2023-07-14T17:47:41.910 INFO:root:teuthology version: 0.0.1.dev145+gaa6a80e 2023-07-14T17:47:41.911 DEBUG:teuthology.run:Teuthology command: teuthology --verbose --description fs:workload/{0-rhel_8 begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/fuse objectstore-ec/bluestore-ec-root omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/multi/{balancer/automatic export-check n/5 replication/always} standby-replay tasks/{0-subvolume/{with-namespace-isolated-and-quota} 1-check-counter 2-scrub/yes 3-snaps/no 4-flush/no 5-workunit/suites/fsx}} --owner scheduled_pdonnell@teuthology --archive /home/teuthworker/archive/pdonnell-2023-07-14_16:44:47-fs:workload-wip-pdonnell-testing-20230714.134335-distro-default-smithi/7337998 --name pdonnell-2023-07-14_16:44:47-fs:workload-wip-pdonnell-testing-20230714.134335-distro-default-smithi -- /home/teuthworker/archive/pdonnell-2023-07-14_16:44:47-fs:workload-wip-pdonnell-testing-20230714.134335-distro-default-smithi/7337998/orig.config.yaml 2023-07-14T17:47:41.968 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-14T17:47:42.082 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/pdonnell-2023-07-14_16:44:47-fs:workload-wip-pdonnell-testing-20230714.134335-distro-default-smithi/7337998 branch: wip-pdonnell-testing-20230714.134335 description: fs:workload/{0-rhel_8 begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/fuse objectstore-ec/bluestore-ec-root omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/multi/{balancer/automatic export-check n/5 replication/always} standby-replay tasks/{0-subvolume/{with-namespace-isolated-and-quota} 1-check-counter 2-scrub/yes 3-snaps/no 4-flush/no 5-workunit/suites/fsx}} email: pdonnell@redhat.com first_in_suite: false job_id: '7337998' kernel: kdb: true sha1: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: pdonnell-2023-07-14_16:44:47-fs:workload-wip-pdonnell-testing-20230714.134335-distro-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: rhel os_version: '8.6' overrides: admin_socket: branch: wip-pdonnell-testing-20230714.134335 ceph: cephfs: ec_profile: - m=2 - k=2 - crush-failure-domain=osd max_mds: 5 session_timeout: 300 standby_replay: true conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds bal fragment size max: 10000 mds bal merge size: 5 mds bal split bits: 3 mds bal split size: 100 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true mds_bal_replicate_threshold: 1 osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: cephsqlite lock renewal timeout: 900000 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 osd shutdown pgref assert: true osd_max_omap_entries_per_request: 10000 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - overall HEALTH_ - \(FS_DEGRADED\) - \(MDS_FAILED\) - \(MDS_DEGRADED\) - \(FS_WITH_FAILED_MDS\) - \(MDS_DAMAGE\) - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(FS_INLINE_DATA_DEPRECATED\) - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - slow metadata IO - SLOW_OPS - slow request sha1: 81c9387d2e7576da065747ec9c16d1c7d69016ec subvols: create: 2 subvol_options: --namespace-isolated --size 25000000000 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: osd default pool size: 2 osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs ceph-fuse: client.0: mount_subvol_num: 0 check-counter: counters: mds: - mds.exported - mds.imported - min: 3 name: mds_cache.dir_update - min: 3 name: mds_cache.dir_update_receipt - mds.dir_split install: ceph: flavor: default sha1: 81c9387d2e7576da065747ec9c16d1c7d69016ec kclient: client.0: mount_subvol_num: 1 selinux: whitelist: - scontext=system_u:system_r:logrotate_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-pdonnell-testing-20230714.134335 sha1: 81c9387d2e7576da065747ec9c16d1c7d69016ec owner: scheduled_pdonnell@teuthology priority: 75 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.x - mds.a - mds.d - mds.g - mds.j - osd.0 - osd.3 - osd.6 - osd.9 - client.0 - - mon.b - mgr.y - mds.b - mds.e - mds.h - mds.k - osd.1 - osd.4 - osd.7 - osd.10 - - mon.c - mgr.z - mds.c - mds.f - mds.i - mds.l - osd.2 - osd.5 - osd.8 - osd.11 seed: 5179 sha1: 81c9387d2e7576da065747ec9c16d1c7d69016ec sleep_before_teardown: 0 subset: 285/512 suite: fs:workload suite_branch: wip-pdonnell-testing-20230714.134335 suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_81c9387d2e7576da065747ec9c16d1c7d69016ec/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: 81c9387d2e7576da065747ec9c16d1c7d69016ec syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi163.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCpUxo5ay/ucdkX9rleNMm8Ofp24XRXUtJPOK3Ji3XBpTiUgmmwneaY6316+3CG+k4K0p3IebanuyTvZApjm02/dNCvu8yD3rjEpWVgIuqYH8O3lEdN9DXcCX+7xHJE0m18+ZPsJQVsNrNJxY+5zqyNnBc8jpZq2LStsWwPOKPWhauANRkOBFSGDoLppWZbLx/yJs+R0qoNLLK9LpKQTUnqsapXvbD27OpPahzj/qbNxFPPyY6XrrldZ6qEO+EjJOujFLH3gzv0kJu10DCuzxrpz6ston4RPi1O3GgcHnF4Mqr/W9VwZ94UTMh+k4dIFRVqJEKrcwRHa5kFsvH/WhVx0Ygr/MiV/Q86mmV7JT+/MpzIRTtWyei5L9IBeZIE9cwzj+mOk6SD/t1roIVEGVV/uF2AyFDVBPr6F8oZ822OGpUyyaDsWTitPNdTX4TC3zdSrLc9tyDa1P74eH/ZLeTSf+C6pM/cepOhQaa6XzpDiPSuJUm9HOQxUlEAvcqa7Ac= smithi172.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCpUxo5ay/ucdkX9rleNMm8Ofp24XRXUtJPOK3Ji3XBpTiUgmmwneaY6316+3CG+k4K0p3IebanuyTvZApjm02/dNCvu8yD3rjEpWVgIuqYH8O3lEdN9DXcCX+7xHJE0m18+ZPsJQVsNrNJxY+5zqyNnBc8jpZq2LStsWwPOKPWhauANRkOBFSGDoLppWZbLx/yJs+R0qoNLLK9LpKQTUnqsapXvbD27OpPahzj/qbNxFPPyY6XrrldZ6qEO+EjJOujFLH3gzv0kJu10DCuzxrpz6ston4RPi1O3GgcHnF4Mqr/W9VwZ94UTMh+k4dIFRVqJEKrcwRHa5kFsvH/WhVx0Ygr/MiV/Q86mmV7JT+/MpzIRTtWyei5L9IBeZIE9cwzj+mOk6SD/t1roIVEGVV/uF2AyFDVBPr6F8oZ822OGpUyyaDsWTitPNdTX4TC3zdSrLc9tyDa1P74eH/ZLeTSf+C6pM/cepOhQaa6XzpDiPSuJUm9HOQxUlEAvcqa7Ac= smithi184.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCpUxo5ay/ucdkX9rleNMm8Ofp24XRXUtJPOK3Ji3XBpTiUgmmwneaY6316+3CG+k4K0p3IebanuyTvZApjm02/dNCvu8yD3rjEpWVgIuqYH8O3lEdN9DXcCX+7xHJE0m18+ZPsJQVsNrNJxY+5zqyNnBc8jpZq2LStsWwPOKPWhauANRkOBFSGDoLppWZbLx/yJs+R0qoNLLK9LpKQTUnqsapXvbD27OpPahzj/qbNxFPPyY6XrrldZ6qEO+EjJOujFLH3gzv0kJu10DCuzxrpz6ston4RPi1O3GgcHnF4Mqr/W9VwZ94UTMh+k4dIFRVqJEKrcwRHa5kFsvH/WhVx0Ygr/MiV/Q86mmV7JT+/MpzIRTtWyei5L9IBeZIE9cwzj+mOk6SD/t1roIVEGVV/uF2AyFDVBPr6F8oZ822OGpUyyaDsWTitPNdTX4TC3zdSrLc9tyDa1P74eH/ZLeTSf+C6pM/cepOhQaa6XzpDiPSuJUm9HOQxUlEAvcqa7Ac= tasks: - pexec: all: - sudo cp /etc/containers/registries.conf /etc/containers/registries.conf.backup - sudo dnf -y module reset container-tools - sudo dnf -y module install container-tools:rhel8 --allowerasing --nobest - sudo cp /etc/containers/registries.conf.backup /etc/containers/registries.conf - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - cephadm: roleless: false - cephadm.shell: mon.a: - ceph orch status - ceph orch ps - ceph orch ls - ceph orch host ls - ceph orch device ls - cephadm.shell: mon.a: - ceph fs dump - ceph osd dump - fs.ready: timeout: 300 - ceph-fuse: null - exec: mon.a: - ceph fs set cephfs balance_automate true - check-counter: {} - fwd_scrub: scrub_timeout: 900 sleep_between_iterations: 1 - workunit: clients: all: - suites/fsx.sh teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return false end - local function is_kdistro() return false end - local function is_fuse() return true end - local function syntax_version() return '' end teuthology_branch: main teuthology_sha1: aa6a80e6cc655fff48452a7eca02070e61d074fc timestamp: 2023-07-14_16:44:47 tube: smithi user: pdonnell verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.23459 2023-07-14T17:47:42.083 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_81c9387d2e7576da065747ec9c16d1c7d69016ec/qa; will attempt to use it 2023-07-14T17:47:42.084 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_81c9387d2e7576da065747ec9c16d1c7d69016ec/qa/tasks 2023-07-14T17:47:42.084 INFO:teuthology.run_tasks:Running task internal.check_packages... 2023-07-14T17:47:42.086 INFO:teuthology.task.internal:Checking packages... 2023-07-14T17:47:42.119 INFO:teuthology.task.internal:Checking packages for os_type 'rhel', flavor 'default' and ceph hash '81c9387d2e7576da065747ec9c16d1c7d69016ec' 2023-07-14T17:47:42.119 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-07-14T17:47:42.120 INFO:teuthology.packaging:ref: None 2023-07-14T17:47:42.120 INFO:teuthology.packaging:tag: None 2023-07-14T17:47:42.120 INFO:teuthology.packaging:branch: wip-pdonnell-testing-20230714.134335 2023-07-14T17:47:42.120 INFO:teuthology.packaging:sha1: 81c9387d2e7576da065747ec9c16d1c7d69016ec 2023-07-14T17:47:42.121 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=wip-pdonnell-testing-20230714.134335 2023-07-14T17:47:46.524 INFO:teuthology.task.internal:Found packages for ceph version 18.0.0-4940.g81c9387d 2023-07-14T17:47:46.525 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2023-07-14T17:47:46.532 INFO:teuthology.task.internal:no buildpackages task found 2023-07-14T17:47:46.533 INFO:teuthology.run_tasks:Running task internal.save_config... 2023-07-14T17:47:46.552 INFO:teuthology.task.internal:Saving configuration 2023-07-14T17:47:46.580 INFO:teuthology.run_tasks:Running task internal.check_lock... 2023-07-14T17:47:46.590 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-07-14T17:48:01.627 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi163.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2023-07-14_16:44:47-fs:workload-wip-pdonnell-testing-20230714.134335-distro-default-smithi/7337998', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-14 17:41:36.212229', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='} 2023-07-14T17:48:06.660 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi172.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2023-07-14_16:44:47-fs:workload-wip-pdonnell-testing-20230714.134335-distro-default-smithi/7337998', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-14 17:41:36.215246', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='} 2023-07-14T17:48:11.694 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi184.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2023-07-14_16:44:47-fs:workload-wip-pdonnell-testing-20230714.134335-distro-default-smithi/7337998', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-14 17:41:36.213859', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='} 2023-07-14T17:48:11.694 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2023-07-14T17:48:11.701 INFO:teuthology.task.internal:roles: ubuntu@smithi163.front.sepia.ceph.com - ['mon.a', 'mgr.x', 'mds.a', 'mds.d', 'mds.g', 'mds.j', 'osd.0', 'osd.3', 'osd.6', 'osd.9', 'client.0'] 2023-07-14T17:48:11.701 INFO:teuthology.task.internal:roles: ubuntu@smithi172.front.sepia.ceph.com - ['mon.b', 'mgr.y', 'mds.b', 'mds.e', 'mds.h', 'mds.k', 'osd.1', 'osd.4', 'osd.7', 'osd.10'] 2023-07-14T17:48:11.702 INFO:teuthology.task.internal:roles: ubuntu@smithi184.front.sepia.ceph.com - ['mon.c', 'mgr.z', 'mds.c', 'mds.f', 'mds.i', 'mds.l', 'osd.2', 'osd.5', 'osd.8', 'osd.11'] 2023-07-14T17:48:11.702 INFO:teuthology.run_tasks:Running task console_log... 2023-07-14T17:48:26.830 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fa3a17ef3a0>, signals=[15]) 2023-07-14T17:48:26.832 INFO:teuthology.run_tasks:Running task internal.connect... 2023-07-14T17:48:26.842 INFO:teuthology.task.internal:Opening connections... 2023-07-14T17:48:26.843 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi163.front.sepia.ceph.com 2023-07-14T17:48:26.845 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-14T17:48:31.919 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi172.front.sepia.ceph.com 2023-07-14T17:48:31.921 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi172.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-14T17:48:36.992 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi184.front.sepia.ceph.com 2023-07-14T17:48:36.993 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi184.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-14T17:48:42.065 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2023-07-14T17:48:42.074 DEBUG:teuthology.orchestra.run.smithi163:> uname -m 2023-07-14T17:48:42.097 INFO:teuthology.orchestra.run.smithi163.stdout:x86_64 2023-07-14T17:48:42.097 DEBUG:teuthology.orchestra.run.smithi163:> cat /etc/os-release 2023-07-14T17:48:42.155 INFO:teuthology.orchestra.run.smithi163.stdout:NAME="Red Hat Enterprise Linux" 2023-07-14T17:48:42.156 INFO:teuthology.orchestra.run.smithi163.stdout:VERSION="8.6 (Ootpa)" 2023-07-14T17:48:42.156 INFO:teuthology.orchestra.run.smithi163.stdout:ID="rhel" 2023-07-14T17:48:42.156 INFO:teuthology.orchestra.run.smithi163.stdout:ID_LIKE="fedora" 2023-07-14T17:48:42.157 INFO:teuthology.orchestra.run.smithi163.stdout:VERSION_ID="8.6" 2023-07-14T17:48:42.157 INFO:teuthology.orchestra.run.smithi163.stdout:PLATFORM_ID="platform:el8" 2023-07-14T17:48:42.157 INFO:teuthology.orchestra.run.smithi163.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-07-14T17:48:42.157 INFO:teuthology.orchestra.run.smithi163.stdout:ANSI_COLOR="0;31" 2023-07-14T17:48:42.157 INFO:teuthology.orchestra.run.smithi163.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-07-14T17:48:42.157 INFO:teuthology.orchestra.run.smithi163.stdout:HOME_URL="https://www.redhat.com/" 2023-07-14T17:48:42.158 INFO:teuthology.orchestra.run.smithi163.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-07-14T17:48:42.158 INFO:teuthology.orchestra.run.smithi163.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-14T17:48:42.158 INFO:teuthology.orchestra.run.smithi163.stdout: 2023-07-14T17:48:42.158 INFO:teuthology.orchestra.run.smithi163.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-07-14T17:48:42.158 INFO:teuthology.orchestra.run.smithi163.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-07-14T17:48:42.158 INFO:teuthology.orchestra.run.smithi163.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-07-14T17:48:42.158 INFO:teuthology.orchestra.run.smithi163.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-07-14T17:48:42.159 INFO:teuthology.lock.ops:Updating smithi163.front.sepia.ceph.com on lock server 2023-07-14T17:48:47.187 DEBUG:teuthology.orchestra.run.smithi172:> uname -m 2023-07-14T17:48:47.209 INFO:teuthology.orchestra.run.smithi172.stdout:x86_64 2023-07-14T17:48:47.210 DEBUG:teuthology.orchestra.run.smithi172:> cat /etc/os-release 2023-07-14T17:48:47.269 INFO:teuthology.orchestra.run.smithi172.stdout:NAME="Red Hat Enterprise Linux" 2023-07-14T17:48:47.269 INFO:teuthology.orchestra.run.smithi172.stdout:VERSION="8.6 (Ootpa)" 2023-07-14T17:48:47.269 INFO:teuthology.orchestra.run.smithi172.stdout:ID="rhel" 2023-07-14T17:48:47.270 INFO:teuthology.orchestra.run.smithi172.stdout:ID_LIKE="fedora" 2023-07-14T17:48:47.270 INFO:teuthology.orchestra.run.smithi172.stdout:VERSION_ID="8.6" 2023-07-14T17:48:47.270 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM_ID="platform:el8" 2023-07-14T17:48:47.270 INFO:teuthology.orchestra.run.smithi172.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-07-14T17:48:47.270 INFO:teuthology.orchestra.run.smithi172.stdout:ANSI_COLOR="0;31" 2023-07-14T17:48:47.270 INFO:teuthology.orchestra.run.smithi172.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-07-14T17:48:47.271 INFO:teuthology.orchestra.run.smithi172.stdout:HOME_URL="https://www.redhat.com/" 2023-07-14T17:48:47.271 INFO:teuthology.orchestra.run.smithi172.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-07-14T17:48:47.271 INFO:teuthology.orchestra.run.smithi172.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-14T17:48:47.271 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-07-14T17:48:47.271 INFO:teuthology.orchestra.run.smithi172.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-07-14T17:48:47.271 INFO:teuthology.orchestra.run.smithi172.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-07-14T17:48:47.271 INFO:teuthology.orchestra.run.smithi172.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-07-14T17:48:47.271 INFO:teuthology.orchestra.run.smithi172.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-07-14T17:48:47.272 INFO:teuthology.lock.ops:Updating smithi172.front.sepia.ceph.com on lock server 2023-07-14T17:48:52.302 DEBUG:teuthology.orchestra.run.smithi184:> uname -m 2023-07-14T17:48:52.324 INFO:teuthology.orchestra.run.smithi184.stdout:x86_64 2023-07-14T17:48:52.325 DEBUG:teuthology.orchestra.run.smithi184:> cat /etc/os-release 2023-07-14T17:48:52.383 INFO:teuthology.orchestra.run.smithi184.stdout:NAME="Red Hat Enterprise Linux" 2023-07-14T17:48:52.384 INFO:teuthology.orchestra.run.smithi184.stdout:VERSION="8.6 (Ootpa)" 2023-07-14T17:48:52.384 INFO:teuthology.orchestra.run.smithi184.stdout:ID="rhel" 2023-07-14T17:48:52.384 INFO:teuthology.orchestra.run.smithi184.stdout:ID_LIKE="fedora" 2023-07-14T17:48:52.385 INFO:teuthology.orchestra.run.smithi184.stdout:VERSION_ID="8.6" 2023-07-14T17:48:52.385 INFO:teuthology.orchestra.run.smithi184.stdout:PLATFORM_ID="platform:el8" 2023-07-14T17:48:52.385 INFO:teuthology.orchestra.run.smithi184.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-07-14T17:48:52.385 INFO:teuthology.orchestra.run.smithi184.stdout:ANSI_COLOR="0;31" 2023-07-14T17:48:52.385 INFO:teuthology.orchestra.run.smithi184.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-07-14T17:48:52.385 INFO:teuthology.orchestra.run.smithi184.stdout:HOME_URL="https://www.redhat.com/" 2023-07-14T17:48:52.385 INFO:teuthology.orchestra.run.smithi184.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-07-14T17:48:52.385 INFO:teuthology.orchestra.run.smithi184.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-14T17:48:52.386 INFO:teuthology.orchestra.run.smithi184.stdout: 2023-07-14T17:48:52.386 INFO:teuthology.orchestra.run.smithi184.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-07-14T17:48:52.386 INFO:teuthology.orchestra.run.smithi184.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-07-14T17:48:52.386 INFO:teuthology.orchestra.run.smithi184.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-07-14T17:48:52.386 INFO:teuthology.orchestra.run.smithi184.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-07-14T17:48:52.386 INFO:teuthology.lock.ops:Updating smithi184.front.sepia.ceph.com on lock server 2023-07-14T17:48:54.394 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2023-07-14T17:48:54.410 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2023-07-14T17:48:54.418 INFO:teuthology.task.internal:Checking for old test directory... 2023-07-14T17:48:54.419 DEBUG:teuthology.orchestra.run.smithi163:> test '!' -e /home/ubuntu/cephtest 2023-07-14T17:48:54.422 DEBUG:teuthology.orchestra.run.smithi172:> test '!' -e /home/ubuntu/cephtest 2023-07-14T17:48:54.424 DEBUG:teuthology.orchestra.run.smithi184:> test '!' -e /home/ubuntu/cephtest 2023-07-14T17:48:54.443 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2023-07-14T17:48:54.453 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2023-07-14T17:48:54.454 DEBUG:teuthology.orchestra.run.smithi163:> test -z $(ls -A /var/lib/ceph) 2023-07-14T17:48:54.481 DEBUG:teuthology.orchestra.run.smithi172:> test -z $(ls -A /var/lib/ceph) 2023-07-14T17:48:54.484 DEBUG:teuthology.orchestra.run.smithi184:> test -z $(ls -A /var/lib/ceph) 2023-07-14T17:48:54.518 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2023-07-14T17:48:54.606 INFO:teuthology.run_tasks:Running task kernel... 2023-07-14T17:48:54.625 INFO:teuthology.task.kernel:normalize config orig: {'kdb': True, 'sha1': 'distro'} 2023-07-14T17:48:54.625 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': True, 'sha1': 'distro'}, 'mon.b': {'kdb': True, 'sha1': 'distro'}, 'mon.c': {'kdb': True, 'sha1': 'distro'}}, timeout 300 2023-07-14T17:48:54.626 DEBUG:teuthology.orchestra.run.smithi163:> test -f /run/.containerenv -o -f /.dockerenv 2023-07-14T17:48:54.627 DEBUG:teuthology.orchestra.run.smithi172:> test -f /run/.containerenv -o -f /.dockerenv 2023-07-14T17:48:54.627 DEBUG:teuthology.orchestra.run.smithi184:> test -f /run/.containerenv -o -f /.dockerenv 2023-07-14T17:48:54.646 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-07-14T17:48:54.647 DEBUG:teuthology.orchestra.run.smithi172:> uname -r 2023-07-14T17:48:54.649 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-07-14T17:48:54.649 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-07-14T17:48:54.651 DEBUG:teuthology.orchestra.run.smithi184:> uname -r 2023-07-14T17:48:54.652 DEBUG:teuthology.orchestra.run.smithi163:> uname -r 2023-07-14T17:48:54.706 INFO:teuthology.orchestra.run.smithi172.stdout:4.18.0-372.9.1.el8.x86_64 2023-07-14T17:48:54.708 INFO:teuthology.task.kernel:Running kernel on smithi172: 4.18.0-372.9.1.el8.x86_64 2023-07-14T17:48:54.709 DEBUG:teuthology.orchestra.run.smithi172:> sudo yum install -y kernel 2023-07-14T17:48:54.710 INFO:teuthology.orchestra.run.smithi184.stdout:4.18.0-372.9.1.el8.x86_64 2023-07-14T17:48:54.710 INFO:teuthology.task.kernel:Running kernel on smithi184: 4.18.0-372.9.1.el8.x86_64 2023-07-14T17:48:54.710 DEBUG:teuthology.orchestra.run.smithi184:> sudo yum install -y kernel 2023-07-14T17:48:54.711 INFO:teuthology.orchestra.run.smithi163.stdout:4.18.0-372.9.1.el8.x86_64 2023-07-14T17:48:54.712 INFO:teuthology.task.kernel:Running kernel on smithi163: 4.18.0-372.9.1.el8.x86_64 2023-07-14T17:48:54.712 DEBUG:teuthology.orchestra.run.smithi163:> sudo yum install -y kernel 2023-07-14T17:48:55.949 INFO:teuthology.orchestra.run.smithi163.stdout:Updating Subscription Management repositories. 2023-07-14T17:48:55.950 INFO:teuthology.orchestra.run.smithi163.stdout:Unable to read consumer identity 2023-07-14T17:48:55.982 INFO:teuthology.orchestra.run.smithi184.stdout:Updating Subscription Management repositories. 2023-07-14T17:48:55.982 INFO:teuthology.orchestra.run.smithi184.stdout:Unable to read consumer identity 2023-07-14T17:48:56.011 INFO:teuthology.orchestra.run.smithi172.stdout:Updating Subscription Management repositories. 2023-07-14T17:48:56.012 INFO:teuthology.orchestra.run.smithi172.stdout:Unable to read consumer identity 2023-07-14T17:48:57.528 INFO:teuthology.orchestra.run.smithi163.stdout:Copr repo for python3-asyncssh owned by ceph 13 kB/s | 3.5 kB 00:00 2023-07-14T17:48:57.529 INFO:teuthology.orchestra.run.smithi172.stdout:Copr repo for python3-asyncssh owned by ceph 13 kB/s | 3.5 kB 00:00 2023-07-14T17:48:57.538 INFO:teuthology.orchestra.run.smithi184.stdout:Copr repo for python3-asyncssh owned by ceph 14 kB/s | 3.5 kB 00:00 2023-07-14T17:49:00.345 INFO:teuthology.orchestra.run.smithi163.stdout:Extra Packages for Enterprise Linux 5.6 MB/s | 16 MB 00:02 2023-07-14T17:49:00.388 INFO:teuthology.orchestra.run.smithi172.stdout:Extra Packages for Enterprise Linux 5.5 MB/s | 16 MB 00:02 2023-07-14T17:49:00.514 INFO:teuthology.orchestra.run.smithi184.stdout:Extra Packages for Enterprise Linux 5.3 MB/s | 16 MB 00:02 2023-07-14T17:49:03.762 INFO:teuthology.orchestra.run.smithi163.stdout:lab-extras 414 kB/s | 24 kB 00:00 2023-07-14T17:49:03.829 INFO:teuthology.orchestra.run.smithi172.stdout:lab-extras 463 kB/s | 24 kB 00:00 2023-07-14T17:49:03.972 INFO:teuthology.orchestra.run.smithi184.stdout:lab-extras 402 kB/s | 24 kB 00:00 2023-07-14T17:49:04.448 INFO:teuthology.orchestra.run.smithi163.stdout:Package kernel-4.18.0-372.9.1.el8.x86_64 is already installed. 2023-07-14T17:49:04.490 INFO:teuthology.orchestra.run.smithi172.stdout:Package kernel-4.18.0-372.9.1.el8.x86_64 is already installed. 2023-07-14T17:49:04.500 INFO:teuthology.orchestra.run.smithi163.stdout:Dependencies resolved. 2023-07-14T17:49:04.501 INFO:teuthology.orchestra.run.smithi163.stdout:Nothing to do. 2023-07-14T17:49:04.501 INFO:teuthology.orchestra.run.smithi163.stdout:Complete! 2023-07-14T17:49:04.544 INFO:teuthology.orchestra.run.smithi172.stdout:Dependencies resolved. 2023-07-14T17:49:04.547 INFO:teuthology.orchestra.run.smithi172.stdout:Nothing to do. 2023-07-14T17:49:04.547 INFO:teuthology.orchestra.run.smithi172.stdout:Complete! 2023-07-14T17:49:04.629 DEBUG:teuthology.orchestra.run.smithi163:> echo no | sudo yum reinstall kernel || true 2023-07-14T17:49:04.643 INFO:teuthology.orchestra.run.smithi184.stdout:Package kernel-4.18.0-372.9.1.el8.x86_64 is already installed. 2023-07-14T17:49:04.675 DEBUG:teuthology.orchestra.run.smithi172:> echo no | sudo yum reinstall kernel || true 2023-07-14T17:49:04.699 INFO:teuthology.orchestra.run.smithi184.stdout:Dependencies resolved. 2023-07-14T17:49:04.701 INFO:teuthology.orchestra.run.smithi184.stdout:Nothing to do. 2023-07-14T17:49:04.701 INFO:teuthology.orchestra.run.smithi184.stdout:Complete! 2023-07-14T17:49:04.831 DEBUG:teuthology.orchestra.run.smithi184:> echo no | sudo yum reinstall kernel || true 2023-07-14T17:49:04.960 INFO:teuthology.orchestra.run.smithi163.stdout:Updating Subscription Management repositories. 2023-07-14T17:49:04.960 INFO:teuthology.orchestra.run.smithi163.stdout:Unable to read consumer identity 2023-07-14T17:49:05.007 INFO:teuthology.orchestra.run.smithi172.stdout:Updating Subscription Management repositories. 2023-07-14T17:49:05.007 INFO:teuthology.orchestra.run.smithi172.stdout:Unable to read consumer identity 2023-07-14T17:49:05.202 INFO:teuthology.orchestra.run.smithi184.stdout:Updating Subscription Management repositories. 2023-07-14T17:49:05.202 INFO:teuthology.orchestra.run.smithi184.stdout:Unable to read consumer identity 2023-07-14T17:49:05.227 INFO:teuthology.orchestra.run.smithi163.stdout:Last metadata expiration check: 0:00:02 ago on Fri 14 Jul 2023 05:49:03 PM UTC. 2023-07-14T17:49:05.268 INFO:teuthology.orchestra.run.smithi163.stdout:Installed package kernel-4.18.0-372.9.1.el8.x86_64 (from anaconda) not available. 2023-07-14T17:49:05.273 INFO:teuthology.orchestra.run.smithi172.stdout:Last metadata expiration check: 0:00:02 ago on Fri 14 Jul 2023 05:49:03 PM UTC. 2023-07-14T17:49:05.313 INFO:teuthology.orchestra.run.smithi163.stderr:Error: No packages marked for reinstall. 2023-07-14T17:49:05.314 INFO:teuthology.orchestra.run.smithi172.stdout:Installed package kernel-4.18.0-372.9.1.el8.x86_64 (from anaconda) not available. 2023-07-14T17:49:05.359 DEBUG:teuthology.orchestra.run.smithi163:> sudo yum reinstall -y kernel || true 2023-07-14T17:49:05.362 INFO:teuthology.orchestra.run.smithi172.stderr:Error: No packages marked for reinstall. 2023-07-14T17:49:05.409 DEBUG:teuthology.orchestra.run.smithi172:> sudo yum reinstall -y kernel || true 2023-07-14T17:49:05.465 INFO:teuthology.orchestra.run.smithi184.stdout:Last metadata expiration check: 0:00:02 ago on Fri 14 Jul 2023 05:49:03 PM UTC. 2023-07-14T17:49:05.522 INFO:teuthology.orchestra.run.smithi184.stdout:Installed package kernel-4.18.0-372.9.1.el8.x86_64 (from anaconda) not available. 2023-07-14T17:49:05.565 INFO:teuthology.orchestra.run.smithi184.stderr:Error: No packages marked for reinstall. 2023-07-14T17:49:05.611 DEBUG:teuthology.orchestra.run.smithi184:> sudo yum reinstall -y kernel || true 2023-07-14T17:49:05.691 INFO:teuthology.orchestra.run.smithi163.stdout:Updating Subscription Management repositories. 2023-07-14T17:49:05.691 INFO:teuthology.orchestra.run.smithi163.stdout:Unable to read consumer identity 2023-07-14T17:49:05.737 INFO:teuthology.orchestra.run.smithi172.stdout:Updating Subscription Management repositories. 2023-07-14T17:49:05.737 INFO:teuthology.orchestra.run.smithi172.stdout:Unable to read consumer identity 2023-07-14T17:49:05.939 INFO:teuthology.orchestra.run.smithi184.stdout:Updating Subscription Management repositories. 2023-07-14T17:49:05.940 INFO:teuthology.orchestra.run.smithi184.stdout:Unable to read consumer identity 2023-07-14T17:49:05.952 INFO:teuthology.orchestra.run.smithi163.stdout:Last metadata expiration check: 0:00:02 ago on Fri 14 Jul 2023 05:49:03 PM UTC. 2023-07-14T17:49:05.992 INFO:teuthology.orchestra.run.smithi163.stdout:Installed package kernel-4.18.0-372.9.1.el8.x86_64 (from anaconda) not available. 2023-07-14T17:49:05.997 INFO:teuthology.orchestra.run.smithi172.stdout:Last metadata expiration check: 0:00:03 ago on Fri 14 Jul 2023 05:49:03 PM UTC. 2023-07-14T17:49:06.024 INFO:teuthology.orchestra.run.smithi163.stderr:Error: No packages marked for reinstall. 2023-07-14T17:49:06.039 INFO:teuthology.orchestra.run.smithi172.stdout:Installed package kernel-4.18.0-372.9.1.el8.x86_64 (from anaconda) not available. 2023-07-14T17:49:06.059 INFO:teuthology.orchestra.run.smithi172.stderr:Error: No packages marked for reinstall. 2023-07-14T17:49:06.075 DEBUG:teuthology.orchestra.run.smithi163:> rpm -q kernel | sort -rV | head -n 1 2023-07-14T17:49:06.105 DEBUG:teuthology.orchestra.run.smithi172:> rpm -q kernel | sort -rV | head -n 1 2023-07-14T17:49:06.154 INFO:teuthology.orchestra.run.smithi163.stdout:kernel-4.18.0-372.9.1.el8.x86_64 2023-07-14T17:49:06.155 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-372.9.1.el8.x86_64 2023-07-14T17:49:06.156 INFO:teuthology.task.kernel:Newest distro kernel installed and running 2023-07-14T17:49:06.156 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2023-07-14T17:49:06.156 DEBUG:teuthology.orchestra.run.smithi163:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2023-07-14T17:49:06.182 INFO:teuthology.orchestra.run.smithi163.stdout:ttyS1 2023-07-14T17:49:06.184 INFO:teuthology.orchestra.run.smithi172.stdout:kernel-4.18.0-372.9.1.el8.x86_64 2023-07-14T17:49:06.185 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-372.9.1.el8.x86_64 2023-07-14T17:49:06.185 INFO:teuthology.task.kernel:Newest distro kernel installed and running 2023-07-14T17:49:06.185 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2023-07-14T17:49:06.186 DEBUG:teuthology.orchestra.run.smithi172:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2023-07-14T17:49:06.198 DEBUG:teuthology.parallel:result is None 2023-07-14T17:49:06.200 INFO:teuthology.orchestra.run.smithi184.stdout:Last metadata expiration check: 0:00:03 ago on Fri 14 Jul 2023 05:49:03 PM UTC. 2023-07-14T17:49:06.214 INFO:teuthology.orchestra.run.smithi172.stdout:ttyS1 2023-07-14T17:49:06.230 DEBUG:teuthology.parallel:result is None 2023-07-14T17:49:06.240 INFO:teuthology.orchestra.run.smithi184.stdout:Installed package kernel-4.18.0-372.9.1.el8.x86_64 (from anaconda) not available. 2023-07-14T17:49:06.274 INFO:teuthology.orchestra.run.smithi184.stderr:Error: No packages marked for reinstall. 2023-07-14T17:49:06.324 DEBUG:teuthology.orchestra.run.smithi184:> rpm -q kernel | sort -rV | head -n 1 2023-07-14T17:49:06.404 INFO:teuthology.orchestra.run.smithi184.stdout:kernel-4.18.0-372.9.1.el8.x86_64 2023-07-14T17:49:06.405 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-372.9.1.el8.x86_64 2023-07-14T17:49:06.405 INFO:teuthology.task.kernel:Newest distro kernel installed and running 2023-07-14T17:49:06.405 INFO:teuthology.task.kernel:Enabling kdb on mon.c... 2023-07-14T17:49:06.406 DEBUG:teuthology.orchestra.run.smithi184:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2023-07-14T17:49:06.431 INFO:teuthology.orchestra.run.smithi184.stdout:ttyS1 2023-07-14T17:49:06.446 DEBUG:teuthology.parallel:result is None 2023-07-14T17:49:06.446 INFO:teuthology.run_tasks:Running task internal.base... 2023-07-14T17:49:06.454 INFO:teuthology.task.internal:Creating test directory... 2023-07-14T17:49:06.454 DEBUG:teuthology.orchestra.run.smithi163:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-07-14T17:49:06.456 DEBUG:teuthology.orchestra.run.smithi172:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-07-14T17:49:06.458 DEBUG:teuthology.orchestra.run.smithi184:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-07-14T17:49:06.502 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2023-07-14T17:49:06.509 INFO:teuthology.run_tasks:Running task internal.archive... 2023-07-14T17:49:06.516 INFO:teuthology.task.internal:Creating archive directory... 2023-07-14T17:49:06.516 DEBUG:teuthology.orchestra.run.smithi163:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-07-14T17:49:06.519 DEBUG:teuthology.orchestra.run.smithi172:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-07-14T17:49:06.521 DEBUG:teuthology.orchestra.run.smithi184:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-07-14T17:49:06.564 INFO:teuthology.run_tasks:Running task internal.coredump... 2023-07-14T17:49:06.571 INFO:teuthology.task.internal:Enabling coredump saving... 2023-07-14T17:49:06.571 DEBUG:teuthology.orchestra.run.smithi163:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-07-14T17:49:06.599 DEBUG:teuthology.orchestra.run.smithi172:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-07-14T17:49:06.601 DEBUG:teuthology.orchestra.run.smithi184:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-07-14T17:49:06.631 INFO:teuthology.orchestra.run.smithi163.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-07-14T17:49:06.636 INFO:teuthology.orchestra.run.smithi184.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-07-14T17:49:06.637 INFO:teuthology.orchestra.run.smithi172.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-07-14T17:49:06.641 INFO:teuthology.orchestra.run.smithi163.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-07-14T17:49:06.646 INFO:teuthology.orchestra.run.smithi184.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-07-14T17:49:06.647 INFO:teuthology.orchestra.run.smithi172.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-07-14T17:49:06.649 INFO:teuthology.run_tasks:Running task internal.sudo... 2023-07-14T17:49:06.656 INFO:teuthology.task.internal:Configuring sudo... 2023-07-14T17:49:06.656 DEBUG:teuthology.orchestra.run.smithi163:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-07-14T17:49:06.684 DEBUG:teuthology.orchestra.run.smithi172:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-07-14T17:49:06.690 DEBUG:teuthology.orchestra.run.smithi184:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-07-14T17:49:06.716 INFO:teuthology.run_tasks:Running task internal.syslog... 2023-07-14T17:49:06.725 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2023-07-14T17:49:06.726 DEBUG:teuthology.orchestra.run.smithi163:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-07-14T17:49:06.753 DEBUG:teuthology.orchestra.run.smithi172:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-07-14T17:49:06.757 DEBUG:teuthology.orchestra.run.smithi184:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-07-14T17:49:06.773 DEBUG:teuthology.orchestra.run.smithi163:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-07-14T17:49:11.854 DEBUG:teuthology.orchestra.run.smithi163:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-07-14T17:49:11.897 DEBUG:teuthology.orchestra.run.smithi163:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-07-14T17:49:16.993 DEBUG:teuthology.orchestra.run.smithi163:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-07-14T17:49:17.026 DEBUG:teuthology.orchestra.run.smithi163:> set -ex 2023-07-14T17:49:17.027 DEBUG:teuthology.orchestra.run.smithi163:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-07-14T17:49:17.098 DEBUG:teuthology.orchestra.run.smithi172:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-07-14T17:49:19.882 DEBUG:teuthology.orchestra.run.smithi172:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-07-14T17:49:19.939 DEBUG:teuthology.orchestra.run.smithi172:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-07-14T17:49:19.988 DEBUG:teuthology.orchestra.run.smithi172:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-07-14T17:49:20.031 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2023-07-14T17:49:20.031 DEBUG:teuthology.orchestra.run.smithi172:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-07-14T17:49:20.100 DEBUG:teuthology.orchestra.run.smithi184:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-07-14T17:49:20.150 DEBUG:teuthology.orchestra.run.smithi184:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-07-14T17:49:20.214 DEBUG:teuthology.orchestra.run.smithi184:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-07-14T17:49:20.263 DEBUG:teuthology.orchestra.run.smithi184:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-07-14T17:49:20.303 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2023-07-14T17:49:20.303 DEBUG:teuthology.orchestra.run.smithi184:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-07-14T17:49:20.372 DEBUG:teuthology.orchestra.run.smithi163:> sudo service rsyslog restart 2023-07-14T17:49:20.374 DEBUG:teuthology.orchestra.run.smithi172:> sudo service rsyslog restart 2023-07-14T17:49:20.377 DEBUG:teuthology.orchestra.run.smithi184:> sudo service rsyslog restart 2023-07-14T17:49:20.440 INFO:teuthology.orchestra.run.smithi172.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-07-14T17:49:20.443 INFO:teuthology.orchestra.run.smithi163.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-07-14T17:49:20.471 INFO:teuthology.orchestra.run.smithi184.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-07-14T17:49:20.728 INFO:teuthology.run_tasks:Running task internal.timer... 2023-07-14T17:49:20.737 INFO:teuthology.task.internal:Starting timer... 2023-07-14T17:49:20.738 INFO:teuthology.run_tasks:Running task pcp... 2023-07-14T17:49:20.753 INFO:teuthology.run_tasks:Running task selinux... 2023-07-14T17:49:20.767 DEBUG:teuthology.task:Applying overrides for task selinux: {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0']} 2023-07-14T17:49:20.768 DEBUG:teuthology.orchestra.run.smithi163:> sudo service auditd rotate 2023-07-14T17:49:20.832 INFO:teuthology.orchestra.run.smithi163.stdout:Rotating logs: 2023-07-14T17:49:20.834 DEBUG:teuthology.orchestra.run.smithi172:> sudo service auditd rotate 2023-07-14T17:49:20.907 INFO:teuthology.orchestra.run.smithi172.stdout:Rotating logs: 2023-07-14T17:49:20.908 DEBUG:teuthology.orchestra.run.smithi184:> sudo service auditd rotate 2023-07-14T17:49:20.989 INFO:teuthology.orchestra.run.smithi184.stdout:Rotating logs: 2023-07-14T17:49:20.991 DEBUG:teuthology.task.selinux:Getting current SELinux state 2023-07-14T17:49:20.991 DEBUG:teuthology.orchestra.run.smithi163:> /usr/sbin/getenforce 2023-07-14T17:49:21.011 INFO:teuthology.orchestra.run.smithi163.stdout:Permissive 2023-07-14T17:49:21.012 DEBUG:teuthology.orchestra.run.smithi172:> /usr/sbin/getenforce 2023-07-14T17:49:21.041 INFO:teuthology.orchestra.run.smithi172.stdout:Permissive 2023-07-14T17:49:21.041 DEBUG:teuthology.orchestra.run.smithi184:> /usr/sbin/getenforce 2023-07-14T17:49:21.068 INFO:teuthology.orchestra.run.smithi184.stdout:Permissive 2023-07-14T17:49:21.068 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi163.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi172.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi184.front.sepia.ceph.com': 'permissive'} 2023-07-14T17:49:21.069 DEBUG:teuthology.orchestra.run.smithi163:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-07-14T17:49:21.096 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-07-14T17:49:21.097 DEBUG:teuthology.orchestra.run.smithi172:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-07-14T17:49:21.124 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-07-14T17:49:21.125 DEBUG:teuthology.orchestra.run.smithi184:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-07-14T17:49:21.152 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-07-14T17:49:21.153 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2023-07-14T17:49:21.154 DEBUG:teuthology.orchestra.run.smithi163:> sudo /usr/sbin/setenforce permissive 2023-07-14T17:49:21.181 DEBUG:teuthology.orchestra.run.smithi172:> sudo /usr/sbin/setenforce permissive 2023-07-14T17:49:21.209 DEBUG:teuthology.orchestra.run.smithi184:> sudo /usr/sbin/setenforce permissive 2023-07-14T17:49:21.236 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2023-07-14T17:49:21.246 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2023-07-14T17:49:21.254 INFO:teuthology.repo_utils:Fetching main from origin 2023-07-14T17:49:21.394 INFO:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2023-07-14T17:49:21.419 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2023-07-14T17:49:21.421 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi163.front.sepia.ceph.com,smithi172.front.sepia.ceph.com,smithi184.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2023-07-14T17:59:42.603 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi163.front.sepia.ceph.com'), Remote(name='ubuntu@smithi172.front.sepia.ceph.com'), Remote(name='ubuntu@smithi184.front.sepia.ceph.com')] 2023-07-14T17:59:42.605 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi163.front.sepia.ceph.com' 2023-07-14T17:59:42.606 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-14T17:59:42.675 DEBUG:teuthology.orchestra.run.smithi163:> true 2023-07-14T17:59:42.746 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi163.front.sepia.ceph.com' 2023-07-14T17:59:42.747 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi172.front.sepia.ceph.com' 2023-07-14T17:59:42.747 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi172.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-14T17:59:42.815 DEBUG:teuthology.orchestra.run.smithi172:> true 2023-07-14T17:59:42.882 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi172.front.sepia.ceph.com' 2023-07-14T17:59:42.883 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi184.front.sepia.ceph.com' 2023-07-14T17:59:42.883 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi184.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-14T17:59:42.952 DEBUG:teuthology.orchestra.run.smithi184:> true 2023-07-14T17:59:43.024 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi184.front.sepia.ceph.com' 2023-07-14T17:59:43.024 INFO:teuthology.run_tasks:Running task clock... 2023-07-14T17:59:43.035 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2023-07-14T17:59:43.035 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-07-14T17:59:43.036 DEBUG:teuthology.orchestra.run.smithi163:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-07-14T17:59:43.038 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-07-14T17:59:43.039 DEBUG:teuthology.orchestra.run.smithi172:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-07-14T17:59:43.041 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-07-14T17:59:43.041 DEBUG:teuthology.orchestra.run.smithi184:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-07-14T17:59:43.070 INFO:teuthology.orchestra.run.smithi163.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-07-14T17:59:43.072 INFO:teuthology.orchestra.run.smithi172.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-07-14T17:59:43.086 INFO:teuthology.orchestra.run.smithi163.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-07-14T17:59:43.087 INFO:teuthology.orchestra.run.smithi172.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-07-14T17:59:43.096 INFO:teuthology.orchestra.run.smithi184.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-07-14T17:59:43.111 INFO:teuthology.orchestra.run.smithi184.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-07-14T17:59:43.157 INFO:teuthology.orchestra.run.smithi163.stderr:sudo: ntpd: command not found 2023-07-14T17:59:43.163 INFO:teuthology.orchestra.run.smithi172.stderr:sudo: ntpd: command not found 2023-07-14T17:59:43.169 INFO:teuthology.orchestra.run.smithi163.stdout:506 Cannot talk to daemon 2023-07-14T17:59:43.176 INFO:teuthology.orchestra.run.smithi172.stdout:506 Cannot talk to daemon 2023-07-14T17:59:43.185 INFO:teuthology.orchestra.run.smithi163.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-07-14T17:59:43.189 INFO:teuthology.orchestra.run.smithi184.stderr:sudo: ntpd: command not found 2023-07-14T17:59:43.190 INFO:teuthology.orchestra.run.smithi172.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-07-14T17:59:43.199 INFO:teuthology.orchestra.run.smithi163.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-07-14T17:59:43.201 INFO:teuthology.orchestra.run.smithi184.stdout:506 Cannot talk to daemon 2023-07-14T17:59:43.204 INFO:teuthology.orchestra.run.smithi172.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-07-14T17:59:43.215 INFO:teuthology.orchestra.run.smithi184.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-07-14T17:59:43.230 INFO:teuthology.orchestra.run.smithi184.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-07-14T17:59:43.262 INFO:teuthology.orchestra.run.smithi172.stderr:bash: ntpq: command not found 2023-07-14T17:59:43.266 INFO:teuthology.orchestra.run.smithi172.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-07-14T17:59:43.266 INFO:teuthology.orchestra.run.smithi172.stdout:=============================================================================== 2023-07-14T17:59:43.267 INFO:teuthology.orchestra.run.smithi172.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-07-14T17:59:43.267 INFO:teuthology.orchestra.run.smithi172.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-07-14T17:59:43.267 INFO:teuthology.orchestra.run.smithi172.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-07-14T17:59:43.267 INFO:teuthology.orchestra.run.smithi172.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-07-14T17:59:43.272 INFO:teuthology.orchestra.run.smithi163.stderr:bash: ntpq: command not found 2023-07-14T17:59:43.277 INFO:teuthology.orchestra.run.smithi163.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-07-14T17:59:43.277 INFO:teuthology.orchestra.run.smithi163.stdout:=============================================================================== 2023-07-14T17:59:43.277 INFO:teuthology.orchestra.run.smithi163.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-07-14T17:59:43.278 INFO:teuthology.orchestra.run.smithi163.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-07-14T17:59:43.278 INFO:teuthology.orchestra.run.smithi163.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-07-14T17:59:43.278 INFO:teuthology.orchestra.run.smithi163.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-07-14T17:59:43.302 INFO:teuthology.orchestra.run.smithi184.stderr:bash: ntpq: command not found 2023-07-14T17:59:43.306 INFO:teuthology.orchestra.run.smithi184.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-07-14T17:59:43.306 INFO:teuthology.orchestra.run.smithi184.stdout:=============================================================================== 2023-07-14T17:59:43.306 INFO:teuthology.orchestra.run.smithi184.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-07-14T17:59:43.306 INFO:teuthology.orchestra.run.smithi184.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-07-14T17:59:43.306 INFO:teuthology.orchestra.run.smithi184.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-07-14T17:59:43.307 INFO:teuthology.orchestra.run.smithi184.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-07-14T17:59:43.308 INFO:teuthology.run_tasks:Running task pexec... 2023-07-14T17:59:43.321 INFO:teuthology.task.pexec:Executing custom commands... 2023-07-14T17:59:43.322 INFO:teuthology.task.pexec:Running commands on host ubuntu@smithi163.front.sepia.ceph.com 2023-07-14T17:59:43.322 DEBUG:teuthology.orchestra.run.smithi163:> TESTDIR=/home/ubuntu/cephtest bash -s 2023-07-14T17:59:43.323 INFO:teuthology.task.pexec:Running commands on host ubuntu@smithi172.front.sepia.ceph.com 2023-07-14T17:59:43.323 DEBUG:teuthology.orchestra.run.smithi172:> TESTDIR=/home/ubuntu/cephtest bash -s 2023-07-14T17:59:43.324 INFO:teuthology.task.pexec:Running commands on host ubuntu@smithi184.front.sepia.ceph.com 2023-07-14T17:59:43.324 DEBUG:teuthology.orchestra.run.smithi184:> TESTDIR=/home/ubuntu/cephtest bash -s 2023-07-14T17:59:43.696 INFO:teuthology.orchestra.run.smithi163.stdout:Updating Subscription Management repositories. 2023-07-14T17:59:43.697 INFO:teuthology.orchestra.run.smithi172.stdout:Updating Subscription Management repositories. 2023-07-14T17:59:43.718 INFO:teuthology.orchestra.run.smithi184.stdout:Updating Subscription Management repositories. 2023-07-14T17:59:45.413 INFO:teuthology.orchestra.run.smithi172.stdout:Last metadata expiration check: 0:01:44 ago on Fri 14 Jul 2023 05:58:00 PM UTC. 2023-07-14T17:59:45.440 INFO:teuthology.orchestra.run.smithi184.stdout:Last metadata expiration check: 0:02:05 ago on Fri 14 Jul 2023 05:57:39 PM UTC. 2023-07-14T17:59:45.445 INFO:teuthology.orchestra.run.smithi163.stdout:Last metadata expiration check: 0:01:55 ago on Fri 14 Jul 2023 05:57:49 PM UTC. 2023-07-14T17:59:47.166 INFO:teuthology.orchestra.run.smithi163.stdout:Dependencies resolved. 2023-07-14T17:59:47.167 INFO:teuthology.orchestra.run.smithi163.stdout:================================================================================ 2023-07-14T17:59:47.167 INFO:teuthology.orchestra.run.smithi163.stdout: Package Architecture Version Repository Size 2023-07-14T17:59:47.167 INFO:teuthology.orchestra.run.smithi163.stdout:================================================================================ 2023-07-14T17:59:47.167 INFO:teuthology.orchestra.run.smithi163.stdout:Resetting modules: 2023-07-14T17:59:47.167 INFO:teuthology.orchestra.run.smithi163.stdout: container-tools 2023-07-14T17:59:47.168 INFO:teuthology.orchestra.run.smithi163.stdout: 2023-07-14T17:59:47.168 INFO:teuthology.orchestra.run.smithi163.stdout:Transaction Summary 2023-07-14T17:59:47.168 INFO:teuthology.orchestra.run.smithi163.stdout:================================================================================ 2023-07-14T17:59:47.168 INFO:teuthology.orchestra.run.smithi163.stdout: 2023-07-14T17:59:47.172 INFO:teuthology.orchestra.run.smithi184.stdout:Dependencies resolved. 2023-07-14T17:59:47.174 INFO:teuthology.orchestra.run.smithi184.stdout:================================================================================ 2023-07-14T17:59:47.174 INFO:teuthology.orchestra.run.smithi184.stdout: Package Architecture Version Repository Size 2023-07-14T17:59:47.174 INFO:teuthology.orchestra.run.smithi184.stdout:================================================================================ 2023-07-14T17:59:47.174 INFO:teuthology.orchestra.run.smithi184.stdout:Resetting modules: 2023-07-14T17:59:47.174 INFO:teuthology.orchestra.run.smithi184.stdout: container-tools 2023-07-14T17:59:47.174 INFO:teuthology.orchestra.run.smithi184.stdout: 2023-07-14T17:59:47.175 INFO:teuthology.orchestra.run.smithi184.stdout:Transaction Summary 2023-07-14T17:59:47.175 INFO:teuthology.orchestra.run.smithi184.stdout:================================================================================ 2023-07-14T17:59:47.175 INFO:teuthology.orchestra.run.smithi184.stdout: 2023-07-14T17:59:47.292 INFO:teuthology.orchestra.run.smithi172.stdout:Dependencies resolved. 2023-07-14T17:59:47.293 INFO:teuthology.orchestra.run.smithi172.stdout:================================================================================ 2023-07-14T17:59:47.293 INFO:teuthology.orchestra.run.smithi172.stdout: Package Architecture Version Repository Size 2023-07-14T17:59:47.293 INFO:teuthology.orchestra.run.smithi172.stdout:================================================================================ 2023-07-14T17:59:47.293 INFO:teuthology.orchestra.run.smithi172.stdout:Resetting modules: 2023-07-14T17:59:47.294 INFO:teuthology.orchestra.run.smithi172.stdout: container-tools 2023-07-14T17:59:47.294 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-07-14T17:59:47.294 INFO:teuthology.orchestra.run.smithi172.stdout:Transaction Summary 2023-07-14T17:59:47.294 INFO:teuthology.orchestra.run.smithi172.stdout:================================================================================ 2023-07-14T17:59:47.294 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-07-14T17:59:48.120 INFO:teuthology.orchestra.run.smithi163.stdout:Last metadata expiration check: 0:01:58 ago on Fri 14 Jul 2023 05:57:49 PM UTC. 2023-07-14T17:59:48.153 INFO:teuthology.orchestra.run.smithi184.stdout:Last metadata expiration check: 0:02:08 ago on Fri 14 Jul 2023 05:57:39 PM UTC. 2023-07-14T17:59:48.247 INFO:teuthology.orchestra.run.smithi172.stdout:Last metadata expiration check: 0:01:47 ago on Fri 14 Jul 2023 05:58:00 PM UTC. 2023-07-14T17:59:56.138 INFO:teuthology.orchestra.run.smithi163.stdout:Complete! 2023-07-14T17:59:56.607 INFO:teuthology.orchestra.run.smithi163.stdout:Updating Subscription Management repositories. 2023-07-14T17:59:56.698 INFO:teuthology.orchestra.run.smithi184.stdout:Complete! 2023-07-14T17:59:57.162 INFO:teuthology.orchestra.run.smithi184.stdout:Updating Subscription Management repositories. 2023-07-14T17:59:57.578 INFO:teuthology.orchestra.run.smithi172.stdout:Complete! 2023-07-14T17:59:58.046 INFO:teuthology.orchestra.run.smithi172.stdout:Updating Subscription Management repositories. 2023-07-14T17:59:58.161 INFO:teuthology.orchestra.run.smithi163.stdout:Last metadata expiration check: 0:02:08 ago on Fri 14 Jul 2023 05:57:49 PM UTC. 2023-07-14T17:59:58.610 INFO:teuthology.orchestra.run.smithi184.stdout:Last metadata expiration check: 0:02:19 ago on Fri 14 Jul 2023 05:57:39 PM UTC. 2023-07-14T17:59:59.461 INFO:teuthology.orchestra.run.smithi172.stdout:Last metadata expiration check: 0:01:59 ago on Fri 14 Jul 2023 05:58:00 PM UTC. 2023-07-14T18:00:00.019 INFO:teuthology.orchestra.run.smithi163.stdout:Dependencies resolved. 2023-07-14T18:00:00.114 INFO:teuthology.orchestra.run.smithi163.stdout:============================================================================================================ 2023-07-14T18:00:00.114 INFO:teuthology.orchestra.run.smithi163.stdout: Package Arch Version Repository Size 2023-07-14T18:00:00.114 INFO:teuthology.orchestra.run.smithi163.stdout:============================================================================================================ 2023-07-14T18:00:00.114 INFO:teuthology.orchestra.run.smithi163.stdout:Installing group/module packages: 2023-07-14T18:00:00.114 INFO:teuthology.orchestra.run.smithi163.stdout: buildah x86_64 1:1.26.2-1.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 8.0 M 2023-07-14T18:00:00.115 INFO:teuthology.orchestra.run.smithi163.stdout: cockpit-podman noarch 49.1-1.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 524 k 2023-07-14T18:00:00.115 INFO:teuthology.orchestra.run.smithi163.stdout: crun x86_64 1.5-1.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 213 k 2023-07-14T18:00:00.115 INFO:teuthology.orchestra.run.smithi163.stdout: python3-podman noarch 4.0.1-1.module+el8.6.0+16837+85b82211 rhel-8-for-x86_64-appstream-rpms 149 k 2023-07-14T18:00:00.115 INFO:teuthology.orchestra.run.smithi163.stdout: skopeo x86_64 2:1.9.1-1.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 7.0 M 2023-07-14T18:00:00.115 INFO:teuthology.orchestra.run.smithi163.stdout: toolbox x86_64 0.0.99.3-0.6.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 2.2 M 2023-07-14T18:00:00.115 INFO:teuthology.orchestra.run.smithi163.stdout: udica noarch 0.2.6-4.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 49 k 2023-07-14T18:00:00.115 INFO:teuthology.orchestra.run.smithi163.stdout:Installing dependencies: 2023-07-14T18:00:00.115 INFO:teuthology.orchestra.run.smithi163.stdout: python3-pytoml noarch 0.1.14-5.git7dea353.el8 rhel-8-for-x86_64-appstream-rpms 25 k 2023-07-14T18:00:00.116 INFO:teuthology.orchestra.run.smithi163.stdout: python3-pyxdg noarch 0.25-16.el8 rhel-8-for-x86_64-appstream-rpms 94 k 2023-07-14T18:00:00.116 INFO:teuthology.orchestra.run.smithi163.stdout: yajl x86_64 2.1.0-10.el8 rhel-8-for-x86_64-appstream-rpms 41 k 2023-07-14T18:00:00.116 INFO:teuthology.orchestra.run.smithi163.stdout:Installing module profiles: 2023-07-14T18:00:00.116 INFO:teuthology.orchestra.run.smithi163.stdout: container-tools/common 2023-07-14T18:00:00.116 INFO:teuthology.orchestra.run.smithi163.stdout: 2023-07-14T18:00:00.116 INFO:teuthology.orchestra.run.smithi163.stdout:Enabling module streams: 2023-07-14T18:00:00.116 INFO:teuthology.orchestra.run.smithi163.stdout: container-tools rhel8 2023-07-14T18:00:00.117 INFO:teuthology.orchestra.run.smithi163.stdout: 2023-07-14T18:00:00.117 INFO:teuthology.orchestra.run.smithi163.stdout:Transaction Summary 2023-07-14T18:00:00.117 INFO:teuthology.orchestra.run.smithi163.stdout:============================================================================================================ 2023-07-14T18:00:00.117 INFO:teuthology.orchestra.run.smithi163.stdout:Install 10 Packages 2023-07-14T18:00:00.117 INFO:teuthology.orchestra.run.smithi163.stdout: 2023-07-14T18:00:00.118 INFO:teuthology.orchestra.run.smithi163.stdout:Total download size: 18 M 2023-07-14T18:00:00.118 INFO:teuthology.orchestra.run.smithi163.stdout:Installed size: 65 M 2023-07-14T18:00:00.118 INFO:teuthology.orchestra.run.smithi163.stdout:Downloading Packages: 2023-07-14T18:00:00.258 INFO:teuthology.orchestra.run.smithi163.stdout:(1/10): python3-pytoml-0.1.14-5.git7dea353.el8. 176 kB/s | 25 kB 00:00 2023-07-14T18:00:00.283 INFO:teuthology.orchestra.run.smithi163.stdout:(2/10): yajl-2.1.0-10.el8.x86_64.rpm 245 kB/s | 41 kB 00:00 2023-07-14T18:00:00.308 INFO:teuthology.orchestra.run.smithi163.stdout:(3/10): python3-pyxdg-0.25-16.el8.noarch.rpm 490 kB/s | 94 kB 00:00 2023-07-14T18:00:00.337 INFO:teuthology.orchestra.run.smithi184.stdout:Dependencies resolved. 2023-07-14T18:00:00.358 INFO:teuthology.orchestra.run.smithi163.stdout:(4/10): udica-0.2.6-4.module+el8.6.0+16771+28df 492 kB/s | 49 kB 00:00 2023-07-14T18:00:00.417 INFO:teuthology.orchestra.run.smithi163.stdout:(5/10): cockpit-podman-49.1-1.module+el8.6.0+16 3.8 MB/s | 524 kB 00:00 2023-07-14T18:00:00.433 INFO:teuthology.orchestra.run.smithi184.stdout:============================================================================================================ 2023-07-14T18:00:00.434 INFO:teuthology.orchestra.run.smithi184.stdout: Package Arch Version Repository Size 2023-07-14T18:00:00.434 INFO:teuthology.orchestra.run.smithi184.stdout:============================================================================================================ 2023-07-14T18:00:00.434 INFO:teuthology.orchestra.run.smithi184.stdout:Installing group/module packages: 2023-07-14T18:00:00.434 INFO:teuthology.orchestra.run.smithi184.stdout: buildah x86_64 1:1.26.2-1.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 8.0 M 2023-07-14T18:00:00.434 INFO:teuthology.orchestra.run.smithi184.stdout: cockpit-podman noarch 49.1-1.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 524 k 2023-07-14T18:00:00.434 INFO:teuthology.orchestra.run.smithi184.stdout: crun x86_64 1.5-1.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 213 k 2023-07-14T18:00:00.435 INFO:teuthology.orchestra.run.smithi184.stdout: python3-podman noarch 4.0.1-1.module+el8.6.0+16837+85b82211 rhel-8-for-x86_64-appstream-rpms 149 k 2023-07-14T18:00:00.435 INFO:teuthology.orchestra.run.smithi184.stdout: skopeo x86_64 2:1.9.1-1.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 7.0 M 2023-07-14T18:00:00.435 INFO:teuthology.orchestra.run.smithi184.stdout: toolbox x86_64 0.0.99.3-0.6.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 2.2 M 2023-07-14T18:00:00.435 INFO:teuthology.orchestra.run.smithi184.stdout: udica noarch 0.2.6-4.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 49 k 2023-07-14T18:00:00.435 INFO:teuthology.orchestra.run.smithi184.stdout:Installing dependencies: 2023-07-14T18:00:00.435 INFO:teuthology.orchestra.run.smithi184.stdout: python3-pytoml noarch 0.1.14-5.git7dea353.el8 rhel-8-for-x86_64-appstream-rpms 25 k 2023-07-14T18:00:00.435 INFO:teuthology.orchestra.run.smithi184.stdout: python3-pyxdg noarch 0.25-16.el8 rhel-8-for-x86_64-appstream-rpms 94 k 2023-07-14T18:00:00.435 INFO:teuthology.orchestra.run.smithi184.stdout: yajl x86_64 2.1.0-10.el8 rhel-8-for-x86_64-appstream-rpms 41 k 2023-07-14T18:00:00.436 INFO:teuthology.orchestra.run.smithi184.stdout:Installing module profiles: 2023-07-14T18:00:00.436 INFO:teuthology.orchestra.run.smithi184.stdout: container-tools/common 2023-07-14T18:00:00.436 INFO:teuthology.orchestra.run.smithi184.stdout: 2023-07-14T18:00:00.436 INFO:teuthology.orchestra.run.smithi184.stdout:Enabling module streams: 2023-07-14T18:00:00.436 INFO:teuthology.orchestra.run.smithi184.stdout: container-tools rhel8 2023-07-14T18:00:00.436 INFO:teuthology.orchestra.run.smithi184.stdout: 2023-07-14T18:00:00.436 INFO:teuthology.orchestra.run.smithi184.stdout:Transaction Summary 2023-07-14T18:00:00.437 INFO:teuthology.orchestra.run.smithi184.stdout:============================================================================================================ 2023-07-14T18:00:00.437 INFO:teuthology.orchestra.run.smithi184.stdout:Install 10 Packages 2023-07-14T18:00:00.437 INFO:teuthology.orchestra.run.smithi184.stdout: 2023-07-14T18:00:00.437 INFO:teuthology.orchestra.run.smithi184.stdout:Total download size: 18 M 2023-07-14T18:00:00.438 INFO:teuthology.orchestra.run.smithi184.stdout:Installed size: 65 M 2023-07-14T18:00:00.438 INFO:teuthology.orchestra.run.smithi184.stdout:Downloading Packages: 2023-07-14T18:00:00.442 INFO:teuthology.orchestra.run.smithi163.stdout:(6/10): python3-podman-4.0.1-1.module+el8.6.0+1 1.7 MB/s | 149 kB 00:00 2023-07-14T18:00:00.576 INFO:teuthology.orchestra.run.smithi163.stdout:(7/10): crun-1.5-1.module+el8.6.0+16771+28dfca7 1.3 MB/s | 213 kB 00:00 2023-07-14T18:00:00.589 INFO:teuthology.orchestra.run.smithi184.stdout:(1/10): python3-pyxdg-0.25-16.el8.noarch.rpm 615 kB/s | 94 kB 00:00 2023-07-14T18:00:00.614 INFO:teuthology.orchestra.run.smithi184.stdout:(2/10): python3-pytoml-0.1.14-5.git7dea353.el8. 139 kB/s | 25 kB 00:00 2023-07-14T18:00:00.639 INFO:teuthology.orchestra.run.smithi184.stdout:(3/10): yajl-2.1.0-10.el8.x86_64.rpm 201 kB/s | 41 kB 00:00 2023-07-14T18:00:00.717 INFO:teuthology.orchestra.run.smithi163.stdout:(8/10): buildah-1.26.2-1.module+el8.6.0+16771+2 19 MB/s | 8.0 MB 00:00 2023-07-14T18:00:00.731 INFO:teuthology.orchestra.run.smithi184.stdout:(4/10): udica-0.2.6-4.module+el8.6.0+16771+28df 347 kB/s | 49 kB 00:00 2023-07-14T18:00:00.765 INFO:teuthology.orchestra.run.smithi184.stdout:(5/10): cockpit-podman-49.1-1.module+el8.6.0+16 3.4 MB/s | 524 kB 00:00 2023-07-14T18:00:00.784 INFO:teuthology.orchestra.run.smithi163.stdout:(9/10): toolbox-0.0.99.3-0.6.module+el8.6.0+167 11 MB/s | 2.2 MB 00:00 2023-07-14T18:00:00.884 INFO:teuthology.orchestra.run.smithi163.stdout:(10/10): skopeo-1.9.1-1.module+el8.6.0+16771+28 16 MB/s | 7.0 MB 00:00 2023-07-14T18:00:00.885 INFO:teuthology.orchestra.run.smithi163.stdout:-------------------------------------------------------------------------------- 2023-07-14T18:00:00.885 INFO:teuthology.orchestra.run.smithi163.stdout:Total 24 MB/s | 18 MB 00:00 2023-07-14T18:00:00.949 INFO:teuthology.orchestra.run.smithi184.stdout:(6/10): buildah-1.26.2-1.module+el8.6.0+16771+2 26 MB/s | 8.0 MB 00:00 2023-07-14T18:00:00.974 INFO:teuthology.orchestra.run.smithi184.stdout:(7/10): crun-1.5-1.module+el8.6.0+16771+28dfca7 1.0 MB/s | 213 kB 00:00 2023-07-14T18:00:00.999 INFO:teuthology.orchestra.run.smithi184.stdout:(8/10): python3-podman-4.0.1-1.module+el8.6.0+1 559 kB/s | 149 kB 00:00 2023-07-14T18:00:01.085 INFO:teuthology.orchestra.run.smithi163.stdout:Running transaction check 2023-07-14T18:00:01.104 INFO:teuthology.orchestra.run.smithi163.stdout:Transaction check succeeded. 2023-07-14T18:00:01.105 INFO:teuthology.orchestra.run.smithi163.stdout:Running transaction test 2023-07-14T18:00:01.184 INFO:teuthology.orchestra.run.smithi172.stdout:Dependencies resolved. 2023-07-14T18:00:01.199 INFO:teuthology.orchestra.run.smithi184.stdout:(9/10): toolbox-0.0.99.3-0.6.module+el8.6.0+167 9.7 MB/s | 2.2 MB 00:00 2023-07-14T18:00:01.279 INFO:teuthology.orchestra.run.smithi172.stdout:============================================================================================================ 2023-07-14T18:00:01.280 INFO:teuthology.orchestra.run.smithi172.stdout: Package Arch Version Repository Size 2023-07-14T18:00:01.280 INFO:teuthology.orchestra.run.smithi172.stdout:============================================================================================================ 2023-07-14T18:00:01.280 INFO:teuthology.orchestra.run.smithi172.stdout:Installing group/module packages: 2023-07-14T18:00:01.280 INFO:teuthology.orchestra.run.smithi172.stdout: buildah x86_64 1:1.26.2-1.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 8.0 M 2023-07-14T18:00:01.280 INFO:teuthology.orchestra.run.smithi172.stdout: cockpit-podman noarch 49.1-1.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 524 k 2023-07-14T18:00:01.280 INFO:teuthology.orchestra.run.smithi172.stdout: crun x86_64 1.5-1.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 213 k 2023-07-14T18:00:01.281 INFO:teuthology.orchestra.run.smithi172.stdout: python3-podman noarch 4.0.1-1.module+el8.6.0+16837+85b82211 rhel-8-for-x86_64-appstream-rpms 149 k 2023-07-14T18:00:01.281 INFO:teuthology.orchestra.run.smithi172.stdout: skopeo x86_64 2:1.9.1-1.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 7.0 M 2023-07-14T18:00:01.281 INFO:teuthology.orchestra.run.smithi172.stdout: toolbox x86_64 0.0.99.3-0.6.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 2.2 M 2023-07-14T18:00:01.281 INFO:teuthology.orchestra.run.smithi172.stdout: udica noarch 0.2.6-4.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 49 k 2023-07-14T18:00:01.281 INFO:teuthology.orchestra.run.smithi172.stdout:Installing dependencies: 2023-07-14T18:00:01.281 INFO:teuthology.orchestra.run.smithi172.stdout: python3-pytoml noarch 0.1.14-5.git7dea353.el8 rhel-8-for-x86_64-appstream-rpms 25 k 2023-07-14T18:00:01.281 INFO:teuthology.orchestra.run.smithi172.stdout: python3-pyxdg noarch 0.25-16.el8 rhel-8-for-x86_64-appstream-rpms 94 k 2023-07-14T18:00:01.281 INFO:teuthology.orchestra.run.smithi172.stdout: yajl x86_64 2.1.0-10.el8 rhel-8-for-x86_64-appstream-rpms 41 k 2023-07-14T18:00:01.282 INFO:teuthology.orchestra.run.smithi172.stdout:Installing module profiles: 2023-07-14T18:00:01.282 INFO:teuthology.orchestra.run.smithi172.stdout: container-tools/common 2023-07-14T18:00:01.282 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-07-14T18:00:01.282 INFO:teuthology.orchestra.run.smithi172.stdout:Enabling module streams: 2023-07-14T18:00:01.282 INFO:teuthology.orchestra.run.smithi172.stdout: container-tools rhel8 2023-07-14T18:00:01.282 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-07-14T18:00:01.282 INFO:teuthology.orchestra.run.smithi172.stdout:Transaction Summary 2023-07-14T18:00:01.283 INFO:teuthology.orchestra.run.smithi172.stdout:============================================================================================================ 2023-07-14T18:00:01.283 INFO:teuthology.orchestra.run.smithi172.stdout:Install 10 Packages 2023-07-14T18:00:01.283 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-07-14T18:00:01.283 INFO:teuthology.orchestra.run.smithi172.stdout:Total download size: 18 M 2023-07-14T18:00:01.284 INFO:teuthology.orchestra.run.smithi172.stdout:Installed size: 65 M 2023-07-14T18:00:01.284 INFO:teuthology.orchestra.run.smithi172.stdout:Downloading Packages: 2023-07-14T18:00:01.286 INFO:teuthology.orchestra.run.smithi163.stdout:Transaction test succeeded. 2023-07-14T18:00:01.290 INFO:teuthology.orchestra.run.smithi163.stdout:Running transaction 2023-07-14T18:00:01.291 INFO:teuthology.orchestra.run.smithi184.stdout:(10/10): skopeo-1.9.1-1.module+el8.6.0+16771+28 20 MB/s | 7.0 MB 00:00 2023-07-14T18:00:01.292 INFO:teuthology.orchestra.run.smithi184.stdout:-------------------------------------------------------------------------------- 2023-07-14T18:00:01.292 INFO:teuthology.orchestra.run.smithi184.stdout:Total 21 MB/s | 18 MB 00:00 2023-07-14T18:00:01.453 INFO:teuthology.orchestra.run.smithi172.stdout:(1/10): python3-pyxdg-0.25-16.el8.noarch.rpm 549 kB/s | 94 kB 00:00 2023-07-14T18:00:01.491 INFO:teuthology.orchestra.run.smithi184.stdout:Running transaction check 2023-07-14T18:00:01.510 INFO:teuthology.orchestra.run.smithi184.stdout:Transaction check succeeded. 2023-07-14T18:00:01.510 INFO:teuthology.orchestra.run.smithi184.stdout:Running transaction test 2023-07-14T18:00:01.520 INFO:teuthology.orchestra.run.smithi172.stdout:(2/10): udica-0.2.6-4.module+el8.6.0+16771+28df 740 kB/s | 49 kB 00:00 2023-07-14T18:00:01.562 INFO:teuthology.orchestra.run.smithi172.stdout:(3/10): python3-pytoml-0.1.14-5.git7dea353.el8. 89 kB/s | 25 kB 00:00 2023-07-14T18:00:01.629 INFO:teuthology.orchestra.run.smithi172.stdout:(4/10): yajl-2.1.0-10.el8.x86_64.rpm 118 kB/s | 41 kB 00:00 2023-07-14T18:00:01.663 INFO:teuthology.orchestra.run.smithi172.stdout:(5/10): cockpit-podman-49.1-1.module+el8.6.0+16 3.6 MB/s | 524 kB 00:00 2023-07-14T18:00:01.693 INFO:teuthology.orchestra.run.smithi184.stdout:Transaction test succeeded. 2023-07-14T18:00:01.697 INFO:teuthology.orchestra.run.smithi184.stdout:Running transaction 2023-07-14T18:00:01.802 INFO:teuthology.orchestra.run.smithi163.stdout: Preparing : 1/1 2023-07-14T18:00:01.838 INFO:teuthology.orchestra.run.smithi172.stdout:(6/10): buildah-1.26.2-1.module+el8.6.0+16771+2 29 MB/s | 8.0 MB 00:00 2023-07-14T18:00:01.863 INFO:teuthology.orchestra.run.smithi172.stdout:(7/10): python3-podman-4.0.1-1.module+el8.6.0+1 639 kB/s | 149 kB 00:00 2023-07-14T18:00:01.888 INFO:teuthology.orchestra.run.smithi172.stdout:(8/10): crun-1.5-1.module+el8.6.0+16771+28dfca7 945 kB/s | 213 kB 00:00 2023-07-14T18:00:01.998 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-pytoml-0.1.14-5.git7dea353.el8.noarch 1/10 2023-07-14T18:00:02.047 INFO:teuthology.orchestra.run.smithi172.stdout:(9/10): toolbox-0.0.99.3-0.6.module+el8.6.0+167 12 MB/s | 2.2 MB 00:00 2023-07-14T18:00:02.147 INFO:teuthology.orchestra.run.smithi172.stdout:(10/10): skopeo-1.9.1-1.module+el8.6.0+16771+28 23 MB/s | 7.0 MB 00:00 2023-07-14T18:00:02.147 INFO:teuthology.orchestra.run.smithi172.stdout:-------------------------------------------------------------------------------- 2023-07-14T18:00:02.148 INFO:teuthology.orchestra.run.smithi172.stdout:Total 21 MB/s | 18 MB 00:00 2023-07-14T18:00:02.180 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : yajl-2.1.0-10.el8.x86_64 2/10 2023-07-14T18:00:02.222 INFO:teuthology.orchestra.run.smithi184.stdout: Preparing : 1/1 2023-07-14T18:00:02.348 INFO:teuthology.orchestra.run.smithi172.stdout:Running transaction check 2023-07-14T18:00:02.367 INFO:teuthology.orchestra.run.smithi172.stdout:Transaction check succeeded. 2023-07-14T18:00:02.367 INFO:teuthology.orchestra.run.smithi172.stdout:Running transaction test 2023-07-14T18:00:02.383 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-pyxdg-0.25-16.el8.noarch 3/10 2023-07-14T18:00:02.385 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-pytoml-0.1.14-5.git7dea353.el8.noarch 1/10 2023-07-14T18:00:02.548 INFO:teuthology.orchestra.run.smithi172.stdout:Transaction test succeeded. 2023-07-14T18:00:02.552 INFO:teuthology.orchestra.run.smithi172.stdout:Running transaction 2023-07-14T18:00:02.570 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : yajl-2.1.0-10.el8.x86_64 2/10 2023-07-14T18:00:02.628 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-podman-4.0.1-1.module+el8.6.0+16837+85b822 4/10 2023-07-14T18:00:02.757 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-pyxdg-0.25-16.el8.noarch 3/10 2023-07-14T18:00:02.966 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : crun-1.5-1.module+el8.6.0+16771+28dfca77.x86_64 5/10 2023-07-14T18:00:02.999 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-podman-4.0.1-1.module+el8.6.0+16837+85b822 4/10 2023-07-14T18:00:03.046 INFO:teuthology.orchestra.run.smithi172.stdout: Preparing : 1/1 2023-07-14T18:00:03.250 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-pytoml-0.1.14-5.git7dea353.el8.noarch 1/10 2023-07-14T18:00:03.350 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : crun-1.5-1.module+el8.6.0+16771+28dfca77.x86_64 5/10 2023-07-14T18:00:03.431 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : yajl-2.1.0-10.el8.x86_64 2/10 2023-07-14T18:00:03.633 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-pyxdg-0.25-16.el8.noarch 3/10 2023-07-14T18:00:03.735 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : toolbox-0.0.99.3-0.6.module+el8.6.0+16771+28dfca77 6/10 2023-07-14T18:00:03.830 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-podman-4.0.1-1.module+el8.6.0+16837+85b822 4/10 2023-07-14T18:00:04.119 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : toolbox-0.0.99.3-0.6.module+el8.6.0+16771+28dfca77 6/10 2023-07-14T18:00:04.210 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : crun-1.5-1.module+el8.6.0+16771+28dfca77.x86_64 5/10 2023-07-14T18:00:04.595 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : skopeo-2:1.9.1-1.module+el8.6.0+16771+28dfca77.x86 7/10 2023-07-14T18:00:04.823 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : buildah-1:1.26.2-1.module+el8.6.0+16771+28dfca77.x 8/10 2023-07-14T18:00:04.986 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : skopeo-2:1.9.1-1.module+el8.6.0+16771+28dfca77.x86 7/10 2023-07-14T18:00:04.987 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : cockpit-podman-49.1-1.module+el8.6.0+16771+28dfca7 9/10 2023-07-14T18:00:04.995 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : toolbox-0.0.99.3-0.6.module+el8.6.0+16771+28dfca77 6/10 2023-07-14T18:00:05.147 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : udica-0.2.6-4.module+el8.6.0+16771+28dfca77.noarch 10/10 2023-07-14T18:00:05.202 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : buildah-1:1.26.2-1.module+el8.6.0+16771+28dfca77.x 8/10 2023-07-14T18:00:05.402 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : cockpit-podman-49.1-1.module+el8.6.0+16771+28dfca7 9/10 2023-07-14T18:00:05.415 INFO:teuthology.orchestra.run.smithi163.stdout: Running scriptlet: udica-0.2.6-4.module+el8.6.0+16771+28dfca77.noarch 10/10 2023-07-14T18:00:05.415 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-pyxdg-0.25-16.el8.noarch 1/10 2023-07-14T18:00:05.415 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : yajl-2.1.0-10.el8.x86_64 2/10 2023-07-14T18:00:05.416 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-pytoml-0.1.14-5.git7dea353.el8.noarch 3/10 2023-07-14T18:00:05.416 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : udica-0.2.6-4.module+el8.6.0+16771+28dfca77.noarch 4/10 2023-07-14T18:00:05.416 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : cockpit-podman-49.1-1.module+el8.6.0+16771+28dfca7 5/10 2023-07-14T18:00:05.416 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : buildah-1:1.26.2-1.module+el8.6.0+16771+28dfca77.x 6/10 2023-07-14T18:00:05.416 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-podman-4.0.1-1.module+el8.6.0+16837+85b822 7/10 2023-07-14T18:00:05.416 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : crun-1.5-1.module+el8.6.0+16771+28dfca77.x86_64 8/10 2023-07-14T18:00:05.416 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : skopeo-2:1.9.1-1.module+el8.6.0+16771+28dfca77.x86 9/10 2023-07-14T18:00:05.563 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : udica-0.2.6-4.module+el8.6.0+16771+28dfca77.noarch 10/10 2023-07-14T18:00:05.832 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: udica-0.2.6-4.module+el8.6.0+16771+28dfca77.noarch 10/10 2023-07-14T18:00:05.833 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-pyxdg-0.25-16.el8.noarch 1/10 2023-07-14T18:00:05.833 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : yajl-2.1.0-10.el8.x86_64 2/10 2023-07-14T18:00:05.833 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-pytoml-0.1.14-5.git7dea353.el8.noarch 3/10 2023-07-14T18:00:05.833 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : udica-0.2.6-4.module+el8.6.0+16771+28dfca77.noarch 4/10 2023-07-14T18:00:05.833 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : cockpit-podman-49.1-1.module+el8.6.0+16771+28dfca7 5/10 2023-07-14T18:00:05.834 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : buildah-1:1.26.2-1.module+el8.6.0+16771+28dfca77.x 6/10 2023-07-14T18:00:05.834 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-podman-4.0.1-1.module+el8.6.0+16837+85b822 7/10 2023-07-14T18:00:05.834 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : crun-1.5-1.module+el8.6.0+16771+28dfca77.x86_64 8/10 2023-07-14T18:00:05.834 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : skopeo-2:1.9.1-1.module+el8.6.0+16771+28dfca77.x86 9/10 2023-07-14T18:00:05.896 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : skopeo-2:1.9.1-1.module+el8.6.0+16771+28dfca77.x86 7/10 2023-07-14T18:00:06.168 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : buildah-1:1.26.2-1.module+el8.6.0+16771+28dfca77.x 8/10 2023-07-14T18:00:06.339 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : cockpit-podman-49.1-1.module+el8.6.0+16771+28dfca7 9/10 2023-07-14T18:00:06.507 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : udica-0.2.6-4.module+el8.6.0+16771+28dfca77.noarch 10/10 2023-07-14T18:00:06.529 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : toolbox-0.0.99.3-0.6.module+el8.6.0+16771+28dfca77 10/10 2023-07-14T18:00:06.529 INFO:teuthology.orchestra.run.smithi163.stdout:Last metadata expiration check: 0:02:17 ago on Fri 14 Jul 2023 05:57:49 PM UTC. 2023-07-14T18:00:06.772 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: udica-0.2.6-4.module+el8.6.0+16771+28dfca77.noarch 10/10 2023-07-14T18:00:06.773 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-pyxdg-0.25-16.el8.noarch 1/10 2023-07-14T18:00:06.773 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : yajl-2.1.0-10.el8.x86_64 2/10 2023-07-14T18:00:06.773 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-pytoml-0.1.14-5.git7dea353.el8.noarch 3/10 2023-07-14T18:00:06.773 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : udica-0.2.6-4.module+el8.6.0+16771+28dfca77.noarch 4/10 2023-07-14T18:00:06.773 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : cockpit-podman-49.1-1.module+el8.6.0+16771+28dfca7 5/10 2023-07-14T18:00:06.773 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : buildah-1:1.26.2-1.module+el8.6.0+16771+28dfca77.x 6/10 2023-07-14T18:00:06.773 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-podman-4.0.1-1.module+el8.6.0+16837+85b822 7/10 2023-07-14T18:00:06.773 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : crun-1.5-1.module+el8.6.0+16771+28dfca77.x86_64 8/10 2023-07-14T18:00:06.774 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : skopeo-2:1.9.1-1.module+el8.6.0+16771+28dfca77.x86 9/10 2023-07-14T18:00:07.061 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : toolbox-0.0.99.3-0.6.module+el8.6.0+16771+28dfca77 10/10 2023-07-14T18:00:07.062 INFO:teuthology.orchestra.run.smithi184.stdout:Last metadata expiration check: 0:02:27 ago on Fri 14 Jul 2023 05:57:39 PM UTC. 2023-07-14T18:00:07.912 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : toolbox-0.0.99.3-0.6.module+el8.6.0+16771+28dfca77 10/10 2023-07-14T18:00:07.912 INFO:teuthology.orchestra.run.smithi172.stdout:Last metadata expiration check: 0:02:07 ago on Fri 14 Jul 2023 05:58:00 PM UTC. 2023-07-14T18:00:15.562 INFO:teuthology.orchestra.run.smithi184.stdout:Installed products updated. 2023-07-14T18:00:15.767 INFO:teuthology.orchestra.run.smithi184.stdout: 2023-07-14T18:00:15.767 INFO:teuthology.orchestra.run.smithi184.stdout:Installed: 2023-07-14T18:00:15.767 INFO:teuthology.orchestra.run.smithi184.stdout: buildah-1:1.26.2-1.module+el8.6.0+16771+28dfca77.x86_64 2023-07-14T18:00:15.767 INFO:teuthology.orchestra.run.smithi184.stdout: cockpit-podman-49.1-1.module+el8.6.0+16771+28dfca77.noarch 2023-07-14T18:00:15.767 INFO:teuthology.orchestra.run.smithi184.stdout: crun-1.5-1.module+el8.6.0+16771+28dfca77.x86_64 2023-07-14T18:00:15.768 INFO:teuthology.orchestra.run.smithi184.stdout: python3-podman-4.0.1-1.module+el8.6.0+16837+85b82211.noarch 2023-07-14T18:00:15.768 INFO:teuthology.orchestra.run.smithi184.stdout: python3-pytoml-0.1.14-5.git7dea353.el8.noarch 2023-07-14T18:00:15.768 INFO:teuthology.orchestra.run.smithi184.stdout: python3-pyxdg-0.25-16.el8.noarch 2023-07-14T18:00:15.768 INFO:teuthology.orchestra.run.smithi184.stdout: skopeo-2:1.9.1-1.module+el8.6.0+16771+28dfca77.x86_64 2023-07-14T18:00:15.768 INFO:teuthology.orchestra.run.smithi184.stdout: toolbox-0.0.99.3-0.6.module+el8.6.0+16771+28dfca77.x86_64 2023-07-14T18:00:15.768 INFO:teuthology.orchestra.run.smithi184.stdout: udica-0.2.6-4.module+el8.6.0+16771+28dfca77.noarch 2023-07-14T18:00:15.768 INFO:teuthology.orchestra.run.smithi184.stdout: yajl-2.1.0-10.el8.x86_64 2023-07-14T18:00:15.769 INFO:teuthology.orchestra.run.smithi184.stdout: 2023-07-14T18:00:15.769 INFO:teuthology.orchestra.run.smithi184.stdout:Complete! 2023-07-14T18:00:15.937 DEBUG:teuthology.parallel:result is None 2023-07-14T18:00:16.120 INFO:teuthology.orchestra.run.smithi163.stdout:Installed products updated. 2023-07-14T18:00:16.316 INFO:teuthology.orchestra.run.smithi163.stdout: 2023-07-14T18:00:16.317 INFO:teuthology.orchestra.run.smithi163.stdout:Installed: 2023-07-14T18:00:16.317 INFO:teuthology.orchestra.run.smithi163.stdout: buildah-1:1.26.2-1.module+el8.6.0+16771+28dfca77.x86_64 2023-07-14T18:00:16.317 INFO:teuthology.orchestra.run.smithi163.stdout: cockpit-podman-49.1-1.module+el8.6.0+16771+28dfca77.noarch 2023-07-14T18:00:16.317 INFO:teuthology.orchestra.run.smithi163.stdout: crun-1.5-1.module+el8.6.0+16771+28dfca77.x86_64 2023-07-14T18:00:16.317 INFO:teuthology.orchestra.run.smithi163.stdout: python3-podman-4.0.1-1.module+el8.6.0+16837+85b82211.noarch 2023-07-14T18:00:16.318 INFO:teuthology.orchestra.run.smithi163.stdout: python3-pytoml-0.1.14-5.git7dea353.el8.noarch 2023-07-14T18:00:16.318 INFO:teuthology.orchestra.run.smithi163.stdout: python3-pyxdg-0.25-16.el8.noarch 2023-07-14T18:00:16.318 INFO:teuthology.orchestra.run.smithi163.stdout: skopeo-2:1.9.1-1.module+el8.6.0+16771+28dfca77.x86_64 2023-07-14T18:00:16.318 INFO:teuthology.orchestra.run.smithi163.stdout: toolbox-0.0.99.3-0.6.module+el8.6.0+16771+28dfca77.x86_64 2023-07-14T18:00:16.318 INFO:teuthology.orchestra.run.smithi163.stdout: udica-0.2.6-4.module+el8.6.0+16771+28dfca77.noarch 2023-07-14T18:00:16.318 INFO:teuthology.orchestra.run.smithi163.stdout: yajl-2.1.0-10.el8.x86_64 2023-07-14T18:00:16.318 INFO:teuthology.orchestra.run.smithi163.stdout: 2023-07-14T18:00:16.318 INFO:teuthology.orchestra.run.smithi163.stdout:Complete! 2023-07-14T18:00:16.481 DEBUG:teuthology.parallel:result is None 2023-07-14T18:00:17.596 INFO:teuthology.orchestra.run.smithi172.stdout:Installed products updated. 2023-07-14T18:00:17.791 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-07-14T18:00:17.791 INFO:teuthology.orchestra.run.smithi172.stdout:Installed: 2023-07-14T18:00:17.791 INFO:teuthology.orchestra.run.smithi172.stdout: buildah-1:1.26.2-1.module+el8.6.0+16771+28dfca77.x86_64 2023-07-14T18:00:17.791 INFO:teuthology.orchestra.run.smithi172.stdout: cockpit-podman-49.1-1.module+el8.6.0+16771+28dfca77.noarch 2023-07-14T18:00:17.791 INFO:teuthology.orchestra.run.smithi172.stdout: crun-1.5-1.module+el8.6.0+16771+28dfca77.x86_64 2023-07-14T18:00:17.792 INFO:teuthology.orchestra.run.smithi172.stdout: python3-podman-4.0.1-1.module+el8.6.0+16837+85b82211.noarch 2023-07-14T18:00:17.792 INFO:teuthology.orchestra.run.smithi172.stdout: python3-pytoml-0.1.14-5.git7dea353.el8.noarch 2023-07-14T18:00:17.792 INFO:teuthology.orchestra.run.smithi172.stdout: python3-pyxdg-0.25-16.el8.noarch 2023-07-14T18:00:17.792 INFO:teuthology.orchestra.run.smithi172.stdout: skopeo-2:1.9.1-1.module+el8.6.0+16771+28dfca77.x86_64 2023-07-14T18:00:17.792 INFO:teuthology.orchestra.run.smithi172.stdout: toolbox-0.0.99.3-0.6.module+el8.6.0+16771+28dfca77.x86_64 2023-07-14T18:00:17.792 INFO:teuthology.orchestra.run.smithi172.stdout: udica-0.2.6-4.module+el8.6.0+16771+28dfca77.noarch 2023-07-14T18:00:17.792 INFO:teuthology.orchestra.run.smithi172.stdout: yajl-2.1.0-10.el8.x86_64 2023-07-14T18:00:17.793 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-07-14T18:00:17.793 INFO:teuthology.orchestra.run.smithi172.stdout:Complete! 2023-07-14T18:00:17.984 DEBUG:teuthology.parallel:result is None 2023-07-14T18:00:17.985 INFO:teuthology.run_tasks:Running task install... 2023-07-14T18:00:17.994 DEBUG:teuthology.task.install:project ceph 2023-07-14T18:00:17.995 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '81c9387d2e7576da065747ec9c16d1c7d69016ec'}} 2023-07-14T18:00:17.995 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '81c9387d2e7576da065747ec9c16d1c7d69016ec'} 2023-07-14T18:00:17.995 INFO:teuthology.task.install:Using flavor: default 2023-07-14T18:00:18.001 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2023-07-14T18:00:18.002 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']} 2023-07-14T18:00:18.002 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '81c9387d2e7576da065747ec9c16d1c7d69016ec', 'tag': None, 'wait_for_package': False} 2023-07-14T18:00:18.003 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=81c9387d2e7576da065747ec9c16d1c7d69016ec 2023-07-14T18:00:18.005 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '81c9387d2e7576da065747ec9c16d1c7d69016ec', 'tag': None, 'wait_for_package': False} 2023-07-14T18:00:18.006 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=81c9387d2e7576da065747ec9c16d1c7d69016ec 2023-07-14T18:00:18.007 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '81c9387d2e7576da065747ec9c16d1c7d69016ec', 'tag': None, 'wait_for_package': False} 2023-07-14T18:00:18.007 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=81c9387d2e7576da065747ec9c16d1c7d69016ec 2023-07-14T18:00:28.616 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20230714.134335/81c9387d2e7576da065747ec9c16d1c7d69016ec/centos/8/flavors/default/ 2023-07-14T18:00:28.616 INFO:teuthology.task.install.rpm:Package version is 18.0.0-4940.g81c9387d 2023-07-14T18:00:28.721 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20230714.134335/81c9387d2e7576da065747ec9c16d1c7d69016ec/centos/8/flavors/default/ 2023-07-14T18:00:28.722 INFO:teuthology.task.install.rpm:Package version is 18.0.0-4940.g81c9387d 2023-07-14T18:00:28.725 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20230714.134335/81c9387d2e7576da065747ec9c16d1c7d69016ec/centos/8/flavors/default/ 2023-07-14T18:00:28.726 INFO:teuthology.task.install.rpm:Package version is 18.0.0-4940.g81c9387d 2023-07-14T18:00:29.105 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20230714.134335/81c9387d2e7576da065747ec9c16d1c7d69016ec/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20230714.134335/81c9387d2e7576da065747ec9c16d1c7d69016ec/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20230714.134335/81c9387d2e7576da065747ec9c16d1c7d69016ec/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-07-14T18:00:29.106 DEBUG:teuthology.orchestra.run.smithi163:> set -ex 2023-07-14T18:00:29.106 DEBUG:teuthology.orchestra.run.smithi163:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-07-14T18:00:29.139 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2023-07-14T18:00:29.139 DEBUG:teuthology.orchestra.run.smithi163:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/81c9387d2e7576da065747ec9c16d1c7d69016ec/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-07-14T18:00:29.211 DEBUG:teuthology.orchestra.run.smithi163:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-07-14T18:00:29.216 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20230714.134335/81c9387d2e7576da065747ec9c16d1c7d69016ec/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20230714.134335/81c9387d2e7576da065747ec9c16d1c7d69016ec/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20230714.134335/81c9387d2e7576da065747ec9c16d1c7d69016ec/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-07-14T18:00:29.217 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2023-07-14T18:00:29.217 DEBUG:teuthology.orchestra.run.smithi184:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-07-14T18:00:29.236 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20230714.134335/81c9387d2e7576da065747ec9c16d1c7d69016ec/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20230714.134335/81c9387d2e7576da065747ec9c16d1c7d69016ec/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20230714.134335/81c9387d2e7576da065747ec9c16d1c7d69016ec/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-07-14T18:00:29.237 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2023-07-14T18:00:29.237 DEBUG:teuthology.orchestra.run.smithi172:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-07-14T18:00:29.251 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2023-07-14T18:00:29.251 DEBUG:teuthology.orchestra.run.smithi184:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/81c9387d2e7576da065747ec9c16d1c7d69016ec/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-07-14T18:00:29.270 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2023-07-14T18:00:29.271 DEBUG:teuthology.orchestra.run.smithi172:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/81c9387d2e7576da065747ec9c16d1c7d69016ec/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-07-14T18:00:29.293 DEBUG:teuthology.orchestra.run.smithi163:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-07-14T18:00:29.325 DEBUG:teuthology.orchestra.run.smithi184:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-07-14T18:00:29.341 DEBUG:teuthology.orchestra.run.smithi172:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-07-14T18:00:29.361 INFO:teuthology.orchestra.run.smithi163.stdout:check_obsoletes = 1 2023-07-14T18:00:29.362 DEBUG:teuthology.orchestra.run.smithi163:> sudo yum clean all 2023-07-14T18:00:29.410 DEBUG:teuthology.orchestra.run.smithi184:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-07-14T18:00:29.422 DEBUG:teuthology.orchestra.run.smithi172:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-07-14T18:00:29.442 INFO:teuthology.orchestra.run.smithi184.stdout:check_obsoletes = 1 2023-07-14T18:00:29.444 DEBUG:teuthology.orchestra.run.smithi184:> sudo yum clean all 2023-07-14T18:00:29.489 INFO:teuthology.orchestra.run.smithi172.stdout:check_obsoletes = 1 2023-07-14T18:00:29.491 DEBUG:teuthology.orchestra.run.smithi172:> sudo yum clean all 2023-07-14T18:00:29.737 INFO:teuthology.orchestra.run.smithi163.stdout:Updating Subscription Management repositories. 2023-07-14T18:00:29.837 INFO:teuthology.orchestra.run.smithi184.stdout:Updating Subscription Management repositories. 2023-07-14T18:00:29.863 INFO:teuthology.orchestra.run.smithi172.stdout:Updating Subscription Management repositories. 2023-07-14T18:00:30.898 INFO:teuthology.orchestra.run.smithi172.stdout:44 files removed 2023-07-14T18:00:30.935 INFO:teuthology.orchestra.run.smithi163.stdout:44 files removed 2023-07-14T18:00:30.952 DEBUG:teuthology.orchestra.run.smithi172:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2023-07-14T18:00:30.963 INFO:teuthology.orchestra.run.smithi184.stdout:44 files removed 2023-07-14T18:00:30.988 DEBUG:teuthology.orchestra.run.smithi163:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2023-07-14T18:00:31.017 DEBUG:teuthology.orchestra.run.smithi184:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2023-07-14T18:00:31.289 INFO:teuthology.orchestra.run.smithi172.stdout:Updating Subscription Management repositories. 2023-07-14T18:00:31.321 INFO:teuthology.orchestra.run.smithi163.stdout:Updating Subscription Management repositories. 2023-07-14T18:00:31.348 INFO:teuthology.orchestra.run.smithi184.stdout:Updating Subscription Management repositories. 2023-07-14T18:00:33.474 INFO:teuthology.orchestra.run.smithi172.stdout:ceph packages for x86_64 79 kB/s | 81 kB 00:01 2023-07-14T18:00:33.502 INFO:teuthology.orchestra.run.smithi163.stdout:ceph packages for x86_64 78 kB/s | 81 kB 00:01 2023-07-14T18:00:33.661 INFO:teuthology.orchestra.run.smithi184.stdout:ceph packages for x86_64 76 kB/s | 81 kB 00:01 2023-07-14T18:00:34.449 INFO:teuthology.orchestra.run.smithi172.stdout:ceph noarch packages 10 kB/s | 9.4 kB 00:00 2023-07-14T18:00:34.595 INFO:teuthology.orchestra.run.smithi184.stdout:ceph noarch packages 10 kB/s | 9.4 kB 00:00 2023-07-14T18:00:34.695 INFO:teuthology.orchestra.run.smithi163.stdout:ceph noarch packages 8.1 kB/s | 9.4 kB 00:01 2023-07-14T18:00:35.358 INFO:teuthology.orchestra.run.smithi172.stdout:ceph source packages 1.7 kB/s | 1.5 kB 00:00 2023-07-14T18:00:35.520 INFO:teuthology.orchestra.run.smithi184.stdout:ceph source packages 1.7 kB/s | 1.5 kB 00:00 2023-07-14T18:00:35.654 INFO:teuthology.orchestra.run.smithi163.stdout:ceph source packages 1.6 kB/s | 1.5 kB 00:00 2023-07-14T18:00:35.692 INFO:teuthology.orchestra.run.smithi172.stdout:Copr repo for python3-asyncssh owned by ceph 11 kB/s | 3.5 kB 00:00 2023-07-14T18:00:35.904 INFO:teuthology.orchestra.run.smithi184.stdout:Copr repo for python3-asyncssh owned by ceph 9.5 kB/s | 3.5 kB 00:00 2023-07-14T18:00:36.005 INFO:teuthology.orchestra.run.smithi163.stdout:Copr repo for python3-asyncssh owned by ceph 11 kB/s | 3.5 kB 00:00 2023-07-14T18:00:37.589 INFO:teuthology.orchestra.run.smithi163.stdout:Extra Packages for Enterprise Linux 10 MB/s | 16 MB 00:01 2023-07-14T18:00:39.227 INFO:teuthology.orchestra.run.smithi172.stdout:Extra Packages for Enterprise Linux 4.4 MB/s | 16 MB 00:03 2023-07-14T18:00:40.989 INFO:teuthology.orchestra.run.smithi163.stdout:lab-extras 401 kB/s | 24 kB 00:00 2023-07-14T18:00:42.133 INFO:teuthology.orchestra.run.smithi163.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 50 MB/s | 53 MB 00:01 2023-07-14T18:00:42.652 INFO:teuthology.orchestra.run.smithi172.stdout:lab-extras 419 kB/s | 24 kB 00:00 2023-07-14T18:00:43.717 INFO:teuthology.orchestra.run.smithi172.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 48 MB/s | 47 MB 00:00 2023-07-14T18:00:50.426 INFO:teuthology.orchestra.run.smithi163.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 47 MB/s | 47 MB 00:01 2023-07-14T18:00:51.913 INFO:teuthology.orchestra.run.smithi172.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 51 MB/s | 53 MB 00:01 2023-07-14T18:00:56.659 INFO:teuthology.orchestra.run.smithi184.stdout:Extra Packages for Enterprise Linux 771 kB/s | 16 MB 00:20 2023-07-14T18:01:00.105 INFO:teuthology.orchestra.run.smithi184.stdout:lab-extras 385 kB/s | 24 kB 00:00 2023-07-14T18:01:01.302 INFO:teuthology.orchestra.run.smithi163.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2023-07-14T18:01:01.303 INFO:teuthology.orchestra.run.smithi163.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2023-07-14T18:01:01.320 INFO:teuthology.orchestra.run.smithi163.stdout:Package NetworkManager-1:1.36.0-4.el8.x86_64 is already installed. 2023-07-14T18:01:01.321 INFO:teuthology.orchestra.run.smithi163.stdout:Package iproute-5.15.0-4.el8.x86_64 is already installed. 2023-07-14T18:01:01.322 INFO:teuthology.orchestra.run.smithi163.stdout:Package util-linux-2.32.1-35.el8.x86_64 is already installed. 2023-07-14T18:01:01.323 INFO:teuthology.orchestra.run.smithi163.stdout:Package libacl-devel-2.2.53-1.el8.x86_64 is already installed. 2023-07-14T18:01:01.326 INFO:teuthology.orchestra.run.smithi163.stdout:Package libattr-devel-2.4.48-3.el8.x86_64 is already installed. 2023-07-14T18:01:01.329 INFO:teuthology.orchestra.run.smithi163.stdout:Package xfsdump-3.1.8-4.el8.x86_64 is already installed. 2023-07-14T18:01:01.330 INFO:teuthology.orchestra.run.smithi163.stdout:Package xfsprogs-5.0.0-10.el8.x86_64 is already installed. 2023-07-14T18:01:01.349 INFO:teuthology.orchestra.run.smithi184.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 45 MB/s | 53 MB 00:01 2023-07-14T18:01:01.464 INFO:teuthology.orchestra.run.smithi163.stdout:Dependencies resolved. 2023-07-14T18:01:01.477 INFO:teuthology.orchestra.run.smithi163.stdout:=========================================================================================================================== 2023-07-14T18:01:01.477 INFO:teuthology.orchestra.run.smithi163.stdout: Package Arch Version Repository Size 2023-07-14T18:01:01.477 INFO:teuthology.orchestra.run.smithi163.stdout:=========================================================================================================================== 2023-07-14T18:01:01.477 INFO:teuthology.orchestra.run.smithi163.stdout:Installing: 2023-07-14T18:01:01.477 INFO:teuthology.orchestra.run.smithi163.stdout: NetworkManager-initscripts-updown noarch 1:1.36.0-9.el8_6 rhel-8-for-x86_64-baseos-rpms 138 k 2023-07-14T18:01:01.477 INFO:teuthology.orchestra.run.smithi163.stdout: bison x86_64 3.0.4-10.el8 rhel-8-for-x86_64-appstream-rpms 688 k 2023-07-14T18:01:01.478 INFO:teuthology.orchestra.run.smithi163.stdout: ceph x86_64 2:18.0.0-4940.g81c9387d.el8 ceph 6.4 k 2023-07-14T18:01:01.478 INFO:teuthology.orchestra.run.smithi163.stdout: ceph-base x86_64 2:18.0.0-4940.g81c9387d.el8 ceph 5.4 M 2023-07-14T18:01:01.478 INFO:teuthology.orchestra.run.smithi163.stdout: ceph-fuse x86_64 2:18.0.0-4940.g81c9387d.el8 ceph 850 k 2023-07-14T18:01:01.478 INFO:teuthology.orchestra.run.smithi163.stdout: ceph-immutable-object-cache x86_64 2:18.0.0-4940.g81c9387d.el8 ceph 167 k 2023-07-14T18:01:01.478 INFO:teuthology.orchestra.run.smithi163.stdout: ceph-mgr x86_64 2:18.0.0-4940.g81c9387d.el8 ceph 1.6 M 2023-07-14T18:01:01.478 INFO:teuthology.orchestra.run.smithi163.stdout: ceph-mgr-cephadm noarch 2:18.0.0-4940.g81c9387d.el8 ceph-noarch 129 k 2023-07-14T18:01:01.478 INFO:teuthology.orchestra.run.smithi163.stdout: ceph-mgr-dashboard noarch 2:18.0.0-4940.g81c9387d.el8 ceph-noarch 1.7 M 2023-07-14T18:01:01.479 INFO:teuthology.orchestra.run.smithi163.stdout: ceph-mgr-diskprediction-local noarch 2:18.0.0-4940.g81c9387d.el8 ceph-noarch 7.4 M 2023-07-14T18:01:01.479 INFO:teuthology.orchestra.run.smithi163.stdout: ceph-mgr-rook noarch 2:18.0.0-4940.g81c9387d.el8 ceph-noarch 47 k 2023-07-14T18:01:01.479 INFO:teuthology.orchestra.run.smithi163.stdout: ceph-radosgw x86_64 2:18.0.0-4940.g81c9387d.el8 ceph 14 M 2023-07-14T18:01:01.479 INFO:teuthology.orchestra.run.smithi163.stdout: ceph-test x86_64 2:18.0.0-4940.g81c9387d.el8 ceph 48 M 2023-07-14T18:01:01.479 INFO:teuthology.orchestra.run.smithi163.stdout: ceph-volume noarch 2:18.0.0-4940.g81c9387d.el8 ceph-noarch 258 k 2023-07-14T18:01:01.479 INFO:teuthology.orchestra.run.smithi163.stdout: cephadm noarch 2:18.0.0-4940.g81c9387d.el8 ceph-noarch 165 k 2023-07-14T18:01:01.479 INFO:teuthology.orchestra.run.smithi163.stdout: cephfs-mirror x86_64 2:18.0.0-4940.g81c9387d.el8 ceph 260 k 2023-07-14T18:01:01.480 INFO:teuthology.orchestra.run.smithi163.stdout: cephfs-top noarch 2:18.0.0-4940.g81c9387d.el8 ceph-noarch 18 k 2023-07-14T18:01:01.480 INFO:teuthology.orchestra.run.smithi163.stdout: elfutils-libelf-devel x86_64 0.186-1.el8 rhel-8-for-x86_64-baseos-rpms 60 k 2023-07-14T18:01:01.480 INFO:teuthology.orchestra.run.smithi163.stdout: flex x86_64 2.6.1-9.el8 rhel-8-for-x86_64-appstream-rpms 320 k 2023-07-14T18:01:01.480 INFO:teuthology.orchestra.run.smithi163.stdout: libaio-devel x86_64 0.3.112-1.el8 rhel-8-for-x86_64-baseos-rpms 19 k 2023-07-14T18:01:01.480 INFO:teuthology.orchestra.run.smithi163.stdout: libcephfs-devel x86_64 2:18.0.0-4940.g81c9387d.el8 ceph 31 k 2023-07-14T18:01:01.480 INFO:teuthology.orchestra.run.smithi163.stdout: libcephfs2 x86_64 2:18.0.0-4940.g81c9387d.el8 ceph 772 k 2023-07-14T18:01:01.480 INFO:teuthology.orchestra.run.smithi163.stdout: librados-devel x86_64 2:18.0.0-4940.g81c9387d.el8 ceph 139 k 2023-07-14T18:01:01.481 INFO:teuthology.orchestra.run.smithi163.stdout: libtool x86_64 2.4.6-25.el8 rhel-8-for-x86_64-appstream-rpms 709 k 2023-07-14T18:01:01.481 INFO:teuthology.orchestra.run.smithi163.stdout: libuuid-devel x86_64 2.32.1-35.el8 rhel-8-for-x86_64-baseos-rpms 98 k 2023-07-14T18:01:01.481 INFO:teuthology.orchestra.run.smithi163.stdout: openssl-devel x86_64 1:1.1.1k-7.el8_6 rhel-8-for-x86_64-baseos-rpms 2.3 M 2023-07-14T18:01:01.481 INFO:teuthology.orchestra.run.smithi163.stdout: postgresql x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 1.5 M 2023-07-14T18:01:01.481 INFO:teuthology.orchestra.run.smithi163.stdout: postgresql-contrib x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 808 k 2023-07-14T18:01:01.481 INFO:teuthology.orchestra.run.smithi163.stdout: postgresql-server x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 5.1 M 2023-07-14T18:01:01.481 INFO:teuthology.orchestra.run.smithi163.stdout: python3-cephfs x86_64 2:18.0.0-4940.g81c9387d.el8 ceph 197 k 2023-07-14T18:01:01.481 INFO:teuthology.orchestra.run.smithi163.stdout: python3-rados x86_64 2:18.0.0-4940.g81c9387d.el8 ceph 371 k 2023-07-14T18:01:01.482 INFO:teuthology.orchestra.run.smithi163.stdout: python3-rbd x86_64 2:18.0.0-4940.g81c9387d.el8 ceph 364 k 2023-07-14T18:01:01.482 INFO:teuthology.orchestra.run.smithi163.stdout: python3-rgw x86_64 2:18.0.0-4940.g81c9387d.el8 ceph 107 k 2023-07-14T18:01:01.482 INFO:teuthology.orchestra.run.smithi163.stdout: rbd-fuse x86_64 2:18.0.0-4940.g81c9387d.el8 ceph 94 k 2023-07-14T18:01:01.482 INFO:teuthology.orchestra.run.smithi163.stdout: rbd-mirror x86_64 2:18.0.0-4940.g81c9387d.el8 ceph 3.5 M 2023-07-14T18:01:01.482 INFO:teuthology.orchestra.run.smithi163.stdout: rbd-nbd x86_64 2:18.0.0-4940.g81c9387d.el8 ceph 179 k 2023-07-14T18:01:01.482 INFO:teuthology.orchestra.run.smithi163.stdout: xfsprogs-devel x86_64 5.0.0-10.el8 rhel-8-for-x86_64-baseos-rpms 72 k 2023-07-14T18:01:01.482 INFO:teuthology.orchestra.run.smithi163.stdout:Upgrading: 2023-07-14T18:01:01.482 INFO:teuthology.orchestra.run.smithi163.stdout: iproute x86_64 5.15.0-4.el8_6.1 rhel-8-for-x86_64-baseos-rpms 798 k 2023-07-14T18:01:01.483 INFO:teuthology.orchestra.run.smithi163.stdout: librados2 x86_64 2:18.0.0-4940.g81c9387d.el8 ceph 3.7 M 2023-07-14T18:01:01.483 INFO:teuthology.orchestra.run.smithi163.stdout: librbd1 x86_64 2:18.0.0-4940.g81c9387d.el8 ceph 3.6 M 2023-07-14T18:01:01.483 INFO:teuthology.orchestra.run.smithi163.stdout:Installing dependencies: 2023-07-14T18:01:01.483 INFO:teuthology.orchestra.run.smithi163.stdout: automake noarch 1.16.1-7.el8 rhel-8-for-x86_64-appstream-rpms 713 k 2023-07-14T18:01:01.483 INFO:teuthology.orchestra.run.smithi163.stdout: ceph-common x86_64 2:18.0.0-4940.g81c9387d.el8 ceph 22 M 2023-07-14T18:01:01.483 INFO:teuthology.orchestra.run.smithi163.stdout: ceph-grafana-dashboards noarch 2:18.0.0-4940.g81c9387d.el8 ceph-noarch 23 k 2023-07-14T18:01:01.483 INFO:teuthology.orchestra.run.smithi163.stdout: ceph-mds x86_64 2:18.0.0-4940.g81c9387d.el8 ceph 2.3 M 2023-07-14T18:01:01.484 INFO:teuthology.orchestra.run.smithi163.stdout: ceph-mgr-modules-core noarch 2:18.0.0-4940.g81c9387d.el8 ceph-noarch 241 k 2023-07-14T18:01:01.484 INFO:teuthology.orchestra.run.smithi163.stdout: ceph-mon x86_64 2:18.0.0-4940.g81c9387d.el8 ceph 4.6 M 2023-07-14T18:01:01.484 INFO:teuthology.orchestra.run.smithi163.stdout: ceph-osd x86_64 2:18.0.0-4940.g81c9387d.el8 ceph 18 M 2023-07-14T18:01:01.484 INFO:teuthology.orchestra.run.smithi163.stdout: ceph-prometheus-alerts noarch 2:18.0.0-4940.g81c9387d.el8 ceph-noarch 15 k 2023-07-14T18:01:01.484 INFO:teuthology.orchestra.run.smithi163.stdout: ceph-selinux x86_64 2:18.0.0-4940.g81c9387d.el8 ceph 24 k 2023-07-14T18:01:01.484 INFO:teuthology.orchestra.run.smithi163.stdout: fuse x86_64 2.9.7-15.el8 rhel-8-for-x86_64-baseos-rpms 83 k 2023-07-14T18:01:01.484 INFO:teuthology.orchestra.run.smithi163.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2023-07-14T18:01:01.485 INFO:teuthology.orchestra.run.smithi163.stdout: jq x86_64 1.6-3.el8 rhel-8-for-x86_64-appstream-rpms 202 k 2023-07-14T18:01:01.485 INFO:teuthology.orchestra.run.smithi163.stdout: keyutils-libs-devel x86_64 1.5.10-9.el8 rhel-8-for-x86_64-baseos-rpms 48 k 2023-07-14T18:01:01.485 INFO:teuthology.orchestra.run.smithi163.stdout: krb5-devel x86_64 1.18.2-14.el8 rhel-8-for-x86_64-baseos-rpms 560 k 2023-07-14T18:01:01.485 INFO:teuthology.orchestra.run.smithi163.stdout: libcephsqlite x86_64 2:18.0.0-4940.g81c9387d.el8 ceph 135 k 2023-07-14T18:01:01.485 INFO:teuthology.orchestra.run.smithi163.stdout: libcom_err-devel x86_64 1.45.6-4.el8 rhel-8-for-x86_64-baseos-rpms 39 k 2023-07-14T18:01:01.485 INFO:teuthology.orchestra.run.smithi163.stdout: libgfortran x86_64 8.5.0-10.1.el8_6 rhel-8-for-x86_64-baseos-rpms 644 k 2023-07-14T18:01:01.485 INFO:teuthology.orchestra.run.smithi163.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2023-07-14T18:01:01.485 INFO:teuthology.orchestra.run.smithi163.stdout: libpq x86_64 13.5-1.el8 rhel-8-for-x86_64-appstream-rpms 198 k 2023-07-14T18:01:01.486 INFO:teuthology.orchestra.run.smithi163.stdout: libquadmath x86_64 8.5.0-10.1.el8_6 rhel-8-for-x86_64-baseos-rpms 171 k 2023-07-14T18:01:01.486 INFO:teuthology.orchestra.run.smithi163.stdout: librabbitmq x86_64 0.9.0-3.el8 rhel-8-for-x86_64-baseos-rpms 47 k 2023-07-14T18:01:01.486 INFO:teuthology.orchestra.run.smithi163.stdout: libradosstriper1 x86_64 2:18.0.0-4940.g81c9387d.el8 ceph 473 k 2023-07-14T18:01:01.486 INFO:teuthology.orchestra.run.smithi163.stdout: librdkafka x86_64 0.11.4-3.el8 rhel-8-for-x86_64-appstream-rpms 354 k 2023-07-14T18:01:01.486 INFO:teuthology.orchestra.run.smithi163.stdout: librgw2 x86_64 2:18.0.0-4940.g81c9387d.el8 ceph 6.8 M 2023-07-14T18:01:01.486 INFO:teuthology.orchestra.run.smithi163.stdout: libselinux-devel x86_64 2.9-5.el8 rhel-8-for-x86_64-baseos-rpms 200 k 2023-07-14T18:01:01.486 INFO:teuthology.orchestra.run.smithi163.stdout: libsepol-devel x86_64 2.9-3.el8 rhel-8-for-x86_64-baseos-rpms 87 k 2023-07-14T18:01:01.487 INFO:teuthology.orchestra.run.smithi163.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2023-07-14T18:01:01.487 INFO:teuthology.orchestra.run.smithi163.stdout: libverto-devel x86_64 0.3.0-5.el8 rhel-8-for-x86_64-baseos-rpms 18 k 2023-07-14T18:01:01.487 INFO:teuthology.orchestra.run.smithi163.stdout: lttng-ust x86_64 2.8.1-11.el8 rhel-8-for-x86_64-appstream-rpms 259 k 2023-07-14T18:01:01.487 INFO:teuthology.orchestra.run.smithi163.stdout: oniguruma x86_64 6.8.2-2.el8 rhel-8-for-x86_64-appstream-rpms 187 k 2023-07-14T18:01:01.487 INFO:teuthology.orchestra.run.smithi163.stdout: openblas x86_64 0.3.15-3.el8 rhel-8-for-x86_64-appstream-rpms 4.7 M 2023-07-14T18:01:01.487 INFO:teuthology.orchestra.run.smithi163.stdout: openblas-threads x86_64 0.3.15-3.el8 rhel-8-for-x86_64-appstream-rpms 4.9 M 2023-07-14T18:01:01.487 INFO:teuthology.orchestra.run.smithi163.stdout: pcre2-devel x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 605 k 2023-07-14T18:01:01.487 INFO:teuthology.orchestra.run.smithi163.stdout: pcre2-utf16 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 229 k 2023-07-14T18:01:01.488 INFO:teuthology.orchestra.run.smithi163.stdout: pcre2-utf32 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 220 k 2023-07-14T18:01:01.488 INFO:teuthology.orchestra.run.smithi163.stdout: python3-asyncssh noarch 2.7.0-2.el8 epel 476 k 2023-07-14T18:01:01.488 INFO:teuthology.orchestra.run.smithi163.stdout: python3-babel noarch 2.5.1-7.el8 rhel-8-for-x86_64-appstream-rpms 4.8 M 2023-07-14T18:01:01.488 INFO:teuthology.orchestra.run.smithi163.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2023-07-14T18:01:01.488 INFO:teuthology.orchestra.run.smithi163.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2023-07-14T18:01:01.488 INFO:teuthology.orchestra.run.smithi163.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2023-07-14T18:01:01.488 INFO:teuthology.orchestra.run.smithi163.stdout: python3-ceph-argparse x86_64 2:18.0.0-4940.g81c9387d.el8 ceph 45 k 2023-07-14T18:01:01.489 INFO:teuthology.orchestra.run.smithi163.stdout: python3-ceph-common x86_64 2:18.0.0-4940.g81c9387d.el8 ceph 122 k 2023-07-14T18:01:01.489 INFO:teuthology.orchestra.run.smithi163.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2023-07-14T18:01:01.489 INFO:teuthology.orchestra.run.smithi163.stdout: python3-cffi x86_64 1.11.5-5.el8 rhel-8-for-x86_64-baseos-rpms 238 k 2023-07-14T18:01:01.489 INFO:teuthology.orchestra.run.smithi163.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2023-07-14T18:01:01.489 INFO:teuthology.orchestra.run.smithi163.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2023-07-14T18:01:01.489 INFO:teuthology.orchestra.run.smithi163.stdout: python3-cryptography x86_64 3.2.1-5.el8 rhel-8-for-x86_64-baseos-rpms 559 k 2023-07-14T18:01:01.489 INFO:teuthology.orchestra.run.smithi163.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2023-07-14T18:01:01.489 INFO:teuthology.orchestra.run.smithi163.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2023-07-14T18:01:01.490 INFO:teuthology.orchestra.run.smithi163.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2023-07-14T18:01:01.490 INFO:teuthology.orchestra.run.smithi163.stdout: python3-jinja2 noarch 2.10.1-3.el8 rhel-8-for-x86_64-appstream-rpms 538 k 2023-07-14T18:01:01.490 INFO:teuthology.orchestra.run.smithi163.stdout: python3-jsonpatch noarch 1.21-2.el8 rhel-8-for-x86_64-appstream-rpms 27 k 2023-07-14T18:01:01.490 INFO:teuthology.orchestra.run.smithi163.stdout: python3-jsonpointer noarch 1.10-11.el8 rhel-8-for-x86_64-appstream-rpms 20 k 2023-07-14T18:01:01.490 INFO:teuthology.orchestra.run.smithi163.stdout: python3-jwt noarch 1.6.1-2.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-07-14T18:01:01.490 INFO:teuthology.orchestra.run.smithi163.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2023-07-14T18:01:01.490 INFO:teuthology.orchestra.run.smithi163.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2023-07-14T18:01:01.490 INFO:teuthology.orchestra.run.smithi163.stdout: python3-mako noarch 1.0.6-13.el8 rhel-8-for-x86_64-appstream-rpms 157 k 2023-07-14T18:01:01.491 INFO:teuthology.orchestra.run.smithi163.stdout: python3-markupsafe x86_64 0.23-19.el8 rhel-8-for-x86_64-appstream-rpms 39 k 2023-07-14T18:01:01.491 INFO:teuthology.orchestra.run.smithi163.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2023-07-14T18:01:01.491 INFO:teuthology.orchestra.run.smithi163.stdout: python3-natsort noarch 7.1.1-2.el8 epel 60 k 2023-07-14T18:01:01.491 INFO:teuthology.orchestra.run.smithi163.stdout: python3-numpy x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 3.7 M 2023-07-14T18:01:01.491 INFO:teuthology.orchestra.run.smithi163.stdout: python3-numpy-f2py x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 225 k 2023-07-14T18:01:01.491 INFO:teuthology.orchestra.run.smithi163.stdout: python3-oauthlib noarch 2.1.0-1.el8 rhel-8-for-x86_64-baseos-rpms 155 k 2023-07-14T18:01:01.491 INFO:teuthology.orchestra.run.smithi163.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2023-07-14T18:01:01.492 INFO:teuthology.orchestra.run.smithi163.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2023-07-14T18:01:01.492 INFO:teuthology.orchestra.run.smithi163.stdout: python3-prettytable noarch 0.7.2-14.el8 rhel-8-for-x86_64-appstream-rpms 44 k 2023-07-14T18:01:01.492 INFO:teuthology.orchestra.run.smithi163.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 rhel-8-for-x86_64-appstream-rpms 103 k 2023-07-14T18:01:01.492 INFO:teuthology.orchestra.run.smithi163.stdout: python3-pyasn1 noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 126 k 2023-07-14T18:01:01.492 INFO:teuthology.orchestra.run.smithi163.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 110 k 2023-07-14T18:01:01.492 INFO:teuthology.orchestra.run.smithi163.stdout: python3-pycparser noarch 2.14-14.el8 rhel-8-for-x86_64-baseos-rpms 109 k 2023-07-14T18:01:01.492 INFO:teuthology.orchestra.run.smithi163.stdout: python3-pytz noarch 2017.2-9.el8 rhel-8-for-x86_64-appstream-rpms 54 k 2023-07-14T18:01:01.492 INFO:teuthology.orchestra.run.smithi163.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2023-07-14T18:01:01.493 INFO:teuthology.orchestra.run.smithi163.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-07-14T18:01:01.493 INFO:teuthology.orchestra.run.smithi163.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2023-07-14T18:01:01.493 INFO:teuthology.orchestra.run.smithi163.stdout: python3-rsa noarch 4.8-1.el8 epel 61 k 2023-07-14T18:01:01.493 INFO:teuthology.orchestra.run.smithi163.stdout: python3-scipy x86_64 1.0.0-21.module+el8.5.0+10916+41bd434d rhel-8-for-x86_64-appstream-rpms 14 M 2023-07-14T18:01:01.493 INFO:teuthology.orchestra.run.smithi163.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2023-07-14T18:01:01.493 INFO:teuthology.orchestra.run.smithi163.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2023-07-14T18:01:01.493 INFO:teuthology.orchestra.run.smithi163.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2023-07-14T18:01:01.493 INFO:teuthology.orchestra.run.smithi163.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2023-07-14T18:01:01.494 INFO:teuthology.orchestra.run.smithi163.stdout: python3-waitress noarch 1.4.3-1.el8 epel 255 k 2023-07-14T18:01:01.494 INFO:teuthology.orchestra.run.smithi163.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2023-07-14T18:01:01.494 INFO:teuthology.orchestra.run.smithi163.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2023-07-14T18:01:01.494 INFO:teuthology.orchestra.run.smithi163.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2023-07-14T18:01:01.494 INFO:teuthology.orchestra.run.smithi163.stdout: python3-werkzeug noarch 0.12.2-4.el8 rhel-8-for-x86_64-appstream-rpms 457 k 2023-07-14T18:01:01.494 INFO:teuthology.orchestra.run.smithi163.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2023-07-14T18:01:01.494 INFO:teuthology.orchestra.run.smithi163.stdout: socat x86_64 1.7.4.1-1.el8 rhel-8-for-x86_64-appstream-rpms 323 k 2023-07-14T18:01:01.495 INFO:teuthology.orchestra.run.smithi163.stdout: thrift x86_64 0.13.0-2.el8 epel 1.7 M 2023-07-14T18:01:01.495 INFO:teuthology.orchestra.run.smithi163.stdout: uuid x86_64 1.6.2-43.el8 rhel-8-for-x86_64-appstream-rpms 64 k 2023-07-14T18:01:01.495 INFO:teuthology.orchestra.run.smithi163.stdout: xmlstarlet x86_64 1.6.1-20.el8 lab-extras 70 k 2023-07-14T18:01:01.495 INFO:teuthology.orchestra.run.smithi163.stdout: zlib-devel x86_64 1.2.11-18.el8_5 rhel-8-for-x86_64-baseos-rpms 58 k 2023-07-14T18:01:01.495 INFO:teuthology.orchestra.run.smithi163.stdout:Enabling module streams: 2023-07-14T18:01:01.495 INFO:teuthology.orchestra.run.smithi163.stdout: postgresql 10 2023-07-14T18:01:01.495 INFO:teuthology.orchestra.run.smithi163.stdout: 2023-07-14T18:01:01.495 INFO:teuthology.orchestra.run.smithi163.stdout:Transaction Summary 2023-07-14T18:01:01.496 INFO:teuthology.orchestra.run.smithi163.stdout:=========================================================================================================================== 2023-07-14T18:01:01.496 INFO:teuthology.orchestra.run.smithi163.stdout:Install 128 Packages 2023-07-14T18:01:01.496 INFO:teuthology.orchestra.run.smithi163.stdout:Upgrade 3 Packages 2023-07-14T18:01:01.496 INFO:teuthology.orchestra.run.smithi163.stdout: 2023-07-14T18:01:01.497 INFO:teuthology.orchestra.run.smithi163.stdout:Total download size: 206 M 2023-07-14T18:01:01.497 INFO:teuthology.orchestra.run.smithi163.stdout:Downloading Packages: 2023-07-14T18:01:01.793 INFO:teuthology.orchestra.run.smithi163.stdout:(1/131): ceph-18.0.0-4940.g81c9387d.el8.x86_64. 24 kB/s | 6.4 kB 00:00 2023-07-14T18:01:02.334 INFO:teuthology.orchestra.run.smithi163.stdout:(2/131): ceph-fuse-18.0.0-4940.g81c9387d.el8.x8 1.5 MB/s | 850 kB 00:00 2023-07-14T18:01:02.468 INFO:teuthology.orchestra.run.smithi163.stdout:(3/131): ceph-immutable-object-cache-18.0.0-494 1.2 MB/s | 167 kB 00:00 2023-07-14T18:01:03.094 INFO:teuthology.orchestra.run.smithi172.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2023-07-14T18:01:03.094 INFO:teuthology.orchestra.run.smithi172.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2023-07-14T18:01:03.109 INFO:teuthology.orchestra.run.smithi172.stdout:Package NetworkManager-1:1.36.0-4.el8.x86_64 is already installed. 2023-07-14T18:01:03.109 INFO:teuthology.orchestra.run.smithi172.stdout:Package iproute-5.15.0-4.el8.x86_64 is already installed. 2023-07-14T18:01:03.111 INFO:teuthology.orchestra.run.smithi172.stdout:Package util-linux-2.32.1-35.el8.x86_64 is already installed. 2023-07-14T18:01:03.112 INFO:teuthology.orchestra.run.smithi172.stdout:Package libacl-devel-2.2.53-1.el8.x86_64 is already installed. 2023-07-14T18:01:03.114 INFO:teuthology.orchestra.run.smithi172.stdout:Package libattr-devel-2.4.48-3.el8.x86_64 is already installed. 2023-07-14T18:01:03.117 INFO:teuthology.orchestra.run.smithi172.stdout:Package xfsdump-3.1.8-4.el8.x86_64 is already installed. 2023-07-14T18:01:03.118 INFO:teuthology.orchestra.run.smithi172.stdout:Package xfsprogs-5.0.0-10.el8.x86_64 is already installed. 2023-07-14T18:01:03.253 INFO:teuthology.orchestra.run.smithi172.stdout:Dependencies resolved. 2023-07-14T18:01:03.264 INFO:teuthology.orchestra.run.smithi172.stdout:=========================================================================================================================== 2023-07-14T18:01:03.264 INFO:teuthology.orchestra.run.smithi172.stdout: Package Arch Version Repository Size 2023-07-14T18:01:03.264 INFO:teuthology.orchestra.run.smithi172.stdout:=========================================================================================================================== 2023-07-14T18:01:03.264 INFO:teuthology.orchestra.run.smithi172.stdout:Installing: 2023-07-14T18:01:03.264 INFO:teuthology.orchestra.run.smithi172.stdout: NetworkManager-initscripts-updown noarch 1:1.36.0-9.el8_6 rhel-8-for-x86_64-baseos-rpms 138 k 2023-07-14T18:01:03.265 INFO:teuthology.orchestra.run.smithi172.stdout: bison x86_64 3.0.4-10.el8 rhel-8-for-x86_64-appstream-rpms 688 k 2023-07-14T18:01:03.265 INFO:teuthology.orchestra.run.smithi172.stdout: ceph x86_64 2:18.0.0-4940.g81c9387d.el8 ceph 6.4 k 2023-07-14T18:01:03.265 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-base x86_64 2:18.0.0-4940.g81c9387d.el8 ceph 5.4 M 2023-07-14T18:01:03.265 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-fuse x86_64 2:18.0.0-4940.g81c9387d.el8 ceph 850 k 2023-07-14T18:01:03.265 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-immutable-object-cache x86_64 2:18.0.0-4940.g81c9387d.el8 ceph 167 k 2023-07-14T18:01:03.265 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-mgr x86_64 2:18.0.0-4940.g81c9387d.el8 ceph 1.6 M 2023-07-14T18:01:03.265 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-mgr-cephadm noarch 2:18.0.0-4940.g81c9387d.el8 ceph-noarch 129 k 2023-07-14T18:01:03.265 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-mgr-dashboard noarch 2:18.0.0-4940.g81c9387d.el8 ceph-noarch 1.7 M 2023-07-14T18:01:03.266 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-mgr-diskprediction-local noarch 2:18.0.0-4940.g81c9387d.el8 ceph-noarch 7.4 M 2023-07-14T18:01:03.266 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-mgr-rook noarch 2:18.0.0-4940.g81c9387d.el8 ceph-noarch 47 k 2023-07-14T18:01:03.266 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-radosgw x86_64 2:18.0.0-4940.g81c9387d.el8 ceph 14 M 2023-07-14T18:01:03.266 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-test x86_64 2:18.0.0-4940.g81c9387d.el8 ceph 48 M 2023-07-14T18:01:03.266 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-volume noarch 2:18.0.0-4940.g81c9387d.el8 ceph-noarch 258 k 2023-07-14T18:01:03.266 INFO:teuthology.orchestra.run.smithi172.stdout: cephadm noarch 2:18.0.0-4940.g81c9387d.el8 ceph-noarch 165 k 2023-07-14T18:01:03.266 INFO:teuthology.orchestra.run.smithi172.stdout: cephfs-mirror x86_64 2:18.0.0-4940.g81c9387d.el8 ceph 260 k 2023-07-14T18:01:03.266 INFO:teuthology.orchestra.run.smithi172.stdout: cephfs-top noarch 2:18.0.0-4940.g81c9387d.el8 ceph-noarch 18 k 2023-07-14T18:01:03.267 INFO:teuthology.orchestra.run.smithi172.stdout: elfutils-libelf-devel x86_64 0.186-1.el8 rhel-8-for-x86_64-baseos-rpms 60 k 2023-07-14T18:01:03.267 INFO:teuthology.orchestra.run.smithi172.stdout: flex x86_64 2.6.1-9.el8 rhel-8-for-x86_64-appstream-rpms 320 k 2023-07-14T18:01:03.267 INFO:teuthology.orchestra.run.smithi172.stdout: libaio-devel x86_64 0.3.112-1.el8 rhel-8-for-x86_64-baseos-rpms 19 k 2023-07-14T18:01:03.267 INFO:teuthology.orchestra.run.smithi172.stdout: libcephfs-devel x86_64 2:18.0.0-4940.g81c9387d.el8 ceph 31 k 2023-07-14T18:01:03.267 INFO:teuthology.orchestra.run.smithi172.stdout: libcephfs2 x86_64 2:18.0.0-4940.g81c9387d.el8 ceph 772 k 2023-07-14T18:01:03.267 INFO:teuthology.orchestra.run.smithi172.stdout: librados-devel x86_64 2:18.0.0-4940.g81c9387d.el8 ceph 139 k 2023-07-14T18:01:03.267 INFO:teuthology.orchestra.run.smithi172.stdout: libtool x86_64 2.4.6-25.el8 rhel-8-for-x86_64-appstream-rpms 709 k 2023-07-14T18:01:03.268 INFO:teuthology.orchestra.run.smithi172.stdout: libuuid-devel x86_64 2.32.1-35.el8 rhel-8-for-x86_64-baseos-rpms 98 k 2023-07-14T18:01:03.268 INFO:teuthology.orchestra.run.smithi172.stdout: openssl-devel x86_64 1:1.1.1k-7.el8_6 rhel-8-for-x86_64-baseos-rpms 2.3 M 2023-07-14T18:01:03.268 INFO:teuthology.orchestra.run.smithi172.stdout: postgresql x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 1.5 M 2023-07-14T18:01:03.268 INFO:teuthology.orchestra.run.smithi172.stdout: postgresql-contrib x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 808 k 2023-07-14T18:01:03.268 INFO:teuthology.orchestra.run.smithi172.stdout: postgresql-server x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 5.1 M 2023-07-14T18:01:03.268 INFO:teuthology.orchestra.run.smithi172.stdout: python3-cephfs x86_64 2:18.0.0-4940.g81c9387d.el8 ceph 197 k 2023-07-14T18:01:03.268 INFO:teuthology.orchestra.run.smithi172.stdout: python3-rados x86_64 2:18.0.0-4940.g81c9387d.el8 ceph 371 k 2023-07-14T18:01:03.269 INFO:teuthology.orchestra.run.smithi172.stdout: python3-rbd x86_64 2:18.0.0-4940.g81c9387d.el8 ceph 364 k 2023-07-14T18:01:03.269 INFO:teuthology.orchestra.run.smithi172.stdout: python3-rgw x86_64 2:18.0.0-4940.g81c9387d.el8 ceph 107 k 2023-07-14T18:01:03.269 INFO:teuthology.orchestra.run.smithi172.stdout: rbd-fuse x86_64 2:18.0.0-4940.g81c9387d.el8 ceph 94 k 2023-07-14T18:01:03.269 INFO:teuthology.orchestra.run.smithi172.stdout: rbd-mirror x86_64 2:18.0.0-4940.g81c9387d.el8 ceph 3.5 M 2023-07-14T18:01:03.269 INFO:teuthology.orchestra.run.smithi172.stdout: rbd-nbd x86_64 2:18.0.0-4940.g81c9387d.el8 ceph 179 k 2023-07-14T18:01:03.269 INFO:teuthology.orchestra.run.smithi172.stdout: xfsprogs-devel x86_64 5.0.0-10.el8 rhel-8-for-x86_64-baseos-rpms 72 k 2023-07-14T18:01:03.269 INFO:teuthology.orchestra.run.smithi172.stdout:Upgrading: 2023-07-14T18:01:03.269 INFO:teuthology.orchestra.run.smithi172.stdout: iproute x86_64 5.15.0-4.el8_6.1 rhel-8-for-x86_64-baseos-rpms 798 k 2023-07-14T18:01:03.270 INFO:teuthology.orchestra.run.smithi172.stdout: librados2 x86_64 2:18.0.0-4940.g81c9387d.el8 ceph 3.7 M 2023-07-14T18:01:03.270 INFO:teuthology.orchestra.run.smithi172.stdout: librbd1 x86_64 2:18.0.0-4940.g81c9387d.el8 ceph 3.6 M 2023-07-14T18:01:03.270 INFO:teuthology.orchestra.run.smithi172.stdout:Installing dependencies: 2023-07-14T18:01:03.270 INFO:teuthology.orchestra.run.smithi172.stdout: automake noarch 1.16.1-7.el8 rhel-8-for-x86_64-appstream-rpms 713 k 2023-07-14T18:01:03.270 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-common x86_64 2:18.0.0-4940.g81c9387d.el8 ceph 22 M 2023-07-14T18:01:03.270 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-grafana-dashboards noarch 2:18.0.0-4940.g81c9387d.el8 ceph-noarch 23 k 2023-07-14T18:01:03.270 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-mds x86_64 2:18.0.0-4940.g81c9387d.el8 ceph 2.3 M 2023-07-14T18:01:03.270 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-mgr-modules-core noarch 2:18.0.0-4940.g81c9387d.el8 ceph-noarch 241 k 2023-07-14T18:01:03.271 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-mon x86_64 2:18.0.0-4940.g81c9387d.el8 ceph 4.6 M 2023-07-14T18:01:03.271 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-osd x86_64 2:18.0.0-4940.g81c9387d.el8 ceph 18 M 2023-07-14T18:01:03.271 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-prometheus-alerts noarch 2:18.0.0-4940.g81c9387d.el8 ceph-noarch 15 k 2023-07-14T18:01:03.271 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-selinux x86_64 2:18.0.0-4940.g81c9387d.el8 ceph 24 k 2023-07-14T18:01:03.271 INFO:teuthology.orchestra.run.smithi172.stdout: fuse x86_64 2.9.7-15.el8 rhel-8-for-x86_64-baseos-rpms 83 k 2023-07-14T18:01:03.271 INFO:teuthology.orchestra.run.smithi172.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2023-07-14T18:01:03.271 INFO:teuthology.orchestra.run.smithi172.stdout: jq x86_64 1.6-3.el8 rhel-8-for-x86_64-appstream-rpms 202 k 2023-07-14T18:01:03.272 INFO:teuthology.orchestra.run.smithi172.stdout: keyutils-libs-devel x86_64 1.5.10-9.el8 rhel-8-for-x86_64-baseos-rpms 48 k 2023-07-14T18:01:03.272 INFO:teuthology.orchestra.run.smithi172.stdout: krb5-devel x86_64 1.18.2-14.el8 rhel-8-for-x86_64-baseos-rpms 560 k 2023-07-14T18:01:03.272 INFO:teuthology.orchestra.run.smithi172.stdout: libcephsqlite x86_64 2:18.0.0-4940.g81c9387d.el8 ceph 135 k 2023-07-14T18:01:03.272 INFO:teuthology.orchestra.run.smithi172.stdout: libcom_err-devel x86_64 1.45.6-4.el8 rhel-8-for-x86_64-baseos-rpms 39 k 2023-07-14T18:01:03.272 INFO:teuthology.orchestra.run.smithi172.stdout: libgfortran x86_64 8.5.0-10.1.el8_6 rhel-8-for-x86_64-baseos-rpms 644 k 2023-07-14T18:01:03.272 INFO:teuthology.orchestra.run.smithi172.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2023-07-14T18:01:03.272 INFO:teuthology.orchestra.run.smithi172.stdout: libpq x86_64 13.5-1.el8 rhel-8-for-x86_64-appstream-rpms 198 k 2023-07-14T18:01:03.272 INFO:teuthology.orchestra.run.smithi172.stdout: libquadmath x86_64 8.5.0-10.1.el8_6 rhel-8-for-x86_64-baseos-rpms 171 k 2023-07-14T18:01:03.273 INFO:teuthology.orchestra.run.smithi172.stdout: librabbitmq x86_64 0.9.0-3.el8 rhel-8-for-x86_64-baseos-rpms 47 k 2023-07-14T18:01:03.273 INFO:teuthology.orchestra.run.smithi172.stdout: libradosstriper1 x86_64 2:18.0.0-4940.g81c9387d.el8 ceph 473 k 2023-07-14T18:01:03.273 INFO:teuthology.orchestra.run.smithi172.stdout: librdkafka x86_64 0.11.4-3.el8 rhel-8-for-x86_64-appstream-rpms 354 k 2023-07-14T18:01:03.273 INFO:teuthology.orchestra.run.smithi172.stdout: librgw2 x86_64 2:18.0.0-4940.g81c9387d.el8 ceph 6.8 M 2023-07-14T18:01:03.273 INFO:teuthology.orchestra.run.smithi172.stdout: libselinux-devel x86_64 2.9-5.el8 rhel-8-for-x86_64-baseos-rpms 200 k 2023-07-14T18:01:03.273 INFO:teuthology.orchestra.run.smithi172.stdout: libsepol-devel x86_64 2.9-3.el8 rhel-8-for-x86_64-baseos-rpms 87 k 2023-07-14T18:01:03.274 INFO:teuthology.orchestra.run.smithi172.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2023-07-14T18:01:03.274 INFO:teuthology.orchestra.run.smithi172.stdout: libverto-devel x86_64 0.3.0-5.el8 rhel-8-for-x86_64-baseos-rpms 18 k 2023-07-14T18:01:03.274 INFO:teuthology.orchestra.run.smithi172.stdout: lttng-ust x86_64 2.8.1-11.el8 rhel-8-for-x86_64-appstream-rpms 259 k 2023-07-14T18:01:03.274 INFO:teuthology.orchestra.run.smithi172.stdout: oniguruma x86_64 6.8.2-2.el8 rhel-8-for-x86_64-appstream-rpms 187 k 2023-07-14T18:01:03.274 INFO:teuthology.orchestra.run.smithi172.stdout: openblas x86_64 0.3.15-3.el8 rhel-8-for-x86_64-appstream-rpms 4.7 M 2023-07-14T18:01:03.274 INFO:teuthology.orchestra.run.smithi172.stdout: openblas-threads x86_64 0.3.15-3.el8 rhel-8-for-x86_64-appstream-rpms 4.9 M 2023-07-14T18:01:03.274 INFO:teuthology.orchestra.run.smithi172.stdout: pcre2-devel x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 605 k 2023-07-14T18:01:03.274 INFO:teuthology.orchestra.run.smithi172.stdout: pcre2-utf16 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 229 k 2023-07-14T18:01:03.275 INFO:teuthology.orchestra.run.smithi172.stdout: pcre2-utf32 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 220 k 2023-07-14T18:01:03.275 INFO:teuthology.orchestra.run.smithi172.stdout: python3-asyncssh noarch 2.7.0-2.el8 epel 476 k 2023-07-14T18:01:03.275 INFO:teuthology.orchestra.run.smithi172.stdout: python3-babel noarch 2.5.1-7.el8 rhel-8-for-x86_64-appstream-rpms 4.8 M 2023-07-14T18:01:03.275 INFO:teuthology.orchestra.run.smithi172.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2023-07-14T18:01:03.275 INFO:teuthology.orchestra.run.smithi172.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2023-07-14T18:01:03.275 INFO:teuthology.orchestra.run.smithi172.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2023-07-14T18:01:03.275 INFO:teuthology.orchestra.run.smithi172.stdout: python3-ceph-argparse x86_64 2:18.0.0-4940.g81c9387d.el8 ceph 45 k 2023-07-14T18:01:03.276 INFO:teuthology.orchestra.run.smithi172.stdout: python3-ceph-common x86_64 2:18.0.0-4940.g81c9387d.el8 ceph 122 k 2023-07-14T18:01:03.276 INFO:teuthology.orchestra.run.smithi172.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2023-07-14T18:01:03.276 INFO:teuthology.orchestra.run.smithi172.stdout: python3-cffi x86_64 1.11.5-5.el8 rhel-8-for-x86_64-baseos-rpms 238 k 2023-07-14T18:01:03.276 INFO:teuthology.orchestra.run.smithi172.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2023-07-14T18:01:03.276 INFO:teuthology.orchestra.run.smithi172.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2023-07-14T18:01:03.276 INFO:teuthology.orchestra.run.smithi172.stdout: python3-cryptography x86_64 3.2.1-5.el8 rhel-8-for-x86_64-baseos-rpms 559 k 2023-07-14T18:01:03.276 INFO:teuthology.orchestra.run.smithi172.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2023-07-14T18:01:03.277 INFO:teuthology.orchestra.run.smithi172.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2023-07-14T18:01:03.277 INFO:teuthology.orchestra.run.smithi172.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2023-07-14T18:01:03.277 INFO:teuthology.orchestra.run.smithi172.stdout: python3-jinja2 noarch 2.10.1-3.el8 rhel-8-for-x86_64-appstream-rpms 538 k 2023-07-14T18:01:03.277 INFO:teuthology.orchestra.run.smithi172.stdout: python3-jsonpatch noarch 1.21-2.el8 rhel-8-for-x86_64-appstream-rpms 27 k 2023-07-14T18:01:03.277 INFO:teuthology.orchestra.run.smithi172.stdout: python3-jsonpointer noarch 1.10-11.el8 rhel-8-for-x86_64-appstream-rpms 20 k 2023-07-14T18:01:03.277 INFO:teuthology.orchestra.run.smithi172.stdout: python3-jwt noarch 1.6.1-2.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-07-14T18:01:03.277 INFO:teuthology.orchestra.run.smithi172.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2023-07-14T18:01:03.277 INFO:teuthology.orchestra.run.smithi172.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2023-07-14T18:01:03.278 INFO:teuthology.orchestra.run.smithi172.stdout: python3-mako noarch 1.0.6-13.el8 rhel-8-for-x86_64-appstream-rpms 157 k 2023-07-14T18:01:03.278 INFO:teuthology.orchestra.run.smithi172.stdout: python3-markupsafe x86_64 0.23-19.el8 rhel-8-for-x86_64-appstream-rpms 39 k 2023-07-14T18:01:03.278 INFO:teuthology.orchestra.run.smithi172.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2023-07-14T18:01:03.278 INFO:teuthology.orchestra.run.smithi172.stdout: python3-natsort noarch 7.1.1-2.el8 epel 60 k 2023-07-14T18:01:03.278 INFO:teuthology.orchestra.run.smithi172.stdout: python3-numpy x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 3.7 M 2023-07-14T18:01:03.278 INFO:teuthology.orchestra.run.smithi172.stdout: python3-numpy-f2py x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 225 k 2023-07-14T18:01:03.278 INFO:teuthology.orchestra.run.smithi172.stdout: python3-oauthlib noarch 2.1.0-1.el8 rhel-8-for-x86_64-baseos-rpms 155 k 2023-07-14T18:01:03.278 INFO:teuthology.orchestra.run.smithi172.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2023-07-14T18:01:03.279 INFO:teuthology.orchestra.run.smithi172.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2023-07-14T18:01:03.279 INFO:teuthology.orchestra.run.smithi172.stdout: python3-prettytable noarch 0.7.2-14.el8 rhel-8-for-x86_64-appstream-rpms 44 k 2023-07-14T18:01:03.279 INFO:teuthology.orchestra.run.smithi172.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 rhel-8-for-x86_64-appstream-rpms 103 k 2023-07-14T18:01:03.279 INFO:teuthology.orchestra.run.smithi172.stdout: python3-pyasn1 noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 126 k 2023-07-14T18:01:03.279 INFO:teuthology.orchestra.run.smithi172.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 110 k 2023-07-14T18:01:03.279 INFO:teuthology.orchestra.run.smithi172.stdout: python3-pycparser noarch 2.14-14.el8 rhel-8-for-x86_64-baseos-rpms 109 k 2023-07-14T18:01:03.279 INFO:teuthology.orchestra.run.smithi172.stdout: python3-pytz noarch 2017.2-9.el8 rhel-8-for-x86_64-appstream-rpms 54 k 2023-07-14T18:01:03.280 INFO:teuthology.orchestra.run.smithi172.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2023-07-14T18:01:03.280 INFO:teuthology.orchestra.run.smithi172.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-07-14T18:01:03.280 INFO:teuthology.orchestra.run.smithi172.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2023-07-14T18:01:03.280 INFO:teuthology.orchestra.run.smithi172.stdout: python3-rsa noarch 4.8-1.el8 epel 61 k 2023-07-14T18:01:03.280 INFO:teuthology.orchestra.run.smithi172.stdout: python3-scipy x86_64 1.0.0-21.module+el8.5.0+10916+41bd434d rhel-8-for-x86_64-appstream-rpms 14 M 2023-07-14T18:01:03.280 INFO:teuthology.orchestra.run.smithi172.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2023-07-14T18:01:03.280 INFO:teuthology.orchestra.run.smithi172.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2023-07-14T18:01:03.280 INFO:teuthology.orchestra.run.smithi172.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2023-07-14T18:01:03.281 INFO:teuthology.orchestra.run.smithi172.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2023-07-14T18:01:03.281 INFO:teuthology.orchestra.run.smithi172.stdout: python3-waitress noarch 1.4.3-1.el8 epel 255 k 2023-07-14T18:01:03.281 INFO:teuthology.orchestra.run.smithi172.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2023-07-14T18:01:03.281 INFO:teuthology.orchestra.run.smithi172.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2023-07-14T18:01:03.281 INFO:teuthology.orchestra.run.smithi172.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2023-07-14T18:01:03.281 INFO:teuthology.orchestra.run.smithi172.stdout: python3-werkzeug noarch 0.12.2-4.el8 rhel-8-for-x86_64-appstream-rpms 457 k 2023-07-14T18:01:03.281 INFO:teuthology.orchestra.run.smithi172.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2023-07-14T18:01:03.281 INFO:teuthology.orchestra.run.smithi172.stdout: socat x86_64 1.7.4.1-1.el8 rhel-8-for-x86_64-appstream-rpms 323 k 2023-07-14T18:01:03.282 INFO:teuthology.orchestra.run.smithi172.stdout: thrift x86_64 0.13.0-2.el8 epel 1.7 M 2023-07-14T18:01:03.282 INFO:teuthology.orchestra.run.smithi172.stdout: uuid x86_64 1.6.2-43.el8 rhel-8-for-x86_64-appstream-rpms 64 k 2023-07-14T18:01:03.282 INFO:teuthology.orchestra.run.smithi172.stdout: xmlstarlet x86_64 1.6.1-20.el8 lab-extras 70 k 2023-07-14T18:01:03.282 INFO:teuthology.orchestra.run.smithi172.stdout: zlib-devel x86_64 1.2.11-18.el8_5 rhel-8-for-x86_64-baseos-rpms 58 k 2023-07-14T18:01:03.282 INFO:teuthology.orchestra.run.smithi172.stdout:Enabling module streams: 2023-07-14T18:01:03.282 INFO:teuthology.orchestra.run.smithi172.stdout: postgresql 10 2023-07-14T18:01:03.282 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-07-14T18:01:03.283 INFO:teuthology.orchestra.run.smithi172.stdout:Transaction Summary 2023-07-14T18:01:03.283 INFO:teuthology.orchestra.run.smithi172.stdout:=========================================================================================================================== 2023-07-14T18:01:03.283 INFO:teuthology.orchestra.run.smithi172.stdout:Install 128 Packages 2023-07-14T18:01:03.283 INFO:teuthology.orchestra.run.smithi172.stdout:Upgrade 3 Packages 2023-07-14T18:01:03.283 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-07-14T18:01:03.284 INFO:teuthology.orchestra.run.smithi172.stdout:Total download size: 206 M 2023-07-14T18:01:03.284 INFO:teuthology.orchestra.run.smithi172.stdout:Downloading Packages: 2023-07-14T18:01:03.485 INFO:teuthology.orchestra.run.smithi163.stdout:(4/131): ceph-mds-18.0.0-4940.g81c9387d.el8.x86 2.3 MB/s | 2.3 MB 00:01 2023-07-14T18:01:03.599 INFO:teuthology.orchestra.run.smithi172.stdout:(1/131): ceph-18.0.0-4940.g81c9387d.el8.x86_64. 24 kB/s | 6.4 kB 00:00 2023-07-14T18:01:03.677 INFO:teuthology.orchestra.run.smithi163.stdout:(5/131): ceph-base-18.0.0-4940.g81c9387d.el8.x8 2.5 MB/s | 5.4 MB 00:02 2023-07-14T18:01:03.902 INFO:teuthology.orchestra.run.smithi163.stdout:(6/131): ceph-mgr-18.0.0-4940.g81c9387d.el8.x86 3.7 MB/s | 1.6 MB 00:00 2023-07-14T18:01:04.360 INFO:teuthology.orchestra.run.smithi172.stdout:(2/131): ceph-fuse-18.0.0-4940.g81c9387d.el8.x8 1.1 MB/s | 850 kB 00:00 2023-07-14T18:01:04.436 INFO:teuthology.orchestra.run.smithi163.stdout:(7/131): ceph-mon-18.0.0-4940.g81c9387d.el8.x86 6.1 MB/s | 4.6 MB 00:00 2023-07-14T18:01:04.516 INFO:teuthology.orchestra.run.smithi172.stdout:(3/131): ceph-immutable-object-cache-18.0.0-494 1.0 MB/s | 167 kB 00:00 2023-07-14T18:01:05.900 INFO:teuthology.orchestra.run.smithi172.stdout:(4/131): ceph-mds-18.0.0-4940.g81c9387d.el8.x86 1.7 MB/s | 2.3 MB 00:01 2023-07-14T18:01:06.178 INFO:teuthology.orchestra.run.smithi163.stdout:(8/131): ceph-common-18.0.0-4940.g81c9387d.el8. 4.8 MB/s | 22 MB 00:04 2023-07-14T18:01:06.336 INFO:teuthology.orchestra.run.smithi163.stdout:(9/131): ceph-radosgw-18.0.0-4940.g81c9387d.el8 7.1 MB/s | 14 MB 00:01 2023-07-14T18:01:06.361 INFO:teuthology.orchestra.run.smithi163.stdout:(10/131): ceph-selinux-18.0.0-4940.g81c9387d.el 132 kB/s | 24 kB 00:00 2023-07-14T18:01:06.375 INFO:teuthology.orchestra.run.smithi172.stdout:(5/131): ceph-base-18.0.0-4940.g81c9387d.el8.x8 1.8 MB/s | 5.4 MB 00:03 2023-07-14T18:01:06.525 INFO:teuthology.orchestra.run.smithi172.stdout:(6/131): ceph-mgr-18.0.0-4940.g81c9387d.el8.x86 2.5 MB/s | 1.6 MB 00:00 2023-07-14T18:01:06.537 INFO:teuthology.orchestra.run.smithi163.stdout:(11/131): ceph-osd-18.0.0-4940.g81c9387d.el8.x8 6.7 MB/s | 18 MB 00:02 2023-07-14T18:01:06.562 INFO:teuthology.orchestra.run.smithi163.stdout:(12/131): cephfs-mirror-18.0.0-4940.g81c9387d.e 1.3 MB/s | 260 kB 00:00 2023-07-14T18:01:06.621 INFO:teuthology.orchestra.run.smithi163.stdout:(13/131): libcephfs-devel-18.0.0-4940.g81c9387d 373 kB/s | 31 kB 00:00 2023-07-14T18:01:06.705 INFO:teuthology.orchestra.run.smithi163.stdout:(14/131): libcephsqlite-18.0.0-4940.g81c9387d.e 1.6 MB/s | 135 kB 00:00 2023-07-14T18:01:06.813 INFO:teuthology.orchestra.run.smithi163.stdout:(15/131): librados-devel-18.0.0-4940.g81c9387d. 1.3 MB/s | 139 kB 00:00 2023-07-14T18:01:06.922 INFO:teuthology.orchestra.run.smithi163.stdout:(16/131): libradosstriper1-18.0.0-4940.g81c9387 4.3 MB/s | 473 kB 00:00 2023-07-14T18:01:07.122 INFO:teuthology.orchestra.run.smithi163.stdout:(17/131): libcephfs2-18.0.0-4940.g81c9387d.el8. 1.3 MB/s | 772 kB 00:00 2023-07-14T18:01:07.247 INFO:teuthology.orchestra.run.smithi163.stdout:(18/131): python3-ceph-argparse-18.0.0-4940.g81 359 kB/s | 45 kB 00:00 2023-07-14T18:01:07.348 INFO:teuthology.orchestra.run.smithi163.stdout:(19/131): python3-ceph-common-18.0.0-4940.g81c9 1.2 MB/s | 122 kB 00:00 2023-07-14T18:01:07.473 INFO:teuthology.orchestra.run.smithi163.stdout:(20/131): python3-cephfs-18.0.0-4940.g81c9387d. 1.5 MB/s | 197 kB 00:00 2023-07-14T18:01:07.665 INFO:teuthology.orchestra.run.smithi163.stdout:(21/131): python3-rados-18.0.0-4940.g81c9387d.e 1.9 MB/s | 371 kB 00:00 2023-07-14T18:01:07.790 INFO:teuthology.orchestra.run.smithi163.stdout:(22/131): librgw2-18.0.0-4940.g81c9387d.el8.x86 7.8 MB/s | 6.8 MB 00:00 2023-07-14T18:01:07.864 INFO:teuthology.orchestra.run.smithi163.stdout:(23/131): python3-rbd-18.0.0-4940.g81c9387d.el8 1.8 MB/s | 364 kB 00:00 2023-07-14T18:01:07.890 INFO:teuthology.orchestra.run.smithi163.stdout:(24/131): python3-rgw-18.0.0-4940.g81c9387d.el8 1.0 MB/s | 107 kB 00:00 2023-07-14T18:01:08.283 INFO:teuthology.orchestra.run.smithi163.stdout:(25/131): rbd-fuse-18.0.0-4940.g81c9387d.el8.x8 224 kB/s | 94 kB 00:00 2023-07-14T18:01:08.524 INFO:teuthology.orchestra.run.smithi163.stdout:(26/131): rbd-nbd-18.0.0-4940.g81c9387d.el8.x86 741 kB/s | 179 kB 00:00 2023-07-14T18:01:08.708 INFO:teuthology.orchestra.run.smithi163.stdout:(27/131): ceph-grafana-dashboards-18.0.0-4940.g 126 kB/s | 23 kB 00:00 2023-07-14T18:01:09.108 INFO:teuthology.orchestra.run.smithi163.stdout:(28/131): ceph-mgr-cephadm-18.0.0-4940.g81c9387 323 kB/s | 129 kB 00:00 2023-07-14T18:01:09.392 INFO:teuthology.orchestra.run.smithi172.stdout:(7/131): ceph-mon-18.0.0-4940.g81c9387d.el8.x86 1.5 MB/s | 4.6 MB 00:03 2023-07-14T18:01:09.508 INFO:teuthology.orchestra.run.smithi163.stdout:(29/131): rbd-mirror-18.0.0-4940.g81c9387d.el8. 2.2 MB/s | 3.5 MB 00:01 2023-07-14T18:01:09.759 INFO:teuthology.orchestra.run.smithi184.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 42 MB/s | 47 MB 00:01 2023-07-14T18:01:11.517 INFO:teuthology.orchestra.run.smithi163.stdout:(30/131): ceph-mgr-dashboard-18.0.0-4940.g81c93 729 kB/s | 1.7 MB 00:02 2023-07-14T18:01:11.900 INFO:teuthology.orchestra.run.smithi163.stdout:(31/131): ceph-mgr-modules-core-18.0.0-4940.g81 629 kB/s | 241 kB 00:00 2023-07-14T18:01:11.984 INFO:teuthology.orchestra.run.smithi163.stdout:(32/131): ceph-mgr-rook-18.0.0-4940.g81c9387d.e 568 kB/s | 47 kB 00:00 2023-07-14T18:01:12.051 INFO:teuthology.orchestra.run.smithi163.stdout:(33/131): ceph-prometheus-alerts-18.0.0-4940.g8 219 kB/s | 15 kB 00:00 2023-07-14T18:01:12.377 INFO:teuthology.orchestra.run.smithi163.stdout:(34/131): ceph-volume-18.0.0-4940.g81c9387d.el8 795 kB/s | 258 kB 00:00 2023-07-14T18:01:12.610 INFO:teuthology.orchestra.run.smithi163.stdout:(35/131): cephadm-18.0.0-4940.g81c9387d.el8.noa 709 kB/s | 165 kB 00:00 2023-07-14T18:01:12.702 INFO:teuthology.orchestra.run.smithi163.stdout:(36/131): cephfs-top-18.0.0-4940.g81c9387d.el8. 196 kB/s | 18 kB 00:00 2023-07-14T18:01:13.186 INFO:teuthology.orchestra.run.smithi163.stdout:(37/131): gperftools-libs-2.7-9.el8.x86_64.rpm 633 kB/s | 306 kB 00:00 2023-07-14T18:01:13.294 INFO:teuthology.orchestra.run.smithi163.stdout:(38/131): liboath-2.6.2-3.el8.x86_64.rpm 543 kB/s | 59 kB 00:00 2023-07-14T18:01:13.420 INFO:teuthology.orchestra.run.smithi163.stdout:(39/131): libunwind-1.3.1-3.el8.x86_64.rpm 602 kB/s | 75 kB 00:00 2023-07-14T18:01:13.628 INFO:teuthology.orchestra.run.smithi163.stdout:(40/131): python3-asyncssh-2.7.0-2.el8.noarch.r 2.2 MB/s | 476 kB 00:00 2023-07-14T18:01:13.720 INFO:teuthology.orchestra.run.smithi163.stdout:(41/131): python3-bcrypt-3.1.6-2.el8.1.x86_64.r 475 kB/s | 44 kB 00:00 2023-07-14T18:01:13.862 INFO:teuthology.orchestra.run.smithi163.stdout:(42/131): python3-beautifulsoup4-4.6.3-2.el8.1. 1.3 MB/s | 185 kB 00:00 2023-07-14T18:01:13.954 INFO:teuthology.orchestra.run.smithi163.stdout:(43/131): python3-cachetools-3.1.1-4.el8.noarch 360 kB/s | 33 kB 00:00 2023-07-14T18:01:14.030 INFO:teuthology.orchestra.run.smithi163.stdout:(44/131): python3-certifi-2018.10.15-7.el8.noar 218 kB/s | 16 kB 00:00 2023-07-14T18:01:14.105 INFO:teuthology.orchestra.run.smithi163.stdout:(45/131): python3-cheroot-8.5.2-1.el8.noarch.rp 2.3 MB/s | 173 kB 00:00 2023-07-14T18:01:14.205 INFO:teuthology.orchestra.run.smithi163.stdout:(46/131): python3-cherrypy-18.4.0-1.el8.noarch. 3.8 MB/s | 384 kB 00:00 2023-07-14T18:01:14.347 INFO:teuthology.orchestra.run.smithi163.stdout:(47/131): python3-google-auth-1.1.1-10.el8.noar 574 kB/s | 81 kB 00:00 2023-07-14T18:01:14.848 INFO:teuthology.orchestra.run.smithi163.stdout:(48/131): ceph-mgr-diskprediction-local-18.0.0- 1.4 MB/s | 7.4 MB 00:05 2023-07-14T18:01:14.931 INFO:teuthology.orchestra.run.smithi163.stdout:(49/131): python3-jaraco-6.2-6.el8.noarch.rpm 19 kB/s | 11 kB 00:00 2023-07-14T18:01:14.998 INFO:teuthology.orchestra.run.smithi163.stdout:(50/131): python3-jaraco-functools-2.0-4.el8.no 117 kB/s | 18 kB 00:00 2023-07-14T18:01:15.065 INFO:teuthology.orchestra.run.smithi163.stdout:(51/131): python3-kubernetes-11.0.0-6.el8.noarc 8.7 MB/s | 1.2 MB 00:00 2023-07-14T18:01:15.115 INFO:teuthology.orchestra.run.smithi163.stdout:(52/131): python3-logutils-0.3.5-11.el8.noarch. 417 kB/s | 49 kB 00:00 2023-07-14T18:01:15.141 INFO:teuthology.orchestra.run.smithi163.stdout:(53/131): python3-more-itertools-7.2.0-3.el8.no 780 kB/s | 59 kB 00:00 2023-07-14T18:01:15.199 INFO:teuthology.orchestra.run.smithi163.stdout:(54/131): python3-natsort-7.1.1-2.el8.noarch.rp 721 kB/s | 60 kB 00:00 2023-07-14T18:01:15.225 INFO:teuthology.orchestra.run.smithi163.stdout:(55/131): python3-pecan-1.3.2-9.el8.noarch.rpm 3.3 MB/s | 283 kB 00:00 2023-07-14T18:01:15.275 INFO:teuthology.orchestra.run.smithi163.stdout:(56/131): python3-portend-2.6-1.el8.noarch.rpm 207 kB/s | 16 kB 00:00 2023-07-14T18:01:15.300 INFO:teuthology.orchestra.run.smithi163.stdout:(57/131): python3-repoze-lru-0.7-6.el8.noarch.r 448 kB/s | 34 kB 00:00 2023-07-14T18:01:15.375 INFO:teuthology.orchestra.run.smithi163.stdout:(58/131): python3-rsa-4.8-1.el8.noarch.rpm 820 kB/s | 61 kB 00:00 2023-07-14T18:01:15.459 INFO:teuthology.orchestra.run.smithi163.stdout:(59/131): python3-simplegeneric-0.8.1-17.el8.no 225 kB/s | 19 kB 00:00 2023-07-14T18:01:15.484 INFO:teuthology.orchestra.run.smithi163.stdout:(60/131): python3-routes-2.4.1-12.el8.noarch.rp 940 kB/s | 196 kB 00:00 2023-07-14T18:01:15.693 INFO:teuthology.orchestra.run.smithi163.stdout:(61/131): python3-singledispatch-3.4.0.3-18.el8 102 kB/s | 24 kB 00:00 2023-07-14T18:01:15.718 INFO:teuthology.orchestra.run.smithi163.stdout:(62/131): python3-tempora-1.14.1-5.el8.noarch.r 125 kB/s | 29 kB 00:00 2023-07-14T18:01:15.777 INFO:teuthology.orchestra.run.smithi163.stdout:(63/131): python3-trustme-0.6.0-4.el8.noarch.rp 329 kB/s | 27 kB 00:00 2023-07-14T18:01:15.869 INFO:teuthology.orchestra.run.smithi163.stdout:(64/131): python3-webob-1.8.5-1.el8.1.noarch.rp 2.7 MB/s | 251 kB 00:00 2023-07-14T18:01:15.894 INFO:teuthology.orchestra.run.smithi163.stdout:(65/131): python3-waitress-1.4.3-1.el8.noarch.r 1.4 MB/s | 255 kB 00:00 2023-07-14T18:01:15.928 INFO:teuthology.orchestra.run.smithi163.stdout:(66/131): python3-websocket-client-0.56.0-5.el8 1.0 MB/s | 61 kB 00:00 2023-07-14T18:01:15.970 INFO:teuthology.orchestra.run.smithi163.stdout:(67/131): python3-webtest-2.0.33-1.el8.noarch.r 1.1 MB/s | 85 kB 00:00 2023-07-14T18:01:16.003 INFO:teuthology.orchestra.run.smithi163.stdout:(68/131): python3-zc-lockfile-2.0-2.el8.noarch. 305 kB/s | 23 kB 00:00 2023-07-14T18:01:16.037 INFO:teuthology.orchestra.run.smithi163.stdout:(69/131): xmlstarlet-1.6.1-20.el8.x86_64.rpm 2.0 MB/s | 70 kB 00:00 2023-07-14T18:01:16.188 INFO:teuthology.orchestra.run.smithi163.stdout:(70/131): librabbitmq-0.9.0-3.el8.x86_64.rpm 312 kB/s | 47 kB 00:00 2023-07-14T18:01:16.271 INFO:teuthology.orchestra.run.smithi163.stdout:(71/131): thrift-0.13.0-2.el8.x86_64.rpm 5.8 MB/s | 1.7 MB 00:00 2023-07-14T18:01:16.338 INFO:teuthology.orchestra.run.smithi163.stdout:(72/131): libselinux-devel-2.9-5.el8.x86_64.rpm 1.3 MB/s | 200 kB 00:00 2023-07-14T18:01:16.438 INFO:teuthology.orchestra.run.smithi163.stdout:(73/131): python3-jwt-1.6.1-2.el8.noarch.rpm 255 kB/s | 43 kB 00:00 2023-07-14T18:01:16.464 INFO:teuthology.orchestra.run.smithi163.stdout:(74/131): pcre2-utf32-10.32-2.el8.x86_64.rpm 1.7 MB/s | 220 kB 00:00 2023-07-14T18:01:16.514 INFO:teuthology.orchestra.run.smithi163.stdout:(75/131): libsepol-devel-2.9-3.el8.x86_64.rpm 1.7 MB/s | 87 kB 00:00 2023-07-14T18:01:16.556 INFO:teuthology.orchestra.run.smithi163.stdout:(76/131): keyutils-libs-devel-1.5.10-9.el8.x86_ 411 kB/s | 48 kB 00:00 2023-07-14T18:01:16.656 INFO:teuthology.orchestra.run.smithi163.stdout:(77/131): python3-requests-oauthlib-1.0.0-1.el8 301 kB/s | 43 kB 00:00 2023-07-14T18:01:16.682 INFO:teuthology.orchestra.run.smithi163.stdout:(78/131): python3-pycparser-2.14-14.el8.noarch. 871 kB/s | 109 kB 00:00 2023-07-14T18:01:16.773 INFO:teuthology.orchestra.run.smithi163.stdout:(79/131): pcre2-utf16-10.32-2.el8.x86_64.rpm 1.9 MB/s | 229 kB 00:00 2023-07-14T18:01:16.857 INFO:teuthology.orchestra.run.smithi163.stdout:(80/131): krb5-devel-1.18.2-14.el8.x86_64.rpm 3.1 MB/s | 560 kB 00:00 2023-07-14T18:01:16.882 INFO:teuthology.orchestra.run.smithi163.stdout:(81/131): libaio-devel-0.3.112-1.el8.x86_64.rpm 172 kB/s | 19 kB 00:00 2023-07-14T18:01:17.032 INFO:teuthology.orchestra.run.smithi163.stdout:(82/131): python3-cryptography-3.2.1-5.el8.x86_ 3.6 MB/s | 559 kB 00:00 2023-07-14T18:01:17.089 INFO:teuthology.orchestra.run.smithi163.stdout:(83/131): python3-oauthlib-2.1.0-1.el8.noarch.r 669 kB/s | 155 kB 00:00 2023-07-14T18:01:17.183 INFO:teuthology.orchestra.run.smithi163.stdout:(84/131): libverto-devel-0.3.0-5.el8.x86_64.rpm 119 kB/s | 18 kB 00:00 2023-07-14T18:01:17.233 INFO:teuthology.orchestra.run.smithi163.stdout:(85/131): pcre2-devel-10.32-2.el8.x86_64.rpm 4.1 MB/s | 605 kB 00:00 2023-07-14T18:01:17.309 INFO:teuthology.orchestra.run.smithi163.stdout:(86/131): python3-cffi-1.11.5-5.el8.x86_64.rpm 1.9 MB/s | 238 kB 00:00 2023-07-14T18:01:17.376 INFO:teuthology.orchestra.run.smithi163.stdout:(87/131): openssl-devel-1.1.1k-7.el8_6.x86_64.r 16 MB/s | 2.3 MB 00:00 2023-07-14T18:01:17.451 INFO:teuthology.orchestra.run.smithi163.stdout:(88/131): xfsprogs-devel-5.0.0-10.el8.x86_64.rp 509 kB/s | 72 kB 00:00 2023-07-14T18:01:17.534 INFO:teuthology.orchestra.run.smithi163.stdout:(89/131): fuse-2.9.7-15.el8.x86_64.rpm 522 kB/s | 83 kB 00:00 2023-07-14T18:01:17.601 INFO:teuthology.orchestra.run.smithi163.stdout:(90/131): elfutils-libelf-devel-0.186-1.el8.x86 398 kB/s | 60 kB 00:00 2023-07-14T18:01:17.668 INFO:teuthology.orchestra.run.smithi163.stdout:(91/131): libuuid-devel-2.32.1-35.el8.x86_64.rp 735 kB/s | 98 kB 00:00 2023-07-14T18:01:17.727 INFO:teuthology.orchestra.run.smithi163.stdout:(92/131): zlib-devel-1.2.11-18.el8_5.x86_64.rpm 460 kB/s | 58 kB 00:00 2023-07-14T18:01:17.752 INFO:teuthology.orchestra.run.smithi163.stdout:(93/131): libcom_err-devel-1.45.6-4.el8.x86_64. 462 kB/s | 39 kB 00:00 2023-07-14T18:01:17.869 INFO:teuthology.orchestra.run.smithi163.stdout:(94/131): libquadmath-8.5.0-10.1.el8_6.x86_64.r 1.4 MB/s | 171 kB 00:00 2023-07-14T18:01:17.903 INFO:teuthology.orchestra.run.smithi163.stdout:(95/131): libgfortran-8.5.0-10.1.el8_6.x86_64.r 3.6 MB/s | 644 kB 00:00 2023-07-14T18:01:17.995 INFO:teuthology.orchestra.run.smithi163.stdout:(96/131): NetworkManager-initscripts-updown-1.3 1.1 MB/s | 138 kB 00:00 2023-07-14T18:01:18.137 INFO:teuthology.orchestra.run.smithi163.stdout:(97/131): python3-pyasn1-modules-0.3.7-6.el8.no 777 kB/s | 110 kB 00:00 2023-07-14T18:01:18.237 INFO:teuthology.orchestra.run.smithi163.stdout:(98/131): python3-pytz-2017.2-9.el8.noarch.rpm 542 kB/s | 54 kB 00:00 2023-07-14T18:01:18.438 INFO:teuthology.orchestra.run.smithi163.stdout:(99/131): python3-scipy-1.0.0-21.module+el8.5.0 26 MB/s | 14 MB 00:00 2023-07-14T18:01:18.463 INFO:teuthology.orchestra.run.smithi163.stdout:(100/131): lttng-ust-2.8.1-11.el8.x86_64.rpm 1.1 MB/s | 259 kB 00:00 2023-07-14T18:01:18.538 INFO:teuthology.orchestra.run.smithi163.stdout:(101/131): socat-1.7.4.1-1.el8.x86_64.rpm 3.2 MB/s | 323 kB 00:00 2023-07-14T18:01:18.580 INFO:teuthology.orchestra.run.smithi163.stdout:(102/131): python3-markupsafe-0.23-19.el8.x86_6 332 kB/s | 39 kB 00:00 2023-07-14T18:01:18.697 INFO:teuthology.orchestra.run.smithi163.stdout:(103/131): bison-3.0.4-10.el8.x86_64.rpm 4.2 MB/s | 688 kB 00:00 2023-07-14T18:01:18.731 INFO:teuthology.orchestra.run.smithi163.stdout:(104/131): python3-jinja2-2.10.1-3.el8.noarch.r 3.5 MB/s | 538 kB 00:00 2023-07-14T18:01:18.848 INFO:teuthology.orchestra.run.smithi163.stdout:(105/131): python3-mako-1.0.6-13.el8.noarch.rpm 1.0 MB/s | 157 kB 00:00 2023-07-14T18:01:18.915 INFO:teuthology.orchestra.run.smithi163.stdout:(106/131): oniguruma-6.8.2-2.el8.x86_64.rpm 1.0 MB/s | 187 kB 00:00 2023-07-14T18:01:18.956 INFO:teuthology.orchestra.run.smithi163.stdout:(107/131): automake-1.16.1-7.el8.noarch.rpm 6.4 MB/s | 713 kB 00:00 2023-07-14T18:01:19.107 INFO:teuthology.orchestra.run.smithi163.stdout:(108/131): python3-jsonpatch-1.21-2.el8.noarch. 177 kB/s | 27 kB 00:00 2023-07-14T18:01:19.190 INFO:teuthology.orchestra.run.smithi163.stdout:(109/131): python3-babel-2.5.1-7.el8.noarch.rpm 17 MB/s | 4.8 MB 00:00 2023-07-14T18:01:19.274 INFO:teuthology.orchestra.run.smithi163.stdout:(110/131): flex-2.6.1-9.el8.x86_64.rpm 1.9 MB/s | 320 kB 00:00 2023-07-14T18:01:19.376 INFO:teuthology.orchestra.run.smithi163.stdout:(111/131): python3-prettytable-0.7.2-14.el8.noa 237 kB/s | 44 kB 00:00 2023-07-14T18:01:19.525 INFO:teuthology.orchestra.run.smithi163.stdout:(112/131): python3-numpy-1.14.3-10.el8.x86_64.r 15 MB/s | 3.7 MB 00:00 2023-07-14T18:01:19.558 INFO:teuthology.orchestra.run.smithi163.stdout:(113/131): python3-werkzeug-0.12.2-4.el8.noarch 2.5 MB/s | 457 kB 00:00 2023-07-14T18:01:19.683 INFO:teuthology.orchestra.run.smithi163.stdout:(114/131): python3-numpy-f2py-1.14.3-10.el8.x86 1.4 MB/s | 225 kB 00:00 2023-07-14T18:01:19.734 INFO:teuthology.orchestra.run.smithi163.stdout:(115/131): uuid-1.6.2-43.el8.x86_64.rpm 365 kB/s | 64 kB 00:00 2023-07-14T18:01:19.776 INFO:teuthology.orchestra.run.smithi163.stdout:(116/131): python3-pyasn1-0.3.7-6.el8.noarch.rp 1.3 MB/s | 126 kB 00:00 2023-07-14T18:01:19.826 INFO:teuthology.orchestra.run.smithi163.stdout:(117/131): python3-jsonpointer-1.10-11.el8.noar 217 kB/s | 20 kB 00:00 2023-07-14T18:01:19.901 INFO:teuthology.orchestra.run.smithi163.stdout:(118/131): python3-pyOpenSSL-19.0.0-1.el8.noarc 827 kB/s | 103 kB 00:00 2023-07-14T18:01:19.993 INFO:teuthology.orchestra.run.smithi163.stdout:(119/131): libtool-2.4.6-25.el8.x86_64.rpm 4.1 MB/s | 709 kB 00:00 2023-07-14T18:01:20.119 INFO:teuthology.orchestra.run.smithi163.stdout:(120/131): openblas-threads-0.3.15-3.el8.x86_64 22 MB/s | 4.9 MB 00:00 2023-07-14T18:01:20.169 INFO:teuthology.orchestra.run.smithi163.stdout:(121/131): libpq-13.5-1.el8.x86_64.rpm 1.1 MB/s | 198 kB 00:00 2023-07-14T18:01:20.336 INFO:teuthology.orchestra.run.smithi163.stdout:(122/131): openblas-0.3.15-3.el8.x86_64.rpm 22 MB/s | 4.7 MB 00:00 2023-07-14T18:01:20.361 INFO:teuthology.orchestra.run.smithi163.stdout:(123/131): jq-1.6-3.el8.x86_64.rpm 1.0 MB/s | 202 kB 00:00 2023-07-14T18:01:20.461 INFO:teuthology.orchestra.run.smithi163.stdout:(124/131): librdkafka-0.11.4-3.el8.x86_64.rpm 2.8 MB/s | 354 kB 00:00 2023-07-14T18:01:20.595 INFO:teuthology.orchestra.run.smithi163.stdout:(125/131): postgresql-server-10.21-2.module+el8 22 MB/s | 5.1 MB 00:00 2023-07-14T18:01:20.637 INFO:teuthology.orchestra.run.smithi163.stdout:(126/131): postgresql-contrib-10.21-2.module+el 4.5 MB/s | 808 kB 00:00 2023-07-14T18:01:20.674 INFO:teuthology.orchestra.run.smithi184.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2023-07-14T18:01:20.675 INFO:teuthology.orchestra.run.smithi184.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2023-07-14T18:01:20.689 INFO:teuthology.orchestra.run.smithi184.stdout:Package NetworkManager-1:1.36.0-4.el8.x86_64 is already installed. 2023-07-14T18:01:20.690 INFO:teuthology.orchestra.run.smithi184.stdout:Package iproute-5.15.0-4.el8.x86_64 is already installed. 2023-07-14T18:01:20.691 INFO:teuthology.orchestra.run.smithi184.stdout:Package util-linux-2.32.1-35.el8.x86_64 is already installed. 2023-07-14T18:01:20.692 INFO:teuthology.orchestra.run.smithi184.stdout:Package libacl-devel-2.2.53-1.el8.x86_64 is already installed. 2023-07-14T18:01:20.695 INFO:teuthology.orchestra.run.smithi184.stdout:Package libattr-devel-2.4.48-3.el8.x86_64 is already installed. 2023-07-14T18:01:20.698 INFO:teuthology.orchestra.run.smithi184.stdout:Package xfsdump-3.1.8-4.el8.x86_64 is already installed. 2023-07-14T18:01:20.699 INFO:teuthology.orchestra.run.smithi184.stdout:Package xfsprogs-5.0.0-10.el8.x86_64 is already installed. 2023-07-14T18:01:20.833 INFO:teuthology.orchestra.run.smithi184.stdout:Dependencies resolved. 2023-07-14T18:01:20.845 INFO:teuthology.orchestra.run.smithi184.stdout:=========================================================================================================================== 2023-07-14T18:01:20.846 INFO:teuthology.orchestra.run.smithi184.stdout: Package Arch Version Repository Size 2023-07-14T18:01:20.846 INFO:teuthology.orchestra.run.smithi184.stdout:=========================================================================================================================== 2023-07-14T18:01:20.846 INFO:teuthology.orchestra.run.smithi184.stdout:Installing: 2023-07-14T18:01:20.846 INFO:teuthology.orchestra.run.smithi184.stdout: NetworkManager-initscripts-updown noarch 1:1.36.0-9.el8_6 rhel-8-for-x86_64-baseos-rpms 138 k 2023-07-14T18:01:20.846 INFO:teuthology.orchestra.run.smithi184.stdout: bison x86_64 3.0.4-10.el8 rhel-8-for-x86_64-appstream-rpms 688 k 2023-07-14T18:01:20.846 INFO:teuthology.orchestra.run.smithi184.stdout: ceph x86_64 2:18.0.0-4940.g81c9387d.el8 ceph 6.4 k 2023-07-14T18:01:20.846 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-base x86_64 2:18.0.0-4940.g81c9387d.el8 ceph 5.4 M 2023-07-14T18:01:20.847 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-fuse x86_64 2:18.0.0-4940.g81c9387d.el8 ceph 850 k 2023-07-14T18:01:20.847 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-immutable-object-cache x86_64 2:18.0.0-4940.g81c9387d.el8 ceph 167 k 2023-07-14T18:01:20.847 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-mgr x86_64 2:18.0.0-4940.g81c9387d.el8 ceph 1.6 M 2023-07-14T18:01:20.847 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-mgr-cephadm noarch 2:18.0.0-4940.g81c9387d.el8 ceph-noarch 129 k 2023-07-14T18:01:20.847 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-mgr-dashboard noarch 2:18.0.0-4940.g81c9387d.el8 ceph-noarch 1.7 M 2023-07-14T18:01:20.847 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-mgr-diskprediction-local noarch 2:18.0.0-4940.g81c9387d.el8 ceph-noarch 7.4 M 2023-07-14T18:01:20.847 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-mgr-rook noarch 2:18.0.0-4940.g81c9387d.el8 ceph-noarch 47 k 2023-07-14T18:01:20.848 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-radosgw x86_64 2:18.0.0-4940.g81c9387d.el8 ceph 14 M 2023-07-14T18:01:20.848 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-test x86_64 2:18.0.0-4940.g81c9387d.el8 ceph 48 M 2023-07-14T18:01:20.848 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-volume noarch 2:18.0.0-4940.g81c9387d.el8 ceph-noarch 258 k 2023-07-14T18:01:20.848 INFO:teuthology.orchestra.run.smithi184.stdout: cephadm noarch 2:18.0.0-4940.g81c9387d.el8 ceph-noarch 165 k 2023-07-14T18:01:20.848 INFO:teuthology.orchestra.run.smithi184.stdout: cephfs-mirror x86_64 2:18.0.0-4940.g81c9387d.el8 ceph 260 k 2023-07-14T18:01:20.848 INFO:teuthology.orchestra.run.smithi184.stdout: cephfs-top noarch 2:18.0.0-4940.g81c9387d.el8 ceph-noarch 18 k 2023-07-14T18:01:20.848 INFO:teuthology.orchestra.run.smithi184.stdout: elfutils-libelf-devel x86_64 0.186-1.el8 rhel-8-for-x86_64-baseos-rpms 60 k 2023-07-14T18:01:20.849 INFO:teuthology.orchestra.run.smithi184.stdout: flex x86_64 2.6.1-9.el8 rhel-8-for-x86_64-appstream-rpms 320 k 2023-07-14T18:01:20.849 INFO:teuthology.orchestra.run.smithi184.stdout: libaio-devel x86_64 0.3.112-1.el8 rhel-8-for-x86_64-baseos-rpms 19 k 2023-07-14T18:01:20.849 INFO:teuthology.orchestra.run.smithi184.stdout: libcephfs-devel x86_64 2:18.0.0-4940.g81c9387d.el8 ceph 31 k 2023-07-14T18:01:20.849 INFO:teuthology.orchestra.run.smithi184.stdout: libcephfs2 x86_64 2:18.0.0-4940.g81c9387d.el8 ceph 772 k 2023-07-14T18:01:20.849 INFO:teuthology.orchestra.run.smithi184.stdout: librados-devel x86_64 2:18.0.0-4940.g81c9387d.el8 ceph 139 k 2023-07-14T18:01:20.849 INFO:teuthology.orchestra.run.smithi184.stdout: libtool x86_64 2.4.6-25.el8 rhel-8-for-x86_64-appstream-rpms 709 k 2023-07-14T18:01:20.850 INFO:teuthology.orchestra.run.smithi184.stdout: libuuid-devel x86_64 2.32.1-35.el8 rhel-8-for-x86_64-baseos-rpms 98 k 2023-07-14T18:01:20.850 INFO:teuthology.orchestra.run.smithi184.stdout: openssl-devel x86_64 1:1.1.1k-7.el8_6 rhel-8-for-x86_64-baseos-rpms 2.3 M 2023-07-14T18:01:20.850 INFO:teuthology.orchestra.run.smithi184.stdout: postgresql x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 1.5 M 2023-07-14T18:01:20.850 INFO:teuthology.orchestra.run.smithi184.stdout: postgresql-contrib x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 808 k 2023-07-14T18:01:20.850 INFO:teuthology.orchestra.run.smithi184.stdout: postgresql-server x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 5.1 M 2023-07-14T18:01:20.850 INFO:teuthology.orchestra.run.smithi184.stdout: python3-cephfs x86_64 2:18.0.0-4940.g81c9387d.el8 ceph 197 k 2023-07-14T18:01:20.850 INFO:teuthology.orchestra.run.smithi184.stdout: python3-rados x86_64 2:18.0.0-4940.g81c9387d.el8 ceph 371 k 2023-07-14T18:01:20.851 INFO:teuthology.orchestra.run.smithi184.stdout: python3-rbd x86_64 2:18.0.0-4940.g81c9387d.el8 ceph 364 k 2023-07-14T18:01:20.851 INFO:teuthology.orchestra.run.smithi184.stdout: python3-rgw x86_64 2:18.0.0-4940.g81c9387d.el8 ceph 107 k 2023-07-14T18:01:20.851 INFO:teuthology.orchestra.run.smithi184.stdout: rbd-fuse x86_64 2:18.0.0-4940.g81c9387d.el8 ceph 94 k 2023-07-14T18:01:20.851 INFO:teuthology.orchestra.run.smithi184.stdout: rbd-mirror x86_64 2:18.0.0-4940.g81c9387d.el8 ceph 3.5 M 2023-07-14T18:01:20.851 INFO:teuthology.orchestra.run.smithi184.stdout: rbd-nbd x86_64 2:18.0.0-4940.g81c9387d.el8 ceph 179 k 2023-07-14T18:01:20.851 INFO:teuthology.orchestra.run.smithi184.stdout: xfsprogs-devel x86_64 5.0.0-10.el8 rhel-8-for-x86_64-baseos-rpms 72 k 2023-07-14T18:01:20.852 INFO:teuthology.orchestra.run.smithi184.stdout:Upgrading: 2023-07-14T18:01:20.852 INFO:teuthology.orchestra.run.smithi184.stdout: iproute x86_64 5.15.0-4.el8_6.1 rhel-8-for-x86_64-baseos-rpms 798 k 2023-07-14T18:01:20.852 INFO:teuthology.orchestra.run.smithi184.stdout: librados2 x86_64 2:18.0.0-4940.g81c9387d.el8 ceph 3.7 M 2023-07-14T18:01:20.852 INFO:teuthology.orchestra.run.smithi184.stdout: librbd1 x86_64 2:18.0.0-4940.g81c9387d.el8 ceph 3.6 M 2023-07-14T18:01:20.852 INFO:teuthology.orchestra.run.smithi184.stdout:Installing dependencies: 2023-07-14T18:01:20.852 INFO:teuthology.orchestra.run.smithi184.stdout: automake noarch 1.16.1-7.el8 rhel-8-for-x86_64-appstream-rpms 713 k 2023-07-14T18:01:20.852 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-common x86_64 2:18.0.0-4940.g81c9387d.el8 ceph 22 M 2023-07-14T18:01:20.853 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-grafana-dashboards noarch 2:18.0.0-4940.g81c9387d.el8 ceph-noarch 23 k 2023-07-14T18:01:20.853 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-mds x86_64 2:18.0.0-4940.g81c9387d.el8 ceph 2.3 M 2023-07-14T18:01:20.853 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-mgr-modules-core noarch 2:18.0.0-4940.g81c9387d.el8 ceph-noarch 241 k 2023-07-14T18:01:20.853 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-mon x86_64 2:18.0.0-4940.g81c9387d.el8 ceph 4.6 M 2023-07-14T18:01:20.853 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-osd x86_64 2:18.0.0-4940.g81c9387d.el8 ceph 18 M 2023-07-14T18:01:20.853 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-prometheus-alerts noarch 2:18.0.0-4940.g81c9387d.el8 ceph-noarch 15 k 2023-07-14T18:01:20.854 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-selinux x86_64 2:18.0.0-4940.g81c9387d.el8 ceph 24 k 2023-07-14T18:01:20.854 INFO:teuthology.orchestra.run.smithi184.stdout: fuse x86_64 2.9.7-15.el8 rhel-8-for-x86_64-baseos-rpms 83 k 2023-07-14T18:01:20.854 INFO:teuthology.orchestra.run.smithi184.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2023-07-14T18:01:20.854 INFO:teuthology.orchestra.run.smithi184.stdout: jq x86_64 1.6-3.el8 rhel-8-for-x86_64-appstream-rpms 202 k 2023-07-14T18:01:20.855 INFO:teuthology.orchestra.run.smithi184.stdout: keyutils-libs-devel x86_64 1.5.10-9.el8 rhel-8-for-x86_64-baseos-rpms 48 k 2023-07-14T18:01:20.855 INFO:teuthology.orchestra.run.smithi184.stdout: krb5-devel x86_64 1.18.2-14.el8 rhel-8-for-x86_64-baseos-rpms 560 k 2023-07-14T18:01:20.855 INFO:teuthology.orchestra.run.smithi184.stdout: libcephsqlite x86_64 2:18.0.0-4940.g81c9387d.el8 ceph 135 k 2023-07-14T18:01:20.855 INFO:teuthology.orchestra.run.smithi184.stdout: libcom_err-devel x86_64 1.45.6-4.el8 rhel-8-for-x86_64-baseos-rpms 39 k 2023-07-14T18:01:20.855 INFO:teuthology.orchestra.run.smithi184.stdout: libgfortran x86_64 8.5.0-10.1.el8_6 rhel-8-for-x86_64-baseos-rpms 644 k 2023-07-14T18:01:20.856 INFO:teuthology.orchestra.run.smithi184.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2023-07-14T18:01:20.856 INFO:teuthology.orchestra.run.smithi184.stdout: libpq x86_64 13.5-1.el8 rhel-8-for-x86_64-appstream-rpms 198 k 2023-07-14T18:01:20.856 INFO:teuthology.orchestra.run.smithi184.stdout: libquadmath x86_64 8.5.0-10.1.el8_6 rhel-8-for-x86_64-baseos-rpms 171 k 2023-07-14T18:01:20.856 INFO:teuthology.orchestra.run.smithi184.stdout: librabbitmq x86_64 0.9.0-3.el8 rhel-8-for-x86_64-baseos-rpms 47 k 2023-07-14T18:01:20.857 INFO:teuthology.orchestra.run.smithi184.stdout: libradosstriper1 x86_64 2:18.0.0-4940.g81c9387d.el8 ceph 473 k 2023-07-14T18:01:20.857 INFO:teuthology.orchestra.run.smithi184.stdout: librdkafka x86_64 0.11.4-3.el8 rhel-8-for-x86_64-appstream-rpms 354 k 2023-07-14T18:01:20.857 INFO:teuthology.orchestra.run.smithi184.stdout: librgw2 x86_64 2:18.0.0-4940.g81c9387d.el8 ceph 6.8 M 2023-07-14T18:01:20.857 INFO:teuthology.orchestra.run.smithi184.stdout: libselinux-devel x86_64 2.9-5.el8 rhel-8-for-x86_64-baseos-rpms 200 k 2023-07-14T18:01:20.857 INFO:teuthology.orchestra.run.smithi184.stdout: libsepol-devel x86_64 2.9-3.el8 rhel-8-for-x86_64-baseos-rpms 87 k 2023-07-14T18:01:20.858 INFO:teuthology.orchestra.run.smithi184.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2023-07-14T18:01:20.858 INFO:teuthology.orchestra.run.smithi184.stdout: libverto-devel x86_64 0.3.0-5.el8 rhel-8-for-x86_64-baseos-rpms 18 k 2023-07-14T18:01:20.858 INFO:teuthology.orchestra.run.smithi184.stdout: lttng-ust x86_64 2.8.1-11.el8 rhel-8-for-x86_64-appstream-rpms 259 k 2023-07-14T18:01:20.858 INFO:teuthology.orchestra.run.smithi184.stdout: oniguruma x86_64 6.8.2-2.el8 rhel-8-for-x86_64-appstream-rpms 187 k 2023-07-14T18:01:20.859 INFO:teuthology.orchestra.run.smithi184.stdout: openblas x86_64 0.3.15-3.el8 rhel-8-for-x86_64-appstream-rpms 4.7 M 2023-07-14T18:01:20.859 INFO:teuthology.orchestra.run.smithi184.stdout: openblas-threads x86_64 0.3.15-3.el8 rhel-8-for-x86_64-appstream-rpms 4.9 M 2023-07-14T18:01:20.859 INFO:teuthology.orchestra.run.smithi184.stdout: pcre2-devel x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 605 k 2023-07-14T18:01:20.859 INFO:teuthology.orchestra.run.smithi184.stdout: pcre2-utf16 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 229 k 2023-07-14T18:01:20.859 INFO:teuthology.orchestra.run.smithi184.stdout: pcre2-utf32 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 220 k 2023-07-14T18:01:20.860 INFO:teuthology.orchestra.run.smithi184.stdout: python3-asyncssh noarch 2.7.0-2.el8 epel 476 k 2023-07-14T18:01:20.860 INFO:teuthology.orchestra.run.smithi184.stdout: python3-babel noarch 2.5.1-7.el8 rhel-8-for-x86_64-appstream-rpms 4.8 M 2023-07-14T18:01:20.860 INFO:teuthology.orchestra.run.smithi184.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2023-07-14T18:01:20.860 INFO:teuthology.orchestra.run.smithi184.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2023-07-14T18:01:20.861 INFO:teuthology.orchestra.run.smithi184.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2023-07-14T18:01:20.861 INFO:teuthology.orchestra.run.smithi184.stdout: python3-ceph-argparse x86_64 2:18.0.0-4940.g81c9387d.el8 ceph 45 k 2023-07-14T18:01:20.861 INFO:teuthology.orchestra.run.smithi184.stdout: python3-ceph-common x86_64 2:18.0.0-4940.g81c9387d.el8 ceph 122 k 2023-07-14T18:01:20.861 INFO:teuthology.orchestra.run.smithi184.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2023-07-14T18:01:20.861 INFO:teuthology.orchestra.run.smithi184.stdout: python3-cffi x86_64 1.11.5-5.el8 rhel-8-for-x86_64-baseos-rpms 238 k 2023-07-14T18:01:20.862 INFO:teuthology.orchestra.run.smithi184.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2023-07-14T18:01:20.862 INFO:teuthology.orchestra.run.smithi184.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2023-07-14T18:01:20.862 INFO:teuthology.orchestra.run.smithi184.stdout: python3-cryptography x86_64 3.2.1-5.el8 rhel-8-for-x86_64-baseos-rpms 559 k 2023-07-14T18:01:20.862 INFO:teuthology.orchestra.run.smithi184.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2023-07-14T18:01:20.863 INFO:teuthology.orchestra.run.smithi184.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2023-07-14T18:01:20.863 INFO:teuthology.orchestra.run.smithi184.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2023-07-14T18:01:20.863 INFO:teuthology.orchestra.run.smithi184.stdout: python3-jinja2 noarch 2.10.1-3.el8 rhel-8-for-x86_64-appstream-rpms 538 k 2023-07-14T18:01:20.863 INFO:teuthology.orchestra.run.smithi184.stdout: python3-jsonpatch noarch 1.21-2.el8 rhel-8-for-x86_64-appstream-rpms 27 k 2023-07-14T18:01:20.863 INFO:teuthology.orchestra.run.smithi184.stdout: python3-jsonpointer noarch 1.10-11.el8 rhel-8-for-x86_64-appstream-rpms 20 k 2023-07-14T18:01:20.864 INFO:teuthology.orchestra.run.smithi184.stdout: python3-jwt noarch 1.6.1-2.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-07-14T18:01:20.864 INFO:teuthology.orchestra.run.smithi184.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2023-07-14T18:01:20.864 INFO:teuthology.orchestra.run.smithi184.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2023-07-14T18:01:20.864 INFO:teuthology.orchestra.run.smithi184.stdout: python3-mako noarch 1.0.6-13.el8 rhel-8-for-x86_64-appstream-rpms 157 k 2023-07-14T18:01:20.865 INFO:teuthology.orchestra.run.smithi184.stdout: python3-markupsafe x86_64 0.23-19.el8 rhel-8-for-x86_64-appstream-rpms 39 k 2023-07-14T18:01:20.865 INFO:teuthology.orchestra.run.smithi184.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2023-07-14T18:01:20.865 INFO:teuthology.orchestra.run.smithi184.stdout: python3-natsort noarch 7.1.1-2.el8 epel 60 k 2023-07-14T18:01:20.865 INFO:teuthology.orchestra.run.smithi184.stdout: python3-numpy x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 3.7 M 2023-07-14T18:01:20.866 INFO:teuthology.orchestra.run.smithi184.stdout: python3-numpy-f2py x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 225 k 2023-07-14T18:01:20.866 INFO:teuthology.orchestra.run.smithi184.stdout: python3-oauthlib noarch 2.1.0-1.el8 rhel-8-for-x86_64-baseos-rpms 155 k 2023-07-14T18:01:20.866 INFO:teuthology.orchestra.run.smithi184.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2023-07-14T18:01:20.866 INFO:teuthology.orchestra.run.smithi184.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2023-07-14T18:01:20.867 INFO:teuthology.orchestra.run.smithi184.stdout: python3-prettytable noarch 0.7.2-14.el8 rhel-8-for-x86_64-appstream-rpms 44 k 2023-07-14T18:01:20.867 INFO:teuthology.orchestra.run.smithi184.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 rhel-8-for-x86_64-appstream-rpms 103 k 2023-07-14T18:01:20.867 INFO:teuthology.orchestra.run.smithi184.stdout: python3-pyasn1 noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 126 k 2023-07-14T18:01:20.868 INFO:teuthology.orchestra.run.smithi184.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 110 k 2023-07-14T18:01:20.868 INFO:teuthology.orchestra.run.smithi184.stdout: python3-pycparser noarch 2.14-14.el8 rhel-8-for-x86_64-baseos-rpms 109 k 2023-07-14T18:01:20.868 INFO:teuthology.orchestra.run.smithi184.stdout: python3-pytz noarch 2017.2-9.el8 rhel-8-for-x86_64-appstream-rpms 54 k 2023-07-14T18:01:20.868 INFO:teuthology.orchestra.run.smithi184.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2023-07-14T18:01:20.869 INFO:teuthology.orchestra.run.smithi184.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-07-14T18:01:20.869 INFO:teuthology.orchestra.run.smithi184.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2023-07-14T18:01:20.869 INFO:teuthology.orchestra.run.smithi184.stdout: python3-rsa noarch 4.8-1.el8 epel 61 k 2023-07-14T18:01:20.869 INFO:teuthology.orchestra.run.smithi184.stdout: python3-scipy x86_64 1.0.0-21.module+el8.5.0+10916+41bd434d rhel-8-for-x86_64-appstream-rpms 14 M 2023-07-14T18:01:20.870 INFO:teuthology.orchestra.run.smithi184.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2023-07-14T18:01:20.870 INFO:teuthology.orchestra.run.smithi184.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2023-07-14T18:01:20.870 INFO:teuthology.orchestra.run.smithi184.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2023-07-14T18:01:20.870 INFO:teuthology.orchestra.run.smithi184.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2023-07-14T18:01:20.871 INFO:teuthology.orchestra.run.smithi184.stdout: python3-waitress noarch 1.4.3-1.el8 epel 255 k 2023-07-14T18:01:20.871 INFO:teuthology.orchestra.run.smithi184.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2023-07-14T18:01:20.871 INFO:teuthology.orchestra.run.smithi184.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2023-07-14T18:01:20.871 INFO:teuthology.orchestra.run.smithi184.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2023-07-14T18:01:20.871 INFO:teuthology.orchestra.run.smithi184.stdout: python3-werkzeug noarch 0.12.2-4.el8 rhel-8-for-x86_64-appstream-rpms 457 k 2023-07-14T18:01:20.871 INFO:teuthology.orchestra.run.smithi184.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2023-07-14T18:01:20.871 INFO:teuthology.orchestra.run.smithi184.stdout: socat x86_64 1.7.4.1-1.el8 rhel-8-for-x86_64-appstream-rpms 323 k 2023-07-14T18:01:20.872 INFO:teuthology.orchestra.run.smithi184.stdout: thrift x86_64 0.13.0-2.el8 epel 1.7 M 2023-07-14T18:01:20.872 INFO:teuthology.orchestra.run.smithi184.stdout: uuid x86_64 1.6.2-43.el8 rhel-8-for-x86_64-appstream-rpms 64 k 2023-07-14T18:01:20.872 INFO:teuthology.orchestra.run.smithi184.stdout: xmlstarlet x86_64 1.6.1-20.el8 lab-extras 70 k 2023-07-14T18:01:20.872 INFO:teuthology.orchestra.run.smithi184.stdout: zlib-devel x86_64 1.2.11-18.el8_5 rhel-8-for-x86_64-baseos-rpms 58 k 2023-07-14T18:01:20.872 INFO:teuthology.orchestra.run.smithi184.stdout:Enabling module streams: 2023-07-14T18:01:20.872 INFO:teuthology.orchestra.run.smithi184.stdout: postgresql 10 2023-07-14T18:01:20.872 INFO:teuthology.orchestra.run.smithi184.stdout: 2023-07-14T18:01:20.873 INFO:teuthology.orchestra.run.smithi184.stdout:Transaction Summary 2023-07-14T18:01:20.873 INFO:teuthology.orchestra.run.smithi184.stdout:=========================================================================================================================== 2023-07-14T18:01:20.873 INFO:teuthology.orchestra.run.smithi184.stdout:Install 128 Packages 2023-07-14T18:01:20.873 INFO:teuthology.orchestra.run.smithi184.stdout:Upgrade 3 Packages 2023-07-14T18:01:20.873 INFO:teuthology.orchestra.run.smithi184.stdout: 2023-07-14T18:01:20.874 INFO:teuthology.orchestra.run.smithi163.stdout:(127/131): postgresql-10.21-2.module+el8.6.0+15 6.0 MB/s | 1.5 MB 00:00 2023-07-14T18:01:20.874 INFO:teuthology.orchestra.run.smithi184.stdout:Total download size: 206 M 2023-07-14T18:01:20.874 INFO:teuthology.orchestra.run.smithi184.stdout:Downloading Packages: 2023-07-14T18:01:21.301 INFO:teuthology.orchestra.run.smithi184.stdout:(1/131): ceph-18.0.0-4940.g81c9387d.el8.x86_64. 23 kB/s | 6.4 kB 00:00 2023-07-14T18:01:21.676 INFO:teuthology.orchestra.run.smithi184.stdout:(2/131): ceph-fuse-18.0.0-4940.g81c9387d.el8.x8 2.2 MB/s | 850 kB 00:00 2023-07-14T18:01:21.777 INFO:teuthology.orchestra.run.smithi184.stdout:(3/131): ceph-immutable-object-cache-18.0.0-494 1.6 MB/s | 167 kB 00:00 2023-07-14T18:01:22.169 INFO:teuthology.orchestra.run.smithi184.stdout:(4/131): ceph-mds-18.0.0-4940.g81c9387d.el8.x86 5.9 MB/s | 2.3 MB 00:00 2023-07-14T18:01:22.436 INFO:teuthology.orchestra.run.smithi184.stdout:(5/131): ceph-base-18.0.0-4940.g81c9387d.el8.x8 3.8 MB/s | 5.4 MB 00:01 2023-07-14T18:01:22.478 INFO:teuthology.orchestra.run.smithi184.stdout:(6/131): ceph-mgr-18.0.0-4940.g81c9387d.el8.x86 5.0 MB/s | 1.6 MB 00:00 2023-07-14T18:01:22.724 INFO:teuthology.orchestra.run.smithi172.stdout:(8/131): ceph-common-18.0.0-4940.g81c9387d.el8. 1.1 MB/s | 22 MB 00:19 2023-07-14T18:01:22.849 INFO:teuthology.orchestra.run.smithi172.stdout:(9/131): ceph-selinux-18.0.0-4940.g81c9387d.el8 195 kB/s | 24 kB 00:00 2023-07-14T18:01:23.195 INFO:teuthology.orchestra.run.smithi184.stdout:(7/131): ceph-mon-18.0.0-4940.g81c9387d.el8.x86 6.1 MB/s | 4.6 MB 00:00 2023-07-14T18:01:23.995 INFO:teuthology.orchestra.run.smithi184.stdout:(8/131): ceph-common-18.0.0-4940.g81c9387d.el8. 7.4 MB/s | 22 MB 00:02 2023-07-14T18:01:24.029 INFO:teuthology.orchestra.run.smithi163.stdout:(128/131): librados2-18.0.0-4940.g81c9387d.el8. 1.1 MB/s | 3.7 MB 00:03 2023-07-14T18:01:24.095 INFO:teuthology.orchestra.run.smithi184.stdout:(9/131): ceph-selinux-18.0.0-4940.g81c9387d.el8 243 kB/s | 24 kB 00:00 2023-07-14T18:01:24.116 INFO:teuthology.orchestra.run.smithi172.stdout:(10/131): ceph-osd-18.0.0-4940.g81c9387d.el8.x8 1.0 MB/s | 18 MB 00:17 2023-07-14T18:01:24.237 INFO:teuthology.orchestra.run.smithi163.stdout:(129/131): iproute-5.15.0-4.el8_6.1.x86_64.rpm 3.7 MB/s | 798 kB 00:00 2023-07-14T18:01:24.388 INFO:teuthology.orchestra.run.smithi163.stdout:(130/131): librbd1-18.0.0-4940.g81c9387d.el8.x8 1.0 MB/s | 3.6 MB 00:03 2023-07-14T18:01:24.483 INFO:teuthology.orchestra.run.smithi172.stdout:(11/131): cephfs-mirror-18.0.0-4940.g81c9387d.e 710 kB/s | 260 kB 00:00 2023-07-14T18:01:24.583 INFO:teuthology.orchestra.run.smithi172.stdout:(12/131): libcephfs-devel-18.0.0-4940.g81c9387d 310 kB/s | 31 kB 00:00 2023-07-14T18:01:24.721 INFO:teuthology.orchestra.run.smithi184.stdout:(10/131): ceph-osd-18.0.0-4940.g81c9387d.el8.x8 7.9 MB/s | 18 MB 00:02 2023-07-14T18:01:24.821 INFO:teuthology.orchestra.run.smithi184.stdout:(11/131): cephfs-mirror-18.0.0-4940.g81c9387d.e 2.5 MB/s | 260 kB 00:00 2023-07-14T18:01:24.904 INFO:teuthology.orchestra.run.smithi184.stdout:(12/131): libcephfs-devel-18.0.0-4940.g81c9387d 372 kB/s | 31 kB 00:00 2023-07-14T18:01:25.030 INFO:teuthology.orchestra.run.smithi184.stdout:(13/131): libcephfs2-18.0.0-4940.g81c9387d.el8. 6.0 MB/s | 772 kB 00:00 2023-07-14T18:01:25.121 INFO:teuthology.orchestra.run.smithi184.stdout:(14/131): libcephsqlite-18.0.0-4940.g81c9387d.e 1.4 MB/s | 135 kB 00:00 2023-07-14T18:01:25.209 INFO:teuthology.orchestra.run.smithi172.stdout:(13/131): libcephfs2-18.0.0-4940.g81c9387d.el8. 1.2 MB/s | 772 kB 00:00 2023-07-14T18:01:25.264 INFO:teuthology.orchestra.run.smithi184.stdout:(15/131): ceph-radosgw-18.0.0-4940.g81c9387d.el 6.5 MB/s | 14 MB 00:02 2023-07-14T18:01:25.289 INFO:teuthology.orchestra.run.smithi184.stdout:(16/131): librados-devel-18.0.0-4940.g81c9387d. 832 kB/s | 139 kB 00:00 2023-07-14T18:01:25.317 INFO:teuthology.orchestra.run.smithi172.stdout:(14/131): libcephsqlite-18.0.0-4940.g81c9387d.e 1.2 MB/s | 135 kB 00:00 2023-07-14T18:01:25.372 INFO:teuthology.orchestra.run.smithi184.stdout:(17/131): libradosstriper1-18.0.0-4940.g81c9387 4.3 MB/s | 473 kB 00:00 2023-07-14T18:01:25.464 INFO:teuthology.orchestra.run.smithi184.stdout:(18/131): python3-ceph-argparse-18.0.0-4940.g81 488 kB/s | 45 kB 00:00 2023-07-14T18:01:25.492 INFO:teuthology.orchestra.run.smithi172.stdout:(15/131): librados-devel-18.0.0-4940.g81c9387d. 795 kB/s | 139 kB 00:00 2023-07-14T18:01:25.556 INFO:teuthology.orchestra.run.smithi184.stdout:(19/131): python3-ceph-common-18.0.0-4940.g81c9 1.3 MB/s | 122 kB 00:00 2023-07-14T18:01:25.665 INFO:teuthology.orchestra.run.smithi184.stdout:(20/131): python3-cephfs-18.0.0-4940.g81c9387d. 1.8 MB/s | 197 kB 00:00 2023-07-14T18:01:25.790 INFO:teuthology.orchestra.run.smithi184.stdout:(21/131): python3-rados-18.0.0-4940.g81c9387d.e 2.9 MB/s | 371 kB 00:00 2023-07-14T18:01:25.899 INFO:teuthology.orchestra.run.smithi184.stdout:(22/131): python3-rbd-18.0.0-4940.g81c9387d.el8 3.3 MB/s | 364 kB 00:00 2023-07-14T18:01:25.984 INFO:teuthology.orchestra.run.smithi172.stdout:(16/131): libradosstriper1-18.0.0-4940.g81c9387 962 kB/s | 473 kB 00:00 2023-07-14T18:01:26.007 INFO:teuthology.orchestra.run.smithi184.stdout:(23/131): python3-rgw-18.0.0-4940.g81c9387d.el8 986 kB/s | 107 kB 00:00 2023-07-14T18:01:26.126 INFO:teuthology.orchestra.run.smithi172.stdout:(17/131): ceph-radosgw-18.0.0-4940.g81c9387d.el 829 kB/s | 14 MB 00:16 2023-07-14T18:01:26.156 INFO:teuthology.orchestra.run.smithi184.stdout:(24/131): librgw2-18.0.0-4940.g81c9387d.el8.x86 7.8 MB/s | 6.8 MB 00:00 2023-07-14T18:01:26.185 INFO:teuthology.orchestra.run.smithi172.stdout:(18/131): python3-ceph-argparse-18.0.0-4940.g81 766 kB/s | 45 kB 00:00 2023-07-14T18:01:26.191 INFO:teuthology.orchestra.run.smithi184.stdout:(25/131): rbd-fuse-18.0.0-4940.g81c9387d.el8.x8 510 kB/s | 94 kB 00:00 2023-07-14T18:01:26.300 INFO:teuthology.orchestra.run.smithi184.stdout:(26/131): rbd-nbd-18.0.0-4940.g81c9387d.el8.x86 1.6 MB/s | 179 kB 00:00 2023-07-14T18:01:26.369 INFO:teuthology.orchestra.run.smithi172.stdout:(19/131): python3-ceph-common-18.0.0-4940.g81c9 669 kB/s | 122 kB 00:00 2023-07-14T18:01:26.400 INFO:teuthology.orchestra.run.smithi184.stdout:(27/131): ceph-grafana-dashboards-18.0.0-4940.g 231 kB/s | 23 kB 00:00 2023-07-14T18:01:26.517 INFO:teuthology.orchestra.run.smithi184.stdout:(28/131): ceph-mgr-cephadm-18.0.0-4940.g81c9387 1.1 MB/s | 129 kB 00:00 2023-07-14T18:01:26.569 INFO:teuthology.orchestra.run.smithi172.stdout:(20/131): python3-cephfs-18.0.0-4940.g81c9387d. 984 kB/s | 197 kB 00:00 2023-07-14T18:01:26.617 INFO:teuthology.orchestra.run.smithi184.stdout:(29/131): rbd-mirror-18.0.0-4940.g81c9387d.el8. 7.7 MB/s | 3.5 MB 00:00 2023-07-14T18:01:26.826 INFO:teuthology.orchestra.run.smithi184.stdout:(30/131): ceph-mgr-dashboard-18.0.0-4940.g81c93 5.6 MB/s | 1.7 MB 00:00 2023-07-14T18:01:26.918 INFO:teuthology.orchestra.run.smithi184.stdout:(31/131): ceph-mgr-modules-core-18.0.0-4940.g81 2.6 MB/s | 241 kB 00:00 2023-07-14T18:01:26.994 INFO:teuthology.orchestra.run.smithi172.stdout:(21/131): python3-rados-18.0.0-4940.g81c9387d.e 874 kB/s | 371 kB 00:00 2023-07-14T18:01:27.010 INFO:teuthology.orchestra.run.smithi184.stdout:(32/131): ceph-mgr-rook-18.0.0-4940.g81c9387d.e 518 kB/s | 47 kB 00:00 2023-07-14T18:01:27.077 INFO:teuthology.orchestra.run.smithi184.stdout:(33/131): ceph-prometheus-alerts-18.0.0-4940.g8 218 kB/s | 15 kB 00:00 2023-07-14T18:01:27.185 INFO:teuthology.orchestra.run.smithi184.stdout:(34/131): ceph-volume-18.0.0-4940.g81c9387d.el8 2.3 MB/s | 258 kB 00:00 2023-07-14T18:01:27.303 INFO:teuthology.orchestra.run.smithi184.stdout:(35/131): cephadm-18.0.0-4940.g81c9387d.el8.noa 1.4 MB/s | 165 kB 00:00 2023-07-14T18:01:27.361 INFO:teuthology.orchestra.run.smithi172.stdout:(22/131): python3-rbd-18.0.0-4940.g81c9387d.el8 994 kB/s | 364 kB 00:00 2023-07-14T18:01:27.403 INFO:teuthology.orchestra.run.smithi184.stdout:(36/131): cephfs-top-18.0.0-4940.g81c9387d.el8. 180 kB/s | 18 kB 00:00 2023-07-14T18:01:27.511 INFO:teuthology.orchestra.run.smithi172.stdout:(23/131): python3-rgw-18.0.0-4940.g81c9387d.el8 710 kB/s | 107 kB 00:00 2023-07-14T18:01:27.603 INFO:teuthology.orchestra.run.smithi184.stdout:(37/131): ceph-mgr-diskprediction-local-18.0.0- 7.5 MB/s | 7.4 MB 00:00 2023-07-14T18:01:27.662 INFO:teuthology.orchestra.run.smithi172.stdout:(24/131): rbd-fuse-18.0.0-4940.g81c9387d.el8.x8 624 kB/s | 94 kB 00:00 2023-07-14T18:01:27.920 INFO:teuthology.orchestra.run.smithi184.stdout:(38/131): gperftools-libs-2.7-9.el8.x86_64.rpm 592 kB/s | 306 kB 00:00 2023-07-14T18:01:27.954 INFO:teuthology.orchestra.run.smithi184.stdout:(39/131): liboath-2.6.2-3.el8.x86_64.rpm 168 kB/s | 59 kB 00:00 2023-07-14T18:01:28.463 INFO:teuthology.orchestra.run.smithi184.stdout:(40/131): ceph-test-18.0.0-4940.g81c9387d.el8.x 11 MB/s | 48 MB 00:04 2023-07-14T18:01:28.488 INFO:teuthology.orchestra.run.smithi184.stdout:(41/131): libunwind-1.3.1-3.el8.x86_64.rpm 132 kB/s | 75 kB 00:00 2023-07-14T18:01:28.655 INFO:teuthology.orchestra.run.smithi184.stdout:(42/131): python3-asyncssh-2.7.0-2.el8.noarch.r 679 kB/s | 476 kB 00:00 2023-07-14T18:01:28.680 INFO:teuthology.orchestra.run.smithi184.stdout:(43/131): python3-beautifulsoup4-4.6.3-2.el8.1. 965 kB/s | 185 kB 00:00 2023-07-14T18:01:28.730 INFO:teuthology.orchestra.run.smithi184.stdout:(44/131): python3-cachetools-3.1.1-4.el8.noarch 439 kB/s | 33 kB 00:00 2023-07-14T18:01:28.764 INFO:teuthology.orchestra.run.smithi184.stdout:(45/131): python3-certifi-2018.10.15-7.el8.noar 195 kB/s | 16 kB 00:00 2023-07-14T18:01:28.821 INFO:teuthology.orchestra.run.smithi184.stdout:(46/131): python3-bcrypt-3.1.6-2.el8.1.x86_64.r 122 kB/s | 44 kB 00:00 2023-07-14T18:01:28.856 INFO:teuthology.orchestra.run.smithi184.stdout:(47/131): python3-cheroot-8.5.2-1.el8.noarch.rp 1.3 MB/s | 173 kB 00:00 2023-07-14T18:01:28.898 INFO:teuthology.orchestra.run.smithi184.stdout:(48/131): python3-cherrypy-18.4.0-1.el8.noarch. 2.8 MB/s | 384 kB 00:00 2023-07-14T18:01:28.940 INFO:teuthology.orchestra.run.smithi184.stdout:(49/131): python3-jaraco-6.2-6.el8.noarch.rpm 133 kB/s | 11 kB 00:00 2023-07-14T18:01:28.966 INFO:teuthology.orchestra.run.smithi184.stdout:(50/131): python3-google-auth-1.1.1-10.el8.noar 562 kB/s | 81 kB 00:00 2023-07-14T18:01:28.991 INFO:teuthology.orchestra.run.smithi184.stdout:(51/131): python3-jaraco-functools-2.0-4.el8.no 191 kB/s | 18 kB 00:00 2023-07-14T18:01:29.050 INFO:teuthology.orchestra.run.smithi184.stdout:(52/131): python3-logutils-0.3.5-11.el8.noarch. 584 kB/s | 49 kB 00:00 2023-07-14T18:01:29.075 INFO:teuthology.orchestra.run.smithi184.stdout:(53/131): python3-more-itertools-7.2.0-3.el8.no 704 kB/s | 59 kB 00:00 2023-07-14T18:01:29.167 INFO:teuthology.orchestra.run.smithi184.stdout:(54/131): python3-pecan-1.3.2-9.el8.noarch.rpm 3.0 MB/s | 283 kB 00:00 2023-07-14T18:01:29.216 INFO:teuthology.orchestra.run.smithi184.stdout:(55/131): python3-natsort-7.1.1-2.el8.noarch.rp 362 kB/s | 60 kB 00:00 2023-07-14T18:01:29.259 INFO:teuthology.orchestra.run.smithi184.stdout:(56/131): python3-portend-2.6-1.el8.noarch.rpm 169 kB/s | 16 kB 00:00 2023-07-14T18:01:29.292 INFO:teuthology.orchestra.run.smithi184.stdout:(57/131): python3-kubernetes-11.0.0-6.el8.noarc 3.3 MB/s | 1.2 MB 00:00 2023-07-14T18:01:29.318 INFO:teuthology.orchestra.run.smithi184.stdout:(58/131): python3-repoze-lru-0.7-6.el8.noarch.r 331 kB/s | 34 kB 00:00 2023-07-14T18:01:29.360 INFO:teuthology.orchestra.run.smithi184.stdout:(59/131): python3-routes-2.4.1-12.el8.noarch.rp 1.9 MB/s | 196 kB 00:00 2023-07-14T18:01:29.393 INFO:teuthology.orchestra.run.smithi184.stdout:(60/131): python3-rsa-4.8-1.el8.noarch.rpm 611 kB/s | 61 kB 00:00 2023-07-14T18:01:29.419 INFO:teuthology.orchestra.run.smithi184.stdout:(61/131): python3-simplegeneric-0.8.1-17.el8.no 186 kB/s | 19 kB 00:00 2023-07-14T18:01:29.452 INFO:teuthology.orchestra.run.smithi184.stdout:(62/131): python3-singledispatch-3.4.0.3-18.el8 259 kB/s | 24 kB 00:00 2023-07-14T18:01:29.486 INFO:teuthology.orchestra.run.smithi184.stdout:(63/131): python3-tempora-1.14.1-5.el8.noarch.r 317 kB/s | 29 kB 00:00 2023-07-14T18:01:29.511 INFO:teuthology.orchestra.run.smithi184.stdout:(64/131): python3-trustme-0.6.0-4.el8.noarch.rp 297 kB/s | 27 kB 00:00 2023-07-14T18:01:29.545 INFO:teuthology.orchestra.run.smithi184.stdout:(65/131): python3-waitress-1.4.3-1.el8.noarch.r 2.7 MB/s | 255 kB 00:00 2023-07-14T18:01:29.579 INFO:teuthology.orchestra.run.smithi184.stdout:(66/131): python3-webob-1.8.5-1.el8.1.noarch.rp 2.7 MB/s | 251 kB 00:00 2023-07-14T18:01:29.646 INFO:teuthology.orchestra.run.smithi184.stdout:(67/131): python3-webtest-2.0.33-1.el8.noarch.r 850 kB/s | 85 kB 00:00 2023-07-14T18:01:29.762 INFO:teuthology.orchestra.run.smithi172.stdout:(25/131): rbd-mirror-18.0.0-4940.g81c9387d.el8. 1.7 MB/s | 3.5 MB 00:02 2023-07-14T18:01:29.805 INFO:teuthology.orchestra.run.smithi184.stdout:(68/131): python3-zc-lockfile-2.0-2.el8.noarch. 102 kB/s | 23 kB 00:00 2023-07-14T18:01:29.830 INFO:teuthology.orchestra.run.smithi184.stdout:(69/131): python3-websocket-client-0.56.0-5.el8 192 kB/s | 61 kB 00:00 2023-07-14T18:01:29.855 INFO:teuthology.orchestra.run.smithi184.stdout:(70/131): xmlstarlet-1.6.1-20.el8.x86_64.rpm 1.4 MB/s | 70 kB 00:00 2023-07-14T18:01:29.920 INFO:teuthology.orchestra.run.smithi172.stdout:(26/131): rbd-nbd-18.0.0-4940.g81c9387d.el8.x86 1.1 MB/s | 179 kB 00:00 2023-07-14T18:01:30.029 INFO:teuthology.orchestra.run.smithi172.stdout:(27/131): ceph-grafana-dashboards-18.0.0-4940.g 213 kB/s | 23 kB 00:00 2023-07-14T18:01:30.039 INFO:teuthology.orchestra.run.smithi184.stdout:(71/131): librabbitmq-0.9.0-3.el8.x86_64.rpm 225 kB/s | 47 kB 00:00 2023-07-14T18:01:30.072 INFO:teuthology.orchestra.run.smithi184.stdout:(72/131): thrift-0.13.0-2.el8.x86_64.rpm 4.1 MB/s | 1.7 MB 00:00 2023-07-14T18:01:30.098 INFO:teuthology.orchestra.run.smithi184.stdout:(73/131): libselinux-devel-2.9-5.el8.x86_64.rpm 844 kB/s | 200 kB 00:00 2023-07-14T18:01:30.140 INFO:teuthology.orchestra.run.smithi184.stdout:(74/131): python3-jwt-1.6.1-2.el8.noarch.rpm 423 kB/s | 43 kB 00:00 2023-07-14T18:01:30.188 INFO:teuthology.orchestra.run.smithi172.stdout:(28/131): ceph-mgr-cephadm-18.0.0-4940.g81c9387 816 kB/s | 129 kB 00:00 2023-07-14T18:01:30.240 INFO:teuthology.orchestra.run.smithi184.stdout:(75/131): pcre2-utf32-10.32-2.el8.x86_64.rpm 1.3 MB/s | 220 kB 00:00 2023-07-14T18:01:30.265 INFO:teuthology.orchestra.run.smithi184.stdout:(76/131): keyutils-libs-devel-1.5.10-9.el8.x86_ 298 kB/s | 48 kB 00:00 2023-07-14T18:01:30.290 INFO:teuthology.orchestra.run.smithi184.stdout:(77/131): libsepol-devel-2.9-3.el8.x86_64.rpm 578 kB/s | 87 kB 00:00 2023-07-14T18:01:30.338 INFO:teuthology.orchestra.run.smithi172.stdout:(29/131): librgw2-18.0.0-4940.g81c9387d.el8.x86 1.6 MB/s | 6.8 MB 00:04 2023-07-14T18:01:30.432 INFO:teuthology.orchestra.run.smithi184.stdout:(78/131): python3-requests-oauthlib-1.0.0-1.el8 222 kB/s | 43 kB 00:00 2023-07-14T18:01:30.458 INFO:teuthology.orchestra.run.smithi184.stdout:(79/131): pcre2-utf16-10.32-2.el8.x86_64.rpm 1.3 MB/s | 229 kB 00:00 2023-07-14T18:01:30.500 INFO:teuthology.orchestra.run.smithi184.stdout:(80/131): python3-pycparser-2.14-14.el8.noarch. 466 kB/s | 109 kB 00:00 2023-07-14T18:01:30.541 INFO:teuthology.orchestra.run.smithi184.stdout:(81/131): krb5-devel-1.18.2-14.el8.x86_64.rpm 5.0 MB/s | 560 kB 00:00 2023-07-14T18:01:30.583 INFO:teuthology.orchestra.run.smithi184.stdout:(82/131): libaio-devel-0.3.112-1.el8.x86_64.rpm 149 kB/s | 19 kB 00:00 2023-07-14T18:01:30.642 INFO:teuthology.orchestra.run.smithi184.stdout:(83/131): python3-oauthlib-2.1.0-1.el8.noarch.r 1.1 MB/s | 155 kB 00:00 2023-07-14T18:01:30.676 INFO:teuthology.orchestra.run.smithi184.stdout:(84/131): python3-cryptography-3.2.1-5.el8.x86_ 4.1 MB/s | 559 kB 00:00 2023-07-14T18:01:30.717 INFO:teuthology.orchestra.run.smithi184.stdout:(85/131): libverto-devel-0.3.0-5.el8.x86_64.rpm 134 kB/s | 18 kB 00:00 2023-07-14T18:01:30.784 INFO:teuthology.orchestra.run.smithi184.stdout:(86/131): pcre2-devel-10.32-2.el8.x86_64.rpm 4.2 MB/s | 605 kB 00:00 2023-07-14T18:01:30.843 INFO:teuthology.orchestra.run.smithi184.stdout:(87/131): python3-cffi-1.11.5-5.el8.x86_64.rpm 1.4 MB/s | 238 kB 00:00 2023-07-14T18:01:30.885 INFO:teuthology.orchestra.run.smithi184.stdout:(88/131): xfsprogs-devel-5.0.0-10.el8.x86_64.rp 720 kB/s | 72 kB 00:00 2023-07-14T18:01:30.944 INFO:teuthology.orchestra.run.smithi184.stdout:(89/131): openssl-devel-1.1.1k-7.el8_6.x86_64.r 10 MB/s | 2.3 MB 00:00 2023-07-14T18:01:30.994 INFO:teuthology.orchestra.run.smithi184.stdout:(90/131): fuse-2.9.7-15.el8.x86_64.rpm 550 kB/s | 83 kB 00:00 2023-07-14T18:01:31.020 INFO:teuthology.orchestra.run.smithi184.stdout:(91/131): elfutils-libelf-devel-0.186-1.el8.x86 447 kB/s | 60 kB 00:00 2023-07-14T18:01:31.112 INFO:teuthology.orchestra.run.smithi184.stdout:(92/131): libuuid-devel-2.32.1-35.el8.x86_64.rp 586 kB/s | 98 kB 00:00 2023-07-14T18:01:31.145 INFO:teuthology.orchestra.run.smithi184.stdout:(93/131): libcom_err-devel-1.45.6-4.el8.x86_64. 308 kB/s | 39 kB 00:00 2023-07-14T18:01:31.170 INFO:teuthology.orchestra.run.smithi184.stdout:(94/131): zlib-devel-1.2.11-18.el8_5.x86_64.rpm 327 kB/s | 58 kB 00:00 2023-07-14T18:01:31.205 INFO:teuthology.orchestra.run.smithi172.stdout:(30/131): ceph-mgr-dashboard-18.0.0-4940.g81c93 1.7 MB/s | 1.7 MB 00:01 2023-07-14T18:01:31.246 INFO:teuthology.orchestra.run.smithi184.stdout:(95/131): libgfortran-8.5.0-10.1.el8_6.x86_64.r 4.7 MB/s | 644 kB 00:00 2023-07-14T18:01:31.279 INFO:teuthology.orchestra.run.smithi184.stdout:(96/131): NetworkManager-initscripts-updown-1.3 1.2 MB/s | 138 kB 00:00 2023-07-14T18:01:31.305 INFO:teuthology.orchestra.run.smithi184.stdout:(97/131): libquadmath-8.5.0-10.1.el8_6.x86_64.r 1.0 MB/s | 171 kB 00:00 2023-07-14T18:01:31.405 INFO:teuthology.orchestra.run.smithi172.stdout:(31/131): ceph-mgr-modules-core-18.0.0-4940.g81 1.2 MB/s | 241 kB 00:00 2023-07-14T18:01:31.422 INFO:teuthology.orchestra.run.smithi184.stdout:(98/131): python3-pyasn1-modules-0.3.7-6.el8.no 775 kB/s | 110 kB 00:00 2023-07-14T18:01:31.455 INFO:teuthology.orchestra.run.smithi184.stdout:(99/131): python3-pytz-2017.2-9.el8.noarch.rpm 360 kB/s | 54 kB 00:00 2023-07-14T18:01:31.489 INFO:teuthology.orchestra.run.smithi172.stdout:(32/131): ceph-mgr-rook-18.0.0-4940.g81c9387d.e 569 kB/s | 47 kB 00:00 2023-07-14T18:01:31.555 INFO:teuthology.orchestra.run.smithi184.stdout:(100/131): lttng-ust-2.8.1-11.el8.x86_64.rpm 1.9 MB/s | 259 kB 00:00 2023-07-14T18:01:31.581 INFO:teuthology.orchestra.run.smithi184.stdout:(101/131): socat-1.7.4.1-1.el8.x86_64.rpm 2.5 MB/s | 323 kB 00:00 2023-07-14T18:01:31.581 INFO:teuthology.orchestra.run.smithi172.stdout:(33/131): ceph-prometheus-alerts-18.0.0-4940.g8 159 kB/s | 15 kB 00:00 2023-07-14T18:01:31.731 INFO:teuthology.orchestra.run.smithi184.stdout:(102/131): python3-scipy-1.0.0-21.module+el8.5. 28 MB/s | 14 MB 00:00 2023-07-14T18:01:31.756 INFO:teuthology.orchestra.run.smithi184.stdout:(103/131): python3-markupsafe-0.23-19.el8.x86_6 193 kB/s | 39 kB 00:00 2023-07-14T18:01:31.790 INFO:teuthology.orchestra.run.smithi184.stdout:(104/131): bison-3.0.4-10.el8.x86_64.rpm 3.2 MB/s | 688 kB 00:00 2023-07-14T18:01:31.806 INFO:teuthology.orchestra.run.smithi172.stdout:(34/131): ceph-volume-18.0.0-4940.g81c9387d.el8 1.1 MB/s | 258 kB 00:00 2023-07-14T18:01:31.823 INFO:teuthology.orchestra.run.smithi184.stdout:(105/131): python3-jinja2-2.10.1-3.el8.noarch.r 5.7 MB/s | 538 kB 00:00 2023-07-14T18:01:31.890 INFO:teuthology.orchestra.run.smithi184.stdout:(106/131): oniguruma-6.8.2-2.el8.x86_64.rpm 1.8 MB/s | 187 kB 00:00 2023-07-14T18:01:31.916 INFO:teuthology.orchestra.run.smithi184.stdout:(107/131): python3-mako-1.0.6-13.el8.noarch.rpm 986 kB/s | 157 kB 00:00 2023-07-14T18:01:31.965 INFO:teuthology.orchestra.run.smithi172.stdout:(35/131): cephadm-18.0.0-4940.g81c9387d.el8.noa 1.0 MB/s | 165 kB 00:00 2023-07-14T18:01:31.974 INFO:teuthology.orchestra.run.smithi184.stdout:(108/131): automake-1.16.1-7.el8.noarch.rpm 4.6 MB/s | 713 kB 00:00 2023-07-14T18:01:32.048 INFO:teuthology.orchestra.run.smithi172.stdout:(36/131): cephfs-top-18.0.0-4940.g81c9387d.el8. 215 kB/s | 18 kB 00:00 2023-07-14T18:01:32.091 INFO:teuthology.orchestra.run.smithi184.stdout:(109/131): flex-2.6.1-9.el8.x86_64.rpm 2.7 MB/s | 320 kB 00:00 2023-07-14T18:01:32.117 INFO:teuthology.orchestra.run.smithi184.stdout:(110/131): python3-jsonpatch-1.21-2.el8.noarch. 132 kB/s | 27 kB 00:00 2023-07-14T18:01:32.158 INFO:teuthology.orchestra.run.smithi184.stdout:(111/131): python3-prettytable-0.7.2-14.el8.noa 658 kB/s | 44 kB 00:00 2023-07-14T18:01:32.234 INFO:teuthology.orchestra.run.smithi184.stdout:(112/131): python3-babel-2.5.1-7.el8.noarch.rpm 14 MB/s | 4.8 MB 00:00 2023-07-14T18:01:32.275 INFO:teuthology.orchestra.run.smithi184.stdout:(113/131): python3-werkzeug-0.12.2-4.el8.noarch 3.8 MB/s | 457 kB 00:00 2023-07-14T18:01:32.301 INFO:teuthology.orchestra.run.smithi184.stdout:(114/131): python3-numpy-f2py-1.14.3-10.el8.x86 3.3 MB/s | 225 kB 00:00 2023-07-14T18:01:32.376 INFO:teuthology.orchestra.run.smithi184.stdout:(115/131): python3-numpy-1.14.3-10.el8.x86_64.r 14 MB/s | 3.7 MB 00:00 2023-07-14T18:01:32.423 INFO:teuthology.orchestra.run.smithi184.stdout:(116/131): uuid-1.6.2-43.el8.x86_64.rpm 434 kB/s | 64 kB 00:00 2023-07-14T18:01:32.452 INFO:teuthology.orchestra.run.smithi184.stdout:(117/131): python3-pyasn1-0.3.7-6.el8.noarch.rp 840 kB/s | 126 kB 00:00 2023-07-14T18:01:32.502 INFO:teuthology.orchestra.run.smithi184.stdout:(118/131): python3-jsonpointer-1.10-11.el8.noar 159 kB/s | 20 kB 00:00 2023-07-14T18:01:32.569 INFO:teuthology.orchestra.run.smithi184.stdout:(119/131): libtool-2.4.6-25.el8.x86_64.rpm 5.9 MB/s | 709 kB 00:00 2023-07-14T18:01:32.594 INFO:teuthology.orchestra.run.smithi184.stdout:(120/131): python3-pyOpenSSL-19.0.0-1.el8.noarc 605 kB/s | 103 kB 00:00 2023-07-14T18:01:32.632 INFO:teuthology.orchestra.run.smithi172.stdout:(37/131): gperftools-libs-2.7-9.el8.x86_64.rpm 525 kB/s | 306 kB 00:00 2023-07-14T18:01:32.636 INFO:teuthology.orchestra.run.smithi184.stdout:(121/131): libpq-13.5-1.el8.x86_64.rpm 2.9 MB/s | 198 kB 00:00 2023-07-14T18:01:32.729 INFO:teuthology.orchestra.run.smithi184.stdout:(122/131): openblas-threads-0.3.15-3.el8.x86_64 21 MB/s | 4.9 MB 00:00 2023-07-14T18:01:32.782 INFO:teuthology.orchestra.run.smithi172.stdout:(38/131): liboath-2.6.2-3.el8.x86_64.rpm 392 kB/s | 59 kB 00:00 2023-07-14T18:01:32.870 INFO:teuthology.orchestra.run.smithi184.stdout:(123/131): librdkafka-0.11.4-3.el8.x86_64.rpm 2.4 MB/s | 354 kB 00:00 2023-07-14T18:01:32.937 INFO:teuthology.orchestra.run.smithi184.stdout:(124/131): openblas-0.3.15-3.el8.x86_64.rpm 14 MB/s | 4.7 MB 00:00 2023-07-14T18:01:32.941 INFO:teuthology.orchestra.run.smithi172.stdout:(39/131): libunwind-1.3.1-3.el8.x86_64.rpm 474 kB/s | 75 kB 00:00 2023-07-14T18:01:32.988 INFO:teuthology.orchestra.run.smithi184.stdout:(125/131): jq-1.6-3.el8.x86_64.rpm 576 kB/s | 202 kB 00:00 2023-07-14T18:01:33.055 INFO:teuthology.orchestra.run.smithi184.stdout:(126/131): postgresql-contrib-10.21-2.module+el 6.8 MB/s | 808 kB 00:00 2023-07-14T18:01:33.130 INFO:teuthology.orchestra.run.smithi184.stdout:(127/131): postgresql-server-10.21-2.module+el8 20 MB/s | 5.1 MB 00:00 2023-07-14T18:01:33.180 INFO:teuthology.orchestra.run.smithi184.stdout:(128/131): postgresql-10.21-2.module+el8.6.0+15 7.8 MB/s | 1.5 MB 00:00 2023-07-14T18:01:33.339 INFO:teuthology.orchestra.run.smithi184.stdout:(129/131): iproute-5.15.0-4.el8_6.1.x86_64.rpm 4.9 MB/s | 798 kB 00:00 2023-07-14T18:01:33.358 INFO:teuthology.orchestra.run.smithi172.stdout:(40/131): python3-asyncssh-2.7.0-2.el8.noarch.r 1.1 MB/s | 476 kB 00:00 2023-07-14T18:01:33.416 INFO:teuthology.orchestra.run.smithi172.stdout:(41/131): python3-bcrypt-3.1.6-2.el8.1.x86_64.r 750 kB/s | 44 kB 00:00 2023-07-14T18:01:33.608 INFO:teuthology.orchestra.run.smithi172.stdout:(42/131): python3-beautifulsoup4-4.6.3-2.el8.1. 967 kB/s | 185 kB 00:00 2023-07-14T18:01:33.692 INFO:teuthology.orchestra.run.smithi172.stdout:(43/131): python3-cachetools-3.1.1-4.el8.noarch 396 kB/s | 33 kB 00:00 2023-07-14T18:01:33.706 INFO:teuthology.orchestra.run.smithi184.stdout:(130/131): librados2-18.0.0-4940.g81c9387d.el8. 5.7 MB/s | 3.7 MB 00:00 2023-07-14T18:01:33.756 INFO:teuthology.orchestra.run.smithi184.stdout:(131/131): librbd1-18.0.0-4940.g81c9387d.el8.x8 5.8 MB/s | 3.6 MB 00:00 2023-07-14T18:01:33.758 INFO:teuthology.orchestra.run.smithi184.stdout:-------------------------------------------------------------------------------- 2023-07-14T18:01:33.758 INFO:teuthology.orchestra.run.smithi184.stdout:Total 16 MB/s | 206 MB 00:12 2023-07-14T18:01:33.767 INFO:teuthology.orchestra.run.smithi172.stdout:(44/131): python3-certifi-2018.10.15-7.el8.noar 217 kB/s | 16 kB 00:00 2023-07-14T18:01:33.885 INFO:teuthology.orchestra.run.smithi172.stdout:(45/131): ceph-mgr-diskprediction-local-18.0.0- 2.1 MB/s | 7.4 MB 00:03 2023-07-14T18:01:33.943 INFO:teuthology.orchestra.run.smithi172.stdout:(46/131): python3-cheroot-8.5.2-1.el8.noarch.rp 983 kB/s | 173 kB 00:00 2023-07-14T18:01:34.077 INFO:teuthology.orchestra.run.smithi172.stdout:(47/131): python3-google-auth-1.1.1-10.el8.noar 609 kB/s | 81 kB 00:00 2023-07-14T18:01:34.160 INFO:teuthology.orchestra.run.smithi172.stdout:(48/131): python3-jaraco-6.2-6.el8.noarch.rpm 134 kB/s | 11 kB 00:00 2023-07-14T18:01:34.227 INFO:teuthology.orchestra.run.smithi172.stdout:(49/131): python3-jaraco-functools-2.0-4.el8.no 264 kB/s | 18 kB 00:00 2023-07-14T18:01:34.261 INFO:teuthology.orchestra.run.smithi172.stdout:(50/131): python3-cherrypy-18.4.0-1.el8.noarch. 1.0 MB/s | 384 kB 00:00 2023-07-14T18:01:34.328 INFO:teuthology.orchestra.run.smithi172.stdout:(51/131): python3-logutils-0.3.5-11.el8.noarch. 730 kB/s | 49 kB 00:00 2023-07-14T18:01:34.396 INFO:teuthology.orchestra.run.smithi172.stdout:(52/131): python3-more-itertools-7.2.0-3.el8.no 880 kB/s | 59 kB 00:00 2023-07-14T18:01:34.498 INFO:teuthology.orchestra.run.smithi172.stdout:(53/131): python3-natsort-7.1.1-2.el8.noarch.rp 586 kB/s | 60 kB 00:00 2023-07-14T18:01:34.588 INFO:teuthology.orchestra.run.smithi184.stdout:Running transaction check 2023-07-14T18:01:34.687 INFO:teuthology.orchestra.run.smithi172.stdout:(54/131): python3-pecan-1.3.2-9.el8.noarch.rpm 1.5 MB/s | 283 kB 00:00 2023-07-14T18:01:34.708 INFO:teuthology.orchestra.run.smithi184.stdout:Transaction check succeeded. 2023-07-14T18:01:34.708 INFO:teuthology.orchestra.run.smithi184.stdout:Running transaction test 2023-07-14T18:01:34.771 INFO:teuthology.orchestra.run.smithi172.stdout:(55/131): python3-portend-2.6-1.el8.noarch.rpm 187 kB/s | 16 kB 00:00 2023-07-14T18:01:34.871 INFO:teuthology.orchestra.run.smithi172.stdout:(56/131): python3-repoze-lru-0.7-6.el8.noarch.r 336 kB/s | 34 kB 00:00 2023-07-14T18:01:35.055 INFO:teuthology.orchestra.run.smithi172.stdout:(57/131): python3-routes-2.4.1-12.el8.noarch.rp 1.0 MB/s | 196 kB 00:00 2023-07-14T18:01:35.213 INFO:teuthology.orchestra.run.smithi172.stdout:(58/131): python3-rsa-4.8-1.el8.noarch.rpm 389 kB/s | 61 kB 00:00 2023-07-14T18:01:35.289 INFO:teuthology.orchestra.run.smithi172.stdout:(59/131): python3-simplegeneric-0.8.1-17.el8.no 250 kB/s | 19 kB 00:00 2023-07-14T18:01:35.381 INFO:teuthology.orchestra.run.smithi172.stdout:(60/131): python3-singledispatch-3.4.0.3-18.el8 261 kB/s | 24 kB 00:00 2023-07-14T18:01:35.473 INFO:teuthology.orchestra.run.smithi172.stdout:(61/131): python3-tempora-1.14.1-5.el8.noarch.r 319 kB/s | 29 kB 00:00 2023-07-14T18:01:35.556 INFO:teuthology.orchestra.run.smithi172.stdout:(62/131): python3-trustme-0.6.0-4.el8.noarch.rp 330 kB/s | 27 kB 00:00 2023-07-14T18:01:35.590 INFO:teuthology.orchestra.run.smithi172.stdout:(63/131): python3-kubernetes-11.0.0-6.el8.noarc 876 kB/s | 1.2 MB 00:01 2023-07-14T18:01:35.773 INFO:teuthology.orchestra.run.smithi172.stdout:(64/131): python3-waitress-1.4.3-1.el8.noarch.r 1.2 MB/s | 255 kB 00:00 2023-07-14T18:01:35.819 INFO:teuthology.orchestra.run.smithi184.stdout:Transaction test succeeded. 2023-07-14T18:01:35.824 INFO:teuthology.orchestra.run.smithi184.stdout:Running transaction 2023-07-14T18:01:35.882 INFO:teuthology.orchestra.run.smithi172.stdout:(65/131): python3-websocket-client-0.56.0-5.el8 566 kB/s | 61 kB 00:00 2023-07-14T18:01:35.974 INFO:teuthology.orchestra.run.smithi172.stdout:(66/131): python3-webtest-2.0.33-1.el8.noarch.r 930 kB/s | 85 kB 00:00 2023-07-14T18:01:35.999 INFO:teuthology.orchestra.run.smithi172.stdout:(67/131): python3-webob-1.8.5-1.el8.1.noarch.rp 614 kB/s | 251 kB 00:00 2023-07-14T18:01:36.108 INFO:teuthology.orchestra.run.smithi172.stdout:(68/131): python3-zc-lockfile-2.0-2.el8.noarch. 172 kB/s | 23 kB 00:00 2023-07-14T18:01:36.134 INFO:teuthology.orchestra.run.smithi172.stdout:(69/131): xmlstarlet-1.6.1-20.el8.x86_64.rpm 2.7 MB/s | 70 kB 00:00 2023-07-14T18:01:36.584 INFO:teuthology.orchestra.run.smithi172.stdout:(70/131): python3-scipy-1.0.0-21.module+el8.5.0 30 MB/s | 14 MB 00:00 2023-07-14T18:01:36.751 INFO:teuthology.orchestra.run.smithi172.stdout:(71/131): thrift-0.13.0-2.el8.x86_64.rpm 2.3 MB/s | 1.7 MB 00:00 2023-07-14T18:01:36.784 INFO:teuthology.orchestra.run.smithi172.stdout:(72/131): python3-pyasn1-modules-0.3.7-6.el8.no 549 kB/s | 110 kB 00:00 2023-07-14T18:01:36.885 INFO:teuthology.orchestra.run.smithi172.stdout:(73/131): python3-pytz-2017.2-9.el8.noarch.rpm 405 kB/s | 54 kB 00:00 2023-07-14T18:01:36.935 INFO:teuthology.orchestra.run.smithi172.stdout:(74/131): lttng-ust-2.8.1-11.el8.x86_64.rpm 1.7 MB/s | 259 kB 00:00 2023-07-14T18:01:36.977 INFO:teuthology.orchestra.run.smithi172.stdout:(75/131): socat-1.7.4.1-1.el8.x86_64.rpm 3.4 MB/s | 323 kB 00:00 2023-07-14T18:01:37.019 INFO:teuthology.orchestra.run.smithi172.stdout:(76/131): python3-markupsafe-0.23-19.el8.x86_64 465 kB/s | 39 kB 00:00 2023-07-14T18:01:37.103 INFO:teuthology.orchestra.run.smithi172.stdout:(77/131): bison-3.0.4-10.el8.x86_64.rpm 5.4 MB/s | 688 kB 00:00 2023-07-14T18:01:37.169 INFO:teuthology.orchestra.run.smithi172.stdout:(78/131): python3-jinja2-2.10.1-3.el8.noarch.rp 3.5 MB/s | 538 kB 00:00 2023-07-14T18:01:37.246 INFO:teuthology.orchestra.run.smithi172.stdout:(79/131): python3-mako-1.0.6-13.el8.noarch.rpm 1.1 MB/s | 157 kB 00:00 2023-07-14T18:01:37.304 INFO:teuthology.orchestra.run.smithi172.stdout:(80/131): oniguruma-6.8.2-2.el8.x86_64.rpm 1.4 MB/s | 187 kB 00:00 2023-07-14T18:01:37.379 INFO:teuthology.orchestra.run.smithi172.stdout:(81/131): automake-1.16.1-7.el8.noarch.rpm 5.3 MB/s | 713 kB 00:00 2023-07-14T18:01:37.524 INFO:teuthology.orchestra.run.smithi163.stdout:(131/131): ceph-test-18.0.0-4940.g81c9387d.el8. 1.5 MB/s | 48 MB 00:31 2023-07-14T18:01:37.525 INFO:teuthology.orchestra.run.smithi163.stdout:-------------------------------------------------------------------------------- 2023-07-14T18:01:37.526 INFO:teuthology.orchestra.run.smithi163.stdout:Total 5.7 MB/s | 206 MB 00:36 2023-07-14T18:01:37.529 INFO:teuthology.orchestra.run.smithi172.stdout:(82/131): python3-jsonpatch-1.21-2.el8.noarch.r 177 kB/s | 27 kB 00:00 2023-07-14T18:01:37.679 INFO:teuthology.orchestra.run.smithi172.stdout:(83/131): python3-babel-2.5.1-7.el8.noarch.rpm 13 MB/s | 4.8 MB 00:00 2023-07-14T18:01:37.705 INFO:teuthology.orchestra.run.smithi172.stdout:(84/131): flex-2.6.1-9.el8.x86_64.rpm 1.8 MB/s | 320 kB 00:00 2023-07-14T18:01:37.830 INFO:teuthology.orchestra.run.smithi172.stdout:(85/131): python3-prettytable-0.7.2-14.el8.noar 293 kB/s | 44 kB 00:00 2023-07-14T18:01:37.930 INFO:teuthology.orchestra.run.smithi172.stdout:(86/131): python3-numpy-1.14.3-10.el8.x86_64.rp 17 MB/s | 3.7 MB 00:00 2023-07-14T18:01:37.964 INFO:teuthology.orchestra.run.smithi172.stdout:(87/131): python3-werkzeug-0.12.2-4.el8.noarch. 3.3 MB/s | 457 kB 00:00 2023-07-14T18:01:38.047 INFO:teuthology.orchestra.run.smithi172.stdout:(88/131): python3-numpy-f2py-1.14.3-10.el8.x86_ 1.9 MB/s | 225 kB 00:00 2023-07-14T18:01:38.114 INFO:teuthology.orchestra.run.smithi172.stdout:(89/131): uuid-1.6.2-43.el8.x86_64.rpm 426 kB/s | 64 kB 00:00 2023-07-14T18:01:38.215 INFO:teuthology.orchestra.run.smithi172.stdout:(90/131): python3-pyasn1-0.3.7-6.el8.noarch.rpm 757 kB/s | 126 kB 00:00 2023-07-14T18:01:38.257 INFO:teuthology.orchestra.run.smithi172.stdout:(91/131): python3-jsonpointer-1.10-11.el8.noarc 141 kB/s | 20 kB 00:00 2023-07-14T18:01:38.342 INFO:teuthology.orchestra.run.smithi163.stdout:Running transaction check 2023-07-14T18:01:38.374 INFO:teuthology.orchestra.run.smithi172.stdout:(92/131): python3-pyOpenSSL-19.0.0-1.el8.noarch 652 kB/s | 103 kB 00:00 2023-07-14T18:01:38.416 INFO:teuthology.orchestra.run.smithi172.stdout:(93/131): libtool-2.4.6-25.el8.x86_64.rpm 4.4 MB/s | 709 kB 00:00 2023-07-14T18:01:38.462 INFO:teuthology.orchestra.run.smithi163.stdout:Transaction check succeeded. 2023-07-14T18:01:38.463 INFO:teuthology.orchestra.run.smithi163.stdout:Running transaction test 2023-07-14T18:01:38.558 INFO:teuthology.orchestra.run.smithi172.stdout:(94/131): libpq-13.5-1.el8.x86_64.rpm 1.4 MB/s | 198 kB 00:00 2023-07-14T18:01:38.691 INFO:teuthology.orchestra.run.smithi172.stdout:(95/131): openblas-threads-0.3.15-3.el8.x86_64. 15 MB/s | 4.9 MB 00:00 2023-07-14T18:01:38.800 INFO:teuthology.orchestra.run.smithi172.stdout:(96/131): openblas-0.3.15-3.el8.x86_64.rpm 20 MB/s | 4.7 MB 00:00 2023-07-14T18:01:38.825 INFO:teuthology.orchestra.run.smithi172.stdout:(97/131): jq-1.6-3.el8.x86_64.rpm 1.5 MB/s | 202 kB 00:00 2023-07-14T18:01:38.950 INFO:teuthology.orchestra.run.smithi172.stdout:(98/131): librdkafka-0.11.4-3.el8.x86_64.rpm 2.3 MB/s | 354 kB 00:00 2023-07-14T18:01:39.059 INFO:teuthology.orchestra.run.smithi172.stdout:(99/131): postgresql-server-10.21-2.module+el8. 22 MB/s | 5.1 MB 00:00 2023-07-14T18:01:39.126 INFO:teuthology.orchestra.run.smithi172.stdout:(100/131): postgresql-contrib-10.21-2.module+el 4.5 MB/s | 808 kB 00:00 2023-07-14T18:01:39.210 INFO:teuthology.orchestra.run.smithi172.stdout:(101/131): postgresql-10.21-2.module+el8.6.0+15 10 MB/s | 1.5 MB 00:00 2023-07-14T18:01:39.235 INFO:teuthology.orchestra.run.smithi172.stdout:(102/131): librabbitmq-0.9.0-3.el8.x86_64.rpm 431 kB/s | 47 kB 00:00 2023-07-14T18:01:39.336 INFO:teuthology.orchestra.run.smithi172.stdout:(103/131): libselinux-devel-2.9-5.el8.x86_64.rp 1.6 MB/s | 200 kB 00:00 2023-07-14T18:01:39.377 INFO:teuthology.orchestra.run.smithi172.stdout:(104/131): python3-jwt-1.6.1-2.el8.noarch.rpm 300 kB/s | 43 kB 00:00 2023-07-14T18:01:39.445 INFO:teuthology.orchestra.run.smithi172.stdout:(105/131): pcre2-utf32-10.32-2.el8.x86_64.rpm 2.0 MB/s | 220 kB 00:00 2023-07-14T18:01:39.511 INFO:teuthology.orchestra.run.smithi172.stdout:(106/131): keyutils-libs-devel-1.5.10-9.el8.x86 360 kB/s | 48 kB 00:00 2023-07-14T18:01:39.561 INFO:teuthology.orchestra.run.smithi172.stdout:(107/131): libsepol-devel-2.9-3.el8.x86_64.rpm 745 kB/s | 87 kB 00:00 2023-07-14T18:01:39.587 INFO:teuthology.orchestra.run.smithi163.stdout:Transaction test succeeded. 2023-07-14T18:01:39.591 INFO:teuthology.orchestra.run.smithi163.stdout:Running transaction 2023-07-14T18:01:39.620 INFO:teuthology.orchestra.run.smithi172.stdout:(108/131): python3-requests-oauthlib-1.0.0-1.el 393 kB/s | 43 kB 00:00 2023-07-14T18:01:39.696 INFO:teuthology.orchestra.run.smithi172.stdout:(109/131): python3-pycparser-2.14-14.el8.noarch 816 kB/s | 109 kB 00:00 2023-07-14T18:01:39.762 INFO:teuthology.orchestra.run.smithi172.stdout:(110/131): pcre2-utf16-10.32-2.el8.x86_64.rpm 1.6 MB/s | 229 kB 00:00 2023-07-14T18:01:39.871 INFO:teuthology.orchestra.run.smithi172.stdout:(111/131): krb5-devel-1.18.2-14.el8.x86_64.rpm 3.1 MB/s | 560 kB 00:00 2023-07-14T18:01:39.913 INFO:teuthology.orchestra.run.smithi172.stdout:(112/131): libaio-devel-0.3.112-1.el8.x86_64.rp 124 kB/s | 19 kB 00:00 2023-07-14T18:01:40.005 INFO:teuthology.orchestra.run.smithi172.stdout:(113/131): python3-oauthlib-2.1.0-1.el8.noarch. 1.1 MB/s | 155 kB 00:00 2023-07-14T18:01:40.047 INFO:teuthology.orchestra.run.smithi172.stdout:(114/131): python3-cryptography-3.2.1-5.el8.x86 4.1 MB/s | 559 kB 00:00 2023-07-14T18:01:40.097 INFO:teuthology.orchestra.run.smithi172.stdout:(115/131): libverto-devel-0.3.0-5.el8.x86_64.rp 195 kB/s | 18 kB 00:00 2023-07-14T18:01:40.181 INFO:teuthology.orchestra.run.smithi172.stdout:(116/131): pcre2-devel-10.32-2.el8.x86_64.rpm 4.4 MB/s | 605 kB 00:00 2023-07-14T18:01:40.231 INFO:teuthology.orchestra.run.smithi172.stdout:(117/131): python3-cffi-1.11.5-5.el8.x86_64.rpm 1.7 MB/s | 238 kB 00:00 2023-07-14T18:01:40.298 INFO:teuthology.orchestra.run.smithi172.stdout:(118/131): xfsprogs-devel-5.0.0-10.el8.x86_64.r 1.1 MB/s | 72 kB 00:00 2023-07-14T18:01:40.373 INFO:teuthology.orchestra.run.smithi172.stdout:(119/131): openssl-devel-1.1.1k-7.el8_6.x86_64. 12 MB/s | 2.3 MB 00:00 2023-07-14T18:01:40.449 INFO:teuthology.orchestra.run.smithi172.stdout:(120/131): fuse-2.9.7-15.el8.x86_64.rpm 551 kB/s | 83 kB 00:00 2023-07-14T18:01:40.491 INFO:teuthology.orchestra.run.smithi172.stdout:(121/131): elfutils-libelf-devel-0.186-1.el8.x8 512 kB/s | 60 kB 00:00 2023-07-14T18:01:40.549 INFO:teuthology.orchestra.run.smithi172.stdout:(122/131): libuuid-devel-2.32.1-35.el8.x86_64.r 980 kB/s | 98 kB 00:00 2023-07-14T18:01:40.575 INFO:teuthology.orchestra.run.smithi172.stdout:(123/131): zlib-devel-1.2.11-18.el8_5.x86_64.rp 690 kB/s | 58 kB 00:00 2023-07-14T18:01:40.675 INFO:teuthology.orchestra.run.smithi172.stdout:(124/131): libcom_err-devel-1.45.6-4.el8.x86_64 308 kB/s | 39 kB 00:00 2023-07-14T18:01:40.717 INFO:teuthology.orchestra.run.smithi172.stdout:(125/131): libgfortran-8.5.0-10.1.el8_6.x86_64. 4.4 MB/s | 644 kB 00:00 2023-07-14T18:01:40.776 INFO:teuthology.orchestra.run.smithi184.stdout: Preparing : 1/1 2023-07-14T18:01:40.809 INFO:teuthology.orchestra.run.smithi172.stdout:(126/131): libquadmath-8.5.0-10.1.el8_6.x86_64. 1.3 MB/s | 171 kB 00:00 2023-07-14T18:01:40.834 INFO:teuthology.orchestra.run.smithi172.stdout:(127/131): NetworkManager-initscripts-updown-1. 1.1 MB/s | 138 kB 00:00 2023-07-14T18:01:40.984 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : thrift-0.13.0-2.el8.x86_64 1/134 2023-07-14T18:01:41.184 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : liboath-2.6.2-3.el8.x86_64 2/134 2023-07-14T18:01:41.387 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : librdkafka-0.11.4-3.el8.x86_64 3/134 2023-07-14T18:01:41.500 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: librdkafka-0.11.4-3.el8.x86_64 3/134 2023-07-14T18:01:41.720 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 4/134 2023-07-14T18:01:42.117 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 4/134 2023-07-14T18:01:42.303 INFO:teuthology.orchestra.run.smithi184.stdout: Upgrading : librados2-2:18.0.0-4940.g81c9387d.el8.x86_64 5/134 2023-07-14T18:01:42.693 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: librados2-2:18.0.0-4940.g81c9387d.el8.x86_64 5/134 2023-07-14T18:01:42.701 INFO:teuthology.orchestra.run.smithi172.stdout:(128/131): librados2-18.0.0-4940.g81c9387d.el8. 1.9 MB/s | 3.7 MB 00:01 2023-07-14T18:01:42.851 INFO:teuthology.orchestra.run.smithi172.stdout:(129/131): iproute-5.15.0-4.el8_6.1.x86_64.rpm 5.2 MB/s | 798 kB 00:00 2023-07-14T18:01:42.870 INFO:teuthology.orchestra.run.smithi184.stdout: Upgrading : librbd1-2:18.0.0-4940.g81c9387d.el8.x86_64 6/134 2023-07-14T18:01:43.005 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: librbd1-2:18.0.0-4940.g81c9387d.el8.x86_64 6/134 2023-07-14T18:01:43.186 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : libcephfs2-2:18.0.0-4940.g81c9387d.el8.x86_64 7/134 2023-07-14T18:01:43.201 INFO:teuthology.orchestra.run.smithi172.stdout:(130/131): librbd1-18.0.0-4940.g81c9387d.el8.x8 1.5 MB/s | 3.6 MB 00:02 2023-07-14T18:01:43.278 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: libcephfs2-2:18.0.0-4940.g81c9387d.el8.x86_64 7/134 2023-07-14T18:01:43.474 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-rados-2:18.0.0-4940.g81c9387d.el8.x86_64 8/134 2023-07-14T18:01:43.670 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : librabbitmq-0.9.0-3.el8.x86_64 9/134 2023-07-14T18:01:43.914 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : libpq-13.5-1.el8.x86_64 10/134 2023-07-14T18:01:44.147 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 11/134 2023-07-14T18:01:44.433 INFO:teuthology.orchestra.run.smithi163.stdout: Preparing : 1/1 2023-07-14T18:01:44.534 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 12/134 2023-07-14T18:01:44.627 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : thrift-0.13.0-2.el8.x86_64 1/134 2023-07-14T18:01:44.774 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : postgresql-10.21-2.module+el8.6.0+15342+53518fac 13/134 2023-07-14T18:01:44.852 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : liboath-2.6.2-3.el8.x86_64 2/134 2023-07-14T18:01:44.936 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : libcephsqlite-2:18.0.0-4940.g81c9387d.el8.x86_64 14/134 2023-07-14T18:01:45.012 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : librdkafka-0.11.4-3.el8.x86_64 3/134 2023-07-14T18:01:45.030 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: libcephsqlite-2:18.0.0-4940.g81c9387d.el8.x86_64 14/134 2023-07-14T18:01:45.130 INFO:teuthology.orchestra.run.smithi163.stdout: Running scriptlet: librdkafka-0.11.4-3.el8.x86_64 3/134 2023-07-14T18:01:45.186 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : libradosstriper1-2:18.0.0-4940.g81c9387d.el8.x86 15/134 2023-07-14T18:01:45.318 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: libradosstriper1-2:18.0.0-4940.g81c9387d.el8.x86 15/134 2023-07-14T18:01:45.329 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 4/134 2023-07-14T18:01:45.711 INFO:teuthology.orchestra.run.smithi163.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 4/134 2023-07-14T18:01:45.763 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 16/134 2023-07-14T18:01:45.904 INFO:teuthology.orchestra.run.smithi163.stdout: Upgrading : librados2-2:18.0.0-4940.g81c9387d.el8.x86_64 5/134 2023-07-14T18:01:46.094 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 17/134 2023-07-14T18:01:46.304 INFO:teuthology.orchestra.run.smithi163.stdout: Running scriptlet: librados2-2:18.0.0-4940.g81c9387d.el8.x86_64 5/134 2023-07-14T18:01:46.308 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-pytz-2017.2-9.el8.noarch 18/134 2023-07-14T18:01:46.444 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : libquadmath-8.5.0-10.1.el8_6.x86_64 19/134 2023-07-14T18:01:46.479 INFO:teuthology.orchestra.run.smithi163.stdout: Upgrading : librbd1-2:18.0.0-4940.g81c9387d.el8.x86_64 6/134 2023-07-14T18:01:46.577 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: libquadmath-8.5.0-10.1.el8_6.x86_64 19/134 2023-07-14T18:01:46.590 INFO:teuthology.orchestra.run.smithi163.stdout: Running scriptlet: librbd1-2:18.0.0-4940.g81c9387d.el8.x86_64 6/134 2023-07-14T18:01:46.728 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : libgfortran-8.5.0-10.1.el8_6.x86_64 20/134 2023-07-14T18:01:46.762 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : libcephfs2-2:18.0.0-4940.g81c9387d.el8.x86_64 7/134 2023-07-14T18:01:46.854 INFO:teuthology.orchestra.run.smithi163.stdout: Running scriptlet: libcephfs2-2:18.0.0-4940.g81c9387d.el8.x86_64 7/134 2023-07-14T18:01:47.000 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-rados-2:18.0.0-4940.g81c9387d.el8.x86_64 8/134 2023-07-14T18:01:47.196 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : librabbitmq-0.9.0-3.el8.x86_64 9/134 2023-07-14T18:01:47.343 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: libgfortran-8.5.0-10.1.el8_6.x86_64 20/134 2023-07-14T18:01:47.416 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : libpq-13.5-1.el8.x86_64 10/134 2023-07-14T18:01:47.536 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : openblas-threads-0.3.15-3.el8.x86_64 21/134 2023-07-14T18:01:47.606 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 11/134 2023-07-14T18:01:47.993 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 12/134 2023-07-14T18:01:48.133 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: openblas-threads-0.3.15-3.el8.x86_64 21/134 2023-07-14T18:01:48.225 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : postgresql-10.21-2.module+el8.6.0+15342+53518fac 13/134 2023-07-14T18:01:48.352 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : openblas-0.3.15-3.el8.x86_64 22/134 2023-07-14T18:01:48.362 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : libcephsqlite-2:18.0.0-4940.g81c9387d.el8.x86_64 14/134 2023-07-14T18:01:48.474 INFO:teuthology.orchestra.run.smithi163.stdout: Running scriptlet: libcephsqlite-2:18.0.0-4940.g81c9387d.el8.x86_64 14/134 2023-07-14T18:01:48.654 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : libradosstriper1-2:18.0.0-4940.g81c9387d.el8.x86 15/134 2023-07-14T18:01:48.803 INFO:teuthology.orchestra.run.smithi163.stdout: Running scriptlet: libradosstriper1-2:18.0.0-4940.g81c9387d.el8.x86 15/134 2023-07-14T18:01:49.015 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 16/134 2023-07-14T18:01:49.051 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: openblas-0.3.15-3.el8.x86_64 22/134 2023-07-14T18:01:49.179 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 17/134 2023-07-14T18:01:49.275 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-numpy-1:1.14.3-10.el8.x86_64 23/134 2023-07-14T18:01:49.381 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-pytz-2017.2-9.el8.noarch 18/134 2023-07-14T18:01:49.483 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : zlib-devel-1.2.11-18.el8_5.x86_64 24/134 2023-07-14T18:01:49.528 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : libquadmath-8.5.0-10.1.el8_6.x86_64 19/134 2023-07-14T18:01:49.670 INFO:teuthology.orchestra.run.smithi163.stdout: Running scriptlet: libquadmath-8.5.0-10.1.el8_6.x86_64 19/134 2023-07-14T18:01:49.720 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 25/134 2023-07-14T18:01:49.837 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : libgfortran-8.5.0-10.1.el8_6.x86_64 20/134 2023-07-14T18:01:49.917 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-ceph-common-2:18.0.0-4940.g81c9387d.el8. 26/134 2023-07-14T18:01:50.046 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-ceph-argparse-2:18.0.0-4940.g81c9387d.el 27/134 2023-07-14T18:01:50.257 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-cephfs-2:18.0.0-4940.g81c9387d.el8.x86_6 28/134 2023-07-14T18:01:50.435 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 29/134 2023-07-14T18:01:50.443 INFO:teuthology.orchestra.run.smithi163.stdout: Running scriptlet: libgfortran-8.5.0-10.1.el8_6.x86_64 20/134 2023-07-14T18:01:50.620 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : openblas-threads-0.3.15-3.el8.x86_64 21/134 2023-07-14T18:01:51.201 INFO:teuthology.orchestra.run.smithi163.stdout: Running scriptlet: openblas-threads-0.3.15-3.el8.x86_64 21/134 2023-07-14T18:01:51.395 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : openblas-0.3.15-3.el8.x86_64 22/134 2023-07-14T18:01:52.099 INFO:teuthology.orchestra.run.smithi163.stdout: Running scriptlet: openblas-0.3.15-3.el8.x86_64 22/134 2023-07-14T18:01:52.200 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 29/134 2023-07-14T18:01:52.335 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-numpy-1:1.14.3-10.el8.x86_64 23/134 2023-07-14T18:01:52.551 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : zlib-devel-1.2.11-18.el8_5.x86_64 24/134 2023-07-14T18:01:52.780 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 25/134 2023-07-14T18:01:52.943 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-ceph-common-2:18.0.0-4940.g81c9387d.el8. 26/134 2023-07-14T18:01:53.064 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-ceph-argparse-2:18.0.0-4940.g81c9387d.el 27/134 2023-07-14T18:01:53.221 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd 30/134 2023-07-14T18:01:53.315 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-cephfs-2:18.0.0-4940.g81c9387d.el8.x86_6 28/134 2023-07-14T18:01:53.508 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-babel-2.5.1-7.el8.noarch 31/134 2023-07-14T18:01:53.536 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 29/134 2023-07-14T18:01:53.796 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-jinja2-2.10.1-3.el8.noarch 32/134 2023-07-14T18:01:54.049 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-mako-1.0.6-13.el8.noarch 33/134 2023-07-14T18:01:54.255 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-rsa-4.8-1.el8.noarch 34/134 2023-07-14T18:01:54.487 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 35/134 2023-07-14T18:01:54.640 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-rbd-2:18.0.0-4940.g81c9387d.el8.x86_64 36/134 2023-07-14T18:01:54.841 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : librados-devel-2:18.0.0-4940.g81c9387d.el8.x86_6 37/134 2023-07-14T18:01:55.000 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 38/134 2023-07-14T18:01:55.169 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 39/134 2023-07-14T18:01:55.320 INFO:teuthology.orchestra.run.smithi163.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 29/134 2023-07-14T18:01:55.335 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : uuid-1.6.2-43.el8.x86_64 40/134 2023-07-14T18:01:55.394 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: uuid-1.6.2-43.el8.x86_64 40/134 2023-07-14T18:01:55.442 INFO:teuthology.orchestra.run.smithi172.stdout:(131/131): ceph-test-18.0.0-4940.g81c9387d.el8. 1.5 MB/s | 48 MB 00:32 2023-07-14T18:01:55.445 INFO:teuthology.orchestra.run.smithi172.stdout:-------------------------------------------------------------------------------- 2023-07-14T18:01:55.446 INFO:teuthology.orchestra.run.smithi172.stdout:Total 3.9 MB/s | 206 MB 00:52 2023-07-14T18:01:55.639 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 41/134 2023-07-14T18:01:55.854 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : automake-1.16.1-7.el8.noarch 42/134 2023-07-14T18:01:56.026 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 43/134 2023-07-14T18:01:56.106 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 43/134 2023-07-14T18:01:56.272 INFO:teuthology.orchestra.run.smithi172.stdout:Running transaction check 2023-07-14T18:01:56.297 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : jq-1.6-3.el8.x86_64 44/134 2023-07-14T18:01:56.353 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd 30/134 2023-07-14T18:01:56.392 INFO:teuthology.orchestra.run.smithi172.stdout:Transaction check succeeded. 2023-07-14T18:01:56.392 INFO:teuthology.orchestra.run.smithi172.stdout:Running transaction test 2023-07-14T18:01:56.497 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 45/134 2023-07-14T18:01:56.643 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-babel-2.5.1-7.el8.noarch 31/134 2023-07-14T18:01:56.666 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : libcom_err-devel-1.45.6-4.el8.x86_64 46/134 2023-07-14T18:01:56.878 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : libuuid-devel-2.32.1-35.el8.x86_64 47/134 2023-07-14T18:01:56.880 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-jinja2-2.10.1-3.el8.noarch 32/134 2023-07-14T18:01:57.046 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : fuse-2.9.7-15.el8.x86_64 48/134 2023-07-14T18:01:57.100 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-mako-1.0.6-13.el8.noarch 33/134 2023-07-14T18:01:57.213 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : libverto-devel-0.3.0-5.el8.x86_64 49/134 2023-07-14T18:01:57.305 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-rsa-4.8-1.el8.noarch 34/134 2023-07-14T18:01:57.423 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : pcre2-utf16-10.32-2.el8.x86_64 50/134 2023-07-14T18:01:57.497 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 35/134 2023-07-14T18:01:57.517 INFO:teuthology.orchestra.run.smithi172.stdout:Transaction test succeeded. 2023-07-14T18:01:57.521 INFO:teuthology.orchestra.run.smithi172.stdout:Running transaction 2023-07-14T18:01:57.647 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 51/134 2023-07-14T18:01:57.675 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-rbd-2:18.0.0-4940.g81c9387d.el8.x86_64 36/134 2023-07-14T18:01:57.867 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : librados-devel-2:18.0.0-4940.g81c9387d.el8.x86_6 37/134 2023-07-14T18:01:58.003 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-cffi-1.11.5-5.el8.x86_64 52/134 2023-07-14T18:01:58.035 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 38/134 2023-07-14T18:01:58.195 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 39/134 2023-07-14T18:01:58.311 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-cryptography-3.2.1-5.el8.x86_64 53/134 2023-07-14T18:01:58.394 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : uuid-1.6.2-43.el8.x86_64 40/134 2023-07-14T18:01:58.469 INFO:teuthology.orchestra.run.smithi163.stdout: Running scriptlet: uuid-1.6.2-43.el8.x86_64 40/134 2023-07-14T18:01:58.562 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 54/134 2023-07-14T18:01:58.725 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 41/134 2023-07-14T18:01:58.813 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 55/134 2023-07-14T18:01:58.939 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : automake-1.16.1-7.el8.noarch 42/134 2023-07-14T18:01:59.014 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 56/134 2023-07-14T18:01:59.077 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 43/134 2023-07-14T18:01:59.164 INFO:teuthology.orchestra.run.smithi163.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 43/134 2023-07-14T18:01:59.367 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 57/134 2023-07-14T18:01:59.390 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : jq-1.6-3.el8.x86_64 44/134 2023-07-14T18:01:59.547 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 45/134 2023-07-14T18:01:59.592 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-asyncssh-2.7.0-2.el8.noarch 58/134 2023-07-14T18:01:59.709 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : libcom_err-devel-1.45.6-4.el8.x86_64 46/134 2023-07-14T18:01:59.769 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 59/134 2023-07-14T18:01:59.895 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : libuuid-devel-2.32.1-35.el8.x86_64 47/134 2023-07-14T18:02:00.031 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 60/134 2023-07-14T18:02:00.063 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : fuse-2.9.7-15.el8.x86_64 48/134 2023-07-14T18:02:00.204 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : libsepol-devel-2.9-3.el8.x86_64 61/134 2023-07-14T18:02:00.230 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : libverto-devel-0.3.0-5.el8.x86_64 49/134 2023-07-14T18:02:00.410 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : keyutils-libs-devel-1.5.10-9.el8.x86_64 62/134 2023-07-14T18:02:00.450 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : pcre2-utf16-10.32-2.el8.x86_64 50/134 2023-07-14T18:02:00.656 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 51/134 2023-07-14T18:02:00.722 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : pcre2-utf32-10.32-2.el8.x86_64 63/134 2023-07-14T18:02:00.991 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : pcre2-devel-10.32-2.el8.x86_64 64/134 2023-07-14T18:02:01.006 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-cffi-1.11.5-5.el8.x86_64 52/134 2023-07-14T18:02:01.247 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : libselinux-devel-2.9-5.el8.x86_64 65/134 2023-07-14T18:02:01.320 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-cryptography-3.2.1-5.el8.x86_64 53/134 2023-07-14T18:02:01.468 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : krb5-devel-1.18.2-14.el8.x86_64 66/134 2023-07-14T18:02:01.538 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 54/134 2023-07-14T18:02:01.650 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 67/134 2023-07-14T18:02:01.789 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 55/134 2023-07-14T18:02:01.820 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 68/134 2023-07-14T18:02:02.023 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 56/134 2023-07-14T18:02:02.087 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 69/134 2023-07-14T18:02:02.291 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-waitress-1.4.3-1.el8.noarch 70/134 2023-07-14T18:02:02.318 INFO:teuthology.orchestra.run.smithi172.stdout: Preparing : 1/1 2023-07-14T18:02:02.344 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 57/134 2023-07-14T18:02:02.464 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 71/134 2023-07-14T18:02:02.517 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : thrift-0.13.0-2.el8.x86_64 1/134 2023-07-14T18:02:02.559 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-asyncssh-2.7.0-2.el8.noarch 58/134 2023-07-14T18:02:02.612 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 72/134 2023-07-14T18:02:02.700 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : liboath-2.6.2-3.el8.x86_64 2/134 2023-07-14T18:02:02.735 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 59/134 2023-07-14T18:02:02.844 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 73/134 2023-07-14T18:02:02.926 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : librabbitmq-0.9.0-3.el8.x86_64 3/134 2023-07-14T18:02:02.947 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 60/134 2023-07-14T18:02:03.021 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 74/134 2023-07-14T18:02:03.096 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : libsepol-devel-2.9-3.el8.x86_64 61/134 2023-07-14T18:02:03.128 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : librdkafka-0.11.4-3.el8.x86_64 4/134 2023-07-14T18:02:03.220 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-natsort-7.1.1-2.el8.noarch 75/134 2023-07-14T18:02:03.239 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: librdkafka-0.11.4-3.el8.x86_64 4/134 2023-07-14T18:02:03.271 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : keyutils-libs-devel-1.5.10-9.el8.x86_64 62/134 2023-07-14T18:02:03.387 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 76/134 2023-07-14T18:02:03.503 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 5/134 2023-07-14T18:02:03.506 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 77/134 2023-07-14T18:02:03.574 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : pcre2-utf32-10.32-2.el8.x86_64 63/134 2023-07-14T18:02:03.751 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 78/134 2023-07-14T18:02:03.816 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : pcre2-devel-10.32-2.el8.x86_64 64/134 2023-07-14T18:02:03.906 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 5/134 2023-07-14T18:02:03.988 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 79/134 2023-07-14T18:02:04.056 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : libselinux-devel-2.9-5.el8.x86_64 65/134 2023-07-14T18:02:04.136 INFO:teuthology.orchestra.run.smithi172.stdout: Upgrading : librados2-2:18.0.0-4940.g81c9387d.el8.x86_64 6/134 2023-07-14T18:02:04.173 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 80/134 2023-07-14T18:02:04.286 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : krb5-devel-1.18.2-14.el8.x86_64 66/134 2023-07-14T18:02:04.404 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-portend-2.6-1.el8.noarch 81/134 2023-07-14T18:02:04.442 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 67/134 2023-07-14T18:02:04.522 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: librados2-2:18.0.0-4940.g81c9387d.el8.x86_64 6/134 2023-07-14T18:02:04.608 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 82/134 2023-07-14T18:02:04.621 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 68/134 2023-07-14T18:02:04.719 INFO:teuthology.orchestra.run.smithi172.stdout: Upgrading : librbd1-2:18.0.0-4940.g81c9387d.el8.x86_64 7/134 2023-07-14T18:02:04.798 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 83/134 2023-07-14T18:02:04.842 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: librbd1-2:18.0.0-4940.g81c9387d.el8.x86_64 7/134 2023-07-14T18:02:04.862 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 69/134 2023-07-14T18:02:04.989 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 84/134 2023-07-14T18:02:05.044 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : libcephfs2-2:18.0.0-4940.g81c9387d.el8.x86_64 8/134 2023-07-14T18:02:05.066 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-waitress-1.4.3-1.el8.noarch 70/134 2023-07-14T18:02:05.139 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: libcephfs2-2:18.0.0-4940.g81c9387d.el8.x86_64 8/134 2023-07-14T18:02:05.223 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 71/134 2023-07-14T18:02:05.344 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-rados-2:18.0.0-4940.g81c9387d.el8.x86_64 9/134 2023-07-14T18:02:05.371 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 72/134 2023-07-14T18:02:05.570 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 73/134 2023-07-14T18:02:05.581 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : libpq-13.5-1.el8.x86_64 10/134 2023-07-14T18:02:05.781 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 74/134 2023-07-14T18:02:05.822 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 11/134 2023-07-14T18:02:05.963 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-natsort-7.1.1-2.el8.noarch 75/134 2023-07-14T18:02:06.101 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 85/134 2023-07-14T18:02:06.138 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 76/134 2023-07-14T18:02:06.228 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 12/134 2023-07-14T18:02:06.266 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 77/134 2023-07-14T18:02:06.378 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 86/134 2023-07-14T18:02:06.474 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : postgresql-10.21-2.module+el8.6.0+15342+53518fac 13/134 2023-07-14T18:02:06.519 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 78/134 2023-07-14T18:02:06.627 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : libcephsqlite-2:18.0.0-4940.g81c9387d.el8.x86_64 14/134 2023-07-14T18:02:06.650 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 87/134 2023-07-14T18:02:06.755 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 79/134 2023-07-14T18:02:06.767 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: libcephsqlite-2:18.0.0-4940.g81c9387d.el8.x86_64 14/134 2023-07-14T18:02:06.915 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 80/134 2023-07-14T18:02:06.927 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : libradosstriper1-2:18.0.0-4940.g81c9387d.el8.x86 15/134 2023-07-14T18:02:06.978 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 88/134 2023-07-14T18:02:07.014 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: libradosstriper1-2:18.0.0-4940.g81c9387d.el8.x86 15/134 2023-07-14T18:02:07.160 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : libquadmath-8.5.0-10.1.el8_6.x86_64 16/134 2023-07-14T18:02:07.165 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-portend-2.6-1.el8.noarch 81/134 2023-07-14T18:02:07.292 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 89/134 2023-07-14T18:02:07.308 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: libquadmath-8.5.0-10.1.el8_6.x86_64 16/134 2023-07-14T18:02:07.367 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 82/134 2023-07-14T18:02:07.477 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : libgfortran-8.5.0-10.1.el8_6.x86_64 17/134 2023-07-14T18:02:07.487 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 90/134 2023-07-14T18:02:07.542 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 83/134 2023-07-14T18:02:07.760 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 84/134 2023-07-14T18:02:08.078 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: libgfortran-8.5.0-10.1.el8_6.x86_64 17/134 2023-07-14T18:02:08.269 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : openblas-threads-0.3.15-3.el8.x86_64 18/134 2023-07-14T18:02:08.302 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 91/134 2023-07-14T18:02:08.491 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : librgw2-2:18.0.0-4940.g81c9387d.el8.x86_64 92/134 2023-07-14T18:02:08.555 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: librgw2-2:18.0.0-4940.g81c9387d.el8.x86_64 92/134 2023-07-14T18:02:08.725 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-rgw-2:18.0.0-4940.g81c9387d.el8.x86_64 93/134 2023-07-14T18:02:08.860 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: openblas-threads-0.3.15-3.el8.x86_64 18/134 2023-07-14T18:02:08.887 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 85/134 2023-07-14T18:02:09.044 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : openblas-0.3.15-3.el8.x86_64 19/134 2023-07-14T18:02:09.146 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 86/134 2023-07-14T18:02:09.392 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 87/134 2023-07-14T18:02:09.726 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 88/134 2023-07-14T18:02:09.753 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: openblas-0.3.15-3.el8.x86_64 19/134 2023-07-14T18:02:09.978 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 89/134 2023-07-14T18:02:10.009 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-numpy-1:1.14.3-10.el8.x86_64 20/134 2023-07-14T18:02:10.206 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 90/134 2023-07-14T18:02:10.237 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : zlib-devel-1.2.11-18.el8_5.x86_64 21/134 2023-07-14T18:02:10.464 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 22/134 2023-07-14T18:02:10.658 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 23/134 2023-07-14T18:02:10.875 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-pytz-2017.2-9.el8.noarch 24/134 2023-07-14T18:02:11.002 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 91/134 2023-07-14T18:02:11.121 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 25/134 2023-07-14T18:02:11.159 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : librgw2-2:18.0.0-4940.g81c9387d.el8.x86_64 92/134 2023-07-14T18:02:11.228 INFO:teuthology.orchestra.run.smithi163.stdout: Running scriptlet: librgw2-2:18.0.0-4940.g81c9387d.el8.x86_64 92/134 2023-07-14T18:02:11.333 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-ceph-common-2:18.0.0-4940.g81c9387d.el8. 26/134 2023-07-14T18:02:11.376 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-rgw-2:18.0.0-4940.g81c9387d.el8.x86_64 93/134 2023-07-14T18:02:11.479 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-ceph-argparse-2:18.0.0-4940.g81c9387d.el 27/134 2023-07-14T18:02:12.425 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-cephfs-2:18.0.0-4940.g81c9387d.el8.x86_6 28/134 2023-07-14T18:02:12.442 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: ceph-common-2:18.0.0-4940.g81c9387d.el8.x86_64 94/134 2023-07-14T18:02:12.641 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : ceph-common-2:18.0.0-4940.g81c9387d.el8.x86_64 94/134 2023-07-14T18:02:12.750 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-babel-2.5.1-7.el8.noarch 29/134 2023-07-14T18:02:12.995 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-jinja2-2.10.1-3.el8.noarch 30/134 2023-07-14T18:02:13.222 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: ceph-common-2:18.0.0-4940.g81c9387d.el8.x86_64 94/134 2023-07-14T18:02:13.238 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-mako-1.0.6-13.el8.noarch 31/134 2023-07-14T18:02:13.443 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 32/134 2023-07-14T18:02:13.512 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : ceph-base-2:18.0.0-4940.g81c9387d.el8.x86_64 95/134 2023-07-14T18:02:13.594 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: ceph-base-2:18.0.0-4940.g81c9387d.el8.x86_64 95/134 2023-07-14T18:02:13.766 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : ceph-selinux-2:18.0.0-4940.g81c9387d.el8.x86_64 96/134 2023-07-14T18:02:15.043 INFO:teuthology.orchestra.run.smithi163.stdout: Running scriptlet: ceph-common-2:18.0.0-4940.g81c9387d.el8.x86_64 94/134 2023-07-14T18:02:15.199 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 32/134 2023-07-14T18:02:15.242 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : ceph-common-2:18.0.0-4940.g81c9387d.el8.x86_64 94/134 2023-07-14T18:02:15.545 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd 33/134 2023-07-14T18:02:15.771 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-rsa-4.8-1.el8.noarch 34/134 2023-07-14T18:02:15.823 INFO:teuthology.orchestra.run.smithi163.stdout: Running scriptlet: ceph-common-2:18.0.0-4940.g81c9387d.el8.x86_64 94/134 2023-07-14T18:02:16.012 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 35/134 2023-07-14T18:02:16.113 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : ceph-base-2:18.0.0-4940.g81c9387d.el8.x86_64 95/134 2023-07-14T18:02:16.213 INFO:teuthology.orchestra.run.smithi163.stdout: Running scriptlet: ceph-base-2:18.0.0-4940.g81c9387d.el8.x86_64 95/134 2023-07-14T18:02:16.240 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-rbd-2:18.0.0-4940.g81c9387d.el8.x86_64 36/134 2023-07-14T18:02:16.383 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : ceph-selinux-2:18.0.0-4940.g81c9387d.el8.x86_64 96/134 2023-07-14T18:02:16.430 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : librados-devel-2:18.0.0-4940.g81c9387d.el8.x86_6 37/134 2023-07-14T18:02:16.616 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : libcom_err-devel-1.45.6-4.el8.x86_64 38/134 2023-07-14T18:02:16.777 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : libuuid-devel-2.32.1-35.el8.x86_64 39/134 2023-07-14T18:02:16.995 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : fuse-2.9.7-15.el8.x86_64 40/134 2023-07-14T18:02:17.163 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : libverto-devel-0.3.0-5.el8.x86_64 41/134 2023-07-14T18:02:17.400 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : pcre2-utf16-10.32-2.el8.x86_64 42/134 2023-07-14T18:02:17.616 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 43/134 2023-07-14T18:02:17.998 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-cffi-1.11.5-5.el8.x86_64 44/134 2023-07-14T18:02:18.262 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-cryptography-3.2.1-5.el8.x86_64 45/134 2023-07-14T18:02:18.485 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 46/134 2023-07-14T18:02:18.704 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 47/134 2023-07-14T18:02:18.964 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 48/134 2023-07-14T18:02:19.292 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 49/134 2023-07-14T18:02:19.517 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-asyncssh-2.7.0-2.el8.noarch 50/134 2023-07-14T18:02:19.760 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 51/134 2023-07-14T18:02:19.989 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 52/134 2023-07-14T18:02:20.188 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : libsepol-devel-2.9-3.el8.x86_64 53/134 2023-07-14T18:02:20.387 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : keyutils-libs-devel-1.5.10-9.el8.x86_64 54/134 2023-07-14T18:02:20.710 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : pcre2-utf32-10.32-2.el8.x86_64 55/134 2023-07-14T18:02:20.981 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : pcre2-devel-10.32-2.el8.x86_64 56/134 2023-07-14T18:02:21.247 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : libselinux-devel-2.9-5.el8.x86_64 57/134 2023-07-14T18:02:21.490 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : krb5-devel-1.18.2-14.el8.x86_64 58/134 2023-07-14T18:02:21.699 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 59/134 2023-07-14T18:02:21.877 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 60/134 2023-07-14T18:02:22.058 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : uuid-1.6.2-43.el8.x86_64 61/134 2023-07-14T18:02:22.129 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: uuid-1.6.2-43.el8.x86_64 61/134 2023-07-14T18:02:22.379 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 62/134 2023-07-14T18:02:22.562 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : automake-1.16.1-7.el8.noarch 63/134 2023-07-14T18:02:22.758 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 64/134 2023-07-14T18:02:22.840 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 64/134 2023-07-14T18:02:23.072 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : jq-1.6-3.el8.x86_64 65/134 2023-07-14T18:02:23.251 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 66/134 2023-07-14T18:02:23.416 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 67/134 2023-07-14T18:02:23.646 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 68/134 2023-07-14T18:02:23.916 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 69/134 2023-07-14T18:02:24.158 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-waitress-1.4.3-1.el8.noarch 70/134 2023-07-14T18:02:24.313 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 71/134 2023-07-14T18:02:24.487 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 72/134 2023-07-14T18:02:24.736 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 73/134 2023-07-14T18:02:24.947 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 74/134 2023-07-14T18:02:25.138 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-natsort-7.1.1-2.el8.noarch 75/134 2023-07-14T18:02:25.320 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 76/134 2023-07-14T18:02:25.514 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 77/134 2023-07-14T18:02:25.751 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 78/134 2023-07-14T18:02:25.988 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 79/134 2023-07-14T18:02:26.173 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 80/134 2023-07-14T18:02:26.424 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-portend-2.6-1.el8.noarch 81/134 2023-07-14T18:02:26.666 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 82/134 2023-07-14T18:02:26.858 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 83/134 2023-07-14T18:02:27.093 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 84/134 2023-07-14T18:02:28.239 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 85/134 2023-07-14T18:02:28.553 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 86/134 2023-07-14T18:02:28.816 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 87/134 2023-07-14T18:02:29.142 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 88/134 2023-07-14T18:02:29.433 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 89/134 2023-07-14T18:02:29.634 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 90/134 2023-07-14T18:02:30.434 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 91/134 2023-07-14T18:02:30.616 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : librgw2-2:18.0.0-4940.g81c9387d.el8.x86_64 92/134 2023-07-14T18:02:30.685 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: librgw2-2:18.0.0-4940.g81c9387d.el8.x86_64 92/134 2023-07-14T18:02:30.883 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-rgw-2:18.0.0-4940.g81c9387d.el8.x86_64 93/134 2023-07-14T18:02:32.466 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: ceph-selinux-2:18.0.0-4940.g81c9387d.el8.x86_64 96/134 2023-07-14T18:02:32.467 INFO:teuthology.orchestra.run.smithi184.stdout:skipping the directory /sys 2023-07-14T18:02:32.467 INFO:teuthology.orchestra.run.smithi184.stdout:skipping the directory /proc 2023-07-14T18:02:32.467 INFO:teuthology.orchestra.run.smithi184.stdout:skipping the directory /dev 2023-07-14T18:02:32.467 INFO:teuthology.orchestra.run.smithi184.stdout:skipping the directory /run 2023-07-14T18:02:32.468 INFO:teuthology.orchestra.run.smithi184.stdout:skipping the directory /mnt 2023-07-14T18:02:32.468 INFO:teuthology.orchestra.run.smithi184.stdout:skipping the directory /var/tmp 2023-07-14T18:02:32.468 INFO:teuthology.orchestra.run.smithi184.stdout:skipping the directory /home 2023-07-14T18:02:32.469 INFO:teuthology.orchestra.run.smithi184.stdout:skipping the directory /tmp 2023-07-14T18:02:32.469 INFO:teuthology.orchestra.run.smithi184.stdout:skipping the directory /dev 2023-07-14T18:02:32.469 INFO:teuthology.orchestra.run.smithi184.stdout: 2023-07-14T18:02:32.822 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : ceph-volume-2:18.0.0-4940.g81c9387d.el8.noarch 97/134 2023-07-14T18:02:34.402 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: ceph-volume-2:18.0.0-4940.g81c9387d.el8.noarch 97/134 2023-07-14T18:02:34.543 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: ceph-common-2:18.0.0-4940.g81c9387d.el8.x86_64 94/134 2023-07-14T18:02:34.601 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : ceph-osd-2:18.0.0-4940.g81c9387d.el8.x86_64 98/134 2023-07-14T18:02:34.774 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : ceph-common-2:18.0.0-4940.g81c9387d.el8.x86_64 94/134 2023-07-14T18:02:34.820 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: ceph-osd-2:18.0.0-4940.g81c9387d.el8.x86_64 98/134 2023-07-14T18:02:34.979 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : ceph-mds-2:18.0.0-4940.g81c9387d.el8.x86_64 99/134 2023-07-14T18:02:35.240 INFO:teuthology.orchestra.run.smithi163.stdout: Running scriptlet: ceph-selinux-2:18.0.0-4940.g81c9387d.el8.x86_64 96/134 2023-07-14T18:02:35.241 INFO:teuthology.orchestra.run.smithi163.stdout:skipping the directory /sys 2023-07-14T18:02:35.241 INFO:teuthology.orchestra.run.smithi163.stdout:skipping the directory /proc 2023-07-14T18:02:35.241 INFO:teuthology.orchestra.run.smithi163.stdout:skipping the directory /dev 2023-07-14T18:02:35.241 INFO:teuthology.orchestra.run.smithi163.stdout:skipping the directory /run 2023-07-14T18:02:35.241 INFO:teuthology.orchestra.run.smithi163.stdout:skipping the directory /mnt 2023-07-14T18:02:35.241 INFO:teuthology.orchestra.run.smithi163.stdout:skipping the directory /var/tmp 2023-07-14T18:02:35.242 INFO:teuthology.orchestra.run.smithi163.stdout:skipping the directory /home 2023-07-14T18:02:35.242 INFO:teuthology.orchestra.run.smithi163.stdout:skipping the directory /tmp 2023-07-14T18:02:35.242 INFO:teuthology.orchestra.run.smithi163.stdout:skipping the directory /dev 2023-07-14T18:02:35.242 INFO:teuthology.orchestra.run.smithi163.stdout: 2023-07-14T18:02:35.356 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: ceph-common-2:18.0.0-4940.g81c9387d.el8.x86_64 94/134 2023-07-14T18:02:35.433 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: ceph-mds-2:18.0.0-4940.g81c9387d.el8.x86_64 99/134 2023-07-14T18:02:35.581 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : ceph-volume-2:18.0.0-4940.g81c9387d.el8.noarch 97/134 2023-07-14T18:02:35.613 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : ceph-mon-2:18.0.0-4940.g81c9387d.el8.x86_64 100/134 2023-07-14T18:02:35.630 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: ceph-mon-2:18.0.0-4940.g81c9387d.el8.x86_64 100/134 2023-07-14T18:02:35.665 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : ceph-base-2:18.0.0-4940.g81c9387d.el8.x86_64 95/134 2023-07-14T18:02:35.754 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: ceph-base-2:18.0.0-4940.g81c9387d.el8.x86_64 95/134 2023-07-14T18:02:35.923 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : ceph-selinux-2:18.0.0-4940.g81c9387d.el8.x86_64 96/134 2023-07-14T18:02:37.165 INFO:teuthology.orchestra.run.smithi163.stdout: Running scriptlet: ceph-volume-2:18.0.0-4940.g81c9387d.el8.noarch 97/134 2023-07-14T18:02:37.233 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: cephadm-2:18.0.0-4940.g81c9387d.el8.noarch 101/134 2023-07-14T18:02:37.360 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : ceph-osd-2:18.0.0-4940.g81c9387d.el8.x86_64 98/134 2023-07-14T18:02:37.395 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : cephadm-2:18.0.0-4940.g81c9387d.el8.noarch 101/134 2023-07-14T18:02:37.535 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : ceph-prometheus-alerts-2:18.0.0-4940.g81c9387d.e 102/134 2023-07-14T18:02:37.579 INFO:teuthology.orchestra.run.smithi163.stdout: Running scriptlet: ceph-osd-2:18.0.0-4940.g81c9387d.el8.x86_64 98/134 2023-07-14T18:02:37.764 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : ceph-mds-2:18.0.0-4940.g81c9387d.el8.x86_64 99/134 2023-07-14T18:02:37.794 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : ceph-grafana-dashboards-2:18.0.0-4940.g81c9387d. 103/134 2023-07-14T18:02:37.989 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : ceph-mgr-cephadm-2:18.0.0-4940.g81c9387d.el8.noa 104/134 2023-07-14T18:02:38.205 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.0.0-4940.g81c9387d.el8.noa 104/134 2023-07-14T18:02:38.217 INFO:teuthology.orchestra.run.smithi163.stdout: Running scriptlet: ceph-mds-2:18.0.0-4940.g81c9387d.el8.x86_64 99/134 2023-07-14T18:02:38.406 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : ceph-mon-2:18.0.0-4940.g81c9387d.el8.x86_64 100/134 2023-07-14T18:02:38.423 INFO:teuthology.orchestra.run.smithi163.stdout: Running scriptlet: ceph-mon-2:18.0.0-4940.g81c9387d.el8.x86_64 100/134 2023-07-14T18:02:38.525 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : ceph-mgr-dashboard-2:18.0.0-4940.g81c9387d.el8.n 105/134 2023-07-14T18:02:39.485 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.0.0-4940.g81c9387d.el8.n 105/134 2023-07-14T18:02:39.679 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : ceph-mgr-diskprediction-local-2:18.0.0-4940.g81c 106/134 2023-07-14T18:02:39.770 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.0.0-4940.g81c 106/134 2023-07-14T18:02:40.136 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : ceph-mgr-modules-core-2:18.0.0-4940.g81c9387d.el 107/134 2023-07-14T18:02:40.177 INFO:teuthology.orchestra.run.smithi163.stdout: Running scriptlet: cephadm-2:18.0.0-4940.g81c9387d.el8.noarch 101/134 2023-07-14T18:02:40.338 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : cephadm-2:18.0.0-4940.g81c9387d.el8.noarch 101/134 2023-07-14T18:02:40.356 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : ceph-mgr-2:18.0.0-4940.g81c9387d.el8.x86_64 108/134 2023-07-14T18:02:40.391 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: ceph-mgr-2:18.0.0-4940.g81c9387d.el8.x86_64 108/134 2023-07-14T18:02:40.461 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : ceph-prometheus-alerts-2:18.0.0-4940.g81c9387d.e 102/134 2023-07-14T18:02:40.579 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : ceph-mgr-rook-2:18.0.0-4940.g81c9387d.el8.noarch 109/134 2023-07-14T18:02:40.591 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: ceph-mgr-rook-2:18.0.0-4940.g81c9387d.el8.noarch 109/134 2023-07-14T18:02:40.688 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : ceph-grafana-dashboards-2:18.0.0-4940.g81c9387d. 103/134 2023-07-14T18:02:40.880 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : ceph-mgr-cephadm-2:18.0.0-4940.g81c9387d.el8.noa 104/134 2023-07-14T18:02:41.097 INFO:teuthology.orchestra.run.smithi163.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.0.0-4940.g81c9387d.el8.noa 104/134 2023-07-14T18:02:41.385 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : ceph-mgr-dashboard-2:18.0.0-4940.g81c9387d.el8.n 105/134 2023-07-14T18:02:41.897 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : ceph-2:18.0.0-4940.g81c9387d.el8.x86_64 110/134 2023-07-14T18:02:42.104 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : ceph-radosgw-2:18.0.0-4940.g81c9387d.el8.x86_64 111/134 2023-07-14T18:02:42.139 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: ceph-radosgw-2:18.0.0-4940.g81c9387d.el8.x86_64 111/134 2023-07-14T18:02:42.287 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : ceph-immutable-object-cache-2:18.0.0-4940.g81c93 112/134 2023-07-14T18:02:42.329 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.0.0-4940.g81c93 112/134 2023-07-14T18:02:42.346 INFO:teuthology.orchestra.run.smithi163.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.0.0-4940.g81c9387d.el8.n 105/134 2023-07-14T18:02:42.513 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : ceph-mgr-diskprediction-local-2:18.0.0-4940.g81c 106/134 2023-07-14T18:02:42.520 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : cephfs-mirror-2:18.0.0-4940.g81c9387d.el8.x86_64 113/134 2023-07-14T18:02:42.604 INFO:teuthology.orchestra.run.smithi163.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.0.0-4940.g81c 106/134 2023-07-14T18:02:42.873 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: cephfs-mirror-2:18.0.0-4940.g81c9387d.el8.x86_64 113/134 2023-07-14T18:02:42.946 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : ceph-mgr-modules-core-2:18.0.0-4940.g81c9387d.el 107/134 2023-07-14T18:02:43.037 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : rbd-mirror-2:18.0.0-4940.g81c9387d.el8.x86_64 114/134 2023-07-14T18:02:43.173 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : ceph-mgr-2:18.0.0-4940.g81c9387d.el8.x86_64 108/134 2023-07-14T18:02:43.208 INFO:teuthology.orchestra.run.smithi163.stdout: Running scriptlet: ceph-mgr-2:18.0.0-4940.g81c9387d.el8.x86_64 108/134 2023-07-14T18:02:43.355 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : ceph-mgr-rook-2:18.0.0-4940.g81c9387d.el8.noarch 109/134 2023-07-14T18:02:43.366 INFO:teuthology.orchestra.run.smithi163.stdout: Running scriptlet: ceph-mgr-rook-2:18.0.0-4940.g81c9387d.el8.noarch 109/134 2023-07-14T18:02:44.677 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : ceph-2:18.0.0-4940.g81c9387d.el8.x86_64 110/134 2023-07-14T18:02:44.908 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : ceph-radosgw-2:18.0.0-4940.g81c9387d.el8.x86_64 111/134 2023-07-14T18:02:44.942 INFO:teuthology.orchestra.run.smithi163.stdout: Running scriptlet: ceph-radosgw-2:18.0.0-4940.g81c9387d.el8.x86_64 111/134 2023-07-14T18:02:45.097 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : ceph-immutable-object-cache-2:18.0.0-4940.g81c93 112/134 2023-07-14T18:02:45.138 INFO:teuthology.orchestra.run.smithi163.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.0.0-4940.g81c93 112/134 2023-07-14T18:02:45.313 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : cephfs-mirror-2:18.0.0-4940.g81c9387d.el8.x86_64 113/134 2023-07-14T18:02:45.665 INFO:teuthology.orchestra.run.smithi163.stdout: Running scriptlet: cephfs-mirror-2:18.0.0-4940.g81c9387d.el8.x86_64 113/134 2023-07-14T18:02:45.821 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : rbd-mirror-2:18.0.0-4940.g81c9387d.el8.x86_64 114/134 2023-07-14T18:02:47.602 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: rbd-mirror-2:18.0.0-4940.g81c9387d.el8.x86_64 114/134 2023-07-14T18:02:48.460 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : ceph-test-2:18.0.0-4940.g81c9387d.el8.x86_64 115/134 2023-07-14T18:02:48.784 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : openssl-devel-1:1.1.1k-7.el8_6.x86_64 116/134 2023-07-14T18:02:49.014 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : ceph-fuse-2:18.0.0-4940.g81c9387d.el8.x86_64 117/134 2023-07-14T18:02:49.256 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : xfsprogs-devel-5.0.0-10.el8.x86_64 118/134 2023-07-14T18:02:49.452 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : libtool-2.4.6-25.el8.x86_64 119/134 2023-07-14T18:02:49.648 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: libtool-2.4.6-25.el8.x86_64 119/134 2023-07-14T18:02:49.907 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : postgresql-contrib-10.21-2.module+el8.6.0+15342+ 120/134 2023-07-14T18:02:50.065 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : libcephfs-devel-2:18.0.0-4940.g81c9387d.el8.x86_ 121/134 2023-07-14T18:02:50.245 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : elfutils-libelf-devel-0.186-1.el8.x86_64 122/134 2023-07-14T18:02:50.392 INFO:teuthology.orchestra.run.smithi163.stdout: Running scriptlet: rbd-mirror-2:18.0.0-4940.g81c9387d.el8.x86_64 114/134 2023-07-14T18:02:51.300 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : ceph-test-2:18.0.0-4940.g81c9387d.el8.x86_64 115/134 2023-07-14T18:02:51.610 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : openssl-devel-1:1.1.1k-7.el8_6.x86_64 116/134 2023-07-14T18:02:51.782 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : ceph-fuse-2:18.0.0-4940.g81c9387d.el8.x86_64 117/134 2023-07-14T18:02:52.021 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : xfsprogs-devel-5.0.0-10.el8.x86_64 118/134 2023-07-14T18:02:52.220 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : libtool-2.4.6-25.el8.x86_64 119/134 2023-07-14T18:02:52.379 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-07-14T18:02:52.420 INFO:teuthology.orchestra.run.smithi163.stdout: Running scriptlet: libtool-2.4.6-25.el8.x86_64 119/134 2023-07-14T18:02:52.633 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : postgresql-contrib-10.21-2.module+el8.6.0+15342+ 120/134 2023-07-14T18:02:52.660 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-07-14T18:02:52.678 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-07-14T18:02:52.799 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : libcephfs-devel-2:18.0.0-4940.g81c9387d.el8.x86_ 121/134 2023-07-14T18:02:52.802 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : cephfs-top-2:18.0.0-4940.g81c9387d.el8.noarch 124/134 2023-07-14T18:02:53.046 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : elfutils-libelf-devel-0.186-1.el8.x86_64 122/134 2023-07-14T18:02:53.119 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : rbd-fuse-2:18.0.0-4940.g81c9387d.el8.x86_64 125/134 2023-07-14T18:02:53.416 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : rbd-nbd-2:18.0.0-4940.g81c9387d.el8.x86_64 126/134 2023-07-14T18:02:53.747 INFO:teuthology.orchestra.run.smithi184.stdout: Upgrading : iproute-5.15.0-4.el8_6.1.x86_64 127/134 2023-07-14T18:02:53.960 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : flex-2.6.1-9.el8.x86_64 128/134 2023-07-14T18:02:54.045 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 128/134 2023-07-14T18:02:54.260 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : bison-3.0.4-10.el8.x86_64 129/134 2023-07-14T18:02:54.273 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 129/134 2023-07-14T18:02:54.427 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : NetworkManager-initscripts-updown-1:1.36.0-9.el8 130/134 2023-07-14T18:02:54.435 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: NetworkManager-initscripts-updown-1:1.36.0-9.el8 130/134 2023-07-14T18:02:54.602 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 131/134 2023-07-14T18:02:54.602 INFO:teuthology.orchestra.run.smithi184.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-07-14T18:02:54.638 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: ceph-selinux-2:18.0.0-4940.g81c9387d.el8.x86_64 96/134 2023-07-14T18:02:54.639 INFO:teuthology.orchestra.run.smithi172.stdout:skipping the directory /sys 2023-07-14T18:02:54.639 INFO:teuthology.orchestra.run.smithi172.stdout:skipping the directory /proc 2023-07-14T18:02:54.639 INFO:teuthology.orchestra.run.smithi172.stdout:skipping the directory /dev 2023-07-14T18:02:54.639 INFO:teuthology.orchestra.run.smithi172.stdout:skipping the directory /run 2023-07-14T18:02:54.639 INFO:teuthology.orchestra.run.smithi172.stdout:skipping the directory /mnt 2023-07-14T18:02:54.640 INFO:teuthology.orchestra.run.smithi172.stdout:skipping the directory /var/tmp 2023-07-14T18:02:54.640 INFO:teuthology.orchestra.run.smithi172.stdout:skipping the directory /home 2023-07-14T18:02:54.640 INFO:teuthology.orchestra.run.smithi172.stdout:skipping the directory /tmp 2023-07-14T18:02:54.640 INFO:teuthology.orchestra.run.smithi172.stdout:skipping the directory /dev 2023-07-14T18:02:54.640 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-07-14T18:02:54.788 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-07-14T18:02:54.789 INFO:teuthology.orchestra.run.smithi184.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 133/134 2023-07-14T18:02:54.996 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : ceph-volume-2:18.0.0-4940.g81c9387d.el8.noarch 97/134 2023-07-14T18:02:55.037 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 133/134 2023-07-14T18:02:55.234 INFO:teuthology.orchestra.run.smithi184.stdout: Cleanup : iproute-5.15.0-4.el8.x86_64 134/134 2023-07-14T18:02:55.272 INFO:teuthology.orchestra.run.smithi163.stdout: Running scriptlet: postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-07-14T18:02:55.503 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-07-14T18:02:55.522 INFO:teuthology.orchestra.run.smithi163.stdout: Running scriptlet: postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-07-14T18:02:55.679 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : cephfs-top-2:18.0.0-4940.g81c9387d.el8.noarch 124/134 2023-07-14T18:02:55.733 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: iproute-5.15.0-4.el8.x86_64 134/134 2023-07-14T18:02:55.733 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : ceph-2:18.0.0-4940.g81c9387d.el8.x86_64 1/134 2023-07-14T18:02:55.733 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : ceph-base-2:18.0.0-4940.g81c9387d.el8.x86_64 2/134 2023-07-14T18:02:55.734 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : ceph-common-2:18.0.0-4940.g81c9387d.el8.x86_64 3/134 2023-07-14T18:02:55.734 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : ceph-fuse-2:18.0.0-4940.g81c9387d.el8.x86_64 4/134 2023-07-14T18:02:55.734 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : ceph-immutable-object-cache-2:18.0.0-4940.g81c93 5/134 2023-07-14T18:02:55.734 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : ceph-mds-2:18.0.0-4940.g81c9387d.el8.x86_64 6/134 2023-07-14T18:02:55.734 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : ceph-mgr-2:18.0.0-4940.g81c9387d.el8.x86_64 7/134 2023-07-14T18:02:55.734 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : ceph-mon-2:18.0.0-4940.g81c9387d.el8.x86_64 8/134 2023-07-14T18:02:55.734 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : ceph-osd-2:18.0.0-4940.g81c9387d.el8.x86_64 9/134 2023-07-14T18:02:55.735 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : ceph-radosgw-2:18.0.0-4940.g81c9387d.el8.x86_64 10/134 2023-07-14T18:02:55.735 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : ceph-selinux-2:18.0.0-4940.g81c9387d.el8.x86_64 11/134 2023-07-14T18:02:55.735 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : ceph-test-2:18.0.0-4940.g81c9387d.el8.x86_64 12/134 2023-07-14T18:02:55.735 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : cephfs-mirror-2:18.0.0-4940.g81c9387d.el8.x86_64 13/134 2023-07-14T18:02:55.735 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : libcephfs-devel-2:18.0.0-4940.g81c9387d.el8.x86_ 14/134 2023-07-14T18:02:55.736 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : libcephfs2-2:18.0.0-4940.g81c9387d.el8.x86_64 15/134 2023-07-14T18:02:55.736 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : libcephsqlite-2:18.0.0-4940.g81c9387d.el8.x86_64 16/134 2023-07-14T18:02:55.736 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : librados-devel-2:18.0.0-4940.g81c9387d.el8.x86_6 17/134 2023-07-14T18:02:55.736 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : libradosstriper1-2:18.0.0-4940.g81c9387d.el8.x86 18/134 2023-07-14T18:02:55.736 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : librgw2-2:18.0.0-4940.g81c9387d.el8.x86_64 19/134 2023-07-14T18:02:55.736 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-ceph-argparse-2:18.0.0-4940.g81c9387d.el 20/134 2023-07-14T18:02:55.736 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-ceph-common-2:18.0.0-4940.g81c9387d.el8. 21/134 2023-07-14T18:02:55.737 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-cephfs-2:18.0.0-4940.g81c9387d.el8.x86_6 22/134 2023-07-14T18:02:55.737 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-rados-2:18.0.0-4940.g81c9387d.el8.x86_64 23/134 2023-07-14T18:02:55.737 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-rbd-2:18.0.0-4940.g81c9387d.el8.x86_64 24/134 2023-07-14T18:02:55.737 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-rgw-2:18.0.0-4940.g81c9387d.el8.x86_64 25/134 2023-07-14T18:02:55.737 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : rbd-fuse-2:18.0.0-4940.g81c9387d.el8.x86_64 26/134 2023-07-14T18:02:55.737 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : rbd-mirror-2:18.0.0-4940.g81c9387d.el8.x86_64 27/134 2023-07-14T18:02:55.737 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : rbd-nbd-2:18.0.0-4940.g81c9387d.el8.x86_64 28/134 2023-07-14T18:02:55.737 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : ceph-grafana-dashboards-2:18.0.0-4940.g81c9387d. 29/134 2023-07-14T18:02:55.738 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : ceph-mgr-cephadm-2:18.0.0-4940.g81c9387d.el8.noa 30/134 2023-07-14T18:02:55.745 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : ceph-mgr-dashboard-2:18.0.0-4940.g81c9387d.el8.n 31/134 2023-07-14T18:02:55.745 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.0.0-4940.g81c 32/134 2023-07-14T18:02:55.745 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : ceph-mgr-modules-core-2:18.0.0-4940.g81c9387d.el 33/134 2023-07-14T18:02:55.745 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : ceph-mgr-rook-2:18.0.0-4940.g81c9387d.el8.noarch 34/134 2023-07-14T18:02:55.746 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : ceph-prometheus-alerts-2:18.0.0-4940.g81c9387d.e 35/134 2023-07-14T18:02:55.746 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : ceph-volume-2:18.0.0-4940.g81c9387d.el8.noarch 36/134 2023-07-14T18:02:55.746 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : cephadm-2:18.0.0-4940.g81c9387d.el8.noarch 37/134 2023-07-14T18:02:55.746 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : cephfs-top-2:18.0.0-4940.g81c9387d.el8.noarch 38/134 2023-07-14T18:02:55.746 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 39/134 2023-07-14T18:02:55.747 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 40/134 2023-07-14T18:02:55.747 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 41/134 2023-07-14T18:02:55.747 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-asyncssh-2.7.0-2.el8.noarch 42/134 2023-07-14T18:02:55.747 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 43/134 2023-07-14T18:02:55.747 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 44/134 2023-07-14T18:02:55.747 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 45/134 2023-07-14T18:02:55.747 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 46/134 2023-07-14T18:02:55.747 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 47/134 2023-07-14T18:02:55.748 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 48/134 2023-07-14T18:02:55.748 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 49/134 2023-07-14T18:02:55.748 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 50/134 2023-07-14T18:02:55.748 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 51/134 2023-07-14T18:02:55.748 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 52/134 2023-07-14T18:02:55.748 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 53/134 2023-07-14T18:02:55.748 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 54/134 2023-07-14T18:02:55.749 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-natsort-7.1.1-2.el8.noarch 55/134 2023-07-14T18:02:55.749 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 56/134 2023-07-14T18:02:55.749 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-portend-2.6-1.el8.noarch 57/134 2023-07-14T18:02:55.749 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 58/134 2023-07-14T18:02:55.749 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 59/134 2023-07-14T18:02:55.749 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-rsa-4.8-1.el8.noarch 60/134 2023-07-14T18:02:55.749 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 61/134 2023-07-14T18:02:55.749 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 62/134 2023-07-14T18:02:55.750 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 63/134 2023-07-14T18:02:55.750 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 64/134 2023-07-14T18:02:55.750 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 65/134 2023-07-14T18:02:55.750 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 66/134 2023-07-14T18:02:55.750 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 67/134 2023-07-14T18:02:55.750 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 68/134 2023-07-14T18:02:55.750 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 69/134 2023-07-14T18:02:55.750 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : thrift-0.13.0-2.el8.x86_64 70/134 2023-07-14T18:02:55.751 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 71/134 2023-07-14T18:02:55.751 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : librabbitmq-0.9.0-3.el8.x86_64 72/134 2023-07-14T18:02:55.751 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : libselinux-devel-2.9-5.el8.x86_64 73/134 2023-07-14T18:02:55.751 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 74/134 2023-07-14T18:02:55.751 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : pcre2-utf32-10.32-2.el8.x86_64 75/134 2023-07-14T18:02:55.751 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : keyutils-libs-devel-1.5.10-9.el8.x86_64 76/134 2023-07-14T18:02:55.751 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : libsepol-devel-2.9-3.el8.x86_64 77/134 2023-07-14T18:02:55.752 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 78/134 2023-07-14T18:02:55.752 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 79/134 2023-07-14T18:02:55.752 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : pcre2-utf16-10.32-2.el8.x86_64 80/134 2023-07-14T18:02:55.752 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : krb5-devel-1.18.2-14.el8.x86_64 81/134 2023-07-14T18:02:55.752 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 82/134 2023-07-14T18:02:55.752 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 83/134 2023-07-14T18:02:55.752 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-cryptography-3.2.1-5.el8.x86_64 84/134 2023-07-14T18:02:55.752 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : libverto-devel-0.3.0-5.el8.x86_64 85/134 2023-07-14T18:02:55.753 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : pcre2-devel-10.32-2.el8.x86_64 86/134 2023-07-14T18:02:55.753 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-cffi-1.11.5-5.el8.x86_64 87/134 2023-07-14T18:02:55.753 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : openssl-devel-1:1.1.1k-7.el8_6.x86_64 88/134 2023-07-14T18:02:55.753 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : xfsprogs-devel-5.0.0-10.el8.x86_64 89/134 2023-07-14T18:02:55.753 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : fuse-2.9.7-15.el8.x86_64 90/134 2023-07-14T18:02:55.753 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : elfutils-libelf-devel-0.186-1.el8.x86_64 91/134 2023-07-14T18:02:55.753 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : libuuid-devel-2.32.1-35.el8.x86_64 92/134 2023-07-14T18:02:55.754 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : zlib-devel-1.2.11-18.el8_5.x86_64 93/134 2023-07-14T18:02:55.754 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : libcom_err-devel-1.45.6-4.el8.x86_64 94/134 2023-07-14T18:02:55.754 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : libgfortran-8.5.0-10.1.el8_6.x86_64 95/134 2023-07-14T18:02:55.754 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : libquadmath-8.5.0-10.1.el8_6.x86_64 96/134 2023-07-14T18:02:55.754 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : NetworkManager-initscripts-updown-1:1.36.0-9.el8 97/134 2023-07-14T18:02:55.754 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd 98/134 2023-07-14T18:02:55.754 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 99/134 2023-07-14T18:02:55.755 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-pytz-2017.2-9.el8.noarch 100/134 2023-07-14T18:02:55.755 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 101/134 2023-07-14T18:02:55.755 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 102/134 2023-07-14T18:02:55.755 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 103/134 2023-07-14T18:02:55.755 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : bison-3.0.4-10.el8.x86_64 104/134 2023-07-14T18:02:55.755 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-jinja2-2.10.1-3.el8.noarch 105/134 2023-07-14T18:02:55.755 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-mako-1.0.6-13.el8.noarch 106/134 2023-07-14T18:02:55.756 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 107/134 2023-07-14T18:02:55.756 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : automake-1.16.1-7.el8.noarch 108/134 2023-07-14T18:02:55.756 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-babel-2.5.1-7.el8.noarch 109/134 2023-07-14T18:02:55.757 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 110/134 2023-07-14T18:02:55.757 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : flex-2.6.1-9.el8.x86_64 111/134 2023-07-14T18:02:55.757 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 112/134 2023-07-14T18:02:55.757 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-numpy-1:1.14.3-10.el8.x86_64 113/134 2023-07-14T18:02:55.758 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 114/134 2023-07-14T18:02:55.758 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 115/134 2023-07-14T18:02:55.758 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : uuid-1.6.2-43.el8.x86_64 116/134 2023-07-14T18:02:55.758 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 117/134 2023-07-14T18:02:55.758 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 118/134 2023-07-14T18:02:55.758 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 119/134 2023-07-14T18:02:55.758 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : libtool-2.4.6-25.el8.x86_64 120/134 2023-07-14T18:02:55.759 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : openblas-threads-0.3.15-3.el8.x86_64 121/134 2023-07-14T18:02:55.759 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : libpq-13.5-1.el8.x86_64 122/134 2023-07-14T18:02:55.759 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : openblas-0.3.15-3.el8.x86_64 123/134 2023-07-14T18:02:55.759 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : jq-1.6-3.el8.x86_64 124/134 2023-07-14T18:02:55.759 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : librdkafka-0.11.4-3.el8.x86_64 125/134 2023-07-14T18:02:55.759 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : postgresql-server-10.21-2.module+el8.6.0+15342+5 126/134 2023-07-14T18:02:55.759 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : postgresql-contrib-10.21-2.module+el8.6.0+15342+ 127/134 2023-07-14T18:02:55.759 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : postgresql-10.21-2.module+el8.6.0+15342+53518fac 128/134 2023-07-14T18:02:55.760 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : librados2-2:18.0.0-4940.g81c9387d.el8.x86_64 129/134 2023-07-14T18:02:55.760 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 130/134 2023-07-14T18:02:55.760 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : librbd1-2:18.0.0-4940.g81c9387d.el8.x86_64 131/134 2023-07-14T18:02:55.760 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-07-14T18:02:55.760 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : iproute-5.15.0-4.el8_6.1.x86_64 133/134 2023-07-14T18:02:55.995 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : rbd-fuse-2:18.0.0-4940.g81c9387d.el8.x86_64 125/134 2023-07-14T18:02:56.298 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : rbd-nbd-2:18.0.0-4940.g81c9387d.el8.x86_64 126/134 2023-07-14T18:02:56.588 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: ceph-volume-2:18.0.0-4940.g81c9387d.el8.noarch 97/134 2023-07-14T18:02:56.621 INFO:teuthology.orchestra.run.smithi163.stdout: Upgrading : iproute-5.15.0-4.el8_6.1.x86_64 127/134 2023-07-14T18:02:56.812 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : ceph-osd-2:18.0.0-4940.g81c9387d.el8.x86_64 98/134 2023-07-14T18:02:56.836 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : flex-2.6.1-9.el8.x86_64 128/134 2023-07-14T18:02:56.916 INFO:teuthology.orchestra.run.smithi163.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 128/134 2023-07-14T18:02:57.031 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: ceph-osd-2:18.0.0-4940.g81c9387d.el8.x86_64 98/134 2023-07-14T18:02:57.103 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : bison-3.0.4-10.el8.x86_64 129/134 2023-07-14T18:02:57.115 INFO:teuthology.orchestra.run.smithi163.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 129/134 2023-07-14T18:02:57.220 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : ceph-mds-2:18.0.0-4940.g81c9387d.el8.x86_64 99/134 2023-07-14T18:02:57.261 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : NetworkManager-initscripts-updown-1:1.36.0-9.el8 130/134 2023-07-14T18:02:57.269 INFO:teuthology.orchestra.run.smithi163.stdout: Running scriptlet: NetworkManager-initscripts-updown-1:1.36.0-9.el8 130/134 2023-07-14T18:02:57.388 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 131/134 2023-07-14T18:02:57.388 INFO:teuthology.orchestra.run.smithi163.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-07-14T18:02:57.606 INFO:teuthology.orchestra.run.smithi163.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-07-14T18:02:57.606 INFO:teuthology.orchestra.run.smithi163.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 133/134 2023-07-14T18:02:57.674 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: ceph-mds-2:18.0.0-4940.g81c9387d.el8.x86_64 99/134 2023-07-14T18:02:57.843 INFO:teuthology.orchestra.run.smithi163.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 133/134 2023-07-14T18:02:57.913 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : ceph-mon-2:18.0.0-4940.g81c9387d.el8.x86_64 100/134 2023-07-14T18:02:57.930 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: ceph-mon-2:18.0.0-4940.g81c9387d.el8.x86_64 100/134 2023-07-14T18:02:58.043 INFO:teuthology.orchestra.run.smithi163.stdout: Cleanup : iproute-5.15.0-4.el8.x86_64 134/134 2023-07-14T18:02:58.321 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : iproute-5.15.0-4.el8.x86_64 134/134 2023-07-14T18:02:58.321 INFO:teuthology.orchestra.run.smithi184.stdout:Last metadata expiration check: 0:01:49 ago on Fri 14 Jul 2023 06:01:09 PM UTC. 2023-07-14T18:02:58.556 INFO:teuthology.orchestra.run.smithi163.stdout: Running scriptlet: iproute-5.15.0-4.el8.x86_64 134/134 2023-07-14T18:02:58.556 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : ceph-2:18.0.0-4940.g81c9387d.el8.x86_64 1/134 2023-07-14T18:02:58.556 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : ceph-base-2:18.0.0-4940.g81c9387d.el8.x86_64 2/134 2023-07-14T18:02:58.557 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : ceph-common-2:18.0.0-4940.g81c9387d.el8.x86_64 3/134 2023-07-14T18:02:58.557 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : ceph-fuse-2:18.0.0-4940.g81c9387d.el8.x86_64 4/134 2023-07-14T18:02:58.557 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : ceph-immutable-object-cache-2:18.0.0-4940.g81c93 5/134 2023-07-14T18:02:58.557 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : ceph-mds-2:18.0.0-4940.g81c9387d.el8.x86_64 6/134 2023-07-14T18:02:58.557 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : ceph-mgr-2:18.0.0-4940.g81c9387d.el8.x86_64 7/134 2023-07-14T18:02:58.557 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : ceph-mon-2:18.0.0-4940.g81c9387d.el8.x86_64 8/134 2023-07-14T18:02:58.558 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : ceph-osd-2:18.0.0-4940.g81c9387d.el8.x86_64 9/134 2023-07-14T18:02:58.558 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : ceph-radosgw-2:18.0.0-4940.g81c9387d.el8.x86_64 10/134 2023-07-14T18:02:58.558 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : ceph-selinux-2:18.0.0-4940.g81c9387d.el8.x86_64 11/134 2023-07-14T18:02:58.558 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : ceph-test-2:18.0.0-4940.g81c9387d.el8.x86_64 12/134 2023-07-14T18:02:58.558 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : cephfs-mirror-2:18.0.0-4940.g81c9387d.el8.x86_64 13/134 2023-07-14T18:02:58.558 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : libcephfs-devel-2:18.0.0-4940.g81c9387d.el8.x86_ 14/134 2023-07-14T18:02:58.558 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : libcephfs2-2:18.0.0-4940.g81c9387d.el8.x86_64 15/134 2023-07-14T18:02:58.559 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : libcephsqlite-2:18.0.0-4940.g81c9387d.el8.x86_64 16/134 2023-07-14T18:02:58.559 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : librados-devel-2:18.0.0-4940.g81c9387d.el8.x86_6 17/134 2023-07-14T18:02:58.559 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : libradosstriper1-2:18.0.0-4940.g81c9387d.el8.x86 18/134 2023-07-14T18:02:58.559 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : librgw2-2:18.0.0-4940.g81c9387d.el8.x86_64 19/134 2023-07-14T18:02:58.559 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-ceph-argparse-2:18.0.0-4940.g81c9387d.el 20/134 2023-07-14T18:02:58.559 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-ceph-common-2:18.0.0-4940.g81c9387d.el8. 21/134 2023-07-14T18:02:58.559 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-cephfs-2:18.0.0-4940.g81c9387d.el8.x86_6 22/134 2023-07-14T18:02:58.560 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-rados-2:18.0.0-4940.g81c9387d.el8.x86_64 23/134 2023-07-14T18:02:58.560 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-rbd-2:18.0.0-4940.g81c9387d.el8.x86_64 24/134 2023-07-14T18:02:58.560 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-rgw-2:18.0.0-4940.g81c9387d.el8.x86_64 25/134 2023-07-14T18:02:58.560 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : rbd-fuse-2:18.0.0-4940.g81c9387d.el8.x86_64 26/134 2023-07-14T18:02:58.560 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : rbd-mirror-2:18.0.0-4940.g81c9387d.el8.x86_64 27/134 2023-07-14T18:02:58.567 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : rbd-nbd-2:18.0.0-4940.g81c9387d.el8.x86_64 28/134 2023-07-14T18:02:58.568 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : ceph-grafana-dashboards-2:18.0.0-4940.g81c9387d. 29/134 2023-07-14T18:02:58.568 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : ceph-mgr-cephadm-2:18.0.0-4940.g81c9387d.el8.noa 30/134 2023-07-14T18:02:58.568 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : ceph-mgr-dashboard-2:18.0.0-4940.g81c9387d.el8.n 31/134 2023-07-14T18:02:58.568 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.0.0-4940.g81c 32/134 2023-07-14T18:02:58.568 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : ceph-mgr-modules-core-2:18.0.0-4940.g81c9387d.el 33/134 2023-07-14T18:02:58.569 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : ceph-mgr-rook-2:18.0.0-4940.g81c9387d.el8.noarch 34/134 2023-07-14T18:02:58.569 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : ceph-prometheus-alerts-2:18.0.0-4940.g81c9387d.e 35/134 2023-07-14T18:02:58.569 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : ceph-volume-2:18.0.0-4940.g81c9387d.el8.noarch 36/134 2023-07-14T18:02:58.569 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : cephadm-2:18.0.0-4940.g81c9387d.el8.noarch 37/134 2023-07-14T18:02:58.569 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : cephfs-top-2:18.0.0-4940.g81c9387d.el8.noarch 38/134 2023-07-14T18:02:58.569 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 39/134 2023-07-14T18:02:58.569 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 40/134 2023-07-14T18:02:58.570 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 41/134 2023-07-14T18:02:58.570 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-asyncssh-2.7.0-2.el8.noarch 42/134 2023-07-14T18:02:58.570 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 43/134 2023-07-14T18:02:58.570 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 44/134 2023-07-14T18:02:58.570 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 45/134 2023-07-14T18:02:58.570 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 46/134 2023-07-14T18:02:58.571 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 47/134 2023-07-14T18:02:58.571 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 48/134 2023-07-14T18:02:58.571 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 49/134 2023-07-14T18:02:58.571 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 50/134 2023-07-14T18:02:58.571 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 51/134 2023-07-14T18:02:58.571 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 52/134 2023-07-14T18:02:58.572 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 53/134 2023-07-14T18:02:58.572 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 54/134 2023-07-14T18:02:58.572 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-natsort-7.1.1-2.el8.noarch 55/134 2023-07-14T18:02:58.572 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 56/134 2023-07-14T18:02:58.572 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-portend-2.6-1.el8.noarch 57/134 2023-07-14T18:02:58.572 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 58/134 2023-07-14T18:02:58.572 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 59/134 2023-07-14T18:02:58.573 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-rsa-4.8-1.el8.noarch 60/134 2023-07-14T18:02:58.573 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 61/134 2023-07-14T18:02:58.573 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 62/134 2023-07-14T18:02:58.573 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 63/134 2023-07-14T18:02:58.573 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 64/134 2023-07-14T18:02:58.573 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 65/134 2023-07-14T18:02:58.574 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 66/134 2023-07-14T18:02:58.574 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 67/134 2023-07-14T18:02:58.574 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 68/134 2023-07-14T18:02:58.574 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 69/134 2023-07-14T18:02:58.575 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : thrift-0.13.0-2.el8.x86_64 70/134 2023-07-14T18:02:58.575 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 71/134 2023-07-14T18:02:58.575 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : librabbitmq-0.9.0-3.el8.x86_64 72/134 2023-07-14T18:02:58.576 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : libselinux-devel-2.9-5.el8.x86_64 73/134 2023-07-14T18:02:58.576 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 74/134 2023-07-14T18:02:58.576 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : pcre2-utf32-10.32-2.el8.x86_64 75/134 2023-07-14T18:02:58.576 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : keyutils-libs-devel-1.5.10-9.el8.x86_64 76/134 2023-07-14T18:02:58.576 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : libsepol-devel-2.9-3.el8.x86_64 77/134 2023-07-14T18:02:58.577 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 78/134 2023-07-14T18:02:58.577 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 79/134 2023-07-14T18:02:58.577 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : pcre2-utf16-10.32-2.el8.x86_64 80/134 2023-07-14T18:02:58.577 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : krb5-devel-1.18.2-14.el8.x86_64 81/134 2023-07-14T18:02:58.577 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 82/134 2023-07-14T18:02:58.577 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 83/134 2023-07-14T18:02:58.578 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-cryptography-3.2.1-5.el8.x86_64 84/134 2023-07-14T18:02:58.578 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : libverto-devel-0.3.0-5.el8.x86_64 85/134 2023-07-14T18:02:58.578 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : pcre2-devel-10.32-2.el8.x86_64 86/134 2023-07-14T18:02:58.578 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-cffi-1.11.5-5.el8.x86_64 87/134 2023-07-14T18:02:58.579 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : openssl-devel-1:1.1.1k-7.el8_6.x86_64 88/134 2023-07-14T18:02:58.579 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : xfsprogs-devel-5.0.0-10.el8.x86_64 89/134 2023-07-14T18:02:58.579 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : fuse-2.9.7-15.el8.x86_64 90/134 2023-07-14T18:02:58.579 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : elfutils-libelf-devel-0.186-1.el8.x86_64 91/134 2023-07-14T18:02:58.579 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : libuuid-devel-2.32.1-35.el8.x86_64 92/134 2023-07-14T18:02:58.579 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : zlib-devel-1.2.11-18.el8_5.x86_64 93/134 2023-07-14T18:02:58.579 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : libcom_err-devel-1.45.6-4.el8.x86_64 94/134 2023-07-14T18:02:58.580 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : libgfortran-8.5.0-10.1.el8_6.x86_64 95/134 2023-07-14T18:02:58.580 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : libquadmath-8.5.0-10.1.el8_6.x86_64 96/134 2023-07-14T18:02:58.580 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : NetworkManager-initscripts-updown-1:1.36.0-9.el8 97/134 2023-07-14T18:02:58.580 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd 98/134 2023-07-14T18:02:58.580 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 99/134 2023-07-14T18:02:58.580 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-pytz-2017.2-9.el8.noarch 100/134 2023-07-14T18:02:58.581 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 101/134 2023-07-14T18:02:58.581 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 102/134 2023-07-14T18:02:58.581 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 103/134 2023-07-14T18:02:58.581 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : bison-3.0.4-10.el8.x86_64 104/134 2023-07-14T18:02:58.581 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-jinja2-2.10.1-3.el8.noarch 105/134 2023-07-14T18:02:58.581 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-mako-1.0.6-13.el8.noarch 106/134 2023-07-14T18:02:58.581 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 107/134 2023-07-14T18:02:58.582 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : automake-1.16.1-7.el8.noarch 108/134 2023-07-14T18:02:58.582 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-babel-2.5.1-7.el8.noarch 109/134 2023-07-14T18:02:58.582 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 110/134 2023-07-14T18:02:58.582 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : flex-2.6.1-9.el8.x86_64 111/134 2023-07-14T18:02:58.582 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 112/134 2023-07-14T18:02:58.582 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-numpy-1:1.14.3-10.el8.x86_64 113/134 2023-07-14T18:02:58.582 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 114/134 2023-07-14T18:02:58.583 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 115/134 2023-07-14T18:02:58.583 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : uuid-1.6.2-43.el8.x86_64 116/134 2023-07-14T18:02:58.583 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 117/134 2023-07-14T18:02:58.583 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 118/134 2023-07-14T18:02:58.583 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 119/134 2023-07-14T18:02:58.583 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : libtool-2.4.6-25.el8.x86_64 120/134 2023-07-14T18:02:58.583 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : openblas-threads-0.3.15-3.el8.x86_64 121/134 2023-07-14T18:02:58.584 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : libpq-13.5-1.el8.x86_64 122/134 2023-07-14T18:02:58.584 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : openblas-0.3.15-3.el8.x86_64 123/134 2023-07-14T18:02:58.584 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : jq-1.6-3.el8.x86_64 124/134 2023-07-14T18:02:58.584 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : librdkafka-0.11.4-3.el8.x86_64 125/134 2023-07-14T18:02:58.584 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : postgresql-server-10.21-2.module+el8.6.0+15342+5 126/134 2023-07-14T18:02:58.584 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : postgresql-contrib-10.21-2.module+el8.6.0+15342+ 127/134 2023-07-14T18:02:58.585 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : postgresql-10.21-2.module+el8.6.0+15342+53518fac 128/134 2023-07-14T18:02:58.585 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : librados2-2:18.0.0-4940.g81c9387d.el8.x86_64 129/134 2023-07-14T18:02:58.585 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 130/134 2023-07-14T18:02:58.585 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : librbd1-2:18.0.0-4940.g81c9387d.el8.x86_64 131/134 2023-07-14T18:02:58.585 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-07-14T18:02:58.585 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : iproute-5.15.0-4.el8_6.1.x86_64 133/134 2023-07-14T18:02:59.620 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: cephadm-2:18.0.0-4940.g81c9387d.el8.noarch 101/134 2023-07-14T18:02:59.839 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : cephadm-2:18.0.0-4940.g81c9387d.el8.noarch 101/134 2023-07-14T18:02:59.985 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : ceph-prometheus-alerts-2:18.0.0-4940.g81c9387d.e 102/134 2023-07-14T18:03:00.193 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : ceph-grafana-dashboards-2:18.0.0-4940.g81c9387d. 103/134 2023-07-14T18:03:00.378 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : ceph-mgr-cephadm-2:18.0.0-4940.g81c9387d.el8.noa 104/134 2023-07-14T18:03:00.595 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.0.0-4940.g81c9387d.el8.noa 104/134 2023-07-14T18:03:00.894 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : ceph-mgr-dashboard-2:18.0.0-4940.g81c9387d.el8.n 105/134 2023-07-14T18:03:01.014 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : iproute-5.15.0-4.el8.x86_64 134/134 2023-07-14T18:03:01.015 INFO:teuthology.orchestra.run.smithi163.stdout:Last metadata expiration check: 0:02:11 ago on Fri 14 Jul 2023 06:00:49 PM UTC. 2023-07-14T18:03:01.853 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.0.0-4940.g81c9387d.el8.n 105/134 2023-07-14T18:03:02.037 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : ceph-mgr-diskprediction-local-2:18.0.0-4940.g81c 106/134 2023-07-14T18:03:02.127 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.0.0-4940.g81c 106/134 2023-07-14T18:03:02.505 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : ceph-mgr-modules-core-2:18.0.0-4940.g81c9387d.el 107/134 2023-07-14T18:03:02.757 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : ceph-mgr-2:18.0.0-4940.g81c9387d.el8.x86_64 108/134 2023-07-14T18:03:02.792 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: ceph-mgr-2:18.0.0-4940.g81c9387d.el8.x86_64 108/134 2023-07-14T18:03:02.953 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : ceph-mgr-rook-2:18.0.0-4940.g81c9387d.el8.noarch 109/134 2023-07-14T18:03:02.964 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: ceph-mgr-rook-2:18.0.0-4940.g81c9387d.el8.noarch 109/134 2023-07-14T18:03:04.276 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : ceph-2:18.0.0-4940.g81c9387d.el8.x86_64 110/134 2023-07-14T18:03:04.512 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : ceph-radosgw-2:18.0.0-4940.g81c9387d.el8.x86_64 111/134 2023-07-14T18:03:04.546 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: ceph-radosgw-2:18.0.0-4940.g81c9387d.el8.x86_64 111/134 2023-07-14T18:03:04.720 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : ceph-immutable-object-cache-2:18.0.0-4940.g81c93 112/134 2023-07-14T18:03:04.761 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.0.0-4940.g81c93 112/134 2023-07-14T18:03:04.945 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : cephfs-mirror-2:18.0.0-4940.g81c9387d.el8.x86_64 113/134 2023-07-14T18:03:05.297 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: cephfs-mirror-2:18.0.0-4940.g81c9387d.el8.x86_64 113/134 2023-07-14T18:03:05.503 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : rbd-mirror-2:18.0.0-4940.g81c9387d.el8.x86_64 114/134 2023-07-14T18:03:07.280 INFO:teuthology.orchestra.run.smithi184.stdout:Installed products updated. 2023-07-14T18:03:07.496 INFO:teuthology.orchestra.run.smithi184.stdout: 2023-07-14T18:03:07.496 INFO:teuthology.orchestra.run.smithi184.stdout:Upgraded: 2023-07-14T18:03:07.496 INFO:teuthology.orchestra.run.smithi184.stdout: iproute-5.15.0-4.el8_6.1.x86_64 2023-07-14T18:03:07.496 INFO:teuthology.orchestra.run.smithi184.stdout: librados2-2:18.0.0-4940.g81c9387d.el8.x86_64 2023-07-14T18:03:07.497 INFO:teuthology.orchestra.run.smithi184.stdout: librbd1-2:18.0.0-4940.g81c9387d.el8.x86_64 2023-07-14T18:03:07.497 INFO:teuthology.orchestra.run.smithi184.stdout:Installed: 2023-07-14T18:03:07.497 INFO:teuthology.orchestra.run.smithi184.stdout: NetworkManager-initscripts-updown-1:1.36.0-9.el8_6.noarch 2023-07-14T18:03:07.497 INFO:teuthology.orchestra.run.smithi184.stdout: automake-1.16.1-7.el8.noarch 2023-07-14T18:03:07.497 INFO:teuthology.orchestra.run.smithi184.stdout: bison-3.0.4-10.el8.x86_64 2023-07-14T18:03:07.497 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-2:18.0.0-4940.g81c9387d.el8.x86_64 2023-07-14T18:03:07.497 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-base-2:18.0.0-4940.g81c9387d.el8.x86_64 2023-07-14T18:03:07.497 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-common-2:18.0.0-4940.g81c9387d.el8.x86_64 2023-07-14T18:03:07.498 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-fuse-2:18.0.0-4940.g81c9387d.el8.x86_64 2023-07-14T18:03:07.498 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-grafana-dashboards-2:18.0.0-4940.g81c9387d.el8.noarch 2023-07-14T18:03:07.498 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-immutable-object-cache-2:18.0.0-4940.g81c9387d.el8.x86_64 2023-07-14T18:03:07.498 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-mds-2:18.0.0-4940.g81c9387d.el8.x86_64 2023-07-14T18:03:07.498 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-mgr-2:18.0.0-4940.g81c9387d.el8.x86_64 2023-07-14T18:03:07.498 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-mgr-cephadm-2:18.0.0-4940.g81c9387d.el8.noarch 2023-07-14T18:03:07.498 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-mgr-dashboard-2:18.0.0-4940.g81c9387d.el8.noarch 2023-07-14T18:03:07.499 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-mgr-diskprediction-local-2:18.0.0-4940.g81c9387d.el8.noarch 2023-07-14T18:03:07.499 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-mgr-modules-core-2:18.0.0-4940.g81c9387d.el8.noarch 2023-07-14T18:03:07.499 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-mgr-rook-2:18.0.0-4940.g81c9387d.el8.noarch 2023-07-14T18:03:07.499 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-mon-2:18.0.0-4940.g81c9387d.el8.x86_64 2023-07-14T18:03:07.499 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-osd-2:18.0.0-4940.g81c9387d.el8.x86_64 2023-07-14T18:03:07.499 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-prometheus-alerts-2:18.0.0-4940.g81c9387d.el8.noarch 2023-07-14T18:03:07.499 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-radosgw-2:18.0.0-4940.g81c9387d.el8.x86_64 2023-07-14T18:03:07.499 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-selinux-2:18.0.0-4940.g81c9387d.el8.x86_64 2023-07-14T18:03:07.500 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-test-2:18.0.0-4940.g81c9387d.el8.x86_64 2023-07-14T18:03:07.500 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-volume-2:18.0.0-4940.g81c9387d.el8.noarch 2023-07-14T18:03:07.500 INFO:teuthology.orchestra.run.smithi184.stdout: cephadm-2:18.0.0-4940.g81c9387d.el8.noarch 2023-07-14T18:03:07.500 INFO:teuthology.orchestra.run.smithi184.stdout: cephfs-mirror-2:18.0.0-4940.g81c9387d.el8.x86_64 2023-07-14T18:03:07.500 INFO:teuthology.orchestra.run.smithi184.stdout: cephfs-top-2:18.0.0-4940.g81c9387d.el8.noarch 2023-07-14T18:03:07.500 INFO:teuthology.orchestra.run.smithi184.stdout: elfutils-libelf-devel-0.186-1.el8.x86_64 2023-07-14T18:03:07.500 INFO:teuthology.orchestra.run.smithi184.stdout: flex-2.6.1-9.el8.x86_64 2023-07-14T18:03:07.501 INFO:teuthology.orchestra.run.smithi184.stdout: fuse-2.9.7-15.el8.x86_64 2023-07-14T18:03:07.501 INFO:teuthology.orchestra.run.smithi184.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2023-07-14T18:03:07.501 INFO:teuthology.orchestra.run.smithi184.stdout: jq-1.6-3.el8.x86_64 2023-07-14T18:03:07.501 INFO:teuthology.orchestra.run.smithi184.stdout: keyutils-libs-devel-1.5.10-9.el8.x86_64 2023-07-14T18:03:07.501 INFO:teuthology.orchestra.run.smithi184.stdout: krb5-devel-1.18.2-14.el8.x86_64 2023-07-14T18:03:07.501 INFO:teuthology.orchestra.run.smithi184.stdout: libaio-devel-0.3.112-1.el8.x86_64 2023-07-14T18:03:07.501 INFO:teuthology.orchestra.run.smithi184.stdout: libcephfs-devel-2:18.0.0-4940.g81c9387d.el8.x86_64 2023-07-14T18:03:07.502 INFO:teuthology.orchestra.run.smithi184.stdout: libcephfs2-2:18.0.0-4940.g81c9387d.el8.x86_64 2023-07-14T18:03:07.502 INFO:teuthology.orchestra.run.smithi184.stdout: libcephsqlite-2:18.0.0-4940.g81c9387d.el8.x86_64 2023-07-14T18:03:07.502 INFO:teuthology.orchestra.run.smithi184.stdout: libcom_err-devel-1.45.6-4.el8.x86_64 2023-07-14T18:03:07.502 INFO:teuthology.orchestra.run.smithi184.stdout: libgfortran-8.5.0-10.1.el8_6.x86_64 2023-07-14T18:03:07.502 INFO:teuthology.orchestra.run.smithi184.stdout: liboath-2.6.2-3.el8.x86_64 2023-07-14T18:03:07.502 INFO:teuthology.orchestra.run.smithi184.stdout: libpq-13.5-1.el8.x86_64 2023-07-14T18:03:07.502 INFO:teuthology.orchestra.run.smithi184.stdout: libquadmath-8.5.0-10.1.el8_6.x86_64 2023-07-14T18:03:07.502 INFO:teuthology.orchestra.run.smithi184.stdout: librabbitmq-0.9.0-3.el8.x86_64 2023-07-14T18:03:07.503 INFO:teuthology.orchestra.run.smithi184.stdout: librados-devel-2:18.0.0-4940.g81c9387d.el8.x86_64 2023-07-14T18:03:07.503 INFO:teuthology.orchestra.run.smithi184.stdout: libradosstriper1-2:18.0.0-4940.g81c9387d.el8.x86_64 2023-07-14T18:03:07.503 INFO:teuthology.orchestra.run.smithi184.stdout: librdkafka-0.11.4-3.el8.x86_64 2023-07-14T18:03:07.503 INFO:teuthology.orchestra.run.smithi184.stdout: librgw2-2:18.0.0-4940.g81c9387d.el8.x86_64 2023-07-14T18:03:07.503 INFO:teuthology.orchestra.run.smithi184.stdout: libselinux-devel-2.9-5.el8.x86_64 2023-07-14T18:03:07.503 INFO:teuthology.orchestra.run.smithi184.stdout: libsepol-devel-2.9-3.el8.x86_64 2023-07-14T18:03:07.503 INFO:teuthology.orchestra.run.smithi184.stdout: libtool-2.4.6-25.el8.x86_64 2023-07-14T18:03:07.503 INFO:teuthology.orchestra.run.smithi184.stdout: libunwind-1.3.1-3.el8.x86_64 2023-07-14T18:03:07.504 INFO:teuthology.orchestra.run.smithi184.stdout: libuuid-devel-2.32.1-35.el8.x86_64 2023-07-14T18:03:07.504 INFO:teuthology.orchestra.run.smithi184.stdout: libverto-devel-0.3.0-5.el8.x86_64 2023-07-14T18:03:07.504 INFO:teuthology.orchestra.run.smithi184.stdout: lttng-ust-2.8.1-11.el8.x86_64 2023-07-14T18:03:07.504 INFO:teuthology.orchestra.run.smithi184.stdout: oniguruma-6.8.2-2.el8.x86_64 2023-07-14T18:03:07.504 INFO:teuthology.orchestra.run.smithi184.stdout: openblas-0.3.15-3.el8.x86_64 2023-07-14T18:03:07.504 INFO:teuthology.orchestra.run.smithi184.stdout: openblas-threads-0.3.15-3.el8.x86_64 2023-07-14T18:03:07.504 INFO:teuthology.orchestra.run.smithi184.stdout: openssl-devel-1:1.1.1k-7.el8_6.x86_64 2023-07-14T18:03:07.505 INFO:teuthology.orchestra.run.smithi184.stdout: pcre2-devel-10.32-2.el8.x86_64 2023-07-14T18:03:07.505 INFO:teuthology.orchestra.run.smithi184.stdout: pcre2-utf16-10.32-2.el8.x86_64 2023-07-14T18:03:07.505 INFO:teuthology.orchestra.run.smithi184.stdout: pcre2-utf32-10.32-2.el8.x86_64 2023-07-14T18:03:07.505 INFO:teuthology.orchestra.run.smithi184.stdout: postgresql-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-07-14T18:03:07.505 INFO:teuthology.orchestra.run.smithi184.stdout: postgresql-contrib-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-07-14T18:03:07.505 INFO:teuthology.orchestra.run.smithi184.stdout: postgresql-server-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-07-14T18:03:07.505 INFO:teuthology.orchestra.run.smithi184.stdout: python3-asyncssh-2.7.0-2.el8.noarch 2023-07-14T18:03:07.505 INFO:teuthology.orchestra.run.smithi184.stdout: python3-babel-2.5.1-7.el8.noarch 2023-07-14T18:03:07.506 INFO:teuthology.orchestra.run.smithi184.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2023-07-14T18:03:07.506 INFO:teuthology.orchestra.run.smithi184.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2023-07-14T18:03:07.506 INFO:teuthology.orchestra.run.smithi184.stdout: python3-cachetools-3.1.1-4.el8.noarch 2023-07-14T18:03:07.506 INFO:teuthology.orchestra.run.smithi184.stdout: python3-ceph-argparse-2:18.0.0-4940.g81c9387d.el8.x86_64 2023-07-14T18:03:07.506 INFO:teuthology.orchestra.run.smithi184.stdout: python3-ceph-common-2:18.0.0-4940.g81c9387d.el8.x86_64 2023-07-14T18:03:07.506 INFO:teuthology.orchestra.run.smithi184.stdout: python3-cephfs-2:18.0.0-4940.g81c9387d.el8.x86_64 2023-07-14T18:03:07.506 INFO:teuthology.orchestra.run.smithi184.stdout: python3-certifi-2018.10.15-7.el8.noarch 2023-07-14T18:03:07.506 INFO:teuthology.orchestra.run.smithi184.stdout: python3-cffi-1.11.5-5.el8.x86_64 2023-07-14T18:03:07.507 INFO:teuthology.orchestra.run.smithi184.stdout: python3-cheroot-8.5.2-1.el8.noarch 2023-07-14T18:03:07.507 INFO:teuthology.orchestra.run.smithi184.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2023-07-14T18:03:07.507 INFO:teuthology.orchestra.run.smithi184.stdout: python3-cryptography-3.2.1-5.el8.x86_64 2023-07-14T18:03:07.507 INFO:teuthology.orchestra.run.smithi184.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2023-07-14T18:03:07.507 INFO:teuthology.orchestra.run.smithi184.stdout: python3-jaraco-6.2-6.el8.noarch 2023-07-14T18:03:07.507 INFO:teuthology.orchestra.run.smithi184.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2023-07-14T18:03:07.507 INFO:teuthology.orchestra.run.smithi184.stdout: python3-jinja2-2.10.1-3.el8.noarch 2023-07-14T18:03:07.508 INFO:teuthology.orchestra.run.smithi184.stdout: python3-jsonpatch-1.21-2.el8.noarch 2023-07-14T18:03:07.508 INFO:teuthology.orchestra.run.smithi184.stdout: python3-jsonpointer-1.10-11.el8.noarch 2023-07-14T18:03:07.508 INFO:teuthology.orchestra.run.smithi184.stdout: python3-jwt-1.6.1-2.el8.noarch 2023-07-14T18:03:07.508 INFO:teuthology.orchestra.run.smithi184.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2023-07-14T18:03:07.508 INFO:teuthology.orchestra.run.smithi184.stdout: python3-logutils-0.3.5-11.el8.noarch 2023-07-14T18:03:07.508 INFO:teuthology.orchestra.run.smithi184.stdout: python3-mako-1.0.6-13.el8.noarch 2023-07-14T18:03:07.508 INFO:teuthology.orchestra.run.smithi184.stdout: python3-markupsafe-0.23-19.el8.x86_64 2023-07-14T18:03:07.509 INFO:teuthology.orchestra.run.smithi184.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2023-07-14T18:03:07.509 INFO:teuthology.orchestra.run.smithi184.stdout: python3-natsort-7.1.1-2.el8.noarch 2023-07-14T18:03:07.509 INFO:teuthology.orchestra.run.smithi184.stdout: python3-numpy-1:1.14.3-10.el8.x86_64 2023-07-14T18:03:07.509 INFO:teuthology.orchestra.run.smithi184.stdout: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 2023-07-14T18:03:07.509 INFO:teuthology.orchestra.run.smithi184.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2023-07-14T18:03:07.509 INFO:teuthology.orchestra.run.smithi184.stdout: python3-pecan-1.3.2-9.el8.noarch 2023-07-14T18:03:07.509 INFO:teuthology.orchestra.run.smithi184.stdout: python3-portend-2.6-1.el8.noarch 2023-07-14T18:03:07.509 INFO:teuthology.orchestra.run.smithi184.stdout: python3-prettytable-0.7.2-14.el8.noarch 2023-07-14T18:03:07.510 INFO:teuthology.orchestra.run.smithi184.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2023-07-14T18:03:07.510 INFO:teuthology.orchestra.run.smithi184.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2023-07-14T18:03:07.510 INFO:teuthology.orchestra.run.smithi184.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2023-07-14T18:03:07.510 INFO:teuthology.orchestra.run.smithi184.stdout: python3-pycparser-2.14-14.el8.noarch 2023-07-14T18:03:07.510 INFO:teuthology.orchestra.run.smithi184.stdout: python3-pytz-2017.2-9.el8.noarch 2023-07-14T18:03:07.510 INFO:teuthology.orchestra.run.smithi184.stdout: python3-rados-2:18.0.0-4940.g81c9387d.el8.x86_64 2023-07-14T18:03:07.510 INFO:teuthology.orchestra.run.smithi184.stdout: python3-rbd-2:18.0.0-4940.g81c9387d.el8.x86_64 2023-07-14T18:03:07.511 INFO:teuthology.orchestra.run.smithi184.stdout: python3-repoze-lru-0.7-6.el8.noarch 2023-07-14T18:03:07.511 INFO:teuthology.orchestra.run.smithi184.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2023-07-14T18:03:07.511 INFO:teuthology.orchestra.run.smithi184.stdout: python3-rgw-2:18.0.0-4940.g81c9387d.el8.x86_64 2023-07-14T18:03:07.511 INFO:teuthology.orchestra.run.smithi184.stdout: python3-routes-2.4.1-12.el8.noarch 2023-07-14T18:03:07.511 INFO:teuthology.orchestra.run.smithi184.stdout: python3-rsa-4.8-1.el8.noarch 2023-07-14T18:03:07.511 INFO:teuthology.orchestra.run.smithi184.stdout: python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd434d.x86_64 2023-07-14T18:03:07.511 INFO:teuthology.orchestra.run.smithi184.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2023-07-14T18:03:07.511 INFO:teuthology.orchestra.run.smithi184.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2023-07-14T18:03:07.512 INFO:teuthology.orchestra.run.smithi184.stdout: python3-tempora-1.14.1-5.el8.noarch 2023-07-14T18:03:07.512 INFO:teuthology.orchestra.run.smithi184.stdout: python3-trustme-0.6.0-4.el8.noarch 2023-07-14T18:03:07.512 INFO:teuthology.orchestra.run.smithi184.stdout: python3-waitress-1.4.3-1.el8.noarch 2023-07-14T18:03:07.512 INFO:teuthology.orchestra.run.smithi184.stdout: python3-webob-1.8.5-1.el8.1.noarch 2023-07-14T18:03:07.512 INFO:teuthology.orchestra.run.smithi184.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2023-07-14T18:03:07.512 INFO:teuthology.orchestra.run.smithi184.stdout: python3-webtest-2.0.33-1.el8.noarch 2023-07-14T18:03:07.512 INFO:teuthology.orchestra.run.smithi184.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2023-07-14T18:03:07.513 INFO:teuthology.orchestra.run.smithi184.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2023-07-14T18:03:07.513 INFO:teuthology.orchestra.run.smithi184.stdout: rbd-fuse-2:18.0.0-4940.g81c9387d.el8.x86_64 2023-07-14T18:03:07.513 INFO:teuthology.orchestra.run.smithi184.stdout: rbd-mirror-2:18.0.0-4940.g81c9387d.el8.x86_64 2023-07-14T18:03:07.513 INFO:teuthology.orchestra.run.smithi184.stdout: rbd-nbd-2:18.0.0-4940.g81c9387d.el8.x86_64 2023-07-14T18:03:07.513 INFO:teuthology.orchestra.run.smithi184.stdout: socat-1.7.4.1-1.el8.x86_64 2023-07-14T18:03:07.513 INFO:teuthology.orchestra.run.smithi184.stdout: thrift-0.13.0-2.el8.x86_64 2023-07-14T18:03:07.513 INFO:teuthology.orchestra.run.smithi184.stdout: uuid-1.6.2-43.el8.x86_64 2023-07-14T18:03:07.513 INFO:teuthology.orchestra.run.smithi184.stdout: xfsprogs-devel-5.0.0-10.el8.x86_64 2023-07-14T18:03:07.514 INFO:teuthology.orchestra.run.smithi184.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2023-07-14T18:03:07.514 INFO:teuthology.orchestra.run.smithi184.stdout: zlib-devel-1.2.11-18.el8_5.x86_64 2023-07-14T18:03:07.514 INFO:teuthology.orchestra.run.smithi184.stdout: 2023-07-14T18:03:07.514 INFO:teuthology.orchestra.run.smithi184.stdout:Complete! 2023-07-14T18:03:08.416 DEBUG:teuthology.parallel:result is None 2023-07-14T18:03:08.913 INFO:teuthology.orchestra.run.smithi163.stdout:Installed products updated. 2023-07-14T18:03:09.126 INFO:teuthology.orchestra.run.smithi163.stdout: 2023-07-14T18:03:09.127 INFO:teuthology.orchestra.run.smithi163.stdout:Upgraded: 2023-07-14T18:03:09.127 INFO:teuthology.orchestra.run.smithi163.stdout: iproute-5.15.0-4.el8_6.1.x86_64 2023-07-14T18:03:09.127 INFO:teuthology.orchestra.run.smithi163.stdout: librados2-2:18.0.0-4940.g81c9387d.el8.x86_64 2023-07-14T18:03:09.127 INFO:teuthology.orchestra.run.smithi163.stdout: librbd1-2:18.0.0-4940.g81c9387d.el8.x86_64 2023-07-14T18:03:09.127 INFO:teuthology.orchestra.run.smithi163.stdout:Installed: 2023-07-14T18:03:09.127 INFO:teuthology.orchestra.run.smithi163.stdout: NetworkManager-initscripts-updown-1:1.36.0-9.el8_6.noarch 2023-07-14T18:03:09.127 INFO:teuthology.orchestra.run.smithi163.stdout: automake-1.16.1-7.el8.noarch 2023-07-14T18:03:09.128 INFO:teuthology.orchestra.run.smithi163.stdout: bison-3.0.4-10.el8.x86_64 2023-07-14T18:03:09.128 INFO:teuthology.orchestra.run.smithi163.stdout: ceph-2:18.0.0-4940.g81c9387d.el8.x86_64 2023-07-14T18:03:09.128 INFO:teuthology.orchestra.run.smithi163.stdout: ceph-base-2:18.0.0-4940.g81c9387d.el8.x86_64 2023-07-14T18:03:09.128 INFO:teuthology.orchestra.run.smithi163.stdout: ceph-common-2:18.0.0-4940.g81c9387d.el8.x86_64 2023-07-14T18:03:09.128 INFO:teuthology.orchestra.run.smithi163.stdout: ceph-fuse-2:18.0.0-4940.g81c9387d.el8.x86_64 2023-07-14T18:03:09.129 INFO:teuthology.orchestra.run.smithi163.stdout: ceph-grafana-dashboards-2:18.0.0-4940.g81c9387d.el8.noarch 2023-07-14T18:03:09.129 INFO:teuthology.orchestra.run.smithi163.stdout: ceph-immutable-object-cache-2:18.0.0-4940.g81c9387d.el8.x86_64 2023-07-14T18:03:09.129 INFO:teuthology.orchestra.run.smithi163.stdout: ceph-mds-2:18.0.0-4940.g81c9387d.el8.x86_64 2023-07-14T18:03:09.129 INFO:teuthology.orchestra.run.smithi163.stdout: ceph-mgr-2:18.0.0-4940.g81c9387d.el8.x86_64 2023-07-14T18:03:09.129 INFO:teuthology.orchestra.run.smithi163.stdout: ceph-mgr-cephadm-2:18.0.0-4940.g81c9387d.el8.noarch 2023-07-14T18:03:09.129 INFO:teuthology.orchestra.run.smithi163.stdout: ceph-mgr-dashboard-2:18.0.0-4940.g81c9387d.el8.noarch 2023-07-14T18:03:09.130 INFO:teuthology.orchestra.run.smithi163.stdout: ceph-mgr-diskprediction-local-2:18.0.0-4940.g81c9387d.el8.noarch 2023-07-14T18:03:09.130 INFO:teuthology.orchestra.run.smithi163.stdout: ceph-mgr-modules-core-2:18.0.0-4940.g81c9387d.el8.noarch 2023-07-14T18:03:09.130 INFO:teuthology.orchestra.run.smithi163.stdout: ceph-mgr-rook-2:18.0.0-4940.g81c9387d.el8.noarch 2023-07-14T18:03:09.130 INFO:teuthology.orchestra.run.smithi163.stdout: ceph-mon-2:18.0.0-4940.g81c9387d.el8.x86_64 2023-07-14T18:03:09.130 INFO:teuthology.orchestra.run.smithi163.stdout: ceph-osd-2:18.0.0-4940.g81c9387d.el8.x86_64 2023-07-14T18:03:09.130 INFO:teuthology.orchestra.run.smithi163.stdout: ceph-prometheus-alerts-2:18.0.0-4940.g81c9387d.el8.noarch 2023-07-14T18:03:09.130 INFO:teuthology.orchestra.run.smithi163.stdout: ceph-radosgw-2:18.0.0-4940.g81c9387d.el8.x86_64 2023-07-14T18:03:09.130 INFO:teuthology.orchestra.run.smithi163.stdout: ceph-selinux-2:18.0.0-4940.g81c9387d.el8.x86_64 2023-07-14T18:03:09.131 INFO:teuthology.orchestra.run.smithi163.stdout: ceph-test-2:18.0.0-4940.g81c9387d.el8.x86_64 2023-07-14T18:03:09.131 INFO:teuthology.orchestra.run.smithi163.stdout: ceph-volume-2:18.0.0-4940.g81c9387d.el8.noarch 2023-07-14T18:03:09.131 INFO:teuthology.orchestra.run.smithi163.stdout: cephadm-2:18.0.0-4940.g81c9387d.el8.noarch 2023-07-14T18:03:09.131 INFO:teuthology.orchestra.run.smithi163.stdout: cephfs-mirror-2:18.0.0-4940.g81c9387d.el8.x86_64 2023-07-14T18:03:09.131 INFO:teuthology.orchestra.run.smithi163.stdout: cephfs-top-2:18.0.0-4940.g81c9387d.el8.noarch 2023-07-14T18:03:09.131 INFO:teuthology.orchestra.run.smithi163.stdout: elfutils-libelf-devel-0.186-1.el8.x86_64 2023-07-14T18:03:09.131 INFO:teuthology.orchestra.run.smithi163.stdout: flex-2.6.1-9.el8.x86_64 2023-07-14T18:03:09.131 INFO:teuthology.orchestra.run.smithi163.stdout: fuse-2.9.7-15.el8.x86_64 2023-07-14T18:03:09.132 INFO:teuthology.orchestra.run.smithi163.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2023-07-14T18:03:09.132 INFO:teuthology.orchestra.run.smithi163.stdout: jq-1.6-3.el8.x86_64 2023-07-14T18:03:09.132 INFO:teuthology.orchestra.run.smithi163.stdout: keyutils-libs-devel-1.5.10-9.el8.x86_64 2023-07-14T18:03:09.132 INFO:teuthology.orchestra.run.smithi163.stdout: krb5-devel-1.18.2-14.el8.x86_64 2023-07-14T18:03:09.132 INFO:teuthology.orchestra.run.smithi163.stdout: libaio-devel-0.3.112-1.el8.x86_64 2023-07-14T18:03:09.132 INFO:teuthology.orchestra.run.smithi163.stdout: libcephfs-devel-2:18.0.0-4940.g81c9387d.el8.x86_64 2023-07-14T18:03:09.132 INFO:teuthology.orchestra.run.smithi163.stdout: libcephfs2-2:18.0.0-4940.g81c9387d.el8.x86_64 2023-07-14T18:03:09.133 INFO:teuthology.orchestra.run.smithi163.stdout: libcephsqlite-2:18.0.0-4940.g81c9387d.el8.x86_64 2023-07-14T18:03:09.133 INFO:teuthology.orchestra.run.smithi163.stdout: libcom_err-devel-1.45.6-4.el8.x86_64 2023-07-14T18:03:09.133 INFO:teuthology.orchestra.run.smithi163.stdout: libgfortran-8.5.0-10.1.el8_6.x86_64 2023-07-14T18:03:09.133 INFO:teuthology.orchestra.run.smithi163.stdout: liboath-2.6.2-3.el8.x86_64 2023-07-14T18:03:09.133 INFO:teuthology.orchestra.run.smithi163.stdout: libpq-13.5-1.el8.x86_64 2023-07-14T18:03:09.133 INFO:teuthology.orchestra.run.smithi163.stdout: libquadmath-8.5.0-10.1.el8_6.x86_64 2023-07-14T18:03:09.133 INFO:teuthology.orchestra.run.smithi163.stdout: librabbitmq-0.9.0-3.el8.x86_64 2023-07-14T18:03:09.133 INFO:teuthology.orchestra.run.smithi163.stdout: librados-devel-2:18.0.0-4940.g81c9387d.el8.x86_64 2023-07-14T18:03:09.134 INFO:teuthology.orchestra.run.smithi163.stdout: libradosstriper1-2:18.0.0-4940.g81c9387d.el8.x86_64 2023-07-14T18:03:09.134 INFO:teuthology.orchestra.run.smithi163.stdout: librdkafka-0.11.4-3.el8.x86_64 2023-07-14T18:03:09.134 INFO:teuthology.orchestra.run.smithi163.stdout: librgw2-2:18.0.0-4940.g81c9387d.el8.x86_64 2023-07-14T18:03:09.134 INFO:teuthology.orchestra.run.smithi163.stdout: libselinux-devel-2.9-5.el8.x86_64 2023-07-14T18:03:09.134 INFO:teuthology.orchestra.run.smithi163.stdout: libsepol-devel-2.9-3.el8.x86_64 2023-07-14T18:03:09.134 INFO:teuthology.orchestra.run.smithi163.stdout: libtool-2.4.6-25.el8.x86_64 2023-07-14T18:03:09.134 INFO:teuthology.orchestra.run.smithi163.stdout: libunwind-1.3.1-3.el8.x86_64 2023-07-14T18:03:09.135 INFO:teuthology.orchestra.run.smithi163.stdout: libuuid-devel-2.32.1-35.el8.x86_64 2023-07-14T18:03:09.135 INFO:teuthology.orchestra.run.smithi163.stdout: libverto-devel-0.3.0-5.el8.x86_64 2023-07-14T18:03:09.135 INFO:teuthology.orchestra.run.smithi163.stdout: lttng-ust-2.8.1-11.el8.x86_64 2023-07-14T18:03:09.135 INFO:teuthology.orchestra.run.smithi163.stdout: oniguruma-6.8.2-2.el8.x86_64 2023-07-14T18:03:09.135 INFO:teuthology.orchestra.run.smithi163.stdout: openblas-0.3.15-3.el8.x86_64 2023-07-14T18:03:09.135 INFO:teuthology.orchestra.run.smithi163.stdout: openblas-threads-0.3.15-3.el8.x86_64 2023-07-14T18:03:09.136 INFO:teuthology.orchestra.run.smithi163.stdout: openssl-devel-1:1.1.1k-7.el8_6.x86_64 2023-07-14T18:03:09.136 INFO:teuthology.orchestra.run.smithi163.stdout: pcre2-devel-10.32-2.el8.x86_64 2023-07-14T18:03:09.136 INFO:teuthology.orchestra.run.smithi163.stdout: pcre2-utf16-10.32-2.el8.x86_64 2023-07-14T18:03:09.136 INFO:teuthology.orchestra.run.smithi163.stdout: pcre2-utf32-10.32-2.el8.x86_64 2023-07-14T18:03:09.136 INFO:teuthology.orchestra.run.smithi163.stdout: postgresql-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-07-14T18:03:09.136 INFO:teuthology.orchestra.run.smithi163.stdout: postgresql-contrib-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-07-14T18:03:09.136 INFO:teuthology.orchestra.run.smithi163.stdout: postgresql-server-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-07-14T18:03:09.137 INFO:teuthology.orchestra.run.smithi163.stdout: python3-asyncssh-2.7.0-2.el8.noarch 2023-07-14T18:03:09.137 INFO:teuthology.orchestra.run.smithi163.stdout: python3-babel-2.5.1-7.el8.noarch 2023-07-14T18:03:09.137 INFO:teuthology.orchestra.run.smithi163.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2023-07-14T18:03:09.137 INFO:teuthology.orchestra.run.smithi163.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2023-07-14T18:03:09.137 INFO:teuthology.orchestra.run.smithi163.stdout: python3-cachetools-3.1.1-4.el8.noarch 2023-07-14T18:03:09.137 INFO:teuthology.orchestra.run.smithi163.stdout: python3-ceph-argparse-2:18.0.0-4940.g81c9387d.el8.x86_64 2023-07-14T18:03:09.137 INFO:teuthology.orchestra.run.smithi163.stdout: python3-ceph-common-2:18.0.0-4940.g81c9387d.el8.x86_64 2023-07-14T18:03:09.137 INFO:teuthology.orchestra.run.smithi163.stdout: python3-cephfs-2:18.0.0-4940.g81c9387d.el8.x86_64 2023-07-14T18:03:09.138 INFO:teuthology.orchestra.run.smithi163.stdout: python3-certifi-2018.10.15-7.el8.noarch 2023-07-14T18:03:09.138 INFO:teuthology.orchestra.run.smithi163.stdout: python3-cffi-1.11.5-5.el8.x86_64 2023-07-14T18:03:09.138 INFO:teuthology.orchestra.run.smithi163.stdout: python3-cheroot-8.5.2-1.el8.noarch 2023-07-14T18:03:09.138 INFO:teuthology.orchestra.run.smithi163.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2023-07-14T18:03:09.138 INFO:teuthology.orchestra.run.smithi163.stdout: python3-cryptography-3.2.1-5.el8.x86_64 2023-07-14T18:03:09.138 INFO:teuthology.orchestra.run.smithi163.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2023-07-14T18:03:09.138 INFO:teuthology.orchestra.run.smithi163.stdout: python3-jaraco-6.2-6.el8.noarch 2023-07-14T18:03:09.138 INFO:teuthology.orchestra.run.smithi163.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2023-07-14T18:03:09.139 INFO:teuthology.orchestra.run.smithi163.stdout: python3-jinja2-2.10.1-3.el8.noarch 2023-07-14T18:03:09.139 INFO:teuthology.orchestra.run.smithi163.stdout: python3-jsonpatch-1.21-2.el8.noarch 2023-07-14T18:03:09.139 INFO:teuthology.orchestra.run.smithi163.stdout: python3-jsonpointer-1.10-11.el8.noarch 2023-07-14T18:03:09.139 INFO:teuthology.orchestra.run.smithi163.stdout: python3-jwt-1.6.1-2.el8.noarch 2023-07-14T18:03:09.139 INFO:teuthology.orchestra.run.smithi163.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2023-07-14T18:03:09.139 INFO:teuthology.orchestra.run.smithi163.stdout: python3-logutils-0.3.5-11.el8.noarch 2023-07-14T18:03:09.139 INFO:teuthology.orchestra.run.smithi163.stdout: python3-mako-1.0.6-13.el8.noarch 2023-07-14T18:03:09.140 INFO:teuthology.orchestra.run.smithi163.stdout: python3-markupsafe-0.23-19.el8.x86_64 2023-07-14T18:03:09.140 INFO:teuthology.orchestra.run.smithi163.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2023-07-14T18:03:09.140 INFO:teuthology.orchestra.run.smithi163.stdout: python3-natsort-7.1.1-2.el8.noarch 2023-07-14T18:03:09.140 INFO:teuthology.orchestra.run.smithi163.stdout: python3-numpy-1:1.14.3-10.el8.x86_64 2023-07-14T18:03:09.140 INFO:teuthology.orchestra.run.smithi163.stdout: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 2023-07-14T18:03:09.140 INFO:teuthology.orchestra.run.smithi163.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2023-07-14T18:03:09.140 INFO:teuthology.orchestra.run.smithi163.stdout: python3-pecan-1.3.2-9.el8.noarch 2023-07-14T18:03:09.140 INFO:teuthology.orchestra.run.smithi163.stdout: python3-portend-2.6-1.el8.noarch 2023-07-14T18:03:09.141 INFO:teuthology.orchestra.run.smithi163.stdout: python3-prettytable-0.7.2-14.el8.noarch 2023-07-14T18:03:09.141 INFO:teuthology.orchestra.run.smithi163.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2023-07-14T18:03:09.141 INFO:teuthology.orchestra.run.smithi163.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2023-07-14T18:03:09.141 INFO:teuthology.orchestra.run.smithi163.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2023-07-14T18:03:09.141 INFO:teuthology.orchestra.run.smithi163.stdout: python3-pycparser-2.14-14.el8.noarch 2023-07-14T18:03:09.141 INFO:teuthology.orchestra.run.smithi163.stdout: python3-pytz-2017.2-9.el8.noarch 2023-07-14T18:03:09.141 INFO:teuthology.orchestra.run.smithi163.stdout: python3-rados-2:18.0.0-4940.g81c9387d.el8.x86_64 2023-07-14T18:03:09.142 INFO:teuthology.orchestra.run.smithi163.stdout: python3-rbd-2:18.0.0-4940.g81c9387d.el8.x86_64 2023-07-14T18:03:09.142 INFO:teuthology.orchestra.run.smithi163.stdout: python3-repoze-lru-0.7-6.el8.noarch 2023-07-14T18:03:09.142 INFO:teuthology.orchestra.run.smithi163.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2023-07-14T18:03:09.142 INFO:teuthology.orchestra.run.smithi163.stdout: python3-rgw-2:18.0.0-4940.g81c9387d.el8.x86_64 2023-07-14T18:03:09.142 INFO:teuthology.orchestra.run.smithi163.stdout: python3-routes-2.4.1-12.el8.noarch 2023-07-14T18:03:09.142 INFO:teuthology.orchestra.run.smithi163.stdout: python3-rsa-4.8-1.el8.noarch 2023-07-14T18:03:09.142 INFO:teuthology.orchestra.run.smithi163.stdout: python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd434d.x86_64 2023-07-14T18:03:09.142 INFO:teuthology.orchestra.run.smithi163.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2023-07-14T18:03:09.143 INFO:teuthology.orchestra.run.smithi163.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2023-07-14T18:03:09.143 INFO:teuthology.orchestra.run.smithi163.stdout: python3-tempora-1.14.1-5.el8.noarch 2023-07-14T18:03:09.143 INFO:teuthology.orchestra.run.smithi163.stdout: python3-trustme-0.6.0-4.el8.noarch 2023-07-14T18:03:09.143 INFO:teuthology.orchestra.run.smithi163.stdout: python3-waitress-1.4.3-1.el8.noarch 2023-07-14T18:03:09.143 INFO:teuthology.orchestra.run.smithi163.stdout: python3-webob-1.8.5-1.el8.1.noarch 2023-07-14T18:03:09.143 INFO:teuthology.orchestra.run.smithi163.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2023-07-14T18:03:09.143 INFO:teuthology.orchestra.run.smithi163.stdout: python3-webtest-2.0.33-1.el8.noarch 2023-07-14T18:03:09.143 INFO:teuthology.orchestra.run.smithi163.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2023-07-14T18:03:09.144 INFO:teuthology.orchestra.run.smithi163.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2023-07-14T18:03:09.144 INFO:teuthology.orchestra.run.smithi163.stdout: rbd-fuse-2:18.0.0-4940.g81c9387d.el8.x86_64 2023-07-14T18:03:09.144 INFO:teuthology.orchestra.run.smithi163.stdout: rbd-mirror-2:18.0.0-4940.g81c9387d.el8.x86_64 2023-07-14T18:03:09.144 INFO:teuthology.orchestra.run.smithi163.stdout: rbd-nbd-2:18.0.0-4940.g81c9387d.el8.x86_64 2023-07-14T18:03:09.144 INFO:teuthology.orchestra.run.smithi163.stdout: socat-1.7.4.1-1.el8.x86_64 2023-07-14T18:03:09.144 INFO:teuthology.orchestra.run.smithi163.stdout: thrift-0.13.0-2.el8.x86_64 2023-07-14T18:03:09.144 INFO:teuthology.orchestra.run.smithi163.stdout: uuid-1.6.2-43.el8.x86_64 2023-07-14T18:03:09.145 INFO:teuthology.orchestra.run.smithi163.stdout: xfsprogs-devel-5.0.0-10.el8.x86_64 2023-07-14T18:03:09.145 INFO:teuthology.orchestra.run.smithi163.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2023-07-14T18:03:09.145 INFO:teuthology.orchestra.run.smithi163.stdout: zlib-devel-1.2.11-18.el8_5.x86_64 2023-07-14T18:03:09.145 INFO:teuthology.orchestra.run.smithi163.stdout: 2023-07-14T18:03:09.146 INFO:teuthology.orchestra.run.smithi163.stdout:Complete! 2023-07-14T18:03:09.356 DEBUG:teuthology.parallel:result is None 2023-07-14T18:03:10.059 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: rbd-mirror-2:18.0.0-4940.g81c9387d.el8.x86_64 114/134 2023-07-14T18:03:10.328 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : ceph-test-2:18.0.0-4940.g81c9387d.el8.x86_64 115/134 2023-07-14T18:03:10.494 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : libtool-2.4.6-25.el8.x86_64 116/134 2023-07-14T18:03:10.685 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: libtool-2.4.6-25.el8.x86_64 116/134 2023-07-14T18:03:11.594 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : postgresql-contrib-10.21-2.module+el8.6.0+15342+ 117/134 2023-07-14T18:03:11.959 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : openssl-devel-1:1.1.1k-7.el8_6.x86_64 118/134 2023-07-14T18:03:12.146 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : ceph-fuse-2:18.0.0-4940.g81c9387d.el8.x86_64 119/134 2023-07-14T18:03:12.348 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : xfsprogs-devel-5.0.0-10.el8.x86_64 120/134 2023-07-14T18:03:12.522 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : libcephfs-devel-2:18.0.0-4940.g81c9387d.el8.x86_ 121/134 2023-07-14T18:03:12.678 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : elfutils-libelf-devel-0.186-1.el8.x86_64 122/134 2023-07-14T18:03:14.853 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-07-14T18:03:15.110 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-07-14T18:03:15.128 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-07-14T18:03:15.286 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : cephfs-top-2:18.0.0-4940.g81c9387d.el8.noarch 124/134 2023-07-14T18:03:15.617 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : rbd-fuse-2:18.0.0-4940.g81c9387d.el8.x86_64 125/134 2023-07-14T18:03:15.902 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : rbd-nbd-2:18.0.0-4940.g81c9387d.el8.x86_64 126/134 2023-07-14T18:03:16.211 INFO:teuthology.orchestra.run.smithi172.stdout: Upgrading : iproute-5.15.0-4.el8_6.1.x86_64 127/134 2023-07-14T18:03:16.376 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : NetworkManager-initscripts-updown-1:1.36.0-9.el8 128/134 2023-07-14T18:03:16.385 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: NetworkManager-initscripts-updown-1:1.36.0-9.el8 128/134 2023-07-14T18:03:16.615 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 129/134 2023-07-14T18:03:16.817 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : flex-2.6.1-9.el8.x86_64 130/134 2023-07-14T18:03:16.901 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 130/134 2023-07-14T18:03:17.101 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : bison-3.0.4-10.el8.x86_64 131/134 2023-07-14T18:03:17.114 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 131/134 2023-07-14T18:03:17.114 INFO:teuthology.orchestra.run.smithi172.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-07-14T18:03:17.312 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-07-14T18:03:17.313 INFO:teuthology.orchestra.run.smithi172.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 133/134 2023-07-14T18:03:17.598 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 133/134 2023-07-14T18:03:17.816 INFO:teuthology.orchestra.run.smithi172.stdout: Cleanup : iproute-5.15.0-4.el8.x86_64 134/134 2023-07-14T18:03:18.364 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: iproute-5.15.0-4.el8.x86_64 134/134 2023-07-14T18:03:18.364 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : ceph-2:18.0.0-4940.g81c9387d.el8.x86_64 1/134 2023-07-14T18:03:18.364 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : ceph-base-2:18.0.0-4940.g81c9387d.el8.x86_64 2/134 2023-07-14T18:03:18.364 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : ceph-common-2:18.0.0-4940.g81c9387d.el8.x86_64 3/134 2023-07-14T18:03:18.365 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : ceph-fuse-2:18.0.0-4940.g81c9387d.el8.x86_64 4/134 2023-07-14T18:03:18.365 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : ceph-immutable-object-cache-2:18.0.0-4940.g81c93 5/134 2023-07-14T18:03:18.365 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : ceph-mds-2:18.0.0-4940.g81c9387d.el8.x86_64 6/134 2023-07-14T18:03:18.365 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : ceph-mgr-2:18.0.0-4940.g81c9387d.el8.x86_64 7/134 2023-07-14T18:03:18.365 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : ceph-mon-2:18.0.0-4940.g81c9387d.el8.x86_64 8/134 2023-07-14T18:03:18.365 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : ceph-osd-2:18.0.0-4940.g81c9387d.el8.x86_64 9/134 2023-07-14T18:03:18.365 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : ceph-radosgw-2:18.0.0-4940.g81c9387d.el8.x86_64 10/134 2023-07-14T18:03:18.365 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : ceph-selinux-2:18.0.0-4940.g81c9387d.el8.x86_64 11/134 2023-07-14T18:03:18.366 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : ceph-test-2:18.0.0-4940.g81c9387d.el8.x86_64 12/134 2023-07-14T18:03:18.366 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : cephfs-mirror-2:18.0.0-4940.g81c9387d.el8.x86_64 13/134 2023-07-14T18:03:18.366 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : libcephfs-devel-2:18.0.0-4940.g81c9387d.el8.x86_ 14/134 2023-07-14T18:03:18.366 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : libcephfs2-2:18.0.0-4940.g81c9387d.el8.x86_64 15/134 2023-07-14T18:03:18.366 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : libcephsqlite-2:18.0.0-4940.g81c9387d.el8.x86_64 16/134 2023-07-14T18:03:18.366 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : librados-devel-2:18.0.0-4940.g81c9387d.el8.x86_6 17/134 2023-07-14T18:03:18.366 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : libradosstriper1-2:18.0.0-4940.g81c9387d.el8.x86 18/134 2023-07-14T18:03:18.367 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : librgw2-2:18.0.0-4940.g81c9387d.el8.x86_64 19/134 2023-07-14T18:03:18.367 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-ceph-argparse-2:18.0.0-4940.g81c9387d.el 20/134 2023-07-14T18:03:18.367 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-ceph-common-2:18.0.0-4940.g81c9387d.el8. 21/134 2023-07-14T18:03:18.367 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-cephfs-2:18.0.0-4940.g81c9387d.el8.x86_6 22/134 2023-07-14T18:03:18.367 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-rados-2:18.0.0-4940.g81c9387d.el8.x86_64 23/134 2023-07-14T18:03:18.367 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-rbd-2:18.0.0-4940.g81c9387d.el8.x86_64 24/134 2023-07-14T18:03:18.367 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-rgw-2:18.0.0-4940.g81c9387d.el8.x86_64 25/134 2023-07-14T18:03:18.368 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : rbd-fuse-2:18.0.0-4940.g81c9387d.el8.x86_64 26/134 2023-07-14T18:03:18.368 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : rbd-mirror-2:18.0.0-4940.g81c9387d.el8.x86_64 27/134 2023-07-14T18:03:18.368 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : rbd-nbd-2:18.0.0-4940.g81c9387d.el8.x86_64 28/134 2023-07-14T18:03:18.368 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : ceph-grafana-dashboards-2:18.0.0-4940.g81c9387d. 29/134 2023-07-14T18:03:18.369 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : ceph-mgr-cephadm-2:18.0.0-4940.g81c9387d.el8.noa 30/134 2023-07-14T18:03:18.375 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : ceph-mgr-dashboard-2:18.0.0-4940.g81c9387d.el8.n 31/134 2023-07-14T18:03:18.376 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.0.0-4940.g81c 32/134 2023-07-14T18:03:18.376 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : ceph-mgr-modules-core-2:18.0.0-4940.g81c9387d.el 33/134 2023-07-14T18:03:18.376 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : ceph-mgr-rook-2:18.0.0-4940.g81c9387d.el8.noarch 34/134 2023-07-14T18:03:18.376 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : ceph-prometheus-alerts-2:18.0.0-4940.g81c9387d.e 35/134 2023-07-14T18:03:18.376 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : ceph-volume-2:18.0.0-4940.g81c9387d.el8.noarch 36/134 2023-07-14T18:03:18.376 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : cephadm-2:18.0.0-4940.g81c9387d.el8.noarch 37/134 2023-07-14T18:03:18.376 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : cephfs-top-2:18.0.0-4940.g81c9387d.el8.noarch 38/134 2023-07-14T18:03:18.377 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 39/134 2023-07-14T18:03:18.377 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 40/134 2023-07-14T18:03:18.377 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 41/134 2023-07-14T18:03:18.377 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-asyncssh-2.7.0-2.el8.noarch 42/134 2023-07-14T18:03:18.377 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 43/134 2023-07-14T18:03:18.377 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 44/134 2023-07-14T18:03:18.377 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 45/134 2023-07-14T18:03:18.378 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 46/134 2023-07-14T18:03:18.378 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 47/134 2023-07-14T18:03:18.378 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 48/134 2023-07-14T18:03:18.378 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 49/134 2023-07-14T18:03:18.378 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 50/134 2023-07-14T18:03:18.378 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 51/134 2023-07-14T18:03:18.378 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 52/134 2023-07-14T18:03:18.378 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 53/134 2023-07-14T18:03:18.379 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 54/134 2023-07-14T18:03:18.379 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-natsort-7.1.1-2.el8.noarch 55/134 2023-07-14T18:03:18.379 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 56/134 2023-07-14T18:03:18.379 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-portend-2.6-1.el8.noarch 57/134 2023-07-14T18:03:18.379 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 58/134 2023-07-14T18:03:18.379 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 59/134 2023-07-14T18:03:18.379 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-rsa-4.8-1.el8.noarch 60/134 2023-07-14T18:03:18.379 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 61/134 2023-07-14T18:03:18.380 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 62/134 2023-07-14T18:03:18.380 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 63/134 2023-07-14T18:03:18.380 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 64/134 2023-07-14T18:03:18.380 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 65/134 2023-07-14T18:03:18.380 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 66/134 2023-07-14T18:03:18.380 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 67/134 2023-07-14T18:03:18.380 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 68/134 2023-07-14T18:03:18.381 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 69/134 2023-07-14T18:03:18.381 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : thrift-0.13.0-2.el8.x86_64 70/134 2023-07-14T18:03:18.381 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 71/134 2023-07-14T18:03:18.381 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd 72/134 2023-07-14T18:03:18.381 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 73/134 2023-07-14T18:03:18.381 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-pytz-2017.2-9.el8.noarch 74/134 2023-07-14T18:03:18.381 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 75/134 2023-07-14T18:03:18.382 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 76/134 2023-07-14T18:03:18.382 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 77/134 2023-07-14T18:03:18.382 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : bison-3.0.4-10.el8.x86_64 78/134 2023-07-14T18:03:18.382 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-jinja2-2.10.1-3.el8.noarch 79/134 2023-07-14T18:03:18.382 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-mako-1.0.6-13.el8.noarch 80/134 2023-07-14T18:03:18.382 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 81/134 2023-07-14T18:03:18.382 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : automake-1.16.1-7.el8.noarch 82/134 2023-07-14T18:03:18.382 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-babel-2.5.1-7.el8.noarch 83/134 2023-07-14T18:03:18.383 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 84/134 2023-07-14T18:03:18.383 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : flex-2.6.1-9.el8.x86_64 85/134 2023-07-14T18:03:18.383 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 86/134 2023-07-14T18:03:18.383 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-numpy-1:1.14.3-10.el8.x86_64 87/134 2023-07-14T18:03:18.383 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 88/134 2023-07-14T18:03:18.383 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 89/134 2023-07-14T18:03:18.383 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : uuid-1.6.2-43.el8.x86_64 90/134 2023-07-14T18:03:18.383 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 91/134 2023-07-14T18:03:18.384 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 92/134 2023-07-14T18:03:18.384 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 93/134 2023-07-14T18:03:18.384 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : libtool-2.4.6-25.el8.x86_64 94/134 2023-07-14T18:03:18.384 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : openblas-threads-0.3.15-3.el8.x86_64 95/134 2023-07-14T18:03:18.384 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : libpq-13.5-1.el8.x86_64 96/134 2023-07-14T18:03:18.384 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : openblas-0.3.15-3.el8.x86_64 97/134 2023-07-14T18:03:18.384 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : jq-1.6-3.el8.x86_64 98/134 2023-07-14T18:03:18.385 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : librdkafka-0.11.4-3.el8.x86_64 99/134 2023-07-14T18:03:18.385 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : postgresql-server-10.21-2.module+el8.6.0+15342+5 100/134 2023-07-14T18:03:18.385 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : postgresql-contrib-10.21-2.module+el8.6.0+15342+ 101/134 2023-07-14T18:03:18.385 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : postgresql-10.21-2.module+el8.6.0+15342+53518fac 102/134 2023-07-14T18:03:18.385 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : librabbitmq-0.9.0-3.el8.x86_64 103/134 2023-07-14T18:03:18.385 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : libselinux-devel-2.9-5.el8.x86_64 104/134 2023-07-14T18:03:18.385 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 105/134 2023-07-14T18:03:18.385 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : pcre2-utf32-10.32-2.el8.x86_64 106/134 2023-07-14T18:03:18.386 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : keyutils-libs-devel-1.5.10-9.el8.x86_64 107/134 2023-07-14T18:03:18.386 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : libsepol-devel-2.9-3.el8.x86_64 108/134 2023-07-14T18:03:18.386 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 109/134 2023-07-14T18:03:18.386 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 110/134 2023-07-14T18:03:18.386 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : pcre2-utf16-10.32-2.el8.x86_64 111/134 2023-07-14T18:03:18.386 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : krb5-devel-1.18.2-14.el8.x86_64 112/134 2023-07-14T18:03:18.386 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 113/134 2023-07-14T18:03:18.386 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 114/134 2023-07-14T18:03:18.387 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-cryptography-3.2.1-5.el8.x86_64 115/134 2023-07-14T18:03:18.387 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : libverto-devel-0.3.0-5.el8.x86_64 116/134 2023-07-14T18:03:18.387 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : pcre2-devel-10.32-2.el8.x86_64 117/134 2023-07-14T18:03:18.387 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-cffi-1.11.5-5.el8.x86_64 118/134 2023-07-14T18:03:18.387 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : openssl-devel-1:1.1.1k-7.el8_6.x86_64 119/134 2023-07-14T18:03:18.387 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : xfsprogs-devel-5.0.0-10.el8.x86_64 120/134 2023-07-14T18:03:18.387 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : fuse-2.9.7-15.el8.x86_64 121/134 2023-07-14T18:03:18.388 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : elfutils-libelf-devel-0.186-1.el8.x86_64 122/134 2023-07-14T18:03:18.388 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : libuuid-devel-2.32.1-35.el8.x86_64 123/134 2023-07-14T18:03:18.388 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : zlib-devel-1.2.11-18.el8_5.x86_64 124/134 2023-07-14T18:03:18.388 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : libcom_err-devel-1.45.6-4.el8.x86_64 125/134 2023-07-14T18:03:18.388 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : libgfortran-8.5.0-10.1.el8_6.x86_64 126/134 2023-07-14T18:03:18.388 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : libquadmath-8.5.0-10.1.el8_6.x86_64 127/134 2023-07-14T18:03:18.388 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : NetworkManager-initscripts-updown-1:1.36.0-9.el8 128/134 2023-07-14T18:03:18.388 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : librados2-2:18.0.0-4940.g81c9387d.el8.x86_64 129/134 2023-07-14T18:03:18.389 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 130/134 2023-07-14T18:03:18.389 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : librbd1-2:18.0.0-4940.g81c9387d.el8.x86_64 131/134 2023-07-14T18:03:18.389 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-07-14T18:03:18.389 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : iproute-5.15.0-4.el8_6.1.x86_64 133/134 2023-07-14T18:03:20.789 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : iproute-5.15.0-4.el8.x86_64 134/134 2023-07-14T18:03:20.789 INFO:teuthology.orchestra.run.smithi172.stdout:Last metadata expiration check: 0:02:29 ago on Fri 14 Jul 2023 06:00:51 PM UTC. 2023-07-14T18:03:30.252 INFO:teuthology.orchestra.run.smithi172.stdout:Installed products updated. 2023-07-14T18:03:30.469 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-07-14T18:03:30.469 INFO:teuthology.orchestra.run.smithi172.stdout:Upgraded: 2023-07-14T18:03:30.469 INFO:teuthology.orchestra.run.smithi172.stdout: iproute-5.15.0-4.el8_6.1.x86_64 2023-07-14T18:03:30.469 INFO:teuthology.orchestra.run.smithi172.stdout: librados2-2:18.0.0-4940.g81c9387d.el8.x86_64 2023-07-14T18:03:30.470 INFO:teuthology.orchestra.run.smithi172.stdout: librbd1-2:18.0.0-4940.g81c9387d.el8.x86_64 2023-07-14T18:03:30.470 INFO:teuthology.orchestra.run.smithi172.stdout:Installed: 2023-07-14T18:03:30.470 INFO:teuthology.orchestra.run.smithi172.stdout: NetworkManager-initscripts-updown-1:1.36.0-9.el8_6.noarch 2023-07-14T18:03:30.470 INFO:teuthology.orchestra.run.smithi172.stdout: automake-1.16.1-7.el8.noarch 2023-07-14T18:03:30.470 INFO:teuthology.orchestra.run.smithi172.stdout: bison-3.0.4-10.el8.x86_64 2023-07-14T18:03:30.470 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-2:18.0.0-4940.g81c9387d.el8.x86_64 2023-07-14T18:03:30.470 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-base-2:18.0.0-4940.g81c9387d.el8.x86_64 2023-07-14T18:03:30.471 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-common-2:18.0.0-4940.g81c9387d.el8.x86_64 2023-07-14T18:03:30.471 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-fuse-2:18.0.0-4940.g81c9387d.el8.x86_64 2023-07-14T18:03:30.471 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-grafana-dashboards-2:18.0.0-4940.g81c9387d.el8.noarch 2023-07-14T18:03:30.471 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-immutable-object-cache-2:18.0.0-4940.g81c9387d.el8.x86_64 2023-07-14T18:03:30.471 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-mds-2:18.0.0-4940.g81c9387d.el8.x86_64 2023-07-14T18:03:30.471 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-mgr-2:18.0.0-4940.g81c9387d.el8.x86_64 2023-07-14T18:03:30.471 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-mgr-cephadm-2:18.0.0-4940.g81c9387d.el8.noarch 2023-07-14T18:03:30.471 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-mgr-dashboard-2:18.0.0-4940.g81c9387d.el8.noarch 2023-07-14T18:03:30.472 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-mgr-diskprediction-local-2:18.0.0-4940.g81c9387d.el8.noarch 2023-07-14T18:03:30.472 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-mgr-modules-core-2:18.0.0-4940.g81c9387d.el8.noarch 2023-07-14T18:03:30.472 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-mgr-rook-2:18.0.0-4940.g81c9387d.el8.noarch 2023-07-14T18:03:30.472 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-mon-2:18.0.0-4940.g81c9387d.el8.x86_64 2023-07-14T18:03:30.472 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-osd-2:18.0.0-4940.g81c9387d.el8.x86_64 2023-07-14T18:03:30.472 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-prometheus-alerts-2:18.0.0-4940.g81c9387d.el8.noarch 2023-07-14T18:03:30.472 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-radosgw-2:18.0.0-4940.g81c9387d.el8.x86_64 2023-07-14T18:03:30.473 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-selinux-2:18.0.0-4940.g81c9387d.el8.x86_64 2023-07-14T18:03:30.473 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-test-2:18.0.0-4940.g81c9387d.el8.x86_64 2023-07-14T18:03:30.473 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-volume-2:18.0.0-4940.g81c9387d.el8.noarch 2023-07-14T18:03:30.473 INFO:teuthology.orchestra.run.smithi172.stdout: cephadm-2:18.0.0-4940.g81c9387d.el8.noarch 2023-07-14T18:03:30.473 INFO:teuthology.orchestra.run.smithi172.stdout: cephfs-mirror-2:18.0.0-4940.g81c9387d.el8.x86_64 2023-07-14T18:03:30.473 INFO:teuthology.orchestra.run.smithi172.stdout: cephfs-top-2:18.0.0-4940.g81c9387d.el8.noarch 2023-07-14T18:03:30.473 INFO:teuthology.orchestra.run.smithi172.stdout: elfutils-libelf-devel-0.186-1.el8.x86_64 2023-07-14T18:03:30.473 INFO:teuthology.orchestra.run.smithi172.stdout: flex-2.6.1-9.el8.x86_64 2023-07-14T18:03:30.474 INFO:teuthology.orchestra.run.smithi172.stdout: fuse-2.9.7-15.el8.x86_64 2023-07-14T18:03:30.474 INFO:teuthology.orchestra.run.smithi172.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2023-07-14T18:03:30.474 INFO:teuthology.orchestra.run.smithi172.stdout: jq-1.6-3.el8.x86_64 2023-07-14T18:03:30.474 INFO:teuthology.orchestra.run.smithi172.stdout: keyutils-libs-devel-1.5.10-9.el8.x86_64 2023-07-14T18:03:30.474 INFO:teuthology.orchestra.run.smithi172.stdout: krb5-devel-1.18.2-14.el8.x86_64 2023-07-14T18:03:30.474 INFO:teuthology.orchestra.run.smithi172.stdout: libaio-devel-0.3.112-1.el8.x86_64 2023-07-14T18:03:30.474 INFO:teuthology.orchestra.run.smithi172.stdout: libcephfs-devel-2:18.0.0-4940.g81c9387d.el8.x86_64 2023-07-14T18:03:30.475 INFO:teuthology.orchestra.run.smithi172.stdout: libcephfs2-2:18.0.0-4940.g81c9387d.el8.x86_64 2023-07-14T18:03:30.475 INFO:teuthology.orchestra.run.smithi172.stdout: libcephsqlite-2:18.0.0-4940.g81c9387d.el8.x86_64 2023-07-14T18:03:30.475 INFO:teuthology.orchestra.run.smithi172.stdout: libcom_err-devel-1.45.6-4.el8.x86_64 2023-07-14T18:03:30.475 INFO:teuthology.orchestra.run.smithi172.stdout: libgfortran-8.5.0-10.1.el8_6.x86_64 2023-07-14T18:03:30.475 INFO:teuthology.orchestra.run.smithi172.stdout: liboath-2.6.2-3.el8.x86_64 2023-07-14T18:03:30.475 INFO:teuthology.orchestra.run.smithi172.stdout: libpq-13.5-1.el8.x86_64 2023-07-14T18:03:30.475 INFO:teuthology.orchestra.run.smithi172.stdout: libquadmath-8.5.0-10.1.el8_6.x86_64 2023-07-14T18:03:30.475 INFO:teuthology.orchestra.run.smithi172.stdout: librabbitmq-0.9.0-3.el8.x86_64 2023-07-14T18:03:30.476 INFO:teuthology.orchestra.run.smithi172.stdout: librados-devel-2:18.0.0-4940.g81c9387d.el8.x86_64 2023-07-14T18:03:30.476 INFO:teuthology.orchestra.run.smithi172.stdout: libradosstriper1-2:18.0.0-4940.g81c9387d.el8.x86_64 2023-07-14T18:03:30.476 INFO:teuthology.orchestra.run.smithi172.stdout: librdkafka-0.11.4-3.el8.x86_64 2023-07-14T18:03:30.476 INFO:teuthology.orchestra.run.smithi172.stdout: librgw2-2:18.0.0-4940.g81c9387d.el8.x86_64 2023-07-14T18:03:30.476 INFO:teuthology.orchestra.run.smithi172.stdout: libselinux-devel-2.9-5.el8.x86_64 2023-07-14T18:03:30.476 INFO:teuthology.orchestra.run.smithi172.stdout: libsepol-devel-2.9-3.el8.x86_64 2023-07-14T18:03:30.476 INFO:teuthology.orchestra.run.smithi172.stdout: libtool-2.4.6-25.el8.x86_64 2023-07-14T18:03:30.476 INFO:teuthology.orchestra.run.smithi172.stdout: libunwind-1.3.1-3.el8.x86_64 2023-07-14T18:03:30.477 INFO:teuthology.orchestra.run.smithi172.stdout: libuuid-devel-2.32.1-35.el8.x86_64 2023-07-14T18:03:30.477 INFO:teuthology.orchestra.run.smithi172.stdout: libverto-devel-0.3.0-5.el8.x86_64 2023-07-14T18:03:30.477 INFO:teuthology.orchestra.run.smithi172.stdout: lttng-ust-2.8.1-11.el8.x86_64 2023-07-14T18:03:30.477 INFO:teuthology.orchestra.run.smithi172.stdout: oniguruma-6.8.2-2.el8.x86_64 2023-07-14T18:03:30.477 INFO:teuthology.orchestra.run.smithi172.stdout: openblas-0.3.15-3.el8.x86_64 2023-07-14T18:03:30.477 INFO:teuthology.orchestra.run.smithi172.stdout: openblas-threads-0.3.15-3.el8.x86_64 2023-07-14T18:03:30.477 INFO:teuthology.orchestra.run.smithi172.stdout: openssl-devel-1:1.1.1k-7.el8_6.x86_64 2023-07-14T18:03:30.478 INFO:teuthology.orchestra.run.smithi172.stdout: pcre2-devel-10.32-2.el8.x86_64 2023-07-14T18:03:30.478 INFO:teuthology.orchestra.run.smithi172.stdout: pcre2-utf16-10.32-2.el8.x86_64 2023-07-14T18:03:30.478 INFO:teuthology.orchestra.run.smithi172.stdout: pcre2-utf32-10.32-2.el8.x86_64 2023-07-14T18:03:30.478 INFO:teuthology.orchestra.run.smithi172.stdout: postgresql-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-07-14T18:03:30.478 INFO:teuthology.orchestra.run.smithi172.stdout: postgresql-contrib-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-07-14T18:03:30.478 INFO:teuthology.orchestra.run.smithi172.stdout: postgresql-server-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-07-14T18:03:30.478 INFO:teuthology.orchestra.run.smithi172.stdout: python3-asyncssh-2.7.0-2.el8.noarch 2023-07-14T18:03:30.478 INFO:teuthology.orchestra.run.smithi172.stdout: python3-babel-2.5.1-7.el8.noarch 2023-07-14T18:03:30.479 INFO:teuthology.orchestra.run.smithi172.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2023-07-14T18:03:30.479 INFO:teuthology.orchestra.run.smithi172.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2023-07-14T18:03:30.479 INFO:teuthology.orchestra.run.smithi172.stdout: python3-cachetools-3.1.1-4.el8.noarch 2023-07-14T18:03:30.479 INFO:teuthology.orchestra.run.smithi172.stdout: python3-ceph-argparse-2:18.0.0-4940.g81c9387d.el8.x86_64 2023-07-14T18:03:30.479 INFO:teuthology.orchestra.run.smithi172.stdout: python3-ceph-common-2:18.0.0-4940.g81c9387d.el8.x86_64 2023-07-14T18:03:30.479 INFO:teuthology.orchestra.run.smithi172.stdout: python3-cephfs-2:18.0.0-4940.g81c9387d.el8.x86_64 2023-07-14T18:03:30.479 INFO:teuthology.orchestra.run.smithi172.stdout: python3-certifi-2018.10.15-7.el8.noarch 2023-07-14T18:03:30.479 INFO:teuthology.orchestra.run.smithi172.stdout: python3-cffi-1.11.5-5.el8.x86_64 2023-07-14T18:03:30.480 INFO:teuthology.orchestra.run.smithi172.stdout: python3-cheroot-8.5.2-1.el8.noarch 2023-07-14T18:03:30.480 INFO:teuthology.orchestra.run.smithi172.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2023-07-14T18:03:30.480 INFO:teuthology.orchestra.run.smithi172.stdout: python3-cryptography-3.2.1-5.el8.x86_64 2023-07-14T18:03:30.480 INFO:teuthology.orchestra.run.smithi172.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2023-07-14T18:03:30.480 INFO:teuthology.orchestra.run.smithi172.stdout: python3-jaraco-6.2-6.el8.noarch 2023-07-14T18:03:30.480 INFO:teuthology.orchestra.run.smithi172.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2023-07-14T18:03:30.480 INFO:teuthology.orchestra.run.smithi172.stdout: python3-jinja2-2.10.1-3.el8.noarch 2023-07-14T18:03:30.480 INFO:teuthology.orchestra.run.smithi172.stdout: python3-jsonpatch-1.21-2.el8.noarch 2023-07-14T18:03:30.481 INFO:teuthology.orchestra.run.smithi172.stdout: python3-jsonpointer-1.10-11.el8.noarch 2023-07-14T18:03:30.481 INFO:teuthology.orchestra.run.smithi172.stdout: python3-jwt-1.6.1-2.el8.noarch 2023-07-14T18:03:30.481 INFO:teuthology.orchestra.run.smithi172.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2023-07-14T18:03:30.481 INFO:teuthology.orchestra.run.smithi172.stdout: python3-logutils-0.3.5-11.el8.noarch 2023-07-14T18:03:30.481 INFO:teuthology.orchestra.run.smithi172.stdout: python3-mako-1.0.6-13.el8.noarch 2023-07-14T18:03:30.481 INFO:teuthology.orchestra.run.smithi172.stdout: python3-markupsafe-0.23-19.el8.x86_64 2023-07-14T18:03:30.481 INFO:teuthology.orchestra.run.smithi172.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2023-07-14T18:03:30.482 INFO:teuthology.orchestra.run.smithi172.stdout: python3-natsort-7.1.1-2.el8.noarch 2023-07-14T18:03:30.482 INFO:teuthology.orchestra.run.smithi172.stdout: python3-numpy-1:1.14.3-10.el8.x86_64 2023-07-14T18:03:30.482 INFO:teuthology.orchestra.run.smithi172.stdout: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 2023-07-14T18:03:30.482 INFO:teuthology.orchestra.run.smithi172.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2023-07-14T18:03:30.482 INFO:teuthology.orchestra.run.smithi172.stdout: python3-pecan-1.3.2-9.el8.noarch 2023-07-14T18:03:30.482 INFO:teuthology.orchestra.run.smithi172.stdout: python3-portend-2.6-1.el8.noarch 2023-07-14T18:03:30.482 INFO:teuthology.orchestra.run.smithi172.stdout: python3-prettytable-0.7.2-14.el8.noarch 2023-07-14T18:03:30.482 INFO:teuthology.orchestra.run.smithi172.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2023-07-14T18:03:30.483 INFO:teuthology.orchestra.run.smithi172.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2023-07-14T18:03:30.483 INFO:teuthology.orchestra.run.smithi172.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2023-07-14T18:03:30.483 INFO:teuthology.orchestra.run.smithi172.stdout: python3-pycparser-2.14-14.el8.noarch 2023-07-14T18:03:30.483 INFO:teuthology.orchestra.run.smithi172.stdout: python3-pytz-2017.2-9.el8.noarch 2023-07-14T18:03:30.483 INFO:teuthology.orchestra.run.smithi172.stdout: python3-rados-2:18.0.0-4940.g81c9387d.el8.x86_64 2023-07-14T18:03:30.483 INFO:teuthology.orchestra.run.smithi172.stdout: python3-rbd-2:18.0.0-4940.g81c9387d.el8.x86_64 2023-07-14T18:03:30.483 INFO:teuthology.orchestra.run.smithi172.stdout: python3-repoze-lru-0.7-6.el8.noarch 2023-07-14T18:03:30.483 INFO:teuthology.orchestra.run.smithi172.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2023-07-14T18:03:30.484 INFO:teuthology.orchestra.run.smithi172.stdout: python3-rgw-2:18.0.0-4940.g81c9387d.el8.x86_64 2023-07-14T18:03:30.484 INFO:teuthology.orchestra.run.smithi172.stdout: python3-routes-2.4.1-12.el8.noarch 2023-07-14T18:03:30.484 INFO:teuthology.orchestra.run.smithi172.stdout: python3-rsa-4.8-1.el8.noarch 2023-07-14T18:03:30.484 INFO:teuthology.orchestra.run.smithi172.stdout: python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd434d.x86_64 2023-07-14T18:03:30.484 INFO:teuthology.orchestra.run.smithi172.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2023-07-14T18:03:30.484 INFO:teuthology.orchestra.run.smithi172.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2023-07-14T18:03:30.484 INFO:teuthology.orchestra.run.smithi172.stdout: python3-tempora-1.14.1-5.el8.noarch 2023-07-14T18:03:30.485 INFO:teuthology.orchestra.run.smithi172.stdout: python3-trustme-0.6.0-4.el8.noarch 2023-07-14T18:03:30.485 INFO:teuthology.orchestra.run.smithi172.stdout: python3-waitress-1.4.3-1.el8.noarch 2023-07-14T18:03:30.485 INFO:teuthology.orchestra.run.smithi172.stdout: python3-webob-1.8.5-1.el8.1.noarch 2023-07-14T18:03:30.485 INFO:teuthology.orchestra.run.smithi172.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2023-07-14T18:03:30.485 INFO:teuthology.orchestra.run.smithi172.stdout: python3-webtest-2.0.33-1.el8.noarch 2023-07-14T18:03:30.485 INFO:teuthology.orchestra.run.smithi172.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2023-07-14T18:03:30.485 INFO:teuthology.orchestra.run.smithi172.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2023-07-14T18:03:30.485 INFO:teuthology.orchestra.run.smithi172.stdout: rbd-fuse-2:18.0.0-4940.g81c9387d.el8.x86_64 2023-07-14T18:03:30.486 INFO:teuthology.orchestra.run.smithi172.stdout: rbd-mirror-2:18.0.0-4940.g81c9387d.el8.x86_64 2023-07-14T18:03:30.486 INFO:teuthology.orchestra.run.smithi172.stdout: rbd-nbd-2:18.0.0-4940.g81c9387d.el8.x86_64 2023-07-14T18:03:30.486 INFO:teuthology.orchestra.run.smithi172.stdout: socat-1.7.4.1-1.el8.x86_64 2023-07-14T18:03:30.486 INFO:teuthology.orchestra.run.smithi172.stdout: thrift-0.13.0-2.el8.x86_64 2023-07-14T18:03:30.486 INFO:teuthology.orchestra.run.smithi172.stdout: uuid-1.6.2-43.el8.x86_64 2023-07-14T18:03:30.486 INFO:teuthology.orchestra.run.smithi172.stdout: xfsprogs-devel-5.0.0-10.el8.x86_64 2023-07-14T18:03:30.486 INFO:teuthology.orchestra.run.smithi172.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2023-07-14T18:03:30.487 INFO:teuthology.orchestra.run.smithi172.stdout: zlib-devel-1.2.11-18.el8_5.x86_64 2023-07-14T18:03:30.487 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-07-14T18:03:30.487 INFO:teuthology.orchestra.run.smithi172.stdout:Complete! 2023-07-14T18:03:31.912 DEBUG:teuthology.parallel:result is None 2023-07-14T18:03:31.912 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=81c9387d2e7576da065747ec9c16d1c7d69016ec 2023-07-14T18:03:32.153 DEBUG:teuthology.orchestra.run.smithi163:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-07-14T18:03:32.182 INFO:teuthology.orchestra.run.smithi163.stdout:18.0.0-4940.g81c9387d.el8 2023-07-14T18:03:32.183 INFO:teuthology.packaging:The installed version of ceph is 18.0.0-4940.g81c9387d.el8 2023-07-14T18:03:32.183 INFO:teuthology.task.install:The correct ceph version 18.0.0-4940.g81c9387d is installed. 2023-07-14T18:03:32.184 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=81c9387d2e7576da065747ec9c16d1c7d69016ec 2023-07-14T18:03:32.424 DEBUG:teuthology.orchestra.run.smithi172:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-07-14T18:03:32.451 INFO:teuthology.orchestra.run.smithi172.stdout:18.0.0-4940.g81c9387d.el8 2023-07-14T18:03:32.451 INFO:teuthology.packaging:The installed version of ceph is 18.0.0-4940.g81c9387d.el8 2023-07-14T18:03:32.451 INFO:teuthology.task.install:The correct ceph version 18.0.0-4940.g81c9387d is installed. 2023-07-14T18:03:32.452 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=81c9387d2e7576da065747ec9c16d1c7d69016ec 2023-07-14T18:03:32.688 DEBUG:teuthology.orchestra.run.smithi184:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-07-14T18:03:32.717 INFO:teuthology.orchestra.run.smithi184.stdout:18.0.0-4940.g81c9387d.el8 2023-07-14T18:03:32.717 INFO:teuthology.packaging:The installed version of ceph is 18.0.0-4940.g81c9387d.el8 2023-07-14T18:03:32.717 INFO:teuthology.task.install:The correct ceph version 18.0.0-4940.g81c9387d is installed. 2023-07-14T18:03:32.718 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2023-07-14T18:03:32.718 DEBUG:teuthology.orchestra.run.smithi163:> set -ex 2023-07-14T18:03:32.719 DEBUG:teuthology.orchestra.run.smithi163:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-07-14T18:03:32.766 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2023-07-14T18:03:32.766 DEBUG:teuthology.orchestra.run.smithi172:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-07-14T18:03:32.814 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2023-07-14T18:03:32.814 DEBUG:teuthology.orchestra.run.smithi184:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-07-14T18:03:32.861 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2023-07-14T18:03:32.864 DEBUG:teuthology.orchestra.run.smithi163:> set -ex 2023-07-14T18:03:32.864 DEBUG:teuthology.orchestra.run.smithi163:> sudo dd of=/usr/bin/daemon-helper 2023-07-14T18:03:32.893 DEBUG:teuthology.orchestra.run.smithi163:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-07-14T18:03:32.962 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2023-07-14T18:03:32.962 DEBUG:teuthology.orchestra.run.smithi172:> sudo dd of=/usr/bin/daemon-helper 2023-07-14T18:03:32.994 DEBUG:teuthology.orchestra.run.smithi172:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-07-14T18:03:33.064 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2023-07-14T18:03:33.064 DEBUG:teuthology.orchestra.run.smithi184:> sudo dd of=/usr/bin/daemon-helper 2023-07-14T18:03:33.097 DEBUG:teuthology.orchestra.run.smithi184:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-07-14T18:03:33.170 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2023-07-14T18:03:33.171 DEBUG:teuthology.orchestra.run.smithi163:> set -ex 2023-07-14T18:03:33.171 DEBUG:teuthology.orchestra.run.smithi163:> sudo dd of=/usr/bin/adjust-ulimits 2023-07-14T18:03:33.200 DEBUG:teuthology.orchestra.run.smithi163:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-07-14T18:03:33.268 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2023-07-14T18:03:33.268 DEBUG:teuthology.orchestra.run.smithi172:> sudo dd of=/usr/bin/adjust-ulimits 2023-07-14T18:03:33.299 DEBUG:teuthology.orchestra.run.smithi172:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-07-14T18:03:33.368 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2023-07-14T18:03:33.369 DEBUG:teuthology.orchestra.run.smithi184:> sudo dd of=/usr/bin/adjust-ulimits 2023-07-14T18:03:33.401 DEBUG:teuthology.orchestra.run.smithi184:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-07-14T18:03:33.471 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2023-07-14T18:03:33.471 DEBUG:teuthology.orchestra.run.smithi163:> set -ex 2023-07-14T18:03:33.472 DEBUG:teuthology.orchestra.run.smithi163:> sudo dd of=/usr/bin/stdin-killer 2023-07-14T18:03:33.500 DEBUG:teuthology.orchestra.run.smithi163:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-07-14T18:03:33.569 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2023-07-14T18:03:33.570 DEBUG:teuthology.orchestra.run.smithi172:> sudo dd of=/usr/bin/stdin-killer 2023-07-14T18:03:33.601 DEBUG:teuthology.orchestra.run.smithi172:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-07-14T18:03:33.671 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2023-07-14T18:03:33.671 DEBUG:teuthology.orchestra.run.smithi184:> sudo dd of=/usr/bin/stdin-killer 2023-07-14T18:03:33.701 DEBUG:teuthology.orchestra.run.smithi184:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-07-14T18:03:33.770 INFO:teuthology.run_tasks:Running task cephadm... 2023-07-14T18:03:33.864 INFO:tasks.cephadm:Config: {'roleless': False, 'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd'], 'max_mds': 5, 'session_timeout': 300, 'standby_replay': True}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'mds_bal_replicate_threshold': 1, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'cephsqlite lock renewal timeout': 900000, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180, 'osd shutdown pgref assert': True, 'osd_max_omap_entries_per_request': 10000}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'slow metadata IO', 'SLOW_OPS', 'slow request'], 'sha1': '81c9387d2e7576da065747ec9c16d1c7d69016ec', 'subvols': {'create': 2, 'subvol_options': '--namespace-isolated --size 25000000000'}} 2023-07-14T18:03:33.865 INFO:tasks.cephadm:Cluster image is quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81c9387d2e7576da065747ec9c16d1c7d69016ec 2023-07-14T18:03:33.874 INFO:tasks.cephadm:Cluster fsid is bf7326ec-2270-11ee-9b33-001a4aab830c 2023-07-14T18:03:33.874 INFO:tasks.cephadm:Choosing monitor IPs and ports... 2023-07-14T18:03:33.875 INFO:tasks.cephadm:Monitor IPs: {'mon.a': '172.21.15.163', 'mon.b': '172.21.15.172', 'mon.c': '172.21.15.184'} 2023-07-14T18:03:33.875 INFO:tasks.cephadm:First mon is mon.a on smithi163 2023-07-14T18:03:33.876 INFO:tasks.cephadm:First mgr is x 2023-07-14T18:03:33.876 INFO:tasks.cephadm:Normalizing hostnames... 2023-07-14T18:03:33.876 DEBUG:teuthology.orchestra.run.smithi163:> sudo hostname $(hostname -s) 2023-07-14T18:03:33.907 DEBUG:teuthology.orchestra.run.smithi172:> sudo hostname $(hostname -s) 2023-07-14T18:03:33.940 DEBUG:teuthology.orchestra.run.smithi184:> sudo hostname $(hostname -s) 2023-07-14T18:03:33.970 INFO:tasks.cephadm:Downloading "compiled" cephadm from cachra 2023-07-14T18:03:33.971 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=81c9387d2e7576da065747ec9c16d1c7d69016ec 2023-07-14T18:03:39.225 INFO:tasks.cephadm:builder_project result: [{'status': 'ready', 'sha1': '81c9387d2e7576da065747ec9c16d1c7d69016ec', 'extra': {'build_url': 'https://jenkins.ceph.com/job/ceph-dev-new-build/ARCH=arm64,AVAILABLE_ARCH=arm64,AVAILABLE_DIST=centos8,DIST=centos8,MACHINE_SIZE=gigantic/71431/', 'root_build_cause': 'SCMTRIGGER', 'version': '18.0.0-4940-g81c9387d', 'node_name': '172.21.4.65+confusa03', 'job_name': 'ceph-dev-new-build/ARCH=arm64,AVAILABLE_ARCH=arm64,AVAILABLE_DIST=centos8,DIST=centos8,MACHINE_SIZE=gigantic', 'package_manager_version': '18.0.0-4940.g81c9387d'}, 'url': 'https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20230714.134335/81c9387d2e7576da065747ec9c16d1c7d69016ec/centos/8/flavors/default/', 'distro_codename': None, 'modified': '2023-07-14 16:50:26.249583', 'distro_version': '8', 'project': 'ceph', 'flavor': 'default', 'ref': 'wip-pdonnell-testing-20230714.134335', 'chacra_url': 'https://4.chacra.ceph.com/repos/ceph/wip-pdonnell-testing-20230714.134335/81c9387d2e7576da065747ec9c16d1c7d69016ec/centos/8/flavors/default/', 'archs': ['source', 'x86_64', 'arm64'], 'distro': 'centos'}] 2023-07-14T18:03:39.531 INFO:tasks.util.chacra:got chacra host 4.chacra.ceph.com, ref wip-pdonnell-testing-20230714.134335, sha1 81c9387d2e7576da065747ec9c16d1c7d69016ec from https://shaman.ceph.com/api/search/?project=ceph&distros=centos%2F8%2Fx86_64&flavor=default&sha1=81c9387d2e7576da065747ec9c16d1c7d69016ec 2023-07-14T18:03:39.532 INFO:tasks.cephadm:Discovered cachra url: https://4.chacra.ceph.com/binaries/ceph/wip-pdonnell-testing-20230714.134335/81c9387d2e7576da065747ec9c16d1c7d69016ec/centos/8/x86_64/flavors/default/cephadm 2023-07-14T18:03:39.533 DEBUG:teuthology.orchestra.run.smithi163:> curl --silent -L https://4.chacra.ceph.com/binaries/ceph/wip-pdonnell-testing-20230714.134335/81c9387d2e7576da065747ec9c16d1c7d69016ec/centos/8/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2023-07-14T18:03:41.057 INFO:teuthology.orchestra.run.smithi163.stdout:-rw-rw-r--. 1 ubuntu ubuntu 670007 Jul 14 18:03 /home/ubuntu/cephtest/cephadm 2023-07-14T18:03:41.057 DEBUG:teuthology.orchestra.run.smithi172:> curl --silent -L https://4.chacra.ceph.com/binaries/ceph/wip-pdonnell-testing-20230714.134335/81c9387d2e7576da065747ec9c16d1c7d69016ec/centos/8/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2023-07-14T18:03:42.699 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-rw-r--. 1 ubuntu ubuntu 670007 Jul 14 18:03 /home/ubuntu/cephtest/cephadm 2023-07-14T18:03:42.699 DEBUG:teuthology.orchestra.run.smithi184:> curl --silent -L https://4.chacra.ceph.com/binaries/ceph/wip-pdonnell-testing-20230714.134335/81c9387d2e7576da065747ec9c16d1c7d69016ec/centos/8/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2023-07-14T18:03:44.547 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-rw-r--. 1 ubuntu ubuntu 670007 Jul 14 18:03 /home/ubuntu/cephtest/cephadm 2023-07-14T18:03:44.548 DEBUG:teuthology.orchestra.run.smithi163:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2023-07-14T18:03:44.570 DEBUG:teuthology.orchestra.run.smithi172:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2023-07-14T18:03:44.591 DEBUG:teuthology.orchestra.run.smithi184:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2023-07-14T18:03:44.627 INFO:tasks.cephadm:Pulling image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81c9387d2e7576da065747ec9c16d1c7d69016ec on all hosts... 2023-07-14T18:03:44.628 DEBUG:teuthology.orchestra.run.smithi163:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81c9387d2e7576da065747ec9c16d1c7d69016ec pull 2023-07-14T18:03:44.630 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81c9387d2e7576da065747ec9c16d1c7d69016ec pull 2023-07-14T18:03:44.633 DEBUG:teuthology.orchestra.run.smithi184:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81c9387d2e7576da065747ec9c16d1c7d69016ec pull 2023-07-14T18:03:45.900 INFO:teuthology.orchestra.run.smithi163.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81c9387d2e7576da065747ec9c16d1c7d69016ec... 2023-07-14T18:03:46.043 INFO:teuthology.orchestra.run.smithi184.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81c9387d2e7576da065747ec9c16d1c7d69016ec... 2023-07-14T18:03:46.572 INFO:teuthology.orchestra.run.smithi172.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81c9387d2e7576da065747ec9c16d1c7d69016ec... 2023-07-14T18:04:10.780 INFO:teuthology.orchestra.run.smithi163.stdout:{ 2023-07-14T18:04:10.781 INFO:teuthology.orchestra.run.smithi163.stdout: "ceph_version": "ceph version 18.0.0-4940-g81c9387d (81c9387d2e7576da065747ec9c16d1c7d69016ec) reef (dev)", 2023-07-14T18:04:10.781 INFO:teuthology.orchestra.run.smithi163.stdout: "image_id": "219b180907a819a02c0d1790ec69e152120a3974adf061aaf947f90f6ccf9705", 2023-07-14T18:04:10.781 INFO:teuthology.orchestra.run.smithi163.stdout: "repo_digests": [ 2023-07-14T18:04:10.781 INFO:teuthology.orchestra.run.smithi163.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1302190083259ae87fcd27babf423c1dd04ae7417edb252031c1d861adeb3110" 2023-07-14T18:04:10.781 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-07-14T18:04:10.781 INFO:teuthology.orchestra.run.smithi163.stdout:} 2023-07-14T18:04:12.332 INFO:teuthology.orchestra.run.smithi184.stdout:{ 2023-07-14T18:04:12.332 INFO:teuthology.orchestra.run.smithi184.stdout: "ceph_version": "ceph version 18.0.0-4940-g81c9387d (81c9387d2e7576da065747ec9c16d1c7d69016ec) reef (dev)", 2023-07-14T18:04:12.332 INFO:teuthology.orchestra.run.smithi184.stdout: "image_id": "219b180907a819a02c0d1790ec69e152120a3974adf061aaf947f90f6ccf9705", 2023-07-14T18:04:12.333 INFO:teuthology.orchestra.run.smithi184.stdout: "repo_digests": [ 2023-07-14T18:04:12.333 INFO:teuthology.orchestra.run.smithi184.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1302190083259ae87fcd27babf423c1dd04ae7417edb252031c1d861adeb3110" 2023-07-14T18:04:12.333 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2023-07-14T18:04:12.333 INFO:teuthology.orchestra.run.smithi184.stdout:} 2023-07-14T18:04:16.563 INFO:teuthology.orchestra.run.smithi172.stdout:{ 2023-07-14T18:04:16.563 INFO:teuthology.orchestra.run.smithi172.stdout: "ceph_version": "ceph version 18.0.0-4940-g81c9387d (81c9387d2e7576da065747ec9c16d1c7d69016ec) reef (dev)", 2023-07-14T18:04:16.563 INFO:teuthology.orchestra.run.smithi172.stdout: "image_id": "219b180907a819a02c0d1790ec69e152120a3974adf061aaf947f90f6ccf9705", 2023-07-14T18:04:16.564 INFO:teuthology.orchestra.run.smithi172.stdout: "repo_digests": [ 2023-07-14T18:04:16.564 INFO:teuthology.orchestra.run.smithi172.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1302190083259ae87fcd27babf423c1dd04ae7417edb252031c1d861adeb3110" 2023-07-14T18:04:16.564 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2023-07-14T18:04:16.564 INFO:teuthology.orchestra.run.smithi172.stdout:} 2023-07-14T18:04:16.582 DEBUG:teuthology.orchestra.run.smithi163:> sudo mkdir -p /etc/ceph 2023-07-14T18:04:16.619 DEBUG:teuthology.orchestra.run.smithi172:> sudo mkdir -p /etc/ceph 2023-07-14T18:04:16.650 DEBUG:teuthology.orchestra.run.smithi184:> sudo mkdir -p /etc/ceph 2023-07-14T18:04:16.688 DEBUG:teuthology.orchestra.run.smithi163:> sudo chmod 777 /etc/ceph 2023-07-14T18:04:16.718 DEBUG:teuthology.orchestra.run.smithi172:> sudo chmod 777 /etc/ceph 2023-07-14T18:04:16.745 DEBUG:teuthology.orchestra.run.smithi184:> sudo chmod 777 /etc/ceph 2023-07-14T18:04:16.774 INFO:tasks.cephadm:Writing seed config... 2023-07-14T18:04:16.775 INFO:tasks.cephadm: override: [client] client mount timeout = 600 2023-07-14T18:04:16.776 INFO:tasks.cephadm: override: [client] debug client = 20 2023-07-14T18:04:16.776 INFO:tasks.cephadm: override: [client] debug ms = 1 2023-07-14T18:04:16.776 INFO:tasks.cephadm: override: [client] rados mon op timeout = 900 2023-07-14T18:04:16.776 INFO:tasks.cephadm: override: [client] rados osd op timeout = 900 2023-07-14T18:04:16.777 INFO:tasks.cephadm: override: [mds] debug mds = 20 2023-07-14T18:04:16.777 INFO:tasks.cephadm: override: [mds] debug mds balancer = 20 2023-07-14T18:04:16.777 INFO:tasks.cephadm: override: [mds] debug ms = 1 2023-07-14T18:04:16.777 INFO:tasks.cephadm: override: [mds] mds bal fragment size max = 10000 2023-07-14T18:04:16.777 INFO:tasks.cephadm: override: [mds] mds bal merge size = 5 2023-07-14T18:04:16.778 INFO:tasks.cephadm: override: [mds] mds bal split bits = 3 2023-07-14T18:04:16.778 INFO:tasks.cephadm: override: [mds] mds bal split size = 100 2023-07-14T18:04:16.778 INFO:tasks.cephadm: override: [mds] mds debug frag = True 2023-07-14T18:04:16.778 INFO:tasks.cephadm: override: [mds] mds debug scatterstat = True 2023-07-14T18:04:16.779 INFO:tasks.cephadm: override: [mds] mds op complaint time = 180 2023-07-14T18:04:16.779 INFO:tasks.cephadm: override: [mds] mds verify scatter = True 2023-07-14T18:04:16.779 INFO:tasks.cephadm: override: [mds] mds_bal_replicate_threshold = 1 2023-07-14T18:04:16.779 INFO:tasks.cephadm: override: [mds] osd op complaint time = 180 2023-07-14T18:04:16.780 INFO:tasks.cephadm: override: [mds] rados mon op timeout = 900 2023-07-14T18:04:16.780 INFO:tasks.cephadm: override: [mds] rados osd op timeout = 900 2023-07-14T18:04:16.780 INFO:tasks.cephadm: override: [mgr] cephsqlite lock renewal timeout = 900000 2023-07-14T18:04:16.780 INFO:tasks.cephadm: override: [mgr] debug mgr = 20 2023-07-14T18:04:16.780 INFO:tasks.cephadm: override: [mgr] debug ms = 1 2023-07-14T18:04:16.781 INFO:tasks.cephadm: override: [mon] debug mon = 20 2023-07-14T18:04:16.781 INFO:tasks.cephadm: override: [mon] debug ms = 1 2023-07-14T18:04:16.781 INFO:tasks.cephadm: override: [mon] debug paxos = 20 2023-07-14T18:04:16.781 INFO:tasks.cephadm: override: [mon] mon op complaint time = 120 2023-07-14T18:04:16.781 INFO:tasks.cephadm: override: [osd] bluestore block size = 96636764160 2023-07-14T18:04:16.782 INFO:tasks.cephadm: override: [osd] bluestore fsck on mount = True 2023-07-14T18:04:16.782 INFO:tasks.cephadm: override: [osd] debug bluefs = 20 2023-07-14T18:04:16.782 INFO:tasks.cephadm: override: [osd] debug bluestore = 20 2023-07-14T18:04:16.782 INFO:tasks.cephadm: override: [osd] debug ms = 1 2023-07-14T18:04:16.782 INFO:tasks.cephadm: override: [osd] debug osd = 20 2023-07-14T18:04:16.783 INFO:tasks.cephadm: override: [osd] debug rocksdb = 10 2023-07-14T18:04:16.783 INFO:tasks.cephadm: override: [osd] mon osd backfillfull_ratio = 0.85 2023-07-14T18:04:16.783 INFO:tasks.cephadm: override: [osd] mon osd full ratio = 0.9 2023-07-14T18:04:16.783 INFO:tasks.cephadm: override: [osd] mon osd nearfull ratio = 0.8 2023-07-14T18:04:16.784 INFO:tasks.cephadm: override: [osd] osd failsafe full ratio = 0.95 2023-07-14T18:04:16.784 INFO:tasks.cephadm: override: [osd] osd objectstore = bluestore 2023-07-14T18:04:16.784 INFO:tasks.cephadm: override: [osd] osd op complaint time = 180 2023-07-14T18:04:16.784 INFO:tasks.cephadm: override: [osd] osd shutdown pgref assert = True 2023-07-14T18:04:16.784 INFO:tasks.cephadm: override: [osd] osd_max_omap_entries_per_request = 10000 2023-07-14T18:04:16.788 DEBUG:teuthology.orchestra.run.smithi163:> set -ex 2023-07-14T18:04:16.789 DEBUG:teuthology.orchestra.run.smithi163:> dd of=/home/ubuntu/cephtest/seed.ceph.conf 2023-07-14T18:04:16.807 DEBUG:tasks.cephadm:Final config: [global] # make logging friendly to teuthology log_to_file = true log_to_stderr = false log to journald = false mon cluster log file level = debug mon clock drift allowed = 1.000 # replicate across OSDs, not hosts osd crush chooseleaf type = 0 #osd pool default size = 2 osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd # enable some debugging auth debug = true ms die on old message = true ms die on bug = true debug asserts on shutdown = true # adjust warnings mon max pg per osd = 10000# >= luminous mon pg warn max object skew = 0 mon osd allow primary affinity = true mon osd allow pg remap = true mon warn on legacy crush tunables = false mon warn on crush straw calc version zero = false mon warn on no sortbitwise = false mon warn on osd down out interval zero = false mon warn on too few osds = false mon_warn_on_pool_pg_num_not_power_of_two = false # disable pg_autoscaler by default for new pools osd_pool_default_pg_autoscale_mode = off # tests delete pools mon allow pool delete = true fsid = bf7326ec-2270-11ee-9b33-001a4aab830c [osd] osd scrub load threshold = 5.0 osd scrub max interval = 600 osd mclock profile = high_recovery_ops osd recover clone overlap = true osd recovery max chunk = 1048576 osd deep scrub update digest min age = 30 osd map max advance = 10 osd memory target autotune = true # debugging osd debug shutdown = true osd debug op order = true osd debug verify stray on activate = true osd debug pg log writeout = true osd debug verify cached snaps = true osd debug verify missing on start = true osd debug misdirected ops = true osd op queue = debug_random osd op queue cut off = debug_random osd shutdown pgref assert = True bdev debug aio = true osd sloppy crc = true bluestore block size = 96636764160 bluestore fsck on mount = True debug bluefs = 20 debug bluestore = 20 debug ms = 1 debug osd = 20 debug rocksdb = 10 mon osd backfillfull_ratio = 0.85 mon osd full ratio = 0.9 mon osd nearfull ratio = 0.8 osd failsafe full ratio = 0.95 osd objectstore = bluestore osd op complaint time = 180 osd_max_omap_entries_per_request = 10000 [mgr] mon reweight min pgs per osd = 4 mon reweight min bytes per osd = 10 mgr/telemetry/nag = false cephsqlite lock renewal timeout = 900000 debug mgr = 20 debug ms = 1 [mon] mon data avail warn = 5 mon mgr mkfs grace = 240 mon reweight min pgs per osd = 4 mon osd reporter subtree level = osd mon osd prime pg temp = true mon reweight min bytes per osd = 10 # rotate auth tickets quickly to exercise renewal paths auth mon ticket ttl = 660# 11m auth service ticket ttl = 240# 4m # don't complain about global id reclaim mon_warn_on_insecure_global_id_reclaim = false mon_warn_on_insecure_global_id_reclaim_allowed = false debug mon = 20 debug ms = 1 debug paxos = 20 mon op complaint time = 120 [client.rgw] rgw cache enabled = true rgw enable ops log = true rgw enable usage log = true [client] client mount timeout = 600 debug client = 20 debug ms = 1 rados mon op timeout = 900 rados osd op timeout = 900 [mds] debug mds = 20 debug mds balancer = 20 debug ms = 1 mds bal fragment size max = 10000 mds bal merge size = 5 mds bal split bits = 3 mds bal split size = 100 mds debug frag = True mds debug scatterstat = True mds op complaint time = 180 mds verify scatter = True mds_bal_replicate_threshold = 1 osd op complaint time = 180 rados mon op timeout = 900 rados osd op timeout = 900 2023-07-14T18:04:16.807 DEBUG:teuthology.orchestra.run.smithi163:mon.a> sudo journalctl -f -n 0 -u ceph-bf7326ec-2270-11ee-9b33-001a4aab830c@mon.a.service 2023-07-14T18:04:16.850 DEBUG:teuthology.orchestra.run.smithi163:mgr.x> sudo journalctl -f -n 0 -u ceph-bf7326ec-2270-11ee-9b33-001a4aab830c@mgr.x.service 2023-07-14T18:04:16.877 INFO:journalctl@ceph.mon.a.smithi163.stdout:-- Logs begin at Fri 2023-07-14 17:46:25 UTC. -- 2023-07-14T18:04:16.878 INFO:tasks.cephadm:Bootstrapping... 2023-07-14T18:04:16.878 DEBUG:teuthology.orchestra.run.smithi163:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81c9387d2e7576da065747ec9c16d1c7d69016ec -v bootstrap --fsid bf7326ec-2270-11ee-9b33-001a4aab830c --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-id a --mgr-id x --orphan-initial-daemons --skip-monitoring-stack --mon-ip 172.21.15.163 --skip-admin-label && sudo chmod +r /etc/ceph/ceph.client.admin.keyring 2023-07-14T18:04:16.903 INFO:journalctl@ceph.mgr.x.smithi163.stdout:-- Logs begin at Fri 2023-07-14 17:46:25 UTC. -- 2023-07-14T18:04:17.037 INFO:teuthology.orchestra.run.smithi163.stdout:-------------------------------------------------------------------------------- 2023-07-14T18:04:17.037 INFO:teuthology.orchestra.run.smithi163.stdout:cephadm ['--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81c9387d2e7576da065747ec9c16d1c7d69016ec', '-v', 'bootstrap', '--fsid', 'bf7326ec-2270-11ee-9b33-001a4aab830c', '--config', '/home/ubuntu/cephtest/seed.ceph.conf', '--output-config', '/etc/ceph/ceph.conf', '--output-keyring', '/etc/ceph/ceph.client.admin.keyring', '--output-pub-ssh-key', '/home/ubuntu/cephtest/ceph.pub', '--mon-id', 'a', '--mgr-id', 'x', '--orphan-initial-daemons', '--skip-monitoring-stack', '--mon-ip', '172.21.15.163', '--skip-admin-label'] 2023-07-14T18:04:17.180 INFO:teuthology.orchestra.run.smithi163.stdout:/bin/podman: stdout 4.1.1 2023-07-14T18:04:17.181 INFO:teuthology.orchestra.run.smithi163.stderr:Specifying an fsid for your cluster offers no advantages and may increase the likelihood of fsid conflicts. 2023-07-14T18:04:17.181 INFO:teuthology.orchestra.run.smithi163.stdout:Verifying podman|docker is present... 2023-07-14T18:04:17.326 INFO:teuthology.orchestra.run.smithi163.stdout:/bin/podman: stdout 4.1.1 2023-07-14T18:04:17.326 INFO:teuthology.orchestra.run.smithi163.stdout:Verifying lvm2 is present... 2023-07-14T18:04:17.326 INFO:teuthology.orchestra.run.smithi163.stdout:Verifying time synchronization is in place... 2023-07-14T18:04:17.333 INFO:teuthology.orchestra.run.smithi163.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2023-07-14T18:04:17.333 INFO:teuthology.orchestra.run.smithi163.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2023-07-14T18:04:17.339 INFO:teuthology.orchestra.run.smithi163.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2023-07-14T18:04:17.339 INFO:teuthology.orchestra.run.smithi163.stdout:systemctl: stdout inactive 2023-07-14T18:04:17.345 INFO:teuthology.orchestra.run.smithi163.stdout:systemctl: stdout enabled 2023-07-14T18:04:17.351 INFO:teuthology.orchestra.run.smithi163.stdout:systemctl: stdout active 2023-07-14T18:04:17.351 INFO:teuthology.orchestra.run.smithi163.stdout:Unit chronyd.service is enabled and running 2023-07-14T18:04:17.351 INFO:teuthology.orchestra.run.smithi163.stdout:Repeating the final host check... 2023-07-14T18:04:17.497 INFO:teuthology.orchestra.run.smithi163.stdout:/bin/podman: stdout 4.1.1 2023-07-14T18:04:17.497 INFO:teuthology.orchestra.run.smithi163.stdout:podman (/bin/podman) version 4.1.1 is present 2023-07-14T18:04:17.497 INFO:teuthology.orchestra.run.smithi163.stdout:systemctl is present 2023-07-14T18:04:17.497 INFO:teuthology.orchestra.run.smithi163.stdout:lvcreate is present 2023-07-14T18:04:17.503 INFO:teuthology.orchestra.run.smithi163.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2023-07-14T18:04:17.503 INFO:teuthology.orchestra.run.smithi163.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2023-07-14T18:04:17.509 INFO:teuthology.orchestra.run.smithi163.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2023-07-14T18:04:17.509 INFO:teuthology.orchestra.run.smithi163.stdout:systemctl: stdout inactive 2023-07-14T18:04:17.515 INFO:teuthology.orchestra.run.smithi163.stdout:systemctl: stdout enabled 2023-07-14T18:04:17.521 INFO:teuthology.orchestra.run.smithi163.stdout:systemctl: stdout active 2023-07-14T18:04:17.521 INFO:teuthology.orchestra.run.smithi163.stdout:Unit chronyd.service is enabled and running 2023-07-14T18:04:17.521 INFO:teuthology.orchestra.run.smithi163.stdout:Host looks OK 2023-07-14T18:04:17.521 INFO:teuthology.orchestra.run.smithi163.stdout:Cluster fsid: bf7326ec-2270-11ee-9b33-001a4aab830c 2023-07-14T18:04:17.521 INFO:teuthology.orchestra.run.smithi163.stdout:Acquiring lock 140176292256232 on /run/cephadm/bf7326ec-2270-11ee-9b33-001a4aab830c.lock 2023-07-14T18:04:17.522 INFO:teuthology.orchestra.run.smithi163.stdout:Lock 140176292256232 acquired on /run/cephadm/bf7326ec-2270-11ee-9b33-001a4aab830c.lock 2023-07-14T18:04:17.522 INFO:teuthology.orchestra.run.smithi163.stdout:Verifying IP 172.21.15.163 port 3300 ... 2023-07-14T18:04:17.522 INFO:teuthology.orchestra.run.smithi163.stdout:Verifying IP 172.21.15.163 port 6789 ... 2023-07-14T18:04:17.522 INFO:teuthology.orchestra.run.smithi163.stdout:Base mon IP(s) is [172.21.15.163:3300, 172.21.15.163:6789], mon addrv is [v2:172.21.15.163:3300,v1:172.21.15.163:6789] 2023-07-14T18:04:17.525 INFO:teuthology.orchestra.run.smithi163.stdout:/sbin/ip: stdout default via 172.21.15.254 dev enp3s0f1 proto dhcp metric 100 2023-07-14T18:04:17.525 INFO:teuthology.orchestra.run.smithi163.stdout:/sbin/ip: stdout 172.21.0.0/20 dev enp3s0f1 proto kernel scope link src 172.21.15.163 metric 100 2023-07-14T18:04:17.528 INFO:teuthology.orchestra.run.smithi163.stdout:/sbin/ip: stdout ::1 dev lo proto kernel metric 256 pref medium 2023-07-14T18:04:17.528 INFO:teuthology.orchestra.run.smithi163.stdout:/sbin/ip: stdout fe80::/64 dev enp3s0f1 proto kernel metric 1024 pref medium 2023-07-14T18:04:17.528 INFO:teuthology.orchestra.run.smithi163.stdout:/sbin/ip: stdout default via fe80::327c:5e00:6487:71e0 dev enp3s0f1 proto ra metric 100 pref medium 2023-07-14T18:04:17.530 INFO:teuthology.orchestra.run.smithi163.stdout:/sbin/ip: stdout 1: lo: mtu 65536 state UNKNOWN qlen 1000 2023-07-14T18:04:17.531 INFO:teuthology.orchestra.run.smithi163.stdout:/sbin/ip: stdout inet6 ::1/128 scope host 2023-07-14T18:04:17.531 INFO:teuthology.orchestra.run.smithi163.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2023-07-14T18:04:17.531 INFO:teuthology.orchestra.run.smithi163.stdout:/sbin/ip: stdout 5: enp3s0f1: mtu 1500 state UP qlen 1000 2023-07-14T18:04:17.531 INFO:teuthology.orchestra.run.smithi163.stdout:/sbin/ip: stdout inet6 fe80::6692:500b:f94:c3b8/64 scope link noprefixroute 2023-07-14T18:04:17.531 INFO:teuthology.orchestra.run.smithi163.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2023-07-14T18:04:17.532 INFO:teuthology.orchestra.run.smithi163.stdout:Mon IP `172.21.15.163` is in CIDR network `172.21.0.0/20` 2023-07-14T18:04:17.532 INFO:teuthology.orchestra.run.smithi163.stdout:Mon IP `172.21.15.163` is in CIDR network `172.21.0.0/20` 2023-07-14T18:04:17.532 INFO:teuthology.orchestra.run.smithi163.stdout:Inferred mon public CIDR from local network configuration ['172.21.0.0/20', '172.21.0.0/20'] 2023-07-14T18:04:17.533 INFO:teuthology.orchestra.run.smithi163.stdout:Internal network (--cluster-network) has not been provided, OSD replication will default to the public_network 2023-07-14T18:04:17.533 INFO:teuthology.orchestra.run.smithi163.stdout:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81c9387d2e7576da065747ec9c16d1c7d69016ec... 2023-07-14T18:04:19.796 INFO:teuthology.orchestra.run.smithi163.stdout:/bin/podman: stdout 219b180907a819a02c0d1790ec69e152120a3974adf061aaf947f90f6ccf9705 2023-07-14T18:04:19.796 INFO:teuthology.orchestra.run.smithi163.stdout:/bin/podman: stderr Trying to pull quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81c9387d2e7576da065747ec9c16d1c7d69016ec... 2023-07-14T18:04:19.796 INFO:teuthology.orchestra.run.smithi163.stdout:/bin/podman: stderr Getting image source signatures 2023-07-14T18:04:19.796 INFO:teuthology.orchestra.run.smithi163.stdout:/bin/podman: stderr Copying blob sha256:0e454b422ba90e2ad13e636c40610401086a3576fe973b0460943839fe5f2508 2023-07-14T18:04:19.797 INFO:teuthology.orchestra.run.smithi163.stdout:/bin/podman: stderr Copying blob sha256:6022c611d474f2b306ddd1edfc8360123ece5266119096f25fde843d7967e636 2023-07-14T18:04:19.797 INFO:teuthology.orchestra.run.smithi163.stdout:/bin/podman: stderr Copying config sha256:219b180907a819a02c0d1790ec69e152120a3974adf061aaf947f90f6ccf9705 2023-07-14T18:04:19.797 INFO:teuthology.orchestra.run.smithi163.stdout:/bin/podman: stderr Writing manifest to image destination 2023-07-14T18:04:19.797 INFO:teuthology.orchestra.run.smithi163.stdout:/bin/podman: stderr Storing signatures 2023-07-14T18:04:20.645 INFO:teuthology.orchestra.run.smithi163.stdout:ceph: stdout ceph version 18.0.0-4940-g81c9387d (81c9387d2e7576da065747ec9c16d1c7d69016ec) reef (dev) 2023-07-14T18:04:20.645 INFO:teuthology.orchestra.run.smithi163.stdout:Ceph version: ceph version 18.0.0-4940-g81c9387d (81c9387d2e7576da065747ec9c16d1c7d69016ec) reef (dev) 2023-07-14T18:04:20.645 INFO:teuthology.orchestra.run.smithi163.stdout:Extracting ceph user uid/gid from container image... 2023-07-14T18:04:21.497 INFO:teuthology.orchestra.run.smithi163.stdout:stat: stdout 167 167 2023-07-14T18:04:21.497 INFO:teuthology.orchestra.run.smithi163.stdout:Creating initial keys... 2023-07-14T18:04:22.150 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph-authtool: stdout AQAljrFkB/i2MBAAkfPY/7APRmuIu8YhLASObg== 2023-07-14T18:04:22.900 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph-authtool: stdout AQAmjrFkngGgHRAAE2Cwut9GSw6MhAvviT1xFg== 2023-07-14T18:04:23.647 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph-authtool: stdout AQAnjrFkoYq5DBAAhGbX3czSwdQvAoqpNEWXmQ== 2023-07-14T18:04:23.647 INFO:teuthology.orchestra.run.smithi163.stdout:Creating initial monmap... 2023-07-14T18:04:24.394 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: monmap file /tmp/monmap 2023-07-14T18:04:24.395 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/monmaptool: stdout setting min_mon_release = pacific 2023-07-14T18:04:24.395 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: set fsid to bf7326ec-2270-11ee-9b33-001a4aab830c 2023-07-14T18:04:24.395 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2023-07-14T18:04:24.395 INFO:teuthology.orchestra.run.smithi163.stdout:monmaptool for a [v2:172.21.15.163:3300,v1:172.21.15.163:6789] on /usr/bin/monmaptool: monmap file /tmp/monmap 2023-07-14T18:04:24.395 INFO:teuthology.orchestra.run.smithi163.stdout:setting min_mon_release = pacific 2023-07-14T18:04:24.395 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/monmaptool: set fsid to bf7326ec-2270-11ee-9b33-001a4aab830c 2023-07-14T18:04:24.396 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2023-07-14T18:04:24.396 INFO:teuthology.orchestra.run.smithi163.stdout: 2023-07-14T18:04:24.396 INFO:teuthology.orchestra.run.smithi163.stdout:Creating mon... 2023-07-14T18:04:25.155 INFO:teuthology.orchestra.run.smithi163.stdout:create mon.a on 2023-07-14T18:04:25.286 INFO:teuthology.orchestra.run.smithi163.stdout:systemctl: stderr Removed /etc/systemd/system/multi-user.target.wants/ceph.target. 2023-07-14T18:04:25.375 INFO:teuthology.orchestra.run.smithi163.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /etc/systemd/system/ceph.target. 2023-07-14T18:04:25.496 INFO:teuthology.orchestra.run.smithi163.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph-bf7326ec-2270-11ee-9b33-001a4aab830c.target → /etc/systemd/system/ceph-bf7326ec-2270-11ee-9b33-001a4aab830c.target. 2023-07-14T18:04:25.496 INFO:teuthology.orchestra.run.smithi163.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph.target.wants/ceph-bf7326ec-2270-11ee-9b33-001a4aab830c.target → /etc/systemd/system/ceph-bf7326ec-2270-11ee-9b33-001a4aab830c.target. 2023-07-14T18:04:25.664 INFO:teuthology.orchestra.run.smithi163.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-bf7326ec-2270-11ee-9b33-001a4aab830c@mon.a 2023-07-14T18:04:25.664 INFO:teuthology.orchestra.run.smithi163.stdout:systemctl: stderr Failed to reset failed state of unit ceph-bf7326ec-2270-11ee-9b33-001a4aab830c@mon.a.service: Unit ceph-bf7326ec-2270-11ee-9b33-001a4aab830c@mon.a.service not loaded. 2023-07-14T18:04:25.750 INFO:teuthology.orchestra.run.smithi163.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-bf7326ec-2270-11ee-9b33-001a4aab830c.target.wants/ceph-bf7326ec-2270-11ee-9b33-001a4aab830c@mon.a.service → /etc/systemd/system/ceph-bf7326ec-2270-11ee-9b33-001a4aab830c@.service. 2023-07-14T18:04:26.052 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:04:25 smithi163 systemd[1]: Starting Ceph mon.a for bf7326ec-2270-11ee-9b33-001a4aab830c... 2023-07-14T18:04:26.343 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:04:26 smithi163 podman[96033]: 2023-07-14T18:04:26.344 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:04:26 smithi163 bash[96033]: da9ff882c77fc66bc05a2d9ce3e0e728448ac2b67b17cfa154a92dd8fc475121 2023-07-14T18:04:26.344 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:04:26 smithi163 ceph-mon[96073]: mkfs bf7326ec-2270-11ee-9b33-001a4aab830c 2023-07-14T18:04:26.344 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:04:26 smithi163 ceph-mon[96073]: mon.a is new leader, mons a in quorum (ranks 0) 2023-07-14T18:04:26.355 INFO:teuthology.orchestra.run.smithi163.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2023-07-14T18:04:26.355 INFO:teuthology.orchestra.run.smithi163.stdout:systemctl: stdout disabled 2023-07-14T18:04:26.362 INFO:teuthology.orchestra.run.smithi163.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2023-07-14T18:04:26.362 INFO:teuthology.orchestra.run.smithi163.stdout:systemctl: stdout inactive 2023-07-14T18:04:26.362 INFO:teuthology.orchestra.run.smithi163.stdout:firewalld.service is not enabled 2023-07-14T18:04:26.362 INFO:teuthology.orchestra.run.smithi163.stdout:Not possible to enable service . firewalld.service is not available 2023-07-14T18:04:26.363 INFO:teuthology.orchestra.run.smithi163.stdout:Waiting for mon to start... 2023-07-14T18:04:26.363 INFO:teuthology.orchestra.run.smithi163.stdout:Waiting for mon... 2023-07-14T18:04:26.612 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:04:26 smithi163 systemd[1]: Started Ceph mon.a for bf7326ec-2270-11ee-9b33-001a4aab830c. 2023-07-14T18:04:27.314 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stdout cluster: 2023-07-14T18:04:27.315 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stdout id: bf7326ec-2270-11ee-9b33-001a4aab830c 2023-07-14T18:04:27.315 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stdout health: HEALTH_OK 2023-07-14T18:04:27.315 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stdout 2023-07-14T18:04:27.315 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stdout services: 2023-07-14T18:04:27.315 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stdout mon: 1 daemons, quorum a (age 0.646144s) 2023-07-14T18:04:27.315 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stdout mgr: no daemons active 2023-07-14T18:04:27.315 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stdout osd: 0 osds: 0 up, 0 in 2023-07-14T18:04:27.316 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stdout 2023-07-14T18:04:27.316 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stdout data: 2023-07-14T18:04:27.316 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stdout pools: 0 pools, 0 pgs 2023-07-14T18:04:27.316 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stdout objects: 0 objects, 0 B 2023-07-14T18:04:27.316 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stdout usage: 0 B used, 0 B / 0 B avail 2023-07-14T18:04:27.316 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stdout pgs: 2023-07-14T18:04:27.316 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stdout 2023-07-14T18:04:27.317 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:26.832+0000 7f3a7c9ec700 1 Processor -- start 2023-07-14T18:04:27.317 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:26.832+0000 7f3a7c9ec700 1 -- start start 2023-07-14T18:04:27.317 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:26.832+0000 7f3a7c9ec700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f3a781051f0 0x7f3a78105600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:04:27.317 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:26.832+0000 7f3a7c9ec700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a78105b40 con 0x7f3a781051f0 2023-07-14T18:04:27.317 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:26.832+0000 7f3a7659c700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f3a781051f0 0x7f3a78105600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:04:27.317 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:26.832+0000 7f3a7659c700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f3a781051f0 0x7f3a78105600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:54400/0 (socket says 172.21.15.163:54400) 2023-07-14T18:04:27.317 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:26.832+0000 7f3a7659c700 1 -- 172.21.15.163:0/1625740942 learned_addr learned my addr 172.21.15.163:0/1625740942 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:04:27.317 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:26.833+0000 7f3a7659c700 1 -- 172.21.15.163:0/1625740942 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a78105c80 con 0x7f3a781051f0 2023-07-14T18:04:27.318 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:26.833+0000 7f3a7659c700 1 --2- 172.21.15.163:0/1625740942 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f3a781051f0 0x7f3a78105600 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f3a680098a0 tx=0x7f3a68009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c47857e05fc460c4 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:04:27.318 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:26.833+0000 7f3a7559a700 1 -- 172.21.15.163:0/1625740942 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3a68004160 con 0x7f3a781051f0 2023-07-14T18:04:27.318 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:26.833+0000 7f3a7559a700 1 -- 172.21.15.163:0/1625740942 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a680042c0 con 0x7f3a781051f0 2023-07-14T18:04:27.318 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:26.833+0000 7f3a7559a700 1 -- 172.21.15.163:0/1625740942 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3a680045a0 con 0x7f3a781051f0 2023-07-14T18:04:27.318 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:26.834+0000 7f3a7c9ec700 1 -- 172.21.15.163:0/1625740942 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f3a781051f0 msgr2=0x7f3a78105600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:04:27.318 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:26.834+0000 7f3a7c9ec700 1 --2- 172.21.15.163:0/1625740942 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f3a781051f0 0x7f3a78105600 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f3a680098a0 tx=0x7f3a68009bb0 comp rx=0 tx=0).stop 2023-07-14T18:04:27.318 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:26.834+0000 7f3a7c9ec700 1 -- 172.21.15.163:0/1625740942 shutdown_connections 2023-07-14T18:04:27.318 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:26.834+0000 7f3a7c9ec700 1 --2- 172.21.15.163:0/1625740942 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f3a781051f0 0x7f3a78105600 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:04:27.319 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:26.834+0000 7f3a7c9ec700 1 -- 172.21.15.163:0/1625740942 >> 172.21.15.163:0/1625740942 conn(0x7f3a781008c0 msgr2=0x7f3a78102cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:04:27.319 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:26.834+0000 7f3a7c9ec700 1 -- 172.21.15.163:0/1625740942 shutdown_connections 2023-07-14T18:04:27.319 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:26.834+0000 7f3a7c9ec700 1 -- 172.21.15.163:0/1625740942 wait complete. 2023-07-14T18:04:27.319 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:26.834+0000 7f3a7c9ec700 1 Processor -- start 2023-07-14T18:04:27.319 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:26.834+0000 7f3a7c9ec700 1 -- start start 2023-07-14T18:04:27.319 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:26.835+0000 7f3a7c9ec700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f3a781051f0 0x7f3a78198820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:04:27.319 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:26.835+0000 7f3a7c9ec700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a78198d60 con 0x7f3a781051f0 2023-07-14T18:04:27.320 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:26.835+0000 7f3a7659c700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f3a781051f0 0x7f3a78198820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:04:27.320 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:26.835+0000 7f3a7659c700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f3a781051f0 0x7f3a78198820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:54402/0 (socket says 172.21.15.163:54402) 2023-07-14T18:04:27.320 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:26.835+0000 7f3a7659c700 1 -- 172.21.15.163:0/1089934319 learned_addr learned my addr 172.21.15.163:0/1089934319 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:04:27.320 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:26.835+0000 7f3a7659c700 1 -- 172.21.15.163:0/1089934319 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a68009550 con 0x7f3a781051f0 2023-07-14T18:04:27.320 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:26.835+0000 7f3a7659c700 1 --2- 172.21.15.163:0/1089934319 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f3a781051f0 0x7f3a78198820 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f3a78105f20 tx=0x7f3a68004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:04:27.320 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:26.835+0000 7f3a677fe700 1 -- 172.21.15.163:0/1089934319 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3a68011630 con 0x7f3a781051f0 2023-07-14T18:04:27.320 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:26.835+0000 7f3a677fe700 1 -- 172.21.15.163:0/1089934319 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a68011790 con 0x7f3a781051f0 2023-07-14T18:04:27.320 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:26.835+0000 7f3a7c9ec700 1 -- 172.21.15.163:0/1089934319 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3a78198f60 con 0x7f3a781051f0 2023-07-14T18:04:27.321 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:26.835+0000 7f3a677fe700 1 -- 172.21.15.163:0/1089934319 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3a68011a30 con 0x7f3a781051f0 2023-07-14T18:04:27.321 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:26.835+0000 7f3a7c9ec700 1 -- 172.21.15.163:0/1089934319 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a78199380 con 0x7f3a781051f0 2023-07-14T18:04:27.321 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:26.835+0000 7f3a677fe700 1 -- 172.21.15.163:0/1089934319 <== mon.0 v2:172.21.15.163:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f3a68022070 con 0x7f3a781051f0 2023-07-14T18:04:27.321 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:26.836+0000 7f3a677fe700 1 -- 172.21.15.163:0/1089934319 <== mon.0 v2:172.21.15.163:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f3a6801c450 con 0x7f3a781051f0 2023-07-14T18:04:27.321 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:26.836+0000 7f3a7c9ec700 1 -- 172.21.15.163:0/1089934319 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3a781065b0 con 0x7f3a781051f0 2023-07-14T18:04:27.321 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:26.839+0000 7f3a677fe700 1 -- 172.21.15.163:0/1089934319 <== mon.0 v2:172.21.15.163:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72446 (secure 0 0 0) 0x7f3a6801b450 con 0x7f3a781051f0 2023-07-14T18:04:27.321 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:26.907+0000 7f3a7c9ec700 1 -- 172.21.15.163:0/1089934319 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "status"} v 0) v1 -- 0x7f3a78191d70 con 0x7f3a781051f0 2023-07-14T18:04:27.322 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:26.907+0000 7f3a677fe700 1 -- 172.21.15.163:0/1089934319 <== mon.0 v2:172.21.15.163:3300/0 7 ==== mon_command_ack([{"prefix": "status"}]=0 v0) v1 ==== 54+0+317 (secure 0 0 0) 0x7f3a6801b5f0 con 0x7f3a781051f0 2023-07-14T18:04:27.322 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:26.908+0000 7f3a7c9ec700 1 -- 172.21.15.163:0/1089934319 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f3a781051f0 msgr2=0x7f3a78198820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:04:27.322 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:26.908+0000 7f3a7c9ec700 1 --2- 172.21.15.163:0/1089934319 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f3a781051f0 0x7f3a78198820 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f3a78105f20 tx=0x7f3a68004750 comp rx=0 tx=0).stop 2023-07-14T18:04:27.322 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:26.908+0000 7f3a7c9ec700 1 -- 172.21.15.163:0/1089934319 shutdown_connections 2023-07-14T18:04:27.322 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:26.908+0000 7f3a7c9ec700 1 --2- 172.21.15.163:0/1089934319 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f3a781051f0 0x7f3a78198820 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:04:27.322 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:26.908+0000 7f3a7c9ec700 1 -- 172.21.15.163:0/1089934319 >> 172.21.15.163:0/1089934319 conn(0x7f3a781008c0 msgr2=0x7f3a7818cc50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:04:27.322 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:26.908+0000 7f3a7c9ec700 1 -- 172.21.15.163:0/1089934319 shutdown_connections 2023-07-14T18:04:27.322 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:26.908+0000 7f3a7c9ec700 1 -- 172.21.15.163:0/1089934319 wait complete. 2023-07-14T18:04:27.323 INFO:teuthology.orchestra.run.smithi163.stdout:mon is available 2023-07-14T18:04:27.323 INFO:teuthology.orchestra.run.smithi163.stdout:Assimilating anything we can from ceph.conf... 2023-07-14T18:04:27.526 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:04:27 smithi163 ceph-mon[96073]: mon.a is new leader, mons a in quorum (ranks 0) 2023-07-14T18:04:27.527 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:04:27 smithi163 ceph-mon[96073]: monmap e1: 1 mons at {a=[v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0]} removed_ranks: {} 2023-07-14T18:04:27.527 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:04:27 smithi163 ceph-mon[96073]: fsmap 2023-07-14T18:04:27.527 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:04:27 smithi163 ceph-mon[96073]: osdmap e1: 0 total, 0 up, 0 in 2023-07-14T18:04:27.527 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:04:27 smithi163 ceph-mon[96073]: mgrmap e1: no daemons active 2023-07-14T18:04:27.527 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:04:27 smithi163 ceph-mon[96073]: from='client.? 172.21.15.163:0/1089934319' entity='client.admin' cmd=[{"prefix": "status"}]: dispatch 2023-07-14T18:04:28.259 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stdout 2023-07-14T18:04:28.260 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stdout [global] 2023-07-14T18:04:28.260 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stdout fsid = bf7326ec-2270-11ee-9b33-001a4aab830c 2023-07-14T18:04:28.260 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stdout mon_host = [v2:172.21.15.163:3300,v1:172.21.15.163:6789] 2023-07-14T18:04:28.260 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2023-07-14T18:04:28.260 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2023-07-14T18:04:28.261 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2023-07-14T18:04:28.261 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2023-07-14T18:04:28.261 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stdout 2023-07-14T18:04:28.261 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stdout [mgr] 2023-07-14T18:04:28.261 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2023-07-14T18:04:28.261 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stdout 2023-07-14T18:04:28.261 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stdout [osd] 2023-07-14T18:04:28.262 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2023-07-14T18:04:28.262 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2023-07-14T18:04:28.262 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2023-07-14T18:04:28.262 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2023-07-14T18:04:28.262 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2023-07-14T18:04:28.262 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:27.753+0000 7fd28fac2700 1 Processor -- start 2023-07-14T18:04:28.262 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:27.754+0000 7fd28fac2700 1 -- start start 2023-07-14T18:04:28.263 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:27.754+0000 7fd28fac2700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fd288105d30 0x7fd288108110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:04:28.263 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:27.754+0000 7fd28fac2700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd288079d10 con 0x7fd288105d30 2023-07-14T18:04:28.263 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:27.754+0000 7fd28d85e700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fd288105d30 0x7fd288108110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:04:28.263 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:27.754+0000 7fd28d85e700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fd288105d30 0x7fd288108110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:54404/0 (socket says 172.21.15.163:54404) 2023-07-14T18:04:28.263 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:27.754+0000 7fd28d85e700 1 -- 172.21.15.163:0/970888829 learned_addr learned my addr 172.21.15.163:0/970888829 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:04:28.263 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:27.754+0000 7fd28d85e700 1 -- 172.21.15.163:0/970888829 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd288079e50 con 0x7fd288105d30 2023-07-14T18:04:28.263 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:27.754+0000 7fd28d85e700 1 --2- 172.21.15.163:0/970888829 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fd288105d30 0x7fd288108110 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7fd2780098a0 tx=0x7fd278009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bffa1ae27a107f15 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:04:28.264 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:27.755+0000 7fd28c85c700 1 -- 172.21.15.163:0/970888829 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd278004160 con 0x7fd288105d30 2023-07-14T18:04:28.264 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:27.755+0000 7fd28c85c700 1 -- 172.21.15.163:0/970888829 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2780042c0 con 0x7fd288105d30 2023-07-14T18:04:28.264 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:27.755+0000 7fd28c85c700 1 -- 172.21.15.163:0/970888829 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd2780045a0 con 0x7fd288105d30 2023-07-14T18:04:28.264 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:27.755+0000 7fd28fac2700 1 -- 172.21.15.163:0/970888829 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fd288105d30 msgr2=0x7fd288108110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:04:28.264 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:27.755+0000 7fd28fac2700 1 --2- 172.21.15.163:0/970888829 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fd288105d30 0x7fd288108110 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7fd2780098a0 tx=0x7fd278009bb0 comp rx=0 tx=0).stop 2023-07-14T18:04:28.264 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:27.755+0000 7fd28fac2700 1 -- 172.21.15.163:0/970888829 shutdown_connections 2023-07-14T18:04:28.264 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:27.755+0000 7fd28fac2700 1 --2- 172.21.15.163:0/970888829 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fd288105d30 0x7fd288108110 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:04:28.265 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:27.755+0000 7fd28fac2700 1 -- 172.21.15.163:0/970888829 >> 172.21.15.163:0/970888829 conn(0x7fd2880ff770 msgr2=0x7fd288101b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:04:28.265 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:27.755+0000 7fd28fac2700 1 -- 172.21.15.163:0/970888829 shutdown_connections 2023-07-14T18:04:28.265 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:27.755+0000 7fd28fac2700 1 -- 172.21.15.163:0/970888829 wait complete. 2023-07-14T18:04:28.265 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:27.756+0000 7fd28fac2700 1 Processor -- start 2023-07-14T18:04:28.265 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:27.756+0000 7fd28fac2700 1 -- start start 2023-07-14T18:04:28.265 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:27.756+0000 7fd28fac2700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fd288105d30 0x7fd288103ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:04:28.265 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:27.756+0000 7fd28fac2700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd288105870 con 0x7fd288105d30 2023-07-14T18:04:28.266 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:27.756+0000 7fd28d85e700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fd288105d30 0x7fd288103ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:04:28.266 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:27.756+0000 7fd28d85e700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fd288105d30 0x7fd288103ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:54406/0 (socket says 172.21.15.163:54406) 2023-07-14T18:04:28.266 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:27.756+0000 7fd28d85e700 1 -- 172.21.15.163:0/3429165838 learned_addr learned my addr 172.21.15.163:0/3429165838 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:04:28.266 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:27.757+0000 7fd28d85e700 1 -- 172.21.15.163:0/3429165838 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd278009550 con 0x7fd288105d30 2023-07-14T18:04:28.266 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:27.757+0000 7fd28d85e700 1 --2- 172.21.15.163:0/3429165838 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fd288105d30 0x7fd288103ce0 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7fd278004000 tx=0x7fd278004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:04:28.266 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:27.757+0000 7fd27effd700 1 -- 172.21.15.163:0/3429165838 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd278011630 con 0x7fd288105d30 2023-07-14T18:04:28.266 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:27.757+0000 7fd27effd700 1 -- 172.21.15.163:0/3429165838 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd278011790 con 0x7fd288105d30 2023-07-14T18:04:28.267 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:27.757+0000 7fd28fac2700 1 -- 172.21.15.163:0/3429165838 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd288105ad0 con 0x7fd288105d30 2023-07-14T18:04:28.267 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:27.757+0000 7fd27effd700 1 -- 172.21.15.163:0/3429165838 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd278011a30 con 0x7fd288105d30 2023-07-14T18:04:28.267 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:27.757+0000 7fd28fac2700 1 -- 172.21.15.163:0/3429165838 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2881043f0 con 0x7fd288105d30 2023-07-14T18:04:28.267 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:27.757+0000 7fd27effd700 1 -- 172.21.15.163:0/3429165838 <== mon.0 v2:172.21.15.163:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fd278022070 con 0x7fd288105d30 2023-07-14T18:04:28.267 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:27.757+0000 7fd27effd700 1 -- 172.21.15.163:0/3429165838 <== mon.0 v2:172.21.15.163:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7fd27801c450 con 0x7fd288105d30 2023-07-14T18:04:28.267 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:27.758+0000 7fd28fac2700 1 -- 172.21.15.163:0/3429165838 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd288192460 con 0x7fd288105d30 2023-07-14T18:04:28.268 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:27.760+0000 7fd27effd700 1 -- 172.21.15.163:0/3429165838 <== mon.0 v2:172.21.15.163:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72446 (secure 0 0 0) 0x7fd27801b450 con 0x7fd288105d30 2023-07-14T18:04:28.268 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:27.826+0000 7fd28fac2700 1 -- 172.21.15.163:0/3429165838 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) v1 -- 0x7fd28802cd40 con 0x7fd288105d30 2023-07-14T18:04:28.268 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:27.829+0000 7fd27effd700 1 -- 172.21.15.163:0/3429165838 <== mon.0 v2:172.21.15.163:3300/0 7 ==== config(25 keys) v1 ==== 1036+0+0 (secure 0 0 0) 0x7fd27801b5f0 con 0x7fd288105d30 2023-07-14T18:04:28.268 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:27.829+0000 7fd27effd700 1 -- 172.21.15.163:0/3429165838 <== mon.0 v2:172.21.15.163:3300/0 8 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v2) v1 ==== 70+0+431 (secure 0 0 0) 0x7fd278036590 con 0x7fd288105d30 2023-07-14T18:04:28.268 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:27.830+0000 7fd28fac2700 1 -- 172.21.15.163:0/3429165838 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fd288105d30 msgr2=0x7fd288103ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:04:28.268 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:27.830+0000 7fd28fac2700 1 --2- 172.21.15.163:0/3429165838 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fd288105d30 0x7fd288103ce0 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7fd278004000 tx=0x7fd278004750 comp rx=0 tx=0).stop 2023-07-14T18:04:28.268 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:27.830+0000 7fd28fac2700 1 -- 172.21.15.163:0/3429165838 shutdown_connections 2023-07-14T18:04:28.269 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:27.830+0000 7fd28fac2700 1 --2- 172.21.15.163:0/3429165838 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fd288105d30 0x7fd288103ce0 unknown :-1 s=CLOSED pgs=4 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:04:28.269 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:27.830+0000 7fd28fac2700 1 -- 172.21.15.163:0/3429165838 >> 172.21.15.163:0/3429165838 conn(0x7fd2880ff770 msgr2=0x7fd288101110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:04:28.269 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:27.830+0000 7fd28fac2700 1 -- 172.21.15.163:0/3429165838 shutdown_connections 2023-07-14T18:04:28.269 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:27.830+0000 7fd28fac2700 1 -- 172.21.15.163:0/3429165838 wait complete. 2023-07-14T18:04:28.269 INFO:teuthology.orchestra.run.smithi163.stdout:Generating new minimal ceph.conf... 2023-07-14T18:04:28.705 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:04:28 smithi163 ceph-mon[96073]: from='client.? 172.21.15.163:0/3429165838' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2023-07-14T18:04:28.706 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:04:28 smithi163 ceph-mon[96073]: from='client.? 172.21.15.163:0/3429165838' entity='client.admin' cmd='[{"prefix": "config assimilate-conf"}]': finished 2023-07-14T18:04:29.204 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:28.687+0000 7f4840628700 1 Processor -- start 2023-07-14T18:04:29.204 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:28.687+0000 7f4840628700 1 -- start start 2023-07-14T18:04:29.204 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:28.687+0000 7f4840628700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f48381045e0 0x7f48381049f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:04:29.205 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:28.687+0000 7f4840628700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4838104f30 con 0x7f48381045e0 2023-07-14T18:04:29.205 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:28.687+0000 7f483e3c4700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f48381045e0 0x7f48381049f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:04:29.205 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:28.687+0000 7f483e3c4700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f48381045e0 0x7f48381049f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:54408/0 (socket says 172.21.15.163:54408) 2023-07-14T18:04:29.205 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:28.687+0000 7f483e3c4700 1 -- 172.21.15.163:0/1700498735 learned_addr learned my addr 172.21.15.163:0/1700498735 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:04:29.205 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:28.687+0000 7f483e3c4700 1 -- 172.21.15.163:0/1700498735 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4838105070 con 0x7f48381045e0 2023-07-14T18:04:29.205 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:28.688+0000 7f483e3c4700 1 --2- 172.21.15.163:0/1700498735 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f48381045e0 0x7f48381049f0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f48280098a0 tx=0x7f4828009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac4dba4314cade4c server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:04:29.205 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:28.688+0000 7f483d3c2700 1 -- 172.21.15.163:0/1700498735 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4828004160 con 0x7f48381045e0 2023-07-14T18:04:29.206 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:28.688+0000 7f483d3c2700 1 -- 172.21.15.163:0/1700498735 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(25 keys) v1 ==== 1036+0+0 (secure 0 0 0) 0x7f48280042c0 con 0x7f48381045e0 2023-07-14T18:04:29.206 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:28.688+0000 7f483d3c2700 1 -- 172.21.15.163:0/1700498735 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4828011940 con 0x7f48381045e0 2023-07-14T18:04:29.206 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:28.688+0000 7f4840628700 1 -- 172.21.15.163:0/1700498735 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f48381045e0 msgr2=0x7f48381049f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:04:29.206 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:28.688+0000 7f4840628700 1 --2- 172.21.15.163:0/1700498735 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f48381045e0 0x7f48381049f0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f48280098a0 tx=0x7f4828009bb0 comp rx=0 tx=0).stop 2023-07-14T18:04:29.206 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:28.688+0000 7f4840628700 1 -- 172.21.15.163:0/1700498735 shutdown_connections 2023-07-14T18:04:29.206 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:28.688+0000 7f4840628700 1 --2- 172.21.15.163:0/1700498735 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f48381045e0 0x7f48381049f0 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:04:29.206 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:28.688+0000 7f4840628700 1 -- 172.21.15.163:0/1700498735 >> 172.21.15.163:0/1700498735 conn(0x7f48380feef0 msgr2=0x7f4838101300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:04:29.207 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:28.688+0000 7f4840628700 1 -- 172.21.15.163:0/1700498735 shutdown_connections 2023-07-14T18:04:29.207 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:28.688+0000 7f4840628700 1 -- 172.21.15.163:0/1700498735 wait complete. 2023-07-14T18:04:29.207 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:28.689+0000 7f4840628700 1 Processor -- start 2023-07-14T18:04:29.207 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:28.689+0000 7f4840628700 1 -- start start 2023-07-14T18:04:29.207 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:28.689+0000 7f4840628700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f48381045e0 0x7f4838197eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:04:29.207 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:28.690+0000 7f4840628700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48381983f0 con 0x7f48381045e0 2023-07-14T18:04:29.208 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:28.690+0000 7f483e3c4700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f48381045e0 0x7f4838197eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:04:29.208 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:28.690+0000 7f483e3c4700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f48381045e0 0x7f4838197eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:54410/0 (socket says 172.21.15.163:54410) 2023-07-14T18:04:29.208 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:28.690+0000 7f483e3c4700 1 -- 172.21.15.163:0/1565627769 learned_addr learned my addr 172.21.15.163:0/1565627769 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:04:29.208 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:28.690+0000 7f483e3c4700 1 -- 172.21.15.163:0/1565627769 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4828009550 con 0x7f48381045e0 2023-07-14T18:04:29.208 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:28.690+0000 7f483e3c4700 1 --2- 172.21.15.163:0/1565627769 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f48381045e0 0x7f4838197eb0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f4828000c00 tx=0x7f4828011e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:04:29.208 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:28.690+0000 7f482f7fe700 1 -- 172.21.15.163:0/1565627769 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f48280036a0 con 0x7f48381045e0 2023-07-14T18:04:29.208 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:28.690+0000 7f482f7fe700 1 -- 172.21.15.163:0/1565627769 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(25 keys) v1 ==== 1036+0+0 (secure 0 0 0) 0x7f482801b440 con 0x7f48381045e0 2023-07-14T18:04:29.209 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:28.690+0000 7f4840628700 1 -- 172.21.15.163:0/1565627769 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f48381985f0 con 0x7f48381045e0 2023-07-14T18:04:29.209 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:28.690+0000 7f482f7fe700 1 -- 172.21.15.163:0/1565627769 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f48280193f0 con 0x7f48381045e0 2023-07-14T18:04:29.209 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:28.690+0000 7f4840628700 1 -- 172.21.15.163:0/1565627769 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4838198a10 con 0x7f48381045e0 2023-07-14T18:04:29.209 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:28.690+0000 7f482f7fe700 1 -- 172.21.15.163:0/1565627769 <== mon.0 v2:172.21.15.163:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f48280198e0 con 0x7f48381045e0 2023-07-14T18:04:29.209 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:28.690+0000 7f482f7fe700 1 -- 172.21.15.163:0/1565627769 <== mon.0 v2:172.21.15.163:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f482801a710 con 0x7f48381045e0 2023-07-14T18:04:29.209 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:28.691+0000 7f482d7fa700 1 -- 172.21.15.163:0/1565627769 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f48200052f0 con 0x7f48381045e0 2023-07-14T18:04:29.209 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:28.693+0000 7f482f7fe700 1 -- 172.21.15.163:0/1565627769 <== mon.0 v2:172.21.15.163:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72446 (secure 0 0 0) 0x7f4828029060 con 0x7f48381045e0 2023-07-14T18:04:29.210 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:28.760+0000 7f482d7fa700 1 -- 172.21.15.163:0/1565627769 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) v1 -- 0x7f4820005c90 con 0x7f48381045e0 2023-07-14T18:04:29.210 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:28.760+0000 7f482f7fe700 1 -- 172.21.15.163:0/1565627769 <== mon.0 v2:172.21.15.163:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v2) v1 ==== 76+0+177 (secure 0 0 0) 0x7f482801f070 con 0x7f48381045e0 2023-07-14T18:04:29.210 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:28.761+0000 7f482d7fa700 1 -- 172.21.15.163:0/1565627769 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f48381045e0 msgr2=0x7f4838197eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:04:29.210 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:28.761+0000 7f482d7fa700 1 --2- 172.21.15.163:0/1565627769 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f48381045e0 0x7f4838197eb0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f4828000c00 tx=0x7f4828011e70 comp rx=0 tx=0).stop 2023-07-14T18:04:29.210 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:28.761+0000 7f482d7fa700 1 -- 172.21.15.163:0/1565627769 shutdown_connections 2023-07-14T18:04:29.210 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:28.761+0000 7f482d7fa700 1 --2- 172.21.15.163:0/1565627769 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f48381045e0 0x7f4838197eb0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:04:29.210 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:28.761+0000 7f482d7fa700 1 -- 172.21.15.163:0/1565627769 >> 172.21.15.163:0/1565627769 conn(0x7f48380feef0 msgr2=0x7f48380ffc80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:04:29.211 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:28.761+0000 7f482d7fa700 1 -- 172.21.15.163:0/1565627769 shutdown_connections 2023-07-14T18:04:29.211 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:28.761+0000 7f482d7fa700 1 -- 172.21.15.163:0/1565627769 wait complete. 2023-07-14T18:04:29.211 INFO:teuthology.orchestra.run.smithi163.stdout:Restarting the monitor... 2023-07-14T18:04:29.455 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:04:29 smithi163 systemd[1]: Stopping Ceph mon.a for bf7326ec-2270-11ee-9b33-001a4aab830c... 2023-07-14T18:04:29.455 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:04:29 smithi163 ceph-mon[96073]: from='client.? 172.21.15.163:0/1565627769' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T18:04:29.811 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:04:29 smithi163 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-mon-a[96049]: 2023-07-14T18:04:29.509+0000 7fd5c0f16700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2023-07-14T18:04:29.812 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:04:29 smithi163 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-mon-a[96049]: 2023-07-14T18:04:29.509+0000 7fd5c0f16700 -1 mon.a@0(leader) e1 *** Got Signal Terminated *** 2023-07-14T18:04:30.170 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:04:29 smithi163 bash[96413]: ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-mon-a 2023-07-14T18:04:30.455 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:04:30 smithi163 systemd[1]: ceph-bf7326ec-2270-11ee-9b33-001a4aab830c@mon.a.service: Succeeded. 2023-07-14T18:04:30.456 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:04:30 smithi163 systemd[1]: Stopped Ceph mon.a for bf7326ec-2270-11ee-9b33-001a4aab830c. 2023-07-14T18:04:30.456 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:04:30 smithi163 systemd[1]: Starting Ceph mon.a for bf7326ec-2270-11ee-9b33-001a4aab830c... 2023-07-14T18:04:30.752 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:04:30 smithi163 podman[96537]: 2023-07-14T18:04:30.752 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:04:30 smithi163 ceph-mon[96576]: set uid:gid to 167:167 (ceph:ceph) 2023-07-14T18:04:30.752 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:04:30 smithi163 ceph-mon[96576]: ceph version 18.0.0-4940-g81c9387d (81c9387d2e7576da065747ec9c16d1c7d69016ec) reef (dev), process ceph-mon, pid 7 2023-07-14T18:04:30.753 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:04:30 smithi163 ceph-mon[96576]: pidfile_write: ignore empty --pid-file 2023-07-14T18:04:30.753 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:04:30 smithi163 bash[96537]: 67f0da97dc0309f59f044ac28f80549ac91663e55b8165e21d7f1ffb4ef961d9 2023-07-14T18:04:30.753 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:04:30 smithi163 ceph-mon[96576]: load: jerasure load: lrc 2023-07-14T18:04:30.753 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:04:30 smithi163 ceph-mon[96576]: rocksdb: RocksDB version: 7.9.2 2023-07-14T18:04:30.753 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:04:30 smithi163 ceph-mon[96576]: rocksdb: Git sha 0 2023-07-14T18:04:30.754 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:04:30 smithi163 ceph-mon[96576]: rocksdb: Compile date 2023-07-14 14:45:42 2023-07-14T18:04:30.754 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:04:30 smithi163 ceph-mon[96576]: rocksdb: DB SUMMARY 2023-07-14T18:04:30.754 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:04:30 smithi163 ceph-mon[96576]: rocksdb: DB Session ID: 6NP9LD6TM988GU912Q4U 2023-07-14T18:04:30.754 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:04:30 smithi163 ceph-mon[96576]: rocksdb: CURRENT file: CURRENT 2023-07-14T18:04:30.754 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:04:30 smithi163 ceph-mon[96576]: rocksdb: IDENTITY file: IDENTITY 2023-07-14T18:04:30.754 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:04:30 smithi163 ceph-mon[96576]: rocksdb: MANIFEST file: MANIFEST-000010 size: 179 Bytes 2023-07-14T18:04:30.754 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:04:30 smithi163 ceph-mon[96576]: rocksdb: SST files in /var/lib/ceph/mon/ceph-a/store.db dir, Total Num: 1, files: 000008.sst 2023-07-14T18:04:30.754 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:04:30 smithi163 ceph-mon[96576]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-a/store.db: 000009.log size: 97742 ; 2023-07-14T18:04:30.755 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:04:30 smithi163 ceph-mon[96576]: rocksdb: Options.error_if_exists: 0 2023-07-14T18:04:30.755 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:04:30 smithi163 ceph-mon[96576]: rocksdb: Options.create_if_missing: 0 2023-07-14T18:04:30.755 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:04:30 smithi163 ceph-mon[96576]: rocksdb: Options.paranoid_checks: 1 2023-07-14T18:04:30.755 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:04:30 smithi163 ceph-mon[96576]: rocksdb: Options.flush_verify_memtable_count: 1 2023-07-14T18:04:30.755 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:04:30 smithi163 ceph-mon[96576]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2023-07-14T18:04:30.755 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:04:30 smithi163 ceph-mon[96576]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2023-07-14T18:04:30.755 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:04:30 smithi163 ceph-mon[96576]: rocksdb: Options.env: 0x556fb9e5ec60 2023-07-14T18:04:30.756 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:04:30 smithi163 ceph-mon[96576]: rocksdb: Options.fs: PosixFileSystem 2023-07-14T18:04:30.756 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:04:30 smithi163 ceph-mon[96576]: rocksdb: Options.info_log: 0x556fbaa432a0 2023-07-14T18:04:30.756 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:04:30 smithi163 ceph-mon[96576]: rocksdb: Options.max_file_opening_threads: 16 2023-07-14T18:04:30.756 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:04:30 smithi163 ceph-mon[96576]: rocksdb: Options.statistics: (nil) 2023-07-14T18:04:30.756 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:04:30 smithi163 ceph-mon[96576]: rocksdb: Options.use_fsync: 0 2023-07-14T18:04:30.756 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:04:30 smithi163 ceph-mon[96576]: rocksdb: Options.max_log_file_size: 0 2023-07-14T18:04:30.756 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:04:30 smithi163 ceph-mon[96576]: rocksdb: Options.max_manifest_file_size: 1073741824 2023-07-14T18:04:30.756 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:04:30 smithi163 ceph-mon[96576]: rocksdb: Options.log_file_time_to_roll: 0 2023-07-14T18:04:30.757 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:04:30 smithi163 ceph-mon[96576]: rocksdb: Options.keep_log_file_num: 1000 2023-07-14T18:04:30.757 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:04:30 smithi163 ceph-mon[96576]: rocksdb: Options.recycle_log_file_num: 0 2023-07-14T18:04:30.757 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:04:30 smithi163 ceph-mon[96576]: rocksdb: Options.allow_fallocate: 1 2023-07-14T18:04:30.757 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:04:30 smithi163 ceph-mon[96576]: rocksdb: Options.allow_mmap_reads: 0 2023-07-14T18:04:30.757 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:04:30 smithi163 ceph-mon[96576]: rocksdb: Options.allow_mmap_writes: 0 2023-07-14T18:04:30.757 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:04:30 smithi163 ceph-mon[96576]: rocksdb: Options.use_direct_reads: 0 2023-07-14T18:04:30.757 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:04:30 smithi163 ceph-mon[96576]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2023-07-14T18:04:30.757 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:04:30 smithi163 ceph-mon[96576]: rocksdb: Options.create_missing_column_families: 0 2023-07-14T18:04:30.758 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:04:30 smithi163 ceph-mon[96576]: rocksdb: Options.db_log_dir: 2023-07-14T18:04:30.758 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:04:30 smithi163 ceph-mon[96576]: rocksdb: Options.wal_dir: 2023-07-14T18:04:30.758 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:04:30 smithi163 ceph-mon[96576]: rocksdb: Options.table_cache_numshardbits: 6 2023-07-14T18:04:30.758 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:04:30 smithi163 ceph-mon[96576]: rocksdb: Options.WAL_ttl_seconds: 0 2023-07-14T18:04:30.758 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:04:30 smithi163 ceph-mon[96576]: rocksdb: Options.WAL_size_limit_MB: 0 2023-07-14T18:04:30.758 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:04:30 smithi163 ceph-mon[96576]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2023-07-14T18:04:30.758 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:04:30 smithi163 ceph-mon[96576]: rocksdb: Options.manifest_preallocation_size: 4194304 2023-07-14T18:04:30.759 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:04:30 smithi163 ceph-mon[96576]: rocksdb: Options.is_fd_close_on_exec: 1 2023-07-14T18:04:30.759 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:04:30 smithi163 ceph-mon[96576]: rocksdb: Options.advise_random_on_open: 1 2023-07-14T18:04:30.759 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:04:30 smithi163 ceph-mon[96576]: rocksdb: Options.db_write_buffer_size: 0 2023-07-14T18:04:30.759 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:04:30 smithi163 ceph-mon[96576]: rocksdb: Options.write_buffer_manager: 0x556fba9643c0 2023-07-14T18:04:30.759 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:04:30 smithi163 ceph-mon[96576]: rocksdb: Options.access_hint_on_compaction_start: 1 2023-07-14T18:04:30.759 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:04:30 smithi163 ceph-mon[96576]: rocksdb: Options.random_access_max_buffer_size: 1048576 2023-07-14T18:04:30.759 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:04:30 smithi163 ceph-mon[96576]: rocksdb: Options.use_adaptive_mutex: 0 2023-07-14T18:04:30.760 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:04:30 smithi163 ceph-mon[96576]: rocksdb: Options.rate_limiter: (nil) 2023-07-14T18:04:30.760 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:04:30 smithi163 ceph-mon[96576]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2023-07-14T18:04:30.760 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:04:30 smithi163 ceph-mon[96576]: rocksdb: Options.wal_recovery_mode: 2 2023-07-14T18:04:30.760 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:04:30 smithi163 ceph-mon[96576]: rocksdb: Options.enable_thread_tracking: 0 2023-07-14T18:04:30.760 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:04:30 smithi163 ceph-mon[96576]: rocksdb: Options.enable_pipelined_write: 0 2023-07-14T18:04:30.760 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:04:30 smithi163 ceph-mon[96576]: rocksdb: Options.unordered_write: 0 2023-07-14T18:04:30.760 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:04:30 smithi163 ceph-mon[96576]: rocksdb: Options.allow_concurrent_memtable_write: 1 2023-07-14T18:04:30.760 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:04:30 smithi163 ceph-mon[96576]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2023-07-14T18:04:30.761 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:04:30 smithi163 ceph-mon[96576]: rocksdb: Options.write_thread_max_yield_usec: 100 2023-07-14T18:04:30.761 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:04:30 smithi163 ceph-mon[96576]: rocksdb: Options.write_thread_slow_yield_usec: 3 2023-07-14T18:04:30.761 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:04:30 smithi163 ceph-mon[96576]: rocksdb: Options.row_cache: None 2023-07-14T18:04:30.761 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:04:30 smithi163 ceph-mon[96576]: rocksdb: Options.wal_filter: None 2023-07-14T18:04:30.761 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:04:30 smithi163 ceph-mon[96576]: rocksdb: Options.avoid_flush_during_recovery: 0 2023-07-14T18:04:30.761 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:04:30 smithi163 ceph-mon[96576]: rocksdb: Options.allow_ingest_behind: 0 2023-07-14T18:04:30.761 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:04:30 smithi163 ceph-mon[96576]: rocksdb: Options.two_write_queues: 0 2023-07-14T18:04:30.761 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:04:30 smithi163 ceph-mon[96576]: rocksdb: Options.manual_wal_flush: 0 2023-07-14T18:04:30.762 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:04:30 smithi163 ceph-mon[96576]: rocksdb: Options.wal_compression: 0 2023-07-14T18:04:30.762 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:04:30 smithi163 ceph-mon[96576]: rocksdb: Options.atomic_flush: 0 2023-07-14T18:04:30.762 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:04:30 smithi163 ceph-mon[96576]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2023-07-14T18:04:30.762 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:04:30 smithi163 ceph-mon[96576]: rocksdb: Options.persist_stats_to_disk: 0 2023-07-14T18:04:30.762 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:04:30 smithi163 ceph-mon[96576]: rocksdb: Options.write_dbid_to_manifest: 0 2023-07-14T18:04:30.762 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:04:30 smithi163 ceph-mon[96576]: rocksdb: Options.log_readahead_size: 0 2023-07-14T18:04:30.762 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:04:30 smithi163 ceph-mon[96576]: rocksdb: Options.file_checksum_gen_factory: Unknown 2023-07-14T18:04:30.762 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:04:30 smithi163 ceph-mon[96576]: rocksdb: Options.best_efforts_recovery: 0 2023-07-14T18:04:30.763 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:04:30 smithi163 ceph-mon[96576]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2023-07-14T18:04:30.763 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:04:30 smithi163 ceph-mon[96576]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2023-07-14T18:04:30.763 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:04:30 smithi163 ceph-mon[96576]: rocksdb: Options.allow_data_in_errors: 0 2023-07-14T18:04:30.764 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:04:30 smithi163 ceph-mon[96576]: rocksdb: Options.db_host_id: __hostname__ 2023-07-14T18:04:30.764 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:04:30 smithi163 ceph-mon[96576]: rocksdb: Options.enforce_single_del_contracts: true 2023-07-14T18:04:30.764 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:04:30 smithi163 ceph-mon[96576]: rocksdb: Options.max_background_jobs: 2 2023-07-14T18:04:30.764 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:04:30 smithi163 ceph-mon[96576]: rocksdb: Options.max_background_compactions: -1 2023-07-14T18:04:30.765 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:04:30 smithi163 ceph-mon[96576]: rocksdb: Options.max_subcompactions: 1 2023-07-14T18:04:30.765 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:04:30 smithi163 ceph-mon[96576]: rocksdb: Options.avoid_flush_during_shutdown: 0 2023-07-14T18:04:30.765 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:04:30 smithi163 ceph-mon[96576]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2023-07-14T18:04:30.765 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:04:30 smithi163 ceph-mon[96576]: rocksdb: Options.delayed_write_rate : 16777216 2023-07-14T18:04:30.765 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:04:30 smithi163 ceph-mon[96576]: rocksdb: Options.max_total_wal_size: 0 2023-07-14T18:04:30.765 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:04:30 smithi163 ceph-mon[96576]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2023-07-14T18:04:30.766 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:04:30 smithi163 ceph-mon[96576]: rocksdb: Options.stats_dump_period_sec: 600 2023-07-14T18:04:30.766 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:04:30 smithi163 ceph-mon[96576]: rocksdb: Options.stats_persist_period_sec: 600 2023-07-14T18:04:30.766 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:04:30 smithi163 ceph-mon[96576]: rocksdb: Options.stats_history_buffer_size: 1048576 2023-07-14T18:04:30.766 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:04:30 smithi163 ceph-mon[96576]: rocksdb: Options.max_open_files: -1 2023-07-14T18:04:30.766 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:04:30 smithi163 ceph-mon[96576]: rocksdb: Options.bytes_per_sync: 0 2023-07-14T18:04:30.766 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:04:30 smithi163 ceph-mon[96576]: rocksdb: Options.wal_bytes_per_sync: 0 2023-07-14T18:04:30.766 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:04:30 smithi163 ceph-mon[96576]: rocksdb: Options.strict_bytes_per_sync: 0 2023-07-14T18:04:30.767 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:04:30 smithi163 ceph-mon[96576]: rocksdb: Options.compaction_readahead_size: 0 2023-07-14T18:04:30.767 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:04:30 smithi163 ceph-mon[96576]: rocksdb: Options.max_background_flushes: -1 2023-07-14T18:04:30.767 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:04:30 smithi163 ceph-mon[96576]: rocksdb: Compression algorithms supported: 2023-07-14T18:04:30.767 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:04:30 smithi163 ceph-mon[96576]: rocksdb: kZSTDNotFinalCompression supported: 0 2023-07-14T18:04:30.767 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:04:30 smithi163 ceph-mon[96576]: rocksdb: kZSTD supported: 0 2023-07-14T18:04:30.767 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:04:30 smithi163 ceph-mon[96576]: rocksdb: kXpressCompression supported: 0 2023-07-14T18:04:30.767 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:04:30 smithi163 ceph-mon[96576]: rocksdb: kLZ4HCCompression supported: 1 2023-07-14T18:04:30.768 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:04:30 smithi163 ceph-mon[96576]: rocksdb: kZlibCompression supported: 1 2023-07-14T18:04:30.768 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:04:30 smithi163 ceph-mon[96576]: rocksdb: kSnappyCompression supported: 1 2023-07-14T18:04:30.768 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:04:30 smithi163 ceph-mon[96576]: rocksdb: kLZ4Compression supported: 1 2023-07-14T18:04:30.768 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:04:30 smithi163 ceph-mon[96576]: rocksdb: kBZip2Compression supported: 0 2023-07-14T18:04:30.768 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:04:30 smithi163 ceph-mon[96576]: rocksdb: Fast CRC32 supported: Supported on x86 2023-07-14T18:04:30.768 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:04:30 smithi163 ceph-mon[96576]: rocksdb: DMutex implementation: pthread_mutex_t 2023-07-14T18:04:30.768 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:04:30 smithi163 ceph-mon[96576]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 2023-07-14T18:04:30.768 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:04:30 smithi163 ceph-mon[96576]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2023-07-14T18:04:30.769 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:04:30 smithi163 ceph-mon[96576]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2023-07-14T18:04:30.769 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:04:30 smithi163 ceph-mon[96576]: rocksdb: Options.merge_operator: 2023-07-14T18:04:30.769 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:04:30 smithi163 ceph-mon[96576]: rocksdb: Options.compaction_filter: None 2023-07-14T18:04:30.769 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:04:30 smithi163 ceph-mon[96576]: rocksdb: Options.compaction_filter_factory: None 2023-07-14T18:04:30.769 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:04:30 smithi163 ceph-mon[96576]: rocksdb: Options.sst_partitioner_factory: None 2023-07-14T18:04:30.769 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:04:30 smithi163 ceph-mon[96576]: rocksdb: Options.memtable_factory: SkipListFactory 2023-07-14T18:04:30.769 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:04:30 smithi163 ceph-mon[96576]: rocksdb: Options.table_factory: BlockBasedTable 2023-07-14T18:04:30.770 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:04:30 smithi163 ceph-mon[96576]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x556fbaa433a0) 2023-07-14T18:04:30.770 INFO:journalctl@ceph.mon.a.smithi163.stdout: cache_index_and_filter_blocks: 1 2023-07-14T18:04:30.770 INFO:journalctl@ceph.mon.a.smithi163.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2023-07-14T18:04:30.770 INFO:journalctl@ceph.mon.a.smithi163.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2023-07-14T18:04:30.770 INFO:journalctl@ceph.mon.a.smithi163.stdout: pin_top_level_index_and_filter: 1 2023-07-14T18:04:30.770 INFO:journalctl@ceph.mon.a.smithi163.stdout: index_type: 0 2023-07-14T18:04:30.770 INFO:journalctl@ceph.mon.a.smithi163.stdout: data_block_index_type: 0 2023-07-14T18:04:30.771 INFO:journalctl@ceph.mon.a.smithi163.stdout: index_shortening: 1 2023-07-14T18:04:30.771 INFO:journalctl@ceph.mon.a.smithi163.stdout: data_block_hash_table_util_ratio: 0.750000 2023-07-14T18:04:30.771 INFO:journalctl@ceph.mon.a.smithi163.stdout: checksum: 4 2023-07-14T18:04:30.771 INFO:journalctl@ceph.mon.a.smithi163.stdout: no_block_cache: 0 2023-07-14T18:04:30.771 INFO:journalctl@ceph.mon.a.smithi163.stdout: block_cache: 0x556fbaa031f0 2023-07-14T18:04:30.771 INFO:journalctl@ceph.mon.a.smithi163.stdout: block_cache_name: BinnedLRUCache 2023-07-14T18:04:30.772 INFO:journalctl@ceph.mon.a.smithi163.stdout: block_cache_options: 2023-07-14T18:04:30.772 INFO:journalctl@ceph.mon.a.smithi163.stdout: capacity : 536870912 2023-07-14T18:04:30.772 INFO:journalctl@ceph.mon.a.smithi163.stdout: num_shard_bits : 4 2023-07-14T18:04:30.772 INFO:journalctl@ceph.mon.a.smithi163.stdout: strict_capacity_limit : 0 2023-07-14T18:04:30.772 INFO:journalctl@ceph.mon.a.smithi163.stdout: high_pri_pool_ratio: 0.000 2023-07-14T18:04:30.772 INFO:journalctl@ceph.mon.a.smithi163.stdout: block_cache_compressed: (nil) 2023-07-14T18:04:30.772 INFO:journalctl@ceph.mon.a.smithi163.stdout: persistent_cache: (nil) 2023-07-14T18:04:30.773 INFO:journalctl@ceph.mon.a.smithi163.stdout: block_size: 4096 2023-07-14T18:04:30.773 INFO:journalctl@ceph.mon.a.smithi163.stdout: block_size_deviation: 10 2023-07-14T18:04:30.773 INFO:journalctl@ceph.mon.a.smithi163.stdout: block_restart_interval: 16 2023-07-14T18:04:30.773 INFO:journalctl@ceph.mon.a.smithi163.stdout: index_block_restart_interval: 1 2023-07-14T18:04:30.773 INFO:journalctl@ceph.mon.a.smithi163.stdout: metadata_block_size: 4096 2023-07-14T18:04:30.773 INFO:journalctl@ceph.mon.a.smithi163.stdout: partition_filters: 0 2023-07-14T18:04:30.773 INFO:journalctl@ceph.mon.a.smithi163.stdout: use_delta_encoding: 1 2023-07-14T18:04:30.773 INFO:journalctl@ceph.mon.a.smithi163.stdout: filter_policy: bloomfilter 2023-07-14T18:04:30.774 INFO:journalctl@ceph.mon.a.smithi163.stdout: whole_key_filtering: 1 2023-07-14T18:04:30.774 INFO:journalctl@ceph.mon.a.smithi163.stdout: verify_compression: 0 2023-07-14T18:04:30.774 INFO:journalctl@ceph.mon.a.smithi163.stdout: read_amp_bytes_per_bit: 0 2023-07-14T18:04:30.774 INFO:journalctl@ceph.mon.a.smithi163.stdout: format_version: 5 2023-07-14T18:04:30.774 INFO:journalctl@ceph.mon.a.smithi163.stdout: enable_index_compression: 1 2023-07-14T18:04:30.774 INFO:journalctl@ceph.mon.a.smithi163.stdout: block_align: 0 2023-07-14T18:04:30.774 INFO:journalctl@ceph.mon.a.smithi163.stdout: max_auto_readahead_size: 262144 2023-07-14T18:04:30.775 INFO:journalctl@ceph.mon.a.smithi163.stdout: prepopulate_block_cache: 0 2023-07-14T18:04:30.775 INFO:journalctl@ceph.mon.a.smithi163.stdout: initial_auto_readahead_size: 8192 2023-07-14T18:04:30.775 INFO:journalctl@ceph.mon.a.smithi163.stdout: num_file_reads_for_auto_readahead: 2 2023-07-14T18:04:30.775 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:04:30 smithi163 ceph-mon[96576]: rocksdb: Options.write_buffer_size: 33554432 2023-07-14T18:04:30.775 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:04:30 smithi163 ceph-mon[96576]: rocksdb: Options.max_write_buffer_number: 2 2023-07-14T18:04:30.775 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:04:30 smithi163 ceph-mon[96576]: rocksdb: Options.compression: NoCompression 2023-07-14T18:04:30.775 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:04:30 smithi163 ceph-mon[96576]: rocksdb: Options.bottommost_compression: Disabled 2023-07-14T18:04:30.775 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:04:30 smithi163 ceph-mon[96576]: rocksdb: Options.prefix_extractor: nullptr 2023-07-14T18:04:30.776 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:04:30 smithi163 ceph-mon[96576]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2023-07-14T18:04:30.776 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:04:30 smithi163 ceph-mon[96576]: rocksdb: Options.num_levels: 7 2023-07-14T18:04:30.776 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:04:30 smithi163 ceph-mon[96576]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2023-07-14T18:04:30.776 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:04:30 smithi163 ceph-mon[96576]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2023-07-14T18:04:30.776 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:04:30 smithi163 ceph-mon[96576]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2023-07-14T18:04:30.776 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:04:30 smithi163 ceph-mon[96576]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2023-07-14T18:04:30.776 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:04:30 smithi163 ceph-mon[96576]: rocksdb: Options.bottommost_compression_opts.level: 32767 2023-07-14T18:04:30.777 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:04:30 smithi163 ceph-mon[96576]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2023-07-14T18:04:30.777 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:04:30 smithi163 ceph-mon[96576]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2023-07-14T18:04:30.777 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:04:30 smithi163 ceph-mon[96576]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2023-07-14T18:04:30.777 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:04:30 smithi163 ceph-mon[96576]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2023-07-14T18:04:30.777 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:04:30 smithi163 ceph-mon[96576]: rocksdb: Options.bottommost_compression_opts.enabled: false 2023-07-14T18:04:30.777 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:04:30 smithi163 ceph-mon[96576]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2023-07-14T18:04:30.777 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:04:30 smithi163 ceph-mon[96576]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2023-07-14T18:04:30.777 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:04:30 smithi163 ceph-mon[96576]: rocksdb: Options.compression_opts.window_bits: -14 2023-07-14T18:04:30.778 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:04:30 smithi163 ceph-mon[96576]: rocksdb: Options.compression_opts.level: 32767 2023-07-14T18:04:30.778 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:04:30 smithi163 ceph-mon[96576]: rocksdb: Options.compression_opts.strategy: 0 2023-07-14T18:04:30.778 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:04:30 smithi163 ceph-mon[96576]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2023-07-14T18:04:30.778 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:04:30 smithi163 ceph-mon[96576]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2023-07-14T18:04:30.778 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:04:30 smithi163 ceph-mon[96576]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2023-07-14T18:04:30.778 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:04:30 smithi163 ceph-mon[96576]: rocksdb: Options.compression_opts.parallel_threads: 1 2023-07-14T18:04:30.778 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:04:30 smithi163 ceph-mon[96576]: rocksdb: Options.compression_opts.enabled: false 2023-07-14T18:04:30.779 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:04:30 smithi163 ceph-mon[96576]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2023-07-14T18:04:30.779 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:04:30 smithi163 ceph-mon[96576]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2023-07-14T18:04:30.779 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:04:30 smithi163 ceph-mon[96576]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2023-07-14T18:04:30.779 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:04:30 smithi163 ceph-mon[96576]: rocksdb: Options.level0_stop_writes_trigger: 36 2023-07-14T18:04:30.779 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:04:30 smithi163 ceph-mon[96576]: rocksdb: Options.target_file_size_base: 67108864 2023-07-14T18:04:30.779 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:04:30 smithi163 ceph-mon[96576]: rocksdb: Options.target_file_size_multiplier: 1 2023-07-14T18:04:30.779 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:04:30 smithi163 ceph-mon[96576]: rocksdb: Options.max_bytes_for_level_base: 268435456 2023-07-14T18:04:30.780 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:04:30 smithi163 ceph-mon[96576]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2023-07-14T18:04:30.780 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:04:30 smithi163 ceph-mon[96576]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2023-07-14T18:04:30.780 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:04:30 smithi163 ceph-mon[96576]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2023-07-14T18:04:30.780 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:04:30 smithi163 ceph-mon[96576]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2023-07-14T18:04:30.780 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:04:30 smithi163 ceph-mon[96576]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2023-07-14T18:04:30.780 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:04:30 smithi163 ceph-mon[96576]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2023-07-14T18:04:30.780 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:04:30 smithi163 ceph-mon[96576]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2023-07-14T18:04:30.780 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:04:30 smithi163 ceph-mon[96576]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2023-07-14T18:04:30.781 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:04:30 smithi163 ceph-mon[96576]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2023-07-14T18:04:30.781 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:04:30 smithi163 ceph-mon[96576]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2023-07-14T18:04:30.781 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:04:30 smithi163 ceph-mon[96576]: rocksdb: Options.max_compaction_bytes: 1677721600 2023-07-14T18:04:30.781 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:04:30 smithi163 ceph-mon[96576]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2023-07-14T18:04:30.781 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:04:30 smithi163 ceph-mon[96576]: rocksdb: Options.arena_block_size: 1048576 2023-07-14T18:04:30.781 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:04:30 smithi163 ceph-mon[96576]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2023-07-14T18:04:30.781 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:04:30 smithi163 ceph-mon[96576]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2023-07-14T18:04:30.781 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:04:30 smithi163 ceph-mon[96576]: rocksdb: Options.disable_auto_compactions: 0 2023-07-14T18:04:30.782 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:04:30 smithi163 ceph-mon[96576]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2023-07-14T18:04:30.782 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:04:30 smithi163 ceph-mon[96576]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2023-07-14T18:04:30.782 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:04:30 smithi163 ceph-mon[96576]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2023-07-14T18:04:30.782 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:04:30 smithi163 ceph-mon[96576]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2023-07-14T18:04:30.782 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:04:30 smithi163 ceph-mon[96576]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2023-07-14T18:04:30.782 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:04:30 smithi163 ceph-mon[96576]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2023-07-14T18:04:30.782 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:04:30 smithi163 ceph-mon[96576]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2023-07-14T18:04:30.782 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:04:30 smithi163 ceph-mon[96576]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2023-07-14T18:04:30.783 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:04:30 smithi163 ceph-mon[96576]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2023-07-14T18:04:30.783 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:04:30 smithi163 ceph-mon[96576]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2023-07-14T18:04:30.783 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:04:30 smithi163 ceph-mon[96576]: rocksdb: Options.table_properties_collectors: 2023-07-14T18:04:30.783 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:04:30 smithi163 ceph-mon[96576]: rocksdb: Options.inplace_update_support: 0 2023-07-14T18:04:30.783 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:04:30 smithi163 ceph-mon[96576]: rocksdb: Options.inplace_update_num_locks: 10000 2023-07-14T18:04:30.783 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:04:30 smithi163 ceph-mon[96576]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2023-07-14T18:04:30.783 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:04:30 smithi163 ceph-mon[96576]: rocksdb: Options.memtable_whole_key_filtering: 0 2023-07-14T18:04:30.784 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:04:30 smithi163 ceph-mon[96576]: rocksdb: Options.memtable_huge_page_size: 0 2023-07-14T18:04:30.784 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:04:30 smithi163 ceph-mon[96576]: rocksdb: Options.bloom_locality: 0 2023-07-14T18:04:30.784 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:04:30 smithi163 ceph-mon[96576]: rocksdb: Options.max_successive_merges: 0 2023-07-14T18:04:30.784 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:04:30 smithi163 ceph-mon[96576]: rocksdb: Options.optimize_filters_for_hits: 0 2023-07-14T18:04:30.784 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:04:30 smithi163 ceph-mon[96576]: rocksdb: Options.paranoid_file_checks: 0 2023-07-14T18:04:30.784 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:04:30 smithi163 ceph-mon[96576]: rocksdb: Options.force_consistency_checks: 1 2023-07-14T18:04:30.784 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:04:30 smithi163 ceph-mon[96576]: rocksdb: Options.report_bg_io_stats: 0 2023-07-14T18:04:30.784 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:04:30 smithi163 ceph-mon[96576]: rocksdb: Options.ttl: 2592000 2023-07-14T18:04:30.785 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:04:30 smithi163 ceph-mon[96576]: rocksdb: Options.periodic_compaction_seconds: 0 2023-07-14T18:04:30.785 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:04:30 smithi163 ceph-mon[96576]: rocksdb: Options.preclude_last_level_data_seconds: 0 2023-07-14T18:04:30.785 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:04:30 smithi163 ceph-mon[96576]: rocksdb: Options.preserve_internal_time_seconds: 0 2023-07-14T18:04:30.785 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:04:30 smithi163 ceph-mon[96576]: rocksdb: Options.enable_blob_files: false 2023-07-14T18:04:30.785 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:04:30 smithi163 ceph-mon[96576]: rocksdb: Options.min_blob_size: 0 2023-07-14T18:04:30.785 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:04:30 smithi163 ceph-mon[96576]: rocksdb: Options.blob_file_size: 268435456 2023-07-14T18:04:30.785 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:04:30 smithi163 ceph-mon[96576]: rocksdb: Options.blob_compression_type: NoCompression 2023-07-14T18:04:30.785 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:04:30 smithi163 ceph-mon[96576]: rocksdb: Options.enable_blob_garbage_collection: false 2023-07-14T18:04:30.786 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:04:30 smithi163 ceph-mon[96576]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2023-07-14T18:04:30.786 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:04:30 smithi163 ceph-mon[96576]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2023-07-14T18:04:30.786 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:04:30 smithi163 ceph-mon[96576]: rocksdb: Options.blob_compaction_readahead_size: 0 2023-07-14T18:04:30.786 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:04:30 smithi163 ceph-mon[96576]: rocksdb: Options.blob_file_starting_level: 0 2023-07-14T18:04:30.786 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:04:30 smithi163 ceph-mon[96576]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2023-07-14T18:04:30.786 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:04:30 smithi163 ceph-mon[96576]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 succeeded,manifest_file_number is 10, next_file_number is 12, last_sequence is 5, log_number is 5,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 5 2023-07-14T18:04:30.786 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:04:30 smithi163 ceph-mon[96576]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 5 2023-07-14T18:04:30.786 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:04:30 smithi163 ceph-mon[96576]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 3446b4ca-d203-4419-86fc-f96169dcdc98 2023-07-14T18:04:30.787 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:04:30 smithi163 ceph-mon[96576]: rocksdb: EVENT_LOG_v1 {"time_micros": 1689357870654935, "job": 1, "event": "recovery_started", "wal_files": [9]} 2023-07-14T18:04:30.787 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:04:30 smithi163 ceph-mon[96576]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #9 mode 2 2023-07-14T18:04:30.787 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:04:30 smithi163 ceph-mon[96576]: rocksdb: EVENT_LOG_v1 {"time_micros": 1689357870655888, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 13, "file_size": 93074, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 8, "largest_seqno": 310, "table_properties": {"data_size": 91096, "index_size": 260, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 709, "raw_key_size": 13396, "raw_average_key_size": 49, "raw_value_size": 83784, "raw_average_value_size": 311, "num_data_blocks": 11, "num_entries": 269, "num_filter_entries": 269, "num_deletions": 3, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1689357870, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "3446b4ca-d203-4419-86fc-f96169dcdc98", "db_session_id": "6NP9LD6TM988GU912Q4U", "orig_file_number": 13, "seqno_to_time_mapping": "N/A"}} 2023-07-14T18:04:30.787 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:04:30 smithi163 ceph-mon[96576]: rocksdb: EVENT_LOG_v1 {"time_micros": 1689357870655955, "job": 1, "event": "recovery_finished"} 2023-07-14T18:04:30.787 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:04:30 smithi163 ceph-mon[96576]: rocksdb: [db/version_set.cc:5047] Creating manifest 15 2023-07-14T18:04:30.787 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:04:30 smithi163 ceph-mon[96576]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-a/store.db/000009.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2023-07-14T18:04:30.787 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:04:30 smithi163 ceph-mon[96576]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x556fbaa9c000 2023-07-14T18:04:30.788 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:04:30 smithi163 ceph-mon[96576]: rocksdb: DB pointer 0x556fbaa88000 2023-07-14T18:04:30.788 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:04:30 smithi163 ceph-mon[96576]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2023-07-14T18:04:30.788 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:04:30 smithi163 ceph-mon[96576]: rocksdb: [db/db_impl/db_impl.cc:1111] 2023-07-14T18:04:30.788 INFO:journalctl@ceph.mon.a.smithi163.stdout: ** DB Stats ** 2023-07-14T18:04:30.788 INFO:journalctl@ceph.mon.a.smithi163.stdout: Uptime(secs): 0.0 total, 0.0 interval 2023-07-14T18:04:30.788 INFO:journalctl@ceph.mon.a.smithi163.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2023-07-14T18:04:30.788 INFO:journalctl@ceph.mon.a.smithi163.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2023-07-14T18:04:30.788 INFO:journalctl@ceph.mon.a.smithi163.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2023-07-14T18:04:30.789 INFO:journalctl@ceph.mon.a.smithi163.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2023-07-14T18:04:30.789 INFO:journalctl@ceph.mon.a.smithi163.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2023-07-14T18:04:30.789 INFO:journalctl@ceph.mon.a.smithi163.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2023-07-14T18:04:30.789 INFO:journalctl@ceph.mon.a.smithi163.stdout: 2023-07-14T18:04:30.789 INFO:journalctl@ceph.mon.a.smithi163.stdout: ** Compaction Stats [default] ** 2023-07-14T18:04:30.789 INFO:journalctl@ceph.mon.a.smithi163.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2023-07-14T18:04:30.789 INFO:journalctl@ceph.mon.a.smithi163.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2023-07-14T18:04:30.790 INFO:journalctl@ceph.mon.a.smithi163.stdout: L0 2/0 92.73 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 148.2 0.00 0.00 1 0.001 0 0 0.0 0.0 2023-07-14T18:04:30.790 INFO:journalctl@ceph.mon.a.smithi163.stdout: Sum 2/0 92.73 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 148.2 0.00 0.00 1 0.001 0 0 0.0 0.0 2023-07-14T18:04:30.790 INFO:journalctl@ceph.mon.a.smithi163.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 148.2 0.00 0.00 1 0.001 0 0 0.0 0.0 2023-07-14T18:04:30.790 INFO:journalctl@ceph.mon.a.smithi163.stdout: 2023-07-14T18:04:30.790 INFO:journalctl@ceph.mon.a.smithi163.stdout: ** Compaction Stats [default] ** 2023-07-14T18:04:30.790 INFO:journalctl@ceph.mon.a.smithi163.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2023-07-14T18:04:30.791 INFO:journalctl@ceph.mon.a.smithi163.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2023-07-14T18:04:30.791 INFO:journalctl@ceph.mon.a.smithi163.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 148.2 0.00 0.00 1 0.001 0 0 0.0 0.0 2023-07-14T18:04:30.791 INFO:journalctl@ceph.mon.a.smithi163.stdout: 2023-07-14T18:04:30.791 INFO:journalctl@ceph.mon.a.smithi163.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2023-07-14T18:04:30.791 INFO:journalctl@ceph.mon.a.smithi163.stdout: 2023-07-14T18:04:30.791 INFO:journalctl@ceph.mon.a.smithi163.stdout: Uptime(secs): 0.0 total, 0.0 interval 2023-07-14T18:04:30.792 INFO:journalctl@ceph.mon.a.smithi163.stdout: Flush(GB): cumulative 0.000, interval 0.000 2023-07-14T18:04:30.792 INFO:journalctl@ceph.mon.a.smithi163.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2023-07-14T18:04:30.792 INFO:journalctl@ceph.mon.a.smithi163.stdout: AddFile(Total Files): cumulative 0, interval 0 2023-07-14T18:04:30.792 INFO:journalctl@ceph.mon.a.smithi163.stdout: AddFile(L0 Files): cumulative 0, interval 0 2023-07-14T18:04:30.792 INFO:journalctl@ceph.mon.a.smithi163.stdout: AddFile(Keys): cumulative 0, interval 0 2023-07-14T18:04:30.792 INFO:journalctl@ceph.mon.a.smithi163.stdout: Cumulative compaction: 0.00 GB write, 24.58 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2023-07-14T18:04:30.792 INFO:journalctl@ceph.mon.a.smithi163.stdout: Interval compaction: 0.00 GB write, 24.58 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2023-07-14T18:04:30.792 INFO:journalctl@ceph.mon.a.smithi163.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2023-07-14T18:04:30.793 INFO:journalctl@ceph.mon.a.smithi163.stdout: Block cache BinnedLRUCache@0x556fbaa031f0#7 capacity: 512.00 MB usage: 1.36 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 9e-06 secs_since: 0 2023-07-14T18:04:30.793 INFO:journalctl@ceph.mon.a.smithi163.stdout: Block cache entry stats(count,size,portion): FilterBlock(2,0.89 KB,0.000169873%) IndexBlock(2,0.47 KB,8.9407e-05%) Misc(1,0.00 KB,0%) 2023-07-14T18:04:30.793 INFO:journalctl@ceph.mon.a.smithi163.stdout: 2023-07-14T18:04:30.793 INFO:journalctl@ceph.mon.a.smithi163.stdout: ** File Read Latency Histogram By Level [default] ** 2023-07-14T18:04:30.793 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:04:30 smithi163 ceph-mon[96576]: starting mon.a rank 0 at public addrs [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] at bind addrs [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] mon_data /var/lib/ceph/mon/ceph-a fsid bf7326ec-2270-11ee-9b33-001a4aab830c 2023-07-14T18:04:30.793 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:04:30 smithi163 ceph-mon[96576]: mon.a@-1(???) e1 preinit fsid bf7326ec-2270-11ee-9b33-001a4aab830c 2023-07-14T18:04:30.793 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:04:30 smithi163 ceph-mon[96576]: mon.a@-1(???).mds e1 new map 2023-07-14T18:04:30.794 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:04:30 smithi163 ceph-mon[96576]: mon.a@-1(???).mds e1 print_map 2023-07-14T18:04:30.794 INFO:journalctl@ceph.mon.a.smithi163.stdout: e1 2023-07-14T18:04:30.794 INFO:journalctl@ceph.mon.a.smithi163.stdout: enable_multiple, ever_enabled_multiple: 1,1 2023-07-14T18:04:30.794 INFO:journalctl@ceph.mon.a.smithi163.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-07-14T18:04:30.794 INFO:journalctl@ceph.mon.a.smithi163.stdout: legacy client fscid: -1 2023-07-14T18:04:30.794 INFO:journalctl@ceph.mon.a.smithi163.stdout: 2023-07-14T18:04:30.794 INFO:journalctl@ceph.mon.a.smithi163.stdout: No filesystems configured 2023-07-14T18:04:30.794 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:04:30 smithi163 ceph-mon[96576]: mon.a@-1(???).osd e1 crush map has features 3314932999778484224, adjusting msgr requires 2023-07-14T18:04:30.795 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:04:30 smithi163 ceph-mon[96576]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2023-07-14T18:04:30.795 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:04:30 smithi163 ceph-mon[96576]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2023-07-14T18:04:30.795 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:04:30 smithi163 ceph-mon[96576]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2023-07-14T18:04:30.795 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:04:30 smithi163 ceph-mon[96576]: mon.a@-1(???).paxosservice(auth 1..2) refresh upgraded, format 0 -> 3 2023-07-14T18:04:30.795 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:04:30 smithi163 systemd[1]: Started Ceph mon.a for bf7326ec-2270-11ee-9b33-001a4aab830c. 2023-07-14T18:04:30.795 INFO:teuthology.orchestra.run.smithi163.stdout:Setting public_network to 172.21.0.0/20 in mon config section 2023-07-14T18:04:31.004 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:04:30 smithi163 ceph-mon[96576]: mon.a is new leader, mons a in quorum (ranks 0) 2023-07-14T18:04:31.004 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:04:30 smithi163 ceph-mon[96576]: monmap e1: 1 mons at {a=[v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0]} removed_ranks: {} 2023-07-14T18:04:31.005 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:04:30 smithi163 ceph-mon[96576]: fsmap 2023-07-14T18:04:31.005 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:04:30 smithi163 ceph-mon[96576]: osdmap e1: 0 total, 0 up, 0 in 2023-07-14T18:04:31.005 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:04:30 smithi163 ceph-mon[96576]: mgrmap e1: no daemons active 2023-07-14T18:04:31.608 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:31.188+0000 7eff8fce0700 1 Processor -- start 2023-07-14T18:04:31.608 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:31.188+0000 7eff8fce0700 1 -- start start 2023-07-14T18:04:31.608 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:31.188+0000 7eff8fce0700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7eff881040e0 0x7eff881044f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:04:31.609 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:31.188+0000 7eff8fce0700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff88104a30 con 0x7eff881040e0 2023-07-14T18:04:31.609 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:31.189+0000 7eff8da7c700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7eff881040e0 0x7eff881044f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:04:31.609 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:31.189+0000 7eff8da7c700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7eff881040e0 0x7eff881044f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:54412/0 (socket says 172.21.15.163:54412) 2023-07-14T18:04:31.609 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:31.189+0000 7eff8da7c700 1 -- 172.21.15.163:0/617480292 learned_addr learned my addr 172.21.15.163:0/617480292 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:04:31.610 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:31.189+0000 7eff8da7c700 1 -- 172.21.15.163:0/617480292 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff88104b70 con 0x7eff881040e0 2023-07-14T18:04:31.610 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:31.189+0000 7eff8da7c700 1 --2- 172.21.15.163:0/617480292 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7eff881040e0 0x7eff881044f0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7eff780098a0 tx=0x7eff78009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b7ef350b934d01af server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:04:31.610 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:31.189+0000 7eff8ca7a700 1 -- 172.21.15.163:0/617480292 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7eff78004160 con 0x7eff881040e0 2023-07-14T18:04:31.610 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:31.189+0000 7eff8ca7a700 1 -- 172.21.15.163:0/617480292 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(25 keys) v1 ==== 1036+0+0 (secure 0 0 0) 0x7eff780042c0 con 0x7eff881040e0 2023-07-14T18:04:31.610 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:31.189+0000 7eff8ca7a700 1 -- 172.21.15.163:0/617480292 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7eff78011940 con 0x7eff881040e0 2023-07-14T18:04:31.611 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:31.190+0000 7eff8fce0700 1 -- 172.21.15.163:0/617480292 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7eff881040e0 msgr2=0x7eff881044f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:04:31.611 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:31.190+0000 7eff8fce0700 1 --2- 172.21.15.163:0/617480292 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7eff881040e0 0x7eff881044f0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7eff780098a0 tx=0x7eff78009bb0 comp rx=0 tx=0).stop 2023-07-14T18:04:31.611 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:31.190+0000 7eff8fce0700 1 -- 172.21.15.163:0/617480292 shutdown_connections 2023-07-14T18:04:31.611 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:31.190+0000 7eff8fce0700 1 --2- 172.21.15.163:0/617480292 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7eff881040e0 0x7eff881044f0 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:04:31.611 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:31.190+0000 7eff8fce0700 1 -- 172.21.15.163:0/617480292 >> 172.21.15.163:0/617480292 conn(0x7eff880ff750 msgr2=0x7eff88101b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:04:31.611 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:31.190+0000 7eff8fce0700 1 -- 172.21.15.163:0/617480292 shutdown_connections 2023-07-14T18:04:31.611 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:31.190+0000 7eff8fce0700 1 -- 172.21.15.163:0/617480292 wait complete. 2023-07-14T18:04:31.611 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:31.191+0000 7eff8fce0700 1 Processor -- start 2023-07-14T18:04:31.612 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:31.191+0000 7eff8fce0700 1 -- start start 2023-07-14T18:04:31.612 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:31.191+0000 7eff8fce0700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7eff881040e0 0x7eff8819bb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:04:31.612 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:31.191+0000 7eff8fce0700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff88079d00 con 0x7eff881040e0 2023-07-14T18:04:31.612 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:31.191+0000 7eff8da7c700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7eff881040e0 0x7eff8819bb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:04:31.612 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:31.191+0000 7eff8da7c700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7eff881040e0 0x7eff8819bb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:54414/0 (socket says 172.21.15.163:54414) 2023-07-14T18:04:31.612 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:31.191+0000 7eff8da7c700 1 -- 172.21.15.163:0/276372880 learned_addr learned my addr 172.21.15.163:0/276372880 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:04:31.612 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:31.191+0000 7eff8da7c700 1 -- 172.21.15.163:0/276372880 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff78009550 con 0x7eff881040e0 2023-07-14T18:04:31.613 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:31.191+0000 7eff8da7c700 1 --2- 172.21.15.163:0/276372880 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7eff881040e0 0x7eff8819bb50 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7eff78011dc0 tx=0x7eff78011ea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:04:31.613 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:31.191+0000 7eff7effd700 1 -- 172.21.15.163:0/276372880 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7eff780037d0 con 0x7eff881040e0 2023-07-14T18:04:31.613 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:31.191+0000 7eff7effd700 1 -- 172.21.15.163:0/276372880 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(25 keys) v1 ==== 1036+0+0 (secure 0 0 0) 0x7eff7801b440 con 0x7eff881040e0 2023-07-14T18:04:31.613 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:31.191+0000 7eff8fce0700 1 -- 172.21.15.163:0/276372880 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff88079f00 con 0x7eff881040e0 2023-07-14T18:04:31.613 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:31.191+0000 7eff7effd700 1 -- 172.21.15.163:0/276372880 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7eff7801a560 con 0x7eff881040e0 2023-07-14T18:04:31.613 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:31.192+0000 7eff8fce0700 1 -- 172.21.15.163:0/276372880 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff8819c260 con 0x7eff881040e0 2023-07-14T18:04:31.613 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:31.192+0000 7eff7effd700 1 -- 172.21.15.163:0/276372880 <== mon.0 v2:172.21.15.163:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7eff7801ab20 con 0x7eff881040e0 2023-07-14T18:04:31.613 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:31.192+0000 7eff7effd700 1 -- 172.21.15.163:0/276372880 <== mon.0 v2:172.21.15.163:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7eff78019730 con 0x7eff881040e0 2023-07-14T18:04:31.614 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:31.192+0000 7eff8fce0700 1 -- 172.21.15.163:0/276372880 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7eff88061c70 con 0x7eff881040e0 2023-07-14T18:04:31.614 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:31.195+0000 7eff7effd700 1 -- 172.21.15.163:0/276372880 <== mon.0 v2:172.21.15.163:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72446 (secure 0 0 0) 0x7eff78029060 con 0x7eff881040e0 2023-07-14T18:04:31.614 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:31.261+0000 7eff8fce0700 1 -- 172.21.15.163:0/276372880 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command([{prefix=config set, name=public_network}] v 0) v1 -- 0x7eff88105f40 con 0x7eff881040e0 2023-07-14T18:04:31.614 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:31.263+0000 7eff7effd700 1 -- 172.21.15.163:0/276372880 <== mon.0 v2:172.21.15.163:3300/0 7 ==== mon_command_ack([{prefix=config set, name=public_network}]=0 v3)=0 v3) v1 ==== 124+0+0 (secure 0 0 0) 0x7eff7801f070 con 0x7eff881040e0 2023-07-14T18:04:31.614 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:31.264+0000 7eff8fce0700 1 -- 172.21.15.163:0/276372880 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7eff881040e0 msgr2=0x7eff8819bb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:04:31.614 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:31.264+0000 7eff8fce0700 1 --2- 172.21.15.163:0/276372880 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7eff881040e0 0x7eff8819bb50 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7eff78011dc0 tx=0x7eff78011ea0 comp rx=0 tx=0).stop 2023-07-14T18:04:31.614 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:31.264+0000 7eff8fce0700 1 -- 172.21.15.163:0/276372880 shutdown_connections 2023-07-14T18:04:31.615 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:31.264+0000 7eff8fce0700 1 --2- 172.21.15.163:0/276372880 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7eff881040e0 0x7eff8819bb50 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:04:31.615 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:31.264+0000 7eff8fce0700 1 -- 172.21.15.163:0/276372880 >> 172.21.15.163:0/276372880 conn(0x7eff880ff750 msgr2=0x7eff88100480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:04:31.615 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:31.264+0000 7eff8fce0700 1 -- 172.21.15.163:0/276372880 shutdown_connections 2023-07-14T18:04:31.615 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:31.264+0000 7eff8fce0700 1 -- 172.21.15.163:0/276372880 wait complete. 2023-07-14T18:04:31.615 INFO:teuthology.orchestra.run.smithi163.stdout:Wrote config to /etc/ceph/ceph.conf 2023-07-14T18:04:31.630 INFO:teuthology.orchestra.run.smithi163.stdout:Wrote keyring to /etc/ceph/ceph.client.admin.keyring 2023-07-14T18:04:31.630 INFO:teuthology.orchestra.run.smithi163.stdout:Creating mgr... 2023-07-14T18:04:31.630 INFO:teuthology.orchestra.run.smithi163.stdout:Verifying port 9283 ... 2023-07-14T18:04:31.631 INFO:teuthology.orchestra.run.smithi163.stdout:Verifying port 8765 ... 2023-07-14T18:04:31.809 INFO:teuthology.orchestra.run.smithi163.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-bf7326ec-2270-11ee-9b33-001a4aab830c@mgr.x 2023-07-14T18:04:31.809 INFO:teuthology.orchestra.run.smithi163.stdout:systemctl: stderr Failed to reset failed state of unit ceph-bf7326ec-2270-11ee-9b33-001a4aab830c@mgr.x.service: Unit ceph-bf7326ec-2270-11ee-9b33-001a4aab830c@mgr.x.service not loaded. 2023-07-14T18:04:31.899 INFO:teuthology.orchestra.run.smithi163.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-bf7326ec-2270-11ee-9b33-001a4aab830c.target.wants/ceph-bf7326ec-2270-11ee-9b33-001a4aab830c@mgr.x.service → /etc/systemd/system/ceph-bf7326ec-2270-11ee-9b33-001a4aab830c@.service. 2023-07-14T18:04:32.174 INFO:journalctl@ceph.mgr.x.smithi163.stdout:Jul 14 18:04:31 smithi163 systemd[1]: Starting Ceph mgr.x for bf7326ec-2270-11ee-9b33-001a4aab830c... 2023-07-14T18:04:32.436 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:04:32 smithi163 ceph-mon[96576]: from='client.? 172.21.15.163:0/276372880' entity='client.admin' 2023-07-14T18:04:32.437 INFO:journalctl@ceph.mgr.x.smithi163.stdout:Jul 14 18:04:32 smithi163 podman[96802]: 2023-07-14T18:04:32.505 INFO:teuthology.orchestra.run.smithi163.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2023-07-14T18:04:32.505 INFO:teuthology.orchestra.run.smithi163.stdout:systemctl: stdout disabled 2023-07-14T18:04:32.512 INFO:teuthology.orchestra.run.smithi163.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2023-07-14T18:04:32.512 INFO:teuthology.orchestra.run.smithi163.stdout:systemctl: stdout inactive 2023-07-14T18:04:32.513 INFO:teuthology.orchestra.run.smithi163.stdout:firewalld.service is not enabled 2023-07-14T18:04:32.513 INFO:teuthology.orchestra.run.smithi163.stdout:Not possible to enable service . firewalld.service is not available 2023-07-14T18:04:32.520 INFO:teuthology.orchestra.run.smithi163.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2023-07-14T18:04:32.521 INFO:teuthology.orchestra.run.smithi163.stdout:systemctl: stdout disabled 2023-07-14T18:04:32.528 INFO:teuthology.orchestra.run.smithi163.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2023-07-14T18:04:32.528 INFO:teuthology.orchestra.run.smithi163.stdout:systemctl: stdout inactive 2023-07-14T18:04:32.528 INFO:teuthology.orchestra.run.smithi163.stdout:firewalld.service is not enabled 2023-07-14T18:04:32.529 INFO:teuthology.orchestra.run.smithi163.stdout:Not possible to open ports <[9283, 8765]>. firewalld.service is not available 2023-07-14T18:04:32.529 INFO:teuthology.orchestra.run.smithi163.stdout:Waiting for mgr to start... 2023-07-14T18:04:32.529 INFO:teuthology.orchestra.run.smithi163.stdout:Waiting for mgr... 2023-07-14T18:04:32.706 INFO:journalctl@ceph.mgr.x.smithi163.stdout:Jul 14 18:04:32 smithi163 bash[96802]: 6e6b00232d0044e58d36cfd058213a28aec218366ada23deff0a978719220411 2023-07-14T18:04:32.706 INFO:journalctl@ceph.mgr.x.smithi163.stdout:Jul 14 18:04:32 smithi163 systemd[1]: Started Ceph mgr.x for bf7326ec-2270-11ee-9b33-001a4aab830c. 2023-07-14T18:04:32.706 INFO:journalctl@ceph.mgr.x.smithi163.stdout:Jul 14 18:04:32 smithi163 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-mgr-x[96818]: 2023-07-14T18:04:32.534+0000 7f87ff936200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-07-14T18:04:32.706 INFO:journalctl@ceph.mgr.x.smithi163.stdout:Jul 14 18:04:32 smithi163 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-mgr-x[96818]: 2023-07-14T18:04:32.615+0000 7f87ff936200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-07-14T18:04:33.016 INFO:journalctl@ceph.mgr.x.smithi163.stdout:Jul 14 18:04:32 smithi163 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-mgr-x[96818]: 2023-07-14T18:04:32.708+0000 7f87ff936200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-07-14T18:04:33.017 INFO:journalctl@ceph.mgr.x.smithi163.stdout:Jul 14 18:04:32 smithi163 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-mgr-x[96818]: 2023-07-14T18:04:32.808+0000 7f87ff936200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-07-14T18:04:33.017 INFO:journalctl@ceph.mgr.x.smithi163.stdout:Jul 14 18:04:32 smithi163 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-mgr-x[96818]: 2023-07-14T18:04:32.987+0000 7f87ff936200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-07-14T18:04:33.574 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:04:33 smithi163 ceph-mon[96576]: from='client.? 172.21.15.163:0/3745290354' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2023-07-14T18:04:33.574 INFO:journalctl@ceph.mgr.x.smithi163.stdout:Jul 14 18:04:33 smithi163 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-mgr-x[96818]: 2023-07-14T18:04:33.322+0000 7f87ff936200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-07-14T18:04:33.575 INFO:journalctl@ceph.mgr.x.smithi163.stdout:Jul 14 18:04:33 smithi163 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-mgr-x[96818]: 2023-07-14T18:04:33.412+0000 7f87ff936200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-07-14T18:04:33.577 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stdout 2023-07-14T18:04:33.579 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stdout { 2023-07-14T18:04:33.580 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stdout "fsid": "bf7326ec-2270-11ee-9b33-001a4aab830c", 2023-07-14T18:04:33.580 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stdout "health": { 2023-07-14T18:04:33.580 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2023-07-14T18:04:33.580 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stdout "checks": {}, 2023-07-14T18:04:33.580 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stdout "mutes": [] 2023-07-14T18:04:33.581 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stdout }, 2023-07-14T18:04:33.581 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2023-07-14T18:04:33.581 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stdout "quorum": [ 2023-07-14T18:04:33.581 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stdout 0 2023-07-14T18:04:33.581 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stdout ], 2023-07-14T18:04:33.581 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2023-07-14T18:04:33.581 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stdout "a" 2023-07-14T18:04:33.582 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stdout ], 2023-07-14T18:04:33.582 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stdout "quorum_age": 2, 2023-07-14T18:04:33.582 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stdout "monmap": { 2023-07-14T18:04:33.582 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-07-14T18:04:33.582 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "reef", 2023-07-14T18:04:33.582 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stdout "num_mons": 1 2023-07-14T18:04:33.582 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stdout }, 2023-07-14T18:04:33.583 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stdout "osdmap": { 2023-07-14T18:04:33.583 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-07-14T18:04:33.583 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2023-07-14T18:04:33.583 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2023-07-14T18:04:33.583 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2023-07-14T18:04:33.588 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2023-07-14T18:04:33.588 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2023-07-14T18:04:33.589 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2023-07-14T18:04:33.589 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stdout }, 2023-07-14T18:04:33.589 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stdout "pgmap": { 2023-07-14T18:04:33.589 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2023-07-14T18:04:33.589 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2023-07-14T18:04:33.589 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2023-07-14T18:04:33.589 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2023-07-14T18:04:33.590 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2023-07-14T18:04:33.590 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2023-07-14T18:04:33.590 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2023-07-14T18:04:33.590 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2023-07-14T18:04:33.590 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stdout }, 2023-07-14T18:04:33.590 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stdout "fsmap": { 2023-07-14T18:04:33.590 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-07-14T18:04:33.590 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stdout "by_rank": [], 2023-07-14T18:04:33.591 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stdout "up:standby": 0 2023-07-14T18:04:33.591 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stdout }, 2023-07-14T18:04:33.591 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stdout "mgrmap": { 2023-07-14T18:04:33.591 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stdout "available": false, 2023-07-14T18:04:33.591 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2023-07-14T18:04:33.591 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stdout "modules": [ 2023-07-14T18:04:33.591 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stdout "iostat", 2023-07-14T18:04:33.591 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stdout "nfs", 2023-07-14T18:04:33.592 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stdout "restful" 2023-07-14T18:04:33.592 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stdout ], 2023-07-14T18:04:33.592 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stdout "services": {} 2023-07-14T18:04:33.592 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stdout }, 2023-07-14T18:04:33.592 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stdout "servicemap": { 2023-07-14T18:04:33.592 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-07-14T18:04:33.592 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stdout "modified": "2023-07-14T18:04:26.263987+0000", 2023-07-14T18:04:33.593 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stdout "services": {} 2023-07-14T18:04:33.593 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stdout }, 2023-07-14T18:04:33.593 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stdout "progress_events": {} 2023-07-14T18:04:33.593 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stdout } 2023-07-14T18:04:33.593 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:33.051+0000 7f9172255700 1 Processor -- start 2023-07-14T18:04:33.593 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:33.051+0000 7f9172255700 1 -- start start 2023-07-14T18:04:33.593 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:33.051+0000 7f9172255700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f916c1040e0 0x7f916c1044f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:04:33.593 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:33.051+0000 7f9172255700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f916c104a30 con 0x7f916c1040e0 2023-07-14T18:04:33.594 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:33.051+0000 7f916b7fe700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f916c1040e0 0x7f916c1044f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:04:33.594 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:33.051+0000 7f916b7fe700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f916c1040e0 0x7f916c1044f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:54420/0 (socket says 172.21.15.163:54420) 2023-07-14T18:04:33.594 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:33.051+0000 7f916b7fe700 1 -- 172.21.15.163:0/845220597 learned_addr learned my addr 172.21.15.163:0/845220597 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:04:33.594 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:33.052+0000 7f916b7fe700 1 -- 172.21.15.163:0/845220597 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f916c104b70 con 0x7f916c1040e0 2023-07-14T18:04:33.594 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:33.052+0000 7f916b7fe700 1 --2- 172.21.15.163:0/845220597 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f916c1040e0 0x7f916c1044f0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f915c0098a0 tx=0x7f915c009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c32734ef796f3466 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:04:33.594 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:33.052+0000 7f916a7fc700 1 -- 172.21.15.163:0/845220597 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f915c004160 con 0x7f916c1040e0 2023-07-14T18:04:33.594 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:33.052+0000 7f916a7fc700 1 -- 172.21.15.163:0/845220597 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(25 keys) v1 ==== 1036+0+0 (secure 0 0 0) 0x7f915c0042c0 con 0x7f916c1040e0 2023-07-14T18:04:33.594 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:33.052+0000 7f916a7fc700 1 -- 172.21.15.163:0/845220597 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f915c011940 con 0x7f916c1040e0 2023-07-14T18:04:33.595 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:33.053+0000 7f9172255700 1 -- 172.21.15.163:0/845220597 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f916c1040e0 msgr2=0x7f916c1044f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:04:33.595 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:33.053+0000 7f9172255700 1 --2- 172.21.15.163:0/845220597 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f916c1040e0 0x7f916c1044f0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f915c0098a0 tx=0x7f915c009bb0 comp rx=0 tx=0).stop 2023-07-14T18:04:33.595 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:33.053+0000 7f9172255700 1 -- 172.21.15.163:0/845220597 shutdown_connections 2023-07-14T18:04:33.595 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:33.053+0000 7f9172255700 1 --2- 172.21.15.163:0/845220597 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f916c1040e0 0x7f916c1044f0 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:04:33.595 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:33.053+0000 7f9172255700 1 -- 172.21.15.163:0/845220597 >> 172.21.15.163:0/845220597 conn(0x7f916c0ff770 msgr2=0x7f916c101b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:04:33.595 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:33.053+0000 7f9172255700 1 -- 172.21.15.163:0/845220597 shutdown_connections 2023-07-14T18:04:33.595 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:33.053+0000 7f9172255700 1 -- 172.21.15.163:0/845220597 wait complete. 2023-07-14T18:04:33.596 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:33.053+0000 7f9172255700 1 Processor -- start 2023-07-14T18:04:33.596 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:33.054+0000 7f9172255700 1 -- start start 2023-07-14T18:04:33.596 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:33.054+0000 7f9172255700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f916c1040e0 0x7f916c19dfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:04:33.596 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:33.054+0000 7f9172255700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f916c199990 con 0x7f916c1040e0 2023-07-14T18:04:33.596 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:33.054+0000 7f916b7fe700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f916c1040e0 0x7f916c19dfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:04:33.596 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:33.054+0000 7f916b7fe700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f916c1040e0 0x7f916c19dfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:54422/0 (socket says 172.21.15.163:54422) 2023-07-14T18:04:33.596 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:33.054+0000 7f916b7fe700 1 -- 172.21.15.163:0/3745290354 learned_addr learned my addr 172.21.15.163:0/3745290354 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:04:33.596 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:33.054+0000 7f916b7fe700 1 -- 172.21.15.163:0/3745290354 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f915c009550 con 0x7f916c1040e0 2023-07-14T18:04:33.597 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:33.054+0000 7f916b7fe700 1 --2- 172.21.15.163:0/3745290354 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f916c1040e0 0x7f916c19dfa0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f915c011dc0 tx=0x7f915c011ea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:04:33.597 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:33.054+0000 7f9168ff9700 1 -- 172.21.15.163:0/3745290354 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f915c0037d0 con 0x7f916c1040e0 2023-07-14T18:04:33.597 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:33.054+0000 7f9172255700 1 -- 172.21.15.163:0/3745290354 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f916c079ce0 con 0x7f916c1040e0 2023-07-14T18:04:33.597 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:33.054+0000 7f9168ff9700 1 -- 172.21.15.163:0/3745290354 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(25 keys) v1 ==== 1036+0+0 (secure 0 0 0) 0x7f915c01b440 con 0x7f916c1040e0 2023-07-14T18:04:33.597 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:33.054+0000 7f9168ff9700 1 -- 172.21.15.163:0/3745290354 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f915c01a560 con 0x7f916c1040e0 2023-07-14T18:04:33.597 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:33.055+0000 7f9172255700 1 -- 172.21.15.163:0/3745290354 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f916c19e6b0 con 0x7f916c1040e0 2023-07-14T18:04:33.597 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:33.055+0000 7f9168ff9700 1 -- 172.21.15.163:0/3745290354 <== mon.0 v2:172.21.15.163:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f915c01ab20 con 0x7f916c1040e0 2023-07-14T18:04:33.598 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:33.055+0000 7f9168ff9700 1 -- 172.21.15.163:0/3745290354 <== mon.0 v2:172.21.15.163:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f915c019730 con 0x7f916c1040e0 2023-07-14T18:04:33.598 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:33.055+0000 7f9172255700 1 -- 172.21.15.163:0/3745290354 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f916c061c70 con 0x7f916c1040e0 2023-07-14T18:04:33.598 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:33.058+0000 7f9168ff9700 1 -- 172.21.15.163:0/3745290354 <== mon.0 v2:172.21.15.163:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72446 (secure 0 0 0) 0x7f915c029060 con 0x7f916c1040e0 2023-07-14T18:04:33.598 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:33.129+0000 7f9172255700 1 -- 172.21.15.163:0/3745290354 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) v1 -- 0x7f916c079e70 con 0x7f916c1040e0 2023-07-14T18:04:33.598 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:33.129+0000 7f9168ff9700 1 -- 172.21.15.163:0/3745290354 <== mon.0 v2:172.21.15.163:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) v1 ==== 79+0+1238 (secure 0 0 0) 0x7f915c01f070 con 0x7f916c1040e0 2023-07-14T18:04:33.598 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:33.130+0000 7f9172255700 1 -- 172.21.15.163:0/3745290354 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f916c1040e0 msgr2=0x7f916c19dfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:04:33.598 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:33.130+0000 7f9172255700 1 --2- 172.21.15.163:0/3745290354 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f916c1040e0 0x7f916c19dfa0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f915c011dc0 tx=0x7f915c011ea0 comp rx=0 tx=0).stop 2023-07-14T18:04:33.598 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:33.130+0000 7f9172255700 1 -- 172.21.15.163:0/3745290354 shutdown_connections 2023-07-14T18:04:33.599 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:33.130+0000 7f9172255700 1 --2- 172.21.15.163:0/3745290354 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f916c1040e0 0x7f916c19dfa0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:04:33.599 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:33.130+0000 7f9172255700 1 -- 172.21.15.163:0/3745290354 >> 172.21.15.163:0/3745290354 conn(0x7f916c0ff770 msgr2=0x7f916c1004c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:04:33.599 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:33.130+0000 7f9172255700 1 -- 172.21.15.163:0/3745290354 shutdown_connections 2023-07-14T18:04:33.599 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:33.130+0000 7f9172255700 1 -- 172.21.15.163:0/3745290354 wait complete. 2023-07-14T18:04:33.599 INFO:teuthology.orchestra.run.smithi163.stdout:mgr not available, waiting (1/15)... 2023-07-14T18:04:33.955 INFO:journalctl@ceph.mgr.x.smithi163.stdout:Jul 14 18:04:33 smithi163 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-mgr-x[96818]: 2023-07-14T18:04:33.545+0000 7f87ff936200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-07-14T18:04:33.956 INFO:journalctl@ceph.mgr.x.smithi163.stdout:Jul 14 18:04:33 smithi163 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-mgr-x[96818]: 2023-07-14T18:04:33.641+0000 7f87ff936200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-07-14T18:04:34.455 INFO:journalctl@ceph.mgr.x.smithi163.stdout:Jul 14 18:04:34 smithi163 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-mgr-x[96818]: 2023-07-14T18:04:34.061+0000 7f87ff936200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-07-14T18:04:34.955 INFO:journalctl@ceph.mgr.x.smithi163.stdout:Jul 14 18:04:34 smithi163 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-mgr-x[96818]: 2023-07-14T18:04:34.635+0000 7f87ff936200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-07-14T18:04:34.956 INFO:journalctl@ceph.mgr.x.smithi163.stdout:Jul 14 18:04:34 smithi163 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-mgr-x[96818]: 2023-07-14T18:04:34.805+0000 7f87ff936200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-07-14T18:04:35.856 INFO:journalctl@ceph.mgr.x.smithi163.stdout:Jul 14 18:04:35 smithi163 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-mgr-x[96818]: 2023-07-14T18:04:35.570+0000 7f87ff936200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-07-14T18:04:35.856 INFO:journalctl@ceph.mgr.x.smithi163.stdout:Jul 14 18:04:35 smithi163 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-mgr-x[96818]: 2023-07-14T18:04:35.666+0000 7f87ff936200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-07-14T18:04:36.171 INFO:journalctl@ceph.mgr.x.smithi163.stdout:Jul 14 18:04:35 smithi163 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-mgr-x[96818]: 2023-07-14T18:04:35.849+0000 7f87ff936200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-07-14T18:04:36.455 INFO:journalctl@ceph.mgr.x.smithi163.stdout:Jul 14 18:04:36 smithi163 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-mgr-x[96818]: 2023-07-14T18:04:36.141+0000 7f87ff936200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-07-14T18:04:36.456 INFO:journalctl@ceph.mgr.x.smithi163.stdout:Jul 14 18:04:36 smithi163 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-mgr-x[96818]: 2023-07-14T18:04:36.387+0000 7f87ff936200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-07-14T18:04:36.527 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stdout 2023-07-14T18:04:36.535 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stdout { 2023-07-14T18:04:36.535 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stdout "fsid": "bf7326ec-2270-11ee-9b33-001a4aab830c", 2023-07-14T18:04:36.535 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stdout "health": { 2023-07-14T18:04:36.535 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2023-07-14T18:04:36.535 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stdout "checks": {}, 2023-07-14T18:04:36.535 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stdout "mutes": [] 2023-07-14T18:04:36.535 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stdout }, 2023-07-14T18:04:36.536 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2023-07-14T18:04:36.536 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stdout "quorum": [ 2023-07-14T18:04:36.536 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stdout 0 2023-07-14T18:04:36.536 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stdout ], 2023-07-14T18:04:36.536 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2023-07-14T18:04:36.536 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stdout "a" 2023-07-14T18:04:36.536 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stdout ], 2023-07-14T18:04:36.537 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stdout "quorum_age": 5, 2023-07-14T18:04:36.537 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stdout "monmap": { 2023-07-14T18:04:36.537 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-07-14T18:04:36.537 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "reef", 2023-07-14T18:04:36.537 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stdout "num_mons": 1 2023-07-14T18:04:36.537 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stdout }, 2023-07-14T18:04:36.537 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stdout "osdmap": { 2023-07-14T18:04:36.537 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-07-14T18:04:36.538 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2023-07-14T18:04:36.538 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2023-07-14T18:04:36.538 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2023-07-14T18:04:36.538 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2023-07-14T18:04:36.538 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2023-07-14T18:04:36.538 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2023-07-14T18:04:36.538 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stdout }, 2023-07-14T18:04:36.539 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stdout "pgmap": { 2023-07-14T18:04:36.539 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2023-07-14T18:04:36.539 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2023-07-14T18:04:36.539 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2023-07-14T18:04:36.539 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2023-07-14T18:04:36.539 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2023-07-14T18:04:36.539 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2023-07-14T18:04:36.539 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2023-07-14T18:04:36.540 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2023-07-14T18:04:36.540 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stdout }, 2023-07-14T18:04:36.540 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stdout "fsmap": { 2023-07-14T18:04:36.540 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-07-14T18:04:36.540 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stdout "by_rank": [], 2023-07-14T18:04:36.540 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stdout "up:standby": 0 2023-07-14T18:04:36.540 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stdout }, 2023-07-14T18:04:36.540 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stdout "mgrmap": { 2023-07-14T18:04:36.541 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stdout "available": false, 2023-07-14T18:04:36.541 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2023-07-14T18:04:36.541 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stdout "modules": [ 2023-07-14T18:04:36.541 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stdout "iostat", 2023-07-14T18:04:36.541 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stdout "nfs", 2023-07-14T18:04:36.541 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stdout "restful" 2023-07-14T18:04:36.541 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stdout ], 2023-07-14T18:04:36.542 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stdout "services": {} 2023-07-14T18:04:36.542 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stdout }, 2023-07-14T18:04:36.542 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stdout "servicemap": { 2023-07-14T18:04:36.542 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-07-14T18:04:36.542 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stdout "modified": "2023-07-14T18:04:26.263987+0000", 2023-07-14T18:04:36.542 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stdout "services": {} 2023-07-14T18:04:36.542 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stdout }, 2023-07-14T18:04:36.542 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stdout "progress_events": {} 2023-07-14T18:04:36.543 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stdout } 2023-07-14T18:04:36.543 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:36.063+0000 7f0ee731c700 1 Processor -- start 2023-07-14T18:04:36.543 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:36.063+0000 7f0ee731c700 1 -- start start 2023-07-14T18:04:36.543 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:36.063+0000 7f0ee731c700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f0ee0105d30 0x7f0ee0108110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:04:36.543 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:36.063+0000 7f0ee731c700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ee0079d10 con 0x7f0ee0105d30 2023-07-14T18:04:36.543 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:36.064+0000 7f0ee50b8700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f0ee0105d30 0x7f0ee0108110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:04:36.543 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:36.064+0000 7f0ee50b8700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f0ee0105d30 0x7f0ee0108110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:54424/0 (socket says 172.21.15.163:54424) 2023-07-14T18:04:36.543 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:36.064+0000 7f0ee50b8700 1 -- 172.21.15.163:0/3198242236 learned_addr learned my addr 172.21.15.163:0/3198242236 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:04:36.544 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:36.064+0000 7f0ee50b8700 1 -- 172.21.15.163:0/3198242236 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ee0079e50 con 0x7f0ee0105d30 2023-07-14T18:04:36.544 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:36.064+0000 7f0ee50b8700 1 --2- 172.21.15.163:0/3198242236 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f0ee0105d30 0x7f0ee0108110 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f0edc0098a0 tx=0x7f0edc009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a90ec0686abbd24f server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:04:36.544 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:36.064+0000 7f0ed7fff700 1 -- 172.21.15.163:0/3198242236 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0edc004160 con 0x7f0ee0105d30 2023-07-14T18:04:36.544 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:36.064+0000 7f0ed7fff700 1 -- 172.21.15.163:0/3198242236 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(25 keys) v1 ==== 1036+0+0 (secure 0 0 0) 0x7f0edc0042c0 con 0x7f0ee0105d30 2023-07-14T18:04:36.544 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:36.064+0000 7f0ed7fff700 1 -- 172.21.15.163:0/3198242236 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0edc011940 con 0x7f0ee0105d30 2023-07-14T18:04:36.544 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:36.065+0000 7f0ee731c700 1 -- 172.21.15.163:0/3198242236 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f0ee0105d30 msgr2=0x7f0ee0108110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:04:36.544 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:36.065+0000 7f0ee731c700 1 --2- 172.21.15.163:0/3198242236 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f0ee0105d30 0x7f0ee0108110 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f0edc0098a0 tx=0x7f0edc009bb0 comp rx=0 tx=0).stop 2023-07-14T18:04:36.544 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:36.065+0000 7f0ee731c700 1 -- 172.21.15.163:0/3198242236 shutdown_connections 2023-07-14T18:04:36.545 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:36.065+0000 7f0ee731c700 1 --2- 172.21.15.163:0/3198242236 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f0ee0105d30 0x7f0ee0108110 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:04:36.545 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:36.065+0000 7f0ee731c700 1 -- 172.21.15.163:0/3198242236 >> 172.21.15.163:0/3198242236 conn(0x7f0ee00ff770 msgr2=0x7f0ee0101b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:04:36.545 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:36.065+0000 7f0ee731c700 1 -- 172.21.15.163:0/3198242236 shutdown_connections 2023-07-14T18:04:36.545 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:36.065+0000 7f0ee731c700 1 -- 172.21.15.163:0/3198242236 wait complete. 2023-07-14T18:04:36.545 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:36.066+0000 7f0ee731c700 1 Processor -- start 2023-07-14T18:04:36.545 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:36.066+0000 7f0ee731c700 1 -- start start 2023-07-14T18:04:36.545 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:36.066+0000 7f0ee731c700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f0ee0105d30 0x7f0ee019b100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:04:36.546 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:36.066+0000 7f0ee731c700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ee019b640 con 0x7f0ee0105d30 2023-07-14T18:04:36.546 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:36.066+0000 7f0ee50b8700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f0ee0105d30 0x7f0ee019b100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:04:36.546 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:36.066+0000 7f0ee50b8700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f0ee0105d30 0x7f0ee019b100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:54426/0 (socket says 172.21.15.163:54426) 2023-07-14T18:04:36.546 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:36.066+0000 7f0ee50b8700 1 -- 172.21.15.163:0/3986725370 learned_addr learned my addr 172.21.15.163:0/3986725370 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:04:36.546 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:36.066+0000 7f0ee50b8700 1 -- 172.21.15.163:0/3986725370 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0edc009550 con 0x7f0ee0105d30 2023-07-14T18:04:36.546 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:36.067+0000 7f0ee50b8700 1 --2- 172.21.15.163:0/3986725370 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f0ee0105d30 0x7f0ee019b100 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f0edc006af0 tx=0x7f0edc011a30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:04:36.546 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:36.067+0000 7f0ed67fc700 1 -- 172.21.15.163:0/3986725370 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0edc003bf0 con 0x7f0ee0105d30 2023-07-14T18:04:36.546 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:36.067+0000 7f0ee731c700 1 -- 172.21.15.163:0/3986725370 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ee019b8a0 con 0x7f0ee0105d30 2023-07-14T18:04:36.547 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:36.067+0000 7f0ed67fc700 1 -- 172.21.15.163:0/3986725370 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(25 keys) v1 ==== 1036+0+0 (secure 0 0 0) 0x7f0edc01b8b0 con 0x7f0ee0105d30 2023-07-14T18:04:36.547 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:36.067+0000 7f0ed67fc700 1 -- 172.21.15.163:0/3986725370 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0edc0198b0 con 0x7f0ee0105d30 2023-07-14T18:04:36.547 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:36.067+0000 7f0ee731c700 1 -- 172.21.15.163:0/3986725370 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ee019c4d0 con 0x7f0ee0105d30 2023-07-14T18:04:36.547 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:36.067+0000 7f0ed67fc700 1 -- 172.21.15.163:0/3986725370 <== mon.0 v2:172.21.15.163:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f0edc0233f0 con 0x7f0ee0105d30 2023-07-14T18:04:36.547 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:36.067+0000 7f0ed67fc700 1 -- 172.21.15.163:0/3986725370 <== mon.0 v2:172.21.15.163:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f0edc01a750 con 0x7f0ee0105d30 2023-07-14T18:04:36.547 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:36.068+0000 7f0ee731c700 1 -- 172.21.15.163:0/3986725370 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ee0061c70 con 0x7f0ee0105d30 2023-07-14T18:04:36.547 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:36.070+0000 7f0ed67fc700 1 -- 172.21.15.163:0/3986725370 <== mon.0 v2:172.21.15.163:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72446 (secure 0 0 0) 0x7f0edc028060 con 0x7f0ee0105d30 2023-07-14T18:04:36.547 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:36.143+0000 7f0ee731c700 1 -- 172.21.15.163:0/3986725370 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) v1 -- 0x7f0ee019c950 con 0x7f0ee0105d30 2023-07-14T18:04:36.548 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:36.143+0000 7f0ed67fc700 1 -- 172.21.15.163:0/3986725370 <== mon.0 v2:172.21.15.163:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) v1 ==== 79+0+1238 (secure 0 0 0) 0x7f0edc01bd70 con 0x7f0ee0105d30 2023-07-14T18:04:36.548 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:36.144+0000 7f0ee731c700 1 -- 172.21.15.163:0/3986725370 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f0ee0105d30 msgr2=0x7f0ee019b100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:04:36.548 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:36.144+0000 7f0ee731c700 1 --2- 172.21.15.163:0/3986725370 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f0ee0105d30 0x7f0ee019b100 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f0edc006af0 tx=0x7f0edc011a30 comp rx=0 tx=0).stop 2023-07-14T18:04:36.548 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:36.144+0000 7f0ee731c700 1 -- 172.21.15.163:0/3986725370 shutdown_connections 2023-07-14T18:04:36.548 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:36.144+0000 7f0ee731c700 1 --2- 172.21.15.163:0/3986725370 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f0ee0105d30 0x7f0ee019b100 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:04:36.548 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:36.144+0000 7f0ee731c700 1 -- 172.21.15.163:0/3986725370 >> 172.21.15.163:0/3986725370 conn(0x7f0ee00ff770 msgr2=0x7f0ee0100510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:04:36.548 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:36.145+0000 7f0ee731c700 1 -- 172.21.15.163:0/3986725370 shutdown_connections 2023-07-14T18:04:36.549 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:36.145+0000 7f0ee731c700 1 -- 172.21.15.163:0/3986725370 wait complete. 2023-07-14T18:04:36.549 INFO:teuthology.orchestra.run.smithi163.stdout:mgr not available, waiting (2/15)... 2023-07-14T18:04:36.831 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:04:36 smithi163 ceph-mon[96576]: from='client.? 172.21.15.163:0/3986725370' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2023-07-14T18:04:36.832 INFO:journalctl@ceph.mgr.x.smithi163.stdout:Jul 14 18:04:36 smithi163 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-mgr-x[96818]: 2023-07-14T18:04:36.541+0000 7f87ff936200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-07-14T18:04:37.205 INFO:journalctl@ceph.mgr.x.smithi163.stdout:Jul 14 18:04:36 smithi163 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-mgr-x[96818]: 2023-07-14T18:04:36.802+0000 7f87ff936200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-07-14T18:04:37.857 INFO:journalctl@ceph.mgr.x.smithi163.stdout:Jul 14 18:04:37 smithi163 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-mgr-x[96818]: 2023-07-14T18:04:37.505+0000 7f87ff936200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-07-14T18:04:37.858 INFO:journalctl@ceph.mgr.x.smithi163.stdout:Jul 14 18:04:37 smithi163 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-mgr-x[96818]: 2023-07-14T18:04:37.638+0000 7f87ff936200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-07-14T18:04:38.188 INFO:journalctl@ceph.mgr.x.smithi163.stdout:Jul 14 18:04:37 smithi163 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-mgr-x[96818]: 2023-07-14T18:04:37.828+0000 7f87ff936200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-07-14T18:04:38.188 INFO:journalctl@ceph.mgr.x.smithi163.stdout:Jul 14 18:04:37 smithi163 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-mgr-x[96818]: 2023-07-14T18:04:37.941+0000 7f87ff936200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-07-14T18:04:38.455 INFO:journalctl@ceph.mgr.x.smithi163.stdout:Jul 14 18:04:38 smithi163 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-mgr-x[96818]: 2023-07-14T18:04:38.158+0000 7f87ff936200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-07-14T18:04:39.441 INFO:journalctl@ceph.mgr.x.smithi163.stdout:Jul 14 18:04:39 smithi163 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-mgr-x[96818]: 2023-07-14T18:04:39.047+0000 7f87ff936200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-07-14T18:04:39.442 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:04:39 smithi163 ceph-mon[96576]: Activating manager daemon x 2023-07-14T18:04:39.442 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:04:39 smithi163 ceph-mon[96576]: mgrmap e2: x(active, starting, since 0.00328966s) 2023-07-14T18:04:39.442 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:04:39 smithi163 ceph-mon[96576]: from='mgr.14100 172.21.15.163:0/3950367290' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2023-07-14T18:04:39.442 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:04:39 smithi163 ceph-mon[96576]: from='mgr.14100 172.21.15.163:0/3950367290' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2023-07-14T18:04:39.443 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:04:39 smithi163 ceph-mon[96576]: from='mgr.14100 172.21.15.163:0/3950367290' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2023-07-14T18:04:39.443 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:04:39 smithi163 ceph-mon[96576]: from='mgr.14100 172.21.15.163:0/3950367290' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-07-14T18:04:39.443 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:04:39 smithi163 ceph-mon[96576]: from='mgr.14100 172.21.15.163:0/3950367290' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2023-07-14T18:04:39.443 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:04:39 smithi163 ceph-mon[96576]: from='client.? 172.21.15.163:0/2123075917' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2023-07-14T18:04:39.443 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:04:39 smithi163 ceph-mon[96576]: Manager daemon x is now available 2023-07-14T18:04:39.443 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:04:39 smithi163 ceph-mon[96576]: from='mgr.14100 172.21.15.163:0/3950367290' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2023-07-14T18:04:39.443 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:04:39 smithi163 ceph-mon[96576]: from='mgr.14100 172.21.15.163:0/3950367290' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2023-07-14T18:04:39.444 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:04:39 smithi163 ceph-mon[96576]: from='mgr.14100 172.21.15.163:0/3950367290' entity='mgr.x' 2023-07-14T18:04:39.444 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:04:39 smithi163 ceph-mon[96576]: from='mgr.14100 172.21.15.163:0/3950367290' entity='mgr.x' 2023-07-14T18:04:39.444 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:04:39 smithi163 ceph-mon[96576]: from='mgr.14100 172.21.15.163:0/3950367290' entity='mgr.x' 2023-07-14T18:04:39.483 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stdout 2023-07-14T18:04:39.483 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stdout { 2023-07-14T18:04:39.483 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stdout "fsid": "bf7326ec-2270-11ee-9b33-001a4aab830c", 2023-07-14T18:04:39.484 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stdout "health": { 2023-07-14T18:04:39.484 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2023-07-14T18:04:39.484 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stdout "checks": {}, 2023-07-14T18:04:39.484 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stdout "mutes": [] 2023-07-14T18:04:39.484 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stdout }, 2023-07-14T18:04:39.484 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2023-07-14T18:04:39.485 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stdout "quorum": [ 2023-07-14T18:04:39.485 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stdout 0 2023-07-14T18:04:39.485 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stdout ], 2023-07-14T18:04:39.485 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2023-07-14T18:04:39.485 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stdout "a" 2023-07-14T18:04:39.485 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stdout ], 2023-07-14T18:04:39.485 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stdout "quorum_age": 8, 2023-07-14T18:04:39.485 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stdout "monmap": { 2023-07-14T18:04:39.486 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-07-14T18:04:39.486 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "reef", 2023-07-14T18:04:39.486 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stdout "num_mons": 1 2023-07-14T18:04:39.486 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stdout }, 2023-07-14T18:04:39.486 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stdout "osdmap": { 2023-07-14T18:04:39.486 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-07-14T18:04:39.486 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2023-07-14T18:04:39.492 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2023-07-14T18:04:39.492 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2023-07-14T18:04:39.492 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2023-07-14T18:04:39.492 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2023-07-14T18:04:39.492 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2023-07-14T18:04:39.492 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stdout }, 2023-07-14T18:04:39.493 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stdout "pgmap": { 2023-07-14T18:04:39.493 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2023-07-14T18:04:39.493 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2023-07-14T18:04:39.493 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2023-07-14T18:04:39.493 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2023-07-14T18:04:39.493 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2023-07-14T18:04:39.493 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2023-07-14T18:04:39.493 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2023-07-14T18:04:39.494 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2023-07-14T18:04:39.494 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stdout }, 2023-07-14T18:04:39.494 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stdout "fsmap": { 2023-07-14T18:04:39.494 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-07-14T18:04:39.494 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stdout "by_rank": [], 2023-07-14T18:04:39.494 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stdout "up:standby": 0 2023-07-14T18:04:39.494 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stdout }, 2023-07-14T18:04:39.495 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stdout "mgrmap": { 2023-07-14T18:04:39.495 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stdout "available": false, 2023-07-14T18:04:39.495 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2023-07-14T18:04:39.495 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stdout "modules": [ 2023-07-14T18:04:39.495 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stdout "iostat", 2023-07-14T18:04:39.495 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stdout "nfs", 2023-07-14T18:04:39.495 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stdout "restful" 2023-07-14T18:04:39.495 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stdout ], 2023-07-14T18:04:39.496 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stdout "services": {} 2023-07-14T18:04:39.496 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stdout }, 2023-07-14T18:04:39.496 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stdout "servicemap": { 2023-07-14T18:04:39.496 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-07-14T18:04:39.496 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stdout "modified": "2023-07-14T18:04:26.263987+0000", 2023-07-14T18:04:39.496 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stdout "services": {} 2023-07-14T18:04:39.496 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stdout }, 2023-07-14T18:04:39.496 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stdout "progress_events": {} 2023-07-14T18:04:39.497 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stdout } 2023-07-14T18:04:39.497 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:38.994+0000 7f4c8341c700 1 Processor -- start 2023-07-14T18:04:39.497 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:38.994+0000 7f4c8341c700 1 -- start start 2023-07-14T18:04:39.497 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:38.994+0000 7f4c8341c700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f4c7c105cf0 0x7f4c7c1080d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:04:39.497 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:38.994+0000 7f4c8341c700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c7c079d50 con 0x7f4c7c105cf0 2023-07-14T18:04:39.497 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:38.994+0000 7f4c811b8700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f4c7c105cf0 0x7f4c7c1080d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:04:39.497 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:38.994+0000 7f4c811b8700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f4c7c105cf0 0x7f4c7c1080d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:54428/0 (socket says 172.21.15.163:54428) 2023-07-14T18:04:39.498 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:38.994+0000 7f4c811b8700 1 -- 172.21.15.163:0/1079010413 learned_addr learned my addr 172.21.15.163:0/1079010413 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:04:39.498 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:38.995+0000 7f4c811b8700 1 -- 172.21.15.163:0/1079010413 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c7c079e90 con 0x7f4c7c105cf0 2023-07-14T18:04:39.498 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:38.995+0000 7f4c811b8700 1 --2- 172.21.15.163:0/1079010413 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f4c7c105cf0 0x7f4c7c1080d0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f4c780098a0 tx=0x7f4c78009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab9f1dfc08595c13 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:04:39.498 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:38.995+0000 7f4c73fff700 1 -- 172.21.15.163:0/1079010413 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4c78004160 con 0x7f4c7c105cf0 2023-07-14T18:04:39.498 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:38.995+0000 7f4c73fff700 1 -- 172.21.15.163:0/1079010413 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(25 keys) v1 ==== 1036+0+0 (secure 0 0 0) 0x7f4c780042c0 con 0x7f4c7c105cf0 2023-07-14T18:04:39.498 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:38.995+0000 7f4c73fff700 1 -- 172.21.15.163:0/1079010413 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4c78011940 con 0x7f4c7c105cf0 2023-07-14T18:04:39.498 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:38.996+0000 7f4c8341c700 1 -- 172.21.15.163:0/1079010413 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f4c7c105cf0 msgr2=0x7f4c7c1080d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:04:39.498 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:38.996+0000 7f4c8341c700 1 --2- 172.21.15.163:0/1079010413 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f4c7c105cf0 0x7f4c7c1080d0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f4c780098a0 tx=0x7f4c78009bb0 comp rx=0 tx=0).stop 2023-07-14T18:04:39.499 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:38.996+0000 7f4c8341c700 1 -- 172.21.15.163:0/1079010413 shutdown_connections 2023-07-14T18:04:39.499 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:38.996+0000 7f4c8341c700 1 --2- 172.21.15.163:0/1079010413 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f4c7c105cf0 0x7f4c7c1080d0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:04:39.499 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:38.996+0000 7f4c8341c700 1 -- 172.21.15.163:0/1079010413 >> 172.21.15.163:0/1079010413 conn(0x7f4c7c0ff770 msgr2=0x7f4c7c101b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:04:39.499 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:38.996+0000 7f4c8341c700 1 -- 172.21.15.163:0/1079010413 shutdown_connections 2023-07-14T18:04:39.499 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:38.996+0000 7f4c8341c700 1 -- 172.21.15.163:0/1079010413 wait complete. 2023-07-14T18:04:39.499 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:38.996+0000 7f4c8341c700 1 Processor -- start 2023-07-14T18:04:39.499 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:38.996+0000 7f4c8341c700 1 -- start start 2023-07-14T18:04:39.499 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:38.997+0000 7f4c8341c700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f4c7c105cf0 0x7f4c7c198f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:04:39.500 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:38.997+0000 7f4c8341c700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c7c1994b0 con 0x7f4c7c105cf0 2023-07-14T18:04:39.500 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:38.997+0000 7f4c811b8700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f4c7c105cf0 0x7f4c7c198f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:04:39.500 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:38.997+0000 7f4c811b8700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f4c7c105cf0 0x7f4c7c198f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:54430/0 (socket says 172.21.15.163:54430) 2023-07-14T18:04:39.500 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:38.997+0000 7f4c811b8700 1 -- 172.21.15.163:0/2123075917 learned_addr learned my addr 172.21.15.163:0/2123075917 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:04:39.500 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:38.997+0000 7f4c811b8700 1 -- 172.21.15.163:0/2123075917 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c78009550 con 0x7f4c7c105cf0 2023-07-14T18:04:39.500 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:38.997+0000 7f4c811b8700 1 --2- 172.21.15.163:0/2123075917 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f4c7c105cf0 0x7f4c7c198f70 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f4c78000c00 tx=0x7f4c78011e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:04:39.500 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:38.997+0000 7f4c727fc700 1 -- 172.21.15.163:0/2123075917 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4c780036a0 con 0x7f4c7c105cf0 2023-07-14T18:04:39.501 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:38.997+0000 7f4c727fc700 1 -- 172.21.15.163:0/2123075917 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(25 keys) v1 ==== 1036+0+0 (secure 0 0 0) 0x7f4c7801b440 con 0x7f4c7c105cf0 2023-07-14T18:04:39.501 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:38.997+0000 7f4c8341c700 1 -- 172.21.15.163:0/2123075917 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4c7c1996b0 con 0x7f4c7c105cf0 2023-07-14T18:04:39.501 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:38.997+0000 7f4c727fc700 1 -- 172.21.15.163:0/2123075917 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4c780193f0 con 0x7f4c7c105cf0 2023-07-14T18:04:39.501 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:38.998+0000 7f4c727fc700 1 -- 172.21.15.163:0/2123075917 <== mon.0 v2:172.21.15.163:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f4c780198e0 con 0x7f4c7c105cf0 2023-07-14T18:04:39.501 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:38.998+0000 7f4c8341c700 1 -- 172.21.15.163:0/2123075917 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c7c199ad0 con 0x7f4c7c105cf0 2023-07-14T18:04:39.501 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:38.998+0000 7f4c727fc700 1 -- 172.21.15.163:0/2123075917 <== mon.0 v2:172.21.15.163:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f4c78024790 con 0x7f4c7c105cf0 2023-07-14T18:04:39.501 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:38.998+0000 7f4c8341c700 1 -- 172.21.15.163:0/2123075917 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4c7c109280 con 0x7f4c7c105cf0 2023-07-14T18:04:39.501 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:39.000+0000 7f4c727fc700 1 -- 172.21.15.163:0/2123075917 <== mon.0 v2:172.21.15.163:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72446 (secure 0 0 0) 0x7f4c78029060 con 0x7f4c7c105cf0 2023-07-14T18:04:39.502 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:39.061+0000 7f4c727fc700 1 -- 172.21.15.163:0/2123075917 <== mon.0 v2:172.21.15.163:3300/0 7 ==== mgrmap(e 2) v1 ==== 45239+0+0 (secure 0 0 0) 0x7f4c7801b5b0 con 0x7f4c7c105cf0 2023-07-14T18:04:39.502 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:39.075+0000 7f4c8341c700 1 -- 172.21.15.163:0/2123075917 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) v1 -- 0x7f4c7c19a650 con 0x7f4c7c105cf0 2023-07-14T18:04:39.502 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:39.075+0000 7f4c727fc700 1 -- 172.21.15.163:0/2123075917 <== mon.0 v2:172.21.15.163:3300/0 8 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) v1 ==== 79+0+1238 (secure 0 0 0) 0x7f4c7801f030 con 0x7f4c7c105cf0 2023-07-14T18:04:39.502 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:39.076+0000 7f4c8341c700 1 -- 172.21.15.163:0/2123075917 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f4c7c105cf0 msgr2=0x7f4c7c198f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:04:39.502 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:39.076+0000 7f4c8341c700 1 --2- 172.21.15.163:0/2123075917 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f4c7c105cf0 0x7f4c7c198f70 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f4c78000c00 tx=0x7f4c78011e70 comp rx=0 tx=0).stop 2023-07-14T18:04:39.502 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:39.076+0000 7f4c8341c700 1 -- 172.21.15.163:0/2123075917 shutdown_connections 2023-07-14T18:04:39.502 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:39.076+0000 7f4c8341c700 1 --2- 172.21.15.163:0/2123075917 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f4c7c105cf0 0x7f4c7c198f70 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:04:39.502 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:39.076+0000 7f4c8341c700 1 -- 172.21.15.163:0/2123075917 >> 172.21.15.163:0/2123075917 conn(0x7f4c7c0ff770 msgr2=0x7f4c7c100510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:04:39.503 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:39.076+0000 7f4c8341c700 1 -- 172.21.15.163:0/2123075917 shutdown_connections 2023-07-14T18:04:39.503 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:39.076+0000 7f4c8341c700 1 -- 172.21.15.163:0/2123075917 wait complete. 2023-07-14T18:04:39.503 INFO:teuthology.orchestra.run.smithi163.stdout:mgr not available, waiting (3/15)... 2023-07-14T18:04:41.456 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:04:41 smithi163 ceph-mon[96576]: mgrmap e3: x(active, since 1.00668s) 2023-07-14T18:04:43.435 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:04:43 smithi163 ceph-mon[96576]: mgrmap e4: x(active, since 3s) 2023-07-14T18:04:44.547 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stdout 2023-07-14T18:04:44.547 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stdout { 2023-07-14T18:04:44.547 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stdout "fsid": "bf7326ec-2270-11ee-9b33-001a4aab830c", 2023-07-14T18:04:44.547 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stdout "health": { 2023-07-14T18:04:44.547 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2023-07-14T18:04:44.547 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stdout "checks": {}, 2023-07-14T18:04:44.548 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stdout "mutes": [] 2023-07-14T18:04:44.548 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stdout }, 2023-07-14T18:04:44.548 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2023-07-14T18:04:44.548 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stdout "quorum": [ 2023-07-14T18:04:44.548 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stdout 0 2023-07-14T18:04:44.548 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stdout ], 2023-07-14T18:04:44.548 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2023-07-14T18:04:44.549 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stdout "a" 2023-07-14T18:04:44.549 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stdout ], 2023-07-14T18:04:44.549 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stdout "quorum_age": 13, 2023-07-14T18:04:44.549 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stdout "monmap": { 2023-07-14T18:04:44.549 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-07-14T18:04:44.549 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "reef", 2023-07-14T18:04:44.549 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stdout "num_mons": 1 2023-07-14T18:04:44.549 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stdout }, 2023-07-14T18:04:44.550 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stdout "osdmap": { 2023-07-14T18:04:44.550 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-07-14T18:04:44.550 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2023-07-14T18:04:44.550 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2023-07-14T18:04:44.550 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2023-07-14T18:04:44.550 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2023-07-14T18:04:44.550 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2023-07-14T18:04:44.550 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2023-07-14T18:04:44.551 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stdout }, 2023-07-14T18:04:44.551 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stdout "pgmap": { 2023-07-14T18:04:44.551 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2023-07-14T18:04:44.551 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2023-07-14T18:04:44.551 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2023-07-14T18:04:44.551 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2023-07-14T18:04:44.551 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2023-07-14T18:04:44.551 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2023-07-14T18:04:44.552 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2023-07-14T18:04:44.552 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2023-07-14T18:04:44.552 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stdout }, 2023-07-14T18:04:44.552 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stdout "fsmap": { 2023-07-14T18:04:44.552 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-07-14T18:04:44.552 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stdout "by_rank": [], 2023-07-14T18:04:44.552 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stdout "up:standby": 0 2023-07-14T18:04:44.552 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stdout }, 2023-07-14T18:04:44.553 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stdout "mgrmap": { 2023-07-14T18:04:44.553 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stdout "available": true, 2023-07-14T18:04:44.553 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2023-07-14T18:04:44.553 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stdout "modules": [ 2023-07-14T18:04:44.553 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stdout "iostat", 2023-07-14T18:04:44.553 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stdout "nfs", 2023-07-14T18:04:44.553 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stdout "restful" 2023-07-14T18:04:44.553 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stdout ], 2023-07-14T18:04:44.554 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stdout "services": {} 2023-07-14T18:04:44.554 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stdout }, 2023-07-14T18:04:44.554 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stdout "servicemap": { 2023-07-14T18:04:44.554 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-07-14T18:04:44.554 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stdout "modified": "2023-07-14T18:04:26.263987+0000", 2023-07-14T18:04:44.554 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stdout "services": {} 2023-07-14T18:04:44.554 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stdout }, 2023-07-14T18:04:44.554 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stdout "progress_events": {} 2023-07-14T18:04:44.555 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stdout } 2023-07-14T18:04:44.555 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:43.930+0000 7f6ae61b2700 1 Processor -- start 2023-07-14T18:04:44.555 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:43.930+0000 7f6ae61b2700 1 -- start start 2023-07-14T18:04:44.555 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:43.930+0000 7f6ae61b2700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f6ae01067e0 0x7f6ae0106bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:04:44.555 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:43.930+0000 7f6ae61b2700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ae0107130 con 0x7f6ae01067e0 2023-07-14T18:04:44.555 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:43.930+0000 7f6adf7fe700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f6ae01067e0 0x7f6ae0106bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:04:44.555 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:43.931+0000 7f6adf7fe700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f6ae01067e0 0x7f6ae0106bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:54456/0 (socket says 172.21.15.163:54456) 2023-07-14T18:04:44.556 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:43.931+0000 7f6adf7fe700 1 -- 172.21.15.163:0/2000283117 learned_addr learned my addr 172.21.15.163:0/2000283117 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:04:44.556 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:43.931+0000 7f6adf7fe700 1 -- 172.21.15.163:0/2000283117 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ae0107270 con 0x7f6ae01067e0 2023-07-14T18:04:44.556 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:43.931+0000 7f6adf7fe700 1 --2- 172.21.15.163:0/2000283117 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f6ae01067e0 0x7f6ae0106bf0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f6ad40098a0 tx=0x7f6ad4009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a061f9247ed263c1 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:04:44.556 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:43.931+0000 7f6ade7fc700 1 -- 172.21.15.163:0/2000283117 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6ad4004160 con 0x7f6ae01067e0 2023-07-14T18:04:44.556 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:43.931+0000 7f6ade7fc700 1 -- 172.21.15.163:0/2000283117 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(25 keys) v1 ==== 1036+0+0 (secure 0 0 0) 0x7f6ad40042c0 con 0x7f6ae01067e0 2023-07-14T18:04:44.556 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:43.931+0000 7f6ade7fc700 1 -- 172.21.15.163:0/2000283117 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6ad4011940 con 0x7f6ae01067e0 2023-07-14T18:04:44.556 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:43.932+0000 7f6ae61b2700 1 -- 172.21.15.163:0/2000283117 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f6ae01067e0 msgr2=0x7f6ae0106bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:04:44.556 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:43.932+0000 7f6ae61b2700 1 --2- 172.21.15.163:0/2000283117 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f6ae01067e0 0x7f6ae0106bf0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f6ad40098a0 tx=0x7f6ad4009bb0 comp rx=0 tx=0).stop 2023-07-14T18:04:44.557 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:43.932+0000 7f6ae61b2700 1 -- 172.21.15.163:0/2000283117 shutdown_connections 2023-07-14T18:04:44.557 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:43.932+0000 7f6ae61b2700 1 --2- 172.21.15.163:0/2000283117 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f6ae01067e0 0x7f6ae0106bf0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:04:44.557 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:43.932+0000 7f6ae61b2700 1 -- 172.21.15.163:0/2000283117 >> 172.21.15.163:0/2000283117 conn(0x7f6ae00feef0 msgr2=0x7f6ae0101300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:04:44.557 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:43.932+0000 7f6ae61b2700 1 -- 172.21.15.163:0/2000283117 shutdown_connections 2023-07-14T18:04:44.557 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:43.932+0000 7f6ae61b2700 1 -- 172.21.15.163:0/2000283117 wait complete. 2023-07-14T18:04:44.557 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:43.932+0000 7f6ae61b2700 1 Processor -- start 2023-07-14T18:04:44.557 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:43.933+0000 7f6ae61b2700 1 -- start start 2023-07-14T18:04:44.558 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:43.933+0000 7f6ae61b2700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f6ae01067e0 0x7f6ae019b160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:04:44.558 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:43.933+0000 7f6ae61b2700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ae019b6a0 con 0x7f6ae01067e0 2023-07-14T18:04:44.558 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:43.933+0000 7f6adf7fe700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f6ae01067e0 0x7f6ae019b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:04:44.558 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:43.933+0000 7f6adf7fe700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f6ae01067e0 0x7f6ae019b160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:54458/0 (socket says 172.21.15.163:54458) 2023-07-14T18:04:44.558 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:43.933+0000 7f6adf7fe700 1 -- 172.21.15.163:0/3271897155 learned_addr learned my addr 172.21.15.163:0/3271897155 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:04:44.558 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:43.933+0000 7f6adf7fe700 1 -- 172.21.15.163:0/3271897155 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ad4009550 con 0x7f6ae01067e0 2023-07-14T18:04:44.558 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:43.933+0000 7f6adf7fe700 1 --2- 172.21.15.163:0/3271897155 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f6ae01067e0 0x7f6ae019b160 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f6ad4006af0 tx=0x7f6ad4011a30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:04:44.558 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:43.933+0000 7f6adcff9700 1 -- 172.21.15.163:0/3271897155 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6ad4003bf0 con 0x7f6ae01067e0 2023-07-14T18:04:44.559 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:43.934+0000 7f6adcff9700 1 -- 172.21.15.163:0/3271897155 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(25 keys) v1 ==== 1036+0+0 (secure 0 0 0) 0x7f6ad401b8b0 con 0x7f6ae01067e0 2023-07-14T18:04:44.559 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:43.934+0000 7f6adcff9700 1 -- 172.21.15.163:0/3271897155 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6ad40198b0 con 0x7f6ae01067e0 2023-07-14T18:04:44.559 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:43.934+0000 7f6ae61b2700 1 -- 172.21.15.163:0/3271897155 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ae019b8a0 con 0x7f6ae01067e0 2023-07-14T18:04:44.559 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:43.934+0000 7f6ae61b2700 1 -- 172.21.15.163:0/3271897155 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ae019bcc0 con 0x7f6ae01067e0 2023-07-14T18:04:44.559 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:43.934+0000 7f6adcff9700 1 -- 172.21.15.163:0/3271897155 <== mon.0 v2:172.21.15.163:3300/0 4 ==== mgrmap(e 4) v1 ==== 45472+0+0 (secure 0 0 0) 0x7f6ad401ba20 con 0x7f6ae01067e0 2023-07-14T18:04:44.559 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:43.935+0000 7f6adcff9700 1 --2- 172.21.15.163:0/3271897155 >> [v2:172.21.15.163:6800/236891232,v1:172.21.15.163:6801/236891232] conn(0x7f6ac8038670 0x7f6ac803ab20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:04:44.559 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:43.935+0000 7f6ae61b2700 1 -- 172.21.15.163:0/3271897155 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ae0103d40 con 0x7f6ae01067e0 2023-07-14T18:04:44.559 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:43.935+0000 7f6adcff9700 1 -- 172.21.15.163:0/3271897155 <== mon.0 v2:172.21.15.163:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f6ad404c960 con 0x7f6ae01067e0 2023-07-14T18:04:44.560 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:43.935+0000 7f6adeffd700 1 --2- 172.21.15.163:0/3271897155 >> [v2:172.21.15.163:6800/236891232,v1:172.21.15.163:6801/236891232] conn(0x7f6ac8038670 0x7f6ac803ab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:04:44.560 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:43.935+0000 7f6adeffd700 1 --2- 172.21.15.163:0/3271897155 >> [v2:172.21.15.163:6800/236891232,v1:172.21.15.163:6801/236891232] conn(0x7f6ac8038670 0x7f6ac803ab20 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f6ad0006fd0 tx=0x7f6ad0006e40 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:04:44.560 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:43.940+0000 7f6adcff9700 1 -- 172.21.15.163:0/3271897155 <== mon.0 v2:172.21.15.163:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178025 (secure 0 0 0) 0x7f6ad4018530 con 0x7f6ae01067e0 2023-07-14T18:04:44.560 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:44.198+0000 7f6ae61b2700 1 -- 172.21.15.163:0/3271897155 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) v1 -- 0x7f6ae0103f60 con 0x7f6ae01067e0 2023-07-14T18:04:44.560 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:44.198+0000 7f6adcff9700 1 -- 172.21.15.163:0/3271897155 <== mon.0 v2:172.21.15.163:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) v1 ==== 79+0+1238 (secure 0 0 0) 0x7f6ad4018350 con 0x7f6ae01067e0 2023-07-14T18:04:44.560 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:44.200+0000 7f6ae61b2700 1 -- 172.21.15.163:0/3271897155 >> [v2:172.21.15.163:6800/236891232,v1:172.21.15.163:6801/236891232] conn(0x7f6ac8038670 msgr2=0x7f6ac803ab20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:04:44.560 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:44.200+0000 7f6ae61b2700 1 --2- 172.21.15.163:0/3271897155 >> [v2:172.21.15.163:6800/236891232,v1:172.21.15.163:6801/236891232] conn(0x7f6ac8038670 0x7f6ac803ab20 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f6ad0006fd0 tx=0x7f6ad0006e40 comp rx=0 tx=0).stop 2023-07-14T18:04:44.561 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:44.200+0000 7f6ae61b2700 1 -- 172.21.15.163:0/3271897155 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f6ae01067e0 msgr2=0x7f6ae019b160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:04:44.561 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:44.200+0000 7f6ae61b2700 1 --2- 172.21.15.163:0/3271897155 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f6ae01067e0 0x7f6ae019b160 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f6ad4006af0 tx=0x7f6ad4011a30 comp rx=0 tx=0).stop 2023-07-14T18:04:44.561 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:44.200+0000 7f6ae61b2700 1 -- 172.21.15.163:0/3271897155 shutdown_connections 2023-07-14T18:04:44.561 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:44.200+0000 7f6ae61b2700 1 --2- 172.21.15.163:0/3271897155 >> [v2:172.21.15.163:6800/236891232,v1:172.21.15.163:6801/236891232] conn(0x7f6ac8038670 0x7f6ac803ab20 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:04:44.561 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:44.200+0000 7f6ae61b2700 1 --2- 172.21.15.163:0/3271897155 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f6ae01067e0 0x7f6ae019b160 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:04:44.561 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:44.200+0000 7f6ae61b2700 1 -- 172.21.15.163:0/3271897155 >> 172.21.15.163:0/3271897155 conn(0x7f6ae00feef0 msgr2=0x7f6ae00ffc80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:04:44.561 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:44.200+0000 7f6ae61b2700 1 -- 172.21.15.163:0/3271897155 shutdown_connections 2023-07-14T18:04:44.561 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:44.200+0000 7f6ae61b2700 1 -- 172.21.15.163:0/3271897155 wait complete. 2023-07-14T18:04:44.562 INFO:teuthology.orchestra.run.smithi163.stdout:mgr is available 2023-07-14T18:04:44.573 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:04:44 smithi163 ceph-mon[96576]: from='client.? 172.21.15.163:0/3271897155' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2023-07-14T18:04:45.677 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:04:45 smithi163 ceph-mon[96576]: from='client.? 172.21.15.163:0/2349982752' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2023-07-14T18:04:45.693 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stdout 2023-07-14T18:04:45.694 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stdout [global] 2023-07-14T18:04:45.694 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stdout fsid = bf7326ec-2270-11ee-9b33-001a4aab830c 2023-07-14T18:04:45.694 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2023-07-14T18:04:45.694 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2023-07-14T18:04:45.694 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2023-07-14T18:04:45.694 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2023-07-14T18:04:45.694 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stdout 2023-07-14T18:04:45.695 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stdout [mgr] 2023-07-14T18:04:45.695 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2023-07-14T18:04:45.695 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stdout 2023-07-14T18:04:45.695 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stdout [osd] 2023-07-14T18:04:45.695 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2023-07-14T18:04:45.695 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2023-07-14T18:04:45.695 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2023-07-14T18:04:45.696 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2023-07-14T18:04:45.696 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2023-07-14T18:04:45.696 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:45.059+0000 7f596b529700 1 Processor -- start 2023-07-14T18:04:45.696 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:45.059+0000 7f596b529700 1 -- start start 2023-07-14T18:04:45.696 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:45.059+0000 7f596b529700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f5964106840 0x7f5964106c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:04:45.696 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:45.059+0000 7f596b529700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5964107190 con 0x7f5964106840 2023-07-14T18:04:45.696 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:45.059+0000 7f59692c5700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f5964106840 0x7f5964106c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:04:45.697 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:45.059+0000 7f59692c5700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f5964106840 0x7f5964106c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:54462/0 (socket says 172.21.15.163:54462) 2023-07-14T18:04:45.697 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:45.059+0000 7f59692c5700 1 -- 172.21.15.163:0/2748637026 learned_addr learned my addr 172.21.15.163:0/2748637026 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:04:45.697 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:45.060+0000 7f59692c5700 1 -- 172.21.15.163:0/2748637026 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59641072d0 con 0x7f5964106840 2023-07-14T18:04:45.697 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:45.060+0000 7f59692c5700 1 --2- 172.21.15.163:0/2748637026 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f5964106840 0x7f5964106c50 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f59600098a0 tx=0x7f5960009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd4a4b3f3bfe0e36 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:04:45.697 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:45.060+0000 7f595bfff700 1 -- 172.21.15.163:0/2748637026 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5960004160 con 0x7f5964106840 2023-07-14T18:04:45.697 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:45.060+0000 7f595bfff700 1 -- 172.21.15.163:0/2748637026 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(25 keys) v1 ==== 1036+0+0 (secure 0 0 0) 0x7f59600042c0 con 0x7f5964106840 2023-07-14T18:04:45.698 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:45.060+0000 7f595bfff700 1 -- 172.21.15.163:0/2748637026 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5960011940 con 0x7f5964106840 2023-07-14T18:04:45.698 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:45.060+0000 7f596b529700 1 -- 172.21.15.163:0/2748637026 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f5964106840 msgr2=0x7f5964106c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:04:45.698 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:45.060+0000 7f596b529700 1 --2- 172.21.15.163:0/2748637026 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f5964106840 0x7f5964106c50 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f59600098a0 tx=0x7f5960009bb0 comp rx=0 tx=0).stop 2023-07-14T18:04:45.698 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:45.060+0000 7f596b529700 1 -- 172.21.15.163:0/2748637026 shutdown_connections 2023-07-14T18:04:45.698 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:45.060+0000 7f596b529700 1 --2- 172.21.15.163:0/2748637026 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f5964106840 0x7f5964106c50 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:04:45.698 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:45.060+0000 7f596b529700 1 -- 172.21.15.163:0/2748637026 >> 172.21.15.163:0/2748637026 conn(0x7f59640feef0 msgr2=0x7f5964101300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:04:45.698 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:45.060+0000 7f596b529700 1 -- 172.21.15.163:0/2748637026 shutdown_connections 2023-07-14T18:04:45.699 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:45.061+0000 7f596b529700 1 -- 172.21.15.163:0/2748637026 wait complete. 2023-07-14T18:04:45.699 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:45.061+0000 7f596b529700 1 Processor -- start 2023-07-14T18:04:45.699 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:45.061+0000 7f596b529700 1 -- start start 2023-07-14T18:04:45.699 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:45.061+0000 7f596b529700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f5964106840 0x7f5964198f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:04:45.699 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:45.061+0000 7f596b529700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59641994b0 con 0x7f5964106840 2023-07-14T18:04:45.699 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:45.061+0000 7f59692c5700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f5964106840 0x7f5964198f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:04:45.699 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:45.061+0000 7f59692c5700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f5964106840 0x7f5964198f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:54464/0 (socket says 172.21.15.163:54464) 2023-07-14T18:04:45.700 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:45.061+0000 7f59692c5700 1 -- 172.21.15.163:0/2349982752 learned_addr learned my addr 172.21.15.163:0/2349982752 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:04:45.700 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:45.062+0000 7f59692c5700 1 -- 172.21.15.163:0/2349982752 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5960009550 con 0x7f5964106840 2023-07-14T18:04:45.700 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:45.062+0000 7f59692c5700 1 --2- 172.21.15.163:0/2349982752 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f5964106840 0x7f5964198f70 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f5960011dc0 tx=0x7f5960011ea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:04:45.700 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:45.062+0000 7f595a7fc700 1 -- 172.21.15.163:0/2349982752 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f59600037d0 con 0x7f5964106840 2023-07-14T18:04:45.700 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:45.062+0000 7f595a7fc700 1 -- 172.21.15.163:0/2349982752 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(25 keys) v1 ==== 1036+0+0 (secure 0 0 0) 0x7f596001b440 con 0x7f5964106840 2023-07-14T18:04:45.700 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:45.062+0000 7f596b529700 1 -- 172.21.15.163:0/2349982752 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f59641996b0 con 0x7f5964106840 2023-07-14T18:04:45.700 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:45.062+0000 7f595a7fc700 1 -- 172.21.15.163:0/2349982752 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f596001a560 con 0x7f5964106840 2023-07-14T18:04:45.701 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:45.062+0000 7f596b529700 1 -- 172.21.15.163:0/2349982752 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5964199ad0 con 0x7f5964106840 2023-07-14T18:04:45.701 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:45.063+0000 7f595a7fc700 1 -- 172.21.15.163:0/2349982752 <== mon.0 v2:172.21.15.163:3300/0 4 ==== mgrmap(e 4) v1 ==== 45472+0+0 (secure 0 0 0) 0x7f596001b5b0 con 0x7f5964106840 2023-07-14T18:04:45.701 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:45.063+0000 7f596b529700 1 -- 172.21.15.163:0/2349982752 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5964103d40 con 0x7f5964106840 2023-07-14T18:04:45.701 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:45.063+0000 7f595a7fc700 1 --2- 172.21.15.163:0/2349982752 >> [v2:172.21.15.163:6800/236891232,v1:172.21.15.163:6801/236891232] conn(0x7f59500386c0 0x7f595003ab70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:04:45.701 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:45.063+0000 7f595a7fc700 1 -- 172.21.15.163:0/2349982752 <== mon.0 v2:172.21.15.163:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f596004c590 con 0x7f5964106840 2023-07-14T18:04:45.701 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:45.063+0000 7f5968ac4700 1 --2- 172.21.15.163:0/2349982752 >> [v2:172.21.15.163:6800/236891232,v1:172.21.15.163:6801/236891232] conn(0x7f59500386c0 0x7f595003ab70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:04:45.702 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:45.064+0000 7f5968ac4700 1 --2- 172.21.15.163:0/2349982752 >> [v2:172.21.15.163:6800/236891232,v1:172.21.15.163:6801/236891232] conn(0x7f59500386c0 0x7f595003ab70 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f5954006fd0 tx=0x7f5954006e40 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:04:45.702 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:45.068+0000 7f595a7fc700 1 -- 172.21.15.163:0/2349982752 <== mon.0 v2:172.21.15.163:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178025 (secure 0 0 0) 0x7f5960023590 con 0x7f5964106840 2023-07-14T18:04:45.702 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:45.251+0000 7f596b529700 1 -- 172.21.15.163:0/2349982752 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) v1 -- 0x7f5964103f60 con 0x7f5964106840 2023-07-14T18:04:45.702 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:45.251+0000 7f595a7fc700 1 -- 172.21.15.163:0/2349982752 <== mon.0 v2:172.21.15.163:3300/0 7 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v3) v1 ==== 70+0+373 (secure 0 0 0) 0x7f596001f070 con 0x7f5964106840 2023-07-14T18:04:45.702 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:45.253+0000 7f596b529700 1 -- 172.21.15.163:0/2349982752 >> [v2:172.21.15.163:6800/236891232,v1:172.21.15.163:6801/236891232] conn(0x7f59500386c0 msgr2=0x7f595003ab70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:04:45.703 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:45.253+0000 7f596b529700 1 --2- 172.21.15.163:0/2349982752 >> [v2:172.21.15.163:6800/236891232,v1:172.21.15.163:6801/236891232] conn(0x7f59500386c0 0x7f595003ab70 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f5954006fd0 tx=0x7f5954006e40 comp rx=0 tx=0).stop 2023-07-14T18:04:45.703 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:45.253+0000 7f596b529700 1 -- 172.21.15.163:0/2349982752 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f5964106840 msgr2=0x7f5964198f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:04:45.703 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:45.253+0000 7f596b529700 1 --2- 172.21.15.163:0/2349982752 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f5964106840 0x7f5964198f70 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f5960011dc0 tx=0x7f5960011ea0 comp rx=0 tx=0).stop 2023-07-14T18:04:45.703 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:45.254+0000 7f596b529700 1 -- 172.21.15.163:0/2349982752 shutdown_connections 2023-07-14T18:04:45.703 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:45.254+0000 7f596b529700 1 --2- 172.21.15.163:0/2349982752 >> [v2:172.21.15.163:6800/236891232,v1:172.21.15.163:6801/236891232] conn(0x7f59500386c0 0x7f595003ab70 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:04:45.703 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:45.254+0000 7f596b529700 1 --2- 172.21.15.163:0/2349982752 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f5964106840 0x7f5964198f70 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:04:45.704 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:45.254+0000 7f596b529700 1 -- 172.21.15.163:0/2349982752 >> 172.21.15.163:0/2349982752 conn(0x7f59640feef0 msgr2=0x7f59640ffc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:04:45.704 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:45.254+0000 7f596b529700 1 -- 172.21.15.163:0/2349982752 shutdown_connections 2023-07-14T18:04:45.704 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:45.254+0000 7f596b529700 1 -- 172.21.15.163:0/2349982752 wait complete. 2023-07-14T18:04:45.704 INFO:teuthology.orchestra.run.smithi163.stdout:Enabling cephadm module... 2023-07-14T18:04:46.952 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:04:46 smithi163 ceph-mon[96576]: from='client.? 172.21.15.163:0/154661798' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "cephadm"}]: dispatch 2023-07-14T18:04:46.953 INFO:journalctl@ceph.mgr.x.smithi163.stdout:Jul 14 18:04:46 smithi163 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-mgr-x[96818]: ignoring --setuser ceph since I am not root 2023-07-14T18:04:46.953 INFO:journalctl@ceph.mgr.x.smithi163.stdout:Jul 14 18:04:46 smithi163 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-mgr-x[96818]: ignoring --setgroup ceph since I am not root 2023-07-14T18:04:46.953 INFO:journalctl@ceph.mgr.x.smithi163.stdout:Jul 14 18:04:46 smithi163 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-mgr-x[96818]: 2023-07-14T18:04:46.842+0000 7f5bdeca1200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-07-14T18:04:47.135 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:46.082+0000 7efcf762a700 1 Processor -- start 2023-07-14T18:04:47.135 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:46.082+0000 7efcf762a700 1 -- start start 2023-07-14T18:04:47.136 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:46.082+0000 7efcf762a700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7efcf01034c0 0x7efcf01038d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:04:47.136 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:46.082+0000 7efcf762a700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efcf0103e10 con 0x7efcf01034c0 2023-07-14T18:04:47.136 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:46.082+0000 7efcf53c6700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7efcf01034c0 0x7efcf01038d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:04:47.136 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:46.082+0000 7efcf53c6700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7efcf01034c0 0x7efcf01038d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:54468/0 (socket says 172.21.15.163:54468) 2023-07-14T18:04:47.136 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:46.082+0000 7efcf53c6700 1 -- 172.21.15.163:0/2414198794 learned_addr learned my addr 172.21.15.163:0/2414198794 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:04:47.136 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:46.083+0000 7efcf53c6700 1 -- 172.21.15.163:0/2414198794 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efcf0103f50 con 0x7efcf01034c0 2023-07-14T18:04:47.136 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:46.083+0000 7efcf53c6700 1 --2- 172.21.15.163:0/2414198794 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7efcf01034c0 0x7efcf01038d0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7efcec0098a0 tx=0x7efcec009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e634ff17a9f0750 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:04:47.137 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:46.083+0000 7efce7fff700 1 -- 172.21.15.163:0/2414198794 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7efcec004160 con 0x7efcf01034c0 2023-07-14T18:04:47.137 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:46.083+0000 7efce7fff700 1 -- 172.21.15.163:0/2414198794 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(25 keys) v1 ==== 1036+0+0 (secure 0 0 0) 0x7efcec0042c0 con 0x7efcf01034c0 2023-07-14T18:04:47.137 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:46.083+0000 7efce7fff700 1 -- 172.21.15.163:0/2414198794 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7efcec011940 con 0x7efcf01034c0 2023-07-14T18:04:47.137 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:46.083+0000 7efcf762a700 1 -- 172.21.15.163:0/2414198794 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7efcf01034c0 msgr2=0x7efcf01038d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:04:47.137 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:46.083+0000 7efcf762a700 1 --2- 172.21.15.163:0/2414198794 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7efcf01034c0 0x7efcf01038d0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7efcec0098a0 tx=0x7efcec009bb0 comp rx=0 tx=0).stop 2023-07-14T18:04:47.137 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:46.083+0000 7efcf762a700 1 -- 172.21.15.163:0/2414198794 shutdown_connections 2023-07-14T18:04:47.137 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:46.083+0000 7efcf762a700 1 --2- 172.21.15.163:0/2414198794 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7efcf01034c0 0x7efcf01038d0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:04:47.137 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:46.083+0000 7efcf762a700 1 -- 172.21.15.163:0/2414198794 >> 172.21.15.163:0/2414198794 conn(0x7efcf00feec0 msgr2=0x7efcf01012d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:04:47.138 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:46.084+0000 7efcf762a700 1 -- 172.21.15.163:0/2414198794 shutdown_connections 2023-07-14T18:04:47.138 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:46.084+0000 7efcf762a700 1 -- 172.21.15.163:0/2414198794 wait complete. 2023-07-14T18:04:47.138 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:46.084+0000 7efcf762a700 1 Processor -- start 2023-07-14T18:04:47.138 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:46.084+0000 7efcf762a700 1 -- start start 2023-07-14T18:04:47.138 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:46.084+0000 7efcf762a700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7efcf01034c0 0x7efcf0198f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:04:47.138 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:46.084+0000 7efcf762a700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efcf0199470 con 0x7efcf01034c0 2023-07-14T18:04:47.138 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:46.084+0000 7efcf53c6700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7efcf01034c0 0x7efcf0198f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:04:47.139 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:46.084+0000 7efcf53c6700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7efcf01034c0 0x7efcf0198f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:54470/0 (socket says 172.21.15.163:54470) 2023-07-14T18:04:47.139 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:46.084+0000 7efcf53c6700 1 -- 172.21.15.163:0/154661798 learned_addr learned my addr 172.21.15.163:0/154661798 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:04:47.139 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:46.085+0000 7efcf53c6700 1 -- 172.21.15.163:0/154661798 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efcec009550 con 0x7efcf01034c0 2023-07-14T18:04:47.139 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:46.085+0000 7efcf53c6700 1 --2- 172.21.15.163:0/154661798 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7efcf01034c0 0x7efcf0198f30 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7efcec006af0 tx=0x7efcec011a30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:04:47.139 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:46.085+0000 7efce67fc700 1 -- 172.21.15.163:0/154661798 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7efcec003bf0 con 0x7efcf01034c0 2023-07-14T18:04:47.139 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:46.085+0000 7efce67fc700 1 -- 172.21.15.163:0/154661798 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(25 keys) v1 ==== 1036+0+0 (secure 0 0 0) 0x7efcec01b8b0 con 0x7efcf01034c0 2023-07-14T18:04:47.139 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:46.085+0000 7efcf762a700 1 -- 172.21.15.163:0/154661798 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efcf0199670 con 0x7efcf01034c0 2023-07-14T18:04:47.139 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:46.085+0000 7efce67fc700 1 -- 172.21.15.163:0/154661798 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7efcec0198b0 con 0x7efcf01034c0 2023-07-14T18:04:47.140 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:46.085+0000 7efcf762a700 1 -- 172.21.15.163:0/154661798 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efcf0199a90 con 0x7efcf01034c0 2023-07-14T18:04:47.140 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:46.086+0000 7efce67fc700 1 -- 172.21.15.163:0/154661798 <== mon.0 v2:172.21.15.163:3300/0 4 ==== mgrmap(e 4) v1 ==== 45472+0+0 (secure 0 0 0) 0x7efcec019b70 con 0x7efcf01034c0 2023-07-14T18:04:47.140 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:46.086+0000 7efce67fc700 1 --2- 172.21.15.163:0/154661798 >> [v2:172.21.15.163:6800/236891232,v1:172.21.15.163:6801/236891232] conn(0x7efcdc038670 0x7efcdc03ab20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:04:47.140 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:46.086+0000 7efce67fc700 1 -- 172.21.15.163:0/154661798 <== mon.0 v2:172.21.15.163:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7efcec04c9a0 con 0x7efcf01034c0 2023-07-14T18:04:47.140 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:46.086+0000 7efcf4bc5700 1 --2- 172.21.15.163:0/154661798 >> [v2:172.21.15.163:6800/236891232,v1:172.21.15.163:6801/236891232] conn(0x7efcdc038670 0x7efcdc03ab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:04:47.140 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:46.086+0000 7efcf762a700 1 -- 172.21.15.163:0/154661798 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efcf0068520 con 0x7efcf01034c0 2023-07-14T18:04:47.140 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:46.086+0000 7efcf4bc5700 1 --2- 172.21.15.163:0/154661798 >> [v2:172.21.15.163:6800/236891232,v1:172.21.15.163:6801/236891232] conn(0x7efcdc038670 0x7efcdc03ab20 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7efce0006fd0 tx=0x7efce0006e40 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:04:47.141 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:46.091+0000 7efce67fc700 1 -- 172.21.15.163:0/154661798 <== mon.0 v2:172.21.15.163:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178025 (secure 0 0 0) 0x7efcec0189a0 con 0x7efcf01034c0 2023-07-14T18:04:47.141 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:46.325+0000 7efcf762a700 1 -- 172.21.15.163:0/154661798 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "cephadm"} v 0) v1 -- 0x7efcf01070a0 con 0x7efcf01034c0 2023-07-14T18:04:47.141 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:46.667+0000 7efce67fc700 1 -- 172.21.15.163:0/154661798 <== mon.0 v2:172.21.15.163:3300/0 7 ==== mgrmap(e 5) v1 ==== 45483+0+0 (secure 0 0 0) 0x7efcec01ba20 con 0x7efcf01034c0 2023-07-14T18:04:47.141 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:46.668+0000 7efce67fc700 1 -- 172.21.15.163:0/154661798 <== mon.0 v2:172.21.15.163:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "cephadm"}]=0 v5) v1 ==== 86+0+0 (secure 0 0 0) 0x7efcec018350 con 0x7efcf01034c0 2023-07-14T18:04:47.141 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:46.671+0000 7efcf762a700 1 -- 172.21.15.163:0/154661798 >> [v2:172.21.15.163:6800/236891232,v1:172.21.15.163:6801/236891232] conn(0x7efcdc038670 msgr2=0x7efcdc03ab20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:04:47.141 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:46.671+0000 7efcf762a700 1 --2- 172.21.15.163:0/154661798 >> [v2:172.21.15.163:6800/236891232,v1:172.21.15.163:6801/236891232] conn(0x7efcdc038670 0x7efcdc03ab20 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7efce0006fd0 tx=0x7efce0006e40 comp rx=0 tx=0).stop 2023-07-14T18:04:47.141 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:46.671+0000 7efcf762a700 1 -- 172.21.15.163:0/154661798 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7efcf01034c0 msgr2=0x7efcf0198f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:04:47.141 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:46.671+0000 7efcf762a700 1 --2- 172.21.15.163:0/154661798 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7efcf01034c0 0x7efcf0198f30 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7efcec006af0 tx=0x7efcec011a30 comp rx=0 tx=0).stop 2023-07-14T18:04:47.142 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:46.672+0000 7efcf762a700 1 -- 172.21.15.163:0/154661798 shutdown_connections 2023-07-14T18:04:47.142 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:46.672+0000 7efcf762a700 1 --2- 172.21.15.163:0/154661798 >> [v2:172.21.15.163:6800/236891232,v1:172.21.15.163:6801/236891232] conn(0x7efcdc038670 0x7efcdc03ab20 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:04:47.142 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:46.672+0000 7efcf762a700 1 --2- 172.21.15.163:0/154661798 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7efcf01034c0 0x7efcf0198f30 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:04:47.142 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:46.672+0000 7efcf762a700 1 -- 172.21.15.163:0/154661798 >> 172.21.15.163:0/154661798 conn(0x7efcf00feec0 msgr2=0x7efcf00ffbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:04:47.142 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:46.672+0000 7efcf762a700 1 -- 172.21.15.163:0/154661798 shutdown_connections 2023-07-14T18:04:47.142 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:46.672+0000 7efcf762a700 1 -- 172.21.15.163:0/154661798 wait complete. 2023-07-14T18:04:47.206 INFO:journalctl@ceph.mgr.x.smithi163.stdout:Jul 14 18:04:46 smithi163 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-mgr-x[96818]: 2023-07-14T18:04:46.923+0000 7f5bdeca1200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-07-14T18:04:47.206 INFO:journalctl@ceph.mgr.x.smithi163.stdout:Jul 14 18:04:47 smithi163 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-mgr-x[96818]: 2023-07-14T18:04:47.014+0000 7f5bdeca1200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-07-14T18:04:47.206 INFO:journalctl@ceph.mgr.x.smithi163.stdout:Jul 14 18:04:47 smithi163 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-mgr-x[96818]: 2023-07-14T18:04:47.111+0000 7f5bdeca1200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-07-14T18:04:47.654 INFO:journalctl@ceph.mgr.x.smithi163.stdout:Jul 14 18:04:47 smithi163 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-mgr-x[96818]: 2023-07-14T18:04:47.290+0000 7f5bdeca1200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-07-14T18:04:47.956 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:04:47 smithi163 ceph-mon[96576]: from='client.? 172.21.15.163:0/154661798' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "cephadm"}]': finished 2023-07-14T18:04:47.956 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:04:47 smithi163 ceph-mon[96576]: mgrmap e5: x(active, since 7s) 2023-07-14T18:04:47.956 INFO:journalctl@ceph.mgr.x.smithi163.stdout:Jul 14 18:04:47 smithi163 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-mgr-x[96818]: 2023-07-14T18:04:47.625+0000 7f5bdeca1200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-07-14T18:04:47.957 INFO:journalctl@ceph.mgr.x.smithi163.stdout:Jul 14 18:04:47 smithi163 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-mgr-x[96818]: 2023-07-14T18:04:47.717+0000 7f5bdeca1200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-07-14T18:04:47.957 INFO:journalctl@ceph.mgr.x.smithi163.stdout:Jul 14 18:04:47 smithi163 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-mgr-x[96818]: 2023-07-14T18:04:47.856+0000 7f5bdeca1200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-07-14T18:04:48.242 INFO:journalctl@ceph.mgr.x.smithi163.stdout:Jul 14 18:04:47 smithi163 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-mgr-x[96818]: 2023-07-14T18:04:47.957+0000 7f5bdeca1200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-07-14T18:04:48.279 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stdout { 2023-07-14T18:04:48.279 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stdout "epoch": 5, 2023-07-14T18:04:48.279 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stdout "available": true, 2023-07-14T18:04:48.279 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stdout "active_name": "x", 2023-07-14T18:04:48.279 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stdout "num_standby": 0 2023-07-14T18:04:48.280 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stdout } 2023-07-14T18:04:48.280 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:47.568+0000 7fc1ab4c4700 1 Processor -- start 2023-07-14T18:04:48.280 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:47.568+0000 7fc1ab4c4700 1 -- start start 2023-07-14T18:04:48.280 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:47.569+0000 7fc1ab4c4700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc1a41040e0 0x7fc1a41044f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:04:48.280 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:47.569+0000 7fc1ab4c4700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1a4104a30 con 0x7fc1a41040e0 2023-07-14T18:04:48.280 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:47.569+0000 7fc1a9260700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc1a41040e0 0x7fc1a41044f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:04:48.281 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:47.569+0000 7fc1a9260700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc1a41040e0 0x7fc1a41044f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:54484/0 (socket says 172.21.15.163:54484) 2023-07-14T18:04:48.281 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:47.569+0000 7fc1a9260700 1 -- 172.21.15.163:0/4082800518 learned_addr learned my addr 172.21.15.163:0/4082800518 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:04:48.281 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:47.569+0000 7fc1a9260700 1 -- 172.21.15.163:0/4082800518 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1a4104b70 con 0x7fc1a41040e0 2023-07-14T18:04:48.281 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:47.569+0000 7fc1a9260700 1 --2- 172.21.15.163:0/4082800518 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc1a41040e0 0x7fc1a41044f0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fc1a00098a0 tx=0x7fc1a0009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=96b33df048845f25 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:04:48.281 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:47.569+0000 7fc19bfff700 1 -- 172.21.15.163:0/4082800518 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc1a0004160 con 0x7fc1a41040e0 2023-07-14T18:04:48.281 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:47.570+0000 7fc19bfff700 1 -- 172.21.15.163:0/4082800518 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(25 keys) v1 ==== 1036+0+0 (secure 0 0 0) 0x7fc1a00042c0 con 0x7fc1a41040e0 2023-07-14T18:04:48.281 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:47.570+0000 7fc19bfff700 1 -- 172.21.15.163:0/4082800518 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc1a0011940 con 0x7fc1a41040e0 2023-07-14T18:04:48.281 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:47.570+0000 7fc1ab4c4700 1 -- 172.21.15.163:0/4082800518 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc1a41040e0 msgr2=0x7fc1a41044f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:04:48.282 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:47.570+0000 7fc1ab4c4700 1 --2- 172.21.15.163:0/4082800518 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc1a41040e0 0x7fc1a41044f0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fc1a00098a0 tx=0x7fc1a0009bb0 comp rx=0 tx=0).stop 2023-07-14T18:04:48.282 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:47.570+0000 7fc1ab4c4700 1 -- 172.21.15.163:0/4082800518 shutdown_connections 2023-07-14T18:04:48.282 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:47.570+0000 7fc1ab4c4700 1 --2- 172.21.15.163:0/4082800518 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc1a41040e0 0x7fc1a41044f0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:04:48.282 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:47.570+0000 7fc1ab4c4700 1 -- 172.21.15.163:0/4082800518 >> 172.21.15.163:0/4082800518 conn(0x7fc1a40ff770 msgr2=0x7fc1a4101b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:04:48.282 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:47.570+0000 7fc1ab4c4700 1 -- 172.21.15.163:0/4082800518 shutdown_connections 2023-07-14T18:04:48.282 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:47.570+0000 7fc1ab4c4700 1 -- 172.21.15.163:0/4082800518 wait complete. 2023-07-14T18:04:48.282 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:47.571+0000 7fc1ab4c4700 1 Processor -- start 2023-07-14T18:04:48.283 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:47.571+0000 7fc1ab4c4700 1 -- start start 2023-07-14T18:04:48.283 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:47.571+0000 7fc1ab4c4700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc1a41040e0 0x7fc1a419bb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:04:48.283 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:47.571+0000 7fc1ab4c4700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1a4079d00 con 0x7fc1a41040e0 2023-07-14T18:04:48.283 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:47.571+0000 7fc1a9260700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc1a41040e0 0x7fc1a419bb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:04:48.284 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:47.572+0000 7fc1a9260700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc1a41040e0 0x7fc1a419bb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:54486/0 (socket says 172.21.15.163:54486) 2023-07-14T18:04:48.284 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:47.572+0000 7fc1a9260700 1 -- 172.21.15.163:0/1801775864 learned_addr learned my addr 172.21.15.163:0/1801775864 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:04:48.284 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:47.572+0000 7fc1a9260700 1 -- 172.21.15.163:0/1801775864 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1a0009550 con 0x7fc1a41040e0 2023-07-14T18:04:48.284 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:47.572+0000 7fc1a9260700 1 --2- 172.21.15.163:0/1801775864 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc1a41040e0 0x7fc1a419bb80 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fc1a0011dc0 tx=0x7fc1a0011ea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:04:48.284 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:47.572+0000 7fc19a7fc700 1 -- 172.21.15.163:0/1801775864 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc1a00037d0 con 0x7fc1a41040e0 2023-07-14T18:04:48.285 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:47.572+0000 7fc19a7fc700 1 -- 172.21.15.163:0/1801775864 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(25 keys) v1 ==== 1036+0+0 (secure 0 0 0) 0x7fc1a001b440 con 0x7fc1a41040e0 2023-07-14T18:04:48.285 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:47.572+0000 7fc1ab4c4700 1 -- 172.21.15.163:0/1801775864 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc1a4079f00 con 0x7fc1a41040e0 2023-07-14T18:04:48.285 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:47.572+0000 7fc19a7fc700 1 -- 172.21.15.163:0/1801775864 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc1a001a560 con 0x7fc1a41040e0 2023-07-14T18:04:48.285 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:47.572+0000 7fc1ab4c4700 1 -- 172.21.15.163:0/1801775864 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc1a419c290 con 0x7fc1a41040e0 2023-07-14T18:04:48.285 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:47.573+0000 7fc19a7fc700 1 -- 172.21.15.163:0/1801775864 <== mon.0 v2:172.21.15.163:3300/0 4 ==== mgrmap(e 5) v1 ==== 45483+0+0 (secure 0 0 0) 0x7fc1a001a7d0 con 0x7fc1a41040e0 2023-07-14T18:04:48.286 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:47.573+0000 7fc1ab4c4700 1 -- 172.21.15.163:0/1801775864 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc1a4061c70 con 0x7fc1a41040e0 2023-07-14T18:04:48.286 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:47.573+0000 7fc19a7fc700 1 --2- 172.21.15.163:0/1801775864 >> [v2:172.21.15.163:6800/236891232,v1:172.21.15.163:6801/236891232] conn(0x7fc190038760 0x7fc19003ac10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:04:48.286 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:47.573+0000 7fc1a8a5f700 1 -- 172.21.15.163:0/1801775864 >> [v2:172.21.15.163:6800/236891232,v1:172.21.15.163:6801/236891232] conn(0x7fc190038760 msgr2=0x7fc19003ac10 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.163:6800/236891232 2023-07-14T18:04:48.286 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:47.573+0000 7fc19a7fc700 1 -- 172.21.15.163:0/1801775864 <== mon.0 v2:172.21.15.163:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7fc1a004c570 con 0x7fc1a41040e0 2023-07-14T18:04:48.286 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:47.573+0000 7fc1a8a5f700 1 --2- 172.21.15.163:0/1801775864 >> [v2:172.21.15.163:6800/236891232,v1:172.21.15.163:6801/236891232] conn(0x7fc190038760 0x7fc19003ac10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-14T18:04:48.287 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:47.578+0000 7fc19a7fc700 1 -- 172.21.15.163:0/1801775864 <== mon.0 v2:172.21.15.163:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178025 (secure 0 0 0) 0x7fc1a0023590 con 0x7fc1a41040e0 2023-07-14T18:04:48.287 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:47.774+0000 7fc1a8a5f700 1 -- 172.21.15.163:0/1801775864 >> [v2:172.21.15.163:6800/236891232,v1:172.21.15.163:6801/236891232] conn(0x7fc190038760 msgr2=0x7fc19003ac10 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.163:6800/236891232 2023-07-14T18:04:48.287 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:47.774+0000 7fc1a8a5f700 1 --2- 172.21.15.163:0/1801775864 >> [v2:172.21.15.163:6800/236891232,v1:172.21.15.163:6801/236891232] conn(0x7fc190038760 0x7fc19003ac10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-07-14T18:04:48.287 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:47.836+0000 7fc1ab4c4700 1 -- 172.21.15.163:0/1801775864 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) v1 -- 0x7fc1a4068520 con 0x7fc1a41040e0 2023-07-14T18:04:48.287 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:47.836+0000 7fc19a7fc700 1 -- 172.21.15.163:0/1801775864 <== mon.0 v2:172.21.15.163:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v5) v1 ==== 56+0+88 (secure 0 0 0) 0x7fc1a001f020 con 0x7fc1a41040e0 2023-07-14T18:04:48.288 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:47.838+0000 7fc1ab4c4700 1 -- 172.21.15.163:0/1801775864 >> [v2:172.21.15.163:6800/236891232,v1:172.21.15.163:6801/236891232] conn(0x7fc190038760 msgr2=0x7fc19003ac10 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-14T18:04:48.288 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:47.838+0000 7fc1ab4c4700 1 --2- 172.21.15.163:0/1801775864 >> [v2:172.21.15.163:6800/236891232,v1:172.21.15.163:6801/236891232] conn(0x7fc190038760 0x7fc19003ac10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:04:48.288 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:47.838+0000 7fc1ab4c4700 1 -- 172.21.15.163:0/1801775864 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc1a41040e0 msgr2=0x7fc1a419bb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:04:48.288 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:47.838+0000 7fc1ab4c4700 1 --2- 172.21.15.163:0/1801775864 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc1a41040e0 0x7fc1a419bb80 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fc1a0011dc0 tx=0x7fc1a0011ea0 comp rx=0 tx=0).stop 2023-07-14T18:04:48.288 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:47.838+0000 7fc1ab4c4700 1 -- 172.21.15.163:0/1801775864 shutdown_connections 2023-07-14T18:04:48.288 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:47.838+0000 7fc1ab4c4700 1 --2- 172.21.15.163:0/1801775864 >> [v2:172.21.15.163:6800/236891232,v1:172.21.15.163:6801/236891232] conn(0x7fc190038760 0x7fc19003ac10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:04:48.288 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:47.838+0000 7fc1ab4c4700 1 --2- 172.21.15.163:0/1801775864 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc1a41040e0 0x7fc1a419bb80 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:04:48.289 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:47.838+0000 7fc1ab4c4700 1 -- 172.21.15.163:0/1801775864 >> 172.21.15.163:0/1801775864 conn(0x7fc1a40ff770 msgr2=0x7fc1a41004c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:04:48.289 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:47.838+0000 7fc1ab4c4700 1 -- 172.21.15.163:0/1801775864 shutdown_connections 2023-07-14T18:04:48.289 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:47.838+0000 7fc1ab4c4700 1 -- 172.21.15.163:0/1801775864 wait complete. 2023-07-14T18:04:48.289 INFO:teuthology.orchestra.run.smithi163.stdout:Waiting for the mgr to restart... 2023-07-14T18:04:48.289 INFO:teuthology.orchestra.run.smithi163.stdout:Waiting for mgr epoch 5... 2023-07-14T18:04:48.507 INFO:journalctl@ceph.mgr.x.smithi163.stdout:Jul 14 18:04:48 smithi163 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-mgr-x[96818]: 2023-07-14T18:04:48.393+0000 7f5bdeca1200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-07-14T18:04:48.956 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:04:48 smithi163 ceph-mon[96576]: from='client.? 172.21.15.163:0/1801775864' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2023-07-14T18:04:49.456 INFO:journalctl@ceph.mgr.x.smithi163.stdout:Jul 14 18:04:48 smithi163 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-mgr-x[96818]: 2023-07-14T18:04:48.979+0000 7f5bdeca1200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-07-14T18:04:49.456 INFO:journalctl@ceph.mgr.x.smithi163.stdout:Jul 14 18:04:49 smithi163 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-mgr-x[96818]: 2023-07-14T18:04:49.148+0000 7f5bdeca1200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-07-14T18:04:50.196 INFO:journalctl@ceph.mgr.x.smithi163.stdout:Jul 14 18:04:49 smithi163 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-mgr-x[96818]: 2023-07-14T18:04:49.908+0000 7f5bdeca1200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-07-14T18:04:50.196 INFO:journalctl@ceph.mgr.x.smithi163.stdout:Jul 14 18:04:49 smithi163 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-mgr-x[96818]: 2023-07-14T18:04:49.998+0000 7f5bdeca1200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-07-14T18:04:50.456 INFO:journalctl@ceph.mgr.x.smithi163.stdout:Jul 14 18:04:50 smithi163 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-mgr-x[96818]: 2023-07-14T18:04:50.167+0000 7f5bdeca1200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-07-14T18:04:50.847 INFO:journalctl@ceph.mgr.x.smithi163.stdout:Jul 14 18:04:50 smithi163 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-mgr-x[96818]: 2023-07-14T18:04:50.443+0000 7f5bdeca1200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-07-14T18:04:50.847 INFO:journalctl@ceph.mgr.x.smithi163.stdout:Jul 14 18:04:50 smithi163 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-mgr-x[96818]: 2023-07-14T18:04:50.672+0000 7f5bdeca1200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-07-14T18:04:51.106 INFO:journalctl@ceph.mgr.x.smithi163.stdout:Jul 14 18:04:50 smithi163 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-mgr-x[96818]: 2023-07-14T18:04:50.818+0000 7f5bdeca1200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-07-14T18:04:51.456 INFO:journalctl@ceph.mgr.x.smithi163.stdout:Jul 14 18:04:51 smithi163 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-mgr-x[96818]: 2023-07-14T18:04:51.077+0000 7f5bdeca1200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-07-14T18:04:52.126 INFO:journalctl@ceph.mgr.x.smithi163.stdout:Jul 14 18:04:51 smithi163 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-mgr-x[96818]: 2023-07-14T18:04:51.780+0000 7f5bdeca1200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-07-14T18:04:52.126 INFO:journalctl@ceph.mgr.x.smithi163.stdout:Jul 14 18:04:51 smithi163 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-mgr-x[96818]: 2023-07-14T18:04:51.909+0000 7f5bdeca1200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-07-14T18:04:52.452 INFO:journalctl@ceph.mgr.x.smithi163.stdout:Jul 14 18:04:52 smithi163 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-mgr-x[96818]: 2023-07-14T18:04:52.097+0000 7f5bdeca1200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-07-14T18:04:52.453 INFO:journalctl@ceph.mgr.x.smithi163.stdout:Jul 14 18:04:52 smithi163 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-mgr-x[96818]: 2023-07-14T18:04:52.210+0000 7f5bdeca1200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-07-14T18:04:52.706 INFO:journalctl@ceph.mgr.x.smithi163.stdout:Jul 14 18:04:52 smithi163 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-mgr-x[96818]: 2023-07-14T18:04:52.423+0000 7f5bdeca1200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-07-14T18:04:53.706 INFO:journalctl@ceph.mgr.x.smithi163.stdout:Jul 14 18:04:53 smithi163 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-mgr-x[96818]: 2023-07-14T18:04:53.274+0000 7f5bdeca1200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-07-14T18:04:53.706 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:04:53 smithi163 ceph-mon[96576]: Active manager daemon x restarted 2023-07-14T18:04:53.707 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:04:53 smithi163 ceph-mon[96576]: Activating manager daemon x 2023-07-14T18:04:53.707 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:04:53 smithi163 ceph-mon[96576]: osdmap e2: 0 total, 0 up, 0 in 2023-07-14T18:04:53.707 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:04:53 smithi163 ceph-mon[96576]: mgrmap e6: x(active, starting, since 0.00351834s) 2023-07-14T18:04:53.707 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:04:53 smithi163 ceph-mon[96576]: from='mgr.14120 172.21.15.163:0/1316764358' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-07-14T18:04:53.707 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:04:53 smithi163 ceph-mon[96576]: from='mgr.14120 172.21.15.163:0/1316764358' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2023-07-14T18:04:53.707 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:04:53 smithi163 ceph-mon[96576]: from='mgr.14120 172.21.15.163:0/1316764358' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2023-07-14T18:04:53.707 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:04:53 smithi163 ceph-mon[96576]: from='mgr.14120 172.21.15.163:0/1316764358' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2023-07-14T18:04:53.708 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:04:53 smithi163 ceph-mon[96576]: from='mgr.14120 172.21.15.163:0/1316764358' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2023-07-14T18:04:53.708 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:04:53 smithi163 ceph-mon[96576]: Manager daemon x is now available 2023-07-14T18:04:53.708 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:04:53 smithi163 ceph-mon[96576]: from='mgr.14120 172.21.15.163:0/1316764358' entity='mgr.x' 2023-07-14T18:04:53.708 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:04:53 smithi163 ceph-mon[96576]: from='mgr.14120 172.21.15.163:0/1316764358' entity='mgr.x' 2023-07-14T18:04:53.708 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:04:53 smithi163 ceph-mon[96576]: from='mgr.14120 172.21.15.163:0/1316764358' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-14T18:04:53.708 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:04:53 smithi163 ceph-mon[96576]: from='mgr.14120 172.21.15.163:0/1316764358' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-14T18:04:53.708 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:04:53 smithi163 ceph-mon[96576]: from='mgr.14120 172.21.15.163:0/1316764358' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-14T18:04:54.697 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:04:54 smithi163 ceph-mon[96576]: Found migration_current of "None". Setting to last migration. 2023-07-14T18:04:54.697 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:04:54 smithi163 ceph-mon[96576]: from='mgr.14120 172.21.15.163:0/1316764358' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2023-07-14T18:04:54.697 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:04:54 smithi163 ceph-mon[96576]: from='mgr.14120 172.21.15.163:0/1316764358' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2023-07-14T18:04:54.697 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:04:54 smithi163 ceph-mon[96576]: from='mgr.14120 172.21.15.163:0/1316764358' entity='mgr.x' 2023-07-14T18:04:54.697 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:04:54 smithi163 ceph-mon[96576]: from='mgr.14120 172.21.15.163:0/1316764358' entity='mgr.x' 2023-07-14T18:04:54.698 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:04:54 smithi163 ceph-mon[96576]: from='mgr.14120 172.21.15.163:0/1316764358' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-14T18:04:54.698 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:04:54 smithi163 ceph-mon[96576]: mgrmap e7: x(active, since 1.00563s) 2023-07-14T18:04:54.737 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stdout { 2023-07-14T18:04:54.737 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 7, 2023-07-14T18:04:54.737 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stdout "initialized": true 2023-07-14T18:04:54.737 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stdout } 2023-07-14T18:04:54.738 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:48.734+0000 7f11c259f700 1 Processor -- start 2023-07-14T18:04:54.738 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:48.734+0000 7f11c259f700 1 -- start start 2023-07-14T18:04:54.738 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:48.734+0000 7f11c259f700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f11bc105d30 0x7f11bc108110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:04:54.738 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:48.734+0000 7f11c259f700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11bc079d10 con 0x7f11bc105d30 2023-07-14T18:04:54.738 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:48.734+0000 7f11bbfff700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f11bc105d30 0x7f11bc108110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:04:54.739 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:48.734+0000 7f11bbfff700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f11bc105d30 0x7f11bc108110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:54494/0 (socket says 172.21.15.163:54494) 2023-07-14T18:04:54.739 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:48.734+0000 7f11bbfff700 1 -- 172.21.15.163:0/3140670765 learned_addr learned my addr 172.21.15.163:0/3140670765 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:04:54.739 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:48.735+0000 7f11bbfff700 1 -- 172.21.15.163:0/3140670765 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11bc079e50 con 0x7f11bc105d30 2023-07-14T18:04:54.739 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:48.735+0000 7f11bbfff700 1 --2- 172.21.15.163:0/3140670765 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f11bc105d30 0x7f11bc108110 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f11ac0098a0 tx=0x7f11ac009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=901716bb7750e40b server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:04:54.739 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:48.735+0000 7f11baffd700 1 -- 172.21.15.163:0/3140670765 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f11ac004160 con 0x7f11bc105d30 2023-07-14T18:04:54.739 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:48.735+0000 7f11baffd700 1 -- 172.21.15.163:0/3140670765 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(25 keys) v1 ==== 1036+0+0 (secure 0 0 0) 0x7f11ac0042c0 con 0x7f11bc105d30 2023-07-14T18:04:54.739 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:48.735+0000 7f11baffd700 1 -- 172.21.15.163:0/3140670765 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f11ac011940 con 0x7f11bc105d30 2023-07-14T18:04:54.739 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:48.736+0000 7f11c259f700 1 -- 172.21.15.163:0/3140670765 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f11bc105d30 msgr2=0x7f11bc108110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:04:54.740 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:48.736+0000 7f11c259f700 1 --2- 172.21.15.163:0/3140670765 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f11bc105d30 0x7f11bc108110 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f11ac0098a0 tx=0x7f11ac009bb0 comp rx=0 tx=0).stop 2023-07-14T18:04:54.740 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:48.736+0000 7f11c259f700 1 -- 172.21.15.163:0/3140670765 shutdown_connections 2023-07-14T18:04:54.740 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:48.736+0000 7f11c259f700 1 --2- 172.21.15.163:0/3140670765 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f11bc105d30 0x7f11bc108110 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:04:54.740 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:48.736+0000 7f11c259f700 1 -- 172.21.15.163:0/3140670765 >> 172.21.15.163:0/3140670765 conn(0x7f11bc0ff770 msgr2=0x7f11bc101b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:04:54.740 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:48.736+0000 7f11c259f700 1 -- 172.21.15.163:0/3140670765 shutdown_connections 2023-07-14T18:04:54.740 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:48.736+0000 7f11c259f700 1 -- 172.21.15.163:0/3140670765 wait complete. 2023-07-14T18:04:54.741 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:48.737+0000 7f11c259f700 1 Processor -- start 2023-07-14T18:04:54.741 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:48.737+0000 7f11c259f700 1 -- start start 2023-07-14T18:04:54.741 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:48.737+0000 7f11c259f700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f11bc105d30 0x7f11bc198f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:04:54.741 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:48.737+0000 7f11c259f700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11bc199450 con 0x7f11bc105d30 2023-07-14T18:04:54.741 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:48.737+0000 7f11bbfff700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f11bc105d30 0x7f11bc198f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:04:54.741 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:48.737+0000 7f11bbfff700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f11bc105d30 0x7f11bc198f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:54496/0 (socket says 172.21.15.163:54496) 2023-07-14T18:04:54.741 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:48.737+0000 7f11bbfff700 1 -- 172.21.15.163:0/2210899958 learned_addr learned my addr 172.21.15.163:0/2210899958 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:04:54.741 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:48.737+0000 7f11bbfff700 1 -- 172.21.15.163:0/2210899958 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11ac009550 con 0x7f11bc105d30 2023-07-14T18:04:54.742 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:48.738+0000 7f11bbfff700 1 --2- 172.21.15.163:0/2210899958 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f11bc105d30 0x7f11bc198f10 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f11ac006af0 tx=0x7f11ac011a30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:04:54.742 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:48.738+0000 7f11b97fa700 1 -- 172.21.15.163:0/2210899958 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f11ac003bf0 con 0x7f11bc105d30 2023-07-14T18:04:54.742 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:48.738+0000 7f11b97fa700 1 -- 172.21.15.163:0/2210899958 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(25 keys) v1 ==== 1036+0+0 (secure 0 0 0) 0x7f11ac01b8b0 con 0x7f11bc105d30 2023-07-14T18:04:54.742 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:48.738+0000 7f11c259f700 1 -- 172.21.15.163:0/2210899958 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f11bc1996b0 con 0x7f11bc105d30 2023-07-14T18:04:54.742 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:48.738+0000 7f11b97fa700 1 -- 172.21.15.163:0/2210899958 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f11ac0198b0 con 0x7f11bc105d30 2023-07-14T18:04:54.742 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:48.738+0000 7f11c259f700 1 -- 172.21.15.163:0/2210899958 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11bc19a2e0 con 0x7f11bc105d30 2023-07-14T18:04:54.742 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:48.739+0000 7f11b97fa700 1 -- 172.21.15.163:0/2210899958 <== mon.0 v2:172.21.15.163:3300/0 4 ==== mgrmap(e 5) v1 ==== 45483+0+0 (secure 0 0 0) 0x7f11ac019b70 con 0x7f11bc105d30 2023-07-14T18:04:54.742 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:48.739+0000 7f11b97fa700 1 --2- 172.21.15.163:0/2210899958 >> [v2:172.21.15.163:6800/236891232,v1:172.21.15.163:6801/236891232] conn(0x7f11a40386c0 0x7f11a403ab70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:04:54.743 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:48.739+0000 7f11b97fa700 1 -- 172.21.15.163:0/2210899958 --> [v2:172.21.15.163:6800/236891232,v1:172.21.15.163:6801/236891232] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7f11a403b280 con 0x7f11a40386c0 2023-07-14T18:04:54.743 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:48.739+0000 7f11b97fa700 1 -- 172.21.15.163:0/2210899958 <== mon.0 v2:172.21.15.163:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f11ac04ca00 con 0x7f11bc105d30 2023-07-14T18:04:54.743 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:48.739+0000 7f11bb7fe700 1 -- 172.21.15.163:0/2210899958 >> [v2:172.21.15.163:6800/236891232,v1:172.21.15.163:6801/236891232] conn(0x7f11a40386c0 msgr2=0x7f11a403ab70 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.163:6800/236891232 2023-07-14T18:04:54.743 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:48.739+0000 7f11bb7fe700 1 --2- 172.21.15.163:0/2210899958 >> [v2:172.21.15.163:6800/236891232,v1:172.21.15.163:6801/236891232] conn(0x7f11a40386c0 0x7f11a403ab70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-14T18:04:54.743 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:48.940+0000 7f11bb7fe700 1 -- 172.21.15.163:0/2210899958 >> [v2:172.21.15.163:6800/236891232,v1:172.21.15.163:6801/236891232] conn(0x7f11a40386c0 msgr2=0x7f11a403ab70 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.163:6800/236891232 2023-07-14T18:04:54.743 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:48.940+0000 7f11bb7fe700 1 --2- 172.21.15.163:0/2210899958 >> [v2:172.21.15.163:6800/236891232,v1:172.21.15.163:6801/236891232] conn(0x7f11a40386c0 0x7f11a403ab70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-07-14T18:04:54.744 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:49.341+0000 7f11bb7fe700 1 -- 172.21.15.163:0/2210899958 >> [v2:172.21.15.163:6800/236891232,v1:172.21.15.163:6801/236891232] conn(0x7f11a40386c0 msgr2=0x7f11a403ab70 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.163:6800/236891232 2023-07-14T18:04:54.744 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:49.341+0000 7f11bb7fe700 1 --2- 172.21.15.163:0/2210899958 >> [v2:172.21.15.163:6800/236891232,v1:172.21.15.163:6801/236891232] conn(0x7f11a40386c0 0x7f11a403ab70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-07-14T18:04:54.744 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:50.142+0000 7f11bb7fe700 1 -- 172.21.15.163:0/2210899958 >> [v2:172.21.15.163:6800/236891232,v1:172.21.15.163:6801/236891232] conn(0x7f11a40386c0 msgr2=0x7f11a403ab70 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.163:6800/236891232 2023-07-14T18:04:54.744 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:50.142+0000 7f11bb7fe700 1 --2- 172.21.15.163:0/2210899958 >> [v2:172.21.15.163:6800/236891232,v1:172.21.15.163:6801/236891232] conn(0x7f11a40386c0 0x7f11a403ab70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-07-14T18:04:54.744 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:51.743+0000 7f11bb7fe700 1 -- 172.21.15.163:0/2210899958 >> [v2:172.21.15.163:6800/236891232,v1:172.21.15.163:6801/236891232] conn(0x7f11a40386c0 msgr2=0x7f11a403ab70 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.163:6800/236891232 2023-07-14T18:04:54.744 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:51.743+0000 7f11bb7fe700 1 --2- 172.21.15.163:0/2210899958 >> [v2:172.21.15.163:6800/236891232,v1:172.21.15.163:6801/236891232] conn(0x7f11a40386c0 0x7f11a403ab70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 3.200000 2023-07-14T18:04:54.744 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:53.290+0000 7f11b97fa700 1 -- 172.21.15.163:0/2210899958 <== mon.0 v2:172.21.15.163:3300/0 6 ==== mgrmap(e 6) v1 ==== 45250+0+0 (secure 0 0 0) 0x7f11ac01ba20 con 0x7f11bc105d30 2023-07-14T18:04:54.745 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:53.290+0000 7f11b97fa700 1 -- 172.21.15.163:0/2210899958 >> [v2:172.21.15.163:6800/236891232,v1:172.21.15.163:6801/236891232] conn(0x7f11a40386c0 msgr2=0x7f11a403ab70 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-14T18:04:54.745 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:53.290+0000 7f11b97fa700 1 --2- 172.21.15.163:0/2210899958 >> [v2:172.21.15.163:6800/236891232,v1:172.21.15.163:6801/236891232] conn(0x7f11a40386c0 0x7f11a403ab70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:04:54.745 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:54.291+0000 7f11b97fa700 1 -- 172.21.15.163:0/2210899958 <== mon.0 v2:172.21.15.163:3300/0 7 ==== mgrmap(e 7) v1 ==== 45377+0+0 (secure 0 0 0) 0x7f11ac04e4f0 con 0x7f11bc105d30 2023-07-14T18:04:54.745 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:54.291+0000 7f11b97fa700 1 --2- 172.21.15.163:0/2210899958 >> [v2:172.21.15.163:6800/1086512093,v1:172.21.15.163:6801/1086512093] conn(0x7f11a403bfe0 0x7f11a403e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:04:54.745 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:54.291+0000 7f11b97fa700 1 -- 172.21.15.163:0/2210899958 --> [v2:172.21.15.163:6800/1086512093,v1:172.21.15.163:6801/1086512093] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7f11a403b280 con 0x7f11a403bfe0 2023-07-14T18:04:54.745 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:54.292+0000 7f11bb7fe700 1 --2- 172.21.15.163:0/2210899958 >> [v2:172.21.15.163:6800/1086512093,v1:172.21.15.163:6801/1086512093] conn(0x7f11a403bfe0 0x7f11a403e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:04:54.745 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:54.292+0000 7f11bb7fe700 1 --2- 172.21.15.163:0/2210899958 >> [v2:172.21.15.163:6800/1086512093,v1:172.21.15.163:6801/1086512093] conn(0x7f11a403bfe0 0x7f11a403e3c0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f11b0003a10 tx=0x7f11b0009290 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:04:54.746 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:54.293+0000 7f11b97fa700 1 -- 172.21.15.163:0/2210899958 <== mgr.14120 v2:172.21.15.163:6800/1086512093 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+6910 (secure 0 0 0) 0x7f11a403b280 con 0x7f11a403bfe0 2023-07-14T18:04:54.746 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:54.299+0000 7f11c259f700 1 -- 172.21.15.163:0/2210899958 --> [v2:172.21.15.163:6800/1086512093,v1:172.21.15.163:6801/1086512093] -- command(tid 1: {"prefix": "mgr_status"}) v1 -- 0x7f11bc19a170 con 0x7f11a403bfe0 2023-07-14T18:04:54.746 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:54.299+0000 7f11b97fa700 1 -- 172.21.15.163:0/2210899958 <== mgr.14120 v2:172.21.15.163:6800/1086512093 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+51 (secure 0 0 0) 0x7f11bc19a170 con 0x7f11a403bfe0 2023-07-14T18:04:54.746 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:54.300+0000 7f11c259f700 1 -- 172.21.15.163:0/2210899958 >> [v2:172.21.15.163:6800/1086512093,v1:172.21.15.163:6801/1086512093] conn(0x7f11a403bfe0 msgr2=0x7f11a403e3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:04:54.746 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:54.300+0000 7f11c259f700 1 --2- 172.21.15.163:0/2210899958 >> [v2:172.21.15.163:6800/1086512093,v1:172.21.15.163:6801/1086512093] conn(0x7f11a403bfe0 0x7f11a403e3c0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f11b0003a10 tx=0x7f11b0009290 comp rx=0 tx=0).stop 2023-07-14T18:04:54.746 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:54.300+0000 7f11c259f700 1 -- 172.21.15.163:0/2210899958 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f11bc105d30 msgr2=0x7f11bc198f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:04:54.746 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:54.300+0000 7f11c259f700 1 --2- 172.21.15.163:0/2210899958 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f11bc105d30 0x7f11bc198f10 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f11ac006af0 tx=0x7f11ac011a30 comp rx=0 tx=0).stop 2023-07-14T18:04:54.746 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:54.300+0000 7f11c259f700 1 -- 172.21.15.163:0/2210899958 shutdown_connections 2023-07-14T18:04:54.747 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:54.300+0000 7f11c259f700 1 --2- 172.21.15.163:0/2210899958 >> [v2:172.21.15.163:6800/1086512093,v1:172.21.15.163:6801/1086512093] conn(0x7f11a403bfe0 0x7f11a403e3c0 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:04:54.747 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:54.300+0000 7f11c259f700 1 --2- 172.21.15.163:0/2210899958 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f11bc105d30 0x7f11bc198f10 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:04:54.747 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:54.300+0000 7f11c259f700 1 --2- 172.21.15.163:0/2210899958 >> [v2:172.21.15.163:6800/236891232,v1:172.21.15.163:6801/236891232] conn(0x7f11a40386c0 0x7f11a403ab70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:04:54.747 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:54.300+0000 7f11c259f700 1 -- 172.21.15.163:0/2210899958 >> 172.21.15.163:0/2210899958 conn(0x7f11bc0ff770 msgr2=0x7f11bc100510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:04:54.747 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:54.300+0000 7f11c259f700 1 -- 172.21.15.163:0/2210899958 shutdown_connections 2023-07-14T18:04:54.747 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:54.300+0000 7f11c259f700 1 -- 172.21.15.163:0/2210899958 wait complete. 2023-07-14T18:04:54.747 INFO:teuthology.orchestra.run.smithi163.stdout:mgr epoch 5 is available 2023-07-14T18:04:54.748 INFO:teuthology.orchestra.run.smithi163.stdout:Setting orchestrator backend to cephadm... 2023-07-14T18:04:55.706 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:04:55 smithi163 ceph-mon[96576]: [14/Jul/2023:18:04:54] ENGINE Bus STARTING 2023-07-14T18:04:55.707 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:04:55 smithi163 ceph-mon[96576]: [14/Jul/2023:18:04:54] ENGINE Serving on http://172.21.15.163:8765 2023-07-14T18:04:55.707 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:04:55 smithi163 ceph-mon[96576]: [14/Jul/2023:18:04:54] ENGINE Serving on https://172.21.15.163:7150 2023-07-14T18:04:55.707 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:04:55 smithi163 ceph-mon[96576]: [14/Jul/2023:18:04:54] ENGINE Bus STARTED 2023-07-14T18:04:55.707 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:04:55 smithi163 ceph-mon[96576]: from='client.14124 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2023-07-14T18:04:55.707 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:04:55 smithi163 ceph-mon[96576]: from='client.14124 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2023-07-14T18:04:55.783 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:55.181+0000 7f056f569700 1 Processor -- start 2023-07-14T18:04:55.783 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:55.181+0000 7f056f569700 1 -- start start 2023-07-14T18:04:55.784 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:55.181+0000 7f056f569700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f0568103b40 0x7f0568103f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:04:55.784 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:55.181+0000 7f056f569700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0568079cf0 con 0x7f0568103b40 2023-07-14T18:04:55.784 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:55.182+0000 7f056d305700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f0568103b40 0x7f0568103f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:04:55.784 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:55.182+0000 7f056d305700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f0568103b40 0x7f0568103f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:54548/0 (socket says 172.21.15.163:54548) 2023-07-14T18:04:55.784 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:55.182+0000 7f056d305700 1 -- 172.21.15.163:0/4160528334 learned_addr learned my addr 172.21.15.163:0/4160528334 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:04:55.784 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:55.182+0000 7f056d305700 1 -- 172.21.15.163:0/4160528334 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0568079e30 con 0x7f0568103b40 2023-07-14T18:04:55.784 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:55.182+0000 7f056d305700 1 --2- 172.21.15.163:0/4160528334 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f0568103b40 0x7f0568103f50 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f05580098a0 tx=0x7f0558009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a9e78598964c630d server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:04:55.785 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:55.182+0000 7f055ffff700 1 -- 172.21.15.163:0/4160528334 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0558004160 con 0x7f0568103b40 2023-07-14T18:04:55.785 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:55.182+0000 7f055ffff700 1 -- 172.21.15.163:0/4160528334 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(25 keys) v1 ==== 1036+0+0 (secure 0 0 0) 0x7f05580042c0 con 0x7f0568103b40 2023-07-14T18:04:55.785 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:55.182+0000 7f055ffff700 1 -- 172.21.15.163:0/4160528334 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0558011940 con 0x7f0568103b40 2023-07-14T18:04:55.785 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:55.183+0000 7f056f569700 1 -- 172.21.15.163:0/4160528334 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f0568103b40 msgr2=0x7f0568103f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:04:55.785 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:55.183+0000 7f056f569700 1 --2- 172.21.15.163:0/4160528334 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f0568103b40 0x7f0568103f50 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f05580098a0 tx=0x7f0558009bb0 comp rx=0 tx=0).stop 2023-07-14T18:04:55.785 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:55.183+0000 7f056f569700 1 -- 172.21.15.163:0/4160528334 shutdown_connections 2023-07-14T18:04:55.785 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:55.183+0000 7f056f569700 1 --2- 172.21.15.163:0/4160528334 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f0568103b40 0x7f0568103f50 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:04:55.786 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:55.183+0000 7f056f569700 1 -- 172.21.15.163:0/4160528334 >> 172.21.15.163:0/4160528334 conn(0x7f05680ff750 msgr2=0x7f0568101b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:04:55.786 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:55.183+0000 7f056f569700 1 -- 172.21.15.163:0/4160528334 shutdown_connections 2023-07-14T18:04:55.786 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:55.183+0000 7f056f569700 1 -- 172.21.15.163:0/4160528334 wait complete. 2023-07-14T18:04:55.786 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:55.183+0000 7f056f569700 1 Processor -- start 2023-07-14T18:04:55.786 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:55.183+0000 7f056f569700 1 -- start start 2023-07-14T18:04:55.786 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:55.184+0000 7f056f569700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f0568103b40 0x7f056819b170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:04:55.786 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:55.184+0000 7f056f569700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f056819b6b0 con 0x7f0568103b40 2023-07-14T18:04:55.787 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:55.184+0000 7f056d305700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f0568103b40 0x7f056819b170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:04:55.787 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:55.184+0000 7f056d305700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f0568103b40 0x7f056819b170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:54550/0 (socket says 172.21.15.163:54550) 2023-07-14T18:04:55.787 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:55.184+0000 7f056d305700 1 -- 172.21.15.163:0/2676561239 learned_addr learned my addr 172.21.15.163:0/2676561239 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:04:55.787 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:55.184+0000 7f056d305700 1 -- 172.21.15.163:0/2676561239 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0558009550 con 0x7f0568103b40 2023-07-14T18:04:55.787 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:55.184+0000 7f056d305700 1 --2- 172.21.15.163:0/2676561239 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f0568103b40 0x7f056819b170 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f0558006af0 tx=0x7f0558011a30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:04:55.787 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:55.184+0000 7f055e7fc700 1 -- 172.21.15.163:0/2676561239 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0558003bf0 con 0x7f0568103b40 2023-07-14T18:04:55.787 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:55.184+0000 7f055e7fc700 1 -- 172.21.15.163:0/2676561239 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(25 keys) v1 ==== 1036+0+0 (secure 0 0 0) 0x7f055801b8b0 con 0x7f0568103b40 2023-07-14T18:04:55.787 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:55.184+0000 7f055e7fc700 1 -- 172.21.15.163:0/2676561239 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f05580198b0 con 0x7f0568103b40 2023-07-14T18:04:55.788 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:55.184+0000 7f056f569700 1 -- 172.21.15.163:0/2676561239 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f056819b8b0 con 0x7f0568103b40 2023-07-14T18:04:55.788 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:55.184+0000 7f056f569700 1 -- 172.21.15.163:0/2676561239 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f056819bcd0 con 0x7f0568103b40 2023-07-14T18:04:55.788 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:55.185+0000 7f056f569700 1 -- 172.21.15.163:0/2676561239 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f05681050a0 con 0x7f0568103b40 2023-07-14T18:04:55.788 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:55.185+0000 7f055e7fc700 1 -- 172.21.15.163:0/2676561239 <== mon.0 v2:172.21.15.163:3300/0 4 ==== mgrmap(e 7) v1 ==== 45377+0+0 (secure 0 0 0) 0x7f055801ba20 con 0x7f0568103b40 2023-07-14T18:04:55.788 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:55.186+0000 7f055e7fc700 1 --2- 172.21.15.163:0/2676561239 >> [v2:172.21.15.163:6800/1086512093,v1:172.21.15.163:6801/1086512093] conn(0x7f05540385a0 0x7f055403aa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:04:55.788 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:55.186+0000 7f055e7fc700 1 -- 172.21.15.163:0/2676561239 <== mon.0 v2:172.21.15.163:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f055804c820 con 0x7f0568103b40 2023-07-14T18:04:55.788 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:55.186+0000 7f056cb04700 1 --2- 172.21.15.163:0/2676561239 >> [v2:172.21.15.163:6800/1086512093,v1:172.21.15.163:6801/1086512093] conn(0x7f05540385a0 0x7f055403aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:04:55.789 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:55.186+0000 7f056cb04700 1 --2- 172.21.15.163:0/2676561239 >> [v2:172.21.15.163:6800/1086512093,v1:172.21.15.163:6801/1086512093] conn(0x7f05540385a0 0x7f055403aa50 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f0564006fd0 tx=0x7f0564006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:04:55.789 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:55.190+0000 7f055e7fc700 1 -- 172.21.15.163:0/2676561239 <== mon.0 v2:172.21.15.163:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178025 (secure 0 0 0) 0x7f0558018530 con 0x7f0568103b40 2023-07-14T18:04:55.789 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:55.342+0000 7f055e7fc700 1 -- 172.21.15.163:0/2676561239 <== mon.0 v2:172.21.15.163:3300/0 7 ==== mgrmap(e 8) v1 ==== 45483+0+0 (secure 0 0 0) 0x7f055801a3d0 con 0x7f0568103b40 2023-07-14T18:04:55.789 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:55.392+0000 7f056f569700 1 -- 172.21.15.163:0/2676561239 --> [v2:172.21.15.163:6800/1086512093,v1:172.21.15.163:6801/1086512093] -- mgr_command(tid 0: {"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}) v1 -- 0x7f056819c3d0 con 0x7f05540385a0 2023-07-14T18:04:55.789 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:55.398+0000 7f055e7fc700 1 -- 172.21.15.163:0/2676561239 <== mgr.14120 v2:172.21.15.163:6800/1086512093 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f056819c3d0 con 0x7f05540385a0 2023-07-14T18:04:55.789 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:55.400+0000 7f056f569700 1 -- 172.21.15.163:0/2676561239 >> [v2:172.21.15.163:6800/1086512093,v1:172.21.15.163:6801/1086512093] conn(0x7f05540385a0 msgr2=0x7f055403aa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:04:55.789 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:55.400+0000 7f056f569700 1 --2- 172.21.15.163:0/2676561239 >> [v2:172.21.15.163:6800/1086512093,v1:172.21.15.163:6801/1086512093] conn(0x7f05540385a0 0x7f055403aa50 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f0564006fd0 tx=0x7f0564006e40 comp rx=0 tx=0).stop 2023-07-14T18:04:55.789 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:55.400+0000 7f056f569700 1 -- 172.21.15.163:0/2676561239 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f0568103b40 msgr2=0x7f056819b170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:04:55.790 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:55.400+0000 7f056f569700 1 --2- 172.21.15.163:0/2676561239 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f0568103b40 0x7f056819b170 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f0558006af0 tx=0x7f0558011a30 comp rx=0 tx=0).stop 2023-07-14T18:04:55.790 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:55.400+0000 7f056f569700 1 -- 172.21.15.163:0/2676561239 shutdown_connections 2023-07-14T18:04:55.790 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:55.400+0000 7f056f569700 1 --2- 172.21.15.163:0/2676561239 >> [v2:172.21.15.163:6800/1086512093,v1:172.21.15.163:6801/1086512093] conn(0x7f05540385a0 0x7f055403aa50 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:04:55.790 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:55.400+0000 7f056f569700 1 --2- 172.21.15.163:0/2676561239 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f0568103b40 0x7f056819b170 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:04:55.790 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:55.400+0000 7f056f569700 1 -- 172.21.15.163:0/2676561239 >> 172.21.15.163:0/2676561239 conn(0x7f05680ff750 msgr2=0x7f056818f700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:04:55.790 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:55.401+0000 7f056f569700 1 -- 172.21.15.163:0/2676561239 shutdown_connections 2023-07-14T18:04:55.791 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:55.401+0000 7f056f569700 1 -- 172.21.15.163:0/2676561239 wait complete. 2023-07-14T18:04:56.706 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:04:56 smithi163 ceph-mon[96576]: mgrmap e8: x(active, since 2s) 2023-07-14T18:04:56.706 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:04:56 smithi163 ceph-mon[96576]: from='client.14132 -' entity='client.admin' cmd=[{"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}]: dispatch 2023-07-14T18:04:56.706 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:04:56 smithi163 ceph-mon[96576]: from='mgr.14120 172.21.15.163:0/1316764358' entity='mgr.x' 2023-07-14T18:04:56.707 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:04:56 smithi163 ceph-mon[96576]: from='mgr.14120 172.21.15.163:0/1316764358' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-14T18:04:56.823 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stdout value unchanged 2023-07-14T18:04:56.823 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:56.226+0000 7fb058070700 1 Processor -- start 2023-07-14T18:04:56.823 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:56.227+0000 7fb058070700 1 -- start start 2023-07-14T18:04:56.823 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:56.227+0000 7fb058070700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fb0501034d0 0x7fb0501038e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:04:56.824 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:56.227+0000 7fb058070700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb050103e20 con 0x7fb0501034d0 2023-07-14T18:04:56.824 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:56.227+0000 7fb055e0c700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fb0501034d0 0x7fb0501038e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:04:56.824 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:56.227+0000 7fb055e0c700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fb0501034d0 0x7fb0501038e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:54554/0 (socket says 172.21.15.163:54554) 2023-07-14T18:04:56.824 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:56.227+0000 7fb055e0c700 1 -- 172.21.15.163:0/3808551129 learned_addr learned my addr 172.21.15.163:0/3808551129 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:04:56.824 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:56.227+0000 7fb055e0c700 1 -- 172.21.15.163:0/3808551129 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb050103f60 con 0x7fb0501034d0 2023-07-14T18:04:56.824 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:56.227+0000 7fb055e0c700 1 --2- 172.21.15.163:0/3808551129 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fb0501034d0 0x7fb0501038e0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fb0400098a0 tx=0x7fb040009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=830a6410b237b03a server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:04:56.825 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:56.228+0000 7fb054e0a700 1 -- 172.21.15.163:0/3808551129 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb040004160 con 0x7fb0501034d0 2023-07-14T18:04:56.825 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:56.228+0000 7fb054e0a700 1 -- 172.21.15.163:0/3808551129 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(25 keys) v1 ==== 1036+0+0 (secure 0 0 0) 0x7fb0400042c0 con 0x7fb0501034d0 2023-07-14T18:04:56.825 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:56.228+0000 7fb054e0a700 1 -- 172.21.15.163:0/3808551129 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb040011940 con 0x7fb0501034d0 2023-07-14T18:04:56.825 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:56.228+0000 7fb058070700 1 -- 172.21.15.163:0/3808551129 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fb0501034d0 msgr2=0x7fb0501038e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:04:56.825 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:56.228+0000 7fb058070700 1 --2- 172.21.15.163:0/3808551129 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fb0501034d0 0x7fb0501038e0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fb0400098a0 tx=0x7fb040009bb0 comp rx=0 tx=0).stop 2023-07-14T18:04:56.825 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:56.228+0000 7fb058070700 1 -- 172.21.15.163:0/3808551129 shutdown_connections 2023-07-14T18:04:56.825 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:56.228+0000 7fb058070700 1 --2- 172.21.15.163:0/3808551129 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fb0501034d0 0x7fb0501038e0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:04:56.825 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:56.228+0000 7fb058070700 1 -- 172.21.15.163:0/3808551129 >> 172.21.15.163:0/3808551129 conn(0x7fb0500feef0 msgr2=0x7fb050101300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:04:56.826 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:56.228+0000 7fb058070700 1 -- 172.21.15.163:0/3808551129 shutdown_connections 2023-07-14T18:04:56.826 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:56.228+0000 7fb058070700 1 -- 172.21.15.163:0/3808551129 wait complete. 2023-07-14T18:04:56.826 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:56.229+0000 7fb058070700 1 Processor -- start 2023-07-14T18:04:56.826 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:56.229+0000 7fb058070700 1 -- start start 2023-07-14T18:04:56.826 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:56.229+0000 7fb058070700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fb0501034d0 0x7fb050198f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:04:56.826 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:56.229+0000 7fb058070700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0501994a0 con 0x7fb0501034d0 2023-07-14T18:04:56.826 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:56.229+0000 7fb055e0c700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fb0501034d0 0x7fb050198f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:04:56.827 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:56.229+0000 7fb055e0c700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fb0501034d0 0x7fb050198f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:54556/0 (socket says 172.21.15.163:54556) 2023-07-14T18:04:56.827 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:56.229+0000 7fb055e0c700 1 -- 172.21.15.163:0/2022986328 learned_addr learned my addr 172.21.15.163:0/2022986328 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:04:56.827 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:56.230+0000 7fb055e0c700 1 -- 172.21.15.163:0/2022986328 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb040009550 con 0x7fb0501034d0 2023-07-14T18:04:56.827 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:56.230+0000 7fb055e0c700 1 --2- 172.21.15.163:0/2022986328 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fb0501034d0 0x7fb050198f60 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fb040000c00 tx=0x7fb040011e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:04:56.827 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:56.230+0000 7fb046ffd700 1 -- 172.21.15.163:0/2022986328 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb0400036a0 con 0x7fb0501034d0 2023-07-14T18:04:56.827 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:56.230+0000 7fb046ffd700 1 -- 172.21.15.163:0/2022986328 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(25 keys) v1 ==== 1036+0+0 (secure 0 0 0) 0x7fb04001b440 con 0x7fb0501034d0 2023-07-14T18:04:56.827 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:56.230+0000 7fb058070700 1 -- 172.21.15.163:0/2022986328 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb0501996a0 con 0x7fb0501034d0 2023-07-14T18:04:56.827 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:56.230+0000 7fb046ffd700 1 -- 172.21.15.163:0/2022986328 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb0400193f0 con 0x7fb0501034d0 2023-07-14T18:04:56.828 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:56.230+0000 7fb058070700 1 -- 172.21.15.163:0/2022986328 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb050199ac0 con 0x7fb0501034d0 2023-07-14T18:04:56.828 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:56.231+0000 7fb046ffd700 1 -- 172.21.15.163:0/2022986328 <== mon.0 v2:172.21.15.163:3300/0 4 ==== mgrmap(e 8) v1 ==== 45483+0+0 (secure 0 0 0) 0x7fb0400195e0 con 0x7fb0501034d0 2023-07-14T18:04:56.828 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:56.231+0000 7fb046ffd700 1 --2- 172.21.15.163:0/2022986328 >> [v2:172.21.15.163:6800/1086512093,v1:172.21.15.163:6801/1086512093] conn(0x7fb03c038760 0x7fb03c03ac10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:04:56.828 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:56.231+0000 7fb058070700 1 -- 172.21.15.163:0/2022986328 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb050068520 con 0x7fb0501034d0 2023-07-14T18:04:56.828 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:56.231+0000 7fb046ffd700 1 -- 172.21.15.163:0/2022986328 <== mon.0 v2:172.21.15.163:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7fb04004c6a0 con 0x7fb0501034d0 2023-07-14T18:04:56.828 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:56.235+0000 7fb05560b700 1 --2- 172.21.15.163:0/2022986328 >> [v2:172.21.15.163:6800/1086512093,v1:172.21.15.163:6801/1086512093] conn(0x7fb03c038760 0x7fb03c03ac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:04:56.828 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:56.235+0000 7fb05560b700 1 --2- 172.21.15.163:0/2022986328 >> [v2:172.21.15.163:6800/1086512093,v1:172.21.15.163:6801/1086512093] conn(0x7fb03c038760 0x7fb03c03ac10 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fb04c006fd0 tx=0x7fb04c006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:04:56.829 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:56.236+0000 7fb046ffd700 1 -- 172.21.15.163:0/2022986328 <== mon.0 v2:172.21.15.163:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178025 (secure 0 0 0) 0x7fb040022950 con 0x7fb0501034d0 2023-07-14T18:04:56.829 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:56.423+0000 7fb058070700 1 -- 172.21.15.163:0/2022986328 --> [v2:172.21.15.163:6800/1086512093,v1:172.21.15.163:6801/1086512093] -- mgr_command(tid 0: {"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}) v1 -- 0x7fb050100370 con 0x7fb03c038760 2023-07-14T18:04:56.829 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:56.423+0000 7fb046ffd700 1 -- 172.21.15.163:0/2022986328 <== mgr.14120 v2:172.21.15.163:6800/1086512093 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+16 (secure 0 0 0) 0x7fb050100370 con 0x7fb03c038760 2023-07-14T18:04:56.829 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:56.426+0000 7fb058070700 1 -- 172.21.15.163:0/2022986328 >> [v2:172.21.15.163:6800/1086512093,v1:172.21.15.163:6801/1086512093] conn(0x7fb03c038760 msgr2=0x7fb03c03ac10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:04:56.829 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:56.426+0000 7fb058070700 1 --2- 172.21.15.163:0/2022986328 >> [v2:172.21.15.163:6800/1086512093,v1:172.21.15.163:6801/1086512093] conn(0x7fb03c038760 0x7fb03c03ac10 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fb04c006fd0 tx=0x7fb04c006e40 comp rx=0 tx=0).stop 2023-07-14T18:04:56.829 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:56.426+0000 7fb058070700 1 -- 172.21.15.163:0/2022986328 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fb0501034d0 msgr2=0x7fb050198f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:04:56.829 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:56.426+0000 7fb058070700 1 --2- 172.21.15.163:0/2022986328 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fb0501034d0 0x7fb050198f60 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fb040000c00 tx=0x7fb040011e70 comp rx=0 tx=0).stop 2023-07-14T18:04:56.830 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:56.426+0000 7fb058070700 1 -- 172.21.15.163:0/2022986328 shutdown_connections 2023-07-14T18:04:56.830 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:56.426+0000 7fb058070700 1 --2- 172.21.15.163:0/2022986328 >> [v2:172.21.15.163:6800/1086512093,v1:172.21.15.163:6801/1086512093] conn(0x7fb03c038760 0x7fb03c03ac10 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:04:56.830 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:56.426+0000 7fb058070700 1 --2- 172.21.15.163:0/2022986328 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fb0501034d0 0x7fb050198f60 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:04:56.830 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:56.426+0000 7fb058070700 1 -- 172.21.15.163:0/2022986328 >> 172.21.15.163:0/2022986328 conn(0x7fb0500feef0 msgr2=0x7fb0500ffc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:04:56.830 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:56.426+0000 7fb058070700 1 -- 172.21.15.163:0/2022986328 shutdown_connections 2023-07-14T18:04:56.830 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:56.426+0000 7fb058070700 1 -- 172.21.15.163:0/2022986328 wait complete. 2023-07-14T18:04:56.830 INFO:teuthology.orchestra.run.smithi163.stdout:Generating ssh key... 2023-07-14T18:04:57.706 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:04:57 smithi163 ceph-mon[96576]: from='client.14134 -' entity='client.admin' cmd=[{"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}]: dispatch 2023-07-14T18:04:57.707 INFO:journalctl@ceph.mgr.x.smithi163.stdout:Jul 14 18:04:57 smithi163 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-mgr-x[96818]: Generating public/private rsa key pair. 2023-07-14T18:04:57.707 INFO:journalctl@ceph.mgr.x.smithi163.stdout:Jul 14 18:04:57 smithi163 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-mgr-x[96818]: Your identification has been saved in /tmp/tmpqb7xwqer/key. 2023-07-14T18:04:57.707 INFO:journalctl@ceph.mgr.x.smithi163.stdout:Jul 14 18:04:57 smithi163 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-mgr-x[96818]: Your public key has been saved in /tmp/tmpqb7xwqer/key.pub. 2023-07-14T18:04:57.707 INFO:journalctl@ceph.mgr.x.smithi163.stdout:Jul 14 18:04:57 smithi163 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-mgr-x[96818]: The key fingerprint is: 2023-07-14T18:04:57.707 INFO:journalctl@ceph.mgr.x.smithi163.stdout:Jul 14 18:04:57 smithi163 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-mgr-x[96818]: SHA256:65tPOwGe9DeWQn4EfYHJqzd5Sqy6otAb2x+DcO0CsYQ ceph-bf7326ec-2270-11ee-9b33-001a4aab830c 2023-07-14T18:04:57.707 INFO:journalctl@ceph.mgr.x.smithi163.stdout:Jul 14 18:04:57 smithi163 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-mgr-x[96818]: The key's randomart image is: 2023-07-14T18:04:57.707 INFO:journalctl@ceph.mgr.x.smithi163.stdout:Jul 14 18:04:57 smithi163 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-mgr-x[96818]: +---[RSA 3072]----+ 2023-07-14T18:04:57.708 INFO:journalctl@ceph.mgr.x.smithi163.stdout:Jul 14 18:04:57 smithi163 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-mgr-x[96818]: | o o.. | 2023-07-14T18:04:57.708 INFO:journalctl@ceph.mgr.x.smithi163.stdout:Jul 14 18:04:57 smithi163 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-mgr-x[96818]: | . . = . | 2023-07-14T18:04:57.708 INFO:journalctl@ceph.mgr.x.smithi163.stdout:Jul 14 18:04:57 smithi163 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-mgr-x[96818]: | E o . o | 2023-07-14T18:04:57.708 INFO:journalctl@ceph.mgr.x.smithi163.stdout:Jul 14 18:04:57 smithi163 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-mgr-x[96818]: | . o .o . o | 2023-07-14T18:04:57.708 INFO:journalctl@ceph.mgr.x.smithi163.stdout:Jul 14 18:04:57 smithi163 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-mgr-x[96818]: | + .oS* + o | 2023-07-14T18:04:57.708 INFO:journalctl@ceph.mgr.x.smithi163.stdout:Jul 14 18:04:57 smithi163 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-mgr-x[96818]: | . + oo.* % . | 2023-07-14T18:04:57.708 INFO:journalctl@ceph.mgr.x.smithi163.stdout:Jul 14 18:04:57 smithi163 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-mgr-x[96818]: | . o o = .X = | 2023-07-14T18:04:57.709 INFO:journalctl@ceph.mgr.x.smithi163.stdout:Jul 14 18:04:57 smithi163 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-mgr-x[96818]: | . =.o =o.. | 2023-07-14T18:04:57.709 INFO:journalctl@ceph.mgr.x.smithi163.stdout:Jul 14 18:04:57 smithi163 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-mgr-x[96818]: | +..oB=o. | 2023-07-14T18:04:57.709 INFO:journalctl@ceph.mgr.x.smithi163.stdout:Jul 14 18:04:57 smithi163 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-mgr-x[96818]: +----[SHA256]-----+ 2023-07-14T18:04:57.968 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:57.304+0000 7f1530570700 1 Processor -- start 2023-07-14T18:04:57.968 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:57.304+0000 7f1530570700 1 -- start start 2023-07-14T18:04:57.969 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:57.304+0000 7f1530570700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f1528106800 0x7f1528106c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:04:57.969 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:57.304+0000 7f1530570700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1528107150 con 0x7f1528106800 2023-07-14T18:04:57.969 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:57.304+0000 7f152e30c700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f1528106800 0x7f1528106c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:04:57.969 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:57.304+0000 7f152e30c700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f1528106800 0x7f1528106c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:54560/0 (socket says 172.21.15.163:54560) 2023-07-14T18:04:57.969 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:57.304+0000 7f152e30c700 1 -- 172.21.15.163:0/1404148026 learned_addr learned my addr 172.21.15.163:0/1404148026 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:04:57.969 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:57.304+0000 7f152e30c700 1 -- 172.21.15.163:0/1404148026 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1528107290 con 0x7f1528106800 2023-07-14T18:04:57.970 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:57.305+0000 7f152e30c700 1 --2- 172.21.15.163:0/1404148026 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f1528106800 0x7f1528106c10 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f15240098a0 tx=0x7f1524009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b1fd5bcd993975aa server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:04:57.970 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:57.305+0000 7f152d30a700 1 -- 172.21.15.163:0/1404148026 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1524004160 con 0x7f1528106800 2023-07-14T18:04:57.970 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:57.305+0000 7f152d30a700 1 -- 172.21.15.163:0/1404148026 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(25 keys) v1 ==== 1036+0+0 (secure 0 0 0) 0x7f15240042c0 con 0x7f1528106800 2023-07-14T18:04:57.970 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:57.305+0000 7f152d30a700 1 -- 172.21.15.163:0/1404148026 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1524011940 con 0x7f1528106800 2023-07-14T18:04:57.970 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:57.305+0000 7f1530570700 1 -- 172.21.15.163:0/1404148026 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f1528106800 msgr2=0x7f1528106c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:04:57.970 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:57.305+0000 7f1530570700 1 --2- 172.21.15.163:0/1404148026 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f1528106800 0x7f1528106c10 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f15240098a0 tx=0x7f1524009bb0 comp rx=0 tx=0).stop 2023-07-14T18:04:57.970 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:57.305+0000 7f1530570700 1 -- 172.21.15.163:0/1404148026 shutdown_connections 2023-07-14T18:04:57.971 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:57.305+0000 7f1530570700 1 --2- 172.21.15.163:0/1404148026 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f1528106800 0x7f1528106c10 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:04:57.971 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:57.305+0000 7f1530570700 1 -- 172.21.15.163:0/1404148026 >> 172.21.15.163:0/1404148026 conn(0x7f15280feef0 msgr2=0x7f1528101300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:04:57.971 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:57.305+0000 7f1530570700 1 -- 172.21.15.163:0/1404148026 shutdown_connections 2023-07-14T18:04:57.971 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:57.305+0000 7f1530570700 1 -- 172.21.15.163:0/1404148026 wait complete. 2023-07-14T18:04:57.971 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:57.306+0000 7f1530570700 1 Processor -- start 2023-07-14T18:04:57.971 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:57.306+0000 7f1530570700 1 -- start start 2023-07-14T18:04:57.971 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:57.306+0000 7f1530570700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f1528106800 0x7f1528198f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:04:57.972 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:57.306+0000 7f1530570700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15281994c0 con 0x7f1528106800 2023-07-14T18:04:57.972 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:57.306+0000 7f152e30c700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f1528106800 0x7f1528198f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:04:57.972 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:57.306+0000 7f152e30c700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f1528106800 0x7f1528198f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:54562/0 (socket says 172.21.15.163:54562) 2023-07-14T18:04:57.972 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:57.306+0000 7f152e30c700 1 -- 172.21.15.163:0/705306492 learned_addr learned my addr 172.21.15.163:0/705306492 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:04:57.972 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:57.307+0000 7f152e30c700 1 -- 172.21.15.163:0/705306492 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1524009550 con 0x7f1528106800 2023-07-14T18:04:57.972 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:57.307+0000 7f152e30c700 1 --2- 172.21.15.163:0/705306492 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f1528106800 0x7f1528198f80 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f1524006af0 tx=0x7f1524011a30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:04:57.972 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:57.307+0000 7f151f7fe700 1 -- 172.21.15.163:0/705306492 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1524003bf0 con 0x7f1528106800 2023-07-14T18:04:57.973 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:57.307+0000 7f1530570700 1 -- 172.21.15.163:0/705306492 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f15281996c0 con 0x7f1528106800 2023-07-14T18:04:57.973 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:57.307+0000 7f151f7fe700 1 -- 172.21.15.163:0/705306492 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(25 keys) v1 ==== 1036+0+0 (secure 0 0 0) 0x7f152401b8b0 con 0x7f1528106800 2023-07-14T18:04:57.973 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:57.307+0000 7f151f7fe700 1 -- 172.21.15.163:0/705306492 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1524019880 con 0x7f1528106800 2023-07-14T18:04:57.973 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:57.307+0000 7f1530570700 1 -- 172.21.15.163:0/705306492 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1528199ae0 con 0x7f1528106800 2023-07-14T18:04:57.973 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:57.308+0000 7f151f7fe700 1 -- 172.21.15.163:0/705306492 <== mon.0 v2:172.21.15.163:3300/0 4 ==== mgrmap(e 8) v1 ==== 45483+0+0 (secure 0 0 0) 0x7f152401b440 con 0x7f1528106800 2023-07-14T18:04:57.973 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:57.308+0000 7f1530570700 1 -- 172.21.15.163:0/705306492 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1528103d10 con 0x7f1528106800 2023-07-14T18:04:57.973 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:57.308+0000 7f151f7fe700 1 --2- 172.21.15.163:0/705306492 >> [v2:172.21.15.163:6800/1086512093,v1:172.21.15.163:6801/1086512093] conn(0x7f15140386c0 0x7f151403ab70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:04:57.974 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:57.308+0000 7f151f7fe700 1 -- 172.21.15.163:0/705306492 <== mon.0 v2:172.21.15.163:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f152404caa0 con 0x7f1528106800 2023-07-14T18:04:57.974 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:57.308+0000 7f152db0b700 1 --2- 172.21.15.163:0/705306492 >> [v2:172.21.15.163:6800/1086512093,v1:172.21.15.163:6801/1086512093] conn(0x7f15140386c0 0x7f151403ab70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:04:57.974 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:57.308+0000 7f152db0b700 1 --2- 172.21.15.163:0/705306492 >> [v2:172.21.15.163:6800/1086512093,v1:172.21.15.163:6801/1086512093] conn(0x7f15140386c0 0x7f151403ab70 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f1518006fd0 tx=0x7f1518006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:04:57.974 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:57.313+0000 7f151f7fe700 1 -- 172.21.15.163:0/705306492 <== mon.0 v2:172.21.15.163:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178025 (secure 0 0 0) 0x7f1524018530 con 0x7f1528106800 2023-07-14T18:04:57.974 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:57.498+0000 7f1530570700 1 -- 172.21.15.163:0/705306492 --> [v2:172.21.15.163:6800/1086512093,v1:172.21.15.163:6801/1086512093] -- mgr_command(tid 0: {"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}) v1 -- 0x7f152819abf0 con 0x7f15140386c0 2023-07-14T18:04:57.974 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:57.559+0000 7f151f7fe700 1 -- 172.21.15.163:0/705306492 <== mgr.14120 v2:172.21.15.163:6800/1086512093 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f152819abf0 con 0x7f15140386c0 2023-07-14T18:04:57.974 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:57.561+0000 7f1530570700 1 -- 172.21.15.163:0/705306492 >> [v2:172.21.15.163:6800/1086512093,v1:172.21.15.163:6801/1086512093] conn(0x7f15140386c0 msgr2=0x7f151403ab70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:04:57.975 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:57.561+0000 7f1530570700 1 --2- 172.21.15.163:0/705306492 >> [v2:172.21.15.163:6800/1086512093,v1:172.21.15.163:6801/1086512093] conn(0x7f15140386c0 0x7f151403ab70 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f1518006fd0 tx=0x7f1518006e40 comp rx=0 tx=0).stop 2023-07-14T18:04:57.975 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:57.561+0000 7f1530570700 1 -- 172.21.15.163:0/705306492 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f1528106800 msgr2=0x7f1528198f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:04:57.975 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:57.561+0000 7f1530570700 1 --2- 172.21.15.163:0/705306492 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f1528106800 0x7f1528198f80 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f1524006af0 tx=0x7f1524011a30 comp rx=0 tx=0).stop 2023-07-14T18:04:57.975 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:57.561+0000 7f1530570700 1 -- 172.21.15.163:0/705306492 shutdown_connections 2023-07-14T18:04:57.975 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:57.561+0000 7f1530570700 1 --2- 172.21.15.163:0/705306492 >> [v2:172.21.15.163:6800/1086512093,v1:172.21.15.163:6801/1086512093] conn(0x7f15140386c0 0x7f151403ab70 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:04:57.975 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:57.561+0000 7f1530570700 1 --2- 172.21.15.163:0/705306492 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f1528106800 0x7f1528198f80 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:04:57.975 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:57.561+0000 7f1530570700 1 -- 172.21.15.163:0/705306492 >> 172.21.15.163:0/705306492 conn(0x7f15280feef0 msgr2=0x7f1528100530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:04:57.976 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:57.561+0000 7f1530570700 1 -- 172.21.15.163:0/705306492 shutdown_connections 2023-07-14T18:04:57.976 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:57.562+0000 7f1530570700 1 -- 172.21.15.163:0/705306492 wait complete. 2023-07-14T18:04:58.956 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:04:58 smithi163 ceph-mon[96576]: from='client.14136 -' entity='client.admin' cmd=[{"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}]: dispatch 2023-07-14T18:04:58.957 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:04:58 smithi163 ceph-mon[96576]: Generating ssh key... 2023-07-14T18:04:58.957 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:04:58 smithi163 ceph-mon[96576]: from='mgr.14120 172.21.15.163:0/1316764358' entity='mgr.x' 2023-07-14T18:04:58.957 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:04:58 smithi163 ceph-mon[96576]: from='mgr.14120 172.21.15.163:0/1316764358' entity='mgr.x' 2023-07-14T18:04:59.013 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stdout ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCi8DSuLRgk0hQA+UFayHR+putkJZIlJWsMuPm0Z0sWknQUyVpjsFRjWFLMiaUg+vaXpZmiImcI+EVzmlJUG5FhzQ7up3qkyNNzob68JBh0VmLYHwRLa9FLVr7OtsyYAF1l9Nn4cHS4XJ9S4mSFsTSM5z1yxdXBNB3KTjQ5+mFR3sqcX2uOD9RlKjNOBAtwVLoXun0bKQ6bjRR5sSwPkUSgtQj/JdgUR5AIJfIN5sxS7lWojyRxtAHXjmYhO3Oa0WT4htev48ePta0lu3bVfCXcMgsGcbfP5VGMKnq15hFVFaTjZGad3H31yahFQE2zjYwkC7V0aKCzwUZe3fpzo3NRZv0uaWAa69dDoF5R/BWOKmmJ5eUVJoGfDKsVZgtkCJUDMREuw/94CZ3H2OpFz5GKc/QrMVvDkvcKft7ftJilratQE4TAgYvLzbLecoMyd9PFceGMMOHElrKJwfM84NeFuxtVczoUR26vfcIyau68JV7GFtNdV+ljqn0goHO1J1c= ceph-bf7326ec-2270-11ee-9b33-001a4aab830c 2023-07-14T18:04:59.013 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:58.387+0000 7f2d53e94700 1 Processor -- start 2023-07-14T18:04:59.014 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:58.387+0000 7f2d53e94700 1 -- start start 2023-07-14T18:04:59.014 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:58.387+0000 7f2d53e94700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f2d4c1051f0 0x7f2d4c105600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:04:59.014 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:58.387+0000 7f2d53e94700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d4c105b40 con 0x7f2d4c1051f0 2023-07-14T18:04:59.014 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:58.387+0000 7f2d51c30700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f2d4c1051f0 0x7f2d4c105600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:04:59.014 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:58.387+0000 7f2d51c30700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f2d4c1051f0 0x7f2d4c105600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:54566/0 (socket says 172.21.15.163:54566) 2023-07-14T18:04:59.014 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:58.387+0000 7f2d51c30700 1 -- 172.21.15.163:0/2321696289 learned_addr learned my addr 172.21.15.163:0/2321696289 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:04:59.014 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:58.388+0000 7f2d51c30700 1 -- 172.21.15.163:0/2321696289 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d4c105c80 con 0x7f2d4c1051f0 2023-07-14T18:04:59.015 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:58.388+0000 7f2d51c30700 1 --2- 172.21.15.163:0/2321696289 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f2d4c1051f0 0x7f2d4c105600 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f2d480098a0 tx=0x7f2d48009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=71cbf374c28afbcb server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:04:59.015 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:58.388+0000 7f2d50c2e700 1 -- 172.21.15.163:0/2321696289 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2d48004160 con 0x7f2d4c1051f0 2023-07-14T18:04:59.015 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:58.388+0000 7f2d50c2e700 1 -- 172.21.15.163:0/2321696289 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(25 keys) v1 ==== 1036+0+0 (secure 0 0 0) 0x7f2d480042c0 con 0x7f2d4c1051f0 2023-07-14T18:04:59.015 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:58.388+0000 7f2d50c2e700 1 -- 172.21.15.163:0/2321696289 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2d48011940 con 0x7f2d4c1051f0 2023-07-14T18:04:59.015 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:58.388+0000 7f2d53e94700 1 -- 172.21.15.163:0/2321696289 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f2d4c1051f0 msgr2=0x7f2d4c105600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:04:59.015 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:58.388+0000 7f2d53e94700 1 --2- 172.21.15.163:0/2321696289 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f2d4c1051f0 0x7f2d4c105600 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f2d480098a0 tx=0x7f2d48009bb0 comp rx=0 tx=0).stop 2023-07-14T18:04:59.015 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:58.388+0000 7f2d53e94700 1 -- 172.21.15.163:0/2321696289 shutdown_connections 2023-07-14T18:04:59.015 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:58.388+0000 7f2d53e94700 1 --2- 172.21.15.163:0/2321696289 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f2d4c1051f0 0x7f2d4c105600 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:04:59.016 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:58.388+0000 7f2d53e94700 1 -- 172.21.15.163:0/2321696289 >> 172.21.15.163:0/2321696289 conn(0x7f2d4c1008c0 msgr2=0x7f2d4c102cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:04:59.016 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:58.389+0000 7f2d53e94700 1 -- 172.21.15.163:0/2321696289 shutdown_connections 2023-07-14T18:04:59.016 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:58.389+0000 7f2d53e94700 1 -- 172.21.15.163:0/2321696289 wait complete. 2023-07-14T18:04:59.016 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:58.389+0000 7f2d53e94700 1 Processor -- start 2023-07-14T18:04:59.016 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:58.389+0000 7f2d53e94700 1 -- start start 2023-07-14T18:04:59.016 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:58.389+0000 7f2d53e94700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f2d4c1051f0 0x7f2d4c198f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:04:59.016 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:58.389+0000 7f2d53e94700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d4c199480 con 0x7f2d4c1051f0 2023-07-14T18:04:59.017 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:58.389+0000 7f2d51c30700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f2d4c1051f0 0x7f2d4c198f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:04:59.017 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:58.389+0000 7f2d51c30700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f2d4c1051f0 0x7f2d4c198f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:54568/0 (socket says 172.21.15.163:54568) 2023-07-14T18:04:59.017 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:58.389+0000 7f2d51c30700 1 -- 172.21.15.163:0/4102517263 learned_addr learned my addr 172.21.15.163:0/4102517263 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:04:59.017 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:58.390+0000 7f2d51c30700 1 -- 172.21.15.163:0/4102517263 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d48009550 con 0x7f2d4c1051f0 2023-07-14T18:04:59.017 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:58.390+0000 7f2d51c30700 1 --2- 172.21.15.163:0/4102517263 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f2d4c1051f0 0x7f2d4c198f40 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f2d48006af0 tx=0x7f2d48011a30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:04:59.017 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:58.390+0000 7f2d42ffd700 1 -- 172.21.15.163:0/4102517263 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2d48003bf0 con 0x7f2d4c1051f0 2023-07-14T18:04:59.017 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:58.390+0000 7f2d42ffd700 1 -- 172.21.15.163:0/4102517263 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(25 keys) v1 ==== 1036+0+0 (secure 0 0 0) 0x7f2d4801b8b0 con 0x7f2d4c1051f0 2023-07-14T18:04:59.017 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:58.390+0000 7f2d53e94700 1 -- 172.21.15.163:0/4102517263 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d4c199680 con 0x7f2d4c1051f0 2023-07-14T18:04:59.018 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:58.390+0000 7f2d42ffd700 1 -- 172.21.15.163:0/4102517263 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2d48019880 con 0x7f2d4c1051f0 2023-07-14T18:04:59.018 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:58.390+0000 7f2d53e94700 1 -- 172.21.15.163:0/4102517263 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d4c199aa0 con 0x7f2d4c1051f0 2023-07-14T18:04:59.018 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:58.391+0000 7f2d42ffd700 1 -- 172.21.15.163:0/4102517263 <== mon.0 v2:172.21.15.163:3300/0 4 ==== mgrmap(e 8) v1 ==== 45483+0+0 (secure 0 0 0) 0x7f2d48019af0 con 0x7f2d4c1051f0 2023-07-14T18:04:59.018 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:58.391+0000 7f2d42ffd700 1 --2- 172.21.15.163:0/4102517263 >> [v2:172.21.15.163:6800/1086512093,v1:172.21.15.163:6801/1086512093] conn(0x7f2d38038710 0x7f2d3803abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:04:59.018 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:58.391+0000 7f2d42ffd700 1 -- 172.21.15.163:0/4102517263 <== mon.0 v2:172.21.15.163:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f2d4804ca30 con 0x7f2d4c1051f0 2023-07-14T18:04:59.018 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:58.391+0000 7f2d5142f700 1 --2- 172.21.15.163:0/4102517263 >> [v2:172.21.15.163:6800/1086512093,v1:172.21.15.163:6801/1086512093] conn(0x7f2d38038710 0x7f2d3803abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:04:59.018 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:58.391+0000 7f2d53e94700 1 -- 172.21.15.163:0/4102517263 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2d4c068520 con 0x7f2d4c1051f0 2023-07-14T18:04:59.019 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:58.391+0000 7f2d5142f700 1 --2- 172.21.15.163:0/4102517263 >> [v2:172.21.15.163:6800/1086512093,v1:172.21.15.163:6801/1086512093] conn(0x7f2d38038710 0x7f2d3803abc0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f2d3c006fd0 tx=0x7f2d3c006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:04:59.019 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:58.396+0000 7f2d42ffd700 1 -- 172.21.15.163:0/4102517263 <== mon.0 v2:172.21.15.163:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178025 (secure 0 0 0) 0x7f2d480189a0 con 0x7f2d4c1051f0 2023-07-14T18:04:59.019 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:58.584+0000 7f2d53e94700 1 -- 172.21.15.163:0/4102517263 --> [v2:172.21.15.163:6800/1086512093,v1:172.21.15.163:6801/1086512093] -- mgr_command(tid 0: {"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}) v1 -- 0x7f2d4c101d30 con 0x7f2d38038710 2023-07-14T18:04:59.019 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:58.584+0000 7f2d42ffd700 1 -- 172.21.15.163:0/4102517263 <== mgr.14120 v2:172.21.15.163:6800/1086512093 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+595 (secure 0 0 0) 0x7f2d4c101d30 con 0x7f2d38038710 2023-07-14T18:04:59.019 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:58.586+0000 7f2d53e94700 1 -- 172.21.15.163:0/4102517263 >> [v2:172.21.15.163:6800/1086512093,v1:172.21.15.163:6801/1086512093] conn(0x7f2d38038710 msgr2=0x7f2d3803abc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:04:59.020 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:58.586+0000 7f2d53e94700 1 --2- 172.21.15.163:0/4102517263 >> [v2:172.21.15.163:6800/1086512093,v1:172.21.15.163:6801/1086512093] conn(0x7f2d38038710 0x7f2d3803abc0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f2d3c006fd0 tx=0x7f2d3c006e40 comp rx=0 tx=0).stop 2023-07-14T18:04:59.020 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:58.586+0000 7f2d53e94700 1 -- 172.21.15.163:0/4102517263 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f2d4c1051f0 msgr2=0x7f2d4c198f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:04:59.020 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:58.586+0000 7f2d53e94700 1 --2- 172.21.15.163:0/4102517263 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f2d4c1051f0 0x7f2d4c198f40 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f2d48006af0 tx=0x7f2d48011a30 comp rx=0 tx=0).stop 2023-07-14T18:04:59.020 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:58.586+0000 7f2d53e94700 1 -- 172.21.15.163:0/4102517263 shutdown_connections 2023-07-14T18:04:59.020 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:58.586+0000 7f2d53e94700 1 --2- 172.21.15.163:0/4102517263 >> [v2:172.21.15.163:6800/1086512093,v1:172.21.15.163:6801/1086512093] conn(0x7f2d38038710 0x7f2d3803abc0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:04:59.020 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:58.586+0000 7f2d53e94700 1 --2- 172.21.15.163:0/4102517263 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f2d4c1051f0 0x7f2d4c198f40 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:04:59.020 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:58.586+0000 7f2d53e94700 1 -- 172.21.15.163:0/4102517263 >> 172.21.15.163:0/4102517263 conn(0x7f2d4c1008c0 msgr2=0x7f2d4c101620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:04:59.020 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:58.587+0000 7f2d53e94700 1 -- 172.21.15.163:0/4102517263 shutdown_connections 2023-07-14T18:04:59.021 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:58.587+0000 7f2d53e94700 1 -- 172.21.15.163:0/4102517263 wait complete. 2023-07-14T18:04:59.021 INFO:teuthology.orchestra.run.smithi163.stdout:Wrote public SSH key to /home/ubuntu/cephtest/ceph.pub 2023-07-14T18:04:59.021 INFO:teuthology.orchestra.run.smithi163.stdout:Adding key to root@localhost authorized_keys... 2023-07-14T18:04:59.022 INFO:teuthology.orchestra.run.smithi163.stdout:Adding host smithi163... 2023-07-14T18:04:59.911 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:04:59 smithi163 ceph-mon[96576]: from='client.14138 -' entity='client.admin' cmd=[{"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}]: dispatch 2023-07-14T18:05:00.706 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:05:00 smithi163 ceph-mon[96576]: from='client.14140 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi163", "addr": "172.21.15.163", "target": ["mon-mgr", ""]}]: dispatch 2023-07-14T18:05:01.956 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:05:01 smithi163 ceph-mon[96576]: Deploying cephadm binary to smithi163 2023-07-14T18:05:02.364 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stdout Added host 'smithi163' with addr '172.21.15.163' 2023-07-14T18:05:02.364 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:59.450+0000 7fe33e8bc700 1 Processor -- start 2023-07-14T18:05:02.364 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:59.450+0000 7fe33e8bc700 1 -- start start 2023-07-14T18:05:02.364 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:59.450+0000 7fe33e8bc700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fe338079cd0 0x7fe33810a180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:05:02.364 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:59.450+0000 7fe33e8bc700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe338105b70 con 0x7fe338079cd0 2023-07-14T18:05:02.364 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:59.450+0000 7fe337fff700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fe338079cd0 0x7fe33810a180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:05:02.365 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:59.450+0000 7fe337fff700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fe338079cd0 0x7fe33810a180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:54572/0 (socket says 172.21.15.163:54572) 2023-07-14T18:05:02.365 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:59.451+0000 7fe337fff700 1 -- 172.21.15.163:0/3236070427 learned_addr learned my addr 172.21.15.163:0/3236070427 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:05:02.365 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:59.451+0000 7fe337fff700 1 -- 172.21.15.163:0/3236070427 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe33810a6c0 con 0x7fe338079cd0 2023-07-14T18:05:02.365 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:59.451+0000 7fe337fff700 1 --2- 172.21.15.163:0/3236070427 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fe338079cd0 0x7fe33810a180 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fe32c0098a0 tx=0x7fe32c009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8dac45e99b950edc server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:05:02.365 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:59.451+0000 7fe336ffd700 1 -- 172.21.15.163:0/3236070427 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe32c004160 con 0x7fe338079cd0 2023-07-14T18:05:02.365 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:59.451+0000 7fe336ffd700 1 -- 172.21.15.163:0/3236070427 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(25 keys) v1 ==== 1036+0+0 (secure 0 0 0) 0x7fe32c0042c0 con 0x7fe338079cd0 2023-07-14T18:05:02.365 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:59.451+0000 7fe336ffd700 1 -- 172.21.15.163:0/3236070427 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe32c011940 con 0x7fe338079cd0 2023-07-14T18:05:02.366 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:59.452+0000 7fe33e8bc700 1 -- 172.21.15.163:0/3236070427 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fe338079cd0 msgr2=0x7fe33810a180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:05:02.366 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:59.452+0000 7fe33e8bc700 1 --2- 172.21.15.163:0/3236070427 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fe338079cd0 0x7fe33810a180 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fe32c0098a0 tx=0x7fe32c009bb0 comp rx=0 tx=0).stop 2023-07-14T18:05:02.366 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:59.452+0000 7fe33e8bc700 1 -- 172.21.15.163:0/3236070427 shutdown_connections 2023-07-14T18:05:02.366 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:59.452+0000 7fe33e8bc700 1 --2- 172.21.15.163:0/3236070427 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fe338079cd0 0x7fe33810a180 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:05:02.366 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:59.452+0000 7fe33e8bc700 1 -- 172.21.15.163:0/3236070427 >> 172.21.15.163:0/3236070427 conn(0x7fe3380ff750 msgr2=0x7fe338101b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:05:02.366 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:59.452+0000 7fe33e8bc700 1 -- 172.21.15.163:0/3236070427 shutdown_connections 2023-07-14T18:05:02.366 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:59.452+0000 7fe33e8bc700 1 -- 172.21.15.163:0/3236070427 wait complete. 2023-07-14T18:05:02.366 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:59.452+0000 7fe33e8bc700 1 Processor -- start 2023-07-14T18:05:02.367 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:59.452+0000 7fe33e8bc700 1 -- start start 2023-07-14T18:05:02.367 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:59.453+0000 7fe33e8bc700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fe33819b0c0 0x7fe33819b4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:05:02.367 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:59.453+0000 7fe33e8bc700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe33819ba10 con 0x7fe33819b0c0 2023-07-14T18:05:02.367 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:59.453+0000 7fe337fff700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fe33819b0c0 0x7fe33819b4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:05:02.367 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:59.453+0000 7fe337fff700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fe33819b0c0 0x7fe33819b4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:54574/0 (socket says 172.21.15.163:54574) 2023-07-14T18:05:02.367 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:59.453+0000 7fe337fff700 1 -- 172.21.15.163:0/3471906535 learned_addr learned my addr 172.21.15.163:0/3471906535 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:05:02.367 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:59.453+0000 7fe337fff700 1 -- 172.21.15.163:0/3471906535 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe32c009550 con 0x7fe33819b0c0 2023-07-14T18:05:02.368 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:59.453+0000 7fe337fff700 1 --2- 172.21.15.163:0/3471906535 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fe33819b0c0 0x7fe33819b4d0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fe32c006af0 tx=0x7fe32c011a30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:05:02.368 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:59.453+0000 7fe3357fa700 1 -- 172.21.15.163:0/3471906535 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe32c003bf0 con 0x7fe33819b0c0 2023-07-14T18:05:02.368 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:59.453+0000 7fe33e8bc700 1 -- 172.21.15.163:0/3471906535 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe33819bc10 con 0x7fe33819b0c0 2023-07-14T18:05:02.368 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:59.453+0000 7fe33e8bc700 1 -- 172.21.15.163:0/3471906535 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe33819c6a0 con 0x7fe33819b0c0 2023-07-14T18:05:02.368 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:59.453+0000 7fe3357fa700 1 -- 172.21.15.163:0/3471906535 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(25 keys) v1 ==== 1036+0+0 (secure 0 0 0) 0x7fe32c01b8b0 con 0x7fe33819b0c0 2023-07-14T18:05:02.368 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:59.453+0000 7fe3357fa700 1 -- 172.21.15.163:0/3471906535 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe32c0197d0 con 0x7fe33819b0c0 2023-07-14T18:05:02.368 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:59.454+0000 7fe3357fa700 1 -- 172.21.15.163:0/3471906535 <== mon.0 v2:172.21.15.163:3300/0 4 ==== mgrmap(e 8) v1 ==== 45483+0+0 (secure 0 0 0) 0x7fe32c019a90 con 0x7fe33819b0c0 2023-07-14T18:05:02.368 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:59.454+0000 7fe33e8bc700 1 -- 172.21.15.163:0/3471906535 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe324005320 con 0x7fe33819b0c0 2023-07-14T18:05:02.369 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:59.454+0000 7fe3357fa700 1 --2- 172.21.15.163:0/3471906535 >> [v2:172.21.15.163:6800/1086512093,v1:172.21.15.163:6801/1086512093] conn(0x7fe3200386c0 0x7fe32003ab70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:05:02.369 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:59.454+0000 7fe3357fa700 1 -- 172.21.15.163:0/3471906535 <== mon.0 v2:172.21.15.163:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7fe32c04ca90 con 0x7fe33819b0c0 2023-07-14T18:05:02.369 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:59.455+0000 7fe3377fe700 1 --2- 172.21.15.163:0/3471906535 >> [v2:172.21.15.163:6800/1086512093,v1:172.21.15.163:6801/1086512093] conn(0x7fe3200386c0 0x7fe32003ab70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:05:02.369 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:59.455+0000 7fe3377fe700 1 --2- 172.21.15.163:0/3471906535 >> [v2:172.21.15.163:6800/1086512093,v1:172.21.15.163:6801/1086512093] conn(0x7fe3200386c0 0x7fe32003ab70 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fe328006fd0 tx=0x7fe328006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:05:02.369 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:59.459+0000 7fe3357fa700 1 -- 172.21.15.163:0/3471906535 <== mon.0 v2:172.21.15.163:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178025 (secure 0 0 0) 0x7fe32c010380 con 0x7fe33819b0c0 2023-07-14T18:05:02.369 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:04:59.651+0000 7fe33e8bc700 1 -- 172.21.15.163:0/3471906535 --> [v2:172.21.15.163:6800/1086512093,v1:172.21.15.163:6801/1086512093] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi163", "addr": "172.21.15.163", "target": ["mon-mgr", ""]}) v1 -- 0x7fe324000bf0 con 0x7fe3200386c0 2023-07-14T18:05:02.369 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:01.908+0000 7fe3357fa700 1 -- 172.21.15.163:0/3471906535 <== mgr.14120 v2:172.21.15.163:6800/1086512093 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+49 (secure 0 0 0) 0x7fe324000bf0 con 0x7fe3200386c0 2023-07-14T18:05:02.370 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:01.911+0000 7fe33e8bc700 1 -- 172.21.15.163:0/3471906535 >> [v2:172.21.15.163:6800/1086512093,v1:172.21.15.163:6801/1086512093] conn(0x7fe3200386c0 msgr2=0x7fe32003ab70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:05:02.370 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:01.911+0000 7fe33e8bc700 1 --2- 172.21.15.163:0/3471906535 >> [v2:172.21.15.163:6800/1086512093,v1:172.21.15.163:6801/1086512093] conn(0x7fe3200386c0 0x7fe32003ab70 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fe328006fd0 tx=0x7fe328006e40 comp rx=0 tx=0).stop 2023-07-14T18:05:02.370 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:01.911+0000 7fe33e8bc700 1 -- 172.21.15.163:0/3471906535 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fe33819b0c0 msgr2=0x7fe33819b4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:05:02.370 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:01.911+0000 7fe33e8bc700 1 --2- 172.21.15.163:0/3471906535 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fe33819b0c0 0x7fe33819b4d0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fe32c006af0 tx=0x7fe32c011a30 comp rx=0 tx=0).stop 2023-07-14T18:05:02.370 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:01.911+0000 7fe33e8bc700 1 -- 172.21.15.163:0/3471906535 shutdown_connections 2023-07-14T18:05:02.370 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:01.911+0000 7fe33e8bc700 1 --2- 172.21.15.163:0/3471906535 >> [v2:172.21.15.163:6800/1086512093,v1:172.21.15.163:6801/1086512093] conn(0x7fe3200386c0 0x7fe32003ab70 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:05:02.370 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:01.911+0000 7fe33e8bc700 1 --2- 172.21.15.163:0/3471906535 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fe33819b0c0 0x7fe33819b4d0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:05:02.370 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:01.911+0000 7fe33e8bc700 1 -- 172.21.15.163:0/3471906535 >> 172.21.15.163:0/3471906535 conn(0x7fe3380ff750 msgr2=0x7fe3381004b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:05:02.371 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:01.911+0000 7fe33e8bc700 1 -- 172.21.15.163:0/3471906535 shutdown_connections 2023-07-14T18:05:02.371 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:01.911+0000 7fe33e8bc700 1 -- 172.21.15.163:0/3471906535 wait complete. 2023-07-14T18:05:02.371 INFO:teuthology.orchestra.run.smithi163.stdout:Deploying unmanaged mon service... 2023-07-14T18:05:02.937 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:05:02 smithi163 ceph-mon[96576]: from='mgr.14120 172.21.15.163:0/1316764358' entity='mgr.x' 2023-07-14T18:05:02.937 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:05:02 smithi163 ceph-mon[96576]: Added host smithi163 2023-07-14T18:05:02.937 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:05:02 smithi163 ceph-mon[96576]: from='mgr.14120 172.21.15.163:0/1316764358' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-14T18:05:03.715 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stdout Scheduled mon update... 2023-07-14T18:05:03.715 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:02.849+0000 7f228187b700 1 Processor -- start 2023-07-14T18:05:03.715 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:02.849+0000 7f228187b700 1 -- start start 2023-07-14T18:05:03.715 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:02.849+0000 7f228187b700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f227c1040e0 0x7f227c1044f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:05:03.716 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:02.849+0000 7f228187b700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f227c104a30 con 0x7f227c1040e0 2023-07-14T18:05:03.716 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:02.849+0000 7f227affd700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f227c1040e0 0x7f227c1044f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:05:03.716 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:02.849+0000 7f227affd700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f227c1040e0 0x7f227c1044f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:54608/0 (socket says 172.21.15.163:54608) 2023-07-14T18:05:03.716 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:02.849+0000 7f227affd700 1 -- 172.21.15.163:0/1009771703 learned_addr learned my addr 172.21.15.163:0/1009771703 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:05:03.716 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:02.850+0000 7f227affd700 1 -- 172.21.15.163:0/1009771703 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f227c104b70 con 0x7f227c1040e0 2023-07-14T18:05:03.716 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:02.850+0000 7f227affd700 1 --2- 172.21.15.163:0/1009771703 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f227c1040e0 0x7f227c1044f0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f22740098a0 tx=0x7f2274009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=448d4fd020b4e2e server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:05:03.716 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:02.850+0000 7f2279ffb700 1 -- 172.21.15.163:0/1009771703 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2274004160 con 0x7f227c1040e0 2023-07-14T18:05:03.717 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:02.850+0000 7f2279ffb700 1 -- 172.21.15.163:0/1009771703 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(25 keys) v1 ==== 1036+0+0 (secure 0 0 0) 0x7f22740042c0 con 0x7f227c1040e0 2023-07-14T18:05:03.717 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:02.850+0000 7f2279ffb700 1 -- 172.21.15.163:0/1009771703 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2274011940 con 0x7f227c1040e0 2023-07-14T18:05:03.717 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:02.850+0000 7f228187b700 1 -- 172.21.15.163:0/1009771703 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f227c1040e0 msgr2=0x7f227c1044f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:05:03.717 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:02.850+0000 7f228187b700 1 --2- 172.21.15.163:0/1009771703 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f227c1040e0 0x7f227c1044f0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f22740098a0 tx=0x7f2274009bb0 comp rx=0 tx=0).stop 2023-07-14T18:05:03.717 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:02.850+0000 7f228187b700 1 -- 172.21.15.163:0/1009771703 shutdown_connections 2023-07-14T18:05:03.717 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:02.850+0000 7f228187b700 1 --2- 172.21.15.163:0/1009771703 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f227c1040e0 0x7f227c1044f0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:05:03.717 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:02.850+0000 7f228187b700 1 -- 172.21.15.163:0/1009771703 >> 172.21.15.163:0/1009771703 conn(0x7f227c0ff750 msgr2=0x7f227c101b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:05:03.718 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:02.850+0000 7f228187b700 1 -- 172.21.15.163:0/1009771703 shutdown_connections 2023-07-14T18:05:03.718 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:02.851+0000 7f228187b700 1 -- 172.21.15.163:0/1009771703 wait complete. 2023-07-14T18:05:03.718 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:02.851+0000 7f228187b700 1 Processor -- start 2023-07-14T18:05:03.718 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:02.851+0000 7f228187b700 1 -- start start 2023-07-14T18:05:03.718 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:02.851+0000 7f228187b700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f227c1040e0 0x7f227c198f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:05:03.718 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:02.851+0000 7f228187b700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f227c199460 con 0x7f227c1040e0 2023-07-14T18:05:03.718 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:02.851+0000 7f227affd700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f227c1040e0 0x7f227c198f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:05:03.718 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:02.851+0000 7f227affd700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f227c1040e0 0x7f227c198f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:54610/0 (socket says 172.21.15.163:54610) 2023-07-14T18:05:03.719 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:02.852+0000 7f227affd700 1 -- 172.21.15.163:0/356210014 learned_addr learned my addr 172.21.15.163:0/356210014 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:05:03.719 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:02.852+0000 7f227affd700 1 -- 172.21.15.163:0/356210014 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2274009550 con 0x7f227c1040e0 2023-07-14T18:05:03.719 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:02.852+0000 7f227affd700 1 --2- 172.21.15.163:0/356210014 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f227c1040e0 0x7f227c198f20 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f2274006af0 tx=0x7f2274011a30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:05:03.719 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:02.852+0000 7f2280879700 1 -- 172.21.15.163:0/356210014 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2274003bf0 con 0x7f227c1040e0 2023-07-14T18:05:03.720 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:02.852+0000 7f2280879700 1 -- 172.21.15.163:0/356210014 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(25 keys) v1 ==== 1036+0+0 (secure 0 0 0) 0x7f227401b8b0 con 0x7f227c1040e0 2023-07-14T18:05:03.720 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:02.852+0000 7f228187b700 1 -- 172.21.15.163:0/356210014 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f227c199660 con 0x7f227c1040e0 2023-07-14T18:05:03.720 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:02.852+0000 7f2280879700 1 -- 172.21.15.163:0/356210014 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2274019880 con 0x7f227c1040e0 2023-07-14T18:05:03.720 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:02.852+0000 7f228187b700 1 -- 172.21.15.163:0/356210014 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f227c199a80 con 0x7f227c1040e0 2023-07-14T18:05:03.720 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:02.853+0000 7f2280879700 1 -- 172.21.15.163:0/356210014 <== mon.0 v2:172.21.15.163:3300/0 4 ==== mgrmap(e 8) v1 ==== 45483+0+0 (secure 0 0 0) 0x7f2274019af0 con 0x7f227c1040e0 2023-07-14T18:05:03.720 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:02.853+0000 7f228187b700 1 -- 172.21.15.163:0/356210014 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f227c068520 con 0x7f227c1040e0 2023-07-14T18:05:03.720 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:02.853+0000 7f2280879700 1 --2- 172.21.15.163:0/356210014 >> [v2:172.21.15.163:6800/1086512093,v1:172.21.15.163:6801/1086512093] conn(0x7f2264038710 0x7f226403abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:05:03.721 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:02.853+0000 7f2280879700 1 -- 172.21.15.163:0/356210014 <== mon.0 v2:172.21.15.163:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f227404ca30 con 0x7f227c1040e0 2023-07-14T18:05:03.721 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:02.853+0000 7f227a7fc700 1 --2- 172.21.15.163:0/356210014 >> [v2:172.21.15.163:6800/1086512093,v1:172.21.15.163:6801/1086512093] conn(0x7f2264038710 0x7f226403abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:05:03.721 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:02.854+0000 7f227a7fc700 1 --2- 172.21.15.163:0/356210014 >> [v2:172.21.15.163:6800/1086512093,v1:172.21.15.163:6801/1086512093] conn(0x7f2264038710 0x7f226403abc0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f2270006fd0 tx=0x7f2270006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:05:03.721 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:02.858+0000 7f2280879700 1 -- 172.21.15.163:0/356210014 <== mon.0 v2:172.21.15.163:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178025 (secure 0 0 0) 0x7f227402bd20 con 0x7f227c1040e0 2023-07-14T18:05:03.721 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:03.063+0000 7f228187b700 1 -- 172.21.15.163:0/356210014 --> [v2:172.21.15.163:6800/1086512093,v1:172.21.15.163:6801/1086512093] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "unmanaged": true, "target": ["mon-mgr", ""]}) v1 -- 0x7f227c101870 con 0x7f2264038710 2023-07-14T18:05:03.721 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:03.068+0000 7f2280879700 1 -- 172.21.15.163:0/356210014 <== mgr.14120 v2:172.21.15.163:6800/1086512093 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+24 (secure 0 0 0) 0x7f227c101870 con 0x7f2264038710 2023-07-14T18:05:03.721 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:03.071+0000 7f228187b700 1 -- 172.21.15.163:0/356210014 >> [v2:172.21.15.163:6800/1086512093,v1:172.21.15.163:6801/1086512093] conn(0x7f2264038710 msgr2=0x7f226403abc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:05:03.721 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:03.071+0000 7f228187b700 1 --2- 172.21.15.163:0/356210014 >> [v2:172.21.15.163:6800/1086512093,v1:172.21.15.163:6801/1086512093] conn(0x7f2264038710 0x7f226403abc0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f2270006fd0 tx=0x7f2270006e40 comp rx=0 tx=0).stop 2023-07-14T18:05:03.722 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:03.071+0000 7f228187b700 1 -- 172.21.15.163:0/356210014 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f227c1040e0 msgr2=0x7f227c198f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:05:03.722 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:03.071+0000 7f228187b700 1 --2- 172.21.15.163:0/356210014 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f227c1040e0 0x7f227c198f20 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f2274006af0 tx=0x7f2274011a30 comp rx=0 tx=0).stop 2023-07-14T18:05:03.722 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:03.071+0000 7f228187b700 1 -- 172.21.15.163:0/356210014 shutdown_connections 2023-07-14T18:05:03.722 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:03.071+0000 7f228187b700 1 --2- 172.21.15.163:0/356210014 >> [v2:172.21.15.163:6800/1086512093,v1:172.21.15.163:6801/1086512093] conn(0x7f2264038710 0x7f226403abc0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:05:03.722 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:03.071+0000 7f228187b700 1 --2- 172.21.15.163:0/356210014 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f227c1040e0 0x7f227c198f20 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:05:03.722 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:03.071+0000 7f228187b700 1 -- 172.21.15.163:0/356210014 >> 172.21.15.163:0/356210014 conn(0x7f227c0ff750 msgr2=0x7f227c0798f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:05:03.722 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:03.071+0000 7f228187b700 1 -- 172.21.15.163:0/356210014 shutdown_connections 2023-07-14T18:05:03.723 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:03.071+0000 7f228187b700 1 -- 172.21.15.163:0/356210014 wait complete. 2023-07-14T18:05:03.723 INFO:teuthology.orchestra.run.smithi163.stdout:Deploying unmanaged mgr service... 2023-07-14T18:05:04.456 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:05:04 smithi163 ceph-mon[96576]: from='client.14142 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2023-07-14T18:05:04.457 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:05:04 smithi163 ceph-mon[96576]: Saving service mon spec with placement count:5 2023-07-14T18:05:04.457 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:05:04 smithi163 ceph-mon[96576]: from='mgr.14120 172.21.15.163:0/1316764358' entity='mgr.x' 2023-07-14T18:05:04.457 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:05:04 smithi163 ceph-mon[96576]: from='mgr.14120 172.21.15.163:0/1316764358' entity='mgr.x' 2023-07-14T18:05:04.861 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stdout Scheduled mgr update... 2023-07-14T18:05:04.861 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:04.174+0000 7f3eb2272700 1 Processor -- start 2023-07-14T18:05:04.862 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:04.174+0000 7f3eb2272700 1 -- start start 2023-07-14T18:05:04.862 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:04.174+0000 7f3eb2272700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f3eac1051f0 0x7f3eac105600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:05:04.862 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:04.174+0000 7f3eb2272700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3eac105b40 con 0x7f3eac1051f0 2023-07-14T18:05:04.862 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:04.174+0000 7f3eabfff700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f3eac1051f0 0x7f3eac105600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:05:04.862 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:04.174+0000 7f3eabfff700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f3eac1051f0 0x7f3eac105600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:54614/0 (socket says 172.21.15.163:54614) 2023-07-14T18:05:04.862 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:04.174+0000 7f3eabfff700 1 -- 172.21.15.163:0/4274741285 learned_addr learned my addr 172.21.15.163:0/4274741285 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:05:04.862 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:04.175+0000 7f3eabfff700 1 -- 172.21.15.163:0/4274741285 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3eac105c80 con 0x7f3eac1051f0 2023-07-14T18:05:04.863 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:04.175+0000 7f3eabfff700 1 --2- 172.21.15.163:0/4274741285 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f3eac1051f0 0x7f3eac105600 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f3e9c0098a0 tx=0x7f3e9c009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb5ee38cd7e24edb server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:05:04.863 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:04.175+0000 7f3eaaffd700 1 -- 172.21.15.163:0/4274741285 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3e9c004160 con 0x7f3eac1051f0 2023-07-14T18:05:04.863 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:04.175+0000 7f3eaaffd700 1 -- 172.21.15.163:0/4274741285 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f3e9c0042c0 con 0x7f3eac1051f0 2023-07-14T18:05:04.863 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:04.175+0000 7f3eaaffd700 1 -- 172.21.15.163:0/4274741285 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3e9c0118e0 con 0x7f3eac1051f0 2023-07-14T18:05:04.863 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:04.175+0000 7f3eb2272700 1 -- 172.21.15.163:0/4274741285 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f3eac1051f0 msgr2=0x7f3eac105600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:05:04.863 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:04.175+0000 7f3eb2272700 1 --2- 172.21.15.163:0/4274741285 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f3eac1051f0 0x7f3eac105600 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f3e9c0098a0 tx=0x7f3e9c009bb0 comp rx=0 tx=0).stop 2023-07-14T18:05:04.863 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:04.176+0000 7f3eb2272700 1 -- 172.21.15.163:0/4274741285 shutdown_connections 2023-07-14T18:05:04.863 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:04.176+0000 7f3eb2272700 1 --2- 172.21.15.163:0/4274741285 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f3eac1051f0 0x7f3eac105600 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:05:04.864 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:04.176+0000 7f3eb2272700 1 -- 172.21.15.163:0/4274741285 >> 172.21.15.163:0/4274741285 conn(0x7f3eac1008c0 msgr2=0x7f3eac102cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:05:04.864 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:04.176+0000 7f3eb2272700 1 -- 172.21.15.163:0/4274741285 shutdown_connections 2023-07-14T18:05:04.864 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:04.176+0000 7f3eb2272700 1 -- 172.21.15.163:0/4274741285 wait complete. 2023-07-14T18:05:04.864 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:04.176+0000 7f3eb2272700 1 Processor -- start 2023-07-14T18:05:04.864 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:04.176+0000 7f3eb2272700 1 -- start start 2023-07-14T18:05:04.864 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:04.177+0000 7f3eb2272700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f3eac1051f0 0x7f3eac199030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:05:04.864 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:04.177+0000 7f3eb2272700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3eac199570 con 0x7f3eac1051f0 2023-07-14T18:05:04.865 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:04.177+0000 7f3eabfff700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f3eac1051f0 0x7f3eac199030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:05:04.865 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:04.177+0000 7f3eabfff700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f3eac1051f0 0x7f3eac199030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:54616/0 (socket says 172.21.15.163:54616) 2023-07-14T18:05:04.865 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:04.177+0000 7f3eabfff700 1 -- 172.21.15.163:0/1998049001 learned_addr learned my addr 172.21.15.163:0/1998049001 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:05:04.865 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:04.177+0000 7f3eabfff700 1 -- 172.21.15.163:0/1998049001 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e9c009550 con 0x7f3eac1051f0 2023-07-14T18:05:04.865 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:04.177+0000 7f3eabfff700 1 --2- 172.21.15.163:0/1998049001 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f3eac1051f0 0x7f3eac199030 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f3e9c006af0 tx=0x7f3e9c011ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:05:04.865 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:04.177+0000 7f3ea97fa700 1 -- 172.21.15.163:0/1998049001 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3e9c0037d0 con 0x7f3eac1051f0 2023-07-14T18:05:04.865 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:04.178+0000 7f3eb2272700 1 -- 172.21.15.163:0/1998049001 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3eac199770 con 0x7f3eac1051f0 2023-07-14T18:05:04.865 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:04.178+0000 7f3ea97fa700 1 -- 172.21.15.163:0/1998049001 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f3e9c01b440 con 0x7f3eac1051f0 2023-07-14T18:05:04.866 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:04.178+0000 7f3ea97fa700 1 -- 172.21.15.163:0/1998049001 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3e9c023400 con 0x7f3eac1051f0 2023-07-14T18:05:04.866 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:04.178+0000 7f3eb2272700 1 -- 172.21.15.163:0/1998049001 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3eac199b90 con 0x7f3eac1051f0 2023-07-14T18:05:04.866 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:04.178+0000 7f3eb2272700 1 -- 172.21.15.163:0/1998049001 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3eac068520 con 0x7f3eac1051f0 2023-07-14T18:05:04.866 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:04.179+0000 7f3ea97fa700 1 -- 172.21.15.163:0/1998049001 <== mon.0 v2:172.21.15.163:3300/0 4 ==== mgrmap(e 8) v1 ==== 45483+0+0 (secure 0 0 0) 0x7f3e9c01b5b0 con 0x7f3eac1051f0 2023-07-14T18:05:04.866 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:04.179+0000 7f3ea97fa700 1 --2- 172.21.15.163:0/1998049001 >> [v2:172.21.15.163:6800/1086512093,v1:172.21.15.163:6801/1086512093] conn(0x7f3e940386c0 0x7f3e9403ab70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:05:04.866 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:04.179+0000 7f3ea97fa700 1 -- 172.21.15.163:0/1998049001 <== mon.0 v2:172.21.15.163:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f3e9c04cb60 con 0x7f3eac1051f0 2023-07-14T18:05:04.866 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:04.179+0000 7f3eab7fe700 1 --2- 172.21.15.163:0/1998049001 >> [v2:172.21.15.163:6800/1086512093,v1:172.21.15.163:6801/1086512093] conn(0x7f3e940386c0 0x7f3e9403ab70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:05:04.866 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:04.180+0000 7f3eab7fe700 1 --2- 172.21.15.163:0/1998049001 >> [v2:172.21.15.163:6800/1086512093,v1:172.21.15.163:6801/1086512093] conn(0x7f3e940386c0 0x7f3e9403ab70 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f3ea0006fd0 tx=0x7f3ea0006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:05:04.867 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:04.183+0000 7f3ea97fa700 1 -- 172.21.15.163:0/1998049001 <== mon.0 v2:172.21.15.163:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178025 (secure 0 0 0) 0x7f3e9c02b950 con 0x7f3eac1051f0 2023-07-14T18:05:04.867 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:04.403+0000 7f3eb2272700 1 -- 172.21.15.163:0/1998049001 --> [v2:172.21.15.163:6800/1086512093,v1:172.21.15.163:6801/1086512093] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mgr", "unmanaged": true, "target": ["mon-mgr", ""]}) v1 -- 0x7f3eac102b90 con 0x7f3e940386c0 2023-07-14T18:05:04.867 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:04.410+0000 7f3ea97fa700 1 -- 172.21.15.163:0/1998049001 <== mgr.14120 v2:172.21.15.163:6800/1086512093 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+24 (secure 0 0 0) 0x7f3eac102b90 con 0x7f3e940386c0 2023-07-14T18:05:04.867 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:04.413+0000 7f3eb2272700 1 -- 172.21.15.163:0/1998049001 >> [v2:172.21.15.163:6800/1086512093,v1:172.21.15.163:6801/1086512093] conn(0x7f3e940386c0 msgr2=0x7f3e9403ab70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:05:04.867 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:04.413+0000 7f3eb2272700 1 --2- 172.21.15.163:0/1998049001 >> [v2:172.21.15.163:6800/1086512093,v1:172.21.15.163:6801/1086512093] conn(0x7f3e940386c0 0x7f3e9403ab70 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f3ea0006fd0 tx=0x7f3ea0006e40 comp rx=0 tx=0).stop 2023-07-14T18:05:04.867 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:04.413+0000 7f3eb2272700 1 -- 172.21.15.163:0/1998049001 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f3eac1051f0 msgr2=0x7f3eac199030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:05:04.867 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:04.413+0000 7f3eb2272700 1 --2- 172.21.15.163:0/1998049001 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f3eac1051f0 0x7f3eac199030 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f3e9c006af0 tx=0x7f3e9c011ed0 comp rx=0 tx=0).stop 2023-07-14T18:05:04.868 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:04.413+0000 7f3eb2272700 1 -- 172.21.15.163:0/1998049001 shutdown_connections 2023-07-14T18:05:04.868 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:04.413+0000 7f3eb2272700 1 --2- 172.21.15.163:0/1998049001 >> [v2:172.21.15.163:6800/1086512093,v1:172.21.15.163:6801/1086512093] conn(0x7f3e940386c0 0x7f3e9403ab70 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:05:04.868 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:04.413+0000 7f3eb2272700 1 --2- 172.21.15.163:0/1998049001 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f3eac1051f0 0x7f3eac199030 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:05:04.868 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:04.413+0000 7f3eb2272700 1 -- 172.21.15.163:0/1998049001 >> 172.21.15.163:0/1998049001 conn(0x7f3eac1008c0 msgr2=0x7f3eac101f70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:05:04.868 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:04.413+0000 7f3eb2272700 1 -- 172.21.15.163:0/1998049001 shutdown_connections 2023-07-14T18:05:04.868 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:04.413+0000 7f3eb2272700 1 -- 172.21.15.163:0/1998049001 wait complete. 2023-07-14T18:05:05.706 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:05:05 smithi163 ceph-mon[96576]: from='mgr.14120 172.21.15.163:0/1316764358' entity='mgr.x' 2023-07-14T18:05:05.707 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:05:05 smithi163 ceph-mon[96576]: from='client.14144 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2023-07-14T18:05:05.707 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:05:05 smithi163 ceph-mon[96576]: Saving service mgr spec with placement count:2 2023-07-14T18:05:05.707 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:05:05 smithi163 ceph-mon[96576]: from='mgr.14120 172.21.15.163:0/1316764358' entity='mgr.x' 2023-07-14T18:05:06.005 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:05.282+0000 7fe5db064700 1 Processor -- start 2023-07-14T18:05:06.005 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:05.282+0000 7fe5db064700 1 -- start start 2023-07-14T18:05:06.005 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:05.282+0000 7fe5db064700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fe5d41051f0 0x7fe5d4105600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:05:06.005 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:05.282+0000 7fe5db064700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5d4105b40 con 0x7fe5d41051f0 2023-07-14T18:05:06.005 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:05.283+0000 7fe5d8e00700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fe5d41051f0 0x7fe5d4105600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:05:06.005 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:05.283+0000 7fe5d8e00700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fe5d41051f0 0x7fe5d4105600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:54620/0 (socket says 172.21.15.163:54620) 2023-07-14T18:05:06.006 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:05.283+0000 7fe5d8e00700 1 -- 172.21.15.163:0/2106068929 learned_addr learned my addr 172.21.15.163:0/2106068929 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:05:06.006 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:05.283+0000 7fe5d8e00700 1 -- 172.21.15.163:0/2106068929 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5d4105c80 con 0x7fe5d41051f0 2023-07-14T18:05:06.006 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:05.283+0000 7fe5d8e00700 1 --2- 172.21.15.163:0/2106068929 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fe5d41051f0 0x7fe5d4105600 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fe5c80098a0 tx=0x7fe5c8009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=11ccb1c86425515e server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:05:06.006 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:05.283+0000 7fe5d37fe700 1 -- 172.21.15.163:0/2106068929 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe5c8004160 con 0x7fe5d41051f0 2023-07-14T18:05:06.006 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:05.283+0000 7fe5d37fe700 1 -- 172.21.15.163:0/2106068929 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fe5c80042c0 con 0x7fe5d41051f0 2023-07-14T18:05:06.006 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:05.283+0000 7fe5d37fe700 1 -- 172.21.15.163:0/2106068929 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe5c80118e0 con 0x7fe5d41051f0 2023-07-14T18:05:06.006 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:05.284+0000 7fe5db064700 1 -- 172.21.15.163:0/2106068929 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fe5d41051f0 msgr2=0x7fe5d4105600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:05:06.006 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:05.284+0000 7fe5db064700 1 --2- 172.21.15.163:0/2106068929 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fe5d41051f0 0x7fe5d4105600 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fe5c80098a0 tx=0x7fe5c8009bb0 comp rx=0 tx=0).stop 2023-07-14T18:05:06.007 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:05.284+0000 7fe5db064700 1 -- 172.21.15.163:0/2106068929 shutdown_connections 2023-07-14T18:05:06.007 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:05.284+0000 7fe5db064700 1 --2- 172.21.15.163:0/2106068929 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fe5d41051f0 0x7fe5d4105600 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:05:06.007 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:05.284+0000 7fe5db064700 1 -- 172.21.15.163:0/2106068929 >> 172.21.15.163:0/2106068929 conn(0x7fe5d41008c0 msgr2=0x7fe5d4102cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:05:06.007 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:05.284+0000 7fe5db064700 1 -- 172.21.15.163:0/2106068929 shutdown_connections 2023-07-14T18:05:06.007 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:05.284+0000 7fe5db064700 1 -- 172.21.15.163:0/2106068929 wait complete. 2023-07-14T18:05:06.007 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:05.285+0000 7fe5db064700 1 Processor -- start 2023-07-14T18:05:06.007 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:05.285+0000 7fe5db064700 1 -- start start 2023-07-14T18:05:06.008 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:05.285+0000 7fe5db064700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fe5d41051f0 0x7fe5d4199080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:05:06.008 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:05.285+0000 7fe5db064700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5d41995c0 con 0x7fe5d41051f0 2023-07-14T18:05:06.008 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:05.285+0000 7fe5d8e00700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fe5d41051f0 0x7fe5d4199080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:05:06.008 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:05.285+0000 7fe5d8e00700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fe5d41051f0 0x7fe5d4199080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:54622/0 (socket says 172.21.15.163:54622) 2023-07-14T18:05:06.008 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:05.285+0000 7fe5d8e00700 1 -- 172.21.15.163:0/2326839437 learned_addr learned my addr 172.21.15.163:0/2326839437 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:05:06.008 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:05.285+0000 7fe5d8e00700 1 -- 172.21.15.163:0/2326839437 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5c8009550 con 0x7fe5d41051f0 2023-07-14T18:05:06.008 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:05.285+0000 7fe5d8e00700 1 --2- 172.21.15.163:0/2326839437 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fe5d41051f0 0x7fe5d4199080 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fe5c80118f0 tx=0x7fe5c80119d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:05:06.008 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:05.286+0000 7fe5d1ffb700 1 -- 172.21.15.163:0/2326839437 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe5c80036a0 con 0x7fe5d41051f0 2023-07-14T18:05:06.009 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:05.286+0000 7fe5d1ffb700 1 -- 172.21.15.163:0/2326839437 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fe5c801b440 con 0x7fe5d41051f0 2023-07-14T18:05:06.009 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:05.286+0000 7fe5d1ffb700 1 -- 172.21.15.163:0/2326839437 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe5c80193f0 con 0x7fe5d41051f0 2023-07-14T18:05:06.009 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:05.286+0000 7fe5db064700 1 -- 172.21.15.163:0/2326839437 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe5d41997c0 con 0x7fe5d41051f0 2023-07-14T18:05:06.009 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:05.286+0000 7fe5db064700 1 -- 172.21.15.163:0/2326839437 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe5d4199be0 con 0x7fe5d41051f0 2023-07-14T18:05:06.009 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:05.287+0000 7fe5d1ffb700 1 -- 172.21.15.163:0/2326839437 <== mon.0 v2:172.21.15.163:3300/0 4 ==== mgrmap(e 8) v1 ==== 45483+0+0 (secure 0 0 0) 0x7fe5c801b5b0 con 0x7fe5d41051f0 2023-07-14T18:05:06.009 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:05.287+0000 7fe5d1ffb700 1 --2- 172.21.15.163:0/2326839437 >> [v2:172.21.15.163:6800/1086512093,v1:172.21.15.163:6801/1086512093] conn(0x7fe5c4038710 0x7fe5c403abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:05:06.009 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:05.287+0000 7fe5d1ffb700 1 -- 172.21.15.163:0/2326839437 <== mon.0 v2:172.21.15.163:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7fe5c804c590 con 0x7fe5d41051f0 2023-07-14T18:05:06.010 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:05.287+0000 7fe5db064700 1 -- 172.21.15.163:0/2326839437 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe5d4068520 con 0x7fe5d41051f0 2023-07-14T18:05:06.010 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:05.287+0000 7fe5d3fff700 1 --2- 172.21.15.163:0/2326839437 >> [v2:172.21.15.163:6800/1086512093,v1:172.21.15.163:6801/1086512093] conn(0x7fe5c4038710 0x7fe5c403abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:05:06.010 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:05.287+0000 7fe5d3fff700 1 --2- 172.21.15.163:0/2326839437 >> [v2:172.21.15.163:6800/1086512093,v1:172.21.15.163:6801/1086512093] conn(0x7fe5c4038710 0x7fe5c403abc0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fe5c0006fd0 tx=0x7fe5c0006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:05:06.010 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:05.291+0000 7fe5d1ffb700 1 -- 172.21.15.163:0/2326839437 <== mon.0 v2:172.21.15.163:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178025 (secure 0 0 0) 0x7fe5c801f020 con 0x7fe5d41051f0 2023-07-14T18:05:06.010 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:05.499+0000 7fe5db064700 1 -- 172.21.15.163:0/2326839437 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/container_init}] v 0) v1 -- 0x7fe5d419abd0 con 0x7fe5d41051f0 2023-07-14T18:05:06.010 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:05.505+0000 7fe5d1ffb700 1 -- 172.21.15.163:0/2326839437 <== mon.0 v2:172.21.15.163:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/container_init}]=0 v7)=0 v7) v1 ==== 142+0+0 (secure 0 0 0) 0x7fe5c8003800 con 0x7fe5d41051f0 2023-07-14T18:05:06.010 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:05.508+0000 7fe5db064700 1 -- 172.21.15.163:0/2326839437 >> [v2:172.21.15.163:6800/1086512093,v1:172.21.15.163:6801/1086512093] conn(0x7fe5c4038710 msgr2=0x7fe5c403abc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:05:06.010 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:05.508+0000 7fe5db064700 1 --2- 172.21.15.163:0/2326839437 >> [v2:172.21.15.163:6800/1086512093,v1:172.21.15.163:6801/1086512093] conn(0x7fe5c4038710 0x7fe5c403abc0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fe5c0006fd0 tx=0x7fe5c0006e40 comp rx=0 tx=0).stop 2023-07-14T18:05:06.011 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:05.508+0000 7fe5db064700 1 -- 172.21.15.163:0/2326839437 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fe5d41051f0 msgr2=0x7fe5d4199080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:05:06.011 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:05.508+0000 7fe5db064700 1 --2- 172.21.15.163:0/2326839437 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fe5d41051f0 0x7fe5d4199080 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fe5c80118f0 tx=0x7fe5c80119d0 comp rx=0 tx=0).stop 2023-07-14T18:05:06.011 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:05.508+0000 7fe5db064700 1 -- 172.21.15.163:0/2326839437 shutdown_connections 2023-07-14T18:05:06.011 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:05.508+0000 7fe5db064700 1 --2- 172.21.15.163:0/2326839437 >> [v2:172.21.15.163:6800/1086512093,v1:172.21.15.163:6801/1086512093] conn(0x7fe5c4038710 0x7fe5c403abc0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:05:06.011 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:05.508+0000 7fe5db064700 1 --2- 172.21.15.163:0/2326839437 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fe5d41051f0 0x7fe5d4199080 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:05:06.011 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:05.508+0000 7fe5db064700 1 -- 172.21.15.163:0/2326839437 >> 172.21.15.163:0/2326839437 conn(0x7fe5d41008c0 msgr2=0x7fe5d4101fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:05:06.011 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:05.508+0000 7fe5db064700 1 -- 172.21.15.163:0/2326839437 shutdown_connections 2023-07-14T18:05:06.011 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:05.508+0000 7fe5db064700 1 -- 172.21.15.163:0/2326839437 wait complete. 2023-07-14T18:05:06.841 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:05:06 smithi163 ceph-mon[96576]: from='client.? 172.21.15.163:0/2326839437' entity='client.admin' 2023-07-14T18:05:06.841 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:05:06 smithi163 ceph-mon[96576]: from='mgr.14120 172.21.15.163:0/1316764358' entity='mgr.x' 2023-07-14T18:05:07.149 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:06.456+0000 7fc7dc3bd700 1 Processor -- start 2023-07-14T18:05:07.149 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:06.456+0000 7fc7dc3bd700 1 -- start start 2023-07-14T18:05:07.149 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:06.457+0000 7fc7dc3bd700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc7d4103850 0x7fc7d4103c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:05:07.149 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:06.457+0000 7fc7dc3bd700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7d41041a0 con 0x7fc7d4103850 2023-07-14T18:05:07.150 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:06.457+0000 7fc7da159700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc7d4103850 0x7fc7d4103c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:05:07.150 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:06.457+0000 7fc7da159700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc7d4103850 0x7fc7d4103c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:54626/0 (socket says 172.21.15.163:54626) 2023-07-14T18:05:07.150 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:06.457+0000 7fc7da159700 1 -- 172.21.15.163:0/3441304657 learned_addr learned my addr 172.21.15.163:0/3441304657 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:05:07.150 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:06.457+0000 7fc7da159700 1 -- 172.21.15.163:0/3441304657 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7d41042e0 con 0x7fc7d4103850 2023-07-14T18:05:07.150 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:06.457+0000 7fc7da159700 1 --2- 172.21.15.163:0/3441304657 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc7d4103850 0x7fc7d4103c60 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fc7c400aa40 tx=0x7fc7c400ad50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=11c0ed5ddb3c0b09 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:05:07.150 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:06.457+0000 7fc7d9157700 1 -- 172.21.15.163:0/3441304657 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc7c4004160 con 0x7fc7d4103850 2023-07-14T18:05:07.150 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:06.458+0000 7fc7d9157700 1 -- 172.21.15.163:0/3441304657 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fc7c400cd80 con 0x7fc7d4103850 2023-07-14T18:05:07.151 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:06.458+0000 7fc7d9157700 1 -- 172.21.15.163:0/3441304657 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc7c4003b70 con 0x7fc7d4103850 2023-07-14T18:05:07.151 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:06.458+0000 7fc7dc3bd700 1 -- 172.21.15.163:0/3441304657 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc7d4103850 msgr2=0x7fc7d4103c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:05:07.151 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:06.458+0000 7fc7dc3bd700 1 --2- 172.21.15.163:0/3441304657 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc7d4103850 0x7fc7d4103c60 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fc7c400aa40 tx=0x7fc7c400ad50 comp rx=0 tx=0).stop 2023-07-14T18:05:07.151 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:06.458+0000 7fc7dc3bd700 1 -- 172.21.15.163:0/3441304657 shutdown_connections 2023-07-14T18:05:07.151 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:06.458+0000 7fc7dc3bd700 1 --2- 172.21.15.163:0/3441304657 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc7d4103850 0x7fc7d4103c60 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:05:07.151 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:06.458+0000 7fc7dc3bd700 1 -- 172.21.15.163:0/3441304657 >> 172.21.15.163:0/3441304657 conn(0x7fc7d40feec0 msgr2=0x7fc7d41012d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:05:07.151 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:06.458+0000 7fc7dc3bd700 1 -- 172.21.15.163:0/3441304657 shutdown_connections 2023-07-14T18:05:07.151 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:06.458+0000 7fc7dc3bd700 1 -- 172.21.15.163:0/3441304657 wait complete. 2023-07-14T18:05:07.152 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:06.459+0000 7fc7dc3bd700 1 Processor -- start 2023-07-14T18:05:07.152 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:06.459+0000 7fc7dc3bd700 1 -- start start 2023-07-14T18:05:07.152 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:06.459+0000 7fc7dc3bd700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc7d4103850 0x7fc7d41969f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:05:07.152 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:06.459+0000 7fc7dc3bd700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7d4198580 con 0x7fc7d4103850 2023-07-14T18:05:07.152 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:06.459+0000 7fc7da159700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc7d4103850 0x7fc7d41969f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:05:07.152 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:06.459+0000 7fc7da159700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc7d4103850 0x7fc7d41969f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:54628/0 (socket says 172.21.15.163:54628) 2023-07-14T18:05:07.152 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:06.459+0000 7fc7da159700 1 -- 172.21.15.163:0/1267276014 learned_addr learned my addr 172.21.15.163:0/1267276014 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:05:07.153 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:06.459+0000 7fc7da159700 1 -- 172.21.15.163:0/1267276014 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7c400a6f0 con 0x7fc7d4103850 2023-07-14T18:05:07.153 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:06.459+0000 7fc7da159700 1 --2- 172.21.15.163:0/1267276014 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc7d4103850 0x7fc7d41969f0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fc7c4004060 tx=0x7fc7c4004140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:05:07.153 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:06.460+0000 7fc7cb7fe700 1 -- 172.21.15.163:0/1267276014 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc7c4020530 con 0x7fc7d4103850 2023-07-14T18:05:07.153 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:06.460+0000 7fc7cb7fe700 1 -- 172.21.15.163:0/1267276014 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fc7c4020b20 con 0x7fc7d4103850 2023-07-14T18:05:07.153 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:06.460+0000 7fc7dc3bd700 1 -- 172.21.15.163:0/1267276014 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc7d4198780 con 0x7fc7d4103850 2023-07-14T18:05:07.153 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:06.460+0000 7fc7cb7fe700 1 -- 172.21.15.163:0/1267276014 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc7c4010a30 con 0x7fc7d4103850 2023-07-14T18:05:07.153 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:06.460+0000 7fc7dc3bd700 1 -- 172.21.15.163:0/1267276014 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc7d4197100 con 0x7fc7d4103850 2023-07-14T18:05:07.153 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:06.460+0000 7fc7cb7fe700 1 -- 172.21.15.163:0/1267276014 <== mon.0 v2:172.21.15.163:3300/0 4 ==== mgrmap(e 8) v1 ==== 45483+0+0 (secure 0 0 0) 0x7fc7c4010cb0 con 0x7fc7d4103850 2023-07-14T18:05:07.154 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:06.461+0000 7fc7cb7fe700 1 --2- 172.21.15.163:0/1267276014 >> [v2:172.21.15.163:6800/1086512093,v1:172.21.15.163:6801/1086512093] conn(0x7fc7c00386c0 0x7fc7c003ab70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:05:07.154 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:06.461+0000 7fc7cb7fe700 1 -- 172.21.15.163:0/1267276014 <== mon.0 v2:172.21.15.163:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7fc7c404c6e0 con 0x7fc7d4103850 2023-07-14T18:05:07.154 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:06.461+0000 7fc7dc3bd700 1 -- 172.21.15.163:0/1267276014 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc7d4190430 con 0x7fc7d4103850 2023-07-14T18:05:07.154 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:06.461+0000 7fc7d9958700 1 --2- 172.21.15.163:0/1267276014 >> [v2:172.21.15.163:6800/1086512093,v1:172.21.15.163:6801/1086512093] conn(0x7fc7c00386c0 0x7fc7c003ab70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:05:07.154 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:06.461+0000 7fc7d9958700 1 --2- 172.21.15.163:0/1267276014 >> [v2:172.21.15.163:6800/1086512093,v1:172.21.15.163:6801/1086512093] conn(0x7fc7c00386c0 0x7fc7c003ab70 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fc7d0006fd0 tx=0x7fc7d0006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:05:07.154 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:06.466+0000 7fc7cb7fe700 1 -- 172.21.15.163:0/1267276014 <== mon.0 v2:172.21.15.163:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178025 (secure 0 0 0) 0x7fc7c4025070 con 0x7fc7d4103850 2023-07-14T18:05:07.154 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:06.657+0000 7fc7dc3bd700 1 -- 172.21.15.163:0/1267276014 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command([{prefix=config set, name=mgr/dashboard/ssl_server_port}] v 0) v1 -- 0x7fc7d4061c70 con 0x7fc7d4103850 2023-07-14T18:05:07.155 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:06.663+0000 7fc7cb7fe700 1 -- 172.21.15.163:0/1267276014 <== mon.0 v2:172.21.15.163:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/dashboard/ssl_server_port}]=0 v8)=0 v8) v1 ==== 130+0+0 (secure 0 0 0) 0x7fc7c4028360 con 0x7fc7d4103850 2023-07-14T18:05:07.155 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:06.666+0000 7fc7dc3bd700 1 -- 172.21.15.163:0/1267276014 >> [v2:172.21.15.163:6800/1086512093,v1:172.21.15.163:6801/1086512093] conn(0x7fc7c00386c0 msgr2=0x7fc7c003ab70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:05:07.155 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:06.666+0000 7fc7dc3bd700 1 --2- 172.21.15.163:0/1267276014 >> [v2:172.21.15.163:6800/1086512093,v1:172.21.15.163:6801/1086512093] conn(0x7fc7c00386c0 0x7fc7c003ab70 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fc7d0006fd0 tx=0x7fc7d0006e40 comp rx=0 tx=0).stop 2023-07-14T18:05:07.155 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:06.666+0000 7fc7dc3bd700 1 -- 172.21.15.163:0/1267276014 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc7d4103850 msgr2=0x7fc7d41969f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:05:07.155 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:06.666+0000 7fc7dc3bd700 1 --2- 172.21.15.163:0/1267276014 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc7d4103850 0x7fc7d41969f0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fc7c4004060 tx=0x7fc7c4004140 comp rx=0 tx=0).stop 2023-07-14T18:05:07.155 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:06.666+0000 7fc7dc3bd700 1 -- 172.21.15.163:0/1267276014 shutdown_connections 2023-07-14T18:05:07.155 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:06.666+0000 7fc7dc3bd700 1 --2- 172.21.15.163:0/1267276014 >> [v2:172.21.15.163:6800/1086512093,v1:172.21.15.163:6801/1086512093] conn(0x7fc7c00386c0 0x7fc7c003ab70 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:05:07.155 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:06.666+0000 7fc7dc3bd700 1 --2- 172.21.15.163:0/1267276014 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc7d4103850 0x7fc7d41969f0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:05:07.156 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:06.666+0000 7fc7dc3bd700 1 -- 172.21.15.163:0/1267276014 >> 172.21.15.163:0/1267276014 conn(0x7fc7d40feec0 msgr2=0x7fc7d418b2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:05:07.156 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:06.666+0000 7fc7dc3bd700 1 -- 172.21.15.163:0/1267276014 shutdown_connections 2023-07-14T18:05:07.156 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:06.666+0000 7fc7dc3bd700 1 -- 172.21.15.163:0/1267276014 wait complete. 2023-07-14T18:05:07.156 INFO:teuthology.orchestra.run.smithi163.stdout:Enabling the dashboard module... 2023-07-14T18:05:07.956 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:05:07 smithi163 ceph-mon[96576]: from='client.? 172.21.15.163:0/1267276014' entity='client.admin' 2023-07-14T18:05:07.957 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:05:07 smithi163 ceph-mon[96576]: from='mgr.14120 172.21.15.163:0/1316764358' entity='mgr.x' 2023-07-14T18:05:08.957 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:05:08 smithi163 ceph-mon[96576]: from='client.? 172.21.15.163:0/1732561951' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "dashboard"}]: dispatch 2023-07-14T18:05:08.957 INFO:journalctl@ceph.mgr.x.smithi163.stdout:Jul 14 18:05:08 smithi163 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-mgr-x[96818]: ignoring --setuser ceph since I am not root 2023-07-14T18:05:08.957 INFO:journalctl@ceph.mgr.x.smithi163.stdout:Jul 14 18:05:08 smithi163 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-mgr-x[96818]: ignoring --setgroup ceph since I am not root 2023-07-14T18:05:08.957 INFO:journalctl@ceph.mgr.x.smithi163.stdout:Jul 14 18:05:08 smithi163 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-mgr-x[96818]: 2023-07-14T18:05:08.849+0000 7fdfc6157200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-07-14T18:05:09.094 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:07.568+0000 7f3baaf21700 1 Processor -- start 2023-07-14T18:05:09.094 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:07.568+0000 7f3baaf21700 1 -- start start 2023-07-14T18:05:09.094 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:07.569+0000 7f3baaf21700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f3ba41045d0 0x7f3ba41049e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:05:09.094 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:07.569+0000 7f3baaf21700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ba4104f20 con 0x7f3ba41045d0 2023-07-14T18:05:09.095 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:07.569+0000 7f3ba8cbd700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f3ba41045d0 0x7f3ba41049e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:05:09.095 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:07.569+0000 7f3ba8cbd700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f3ba41045d0 0x7f3ba41049e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:54632/0 (socket says 172.21.15.163:54632) 2023-07-14T18:05:09.095 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:07.569+0000 7f3ba8cbd700 1 -- 172.21.15.163:0/2864572827 learned_addr learned my addr 172.21.15.163:0/2864572827 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:05:09.095 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:07.569+0000 7f3ba8cbd700 1 -- 172.21.15.163:0/2864572827 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ba4105060 con 0x7f3ba41045d0 2023-07-14T18:05:09.095 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:07.569+0000 7f3ba8cbd700 1 --2- 172.21.15.163:0/2864572827 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f3ba41045d0 0x7f3ba41049e0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f3b980098a0 tx=0x7f3b98009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f6f7397865e315cb server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:05:09.095 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:07.569+0000 7f3ba37fe700 1 -- 172.21.15.163:0/2864572827 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3b98004160 con 0x7f3ba41045d0 2023-07-14T18:05:09.095 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:07.570+0000 7f3ba37fe700 1 -- 172.21.15.163:0/2864572827 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f3b980042c0 con 0x7f3ba41045d0 2023-07-14T18:05:09.096 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:07.570+0000 7f3ba37fe700 1 -- 172.21.15.163:0/2864572827 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3b980118e0 con 0x7f3ba41045d0 2023-07-14T18:05:09.096 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:07.570+0000 7f3baaf21700 1 -- 172.21.15.163:0/2864572827 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f3ba41045d0 msgr2=0x7f3ba41049e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:05:09.096 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:07.570+0000 7f3baaf21700 1 --2- 172.21.15.163:0/2864572827 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f3ba41045d0 0x7f3ba41049e0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f3b980098a0 tx=0x7f3b98009bb0 comp rx=0 tx=0).stop 2023-07-14T18:05:09.096 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:07.570+0000 7f3baaf21700 1 -- 172.21.15.163:0/2864572827 shutdown_connections 2023-07-14T18:05:09.096 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:07.570+0000 7f3baaf21700 1 --2- 172.21.15.163:0/2864572827 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f3ba41045d0 0x7f3ba41049e0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:05:09.096 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:07.570+0000 7f3baaf21700 1 -- 172.21.15.163:0/2864572827 >> 172.21.15.163:0/2864572827 conn(0x7f3ba40feec0 msgr2=0x7f3ba41012d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:05:09.096 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:07.570+0000 7f3baaf21700 1 -- 172.21.15.163:0/2864572827 shutdown_connections 2023-07-14T18:05:09.096 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:07.570+0000 7f3baaf21700 1 -- 172.21.15.163:0/2864572827 wait complete. 2023-07-14T18:05:09.097 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:07.571+0000 7f3baaf21700 1 Processor -- start 2023-07-14T18:05:09.097 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:07.571+0000 7f3baaf21700 1 -- start start 2023-07-14T18:05:09.097 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:07.571+0000 7f3baaf21700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f3ba41045d0 0x7f3ba418d870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:05:09.097 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:07.571+0000 7f3baaf21700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ba418f400 con 0x7f3ba41045d0 2023-07-14T18:05:09.097 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:07.571+0000 7f3ba8cbd700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f3ba41045d0 0x7f3ba418d870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:05:09.097 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:07.571+0000 7f3ba8cbd700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f3ba41045d0 0x7f3ba418d870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:54634/0 (socket says 172.21.15.163:54634) 2023-07-14T18:05:09.097 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:07.571+0000 7f3ba8cbd700 1 -- 172.21.15.163:0/1732561951 learned_addr learned my addr 172.21.15.163:0/1732561951 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:05:09.098 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:07.571+0000 7f3ba8cbd700 1 -- 172.21.15.163:0/1732561951 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b98009550 con 0x7f3ba41045d0 2023-07-14T18:05:09.098 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:07.571+0000 7f3ba8cbd700 1 --2- 172.21.15.163:0/1732561951 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f3ba41045d0 0x7f3ba418d870 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f3b98006af0 tx=0x7f3b98011e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:05:09.098 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:07.572+0000 7f3ba1ffb700 1 -- 172.21.15.163:0/1732561951 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3b980037d0 con 0x7f3ba41045d0 2023-07-14T18:05:09.098 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:07.572+0000 7f3ba1ffb700 1 -- 172.21.15.163:0/1732561951 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f3b9801b440 con 0x7f3ba41045d0 2023-07-14T18:05:09.098 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:07.572+0000 7f3baaf21700 1 -- 172.21.15.163:0/1732561951 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ba418f600 con 0x7f3ba41045d0 2023-07-14T18:05:09.098 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:07.572+0000 7f3ba1ffb700 1 -- 172.21.15.163:0/1732561951 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3b98019560 con 0x7f3ba41045d0 2023-07-14T18:05:09.098 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:07.572+0000 7f3baaf21700 1 -- 172.21.15.163:0/1732561951 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ba418df80 con 0x7f3ba41045d0 2023-07-14T18:05:09.098 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:07.573+0000 7f3ba1ffb700 1 -- 172.21.15.163:0/1732561951 <== mon.0 v2:172.21.15.163:3300/0 4 ==== mgrmap(e 8) v1 ==== 45483+0+0 (secure 0 0 0) 0x7f3b98003930 con 0x7f3ba41045d0 2023-07-14T18:05:09.099 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:07.573+0000 7f3ba1ffb700 1 --2- 172.21.15.163:0/1732561951 >> [v2:172.21.15.163:6800/1086512093,v1:172.21.15.163:6801/1086512093] conn(0x7f3b940386c0 0x7f3b9403ab70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:05:09.099 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:07.573+0000 7f3ba1ffb700 1 -- 172.21.15.163:0/1732561951 <== mon.0 v2:172.21.15.163:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f3b9804c560 con 0x7f3ba41045d0 2023-07-14T18:05:09.099 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:07.573+0000 7f3baaf21700 1 -- 172.21.15.163:0/1732561951 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3ba4061c70 con 0x7f3ba41045d0 2023-07-14T18:05:09.099 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:07.573+0000 7f3ba3fff700 1 --2- 172.21.15.163:0/1732561951 >> [v2:172.21.15.163:6800/1086512093,v1:172.21.15.163:6801/1086512093] conn(0x7f3b940386c0 0x7f3b9403ab70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:05:09.099 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:07.573+0000 7f3ba3fff700 1 --2- 172.21.15.163:0/1732561951 >> [v2:172.21.15.163:6800/1086512093,v1:172.21.15.163:6801/1086512093] conn(0x7f3b940386c0 0x7f3b9403ab70 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f3b90006fd0 tx=0x7f3b90006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:05:09.099 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:07.577+0000 7f3ba1ffb700 1 -- 172.21.15.163:0/1732561951 <== mon.0 v2:172.21.15.163:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178025 (secure 0 0 0) 0x7f3b9801b820 con 0x7f3ba41045d0 2023-07-14T18:05:09.099 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:07.826+0000 7f3baaf21700 1 -- 172.21.15.163:0/1732561951 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "dashboard"} v 0) v1 -- 0x7f3ba418e6b0 con 0x7f3ba41045d0 2023-07-14T18:05:09.099 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:08.673+0000 7f3ba1ffb700 1 -- 172.21.15.163:0/1732561951 <== mon.0 v2:172.21.15.163:3300/0 7 ==== mgrmap(e 9) v1 ==== 45496+0+0 (secure 0 0 0) 0x7f3b98019820 con 0x7f3ba41045d0 2023-07-14T18:05:09.100 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:08.674+0000 7f3ba1ffb700 1 -- 172.21.15.163:0/1732561951 <== mon.0 v2:172.21.15.163:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "dashboard"}]=0 v9) v1 ==== 88+0+0 (secure 0 0 0) 0x7f3b9802bd20 con 0x7f3ba41045d0 2023-07-14T18:05:09.100 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:08.677+0000 7f3baaf21700 1 -- 172.21.15.163:0/1732561951 >> [v2:172.21.15.163:6800/1086512093,v1:172.21.15.163:6801/1086512093] conn(0x7f3b940386c0 msgr2=0x7f3b9403ab70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:05:09.100 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:08.677+0000 7f3baaf21700 1 --2- 172.21.15.163:0/1732561951 >> [v2:172.21.15.163:6800/1086512093,v1:172.21.15.163:6801/1086512093] conn(0x7f3b940386c0 0x7f3b9403ab70 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f3b90006fd0 tx=0x7f3b90006e40 comp rx=0 tx=0).stop 2023-07-14T18:05:09.100 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:08.677+0000 7f3baaf21700 1 -- 172.21.15.163:0/1732561951 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f3ba41045d0 msgr2=0x7f3ba418d870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:05:09.100 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:08.677+0000 7f3baaf21700 1 --2- 172.21.15.163:0/1732561951 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f3ba41045d0 0x7f3ba418d870 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f3b98006af0 tx=0x7f3b98011e80 comp rx=0 tx=0).stop 2023-07-14T18:05:09.100 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:08.677+0000 7f3baaf21700 1 -- 172.21.15.163:0/1732561951 shutdown_connections 2023-07-14T18:05:09.100 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:08.677+0000 7f3baaf21700 1 --2- 172.21.15.163:0/1732561951 >> [v2:172.21.15.163:6800/1086512093,v1:172.21.15.163:6801/1086512093] conn(0x7f3b940386c0 0x7f3b9403ab70 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:05:09.101 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:08.677+0000 7f3baaf21700 1 --2- 172.21.15.163:0/1732561951 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f3ba41045d0 0x7f3ba418d870 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:05:09.101 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:08.677+0000 7f3baaf21700 1 -- 172.21.15.163:0/1732561951 >> 172.21.15.163:0/1732561951 conn(0x7f3ba40feec0 msgr2=0x7f3ba4103ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:05:09.101 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:08.677+0000 7f3baaf21700 1 -- 172.21.15.163:0/1732561951 shutdown_connections 2023-07-14T18:05:09.101 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:08.677+0000 7f3baaf21700 1 -- 172.21.15.163:0/1732561951 wait complete. 2023-07-14T18:05:09.305 INFO:journalctl@ceph.mgr.x.smithi163.stdout:Jul 14 18:05:08 smithi163 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-mgr-x[96818]: 2023-07-14T18:05:08.930+0000 7fdfc6157200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-07-14T18:05:09.305 INFO:journalctl@ceph.mgr.x.smithi163.stdout:Jul 14 18:05:09 smithi163 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-mgr-x[96818]: 2023-07-14T18:05:09.020+0000 7fdfc6157200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-07-14T18:05:09.305 INFO:journalctl@ceph.mgr.x.smithi163.stdout:Jul 14 18:05:09 smithi163 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-mgr-x[96818]: 2023-07-14T18:05:09.125+0000 7fdfc6157200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-07-14T18:05:09.664 INFO:journalctl@ceph.mgr.x.smithi163.stdout:Jul 14 18:05:09 smithi163 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-mgr-x[96818]: 2023-07-14T18:05:09.303+0000 7fdfc6157200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-07-14T18:05:09.664 INFO:journalctl@ceph.mgr.x.smithi163.stdout:Jul 14 18:05:09 smithi163 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-mgr-x[96818]: 2023-07-14T18:05:09.632+0000 7fdfc6157200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-07-14T18:05:09.957 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:05:09 smithi163 ceph-mon[96576]: from='client.? 172.21.15.163:0/1732561951' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "dashboard"}]': finished 2023-07-14T18:05:09.957 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:05:09 smithi163 ceph-mon[96576]: mgrmap e9: x(active, since 15s) 2023-07-14T18:05:09.957 INFO:journalctl@ceph.mgr.x.smithi163.stdout:Jul 14 18:05:09 smithi163 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-mgr-x[96818]: 2023-07-14T18:05:09.724+0000 7fdfc6157200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-07-14T18:05:09.957 INFO:journalctl@ceph.mgr.x.smithi163.stdout:Jul 14 18:05:09 smithi163 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-mgr-x[96818]: 2023-07-14T18:05:09.859+0000 7fdfc6157200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-07-14T18:05:10.244 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stdout { 2023-07-14T18:05:10.246 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stdout "epoch": 9, 2023-07-14T18:05:10.246 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stdout "available": true, 2023-07-14T18:05:10.246 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stdout "active_name": "x", 2023-07-14T18:05:10.246 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stdout "num_standby": 0 2023-07-14T18:05:10.247 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stdout } 2023-07-14T18:05:10.247 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:09.548+0000 7fb14332b700 1 Processor -- start 2023-07-14T18:05:10.247 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:09.549+0000 7fb14332b700 1 -- start start 2023-07-14T18:05:10.247 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:09.549+0000 7fb14332b700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fb13c105cf0 0x7fb13c1080d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:05:10.247 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:09.549+0000 7fb14332b700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb13c079d50 con 0x7fb13c105cf0 2023-07-14T18:05:10.247 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:09.549+0000 7fb1410c7700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fb13c105cf0 0x7fb13c1080d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:05:10.247 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:09.549+0000 7fb1410c7700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fb13c105cf0 0x7fb13c1080d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:54648/0 (socket says 172.21.15.163:54648) 2023-07-14T18:05:10.248 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:09.549+0000 7fb1410c7700 1 -- 172.21.15.163:0/3550411342 learned_addr learned my addr 172.21.15.163:0/3550411342 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:05:10.248 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:09.549+0000 7fb1410c7700 1 -- 172.21.15.163:0/3550411342 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb13c079e90 con 0x7fb13c105cf0 2023-07-14T18:05:10.248 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:09.549+0000 7fb1410c7700 1 --2- 172.21.15.163:0/3550411342 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fb13c105cf0 0x7fb13c1080d0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fb1380098a0 tx=0x7fb138009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=382078dc573c821c server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:05:10.248 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:09.550+0000 7fb133fff700 1 -- 172.21.15.163:0/3550411342 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb138004160 con 0x7fb13c105cf0 2023-07-14T18:05:10.248 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:09.550+0000 7fb133fff700 1 -- 172.21.15.163:0/3550411342 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fb1380042c0 con 0x7fb13c105cf0 2023-07-14T18:05:10.248 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:09.550+0000 7fb133fff700 1 -- 172.21.15.163:0/3550411342 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb1380118e0 con 0x7fb13c105cf0 2023-07-14T18:05:10.248 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:09.550+0000 7fb14332b700 1 -- 172.21.15.163:0/3550411342 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fb13c105cf0 msgr2=0x7fb13c1080d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:05:10.248 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:09.550+0000 7fb14332b700 1 --2- 172.21.15.163:0/3550411342 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fb13c105cf0 0x7fb13c1080d0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fb1380098a0 tx=0x7fb138009bb0 comp rx=0 tx=0).stop 2023-07-14T18:05:10.249 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:09.550+0000 7fb14332b700 1 -- 172.21.15.163:0/3550411342 shutdown_connections 2023-07-14T18:05:10.249 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:09.550+0000 7fb14332b700 1 --2- 172.21.15.163:0/3550411342 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fb13c105cf0 0x7fb13c1080d0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:05:10.249 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:09.550+0000 7fb14332b700 1 -- 172.21.15.163:0/3550411342 >> 172.21.15.163:0/3550411342 conn(0x7fb13c0ff770 msgr2=0x7fb13c101b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:05:10.249 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:09.550+0000 7fb14332b700 1 -- 172.21.15.163:0/3550411342 shutdown_connections 2023-07-14T18:05:10.249 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:09.550+0000 7fb14332b700 1 -- 172.21.15.163:0/3550411342 wait complete. 2023-07-14T18:05:10.252 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:09.551+0000 7fb14332b700 1 Processor -- start 2023-07-14T18:05:10.252 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:09.551+0000 7fb14332b700 1 -- start start 2023-07-14T18:05:10.252 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:09.551+0000 7fb14332b700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fb13c105cf0 0x7fb13c199030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:05:10.252 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:09.552+0000 7fb14332b700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb13c199570 con 0x7fb13c105cf0 2023-07-14T18:05:10.252 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:09.552+0000 7fb1410c7700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fb13c105cf0 0x7fb13c199030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:05:10.253 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:09.552+0000 7fb1410c7700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fb13c105cf0 0x7fb13c199030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:54650/0 (socket says 172.21.15.163:54650) 2023-07-14T18:05:10.253 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:09.552+0000 7fb1410c7700 1 -- 172.21.15.163:0/3618835865 learned_addr learned my addr 172.21.15.163:0/3618835865 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:05:10.253 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:09.552+0000 7fb1410c7700 1 -- 172.21.15.163:0/3618835865 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb138009550 con 0x7fb13c105cf0 2023-07-14T18:05:10.253 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:09.552+0000 7fb1410c7700 1 --2- 172.21.15.163:0/3618835865 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fb13c105cf0 0x7fb13c199030 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fb138006af0 tx=0x7fb138011e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:05:10.253 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:09.552+0000 7fb1327fc700 1 -- 172.21.15.163:0/3618835865 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb1380037d0 con 0x7fb13c105cf0 2023-07-14T18:05:10.253 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:09.552+0000 7fb1327fc700 1 -- 172.21.15.163:0/3618835865 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fb13801b440 con 0x7fb13c105cf0 2023-07-14T18:05:10.253 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:09.552+0000 7fb14332b700 1 -- 172.21.15.163:0/3618835865 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb13c199770 con 0x7fb13c105cf0 2023-07-14T18:05:10.253 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:09.552+0000 7fb14332b700 1 -- 172.21.15.163:0/3618835865 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb13c199b90 con 0x7fb13c105cf0 2023-07-14T18:05:10.254 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:09.552+0000 7fb1327fc700 1 -- 172.21.15.163:0/3618835865 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb138019560 con 0x7fb13c105cf0 2023-07-14T18:05:10.254 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:09.553+0000 7fb1327fc700 1 -- 172.21.15.163:0/3618835865 <== mon.0 v2:172.21.15.163:3300/0 4 ==== mgrmap(e 9) v1 ==== 45496+0+0 (secure 0 0 0) 0x7fb138019820 con 0x7fb13c105cf0 2023-07-14T18:05:10.254 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:09.553+0000 7fb1327fc700 1 --2- 172.21.15.163:0/3618835865 >> [v2:172.21.15.163:6800/1086512093,v1:172.21.15.163:6801/1086512093] conn(0x7fb128038710 0x7fb12803abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:05:10.254 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:09.553+0000 7fb1327fc700 1 -- 172.21.15.163:0/3618835865 <== mon.0 v2:172.21.15.163:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7fb13804c580 con 0x7fb13c105cf0 2023-07-14T18:05:10.254 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:09.553+0000 7fb1408c6700 1 -- 172.21.15.163:0/3618835865 >> [v2:172.21.15.163:6800/1086512093,v1:172.21.15.163:6801/1086512093] conn(0x7fb128038710 msgr2=0x7fb12803abc0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.163:6800/1086512093 2023-07-14T18:05:10.254 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:09.553+0000 7fb1408c6700 1 --2- 172.21.15.163:0/3618835865 >> [v2:172.21.15.163:6800/1086512093,v1:172.21.15.163:6801/1086512093] conn(0x7fb128038710 0x7fb12803abc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-14T18:05:10.254 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:09.553+0000 7fb14332b700 1 -- 172.21.15.163:0/3618835865 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb120005320 con 0x7fb13c105cf0 2023-07-14T18:05:10.255 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:09.558+0000 7fb1327fc700 1 -- 172.21.15.163:0/3618835865 <== mon.0 v2:172.21.15.163:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178025 (secure 0 0 0) 0x7fb1380189a0 con 0x7fb13c105cf0 2023-07-14T18:05:10.255 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:09.754+0000 7fb1408c6700 1 -- 172.21.15.163:0/3618835865 >> [v2:172.21.15.163:6800/1086512093,v1:172.21.15.163:6801/1086512093] conn(0x7fb128038710 msgr2=0x7fb12803abc0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.163:6800/1086512093 2023-07-14T18:05:10.255 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:09.754+0000 7fb1408c6700 1 --2- 172.21.15.163:0/3618835865 >> [v2:172.21.15.163:6800/1086512093,v1:172.21.15.163:6801/1086512093] conn(0x7fb128038710 0x7fb12803abc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-07-14T18:05:10.255 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:09.815+0000 7fb14332b700 1 -- 172.21.15.163:0/3618835865 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) v1 -- 0x7fb120006200 con 0x7fb13c105cf0 2023-07-14T18:05:10.255 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:09.815+0000 7fb1327fc700 1 -- 172.21.15.163:0/3618835865 <== mon.0 v2:172.21.15.163:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v9) v1 ==== 56+0+88 (secure 0 0 0) 0x7fb138018350 con 0x7fb13c105cf0 2023-07-14T18:05:10.255 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:09.817+0000 7fb14332b700 1 -- 172.21.15.163:0/3618835865 >> [v2:172.21.15.163:6800/1086512093,v1:172.21.15.163:6801/1086512093] conn(0x7fb128038710 msgr2=0x7fb12803abc0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-14T18:05:10.255 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:09.817+0000 7fb14332b700 1 --2- 172.21.15.163:0/3618835865 >> [v2:172.21.15.163:6800/1086512093,v1:172.21.15.163:6801/1086512093] conn(0x7fb128038710 0x7fb12803abc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:05:10.255 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:09.817+0000 7fb14332b700 1 -- 172.21.15.163:0/3618835865 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fb13c105cf0 msgr2=0x7fb13c199030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:05:10.256 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:09.817+0000 7fb14332b700 1 --2- 172.21.15.163:0/3618835865 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fb13c105cf0 0x7fb13c199030 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fb138006af0 tx=0x7fb138011e80 comp rx=0 tx=0).stop 2023-07-14T18:05:10.256 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:09.817+0000 7fb14332b700 1 -- 172.21.15.163:0/3618835865 shutdown_connections 2023-07-14T18:05:10.256 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:09.817+0000 7fb14332b700 1 --2- 172.21.15.163:0/3618835865 >> [v2:172.21.15.163:6800/1086512093,v1:172.21.15.163:6801/1086512093] conn(0x7fb128038710 0x7fb12803abc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:05:10.256 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:09.817+0000 7fb14332b700 1 --2- 172.21.15.163:0/3618835865 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fb13c105cf0 0x7fb13c199030 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:05:10.256 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:09.817+0000 7fb14332b700 1 -- 172.21.15.163:0/3618835865 >> 172.21.15.163:0/3618835865 conn(0x7fb13c0ff770 msgr2=0x7fb13c100e20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:05:10.256 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:09.817+0000 7fb14332b700 1 -- 172.21.15.163:0/3618835865 shutdown_connections 2023-07-14T18:05:10.256 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:09.817+0000 7fb14332b700 1 -- 172.21.15.163:0/3618835865 wait complete. 2023-07-14T18:05:10.257 INFO:teuthology.orchestra.run.smithi163.stdout:Waiting for the mgr to restart... 2023-07-14T18:05:10.257 INFO:teuthology.orchestra.run.smithi163.stdout:Waiting for mgr epoch 9... 2023-07-14T18:05:10.257 INFO:journalctl@ceph.mgr.x.smithi163.stdout:Jul 14 18:05:09 smithi163 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-mgr-x[96818]: 2023-07-14T18:05:09.960+0000 7fdfc6157200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-07-14T18:05:10.510 INFO:journalctl@ceph.mgr.x.smithi163.stdout:Jul 14 18:05:10 smithi163 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-mgr-x[96818]: 2023-07-14T18:05:10.405+0000 7fdfc6157200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-07-14T18:05:10.957 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:05:10 smithi163 ceph-mon[96576]: from='client.? 172.21.15.163:0/3618835865' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2023-07-14T18:05:11.457 INFO:journalctl@ceph.mgr.x.smithi163.stdout:Jul 14 18:05:10 smithi163 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-mgr-x[96818]: 2023-07-14T18:05:10.988+0000 7fdfc6157200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-07-14T18:05:11.457 INFO:journalctl@ceph.mgr.x.smithi163.stdout:Jul 14 18:05:11 smithi163 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-mgr-x[96818]: 2023-07-14T18:05:11.158+0000 7fdfc6157200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-07-14T18:05:12.206 INFO:journalctl@ceph.mgr.x.smithi163.stdout:Jul 14 18:05:11 smithi163 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-mgr-x[96818]: 2023-07-14T18:05:11.920+0000 7fdfc6157200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-07-14T18:05:12.207 INFO:journalctl@ceph.mgr.x.smithi163.stdout:Jul 14 18:05:12 smithi163 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-mgr-x[96818]: 2023-07-14T18:05:12.011+0000 7fdfc6157200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-07-14T18:05:12.487 INFO:journalctl@ceph.mgr.x.smithi163.stdout:Jul 14 18:05:12 smithi163 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-mgr-x[96818]: 2023-07-14T18:05:12.181+0000 7fdfc6157200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-07-14T18:05:12.861 INFO:journalctl@ceph.mgr.x.smithi163.stdout:Jul 14 18:05:12 smithi163 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-mgr-x[96818]: 2023-07-14T18:05:12.456+0000 7fdfc6157200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-07-14T18:05:12.861 INFO:journalctl@ceph.mgr.x.smithi163.stdout:Jul 14 18:05:12 smithi163 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-mgr-x[96818]: 2023-07-14T18:05:12.682+0000 7fdfc6157200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-07-14T18:05:13.120 INFO:journalctl@ceph.mgr.x.smithi163.stdout:Jul 14 18:05:12 smithi163 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-mgr-x[96818]: 2023-07-14T18:05:12.830+0000 7fdfc6157200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-07-14T18:05:13.456 INFO:journalctl@ceph.mgr.x.smithi163.stdout:Jul 14 18:05:13 smithi163 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-mgr-x[96818]: 2023-07-14T18:05:13.090+0000 7fdfc6157200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-07-14T18:05:14.144 INFO:journalctl@ceph.mgr.x.smithi163.stdout:Jul 14 18:05:13 smithi163 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-mgr-x[96818]: 2023-07-14T18:05:13.790+0000 7fdfc6157200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-07-14T18:05:14.145 INFO:journalctl@ceph.mgr.x.smithi163.stdout:Jul 14 18:05:13 smithi163 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-mgr-x[96818]: 2023-07-14T18:05:13.920+0000 7fdfc6157200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-07-14T18:05:14.456 INFO:journalctl@ceph.mgr.x.smithi163.stdout:Jul 14 18:05:14 smithi163 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-mgr-x[96818]: 2023-07-14T18:05:14.114+0000 7fdfc6157200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-07-14T18:05:14.457 INFO:journalctl@ceph.mgr.x.smithi163.stdout:Jul 14 18:05:14 smithi163 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-mgr-x[96818]: 2023-07-14T18:05:14.228+0000 7fdfc6157200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-07-14T18:05:14.957 INFO:journalctl@ceph.mgr.x.smithi163.stdout:Jul 14 18:05:14 smithi163 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-mgr-x[96818]: 2023-07-14T18:05:14.446+0000 7fdfc6157200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-07-14T18:05:15.707 INFO:journalctl@ceph.mgr.x.smithi163.stdout:Jul 14 18:05:15 smithi163 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-mgr-x[96818]: 2023-07-14T18:05:15.317+0000 7fdfc6157200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-07-14T18:05:15.707 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:05:15 smithi163 ceph-mon[96576]: Active manager daemon x restarted 2023-07-14T18:05:15.707 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:05:15 smithi163 ceph-mon[96576]: Activating manager daemon x 2023-07-14T18:05:15.707 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:05:15 smithi163 ceph-mon[96576]: osdmap e3: 0 total, 0 up, 0 in 2023-07-14T18:05:15.707 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:05:15 smithi163 ceph-mon[96576]: mgrmap e10: x(active, starting, since 0.00320969s) 2023-07-14T18:05:15.708 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:05:15 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-07-14T18:05:15.708 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:05:15 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2023-07-14T18:05:15.708 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:05:15 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2023-07-14T18:05:15.708 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:05:15 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2023-07-14T18:05:15.708 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:05:15 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2023-07-14T18:05:15.708 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:05:15 smithi163 ceph-mon[96576]: Manager daemon x is now available 2023-07-14T18:05:15.708 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:05:15 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-14T18:05:15.709 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:05:15 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-14T18:05:16.707 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:05:16 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2023-07-14T18:05:16.707 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:05:16 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2023-07-14T18:05:16.707 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:05:16 smithi163 ceph-mon[96576]: [14/Jul/2023:18:05:15] ENGINE Bus STARTING 2023-07-14T18:05:16.707 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:05:16 smithi163 ceph-mon[96576]: mgrmap e11: x(active, since 1.00562s) 2023-07-14T18:05:17.014 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stdout { 2023-07-14T18:05:17.014 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 11, 2023-07-14T18:05:17.015 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stdout "initialized": true 2023-07-14T18:05:17.015 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stdout } 2023-07-14T18:05:17.015 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:10.733+0000 7fccec77b700 1 Processor -- start 2023-07-14T18:05:17.015 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:10.733+0000 7fccec77b700 1 -- start start 2023-07-14T18:05:17.015 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:10.733+0000 7fccec77b700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fcce41040e0 0x7fcce41044f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:05:17.015 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:10.733+0000 7fccec77b700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcce4104a30 con 0x7fcce41040e0 2023-07-14T18:05:17.015 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:10.733+0000 7fccea517700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fcce41040e0 0x7fcce41044f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:05:17.016 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:10.733+0000 7fccea517700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fcce41040e0 0x7fcce41044f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:54658/0 (socket says 172.21.15.163:54658) 2023-07-14T18:05:17.016 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:10.733+0000 7fccea517700 1 -- 172.21.15.163:0/3890078910 learned_addr learned my addr 172.21.15.163:0/3890078910 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:05:17.016 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:10.734+0000 7fccea517700 1 -- 172.21.15.163:0/3890078910 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcce4104b70 con 0x7fcce41040e0 2023-07-14T18:05:17.016 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:10.734+0000 7fccea517700 1 --2- 172.21.15.163:0/3890078910 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fcce41040e0 0x7fcce41044f0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fcce000bb40 tx=0x7fcce000be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e000c76f265424b server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:05:17.016 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:10.734+0000 7fcce9515700 1 -- 172.21.15.163:0/3890078910 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fcce000dbe0 con 0x7fcce41040e0 2023-07-14T18:05:17.016 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:10.734+0000 7fcce9515700 1 -- 172.21.15.163:0/3890078910 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fcce00044c0 con 0x7fcce41040e0 2023-07-14T18:05:17.016 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:10.734+0000 7fcce9515700 1 -- 172.21.15.163:0/3890078910 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fcce0003d50 con 0x7fcce41040e0 2023-07-14T18:05:17.017 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:10.735+0000 7fccec77b700 1 -- 172.21.15.163:0/3890078910 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fcce41040e0 msgr2=0x7fcce41044f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:05:17.017 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:10.735+0000 7fccec77b700 1 --2- 172.21.15.163:0/3890078910 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fcce41040e0 0x7fcce41044f0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fcce000bb40 tx=0x7fcce000be50 comp rx=0 tx=0).stop 2023-07-14T18:05:17.017 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:10.735+0000 7fccec77b700 1 -- 172.21.15.163:0/3890078910 shutdown_connections 2023-07-14T18:05:17.017 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:10.735+0000 7fccec77b700 1 --2- 172.21.15.163:0/3890078910 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fcce41040e0 0x7fcce41044f0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:05:17.017 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:10.735+0000 7fccec77b700 1 -- 172.21.15.163:0/3890078910 >> 172.21.15.163:0/3890078910 conn(0x7fcce40ff770 msgr2=0x7fcce4101b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:05:17.017 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:10.735+0000 7fccec77b700 1 -- 172.21.15.163:0/3890078910 shutdown_connections 2023-07-14T18:05:17.017 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:10.735+0000 7fccec77b700 1 -- 172.21.15.163:0/3890078910 wait complete. 2023-07-14T18:05:17.017 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:10.736+0000 7fccec77b700 1 Processor -- start 2023-07-14T18:05:17.018 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:10.736+0000 7fccec77b700 1 -- start start 2023-07-14T18:05:17.018 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:10.736+0000 7fccec77b700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fcce41040e0 0x7fcce4196e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:05:17.018 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:10.736+0000 7fccec77b700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcce41973b0 con 0x7fcce41040e0 2023-07-14T18:05:17.018 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:10.736+0000 7fccea517700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fcce41040e0 0x7fcce4196e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:05:17.018 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:10.736+0000 7fccea517700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fcce41040e0 0x7fcce4196e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:54660/0 (socket says 172.21.15.163:54660) 2023-07-14T18:05:17.018 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:10.736+0000 7fccea517700 1 -- 172.21.15.163:0/4054100591 learned_addr learned my addr 172.21.15.163:0/4054100591 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:05:17.018 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:10.736+0000 7fccea517700 1 -- 172.21.15.163:0/4054100591 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcce000b7f0 con 0x7fcce41040e0 2023-07-14T18:05:17.019 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:10.736+0000 7fccea517700 1 --2- 172.21.15.163:0/4054100591 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fcce41040e0 0x7fcce4196e70 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fcce000dd10 tx=0x7fcce000ddf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:05:17.019 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:10.737+0000 7fccdb7fe700 1 -- 172.21.15.163:0/4054100591 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fcce001e070 con 0x7fcce41040e0 2023-07-14T18:05:17.019 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:10.737+0000 7fccec77b700 1 -- 172.21.15.163:0/4054100591 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcce41975b0 con 0x7fcce41040e0 2023-07-14T18:05:17.019 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:10.737+0000 7fccdb7fe700 1 -- 172.21.15.163:0/4054100591 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fcce0010b10 con 0x7fcce41040e0 2023-07-14T18:05:17.019 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:10.737+0000 7fccdb7fe700 1 -- 172.21.15.163:0/4054100591 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fcce0022a20 con 0x7fcce41040e0 2023-07-14T18:05:17.019 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:10.737+0000 7fccec77b700 1 -- 172.21.15.163:0/4054100591 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcce4198160 con 0x7fcce41040e0 2023-07-14T18:05:17.019 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:10.738+0000 7fccdb7fe700 1 -- 172.21.15.163:0/4054100591 <== mon.0 v2:172.21.15.163:3300/0 4 ==== mgrmap(e 9) v1 ==== 45496+0+0 (secure 0 0 0) 0x7fcce0010c80 con 0x7fcce41040e0 2023-07-14T18:05:17.019 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:10.738+0000 7fccdb7fe700 1 --2- 172.21.15.163:0/4054100591 >> [v2:172.21.15.163:6800/1086512093,v1:172.21.15.163:6801/1086512093] conn(0x7fccd0038740 0x7fccd003abf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:05:17.020 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:10.738+0000 7fccdb7fe700 1 -- 172.21.15.163:0/4054100591 --> [v2:172.21.15.163:6800/1086512093,v1:172.21.15.163:6801/1086512093] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7fccd003b300 con 0x7fccd0038740 2023-07-14T18:05:17.020 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:10.738+0000 7fccdb7fe700 1 -- 172.21.15.163:0/4054100591 <== mon.0 v2:172.21.15.163:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7fcce004efd0 con 0x7fcce41040e0 2023-07-14T18:05:17.020 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:10.738+0000 7fcce9d16700 1 -- 172.21.15.163:0/4054100591 >> [v2:172.21.15.163:6800/1086512093,v1:172.21.15.163:6801/1086512093] conn(0x7fccd0038740 msgr2=0x7fccd003abf0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.163:6800/1086512093 2023-07-14T18:05:17.020 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:10.738+0000 7fcce9d16700 1 --2- 172.21.15.163:0/4054100591 >> [v2:172.21.15.163:6800/1086512093,v1:172.21.15.163:6801/1086512093] conn(0x7fccd0038740 0x7fccd003abf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-14T18:05:17.020 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:10.939+0000 7fcce9d16700 1 -- 172.21.15.163:0/4054100591 >> [v2:172.21.15.163:6800/1086512093,v1:172.21.15.163:6801/1086512093] conn(0x7fccd0038740 msgr2=0x7fccd003abf0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.163:6800/1086512093 2023-07-14T18:05:17.020 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:10.939+0000 7fcce9d16700 1 --2- 172.21.15.163:0/4054100591 >> [v2:172.21.15.163:6800/1086512093,v1:172.21.15.163:6801/1086512093] conn(0x7fccd0038740 0x7fccd003abf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-07-14T18:05:17.020 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:11.340+0000 7fcce9d16700 1 -- 172.21.15.163:0/4054100591 >> [v2:172.21.15.163:6800/1086512093,v1:172.21.15.163:6801/1086512093] conn(0x7fccd0038740 msgr2=0x7fccd003abf0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.163:6800/1086512093 2023-07-14T18:05:17.021 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:11.340+0000 7fcce9d16700 1 --2- 172.21.15.163:0/4054100591 >> [v2:172.21.15.163:6800/1086512093,v1:172.21.15.163:6801/1086512093] conn(0x7fccd0038740 0x7fccd003abf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-07-14T18:05:17.021 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:12.141+0000 7fcce9d16700 1 -- 172.21.15.163:0/4054100591 >> [v2:172.21.15.163:6800/1086512093,v1:172.21.15.163:6801/1086512093] conn(0x7fccd0038740 msgr2=0x7fccd003abf0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.163:6800/1086512093 2023-07-14T18:05:17.021 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:12.141+0000 7fcce9d16700 1 --2- 172.21.15.163:0/4054100591 >> [v2:172.21.15.163:6800/1086512093,v1:172.21.15.163:6801/1086512093] conn(0x7fccd0038740 0x7fccd003abf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-07-14T18:05:17.021 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:13.742+0000 7fcce9d16700 1 -- 172.21.15.163:0/4054100591 >> [v2:172.21.15.163:6800/1086512093,v1:172.21.15.163:6801/1086512093] conn(0x7fccd0038740 msgr2=0x7fccd003abf0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.163:6800/1086512093 2023-07-14T18:05:17.021 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:13.742+0000 7fcce9d16700 1 --2- 172.21.15.163:0/4054100591 >> [v2:172.21.15.163:6800/1086512093,v1:172.21.15.163:6801/1086512093] conn(0x7fccd0038740 0x7fccd003abf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 3.200000 2023-07-14T18:05:17.021 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:15.332+0000 7fccdb7fe700 1 -- 172.21.15.163:0/4054100591 <== mon.0 v2:172.21.15.163:3300/0 6 ==== mgrmap(e 10) v1 ==== 45263+0+0 (secure 0 0 0) 0x7fcce002c440 con 0x7fcce41040e0 2023-07-14T18:05:17.021 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:15.332+0000 7fccdb7fe700 1 -- 172.21.15.163:0/4054100591 >> [v2:172.21.15.163:6800/1086512093,v1:172.21.15.163:6801/1086512093] conn(0x7fccd0038740 msgr2=0x7fccd003abf0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-14T18:05:17.021 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:15.332+0000 7fccdb7fe700 1 --2- 172.21.15.163:0/4054100591 >> [v2:172.21.15.163:6800/1086512093,v1:172.21.15.163:6801/1086512093] conn(0x7fccd0038740 0x7fccd003abf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:05:17.022 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:16.333+0000 7fccdb7fe700 1 -- 172.21.15.163:0/4054100591 <== mon.0 v2:172.21.15.163:3300/0 7 ==== mgrmap(e 11) v1 ==== 45390+0+0 (secure 0 0 0) 0x7fcce0018cb0 con 0x7fcce41040e0 2023-07-14T18:05:17.022 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:16.333+0000 7fccdb7fe700 1 --2- 172.21.15.163:0/4054100591 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7fccd003bfd0 0x7fccd003e3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:05:17.022 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:16.333+0000 7fccdb7fe700 1 -- 172.21.15.163:0/4054100591 --> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7fccd003b300 con 0x7fccd003bfd0 2023-07-14T18:05:17.022 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:16.334+0000 7fcce9d16700 1 --2- 172.21.15.163:0/4054100591 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7fccd003bfd0 0x7fccd003e3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:05:17.022 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:16.334+0000 7fcce9d16700 1 --2- 172.21.15.163:0/4054100591 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7fccd003bfd0 0x7fccd003e3b0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7fccd4003a10 tx=0x7fccd40092b0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:05:17.022 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:16.335+0000 7fccdb7fe700 1 -- 172.21.15.163:0/4054100591 <== mgr.14152 v2:172.21.15.163:6800/1949590926 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+6910 (secure 0 0 0) 0x7fccd003b300 con 0x7fccd003bfd0 2023-07-14T18:05:17.022 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:16.341+0000 7fccec77b700 1 -- 172.21.15.163:0/4054100591 --> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] -- command(tid 1: {"prefix": "mgr_status"}) v1 -- 0x7fcce4197ff0 con 0x7fccd003bfd0 2023-07-14T18:05:17.022 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:16.341+0000 7fccdb7fe700 1 -- 172.21.15.163:0/4054100591 <== mgr.14152 v2:172.21.15.163:6800/1949590926 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+52 (secure 0 0 0) 0x7fcce4197ff0 con 0x7fccd003bfd0 2023-07-14T18:05:17.023 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:16.342+0000 7fccec77b700 1 -- 172.21.15.163:0/4054100591 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7fccd003bfd0 msgr2=0x7fccd003e3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:05:17.023 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:16.342+0000 7fccec77b700 1 --2- 172.21.15.163:0/4054100591 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7fccd003bfd0 0x7fccd003e3b0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7fccd4003a10 tx=0x7fccd40092b0 comp rx=0 tx=0).stop 2023-07-14T18:05:17.023 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:16.342+0000 7fccec77b700 1 -- 172.21.15.163:0/4054100591 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fcce41040e0 msgr2=0x7fcce4196e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:05:17.023 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:16.342+0000 7fccec77b700 1 --2- 172.21.15.163:0/4054100591 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fcce41040e0 0x7fcce4196e70 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fcce000dd10 tx=0x7fcce000ddf0 comp rx=0 tx=0).stop 2023-07-14T18:05:17.023 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:16.342+0000 7fccec77b700 1 -- 172.21.15.163:0/4054100591 shutdown_connections 2023-07-14T18:05:17.023 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:16.342+0000 7fccec77b700 1 --2- 172.21.15.163:0/4054100591 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7fccd003bfd0 0x7fccd003e3b0 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:05:17.023 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:16.342+0000 7fccec77b700 1 --2- 172.21.15.163:0/4054100591 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fcce41040e0 0x7fcce4196e70 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:05:17.024 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:16.342+0000 7fccec77b700 1 --2- 172.21.15.163:0/4054100591 >> [v2:172.21.15.163:6800/1086512093,v1:172.21.15.163:6801/1086512093] conn(0x7fccd0038740 0x7fccd003abf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:05:17.024 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:16.342+0000 7fccec77b700 1 -- 172.21.15.163:0/4054100591 >> 172.21.15.163:0/4054100591 conn(0x7fcce40ff770 msgr2=0x7fcce418db50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:05:17.024 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:16.342+0000 7fccec77b700 1 -- 172.21.15.163:0/4054100591 shutdown_connections 2023-07-14T18:05:17.024 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:16.342+0000 7fccec77b700 1 -- 172.21.15.163:0/4054100591 wait complete. 2023-07-14T18:05:17.024 INFO:teuthology.orchestra.run.smithi163.stdout:mgr epoch 9 is available 2023-07-14T18:05:17.024 INFO:teuthology.orchestra.run.smithi163.stdout:Generating a dashboard self-signed certificate... 2023-07-14T18:05:17.707 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:05:17 smithi163 ceph-mon[96576]: [14/Jul/2023:18:05:15] ENGINE Serving on https://172.21.15.163:7150 2023-07-14T18:05:17.707 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:05:17 smithi163 ceph-mon[96576]: [14/Jul/2023:18:05:15] ENGINE Serving on http://172.21.15.163:8765 2023-07-14T18:05:17.707 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:05:17 smithi163 ceph-mon[96576]: [14/Jul/2023:18:05:15] ENGINE Bus STARTED 2023-07-14T18:05:17.707 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:05:17 smithi163 ceph-mon[96576]: from='client.14156 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2023-07-14T18:05:17.707 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:05:17 smithi163 ceph-mon[96576]: from='client.14156 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2023-07-14T18:05:17.707 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:05:17 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:05:18.158 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stdout Self-signed certificate created 2023-07-14T18:05:18.158 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:17.494+0000 7f43e211b700 1 Processor -- start 2023-07-14T18:05:18.158 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:17.494+0000 7f43e211b700 1 -- start start 2023-07-14T18:05:18.158 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:17.494+0000 7f43e211b700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f43dc079cd0 0x7f43dc10a180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:05:18.158 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:17.494+0000 7f43e211b700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43dc105b70 con 0x7f43dc079cd0 2023-07-14T18:05:18.159 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:17.494+0000 7f43db7fe700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f43dc079cd0 0x7f43dc10a180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:05:18.159 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:17.494+0000 7f43db7fe700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f43dc079cd0 0x7f43dc10a180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:54714/0 (socket says 172.21.15.163:54714) 2023-07-14T18:05:18.159 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:17.494+0000 7f43db7fe700 1 -- 172.21.15.163:0/4093133881 learned_addr learned my addr 172.21.15.163:0/4093133881 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:05:18.159 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:17.495+0000 7f43db7fe700 1 -- 172.21.15.163:0/4093133881 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43dc10a6c0 con 0x7f43dc079cd0 2023-07-14T18:05:18.159 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:17.495+0000 7f43db7fe700 1 --2- 172.21.15.163:0/4093133881 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f43dc079cd0 0x7f43dc10a180 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f43cc0098a0 tx=0x7f43cc009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f79e7d7e2e0bd233 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:05:18.159 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:17.495+0000 7f43da7fc700 1 -- 172.21.15.163:0/4093133881 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f43cc004160 con 0x7f43dc079cd0 2023-07-14T18:05:18.159 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:17.495+0000 7f43da7fc700 1 -- 172.21.15.163:0/4093133881 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f43cc0042c0 con 0x7f43dc079cd0 2023-07-14T18:05:18.160 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:17.495+0000 7f43da7fc700 1 -- 172.21.15.163:0/4093133881 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f43cc0118e0 con 0x7f43dc079cd0 2023-07-14T18:05:18.160 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:17.496+0000 7f43e211b700 1 -- 172.21.15.163:0/4093133881 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f43dc079cd0 msgr2=0x7f43dc10a180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:05:18.160 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:17.496+0000 7f43e211b700 1 --2- 172.21.15.163:0/4093133881 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f43dc079cd0 0x7f43dc10a180 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f43cc0098a0 tx=0x7f43cc009bb0 comp rx=0 tx=0).stop 2023-07-14T18:05:18.160 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:17.496+0000 7f43e211b700 1 -- 172.21.15.163:0/4093133881 shutdown_connections 2023-07-14T18:05:18.160 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:17.496+0000 7f43e211b700 1 --2- 172.21.15.163:0/4093133881 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f43dc079cd0 0x7f43dc10a180 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:05:18.160 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:17.496+0000 7f43e211b700 1 -- 172.21.15.163:0/4093133881 >> 172.21.15.163:0/4093133881 conn(0x7f43dc0ff770 msgr2=0x7f43dc101b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:05:18.160 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:17.496+0000 7f43e211b700 1 -- 172.21.15.163:0/4093133881 shutdown_connections 2023-07-14T18:05:18.160 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:17.496+0000 7f43e211b700 1 -- 172.21.15.163:0/4093133881 wait complete. 2023-07-14T18:05:18.161 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:17.496+0000 7f43e211b700 1 Processor -- start 2023-07-14T18:05:18.161 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:17.496+0000 7f43e211b700 1 -- start start 2023-07-14T18:05:18.161 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:17.497+0000 7f43e211b700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f43dc19b200 0x7f43dc19b610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:05:18.161 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:17.497+0000 7f43e211b700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43dc19bb50 con 0x7f43dc19b200 2023-07-14T18:05:18.161 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:17.497+0000 7f43db7fe700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f43dc19b200 0x7f43dc19b610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:05:18.161 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:17.497+0000 7f43db7fe700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f43dc19b200 0x7f43dc19b610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:54716/0 (socket says 172.21.15.163:54716) 2023-07-14T18:05:18.161 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:17.497+0000 7f43db7fe700 1 -- 172.21.15.163:0/1875070903 learned_addr learned my addr 172.21.15.163:0/1875070903 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:05:18.162 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:17.497+0000 7f43db7fe700 1 -- 172.21.15.163:0/1875070903 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43cc009550 con 0x7f43dc19b200 2023-07-14T18:05:18.162 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:17.497+0000 7f43db7fe700 1 --2- 172.21.15.163:0/1875070903 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f43dc19b200 0x7f43dc19b610 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f43cc006af0 tx=0x7f43cc011e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:05:18.162 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:17.497+0000 7f43d8ff9700 1 -- 172.21.15.163:0/1875070903 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f43cc0037d0 con 0x7f43dc19b200 2023-07-14T18:05:18.162 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:17.497+0000 7f43d8ff9700 1 -- 172.21.15.163:0/1875070903 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f43cc01b440 con 0x7f43dc19b200 2023-07-14T18:05:18.162 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:17.497+0000 7f43e211b700 1 -- 172.21.15.163:0/1875070903 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f43dc19bd50 con 0x7f43dc19b200 2023-07-14T18:05:18.162 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:17.497+0000 7f43d8ff9700 1 -- 172.21.15.163:0/1875070903 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f43cc019560 con 0x7f43dc19b200 2023-07-14T18:05:18.163 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:17.497+0000 7f43e211b700 1 -- 172.21.15.163:0/1875070903 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f43dc19c7e0 con 0x7f43dc19b200 2023-07-14T18:05:18.163 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:17.498+0000 7f43d8ff9700 1 -- 172.21.15.163:0/1875070903 <== mon.0 v2:172.21.15.163:3300/0 4 ==== mgrmap(e 11) v1 ==== 45390+0+0 (secure 0 0 0) 0x7f43cc0197d0 con 0x7f43dc19b200 2023-07-14T18:05:18.163 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:17.498+0000 7f43e211b700 1 -- 172.21.15.163:0/1875070903 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f43dc061c70 con 0x7f43dc19b200 2023-07-14T18:05:18.163 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:17.498+0000 7f43d8ff9700 1 --2- 172.21.15.163:0/1875070903 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f43c4038640 0x7f43c403aaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:05:18.163 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:17.499+0000 7f43d8ff9700 1 -- 172.21.15.163:0/1875070903 <== mon.0 v2:172.21.15.163:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f43cc04c480 con 0x7f43dc19b200 2023-07-14T18:05:18.163 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:17.499+0000 7f43daffd700 1 --2- 172.21.15.163:0/1875070903 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f43c4038640 0x7f43c403aaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:05:18.163 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:17.499+0000 7f43daffd700 1 --2- 172.21.15.163:0/1875070903 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f43c4038640 0x7f43c403aaf0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f43d0006fd0 tx=0x7f43d0006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:05:18.164 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:17.503+0000 7f43d8ff9700 1 -- 172.21.15.163:0/1875070903 <== mon.0 v2:172.21.15.163:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178025 (secure 0 0 0) 0x7f43cc018db0 con 0x7f43dc19b200 2023-07-14T18:05:18.164 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:17.708+0000 7f43e211b700 1 -- 172.21.15.163:0/1875070903 --> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] -- mgr_command(tid 0: {"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}) v1 -- 0x7f43dc101a80 con 0x7f43c4038640 2023-07-14T18:05:18.164 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:17.767+0000 7f43d8ff9700 1 -- 172.21.15.163:0/1875070903 <== mgr.14152 v2:172.21.15.163:6800/1949590926 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+32 (secure 0 0 0) 0x7f43dc101a80 con 0x7f43c4038640 2023-07-14T18:05:18.164 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:17.769+0000 7f43e211b700 1 -- 172.21.15.163:0/1875070903 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f43c4038640 msgr2=0x7f43c403aaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:05:18.164 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:17.769+0000 7f43e211b700 1 --2- 172.21.15.163:0/1875070903 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f43c4038640 0x7f43c403aaf0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f43d0006fd0 tx=0x7f43d0006e40 comp rx=0 tx=0).stop 2023-07-14T18:05:18.164 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:17.769+0000 7f43e211b700 1 -- 172.21.15.163:0/1875070903 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f43dc19b200 msgr2=0x7f43dc19b610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:05:18.164 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:17.769+0000 7f43e211b700 1 --2- 172.21.15.163:0/1875070903 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f43dc19b200 0x7f43dc19b610 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f43cc006af0 tx=0x7f43cc011e80 comp rx=0 tx=0).stop 2023-07-14T18:05:18.164 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:17.769+0000 7f43e211b700 1 -- 172.21.15.163:0/1875070903 shutdown_connections 2023-07-14T18:05:18.165 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:17.769+0000 7f43e211b700 1 --2- 172.21.15.163:0/1875070903 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f43c4038640 0x7f43c403aaf0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:05:18.165 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:17.769+0000 7f43e211b700 1 --2- 172.21.15.163:0/1875070903 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f43dc19b200 0x7f43dc19b610 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:05:18.165 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:17.769+0000 7f43e211b700 1 -- 172.21.15.163:0/1875070903 >> 172.21.15.163:0/1875070903 conn(0x7f43dc0ff770 msgr2=0x7f43dc100e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:05:18.165 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:17.769+0000 7f43e211b700 1 -- 172.21.15.163:0/1875070903 shutdown_connections 2023-07-14T18:05:18.165 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:17.770+0000 7f43e211b700 1 -- 172.21.15.163:0/1875070903 wait complete. 2023-07-14T18:05:18.165 INFO:teuthology.orchestra.run.smithi163.stdout:Creating initial admin user... 2023-07-14T18:05:18.457 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:05:18 smithi163 ceph-mon[96576]: from='client.14164 -' entity='client.admin' cmd=[{"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}]: dispatch 2023-07-14T18:05:18.457 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:05:18 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:05:18.458 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:05:18 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:05:18.458 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:05:18 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:05:18.458 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:05:18 smithi163 ceph-mon[96576]: mgrmap e12: x(active, since 2s) 2023-07-14T18:05:19.713 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stdout {"username": "admin", "password": "$2b$12$iuZCA9lSYgkD7AAjapeViOTNISwqcy8L4//octlDM8yRtIzKbnGBO", "roles": ["administrator"], "name": null, "email": null, "lastUpdate": 1689357919, "enabled": true, "pwdExpirationDate": null, "pwdUpdateRequired": true} 2023-07-14T18:05:19.713 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:18.593+0000 7f4e55d94700 1 Processor -- start 2023-07-14T18:05:19.713 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:18.593+0000 7f4e55d94700 1 -- start start 2023-07-14T18:05:19.713 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:18.593+0000 7f4e55d94700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f4e50105cf0 0x7f4e501080d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:05:19.713 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:18.593+0000 7f4e55d94700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e50079d50 con 0x7f4e50105cf0 2023-07-14T18:05:19.714 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:18.594+0000 7f4e4f7fe700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f4e50105cf0 0x7f4e501080d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:05:19.714 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:18.594+0000 7f4e4f7fe700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f4e50105cf0 0x7f4e501080d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:54720/0 (socket says 172.21.15.163:54720) 2023-07-14T18:05:19.714 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:18.594+0000 7f4e4f7fe700 1 -- 172.21.15.163:0/3645874894 learned_addr learned my addr 172.21.15.163:0/3645874894 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:05:19.714 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:18.594+0000 7f4e4f7fe700 1 -- 172.21.15.163:0/3645874894 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e50079e90 con 0x7f4e50105cf0 2023-07-14T18:05:19.714 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:18.594+0000 7f4e4f7fe700 1 --2- 172.21.15.163:0/3645874894 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f4e50105cf0 0x7f4e501080d0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f4e440098a0 tx=0x7f4e44009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2198149a8881a9eb server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:05:19.714 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:18.594+0000 7f4e4e7fc700 1 -- 172.21.15.163:0/3645874894 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4e44004160 con 0x7f4e50105cf0 2023-07-14T18:05:19.714 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:18.594+0000 7f4e4e7fc700 1 -- 172.21.15.163:0/3645874894 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f4e440042c0 con 0x7f4e50105cf0 2023-07-14T18:05:19.714 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:18.594+0000 7f4e4e7fc700 1 -- 172.21.15.163:0/3645874894 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4e440118e0 con 0x7f4e50105cf0 2023-07-14T18:05:19.715 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:18.595+0000 7f4e55d94700 1 -- 172.21.15.163:0/3645874894 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f4e50105cf0 msgr2=0x7f4e501080d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:05:19.715 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:18.595+0000 7f4e55d94700 1 --2- 172.21.15.163:0/3645874894 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f4e50105cf0 0x7f4e501080d0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f4e440098a0 tx=0x7f4e44009bb0 comp rx=0 tx=0).stop 2023-07-14T18:05:19.715 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:18.595+0000 7f4e55d94700 1 -- 172.21.15.163:0/3645874894 shutdown_connections 2023-07-14T18:05:19.715 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:18.595+0000 7f4e55d94700 1 --2- 172.21.15.163:0/3645874894 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f4e50105cf0 0x7f4e501080d0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:05:19.715 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:18.595+0000 7f4e55d94700 1 -- 172.21.15.163:0/3645874894 >> 172.21.15.163:0/3645874894 conn(0x7f4e500ff770 msgr2=0x7f4e50101b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:05:19.715 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:18.595+0000 7f4e55d94700 1 -- 172.21.15.163:0/3645874894 shutdown_connections 2023-07-14T18:05:19.715 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:18.595+0000 7f4e55d94700 1 -- 172.21.15.163:0/3645874894 wait complete. 2023-07-14T18:05:19.716 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:18.595+0000 7f4e55d94700 1 Processor -- start 2023-07-14T18:05:19.716 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:18.596+0000 7f4e55d94700 1 -- start start 2023-07-14T18:05:19.716 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:18.596+0000 7f4e55d94700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f4e50105cf0 0x7f4e50103ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:05:19.716 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:18.596+0000 7f4e55d94700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e50105830 con 0x7f4e50105cf0 2023-07-14T18:05:19.716 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:18.596+0000 7f4e4f7fe700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f4e50105cf0 0x7f4e50103ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:05:19.716 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:18.596+0000 7f4e4f7fe700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f4e50105cf0 0x7f4e50103ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:54722/0 (socket says 172.21.15.163:54722) 2023-07-14T18:05:19.716 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:18.596+0000 7f4e4f7fe700 1 -- 172.21.15.163:0/1924980184 learned_addr learned my addr 172.21.15.163:0/1924980184 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:05:19.717 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:18.596+0000 7f4e4f7fe700 1 -- 172.21.15.163:0/1924980184 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e44009550 con 0x7f4e50105cf0 2023-07-14T18:05:19.717 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:18.596+0000 7f4e4f7fe700 1 --2- 172.21.15.163:0/1924980184 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f4e50105cf0 0x7f4e50103ca0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f4e44006af0 tx=0x7f4e44011e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:05:19.717 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:18.596+0000 7f4e4cff9700 1 -- 172.21.15.163:0/1924980184 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4e440037d0 con 0x7f4e50105cf0 2023-07-14T18:05:19.717 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:18.596+0000 7f4e4cff9700 1 -- 172.21.15.163:0/1924980184 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f4e4401b440 con 0x7f4e50105cf0 2023-07-14T18:05:19.717 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:18.596+0000 7f4e55d94700 1 -- 172.21.15.163:0/1924980184 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e50105a30 con 0x7f4e50105cf0 2023-07-14T18:05:19.717 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:18.596+0000 7f4e4cff9700 1 -- 172.21.15.163:0/1924980184 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4e44019560 con 0x7f4e50105cf0 2023-07-14T18:05:19.717 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:18.596+0000 7f4e55d94700 1 -- 172.21.15.163:0/1924980184 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e501043b0 con 0x7f4e50105cf0 2023-07-14T18:05:19.717 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:18.597+0000 7f4e4cff9700 1 -- 172.21.15.163:0/1924980184 <== mon.0 v2:172.21.15.163:3300/0 4 ==== mgrmap(e 12) v1 ==== 45496+0+0 (secure 0 0 0) 0x7f4e440197d0 con 0x7f4e50105cf0 2023-07-14T18:05:19.718 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:18.597+0000 7f4e4cff9700 1 --2- 172.21.15.163:0/1924980184 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f4e38038760 0x7f4e3803ac10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:05:19.718 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:18.597+0000 7f4e4cff9700 1 -- 172.21.15.163:0/1924980184 <== mon.0 v2:172.21.15.163:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f4e4404c650 con 0x7f4e50105cf0 2023-07-14T18:05:19.718 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:18.597+0000 7f4e55d94700 1 -- 172.21.15.163:0/1924980184 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4e50061c70 con 0x7f4e50105cf0 2023-07-14T18:05:19.718 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:18.598+0000 7f4e4effd700 1 --2- 172.21.15.163:0/1924980184 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f4e38038760 0x7f4e3803ac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:05:19.718 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:18.598+0000 7f4e4effd700 1 --2- 172.21.15.163:0/1924980184 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f4e38038760 0x7f4e3803ac10 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f4e40006fd0 tx=0x7f4e40006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:05:19.718 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:18.603+0000 7f4e4cff9700 1 -- 172.21.15.163:0/1924980184 <== mon.0 v2:172.21.15.163:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178025 (secure 0 0 0) 0x7f4e44018db0 con 0x7f4e50105cf0 2023-07-14T18:05:19.718 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:18.822+0000 7f4e55d94700 1 -- 172.21.15.163:0/1924980184 --> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] -- mgr_command(tid 0: {"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}) v1 -- 0x7f4e50061a90 con 0x7f4e38038760 2023-07-14T18:05:19.718 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:19.046+0000 7f4e4cff9700 1 -- 172.21.15.163:0/1924980184 <== mgr.14152 v2:172.21.15.163:6800/1949590926 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+252 (secure 0 0 0) 0x7f4e50061a90 con 0x7f4e38038760 2023-07-14T18:05:19.719 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:19.048+0000 7f4e55d94700 1 -- 172.21.15.163:0/1924980184 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f4e38038760 msgr2=0x7f4e3803ac10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:05:19.719 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:19.048+0000 7f4e55d94700 1 --2- 172.21.15.163:0/1924980184 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f4e38038760 0x7f4e3803ac10 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f4e40006fd0 tx=0x7f4e40006e40 comp rx=0 tx=0).stop 2023-07-14T18:05:19.719 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:19.048+0000 7f4e55d94700 1 -- 172.21.15.163:0/1924980184 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f4e50105cf0 msgr2=0x7f4e50103ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:05:19.719 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:19.048+0000 7f4e55d94700 1 --2- 172.21.15.163:0/1924980184 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f4e50105cf0 0x7f4e50103ca0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f4e44006af0 tx=0x7f4e44011e80 comp rx=0 tx=0).stop 2023-07-14T18:05:19.719 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:19.048+0000 7f4e55d94700 1 -- 172.21.15.163:0/1924980184 shutdown_connections 2023-07-14T18:05:19.719 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:19.048+0000 7f4e55d94700 1 --2- 172.21.15.163:0/1924980184 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f4e38038760 0x7f4e3803ac10 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:05:19.719 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:19.048+0000 7f4e55d94700 1 --2- 172.21.15.163:0/1924980184 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f4e50105cf0 0x7f4e50103ca0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:05:19.720 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:19.048+0000 7f4e55d94700 1 -- 172.21.15.163:0/1924980184 >> 172.21.15.163:0/1924980184 conn(0x7f4e500ff770 msgr2=0x7f4e50100e40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:05:19.720 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:19.049+0000 7f4e55d94700 1 -- 172.21.15.163:0/1924980184 shutdown_connections 2023-07-14T18:05:19.720 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:19.049+0000 7f4e55d94700 1 -- 172.21.15.163:0/1924980184 wait complete. 2023-07-14T18:05:19.720 INFO:teuthology.orchestra.run.smithi163.stdout:Fetching dashboard port number... 2023-07-14T18:05:20.359 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:05:20 smithi163 ceph-mon[96576]: from='client.14166 -' entity='client.admin' cmd=[{"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}]: dispatch 2023-07-14T18:05:20.359 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:05:20 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:05:20.657 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stdout 8443 2023-07-14T18:05:20.657 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:20.111+0000 7f0e1b2d4700 1 Processor -- start 2023-07-14T18:05:20.657 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:20.112+0000 7f0e1b2d4700 1 -- start start 2023-07-14T18:05:20.657 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:20.112+0000 7f0e1b2d4700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f0e141056b0 0x7f0e14105ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:05:20.657 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:20.112+0000 7f0e1b2d4700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e14106000 con 0x7f0e141056b0 2023-07-14T18:05:20.658 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:20.112+0000 7f0e19070700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f0e141056b0 0x7f0e14105ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:05:20.658 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:20.112+0000 7f0e19070700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f0e141056b0 0x7f0e14105ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:54726/0 (socket says 172.21.15.163:54726) 2023-07-14T18:05:20.658 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:20.112+0000 7f0e19070700 1 -- 172.21.15.163:0/1957659710 learned_addr learned my addr 172.21.15.163:0/1957659710 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:05:20.658 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:20.112+0000 7f0e19070700 1 -- 172.21.15.163:0/1957659710 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e14106140 con 0x7f0e141056b0 2023-07-14T18:05:20.658 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:20.112+0000 7f0e19070700 1 --2- 172.21.15.163:0/1957659710 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f0e141056b0 0x7f0e14105ac0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f0e040098a0 tx=0x7f0e04009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=668aa32c9594a1ca server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:05:20.658 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:20.112+0000 7f0e0bfff700 1 -- 172.21.15.163:0/1957659710 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0e04004160 con 0x7f0e141056b0 2023-07-14T18:05:20.658 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:20.112+0000 7f0e0bfff700 1 -- 172.21.15.163:0/1957659710 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f0e040042c0 con 0x7f0e141056b0 2023-07-14T18:05:20.659 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:20.113+0000 7f0e0bfff700 1 -- 172.21.15.163:0/1957659710 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0e040118e0 con 0x7f0e141056b0 2023-07-14T18:05:20.659 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:20.113+0000 7f0e1b2d4700 1 -- 172.21.15.163:0/1957659710 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f0e141056b0 msgr2=0x7f0e14105ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:05:20.659 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:20.113+0000 7f0e1b2d4700 1 --2- 172.21.15.163:0/1957659710 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f0e141056b0 0x7f0e14105ac0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f0e040098a0 tx=0x7f0e04009bb0 comp rx=0 tx=0).stop 2023-07-14T18:05:20.659 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:20.113+0000 7f0e1b2d4700 1 -- 172.21.15.163:0/1957659710 shutdown_connections 2023-07-14T18:05:20.659 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:20.113+0000 7f0e1b2d4700 1 --2- 172.21.15.163:0/1957659710 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f0e141056b0 0x7f0e14105ac0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:05:20.659 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:20.113+0000 7f0e1b2d4700 1 -- 172.21.15.163:0/1957659710 >> 172.21.15.163:0/1957659710 conn(0x7f0e140feec0 msgr2=0x7f0e141012d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:05:20.659 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:20.113+0000 7f0e1b2d4700 1 -- 172.21.15.163:0/1957659710 shutdown_connections 2023-07-14T18:05:20.660 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:20.113+0000 7f0e1b2d4700 1 -- 172.21.15.163:0/1957659710 wait complete. 2023-07-14T18:05:20.660 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:20.114+0000 7f0e1b2d4700 1 Processor -- start 2023-07-14T18:05:20.660 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:20.114+0000 7f0e1b2d4700 1 -- start start 2023-07-14T18:05:20.660 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:20.114+0000 7f0e1b2d4700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f0e141056b0 0x7f0e14196de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:05:20.660 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:20.114+0000 7f0e1b2d4700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e14197320 con 0x7f0e141056b0 2023-07-14T18:05:20.660 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:20.114+0000 7f0e19070700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f0e141056b0 0x7f0e14196de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:05:20.660 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:20.114+0000 7f0e19070700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f0e141056b0 0x7f0e14196de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:54728/0 (socket says 172.21.15.163:54728) 2023-07-14T18:05:20.661 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:20.114+0000 7f0e19070700 1 -- 172.21.15.163:0/3556167094 learned_addr learned my addr 172.21.15.163:0/3556167094 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:05:20.661 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:20.115+0000 7f0e19070700 1 -- 172.21.15.163:0/3556167094 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e04009550 con 0x7f0e141056b0 2023-07-14T18:05:20.661 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:20.115+0000 7f0e19070700 1 --2- 172.21.15.163:0/3556167094 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f0e141056b0 0x7f0e14196de0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f0e040118f0 tx=0x7f0e040119d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:05:20.661 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:20.115+0000 7f0e0a7fc700 1 -- 172.21.15.163:0/3556167094 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0e040036a0 con 0x7f0e141056b0 2023-07-14T18:05:20.661 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:20.115+0000 7f0e0a7fc700 1 -- 172.21.15.163:0/3556167094 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f0e0401b440 con 0x7f0e141056b0 2023-07-14T18:05:20.661 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:20.115+0000 7f0e1b2d4700 1 -- 172.21.15.163:0/3556167094 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e14197520 con 0x7f0e141056b0 2023-07-14T18:05:20.661 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:20.115+0000 7f0e0a7fc700 1 -- 172.21.15.163:0/3556167094 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0e040193f0 con 0x7f0e141056b0 2023-07-14T18:05:20.662 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:20.115+0000 7f0e1b2d4700 1 -- 172.21.15.163:0/3556167094 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e14198100 con 0x7f0e141056b0 2023-07-14T18:05:20.662 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:20.116+0000 7f0e0a7fc700 1 -- 172.21.15.163:0/3556167094 <== mon.0 v2:172.21.15.163:3300/0 4 ==== mgrmap(e 12) v1 ==== 45496+0+0 (secure 0 0 0) 0x7f0e04019660 con 0x7f0e141056b0 2023-07-14T18:05:20.662 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:20.116+0000 7f0e1b2d4700 1 -- 172.21.15.163:0/3556167094 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0e14197940 con 0x7f0e141056b0 2023-07-14T18:05:20.662 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:20.116+0000 7f0e0a7fc700 1 --2- 172.21.15.163:0/3556167094 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f0e0003cbd0 0x7f0e0003f080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:05:20.662 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:20.116+0000 7f0e0a7fc700 1 -- 172.21.15.163:0/3556167094 <== mon.0 v2:172.21.15.163:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f0e0404c8b0 con 0x7f0e141056b0 2023-07-14T18:05:20.662 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:20.116+0000 7f0e1886f700 1 --2- 172.21.15.163:0/3556167094 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f0e0003cbd0 0x7f0e0003f080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:05:20.662 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:20.117+0000 7f0e1886f700 1 --2- 172.21.15.163:0/3556167094 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f0e0003cbd0 0x7f0e0003f080 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f0e10006fd0 tx=0x7f0e10006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:05:20.663 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:20.121+0000 7f0e0a7fc700 1 -- 172.21.15.163:0/3556167094 <== mon.0 v2:172.21.15.163:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178025 (secure 0 0 0) 0x7f0e04018e00 con 0x7f0e141056b0 2023-07-14T18:05:20.663 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:20.304+0000 7f0e1b2d4700 1 -- 172.21.15.163:0/3556167094 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"} v 0) v1 -- 0x7f0e14198c30 con 0x7f0e141056b0 2023-07-14T18:05:20.663 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:20.305+0000 7f0e0a7fc700 1 -- 172.21.15.163:0/3556167094 <== mon.0 v2:172.21.15.163:3300/0 7 ==== mon_command_ack([{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]=0 v8) v1 ==== 112+0+5 (secure 0 0 0) 0x7f0e04003800 con 0x7f0e141056b0 2023-07-14T18:05:20.663 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:20.306+0000 7f0e1b2d4700 1 -- 172.21.15.163:0/3556167094 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f0e0003cbd0 msgr2=0x7f0e0003f080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:05:20.663 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:20.306+0000 7f0e1b2d4700 1 --2- 172.21.15.163:0/3556167094 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f0e0003cbd0 0x7f0e0003f080 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f0e10006fd0 tx=0x7f0e10006e40 comp rx=0 tx=0).stop 2023-07-14T18:05:20.663 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:20.307+0000 7f0e1b2d4700 1 -- 172.21.15.163:0/3556167094 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f0e141056b0 msgr2=0x7f0e14196de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:05:20.663 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:20.307+0000 7f0e1b2d4700 1 --2- 172.21.15.163:0/3556167094 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f0e141056b0 0x7f0e14196de0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f0e040118f0 tx=0x7f0e040119d0 comp rx=0 tx=0).stop 2023-07-14T18:05:20.664 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:20.307+0000 7f0e1b2d4700 1 -- 172.21.15.163:0/3556167094 shutdown_connections 2023-07-14T18:05:20.664 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:20.307+0000 7f0e1b2d4700 1 --2- 172.21.15.163:0/3556167094 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f0e0003cbd0 0x7f0e0003f080 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:05:20.664 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:20.307+0000 7f0e1b2d4700 1 --2- 172.21.15.163:0/3556167094 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f0e141056b0 0x7f0e14196de0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:05:20.664 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:20.307+0000 7f0e1b2d4700 1 -- 172.21.15.163:0/3556167094 >> 172.21.15.163:0/3556167094 conn(0x7f0e140feec0 msgr2=0x7f0e1418db40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:05:20.664 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:20.307+0000 7f0e1b2d4700 1 -- 172.21.15.163:0/3556167094 shutdown_connections 2023-07-14T18:05:20.664 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:20.307+0000 7f0e1b2d4700 1 -- 172.21.15.163:0/3556167094 wait complete. 2023-07-14T18:05:20.665 INFO:teuthology.orchestra.run.smithi163.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2023-07-14T18:05:20.665 INFO:teuthology.orchestra.run.smithi163.stdout:systemctl: stdout disabled 2023-07-14T18:05:20.673 INFO:teuthology.orchestra.run.smithi163.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2023-07-14T18:05:20.673 INFO:teuthology.orchestra.run.smithi163.stdout:systemctl: stdout inactive 2023-07-14T18:05:20.673 INFO:teuthology.orchestra.run.smithi163.stdout:firewalld.service is not enabled 2023-07-14T18:05:20.673 INFO:teuthology.orchestra.run.smithi163.stdout:Not possible to open ports <[8443]>. firewalld.service is not available 2023-07-14T18:05:20.675 INFO:teuthology.orchestra.run.smithi163.stdout:Ceph Dashboard is now available at: 2023-07-14T18:05:20.675 INFO:teuthology.orchestra.run.smithi163.stdout: 2023-07-14T18:05:20.675 INFO:teuthology.orchestra.run.smithi163.stdout: URL: https://smithi163:8443/ 2023-07-14T18:05:20.675 INFO:teuthology.orchestra.run.smithi163.stdout: User: admin 2023-07-14T18:05:20.675 INFO:teuthology.orchestra.run.smithi163.stdout: Password: m3d8zhemfc 2023-07-14T18:05:20.675 INFO:teuthology.orchestra.run.smithi163.stdout: 2023-07-14T18:05:20.676 INFO:teuthology.orchestra.run.smithi163.stdout:Saving cluster configuration to /var/lib/ceph/bf7326ec-2270-11ee-9b33-001a4aab830c/config directory 2023-07-14T18:05:20.676 INFO:teuthology.orchestra.run.smithi163.stdout:Enabling autotune for osd_memory_target 2023-07-14T18:05:21.207 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:05:21 smithi163 ceph-mon[96576]: from='client.? 172.21.15.163:0/3556167094' entity='client.admin' cmd=[{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]: dispatch 2023-07-14T18:05:21.720 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:21.107+0000 7f6c7e467700 1 Processor -- start 2023-07-14T18:05:21.721 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:21.107+0000 7f6c7e467700 1 -- start start 2023-07-14T18:05:21.721 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:21.107+0000 7f6c7e467700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f6c781034c0 0x7f6c781038d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:05:21.721 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:21.107+0000 7f6c7e467700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c78103e10 con 0x7f6c781034c0 2023-07-14T18:05:21.721 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:21.107+0000 7f6c77fff700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f6c781034c0 0x7f6c781038d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:05:21.721 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:21.107+0000 7f6c77fff700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f6c781034c0 0x7f6c781038d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:54736/0 (socket says 172.21.15.163:54736) 2023-07-14T18:05:21.721 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:21.107+0000 7f6c77fff700 1 -- 172.21.15.163:0/3068136912 learned_addr learned my addr 172.21.15.163:0/3068136912 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:05:21.721 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:21.108+0000 7f6c77fff700 1 -- 172.21.15.163:0/3068136912 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c78103f50 con 0x7f6c781034c0 2023-07-14T18:05:21.722 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:21.108+0000 7f6c77fff700 1 --2- 172.21.15.163:0/3068136912 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f6c781034c0 0x7f6c781038d0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f6c6c0098a0 tx=0x7f6c6c009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd893bee83592e0c server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:05:21.722 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:21.108+0000 7f6c76ffd700 1 -- 172.21.15.163:0/3068136912 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6c6c004160 con 0x7f6c781034c0 2023-07-14T18:05:21.722 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:21.108+0000 7f6c76ffd700 1 -- 172.21.15.163:0/3068136912 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f6c6c0042c0 con 0x7f6c781034c0 2023-07-14T18:05:21.722 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:21.108+0000 7f6c76ffd700 1 -- 172.21.15.163:0/3068136912 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6c6c0118e0 con 0x7f6c781034c0 2023-07-14T18:05:21.722 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:21.109+0000 7f6c7e467700 1 -- 172.21.15.163:0/3068136912 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f6c781034c0 msgr2=0x7f6c781038d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:05:21.722 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:21.109+0000 7f6c7e467700 1 --2- 172.21.15.163:0/3068136912 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f6c781034c0 0x7f6c781038d0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f6c6c0098a0 tx=0x7f6c6c009bb0 comp rx=0 tx=0).stop 2023-07-14T18:05:21.722 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:21.109+0000 7f6c7e467700 1 -- 172.21.15.163:0/3068136912 shutdown_connections 2023-07-14T18:05:21.723 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:21.109+0000 7f6c7e467700 1 --2- 172.21.15.163:0/3068136912 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f6c781034c0 0x7f6c781038d0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:05:21.723 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:21.109+0000 7f6c7e467700 1 -- 172.21.15.163:0/3068136912 >> 172.21.15.163:0/3068136912 conn(0x7f6c780feec0 msgr2=0x7f6c781012d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:05:21.723 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:21.109+0000 7f6c7e467700 1 -- 172.21.15.163:0/3068136912 shutdown_connections 2023-07-14T18:05:21.723 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:21.109+0000 7f6c7e467700 1 -- 172.21.15.163:0/3068136912 wait complete. 2023-07-14T18:05:21.723 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:21.109+0000 7f6c7e467700 1 Processor -- start 2023-07-14T18:05:21.723 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:21.109+0000 7f6c7e467700 1 -- start start 2023-07-14T18:05:21.723 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:21.110+0000 7f6c7e467700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f6c781034c0 0x7f6c781044a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:05:21.723 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:21.110+0000 7f6c7e467700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c78106030 con 0x7f6c781034c0 2023-07-14T18:05:21.724 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:21.110+0000 7f6c77fff700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f6c781034c0 0x7f6c781044a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:05:21.724 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:21.110+0000 7f6c77fff700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f6c781034c0 0x7f6c781044a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:54738/0 (socket says 172.21.15.163:54738) 2023-07-14T18:05:21.724 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:21.110+0000 7f6c77fff700 1 -- 172.21.15.163:0/4096997270 learned_addr learned my addr 172.21.15.163:0/4096997270 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:05:21.724 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:21.110+0000 7f6c77fff700 1 -- 172.21.15.163:0/4096997270 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c6c009550 con 0x7f6c781034c0 2023-07-14T18:05:21.725 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:21.110+0000 7f6c77fff700 1 --2- 172.21.15.163:0/4096997270 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f6c781034c0 0x7f6c781044a0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f6c6c006af0 tx=0x7f6c6c011e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:05:21.725 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:21.110+0000 7f6c757fa700 1 -- 172.21.15.163:0/4096997270 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6c6c0037d0 con 0x7f6c781034c0 2023-07-14T18:05:21.725 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:21.110+0000 7f6c757fa700 1 -- 172.21.15.163:0/4096997270 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f6c6c01b440 con 0x7f6c781034c0 2023-07-14T18:05:21.725 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:21.110+0000 7f6c757fa700 1 -- 172.21.15.163:0/4096997270 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6c6c019560 con 0x7f6c781034c0 2023-07-14T18:05:21.725 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:21.110+0000 7f6c7e467700 1 -- 172.21.15.163:0/4096997270 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c78106230 con 0x7f6c781034c0 2023-07-14T18:05:21.725 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:21.111+0000 7f6c7e467700 1 -- 172.21.15.163:0/4096997270 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c78104bb0 con 0x7f6c781034c0 2023-07-14T18:05:21.725 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:21.111+0000 7f6c757fa700 1 -- 172.21.15.163:0/4096997270 <== mon.0 v2:172.21.15.163:3300/0 4 ==== mgrmap(e 12) v1 ==== 45496+0+0 (secure 0 0 0) 0x7f6c6c019820 con 0x7f6c781034c0 2023-07-14T18:05:21.725 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:21.111+0000 7f6c757fa700 1 --2- 172.21.15.163:0/4096997270 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f6c60038710 0x7f6c6003abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:05:21.726 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:21.112+0000 7f6c757fa700 1 -- 172.21.15.163:0/4096997270 <== mon.0 v2:172.21.15.163:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f6c6c04c670 con 0x7f6c781034c0 2023-07-14T18:05:21.726 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:21.112+0000 7f6c7e467700 1 -- 172.21.15.163:0/4096997270 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6c78061c70 con 0x7f6c781034c0 2023-07-14T18:05:21.726 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:21.112+0000 7f6c777fe700 1 --2- 172.21.15.163:0/4096997270 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f6c60038710 0x7f6c6003abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:05:21.726 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:21.112+0000 7f6c777fe700 1 --2- 172.21.15.163:0/4096997270 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f6c60038710 0x7f6c6003abc0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f6c68006fd0 tx=0x7f6c68006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:05:21.726 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:21.116+0000 7f6c757fa700 1 -- 172.21.15.163:0/4096997270 <== mon.0 v2:172.21.15.163:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178025 (secure 0 0 0) 0x7f6c6c0189a0 con 0x7f6c781034c0 2023-07-14T18:05:21.726 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:21.303+0000 7f6c7e467700 1 -- 172.21.15.163:0/4096997270 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command([{prefix=config set, name=osd_memory_target_autotune}] v 0) v1 -- 0x7f6c781096f0 con 0x7f6c781034c0 2023-07-14T18:05:21.726 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:21.304+0000 7f6c757fa700 1 -- 172.21.15.163:0/4096997270 <== mon.0 v2:172.21.15.163:3300/0 7 ==== mon_command_ack([{prefix=config set, name=osd_memory_target_autotune}]=0 v8)=0 v8) v1 ==== 127+0+0 (secure 0 0 0) 0x7f6c6c018350 con 0x7f6c781034c0 2023-07-14T18:05:21.727 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:21.306+0000 7f6c7e467700 1 -- 172.21.15.163:0/4096997270 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f6c60038710 msgr2=0x7f6c6003abc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:05:21.727 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:21.306+0000 7f6c7e467700 1 --2- 172.21.15.163:0/4096997270 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f6c60038710 0x7f6c6003abc0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f6c68006fd0 tx=0x7f6c68006e40 comp rx=0 tx=0).stop 2023-07-14T18:05:21.727 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:21.306+0000 7f6c7e467700 1 -- 172.21.15.163:0/4096997270 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f6c781034c0 msgr2=0x7f6c781044a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:05:21.727 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:21.306+0000 7f6c7e467700 1 --2- 172.21.15.163:0/4096997270 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f6c781034c0 0x7f6c781044a0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f6c6c006af0 tx=0x7f6c6c011e80 comp rx=0 tx=0).stop 2023-07-14T18:05:21.727 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:21.306+0000 7f6c7e467700 1 -- 172.21.15.163:0/4096997270 shutdown_connections 2023-07-14T18:05:21.727 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:21.306+0000 7f6c7e467700 1 --2- 172.21.15.163:0/4096997270 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f6c60038710 0x7f6c6003abc0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:05:21.727 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:21.306+0000 7f6c7e467700 1 --2- 172.21.15.163:0/4096997270 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f6c781034c0 0x7f6c781044a0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:05:21.727 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:21.306+0000 7f6c7e467700 1 -- 172.21.15.163:0/4096997270 >> 172.21.15.163:0/4096997270 conn(0x7f6c780feec0 msgr2=0x7f6c78100550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:05:21.728 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:21.306+0000 7f6c7e467700 1 -- 172.21.15.163:0/4096997270 shutdown_connections 2023-07-14T18:05:21.728 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:21.306+0000 7f6c7e467700 1 -- 172.21.15.163:0/4096997270 wait complete. 2023-07-14T18:05:22.865 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:22.168+0000 7f8b9d67e700 1 Processor -- start 2023-07-14T18:05:22.865 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:22.168+0000 7f8b9d67e700 1 -- start start 2023-07-14T18:05:22.865 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:22.168+0000 7f8b9d67e700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f8b981067f0 0x7f8b98106c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:05:22.865 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:22.168+0000 7f8b9d67e700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b98107140 con 0x7f8b981067f0 2023-07-14T18:05:22.866 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:22.169+0000 7f8b96ffd700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f8b981067f0 0x7f8b98106c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:05:22.866 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:22.169+0000 7f8b96ffd700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f8b981067f0 0x7f8b98106c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:54742/0 (socket says 172.21.15.163:54742) 2023-07-14T18:05:22.866 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:22.169+0000 7f8b96ffd700 1 -- 172.21.15.163:0/1219778982 learned_addr learned my addr 172.21.15.163:0/1219778982 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:05:22.866 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:22.169+0000 7f8b96ffd700 1 -- 172.21.15.163:0/1219778982 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b98107280 con 0x7f8b981067f0 2023-07-14T18:05:22.866 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:22.169+0000 7f8b96ffd700 1 --2- 172.21.15.163:0/1219778982 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f8b981067f0 0x7f8b98106c00 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f8b8c0098a0 tx=0x7f8b8c009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c23dfe5ddf2bf2f server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:05:22.866 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:22.169+0000 7f8b95ffb700 1 -- 172.21.15.163:0/1219778982 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8b8c004160 con 0x7f8b981067f0 2023-07-14T18:05:22.867 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:22.169+0000 7f8b95ffb700 1 -- 172.21.15.163:0/1219778982 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f8b8c0042c0 con 0x7f8b981067f0 2023-07-14T18:05:22.867 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:22.169+0000 7f8b95ffb700 1 -- 172.21.15.163:0/1219778982 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8b8c0118e0 con 0x7f8b981067f0 2023-07-14T18:05:22.867 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:22.170+0000 7f8b9d67e700 1 -- 172.21.15.163:0/1219778982 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f8b981067f0 msgr2=0x7f8b98106c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:05:22.867 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:22.170+0000 7f8b9d67e700 1 --2- 172.21.15.163:0/1219778982 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f8b981067f0 0x7f8b98106c00 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f8b8c0098a0 tx=0x7f8b8c009bb0 comp rx=0 tx=0).stop 2023-07-14T18:05:22.867 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:22.170+0000 7f8b9d67e700 1 -- 172.21.15.163:0/1219778982 shutdown_connections 2023-07-14T18:05:22.867 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:22.170+0000 7f8b9d67e700 1 --2- 172.21.15.163:0/1219778982 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f8b981067f0 0x7f8b98106c00 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:05:22.867 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:22.170+0000 7f8b9d67e700 1 -- 172.21.15.163:0/1219778982 >> 172.21.15.163:0/1219778982 conn(0x7f8b980feec0 msgr2=0x7f8b981012d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:05:22.868 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:22.170+0000 7f8b9d67e700 1 -- 172.21.15.163:0/1219778982 shutdown_connections 2023-07-14T18:05:22.868 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:22.170+0000 7f8b9d67e700 1 -- 172.21.15.163:0/1219778982 wait complete. 2023-07-14T18:05:22.868 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:22.171+0000 7f8b9d67e700 1 Processor -- start 2023-07-14T18:05:22.868 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:22.171+0000 7f8b9d67e700 1 -- start start 2023-07-14T18:05:22.868 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:22.171+0000 7f8b9d67e700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f8b981067f0 0x7f8b98198f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:05:22.868 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:22.171+0000 7f8b9d67e700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b981994c0 con 0x7f8b981067f0 2023-07-14T18:05:22.868 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:22.171+0000 7f8b96ffd700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f8b981067f0 0x7f8b98198f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:05:22.869 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:22.171+0000 7f8b96ffd700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f8b981067f0 0x7f8b98198f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:54744/0 (socket says 172.21.15.163:54744) 2023-07-14T18:05:22.869 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:22.171+0000 7f8b96ffd700 1 -- 172.21.15.163:0/407225171 learned_addr learned my addr 172.21.15.163:0/407225171 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:05:22.869 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:22.171+0000 7f8b96ffd700 1 -- 172.21.15.163:0/407225171 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b8c009550 con 0x7f8b981067f0 2023-07-14T18:05:22.869 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:22.171+0000 7f8b96ffd700 1 --2- 172.21.15.163:0/407225171 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f8b981067f0 0x7f8b98198f80 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f8b8c006af0 tx=0x7f8b8c011e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:05:22.869 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:22.172+0000 7f8b7ffff700 1 -- 172.21.15.163:0/407225171 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8b8c0037d0 con 0x7f8b981067f0 2023-07-14T18:05:22.869 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:22.172+0000 7f8b7ffff700 1 -- 172.21.15.163:0/407225171 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f8b8c01b440 con 0x7f8b981067f0 2023-07-14T18:05:22.869 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:22.172+0000 7f8b9d67e700 1 -- 172.21.15.163:0/407225171 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8b981996c0 con 0x7f8b981067f0 2023-07-14T18:05:22.869 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:22.172+0000 7f8b7ffff700 1 -- 172.21.15.163:0/407225171 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8b8c0193d0 con 0x7f8b981067f0 2023-07-14T18:05:22.870 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:22.172+0000 7f8b9d67e700 1 -- 172.21.15.163:0/407225171 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b98199ae0 con 0x7f8b981067f0 2023-07-14T18:05:22.870 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:22.172+0000 7f8b7ffff700 1 -- 172.21.15.163:0/407225171 <== mon.0 v2:172.21.15.163:3300/0 4 ==== mgrmap(e 13) v1 ==== 45540+0+0 (secure 0 0 0) 0x7f8b8c019690 con 0x7f8b981067f0 2023-07-14T18:05:22.870 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:22.173+0000 7f8b7ffff700 1 --2- 172.21.15.163:0/407225171 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f8b800387b0 0x7f8b8003ac60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:05:22.870 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:22.173+0000 7f8b7ffff700 1 -- 172.21.15.163:0/407225171 <== mon.0 v2:172.21.15.163:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f8b8c04c780 con 0x7f8b981067f0 2023-07-14T18:05:22.870 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:22.173+0000 7f8b967fc700 1 --2- 172.21.15.163:0/407225171 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f8b800387b0 0x7f8b8003ac60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:05:22.870 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:22.173+0000 7f8b9d67e700 1 -- 172.21.15.163:0/407225171 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8b98103db0 con 0x7f8b981067f0 2023-07-14T18:05:22.870 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:22.173+0000 7f8b967fc700 1 --2- 172.21.15.163:0/407225171 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f8b800387b0 0x7f8b8003ac60 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f8b88006fd0 tx=0x7f8b88006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:05:22.871 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:22.178+0000 7f8b7ffff700 1 -- 172.21.15.163:0/407225171 <== mon.0 v2:172.21.15.163:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178025 (secure 0 0 0) 0x7f8b8c01a3d0 con 0x7f8b981067f0 2023-07-14T18:05:22.871 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:22.468+0000 7f8b9d67e700 1 -- 172.21.15.163:0/407225171 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command([{prefix=config-key set, key=mgr/dashboard/cluster/status}] v 0) v1 -- 0x7f8b98103f40 con 0x7f8b981067f0 2023-07-14T18:05:22.871 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:22.473+0000 7f8b7ffff700 1 -- 172.21.15.163:0/407225171 <== mon.0 v2:172.21.15.163:3300/0 7 ==== mon_command_ack([{prefix=config-key set, key=mgr/dashboard/cluster/status}]=0 set mgr/dashboard/cluster/status v28)=0 set mgr/dashboard/cluster/status v28) v1 ==== 153+0+0 (secure 0 0 0) 0x7f8b8c018350 con 0x7f8b981067f0 2023-07-14T18:05:22.871 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:22.475+0000 7f8b9d67e700 1 -- 172.21.15.163:0/407225171 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f8b800387b0 msgr2=0x7f8b8003ac60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:05:22.871 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:22.475+0000 7f8b9d67e700 1 --2- 172.21.15.163:0/407225171 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f8b800387b0 0x7f8b8003ac60 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f8b88006fd0 tx=0x7f8b88006e40 comp rx=0 tx=0).stop 2023-07-14T18:05:22.871 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:22.475+0000 7f8b9d67e700 1 -- 172.21.15.163:0/407225171 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f8b981067f0 msgr2=0x7f8b98198f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:05:22.871 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:22.475+0000 7f8b9d67e700 1 --2- 172.21.15.163:0/407225171 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f8b981067f0 0x7f8b98198f80 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f8b8c006af0 tx=0x7f8b8c011e80 comp rx=0 tx=0).stop 2023-07-14T18:05:22.871 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:22.476+0000 7f8b9d67e700 1 -- 172.21.15.163:0/407225171 shutdown_connections 2023-07-14T18:05:22.872 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:22.476+0000 7f8b9d67e700 1 --2- 172.21.15.163:0/407225171 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f8b800387b0 0x7f8b8003ac60 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:05:22.872 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:22.476+0000 7f8b9d67e700 1 --2- 172.21.15.163:0/407225171 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f8b981067f0 0x7f8b98198f80 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:05:22.872 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:22.476+0000 7f8b9d67e700 1 -- 172.21.15.163:0/407225171 >> 172.21.15.163:0/407225171 conn(0x7f8b980feec0 msgr2=0x7f8b980ffca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:05:22.872 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:22.476+0000 7f8b9d67e700 1 -- 172.21.15.163:0/407225171 shutdown_connections 2023-07-14T18:05:22.872 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr 2023-07-14T18:05:22.476+0000 7f8b9d67e700 1 -- 172.21.15.163:0/407225171 wait complete. 2023-07-14T18:05:22.872 INFO:teuthology.orchestra.run.smithi163.stdout:/usr/bin/ceph: stderr set mgr/dashboard/cluster/status 2023-07-14T18:05:22.872 INFO:teuthology.orchestra.run.smithi163.stdout:You can access the Ceph CLI as following in case of multi-cluster or non-default config: 2023-07-14T18:05:22.872 INFO:teuthology.orchestra.run.smithi163.stdout: 2023-07-14T18:05:22.873 INFO:teuthology.orchestra.run.smithi163.stdout: sudo /home/ubuntu/cephtest/cephadm shell --fsid bf7326ec-2270-11ee-9b33-001a4aab830c -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring 2023-07-14T18:05:22.873 INFO:teuthology.orchestra.run.smithi163.stdout: 2023-07-14T18:05:22.873 INFO:teuthology.orchestra.run.smithi163.stdout:Or, if you are only running a single cluster on this host: 2023-07-14T18:05:22.873 INFO:teuthology.orchestra.run.smithi163.stdout: 2023-07-14T18:05:22.873 INFO:teuthology.orchestra.run.smithi163.stdout: sudo /home/ubuntu/cephtest/cephadm shell 2023-07-14T18:05:22.873 INFO:teuthology.orchestra.run.smithi163.stdout: 2023-07-14T18:05:22.873 INFO:teuthology.orchestra.run.smithi163.stdout:Please consider enabling telemetry to help improve Ceph: 2023-07-14T18:05:22.874 INFO:teuthology.orchestra.run.smithi163.stdout: 2023-07-14T18:05:22.874 INFO:teuthology.orchestra.run.smithi163.stdout: ceph telemetry on 2023-07-14T18:05:22.874 INFO:teuthology.orchestra.run.smithi163.stdout: 2023-07-14T18:05:22.874 INFO:teuthology.orchestra.run.smithi163.stdout:For more information see: 2023-07-14T18:05:22.874 INFO:teuthology.orchestra.run.smithi163.stdout: 2023-07-14T18:05:22.874 INFO:teuthology.orchestra.run.smithi163.stdout: https://docs.ceph.com/en/latest/mgr/telemetry/ 2023-07-14T18:05:22.875 INFO:teuthology.orchestra.run.smithi163.stdout: 2023-07-14T18:05:22.875 INFO:teuthology.orchestra.run.smithi163.stdout:Bootstrap complete. 2023-07-14T18:05:22.900 INFO:tasks.cephadm:Fetching config... 2023-07-14T18:05:22.900 DEBUG:teuthology.orchestra.run.smithi163:> set -ex 2023-07-14T18:05:22.900 DEBUG:teuthology.orchestra.run.smithi163:> dd if=/etc/ceph/ceph.conf of=/dev/stdout 2023-07-14T18:05:22.917 INFO:tasks.cephadm:Fetching client.admin keyring... 2023-07-14T18:05:22.917 DEBUG:teuthology.orchestra.run.smithi163:> set -ex 2023-07-14T18:05:22.918 DEBUG:teuthology.orchestra.run.smithi163:> dd if=/etc/ceph/ceph.client.admin.keyring of=/dev/stdout 2023-07-14T18:05:22.975 INFO:tasks.cephadm:Fetching mon keyring... 2023-07-14T18:05:22.976 DEBUG:teuthology.orchestra.run.smithi163:> set -ex 2023-07-14T18:05:22.976 DEBUG:teuthology.orchestra.run.smithi163:> sudo dd if=/var/lib/ceph/bf7326ec-2270-11ee-9b33-001a4aab830c/mon.a/keyring of=/dev/stdout 2023-07-14T18:05:23.043 INFO:tasks.cephadm:Fetching pub ssh key... 2023-07-14T18:05:23.043 DEBUG:teuthology.orchestra.run.smithi163:> set -ex 2023-07-14T18:05:23.044 DEBUG:teuthology.orchestra.run.smithi163:> dd if=/home/ubuntu/cephtest/ceph.pub of=/dev/stdout 2023-07-14T18:05:23.100 INFO:tasks.cephadm:Installing pub ssh key for root users... 2023-07-14T18:05:23.100 DEBUG:teuthology.orchestra.run.smithi163:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCi8DSuLRgk0hQA+UFayHR+putkJZIlJWsMuPm0Z0sWknQUyVpjsFRjWFLMiaUg+vaXpZmiImcI+EVzmlJUG5FhzQ7up3qkyNNzob68JBh0VmLYHwRLa9FLVr7OtsyYAF1l9Nn4cHS4XJ9S4mSFsTSM5z1yxdXBNB3KTjQ5+mFR3sqcX2uOD9RlKjNOBAtwVLoXun0bKQ6bjRR5sSwPkUSgtQj/JdgUR5AIJfIN5sxS7lWojyRxtAHXjmYhO3Oa0WT4htev48ePta0lu3bVfCXcMgsGcbfP5VGMKnq15hFVFaTjZGad3H31yahFQE2zjYwkC7V0aKCzwUZe3fpzo3NRZv0uaWAa69dDoF5R/BWOKmmJ5eUVJoGfDKsVZgtkCJUDMREuw/94CZ3H2OpFz5GKc/QrMVvDkvcKft7ftJilratQE4TAgYvLzbLecoMyd9PFceGMMOHElrKJwfM84NeFuxtVczoUR26vfcIyau68JV7GFtNdV+ljqn0goHO1J1c= ceph-bf7326ec-2270-11ee-9b33-001a4aab830c' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2023-07-14T18:05:23.146 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:05:23 smithi163 ceph-mon[96576]: mgrmap e13: x(active, since 6s) 2023-07-14T18:05:23.146 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:05:23 smithi163 ceph-mon[96576]: from='client.? 172.21.15.163:0/407225171' entity='client.admin' 2023-07-14T18:05:23.185 INFO:teuthology.orchestra.run.smithi163.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCi8DSuLRgk0hQA+UFayHR+putkJZIlJWsMuPm0Z0sWknQUyVpjsFRjWFLMiaUg+vaXpZmiImcI+EVzmlJUG5FhzQ7up3qkyNNzob68JBh0VmLYHwRLa9FLVr7OtsyYAF1l9Nn4cHS4XJ9S4mSFsTSM5z1yxdXBNB3KTjQ5+mFR3sqcX2uOD9RlKjNOBAtwVLoXun0bKQ6bjRR5sSwPkUSgtQj/JdgUR5AIJfIN5sxS7lWojyRxtAHXjmYhO3Oa0WT4htev48ePta0lu3bVfCXcMgsGcbfP5VGMKnq15hFVFaTjZGad3H31yahFQE2zjYwkC7V0aKCzwUZe3fpzo3NRZv0uaWAa69dDoF5R/BWOKmmJ5eUVJoGfDKsVZgtkCJUDMREuw/94CZ3H2OpFz5GKc/QrMVvDkvcKft7ftJilratQE4TAgYvLzbLecoMyd9PFceGMMOHElrKJwfM84NeFuxtVczoUR26vfcIyau68JV7GFtNdV+ljqn0goHO1J1c= ceph-bf7326ec-2270-11ee-9b33-001a4aab830c 2023-07-14T18:05:23.198 DEBUG:teuthology.orchestra.run.smithi172:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCi8DSuLRgk0hQA+UFayHR+putkJZIlJWsMuPm0Z0sWknQUyVpjsFRjWFLMiaUg+vaXpZmiImcI+EVzmlJUG5FhzQ7up3qkyNNzob68JBh0VmLYHwRLa9FLVr7OtsyYAF1l9Nn4cHS4XJ9S4mSFsTSM5z1yxdXBNB3KTjQ5+mFR3sqcX2uOD9RlKjNOBAtwVLoXun0bKQ6bjRR5sSwPkUSgtQj/JdgUR5AIJfIN5sxS7lWojyRxtAHXjmYhO3Oa0WT4htev48ePta0lu3bVfCXcMgsGcbfP5VGMKnq15hFVFaTjZGad3H31yahFQE2zjYwkC7V0aKCzwUZe3fpzo3NRZv0uaWAa69dDoF5R/BWOKmmJ5eUVJoGfDKsVZgtkCJUDMREuw/94CZ3H2OpFz5GKc/QrMVvDkvcKft7ftJilratQE4TAgYvLzbLecoMyd9PFceGMMOHElrKJwfM84NeFuxtVczoUR26vfcIyau68JV7GFtNdV+ljqn0goHO1J1c= ceph-bf7326ec-2270-11ee-9b33-001a4aab830c' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2023-07-14T18:05:23.243 INFO:teuthology.orchestra.run.smithi172.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCi8DSuLRgk0hQA+UFayHR+putkJZIlJWsMuPm0Z0sWknQUyVpjsFRjWFLMiaUg+vaXpZmiImcI+EVzmlJUG5FhzQ7up3qkyNNzob68JBh0VmLYHwRLa9FLVr7OtsyYAF1l9Nn4cHS4XJ9S4mSFsTSM5z1yxdXBNB3KTjQ5+mFR3sqcX2uOD9RlKjNOBAtwVLoXun0bKQ6bjRR5sSwPkUSgtQj/JdgUR5AIJfIN5sxS7lWojyRxtAHXjmYhO3Oa0WT4htev48ePta0lu3bVfCXcMgsGcbfP5VGMKnq15hFVFaTjZGad3H31yahFQE2zjYwkC7V0aKCzwUZe3fpzo3NRZv0uaWAa69dDoF5R/BWOKmmJ5eUVJoGfDKsVZgtkCJUDMREuw/94CZ3H2OpFz5GKc/QrMVvDkvcKft7ftJilratQE4TAgYvLzbLecoMyd9PFceGMMOHElrKJwfM84NeFuxtVczoUR26vfcIyau68JV7GFtNdV+ljqn0goHO1J1c= ceph-bf7326ec-2270-11ee-9b33-001a4aab830c 2023-07-14T18:05:23.256 DEBUG:teuthology.orchestra.run.smithi184:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCi8DSuLRgk0hQA+UFayHR+putkJZIlJWsMuPm0Z0sWknQUyVpjsFRjWFLMiaUg+vaXpZmiImcI+EVzmlJUG5FhzQ7up3qkyNNzob68JBh0VmLYHwRLa9FLVr7OtsyYAF1l9Nn4cHS4XJ9S4mSFsTSM5z1yxdXBNB3KTjQ5+mFR3sqcX2uOD9RlKjNOBAtwVLoXun0bKQ6bjRR5sSwPkUSgtQj/JdgUR5AIJfIN5sxS7lWojyRxtAHXjmYhO3Oa0WT4htev48ePta0lu3bVfCXcMgsGcbfP5VGMKnq15hFVFaTjZGad3H31yahFQE2zjYwkC7V0aKCzwUZe3fpzo3NRZv0uaWAa69dDoF5R/BWOKmmJ5eUVJoGfDKsVZgtkCJUDMREuw/94CZ3H2OpFz5GKc/QrMVvDkvcKft7ftJilratQE4TAgYvLzbLecoMyd9PFceGMMOHElrKJwfM84NeFuxtVczoUR26vfcIyau68JV7GFtNdV+ljqn0goHO1J1c= ceph-bf7326ec-2270-11ee-9b33-001a4aab830c' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2023-07-14T18:05:23.301 INFO:teuthology.orchestra.run.smithi184.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCi8DSuLRgk0hQA+UFayHR+putkJZIlJWsMuPm0Z0sWknQUyVpjsFRjWFLMiaUg+vaXpZmiImcI+EVzmlJUG5FhzQ7up3qkyNNzob68JBh0VmLYHwRLa9FLVr7OtsyYAF1l9Nn4cHS4XJ9S4mSFsTSM5z1yxdXBNB3KTjQ5+mFR3sqcX2uOD9RlKjNOBAtwVLoXun0bKQ6bjRR5sSwPkUSgtQj/JdgUR5AIJfIN5sxS7lWojyRxtAHXjmYhO3Oa0WT4htev48ePta0lu3bVfCXcMgsGcbfP5VGMKnq15hFVFaTjZGad3H31yahFQE2zjYwkC7V0aKCzwUZe3fpzo3NRZv0uaWAa69dDoF5R/BWOKmmJ5eUVJoGfDKsVZgtkCJUDMREuw/94CZ3H2OpFz5GKc/QrMVvDkvcKft7ftJilratQE4TAgYvLzbLecoMyd9PFceGMMOHElrKJwfM84NeFuxtVczoUR26vfcIyau68JV7GFtNdV+ljqn0goHO1J1c= ceph-bf7326ec-2270-11ee-9b33-001a4aab830c 2023-07-14T18:05:23.313 DEBUG:teuthology.orchestra.run.smithi163:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81c9387d2e7576da065747ec9c16d1c7d69016ec shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bf7326ec-2270-11ee-9b33-001a4aab830c -- ceph config set mgr mgr/cephadm/allow_ptrace true 2023-07-14T18:05:23.769 INFO:teuthology.orchestra.run.smithi163.stderr:Inferring config /var/lib/ceph/bf7326ec-2270-11ee-9b33-001a4aab830c/mon.a/config 2023-07-14T18:05:25.578 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:05:25.546+0000 7f11f3374700 1 -- 172.21.15.163:0/3378895701 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f11ec0fe620 msgr2=0x7f11ec0fea30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:05:25.578 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:05:25.546+0000 7f11f3374700 1 --2- 172.21.15.163:0/3378895701 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f11ec0fe620 0x7f11ec0fea30 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f11e400b0a0 tx=0x7f11e400b3b0 comp rx=0 tx=0).stop 2023-07-14T18:05:25.578 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:05:25.546+0000 7f11f3374700 1 -- 172.21.15.163:0/3378895701 shutdown_connections 2023-07-14T18:05:25.578 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:05:25.546+0000 7f11f3374700 1 --2- 172.21.15.163:0/3378895701 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f11ec0fe620 0x7f11ec0fea30 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:05:25.578 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:05:25.546+0000 7f11f3374700 1 -- 172.21.15.163:0/3378895701 >> 172.21.15.163:0/3378895701 conn(0x7f11ec0f9bd0 msgr2=0x7f11ec0fc000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:05:25.579 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:05:25.547+0000 7f11f3374700 1 -- 172.21.15.163:0/3378895701 shutdown_connections 2023-07-14T18:05:25.579 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:05:25.547+0000 7f11f3374700 1 -- 172.21.15.163:0/3378895701 wait complete. 2023-07-14T18:05:25.580 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:05:25.547+0000 7f11f3374700 1 Processor -- start 2023-07-14T18:05:25.580 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:05:25.547+0000 7f11f3374700 1 -- start start 2023-07-14T18:05:25.580 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:05:25.548+0000 7f11f3374700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f11ec0fe620 0x7f11ec193620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:05:25.581 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:05:25.548+0000 7f11f3374700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11ec193b60 con 0x7f11ec0fe620 2023-07-14T18:05:25.581 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:05:25.548+0000 7f11f1110700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f11ec0fe620 0x7f11ec193620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:05:25.581 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:05:25.548+0000 7f11f1110700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f11ec0fe620 0x7f11ec193620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:54750/0 (socket says 172.21.15.163:54750) 2023-07-14T18:05:25.581 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:05:25.548+0000 7f11f1110700 1 -- 172.21.15.163:0/513341245 learned_addr learned my addr 172.21.15.163:0/513341245 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:05:25.581 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:05:25.548+0000 7f11f1110700 1 -- 172.21.15.163:0/513341245 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11e4009d00 con 0x7f11ec0fe620 2023-07-14T18:05:25.581 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:05:25.548+0000 7f11f1110700 1 --2- 172.21.15.163:0/513341245 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f11ec0fe620 0x7f11ec193620 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f11e4003f40 tx=0x7f11e4003ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:05:25.581 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:05:25.548+0000 7f11ea7fc700 1 -- 172.21.15.163:0/513341245 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f11e400e040 con 0x7f11ec0fe620 2023-07-14T18:05:25.582 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:05:25.548+0000 7f11ea7fc700 1 -- 172.21.15.163:0/513341245 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f11e400bc70 con 0x7f11ec0fe620 2023-07-14T18:05:25.582 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:05:25.548+0000 7f11f3374700 1 -- 172.21.15.163:0/513341245 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f11ec193d60 con 0x7f11ec0fe620 2023-07-14T18:05:25.582 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:05:25.548+0000 7f11ea7fc700 1 -- 172.21.15.163:0/513341245 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f11e4012650 con 0x7f11ec0fe620 2023-07-14T18:05:25.582 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:05:25.548+0000 7f11f3374700 1 -- 172.21.15.163:0/513341245 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11ec194260 con 0x7f11ec0fe620 2023-07-14T18:05:25.582 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:05:25.549+0000 7f11ea7fc700 1 -- 172.21.15.163:0/513341245 <== mon.0 v2:172.21.15.163:3300/0 4 ==== mgrmap(e 13) v1 ==== 45540+0+0 (secure 0 0 0) 0x7f11e4019070 con 0x7f11ec0fe620 2023-07-14T18:05:25.582 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:05:25.549+0000 7f11f3374700 1 -- 172.21.15.163:0/513341245 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f11ec18d0a0 con 0x7f11ec0fe620 2023-07-14T18:05:25.582 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:05:25.549+0000 7f11ea7fc700 1 --2- 172.21.15.163:0/513341245 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f11d4038850 0x7f11d403ad00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:05:25.582 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:05:25.549+0000 7f11ea7fc700 1 -- 172.21.15.163:0/513341245 <== mon.0 v2:172.21.15.163:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f11e404cba0 con 0x7f11ec0fe620 2023-07-14T18:05:25.583 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:05:25.550+0000 7f11f090f700 1 --2- 172.21.15.163:0/513341245 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f11d4038850 0x7f11d403ad00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:05:25.583 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:05:25.550+0000 7f11f090f700 1 --2- 172.21.15.163:0/513341245 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f11d4038850 0x7f11d403ad00 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f11e0006fd0 tx=0x7f11e0006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:05:25.585 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:05:25.554+0000 7f11ea7fc700 1 -- 172.21.15.163:0/513341245 <== mon.0 v2:172.21.15.163:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178025 (secure 0 0 0) 0x7f11e4025590 con 0x7f11ec0fe620 2023-07-14T18:05:25.775 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:05:25.745+0000 7f11f3374700 1 -- 172.21.15.163:0/513341245 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/allow_ptrace}] v 0) v1 -- 0x7f11ec02c8e0 con 0x7f11ec0fe620 2023-07-14T18:05:25.781 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:05:25.750+0000 7f11ea7fc700 1 -- 172.21.15.163:0/513341245 <== mon.0 v2:172.21.15.163:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/allow_ptrace}]=0 v9)=0 v9) v1 ==== 125+0+0 (secure 0 0 0) 0x7f11e4021020 con 0x7f11ec0fe620 2023-07-14T18:05:25.783 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:05:25.753+0000 7f11f3374700 1 -- 172.21.15.163:0/513341245 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f11d4038850 msgr2=0x7f11d403ad00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:05:25.784 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:05:25.753+0000 7f11f3374700 1 --2- 172.21.15.163:0/513341245 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f11d4038850 0x7f11d403ad00 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f11e0006fd0 tx=0x7f11e0006e40 comp rx=0 tx=0).stop 2023-07-14T18:05:25.784 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:05:25.753+0000 7f11f3374700 1 -- 172.21.15.163:0/513341245 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f11ec0fe620 msgr2=0x7f11ec193620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:05:25.784 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:05:25.753+0000 7f11f3374700 1 --2- 172.21.15.163:0/513341245 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f11ec0fe620 0x7f11ec193620 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f11e4003f40 tx=0x7f11e4003ce0 comp rx=0 tx=0).stop 2023-07-14T18:05:25.784 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:05:25.753+0000 7f11f3374700 1 -- 172.21.15.163:0/513341245 shutdown_connections 2023-07-14T18:05:25.784 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:05:25.753+0000 7f11f3374700 1 --2- 172.21.15.163:0/513341245 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f11d4038850 0x7f11d403ad00 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:05:25.784 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:05:25.753+0000 7f11f3374700 1 --2- 172.21.15.163:0/513341245 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f11ec0fe620 0x7f11ec193620 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:05:25.785 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:05:25.753+0000 7f11f3374700 1 -- 172.21.15.163:0/513341245 >> 172.21.15.163:0/513341245 conn(0x7f11ec0f9bd0 msgr2=0x7f11ec0fa8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:05:25.785 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:05:25.753+0000 7f11f3374700 1 -- 172.21.15.163:0/513341245 shutdown_connections 2023-07-14T18:05:25.785 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:05:25.753+0000 7f11f3374700 1 -- 172.21.15.163:0/513341245 wait complete. 2023-07-14T18:05:26.281 INFO:tasks.cephadm:Distributing conf and client.admin keyring to all hosts + 0755 2023-07-14T18:05:26.282 DEBUG:teuthology.orchestra.run.smithi163:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81c9387d2e7576da065747ec9c16d1c7d69016ec shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bf7326ec-2270-11ee-9b33-001a4aab830c -- ceph orch client-keyring set client.admin '*' --mode 0755 2023-07-14T18:05:26.833 INFO:teuthology.orchestra.run.smithi163.stderr:Inferring config /var/lib/ceph/bf7326ec-2270-11ee-9b33-001a4aab830c/mon.a/config 2023-07-14T18:05:27.044 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:05:26 smithi163 ceph-mon[96576]: from='client.? 172.21.15.163:0/513341245' entity='client.admin' 2023-07-14T18:05:27.045 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:05:26 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:05:27.045 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:05:26 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:05:27.045 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:05:26 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi163", "name": "osd_memory_target"}]: dispatch 2023-07-14T18:05:27.045 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:05:26 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:05:27.045 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:05:26 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-14T18:05:27.045 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:05:26 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:05:27.979 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:05:27.947+0000 7f6296221700 1 -- 172.21.15.163:0/3120078591 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f62900ff730 msgr2=0x7f62900ffb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:05:27.979 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:05:27.947+0000 7f6296221700 1 --2- 172.21.15.163:0/3120078591 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f62900ff730 0x7f62900ffb40 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f6284009910 tx=0x7f6284009c20 comp rx=0 tx=0).stop 2023-07-14T18:05:27.980 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:05:27.947+0000 7f6296221700 1 -- 172.21.15.163:0/3120078591 shutdown_connections 2023-07-14T18:05:27.980 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:05:27.947+0000 7f6296221700 1 --2- 172.21.15.163:0/3120078591 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f62900ff730 0x7f62900ffb40 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:05:27.980 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:05:27.947+0000 7f6296221700 1 -- 172.21.15.163:0/3120078591 >> 172.21.15.163:0/3120078591 conn(0x7f62900face0 msgr2=0x7f62900fd110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:05:27.980 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:05:27.947+0000 7f6296221700 1 -- 172.21.15.163:0/3120078591 shutdown_connections 2023-07-14T18:05:27.980 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:05:27.947+0000 7f6296221700 1 -- 172.21.15.163:0/3120078591 wait complete. 2023-07-14T18:05:27.980 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:05:27.948+0000 7f6296221700 1 Processor -- start 2023-07-14T18:05:27.980 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:05:27.948+0000 7f6296221700 1 -- start start 2023-07-14T18:05:27.981 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:05:27.948+0000 7f6296221700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f62900ff730 0x7f62901947e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:05:27.981 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:05:27.948+0000 7f6296221700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6290194d20 con 0x7f62900ff730 2023-07-14T18:05:27.981 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:05:27.948+0000 7f628f7fe700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f62900ff730 0x7f62901947e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:05:27.981 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:05:27.948+0000 7f628f7fe700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f62900ff730 0x7f62901947e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:54756/0 (socket says 172.21.15.163:54756) 2023-07-14T18:05:27.981 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:05:27.948+0000 7f628f7fe700 1 -- 172.21.15.163:0/1631151984 learned_addr learned my addr 172.21.15.163:0/1631151984 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:05:27.981 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:05:27.948+0000 7f628f7fe700 1 -- 172.21.15.163:0/1631151984 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62840095f0 con 0x7f62900ff730 2023-07-14T18:05:27.981 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:05:27.948+0000 7f628f7fe700 1 --2- 172.21.15.163:0/1631151984 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f62900ff730 0x7f62901947e0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f6284006010 tx=0x7f6284005810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:05:27.982 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:05:27.949+0000 7f628cff9700 1 -- 172.21.15.163:0/1631151984 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f628400ba90 con 0x7f62900ff730 2023-07-14T18:05:27.983 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:05:27.949+0000 7f628cff9700 1 -- 172.21.15.163:0/1631151984 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f628400bbf0 con 0x7f62900ff730 2023-07-14T18:05:27.983 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:05:27.949+0000 7f6296221700 1 -- 172.21.15.163:0/1631151984 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6290194f20 con 0x7f62900ff730 2023-07-14T18:05:27.983 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:05:27.949+0000 7f628cff9700 1 -- 172.21.15.163:0/1631151984 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6284017440 con 0x7f62900ff730 2023-07-14T18:05:27.983 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:05:27.949+0000 7f6296221700 1 -- 172.21.15.163:0/1631151984 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f62901953c0 con 0x7f62900ff730 2023-07-14T18:05:27.983 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:05:27.950+0000 7f628cff9700 1 -- 172.21.15.163:0/1631151984 <== mon.0 v2:172.21.15.163:3300/0 4 ==== mgrmap(e 13) v1 ==== 45540+0+0 (secure 0 0 0) 0x7f6284017670 con 0x7f62900ff730 2023-07-14T18:05:27.983 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:05:27.950+0000 7f628cff9700 1 --2- 172.21.15.163:0/1631151984 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f62780387b0 0x7f627803ac60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:05:27.983 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:05:27.950+0000 7f6296221700 1 -- 172.21.15.163:0/1631151984 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f629018e1b0 con 0x7f62900ff730 2023-07-14T18:05:27.984 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:05:27.950+0000 7f628cff9700 1 -- 172.21.15.163:0/1631151984 <== mon.0 v2:172.21.15.163:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f628404ca80 con 0x7f62900ff730 2023-07-14T18:05:27.984 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:05:27.950+0000 7f628effd700 1 --2- 172.21.15.163:0/1631151984 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f62780387b0 0x7f627803ac60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:05:27.984 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:05:27.950+0000 7f628effd700 1 --2- 172.21.15.163:0/1631151984 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f62780387b0 0x7f627803ac60 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f6280006fd0 tx=0x7f6280006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:05:27.985 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:05:27.955+0000 7f628cff9700 1 -- 172.21.15.163:0/1631151984 <== mon.0 v2:172.21.15.163:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178025 (secure 0 0 0) 0x7f6284015d90 con 0x7f62900ff730 2023-07-14T18:05:28.176 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:05:28.145+0000 7f6296221700 1 -- 172.21.15.163:0/1631151984 --> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] -- mgr_command(tid 0: {"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}) v1 -- 0x7f6290060b10 con 0x7f62780387b0 2023-07-14T18:05:28.179 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:05:28.148+0000 7f628cff9700 1 -- 172.21.15.163:0/1631151984 <== mgr.14152 v2:172.21.15.163:6800/1949590926 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f6290060b10 con 0x7f62780387b0 2023-07-14T18:05:28.181 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:05:28.150+0000 7f6296221700 1 -- 172.21.15.163:0/1631151984 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f62780387b0 msgr2=0x7f627803ac60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:05:28.182 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:05:28.150+0000 7f6296221700 1 --2- 172.21.15.163:0/1631151984 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f62780387b0 0x7f627803ac60 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f6280006fd0 tx=0x7f6280006e40 comp rx=0 tx=0).stop 2023-07-14T18:05:28.182 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:05:28.150+0000 7f6296221700 1 -- 172.21.15.163:0/1631151984 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f62900ff730 msgr2=0x7f62901947e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:05:28.182 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:05:28.151+0000 7f6296221700 1 --2- 172.21.15.163:0/1631151984 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f62900ff730 0x7f62901947e0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f6284006010 tx=0x7f6284005810 comp rx=0 tx=0).stop 2023-07-14T18:05:28.182 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:05:28.151+0000 7f6296221700 1 -- 172.21.15.163:0/1631151984 shutdown_connections 2023-07-14T18:05:28.182 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:05:28.151+0000 7f6296221700 1 --2- 172.21.15.163:0/1631151984 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f62780387b0 0x7f627803ac60 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:05:28.182 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:05:28.151+0000 7f6296221700 1 --2- 172.21.15.163:0/1631151984 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f62900ff730 0x7f62901947e0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:05:28.182 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:05:28.151+0000 7f6296221700 1 -- 172.21.15.163:0/1631151984 >> 172.21.15.163:0/1631151984 conn(0x7f62900face0 msgr2=0x7f62900fba90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:05:28.183 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:05:28.151+0000 7f6296221700 1 -- 172.21.15.163:0/1631151984 shutdown_connections 2023-07-14T18:05:28.183 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:05:28.151+0000 7f6296221700 1 -- 172.21.15.163:0/1631151984 wait complete. 2023-07-14T18:05:28.590 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi172 2023-07-14T18:05:28.590 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2023-07-14T18:05:28.590 DEBUG:teuthology.orchestra.run.smithi172:> dd of=/etc/ceph/ceph.conf 2023-07-14T18:05:28.610 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2023-07-14T18:05:28.611 DEBUG:teuthology.orchestra.run.smithi172:> dd of=/etc/ceph/ceph.client.admin.keyring 2023-07-14T18:05:28.669 INFO:tasks.cephadm:Adding host smithi172 to orchestrator... 2023-07-14T18:05:28.670 DEBUG:teuthology.orchestra.run.smithi163:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81c9387d2e7576da065747ec9c16d1c7d69016ec shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bf7326ec-2270-11ee-9b33-001a4aab830c -- ceph orch host add smithi172 2023-07-14T18:05:29.240 INFO:teuthology.orchestra.run.smithi163.stderr:Inferring config /var/lib/ceph/bf7326ec-2270-11ee-9b33-001a4aab830c/mon.a/config 2023-07-14T18:05:29.434 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:05:29 smithi163 ceph-mon[96576]: from='client.14176 -' entity='client.admin' cmd=[{"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}]: dispatch 2023-07-14T18:05:29.434 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:05:29 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:05:29.435 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:05:29 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-14T18:05:29.435 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:05:29 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T18:05:29.435 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:05:29 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-14T18:05:29.435 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:05:29 smithi163 ceph-mon[96576]: Updating smithi163:/etc/ceph/ceph.conf 2023-07-14T18:05:29.435 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:05:29 smithi163 ceph-mon[96576]: Updating smithi163:/var/lib/ceph/bf7326ec-2270-11ee-9b33-001a4aab830c/config/ceph.conf 2023-07-14T18:05:29.435 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:05:29 smithi163 ceph-mon[96576]: Updating smithi163:/etc/ceph/ceph.client.admin.keyring 2023-07-14T18:05:29.435 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:05:29 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:05:29.436 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:05:29 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:05:29.436 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:05:29 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:05:30.431 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:05:30.399+0000 7f57cdbb4700 1 -- 172.21.15.163:0/2569462184 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f57c8104650 msgr2=0x7f57c8104a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:05:30.431 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:05:30.399+0000 7f57cdbb4700 1 --2- 172.21.15.163:0/2569462184 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f57c8104650 0x7f57c8104a20 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f57b8009910 tx=0x7f57b8009c20 comp rx=0 tx=0).stop 2023-07-14T18:05:30.432 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:05:30.400+0000 7f57cdbb4700 1 -- 172.21.15.163:0/2569462184 shutdown_connections 2023-07-14T18:05:30.432 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:05:30.400+0000 7f57cdbb4700 1 --2- 172.21.15.163:0/2569462184 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f57c8104650 0x7f57c8104a20 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:05:30.432 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:05:30.400+0000 7f57cdbb4700 1 -- 172.21.15.163:0/2569462184 >> 172.21.15.163:0/2569462184 conn(0x7f57c80743e0 msgr2=0x7f57c80747e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:05:30.432 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:05:30.400+0000 7f57cdbb4700 1 -- 172.21.15.163:0/2569462184 shutdown_connections 2023-07-14T18:05:30.432 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:05:30.400+0000 7f57cdbb4700 1 -- 172.21.15.163:0/2569462184 wait complete. 2023-07-14T18:05:30.432 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:05:30.400+0000 7f57cdbb4700 1 Processor -- start 2023-07-14T18:05:30.433 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:05:30.400+0000 7f57cdbb4700 1 -- start start 2023-07-14T18:05:30.433 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:05:30.401+0000 7f57cdbb4700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f57c8104650 0x7f57c8199840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:05:30.433 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:05:30.401+0000 7f57cdbb4700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57c8199d80 con 0x7f57c8104650 2023-07-14T18:05:30.433 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:05:30.401+0000 7f57c77fe700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f57c8104650 0x7f57c8199840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:05:30.433 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:05:30.401+0000 7f57c77fe700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f57c8104650 0x7f57c8199840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:54762/0 (socket says 172.21.15.163:54762) 2023-07-14T18:05:30.433 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:05:30.401+0000 7f57c77fe700 1 -- 172.21.15.163:0/2453409414 learned_addr learned my addr 172.21.15.163:0/2453409414 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:05:30.433 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:05:30.401+0000 7f57c77fe700 1 -- 172.21.15.163:0/2453409414 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57b80095f0 con 0x7f57c8104650 2023-07-14T18:05:30.433 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:05:30.401+0000 7f57c77fe700 1 --2- 172.21.15.163:0/2453409414 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f57c8104650 0x7f57c8199840 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f57b8006010 tx=0x7f57b8004ff0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:05:30.434 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:05:30.401+0000 7f57c4ff9700 1 -- 172.21.15.163:0/2453409414 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f57b801d070 con 0x7f57c8104650 2023-07-14T18:05:30.434 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:05:30.401+0000 7f57cdbb4700 1 -- 172.21.15.163:0/2453409414 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f57c8199f80 con 0x7f57c8104650 2023-07-14T18:05:30.434 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:05:30.401+0000 7f57c4ff9700 1 -- 172.21.15.163:0/2453409414 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f57b80044b0 con 0x7f57c8104650 2023-07-14T18:05:30.434 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:05:30.401+0000 7f57c4ff9700 1 -- 172.21.15.163:0/2453409414 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f57b8003840 con 0x7f57c8104650 2023-07-14T18:05:30.435 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:05:30.401+0000 7f57cdbb4700 1 -- 172.21.15.163:0/2453409414 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f57c8193830 con 0x7f57c8104650 2023-07-14T18:05:30.435 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:05:30.402+0000 7f57c4ff9700 1 -- 172.21.15.163:0/2453409414 <== mon.0 v2:172.21.15.163:3300/0 4 ==== mgrmap(e 13) v1 ==== 45540+0+0 (secure 0 0 0) 0x7f57b8003ac0 con 0x7f57c8104650 2023-07-14T18:05:30.435 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:05:30.402+0000 7f57cdbb4700 1 -- 172.21.15.163:0/2453409414 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f57c8061c70 con 0x7f57c8104650 2023-07-14T18:05:30.435 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:05:30.402+0000 7f57c4ff9700 1 --2- 172.21.15.163:0/2453409414 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f57b00387b0 0x7f57b003ac60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:05:30.435 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:05:30.403+0000 7f57c4ff9700 1 -- 172.21.15.163:0/2453409414 <== mon.0 v2:172.21.15.163:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f57b804c850 con 0x7f57c8104650 2023-07-14T18:05:30.436 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:05:30.403+0000 7f57c6ffd700 1 --2- 172.21.15.163:0/2453409414 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f57b00387b0 0x7f57b003ac60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:05:30.436 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:05:30.403+0000 7f57c6ffd700 1 --2- 172.21.15.163:0/2453409414 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f57b00387b0 0x7f57b003ac60 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f57bc006fd0 tx=0x7f57bc006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:05:30.437 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:05:30.407+0000 7f57c4ff9700 1 -- 172.21.15.163:0/2453409414 <== mon.0 v2:172.21.15.163:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178025 (secure 0 0 0) 0x7f57b802a770 con 0x7f57c8104650 2023-07-14T18:05:30.457 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:05:30 smithi163 ceph-mon[96576]: Updating smithi163:/var/lib/ceph/bf7326ec-2270-11ee-9b33-001a4aab830c/config/ceph.client.admin.keyring 2023-07-14T18:05:30.625 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:05:30.595+0000 7f57cdbb4700 1 -- 172.21.15.163:0/2453409414 --> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi172", "target": ["mon-mgr", ""]}) v1 -- 0x7f57c81942c0 con 0x7f57b00387b0 2023-07-14T18:05:31.957 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:05:31 smithi163 ceph-mon[96576]: from='client.14178 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi172", "target": ["mon-mgr", ""]}]: dispatch 2023-07-14T18:05:32.905 INFO:teuthology.orchestra.run.smithi163.stdout:Added host 'smithi172' with addr '172.21.15.172' 2023-07-14T18:05:32.905 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:05:32.875+0000 7f57c4ff9700 1 -- 172.21.15.163:0/2453409414 <== mgr.14152 v2:172.21.15.163:6800/1949590926 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+49 (secure 0 0 0) 0x7f57c81942c0 con 0x7f57b00387b0 2023-07-14T18:05:32.907 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:05:32.877+0000 7f57cdbb4700 1 -- 172.21.15.163:0/2453409414 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f57b00387b0 msgr2=0x7f57b003ac60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:05:32.907 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:05:32.877+0000 7f57cdbb4700 1 --2- 172.21.15.163:0/2453409414 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f57b00387b0 0x7f57b003ac60 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f57bc006fd0 tx=0x7f57bc006e40 comp rx=0 tx=0).stop 2023-07-14T18:05:32.907 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:05:32.877+0000 7f57cdbb4700 1 -- 172.21.15.163:0/2453409414 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f57c8104650 msgr2=0x7f57c8199840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:05:32.908 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:05:32.877+0000 7f57cdbb4700 1 --2- 172.21.15.163:0/2453409414 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f57c8104650 0x7f57c8199840 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f57b8006010 tx=0x7f57b8004ff0 comp rx=0 tx=0).stop 2023-07-14T18:05:32.908 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:05:32.877+0000 7f57cdbb4700 1 -- 172.21.15.163:0/2453409414 shutdown_connections 2023-07-14T18:05:32.908 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:05:32.877+0000 7f57cdbb4700 1 --2- 172.21.15.163:0/2453409414 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f57b00387b0 0x7f57b003ac60 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:05:32.908 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:05:32.877+0000 7f57cdbb4700 1 --2- 172.21.15.163:0/2453409414 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f57c8104650 0x7f57c8199840 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:05:32.908 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:05:32.877+0000 7f57cdbb4700 1 -- 172.21.15.163:0/2453409414 >> 172.21.15.163:0/2453409414 conn(0x7f57c80743e0 msgr2=0x7f57c8105c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:05:32.908 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:05:32.877+0000 7f57cdbb4700 1 -- 172.21.15.163:0/2453409414 shutdown_connections 2023-07-14T18:05:32.908 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:05:32.877+0000 7f57cdbb4700 1 -- 172.21.15.163:0/2453409414 wait complete. 2023-07-14T18:05:32.957 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:05:32 smithi163 ceph-mon[96576]: Deploying cephadm binary to smithi172 2023-07-14T18:05:33.287 DEBUG:teuthology.orchestra.run.smithi163:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81c9387d2e7576da065747ec9c16d1c7d69016ec shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bf7326ec-2270-11ee-9b33-001a4aab830c -- ceph orch host ls --format=json 2023-07-14T18:05:33.841 INFO:teuthology.orchestra.run.smithi163.stderr:Inferring config /var/lib/ceph/bf7326ec-2270-11ee-9b33-001a4aab830c/mon.a/config 2023-07-14T18:05:34.207 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:05:33 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:05:34.207 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:05:33 smithi163 ceph-mon[96576]: Added host smithi172 2023-07-14T18:05:34.208 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:05:33 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-14T18:05:34.208 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:05:33 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:05:35.015 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:05:34.984+0000 7f47985f1700 1 -- 172.21.15.163:0/3603106438 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f4790105730 msgr2=0x7f4790105b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:05:35.015 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:05:34.984+0000 7f47985f1700 1 --2- 172.21.15.163:0/3603106438 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f4790105730 0x7f4790105b00 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f478c009910 tx=0x7f478c009c20 comp rx=0 tx=0).stop 2023-07-14T18:05:35.015 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:05:34.984+0000 7f47985f1700 1 -- 172.21.15.163:0/3603106438 shutdown_connections 2023-07-14T18:05:35.015 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:05:34.984+0000 7f47985f1700 1 --2- 172.21.15.163:0/3603106438 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f4790105730 0x7f4790105b00 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:05:35.015 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:05:34.984+0000 7f47985f1700 1 -- 172.21.15.163:0/3603106438 >> 172.21.15.163:0/3603106438 conn(0x7f47900fb230 msgr2=0x7f47900fd640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:05:35.015 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:05:34.984+0000 7f47985f1700 1 -- 172.21.15.163:0/3603106438 shutdown_connections 2023-07-14T18:05:35.016 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:05:34.984+0000 7f47985f1700 1 -- 172.21.15.163:0/3603106438 wait complete. 2023-07-14T18:05:35.017 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:05:34.985+0000 7f47985f1700 1 Processor -- start 2023-07-14T18:05:35.017 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:05:34.985+0000 7f47985f1700 1 -- start start 2023-07-14T18:05:35.017 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:05:34.985+0000 7f47985f1700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f4790105730 0x7f479019a960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:05:35.017 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:05:34.985+0000 7f47985f1700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f479019aea0 con 0x7f4790105730 2023-07-14T18:05:35.017 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:05:34.985+0000 7f479638d700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f4790105730 0x7f479019a960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:05:35.018 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:05:34.985+0000 7f479638d700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f4790105730 0x7f479019a960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:54788/0 (socket says 172.21.15.163:54788) 2023-07-14T18:05:35.018 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:05:34.985+0000 7f479638d700 1 -- 172.21.15.163:0/3551741851 learned_addr learned my addr 172.21.15.163:0/3551741851 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:05:35.018 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:05:34.986+0000 7f479638d700 1 -- 172.21.15.163:0/3551741851 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f478c0095f0 con 0x7f4790105730 2023-07-14T18:05:35.018 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:05:34.986+0000 7f479638d700 1 --2- 172.21.15.163:0/3551741851 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f4790105730 0x7f479019a960 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f478c006010 tx=0x7f478c004ff0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:05:35.018 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:05:34.986+0000 7f47837fe700 1 -- 172.21.15.163:0/3551741851 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f478c01d070 con 0x7f4790105730 2023-07-14T18:05:35.018 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:05:34.986+0000 7f47985f1700 1 -- 172.21.15.163:0/3551741851 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f479019b0a0 con 0x7f4790105730 2023-07-14T18:05:35.018 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:05:34.986+0000 7f47837fe700 1 -- 172.21.15.163:0/3551741851 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f478c0044b0 con 0x7f4790105730 2023-07-14T18:05:35.018 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:05:34.986+0000 7f47837fe700 1 -- 172.21.15.163:0/3551741851 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f478c003840 con 0x7f4790105730 2023-07-14T18:05:35.019 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:05:34.986+0000 7f47985f1700 1 -- 172.21.15.163:0/3551741851 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f479019b460 con 0x7f4790105730 2023-07-14T18:05:35.019 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:05:34.987+0000 7f47837fe700 1 -- 172.21.15.163:0/3551741851 <== mon.0 v2:172.21.15.163:3300/0 4 ==== mgrmap(e 13) v1 ==== 45540+0+0 (secure 0 0 0) 0x7f478c003ac0 con 0x7f4790105730 2023-07-14T18:05:35.019 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:05:34.987+0000 7f47985f1700 1 -- 172.21.15.163:0/3551741851 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4790061c70 con 0x7f4790105730 2023-07-14T18:05:35.019 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:05:34.987+0000 7f47837fe700 1 --2- 172.21.15.163:0/3551741851 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f477c0387b0 0x7f477c03ac60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:05:35.019 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:05:34.987+0000 7f47837fe700 1 -- 172.21.15.163:0/3551741851 <== mon.0 v2:172.21.15.163:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f478c04c7e0 con 0x7f4790105730 2023-07-14T18:05:35.020 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:05:34.987+0000 7f4795b8c700 1 --2- 172.21.15.163:0/3551741851 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f477c0387b0 0x7f477c03ac60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:05:35.020 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:05:34.987+0000 7f4795b8c700 1 --2- 172.21.15.163:0/3551741851 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f477c0387b0 0x7f477c03ac60 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f4784006fd0 tx=0x7f4784006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:05:35.022 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:05:34.992+0000 7f47837fe700 1 -- 172.21.15.163:0/3551741851 <== mon.0 v2:172.21.15.163:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178025 (secure 0 0 0) 0x7f478c02a540 con 0x7f4790105730 2023-07-14T18:05:35.213 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:05:35.183+0000 7f47985f1700 1 -- 172.21.15.163:0/3551741851 --> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f47901046e0 con 0x7f477c0387b0 2023-07-14T18:05:35.214 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:05:35.184+0000 7f47837fe700 1 -- 172.21.15.163:0/3551741851 <== mgr.14152 v2:172.21.15.163:6800/1949590926 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+161 (secure 0 0 0) 0x7f47901046e0 con 0x7f477c0387b0 2023-07-14T18:05:35.214 INFO:teuthology.orchestra.run.smithi163.stdout: 2023-07-14T18:05:35.215 INFO:teuthology.orchestra.run.smithi163.stdout:[{"addr": "172.21.15.163", "hostname": "smithi163", "labels": [], "status": ""}, {"addr": "172.21.15.172", "hostname": "smithi172", "labels": [], "status": ""}] 2023-07-14T18:05:35.216 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:05:35.186+0000 7f47985f1700 1 -- 172.21.15.163:0/3551741851 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f477c0387b0 msgr2=0x7f477c03ac60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:05:35.216 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:05:35.186+0000 7f47985f1700 1 --2- 172.21.15.163:0/3551741851 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f477c0387b0 0x7f477c03ac60 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f4784006fd0 tx=0x7f4784006e40 comp rx=0 tx=0).stop 2023-07-14T18:05:35.217 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:05:35.186+0000 7f47985f1700 1 -- 172.21.15.163:0/3551741851 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f4790105730 msgr2=0x7f479019a960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:05:35.217 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:05:35.186+0000 7f47985f1700 1 --2- 172.21.15.163:0/3551741851 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f4790105730 0x7f479019a960 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f478c006010 tx=0x7f478c004ff0 comp rx=0 tx=0).stop 2023-07-14T18:05:35.217 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:05:35.186+0000 7f47985f1700 1 -- 172.21.15.163:0/3551741851 shutdown_connections 2023-07-14T18:05:35.217 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:05:35.186+0000 7f47985f1700 1 --2- 172.21.15.163:0/3551741851 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f477c0387b0 0x7f477c03ac60 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:05:35.217 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:05:35.186+0000 7f47985f1700 1 --2- 172.21.15.163:0/3551741851 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f4790105730 0x7f479019a960 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:05:35.217 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:05:35.186+0000 7f47985f1700 1 -- 172.21.15.163:0/3551741851 >> 172.21.15.163:0/3551741851 conn(0x7f47900fb230 msgr2=0x7f47900fd170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:05:35.217 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:05:35.186+0000 7f47985f1700 1 -- 172.21.15.163:0/3551741851 shutdown_connections 2023-07-14T18:05:35.218 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:05:35.186+0000 7f47985f1700 1 -- 172.21.15.163:0/3551741851 wait complete. 2023-07-14T18:05:35.362 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:05:34 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:05:35.583 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi184 2023-07-14T18:05:35.583 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2023-07-14T18:05:35.583 DEBUG:teuthology.orchestra.run.smithi184:> dd of=/etc/ceph/ceph.conf 2023-07-14T18:05:35.604 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2023-07-14T18:05:35.604 DEBUG:teuthology.orchestra.run.smithi184:> dd of=/etc/ceph/ceph.client.admin.keyring 2023-07-14T18:05:35.663 INFO:tasks.cephadm:Adding host smithi184 to orchestrator... 2023-07-14T18:05:35.663 DEBUG:teuthology.orchestra.run.smithi163:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81c9387d2e7576da065747ec9c16d1c7d69016ec shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bf7326ec-2270-11ee-9b33-001a4aab830c -- ceph orch host add smithi184 2023-07-14T18:05:36.215 INFO:teuthology.orchestra.run.smithi163.stderr:Inferring config /var/lib/ceph/bf7326ec-2270-11ee-9b33-001a4aab830c/mon.a/config 2023-07-14T18:05:36.645 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:05:36 smithi163 ceph-mon[96576]: from='client.14180 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-07-14T18:05:36.645 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:05:36 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:05:36.645 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:05:36 smithi163 ceph-mon[96576]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-14T18:05:37.543 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:05:37.512+0000 7f74515d1700 1 -- 172.21.15.163:0/3084476239 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f744c1046d0 msgr2=0x7f744c104aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:05:37.544 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:05:37.512+0000 7f74515d1700 1 --2- 172.21.15.163:0/3084476239 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f744c1046d0 0x7f744c104aa0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f743c009910 tx=0x7f743c009c20 comp rx=0 tx=0).stop 2023-07-14T18:05:37.544 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:05:37.512+0000 7f74515d1700 1 -- 172.21.15.163:0/3084476239 shutdown_connections 2023-07-14T18:05:37.544 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:05:37.512+0000 7f74515d1700 1 --2- 172.21.15.163:0/3084476239 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f744c1046d0 0x7f744c104aa0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:05:37.544 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:05:37.512+0000 7f74515d1700 1 -- 172.21.15.163:0/3084476239 >> 172.21.15.163:0/3084476239 conn(0x7f744c0fa1f0 msgr2=0x7f744c0fc600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:05:37.544 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:05:37.512+0000 7f74515d1700 1 -- 172.21.15.163:0/3084476239 shutdown_connections 2023-07-14T18:05:37.545 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:05:37.512+0000 7f74515d1700 1 -- 172.21.15.163:0/3084476239 wait complete. 2023-07-14T18:05:37.545 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:05:37.513+0000 7f74515d1700 1 Processor -- start 2023-07-14T18:05:37.545 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:05:37.513+0000 7f74515d1700 1 -- start start 2023-07-14T18:05:37.545 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:05:37.513+0000 7f74515d1700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f744c1046d0 0x7f744c195970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:05:37.545 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:05:37.513+0000 7f74515d1700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f744c195eb0 con 0x7f744c1046d0 2023-07-14T18:05:37.546 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:05:37.513+0000 7f744affd700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f744c1046d0 0x7f744c195970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:05:37.547 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:05:37.514+0000 7f744affd700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f744c1046d0 0x7f744c195970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:54794/0 (socket says 172.21.15.163:54794) 2023-07-14T18:05:37.547 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:05:37.514+0000 7f744affd700 1 -- 172.21.15.163:0/2326330514 learned_addr learned my addr 172.21.15.163:0/2326330514 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:05:37.547 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:05:37.514+0000 7f744affd700 1 -- 172.21.15.163:0/2326330514 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f743c0095f0 con 0x7f744c1046d0 2023-07-14T18:05:37.547 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:05:37.514+0000 7f744affd700 1 --2- 172.21.15.163:0/2326330514 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f744c1046d0 0x7f744c195970 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f743c006010 tx=0x7f743c004ff0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:05:37.547 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:05:37.514+0000 7f7433fff700 1 -- 172.21.15.163:0/2326330514 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f743c01d070 con 0x7f744c1046d0 2023-07-14T18:05:37.547 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:05:37.514+0000 7f74515d1700 1 -- 172.21.15.163:0/2326330514 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f744c1960b0 con 0x7f744c1046d0 2023-07-14T18:05:37.548 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:05:37.514+0000 7f7433fff700 1 -- 172.21.15.163:0/2326330514 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f743c0044b0 con 0x7f744c1046d0 2023-07-14T18:05:37.548 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:05:37.514+0000 7f7433fff700 1 -- 172.21.15.163:0/2326330514 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f743c003840 con 0x7f744c1046d0 2023-07-14T18:05:37.548 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:05:37.514+0000 7f74515d1700 1 -- 172.21.15.163:0/2326330514 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f744c1964f0 con 0x7f744c1046d0 2023-07-14T18:05:37.548 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:05:37.515+0000 7f7433fff700 1 -- 172.21.15.163:0/2326330514 <== mon.0 v2:172.21.15.163:3300/0 4 ==== mgrmap(e 13) v1 ==== 45540+0+0 (secure 0 0 0) 0x7f743c003ac0 con 0x7f744c1046d0 2023-07-14T18:05:37.548 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:05:37.515+0000 7f74515d1700 1 -- 172.21.15.163:0/2326330514 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f744c1039c0 con 0x7f744c1046d0 2023-07-14T18:05:37.548 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:05:37.515+0000 7f7433fff700 1 --2- 172.21.15.163:0/2326330514 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f74340387b0 0x7f743403ac60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:05:37.548 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:05:37.515+0000 7f7433fff700 1 -- 172.21.15.163:0/2326330514 <== mon.0 v2:172.21.15.163:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f743c04c890 con 0x7f744c1046d0 2023-07-14T18:05:37.549 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:05:37.515+0000 7f744a7fc700 1 --2- 172.21.15.163:0/2326330514 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f74340387b0 0x7f743403ac60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:05:37.549 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:05:37.516+0000 7f744a7fc700 1 --2- 172.21.15.163:0/2326330514 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f74340387b0 0x7f743403ac60 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f7440006fd0 tx=0x7f7440006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:05:37.550 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:05:37.520+0000 7f7433fff700 1 -- 172.21.15.163:0/2326330514 <== mon.0 v2:172.21.15.163:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178025 (secure 0 0 0) 0x7f743c02a540 con 0x7f744c1046d0 2023-07-14T18:05:37.740 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:05:37.710+0000 7f74515d1700 1 -- 172.21.15.163:0/2326330514 --> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi184", "target": ["mon-mgr", ""]}) v1 -- 0x7f744c0687a0 con 0x7f74340387b0 2023-07-14T18:05:38.707 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:05:38 smithi163 ceph-mon[96576]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-14T18:05:38.708 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:05:38 smithi163 ceph-mon[96576]: from='client.14182 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi184", "target": ["mon-mgr", ""]}]: dispatch 2023-07-14T18:05:38.708 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:05:38 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:05:38.708 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:05:38 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:05:38.708 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:05:38 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:05:38.709 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:05:38 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:05:38.709 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:05:38 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi172", "name": "osd_memory_target"}]: dispatch 2023-07-14T18:05:38.709 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:05:38 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T18:05:38.709 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:05:38 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-14T18:05:40.046 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:05:40.016+0000 7f7433fff700 1 -- 172.21.15.163:0/2326330514 <== mgr.14152 v2:172.21.15.163:6800/1949590926 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+49 (secure 0 0 0) 0x7f744c0687a0 con 0x7f74340387b0 2023-07-14T18:05:40.047 INFO:teuthology.orchestra.run.smithi163.stdout:Added host 'smithi184' with addr '172.21.15.184' 2023-07-14T18:05:40.048 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:05:40.018+0000 7f74515d1700 1 -- 172.21.15.163:0/2326330514 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f74340387b0 msgr2=0x7f743403ac60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:05:40.048 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:05:40.018+0000 7f74515d1700 1 --2- 172.21.15.163:0/2326330514 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f74340387b0 0x7f743403ac60 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f7440006fd0 tx=0x7f7440006e40 comp rx=0 tx=0).stop 2023-07-14T18:05:40.049 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:05:40.018+0000 7f74515d1700 1 -- 172.21.15.163:0/2326330514 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f744c1046d0 msgr2=0x7f744c195970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:05:40.049 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:05:40.018+0000 7f74515d1700 1 --2- 172.21.15.163:0/2326330514 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f744c1046d0 0x7f744c195970 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f743c006010 tx=0x7f743c004ff0 comp rx=0 tx=0).stop 2023-07-14T18:05:40.049 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:05:40.018+0000 7f74515d1700 1 -- 172.21.15.163:0/2326330514 shutdown_connections 2023-07-14T18:05:40.049 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:05:40.018+0000 7f74515d1700 1 --2- 172.21.15.163:0/2326330514 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f74340387b0 0x7f743403ac60 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:05:40.049 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:05:40.018+0000 7f74515d1700 1 --2- 172.21.15.163:0/2326330514 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f744c1046d0 0x7f744c195970 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:05:40.049 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:05:40.018+0000 7f74515d1700 1 -- 172.21.15.163:0/2326330514 >> 172.21.15.163:0/2326330514 conn(0x7f744c0fa1f0 msgr2=0x7f744c0fae50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:05:40.049 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:05:40.018+0000 7f74515d1700 1 -- 172.21.15.163:0/2326330514 shutdown_connections 2023-07-14T18:05:40.049 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:05:40.018+0000 7f74515d1700 1 -- 172.21.15.163:0/2326330514 wait complete. 2023-07-14T18:05:40.075 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:05:39 smithi163 ceph-mon[96576]: Updating smithi172:/etc/ceph/ceph.conf 2023-07-14T18:05:40.076 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:05:39 smithi163 ceph-mon[96576]: Updating smithi172:/var/lib/ceph/bf7326ec-2270-11ee-9b33-001a4aab830c/config/ceph.conf 2023-07-14T18:05:40.076 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:05:39 smithi163 ceph-mon[96576]: Deploying cephadm binary to smithi184 2023-07-14T18:05:40.076 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:05:39 smithi163 ceph-mon[96576]: Updating smithi172:/etc/ceph/ceph.client.admin.keyring 2023-07-14T18:05:40.076 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:05:39 smithi163 ceph-mon[96576]: Updating smithi172:/var/lib/ceph/bf7326ec-2270-11ee-9b33-001a4aab830c/config/ceph.client.admin.keyring 2023-07-14T18:05:40.076 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:05:39 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:05:40.076 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:05:39 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:05:40.076 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:05:39 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:05:40.476 DEBUG:teuthology.orchestra.run.smithi163:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81c9387d2e7576da065747ec9c16d1c7d69016ec shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bf7326ec-2270-11ee-9b33-001a4aab830c -- ceph orch host ls --format=json 2023-07-14T18:05:41.032 INFO:teuthology.orchestra.run.smithi163.stderr:Inferring config /var/lib/ceph/bf7326ec-2270-11ee-9b33-001a4aab830c/mon.a/config 2023-07-14T18:05:41.207 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:05:40 smithi163 ceph-mon[96576]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-14T18:05:41.208 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:05:40 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:05:41.208 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:05:40 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-14T18:05:41.208 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:05:40 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:05:41.958 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:05:41 smithi163 ceph-mon[96576]: Added host smithi184 2023-07-14T18:05:41.958 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:05:41 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:05:42.205 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:05:42.175+0000 7f0aa926c700 1 -- 172.21.15.163:0/1622065947 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f0aa40ff880 msgr2=0x7f0aa40ffc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:05:42.206 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:05:42.175+0000 7f0aa926c700 1 --2- 172.21.15.163:0/1622065947 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f0aa40ff880 0x7f0aa40ffc50 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f0a98009910 tx=0x7f0a98009c20 comp rx=0 tx=0).stop 2023-07-14T18:05:42.206 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:05:42.175+0000 7f0aa926c700 1 -- 172.21.15.163:0/1622065947 shutdown_connections 2023-07-14T18:05:42.206 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:05:42.175+0000 7f0aa926c700 1 --2- 172.21.15.163:0/1622065947 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f0aa40ff880 0x7f0aa40ffc50 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:05:42.206 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:05:42.175+0000 7f0aa926c700 1 -- 172.21.15.163:0/1622065947 >> 172.21.15.163:0/1622065947 conn(0x7f0aa4074e40 msgr2=0x7f0aa4075240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:05:42.206 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:05:42.175+0000 7f0aa926c700 1 -- 172.21.15.163:0/1622065947 shutdown_connections 2023-07-14T18:05:42.207 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:05:42.175+0000 7f0aa926c700 1 -- 172.21.15.163:0/1622065947 wait complete. 2023-07-14T18:05:42.208 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:05:42.176+0000 7f0aa926c700 1 Processor -- start 2023-07-14T18:05:42.208 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:05:42.176+0000 7f0aa926c700 1 -- start start 2023-07-14T18:05:42.208 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:05:42.176+0000 7f0aa926c700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f0aa40ff880 0x7f0aa41997b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:05:42.208 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:05:42.176+0000 7f0aa926c700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0aa4199cf0 con 0x7f0aa40ff880 2023-07-14T18:05:42.208 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:05:42.176+0000 7f0aa2ffd700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f0aa40ff880 0x7f0aa41997b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:05:42.209 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:05:42.176+0000 7f0aa2ffd700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f0aa40ff880 0x7f0aa41997b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:54820/0 (socket says 172.21.15.163:54820) 2023-07-14T18:05:42.209 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:05:42.176+0000 7f0aa2ffd700 1 -- 172.21.15.163:0/414181200 learned_addr learned my addr 172.21.15.163:0/414181200 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:05:42.209 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:05:42.176+0000 7f0aa2ffd700 1 -- 172.21.15.163:0/414181200 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a980095f0 con 0x7f0aa40ff880 2023-07-14T18:05:42.209 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:05:42.177+0000 7f0aa2ffd700 1 --2- 172.21.15.163:0/414181200 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f0aa40ff880 0x7f0aa41997b0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f0a98006010 tx=0x7f0a98004ff0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:05:42.209 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:05:42.177+0000 7f0a8bfff700 1 -- 172.21.15.163:0/414181200 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0a9801d070 con 0x7f0aa40ff880 2023-07-14T18:05:42.209 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:05:42.177+0000 7f0aa926c700 1 -- 172.21.15.163:0/414181200 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0aa4199ef0 con 0x7f0aa40ff880 2023-07-14T18:05:42.209 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:05:42.177+0000 7f0a8bfff700 1 -- 172.21.15.163:0/414181200 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f0a9800bdf0 con 0x7f0aa40ff880 2023-07-14T18:05:42.210 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:05:42.177+0000 7f0a8bfff700 1 -- 172.21.15.163:0/414181200 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0a98022d80 con 0x7f0aa40ff880 2023-07-14T18:05:42.210 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:05:42.177+0000 7f0aa926c700 1 -- 172.21.15.163:0/414181200 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0aa4193830 con 0x7f0aa40ff880 2023-07-14T18:05:42.210 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:05:42.178+0000 7f0a8bfff700 1 -- 172.21.15.163:0/414181200 <== mon.0 v2:172.21.15.163:3300/0 4 ==== mgrmap(e 13) v1 ==== 45540+0+0 (secure 0 0 0) 0x7f0a9800f460 con 0x7f0aa40ff880 2023-07-14T18:05:42.210 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:05:42.178+0000 7f0aa926c700 1 -- 172.21.15.163:0/414181200 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0aa4061c70 con 0x7f0aa40ff880 2023-07-14T18:05:42.211 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:05:42.178+0000 7f0a8bfff700 1 --2- 172.21.15.163:0/414181200 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f0a8c0387b0 0x7f0a8c03ac60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:05:42.211 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:05:42.178+0000 7f0a8bfff700 1 -- 172.21.15.163:0/414181200 <== mon.0 v2:172.21.15.163:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f0a9804ca90 con 0x7f0aa40ff880 2023-07-14T18:05:42.211 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:05:42.178+0000 7f0aa27fc700 1 --2- 172.21.15.163:0/414181200 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f0a8c0387b0 0x7f0a8c03ac60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:05:42.211 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:05:42.178+0000 7f0aa27fc700 1 --2- 172.21.15.163:0/414181200 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f0a8c0387b0 0x7f0a8c03ac60 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f0a94006fd0 tx=0x7f0a94006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:05:42.213 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:05:42.183+0000 7f0a8bfff700 1 -- 172.21.15.163:0/414181200 <== mon.0 v2:172.21.15.163:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178025 (secure 0 0 0) 0x7f0a98020730 con 0x7f0aa40ff880 2023-07-14T18:05:42.405 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:05:42.375+0000 7f0aa926c700 1 -- 172.21.15.163:0/414181200 --> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f0aa4194260 con 0x7f0a8c0387b0 2023-07-14T18:05:42.406 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:05:42.376+0000 7f0a8bfff700 1 -- 172.21.15.163:0/414181200 <== mgr.14152 v2:172.21.15.163:6800/1949590926 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+241 (secure 0 0 0) 0x7f0aa4194260 con 0x7f0a8c0387b0 2023-07-14T18:05:42.406 INFO:teuthology.orchestra.run.smithi163.stdout: 2023-07-14T18:05:42.406 INFO:teuthology.orchestra.run.smithi163.stdout:[{"addr": "172.21.15.163", "hostname": "smithi163", "labels": [], "status": ""}, {"addr": "172.21.15.172", "hostname": "smithi172", "labels": [], "status": ""}, {"addr": "172.21.15.184", "hostname": "smithi184", "labels": [], "status": ""}] 2023-07-14T18:05:42.408 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:05:42.378+0000 7f0aa926c700 1 -- 172.21.15.163:0/414181200 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f0a8c0387b0 msgr2=0x7f0a8c03ac60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:05:42.408 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:05:42.378+0000 7f0aa926c700 1 --2- 172.21.15.163:0/414181200 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f0a8c0387b0 0x7f0a8c03ac60 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f0a94006fd0 tx=0x7f0a94006e40 comp rx=0 tx=0).stop 2023-07-14T18:05:42.409 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:05:42.378+0000 7f0aa926c700 1 -- 172.21.15.163:0/414181200 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f0aa40ff880 msgr2=0x7f0aa41997b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:05:42.409 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:05:42.378+0000 7f0aa926c700 1 --2- 172.21.15.163:0/414181200 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f0aa40ff880 0x7f0aa41997b0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f0a98006010 tx=0x7f0a98004ff0 comp rx=0 tx=0).stop 2023-07-14T18:05:42.409 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:05:42.378+0000 7f0aa926c700 1 -- 172.21.15.163:0/414181200 shutdown_connections 2023-07-14T18:05:42.409 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:05:42.378+0000 7f0aa926c700 1 --2- 172.21.15.163:0/414181200 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f0a8c0387b0 0x7f0a8c03ac60 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:05:42.409 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:05:42.378+0000 7f0aa926c700 1 --2- 172.21.15.163:0/414181200 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f0aa40ff880 0x7f0aa41997b0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:05:42.409 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:05:42.378+0000 7f0aa926c700 1 -- 172.21.15.163:0/414181200 >> 172.21.15.163:0/414181200 conn(0x7f0aa4074e40 msgr2=0x7f0aa4103130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:05:42.409 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:05:42.378+0000 7f0aa926c700 1 -- 172.21.15.163:0/414181200 shutdown_connections 2023-07-14T18:05:42.409 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:05:42.378+0000 7f0aa926c700 1 -- 172.21.15.163:0/414181200 wait complete. 2023-07-14T18:05:42.875 INFO:tasks.cephadm:Setting crush tunables to default 2023-07-14T18:05:42.876 DEBUG:teuthology.orchestra.run.smithi163:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81c9387d2e7576da065747ec9c16d1c7d69016ec shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bf7326ec-2270-11ee-9b33-001a4aab830c -- ceph osd crush tunables default 2023-07-14T18:05:43.207 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:05:42 smithi163 ceph-mon[96576]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-14T18:05:43.208 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:05:42 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:05:43.427 INFO:teuthology.orchestra.run.smithi163.stderr:Inferring config /var/lib/ceph/bf7326ec-2270-11ee-9b33-001a4aab830c/mon.a/config 2023-07-14T18:05:43.911 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:05:43 smithi163 ceph-mon[96576]: from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-07-14T18:05:44.585 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:05:44.554+0000 7f9c587d2700 1 -- 172.21.15.163:0/155823907 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f9c50104650 msgr2=0x7f9c50104a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:05:44.585 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:05:44.554+0000 7f9c587d2700 1 --2- 172.21.15.163:0/155823907 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f9c50104650 0x7f9c50104a20 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f9c40009910 tx=0x7f9c40009c20 comp rx=0 tx=0).stop 2023-07-14T18:05:44.585 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:05:44.554+0000 7f9c587d2700 1 -- 172.21.15.163:0/155823907 shutdown_connections 2023-07-14T18:05:44.585 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:05:44.554+0000 7f9c587d2700 1 --2- 172.21.15.163:0/155823907 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f9c50104650 0x7f9c50104a20 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:05:44.585 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:05:44.554+0000 7f9c587d2700 1 -- 172.21.15.163:0/155823907 >> 172.21.15.163:0/155823907 conn(0x7f9c500743e0 msgr2=0x7f9c500747e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:05:44.585 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:05:44.554+0000 7f9c587d2700 1 -- 172.21.15.163:0/155823907 shutdown_connections 2023-07-14T18:05:44.586 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:05:44.554+0000 7f9c587d2700 1 -- 172.21.15.163:0/155823907 wait complete. 2023-07-14T18:05:44.587 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:05:44.555+0000 7f9c587d2700 1 Processor -- start 2023-07-14T18:05:44.587 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:05:44.555+0000 7f9c587d2700 1 -- start start 2023-07-14T18:05:44.587 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:05:44.555+0000 7f9c587d2700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f9c50104650 0x7f9c5019aa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:05:44.587 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:05:44.555+0000 7f9c587d2700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c5019af60 con 0x7f9c50104650 2023-07-14T18:05:44.587 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:05:44.555+0000 7f9c5656e700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f9c50104650 0x7f9c5019aa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:05:44.588 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:05:44.555+0000 7f9c5656e700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f9c50104650 0x7f9c5019aa20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:54826/0 (socket says 172.21.15.163:54826) 2023-07-14T18:05:44.588 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:05:44.555+0000 7f9c5656e700 1 -- 172.21.15.163:0/1452552109 learned_addr learned my addr 172.21.15.163:0/1452552109 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:05:44.588 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:05:44.555+0000 7f9c5656e700 1 -- 172.21.15.163:0/1452552109 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c400095f0 con 0x7f9c50104650 2023-07-14T18:05:44.588 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:05:44.555+0000 7f9c5656e700 1 --2- 172.21.15.163:0/1452552109 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f9c50104650 0x7f9c5019aa20 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f9c40006010 tx=0x7f9c40004ff0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:05:44.588 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:05:44.555+0000 7f9c477fe700 1 -- 172.21.15.163:0/1452552109 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9c4001d070 con 0x7f9c50104650 2023-07-14T18:05:44.588 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:05:44.555+0000 7f9c587d2700 1 -- 172.21.15.163:0/1452552109 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9c5019b160 con 0x7f9c50104650 2023-07-14T18:05:44.588 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:05:44.555+0000 7f9c477fe700 1 -- 172.21.15.163:0/1452552109 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f9c400044b0 con 0x7f9c50104650 2023-07-14T18:05:44.589 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:05:44.555+0000 7f9c477fe700 1 -- 172.21.15.163:0/1452552109 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9c40003840 con 0x7f9c50104650 2023-07-14T18:05:44.589 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:05:44.555+0000 7f9c587d2700 1 -- 172.21.15.163:0/1452552109 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c5019b520 con 0x7f9c50104650 2023-07-14T18:05:44.589 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:05:44.556+0000 7f9c477fe700 1 -- 172.21.15.163:0/1452552109 <== mon.0 v2:172.21.15.163:3300/0 4 ==== mgrmap(e 13) v1 ==== 45540+0+0 (secure 0 0 0) 0x7f9c40003ac0 con 0x7f9c50104650 2023-07-14T18:05:44.589 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:05:44.556+0000 7f9c587d2700 1 -- 172.21.15.163:0/1452552109 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9c50061c70 con 0x7f9c50104650 2023-07-14T18:05:44.589 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:05:44.556+0000 7f9c477fe700 1 --2- 172.21.15.163:0/1452552109 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f9c3c0387b0 0x7f9c3c03ac60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:05:44.589 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:05:44.557+0000 7f9c477fe700 1 -- 172.21.15.163:0/1452552109 <== mon.0 v2:172.21.15.163:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f9c4004c7e0 con 0x7f9c50104650 2023-07-14T18:05:44.589 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:05:44.557+0000 7f9c55d6d700 1 --2- 172.21.15.163:0/1452552109 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f9c3c0387b0 0x7f9c3c03ac60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:05:44.590 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:05:44.557+0000 7f9c55d6d700 1 --2- 172.21.15.163:0/1452552109 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f9c3c0387b0 0x7f9c3c03ac60 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f9c4c006fd0 tx=0x7f9c4c006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:05:44.591 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:05:44.561+0000 7f9c477fe700 1 -- 172.21.15.163:0/1452552109 <== mon.0 v2:172.21.15.163:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178025 (secure 0 0 0) 0x7f9c4002a540 con 0x7f9c50104650 2023-07-14T18:05:44.785 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:05:44.754+0000 7f9c587d2700 1 -- 172.21.15.163:0/1452552109 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7f9c50195fb0 con 0x7f9c50104650 2023-07-14T18:05:45.207 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:05:44 smithi163 ceph-mon[96576]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-14T18:05:45.735 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:05:45.705+0000 7f9c477fe700 1 -- 172.21.15.163:0/1452552109 <== mon.0 v2:172.21.15.163:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v4) v1 ==== 124+0+0 (secure 0 0 0) 0x7f9c4002a360 con 0x7f9c50104650 2023-07-14T18:05:45.737 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:05:45.707+0000 7f9c587d2700 1 -- 172.21.15.163:0/1452552109 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f9c3c0387b0 msgr2=0x7f9c3c03ac60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:05:45.738 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:05:45.707+0000 7f9c587d2700 1 --2- 172.21.15.163:0/1452552109 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f9c3c0387b0 0x7f9c3c03ac60 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f9c4c006fd0 tx=0x7f9c4c006e40 comp rx=0 tx=0).stop 2023-07-14T18:05:45.738 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:05:45.707+0000 7f9c587d2700 1 -- 172.21.15.163:0/1452552109 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f9c50104650 msgr2=0x7f9c5019aa20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:05:45.738 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:05:45.707+0000 7f9c587d2700 1 --2- 172.21.15.163:0/1452552109 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f9c50104650 0x7f9c5019aa20 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f9c40006010 tx=0x7f9c40004ff0 comp rx=0 tx=0).stop 2023-07-14T18:05:45.738 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:05:45.707+0000 7f9c587d2700 1 -- 172.21.15.163:0/1452552109 shutdown_connections 2023-07-14T18:05:45.738 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:05:45.707+0000 7f9c587d2700 1 --2- 172.21.15.163:0/1452552109 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f9c3c0387b0 0x7f9c3c03ac60 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:05:45.738 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:05:45.707+0000 7f9c587d2700 1 --2- 172.21.15.163:0/1452552109 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f9c50104650 0x7f9c5019aa20 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:05:45.738 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:05:45.707+0000 7f9c587d2700 1 -- 172.21.15.163:0/1452552109 >> 172.21.15.163:0/1452552109 conn(0x7f9c500743e0 msgr2=0x7f9c500680e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:05:45.739 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:05:45.707+0000 7f9c587d2700 1 -- 172.21.15.163:0/1452552109 shutdown_connections 2023-07-14T18:05:45.739 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:05:45.707+0000 7f9c587d2700 1 -- 172.21.15.163:0/1452552109 wait complete. 2023-07-14T18:05:45.739 INFO:teuthology.orchestra.run.smithi163.stderr:adjusted tunables profile to default 2023-07-14T18:05:46.083 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:05:45 smithi163 ceph-mon[96576]: from='client.? 172.21.15.163:0/1452552109' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2023-07-14T18:05:46.083 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:05:45 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:05:46.083 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:05:45 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:05:46.083 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:05:45 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:05:46.083 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:05:45 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:05:46.084 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:05:45 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi184", "name": "osd_memory_target"}]: dispatch 2023-07-14T18:05:46.084 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:05:45 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T18:05:46.084 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:05:45 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-14T18:05:46.085 INFO:tasks.cephadm:Adding mon.a on smithi163 2023-07-14T18:05:46.085 INFO:tasks.cephadm:Adding mon.b on smithi172 2023-07-14T18:05:46.085 INFO:tasks.cephadm:Adding mon.c on smithi184 2023-07-14T18:05:46.086 DEBUG:teuthology.orchestra.run.smithi184:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81c9387d2e7576da065747ec9c16d1c7d69016ec shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bf7326ec-2270-11ee-9b33-001a4aab830c -- ceph orch apply mon '3;smithi163:172.21.15.163=a;smithi172:172.21.15.172=b;smithi184:172.21.15.184=c' 2023-07-14T18:05:46.664 INFO:teuthology.orchestra.run.smithi184.stderr:Inferring config /var/lib/ceph/bf7326ec-2270-11ee-9b33-001a4aab830c/config/ceph.conf 2023-07-14T18:05:47.208 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:05:46 smithi163 ceph-mon[96576]: Updating smithi184:/etc/ceph/ceph.conf 2023-07-14T18:05:47.208 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:05:46 smithi163 ceph-mon[96576]: Updating smithi184:/var/lib/ceph/bf7326ec-2270-11ee-9b33-001a4aab830c/config/ceph.conf 2023-07-14T18:05:47.208 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:05:46 smithi163 ceph-mon[96576]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-14T18:05:47.208 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:05:46 smithi163 ceph-mon[96576]: Updating smithi184:/etc/ceph/ceph.client.admin.keyring 2023-07-14T18:05:47.209 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:05:46 smithi163 ceph-mon[96576]: Updating smithi184:/var/lib/ceph/bf7326ec-2270-11ee-9b33-001a4aab830c/config/ceph.client.admin.keyring 2023-07-14T18:05:47.209 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:05:46 smithi163 ceph-mon[96576]: from='client.? 172.21.15.163:0/1452552109' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2023-07-14T18:05:47.209 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:05:46 smithi163 ceph-mon[96576]: osdmap e4: 0 total, 0 up, 0 in 2023-07-14T18:05:47.209 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:05:46 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:05:47.209 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:05:46 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:05:47.209 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:05:46 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:05:47.868 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:05:47.836+0000 7efc694a3700 1 -- 172.21.15.184:0/4162725088 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7efc640fe580 msgr2=0x7efc640fe950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:05:47.869 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:05:47.836+0000 7efc694a3700 1 --2- 172.21.15.184:0/4162725088 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7efc640fe580 0x7efc640fe950 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7efc5800aa20 tx=0x7efc5800ad30 comp rx=0 tx=0).stop 2023-07-14T18:05:47.869 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:05:47.837+0000 7efc694a3700 1 -- 172.21.15.184:0/4162725088 shutdown_connections 2023-07-14T18:05:47.869 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:05:47.837+0000 7efc694a3700 1 --2- 172.21.15.184:0/4162725088 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7efc640fe580 0x7efc640fe950 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:05:47.869 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:05:47.837+0000 7efc694a3700 1 -- 172.21.15.184:0/4162725088 >> 172.21.15.184:0/4162725088 conn(0x7efc64075070 msgr2=0x7efc64075470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:05:47.869 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:05:47.837+0000 7efc694a3700 1 -- 172.21.15.184:0/4162725088 shutdown_connections 2023-07-14T18:05:47.869 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:05:47.837+0000 7efc694a3700 1 -- 172.21.15.184:0/4162725088 wait complete. 2023-07-14T18:05:47.870 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:05:47.837+0000 7efc694a3700 1 Processor -- start 2023-07-14T18:05:47.871 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:05:47.837+0000 7efc694a3700 1 -- start start 2023-07-14T18:05:47.871 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:05:47.837+0000 7efc694a3700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7efc640fe580 0x7efc6419a8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:05:47.871 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:05:47.837+0000 7efc694a3700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc6419ae20 con 0x7efc640fe580 2023-07-14T18:05:47.872 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:05:47.838+0000 7efc62ffd700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7efc640fe580 0x7efc6419a8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:05:47.872 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:05:47.838+0000 7efc62ffd700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7efc640fe580 0x7efc6419a8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.184:50448/0 (socket says 172.21.15.184:50448) 2023-07-14T18:05:47.872 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:05:47.838+0000 7efc62ffd700 1 -- 172.21.15.184:0/2229841349 learned_addr learned my addr 172.21.15.184:0/2229841349 (peer_addr_for_me v2:172.21.15.184:0/0) 2023-07-14T18:05:47.872 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:05:47.838+0000 7efc62ffd700 1 -- 172.21.15.184:0/2229841349 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc5800a700 con 0x7efc640fe580 2023-07-14T18:05:47.872 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:05:47.838+0000 7efc62ffd700 1 --2- 172.21.15.184:0/2229841349 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7efc640fe580 0x7efc6419a8e0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7efc5800c6d0 tx=0x7efc58018770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:05:47.872 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:05:47.838+0000 7efc4bfff700 1 -- 172.21.15.184:0/2229841349 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7efc5801d070 con 0x7efc640fe580 2023-07-14T18:05:47.872 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:05:47.838+0000 7efc4bfff700 1 -- 172.21.15.184:0/2229841349 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7efc5800ce50 con 0x7efc640fe580 2023-07-14T18:05:47.873 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:05:47.838+0000 7efc694a3700 1 -- 172.21.15.184:0/2229841349 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc6419b020 con 0x7efc640fe580 2023-07-14T18:05:47.873 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:05:47.838+0000 7efc4bfff700 1 -- 172.21.15.184:0/2229841349 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7efc58016c50 con 0x7efc640fe580 2023-07-14T18:05:47.873 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:05:47.838+0000 7efc694a3700 1 -- 172.21.15.184:0/2229841349 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc6419b440 con 0x7efc640fe580 2023-07-14T18:05:47.873 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:05:47.839+0000 7efc694a3700 1 -- 172.21.15.184:0/2229841349 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efc64061c70 con 0x7efc640fe580 2023-07-14T18:05:47.873 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:05:47.839+0000 7efc4bfff700 1 -- 172.21.15.184:0/2229841349 <== mon.0 v2:172.21.15.163:3300/0 4 ==== mgrmap(e 13) v1 ==== 45540+0+0 (secure 0 0 0) 0x7efc58016470 con 0x7efc640fe580 2023-07-14T18:05:47.873 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:05:47.839+0000 7efc4bfff700 1 --2- 172.21.15.184:0/2229841349 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7efc4c0387b0 0x7efc4c03ac60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:05:47.873 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:05:47.839+0000 7efc4bfff700 1 -- 172.21.15.184:0/2229841349 <== mon.0 v2:172.21.15.163:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7efc58012070 con 0x7efc640fe580 2023-07-14T18:05:47.874 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:05:47.840+0000 7efc627fc700 1 --2- 172.21.15.184:0/2229841349 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7efc4c0387b0 0x7efc4c03ac60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:05:47.874 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:05:47.840+0000 7efc627fc700 1 --2- 172.21.15.184:0/2229841349 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7efc4c0387b0 0x7efc4c03ac60 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7efc54006fd0 tx=0x7efc54006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:05:47.876 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:05:47.845+0000 7efc4bfff700 1 -- 172.21.15.184:0/2229841349 <== mon.0 v2:172.21.15.163:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178025 (secure 0 0 0) 0x7efc5802ab90 con 0x7efc640fe580 2023-07-14T18:05:48.068 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:05:48.037+0000 7efc694a3700 1 -- 172.21.15.184:0/2229841349 --> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi163:172.21.15.163=a;smithi172:172.21.15.172=b;smithi184:172.21.15.184=c", "target": ["mon-mgr", ""]}) v1 -- 0x7efc64101dd0 con 0x7efc4c0387b0 2023-07-14T18:05:48.078 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:05:48.046+0000 7efc4bfff700 1 -- 172.21.15.184:0/2229841349 <== mgr.14152 v2:172.21.15.163:6800/1949590926 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+24 (secure 0 0 0) 0x7efc64101dd0 con 0x7efc4c0387b0 2023-07-14T18:05:48.078 INFO:teuthology.orchestra.run.smithi184.stdout:Scheduled mon update... 2023-07-14T18:05:48.080 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:05:48.049+0000 7efc694a3700 1 -- 172.21.15.184:0/2229841349 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7efc4c0387b0 msgr2=0x7efc4c03ac60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:05:48.080 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:05:48.049+0000 7efc694a3700 1 --2- 172.21.15.184:0/2229841349 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7efc4c0387b0 0x7efc4c03ac60 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7efc54006fd0 tx=0x7efc54006e40 comp rx=0 tx=0).stop 2023-07-14T18:05:48.080 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:05:48.049+0000 7efc694a3700 1 -- 172.21.15.184:0/2229841349 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7efc640fe580 msgr2=0x7efc6419a8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:05:48.080 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:05:48.049+0000 7efc694a3700 1 --2- 172.21.15.184:0/2229841349 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7efc640fe580 0x7efc6419a8e0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7efc5800c6d0 tx=0x7efc58018770 comp rx=0 tx=0).stop 2023-07-14T18:05:48.081 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:05:48.049+0000 7efc694a3700 1 -- 172.21.15.184:0/2229841349 shutdown_connections 2023-07-14T18:05:48.081 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:05:48.049+0000 7efc694a3700 1 --2- 172.21.15.184:0/2229841349 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7efc4c0387b0 0x7efc4c03ac60 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:05:48.081 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:05:48.049+0000 7efc694a3700 1 --2- 172.21.15.184:0/2229841349 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7efc640fe580 0x7efc6419a8e0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:05:48.081 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:05:48.049+0000 7efc694a3700 1 -- 172.21.15.184:0/2229841349 >> 172.21.15.184:0/2229841349 conn(0x7efc64075070 msgr2=0x7efc640fdc00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:05:48.081 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:05:48.049+0000 7efc694a3700 1 -- 172.21.15.184:0/2229841349 shutdown_connections 2023-07-14T18:05:48.081 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:05:48.049+0000 7efc694a3700 1 -- 172.21.15.184:0/2229841349 wait complete. 2023-07-14T18:05:48.537 DEBUG:teuthology.orchestra.run.smithi172:mon.b> sudo journalctl -f -n 0 -u ceph-bf7326ec-2270-11ee-9b33-001a4aab830c@mon.b.service 2023-07-14T18:05:48.540 DEBUG:teuthology.orchestra.run.smithi184:mon.c> sudo journalctl -f -n 0 -u ceph-bf7326ec-2270-11ee-9b33-001a4aab830c@mon.c.service 2023-07-14T18:05:48.544 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2023-07-14T18:05:48.544 DEBUG:teuthology.orchestra.run.smithi184:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81c9387d2e7576da065747ec9c16d1c7d69016ec shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bf7326ec-2270-11ee-9b33-001a4aab830c -- ceph mon dump -f json 2023-07-14T18:05:48.575 INFO:journalctl@ceph.mon.c.smithi184.stdout:-- Logs begin at Fri 2023-07-14 17:45:39 UTC. -- 2023-07-14T18:05:48.576 INFO:journalctl@ceph.mon.b.smithi172.stdout:-- Logs begin at Fri 2023-07-14 17:45:52 UTC. -- 2023-07-14T18:05:49.208 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:05:48 smithi163 ceph-mon[96576]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-14T18:05:49.208 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:05:48 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:05:49.208 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:05:48 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-14T18:05:49.208 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:05:48 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T18:05:49.208 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:05:48 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-14T18:05:49.209 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:05:48 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:05:49.209 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:05:48 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-07-14T18:05:49.209 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:05:48 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T18:05:49.465 INFO:teuthology.orchestra.run.smithi184.stderr:Inferring config /var/lib/ceph/bf7326ec-2270-11ee-9b33-001a4aab830c/config/ceph.conf 2023-07-14T18:05:50.208 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:05:49 smithi163 ceph-mon[96576]: from='client.14188 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi163:172.21.15.163=a;smithi172:172.21.15.172=b;smithi184:172.21.15.184=c", "target": ["mon-mgr", ""]}]: dispatch 2023-07-14T18:05:50.208 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:05:49 smithi163 ceph-mon[96576]: Saving service mon spec with placement smithi163:172.21.15.163=a;smithi172:172.21.15.172=b;smithi184:172.21.15.184=c;count:3 2023-07-14T18:05:50.208 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:05:49 smithi163 ceph-mon[96576]: Deploying daemon mon.c on smithi184 2023-07-14T18:05:51.179 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:05:51.146+0000 7f2df744c700 1 -- 172.21.15.184:0/1714251324 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f2df00fe580 msgr2=0x7f2df00fe950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:05:51.179 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:05:51.146+0000 7f2df744c700 1 --2- 172.21.15.184:0/1714251324 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f2df00fe580 0x7f2df00fe950 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f2dec009910 tx=0x7f2dec009c20 comp rx=0 tx=0).stop 2023-07-14T18:05:51.179 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:05:51.146+0000 7f2df744c700 1 -- 172.21.15.184:0/1714251324 shutdown_connections 2023-07-14T18:05:51.179 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:05:51.146+0000 7f2df744c700 1 --2- 172.21.15.184:0/1714251324 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f2df00fe580 0x7f2df00fe950 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:05:51.179 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:05:51.146+0000 7f2df744c700 1 -- 172.21.15.184:0/1714251324 >> 172.21.15.184:0/1714251324 conn(0x7f2df0075070 msgr2=0x7f2df0075470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:05:51.180 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:05:51.146+0000 7f2df744c700 1 -- 172.21.15.184:0/1714251324 shutdown_connections 2023-07-14T18:05:51.180 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:05:51.146+0000 7f2df744c700 1 -- 172.21.15.184:0/1714251324 wait complete. 2023-07-14T18:05:51.180 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:05:51.147+0000 7f2df744c700 1 Processor -- start 2023-07-14T18:05:51.180 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:05:51.147+0000 7f2df744c700 1 -- start start 2023-07-14T18:05:51.180 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:05:51.147+0000 7f2df744c700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f2df00fe580 0x7f2df019a9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:05:51.180 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:05:51.147+0000 7f2df744c700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2df019af00 con 0x7f2df00fe580 2023-07-14T18:05:51.181 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:05:51.147+0000 7f2df51e8700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f2df00fe580 0x7f2df019a9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:05:51.181 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:05:51.147+0000 7f2df51e8700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f2df00fe580 0x7f2df019a9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.184:50454/0 (socket says 172.21.15.184:50454) 2023-07-14T18:05:51.181 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:05:51.147+0000 7f2df51e8700 1 -- 172.21.15.184:0/1115256365 learned_addr learned my addr 172.21.15.184:0/1115256365 (peer_addr_for_me v2:172.21.15.184:0/0) 2023-07-14T18:05:51.182 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:05:51.148+0000 7f2df51e8700 1 -- 172.21.15.184:0/1115256365 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2dec0095f0 con 0x7f2df00fe580 2023-07-14T18:05:51.182 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:05:51.148+0000 7f2df51e8700 1 --2- 172.21.15.184:0/1115256365 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f2df00fe580 0x7f2df019a9c0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f2dec006010 tx=0x7f2dec004ff0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:05:51.182 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:05:51.148+0000 7f2de67fc700 1 -- 172.21.15.184:0/1115256365 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2dec01d070 con 0x7f2df00fe580 2023-07-14T18:05:51.182 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:05:51.148+0000 7f2de67fc700 1 -- 172.21.15.184:0/1115256365 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f2dec00bdf0 con 0x7f2df00fe580 2023-07-14T18:05:51.183 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:05:51.148+0000 7f2df744c700 1 -- 172.21.15.184:0/1115256365 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2df019b100 con 0x7f2df00fe580 2023-07-14T18:05:51.183 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:05:51.148+0000 7f2de67fc700 1 -- 172.21.15.184:0/1115256365 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2dec022d80 con 0x7f2df00fe580 2023-07-14T18:05:51.183 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:05:51.148+0000 7f2df744c700 1 -- 172.21.15.184:0/1115256365 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2df01949b0 con 0x7f2df00fe580 2023-07-14T18:05:51.183 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:05:51.149+0000 7f2de67fc700 1 -- 172.21.15.184:0/1115256365 <== mon.0 v2:172.21.15.163:3300/0 4 ==== mgrmap(e 13) v1 ==== 45540+0+0 (secure 0 0 0) 0x7f2dec00f460 con 0x7f2df00fe580 2023-07-14T18:05:51.183 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:05:51.149+0000 7f2de67fc700 1 --2- 172.21.15.184:0/1115256365 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f2ddc0387b0 0x7f2ddc03ac60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:05:51.183 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:05:51.149+0000 7f2df744c700 1 -- 172.21.15.184:0/1115256365 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2df019b520 con 0x7f2df00fe580 2023-07-14T18:05:51.183 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:05:51.149+0000 7f2de67fc700 1 -- 172.21.15.184:0/1115256365 <== mon.0 v2:172.21.15.163:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f2dec04cab0 con 0x7f2df00fe580 2023-07-14T18:05:51.184 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:05:51.149+0000 7f2df49e7700 1 --2- 172.21.15.184:0/1115256365 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f2ddc0387b0 0x7f2ddc03ac60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:05:51.184 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:05:51.150+0000 7f2df49e7700 1 --2- 172.21.15.184:0/1115256365 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f2ddc0387b0 0x7f2ddc03ac60 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f2de0006fd0 tx=0x7f2de0006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:05:51.186 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:05:51.154+0000 7f2de67fc700 1 -- 172.21.15.184:0/1115256365 <== mon.0 v2:172.21.15.163:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178025 (secure 0 0 0) 0x7f2dec020960 con 0x7f2df00fe580 2023-07-14T18:05:51.208 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:05:50 smithi163 ceph-mon[96576]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-14T18:05:51.464 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:05:51.432+0000 7f2df744c700 1 -- 172.21.15.184:0/1115256365 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f2df01960c0 con 0x7f2df00fe580 2023-07-14T18:05:51.465 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:05:51.432+0000 7f2de67fc700 1 -- 172.21.15.184:0/1115256365 <== mon.0 v2:172.21.15.163:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+740 (secure 0 0 0) 0x7f2dec027030 con 0x7f2df00fe580 2023-07-14T18:05:51.465 INFO:teuthology.orchestra.run.smithi184.stdout: 2023-07-14T18:05:51.465 INFO:teuthology.orchestra.run.smithi184.stdout:{"epoch":1,"fsid":"bf7326ec-2270-11ee-9b33-001a4aab830c","modified":"2023-07-14T18:04:23.985781Z","created":"2023-07-14T18:04:23.985781Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:3300","nonce":0},{"type":"v1","addr":"172.21.15.163:6789","nonce":0}]},"addr":"172.21.15.163:6789/0","public_addr":"172.21.15.163:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2023-07-14T18:05:51.466 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:05:51.434+0000 7f2df744c700 1 -- 172.21.15.184:0/1115256365 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f2ddc0387b0 msgr2=0x7f2ddc03ac60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:05:51.466 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:05:51.434+0000 7f2df744c700 1 --2- 172.21.15.184:0/1115256365 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f2ddc0387b0 0x7f2ddc03ac60 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f2de0006fd0 tx=0x7f2de0006e40 comp rx=0 tx=0).stop 2023-07-14T18:05:51.466 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:05:51.434+0000 7f2df744c700 1 -- 172.21.15.184:0/1115256365 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f2df00fe580 msgr2=0x7f2df019a9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:05:51.467 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:05:51.434+0000 7f2df744c700 1 --2- 172.21.15.184:0/1115256365 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f2df00fe580 0x7f2df019a9c0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f2dec006010 tx=0x7f2dec004ff0 comp rx=0 tx=0).stop 2023-07-14T18:05:51.467 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:05:51.435+0000 7f2df744c700 1 -- 172.21.15.184:0/1115256365 shutdown_connections 2023-07-14T18:05:51.467 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:05:51.435+0000 7f2df744c700 1 --2- 172.21.15.184:0/1115256365 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f2ddc0387b0 0x7f2ddc03ac60 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:05:51.467 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:05:51.435+0000 7f2df744c700 1 --2- 172.21.15.184:0/1115256365 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f2df00fe580 0x7f2df019a9c0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:05:51.467 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:05:51.435+0000 7f2df744c700 1 -- 172.21.15.184:0/1115256365 >> 172.21.15.184:0/1115256365 conn(0x7f2df0075070 msgr2=0x7f2df0101bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:05:51.467 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:05:51.435+0000 7f2df744c700 1 -- 172.21.15.184:0/1115256365 shutdown_connections 2023-07-14T18:05:51.467 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:05:51.435+0000 7f2df744c700 1 -- 172.21.15.184:0/1115256365 wait complete. 2023-07-14T18:05:51.468 INFO:teuthology.orchestra.run.smithi184.stderr:dumped monmap epoch 1 2023-07-14T18:05:51.602 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:05:51 smithi184 ceph-mon[98481]: mon.c@-1(synchronizing) e1 handle_conf_change mon_allow_pool_delete 2023-07-14T18:05:51.890 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:05:51 smithi184 systemd[1]: Started Ceph mon.c for bf7326ec-2270-11ee-9b33-001a4aab830c. 2023-07-14T18:05:52.961 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2023-07-14T18:05:52.962 DEBUG:teuthology.orchestra.run.smithi184:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81c9387d2e7576da065747ec9c16d1c7d69016ec shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bf7326ec-2270-11ee-9b33-001a4aab830c -- ceph mon dump -f json 2023-07-14T18:05:53.528 INFO:teuthology.orchestra.run.smithi184.stderr:Inferring config /var/lib/ceph/bf7326ec-2270-11ee-9b33-001a4aab830c/mon.c/config 2023-07-14T18:05:56.958 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:05:56 smithi163 ceph-mon[96576]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-14T18:05:56.958 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:05:56 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-07-14T18:05:56.959 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:05:56 smithi163 ceph-mon[96576]: mon.a calling monitor election 2023-07-14T18:05:56.959 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:05:56 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-07-14T18:05:56.959 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:05:56 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-07-14T18:05:56.959 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:05:56 smithi163 ceph-mon[96576]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-14T18:05:56.959 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:05:56 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-07-14T18:05:56.959 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:05:56 smithi163 ceph-mon[96576]: mon.c calling monitor election 2023-07-14T18:05:56.959 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:05:56 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-07-14T18:05:56.960 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:05:56 smithi163 ceph-mon[96576]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-14T18:05:56.960 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:05:56 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-07-14T18:05:56.960 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:05:56 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-07-14T18:05:56.960 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:05:56 smithi163 ceph-mon[96576]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2023-07-14T18:05:56.960 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:05:56 smithi163 ceph-mon[96576]: monmap e2: 2 mons at {a=[v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0],c=[v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0]} removed_ranks: {} 2023-07-14T18:05:56.960 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:05:56 smithi163 ceph-mon[96576]: fsmap 2023-07-14T18:05:56.960 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:05:56 smithi163 ceph-mon[96576]: osdmap e4: 0 total, 0 up, 0 in 2023-07-14T18:05:56.961 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:05:56 smithi163 ceph-mon[96576]: mgrmap e13: x(active, since 41s) 2023-07-14T18:05:56.961 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:05:56 smithi163 ceph-mon[96576]: overall HEALTH_OK 2023-07-14T18:05:56.961 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:05:56 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:05:56.961 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:05:56 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:05:56.961 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:05:56 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:05:56.961 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:05:56 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-07-14T18:05:56.961 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:05:56 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T18:05:57.166 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:05:56 smithi184 ceph-mon[98481]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-14T18:05:57.166 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:05:56 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-07-14T18:05:57.166 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:05:56 smithi184 ceph-mon[98481]: mon.a calling monitor election 2023-07-14T18:05:57.166 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:05:56 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-07-14T18:05:57.166 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:05:56 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-07-14T18:05:57.167 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:05:56 smithi184 ceph-mon[98481]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-14T18:05:57.167 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:05:56 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-07-14T18:05:57.167 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:05:56 smithi184 ceph-mon[98481]: mon.c calling monitor election 2023-07-14T18:05:57.167 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:05:56 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-07-14T18:05:57.167 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:05:56 smithi184 ceph-mon[98481]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-14T18:05:57.167 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:05:56 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-07-14T18:05:57.168 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:05:56 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-07-14T18:05:57.168 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:05:56 smithi184 ceph-mon[98481]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2023-07-14T18:05:57.168 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:05:56 smithi184 ceph-mon[98481]: monmap e2: 2 mons at {a=[v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0],c=[v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0]} removed_ranks: {} 2023-07-14T18:05:57.168 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:05:56 smithi184 ceph-mon[98481]: fsmap 2023-07-14T18:05:57.168 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:05:56 smithi184 ceph-mon[98481]: osdmap e4: 0 total, 0 up, 0 in 2023-07-14T18:05:57.168 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:05:56 smithi184 ceph-mon[98481]: mgrmap e13: x(active, since 41s) 2023-07-14T18:05:57.169 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:05:56 smithi184 ceph-mon[98481]: overall HEALTH_OK 2023-07-14T18:05:57.169 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:05:56 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:05:57.169 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:05:56 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:05:57.169 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:05:56 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:05:57.169 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:05:56 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-07-14T18:05:57.169 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:05:56 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T18:05:57.822 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:05:57.790+0000 7fee56f48700 1 -- 172.21.15.184:0/2435551797 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fee400057d0 msgr2=0x7fee40007c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:05:57.822 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:05:57.790+0000 7fee56f48700 1 --2- 172.21.15.184:0/2435551797 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fee400057d0 0x7fee40007c50 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fee50077a10 tx=0x7fee4400feb0 comp rx=0 tx=0).stop 2023-07-14T18:05:57.822 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:05:57.790+0000 7fee56f48700 1 -- 172.21.15.184:0/2435551797 shutdown_connections 2023-07-14T18:05:57.823 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:05:57.790+0000 7fee56f48700 1 --2- 172.21.15.184:0/2435551797 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fee400057d0 0x7fee40007c50 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:05:57.823 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:05:57.790+0000 7fee56f48700 1 -- 172.21.15.184:0/2435551797 >> 172.21.15.184:0/2435551797 conn(0x7fee50073ea0 msgr2=0x7fee500742a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:05:57.823 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:05:57.790+0000 7fee56f48700 1 -- 172.21.15.184:0/2435551797 shutdown_connections 2023-07-14T18:05:57.823 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:05:57.790+0000 7fee56f48700 1 -- 172.21.15.184:0/2435551797 wait complete. 2023-07-14T18:05:57.824 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:05:57.791+0000 7fee56f48700 1 Processor -- start 2023-07-14T18:05:57.825 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:05:57.791+0000 7fee56f48700 1 -- start start 2023-07-14T18:05:57.825 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:05:57.792+0000 7fee56f48700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fee400057d0 0x7fee50198940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:05:57.825 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:05:57.792+0000 7fee56f48700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fee50198e80 0x7fee501929c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:05:57.825 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:05:57.792+0000 7fee56f48700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee501992f0 con 0x7fee400057d0 2023-07-14T18:05:57.825 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:05:57.792+0000 7fee56f48700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee50199460 con 0x7fee50198e80 2023-07-14T18:05:57.826 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:05:57.792+0000 7fee4ffff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fee50198e80 0x7fee501929c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:05:57.826 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:05:57.792+0000 7fee4ffff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fee50198e80 0x7fee501929c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.184:53814/0 (socket says 172.21.15.184:53814) 2023-07-14T18:05:57.826 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:05:57.792+0000 7fee4ffff700 1 -- 172.21.15.184:0/60260966 learned_addr learned my addr 172.21.15.184:0/60260966 (peer_addr_for_me v2:172.21.15.184:0/0) 2023-07-14T18:05:57.826 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:05:57.792+0000 7fee54ce4700 1 --2- 172.21.15.184:0/60260966 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fee400057d0 0x7fee50198940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:05:57.826 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:05:57.792+0000 7fee4ffff700 1 -- 172.21.15.184:0/60260966 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fee50198e80 msgr2=0x7fee501929c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 13 2023-07-14T18:05:57.826 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:05:57.792+0000 7fee4ffff700 1 -- 172.21.15.184:0/60260966 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fee50198e80 msgr2=0x7fee501929c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2023-07-14T18:05:57.826 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:05:57.792+0000 7fee4ffff700 1 --2- 172.21.15.184:0/60260966 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fee50198e80 0x7fee501929c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-07-14T18:05:57.827 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:05:57.792+0000 7fee4ffff700 1 --2- 172.21.15.184:0/60260966 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fee50198e80 0x7fee501929c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-14T18:05:57.827 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:05:57.792+0000 7fee54ce4700 1 -- 172.21.15.184:0/60260966 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fee50198e80 msgr2=0x7fee501929c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-14T18:05:57.827 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:05:57.792+0000 7fee54ce4700 1 --2- 172.21.15.184:0/60260966 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fee50198e80 0x7fee501929c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:05:57.827 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:05:57.792+0000 7fee54ce4700 1 -- 172.21.15.184:0/60260966 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee4400f900 con 0x7fee400057d0 2023-07-14T18:05:57.827 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:05:57.793+0000 7fee54ce4700 1 --2- 172.21.15.184:0/60260966 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fee400057d0 0x7fee50198940 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fee44000c00 tx=0x7fee440049d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:05:57.827 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:05:57.793+0000 7fee4dffb700 1 -- 172.21.15.184:0/60260966 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 309+0+0 (secure 0 0 0) 0x7fee44013b00 con 0x7fee400057d0 2023-07-14T18:05:57.827 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:05:57.793+0000 7fee56f48700 1 -- 172.21.15.184:0/60260966 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee50192f60 con 0x7fee400057d0 2023-07-14T18:05:57.828 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:05:57.793+0000 7fee4dffb700 1 -- 172.21.15.184:0/60260966 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fee440044c0 con 0x7fee400057d0 2023-07-14T18:05:57.828 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:05:57.793+0000 7fee4dffb700 1 -- 172.21.15.184:0/60260966 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 309+0+0 (secure 0 0 0) 0x7fee44003c60 con 0x7fee400057d0 2023-07-14T18:05:57.829 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:05:57.793+0000 7fee56f48700 1 -- 172.21.15.184:0/60260966 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee501934b0 con 0x7fee400057d0 2023-07-14T18:05:57.829 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:05:57.794+0000 7fee4dffb700 1 -- 172.21.15.184:0/60260966 <== mon.0 v2:172.21.15.163:3300/0 4 ==== mgrmap(e 13) v1 ==== 45540+0+0 (secure 0 0 0) 0x7fee440114c0 con 0x7fee400057d0 2023-07-14T18:05:57.829 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:05:57.794+0000 7fee56f48700 1 -- 172.21.15.184:0/60260966 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fee50061c70 con 0x7fee400057d0 2023-07-14T18:05:57.829 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:05:57.795+0000 7fee4dffb700 1 --2- 172.21.15.184:0/60260966 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7fee34038630 0x7fee3403aae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:05:57.829 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:05:57.795+0000 7fee4dffb700 1 -- 172.21.15.184:0/60260966 <== mon.0 v2:172.21.15.163:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7fee4404dcc0 con 0x7fee400057d0 2023-07-14T18:05:57.830 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:05:57.795+0000 7fee4ffff700 1 --2- 172.21.15.184:0/60260966 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7fee34038630 0x7fee3403aae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:05:57.830 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:05:57.795+0000 7fee4ffff700 1 --2- 172.21.15.184:0/60260966 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7fee34038630 0x7fee3403aae0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fee3c009180 tx=0x7fee3c008040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:05:57.831 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:05:57.800+0000 7fee4dffb700 1 -- 172.21.15.184:0/60260966 <== mon.0 v2:172.21.15.163:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178025 (secure 0 0 0) 0x7fee440107e0 con 0x7fee400057d0 2023-07-14T18:05:57.958 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:05:57 smithi163 ceph-mon[96576]: Deploying daemon mon.b on smithi172 2023-07-14T18:05:57.958 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:05:57 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-07-14T18:05:58.098 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:05:58.067+0000 7fee56f48700 1 -- 172.21.15.184:0/60260966 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7fee50193ed0 con 0x7fee400057d0 2023-07-14T18:05:58.099 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:05:58.067+0000 7fee4dffb700 1 -- 172.21.15.184:0/60260966 <== mon.0 v2:172.21.15.163:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 2 v2) v1 ==== 95+0+1010 (secure 0 0 0) 0x7fee44023360 con 0x7fee400057d0 2023-07-14T18:05:58.099 INFO:teuthology.orchestra.run.smithi184.stdout: 2023-07-14T18:05:58.099 INFO:teuthology.orchestra.run.smithi184.stdout:{"epoch":2,"fsid":"bf7326ec-2270-11ee-9b33-001a4aab830c","modified":"2023-07-14T18:05:51.532217Z","created":"2023-07-14T18:04:23.985781Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:3300","nonce":0},{"type":"v1","addr":"172.21.15.163:6789","nonce":0}]},"addr":"172.21.15.163:6789/0","public_addr":"172.21.15.163:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:3300","nonce":0},{"type":"v1","addr":"172.21.15.184:6789","nonce":0}]},"addr":"172.21.15.184:6789/0","public_addr":"172.21.15.184:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2023-07-14T18:05:58.101 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:05:58.069+0000 7fee56f48700 1 -- 172.21.15.184:0/60260966 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7fee34038630 msgr2=0x7fee3403aae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:05:58.101 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:05:58.069+0000 7fee56f48700 1 --2- 172.21.15.184:0/60260966 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7fee34038630 0x7fee3403aae0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fee3c009180 tx=0x7fee3c008040 comp rx=0 tx=0).stop 2023-07-14T18:05:58.101 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:05:58.070+0000 7fee56f48700 1 -- 172.21.15.184:0/60260966 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fee400057d0 msgr2=0x7fee50198940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:05:58.102 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:05:58.070+0000 7fee56f48700 1 --2- 172.21.15.184:0/60260966 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fee400057d0 0x7fee50198940 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fee44000c00 tx=0x7fee440049d0 comp rx=0 tx=0).stop 2023-07-14T18:05:58.102 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:05:58.070+0000 7fee56f48700 1 -- 172.21.15.184:0/60260966 shutdown_connections 2023-07-14T18:05:58.102 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:05:58.070+0000 7fee56f48700 1 --2- 172.21.15.184:0/60260966 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7fee34038630 0x7fee3403aae0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:05:58.102 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:05:58.070+0000 7fee56f48700 1 --2- 172.21.15.184:0/60260966 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fee400057d0 0x7fee50198940 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:05:58.102 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:05:58.070+0000 7fee56f48700 1 --2- 172.21.15.184:0/60260966 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fee50198e80 0x7fee501929c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:05:58.102 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:05:58.070+0000 7fee56f48700 1 -- 172.21.15.184:0/60260966 >> 172.21.15.184:0/60260966 conn(0x7fee50073ea0 msgr2=0x7fee50100a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:05:58.102 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:05:58.070+0000 7fee56f48700 1 -- 172.21.15.184:0/60260966 shutdown_connections 2023-07-14T18:05:58.103 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:05:58.070+0000 7fee56f48700 1 -- 172.21.15.184:0/60260966 wait complete. 2023-07-14T18:05:58.103 INFO:teuthology.orchestra.run.smithi184.stderr:dumped monmap epoch 2 2023-07-14T18:05:58.128 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:05:57 smithi184 ceph-mon[98481]: Deploying daemon mon.b on smithi172 2023-07-14T18:05:58.128 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:05:57 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-07-14T18:05:58.915 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:05:58 smithi184 ceph-mon[98481]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-14T18:05:58.916 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:05:58 smithi184 ceph-mon[98481]: from='client.? 172.21.15.184:0/60260966' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-07-14T18:05:58.958 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:05:58 smithi163 ceph-mon[96576]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-14T18:05:58.958 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:05:58 smithi163 ceph-mon[96576]: from='client.? 172.21.15.184:0/60260966' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-07-14T18:05:59.489 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2023-07-14T18:05:59.490 DEBUG:teuthology.orchestra.run.smithi184:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81c9387d2e7576da065747ec9c16d1c7d69016ec shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bf7326ec-2270-11ee-9b33-001a4aab830c -- ceph mon dump -f json 2023-07-14T18:05:59.512 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:05:59 smithi172 systemd[1]: Starting Ceph mon.b for bf7326ec-2270-11ee-9b33-001a4aab830c... 2023-07-14T18:05:59.767 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:05:59 smithi172 podman[97943]: 2023-07-14T18:05:59.767 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:05:59 smithi172 ceph-mon[97983]: set uid:gid to 167:167 (ceph:ceph) 2023-07-14T18:05:59.768 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:05:59 smithi172 ceph-mon[97983]: ceph version 18.0.0-4940-g81c9387d (81c9387d2e7576da065747ec9c16d1c7d69016ec) reef (dev), process ceph-mon, pid 7 2023-07-14T18:05:59.768 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:05:59 smithi172 ceph-mon[97983]: pidfile_write: ignore empty --pid-file 2023-07-14T18:05:59.768 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:05:59 smithi172 bash[97943]: eaaf358d8bbcd4616826bd4c440da410dc7c40db1fcca1364dacac5b77a2871c 2023-07-14T18:05:59.768 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:05:59 smithi172 ceph-mon[97983]: load: jerasure load: lrc 2023-07-14T18:05:59.768 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:05:59 smithi172 ceph-mon[97983]: rocksdb: RocksDB version: 7.9.2 2023-07-14T18:05:59.768 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:05:59 smithi172 ceph-mon[97983]: rocksdb: Git sha 0 2023-07-14T18:05:59.768 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:05:59 smithi172 ceph-mon[97983]: rocksdb: Compile date 2023-07-14 14:45:42 2023-07-14T18:05:59.769 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:05:59 smithi172 ceph-mon[97983]: rocksdb: DB SUMMARY 2023-07-14T18:05:59.769 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:05:59 smithi172 ceph-mon[97983]: rocksdb: DB Session ID: 5GLE325P2EPTDKFPOPEK 2023-07-14T18:05:59.769 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:05:59 smithi172 ceph-mon[97983]: rocksdb: CURRENT file: CURRENT 2023-07-14T18:05:59.769 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:05:59 smithi172 ceph-mon[97983]: rocksdb: IDENTITY file: IDENTITY 2023-07-14T18:05:59.769 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:05:59 smithi172 ceph-mon[97983]: rocksdb: MANIFEST file: MANIFEST-000005 size: 59 Bytes 2023-07-14T18:05:59.769 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:05:59 smithi172 ceph-mon[97983]: rocksdb: SST files in /var/lib/ceph/mon/ceph-b/store.db dir, Total Num: 0, files: 2023-07-14T18:05:59.769 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:05:59 smithi172 ceph-mon[97983]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-b/store.db: 000004.log size: 636 ; 2023-07-14T18:05:59.770 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:05:59 smithi172 ceph-mon[97983]: rocksdb: Options.error_if_exists: 0 2023-07-14T18:05:59.770 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:05:59 smithi172 ceph-mon[97983]: rocksdb: Options.create_if_missing: 0 2023-07-14T18:05:59.770 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:05:59 smithi172 ceph-mon[97983]: rocksdb: Options.paranoid_checks: 1 2023-07-14T18:05:59.770 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:05:59 smithi172 ceph-mon[97983]: rocksdb: Options.flush_verify_memtable_count: 1 2023-07-14T18:05:59.770 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:05:59 smithi172 ceph-mon[97983]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2023-07-14T18:05:59.770 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:05:59 smithi172 ceph-mon[97983]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2023-07-14T18:05:59.770 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:05:59 smithi172 ceph-mon[97983]: rocksdb: Options.env: 0x5582aa6fcc60 2023-07-14T18:05:59.770 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:05:59 smithi172 ceph-mon[97983]: rocksdb: Options.fs: PosixFileSystem 2023-07-14T18:05:59.771 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:05:59 smithi172 ceph-mon[97983]: rocksdb: Options.info_log: 0x5582ac3412a0 2023-07-14T18:05:59.771 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:05:59 smithi172 ceph-mon[97983]: rocksdb: Options.max_file_opening_threads: 16 2023-07-14T18:05:59.771 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:05:59 smithi172 ceph-mon[97983]: rocksdb: Options.statistics: (nil) 2023-07-14T18:05:59.771 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:05:59 smithi172 ceph-mon[97983]: rocksdb: Options.use_fsync: 0 2023-07-14T18:05:59.771 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:05:59 smithi172 ceph-mon[97983]: rocksdb: Options.max_log_file_size: 0 2023-07-14T18:05:59.771 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:05:59 smithi172 ceph-mon[97983]: rocksdb: Options.max_manifest_file_size: 1073741824 2023-07-14T18:05:59.771 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:05:59 smithi172 ceph-mon[97983]: rocksdb: Options.log_file_time_to_roll: 0 2023-07-14T18:05:59.772 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:05:59 smithi172 ceph-mon[97983]: rocksdb: Options.keep_log_file_num: 1000 2023-07-14T18:05:59.772 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:05:59 smithi172 ceph-mon[97983]: rocksdb: Options.recycle_log_file_num: 0 2023-07-14T18:05:59.772 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:05:59 smithi172 ceph-mon[97983]: rocksdb: Options.allow_fallocate: 1 2023-07-14T18:05:59.772 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:05:59 smithi172 ceph-mon[97983]: rocksdb: Options.allow_mmap_reads: 0 2023-07-14T18:05:59.772 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:05:59 smithi172 ceph-mon[97983]: rocksdb: Options.allow_mmap_writes: 0 2023-07-14T18:05:59.772 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:05:59 smithi172 ceph-mon[97983]: rocksdb: Options.use_direct_reads: 0 2023-07-14T18:05:59.772 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:05:59 smithi172 ceph-mon[97983]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2023-07-14T18:05:59.772 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:05:59 smithi172 ceph-mon[97983]: rocksdb: Options.create_missing_column_families: 0 2023-07-14T18:05:59.773 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:05:59 smithi172 ceph-mon[97983]: rocksdb: Options.db_log_dir: 2023-07-14T18:05:59.773 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:05:59 smithi172 ceph-mon[97983]: rocksdb: Options.wal_dir: 2023-07-14T18:05:59.773 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:05:59 smithi172 ceph-mon[97983]: rocksdb: Options.table_cache_numshardbits: 6 2023-07-14T18:05:59.773 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:05:59 smithi172 ceph-mon[97983]: rocksdb: Options.WAL_ttl_seconds: 0 2023-07-14T18:05:59.773 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:05:59 smithi172 ceph-mon[97983]: rocksdb: Options.WAL_size_limit_MB: 0 2023-07-14T18:05:59.773 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:05:59 smithi172 ceph-mon[97983]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2023-07-14T18:05:59.773 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:05:59 smithi172 ceph-mon[97983]: rocksdb: Options.manifest_preallocation_size: 4194304 2023-07-14T18:05:59.774 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:05:59 smithi172 ceph-mon[97983]: rocksdb: Options.is_fd_close_on_exec: 1 2023-07-14T18:05:59.774 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:05:59 smithi172 ceph-mon[97983]: rocksdb: Options.advise_random_on_open: 1 2023-07-14T18:05:59.774 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:05:59 smithi172 ceph-mon[97983]: rocksdb: Options.db_write_buffer_size: 0 2023-07-14T18:05:59.774 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:05:59 smithi172 ceph-mon[97983]: rocksdb: Options.write_buffer_manager: 0x5582ac2623c0 2023-07-14T18:05:59.774 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:05:59 smithi172 ceph-mon[97983]: rocksdb: Options.access_hint_on_compaction_start: 1 2023-07-14T18:05:59.774 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:05:59 smithi172 ceph-mon[97983]: rocksdb: Options.random_access_max_buffer_size: 1048576 2023-07-14T18:05:59.774 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:05:59 smithi172 ceph-mon[97983]: rocksdb: Options.use_adaptive_mutex: 0 2023-07-14T18:05:59.774 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:05:59 smithi172 ceph-mon[97983]: rocksdb: Options.rate_limiter: (nil) 2023-07-14T18:05:59.775 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:05:59 smithi172 ceph-mon[97983]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2023-07-14T18:05:59.775 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:05:59 smithi172 ceph-mon[97983]: rocksdb: Options.wal_recovery_mode: 2 2023-07-14T18:05:59.775 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:05:59 smithi172 ceph-mon[97983]: rocksdb: Options.enable_thread_tracking: 0 2023-07-14T18:05:59.775 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:05:59 smithi172 ceph-mon[97983]: rocksdb: Options.enable_pipelined_write: 0 2023-07-14T18:05:59.775 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:05:59 smithi172 ceph-mon[97983]: rocksdb: Options.unordered_write: 0 2023-07-14T18:05:59.775 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:05:59 smithi172 ceph-mon[97983]: rocksdb: Options.allow_concurrent_memtable_write: 1 2023-07-14T18:05:59.775 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:05:59 smithi172 ceph-mon[97983]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2023-07-14T18:05:59.775 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:05:59 smithi172 ceph-mon[97983]: rocksdb: Options.write_thread_max_yield_usec: 100 2023-07-14T18:05:59.776 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:05:59 smithi172 ceph-mon[97983]: rocksdb: Options.write_thread_slow_yield_usec: 3 2023-07-14T18:05:59.776 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:05:59 smithi172 ceph-mon[97983]: rocksdb: Options.row_cache: None 2023-07-14T18:05:59.776 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:05:59 smithi172 ceph-mon[97983]: rocksdb: Options.wal_filter: None 2023-07-14T18:05:59.776 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:05:59 smithi172 ceph-mon[97983]: rocksdb: Options.avoid_flush_during_recovery: 0 2023-07-14T18:05:59.776 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:05:59 smithi172 ceph-mon[97983]: rocksdb: Options.allow_ingest_behind: 0 2023-07-14T18:05:59.776 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:05:59 smithi172 ceph-mon[97983]: rocksdb: Options.two_write_queues: 0 2023-07-14T18:05:59.776 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:05:59 smithi172 ceph-mon[97983]: rocksdb: Options.manual_wal_flush: 0 2023-07-14T18:05:59.777 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:05:59 smithi172 ceph-mon[97983]: rocksdb: Options.wal_compression: 0 2023-07-14T18:05:59.777 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:05:59 smithi172 ceph-mon[97983]: rocksdb: Options.atomic_flush: 0 2023-07-14T18:05:59.777 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:05:59 smithi172 ceph-mon[97983]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2023-07-14T18:05:59.777 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:05:59 smithi172 ceph-mon[97983]: rocksdb: Options.persist_stats_to_disk: 0 2023-07-14T18:05:59.777 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:05:59 smithi172 ceph-mon[97983]: rocksdb: Options.write_dbid_to_manifest: 0 2023-07-14T18:05:59.777 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:05:59 smithi172 ceph-mon[97983]: rocksdb: Options.log_readahead_size: 0 2023-07-14T18:05:59.777 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:05:59 smithi172 ceph-mon[97983]: rocksdb: Options.file_checksum_gen_factory: Unknown 2023-07-14T18:05:59.777 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:05:59 smithi172 ceph-mon[97983]: rocksdb: Options.best_efforts_recovery: 0 2023-07-14T18:05:59.778 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:05:59 smithi172 ceph-mon[97983]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2023-07-14T18:05:59.778 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:05:59 smithi172 ceph-mon[97983]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2023-07-14T18:05:59.778 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:05:59 smithi172 ceph-mon[97983]: rocksdb: Options.allow_data_in_errors: 0 2023-07-14T18:05:59.779 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:05:59 smithi172 ceph-mon[97983]: rocksdb: Options.db_host_id: __hostname__ 2023-07-14T18:05:59.779 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:05:59 smithi172 ceph-mon[97983]: rocksdb: Options.enforce_single_del_contracts: true 2023-07-14T18:05:59.779 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:05:59 smithi172 ceph-mon[97983]: rocksdb: Options.max_background_jobs: 2 2023-07-14T18:05:59.780 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:05:59 smithi172 ceph-mon[97983]: rocksdb: Options.max_background_compactions: -1 2023-07-14T18:05:59.780 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:05:59 smithi172 ceph-mon[97983]: rocksdb: Options.max_subcompactions: 1 2023-07-14T18:05:59.780 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:05:59 smithi172 ceph-mon[97983]: rocksdb: Options.avoid_flush_during_shutdown: 0 2023-07-14T18:05:59.780 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:05:59 smithi172 ceph-mon[97983]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2023-07-14T18:05:59.780 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:05:59 smithi172 ceph-mon[97983]: rocksdb: Options.delayed_write_rate : 16777216 2023-07-14T18:05:59.780 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:05:59 smithi172 ceph-mon[97983]: rocksdb: Options.max_total_wal_size: 0 2023-07-14T18:05:59.780 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:05:59 smithi172 ceph-mon[97983]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2023-07-14T18:05:59.781 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:05:59 smithi172 ceph-mon[97983]: rocksdb: Options.stats_dump_period_sec: 600 2023-07-14T18:05:59.781 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:05:59 smithi172 ceph-mon[97983]: rocksdb: Options.stats_persist_period_sec: 600 2023-07-14T18:05:59.781 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:05:59 smithi172 ceph-mon[97983]: rocksdb: Options.stats_history_buffer_size: 1048576 2023-07-14T18:05:59.781 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:05:59 smithi172 ceph-mon[97983]: rocksdb: Options.max_open_files: -1 2023-07-14T18:05:59.781 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:05:59 smithi172 ceph-mon[97983]: rocksdb: Options.bytes_per_sync: 0 2023-07-14T18:05:59.781 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:05:59 smithi172 ceph-mon[97983]: rocksdb: Options.wal_bytes_per_sync: 0 2023-07-14T18:05:59.781 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:05:59 smithi172 ceph-mon[97983]: rocksdb: Options.strict_bytes_per_sync: 0 2023-07-14T18:05:59.781 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:05:59 smithi172 ceph-mon[97983]: rocksdb: Options.compaction_readahead_size: 0 2023-07-14T18:05:59.782 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:05:59 smithi172 ceph-mon[97983]: rocksdb: Options.max_background_flushes: -1 2023-07-14T18:05:59.782 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:05:59 smithi172 ceph-mon[97983]: rocksdb: Compression algorithms supported: 2023-07-14T18:05:59.782 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:05:59 smithi172 ceph-mon[97983]: rocksdb: kZSTDNotFinalCompression supported: 0 2023-07-14T18:05:59.782 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:05:59 smithi172 ceph-mon[97983]: rocksdb: kZSTD supported: 0 2023-07-14T18:05:59.782 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:05:59 smithi172 ceph-mon[97983]: rocksdb: kXpressCompression supported: 0 2023-07-14T18:05:59.782 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:05:59 smithi172 ceph-mon[97983]: rocksdb: kLZ4HCCompression supported: 1 2023-07-14T18:05:59.782 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:05:59 smithi172 ceph-mon[97983]: rocksdb: kZlibCompression supported: 1 2023-07-14T18:05:59.782 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:05:59 smithi172 ceph-mon[97983]: rocksdb: kSnappyCompression supported: 1 2023-07-14T18:05:59.783 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:05:59 smithi172 ceph-mon[97983]: rocksdb: kLZ4Compression supported: 1 2023-07-14T18:05:59.783 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:05:59 smithi172 ceph-mon[97983]: rocksdb: kBZip2Compression supported: 0 2023-07-14T18:05:59.783 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:05:59 smithi172 ceph-mon[97983]: rocksdb: Fast CRC32 supported: Supported on x86 2023-07-14T18:05:59.783 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:05:59 smithi172 ceph-mon[97983]: rocksdb: DMutex implementation: pthread_mutex_t 2023-07-14T18:05:59.783 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:05:59 smithi172 ceph-mon[97983]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-b/store.db/MANIFEST-000005 2023-07-14T18:05:59.783 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:05:59 smithi172 ceph-mon[97983]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2023-07-14T18:05:59.783 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:05:59 smithi172 ceph-mon[97983]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2023-07-14T18:05:59.783 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:05:59 smithi172 ceph-mon[97983]: rocksdb: Options.merge_operator: 2023-07-14T18:05:59.784 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:05:59 smithi172 ceph-mon[97983]: rocksdb: Options.compaction_filter: None 2023-07-14T18:05:59.784 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:05:59 smithi172 ceph-mon[97983]: rocksdb: Options.compaction_filter_factory: None 2023-07-14T18:05:59.784 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:05:59 smithi172 ceph-mon[97983]: rocksdb: Options.sst_partitioner_factory: None 2023-07-14T18:05:59.784 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:05:59 smithi172 ceph-mon[97983]: rocksdb: Options.memtable_factory: SkipListFactory 2023-07-14T18:05:59.784 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:05:59 smithi172 ceph-mon[97983]: rocksdb: Options.table_factory: BlockBasedTable 2023-07-14T18:05:59.784 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:05:59 smithi172 ceph-mon[97983]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x5582ac3413a0) 2023-07-14T18:05:59.785 INFO:journalctl@ceph.mon.b.smithi172.stdout: cache_index_and_filter_blocks: 1 2023-07-14T18:05:59.785 INFO:journalctl@ceph.mon.b.smithi172.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2023-07-14T18:05:59.785 INFO:journalctl@ceph.mon.b.smithi172.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2023-07-14T18:05:59.785 INFO:journalctl@ceph.mon.b.smithi172.stdout: pin_top_level_index_and_filter: 1 2023-07-14T18:05:59.785 INFO:journalctl@ceph.mon.b.smithi172.stdout: index_type: 0 2023-07-14T18:05:59.785 INFO:journalctl@ceph.mon.b.smithi172.stdout: data_block_index_type: 0 2023-07-14T18:05:59.785 INFO:journalctl@ceph.mon.b.smithi172.stdout: index_shortening: 1 2023-07-14T18:05:59.785 INFO:journalctl@ceph.mon.b.smithi172.stdout: data_block_hash_table_util_ratio: 0.750000 2023-07-14T18:05:59.786 INFO:journalctl@ceph.mon.b.smithi172.stdout: checksum: 4 2023-07-14T18:05:59.786 INFO:journalctl@ceph.mon.b.smithi172.stdout: no_block_cache: 0 2023-07-14T18:05:59.786 INFO:journalctl@ceph.mon.b.smithi172.stdout: block_cache: 0x5582ac3011f0 2023-07-14T18:05:59.786 INFO:journalctl@ceph.mon.b.smithi172.stdout: block_cache_name: BinnedLRUCache 2023-07-14T18:05:59.786 INFO:journalctl@ceph.mon.b.smithi172.stdout: block_cache_options: 2023-07-14T18:05:59.786 INFO:journalctl@ceph.mon.b.smithi172.stdout: capacity : 536870912 2023-07-14T18:05:59.786 INFO:journalctl@ceph.mon.b.smithi172.stdout: num_shard_bits : 4 2023-07-14T18:05:59.787 INFO:journalctl@ceph.mon.b.smithi172.stdout: strict_capacity_limit : 0 2023-07-14T18:05:59.787 INFO:journalctl@ceph.mon.b.smithi172.stdout: high_pri_pool_ratio: 0.000 2023-07-14T18:05:59.787 INFO:journalctl@ceph.mon.b.smithi172.stdout: block_cache_compressed: (nil) 2023-07-14T18:05:59.787 INFO:journalctl@ceph.mon.b.smithi172.stdout: persistent_cache: (nil) 2023-07-14T18:05:59.787 INFO:journalctl@ceph.mon.b.smithi172.stdout: block_size: 4096 2023-07-14T18:05:59.787 INFO:journalctl@ceph.mon.b.smithi172.stdout: block_size_deviation: 10 2023-07-14T18:05:59.787 INFO:journalctl@ceph.mon.b.smithi172.stdout: block_restart_interval: 16 2023-07-14T18:05:59.787 INFO:journalctl@ceph.mon.b.smithi172.stdout: index_block_restart_interval: 1 2023-07-14T18:05:59.788 INFO:journalctl@ceph.mon.b.smithi172.stdout: metadata_block_size: 4096 2023-07-14T18:05:59.788 INFO:journalctl@ceph.mon.b.smithi172.stdout: partition_filters: 0 2023-07-14T18:05:59.788 INFO:journalctl@ceph.mon.b.smithi172.stdout: use_delta_encoding: 1 2023-07-14T18:05:59.788 INFO:journalctl@ceph.mon.b.smithi172.stdout: filter_policy: bloomfilter 2023-07-14T18:05:59.788 INFO:journalctl@ceph.mon.b.smithi172.stdout: whole_key_filtering: 1 2023-07-14T18:05:59.788 INFO:journalctl@ceph.mon.b.smithi172.stdout: verify_compression: 0 2023-07-14T18:05:59.788 INFO:journalctl@ceph.mon.b.smithi172.stdout: read_amp_bytes_per_bit: 0 2023-07-14T18:05:59.788 INFO:journalctl@ceph.mon.b.smithi172.stdout: format_version: 5 2023-07-14T18:05:59.789 INFO:journalctl@ceph.mon.b.smithi172.stdout: enable_index_compression: 1 2023-07-14T18:05:59.789 INFO:journalctl@ceph.mon.b.smithi172.stdout: block_align: 0 2023-07-14T18:05:59.789 INFO:journalctl@ceph.mon.b.smithi172.stdout: max_auto_readahead_size: 262144 2023-07-14T18:05:59.789 INFO:journalctl@ceph.mon.b.smithi172.stdout: prepopulate_block_cache: 0 2023-07-14T18:05:59.789 INFO:journalctl@ceph.mon.b.smithi172.stdout: initial_auto_readahead_size: 8192 2023-07-14T18:05:59.789 INFO:journalctl@ceph.mon.b.smithi172.stdout: num_file_reads_for_auto_readahead: 2 2023-07-14T18:05:59.789 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:05:59 smithi172 ceph-mon[97983]: rocksdb: Options.write_buffer_size: 33554432 2023-07-14T18:05:59.789 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:05:59 smithi172 ceph-mon[97983]: rocksdb: Options.max_write_buffer_number: 2 2023-07-14T18:05:59.790 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:05:59 smithi172 ceph-mon[97983]: rocksdb: Options.compression: NoCompression 2023-07-14T18:05:59.790 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:05:59 smithi172 ceph-mon[97983]: rocksdb: Options.bottommost_compression: Disabled 2023-07-14T18:05:59.790 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:05:59 smithi172 ceph-mon[97983]: rocksdb: Options.prefix_extractor: nullptr 2023-07-14T18:05:59.790 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:05:59 smithi172 ceph-mon[97983]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2023-07-14T18:05:59.790 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:05:59 smithi172 ceph-mon[97983]: rocksdb: Options.num_levels: 7 2023-07-14T18:05:59.790 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:05:59 smithi172 ceph-mon[97983]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2023-07-14T18:05:59.790 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:05:59 smithi172 ceph-mon[97983]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2023-07-14T18:05:59.790 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:05:59 smithi172 ceph-mon[97983]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2023-07-14T18:05:59.791 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:05:59 smithi172 ceph-mon[97983]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2023-07-14T18:05:59.791 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:05:59 smithi172 ceph-mon[97983]: rocksdb: Options.bottommost_compression_opts.level: 32767 2023-07-14T18:05:59.791 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:05:59 smithi172 ceph-mon[97983]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2023-07-14T18:05:59.791 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:05:59 smithi172 ceph-mon[97983]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2023-07-14T18:05:59.791 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:05:59 smithi172 ceph-mon[97983]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2023-07-14T18:05:59.791 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:05:59 smithi172 ceph-mon[97983]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2023-07-14T18:05:59.791 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:05:59 smithi172 ceph-mon[97983]: rocksdb: Options.bottommost_compression_opts.enabled: false 2023-07-14T18:05:59.792 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:05:59 smithi172 ceph-mon[97983]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2023-07-14T18:05:59.792 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:05:59 smithi172 ceph-mon[97983]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2023-07-14T18:05:59.792 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:05:59 smithi172 ceph-mon[97983]: rocksdb: Options.compression_opts.window_bits: -14 2023-07-14T18:05:59.792 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:05:59 smithi172 ceph-mon[97983]: rocksdb: Options.compression_opts.level: 32767 2023-07-14T18:05:59.792 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:05:59 smithi172 ceph-mon[97983]: rocksdb: Options.compression_opts.strategy: 0 2023-07-14T18:05:59.792 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:05:59 smithi172 ceph-mon[97983]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2023-07-14T18:05:59.792 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:05:59 smithi172 ceph-mon[97983]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2023-07-14T18:05:59.792 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:05:59 smithi172 ceph-mon[97983]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2023-07-14T18:05:59.793 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:05:59 smithi172 ceph-mon[97983]: rocksdb: Options.compression_opts.parallel_threads: 1 2023-07-14T18:05:59.793 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:05:59 smithi172 ceph-mon[97983]: rocksdb: Options.compression_opts.enabled: false 2023-07-14T18:05:59.793 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:05:59 smithi172 ceph-mon[97983]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2023-07-14T18:05:59.793 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:05:59 smithi172 ceph-mon[97983]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2023-07-14T18:05:59.793 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:05:59 smithi172 ceph-mon[97983]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2023-07-14T18:05:59.793 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:05:59 smithi172 ceph-mon[97983]: rocksdb: Options.level0_stop_writes_trigger: 36 2023-07-14T18:05:59.793 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:05:59 smithi172 ceph-mon[97983]: rocksdb: Options.target_file_size_base: 67108864 2023-07-14T18:05:59.793 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:05:59 smithi172 ceph-mon[97983]: rocksdb: Options.target_file_size_multiplier: 1 2023-07-14T18:05:59.794 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:05:59 smithi172 ceph-mon[97983]: rocksdb: Options.max_bytes_for_level_base: 268435456 2023-07-14T18:05:59.794 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:05:59 smithi172 ceph-mon[97983]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2023-07-14T18:05:59.794 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:05:59 smithi172 ceph-mon[97983]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2023-07-14T18:05:59.794 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:05:59 smithi172 ceph-mon[97983]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2023-07-14T18:05:59.794 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:05:59 smithi172 ceph-mon[97983]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2023-07-14T18:05:59.794 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:05:59 smithi172 ceph-mon[97983]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2023-07-14T18:05:59.794 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:05:59 smithi172 ceph-mon[97983]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2023-07-14T18:05:59.795 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:05:59 smithi172 ceph-mon[97983]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2023-07-14T18:05:59.795 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:05:59 smithi172 ceph-mon[97983]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2023-07-14T18:05:59.795 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:05:59 smithi172 ceph-mon[97983]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2023-07-14T18:05:59.795 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:05:59 smithi172 ceph-mon[97983]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2023-07-14T18:05:59.795 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:05:59 smithi172 ceph-mon[97983]: rocksdb: Options.max_compaction_bytes: 1677721600 2023-07-14T18:05:59.795 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:05:59 smithi172 ceph-mon[97983]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2023-07-14T18:05:59.795 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:05:59 smithi172 ceph-mon[97983]: rocksdb: Options.arena_block_size: 1048576 2023-07-14T18:05:59.795 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:05:59 smithi172 ceph-mon[97983]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2023-07-14T18:05:59.796 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:05:59 smithi172 ceph-mon[97983]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2023-07-14T18:05:59.796 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:05:59 smithi172 ceph-mon[97983]: rocksdb: Options.disable_auto_compactions: 0 2023-07-14T18:05:59.796 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:05:59 smithi172 ceph-mon[97983]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2023-07-14T18:05:59.796 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:05:59 smithi172 ceph-mon[97983]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2023-07-14T18:05:59.796 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:05:59 smithi172 ceph-mon[97983]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2023-07-14T18:05:59.796 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:05:59 smithi172 ceph-mon[97983]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2023-07-14T18:05:59.796 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:05:59 smithi172 ceph-mon[97983]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2023-07-14T18:05:59.796 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:05:59 smithi172 ceph-mon[97983]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2023-07-14T18:05:59.797 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:05:59 smithi172 ceph-mon[97983]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2023-07-14T18:05:59.797 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:05:59 smithi172 ceph-mon[97983]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2023-07-14T18:05:59.797 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:05:59 smithi172 ceph-mon[97983]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2023-07-14T18:05:59.797 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:05:59 smithi172 ceph-mon[97983]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2023-07-14T18:05:59.797 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:05:59 smithi172 ceph-mon[97983]: rocksdb: Options.table_properties_collectors: 2023-07-14T18:05:59.797 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:05:59 smithi172 ceph-mon[97983]: rocksdb: Options.inplace_update_support: 0 2023-07-14T18:05:59.797 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:05:59 smithi172 ceph-mon[97983]: rocksdb: Options.inplace_update_num_locks: 10000 2023-07-14T18:05:59.797 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:05:59 smithi172 ceph-mon[97983]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2023-07-14T18:05:59.798 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:05:59 smithi172 ceph-mon[97983]: rocksdb: Options.memtable_whole_key_filtering: 0 2023-07-14T18:05:59.798 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:05:59 smithi172 ceph-mon[97983]: rocksdb: Options.memtable_huge_page_size: 0 2023-07-14T18:05:59.798 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:05:59 smithi172 ceph-mon[97983]: rocksdb: Options.bloom_locality: 0 2023-07-14T18:05:59.798 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:05:59 smithi172 ceph-mon[97983]: rocksdb: Options.max_successive_merges: 0 2023-07-14T18:05:59.798 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:05:59 smithi172 ceph-mon[97983]: rocksdb: Options.optimize_filters_for_hits: 0 2023-07-14T18:05:59.798 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:05:59 smithi172 ceph-mon[97983]: rocksdb: Options.paranoid_file_checks: 0 2023-07-14T18:05:59.798 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:05:59 smithi172 ceph-mon[97983]: rocksdb: Options.force_consistency_checks: 1 2023-07-14T18:05:59.798 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:05:59 smithi172 ceph-mon[97983]: rocksdb: Options.report_bg_io_stats: 0 2023-07-14T18:05:59.799 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:05:59 smithi172 ceph-mon[97983]: rocksdb: Options.ttl: 2592000 2023-07-14T18:05:59.799 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:05:59 smithi172 ceph-mon[97983]: rocksdb: Options.periodic_compaction_seconds: 0 2023-07-14T18:05:59.799 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:05:59 smithi172 ceph-mon[97983]: rocksdb: Options.preclude_last_level_data_seconds: 0 2023-07-14T18:05:59.799 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:05:59 smithi172 ceph-mon[97983]: rocksdb: Options.preserve_internal_time_seconds: 0 2023-07-14T18:05:59.799 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:05:59 smithi172 ceph-mon[97983]: rocksdb: Options.enable_blob_files: false 2023-07-14T18:05:59.799 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:05:59 smithi172 ceph-mon[97983]: rocksdb: Options.min_blob_size: 0 2023-07-14T18:05:59.799 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:05:59 smithi172 ceph-mon[97983]: rocksdb: Options.blob_file_size: 268435456 2023-07-14T18:05:59.799 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:05:59 smithi172 ceph-mon[97983]: rocksdb: Options.blob_compression_type: NoCompression 2023-07-14T18:05:59.800 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:05:59 smithi172 ceph-mon[97983]: rocksdb: Options.enable_blob_garbage_collection: false 2023-07-14T18:05:59.800 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:05:59 smithi172 ceph-mon[97983]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2023-07-14T18:05:59.800 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:05:59 smithi172 ceph-mon[97983]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2023-07-14T18:05:59.800 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:05:59 smithi172 ceph-mon[97983]: rocksdb: Options.blob_compaction_readahead_size: 0 2023-07-14T18:05:59.800 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:05:59 smithi172 ceph-mon[97983]: rocksdb: Options.blob_file_starting_level: 0 2023-07-14T18:05:59.800 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:05:59 smithi172 ceph-mon[97983]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2023-07-14T18:05:59.800 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:05:59 smithi172 ceph-mon[97983]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-b/store.db/MANIFEST-000005 succeeded,manifest_file_number is 5, next_file_number is 7, last_sequence is 0, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2023-07-14T18:05:59.800 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:05:59 smithi172 ceph-mon[97983]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 0 2023-07-14T18:05:59.801 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:05:59 smithi172 ceph-mon[97983]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: bb134994-cb37-4822-af7a-8696f955d664 2023-07-14T18:05:59.801 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:05:59 smithi172 ceph-mon[97983]: rocksdb: EVENT_LOG_v1 {"time_micros": 1689357959671086, "job": 1, "event": "recovery_started", "wal_files": [4]} 2023-07-14T18:05:59.801 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:05:59 smithi172 ceph-mon[97983]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #4 mode 2 2023-07-14T18:05:59.801 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:05:59 smithi172 ceph-mon[97983]: rocksdb: EVENT_LOG_v1 {"time_micros": 1689357959671504, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 8, "file_size": 1747, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 1, "largest_seqno": 5, "table_properties": {"data_size": 648, "index_size": 31, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 69, "raw_key_size": 115, "raw_average_key_size": 23, "raw_value_size": 526, "raw_average_value_size": 105, "num_data_blocks": 1, "num_entries": 5, "num_filter_entries": 5, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1689357959, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "bb134994-cb37-4822-af7a-8696f955d664", "db_session_id": "5GLE325P2EPTDKFPOPEK", "orig_file_number": 8, "seqno_to_time_mapping": "N/A"}} 2023-07-14T18:05:59.801 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:05:59 smithi172 ceph-mon[97983]: rocksdb: EVENT_LOG_v1 {"time_micros": 1689357959671571, "job": 1, "event": "recovery_finished"} 2023-07-14T18:05:59.801 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:05:59 smithi172 ceph-mon[97983]: rocksdb: [db/version_set.cc:5047] Creating manifest 10 2023-07-14T18:05:59.801 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:05:59 smithi172 ceph-mon[97983]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-b/store.db/000004.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2023-07-14T18:05:59.802 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:05:59 smithi172 ceph-mon[97983]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x5582ac39a000 2023-07-14T18:05:59.802 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:05:59 smithi172 ceph-mon[97983]: rocksdb: DB pointer 0x5582ac386000 2023-07-14T18:05:59.802 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:05:59 smithi172 ceph-mon[97983]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2023-07-14T18:05:59.802 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:05:59 smithi172 ceph-mon[97983]: rocksdb: [db/db_impl/db_impl.cc:1111] 2023-07-14T18:05:59.802 INFO:journalctl@ceph.mon.b.smithi172.stdout: ** DB Stats ** 2023-07-14T18:05:59.802 INFO:journalctl@ceph.mon.b.smithi172.stdout: Uptime(secs): 0.0 total, 0.0 interval 2023-07-14T18:05:59.802 INFO:journalctl@ceph.mon.b.smithi172.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2023-07-14T18:05:59.802 INFO:journalctl@ceph.mon.b.smithi172.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2023-07-14T18:05:59.803 INFO:journalctl@ceph.mon.b.smithi172.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2023-07-14T18:05:59.803 INFO:journalctl@ceph.mon.b.smithi172.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2023-07-14T18:05:59.803 INFO:journalctl@ceph.mon.b.smithi172.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2023-07-14T18:05:59.803 INFO:journalctl@ceph.mon.b.smithi172.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2023-07-14T18:05:59.803 INFO:journalctl@ceph.mon.b.smithi172.stdout: 2023-07-14T18:05:59.803 INFO:journalctl@ceph.mon.b.smithi172.stdout: ** Compaction Stats [default] ** 2023-07-14T18:05:59.803 INFO:journalctl@ceph.mon.b.smithi172.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2023-07-14T18:05:59.804 INFO:journalctl@ceph.mon.b.smithi172.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2023-07-14T18:05:59.804 INFO:journalctl@ceph.mon.b.smithi172.stdout: L0 1/0 1.71 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 4.2 0.00 0.00 1 0.000 0 0 0.0 0.0 2023-07-14T18:05:59.804 INFO:journalctl@ceph.mon.b.smithi172.stdout: Sum 1/0 1.71 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 4.2 0.00 0.00 1 0.000 0 0 0.0 0.0 2023-07-14T18:05:59.804 INFO:journalctl@ceph.mon.b.smithi172.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 4.2 0.00 0.00 1 0.000 0 0 0.0 0.0 2023-07-14T18:05:59.804 INFO:journalctl@ceph.mon.b.smithi172.stdout: 2023-07-14T18:05:59.804 INFO:journalctl@ceph.mon.b.smithi172.stdout: ** Compaction Stats [default] ** 2023-07-14T18:05:59.804 INFO:journalctl@ceph.mon.b.smithi172.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2023-07-14T18:05:59.804 INFO:journalctl@ceph.mon.b.smithi172.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2023-07-14T18:05:59.805 INFO:journalctl@ceph.mon.b.smithi172.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 4.2 0.00 0.00 1 0.000 0 0 0.0 0.0 2023-07-14T18:05:59.805 INFO:journalctl@ceph.mon.b.smithi172.stdout: 2023-07-14T18:05:59.805 INFO:journalctl@ceph.mon.b.smithi172.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2023-07-14T18:05:59.805 INFO:journalctl@ceph.mon.b.smithi172.stdout: 2023-07-14T18:05:59.805 INFO:journalctl@ceph.mon.b.smithi172.stdout: Uptime(secs): 0.0 total, 0.0 interval 2023-07-14T18:05:59.805 INFO:journalctl@ceph.mon.b.smithi172.stdout: Flush(GB): cumulative 0.000, interval 0.000 2023-07-14T18:05:59.805 INFO:journalctl@ceph.mon.b.smithi172.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2023-07-14T18:05:59.805 INFO:journalctl@ceph.mon.b.smithi172.stdout: AddFile(Total Files): cumulative 0, interval 0 2023-07-14T18:05:59.806 INFO:journalctl@ceph.mon.b.smithi172.stdout: AddFile(L0 Files): cumulative 0, interval 0 2023-07-14T18:05:59.806 INFO:journalctl@ceph.mon.b.smithi172.stdout: AddFile(Keys): cumulative 0, interval 0 2023-07-14T18:05:59.806 INFO:journalctl@ceph.mon.b.smithi172.stdout: Cumulative compaction: 0.00 GB write, 0.68 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2023-07-14T18:05:59.806 INFO:journalctl@ceph.mon.b.smithi172.stdout: Interval compaction: 0.00 GB write, 0.68 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2023-07-14T18:05:59.806 INFO:journalctl@ceph.mon.b.smithi172.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2023-07-14T18:05:59.806 INFO:journalctl@ceph.mon.b.smithi172.stdout: Block cache BinnedLRUCache@0x5582ac3011f0#7 capacity: 512.00 MB usage: 0.22 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1.1e-05 secs_since: 0 2023-07-14T18:05:59.806 INFO:journalctl@ceph.mon.b.smithi172.stdout: Block cache entry stats(count,size,portion): FilterBlock(1,0.11 KB,2.08616e-05%) IndexBlock(1,0.11 KB,2.08616e-05%) Misc(1,0.00 KB,0%) 2023-07-14T18:05:59.806 INFO:journalctl@ceph.mon.b.smithi172.stdout: 2023-07-14T18:05:59.807 INFO:journalctl@ceph.mon.b.smithi172.stdout: ** File Read Latency Histogram By Level [default] ** 2023-07-14T18:05:59.807 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:05:59 smithi172 ceph-mon[97983]: mon.b does not exist in monmap, will attempt to join an existing cluster 2023-07-14T18:05:59.807 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:05:59 smithi172 ceph-mon[97983]: using public_addr v2:172.21.15.172:0/0 -> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] 2023-07-14T18:05:59.807 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:05:59 smithi172 ceph-mon[97983]: starting mon.b rank -1 at public addrs [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] at bind addrs [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] mon_data /var/lib/ceph/mon/ceph-b fsid bf7326ec-2270-11ee-9b33-001a4aab830c 2023-07-14T18:05:59.807 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:05:59 smithi172 systemd[1]: Started Ceph mon.b for bf7326ec-2270-11ee-9b33-001a4aab830c. 2023-07-14T18:05:59.807 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:05:59 smithi172 ceph-mon[97983]: mon.b@-1(???) e0 preinit fsid bf7326ec-2270-11ee-9b33-001a4aab830c 2023-07-14T18:05:59.807 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:05:59 smithi172 ceph-mon[97983]: mon.b@-1(synchronizing).mds e1 new map 2023-07-14T18:05:59.808 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:05:59 smithi172 ceph-mon[97983]: mon.b@-1(synchronizing).mds e1 print_map 2023-07-14T18:05:59.808 INFO:journalctl@ceph.mon.b.smithi172.stdout: e1 2023-07-14T18:05:59.808 INFO:journalctl@ceph.mon.b.smithi172.stdout: enable_multiple, ever_enabled_multiple: 1,1 2023-07-14T18:05:59.808 INFO:journalctl@ceph.mon.b.smithi172.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-07-14T18:05:59.808 INFO:journalctl@ceph.mon.b.smithi172.stdout: legacy client fscid: -1 2023-07-14T18:05:59.808 INFO:journalctl@ceph.mon.b.smithi172.stdout: 2023-07-14T18:05:59.808 INFO:journalctl@ceph.mon.b.smithi172.stdout: No filesystems configured 2023-07-14T18:05:59.808 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:05:59 smithi172 ceph-mon[97983]: mon.b@-1(synchronizing).osd e0 _set_cache_ratios kv ratio 0.25 inc ratio 0.375 full ratio 0.375 2023-07-14T18:05:59.809 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:05:59 smithi172 ceph-mon[97983]: mon.b@-1(synchronizing).osd e0 register_cache_with_pcm pcm target: 2147483648 pcm max: 1020054732 pcm min: 134217728 inc_osd_cache size: 1 2023-07-14T18:05:59.809 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:05:59 smithi172 ceph-mon[97983]: mon.b@-1(synchronizing).osd e1 e1: 0 total, 0 up, 0 in 2023-07-14T18:05:59.809 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:05:59 smithi172 ceph-mon[97983]: mon.b@-1(synchronizing).osd e2 e2: 0 total, 0 up, 0 in 2023-07-14T18:05:59.809 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:05:59 smithi172 ceph-mon[97983]: mon.b@-1(synchronizing).osd e3 e3: 0 total, 0 up, 0 in 2023-07-14T18:05:59.809 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:05:59 smithi172 ceph-mon[97983]: mon.b@-1(synchronizing).osd e4 e4: 0 total, 0 up, 0 in 2023-07-14T18:05:59.809 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:05:59 smithi172 ceph-mon[97983]: mon.b@-1(synchronizing).osd e4 crush map has features 3314932999778484224, adjusting msgr requires 2023-07-14T18:05:59.809 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:05:59 smithi172 ceph-mon[97983]: mon.b@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2023-07-14T18:05:59.809 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:05:59 smithi172 ceph-mon[97983]: mon.b@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2023-07-14T18:05:59.810 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:05:59 smithi172 ceph-mon[97983]: mon.b@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2023-07-14T18:05:59.810 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:05:59 smithi172 ceph-mon[97983]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-14T18:05:59.810 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:05:59 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:05:59.810 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:05:59 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-14T18:05:59.810 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:05:59 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:05:59.810 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:05:59 smithi172 ceph-mon[97983]: Added host smithi184 2023-07-14T18:05:59.810 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:05:59 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:05:59.810 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:05:59 smithi172 ceph-mon[97983]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-14T18:05:59.811 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:05:59 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:05:59.811 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:05:59 smithi172 ceph-mon[97983]: from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-07-14T18:05:59.811 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:05:59 smithi172 ceph-mon[97983]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-14T18:05:59.811 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:05:59 smithi172 ceph-mon[97983]: from='client.? 172.21.15.163:0/1452552109' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2023-07-14T18:05:59.811 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:05:59 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:05:59.811 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:05:59 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:05:59.811 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:05:59 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:05:59.811 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:05:59 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:05:59.812 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:05:59 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi184", "name": "osd_memory_target"}]: dispatch 2023-07-14T18:05:59.812 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:05:59 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T18:05:59.812 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:05:59 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-14T18:05:59.812 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:05:59 smithi172 ceph-mon[97983]: Updating smithi184:/etc/ceph/ceph.conf 2023-07-14T18:05:59.812 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:05:59 smithi172 ceph-mon[97983]: Updating smithi184:/var/lib/ceph/bf7326ec-2270-11ee-9b33-001a4aab830c/config/ceph.conf 2023-07-14T18:05:59.812 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:05:59 smithi172 ceph-mon[97983]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-14T18:05:59.812 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:05:59 smithi172 ceph-mon[97983]: Updating smithi184:/etc/ceph/ceph.client.admin.keyring 2023-07-14T18:05:59.813 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:05:59 smithi172 ceph-mon[97983]: Updating smithi184:/var/lib/ceph/bf7326ec-2270-11ee-9b33-001a4aab830c/config/ceph.client.admin.keyring 2023-07-14T18:05:59.813 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:05:59 smithi172 ceph-mon[97983]: from='client.? 172.21.15.163:0/1452552109' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2023-07-14T18:05:59.813 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:05:59 smithi172 ceph-mon[97983]: osdmap e4: 0 total, 0 up, 0 in 2023-07-14T18:05:59.813 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:05:59 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:05:59.813 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:05:59 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:05:59.813 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:05:59 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:05:59.813 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:05:59 smithi172 ceph-mon[97983]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-14T18:05:59.813 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:05:59 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:05:59.814 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:05:59 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-14T18:05:59.814 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:05:59 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T18:05:59.814 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:05:59 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-14T18:05:59.814 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:05:59 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:05:59.814 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:05:59 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-07-14T18:05:59.814 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:05:59 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T18:05:59.814 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:05:59 smithi172 ceph-mon[97983]: from='client.14188 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi163:172.21.15.163=a;smithi172:172.21.15.172=b;smithi184:172.21.15.184=c", "target": ["mon-mgr", ""]}]: dispatch 2023-07-14T18:05:59.814 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:05:59 smithi172 ceph-mon[97983]: Saving service mon spec with placement smithi163:172.21.15.163=a;smithi172:172.21.15.172=b;smithi184:172.21.15.184=c;count:3 2023-07-14T18:05:59.815 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:05:59 smithi172 ceph-mon[97983]: Deploying daemon mon.c on smithi184 2023-07-14T18:05:59.815 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:05:59 smithi172 ceph-mon[97983]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-14T18:05:59.815 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:05:59 smithi172 ceph-mon[97983]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-14T18:05:59.815 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:05:59 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-07-14T18:05:59.815 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:05:59 smithi172 ceph-mon[97983]: mon.a calling monitor election 2023-07-14T18:05:59.815 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:05:59 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-07-14T18:05:59.815 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:05:59 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-07-14T18:05:59.815 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:05:59 smithi172 ceph-mon[97983]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-14T18:05:59.816 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:05:59 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-07-14T18:05:59.816 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:05:59 smithi172 ceph-mon[97983]: mon.c calling monitor election 2023-07-14T18:05:59.816 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:05:59 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-07-14T18:05:59.816 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:05:59 smithi172 ceph-mon[97983]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-14T18:05:59.816 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:05:59 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-07-14T18:05:59.816 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:05:59 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-07-14T18:05:59.816 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:05:59 smithi172 ceph-mon[97983]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2023-07-14T18:05:59.817 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:05:59 smithi172 ceph-mon[97983]: monmap e2: 2 mons at {a=[v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0],c=[v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0]} removed_ranks: {} 2023-07-14T18:05:59.817 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:05:59 smithi172 ceph-mon[97983]: fsmap 2023-07-14T18:05:59.817 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:05:59 smithi172 ceph-mon[97983]: osdmap e4: 0 total, 0 up, 0 in 2023-07-14T18:05:59.817 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:05:59 smithi172 ceph-mon[97983]: mgrmap e13: x(active, since 41s) 2023-07-14T18:05:59.817 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:05:59 smithi172 ceph-mon[97983]: overall HEALTH_OK 2023-07-14T18:05:59.817 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:05:59 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:05:59.817 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:05:59 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:05:59.817 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:05:59 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:05:59.818 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:05:59 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-07-14T18:05:59.818 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:05:59 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T18:05:59.818 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:05:59 smithi172 ceph-mon[97983]: Deploying daemon mon.b on smithi172 2023-07-14T18:05:59.818 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:05:59 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-07-14T18:05:59.818 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:05:59 smithi172 ceph-mon[97983]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-14T18:05:59.818 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:05:59 smithi172 ceph-mon[97983]: from='client.? 172.21.15.184:0/60260966' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-07-14T18:05:59.818 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:05:59 smithi172 ceph-mon[97983]: mon.b@-1(synchronizing).paxosservice(auth 1..3) refresh upgraded, format 0 -> 3 2023-07-14T18:05:59.818 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:05:59 smithi172 ceph-mon[97983]: mon.b@-1(synchronizing) e2 handle_conf_change mon_allow_pool_delete 2023-07-14T18:05:59.819 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:05:59 smithi172 ceph-mon[97983]: expand_channel_meta expand map: {default=false} 2023-07-14T18:05:59.819 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:05:59 smithi172 ceph-mon[97983]: expand_channel_meta from 'false' to 'false' 2023-07-14T18:05:59.819 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:05:59 smithi172 ceph-mon[97983]: expand_channel_meta expanded map: {default=false} 2023-07-14T18:05:59.819 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:05:59 smithi172 ceph-mon[97983]: expand_channel_meta expand map: {default=info} 2023-07-14T18:05:59.819 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:05:59 smithi172 ceph-mon[97983]: expand_channel_meta from 'info' to 'info' 2023-07-14T18:05:59.819 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:05:59 smithi172 ceph-mon[97983]: expand_channel_meta expanded map: {default=info} 2023-07-14T18:05:59.819 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:05:59 smithi172 ceph-mon[97983]: expand_channel_meta expand map: {default=daemon} 2023-07-14T18:05:59.819 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:05:59 smithi172 ceph-mon[97983]: expand_channel_meta from 'daemon' to 'daemon' 2023-07-14T18:05:59.820 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:05:59 smithi172 ceph-mon[97983]: expand_channel_meta expanded map: {default=daemon} 2023-07-14T18:05:59.820 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:05:59 smithi172 ceph-mon[97983]: expand_channel_meta expand map: {default=debug} 2023-07-14T18:05:59.820 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:05:59 smithi172 ceph-mon[97983]: expand_channel_meta from 'debug' to 'debug' 2023-07-14T18:05:59.820 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:05:59 smithi172 ceph-mon[97983]: expand_channel_meta expanded map: {default=debug} 2023-07-14T18:06:00.051 INFO:teuthology.orchestra.run.smithi184.stderr:Inferring config /var/lib/ceph/bf7326ec-2270-11ee-9b33-001a4aab830c/mon.c/config 2023-07-14T18:06:04.838 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:06:04.806+0000 7fc09a8b1700 1 -- 172.21.15.184:0/2479718967 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc0800035c0 msgr2=0x7fc080005a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:06:04.839 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:06:04.806+0000 7fc09a8b1700 1 --2- 172.21.15.184:0/2479718967 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc0800035c0 0x7fc080005a40 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fc0940ff790 tx=0x7fc07c014e70 comp rx=0 tx=0).stop 2023-07-14T18:06:04.839 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:06:04.806+0000 7fc09a8b1700 1 -- 172.21.15.184:0/2479718967 shutdown_connections 2023-07-14T18:06:04.839 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:06:04.806+0000 7fc09a8b1700 1 --2- 172.21.15.184:0/2479718967 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc0800035c0 0x7fc080005a40 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:06:04.839 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:06:04.806+0000 7fc09a8b1700 1 -- 172.21.15.184:0/2479718967 >> 172.21.15.184:0/2479718967 conn(0x7fc0940fb340 msgr2=0x7fc0940fd750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:06:04.839 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:06:04.806+0000 7fc09a8b1700 1 -- 172.21.15.184:0/2479718967 shutdown_connections 2023-07-14T18:06:04.839 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:06:04.806+0000 7fc09a8b1700 1 -- 172.21.15.184:0/2479718967 wait complete. 2023-07-14T18:06:04.841 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:06:04.807+0000 7fc09a8b1700 1 Processor -- start 2023-07-14T18:06:04.841 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:06:04.807+0000 7fc09a8b1700 1 -- start start 2023-07-14T18:06:04.841 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:06:04.808+0000 7fc09a8b1700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc0800035c0 0x7fc09419aa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:06:04.841 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:06:04.808+0000 7fc09a8b1700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc09419afa0 0x7fc094194ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:06:04.842 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:06:04.808+0000 7fc09a8b1700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc094195020 0x7fc0941954c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:06:04.842 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:06:04.808+0000 7fc09a8b1700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc09419b5b0 con 0x7fc0800035c0 2023-07-14T18:06:04.842 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:06:04.808+0000 7fc09a8b1700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0941a1880 con 0x7fc09419afa0 2023-07-14T18:06:04.842 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:06:04.808+0000 7fc09a8b1700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0941a19c0 con 0x7fc094195020 2023-07-14T18:06:04.842 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:06:04.808+0000 7fc098e4e700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc094195020 0x7fc0941954c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:06:04.842 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:06:04.808+0000 7fc093fff700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc0800035c0 0x7fc09419aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:06:04.842 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:06:04.808+0000 7fc093fff700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc0800035c0 0x7fc09419aa60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.184:50510/0 (socket says 172.21.15.184:50510) 2023-07-14T18:06:04.842 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:06:04.808+0000 7fc098e4e700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc094195020 0x7fc0941954c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.184:53840/0 (socket says 172.21.15.184:53840) 2023-07-14T18:06:04.843 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:06:04.808+0000 7fc093fff700 1 -- 172.21.15.184:0/3653967966 learned_addr learned my addr 172.21.15.184:0/3653967966 (peer_addr_for_me v2:172.21.15.184:0/0) 2023-07-14T18:06:04.843 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:06:04.808+0000 7fc0937fe700 1 --2- 172.21.15.184:0/3653967966 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc09419afa0 0x7fc094194ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:06:04.843 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:06:04.808+0000 7fc098e4e700 1 -- 172.21.15.184:0/3653967966 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc094195020 msgr2=0x7fc0941954c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 14 2023-07-14T18:06:04.843 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:06:04.808+0000 7fc098e4e700 1 -- 172.21.15.184:0/3653967966 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc094195020 msgr2=0x7fc0941954c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2023-07-14T18:06:04.843 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:06:04.808+0000 7fc098e4e700 1 --2- 172.21.15.184:0/3653967966 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc094195020 0x7fc0941954c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-07-14T18:06:04.843 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:06:04.808+0000 7fc098e4e700 1 --2- 172.21.15.184:0/3653967966 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc094195020 0x7fc0941954c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-14T18:06:04.843 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:06:04.808+0000 7fc0937fe700 1 -- 172.21.15.184:0/3653967966 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc09419afa0 msgr2=0x7fc094194ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 13 2023-07-14T18:06:04.844 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:06:04.808+0000 7fc0937fe700 1 -- 172.21.15.184:0/3653967966 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc09419afa0 msgr2=0x7fc094194ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2023-07-14T18:06:04.844 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:06:04.808+0000 7fc0937fe700 1 --2- 172.21.15.184:0/3653967966 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc09419afa0 0x7fc094194ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-07-14T18:06:04.844 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:06:04.808+0000 7fc0937fe700 1 --2- 172.21.15.184:0/3653967966 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc09419afa0 0x7fc094194ae0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-14T18:06:04.844 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:06:04.808+0000 7fc093fff700 1 -- 172.21.15.184:0/3653967966 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc094195020 msgr2=0x7fc0941954c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-14T18:06:04.844 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:06:04.808+0000 7fc093fff700 1 --2- 172.21.15.184:0/3653967966 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc094195020 0x7fc0941954c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:06:04.844 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:06:04.808+0000 7fc093fff700 1 -- 172.21.15.184:0/3653967966 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc09419afa0 msgr2=0x7fc094194ae0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-14T18:06:04.844 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:06:04.808+0000 7fc093fff700 1 --2- 172.21.15.184:0/3653967966 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc09419afa0 0x7fc094194ae0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:06:04.845 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:06:04.808+0000 7fc093fff700 1 -- 172.21.15.184:0/3653967966 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc07c0148c0 con 0x7fc0800035c0 2023-07-14T18:06:04.845 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:06:04.809+0000 7fc093fff700 1 --2- 172.21.15.184:0/3653967966 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc0800035c0 0x7fc09419aa60 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fc07c014fd0 tx=0x7fc07c005720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:06:04.845 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:06:04.809+0000 7fc0917fa700 1 -- 172.21.15.184:0/3653967966 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc07c019040 con 0x7fc0800035c0 2023-07-14T18:06:04.845 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:06:04.809+0000 7fc0917fa700 1 -- 172.21.15.184:0/3653967966 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fc07c0041e0 con 0x7fc0800035c0 2023-07-14T18:06:04.845 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:06:04.809+0000 7fc0917fa700 1 -- 172.21.15.184:0/3653967966 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc07c012dc0 con 0x7fc0800035c0 2023-07-14T18:06:04.845 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:06:04.809+0000 7fc09a8b1700 1 -- 172.21.15.184:0/3653967966 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc0941a1c40 con 0x7fc0800035c0 2023-07-14T18:06:04.845 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:06:04.809+0000 7fc09a8b1700 1 -- 172.21.15.184:0/3653967966 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc0941a20f0 con 0x7fc0800035c0 2023-07-14T18:06:04.846 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:06:04.810+0000 7fc0917fa700 1 -- 172.21.15.184:0/3653967966 <== mon.0 v2:172.21.15.163:3300/0 4 ==== mgrmap(e 13) v1 ==== 45540+0+0 (secure 0 0 0) 0x7fc07c01e420 con 0x7fc0800035c0 2023-07-14T18:06:04.846 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:06:04.810+0000 7fc0917fa700 1 --2- 172.21.15.184:0/3653967966 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7fc074038c80 0x7fc07403b130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:06:04.846 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:06:04.810+0000 7fc09a8b1700 1 -- 172.21.15.184:0/3653967966 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc094061c70 con 0x7fc0800035c0 2023-07-14T18:06:04.846 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:06:04.810+0000 7fc0917fa700 1 -- 172.21.15.184:0/3653967966 <== mon.0 v2:172.21.15.163:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7fc07c000e40 con 0x7fc0800035c0 2023-07-14T18:06:04.847 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:06:04.810+0000 7fc0937fe700 1 --2- 172.21.15.184:0/3653967966 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7fc074038c80 0x7fc07403b130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:06:04.847 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:06:04.811+0000 7fc0937fe700 1 --2- 172.21.15.184:0/3653967966 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7fc074038c80 0x7fc07403b130 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fc084009850 tx=0x7fc084008040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:06:04.847 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:06:04.815+0000 7fc0917fa700 1 -- 172.21.15.184:0/3653967966 <== mon.0 v2:172.21.15.163:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178025 (secure 0 0 0) 0x7fc07c027980 con 0x7fc0800035c0 2023-07-14T18:06:05.123 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:06:05.090+0000 7fc09a8b1700 1 -- 172.21.15.184:0/3653967966 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7fc094195ff0 con 0x7fc0800035c0 2023-07-14T18:06:05.123 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:06:05.091+0000 7fc0917fa700 1 -- 172.21.15.184:0/3653967966 <== mon.0 v2:172.21.15.163:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 3 v3) v1 ==== 95+0+1278 (secure 0 0 0) 0x7fc07c027390 con 0x7fc0800035c0 2023-07-14T18:06:05.123 INFO:teuthology.orchestra.run.smithi184.stdout: 2023-07-14T18:06:05.123 INFO:teuthology.orchestra.run.smithi184.stdout:{"epoch":3,"fsid":"bf7326ec-2270-11ee-9b33-001a4aab830c","modified":"2023-07-14T18:05:59.701689Z","created":"2023-07-14T18:04:23.985781Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:3300","nonce":0},{"type":"v1","addr":"172.21.15.163:6789","nonce":0}]},"addr":"172.21.15.163:6789/0","public_addr":"172.21.15.163:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:3300","nonce":0},{"type":"v1","addr":"172.21.15.184:6789","nonce":0}]},"addr":"172.21.15.184:6789/0","public_addr":"172.21.15.184:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:3300","nonce":0},{"type":"v1","addr":"172.21.15.172:6789","nonce":0}]},"addr":"172.21.15.172:6789/0","public_addr":"172.21.15.172:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2023-07-14T18:06:05.125 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:06:05.093+0000 7fc09a8b1700 1 -- 172.21.15.184:0/3653967966 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7fc074038c80 msgr2=0x7fc07403b130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:06:05.125 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:06:05.093+0000 7fc09a8b1700 1 --2- 172.21.15.184:0/3653967966 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7fc074038c80 0x7fc07403b130 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fc084009850 tx=0x7fc084008040 comp rx=0 tx=0).stop 2023-07-14T18:06:05.125 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:06:05.093+0000 7fc09a8b1700 1 -- 172.21.15.184:0/3653967966 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc0800035c0 msgr2=0x7fc09419aa60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:06:05.125 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:06:05.093+0000 7fc09a8b1700 1 --2- 172.21.15.184:0/3653967966 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc0800035c0 0x7fc09419aa60 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fc07c014fd0 tx=0x7fc07c005720 comp rx=0 tx=0).stop 2023-07-14T18:06:05.126 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:06:05.093+0000 7fc09a8b1700 1 -- 172.21.15.184:0/3653967966 shutdown_connections 2023-07-14T18:06:05.126 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:06:05.093+0000 7fc09a8b1700 1 --2- 172.21.15.184:0/3653967966 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7fc074038c80 0x7fc07403b130 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:06:05.126 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:06:05.093+0000 7fc09a8b1700 1 --2- 172.21.15.184:0/3653967966 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc094195020 0x7fc0941954c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:06:05.126 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:06:05.093+0000 7fc09a8b1700 1 --2- 172.21.15.184:0/3653967966 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc0800035c0 0x7fc09419aa60 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:06:05.126 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:06:05.093+0000 7fc09a8b1700 1 --2- 172.21.15.184:0/3653967966 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc09419afa0 0x7fc094194ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:06:05.127 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:06:05.093+0000 7fc09a8b1700 1 -- 172.21.15.184:0/3653967966 >> 172.21.15.184:0/3653967966 conn(0x7fc0940fb340 msgr2=0x7fc094101400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:06:05.127 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:06:05.093+0000 7fc09a8b1700 1 -- 172.21.15.184:0/3653967966 shutdown_connections 2023-07-14T18:06:05.127 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:06:05.093+0000 7fc09a8b1700 1 -- 172.21.15.184:0/3653967966 wait complete. 2023-07-14T18:06:05.127 INFO:teuthology.orchestra.run.smithi184.stderr:dumped monmap epoch 3 2023-07-14T18:06:05.156 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:06:04 smithi184 ceph-mon[98481]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-14T18:06:05.157 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:06:04 smithi184 ceph-mon[98481]: mon.c calling monitor election 2023-07-14T18:06:05.157 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:06:04 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-07-14T18:06:05.157 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:06:04 smithi184 ceph-mon[98481]: mon.a calling monitor election 2023-07-14T18:06:05.157 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:06:04 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-07-14T18:06:05.157 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:06:04 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-07-14T18:06:05.157 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:06:04 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-07-14T18:06:05.158 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:06:04 smithi184 ceph-mon[98481]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-14T18:06:05.158 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:06:04 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-07-14T18:06:05.158 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:06:04 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-07-14T18:06:05.158 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:06:04 smithi184 ceph-mon[98481]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-14T18:06:05.158 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:06:04 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-07-14T18:06:05.158 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:06:04 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-07-14T18:06:05.158 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:06:04 smithi184 ceph-mon[98481]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2023-07-14T18:06:05.159 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:06:04 smithi184 ceph-mon[98481]: monmap e3: 3 mons at {a=[v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0],b=[v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0],c=[v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0]} removed_ranks: {} 2023-07-14T18:06:05.159 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:06:04 smithi184 ceph-mon[98481]: fsmap 2023-07-14T18:06:05.159 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:06:04 smithi184 ceph-mon[98481]: osdmap e4: 0 total, 0 up, 0 in 2023-07-14T18:06:05.159 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:06:04 smithi184 ceph-mon[98481]: mgrmap e13: x(active, since 49s) 2023-07-14T18:06:05.159 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:06:04 smithi184 ceph-mon[98481]: Health check failed: 1/3 mons down, quorum a,c (MON_DOWN) 2023-07-14T18:06:05.159 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:06:04 smithi184 ceph-mon[98481]: Health detail: HEALTH_WARN 1/3 mons down, quorum a,c 2023-07-14T18:06:05.159 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:06:04 smithi184 ceph-mon[98481]: [WRN] MON_DOWN: 1/3 mons down, quorum a,c 2023-07-14T18:06:05.159 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:06:04 smithi184 ceph-mon[98481]: mon.b (rank 2) addr [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] is down (out of quorum) 2023-07-14T18:06:05.160 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:06:04 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:06:05.160 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:06:04 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:06:05.160 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:06:04 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:06:05.160 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:06:04 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:06:05.208 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:06:04 smithi163 ceph-mon[96576]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-14T18:06:05.209 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:06:04 smithi163 ceph-mon[96576]: mon.c calling monitor election 2023-07-14T18:06:05.209 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:06:04 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-07-14T18:06:05.209 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:06:04 smithi163 ceph-mon[96576]: mon.a calling monitor election 2023-07-14T18:06:05.209 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:06:04 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-07-14T18:06:05.209 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:06:04 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-07-14T18:06:05.209 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:06:04 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-07-14T18:06:05.209 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:06:04 smithi163 ceph-mon[96576]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-14T18:06:05.210 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:06:04 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-07-14T18:06:05.210 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:06:04 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-07-14T18:06:05.210 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:06:04 smithi163 ceph-mon[96576]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-14T18:06:05.210 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:06:04 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-07-14T18:06:05.210 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:06:04 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-07-14T18:06:05.210 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:06:04 smithi163 ceph-mon[96576]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2023-07-14T18:06:05.210 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:06:04 smithi163 ceph-mon[96576]: monmap e3: 3 mons at {a=[v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0],b=[v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0],c=[v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0]} removed_ranks: {} 2023-07-14T18:06:05.211 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:06:04 smithi163 ceph-mon[96576]: fsmap 2023-07-14T18:06:05.211 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:06:04 smithi163 ceph-mon[96576]: osdmap e4: 0 total, 0 up, 0 in 2023-07-14T18:06:05.211 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:06:04 smithi163 ceph-mon[96576]: mgrmap e13: x(active, since 49s) 2023-07-14T18:06:05.211 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:06:04 smithi163 ceph-mon[96576]: Health check failed: 1/3 mons down, quorum a,c (MON_DOWN) 2023-07-14T18:06:05.211 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:06:04 smithi163 ceph-mon[96576]: Health detail: HEALTH_WARN 1/3 mons down, quorum a,c 2023-07-14T18:06:05.211 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:06:04 smithi163 ceph-mon[96576]: [WRN] MON_DOWN: 1/3 mons down, quorum a,c 2023-07-14T18:06:05.211 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:06:04 smithi163 ceph-mon[96576]: mon.b (rank 2) addr [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] is down (out of quorum) 2023-07-14T18:06:05.211 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:06:04 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:06:05.212 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:06:04 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:06:05.212 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:06:04 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:06:05.212 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:06:04 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:06:05.504 INFO:tasks.cephadm:Generating final ceph.conf file... 2023-07-14T18:06:05.504 DEBUG:teuthology.orchestra.run.smithi163:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81c9387d2e7576da065747ec9c16d1c7d69016ec shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bf7326ec-2270-11ee-9b33-001a4aab830c -- ceph config generate-minimal-conf 2023-07-14T18:06:06.073 INFO:teuthology.orchestra.run.smithi163.stderr:Inferring config /var/lib/ceph/bf7326ec-2270-11ee-9b33-001a4aab830c/mon.a/config 2023-07-14T18:06:06.166 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:06:05 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-14T18:06:06.166 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:06:05 smithi184 ceph-mon[98481]: from='client.? 172.21.15.184:0/3653967966' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-07-14T18:06:06.166 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:06:05 smithi184 ceph-mon[98481]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-14T18:06:06.166 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:06:05 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:06:06.167 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:06:05 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-07-14T18:06:06.208 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:06:05 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-14T18:06:06.208 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:06:05 smithi163 ceph-mon[96576]: from='client.? 172.21.15.184:0/3653967966' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-07-14T18:06:06.208 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:06:05 smithi163 ceph-mon[96576]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-14T18:06:06.209 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:06:05 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:06:06.209 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:06:05 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-07-14T18:06:07.017 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:06:06 smithi172 ceph-mon[97983]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-14T18:06:07.017 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:06:06 smithi172 ceph-mon[97983]: mon.c calling monitor election 2023-07-14T18:06:07.017 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:06:06 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-07-14T18:06:07.017 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:06:06 smithi172 ceph-mon[97983]: mon.a calling monitor election 2023-07-14T18:06:07.018 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:06:06 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-07-14T18:06:07.018 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:06:06 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-07-14T18:06:07.018 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:06:06 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-07-14T18:06:07.018 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:06:06 smithi172 ceph-mon[97983]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-14T18:06:07.018 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:06:06 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-07-14T18:06:07.018 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:06:06 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-07-14T18:06:07.018 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:06:06 smithi172 ceph-mon[97983]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-14T18:06:07.019 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:06:06 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-07-14T18:06:07.019 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:06:06 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-07-14T18:06:07.019 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:06:06 smithi172 ceph-mon[97983]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2023-07-14T18:06:07.019 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:06:06 smithi172 ceph-mon[97983]: monmap e3: 3 mons at {a=[v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0],b=[v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0],c=[v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0]} removed_ranks: {} 2023-07-14T18:06:07.019 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:06:06 smithi172 ceph-mon[97983]: fsmap 2023-07-14T18:06:07.019 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:06:06 smithi172 ceph-mon[97983]: osdmap e4: 0 total, 0 up, 0 in 2023-07-14T18:06:07.019 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:06:06 smithi172 ceph-mon[97983]: mgrmap e13: x(active, since 49s) 2023-07-14T18:06:07.019 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:06:06 smithi172 ceph-mon[97983]: Health check failed: 1/3 mons down, quorum a,c (MON_DOWN) 2023-07-14T18:06:07.020 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:06:06 smithi172 ceph-mon[97983]: Health detail: HEALTH_WARN 1/3 mons down, quorum a,c 2023-07-14T18:06:07.020 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:06:06 smithi172 ceph-mon[97983]: [WRN] MON_DOWN: 1/3 mons down, quorum a,c 2023-07-14T18:06:07.020 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:06:06 smithi172 ceph-mon[97983]: mon.b (rank 2) addr [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] is down (out of quorum) 2023-07-14T18:06:07.020 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:06:06 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:06:07.020 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:06:06 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:06:07.020 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:06:06 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:06:07.020 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:06:06 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:06:07.021 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:06:06 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-14T18:06:07.021 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:06:06 smithi172 ceph-mon[97983]: from='client.? 172.21.15.184:0/3653967966' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-07-14T18:06:07.021 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:06:06 smithi172 ceph-mon[97983]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-14T18:06:07.021 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:06:06 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:06:07.021 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:06:06 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-07-14T18:06:07.319 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:06:07.286+0000 7fed9f0ce700 1 -- 172.21.15.163:0/3579985150 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fed98100820 msgr2=0x7fed98100bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:06:07.319 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:06:07.286+0000 7fed9f0ce700 1 --2- 172.21.15.163:0/3579985150 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fed98100820 0x7fed98100bf0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fed8c009910 tx=0x7fed8c009c20 comp rx=0 tx=0).stop 2023-07-14T18:06:07.319 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:06:07.286+0000 7fed9f0ce700 1 -- 172.21.15.163:0/3579985150 shutdown_connections 2023-07-14T18:06:07.319 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:06:07.286+0000 7fed9f0ce700 1 --2- 172.21.15.163:0/3579985150 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fed98100820 0x7fed98100bf0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:06:07.320 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:06:07.286+0000 7fed9f0ce700 1 -- 172.21.15.163:0/3579985150 >> 172.21.15.163:0/3579985150 conn(0x7fed980743e0 msgr2=0x7fed980747e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:06:07.320 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:06:07.287+0000 7fed9f0ce700 1 -- 172.21.15.163:0/3579985150 shutdown_connections 2023-07-14T18:06:07.320 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:06:07.287+0000 7fed9f0ce700 1 -- 172.21.15.163:0/3579985150 wait complete. 2023-07-14T18:06:07.322 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:06:07.287+0000 7fed9f0ce700 1 Processor -- start 2023-07-14T18:06:07.322 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:06:07.287+0000 7fed9f0ce700 1 -- start start 2023-07-14T18:06:07.323 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:06:07.287+0000 7fed9f0ce700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fed98100820 0x7fed98194d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:06:07.323 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:06:07.287+0000 7fed9f0ce700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fed98195290 0x7fed98199700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:06:07.323 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:06:07.287+0000 7fed9f0ce700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fed98199c40 0x7fed9819a0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:06:07.323 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:06:07.287+0000 7fed9f0ce700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed98195960 con 0x7fed98195290 2023-07-14T18:06:07.323 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:06:07.287+0000 7fed9f0ce700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed981a19b0 con 0x7fed98199c40 2023-07-14T18:06:07.323 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:06:07.287+0000 7fed9f0ce700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed981a1af0 con 0x7fed98100820 2023-07-14T18:06:07.323 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:06:07.287+0000 7fed97fff700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fed98195290 0x7fed98199700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:06:07.324 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:06:07.288+0000 7fed97fff700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fed98195290 0x7fed98199700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:54834/0 (socket says 172.21.15.163:54834) 2023-07-14T18:06:07.324 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:06:07.288+0000 7fed97fff700 1 -- 172.21.15.163:0/3070788032 learned_addr learned my addr 172.21.15.163:0/3070788032 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:06:07.324 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:06:07.288+0000 7fed9ce6a700 1 --2- 172.21.15.163:0/3070788032 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fed98100820 0x7fed98194d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:06:07.324 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:06:07.288+0000 7fed9d66b700 1 --2- 172.21.15.163:0/3070788032 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fed98199c40 0x7fed9819a0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:06:07.324 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:06:07.288+0000 7fed97fff700 1 -- 172.21.15.163:0/3070788032 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fed98100820 msgr2=0x7fed98194d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:06:07.324 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:06:07.288+0000 7fed97fff700 1 --2- 172.21.15.163:0/3070788032 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fed98100820 0x7fed98194d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:06:07.324 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:06:07.288+0000 7fed97fff700 1 -- 172.21.15.163:0/3070788032 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fed98199c40 msgr2=0x7fed9819a0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:06:07.325 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:06:07.288+0000 7fed97fff700 1 --2- 172.21.15.163:0/3070788032 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fed98199c40 0x7fed9819a0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:06:07.325 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:06:07.288+0000 7fed97fff700 1 -- 172.21.15.163:0/3070788032 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed8c0095f0 con 0x7fed98195290 2023-07-14T18:06:07.325 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:06:07.288+0000 7fed9d66b700 1 --2- 172.21.15.163:0/3070788032 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fed98199c40 0x7fed9819a0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T18:06:07.325 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:06:07.288+0000 7fed97fff700 1 --2- 172.21.15.163:0/3070788032 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fed98195290 0x7fed98199700 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fed8400b7b0 tx=0x7fed8400bac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:06:07.325 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:06:07.288+0000 7fed95ffb700 1 -- 172.21.15.163:0/3070788032 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed84004230 con 0x7fed98195290 2023-07-14T18:06:07.325 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:06:07.288+0000 7fed95ffb700 1 -- 172.21.15.163:0/3070788032 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fed84004390 con 0x7fed98195290 2023-07-14T18:06:07.325 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:06:07.288+0000 7fed95ffb700 1 -- 172.21.15.163:0/3070788032 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed84011a50 con 0x7fed98195290 2023-07-14T18:06:07.326 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:06:07.288+0000 7fed9f0ce700 1 -- 172.21.15.163:0/3070788032 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fed981a1da0 con 0x7fed98195290 2023-07-14T18:06:07.326 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:06:07.288+0000 7fed9f0ce700 1 -- 172.21.15.163:0/3070788032 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed981a2240 con 0x7fed98195290 2023-07-14T18:06:07.326 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:06:07.289+0000 7fed95ffb700 1 -- 172.21.15.163:0/3070788032 <== mon.0 v2:172.21.15.163:3300/0 4 ==== mgrmap(e 13) v1 ==== 45540+0+0 (secure 0 0 0) 0x7fed84011bb0 con 0x7fed98195290 2023-07-14T18:06:07.326 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:06:07.289+0000 7fed95ffb700 1 --2- 172.21.15.163:0/3070788032 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7fed88038c80 0x7fed8803b130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:06:07.326 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:06:07.290+0000 7fed9f0ce700 1 -- 172.21.15.163:0/3070788032 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fed98106f00 con 0x7fed98195290 2023-07-14T18:06:07.326 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:06:07.290+0000 7fed95ffb700 1 -- 172.21.15.163:0/3070788032 <== mon.0 v2:172.21.15.163:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7fed8404ae10 con 0x7fed98195290 2023-07-14T18:06:07.326 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:06:07.290+0000 7fed9ce6a700 1 --2- 172.21.15.163:0/3070788032 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7fed88038c80 0x7fed8803b130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:06:07.326 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:06:07.290+0000 7fed9ce6a700 1 --2- 172.21.15.163:0/3070788032 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7fed88038c80 0x7fed8803b130 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fed8c009fd0 tx=0x7fed8c0058e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:06:07.327 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:06:07.294+0000 7fed95ffb700 1 -- 172.21.15.163:0/3070788032 <== mon.0 v2:172.21.15.163:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178025 (secure 0 0 0) 0x7fed840193a0 con 0x7fed98195290 2023-07-14T18:06:07.537 INFO:teuthology.orchestra.run.smithi163.stdout:# minimal ceph.conf for bf7326ec-2270-11ee-9b33-001a4aab830c 2023-07-14T18:06:07.537 INFO:teuthology.orchestra.run.smithi163.stdout:[global] 2023-07-14T18:06:07.538 INFO:teuthology.orchestra.run.smithi163.stdout: fsid = bf7326ec-2270-11ee-9b33-001a4aab830c 2023-07-14T18:06:07.538 INFO:teuthology.orchestra.run.smithi163.stdout: mon_host = [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] 2023-07-14T18:06:07.538 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:06:07.504+0000 7fed9f0ce700 1 -- 172.21.15.163:0/3070788032 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) v1 -- 0x7fed98061c70 con 0x7fed98195290 2023-07-14T18:06:07.538 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:06:07.505+0000 7fed95ffb700 1 -- 172.21.15.163:0/3070788032 <== mon.0 v2:172.21.15.163:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v9) v1 ==== 76+0+277 (secure 0 0 0) 0x7fed84004570 con 0x7fed98195290 2023-07-14T18:06:07.539 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:06:07.507+0000 7fed9f0ce700 1 -- 172.21.15.163:0/3070788032 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7fed88038c80 msgr2=0x7fed8803b130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:06:07.539 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:06:07.507+0000 7fed9f0ce700 1 --2- 172.21.15.163:0/3070788032 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7fed88038c80 0x7fed8803b130 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fed8c009fd0 tx=0x7fed8c0058e0 comp rx=0 tx=0).stop 2023-07-14T18:06:07.539 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:06:07.507+0000 7fed9f0ce700 1 -- 172.21.15.163:0/3070788032 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fed98195290 msgr2=0x7fed98199700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:06:07.539 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:06:07.507+0000 7fed9f0ce700 1 --2- 172.21.15.163:0/3070788032 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fed98195290 0x7fed98199700 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fed8400b7b0 tx=0x7fed8400bac0 comp rx=0 tx=0).stop 2023-07-14T18:06:07.539 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:06:07.507+0000 7fed9f0ce700 1 -- 172.21.15.163:0/3070788032 shutdown_connections 2023-07-14T18:06:07.540 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:06:07.507+0000 7fed9f0ce700 1 --2- 172.21.15.163:0/3070788032 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7fed88038c80 0x7fed8803b130 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:06:07.540 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:06:07.507+0000 7fed9f0ce700 1 --2- 172.21.15.163:0/3070788032 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fed98100820 0x7fed98194d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:06:07.540 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:06:07.507+0000 7fed9f0ce700 1 --2- 172.21.15.163:0/3070788032 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fed98199c40 0x7fed9819a0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:06:07.540 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:06:07.507+0000 7fed9f0ce700 1 --2- 172.21.15.163:0/3070788032 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fed98195290 0x7fed98199700 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:06:07.540 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:06:07.507+0000 7fed9f0ce700 1 -- 172.21.15.163:0/3070788032 >> 172.21.15.163:0/3070788032 conn(0x7fed980743e0 msgr2=0x7fed98104040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:06:07.540 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:06:07.507+0000 7fed9f0ce700 1 -- 172.21.15.163:0/3070788032 shutdown_connections 2023-07-14T18:06:07.540 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:06:07.507+0000 7fed9f0ce700 1 -- 172.21.15.163:0/3070788032 wait complete. 2023-07-14T18:06:07.906 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:06:07 smithi163 ceph-mon[96576]: mon.b calling monitor election 2023-07-14T18:06:07.906 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:06:07 smithi163 ceph-mon[96576]: Updating smithi163:/etc/ceph/ceph.conf 2023-07-14T18:06:07.907 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:06:07 smithi163 ceph-mon[96576]: Updating smithi172:/etc/ceph/ceph.conf 2023-07-14T18:06:07.907 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:06:07 smithi163 ceph-mon[96576]: Updating smithi184:/etc/ceph/ceph.conf 2023-07-14T18:06:07.907 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:06:07 smithi163 ceph-mon[96576]: mon.b calling monitor election 2023-07-14T18:06:07.907 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:06:07 smithi163 ceph-mon[96576]: mon.c calling monitor election 2023-07-14T18:06:07.907 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:06:07 smithi163 ceph-mon[96576]: mon.a calling monitor election 2023-07-14T18:06:07.908 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:06:07 smithi163 ceph-mon[96576]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2023-07-14T18:06:07.908 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:06:07 smithi163 ceph-mon[96576]: monmap e3: 3 mons at {a=[v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0],b=[v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0],c=[v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0]} removed_ranks: {} 2023-07-14T18:06:07.908 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:06:07 smithi163 ceph-mon[96576]: fsmap 2023-07-14T18:06:07.908 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:06:07 smithi163 ceph-mon[96576]: osdmap e4: 0 total, 0 up, 0 in 2023-07-14T18:06:07.908 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:06:07 smithi163 ceph-mon[96576]: mgrmap e13: x(active, since 51s) 2023-07-14T18:06:07.908 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:06:07 smithi163 ceph-mon[96576]: Health check cleared: MON_DOWN (was: 1/3 mons down, quorum a,c) 2023-07-14T18:06:07.908 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:06:07 smithi163 ceph-mon[96576]: Cluster is now healthy 2023-07-14T18:06:07.909 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:06:07 smithi163 ceph-mon[96576]: overall HEALTH_OK 2023-07-14T18:06:07.909 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:06:07 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:06:07.909 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:06:07 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:06:07.909 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:06:07 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:06:07.909 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:06:07 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:06:07.909 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:06:07 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:06:07.909 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:06:07 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:06:07.910 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:06:07 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:06:07.910 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:06:07 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-07-14T18:06:07.910 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:06:07 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-07-14T18:06:07.910 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:06:07 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T18:06:07.910 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:06:07 smithi163 ceph-mon[96576]: from='client.? 172.21.15.163:0/3070788032' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T18:06:07.916 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:06:07 smithi184 ceph-mon[98481]: mon.b calling monitor election 2023-07-14T18:06:07.916 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:06:07 smithi184 ceph-mon[98481]: Updating smithi163:/etc/ceph/ceph.conf 2023-07-14T18:06:07.916 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:06:07 smithi184 ceph-mon[98481]: Updating smithi172:/etc/ceph/ceph.conf 2023-07-14T18:06:07.916 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:06:07 smithi184 ceph-mon[98481]: Updating smithi184:/etc/ceph/ceph.conf 2023-07-14T18:06:07.916 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:06:07 smithi184 ceph-mon[98481]: mon.b calling monitor election 2023-07-14T18:06:07.917 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:06:07 smithi184 ceph-mon[98481]: mon.c calling monitor election 2023-07-14T18:06:07.917 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:06:07 smithi184 ceph-mon[98481]: mon.a calling monitor election 2023-07-14T18:06:07.917 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:06:07 smithi184 ceph-mon[98481]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2023-07-14T18:06:07.917 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:06:07 smithi184 ceph-mon[98481]: monmap e3: 3 mons at {a=[v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0],b=[v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0],c=[v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0]} removed_ranks: {} 2023-07-14T18:06:07.917 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:06:07 smithi184 ceph-mon[98481]: fsmap 2023-07-14T18:06:07.917 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:06:07 smithi184 ceph-mon[98481]: osdmap e4: 0 total, 0 up, 0 in 2023-07-14T18:06:07.917 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:06:07 smithi184 ceph-mon[98481]: mgrmap e13: x(active, since 51s) 2023-07-14T18:06:07.918 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:06:07 smithi184 ceph-mon[98481]: Health check cleared: MON_DOWN (was: 1/3 mons down, quorum a,c) 2023-07-14T18:06:07.918 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:06:07 smithi184 ceph-mon[98481]: Cluster is now healthy 2023-07-14T18:06:07.918 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:06:07 smithi184 ceph-mon[98481]: overall HEALTH_OK 2023-07-14T18:06:07.918 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:06:07 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:06:07.918 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:06:07 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:06:07.918 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:06:07 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:06:07.918 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:06:07 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:06:07.919 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:06:07 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:06:07.919 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:06:07 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:06:07.919 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:06:07 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:06:07.919 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:06:07 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-07-14T18:06:07.919 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:06:07 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-07-14T18:06:07.919 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:06:07 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T18:06:07.919 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:06:07 smithi184 ceph-mon[98481]: from='client.? 172.21.15.163:0/3070788032' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T18:06:07.942 INFO:tasks.cephadm:Distributing (final) config and client.admin keyring... 2023-07-14T18:06:07.942 DEBUG:teuthology.orchestra.run.smithi163:> set -ex 2023-07-14T18:06:07.943 DEBUG:teuthology.orchestra.run.smithi163:> sudo dd of=/etc/ceph/ceph.conf 2023-07-14T18:06:07.971 DEBUG:teuthology.orchestra.run.smithi163:> set -ex 2023-07-14T18:06:07.972 DEBUG:teuthology.orchestra.run.smithi163:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2023-07-14T18:06:08.017 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:06:07 smithi172 ceph-mon[97983]: mon.b calling monitor election 2023-07-14T18:06:08.017 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:06:07 smithi172 ceph-mon[97983]: Updating smithi163:/etc/ceph/ceph.conf 2023-07-14T18:06:08.017 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:06:07 smithi172 ceph-mon[97983]: Updating smithi172:/etc/ceph/ceph.conf 2023-07-14T18:06:08.017 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:06:07 smithi172 ceph-mon[97983]: Updating smithi184:/etc/ceph/ceph.conf 2023-07-14T18:06:08.017 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:06:07 smithi172 ceph-mon[97983]: mon.b calling monitor election 2023-07-14T18:06:08.017 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:06:07 smithi172 ceph-mon[97983]: mon.c calling monitor election 2023-07-14T18:06:08.018 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:06:07 smithi172 ceph-mon[97983]: mon.a calling monitor election 2023-07-14T18:06:08.018 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:06:07 smithi172 ceph-mon[97983]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2023-07-14T18:06:08.018 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:06:07 smithi172 ceph-mon[97983]: monmap e3: 3 mons at {a=[v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0],b=[v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0],c=[v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0]} removed_ranks: {} 2023-07-14T18:06:08.018 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:06:07 smithi172 ceph-mon[97983]: fsmap 2023-07-14T18:06:08.018 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:06:07 smithi172 ceph-mon[97983]: osdmap e4: 0 total, 0 up, 0 in 2023-07-14T18:06:08.018 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:06:07 smithi172 ceph-mon[97983]: mgrmap e13: x(active, since 51s) 2023-07-14T18:06:08.019 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:06:07 smithi172 ceph-mon[97983]: Health check cleared: MON_DOWN (was: 1/3 mons down, quorum a,c) 2023-07-14T18:06:08.019 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:06:07 smithi172 ceph-mon[97983]: Cluster is now healthy 2023-07-14T18:06:08.019 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:06:07 smithi172 ceph-mon[97983]: overall HEALTH_OK 2023-07-14T18:06:08.019 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:06:07 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:06:08.019 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:06:07 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:06:08.019 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:06:07 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:06:08.019 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:06:07 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:06:08.020 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:06:07 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:06:08.020 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:06:07 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:06:08.020 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:06:07 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:06:08.020 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:06:07 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-07-14T18:06:08.020 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:06:07 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-07-14T18:06:08.020 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:06:07 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T18:06:08.020 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:06:07 smithi172 ceph-mon[97983]: from='client.? 172.21.15.163:0/3070788032' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T18:06:08.039 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2023-07-14T18:06:08.040 DEBUG:teuthology.orchestra.run.smithi172:> sudo dd of=/etc/ceph/ceph.conf 2023-07-14T18:06:08.076 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2023-07-14T18:06:08.076 DEBUG:teuthology.orchestra.run.smithi172:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2023-07-14T18:06:08.146 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2023-07-14T18:06:08.147 DEBUG:teuthology.orchestra.run.smithi184:> sudo dd of=/etc/ceph/ceph.conf 2023-07-14T18:06:08.178 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2023-07-14T18:06:08.179 DEBUG:teuthology.orchestra.run.smithi184:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2023-07-14T18:06:08.247 INFO:tasks.cephadm:Adding mgr.x on smithi163 2023-07-14T18:06:08.247 INFO:tasks.cephadm:Adding mgr.y on smithi172 2023-07-14T18:06:08.248 INFO:tasks.cephadm:Adding mgr.z on smithi184 2023-07-14T18:06:08.248 DEBUG:teuthology.orchestra.run.smithi184:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81c9387d2e7576da065747ec9c16d1c7d69016ec shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bf7326ec-2270-11ee-9b33-001a4aab830c -- ceph orch apply mgr '3;smithi163=x;smithi172=y;smithi184=z' 2023-07-14T18:06:08.834 INFO:teuthology.orchestra.run.smithi184.stderr:Inferring config /var/lib/ceph/bf7326ec-2270-11ee-9b33-001a4aab830c/mon.c/config 2023-07-14T18:06:08.916 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:06:08 smithi184 ceph-mon[98481]: Updating smithi163:/var/lib/ceph/bf7326ec-2270-11ee-9b33-001a4aab830c/config/ceph.conf 2023-07-14T18:06:08.916 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:06:08 smithi184 ceph-mon[98481]: Updating smithi184:/var/lib/ceph/bf7326ec-2270-11ee-9b33-001a4aab830c/config/ceph.conf 2023-07-14T18:06:08.916 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:06:08 smithi184 ceph-mon[98481]: Updating smithi172:/var/lib/ceph/bf7326ec-2270-11ee-9b33-001a4aab830c/config/ceph.conf 2023-07-14T18:06:08.916 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:06:08 smithi184 ceph-mon[98481]: Reconfiguring mon.a (unknown last config time)... 2023-07-14T18:06:08.916 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:06:08 smithi184 ceph-mon[98481]: Reconfiguring daemon mon.a on smithi163 2023-07-14T18:06:08.917 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:06:08 smithi184 ceph-mon[98481]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-14T18:06:08.917 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:06:08 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-07-14T18:06:08.958 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:06:08 smithi163 ceph-mon[96576]: Updating smithi163:/var/lib/ceph/bf7326ec-2270-11ee-9b33-001a4aab830c/config/ceph.conf 2023-07-14T18:06:08.958 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:06:08 smithi163 ceph-mon[96576]: Updating smithi184:/var/lib/ceph/bf7326ec-2270-11ee-9b33-001a4aab830c/config/ceph.conf 2023-07-14T18:06:08.959 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:06:08 smithi163 ceph-mon[96576]: Updating smithi172:/var/lib/ceph/bf7326ec-2270-11ee-9b33-001a4aab830c/config/ceph.conf 2023-07-14T18:06:08.959 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:06:08 smithi163 ceph-mon[96576]: Reconfiguring mon.a (unknown last config time)... 2023-07-14T18:06:08.959 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:06:08 smithi163 ceph-mon[96576]: Reconfiguring daemon mon.a on smithi163 2023-07-14T18:06:08.959 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:06:08 smithi163 ceph-mon[96576]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-14T18:06:08.959 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:06:08 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-07-14T18:06:09.017 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:06:08 smithi172 ceph-mon[97983]: Updating smithi163:/var/lib/ceph/bf7326ec-2270-11ee-9b33-001a4aab830c/config/ceph.conf 2023-07-14T18:06:09.017 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:06:08 smithi172 ceph-mon[97983]: Updating smithi184:/var/lib/ceph/bf7326ec-2270-11ee-9b33-001a4aab830c/config/ceph.conf 2023-07-14T18:06:09.017 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:06:08 smithi172 ceph-mon[97983]: Updating smithi172:/var/lib/ceph/bf7326ec-2270-11ee-9b33-001a4aab830c/config/ceph.conf 2023-07-14T18:06:09.017 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:06:08 smithi172 ceph-mon[97983]: Reconfiguring mon.a (unknown last config time)... 2023-07-14T18:06:09.017 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:06:08 smithi172 ceph-mon[97983]: Reconfiguring daemon mon.a on smithi163 2023-07-14T18:06:09.018 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:06:08 smithi172 ceph-mon[97983]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-14T18:06:09.018 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:06:08 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-07-14T18:06:09.666 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:06:09 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:06:09.666 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:06:09 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:06:09.666 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:06:09 smithi184 ceph-mon[98481]: Reconfiguring mon.b (monmap changed)... 2023-07-14T18:06:09.666 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:06:09 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-07-14T18:06:09.666 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:06:09 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-07-14T18:06:09.666 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:06:09 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T18:06:09.667 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:06:09 smithi184 ceph-mon[98481]: Reconfiguring daemon mon.b on smithi172 2023-07-14T18:06:09.767 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:06:09 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:06:09.767 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:06:09 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:06:09.767 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:06:09 smithi172 ceph-mon[97983]: Reconfiguring mon.b (monmap changed)... 2023-07-14T18:06:09.767 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:06:09 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-07-14T18:06:09.767 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:06:09 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-07-14T18:06:09.767 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:06:09 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T18:06:09.768 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:06:09 smithi172 ceph-mon[97983]: Reconfiguring daemon mon.b on smithi172 2023-07-14T18:06:09.958 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:06:09 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:06:09.959 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:06:09 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:06:09.959 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:06:09 smithi163 ceph-mon[96576]: Reconfiguring mon.b (monmap changed)... 2023-07-14T18:06:09.959 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:06:09 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-07-14T18:06:09.959 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:06:09 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-07-14T18:06:09.959 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:06:09 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T18:06:09.959 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:06:09 smithi163 ceph-mon[96576]: Reconfiguring daemon mon.b on smithi172 2023-07-14T18:06:10.012 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:06:09.979+0000 7f1f9c2a4700 1 -- 172.21.15.184:0/3478841473 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f1f940fe730 msgr2=0x7f1f940feb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:06:10.012 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:06:09.979+0000 7f1f9c2a4700 1 --2- 172.21.15.184:0/3478841473 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f1f940fe730 0x7f1f940feb40 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f1f90009910 tx=0x7f1f90009c20 comp rx=0 tx=0).stop 2023-07-14T18:06:10.012 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:06:09.979+0000 7f1f9c2a4700 1 -- 172.21.15.184:0/3478841473 shutdown_connections 2023-07-14T18:06:10.013 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:06:09.979+0000 7f1f9c2a4700 1 --2- 172.21.15.184:0/3478841473 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f1f940fe730 0x7f1f940feb40 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:06:10.013 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:06:09.979+0000 7f1f9c2a4700 1 -- 172.21.15.184:0/3478841473 >> 172.21.15.184:0/3478841473 conn(0x7f1f940f9ce0 msgr2=0x7f1f940fc110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:06:10.013 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:06:09.979+0000 7f1f9c2a4700 1 -- 172.21.15.184:0/3478841473 shutdown_connections 2023-07-14T18:06:10.013 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:06:09.979+0000 7f1f9c2a4700 1 -- 172.21.15.184:0/3478841473 wait complete. 2023-07-14T18:06:10.013 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:06:09.980+0000 7f1f9c2a4700 1 Processor -- start 2023-07-14T18:06:10.013 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:06:09.980+0000 7f1f9c2a4700 1 -- start start 2023-07-14T18:06:10.013 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:06:09.980+0000 7f1f9c2a4700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1f940fe730 0x7f1f94194ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:06:10.013 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:06:09.980+0000 7f1f9c2a4700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f1f94195010 0x7f1f9419a080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:06:10.014 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:06:09.980+0000 7f1f9c2a4700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1f94195480 0x7f1f9419c5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:06:10.014 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:06:09.980+0000 7f1f9c2a4700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f9419cd90 con 0x7f1f94195010 2023-07-14T18:06:10.014 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:06:09.980+0000 7f1f9c2a4700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f9419cf00 con 0x7f1f94195480 2023-07-14T18:06:10.014 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:06:09.980+0000 7f1f9c2a4700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f9419d0c0 con 0x7f1f940fe730 2023-07-14T18:06:10.014 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:06:09.980+0000 7f1f9a040700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1f940fe730 0x7f1f94194ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:06:10.014 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:06:09.980+0000 7f1f9983f700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f1f94195010 0x7f1f9419a080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:06:10.014 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:06:09.980+0000 7f1f9a040700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1f940fe730 0x7f1f94194ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.184:53846/0 (socket says 172.21.15.184:53846) 2023-07-14T18:06:10.015 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:06:09.980+0000 7f1f9983f700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f1f94195010 0x7f1f9419a080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.184:50522/0 (socket says 172.21.15.184:50522) 2023-07-14T18:06:10.015 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:06:09.980+0000 7f1f9a040700 1 -- 172.21.15.184:0/4256149031 learned_addr learned my addr 172.21.15.184:0/4256149031 (peer_addr_for_me v2:172.21.15.184:0/0) 2023-07-14T18:06:10.015 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:06:09.980+0000 7f1f9a841700 1 --2- 172.21.15.184:0/4256149031 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1f94195480 0x7f1f9419c5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:06:10.016 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:06:09.980+0000 7f1f9983f700 1 -- 172.21.15.184:0/4256149031 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1f940fe730 msgr2=0x7f1f94194ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:06:10.016 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:06:09.980+0000 7f1f9983f700 1 --2- 172.21.15.184:0/4256149031 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1f940fe730 0x7f1f94194ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:06:10.016 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:06:09.980+0000 7f1f9983f700 1 -- 172.21.15.184:0/4256149031 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1f94195480 msgr2=0x7f1f9419c5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:06:10.016 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:06:09.980+0000 7f1f9983f700 1 --2- 172.21.15.184:0/4256149031 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1f94195480 0x7f1f9419c5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:06:10.017 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:06:09.980+0000 7f1f9983f700 1 -- 172.21.15.184:0/4256149031 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f900095f0 con 0x7f1f94195010 2023-07-14T18:06:10.017 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:06:09.981+0000 7f1f9983f700 1 --2- 172.21.15.184:0/4256149031 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f1f94195010 0x7f1f9419a080 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f1f8400b550 tx=0x7f1f8400b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:06:10.017 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:06:09.981+0000 7f1f8b7fe700 1 -- 172.21.15.184:0/4256149031 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f84004230 con 0x7f1f94195010 2023-07-14T18:06:10.017 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:06:09.981+0000 7f1f8b7fe700 1 -- 172.21.15.184:0/4256149031 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f1f84004390 con 0x7f1f94195010 2023-07-14T18:06:10.017 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:06:09.981+0000 7f1f9c2a4700 1 -- 172.21.15.184:0/4256149031 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1f9419d3a0 con 0x7f1f94195010 2023-07-14T18:06:10.017 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:06:09.981+0000 7f1f8b7fe700 1 -- 172.21.15.184:0/4256149031 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f84011a20 con 0x7f1f94195010 2023-07-14T18:06:10.017 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:06:09.981+0000 7f1f9c2a4700 1 -- 172.21.15.184:0/4256149031 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1f9419d920 con 0x7f1f94195010 2023-07-14T18:06:10.017 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:06:09.982+0000 7f1f8b7fe700 1 -- 172.21.15.184:0/4256149031 <== mon.0 v2:172.21.15.163:3300/0 4 ==== mgrmap(e 13) v1 ==== 45540+0+0 (secure 0 0 0) 0x7f1f84011b80 con 0x7f1f94195010 2023-07-14T18:06:10.018 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:06:09.982+0000 7f1f9c2a4700 1 -- 172.21.15.184:0/4256149031 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1f9418e880 con 0x7f1f94195010 2023-07-14T18:06:10.018 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:06:09.982+0000 7f1f8b7fe700 1 --2- 172.21.15.184:0/4256149031 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f1f80038c30 0x7f1f8003b0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:06:10.018 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:06:09.982+0000 7f1f8b7fe700 1 -- 172.21.15.184:0/4256149031 <== mon.0 v2:172.21.15.163:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f1f8404ab90 con 0x7f1f94195010 2023-07-14T18:06:10.018 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:06:09.982+0000 7f1f9a040700 1 --2- 172.21.15.184:0/4256149031 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f1f80038c30 0x7f1f8003b0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:06:10.018 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:06:09.983+0000 7f1f9a040700 1 --2- 172.21.15.184:0/4256149031 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f1f80038c30 0x7f1f8003b0e0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f1f90006010 tx=0x7f1f9000b540 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:06:10.019 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:06:09.987+0000 7f1f8b7fe700 1 -- 172.21.15.184:0/4256149031 <== mon.0 v2:172.21.15.163:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178025 (secure 0 0 0) 0x7f1f84004500 con 0x7f1f94195010 2023-07-14T18:06:10.220 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:06:10.188+0000 7f1f9c2a4700 1 -- 172.21.15.184:0/4256149031 --> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi163=x;smithi172=y;smithi184=z", "target": ["mon-mgr", ""]}) v1 -- 0x7f1f94060b10 con 0x7f1f80038c30 2023-07-14T18:06:10.227 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:06:10.195+0000 7f1f8b7fe700 1 -- 172.21.15.184:0/4256149031 <== mgr.14152 v2:172.21.15.163:6800/1949590926 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+24 (secure 0 0 0) 0x7f1f94060b10 con 0x7f1f80038c30 2023-07-14T18:06:10.227 INFO:teuthology.orchestra.run.smithi184.stdout:Scheduled mgr update... 2023-07-14T18:06:10.229 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:06:10.197+0000 7f1f9c2a4700 1 -- 172.21.15.184:0/4256149031 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f1f80038c30 msgr2=0x7f1f8003b0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:06:10.229 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:06:10.197+0000 7f1f9c2a4700 1 --2- 172.21.15.184:0/4256149031 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f1f80038c30 0x7f1f8003b0e0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f1f90006010 tx=0x7f1f9000b540 comp rx=0 tx=0).stop 2023-07-14T18:06:10.229 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:06:10.197+0000 7f1f9c2a4700 1 -- 172.21.15.184:0/4256149031 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f1f94195010 msgr2=0x7f1f9419a080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:06:10.230 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:06:10.197+0000 7f1f9c2a4700 1 --2- 172.21.15.184:0/4256149031 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f1f94195010 0x7f1f9419a080 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f1f8400b550 tx=0x7f1f8400b860 comp rx=0 tx=0).stop 2023-07-14T18:06:10.230 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:06:10.197+0000 7f1f9c2a4700 1 -- 172.21.15.184:0/4256149031 shutdown_connections 2023-07-14T18:06:10.230 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:06:10.197+0000 7f1f9c2a4700 1 --2- 172.21.15.184:0/4256149031 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f1f80038c30 0x7f1f8003b0e0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:06:10.230 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:06:10.197+0000 7f1f9c2a4700 1 --2- 172.21.15.184:0/4256149031 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1f940fe730 0x7f1f94194ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:06:10.230 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:06:10.197+0000 7f1f9c2a4700 1 --2- 172.21.15.184:0/4256149031 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1f94195480 0x7f1f9419c5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:06:10.230 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:06:10.197+0000 7f1f9c2a4700 1 --2- 172.21.15.184:0/4256149031 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f1f94195010 0x7f1f9419a080 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:06:10.230 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:06:10.197+0000 7f1f9c2a4700 1 -- 172.21.15.184:0/4256149031 >> 172.21.15.184:0/4256149031 conn(0x7f1f940f9ce0 msgr2=0x7f1f9418b9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:06:10.231 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:06:10.197+0000 7f1f9c2a4700 1 -- 172.21.15.184:0/4256149031 shutdown_connections 2023-07-14T18:06:10.231 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:06:10.197+0000 7f1f9c2a4700 1 -- 172.21.15.184:0/4256149031 wait complete. 2023-07-14T18:06:10.686 DEBUG:teuthology.orchestra.run.smithi172:mgr.y> sudo journalctl -f -n 0 -u ceph-bf7326ec-2270-11ee-9b33-001a4aab830c@mgr.y.service 2023-07-14T18:06:10.689 DEBUG:teuthology.orchestra.run.smithi184:mgr.z> sudo journalctl -f -n 0 -u ceph-bf7326ec-2270-11ee-9b33-001a4aab830c@mgr.z.service 2023-07-14T18:06:10.692 INFO:tasks.cephadm:Deploying OSDs... 2023-07-14T18:06:10.693 DEBUG:teuthology.orchestra.run.smithi163:> set -ex 2023-07-14T18:06:10.693 DEBUG:teuthology.orchestra.run.smithi163:> dd if=/scratch_devs of=/dev/stdout 2023-07-14T18:06:10.716 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-07-14T18:06:10.717 DEBUG:teuthology.orchestra.run.smithi163:> stat /dev/vg_nvme/lv_1 2023-07-14T18:06:10.722 INFO:journalctl@ceph.mgr.z.smithi184.stdout:-- Logs begin at Fri 2023-07-14 17:45:39 UTC. -- 2023-07-14T18:06:10.724 INFO:journalctl@ceph.mgr.y.smithi172.stdout:-- Logs begin at Fri 2023-07-14 17:45:52 UTC. -- 2023-07-14T18:06:10.777 INFO:teuthology.orchestra.run.smithi163.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-07-14T18:06:10.777 INFO:teuthology.orchestra.run.smithi163.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-07-14T18:06:10.777 INFO:teuthology.orchestra.run.smithi163.stdout:Device: 6h/6d Inode: 377610 Links: 1 2023-07-14T18:06:10.777 INFO:teuthology.orchestra.run.smithi163.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-07-14T18:06:10.778 INFO:teuthology.orchestra.run.smithi163.stdout:Context: system_u:object_r:device_t:s0 2023-07-14T18:06:10.778 INFO:teuthology.orchestra.run.smithi163.stdout:Access: 2023-07-14 18:05:25.095482123 +0000 2023-07-14T18:06:10.778 INFO:teuthology.orchestra.run.smithi163.stdout:Modify: 2023-07-14 17:59:03.519527635 +0000 2023-07-14T18:06:10.778 INFO:teuthology.orchestra.run.smithi163.stdout:Change: 2023-07-14 17:59:03.519527635 +0000 2023-07-14T18:06:10.778 INFO:teuthology.orchestra.run.smithi163.stdout: Birth: - 2023-07-14T18:06:10.778 DEBUG:teuthology.orchestra.run.smithi163:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-07-14T18:06:10.848 INFO:teuthology.orchestra.run.smithi163.stderr:1+0 records in 2023-07-14T18:06:10.848 INFO:teuthology.orchestra.run.smithi163.stderr:1+0 records out 2023-07-14T18:06:10.848 INFO:teuthology.orchestra.run.smithi163.stderr:512 bytes copied, 0.000261394 s, 2.0 MB/s 2023-07-14T18:06:10.849 DEBUG:teuthology.orchestra.run.smithi163:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-07-14T18:06:10.909 DEBUG:teuthology.orchestra.run.smithi163:> stat /dev/vg_nvme/lv_2 2023-07-14T18:06:10.916 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:06:10 smithi184 ceph-mon[98481]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-14T18:06:10.916 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:06:10 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:06:10.916 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:06:10 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:06:10.916 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:06:10 smithi184 ceph-mon[98481]: Reconfiguring mon.c (monmap changed)... 2023-07-14T18:06:10.916 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:06:10 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-07-14T18:06:10.917 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:06:10 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-07-14T18:06:10.917 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:06:10 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T18:06:10.917 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:06:10 smithi184 ceph-mon[98481]: Reconfiguring daemon mon.c on smithi184 2023-07-14T18:06:10.917 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:06:10 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:06:10.958 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:06:10 smithi163 ceph-mon[96576]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-14T18:06:10.958 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:06:10 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:06:10.959 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:06:10 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:06:10.959 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:06:10 smithi163 ceph-mon[96576]: Reconfiguring mon.c (monmap changed)... 2023-07-14T18:06:10.959 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:06:10 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-07-14T18:06:10.959 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:06:10 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-07-14T18:06:10.959 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:06:10 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T18:06:10.959 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:06:10 smithi163 ceph-mon[96576]: Reconfiguring daemon mon.c on smithi184 2023-07-14T18:06:10.959 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:06:10 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:06:10.970 INFO:teuthology.orchestra.run.smithi163.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-07-14T18:06:10.970 INFO:teuthology.orchestra.run.smithi163.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-07-14T18:06:10.970 INFO:teuthology.orchestra.run.smithi163.stdout:Device: 6h/6d Inode: 367502 Links: 1 2023-07-14T18:06:10.970 INFO:teuthology.orchestra.run.smithi163.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-07-14T18:06:10.970 INFO:teuthology.orchestra.run.smithi163.stdout:Context: system_u:object_r:device_t:s0 2023-07-14T18:06:10.971 INFO:teuthology.orchestra.run.smithi163.stdout:Access: 2023-07-14 18:05:25.095482123 +0000 2023-07-14T18:06:10.971 INFO:teuthology.orchestra.run.smithi163.stdout:Modify: 2023-07-14 17:59:04.028515871 +0000 2023-07-14T18:06:10.971 INFO:teuthology.orchestra.run.smithi163.stdout:Change: 2023-07-14 17:59:04.028515871 +0000 2023-07-14T18:06:10.971 INFO:teuthology.orchestra.run.smithi163.stdout: Birth: - 2023-07-14T18:06:10.971 DEBUG:teuthology.orchestra.run.smithi163:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-07-14T18:06:11.017 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:06:10 smithi172 ceph-mon[97983]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-14T18:06:11.017 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:06:10 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:06:11.017 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:06:10 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:06:11.017 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:06:10 smithi172 ceph-mon[97983]: Reconfiguring mon.c (monmap changed)... 2023-07-14T18:06:11.017 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:06:10 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-07-14T18:06:11.018 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:06:10 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-07-14T18:06:11.018 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:06:10 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T18:06:11.018 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:06:10 smithi172 ceph-mon[97983]: Reconfiguring daemon mon.c on smithi184 2023-07-14T18:06:11.018 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:06:10 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:06:11.040 INFO:teuthology.orchestra.run.smithi163.stderr:1+0 records in 2023-07-14T18:06:11.040 INFO:teuthology.orchestra.run.smithi163.stderr:1+0 records out 2023-07-14T18:06:11.040 INFO:teuthology.orchestra.run.smithi163.stderr:512 bytes copied, 0.000216178 s, 2.4 MB/s 2023-07-14T18:06:11.041 DEBUG:teuthology.orchestra.run.smithi163:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-07-14T18:06:11.100 DEBUG:teuthology.orchestra.run.smithi163:> stat /dev/vg_nvme/lv_3 2023-07-14T18:06:11.158 INFO:teuthology.orchestra.run.smithi163.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-07-14T18:06:11.158 INFO:teuthology.orchestra.run.smithi163.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-07-14T18:06:11.159 INFO:teuthology.orchestra.run.smithi163.stdout:Device: 6h/6d Inode: 380356 Links: 1 2023-07-14T18:06:11.159 INFO:teuthology.orchestra.run.smithi163.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-07-14T18:06:11.159 INFO:teuthology.orchestra.run.smithi163.stdout:Context: system_u:object_r:device_t:s0 2023-07-14T18:06:11.159 INFO:teuthology.orchestra.run.smithi163.stdout:Access: 2023-07-14 18:05:25.095482123 +0000 2023-07-14T18:06:11.159 INFO:teuthology.orchestra.run.smithi163.stdout:Modify: 2023-07-14 17:59:04.533504199 +0000 2023-07-14T18:06:11.159 INFO:teuthology.orchestra.run.smithi163.stdout:Change: 2023-07-14 17:59:04.533504199 +0000 2023-07-14T18:06:11.160 INFO:teuthology.orchestra.run.smithi163.stdout: Birth: - 2023-07-14T18:06:11.160 DEBUG:teuthology.orchestra.run.smithi163:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-07-14T18:06:11.225 INFO:teuthology.orchestra.run.smithi163.stderr:1+0 records in 2023-07-14T18:06:11.225 INFO:teuthology.orchestra.run.smithi163.stderr:1+0 records out 2023-07-14T18:06:11.225 INFO:teuthology.orchestra.run.smithi163.stderr:512 bytes copied, 0.000278495 s, 1.8 MB/s 2023-07-14T18:06:11.227 DEBUG:teuthology.orchestra.run.smithi163:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-07-14T18:06:11.285 DEBUG:teuthology.orchestra.run.smithi163:> stat /dev/vg_nvme/lv_4 2023-07-14T18:06:11.344 INFO:teuthology.orchestra.run.smithi163.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-07-14T18:06:11.344 INFO:teuthology.orchestra.run.smithi163.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-07-14T18:06:11.344 INFO:teuthology.orchestra.run.smithi163.stdout:Device: 6h/6d Inode: 384207 Links: 1 2023-07-14T18:06:11.344 INFO:teuthology.orchestra.run.smithi163.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-07-14T18:06:11.344 INFO:teuthology.orchestra.run.smithi163.stdout:Context: system_u:object_r:device_t:s0 2023-07-14T18:06:11.345 INFO:teuthology.orchestra.run.smithi163.stdout:Access: 2023-07-14 18:05:25.095482123 +0000 2023-07-14T18:06:11.345 INFO:teuthology.orchestra.run.smithi163.stdout:Modify: 2023-07-14 17:59:05.047492320 +0000 2023-07-14T18:06:11.345 INFO:teuthology.orchestra.run.smithi163.stdout:Change: 2023-07-14 17:59:05.047492320 +0000 2023-07-14T18:06:11.345 INFO:teuthology.orchestra.run.smithi163.stdout: Birth: - 2023-07-14T18:06:11.345 DEBUG:teuthology.orchestra.run.smithi163:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-07-14T18:06:11.409 INFO:teuthology.orchestra.run.smithi163.stderr:1+0 records in 2023-07-14T18:06:11.410 INFO:teuthology.orchestra.run.smithi163.stderr:1+0 records out 2023-07-14T18:06:11.410 INFO:teuthology.orchestra.run.smithi163.stderr:512 bytes copied, 0.000208299 s, 2.5 MB/s 2023-07-14T18:06:11.411 DEBUG:teuthology.orchestra.run.smithi163:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-07-14T18:06:11.468 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2023-07-14T18:06:11.469 DEBUG:teuthology.orchestra.run.smithi172:> dd if=/scratch_devs of=/dev/stdout 2023-07-14T18:06:11.489 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-07-14T18:06:11.489 DEBUG:teuthology.orchestra.run.smithi172:> stat /dev/vg_nvme/lv_1 2023-07-14T18:06:11.549 INFO:teuthology.orchestra.run.smithi172.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-07-14T18:06:11.550 INFO:teuthology.orchestra.run.smithi172.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-07-14T18:06:11.550 INFO:teuthology.orchestra.run.smithi172.stdout:Device: 6h/6d Inode: 380253 Links: 1 2023-07-14T18:06:11.550 INFO:teuthology.orchestra.run.smithi172.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-07-14T18:06:11.550 INFO:teuthology.orchestra.run.smithi172.stdout:Context: system_u:object_r:device_t:s0 2023-07-14T18:06:11.550 INFO:teuthology.orchestra.run.smithi172.stdout:Access: 2023-07-14 18:05:59.139103182 +0000 2023-07-14T18:06:11.550 INFO:teuthology.orchestra.run.smithi172.stdout:Modify: 2023-07-14 17:59:12.524989727 +0000 2023-07-14T18:06:11.551 INFO:teuthology.orchestra.run.smithi172.stdout:Change: 2023-07-14 17:59:12.524989727 +0000 2023-07-14T18:06:11.551 INFO:teuthology.orchestra.run.smithi172.stdout: Birth: - 2023-07-14T18:06:11.551 DEBUG:teuthology.orchestra.run.smithi172:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-07-14T18:06:11.618 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2023-07-14T18:06:11.618 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2023-07-14T18:06:11.618 INFO:teuthology.orchestra.run.smithi172.stderr:512 bytes copied, 0.000264071 s, 1.9 MB/s 2023-07-14T18:06:11.619 DEBUG:teuthology.orchestra.run.smithi172:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-07-14T18:06:11.678 DEBUG:teuthology.orchestra.run.smithi172:> stat /dev/vg_nvme/lv_2 2023-07-14T18:06:11.738 INFO:teuthology.orchestra.run.smithi172.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-07-14T18:06:11.738 INFO:teuthology.orchestra.run.smithi172.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-07-14T18:06:11.738 INFO:teuthology.orchestra.run.smithi172.stdout:Device: 6h/6d Inode: 382164 Links: 1 2023-07-14T18:06:11.739 INFO:teuthology.orchestra.run.smithi172.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-07-14T18:06:11.739 INFO:teuthology.orchestra.run.smithi172.stdout:Context: system_u:object_r:device_t:s0 2023-07-14T18:06:11.739 INFO:teuthology.orchestra.run.smithi172.stdout:Access: 2023-07-14 18:05:59.139103182 +0000 2023-07-14T18:06:11.739 INFO:teuthology.orchestra.run.smithi172.stdout:Modify: 2023-07-14 17:59:13.042978598 +0000 2023-07-14T18:06:11.739 INFO:teuthology.orchestra.run.smithi172.stdout:Change: 2023-07-14 17:59:13.042978598 +0000 2023-07-14T18:06:11.739 INFO:teuthology.orchestra.run.smithi172.stdout: Birth: - 2023-07-14T18:06:11.740 DEBUG:teuthology.orchestra.run.smithi172:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-07-14T18:06:11.805 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2023-07-14T18:06:11.805 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2023-07-14T18:06:11.805 INFO:teuthology.orchestra.run.smithi172.stderr:512 bytes copied, 0.000237429 s, 2.2 MB/s 2023-07-14T18:06:11.806 DEBUG:teuthology.orchestra.run.smithi172:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-07-14T18:06:11.865 DEBUG:teuthology.orchestra.run.smithi172:> stat /dev/vg_nvme/lv_3 2023-07-14T18:06:11.916 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:06:11 smithi184 ceph-mon[98481]: from='client.14211 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi163=x;smithi172=y;smithi184=z", "target": ["mon-mgr", ""]}]: dispatch 2023-07-14T18:06:11.916 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:06:11 smithi184 ceph-mon[98481]: Saving service mgr spec with placement smithi163=x;smithi172=y;smithi184=z;count:3 2023-07-14T18:06:11.916 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:06:11 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:06:11.916 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:06:11 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:06:11.916 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:06:11 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-14T18:06:11.917 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:06:11 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T18:06:11.917 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:06:11 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-14T18:06:11.917 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:06:11 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:06:11.917 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:06:11 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-07-14T18:06:11.917 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:06:11 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2023-07-14T18:06:11.917 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:06:11 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2023-07-14T18:06:11.917 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:06:11 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T18:06:11.922 INFO:teuthology.orchestra.run.smithi172.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-07-14T18:06:11.923 INFO:teuthology.orchestra.run.smithi172.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-07-14T18:06:11.923 INFO:teuthology.orchestra.run.smithi172.stdout:Device: 6h/6d Inode: 379297 Links: 1 2023-07-14T18:06:11.923 INFO:teuthology.orchestra.run.smithi172.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-07-14T18:06:11.923 INFO:teuthology.orchestra.run.smithi172.stdout:Context: system_u:object_r:device_t:s0 2023-07-14T18:06:11.923 INFO:teuthology.orchestra.run.smithi172.stdout:Access: 2023-07-14 18:05:59.139103182 +0000 2023-07-14T18:06:11.923 INFO:teuthology.orchestra.run.smithi172.stdout:Modify: 2023-07-14 17:59:13.547967748 +0000 2023-07-14T18:06:11.923 INFO:teuthology.orchestra.run.smithi172.stdout:Change: 2023-07-14 17:59:13.547967748 +0000 2023-07-14T18:06:11.924 INFO:teuthology.orchestra.run.smithi172.stdout: Birth: - 2023-07-14T18:06:11.924 DEBUG:teuthology.orchestra.run.smithi172:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-07-14T18:06:11.958 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:06:11 smithi163 ceph-mon[96576]: from='client.14211 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi163=x;smithi172=y;smithi184=z", "target": ["mon-mgr", ""]}]: dispatch 2023-07-14T18:06:11.959 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:06:11 smithi163 ceph-mon[96576]: Saving service mgr spec with placement smithi163=x;smithi172=y;smithi184=z;count:3 2023-07-14T18:06:11.959 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:06:11 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:06:11.959 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:06:11 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:06:11.959 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:06:11 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-14T18:06:11.959 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:06:11 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T18:06:11.960 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:06:11 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-14T18:06:11.960 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:06:11 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:06:11.960 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:06:11 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-07-14T18:06:11.960 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:06:11 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2023-07-14T18:06:11.960 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:06:11 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2023-07-14T18:06:11.960 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:06:11 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T18:06:11.987 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:06:11 smithi172 ceph-mon[97983]: from='client.14211 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi163=x;smithi172=y;smithi184=z", "target": ["mon-mgr", ""]}]: dispatch 2023-07-14T18:06:11.987 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:06:11 smithi172 ceph-mon[97983]: Saving service mgr spec with placement smithi163=x;smithi172=y;smithi184=z;count:3 2023-07-14T18:06:11.987 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:06:11 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:06:11.988 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:06:11 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:06:11.988 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:06:11 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-14T18:06:11.988 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:06:11 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T18:06:11.988 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:06:11 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-14T18:06:11.988 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:06:11 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:06:11.988 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:06:11 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-07-14T18:06:11.989 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:06:11 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2023-07-14T18:06:11.989 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:06:11 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2023-07-14T18:06:11.989 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:06:11 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T18:06:11.989 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2023-07-14T18:06:11.990 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2023-07-14T18:06:11.990 INFO:teuthology.orchestra.run.smithi172.stderr:512 bytes copied, 0.000222068 s, 2.3 MB/s 2023-07-14T18:06:11.991 DEBUG:teuthology.orchestra.run.smithi172:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-07-14T18:06:12.049 DEBUG:teuthology.orchestra.run.smithi172:> stat /dev/vg_nvme/lv_4 2023-07-14T18:06:12.106 INFO:teuthology.orchestra.run.smithi172.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-07-14T18:06:12.106 INFO:teuthology.orchestra.run.smithi172.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-07-14T18:06:12.107 INFO:teuthology.orchestra.run.smithi172.stdout:Device: 6h/6d Inode: 380347 Links: 1 2023-07-14T18:06:12.107 INFO:teuthology.orchestra.run.smithi172.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-07-14T18:06:12.107 INFO:teuthology.orchestra.run.smithi172.stdout:Context: system_u:object_r:device_t:s0 2023-07-14T18:06:12.107 INFO:teuthology.orchestra.run.smithi172.stdout:Access: 2023-07-14 18:05:59.139103182 +0000 2023-07-14T18:06:12.107 INFO:teuthology.orchestra.run.smithi172.stdout:Modify: 2023-07-14 17:59:14.081956276 +0000 2023-07-14T18:06:12.107 INFO:teuthology.orchestra.run.smithi172.stdout:Change: 2023-07-14 17:59:14.081956276 +0000 2023-07-14T18:06:12.107 INFO:teuthology.orchestra.run.smithi172.stdout: Birth: - 2023-07-14T18:06:12.108 DEBUG:teuthology.orchestra.run.smithi172:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-07-14T18:06:12.171 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2023-07-14T18:06:12.171 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2023-07-14T18:06:12.172 INFO:teuthology.orchestra.run.smithi172.stderr:512 bytes copied, 0.000238684 s, 2.1 MB/s 2023-07-14T18:06:12.172 DEBUG:teuthology.orchestra.run.smithi172:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-07-14T18:06:12.230 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2023-07-14T18:06:12.231 DEBUG:teuthology.orchestra.run.smithi184:> dd if=/scratch_devs of=/dev/stdout 2023-07-14T18:06:12.254 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-07-14T18:06:12.254 DEBUG:teuthology.orchestra.run.smithi184:> stat /dev/vg_nvme/lv_1 2023-07-14T18:06:12.311 INFO:teuthology.orchestra.run.smithi184.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-07-14T18:06:12.311 INFO:teuthology.orchestra.run.smithi184.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-07-14T18:06:12.311 INFO:teuthology.orchestra.run.smithi184.stdout:Device: 6h/6d Inode: 375333 Links: 1 2023-07-14T18:06:12.312 INFO:teuthology.orchestra.run.smithi184.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-07-14T18:06:12.312 INFO:teuthology.orchestra.run.smithi184.stdout:Context: system_u:object_r:device_t:s0 2023-07-14T18:06:12.312 INFO:teuthology.orchestra.run.smithi184.stdout:Access: 2023-07-14 18:06:12.233446994 +0000 2023-07-14T18:06:12.312 INFO:teuthology.orchestra.run.smithi184.stdout:Modify: 2023-07-14 17:58:54.681480218 +0000 2023-07-14T18:06:12.312 INFO:teuthology.orchestra.run.smithi184.stdout:Change: 2023-07-14 17:58:54.681480218 +0000 2023-07-14T18:06:12.312 INFO:teuthology.orchestra.run.smithi184.stdout: Birth: - 2023-07-14T18:06:12.313 DEBUG:teuthology.orchestra.run.smithi184:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-07-14T18:06:12.436 INFO:teuthology.orchestra.run.smithi184.stderr:1+0 records in 2023-07-14T18:06:12.436 INFO:teuthology.orchestra.run.smithi184.stderr:1+0 records out 2023-07-14T18:06:12.437 INFO:teuthology.orchestra.run.smithi184.stderr:512 bytes copied, 0.000247708 s, 2.1 MB/s 2023-07-14T18:06:12.437 DEBUG:teuthology.orchestra.run.smithi184:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-07-14T18:06:12.456 DEBUG:teuthology.orchestra.run.smithi184:> stat /dev/vg_nvme/lv_2 2023-07-14T18:06:12.515 INFO:teuthology.orchestra.run.smithi184.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-07-14T18:06:12.515 INFO:teuthology.orchestra.run.smithi184.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-07-14T18:06:12.515 INFO:teuthology.orchestra.run.smithi184.stdout:Device: 6h/6d Inode: 384014 Links: 1 2023-07-14T18:06:12.515 INFO:teuthology.orchestra.run.smithi184.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-07-14T18:06:12.515 INFO:teuthology.orchestra.run.smithi184.stdout:Context: system_u:object_r:device_t:s0 2023-07-14T18:06:12.516 INFO:teuthology.orchestra.run.smithi184.stdout:Access: 2023-07-14 18:06:12.357444462 +0000 2023-07-14T18:06:12.516 INFO:teuthology.orchestra.run.smithi184.stdout:Modify: 2023-07-14 17:58:55.183469977 +0000 2023-07-14T18:06:12.516 INFO:teuthology.orchestra.run.smithi184.stdout:Change: 2023-07-14 17:58:55.183469977 +0000 2023-07-14T18:06:12.516 INFO:teuthology.orchestra.run.smithi184.stdout: Birth: - 2023-07-14T18:06:12.516 DEBUG:teuthology.orchestra.run.smithi184:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-07-14T18:06:12.581 INFO:journalctl@ceph.mgr.z.smithi184.stdout:Jul 14 18:06:12 smithi184 systemd[1]: Starting Ceph mgr.z for bf7326ec-2270-11ee-9b33-001a4aab830c... 2023-07-14T18:06:12.583 INFO:teuthology.orchestra.run.smithi184.stderr:1+0 records in 2023-07-14T18:06:12.583 INFO:teuthology.orchestra.run.smithi184.stderr:1+0 records out 2023-07-14T18:06:12.584 INFO:teuthology.orchestra.run.smithi184.stderr:512 bytes copied, 0.000266082 s, 1.9 MB/s 2023-07-14T18:06:12.584 DEBUG:teuthology.orchestra.run.smithi184:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-07-14T18:06:12.642 DEBUG:teuthology.orchestra.run.smithi184:> stat /dev/vg_nvme/lv_3 2023-07-14T18:06:12.699 INFO:teuthology.orchestra.run.smithi184.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-07-14T18:06:12.699 INFO:teuthology.orchestra.run.smithi184.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-07-14T18:06:12.700 INFO:teuthology.orchestra.run.smithi184.stdout:Device: 6h/6d Inode: 382190 Links: 1 2023-07-14T18:06:12.700 INFO:teuthology.orchestra.run.smithi184.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-07-14T18:06:12.700 INFO:teuthology.orchestra.run.smithi184.stdout:Context: system_u:object_r:device_t:s0 2023-07-14T18:06:12.700 INFO:teuthology.orchestra.run.smithi184.stdout:Access: 2023-07-14 18:06:12.357444462 +0000 2023-07-14T18:06:12.700 INFO:teuthology.orchestra.run.smithi184.stdout:Modify: 2023-07-14 17:58:55.690459634 +0000 2023-07-14T18:06:12.700 INFO:teuthology.orchestra.run.smithi184.stdout:Change: 2023-07-14 17:58:55.690459634 +0000 2023-07-14T18:06:12.700 INFO:teuthology.orchestra.run.smithi184.stdout: Birth: - 2023-07-14T18:06:12.701 DEBUG:teuthology.orchestra.run.smithi184:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-07-14T18:06:12.767 INFO:teuthology.orchestra.run.smithi184.stderr:1+0 records in 2023-07-14T18:06:12.768 INFO:teuthology.orchestra.run.smithi184.stderr:1+0 records out 2023-07-14T18:06:12.768 INFO:teuthology.orchestra.run.smithi184.stderr:512 bytes copied, 0.00021424 s, 2.4 MB/s 2023-07-14T18:06:12.769 DEBUG:teuthology.orchestra.run.smithi184:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-07-14T18:06:12.826 DEBUG:teuthology.orchestra.run.smithi184:> stat /dev/vg_nvme/lv_4 2023-07-14T18:06:12.847 INFO:journalctl@ceph.mgr.z.smithi184.stdout:Jul 14 18:06:12 smithi184 podman[100461]: 2023-07-14T18:06:12.847 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:06:12 smithi184 ceph-mon[98481]: Deploying daemon mgr.z on smithi184 2023-07-14T18:06:12.847 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:06:12 smithi184 ceph-mon[98481]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-14T18:06:12.864 INFO:teuthology.orchestra.run.smithi184.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-07-14T18:06:12.864 INFO:teuthology.orchestra.run.smithi184.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-07-14T18:06:12.864 INFO:teuthology.orchestra.run.smithi184.stdout:Device: 6h/6d Inode: 381171 Links: 1 2023-07-14T18:06:12.864 INFO:teuthology.orchestra.run.smithi184.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-07-14T18:06:12.865 INFO:teuthology.orchestra.run.smithi184.stdout:Context: system_u:object_r:device_t:s0 2023-07-14T18:06:12.865 INFO:teuthology.orchestra.run.smithi184.stdout:Access: 2023-07-14 18:06:12.357444462 +0000 2023-07-14T18:06:12.865 INFO:teuthology.orchestra.run.smithi184.stdout:Modify: 2023-07-14 17:58:56.219448842 +0000 2023-07-14T18:06:12.865 INFO:teuthology.orchestra.run.smithi184.stdout:Change: 2023-07-14 17:58:56.219448842 +0000 2023-07-14T18:06:12.865 INFO:teuthology.orchestra.run.smithi184.stdout: Birth: - 2023-07-14T18:06:12.865 DEBUG:teuthology.orchestra.run.smithi184:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-07-14T18:06:12.928 INFO:teuthology.orchestra.run.smithi184.stderr:1+0 records in 2023-07-14T18:06:12.929 INFO:teuthology.orchestra.run.smithi184.stderr:1+0 records out 2023-07-14T18:06:12.929 INFO:teuthology.orchestra.run.smithi184.stderr:512 bytes copied, 0.000204749 s, 2.5 MB/s 2023-07-14T18:06:12.930 DEBUG:teuthology.orchestra.run.smithi184:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-07-14T18:06:12.988 INFO:tasks.cephadm:Deploying osd.0 on smithi163 with /dev/vg_nvme/lv_4... 2023-07-14T18:06:12.989 DEBUG:teuthology.orchestra.run.smithi163:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81c9387d2e7576da065747ec9c16d1c7d69016ec shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bf7326ec-2270-11ee-9b33-001a4aab830c -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2023-07-14T18:06:13.017 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:06:12 smithi172 ceph-mon[97983]: Deploying daemon mgr.z on smithi184 2023-07-14T18:06:13.017 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:06:12 smithi172 ceph-mon[97983]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-14T18:06:13.018 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:06:12 smithi163 ceph-mon[96576]: Deploying daemon mgr.z on smithi184 2023-07-14T18:06:13.018 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:06:12 smithi163 ceph-mon[96576]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-14T18:06:13.208 INFO:journalctl@ceph.mgr.z.smithi184.stdout:Jul 14 18:06:12 smithi184 bash[100461]: a10ee43ef151e3c8901a794bf919c37ef89b6b5695a3efd94f2e86e090c2d822 2023-07-14T18:06:13.208 INFO:journalctl@ceph.mgr.z.smithi184.stdout:Jul 14 18:06:12 smithi184 ceph-mgr[100629]: -- 172.21.15.184:0/1927082901 <== mon.1 v2:172.21.15.184:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55e89a4f11e0 con 0x55e89a4c6800 2023-07-14T18:06:13.208 INFO:journalctl@ceph.mgr.z.smithi184.stdout:Jul 14 18:06:12 smithi184 systemd[1]: Started Ceph mgr.z for bf7326ec-2270-11ee-9b33-001a4aab830c. 2023-07-14T18:06:13.209 INFO:journalctl@ceph.mgr.z.smithi184.stdout:Jul 14 18:06:13 smithi184 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-mgr-z[100539]: 2023-07-14T18:06:13.096+0000 7f609aa19200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-07-14T18:06:13.209 INFO:journalctl@ceph.mgr.z.smithi184.stdout:Jul 14 18:06:13 smithi184 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-mgr-z[100539]: 2023-07-14T18:06:13.176+0000 7f609aa19200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-07-14T18:06:13.554 INFO:teuthology.orchestra.run.smithi163.stderr:Inferring config /var/lib/ceph/bf7326ec-2270-11ee-9b33-001a4aab830c/mon.a/config 2023-07-14T18:06:13.557 INFO:journalctl@ceph.mgr.z.smithi184.stdout:Jul 14 18:06:13 smithi184 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-mgr-z[100539]: 2023-07-14T18:06:13.264+0000 7f609aa19200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-07-14T18:06:13.557 INFO:journalctl@ceph.mgr.z.smithi184.stdout:Jul 14 18:06:13 smithi184 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-mgr-z[100539]: 2023-07-14T18:06:13.357+0000 7f609aa19200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-07-14T18:06:14.166 INFO:journalctl@ceph.mgr.z.smithi184.stdout:Jul 14 18:06:13 smithi184 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-mgr-z[100539]: 2023-07-14T18:06:13.525+0000 7f609aa19200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-07-14T18:06:14.166 INFO:journalctl@ceph.mgr.z.smithi184.stdout:Jul 14 18:06:13 smithi184 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-mgr-z[100539]: 2023-07-14T18:06:13.833+0000 7f609aa19200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-07-14T18:06:14.166 INFO:journalctl@ceph.mgr.z.smithi184.stdout:Jul 14 18:06:13 smithi184 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-mgr-z[100539]: 2023-07-14T18:06:13.921+0000 7f609aa19200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-07-14T18:06:14.167 INFO:journalctl@ceph.mgr.z.smithi184.stdout:Jul 14 18:06:14 smithi184 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-mgr-z[100539]: 2023-07-14T18:06:14.056+0000 7f609aa19200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-07-14T18:06:14.167 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:06:14 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:06:14.167 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:06:14 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:06:14.167 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:06:14 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:06:14.167 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:06:14 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-07-14T18:06:14.167 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:06:14 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2023-07-14T18:06:14.168 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:06:14 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2023-07-14T18:06:14.168 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:06:14 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T18:06:14.168 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:06:14 smithi184 ceph-mon[98481]: Deploying daemon mgr.y on smithi172 2023-07-14T18:06:14.168 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:06:14 smithi184 ceph-mon[98481]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-14T18:06:14.318 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:06:14 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:06:14.318 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:06:14 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:06:14.318 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:06:14 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:06:14.318 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:06:14 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-07-14T18:06:14.319 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:06:14 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2023-07-14T18:06:14.319 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:06:14 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2023-07-14T18:06:14.319 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:06:14 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T18:06:14.319 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:06:14 smithi163 ceph-mon[96576]: Deploying daemon mgr.y on smithi172 2023-07-14T18:06:14.319 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:06:14 smithi163 ceph-mon[96576]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-14T18:06:14.369 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:06:14 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:06:14.369 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:06:14 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:06:14.370 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:06:14 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:06:14.370 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:06:14 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-07-14T18:06:14.370 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:06:14 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2023-07-14T18:06:14.370 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:06:14 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2023-07-14T18:06:14.370 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:06:14 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T18:06:14.370 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:06:14 smithi172 ceph-mon[97983]: Deploying daemon mgr.y on smithi172 2023-07-14T18:06:14.370 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:06:14 smithi172 ceph-mon[97983]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-14T18:06:14.604 INFO:journalctl@ceph.mgr.z.smithi184.stdout:Jul 14 18:06:14 smithi184 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-mgr-z[100539]: 2023-07-14T18:06:14.152+0000 7f609aa19200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-07-14T18:06:14.767 INFO:journalctl@ceph.mgr.y.smithi172.stdout:Jul 14 18:06:14 smithi172 systemd[1]: Starting Ceph mgr.y for bf7326ec-2270-11ee-9b33-001a4aab830c... 2023-07-14T18:06:14.916 INFO:journalctl@ceph.mgr.z.smithi184.stdout:Jul 14 18:06:14 smithi184 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-mgr-z[100539]: 2023-07-14T18:06:14.572+0000 7f609aa19200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-07-14T18:06:15.008 INFO:teuthology.orchestra.run.smithi163.stderr:--> Zapping: /dev/vg_nvme/lv_4 2023-07-14T18:06:15.009 INFO:teuthology.orchestra.run.smithi163.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2023-07-14T18:06:15.009 INFO:teuthology.orchestra.run.smithi163.stderr: stderr: 10+0 records in 2023-07-14T18:06:15.009 INFO:teuthology.orchestra.run.smithi163.stderr:10+0 records out 2023-07-14T18:06:15.009 INFO:teuthology.orchestra.run.smithi163.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0108762 s, 964 MB/s 2023-07-14T18:06:15.009 INFO:teuthology.orchestra.run.smithi163.stderr:--> Zapping successful for: 2023-07-14T18:06:15.172 INFO:journalctl@ceph.mgr.y.smithi172.stdout:Jul 14 18:06:14 smithi172 podman[99420]: 2023-07-14T18:06:15.172 INFO:journalctl@ceph.mgr.y.smithi172.stdout:Jul 14 18:06:15 smithi172 bash[99420]: 2d0c5ad99722d2c08cf0bc6ec2c196902dd4d94d8398ca04187001e1141a1fd3 2023-07-14T18:06:15.172 INFO:journalctl@ceph.mgr.y.smithi172.stdout:Jul 14 18:06:15 smithi172 ceph-mgr[99459]: -- 172.21.15.172:0/2965732031 <== mon.0 v2:172.21.15.163:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55a5d69211e0 con 0x55a5d68f7000 2023-07-14T18:06:15.400 DEBUG:teuthology.orchestra.run.smithi163:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81c9387d2e7576da065747ec9c16d1c7d69016ec shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bf7326ec-2270-11ee-9b33-001a4aab830c -- ceph orch daemon add osd smithi163:vg_nvme/lv_4 2023-07-14T18:06:15.498 INFO:journalctl@ceph.mgr.y.smithi172.stdout:Jul 14 18:06:15 smithi172 systemd[1]: Started Ceph mgr.y for bf7326ec-2270-11ee-9b33-001a4aab830c. 2023-07-14T18:06:15.498 INFO:journalctl@ceph.mgr.y.smithi172.stdout:Jul 14 18:06:15 smithi172 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-mgr-y[99435]: 2023-07-14T18:06:15.184+0000 7f1664efd200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-07-14T18:06:15.498 INFO:journalctl@ceph.mgr.y.smithi172.stdout:Jul 14 18:06:15 smithi172 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-mgr-y[99435]: 2023-07-14T18:06:15.271+0000 7f1664efd200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-07-14T18:06:15.498 INFO:journalctl@ceph.mgr.y.smithi172.stdout:Jul 14 18:06:15 smithi172 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-mgr-y[99435]: 2023-07-14T18:06:15.364+0000 7f1664efd200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-07-14T18:06:15.499 INFO:journalctl@ceph.mgr.y.smithi172.stdout:Jul 14 18:06:15 smithi172 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-mgr-y[99435]: 2023-07-14T18:06:15.465+0000 7f1664efd200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-07-14T18:06:15.666 INFO:journalctl@ceph.mgr.z.smithi184.stdout:Jul 14 18:06:15 smithi184 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-mgr-z[100539]: 2023-07-14T18:06:15.145+0000 7f609aa19200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-07-14T18:06:15.666 INFO:journalctl@ceph.mgr.z.smithi184.stdout:Jul 14 18:06:15 smithi184 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-mgr-z[100539]: 2023-07-14T18:06:15.317+0000 7f609aa19200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-07-14T18:06:15.767 INFO:journalctl@ceph.mgr.y.smithi172.stdout:Jul 14 18:06:15 smithi172 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-mgr-y[99435]: 2023-07-14T18:06:15.644+0000 7f1664efd200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-07-14T18:06:15.993 INFO:teuthology.orchestra.run.smithi163.stderr:Inferring config /var/lib/ceph/bf7326ec-2270-11ee-9b33-001a4aab830c/mon.a/config 2023-07-14T18:06:16.267 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:06:16 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:06:16.267 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:06:16 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:06:16.267 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:06:16 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:06:16.267 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:06:16 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:06:16.268 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:06:16 smithi172 ceph-mon[97983]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-14T18:06:16.268 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:06:16 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-14T18:06:16.268 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:06:16 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:06:16.268 INFO:journalctl@ceph.mgr.y.smithi172.stdout:Jul 14 18:06:15 smithi172 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-mgr-y[99435]: 2023-07-14T18:06:15.968+0000 7f1664efd200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-07-14T18:06:16.268 INFO:journalctl@ceph.mgr.y.smithi172.stdout:Jul 14 18:06:16 smithi172 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-mgr-y[99435]: 2023-07-14T18:06:16.061+0000 7f1664efd200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-07-14T18:06:16.268 INFO:journalctl@ceph.mgr.y.smithi172.stdout:Jul 14 18:06:16 smithi172 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-mgr-y[99435]: 2023-07-14T18:06:16.197+0000 7f1664efd200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-07-14T18:06:16.416 INFO:journalctl@ceph.mgr.z.smithi184.stdout:Jul 14 18:06:16 smithi184 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-mgr-z[100539]: 2023-07-14T18:06:16.127+0000 7f609aa19200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-07-14T18:06:16.416 INFO:journalctl@ceph.mgr.z.smithi184.stdout:Jul 14 18:06:16 smithi184 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-mgr-z[100539]: 2023-07-14T18:06:16.220+0000 7f609aa19200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-07-14T18:06:16.416 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:06:16 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:06:16.417 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:06:16 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:06:16.417 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:06:16 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:06:16.417 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:06:16 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:06:16.417 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:06:16 smithi184 ceph-mon[98481]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-14T18:06:16.417 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:06:16 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-14T18:06:16.417 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:06:16 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:06:16.459 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:06:16 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:06:16.459 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:06:16 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:06:16.459 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:06:16 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:06:16.459 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:06:16 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:06:16.459 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:06:16 smithi163 ceph-mon[96576]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-14T18:06:16.460 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:06:16 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-14T18:06:16.460 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:06:16 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:06:16.742 INFO:journalctl@ceph.mgr.z.smithi184.stdout:Jul 14 18:06:16 smithi184 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-mgr-z[100539]: 2023-07-14T18:06:16.410+0000 7f609aa19200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-07-14T18:06:16.767 INFO:journalctl@ceph.mgr.y.smithi172.stdout:Jul 14 18:06:16 smithi172 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-mgr-y[99435]: 2023-07-14T18:06:16.298+0000 7f1664efd200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-07-14T18:06:17.136 INFO:journalctl@ceph.mgr.z.smithi184.stdout:Jul 14 18:06:16 smithi184 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-mgr-z[100539]: 2023-07-14T18:06:16.710+0000 7f609aa19200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-07-14T18:06:17.137 INFO:journalctl@ceph.mgr.z.smithi184.stdout:Jul 14 18:06:16 smithi184 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-mgr-z[100539]: 2023-07-14T18:06:16.956+0000 7f609aa19200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-07-14T18:06:17.267 INFO:journalctl@ceph.mgr.y.smithi172.stdout:Jul 14 18:06:16 smithi172 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-mgr-y[99435]: 2023-07-14T18:06:16.754+0000 7f1664efd200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-07-14T18:06:17.314 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:06:17.280+0000 7f1bc6d9f700 1 -- 172.21.15.163:0/3793079231 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f1bc00ffe70 msgr2=0x7f1bc01002e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:06:17.315 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:06:17.280+0000 7f1bc6d9f700 1 --2- 172.21.15.163:0/3793079231 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f1bc00ffe70 0x7f1bc01002e0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f1bac009990 tx=0x7f1bac009ca0 comp rx=0 tx=0).stop 2023-07-14T18:06:17.315 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:06:17.280+0000 7f1bc6d9f700 1 -- 172.21.15.163:0/3793079231 shutdown_connections 2023-07-14T18:06:17.315 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:06:17.280+0000 7f1bc6d9f700 1 --2- 172.21.15.163:0/3793079231 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1bc0100820 0x7f1bc01070c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:06:17.315 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:06:17.280+0000 7f1bc6d9f700 1 --2- 172.21.15.163:0/3793079231 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1bc00febd0 0x7f1bc00fefe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:06:17.315 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:06:17.280+0000 7f1bc6d9f700 1 --2- 172.21.15.163:0/3793079231 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f1bc00ffe70 0x7f1bc01002e0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:06:17.315 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:06:17.280+0000 7f1bc6d9f700 1 -- 172.21.15.163:0/3793079231 >> 172.21.15.163:0/3793079231 conn(0x7f1bc00fa240 msgr2=0x7f1bc00fc650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:06:17.315 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:06:17.280+0000 7f1bc6d9f700 1 -- 172.21.15.163:0/3793079231 shutdown_connections 2023-07-14T18:06:17.316 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:06:17.280+0000 7f1bc6d9f700 1 -- 172.21.15.163:0/3793079231 wait complete. 2023-07-14T18:06:17.316 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:06:17.280+0000 7f1bc6d9f700 1 Processor -- start 2023-07-14T18:06:17.316 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:06:17.281+0000 7f1bc6d9f700 1 -- start start 2023-07-14T18:06:17.316 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:06:17.281+0000 7f1bc6d9f700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f1bc00febd0 0x7f1bc0194810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:06:17.316 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:06:17.281+0000 7f1bc6d9f700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1bc00ffe70 0x7f1bc0194d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:06:17.316 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:06:17.281+0000 7f1bc6d9f700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1bc0100820 0x7f1bc019bdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:06:17.317 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:06:17.281+0000 7f1bc6d9f700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1bc019c3a0 con 0x7f1bc00febd0 2023-07-14T18:06:17.317 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:06:17.281+0000 7f1bc6d9f700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1bc019c4e0 con 0x7f1bc00ffe70 2023-07-14T18:06:17.317 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:06:17.281+0000 7f1bc6d9f700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1bc019c670 con 0x7f1bc0100820 2023-07-14T18:06:17.317 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:06:17.281+0000 7f1bc4b3b700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f1bc00febd0 0x7f1bc0194810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:06:17.317 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:06:17.281+0000 7f1bc4b3b700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f1bc00febd0 0x7f1bc0194810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:54844/0 (socket says 172.21.15.163:54844) 2023-07-14T18:06:17.317 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:06:17.281+0000 7f1bc4b3b700 1 -- 172.21.15.163:0/1287296054 learned_addr learned my addr 172.21.15.163:0/1287296054 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:06:17.317 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:06:17.281+0000 7f1bbffff700 1 --2- 172.21.15.163:0/1287296054 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1bc00ffe70 0x7f1bc0194d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:06:17.317 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:06:17.281+0000 7f1bc533c700 1 --2- 172.21.15.163:0/1287296054 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1bc0100820 0x7f1bc019bdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:06:17.318 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:06:17.281+0000 7f1bc4b3b700 1 -- 172.21.15.163:0/1287296054 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1bc0100820 msgr2=0x7f1bc019bdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:06:17.318 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:06:17.281+0000 7f1bc4b3b700 1 --2- 172.21.15.163:0/1287296054 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1bc0100820 0x7f1bc019bdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:06:17.318 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:06:17.281+0000 7f1bc4b3b700 1 -- 172.21.15.163:0/1287296054 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1bc00ffe70 msgr2=0x7f1bc0194d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:06:17.318 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:06:17.281+0000 7f1bc4b3b700 1 --2- 172.21.15.163:0/1287296054 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1bc00ffe70 0x7f1bc0194d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:06:17.318 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:06:17.281+0000 7f1bc4b3b700 1 -- 172.21.15.163:0/1287296054 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1bac0095f0 con 0x7f1bc00febd0 2023-07-14T18:06:17.318 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:06:17.281+0000 7f1bc533c700 1 --2- 172.21.15.163:0/1287296054 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1bc0100820 0x7f1bc019bdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T18:06:17.318 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:06:17.281+0000 7f1bc4b3b700 1 --2- 172.21.15.163:0/1287296054 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f1bc00febd0 0x7f1bc0194810 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f1bb400e9d0 tx=0x7f1bb400ece0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:06:17.319 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:06:17.281+0000 7f1bbdffb700 1 -- 172.21.15.163:0/1287296054 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bb4009790 con 0x7f1bc00febd0 2023-07-14T18:06:17.319 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:06:17.281+0000 7f1bbdffb700 1 -- 172.21.15.163:0/1287296054 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f1bb400cbd0 con 0x7f1bc00febd0 2023-07-14T18:06:17.319 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:06:17.281+0000 7f1bc6d9f700 1 -- 172.21.15.163:0/1287296054 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1bc019c950 con 0x7f1bc00febd0 2023-07-14T18:06:17.319 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:06:17.281+0000 7f1bbdffb700 1 -- 172.21.15.163:0/1287296054 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bb4018680 con 0x7f1bc00febd0 2023-07-14T18:06:17.319 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:06:17.282+0000 7f1bc6d9f700 1 -- 172.21.15.163:0/1287296054 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1bc019ce50 con 0x7f1bc00febd0 2023-07-14T18:06:17.319 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:06:17.282+0000 7f1bbdffb700 1 -- 172.21.15.163:0/1287296054 <== mon.0 v2:172.21.15.163:3300/0 4 ==== mgrmap(e 13) v1 ==== 45540+0+0 (secure 0 0 0) 0x7f1bb400cd40 con 0x7f1bc00febd0 2023-07-14T18:06:17.319 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:06:17.283+0000 7f1bc6d9f700 1 -- 172.21.15.163:0/1287296054 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1bc010a250 con 0x7f1bc00febd0 2023-07-14T18:06:17.320 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:06:17.283+0000 7f1bbdffb700 1 --2- 172.21.15.163:0/1287296054 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f1bb00389e0 0x7f1bb003ae90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:06:17.320 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:06:17.283+0000 7f1bbdffb700 1 -- 172.21.15.163:0/1287296054 <== mon.0 v2:172.21.15.163:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f1bb4014070 con 0x7f1bc00febd0 2023-07-14T18:06:17.320 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:06:17.283+0000 7f1bbffff700 1 --2- 172.21.15.163:0/1287296054 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f1bb00389e0 0x7f1bb003ae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:06:17.320 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:06:17.283+0000 7f1bbffff700 1 --2- 172.21.15.163:0/1287296054 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f1bb00389e0 0x7f1bb003ae90 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f1bac006010 tx=0x7f1bac005960 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:06:17.321 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:06:17.287+0000 7f1bbdffb700 1 -- 172.21.15.163:0/1287296054 <== mon.0 v2:172.21.15.163:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178025 (secure 0 0 0) 0x7f1bb40187e0 con 0x7f1bc00febd0 2023-07-14T18:06:17.396 INFO:journalctl@ceph.mgr.z.smithi184.stdout:Jul 14 18:06:17 smithi184 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-mgr-z[100539]: 2023-07-14T18:06:17.104+0000 7f609aa19200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-07-14T18:06:17.528 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:06:17.497+0000 7f1bc6d9f700 1 -- 172.21.15.163:0/1287296054 --> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi163:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) v1 -- 0x7f1bc0060a80 con 0x7f1bb00389e0 2023-07-14T18:06:17.666 INFO:journalctl@ceph.mgr.z.smithi184.stdout:Jul 14 18:06:17 smithi184 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-mgr-z[100539]: 2023-07-14T18:06:17.364+0000 7f609aa19200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-07-14T18:06:17.767 INFO:journalctl@ceph.mgr.y.smithi172.stdout:Jul 14 18:06:17 smithi172 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-mgr-y[99435]: 2023-07-14T18:06:17.338+0000 7f1664efd200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-07-14T18:06:17.767 INFO:journalctl@ceph.mgr.y.smithi172.stdout:Jul 14 18:06:17 smithi172 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-mgr-y[99435]: 2023-07-14T18:06:17.509+0000 7f1664efd200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-07-14T18:06:17.906 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:06:17 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:06:17.907 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:06:17 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:06:17.907 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:06:17 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:06:17.907 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:06:17 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:06:17.907 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:06:17 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T18:06:17.907 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:06:17 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-14T18:06:17.908 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:06:17 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:06:17.908 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:06:17 smithi163 ceph-mon[96576]: Reconfiguring mgr.x (unknown last config time)... 2023-07-14T18:06:17.908 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:06:17 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-07-14T18:06:17.908 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:06:17 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2023-07-14T18:06:17.908 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:06:17 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T18:06:17.908 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:06:17 smithi163 ceph-mon[96576]: Reconfiguring daemon mgr.x on smithi163 2023-07-14T18:06:17.908 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:06:17 smithi163 ceph-mon[96576]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-14T18:06:17.909 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:06:17 smithi163 ceph-mon[96576]: from='client.14229 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi163:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2023-07-14T18:06:17.909 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:06:17 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-07-14T18:06:17.909 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:06:17 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-07-14T18:06:17.909 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:06:17 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T18:06:18.099 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:06:17 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:06:18.100 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:06:17 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:06:18.100 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:06:17 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:06:18.100 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:06:17 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:06:18.100 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:06:17 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T18:06:18.100 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:06:17 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-14T18:06:18.100 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:06:17 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:06:18.100 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:06:17 smithi184 ceph-mon[98481]: Reconfiguring mgr.x (unknown last config time)... 2023-07-14T18:06:18.101 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:06:17 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-07-14T18:06:18.101 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:06:17 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2023-07-14T18:06:18.101 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:06:17 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T18:06:18.101 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:06:17 smithi184 ceph-mon[98481]: Reconfiguring daemon mgr.x on smithi163 2023-07-14T18:06:18.101 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:06:17 smithi184 ceph-mon[98481]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-14T18:06:18.101 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:06:17 smithi184 ceph-mon[98481]: from='client.14229 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi163:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2023-07-14T18:06:18.101 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:06:17 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-07-14T18:06:18.102 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:06:17 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-07-14T18:06:18.102 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:06:17 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T18:06:18.267 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:06:17 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:06:18.268 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:06:17 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:06:18.268 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:06:17 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:06:18.268 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:06:17 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:06:18.268 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:06:17 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T18:06:18.268 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:06:17 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-14T18:06:18.268 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:06:17 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:06:18.269 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:06:17 smithi172 ceph-mon[97983]: Reconfiguring mgr.x (unknown last config time)... 2023-07-14T18:06:18.269 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:06:17 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-07-14T18:06:18.269 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:06:17 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2023-07-14T18:06:18.269 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:06:17 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T18:06:18.269 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:06:17 smithi172 ceph-mon[97983]: Reconfiguring daemon mgr.x on smithi163 2023-07-14T18:06:18.269 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:06:17 smithi172 ceph-mon[97983]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-14T18:06:18.269 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:06:17 smithi172 ceph-mon[97983]: from='client.14229 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi163:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2023-07-14T18:06:18.269 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:06:17 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-07-14T18:06:18.270 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:06:17 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-07-14T18:06:18.270 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:06:17 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T18:06:18.416 INFO:journalctl@ceph.mgr.z.smithi184.stdout:Jul 14 18:06:18 smithi184 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-mgr-z[100539]: 2023-07-14T18:06:18.067+0000 7f609aa19200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-07-14T18:06:18.416 INFO:journalctl@ceph.mgr.z.smithi184.stdout:Jul 14 18:06:18 smithi184 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-mgr-z[100539]: 2023-07-14T18:06:18.197+0000 7f609aa19200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-07-14T18:06:18.572 INFO:journalctl@ceph.mgr.y.smithi172.stdout:Jul 14 18:06:18 smithi172 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-mgr-y[99435]: 2023-07-14T18:06:18.278+0000 7f1664efd200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-07-14T18:06:18.572 INFO:journalctl@ceph.mgr.y.smithi172.stdout:Jul 14 18:06:18 smithi172 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-mgr-y[99435]: 2023-07-14T18:06:18.369+0000 7f1664efd200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-07-14T18:06:18.748 INFO:journalctl@ceph.mgr.z.smithi184.stdout:Jul 14 18:06:18 smithi184 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-mgr-z[100539]: 2023-07-14T18:06:18.387+0000 7f609aa19200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-07-14T18:06:18.748 INFO:journalctl@ceph.mgr.z.smithi184.stdout:Jul 14 18:06:18 smithi184 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-mgr-z[100539]: 2023-07-14T18:06:18.501+0000 7f609aa19200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-07-14T18:06:18.852 INFO:journalctl@ceph.mgr.y.smithi172.stdout:Jul 14 18:06:18 smithi172 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-mgr-y[99435]: 2023-07-14T18:06:18.539+0000 7f1664efd200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-07-14T18:06:19.166 INFO:journalctl@ceph.mgr.z.smithi184.stdout:Jul 14 18:06:18 smithi184 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-mgr-z[100539]: 2023-07-14T18:06:18.715+0000 7f609aa19200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-07-14T18:06:19.235 INFO:journalctl@ceph.mgr.y.smithi172.stdout:Jul 14 18:06:18 smithi172 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-mgr-y[99435]: 2023-07-14T18:06:18.819+0000 7f1664efd200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-07-14T18:06:19.235 INFO:journalctl@ceph.mgr.y.smithi172.stdout:Jul 14 18:06:19 smithi172 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-mgr-y[99435]: 2023-07-14T18:06:19.055+0000 7f1664efd200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-07-14T18:06:19.496 INFO:journalctl@ceph.mgr.y.smithi172.stdout:Jul 14 18:06:19 smithi172 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-mgr-y[99435]: 2023-07-14T18:06:19.202+0000 7f1664efd200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-07-14T18:06:19.497 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:06:19 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:06:19.497 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:06:19 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:06:19.497 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:06:19 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-14T18:06:19.497 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:06:19 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T18:06:19.497 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:06:19 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-14T18:06:19.498 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:06:19 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:06:19.516 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:06:19 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:06:19.516 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:06:19 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:06:19.516 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:06:19 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-14T18:06:19.516 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:06:19 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T18:06:19.516 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:06:19 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-14T18:06:19.516 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:06:19 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:06:19.638 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:06:19 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:06:19.638 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:06:19 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:06:19.638 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:06:19 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-14T18:06:19.638 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:06:19 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T18:06:19.639 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:06:19 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-14T18:06:19.639 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:06:19 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:06:19.767 INFO:journalctl@ceph.mgr.y.smithi172.stdout:Jul 14 18:06:19 smithi172 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-mgr-y[99435]: 2023-07-14T18:06:19.464+0000 7f1664efd200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-07-14T18:06:19.916 INFO:journalctl@ceph.mgr.z.smithi184.stdout:Jul 14 18:06:19 smithi184 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-mgr-z[100539]: 2023-07-14T18:06:19.605+0000 7f609aa19200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-07-14T18:06:20.273 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:06:20.241+0000 7f1bbdffb700 1 -- 172.21.15.163:0/1287296054 <== mon.0 v2:172.21.15.163:3300/0 7 ==== mgrmap(e 14) v1 ==== 90600+0+0 (secure 0 0 0) 0x7f1bb4016bf0 con 0x7f1bc00febd0 2023-07-14T18:06:20.517 INFO:journalctl@ceph.mgr.y.smithi172.stdout:Jul 14 18:06:20 smithi172 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-mgr-y[99435]: 2023-07-14T18:06:20.168+0000 7f1664efd200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-07-14T18:06:20.517 INFO:journalctl@ceph.mgr.y.smithi172.stdout:Jul 14 18:06:20 smithi172 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-mgr-y[99435]: 2023-07-14T18:06:20.300+0000 7f1664efd200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-07-14T18:06:20.518 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:06:20 smithi172 ceph-mon[97983]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-14T18:06:20.518 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:06:20 smithi172 ceph-mon[97983]: Standby manager daemon z started 2023-07-14T18:06:20.519 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:06:20 smithi172 ceph-mon[97983]: from='mgr.? 172.21.15.184:0/3089134264' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2023-07-14T18:06:20.519 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:06:20 smithi172 ceph-mon[97983]: from='mgr.? 172.21.15.184:0/3089134264' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2023-07-14T18:06:20.519 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:06:20 smithi172 ceph-mon[97983]: from='mgr.? 172.21.15.184:0/3089134264' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2023-07-14T18:06:20.520 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:06:20 smithi172 ceph-mon[97983]: from='mgr.? 172.21.15.184:0/3089134264' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2023-07-14T18:06:20.520 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:06:20 smithi172 ceph-mon[97983]: from='client.? 172.21.15.163:0/3475849534' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e6490568-046d-43ef-bb07-d79fb884b276"}]: dispatch 2023-07-14T18:06:20.520 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:06:20 smithi172 ceph-mon[97983]: from='client.? 172.21.15.163:0/3475849534' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "e6490568-046d-43ef-bb07-d79fb884b276"}]': finished 2023-07-14T18:06:20.520 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:06:20 smithi172 ceph-mon[97983]: osdmap e5: 1 total, 0 up, 1 in 2023-07-14T18:06:20.521 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:06:20 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-07-14T18:06:20.666 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:06:20 smithi184 ceph-mon[98481]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-14T18:06:20.666 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:06:20 smithi184 ceph-mon[98481]: Standby manager daemon z started 2023-07-14T18:06:20.667 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:06:20 smithi184 ceph-mon[98481]: from='mgr.? 172.21.15.184:0/3089134264' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2023-07-14T18:06:20.667 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:06:20 smithi184 ceph-mon[98481]: from='mgr.? 172.21.15.184:0/3089134264' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2023-07-14T18:06:20.667 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:06:20 smithi184 ceph-mon[98481]: from='mgr.? 172.21.15.184:0/3089134264' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2023-07-14T18:06:20.667 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:06:20 smithi184 ceph-mon[98481]: from='mgr.? 172.21.15.184:0/3089134264' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2023-07-14T18:06:20.667 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:06:20 smithi184 ceph-mon[98481]: from='client.? 172.21.15.163:0/3475849534' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e6490568-046d-43ef-bb07-d79fb884b276"}]: dispatch 2023-07-14T18:06:20.667 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:06:20 smithi184 ceph-mon[98481]: from='client.? 172.21.15.163:0/3475849534' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "e6490568-046d-43ef-bb07-d79fb884b276"}]': finished 2023-07-14T18:06:20.667 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:06:20 smithi184 ceph-mon[98481]: osdmap e5: 1 total, 0 up, 1 in 2023-07-14T18:06:20.668 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:06:20 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-07-14T18:06:20.709 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:06:20 smithi163 ceph-mon[96576]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-14T18:06:20.709 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:06:20 smithi163 ceph-mon[96576]: Standby manager daemon z started 2023-07-14T18:06:20.709 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:06:20 smithi163 ceph-mon[96576]: from='mgr.? 172.21.15.184:0/3089134264' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2023-07-14T18:06:20.709 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:06:20 smithi163 ceph-mon[96576]: from='mgr.? 172.21.15.184:0/3089134264' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2023-07-14T18:06:20.709 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:06:20 smithi163 ceph-mon[96576]: from='mgr.? 172.21.15.184:0/3089134264' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2023-07-14T18:06:20.710 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:06:20 smithi163 ceph-mon[96576]: from='mgr.? 172.21.15.184:0/3089134264' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2023-07-14T18:06:20.710 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:06:20 smithi163 ceph-mon[96576]: from='client.? 172.21.15.163:0/3475849534' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e6490568-046d-43ef-bb07-d79fb884b276"}]: dispatch 2023-07-14T18:06:20.710 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:06:20 smithi163 ceph-mon[96576]: from='client.? 172.21.15.163:0/3475849534' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "e6490568-046d-43ef-bb07-d79fb884b276"}]': finished 2023-07-14T18:06:20.710 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:06:20 smithi163 ceph-mon[96576]: osdmap e5: 1 total, 0 up, 1 in 2023-07-14T18:06:20.710 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:06:20 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-07-14T18:06:20.851 INFO:journalctl@ceph.mgr.y.smithi172.stdout:Jul 14 18:06:20 smithi172 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-mgr-y[99435]: 2023-07-14T18:06:20.490+0000 7f1664efd200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-07-14T18:06:20.851 INFO:journalctl@ceph.mgr.y.smithi172.stdout:Jul 14 18:06:20 smithi172 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-mgr-y[99435]: 2023-07-14T18:06:20.604+0000 7f1664efd200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-07-14T18:06:21.267 INFO:journalctl@ceph.mgr.y.smithi172.stdout:Jul 14 18:06:20 smithi172 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-mgr-y[99435]: 2023-07-14T18:06:20.818+0000 7f1664efd200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-07-14T18:06:21.666 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:06:21 smithi184 ceph-mon[98481]: mgrmap e14: x(active, since 64s), standbys: z 2023-07-14T18:06:21.666 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:06:21 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2023-07-14T18:06:21.667 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:06:21 smithi184 ceph-mon[98481]: from='client.? 172.21.15.163:0/1674093579' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-07-14T18:06:21.705 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:06:21 smithi172 ceph-mon[97983]: mgrmap e14: x(active, since 64s), standbys: z 2023-07-14T18:06:21.705 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:06:21 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2023-07-14T18:06:21.706 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:06:21 smithi172 ceph-mon[97983]: from='client.? 172.21.15.163:0/1674093579' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-07-14T18:06:21.708 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:06:21 smithi163 ceph-mon[96576]: mgrmap e14: x(active, since 64s), standbys: z 2023-07-14T18:06:21.709 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:06:21 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2023-07-14T18:06:21.709 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:06:21 smithi163 ceph-mon[96576]: from='client.? 172.21.15.163:0/1674093579' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-07-14T18:06:22.017 INFO:journalctl@ceph.mgr.y.smithi172.stdout:Jul 14 18:06:21 smithi172 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-mgr-y[99435]: 2023-07-14T18:06:21.672+0000 7f1664efd200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-07-14T18:06:22.281 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:06:22.250+0000 7f1bbdffb700 1 -- 172.21.15.163:0/1287296054 <== mon.0 v2:172.21.15.163:3300/0 8 ==== mgrmap(e 15) v1 ==== 135660+0+0 (secure 0 0 0) 0x7f1bb4010e20 con 0x7f1bc00febd0 2023-07-14T18:06:22.666 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:06:22 smithi184 ceph-mon[98481]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-14T18:06:22.666 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:06:22 smithi184 ceph-mon[98481]: Standby manager daemon y started 2023-07-14T18:06:22.667 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:06:22 smithi184 ceph-mon[98481]: from='mgr.? 172.21.15.172:0/3256072103' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2023-07-14T18:06:22.667 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:06:22 smithi184 ceph-mon[98481]: from='mgr.? 172.21.15.172:0/3256072103' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2023-07-14T18:06:22.667 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:06:22 smithi184 ceph-mon[98481]: from='mgr.? 172.21.15.172:0/3256072103' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2023-07-14T18:06:22.667 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:06:22 smithi184 ceph-mon[98481]: from='mgr.? 172.21.15.172:0/3256072103' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2023-07-14T18:06:22.709 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:06:22 smithi163 ceph-mon[96576]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-14T18:06:22.709 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:06:22 smithi163 ceph-mon[96576]: Standby manager daemon y started 2023-07-14T18:06:22.709 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:06:22 smithi163 ceph-mon[96576]: from='mgr.? 172.21.15.172:0/3256072103' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2023-07-14T18:06:22.709 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:06:22 smithi163 ceph-mon[96576]: from='mgr.? 172.21.15.172:0/3256072103' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2023-07-14T18:06:22.709 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:06:22 smithi163 ceph-mon[96576]: from='mgr.? 172.21.15.172:0/3256072103' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2023-07-14T18:06:22.709 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:06:22 smithi163 ceph-mon[96576]: from='mgr.? 172.21.15.172:0/3256072103' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2023-07-14T18:06:22.767 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:06:22 smithi172 ceph-mon[97983]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-14T18:06:22.767 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:06:22 smithi172 ceph-mon[97983]: Standby manager daemon y started 2023-07-14T18:06:22.768 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:06:22 smithi172 ceph-mon[97983]: from='mgr.? 172.21.15.172:0/3256072103' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2023-07-14T18:06:22.768 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:06:22 smithi172 ceph-mon[97983]: from='mgr.? 172.21.15.172:0/3256072103' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2023-07-14T18:06:22.768 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:06:22 smithi172 ceph-mon[97983]: from='mgr.? 172.21.15.172:0/3256072103' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2023-07-14T18:06:22.768 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:06:22 smithi172 ceph-mon[97983]: from='mgr.? 172.21.15.172:0/3256072103' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2023-07-14T18:06:23.666 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:06:23 smithi184 ceph-mon[98481]: mgrmap e15: x(active, since 66s), standbys: z, y 2023-07-14T18:06:23.666 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:06:23 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2023-07-14T18:06:23.709 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:06:23 smithi163 ceph-mon[96576]: mgrmap e15: x(active, since 66s), standbys: z, y 2023-07-14T18:06:23.709 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:06:23 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2023-07-14T18:06:23.767 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:06:23 smithi172 ceph-mon[97983]: mgrmap e15: x(active, since 66s), standbys: z, y 2023-07-14T18:06:23.767 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:06:23 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2023-07-14T18:06:24.666 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:06:24 smithi184 ceph-mon[98481]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-14T18:06:24.709 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:06:24 smithi163 ceph-mon[96576]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-14T18:06:24.767 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:06:24 smithi172 ceph-mon[97983]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-14T18:06:27.017 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:06:26 smithi172 ceph-mon[97983]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-14T18:06:27.166 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:06:26 smithi184 ceph-mon[98481]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-14T18:06:27.209 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:06:26 smithi163 ceph-mon[96576]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-14T18:06:27.959 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:06:27 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2023-07-14T18:06:27.959 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:06:27 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T18:06:28.017 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:06:27 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2023-07-14T18:06:28.017 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:06:27 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T18:06:28.166 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:06:27 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2023-07-14T18:06:28.167 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:06:27 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T18:06:28.903 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:06:28 smithi163 ceph-mon[96576]: Deploying daemon osd.0 on smithi163 2023-07-14T18:06:28.904 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:06:28 smithi163 ceph-mon[96576]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-14T18:06:29.017 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:06:28 smithi172 ceph-mon[97983]: Deploying daemon osd.0 on smithi163 2023-07-14T18:06:29.017 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:06:28 smithi172 ceph-mon[97983]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-14T18:06:29.166 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:06:28 smithi184 ceph-mon[98481]: Deploying daemon osd.0 on smithi163 2023-07-14T18:06:29.167 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:06:28 smithi184 ceph-mon[98481]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-14T18:06:31.001 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:06:30 smithi163 ceph-mon[96576]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-14T18:06:31.017 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:06:30 smithi172 ceph-mon[97983]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-14T18:06:31.166 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:06:30 smithi184 ceph-mon[98481]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-14T18:06:32.209 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:06:32 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:06:32.209 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:06:32 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:06:32.210 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:06:32 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-14T18:06:32.210 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:06:32 smithi163 ceph-mon[96576]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-14T18:06:32.416 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:06:32 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:06:32.417 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:06:32 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:06:32.417 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:06:32 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-14T18:06:32.417 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:06:32 smithi184 ceph-mon[98481]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-14T18:06:32.517 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:06:32 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:06:32.518 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:06:32 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:06:32.518 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:06:32 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-14T18:06:32.518 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:06:32 smithi172 ceph-mon[97983]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-14T18:06:34.033 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:06:34.000+0000 7f1bbdffb700 1 -- 172.21.15.163:0/1287296054 <== mgr.14152 v2:172.21.15.163:6800/1949590926 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f1bc0060a80 con 0x7f1bb00389e0 2023-07-14T18:06:34.034 INFO:teuthology.orchestra.run.smithi163.stdout:Created osd(s) 0 on host 'smithi163' 2023-07-14T18:06:34.036 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:06:34.003+0000 7f1bc6d9f700 1 -- 172.21.15.163:0/1287296054 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f1bb00389e0 msgr2=0x7f1bb003ae90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:06:34.036 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:06:34.003+0000 7f1bc6d9f700 1 --2- 172.21.15.163:0/1287296054 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f1bb00389e0 0x7f1bb003ae90 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f1bac006010 tx=0x7f1bac005960 comp rx=0 tx=0).stop 2023-07-14T18:06:34.037 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:06:34.003+0000 7f1bc6d9f700 1 -- 172.21.15.163:0/1287296054 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f1bc00febd0 msgr2=0x7f1bc0194810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:06:34.037 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:06:34.003+0000 7f1bc6d9f700 1 --2- 172.21.15.163:0/1287296054 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f1bc00febd0 0x7f1bc0194810 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f1bb400e9d0 tx=0x7f1bb400ece0 comp rx=0 tx=0).stop 2023-07-14T18:06:34.037 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:06:34.003+0000 7f1bc6d9f700 1 -- 172.21.15.163:0/1287296054 shutdown_connections 2023-07-14T18:06:34.038 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:06:34.003+0000 7f1bc6d9f700 1 --2- 172.21.15.163:0/1287296054 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f1bb00389e0 0x7f1bb003ae90 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:06:34.038 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:06:34.003+0000 7f1bc6d9f700 1 --2- 172.21.15.163:0/1287296054 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1bc0100820 0x7f1bc019bdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:06:34.038 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:06:34.003+0000 7f1bc6d9f700 1 --2- 172.21.15.163:0/1287296054 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f1bc00febd0 0x7f1bc0194810 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:06:34.038 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:06:34.003+0000 7f1bc6d9f700 1 --2- 172.21.15.163:0/1287296054 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1bc00ffe70 0x7f1bc0194d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:06:34.039 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:06:34.003+0000 7f1bc6d9f700 1 -- 172.21.15.163:0/1287296054 >> 172.21.15.163:0/1287296054 conn(0x7f1bc00fa240 msgr2=0x7f1bc00fc540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:06:34.039 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:06:34.003+0000 7f1bc6d9f700 1 -- 172.21.15.163:0/1287296054 shutdown_connections 2023-07-14T18:06:34.039 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:06:34.003+0000 7f1bc6d9f700 1 -- 172.21.15.163:0/1287296054 wait complete. 2023-07-14T18:06:34.386 DEBUG:teuthology.orchestra.run.smithi163:osd.0> sudo journalctl -f -n 0 -u ceph-bf7326ec-2270-11ee-9b33-001a4aab830c@osd.0.service 2023-07-14T18:06:34.388 INFO:tasks.cephadm:Deploying osd.1 on smithi172 with /dev/vg_nvme/lv_4... 2023-07-14T18:06:34.389 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81c9387d2e7576da065747ec9c16d1c7d69016ec shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bf7326ec-2270-11ee-9b33-001a4aab830c -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2023-07-14T18:06:34.417 INFO:journalctl@ceph.osd.0.smithi163.stdout:-- Logs begin at Fri 2023-07-14 17:46:25 UTC. -- 2023-07-14T18:06:34.709 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:06:34 smithi163 ceph-mon[96576]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-14T18:06:34.709 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:06:34 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:06:34.709 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:06:34 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:06:34.710 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:06:34 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T18:06:34.710 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:06:34 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-14T18:06:34.710 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:06:34 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:06:34.710 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:06:34 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:06:34.710 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:06:34 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:06:34.710 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:06:34 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-14T18:06:34.767 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:06:34 smithi172 ceph-mon[97983]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-14T18:06:34.768 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:06:34 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:06:34.768 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:06:34 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:06:34.768 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:06:34 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T18:06:34.768 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:06:34 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-14T18:06:34.768 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:06:34 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:06:34.768 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:06:34 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:06:34.769 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:06:34 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:06:34.769 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:06:34 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-14T18:06:34.916 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:06:34 smithi184 ceph-mon[98481]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-14T18:06:34.917 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:06:34 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:06:34.917 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:06:34 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:06:34.917 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:06:34 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T18:06:34.917 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:06:34 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-14T18:06:34.917 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:06:34 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:06:34.917 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:06:34 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:06:34.917 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:06:34 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:06:34.918 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:06:34 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-14T18:06:34.951 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/bf7326ec-2270-11ee-9b33-001a4aab830c/mon.b/config 2023-07-14T18:06:35.154 INFO:journalctl@ceph.osd.0.smithi163.stdout:Jul 14 18:06:35 smithi163 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-0[109611]: 2023-07-14T18:06:35.023+0000 7f19826d6640 -1 osd.0 0 log_to_monitors true 2023-07-14T18:06:35.768 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:06:35 smithi172 ceph-mon[97983]: from='osd.0 [v2:172.21.15.163:6802/3124653025,v1:172.21.15.163:6803/3124653025]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2023-07-14T18:06:35.916 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:06:35 smithi184 ceph-mon[98481]: from='osd.0 [v2:172.21.15.163:6802/3124653025,v1:172.21.15.163:6803/3124653025]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2023-07-14T18:06:35.959 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:06:35 smithi163 ceph-mon[96576]: from='osd.0 [v2:172.21.15.163:6802/3124653025,v1:172.21.15.163:6803/3124653025]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2023-07-14T18:06:36.447 INFO:teuthology.orchestra.run.smithi172.stderr:--> Zapping: /dev/vg_nvme/lv_4 2023-07-14T18:06:36.448 INFO:teuthology.orchestra.run.smithi172.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2023-07-14T18:06:36.448 INFO:teuthology.orchestra.run.smithi172.stderr: stderr: 10+0 records in 2023-07-14T18:06:36.448 INFO:teuthology.orchestra.run.smithi172.stderr:10+0 records out 2023-07-14T18:06:36.448 INFO:teuthology.orchestra.run.smithi172.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0110121 s, 952 MB/s 2023-07-14T18:06:36.448 INFO:teuthology.orchestra.run.smithi172.stderr: stderr: 2023-07-14T18:06:36.448 INFO:teuthology.orchestra.run.smithi172.stderr:--> Zapping successful for: 2023-07-14T18:06:36.767 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:06:36 smithi172 ceph-mon[97983]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-14T18:06:36.768 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:06:36 smithi172 ceph-mon[97983]: from='osd.0 [v2:172.21.15.163:6802/3124653025,v1:172.21.15.163:6803/3124653025]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2023-07-14T18:06:36.768 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:06:36 smithi172 ceph-mon[97983]: osdmap e6: 1 total, 0 up, 1 in 2023-07-14T18:06:36.768 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:06:36 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-07-14T18:06:36.768 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:06:36 smithi172 ceph-mon[97983]: from='osd.0 [v2:172.21.15.163:6802/3124653025,v1:172.21.15.163:6803/3124653025]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi163", "root=default"]}]: dispatch 2023-07-14T18:06:36.768 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:06:36 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:06:36.768 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:06:36 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:06:36.769 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:06:36 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-07-14T18:06:36.769 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:06:36 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:06:36.769 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:06:36 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T18:06:36.769 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:06:36 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-14T18:06:36.895 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81c9387d2e7576da065747ec9c16d1c7d69016ec shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bf7326ec-2270-11ee-9b33-001a4aab830c -- ceph orch daemon add osd smithi172:vg_nvme/lv_4 2023-07-14T18:06:36.916 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:06:36 smithi184 ceph-mon[98481]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-14T18:06:36.917 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:06:36 smithi184 ceph-mon[98481]: from='osd.0 [v2:172.21.15.163:6802/3124653025,v1:172.21.15.163:6803/3124653025]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2023-07-14T18:06:36.917 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:06:36 smithi184 ceph-mon[98481]: osdmap e6: 1 total, 0 up, 1 in 2023-07-14T18:06:36.917 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:06:36 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-07-14T18:06:36.917 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:06:36 smithi184 ceph-mon[98481]: from='osd.0 [v2:172.21.15.163:6802/3124653025,v1:172.21.15.163:6803/3124653025]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi163", "root=default"]}]: dispatch 2023-07-14T18:06:36.917 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:06:36 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:06:36.917 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:06:36 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:06:36.918 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:06:36 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-07-14T18:06:36.918 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:06:36 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:06:36.918 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:06:36 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T18:06:36.918 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:06:36 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-14T18:06:36.959 INFO:journalctl@ceph.osd.0.smithi163.stdout:Jul 14 18:06:36 smithi163 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-0[109611]: 2023-07-14T18:06:36.571+0000 7f1977d4e700 -1 osd.0 0 waiting for initial osdmap 2023-07-14T18:06:36.959 INFO:journalctl@ceph.osd.0.smithi163.stdout:Jul 14 18:06:36 smithi163 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-0[109611]: 2023-07-14T18:06:36.574+0000 7f1971b40700 -1 osd.0 7 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-07-14T18:06:36.960 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:06:36 smithi163 ceph-mon[96576]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-14T18:06:36.960 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:06:36 smithi163 ceph-mon[96576]: from='osd.0 [v2:172.21.15.163:6802/3124653025,v1:172.21.15.163:6803/3124653025]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2023-07-14T18:06:36.960 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:06:36 smithi163 ceph-mon[96576]: osdmap e6: 1 total, 0 up, 1 in 2023-07-14T18:06:36.960 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:06:36 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-07-14T18:06:36.960 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:06:36 smithi163 ceph-mon[96576]: from='osd.0 [v2:172.21.15.163:6802/3124653025,v1:172.21.15.163:6803/3124653025]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi163", "root=default"]}]: dispatch 2023-07-14T18:06:36.960 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:06:36 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:06:36.960 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:06:36 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:06:36.961 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:06:36 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-07-14T18:06:36.961 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:06:36 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:06:36.961 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:06:36 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T18:06:36.961 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:06:36 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-14T18:06:37.443 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/bf7326ec-2270-11ee-9b33-001a4aab830c/mon.b/config 2023-07-14T18:06:37.917 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:06:37 smithi184 ceph-mon[98481]: Detected new or changed devices on smithi163 2023-07-14T18:06:37.917 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:06:37 smithi184 ceph-mon[98481]: Adjusting osd_memory_target on smithi163 to 17168M 2023-07-14T18:06:37.917 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:06:37 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:06:37.918 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:06:37 smithi184 ceph-mon[98481]: from='osd.0 [v2:172.21.15.163:6802/3124653025,v1:172.21.15.163:6803/3124653025]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi163", "root=default"]}]': finished 2023-07-14T18:06:37.918 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:06:37 smithi184 ceph-mon[98481]: osdmap e7: 1 total, 0 up, 1 in 2023-07-14T18:06:37.918 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:06:37 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-07-14T18:06:37.918 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:06:37 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-07-14T18:06:37.959 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:06:37 smithi163 ceph-mon[96576]: Detected new or changed devices on smithi163 2023-07-14T18:06:37.959 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:06:37 smithi163 ceph-mon[96576]: Adjusting osd_memory_target on smithi163 to 17168M 2023-07-14T18:06:37.960 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:06:37 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:06:37.960 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:06:37 smithi163 ceph-mon[96576]: from='osd.0 [v2:172.21.15.163:6802/3124653025,v1:172.21.15.163:6803/3124653025]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi163", "root=default"]}]': finished 2023-07-14T18:06:37.960 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:06:37 smithi163 ceph-mon[96576]: osdmap e7: 1 total, 0 up, 1 in 2023-07-14T18:06:37.960 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:06:37 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-07-14T18:06:37.960 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:06:37 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-07-14T18:06:37.978 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:06:37 smithi172 ceph-mon[97983]: Detected new or changed devices on smithi163 2023-07-14T18:06:37.978 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:06:37 smithi172 ceph-mon[97983]: Adjusting osd_memory_target on smithi163 to 17168M 2023-07-14T18:06:37.978 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:06:37 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:06:37.978 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:06:37 smithi172 ceph-mon[97983]: from='osd.0 [v2:172.21.15.163:6802/3124653025,v1:172.21.15.163:6803/3124653025]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi163", "root=default"]}]': finished 2023-07-14T18:06:37.979 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:06:37 smithi172 ceph-mon[97983]: osdmap e7: 1 total, 0 up, 1 in 2023-07-14T18:06:37.979 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:06:37 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-07-14T18:06:37.979 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:06:37 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-07-14T18:06:38.673 INFO:teuthology.orchestra.run.smithi172.stderr:2023-07-14T18:06:38.641+0000 7f96aa26b700 1 -- 172.21.15.172:0/2335387866 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f96a4103060 msgr2=0x7f96a4105440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:06:38.673 INFO:teuthology.orchestra.run.smithi172.stderr:2023-07-14T18:06:38.641+0000 7f96aa26b700 1 --2- 172.21.15.172:0/2335387866 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f96a4103060 0x7f96a4105440 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f9694009990 tx=0x7f9694009ca0 comp rx=0 tx=0).stop 2023-07-14T18:06:38.673 INFO:teuthology.orchestra.run.smithi172.stderr:2023-07-14T18:06:38.641+0000 7f96aa26b700 1 -- 172.21.15.172:0/2335387866 shutdown_connections 2023-07-14T18:06:38.674 INFO:teuthology.orchestra.run.smithi172.stderr:2023-07-14T18:06:38.641+0000 7f96aa26b700 1 --2- 172.21.15.172:0/2335387866 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f96a4100740 0x7f96a4102b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:06:38.674 INFO:teuthology.orchestra.run.smithi172.stderr:2023-07-14T18:06:38.641+0000 7f96aa26b700 1 --2- 172.21.15.172:0/2335387866 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f96a4105980 0x7f96a4107de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:06:38.674 INFO:teuthology.orchestra.run.smithi172.stderr:2023-07-14T18:06:38.641+0000 7f96aa26b700 1 --2- 172.21.15.172:0/2335387866 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f96a4103060 0x7f96a4105440 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:06:38.674 INFO:teuthology.orchestra.run.smithi172.stderr:2023-07-14T18:06:38.641+0000 7f96aa26b700 1 -- 172.21.15.172:0/2335387866 >> 172.21.15.172:0/2335387866 conn(0x7f96a40fa1e0 msgr2=0x7f96a40fc630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:06:38.674 INFO:teuthology.orchestra.run.smithi172.stderr:2023-07-14T18:06:38.641+0000 7f96aa26b700 1 -- 172.21.15.172:0/2335387866 shutdown_connections 2023-07-14T18:06:38.674 INFO:teuthology.orchestra.run.smithi172.stderr:2023-07-14T18:06:38.641+0000 7f96aa26b700 1 -- 172.21.15.172:0/2335387866 wait complete. 2023-07-14T18:06:38.676 INFO:teuthology.orchestra.run.smithi172.stderr:2023-07-14T18:06:38.641+0000 7f96aa26b700 1 Processor -- start 2023-07-14T18:06:38.676 INFO:teuthology.orchestra.run.smithi172.stderr:2023-07-14T18:06:38.641+0000 7f96aa26b700 1 -- start start 2023-07-14T18:06:38.676 INFO:teuthology.orchestra.run.smithi172.stderr:2023-07-14T18:06:38.642+0000 7f96aa26b700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f96a4100740 0x7f96a4195950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:06:38.676 INFO:teuthology.orchestra.run.smithi172.stderr:2023-07-14T18:06:38.642+0000 7f96aa26b700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f96a4103060 0x7f96a4195e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:06:38.676 INFO:teuthology.orchestra.run.smithi172.stderr:2023-07-14T18:06:38.642+0000 7f96aa26b700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f96a4105980 0x7f96a419cf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:06:38.676 INFO:teuthology.orchestra.run.smithi172.stderr:2023-07-14T18:06:38.642+0000 7f96aa26b700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96a419d4e0 con 0x7f96a4100740 2023-07-14T18:06:38.677 INFO:teuthology.orchestra.run.smithi172.stderr:2023-07-14T18:06:38.642+0000 7f96aa26b700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96a419d620 con 0x7f96a4105980 2023-07-14T18:06:38.677 INFO:teuthology.orchestra.run.smithi172.stderr:2023-07-14T18:06:38.642+0000 7f96aa26b700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96a419d7b0 con 0x7f96a4103060 2023-07-14T18:06:38.677 INFO:teuthology.orchestra.run.smithi172.stderr:2023-07-14T18:06:38.642+0000 7f96a8808700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f96a4105980 0x7f96a419cf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:06:38.677 INFO:teuthology.orchestra.run.smithi172.stderr:2023-07-14T18:06:38.642+0000 7f96a8808700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f96a4105980 0x7f96a419cf10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:34336/0 (socket says 172.21.15.172:34336) 2023-07-14T18:06:38.677 INFO:teuthology.orchestra.run.smithi172.stderr:2023-07-14T18:06:38.642+0000 7f96a8808700 1 -- 172.21.15.172:0/1299702750 learned_addr learned my addr 172.21.15.172:0/1299702750 (peer_addr_for_me v2:172.21.15.172:0/0) 2023-07-14T18:06:38.677 INFO:teuthology.orchestra.run.smithi172.stderr:2023-07-14T18:06:38.642+0000 7f96a3fff700 1 --2- 172.21.15.172:0/1299702750 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f96a4100740 0x7f96a4195950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:06:38.677 INFO:teuthology.orchestra.run.smithi172.stderr:2023-07-14T18:06:38.642+0000 7f96a37fe700 1 --2- 172.21.15.172:0/1299702750 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f96a4103060 0x7f96a4195e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:06:38.678 INFO:teuthology.orchestra.run.smithi172.stderr:2023-07-14T18:06:38.642+0000 7f96a8808700 1 -- 172.21.15.172:0/1299702750 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f96a4103060 msgr2=0x7f96a4195e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:06:38.678 INFO:teuthology.orchestra.run.smithi172.stderr:2023-07-14T18:06:38.642+0000 7f96a8808700 1 --2- 172.21.15.172:0/1299702750 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f96a4103060 0x7f96a4195e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:06:38.678 INFO:teuthology.orchestra.run.smithi172.stderr:2023-07-14T18:06:38.642+0000 7f96a8808700 1 -- 172.21.15.172:0/1299702750 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f96a4100740 msgr2=0x7f96a4195950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:06:38.678 INFO:teuthology.orchestra.run.smithi172.stderr:2023-07-14T18:06:38.642+0000 7f96a8808700 1 --2- 172.21.15.172:0/1299702750 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f96a4100740 0x7f96a4195950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:06:38.678 INFO:teuthology.orchestra.run.smithi172.stderr:2023-07-14T18:06:38.642+0000 7f96a8808700 1 -- 172.21.15.172:0/1299702750 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96940095f0 con 0x7f96a4105980 2023-07-14T18:06:38.678 INFO:teuthology.orchestra.run.smithi172.stderr:2023-07-14T18:06:38.642+0000 7f96a8808700 1 --2- 172.21.15.172:0/1299702750 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f96a4105980 0x7f96a419cf10 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f969c007ec0 tx=0x7f969c00d3b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:06:38.678 INFO:teuthology.orchestra.run.smithi172.stderr:2023-07-14T18:06:38.642+0000 7f96a17fa700 1 -- 172.21.15.172:0/1299702750 <== mon.2 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f969c017070 con 0x7f96a4105980 2023-07-14T18:06:38.678 INFO:teuthology.orchestra.run.smithi172.stderr:2023-07-14T18:06:38.642+0000 7f96aa26b700 1 -- 172.21.15.172:0/1299702750 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f96a419da90 con 0x7f96a4105980 2023-07-14T18:06:38.679 INFO:teuthology.orchestra.run.smithi172.stderr:2023-07-14T18:06:38.642+0000 7f96a17fa700 1 -- 172.21.15.172:0/1299702750 <== mon.2 v2:172.21.15.172:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f969c00f040 con 0x7f96a4105980 2023-07-14T18:06:38.679 INFO:teuthology.orchestra.run.smithi172.stderr:2023-07-14T18:06:38.642+0000 7f96a17fa700 1 -- 172.21.15.172:0/1299702750 <== mon.2 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f969c004280 con 0x7f96a4105980 2023-07-14T18:06:38.679 INFO:teuthology.orchestra.run.smithi172.stderr:2023-07-14T18:06:38.642+0000 7f96aa26b700 1 -- 172.21.15.172:0/1299702750 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f96a419df40 con 0x7f96a4105980 2023-07-14T18:06:38.679 INFO:teuthology.orchestra.run.smithi172.stderr:2023-07-14T18:06:38.643+0000 7f96aa26b700 1 -- 172.21.15.172:0/1299702750 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f96a40fbd50 con 0x7f96a4105980 2023-07-14T18:06:38.680 INFO:teuthology.orchestra.run.smithi172.stderr:2023-07-14T18:06:38.644+0000 7f96a17fa700 1 -- 172.21.15.172:0/1299702750 <== mon.2 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 15) v1 ==== 135660+0+0 (secure 0 0 0) 0x7f969c004ad0 con 0x7f96a4105980 2023-07-14T18:06:38.680 INFO:teuthology.orchestra.run.smithi172.stderr:2023-07-14T18:06:38.645+0000 7f96a17fa700 1 --2- 172.21.15.172:0/1299702750 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f96900a10c0 0x7f96900a3570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:06:38.680 INFO:teuthology.orchestra.run.smithi172.stderr:2023-07-14T18:06:38.645+0000 7f96a17fa700 1 -- 172.21.15.172:0/1299702750 <== mon.2 v2:172.21.15.172:3300/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 1767+0+0 (secure 0 0 0) 0x7f969c0caab0 con 0x7f96a4105980 2023-07-14T18:06:38.681 INFO:teuthology.orchestra.run.smithi172.stderr:2023-07-14T18:06:38.645+0000 7f96a3fff700 1 --2- 172.21.15.172:0/1299702750 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f96900a10c0 0x7f96900a3570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:06:38.681 INFO:teuthology.orchestra.run.smithi172.stderr:2023-07-14T18:06:38.646+0000 7f96a3fff700 1 --2- 172.21.15.172:0/1299702750 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f96900a10c0 0x7f96900a3570 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f968c005950 tx=0x7f968c005eb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:06:38.681 INFO:teuthology.orchestra.run.smithi172.stderr:2023-07-14T18:06:38.648+0000 7f96a17fa700 1 -- 172.21.15.172:0/1299702750 <== mon.2 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178025 (secure 0 0 0) 0x7f969c095d00 con 0x7f96a4105980 2023-07-14T18:06:38.767 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:06:38 smithi172 ceph-mon[97983]: purged_snaps scrub starts 2023-07-14T18:06:38.768 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:06:38 smithi172 ceph-mon[97983]: purged_snaps scrub ok 2023-07-14T18:06:38.768 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:06:38 smithi172 ceph-mon[97983]: pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-14T18:06:38.768 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:06:38 smithi172 ceph-mon[97983]: osd.0 [v2:172.21.15.163:6802/3124653025,v1:172.21.15.163:6803/3124653025] boot 2023-07-14T18:06:38.768 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:06:38 smithi172 ceph-mon[97983]: osdmap e8: 1 total, 1 up, 1 in 2023-07-14T18:06:38.768 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:06:38 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-07-14T18:06:38.873 INFO:teuthology.orchestra.run.smithi172.stderr:2023-07-14T18:06:38.841+0000 7f96aa26b700 1 -- 172.21.15.172:0/1299702750 --> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi172:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) v1 -- 0x7f96a4060a80 con 0x7f96900a10c0 2023-07-14T18:06:38.917 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:06:38 smithi184 ceph-mon[98481]: purged_snaps scrub starts 2023-07-14T18:06:38.917 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:06:38 smithi184 ceph-mon[98481]: purged_snaps scrub ok 2023-07-14T18:06:38.917 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:06:38 smithi184 ceph-mon[98481]: pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-14T18:06:38.918 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:06:38 smithi184 ceph-mon[98481]: osd.0 [v2:172.21.15.163:6802/3124653025,v1:172.21.15.163:6803/3124653025] boot 2023-07-14T18:06:38.918 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:06:38 smithi184 ceph-mon[98481]: osdmap e8: 1 total, 1 up, 1 in 2023-07-14T18:06:38.918 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:06:38 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-07-14T18:06:38.959 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:06:38 smithi163 ceph-mon[96576]: purged_snaps scrub starts 2023-07-14T18:06:38.959 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:06:38 smithi163 ceph-mon[96576]: purged_snaps scrub ok 2023-07-14T18:06:38.960 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:06:38 smithi163 ceph-mon[96576]: pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-14T18:06:38.960 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:06:38 smithi163 ceph-mon[96576]: osd.0 [v2:172.21.15.163:6802/3124653025,v1:172.21.15.163:6803/3124653025] boot 2023-07-14T18:06:38.960 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:06:38 smithi163 ceph-mon[96576]: osdmap e8: 1 total, 1 up, 1 in 2023-07-14T18:06:38.960 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:06:38 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-07-14T18:06:39.916 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:06:39 smithi184 ceph-mon[98481]: osdmap e9: 1 total, 1 up, 1 in 2023-07-14T18:06:39.917 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:06:39 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-07-14T18:06:39.917 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:06:39 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-07-14T18:06:39.917 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:06:39 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T18:06:39.959 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:06:39 smithi163 ceph-mon[96576]: osdmap e9: 1 total, 1 up, 1 in 2023-07-14T18:06:39.960 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:06:39 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-07-14T18:06:39.960 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:06:39 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-07-14T18:06:39.960 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:06:39 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T18:06:39.977 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:06:39 smithi172 ceph-mon[97983]: osdmap e9: 1 total, 1 up, 1 in 2023-07-14T18:06:39.978 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:06:39 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-07-14T18:06:39.978 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:06:39 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-07-14T18:06:39.978 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:06:39 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T18:06:40.767 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:06:40 smithi172 ceph-mon[97983]: from='client.24143 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi172:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2023-07-14T18:06:40.768 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:06:40 smithi172 ceph-mon[97983]: pgmap v41: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-07-14T18:06:40.917 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:06:40 smithi184 ceph-mon[98481]: from='client.24143 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi172:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2023-07-14T18:06:40.917 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:06:40 smithi184 ceph-mon[98481]: pgmap v41: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-07-14T18:06:40.959 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:06:40 smithi163 ceph-mon[96576]: from='client.24143 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi172:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2023-07-14T18:06:40.959 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:06:40 smithi163 ceph-mon[96576]: pgmap v41: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-07-14T18:06:42.018 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:06:41 smithi172 ceph-mon[97983]: from='client.? 172.21.15.172:0/2496025888' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "0af39bda-f096-4603-adcc-bf1988f36603"}]: dispatch 2023-07-14T18:06:42.018 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:06:41 smithi172 ceph-mon[97983]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "0af39bda-f096-4603-adcc-bf1988f36603"}]: dispatch 2023-07-14T18:06:42.018 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:06:41 smithi172 ceph-mon[97983]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "0af39bda-f096-4603-adcc-bf1988f36603"}]': finished 2023-07-14T18:06:42.018 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:06:41 smithi172 ceph-mon[97983]: osdmap e10: 2 total, 1 up, 2 in 2023-07-14T18:06:42.018 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:06:41 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-07-14T18:06:42.167 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:06:41 smithi184 ceph-mon[98481]: from='client.? 172.21.15.172:0/2496025888' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "0af39bda-f096-4603-adcc-bf1988f36603"}]: dispatch 2023-07-14T18:06:42.167 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:06:41 smithi184 ceph-mon[98481]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "0af39bda-f096-4603-adcc-bf1988f36603"}]: dispatch 2023-07-14T18:06:42.167 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:06:41 smithi184 ceph-mon[98481]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "0af39bda-f096-4603-adcc-bf1988f36603"}]': finished 2023-07-14T18:06:42.167 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:06:41 smithi184 ceph-mon[98481]: osdmap e10: 2 total, 1 up, 2 in 2023-07-14T18:06:42.168 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:06:41 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-07-14T18:06:42.209 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:06:41 smithi163 ceph-mon[96576]: from='client.? 172.21.15.172:0/2496025888' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "0af39bda-f096-4603-adcc-bf1988f36603"}]: dispatch 2023-07-14T18:06:42.209 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:06:41 smithi163 ceph-mon[96576]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "0af39bda-f096-4603-adcc-bf1988f36603"}]: dispatch 2023-07-14T18:06:42.210 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:06:41 smithi163 ceph-mon[96576]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "0af39bda-f096-4603-adcc-bf1988f36603"}]': finished 2023-07-14T18:06:42.210 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:06:41 smithi163 ceph-mon[96576]: osdmap e10: 2 total, 1 up, 2 in 2023-07-14T18:06:42.210 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:06:41 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-07-14T18:06:43.018 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:06:42 smithi172 ceph-mon[97983]: pgmap v43: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-07-14T18:06:43.018 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:06:42 smithi172 ceph-mon[97983]: from='client.? 172.21.15.172:0/274880274' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-07-14T18:06:43.167 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:06:42 smithi184 ceph-mon[98481]: pgmap v43: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-07-14T18:06:43.167 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:06:42 smithi184 ceph-mon[98481]: from='client.? 172.21.15.172:0/274880274' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-07-14T18:06:43.209 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:06:42 smithi163 ceph-mon[96576]: pgmap v43: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-07-14T18:06:43.210 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:06:42 smithi163 ceph-mon[96576]: from='client.? 172.21.15.172:0/274880274' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-07-14T18:06:45.003 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:06:44 smithi172 ceph-mon[97983]: pgmap v44: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-07-14T18:06:45.167 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:06:44 smithi184 ceph-mon[98481]: pgmap v44: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-07-14T18:06:45.209 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:06:44 smithi163 ceph-mon[96576]: pgmap v44: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-07-14T18:06:47.018 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:06:46 smithi172 ceph-mon[97983]: pgmap v45: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-07-14T18:06:47.167 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:06:46 smithi184 ceph-mon[98481]: pgmap v45: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-07-14T18:06:47.209 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:06:46 smithi163 ceph-mon[96576]: pgmap v45: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-07-14T18:06:48.018 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:06:47 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2023-07-14T18:06:48.018 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:06:47 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T18:06:48.167 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:06:47 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2023-07-14T18:06:48.167 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:06:47 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T18:06:48.209 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:06:47 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2023-07-14T18:06:48.210 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:06:47 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T18:06:49.018 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:06:48 smithi172 ceph-mon[97983]: pgmap v46: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-07-14T18:06:49.018 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:06:48 smithi172 ceph-mon[97983]: Deploying daemon osd.1 on smithi172 2023-07-14T18:06:49.167 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:06:48 smithi184 ceph-mon[98481]: pgmap v46: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-07-14T18:06:49.167 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:06:48 smithi184 ceph-mon[98481]: Deploying daemon osd.1 on smithi172 2023-07-14T18:06:49.209 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:06:48 smithi163 ceph-mon[96576]: pgmap v46: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-07-14T18:06:49.210 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:06:48 smithi163 ceph-mon[96576]: Deploying daemon osd.1 on smithi172 2023-07-14T18:06:51.019 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:06:50 smithi172 ceph-mon[97983]: pgmap v47: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-07-14T18:06:51.167 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:06:50 smithi184 ceph-mon[98481]: pgmap v47: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-07-14T18:06:51.209 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:06:50 smithi163 ceph-mon[96576]: pgmap v47: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-07-14T18:06:53.018 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:06:52 smithi172 ceph-mon[97983]: pgmap v48: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-07-14T18:06:53.018 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:06:52 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:06:53.019 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:06:52 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:06:53.019 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:06:52 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-14T18:06:53.167 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:06:52 smithi184 ceph-mon[98481]: pgmap v48: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-07-14T18:06:53.167 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:06:52 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:06:53.168 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:06:52 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:06:53.168 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:06:52 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-14T18:06:53.209 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:06:52 smithi163 ceph-mon[96576]: pgmap v48: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-07-14T18:06:53.210 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:06:52 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:06:53.210 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:06:52 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:06:53.210 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:06:52 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-14T18:06:55.018 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:06:54 smithi172 ceph-mon[97983]: pgmap v49: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-07-14T18:06:55.018 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:06:54 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:06:55.018 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:06:54 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:06:55.087 INFO:teuthology.orchestra.run.smithi172.stderr:2023-07-14T18:06:55.053+0000 7f96a17fa700 1 -- 172.21.15.172:0/1299702750 <== mgr.14152 v2:172.21.15.163:6800/1949590926 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f96a4060a80 con 0x7f96900a10c0 2023-07-14T18:06:55.087 INFO:teuthology.orchestra.run.smithi172.stdout:Created osd(s) 1 on host 'smithi172' 2023-07-14T18:06:55.089 INFO:teuthology.orchestra.run.smithi172.stderr:2023-07-14T18:06:55.056+0000 7f96aa26b700 1 -- 172.21.15.172:0/1299702750 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f96900a10c0 msgr2=0x7f96900a3570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:06:55.089 INFO:teuthology.orchestra.run.smithi172.stderr:2023-07-14T18:06:55.056+0000 7f96aa26b700 1 --2- 172.21.15.172:0/1299702750 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f96900a10c0 0x7f96900a3570 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f968c005950 tx=0x7f968c005eb0 comp rx=0 tx=0).stop 2023-07-14T18:06:55.090 INFO:teuthology.orchestra.run.smithi172.stderr:2023-07-14T18:06:55.056+0000 7f96aa26b700 1 -- 172.21.15.172:0/1299702750 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f96a4105980 msgr2=0x7f96a419cf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:06:55.090 INFO:teuthology.orchestra.run.smithi172.stderr:2023-07-14T18:06:55.056+0000 7f96aa26b700 1 --2- 172.21.15.172:0/1299702750 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f96a4105980 0x7f96a419cf10 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f969c007ec0 tx=0x7f969c00d3b0 comp rx=0 tx=0).stop 2023-07-14T18:06:55.090 INFO:teuthology.orchestra.run.smithi172.stderr:2023-07-14T18:06:55.056+0000 7f96aa26b700 1 -- 172.21.15.172:0/1299702750 shutdown_connections 2023-07-14T18:06:55.090 INFO:teuthology.orchestra.run.smithi172.stderr:2023-07-14T18:06:55.056+0000 7f96aa26b700 1 --2- 172.21.15.172:0/1299702750 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f96900a10c0 0x7f96900a3570 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:06:55.091 INFO:teuthology.orchestra.run.smithi172.stderr:2023-07-14T18:06:55.056+0000 7f96aa26b700 1 --2- 172.21.15.172:0/1299702750 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f96a4105980 0x7f96a419cf10 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:06:55.091 INFO:teuthology.orchestra.run.smithi172.stderr:2023-07-14T18:06:55.056+0000 7f96aa26b700 1 --2- 172.21.15.172:0/1299702750 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f96a4100740 0x7f96a4195950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:06:55.091 INFO:teuthology.orchestra.run.smithi172.stderr:2023-07-14T18:06:55.056+0000 7f96aa26b700 1 --2- 172.21.15.172:0/1299702750 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f96a4103060 0x7f96a4195e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:06:55.091 INFO:teuthology.orchestra.run.smithi172.stderr:2023-07-14T18:06:55.056+0000 7f96aa26b700 1 -- 172.21.15.172:0/1299702750 >> 172.21.15.172:0/1299702750 conn(0x7f96a40fa1e0 msgr2=0x7f96a41013a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:06:55.091 INFO:teuthology.orchestra.run.smithi172.stderr:2023-07-14T18:06:55.056+0000 7f96aa26b700 1 -- 172.21.15.172:0/1299702750 shutdown_connections 2023-07-14T18:06:55.091 INFO:teuthology.orchestra.run.smithi172.stderr:2023-07-14T18:06:55.056+0000 7f96aa26b700 1 -- 172.21.15.172:0/1299702750 wait complete. 2023-07-14T18:06:55.167 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:06:54 smithi184 ceph-mon[98481]: pgmap v49: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-07-14T18:06:55.167 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:06:54 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:06:55.168 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:06:54 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:06:55.210 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:06:54 smithi163 ceph-mon[96576]: pgmap v49: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-07-14T18:06:55.210 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:06:54 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:06:55.210 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:06:54 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:06:55.524 DEBUG:teuthology.orchestra.run.smithi172:osd.1> sudo journalctl -f -n 0 -u ceph-bf7326ec-2270-11ee-9b33-001a4aab830c@osd.1.service 2023-07-14T18:06:55.526 INFO:tasks.cephadm:Deploying osd.2 on smithi184 with /dev/vg_nvme/lv_4... 2023-07-14T18:06:55.526 DEBUG:teuthology.orchestra.run.smithi184:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81c9387d2e7576da065747ec9c16d1c7d69016ec shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bf7326ec-2270-11ee-9b33-001a4aab830c -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2023-07-14T18:06:55.558 INFO:journalctl@ceph.osd.1.smithi172.stdout:-- Logs begin at Fri 2023-07-14 17:45:52 UTC. -- 2023-07-14T18:06:55.917 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:06:55 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T18:06:55.917 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:06:55 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-14T18:06:55.917 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:06:55 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:06:55.918 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:06:55 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:06:55.918 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:06:55 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:06:55.918 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:06:55 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-14T18:06:56.006 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:06:55 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T18:06:56.006 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:06:55 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-14T18:06:56.006 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:06:55 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:06:56.007 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:06:55 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:06:56.007 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:06:55 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:06:56.007 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:06:55 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-14T18:06:56.087 INFO:teuthology.orchestra.run.smithi184.stderr:Inferring config /var/lib/ceph/bf7326ec-2270-11ee-9b33-001a4aab830c/mon.c/config 2023-07-14T18:06:56.210 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:06:55 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T18:06:56.210 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:06:55 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-14T18:06:56.210 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:06:55 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:06:56.210 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:06:55 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:06:56.210 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:06:55 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:06:56.210 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:06:55 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-14T18:06:56.268 INFO:journalctl@ceph.osd.1.smithi172.stdout:Jul 14 18:06:56 smithi172 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-1[102969]: 2023-07-14T18:06:56.118+0000 7f0d68708640 -1 osd.1 0 log_to_monitors true 2023-07-14T18:06:56.917 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:06:56 smithi184 ceph-mon[98481]: pgmap v50: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-07-14T18:06:56.917 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:06:56 smithi184 ceph-mon[98481]: from='osd.1 [v2:172.21.15.172:6800/3774455900,v1:172.21.15.172:6801/3774455900]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2023-07-14T18:06:56.918 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:06:56 smithi184 ceph-mon[98481]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2023-07-14T18:06:57.018 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:06:56 smithi172 ceph-mon[97983]: pgmap v50: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-07-14T18:06:57.019 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:06:56 smithi172 ceph-mon[97983]: from='osd.1 [v2:172.21.15.172:6800/3774455900,v1:172.21.15.172:6801/3774455900]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2023-07-14T18:06:57.019 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:06:56 smithi172 ceph-mon[97983]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2023-07-14T18:06:57.210 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:06:56 smithi163 ceph-mon[96576]: pgmap v50: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-07-14T18:06:57.210 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:06:56 smithi163 ceph-mon[96576]: from='osd.1 [v2:172.21.15.172:6800/3774455900,v1:172.21.15.172:6801/3774455900]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2023-07-14T18:06:57.210 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:06:56 smithi163 ceph-mon[96576]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2023-07-14T18:06:57.594 INFO:teuthology.orchestra.run.smithi184.stderr:--> Zapping: /dev/vg_nvme/lv_4 2023-07-14T18:06:57.595 INFO:teuthology.orchestra.run.smithi184.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2023-07-14T18:06:57.595 INFO:teuthology.orchestra.run.smithi184.stderr: stderr: 10+0 records in 2023-07-14T18:06:57.595 INFO:teuthology.orchestra.run.smithi184.stderr:10+0 records out 2023-07-14T18:06:57.595 INFO:teuthology.orchestra.run.smithi184.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0147101 s, 713 MB/s 2023-07-14T18:06:57.595 INFO:teuthology.orchestra.run.smithi184.stderr:--> Zapping successful for: 2023-07-14T18:06:58.027 DEBUG:teuthology.orchestra.run.smithi184:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81c9387d2e7576da065747ec9c16d1c7d69016ec shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bf7326ec-2270-11ee-9b33-001a4aab830c -- ceph orch daemon add osd smithi184:vg_nvme/lv_4 2023-07-14T18:06:58.417 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:06:58 smithi184 ceph-mon[98481]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2023-07-14T18:06:58.418 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:06:58 smithi184 ceph-mon[98481]: osdmap e11: 2 total, 1 up, 2 in 2023-07-14T18:06:58.418 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:06:58 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-07-14T18:06:58.418 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:06:58 smithi184 ceph-mon[98481]: from='osd.1 [v2:172.21.15.172:6800/3774455900,v1:172.21.15.172:6801/3774455900]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi172", "root=default"]}]: dispatch 2023-07-14T18:06:58.418 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:06:58 smithi184 ceph-mon[98481]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi172", "root=default"]}]: dispatch 2023-07-14T18:06:58.418 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:06:58 smithi184 ceph-mon[98481]: pgmap v52: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-07-14T18:06:58.418 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:06:58 smithi184 ceph-mon[98481]: Detected new or changed devices on smithi172 2023-07-14T18:06:58.418 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:06:58 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:06:58.419 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:06:58 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:06:58.419 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:06:58 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-07-14T18:06:58.419 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:06:58 smithi184 ceph-mon[98481]: Adjusting osd_memory_target on smithi172 to 17168M 2023-07-14T18:06:58.419 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:06:58 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:06:58.419 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:06:58 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T18:06:58.419 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:06:58 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-14T18:06:58.419 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:06:58 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:06:58.460 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:06:58 smithi163 ceph-mon[96576]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2023-07-14T18:06:58.460 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:06:58 smithi163 ceph-mon[96576]: osdmap e11: 2 total, 1 up, 2 in 2023-07-14T18:06:58.460 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:06:58 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-07-14T18:06:58.461 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:06:58 smithi163 ceph-mon[96576]: from='osd.1 [v2:172.21.15.172:6800/3774455900,v1:172.21.15.172:6801/3774455900]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi172", "root=default"]}]: dispatch 2023-07-14T18:06:58.461 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:06:58 smithi163 ceph-mon[96576]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi172", "root=default"]}]: dispatch 2023-07-14T18:06:58.461 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:06:58 smithi163 ceph-mon[96576]: pgmap v52: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-07-14T18:06:58.461 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:06:58 smithi163 ceph-mon[96576]: Detected new or changed devices on smithi172 2023-07-14T18:06:58.461 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:06:58 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:06:58.461 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:06:58 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:06:58.461 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:06:58 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-07-14T18:06:58.462 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:06:58 smithi163 ceph-mon[96576]: Adjusting osd_memory_target on smithi172 to 17168M 2023-07-14T18:06:58.462 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:06:58 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:06:58.462 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:06:58 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T18:06:58.462 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:06:58 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-14T18:06:58.462 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:06:58 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:06:58.518 INFO:journalctl@ceph.osd.1.smithi172.stdout:Jul 14 18:06:58 smithi172 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-1[102969]: 2023-07-14T18:06:58.054+0000 7f0d5dd80700 -1 osd.1 0 waiting for initial osdmap 2023-07-14T18:06:58.518 INFO:journalctl@ceph.osd.1.smithi172.stdout:Jul 14 18:06:58 smithi172 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-1[102969]: 2023-07-14T18:06:58.057+0000 7f0d59375700 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-07-14T18:06:58.519 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:06:58 smithi172 ceph-mon[97983]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2023-07-14T18:06:58.519 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:06:58 smithi172 ceph-mon[97983]: osdmap e11: 2 total, 1 up, 2 in 2023-07-14T18:06:58.519 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:06:58 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-07-14T18:06:58.519 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:06:58 smithi172 ceph-mon[97983]: from='osd.1 [v2:172.21.15.172:6800/3774455900,v1:172.21.15.172:6801/3774455900]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi172", "root=default"]}]: dispatch 2023-07-14T18:06:58.519 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:06:58 smithi172 ceph-mon[97983]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi172", "root=default"]}]: dispatch 2023-07-14T18:06:58.519 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:06:58 smithi172 ceph-mon[97983]: pgmap v52: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-07-14T18:06:58.520 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:06:58 smithi172 ceph-mon[97983]: Detected new or changed devices on smithi172 2023-07-14T18:06:58.520 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:06:58 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:06:58.520 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:06:58 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:06:58.520 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:06:58 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-07-14T18:06:58.520 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:06:58 smithi172 ceph-mon[97983]: Adjusting osd_memory_target on smithi172 to 17168M 2023-07-14T18:06:58.520 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:06:58 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:06:58.520 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:06:58 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T18:06:58.521 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:06:58 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-14T18:06:58.521 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:06:58 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:06:58.580 INFO:teuthology.orchestra.run.smithi184.stderr:Inferring config /var/lib/ceph/bf7326ec-2270-11ee-9b33-001a4aab830c/mon.c/config 2023-07-14T18:06:59.417 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:06:59 smithi184 ceph-mon[98481]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi172", "root=default"]}]': finished 2023-07-14T18:06:59.418 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:06:59 smithi184 ceph-mon[98481]: osdmap e12: 2 total, 1 up, 2 in 2023-07-14T18:06:59.418 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:06:59 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-07-14T18:06:59.418 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:06:59 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-07-14T18:06:59.460 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:06:59 smithi163 ceph-mon[96576]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi172", "root=default"]}]': finished 2023-07-14T18:06:59.460 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:06:59 smithi163 ceph-mon[96576]: osdmap e12: 2 total, 1 up, 2 in 2023-07-14T18:06:59.460 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:06:59 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-07-14T18:06:59.460 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:06:59 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-07-14T18:06:59.518 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:06:59 smithi172 ceph-mon[97983]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi172", "root=default"]}]': finished 2023-07-14T18:06:59.519 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:06:59 smithi172 ceph-mon[97983]: osdmap e12: 2 total, 1 up, 2 in 2023-07-14T18:06:59.519 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:06:59 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-07-14T18:06:59.519 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:06:59 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-07-14T18:06:59.797 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:06:59.764+0000 7f52cae43700 1 -- 172.21.15.184:0/3758264449 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f52c4100740 msgr2=0x7f52c4107000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:06:59.798 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:06:59.764+0000 7f52cae43700 1 --2- 172.21.15.184:0/3758264449 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f52c4100740 0x7f52c4107000 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f52bc00b0a0 tx=0x7f52bc00b3b0 comp rx=0 tx=0).stop 2023-07-14T18:06:59.798 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:06:59.764+0000 7f52cae43700 1 -- 172.21.15.184:0/3758264449 shutdown_connections 2023-07-14T18:06:59.798 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:06:59.764+0000 7f52cae43700 1 --2- 172.21.15.184:0/3758264449 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f52c4100740 0x7f52c4107000 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:06:59.798 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:06:59.764+0000 7f52cae43700 1 --2- 172.21.15.184:0/3758264449 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f52c40febb0 0x7f52c40fefc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:06:59.798 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:06:59.764+0000 7f52cae43700 1 --2- 172.21.15.184:0/3758264449 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f52c40ffdb0 0x7f52c4100200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:06:59.798 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:06:59.764+0000 7f52cae43700 1 -- 172.21.15.184:0/3758264449 >> 172.21.15.184:0/3758264449 conn(0x7f52c40fa1e0 msgr2=0x7f52c40fc630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:06:59.798 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:06:59.764+0000 7f52cae43700 1 -- 172.21.15.184:0/3758264449 shutdown_connections 2023-07-14T18:06:59.799 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:06:59.764+0000 7f52cae43700 1 -- 172.21.15.184:0/3758264449 wait complete. 2023-07-14T18:06:59.800 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:06:59.764+0000 7f52cae43700 1 Processor -- start 2023-07-14T18:06:59.800 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:06:59.764+0000 7f52cae43700 1 -- start start 2023-07-14T18:06:59.800 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:06:59.765+0000 7f52cae43700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f52c40febb0 0x7f52c41948f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:06:59.801 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:06:59.765+0000 7f52cae43700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f52c40ffdb0 0x7f52c4194e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:06:59.801 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:06:59.765+0000 7f52cae43700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f52c4100740 0x7f52c419beb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:06:59.801 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:06:59.765+0000 7f52cae43700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52c419c480 con 0x7f52c40febb0 2023-07-14T18:06:59.801 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:06:59.765+0000 7f52cae43700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52c419c5c0 con 0x7f52c40ffdb0 2023-07-14T18:06:59.801 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:06:59.765+0000 7f52cae43700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52c419c750 con 0x7f52c4100740 2023-07-14T18:06:59.801 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:06:59.765+0000 7f52c93e0700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f52c4100740 0x7f52c419beb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:06:59.801 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:06:59.765+0000 7f52c93e0700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f52c4100740 0x7f52c419beb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.184:53882/0 (socket says 172.21.15.184:53882) 2023-07-14T18:06:59.801 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:06:59.765+0000 7f52c93e0700 1 -- 172.21.15.184:0/4223219401 learned_addr learned my addr 172.21.15.184:0/4223219401 (peer_addr_for_me v2:172.21.15.184:0/0) 2023-07-14T18:06:59.802 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:06:59.765+0000 7f52c8bdf700 1 --2- 172.21.15.184:0/4223219401 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f52c40febb0 0x7f52c41948f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:06:59.802 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:06:59.765+0000 7f52c3fff700 1 --2- 172.21.15.184:0/4223219401 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f52c40ffdb0 0x7f52c4194e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:06:59.802 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:06:59.765+0000 7f52c93e0700 1 -- 172.21.15.184:0/4223219401 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f52c40ffdb0 msgr2=0x7f52c4194e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:06:59.802 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:06:59.765+0000 7f52c93e0700 1 --2- 172.21.15.184:0/4223219401 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f52c40ffdb0 0x7f52c4194e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:06:59.802 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:06:59.765+0000 7f52c93e0700 1 -- 172.21.15.184:0/4223219401 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f52c40febb0 msgr2=0x7f52c41948f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:06:59.802 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:06:59.765+0000 7f52c93e0700 1 --2- 172.21.15.184:0/4223219401 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f52c40febb0 0x7f52c41948f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:06:59.802 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:06:59.765+0000 7f52c93e0700 1 -- 172.21.15.184:0/4223219401 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52bc009d00 con 0x7f52c4100740 2023-07-14T18:06:59.803 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:06:59.765+0000 7f52c3fff700 1 --2- 172.21.15.184:0/4223219401 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f52c40ffdb0 0x7f52c4194e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T18:06:59.803 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:06:59.765+0000 7f52c93e0700 1 --2- 172.21.15.184:0/4223219401 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f52c4100740 0x7f52c419beb0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f52bc007a30 tx=0x7f52bc004d00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:06:59.803 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:06:59.765+0000 7f52c1ffb700 1 -- 172.21.15.184:0/4223219401 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52bc00e040 con 0x7f52c4100740 2023-07-14T18:06:59.803 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:06:59.765+0000 7f52c1ffb700 1 -- 172.21.15.184:0/4223219401 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f52bc01db20 con 0x7f52c4100740 2023-07-14T18:06:59.803 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:06:59.765+0000 7f52cae43700 1 -- 172.21.15.184:0/4223219401 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f52c4068240 con 0x7f52c4100740 2023-07-14T18:06:59.803 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:06:59.765+0000 7f52c1ffb700 1 -- 172.21.15.184:0/4223219401 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52bc01bb90 con 0x7f52c4100740 2023-07-14T18:06:59.803 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:06:59.765+0000 7f52cae43700 1 -- 172.21.15.184:0/4223219401 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52c4068740 con 0x7f52c4100740 2023-07-14T18:06:59.805 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:06:59.767+0000 7f52cae43700 1 -- 172.21.15.184:0/4223219401 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f52c410a230 con 0x7f52c4100740 2023-07-14T18:06:59.805 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:06:59.768+0000 7f52c1ffb700 1 -- 172.21.15.184:0/4223219401 <== mon.1 v2:172.21.15.184:3300/0 4 ==== mgrmap(e 15) v1 ==== 135660+0+0 (secure 0 0 0) 0x7f52bc01dc90 con 0x7f52c4100740 2023-07-14T18:06:59.805 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:06:59.768+0000 7f52c1ffb700 1 --2- 172.21.15.184:0/4223219401 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f52b40a10c0 0x7f52b40a3570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:06:59.805 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:06:59.768+0000 7f52c1ffb700 1 -- 172.21.15.184:0/4223219401 <== mon.1 v2:172.21.15.184:3300/0 5 ==== osd_map(13..13 src has 1..13) v4 ==== 2309+0+0 (secure 0 0 0) 0x7f52bc0ccfa0 con 0x7f52c4100740 2023-07-14T18:06:59.806 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:06:59.769+0000 7f52c8bdf700 1 --2- 172.21.15.184:0/4223219401 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f52b40a10c0 0x7f52b40a3570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:06:59.806 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:06:59.769+0000 7f52c8bdf700 1 --2- 172.21.15.184:0/4223219401 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f52b40a10c0 0x7f52b40a3570 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f52c40ffc10 tx=0x7f52b800a380 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:06:59.807 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:06:59.773+0000 7f52c1ffb700 1 -- 172.21.15.184:0/4223219401 <== mon.1 v2:172.21.15.184:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178025 (secure 0 0 0) 0x7f52bc097fd0 con 0x7f52c4100740 2023-07-14T18:07:00.001 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:06:59.968+0000 7f52cae43700 1 -- 172.21.15.184:0/4223219401 --> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi184:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) v1 -- 0x7f52c4068a20 con 0x7f52b40a10c0 2023-07-14T18:07:00.417 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:07:00 smithi184 ceph-mon[98481]: purged_snaps scrub starts 2023-07-14T18:07:00.417 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:07:00 smithi184 ceph-mon[98481]: purged_snaps scrub ok 2023-07-14T18:07:00.418 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:07:00 smithi184 ceph-mon[98481]: osd.1 [v2:172.21.15.172:6800/3774455900,v1:172.21.15.172:6801/3774455900] boot 2023-07-14T18:07:00.418 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:07:00 smithi184 ceph-mon[98481]: osdmap e13: 2 total, 2 up, 2 in 2023-07-14T18:07:00.418 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:07:00 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-07-14T18:07:00.418 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:07:00 smithi184 ceph-mon[98481]: pgmap v55: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-07-14T18:07:00.418 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:07:00 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-07-14T18:07:00.418 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:07:00 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-07-14T18:07:00.418 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:07:00 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T18:07:00.460 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:07:00 smithi163 ceph-mon[96576]: purged_snaps scrub starts 2023-07-14T18:07:00.460 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:07:00 smithi163 ceph-mon[96576]: purged_snaps scrub ok 2023-07-14T18:07:00.461 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:07:00 smithi163 ceph-mon[96576]: osd.1 [v2:172.21.15.172:6800/3774455900,v1:172.21.15.172:6801/3774455900] boot 2023-07-14T18:07:00.461 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:07:00 smithi163 ceph-mon[96576]: osdmap e13: 2 total, 2 up, 2 in 2023-07-14T18:07:00.461 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:07:00 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-07-14T18:07:00.461 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:07:00 smithi163 ceph-mon[96576]: pgmap v55: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-07-14T18:07:00.462 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:07:00 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-07-14T18:07:00.462 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:07:00 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-07-14T18:07:00.462 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:07:00 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T18:07:00.518 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:07:00 smithi172 ceph-mon[97983]: purged_snaps scrub starts 2023-07-14T18:07:00.518 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:07:00 smithi172 ceph-mon[97983]: purged_snaps scrub ok 2023-07-14T18:07:00.518 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:07:00 smithi172 ceph-mon[97983]: osd.1 [v2:172.21.15.172:6800/3774455900,v1:172.21.15.172:6801/3774455900] boot 2023-07-14T18:07:00.519 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:07:00 smithi172 ceph-mon[97983]: osdmap e13: 2 total, 2 up, 2 in 2023-07-14T18:07:00.519 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:07:00 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-07-14T18:07:00.519 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:07:00 smithi172 ceph-mon[97983]: pgmap v55: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-07-14T18:07:00.519 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:07:00 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-07-14T18:07:00.519 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:07:00 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-07-14T18:07:00.519 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:07:00 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T18:07:01.411 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:07:01 smithi184 ceph-mon[98481]: from='client.24160 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi184:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2023-07-14T18:07:01.411 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:07:01 smithi184 ceph-mon[98481]: osdmap e14: 2 total, 2 up, 2 in 2023-07-14T18:07:01.460 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:07:01 smithi163 ceph-mon[96576]: from='client.24160 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi184:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2023-07-14T18:07:01.460 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:07:01 smithi163 ceph-mon[96576]: osdmap e14: 2 total, 2 up, 2 in 2023-07-14T18:07:01.518 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:07:01 smithi172 ceph-mon[97983]: from='client.24160 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi184:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2023-07-14T18:07:01.519 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:07:01 smithi172 ceph-mon[97983]: osdmap e14: 2 total, 2 up, 2 in 2023-07-14T18:07:02.418 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:07:02 smithi184 ceph-mon[98481]: pgmap v57: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-07-14T18:07:02.460 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:07:02 smithi163 ceph-mon[96576]: pgmap v57: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-07-14T18:07:02.518 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:07:02 smithi172 ceph-mon[97983]: pgmap v57: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-07-14T18:07:03.417 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:07:03 smithi184 ceph-mon[98481]: from='client.? 172.21.15.184:0/782917254' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "cc732c13-af0f-4199-98e6-fe960ed4e5dc"}]: dispatch 2023-07-14T18:07:03.418 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:07:03 smithi184 ceph-mon[98481]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "cc732c13-af0f-4199-98e6-fe960ed4e5dc"}]: dispatch 2023-07-14T18:07:03.418 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:07:03 smithi184 ceph-mon[98481]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "cc732c13-af0f-4199-98e6-fe960ed4e5dc"}]': finished 2023-07-14T18:07:03.418 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:07:03 smithi184 ceph-mon[98481]: osdmap e15: 3 total, 2 up, 3 in 2023-07-14T18:07:03.418 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:07:03 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-07-14T18:07:03.418 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:07:03 smithi184 ceph-mon[98481]: from='client.? 172.21.15.184:0/1671523674' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-07-14T18:07:03.460 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:07:03 smithi163 ceph-mon[96576]: from='client.? 172.21.15.184:0/782917254' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "cc732c13-af0f-4199-98e6-fe960ed4e5dc"}]: dispatch 2023-07-14T18:07:03.460 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:07:03 smithi163 ceph-mon[96576]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "cc732c13-af0f-4199-98e6-fe960ed4e5dc"}]: dispatch 2023-07-14T18:07:03.460 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:07:03 smithi163 ceph-mon[96576]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "cc732c13-af0f-4199-98e6-fe960ed4e5dc"}]': finished 2023-07-14T18:07:03.460 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:07:03 smithi163 ceph-mon[96576]: osdmap e15: 3 total, 2 up, 3 in 2023-07-14T18:07:03.461 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:07:03 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-07-14T18:07:03.461 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:07:03 smithi163 ceph-mon[96576]: from='client.? 172.21.15.184:0/1671523674' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-07-14T18:07:03.518 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:07:03 smithi172 ceph-mon[97983]: from='client.? 172.21.15.184:0/782917254' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "cc732c13-af0f-4199-98e6-fe960ed4e5dc"}]: dispatch 2023-07-14T18:07:03.518 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:07:03 smithi172 ceph-mon[97983]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "cc732c13-af0f-4199-98e6-fe960ed4e5dc"}]: dispatch 2023-07-14T18:07:03.519 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:07:03 smithi172 ceph-mon[97983]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "cc732c13-af0f-4199-98e6-fe960ed4e5dc"}]': finished 2023-07-14T18:07:03.519 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:07:03 smithi172 ceph-mon[97983]: osdmap e15: 3 total, 2 up, 3 in 2023-07-14T18:07:03.519 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:07:03 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-07-14T18:07:03.519 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:07:03 smithi172 ceph-mon[97983]: from='client.? 172.21.15.184:0/1671523674' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-07-14T18:07:04.417 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:07:04 smithi184 ceph-mon[98481]: pgmap v59: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-07-14T18:07:04.460 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:07:04 smithi163 ceph-mon[96576]: pgmap v59: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-07-14T18:07:04.518 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:07:04 smithi172 ceph-mon[97983]: pgmap v59: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-07-14T18:07:07.018 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:07:06 smithi172 ceph-mon[97983]: pgmap v60: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-07-14T18:07:07.148 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:07:06 smithi184 ceph-mon[98481]: pgmap v60: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-07-14T18:07:07.210 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:07:06 smithi163 ceph-mon[96576]: pgmap v60: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-07-14T18:07:09.018 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:07:08 smithi172 ceph-mon[97983]: pgmap v61: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-07-14T18:07:09.167 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:07:08 smithi184 ceph-mon[98481]: pgmap v61: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-07-14T18:07:09.210 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:07:08 smithi163 ceph-mon[96576]: pgmap v61: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-07-14T18:07:09.911 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:07:09 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2023-07-14T18:07:09.911 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:07:09 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T18:07:10.018 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:07:09 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2023-07-14T18:07:10.019 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:07:09 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T18:07:10.210 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:07:09 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2023-07-14T18:07:10.210 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:07:09 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T18:07:11.018 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:07:10 smithi172 ceph-mon[97983]: Deploying daemon osd.2 on smithi184 2023-07-14T18:07:11.019 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:07:10 smithi172 ceph-mon[97983]: pgmap v62: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-07-14T18:07:11.060 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:07:10 smithi184 ceph-mon[98481]: Deploying daemon osd.2 on smithi184 2023-07-14T18:07:11.061 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:07:10 smithi184 ceph-mon[98481]: pgmap v62: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-07-14T18:07:11.210 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:07:10 smithi163 ceph-mon[96576]: Deploying daemon osd.2 on smithi184 2023-07-14T18:07:11.210 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:07:10 smithi163 ceph-mon[96576]: pgmap v62: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-07-14T18:07:12.917 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:07:12 smithi184 ceph-mon[98481]: pgmap v63: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-07-14T18:07:13.018 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:07:12 smithi172 ceph-mon[97983]: pgmap v63: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-07-14T18:07:13.210 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:07:12 smithi163 ceph-mon[96576]: pgmap v63: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-07-14T18:07:14.068 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:07:13 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:07:14.068 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:07:13 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:07:14.068 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:07:13 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-14T18:07:14.068 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:07:13 smithi184 ceph-mon[98481]: pgmap v64: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-07-14T18:07:14.210 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:07:13 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:07:14.210 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:07:13 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:07:14.211 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:07:13 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-14T18:07:14.211 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:07:13 smithi163 ceph-mon[96576]: pgmap v64: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-07-14T18:07:14.269 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:07:13 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:07:14.269 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:07:13 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:07:14.269 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:07:13 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-14T18:07:14.269 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:07:13 smithi172 ceph-mon[97983]: pgmap v64: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-07-14T18:07:15.609 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:07:15.576+0000 7f52c1ffb700 1 -- 172.21.15.184:0/4223219401 <== mgr.14152 v2:172.21.15.163:6800/1949590926 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f52c4068a20 con 0x7f52b40a10c0 2023-07-14T18:07:15.610 INFO:teuthology.orchestra.run.smithi184.stdout:Created osd(s) 2 on host 'smithi184' 2023-07-14T18:07:15.611 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:07:15.578+0000 7f52cae43700 1 -- 172.21.15.184:0/4223219401 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f52b40a10c0 msgr2=0x7f52b40a3570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:07:15.611 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:07:15.578+0000 7f52cae43700 1 --2- 172.21.15.184:0/4223219401 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f52b40a10c0 0x7f52b40a3570 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f52c40ffc10 tx=0x7f52b800a380 comp rx=0 tx=0).stop 2023-07-14T18:07:15.611 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:07:15.578+0000 7f52cae43700 1 -- 172.21.15.184:0/4223219401 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f52c4100740 msgr2=0x7f52c419beb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:07:15.612 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:07:15.578+0000 7f52cae43700 1 --2- 172.21.15.184:0/4223219401 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f52c4100740 0x7f52c419beb0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f52bc007a30 tx=0x7f52bc004d00 comp rx=0 tx=0).stop 2023-07-14T18:07:15.612 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:07:15.578+0000 7f52cae43700 1 -- 172.21.15.184:0/4223219401 shutdown_connections 2023-07-14T18:07:15.612 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:07:15.578+0000 7f52cae43700 1 --2- 172.21.15.184:0/4223219401 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f52b40a10c0 0x7f52b40a3570 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:07:15.612 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:07:15.578+0000 7f52cae43700 1 --2- 172.21.15.184:0/4223219401 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f52c4100740 0x7f52c419beb0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:07:15.612 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:07:15.578+0000 7f52cae43700 1 --2- 172.21.15.184:0/4223219401 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f52c40febb0 0x7f52c41948f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:07:15.612 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:07:15.578+0000 7f52cae43700 1 --2- 172.21.15.184:0/4223219401 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f52c40ffdb0 0x7f52c4194e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:07:15.612 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:07:15.578+0000 7f52cae43700 1 -- 172.21.15.184:0/4223219401 >> 172.21.15.184:0/4223219401 conn(0x7f52c40fa1e0 msgr2=0x7f52c4103330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:07:15.613 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:07:15.578+0000 7f52cae43700 1 -- 172.21.15.184:0/4223219401 shutdown_connections 2023-07-14T18:07:15.613 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:07:15.578+0000 7f52cae43700 1 -- 172.21.15.184:0/4223219401 wait complete. 2023-07-14T18:07:15.955 DEBUG:teuthology.orchestra.run.smithi184:osd.2> sudo journalctl -f -n 0 -u ceph-bf7326ec-2270-11ee-9b33-001a4aab830c@osd.2.service 2023-07-14T18:07:15.957 INFO:tasks.cephadm:Deploying osd.3 on smithi163 with /dev/vg_nvme/lv_3... 2023-07-14T18:07:15.958 DEBUG:teuthology.orchestra.run.smithi163:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81c9387d2e7576da065747ec9c16d1c7d69016ec shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bf7326ec-2270-11ee-9b33-001a4aab830c -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2023-07-14T18:07:15.986 INFO:journalctl@ceph.osd.2.smithi184.stdout:-- Logs begin at Fri 2023-07-14 17:45:39 UTC. -- 2023-07-14T18:07:16.167 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:07:15 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:07:16.168 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:07:15 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:07:16.168 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:07:15 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T18:07:16.168 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:07:15 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-14T18:07:16.168 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:07:15 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:07:16.168 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:07:15 smithi184 ceph-mon[98481]: pgmap v65: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-07-14T18:07:16.169 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:07:15 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:07:16.169 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:07:15 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:07:16.169 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:07:15 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-14T18:07:16.214 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:07:15 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:07:16.214 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:07:15 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:07:16.214 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:07:15 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T18:07:16.214 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:07:15 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-14T18:07:16.214 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:07:15 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:07:16.214 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:07:15 smithi163 ceph-mon[96576]: pgmap v65: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-07-14T18:07:16.215 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:07:15 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:07:16.215 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:07:15 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:07:16.215 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:07:15 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-14T18:07:16.269 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:07:15 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:07:16.269 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:07:15 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:07:16.269 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:07:15 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T18:07:16.269 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:07:15 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-14T18:07:16.269 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:07:15 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:07:16.269 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:07:15 smithi172 ceph-mon[97983]: pgmap v65: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-07-14T18:07:16.270 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:07:15 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:07:16.270 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:07:15 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:07:16.270 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:07:15 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-14T18:07:16.525 INFO:teuthology.orchestra.run.smithi163.stderr:Inferring config /var/lib/ceph/bf7326ec-2270-11ee-9b33-001a4aab830c/mon.a/config 2023-07-14T18:07:17.015 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:07:16 smithi163 ceph-mon[96576]: from='osd.2 [v2:172.21.15.184:6800/1976927678,v1:172.21.15.184:6801/1976927678]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2023-07-14T18:07:17.015 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:07:16 smithi163 ceph-mon[96576]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2023-07-14T18:07:17.168 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:07:16 smithi184 ceph-mon[98481]: from='osd.2 [v2:172.21.15.184:6800/1976927678,v1:172.21.15.184:6801/1976927678]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2023-07-14T18:07:17.168 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:07:16 smithi184 ceph-mon[98481]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2023-07-14T18:07:17.168 INFO:journalctl@ceph.osd.2.smithi184.stdout:Jul 14 18:07:16 smithi184 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-2[104293]: 2023-07-14T18:07:16.863+0000 7f0dfaf9b640 -1 osd.2 0 log_to_monitors true 2023-07-14T18:07:17.268 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:07:16 smithi172 ceph-mon[97983]: from='osd.2 [v2:172.21.15.184:6800/1976927678,v1:172.21.15.184:6801/1976927678]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2023-07-14T18:07:17.269 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:07:16 smithi172 ceph-mon[97983]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2023-07-14T18:07:18.000 INFO:teuthology.orchestra.run.smithi163.stderr:--> Zapping: /dev/vg_nvme/lv_3 2023-07-14T18:07:18.000 INFO:teuthology.orchestra.run.smithi163.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2023-07-14T18:07:18.000 INFO:teuthology.orchestra.run.smithi163.stderr: stderr: 10+0 records in 2023-07-14T18:07:18.000 INFO:teuthology.orchestra.run.smithi163.stderr:10+0 records out 2023-07-14T18:07:18.000 INFO:teuthology.orchestra.run.smithi163.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0108909 s, 963 MB/s 2023-07-14T18:07:18.001 INFO:teuthology.orchestra.run.smithi163.stderr:--> Zapping successful for: 2023-07-14T18:07:18.168 INFO:journalctl@ceph.osd.2.smithi184.stdout:Jul 14 18:07:17 smithi184 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-2[104293]: 2023-07-14T18:07:17.892+0000 7f0df0613700 -1 osd.2 0 waiting for initial osdmap 2023-07-14T18:07:18.168 INFO:journalctl@ceph.osd.2.smithi184.stdout:Jul 14 18:07:17 smithi184 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-2[104293]: 2023-07-14T18:07:17.896+0000 7f0de8c02700 -1 osd.2 17 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-07-14T18:07:18.168 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:07:17 smithi184 ceph-mon[98481]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2023-07-14T18:07:18.169 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:07:17 smithi184 ceph-mon[98481]: osdmap e16: 3 total, 2 up, 3 in 2023-07-14T18:07:18.169 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:07:17 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-07-14T18:07:18.169 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:07:17 smithi184 ceph-mon[98481]: from='osd.2 [v2:172.21.15.184:6800/1976927678,v1:172.21.15.184:6801/1976927678]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi184", "root=default"]}]: dispatch 2023-07-14T18:07:18.169 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:07:17 smithi184 ceph-mon[98481]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi184", "root=default"]}]: dispatch 2023-07-14T18:07:18.169 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:07:17 smithi184 ceph-mon[98481]: pgmap v67: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-07-14T18:07:18.210 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:07:17 smithi163 ceph-mon[96576]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2023-07-14T18:07:18.211 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:07:17 smithi163 ceph-mon[96576]: osdmap e16: 3 total, 2 up, 3 in 2023-07-14T18:07:18.211 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:07:17 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-07-14T18:07:18.211 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:07:17 smithi163 ceph-mon[96576]: from='osd.2 [v2:172.21.15.184:6800/1976927678,v1:172.21.15.184:6801/1976927678]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi184", "root=default"]}]: dispatch 2023-07-14T18:07:18.211 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:07:17 smithi163 ceph-mon[96576]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi184", "root=default"]}]: dispatch 2023-07-14T18:07:18.211 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:07:17 smithi163 ceph-mon[96576]: pgmap v67: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-07-14T18:07:18.269 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:07:17 smithi172 ceph-mon[97983]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2023-07-14T18:07:18.269 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:07:17 smithi172 ceph-mon[97983]: osdmap e16: 3 total, 2 up, 3 in 2023-07-14T18:07:18.269 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:07:17 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-07-14T18:07:18.269 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:07:17 smithi172 ceph-mon[97983]: from='osd.2 [v2:172.21.15.184:6800/1976927678,v1:172.21.15.184:6801/1976927678]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi184", "root=default"]}]: dispatch 2023-07-14T18:07:18.269 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:07:17 smithi172 ceph-mon[97983]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi184", "root=default"]}]: dispatch 2023-07-14T18:07:18.269 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:07:17 smithi172 ceph-mon[97983]: pgmap v67: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-07-14T18:07:18.373 DEBUG:teuthology.orchestra.run.smithi163:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81c9387d2e7576da065747ec9c16d1c7d69016ec shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bf7326ec-2270-11ee-9b33-001a4aab830c -- ceph orch daemon add osd smithi163:vg_nvme/lv_3 2023-07-14T18:07:18.925 INFO:teuthology.orchestra.run.smithi163.stderr:Inferring config /var/lib/ceph/bf7326ec-2270-11ee-9b33-001a4aab830c/mon.a/config 2023-07-14T18:07:19.178 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:07:18 smithi163 ceph-mon[96576]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi184", "root=default"]}]': finished 2023-07-14T18:07:19.178 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:07:18 smithi163 ceph-mon[96576]: osdmap e17: 3 total, 2 up, 3 in 2023-07-14T18:07:19.179 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:07:18 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-07-14T18:07:19.179 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:07:18 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-07-14T18:07:19.179 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:07:18 smithi163 ceph-mon[96576]: Detected new or changed devices on smithi184 2023-07-14T18:07:19.179 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:07:18 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:07:19.179 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:07:18 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:07:19.179 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:07:18 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-07-14T18:07:19.179 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:07:18 smithi163 ceph-mon[96576]: Adjusting osd_memory_target on smithi184 to 17168M 2023-07-14T18:07:19.180 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:07:18 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:07:19.180 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:07:18 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T18:07:19.180 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:07:18 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-14T18:07:19.180 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:07:18 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:07:19.269 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:07:18 smithi172 ceph-mon[97983]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi184", "root=default"]}]': finished 2023-07-14T18:07:19.269 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:07:18 smithi172 ceph-mon[97983]: osdmap e17: 3 total, 2 up, 3 in 2023-07-14T18:07:19.270 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:07:18 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-07-14T18:07:19.270 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:07:18 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-07-14T18:07:19.270 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:07:18 smithi172 ceph-mon[97983]: Detected new or changed devices on smithi184 2023-07-14T18:07:19.270 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:07:18 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:07:19.270 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:07:18 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:07:19.270 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:07:18 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-07-14T18:07:19.270 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:07:18 smithi172 ceph-mon[97983]: Adjusting osd_memory_target on smithi184 to 17168M 2023-07-14T18:07:19.271 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:07:18 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:07:19.271 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:07:18 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T18:07:19.271 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:07:18 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-14T18:07:19.271 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:07:18 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:07:19.418 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:07:18 smithi184 ceph-mon[98481]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi184", "root=default"]}]': finished 2023-07-14T18:07:19.418 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:07:18 smithi184 ceph-mon[98481]: osdmap e17: 3 total, 2 up, 3 in 2023-07-14T18:07:19.418 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:07:18 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-07-14T18:07:19.418 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:07:18 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-07-14T18:07:19.418 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:07:18 smithi184 ceph-mon[98481]: Detected new or changed devices on smithi184 2023-07-14T18:07:19.419 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:07:18 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:07:19.419 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:07:18 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:07:19.419 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:07:18 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-07-14T18:07:19.419 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:07:18 smithi184 ceph-mon[98481]: Adjusting osd_memory_target on smithi184 to 17168M 2023-07-14T18:07:19.419 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:07:18 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:07:19.419 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:07:18 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T18:07:19.419 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:07:18 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-14T18:07:19.420 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:07:18 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:07:20.005 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:07:19 smithi163 ceph-mon[96576]: purged_snaps scrub starts 2023-07-14T18:07:20.005 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:07:19 smithi163 ceph-mon[96576]: purged_snaps scrub ok 2023-07-14T18:07:20.005 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:07:19 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-07-14T18:07:20.005 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:07:19 smithi163 ceph-mon[96576]: osd.2 [v2:172.21.15.184:6800/1976927678,v1:172.21.15.184:6801/1976927678] boot 2023-07-14T18:07:20.006 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:07:19 smithi163 ceph-mon[96576]: osdmap e18: 3 total, 3 up, 3 in 2023-07-14T18:07:20.006 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:07:19 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-07-14T18:07:20.006 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:07:19 smithi163 ceph-mon[96576]: pgmap v70: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-07-14T18:07:20.006 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:07:19 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2023-07-14T18:07:20.195 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:07:20.160+0000 7f5513546700 1 -- 172.21.15.163:0/666827991 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f550c0ffed0 msgr2=0x7f550c106790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:07:20.195 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:07:20.160+0000 7f5513546700 1 --2- 172.21.15.163:0/666827991 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f550c0ffed0 0x7f550c106790 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f550400c210 tx=0x7f550400c520 comp rx=0 tx=0).stop 2023-07-14T18:07:20.195 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:07:20.160+0000 7f5513546700 1 -- 172.21.15.163:0/666827991 shutdown_connections 2023-07-14T18:07:20.196 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:07:20.160+0000 7f5513546700 1 --2- 172.21.15.163:0/666827991 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f550c0fe340 0x7f550c0fe750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:07:20.196 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:07:20.160+0000 7f5513546700 1 --2- 172.21.15.163:0/666827991 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f550c0ffed0 0x7f550c106790 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:07:20.196 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:07:20.160+0000 7f5513546700 1 --2- 172.21.15.163:0/666827991 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f550c0ff540 0x7f550c0ff990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:07:20.196 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:07:20.160+0000 7f5513546700 1 -- 172.21.15.163:0/666827991 >> 172.21.15.163:0/666827991 conn(0x7f550c0f9990 msgr2=0x7f550c0fbdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:07:20.196 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:07:20.160+0000 7f5513546700 1 -- 172.21.15.163:0/666827991 shutdown_connections 2023-07-14T18:07:20.196 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:07:20.161+0000 7f5513546700 1 -- 172.21.15.163:0/666827991 wait complete. 2023-07-14T18:07:20.196 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:07:20.161+0000 7f5513546700 1 Processor -- start 2023-07-14T18:07:20.196 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:07:20.161+0000 7f5513546700 1 -- start start 2023-07-14T18:07:20.198 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:07:20.161+0000 7f5513546700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f550c0fe340 0x7f550c195950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:07:20.198 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:07:20.161+0000 7f5513546700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f550c0ff540 0x7f550c195e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:07:20.198 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:07:20.161+0000 7f5513546700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f550c0ffed0 0x7f550c19cf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:07:20.198 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:07:20.161+0000 7f5513546700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f550c19d4e0 con 0x7f550c0ff540 2023-07-14T18:07:20.198 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:07:20.161+0000 7f5513546700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f550c19d620 con 0x7f550c0fe340 2023-07-14T18:07:20.199 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:07:20.161+0000 7f5513546700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f550c19d7b0 con 0x7f550c0ffed0 2023-07-14T18:07:20.199 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:07:20.161+0000 7f5510ae1700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f550c0ff540 0x7f550c195e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:07:20.199 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:07:20.161+0000 7f5510ae1700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f550c0ff540 0x7f550c195e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:54918/0 (socket says 172.21.15.163:54918) 2023-07-14T18:07:20.199 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:07:20.161+0000 7f5510ae1700 1 -- 172.21.15.163:0/879925434 learned_addr learned my addr 172.21.15.163:0/879925434 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:07:20.199 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:07:20.162+0000 7f5511ae3700 1 --2- 172.21.15.163:0/879925434 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f550c0ffed0 0x7f550c19cf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:07:20.199 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:07:20.162+0000 7f55112e2700 1 --2- 172.21.15.163:0/879925434 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f550c0fe340 0x7f550c195950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:07:20.200 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:07:20.162+0000 7f5510ae1700 1 -- 172.21.15.163:0/879925434 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f550c0ffed0 msgr2=0x7f550c19cf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:07:20.200 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:07:20.162+0000 7f5510ae1700 1 --2- 172.21.15.163:0/879925434 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f550c0ffed0 0x7f550c19cf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:07:20.200 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:07:20.162+0000 7f5510ae1700 1 -- 172.21.15.163:0/879925434 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f550c0fe340 msgr2=0x7f550c195950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:07:20.200 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:07:20.162+0000 7f5510ae1700 1 --2- 172.21.15.163:0/879925434 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f550c0fe340 0x7f550c195950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:07:20.200 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:07:20.162+0000 7f5510ae1700 1 -- 172.21.15.163:0/879925434 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f550400ae10 con 0x7f550c0ff540 2023-07-14T18:07:20.200 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:07:20.162+0000 7f5510ae1700 1 --2- 172.21.15.163:0/879925434 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f550c0ff540 0x7f550c195e90 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f550800e9d0 tx=0x7f550800ece0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:07:20.200 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:07:20.162+0000 7f55027fc700 1 -- 172.21.15.163:0/879925434 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5508009790 con 0x7f550c0ff540 2023-07-14T18:07:20.201 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:07:20.162+0000 7f55027fc700 1 -- 172.21.15.163:0/879925434 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f550800ee70 con 0x7f550c0ff540 2023-07-14T18:07:20.201 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:07:20.162+0000 7f55027fc700 1 -- 172.21.15.163:0/879925434 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5508018420 con 0x7f550c0ff540 2023-07-14T18:07:20.201 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:07:20.162+0000 7f5513546700 1 -- 172.21.15.163:0/879925434 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f550c19da90 con 0x7f550c0ff540 2023-07-14T18:07:20.201 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:07:20.162+0000 7f5513546700 1 -- 172.21.15.163:0/879925434 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f550c19df40 con 0x7f550c0ff540 2023-07-14T18:07:20.201 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:07:20.163+0000 7f5513546700 1 -- 172.21.15.163:0/879925434 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f550c1091c0 con 0x7f550c0ff540 2023-07-14T18:07:20.202 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:07:20.164+0000 7f55027fc700 1 -- 172.21.15.163:0/879925434 <== mon.0 v2:172.21.15.163:3300/0 4 ==== mgrmap(e 15) v1 ==== 135660+0+0 (secure 0 0 0) 0x7f550800cbd0 con 0x7f550c0ff540 2023-07-14T18:07:20.202 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:07:20.165+0000 7f55027fc700 1 --2- 172.21.15.163:0/879925434 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f54f80a10c0 0x7f54f80a3570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:07:20.202 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:07:20.165+0000 7f55112e2700 1 --2- 172.21.15.163:0/879925434 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f54f80a10c0 0x7f54f80a3570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:07:20.202 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:07:20.165+0000 7f55027fc700 1 -- 172.21.15.163:0/879925434 <== mon.0 v2:172.21.15.163:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3226+0+0 (secure 0 0 0) 0x7f5508014070 con 0x7f550c0ff540 2023-07-14T18:07:20.202 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:07:20.165+0000 7f55112e2700 1 --2- 172.21.15.163:0/879925434 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f54f80a10c0 0x7f54f80a3570 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f550c0ff3a0 tx=0x7f54fc007400 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:07:20.203 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:07:20.168+0000 7f55027fc700 1 -- 172.21.15.163:0/879925434 <== mon.0 v2:172.21.15.163:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178025 (secure 0 0 0) 0x7f55080965c0 con 0x7f550c0ff540 2023-07-14T18:07:20.269 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:07:19 smithi172 ceph-mon[97983]: purged_snaps scrub starts 2023-07-14T18:07:20.269 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:07:19 smithi172 ceph-mon[97983]: purged_snaps scrub ok 2023-07-14T18:07:20.269 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:07:19 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-07-14T18:07:20.269 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:07:19 smithi172 ceph-mon[97983]: osd.2 [v2:172.21.15.184:6800/1976927678,v1:172.21.15.184:6801/1976927678] boot 2023-07-14T18:07:20.269 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:07:19 smithi172 ceph-mon[97983]: osdmap e18: 3 total, 3 up, 3 in 2023-07-14T18:07:20.270 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:07:19 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-07-14T18:07:20.270 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:07:19 smithi172 ceph-mon[97983]: pgmap v70: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-07-14T18:07:20.270 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:07:19 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2023-07-14T18:07:20.396 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:07:20.362+0000 7f5513546700 1 -- 172.21.15.163:0/879925434 --> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi163:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) v1 -- 0x7f550c105c90 con 0x7f54f80a10c0 2023-07-14T18:07:20.418 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:07:19 smithi184 ceph-mon[98481]: purged_snaps scrub starts 2023-07-14T18:07:20.418 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:07:19 smithi184 ceph-mon[98481]: purged_snaps scrub ok 2023-07-14T18:07:20.418 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:07:19 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-07-14T18:07:20.418 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:07:19 smithi184 ceph-mon[98481]: osd.2 [v2:172.21.15.184:6800/1976927678,v1:172.21.15.184:6801/1976927678] boot 2023-07-14T18:07:20.418 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:07:19 smithi184 ceph-mon[98481]: osdmap e18: 3 total, 3 up, 3 in 2023-07-14T18:07:20.419 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:07:19 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-07-14T18:07:20.419 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:07:19 smithi184 ceph-mon[98481]: pgmap v70: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-07-14T18:07:20.419 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:07:19 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2023-07-14T18:07:21.210 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:07:20 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2023-07-14T18:07:21.210 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:07:20 smithi163 ceph-mon[96576]: osdmap e19: 3 total, 3 up, 3 in 2023-07-14T18:07:21.211 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:07:20 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2023-07-14T18:07:21.211 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:07:20 smithi163 ceph-mon[96576]: from='client.14295 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi163:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2023-07-14T18:07:21.211 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:07:20 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-07-14T18:07:21.211 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:07:20 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-07-14T18:07:21.211 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:07:20 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T18:07:21.269 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:07:20 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2023-07-14T18:07:21.269 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:07:20 smithi172 ceph-mon[97983]: osdmap e19: 3 total, 3 up, 3 in 2023-07-14T18:07:21.269 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:07:20 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2023-07-14T18:07:21.270 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:07:20 smithi172 ceph-mon[97983]: from='client.14295 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi163:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2023-07-14T18:07:21.270 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:07:20 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-07-14T18:07:21.270 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:07:20 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-07-14T18:07:21.270 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:07:20 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T18:07:21.418 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:07:20 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2023-07-14T18:07:21.418 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:07:20 smithi184 ceph-mon[98481]: osdmap e19: 3 total, 3 up, 3 in 2023-07-14T18:07:21.418 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:07:20 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2023-07-14T18:07:21.418 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:07:20 smithi184 ceph-mon[98481]: from='client.14295 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi163:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2023-07-14T18:07:21.419 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:07:20 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-07-14T18:07:21.419 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:07:20 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-07-14T18:07:21.419 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:07:20 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T18:07:21.555 INFO:journalctl@ceph.osd.0.smithi163.stdout:Jul 14 18:07:21 smithi163 sudo[112579]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/smartctl -x --json=o /dev/nvme0n1 2023-07-14T18:07:21.555 INFO:journalctl@ceph.osd.0.smithi163.stdout:Jul 14 18:07:21 smithi163 sudo[112579]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2023-07-14T18:07:21.555 INFO:journalctl@ceph.osd.0.smithi163.stdout:Jul 14 18:07:21 smithi163 sudo[112579]: pam_unix(sudo:session): session opened for user root by (uid=0) 2023-07-14T18:07:21.556 INFO:journalctl@ceph.osd.0.smithi163.stdout:Jul 14 18:07:21 smithi163 sudo[112579]: pam_unix(sudo:session): session closed for user root 2023-07-14T18:07:22.076 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:07:21 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2023-07-14T18:07:22.076 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:07:21 smithi172 ceph-mon[97983]: osdmap e20: 3 total, 3 up, 3 in 2023-07-14T18:07:22.076 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:07:21 smithi172 ceph-mon[97983]: pgmap v73: 1 pgs: 1 creating+peering; 0 B data, 80 MiB used, 268 GiB / 268 GiB avail 2023-07-14T18:07:22.076 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:07:21 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:07:22.076 INFO:journalctl@ceph.osd.1.smithi172.stdout:Jul 14 18:07:21 smithi172 sudo[105377]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/smartctl -x --json=o /dev/nvme0n1 2023-07-14T18:07:22.077 INFO:journalctl@ceph.osd.1.smithi172.stdout:Jul 14 18:07:21 smithi172 sudo[105377]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2023-07-14T18:07:22.077 INFO:journalctl@ceph.osd.1.smithi172.stdout:Jul 14 18:07:21 smithi172 sudo[105377]: pam_unix(sudo:session): session opened for user root by (uid=0) 2023-07-14T18:07:22.077 INFO:journalctl@ceph.osd.1.smithi172.stdout:Jul 14 18:07:21 smithi172 sudo[105377]: pam_unix(sudo:session): session closed for user root 2023-07-14T18:07:22.210 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:07:21 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2023-07-14T18:07:22.211 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:07:21 smithi163 ceph-mon[96576]: osdmap e20: 3 total, 3 up, 3 in 2023-07-14T18:07:22.211 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:07:21 smithi163 ceph-mon[96576]: pgmap v73: 1 pgs: 1 creating+peering; 0 B data, 80 MiB used, 268 GiB / 268 GiB avail 2023-07-14T18:07:22.211 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:07:21 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:07:22.343 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:07:21 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2023-07-14T18:07:22.343 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:07:21 smithi184 ceph-mon[98481]: osdmap e20: 3 total, 3 up, 3 in 2023-07-14T18:07:22.344 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:07:21 smithi184 ceph-mon[98481]: pgmap v73: 1 pgs: 1 creating+peering; 0 B data, 80 MiB used, 268 GiB / 268 GiB avail 2023-07-14T18:07:22.344 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:07:21 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:07:22.519 INFO:journalctl@ceph.osd.1.smithi172.stdout:Jul 14 18:07:22 smithi172 sudo[105380]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2023-07-14T18:07:22.519 INFO:journalctl@ceph.osd.1.smithi172.stdout:Jul 14 18:07:22 smithi172 sudo[105380]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2023-07-14T18:07:22.519 INFO:journalctl@ceph.osd.1.smithi172.stdout:Jul 14 18:07:22 smithi172 sudo[105380]: pam_unix(sudo:session): session opened for user root by (uid=0) 2023-07-14T18:07:22.519 INFO:journalctl@ceph.osd.1.smithi172.stdout:Jul 14 18:07:22 smithi172 sudo[105380]: pam_unix(sudo:session): session closed for user root 2023-07-14T18:07:22.596 INFO:journalctl@ceph.osd.2.smithi184.stdout:Jul 14 18:07:22 smithi184 sudo[106544]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/smartctl -x --json=o /dev/nvme0n1 2023-07-14T18:07:22.596 INFO:journalctl@ceph.osd.2.smithi184.stdout:Jul 14 18:07:22 smithi184 sudo[106544]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2023-07-14T18:07:22.596 INFO:journalctl@ceph.osd.2.smithi184.stdout:Jul 14 18:07:22 smithi184 sudo[106544]: pam_unix(sudo:session): session opened for user root by (uid=0) 2023-07-14T18:07:22.596 INFO:journalctl@ceph.osd.2.smithi184.stdout:Jul 14 18:07:22 smithi184 sudo[106544]: pam_unix(sudo:session): session closed for user root 2023-07-14T18:07:22.918 INFO:journalctl@ceph.osd.2.smithi184.stdout:Jul 14 18:07:22 smithi184 sudo[106547]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2023-07-14T18:07:22.918 INFO:journalctl@ceph.osd.2.smithi184.stdout:Jul 14 18:07:22 smithi184 sudo[106547]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2023-07-14T18:07:22.918 INFO:journalctl@ceph.osd.2.smithi184.stdout:Jul 14 18:07:22 smithi184 sudo[106547]: pam_unix(sudo:session): session opened for user root by (uid=0) 2023-07-14T18:07:22.918 INFO:journalctl@ceph.osd.2.smithi184.stdout:Jul 14 18:07:22 smithi184 sudo[106547]: pam_unix(sudo:session): session closed for user root 2023-07-14T18:07:23.125 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:07:22 smithi163 sudo[112698]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/smartctl -x --json=o /dev/nvme0n1 2023-07-14T18:07:23.125 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:07:22 smithi163 sudo[112698]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2023-07-14T18:07:23.125 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:07:22 smithi163 sudo[112698]: pam_unix(sudo:session): session opened for user root by (uid=0) 2023-07-14T18:07:23.126 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:07:22 smithi163 sudo[112698]: pam_unix(sudo:session): session closed for user root 2023-07-14T18:07:23.142 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:07:23.107+0000 7f55027fc700 1 -- 172.21.15.163:0/879925434 <== mon.0 v2:172.21.15.163:3300/0 7 ==== mgrmap(e 16) v1 ==== 135716+0+0 (secure 0 0 0) 0x7f5508096990 con 0x7f550c0ff540 2023-07-14T18:07:23.386 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:07:23 smithi184 ceph-mon[98481]: osdmap e21: 3 total, 3 up, 3 in 2023-07-14T18:07:23.386 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:07:23 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:07:23.386 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:07:23 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:07:23.386 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:07:23 smithi184 ceph-mon[98481]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2023-07-14T18:07:23.387 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:07:23 smithi184 sudo[106550]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/smartctl -x --json=o /dev/nvme0n1 2023-07-14T18:07:23.387 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:07:23 smithi184 sudo[106550]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2023-07-14T18:07:23.387 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:07:23 smithi184 sudo[106550]: pam_unix(sudo:session): session opened for user root by (uid=0) 2023-07-14T18:07:23.387 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:07:23 smithi184 sudo[106550]: pam_unix(sudo:session): session closed for user root 2023-07-14T18:07:23.460 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:07:23 smithi163 sudo[112701]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2023-07-14T18:07:23.461 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:07:23 smithi163 sudo[112701]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2023-07-14T18:07:23.461 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:07:23 smithi163 sudo[112701]: pam_unix(sudo:session): session opened for user root by (uid=0) 2023-07-14T18:07:23.461 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:07:23 smithi163 sudo[112701]: pam_unix(sudo:session): session closed for user root 2023-07-14T18:07:23.461 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:07:23 smithi163 ceph-mon[96576]: osdmap e21: 3 total, 3 up, 3 in 2023-07-14T18:07:23.461 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:07:23 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:07:23.461 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:07:23 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:07:23.461 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:07:23 smithi163 ceph-mon[96576]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2023-07-14T18:07:23.519 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:07:23 smithi172 ceph-mon[97983]: osdmap e21: 3 total, 3 up, 3 in 2023-07-14T18:07:23.519 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:07:23 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:07:23.519 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:07:23 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:07:23.519 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:07:23 smithi172 ceph-mon[97983]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2023-07-14T18:07:23.668 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:07:23 smithi184 sudo[106553]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2023-07-14T18:07:23.668 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:07:23 smithi184 sudo[106553]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2023-07-14T18:07:23.668 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:07:23 smithi184 sudo[106553]: pam_unix(sudo:session): session opened for user root by (uid=0) 2023-07-14T18:07:23.668 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:07:23 smithi184 sudo[106553]: pam_unix(sudo:session): session closed for user root 2023-07-14T18:07:24.120 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:07:23 smithi172 sudo[105383]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/smartctl -x --json=o /dev/nvme0n1 2023-07-14T18:07:24.120 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:07:23 smithi172 sudo[105383]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2023-07-14T18:07:24.120 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:07:23 smithi172 sudo[105383]: pam_unix(sudo:session): session opened for user root by (uid=0) 2023-07-14T18:07:24.121 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:07:23 smithi172 sudo[105383]: pam_unix(sudo:session): session closed for user root 2023-07-14T18:07:24.418 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:07:24 smithi184 ceph-mon[98481]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2023-07-14T18:07:24.418 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:07:24 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-07-14T18:07:24.418 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:07:24 smithi184 ceph-mon[98481]: from='client.? 172.21.15.163:0/1067444851' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "dcee9576-0bc6-4ab0-8f63-79eacd0eca5f"}]: dispatch 2023-07-14T18:07:24.419 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:07:24 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-07-14T18:07:24.419 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:07:24 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-07-14T18:07:24.419 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:07:24 smithi184 ceph-mon[98481]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2023-07-14T18:07:24.419 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:07:24 smithi184 ceph-mon[98481]: mgrmap e16: x(active, since 2m), standbys: z, y 2023-07-14T18:07:24.419 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:07:24 smithi184 ceph-mon[98481]: from='client.? 172.21.15.163:0/1067444851' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "dcee9576-0bc6-4ab0-8f63-79eacd0eca5f"}]': finished 2023-07-14T18:07:24.419 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:07:24 smithi184 ceph-mon[98481]: osdmap e22: 4 total, 3 up, 4 in 2023-07-14T18:07:24.419 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:07:24 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-07-14T18:07:24.420 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:07:24 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-07-14T18:07:24.420 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:07:24 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-07-14T18:07:24.420 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:07:24 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-07-14T18:07:24.420 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:07:24 smithi184 ceph-mon[98481]: pgmap v76: 1 pgs: 1 creating+peering; 0 B data, 80 MiB used, 268 GiB / 268 GiB avail 2023-07-14T18:07:24.420 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:07:24 smithi184 ceph-mon[98481]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2023-07-14T18:07:24.420 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:07:24 smithi184 ceph-mon[98481]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2023-07-14T18:07:24.420 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:07:24 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-07-14T18:07:24.421 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:07:24 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-07-14T18:07:24.421 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:07:24 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-07-14T18:07:24.421 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:07:24 smithi184 ceph-mon[98481]: from='client.? 172.21.15.163:0/3346698721' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-07-14T18:07:24.421 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:07:24 smithi184 ceph-mon[98481]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2023-07-14T18:07:24.461 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:07:24 smithi163 ceph-mon[96576]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2023-07-14T18:07:24.461 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:07:24 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-07-14T18:07:24.461 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:07:24 smithi163 ceph-mon[96576]: from='client.? 172.21.15.163:0/1067444851' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "dcee9576-0bc6-4ab0-8f63-79eacd0eca5f"}]: dispatch 2023-07-14T18:07:24.461 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:07:24 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-07-14T18:07:24.461 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:07:24 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-07-14T18:07:24.462 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:07:24 smithi163 ceph-mon[96576]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2023-07-14T18:07:24.462 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:07:24 smithi163 ceph-mon[96576]: mgrmap e16: x(active, since 2m), standbys: z, y 2023-07-14T18:07:24.462 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:07:24 smithi163 ceph-mon[96576]: from='client.? 172.21.15.163:0/1067444851' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "dcee9576-0bc6-4ab0-8f63-79eacd0eca5f"}]': finished 2023-07-14T18:07:24.462 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:07:24 smithi163 ceph-mon[96576]: osdmap e22: 4 total, 3 up, 4 in 2023-07-14T18:07:24.462 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:07:24 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-07-14T18:07:24.462 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:07:24 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-07-14T18:07:24.462 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:07:24 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-07-14T18:07:24.462 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:07:24 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-07-14T18:07:24.463 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:07:24 smithi163 ceph-mon[96576]: pgmap v76: 1 pgs: 1 creating+peering; 0 B data, 80 MiB used, 268 GiB / 268 GiB avail 2023-07-14T18:07:24.463 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:07:24 smithi163 ceph-mon[96576]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2023-07-14T18:07:24.463 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:07:24 smithi163 ceph-mon[96576]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2023-07-14T18:07:24.463 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:07:24 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-07-14T18:07:24.463 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:07:24 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-07-14T18:07:24.463 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:07:24 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-07-14T18:07:24.463 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:07:24 smithi163 ceph-mon[96576]: from='client.? 172.21.15.163:0/3346698721' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-07-14T18:07:24.464 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:07:24 smithi163 ceph-mon[96576]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2023-07-14T18:07:24.519 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:07:24 smithi172 sudo[105386]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2023-07-14T18:07:24.519 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:07:24 smithi172 sudo[105386]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2023-07-14T18:07:24.519 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:07:24 smithi172 sudo[105386]: pam_unix(sudo:session): session opened for user root by (uid=0) 2023-07-14T18:07:24.519 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:07:24 smithi172 sudo[105386]: pam_unix(sudo:session): session closed for user root 2023-07-14T18:07:24.520 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:07:24 smithi172 ceph-mon[97983]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2023-07-14T18:07:24.520 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:07:24 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-07-14T18:07:24.520 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:07:24 smithi172 ceph-mon[97983]: from='client.? 172.21.15.163:0/1067444851' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "dcee9576-0bc6-4ab0-8f63-79eacd0eca5f"}]: dispatch 2023-07-14T18:07:24.520 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:07:24 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-07-14T18:07:24.520 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:07:24 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-07-14T18:07:24.520 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:07:24 smithi172 ceph-mon[97983]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2023-07-14T18:07:24.520 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:07:24 smithi172 ceph-mon[97983]: mgrmap e16: x(active, since 2m), standbys: z, y 2023-07-14T18:07:24.521 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:07:24 smithi172 ceph-mon[97983]: from='client.? 172.21.15.163:0/1067444851' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "dcee9576-0bc6-4ab0-8f63-79eacd0eca5f"}]': finished 2023-07-14T18:07:24.521 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:07:24 smithi172 ceph-mon[97983]: osdmap e22: 4 total, 3 up, 4 in 2023-07-14T18:07:24.521 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:07:24 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-07-14T18:07:24.521 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:07:24 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-07-14T18:07:24.521 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:07:24 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-07-14T18:07:24.521 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:07:24 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-07-14T18:07:24.521 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:07:24 smithi172 ceph-mon[97983]: pgmap v76: 1 pgs: 1 creating+peering; 0 B data, 80 MiB used, 268 GiB / 268 GiB avail 2023-07-14T18:07:24.521 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:07:24 smithi172 ceph-mon[97983]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2023-07-14T18:07:24.522 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:07:24 smithi172 ceph-mon[97983]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2023-07-14T18:07:24.522 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:07:24 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-07-14T18:07:24.522 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:07:24 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-07-14T18:07:24.522 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:07:24 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-07-14T18:07:24.522 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:07:24 smithi172 ceph-mon[97983]: from='client.? 172.21.15.163:0/3346698721' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-07-14T18:07:24.522 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:07:24 smithi172 ceph-mon[97983]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2023-07-14T18:07:27.019 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:07:26 smithi172 ceph-mon[97983]: pgmap v77: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2023-07-14T18:07:27.132 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:07:26 smithi163 ceph-mon[96576]: pgmap v77: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2023-07-14T18:07:27.168 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:07:26 smithi184 ceph-mon[98481]: pgmap v77: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2023-07-14T18:07:28.874 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:07:28 smithi163 ceph-mon[96576]: pgmap v78: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2023-07-14T18:07:29.019 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:07:28 smithi172 ceph-mon[97983]: pgmap v78: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2023-07-14T18:07:29.168 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:07:28 smithi184 ceph-mon[98481]: pgmap v78: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2023-07-14T18:07:29.960 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:07:29 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2023-07-14T18:07:29.961 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:07:29 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T18:07:30.019 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:07:29 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2023-07-14T18:07:30.019 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:07:29 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T18:07:30.168 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:07:29 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2023-07-14T18:07:30.168 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:07:29 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T18:07:30.960 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:07:30 smithi163 ceph-mon[96576]: pgmap v79: 1 pgs: 1 active+clean; 577 KiB data, 83 MiB used, 268 GiB / 268 GiB avail 2023-07-14T18:07:30.961 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:07:30 smithi163 ceph-mon[96576]: Deploying daemon osd.3 on smithi163 2023-07-14T18:07:31.019 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:07:30 smithi172 ceph-mon[97983]: pgmap v79: 1 pgs: 1 active+clean; 577 KiB data, 83 MiB used, 268 GiB / 268 GiB avail 2023-07-14T18:07:31.019 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:07:30 smithi172 ceph-mon[97983]: Deploying daemon osd.3 on smithi163 2023-07-14T18:07:31.168 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:07:30 smithi184 ceph-mon[98481]: pgmap v79: 1 pgs: 1 active+clean; 577 KiB data, 83 MiB used, 268 GiB / 268 GiB avail 2023-07-14T18:07:31.168 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:07:30 smithi184 ceph-mon[98481]: Deploying daemon osd.3 on smithi163 2023-07-14T18:07:32.961 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:07:32 smithi163 ceph-mon[96576]: pgmap v80: 1 pgs: 1 active+clean; 577 KiB data, 83 MiB used, 268 GiB / 268 GiB avail 2023-07-14T18:07:33.019 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:07:32 smithi172 ceph-mon[97983]: pgmap v80: 1 pgs: 1 active+clean; 577 KiB data, 83 MiB used, 268 GiB / 268 GiB avail 2023-07-14T18:07:33.168 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:07:32 smithi184 ceph-mon[98481]: pgmap v80: 1 pgs: 1 active+clean; 577 KiB data, 83 MiB used, 268 GiB / 268 GiB avail 2023-07-14T18:07:34.843 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:07:34 smithi163 ceph-mon[96576]: pgmap v81: 1 pgs: 1 active+clean; 577 KiB data, 83 MiB used, 268 GiB / 268 GiB avail 2023-07-14T18:07:34.843 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:07:34 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:07:34.844 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:07:34 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:07:34.844 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:07:34 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-14T18:07:35.019 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:07:34 smithi172 ceph-mon[97983]: pgmap v81: 1 pgs: 1 active+clean; 577 KiB data, 83 MiB used, 268 GiB / 268 GiB avail 2023-07-14T18:07:35.020 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:07:34 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:07:35.020 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:07:34 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:07:35.020 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:07:34 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-14T18:07:35.168 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:07:34 smithi184 ceph-mon[98481]: pgmap v81: 1 pgs: 1 active+clean; 577 KiB data, 83 MiB used, 268 GiB / 268 GiB avail 2023-07-14T18:07:35.168 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:07:34 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:07:35.168 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:07:34 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:07:35.169 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:07:34 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-14T18:07:36.847 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:07:36.813+0000 7f55027fc700 1 -- 172.21.15.163:0/879925434 <== mgr.14152 v2:172.21.15.163:6800/1949590926 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f550c105c90 con 0x7f54f80a10c0 2023-07-14T18:07:36.848 INFO:teuthology.orchestra.run.smithi163.stdout:Created osd(s) 3 on host 'smithi163' 2023-07-14T18:07:36.849 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:07:36.815+0000 7f5513546700 1 -- 172.21.15.163:0/879925434 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f54f80a10c0 msgr2=0x7f54f80a3570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:07:36.850 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:07:36.815+0000 7f5513546700 1 --2- 172.21.15.163:0/879925434 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f54f80a10c0 0x7f54f80a3570 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f550c0ff3a0 tx=0x7f54fc007400 comp rx=0 tx=0).stop 2023-07-14T18:07:36.850 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:07:36.815+0000 7f5513546700 1 -- 172.21.15.163:0/879925434 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f550c0ff540 msgr2=0x7f550c195e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:07:36.850 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:07:36.815+0000 7f5513546700 1 --2- 172.21.15.163:0/879925434 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f550c0ff540 0x7f550c195e90 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f550800e9d0 tx=0x7f550800ece0 comp rx=0 tx=0).stop 2023-07-14T18:07:36.850 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:07:36.815+0000 7f5513546700 1 -- 172.21.15.163:0/879925434 shutdown_connections 2023-07-14T18:07:36.850 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:07:36.815+0000 7f5513546700 1 --2- 172.21.15.163:0/879925434 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f54f80a10c0 0x7f54f80a3570 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:07:36.850 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:07:36.815+0000 7f5513546700 1 --2- 172.21.15.163:0/879925434 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f550c0ffed0 0x7f550c19cf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:07:36.850 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:07:36.815+0000 7f5513546700 1 --2- 172.21.15.163:0/879925434 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f550c0fe340 0x7f550c195950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:07:36.850 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:07:36.815+0000 7f5513546700 1 --2- 172.21.15.163:0/879925434 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f550c0ff540 0x7f550c195e90 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:07:36.851 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:07:36.815+0000 7f5513546700 1 -- 172.21.15.163:0/879925434 >> 172.21.15.163:0/879925434 conn(0x7f550c0f9990 msgr2=0x7f550c0fbbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:07:36.851 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:07:36.815+0000 7f5513546700 1 -- 172.21.15.163:0/879925434 shutdown_connections 2023-07-14T18:07:36.851 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:07:36.815+0000 7f5513546700 1 -- 172.21.15.163:0/879925434 wait complete. 2023-07-14T18:07:37.003 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:07:36 smithi163 ceph-mon[96576]: pgmap v82: 1 pgs: 1 active+clean; 577 KiB data, 83 MiB used, 268 GiB / 268 GiB avail 2023-07-14T18:07:37.004 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:07:36 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:07:37.004 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:07:36 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:07:37.004 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:07:36 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T18:07:37.004 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:07:36 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-14T18:07:37.004 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:07:36 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:07:37.019 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:07:36 smithi172 ceph-mon[97983]: pgmap v82: 1 pgs: 1 active+clean; 577 KiB data, 83 MiB used, 268 GiB / 268 GiB avail 2023-07-14T18:07:37.019 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:07:36 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:07:37.019 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:07:36 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:07:37.020 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:07:36 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T18:07:37.020 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:07:36 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-14T18:07:37.020 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:07:36 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:07:37.168 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:07:36 smithi184 ceph-mon[98481]: pgmap v82: 1 pgs: 1 active+clean; 577 KiB data, 83 MiB used, 268 GiB / 268 GiB avail 2023-07-14T18:07:37.168 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:07:36 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:07:37.169 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:07:36 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:07:37.169 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:07:36 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T18:07:37.169 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:07:36 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-14T18:07:37.169 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:07:36 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:07:37.322 DEBUG:teuthology.orchestra.run.smithi163:osd.3> sudo journalctl -f -n 0 -u ceph-bf7326ec-2270-11ee-9b33-001a4aab830c@osd.3.service 2023-07-14T18:07:37.324 INFO:tasks.cephadm:Deploying osd.4 on smithi172 with /dev/vg_nvme/lv_3... 2023-07-14T18:07:37.324 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81c9387d2e7576da065747ec9c16d1c7d69016ec shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bf7326ec-2270-11ee-9b33-001a4aab830c -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2023-07-14T18:07:37.357 INFO:journalctl@ceph.osd.3.smithi163.stdout:-- Logs begin at Fri 2023-07-14 17:46:25 UTC. -- 2023-07-14T18:07:37.888 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/bf7326ec-2270-11ee-9b33-001a4aab830c/mon.b/config 2023-07-14T18:07:38.101 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:07:37 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:07:38.101 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:07:37 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:07:38.101 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:07:37 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-14T18:07:38.102 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:07:37 smithi172 ceph-mon[97983]: pgmap v83: 1 pgs: 1 active+clean; 577 KiB data, 83 MiB used, 268 GiB / 268 GiB avail 2023-07-14T18:07:38.162 INFO:journalctl@ceph.osd.3.smithi163.stdout:Jul 14 18:07:37 smithi163 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-3[114961]: 2023-07-14T18:07:37.968+0000 7f91d53bb640 -1 osd.3 0 log_to_monitors true 2023-07-14T18:07:38.162 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:07:37 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:07:38.162 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:07:37 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:07:38.163 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:07:37 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-14T18:07:38.163 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:07:37 smithi163 ceph-mon[96576]: pgmap v83: 1 pgs: 1 active+clean; 577 KiB data, 83 MiB used, 268 GiB / 268 GiB avail 2023-07-14T18:07:38.168 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:07:37 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:07:38.168 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:07:37 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:07:38.168 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:07:37 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-14T18:07:38.168 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:07:37 smithi184 ceph-mon[98481]: pgmap v83: 1 pgs: 1 active+clean; 577 KiB data, 83 MiB used, 268 GiB / 268 GiB avail 2023-07-14T18:07:38.961 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:07:38 smithi163 ceph-mon[96576]: from='osd.3 [v2:172.21.15.163:6810/2589130694,v1:172.21.15.163:6811/2589130694]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2023-07-14T18:07:38.967 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:07:38 smithi172 ceph-mon[97983]: from='osd.3 [v2:172.21.15.163:6810/2589130694,v1:172.21.15.163:6811/2589130694]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2023-07-14T18:07:39.168 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:07:38 smithi184 ceph-mon[98481]: from='osd.3 [v2:172.21.15.163:6810/2589130694,v1:172.21.15.163:6811/2589130694]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2023-07-14T18:07:39.475 INFO:teuthology.orchestra.run.smithi172.stderr:--> Zapping: /dev/vg_nvme/lv_3 2023-07-14T18:07:39.475 INFO:teuthology.orchestra.run.smithi172.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2023-07-14T18:07:39.475 INFO:teuthology.orchestra.run.smithi172.stderr: stderr: 10+0 records in 2023-07-14T18:07:39.475 INFO:teuthology.orchestra.run.smithi172.stderr:10+0 records out 2023-07-14T18:07:39.476 INFO:teuthology.orchestra.run.smithi172.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0111952 s, 937 MB/s 2023-07-14T18:07:39.476 INFO:teuthology.orchestra.run.smithi172.stderr:--> Zapping successful for: 2023-07-14T18:07:39.944 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81c9387d2e7576da065747ec9c16d1c7d69016ec shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bf7326ec-2270-11ee-9b33-001a4aab830c -- ceph orch daemon add osd smithi172:vg_nvme/lv_3 2023-07-14T18:07:40.168 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:07:39 smithi184 ceph-mon[98481]: from='osd.3 [v2:172.21.15.163:6810/2589130694,v1:172.21.15.163:6811/2589130694]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2023-07-14T18:07:40.169 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:07:39 smithi184 ceph-mon[98481]: osdmap e23: 4 total, 3 up, 4 in 2023-07-14T18:07:40.169 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:07:39 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-07-14T18:07:40.169 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:07:39 smithi184 ceph-mon[98481]: from='osd.3 [v2:172.21.15.163:6810/2589130694,v1:172.21.15.163:6811/2589130694]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi163", "root=default"]}]: dispatch 2023-07-14T18:07:40.169 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:07:39 smithi184 ceph-mon[98481]: pgmap v85: 1 pgs: 1 active+clean; 577 KiB data, 83 MiB used, 268 GiB / 268 GiB avail 2023-07-14T18:07:40.169 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:07:39 smithi184 ceph-mon[98481]: Detected new or changed devices on smithi163 2023-07-14T18:07:40.169 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:07:39 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:07:40.169 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:07:39 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:07:40.170 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:07:39 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-07-14T18:07:40.170 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:07:39 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-07-14T18:07:40.170 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:07:39 smithi184 ceph-mon[98481]: Adjusting osd_memory_target on smithi163 to 8584M 2023-07-14T18:07:40.170 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:07:39 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:07:40.170 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:07:39 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T18:07:40.170 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:07:39 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-14T18:07:40.170 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:07:39 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:07:40.211 INFO:journalctl@ceph.osd.3.smithi163.stdout:Jul 14 18:07:39 smithi163 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-3[114961]: 2023-07-14T18:07:39.778+0000 7f91caa33700 -1 osd.3 0 waiting for initial osdmap 2023-07-14T18:07:40.211 INFO:journalctl@ceph.osd.3.smithi163.stdout:Jul 14 18:07:39 smithi163 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-3[114961]: 2023-07-14T18:07:39.784+0000 7f91c4825700 -1 osd.3 24 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-07-14T18:07:40.212 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:07:39 smithi163 ceph-mon[96576]: from='osd.3 [v2:172.21.15.163:6810/2589130694,v1:172.21.15.163:6811/2589130694]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2023-07-14T18:07:40.212 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:07:39 smithi163 ceph-mon[96576]: osdmap e23: 4 total, 3 up, 4 in 2023-07-14T18:07:40.212 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:07:39 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-07-14T18:07:40.212 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:07:39 smithi163 ceph-mon[96576]: from='osd.3 [v2:172.21.15.163:6810/2589130694,v1:172.21.15.163:6811/2589130694]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi163", "root=default"]}]: dispatch 2023-07-14T18:07:40.212 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:07:39 smithi163 ceph-mon[96576]: pgmap v85: 1 pgs: 1 active+clean; 577 KiB data, 83 MiB used, 268 GiB / 268 GiB avail 2023-07-14T18:07:40.212 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:07:39 smithi163 ceph-mon[96576]: Detected new or changed devices on smithi163 2023-07-14T18:07:40.212 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:07:39 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:07:40.213 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:07:39 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:07:40.213 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:07:39 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-07-14T18:07:40.213 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:07:39 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-07-14T18:07:40.213 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:07:39 smithi163 ceph-mon[96576]: Adjusting osd_memory_target on smithi163 to 8584M 2023-07-14T18:07:40.213 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:07:39 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:07:40.214 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:07:39 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T18:07:40.214 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:07:39 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-14T18:07:40.214 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:07:39 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:07:40.269 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:07:39 smithi172 ceph-mon[97983]: from='osd.3 [v2:172.21.15.163:6810/2589130694,v1:172.21.15.163:6811/2589130694]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2023-07-14T18:07:40.270 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:07:39 smithi172 ceph-mon[97983]: osdmap e23: 4 total, 3 up, 4 in 2023-07-14T18:07:40.270 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:07:39 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-07-14T18:07:40.270 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:07:39 smithi172 ceph-mon[97983]: from='osd.3 [v2:172.21.15.163:6810/2589130694,v1:172.21.15.163:6811/2589130694]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi163", "root=default"]}]: dispatch 2023-07-14T18:07:40.270 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:07:39 smithi172 ceph-mon[97983]: pgmap v85: 1 pgs: 1 active+clean; 577 KiB data, 83 MiB used, 268 GiB / 268 GiB avail 2023-07-14T18:07:40.270 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:07:39 smithi172 ceph-mon[97983]: Detected new or changed devices on smithi163 2023-07-14T18:07:40.270 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:07:39 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:07:40.271 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:07:39 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:07:40.271 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:07:39 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-07-14T18:07:40.271 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:07:39 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-07-14T18:07:40.271 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:07:39 smithi172 ceph-mon[97983]: Adjusting osd_memory_target on smithi163 to 8584M 2023-07-14T18:07:40.271 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:07:39 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:07:40.271 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:07:39 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T18:07:40.271 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:07:39 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-14T18:07:40.271 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:07:39 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:07:40.493 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/bf7326ec-2270-11ee-9b33-001a4aab830c/mon.b/config 2023-07-14T18:07:41.020 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:07:40 smithi172 ceph-mon[97983]: from='osd.3 [v2:172.21.15.163:6810/2589130694,v1:172.21.15.163:6811/2589130694]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi163", "root=default"]}]': finished 2023-07-14T18:07:41.020 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:07:40 smithi172 ceph-mon[97983]: osdmap e24: 4 total, 3 up, 4 in 2023-07-14T18:07:41.020 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:07:40 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-07-14T18:07:41.020 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:07:40 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-07-14T18:07:41.020 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:07:40 smithi172 ceph-mon[97983]: osd.3 [v2:172.21.15.163:6810/2589130694,v1:172.21.15.163:6811/2589130694] boot 2023-07-14T18:07:41.021 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:07:40 smithi172 ceph-mon[97983]: osdmap e25: 4 total, 4 up, 4 in 2023-07-14T18:07:41.021 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:07:40 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-07-14T18:07:41.168 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:07:40 smithi184 ceph-mon[98481]: from='osd.3 [v2:172.21.15.163:6810/2589130694,v1:172.21.15.163:6811/2589130694]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi163", "root=default"]}]': finished 2023-07-14T18:07:41.169 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:07:40 smithi184 ceph-mon[98481]: osdmap e24: 4 total, 3 up, 4 in 2023-07-14T18:07:41.169 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:07:40 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-07-14T18:07:41.169 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:07:40 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-07-14T18:07:41.170 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:07:40 smithi184 ceph-mon[98481]: osd.3 [v2:172.21.15.163:6810/2589130694,v1:172.21.15.163:6811/2589130694] boot 2023-07-14T18:07:41.170 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:07:40 smithi184 ceph-mon[98481]: osdmap e25: 4 total, 4 up, 4 in 2023-07-14T18:07:41.170 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:07:40 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-07-14T18:07:41.211 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:07:40 smithi163 ceph-mon[96576]: from='osd.3 [v2:172.21.15.163:6810/2589130694,v1:172.21.15.163:6811/2589130694]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi163", "root=default"]}]': finished 2023-07-14T18:07:41.211 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:07:40 smithi163 ceph-mon[96576]: osdmap e24: 4 total, 3 up, 4 in 2023-07-14T18:07:41.211 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:07:40 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-07-14T18:07:41.211 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:07:40 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-07-14T18:07:41.211 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:07:40 smithi163 ceph-mon[96576]: osd.3 [v2:172.21.15.163:6810/2589130694,v1:172.21.15.163:6811/2589130694] boot 2023-07-14T18:07:41.212 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:07:40 smithi163 ceph-mon[96576]: osdmap e25: 4 total, 4 up, 4 in 2023-07-14T18:07:41.212 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:07:40 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-07-14T18:07:41.717 INFO:teuthology.orchestra.run.smithi172.stderr:2023-07-14T18:07:41.682+0000 7feb8b9e3700 1 -- 172.21.15.172:0/4169772867 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7feb84100740 msgr2=0x7feb84107000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:07:41.718 INFO:teuthology.orchestra.run.smithi172.stderr:2023-07-14T18:07:41.682+0000 7feb8b9e3700 1 --2- 172.21.15.172:0/4169772867 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7feb84100740 0x7feb84107000 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7feb7c00b0a0 tx=0x7feb7c00b3b0 comp rx=0 tx=0).stop 2023-07-14T18:07:41.718 INFO:teuthology.orchestra.run.smithi172.stderr:2023-07-14T18:07:41.682+0000 7feb8b9e3700 1 -- 172.21.15.172:0/4169772867 shutdown_connections 2023-07-14T18:07:41.718 INFO:teuthology.orchestra.run.smithi172.stderr:2023-07-14T18:07:41.682+0000 7feb8b9e3700 1 --2- 172.21.15.172:0/4169772867 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7feb84100740 0x7feb84107000 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:07:41.718 INFO:teuthology.orchestra.run.smithi172.stderr:2023-07-14T18:07:41.682+0000 7feb8b9e3700 1 --2- 172.21.15.172:0/4169772867 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7feb840febb0 0x7feb840fefc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:07:41.718 INFO:teuthology.orchestra.run.smithi172.stderr:2023-07-14T18:07:41.682+0000 7feb8b9e3700 1 --2- 172.21.15.172:0/4169772867 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7feb840ffdb0 0x7feb84100200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:07:41.718 INFO:teuthology.orchestra.run.smithi172.stderr:2023-07-14T18:07:41.682+0000 7feb8b9e3700 1 -- 172.21.15.172:0/4169772867 >> 172.21.15.172:0/4169772867 conn(0x7feb840fa1e0 msgr2=0x7feb840fc630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:07:41.718 INFO:teuthology.orchestra.run.smithi172.stderr:2023-07-14T18:07:41.682+0000 7feb8b9e3700 1 -- 172.21.15.172:0/4169772867 shutdown_connections 2023-07-14T18:07:41.719 INFO:teuthology.orchestra.run.smithi172.stderr:2023-07-14T18:07:41.682+0000 7feb8b9e3700 1 -- 172.21.15.172:0/4169772867 wait complete. 2023-07-14T18:07:41.720 INFO:teuthology.orchestra.run.smithi172.stderr:2023-07-14T18:07:41.683+0000 7feb8b9e3700 1 Processor -- start 2023-07-14T18:07:41.720 INFO:teuthology.orchestra.run.smithi172.stderr:2023-07-14T18:07:41.683+0000 7feb8b9e3700 1 -- start start 2023-07-14T18:07:41.721 INFO:teuthology.orchestra.run.smithi172.stderr:2023-07-14T18:07:41.683+0000 7feb8b9e3700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7feb840febb0 0x7feb84194920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:07:41.721 INFO:teuthology.orchestra.run.smithi172.stderr:2023-07-14T18:07:41.683+0000 7feb8b9e3700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7feb840ffdb0 0x7feb84194e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:07:41.721 INFO:teuthology.orchestra.run.smithi172.stderr:2023-07-14T18:07:41.683+0000 7feb8b9e3700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7feb84100740 0x7feb8419bee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:07:41.721 INFO:teuthology.orchestra.run.smithi172.stderr:2023-07-14T18:07:41.683+0000 7feb8b9e3700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb8419c4b0 con 0x7feb840febb0 2023-07-14T18:07:41.721 INFO:teuthology.orchestra.run.smithi172.stderr:2023-07-14T18:07:41.683+0000 7feb8b9e3700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb8419c5f0 con 0x7feb84100740 2023-07-14T18:07:41.721 INFO:teuthology.orchestra.run.smithi172.stderr:2023-07-14T18:07:41.684+0000 7feb8b9e3700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb8419c780 con 0x7feb840ffdb0 2023-07-14T18:07:41.721 INFO:teuthology.orchestra.run.smithi172.stderr:2023-07-14T18:07:41.684+0000 7feb89f80700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7feb84100740 0x7feb8419bee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:07:41.722 INFO:teuthology.orchestra.run.smithi172.stderr:2023-07-14T18:07:41.684+0000 7feb89f80700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7feb84100740 0x7feb8419bee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:34418/0 (socket says 172.21.15.172:34418) 2023-07-14T18:07:41.722 INFO:teuthology.orchestra.run.smithi172.stderr:2023-07-14T18:07:41.684+0000 7feb89f80700 1 -- 172.21.15.172:0/2139542157 learned_addr learned my addr 172.21.15.172:0/2139542157 (peer_addr_for_me v2:172.21.15.172:0/0) 2023-07-14T18:07:41.722 INFO:teuthology.orchestra.run.smithi172.stderr:2023-07-14T18:07:41.684+0000 7feb8977f700 1 --2- 172.21.15.172:0/2139542157 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7feb840febb0 0x7feb84194920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:07:41.722 INFO:teuthology.orchestra.run.smithi172.stderr:2023-07-14T18:07:41.684+0000 7feb88f7e700 1 --2- 172.21.15.172:0/2139542157 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7feb840ffdb0 0x7feb84194e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:07:41.722 INFO:teuthology.orchestra.run.smithi172.stderr:2023-07-14T18:07:41.684+0000 7feb89f80700 1 -- 172.21.15.172:0/2139542157 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7feb840ffdb0 msgr2=0x7feb84194e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:07:41.722 INFO:teuthology.orchestra.run.smithi172.stderr:2023-07-14T18:07:41.684+0000 7feb89f80700 1 --2- 172.21.15.172:0/2139542157 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7feb840ffdb0 0x7feb84194e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:07:41.722 INFO:teuthology.orchestra.run.smithi172.stderr:2023-07-14T18:07:41.684+0000 7feb89f80700 1 -- 172.21.15.172:0/2139542157 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7feb840febb0 msgr2=0x7feb84194920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:07:41.723 INFO:teuthology.orchestra.run.smithi172.stderr:2023-07-14T18:07:41.684+0000 7feb89f80700 1 --2- 172.21.15.172:0/2139542157 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7feb840febb0 0x7feb84194920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:07:41.723 INFO:teuthology.orchestra.run.smithi172.stderr:2023-07-14T18:07:41.684+0000 7feb89f80700 1 -- 172.21.15.172:0/2139542157 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb7c009d00 con 0x7feb84100740 2023-07-14T18:07:41.723 INFO:teuthology.orchestra.run.smithi172.stderr:2023-07-14T18:07:41.684+0000 7feb89f80700 1 --2- 172.21.15.172:0/2139542157 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7feb84100740 0x7feb8419bee0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7feb7c0062a0 tx=0x7feb7c004d00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:07:41.723 INFO:teuthology.orchestra.run.smithi172.stderr:2023-07-14T18:07:41.684+0000 7feb767fc700 1 -- 172.21.15.172:0/2139542157 <== mon.2 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb7c00e040 con 0x7feb84100740 2023-07-14T18:07:41.723 INFO:teuthology.orchestra.run.smithi172.stderr:2023-07-14T18:07:41.684+0000 7feb767fc700 1 -- 172.21.15.172:0/2139542157 <== mon.2 v2:172.21.15.172:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7feb7c01db20 con 0x7feb84100740 2023-07-14T18:07:41.723 INFO:teuthology.orchestra.run.smithi172.stderr:2023-07-14T18:07:41.684+0000 7feb8b9e3700 1 -- 172.21.15.172:0/2139542157 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feb8419ca00 con 0x7feb84100740 2023-07-14T18:07:41.723 INFO:teuthology.orchestra.run.smithi172.stderr:2023-07-14T18:07:41.684+0000 7feb767fc700 1 -- 172.21.15.172:0/2139542157 <== mon.2 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb7c01bae0 con 0x7feb84100740 2023-07-14T18:07:41.724 INFO:teuthology.orchestra.run.smithi172.stderr:2023-07-14T18:07:41.684+0000 7feb8b9e3700 1 -- 172.21.15.172:0/2139542157 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb8419cef0 con 0x7feb84100740 2023-07-14T18:07:41.724 INFO:teuthology.orchestra.run.smithi172.stderr:2023-07-14T18:07:41.685+0000 7feb8b9e3700 1 -- 172.21.15.172:0/2139542157 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feb84106150 con 0x7feb84100740 2023-07-14T18:07:41.725 INFO:teuthology.orchestra.run.smithi172.stderr:2023-07-14T18:07:41.686+0000 7feb767fc700 1 -- 172.21.15.172:0/2139542157 <== mon.2 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 16) v1 ==== 135716+0+0 (secure 0 0 0) 0x7feb7c01dc90 con 0x7feb84100740 2023-07-14T18:07:41.725 INFO:teuthology.orchestra.run.smithi172.stderr:2023-07-14T18:07:41.687+0000 7feb767fc700 1 --2- 172.21.15.172:0/2139542157 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7feb700a1150 0x7feb700a3600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:07:41.725 INFO:teuthology.orchestra.run.smithi172.stderr:2023-07-14T18:07:41.687+0000 7feb767fc700 1 -- 172.21.15.172:0/2139542157 <== mon.2 v2:172.21.15.172:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 3702+0+0 (secure 0 0 0) 0x7feb7c0cdd30 con 0x7feb84100740 2023-07-14T18:07:41.725 INFO:teuthology.orchestra.run.smithi172.stderr:2023-07-14T18:07:41.687+0000 7feb8977f700 1 --2- 172.21.15.172:0/2139542157 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7feb700a1150 0x7feb700a3600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:07:41.726 INFO:teuthology.orchestra.run.smithi172.stderr:2023-07-14T18:07:41.688+0000 7feb8977f700 1 --2- 172.21.15.172:0/2139542157 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7feb700a1150 0x7feb700a3600 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7feb840ffc10 tx=0x7feb8000b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:07:41.726 INFO:teuthology.orchestra.run.smithi172.stderr:2023-07-14T18:07:41.690+0000 7feb767fc700 1 -- 172.21.15.172:0/2139542157 <== mon.2 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178025 (secure 0 0 0) 0x7feb7c098710 con 0x7feb84100740 2023-07-14T18:07:41.920 INFO:teuthology.orchestra.run.smithi172.stderr:2023-07-14T18:07:41.885+0000 7feb8b9e3700 1 -- 172.21.15.172:0/2139542157 --> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi172:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) v1 -- 0x7feb84060a80 con 0x7feb700a1150 2023-07-14T18:07:42.168 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:07:41 smithi184 ceph-mon[98481]: purged_snaps scrub starts 2023-07-14T18:07:42.168 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:07:41 smithi184 ceph-mon[98481]: purged_snaps scrub ok 2023-07-14T18:07:42.169 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:07:41 smithi184 ceph-mon[98481]: pgmap v88: 1 pgs: 1 peering; 577 KiB data, 109 MiB used, 358 GiB / 358 GiB avail 2023-07-14T18:07:42.169 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:07:41 smithi184 ceph-mon[98481]: osdmap e26: 4 total, 4 up, 4 in 2023-07-14T18:07:42.211 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:07:41 smithi163 ceph-mon[96576]: purged_snaps scrub starts 2023-07-14T18:07:42.211 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:07:41 smithi163 ceph-mon[96576]: purged_snaps scrub ok 2023-07-14T18:07:42.211 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:07:41 smithi163 ceph-mon[96576]: pgmap v88: 1 pgs: 1 peering; 577 KiB data, 109 MiB used, 358 GiB / 358 GiB avail 2023-07-14T18:07:42.211 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:07:41 smithi163 ceph-mon[96576]: osdmap e26: 4 total, 4 up, 4 in 2023-07-14T18:07:42.269 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:07:41 smithi172 ceph-mon[97983]: purged_snaps scrub starts 2023-07-14T18:07:42.269 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:07:41 smithi172 ceph-mon[97983]: purged_snaps scrub ok 2023-07-14T18:07:42.269 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:07:41 smithi172 ceph-mon[97983]: pgmap v88: 1 pgs: 1 peering; 577 KiB data, 109 MiB used, 358 GiB / 358 GiB avail 2023-07-14T18:07:42.270 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:07:41 smithi172 ceph-mon[97983]: osdmap e26: 4 total, 4 up, 4 in 2023-07-14T18:07:43.019 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:07:42 smithi172 ceph-mon[97983]: from='client.24209 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi172:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2023-07-14T18:07:43.019 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:07:42 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-07-14T18:07:43.020 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:07:42 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-07-14T18:07:43.020 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:07:42 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T18:07:43.020 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:07:42 smithi172 ceph-mon[97983]: osdmap e27: 4 total, 4 up, 4 in 2023-07-14T18:07:43.168 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:07:42 smithi184 ceph-mon[98481]: from='client.24209 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi172:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2023-07-14T18:07:43.168 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:07:42 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-07-14T18:07:43.169 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:07:42 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-07-14T18:07:43.169 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:07:42 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T18:07:43.169 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:07:42 smithi184 ceph-mon[98481]: osdmap e27: 4 total, 4 up, 4 in 2023-07-14T18:07:43.211 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:07:42 smithi163 ceph-mon[96576]: from='client.24209 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi172:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2023-07-14T18:07:43.211 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:07:42 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-07-14T18:07:43.211 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:07:42 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-07-14T18:07:43.211 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:07:42 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T18:07:43.212 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:07:42 smithi163 ceph-mon[96576]: osdmap e27: 4 total, 4 up, 4 in 2023-07-14T18:07:44.168 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:07:43 smithi184 ceph-mon[98481]: pgmap v91: 1 pgs: 1 peering; 577 KiB data, 109 MiB used, 358 GiB / 358 GiB avail 2023-07-14T18:07:44.211 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:07:43 smithi163 ceph-mon[96576]: pgmap v91: 1 pgs: 1 peering; 577 KiB data, 109 MiB used, 358 GiB / 358 GiB avail 2023-07-14T18:07:44.270 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:07:43 smithi172 ceph-mon[97983]: pgmap v91: 1 pgs: 1 peering; 577 KiB data, 109 MiB used, 358 GiB / 358 GiB avail 2023-07-14T18:07:45.168 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:07:44 smithi184 ceph-mon[98481]: osdmap e28: 4 total, 4 up, 4 in 2023-07-14T18:07:45.169 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:07:44 smithi184 ceph-mon[98481]: from='client.? 172.21.15.172:0/3852312850' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "055df823-b8b0-426a-83c2-f0d727932ad8"}]: dispatch 2023-07-14T18:07:45.169 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:07:44 smithi184 ceph-mon[98481]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "055df823-b8b0-426a-83c2-f0d727932ad8"}]: dispatch 2023-07-14T18:07:45.169 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:07:44 smithi184 ceph-mon[98481]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "055df823-b8b0-426a-83c2-f0d727932ad8"}]': finished 2023-07-14T18:07:45.169 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:07:44 smithi184 ceph-mon[98481]: osdmap e29: 5 total, 4 up, 5 in 2023-07-14T18:07:45.169 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:07:44 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-07-14T18:07:45.211 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:07:44 smithi163 ceph-mon[96576]: osdmap e28: 4 total, 4 up, 4 in 2023-07-14T18:07:45.211 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:07:44 smithi163 ceph-mon[96576]: from='client.? 172.21.15.172:0/3852312850' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "055df823-b8b0-426a-83c2-f0d727932ad8"}]: dispatch 2023-07-14T18:07:45.211 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:07:44 smithi163 ceph-mon[96576]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "055df823-b8b0-426a-83c2-f0d727932ad8"}]: dispatch 2023-07-14T18:07:45.212 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:07:44 smithi163 ceph-mon[96576]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "055df823-b8b0-426a-83c2-f0d727932ad8"}]': finished 2023-07-14T18:07:45.212 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:07:44 smithi163 ceph-mon[96576]: osdmap e29: 5 total, 4 up, 5 in 2023-07-14T18:07:45.212 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:07:44 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-07-14T18:07:45.269 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:07:44 smithi172 ceph-mon[97983]: osdmap e28: 4 total, 4 up, 4 in 2023-07-14T18:07:45.270 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:07:44 smithi172 ceph-mon[97983]: from='client.? 172.21.15.172:0/3852312850' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "055df823-b8b0-426a-83c2-f0d727932ad8"}]: dispatch 2023-07-14T18:07:45.270 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:07:44 smithi172 ceph-mon[97983]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "055df823-b8b0-426a-83c2-f0d727932ad8"}]: dispatch 2023-07-14T18:07:45.270 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:07:44 smithi172 ceph-mon[97983]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "055df823-b8b0-426a-83c2-f0d727932ad8"}]': finished 2023-07-14T18:07:45.271 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:07:44 smithi172 ceph-mon[97983]: osdmap e29: 5 total, 4 up, 5 in 2023-07-14T18:07:45.271 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:07:44 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-07-14T18:07:46.168 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:07:45 smithi184 ceph-mon[98481]: from='client.? 172.21.15.172:0/1078773067' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-07-14T18:07:46.168 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:07:45 smithi184 ceph-mon[98481]: pgmap v94: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail; 144 KiB/s, 0 objects/s recovering 2023-07-14T18:07:46.211 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:07:45 smithi163 ceph-mon[96576]: from='client.? 172.21.15.172:0/1078773067' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-07-14T18:07:46.211 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:07:45 smithi163 ceph-mon[96576]: pgmap v94: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail; 144 KiB/s, 0 objects/s recovering 2023-07-14T18:07:46.269 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:07:45 smithi172 ceph-mon[97983]: from='client.? 172.21.15.172:0/1078773067' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-07-14T18:07:46.269 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:07:45 smithi172 ceph-mon[97983]: pgmap v94: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail; 144 KiB/s, 0 objects/s recovering 2023-07-14T18:07:48.711 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:07:48 smithi163 ceph-mon[96576]: pgmap v95: 1 pgs: 1 active+clean; 577 KiB data, 109 MiB used, 358 GiB / 358 GiB avail; 102 KiB/s, 0 objects/s recovering 2023-07-14T18:07:48.769 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:07:48 smithi172 ceph-mon[97983]: pgmap v95: 1 pgs: 1 active+clean; 577 KiB data, 109 MiB used, 358 GiB / 358 GiB avail; 102 KiB/s, 0 objects/s recovering 2023-07-14T18:07:48.918 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:07:48 smithi184 ceph-mon[98481]: pgmap v95: 1 pgs: 1 active+clean; 577 KiB data, 109 MiB used, 358 GiB / 358 GiB avail; 102 KiB/s, 0 objects/s recovering 2023-07-14T18:07:50.711 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:07:50 smithi163 ceph-mon[96576]: pgmap v96: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail; 87 KiB/s, 0 objects/s recovering 2023-07-14T18:07:50.769 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:07:50 smithi172 ceph-mon[97983]: pgmap v96: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail; 87 KiB/s, 0 objects/s recovering 2023-07-14T18:07:50.918 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:07:50 smithi184 ceph-mon[98481]: pgmap v96: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail; 87 KiB/s, 0 objects/s recovering 2023-07-14T18:07:52.019 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:07:51 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2023-07-14T18:07:52.020 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:07:51 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T18:07:52.168 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:07:51 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2023-07-14T18:07:52.169 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:07:51 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T18:07:52.211 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:07:51 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2023-07-14T18:07:52.211 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:07:51 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T18:07:52.925 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:07:52 smithi172 ceph-mon[97983]: Deploying daemon osd.4 on smithi172 2023-07-14T18:07:52.925 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:07:52 smithi172 ceph-mon[97983]: pgmap v97: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail; 72 KiB/s, 0 objects/s recovering 2023-07-14T18:07:53.168 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:07:52 smithi184 ceph-mon[98481]: Deploying daemon osd.4 on smithi172 2023-07-14T18:07:53.169 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:07:52 smithi184 ceph-mon[98481]: pgmap v97: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail; 72 KiB/s, 0 objects/s recovering 2023-07-14T18:07:53.211 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:07:52 smithi163 ceph-mon[96576]: Deploying daemon osd.4 on smithi172 2023-07-14T18:07:53.211 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:07:52 smithi163 ceph-mon[96576]: pgmap v97: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail; 72 KiB/s, 0 objects/s recovering 2023-07-14T18:07:55.020 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:07:54 smithi172 ceph-mon[97983]: pgmap v98: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail; 60 KiB/s, 0 objects/s recovering 2023-07-14T18:07:55.168 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:07:54 smithi184 ceph-mon[98481]: pgmap v98: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail; 60 KiB/s, 0 objects/s recovering 2023-07-14T18:07:55.211 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:07:54 smithi163 ceph-mon[96576]: pgmap v98: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail; 60 KiB/s, 0 objects/s recovering 2023-07-14T18:07:56.270 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:07:56 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:07:56.271 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:07:56 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-14T18:07:56.271 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:07:56 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:07:56.271 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:07:56 smithi172 ceph-mon[97983]: pgmap v99: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail; 52 KiB/s, 0 objects/s recovering 2023-07-14T18:07:56.418 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:07:56 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:07:56.419 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:07:56 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-14T18:07:56.419 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:07:56 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:07:56.419 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:07:56 smithi184 ceph-mon[98481]: pgmap v99: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail; 52 KiB/s, 0 objects/s recovering 2023-07-14T18:07:56.461 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:07:56 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:07:56.462 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:07:56 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-14T18:07:56.462 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:07:56 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:07:56.462 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:07:56 smithi163 ceph-mon[96576]: pgmap v99: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail; 52 KiB/s, 0 objects/s recovering 2023-07-14T18:07:57.878 INFO:teuthology.orchestra.run.smithi172.stderr:2023-07-14T18:07:57.842+0000 7feb767fc700 1 -- 172.21.15.172:0/2139542157 <== mgr.14152 v2:172.21.15.163:6800/1949590926 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7feb84060a80 con 0x7feb700a1150 2023-07-14T18:07:57.878 INFO:teuthology.orchestra.run.smithi172.stdout:Created osd(s) 4 on host 'smithi172' 2023-07-14T18:07:57.881 INFO:teuthology.orchestra.run.smithi172.stderr:2023-07-14T18:07:57.845+0000 7feb8b9e3700 1 -- 172.21.15.172:0/2139542157 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7feb700a1150 msgr2=0x7feb700a3600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:07:57.881 INFO:teuthology.orchestra.run.smithi172.stderr:2023-07-14T18:07:57.845+0000 7feb8b9e3700 1 --2- 172.21.15.172:0/2139542157 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7feb700a1150 0x7feb700a3600 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7feb840ffc10 tx=0x7feb8000b410 comp rx=0 tx=0).stop 2023-07-14T18:07:57.881 INFO:teuthology.orchestra.run.smithi172.stderr:2023-07-14T18:07:57.846+0000 7feb8b9e3700 1 -- 172.21.15.172:0/2139542157 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7feb84100740 msgr2=0x7feb8419bee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:07:57.881 INFO:teuthology.orchestra.run.smithi172.stderr:2023-07-14T18:07:57.846+0000 7feb8b9e3700 1 --2- 172.21.15.172:0/2139542157 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7feb84100740 0x7feb8419bee0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7feb7c0062a0 tx=0x7feb7c004d00 comp rx=0 tx=0).stop 2023-07-14T18:07:57.881 INFO:teuthology.orchestra.run.smithi172.stderr:2023-07-14T18:07:57.846+0000 7feb8b9e3700 1 -- 172.21.15.172:0/2139542157 shutdown_connections 2023-07-14T18:07:57.881 INFO:teuthology.orchestra.run.smithi172.stderr:2023-07-14T18:07:57.846+0000 7feb8b9e3700 1 --2- 172.21.15.172:0/2139542157 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7feb700a1150 0x7feb700a3600 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:07:57.881 INFO:teuthology.orchestra.run.smithi172.stderr:2023-07-14T18:07:57.846+0000 7feb8b9e3700 1 --2- 172.21.15.172:0/2139542157 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7feb84100740 0x7feb8419bee0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:07:57.882 INFO:teuthology.orchestra.run.smithi172.stderr:2023-07-14T18:07:57.846+0000 7feb8b9e3700 1 --2- 172.21.15.172:0/2139542157 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7feb840febb0 0x7feb84194920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:07:57.882 INFO:teuthology.orchestra.run.smithi172.stderr:2023-07-14T18:07:57.846+0000 7feb8b9e3700 1 --2- 172.21.15.172:0/2139542157 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7feb840ffdb0 0x7feb84194e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:07:57.882 INFO:teuthology.orchestra.run.smithi172.stderr:2023-07-14T18:07:57.846+0000 7feb8b9e3700 1 -- 172.21.15.172:0/2139542157 >> 172.21.15.172:0/2139542157 conn(0x7feb840fa1e0 msgr2=0x7feb84103290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:07:57.882 INFO:teuthology.orchestra.run.smithi172.stderr:2023-07-14T18:07:57.846+0000 7feb8b9e3700 1 -- 172.21.15.172:0/2139542157 shutdown_connections 2023-07-14T18:07:57.882 INFO:teuthology.orchestra.run.smithi172.stderr:2023-07-14T18:07:57.846+0000 7feb8b9e3700 1 -- 172.21.15.172:0/2139542157 wait complete. 2023-07-14T18:07:58.283 DEBUG:teuthology.orchestra.run.smithi172:osd.4> sudo journalctl -f -n 0 -u ceph-bf7326ec-2270-11ee-9b33-001a4aab830c@osd.4.service 2023-07-14T18:07:58.285 INFO:tasks.cephadm:Deploying osd.5 on smithi184 with /dev/vg_nvme/lv_3... 2023-07-14T18:07:58.285 DEBUG:teuthology.orchestra.run.smithi184:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81c9387d2e7576da065747ec9c16d1c7d69016ec shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bf7326ec-2270-11ee-9b33-001a4aab830c -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2023-07-14T18:07:58.317 INFO:journalctl@ceph.osd.4.smithi172.stdout:-- Logs begin at Fri 2023-07-14 17:45:52 UTC. -- 2023-07-14T18:07:58.669 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:07:58 smithi184 ceph-mon[98481]: pgmap v100: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-07-14T18:07:58.669 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:07:58 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:07:58.669 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:07:58 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:07:58.669 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:07:58 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:07:58.669 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:07:58 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:07:58.711 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:07:58 smithi163 ceph-mon[96576]: pgmap v100: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-07-14T18:07:58.712 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:07:58 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:07:58.712 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:07:58 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:07:58.712 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:07:58 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:07:58.712 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:07:58 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:07:58.770 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:07:58 smithi172 ceph-mon[97983]: pgmap v100: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-07-14T18:07:58.770 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:07:58 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:07:58.770 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:07:58 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:07:58.770 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:07:58 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:07:58.770 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:07:58 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:07:58.847 INFO:teuthology.orchestra.run.smithi184.stderr:Inferring config /var/lib/ceph/bf7326ec-2270-11ee-9b33-001a4aab830c/mon.c/config 2023-07-14T18:07:59.182 INFO:journalctl@ceph.osd.4.smithi172.stdout:Jul 14 18:07:59 smithi172 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-4[108488]: 2023-07-14T18:07:59.061+0000 7f9f20514640 -1 osd.4 0 log_to_monitors true 2023-07-14T18:07:59.505 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:07:59 smithi172 ceph-mon[97983]: from='osd.4 [v2:172.21.15.172:6808/3319632614,v1:172.21.15.172:6809/3319632614]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2023-07-14T18:07:59.506 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:07:59 smithi172 ceph-mon[97983]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2023-07-14T18:07:59.669 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:07:59 smithi184 ceph-mon[98481]: from='osd.4 [v2:172.21.15.172:6808/3319632614,v1:172.21.15.172:6809/3319632614]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2023-07-14T18:07:59.669 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:07:59 smithi184 ceph-mon[98481]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2023-07-14T18:07:59.711 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:07:59 smithi163 ceph-mon[96576]: from='osd.4 [v2:172.21.15.172:6808/3319632614,v1:172.21.15.172:6809/3319632614]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2023-07-14T18:07:59.712 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:07:59 smithi163 ceph-mon[96576]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2023-07-14T18:08:00.288 INFO:teuthology.orchestra.run.smithi184.stderr:--> Zapping: /dev/vg_nvme/lv_3 2023-07-14T18:08:00.289 INFO:teuthology.orchestra.run.smithi184.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2023-07-14T18:08:00.289 INFO:teuthology.orchestra.run.smithi184.stderr: stderr: 10+0 records in 2023-07-14T18:08:00.289 INFO:teuthology.orchestra.run.smithi184.stderr:10+0 records out 2023-07-14T18:08:00.289 INFO:teuthology.orchestra.run.smithi184.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0110031 s, 953 MB/s 2023-07-14T18:08:00.289 INFO:teuthology.orchestra.run.smithi184.stderr:--> Zapping successful for: 2023-07-14T18:08:00.669 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:08:00 smithi184 ceph-mon[98481]: pgmap v101: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-07-14T18:08:00.669 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:08:00 smithi184 ceph-mon[98481]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2023-07-14T18:08:00.669 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:08:00 smithi184 ceph-mon[98481]: osdmap e30: 5 total, 4 up, 5 in 2023-07-14T18:08:00.669 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:08:00 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-07-14T18:08:00.669 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:08:00 smithi184 ceph-mon[98481]: from='osd.4 [v2:172.21.15.172:6808/3319632614,v1:172.21.15.172:6809/3319632614]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi172", "root=default"]}]: dispatch 2023-07-14T18:08:00.670 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:08:00 smithi184 ceph-mon[98481]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi172", "root=default"]}]: dispatch 2023-07-14T18:08:00.689 DEBUG:teuthology.orchestra.run.smithi184:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81c9387d2e7576da065747ec9c16d1c7d69016ec shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bf7326ec-2270-11ee-9b33-001a4aab830c -- ceph orch daemon add osd smithi184:vg_nvme/lv_3 2023-07-14T18:08:00.711 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:08:00 smithi163 ceph-mon[96576]: pgmap v101: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-07-14T18:08:00.712 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:08:00 smithi163 ceph-mon[96576]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2023-07-14T18:08:00.712 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:08:00 smithi163 ceph-mon[96576]: osdmap e30: 5 total, 4 up, 5 in 2023-07-14T18:08:00.712 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:08:00 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-07-14T18:08:00.712 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:08:00 smithi163 ceph-mon[96576]: from='osd.4 [v2:172.21.15.172:6808/3319632614,v1:172.21.15.172:6809/3319632614]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi172", "root=default"]}]: dispatch 2023-07-14T18:08:00.712 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:08:00 smithi163 ceph-mon[96576]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi172", "root=default"]}]: dispatch 2023-07-14T18:08:00.717 INFO:journalctl@ceph.osd.4.smithi172.stdout:Jul 14 18:08:00 smithi172 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-4[108488]: 2023-07-14T18:08:00.400+0000 7f9f15b8c700 -1 osd.4 0 waiting for initial osdmap 2023-07-14T18:08:00.717 INFO:journalctl@ceph.osd.4.smithi172.stdout:Jul 14 18:08:00 smithi172 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-4[108488]: 2023-07-14T18:08:00.405+0000 7f9f0f97e700 -1 osd.4 31 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-07-14T18:08:00.718 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:08:00 smithi172 ceph-mon[97983]: pgmap v101: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-07-14T18:08:00.718 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:08:00 smithi172 ceph-mon[97983]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2023-07-14T18:08:00.718 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:08:00 smithi172 ceph-mon[97983]: osdmap e30: 5 total, 4 up, 5 in 2023-07-14T18:08:00.718 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:08:00 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-07-14T18:08:00.718 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:08:00 smithi172 ceph-mon[97983]: from='osd.4 [v2:172.21.15.172:6808/3319632614,v1:172.21.15.172:6809/3319632614]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi172", "root=default"]}]: dispatch 2023-07-14T18:08:00.718 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:08:00 smithi172 ceph-mon[97983]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi172", "root=default"]}]: dispatch 2023-07-14T18:08:01.241 INFO:teuthology.orchestra.run.smithi184.stderr:Inferring config /var/lib/ceph/bf7326ec-2270-11ee-9b33-001a4aab830c/mon.c/config 2023-07-14T18:08:01.711 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:08:01 smithi163 ceph-mon[96576]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi172", "root=default"]}]': finished 2023-07-14T18:08:01.712 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:08:01 smithi163 ceph-mon[96576]: osdmap e31: 5 total, 4 up, 5 in 2023-07-14T18:08:01.712 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:08:01 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-07-14T18:08:01.712 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:08:01 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-07-14T18:08:01.712 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:08:01 smithi163 ceph-mon[96576]: Detected new or changed devices on smithi172 2023-07-14T18:08:01.712 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:08:01 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:08:01.713 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:08:01 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:08:01.713 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:08:01 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-07-14T18:08:01.713 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:08:01 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-07-14T18:08:01.713 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:08:01 smithi163 ceph-mon[96576]: Adjusting osd_memory_target on smithi172 to 8584M 2023-07-14T18:08:01.713 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:08:01 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:08:01.713 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:08:01 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T18:08:01.714 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:08:01 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-14T18:08:01.714 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:08:01 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:08:01.714 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:08:01 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-14T18:08:01.714 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:08:01 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T18:08:01.714 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:08:01 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-14T18:08:01.714 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:08:01 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:08:01.768 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:08:01 smithi184 ceph-mon[98481]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi172", "root=default"]}]': finished 2023-07-14T18:08:01.768 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:08:01 smithi184 ceph-mon[98481]: osdmap e31: 5 total, 4 up, 5 in 2023-07-14T18:08:01.768 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:08:01 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-07-14T18:08:01.768 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:08:01 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-07-14T18:08:01.768 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:08:01 smithi184 ceph-mon[98481]: Detected new or changed devices on smithi172 2023-07-14T18:08:01.769 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:08:01 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:08:01.769 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:08:01 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:08:01.769 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:08:01 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-07-14T18:08:01.769 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:08:01 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-07-14T18:08:01.769 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:08:01 smithi184 ceph-mon[98481]: Adjusting osd_memory_target on smithi172 to 8584M 2023-07-14T18:08:01.769 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:08:01 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:08:01.769 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:08:01 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T18:08:01.769 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:08:01 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-14T18:08:01.770 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:08:01 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:08:01.770 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:08:01 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-14T18:08:01.770 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:08:01 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T18:08:01.770 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:08:01 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-14T18:08:01.770 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:08:01 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:08:01.770 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:08:01 smithi172 ceph-mon[97983]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi172", "root=default"]}]': finished 2023-07-14T18:08:01.771 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:08:01 smithi172 ceph-mon[97983]: osdmap e31: 5 total, 4 up, 5 in 2023-07-14T18:08:01.771 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:08:01 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-07-14T18:08:01.771 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:08:01 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-07-14T18:08:01.771 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:08:01 smithi172 ceph-mon[97983]: Detected new or changed devices on smithi172 2023-07-14T18:08:01.771 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:08:01 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:08:01.771 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:08:01 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:08:01.771 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:08:01 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-07-14T18:08:01.772 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:08:01 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-07-14T18:08:01.772 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:08:01 smithi172 ceph-mon[97983]: Adjusting osd_memory_target on smithi172 to 8584M 2023-07-14T18:08:01.772 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:08:01 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:08:01.772 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:08:01 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T18:08:01.772 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:08:01 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-14T18:08:01.772 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:08:01 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:08:01.773 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:08:01 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-14T18:08:01.773 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:08:01 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T18:08:01.773 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:08:01 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-14T18:08:01.773 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:08:01 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:08:02.441 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:08:02.406+0000 7fdfbcb45700 1 -- 172.21.15.184:0/561582519 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fdfb8101850 msgr2=0x7fdfb8108110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:08:02.441 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:08:02.406+0000 7fdfbcb45700 1 --2- 172.21.15.184:0/561582519 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fdfb8101850 0x7fdfb8108110 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fdfb000b0a0 tx=0x7fdfb000b3b0 comp rx=0 tx=0).stop 2023-07-14T18:08:02.441 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:08:02.406+0000 7fdfbcb45700 1 -- 172.21.15.184:0/561582519 shutdown_connections 2023-07-14T18:08:02.441 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:08:02.406+0000 7fdfbcb45700 1 --2- 172.21.15.184:0/561582519 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fdfb8101850 0x7fdfb8108110 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:08:02.442 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:08:02.406+0000 7fdfbcb45700 1 --2- 172.21.15.184:0/561582519 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fdfb80ffcc0 0x7fdfb81000d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:08:02.442 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:08:02.406+0000 7fdfbcb45700 1 --2- 172.21.15.184:0/561582519 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdfb8100ec0 0x7fdfb8101310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:08:02.442 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:08:02.406+0000 7fdfbcb45700 1 -- 172.21.15.184:0/561582519 >> 172.21.15.184:0/561582519 conn(0x7fdfb80fb2d0 msgr2=0x7fdfb80fd740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:08:02.442 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:08:02.406+0000 7fdfbcb45700 1 -- 172.21.15.184:0/561582519 shutdown_connections 2023-07-14T18:08:02.443 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:08:02.406+0000 7fdfbcb45700 1 -- 172.21.15.184:0/561582519 wait complete. 2023-07-14T18:08:02.443 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:08:02.407+0000 7fdfbcb45700 1 Processor -- start 2023-07-14T18:08:02.443 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:08:02.407+0000 7fdfbcb45700 1 -- start start 2023-07-14T18:08:02.443 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:08:02.407+0000 7fdfbcb45700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fdfb80ffcc0 0x7fdfb8195950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:08:02.443 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:08:02.407+0000 7fdfbcb45700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fdfb8100ec0 0x7fdfb8195e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:08:02.444 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:08:02.407+0000 7fdfbcb45700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdfb8101850 0x7fdfb819cf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:08:02.444 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:08:02.407+0000 7fdfbcb45700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfb819d4e0 con 0x7fdfb8100ec0 2023-07-14T18:08:02.444 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:08:02.407+0000 7fdfbcb45700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfb819d620 con 0x7fdfb8101850 2023-07-14T18:08:02.446 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:08:02.407+0000 7fdfbcb45700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfb819d7b0 con 0x7fdfb80ffcc0 2023-07-14T18:08:02.447 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:08:02.407+0000 7fdfb659c700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fdfb80ffcc0 0x7fdfb8195950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:08:02.448 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:08:02.407+0000 7fdfb659c700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fdfb80ffcc0 0x7fdfb8195950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.184:53958/0 (socket says 172.21.15.184:53958) 2023-07-14T18:08:02.448 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:08:02.407+0000 7fdfb659c700 1 -- 172.21.15.184:0/1496544262 learned_addr learned my addr 172.21.15.184:0/1496544262 (peer_addr_for_me v2:172.21.15.184:0/0) 2023-07-14T18:08:02.448 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:08:02.407+0000 7fdfb659c700 1 -- 172.21.15.184:0/1496544262 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdfb8101850 msgr2=0x7fdfb819cf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:08:02.448 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:08:02.407+0000 7fdfb659c700 1 --2- 172.21.15.184:0/1496544262 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdfb8101850 0x7fdfb819cf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:08:02.448 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:08:02.407+0000 7fdfb5d9b700 1 --2- 172.21.15.184:0/1496544262 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fdfb8100ec0 0x7fdfb8195e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:08:02.448 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:08:02.407+0000 7fdfb659c700 1 -- 172.21.15.184:0/1496544262 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fdfb8100ec0 msgr2=0x7fdfb8195e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:08:02.449 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:08:02.407+0000 7fdfb659c700 1 --2- 172.21.15.184:0/1496544262 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fdfb8100ec0 0x7fdfb8195e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:08:02.449 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:08:02.407+0000 7fdfb659c700 1 -- 172.21.15.184:0/1496544262 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdfb0009d00 con 0x7fdfb80ffcc0 2023-07-14T18:08:02.449 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:08:02.408+0000 7fdfb5d9b700 1 --2- 172.21.15.184:0/1496544262 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fdfb8100ec0 0x7fdfb8195e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T18:08:02.449 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:08:02.408+0000 7fdfb659c700 1 --2- 172.21.15.184:0/1496544262 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fdfb80ffcc0 0x7fdfb8195950 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fdfac00d9b0 tx=0x7fdfac00dd70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:08:02.449 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:08:02.408+0000 7fdfa77fe700 1 -- 172.21.15.184:0/1496544262 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfac00be80 con 0x7fdfb80ffcc0 2023-07-14T18:08:02.449 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:08:02.408+0000 7fdfa77fe700 1 -- 172.21.15.184:0/1496544262 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fdfac0044b0 con 0x7fdfb80ffcc0 2023-07-14T18:08:02.449 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:08:02.408+0000 7fdfa77fe700 1 -- 172.21.15.184:0/1496544262 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfac003aa0 con 0x7fdfb80ffcc0 2023-07-14T18:08:02.449 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:08:02.408+0000 7fdfbcb45700 1 -- 172.21.15.184:0/1496544262 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdfb819da90 con 0x7fdfb80ffcc0 2023-07-14T18:08:02.450 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:08:02.408+0000 7fdfbcb45700 1 -- 172.21.15.184:0/1496544262 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdfb819df40 con 0x7fdfb80ffcc0 2023-07-14T18:08:02.450 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:08:02.409+0000 7fdfbcb45700 1 -- 172.21.15.184:0/1496544262 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdfb8107260 con 0x7fdfb80ffcc0 2023-07-14T18:08:02.450 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:08:02.410+0000 7fdfa77fe700 1 -- 172.21.15.184:0/1496544262 <== mon.1 v2:172.21.15.184:3300/0 4 ==== mgrmap(e 16) v1 ==== 135716+0+0 (secure 0 0 0) 0x7fdfac009940 con 0x7fdfb80ffcc0 2023-07-14T18:08:02.450 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:08:02.410+0000 7fdfa77fe700 1 --2- 172.21.15.184:0/1496544262 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7fdfa00a1150 0x7fdfa00a3600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:08:02.450 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:08:02.411+0000 7fdfa77fe700 1 -- 172.21.15.184:0/1496544262 <== mon.1 v2:172.21.15.184:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 4101+0+0 (secure 0 0 0) 0x7fdfac0cb590 con 0x7fdfb80ffcc0 2023-07-14T18:08:02.450 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:08:02.411+0000 7fdfb5d9b700 1 --2- 172.21.15.184:0/1496544262 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7fdfa00a1150 0x7fdfa00a3600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:08:02.450 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:08:02.411+0000 7fdfb5d9b700 1 --2- 172.21.15.184:0/1496544262 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7fdfa00a1150 0x7fdfa00a3600 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fdfa8005fd0 tx=0x7fdfa8005e20 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:08:02.451 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:08:02.415+0000 7fdfa77fe700 1 -- 172.21.15.184:0/1496544262 <== mon.1 v2:172.21.15.184:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178025 (secure 0 0 0) 0x7fdfac095d50 con 0x7fdfb80ffcc0 2023-07-14T18:08:02.641 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:08:02.607+0000 7fdfbcb45700 1 -- 172.21.15.184:0/1496544262 --> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi184:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) v1 -- 0x7fdfb8060a80 con 0x7fdfa00a1150 2023-07-14T18:08:02.669 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:08:02 smithi184 ceph-mon[98481]: purged_snaps scrub starts 2023-07-14T18:08:02.669 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:08:02 smithi184 ceph-mon[98481]: purged_snaps scrub ok 2023-07-14T18:08:02.669 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:08:02 smithi184 ceph-mon[98481]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-07-14T18:08:02.669 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:08:02 smithi184 ceph-mon[98481]: osd.4 [v2:172.21.15.172:6808/3319632614,v1:172.21.15.172:6809/3319632614] boot 2023-07-14T18:08:02.669 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:08:02 smithi184 ceph-mon[98481]: osdmap e32: 5 total, 5 up, 5 in 2023-07-14T18:08:02.670 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:08:02 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-07-14T18:08:02.712 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:08:02 smithi163 ceph-mon[96576]: purged_snaps scrub starts 2023-07-14T18:08:02.712 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:08:02 smithi163 ceph-mon[96576]: purged_snaps scrub ok 2023-07-14T18:08:02.713 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:08:02 smithi163 ceph-mon[96576]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-07-14T18:08:02.713 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:08:02 smithi163 ceph-mon[96576]: osd.4 [v2:172.21.15.172:6808/3319632614,v1:172.21.15.172:6809/3319632614] boot 2023-07-14T18:08:02.713 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:08:02 smithi163 ceph-mon[96576]: osdmap e32: 5 total, 5 up, 5 in 2023-07-14T18:08:02.714 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:08:02 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-07-14T18:08:02.770 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:08:02 smithi172 ceph-mon[97983]: purged_snaps scrub starts 2023-07-14T18:08:02.770 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:08:02 smithi172 ceph-mon[97983]: purged_snaps scrub ok 2023-07-14T18:08:02.770 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:08:02 smithi172 ceph-mon[97983]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-07-14T18:08:02.770 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:08:02 smithi172 ceph-mon[97983]: osd.4 [v2:172.21.15.172:6808/3319632614,v1:172.21.15.172:6809/3319632614] boot 2023-07-14T18:08:02.770 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:08:02 smithi172 ceph-mon[97983]: osdmap e32: 5 total, 5 up, 5 in 2023-07-14T18:08:02.771 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:08:02 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-07-14T18:08:03.712 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:08:03 smithi163 ceph-mon[96576]: from='client.24238 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi184:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2023-07-14T18:08:03.712 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:08:03 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-07-14T18:08:03.712 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:08:03 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-07-14T18:08:03.712 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:08:03 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T18:08:03.712 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:08:03 smithi163 ceph-mon[96576]: osdmap e33: 5 total, 5 up, 5 in 2023-07-14T18:08:03.767 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:08:03 smithi184 ceph-mon[98481]: from='client.24238 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi184:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2023-07-14T18:08:03.767 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:08:03 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-07-14T18:08:03.767 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:08:03 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-07-14T18:08:03.767 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:08:03 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T18:08:03.768 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:08:03 smithi184 ceph-mon[98481]: osdmap e33: 5 total, 5 up, 5 in 2023-07-14T18:08:03.769 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:08:03 smithi172 ceph-mon[97983]: from='client.24238 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi184:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2023-07-14T18:08:03.770 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:08:03 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-07-14T18:08:03.770 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:08:03 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-07-14T18:08:03.770 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:08:03 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T18:08:03.770 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:08:03 smithi172 ceph-mon[97983]: osdmap e33: 5 total, 5 up, 5 in 2023-07-14T18:08:04.669 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:08:04 smithi184 ceph-mon[98481]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2023-07-14T18:08:04.711 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:08:04 smithi163 ceph-mon[96576]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2023-07-14T18:08:04.770 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:08:04 smithi172 ceph-mon[97983]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2023-07-14T18:08:05.711 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:08:05 smithi163 ceph-mon[96576]: from='client.? 172.21.15.184:0/1214592318' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ef5ef02a-b4e2-4790-9d27-f6d2247b25c8"}]: dispatch 2023-07-14T18:08:05.712 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:08:05 smithi163 ceph-mon[96576]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ef5ef02a-b4e2-4790-9d27-f6d2247b25c8"}]: dispatch 2023-07-14T18:08:05.712 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:08:05 smithi163 ceph-mon[96576]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "ef5ef02a-b4e2-4790-9d27-f6d2247b25c8"}]': finished 2023-07-14T18:08:05.712 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:08:05 smithi163 ceph-mon[96576]: osdmap e34: 6 total, 5 up, 6 in 2023-07-14T18:08:05.712 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:08:05 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-07-14T18:08:05.770 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:08:05 smithi172 ceph-mon[97983]: from='client.? 172.21.15.184:0/1214592318' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ef5ef02a-b4e2-4790-9d27-f6d2247b25c8"}]: dispatch 2023-07-14T18:08:05.770 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:08:05 smithi172 ceph-mon[97983]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ef5ef02a-b4e2-4790-9d27-f6d2247b25c8"}]: dispatch 2023-07-14T18:08:05.770 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:08:05 smithi172 ceph-mon[97983]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "ef5ef02a-b4e2-4790-9d27-f6d2247b25c8"}]': finished 2023-07-14T18:08:05.770 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:08:05 smithi172 ceph-mon[97983]: osdmap e34: 6 total, 5 up, 6 in 2023-07-14T18:08:05.770 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:08:05 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-07-14T18:08:05.919 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:08:05 smithi184 ceph-mon[98481]: from='client.? 172.21.15.184:0/1214592318' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ef5ef02a-b4e2-4790-9d27-f6d2247b25c8"}]: dispatch 2023-07-14T18:08:05.919 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:08:05 smithi184 ceph-mon[98481]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ef5ef02a-b4e2-4790-9d27-f6d2247b25c8"}]: dispatch 2023-07-14T18:08:05.920 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:08:05 smithi184 ceph-mon[98481]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "ef5ef02a-b4e2-4790-9d27-f6d2247b25c8"}]': finished 2023-07-14T18:08:05.920 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:08:05 smithi184 ceph-mon[98481]: osdmap e34: 6 total, 5 up, 6 in 2023-07-14T18:08:05.920 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:08:05 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-07-14T18:08:06.770 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:08:06 smithi172 ceph-mon[97983]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2023-07-14T18:08:06.770 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:08:06 smithi172 ceph-mon[97983]: from='client.? 172.21.15.184:0/968668127' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-07-14T18:08:06.919 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:08:06 smithi184 ceph-mon[98481]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2023-07-14T18:08:06.919 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:08:06 smithi184 ceph-mon[98481]: from='client.? 172.21.15.184:0/968668127' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-07-14T18:08:06.961 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:08:06 smithi163 ceph-mon[96576]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2023-07-14T18:08:06.962 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:08:06 smithi163 ceph-mon[96576]: from='client.? 172.21.15.184:0/968668127' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-07-14T18:08:08.770 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:08:08 smithi172 ceph-mon[97983]: pgmap v110: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2023-07-14T18:08:08.774 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:08:08 smithi184 ceph-mon[98481]: pgmap v110: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2023-07-14T18:08:08.961 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:08:08 smithi163 ceph-mon[96576]: pgmap v110: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2023-07-14T18:08:10.770 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:08:10 smithi172 ceph-mon[97983]: pgmap v111: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2023-07-14T18:08:10.919 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:08:10 smithi184 ceph-mon[98481]: pgmap v111: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2023-07-14T18:08:10.961 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:08:10 smithi163 ceph-mon[96576]: pgmap v111: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2023-07-14T18:08:12.020 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:08:11 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2023-07-14T18:08:12.020 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:08:11 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T18:08:12.099 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:08:11 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2023-07-14T18:08:12.099 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:08:11 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T18:08:12.212 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:08:11 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2023-07-14T18:08:12.212 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:08:11 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T18:08:12.834 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:08:12 smithi184 ceph-mon[98481]: Deploying daemon osd.5 on smithi184 2023-07-14T18:08:12.834 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:08:12 smithi184 ceph-mon[98481]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2023-07-14T18:08:13.020 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:08:12 smithi172 ceph-mon[97983]: Deploying daemon osd.5 on smithi184 2023-07-14T18:08:13.020 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:08:12 smithi172 ceph-mon[97983]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2023-07-14T18:08:13.212 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:08:12 smithi163 ceph-mon[96576]: Deploying daemon osd.5 on smithi184 2023-07-14T18:08:13.212 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:08:12 smithi163 ceph-mon[96576]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2023-07-14T18:08:15.020 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:08:14 smithi172 ceph-mon[97983]: pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2023-07-14T18:08:15.170 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:08:14 smithi184 ceph-mon[98481]: pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2023-07-14T18:08:15.212 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:08:14 smithi163 ceph-mon[96576]: pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2023-07-14T18:08:16.765 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:08:16 smithi184 ceph-mon[98481]: pgmap v114: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2023-07-14T18:08:16.765 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:08:16 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:08:16.765 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:08:16 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:08:16.766 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:08:16 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-14T18:08:16.962 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:08:16 smithi163 ceph-mon[96576]: pgmap v114: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2023-07-14T18:08:16.962 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:08:16 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:08:16.962 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:08:16 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:08:16.962 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:08:16 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-14T18:08:17.020 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:08:16 smithi172 ceph-mon[97983]: pgmap v114: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2023-07-14T18:08:17.020 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:08:16 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:08:17.020 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:08:16 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:08:17.021 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:08:16 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-14T18:08:18.351 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:08:18.316+0000 7fdfa77fe700 1 -- 172.21.15.184:0/1496544262 <== mgr.14152 v2:172.21.15.163:6800/1949590926 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7fdfb8060a80 con 0x7fdfa00a1150 2023-07-14T18:08:18.352 INFO:teuthology.orchestra.run.smithi184.stdout:Created osd(s) 5 on host 'smithi184' 2023-07-14T18:08:18.353 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:08:18.318+0000 7fdfbcb45700 1 -- 172.21.15.184:0/1496544262 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7fdfa00a1150 msgr2=0x7fdfa00a3600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:08:18.354 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:08:18.318+0000 7fdfbcb45700 1 --2- 172.21.15.184:0/1496544262 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7fdfa00a1150 0x7fdfa00a3600 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fdfa8005fd0 tx=0x7fdfa8005e20 comp rx=0 tx=0).stop 2023-07-14T18:08:18.354 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:08:18.318+0000 7fdfbcb45700 1 -- 172.21.15.184:0/1496544262 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fdfb80ffcc0 msgr2=0x7fdfb8195950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:08:18.354 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:08:18.318+0000 7fdfbcb45700 1 --2- 172.21.15.184:0/1496544262 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fdfb80ffcc0 0x7fdfb8195950 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fdfac00d9b0 tx=0x7fdfac00dd70 comp rx=0 tx=0).stop 2023-07-14T18:08:18.354 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:08:18.318+0000 7fdfbcb45700 1 -- 172.21.15.184:0/1496544262 shutdown_connections 2023-07-14T18:08:18.354 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:08:18.318+0000 7fdfbcb45700 1 --2- 172.21.15.184:0/1496544262 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7fdfa00a1150 0x7fdfa00a3600 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:08:18.354 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:08:18.318+0000 7fdfbcb45700 1 --2- 172.21.15.184:0/1496544262 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fdfb80ffcc0 0x7fdfb8195950 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:08:18.355 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:08:18.318+0000 7fdfbcb45700 1 --2- 172.21.15.184:0/1496544262 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdfb8101850 0x7fdfb819cf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:08:18.355 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:08:18.318+0000 7fdfbcb45700 1 --2- 172.21.15.184:0/1496544262 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fdfb8100ec0 0x7fdfb8195e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:08:18.355 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:08:18.318+0000 7fdfbcb45700 1 -- 172.21.15.184:0/1496544262 >> 172.21.15.184:0/1496544262 conn(0x7fdfb80fb2d0 msgr2=0x7fdfb81043a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:08:18.355 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:08:18.318+0000 7fdfbcb45700 1 -- 172.21.15.184:0/1496544262 shutdown_connections 2023-07-14T18:08:18.355 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:08:18.318+0000 7fdfbcb45700 1 -- 172.21.15.184:0/1496544262 wait complete. 2023-07-14T18:08:18.738 DEBUG:teuthology.orchestra.run.smithi184:osd.5> sudo journalctl -f -n 0 -u ceph-bf7326ec-2270-11ee-9b33-001a4aab830c@osd.5.service 2023-07-14T18:08:18.740 INFO:tasks.cephadm:Deploying osd.6 on smithi163 with /dev/vg_nvme/lv_2... 2023-07-14T18:08:18.740 DEBUG:teuthology.orchestra.run.smithi163:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81c9387d2e7576da065747ec9c16d1c7d69016ec shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bf7326ec-2270-11ee-9b33-001a4aab830c -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2023-07-14T18:08:18.770 INFO:journalctl@ceph.osd.5.smithi184.stdout:-- Logs begin at Fri 2023-07-14 17:45:39 UTC. -- 2023-07-14T18:08:18.962 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:08:18 smithi163 ceph-mon[96576]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2023-07-14T18:08:18.962 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:08:18 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:08:18.963 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:08:18 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:08:18.963 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:08:18 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T18:08:18.963 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:08:18 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-14T18:08:18.963 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:08:18 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:08:18.963 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:08:18 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:08:18.963 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:08:18 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:08:18.963 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:08:18 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-14T18:08:19.020 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:08:18 smithi172 ceph-mon[97983]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2023-07-14T18:08:19.021 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:08:18 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:08:19.021 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:08:18 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:08:19.021 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:08:18 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T18:08:19.021 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:08:18 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-14T18:08:19.021 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:08:18 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:08:19.021 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:08:18 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:08:19.021 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:08:18 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:08:19.022 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:08:18 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-14T18:08:19.169 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:08:18 smithi184 ceph-mon[98481]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2023-07-14T18:08:19.170 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:08:18 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:08:19.170 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:08:18 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:08:19.170 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:08:18 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T18:08:19.170 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:08:18 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-14T18:08:19.170 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:08:18 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:08:19.170 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:08:18 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:08:19.170 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:08:18 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:08:19.171 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:08:18 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-14T18:08:19.310 INFO:teuthology.orchestra.run.smithi163.stderr:Inferring config /var/lib/ceph/bf7326ec-2270-11ee-9b33-001a4aab830c/mon.a/config 2023-07-14T18:08:19.919 INFO:journalctl@ceph.osd.5.smithi184.stdout:Jul 14 18:08:19 smithi184 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-5[109831]: 2023-07-14T18:08:19.650+0000 7f8b6072a640 -1 osd.5 0 log_to_monitors true 2023-07-14T18:08:20.879 INFO:teuthology.orchestra.run.smithi163.stderr:--> Zapping: /dev/vg_nvme/lv_2 2023-07-14T18:08:20.879 INFO:teuthology.orchestra.run.smithi163.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2023-07-14T18:08:20.879 INFO:teuthology.orchestra.run.smithi163.stderr: stderr: 10+0 records in 2023-07-14T18:08:20.879 INFO:teuthology.orchestra.run.smithi163.stderr:10+0 records out 2023-07-14T18:08:20.880 INFO:teuthology.orchestra.run.smithi163.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0119873 s, 875 MB/s 2023-07-14T18:08:20.880 INFO:teuthology.orchestra.run.smithi163.stderr:--> Zapping successful for: 2023-07-14T18:08:20.919 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:08:20 smithi184 ceph-mon[98481]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2023-07-14T18:08:20.920 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:08:20 smithi184 ceph-mon[98481]: from='osd.5 [v2:172.21.15.184:6808/2662084043,v1:172.21.15.184:6809/2662084043]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2023-07-14T18:08:20.920 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:08:20 smithi184 ceph-mon[98481]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2023-07-14T18:08:20.963 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:08:20 smithi163 ceph-mon[96576]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2023-07-14T18:08:20.963 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:08:20 smithi163 ceph-mon[96576]: from='osd.5 [v2:172.21.15.184:6808/2662084043,v1:172.21.15.184:6809/2662084043]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2023-07-14T18:08:20.963 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:08:20 smithi163 ceph-mon[96576]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2023-07-14T18:08:21.020 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:08:20 smithi172 ceph-mon[97983]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2023-07-14T18:08:21.020 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:08:20 smithi172 ceph-mon[97983]: from='osd.5 [v2:172.21.15.184:6808/2662084043,v1:172.21.15.184:6809/2662084043]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2023-07-14T18:08:21.021 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:08:20 smithi172 ceph-mon[97983]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2023-07-14T18:08:21.256 DEBUG:teuthology.orchestra.run.smithi163:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81c9387d2e7576da065747ec9c16d1c7d69016ec shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bf7326ec-2270-11ee-9b33-001a4aab830c -- ceph orch daemon add osd smithi163:vg_nvme/lv_2 2023-07-14T18:08:21.809 INFO:teuthology.orchestra.run.smithi163.stderr:Inferring config /var/lib/ceph/bf7326ec-2270-11ee-9b33-001a4aab830c/mon.a/config 2023-07-14T18:08:21.962 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:08:21 smithi163 ceph-mon[96576]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2023-07-14T18:08:21.962 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:08:21 smithi163 ceph-mon[96576]: osdmap e35: 6 total, 5 up, 6 in 2023-07-14T18:08:21.962 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:08:21 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-07-14T18:08:21.962 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:08:21 smithi163 ceph-mon[96576]: from='osd.5 [v2:172.21.15.184:6808/2662084043,v1:172.21.15.184:6809/2662084043]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi184", "root=default"]}]: dispatch 2023-07-14T18:08:21.963 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:08:21 smithi163 ceph-mon[96576]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi184", "root=default"]}]: dispatch 2023-07-14T18:08:21.963 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:08:21 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:08:21.963 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:08:21 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:08:21.963 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:08:21 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-07-14T18:08:21.963 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:08:21 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-07-14T18:08:21.963 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:08:21 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:08:21.963 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:08:21 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T18:08:21.964 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:08:21 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-14T18:08:21.964 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:08:21 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:08:22.020 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:08:21 smithi172 ceph-mon[97983]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2023-07-14T18:08:22.020 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:08:21 smithi172 ceph-mon[97983]: osdmap e35: 6 total, 5 up, 6 in 2023-07-14T18:08:22.021 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:08:21 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-07-14T18:08:22.021 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:08:21 smithi172 ceph-mon[97983]: from='osd.5 [v2:172.21.15.184:6808/2662084043,v1:172.21.15.184:6809/2662084043]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi184", "root=default"]}]: dispatch 2023-07-14T18:08:22.021 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:08:21 smithi172 ceph-mon[97983]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi184", "root=default"]}]: dispatch 2023-07-14T18:08:22.021 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:08:21 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:08:22.021 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:08:21 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:08:22.021 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:08:21 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-07-14T18:08:22.021 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:08:21 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-07-14T18:08:22.022 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:08:21 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:08:22.022 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:08:21 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T18:08:22.022 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:08:21 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-14T18:08:22.022 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:08:21 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:08:22.169 INFO:journalctl@ceph.osd.5.smithi184.stdout:Jul 14 18:08:21 smithi184 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-5[109831]: 2023-07-14T18:08:21.667+0000 7f8b55da2700 -1 osd.5 0 waiting for initial osdmap 2023-07-14T18:08:22.170 INFO:journalctl@ceph.osd.5.smithi184.stdout:Jul 14 18:08:21 smithi184 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-5[109831]: 2023-07-14T18:08:21.676+0000 7f8b4eb92700 -1 osd.5 36 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-07-14T18:08:22.170 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:08:21 smithi184 ceph-mon[98481]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2023-07-14T18:08:22.170 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:08:21 smithi184 ceph-mon[98481]: osdmap e35: 6 total, 5 up, 6 in 2023-07-14T18:08:22.170 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:08:21 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-07-14T18:08:22.170 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:08:21 smithi184 ceph-mon[98481]: from='osd.5 [v2:172.21.15.184:6808/2662084043,v1:172.21.15.184:6809/2662084043]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi184", "root=default"]}]: dispatch 2023-07-14T18:08:22.170 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:08:21 smithi184 ceph-mon[98481]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi184", "root=default"]}]: dispatch 2023-07-14T18:08:22.171 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:08:21 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:08:22.171 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:08:21 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:08:22.171 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:08:21 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-07-14T18:08:22.171 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:08:21 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-07-14T18:08:22.171 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:08:21 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:08:22.171 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:08:21 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T18:08:22.171 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:08:21 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-14T18:08:22.171 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:08:21 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:08:22.963 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:08:22 smithi163 ceph-mon[96576]: purged_snaps scrub starts 2023-07-14T18:08:22.963 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:08:22 smithi163 ceph-mon[96576]: purged_snaps scrub ok 2023-07-14T18:08:22.963 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:08:22 smithi163 ceph-mon[96576]: Detected new or changed devices on smithi184 2023-07-14T18:08:22.963 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:08:22 smithi163 ceph-mon[96576]: Adjusting osd_memory_target on smithi184 to 8584M 2023-07-14T18:08:22.963 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:08:22 smithi163 ceph-mon[96576]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2023-07-14T18:08:22.963 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:08:22 smithi163 ceph-mon[96576]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi184", "root=default"]}]': finished 2023-07-14T18:08:22.964 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:08:22 smithi163 ceph-mon[96576]: osdmap e36: 6 total, 5 up, 6 in 2023-07-14T18:08:22.964 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:08:22 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-07-14T18:08:22.964 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:08:22 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-07-14T18:08:22.964 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:08:22 smithi163 ceph-mon[96576]: osd.5 [v2:172.21.15.184:6808/2662084043,v1:172.21.15.184:6809/2662084043] boot 2023-07-14T18:08:22.964 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:08:22 smithi163 ceph-mon[96576]: osdmap e37: 6 total, 6 up, 6 in 2023-07-14T18:08:22.964 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:08:22 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-07-14T18:08:23.020 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:08:22 smithi172 ceph-mon[97983]: purged_snaps scrub starts 2023-07-14T18:08:23.021 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:08:22 smithi172 ceph-mon[97983]: purged_snaps scrub ok 2023-07-14T18:08:23.021 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:08:22 smithi172 ceph-mon[97983]: Detected new or changed devices on smithi184 2023-07-14T18:08:23.021 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:08:22 smithi172 ceph-mon[97983]: Adjusting osd_memory_target on smithi184 to 8584M 2023-07-14T18:08:23.021 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:08:22 smithi172 ceph-mon[97983]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2023-07-14T18:08:23.021 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:08:22 smithi172 ceph-mon[97983]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi184", "root=default"]}]': finished 2023-07-14T18:08:23.021 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:08:22 smithi172 ceph-mon[97983]: osdmap e36: 6 total, 5 up, 6 in 2023-07-14T18:08:23.021 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:08:22 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-07-14T18:08:23.022 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:08:22 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-07-14T18:08:23.022 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:08:22 smithi172 ceph-mon[97983]: osd.5 [v2:172.21.15.184:6808/2662084043,v1:172.21.15.184:6809/2662084043] boot 2023-07-14T18:08:23.022 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:08:22 smithi172 ceph-mon[97983]: osdmap e37: 6 total, 6 up, 6 in 2023-07-14T18:08:23.022 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:08:22 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-07-14T18:08:23.077 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:08:23.043+0000 7efe46d84700 1 -- 172.21.15.163:0/296203254 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7efe40100740 msgr2=0x7efe40107000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:08:23.078 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:08:23.043+0000 7efe46d84700 1 --2- 172.21.15.163:0/296203254 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7efe40100740 0x7efe40107000 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7efe3800b0a0 tx=0x7efe3800b3b0 comp rx=0 tx=0).stop 2023-07-14T18:08:23.078 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:08:23.043+0000 7efe46d84700 1 -- 172.21.15.163:0/296203254 shutdown_connections 2023-07-14T18:08:23.078 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:08:23.043+0000 7efe46d84700 1 --2- 172.21.15.163:0/296203254 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7efe40100740 0x7efe40107000 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:08:23.078 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:08:23.043+0000 7efe46d84700 1 --2- 172.21.15.163:0/296203254 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efe400febb0 0x7efe400fefc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:08:23.078 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:08:23.043+0000 7efe46d84700 1 --2- 172.21.15.163:0/296203254 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7efe400ffdb0 0x7efe40100200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:08:23.079 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:08:23.043+0000 7efe46d84700 1 -- 172.21.15.163:0/296203254 >> 172.21.15.163:0/296203254 conn(0x7efe400fa1e0 msgr2=0x7efe400fc630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:08:23.079 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:08:23.043+0000 7efe46d84700 1 -- 172.21.15.163:0/296203254 shutdown_connections 2023-07-14T18:08:23.079 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:08:23.043+0000 7efe46d84700 1 -- 172.21.15.163:0/296203254 wait complete. 2023-07-14T18:08:23.080 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:08:23.043+0000 7efe46d84700 1 Processor -- start 2023-07-14T18:08:23.081 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:08:23.043+0000 7efe46d84700 1 -- start start 2023-07-14T18:08:23.081 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:08:23.044+0000 7efe46d84700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efe400febb0 0x7efe401948f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:08:23.081 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:08:23.044+0000 7efe46d84700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7efe400ffdb0 0x7efe40194e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:08:23.081 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:08:23.044+0000 7efe46d84700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7efe40100740 0x7efe4019beb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:08:23.081 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:08:23.044+0000 7efe46d84700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe4019c480 con 0x7efe400ffdb0 2023-07-14T18:08:23.081 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:08:23.044+0000 7efe46d84700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe4019c5c0 con 0x7efe400febb0 2023-07-14T18:08:23.082 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:08:23.044+0000 7efe46d84700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe4019c750 con 0x7efe40100740 2023-07-14T18:08:23.082 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:08:23.044+0000 7efe3ffff700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7efe400ffdb0 0x7efe40194e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:08:23.082 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:08:23.044+0000 7efe3ffff700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7efe400ffdb0 0x7efe40194e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:55048/0 (socket says 172.21.15.163:55048) 2023-07-14T18:08:23.082 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:08:23.044+0000 7efe3ffff700 1 -- 172.21.15.163:0/3522421509 learned_addr learned my addr 172.21.15.163:0/3522421509 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:08:23.082 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:08:23.044+0000 7efe44b20700 1 --2- 172.21.15.163:0/3522421509 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efe400febb0 0x7efe401948f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:08:23.082 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:08:23.044+0000 7efe45321700 1 --2- 172.21.15.163:0/3522421509 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7efe40100740 0x7efe4019beb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:08:23.082 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:08:23.044+0000 7efe3ffff700 1 -- 172.21.15.163:0/3522421509 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7efe40100740 msgr2=0x7efe4019beb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:08:23.083 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:08:23.044+0000 7efe3ffff700 1 --2- 172.21.15.163:0/3522421509 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7efe40100740 0x7efe4019beb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:08:23.083 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:08:23.044+0000 7efe3ffff700 1 -- 172.21.15.163:0/3522421509 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efe400febb0 msgr2=0x7efe401948f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:08:23.083 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:08:23.044+0000 7efe3ffff700 1 --2- 172.21.15.163:0/3522421509 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efe400febb0 0x7efe401948f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:08:23.083 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:08:23.044+0000 7efe3ffff700 1 -- 172.21.15.163:0/3522421509 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe38009d00 con 0x7efe400ffdb0 2023-07-14T18:08:23.083 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:08:23.044+0000 7efe45321700 1 --2- 172.21.15.163:0/3522421509 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7efe40100740 0x7efe4019beb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T18:08:23.083 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:08:23.044+0000 7efe3ffff700 1 --2- 172.21.15.163:0/3522421509 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7efe400ffdb0 0x7efe40194e30 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7efe2c00c950 tx=0x7efe2c00cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:08:23.083 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:08:23.044+0000 7efe3dffb700 1 -- 172.21.15.163:0/3522421509 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe2c00cea0 con 0x7efe400ffdb0 2023-07-14T18:08:23.083 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:08:23.044+0000 7efe46d84700 1 -- 172.21.15.163:0/3522421509 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efe4019ca30 con 0x7efe400ffdb0 2023-07-14T18:08:23.084 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:08:23.044+0000 7efe3dffb700 1 -- 172.21.15.163:0/3522421509 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7efe2c004830 con 0x7efe400ffdb0 2023-07-14T18:08:23.084 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:08:23.044+0000 7efe3dffb700 1 -- 172.21.15.163:0/3522421509 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe2c005380 con 0x7efe400ffdb0 2023-07-14T18:08:23.084 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:08:23.045+0000 7efe46d84700 1 -- 172.21.15.163:0/3522421509 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe4019cf80 con 0x7efe400ffdb0 2023-07-14T18:08:23.084 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:08:23.045+0000 7efe46d84700 1 -- 172.21.15.163:0/3522421509 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efe401061f0 con 0x7efe400ffdb0 2023-07-14T18:08:23.085 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:08:23.046+0000 7efe3dffb700 1 -- 172.21.15.163:0/3522421509 <== mon.0 v2:172.21.15.163:3300/0 4 ==== mgrmap(e 16) v1 ==== 135716+0+0 (secure 0 0 0) 0x7efe2c007ac0 con 0x7efe400ffdb0 2023-07-14T18:08:23.085 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:08:23.047+0000 7efe3dffb700 1 --2- 172.21.15.163:0/3522421509 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7efe300a1150 0x7efe300a3600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:08:23.085 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:08:23.047+0000 7efe3dffb700 1 -- 172.21.15.163:0/3522421509 <== mon.0 v2:172.21.15.163:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 4566+0+0 (secure 0 0 0) 0x7efe2c0cb610 con 0x7efe400ffdb0 2023-07-14T18:08:23.085 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:08:23.047+0000 7efe44b20700 1 --2- 172.21.15.163:0/3522421509 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7efe300a1150 0x7efe300a3600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:08:23.085 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:08:23.048+0000 7efe44b20700 1 --2- 172.21.15.163:0/3522421509 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7efe300a1150 0x7efe300a3600 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7efe400ffc10 tx=0x7efe3400a380 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:08:23.086 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:08:23.051+0000 7efe3dffb700 1 -- 172.21.15.163:0/3522421509 <== mon.0 v2:172.21.15.163:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178025 (secure 0 0 0) 0x7efe2c095c00 con 0x7efe400ffdb0 2023-07-14T18:08:23.169 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:08:22 smithi184 ceph-mon[98481]: purged_snaps scrub starts 2023-07-14T18:08:23.170 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:08:22 smithi184 ceph-mon[98481]: purged_snaps scrub ok 2023-07-14T18:08:23.170 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:08:22 smithi184 ceph-mon[98481]: Detected new or changed devices on smithi184 2023-07-14T18:08:23.170 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:08:22 smithi184 ceph-mon[98481]: Adjusting osd_memory_target on smithi184 to 8584M 2023-07-14T18:08:23.170 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:08:22 smithi184 ceph-mon[98481]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2023-07-14T18:08:23.170 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:08:22 smithi184 ceph-mon[98481]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi184", "root=default"]}]': finished 2023-07-14T18:08:23.170 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:08:22 smithi184 ceph-mon[98481]: osdmap e36: 6 total, 5 up, 6 in 2023-07-14T18:08:23.170 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:08:22 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-07-14T18:08:23.171 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:08:22 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-07-14T18:08:23.171 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:08:22 smithi184 ceph-mon[98481]: osd.5 [v2:172.21.15.184:6808/2662084043,v1:172.21.15.184:6809/2662084043] boot 2023-07-14T18:08:23.171 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:08:22 smithi184 ceph-mon[98481]: osdmap e37: 6 total, 6 up, 6 in 2023-07-14T18:08:23.171 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:08:22 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-07-14T18:08:23.280 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:08:23.245+0000 7efe46d84700 1 -- 172.21.15.163:0/3522421509 --> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi163:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) v1 -- 0x7efe40060a80 con 0x7efe300a1150 2023-07-14T18:08:23.962 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:08:23 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-07-14T18:08:23.962 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:08:23 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-07-14T18:08:23.962 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:08:23 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T18:08:23.962 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:08:23 smithi163 ceph-mon[96576]: osdmap e38: 6 total, 6 up, 6 in 2023-07-14T18:08:24.020 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:08:23 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-07-14T18:08:24.021 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:08:23 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-07-14T18:08:24.021 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:08:23 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T18:08:24.021 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:08:23 smithi172 ceph-mon[97983]: osdmap e38: 6 total, 6 up, 6 in 2023-07-14T18:08:24.169 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:08:23 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-07-14T18:08:24.170 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:08:23 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-07-14T18:08:24.170 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:08:23 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T18:08:24.170 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:08:23 smithi184 ceph-mon[98481]: osdmap e38: 6 total, 6 up, 6 in 2023-07-14T18:08:24.962 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:08:24 smithi163 ceph-mon[96576]: from='client.14370 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi163:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2023-07-14T18:08:24.962 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:08:24 smithi163 ceph-mon[96576]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2023-07-14T18:08:24.962 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:08:24 smithi163 ceph-mon[96576]: osdmap e39: 6 total, 6 up, 6 in 2023-07-14T18:08:25.020 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:08:24 smithi172 ceph-mon[97983]: from='client.14370 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi163:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2023-07-14T18:08:25.020 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:08:24 smithi172 ceph-mon[97983]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2023-07-14T18:08:25.021 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:08:24 smithi172 ceph-mon[97983]: osdmap e39: 6 total, 6 up, 6 in 2023-07-14T18:08:25.169 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:08:24 smithi184 ceph-mon[98481]: from='client.14370 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi163:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2023-07-14T18:08:25.170 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:08:24 smithi184 ceph-mon[98481]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2023-07-14T18:08:25.170 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:08:24 smithi184 ceph-mon[98481]: osdmap e39: 6 total, 6 up, 6 in 2023-07-14T18:08:26.020 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:08:25 smithi172 ceph-mon[97983]: from='client.? 172.21.15.163:0/1780284060' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "dba754be-0fc5-4867-a6d5-cf97eb344f81"}]: dispatch 2023-07-14T18:08:26.021 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:08:25 smithi172 ceph-mon[97983]: from='client.? 172.21.15.163:0/1780284060' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "dba754be-0fc5-4867-a6d5-cf97eb344f81"}]': finished 2023-07-14T18:08:26.021 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:08:25 smithi172 ceph-mon[97983]: osdmap e40: 7 total, 6 up, 7 in 2023-07-14T18:08:26.021 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:08:25 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-07-14T18:08:26.170 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:08:25 smithi184 ceph-mon[98481]: from='client.? 172.21.15.163:0/1780284060' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "dba754be-0fc5-4867-a6d5-cf97eb344f81"}]: dispatch 2023-07-14T18:08:26.170 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:08:25 smithi184 ceph-mon[98481]: from='client.? 172.21.15.163:0/1780284060' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "dba754be-0fc5-4867-a6d5-cf97eb344f81"}]': finished 2023-07-14T18:08:26.170 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:08:25 smithi184 ceph-mon[98481]: osdmap e40: 7 total, 6 up, 7 in 2023-07-14T18:08:26.171 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:08:25 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-07-14T18:08:26.212 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:08:25 smithi163 ceph-mon[96576]: from='client.? 172.21.15.163:0/1780284060' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "dba754be-0fc5-4867-a6d5-cf97eb344f81"}]: dispatch 2023-07-14T18:08:26.213 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:08:25 smithi163 ceph-mon[96576]: from='client.? 172.21.15.163:0/1780284060' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "dba754be-0fc5-4867-a6d5-cf97eb344f81"}]': finished 2023-07-14T18:08:26.213 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:08:25 smithi163 ceph-mon[96576]: osdmap e40: 7 total, 6 up, 7 in 2023-07-14T18:08:26.213 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:08:25 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-07-14T18:08:27.020 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:08:26 smithi172 ceph-mon[97983]: pgmap v124: 1 pgs: 1 activating+undersized+degraded+remapped; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 2/6 objects degraded (33.333%) 2023-07-14T18:08:27.021 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:08:26 smithi172 ceph-mon[97983]: Health check failed: Degraded data redundancy: 2/6 objects degraded (33.333%), 1 pg degraded (PG_DEGRADED) 2023-07-14T18:08:27.021 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:08:26 smithi172 ceph-mon[97983]: from='client.? 172.21.15.163:0/4249655169' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-07-14T18:08:27.021 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:08:26 smithi172 ceph-mon[97983]: osdmap e41: 7 total, 6 up, 7 in 2023-07-14T18:08:27.021 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:08:26 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-07-14T18:08:27.169 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:08:26 smithi184 ceph-mon[98481]: pgmap v124: 1 pgs: 1 activating+undersized+degraded+remapped; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 2/6 objects degraded (33.333%) 2023-07-14T18:08:27.170 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:08:26 smithi184 ceph-mon[98481]: Health check failed: Degraded data redundancy: 2/6 objects degraded (33.333%), 1 pg degraded (PG_DEGRADED) 2023-07-14T18:08:27.170 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:08:26 smithi184 ceph-mon[98481]: from='client.? 172.21.15.163:0/4249655169' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-07-14T18:08:27.170 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:08:26 smithi184 ceph-mon[98481]: osdmap e41: 7 total, 6 up, 7 in 2023-07-14T18:08:27.170 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:08:26 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-07-14T18:08:27.212 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:08:26 smithi163 ceph-mon[96576]: pgmap v124: 1 pgs: 1 activating+undersized+degraded+remapped; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 2/6 objects degraded (33.333%) 2023-07-14T18:08:27.212 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:08:26 smithi163 ceph-mon[96576]: Health check failed: Degraded data redundancy: 2/6 objects degraded (33.333%), 1 pg degraded (PG_DEGRADED) 2023-07-14T18:08:27.212 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:08:26 smithi163 ceph-mon[96576]: from='client.? 172.21.15.163:0/4249655169' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-07-14T18:08:27.213 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:08:26 smithi163 ceph-mon[96576]: osdmap e41: 7 total, 6 up, 7 in 2023-07-14T18:08:27.213 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:08:26 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-07-14T18:08:29.020 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:08:28 smithi172 ceph-mon[97983]: pgmap v127: 1 pgs: 1 activating+undersized+degraded+remapped; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 2/6 objects degraded (33.333%) 2023-07-14T18:08:29.170 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:08:28 smithi184 ceph-mon[98481]: pgmap v127: 1 pgs: 1 activating+undersized+degraded+remapped; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 2/6 objects degraded (33.333%) 2023-07-14T18:08:29.212 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:08:28 smithi163 ceph-mon[96576]: pgmap v127: 1 pgs: 1 activating+undersized+degraded+remapped; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 2/6 objects degraded (33.333%) 2023-07-14T18:08:30.913 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:08:30 smithi163 ceph-mon[96576]: pgmap v128: 1 pgs: 1 activating+undersized+degraded+remapped; 577 KiB data, 163 MiB used, 536 GiB / 536 GiB avail; 2/6 objects degraded (33.333%) 2023-07-14T18:08:31.020 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:08:30 smithi172 ceph-mon[97983]: pgmap v128: 1 pgs: 1 activating+undersized+degraded+remapped; 577 KiB data, 163 MiB used, 536 GiB / 536 GiB avail; 2/6 objects degraded (33.333%) 2023-07-14T18:08:31.169 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:08:30 smithi184 ceph-mon[98481]: pgmap v128: 1 pgs: 1 activating+undersized+degraded+remapped; 577 KiB data, 163 MiB used, 536 GiB / 536 GiB avail; 2/6 objects degraded (33.333%) 2023-07-14T18:08:32.087 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:08:31 smithi163 ceph-mon[96576]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 2/6 objects degraded (33.333%), 1 pg degraded) 2023-07-14T18:08:32.088 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:08:31 smithi163 ceph-mon[96576]: Cluster is now healthy 2023-07-14T18:08:32.169 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:08:31 smithi184 ceph-mon[98481]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 2/6 objects degraded (33.333%), 1 pg degraded) 2023-07-14T18:08:32.170 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:08:31 smithi184 ceph-mon[98481]: Cluster is now healthy 2023-07-14T18:08:32.271 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:08:31 smithi172 ceph-mon[97983]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 2/6 objects degraded (33.333%), 1 pg degraded) 2023-07-14T18:08:32.271 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:08:31 smithi172 ceph-mon[97983]: Cluster is now healthy 2023-07-14T18:08:33.070 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:08:32 smithi163 ceph-mon[96576]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 86 KiB/s, 0 objects/s recovering 2023-07-14T18:08:33.071 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:08:32 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2023-07-14T18:08:33.071 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:08:32 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T18:08:33.071 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:08:32 smithi163 ceph-mon[96576]: Deploying daemon osd.6 on smithi163 2023-07-14T18:08:33.170 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:08:32 smithi184 ceph-mon[98481]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 86 KiB/s, 0 objects/s recovering 2023-07-14T18:08:33.170 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:08:32 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2023-07-14T18:08:33.170 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:08:32 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T18:08:33.170 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:08:32 smithi184 ceph-mon[98481]: Deploying daemon osd.6 on smithi163 2023-07-14T18:08:33.270 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:08:32 smithi172 ceph-mon[97983]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 86 KiB/s, 0 objects/s recovering 2023-07-14T18:08:33.271 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:08:32 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2023-07-14T18:08:33.271 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:08:32 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T18:08:33.271 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:08:32 smithi172 ceph-mon[97983]: Deploying daemon osd.6 on smithi163 2023-07-14T18:08:34.086 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:08:33 smithi163 ceph-mon[96576]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 72 KiB/s, 0 objects/s recovering 2023-07-14T18:08:34.169 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:08:33 smithi184 ceph-mon[98481]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 72 KiB/s, 0 objects/s recovering 2023-07-14T18:08:34.270 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:08:33 smithi172 ceph-mon[97983]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 72 KiB/s, 0 objects/s recovering 2023-07-14T18:08:36.962 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:08:36 smithi163 ceph-mon[96576]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 59 KiB/s, 0 objects/s recovering 2023-07-14T18:08:36.962 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:08:36 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:08:36.963 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:08:36 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-14T18:08:36.963 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:08:36 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:08:37.021 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:08:36 smithi172 ceph-mon[97983]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 59 KiB/s, 0 objects/s recovering 2023-07-14T18:08:37.021 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:08:36 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:08:37.021 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:08:36 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-14T18:08:37.021 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:08:36 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:08:37.170 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:08:36 smithi184 ceph-mon[98481]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 59 KiB/s, 0 objects/s recovering 2023-07-14T18:08:37.170 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:08:36 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:08:37.170 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:08:36 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-14T18:08:37.170 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:08:36 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:08:39.021 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:08:38 smithi172 ceph-mon[97983]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 54 KiB/s, 0 objects/s recovering 2023-07-14T18:08:39.170 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:08:38 smithi184 ceph-mon[98481]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 54 KiB/s, 0 objects/s recovering 2023-07-14T18:08:39.212 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:08:38 smithi163 ceph-mon[96576]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 54 KiB/s, 0 objects/s recovering 2023-07-14T18:08:39.680 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:08:39.644+0000 7efe3dffb700 1 -- 172.21.15.163:0/3522421509 <== mgr.14152 v2:172.21.15.163:6800/1949590926 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7efe40060a80 con 0x7efe300a1150 2023-07-14T18:08:39.681 INFO:teuthology.orchestra.run.smithi163.stdout:Created osd(s) 6 on host 'smithi163' 2023-07-14T18:08:39.683 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:08:39.646+0000 7efe46d84700 1 -- 172.21.15.163:0/3522421509 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7efe300a1150 msgr2=0x7efe300a3600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:08:39.683 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:08:39.646+0000 7efe46d84700 1 --2- 172.21.15.163:0/3522421509 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7efe300a1150 0x7efe300a3600 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7efe400ffc10 tx=0x7efe3400a380 comp rx=0 tx=0).stop 2023-07-14T18:08:39.683 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:08:39.646+0000 7efe46d84700 1 -- 172.21.15.163:0/3522421509 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7efe400ffdb0 msgr2=0x7efe40194e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:08:39.683 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:08:39.646+0000 7efe46d84700 1 --2- 172.21.15.163:0/3522421509 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7efe400ffdb0 0x7efe40194e30 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7efe2c00c950 tx=0x7efe2c00cc60 comp rx=0 tx=0).stop 2023-07-14T18:08:39.683 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:08:39.647+0000 7efe46d84700 1 -- 172.21.15.163:0/3522421509 shutdown_connections 2023-07-14T18:08:39.683 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:08:39.647+0000 7efe46d84700 1 --2- 172.21.15.163:0/3522421509 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7efe300a1150 0x7efe300a3600 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:08:39.683 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:08:39.647+0000 7efe46d84700 1 --2- 172.21.15.163:0/3522421509 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7efe40100740 0x7efe4019beb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:08:39.684 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:08:39.647+0000 7efe46d84700 1 --2- 172.21.15.163:0/3522421509 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efe400febb0 0x7efe401948f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:08:39.684 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:08:39.647+0000 7efe46d84700 1 --2- 172.21.15.163:0/3522421509 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7efe400ffdb0 0x7efe40194e30 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:08:39.684 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:08:39.647+0000 7efe46d84700 1 -- 172.21.15.163:0/3522421509 >> 172.21.15.163:0/3522421509 conn(0x7efe400fa1e0 msgr2=0x7efe40103330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:08:39.684 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:08:39.647+0000 7efe46d84700 1 -- 172.21.15.163:0/3522421509 shutdown_connections 2023-07-14T18:08:39.684 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:08:39.647+0000 7efe46d84700 1 -- 172.21.15.163:0/3522421509 wait complete. 2023-07-14T18:08:40.091 DEBUG:teuthology.orchestra.run.smithi163:osd.6> sudo journalctl -f -n 0 -u ceph-bf7326ec-2270-11ee-9b33-001a4aab830c@osd.6.service 2023-07-14T18:08:40.093 INFO:tasks.cephadm:Deploying osd.7 on smithi172 with /dev/vg_nvme/lv_2... 2023-07-14T18:08:40.094 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81c9387d2e7576da065747ec9c16d1c7d69016ec shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bf7326ec-2270-11ee-9b33-001a4aab830c -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2023-07-14T18:08:40.136 INFO:journalctl@ceph.osd.6.smithi163.stdout:-- Logs begin at Fri 2023-07-14 17:46:25 UTC. -- 2023-07-14T18:08:40.212 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:08:39 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:08:40.213 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:08:39 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:08:40.213 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:08:39 smithi163 ceph-mon[96576]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 48 KiB/s, 0 objects/s recovering 2023-07-14T18:08:40.213 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:08:39 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T18:08:40.213 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:08:39 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-14T18:08:40.213 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:08:39 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:08:40.213 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:08:39 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:08:40.213 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:08:39 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:08:40.214 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:08:39 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-14T18:08:40.271 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:08:39 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:08:40.271 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:08:39 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:08:40.271 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:08:39 smithi172 ceph-mon[97983]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 48 KiB/s, 0 objects/s recovering 2023-07-14T18:08:40.271 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:08:39 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T18:08:40.271 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:08:39 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-14T18:08:40.272 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:08:39 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:08:40.272 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:08:39 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:08:40.272 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:08:39 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:08:40.272 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:08:39 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-14T18:08:40.420 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:08:39 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:08:40.420 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:08:39 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:08:40.420 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:08:39 smithi184 ceph-mon[98481]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 48 KiB/s, 0 objects/s recovering 2023-07-14T18:08:40.420 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:08:39 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T18:08:40.421 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:08:39 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-14T18:08:40.421 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:08:39 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:08:40.421 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:08:39 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:08:40.421 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:08:39 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:08:40.421 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:08:39 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-14T18:08:40.673 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/bf7326ec-2270-11ee-9b33-001a4aab830c/mon.b/config 2023-07-14T18:08:40.869 INFO:journalctl@ceph.osd.6.smithi163.stdout:Jul 14 18:08:40 smithi163 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-6[120359]: 2023-07-14T18:08:40.518+0000 7fc6a162c640 -1 osd.6 0 log_to_monitors true 2023-07-14T18:08:41.149 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:08:40 smithi163 ceph-mon[96576]: from='osd.6 [v2:172.21.15.163:6818/2530874117,v1:172.21.15.163:6819/2530874117]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2023-07-14T18:08:41.184 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:08:40 smithi172 ceph-mon[97983]: from='osd.6 [v2:172.21.15.163:6818/2530874117,v1:172.21.15.163:6819/2530874117]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2023-07-14T18:08:41.420 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:08:40 smithi184 ceph-mon[98481]: from='osd.6 [v2:172.21.15.163:6818/2530874117,v1:172.21.15.163:6819/2530874117]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2023-07-14T18:08:42.024 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:08:41 smithi172 ceph-mon[97983]: from='osd.6 [v2:172.21.15.163:6818/2530874117,v1:172.21.15.163:6819/2530874117]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2023-07-14T18:08:42.025 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:08:41 smithi172 ceph-mon[97983]: osdmap e42: 7 total, 6 up, 7 in 2023-07-14T18:08:42.025 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:08:41 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-07-14T18:08:42.025 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:08:41 smithi172 ceph-mon[97983]: from='osd.6 [v2:172.21.15.163:6818/2530874117,v1:172.21.15.163:6819/2530874117]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi163", "root=default"]}]: dispatch 2023-07-14T18:08:42.026 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:08:41 smithi172 ceph-mon[97983]: pgmap v135: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2023-07-14T18:08:42.198 INFO:teuthology.orchestra.run.smithi172.stderr:--> Zapping: /dev/vg_nvme/lv_2 2023-07-14T18:08:42.199 INFO:teuthology.orchestra.run.smithi172.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2023-07-14T18:08:42.199 INFO:teuthology.orchestra.run.smithi172.stderr: stderr: 10+0 records in 2023-07-14T18:08:42.199 INFO:teuthology.orchestra.run.smithi172.stderr:10+0 records out 2023-07-14T18:08:42.199 INFO:teuthology.orchestra.run.smithi172.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0110996 s, 945 MB/s 2023-07-14T18:08:42.199 INFO:teuthology.orchestra.run.smithi172.stderr: stderr: 2023-07-14T18:08:42.199 INFO:teuthology.orchestra.run.smithi172.stderr:--> Zapping successful for: 2023-07-14T18:08:42.213 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:08:41 smithi163 ceph-mon[96576]: from='osd.6 [v2:172.21.15.163:6818/2530874117,v1:172.21.15.163:6819/2530874117]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2023-07-14T18:08:42.213 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:08:41 smithi163 ceph-mon[96576]: osdmap e42: 7 total, 6 up, 7 in 2023-07-14T18:08:42.213 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:08:41 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-07-14T18:08:42.213 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:08:41 smithi163 ceph-mon[96576]: from='osd.6 [v2:172.21.15.163:6818/2530874117,v1:172.21.15.163:6819/2530874117]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi163", "root=default"]}]: dispatch 2023-07-14T18:08:42.213 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:08:41 smithi163 ceph-mon[96576]: pgmap v135: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2023-07-14T18:08:42.214 INFO:journalctl@ceph.osd.6.smithi163.stdout:Jul 14 18:08:41 smithi163 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-6[120359]: 2023-07-14T18:08:41.908+0000 7fc696ca4700 -1 osd.6 0 waiting for initial osdmap 2023-07-14T18:08:42.214 INFO:journalctl@ceph.osd.6.smithi163.stdout:Jul 14 18:08:41 smithi163 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-6[120359]: 2023-07-14T18:08:41.917+0000 7fc68fa94700 -1 osd.6 43 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-07-14T18:08:42.420 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:08:41 smithi184 ceph-mon[98481]: from='osd.6 [v2:172.21.15.163:6818/2530874117,v1:172.21.15.163:6819/2530874117]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2023-07-14T18:08:42.420 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:08:41 smithi184 ceph-mon[98481]: osdmap e42: 7 total, 6 up, 7 in 2023-07-14T18:08:42.420 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:08:41 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-07-14T18:08:42.420 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:08:41 smithi184 ceph-mon[98481]: from='osd.6 [v2:172.21.15.163:6818/2530874117,v1:172.21.15.163:6819/2530874117]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi163", "root=default"]}]: dispatch 2023-07-14T18:08:42.421 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:08:41 smithi184 ceph-mon[98481]: pgmap v135: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2023-07-14T18:08:42.527 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81c9387d2e7576da065747ec9c16d1c7d69016ec shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bf7326ec-2270-11ee-9b33-001a4aab830c -- ceph orch daemon add osd smithi172:vg_nvme/lv_2 2023-07-14T18:08:43.081 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/bf7326ec-2270-11ee-9b33-001a4aab830c/mon.b/config 2023-07-14T18:08:43.213 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:08:42 smithi163 ceph-mon[96576]: from='osd.6 [v2:172.21.15.163:6818/2530874117,v1:172.21.15.163:6819/2530874117]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi163", "root=default"]}]': finished 2023-07-14T18:08:43.213 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:08:42 smithi163 ceph-mon[96576]: osdmap e43: 7 total, 6 up, 7 in 2023-07-14T18:08:43.213 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:08:42 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-07-14T18:08:43.214 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:08:42 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-07-14T18:08:43.214 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:08:42 smithi163 ceph-mon[96576]: Detected new or changed devices on smithi163 2023-07-14T18:08:43.214 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:08:42 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:08:43.214 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:08:42 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:08:43.215 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:08:42 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-07-14T18:08:43.215 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:08:42 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-07-14T18:08:43.215 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:08:42 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-07-14T18:08:43.215 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:08:42 smithi163 ceph-mon[96576]: Adjusting osd_memory_target on smithi163 to 5722M 2023-07-14T18:08:43.216 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:08:42 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:08:43.216 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:08:42 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T18:08:43.216 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:08:42 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-14T18:08:43.217 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:08:42 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:08:43.271 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:08:42 smithi172 ceph-mon[97983]: from='osd.6 [v2:172.21.15.163:6818/2530874117,v1:172.21.15.163:6819/2530874117]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi163", "root=default"]}]': finished 2023-07-14T18:08:43.271 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:08:42 smithi172 ceph-mon[97983]: osdmap e43: 7 total, 6 up, 7 in 2023-07-14T18:08:43.271 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:08:42 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-07-14T18:08:43.271 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:08:42 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-07-14T18:08:43.272 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:08:42 smithi172 ceph-mon[97983]: Detected new or changed devices on smithi163 2023-07-14T18:08:43.272 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:08:42 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:08:43.272 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:08:42 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:08:43.272 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:08:42 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-07-14T18:08:43.272 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:08:42 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-07-14T18:08:43.272 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:08:42 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-07-14T18:08:43.273 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:08:42 smithi172 ceph-mon[97983]: Adjusting osd_memory_target on smithi163 to 5722M 2023-07-14T18:08:43.273 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:08:42 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:08:43.273 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:08:42 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T18:08:43.273 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:08:42 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-14T18:08:43.273 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:08:42 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:08:43.420 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:08:42 smithi184 ceph-mon[98481]: from='osd.6 [v2:172.21.15.163:6818/2530874117,v1:172.21.15.163:6819/2530874117]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi163", "root=default"]}]': finished 2023-07-14T18:08:43.420 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:08:42 smithi184 ceph-mon[98481]: osdmap e43: 7 total, 6 up, 7 in 2023-07-14T18:08:43.420 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:08:42 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-07-14T18:08:43.421 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:08:42 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-07-14T18:08:43.421 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:08:42 smithi184 ceph-mon[98481]: Detected new or changed devices on smithi163 2023-07-14T18:08:43.421 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:08:42 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:08:43.421 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:08:42 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:08:43.421 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:08:42 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-07-14T18:08:43.421 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:08:42 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-07-14T18:08:43.421 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:08:42 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-07-14T18:08:43.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:08:42 smithi184 ceph-mon[98481]: Adjusting osd_memory_target on smithi163 to 5722M 2023-07-14T18:08:43.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:08:42 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:08:43.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:08:42 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T18:08:43.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:08:42 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-14T18:08:43.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:08:42 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:08:44.212 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:08:43 smithi163 ceph-mon[96576]: purged_snaps scrub starts 2023-07-14T18:08:44.213 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:08:43 smithi163 ceph-mon[96576]: purged_snaps scrub ok 2023-07-14T18:08:44.213 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:08:43 smithi163 ceph-mon[96576]: osd.6 [v2:172.21.15.163:6818/2530874117,v1:172.21.15.163:6819/2530874117] boot 2023-07-14T18:08:44.213 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:08:43 smithi163 ceph-mon[96576]: osdmap e44: 7 total, 7 up, 7 in 2023-07-14T18:08:44.213 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:08:43 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-07-14T18:08:44.213 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:08:43 smithi163 ceph-mon[96576]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2023-07-14T18:08:44.271 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:08:43 smithi172 ceph-mon[97983]: purged_snaps scrub starts 2023-07-14T18:08:44.272 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:08:43 smithi172 ceph-mon[97983]: purged_snaps scrub ok 2023-07-14T18:08:44.272 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:08:43 smithi172 ceph-mon[97983]: osd.6 [v2:172.21.15.163:6818/2530874117,v1:172.21.15.163:6819/2530874117] boot 2023-07-14T18:08:44.272 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:08:43 smithi172 ceph-mon[97983]: osdmap e44: 7 total, 7 up, 7 in 2023-07-14T18:08:44.273 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:08:43 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-07-14T18:08:44.273 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:08:43 smithi172 ceph-mon[97983]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2023-07-14T18:08:44.283 INFO:teuthology.orchestra.run.smithi172.stderr:2023-07-14T18:08:44.247+0000 7f4f4d6c1700 1 -- 172.21.15.172:0/1263880697 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4f48101060 msgr2=0x7f4f481014b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:08:44.283 INFO:teuthology.orchestra.run.smithi172.stderr:2023-07-14T18:08:44.247+0000 7f4f4d6c1700 1 --2- 172.21.15.172:0/1263880697 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4f48101060 0x7f4f481014b0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f4f380099c0 tx=0x7f4f38009cd0 comp rx=0 tx=0).stop 2023-07-14T18:08:44.284 INFO:teuthology.orchestra.run.smithi172.stderr:2023-07-14T18:08:44.247+0000 7f4f4d6c1700 1 -- 172.21.15.172:0/1263880697 shutdown_connections 2023-07-14T18:08:44.284 INFO:teuthology.orchestra.run.smithi172.stderr:2023-07-14T18:08:44.247+0000 7f4f4d6c1700 1 --2- 172.21.15.172:0/1263880697 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4f481019f0 0x7f4f481082b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:08:44.284 INFO:teuthology.orchestra.run.smithi172.stderr:2023-07-14T18:08:44.247+0000 7f4f4d6c1700 1 --2- 172.21.15.172:0/1263880697 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f4f480fdfe0 0x7f4f480fe3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:08:44.284 INFO:teuthology.orchestra.run.smithi172.stderr:2023-07-14T18:08:44.247+0000 7f4f4d6c1700 1 --2- 172.21.15.172:0/1263880697 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4f48101060 0x7f4f481014b0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:08:44.284 INFO:teuthology.orchestra.run.smithi172.stderr:2023-07-14T18:08:44.247+0000 7f4f4d6c1700 1 -- 172.21.15.172:0/1263880697 >> 172.21.15.172:0/1263880697 conn(0x7f4f480f99b0 msgr2=0x7f4f480fbe00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:08:44.284 INFO:teuthology.orchestra.run.smithi172.stderr:2023-07-14T18:08:44.247+0000 7f4f4d6c1700 1 -- 172.21.15.172:0/1263880697 shutdown_connections 2023-07-14T18:08:44.285 INFO:teuthology.orchestra.run.smithi172.stderr:2023-07-14T18:08:44.247+0000 7f4f4d6c1700 1 -- 172.21.15.172:0/1263880697 wait complete. 2023-07-14T18:08:44.286 INFO:teuthology.orchestra.run.smithi172.stderr:2023-07-14T18:08:44.248+0000 7f4f4d6c1700 1 Processor -- start 2023-07-14T18:08:44.286 INFO:teuthology.orchestra.run.smithi172.stderr:2023-07-14T18:08:44.248+0000 7f4f4d6c1700 1 -- start start 2023-07-14T18:08:44.286 INFO:teuthology.orchestra.run.smithi172.stderr:2023-07-14T18:08:44.248+0000 7f4f4d6c1700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4f480fdfe0 0x7f4f48195980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:08:44.287 INFO:teuthology.orchestra.run.smithi172.stderr:2023-07-14T18:08:44.248+0000 7f4f4d6c1700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f4f48101060 0x7f4f48195ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:08:44.287 INFO:teuthology.orchestra.run.smithi172.stderr:2023-07-14T18:08:44.248+0000 7f4f4d6c1700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4f481019f0 0x7f4f4819cf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:08:44.287 INFO:teuthology.orchestra.run.smithi172.stderr:2023-07-14T18:08:44.248+0000 7f4f4d6c1700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f4819d510 con 0x7f4f48101060 2023-07-14T18:08:44.287 INFO:teuthology.orchestra.run.smithi172.stderr:2023-07-14T18:08:44.248+0000 7f4f4d6c1700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f4819d650 con 0x7f4f480fdfe0 2023-07-14T18:08:44.287 INFO:teuthology.orchestra.run.smithi172.stderr:2023-07-14T18:08:44.248+0000 7f4f4d6c1700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f4819d7e0 con 0x7f4f481019f0 2023-07-14T18:08:44.287 INFO:teuthology.orchestra.run.smithi172.stderr:2023-07-14T18:08:44.248+0000 7f4f46ffd700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4f480fdfe0 0x7f4f48195980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:08:44.287 INFO:teuthology.orchestra.run.smithi172.stderr:2023-07-14T18:08:44.248+0000 7f4f46ffd700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4f480fdfe0 0x7f4f48195980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:34524/0 (socket says 172.21.15.172:34524) 2023-07-14T18:08:44.288 INFO:teuthology.orchestra.run.smithi172.stderr:2023-07-14T18:08:44.248+0000 7f4f46ffd700 1 -- 172.21.15.172:0/4259600199 learned_addr learned my addr 172.21.15.172:0/4259600199 (peer_addr_for_me v2:172.21.15.172:0/0) 2023-07-14T18:08:44.288 INFO:teuthology.orchestra.run.smithi172.stderr:2023-07-14T18:08:44.248+0000 7f4f46ffd700 1 -- 172.21.15.172:0/4259600199 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4f481019f0 msgr2=0x7f4f4819cf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:08:44.288 INFO:teuthology.orchestra.run.smithi172.stderr:2023-07-14T18:08:44.248+0000 7f4f46ffd700 1 --2- 172.21.15.172:0/4259600199 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4f481019f0 0x7f4f4819cf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:08:44.288 INFO:teuthology.orchestra.run.smithi172.stderr:2023-07-14T18:08:44.248+0000 7f4f46ffd700 1 -- 172.21.15.172:0/4259600199 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f4f48101060 msgr2=0x7f4f48195ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:08:44.288 INFO:teuthology.orchestra.run.smithi172.stderr:2023-07-14T18:08:44.248+0000 7f4f467fc700 1 --2- 172.21.15.172:0/4259600199 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f4f48101060 0x7f4f48195ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:08:44.288 INFO:teuthology.orchestra.run.smithi172.stderr:2023-07-14T18:08:44.248+0000 7f4f46ffd700 1 --2- 172.21.15.172:0/4259600199 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f4f48101060 0x7f4f48195ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:08:44.288 INFO:teuthology.orchestra.run.smithi172.stderr:2023-07-14T18:08:44.248+0000 7f4f46ffd700 1 -- 172.21.15.172:0/4259600199 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f380095f0 con 0x7f4f480fdfe0 2023-07-14T18:08:44.289 INFO:teuthology.orchestra.run.smithi172.stderr:2023-07-14T18:08:44.249+0000 7f4f46ffd700 1 --2- 172.21.15.172:0/4259600199 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4f480fdfe0 0x7f4f48195980 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f4f3c00c8f0 tx=0x7f4f3c00ccb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:08:44.289 INFO:teuthology.orchestra.run.smithi172.stderr:2023-07-14T18:08:44.249+0000 7f4f2ffff700 1 -- 172.21.15.172:0/4259600199 <== mon.2 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f3c004220 con 0x7f4f480fdfe0 2023-07-14T18:08:44.289 INFO:teuthology.orchestra.run.smithi172.stderr:2023-07-14T18:08:44.249+0000 7f4f2ffff700 1 -- 172.21.15.172:0/4259600199 <== mon.2 v2:172.21.15.172:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f4f3c007d90 con 0x7f4f480fdfe0 2023-07-14T18:08:44.289 INFO:teuthology.orchestra.run.smithi172.stderr:2023-07-14T18:08:44.249+0000 7f4f4d6c1700 1 -- 172.21.15.172:0/4259600199 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f4819dac0 con 0x7f4f480fdfe0 2023-07-14T18:08:44.289 INFO:teuthology.orchestra.run.smithi172.stderr:2023-07-14T18:08:44.249+0000 7f4f2ffff700 1 -- 172.21.15.172:0/4259600199 <== mon.2 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f3c003bd0 con 0x7f4f480fdfe0 2023-07-14T18:08:44.289 INFO:teuthology.orchestra.run.smithi172.stderr:2023-07-14T18:08:44.249+0000 7f4f4d6c1700 1 -- 172.21.15.172:0/4259600199 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f4819df70 con 0x7f4f480fdfe0 2023-07-14T18:08:44.289 INFO:teuthology.orchestra.run.smithi172.stderr:2023-07-14T18:08:44.250+0000 7f4f4d6c1700 1 -- 172.21.15.172:0/4259600199 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4f48107460 con 0x7f4f480fdfe0 2023-07-14T18:08:44.290 INFO:teuthology.orchestra.run.smithi172.stderr:2023-07-14T18:08:44.252+0000 7f4f2ffff700 1 -- 172.21.15.172:0/4259600199 <== mon.2 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 16) v1 ==== 135716+0+0 (secure 0 0 0) 0x7f4f3c007900 con 0x7f4f480fdfe0 2023-07-14T18:08:44.290 INFO:teuthology.orchestra.run.smithi172.stderr:2023-07-14T18:08:44.252+0000 7f4f2ffff700 1 --2- 172.21.15.172:0/4259600199 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f4f300a1150 0x7f4f300a3600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:08:44.291 INFO:teuthology.orchestra.run.smithi172.stderr:2023-07-14T18:08:44.252+0000 7f4f2ffff700 1 -- 172.21.15.172:0/4259600199 <== mon.2 v2:172.21.15.172:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 4965+0+0 (secure 0 0 0) 0x7f4f3c0cbcf0 con 0x7f4f480fdfe0 2023-07-14T18:08:44.291 INFO:teuthology.orchestra.run.smithi172.stderr:2023-07-14T18:08:44.252+0000 7f4f467fc700 1 --2- 172.21.15.172:0/4259600199 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f4f300a1150 0x7f4f300a3600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:08:44.291 INFO:teuthology.orchestra.run.smithi172.stderr:2023-07-14T18:08:44.253+0000 7f4f467fc700 1 --2- 172.21.15.172:0/4259600199 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f4f300a1150 0x7f4f300a3600 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f4f380098e0 tx=0x7f4f38000bc0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:08:44.291 INFO:teuthology.orchestra.run.smithi172.stderr:2023-07-14T18:08:44.255+0000 7f4f2ffff700 1 -- 172.21.15.172:0/4259600199 <== mon.2 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178025 (secure 0 0 0) 0x7f4f3c0960b0 con 0x7f4f480fdfe0 2023-07-14T18:08:44.420 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:08:43 smithi184 ceph-mon[98481]: purged_snaps scrub starts 2023-07-14T18:08:44.420 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:08:43 smithi184 ceph-mon[98481]: purged_snaps scrub ok 2023-07-14T18:08:44.420 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:08:43 smithi184 ceph-mon[98481]: osd.6 [v2:172.21.15.163:6818/2530874117,v1:172.21.15.163:6819/2530874117] boot 2023-07-14T18:08:44.420 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:08:43 smithi184 ceph-mon[98481]: osdmap e44: 7 total, 7 up, 7 in 2023-07-14T18:08:44.420 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:08:43 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-07-14T18:08:44.421 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:08:43 smithi184 ceph-mon[98481]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2023-07-14T18:08:44.483 INFO:teuthology.orchestra.run.smithi172.stderr:2023-07-14T18:08:44.446+0000 7f4f4d6c1700 1 -- 172.21.15.172:0/4259600199 --> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi172:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) v1 -- 0x7f4f48060a80 con 0x7f4f300a1150 2023-07-14T18:08:45.212 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:08:44 smithi163 ceph-mon[96576]: osdmap e45: 7 total, 7 up, 7 in 2023-07-14T18:08:45.213 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:08:44 smithi163 ceph-mon[96576]: from='client.24269 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi172:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2023-07-14T18:08:45.213 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:08:44 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-07-14T18:08:45.213 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:08:44 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-07-14T18:08:45.213 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:08:44 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T18:08:45.271 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:08:44 smithi172 ceph-mon[97983]: osdmap e45: 7 total, 7 up, 7 in 2023-07-14T18:08:45.271 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:08:44 smithi172 ceph-mon[97983]: from='client.24269 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi172:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2023-07-14T18:08:45.271 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:08:44 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-07-14T18:08:45.271 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:08:44 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-07-14T18:08:45.272 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:08:44 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T18:08:45.420 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:08:44 smithi184 ceph-mon[98481]: osdmap e45: 7 total, 7 up, 7 in 2023-07-14T18:08:45.420 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:08:44 smithi184 ceph-mon[98481]: from='client.24269 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi172:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2023-07-14T18:08:45.420 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:08:44 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-07-14T18:08:45.420 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:08:44 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-07-14T18:08:45.421 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:08:44 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T18:08:47.021 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:08:46 smithi172 ceph-mon[97983]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 626 GiB / 626 GiB avail 2023-07-14T18:08:47.170 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:08:46 smithi184 ceph-mon[98481]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 626 GiB / 626 GiB avail 2023-07-14T18:08:47.212 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:08:46 smithi163 ceph-mon[96576]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 626 GiB / 626 GiB avail 2023-07-14T18:08:48.021 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:08:47 smithi172 ceph-mon[97983]: from='client.? 172.21.15.172:0/1268549279' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "edd76e6b-6077-4619-b00d-1e906f70ddcc"}]: dispatch 2023-07-14T18:08:48.021 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:08:47 smithi172 ceph-mon[97983]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "edd76e6b-6077-4619-b00d-1e906f70ddcc"}]: dispatch 2023-07-14T18:08:48.021 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:08:47 smithi172 ceph-mon[97983]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "edd76e6b-6077-4619-b00d-1e906f70ddcc"}]': finished 2023-07-14T18:08:48.022 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:08:47 smithi172 ceph-mon[97983]: osdmap e46: 8 total, 7 up, 8 in 2023-07-14T18:08:48.022 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:08:47 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-07-14T18:08:48.022 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:08:47 smithi172 ceph-mon[97983]: from='client.? 172.21.15.172:0/3027980393' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-07-14T18:08:48.170 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:08:47 smithi184 ceph-mon[98481]: from='client.? 172.21.15.172:0/1268549279' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "edd76e6b-6077-4619-b00d-1e906f70ddcc"}]: dispatch 2023-07-14T18:08:48.170 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:08:47 smithi184 ceph-mon[98481]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "edd76e6b-6077-4619-b00d-1e906f70ddcc"}]: dispatch 2023-07-14T18:08:48.170 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:08:47 smithi184 ceph-mon[98481]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "edd76e6b-6077-4619-b00d-1e906f70ddcc"}]': finished 2023-07-14T18:08:48.171 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:08:47 smithi184 ceph-mon[98481]: osdmap e46: 8 total, 7 up, 8 in 2023-07-14T18:08:48.171 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:08:47 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-07-14T18:08:48.171 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:08:47 smithi184 ceph-mon[98481]: from='client.? 172.21.15.172:0/3027980393' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-07-14T18:08:48.213 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:08:47 smithi163 ceph-mon[96576]: from='client.? 172.21.15.172:0/1268549279' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "edd76e6b-6077-4619-b00d-1e906f70ddcc"}]: dispatch 2023-07-14T18:08:48.213 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:08:47 smithi163 ceph-mon[96576]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "edd76e6b-6077-4619-b00d-1e906f70ddcc"}]: dispatch 2023-07-14T18:08:48.213 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:08:47 smithi163 ceph-mon[96576]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "edd76e6b-6077-4619-b00d-1e906f70ddcc"}]': finished 2023-07-14T18:08:48.213 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:08:47 smithi163 ceph-mon[96576]: osdmap e46: 8 total, 7 up, 8 in 2023-07-14T18:08:48.213 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:08:47 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-07-14T18:08:48.213 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:08:47 smithi163 ceph-mon[96576]: from='client.? 172.21.15.172:0/3027980393' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-07-14T18:08:49.021 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:08:48 smithi172 ceph-mon[97983]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 626 GiB / 626 GiB avail 2023-07-14T18:08:49.170 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:08:48 smithi184 ceph-mon[98481]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 626 GiB / 626 GiB avail 2023-07-14T18:08:49.212 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:08:48 smithi163 ceph-mon[96576]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 626 GiB / 626 GiB avail 2023-07-14T18:08:51.012 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:08:50 smithi172 ceph-mon[97983]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 626 GiB / 626 GiB avail 2023-07-14T18:08:51.170 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:08:50 smithi184 ceph-mon[98481]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 626 GiB / 626 GiB avail 2023-07-14T18:08:51.212 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:08:50 smithi163 ceph-mon[96576]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 626 GiB / 626 GiB avail 2023-07-14T18:08:53.022 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:08:52 smithi172 ceph-mon[97983]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 626 GiB / 626 GiB avail 2023-07-14T18:08:53.170 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:08:52 smithi184 ceph-mon[98481]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 626 GiB / 626 GiB avail 2023-07-14T18:08:53.213 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:08:52 smithi163 ceph-mon[96576]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 626 GiB / 626 GiB avail 2023-07-14T18:08:54.021 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:08:53 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2023-07-14T18:08:54.021 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:08:53 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T18:08:54.170 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:08:53 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2023-07-14T18:08:54.170 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:08:53 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T18:08:54.212 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:08:53 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2023-07-14T18:08:54.213 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:08:53 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T18:08:55.021 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:08:54 smithi172 ceph-mon[97983]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 626 GiB / 626 GiB avail 2023-07-14T18:08:55.022 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:08:54 smithi172 ceph-mon[97983]: Deploying daemon osd.7 on smithi172 2023-07-14T18:08:55.170 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:08:54 smithi184 ceph-mon[98481]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 626 GiB / 626 GiB avail 2023-07-14T18:08:55.170 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:08:54 smithi184 ceph-mon[98481]: Deploying daemon osd.7 on smithi172 2023-07-14T18:08:55.212 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:08:54 smithi163 ceph-mon[96576]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 626 GiB / 626 GiB avail 2023-07-14T18:08:55.213 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:08:54 smithi163 ceph-mon[96576]: Deploying daemon osd.7 on smithi172 2023-07-14T18:08:57.022 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:08:56 smithi172 ceph-mon[97983]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 626 GiB / 626 GiB avail 2023-07-14T18:08:57.170 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:08:56 smithi184 ceph-mon[98481]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 626 GiB / 626 GiB avail 2023-07-14T18:08:57.213 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:08:56 smithi163 ceph-mon[96576]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 626 GiB / 626 GiB avail 2023-07-14T18:08:59.021 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:08:58 smithi172 ceph-mon[97983]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 626 GiB / 626 GiB avail 2023-07-14T18:08:59.021 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:08:58 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:08:59.021 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:08:58 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:08:59.022 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:08:58 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-14T18:08:59.170 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:08:58 smithi184 ceph-mon[98481]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 626 GiB / 626 GiB avail 2023-07-14T18:08:59.170 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:08:58 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:08:59.171 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:08:58 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:08:59.171 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:08:58 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-14T18:08:59.213 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:08:58 smithi163 ceph-mon[96576]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 626 GiB / 626 GiB avail 2023-07-14T18:08:59.213 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:08:58 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:08:59.213 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:08:58 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:08:59.213 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:08:58 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-14T18:09:00.947 INFO:teuthology.orchestra.run.smithi172.stdout:Created osd(s) 7 on host 'smithi172' 2023-07-14T18:09:00.947 INFO:teuthology.orchestra.run.smithi172.stderr:2023-07-14T18:09:00.911+0000 7f4f2ffff700 1 -- 172.21.15.172:0/4259600199 <== mgr.14152 v2:172.21.15.163:6800/1949590926 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f4f48060a80 con 0x7f4f300a1150 2023-07-14T18:09:00.949 INFO:teuthology.orchestra.run.smithi172.stderr:2023-07-14T18:09:00.913+0000 7f4f4d6c1700 1 -- 172.21.15.172:0/4259600199 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f4f300a1150 msgr2=0x7f4f300a3600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:09:00.949 INFO:teuthology.orchestra.run.smithi172.stderr:2023-07-14T18:09:00.913+0000 7f4f4d6c1700 1 --2- 172.21.15.172:0/4259600199 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f4f300a1150 0x7f4f300a3600 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f4f380098e0 tx=0x7f4f38000bc0 comp rx=0 tx=0).stop 2023-07-14T18:09:00.949 INFO:teuthology.orchestra.run.smithi172.stderr:2023-07-14T18:09:00.913+0000 7f4f4d6c1700 1 -- 172.21.15.172:0/4259600199 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4f480fdfe0 msgr2=0x7f4f48195980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:09:00.949 INFO:teuthology.orchestra.run.smithi172.stderr:2023-07-14T18:09:00.913+0000 7f4f4d6c1700 1 --2- 172.21.15.172:0/4259600199 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4f480fdfe0 0x7f4f48195980 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f4f3c00c8f0 tx=0x7f4f3c00ccb0 comp rx=0 tx=0).stop 2023-07-14T18:09:00.950 INFO:teuthology.orchestra.run.smithi172.stderr:2023-07-14T18:09:00.913+0000 7f4f4d6c1700 1 -- 172.21.15.172:0/4259600199 shutdown_connections 2023-07-14T18:09:00.950 INFO:teuthology.orchestra.run.smithi172.stderr:2023-07-14T18:09:00.913+0000 7f4f4d6c1700 1 --2- 172.21.15.172:0/4259600199 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f4f300a1150 0x7f4f300a3600 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:09:00.950 INFO:teuthology.orchestra.run.smithi172.stderr:2023-07-14T18:09:00.913+0000 7f4f4d6c1700 1 --2- 172.21.15.172:0/4259600199 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4f481019f0 0x7f4f4819cf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:09:00.950 INFO:teuthology.orchestra.run.smithi172.stderr:2023-07-14T18:09:00.913+0000 7f4f4d6c1700 1 --2- 172.21.15.172:0/4259600199 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4f480fdfe0 0x7f4f48195980 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:09:00.950 INFO:teuthology.orchestra.run.smithi172.stderr:2023-07-14T18:09:00.913+0000 7f4f4d6c1700 1 --2- 172.21.15.172:0/4259600199 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f4f48101060 0x7f4f48195ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:09:00.950 INFO:teuthology.orchestra.run.smithi172.stderr:2023-07-14T18:09:00.913+0000 7f4f4d6c1700 1 -- 172.21.15.172:0/4259600199 >> 172.21.15.172:0/4259600199 conn(0x7f4f480f99b0 msgr2=0x7f4f481045a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:09:00.950 INFO:teuthology.orchestra.run.smithi172.stderr:2023-07-14T18:09:00.913+0000 7f4f4d6c1700 1 -- 172.21.15.172:0/4259600199 shutdown_connections 2023-07-14T18:09:00.951 INFO:teuthology.orchestra.run.smithi172.stderr:2023-07-14T18:09:00.914+0000 7f4f4d6c1700 1 -- 172.21.15.172:0/4259600199 wait complete. 2023-07-14T18:09:01.123 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:09:00 smithi172 ceph-mon[97983]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 626 GiB / 626 GiB avail 2023-07-14T18:09:01.123 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:09:00 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:09:01.123 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:09:00 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:09:01.170 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:09:00 smithi184 ceph-mon[98481]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 626 GiB / 626 GiB avail 2023-07-14T18:09:01.170 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:09:00 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:09:01.171 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:09:00 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:09:01.213 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:09:00 smithi163 ceph-mon[96576]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 626 GiB / 626 GiB avail 2023-07-14T18:09:01.213 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:09:00 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:09:01.213 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:09:00 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:09:01.361 DEBUG:teuthology.orchestra.run.smithi172:osd.7> sudo journalctl -f -n 0 -u ceph-bf7326ec-2270-11ee-9b33-001a4aab830c@osd.7.service 2023-07-14T18:09:01.363 INFO:tasks.cephadm:Deploying osd.8 on smithi184 with /dev/vg_nvme/lv_2... 2023-07-14T18:09:01.364 DEBUG:teuthology.orchestra.run.smithi184:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81c9387d2e7576da065747ec9c16d1c7d69016ec shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bf7326ec-2270-11ee-9b33-001a4aab830c -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2023-07-14T18:09:01.393 INFO:journalctl@ceph.osd.7.smithi172.stdout:-- Logs begin at Fri 2023-07-14 17:45:52 UTC. -- 2023-07-14T18:09:01.936 INFO:teuthology.orchestra.run.smithi184.stderr:Inferring config /var/lib/ceph/bf7326ec-2270-11ee-9b33-001a4aab830c/mon.c/config 2023-07-14T18:09:02.122 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:09:01 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T18:09:02.122 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:09:01 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-14T18:09:02.122 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:09:01 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:09:02.122 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:09:01 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:09:02.123 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:09:01 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:09:02.123 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:09:01 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-14T18:09:02.123 INFO:journalctl@ceph.osd.7.smithi172.stdout:Jul 14 18:09:01 smithi172 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-7[114020]: 2023-07-14T18:09:01.886+0000 7f4bf8415640 -1 osd.7 0 log_to_monitors true 2023-07-14T18:09:02.131 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:09:01 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T18:09:02.131 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:09:01 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-14T18:09:02.132 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:09:01 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:09:02.132 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:09:01 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:09:02.132 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:09:01 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:09:02.132 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:09:01 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-14T18:09:02.213 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:09:01 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T18:09:02.213 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:09:01 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-14T18:09:02.213 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:09:01 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:09:02.213 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:09:01 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:09:02.213 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:09:01 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:09:02.214 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:09:01 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-14T18:09:03.021 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:09:02 smithi172 ceph-mon[97983]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 626 GiB / 626 GiB avail 2023-07-14T18:09:03.022 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:09:02 smithi172 ceph-mon[97983]: from='osd.7 [v2:172.21.15.172:6816/233511803,v1:172.21.15.172:6817/233511803]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2023-07-14T18:09:03.022 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:09:02 smithi172 ceph-mon[97983]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2023-07-14T18:09:03.171 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:09:02 smithi184 ceph-mon[98481]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 626 GiB / 626 GiB avail 2023-07-14T18:09:03.171 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:09:02 smithi184 ceph-mon[98481]: from='osd.7 [v2:172.21.15.172:6816/233511803,v1:172.21.15.172:6817/233511803]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2023-07-14T18:09:03.172 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:09:02 smithi184 ceph-mon[98481]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2023-07-14T18:09:03.213 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:09:02 smithi163 ceph-mon[96576]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 626 GiB / 626 GiB avail 2023-07-14T18:09:03.213 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:09:02 smithi163 ceph-mon[96576]: from='osd.7 [v2:172.21.15.172:6816/233511803,v1:172.21.15.172:6817/233511803]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2023-07-14T18:09:03.214 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:09:02 smithi163 ceph-mon[96576]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2023-07-14T18:09:03.408 INFO:teuthology.orchestra.run.smithi184.stderr:--> Zapping: /dev/vg_nvme/lv_2 2023-07-14T18:09:03.409 INFO:teuthology.orchestra.run.smithi184.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2023-07-14T18:09:03.409 INFO:teuthology.orchestra.run.smithi184.stderr: stderr: 10+0 records in 2023-07-14T18:09:03.409 INFO:teuthology.orchestra.run.smithi184.stderr:10+0 records out 2023-07-14T18:09:03.410 INFO:teuthology.orchestra.run.smithi184.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0148727 s, 705 MB/s 2023-07-14T18:09:03.410 INFO:teuthology.orchestra.run.smithi184.stderr:--> Zapping successful for: 2023-07-14T18:09:03.777 DEBUG:teuthology.orchestra.run.smithi184:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81c9387d2e7576da065747ec9c16d1c7d69016ec shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bf7326ec-2270-11ee-9b33-001a4aab830c -- ceph orch daemon add osd smithi184:vg_nvme/lv_2 2023-07-14T18:09:03.927 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:09:03 smithi172 ceph-mon[97983]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2023-07-14T18:09:03.927 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:09:03 smithi172 ceph-mon[97983]: osdmap e47: 8 total, 7 up, 8 in 2023-07-14T18:09:03.928 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:09:03 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-07-14T18:09:03.928 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:09:03 smithi172 ceph-mon[97983]: from='osd.7 [v2:172.21.15.172:6816/233511803,v1:172.21.15.172:6817/233511803]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi172", "root=default"]}]: dispatch 2023-07-14T18:09:03.928 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:09:03 smithi172 ceph-mon[97983]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi172", "root=default"]}]: dispatch 2023-07-14T18:09:03.928 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:09:03 smithi172 ceph-mon[97983]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 626 GiB / 626 GiB avail 2023-07-14T18:09:03.928 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:09:03 smithi172 ceph-mon[97983]: Detected new or changed devices on smithi172 2023-07-14T18:09:03.928 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:09:03 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:09:03.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:09:03 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:09:03.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:09:03 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-07-14T18:09:03.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:09:03 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-07-14T18:09:03.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:09:03 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-07-14T18:09:03.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:09:03 smithi172 ceph-mon[97983]: Adjusting osd_memory_target on smithi172 to 5722M 2023-07-14T18:09:03.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:09:03 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:09:03.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:09:03 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T18:09:03.930 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:09:03 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-14T18:09:03.930 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:09:03 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:09:04.170 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:09:03 smithi184 ceph-mon[98481]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2023-07-14T18:09:04.171 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:09:03 smithi184 ceph-mon[98481]: osdmap e47: 8 total, 7 up, 8 in 2023-07-14T18:09:04.171 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:09:03 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-07-14T18:09:04.171 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:09:03 smithi184 ceph-mon[98481]: from='osd.7 [v2:172.21.15.172:6816/233511803,v1:172.21.15.172:6817/233511803]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi172", "root=default"]}]: dispatch 2023-07-14T18:09:04.171 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:09:03 smithi184 ceph-mon[98481]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi172", "root=default"]}]: dispatch 2023-07-14T18:09:04.171 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:09:03 smithi184 ceph-mon[98481]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 626 GiB / 626 GiB avail 2023-07-14T18:09:04.171 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:09:03 smithi184 ceph-mon[98481]: Detected new or changed devices on smithi172 2023-07-14T18:09:04.172 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:09:03 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:09:04.172 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:09:03 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:09:04.172 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:09:03 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-07-14T18:09:04.173 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:09:03 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-07-14T18:09:04.173 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:09:03 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-07-14T18:09:04.173 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:09:03 smithi184 ceph-mon[98481]: Adjusting osd_memory_target on smithi172 to 5722M 2023-07-14T18:09:04.173 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:09:03 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:09:04.174 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:09:03 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T18:09:04.174 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:09:03 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-14T18:09:04.174 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:09:03 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:09:04.213 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:09:03 smithi163 ceph-mon[96576]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2023-07-14T18:09:04.213 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:09:03 smithi163 ceph-mon[96576]: osdmap e47: 8 total, 7 up, 8 in 2023-07-14T18:09:04.213 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:09:03 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-07-14T18:09:04.213 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:09:03 smithi163 ceph-mon[96576]: from='osd.7 [v2:172.21.15.172:6816/233511803,v1:172.21.15.172:6817/233511803]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi172", "root=default"]}]: dispatch 2023-07-14T18:09:04.214 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:09:03 smithi163 ceph-mon[96576]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi172", "root=default"]}]: dispatch 2023-07-14T18:09:04.214 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:09:03 smithi163 ceph-mon[96576]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 626 GiB / 626 GiB avail 2023-07-14T18:09:04.214 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:09:03 smithi163 ceph-mon[96576]: Detected new or changed devices on smithi172 2023-07-14T18:09:04.214 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:09:03 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:09:04.214 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:09:03 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:09:04.214 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:09:03 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-07-14T18:09:04.214 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:09:03 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-07-14T18:09:04.215 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:09:03 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-07-14T18:09:04.215 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:09:03 smithi163 ceph-mon[96576]: Adjusting osd_memory_target on smithi172 to 5722M 2023-07-14T18:09:04.215 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:09:03 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:09:04.215 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:09:03 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T18:09:04.215 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:09:03 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-14T18:09:04.215 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:09:03 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:09:04.271 INFO:journalctl@ceph.osd.7.smithi172.stdout:Jul 14 18:09:03 smithi172 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-7[114020]: 2023-07-14T18:09:03.890+0000 7f4beda8d700 -1 osd.7 0 waiting for initial osdmap 2023-07-14T18:09:04.271 INFO:journalctl@ceph.osd.7.smithi172.stdout:Jul 14 18:09:03 smithi172 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-7[114020]: 2023-07-14T18:09:03.898+0000 7f4be587b700 -1 osd.7 48 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-07-14T18:09:04.334 INFO:teuthology.orchestra.run.smithi184.stderr:Inferring config /var/lib/ceph/bf7326ec-2270-11ee-9b33-001a4aab830c/mon.c/config 2023-07-14T18:09:05.170 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:09:04 smithi184 ceph-mon[98481]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi172", "root=default"]}]': finished 2023-07-14T18:09:05.171 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:09:04 smithi184 ceph-mon[98481]: osdmap e48: 8 total, 7 up, 8 in 2023-07-14T18:09:05.171 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:09:04 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-07-14T18:09:05.171 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:09:04 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-07-14T18:09:05.213 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:09:04 smithi163 ceph-mon[96576]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi172", "root=default"]}]': finished 2023-07-14T18:09:05.213 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:09:04 smithi163 ceph-mon[96576]: osdmap e48: 8 total, 7 up, 8 in 2023-07-14T18:09:05.214 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:09:04 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-07-14T18:09:05.214 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:09:04 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-07-14T18:09:05.271 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:09:04 smithi172 ceph-mon[97983]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi172", "root=default"]}]': finished 2023-07-14T18:09:05.271 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:09:04 smithi172 ceph-mon[97983]: osdmap e48: 8 total, 7 up, 8 in 2023-07-14T18:09:05.272 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:09:04 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-07-14T18:09:05.272 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:09:04 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-07-14T18:09:05.538 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:09:05.500+0000 7f0f86839700 1 -- 172.21.15.184:0/3574371328 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0f800fee30 msgr2=0x7f0f800ff2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:09:05.538 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:09:05.500+0000 7f0f86839700 1 --2- 172.21.15.184:0/3574371328 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0f800fee30 0x7f0f800ff2a0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f0f74009990 tx=0x7f0f74009ca0 comp rx=0 tx=0).stop 2023-07-14T18:09:05.539 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:09:05.500+0000 7f0f86839700 1 -- 172.21.15.184:0/3574371328 shutdown_connections 2023-07-14T18:09:05.539 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:09:05.500+0000 7f0f86839700 1 --2- 172.21.15.184:0/3574371328 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f0f800ff7e0 0x7f0f80107090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:09:05.539 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:09:05.500+0000 7f0f86839700 1 --2- 172.21.15.184:0/3574371328 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0f801001d0 0x7f0f801005e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:09:05.539 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:09:05.500+0000 7f0f86839700 1 --2- 172.21.15.184:0/3574371328 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0f800fee30 0x7f0f800ff2a0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:09:05.539 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:09:05.500+0000 7f0f86839700 1 -- 172.21.15.184:0/3574371328 >> 172.21.15.184:0/3574371328 conn(0x7f0f800f9990 msgr2=0x7f0f800fbdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:09:05.539 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:09:05.500+0000 7f0f86839700 1 -- 172.21.15.184:0/3574371328 shutdown_connections 2023-07-14T18:09:05.539 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:09:05.500+0000 7f0f86839700 1 -- 172.21.15.184:0/3574371328 wait complete. 2023-07-14T18:09:05.540 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:09:05.500+0000 7f0f86839700 1 Processor -- start 2023-07-14T18:09:05.540 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:09:05.500+0000 7f0f86839700 1 -- start start 2023-07-14T18:09:05.540 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:09:05.501+0000 7f0f86839700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f0f800fee30 0x7f0f800fe8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:09:05.540 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:09:05.501+0000 7f0f86839700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0f800ff7e0 0x7f0f8019a690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:09:05.540 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:09:05.501+0000 7f0f86839700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0f801001d0 0x7f0f8019cce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:09:05.541 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:09:05.501+0000 7f0f86839700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f8019d480 con 0x7f0f800fee30 2023-07-14T18:09:05.541 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:09:05.501+0000 7f0f86839700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f8019d5f0 con 0x7f0f801001d0 2023-07-14T18:09:05.541 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:09:05.501+0000 7f0f86839700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f8019d7b0 con 0x7f0f800ff7e0 2023-07-14T18:09:05.541 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:09:05.501+0000 7f0f7f7fe700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0f800ff7e0 0x7f0f8019a690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:09:05.541 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:09:05.501+0000 7f0f7f7fe700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0f800ff7e0 0x7f0f8019a690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.184:54078/0 (socket says 172.21.15.184:54078) 2023-07-14T18:09:05.541 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:09:05.501+0000 7f0f7f7fe700 1 -- 172.21.15.184:0/1345334620 learned_addr learned my addr 172.21.15.184:0/1345334620 (peer_addr_for_me v2:172.21.15.184:0/0) 2023-07-14T18:09:05.541 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:09:05.501+0000 7f0f7ffff700 1 --2- 172.21.15.184:0/1345334620 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f0f800fee30 0x7f0f800fe8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:09:05.542 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:09:05.501+0000 7f0f84dd6700 1 --2- 172.21.15.184:0/1345334620 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0f801001d0 0x7f0f8019cce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:09:05.542 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:09:05.501+0000 7f0f7f7fe700 1 -- 172.21.15.184:0/1345334620 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0f801001d0 msgr2=0x7f0f8019cce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:09:05.542 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:09:05.501+0000 7f0f7f7fe700 1 --2- 172.21.15.184:0/1345334620 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0f801001d0 0x7f0f8019cce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:09:05.542 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:09:05.501+0000 7f0f7f7fe700 1 -- 172.21.15.184:0/1345334620 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f0f800fee30 msgr2=0x7f0f800fe8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:09:05.542 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:09:05.501+0000 7f0f7f7fe700 1 --2- 172.21.15.184:0/1345334620 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f0f800fee30 0x7f0f800fe8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:09:05.543 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:09:05.501+0000 7f0f7f7fe700 1 -- 172.21.15.184:0/1345334620 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f740095f0 con 0x7f0f800ff7e0 2023-07-14T18:09:05.543 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:09:05.501+0000 7f0f84dd6700 1 --2- 172.21.15.184:0/1345334620 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0f801001d0 0x7f0f8019cce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T18:09:05.543 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:09:05.501+0000 7f0f7f7fe700 1 --2- 172.21.15.184:0/1345334620 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0f800ff7e0 0x7f0f8019a690 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f0f74005910 tx=0x7f0f74004730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:09:05.543 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:09:05.501+0000 7f0f7d7fa700 1 -- 172.21.15.184:0/1345334620 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f7401d070 con 0x7f0f800ff7e0 2023-07-14T18:09:05.543 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:09:05.501+0000 7f0f86839700 1 -- 172.21.15.184:0/1345334620 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f8019da30 con 0x7f0f800ff7e0 2023-07-14T18:09:05.544 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:09:05.502+0000 7f0f7d7fa700 1 -- 172.21.15.184:0/1345334620 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f0f740054c0 con 0x7f0f800ff7e0 2023-07-14T18:09:05.544 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:09:05.502+0000 7f0f7d7fa700 1 -- 172.21.15.184:0/1345334620 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f74003ab0 con 0x7f0f800ff7e0 2023-07-14T18:09:05.544 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:09:05.502+0000 7f0f86839700 1 -- 172.21.15.184:0/1345334620 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f8019dea0 con 0x7f0f800ff7e0 2023-07-14T18:09:05.545 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:09:05.503+0000 7f0f86839700 1 -- 172.21.15.184:0/1345334620 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0f8010a290 con 0x7f0f800ff7e0 2023-07-14T18:09:05.545 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:09:05.504+0000 7f0f7d7fa700 1 -- 172.21.15.184:0/1345334620 <== mon.1 v2:172.21.15.184:3300/0 4 ==== mgrmap(e 16) v1 ==== 135716+0+0 (secure 0 0 0) 0x7f0f740047a0 con 0x7f0f800ff7e0 2023-07-14T18:09:05.545 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:09:05.504+0000 7f0f7d7fa700 1 --2- 172.21.15.184:0/1345334620 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f0f680a1150 0x7f0f680a3600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:09:05.545 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:09:05.504+0000 7f0f7d7fa700 1 -- 172.21.15.184:0/1345334620 <== mon.1 v2:172.21.15.184:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5430+0+0 (secure 0 0 0) 0x7f0f740ccda0 con 0x7f0f800ff7e0 2023-07-14T18:09:05.546 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:09:05.504+0000 7f0f7ffff700 1 --2- 172.21.15.184:0/1345334620 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f0f680a1150 0x7f0f680a3600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:09:05.546 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:09:05.505+0000 7f0f7ffff700 1 --2- 172.21.15.184:0/1345334620 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f0f680a1150 0x7f0f680a3600 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f0f80067ee0 tx=0x7f0f70007400 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:09:05.546 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:09:05.508+0000 7f0f7d7fa700 1 -- 172.21.15.184:0/1345334620 <== mon.1 v2:172.21.15.184:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178025 (secure 0 0 0) 0x7f0f7409ab50 con 0x7f0f800ff7e0 2023-07-14T18:09:05.739 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:09:05.702+0000 7f0f86839700 1 -- 172.21.15.184:0/1345334620 --> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi184:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) v1 -- 0x7f0f80060a80 con 0x7f0f680a1150 2023-07-14T18:09:06.213 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:09:05 smithi163 ceph-mon[96576]: purged_snaps scrub starts 2023-07-14T18:09:06.213 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:09:05 smithi163 ceph-mon[96576]: purged_snaps scrub ok 2023-07-14T18:09:06.213 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:09:05 smithi163 ceph-mon[96576]: osd.7 [v2:172.21.15.172:6816/233511803,v1:172.21.15.172:6817/233511803] boot 2023-07-14T18:09:06.214 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:09:05 smithi163 ceph-mon[96576]: osdmap e49: 8 total, 8 up, 8 in 2023-07-14T18:09:06.214 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:09:05 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-07-14T18:09:06.214 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:09:05 smithi163 ceph-mon[96576]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 216 MiB used, 715 GiB / 715 GiB avail 2023-07-14T18:09:06.214 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:09:05 smithi163 ceph-mon[96576]: from='client.24283 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi184:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2023-07-14T18:09:06.214 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:09:05 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-07-14T18:09:06.215 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:09:05 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-07-14T18:09:06.215 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:09:05 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T18:09:06.215 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:09:05 smithi163 ceph-mon[96576]: osdmap e50: 8 total, 8 up, 8 in 2023-07-14T18:09:06.271 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:09:05 smithi172 ceph-mon[97983]: purged_snaps scrub starts 2023-07-14T18:09:06.272 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:09:05 smithi172 ceph-mon[97983]: purged_snaps scrub ok 2023-07-14T18:09:06.272 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:09:05 smithi172 ceph-mon[97983]: osd.7 [v2:172.21.15.172:6816/233511803,v1:172.21.15.172:6817/233511803] boot 2023-07-14T18:09:06.272 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:09:05 smithi172 ceph-mon[97983]: osdmap e49: 8 total, 8 up, 8 in 2023-07-14T18:09:06.272 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:09:05 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-07-14T18:09:06.272 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:09:05 smithi172 ceph-mon[97983]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 216 MiB used, 715 GiB / 715 GiB avail 2023-07-14T18:09:06.272 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:09:05 smithi172 ceph-mon[97983]: from='client.24283 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi184:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2023-07-14T18:09:06.272 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:09:05 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-07-14T18:09:06.273 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:09:05 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-07-14T18:09:06.273 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:09:05 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T18:09:06.273 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:09:05 smithi172 ceph-mon[97983]: osdmap e50: 8 total, 8 up, 8 in 2023-07-14T18:09:06.420 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:09:05 smithi184 ceph-mon[98481]: purged_snaps scrub starts 2023-07-14T18:09:06.421 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:09:05 smithi184 ceph-mon[98481]: purged_snaps scrub ok 2023-07-14T18:09:06.421 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:09:05 smithi184 ceph-mon[98481]: osd.7 [v2:172.21.15.172:6816/233511803,v1:172.21.15.172:6817/233511803] boot 2023-07-14T18:09:06.421 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:09:05 smithi184 ceph-mon[98481]: osdmap e49: 8 total, 8 up, 8 in 2023-07-14T18:09:06.421 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:09:05 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-07-14T18:09:06.421 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:09:05 smithi184 ceph-mon[98481]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 216 MiB used, 715 GiB / 715 GiB avail 2023-07-14T18:09:06.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:09:05 smithi184 ceph-mon[98481]: from='client.24283 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi184:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2023-07-14T18:09:06.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:09:05 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-07-14T18:09:06.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:09:05 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-07-14T18:09:06.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:09:05 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T18:09:06.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:09:05 smithi184 ceph-mon[98481]: osdmap e50: 8 total, 8 up, 8 in 2023-07-14T18:09:08.021 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:09:07 smithi172 ceph-mon[97983]: osdmap e51: 8 total, 8 up, 8 in 2023-07-14T18:09:08.171 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:09:07 smithi184 ceph-mon[98481]: osdmap e51: 8 total, 8 up, 8 in 2023-07-14T18:09:08.213 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:09:07 smithi163 ceph-mon[96576]: osdmap e51: 8 total, 8 up, 8 in 2023-07-14T18:09:09.021 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:09:08 smithi172 ceph-mon[97983]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 216 MiB used, 715 GiB / 715 GiB avail 2023-07-14T18:09:09.022 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:09:08 smithi172 ceph-mon[97983]: osdmap e52: 8 total, 8 up, 8 in 2023-07-14T18:09:09.022 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:09:08 smithi172 ceph-mon[97983]: from='client.? 172.21.15.184:0/625593540' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "36559400-f33e-44e6-868a-316d34da457d"}]: dispatch 2023-07-14T18:09:09.022 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:09:08 smithi172 ceph-mon[97983]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "36559400-f33e-44e6-868a-316d34da457d"}]: dispatch 2023-07-14T18:09:09.022 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:09:08 smithi172 ceph-mon[97983]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "36559400-f33e-44e6-868a-316d34da457d"}]': finished 2023-07-14T18:09:09.022 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:09:08 smithi172 ceph-mon[97983]: osdmap e53: 9 total, 8 up, 9 in 2023-07-14T18:09:09.023 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:09:08 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-07-14T18:09:09.023 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:09:08 smithi172 ceph-mon[97983]: from='client.? 172.21.15.184:0/2701163794' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-07-14T18:09:09.170 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:09:08 smithi184 ceph-mon[98481]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 216 MiB used, 715 GiB / 715 GiB avail 2023-07-14T18:09:09.171 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:09:08 smithi184 ceph-mon[98481]: osdmap e52: 8 total, 8 up, 8 in 2023-07-14T18:09:09.171 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:09:08 smithi184 ceph-mon[98481]: from='client.? 172.21.15.184:0/625593540' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "36559400-f33e-44e6-868a-316d34da457d"}]: dispatch 2023-07-14T18:09:09.172 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:09:08 smithi184 ceph-mon[98481]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "36559400-f33e-44e6-868a-316d34da457d"}]: dispatch 2023-07-14T18:09:09.172 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:09:08 smithi184 ceph-mon[98481]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "36559400-f33e-44e6-868a-316d34da457d"}]': finished 2023-07-14T18:09:09.172 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:09:08 smithi184 ceph-mon[98481]: osdmap e53: 9 total, 8 up, 9 in 2023-07-14T18:09:09.172 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:09:08 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-07-14T18:09:09.173 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:09:08 smithi184 ceph-mon[98481]: from='client.? 172.21.15.184:0/2701163794' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-07-14T18:09:09.213 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:09:08 smithi163 ceph-mon[96576]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 216 MiB used, 715 GiB / 715 GiB avail 2023-07-14T18:09:09.213 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:09:08 smithi163 ceph-mon[96576]: osdmap e52: 8 total, 8 up, 8 in 2023-07-14T18:09:09.214 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:09:08 smithi163 ceph-mon[96576]: from='client.? 172.21.15.184:0/625593540' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "36559400-f33e-44e6-868a-316d34da457d"}]: dispatch 2023-07-14T18:09:09.214 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:09:08 smithi163 ceph-mon[96576]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "36559400-f33e-44e6-868a-316d34da457d"}]: dispatch 2023-07-14T18:09:09.214 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:09:08 smithi163 ceph-mon[96576]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "36559400-f33e-44e6-868a-316d34da457d"}]': finished 2023-07-14T18:09:09.215 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:09:08 smithi163 ceph-mon[96576]: osdmap e53: 9 total, 8 up, 9 in 2023-07-14T18:09:09.215 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:09:08 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-07-14T18:09:09.215 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:09:08 smithi163 ceph-mon[96576]: from='client.? 172.21.15.184:0/2701163794' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-07-14T18:09:11.021 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:09:10 smithi172 ceph-mon[97983]: pgmap v160: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 216 MiB used, 715 GiB / 715 GiB avail 2023-07-14T18:09:11.170 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:09:10 smithi184 ceph-mon[98481]: pgmap v160: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 216 MiB used, 715 GiB / 715 GiB avail 2023-07-14T18:09:11.213 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:09:10 smithi163 ceph-mon[96576]: pgmap v160: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 216 MiB used, 715 GiB / 715 GiB avail 2023-07-14T18:09:13.021 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:09:12 smithi172 ceph-mon[97983]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 217 MiB used, 715 GiB / 715 GiB avail 2023-07-14T18:09:13.104 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:09:12 smithi184 ceph-mon[98481]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 217 MiB used, 715 GiB / 715 GiB avail 2023-07-14T18:09:13.213 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:09:12 smithi163 ceph-mon[96576]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 217 MiB used, 715 GiB / 715 GiB avail 2023-07-14T18:09:15.112 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:09:14 smithi184 ceph-mon[98481]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 217 MiB used, 715 GiB / 715 GiB avail 2023-07-14T18:09:15.113 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:09:14 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2023-07-14T18:09:15.113 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:09:14 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T18:09:15.213 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:09:14 smithi163 ceph-mon[96576]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 217 MiB used, 715 GiB / 715 GiB avail 2023-07-14T18:09:15.214 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:09:14 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2023-07-14T18:09:15.214 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:09:14 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T18:09:15.271 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:09:14 smithi172 ceph-mon[97983]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 217 MiB used, 715 GiB / 715 GiB avail 2023-07-14T18:09:15.272 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:09:14 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2023-07-14T18:09:15.272 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:09:14 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T18:09:16.170 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:09:15 smithi184 ceph-mon[98481]: Deploying daemon osd.8 on smithi184 2023-07-14T18:09:16.213 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:09:15 smithi163 ceph-mon[96576]: Deploying daemon osd.8 on smithi184 2023-07-14T18:09:16.271 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:09:15 smithi172 ceph-mon[97983]: Deploying daemon osd.8 on smithi184 2023-07-14T18:09:16.961 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:09:16 smithi184 ceph-mon[98481]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 217 MiB used, 715 GiB / 715 GiB avail 2023-07-14T18:09:17.213 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:09:16 smithi163 ceph-mon[96576]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 217 MiB used, 715 GiB / 715 GiB avail 2023-07-14T18:09:17.271 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:09:16 smithi172 ceph-mon[97983]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 217 MiB used, 715 GiB / 715 GiB avail 2023-07-14T18:09:18.920 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:09:18 smithi184 ceph-mon[98481]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 217 MiB used, 715 GiB / 715 GiB avail 2023-07-14T18:09:19.213 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:09:18 smithi163 ceph-mon[96576]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 217 MiB used, 715 GiB / 715 GiB avail 2023-07-14T18:09:19.272 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:09:18 smithi172 ceph-mon[97983]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 217 MiB used, 715 GiB / 715 GiB avail 2023-07-14T18:09:19.898 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:09:19 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:09:19.898 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:09:19 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:09:19.898 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:09:19 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-14T18:09:19.898 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:09:19 smithi184 ceph-mon[98481]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 217 MiB used, 715 GiB / 715 GiB avail 2023-07-14T18:09:20.213 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:09:19 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:09:20.213 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:09:19 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:09:20.214 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:09:19 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-14T18:09:20.214 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:09:19 smithi163 ceph-mon[96576]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 217 MiB used, 715 GiB / 715 GiB avail 2023-07-14T18:09:20.272 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:09:19 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:09:20.272 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:09:19 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:09:20.272 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:09:19 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-14T18:09:20.272 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:09:19 smithi172 ceph-mon[97983]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 217 MiB used, 715 GiB / 715 GiB avail 2023-07-14T18:09:21.447 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:09:21.410+0000 7f0f7d7fa700 1 -- 172.21.15.184:0/1345334620 <== mgr.14152 v2:172.21.15.163:6800/1949590926 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f0f80060a80 con 0x7f0f680a1150 2023-07-14T18:09:21.447 INFO:teuthology.orchestra.run.smithi184.stdout:Created osd(s) 8 on host 'smithi184' 2023-07-14T18:09:21.449 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:09:21.412+0000 7f0f86839700 1 -- 172.21.15.184:0/1345334620 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f0f680a1150 msgr2=0x7f0f680a3600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:09:21.449 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:09:21.412+0000 7f0f86839700 1 --2- 172.21.15.184:0/1345334620 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f0f680a1150 0x7f0f680a3600 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f0f80067ee0 tx=0x7f0f70007400 comp rx=0 tx=0).stop 2023-07-14T18:09:21.449 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:09:21.412+0000 7f0f86839700 1 -- 172.21.15.184:0/1345334620 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0f800ff7e0 msgr2=0x7f0f8019a690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:09:21.449 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:09:21.412+0000 7f0f86839700 1 --2- 172.21.15.184:0/1345334620 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0f800ff7e0 0x7f0f8019a690 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f0f74005910 tx=0x7f0f74004730 comp rx=0 tx=0).stop 2023-07-14T18:09:21.449 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:09:21.412+0000 7f0f86839700 1 -- 172.21.15.184:0/1345334620 shutdown_connections 2023-07-14T18:09:21.450 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:09:21.412+0000 7f0f86839700 1 --2- 172.21.15.184:0/1345334620 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f0f680a1150 0x7f0f680a3600 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:09:21.450 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:09:21.412+0000 7f0f86839700 1 --2- 172.21.15.184:0/1345334620 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0f801001d0 0x7f0f8019cce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:09:21.450 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:09:21.412+0000 7f0f86839700 1 --2- 172.21.15.184:0/1345334620 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f0f800fee30 0x7f0f800fe8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:09:21.450 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:09:21.412+0000 7f0f86839700 1 --2- 172.21.15.184:0/1345334620 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0f800ff7e0 0x7f0f8019a690 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:09:21.450 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:09:21.412+0000 7f0f86839700 1 -- 172.21.15.184:0/1345334620 >> 172.21.15.184:0/1345334620 conn(0x7f0f800f9990 msgr2=0x7f0f800fbc80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:09:21.450 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:09:21.412+0000 7f0f86839700 1 -- 172.21.15.184:0/1345334620 shutdown_connections 2023-07-14T18:09:21.450 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:09:21.412+0000 7f0f86839700 1 -- 172.21.15.184:0/1345334620 wait complete. 2023-07-14T18:09:21.915 DEBUG:teuthology.orchestra.run.smithi184:osd.8> sudo journalctl -f -n 0 -u ceph-bf7326ec-2270-11ee-9b33-001a4aab830c@osd.8.service 2023-07-14T18:09:21.917 INFO:tasks.cephadm:Deploying osd.9 on smithi163 with /dev/vg_nvme/lv_1... 2023-07-14T18:09:21.917 DEBUG:teuthology.orchestra.run.smithi163:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81c9387d2e7576da065747ec9c16d1c7d69016ec shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bf7326ec-2270-11ee-9b33-001a4aab830c -- ceph-volume lvm zap /dev/vg_nvme/lv_1 2023-07-14T18:09:21.946 INFO:journalctl@ceph.osd.8.smithi184.stdout:-- Logs begin at Fri 2023-07-14 17:45:39 UTC. -- 2023-07-14T18:09:22.213 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:09:22 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:09:22.214 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:09:22 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:09:22.214 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:09:22 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T18:09:22.214 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:09:22 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-14T18:09:22.214 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:09:22 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:09:22.214 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:09:22 smithi163 ceph-mon[96576]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 217 MiB used, 715 GiB / 715 GiB avail 2023-07-14T18:09:22.215 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:09:22 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:09:22.215 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:09:22 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:09:22.215 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:09:22 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-14T18:09:22.377 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:09:22 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:09:22.377 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:09:22 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:09:22.377 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:09:22 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T18:09:22.378 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:09:22 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-14T18:09:22.378 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:09:22 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:09:22.378 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:09:22 smithi184 ceph-mon[98481]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 217 MiB used, 715 GiB / 715 GiB avail 2023-07-14T18:09:22.378 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:09:22 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:09:22.378 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:09:22 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:09:22.378 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:09:22 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-14T18:09:22.485 INFO:teuthology.orchestra.run.smithi163.stderr:Inferring config /var/lib/ceph/bf7326ec-2270-11ee-9b33-001a4aab830c/mon.a/config 2023-07-14T18:09:22.522 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:09:22 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:09:22.522 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:09:22 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:09:22.522 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:09:22 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T18:09:22.522 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:09:22 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-14T18:09:22.522 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:09:22 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:09:22.523 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:09:22 smithi172 ceph-mon[97983]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 217 MiB used, 715 GiB / 715 GiB avail 2023-07-14T18:09:22.523 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:09:22 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:09:22.523 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:09:22 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:09:22.523 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:09:22 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-14T18:09:22.921 INFO:journalctl@ceph.osd.8.smithi184.stdout:Jul 14 18:09:22 smithi184 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-8[115280]: 2023-07-14T18:09:22.793+0000 7fa8a79c8640 -1 osd.8 0 log_to_monitors true 2023-07-14T18:09:23.256 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:09:23 smithi163 ceph-mon[96576]: from='osd.8 [v2:172.21.15.184:6816/290154343,v1:172.21.15.184:6817/290154343]' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2023-07-14T18:09:23.256 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:09:23 smithi163 ceph-mon[96576]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2023-07-14T18:09:23.421 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:09:23 smithi184 ceph-mon[98481]: from='osd.8 [v2:172.21.15.184:6816/290154343,v1:172.21.15.184:6817/290154343]' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2023-07-14T18:09:23.421 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:09:23 smithi184 ceph-mon[98481]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2023-07-14T18:09:23.522 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:09:23 smithi172 ceph-mon[97983]: from='osd.8 [v2:172.21.15.184:6816/290154343,v1:172.21.15.184:6817/290154343]' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2023-07-14T18:09:23.522 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:09:23 smithi172 ceph-mon[97983]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2023-07-14T18:09:23.993 INFO:teuthology.orchestra.run.smithi163.stderr:--> Zapping: /dev/vg_nvme/lv_1 2023-07-14T18:09:23.994 INFO:teuthology.orchestra.run.smithi163.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_1 bs=1M count=10 conv=fsync 2023-07-14T18:09:23.994 INFO:teuthology.orchestra.run.smithi163.stderr: stderr: 10+0 records in 2023-07-14T18:09:23.994 INFO:teuthology.orchestra.run.smithi163.stderr:10+0 records out 2023-07-14T18:09:23.994 INFO:teuthology.orchestra.run.smithi163.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0153196 s, 684 MB/s 2023-07-14T18:09:23.994 INFO:teuthology.orchestra.run.smithi163.stderr:--> Zapping successful for: 2023-07-14T18:09:24.377 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:09:24 smithi163 ceph-mon[96576]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2023-07-14T18:09:24.378 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:09:24 smithi163 ceph-mon[96576]: osdmap e54: 9 total, 8 up, 9 in 2023-07-14T18:09:24.378 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:09:24 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-07-14T18:09:24.378 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:09:24 smithi163 ceph-mon[96576]: from='osd.8 [v2:172.21.15.184:6816/290154343,v1:172.21.15.184:6817/290154343]' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi184", "root=default"]}]: dispatch 2023-07-14T18:09:24.378 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:09:24 smithi163 ceph-mon[96576]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi184", "root=default"]}]: dispatch 2023-07-14T18:09:24.378 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:09:24 smithi163 ceph-mon[96576]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 217 MiB used, 715 GiB / 715 GiB avail 2023-07-14T18:09:24.379 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:09:24 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:09:24.379 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:09:24 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:09:24.379 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:09:24 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-07-14T18:09:24.379 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:09:24 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-07-14T18:09:24.379 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:09:24 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-07-14T18:09:24.379 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:09:24 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:09:24.379 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:09:24 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T18:09:24.379 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:09:24 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-14T18:09:24.380 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:09:24 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:09:24.421 INFO:journalctl@ceph.osd.8.smithi184.stdout:Jul 14 18:09:24 smithi184 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-8[115280]: 2023-07-14T18:09:24.116+0000 7fa89d040700 -1 osd.8 0 waiting for initial osdmap 2023-07-14T18:09:24.421 INFO:journalctl@ceph.osd.8.smithi184.stdout:Jul 14 18:09:24 smithi184 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-8[115280]: 2023-07-14T18:09:24.125+0000 7fa896631700 -1 osd.8 55 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-07-14T18:09:24.421 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:09:24 smithi184 ceph-mon[98481]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2023-07-14T18:09:24.421 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:09:24 smithi184 ceph-mon[98481]: osdmap e54: 9 total, 8 up, 9 in 2023-07-14T18:09:24.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:09:24 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-07-14T18:09:24.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:09:24 smithi184 ceph-mon[98481]: from='osd.8 [v2:172.21.15.184:6816/290154343,v1:172.21.15.184:6817/290154343]' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi184", "root=default"]}]: dispatch 2023-07-14T18:09:24.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:09:24 smithi184 ceph-mon[98481]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi184", "root=default"]}]: dispatch 2023-07-14T18:09:24.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:09:24 smithi184 ceph-mon[98481]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 217 MiB used, 715 GiB / 715 GiB avail 2023-07-14T18:09:24.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:09:24 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:09:24.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:09:24 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:09:24.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:09:24 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-07-14T18:09:24.423 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:09:24 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-07-14T18:09:24.423 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:09:24 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-07-14T18:09:24.423 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:09:24 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:09:24.423 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:09:24 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T18:09:24.423 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:09:24 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-14T18:09:24.423 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:09:24 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:09:24.443 DEBUG:teuthology.orchestra.run.smithi163:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81c9387d2e7576da065747ec9c16d1c7d69016ec shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bf7326ec-2270-11ee-9b33-001a4aab830c -- ceph orch daemon add osd smithi163:vg_nvme/lv_1 2023-07-14T18:09:24.522 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:09:24 smithi172 ceph-mon[97983]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2023-07-14T18:09:24.522 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:09:24 smithi172 ceph-mon[97983]: osdmap e54: 9 total, 8 up, 9 in 2023-07-14T18:09:24.522 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:09:24 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-07-14T18:09:24.522 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:09:24 smithi172 ceph-mon[97983]: from='osd.8 [v2:172.21.15.184:6816/290154343,v1:172.21.15.184:6817/290154343]' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi184", "root=default"]}]: dispatch 2023-07-14T18:09:24.522 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:09:24 smithi172 ceph-mon[97983]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi184", "root=default"]}]: dispatch 2023-07-14T18:09:24.523 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:09:24 smithi172 ceph-mon[97983]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 217 MiB used, 715 GiB / 715 GiB avail 2023-07-14T18:09:24.523 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:09:24 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:09:24.523 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:09:24 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:09:24.523 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:09:24 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-07-14T18:09:24.523 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:09:24 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-07-14T18:09:24.523 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:09:24 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-07-14T18:09:24.523 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:09:24 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:09:24.524 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:09:24 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T18:09:24.524 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:09:24 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-14T18:09:24.524 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:09:24 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:09:24.996 INFO:teuthology.orchestra.run.smithi163.stderr:Inferring config /var/lib/ceph/bf7326ec-2270-11ee-9b33-001a4aab830c/mon.a/config 2023-07-14T18:09:25.421 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:09:25 smithi184 ceph-mon[98481]: Detected new or changed devices on smithi184 2023-07-14T18:09:25.421 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:09:25 smithi184 ceph-mon[98481]: Adjusting osd_memory_target on smithi184 to 5722M 2023-07-14T18:09:25.421 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:09:25 smithi184 ceph-mon[98481]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi184", "root=default"]}]': finished 2023-07-14T18:09:25.421 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:09:25 smithi184 ceph-mon[98481]: osdmap e55: 9 total, 8 up, 9 in 2023-07-14T18:09:25.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:09:25 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-07-14T18:09:25.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:09:25 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-07-14T18:09:25.464 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:09:25 smithi163 ceph-mon[96576]: Detected new or changed devices on smithi184 2023-07-14T18:09:25.464 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:09:25 smithi163 ceph-mon[96576]: Adjusting osd_memory_target on smithi184 to 5722M 2023-07-14T18:09:25.464 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:09:25 smithi163 ceph-mon[96576]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi184", "root=default"]}]': finished 2023-07-14T18:09:25.464 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:09:25 smithi163 ceph-mon[96576]: osdmap e55: 9 total, 8 up, 9 in 2023-07-14T18:09:25.464 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:09:25 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-07-14T18:09:25.465 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:09:25 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-07-14T18:09:25.522 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:09:25 smithi172 ceph-mon[97983]: Detected new or changed devices on smithi184 2023-07-14T18:09:25.522 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:09:25 smithi172 ceph-mon[97983]: Adjusting osd_memory_target on smithi184 to 5722M 2023-07-14T18:09:25.522 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:09:25 smithi172 ceph-mon[97983]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi184", "root=default"]}]': finished 2023-07-14T18:09:25.522 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:09:25 smithi172 ceph-mon[97983]: osdmap e55: 9 total, 8 up, 9 in 2023-07-14T18:09:25.522 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:09:25 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-07-14T18:09:25.523 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:09:25 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-07-14T18:09:26.221 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:09:26.184+0000 7ff3f88ce700 1 -- 172.21.15.163:0/4265322190 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff3f4101850 msgr2=0x7ff3f4108110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:09:26.222 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:09:26.184+0000 7ff3f88ce700 1 --2- 172.21.15.163:0/4265322190 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff3f4101850 0x7ff3f4108110 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7ff3ec00b0a0 tx=0x7ff3ec00b3b0 comp rx=0 tx=0).stop 2023-07-14T18:09:26.222 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:09:26.184+0000 7ff3f88ce700 1 -- 172.21.15.163:0/4265322190 shutdown_connections 2023-07-14T18:09:26.222 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:09:26.184+0000 7ff3f88ce700 1 --2- 172.21.15.163:0/4265322190 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff3f4101850 0x7ff3f4108110 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:09:26.222 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:09:26.184+0000 7ff3f88ce700 1 --2- 172.21.15.163:0/4265322190 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff3f40ffcc0 0x7ff3f41000d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:09:26.222 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:09:26.184+0000 7ff3f88ce700 1 --2- 172.21.15.163:0/4265322190 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff3f4100ec0 0x7ff3f4101310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:09:26.222 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:09:26.184+0000 7ff3f88ce700 1 -- 172.21.15.163:0/4265322190 >> 172.21.15.163:0/4265322190 conn(0x7ff3f40fb2d0 msgr2=0x7ff3f40fd740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:09:26.222 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:09:26.184+0000 7ff3f88ce700 1 -- 172.21.15.163:0/4265322190 shutdown_connections 2023-07-14T18:09:26.223 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:09:26.184+0000 7ff3f88ce700 1 -- 172.21.15.163:0/4265322190 wait complete. 2023-07-14T18:09:26.224 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:09:26.185+0000 7ff3f88ce700 1 Processor -- start 2023-07-14T18:09:26.225 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:09:26.185+0000 7ff3f88ce700 1 -- start start 2023-07-14T18:09:26.225 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:09:26.185+0000 7ff3f88ce700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff3f40ffcc0 0x7ff3f4195960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:09:26.225 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:09:26.185+0000 7ff3f88ce700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff3f4100ec0 0x7ff3f4195ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:09:26.225 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:09:26.185+0000 7ff3f88ce700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff3f4101850 0x7ff3f419cf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:09:26.225 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:09:26.185+0000 7ff3f88ce700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3f419d4f0 con 0x7ff3f4100ec0 2023-07-14T18:09:26.225 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:09:26.185+0000 7ff3f88ce700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3f419d630 con 0x7ff3f40ffcc0 2023-07-14T18:09:26.226 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:09:26.185+0000 7ff3f88ce700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3f419d7c0 con 0x7ff3f4101850 2023-07-14T18:09:26.226 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:09:26.185+0000 7ff3f1d9b700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff3f4100ec0 0x7ff3f4195ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:09:26.226 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:09:26.185+0000 7ff3f1d9b700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff3f4100ec0 0x7ff3f4195ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:55184/0 (socket says 172.21.15.163:55184) 2023-07-14T18:09:26.226 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:09:26.185+0000 7ff3f1d9b700 1 -- 172.21.15.163:0/1820239338 learned_addr learned my addr 172.21.15.163:0/1820239338 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:09:26.226 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:09:26.185+0000 7ff3f259c700 1 --2- 172.21.15.163:0/1820239338 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff3f40ffcc0 0x7ff3f4195960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:09:26.226 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:09:26.185+0000 7ff3f2d9d700 1 --2- 172.21.15.163:0/1820239338 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff3f4101850 0x7ff3f419cf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:09:26.226 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:09:26.185+0000 7ff3f1d9b700 1 -- 172.21.15.163:0/1820239338 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff3f4101850 msgr2=0x7ff3f419cf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:09:26.227 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:09:26.185+0000 7ff3f1d9b700 1 --2- 172.21.15.163:0/1820239338 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff3f4101850 0x7ff3f419cf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:09:26.227 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:09:26.185+0000 7ff3f1d9b700 1 -- 172.21.15.163:0/1820239338 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff3f40ffcc0 msgr2=0x7ff3f4195960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:09:26.227 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:09:26.185+0000 7ff3f1d9b700 1 --2- 172.21.15.163:0/1820239338 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff3f40ffcc0 0x7ff3f4195960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:09:26.227 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:09:26.185+0000 7ff3f1d9b700 1 -- 172.21.15.163:0/1820239338 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3ec009d00 con 0x7ff3f4100ec0 2023-07-14T18:09:26.227 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:09:26.186+0000 7ff3f1d9b700 1 --2- 172.21.15.163:0/1820239338 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff3f4100ec0 0x7ff3f4195ea0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7ff3e800d980 tx=0x7ff3e800dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:09:26.227 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:09:26.186+0000 7ff3e37fe700 1 -- 172.21.15.163:0/1820239338 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3e80098d0 con 0x7ff3f4100ec0 2023-07-14T18:09:26.228 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:09:26.186+0000 7ff3f88ce700 1 -- 172.21.15.163:0/1820239338 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff3f419daa0 con 0x7ff3f4100ec0 2023-07-14T18:09:26.228 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:09:26.186+0000 7ff3e37fe700 1 -- 172.21.15.163:0/1820239338 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ff3e8010460 con 0x7ff3f4100ec0 2023-07-14T18:09:26.228 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:09:26.186+0000 7ff3e37fe700 1 -- 172.21.15.163:0/1820239338 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3e800f620 con 0x7ff3f4100ec0 2023-07-14T18:09:26.228 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:09:26.186+0000 7ff3f88ce700 1 -- 172.21.15.163:0/1820239338 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff3f419dff0 con 0x7ff3f4100ec0 2023-07-14T18:09:26.228 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:09:26.187+0000 7ff3f88ce700 1 -- 172.21.15.163:0/1820239338 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff3f4107230 con 0x7ff3f4100ec0 2023-07-14T18:09:26.229 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:09:26.189+0000 7ff3e37fe700 1 -- 172.21.15.163:0/1820239338 <== mon.0 v2:172.21.15.163:3300/0 4 ==== mgrmap(e 16) v1 ==== 135716+0+0 (secure 0 0 0) 0x7ff3e8009a30 con 0x7ff3f4100ec0 2023-07-14T18:09:26.229 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:09:26.189+0000 7ff3e37fe700 1 --2- 172.21.15.163:0/1820239338 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7ff3dc0a1150 0x7ff3dc0a3600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:09:26.229 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:09:26.189+0000 7ff3f259c700 1 --2- 172.21.15.163:0/1820239338 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7ff3dc0a1150 0x7ff3dc0a3600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:09:26.229 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:09:26.189+0000 7ff3e37fe700 1 -- 172.21.15.163:0/1820239338 <== mon.0 v2:172.21.15.163:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 5858+0+0 (secure 0 0 0) 0x7ff3e80cc150 con 0x7ff3f4100ec0 2023-07-14T18:09:26.230 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:09:26.190+0000 7ff3f259c700 1 --2- 172.21.15.163:0/1820239338 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7ff3dc0a1150 0x7ff3dc0a3600 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7ff3f4100d20 tx=0x7ff3e400a3b0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:09:26.230 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:09:26.193+0000 7ff3e37fe700 1 -- 172.21.15.163:0/1820239338 <== mon.0 v2:172.21.15.163:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178025 (secure 0 0 0) 0x7ff3e8096190 con 0x7ff3f4100ec0 2023-07-14T18:09:26.421 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:09:26 smithi184 ceph-mon[98481]: purged_snaps scrub starts 2023-07-14T18:09:26.421 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:09:26 smithi184 ceph-mon[98481]: purged_snaps scrub ok 2023-07-14T18:09:26.421 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:09:26 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-07-14T18:09:26.421 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:09:26 smithi184 ceph-mon[98481]: osd.8 [v2:172.21.15.184:6816/290154343,v1:172.21.15.184:6817/290154343] boot 2023-07-14T18:09:26.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:09:26 smithi184 ceph-mon[98481]: osdmap e56: 9 total, 9 up, 9 in 2023-07-14T18:09:26.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:09:26 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-07-14T18:09:26.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:09:26 smithi184 ceph-mon[98481]: pgmap v171: 1 pgs: 1 peering; 577 KiB data, 217 MiB used, 715 GiB / 715 GiB avail 2023-07-14T18:09:26.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:09:26 smithi184 ceph-mon[98481]: osdmap e57: 9 total, 9 up, 9 in 2023-07-14T18:09:26.424 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:09:26.387+0000 7ff3f88ce700 1 -- 172.21.15.163:0/1820239338 --> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi163:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) v1 -- 0x7ff3f4060a80 con 0x7ff3dc0a1150 2023-07-14T18:09:26.463 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:09:26 smithi163 ceph-mon[96576]: purged_snaps scrub starts 2023-07-14T18:09:26.463 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:09:26 smithi163 ceph-mon[96576]: purged_snaps scrub ok 2023-07-14T18:09:26.464 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:09:26 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-07-14T18:09:26.464 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:09:26 smithi163 ceph-mon[96576]: osd.8 [v2:172.21.15.184:6816/290154343,v1:172.21.15.184:6817/290154343] boot 2023-07-14T18:09:26.464 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:09:26 smithi163 ceph-mon[96576]: osdmap e56: 9 total, 9 up, 9 in 2023-07-14T18:09:26.464 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:09:26 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-07-14T18:09:26.464 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:09:26 smithi163 ceph-mon[96576]: pgmap v171: 1 pgs: 1 peering; 577 KiB data, 217 MiB used, 715 GiB / 715 GiB avail 2023-07-14T18:09:26.464 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:09:26 smithi163 ceph-mon[96576]: osdmap e57: 9 total, 9 up, 9 in 2023-07-14T18:09:26.522 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:09:26 smithi172 ceph-mon[97983]: purged_snaps scrub starts 2023-07-14T18:09:26.522 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:09:26 smithi172 ceph-mon[97983]: purged_snaps scrub ok 2023-07-14T18:09:26.523 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:09:26 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-07-14T18:09:26.523 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:09:26 smithi172 ceph-mon[97983]: osd.8 [v2:172.21.15.184:6816/290154343,v1:172.21.15.184:6817/290154343] boot 2023-07-14T18:09:26.523 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:09:26 smithi172 ceph-mon[97983]: osdmap e56: 9 total, 9 up, 9 in 2023-07-14T18:09:26.523 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:09:26 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-07-14T18:09:26.523 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:09:26 smithi172 ceph-mon[97983]: pgmap v171: 1 pgs: 1 peering; 577 KiB data, 217 MiB used, 715 GiB / 715 GiB avail 2023-07-14T18:09:26.523 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:09:26 smithi172 ceph-mon[97983]: osdmap e57: 9 total, 9 up, 9 in 2023-07-14T18:09:27.421 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:09:27 smithi184 ceph-mon[98481]: from='client.14433 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi163:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2023-07-14T18:09:27.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:09:27 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-07-14T18:09:27.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:09:27 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-07-14T18:09:27.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:09:27 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T18:09:27.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:09:27 smithi184 ceph-mon[98481]: osdmap e58: 9 total, 9 up, 9 in 2023-07-14T18:09:27.463 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:09:27 smithi163 ceph-mon[96576]: from='client.14433 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi163:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2023-07-14T18:09:27.464 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:09:27 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-07-14T18:09:27.464 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:09:27 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-07-14T18:09:27.464 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:09:27 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T18:09:27.464 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:09:27 smithi163 ceph-mon[96576]: osdmap e58: 9 total, 9 up, 9 in 2023-07-14T18:09:27.522 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:09:27 smithi172 ceph-mon[97983]: from='client.14433 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi163:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2023-07-14T18:09:27.522 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:09:27 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-07-14T18:09:27.522 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:09:27 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-07-14T18:09:27.522 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:09:27 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T18:09:27.523 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:09:27 smithi172 ceph-mon[97983]: osdmap e58: 9 total, 9 up, 9 in 2023-07-14T18:09:28.421 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:09:28 smithi184 ceph-mon[98481]: pgmap v174: 1 pgs: 1 peering; 577 KiB data, 244 MiB used, 804 GiB / 805 GiB avail 2023-07-14T18:09:28.463 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:09:28 smithi163 ceph-mon[96576]: pgmap v174: 1 pgs: 1 peering; 577 KiB data, 244 MiB used, 804 GiB / 805 GiB avail 2023-07-14T18:09:28.522 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:09:28 smithi172 ceph-mon[97983]: pgmap v174: 1 pgs: 1 peering; 577 KiB data, 244 MiB used, 804 GiB / 805 GiB avail 2023-07-14T18:09:29.421 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:09:29 smithi184 ceph-mon[98481]: osdmap e59: 9 total, 9 up, 9 in 2023-07-14T18:09:29.421 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:09:29 smithi184 ceph-mon[98481]: from='client.? 172.21.15.163:0/3660263300' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d484f111-f36c-4c67-9a8a-ae03e7e0d137"}]: dispatch 2023-07-14T18:09:29.421 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:09:29 smithi184 ceph-mon[98481]: from='client.? 172.21.15.163:0/3660263300' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "d484f111-f36c-4c67-9a8a-ae03e7e0d137"}]': finished 2023-07-14T18:09:29.421 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:09:29 smithi184 ceph-mon[98481]: osdmap e60: 10 total, 9 up, 10 in 2023-07-14T18:09:29.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:09:29 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-07-14T18:09:29.463 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:09:29 smithi163 ceph-mon[96576]: osdmap e59: 9 total, 9 up, 9 in 2023-07-14T18:09:29.464 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:09:29 smithi163 ceph-mon[96576]: from='client.? 172.21.15.163:0/3660263300' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d484f111-f36c-4c67-9a8a-ae03e7e0d137"}]: dispatch 2023-07-14T18:09:29.464 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:09:29 smithi163 ceph-mon[96576]: from='client.? 172.21.15.163:0/3660263300' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "d484f111-f36c-4c67-9a8a-ae03e7e0d137"}]': finished 2023-07-14T18:09:29.464 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:09:29 smithi163 ceph-mon[96576]: osdmap e60: 10 total, 9 up, 10 in 2023-07-14T18:09:29.464 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:09:29 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-07-14T18:09:29.522 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:09:29 smithi172 ceph-mon[97983]: osdmap e59: 9 total, 9 up, 9 in 2023-07-14T18:09:29.522 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:09:29 smithi172 ceph-mon[97983]: from='client.? 172.21.15.163:0/3660263300' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d484f111-f36c-4c67-9a8a-ae03e7e0d137"}]: dispatch 2023-07-14T18:09:29.523 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:09:29 smithi172 ceph-mon[97983]: from='client.? 172.21.15.163:0/3660263300' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "d484f111-f36c-4c67-9a8a-ae03e7e0d137"}]': finished 2023-07-14T18:09:29.523 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:09:29 smithi172 ceph-mon[97983]: osdmap e60: 10 total, 9 up, 10 in 2023-07-14T18:09:29.523 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:09:29 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-07-14T18:09:30.464 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:09:30 smithi163 ceph-mon[96576]: pgmap v177: 1 pgs: 1 peering; 577 KiB data, 244 MiB used, 804 GiB / 805 GiB avail 2023-07-14T18:09:30.464 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:09:30 smithi163 ceph-mon[96576]: from='client.? 172.21.15.163:0/901471864' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-07-14T18:09:30.522 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:09:30 smithi172 ceph-mon[97983]: pgmap v177: 1 pgs: 1 peering; 577 KiB data, 244 MiB used, 804 GiB / 805 GiB avail 2023-07-14T18:09:30.522 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:09:30 smithi172 ceph-mon[97983]: from='client.? 172.21.15.163:0/901471864' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-07-14T18:09:30.671 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:09:30 smithi184 ceph-mon[98481]: pgmap v177: 1 pgs: 1 peering; 577 KiB data, 244 MiB used, 804 GiB / 805 GiB avail 2023-07-14T18:09:30.671 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:09:30 smithi184 ceph-mon[98481]: from='client.? 172.21.15.163:0/901471864' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-07-14T18:09:32.912 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:09:32 smithi163 ceph-mon[96576]: pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 244 MiB used, 804 GiB / 805 GiB avail; 102 KiB/s, 0 objects/s recovering 2023-07-14T18:09:33.022 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:09:32 smithi172 ceph-mon[97983]: pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 244 MiB used, 804 GiB / 805 GiB avail; 102 KiB/s, 0 objects/s recovering 2023-07-14T18:09:33.171 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:09:32 smithi184 ceph-mon[98481]: pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 244 MiB used, 804 GiB / 805 GiB avail; 102 KiB/s, 0 objects/s recovering 2023-07-14T18:09:34.964 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:09:34 smithi163 ceph-mon[96576]: pgmap v179: 1 pgs: 1 active+clean; 577 KiB data, 244 MiB used, 804 GiB / 805 GiB avail; 87 KiB/s, 0 objects/s recovering 2023-07-14T18:09:35.022 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:09:34 smithi172 ceph-mon[97983]: pgmap v179: 1 pgs: 1 active+clean; 577 KiB data, 244 MiB used, 804 GiB / 805 GiB avail; 87 KiB/s, 0 objects/s recovering 2023-07-14T18:09:35.171 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:09:34 smithi184 ceph-mon[98481]: pgmap v179: 1 pgs: 1 active+clean; 577 KiB data, 244 MiB used, 804 GiB / 805 GiB avail; 87 KiB/s, 0 objects/s recovering 2023-07-14T18:09:36.023 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:09:35 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2023-07-14T18:09:36.023 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:09:35 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T18:09:36.171 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:09:35 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2023-07-14T18:09:36.171 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:09:35 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T18:09:36.272 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:09:35 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2023-07-14T18:09:36.272 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:09:35 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T18:09:36.934 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:09:36 smithi163 ceph-mon[96576]: Deploying daemon osd.9 on smithi163 2023-07-14T18:09:36.934 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:09:36 smithi163 ceph-mon[96576]: pgmap v180: 1 pgs: 1 active+clean; 577 KiB data, 244 MiB used, 804 GiB / 805 GiB avail; 72 KiB/s, 0 objects/s recovering 2023-07-14T18:09:37.171 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:09:36 smithi184 ceph-mon[98481]: Deploying daemon osd.9 on smithi163 2023-07-14T18:09:37.172 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:09:36 smithi184 ceph-mon[98481]: pgmap v180: 1 pgs: 1 active+clean; 577 KiB data, 244 MiB used, 804 GiB / 805 GiB avail; 72 KiB/s, 0 objects/s recovering 2023-07-14T18:09:37.272 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:09:36 smithi172 ceph-mon[97983]: Deploying daemon osd.9 on smithi163 2023-07-14T18:09:37.272 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:09:36 smithi172 ceph-mon[97983]: pgmap v180: 1 pgs: 1 active+clean; 577 KiB data, 244 MiB used, 804 GiB / 805 GiB avail; 72 KiB/s, 0 objects/s recovering 2023-07-14T18:09:39.136 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:09:38 smithi163 ceph-mon[96576]: pgmap v181: 1 pgs: 1 active+clean; 577 KiB data, 244 MiB used, 804 GiB / 805 GiB avail; 62 KiB/s, 0 objects/s recovering 2023-07-14T18:09:39.171 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:09:38 smithi184 ceph-mon[98481]: pgmap v181: 1 pgs: 1 active+clean; 577 KiB data, 244 MiB used, 804 GiB / 805 GiB avail; 62 KiB/s, 0 objects/s recovering 2023-07-14T18:09:39.272 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:09:38 smithi172 ceph-mon[97983]: pgmap v181: 1 pgs: 1 active+clean; 577 KiB data, 244 MiB used, 804 GiB / 805 GiB avail; 62 KiB/s, 0 objects/s recovering 2023-07-14T18:09:40.964 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:09:40 smithi163 ceph-mon[96576]: pgmap v182: 1 pgs: 1 active+clean; 577 KiB data, 244 MiB used, 804 GiB / 805 GiB avail; 55 KiB/s, 0 objects/s recovering 2023-07-14T18:09:40.964 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:09:40 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:09:40.964 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:09:40 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:09:40.964 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:09:40 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-14T18:09:41.171 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:09:40 smithi184 ceph-mon[98481]: pgmap v182: 1 pgs: 1 active+clean; 577 KiB data, 244 MiB used, 804 GiB / 805 GiB avail; 55 KiB/s, 0 objects/s recovering 2023-07-14T18:09:41.171 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:09:40 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:09:41.172 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:09:40 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:09:41.172 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:09:40 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-14T18:09:41.272 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:09:40 smithi172 ceph-mon[97983]: pgmap v182: 1 pgs: 1 active+clean; 577 KiB data, 244 MiB used, 804 GiB / 805 GiB avail; 55 KiB/s, 0 objects/s recovering 2023-07-14T18:09:41.272 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:09:40 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:09:41.273 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:09:40 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:09:41.273 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:09:40 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-14T18:09:42.778 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:09:42.740+0000 7ff3e37fe700 1 -- 172.21.15.163:0/1820239338 <== mgr.14152 v2:172.21.15.163:6800/1949590926 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7ff3f4060a80 con 0x7ff3dc0a1150 2023-07-14T18:09:42.779 INFO:teuthology.orchestra.run.smithi163.stdout:Created osd(s) 9 on host 'smithi163' 2023-07-14T18:09:42.781 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:09:42.743+0000 7ff3f88ce700 1 -- 172.21.15.163:0/1820239338 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7ff3dc0a1150 msgr2=0x7ff3dc0a3600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:09:42.781 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:09:42.743+0000 7ff3f88ce700 1 --2- 172.21.15.163:0/1820239338 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7ff3dc0a1150 0x7ff3dc0a3600 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7ff3f4100d20 tx=0x7ff3e400a3b0 comp rx=0 tx=0).stop 2023-07-14T18:09:42.781 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:09:42.743+0000 7ff3f88ce700 1 -- 172.21.15.163:0/1820239338 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff3f4100ec0 msgr2=0x7ff3f4195ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:09:42.781 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:09:42.743+0000 7ff3f88ce700 1 --2- 172.21.15.163:0/1820239338 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff3f4100ec0 0x7ff3f4195ea0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7ff3e800d980 tx=0x7ff3e800dc90 comp rx=0 tx=0).stop 2023-07-14T18:09:42.782 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:09:42.743+0000 7ff3f88ce700 1 -- 172.21.15.163:0/1820239338 shutdown_connections 2023-07-14T18:09:42.782 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:09:42.743+0000 7ff3f88ce700 1 --2- 172.21.15.163:0/1820239338 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7ff3dc0a1150 0x7ff3dc0a3600 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:09:42.782 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:09:42.743+0000 7ff3f88ce700 1 --2- 172.21.15.163:0/1820239338 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff3f4101850 0x7ff3f419cf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:09:42.782 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:09:42.743+0000 7ff3f88ce700 1 --2- 172.21.15.163:0/1820239338 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff3f40ffcc0 0x7ff3f4195960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:09:42.782 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:09:42.743+0000 7ff3f88ce700 1 --2- 172.21.15.163:0/1820239338 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff3f4100ec0 0x7ff3f4195ea0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:09:42.782 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:09:42.743+0000 7ff3f88ce700 1 -- 172.21.15.163:0/1820239338 >> 172.21.15.163:0/1820239338 conn(0x7ff3f40fb2d0 msgr2=0x7ff3f4104370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:09:42.782 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:09:42.743+0000 7ff3f88ce700 1 -- 172.21.15.163:0/1820239338 shutdown_connections 2023-07-14T18:09:42.783 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:09:42.743+0000 7ff3f88ce700 1 -- 172.21.15.163:0/1820239338 wait complete. 2023-07-14T18:09:42.964 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:09:42 smithi163 ceph-mon[96576]: pgmap v183: 1 pgs: 1 active+clean; 577 KiB data, 244 MiB used, 804 GiB / 805 GiB avail; 48 KiB/s, 0 objects/s recovering 2023-07-14T18:09:42.964 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:09:42 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:09:42.964 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:09:42 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:09:42.964 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:09:42 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:09:42.964 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:09:42 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:09:43.171 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:09:42 smithi184 ceph-mon[98481]: pgmap v183: 1 pgs: 1 active+clean; 577 KiB data, 244 MiB used, 804 GiB / 805 GiB avail; 48 KiB/s, 0 objects/s recovering 2023-07-14T18:09:43.171 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:09:42 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:09:43.172 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:09:42 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:09:43.172 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:09:42 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:09:43.172 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:09:42 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:09:43.203 DEBUG:teuthology.orchestra.run.smithi163:osd.9> sudo journalctl -f -n 0 -u ceph-bf7326ec-2270-11ee-9b33-001a4aab830c@osd.9.service 2023-07-14T18:09:43.205 INFO:tasks.cephadm:Deploying osd.10 on smithi172 with /dev/vg_nvme/lv_1... 2023-07-14T18:09:43.205 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81c9387d2e7576da065747ec9c16d1c7d69016ec shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bf7326ec-2270-11ee-9b33-001a4aab830c -- ceph-volume lvm zap /dev/vg_nvme/lv_1 2023-07-14T18:09:43.236 INFO:journalctl@ceph.osd.9.smithi163.stdout:-- Logs begin at Fri 2023-07-14 17:46:25 UTC. -- 2023-07-14T18:09:43.237 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:09:42 smithi172 ceph-mon[97983]: pgmap v183: 1 pgs: 1 active+clean; 577 KiB data, 244 MiB used, 804 GiB / 805 GiB avail; 48 KiB/s, 0 objects/s recovering 2023-07-14T18:09:43.238 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:09:42 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:09:43.238 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:09:42 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:09:43.238 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:09:42 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:09:43.238 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:09:42 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:09:43.772 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/bf7326ec-2270-11ee-9b33-001a4aab830c/mon.b/config 2023-07-14T18:09:43.964 INFO:journalctl@ceph.osd.9.smithi163.stdout:Jul 14 18:09:43 smithi163 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-9[125814]: 2023-07-14T18:09:43.869+0000 7fd086589640 -1 osd.9 0 log_to_monitors true 2023-07-14T18:09:45.022 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:09:44 smithi172 ceph-mon[97983]: pgmap v184: 1 pgs: 1 active+clean; 577 KiB data, 244 MiB used, 804 GiB / 805 GiB avail 2023-07-14T18:09:45.023 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:09:44 smithi172 ceph-mon[97983]: from='osd.9 [v2:172.21.15.163:6826/3848110906,v1:172.21.15.163:6827/3848110906]' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2023-07-14T18:09:45.023 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:09:44 smithi172 ceph-mon[97983]: from='osd.9 ' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2023-07-14T18:09:45.089 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:09:44 smithi163 ceph-mon[96576]: pgmap v184: 1 pgs: 1 active+clean; 577 KiB data, 244 MiB used, 804 GiB / 805 GiB avail 2023-07-14T18:09:45.090 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:09:44 smithi163 ceph-mon[96576]: from='osd.9 [v2:172.21.15.163:6826/3848110906,v1:172.21.15.163:6827/3848110906]' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2023-07-14T18:09:45.090 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:09:44 smithi163 ceph-mon[96576]: from='osd.9 ' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2023-07-14T18:09:45.171 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:09:44 smithi184 ceph-mon[98481]: pgmap v184: 1 pgs: 1 active+clean; 577 KiB data, 244 MiB used, 804 GiB / 805 GiB avail 2023-07-14T18:09:45.172 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:09:44 smithi184 ceph-mon[98481]: from='osd.9 [v2:172.21.15.163:6826/3848110906,v1:172.21.15.163:6827/3848110906]' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2023-07-14T18:09:45.172 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:09:44 smithi184 ceph-mon[98481]: from='osd.9 ' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2023-07-14T18:09:45.258 INFO:teuthology.orchestra.run.smithi172.stderr:--> Zapping: /dev/vg_nvme/lv_1 2023-07-14T18:09:45.259 INFO:teuthology.orchestra.run.smithi172.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_1 bs=1M count=10 conv=fsync 2023-07-14T18:09:45.259 INFO:teuthology.orchestra.run.smithi172.stderr: stderr: 10+0 records in 2023-07-14T18:09:45.259 INFO:teuthology.orchestra.run.smithi172.stderr:10+0 records out 2023-07-14T18:09:45.259 INFO:teuthology.orchestra.run.smithi172.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0116281 s, 902 MB/s 2023-07-14T18:09:45.259 INFO:teuthology.orchestra.run.smithi172.stderr:--> Zapping successful for: 2023-07-14T18:09:45.616 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81c9387d2e7576da065747ec9c16d1c7d69016ec shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bf7326ec-2270-11ee-9b33-001a4aab830c -- ceph orch daemon add osd smithi172:vg_nvme/lv_1 2023-07-14T18:09:46.022 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:09:45 smithi172 ceph-mon[97983]: from='osd.9 ' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2023-07-14T18:09:46.023 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:09:45 smithi172 ceph-mon[97983]: osdmap e61: 10 total, 9 up, 10 in 2023-07-14T18:09:46.023 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:09:45 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-07-14T18:09:46.023 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:09:45 smithi172 ceph-mon[97983]: from='osd.9 [v2:172.21.15.163:6826/3848110906,v1:172.21.15.163:6827/3848110906]' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi163", "root=default"]}]: dispatch 2023-07-14T18:09:46.023 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:09:45 smithi172 ceph-mon[97983]: from='osd.9 ' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi163", "root=default"]}]: dispatch 2023-07-14T18:09:46.023 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:09:45 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:09:46.024 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:09:45 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:09:46.024 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:09:45 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-07-14T18:09:46.024 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:09:45 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-07-14T18:09:46.024 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:09:45 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-07-14T18:09:46.024 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:09:45 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-07-14T18:09:46.024 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:09:45 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:09:46.025 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:09:45 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T18:09:46.025 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:09:45 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-14T18:09:46.025 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:09:45 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:09:46.025 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:09:45 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-14T18:09:46.025 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:09:45 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T18:09:46.025 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:09:45 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-14T18:09:46.025 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:09:45 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:09:46.171 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:09:45 smithi184 ceph-mon[98481]: from='osd.9 ' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2023-07-14T18:09:46.172 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:09:45 smithi184 ceph-mon[98481]: osdmap e61: 10 total, 9 up, 10 in 2023-07-14T18:09:46.172 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:09:45 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-07-14T18:09:46.172 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:09:45 smithi184 ceph-mon[98481]: from='osd.9 [v2:172.21.15.163:6826/3848110906,v1:172.21.15.163:6827/3848110906]' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi163", "root=default"]}]: dispatch 2023-07-14T18:09:46.172 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:09:45 smithi184 ceph-mon[98481]: from='osd.9 ' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi163", "root=default"]}]: dispatch 2023-07-14T18:09:46.173 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:09:45 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:09:46.173 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:09:45 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:09:46.173 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:09:45 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-07-14T18:09:46.173 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:09:45 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-07-14T18:09:46.173 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:09:45 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-07-14T18:09:46.173 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:09:45 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-07-14T18:09:46.173 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:09:45 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:09:46.173 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:09:45 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T18:09:46.174 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:09:45 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-14T18:09:46.174 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:09:45 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:09:46.174 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:09:45 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-14T18:09:46.174 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:09:45 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T18:09:46.174 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:09:45 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-14T18:09:46.174 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:09:45 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:09:46.209 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/bf7326ec-2270-11ee-9b33-001a4aab830c/mon.b/config 2023-07-14T18:09:46.214 INFO:journalctl@ceph.osd.9.smithi163.stdout:Jul 14 18:09:45 smithi163 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-9[125814]: 2023-07-14T18:09:45.769+0000 7fd07bc01700 -1 osd.9 0 waiting for initial osdmap 2023-07-14T18:09:46.214 INFO:journalctl@ceph.osd.9.smithi163.stdout:Jul 14 18:09:45 smithi163 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-9[125814]: 2023-07-14T18:09:45.779+0000 7fd0741f0700 -1 osd.9 62 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-07-14T18:09:46.214 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:09:45 smithi163 ceph-mon[96576]: from='osd.9 ' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2023-07-14T18:09:46.214 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:09:45 smithi163 ceph-mon[96576]: osdmap e61: 10 total, 9 up, 10 in 2023-07-14T18:09:46.214 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:09:45 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-07-14T18:09:46.215 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:09:45 smithi163 ceph-mon[96576]: from='osd.9 [v2:172.21.15.163:6826/3848110906,v1:172.21.15.163:6827/3848110906]' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi163", "root=default"]}]: dispatch 2023-07-14T18:09:46.215 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:09:45 smithi163 ceph-mon[96576]: from='osd.9 ' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi163", "root=default"]}]: dispatch 2023-07-14T18:09:46.215 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:09:45 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:09:46.215 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:09:45 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:09:46.215 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:09:45 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-07-14T18:09:46.215 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:09:45 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-07-14T18:09:46.215 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:09:45 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-07-14T18:09:46.216 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:09:45 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-07-14T18:09:46.216 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:09:45 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:09:46.216 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:09:45 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T18:09:46.216 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:09:45 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-14T18:09:46.216 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:09:45 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:09:46.216 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:09:45 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-14T18:09:46.216 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:09:45 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T18:09:46.216 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:09:45 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-14T18:09:46.217 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:09:45 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:09:47.022 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:09:46 smithi172 ceph-mon[97983]: pgmap v186: 1 pgs: 1 active+clean; 577 KiB data, 244 MiB used, 804 GiB / 805 GiB avail 2023-07-14T18:09:47.022 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:09:46 smithi172 ceph-mon[97983]: Detected new or changed devices on smithi163 2023-07-14T18:09:47.022 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:09:46 smithi172 ceph-mon[97983]: Adjusting osd_memory_target on smithi163 to 4292M 2023-07-14T18:09:47.023 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:09:46 smithi172 ceph-mon[97983]: from='osd.9 ' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi163", "root=default"]}]': finished 2023-07-14T18:09:47.023 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:09:46 smithi172 ceph-mon[97983]: osdmap e62: 10 total, 9 up, 10 in 2023-07-14T18:09:47.023 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:09:46 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-07-14T18:09:47.023 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:09:46 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-07-14T18:09:47.171 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:09:46 smithi184 ceph-mon[98481]: pgmap v186: 1 pgs: 1 active+clean; 577 KiB data, 244 MiB used, 804 GiB / 805 GiB avail 2023-07-14T18:09:47.172 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:09:46 smithi184 ceph-mon[98481]: Detected new or changed devices on smithi163 2023-07-14T18:09:47.172 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:09:46 smithi184 ceph-mon[98481]: Adjusting osd_memory_target on smithi163 to 4292M 2023-07-14T18:09:47.172 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:09:46 smithi184 ceph-mon[98481]: from='osd.9 ' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi163", "root=default"]}]': finished 2023-07-14T18:09:47.172 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:09:46 smithi184 ceph-mon[98481]: osdmap e62: 10 total, 9 up, 10 in 2023-07-14T18:09:47.172 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:09:46 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-07-14T18:09:47.173 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:09:46 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-07-14T18:09:47.214 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:09:46 smithi163 ceph-mon[96576]: pgmap v186: 1 pgs: 1 active+clean; 577 KiB data, 244 MiB used, 804 GiB / 805 GiB avail 2023-07-14T18:09:47.214 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:09:46 smithi163 ceph-mon[96576]: Detected new or changed devices on smithi163 2023-07-14T18:09:47.214 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:09:46 smithi163 ceph-mon[96576]: Adjusting osd_memory_target on smithi163 to 4292M 2023-07-14T18:09:47.215 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:09:46 smithi163 ceph-mon[96576]: from='osd.9 ' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi163", "root=default"]}]': finished 2023-07-14T18:09:47.215 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:09:46 smithi163 ceph-mon[96576]: osdmap e62: 10 total, 9 up, 10 in 2023-07-14T18:09:47.215 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:09:46 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-07-14T18:09:47.215 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:09:46 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-07-14T18:09:47.419 INFO:teuthology.orchestra.run.smithi172.stderr:2023-07-14T18:09:47.379+0000 7f2dbe687700 1 -- 172.21.15.172:0/2187186687 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2db8100130 msgr2=0x7f2db8100540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:09:47.419 INFO:teuthology.orchestra.run.smithi172.stderr:2023-07-14T18:09:47.379+0000 7f2dbe687700 1 --2- 172.21.15.172:0/2187186687 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2db8100130 0x7f2db8100540 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f2da80099c0 tx=0x7f2da8009cd0 comp rx=0 tx=0).stop 2023-07-14T18:09:47.419 INFO:teuthology.orchestra.run.smithi172.stderr:2023-07-14T18:09:47.379+0000 7f2dbe687700 1 -- 172.21.15.172:0/2187186687 shutdown_connections 2023-07-14T18:09:47.419 INFO:teuthology.orchestra.run.smithi172.stderr:2023-07-14T18:09:47.379+0000 7f2dbe687700 1 --2- 172.21.15.172:0/2187186687 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2db80ff740 0x7f2db8106ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:09:47.420 INFO:teuthology.orchestra.run.smithi172.stderr:2023-07-14T18:09:47.379+0000 7f2dbe687700 1 --2- 172.21.15.172:0/2187186687 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2db8100130 0x7f2db8100540 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:09:47.420 INFO:teuthology.orchestra.run.smithi172.stderr:2023-07-14T18:09:47.379+0000 7f2dbe687700 1 --2- 172.21.15.172:0/2187186687 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f2db80fed90 0x7f2db80ff200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:09:47.420 INFO:teuthology.orchestra.run.smithi172.stderr:2023-07-14T18:09:47.380+0000 7f2dbe687700 1 -- 172.21.15.172:0/2187186687 >> 172.21.15.172:0/2187186687 conn(0x7f2db80f9950 msgr2=0x7f2db80fbd80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:09:47.420 INFO:teuthology.orchestra.run.smithi172.stderr:2023-07-14T18:09:47.380+0000 7f2dbe687700 1 -- 172.21.15.172:0/2187186687 shutdown_connections 2023-07-14T18:09:47.420 INFO:teuthology.orchestra.run.smithi172.stderr:2023-07-14T18:09:47.380+0000 7f2dbe687700 1 -- 172.21.15.172:0/2187186687 wait complete. 2023-07-14T18:09:47.420 INFO:teuthology.orchestra.run.smithi172.stderr:2023-07-14T18:09:47.380+0000 7f2dbe687700 1 Processor -- start 2023-07-14T18:09:47.421 INFO:teuthology.orchestra.run.smithi172.stderr:2023-07-14T18:09:47.380+0000 7f2dbe687700 1 -- start start 2023-07-14T18:09:47.421 INFO:teuthology.orchestra.run.smithi172.stderr:2023-07-14T18:09:47.380+0000 7f2dbe687700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f2db80fed90 0x7f2db80fe7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:09:47.421 INFO:teuthology.orchestra.run.smithi172.stderr:2023-07-14T18:09:47.380+0000 7f2dbe687700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2db80ff740 0x7f2db819a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:09:47.421 INFO:teuthology.orchestra.run.smithi172.stderr:2023-07-14T18:09:47.380+0000 7f2dbe687700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2db8100130 0x7f2db819cc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:09:47.421 INFO:teuthology.orchestra.run.smithi172.stderr:2023-07-14T18:09:47.380+0000 7f2dbe687700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2db819d3c0 con 0x7f2db80fed90 2023-07-14T18:09:47.421 INFO:teuthology.orchestra.run.smithi172.stderr:2023-07-14T18:09:47.380+0000 7f2dbe687700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2db819d530 con 0x7f2db8100130 2023-07-14T18:09:47.421 INFO:teuthology.orchestra.run.smithi172.stderr:2023-07-14T18:09:47.380+0000 7f2dbe687700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2db819d6f0 con 0x7f2db80ff740 2023-07-14T18:09:47.422 INFO:teuthology.orchestra.run.smithi172.stderr:2023-07-14T18:09:47.381+0000 7f2dbcc24700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2db8100130 0x7f2db819cc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:09:47.422 INFO:teuthology.orchestra.run.smithi172.stderr:2023-07-14T18:09:47.381+0000 7f2dbcc24700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2db8100130 0x7f2db819cc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:34666/0 (socket says 172.21.15.172:34666) 2023-07-14T18:09:47.422 INFO:teuthology.orchestra.run.smithi172.stderr:2023-07-14T18:09:47.381+0000 7f2dbcc24700 1 -- 172.21.15.172:0/3764211961 learned_addr learned my addr 172.21.15.172:0/3764211961 (peer_addr_for_me v2:172.21.15.172:0/0) 2023-07-14T18:09:47.422 INFO:teuthology.orchestra.run.smithi172.stderr:2023-07-14T18:09:47.381+0000 7f2db7fff700 1 --2- 172.21.15.172:0/3764211961 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f2db80fed90 0x7f2db80fe7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:09:47.422 INFO:teuthology.orchestra.run.smithi172.stderr:2023-07-14T18:09:47.381+0000 7f2db77fe700 1 --2- 172.21.15.172:0/3764211961 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2db80ff740 0x7f2db819a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:09:47.422 INFO:teuthology.orchestra.run.smithi172.stderr:2023-07-14T18:09:47.381+0000 7f2dbcc24700 1 -- 172.21.15.172:0/3764211961 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2db80ff740 msgr2=0x7f2db819a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:09:47.422 INFO:teuthology.orchestra.run.smithi172.stderr:2023-07-14T18:09:47.381+0000 7f2dbcc24700 1 --2- 172.21.15.172:0/3764211961 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2db80ff740 0x7f2db819a5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:09:47.423 INFO:teuthology.orchestra.run.smithi172.stderr:2023-07-14T18:09:47.381+0000 7f2dbcc24700 1 -- 172.21.15.172:0/3764211961 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f2db80fed90 msgr2=0x7f2db80fe7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:09:47.423 INFO:teuthology.orchestra.run.smithi172.stderr:2023-07-14T18:09:47.381+0000 7f2dbcc24700 1 --2- 172.21.15.172:0/3764211961 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f2db80fed90 0x7f2db80fe7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:09:47.423 INFO:teuthology.orchestra.run.smithi172.stderr:2023-07-14T18:09:47.381+0000 7f2dbcc24700 1 -- 172.21.15.172:0/3764211961 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2da80095f0 con 0x7f2db8100130 2023-07-14T18:09:47.423 INFO:teuthology.orchestra.run.smithi172.stderr:2023-07-14T18:09:47.381+0000 7f2dbcc24700 1 --2- 172.21.15.172:0/3764211961 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2db8100130 0x7f2db819cc20 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f2db0007d70 tx=0x7f2db000a340 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:09:47.423 INFO:teuthology.orchestra.run.smithi172.stderr:2023-07-14T18:09:47.381+0000 7f2db57fa700 1 -- 172.21.15.172:0/3764211961 <== mon.2 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2db000ac90 con 0x7f2db8100130 2023-07-14T18:09:47.423 INFO:teuthology.orchestra.run.smithi172.stderr:2023-07-14T18:09:47.381+0000 7f2db57fa700 1 -- 172.21.15.172:0/3764211961 <== mon.2 v2:172.21.15.172:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f2db000adf0 con 0x7f2db8100130 2023-07-14T18:09:47.423 INFO:teuthology.orchestra.run.smithi172.stderr:2023-07-14T18:09:47.381+0000 7f2dbe687700 1 -- 172.21.15.172:0/3764211961 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2db819d9d0 con 0x7f2db8100130 2023-07-14T18:09:47.424 INFO:teuthology.orchestra.run.smithi172.stderr:2023-07-14T18:09:47.381+0000 7f2db57fa700 1 -- 172.21.15.172:0/3764211961 <== mon.2 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2db00115e0 con 0x7f2db8100130 2023-07-14T18:09:47.424 INFO:teuthology.orchestra.run.smithi172.stderr:2023-07-14T18:09:47.381+0000 7f2dbe687700 1 -- 172.21.15.172:0/3764211961 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2db819ded0 con 0x7f2db8100130 2023-07-14T18:09:47.424 INFO:teuthology.orchestra.run.smithi172.stderr:2023-07-14T18:09:47.382+0000 7f2dbe687700 1 -- 172.21.15.172:0/3764211961 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2db810a270 con 0x7f2db8100130 2023-07-14T18:09:47.425 INFO:teuthology.orchestra.run.smithi172.stderr:2023-07-14T18:09:47.383+0000 7f2db57fa700 1 -- 172.21.15.172:0/3764211961 <== mon.2 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 16) v1 ==== 135716+0+0 (secure 0 0 0) 0x7f2db0012420 con 0x7f2db8100130 2023-07-14T18:09:47.425 INFO:teuthology.orchestra.run.smithi172.stderr:2023-07-14T18:09:47.384+0000 7f2db57fa700 1 --2- 172.21.15.172:0/3764211961 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f2da00a1150 0x7f2da00a3600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:09:47.425 INFO:teuthology.orchestra.run.smithi172.stderr:2023-07-14T18:09:47.384+0000 7f2db57fa700 1 -- 172.21.15.172:0/3764211961 <== mon.2 v2:172.21.15.172:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 6261+0+0 (secure 0 0 0) 0x7f2db00cc550 con 0x7f2db8100130 2023-07-14T18:09:47.426 INFO:teuthology.orchestra.run.smithi172.stderr:2023-07-14T18:09:47.384+0000 7f2db7fff700 1 --2- 172.21.15.172:0/3764211961 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f2da00a1150 0x7f2da00a3600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:09:47.426 INFO:teuthology.orchestra.run.smithi172.stderr:2023-07-14T18:09:47.385+0000 7f2db7fff700 1 --2- 172.21.15.172:0/3764211961 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f2da00a1150 0x7f2da00a3600 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f2da8009990 tx=0x7f2da8005c40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:09:47.426 INFO:teuthology.orchestra.run.smithi172.stderr:2023-07-14T18:09:47.387+0000 7f2db57fa700 1 -- 172.21.15.172:0/3764211961 <== mon.2 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178025 (secure 0 0 0) 0x7f2db00964a0 con 0x7f2db8100130 2023-07-14T18:09:47.618 INFO:teuthology.orchestra.run.smithi172.stderr:2023-07-14T18:09:47.582+0000 7f2dbe687700 1 -- 172.21.15.172:0/3764211961 --> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi172:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) v1 -- 0x7f2db8060a80 con 0x7f2da00a1150 2023-07-14T18:09:48.171 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:09:47 smithi184 ceph-mon[98481]: purged_snaps scrub starts 2023-07-14T18:09:48.172 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:09:47 smithi184 ceph-mon[98481]: purged_snaps scrub ok 2023-07-14T18:09:48.172 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:09:47 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-07-14T18:09:48.172 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:09:47 smithi184 ceph-mon[98481]: osd.9 [v2:172.21.15.163:6826/3848110906,v1:172.21.15.163:6827/3848110906] boot 2023-07-14T18:09:48.172 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:09:47 smithi184 ceph-mon[98481]: osdmap e63: 10 total, 10 up, 10 in 2023-07-14T18:09:48.172 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:09:47 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-07-14T18:09:48.173 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:09:47 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-07-14T18:09:48.173 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:09:47 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-07-14T18:09:48.173 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:09:47 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T18:09:48.214 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:09:47 smithi163 ceph-mon[96576]: purged_snaps scrub starts 2023-07-14T18:09:48.214 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:09:47 smithi163 ceph-mon[96576]: purged_snaps scrub ok 2023-07-14T18:09:48.214 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:09:47 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-07-14T18:09:48.215 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:09:47 smithi163 ceph-mon[96576]: osd.9 [v2:172.21.15.163:6826/3848110906,v1:172.21.15.163:6827/3848110906] boot 2023-07-14T18:09:48.215 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:09:47 smithi163 ceph-mon[96576]: osdmap e63: 10 total, 10 up, 10 in 2023-07-14T18:09:48.215 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:09:47 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-07-14T18:09:48.215 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:09:47 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-07-14T18:09:48.215 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:09:47 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-07-14T18:09:48.215 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:09:47 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T18:09:48.272 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:09:47 smithi172 ceph-mon[97983]: purged_snaps scrub starts 2023-07-14T18:09:48.273 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:09:47 smithi172 ceph-mon[97983]: purged_snaps scrub ok 2023-07-14T18:09:48.273 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:09:47 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-07-14T18:09:48.273 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:09:47 smithi172 ceph-mon[97983]: osd.9 [v2:172.21.15.163:6826/3848110906,v1:172.21.15.163:6827/3848110906] boot 2023-07-14T18:09:48.273 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:09:47 smithi172 ceph-mon[97983]: osdmap e63: 10 total, 10 up, 10 in 2023-07-14T18:09:48.273 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:09:47 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-07-14T18:09:48.273 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:09:47 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-07-14T18:09:48.274 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:09:47 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-07-14T18:09:48.274 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:09:47 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T18:09:49.022 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:09:48 smithi172 ceph-mon[97983]: pgmap v189: 1 pgs: 1 active+clean; 577 KiB data, 244 MiB used, 804 GiB / 805 GiB avail 2023-07-14T18:09:49.023 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:09:48 smithi172 ceph-mon[97983]: from='client.24347 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi172:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2023-07-14T18:09:49.023 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:09:48 smithi172 ceph-mon[97983]: osdmap e64: 10 total, 10 up, 10 in 2023-07-14T18:09:49.171 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:09:48 smithi184 ceph-mon[98481]: pgmap v189: 1 pgs: 1 active+clean; 577 KiB data, 244 MiB used, 804 GiB / 805 GiB avail 2023-07-14T18:09:49.172 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:09:48 smithi184 ceph-mon[98481]: from='client.24347 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi172:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2023-07-14T18:09:49.172 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:09:48 smithi184 ceph-mon[98481]: osdmap e64: 10 total, 10 up, 10 in 2023-07-14T18:09:49.214 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:09:48 smithi163 ceph-mon[96576]: pgmap v189: 1 pgs: 1 active+clean; 577 KiB data, 244 MiB used, 804 GiB / 805 GiB avail 2023-07-14T18:09:49.214 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:09:48 smithi163 ceph-mon[96576]: from='client.24347 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi172:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2023-07-14T18:09:49.214 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:09:48 smithi163 ceph-mon[96576]: osdmap e64: 10 total, 10 up, 10 in 2023-07-14T18:09:50.171 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:09:49 smithi184 ceph-mon[98481]: pgmap v191: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 894 GiB / 894 GiB avail 2023-07-14T18:09:50.214 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:09:49 smithi163 ceph-mon[96576]: pgmap v191: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 894 GiB / 894 GiB avail 2023-07-14T18:09:50.272 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:09:49 smithi172 ceph-mon[97983]: pgmap v191: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 894 GiB / 894 GiB avail 2023-07-14T18:09:51.171 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:09:50 smithi184 ceph-mon[98481]: from='client.? 172.21.15.172:0/1443724934' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d943f7c0-da3d-4605-9e23-0231e675c6be"}]: dispatch 2023-07-14T18:09:51.172 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:09:50 smithi184 ceph-mon[98481]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d943f7c0-da3d-4605-9e23-0231e675c6be"}]: dispatch 2023-07-14T18:09:51.172 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:09:50 smithi184 ceph-mon[98481]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "d943f7c0-da3d-4605-9e23-0231e675c6be"}]': finished 2023-07-14T18:09:51.172 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:09:50 smithi184 ceph-mon[98481]: osdmap e65: 11 total, 10 up, 11 in 2023-07-14T18:09:51.172 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:09:50 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-07-14T18:09:51.172 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:09:50 smithi184 ceph-mon[98481]: from='client.? 172.21.15.172:0/1671918273' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-07-14T18:09:51.214 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:09:50 smithi163 ceph-mon[96576]: from='client.? 172.21.15.172:0/1443724934' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d943f7c0-da3d-4605-9e23-0231e675c6be"}]: dispatch 2023-07-14T18:09:51.215 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:09:50 smithi163 ceph-mon[96576]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d943f7c0-da3d-4605-9e23-0231e675c6be"}]: dispatch 2023-07-14T18:09:51.215 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:09:50 smithi163 ceph-mon[96576]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "d943f7c0-da3d-4605-9e23-0231e675c6be"}]': finished 2023-07-14T18:09:51.215 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:09:50 smithi163 ceph-mon[96576]: osdmap e65: 11 total, 10 up, 11 in 2023-07-14T18:09:51.215 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:09:50 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-07-14T18:09:51.215 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:09:50 smithi163 ceph-mon[96576]: from='client.? 172.21.15.172:0/1671918273' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-07-14T18:09:51.272 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:09:50 smithi172 ceph-mon[97983]: from='client.? 172.21.15.172:0/1443724934' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d943f7c0-da3d-4605-9e23-0231e675c6be"}]: dispatch 2023-07-14T18:09:51.273 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:09:50 smithi172 ceph-mon[97983]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d943f7c0-da3d-4605-9e23-0231e675c6be"}]: dispatch 2023-07-14T18:09:51.273 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:09:50 smithi172 ceph-mon[97983]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "d943f7c0-da3d-4605-9e23-0231e675c6be"}]': finished 2023-07-14T18:09:51.273 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:09:50 smithi172 ceph-mon[97983]: osdmap e65: 11 total, 10 up, 11 in 2023-07-14T18:09:51.273 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:09:50 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-07-14T18:09:51.273 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:09:50 smithi172 ceph-mon[97983]: from='client.? 172.21.15.172:0/1671918273' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-07-14T18:09:52.171 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:09:51 smithi184 ceph-mon[98481]: pgmap v193: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 894 GiB / 894 GiB avail 2023-07-14T18:09:52.214 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:09:51 smithi163 ceph-mon[96576]: pgmap v193: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 894 GiB / 894 GiB avail 2023-07-14T18:09:52.272 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:09:51 smithi172 ceph-mon[97983]: pgmap v193: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 894 GiB / 894 GiB avail 2023-07-14T18:09:54.738 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:09:54 smithi172 ceph-mon[97983]: pgmap v194: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 894 GiB / 894 GiB avail 2023-07-14T18:09:54.922 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:09:54 smithi184 ceph-mon[98481]: pgmap v194: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 894 GiB / 894 GiB avail 2023-07-14T18:09:54.964 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:09:54 smithi163 ceph-mon[96576]: pgmap v194: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 894 GiB / 894 GiB avail 2023-07-14T18:09:57.022 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:09:56 smithi172 ceph-mon[97983]: pgmap v195: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 894 GiB / 894 GiB avail 2023-07-14T18:09:57.023 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:09:56 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2023-07-14T18:09:57.023 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:09:56 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T18:09:57.171 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:09:56 smithi184 ceph-mon[98481]: pgmap v195: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 894 GiB / 894 GiB avail 2023-07-14T18:09:57.172 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:09:56 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2023-07-14T18:09:57.172 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:09:56 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T18:09:57.214 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:09:56 smithi163 ceph-mon[96576]: pgmap v195: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 894 GiB / 894 GiB avail 2023-07-14T18:09:57.214 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:09:56 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2023-07-14T18:09:57.214 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:09:56 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T18:09:58.023 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:09:57 smithi172 ceph-mon[97983]: Deploying daemon osd.10 on smithi172 2023-07-14T18:09:58.171 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:09:57 smithi184 ceph-mon[98481]: Deploying daemon osd.10 on smithi172 2023-07-14T18:09:58.214 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:09:57 smithi163 ceph-mon[96576]: Deploying daemon osd.10 on smithi172 2023-07-14T18:09:59.023 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:09:58 smithi172 ceph-mon[97983]: pgmap v196: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 894 GiB / 894 GiB avail 2023-07-14T18:09:59.171 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:09:58 smithi184 ceph-mon[98481]: pgmap v196: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 894 GiB / 894 GiB avail 2023-07-14T18:09:59.214 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:09:58 smithi163 ceph-mon[96576]: pgmap v196: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 894 GiB / 894 GiB avail 2023-07-14T18:10:01.172 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:10:00 smithi184 ceph-mon[98481]: pgmap v197: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 894 GiB / 894 GiB avail 2023-07-14T18:10:01.172 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:10:00 smithi184 ceph-mon[98481]: overall HEALTH_OK 2023-07-14T18:10:01.172 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:10:00 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:10:01.172 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:10:00 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:10:01.172 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:10:00 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-14T18:10:01.214 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:10:00 smithi163 ceph-mon[96576]: pgmap v197: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 894 GiB / 894 GiB avail 2023-07-14T18:10:01.215 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:10:00 smithi163 ceph-mon[96576]: overall HEALTH_OK 2023-07-14T18:10:01.215 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:10:00 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:10:01.215 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:10:00 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:10:01.215 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:10:00 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-14T18:10:01.272 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:10:00 smithi172 ceph-mon[97983]: pgmap v197: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 894 GiB / 894 GiB avail 2023-07-14T18:10:01.273 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:10:00 smithi172 ceph-mon[97983]: overall HEALTH_OK 2023-07-14T18:10:01.273 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:10:00 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:10:01.273 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:10:00 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:10:01.273 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:10:00 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-14T18:10:03.065 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:10:02 smithi172 ceph-mon[97983]: pgmap v198: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 894 GiB / 894 GiB avail 2023-07-14T18:10:03.172 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:10:02 smithi184 ceph-mon[98481]: pgmap v198: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 894 GiB / 894 GiB avail 2023-07-14T18:10:03.214 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:10:02 smithi163 ceph-mon[96576]: pgmap v198: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 894 GiB / 894 GiB avail 2023-07-14T18:10:03.483 INFO:teuthology.orchestra.run.smithi172.stdout:Created osd(s) 10 on host 'smithi172' 2023-07-14T18:10:03.484 INFO:teuthology.orchestra.run.smithi172.stderr:2023-07-14T18:10:03.444+0000 7f2db57fa700 1 -- 172.21.15.172:0/3764211961 <== mgr.14152 v2:172.21.15.163:6800/1949590926 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+38 (secure 0 0 0) 0x7f2db8060a80 con 0x7f2da00a1150 2023-07-14T18:10:03.485 INFO:teuthology.orchestra.run.smithi172.stderr:2023-07-14T18:10:03.447+0000 7f2dbe687700 1 -- 172.21.15.172:0/3764211961 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f2da00a1150 msgr2=0x7f2da00a3600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:10:03.485 INFO:teuthology.orchestra.run.smithi172.stderr:2023-07-14T18:10:03.447+0000 7f2dbe687700 1 --2- 172.21.15.172:0/3764211961 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f2da00a1150 0x7f2da00a3600 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f2da8009990 tx=0x7f2da8005c40 comp rx=0 tx=0).stop 2023-07-14T18:10:03.485 INFO:teuthology.orchestra.run.smithi172.stderr:2023-07-14T18:10:03.447+0000 7f2dbe687700 1 -- 172.21.15.172:0/3764211961 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2db8100130 msgr2=0x7f2db819cc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:10:03.486 INFO:teuthology.orchestra.run.smithi172.stderr:2023-07-14T18:10:03.447+0000 7f2dbe687700 1 --2- 172.21.15.172:0/3764211961 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2db8100130 0x7f2db819cc20 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f2db0007d70 tx=0x7f2db000a340 comp rx=0 tx=0).stop 2023-07-14T18:10:03.486 INFO:teuthology.orchestra.run.smithi172.stderr:2023-07-14T18:10:03.447+0000 7f2dbe687700 1 -- 172.21.15.172:0/3764211961 shutdown_connections 2023-07-14T18:10:03.486 INFO:teuthology.orchestra.run.smithi172.stderr:2023-07-14T18:10:03.447+0000 7f2dbe687700 1 --2- 172.21.15.172:0/3764211961 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f2da00a1150 0x7f2da00a3600 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:10:03.486 INFO:teuthology.orchestra.run.smithi172.stderr:2023-07-14T18:10:03.447+0000 7f2dbe687700 1 --2- 172.21.15.172:0/3764211961 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2db8100130 0x7f2db819cc20 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:10:03.486 INFO:teuthology.orchestra.run.smithi172.stderr:2023-07-14T18:10:03.447+0000 7f2dbe687700 1 --2- 172.21.15.172:0/3764211961 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f2db80fed90 0x7f2db80fe7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:10:03.486 INFO:teuthology.orchestra.run.smithi172.stderr:2023-07-14T18:10:03.447+0000 7f2dbe687700 1 --2- 172.21.15.172:0/3764211961 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2db80ff740 0x7f2db819a5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:10:03.486 INFO:teuthology.orchestra.run.smithi172.stderr:2023-07-14T18:10:03.447+0000 7f2dbe687700 1 -- 172.21.15.172:0/3764211961 >> 172.21.15.172:0/3764211961 conn(0x7f2db80f9950 msgr2=0x7f2db80fbba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:10:03.487 INFO:teuthology.orchestra.run.smithi172.stderr:2023-07-14T18:10:03.447+0000 7f2dbe687700 1 -- 172.21.15.172:0/3764211961 shutdown_connections 2023-07-14T18:10:03.487 INFO:teuthology.orchestra.run.smithi172.stderr:2023-07-14T18:10:03.447+0000 7f2dbe687700 1 -- 172.21.15.172:0/3764211961 wait complete. 2023-07-14T18:10:03.905 DEBUG:teuthology.orchestra.run.smithi172:osd.10> sudo journalctl -f -n 0 -u ceph-bf7326ec-2270-11ee-9b33-001a4aab830c@osd.10.service 2023-07-14T18:10:03.907 INFO:tasks.cephadm:Deploying osd.11 on smithi184 with /dev/vg_nvme/lv_1... 2023-07-14T18:10:03.907 DEBUG:teuthology.orchestra.run.smithi184:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81c9387d2e7576da065747ec9c16d1c7d69016ec shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bf7326ec-2270-11ee-9b33-001a4aab830c -- ceph-volume lvm zap /dev/vg_nvme/lv_1 2023-07-14T18:10:03.936 INFO:journalctl@ceph.osd.10.smithi172.stdout:-- Logs begin at Fri 2023-07-14 17:45:52 UTC. -- 2023-07-14T18:10:04.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:10:04 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:10:04.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:10:04 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:10:04.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:10:04 smithi184 ceph-mon[98481]: pgmap v199: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 894 GiB / 894 GiB avail 2023-07-14T18:10:04.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:10:04 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:10:04.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:10:04 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:10:04.445 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:10:04 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:10:04.445 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:10:04 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:10:04.445 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:10:04 smithi172 ceph-mon[97983]: pgmap v199: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 894 GiB / 894 GiB avail 2023-07-14T18:10:04.445 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:10:04 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:10:04.446 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:10:04 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:10:04.464 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:10:04 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:10:04.465 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:10:04 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:10:04.465 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:10:04 smithi163 ceph-mon[96576]: pgmap v199: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 894 GiB / 894 GiB avail 2023-07-14T18:10:04.465 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:10:04 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:10:04.465 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:10:04 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:10:04.470 INFO:teuthology.orchestra.run.smithi184.stderr:Inferring config /var/lib/ceph/bf7326ec-2270-11ee-9b33-001a4aab830c/mon.c/config 2023-07-14T18:10:04.763 INFO:journalctl@ceph.osd.10.smithi172.stdout:Jul 14 18:10:04 smithi172 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-10[119489]: 2023-07-14T18:10:04.516+0000 7fe8b43a8640 -1 osd.10 0 log_to_monitors true 2023-07-14T18:10:05.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:10:05 smithi184 ceph-mon[98481]: from='osd.10 [v2:172.21.15.172:6824/3281085356,v1:172.21.15.172:6825/3281085356]' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2023-07-14T18:10:05.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:10:05 smithi184 ceph-mon[98481]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2023-07-14T18:10:05.464 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:10:05 smithi163 ceph-mon[96576]: from='osd.10 [v2:172.21.15.172:6824/3281085356,v1:172.21.15.172:6825/3281085356]' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2023-07-14T18:10:05.465 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:10:05 smithi163 ceph-mon[96576]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2023-07-14T18:10:05.522 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:10:05 smithi172 ceph-mon[97983]: from='osd.10 [v2:172.21.15.172:6824/3281085356,v1:172.21.15.172:6825/3281085356]' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2023-07-14T18:10:05.523 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:10:05 smithi172 ceph-mon[97983]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2023-07-14T18:10:06.068 INFO:teuthology.orchestra.run.smithi184.stderr:--> Zapping: /dev/vg_nvme/lv_1 2023-07-14T18:10:06.068 INFO:teuthology.orchestra.run.smithi184.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_1 bs=1M count=10 conv=fsync 2023-07-14T18:10:06.069 INFO:teuthology.orchestra.run.smithi184.stderr: stderr: 10+0 records in 2023-07-14T18:10:06.069 INFO:teuthology.orchestra.run.smithi184.stderr:10+0 records out 2023-07-14T18:10:06.069 INFO:teuthology.orchestra.run.smithi184.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0111258 s, 942 MB/s 2023-07-14T18:10:06.069 INFO:teuthology.orchestra.run.smithi184.stderr:--> Zapping successful for: 2023-07-14T18:10:06.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:10:06 smithi184 ceph-mon[98481]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2023-07-14T18:10:06.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:10:06 smithi184 ceph-mon[98481]: osdmap e66: 11 total, 10 up, 11 in 2023-07-14T18:10:06.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:10:06 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-07-14T18:10:06.423 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:10:06 smithi184 ceph-mon[98481]: from='osd.10 [v2:172.21.15.172:6824/3281085356,v1:172.21.15.172:6825/3281085356]' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi172", "root=default"]}]: dispatch 2023-07-14T18:10:06.423 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:10:06 smithi184 ceph-mon[98481]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi172", "root=default"]}]: dispatch 2023-07-14T18:10:06.423 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:10:06 smithi184 ceph-mon[98481]: pgmap v201: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 894 GiB / 894 GiB avail 2023-07-14T18:10:06.423 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:10:06 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:10:06.423 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:10:06 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:10:06.423 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:10:06 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-07-14T18:10:06.423 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:10:06 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-07-14T18:10:06.424 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:10:06 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-07-14T18:10:06.464 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:10:06 smithi163 ceph-mon[96576]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2023-07-14T18:10:06.465 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:10:06 smithi163 ceph-mon[96576]: osdmap e66: 11 total, 10 up, 11 in 2023-07-14T18:10:06.465 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:10:06 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-07-14T18:10:06.465 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:10:06 smithi163 ceph-mon[96576]: from='osd.10 [v2:172.21.15.172:6824/3281085356,v1:172.21.15.172:6825/3281085356]' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi172", "root=default"]}]: dispatch 2023-07-14T18:10:06.465 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:10:06 smithi163 ceph-mon[96576]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi172", "root=default"]}]: dispatch 2023-07-14T18:10:06.465 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:10:06 smithi163 ceph-mon[96576]: pgmap v201: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 894 GiB / 894 GiB avail 2023-07-14T18:10:06.465 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:10:06 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:10:06.465 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:10:06 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:10:06.466 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:10:06 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-07-14T18:10:06.466 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:10:06 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-07-14T18:10:06.466 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:10:06 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-07-14T18:10:06.517 DEBUG:teuthology.orchestra.run.smithi184:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81c9387d2e7576da065747ec9c16d1c7d69016ec shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bf7326ec-2270-11ee-9b33-001a4aab830c -- ceph orch daemon add osd smithi184:vg_nvme/lv_1 2023-07-14T18:10:06.523 INFO:journalctl@ceph.osd.10.smithi172.stdout:Jul 14 18:10:06 smithi172 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-10[119489]: 2023-07-14T18:10:06.144+0000 7fe8a9a20700 -1 osd.10 0 waiting for initial osdmap 2023-07-14T18:10:06.523 INFO:journalctl@ceph.osd.10.smithi172.stdout:Jul 14 18:10:06 smithi172 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-10[119489]: 2023-07-14T18:10:06.156+0000 7fe8a4814700 -1 osd.10 67 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-07-14T18:10:06.524 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:10:06 smithi172 ceph-mon[97983]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2023-07-14T18:10:06.524 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:10:06 smithi172 ceph-mon[97983]: osdmap e66: 11 total, 10 up, 11 in 2023-07-14T18:10:06.525 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:10:06 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-07-14T18:10:06.525 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:10:06 smithi172 ceph-mon[97983]: from='osd.10 [v2:172.21.15.172:6824/3281085356,v1:172.21.15.172:6825/3281085356]' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi172", "root=default"]}]: dispatch 2023-07-14T18:10:06.525 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:10:06 smithi172 ceph-mon[97983]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi172", "root=default"]}]: dispatch 2023-07-14T18:10:06.526 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:10:06 smithi172 ceph-mon[97983]: pgmap v201: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 894 GiB / 894 GiB avail 2023-07-14T18:10:06.526 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:10:06 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:10:06.526 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:10:06 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:10:06.526 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:10:06 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-07-14T18:10:06.526 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:10:06 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-07-14T18:10:06.526 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:10:06 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-07-14T18:10:07.069 INFO:teuthology.orchestra.run.smithi184.stderr:Inferring config /var/lib/ceph/bf7326ec-2270-11ee-9b33-001a4aab830c/mon.c/config 2023-07-14T18:10:07.460 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:10:07 smithi184 ceph-mon[98481]: Detected new or changed devices on smithi172 2023-07-14T18:10:07.460 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:10:07 smithi184 ceph-mon[98481]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi172", "root=default"]}]': finished 2023-07-14T18:10:07.460 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:10:07 smithi184 ceph-mon[98481]: osdmap e67: 11 total, 10 up, 11 in 2023-07-14T18:10:07.461 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:10:07 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-07-14T18:10:07.461 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:10:07 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-07-14T18:10:07.461 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:10:07 smithi184 ceph-mon[98481]: Adjusting osd_memory_target on smithi172 to 4292M 2023-07-14T18:10:07.461 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:10:07 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-07-14T18:10:07.461 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:10:07 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:10:07.462 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:10:07 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T18:10:07.462 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:10:07 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-14T18:10:07.462 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:10:07 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:10:07.462 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:10:07 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-14T18:10:07.462 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:10:07 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T18:10:07.462 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:10:07 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-14T18:10:07.462 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:10:07 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:10:07.464 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:10:07 smithi163 ceph-mon[96576]: Detected new or changed devices on smithi172 2023-07-14T18:10:07.465 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:10:07 smithi163 ceph-mon[96576]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi172", "root=default"]}]': finished 2023-07-14T18:10:07.465 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:10:07 smithi163 ceph-mon[96576]: osdmap e67: 11 total, 10 up, 11 in 2023-07-14T18:10:07.465 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:10:07 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-07-14T18:10:07.465 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:10:07 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-07-14T18:10:07.466 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:10:07 smithi163 ceph-mon[96576]: Adjusting osd_memory_target on smithi172 to 4292M 2023-07-14T18:10:07.466 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:10:07 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-07-14T18:10:07.466 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:10:07 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:10:07.467 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:10:07 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T18:10:07.467 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:10:07 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-14T18:10:07.467 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:10:07 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:10:07.467 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:10:07 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-14T18:10:07.468 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:10:07 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T18:10:07.468 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:10:07 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-14T18:10:07.468 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:10:07 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:10:07.523 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:10:07 smithi172 ceph-mon[97983]: Detected new or changed devices on smithi172 2023-07-14T18:10:07.523 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:10:07 smithi172 ceph-mon[97983]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi172", "root=default"]}]': finished 2023-07-14T18:10:07.524 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:10:07 smithi172 ceph-mon[97983]: osdmap e67: 11 total, 10 up, 11 in 2023-07-14T18:10:07.524 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:10:07 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-07-14T18:10:07.524 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:10:07 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-07-14T18:10:07.525 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:10:07 smithi172 ceph-mon[97983]: Adjusting osd_memory_target on smithi172 to 4292M 2023-07-14T18:10:07.525 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:10:07 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-07-14T18:10:07.525 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:10:07 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:10:07.525 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:10:07 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T18:10:07.526 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:10:07 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-14T18:10:07.526 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:10:07 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:10:07.526 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:10:07 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-14T18:10:07.526 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:10:07 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T18:10:07.527 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:10:07 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-14T18:10:07.527 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:10:07 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:10:08.238 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:10:08.200+0000 7f7bf67fd700 1 -- 172.21.15.184:0/765393028 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7bf01002e0 msgr2=0x7f7bf01006f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:10:08.238 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:10:08.200+0000 7f7bf67fd700 1 --2- 172.21.15.184:0/765393028 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7bf01002e0 0x7f7bf01006f0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f7bd8009990 tx=0x7f7bd8009ca0 comp rx=0 tx=0).stop 2023-07-14T18:10:08.239 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:10:08.200+0000 7f7bf67fd700 1 -- 172.21.15.184:0/765393028 shutdown_connections 2023-07-14T18:10:08.239 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:10:08.200+0000 7f7bf67fd700 1 --2- 172.21.15.184:0/765393028 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7bf01002e0 0x7f7bf01006f0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:10:08.239 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:10:08.200+0000 7f7bf67fd700 1 --2- 172.21.15.184:0/765393028 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7bf00ff860 0x7f7bf0107110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:10:08.239 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:10:08.200+0000 7f7bf67fd700 1 --2- 172.21.15.184:0/765393028 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f7bf00feeb0 0x7f7bf00ff320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:10:08.239 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:10:08.200+0000 7f7bf67fd700 1 -- 172.21.15.184:0/765393028 >> 172.21.15.184:0/765393028 conn(0x7f7bf00f99f0 msgr2=0x7f7bf00fbe60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:10:08.239 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:10:08.200+0000 7f7bf67fd700 1 -- 172.21.15.184:0/765393028 shutdown_connections 2023-07-14T18:10:08.240 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:10:08.200+0000 7f7bf67fd700 1 -- 172.21.15.184:0/765393028 wait complete. 2023-07-14T18:10:08.240 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:10:08.200+0000 7f7bf67fd700 1 Processor -- start 2023-07-14T18:10:08.240 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:10:08.200+0000 7f7bf67fd700 1 -- start start 2023-07-14T18:10:08.241 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:10:08.201+0000 7f7bf67fd700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7bf00feeb0 0x7f7bf0195970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:10:08.242 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:10:08.201+0000 7f7bf67fd700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7bf00ff860 0x7f7bf0195eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:10:08.242 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:10:08.201+0000 7f7bf67fd700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f7bf01002e0 0x7f7bf019cf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:10:08.242 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:10:08.201+0000 7f7bf67fd700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7bf019d500 con 0x7f7bf01002e0 2023-07-14T18:10:08.242 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:10:08.201+0000 7f7bf67fd700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7bf019d640 con 0x7f7bf00ff860 2023-07-14T18:10:08.242 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:10:08.201+0000 7f7bf67fd700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7bf019d7d0 con 0x7f7bf00feeb0 2023-07-14T18:10:08.242 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:10:08.201+0000 7f7beffff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7bf00feeb0 0x7f7bf0195970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:10:08.243 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:10:08.201+0000 7f7beffff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7bf00feeb0 0x7f7bf0195970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.184:54222/0 (socket says 172.21.15.184:54222) 2023-07-14T18:10:08.243 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:10:08.201+0000 7f7beffff700 1 -- 172.21.15.184:0/2183049080 learned_addr learned my addr 172.21.15.184:0/2183049080 (peer_addr_for_me v2:172.21.15.184:0/0) 2023-07-14T18:10:08.243 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:10:08.201+0000 7f7bf4d9a700 1 --2- 172.21.15.184:0/2183049080 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f7bf01002e0 0x7f7bf019cf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:10:08.243 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:10:08.201+0000 7f7bef7fe700 1 --2- 172.21.15.184:0/2183049080 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7bf00ff860 0x7f7bf0195eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:10:08.243 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:10:08.201+0000 7f7beffff700 1 -- 172.21.15.184:0/2183049080 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7bf00ff860 msgr2=0x7f7bf0195eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:10:08.243 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:10:08.201+0000 7f7beffff700 1 --2- 172.21.15.184:0/2183049080 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7bf00ff860 0x7f7bf0195eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:10:08.243 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:10:08.201+0000 7f7beffff700 1 -- 172.21.15.184:0/2183049080 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f7bf01002e0 msgr2=0x7f7bf019cf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:10:08.244 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:10:08.201+0000 7f7beffff700 1 --2- 172.21.15.184:0/2183049080 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f7bf01002e0 0x7f7bf019cf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:10:08.244 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:10:08.201+0000 7f7beffff700 1 -- 172.21.15.184:0/2183049080 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7bd80095f0 con 0x7f7bf00feeb0 2023-07-14T18:10:08.244 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:10:08.201+0000 7f7beffff700 1 --2- 172.21.15.184:0/2183049080 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7bf00feeb0 0x7f7bf0195970 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f7bd80059d0 tx=0x7f7bd8004730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:10:08.244 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:10:08.201+0000 7f7bed7fa700 1 -- 172.21.15.184:0/2183049080 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bd801d070 con 0x7f7bf00feeb0 2023-07-14T18:10:08.244 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:10:08.201+0000 7f7bed7fa700 1 -- 172.21.15.184:0/2183049080 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f7bd8004080 con 0x7f7bf00feeb0 2023-07-14T18:10:08.244 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:10:08.201+0000 7f7bf67fd700 1 -- 172.21.15.184:0/2183049080 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7bf019da50 con 0x7f7bf00feeb0 2023-07-14T18:10:08.244 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:10:08.201+0000 7f7bed7fa700 1 -- 172.21.15.184:0/2183049080 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bd8022c50 con 0x7f7bf00feeb0 2023-07-14T18:10:08.244 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:10:08.201+0000 7f7bf67fd700 1 -- 172.21.15.184:0/2183049080 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7bf019df40 con 0x7f7bf00feeb0 2023-07-14T18:10:08.245 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:10:08.202+0000 7f7bf67fd700 1 -- 172.21.15.184:0/2183049080 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7bf0106e80 con 0x7f7bf00feeb0 2023-07-14T18:10:08.245 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:10:08.204+0000 7f7bed7fa700 1 -- 172.21.15.184:0/2183049080 <== mon.1 v2:172.21.15.184:3300/0 4 ==== mgrmap(e 16) v1 ==== 135716+0+0 (secure 0 0 0) 0x7f7bd8022470 con 0x7f7bf00feeb0 2023-07-14T18:10:08.245 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:10:08.204+0000 7f7bed7fa700 1 --2- 172.21.15.184:0/2183049080 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f7bdc0a11d0 0x7f7bdc0a3680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:10:08.246 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:10:08.205+0000 7f7bed7fa700 1 -- 172.21.15.184:0/2183049080 <== mon.1 v2:172.21.15.184:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 6723+0+0 (secure 0 0 0) 0x7f7bd80cd970 con 0x7f7bf00feeb0 2023-07-14T18:10:08.246 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:10:08.205+0000 7f7bef7fe700 1 --2- 172.21.15.184:0/2183049080 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f7bdc0a11d0 0x7f7bdc0a3680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:10:08.246 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:10:08.205+0000 7f7bef7fe700 1 --2- 172.21.15.184:0/2183049080 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f7bdc0a11d0 0x7f7bdc0a3680 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f7be0005950 tx=0x7f7be00058e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:10:08.246 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:10:08.208+0000 7f7bed7fa700 1 -- 172.21.15.184:0/2183049080 <== mon.1 v2:172.21.15.184:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178025 (secure 0 0 0) 0x7f7bd8097780 con 0x7f7bf00feeb0 2023-07-14T18:10:08.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:10:08 smithi184 ceph-mon[98481]: purged_snaps scrub starts 2023-07-14T18:10:08.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:10:08 smithi184 ceph-mon[98481]: purged_snaps scrub ok 2023-07-14T18:10:08.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:10:08 smithi184 ceph-mon[98481]: osd.10 [v2:172.21.15.172:6824/3281085356,v1:172.21.15.172:6825/3281085356] boot 2023-07-14T18:10:08.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:10:08 smithi184 ceph-mon[98481]: osdmap e68: 11 total, 11 up, 11 in 2023-07-14T18:10:08.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:10:08 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-07-14T18:10:08.423 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:10:08 smithi184 ceph-mon[98481]: pgmap v204: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 894 GiB / 894 GiB avail 2023-07-14T18:10:08.423 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:10:08 smithi184 ceph-mon[98481]: osdmap e69: 11 total, 11 up, 11 in 2023-07-14T18:10:08.440 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:10:08.402+0000 7f7bf67fd700 1 -- 172.21.15.184:0/2183049080 --> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi184:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) v1 -- 0x7f7bf0060a80 con 0x7f7bdc0a11d0 2023-07-14T18:10:08.464 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:10:08 smithi163 ceph-mon[96576]: purged_snaps scrub starts 2023-07-14T18:10:08.465 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:10:08 smithi163 ceph-mon[96576]: purged_snaps scrub ok 2023-07-14T18:10:08.465 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:10:08 smithi163 ceph-mon[96576]: osd.10 [v2:172.21.15.172:6824/3281085356,v1:172.21.15.172:6825/3281085356] boot 2023-07-14T18:10:08.465 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:10:08 smithi163 ceph-mon[96576]: osdmap e68: 11 total, 11 up, 11 in 2023-07-14T18:10:08.465 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:10:08 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-07-14T18:10:08.465 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:10:08 smithi163 ceph-mon[96576]: pgmap v204: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 894 GiB / 894 GiB avail 2023-07-14T18:10:08.465 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:10:08 smithi163 ceph-mon[96576]: osdmap e69: 11 total, 11 up, 11 in 2023-07-14T18:10:08.523 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:10:08 smithi172 ceph-mon[97983]: purged_snaps scrub starts 2023-07-14T18:10:08.523 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:10:08 smithi172 ceph-mon[97983]: purged_snaps scrub ok 2023-07-14T18:10:08.523 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:10:08 smithi172 ceph-mon[97983]: osd.10 [v2:172.21.15.172:6824/3281085356,v1:172.21.15.172:6825/3281085356] boot 2023-07-14T18:10:08.523 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:10:08 smithi172 ceph-mon[97983]: osdmap e68: 11 total, 11 up, 11 in 2023-07-14T18:10:08.523 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:10:08 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-07-14T18:10:08.524 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:10:08 smithi172 ceph-mon[97983]: pgmap v204: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 894 GiB / 894 GiB avail 2023-07-14T18:10:08.524 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:10:08 smithi172 ceph-mon[97983]: osdmap e69: 11 total, 11 up, 11 in 2023-07-14T18:10:09.464 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:10:09 smithi163 ceph-mon[96576]: from='client.24352 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi184:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2023-07-14T18:10:09.465 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:10:09 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-07-14T18:10:09.465 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:10:09 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-07-14T18:10:09.465 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:10:09 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T18:10:09.465 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:10:09 smithi163 ceph-mon[96576]: osdmap e70: 11 total, 11 up, 11 in 2023-07-14T18:10:09.515 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:10:09 smithi184 ceph-mon[98481]: from='client.24352 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi184:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2023-07-14T18:10:09.515 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:10:09 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-07-14T18:10:09.516 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:10:09 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-07-14T18:10:09.516 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:10:09 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T18:10:09.516 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:10:09 smithi184 ceph-mon[98481]: osdmap e70: 11 total, 11 up, 11 in 2023-07-14T18:10:09.523 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:10:09 smithi172 ceph-mon[97983]: from='client.24352 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi184:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2023-07-14T18:10:09.523 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:10:09 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-07-14T18:10:09.523 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:10:09 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-07-14T18:10:09.523 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:10:09 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T18:10:09.523 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:10:09 smithi172 ceph-mon[97983]: osdmap e70: 11 total, 11 up, 11 in 2023-07-14T18:10:10.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:10:10 smithi184 ceph-mon[98481]: pgmap v207: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 983 GiB / 983 GiB avail 2023-07-14T18:10:10.464 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:10:10 smithi163 ceph-mon[96576]: pgmap v207: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 983 GiB / 983 GiB avail 2023-07-14T18:10:10.523 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:10:10 smithi172 ceph-mon[97983]: pgmap v207: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 983 GiB / 983 GiB avail 2023-07-14T18:10:11.464 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:10:11 smithi163 ceph-mon[96576]: osdmap e71: 11 total, 11 up, 11 in 2023-07-14T18:10:11.465 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:10:11 smithi163 ceph-mon[96576]: from='client.? 172.21.15.184:0/3077724872' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "09e610a8-408a-4119-a21b-c4de2810a538"}]: dispatch 2023-07-14T18:10:11.465 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:10:11 smithi163 ceph-mon[96576]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "09e610a8-408a-4119-a21b-c4de2810a538"}]: dispatch 2023-07-14T18:10:11.465 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:10:11 smithi163 ceph-mon[96576]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "09e610a8-408a-4119-a21b-c4de2810a538"}]': finished 2023-07-14T18:10:11.465 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:10:11 smithi163 ceph-mon[96576]: osdmap e72: 12 total, 11 up, 12 in 2023-07-14T18:10:11.465 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:10:11 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-07-14T18:10:11.523 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:10:11 smithi172 ceph-mon[97983]: osdmap e71: 11 total, 11 up, 11 in 2023-07-14T18:10:11.523 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:10:11 smithi172 ceph-mon[97983]: from='client.? 172.21.15.184:0/3077724872' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "09e610a8-408a-4119-a21b-c4de2810a538"}]: dispatch 2023-07-14T18:10:11.523 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:10:11 smithi172 ceph-mon[97983]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "09e610a8-408a-4119-a21b-c4de2810a538"}]: dispatch 2023-07-14T18:10:11.523 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:10:11 smithi172 ceph-mon[97983]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "09e610a8-408a-4119-a21b-c4de2810a538"}]': finished 2023-07-14T18:10:11.524 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:10:11 smithi172 ceph-mon[97983]: osdmap e72: 12 total, 11 up, 12 in 2023-07-14T18:10:11.524 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:10:11 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-07-14T18:10:11.672 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:10:11 smithi184 ceph-mon[98481]: osdmap e71: 11 total, 11 up, 11 in 2023-07-14T18:10:11.672 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:10:11 smithi184 ceph-mon[98481]: from='client.? 172.21.15.184:0/3077724872' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "09e610a8-408a-4119-a21b-c4de2810a538"}]: dispatch 2023-07-14T18:10:11.672 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:10:11 smithi184 ceph-mon[98481]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "09e610a8-408a-4119-a21b-c4de2810a538"}]: dispatch 2023-07-14T18:10:11.672 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:10:11 smithi184 ceph-mon[98481]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "09e610a8-408a-4119-a21b-c4de2810a538"}]': finished 2023-07-14T18:10:11.673 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:10:11 smithi184 ceph-mon[98481]: osdmap e72: 12 total, 11 up, 12 in 2023-07-14T18:10:11.673 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:10:11 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-07-14T18:10:12.464 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:10:12 smithi163 ceph-mon[96576]: from='client.? 172.21.15.184:0/3484162773' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-07-14T18:10:12.465 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:10:12 smithi163 ceph-mon[96576]: pgmap v210: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 300 MiB used, 983 GiB / 983 GiB avail; 144 KiB/s, 0 objects/s recovering 2023-07-14T18:10:12.523 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:10:12 smithi172 ceph-mon[97983]: from='client.? 172.21.15.184:0/3484162773' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-07-14T18:10:12.523 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:10:12 smithi172 ceph-mon[97983]: pgmap v210: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 300 MiB used, 983 GiB / 983 GiB avail; 144 KiB/s, 0 objects/s recovering 2023-07-14T18:10:12.672 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:10:12 smithi184 ceph-mon[98481]: from='client.? 172.21.15.184:0/3484162773' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-07-14T18:10:12.672 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:10:12 smithi184 ceph-mon[98481]: pgmap v210: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 300 MiB used, 983 GiB / 983 GiB avail; 144 KiB/s, 0 objects/s recovering 2023-07-14T18:10:14.773 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:10:14 smithi172 ceph-mon[97983]: pgmap v211: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 300 MiB used, 983 GiB / 983 GiB avail; 110 KiB/s, 0 objects/s recovering 2023-07-14T18:10:14.826 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:10:14 smithi184 ceph-mon[98481]: pgmap v211: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 300 MiB used, 983 GiB / 983 GiB avail; 110 KiB/s, 0 objects/s recovering 2023-07-14T18:10:14.964 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:10:14 smithi163 ceph-mon[96576]: pgmap v211: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 300 MiB used, 983 GiB / 983 GiB avail; 110 KiB/s, 0 objects/s recovering 2023-07-14T18:10:15.714 INFO:journalctl@ceph.mgr.x.smithi163.stdout:Jul 14 18:10:15 smithi163 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-mgr-x[96818]: 2023-07-14T18:10:15.362+0000 7fdf56494700 -1 calc_pg_upmaps abort due to max <= 0 2023-07-14T18:10:17.052 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:10:16 smithi184 ceph-mon[98481]: pgmap v212: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 983 GiB / 983 GiB avail; 92 KiB/s, 0 objects/s recovering 2023-07-14T18:10:17.214 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:10:16 smithi163 ceph-mon[96576]: pgmap v212: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 983 GiB / 983 GiB avail; 92 KiB/s, 0 objects/s recovering 2023-07-14T18:10:17.273 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:10:16 smithi172 ceph-mon[97983]: pgmap v212: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 983 GiB / 983 GiB avail; 92 KiB/s, 0 objects/s recovering 2023-07-14T18:10:18.030 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:10:17 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2023-07-14T18:10:18.031 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:10:17 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T18:10:18.214 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:10:17 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2023-07-14T18:10:18.215 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:10:17 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T18:10:18.273 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:10:17 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2023-07-14T18:10:18.273 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:10:17 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T18:10:18.894 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:10:18 smithi184 ceph-mon[98481]: Deploying daemon osd.11 on smithi184 2023-07-14T18:10:18.894 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:10:18 smithi184 ceph-mon[98481]: pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 983 GiB / 983 GiB avail; 72 KiB/s, 0 objects/s recovering 2023-07-14T18:10:19.214 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:10:18 smithi163 ceph-mon[96576]: Deploying daemon osd.11 on smithi184 2023-07-14T18:10:19.215 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:10:18 smithi163 ceph-mon[96576]: pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 983 GiB / 983 GiB avail; 72 KiB/s, 0 objects/s recovering 2023-07-14T18:10:19.273 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:10:18 smithi172 ceph-mon[97983]: Deploying daemon osd.11 on smithi184 2023-07-14T18:10:19.273 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:10:18 smithi172 ceph-mon[97983]: pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 983 GiB / 983 GiB avail; 72 KiB/s, 0 objects/s recovering 2023-07-14T18:10:20.923 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:10:20 smithi184 ceph-mon[98481]: pgmap v214: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 983 GiB / 983 GiB avail 2023-07-14T18:10:21.215 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:10:20 smithi163 ceph-mon[96576]: pgmap v214: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 983 GiB / 983 GiB avail 2023-07-14T18:10:21.273 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:10:20 smithi172 ceph-mon[97983]: pgmap v214: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 983 GiB / 983 GiB avail 2023-07-14T18:10:22.672 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:10:22 smithi184 ceph-mon[98481]: pgmap v215: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 983 GiB / 983 GiB avail 2023-07-14T18:10:22.673 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:10:22 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:10:22.673 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:10:22 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:10:22.673 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:10:22 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-14T18:10:22.965 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:10:22 smithi163 ceph-mon[96576]: pgmap v215: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 983 GiB / 983 GiB avail 2023-07-14T18:10:22.965 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:10:22 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:10:22.965 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:10:22 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:10:22.965 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:10:22 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-14T18:10:23.023 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:10:22 smithi172 ceph-mon[97983]: pgmap v215: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 983 GiB / 983 GiB avail 2023-07-14T18:10:23.024 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:10:22 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:10:23.024 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:10:22 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:10:23.024 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:10:22 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-14T18:10:24.348 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:10:24.310+0000 7f7bed7fa700 1 -- 172.21.15.184:0/2183049080 <== mgr.14152 v2:172.21.15.163:6800/1949590926 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+38 (secure 0 0 0) 0x7f7bf0060a80 con 0x7f7bdc0a11d0 2023-07-14T18:10:24.349 INFO:teuthology.orchestra.run.smithi184.stdout:Created osd(s) 11 on host 'smithi184' 2023-07-14T18:10:24.350 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:10:24.312+0000 7f7bf67fd700 1 -- 172.21.15.184:0/2183049080 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f7bdc0a11d0 msgr2=0x7f7bdc0a3680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:10:24.351 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:10:24.312+0000 7f7bf67fd700 1 --2- 172.21.15.184:0/2183049080 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f7bdc0a11d0 0x7f7bdc0a3680 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f7be0005950 tx=0x7f7be00058e0 comp rx=0 tx=0).stop 2023-07-14T18:10:24.351 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:10:24.312+0000 7f7bf67fd700 1 -- 172.21.15.184:0/2183049080 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7bf00feeb0 msgr2=0x7f7bf0195970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:10:24.351 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:10:24.312+0000 7f7bf67fd700 1 --2- 172.21.15.184:0/2183049080 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7bf00feeb0 0x7f7bf0195970 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f7bd80059d0 tx=0x7f7bd8004730 comp rx=0 tx=0).stop 2023-07-14T18:10:24.351 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:10:24.312+0000 7f7bf67fd700 1 -- 172.21.15.184:0/2183049080 shutdown_connections 2023-07-14T18:10:24.351 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:10:24.312+0000 7f7bf67fd700 1 --2- 172.21.15.184:0/2183049080 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f7bdc0a11d0 0x7f7bdc0a3680 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:10:24.352 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:10:24.312+0000 7f7bf67fd700 1 --2- 172.21.15.184:0/2183049080 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7bf00feeb0 0x7f7bf0195970 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:10:24.352 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:10:24.312+0000 7f7bf67fd700 1 --2- 172.21.15.184:0/2183049080 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f7bf01002e0 0x7f7bf019cf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:10:24.352 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:10:24.312+0000 7f7bf67fd700 1 --2- 172.21.15.184:0/2183049080 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7bf00ff860 0x7f7bf0195eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:10:24.352 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:10:24.312+0000 7f7bf67fd700 1 -- 172.21.15.184:0/2183049080 >> 172.21.15.184:0/2183049080 conn(0x7f7bf00f99f0 msgr2=0x7f7bf00fbd20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:10:24.352 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:10:24.312+0000 7f7bf67fd700 1 -- 172.21.15.184:0/2183049080 shutdown_connections 2023-07-14T18:10:24.352 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:10:24.312+0000 7f7bf67fd700 1 -- 172.21.15.184:0/2183049080 wait complete. 2023-07-14T18:10:24.754 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:10:24 smithi184 ceph-mon[98481]: pgmap v216: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 983 GiB / 983 GiB avail 2023-07-14T18:10:24.754 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:10:24 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:10:24.755 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:10:24 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:10:24.755 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:10:24 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T18:10:24.755 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:10:24 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-14T18:10:24.755 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:10:24 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:10:24.755 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:10:24 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:10:24.755 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:10:24 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-14T18:10:24.756 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:10:24 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:10:24.757 DEBUG:teuthology.orchestra.run.smithi184:osd.11> sudo journalctl -f -n 0 -u ceph-bf7326ec-2270-11ee-9b33-001a4aab830c@osd.11.service 2023-07-14T18:10:24.759 INFO:tasks.cephadm:Waiting for 12 OSDs to come up... 2023-07-14T18:10:24.759 DEBUG:teuthology.orchestra.run.smithi163:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81c9387d2e7576da065747ec9c16d1c7d69016ec shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bf7326ec-2270-11ee-9b33-001a4aab830c -- ceph osd stat -f json 2023-07-14T18:10:24.792 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:10:24 smithi163 ceph-mon[96576]: pgmap v216: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 983 GiB / 983 GiB avail 2023-07-14T18:10:24.793 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:10:24 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:10:24.793 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:10:24 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:10:24.793 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:10:24 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T18:10:24.793 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:10:24 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-14T18:10:24.793 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:10:24 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:10:24.793 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:10:24 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:10:24.794 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:10:24 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-14T18:10:24.794 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:10:24 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:10:24.795 INFO:journalctl@ceph.osd.11.smithi184.stdout:-- Logs begin at Fri 2023-07-14 17:45:39 UTC. -- 2023-07-14T18:10:25.023 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:10:24 smithi172 ceph-mon[97983]: pgmap v216: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 983 GiB / 983 GiB avail 2023-07-14T18:10:25.023 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:10:24 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:10:25.023 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:10:24 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:10:25.024 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:10:24 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T18:10:25.024 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:10:24 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-14T18:10:25.024 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:10:24 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:10:25.024 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:10:24 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:10:25.024 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:10:24 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-14T18:10:25.024 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:10:24 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:10:25.330 INFO:teuthology.orchestra.run.smithi163.stderr:Inferring config /var/lib/ceph/bf7326ec-2270-11ee-9b33-001a4aab830c/mon.a/config 2023-07-14T18:10:25.716 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:10:25 smithi184 ceph-mon[98481]: from='osd.11 [v2:172.21.15.184:6824/3614578747,v1:172.21.15.184:6825/3614578747]' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2023-07-14T18:10:25.716 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:10:25 smithi184 ceph-mon[98481]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2023-07-14T18:10:25.717 INFO:journalctl@ceph.osd.11.smithi184.stdout:Jul 14 18:10:25 smithi184 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-11[120819]: 2023-07-14T18:10:25.473+0000 7f44ea379640 -1 osd.11 0 log_to_monitors true 2023-07-14T18:10:25.837 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:10:25 smithi163 ceph-mon[96576]: from='osd.11 [v2:172.21.15.184:6824/3614578747,v1:172.21.15.184:6825/3614578747]' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2023-07-14T18:10:25.838 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:10:25 smithi163 ceph-mon[96576]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2023-07-14T18:10:26.023 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:10:25 smithi172 ceph-mon[97983]: from='osd.11 [v2:172.21.15.184:6824/3614578747,v1:172.21.15.184:6825/3614578747]' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2023-07-14T18:10:26.023 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:10:25 smithi172 ceph-mon[97983]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2023-07-14T18:10:26.518 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:26.479+0000 7fce10d8f700 1 -- 172.21.15.163:0/1163311317 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fce0c100820 msgr2=0x7fce0c1070c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:10:26.518 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:26.479+0000 7fce10d8f700 1 --2- 172.21.15.163:0/1163311317 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fce0c100820 0x7fce0c1070c0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fce0400b0a0 tx=0x7fce0400b3b0 comp rx=0 tx=0).stop 2023-07-14T18:10:26.518 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:26.479+0000 7fce10d8f700 1 -- 172.21.15.163:0/1163311317 shutdown_connections 2023-07-14T18:10:26.518 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:26.479+0000 7fce10d8f700 1 --2- 172.21.15.163:0/1163311317 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fce0c0febd0 0x7fce0c0fefe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:10:26.518 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:26.479+0000 7fce10d8f700 1 --2- 172.21.15.163:0/1163311317 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fce0c100820 0x7fce0c1070c0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:10:26.518 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:26.479+0000 7fce10d8f700 1 --2- 172.21.15.163:0/1163311317 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fce0c0ffe70 0x7fce0c1002e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:10:26.519 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:26.479+0000 7fce10d8f700 1 -- 172.21.15.163:0/1163311317 >> 172.21.15.163:0/1163311317 conn(0x7fce0c0fa240 msgr2=0x7fce0c0fc650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:10:26.519 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:26.479+0000 7fce10d8f700 1 -- 172.21.15.163:0/1163311317 shutdown_connections 2023-07-14T18:10:26.519 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:26.479+0000 7fce10d8f700 1 -- 172.21.15.163:0/1163311317 wait complete. 2023-07-14T18:10:26.520 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:26.480+0000 7fce10d8f700 1 Processor -- start 2023-07-14T18:10:26.521 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:26.480+0000 7fce10d8f700 1 -- start start 2023-07-14T18:10:26.521 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:26.480+0000 7fce10d8f700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fce0c0febd0 0x7fce0c069580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:10:26.521 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:26.480+0000 7fce10d8f700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fce0c0ffe70 0x7fce0c19a750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:10:26.521 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:26.480+0000 7fce10d8f700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fce0c100820 0x7fce0c19cd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:10:26.521 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:26.480+0000 7fce10d8f700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce0c19d530 con 0x7fce0c0febd0 2023-07-14T18:10:26.521 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:26.480+0000 7fce10d8f700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce0c19d6a0 con 0x7fce0c100820 2023-07-14T18:10:26.521 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:26.480+0000 7fce10d8f700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce0c19d860 con 0x7fce0c0ffe70 2023-07-14T18:10:26.522 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:26.480+0000 7fce0a59c700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fce0c0febd0 0x7fce0c069580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:10:26.522 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:26.480+0000 7fce0a59c700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fce0c0febd0 0x7fce0c069580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:55348/0 (socket says 172.21.15.163:55348) 2023-07-14T18:10:26.522 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:26.480+0000 7fce0a59c700 1 -- 172.21.15.163:0/1590349452 learned_addr learned my addr 172.21.15.163:0/1590349452 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:10:26.522 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:26.480+0000 7fce09d9b700 1 --2- 172.21.15.163:0/1590349452 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fce0c0ffe70 0x7fce0c19a750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:10:26.522 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:26.480+0000 7fce0ad9d700 1 --2- 172.21.15.163:0/1590349452 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fce0c100820 0x7fce0c19cd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:10:26.522 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:26.480+0000 7fce0a59c700 1 -- 172.21.15.163:0/1590349452 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fce0c0ffe70 msgr2=0x7fce0c19a750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:10:26.522 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:26.480+0000 7fce0a59c700 1 --2- 172.21.15.163:0/1590349452 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fce0c0ffe70 0x7fce0c19a750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:10:26.523 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:26.480+0000 7fce0a59c700 1 -- 172.21.15.163:0/1590349452 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fce0c100820 msgr2=0x7fce0c19cd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:10:26.523 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:26.480+0000 7fce0a59c700 1 --2- 172.21.15.163:0/1590349452 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fce0c100820 0x7fce0c19cd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:10:26.523 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:26.480+0000 7fce0a59c700 1 -- 172.21.15.163:0/1590349452 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce04009d00 con 0x7fce0c0febd0 2023-07-14T18:10:26.523 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:26.480+0000 7fce0ad9d700 1 --2- 172.21.15.163:0/1590349452 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fce0c100820 0x7fce0c19cd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T18:10:26.523 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:26.480+0000 7fce0a59c700 1 --2- 172.21.15.163:0/1590349452 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fce0c0febd0 0x7fce0c069580 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fcdfc00e9a0 tx=0x7fcdfc00ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:10:26.523 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:26.481+0000 7fcdfb7fe700 1 -- 172.21.15.163:0/1590349452 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdfc009790 con 0x7fce0c0febd0 2023-07-14T18:10:26.523 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:26.481+0000 7fcdfb7fe700 1 -- 172.21.15.163:0/1590349452 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fcdfc00cbd0 con 0x7fce0c0febd0 2023-07-14T18:10:26.523 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:26.481+0000 7fce10d8f700 1 -- 172.21.15.163:0/1590349452 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fce0c19db40 con 0x7fce0c0febd0 2023-07-14T18:10:26.524 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:26.481+0000 7fcdfb7fe700 1 -- 172.21.15.163:0/1590349452 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdfc018680 con 0x7fce0c0febd0 2023-07-14T18:10:26.524 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:26.481+0000 7fce10d8f700 1 -- 172.21.15.163:0/1590349452 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fce0c19e040 con 0x7fce0c0febd0 2023-07-14T18:10:26.524 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:26.482+0000 7fce10d8f700 1 -- 172.21.15.163:0/1590349452 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fce0c10a200 con 0x7fce0c0febd0 2023-07-14T18:10:26.525 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:26.483+0000 7fcdfb7fe700 1 -- 172.21.15.163:0/1590349452 <== mon.0 v2:172.21.15.163:3300/0 4 ==== mgrmap(e 16) v1 ==== 135716+0+0 (secure 0 0 0) 0x7fcdfc00cd40 con 0x7fce0c0febd0 2023-07-14T18:10:26.525 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:26.483+0000 7fcdfb7fe700 1 --2- 172.21.15.163:0/1590349452 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7fcdf40a1150 0x7fcdf40a3600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:10:26.525 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:26.483+0000 7fce09d9b700 1 --2- 172.21.15.163:0/1590349452 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7fcdf40a1150 0x7fcdf40a3600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:10:26.525 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:26.483+0000 7fcdfb7fe700 1 -- 172.21.15.163:0/1590349452 <== mon.0 v2:172.21.15.163:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 6831+0+0 (secure 0 0 0) 0x7fcdfc014070 con 0x7fce0c0febd0 2023-07-14T18:10:26.525 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:26.484+0000 7fce09d9b700 1 --2- 172.21.15.163:0/1590349452 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7fcdf40a1150 0x7fcdf40a3600 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fce0c069b00 tx=0x7fce0000b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:10:26.526 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:26.487+0000 7fcdfb7fe700 1 -- 172.21.15.163:0/1590349452 <== mon.0 v2:172.21.15.163:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178025 (secure 0 0 0) 0x7fcdfc096660 con 0x7fce0c0febd0 2023-07-14T18:10:26.714 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:26.675+0000 7fce10d8f700 1 -- 172.21.15.163:0/1590349452 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) v1 -- 0x7fce0c105c10 con 0x7fce0c0febd0 2023-07-14T18:10:26.714 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:26.675+0000 7fcdfb7fe700 1 -- 172.21.15.163:0/1590349452 <== mon.0 v2:172.21.15.163:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v74) v1 ==== 74+0+133 (secure 0 0 0) 0x7fcdfc099c80 con 0x7fce0c0febd0 2023-07-14T18:10:26.715 INFO:teuthology.orchestra.run.smithi163.stdout: 2023-07-14T18:10:26.715 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:10:26 smithi163 ceph-mon[96576]: pgmap v217: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 983 GiB / 983 GiB avail 2023-07-14T18:10:26.715 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:10:26 smithi163 ceph-mon[96576]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2023-07-14T18:10:26.715 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:10:26 smithi163 ceph-mon[96576]: osdmap e73: 12 total, 11 up, 12 in 2023-07-14T18:10:26.715 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:10:26 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-07-14T18:10:26.715 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:10:26 smithi163 ceph-mon[96576]: from='osd.11 [v2:172.21.15.184:6824/3614578747,v1:172.21.15.184:6825/3614578747]' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi184", "root=default"]}]: dispatch 2023-07-14T18:10:26.716 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:10:26 smithi163 ceph-mon[96576]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi184", "root=default"]}]: dispatch 2023-07-14T18:10:26.716 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:26.678+0000 7fce10d8f700 1 -- 172.21.15.163:0/1590349452 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7fcdf40a1150 msgr2=0x7fcdf40a3600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:10:26.717 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:26.678+0000 7fce10d8f700 1 --2- 172.21.15.163:0/1590349452 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7fcdf40a1150 0x7fcdf40a3600 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fce0c069b00 tx=0x7fce0000b410 comp rx=0 tx=0).stop 2023-07-14T18:10:26.717 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:26.678+0000 7fce10d8f700 1 -- 172.21.15.163:0/1590349452 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fce0c0febd0 msgr2=0x7fce0c069580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:10:26.717 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:26.678+0000 7fce10d8f700 1 --2- 172.21.15.163:0/1590349452 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fce0c0febd0 0x7fce0c069580 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fcdfc00e9a0 tx=0x7fcdfc00ecb0 comp rx=0 tx=0).stop 2023-07-14T18:10:26.717 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:26.678+0000 7fce10d8f700 1 -- 172.21.15.163:0/1590349452 shutdown_connections 2023-07-14T18:10:26.717 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:26.678+0000 7fce10d8f700 1 --2- 172.21.15.163:0/1590349452 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7fcdf40a1150 0x7fcdf40a3600 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:10:26.717 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:26.678+0000 7fce10d8f700 1 --2- 172.21.15.163:0/1590349452 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fce0c100820 0x7fce0c19cd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:10:26.717 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:26.678+0000 7fce10d8f700 1 --2- 172.21.15.163:0/1590349452 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fce0c0febd0 0x7fce0c069580 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:10:26.718 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:26.678+0000 7fce10d8f700 1 --2- 172.21.15.163:0/1590349452 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fce0c0ffe70 0x7fce0c19a750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:10:26.718 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:26.678+0000 7fce10d8f700 1 -- 172.21.15.163:0/1590349452 >> 172.21.15.163:0/1590349452 conn(0x7fce0c0fa240 msgr2=0x7fce0c0fc4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:10:26.718 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:26.678+0000 7fce10d8f700 1 -- 172.21.15.163:0/1590349452 shutdown_connections 2023-07-14T18:10:26.718 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:26.678+0000 7fce10d8f700 1 -- 172.21.15.163:0/1590349452 wait complete. 2023-07-14T18:10:26.919 INFO:journalctl@ceph.osd.11.smithi184.stdout:Jul 14 18:10:26 smithi184 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-11[120819]: 2023-07-14T18:10:26.519+0000 7f44df9f1700 -1 osd.11 0 waiting for initial osdmap 2023-07-14T18:10:26.920 INFO:journalctl@ceph.osd.11.smithi184.stdout:Jul 14 18:10:26 smithi184 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-11[120819]: 2023-07-14T18:10:26.530+0000 7f44da7e5700 -1 osd.11 74 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-07-14T18:10:26.920 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:10:26 smithi184 ceph-mon[98481]: pgmap v217: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 983 GiB / 983 GiB avail 2023-07-14T18:10:26.920 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:10:26 smithi184 ceph-mon[98481]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2023-07-14T18:10:26.920 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:10:26 smithi184 ceph-mon[98481]: osdmap e73: 12 total, 11 up, 12 in 2023-07-14T18:10:26.921 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:10:26 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-07-14T18:10:26.921 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:10:26 smithi184 ceph-mon[98481]: from='osd.11 [v2:172.21.15.184:6824/3614578747,v1:172.21.15.184:6825/3614578747]' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi184", "root=default"]}]: dispatch 2023-07-14T18:10:26.921 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:10:26 smithi184 ceph-mon[98481]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi184", "root=default"]}]: dispatch 2023-07-14T18:10:27.023 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:10:26 smithi172 ceph-mon[97983]: pgmap v217: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 983 GiB / 983 GiB avail 2023-07-14T18:10:27.023 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:10:26 smithi172 ceph-mon[97983]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2023-07-14T18:10:27.023 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:10:26 smithi172 ceph-mon[97983]: osdmap e73: 12 total, 11 up, 12 in 2023-07-14T18:10:27.024 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:10:26 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-07-14T18:10:27.024 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:10:26 smithi172 ceph-mon[97983]: from='osd.11 [v2:172.21.15.184:6824/3614578747,v1:172.21.15.184:6825/3614578747]' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi184", "root=default"]}]: dispatch 2023-07-14T18:10:27.024 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:10:26 smithi172 ceph-mon[97983]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi184", "root=default"]}]: dispatch 2023-07-14T18:10:27.182 INFO:teuthology.orchestra.run.smithi163.stdout:{"epoch":74,"num_osds":12,"num_up_osds":11,"osd_up_since":1689358207,"num_in_osds":12,"osd_in_since":1689358210,"num_remapped_pgs":0} 2023-07-14T18:10:27.922 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:10:27 smithi184 ceph-mon[98481]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi184", "root=default"]}]': finished 2023-07-14T18:10:27.923 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:10:27 smithi184 ceph-mon[98481]: osdmap e74: 12 total, 11 up, 12 in 2023-07-14T18:10:27.923 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:10:27 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-07-14T18:10:27.923 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:10:27 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-07-14T18:10:27.923 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:10:27 smithi184 ceph-mon[98481]: from='client.? 172.21.15.163:0/1590349452' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-14T18:10:27.924 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:10:27 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:10:27.924 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:10:27 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:10:27.924 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:10:27 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-07-14T18:10:27.924 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:10:27 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-07-14T18:10:27.924 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:10:27 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-07-14T18:10:27.924 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:10:27 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-07-14T18:10:27.925 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:10:27 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:10:27.925 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:10:27 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T18:10:27.925 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:10:27 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-14T18:10:27.925 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:10:27 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:10:27.965 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:10:27 smithi163 ceph-mon[96576]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi184", "root=default"]}]': finished 2023-07-14T18:10:27.965 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:10:27 smithi163 ceph-mon[96576]: osdmap e74: 12 total, 11 up, 12 in 2023-07-14T18:10:27.965 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:10:27 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-07-14T18:10:27.965 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:10:27 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-07-14T18:10:27.966 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:10:27 smithi163 ceph-mon[96576]: from='client.? 172.21.15.163:0/1590349452' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-14T18:10:27.966 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:10:27 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:10:27.966 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:10:27 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:10:27.966 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:10:27 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-07-14T18:10:27.966 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:10:27 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-07-14T18:10:27.966 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:10:27 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-07-14T18:10:27.966 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:10:27 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-07-14T18:10:27.967 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:10:27 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:10:27.967 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:10:27 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T18:10:27.967 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:10:27 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-14T18:10:27.967 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:10:27 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:10:28.023 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:10:27 smithi172 ceph-mon[97983]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi184", "root=default"]}]': finished 2023-07-14T18:10:28.023 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:10:27 smithi172 ceph-mon[97983]: osdmap e74: 12 total, 11 up, 12 in 2023-07-14T18:10:28.024 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:10:27 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-07-14T18:10:28.024 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:10:27 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-07-14T18:10:28.024 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:10:27 smithi172 ceph-mon[97983]: from='client.? 172.21.15.163:0/1590349452' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-14T18:10:28.024 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:10:27 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:10:28.024 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:10:27 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:10:28.024 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:10:27 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-07-14T18:10:28.025 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:10:27 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-07-14T18:10:28.025 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:10:27 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-07-14T18:10:28.025 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:10:27 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-07-14T18:10:28.025 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:10:27 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:10:28.026 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:10:27 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T18:10:28.026 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:10:27 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-14T18:10:28.026 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:10:27 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:10:28.184 DEBUG:teuthology.orchestra.run.smithi163:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81c9387d2e7576da065747ec9c16d1c7d69016ec shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bf7326ec-2270-11ee-9b33-001a4aab830c -- ceph osd stat -f json 2023-07-14T18:10:28.750 INFO:teuthology.orchestra.run.smithi163.stderr:Inferring config /var/lib/ceph/bf7326ec-2270-11ee-9b33-001a4aab830c/mon.a/config 2023-07-14T18:10:28.922 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:10:28 smithi184 ceph-mon[98481]: purged_snaps scrub starts 2023-07-14T18:10:28.923 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:10:28 smithi184 ceph-mon[98481]: purged_snaps scrub ok 2023-07-14T18:10:28.923 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:10:28 smithi184 ceph-mon[98481]: Detected new or changed devices on smithi184 2023-07-14T18:10:28.923 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:10:28 smithi184 ceph-mon[98481]: Adjusting osd_memory_target on smithi184 to 4292M 2023-07-14T18:10:28.923 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:10:28 smithi184 ceph-mon[98481]: pgmap v220: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 983 GiB / 983 GiB avail 2023-07-14T18:10:28.923 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:10:28 smithi184 ceph-mon[98481]: osd.11 [v2:172.21.15.184:6824/3614578747,v1:172.21.15.184:6825/3614578747] boot 2023-07-14T18:10:28.923 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:10:28 smithi184 ceph-mon[98481]: osdmap e75: 12 total, 12 up, 12 in 2023-07-14T18:10:28.924 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:10:28 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-07-14T18:10:28.959 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:10:28 smithi163 ceph-mon[96576]: purged_snaps scrub starts 2023-07-14T18:10:28.959 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:10:28 smithi163 ceph-mon[96576]: purged_snaps scrub ok 2023-07-14T18:10:28.960 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:10:28 smithi163 ceph-mon[96576]: Detected new or changed devices on smithi184 2023-07-14T18:10:28.960 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:10:28 smithi163 ceph-mon[96576]: Adjusting osd_memory_target on smithi184 to 4292M 2023-07-14T18:10:28.960 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:10:28 smithi163 ceph-mon[96576]: pgmap v220: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 983 GiB / 983 GiB avail 2023-07-14T18:10:28.960 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:10:28 smithi163 ceph-mon[96576]: osd.11 [v2:172.21.15.184:6824/3614578747,v1:172.21.15.184:6825/3614578747] boot 2023-07-14T18:10:28.960 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:10:28 smithi163 ceph-mon[96576]: osdmap e75: 12 total, 12 up, 12 in 2023-07-14T18:10:28.960 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:10:28 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-07-14T18:10:29.023 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:10:28 smithi172 ceph-mon[97983]: purged_snaps scrub starts 2023-07-14T18:10:29.024 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:10:28 smithi172 ceph-mon[97983]: purged_snaps scrub ok 2023-07-14T18:10:29.024 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:10:28 smithi172 ceph-mon[97983]: Detected new or changed devices on smithi184 2023-07-14T18:10:29.024 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:10:28 smithi172 ceph-mon[97983]: Adjusting osd_memory_target on smithi184 to 4292M 2023-07-14T18:10:29.024 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:10:28 smithi172 ceph-mon[97983]: pgmap v220: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 983 GiB / 983 GiB avail 2023-07-14T18:10:29.024 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:10:28 smithi172 ceph-mon[97983]: osd.11 [v2:172.21.15.184:6824/3614578747,v1:172.21.15.184:6825/3614578747] boot 2023-07-14T18:10:29.024 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:10:28 smithi172 ceph-mon[97983]: osdmap e75: 12 total, 12 up, 12 in 2023-07-14T18:10:29.025 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:10:28 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-07-14T18:10:29.966 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:29.926+0000 7f5ff6870700 1 -- 172.21.15.163:0/695066677 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f5ff00febb0 msgr2=0x7f5ff00fefc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:10:29.967 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:29.926+0000 7f5ff6870700 1 --2- 172.21.15.163:0/695066677 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f5ff00febb0 0x7f5ff00fefc0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f5fe0009990 tx=0x7f5fe0009ca0 comp rx=0 tx=0).stop 2023-07-14T18:10:29.967 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:29.926+0000 7f5ff6870700 1 -- 172.21.15.163:0/695066677 shutdown_connections 2023-07-14T18:10:29.967 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:29.926+0000 7f5ff6870700 1 --2- 172.21.15.163:0/695066677 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5ff0100740 0x7f5ff0107000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:10:29.967 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:29.926+0000 7f5ff6870700 1 --2- 172.21.15.163:0/695066677 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f5ff00febb0 0x7f5ff00fefc0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:10:29.967 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:29.926+0000 7f5ff6870700 1 --2- 172.21.15.163:0/695066677 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5ff00ffdb0 0x7f5ff0100200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:10:29.967 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:29.926+0000 7f5ff6870700 1 -- 172.21.15.163:0/695066677 >> 172.21.15.163:0/695066677 conn(0x7f5ff00fa1e0 msgr2=0x7f5ff00fc630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:10:29.967 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:29.926+0000 7f5ff6870700 1 -- 172.21.15.163:0/695066677 shutdown_connections 2023-07-14T18:10:29.968 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:29.926+0000 7f5ff6870700 1 -- 172.21.15.163:0/695066677 wait complete. 2023-07-14T18:10:29.968 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:29.927+0000 7f5ff6870700 1 Processor -- start 2023-07-14T18:10:29.968 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:29.927+0000 7f5ff6870700 1 -- start start 2023-07-14T18:10:29.968 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:29.927+0000 7f5ff6870700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f5ff00febb0 0x7f5ff0194810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:10:29.968 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:29.927+0000 7f5ff6870700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5ff00ffdb0 0x7f5ff0194d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:10:29.968 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:29.927+0000 7f5ff6870700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5ff0100740 0x7f5ff019bdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:10:29.968 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:29.927+0000 7f5ff6870700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ff019c3a0 con 0x7f5ff00febb0 2023-07-14T18:10:29.969 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:29.927+0000 7f5ff6870700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ff019c4e0 con 0x7f5ff00ffdb0 2023-07-14T18:10:29.969 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:29.927+0000 7f5ff6870700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ff019c670 con 0x7f5ff0100740 2023-07-14T18:10:29.969 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:29.927+0000 7f5feffff700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f5ff00febb0 0x7f5ff0194810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:10:29.969 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:29.927+0000 7f5feffff700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f5ff00febb0 0x7f5ff0194810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:55368/0 (socket says 172.21.15.163:55368) 2023-07-14T18:10:29.969 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:29.927+0000 7f5feffff700 1 -- 172.21.15.163:0/3433282845 learned_addr learned my addr 172.21.15.163:0/3433282845 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:10:29.969 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:29.928+0000 7f5fef7fe700 1 --2- 172.21.15.163:0/3433282845 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5ff00ffdb0 0x7f5ff0194d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:10:29.969 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:29.928+0000 7f5ff4e0d700 1 --2- 172.21.15.163:0/3433282845 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5ff0100740 0x7f5ff019bdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:10:29.970 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:29.928+0000 7f5feffff700 1 -- 172.21.15.163:0/3433282845 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5ff0100740 msgr2=0x7f5ff019bdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:10:29.970 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:29.928+0000 7f5feffff700 1 --2- 172.21.15.163:0/3433282845 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5ff0100740 0x7f5ff019bdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:10:29.970 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:29.928+0000 7f5feffff700 1 -- 172.21.15.163:0/3433282845 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5ff00ffdb0 msgr2=0x7f5ff0194d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:10:29.970 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:29.928+0000 7f5feffff700 1 --2- 172.21.15.163:0/3433282845 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5ff00ffdb0 0x7f5ff0194d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:10:29.970 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:29.928+0000 7f5feffff700 1 -- 172.21.15.163:0/3433282845 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5fe00095f0 con 0x7f5ff00febb0 2023-07-14T18:10:29.970 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:29.928+0000 7f5ff4e0d700 1 --2- 172.21.15.163:0/3433282845 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5ff0100740 0x7f5ff019bdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T18:10:29.970 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:29.928+0000 7f5feffff700 1 --2- 172.21.15.163:0/3433282845 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f5ff00febb0 0x7f5ff0194810 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f5fe0004730 tx=0x7f5fe0004760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:10:29.970 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:29.928+0000 7f5fed7fa700 1 -- 172.21.15.163:0/3433282845 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fe001d070 con 0x7f5ff00febb0 2023-07-14T18:10:29.971 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:29.928+0000 7f5ff6870700 1 -- 172.21.15.163:0/3433282845 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ff019c8f0 con 0x7f5ff00febb0 2023-07-14T18:10:29.972 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:29.928+0000 7f5fed7fa700 1 -- 172.21.15.163:0/3433282845 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f5fe00054c0 con 0x7f5ff00febb0 2023-07-14T18:10:29.972 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:29.928+0000 7f5fed7fa700 1 -- 172.21.15.163:0/3433282845 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fe0003b30 con 0x7f5ff00febb0 2023-07-14T18:10:29.972 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:29.928+0000 7f5ff6870700 1 -- 172.21.15.163:0/3433282845 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ff019cd60 con 0x7f5ff00febb0 2023-07-14T18:10:29.972 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:29.929+0000 7f5ff6870700 1 -- 172.21.15.163:0/3433282845 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ff010a220 con 0x7f5ff00febb0 2023-07-14T18:10:29.972 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:29.930+0000 7f5fed7fa700 1 -- 172.21.15.163:0/3433282845 <== mon.0 v2:172.21.15.163:3300/0 4 ==== mgrmap(e 16) v1 ==== 135716+0+0 (secure 0 0 0) 0x7f5fe00047d0 con 0x7f5ff00febb0 2023-07-14T18:10:29.972 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:29.931+0000 7f5fed7fa700 1 --2- 172.21.15.163:0/3433282845 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f5fd80a1150 0x7f5fd80a3600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:10:29.972 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:29.931+0000 7f5fef7fe700 1 --2- 172.21.15.163:0/3433282845 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f5fd80a1150 0x7f5fd80a3600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:10:29.973 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:29.931+0000 7f5fed7fa700 1 -- 172.21.15.163:0/3433282845 <== mon.0 v2:172.21.15.163:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f5fe00cd770 con 0x7f5ff00febb0 2023-07-14T18:10:29.973 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:29.931+0000 7f5fef7fe700 1 --2- 172.21.15.163:0/3433282845 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f5fd80a1150 0x7f5fd80a3600 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f5fe4005950 tx=0x7f5fe400b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:10:29.973 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:29.935+0000 7f5fed7fa700 1 -- 172.21.15.163:0/3433282845 <== mon.0 v2:172.21.15.163:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178025 (secure 0 0 0) 0x7f5fe00973f0 con 0x7f5ff00febb0 2023-07-14T18:10:30.159 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:30.120+0000 7f5ff6870700 1 -- 172.21.15.163:0/3433282845 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) v1 -- 0x7f5ff019d3a0 con 0x7f5ff00febb0 2023-07-14T18:10:30.160 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:30.121+0000 7f5fed7fa700 1 -- 172.21.15.163:0/3433282845 <== mon.0 v2:172.21.15.163:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v76) v1 ==== 74+0+133 (secure 0 0 0) 0x7f5fe009aa10 con 0x7f5ff00febb0 2023-07-14T18:10:30.160 INFO:teuthology.orchestra.run.smithi163.stdout: 2023-07-14T18:10:30.162 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:30.123+0000 7f5ff6870700 1 -- 172.21.15.163:0/3433282845 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f5fd80a1150 msgr2=0x7f5fd80a3600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:10:30.162 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:30.123+0000 7f5ff6870700 1 --2- 172.21.15.163:0/3433282845 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f5fd80a1150 0x7f5fd80a3600 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f5fe4005950 tx=0x7f5fe400b410 comp rx=0 tx=0).stop 2023-07-14T18:10:30.162 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:30.123+0000 7f5ff6870700 1 -- 172.21.15.163:0/3433282845 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f5ff00febb0 msgr2=0x7f5ff0194810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:10:30.162 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:30.123+0000 7f5ff6870700 1 --2- 172.21.15.163:0/3433282845 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f5ff00febb0 0x7f5ff0194810 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f5fe0004730 tx=0x7f5fe0004760 comp rx=0 tx=0).stop 2023-07-14T18:10:30.162 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:30.123+0000 7f5ff6870700 1 -- 172.21.15.163:0/3433282845 shutdown_connections 2023-07-14T18:10:30.163 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:30.123+0000 7f5ff6870700 1 --2- 172.21.15.163:0/3433282845 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f5fd80a1150 0x7f5fd80a3600 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:10:30.163 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:30.123+0000 7f5ff6870700 1 --2- 172.21.15.163:0/3433282845 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5ff0100740 0x7f5ff019bdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:10:30.163 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:30.123+0000 7f5ff6870700 1 --2- 172.21.15.163:0/3433282845 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f5ff00febb0 0x7f5ff0194810 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:10:30.163 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:30.123+0000 7f5ff6870700 1 --2- 172.21.15.163:0/3433282845 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5ff00ffdb0 0x7f5ff0194d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:10:30.163 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:30.123+0000 7f5ff6870700 1 -- 172.21.15.163:0/3433282845 >> 172.21.15.163:0/3433282845 conn(0x7f5ff00fa1e0 msgr2=0x7f5ff00fc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:10:30.163 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:30.123+0000 7f5ff6870700 1 -- 172.21.15.163:0/3433282845 shutdown_connections 2023-07-14T18:10:30.163 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:30.123+0000 7f5ff6870700 1 -- 172.21.15.163:0/3433282845 wait complete. 2023-07-14T18:10:30.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:10:30 smithi184 ceph-mon[98481]: osdmap e76: 12 total, 12 up, 12 in 2023-07-14T18:10:30.423 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:10:30 smithi184 ceph-mon[98481]: pgmap v223: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-07-14T18:10:30.465 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:10:30 smithi163 ceph-mon[96576]: osdmap e76: 12 total, 12 up, 12 in 2023-07-14T18:10:30.465 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:10:30 smithi163 ceph-mon[96576]: pgmap v223: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-07-14T18:10:30.523 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:10:30 smithi172 ceph-mon[97983]: osdmap e76: 12 total, 12 up, 12 in 2023-07-14T18:10:30.523 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:10:30 smithi172 ceph-mon[97983]: pgmap v223: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-07-14T18:10:30.608 INFO:teuthology.orchestra.run.smithi163.stdout:{"epoch":76,"num_osds":12,"num_up_osds":12,"osd_up_since":1689358227,"num_in_osds":12,"osd_in_since":1689358210,"num_remapped_pgs":0} 2023-07-14T18:10:30.609 DEBUG:teuthology.orchestra.run.smithi163:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81c9387d2e7576da065747ec9c16d1c7d69016ec shell --fsid bf7326ec-2270-11ee-9b33-001a4aab830c -- ceph osd dump --format=json 2023-07-14T18:10:31.165 INFO:teuthology.orchestra.run.smithi163.stderr:Inferring config /var/lib/ceph/bf7326ec-2270-11ee-9b33-001a4aab830c/mon.a/config 2023-07-14T18:10:31.367 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:10:31 smithi163 ceph-mon[96576]: from='client.? 172.21.15.163:0/3433282845' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-14T18:10:31.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:10:31 smithi184 ceph-mon[98481]: from='client.? 172.21.15.163:0/3433282845' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-14T18:10:31.523 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:10:31 smithi172 ceph-mon[97983]: from='client.? 172.21.15.163:0/3433282845' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-14T18:10:32.370 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:32.330+0000 7f990961d700 1 -- 172.21.15.163:0/3702695313 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f9904109620 msgr2=0x7f990410ba00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:10:32.370 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:32.330+0000 7f990961d700 1 --2- 172.21.15.163:0/3702695313 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f9904109620 0x7f990410ba00 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f98fc00b0a0 tx=0x7f98fc00b3b0 comp rx=0 tx=0).stop 2023-07-14T18:10:32.370 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:32.331+0000 7f990961d700 1 -- 172.21.15.163:0/3702695313 shutdown_connections 2023-07-14T18:10:32.371 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:32.331+0000 7f990961d700 1 --2- 172.21.15.163:0/3702695313 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9904100070 0x7f9904100440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:10:32.371 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:32.331+0000 7f990961d700 1 --2- 172.21.15.163:0/3702695313 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f9904109620 0x7f990410ba00 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:10:32.371 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:32.331+0000 7f990961d700 1 --2- 172.21.15.163:0/3702695313 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9904100980 0x7f99041090e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:10:32.371 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:32.331+0000 7f990961d700 1 -- 172.21.15.163:0/3702695313 >> 172.21.15.163:0/3702695313 conn(0x7f9904074550 msgr2=0x7f9904074950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:10:32.371 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:32.331+0000 7f990961d700 1 -- 172.21.15.163:0/3702695313 shutdown_connections 2023-07-14T18:10:32.371 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:32.331+0000 7f990961d700 1 -- 172.21.15.163:0/3702695313 wait complete. 2023-07-14T18:10:32.371 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:32.331+0000 7f990961d700 1 Processor -- start 2023-07-14T18:10:32.372 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:32.331+0000 7f990961d700 1 -- start start 2023-07-14T18:10:32.372 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:32.332+0000 7f990961d700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9904100070 0x7f990419aa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:10:32.372 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:32.332+0000 7f990961d700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f9904100980 0x7f990419af60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:10:32.372 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:32.332+0000 7f990961d700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9904109620 0x7f9904194aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:10:32.372 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:32.332+0000 7f990961d700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9904195110 con 0x7f9904100980 2023-07-14T18:10:32.372 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:32.332+0000 7f990961d700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9904195280 con 0x7f9904100070 2023-07-14T18:10:32.372 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:32.332+0000 7f990961d700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9904195440 con 0x7f9904109620 2023-07-14T18:10:32.373 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:32.332+0000 7f99027fc700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f9904100980 0x7f990419af60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:10:32.373 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:32.332+0000 7f9902ffd700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9904100070 0x7f990419aa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:10:32.373 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:32.332+0000 7f99027fc700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f9904100980 0x7f990419af60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:55382/0 (socket says 172.21.15.163:55382) 2023-07-14T18:10:32.373 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:32.332+0000 7f99027fc700 1 -- 172.21.15.163:0/3608131476 learned_addr learned my addr 172.21.15.163:0/3608131476 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:10:32.373 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:32.332+0000 7f99037fe700 1 --2- 172.21.15.163:0/3608131476 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9904109620 0x7f9904194aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:10:32.373 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:32.332+0000 7f99027fc700 1 -- 172.21.15.163:0/3608131476 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9904109620 msgr2=0x7f9904194aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:10:32.373 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:32.332+0000 7f99027fc700 1 --2- 172.21.15.163:0/3608131476 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9904109620 0x7f9904194aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:10:32.373 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:32.332+0000 7f99027fc700 1 -- 172.21.15.163:0/3608131476 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9904100070 msgr2=0x7f990419aa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:10:32.374 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:32.332+0000 7f99027fc700 1 --2- 172.21.15.163:0/3608131476 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9904100070 0x7f990419aa20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:10:32.374 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:32.332+0000 7f99027fc700 1 -- 172.21.15.163:0/3608131476 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98fc009d00 con 0x7f9904100980 2023-07-14T18:10:32.374 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:32.332+0000 7f9902ffd700 1 --2- 172.21.15.163:0/3608131476 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9904100070 0x7f990419aa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T18:10:32.374 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:32.332+0000 7f99027fc700 1 --2- 172.21.15.163:0/3608131476 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f9904100980 0x7f990419af60 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f98f800c9b0 tx=0x7f98f800ccc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:10:32.374 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:32.332+0000 7f98ebfff700 1 -- 172.21.15.163:0/3608131476 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98f8007b00 con 0x7f9904100980 2023-07-14T18:10:32.374 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:32.332+0000 7f990961d700 1 -- 172.21.15.163:0/3608131476 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9904195720 con 0x7f9904100980 2023-07-14T18:10:32.375 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:32.332+0000 7f98ebfff700 1 -- 172.21.15.163:0/3608131476 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f98f800ce50 con 0x7f9904100980 2023-07-14T18:10:32.375 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:32.332+0000 7f990961d700 1 -- 172.21.15.163:0/3608131476 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99041a1a10 con 0x7f9904100980 2023-07-14T18:10:32.375 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:32.332+0000 7f98ebfff700 1 -- 172.21.15.163:0/3608131476 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98f8018400 con 0x7f9904100980 2023-07-14T18:10:32.376 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:32.333+0000 7f990961d700 1 -- 172.21.15.163:0/3608131476 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9904103f10 con 0x7f9904100980 2023-07-14T18:10:32.376 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:32.334+0000 7f98ebfff700 1 -- 172.21.15.163:0/3608131476 <== mon.0 v2:172.21.15.163:3300/0 4 ==== mgrmap(e 16) v1 ==== 135716+0+0 (secure 0 0 0) 0x7f98f800f450 con 0x7f9904100980 2023-07-14T18:10:32.376 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:32.335+0000 7f98ebfff700 1 --2- 172.21.15.163:0/3608131476 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f98ec0a1150 0x7f98ec0a3600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:10:32.376 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:32.335+0000 7f9902ffd700 1 --2- 172.21.15.163:0/3608131476 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f98ec0a1150 0x7f98ec0a3600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:10:32.376 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:32.335+0000 7f98ebfff700 1 -- 172.21.15.163:0/3608131476 <== mon.0 v2:172.21.15.163:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f98f80cc670 con 0x7f9904100980 2023-07-14T18:10:32.376 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:32.336+0000 7f9902ffd700 1 --2- 172.21.15.163:0/3608131476 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f98ec0a1150 0x7f98ec0a3600 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f98f4005950 tx=0x7f98f400b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:10:32.377 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:32.339+0000 7f98ebfff700 1 -- 172.21.15.163:0/3608131476 <== mon.0 v2:172.21.15.163:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178025 (secure 0 0 0) 0x7f98f80962f0 con 0x7f9904100980 2023-07-14T18:10:32.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:10:32 smithi184 ceph-mon[98481]: pgmap v224: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-07-14T18:10:32.465 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:10:32 smithi163 ceph-mon[96576]: pgmap v224: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-07-14T18:10:32.523 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:10:32 smithi172 ceph-mon[97983]: pgmap v224: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-07-14T18:10:32.565 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:32.527+0000 7f990961d700 1 -- 172.21.15.163:0/3608131476 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f99041038f0 con 0x7f9904100980 2023-07-14T18:10:32.566 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:32.528+0000 7f98ebfff700 1 -- 172.21.15.163:0/3608131476 <== mon.0 v2:172.21.15.163:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v76) v1 ==== 74+0+18492 (secure 0 0 0) 0x7f98f800f700 con 0x7f9904100980 2023-07-14T18:10:32.567 INFO:teuthology.orchestra.run.smithi163.stdout: 2023-07-14T18:10:32.567 INFO:teuthology.orchestra.run.smithi163.stdout:{"epoch":76,"fsid":"bf7326ec-2270-11ee-9b33-001a4aab830c","created":"2023-07-14T18:04:26.263517+0000","modified":"2023-07-14T18:10:29.005628+0000","last_up_change":"2023-07-14T18:10:27.514863+0000","last_in_change":"2023-07-14T18:10:10.726443+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-14T18:07:19.653852+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e6490568-046d-43ef-bb07-d79fb884b276","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6802","nonce":3124653025},{"type":"v1","addr":"172.21.15.163:6803","nonce":3124653025}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6804","nonce":3124653025},{"type":"v1","addr":"172.21.15.163:6805","nonce":3124653025}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6808","nonce":3124653025},{"type":"v1","addr":"172.21.15.163:6809","nonce":3124653025}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6806","nonce":3124653025},{"type":"v1","addr":"172.21.15.163:6807","nonce":3124653025}]},"public_addr":"172.21.15.163:6803/3124653025","cluster_addr":"172.21.15.163:6805/3124653025","heartbeat_back_addr":"172.21.15.163:6809/3124653025","heartbeat_front_addr":"172.21.15.163:6807/3124653025","state":["exists","up"]},{"osd":1,"uuid":"0af39bda-f096-4603-adcc-bf1988f36603","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":3774455900},{"type":"v1","addr":"172.21.15.172:6801","nonce":3774455900}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":3774455900},{"type":"v1","addr":"172.21.15.172:6803","nonce":3774455900}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":3774455900},{"type":"v1","addr":"172.21.15.172:6807","nonce":3774455900}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":3774455900},{"type":"v1","addr":"172.21.15.172:6805","nonce":3774455900}]},"public_addr":"172.21.15.172:6801/3774455900","cluster_addr":"172.21.15.172:6803/3774455900","heartbeat_back_addr":"172.21.15.172:6807/3774455900","heartbeat_front_addr":"172.21.15.172:6805/3774455900","state":["exists","up"]},{"osd":2,"uuid":"cc732c13-af0f-4199-98e6-fe960ed4e5dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":1976927678},{"type":"v1","addr":"172.21.15.184:6801","nonce":1976927678}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":1976927678},{"type":"v1","addr":"172.21.15.184:6803","nonce":1976927678}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":1976927678},{"type":"v1","addr":"172.21.15.184:6807","nonce":1976927678}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":1976927678},{"type":"v1","addr":"172.21.15.184:6805","nonce":1976927678}]},"public_addr":"172.21.15.184:6801/1976927678","cluster_addr":"172.21.15.184:6803/1976927678","heartbeat_back_addr":"172.21.15.184:6807/1976927678","heartbeat_front_addr":"172.21.15.184:6805/1976927678","state":["exists","up"]},{"osd":3,"uuid":"dcee9576-0bc6-4ab0-8f63-79eacd0eca5f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6810","nonce":2589130694},{"type":"v1","addr":"172.21.15.163:6811","nonce":2589130694}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6812","nonce":2589130694},{"type":"v1","addr":"172.21.15.163:6813","nonce":2589130694}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6816","nonce":2589130694},{"type":"v1","addr":"172.21.15.163:6817","nonce":2589130694}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6814","nonce":2589130694},{"type":"v1","addr":"172.21.15.163:6815","nonce":2589130694}]},"public_addr":"172.21.15.163:6811/2589130694","cluster_addr":"172.21.15.163:6813/2589130694","heartbeat_back_addr":"172.21.15.163:6817/2589130694","heartbeat_front_addr":"172.21.15.163:6815/2589130694","state":["exists","up"]},{"osd":4,"uuid":"055df823-b8b0-426a-83c2-f0d727932ad8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":3319632614},{"type":"v1","addr":"172.21.15.172:6809","nonce":3319632614}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6810","nonce":3319632614},{"type":"v1","addr":"172.21.15.172:6811","nonce":3319632614}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6814","nonce":3319632614},{"type":"v1","addr":"172.21.15.172:6815","nonce":3319632614}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":3319632614},{"type":"v1","addr":"172.21.15.172:6813","nonce":3319632614}]},"public_addr":"172.21.15.172:6809/3319632614","cluster_addr":"172.21.15.172:6811/3319632614","heartbeat_back_addr":"172.21.15.172:6815/3319632614","heartbeat_front_addr":"172.21.15.172:6813/3319632614","state":["exists","up"]},{"osd":5,"uuid":"ef5ef02a-b4e2-4790-9d27-f6d2247b25c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":2662084043},{"type":"v1","addr":"172.21.15.184:6809","nonce":2662084043}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6810","nonce":2662084043},{"type":"v1","addr":"172.21.15.184:6811","nonce":2662084043}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6814","nonce":2662084043},{"type":"v1","addr":"172.21.15.184:6815","nonce":2662084043}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6812","nonce":2662084043},{"type":"v1","addr":"172.21.15.184:6813","nonce":2662084043}]},"public_addr":"172.21.15.184:6809/2662084043","cluster_addr":"172.21.15.184:6811/2662084043","heartbeat_back_addr":"172.21.15.184:6815/2662084043","heartbeat_front_addr":"172.21.15.184:6813/2662084043","state":["exists","up"]},{"osd":6,"uuid":"dba754be-0fc5-4867-a6d5-cf97eb344f81","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":44,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6818","nonce":2530874117},{"type":"v1","addr":"172.21.15.163:6819","nonce":2530874117}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6820","nonce":2530874117},{"type":"v1","addr":"172.21.15.163:6821","nonce":2530874117}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6824","nonce":2530874117},{"type":"v1","addr":"172.21.15.163:6825","nonce":2530874117}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6822","nonce":2530874117},{"type":"v1","addr":"172.21.15.163:6823","nonce":2530874117}]},"public_addr":"172.21.15.163:6819/2530874117","cluster_addr":"172.21.15.163:6821/2530874117","heartbeat_back_addr":"172.21.15.163:6825/2530874117","heartbeat_front_addr":"172.21.15.163:6823/2530874117","state":["exists","up"]},{"osd":7,"uuid":"edd76e6b-6077-4619-b00d-1e906f70ddcc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":49,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":233511803},{"type":"v1","addr":"172.21.15.172:6817","nonce":233511803}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6818","nonce":233511803},{"type":"v1","addr":"172.21.15.172:6819","nonce":233511803}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":233511803},{"type":"v1","addr":"172.21.15.172:6823","nonce":233511803}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6820","nonce":233511803},{"type":"v1","addr":"172.21.15.172:6821","nonce":233511803}]},"public_addr":"172.21.15.172:6817/233511803","cluster_addr":"172.21.15.172:6819/233511803","heartbeat_back_addr":"172.21.15.172:6823/233511803","heartbeat_front_addr":"172.21.15.172:6821/233511803","state":["exists","up"]},{"osd":8,"uuid":"36559400-f33e-44e6-868a-316d34da457d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":56,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6816","nonce":290154343},{"type":"v1","addr":"172.21.15.184:6817","nonce":290154343}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6818","nonce":290154343},{"type":"v1","addr":"172.21.15.184:6819","nonce":290154343}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6822","nonce":290154343},{"type":"v1","addr":"172.21.15.184:6823","nonce":290154343}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6820","nonce":290154343},{"type":"v1","addr":"172.21.15.184:6821","nonce":290154343}]},"public_addr":"172.21.15.184:6817/290154343","cluster_addr":"172.21.15.184:6819/290154343","heartbeat_back_addr":"172.21.15.184:6823/290154343","heartbeat_front_addr":"172.21.15.184:6821/290154343","state":["exists","up"]},{"osd":9,"uuid":"d484f111-f36c-4c67-9a8a-ae03e7e0d137","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6826","nonce":3848110906},{"type":"v1","addr":"172.21.15.163:6827","nonce":3848110906}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6828","nonce":3848110906},{"type":"v1","addr":"172.21.15.163:6829","nonce":3848110906}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6832","nonce":3848110906},{"type":"v1","addr":"172.21.15.163:6833","nonce":3848110906}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6830","nonce":3848110906},{"type":"v1","addr":"172.21.15.163:6831","nonce":3848110906}]},"public_addr":"172.21.15.163:6827/3848110906","cluster_addr":"172.21.15.163:6829/3848110906","heartbeat_back_addr":"172.21.15.163:6833/3848110906","heartbeat_front_addr":"172.21.15.163:6831/3848110906","state":["exists","up"]},{"osd":10,"uuid":"d943f7c0-da3d-4605-9e23-0231e675c6be","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6824","nonce":3281085356},{"type":"v1","addr":"172.21.15.172:6825","nonce":3281085356}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":3281085356},{"type":"v1","addr":"172.21.15.172:6827","nonce":3281085356}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":3281085356},{"type":"v1","addr":"172.21.15.172:6831","nonce":3281085356}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6828","nonce":3281085356},{"type":"v1","addr":"172.21.15.172:6829","nonce":3281085356}]},"public_addr":"172.21.15.172:6825/3281085356","cluster_addr":"172.21.15.172:6827/3281085356","heartbeat_back_addr":"172.21.15.172:6831/3281085356","heartbeat_front_addr":"172.21.15.172:6829/3281085356","state":["exists","up"]},{"osd":11,"uuid":"09e610a8-408a-4119-a21b-c4de2810a538","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":75,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6824","nonce":3614578747},{"type":"v1","addr":"172.21.15.184:6825","nonce":3614578747}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6826","nonce":3614578747},{"type":"v1","addr":"172.21.15.184:6827","nonce":3614578747}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6830","nonce":3614578747},{"type":"v1","addr":"172.21.15.184:6831","nonce":3614578747}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6828","nonce":3614578747},{"type":"v1","addr":"172.21.15.184:6829","nonce":3614578747}]},"public_addr":"172.21.15.184:6825/3614578747","cluster_addr":"172.21.15.184:6827/3614578747","heartbeat_back_addr":"172.21.15.184:6831/3614578747","heartbeat_front_addr":"172.21.15.184:6829/3614578747","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T18:06:36.067578+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T18:06:57.095120+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T18:07:17.825363+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T18:07:38.977196+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T18:08:00.108709+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T18:08:20.700646+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T18:08:41.473899+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T18:09:02.856536+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T18:09:23.832722+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T18:09:44.860884+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T18:10:05.520678+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T18:10:26.426315+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.163:6801/1086512093":"2023-07-15T18:05:15.331458+0000","172.21.15.163:6800/1086512093":"2023-07-15T18:05:15.331458+0000","172.21.15.163:0/4235784810":"2023-07-15T18:05:15.331458+0000","172.21.15.163:6800/236891232":"2023-07-15T18:04:53.288443+0000","172.21.15.163:6801/236891232":"2023-07-15T18:04:53.288443+0000","172.21.15.163:0/3260193612":"2023-07-15T18:05:15.331458+0000","172.21.15.163:0/3513629472":"2023-07-15T18:04:53.288443+0000","172.21.15.163:0/1090329830":"2023-07-15T18:04:53.288443+0000","172.21.15.163:0/3868922045":"2023-07-15T18:05:15.331458+0000","172.21.15.163:0/2945662447":"2023-07-15T18:04:53.288443+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-14T18:10:32.568 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:32.530+0000 7f990961d700 1 -- 172.21.15.163:0/3608131476 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f98ec0a1150 msgr2=0x7f98ec0a3600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:10:32.568 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:32.530+0000 7f990961d700 1 --2- 172.21.15.163:0/3608131476 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f98ec0a1150 0x7f98ec0a3600 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f98f4005950 tx=0x7f98f400b410 comp rx=0 tx=0).stop 2023-07-14T18:10:32.568 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:32.530+0000 7f990961d700 1 -- 172.21.15.163:0/3608131476 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f9904100980 msgr2=0x7f990419af60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:10:32.568 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:32.530+0000 7f990961d700 1 --2- 172.21.15.163:0/3608131476 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f9904100980 0x7f990419af60 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f98f800c9b0 tx=0x7f98f800ccc0 comp rx=0 tx=0).stop 2023-07-14T18:10:32.569 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:32.530+0000 7f990961d700 1 -- 172.21.15.163:0/3608131476 shutdown_connections 2023-07-14T18:10:32.569 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:32.530+0000 7f990961d700 1 --2- 172.21.15.163:0/3608131476 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f98ec0a1150 0x7f98ec0a3600 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:10:32.569 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:32.530+0000 7f990961d700 1 --2- 172.21.15.163:0/3608131476 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9904109620 0x7f9904194aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:10:32.569 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:32.530+0000 7f990961d700 1 --2- 172.21.15.163:0/3608131476 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9904100070 0x7f990419aa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:10:32.569 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:32.530+0000 7f990961d700 1 --2- 172.21.15.163:0/3608131476 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f9904100980 0x7f990419af60 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:10:32.569 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:32.530+0000 7f990961d700 1 -- 172.21.15.163:0/3608131476 >> 172.21.15.163:0/3608131476 conn(0x7f9904074550 msgr2=0x7f9904101050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:10:32.569 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:32.530+0000 7f990961d700 1 -- 172.21.15.163:0/3608131476 shutdown_connections 2023-07-14T18:10:32.570 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:32.530+0000 7f990961d700 1 -- 172.21.15.163:0/3608131476 wait complete. 2023-07-14T18:10:32.910 INFO:tasks.cephadm.ceph_manager.ceph:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-14T18:07:19.653852+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-14T18:10:32.911 DEBUG:teuthology.orchestra.run.smithi163:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81c9387d2e7576da065747ec9c16d1c7d69016ec shell --fsid bf7326ec-2270-11ee-9b33-001a4aab830c -- ceph osd pool get .mgr pg_num 2023-07-14T18:10:33.215 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:10:33 smithi163 ceph-mon[96576]: from='client.? 172.21.15.163:0/3608131476' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-07-14T18:10:33.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:10:33 smithi184 ceph-mon[98481]: from='client.? 172.21.15.163:0/3608131476' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-07-14T18:10:33.466 INFO:teuthology.orchestra.run.smithi163.stderr:Inferring config /var/lib/ceph/bf7326ec-2270-11ee-9b33-001a4aab830c/mon.a/config 2023-07-14T18:10:33.523 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:10:33 smithi172 ceph-mon[97983]: from='client.? 172.21.15.163:0/3608131476' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-07-14T18:10:34.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:10:34 smithi184 ceph-mon[98481]: pgmap v225: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-07-14T18:10:34.465 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:10:34 smithi163 ceph-mon[96576]: pgmap v225: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-07-14T18:10:34.523 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:10:34 smithi172 ceph-mon[97983]: pgmap v225: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-07-14T18:10:34.776 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:34.738+0000 7fc8c6233700 1 -- 172.21.15.163:0/683459970 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc8c0100f20 msgr2=0x7fc8c01012f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:10:34.776 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:34.738+0000 7fc8c6233700 1 --2- 172.21.15.163:0/683459970 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc8c0100f20 0x7fc8c01012f0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fc8a8009990 tx=0x7fc8a8009ca0 comp rx=0 tx=0).stop 2023-07-14T18:10:34.776 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:34.738+0000 7fc8c6233700 1 -- 172.21.15.163:0/683459970 shutdown_connections 2023-07-14T18:10:34.777 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:34.738+0000 7fc8c6233700 1 --2- 172.21.15.163:0/683459970 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc8c010a270 0x7fc8c010c6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:10:34.777 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:34.738+0000 7fc8c6233700 1 --2- 172.21.15.163:0/683459970 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc8c0100f20 0x7fc8c01012f0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:10:34.777 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:34.738+0000 7fc8c6233700 1 --2- 172.21.15.163:0/683459970 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc8c0101830 0x7fc8c0109d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:10:34.777 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:34.738+0000 7fc8c6233700 1 -- 172.21.15.163:0/683459970 >> 172.21.15.163:0/683459970 conn(0x7fc8c0075ca0 msgr2=0x7fc8c00760a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:10:34.777 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:34.738+0000 7fc8c6233700 1 -- 172.21.15.163:0/683459970 shutdown_connections 2023-07-14T18:10:34.777 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:34.738+0000 7fc8c6233700 1 -- 172.21.15.163:0/683459970 wait complete. 2023-07-14T18:10:34.777 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:34.738+0000 7fc8c6233700 1 Processor -- start 2023-07-14T18:10:34.777 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:34.739+0000 7fc8c6233700 1 -- start start 2023-07-14T18:10:34.779 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:34.739+0000 7fc8c6233700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc8c0100f20 0x7fc8c00feb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:10:34.779 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:34.739+0000 7fc8c6233700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc8c0101830 0x7fc8c00ff0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:10:34.779 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:34.739+0000 7fc8c6233700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc8c010a270 0x7fc8c00ff640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:10:34.780 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:34.739+0000 7fc8c6233700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8c01a4130 con 0x7fc8c0101830 2023-07-14T18:10:34.780 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:34.739+0000 7fc8c6233700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8c01a42a0 con 0x7fc8c010a270 2023-07-14T18:10:34.780 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:34.739+0000 7fc8c6233700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8c01a4460 con 0x7fc8c0100f20 2023-07-14T18:10:34.780 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:34.739+0000 7fc8beffd700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc8c0101830 0x7fc8c00ff0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:10:34.780 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:34.739+0000 7fc8beffd700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc8c0101830 0x7fc8c00ff0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:55392/0 (socket says 172.21.15.163:55392) 2023-07-14T18:10:34.780 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:34.739+0000 7fc8beffd700 1 -- 172.21.15.163:0/704475786 learned_addr learned my addr 172.21.15.163:0/704475786 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:10:34.780 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:34.739+0000 7fc8bffff700 1 --2- 172.21.15.163:0/704475786 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc8c010a270 0x7fc8c00ff640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:10:34.780 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:34.739+0000 7fc8bf7fe700 1 --2- 172.21.15.163:0/704475786 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc8c0100f20 0x7fc8c00feb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:10:34.781 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:34.739+0000 7fc8beffd700 1 -- 172.21.15.163:0/704475786 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc8c0100f20 msgr2=0x7fc8c00feb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:10:34.781 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:34.739+0000 7fc8beffd700 1 --2- 172.21.15.163:0/704475786 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc8c0100f20 0x7fc8c00feb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:10:34.781 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:34.739+0000 7fc8beffd700 1 -- 172.21.15.163:0/704475786 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc8c010a270 msgr2=0x7fc8c00ff640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:10:34.781 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:34.739+0000 7fc8beffd700 1 --2- 172.21.15.163:0/704475786 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc8c010a270 0x7fc8c00ff640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:10:34.781 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:34.739+0000 7fc8beffd700 1 -- 172.21.15.163:0/704475786 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8a80095f0 con 0x7fc8c0101830 2023-07-14T18:10:34.781 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:34.739+0000 7fc8bffff700 1 --2- 172.21.15.163:0/704475786 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc8c010a270 0x7fc8c00ff640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T18:10:34.781 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:34.739+0000 7fc8beffd700 1 --2- 172.21.15.163:0/704475786 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc8c0101830 0x7fc8c00ff0c0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fc8b000d950 tx=0x7fc8b000dd10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:10:34.782 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:34.739+0000 7fc8bcff9700 1 -- 172.21.15.163:0/704475786 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8b0009b40 con 0x7fc8c0101830 2023-07-14T18:10:34.782 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:34.740+0000 7fc8bcff9700 1 -- 172.21.15.163:0/704475786 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fc8b0009ca0 con 0x7fc8c0101830 2023-07-14T18:10:34.782 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:34.740+0000 7fc8c6233700 1 -- 172.21.15.163:0/704475786 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc8c01a4740 con 0x7fc8c0101830 2023-07-14T18:10:34.782 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:34.740+0000 7fc8bcff9700 1 -- 172.21.15.163:0/704475786 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8b000f620 con 0x7fc8c0101830 2023-07-14T18:10:34.782 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:34.740+0000 7fc8c6233700 1 -- 172.21.15.163:0/704475786 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc8c01a4c40 con 0x7fc8c0101830 2023-07-14T18:10:34.782 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:34.740+0000 7fc8c6233700 1 -- 172.21.15.163:0/704475786 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc8c0104b60 con 0x7fc8c0101830 2023-07-14T18:10:34.782 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:34.741+0000 7fc8bcff9700 1 -- 172.21.15.163:0/704475786 <== mon.0 v2:172.21.15.163:3300/0 4 ==== mgrmap(e 16) v1 ==== 135716+0+0 (secure 0 0 0) 0x7fc8b0010460 con 0x7fc8c0101830 2023-07-14T18:10:34.783 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:34.742+0000 7fc8bcff9700 1 --2- 172.21.15.163:0/704475786 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7fc8ac0a1150 0x7fc8ac0a3600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:10:34.783 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:34.742+0000 7fc8bf7fe700 1 --2- 172.21.15.163:0/704475786 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7fc8ac0a1150 0x7fc8ac0a3600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:10:34.783 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:34.742+0000 7fc8bcff9700 1 -- 172.21.15.163:0/704475786 <== mon.0 v2:172.21.15.163:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 7127+0+0 (secure 0 0 0) 0x7fc8b00cc850 con 0x7fc8c0101830 2023-07-14T18:10:34.783 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:34.742+0000 7fc8bf7fe700 1 --2- 172.21.15.163:0/704475786 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7fc8ac0a1150 0x7fc8ac0a3600 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fc8a800b5c0 tx=0x7fc8a8005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:10:34.784 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:34.745+0000 7fc8bcff9700 1 -- 172.21.15.163:0/704475786 <== mon.0 v2:172.21.15.163:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178025 (secure 0 0 0) 0x7fc8b0096440 con 0x7fc8c0101830 2023-07-14T18:10:34.967 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:34.930+0000 7fc8c6233700 1 -- 172.21.15.163:0/704475786 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fc8c002c8e0 con 0x7fc8c0101830 2023-07-14T18:10:34.968 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:34.930+0000 7fc8bcff9700 1 -- 172.21.15.163:0/704475786 <== mon.0 v2:172.21.15.163:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v76) v1 ==== 93+0+10 (secure 0 0 0) 0x7fc8b0099a60 con 0x7fc8c0101830 2023-07-14T18:10:34.968 INFO:teuthology.orchestra.run.smithi163.stdout:pg_num: 1 2023-07-14T18:10:34.970 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:34.932+0000 7fc8c6233700 1 -- 172.21.15.163:0/704475786 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7fc8ac0a1150 msgr2=0x7fc8ac0a3600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:10:34.970 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:34.932+0000 7fc8c6233700 1 --2- 172.21.15.163:0/704475786 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7fc8ac0a1150 0x7fc8ac0a3600 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fc8a800b5c0 tx=0x7fc8a8005fb0 comp rx=0 tx=0).stop 2023-07-14T18:10:34.970 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:34.932+0000 7fc8c6233700 1 -- 172.21.15.163:0/704475786 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc8c0101830 msgr2=0x7fc8c00ff0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:10:34.970 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:34.932+0000 7fc8c6233700 1 --2- 172.21.15.163:0/704475786 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc8c0101830 0x7fc8c00ff0c0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fc8b000d950 tx=0x7fc8b000dd10 comp rx=0 tx=0).stop 2023-07-14T18:10:34.971 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:34.932+0000 7fc8c6233700 1 -- 172.21.15.163:0/704475786 shutdown_connections 2023-07-14T18:10:34.971 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:34.932+0000 7fc8c6233700 1 --2- 172.21.15.163:0/704475786 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7fc8ac0a1150 0x7fc8ac0a3600 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:10:34.971 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:34.932+0000 7fc8c6233700 1 --2- 172.21.15.163:0/704475786 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc8c0100f20 0x7fc8c00feb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:10:34.971 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:34.932+0000 7fc8c6233700 1 --2- 172.21.15.163:0/704475786 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc8c010a270 0x7fc8c00ff640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:10:34.971 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:34.932+0000 7fc8c6233700 1 --2- 172.21.15.163:0/704475786 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc8c0101830 0x7fc8c00ff0c0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:10:34.971 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:34.932+0000 7fc8c6233700 1 -- 172.21.15.163:0/704475786 >> 172.21.15.163:0/704475786 conn(0x7fc8c0075ca0 msgr2=0x7fc8c0101ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:10:34.971 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:34.932+0000 7fc8c6233700 1 -- 172.21.15.163:0/704475786 shutdown_connections 2023-07-14T18:10:34.971 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:34.933+0000 7fc8c6233700 1 -- 172.21.15.163:0/704475786 wait complete. 2023-07-14T18:10:35.312 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:10:35 smithi163 ceph-mon[96576]: from='client.? 172.21.15.163:0/704475786' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-07-14T18:10:35.325 INFO:tasks.cephadm:Adding mds.a on smithi163 2023-07-14T18:10:35.325 INFO:tasks.cephadm:Adding mds.d on smithi163 2023-07-14T18:10:35.326 INFO:tasks.cephadm:Adding mds.g on smithi163 2023-07-14T18:10:35.326 INFO:tasks.cephadm:Adding mds.j on smithi163 2023-07-14T18:10:35.326 INFO:tasks.cephadm:Adding mds.b on smithi172 2023-07-14T18:10:35.326 INFO:tasks.cephadm:Adding mds.e on smithi172 2023-07-14T18:10:35.326 INFO:tasks.cephadm:Adding mds.h on smithi172 2023-07-14T18:10:35.326 INFO:tasks.cephadm:Adding mds.k on smithi172 2023-07-14T18:10:35.327 INFO:tasks.cephadm:Adding mds.c on smithi184 2023-07-14T18:10:35.327 INFO:tasks.cephadm:Adding mds.f on smithi184 2023-07-14T18:10:35.327 INFO:tasks.cephadm:Adding mds.i on smithi184 2023-07-14T18:10:35.327 INFO:tasks.cephadm:Adding mds.l on smithi184 2023-07-14T18:10:35.328 DEBUG:teuthology.orchestra.run.smithi184:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81c9387d2e7576da065747ec9c16d1c7d69016ec shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bf7326ec-2270-11ee-9b33-001a4aab830c -- ceph orch apply mds all '12;smithi163=a;smithi163=d;smithi163=g;smithi163=j;smithi172=b;smithi172=e;smithi172=h;smithi172=k;smithi184=c;smithi184=f;smithi184=i;smithi184=l' 2023-07-14T18:10:35.361 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:10:35 smithi184 ceph-mon[98481]: from='client.? 172.21.15.163:0/704475786' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-07-14T18:10:35.523 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:10:35 smithi172 ceph-mon[97983]: from='client.? 172.21.15.163:0/704475786' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-07-14T18:10:35.903 INFO:teuthology.orchestra.run.smithi184.stderr:Inferring config /var/lib/ceph/bf7326ec-2270-11ee-9b33-001a4aab830c/mon.c/config 2023-07-14T18:10:37.051 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:10:36 smithi184 ceph-mon[98481]: pgmap v226: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-07-14T18:10:37.193 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:10:37.154+0000 7f2bbb624700 1 -- 172.21.15.184:0/3193117280 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2bb40ff570 msgr2=0x7f2bb41070e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:10:37.194 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:10:37.154+0000 7f2bbb624700 1 --2- 172.21.15.184:0/3193117280 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2bb40ff570 0x7f2bb41070e0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f2bac00b0a0 tx=0x7f2bac00b3b0 comp rx=0 tx=0).stop 2023-07-14T18:10:37.194 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:10:37.154+0000 7f2bbb624700 1 -- 172.21.15.184:0/3193117280 shutdown_connections 2023-07-14T18:10:37.194 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:10:37.154+0000 7f2bbb624700 1 --2- 172.21.15.184:0/3193117280 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2bb40ff570 0x7f2bb41070e0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:10:37.194 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:10:37.154+0000 7f2bbb624700 1 --2- 172.21.15.184:0/3193117280 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f2bb4100180 0x7f2bb4100590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:10:37.194 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:10:37.154+0000 7f2bbb624700 1 --2- 172.21.15.184:0/3193117280 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2bb4100ad0 0x7f2bb40feee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:10:37.194 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:10:37.154+0000 7f2bbb624700 1 -- 172.21.15.184:0/3193117280 >> 172.21.15.184:0/3193117280 conn(0x7f2bb40f99c0 msgr2=0x7f2bb40fbdd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:10:37.194 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:10:37.155+0000 7f2bbb624700 1 -- 172.21.15.184:0/3193117280 shutdown_connections 2023-07-14T18:10:37.194 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:10:37.155+0000 7f2bbb624700 1 -- 172.21.15.184:0/3193117280 wait complete. 2023-07-14T18:10:37.196 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:10:37.155+0000 7f2bbb624700 1 Processor -- start 2023-07-14T18:10:37.196 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:10:37.155+0000 7f2bbb624700 1 -- start start 2023-07-14T18:10:37.196 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:10:37.156+0000 7f2bbb624700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f2bb40ff570 0x7f2bb4195a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:10:37.196 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:10:37.156+0000 7f2bbb624700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2bb4100180 0x7f2bb4195f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:10:37.197 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:10:37.156+0000 7f2bbb624700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2bb4100ad0 0x7f2bb419cfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:10:37.197 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:10:37.156+0000 7f2bbb624700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2bb419d5a0 con 0x7f2bb40ff570 2023-07-14T18:10:37.197 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:10:37.156+0000 7f2bbb624700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2bb419d6e0 con 0x7f2bb4100ad0 2023-07-14T18:10:37.197 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:10:37.156+0000 7f2bbb624700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2bb419d870 con 0x7f2bb4100180 2023-07-14T18:10:37.197 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:10:37.156+0000 7f2bb8bbf700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2bb4100180 0x7f2bb4195f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:10:37.197 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:10:37.156+0000 7f2bb8bbf700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2bb4100180 0x7f2bb4195f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.184:54348/0 (socket says 172.21.15.184:54348) 2023-07-14T18:10:37.197 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:10:37.156+0000 7f2bb8bbf700 1 -- 172.21.15.184:0/1250809623 learned_addr learned my addr 172.21.15.184:0/1250809623 (peer_addr_for_me v2:172.21.15.184:0/0) 2023-07-14T18:10:37.198 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:10:37.156+0000 7f2bb93c0700 1 --2- 172.21.15.184:0/1250809623 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f2bb40ff570 0x7f2bb4195a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:10:37.198 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:10:37.156+0000 7f2bb9bc1700 1 --2- 172.21.15.184:0/1250809623 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2bb4100ad0 0x7f2bb419cfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:10:37.198 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:10:37.156+0000 7f2bb8bbf700 1 -- 172.21.15.184:0/1250809623 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2bb4100ad0 msgr2=0x7f2bb419cfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:10:37.198 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:10:37.156+0000 7f2bb8bbf700 1 --2- 172.21.15.184:0/1250809623 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2bb4100ad0 0x7f2bb419cfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:10:37.198 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:10:37.156+0000 7f2bb8bbf700 1 -- 172.21.15.184:0/1250809623 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f2bb40ff570 msgr2=0x7f2bb4195a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:10:37.198 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:10:37.156+0000 7f2bb8bbf700 1 --2- 172.21.15.184:0/1250809623 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f2bb40ff570 0x7f2bb4195a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:10:37.199 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:10:37.156+0000 7f2bb8bbf700 1 -- 172.21.15.184:0/1250809623 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2bac009d00 con 0x7f2bb4100180 2023-07-14T18:10:37.199 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:10:37.156+0000 7f2bb9bc1700 1 --2- 172.21.15.184:0/1250809623 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2bb4100ad0 0x7f2bb419cfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T18:10:37.199 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:10:37.156+0000 7f2bb8bbf700 1 --2- 172.21.15.184:0/1250809623 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2bb4100180 0x7f2bb4195f50 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f2bb000c950 tx=0x7f2bb000cc60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:10:37.199 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:10:37.156+0000 7f2baa7fc700 1 -- 172.21.15.184:0/1250809623 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bb000cea0 con 0x7f2bb4100180 2023-07-14T18:10:37.199 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:10:37.156+0000 7f2baa7fc700 1 -- 172.21.15.184:0/1250809623 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f2bb0004830 con 0x7f2bb4100180 2023-07-14T18:10:37.199 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:10:37.156+0000 7f2bbb624700 1 -- 172.21.15.184:0/1250809623 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2bb419db50 con 0x7f2bb4100180 2023-07-14T18:10:37.199 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:10:37.156+0000 7f2baa7fc700 1 -- 172.21.15.184:0/1250809623 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bb0005440 con 0x7f2bb4100180 2023-07-14T18:10:37.199 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:10:37.156+0000 7f2bbb624700 1 -- 172.21.15.184:0/1250809623 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2bb419e0a0 con 0x7f2bb4100180 2023-07-14T18:10:37.200 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:10:37.157+0000 7f2bbb624700 1 -- 172.21.15.184:0/1250809623 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2bb4105c20 con 0x7f2bb4100180 2023-07-14T18:10:37.200 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:10:37.158+0000 7f2baa7fc700 1 -- 172.21.15.184:0/1250809623 <== mon.1 v2:172.21.15.184:3300/0 4 ==== mgrmap(e 16) v1 ==== 135716+0+0 (secure 0 0 0) 0x7f2bb00049a0 con 0x7f2bb4100180 2023-07-14T18:10:37.200 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:10:37.159+0000 7f2baa7fc700 1 --2- 172.21.15.184:0/1250809623 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f2ba00a11d0 0x7f2ba00a3680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:10:37.201 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:10:37.159+0000 7f2baa7fc700 1 -- 172.21.15.184:0/1250809623 <== mon.1 v2:172.21.15.184:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f2bb00cc370 con 0x7f2bb4100180 2023-07-14T18:10:37.201 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:10:37.159+0000 7f2bb93c0700 1 --2- 172.21.15.184:0/1250809623 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f2ba00a11d0 0x7f2ba00a3680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:10:37.201 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:10:37.160+0000 7f2bb93c0700 1 --2- 172.21.15.184:0/1250809623 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f2ba00a11d0 0x7f2ba00a3680 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f2bb40ffeb0 tx=0x7f2ba400a380 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:10:37.201 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:10:37.162+0000 7f2baa7fc700 1 -- 172.21.15.184:0/1250809623 <== mon.1 v2:172.21.15.184:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178025 (secure 0 0 0) 0x7f2bb0095fe0 con 0x7f2bb4100180 2023-07-14T18:10:37.215 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:10:36 smithi163 ceph-mon[96576]: pgmap v226: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-07-14T18:10:37.273 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:10:36 smithi172 ceph-mon[97983]: pgmap v226: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-07-14T18:10:37.393 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:10:37.354+0000 7f2bbb624700 1 -- 172.21.15.184:0/1250809623 --> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] -- mgr_command(tid 0: {"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi163=a;smithi163=d;smithi163=g;smithi163=j;smithi172=b;smithi172=e;smithi172=h;smithi172=k;smithi184=c;smithi184=f;smithi184=i;smithi184=l", "target": ["mon-mgr", ""]}) v1 -- 0x7f2bb4060c80 con 0x7f2ba00a11d0 2023-07-14T18:10:37.401 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:10:37.363+0000 7f2baa7fc700 1 -- 172.21.15.184:0/1250809623 <== mgr.14152 v2:172.21.15.163:6800/1949590926 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+28 (secure 0 0 0) 0x7f2bb4060c80 con 0x7f2ba00a11d0 2023-07-14T18:10:37.402 INFO:teuthology.orchestra.run.smithi184.stdout:Scheduled mds.all update... 2023-07-14T18:10:37.403 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:10:37.365+0000 7f2bbb624700 1 -- 172.21.15.184:0/1250809623 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f2ba00a11d0 msgr2=0x7f2ba00a3680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:10:37.404 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:10:37.365+0000 7f2bbb624700 1 --2- 172.21.15.184:0/1250809623 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f2ba00a11d0 0x7f2ba00a3680 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f2bb40ffeb0 tx=0x7f2ba400a380 comp rx=0 tx=0).stop 2023-07-14T18:10:37.404 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:10:37.365+0000 7f2bbb624700 1 -- 172.21.15.184:0/1250809623 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2bb4100180 msgr2=0x7f2bb4195f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:10:37.404 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:10:37.365+0000 7f2bbb624700 1 --2- 172.21.15.184:0/1250809623 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2bb4100180 0x7f2bb4195f50 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f2bb000c950 tx=0x7f2bb000cc60 comp rx=0 tx=0).stop 2023-07-14T18:10:37.404 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:10:37.365+0000 7f2bbb624700 1 -- 172.21.15.184:0/1250809623 shutdown_connections 2023-07-14T18:10:37.404 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:10:37.365+0000 7f2bbb624700 1 --2- 172.21.15.184:0/1250809623 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f2ba00a11d0 0x7f2ba00a3680 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:10:37.404 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:10:37.365+0000 7f2bbb624700 1 --2- 172.21.15.184:0/1250809623 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2bb4100ad0 0x7f2bb419cfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:10:37.405 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:10:37.365+0000 7f2bbb624700 1 --2- 172.21.15.184:0/1250809623 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f2bb40ff570 0x7f2bb4195a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:10:37.405 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:10:37.365+0000 7f2bbb624700 1 --2- 172.21.15.184:0/1250809623 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2bb4100180 0x7f2bb4195f50 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:10:37.405 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:10:37.365+0000 7f2bbb624700 1 -- 172.21.15.184:0/1250809623 >> 172.21.15.184:0/1250809623 conn(0x7f2bb40f99c0 msgr2=0x7f2bb40fbc30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:10:37.405 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:10:37.365+0000 7f2bbb624700 1 -- 172.21.15.184:0/1250809623 shutdown_connections 2023-07-14T18:10:37.405 INFO:teuthology.orchestra.run.smithi184.stderr:2023-07-14T18:10:37.365+0000 7f2bbb624700 1 -- 172.21.15.184:0/1250809623 wait complete. 2023-07-14T18:10:37.863 DEBUG:teuthology.orchestra.run.smithi163:mds.a> sudo journalctl -f -n 0 -u ceph-bf7326ec-2270-11ee-9b33-001a4aab830c@mds.a.service 2023-07-14T18:10:37.866 DEBUG:teuthology.orchestra.run.smithi163:mds.d> sudo journalctl -f -n 0 -u ceph-bf7326ec-2270-11ee-9b33-001a4aab830c@mds.d.service 2023-07-14T18:10:37.902 INFO:journalctl@ceph.mds.a.smithi163.stdout:-- Logs begin at Fri 2023-07-14 17:46:25 UTC. -- 2023-07-14T18:10:37.903 DEBUG:teuthology.orchestra.run.smithi163:mds.g> sudo journalctl -f -n 0 -u ceph-bf7326ec-2270-11ee-9b33-001a4aab830c@mds.g.service 2023-07-14T18:10:37.933 INFO:journalctl@ceph.mds.d.smithi163.stdout:-- Logs begin at Fri 2023-07-14 17:46:25 UTC. -- 2023-07-14T18:10:37.933 DEBUG:teuthology.orchestra.run.smithi163:mds.j> sudo journalctl -f -n 0 -u ceph-bf7326ec-2270-11ee-9b33-001a4aab830c@mds.j.service 2023-07-14T18:10:37.961 INFO:journalctl@ceph.mds.g.smithi163.stdout:-- Logs begin at Fri 2023-07-14 17:46:25 UTC. -- 2023-07-14T18:10:37.961 DEBUG:teuthology.orchestra.run.smithi172:mds.b> sudo journalctl -f -n 0 -u ceph-bf7326ec-2270-11ee-9b33-001a4aab830c@mds.b.service 2023-07-14T18:10:37.964 DEBUG:teuthology.orchestra.run.smithi172:mds.e> sudo journalctl -f -n 0 -u ceph-bf7326ec-2270-11ee-9b33-001a4aab830c@mds.e.service 2023-07-14T18:10:37.988 INFO:journalctl@ceph.mds.j.smithi163.stdout:-- Logs begin at Fri 2023-07-14 17:46:25 UTC. -- 2023-07-14T18:10:38.001 INFO:journalctl@ceph.mds.b.smithi172.stdout:-- Logs begin at Fri 2023-07-14 17:45:52 UTC. -- 2023-07-14T18:10:38.002 DEBUG:teuthology.orchestra.run.smithi172:mds.h> sudo journalctl -f -n 0 -u ceph-bf7326ec-2270-11ee-9b33-001a4aab830c@mds.h.service 2023-07-14T18:10:38.032 INFO:journalctl@ceph.mds.e.smithi172.stdout:-- Logs begin at Fri 2023-07-14 17:45:52 UTC. -- 2023-07-14T18:10:38.033 DEBUG:teuthology.orchestra.run.smithi172:mds.k> sudo journalctl -f -n 0 -u ceph-bf7326ec-2270-11ee-9b33-001a4aab830c@mds.k.service 2023-07-14T18:10:38.060 INFO:journalctl@ceph.mds.h.smithi172.stdout:-- Logs begin at Fri 2023-07-14 17:45:52 UTC. -- 2023-07-14T18:10:38.061 DEBUG:teuthology.orchestra.run.smithi184:mds.c> sudo journalctl -f -n 0 -u ceph-bf7326ec-2270-11ee-9b33-001a4aab830c@mds.c.service 2023-07-14T18:10:38.063 DEBUG:teuthology.orchestra.run.smithi184:mds.f> sudo journalctl -f -n 0 -u ceph-bf7326ec-2270-11ee-9b33-001a4aab830c@mds.f.service 2023-07-14T18:10:38.087 INFO:journalctl@ceph.mds.k.smithi172.stdout:-- Logs begin at Fri 2023-07-14 17:45:52 UTC. -- 2023-07-14T18:10:38.094 INFO:journalctl@ceph.mds.c.smithi184.stdout:-- Logs begin at Fri 2023-07-14 17:45:39 UTC. -- 2023-07-14T18:10:38.095 DEBUG:teuthology.orchestra.run.smithi184:mds.i> sudo journalctl -f -n 0 -u ceph-bf7326ec-2270-11ee-9b33-001a4aab830c@mds.i.service 2023-07-14T18:10:38.122 INFO:journalctl@ceph.mds.f.smithi184.stdout:-- Logs begin at Fri 2023-07-14 17:45:39 UTC. -- 2023-07-14T18:10:38.123 DEBUG:teuthology.orchestra.run.smithi184:mds.l> sudo journalctl -f -n 0 -u ceph-bf7326ec-2270-11ee-9b33-001a4aab830c@mds.l.service 2023-07-14T18:10:38.149 INFO:journalctl@ceph.mds.i.smithi184.stdout:-- Logs begin at Fri 2023-07-14 17:45:39 UTC. -- 2023-07-14T18:10:38.150 INFO:tasks.cephadm:Setting up CephFS filesystem(s)... 2023-07-14T18:10:38.150 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-14T18:10:38.177 INFO:journalctl@ceph.mds.l.smithi184.stdout:-- Logs begin at Fri 2023-07-14 17:45:39 UTC. -- 2023-07-14T18:10:38.286 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:38.248+0000 7fc2ee04d700 1 -- 172.21.15.163:0/276806488 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc2e80ffd30 msgr2=0x7fc2e8100180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:10:38.287 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:38.248+0000 7fc2ee04d700 1 --2- 172.21.15.163:0/276806488 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc2e80ffd30 0x7fc2e8100180 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fc2dc0098f0 tx=0x7fc2dc009c00 comp rx=0 tx=0).stop 2023-07-14T18:10:38.287 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:38.248+0000 7fc2ee04d700 1 -- 172.21.15.163:0/276806488 shutdown_connections 2023-07-14T18:10:38.287 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:38.248+0000 7fc2ee04d700 1 --2- 172.21.15.163:0/276806488 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc2e80feb40 0x7fc2e80fef50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:10:38.287 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:38.248+0000 7fc2ee04d700 1 --2- 172.21.15.163:0/276806488 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc2e81006c0 0x7fc2e8106f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:10:38.287 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:38.248+0000 7fc2ee04d700 1 --2- 172.21.15.163:0/276806488 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc2e80ffd30 0x7fc2e8100180 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:10:38.287 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:38.248+0000 7fc2ee04d700 1 -- 172.21.15.163:0/276806488 >> 172.21.15.163:0/276806488 conn(0x7fc2e80fa160 msgr2=0x7fc2e80fc590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:10:38.288 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:38.249+0000 7fc2ee04d700 1 -- 172.21.15.163:0/276806488 shutdown_connections 2023-07-14T18:10:38.288 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:38.249+0000 7fc2ee04d700 1 -- 172.21.15.163:0/276806488 wait complete. 2023-07-14T18:10:38.289 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:38.249+0000 7fc2ee04d700 1 Processor -- start 2023-07-14T18:10:38.289 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:38.249+0000 7fc2ee04d700 1 -- start start 2023-07-14T18:10:38.290 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:38.249+0000 7fc2ee04d700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc2e80feb40 0x7fc2e80692e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:10:38.290 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:38.249+0000 7fc2ee04d700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc2e80ffd30 0x7fc2e819a590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:10:38.290 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:38.249+0000 7fc2ee04d700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc2e81006c0 0x7fc2e819cbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:10:38.290 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:38.249+0000 7fc2ee04d700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2e819d370 con 0x7fc2e80ffd30 2023-07-14T18:10:38.290 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:38.249+0000 7fc2ee04d700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2e819d4e0 con 0x7fc2e80feb40 2023-07-14T18:10:38.290 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:38.249+0000 7fc2ee04d700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2e819d6a0 con 0x7fc2e81006c0 2023-07-14T18:10:38.290 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:38.250+0000 7fc2e77fe700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc2e80feb40 0x7fc2e80692e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:10:38.291 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:38.250+0000 7fc2e6ffd700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc2e80ffd30 0x7fc2e819a590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:10:38.291 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:38.250+0000 7fc2e77fe700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc2e80feb40 0x7fc2e80692e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.163:56086/0 (socket says 172.21.15.163:56086) 2023-07-14T18:10:38.291 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:38.250+0000 7fc2e77fe700 1 -- 172.21.15.163:0/2613134923 learned_addr learned my addr 172.21.15.163:0/2613134923 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:10:38.291 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:38.250+0000 7fc2e7fff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc2e81006c0 0x7fc2e819cbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:10:38.291 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:38.250+0000 7fc2e6ffd700 1 -- 172.21.15.163:0/2613134923 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc2e81006c0 msgr2=0x7fc2e819cbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:10:38.291 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:38.250+0000 7fc2e6ffd700 1 --2- 172.21.15.163:0/2613134923 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc2e81006c0 0x7fc2e819cbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:10:38.291 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:38.250+0000 7fc2e6ffd700 1 -- 172.21.15.163:0/2613134923 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc2e80feb40 msgr2=0x7fc2e80692e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:10:38.291 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:38.250+0000 7fc2e6ffd700 1 --2- 172.21.15.163:0/2613134923 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc2e80feb40 0x7fc2e80692e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:10:38.292 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:38.250+0000 7fc2e6ffd700 1 -- 172.21.15.163:0/2613134923 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2dc009520 con 0x7fc2e80ffd30 2023-07-14T18:10:38.292 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:38.250+0000 7fc2e6ffd700 1 --2- 172.21.15.163:0/2613134923 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc2e80ffd30 0x7fc2e819a590 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fc2dc000c00 tx=0x7fc2dc00bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:10:38.292 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:38.250+0000 7fc2e4ff9700 1 -- 172.21.15.163:0/2613134923 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2dc01c070 con 0x7fc2e80ffd30 2023-07-14T18:10:38.292 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:38.250+0000 7fc2ee04d700 1 -- 172.21.15.163:0/2613134923 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc2e819d920 con 0x7fc2e80ffd30 2023-07-14T18:10:38.292 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:38.250+0000 7fc2e4ff9700 1 -- 172.21.15.163:0/2613134923 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fc2dc00ba90 con 0x7fc2e80ffd30 2023-07-14T18:10:38.292 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:38.250+0000 7fc2e4ff9700 1 -- 172.21.15.163:0/2613134923 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2dc0038e0 con 0x7fc2e80ffd30 2023-07-14T18:10:38.292 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:38.250+0000 7fc2ee04d700 1 -- 172.21.15.163:0/2613134923 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc2e819dd40 con 0x7fc2e80ffd30 2023-07-14T18:10:38.293 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:38.251+0000 7fc2ee04d700 1 -- 172.21.15.163:0/2613134923 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc2e8105a90 con 0x7fc2e80ffd30 2023-07-14T18:10:38.293 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:38.252+0000 7fc2e4ff9700 1 -- 172.21.15.163:0/2613134923 <== mon.0 v2:172.21.15.163:3300/0 4 ==== mgrmap(e 16) v1 ==== 135716+0+0 (secure 0 0 0) 0x7fc2dc020030 con 0x7fc2e80ffd30 2023-07-14T18:10:38.293 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:38.253+0000 7fc2e4ff9700 1 --2- 172.21.15.163:0/2613134923 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7fc2d00a11a0 0x7fc2d00a3650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:10:38.294 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:38.253+0000 7fc2e4ff9700 1 -- 172.21.15.163:0/2613134923 <== mon.0 v2:172.21.15.163:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 7127+0+0 (secure 0 0 0) 0x7fc2dc0cd3a0 con 0x7fc2e80ffd30 2023-07-14T18:10:38.294 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:38.253+0000 7fc2e77fe700 1 --2- 172.21.15.163:0/2613134923 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7fc2d00a11a0 0x7fc2d00a3650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:10:38.294 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:38.253+0000 7fc2e77fe700 1 --2- 172.21.15.163:0/2613134923 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7fc2d00a11a0 0x7fc2d00a3650 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fc2d8009cf0 tx=0x7fc2d8009310 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:10:38.294 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:38.257+0000 7fc2e4ff9700 1 -- 172.21.15.163:0/2613134923 <== mon.0 v2:172.21.15.163:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178025 (secure 0 0 0) 0x7fc2dc097020 con 0x7fc2e80ffd30 2023-07-14T18:10:38.465 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:10:38 smithi163 ceph-mon[96576]: from='client.24403 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi163=a;smithi163=d;smithi163=g;smithi163=j;smithi172=b;smithi172=e;smithi172=h;smithi172=k;smithi184=c;smithi184=f;smithi184=i;smithi184=l", "target": ["mon-mgr", ""]}]: dispatch 2023-07-14T18:10:38.465 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:10:38 smithi163 ceph-mon[96576]: Saving service mds.all spec with placement smithi163=a;smithi163=d;smithi163=g;smithi163=j;smithi172=b;smithi172=e;smithi172=h;smithi172=k;smithi184=c;smithi184=f;smithi184=i;smithi184=l;count:12 2023-07-14T18:10:38.465 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:10:38 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:10:38.466 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:10:38 smithi163 ceph-mon[96576]: pgmap v227: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-07-14T18:10:38.466 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:10:38 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-14T18:10:38.466 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:10:38 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T18:10:38.466 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:10:38 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-14T18:10:38.466 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:10:38 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:10:38.466 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:10:38 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-07-14T18:10:38.466 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:10:38 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-07-14T18:10:38.466 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:10:38 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T18:10:38.467 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:10:38 smithi163 ceph-mon[96576]: Deploying daemon mds.l on smithi184 2023-07-14T18:10:38.487 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:38.450+0000 7fc2ee04d700 1 -- 172.21.15.163:0/2613134923 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc2e802cb30 con 0x7fc2e80ffd30 2023-07-14T18:10:38.488 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:38.451+0000 7fc2e4ff9700 1 -- 172.21.15.163:0/2613134923 <== mon.0 v2:172.21.15.163:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v76) v1 ==== 74+0+18492 (secure 0 0 0) 0x7fc2dc09a640 con 0x7fc2e80ffd30 2023-07-14T18:10:38.489 INFO:teuthology.orchestra.run.smithi163.stdout: 2023-07-14T18:10:38.489 INFO:teuthology.orchestra.run.smithi163.stdout:{"epoch":76,"fsid":"bf7326ec-2270-11ee-9b33-001a4aab830c","created":"2023-07-14T18:04:26.263517+0000","modified":"2023-07-14T18:10:29.005628+0000","last_up_change":"2023-07-14T18:10:27.514863+0000","last_in_change":"2023-07-14T18:10:10.726443+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-14T18:07:19.653852+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e6490568-046d-43ef-bb07-d79fb884b276","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6802","nonce":3124653025},{"type":"v1","addr":"172.21.15.163:6803","nonce":3124653025}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6804","nonce":3124653025},{"type":"v1","addr":"172.21.15.163:6805","nonce":3124653025}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6808","nonce":3124653025},{"type":"v1","addr":"172.21.15.163:6809","nonce":3124653025}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6806","nonce":3124653025},{"type":"v1","addr":"172.21.15.163:6807","nonce":3124653025}]},"public_addr":"172.21.15.163:6803/3124653025","cluster_addr":"172.21.15.163:6805/3124653025","heartbeat_back_addr":"172.21.15.163:6809/3124653025","heartbeat_front_addr":"172.21.15.163:6807/3124653025","state":["exists","up"]},{"osd":1,"uuid":"0af39bda-f096-4603-adcc-bf1988f36603","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":3774455900},{"type":"v1","addr":"172.21.15.172:6801","nonce":3774455900}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":3774455900},{"type":"v1","addr":"172.21.15.172:6803","nonce":3774455900}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":3774455900},{"type":"v1","addr":"172.21.15.172:6807","nonce":3774455900}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":3774455900},{"type":"v1","addr":"172.21.15.172:6805","nonce":3774455900}]},"public_addr":"172.21.15.172:6801/3774455900","cluster_addr":"172.21.15.172:6803/3774455900","heartbeat_back_addr":"172.21.15.172:6807/3774455900","heartbeat_front_addr":"172.21.15.172:6805/3774455900","state":["exists","up"]},{"osd":2,"uuid":"cc732c13-af0f-4199-98e6-fe960ed4e5dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":1976927678},{"type":"v1","addr":"172.21.15.184:6801","nonce":1976927678}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":1976927678},{"type":"v1","addr":"172.21.15.184:6803","nonce":1976927678}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":1976927678},{"type":"v1","addr":"172.21.15.184:6807","nonce":1976927678}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":1976927678},{"type":"v1","addr":"172.21.15.184:6805","nonce":1976927678}]},"public_addr":"172.21.15.184:6801/1976927678","cluster_addr":"172.21.15.184:6803/1976927678","heartbeat_back_addr":"172.21.15.184:6807/1976927678","heartbeat_front_addr":"172.21.15.184:6805/1976927678","state":["exists","up"]},{"osd":3,"uuid":"dcee9576-0bc6-4ab0-8f63-79eacd0eca5f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6810","nonce":2589130694},{"type":"v1","addr":"172.21.15.163:6811","nonce":2589130694}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6812","nonce":2589130694},{"type":"v1","addr":"172.21.15.163:6813","nonce":2589130694}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6816","nonce":2589130694},{"type":"v1","addr":"172.21.15.163:6817","nonce":2589130694}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6814","nonce":2589130694},{"type":"v1","addr":"172.21.15.163:6815","nonce":2589130694}]},"public_addr":"172.21.15.163:6811/2589130694","cluster_addr":"172.21.15.163:6813/2589130694","heartbeat_back_addr":"172.21.15.163:6817/2589130694","heartbeat_front_addr":"172.21.15.163:6815/2589130694","state":["exists","up"]},{"osd":4,"uuid":"055df823-b8b0-426a-83c2-f0d727932ad8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":3319632614},{"type":"v1","addr":"172.21.15.172:6809","nonce":3319632614}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6810","nonce":3319632614},{"type":"v1","addr":"172.21.15.172:6811","nonce":3319632614}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6814","nonce":3319632614},{"type":"v1","addr":"172.21.15.172:6815","nonce":3319632614}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":3319632614},{"type":"v1","addr":"172.21.15.172:6813","nonce":3319632614}]},"public_addr":"172.21.15.172:6809/3319632614","cluster_addr":"172.21.15.172:6811/3319632614","heartbeat_back_addr":"172.21.15.172:6815/3319632614","heartbeat_front_addr":"172.21.15.172:6813/3319632614","state":["exists","up"]},{"osd":5,"uuid":"ef5ef02a-b4e2-4790-9d27-f6d2247b25c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":2662084043},{"type":"v1","addr":"172.21.15.184:6809","nonce":2662084043}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6810","nonce":2662084043},{"type":"v1","addr":"172.21.15.184:6811","nonce":2662084043}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6814","nonce":2662084043},{"type":"v1","addr":"172.21.15.184:6815","nonce":2662084043}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6812","nonce":2662084043},{"type":"v1","addr":"172.21.15.184:6813","nonce":2662084043}]},"public_addr":"172.21.15.184:6809/2662084043","cluster_addr":"172.21.15.184:6811/2662084043","heartbeat_back_addr":"172.21.15.184:6815/2662084043","heartbeat_front_addr":"172.21.15.184:6813/2662084043","state":["exists","up"]},{"osd":6,"uuid":"dba754be-0fc5-4867-a6d5-cf97eb344f81","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":44,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6818","nonce":2530874117},{"type":"v1","addr":"172.21.15.163:6819","nonce":2530874117}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6820","nonce":2530874117},{"type":"v1","addr":"172.21.15.163:6821","nonce":2530874117}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6824","nonce":2530874117},{"type":"v1","addr":"172.21.15.163:6825","nonce":2530874117}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6822","nonce":2530874117},{"type":"v1","addr":"172.21.15.163:6823","nonce":2530874117}]},"public_addr":"172.21.15.163:6819/2530874117","cluster_addr":"172.21.15.163:6821/2530874117","heartbeat_back_addr":"172.21.15.163:6825/2530874117","heartbeat_front_addr":"172.21.15.163:6823/2530874117","state":["exists","up"]},{"osd":7,"uuid":"edd76e6b-6077-4619-b00d-1e906f70ddcc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":49,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":233511803},{"type":"v1","addr":"172.21.15.172:6817","nonce":233511803}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6818","nonce":233511803},{"type":"v1","addr":"172.21.15.172:6819","nonce":233511803}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":233511803},{"type":"v1","addr":"172.21.15.172:6823","nonce":233511803}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6820","nonce":233511803},{"type":"v1","addr":"172.21.15.172:6821","nonce":233511803}]},"public_addr":"172.21.15.172:6817/233511803","cluster_addr":"172.21.15.172:6819/233511803","heartbeat_back_addr":"172.21.15.172:6823/233511803","heartbeat_front_addr":"172.21.15.172:6821/233511803","state":["exists","up"]},{"osd":8,"uuid":"36559400-f33e-44e6-868a-316d34da457d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":56,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6816","nonce":290154343},{"type":"v1","addr":"172.21.15.184:6817","nonce":290154343}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6818","nonce":290154343},{"type":"v1","addr":"172.21.15.184:6819","nonce":290154343}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6822","nonce":290154343},{"type":"v1","addr":"172.21.15.184:6823","nonce":290154343}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6820","nonce":290154343},{"type":"v1","addr":"172.21.15.184:6821","nonce":290154343}]},"public_addr":"172.21.15.184:6817/290154343","cluster_addr":"172.21.15.184:6819/290154343","heartbeat_back_addr":"172.21.15.184:6823/290154343","heartbeat_front_addr":"172.21.15.184:6821/290154343","state":["exists","up"]},{"osd":9,"uuid":"d484f111-f36c-4c67-9a8a-ae03e7e0d137","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6826","nonce":3848110906},{"type":"v1","addr":"172.21.15.163:6827","nonce":3848110906}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6828","nonce":3848110906},{"type":"v1","addr":"172.21.15.163:6829","nonce":3848110906}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6832","nonce":3848110906},{"type":"v1","addr":"172.21.15.163:6833","nonce":3848110906}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6830","nonce":3848110906},{"type":"v1","addr":"172.21.15.163:6831","nonce":3848110906}]},"public_addr":"172.21.15.163:6827/3848110906","cluster_addr":"172.21.15.163:6829/3848110906","heartbeat_back_addr":"172.21.15.163:6833/3848110906","heartbeat_front_addr":"172.21.15.163:6831/3848110906","state":["exists","up"]},{"osd":10,"uuid":"d943f7c0-da3d-4605-9e23-0231e675c6be","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6824","nonce":3281085356},{"type":"v1","addr":"172.21.15.172:6825","nonce":3281085356}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":3281085356},{"type":"v1","addr":"172.21.15.172:6827","nonce":3281085356}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":3281085356},{"type":"v1","addr":"172.21.15.172:6831","nonce":3281085356}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6828","nonce":3281085356},{"type":"v1","addr":"172.21.15.172:6829","nonce":3281085356}]},"public_addr":"172.21.15.172:6825/3281085356","cluster_addr":"172.21.15.172:6827/3281085356","heartbeat_back_addr":"172.21.15.172:6831/3281085356","heartbeat_front_addr":"172.21.15.172:6829/3281085356","state":["exists","up"]},{"osd":11,"uuid":"09e610a8-408a-4119-a21b-c4de2810a538","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":75,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6824","nonce":3614578747},{"type":"v1","addr":"172.21.15.184:6825","nonce":3614578747}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6826","nonce":3614578747},{"type":"v1","addr":"172.21.15.184:6827","nonce":3614578747}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6830","nonce":3614578747},{"type":"v1","addr":"172.21.15.184:6831","nonce":3614578747}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6828","nonce":3614578747},{"type":"v1","addr":"172.21.15.184:6829","nonce":3614578747}]},"public_addr":"172.21.15.184:6825/3614578747","cluster_addr":"172.21.15.184:6827/3614578747","heartbeat_back_addr":"172.21.15.184:6831/3614578747","heartbeat_front_addr":"172.21.15.184:6829/3614578747","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T18:06:36.067578+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T18:06:57.095120+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T18:07:17.825363+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T18:07:38.977196+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T18:08:00.108709+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T18:08:20.700646+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T18:08:41.473899+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T18:09:02.856536+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T18:09:23.832722+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T18:09:44.860884+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T18:10:05.520678+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T18:10:26.426315+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.163:6801/1086512093":"2023-07-15T18:05:15.331458+0000","172.21.15.163:6800/1086512093":"2023-07-15T18:05:15.331458+0000","172.21.15.163:0/4235784810":"2023-07-15T18:05:15.331458+0000","172.21.15.163:6800/236891232":"2023-07-15T18:04:53.288443+0000","172.21.15.163:6801/236891232":"2023-07-15T18:04:53.288443+0000","172.21.15.163:0/3260193612":"2023-07-15T18:05:15.331458+0000","172.21.15.163:0/3513629472":"2023-07-15T18:04:53.288443+0000","172.21.15.163:0/1090329830":"2023-07-15T18:04:53.288443+0000","172.21.15.163:0/3868922045":"2023-07-15T18:05:15.331458+0000","172.21.15.163:0/2945662447":"2023-07-15T18:04:53.288443+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-14T18:10:38.491 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:38.453+0000 7fc2ee04d700 1 -- 172.21.15.163:0/2613134923 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7fc2d00a11a0 msgr2=0x7fc2d00a3650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:10:38.491 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:38.453+0000 7fc2ee04d700 1 --2- 172.21.15.163:0/2613134923 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7fc2d00a11a0 0x7fc2d00a3650 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fc2d8009cf0 tx=0x7fc2d8009310 comp rx=0 tx=0).stop 2023-07-14T18:10:38.491 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:38.453+0000 7fc2ee04d700 1 -- 172.21.15.163:0/2613134923 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc2e80ffd30 msgr2=0x7fc2e819a590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:10:38.491 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:38.453+0000 7fc2ee04d700 1 --2- 172.21.15.163:0/2613134923 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc2e80ffd30 0x7fc2e819a590 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fc2dc000c00 tx=0x7fc2dc00bf60 comp rx=0 tx=0).stop 2023-07-14T18:10:38.491 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:38.453+0000 7fc2ee04d700 1 -- 172.21.15.163:0/2613134923 shutdown_connections 2023-07-14T18:10:38.492 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:38.453+0000 7fc2ee04d700 1 --2- 172.21.15.163:0/2613134923 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7fc2d00a11a0 0x7fc2d00a3650 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:10:38.492 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:38.453+0000 7fc2ee04d700 1 --2- 172.21.15.163:0/2613134923 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc2e81006c0 0x7fc2e819cbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:10:38.492 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:38.453+0000 7fc2ee04d700 1 --2- 172.21.15.163:0/2613134923 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc2e80feb40 0x7fc2e80692e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:10:38.492 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:38.453+0000 7fc2ee04d700 1 --2- 172.21.15.163:0/2613134923 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc2e80ffd30 0x7fc2e819a590 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:10:38.492 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:38.453+0000 7fc2ee04d700 1 -- 172.21.15.163:0/2613134923 >> 172.21.15.163:0/2613134923 conn(0x7fc2e80fa160 msgr2=0x7fc2e80fc430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:10:38.492 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:38.453+0000 7fc2ee04d700 1 -- 172.21.15.163:0/2613134923 shutdown_connections 2023-07-14T18:10:38.492 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:38.453+0000 7fc2ee04d700 1 -- 172.21.15.163:0/2613134923 wait complete. 2023-07-14T18:10:38.503 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-14T18:07:19.653852+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-14T18:10:38.504 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-14T18:10:38.629 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:38.591+0000 7f345cdcf700 1 -- 172.21.15.163:0/3452903437 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f34581006a0 msgr2=0x7f3458106f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:10:38.629 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:38.591+0000 7f345cdcf700 1 --2- 172.21.15.163:0/3452903437 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f34581006a0 0x7f3458106f60 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f345000b0a0 tx=0x7f345000b3b0 comp rx=0 tx=0).stop 2023-07-14T18:10:38.629 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:38.591+0000 7f345cdcf700 1 -- 172.21.15.163:0/3452903437 shutdown_connections 2023-07-14T18:10:38.629 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:38.591+0000 7f345cdcf700 1 --2- 172.21.15.163:0/3452903437 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f34580feb20 0x7f34580fef30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:10:38.630 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:38.591+0000 7f345cdcf700 1 --2- 172.21.15.163:0/3452903437 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f34581006a0 0x7f3458106f60 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:10:38.630 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:38.591+0000 7f345cdcf700 1 --2- 172.21.15.163:0/3452903437 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f34580ffd10 0x7f3458100160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:10:38.630 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:38.591+0000 7f345cdcf700 1 -- 172.21.15.163:0/3452903437 >> 172.21.15.163:0/3452903437 conn(0x7f34580fa160 msgr2=0x7f34580fc570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:10:38.630 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:38.591+0000 7f345cdcf700 1 -- 172.21.15.163:0/3452903437 shutdown_connections 2023-07-14T18:10:38.630 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:38.591+0000 7f345cdcf700 1 -- 172.21.15.163:0/3452903437 wait complete. 2023-07-14T18:10:38.632 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:38.592+0000 7f345cdcf700 1 Processor -- start 2023-07-14T18:10:38.632 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:38.592+0000 7f345cdcf700 1 -- start start 2023-07-14T18:10:38.632 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:38.592+0000 7f345cdcf700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f34580feb20 0x7f3458069320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:10:38.632 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:38.592+0000 7f345cdcf700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f34580ffd10 0x7f345819ca50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:10:38.632 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:38.592+0000 7f345cdcf700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f34581006a0 0x7f345819efa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:10:38.632 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:38.592+0000 7f345cdcf700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f345819f650 con 0x7f34580feb20 2023-07-14T18:10:38.633 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:38.592+0000 7f345cdcf700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f345819f7c0 con 0x7f34581006a0 2023-07-14T18:10:38.633 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:38.592+0000 7f345cdcf700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f345819f980 con 0x7f34580ffd10 2023-07-14T18:10:38.633 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:38.592+0000 7f345659c700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f34580feb20 0x7f3458069320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:10:38.633 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:38.592+0000 7f345659c700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f34580feb20 0x7f3458069320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:55416/0 (socket says 172.21.15.163:55416) 2023-07-14T18:10:38.633 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:38.592+0000 7f345659c700 1 -- 172.21.15.163:0/2051832039 learned_addr learned my addr 172.21.15.163:0/2051832039 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:10:38.633 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:38.592+0000 7f3455d9b700 1 --2- 172.21.15.163:0/2051832039 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f34580ffd10 0x7f345819ca50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:10:38.633 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:38.592+0000 7f3456d9d700 1 --2- 172.21.15.163:0/2051832039 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f34581006a0 0x7f345819efa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:10:38.633 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:38.592+0000 7f345659c700 1 -- 172.21.15.163:0/2051832039 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f34580ffd10 msgr2=0x7f345819ca50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:10:38.634 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:38.592+0000 7f345659c700 1 --2- 172.21.15.163:0/2051832039 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f34580ffd10 0x7f345819ca50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:10:38.634 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:38.592+0000 7f345659c700 1 -- 172.21.15.163:0/2051832039 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f34581006a0 msgr2=0x7f345819efa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:10:38.634 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:38.592+0000 7f345659c700 1 --2- 172.21.15.163:0/2051832039 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f34581006a0 0x7f345819efa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:10:38.634 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:38.593+0000 7f345659c700 1 -- 172.21.15.163:0/2051832039 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3450009d00 con 0x7f34580feb20 2023-07-14T18:10:38.634 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:38.593+0000 7f345659c700 1 --2- 172.21.15.163:0/2051832039 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f34580feb20 0x7f3458069320 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f344800d980 tx=0x7f344800dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:10:38.634 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:38.593+0000 7f344f7fe700 1 -- 172.21.15.163:0/2051832039 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f344800f890 con 0x7f34580feb20 2023-07-14T18:10:38.634 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:38.593+0000 7f344f7fe700 1 -- 172.21.15.163:0/2051832039 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f344800fe80 con 0x7f34580feb20 2023-07-14T18:10:38.635 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:38.593+0000 7f345cdcf700 1 -- 172.21.15.163:0/2051832039 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f345819fc60 con 0x7f34580feb20 2023-07-14T18:10:38.635 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:38.593+0000 7f344f7fe700 1 -- 172.21.15.163:0/2051832039 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f344800e3b0 con 0x7f34580feb20 2023-07-14T18:10:38.635 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:38.593+0000 7f345cdcf700 1 -- 172.21.15.163:0/2051832039 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f34581a0120 con 0x7f34580feb20 2023-07-14T18:10:38.635 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:38.594+0000 7f345cdcf700 1 -- 172.21.15.163:0/2051832039 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f345810a1d0 con 0x7f34580feb20 2023-07-14T18:10:38.636 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:38.595+0000 7f344f7fe700 1 -- 172.21.15.163:0/2051832039 <== mon.0 v2:172.21.15.163:3300/0 4 ==== mgrmap(e 16) v1 ==== 135716+0+0 (secure 0 0 0) 0x7f344800f9f0 con 0x7f34580feb20 2023-07-14T18:10:38.636 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:38.595+0000 7f344f7fe700 1 --2- 172.21.15.163:0/2051832039 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f34440a1150 0x7f34440a3600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:10:38.636 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:38.596+0000 7f3455d9b700 1 --2- 172.21.15.163:0/2051832039 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f34440a1150 0x7f34440a3600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:10:38.636 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:38.596+0000 7f344f7fe700 1 -- 172.21.15.163:0/2051832039 <== mon.0 v2:172.21.15.163:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f34480cbf70 con 0x7f34580feb20 2023-07-14T18:10:38.636 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:38.596+0000 7f3455d9b700 1 --2- 172.21.15.163:0/2051832039 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f34440a1150 0x7f34440a3600 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f344000ac50 tx=0x7f344000a380 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:10:38.637 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:38.599+0000 7f344f7fe700 1 -- 172.21.15.163:0/2051832039 <== mon.0 v2:172.21.15.163:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178025 (secure 0 0 0) 0x7f3448095b60 con 0x7f34580feb20 2023-07-14T18:10:38.673 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:10:38 smithi184 ceph-mon[98481]: from='client.24403 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi163=a;smithi163=d;smithi163=g;smithi163=j;smithi172=b;smithi172=e;smithi172=h;smithi172=k;smithi184=c;smithi184=f;smithi184=i;smithi184=l", "target": ["mon-mgr", ""]}]: dispatch 2023-07-14T18:10:38.673 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:10:38 smithi184 ceph-mon[98481]: Saving service mds.all spec with placement smithi163=a;smithi163=d;smithi163=g;smithi163=j;smithi172=b;smithi172=e;smithi172=h;smithi172=k;smithi184=c;smithi184=f;smithi184=i;smithi184=l;count:12 2023-07-14T18:10:38.673 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:10:38 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:10:38.673 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:10:38 smithi184 ceph-mon[98481]: pgmap v227: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-07-14T18:10:38.673 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:10:38 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-14T18:10:38.673 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:10:38 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T18:10:38.674 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:10:38 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-14T18:10:38.674 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:10:38 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:10:38.674 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:10:38 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-07-14T18:10:38.674 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:10:38 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-07-14T18:10:38.674 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:10:38 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T18:10:38.674 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:10:38 smithi184 ceph-mon[98481]: Deploying daemon mds.l on smithi184 2023-07-14T18:10:38.773 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:10:38 smithi172 ceph-mon[97983]: from='client.24403 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi163=a;smithi163=d;smithi163=g;smithi163=j;smithi172=b;smithi172=e;smithi172=h;smithi172=k;smithi184=c;smithi184=f;smithi184=i;smithi184=l", "target": ["mon-mgr", ""]}]: dispatch 2023-07-14T18:10:38.774 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:10:38 smithi172 ceph-mon[97983]: Saving service mds.all spec with placement smithi163=a;smithi163=d;smithi163=g;smithi163=j;smithi172=b;smithi172=e;smithi172=h;smithi172=k;smithi184=c;smithi184=f;smithi184=i;smithi184=l;count:12 2023-07-14T18:10:38.774 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:10:38 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:10:38.774 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:10:38 smithi172 ceph-mon[97983]: pgmap v227: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-07-14T18:10:38.774 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:10:38 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-14T18:10:38.774 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:10:38 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T18:10:38.774 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:10:38 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-14T18:10:38.775 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:10:38 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:10:38.775 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:10:38 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-07-14T18:10:38.775 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:10:38 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-07-14T18:10:38.775 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:10:38 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T18:10:38.775 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:10:38 smithi172 ceph-mon[97983]: Deploying daemon mds.l on smithi184 2023-07-14T18:10:38.823 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:38.785+0000 7f345cdcf700 1 -- 172.21.15.163:0/2051832039 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f34581059b0 con 0x7f34580feb20 2023-07-14T18:10:38.824 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:38.786+0000 7f344f7fe700 1 -- 172.21.15.163:0/2051832039 <== mon.0 v2:172.21.15.163:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v76) v1 ==== 93+0+10 (secure 0 0 0) 0x7f3448099180 con 0x7f34580feb20 2023-07-14T18:10:38.824 INFO:teuthology.orchestra.run.smithi163.stdout:pg_num: 1 2023-07-14T18:10:38.826 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:38.788+0000 7f345cdcf700 1 -- 172.21.15.163:0/2051832039 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f34440a1150 msgr2=0x7f34440a3600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:10:38.826 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:38.788+0000 7f345cdcf700 1 --2- 172.21.15.163:0/2051832039 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f34440a1150 0x7f34440a3600 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f344000ac50 tx=0x7f344000a380 comp rx=0 tx=0).stop 2023-07-14T18:10:38.826 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:38.788+0000 7f345cdcf700 1 -- 172.21.15.163:0/2051832039 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f34580feb20 msgr2=0x7f3458069320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:10:38.826 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:38.788+0000 7f345cdcf700 1 --2- 172.21.15.163:0/2051832039 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f34580feb20 0x7f3458069320 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f344800d980 tx=0x7f344800dc90 comp rx=0 tx=0).stop 2023-07-14T18:10:38.826 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:38.788+0000 7f345cdcf700 1 -- 172.21.15.163:0/2051832039 shutdown_connections 2023-07-14T18:10:38.826 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:38.788+0000 7f345cdcf700 1 --2- 172.21.15.163:0/2051832039 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f34440a1150 0x7f34440a3600 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:10:38.826 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:38.788+0000 7f345cdcf700 1 --2- 172.21.15.163:0/2051832039 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f34581006a0 0x7f345819efa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:10:38.827 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:38.788+0000 7f345cdcf700 1 --2- 172.21.15.163:0/2051832039 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f34580feb20 0x7f3458069320 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:10:38.827 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:38.788+0000 7f345cdcf700 1 --2- 172.21.15.163:0/2051832039 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f34580ffd10 0x7f345819ca50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:10:38.827 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:38.788+0000 7f345cdcf700 1 -- 172.21.15.163:0/2051832039 >> 172.21.15.163:0/2051832039 conn(0x7f34580fa160 msgr2=0x7f34580fc320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:10:38.827 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:38.788+0000 7f345cdcf700 1 -- 172.21.15.163:0/2051832039 shutdown_connections 2023-07-14T18:10:38.827 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:38.788+0000 7f345cdcf700 1 -- 172.21.15.163:0/2051832039 wait complete. 2023-07-14T18:10:38.838 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-14T18:10:38.960 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:38.921+0000 7fd1ad720700 1 -- 172.21.15.163:0/4256112875 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fd1a81006d0 msgr2=0x7fd1a8102ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:10:38.960 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:38.921+0000 7fd1ad720700 1 --2- 172.21.15.163:0/4256112875 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fd1a81006d0 0x7fd1a8102ab0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fd198009990 tx=0x7fd198009ca0 comp rx=0 tx=0).stop 2023-07-14T18:10:38.960 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:38.922+0000 7fd1ad720700 1 -- 172.21.15.163:0/4256112875 shutdown_connections 2023-07-14T18:10:38.960 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:38.922+0000 7fd1ad720700 1 --2- 172.21.15.163:0/4256112875 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd1a8105910 0x7fd1a8107d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:10:38.961 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:38.922+0000 7fd1ad720700 1 --2- 172.21.15.163:0/4256112875 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fd1a81006d0 0x7fd1a8102ab0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:10:38.961 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:38.922+0000 7fd1ad720700 1 --2- 172.21.15.163:0/4256112875 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd1a8102ff0 0x7fd1a81053d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:10:38.961 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:38.922+0000 7fd1ad720700 1 -- 172.21.15.163:0/4256112875 >> 172.21.15.163:0/4256112875 conn(0x7fd1a80fa130 msgr2=0x7fd1a80fc560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:10:38.961 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:38.922+0000 7fd1ad720700 1 -- 172.21.15.163:0/4256112875 shutdown_connections 2023-07-14T18:10:38.961 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:38.922+0000 7fd1ad720700 1 -- 172.21.15.163:0/4256112875 wait complete. 2023-07-14T18:10:38.961 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:38.922+0000 7fd1ad720700 1 Processor -- start 2023-07-14T18:10:38.961 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:38.922+0000 7fd1ad720700 1 -- start start 2023-07-14T18:10:38.963 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:38.922+0000 7fd1ad720700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd1a81006d0 0x7fd1a8197ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:10:38.963 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:38.922+0000 7fd1ad720700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fd1a8102ff0 0x7fd1a8198000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:10:38.963 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:38.922+0000 7fd1ad720700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd1a8105910 0x7fd1a819f070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:10:38.963 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:38.922+0000 7fd1ad720700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1a819f640 con 0x7fd1a8102ff0 2023-07-14T18:10:38.963 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:38.922+0000 7fd1ad720700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1a819f780 con 0x7fd1a81006d0 2023-07-14T18:10:38.964 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:38.922+0000 7fd1ad720700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1a819f910 con 0x7fd1a8105910 2023-07-14T18:10:38.964 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:38.923+0000 7fd1a67fc700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fd1a8102ff0 0x7fd1a8198000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:10:38.964 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:38.923+0000 7fd1a67fc700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fd1a8102ff0 0x7fd1a8198000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:55432/0 (socket says 172.21.15.163:55432) 2023-07-14T18:10:38.964 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:38.923+0000 7fd1a67fc700 1 -- 172.21.15.163:0/2155728489 learned_addr learned my addr 172.21.15.163:0/2155728489 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:10:38.964 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:38.923+0000 7fd1a6ffd700 1 --2- 172.21.15.163:0/2155728489 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd1a81006d0 0x7fd1a8197ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:10:38.964 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:38.923+0000 7fd1a67fc700 1 -- 172.21.15.163:0/2155728489 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd1a8105910 msgr2=0x7fd1a819f070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:10:38.965 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:38.923+0000 7fd1a67fc700 1 --2- 172.21.15.163:0/2155728489 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd1a8105910 0x7fd1a819f070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:10:38.965 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:38.923+0000 7fd1a67fc700 1 -- 172.21.15.163:0/2155728489 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd1a81006d0 msgr2=0x7fd1a8197ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:10:38.965 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:38.923+0000 7fd1a67fc700 1 --2- 172.21.15.163:0/2155728489 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd1a81006d0 0x7fd1a8197ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:10:38.965 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:38.923+0000 7fd1a67fc700 1 -- 172.21.15.163:0/2155728489 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1980095f0 con 0x7fd1a8102ff0 2023-07-14T18:10:38.965 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:38.923+0000 7fd1a67fc700 1 --2- 172.21.15.163:0/2155728489 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fd1a8102ff0 0x7fd1a8198000 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fd19c00d980 tx=0x7fd19c00dd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:10:38.965 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:38.923+0000 7fd18ffff700 1 -- 172.21.15.163:0/2155728489 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd19c00bb60 con 0x7fd1a8102ff0 2023-07-14T18:10:38.966 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:38.923+0000 7fd1ad720700 1 -- 172.21.15.163:0/2155728489 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd1a819fbf0 con 0x7fd1a8102ff0 2023-07-14T18:10:38.966 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:38.923+0000 7fd18ffff700 1 -- 172.21.15.163:0/2155728489 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fd19c007640 con 0x7fd1a8102ff0 2023-07-14T18:10:38.966 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:38.923+0000 7fd18ffff700 1 -- 172.21.15.163:0/2155728489 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd19c004d60 con 0x7fd1a8102ff0 2023-07-14T18:10:38.966 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:38.923+0000 7fd1ad720700 1 -- 172.21.15.163:0/2155728489 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1a81a0150 con 0x7fd1a8102ff0 2023-07-14T18:10:38.967 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:38.924+0000 7fd1ad720700 1 -- 172.21.15.163:0/2155728489 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd1a8107480 con 0x7fd1a8102ff0 2023-07-14T18:10:38.967 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:38.925+0000 7fd18ffff700 1 -- 172.21.15.163:0/2155728489 <== mon.0 v2:172.21.15.163:3300/0 4 ==== mgrmap(e 16) v1 ==== 135716+0+0 (secure 0 0 0) 0x7fd19c004020 con 0x7fd1a8102ff0 2023-07-14T18:10:38.968 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:38.926+0000 7fd18ffff700 1 --2- 172.21.15.163:0/2155728489 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7fd1900a11a0 0x7fd1900a3650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:10:38.968 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:38.926+0000 7fd1a6ffd700 1 --2- 172.21.15.163:0/2155728489 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7fd1900a11a0 0x7fd1900a3650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:10:38.969 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:38.926+0000 7fd18ffff700 1 -- 172.21.15.163:0/2155728489 <== mon.0 v2:172.21.15.163:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 7127+0+0 (secure 0 0 0) 0x7fd19c0cc870 con 0x7fd1a8102ff0 2023-07-14T18:10:38.969 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:38.926+0000 7fd1a6ffd700 1 --2- 172.21.15.163:0/2155728489 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7fd1900a11a0 0x7fd1900a3650 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fd19800b5c0 tx=0x7fd198005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:10:38.969 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:38.929+0000 7fd18ffff700 1 -- 172.21.15.163:0/2155728489 <== mon.0 v2:172.21.15.163:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178025 (secure 0 0 0) 0x7fd19c096460 con 0x7fd1a8102ff0 2023-07-14T18:10:39.046 INFO:journalctl@ceph.mds.l.smithi184.stdout:Jul 14 18:10:39 smithi184 systemd[1]: Starting Ceph mds.l for bf7326ec-2270-11ee-9b33-001a4aab830c... 2023-07-14T18:10:39.203 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:39.166+0000 7fd1ad720700 1 -- 172.21.15.163:0/2155728489 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd1a802c8e0 con 0x7fd1a8102ff0 2023-07-14T18:10:39.204 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:39.166+0000 7fd18ffff700 1 -- 172.21.15.163:0/2155728489 <== mon.0 v2:172.21.15.163:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 1 v1) v1 ==== 93+0+501 (secure 0 0 0) 0x7fd19c00de60 con 0x7fd1a8102ff0 2023-07-14T18:10:39.204 INFO:teuthology.orchestra.run.smithi163.stdout: 2023-07-14T18:10:39.205 INFO:teuthology.orchestra.run.smithi163.stdout:{"epoch":1,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[]} 2023-07-14T18:10:39.206 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:39.168+0000 7fd1ad720700 1 -- 172.21.15.163:0/2155728489 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7fd1900a11a0 msgr2=0x7fd1900a3650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:10:39.206 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:39.168+0000 7fd1ad720700 1 --2- 172.21.15.163:0/2155728489 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7fd1900a11a0 0x7fd1900a3650 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fd19800b5c0 tx=0x7fd198005fb0 comp rx=0 tx=0).stop 2023-07-14T18:10:39.206 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:39.168+0000 7fd1ad720700 1 -- 172.21.15.163:0/2155728489 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fd1a8102ff0 msgr2=0x7fd1a8198000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:10:39.207 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:39.168+0000 7fd1ad720700 1 --2- 172.21.15.163:0/2155728489 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fd1a8102ff0 0x7fd1a8198000 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fd19c00d980 tx=0x7fd19c00dd40 comp rx=0 tx=0).stop 2023-07-14T18:10:39.207 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:39.168+0000 7fd1ad720700 1 -- 172.21.15.163:0/2155728489 shutdown_connections 2023-07-14T18:10:39.207 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:39.168+0000 7fd1ad720700 1 --2- 172.21.15.163:0/2155728489 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7fd1900a11a0 0x7fd1900a3650 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:10:39.207 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:39.168+0000 7fd1ad720700 1 --2- 172.21.15.163:0/2155728489 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd1a8105910 0x7fd1a819f070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:10:39.207 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:39.168+0000 7fd1ad720700 1 --2- 172.21.15.163:0/2155728489 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd1a81006d0 0x7fd1a8197ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:10:39.207 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:39.168+0000 7fd1ad720700 1 --2- 172.21.15.163:0/2155728489 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fd1a8102ff0 0x7fd1a8198000 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:10:39.207 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:39.168+0000 7fd1ad720700 1 -- 172.21.15.163:0/2155728489 >> 172.21.15.163:0/2155728489 conn(0x7fd1a80fa130 msgr2=0x7fd1a80fed50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:10:39.207 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:39.168+0000 7fd1ad720700 1 -- 172.21.15.163:0/2155728489 shutdown_connections 2023-07-14T18:10:39.208 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:39.168+0000 7fd1ad720700 1 -- 172.21.15.163:0/2155728489 wait complete. 2023-07-14T18:10:39.208 INFO:teuthology.orchestra.run.smithi163.stderr:dumped fsmap epoch 1 2023-07-14T18:10:39.582 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:10:39 smithi184 ceph-mon[98481]: from='client.? 172.21.15.163:0/2613134923' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-07-14T18:10:39.582 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:10:39 smithi184 ceph-mon[98481]: from='client.? 172.21.15.163:0/2051832039' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-07-14T18:10:39.582 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:10:39 smithi184 ceph-mon[98481]: from='client.? 172.21.15.163:0/2155728489' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-07-14T18:10:39.583 INFO:journalctl@ceph.mds.l.smithi184.stdout:Jul 14 18:10:39 smithi184 podman[123631]: 2023-07-14T18:10:39.583 INFO:journalctl@ceph.mds.l.smithi184.stdout:Jul 14 18:10:39 smithi184 ceph-mds[123671]: -- 172.21.15.184:0/4080805418 <== mon.1 v2:172.21.15.184:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55acaadb71e0 con 0x55acaad8cc00 2023-07-14T18:10:39.583 INFO:journalctl@ceph.mds.l.smithi184.stdout:Jul 14 18:10:39 smithi184 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-mds-l[123647]: starting mds.l at 2023-07-14T18:10:39.715 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:10:39 smithi163 ceph-mon[96576]: from='client.? 172.21.15.163:0/2613134923' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-07-14T18:10:39.715 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:10:39 smithi163 ceph-mon[96576]: from='client.? 172.21.15.163:0/2051832039' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-07-14T18:10:39.715 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:10:39 smithi163 ceph-mon[96576]: from='client.? 172.21.15.163:0/2155728489' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-07-14T18:10:39.773 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:10:39 smithi172 ceph-mon[97983]: from='client.? 172.21.15.163:0/2613134923' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-07-14T18:10:39.773 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:10:39 smithi172 ceph-mon[97983]: from='client.? 172.21.15.163:0/2051832039' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-07-14T18:10:39.774 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:10:39 smithi172 ceph-mon[97983]: from='client.? 172.21.15.163:0/2155728489' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-07-14T18:10:39.922 INFO:journalctl@ceph.mds.l.smithi184.stdout:Jul 14 18:10:39 smithi184 bash[123631]: 8b0027c4fd29021a88df041cf78ff530951a1382982e9e30ae8cbd57f45d0c65 2023-07-14T18:10:39.923 INFO:journalctl@ceph.mds.l.smithi184.stdout:Jul 14 18:10:39 smithi184 systemd[1]: Started Ceph mds.l for bf7326ec-2270-11ee-9b33-001a4aab830c. 2023-07-14T18:10:40.650 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:10:40 smithi172 ceph-mon[97983]: pgmap v228: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-07-14T18:10:40.650 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:10:40 smithi172 ceph-mon[97983]: mds.? [v2:172.21.15.184:6832/797722972,v1:172.21.15.184:6833/797722972] up:boot 2023-07-14T18:10:40.650 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:10:40 smithi172 ceph-mon[97983]: fsmap 1 up:standby 2023-07-14T18:10:40.650 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:10:40 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2023-07-14T18:10:40.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:10:40 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:10:40.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:10:40 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:10:40.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:10:40 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:10:40.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:10:40 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-07-14T18:10:40.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:10:40 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-07-14T18:10:40.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:10:40 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T18:10:40.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:10:40 smithi172 ceph-mon[97983]: Deploying daemon mds.k on smithi172 2023-07-14T18:10:40.922 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:10:40 smithi184 ceph-mon[98481]: pgmap v228: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-07-14T18:10:40.923 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:10:40 smithi184 ceph-mon[98481]: mds.? [v2:172.21.15.184:6832/797722972,v1:172.21.15.184:6833/797722972] up:boot 2023-07-14T18:10:40.923 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:10:40 smithi184 ceph-mon[98481]: fsmap 1 up:standby 2023-07-14T18:10:40.923 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:10:40 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2023-07-14T18:10:40.923 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:10:40 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:10:40.923 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:10:40 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:10:40.923 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:10:40 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:10:40.924 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:10:40 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-07-14T18:10:40.924 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:10:40 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-07-14T18:10:40.924 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:10:40 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T18:10:40.924 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:10:40 smithi184 ceph-mon[98481]: Deploying daemon mds.k on smithi172 2023-07-14T18:10:40.965 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:10:40 smithi163 ceph-mon[96576]: pgmap v228: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-07-14T18:10:40.965 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:10:40 smithi163 ceph-mon[96576]: mds.? [v2:172.21.15.184:6832/797722972,v1:172.21.15.184:6833/797722972] up:boot 2023-07-14T18:10:40.965 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:10:40 smithi163 ceph-mon[96576]: fsmap 1 up:standby 2023-07-14T18:10:40.965 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:10:40 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2023-07-14T18:10:40.966 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:10:40 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:10:40.966 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:10:40 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:10:40.966 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:10:40 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:10:40.966 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:10:40 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-07-14T18:10:40.966 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:10:40 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-07-14T18:10:40.966 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:10:40 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T18:10:40.966 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:10:40 smithi163 ceph-mon[96576]: Deploying daemon mds.k on smithi172 2023-07-14T18:10:41.219 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-14T18:10:41.274 INFO:journalctl@ceph.mds.k.smithi172.stdout:Jul 14 18:10:41 smithi172 systemd[1]: Starting Ceph mds.k for bf7326ec-2270-11ee-9b33-001a4aab830c... 2023-07-14T18:10:41.354 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:41.316+0000 7f8562f12700 1 -- 172.21.15.163:0/1269943953 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f855c0fedd0 msgr2=0x7f855c0ff240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:10:41.354 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:41.316+0000 7f8562f12700 1 --2- 172.21.15.163:0/1269943953 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f855c0fedd0 0x7f855c0ff240 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f8548009990 tx=0x7f8548009ca0 comp rx=0 tx=0).stop 2023-07-14T18:10:41.355 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:41.316+0000 7f8562f12700 1 -- 172.21.15.163:0/1269943953 shutdown_connections 2023-07-14T18:10:41.355 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:41.316+0000 7f8562f12700 1 --2- 172.21.15.163:0/1269943953 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f855c0ff780 0x7f855c107030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:10:41.355 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:41.316+0000 7f8562f12700 1 --2- 172.21.15.163:0/1269943953 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f855c100180 0x7f855c100590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:10:41.355 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:41.316+0000 7f8562f12700 1 --2- 172.21.15.163:0/1269943953 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f855c0fedd0 0x7f855c0ff240 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:10:41.355 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:41.316+0000 7f8562f12700 1 -- 172.21.15.163:0/1269943953 >> 172.21.15.163:0/1269943953 conn(0x7f855c0f9990 msgr2=0x7f855c0fbda0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:10:41.355 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:41.316+0000 7f8562f12700 1 -- 172.21.15.163:0/1269943953 shutdown_connections 2023-07-14T18:10:41.355 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:41.316+0000 7f8562f12700 1 -- 172.21.15.163:0/1269943953 wait complete. 2023-07-14T18:10:41.356 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:41.316+0000 7f8562f12700 1 Processor -- start 2023-07-14T18:10:41.356 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:41.316+0000 7f8562f12700 1 -- start start 2023-07-14T18:10:41.357 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:41.317+0000 7f8562f12700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f855c0fedd0 0x7f855c1957f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:10:41.357 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:41.317+0000 7f8562f12700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f855c0ff780 0x7f855c195d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:10:41.357 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:41.317+0000 7f8562f12700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f855c100180 0x7f855c19cda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:10:41.358 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:41.317+0000 7f8562f12700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f855c19d370 con 0x7f855c100180 2023-07-14T18:10:41.358 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:41.317+0000 7f8562f12700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f855c19d4b0 con 0x7f855c0ff780 2023-07-14T18:10:41.358 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:41.317+0000 7f8562f12700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f855c19d640 con 0x7f855c0fedd0 2023-07-14T18:10:41.358 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:41.317+0000 7f85614af700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f855c100180 0x7f855c19cda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:10:41.358 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:41.317+0000 7f85614af700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f855c100180 0x7f855c19cda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:55448/0 (socket says 172.21.15.163:55448) 2023-07-14T18:10:41.358 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:41.317+0000 7f85614af700 1 -- 172.21.15.163:0/3096927619 learned_addr learned my addr 172.21.15.163:0/3096927619 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:10:41.358 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:41.317+0000 7f855bfff700 1 --2- 172.21.15.163:0/3096927619 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f855c0ff780 0x7f855c195d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:10:41.359 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:41.317+0000 7f8560cae700 1 --2- 172.21.15.163:0/3096927619 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f855c0fedd0 0x7f855c1957f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:10:41.359 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:41.317+0000 7f85614af700 1 -- 172.21.15.163:0/3096927619 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f855c0fedd0 msgr2=0x7f855c1957f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:10:41.359 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:41.317+0000 7f85614af700 1 --2- 172.21.15.163:0/3096927619 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f855c0fedd0 0x7f855c1957f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:10:41.359 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:41.317+0000 7f85614af700 1 -- 172.21.15.163:0/3096927619 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f855c0ff780 msgr2=0x7f855c195d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:10:41.359 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:41.317+0000 7f85614af700 1 --2- 172.21.15.163:0/3096927619 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f855c0ff780 0x7f855c195d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:10:41.359 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:41.317+0000 7f85614af700 1 -- 172.21.15.163:0/3096927619 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85480095f0 con 0x7f855c100180 2023-07-14T18:10:41.359 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:41.317+0000 7f85614af700 1 --2- 172.21.15.163:0/3096927619 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f855c100180 0x7f855c19cda0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f8554007ee0 tx=0x7f855400d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:10:41.360 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:41.317+0000 7f8559ffb700 1 -- 172.21.15.163:0/3096927619 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8554017070 con 0x7f855c100180 2023-07-14T18:10:41.360 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:41.317+0000 7f8559ffb700 1 -- 172.21.15.163:0/3096927619 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f855400f040 con 0x7f855c100180 2023-07-14T18:10:41.360 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:41.317+0000 7f8562f12700 1 -- 172.21.15.163:0/3096927619 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f855c19d920 con 0x7f855c100180 2023-07-14T18:10:41.360 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:41.317+0000 7f8559ffb700 1 -- 172.21.15.163:0/3096927619 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8554005570 con 0x7f855c100180 2023-07-14T18:10:41.360 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:41.318+0000 7f8562f12700 1 -- 172.21.15.163:0/3096927619 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f855c19de30 con 0x7f855c100180 2023-07-14T18:10:41.360 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:41.319+0000 7f8562f12700 1 -- 172.21.15.163:0/3096927619 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f855c10a260 con 0x7f855c100180 2023-07-14T18:10:41.360 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:41.319+0000 7f8559ffb700 1 -- 172.21.15.163:0/3096927619 <== mon.0 v2:172.21.15.163:3300/0 4 ==== mgrmap(e 16) v1 ==== 135716+0+0 (secure 0 0 0) 0x7f855400db20 con 0x7f855c100180 2023-07-14T18:10:41.361 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:41.320+0000 7f8559ffb700 1 --2- 172.21.15.163:0/3096927619 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f854c0a11a0 0x7f854c0a3650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:10:41.361 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:41.320+0000 7f8560cae700 1 --2- 172.21.15.163:0/3096927619 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f854c0a11a0 0x7f854c0a3650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:10:41.361 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:41.320+0000 7f8559ffb700 1 -- 172.21.15.163:0/3096927619 <== mon.0 v2:172.21.15.163:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f85540cbba0 con 0x7f855c100180 2023-07-14T18:10:41.361 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:41.321+0000 7f8560cae700 1 --2- 172.21.15.163:0/3096927619 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f854c0a11a0 0x7f854c0a3650 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f8550009c60 tx=0x7f8550009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:10:41.362 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:41.325+0000 7f8559ffb700 1 -- 172.21.15.163:0/3096927619 <== mon.0 v2:172.21.15.163:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178025 (secure 0 0 0) 0x7f8554095790 con 0x7f855c100180 2023-07-14T18:10:41.593 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:41.555+0000 7f8562f12700 1 -- 172.21.15.163:0/3096927619 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f855c19e470 con 0x7f855c100180 2023-07-14T18:10:41.594 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:41.556+0000 7f8559ffb700 1 -- 172.21.15.163:0/3096927619 <== mon.0 v2:172.21.15.163:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) v1 ==== 93+0+1257 (secure 0 0 0) 0x7f8554098db0 con 0x7f855c100180 2023-07-14T18:10:41.594 INFO:teuthology.orchestra.run.smithi163.stdout: 2023-07-14T18:10:41.594 INFO:teuthology.orchestra.run.smithi163.stdout:{"epoch":2,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24421,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6833/797722972","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6832","nonce":797722972},{"type":"v1","addr":"172.21.15.184:6833","nonce":797722972}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[]} 2023-07-14T18:10:41.596 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:41.558+0000 7f8562f12700 1 -- 172.21.15.163:0/3096927619 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f854c0a11a0 msgr2=0x7f854c0a3650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:10:41.596 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:41.558+0000 7f8562f12700 1 --2- 172.21.15.163:0/3096927619 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f854c0a11a0 0x7f854c0a3650 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f8550009c60 tx=0x7f8550009260 comp rx=0 tx=0).stop 2023-07-14T18:10:41.596 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:41.558+0000 7f8562f12700 1 -- 172.21.15.163:0/3096927619 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f855c100180 msgr2=0x7f855c19cda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:10:41.596 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:41.558+0000 7f8562f12700 1 --2- 172.21.15.163:0/3096927619 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f855c100180 0x7f855c19cda0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f8554007ee0 tx=0x7f855400d3b0 comp rx=0 tx=0).stop 2023-07-14T18:10:41.597 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:41.558+0000 7f8562f12700 1 -- 172.21.15.163:0/3096927619 shutdown_connections 2023-07-14T18:10:41.597 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:41.558+0000 7f8562f12700 1 --2- 172.21.15.163:0/3096927619 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f854c0a11a0 0x7f854c0a3650 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:10:41.597 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:41.558+0000 7f8562f12700 1 --2- 172.21.15.163:0/3096927619 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f855c0fedd0 0x7f855c1957f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:10:41.597 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:41.558+0000 7f8562f12700 1 --2- 172.21.15.163:0/3096927619 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f855c100180 0x7f855c19cda0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:10:41.597 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:41.558+0000 7f8562f12700 1 --2- 172.21.15.163:0/3096927619 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f855c0ff780 0x7f855c195d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:10:41.597 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:41.558+0000 7f8562f12700 1 -- 172.21.15.163:0/3096927619 >> 172.21.15.163:0/3096927619 conn(0x7f855c0f9990 msgr2=0x7f855c0fdce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:10:41.597 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:41.558+0000 7f8562f12700 1 -- 172.21.15.163:0/3096927619 shutdown_connections 2023-07-14T18:10:41.598 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:41.558+0000 7f8562f12700 1 -- 172.21.15.163:0/3096927619 wait complete. 2023-07-14T18:10:41.598 INFO:teuthology.orchestra.run.smithi163.stderr:dumped fsmap epoch 2 2023-07-14T18:10:41.771 INFO:journalctl@ceph.mds.k.smithi172.stdout:Jul 14 18:10:41 smithi172 podman[122210]: 2023-07-14T18:10:41.771 INFO:journalctl@ceph.mds.k.smithi172.stdout:Jul 14 18:10:41 smithi172 ceph-mds[122250]: -- 172.21.15.172:0/858544593 <== mon.2 v2:172.21.15.172:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x564e0eea11e0 con 0x564e0ee76800 2023-07-14T18:10:41.771 INFO:journalctl@ceph.mds.k.smithi172.stdout:Jul 14 18:10:41 smithi172 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-mds-k[122226]: starting mds.k at 2023-07-14T18:10:41.965 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:10:41 smithi163 ceph-mon[96576]: from='client.? 172.21.15.163:0/3096927619' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-07-14T18:10:42.023 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:10:41 smithi172 ceph-mon[97983]: from='client.? 172.21.15.163:0/3096927619' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-07-14T18:10:42.024 INFO:journalctl@ceph.mds.k.smithi172.stdout:Jul 14 18:10:41 smithi172 bash[122210]: 83e8e29972ac14177bda6b60979a22c2b2dc8c4da8c790ad3c994ffccf8afdc9 2023-07-14T18:10:42.024 INFO:journalctl@ceph.mds.k.smithi172.stdout:Jul 14 18:10:41 smithi172 systemd[1]: Started Ceph mds.k for bf7326ec-2270-11ee-9b33-001a4aab830c. 2023-07-14T18:10:42.173 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:10:41 smithi184 ceph-mon[98481]: from='client.? 172.21.15.163:0/3096927619' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-07-14T18:10:43.110 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:10:42 smithi163 ceph-mon[96576]: pgmap v229: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-07-14T18:10:43.110 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:10:42 smithi163 ceph-mon[96576]: mds.? [v2:172.21.15.172:6832/1075696311,v1:172.21.15.172:6833/1075696311] up:boot 2023-07-14T18:10:43.110 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:10:42 smithi163 ceph-mon[96576]: fsmap 2 up:standby 2023-07-14T18:10:43.110 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:10:42 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2023-07-14T18:10:43.110 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:10:42 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:10:43.111 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:10:42 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:10:43.111 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:10:42 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:10:43.111 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:10:42 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-07-14T18:10:43.111 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:10:42 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-07-14T18:10:43.111 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:10:42 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T18:10:43.173 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:10:42 smithi184 ceph-mon[98481]: pgmap v229: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-07-14T18:10:43.173 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:10:42 smithi184 ceph-mon[98481]: mds.? [v2:172.21.15.172:6832/1075696311,v1:172.21.15.172:6833/1075696311] up:boot 2023-07-14T18:10:43.173 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:10:42 smithi184 ceph-mon[98481]: fsmap 2 up:standby 2023-07-14T18:10:43.173 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:10:42 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2023-07-14T18:10:43.173 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:10:42 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:10:43.173 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:10:42 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:10:43.174 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:10:42 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:10:43.174 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:10:42 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-07-14T18:10:43.174 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:10:42 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-07-14T18:10:43.174 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:10:42 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T18:10:43.274 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:10:42 smithi172 ceph-mon[97983]: pgmap v229: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-07-14T18:10:43.274 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:10:42 smithi172 ceph-mon[97983]: mds.? [v2:172.21.15.172:6832/1075696311,v1:172.21.15.172:6833/1075696311] up:boot 2023-07-14T18:10:43.274 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:10:42 smithi172 ceph-mon[97983]: fsmap 2 up:standby 2023-07-14T18:10:43.274 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:10:42 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2023-07-14T18:10:43.274 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:10:42 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:10:43.274 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:10:42 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:10:43.275 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:10:42 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:10:43.275 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:10:42 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-07-14T18:10:43.275 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:10:42 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-07-14T18:10:43.275 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:10:42 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T18:10:43.465 INFO:journalctl@ceph.mds.j.smithi163.stdout:Jul 14 18:10:43 smithi163 systemd[1]: Starting Ceph mds.j for bf7326ec-2270-11ee-9b33-001a4aab830c... 2023-07-14T18:10:43.610 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-14T18:10:43.750 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:43.712+0000 7f542f705700 1 -- 172.21.15.163:0/3124200882 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f54281006a0 msgr2=0x7f5428106f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:10:43.750 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:43.712+0000 7f542f705700 1 --2- 172.21.15.163:0/3124200882 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f54281006a0 0x7f5428106f60 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f5420009990 tx=0x7f5420009ca0 comp rx=0 tx=0).stop 2023-07-14T18:10:43.750 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:43.712+0000 7f542f705700 1 -- 172.21.15.163:0/3124200882 shutdown_connections 2023-07-14T18:10:43.750 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:43.712+0000 7f542f705700 1 --2- 172.21.15.163:0/3124200882 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f54280feb20 0x7f54280fef30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:10:43.751 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:43.712+0000 7f542f705700 1 --2- 172.21.15.163:0/3124200882 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f54281006a0 0x7f5428106f60 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:10:43.751 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:43.712+0000 7f542f705700 1 --2- 172.21.15.163:0/3124200882 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f54280ffd10 0x7f5428100160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:10:43.751 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:43.712+0000 7f542f705700 1 -- 172.21.15.163:0/3124200882 >> 172.21.15.163:0/3124200882 conn(0x7f54280fa120 msgr2=0x7f54280fc570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:10:43.751 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:43.712+0000 7f542f705700 1 -- 172.21.15.163:0/3124200882 shutdown_connections 2023-07-14T18:10:43.751 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:43.712+0000 7f542f705700 1 -- 172.21.15.163:0/3124200882 wait complete. 2023-07-14T18:10:43.753 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:43.712+0000 7f542f705700 1 Processor -- start 2023-07-14T18:10:43.753 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:43.712+0000 7f542f705700 1 -- start start 2023-07-14T18:10:43.753 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:43.713+0000 7f542f705700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f54280feb20 0x7f5428069590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:10:43.753 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:43.713+0000 7f542f705700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f54280ffd10 0x7f542819a4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:10:43.754 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:43.713+0000 7f542f705700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f54281006a0 0x7f542819cb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:10:43.754 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:43.713+0000 7f542f705700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f542819d2f0 con 0x7f54280feb20 2023-07-14T18:10:43.754 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:43.713+0000 7f542f705700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f542819d460 con 0x7f54280ffd10 2023-07-14T18:10:43.754 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:43.713+0000 7f542f705700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f542819d620 con 0x7f54281006a0 2023-07-14T18:10:43.754 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:43.713+0000 7f542d4a1700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f54280feb20 0x7f5428069590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:10:43.754 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:43.713+0000 7f542d4a1700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f54280feb20 0x7f5428069590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:55456/0 (socket says 172.21.15.163:55456) 2023-07-14T18:10:43.755 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:43.713+0000 7f542d4a1700 1 -- 172.21.15.163:0/4200331630 learned_addr learned my addr 172.21.15.163:0/4200331630 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:10:43.755 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:43.713+0000 7f542cca0700 1 --2- 172.21.15.163:0/4200331630 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f54280ffd10 0x7f542819a4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:10:43.755 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:43.713+0000 7f542dca2700 1 --2- 172.21.15.163:0/4200331630 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f54281006a0 0x7f542819cb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:10:43.755 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:43.713+0000 7f542d4a1700 1 -- 172.21.15.163:0/4200331630 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f54281006a0 msgr2=0x7f542819cb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:10:43.755 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:43.713+0000 7f542d4a1700 1 --2- 172.21.15.163:0/4200331630 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f54281006a0 0x7f542819cb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:10:43.755 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:43.713+0000 7f542d4a1700 1 -- 172.21.15.163:0/4200331630 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f54280ffd10 msgr2=0x7f542819a4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:10:43.755 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:43.713+0000 7f542d4a1700 1 --2- 172.21.15.163:0/4200331630 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f54280ffd10 0x7f542819a4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:10:43.755 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:43.713+0000 7f542d4a1700 1 -- 172.21.15.163:0/4200331630 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54200095f0 con 0x7f54280feb20 2023-07-14T18:10:43.756 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:43.713+0000 7f542d4a1700 1 --2- 172.21.15.163:0/4200331630 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f54280feb20 0x7f5428069590 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f541800efc0 tx=0x7f541800c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:10:43.756 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:43.713+0000 7f54267fc700 1 -- 172.21.15.163:0/4200331630 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5418018070 con 0x7f54280feb20 2023-07-14T18:10:43.756 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:43.713+0000 7f54267fc700 1 -- 172.21.15.163:0/4200331630 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f541800f040 con 0x7f54280feb20 2023-07-14T18:10:43.756 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:43.713+0000 7f542f705700 1 -- 172.21.15.163:0/4200331630 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f542819d8a0 con 0x7f54280feb20 2023-07-14T18:10:43.756 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:43.713+0000 7f54267fc700 1 -- 172.21.15.163:0/4200331630 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5418004280 con 0x7f54280feb20 2023-07-14T18:10:43.756 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:43.713+0000 7f542f705700 1 -- 172.21.15.163:0/4200331630 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f542819ddb0 con 0x7f54280feb20 2023-07-14T18:10:43.756 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:43.714+0000 7f542f705700 1 -- 172.21.15.163:0/4200331630 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5428106080 con 0x7f54280feb20 2023-07-14T18:10:43.757 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:43.715+0000 7f54267fc700 1 -- 172.21.15.163:0/4200331630 <== mon.0 v2:172.21.15.163:3300/0 4 ==== mgrmap(e 16) v1 ==== 135716+0+0 (secure 0 0 0) 0x7f541800ca70 con 0x7f54280feb20 2023-07-14T18:10:43.757 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:43.716+0000 7f54267fc700 1 --2- 172.21.15.163:0/4200331630 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f54100a11a0 0x7f54100a3650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:10:43.757 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:43.716+0000 7f54267fc700 1 -- 172.21.15.163:0/4200331630 <== mon.0 v2:172.21.15.163:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f54180ccdb0 con 0x7f54280feb20 2023-07-14T18:10:43.758 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:43.716+0000 7f542cca0700 1 --2- 172.21.15.163:0/4200331630 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f54100a11a0 0x7f54100a3650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:10:43.758 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:43.716+0000 7f542cca0700 1 --2- 172.21.15.163:0/4200331630 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f54100a11a0 0x7f54100a3650 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f5428069300 tx=0x7f541c00b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:10:43.758 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:43.719+0000 7f54267fc700 1 -- 172.21.15.163:0/4200331630 <== mon.0 v2:172.21.15.163:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178025 (secure 0 0 0) 0x7f5418096a30 con 0x7f54280feb20 2023-07-14T18:10:43.950 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:10:43 smithi163 ceph-mon[96576]: Deploying daemon mds.j on smithi163 2023-07-14T18:10:43.950 INFO:journalctl@ceph.mds.j.smithi163.stdout:Jul 14 18:10:43 smithi163 podman[129751]: 2023-07-14T18:10:44.002 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:43.965+0000 7f542f705700 1 -- 172.21.15.163:0/4200331630 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f542802cb50 con 0x7f54280feb20 2023-07-14T18:10:44.003 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:43.965+0000 7f54267fc700 1 -- 172.21.15.163:0/4200331630 <== mon.0 v2:172.21.15.163:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) v1 ==== 93+0+2017 (secure 0 0 0) 0x7f5418013ed0 con 0x7f54280feb20 2023-07-14T18:10:44.004 INFO:teuthology.orchestra.run.smithi163.stdout: 2023-07-14T18:10:44.004 INFO:teuthology.orchestra.run.smithi163.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24421,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6833/797722972","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6832","nonce":797722972},{"type":"v1","addr":"172.21.15.184:6833","nonce":797722972}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":24431,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6833/1075696311","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":1075696311},{"type":"v1","addr":"172.21.15.172:6833","nonce":1075696311}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[]} 2023-07-14T18:10:44.005 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:43.967+0000 7f542f705700 1 -- 172.21.15.163:0/4200331630 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f54100a11a0 msgr2=0x7f54100a3650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:10:44.005 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:43.967+0000 7f542f705700 1 --2- 172.21.15.163:0/4200331630 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f54100a11a0 0x7f54100a3650 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f5428069300 tx=0x7f541c00b410 comp rx=0 tx=0).stop 2023-07-14T18:10:44.005 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:43.967+0000 7f542f705700 1 -- 172.21.15.163:0/4200331630 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f54280feb20 msgr2=0x7f5428069590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:10:44.005 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:43.967+0000 7f542f705700 1 --2- 172.21.15.163:0/4200331630 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f54280feb20 0x7f5428069590 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f541800efc0 tx=0x7f541800c3a0 comp rx=0 tx=0).stop 2023-07-14T18:10:44.006 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:43.967+0000 7f542f705700 1 -- 172.21.15.163:0/4200331630 shutdown_connections 2023-07-14T18:10:44.006 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:43.967+0000 7f542f705700 1 --2- 172.21.15.163:0/4200331630 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f54100a11a0 0x7f54100a3650 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:10:44.006 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:43.967+0000 7f542f705700 1 --2- 172.21.15.163:0/4200331630 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f54281006a0 0x7f542819cb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:10:44.006 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:43.967+0000 7f542f705700 1 --2- 172.21.15.163:0/4200331630 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f54280feb20 0x7f5428069590 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:10:44.006 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:43.967+0000 7f542f705700 1 --2- 172.21.15.163:0/4200331630 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f54280ffd10 0x7f542819a4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:10:44.006 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:43.967+0000 7f542f705700 1 -- 172.21.15.163:0/4200331630 >> 172.21.15.163:0/4200331630 conn(0x7f54280fa120 msgr2=0x7f54281031c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:10:44.006 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:43.967+0000 7f542f705700 1 -- 172.21.15.163:0/4200331630 shutdown_connections 2023-07-14T18:10:44.007 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:43.967+0000 7f542f705700 1 -- 172.21.15.163:0/4200331630 wait complete. 2023-07-14T18:10:44.007 INFO:teuthology.orchestra.run.smithi163.stderr:dumped fsmap epoch 3 2023-07-14T18:10:44.173 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:10:43 smithi184 ceph-mon[98481]: Deploying daemon mds.j on smithi163 2023-07-14T18:10:44.215 INFO:journalctl@ceph.mds.j.smithi163.stdout:Jul 14 18:10:43 smithi163 bash[129751]: eb0e5a7f75180ffd8397df5cfe19946dc1c56455dfd61a6aa2ce435cc9937cb6 2023-07-14T18:10:44.215 INFO:journalctl@ceph.mds.j.smithi163.stdout:Jul 14 18:10:43 smithi163 ceph-mds[129834]: -- 172.21.15.163:0/1323452028 <== mon.0 v2:172.21.15.163:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x555f49a771e0 con 0x555f49a4cc00 2023-07-14T18:10:44.216 INFO:journalctl@ceph.mds.j.smithi163.stdout:Jul 14 18:10:43 smithi163 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-mds-j[129790]: starting mds.j at 2023-07-14T18:10:44.216 INFO:journalctl@ceph.mds.j.smithi163.stdout:Jul 14 18:10:43 smithi163 systemd[1]: Started Ceph mds.j for bf7326ec-2270-11ee-9b33-001a4aab830c. 2023-07-14T18:10:44.273 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:10:43 smithi172 ceph-mon[97983]: Deploying daemon mds.j on smithi163 2023-07-14T18:10:45.026 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:10:44 smithi163 ceph-mon[96576]: pgmap v230: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-07-14T18:10:45.026 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:10:44 smithi163 ceph-mon[96576]: from='client.? 172.21.15.163:0/4200331630' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-07-14T18:10:45.026 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:10:44 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:10:45.027 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:10:44 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:10:45.027 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:10:44 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:10:45.027 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:10:44 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-07-14T18:10:45.027 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:10:44 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-07-14T18:10:45.027 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:10:44 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T18:10:45.173 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:10:44 smithi184 ceph-mon[98481]: pgmap v230: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-07-14T18:10:45.173 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:10:44 smithi184 ceph-mon[98481]: from='client.? 172.21.15.163:0/4200331630' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-07-14T18:10:45.173 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:10:44 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:10:45.173 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:10:44 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:10:45.173 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:10:44 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:10:45.174 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:10:44 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-07-14T18:10:45.174 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:10:44 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-07-14T18:10:45.174 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:10:44 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T18:10:45.274 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:10:44 smithi172 ceph-mon[97983]: pgmap v230: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-07-14T18:10:45.274 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:10:44 smithi172 ceph-mon[97983]: from='client.? 172.21.15.163:0/4200331630' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-07-14T18:10:45.274 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:10:44 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:10:45.274 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:10:44 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:10:45.274 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:10:44 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:10:45.275 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:10:44 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-07-14T18:10:45.275 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:10:44 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-07-14T18:10:45.275 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:10:44 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T18:10:45.716 INFO:journalctl@ceph.mds.d.smithi163.stdout:Jul 14 18:10:45 smithi163 systemd[1]: Starting Ceph mds.d for bf7326ec-2270-11ee-9b33-001a4aab830c... 2023-07-14T18:10:46.017 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-14T18:10:46.099 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:10:45 smithi163 ceph-mon[96576]: Deploying daemon mds.d on smithi163 2023-07-14T18:10:46.100 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:10:45 smithi163 ceph-mon[96576]: mds.? [v2:172.21.15.163:6834/1058662632,v1:172.21.15.163:6835/1058662632] up:boot 2023-07-14T18:10:46.100 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:10:45 smithi163 ceph-mon[96576]: fsmap 3 up:standby 2023-07-14T18:10:46.100 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:10:45 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2023-07-14T18:10:46.100 INFO:journalctl@ceph.mds.d.smithi163.stdout:Jul 14 18:10:45 smithi163 podman[130139]: 2023-07-14T18:10:46.100 INFO:journalctl@ceph.mds.d.smithi163.stdout:Jul 14 18:10:46 smithi163 ceph-mds[130202]: -- 172.21.15.163:0/4147269711 <== mon.0 v2:172.21.15.163:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x5642423a91e0 con 0x56424237ec00 2023-07-14T18:10:46.150 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:46.112+0000 7f56b864e700 1 -- 172.21.15.163:0/1550758622 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f56b0102ff0 msgr2=0x7f56b01053d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:10:46.151 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:46.112+0000 7f56b864e700 1 --2- 172.21.15.163:0/1550758622 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f56b0102ff0 0x7f56b01053d0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f56a0009990 tx=0x7f56a0009ca0 comp rx=0 tx=0).stop 2023-07-14T18:10:46.151 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:46.112+0000 7f56b864e700 1 -- 172.21.15.163:0/1550758622 shutdown_connections 2023-07-14T18:10:46.151 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:46.112+0000 7f56b864e700 1 --2- 172.21.15.163:0/1550758622 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f56b0105910 0x7f56b0107d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:10:46.151 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:46.112+0000 7f56b864e700 1 --2- 172.21.15.163:0/1550758622 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f56b01006d0 0x7f56b0102ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:10:46.152 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:46.112+0000 7f56b864e700 1 --2- 172.21.15.163:0/1550758622 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f56b0102ff0 0x7f56b01053d0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:10:46.152 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:46.112+0000 7f56b864e700 1 -- 172.21.15.163:0/1550758622 >> 172.21.15.163:0/1550758622 conn(0x7f56b00fa190 msgr2=0x7f56b00fc5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:10:46.152 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:46.113+0000 7f56b864e700 1 -- 172.21.15.163:0/1550758622 shutdown_connections 2023-07-14T18:10:46.152 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:46.113+0000 7f56b864e700 1 -- 172.21.15.163:0/1550758622 wait complete. 2023-07-14T18:10:46.154 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:46.113+0000 7f56b864e700 1 Processor -- start 2023-07-14T18:10:46.154 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:46.113+0000 7f56b864e700 1 -- start start 2023-07-14T18:10:46.154 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:46.113+0000 7f56b864e700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f56b01006d0 0x7f56b01957b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:10:46.154 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:46.113+0000 7f56b864e700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f56b0102ff0 0x7f56b0195cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:10:46.154 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:46.113+0000 7f56b864e700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f56b0105910 0x7f56b019cd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:10:46.155 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:46.113+0000 7f56b864e700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56b019d330 con 0x7f56b0102ff0 2023-07-14T18:10:46.155 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:46.113+0000 7f56b864e700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56b019d470 con 0x7f56b0105910 2023-07-14T18:10:46.155 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:46.113+0000 7f56b864e700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56b019d600 con 0x7f56b01006d0 2023-07-14T18:10:46.155 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:46.113+0000 7f56b5be9700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f56b0102ff0 0x7f56b0195cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:10:46.155 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:46.113+0000 7f56b5be9700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f56b0102ff0 0x7f56b0195cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:55498/0 (socket says 172.21.15.163:55498) 2023-07-14T18:10:46.155 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:46.113+0000 7f56b5be9700 1 -- 172.21.15.163:0/1587933082 learned_addr learned my addr 172.21.15.163:0/1587933082 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:10:46.155 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:46.114+0000 7f56b63ea700 1 --2- 172.21.15.163:0/1587933082 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f56b01006d0 0x7f56b01957b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:10:46.155 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:46.114+0000 7f56b6beb700 1 --2- 172.21.15.163:0/1587933082 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f56b0105910 0x7f56b019cd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:10:46.156 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:46.114+0000 7f56b5be9700 1 -- 172.21.15.163:0/1587933082 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f56b01006d0 msgr2=0x7f56b01957b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:10:46.156 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:46.114+0000 7f56b5be9700 1 --2- 172.21.15.163:0/1587933082 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f56b01006d0 0x7f56b01957b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:10:46.156 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:46.114+0000 7f56b5be9700 1 -- 172.21.15.163:0/1587933082 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f56b0105910 msgr2=0x7f56b019cd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:10:46.156 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:46.114+0000 7f56b5be9700 1 --2- 172.21.15.163:0/1587933082 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f56b0105910 0x7f56b019cd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:10:46.156 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:46.114+0000 7f56b5be9700 1 -- 172.21.15.163:0/1587933082 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56a00095f0 con 0x7f56b0102ff0 2023-07-14T18:10:46.156 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:46.114+0000 7f56b6beb700 1 --2- 172.21.15.163:0/1587933082 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f56b0105910 0x7f56b019cd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T18:10:46.156 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:46.114+0000 7f56b5be9700 1 --2- 172.21.15.163:0/1587933082 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f56b0102ff0 0x7f56b0195cf0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f56a00059d0 tx=0x7f56a0004790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:10:46.157 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:46.114+0000 7f56a77fe700 1 -- 172.21.15.163:0/1587933082 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56a001d070 con 0x7f56b0102ff0 2023-07-14T18:10:46.157 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:46.114+0000 7f56a77fe700 1 -- 172.21.15.163:0/1587933082 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f56a000f460 con 0x7f56b0102ff0 2023-07-14T18:10:46.157 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:46.114+0000 7f56a77fe700 1 -- 172.21.15.163:0/1587933082 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56a0021670 con 0x7f56b0102ff0 2023-07-14T18:10:46.157 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:46.114+0000 7f56b864e700 1 -- 172.21.15.163:0/1587933082 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f56b019d880 con 0x7f56b0102ff0 2023-07-14T18:10:46.157 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:46.114+0000 7f56b864e700 1 -- 172.21.15.163:0/1587933082 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f56b00fe700 con 0x7f56b0102ff0 2023-07-14T18:10:46.157 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:46.115+0000 7f56b864e700 1 -- 172.21.15.163:0/1587933082 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f56b00fbd00 con 0x7f56b0102ff0 2023-07-14T18:10:46.158 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:46.116+0000 7f56a77fe700 1 -- 172.21.15.163:0/1587933082 <== mon.0 v2:172.21.15.163:3300/0 4 ==== mgrmap(e 16) v1 ==== 135716+0+0 (secure 0 0 0) 0x7f56a000f5d0 con 0x7f56b0102ff0 2023-07-14T18:10:46.158 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:46.117+0000 7f56a77fe700 1 --2- 172.21.15.163:0/1587933082 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f569c0a11a0 0x7f569c0a3650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:10:46.158 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:46.117+0000 7f56b63ea700 1 --2- 172.21.15.163:0/1587933082 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f569c0a11a0 0x7f569c0a3650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:10:46.158 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:46.117+0000 7f56a77fe700 1 -- 172.21.15.163:0/1587933082 <== mon.0 v2:172.21.15.163:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f56a00cdab0 con 0x7f56b0102ff0 2023-07-14T18:10:46.158 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:46.118+0000 7f56b63ea700 1 --2- 172.21.15.163:0/1587933082 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f569c0a11a0 0x7f569c0a3650 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f56ac007c60 tx=0x7f56ac0073d0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:10:46.159 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:46.121+0000 7f56a77fe700 1 -- 172.21.15.163:0/1587933082 <== mon.0 v2:172.21.15.163:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178025 (secure 0 0 0) 0x7f56a0097730 con 0x7f56b0102ff0 2023-07-14T18:10:46.172 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:10:45 smithi184 ceph-mon[98481]: Deploying daemon mds.d on smithi163 2023-07-14T18:10:46.173 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:10:45 smithi184 ceph-mon[98481]: mds.? [v2:172.21.15.163:6834/1058662632,v1:172.21.15.163:6835/1058662632] up:boot 2023-07-14T18:10:46.173 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:10:45 smithi184 ceph-mon[98481]: fsmap 3 up:standby 2023-07-14T18:10:46.173 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:10:45 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2023-07-14T18:10:46.273 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:10:45 smithi172 ceph-mon[97983]: Deploying daemon mds.d on smithi163 2023-07-14T18:10:46.274 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:10:45 smithi172 ceph-mon[97983]: mds.? [v2:172.21.15.163:6834/1058662632,v1:172.21.15.163:6835/1058662632] up:boot 2023-07-14T18:10:46.274 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:10:45 smithi172 ceph-mon[97983]: fsmap 3 up:standby 2023-07-14T18:10:46.274 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:10:45 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2023-07-14T18:10:46.394 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:46.356+0000 7f56b864e700 1 -- 172.21.15.163:0/1587933082 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f56b002c8e0 con 0x7f56b0102ff0 2023-07-14T18:10:46.395 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:46.357+0000 7f56a77fe700 1 -- 172.21.15.163:0/1587933082 <== mon.0 v2:172.21.15.163:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 4 v4) v1 ==== 93+0+2777 (secure 0 0 0) 0x7f56a009ad50 con 0x7f56b0102ff0 2023-07-14T18:10:46.395 INFO:teuthology.orchestra.run.smithi163.stdout: 2023-07-14T18:10:46.395 INFO:teuthology.orchestra.run.smithi163.stdout:{"epoch":4,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14562,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.163:6835/1058662632","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6834","nonce":1058662632},{"type":"v1","addr":"172.21.15.163:6835","nonce":1058662632}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":24421,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6833/797722972","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6832","nonce":797722972},{"type":"v1","addr":"172.21.15.184:6833","nonce":797722972}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":24431,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6833/1075696311","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":1075696311},{"type":"v1","addr":"172.21.15.172:6833","nonce":1075696311}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[]} 2023-07-14T18:10:46.397 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:46.359+0000 7f56b864e700 1 -- 172.21.15.163:0/1587933082 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f569c0a11a0 msgr2=0x7f569c0a3650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:10:46.397 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:46.359+0000 7f56b864e700 1 --2- 172.21.15.163:0/1587933082 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f569c0a11a0 0x7f569c0a3650 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f56ac007c60 tx=0x7f56ac0073d0 comp rx=0 tx=0).stop 2023-07-14T18:10:46.397 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:46.359+0000 7f56b864e700 1 -- 172.21.15.163:0/1587933082 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f56b0102ff0 msgr2=0x7f56b0195cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:10:46.397 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:46.359+0000 7f56b864e700 1 --2- 172.21.15.163:0/1587933082 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f56b0102ff0 0x7f56b0195cf0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f56a00059d0 tx=0x7f56a0004790 comp rx=0 tx=0).stop 2023-07-14T18:10:46.397 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:46.359+0000 7f56b864e700 1 -- 172.21.15.163:0/1587933082 shutdown_connections 2023-07-14T18:10:46.398 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:46.359+0000 7f56b864e700 1 --2- 172.21.15.163:0/1587933082 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f569c0a11a0 0x7f569c0a3650 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:10:46.398 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:46.359+0000 7f56b864e700 1 --2- 172.21.15.163:0/1587933082 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f56b01006d0 0x7f56b01957b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:10:46.398 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:46.359+0000 7f56b864e700 1 --2- 172.21.15.163:0/1587933082 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f56b0105910 0x7f56b019cd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:10:46.398 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:46.359+0000 7f56b864e700 1 --2- 172.21.15.163:0/1587933082 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f56b0102ff0 0x7f56b0195cf0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:10:46.398 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:46.359+0000 7f56b864e700 1 -- 172.21.15.163:0/1587933082 >> 172.21.15.163:0/1587933082 conn(0x7f56b00fa190 msgr2=0x7f56b0101330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:10:46.398 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:46.359+0000 7f56b864e700 1 -- 172.21.15.163:0/1587933082 shutdown_connections 2023-07-14T18:10:46.398 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:46.359+0000 7f56b864e700 1 -- 172.21.15.163:0/1587933082 wait complete. 2023-07-14T18:10:46.399 INFO:teuthology.orchestra.run.smithi163.stderr:dumped fsmap epoch 4 2023-07-14T18:10:46.408 INFO:journalctl@ceph.mds.d.smithi163.stdout:Jul 14 18:10:46 smithi163 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-mds-d[130155]: starting mds.d at 2023-07-14T18:10:46.408 INFO:journalctl@ceph.mds.d.smithi163.stdout:Jul 14 18:10:46 smithi163 bash[130139]: 78a7b48c86885fb661e611c2ad6bc19688f9b3f143960edfc54294c391e35664 2023-07-14T18:10:46.408 INFO:journalctl@ceph.mds.d.smithi163.stdout:Jul 14 18:10:46 smithi163 systemd[1]: Started Ceph mds.d for bf7326ec-2270-11ee-9b33-001a4aab830c. 2023-07-14T18:10:47.115 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:10:46 smithi172 ceph-mon[97983]: pgmap v231: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-07-14T18:10:47.115 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:10:46 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:10:47.116 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:10:46 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:10:47.116 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:10:46 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:10:47.116 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:10:46 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-07-14T18:10:47.116 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:10:46 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-07-14T18:10:47.116 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:10:46 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T18:10:47.116 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:10:46 smithi172 ceph-mon[97983]: from='client.? 172.21.15.163:0/1587933082' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-07-14T18:10:47.173 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:10:46 smithi184 ceph-mon[98481]: pgmap v231: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-07-14T18:10:47.173 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:10:46 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:10:47.173 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:10:46 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:10:47.173 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:10:46 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:10:47.174 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:10:46 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-07-14T18:10:47.174 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:10:46 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-07-14T18:10:47.174 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:10:46 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T18:10:47.174 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:10:46 smithi184 ceph-mon[98481]: from='client.? 172.21.15.163:0/1587933082' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-07-14T18:10:47.215 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:10:46 smithi163 ceph-mon[96576]: pgmap v231: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-07-14T18:10:47.215 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:10:46 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:10:47.215 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:10:46 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:10:47.216 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:10:46 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:10:47.216 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:10:46 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-07-14T18:10:47.216 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:10:46 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-07-14T18:10:47.216 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:10:46 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T18:10:47.216 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:10:46 smithi163 ceph-mon[96576]: from='client.? 172.21.15.163:0/1587933082' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-07-14T18:10:47.702 INFO:journalctl@ceph.mds.e.smithi172.stdout:Jul 14 18:10:47 smithi172 systemd[1]: Starting Ceph mds.e for bf7326ec-2270-11ee-9b33-001a4aab830c... 2023-07-14T18:10:47.975 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:10:47 smithi172 ceph-mon[97983]: Deploying daemon mds.e on smithi172 2023-07-14T18:10:47.975 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:10:47 smithi172 ceph-mon[97983]: mds.? [v2:172.21.15.163:6836/1107244425,v1:172.21.15.163:6837/1107244425] up:boot 2023-07-14T18:10:47.976 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:10:47 smithi172 ceph-mon[97983]: fsmap 4 up:standby 2023-07-14T18:10:47.976 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:10:47 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2023-07-14T18:10:48.173 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:10:47 smithi184 ceph-mon[98481]: Deploying daemon mds.e on smithi172 2023-07-14T18:10:48.173 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:10:47 smithi184 ceph-mon[98481]: mds.? [v2:172.21.15.163:6836/1107244425,v1:172.21.15.163:6837/1107244425] up:boot 2023-07-14T18:10:48.173 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:10:47 smithi184 ceph-mon[98481]: fsmap 4 up:standby 2023-07-14T18:10:48.173 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:10:47 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2023-07-14T18:10:48.215 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:10:47 smithi163 ceph-mon[96576]: Deploying daemon mds.e on smithi172 2023-07-14T18:10:48.215 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:10:47 smithi163 ceph-mon[96576]: mds.? [v2:172.21.15.163:6836/1107244425,v1:172.21.15.163:6837/1107244425] up:boot 2023-07-14T18:10:48.216 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:10:47 smithi163 ceph-mon[96576]: fsmap 4 up:standby 2023-07-14T18:10:48.216 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:10:47 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2023-07-14T18:10:48.246 INFO:journalctl@ceph.mds.e.smithi172.stdout:Jul 14 18:10:47 smithi172 podman[122554]: 2023-07-14T18:10:48.410 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-14T18:10:48.523 INFO:journalctl@ceph.mds.e.smithi172.stdout:Jul 14 18:10:48 smithi172 ceph-mds[122594]: -- 172.21.15.172:0/635354790 <== mon.2 v2:172.21.15.172:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x562784c2f1e0 con 0x562784c04c00 2023-07-14T18:10:48.524 INFO:journalctl@ceph.mds.e.smithi172.stdout:Jul 14 18:10:48 smithi172 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-mds-e[122570]: starting mds.e at 2023-07-14T18:10:48.524 INFO:journalctl@ceph.mds.e.smithi172.stdout:Jul 14 18:10:48 smithi172 bash[122554]: 4952fddfb07131776e2a1c770ffa6bb171c69bb539ec500d78ca360e74a17568 2023-07-14T18:10:48.524 INFO:journalctl@ceph.mds.e.smithi172.stdout:Jul 14 18:10:48 smithi172 systemd[1]: Started Ceph mds.e for bf7326ec-2270-11ee-9b33-001a4aab830c. 2023-07-14T18:10:48.545 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:48.505+0000 7f3b010d0700 1 -- 172.21.15.163:0/2654244085 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f3afc102fa0 msgr2=0x7f3afc105380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:10:48.545 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:48.505+0000 7f3b010d0700 1 --2- 172.21.15.163:0/2654244085 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f3afc102fa0 0x7f3afc105380 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f3af0009990 tx=0x7f3af0009ca0 comp rx=0 tx=0).stop 2023-07-14T18:10:48.545 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:48.505+0000 7f3b010d0700 1 -- 172.21.15.163:0/2654244085 shutdown_connections 2023-07-14T18:10:48.545 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:48.505+0000 7f3b010d0700 1 --2- 172.21.15.163:0/2654244085 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3afc100680 0x7f3afc102a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:10:48.545 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:48.505+0000 7f3b010d0700 1 --2- 172.21.15.163:0/2654244085 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3afc1058c0 0x7f3afc107d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:10:48.546 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:48.505+0000 7f3b010d0700 1 --2- 172.21.15.163:0/2654244085 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f3afc102fa0 0x7f3afc105380 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:10:48.546 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:48.505+0000 7f3b010d0700 1 -- 172.21.15.163:0/2654244085 >> 172.21.15.163:0/2654244085 conn(0x7f3afc0fa100 msgr2=0x7f3afc0fc550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:10:48.546 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:48.505+0000 7f3b010d0700 1 -- 172.21.15.163:0/2654244085 shutdown_connections 2023-07-14T18:10:48.546 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:48.505+0000 7f3b010d0700 1 -- 172.21.15.163:0/2654244085 wait complete. 2023-07-14T18:10:48.548 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:48.506+0000 7f3b010d0700 1 Processor -- start 2023-07-14T18:10:48.548 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:48.506+0000 7f3b010d0700 1 -- start start 2023-07-14T18:10:48.548 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:48.506+0000 7f3b010d0700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3afc100680 0x7f3afc0ffff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:10:48.548 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:48.506+0000 7f3b010d0700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3afc102fa0 0x7f3afc0fe630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:10:48.549 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:48.506+0000 7f3b010d0700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f3afc1058c0 0x7f3afc0feb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:10:48.549 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:48.506+0000 7f3b010d0700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3afc0ff310 con 0x7f3afc1058c0 2023-07-14T18:10:48.549 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:48.507+0000 7f3b010d0700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3afc0ff480 con 0x7f3afc102fa0 2023-07-14T18:10:48.549 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:48.507+0000 7f3b010d0700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3afc19f870 con 0x7f3afc100680 2023-07-14T18:10:48.549 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:48.507+0000 7f3afad9d700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3afc100680 0x7f3afc0ffff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:10:48.549 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:48.507+0000 7f3afb59e700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f3afc1058c0 0x7f3afc0feb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:10:48.549 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:48.507+0000 7f3afad9d700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3afc100680 0x7f3afc0ffff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.163:37332/0 (socket says 172.21.15.163:37332) 2023-07-14T18:10:48.550 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:48.507+0000 7f3afad9d700 1 -- 172.21.15.163:0/1067415825 learned_addr learned my addr 172.21.15.163:0/1067415825 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:10:48.550 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:48.507+0000 7f3afa59c700 1 --2- 172.21.15.163:0/1067415825 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3afc102fa0 0x7f3afc0fe630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:10:48.550 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:48.507+0000 7f3afad9d700 1 -- 172.21.15.163:0/1067415825 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3afc102fa0 msgr2=0x7f3afc0fe630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:10:48.550 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:48.507+0000 7f3afad9d700 1 --2- 172.21.15.163:0/1067415825 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3afc102fa0 0x7f3afc0fe630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:10:48.550 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:48.507+0000 7f3afad9d700 1 -- 172.21.15.163:0/1067415825 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f3afc1058c0 msgr2=0x7f3afc0feb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:10:48.550 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:48.507+0000 7f3afad9d700 1 --2- 172.21.15.163:0/1067415825 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f3afc1058c0 0x7f3afc0feb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:10:48.550 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:48.507+0000 7f3afad9d700 1 -- 172.21.15.163:0/1067415825 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3af00095f0 con 0x7f3afc100680 2023-07-14T18:10:48.550 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:48.507+0000 7f3afb59e700 1 --2- 172.21.15.163:0/1067415825 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f3afc1058c0 0x7f3afc0feb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T18:10:48.551 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:48.507+0000 7f3afad9d700 1 --2- 172.21.15.163:0/1067415825 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3afc100680 0x7f3afc0ffff0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f3aec00e9a0 tx=0x7f3aec00ecb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:10:48.551 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:48.507+0000 7f3ae3fff700 1 -- 172.21.15.163:0/1067415825 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3aec009790 con 0x7f3afc100680 2023-07-14T18:10:48.551 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:48.507+0000 7f3b010d0700 1 -- 172.21.15.163:0/1067415825 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3afc19fb50 con 0x7f3afc100680 2023-07-14T18:10:48.551 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:48.507+0000 7f3ae3fff700 1 -- 172.21.15.163:0/1067415825 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f3aec010430 con 0x7f3afc100680 2023-07-14T18:10:48.551 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:48.507+0000 7f3ae3fff700 1 -- 172.21.15.163:0/1067415825 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3aec00cea0 con 0x7f3afc100680 2023-07-14T18:10:48.551 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:48.507+0000 7f3b010d0700 1 -- 172.21.15.163:0/1067415825 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3afc1a0060 con 0x7f3afc100680 2023-07-14T18:10:48.551 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:48.508+0000 7f3b010d0700 1 -- 172.21.15.163:0/1067415825 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3afc0fbc70 con 0x7f3afc100680 2023-07-14T18:10:48.552 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:48.510+0000 7f3ae3fff700 1 -- 172.21.15.163:0/1067415825 <== mon.1 v2:172.21.15.184:3300/0 4 ==== mgrmap(e 16) v1 ==== 135716+0+0 (secure 0 0 0) 0x7f3aec0105a0 con 0x7f3afc100680 2023-07-14T18:10:48.552 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:48.510+0000 7f3ae3fff700 1 --2- 172.21.15.163:0/1067415825 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f3ae40a11a0 0x7f3ae40a3650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:10:48.552 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:48.510+0000 7f3ae3fff700 1 -- 172.21.15.163:0/1067415825 <== mon.1 v2:172.21.15.184:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f3aec014070 con 0x7f3afc100680 2023-07-14T18:10:48.553 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:48.510+0000 7f3afa59c700 1 --2- 172.21.15.163:0/1067415825 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f3ae40a11a0 0x7f3ae40a3650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:10:48.553 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:48.511+0000 7f3afa59c700 1 --2- 172.21.15.163:0/1067415825 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f3ae40a11a0 0x7f3ae40a3650 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f3af0006010 tx=0x7f3af000b260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:10:48.553 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:48.514+0000 7f3ae3fff700 1 -- 172.21.15.163:0/1067415825 <== mon.1 v2:172.21.15.184:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178025 (secure 0 0 0) 0x7f3aec0961b0 con 0x7f3afc100680 2023-07-14T18:10:48.788 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:48.749+0000 7f3b010d0700 1 -- 172.21.15.163:0/1067415825 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3afc02c8e0 con 0x7f3afc100680 2023-07-14T18:10:48.789 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:48.750+0000 7f3ae3fff700 1 -- 172.21.15.163:0/1067415825 <== mon.1 v2:172.21.15.184:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 5 v5) v1 ==== 93+0+3537 (secure 0 0 0) 0x7f3aec0997d0 con 0x7f3afc100680 2023-07-14T18:10:48.789 INFO:teuthology.orchestra.run.smithi163.stdout: 2023-07-14T18:10:48.789 INFO:teuthology.orchestra.run.smithi163.stdout:{"epoch":5,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14562,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.163:6835/1058662632","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6834","nonce":1058662632},{"type":"v1","addr":"172.21.15.163:6835","nonce":1058662632}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":14568,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.163:6837/1107244425","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6836","nonce":1107244425},{"type":"v1","addr":"172.21.15.163:6837","nonce":1107244425}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5},{"gid":24421,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6833/797722972","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6832","nonce":797722972},{"type":"v1","addr":"172.21.15.184:6833","nonce":797722972}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":24431,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6833/1075696311","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":1075696311},{"type":"v1","addr":"172.21.15.172:6833","nonce":1075696311}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[]} 2023-07-14T18:10:48.791 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:48.752+0000 7f3b010d0700 1 -- 172.21.15.163:0/1067415825 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f3ae40a11a0 msgr2=0x7f3ae40a3650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:10:48.791 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:48.752+0000 7f3b010d0700 1 --2- 172.21.15.163:0/1067415825 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f3ae40a11a0 0x7f3ae40a3650 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f3af0006010 tx=0x7f3af000b260 comp rx=0 tx=0).stop 2023-07-14T18:10:48.791 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:48.752+0000 7f3b010d0700 1 -- 172.21.15.163:0/1067415825 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3afc100680 msgr2=0x7f3afc0ffff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:10:48.792 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:48.752+0000 7f3b010d0700 1 --2- 172.21.15.163:0/1067415825 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3afc100680 0x7f3afc0ffff0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f3aec00e9a0 tx=0x7f3aec00ecb0 comp rx=0 tx=0).stop 2023-07-14T18:10:48.792 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:48.752+0000 7f3b010d0700 1 -- 172.21.15.163:0/1067415825 shutdown_connections 2023-07-14T18:10:48.792 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:48.752+0000 7f3b010d0700 1 --2- 172.21.15.163:0/1067415825 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f3ae40a11a0 0x7f3ae40a3650 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:10:48.792 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:48.752+0000 7f3b010d0700 1 --2- 172.21.15.163:0/1067415825 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3afc100680 0x7f3afc0ffff0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:10:48.792 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:48.752+0000 7f3b010d0700 1 --2- 172.21.15.163:0/1067415825 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f3afc1058c0 0x7f3afc0feb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:10:48.792 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:48.752+0000 7f3b010d0700 1 --2- 172.21.15.163:0/1067415825 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3afc102fa0 0x7f3afc0fe630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:10:48.793 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:48.752+0000 7f3b010d0700 1 -- 172.21.15.163:0/1067415825 >> 172.21.15.163:0/1067415825 conn(0x7f3afc0fa100 msgr2=0x7f3afc1012e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:10:48.793 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:48.752+0000 7f3b010d0700 1 -- 172.21.15.163:0/1067415825 shutdown_connections 2023-07-14T18:10:48.793 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:48.752+0000 7f3b010d0700 1 -- 172.21.15.163:0/1067415825 wait complete. 2023-07-14T18:10:48.794 INFO:teuthology.orchestra.run.smithi163.stderr:dumped fsmap epoch 5 2023-07-14T18:10:49.085 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:10:48 smithi184 ceph-mon[98481]: pgmap v232: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-07-14T18:10:49.085 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:10:48 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:10:49.086 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:10:48 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:10:49.086 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:10:48 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:10:49.086 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:10:48 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-07-14T18:10:49.086 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:10:48 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-07-14T18:10:49.086 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:10:48 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T18:10:49.086 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:10:48 smithi184 ceph-mon[98481]: from='client.? 172.21.15.163:0/1067415825' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-07-14T18:10:49.215 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:10:48 smithi163 ceph-mon[96576]: pgmap v232: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-07-14T18:10:49.216 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:10:48 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:10:49.216 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:10:48 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:10:49.216 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:10:48 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:10:49.216 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:10:48 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-07-14T18:10:49.216 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:10:48 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-07-14T18:10:49.217 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:10:48 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T18:10:49.217 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:10:48 smithi163 ceph-mon[96576]: from='client.? 172.21.15.163:0/1067415825' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-07-14T18:10:49.274 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:10:48 smithi172 ceph-mon[97983]: pgmap v232: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-07-14T18:10:49.274 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:10:48 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:10:49.274 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:10:48 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:10:49.274 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:10:48 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:10:49.274 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:10:48 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-07-14T18:10:49.275 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:10:48 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-07-14T18:10:49.275 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:10:48 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T18:10:49.275 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:10:48 smithi172 ceph-mon[97983]: from='client.? 172.21.15.163:0/1067415825' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-07-14T18:10:49.883 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:10:49 smithi184 ceph-mon[98481]: Deploying daemon mds.f on smithi184 2023-07-14T18:10:49.883 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:10:49 smithi184 ceph-mon[98481]: mds.? [v2:172.21.15.172:6834/1158120127,v1:172.21.15.172:6835/1158120127] up:boot 2023-07-14T18:10:49.884 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:10:49 smithi184 ceph-mon[98481]: fsmap 5 up:standby 2023-07-14T18:10:49.884 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:10:49 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2023-07-14T18:10:50.150 INFO:journalctl@ceph.mds.f.smithi184.stdout:Jul 14 18:10:49 smithi184 systemd[1]: Starting Ceph mds.f for bf7326ec-2270-11ee-9b33-001a4aab830c... 2023-07-14T18:10:50.215 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:10:49 smithi163 ceph-mon[96576]: Deploying daemon mds.f on smithi184 2023-07-14T18:10:50.215 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:10:49 smithi163 ceph-mon[96576]: mds.? [v2:172.21.15.172:6834/1158120127,v1:172.21.15.172:6835/1158120127] up:boot 2023-07-14T18:10:50.216 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:10:49 smithi163 ceph-mon[96576]: fsmap 5 up:standby 2023-07-14T18:10:50.216 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:10:49 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2023-07-14T18:10:50.274 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:10:49 smithi172 ceph-mon[97983]: Deploying daemon mds.f on smithi184 2023-07-14T18:10:50.274 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:10:49 smithi172 ceph-mon[97983]: mds.? [v2:172.21.15.172:6834/1158120127,v1:172.21.15.172:6835/1158120127] up:boot 2023-07-14T18:10:50.274 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:10:49 smithi172 ceph-mon[97983]: fsmap 5 up:standby 2023-07-14T18:10:50.274 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:10:49 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2023-07-14T18:10:50.423 INFO:journalctl@ceph.mds.f.smithi184.stdout:Jul 14 18:10:50 smithi184 podman[123980]: 2023-07-14T18:10:50.423 INFO:journalctl@ceph.mds.f.smithi184.stdout:Jul 14 18:10:50 smithi184 ceph-mds[124020]: -- 172.21.15.184:0/2310421747 <== mon.1 v2:172.21.15.184:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x557a6bec71e0 con 0x557a6be9c800 2023-07-14T18:10:50.423 INFO:journalctl@ceph.mds.f.smithi184.stdout:Jul 14 18:10:50 smithi184 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-mds-f[123996]: starting mds.f at 2023-07-14T18:10:50.424 INFO:journalctl@ceph.mds.f.smithi184.stdout:Jul 14 18:10:50 smithi184 bash[123980]: 0c5d36ffdefc87eeae636b79c084d9a4de32f7bb5f3a0a2f01e2df09d0c730c6 2023-07-14T18:10:50.805 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-14T18:10:50.833 INFO:journalctl@ceph.mds.f.smithi184.stdout:Jul 14 18:10:50 smithi184 systemd[1]: Started Ceph mds.f for bf7326ec-2270-11ee-9b33-001a4aab830c. 2023-07-14T18:10:50.943 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:50.902+0000 7f212375f700 1 -- 172.21.15.163:0/2106825693 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f211c1000b0 msgr2=0x7f211c1004c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:10:50.943 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:50.902+0000 7f212375f700 1 --2- 172.21.15.163:0/2106825693 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f211c1000b0 0x7f211c1004c0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f210c009990 tx=0x7f210c009ca0 comp rx=0 tx=0).stop 2023-07-14T18:10:50.944 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:50.902+0000 7f212375f700 1 -- 172.21.15.163:0/2106825693 shutdown_connections 2023-07-14T18:10:50.944 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:50.902+0000 7f212375f700 1 --2- 172.21.15.163:0/2106825693 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f211c0ff6b0 0x7f211c106f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:10:50.944 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:50.902+0000 7f212375f700 1 --2- 172.21.15.163:0/2106825693 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f211c1000b0 0x7f211c1004c0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:10:50.944 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:50.902+0000 7f212375f700 1 --2- 172.21.15.163:0/2106825693 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f211c0fed00 0x7f211c0ff170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:10:50.944 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:50.902+0000 7f212375f700 1 -- 172.21.15.163:0/2106825693 >> 172.21.15.163:0/2106825693 conn(0x7f211c0f98a0 msgr2=0x7f211c0fbcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:10:50.944 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:50.902+0000 7f212375f700 1 -- 172.21.15.163:0/2106825693 shutdown_connections 2023-07-14T18:10:50.944 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:50.902+0000 7f212375f700 1 -- 172.21.15.163:0/2106825693 wait complete. 2023-07-14T18:10:50.945 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:50.903+0000 7f212375f700 1 Processor -- start 2023-07-14T18:10:50.945 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:50.903+0000 7f212375f700 1 -- start start 2023-07-14T18:10:50.945 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:50.903+0000 7f212375f700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f211c0fed00 0x7f211c0fe780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:10:50.945 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:50.903+0000 7f212375f700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f211c0ff6b0 0x7f211c19a590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:10:50.945 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:50.903+0000 7f212375f700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f211c1000b0 0x7f211c19cbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:10:50.945 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:50.903+0000 7f212375f700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f211c19d3b0 con 0x7f211c0ff6b0 2023-07-14T18:10:50.946 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:50.903+0000 7f212375f700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f211c19d520 con 0x7f211c1000b0 2023-07-14T18:10:50.946 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:50.903+0000 7f212375f700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f211c19d6e0 con 0x7f211c0fed00 2023-07-14T18:10:50.946 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:50.903+0000 7f2120cfa700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f211c0ff6b0 0x7f211c19a590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:10:50.946 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:50.903+0000 7f21214fb700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f211c0fed00 0x7f211c0fe780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:10:50.946 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:50.903+0000 7f2120cfa700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f211c0ff6b0 0x7f211c19a590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:55526/0 (socket says 172.21.15.163:55526) 2023-07-14T18:10:50.946 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:50.903+0000 7f2120cfa700 1 -- 172.21.15.163:0/73888967 learned_addr learned my addr 172.21.15.163:0/73888967 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:10:50.946 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:50.903+0000 7f2121cfc700 1 --2- 172.21.15.163:0/73888967 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f211c1000b0 0x7f211c19cbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:10:50.947 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:50.903+0000 7f2120cfa700 1 -- 172.21.15.163:0/73888967 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f211c0fed00 msgr2=0x7f211c0fe780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:10:50.947 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:50.903+0000 7f2120cfa700 1 --2- 172.21.15.163:0/73888967 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f211c0fed00 0x7f211c0fe780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:10:50.947 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:50.903+0000 7f2120cfa700 1 -- 172.21.15.163:0/73888967 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f211c1000b0 msgr2=0x7f211c19cbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:10:50.947 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:50.903+0000 7f2120cfa700 1 --2- 172.21.15.163:0/73888967 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f211c1000b0 0x7f211c19cbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:10:50.947 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:50.903+0000 7f2120cfa700 1 -- 172.21.15.163:0/73888967 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f210c0095f0 con 0x7f211c0ff6b0 2023-07-14T18:10:50.948 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:50.904+0000 7f2120cfa700 1 --2- 172.21.15.163:0/73888967 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f211c0ff6b0 0x7f211c19a590 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f211800c920 tx=0x7f211800cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:10:50.948 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:50.904+0000 7f21127fc700 1 -- 172.21.15.163:0/73888967 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2118007b00 con 0x7f211c0ff6b0 2023-07-14T18:10:50.948 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:50.904+0000 7f212375f700 1 -- 172.21.15.163:0/73888967 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f211c19d9c0 con 0x7f211c0ff6b0 2023-07-14T18:10:50.948 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:50.904+0000 7f21127fc700 1 -- 172.21.15.163:0/73888967 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f211800ce70 con 0x7f211c0ff6b0 2023-07-14T18:10:50.948 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:50.904+0000 7f21127fc700 1 -- 172.21.15.163:0/73888967 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21180053e0 con 0x7f211c0ff6b0 2023-07-14T18:10:50.948 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:50.904+0000 7f212375f700 1 -- 172.21.15.163:0/73888967 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f211c19df20 con 0x7f211c0ff6b0 2023-07-14T18:10:50.949 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:50.905+0000 7f212375f700 1 -- 172.21.15.163:0/73888967 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f211c1061b0 con 0x7f211c0ff6b0 2023-07-14T18:10:50.949 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:50.906+0000 7f21127fc700 1 -- 172.21.15.163:0/73888967 <== mon.0 v2:172.21.15.163:3300/0 4 ==== mgrmap(e 16) v1 ==== 135716+0+0 (secure 0 0 0) 0x7f2118005580 con 0x7f211c0ff6b0 2023-07-14T18:10:50.949 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:50.906+0000 7f21127fc700 1 --2- 172.21.15.163:0/73888967 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f21080a11a0 0x7f21080a3650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:10:50.950 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:50.906+0000 7f21127fc700 1 -- 172.21.15.163:0/73888967 <== mon.0 v2:172.21.15.163:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f21180cc100 con 0x7f211c0ff6b0 2023-07-14T18:10:50.950 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:50.906+0000 7f21214fb700 1 --2- 172.21.15.163:0/73888967 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f21080a11a0 0x7f21080a3650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:10:50.950 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:50.907+0000 7f21214fb700 1 --2- 172.21.15.163:0/73888967 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f21080a11a0 0x7f21080a3650 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f210c006010 tx=0x7f210c005960 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:10:50.950 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:50.911+0000 7f21127fc700 1 -- 172.21.15.163:0/73888967 <== mon.0 v2:172.21.15.163:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178025 (secure 0 0 0) 0x7f2118095c50 con 0x7f211c0ff6b0 2023-07-14T18:10:51.173 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:10:50 smithi184 ceph-mon[98481]: pgmap v233: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-07-14T18:10:51.173 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:10:50 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:10:51.173 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:10:50 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:10:51.173 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:10:50 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:10:51.174 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:10:50 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-07-14T18:10:51.174 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:10:50 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-07-14T18:10:51.174 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:10:50 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T18:10:51.183 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:51.144+0000 7f212375f700 1 -- 172.21.15.163:0/73888967 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f211c0612f0 con 0x7f211c0ff6b0 2023-07-14T18:10:51.184 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:51.145+0000 7f21127fc700 1 -- 172.21.15.163:0/73888967 <== mon.0 v2:172.21.15.163:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+5054 (secure 0 0 0) 0x7f2118099270 con 0x7f211c0ff6b0 2023-07-14T18:10:51.184 INFO:teuthology.orchestra.run.smithi163.stdout: 2023-07-14T18:10:51.184 INFO:teuthology.orchestra.run.smithi163.stdout:{"epoch":7,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14562,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.163:6835/1058662632","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6834","nonce":1058662632},{"type":"v1","addr":"172.21.15.163:6835","nonce":1058662632}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":14568,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.163:6837/1107244425","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6836","nonce":1107244425},{"type":"v1","addr":"172.21.15.163:6837","nonce":1107244425}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5},{"gid":24421,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6833/797722972","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6832","nonce":797722972},{"type":"v1","addr":"172.21.15.184:6833","nonce":797722972}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":24431,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6833/1075696311","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":1075696311},{"type":"v1","addr":"172.21.15.172:6833","nonce":1075696311}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":24458,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6835/1158120127","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":1158120127},{"type":"v1","addr":"172.21.15.172:6835","nonce":1158120127}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":6},{"gid":24466,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6835/460134263","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6834","nonce":460134263},{"type":"v1","addr":"172.21.15.184:6835","nonce":460134263}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":7}],"filesystems":[]} 2023-07-14T18:10:51.186 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:51.147+0000 7f212375f700 1 -- 172.21.15.163:0/73888967 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f21080a11a0 msgr2=0x7f21080a3650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:10:51.187 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:51.147+0000 7f212375f700 1 --2- 172.21.15.163:0/73888967 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f21080a11a0 0x7f21080a3650 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f210c006010 tx=0x7f210c005960 comp rx=0 tx=0).stop 2023-07-14T18:10:51.187 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:51.147+0000 7f212375f700 1 -- 172.21.15.163:0/73888967 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f211c0ff6b0 msgr2=0x7f211c19a590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:10:51.187 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:51.147+0000 7f212375f700 1 --2- 172.21.15.163:0/73888967 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f211c0ff6b0 0x7f211c19a590 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f211800c920 tx=0x7f211800cc30 comp rx=0 tx=0).stop 2023-07-14T18:10:51.187 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:51.147+0000 7f212375f700 1 -- 172.21.15.163:0/73888967 shutdown_connections 2023-07-14T18:10:51.187 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:51.147+0000 7f212375f700 1 --2- 172.21.15.163:0/73888967 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f21080a11a0 0x7f21080a3650 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:10:51.187 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:51.147+0000 7f212375f700 1 --2- 172.21.15.163:0/73888967 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f211c0fed00 0x7f211c0fe780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:10:51.187 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:51.147+0000 7f212375f700 1 --2- 172.21.15.163:0/73888967 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f211c1000b0 0x7f211c19cbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:10:51.188 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:51.147+0000 7f212375f700 1 --2- 172.21.15.163:0/73888967 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f211c0ff6b0 0x7f211c19a590 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:10:51.188 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:51.147+0000 7f212375f700 1 -- 172.21.15.163:0/73888967 >> 172.21.15.163:0/73888967 conn(0x7f211c0f98a0 msgr2=0x7f211c1032f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:10:51.188 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:51.148+0000 7f212375f700 1 -- 172.21.15.163:0/73888967 shutdown_connections 2023-07-14T18:10:51.188 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:51.148+0000 7f212375f700 1 -- 172.21.15.163:0/73888967 wait complete. 2023-07-14T18:10:51.188 INFO:teuthology.orchestra.run.smithi163.stderr:dumped fsmap epoch 7 2023-07-14T18:10:51.198 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:10:50 smithi163 ceph-mon[96576]: pgmap v233: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-07-14T18:10:51.198 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:10:50 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:10:51.198 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:10:50 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:10:51.198 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:10:50 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:10:51.198 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:10:50 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-07-14T18:10:51.198 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:10:50 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-07-14T18:10:51.198 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:10:50 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T18:10:51.274 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:10:50 smithi172 ceph-mon[97983]: pgmap v233: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-07-14T18:10:51.274 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:10:50 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:10:51.274 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:10:50 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:10:51.274 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:10:50 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:10:51.274 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:10:50 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-07-14T18:10:51.275 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:10:50 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-07-14T18:10:51.275 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:10:50 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T18:10:52.173 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:10:51 smithi184 ceph-mon[98481]: Deploying daemon mds.c on smithi184 2023-07-14T18:10:52.173 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:10:51 smithi184 ceph-mon[98481]: mds.? [v2:172.21.15.184:6834/460134263,v1:172.21.15.184:6835/460134263] up:boot 2023-07-14T18:10:52.174 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:10:51 smithi184 ceph-mon[98481]: fsmap 6 up:standby 2023-07-14T18:10:52.174 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:10:51 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2023-07-14T18:10:52.174 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:10:51 smithi184 ceph-mon[98481]: from='client.? 172.21.15.163:0/73888967' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-07-14T18:10:52.174 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:10:51 smithi184 ceph-mon[98481]: pgmap v234: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-07-14T18:10:52.174 INFO:journalctl@ceph.mds.c.smithi184.stdout:Jul 14 18:10:52 smithi184 systemd[1]: Starting Ceph mds.c for bf7326ec-2270-11ee-9b33-001a4aab830c... 2023-07-14T18:10:52.215 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:10:51 smithi163 ceph-mon[96576]: Deploying daemon mds.c on smithi184 2023-07-14T18:10:52.216 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:10:51 smithi163 ceph-mon[96576]: mds.? [v2:172.21.15.184:6834/460134263,v1:172.21.15.184:6835/460134263] up:boot 2023-07-14T18:10:52.216 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:10:51 smithi163 ceph-mon[96576]: fsmap 6 up:standby 2023-07-14T18:10:52.216 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:10:51 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2023-07-14T18:10:52.216 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:10:51 smithi163 ceph-mon[96576]: from='client.? 172.21.15.163:0/73888967' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-07-14T18:10:52.216 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:10:51 smithi163 ceph-mon[96576]: pgmap v234: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-07-14T18:10:52.274 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:10:51 smithi172 ceph-mon[97983]: Deploying daemon mds.c on smithi184 2023-07-14T18:10:52.274 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:10:51 smithi172 ceph-mon[97983]: mds.? [v2:172.21.15.184:6834/460134263,v1:172.21.15.184:6835/460134263] up:boot 2023-07-14T18:10:52.274 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:10:51 smithi172 ceph-mon[97983]: fsmap 6 up:standby 2023-07-14T18:10:52.274 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:10:51 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2023-07-14T18:10:52.274 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:10:51 smithi172 ceph-mon[97983]: from='client.? 172.21.15.163:0/73888967' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-07-14T18:10:52.274 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:10:51 smithi172 ceph-mon[97983]: pgmap v234: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-07-14T18:10:52.607 INFO:journalctl@ceph.mds.c.smithi184.stdout:Jul 14 18:10:52 smithi184 podman[124318]: 2023-07-14T18:10:52.923 INFO:journalctl@ceph.mds.c.smithi184.stdout:Jul 14 18:10:52 smithi184 ceph-mds[124358]: -- 172.21.15.184:0/3493861274 <== mon.1 v2:172.21.15.184:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x56233361b1e0 con 0x5623335f0c00 2023-07-14T18:10:52.923 INFO:journalctl@ceph.mds.c.smithi184.stdout:Jul 14 18:10:52 smithi184 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-mds-c[124334]: starting mds.c at 2023-07-14T18:10:52.923 INFO:journalctl@ceph.mds.c.smithi184.stdout:Jul 14 18:10:52 smithi184 bash[124318]: 90cff0cb1f48b0641a043f20b40aed90c5c041465c810d152e1f2717106c272f 2023-07-14T18:10:52.923 INFO:journalctl@ceph.mds.c.smithi184.stdout:Jul 14 18:10:52 smithi184 systemd[1]: Started Ceph mds.c for bf7326ec-2270-11ee-9b33-001a4aab830c. 2023-07-14T18:10:53.200 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-14T18:10:53.335 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:53.295+0000 7f65a1b28700 1 -- 172.21.15.163:0/1169589366 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f659c1058d0 msgr2=0x7f659c107d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:10:53.335 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:53.295+0000 7f65a1b28700 1 --2- 172.21.15.163:0/1169589366 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f659c1058d0 0x7f659c107d30 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f659400b0a0 tx=0x7f659400b3b0 comp rx=0 tx=0).stop 2023-07-14T18:10:53.335 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:53.295+0000 7f65a1b28700 1 -- 172.21.15.163:0/1169589366 shutdown_connections 2023-07-14T18:10:53.335 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:53.295+0000 7f65a1b28700 1 --2- 172.21.15.163:0/1169589366 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f659c1058d0 0x7f659c107d30 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:10:53.336 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:53.295+0000 7f65a1b28700 1 --2- 172.21.15.163:0/1169589366 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f659c100690 0x7f659c102a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:10:53.336 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:53.295+0000 7f65a1b28700 1 --2- 172.21.15.163:0/1169589366 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f659c102fb0 0x7f659c105390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:10:53.336 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:53.295+0000 7f65a1b28700 1 -- 172.21.15.163:0/1169589366 >> 172.21.15.163:0/1169589366 conn(0x7f659c0fa130 msgr2=0x7f659c0fc560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:10:53.336 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:53.295+0000 7f65a1b28700 1 -- 172.21.15.163:0/1169589366 shutdown_connections 2023-07-14T18:10:53.336 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:53.295+0000 7f65a1b28700 1 -- 172.21.15.163:0/1169589366 wait complete. 2023-07-14T18:10:53.336 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:53.296+0000 7f65a1b28700 1 Processor -- start 2023-07-14T18:10:53.338 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:53.296+0000 7f65a1b28700 1 -- start start 2023-07-14T18:10:53.338 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:53.296+0000 7f65a1b28700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f659c100690 0x7f659c195900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:10:53.338 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:53.296+0000 7f65a1b28700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f659c102fb0 0x7f659c195e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:10:53.338 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:53.296+0000 7f65a1b28700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f659c1058d0 0x7f659c19ceb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:10:53.338 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:53.296+0000 7f65a1b28700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f659c19d480 con 0x7f659c102fb0 2023-07-14T18:10:53.339 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:53.296+0000 7f65a1b28700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f659c19d5c0 con 0x7f659c1058d0 2023-07-14T18:10:53.339 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:53.296+0000 7f65a1b28700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f659c19d750 con 0x7f659c100690 2023-07-14T18:10:53.339 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:53.297+0000 7f659affd700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f659c102fb0 0x7f659c195e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:10:53.339 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:53.297+0000 7f659affd700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f659c102fb0 0x7f659c195e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:55540/0 (socket says 172.21.15.163:55540) 2023-07-14T18:10:53.339 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:53.297+0000 7f659bfff700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f659c1058d0 0x7f659c19ceb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:10:53.339 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:53.297+0000 7f659affd700 1 -- 172.21.15.163:0/1505600406 learned_addr learned my addr 172.21.15.163:0/1505600406 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:10:53.339 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:53.297+0000 7f659b7fe700 1 --2- 172.21.15.163:0/1505600406 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f659c100690 0x7f659c195900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:10:53.339 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:53.297+0000 7f659affd700 1 -- 172.21.15.163:0/1505600406 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f659c100690 msgr2=0x7f659c195900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:10:53.340 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:53.297+0000 7f659affd700 1 --2- 172.21.15.163:0/1505600406 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f659c100690 0x7f659c195900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:10:53.340 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:53.297+0000 7f659affd700 1 -- 172.21.15.163:0/1505600406 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f659c1058d0 msgr2=0x7f659c19ceb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:10:53.340 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:53.297+0000 7f659affd700 1 --2- 172.21.15.163:0/1505600406 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f659c1058d0 0x7f659c19ceb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:10:53.340 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:53.297+0000 7f659affd700 1 -- 172.21.15.163:0/1505600406 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6594009d00 con 0x7f659c102fb0 2023-07-14T18:10:53.340 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:53.297+0000 7f659bfff700 1 --2- 172.21.15.163:0/1505600406 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f659c1058d0 0x7f659c19ceb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T18:10:53.340 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:53.297+0000 7f659affd700 1 --2- 172.21.15.163:0/1505600406 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f659c102fb0 0x7f659c195e40 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f659000d950 tx=0x7f659000dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:10:53.340 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:53.297+0000 7f6598ff9700 1 -- 172.21.15.163:0/1505600406 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f659000f890 con 0x7f659c102fb0 2023-07-14T18:10:53.341 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:53.297+0000 7f65a1b28700 1 -- 172.21.15.163:0/1505600406 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f659c19da30 con 0x7f659c102fb0 2023-07-14T18:10:53.341 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:53.297+0000 7f6598ff9700 1 -- 172.21.15.163:0/1505600406 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f659000fe80 con 0x7f659c102fb0 2023-07-14T18:10:53.341 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:53.297+0000 7f6598ff9700 1 -- 172.21.15.163:0/1505600406 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f659000e3b0 con 0x7f659c102fb0 2023-07-14T18:10:53.341 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:53.297+0000 7f65a1b28700 1 -- 172.21.15.163:0/1505600406 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f659c19df40 con 0x7f659c102fb0 2023-07-14T18:10:53.341 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:53.298+0000 7f65a1b28700 1 -- 172.21.15.163:0/1505600406 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f659c0fbca0 con 0x7f659c102fb0 2023-07-14T18:10:53.342 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:53.299+0000 7f6598ff9700 1 -- 172.21.15.163:0/1505600406 <== mon.0 v2:172.21.15.163:3300/0 4 ==== mgrmap(e 16) v1 ==== 135716+0+0 (secure 0 0 0) 0x7f6590010460 con 0x7f659c102fb0 2023-07-14T18:10:53.342 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:53.300+0000 7f6598ff9700 1 --2- 172.21.15.163:0/1505600406 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f65840a11a0 0x7f65840a3650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:10:53.342 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:53.300+0000 7f659b7fe700 1 --2- 172.21.15.163:0/1505600406 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f65840a11a0 0x7f65840a3650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:10:53.342 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:53.300+0000 7f6598ff9700 1 -- 172.21.15.163:0/1505600406 <== mon.0 v2:172.21.15.163:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f65900cc1f0 con 0x7f659c102fb0 2023-07-14T18:10:53.342 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:53.300+0000 7f659b7fe700 1 --2- 172.21.15.163:0/1505600406 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f65840a11a0 0x7f65840a3650 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f658c009c60 tx=0x7f658c009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:10:53.343 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:53.303+0000 7f6598ff9700 1 -- 172.21.15.163:0/1505600406 <== mon.0 v2:172.21.15.163:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178025 (secure 0 0 0) 0x7f6590095de0 con 0x7f659c102fb0 2023-07-14T18:10:53.576 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:53.537+0000 7f65a1b28700 1 -- 172.21.15.163:0/1505600406 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f659c02cb30 con 0x7f659c102fb0 2023-07-14T18:10:53.577 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:53.538+0000 7f6598ff9700 1 -- 172.21.15.163:0/1505600406 <== mon.0 v2:172.21.15.163:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+5814 (secure 0 0 0) 0x7f6590099400 con 0x7f659c102fb0 2023-07-14T18:10:53.577 INFO:teuthology.orchestra.run.smithi163.stdout: 2023-07-14T18:10:53.577 INFO:teuthology.orchestra.run.smithi163.stdout:{"epoch":8,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14562,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.163:6835/1058662632","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6834","nonce":1058662632},{"type":"v1","addr":"172.21.15.163:6835","nonce":1058662632}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":14568,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.163:6837/1107244425","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6836","nonce":1107244425},{"type":"v1","addr":"172.21.15.163:6837","nonce":1107244425}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5},{"gid":24421,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6833/797722972","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6832","nonce":797722972},{"type":"v1","addr":"172.21.15.184:6833","nonce":797722972}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":24431,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6833/1075696311","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":1075696311},{"type":"v1","addr":"172.21.15.172:6833","nonce":1075696311}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":24458,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6835/1158120127","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":1158120127},{"type":"v1","addr":"172.21.15.172:6835","nonce":1158120127}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":6},{"gid":24466,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6835/460134263","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6834","nonce":460134263},{"type":"v1","addr":"172.21.15.184:6835","nonce":460134263}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":7},{"gid":24478,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6837/3389277679","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6836","nonce":3389277679},{"type":"v1","addr":"172.21.15.184:6837","nonce":3389277679}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":8}],"filesystems":[]} 2023-07-14T18:10:53.579 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:53.540+0000 7f65a1b28700 1 -- 172.21.15.163:0/1505600406 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f65840a11a0 msgr2=0x7f65840a3650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:10:53.579 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:53.540+0000 7f65a1b28700 1 --2- 172.21.15.163:0/1505600406 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f65840a11a0 0x7f65840a3650 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f658c009c60 tx=0x7f658c009260 comp rx=0 tx=0).stop 2023-07-14T18:10:53.579 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:53.540+0000 7f65a1b28700 1 -- 172.21.15.163:0/1505600406 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f659c102fb0 msgr2=0x7f659c195e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:10:53.579 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:53.540+0000 7f65a1b28700 1 --2- 172.21.15.163:0/1505600406 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f659c102fb0 0x7f659c195e40 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f659000d950 tx=0x7f659000dc60 comp rx=0 tx=0).stop 2023-07-14T18:10:53.580 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:53.540+0000 7f65a1b28700 1 -- 172.21.15.163:0/1505600406 shutdown_connections 2023-07-14T18:10:53.580 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:53.540+0000 7f65a1b28700 1 --2- 172.21.15.163:0/1505600406 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f65840a11a0 0x7f65840a3650 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:10:53.580 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:53.540+0000 7f65a1b28700 1 --2- 172.21.15.163:0/1505600406 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f659c100690 0x7f659c195900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:10:53.580 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:53.540+0000 7f65a1b28700 1 --2- 172.21.15.163:0/1505600406 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f659c1058d0 0x7f659c19ceb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:10:53.581 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:53.540+0000 7f65a1b28700 1 --2- 172.21.15.163:0/1505600406 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f659c102fb0 0x7f659c195e40 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:10:53.581 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:53.540+0000 7f65a1b28700 1 -- 172.21.15.163:0/1505600406 >> 172.21.15.163:0/1505600406 conn(0x7f659c0fa130 msgr2=0x7f659c1012f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:10:53.581 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:53.540+0000 7f65a1b28700 1 -- 172.21.15.163:0/1505600406 shutdown_connections 2023-07-14T18:10:53.581 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:53.540+0000 7f65a1b28700 1 -- 172.21.15.163:0/1505600406 wait complete. 2023-07-14T18:10:53.581 INFO:teuthology.orchestra.run.smithi163.stderr:dumped fsmap epoch 8 2023-07-14T18:10:53.935 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:10:53 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:10:53.935 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:10:53 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:10:53.935 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:10:53 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:10:53.935 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:10:53 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-07-14T18:10:53.936 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:10:53 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-07-14T18:10:53.936 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:10:53 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T18:10:53.936 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:10:53 smithi172 ceph-mon[97983]: Deploying daemon mds.h on smithi172 2023-07-14T18:10:53.936 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:10:53 smithi172 ceph-mon[97983]: mds.? [v2:172.21.15.184:6836/3389277679,v1:172.21.15.184:6837/3389277679] up:boot 2023-07-14T18:10:53.936 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:10:53 smithi172 ceph-mon[97983]: fsmap 7 up:standby 2023-07-14T18:10:53.936 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:10:53 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2023-07-14T18:10:53.936 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:10:53 smithi172 ceph-mon[97983]: from='client.? 172.21.15.163:0/1505600406' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-07-14T18:10:53.966 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:10:53 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:10:53.966 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:10:53 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:10:53.966 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:10:53 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:10:53.966 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:10:53 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-07-14T18:10:53.966 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:10:53 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-07-14T18:10:53.967 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:10:53 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T18:10:53.967 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:10:53 smithi163 ceph-mon[96576]: Deploying daemon mds.h on smithi172 2023-07-14T18:10:53.967 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:10:53 smithi163 ceph-mon[96576]: mds.? [v2:172.21.15.184:6836/3389277679,v1:172.21.15.184:6837/3389277679] up:boot 2023-07-14T18:10:53.967 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:10:53 smithi163 ceph-mon[96576]: fsmap 7 up:standby 2023-07-14T18:10:53.967 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:10:53 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2023-07-14T18:10:53.967 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:10:53 smithi163 ceph-mon[96576]: from='client.? 172.21.15.163:0/1505600406' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-07-14T18:10:54.173 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:10:53 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:10:54.173 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:10:53 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:10:54.173 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:10:53 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:10:54.174 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:10:53 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-07-14T18:10:54.174 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:10:53 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-07-14T18:10:54.174 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:10:53 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T18:10:54.174 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:10:53 smithi184 ceph-mon[98481]: Deploying daemon mds.h on smithi172 2023-07-14T18:10:54.174 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:10:53 smithi184 ceph-mon[98481]: mds.? [v2:172.21.15.184:6836/3389277679,v1:172.21.15.184:6837/3389277679] up:boot 2023-07-14T18:10:54.174 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:10:53 smithi184 ceph-mon[98481]: fsmap 7 up:standby 2023-07-14T18:10:54.174 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:10:53 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2023-07-14T18:10:54.175 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:10:53 smithi184 ceph-mon[98481]: from='client.? 172.21.15.163:0/1505600406' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-07-14T18:10:54.524 INFO:journalctl@ceph.mds.h.smithi172.stdout:Jul 14 18:10:54 smithi172 systemd[1]: Starting Ceph mds.h for bf7326ec-2270-11ee-9b33-001a4aab830c... 2023-07-14T18:10:54.904 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:10:54 smithi172 ceph-mon[97983]: pgmap v235: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-07-14T18:10:54.904 INFO:journalctl@ceph.mds.h.smithi172.stdout:Jul 14 18:10:54 smithi172 podman[122897]: 2023-07-14T18:10:54.965 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:10:54 smithi163 ceph-mon[96576]: pgmap v235: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-07-14T18:10:55.173 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:10:54 smithi184 ceph-mon[98481]: pgmap v235: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-07-14T18:10:55.274 INFO:journalctl@ceph.mds.h.smithi172.stdout:Jul 14 18:10:54 smithi172 ceph-mds[122937]: -- 172.21.15.172:0/4234177050 <== mon.2 v2:172.21.15.172:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x564dc1cd91e0 con 0x564dc1caec00 2023-07-14T18:10:55.274 INFO:journalctl@ceph.mds.h.smithi172.stdout:Jul 14 18:10:54 smithi172 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-mds-h[122913]: starting mds.h at 2023-07-14T18:10:55.274 INFO:journalctl@ceph.mds.h.smithi172.stdout:Jul 14 18:10:54 smithi172 bash[122897]: f0d0d8642ba739429b225d7a1f0bf605658682fdf252af5f1c00c60739f27acd 2023-07-14T18:10:55.274 INFO:journalctl@ceph.mds.h.smithi172.stdout:Jul 14 18:10:54 smithi172 systemd[1]: Started Ceph mds.h for bf7326ec-2270-11ee-9b33-001a4aab830c. 2023-07-14T18:10:55.592 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-14T18:10:55.730 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:55.690+0000 7f66bd2ae700 1 -- 172.21.15.163:0/1413087730 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f66b81007b0 msgr2=0x7f66b8107050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:10:55.730 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:55.690+0000 7f66bd2ae700 1 --2- 172.21.15.163:0/1413087730 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f66b81007b0 0x7f66b8107050 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f66b000b0a0 tx=0x7f66b000b3b0 comp rx=0 tx=0).stop 2023-07-14T18:10:55.730 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:55.690+0000 7f66bd2ae700 1 -- 172.21.15.163:0/1413087730 shutdown_connections 2023-07-14T18:10:55.731 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:55.690+0000 7f66bd2ae700 1 --2- 172.21.15.163:0/1413087730 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f66b81007b0 0x7f66b8107050 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:10:55.731 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:55.690+0000 7f66bd2ae700 1 --2- 172.21.15.163:0/1413087730 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f66b80ff0f0 0x7f66b80ff500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:10:55.731 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:55.690+0000 7f66bd2ae700 1 --2- 172.21.15.163:0/1413087730 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f66b80ffe00 0x7f66b8100270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:10:55.731 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:55.690+0000 7f66bd2ae700 1 -- 172.21.15.163:0/1413087730 >> 172.21.15.163:0/1413087730 conn(0x7f66b80f9990 msgr2=0x7f66b80fbda0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:10:55.731 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:55.690+0000 7f66bd2ae700 1 -- 172.21.15.163:0/1413087730 shutdown_connections 2023-07-14T18:10:55.731 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:55.690+0000 7f66bd2ae700 1 -- 172.21.15.163:0/1413087730 wait complete. 2023-07-14T18:10:55.731 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:55.691+0000 7f66bd2ae700 1 Processor -- start 2023-07-14T18:10:55.733 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:55.691+0000 7f66bd2ae700 1 -- start start 2023-07-14T18:10:55.733 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:55.691+0000 7f66bd2ae700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f66b80ff0f0 0x7f66b80fe7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:10:55.733 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:55.691+0000 7f66bd2ae700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f66b80ffe00 0x7f66b819a660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:10:55.734 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:55.691+0000 7f66bd2ae700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f66b81007b0 0x7f66b819ccb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:10:55.734 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:55.691+0000 7f66bd2ae700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66b819d480 con 0x7f66b80ff0f0 2023-07-14T18:10:55.734 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:55.691+0000 7f66bd2ae700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66b819d5f0 con 0x7f66b80ffe00 2023-07-14T18:10:55.734 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:55.691+0000 7f66bd2ae700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66b819d7b0 con 0x7f66b81007b0 2023-07-14T18:10:55.734 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:55.691+0000 7f66b6ffd700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f66b80ff0f0 0x7f66b80fe7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:10:55.734 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:55.692+0000 7f66b6ffd700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f66b80ff0f0 0x7f66b80fe7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:55552/0 (socket says 172.21.15.163:55552) 2023-07-14T18:10:55.734 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:55.692+0000 7f66b6ffd700 1 -- 172.21.15.163:0/488039006 learned_addr learned my addr 172.21.15.163:0/488039006 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:10:55.735 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:55.692+0000 7f66b67fc700 1 --2- 172.21.15.163:0/488039006 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f66b80ffe00 0x7f66b819a660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:10:55.735 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:55.692+0000 7f66b77fe700 1 --2- 172.21.15.163:0/488039006 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f66b81007b0 0x7f66b819ccb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:10:55.735 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:55.692+0000 7f66b6ffd700 1 -- 172.21.15.163:0/488039006 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f66b81007b0 msgr2=0x7f66b819ccb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:10:55.735 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:55.692+0000 7f66b6ffd700 1 --2- 172.21.15.163:0/488039006 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f66b81007b0 0x7f66b819ccb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:10:55.735 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:55.692+0000 7f66b6ffd700 1 -- 172.21.15.163:0/488039006 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f66b80ffe00 msgr2=0x7f66b819a660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:10:55.735 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:55.692+0000 7f66b6ffd700 1 --2- 172.21.15.163:0/488039006 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f66b80ffe00 0x7f66b819a660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:10:55.735 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:55.692+0000 7f66b6ffd700 1 -- 172.21.15.163:0/488039006 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66b0009d00 con 0x7f66b80ff0f0 2023-07-14T18:10:55.735 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:55.692+0000 7f66b6ffd700 1 --2- 172.21.15.163:0/488039006 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f66b80ff0f0 0x7f66b80fe7d0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f66a800c990 tx=0x7f66a800cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:10:55.736 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:55.692+0000 7f669ffff700 1 -- 172.21.15.163:0/488039006 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66a8007b00 con 0x7f66b80ff0f0 2023-07-14T18:10:55.736 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:55.692+0000 7f66bd2ae700 1 -- 172.21.15.163:0/488039006 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f66b819da90 con 0x7f66b80ff0f0 2023-07-14T18:10:55.736 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:55.692+0000 7f669ffff700 1 -- 172.21.15.163:0/488039006 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f66a8007c60 con 0x7f66b80ff0f0 2023-07-14T18:10:55.736 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:55.692+0000 7f669ffff700 1 -- 172.21.15.163:0/488039006 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66a8018660 con 0x7f66b80ff0f0 2023-07-14T18:10:55.736 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:55.692+0000 7f66bd2ae700 1 -- 172.21.15.163:0/488039006 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f66b819dfa0 con 0x7f66b80ff0f0 2023-07-14T18:10:55.736 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:55.693+0000 7f66bd2ae700 1 -- 172.21.15.163:0/488039006 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f66b8106110 con 0x7f66b80ff0f0 2023-07-14T18:10:55.736 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:55.694+0000 7f669ffff700 1 -- 172.21.15.163:0/488039006 <== mon.0 v2:172.21.15.163:3300/0 4 ==== mgrmap(e 16) v1 ==== 135716+0+0 (secure 0 0 0) 0x7f66a800f450 con 0x7f66b80ff0f0 2023-07-14T18:10:55.737 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:55.695+0000 7f669ffff700 1 --2- 172.21.15.163:0/488039006 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f66a00a11a0 0x7f66a00a3650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:10:55.737 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:55.695+0000 7f669ffff700 1 -- 172.21.15.163:0/488039006 <== mon.0 v2:172.21.15.163:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f66a80cc690 con 0x7f66b80ff0f0 2023-07-14T18:10:55.737 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:55.695+0000 7f66b67fc700 1 --2- 172.21.15.163:0/488039006 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f66a00a11a0 0x7f66a00a3650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:10:55.738 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:55.695+0000 7f66b67fc700 1 --2- 172.21.15.163:0/488039006 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f66a00a11a0 0x7f66a00a3650 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f66ac006fd0 tx=0x7f66ac008040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:10:55.738 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:55.698+0000 7f669ffff700 1 -- 172.21.15.163:0/488039006 <== mon.0 v2:172.21.15.163:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178025 (secure 0 0 0) 0x7f66a8096270 con 0x7f66b80ff0f0 2023-07-14T18:10:55.973 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:55.934+0000 7f66bd2ae700 1 -- 172.21.15.163:0/488039006 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f66b802c8e0 con 0x7f66b80ff0f0 2023-07-14T18:10:55.974 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:55.934+0000 7f669ffff700 1 -- 172.21.15.163:0/488039006 <== mon.0 v2:172.21.15.163:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+6574 (secure 0 0 0) 0x7f66a8099890 con 0x7f66b80ff0f0 2023-07-14T18:10:55.974 INFO:teuthology.orchestra.run.smithi163.stdout: 2023-07-14T18:10:55.974 INFO:teuthology.orchestra.run.smithi163.stdout:{"epoch":9,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14562,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.163:6835/1058662632","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6834","nonce":1058662632},{"type":"v1","addr":"172.21.15.163:6835","nonce":1058662632}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":14568,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.163:6837/1107244425","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6836","nonce":1107244425},{"type":"v1","addr":"172.21.15.163:6837","nonce":1107244425}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5},{"gid":24421,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6833/797722972","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6832","nonce":797722972},{"type":"v1","addr":"172.21.15.184:6833","nonce":797722972}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":24431,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6833/1075696311","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":1075696311},{"type":"v1","addr":"172.21.15.172:6833","nonce":1075696311}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":24458,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6835/1158120127","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":1158120127},{"type":"v1","addr":"172.21.15.172:6835","nonce":1158120127}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":6},{"gid":24466,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6835/460134263","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6834","nonce":460134263},{"type":"v1","addr":"172.21.15.184:6835","nonce":460134263}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":7},{"gid":24478,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6837/3389277679","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6836","nonce":3389277679},{"type":"v1","addr":"172.21.15.184:6837","nonce":3389277679}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":8},{"gid":24479,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6837/3783835012","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":3783835012},{"type":"v1","addr":"172.21.15.172:6837","nonce":3783835012}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":9}],"filesystems":[]} 2023-07-14T18:10:55.976 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:55.936+0000 7f66bd2ae700 1 -- 172.21.15.163:0/488039006 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f66a00a11a0 msgr2=0x7f66a00a3650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:10:55.976 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:55.936+0000 7f66bd2ae700 1 --2- 172.21.15.163:0/488039006 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f66a00a11a0 0x7f66a00a3650 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f66ac006fd0 tx=0x7f66ac008040 comp rx=0 tx=0).stop 2023-07-14T18:10:55.976 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:55.936+0000 7f66bd2ae700 1 -- 172.21.15.163:0/488039006 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f66b80ff0f0 msgr2=0x7f66b80fe7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:10:55.976 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:55.936+0000 7f66bd2ae700 1 --2- 172.21.15.163:0/488039006 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f66b80ff0f0 0x7f66b80fe7d0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f66a800c990 tx=0x7f66a800cd50 comp rx=0 tx=0).stop 2023-07-14T18:10:55.976 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:55.936+0000 7f66bd2ae700 1 -- 172.21.15.163:0/488039006 shutdown_connections 2023-07-14T18:10:55.977 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:55.936+0000 7f66bd2ae700 1 --2- 172.21.15.163:0/488039006 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f66a00a11a0 0x7f66a00a3650 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:10:55.977 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:55.936+0000 7f66bd2ae700 1 --2- 172.21.15.163:0/488039006 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f66b81007b0 0x7f66b819ccb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:10:55.977 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:55.936+0000 7f66bd2ae700 1 --2- 172.21.15.163:0/488039006 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f66b80ff0f0 0x7f66b80fe7d0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:10:55.977 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:55.936+0000 7f66bd2ae700 1 --2- 172.21.15.163:0/488039006 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f66b80ffe00 0x7f66b819a660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:10:55.977 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:55.936+0000 7f66bd2ae700 1 -- 172.21.15.163:0/488039006 >> 172.21.15.163:0/488039006 conn(0x7f66b80f9990 msgr2=0x7f66b8103250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:10:55.977 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:55.937+0000 7f66bd2ae700 1 -- 172.21.15.163:0/488039006 shutdown_connections 2023-07-14T18:10:55.977 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:55.937+0000 7f66bd2ae700 1 -- 172.21.15.163:0/488039006 wait complete. 2023-07-14T18:10:55.978 INFO:teuthology.orchestra.run.smithi163.stderr:dumped fsmap epoch 9 2023-07-14T18:10:56.243 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:10:55 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:10:56.243 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:10:55 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:10:56.243 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:10:55 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:10:56.243 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:10:55 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-07-14T18:10:56.244 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:10:55 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-07-14T18:10:56.244 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:10:55 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T18:10:56.244 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:10:55 smithi184 ceph-mon[98481]: Deploying daemon mds.i on smithi184 2023-07-14T18:10:56.244 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:10:55 smithi184 ceph-mon[98481]: pgmap v236: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-07-14T18:10:56.244 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:10:55 smithi184 ceph-mon[98481]: mds.? [v2:172.21.15.172:6836/3783835012,v1:172.21.15.172:6837/3783835012] up:boot 2023-07-14T18:10:56.244 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:10:55 smithi184 ceph-mon[98481]: fsmap 8 up:standby 2023-07-14T18:10:56.244 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:10:55 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2023-07-14T18:10:56.245 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:10:55 smithi184 ceph-mon[98481]: from='client.? 172.21.15.163:0/488039006' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-07-14T18:10:56.274 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:10:55 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:10:56.274 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:10:55 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:10:56.274 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:10:55 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:10:56.274 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:10:55 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-07-14T18:10:56.274 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:10:55 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-07-14T18:10:56.275 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:10:55 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T18:10:56.275 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:10:55 smithi172 ceph-mon[97983]: Deploying daemon mds.i on smithi184 2023-07-14T18:10:56.275 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:10:55 smithi172 ceph-mon[97983]: pgmap v236: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-07-14T18:10:56.275 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:10:55 smithi172 ceph-mon[97983]: mds.? [v2:172.21.15.172:6836/3783835012,v1:172.21.15.172:6837/3783835012] up:boot 2023-07-14T18:10:56.275 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:10:55 smithi172 ceph-mon[97983]: fsmap 8 up:standby 2023-07-14T18:10:56.275 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:10:55 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2023-07-14T18:10:56.275 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:10:55 smithi172 ceph-mon[97983]: from='client.? 172.21.15.163:0/488039006' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-07-14T18:10:56.465 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:10:55 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:10:56.466 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:10:55 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:10:56.466 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:10:55 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:10:56.466 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:10:55 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-07-14T18:10:56.466 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:10:55 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-07-14T18:10:56.466 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:10:55 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T18:10:56.466 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:10:55 smithi163 ceph-mon[96576]: Deploying daemon mds.i on smithi184 2023-07-14T18:10:56.467 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:10:55 smithi163 ceph-mon[96576]: pgmap v236: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-07-14T18:10:56.467 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:10:55 smithi163 ceph-mon[96576]: mds.? [v2:172.21.15.172:6836/3783835012,v1:172.21.15.172:6837/3783835012] up:boot 2023-07-14T18:10:56.467 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:10:55 smithi163 ceph-mon[96576]: fsmap 8 up:standby 2023-07-14T18:10:56.467 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:10:55 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2023-07-14T18:10:56.467 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:10:55 smithi163 ceph-mon[96576]: from='client.? 172.21.15.163:0/488039006' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-07-14T18:10:56.873 INFO:journalctl@ceph.mds.i.smithi184.stdout:Jul 14 18:10:56 smithi184 systemd[1]: Starting Ceph mds.i for bf7326ec-2270-11ee-9b33-001a4aab830c... 2023-07-14T18:10:57.132 INFO:journalctl@ceph.mds.i.smithi184.stdout:Jul 14 18:10:56 smithi184 podman[124659]: 2023-07-14T18:10:57.132 INFO:journalctl@ceph.mds.i.smithi184.stdout:Jul 14 18:10:57 smithi184 bash[124659]: b58e0819e177b8ddd3fd1e75b090910ee4f4e50d4e0c377e063ddbf1aaddce59 2023-07-14T18:10:57.132 INFO:journalctl@ceph.mds.i.smithi184.stdout:Jul 14 18:10:57 smithi184 ceph-mds[124699]: -- 172.21.15.184:0/166518108 <== mon.1 v2:172.21.15.184:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55af2d7711e0 con 0x55af2d746800 2023-07-14T18:10:57.132 INFO:journalctl@ceph.mds.i.smithi184.stdout:Jul 14 18:10:57 smithi184 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-mds-i[124675]: starting mds.i at 2023-07-14T18:10:57.423 INFO:journalctl@ceph.mds.i.smithi184.stdout:Jul 14 18:10:57 smithi184 systemd[1]: Started Ceph mds.i for bf7326ec-2270-11ee-9b33-001a4aab830c. 2023-07-14T18:10:57.988 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-14T18:10:58.120 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:58.080+0000 7f1169071700 1 -- 172.21.15.163:0/3231066360 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f11640ffcf0 msgr2=0x7f1164100140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:10:58.120 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:58.080+0000 7f1169071700 1 --2- 172.21.15.163:0/3231066360 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f11640ffcf0 0x7f1164100140 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f1158009990 tx=0x7f1158009ca0 comp rx=0 tx=0).stop 2023-07-14T18:10:58.120 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:58.080+0000 7f1169071700 1 -- 172.21.15.163:0/3231066360 shutdown_connections 2023-07-14T18:10:58.120 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:58.080+0000 7f1169071700 1 --2- 172.21.15.163:0/3231066360 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f11640feb00 0x7f11640fef10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:10:58.121 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:58.080+0000 7f1169071700 1 --2- 172.21.15.163:0/3231066360 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1164100680 0x7f1164106f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:10:58.121 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:58.080+0000 7f1169071700 1 --2- 172.21.15.163:0/3231066360 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f11640ffcf0 0x7f1164100140 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:10:58.121 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:58.080+0000 7f1169071700 1 -- 172.21.15.163:0/3231066360 >> 172.21.15.163:0/3231066360 conn(0x7f11640fa100 msgr2=0x7f11640fc550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:10:58.121 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:58.080+0000 7f1169071700 1 -- 172.21.15.163:0/3231066360 shutdown_connections 2023-07-14T18:10:58.121 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:58.080+0000 7f1169071700 1 -- 172.21.15.163:0/3231066360 wait complete. 2023-07-14T18:10:58.123 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:58.081+0000 7f1169071700 1 Processor -- start 2023-07-14T18:10:58.123 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:58.081+0000 7f1169071700 1 -- start start 2023-07-14T18:10:58.123 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:58.082+0000 7f1169071700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f11640feb00 0x7f1164102df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:10:58.123 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:58.082+0000 7f1169071700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f11640ffcf0 0x7f1164101430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:10:58.124 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:58.082+0000 7f1169071700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1164100680 0x7f1164101970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:10:58.124 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:58.082+0000 7f1169071700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1164102110 con 0x7f11640ffcf0 2023-07-14T18:10:58.124 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:58.082+0000 7f1169071700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1164102280 con 0x7f11640feb00 2023-07-14T18:10:58.124 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:58.082+0000 7f1169071700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f116419f8a0 con 0x7f1164100680 2023-07-14T18:10:58.124 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:58.082+0000 7f116259c700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f11640ffcf0 0x7f1164101430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:10:58.124 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:58.082+0000 7f116259c700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f11640ffcf0 0x7f1164101430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:55566/0 (socket says 172.21.15.163:55566) 2023-07-14T18:10:58.125 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:58.082+0000 7f116259c700 1 -- 172.21.15.163:0/4062283295 learned_addr learned my addr 172.21.15.163:0/4062283295 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:10:58.125 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:58.082+0000 7f116359e700 1 --2- 172.21.15.163:0/4062283295 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1164100680 0x7f1164101970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:10:58.125 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:58.082+0000 7f1162d9d700 1 --2- 172.21.15.163:0/4062283295 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f11640feb00 0x7f1164102df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:10:58.125 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:58.082+0000 7f116259c700 1 -- 172.21.15.163:0/4062283295 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1164100680 msgr2=0x7f1164101970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:10:58.125 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:58.082+0000 7f116259c700 1 --2- 172.21.15.163:0/4062283295 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1164100680 0x7f1164101970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:10:58.125 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:58.082+0000 7f116259c700 1 -- 172.21.15.163:0/4062283295 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f11640feb00 msgr2=0x7f1164102df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:10:58.125 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:58.082+0000 7f116259c700 1 --2- 172.21.15.163:0/4062283295 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f11640feb00 0x7f1164102df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:10:58.125 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:58.082+0000 7f116259c700 1 -- 172.21.15.163:0/4062283295 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11580095f0 con 0x7f11640ffcf0 2023-07-14T18:10:58.126 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:58.082+0000 7f116259c700 1 --2- 172.21.15.163:0/4062283295 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f11640ffcf0 0x7f1164101430 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f1158003a50 tx=0x7f1158003a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:10:58.126 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:58.082+0000 7f114bfff700 1 -- 172.21.15.163:0/4062283295 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f115801d070 con 0x7f11640ffcf0 2023-07-14T18:10:58.126 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:58.082+0000 7f114bfff700 1 -- 172.21.15.163:0/4062283295 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f115800bd60 con 0x7f11640ffcf0 2023-07-14T18:10:58.126 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:58.082+0000 7f1169071700 1 -- 172.21.15.163:0/4062283295 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f116419fb20 con 0x7f11640ffcf0 2023-07-14T18:10:58.126 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:58.082+0000 7f114bfff700 1 -- 172.21.15.163:0/4062283295 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1158005280 con 0x7f11640ffcf0 2023-07-14T18:10:58.126 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:58.082+0000 7f1169071700 1 -- 172.21.15.163:0/4062283295 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f116419ff70 con 0x7f11640ffcf0 2023-07-14T18:10:58.126 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:58.083+0000 7f1169071700 1 -- 172.21.15.163:0/4062283295 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1164106c30 con 0x7f11640ffcf0 2023-07-14T18:10:58.127 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:58.084+0000 7f114bfff700 1 -- 172.21.15.163:0/4062283295 <== mon.0 v2:172.21.15.163:3300/0 4 ==== mgrmap(e 16) v1 ==== 135716+0+0 (secure 0 0 0) 0x7f1158004930 con 0x7f11640ffcf0 2023-07-14T18:10:58.127 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:58.085+0000 7f114bfff700 1 --2- 172.21.15.163:0/4062283295 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f114c0a11a0 0x7f114c0a3650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:10:58.127 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:58.085+0000 7f1162d9d700 1 --2- 172.21.15.163:0/4062283295 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f114c0a11a0 0x7f114c0a3650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:10:58.128 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:58.085+0000 7f114bfff700 1 -- 172.21.15.163:0/4062283295 <== mon.0 v2:172.21.15.163:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f11580cd6e0 con 0x7f11640ffcf0 2023-07-14T18:10:58.128 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:58.085+0000 7f1162d9d700 1 --2- 172.21.15.163:0/4062283295 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f114c0a11a0 0x7f114c0a3650 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f11640ffb50 tx=0x7f115400a380 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:10:58.128 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:58.089+0000 7f114bfff700 1 -- 172.21.15.163:0/4062283295 <== mon.0 v2:172.21.15.163:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178025 (secure 0 0 0) 0x7f115805b780 con 0x7f11640ffcf0 2023-07-14T18:10:58.365 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:58.326+0000 7f1169071700 1 -- 172.21.15.163:0/4062283295 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f116402cd00 con 0x7f11640ffcf0 2023-07-14T18:10:58.366 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:58.327+0000 7f114bfff700 1 -- 172.21.15.163:0/4062283295 <== mon.0 v2:172.21.15.163:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 10 v10) v1 ==== 94+0+7336 (secure 0 0 0) 0x7f1158097360 con 0x7f11640ffcf0 2023-07-14T18:10:58.366 INFO:teuthology.orchestra.run.smithi163.stdout: 2023-07-14T18:10:58.367 INFO:teuthology.orchestra.run.smithi163.stdout:{"epoch":10,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14562,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.163:6835/1058662632","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6834","nonce":1058662632},{"type":"v1","addr":"172.21.15.163:6835","nonce":1058662632}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":14568,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.163:6837/1107244425","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6836","nonce":1107244425},{"type":"v1","addr":"172.21.15.163:6837","nonce":1107244425}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5},{"gid":24421,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6833/797722972","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6832","nonce":797722972},{"type":"v1","addr":"172.21.15.184:6833","nonce":797722972}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":24431,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6833/1075696311","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":1075696311},{"type":"v1","addr":"172.21.15.172:6833","nonce":1075696311}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":24458,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6835/1158120127","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":1158120127},{"type":"v1","addr":"172.21.15.172:6835","nonce":1158120127}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":6},{"gid":24466,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6835/460134263","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6834","nonce":460134263},{"type":"v1","addr":"172.21.15.184:6835","nonce":460134263}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":7},{"gid":24478,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6837/3389277679","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6836","nonce":3389277679},{"type":"v1","addr":"172.21.15.184:6837","nonce":3389277679}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":8},{"gid":24479,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6837/3783835012","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":3783835012},{"type":"v1","addr":"172.21.15.172:6837","nonce":3783835012}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":9},{"gid":24493,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6839/2819059257","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6838","nonce":2819059257},{"type":"v1","addr":"172.21.15.184:6839","nonce":2819059257}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10}],"filesystems":[]} 2023-07-14T18:10:58.368 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:58.329+0000 7f1169071700 1 -- 172.21.15.163:0/4062283295 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f114c0a11a0 msgr2=0x7f114c0a3650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:10:58.368 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:58.329+0000 7f1169071700 1 --2- 172.21.15.163:0/4062283295 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f114c0a11a0 0x7f114c0a3650 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f11640ffb50 tx=0x7f115400a380 comp rx=0 tx=0).stop 2023-07-14T18:10:58.369 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:58.329+0000 7f1169071700 1 -- 172.21.15.163:0/4062283295 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f11640ffcf0 msgr2=0x7f1164101430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:10:58.369 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:58.329+0000 7f1169071700 1 --2- 172.21.15.163:0/4062283295 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f11640ffcf0 0x7f1164101430 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f1158003a50 tx=0x7f1158003a80 comp rx=0 tx=0).stop 2023-07-14T18:10:58.369 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:58.329+0000 7f1169071700 1 -- 172.21.15.163:0/4062283295 shutdown_connections 2023-07-14T18:10:58.369 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:58.329+0000 7f1169071700 1 --2- 172.21.15.163:0/4062283295 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f114c0a11a0 0x7f114c0a3650 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:10:58.369 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:58.329+0000 7f1169071700 1 --2- 172.21.15.163:0/4062283295 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1164100680 0x7f1164101970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:10:58.369 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:58.329+0000 7f1169071700 1 --2- 172.21.15.163:0/4062283295 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f11640feb00 0x7f1164102df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:10:58.369 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:58.329+0000 7f1169071700 1 --2- 172.21.15.163:0/4062283295 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f11640ffcf0 0x7f1164101430 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:10:58.370 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:58.329+0000 7f1169071700 1 -- 172.21.15.163:0/4062283295 >> 172.21.15.163:0/4062283295 conn(0x7f11640fa100 msgr2=0x7f11640fc3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:10:58.370 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:58.329+0000 7f1169071700 1 -- 172.21.15.163:0/4062283295 shutdown_connections 2023-07-14T18:10:58.370 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:10:58.329+0000 7f1169071700 1 -- 172.21.15.163:0/4062283295 wait complete. 2023-07-14T18:10:58.370 INFO:teuthology.orchestra.run.smithi163.stderr:dumped fsmap epoch 10 2023-07-14T18:10:58.414 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:10:58 smithi163 ceph-mon[96576]: mds.? [v2:172.21.15.184:6838/2819059257,v1:172.21.15.184:6839/2819059257] up:boot 2023-07-14T18:10:58.415 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:10:58 smithi163 ceph-mon[96576]: fsmap 9 up:standby 2023-07-14T18:10:58.415 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:10:58 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2023-07-14T18:10:58.415 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:10:58 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:10:58.415 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:10:58 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:10:58.415 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:10:58 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:10:58.415 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:10:58 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-07-14T18:10:58.415 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:10:58 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-07-14T18:10:58.416 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:10:58 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T18:10:58.416 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:10:58 smithi163 ceph-mon[96576]: Deploying daemon mds.g on smithi163 2023-07-14T18:10:58.416 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:10:58 smithi163 ceph-mon[96576]: pgmap v237: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-07-14T18:10:58.423 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:10:58 smithi184 ceph-mon[98481]: mds.? [v2:172.21.15.184:6838/2819059257,v1:172.21.15.184:6839/2819059257] up:boot 2023-07-14T18:10:58.423 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:10:58 smithi184 ceph-mon[98481]: fsmap 9 up:standby 2023-07-14T18:10:58.423 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:10:58 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2023-07-14T18:10:58.423 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:10:58 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:10:58.424 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:10:58 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:10:58.424 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:10:58 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:10:58.424 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:10:58 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-07-14T18:10:58.424 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:10:58 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-07-14T18:10:58.424 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:10:58 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T18:10:58.424 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:10:58 smithi184 ceph-mon[98481]: Deploying daemon mds.g on smithi163 2023-07-14T18:10:58.424 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:10:58 smithi184 ceph-mon[98481]: pgmap v237: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-07-14T18:10:58.524 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:10:58 smithi172 ceph-mon[97983]: mds.? [v2:172.21.15.184:6838/2819059257,v1:172.21.15.184:6839/2819059257] up:boot 2023-07-14T18:10:58.524 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:10:58 smithi172 ceph-mon[97983]: fsmap 9 up:standby 2023-07-14T18:10:58.524 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:10:58 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2023-07-14T18:10:58.524 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:10:58 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:10:58.525 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:10:58 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:10:58.525 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:10:58 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:10:58.525 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:10:58 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-07-14T18:10:58.525 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:10:58 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-07-14T18:10:58.525 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:10:58 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T18:10:58.525 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:10:58 smithi172 ceph-mon[97983]: Deploying daemon mds.g on smithi163 2023-07-14T18:10:58.526 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:10:58 smithi172 ceph-mon[97983]: pgmap v237: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-07-14T18:10:59.027 INFO:journalctl@ceph.mds.g.smithi163.stdout:Jul 14 18:10:58 smithi163 systemd[1]: Starting Ceph mds.g for bf7326ec-2270-11ee-9b33-001a4aab830c... 2023-07-14T18:10:59.322 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:10:59 smithi163 ceph-mon[96576]: from='client.? 172.21.15.163:0/4062283295' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-07-14T18:10:59.322 INFO:journalctl@ceph.mds.g.smithi163.stdout:Jul 14 18:10:58 smithi163 podman[130750]: 2023-07-14T18:10:59.323 INFO:journalctl@ceph.mds.g.smithi163.stdout:Jul 14 18:10:59 smithi163 ceph-mds[130790]: -- 172.21.15.163:0/2492915433 <== mon.0 v2:172.21.15.163:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55c5b1a651e0 con 0x55c5b1a3ac00 2023-07-14T18:10:59.524 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:10:59 smithi172 ceph-mon[97983]: from='client.? 172.21.15.163:0/4062283295' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-07-14T18:10:59.673 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:10:59 smithi184 ceph-mon[98481]: from='client.? 172.21.15.163:0/4062283295' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-07-14T18:10:59.716 INFO:journalctl@ceph.mds.g.smithi163.stdout:Jul 14 18:10:59 smithi163 bash[130750]: 7677e3c28fd651a3cc2f2c6cc682a05efdb94229e9d2f11845c8e08946428583 2023-07-14T18:10:59.716 INFO:journalctl@ceph.mds.g.smithi163.stdout:Jul 14 18:10:59 smithi163 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-mds-g[130766]: starting mds.g at 2023-07-14T18:10:59.716 INFO:journalctl@ceph.mds.g.smithi163.stdout:Jul 14 18:10:59 smithi163 systemd[1]: Started Ceph mds.g for bf7326ec-2270-11ee-9b33-001a4aab830c. 2023-07-14T18:11:00.382 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-14T18:11:00.512 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:00.473+0000 7f78011f7700 1 -- 172.21.15.163:0/215621923 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f77fc0ff6f0 msgr2=0x7f77fc106fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:11:00.512 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:00.473+0000 7f78011f7700 1 --2- 172.21.15.163:0/215621923 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f77fc0ff6f0 0x7f77fc106fa0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f77f400b0a0 tx=0x7f77f400b3b0 comp rx=0 tx=0).stop 2023-07-14T18:11:00.513 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:00.473+0000 7f78011f7700 1 -- 172.21.15.163:0/215621923 shutdown_connections 2023-07-14T18:11:00.513 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:00.473+0000 7f78011f7700 1 --2- 172.21.15.163:0/215621923 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f77fc0ff6f0 0x7f77fc106fa0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:00.513 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:00.473+0000 7f78011f7700 1 --2- 172.21.15.163:0/215621923 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f77fc100180 0x7f77fc100590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:00.513 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:00.473+0000 7f78011f7700 1 --2- 172.21.15.163:0/215621923 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f77fc0fed40 0x7f77fc0ff1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:00.513 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:00.473+0000 7f78011f7700 1 -- 172.21.15.163:0/215621923 >> 172.21.15.163:0/215621923 conn(0x7f77fc0f98a0 msgr2=0x7f77fc0fbcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:11:00.513 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:00.473+0000 7f78011f7700 1 -- 172.21.15.163:0/215621923 shutdown_connections 2023-07-14T18:11:00.513 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:00.473+0000 7f78011f7700 1 -- 172.21.15.163:0/215621923 wait complete. 2023-07-14T18:11:00.515 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:00.473+0000 7f78011f7700 1 Processor -- start 2023-07-14T18:11:00.515 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:00.474+0000 7f78011f7700 1 -- start start 2023-07-14T18:11:00.515 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:00.474+0000 7f78011f7700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f77fc0fed40 0x7f77fc0fe7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:11:00.516 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:00.474+0000 7f78011f7700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f77fc0ff6f0 0x7f77fc19a640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:11:00.516 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:00.474+0000 7f78011f7700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f77fc100180 0x7f77fc19cc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:11:00.516 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:00.474+0000 7f78011f7700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77fc19d460 con 0x7f77fc0fed40 2023-07-14T18:11:00.516 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:00.474+0000 7f78011f7700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77fc19d5d0 con 0x7f77fc100180 2023-07-14T18:11:00.516 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:00.474+0000 7f78011f7700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77fc19d790 con 0x7f77fc0ff6f0 2023-07-14T18:11:00.516 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:00.474+0000 7f77fad9d700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f77fc0fed40 0x7f77fc0fe7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:11:00.516 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:00.474+0000 7f77fad9d700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f77fc0fed40 0x7f77fc0fe7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:55590/0 (socket says 172.21.15.163:55590) 2023-07-14T18:11:00.516 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:00.474+0000 7f77fad9d700 1 -- 172.21.15.163:0/1718587670 learned_addr learned my addr 172.21.15.163:0/1718587670 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:11:00.517 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:00.474+0000 7f77fa59c700 1 --2- 172.21.15.163:0/1718587670 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f77fc0ff6f0 0x7f77fc19a640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:11:00.517 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:00.474+0000 7f77fb59e700 1 --2- 172.21.15.163:0/1718587670 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f77fc100180 0x7f77fc19cc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:11:00.517 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:00.474+0000 7f77fad9d700 1 -- 172.21.15.163:0/1718587670 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f77fc0ff6f0 msgr2=0x7f77fc19a640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:11:00.517 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:00.474+0000 7f77fad9d700 1 --2- 172.21.15.163:0/1718587670 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f77fc0ff6f0 0x7f77fc19a640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:00.517 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:00.474+0000 7f77fad9d700 1 -- 172.21.15.163:0/1718587670 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f77fc100180 msgr2=0x7f77fc19cc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:11:00.517 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:00.474+0000 7f77fad9d700 1 --2- 172.21.15.163:0/1718587670 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f77fc100180 0x7f77fc19cc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:00.517 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:00.474+0000 7f77fad9d700 1 -- 172.21.15.163:0/1718587670 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77f4009d00 con 0x7f77fc0fed40 2023-07-14T18:11:00.518 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:00.474+0000 7f77fad9d700 1 --2- 172.21.15.163:0/1718587670 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f77fc0fed40 0x7f77fc0fe7c0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f77ec00d950 tx=0x7f77ec00dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:11:00.518 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:00.475+0000 7f77e3fff700 1 -- 172.21.15.163:0/1718587670 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77ec00f890 con 0x7f77fc0fed40 2023-07-14T18:11:00.518 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:00.475+0000 7f78011f7700 1 -- 172.21.15.163:0/1718587670 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f77fc19da70 con 0x7f77fc0fed40 2023-07-14T18:11:00.518 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:00.475+0000 7f77e3fff700 1 -- 172.21.15.163:0/1718587670 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f77ec00fe80 con 0x7f77fc0fed40 2023-07-14T18:11:00.518 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:00.475+0000 7f77e3fff700 1 -- 172.21.15.163:0/1718587670 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77ec00e3b0 con 0x7f77fc0fed40 2023-07-14T18:11:00.519 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:00.475+0000 7f78011f7700 1 -- 172.21.15.163:0/1718587670 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f77fc19df80 con 0x7f77fc0fed40 2023-07-14T18:11:00.519 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:00.476+0000 7f78011f7700 1 -- 172.21.15.163:0/1718587670 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f77fc10a180 con 0x7f77fc0fed40 2023-07-14T18:11:00.519 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:00.477+0000 7f77e3fff700 1 -- 172.21.15.163:0/1718587670 <== mon.0 v2:172.21.15.163:3300/0 4 ==== mgrmap(e 16) v1 ==== 135716+0+0 (secure 0 0 0) 0x7f77ec010460 con 0x7f77fc0fed40 2023-07-14T18:11:00.520 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:00.477+0000 7f77e3fff700 1 --2- 172.21.15.163:0/1718587670 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f77e40a11a0 0x7f77e40a3650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:11:00.520 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:00.477+0000 7f77fa59c700 1 --2- 172.21.15.163:0/1718587670 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f77e40a11a0 0x7f77e40a3650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:11:00.520 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:00.477+0000 7f77e3fff700 1 -- 172.21.15.163:0/1718587670 <== mon.0 v2:172.21.15.163:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f77ec0cc590 con 0x7f77fc0fed40 2023-07-14T18:11:00.520 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:00.478+0000 7f77fa59c700 1 --2- 172.21.15.163:0/1718587670 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f77e40a11a0 0x7f77e40a3650 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f77fc0fe530 tx=0x7f77f000a300 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:11:00.520 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:00.481+0000 7f77e3fff700 1 -- 172.21.15.163:0/1718587670 <== mon.0 v2:172.21.15.163:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178025 (secure 0 0 0) 0x7f77ec096180 con 0x7f77fc0fed40 2023-07-14T18:11:00.622 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:11:00 smithi163 ceph-mon[96576]: pgmap v238: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-07-14T18:11:00.622 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:11:00 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:11:00.622 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:11:00 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:11:00.622 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:11:00 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:11:00.622 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:11:00 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-07-14T18:11:00.622 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:11:00 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-07-14T18:11:00.623 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:11:00 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T18:11:00.623 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:11:00 smithi163 ceph-mon[96576]: Deploying daemon mds.a on smithi163 2023-07-14T18:11:00.623 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:11:00 smithi163 ceph-mon[96576]: mds.? [v2:172.21.15.163:6838/1337572937,v1:172.21.15.163:6839/1337572937] up:boot 2023-07-14T18:11:00.623 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:11:00 smithi163 ceph-mon[96576]: fsmap 10 up:standby 2023-07-14T18:11:00.623 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:11:00 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2023-07-14T18:11:00.774 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:11:00 smithi172 ceph-mon[97983]: pgmap v238: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-07-14T18:11:00.774 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:11:00 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:11:00.775 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:11:00 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:11:00.775 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:11:00 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:11:00.775 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:11:00 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-07-14T18:11:00.775 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:11:00 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-07-14T18:11:00.775 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:11:00 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T18:11:00.775 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:11:00 smithi172 ceph-mon[97983]: Deploying daemon mds.a on smithi163 2023-07-14T18:11:00.775 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:11:00 smithi172 ceph-mon[97983]: mds.? [v2:172.21.15.163:6838/1337572937,v1:172.21.15.163:6839/1337572937] up:boot 2023-07-14T18:11:00.775 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:11:00 smithi172 ceph-mon[97983]: fsmap 10 up:standby 2023-07-14T18:11:00.776 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:11:00 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2023-07-14T18:11:00.782 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:00.743+0000 7f78011f7700 1 -- 172.21.15.163:0/1718587670 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f77fc105a20 con 0x7f77fc0fed40 2023-07-14T18:11:00.786 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:00.747+0000 7f77e3fff700 1 -- 172.21.15.163:0/1718587670 <== mon.0 v2:172.21.15.163:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 11 v11) v1 ==== 94+0+8097 (secure 0 0 0) 0x7f77ec0997a0 con 0x7f77fc0fed40 2023-07-14T18:11:00.786 INFO:teuthology.orchestra.run.smithi163.stdout: 2023-07-14T18:11:00.786 INFO:teuthology.orchestra.run.smithi163.stdout:{"epoch":11,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14562,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.163:6835/1058662632","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6834","nonce":1058662632},{"type":"v1","addr":"172.21.15.163:6835","nonce":1058662632}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":14568,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.163:6837/1107244425","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6836","nonce":1107244425},{"type":"v1","addr":"172.21.15.163:6837","nonce":1107244425}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5},{"gid":14640,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.163:6839/1337572937","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6838","nonce":1337572937},{"type":"v1","addr":"172.21.15.163:6839","nonce":1337572937}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":24421,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6833/797722972","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6832","nonce":797722972},{"type":"v1","addr":"172.21.15.184:6833","nonce":797722972}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":24431,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6833/1075696311","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":1075696311},{"type":"v1","addr":"172.21.15.172:6833","nonce":1075696311}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":24458,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6835/1158120127","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":1158120127},{"type":"v1","addr":"172.21.15.172:6835","nonce":1158120127}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":6},{"gid":24466,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6835/460134263","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6834","nonce":460134263},{"type":"v1","addr":"172.21.15.184:6835","nonce":460134263}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":7},{"gid":24478,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6837/3389277679","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6836","nonce":3389277679},{"type":"v1","addr":"172.21.15.184:6837","nonce":3389277679}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":8},{"gid":24479,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6837/3783835012","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":3783835012},{"type":"v1","addr":"172.21.15.172:6837","nonce":3783835012}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":9},{"gid":24493,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6839/2819059257","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6838","nonce":2819059257},{"type":"v1","addr":"172.21.15.184:6839","nonce":2819059257}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10}],"filesystems":[]} 2023-07-14T18:11:00.789 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:00.749+0000 7f78011f7700 1 -- 172.21.15.163:0/1718587670 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f77e40a11a0 msgr2=0x7f77e40a3650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:11:00.789 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:00.749+0000 7f78011f7700 1 --2- 172.21.15.163:0/1718587670 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f77e40a11a0 0x7f77e40a3650 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f77fc0fe530 tx=0x7f77f000a300 comp rx=0 tx=0).stop 2023-07-14T18:11:00.789 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:00.749+0000 7f78011f7700 1 -- 172.21.15.163:0/1718587670 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f77fc0fed40 msgr2=0x7f77fc0fe7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:11:00.789 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:00.749+0000 7f78011f7700 1 --2- 172.21.15.163:0/1718587670 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f77fc0fed40 0x7f77fc0fe7c0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f77ec00d950 tx=0x7f77ec00dc60 comp rx=0 tx=0).stop 2023-07-14T18:11:00.789 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:00.749+0000 7f78011f7700 1 -- 172.21.15.163:0/1718587670 shutdown_connections 2023-07-14T18:11:00.789 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:00.749+0000 7f78011f7700 1 --2- 172.21.15.163:0/1718587670 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f77e40a11a0 0x7f77e40a3650 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:00.789 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:00.749+0000 7f78011f7700 1 --2- 172.21.15.163:0/1718587670 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f77fc100180 0x7f77fc19cc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:00.790 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:00.749+0000 7f78011f7700 1 --2- 172.21.15.163:0/1718587670 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f77fc0fed40 0x7f77fc0fe7c0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:00.790 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:00.749+0000 7f78011f7700 1 --2- 172.21.15.163:0/1718587670 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f77fc0ff6f0 0x7f77fc19a640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:00.790 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:00.749+0000 7f78011f7700 1 -- 172.21.15.163:0/1718587670 >> 172.21.15.163:0/1718587670 conn(0x7f77fc0f98a0 msgr2=0x7f77fc0fbb20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:11:00.790 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:00.750+0000 7f78011f7700 1 -- 172.21.15.163:0/1718587670 shutdown_connections 2023-07-14T18:11:00.790 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:00.750+0000 7f78011f7700 1 -- 172.21.15.163:0/1718587670 wait complete. 2023-07-14T18:11:00.790 INFO:teuthology.orchestra.run.smithi163.stderr:dumped fsmap epoch 11 2023-07-14T18:11:00.923 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:11:00 smithi184 ceph-mon[98481]: pgmap v238: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-07-14T18:11:00.923 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:11:00 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:11:00.923 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:11:00 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:11:00.924 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:11:00 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:11:00.924 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:11:00 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-07-14T18:11:00.924 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:11:00 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-07-14T18:11:00.924 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:11:00 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T18:11:00.924 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:11:00 smithi184 ceph-mon[98481]: Deploying daemon mds.a on smithi163 2023-07-14T18:11:00.924 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:11:00 smithi184 ceph-mon[98481]: mds.? [v2:172.21.15.163:6838/1337572937,v1:172.21.15.163:6839/1337572937] up:boot 2023-07-14T18:11:00.924 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:11:00 smithi184 ceph-mon[98481]: fsmap 10 up:standby 2023-07-14T18:11:00.925 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:11:00 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2023-07-14T18:11:01.151 INFO:journalctl@ceph.mds.a.smithi163.stdout:Jul 14 18:11:00 smithi163 systemd[1]: Starting Ceph mds.a for bf7326ec-2270-11ee-9b33-001a4aab830c... 2023-07-14T18:11:01.405 INFO:journalctl@ceph.mds.a.smithi163.stdout:Jul 14 18:11:01 smithi163 podman[131142]: 2023-07-14T18:11:01.715 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:11:01 smithi163 ceph-mon[96576]: from='client.? 172.21.15.163:0/1718587670' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-07-14T18:11:01.716 INFO:journalctl@ceph.mds.a.smithi163.stdout:Jul 14 18:11:01 smithi163 ceph-mds[131182]: -- 172.21.15.163:0/3158914267 <== mon.0 v2:172.21.15.163:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x5611174d91e0 con 0x5611174af000 2023-07-14T18:11:01.716 INFO:journalctl@ceph.mds.a.smithi163.stdout:Jul 14 18:11:01 smithi163 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-mds-a[131158]: starting mds.a at 2023-07-14T18:11:01.716 INFO:journalctl@ceph.mds.a.smithi163.stdout:Jul 14 18:11:01 smithi163 bash[131142]: 5fc461a57d1807d8147c68620628cbe8e8a5363d6dbc412ac638ea20bdb787d8 2023-07-14T18:11:01.716 INFO:journalctl@ceph.mds.a.smithi163.stdout:Jul 14 18:11:01 smithi163 systemd[1]: Started Ceph mds.a for bf7326ec-2270-11ee-9b33-001a4aab830c. 2023-07-14T18:11:01.774 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:11:01 smithi172 ceph-mon[97983]: from='client.? 172.21.15.163:0/1718587670' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-07-14T18:11:01.913 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:11:01 smithi184 ceph-mon[98481]: from='client.? 172.21.15.163:0/1718587670' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-07-14T18:11:02.577 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:11:02 smithi184 ceph-mon[98481]: pgmap v239: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-07-14T18:11:02.578 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:11:02 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:11:02.578 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:11:02 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:11:02.578 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:11:02 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:11:02.578 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:11:02 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-07-14T18:11:02.578 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:11:02 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-07-14T18:11:02.579 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:11:02 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T18:11:02.579 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:11:02 smithi184 ceph-mon[98481]: Deploying daemon mds.b on smithi172 2023-07-14T18:11:02.579 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:11:02 smithi184 ceph-mon[98481]: mds.? [v2:172.21.15.163:6840/1032082642,v1:172.21.15.163:6841/1032082642] up:boot 2023-07-14T18:11:02.579 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:11:02 smithi184 ceph-mon[98481]: fsmap 11 up:standby 2023-07-14T18:11:02.579 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:11:02 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2023-07-14T18:11:02.774 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:11:02 smithi172 ceph-mon[97983]: pgmap v239: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-07-14T18:11:02.774 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:11:02 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:11:02.774 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:11:02 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:11:02.774 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:11:02 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:11:02.774 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:11:02 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-07-14T18:11:02.775 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:11:02 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-07-14T18:11:02.775 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:11:02 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T18:11:02.775 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:11:02 smithi172 ceph-mon[97983]: Deploying daemon mds.b on smithi172 2023-07-14T18:11:02.775 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:11:02 smithi172 ceph-mon[97983]: mds.? [v2:172.21.15.163:6840/1032082642,v1:172.21.15.163:6841/1032082642] up:boot 2023-07-14T18:11:02.775 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:11:02 smithi172 ceph-mon[97983]: fsmap 11 up:standby 2023-07-14T18:11:02.775 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:11:02 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2023-07-14T18:11:02.806 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-14T18:11:02.840 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:11:02 smithi163 ceph-mon[96576]: pgmap v239: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-07-14T18:11:02.840 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:11:02 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:11:02.840 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:11:02 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:11:02.840 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:11:02 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:11:02.840 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:11:02 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-07-14T18:11:02.841 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:11:02 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-07-14T18:11:02.841 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:11:02 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T18:11:02.841 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:11:02 smithi163 ceph-mon[96576]: Deploying daemon mds.b on smithi172 2023-07-14T18:11:02.841 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:11:02 smithi163 ceph-mon[96576]: mds.? [v2:172.21.15.163:6840/1032082642,v1:172.21.15.163:6841/1032082642] up:boot 2023-07-14T18:11:02.841 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:11:02 smithi163 ceph-mon[96576]: fsmap 11 up:standby 2023-07-14T18:11:02.841 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:11:02 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2023-07-14T18:11:02.946 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:02.907+0000 7fb6ca9f3700 1 -- 172.21.15.163:0/2440288391 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fb6c41017c0 msgr2=0x7fb6c4108080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:11:02.947 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:02.907+0000 7fb6ca9f3700 1 --2- 172.21.15.163:0/2440288391 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fb6c41017c0 0x7fb6c4108080 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fb6bc00b0a0 tx=0x7fb6bc00b3b0 comp rx=0 tx=0).stop 2023-07-14T18:11:02.947 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:02.907+0000 7fb6ca9f3700 1 -- 172.21.15.163:0/2440288391 shutdown_connections 2023-07-14T18:11:02.947 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:02.907+0000 7fb6ca9f3700 1 --2- 172.21.15.163:0/2440288391 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb6c40ffc40 0x7fb6c4100050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:02.947 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:02.907+0000 7fb6ca9f3700 1 --2- 172.21.15.163:0/2440288391 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fb6c41017c0 0x7fb6c4108080 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:02.947 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:02.907+0000 7fb6ca9f3700 1 --2- 172.21.15.163:0/2440288391 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb6c4100e30 0x7fb6c4101280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:02.947 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:02.907+0000 7fb6ca9f3700 1 -- 172.21.15.163:0/2440288391 >> 172.21.15.163:0/2440288391 conn(0x7fb6c40fb240 msgr2=0x7fb6c40fd690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:11:02.947 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:02.907+0000 7fb6ca9f3700 1 -- 172.21.15.163:0/2440288391 shutdown_connections 2023-07-14T18:11:02.948 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:02.907+0000 7fb6ca9f3700 1 -- 172.21.15.163:0/2440288391 wait complete. 2023-07-14T18:11:02.948 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:02.907+0000 7fb6ca9f3700 1 Processor -- start 2023-07-14T18:11:02.948 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:02.907+0000 7fb6ca9f3700 1 -- start start 2023-07-14T18:11:02.950 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:02.908+0000 7fb6ca9f3700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fb6c40ffc40 0x7fb6c41959a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:11:02.950 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:02.908+0000 7fb6ca9f3700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb6c4100e30 0x7fb6c4195ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:11:02.950 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:02.908+0000 7fb6ca9f3700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb6c41017c0 0x7fb6c419cf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:11:02.950 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:02.908+0000 7fb6ca9f3700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6c419d520 con 0x7fb6c40ffc40 2023-07-14T18:11:02.950 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:02.908+0000 7fb6ca9f3700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6c419d660 con 0x7fb6c4100e30 2023-07-14T18:11:02.950 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:02.908+0000 7fb6ca9f3700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6c419d7f0 con 0x7fb6c41017c0 2023-07-14T18:11:02.950 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:02.908+0000 7fb6c3fff700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fb6c40ffc40 0x7fb6c41959a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:11:02.951 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:02.908+0000 7fb6c3fff700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fb6c40ffc40 0x7fb6c41959a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:55616/0 (socket says 172.21.15.163:55616) 2023-07-14T18:11:02.951 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:02.908+0000 7fb6c3fff700 1 -- 172.21.15.163:0/1280489510 learned_addr learned my addr 172.21.15.163:0/1280489510 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:11:02.951 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:02.908+0000 7fb6c37fe700 1 --2- 172.21.15.163:0/1280489510 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb6c4100e30 0x7fb6c4195ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:11:02.951 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:02.908+0000 7fb6c8f90700 1 --2- 172.21.15.163:0/1280489510 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb6c41017c0 0x7fb6c419cf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:11:02.951 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:02.908+0000 7fb6c3fff700 1 -- 172.21.15.163:0/1280489510 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb6c41017c0 msgr2=0x7fb6c419cf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:11:02.951 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:02.908+0000 7fb6c3fff700 1 --2- 172.21.15.163:0/1280489510 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb6c41017c0 0x7fb6c419cf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:02.951 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:02.908+0000 7fb6c3fff700 1 -- 172.21.15.163:0/1280489510 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb6c4100e30 msgr2=0x7fb6c4195ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:11:02.952 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:02.908+0000 7fb6c3fff700 1 --2- 172.21.15.163:0/1280489510 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb6c4100e30 0x7fb6c4195ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:02.952 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:02.908+0000 7fb6c3fff700 1 -- 172.21.15.163:0/1280489510 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6bc009d00 con 0x7fb6c40ffc40 2023-07-14T18:11:02.952 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:02.908+0000 7fb6c8f90700 1 --2- 172.21.15.163:0/1280489510 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb6c41017c0 0x7fb6c419cf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T18:11:02.952 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:02.908+0000 7fb6c3fff700 1 --2- 172.21.15.163:0/1280489510 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fb6c40ffc40 0x7fb6c41959a0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fb6b400d980 tx=0x7fb6b400dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:11:02.952 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:02.908+0000 7fb6c17fa700 1 -- 172.21.15.163:0/1280489510 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6b400b950 con 0x7fb6c40ffc40 2023-07-14T18:11:02.952 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:02.908+0000 7fb6ca9f3700 1 -- 172.21.15.163:0/1280489510 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb6c419dad0 con 0x7fb6c40ffc40 2023-07-14T18:11:02.952 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:02.908+0000 7fb6c17fa700 1 -- 172.21.15.163:0/1280489510 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fb6b4007620 con 0x7fb6c40ffc40 2023-07-14T18:11:02.952 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:02.908+0000 7fb6c17fa700 1 -- 172.21.15.163:0/1280489510 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6b400f3c0 con 0x7fb6c40ffc40 2023-07-14T18:11:02.953 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:02.908+0000 7fb6ca9f3700 1 -- 172.21.15.163:0/1280489510 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb6c419e030 con 0x7fb6c40ffc40 2023-07-14T18:11:02.953 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:02.909+0000 7fb6ca9f3700 1 -- 172.21.15.163:0/1280489510 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb6c4107190 con 0x7fb6c40ffc40 2023-07-14T18:11:02.953 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:02.910+0000 7fb6c17fa700 1 -- 172.21.15.163:0/1280489510 <== mon.0 v2:172.21.15.163:3300/0 4 ==== mgrmap(e 16) v1 ==== 135716+0+0 (secure 0 0 0) 0x7fb6b400bab0 con 0x7fb6c40ffc40 2023-07-14T18:11:02.954 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:02.911+0000 7fb6c17fa700 1 --2- 172.21.15.163:0/1280489510 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7fb6ac0a11a0 0x7fb6ac0a3650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:11:02.954 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:02.911+0000 7fb6c37fe700 1 --2- 172.21.15.163:0/1280489510 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7fb6ac0a11a0 0x7fb6ac0a3650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:11:02.954 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:02.911+0000 7fb6c17fa700 1 -- 172.21.15.163:0/1280489510 <== mon.0 v2:172.21.15.163:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 7127+0+0 (secure 0 0 0) 0x7fb6b40ccb30 con 0x7fb6c40ffc40 2023-07-14T18:11:02.954 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:02.911+0000 7fb6c37fe700 1 --2- 172.21.15.163:0/1280489510 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7fb6ac0a11a0 0x7fb6ac0a3650 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fb6b8009be0 tx=0x7fb6b8009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:11:02.954 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:02.914+0000 7fb6c17fa700 1 -- 172.21.15.163:0/1280489510 <== mon.0 v2:172.21.15.163:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178025 (secure 0 0 0) 0x7fb6b4096720 con 0x7fb6c40ffc40 2023-07-14T18:11:03.183 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:03.144+0000 7fb6ca9f3700 1 -- 172.21.15.163:0/1280489510 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb6c402c8e0 con 0x7fb6c40ffc40 2023-07-14T18:11:03.265 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:03.145+0000 7fb6c17fa700 1 -- 172.21.15.163:0/1280489510 <== mon.0 v2:172.21.15.163:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 12 v12) v1 ==== 94+0+8858 (secure 0 0 0) 0x7fb6b400bd60 con 0x7fb6c40ffc40 2023-07-14T18:11:03.266 INFO:teuthology.orchestra.run.smithi163.stdout: 2023-07-14T18:11:03.266 INFO:teuthology.orchestra.run.smithi163.stdout:{"epoch":12,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14562,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.163:6835/1058662632","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6834","nonce":1058662632},{"type":"v1","addr":"172.21.15.163:6835","nonce":1058662632}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":14568,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.163:6837/1107244425","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6836","nonce":1107244425},{"type":"v1","addr":"172.21.15.163:6837","nonce":1107244425}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5},{"gid":14640,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.163:6839/1337572937","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6838","nonce":1337572937},{"type":"v1","addr":"172.21.15.163:6839","nonce":1337572937}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":14652,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.163:6841/1032082642","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6840","nonce":1032082642},{"type":"v1","addr":"172.21.15.163:6841","nonce":1032082642}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":24421,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6833/797722972","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6832","nonce":797722972},{"type":"v1","addr":"172.21.15.184:6833","nonce":797722972}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":24431,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6833/1075696311","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":1075696311},{"type":"v1","addr":"172.21.15.172:6833","nonce":1075696311}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":24458,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6835/1158120127","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":1158120127},{"type":"v1","addr":"172.21.15.172:6835","nonce":1158120127}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":6},{"gid":24466,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6835/460134263","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6834","nonce":460134263},{"type":"v1","addr":"172.21.15.184:6835","nonce":460134263}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":7},{"gid":24478,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6837/3389277679","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6836","nonce":3389277679},{"type":"v1","addr":"172.21.15.184:6837","nonce":3389277679}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":8},{"gid":24479,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6837/3783835012","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":3783835012},{"type":"v1","addr":"172.21.15.172:6837","nonce":3783835012}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":9},{"gid":24493,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6839/2819059257","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6838","nonce":2819059257},{"type":"v1","addr":"172.21.15.184:6839","nonce":2819059257}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10}],"filesystems":[]} 2023-07-14T18:11:03.267 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:03.147+0000 7fb6ca9f3700 1 -- 172.21.15.163:0/1280489510 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7fb6ac0a11a0 msgr2=0x7fb6ac0a3650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:11:03.267 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:03.147+0000 7fb6ca9f3700 1 --2- 172.21.15.163:0/1280489510 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7fb6ac0a11a0 0x7fb6ac0a3650 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fb6b8009be0 tx=0x7fb6b8009260 comp rx=0 tx=0).stop 2023-07-14T18:11:03.267 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:03.147+0000 7fb6ca9f3700 1 -- 172.21.15.163:0/1280489510 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fb6c40ffc40 msgr2=0x7fb6c41959a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:11:03.268 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:03.147+0000 7fb6ca9f3700 1 --2- 172.21.15.163:0/1280489510 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fb6c40ffc40 0x7fb6c41959a0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fb6b400d980 tx=0x7fb6b400dc90 comp rx=0 tx=0).stop 2023-07-14T18:11:03.268 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:03.147+0000 7fb6ca9f3700 1 -- 172.21.15.163:0/1280489510 shutdown_connections 2023-07-14T18:11:03.268 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:03.147+0000 7fb6ca9f3700 1 --2- 172.21.15.163:0/1280489510 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7fb6ac0a11a0 0x7fb6ac0a3650 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:03.268 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:03.147+0000 7fb6ca9f3700 1 --2- 172.21.15.163:0/1280489510 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb6c41017c0 0x7fb6c419cf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:03.268 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:03.147+0000 7fb6ca9f3700 1 --2- 172.21.15.163:0/1280489510 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fb6c40ffc40 0x7fb6c41959a0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:03.268 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:03.147+0000 7fb6ca9f3700 1 --2- 172.21.15.163:0/1280489510 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb6c4100e30 0x7fb6c4195ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:03.268 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:03.147+0000 7fb6ca9f3700 1 -- 172.21.15.163:0/1280489510 >> 172.21.15.163:0/1280489510 conn(0x7fb6c40fb240 msgr2=0x7fb6c41042d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:11:03.269 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:03.147+0000 7fb6ca9f3700 1 -- 172.21.15.163:0/1280489510 shutdown_connections 2023-07-14T18:11:03.269 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:03.147+0000 7fb6ca9f3700 1 -- 172.21.15.163:0/1280489510 wait complete. 2023-07-14T18:11:03.269 INFO:teuthology.orchestra.run.smithi163.stderr:dumped fsmap epoch 12 2023-07-14T18:11:03.389 INFO:journalctl@ceph.mds.b.smithi172.stdout:Jul 14 18:11:03 smithi172 systemd[1]: Starting Ceph mds.b for bf7326ec-2270-11ee-9b33-001a4aab830c... 2023-07-14T18:11:03.687 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:11:03 smithi172 ceph-mon[97983]: from='client.? 172.21.15.163:0/1280489510' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-07-14T18:11:03.687 INFO:journalctl@ceph.mds.b.smithi172.stdout:Jul 14 18:11:03 smithi172 podman[123243]: 2023-07-14T18:11:03.688 INFO:journalctl@ceph.mds.b.smithi172.stdout:Jul 14 18:11:03 smithi172 ceph-mds[123283]: -- 172.21.15.172:0/2496455791 <== mon.2 v2:172.21.15.172:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55712c0531e0 con 0x55712c028800 2023-07-14T18:11:03.688 INFO:journalctl@ceph.mds.b.smithi172.stdout:Jul 14 18:11:03 smithi172 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-mds-b[123259]: starting mds.b at 2023-07-14T18:11:03.913 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:11:03 smithi184 ceph-mon[98481]: from='client.? 172.21.15.163:0/1280489510' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-07-14T18:11:03.965 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:11:03 smithi163 ceph-mon[96576]: from='client.? 172.21.15.163:0/1280489510' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-07-14T18:11:04.024 INFO:journalctl@ceph.mds.b.smithi172.stdout:Jul 14 18:11:03 smithi172 bash[123243]: 0448994255cf473d6c4db980f1363eb6e3ae02185ff3704734b85a1e3fe7fe8a 2023-07-14T18:11:04.024 INFO:journalctl@ceph.mds.b.smithi172.stdout:Jul 14 18:11:03 smithi172 systemd[1]: Started Ceph mds.b for bf7326ec-2270-11ee-9b33-001a4aab830c. 2023-07-14T18:11:05.173 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:11:04 smithi184 ceph-mon[98481]: pgmap v240: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-07-14T18:11:05.173 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:11:04 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:11:05.173 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:11:04 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:11:05.174 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:11:04 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:11:05.174 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:11:04 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:11:05.174 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:11:04 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:11:05.174 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:11:04 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-14T18:11:05.174 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:11:04 smithi184 ceph-mon[98481]: mds.? [v2:172.21.15.172:6838/3850440096,v1:172.21.15.172:6839/3850440096] up:boot 2023-07-14T18:11:05.174 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:11:04 smithi184 ceph-mon[98481]: fsmap 12 up:standby 2023-07-14T18:11:05.174 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:11:04 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2023-07-14T18:11:05.216 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:11:04 smithi163 ceph-mon[96576]: pgmap v240: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-07-14T18:11:05.216 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:11:04 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:11:05.216 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:11:04 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:11:05.216 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:11:04 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:11:05.216 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:11:04 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:11:05.217 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:11:04 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:11:05.217 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:11:04 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-14T18:11:05.217 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:11:04 smithi163 ceph-mon[96576]: mds.? [v2:172.21.15.172:6838/3850440096,v1:172.21.15.172:6839/3850440096] up:boot 2023-07-14T18:11:05.217 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:11:04 smithi163 ceph-mon[96576]: fsmap 12 up:standby 2023-07-14T18:11:05.217 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:11:04 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2023-07-14T18:11:05.270 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-14T18:11:05.274 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:11:04 smithi172 ceph-mon[97983]: pgmap v240: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-07-14T18:11:05.274 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:11:04 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:11:05.275 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:11:04 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:11:05.275 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:11:04 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:11:05.275 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:11:04 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:11:05.275 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:11:04 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:11:05.275 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:11:04 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-14T18:11:05.275 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:11:04 smithi172 ceph-mon[97983]: mds.? [v2:172.21.15.172:6838/3850440096,v1:172.21.15.172:6839/3850440096] up:boot 2023-07-14T18:11:05.275 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:11:04 smithi172 ceph-mon[97983]: fsmap 12 up:standby 2023-07-14T18:11:05.276 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:11:04 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2023-07-14T18:11:05.401 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:05.361+0000 7fb7de0fa700 1 -- 172.21.15.163:0/1241320947 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fb7d81006b0 msgr2=0x7fb7d8106f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:11:05.401 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:05.361+0000 7fb7de0fa700 1 --2- 172.21.15.163:0/1241320947 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fb7d81006b0 0x7fb7d8106f70 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fb7c8009990 tx=0x7fb7c8009ca0 comp rx=0 tx=0).stop 2023-07-14T18:11:05.402 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:05.361+0000 7fb7de0fa700 1 -- 172.21.15.163:0/1241320947 shutdown_connections 2023-07-14T18:11:05.402 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:05.361+0000 7fb7de0fa700 1 --2- 172.21.15.163:0/1241320947 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb7d80feb30 0x7fb7d80fef40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:05.402 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:05.361+0000 7fb7de0fa700 1 --2- 172.21.15.163:0/1241320947 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fb7d81006b0 0x7fb7d8106f70 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:05.402 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:05.361+0000 7fb7de0fa700 1 --2- 172.21.15.163:0/1241320947 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb7d80ffd20 0x7fb7d8100170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:05.402 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:05.361+0000 7fb7de0fa700 1 -- 172.21.15.163:0/1241320947 >> 172.21.15.163:0/1241320947 conn(0x7fb7d80fa110 msgr2=0x7fb7d80fc580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:11:05.402 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:05.362+0000 7fb7de0fa700 1 -- 172.21.15.163:0/1241320947 shutdown_connections 2023-07-14T18:11:05.402 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:05.362+0000 7fb7de0fa700 1 -- 172.21.15.163:0/1241320947 wait complete. 2023-07-14T18:11:05.403 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:05.362+0000 7fb7de0fa700 1 Processor -- start 2023-07-14T18:11:05.405 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:05.362+0000 7fb7de0fa700 1 -- start start 2023-07-14T18:11:05.405 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:05.362+0000 7fb7de0fa700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fb7d80feb30 0x7fb7d81957a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:11:05.405 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:05.362+0000 7fb7de0fa700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb7d80ffd20 0x7fb7d8195ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:11:05.405 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:05.362+0000 7fb7de0fa700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb7d81006b0 0x7fb7d819cd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:11:05.405 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:05.362+0000 7fb7de0fa700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7d819d320 con 0x7fb7d80feb30 2023-07-14T18:11:05.406 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:05.363+0000 7fb7de0fa700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7d819d460 con 0x7fb7d80ffd20 2023-07-14T18:11:05.406 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:05.363+0000 7fb7de0fa700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7d819d5f0 con 0x7fb7d81006b0 2023-07-14T18:11:05.406 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:05.363+0000 7fb7d77fe700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fb7d80feb30 0x7fb7d81957a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:11:05.406 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:05.363+0000 7fb7d77fe700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fb7d80feb30 0x7fb7d81957a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:55628/0 (socket says 172.21.15.163:55628) 2023-07-14T18:11:05.406 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:05.363+0000 7fb7d77fe700 1 -- 172.21.15.163:0/1131518282 learned_addr learned my addr 172.21.15.163:0/1131518282 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:11:05.406 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:05.363+0000 7fb7d6ffd700 1 --2- 172.21.15.163:0/1131518282 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb7d80ffd20 0x7fb7d8195ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:11:05.406 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:05.363+0000 7fb7d7fff700 1 --2- 172.21.15.163:0/1131518282 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb7d81006b0 0x7fb7d819cd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:11:05.406 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:05.363+0000 7fb7d77fe700 1 -- 172.21.15.163:0/1131518282 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb7d81006b0 msgr2=0x7fb7d819cd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:11:05.407 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:05.363+0000 7fb7d77fe700 1 --2- 172.21.15.163:0/1131518282 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb7d81006b0 0x7fb7d819cd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:05.407 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:05.363+0000 7fb7d77fe700 1 -- 172.21.15.163:0/1131518282 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb7d80ffd20 msgr2=0x7fb7d8195ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:11:05.407 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:05.363+0000 7fb7d77fe700 1 --2- 172.21.15.163:0/1131518282 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb7d80ffd20 0x7fb7d8195ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:05.407 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:05.363+0000 7fb7d77fe700 1 -- 172.21.15.163:0/1131518282 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7c80095f0 con 0x7fb7d80feb30 2023-07-14T18:11:05.407 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:05.363+0000 7fb7d6ffd700 1 --2- 172.21.15.163:0/1131518282 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb7d80ffd20 0x7fb7d8195ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T18:11:05.407 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:05.363+0000 7fb7d77fe700 1 --2- 172.21.15.163:0/1131518282 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fb7d80feb30 0x7fb7d81957a0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fb7d000efc0 tx=0x7fb7d000c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:11:05.407 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:05.363+0000 7fb7d4ff9700 1 -- 172.21.15.163:0/1131518282 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7d0018070 con 0x7fb7d80feb30 2023-07-14T18:11:05.408 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:05.363+0000 7fb7d4ff9700 1 -- 172.21.15.163:0/1131518282 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fb7d000f040 con 0x7fb7d80feb30 2023-07-14T18:11:05.408 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:05.363+0000 7fb7de0fa700 1 -- 172.21.15.163:0/1131518282 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb7d819d870 con 0x7fb7d80feb30 2023-07-14T18:11:05.408 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:05.363+0000 7fb7d4ff9700 1 -- 172.21.15.163:0/1131518282 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7d0004280 con 0x7fb7d80feb30 2023-07-14T18:11:05.408 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:05.363+0000 7fb7de0fa700 1 -- 172.21.15.163:0/1131518282 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb7d819dd80 con 0x7fb7d80feb30 2023-07-14T18:11:05.408 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:05.364+0000 7fb7de0fa700 1 -- 172.21.15.163:0/1131518282 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb7d810a1c0 con 0x7fb7d80feb30 2023-07-14T18:11:05.408 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:05.365+0000 7fb7d4ff9700 1 -- 172.21.15.163:0/1131518282 <== mon.0 v2:172.21.15.163:3300/0 4 ==== mgrmap(e 16) v1 ==== 135716+0+0 (secure 0 0 0) 0x7fb7d0003a00 con 0x7fb7d80feb30 2023-07-14T18:11:05.409 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:05.366+0000 7fb7d4ff9700 1 --2- 172.21.15.163:0/1131518282 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7fb7c40a11a0 0x7fb7c40a3650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:11:05.409 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:05.366+0000 7fb7d6ffd700 1 --2- 172.21.15.163:0/1131518282 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7fb7c40a11a0 0x7fb7c40a3650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:11:05.409 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:05.366+0000 7fb7d4ff9700 1 -- 172.21.15.163:0/1131518282 <== mon.0 v2:172.21.15.163:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 7127+0+0 (secure 0 0 0) 0x7fb7d00ccd00 con 0x7fb7d80feb30 2023-07-14T18:11:05.409 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:05.367+0000 7fb7d6ffd700 1 --2- 172.21.15.163:0/1131518282 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7fb7c40a11a0 0x7fb7c40a3650 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fb7c0011490 tx=0x7fb7c0009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:11:05.410 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:05.370+0000 7fb7d4ff9700 1 -- 172.21.15.163:0/1131518282 <== mon.0 v2:172.21.15.163:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178025 (secure 0 0 0) 0x7fb7d0096980 con 0x7fb7d80feb30 2023-07-14T18:11:05.658 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:05.619+0000 7fb7de0fa700 1 -- 172.21.15.163:0/1131518282 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb7d819e3c0 con 0x7fb7d80feb30 2023-07-14T18:11:05.659 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:05.619+0000 7fb7d4ff9700 1 -- 172.21.15.163:0/1131518282 <== mon.0 v2:172.21.15.163:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) v1 ==== 94+0+9619 (secure 0 0 0) 0x7fb7d0099fa0 con 0x7fb7d80feb30 2023-07-14T18:11:05.659 INFO:teuthology.orchestra.run.smithi163.stdout: 2023-07-14T18:11:05.659 INFO:teuthology.orchestra.run.smithi163.stdout:{"epoch":13,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14562,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.163:6835/1058662632","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6834","nonce":1058662632},{"type":"v1","addr":"172.21.15.163:6835","nonce":1058662632}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":14568,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.163:6837/1107244425","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6836","nonce":1107244425},{"type":"v1","addr":"172.21.15.163:6837","nonce":1107244425}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5},{"gid":14640,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.163:6839/1337572937","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6838","nonce":1337572937},{"type":"v1","addr":"172.21.15.163:6839","nonce":1337572937}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":14652,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.163:6841/1032082642","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6840","nonce":1032082642},{"type":"v1","addr":"172.21.15.163:6841","nonce":1032082642}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":24421,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6833/797722972","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6832","nonce":797722972},{"type":"v1","addr":"172.21.15.184:6833","nonce":797722972}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":24431,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6833/1075696311","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":1075696311},{"type":"v1","addr":"172.21.15.172:6833","nonce":1075696311}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":24458,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6835/1158120127","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":1158120127},{"type":"v1","addr":"172.21.15.172:6835","nonce":1158120127}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":6},{"gid":24466,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6835/460134263","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6834","nonce":460134263},{"type":"v1","addr":"172.21.15.184:6835","nonce":460134263}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":7},{"gid":24478,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6837/3389277679","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6836","nonce":3389277679},{"type":"v1","addr":"172.21.15.184:6837","nonce":3389277679}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":8},{"gid":24479,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6837/3783835012","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":3783835012},{"type":"v1","addr":"172.21.15.172:6837","nonce":3783835012}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":9},{"gid":24493,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6839/2819059257","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6838","nonce":2819059257},{"type":"v1","addr":"172.21.15.184:6839","nonce":2819059257}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":24518,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6839/3850440096","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6838","nonce":3850440096},{"type":"v1","addr":"172.21.15.172:6839","nonce":3850440096}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":13}],"filesystems":[]} 2023-07-14T18:11:05.662 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:05.622+0000 7fb7de0fa700 1 -- 172.21.15.163:0/1131518282 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7fb7c40a11a0 msgr2=0x7fb7c40a3650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:11:05.662 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:05.622+0000 7fb7de0fa700 1 --2- 172.21.15.163:0/1131518282 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7fb7c40a11a0 0x7fb7c40a3650 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fb7c0011490 tx=0x7fb7c0009260 comp rx=0 tx=0).stop 2023-07-14T18:11:05.662 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:05.622+0000 7fb7de0fa700 1 -- 172.21.15.163:0/1131518282 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fb7d80feb30 msgr2=0x7fb7d81957a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:11:05.662 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:05.622+0000 7fb7de0fa700 1 --2- 172.21.15.163:0/1131518282 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fb7d80feb30 0x7fb7d81957a0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fb7d000efc0 tx=0x7fb7d000c3a0 comp rx=0 tx=0).stop 2023-07-14T18:11:05.662 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:05.622+0000 7fb7de0fa700 1 -- 172.21.15.163:0/1131518282 shutdown_connections 2023-07-14T18:11:05.662 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:05.622+0000 7fb7de0fa700 1 --2- 172.21.15.163:0/1131518282 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7fb7c40a11a0 0x7fb7c40a3650 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:05.662 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:05.622+0000 7fb7de0fa700 1 --2- 172.21.15.163:0/1131518282 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb7d81006b0 0x7fb7d819cd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:05.663 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:05.622+0000 7fb7de0fa700 1 --2- 172.21.15.163:0/1131518282 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fb7d80feb30 0x7fb7d81957a0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:05.663 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:05.622+0000 7fb7de0fa700 1 --2- 172.21.15.163:0/1131518282 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb7d80ffd20 0x7fb7d8195ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:05.663 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:05.622+0000 7fb7de0fa700 1 -- 172.21.15.163:0/1131518282 >> 172.21.15.163:0/1131518282 conn(0x7fb7d80fa110 msgr2=0x7fb7d8068870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:11:05.663 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:05.622+0000 7fb7de0fa700 1 -- 172.21.15.163:0/1131518282 shutdown_connections 2023-07-14T18:11:05.663 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:05.622+0000 7fb7de0fa700 1 -- 172.21.15.163:0/1131518282 wait complete. 2023-07-14T18:11:05.663 INFO:teuthology.orchestra.run.smithi163.stderr:dumped fsmap epoch 13 2023-07-14T18:11:05.680 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-14T18:11:05.811 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:05.768+0000 7f7738a78700 1 -- 172.21.15.163:0/2605765084 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f77340fdf10 msgr2=0x7f77340fe320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:11:05.812 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:05.768+0000 7f7738a78700 1 --2- 172.21.15.163:0/2605765084 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f77340fdf10 0x7f77340fe320 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f7724009990 tx=0x7f7724009ca0 comp rx=0 tx=0).stop 2023-07-14T18:11:05.812 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:05.768+0000 7f7738a78700 1 -- 172.21.15.163:0/2605765084 shutdown_connections 2023-07-14T18:11:05.812 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:05.768+0000 7f7738a78700 1 --2- 172.21.15.163:0/2605765084 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7734101870 0x7f7734108130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:05.813 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:05.768+0000 7f7738a78700 1 --2- 172.21.15.163:0/2605765084 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f77340fdf10 0x7f77340fe320 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:05.813 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:05.768+0000 7f7738a78700 1 --2- 172.21.15.163:0/2605765084 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7734100ee0 0x7f7734101330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:05.813 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:05.768+0000 7f7738a78700 1 -- 172.21.15.163:0/2605765084 >> 172.21.15.163:0/2605765084 conn(0x7f77340f98d0 msgr2=0x7f77340fbd20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:11:05.814 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:05.768+0000 7f7738a78700 1 -- 172.21.15.163:0/2605765084 shutdown_connections 2023-07-14T18:11:05.814 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:05.768+0000 7f7738a78700 1 -- 172.21.15.163:0/2605765084 wait complete. 2023-07-14T18:11:05.814 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:05.769+0000 7f7738a78700 1 Processor -- start 2023-07-14T18:11:05.814 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:05.769+0000 7f7738a78700 1 -- start start 2023-07-14T18:11:05.815 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:05.770+0000 7f7738a78700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f77340fdf10 0x7f77341958b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:11:05.815 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:05.770+0000 7f7738a78700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7734100ee0 0x7f7734195df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:11:05.815 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:05.770+0000 7f7738a78700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f7734101870 0x7f773419ce60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:11:05.816 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:05.770+0000 7f7738a78700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f773419d430 con 0x7f7734101870 2023-07-14T18:11:05.816 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:05.770+0000 7f7738a78700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f773419d570 con 0x7f7734100ee0 2023-07-14T18:11:05.816 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:05.770+0000 7f7738a78700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f773419d700 con 0x7f77340fdf10 2023-07-14T18:11:05.816 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:05.770+0000 7f7732d9d700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f7734101870 0x7f773419ce60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:11:05.817 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:05.770+0000 7f773259c700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f77340fdf10 0x7f77341958b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:11:05.817 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:05.770+0000 7f773259c700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f77340fdf10 0x7f77341958b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.163:37462/0 (socket says 172.21.15.163:37462) 2023-07-14T18:11:05.817 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:05.770+0000 7f773259c700 1 -- 172.21.15.163:0/749852288 learned_addr learned my addr 172.21.15.163:0/749852288 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:11:05.818 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:05.770+0000 7f7731d9b700 1 --2- 172.21.15.163:0/749852288 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7734100ee0 0x7f7734195df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:11:05.818 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:05.770+0000 7f773259c700 1 -- 172.21.15.163:0/749852288 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7734100ee0 msgr2=0x7f7734195df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:11:05.818 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:05.770+0000 7f773259c700 1 --2- 172.21.15.163:0/749852288 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7734100ee0 0x7f7734195df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:05.818 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:05.770+0000 7f773259c700 1 -- 172.21.15.163:0/749852288 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f7734101870 msgr2=0x7f773419ce60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:11:05.819 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:05.770+0000 7f773259c700 1 --2- 172.21.15.163:0/749852288 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f7734101870 0x7f773419ce60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:05.819 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:05.770+0000 7f773259c700 1 -- 172.21.15.163:0/749852288 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77240095f0 con 0x7f77340fdf10 2023-07-14T18:11:05.819 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:05.770+0000 7f7732d9d700 1 --2- 172.21.15.163:0/749852288 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f7734101870 0x7f773419ce60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T18:11:05.820 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:05.770+0000 7f773259c700 1 --2- 172.21.15.163:0/749852288 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f77340fdf10 0x7f77341958b0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f77240059d0 tx=0x7f7724004730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:11:05.820 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:05.770+0000 7f77237fe700 1 -- 172.21.15.163:0/749852288 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f772401d070 con 0x7f77340fdf10 2023-07-14T18:11:05.820 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:05.771+0000 7f77237fe700 1 -- 172.21.15.163:0/749852288 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f772400bdb0 con 0x7f77340fdf10 2023-07-14T18:11:05.820 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:05.771+0000 7f7738a78700 1 -- 172.21.15.163:0/749852288 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f77340fecd0 con 0x7f77340fdf10 2023-07-14T18:11:05.820 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:05.771+0000 7f77237fe700 1 -- 172.21.15.163:0/749852288 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7724022cf0 con 0x7f77340fdf10 2023-07-14T18:11:05.821 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:05.771+0000 7f7738a78700 1 -- 172.21.15.163:0/749852288 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f77340ff180 con 0x7f77340fdf10 2023-07-14T18:11:05.821 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:05.771+0000 7f7738a78700 1 -- 172.21.15.163:0/749852288 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f77341072b0 con 0x7f77340fdf10 2023-07-14T18:11:05.822 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:05.772+0000 7f77237fe700 1 -- 172.21.15.163:0/749852288 <== mon.1 v2:172.21.15.184:3300/0 4 ==== mgrmap(e 16) v1 ==== 135716+0+0 (secure 0 0 0) 0x7f772400b920 con 0x7f77340fdf10 2023-07-14T18:11:05.822 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:05.773+0000 7f77237fe700 1 --2- 172.21.15.163:0/749852288 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f771c0a11a0 0x7f771c0a3650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:11:05.822 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:05.773+0000 7f7731d9b700 1 --2- 172.21.15.163:0/749852288 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f771c0a11a0 0x7f771c0a3650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:11:05.822 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:05.773+0000 7f77237fe700 1 -- 172.21.15.163:0/749852288 <== mon.1 v2:172.21.15.184:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f77240cdc90 con 0x7f77340fdf10 2023-07-14T18:11:05.822 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:05.773+0000 7f7731d9b700 1 --2- 172.21.15.163:0/749852288 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f771c0a11a0 0x7f771c0a3650 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f7728009c60 tx=0x7f7728009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:11:05.823 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:05.781+0000 7f77237fe700 1 -- 172.21.15.163:0/749852288 <== mon.1 v2:172.21.15.184:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178025 (secure 0 0 0) 0x7f7724097870 con 0x7f77340fdf10 2023-07-14T18:11:06.026 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:05.987+0000 7f7738a78700 1 -- 172.21.15.163:0/749852288 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f773402c8e0 con 0x7f77340fdf10 2023-07-14T18:11:06.028 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:05.989+0000 7f77237fe700 1 -- 172.21.15.163:0/749852288 <== mon.1 v2:172.21.15.184:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v76) v1 ==== 74+0+18492 (secure 0 0 0) 0x7f772409ae90 con 0x7f77340fdf10 2023-07-14T18:11:06.028 INFO:teuthology.orchestra.run.smithi163.stdout: 2023-07-14T18:11:06.029 INFO:teuthology.orchestra.run.smithi163.stdout:{"epoch":76,"fsid":"bf7326ec-2270-11ee-9b33-001a4aab830c","created":"2023-07-14T18:04:26.263517+0000","modified":"2023-07-14T18:10:29.005628+0000","last_up_change":"2023-07-14T18:10:27.514863+0000","last_in_change":"2023-07-14T18:10:10.726443+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-14T18:07:19.653852+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e6490568-046d-43ef-bb07-d79fb884b276","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6802","nonce":3124653025},{"type":"v1","addr":"172.21.15.163:6803","nonce":3124653025}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6804","nonce":3124653025},{"type":"v1","addr":"172.21.15.163:6805","nonce":3124653025}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6808","nonce":3124653025},{"type":"v1","addr":"172.21.15.163:6809","nonce":3124653025}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6806","nonce":3124653025},{"type":"v1","addr":"172.21.15.163:6807","nonce":3124653025}]},"public_addr":"172.21.15.163:6803/3124653025","cluster_addr":"172.21.15.163:6805/3124653025","heartbeat_back_addr":"172.21.15.163:6809/3124653025","heartbeat_front_addr":"172.21.15.163:6807/3124653025","state":["exists","up"]},{"osd":1,"uuid":"0af39bda-f096-4603-adcc-bf1988f36603","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":3774455900},{"type":"v1","addr":"172.21.15.172:6801","nonce":3774455900}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":3774455900},{"type":"v1","addr":"172.21.15.172:6803","nonce":3774455900}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":3774455900},{"type":"v1","addr":"172.21.15.172:6807","nonce":3774455900}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":3774455900},{"type":"v1","addr":"172.21.15.172:6805","nonce":3774455900}]},"public_addr":"172.21.15.172:6801/3774455900","cluster_addr":"172.21.15.172:6803/3774455900","heartbeat_back_addr":"172.21.15.172:6807/3774455900","heartbeat_front_addr":"172.21.15.172:6805/3774455900","state":["exists","up"]},{"osd":2,"uuid":"cc732c13-af0f-4199-98e6-fe960ed4e5dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":1976927678},{"type":"v1","addr":"172.21.15.184:6801","nonce":1976927678}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":1976927678},{"type":"v1","addr":"172.21.15.184:6803","nonce":1976927678}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":1976927678},{"type":"v1","addr":"172.21.15.184:6807","nonce":1976927678}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":1976927678},{"type":"v1","addr":"172.21.15.184:6805","nonce":1976927678}]},"public_addr":"172.21.15.184:6801/1976927678","cluster_addr":"172.21.15.184:6803/1976927678","heartbeat_back_addr":"172.21.15.184:6807/1976927678","heartbeat_front_addr":"172.21.15.184:6805/1976927678","state":["exists","up"]},{"osd":3,"uuid":"dcee9576-0bc6-4ab0-8f63-79eacd0eca5f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6810","nonce":2589130694},{"type":"v1","addr":"172.21.15.163:6811","nonce":2589130694}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6812","nonce":2589130694},{"type":"v1","addr":"172.21.15.163:6813","nonce":2589130694}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6816","nonce":2589130694},{"type":"v1","addr":"172.21.15.163:6817","nonce":2589130694}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6814","nonce":2589130694},{"type":"v1","addr":"172.21.15.163:6815","nonce":2589130694}]},"public_addr":"172.21.15.163:6811/2589130694","cluster_addr":"172.21.15.163:6813/2589130694","heartbeat_back_addr":"172.21.15.163:6817/2589130694","heartbeat_front_addr":"172.21.15.163:6815/2589130694","state":["exists","up"]},{"osd":4,"uuid":"055df823-b8b0-426a-83c2-f0d727932ad8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":3319632614},{"type":"v1","addr":"172.21.15.172:6809","nonce":3319632614}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6810","nonce":3319632614},{"type":"v1","addr":"172.21.15.172:6811","nonce":3319632614}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6814","nonce":3319632614},{"type":"v1","addr":"172.21.15.172:6815","nonce":3319632614}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":3319632614},{"type":"v1","addr":"172.21.15.172:6813","nonce":3319632614}]},"public_addr":"172.21.15.172:6809/3319632614","cluster_addr":"172.21.15.172:6811/3319632614","heartbeat_back_addr":"172.21.15.172:6815/3319632614","heartbeat_front_addr":"172.21.15.172:6813/3319632614","state":["exists","up"]},{"osd":5,"uuid":"ef5ef02a-b4e2-4790-9d27-f6d2247b25c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":2662084043},{"type":"v1","addr":"172.21.15.184:6809","nonce":2662084043}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6810","nonce":2662084043},{"type":"v1","addr":"172.21.15.184:6811","nonce":2662084043}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6814","nonce":2662084043},{"type":"v1","addr":"172.21.15.184:6815","nonce":2662084043}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6812","nonce":2662084043},{"type":"v1","addr":"172.21.15.184:6813","nonce":2662084043}]},"public_addr":"172.21.15.184:6809/2662084043","cluster_addr":"172.21.15.184:6811/2662084043","heartbeat_back_addr":"172.21.15.184:6815/2662084043","heartbeat_front_addr":"172.21.15.184:6813/2662084043","state":["exists","up"]},{"osd":6,"uuid":"dba754be-0fc5-4867-a6d5-cf97eb344f81","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":44,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6818","nonce":2530874117},{"type":"v1","addr":"172.21.15.163:6819","nonce":2530874117}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6820","nonce":2530874117},{"type":"v1","addr":"172.21.15.163:6821","nonce":2530874117}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6824","nonce":2530874117},{"type":"v1","addr":"172.21.15.163:6825","nonce":2530874117}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6822","nonce":2530874117},{"type":"v1","addr":"172.21.15.163:6823","nonce":2530874117}]},"public_addr":"172.21.15.163:6819/2530874117","cluster_addr":"172.21.15.163:6821/2530874117","heartbeat_back_addr":"172.21.15.163:6825/2530874117","heartbeat_front_addr":"172.21.15.163:6823/2530874117","state":["exists","up"]},{"osd":7,"uuid":"edd76e6b-6077-4619-b00d-1e906f70ddcc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":49,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":233511803},{"type":"v1","addr":"172.21.15.172:6817","nonce":233511803}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6818","nonce":233511803},{"type":"v1","addr":"172.21.15.172:6819","nonce":233511803}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":233511803},{"type":"v1","addr":"172.21.15.172:6823","nonce":233511803}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6820","nonce":233511803},{"type":"v1","addr":"172.21.15.172:6821","nonce":233511803}]},"public_addr":"172.21.15.172:6817/233511803","cluster_addr":"172.21.15.172:6819/233511803","heartbeat_back_addr":"172.21.15.172:6823/233511803","heartbeat_front_addr":"172.21.15.172:6821/233511803","state":["exists","up"]},{"osd":8,"uuid":"36559400-f33e-44e6-868a-316d34da457d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":56,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6816","nonce":290154343},{"type":"v1","addr":"172.21.15.184:6817","nonce":290154343}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6818","nonce":290154343},{"type":"v1","addr":"172.21.15.184:6819","nonce":290154343}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6822","nonce":290154343},{"type":"v1","addr":"172.21.15.184:6823","nonce":290154343}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6820","nonce":290154343},{"type":"v1","addr":"172.21.15.184:6821","nonce":290154343}]},"public_addr":"172.21.15.184:6817/290154343","cluster_addr":"172.21.15.184:6819/290154343","heartbeat_back_addr":"172.21.15.184:6823/290154343","heartbeat_front_addr":"172.21.15.184:6821/290154343","state":["exists","up"]},{"osd":9,"uuid":"d484f111-f36c-4c67-9a8a-ae03e7e0d137","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6826","nonce":3848110906},{"type":"v1","addr":"172.21.15.163:6827","nonce":3848110906}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6828","nonce":3848110906},{"type":"v1","addr":"172.21.15.163:6829","nonce":3848110906}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6832","nonce":3848110906},{"type":"v1","addr":"172.21.15.163:6833","nonce":3848110906}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6830","nonce":3848110906},{"type":"v1","addr":"172.21.15.163:6831","nonce":3848110906}]},"public_addr":"172.21.15.163:6827/3848110906","cluster_addr":"172.21.15.163:6829/3848110906","heartbeat_back_addr":"172.21.15.163:6833/3848110906","heartbeat_front_addr":"172.21.15.163:6831/3848110906","state":["exists","up"]},{"osd":10,"uuid":"d943f7c0-da3d-4605-9e23-0231e675c6be","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6824","nonce":3281085356},{"type":"v1","addr":"172.21.15.172:6825","nonce":3281085356}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":3281085356},{"type":"v1","addr":"172.21.15.172:6827","nonce":3281085356}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":3281085356},{"type":"v1","addr":"172.21.15.172:6831","nonce":3281085356}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6828","nonce":3281085356},{"type":"v1","addr":"172.21.15.172:6829","nonce":3281085356}]},"public_addr":"172.21.15.172:6825/3281085356","cluster_addr":"172.21.15.172:6827/3281085356","heartbeat_back_addr":"172.21.15.172:6831/3281085356","heartbeat_front_addr":"172.21.15.172:6829/3281085356","state":["exists","up"]},{"osd":11,"uuid":"09e610a8-408a-4119-a21b-c4de2810a538","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":75,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6824","nonce":3614578747},{"type":"v1","addr":"172.21.15.184:6825","nonce":3614578747}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6826","nonce":3614578747},{"type":"v1","addr":"172.21.15.184:6827","nonce":3614578747}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6830","nonce":3614578747},{"type":"v1","addr":"172.21.15.184:6831","nonce":3614578747}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6828","nonce":3614578747},{"type":"v1","addr":"172.21.15.184:6829","nonce":3614578747}]},"public_addr":"172.21.15.184:6825/3614578747","cluster_addr":"172.21.15.184:6827/3614578747","heartbeat_back_addr":"172.21.15.184:6831/3614578747","heartbeat_front_addr":"172.21.15.184:6829/3614578747","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T18:06:36.067578+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T18:06:57.095120+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T18:07:17.825363+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T18:07:38.977196+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T18:08:00.108709+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T18:08:20.700646+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T18:08:41.473899+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T18:09:02.856536+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T18:09:23.832722+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T18:09:44.860884+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T18:10:05.520678+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T18:10:26.426315+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.163:6801/1086512093":"2023-07-15T18:05:15.331458+0000","172.21.15.163:6800/1086512093":"2023-07-15T18:05:15.331458+0000","172.21.15.163:0/4235784810":"2023-07-15T18:05:15.331458+0000","172.21.15.163:6800/236891232":"2023-07-15T18:04:53.288443+0000","172.21.15.163:6801/236891232":"2023-07-15T18:04:53.288443+0000","172.21.15.163:0/3260193612":"2023-07-15T18:05:15.331458+0000","172.21.15.163:0/3513629472":"2023-07-15T18:04:53.288443+0000","172.21.15.163:0/1090329830":"2023-07-15T18:04:53.288443+0000","172.21.15.163:0/3868922045":"2023-07-15T18:05:15.331458+0000","172.21.15.163:0/2945662447":"2023-07-15T18:04:53.288443+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-14T18:11:06.030 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:05.991+0000 7f7738a78700 1 -- 172.21.15.163:0/749852288 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f771c0a11a0 msgr2=0x7f771c0a3650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:11:06.030 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:05.991+0000 7f7738a78700 1 --2- 172.21.15.163:0/749852288 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f771c0a11a0 0x7f771c0a3650 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f7728009c60 tx=0x7f7728009260 comp rx=0 tx=0).stop 2023-07-14T18:11:06.031 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:05.991+0000 7f7738a78700 1 -- 172.21.15.163:0/749852288 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f77340fdf10 msgr2=0x7f77341958b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:11:06.031 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:05.991+0000 7f7738a78700 1 --2- 172.21.15.163:0/749852288 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f77340fdf10 0x7f77341958b0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f77240059d0 tx=0x7f7724004730 comp rx=0 tx=0).stop 2023-07-14T18:11:06.031 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:05.991+0000 7f7738a78700 1 -- 172.21.15.163:0/749852288 shutdown_connections 2023-07-14T18:11:06.031 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:05.991+0000 7f7738a78700 1 --2- 172.21.15.163:0/749852288 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f771c0a11a0 0x7f771c0a3650 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:06.031 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:05.991+0000 7f7738a78700 1 --2- 172.21.15.163:0/749852288 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f77340fdf10 0x7f77341958b0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:06.031 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:05.991+0000 7f7738a78700 1 --2- 172.21.15.163:0/749852288 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f7734101870 0x7f773419ce60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:06.031 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:05.991+0000 7f7738a78700 1 --2- 172.21.15.163:0/749852288 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7734100ee0 0x7f7734195df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:06.032 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:05.991+0000 7f7738a78700 1 -- 172.21.15.163:0/749852288 >> 172.21.15.163:0/749852288 conn(0x7f77340f98d0 msgr2=0x7f77341043f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:11:06.032 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:05.991+0000 7f7738a78700 1 -- 172.21.15.163:0/749852288 shutdown_connections 2023-07-14T18:11:06.032 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:05.991+0000 7f7738a78700 1 -- 172.21.15.163:0/749852288 wait complete. 2023-07-14T18:11:06.042 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-14T18:07:19.653852+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-14T18:11:06.043 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-14T18:11:06.174 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:06.134+0000 7f000d513700 1 -- 172.21.15.163:0/3098336597 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f0008101790 msgr2=0x7f0008108050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:11:06.174 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:06.134+0000 7f000d513700 1 --2- 172.21.15.163:0/3098336597 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f0008101790 0x7f0008108050 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7efff8009990 tx=0x7efff8009ca0 comp rx=0 tx=0).stop 2023-07-14T18:11:06.174 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:06.134+0000 7f000d513700 1 -- 172.21.15.163:0/3098336597 shutdown_connections 2023-07-14T18:11:06.174 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:06.134+0000 7f000d513700 1 --2- 172.21.15.163:0/3098336597 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f0008101790 0x7f0008108050 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:06.174 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:06.134+0000 7f000d513700 1 --2- 172.21.15.163:0/3098336597 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f00080ffc10 0x7f0008100020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:06.174 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:06.134+0000 7f000d513700 1 --2- 172.21.15.163:0/3098336597 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0008100e00 0x7f0008101250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:06.175 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:06.134+0000 7f000d513700 1 -- 172.21.15.163:0/3098336597 >> 172.21.15.163:0/3098336597 conn(0x7f00080fb250 msgr2=0x7f00080fd660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:11:06.175 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:06.134+0000 7f000d513700 1 -- 172.21.15.163:0/3098336597 shutdown_connections 2023-07-14T18:11:06.175 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:06.134+0000 7f000d513700 1 -- 172.21.15.163:0/3098336597 wait complete. 2023-07-14T18:11:06.177 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:06.135+0000 7f000d513700 1 Processor -- start 2023-07-14T18:11:06.177 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:06.135+0000 7f000d513700 1 -- start start 2023-07-14T18:11:06.177 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:06.135+0000 7f000d513700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f00080ffc10 0x7f00081957e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:11:06.177 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:06.135+0000 7f000d513700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0008100e00 0x7f0008195d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:11:06.177 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:06.135+0000 7f000d513700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0008101790 0x7f000819cd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:11:06.178 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:06.135+0000 7f000d513700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f000819d360 con 0x7f00080ffc10 2023-07-14T18:11:06.178 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:06.135+0000 7f000d513700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f000819d4a0 con 0x7f0008100e00 2023-07-14T18:11:06.178 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:06.135+0000 7f000d513700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f000819d630 con 0x7f0008101790 2023-07-14T18:11:06.178 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:06.135+0000 7f0006ffd700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f00080ffc10 0x7f00081957e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:11:06.178 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:06.135+0000 7f0006ffd700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f00080ffc10 0x7f00081957e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:55654/0 (socket says 172.21.15.163:55654) 2023-07-14T18:11:06.178 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:06.135+0000 7f0006ffd700 1 -- 172.21.15.163:0/811817227 learned_addr learned my addr 172.21.15.163:0/811817227 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:11:06.178 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:06.135+0000 7f00067fc700 1 --2- 172.21.15.163:0/811817227 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0008100e00 0x7f0008195d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:11:06.179 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:06.135+0000 7f00077fe700 1 --2- 172.21.15.163:0/811817227 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0008101790 0x7f000819cd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:11:06.179 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:06.136+0000 7f0006ffd700 1 -- 172.21.15.163:0/811817227 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0008101790 msgr2=0x7f000819cd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:11:06.179 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:06.136+0000 7f0006ffd700 1 --2- 172.21.15.163:0/811817227 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0008101790 0x7f000819cd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:06.179 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:06.136+0000 7f0006ffd700 1 -- 172.21.15.163:0/811817227 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0008100e00 msgr2=0x7f0008195d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:11:06.179 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:06.136+0000 7f0006ffd700 1 --2- 172.21.15.163:0/811817227 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0008100e00 0x7f0008195d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:06.179 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:06.136+0000 7f0006ffd700 1 -- 172.21.15.163:0/811817227 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efff80095f0 con 0x7f00080ffc10 2023-07-14T18:11:06.179 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:06.136+0000 7f00067fc700 1 --2- 172.21.15.163:0/811817227 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0008100e00 0x7f0008195d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T18:11:06.179 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:06.136+0000 7f0006ffd700 1 --2- 172.21.15.163:0/811817227 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f00080ffc10 0x7f00081957e0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f000000efc0 tx=0x7f000000c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:11:06.180 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:06.136+0000 7effeffff700 1 -- 172.21.15.163:0/811817227 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0000018070 con 0x7f00080ffc10 2023-07-14T18:11:06.180 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:06.136+0000 7effeffff700 1 -- 172.21.15.163:0/811817227 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f000000f040 con 0x7f00080ffc10 2023-07-14T18:11:06.180 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:06.136+0000 7f000d513700 1 -- 172.21.15.163:0/811817227 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f000819d8b0 con 0x7f00080ffc10 2023-07-14T18:11:06.180 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:06.136+0000 7effeffff700 1 -- 172.21.15.163:0/811817227 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0000004280 con 0x7f00080ffc10 2023-07-14T18:11:06.180 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:06.136+0000 7f000d513700 1 -- 172.21.15.163:0/811817227 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f000819de10 con 0x7f00080ffc10 2023-07-14T18:11:06.180 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:06.137+0000 7f000d513700 1 -- 172.21.15.163:0/811817227 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0008107200 con 0x7f00080ffc10 2023-07-14T18:11:06.181 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:06.138+0000 7effeffff700 1 -- 172.21.15.163:0/811817227 <== mon.0 v2:172.21.15.163:3300/0 4 ==== mgrmap(e 16) v1 ==== 135716+0+0 (secure 0 0 0) 0x7f0000003a00 con 0x7f00080ffc10 2023-07-14T18:11:06.181 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:06.139+0000 7effeffff700 1 --2- 172.21.15.163:0/811817227 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7efff00a11d0 0x7efff00a3680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:11:06.181 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:06.139+0000 7f00067fc700 1 --2- 172.21.15.163:0/811817227 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7efff00a11d0 0x7efff00a3680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:11:06.181 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:06.139+0000 7effeffff700 1 -- 172.21.15.163:0/811817227 <== mon.0 v2:172.21.15.163:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f00000ccc60 con 0x7f00080ffc10 2023-07-14T18:11:06.182 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:06.139+0000 7f00067fc700 1 --2- 172.21.15.163:0/811817227 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7efff00a11d0 0x7efff00a3680 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7efffc011490 tx=0x7efffc009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:11:06.182 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:06.142+0000 7effeffff700 1 -- 172.21.15.163:0/811817227 <== mon.0 v2:172.21.15.163:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178025 (secure 0 0 0) 0x7f00000968e0 con 0x7f00080ffc10 2023-07-14T18:11:06.378 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:06.339+0000 7f000d513700 1 -- 172.21.15.163:0/811817227 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f000802cb50 con 0x7f00080ffc10 2023-07-14T18:11:06.379 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:06.339+0000 7effeffff700 1 -- 172.21.15.163:0/811817227 <== mon.0 v2:172.21.15.163:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v76) v1 ==== 93+0+10 (secure 0 0 0) 0x7f0000099f00 con 0x7f00080ffc10 2023-07-14T18:11:06.379 INFO:teuthology.orchestra.run.smithi163.stdout:pg_num: 1 2023-07-14T18:11:06.381 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:06.341+0000 7f000d513700 1 -- 172.21.15.163:0/811817227 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7efff00a11d0 msgr2=0x7efff00a3680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:11:06.381 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:06.341+0000 7f000d513700 1 --2- 172.21.15.163:0/811817227 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7efff00a11d0 0x7efff00a3680 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7efffc011490 tx=0x7efffc009260 comp rx=0 tx=0).stop 2023-07-14T18:11:06.381 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:06.341+0000 7f000d513700 1 -- 172.21.15.163:0/811817227 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f00080ffc10 msgr2=0x7f00081957e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:11:06.382 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:06.341+0000 7f000d513700 1 --2- 172.21.15.163:0/811817227 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f00080ffc10 0x7f00081957e0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f000000efc0 tx=0x7f000000c3a0 comp rx=0 tx=0).stop 2023-07-14T18:11:06.382 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:06.341+0000 7f000d513700 1 -- 172.21.15.163:0/811817227 shutdown_connections 2023-07-14T18:11:06.382 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:06.341+0000 7f000d513700 1 --2- 172.21.15.163:0/811817227 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7efff00a11d0 0x7efff00a3680 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:06.382 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:06.341+0000 7f000d513700 1 --2- 172.21.15.163:0/811817227 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0008101790 0x7f000819cd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:06.383 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:06.341+0000 7f000d513700 1 --2- 172.21.15.163:0/811817227 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f00080ffc10 0x7f00081957e0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:06.383 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:06.341+0000 7f000d513700 1 --2- 172.21.15.163:0/811817227 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0008100e00 0x7f0008195d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:06.383 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:06.341+0000 7f000d513700 1 -- 172.21.15.163:0/811817227 >> 172.21.15.163:0/811817227 conn(0x7f00080fb250 msgr2=0x7f0008104340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:11:06.384 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:06.341+0000 7f000d513700 1 -- 172.21.15.163:0/811817227 shutdown_connections 2023-07-14T18:11:06.384 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:06.341+0000 7f000d513700 1 -- 172.21.15.163:0/811817227 wait complete. 2023-07-14T18:11:06.393 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-07-14T18:11:06.520 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:06.480+0000 7f5f5ae9a700 1 -- 172.21.15.163:0/3680642348 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f5f540ffcf0 msgr2=0x7f5f54100140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:11:06.520 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:06.480+0000 7f5f5ae9a700 1 --2- 172.21.15.163:0/3680642348 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f5f540ffcf0 0x7f5f54100140 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f5f40009990 tx=0x7f5f40009ca0 comp rx=0 tx=0).stop 2023-07-14T18:11:06.520 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:06.480+0000 7f5f5ae9a700 1 -- 172.21.15.163:0/3680642348 shutdown_connections 2023-07-14T18:11:06.520 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:06.480+0000 7f5f5ae9a700 1 --2- 172.21.15.163:0/3680642348 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5f54100680 0x7f5f54106f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:06.520 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:06.480+0000 7f5f5ae9a700 1 --2- 172.21.15.163:0/3680642348 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5f540feb00 0x7f5f540fef10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:06.521 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:06.480+0000 7f5f5ae9a700 1 --2- 172.21.15.163:0/3680642348 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f5f540ffcf0 0x7f5f54100140 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:06.521 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:06.480+0000 7f5f5ae9a700 1 -- 172.21.15.163:0/3680642348 >> 172.21.15.163:0/3680642348 conn(0x7f5f540fa100 msgr2=0x7f5f540fc550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:11:06.521 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:06.480+0000 7f5f5ae9a700 1 -- 172.21.15.163:0/3680642348 shutdown_connections 2023-07-14T18:11:06.521 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:06.480+0000 7f5f5ae9a700 1 -- 172.21.15.163:0/3680642348 wait complete. 2023-07-14T18:11:06.521 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:06.481+0000 7f5f5ae9a700 1 Processor -- start 2023-07-14T18:11:06.521 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:06.481+0000 7f5f5ae9a700 1 -- start start 2023-07-14T18:11:06.523 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:06.481+0000 7f5f5ae9a700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f5f540feb00 0x7f5f54068330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:11:06.523 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:06.481+0000 7f5f5ae9a700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5f540ffcf0 0x7f5f5419a4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:11:06.523 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:06.481+0000 7f5f5ae9a700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5f54100680 0x7f5f5419cb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:11:06.523 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:06.481+0000 7f5f5ae9a700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f5419d2f0 con 0x7f5f540feb00 2023-07-14T18:11:06.524 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:06.481+0000 7f5f5ae9a700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f5419d460 con 0x7f5f540ffcf0 2023-07-14T18:11:06.524 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:06.481+0000 7f5f5ae9a700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f5419d620 con 0x7f5f54100680 2023-07-14T18:11:06.524 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:06.481+0000 7f5f58c36700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f5f540feb00 0x7f5f54068330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:11:06.524 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:06.481+0000 7f5f58c36700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f5f540feb00 0x7f5f54068330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:55668/0 (socket says 172.21.15.163:55668) 2023-07-14T18:11:06.524 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:06.481+0000 7f5f58c36700 1 -- 172.21.15.163:0/684032803 learned_addr learned my addr 172.21.15.163:0/684032803 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:11:06.524 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:06.481+0000 7f5f53fff700 1 --2- 172.21.15.163:0/684032803 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5f540ffcf0 0x7f5f5419a4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:11:06.524 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:06.481+0000 7f5f59437700 1 --2- 172.21.15.163:0/684032803 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5f54100680 0x7f5f5419cb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:11:06.524 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:06.481+0000 7f5f58c36700 1 -- 172.21.15.163:0/684032803 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5f54100680 msgr2=0x7f5f5419cb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:11:06.525 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:06.481+0000 7f5f58c36700 1 --2- 172.21.15.163:0/684032803 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5f54100680 0x7f5f5419cb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:06.525 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:06.481+0000 7f5f58c36700 1 -- 172.21.15.163:0/684032803 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5f540ffcf0 msgr2=0x7f5f5419a4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:11:06.525 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:06.481+0000 7f5f58c36700 1 --2- 172.21.15.163:0/684032803 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5f540ffcf0 0x7f5f5419a4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:06.525 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:06.481+0000 7f5f58c36700 1 -- 172.21.15.163:0/684032803 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f400095f0 con 0x7f5f540feb00 2023-07-14T18:11:06.525 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:06.481+0000 7f5f58c36700 1 --2- 172.21.15.163:0/684032803 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f5f540feb00 0x7f5f54068330 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f5f4800d980 tx=0x7f5f4800dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:11:06.525 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:06.481+0000 7f5f51ffb700 1 -- 172.21.15.163:0/684032803 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f48004020 con 0x7f5f540feb00 2023-07-14T18:11:06.525 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:06.481+0000 7f5f5ae9a700 1 -- 172.21.15.163:0/684032803 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f5419d900 con 0x7f5f540feb00 2023-07-14T18:11:06.526 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:06.481+0000 7f5f51ffb700 1 -- 172.21.15.163:0/684032803 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f5f48009730 con 0x7f5f540feb00 2023-07-14T18:11:06.526 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:06.481+0000 7f5f51ffb700 1 -- 172.21.15.163:0/684032803 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f480039c0 con 0x7f5f540feb00 2023-07-14T18:11:06.526 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:06.482+0000 7f5f5ae9a700 1 -- 172.21.15.163:0/684032803 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f5419dde0 con 0x7f5f540feb00 2023-07-14T18:11:06.526 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:06.483+0000 7f5f5ae9a700 1 -- 172.21.15.163:0/684032803 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5f54106070 con 0x7f5f540feb00 2023-07-14T18:11:06.526 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:06.483+0000 7f5f51ffb700 1 -- 172.21.15.163:0/684032803 <== mon.0 v2:172.21.15.163:3300/0 4 ==== mgrmap(e 16) v1 ==== 135716+0+0 (secure 0 0 0) 0x7f5f480098a0 con 0x7f5f540feb00 2023-07-14T18:11:06.526 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:06.484+0000 7f5f51ffb700 1 --2- 172.21.15.163:0/684032803 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f5f440a1220 0x7f5f440a36d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:11:06.527 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:06.484+0000 7f5f53fff700 1 --2- 172.21.15.163:0/684032803 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f5f440a1220 0x7f5f440a36d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:11:06.527 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:06.484+0000 7f5f51ffb700 1 -- 172.21.15.163:0/684032803 <== mon.0 v2:172.21.15.163:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f5f480cc1e0 con 0x7f5f540feb00 2023-07-14T18:11:06.527 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:06.484+0000 7f5f53fff700 1 --2- 172.21.15.163:0/684032803 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f5f440a1220 0x7f5f440a36d0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f5f4000c010 tx=0x7f5f40005960 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:11:06.527 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:06.488+0000 7f5f51ffb700 1 -- 172.21.15.163:0/684032803 <== mon.0 v2:172.21.15.163:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178025 (secure 0 0 0) 0x7f5f48095d30 con 0x7f5f540feb00 2023-07-14T18:11:06.673 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:11:06 smithi184 ceph-mon[98481]: pgmap v241: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-07-14T18:11:06.673 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:11:06 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:11:06.673 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:11:06 smithi184 ceph-mon[98481]: from='client.? 172.21.15.163:0/1131518282' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-07-14T18:11:06.674 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:11:06 smithi184 ceph-mon[98481]: from='client.? 172.21.15.163:0/749852288' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-07-14T18:11:06.674 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:11:06 smithi184 ceph-mon[98481]: from='client.? 172.21.15.163:0/811817227' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-07-14T18:11:06.715 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:11:06 smithi163 ceph-mon[96576]: pgmap v241: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-07-14T18:11:06.716 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:11:06 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:11:06.716 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:11:06 smithi163 ceph-mon[96576]: from='client.? 172.21.15.163:0/1131518282' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-07-14T18:11:06.716 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:11:06 smithi163 ceph-mon[96576]: from='client.? 172.21.15.163:0/749852288' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-07-14T18:11:06.716 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:11:06 smithi163 ceph-mon[96576]: from='client.? 172.21.15.163:0/811817227' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-07-14T18:11:06.742 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:06.703+0000 7f5f5ae9a700 1 -- 172.21.15.163:0/684032803 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f5f540612f0 con 0x7f5f540feb00 2023-07-14T18:11:06.743 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:06.703+0000 7f5f51ffb700 1 -- 172.21.15.163:0/684032803 <== mon.0 v2:172.21.15.163:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v76) v1 ==== 84+0+65 (secure 0 0 0) 0x7f5f48099350 con 0x7f5f540feb00 2023-07-14T18:11:06.743 INFO:teuthology.orchestra.run.smithi163.stdout: 2023-07-14T18:11:06.743 INFO:teuthology.orchestra.run.smithi163.stdout:[ 2023-07-14T18:11:06.743 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-07-14T18:11:06.744 INFO:teuthology.orchestra.run.smithi163.stdout: "poolnum": 1, 2023-07-14T18:11:06.744 INFO:teuthology.orchestra.run.smithi163.stdout: "poolname": ".mgr" 2023-07-14T18:11:06.744 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-07-14T18:11:06.744 INFO:teuthology.orchestra.run.smithi163.stdout:] 2023-07-14T18:11:06.745 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:06.706+0000 7f5f5ae9a700 1 -- 172.21.15.163:0/684032803 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f5f440a1220 msgr2=0x7f5f440a36d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:11:06.745 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:06.706+0000 7f5f5ae9a700 1 --2- 172.21.15.163:0/684032803 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f5f440a1220 0x7f5f440a36d0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f5f4000c010 tx=0x7f5f40005960 comp rx=0 tx=0).stop 2023-07-14T18:11:06.746 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:06.706+0000 7f5f5ae9a700 1 -- 172.21.15.163:0/684032803 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f5f540feb00 msgr2=0x7f5f54068330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:11:06.746 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:06.706+0000 7f5f5ae9a700 1 --2- 172.21.15.163:0/684032803 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f5f540feb00 0x7f5f54068330 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f5f4800d980 tx=0x7f5f4800dc90 comp rx=0 tx=0).stop 2023-07-14T18:11:06.746 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:06.706+0000 7f5f5ae9a700 1 -- 172.21.15.163:0/684032803 shutdown_connections 2023-07-14T18:11:06.746 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:06.706+0000 7f5f5ae9a700 1 --2- 172.21.15.163:0/684032803 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f5f440a1220 0x7f5f440a36d0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:06.746 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:06.706+0000 7f5f5ae9a700 1 --2- 172.21.15.163:0/684032803 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5f54100680 0x7f5f5419cb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:06.746 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:06.706+0000 7f5f5ae9a700 1 --2- 172.21.15.163:0/684032803 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f5f540feb00 0x7f5f54068330 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:06.746 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:06.706+0000 7f5f5ae9a700 1 --2- 172.21.15.163:0/684032803 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5f540ffcf0 0x7f5f5419a4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:06.747 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:06.706+0000 7f5f5ae9a700 1 -- 172.21.15.163:0/684032803 >> 172.21.15.163:0/684032803 conn(0x7f5f540fa100 msgr2=0x7f5f541031b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:11:06.747 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:06.706+0000 7f5f5ae9a700 1 -- 172.21.15.163:0/684032803 shutdown_connections 2023-07-14T18:11:06.747 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:06.706+0000 7f5f5ae9a700 1 -- 172.21.15.163:0/684032803 wait complete. 2023-07-14T18:11:06.758 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-07-14T18:11:06.758 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-07-14T18:11:06.774 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:11:06 smithi172 ceph-mon[97983]: pgmap v241: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-07-14T18:11:06.774 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:11:06 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:11:06.774 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:11:06 smithi172 ceph-mon[97983]: from='client.? 172.21.15.163:0/1131518282' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-07-14T18:11:06.774 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:11:06 smithi172 ceph-mon[97983]: from='client.? 172.21.15.163:0/749852288' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-07-14T18:11:06.774 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:11:06 smithi172 ceph-mon[97983]: from='client.? 172.21.15.163:0/811817227' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-07-14T18:11:06.886 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:06.847+0000 7fb4a0be2700 1 -- 172.21.15.163:0/4125416462 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fb49c0feb10 msgr2=0x7fb49c0fef20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:11:06.887 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:06.847+0000 7fb4a0be2700 1 --2- 172.21.15.163:0/4125416462 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fb49c0feb10 0x7fb49c0fef20 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fb49400b0a0 tx=0x7fb49400b3b0 comp rx=0 tx=0).stop 2023-07-14T18:11:06.887 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:06.847+0000 7fb4a0be2700 1 -- 172.21.15.163:0/4125416462 shutdown_connections 2023-07-14T18:11:06.887 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:06.847+0000 7fb4a0be2700 1 --2- 172.21.15.163:0/4125416462 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb49c100690 0x7fb49c106f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:06.887 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:06.847+0000 7fb4a0be2700 1 --2- 172.21.15.163:0/4125416462 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fb49c0feb10 0x7fb49c0fef20 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:06.887 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:06.847+0000 7fb4a0be2700 1 --2- 172.21.15.163:0/4125416462 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb49c0ffd00 0x7fb49c100150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:06.888 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:06.847+0000 7fb4a0be2700 1 -- 172.21.15.163:0/4125416462 >> 172.21.15.163:0/4125416462 conn(0x7fb49c0fa130 msgr2=0x7fb49c0fc560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:11:06.888 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:06.847+0000 7fb4a0be2700 1 -- 172.21.15.163:0/4125416462 shutdown_connections 2023-07-14T18:11:06.888 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:06.847+0000 7fb4a0be2700 1 -- 172.21.15.163:0/4125416462 wait complete. 2023-07-14T18:11:06.889 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:06.848+0000 7fb4a0be2700 1 Processor -- start 2023-07-14T18:11:06.890 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:06.848+0000 7fb4a0be2700 1 -- start start 2023-07-14T18:11:06.890 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:06.848+0000 7fb4a0be2700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb49c0feb10 0x7fb49c068330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:11:06.890 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:06.848+0000 7fb4a0be2700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb49c0ffd00 0x7fb49c19a780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:11:06.890 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:06.848+0000 7fb4a0be2700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fb49c100690 0x7fb49c19cdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:11:06.890 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:06.848+0000 7fb4a0be2700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb49c19d5a0 con 0x7fb49c100690 2023-07-14T18:11:06.890 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:06.848+0000 7fb4a0be2700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb49c19d710 con 0x7fb49c0ffd00 2023-07-14T18:11:06.891 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:06.848+0000 7fb4a0be2700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb49c19d8d0 con 0x7fb49c0feb10 2023-07-14T18:11:06.891 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:06.848+0000 7fb49ad9d700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fb49c100690 0x7fb49c19cdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:11:06.891 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:06.848+0000 7fb49ad9d700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fb49c100690 0x7fb49c19cdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:55686/0 (socket says 172.21.15.163:55686) 2023-07-14T18:11:06.891 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:06.848+0000 7fb49ad9d700 1 -- 172.21.15.163:0/4060763125 learned_addr learned my addr 172.21.15.163:0/4060763125 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:11:06.891 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:06.848+0000 7fb499d9b700 1 --2- 172.21.15.163:0/4060763125 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb49c0ffd00 0x7fb49c19a780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:11:06.891 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:06.848+0000 7fb49a59c700 1 --2- 172.21.15.163:0/4060763125 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb49c0feb10 0x7fb49c068330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:11:06.891 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:06.848+0000 7fb49ad9d700 1 -- 172.21.15.163:0/4060763125 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb49c0feb10 msgr2=0x7fb49c068330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:11:06.892 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:06.848+0000 7fb49ad9d700 1 --2- 172.21.15.163:0/4060763125 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb49c0feb10 0x7fb49c068330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:06.892 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:06.848+0000 7fb49ad9d700 1 -- 172.21.15.163:0/4060763125 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb49c0ffd00 msgr2=0x7fb49c19a780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:11:06.892 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:06.848+0000 7fb49ad9d700 1 --2- 172.21.15.163:0/4060763125 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb49c0ffd00 0x7fb49c19a780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:06.892 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:06.848+0000 7fb49ad9d700 1 -- 172.21.15.163:0/4060763125 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb494009d00 con 0x7fb49c100690 2023-07-14T18:11:06.892 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:06.849+0000 7fb49ad9d700 1 --2- 172.21.15.163:0/4060763125 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fb49c100690 0x7fb49c19cdd0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fb48c00e940 tx=0x7fb48c00ec50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:11:06.892 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:06.849+0000 7fb48b7fe700 1 -- 172.21.15.163:0/4060763125 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb48c0097b0 con 0x7fb49c100690 2023-07-14T18:11:06.892 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:06.849+0000 7fb4a0be2700 1 -- 172.21.15.163:0/4060763125 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb49c19dbb0 con 0x7fb49c100690 2023-07-14T18:11:06.893 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:06.849+0000 7fb48b7fe700 1 -- 172.21.15.163:0/4060763125 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fb48c005020 con 0x7fb49c100690 2023-07-14T18:11:06.893 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:06.849+0000 7fb48b7fe700 1 -- 172.21.15.163:0/4060763125 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb48c00cb70 con 0x7fb49c100690 2023-07-14T18:11:06.893 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:06.849+0000 7fb4a0be2700 1 -- 172.21.15.163:0/4060763125 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb49c19e110 con 0x7fb49c100690 2023-07-14T18:11:06.893 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:06.850+0000 7fb4a0be2700 1 -- 172.21.15.163:0/4060763125 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb49c10a200 con 0x7fb49c100690 2023-07-14T18:11:06.894 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:06.851+0000 7fb48b7fe700 1 -- 172.21.15.163:0/4060763125 <== mon.0 v2:172.21.15.163:3300/0 4 ==== mgrmap(e 16) v1 ==== 135716+0+0 (secure 0 0 0) 0x7fb48c004a30 con 0x7fb49c100690 2023-07-14T18:11:06.894 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:06.851+0000 7fb48b7fe700 1 --2- 172.21.15.163:0/4060763125 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7fb4840a11d0 0x7fb4840a3680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:11:06.894 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:06.851+0000 7fb49a59c700 1 --2- 172.21.15.163:0/4060763125 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7fb4840a11d0 0x7fb4840a3680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:11:06.894 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:06.851+0000 7fb48b7fe700 1 -- 172.21.15.163:0/4060763125 <== mon.0 v2:172.21.15.163:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 7127+0+0 (secure 0 0 0) 0x7fb48c014070 con 0x7fb49c100690 2023-07-14T18:11:06.894 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:06.852+0000 7fb49a59c700 1 --2- 172.21.15.163:0/4060763125 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7fb4840a11d0 0x7fb4840a3680 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fb4940062a0 tx=0x7fb494006210 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:11:06.894 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:06.854+0000 7fb48b7fe700 1 -- 172.21.15.163:0/4060763125 <== mon.0 v2:172.21.15.163:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178025 (secure 0 0 0) 0x7fb48c096370 con 0x7fb49c100690 2023-07-14T18:11:07.115 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:07.075+0000 7fb4a0be2700 1 -- 172.21.15.163:0/4060763125 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7fb49c10a420 con 0x7fb49c100690 2023-07-14T18:11:07.708 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:07.668+0000 7fb48b7fe700 1 -- 172.21.15.163:0/4060763125 <== mon.0 v2:172.21.15.163:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v77) v1 ==== 138+0+0 (secure 0 0 0) 0x7fb48c099990 con 0x7fb49c100690 2023-07-14T18:11:07.712 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:07.672+0000 7fb4a0be2700 1 -- 172.21.15.163:0/4060763125 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7fb4840a11d0 msgr2=0x7fb4840a3680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:11:07.713 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:07.672+0000 7fb4a0be2700 1 --2- 172.21.15.163:0/4060763125 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7fb4840a11d0 0x7fb4840a3680 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fb4940062a0 tx=0x7fb494006210 comp rx=0 tx=0).stop 2023-07-14T18:11:07.713 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:07.672+0000 7fb4a0be2700 1 -- 172.21.15.163:0/4060763125 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fb49c100690 msgr2=0x7fb49c19cdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:11:07.713 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:07.672+0000 7fb4a0be2700 1 --2- 172.21.15.163:0/4060763125 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fb49c100690 0x7fb49c19cdd0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fb48c00e940 tx=0x7fb48c00ec50 comp rx=0 tx=0).stop 2023-07-14T18:11:07.713 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:07.672+0000 7fb4a0be2700 1 -- 172.21.15.163:0/4060763125 shutdown_connections 2023-07-14T18:11:07.713 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:07.672+0000 7fb4a0be2700 1 --2- 172.21.15.163:0/4060763125 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7fb4840a11d0 0x7fb4840a3680 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:07.714 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:07.672+0000 7fb4a0be2700 1 --2- 172.21.15.163:0/4060763125 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb49c0feb10 0x7fb49c068330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:07.714 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:07.672+0000 7fb4a0be2700 1 --2- 172.21.15.163:0/4060763125 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fb49c100690 0x7fb49c19cdd0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:07.714 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:07.672+0000 7fb4a0be2700 1 --2- 172.21.15.163:0/4060763125 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb49c0ffd00 0x7fb49c19a780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:07.714 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:07.672+0000 7fb4a0be2700 1 -- 172.21.15.163:0/4060763125 >> 172.21.15.163:0/4060763125 conn(0x7fb49c0fa130 msgr2=0x7fb49c0fc430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:11:07.714 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:07.674+0000 7fb4a0be2700 1 -- 172.21.15.163:0/4060763125 shutdown_connections 2023-07-14T18:11:07.715 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:07.674+0000 7fb4a0be2700 1 -- 172.21.15.163:0/4060763125 wait complete. 2023-07-14T18:11:07.715 INFO:teuthology.orchestra.run.smithi163.stderr:pool 'cephfs_metadata' created 2023-07-14T18:11:07.725 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.05 2023-07-14T18:11:07.865 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:07.824+0000 7f11f7a35700 1 -- 172.21.15.163:0/3207309423 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f11f01018c0 msgr2=0x7f11f0108180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:11:07.866 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:07.824+0000 7f11f7a35700 1 --2- 172.21.15.163:0/3207309423 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f11f01018c0 0x7f11f0108180 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f11e800b0a0 tx=0x7f11e800b3b0 comp rx=0 tx=0).stop 2023-07-14T18:11:07.866 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:07.824+0000 7f11f7a35700 1 -- 172.21.15.163:0/3207309423 shutdown_connections 2023-07-14T18:11:07.866 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:07.824+0000 7f11f7a35700 1 --2- 172.21.15.163:0/3207309423 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f11f01018c0 0x7f11f0108180 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:07.866 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:07.824+0000 7f11f7a35700 1 --2- 172.21.15.163:0/3207309423 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f11f00fdec0 0x7f11f00fe2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:07.866 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:07.824+0000 7f11f7a35700 1 --2- 172.21.15.163:0/3207309423 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f11f0100f30 0x7f11f0101380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:07.866 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:07.824+0000 7f11f7a35700 1 -- 172.21.15.163:0/3207309423 >> 172.21.15.163:0/3207309423 conn(0x7f11f00f98a0 msgr2=0x7f11f00fbcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:11:07.866 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:07.825+0000 7f11f7a35700 1 -- 172.21.15.163:0/3207309423 shutdown_connections 2023-07-14T18:11:07.867 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:07.825+0000 7f11f7a35700 1 -- 172.21.15.163:0/3207309423 wait complete. 2023-07-14T18:11:07.867 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:07.825+0000 7f11f7a35700 1 Processor -- start 2023-07-14T18:11:07.867 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:07.825+0000 7f11f7a35700 1 -- start start 2023-07-14T18:11:07.867 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:07.825+0000 7f11f7a35700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f11f00fdec0 0x7f11f0197b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:11:07.867 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:07.825+0000 7f11f7a35700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f11f0100f30 0x7f11f01980d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:11:07.867 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:07.825+0000 7f11f7a35700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f11f01018c0 0x7f11f019f140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:11:07.867 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:07.825+0000 7f11f7a35700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11f019f710 con 0x7f11f00fdec0 2023-07-14T18:11:07.867 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:07.825+0000 7f11f7a35700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11f019f850 con 0x7f11f01018c0 2023-07-14T18:11:07.868 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:07.825+0000 7f11f7a35700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11f019f9e0 con 0x7f11f0100f30 2023-07-14T18:11:07.868 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:07.825+0000 7f11f57d1700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f11f00fdec0 0x7f11f0197b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:11:07.868 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:07.825+0000 7f11f57d1700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f11f00fdec0 0x7f11f0197b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:55694/0 (socket says 172.21.15.163:55694) 2023-07-14T18:11:07.868 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:07.825+0000 7f11f57d1700 1 -- 172.21.15.163:0/3555897615 learned_addr learned my addr 172.21.15.163:0/3555897615 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:11:07.868 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:07.825+0000 7f11f5fd2700 1 --2- 172.21.15.163:0/3555897615 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f11f01018c0 0x7f11f019f140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:11:07.868 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:07.826+0000 7f11f4fd0700 1 --2- 172.21.15.163:0/3555897615 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f11f0100f30 0x7f11f01980d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:11:07.868 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:07.826+0000 7f11f57d1700 1 -- 172.21.15.163:0/3555897615 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f11f0100f30 msgr2=0x7f11f01980d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:11:07.869 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:07.826+0000 7f11f57d1700 1 --2- 172.21.15.163:0/3555897615 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f11f0100f30 0x7f11f01980d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:07.869 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:07.826+0000 7f11f57d1700 1 -- 172.21.15.163:0/3555897615 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f11f01018c0 msgr2=0x7f11f019f140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:11:07.869 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:07.826+0000 7f11f57d1700 1 --2- 172.21.15.163:0/3555897615 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f11f01018c0 0x7f11f019f140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:07.869 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:07.826+0000 7f11f57d1700 1 -- 172.21.15.163:0/3555897615 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11e8009d00 con 0x7f11f00fdec0 2023-07-14T18:11:07.869 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:07.826+0000 7f11f4fd0700 1 --2- 172.21.15.163:0/3555897615 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f11f0100f30 0x7f11f01980d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T18:11:07.869 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:07.826+0000 7f11f5fd2700 1 --2- 172.21.15.163:0/3555897615 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f11f01018c0 0x7f11f019f140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T18:11:07.869 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:07.826+0000 7f11f57d1700 1 --2- 172.21.15.163:0/3555897615 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f11f00fdec0 0x7f11f0197b90 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f11ec00d980 tx=0x7f11ec00dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:11:07.869 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:07.826+0000 7f11e67fc700 1 -- 172.21.15.163:0/3555897615 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11ec004020 con 0x7f11f00fdec0 2023-07-14T18:11:07.870 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:07.826+0000 7f11e67fc700 1 -- 172.21.15.163:0/3555897615 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f11ec009730 con 0x7f11f00fdec0 2023-07-14T18:11:07.870 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:07.826+0000 7f11f7a35700 1 -- 172.21.15.163:0/3555897615 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f11f019fcc0 con 0x7f11f00fdec0 2023-07-14T18:11:07.870 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:07.826+0000 7f11e67fc700 1 -- 172.21.15.163:0/3555897615 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11ec003a00 con 0x7f11f00fdec0 2023-07-14T18:11:07.870 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:07.826+0000 7f11f7a35700 1 -- 172.21.15.163:0/3555897615 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11f01a01d0 con 0x7f11f00fdec0 2023-07-14T18:11:07.871 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:07.827+0000 7f11f7a35700 1 -- 172.21.15.163:0/3555897615 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f11f0192150 con 0x7f11f00fdec0 2023-07-14T18:11:07.871 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:07.828+0000 7f11e67fc700 1 -- 172.21.15.163:0/3555897615 <== mon.0 v2:172.21.15.163:3300/0 4 ==== mgrmap(e 16) v1 ==== 135716+0+0 (secure 0 0 0) 0x7f11ec0098a0 con 0x7f11f00fdec0 2023-07-14T18:11:07.871 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:07.828+0000 7f11e67fc700 1 --2- 172.21.15.163:0/3555897615 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f11dc0a1150 0x7f11dc0a3600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:11:07.871 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:07.829+0000 7f11f4fd0700 1 --2- 172.21.15.163:0/3555897615 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f11dc0a1150 0x7f11dc0a3600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:11:07.871 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:07.829+0000 7f11e67fc700 1 -- 172.21.15.163:0/3555897615 <== mon.0 v2:172.21.15.163:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 7497+0+0 (secure 0 0 0) 0x7f11ec0cc660 con 0x7f11f00fdec0 2023-07-14T18:11:07.871 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:07.829+0000 7f11f4fd0700 1 --2- 172.21.15.163:0/3555897615 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f11dc0a1150 0x7f11dc0a3600 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f11e0005950 tx=0x7f11e0005f50 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:11:07.872 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:07.832+0000 7f11e67fc700 1 -- 172.21.15.163:0/3555897615 <== mon.0 v2:172.21.15.163:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178025 (secure 0 0 0) 0x7f11ec0960e0 con 0x7f11f00fdec0 2023-07-14T18:11:07.923 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:11:07 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:11:07.923 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:11:07 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:11:07.923 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:11:07 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:11:07.924 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:11:07 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:11:07.924 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:11:07 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:11:07.924 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:11:07 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:11:07.924 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:11:07 smithi184 ceph-mon[98481]: from='client.? 172.21.15.163:0/684032803' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2023-07-14T18:11:07.924 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:11:07 smithi184 ceph-mon[98481]: from='client.? 172.21.15.163:0/4060763125' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2023-07-14T18:11:07.924 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:11:07 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T18:11:07.924 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:11:07 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-14T18:11:07.925 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:11:07 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:11:07.925 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:11:07 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-14T18:11:07.965 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:11:07 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:11:07.966 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:11:07 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:11:07.966 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:11:07 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:11:07.966 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:11:07 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:11:07.966 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:11:07 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:11:07.966 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:11:07 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:11:07.967 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:11:07 smithi163 ceph-mon[96576]: from='client.? 172.21.15.163:0/684032803' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2023-07-14T18:11:07.967 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:11:07 smithi163 ceph-mon[96576]: from='client.? 172.21.15.163:0/4060763125' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2023-07-14T18:11:07.967 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:11:07 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T18:11:07.967 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:11:07 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-14T18:11:07.967 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:11:07 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:11:07.967 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:11:07 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-14T18:11:08.024 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:11:07 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:11:08.024 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:11:07 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:11:08.025 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:11:07 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:11:08.025 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:11:07 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:11:08.025 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:11:07 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:11:08.025 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:11:07 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:11:08.025 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:11:07 smithi172 ceph-mon[97983]: from='client.? 172.21.15.163:0/684032803' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2023-07-14T18:11:08.025 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:11:07 smithi172 ceph-mon[97983]: from='client.? 172.21.15.163:0/4060763125' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2023-07-14T18:11:08.025 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:11:07 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T18:11:08.025 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:11:07 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-14T18:11:08.026 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:11:07 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:11:08.026 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:11:07 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-14T18:11:08.069 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:08.030+0000 7f11f7a35700 1 -- 172.21.15.163:0/3555897615 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05} v 0) v1 -- 0x7f11f002c8e0 con 0x7f11f00fdec0 2023-07-14T18:11:08.712 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:08.673+0000 7f11e67fc700 1 -- 172.21.15.163:0/3555897615 <== mon.0 v2:172.21.15.163:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]=0 pool 'cephfs_data' created v78) v1 ==== 171+0+0 (secure 0 0 0) 0x7f11ec099700 con 0x7f11f00fdec0 2023-07-14T18:11:08.724 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:08.684+0000 7f11f7a35700 1 -- 172.21.15.163:0/3555897615 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f11dc0a1150 msgr2=0x7f11dc0a3600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:11:08.724 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:08.684+0000 7f11f7a35700 1 --2- 172.21.15.163:0/3555897615 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f11dc0a1150 0x7f11dc0a3600 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f11e0005950 tx=0x7f11e0005f50 comp rx=0 tx=0).stop 2023-07-14T18:11:08.724 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:08.684+0000 7f11f7a35700 1 -- 172.21.15.163:0/3555897615 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f11f00fdec0 msgr2=0x7f11f0197b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:11:08.724 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:08.684+0000 7f11f7a35700 1 --2- 172.21.15.163:0/3555897615 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f11f00fdec0 0x7f11f0197b90 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f11ec00d980 tx=0x7f11ec00dc90 comp rx=0 tx=0).stop 2023-07-14T18:11:08.725 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:08.686+0000 7f11f7a35700 1 -- 172.21.15.163:0/3555897615 shutdown_connections 2023-07-14T18:11:08.725 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:08.686+0000 7f11f7a35700 1 --2- 172.21.15.163:0/3555897615 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f11dc0a1150 0x7f11dc0a3600 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:08.725 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:08.686+0000 7f11f7a35700 1 --2- 172.21.15.163:0/3555897615 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f11f01018c0 0x7f11f019f140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:08.726 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:08.686+0000 7f11f7a35700 1 --2- 172.21.15.163:0/3555897615 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f11f00fdec0 0x7f11f0197b90 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:08.726 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:08.686+0000 7f11f7a35700 1 --2- 172.21.15.163:0/3555897615 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f11f0100f30 0x7f11f01980d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:08.726 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:08.686+0000 7f11f7a35700 1 -- 172.21.15.163:0/3555897615 >> 172.21.15.163:0/3555897615 conn(0x7f11f00f98a0 msgr2=0x7f11f0106800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:11:08.726 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:08.686+0000 7f11f7a35700 1 -- 172.21.15.163:0/3555897615 shutdown_connections 2023-07-14T18:11:08.726 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:08.686+0000 7f11f7a35700 1 -- 172.21.15.163:0/3555897615 wait complete. 2023-07-14T18:11:08.732 INFO:teuthology.orchestra.run.smithi163.stderr:pool 'cephfs_data' created 2023-07-14T18:11:08.746 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-07-14T18:11:08.874 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:08.834+0000 7f31dbab1700 1 -- 172.21.15.163:0/3183702525 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f31d40feb10 msgr2=0x7f31d40fef20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:11:08.874 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:08.834+0000 7f31dbab1700 1 --2- 172.21.15.163:0/3183702525 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f31d40feb10 0x7f31d40fef20 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f31d0009990 tx=0x7f31d0009ca0 comp rx=0 tx=0).stop 2023-07-14T18:11:08.874 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:08.834+0000 7f31dbab1700 1 -- 172.21.15.163:0/3183702525 shutdown_connections 2023-07-14T18:11:08.874 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:08.834+0000 7f31dbab1700 1 --2- 172.21.15.163:0/3183702525 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f31d4100690 0x7f31d4106f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:08.875 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:08.834+0000 7f31dbab1700 1 --2- 172.21.15.163:0/3183702525 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f31d40feb10 0x7f31d40fef20 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:08.875 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:08.834+0000 7f31dbab1700 1 --2- 172.21.15.163:0/3183702525 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f31d40ffd00 0x7f31d4100150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:08.875 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:08.834+0000 7f31dbab1700 1 -- 172.21.15.163:0/3183702525 >> 172.21.15.163:0/3183702525 conn(0x7f31d40fa130 msgr2=0x7f31d40fc560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:11:08.875 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:08.834+0000 7f31dbab1700 1 -- 172.21.15.163:0/3183702525 shutdown_connections 2023-07-14T18:11:08.875 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:08.834+0000 7f31dbab1700 1 -- 172.21.15.163:0/3183702525 wait complete. 2023-07-14T18:11:08.877 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:08.835+0000 7f31dbab1700 1 Processor -- start 2023-07-14T18:11:08.877 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:08.835+0000 7f31dbab1700 1 -- start start 2023-07-14T18:11:08.877 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:08.835+0000 7f31dbab1700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f31d40feb10 0x7f31d4069340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:11:08.877 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:08.835+0000 7f31dbab1700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f31d40ffd00 0x7f31d419a640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:11:08.877 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:08.835+0000 7f31dbab1700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f31d4100690 0x7f31d419cc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:11:08.878 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:08.835+0000 7f31dbab1700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31d419d420 con 0x7f31d40feb10 2023-07-14T18:11:08.878 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:08.835+0000 7f31dbab1700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31d419d590 con 0x7f31d4100690 2023-07-14T18:11:08.878 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:08.835+0000 7f31dbab1700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31d419d750 con 0x7f31d40ffd00 2023-07-14T18:11:08.878 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:08.835+0000 7f31d984d700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f31d40feb10 0x7f31d4069340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:11:08.878 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:08.835+0000 7f31d904c700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f31d40ffd00 0x7f31d419a640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:11:08.878 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:08.835+0000 7f31d984d700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f31d40feb10 0x7f31d4069340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:55712/0 (socket says 172.21.15.163:55712) 2023-07-14T18:11:08.878 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:08.835+0000 7f31d904c700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f31d40ffd00 0x7f31d419a640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.163:37530/0 (socket says 172.21.15.163:37530) 2023-07-14T18:11:08.878 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:08.835+0000 7f31d984d700 1 -- 172.21.15.163:0/2417976398 learned_addr learned my addr 172.21.15.163:0/2417976398 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:11:08.879 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:08.836+0000 7f31da04e700 1 --2- 172.21.15.163:0/2417976398 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f31d4100690 0x7f31d419cc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:11:08.879 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:08.836+0000 7f31d904c700 1 -- 172.21.15.163:0/2417976398 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f31d4100690 msgr2=0x7f31d419cc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:11:08.879 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:08.836+0000 7f31d904c700 1 --2- 172.21.15.163:0/2417976398 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f31d4100690 0x7f31d419cc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:08.879 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:08.836+0000 7f31d904c700 1 -- 172.21.15.163:0/2417976398 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f31d40feb10 msgr2=0x7f31d4069340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:11:08.879 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:08.836+0000 7f31d904c700 1 --2- 172.21.15.163:0/2417976398 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f31d40feb10 0x7f31d4069340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:08.879 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:08.836+0000 7f31d904c700 1 -- 172.21.15.163:0/2417976398 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31d00095f0 con 0x7f31d40ffd00 2023-07-14T18:11:08.879 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:08.836+0000 7f31d904c700 1 --2- 172.21.15.163:0/2417976398 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f31d40ffd00 0x7f31d419a640 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f31c400e9f0 tx=0x7f31c400ed00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:11:08.880 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:08.836+0000 7f31caffd700 1 -- 172.21.15.163:0/2417976398 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31c400c9c0 con 0x7f31d40ffd00 2023-07-14T18:11:08.880 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:08.836+0000 7f31caffd700 1 -- 172.21.15.163:0/2417976398 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f31c4010430 con 0x7f31d40ffd00 2023-07-14T18:11:08.880 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:08.836+0000 7f31dbab1700 1 -- 172.21.15.163:0/2417976398 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f31d419da30 con 0x7f31d40ffd00 2023-07-14T18:11:08.880 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:08.836+0000 7f31caffd700 1 -- 172.21.15.163:0/2417976398 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31c4018680 con 0x7f31d40ffd00 2023-07-14T18:11:08.880 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:08.836+0000 7f31dbab1700 1 -- 172.21.15.163:0/2417976398 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f31d419df40 con 0x7f31d40ffd00 2023-07-14T18:11:08.880 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:08.837+0000 7f31dbab1700 1 -- 172.21.15.163:0/2417976398 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f31d41061a0 con 0x7f31d40ffd00 2023-07-14T18:11:08.881 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:08.838+0000 7f31caffd700 1 -- 172.21.15.163:0/2417976398 <== mon.1 v2:172.21.15.184:3300/0 4 ==== mgrmap(e 16) v1 ==== 135716+0+0 (secure 0 0 0) 0x7f31c40105a0 con 0x7f31d40ffd00 2023-07-14T18:11:08.881 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:08.839+0000 7f31caffd700 1 --2- 172.21.15.163:0/2417976398 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f31c00a1150 0x7f31c00a3600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:11:08.881 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:08.839+0000 7f31caffd700 1 -- 172.21.15.163:0/2417976398 <== mon.1 v2:172.21.15.184:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 7879+0+0 (secure 0 0 0) 0x7f31c4014070 con 0x7f31d40ffd00 2023-07-14T18:11:08.881 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:08.839+0000 7f31d984d700 1 --2- 172.21.15.163:0/2417976398 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f31c00a1150 0x7f31c00a3600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:11:08.882 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:08.839+0000 7f31d984d700 1 --2- 172.21.15.163:0/2417976398 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f31c00a1150 0x7f31c00a3600 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f31d0006010 tx=0x7f31d000b260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:11:08.882 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:08.843+0000 7f31caffd700 1 -- 172.21.15.163:0/2417976398 <== mon.1 v2:172.21.15.184:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178025 (secure 0 0 0) 0x7f31c4096210 con 0x7f31d40ffd00 2023-07-14T18:11:09.024 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:11:08 smithi172 ceph-mon[97983]: pgmap v242: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-07-14T18:11:09.024 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:11:08 smithi172 ceph-mon[97983]: from='client.? 172.21.15.163:0/4060763125' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2023-07-14T18:11:09.025 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:11:08 smithi172 ceph-mon[97983]: osdmap e77: 12 total, 12 up, 12 in 2023-07-14T18:11:09.025 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:11:08 smithi172 ceph-mon[97983]: from='client.? 172.21.15.163:0/3555897615' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]: dispatch 2023-07-14T18:11:09.146 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:09.107+0000 7f31dbab1700 1 -- 172.21.15.163:0/2417976398 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f31d402caf0 con 0x7f31d40ffd00 2023-07-14T18:11:09.173 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:11:08 smithi184 ceph-mon[98481]: pgmap v242: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-07-14T18:11:09.173 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:11:08 smithi184 ceph-mon[98481]: from='client.? 172.21.15.163:0/4060763125' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2023-07-14T18:11:09.173 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:11:08 smithi184 ceph-mon[98481]: osdmap e77: 12 total, 12 up, 12 in 2023-07-14T18:11:09.174 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:11:08 smithi184 ceph-mon[98481]: from='client.? 172.21.15.163:0/3555897615' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]: dispatch 2023-07-14T18:11:09.216 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:11:08 smithi163 ceph-mon[96576]: pgmap v242: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-07-14T18:11:09.216 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:11:08 smithi163 ceph-mon[96576]: from='client.? 172.21.15.163:0/4060763125' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2023-07-14T18:11:09.216 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:11:08 smithi163 ceph-mon[96576]: osdmap e77: 12 total, 12 up, 12 in 2023-07-14T18:11:09.216 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:11:08 smithi163 ceph-mon[96576]: from='client.? 172.21.15.163:0/3555897615' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]: dispatch 2023-07-14T18:11:09.754 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:09.715+0000 7f31caffd700 1 -- 172.21.15.163:0/2417976398 <== mon.1 v2:172.21.15.184:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v14) v1 ==== 172+0+0 (secure 0 0 0) 0x7f31c4099830 con 0x7f31d40ffd00 2023-07-14T18:11:09.759 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:09.719+0000 7f31dbab1700 1 -- 172.21.15.163:0/2417976398 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f31c00a1150 msgr2=0x7f31c00a3600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:11:09.760 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:09.720+0000 7f31dbab1700 1 --2- 172.21.15.163:0/2417976398 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f31c00a1150 0x7f31c00a3600 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f31d0006010 tx=0x7f31d000b260 comp rx=0 tx=0).stop 2023-07-14T18:11:09.760 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:09.720+0000 7f31dbab1700 1 -- 172.21.15.163:0/2417976398 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f31d40ffd00 msgr2=0x7f31d419a640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:11:09.760 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:09.720+0000 7f31dbab1700 1 --2- 172.21.15.163:0/2417976398 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f31d40ffd00 0x7f31d419a640 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f31c400e9f0 tx=0x7f31c400ed00 comp rx=0 tx=0).stop 2023-07-14T18:11:09.761 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:09.720+0000 7f31dbab1700 1 -- 172.21.15.163:0/2417976398 shutdown_connections 2023-07-14T18:11:09.761 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:09.720+0000 7f31dbab1700 1 --2- 172.21.15.163:0/2417976398 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f31c00a1150 0x7f31c00a3600 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:09.761 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:09.720+0000 7f31dbab1700 1 --2- 172.21.15.163:0/2417976398 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f31d4100690 0x7f31d419cc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:09.761 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:09.720+0000 7f31dbab1700 1 --2- 172.21.15.163:0/2417976398 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f31d40feb10 0x7f31d4069340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:09.761 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:09.720+0000 7f31dbab1700 1 --2- 172.21.15.163:0/2417976398 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f31d40ffd00 0x7f31d419a640 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:09.761 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:09.720+0000 7f31dbab1700 1 -- 172.21.15.163:0/2417976398 >> 172.21.15.163:0/2417976398 conn(0x7f31d40fa130 msgr2=0x7f31d41032e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:11:09.762 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:09.720+0000 7f31dbab1700 1 -- 172.21.15.163:0/2417976398 shutdown_connections 2023-07-14T18:11:09.762 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:09.720+0000 7f31dbab1700 1 -- 172.21.15.163:0/2417976398 wait complete. 2023-07-14T18:11:09.762 INFO:teuthology.orchestra.run.smithi163.stderr:new fs with metadata pool 2 and data pool 3 2023-07-14T18:11:09.774 DEBUG:tasks.cephfs.filesystem:EC profile is ['m=2', 'k=2', 'crush-failure-domain=osd'] 2023-07-14T18:11:09.774 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd erasure-code-profile set cephfs_data_ec m=2 k=2 crush-failure-domain=osd 2023-07-14T18:11:09.903 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:09.863+0000 7fca1a796700 1 -- 172.21.15.163:0/1885262014 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fca141018e0 msgr2=0x7fca141081a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:11:09.903 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:09.863+0000 7fca1a796700 1 --2- 172.21.15.163:0/1885262014 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fca141018e0 0x7fca141081a0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fca0c00b0a0 tx=0x7fca0c00b3b0 comp rx=0 tx=0).stop 2023-07-14T18:11:09.903 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:09.863+0000 7fca1a796700 1 -- 172.21.15.163:0/1885262014 shutdown_connections 2023-07-14T18:11:09.903 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:09.863+0000 7fca1a796700 1 --2- 172.21.15.163:0/1885262014 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fca141018e0 0x7fca141081a0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:09.904 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:09.863+0000 7fca1a796700 1 --2- 172.21.15.163:0/1885262014 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fca140fdee0 0x7fca140fe2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:09.904 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:09.863+0000 7fca1a796700 1 --2- 172.21.15.163:0/1885262014 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fca14100f50 0x7fca141013a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:09.904 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:09.863+0000 7fca1a796700 1 -- 172.21.15.163:0/1885262014 >> 172.21.15.163:0/1885262014 conn(0x7fca140f98a0 msgr2=0x7fca140fbcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:11:09.904 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:09.863+0000 7fca1a796700 1 -- 172.21.15.163:0/1885262014 shutdown_connections 2023-07-14T18:11:09.904 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:09.863+0000 7fca1a796700 1 -- 172.21.15.163:0/1885262014 wait complete. 2023-07-14T18:11:09.906 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:09.864+0000 7fca1a796700 1 Processor -- start 2023-07-14T18:11:09.906 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:09.864+0000 7fca1a796700 1 -- start start 2023-07-14T18:11:09.906 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:09.864+0000 7fca1a796700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fca140fdee0 0x7fca14195a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:11:09.906 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:09.864+0000 7fca1a796700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fca14100f50 0x7fca14195f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:11:09.907 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:09.864+0000 7fca1a796700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fca141018e0 0x7fca1419cfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:11:09.907 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:09.864+0000 7fca1a796700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca1419d590 con 0x7fca140fdee0 2023-07-14T18:11:09.907 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:09.864+0000 7fca1a796700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca1419d6d0 con 0x7fca14100f50 2023-07-14T18:11:09.907 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:09.864+0000 7fca1a796700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca1419d860 con 0x7fca141018e0 2023-07-14T18:11:09.907 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:09.864+0000 7fca13fff700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fca140fdee0 0x7fca14195a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:11:09.907 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:09.864+0000 7fca13fff700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fca140fdee0 0x7fca14195a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:55730/0 (socket says 172.21.15.163:55730) 2023-07-14T18:11:09.907 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:09.864+0000 7fca13fff700 1 -- 172.21.15.163:0/2526401585 learned_addr learned my addr 172.21.15.163:0/2526401585 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:11:09.908 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:09.865+0000 7fca18d33700 1 --2- 172.21.15.163:0/2526401585 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fca141018e0 0x7fca1419cfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:11:09.908 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:09.865+0000 7fca0bfff700 1 --2- 172.21.15.163:0/2526401585 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fca14100f50 0x7fca14195f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:11:09.908 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:09.865+0000 7fca13fff700 1 -- 172.21.15.163:0/2526401585 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fca141018e0 msgr2=0x7fca1419cfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:11:09.908 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:09.865+0000 7fca13fff700 1 --2- 172.21.15.163:0/2526401585 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fca141018e0 0x7fca1419cfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:09.908 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:09.865+0000 7fca13fff700 1 -- 172.21.15.163:0/2526401585 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fca14100f50 msgr2=0x7fca14195f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:11:09.908 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:09.865+0000 7fca13fff700 1 --2- 172.21.15.163:0/2526401585 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fca14100f50 0x7fca14195f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:09.908 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:09.865+0000 7fca13fff700 1 -- 172.21.15.163:0/2526401585 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca0c009d00 con 0x7fca140fdee0 2023-07-14T18:11:09.909 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:09.865+0000 7fca0bfff700 1 --2- 172.21.15.163:0/2526401585 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fca14100f50 0x7fca14195f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T18:11:09.909 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:09.865+0000 7fca13fff700 1 --2- 172.21.15.163:0/2526401585 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fca140fdee0 0x7fca14195a10 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fca0400d980 tx=0x7fca0400dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:11:09.909 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:09.865+0000 7fca11ffb700 1 -- 172.21.15.163:0/2526401585 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca04004020 con 0x7fca140fdee0 2023-07-14T18:11:09.909 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:09.865+0000 7fca11ffb700 1 -- 172.21.15.163:0/2526401585 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fca04009730 con 0x7fca140fdee0 2023-07-14T18:11:09.909 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:09.865+0000 7fca1a796700 1 -- 172.21.15.163:0/2526401585 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fca1419db40 con 0x7fca140fdee0 2023-07-14T18:11:09.909 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:09.865+0000 7fca11ffb700 1 -- 172.21.15.163:0/2526401585 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca04003a00 con 0x7fca140fdee0 2023-07-14T18:11:09.909 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:09.865+0000 7fca1a796700 1 -- 172.21.15.163:0/2526401585 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca1419e050 con 0x7fca140fdee0 2023-07-14T18:11:09.909 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:09.866+0000 7fca1a796700 1 -- 172.21.15.163:0/2526401585 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fca1410b2d0 con 0x7fca140fdee0 2023-07-14T18:11:09.910 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:09.867+0000 7fca11ffb700 1 -- 172.21.15.163:0/2526401585 <== mon.0 v2:172.21.15.163:3300/0 4 ==== mgrmap(e 16) v1 ==== 135716+0+0 (secure 0 0 0) 0x7fca040098a0 con 0x7fca140fdee0 2023-07-14T18:11:09.910 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:09.868+0000 7fca11ffb700 1 --2- 172.21.15.163:0/2526401585 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7fca000a1150 0x7fca000a3600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:11:09.910 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:09.868+0000 7fca11ffb700 1 -- 172.21.15.163:0/2526401585 <== mon.0 v2:172.21.15.163:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 7979+0+0 (secure 0 0 0) 0x7fca040cc840 con 0x7fca140fdee0 2023-07-14T18:11:09.911 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:09.868+0000 7fca0bfff700 1 --2- 172.21.15.163:0/2526401585 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7fca000a1150 0x7fca000a3600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:11:09.911 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:09.868+0000 7fca0bfff700 1 --2- 172.21.15.163:0/2526401585 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7fca000a1150 0x7fca000a3600 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fc9fc00bc10 tx=0x7fc9fc00b5f0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:11:09.911 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:09.872+0000 7fca11ffb700 1 -- 172.21.15.163:0/2526401585 <== mon.0 v2:172.21.15.163:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178025 (secure 0 0 0) 0x7fca040960e0 con 0x7fca140fdee0 2023-07-14T18:11:10.024 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:11:09 smithi172 ceph-mon[97983]: from='client.? 172.21.15.163:0/3555897615' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]': finished 2023-07-14T18:11:10.024 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:11:09 smithi172 ceph-mon[97983]: osdmap e78: 12 total, 12 up, 12 in 2023-07-14T18:11:10.024 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:11:09 smithi172 ceph-mon[97983]: from='client.? 172.21.15.163:0/2417976398' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2023-07-14T18:11:10.025 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:11:09 smithi172 ceph-mon[97983]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2023-07-14T18:11:10.025 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:11:09 smithi172 ceph-mon[97983]: daemon mds.b assigned to filesystem cephfs as rank 0 2023-07-14T18:11:10.129 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:10.089+0000 7fca1a796700 1 -- 172.21.15.163:0/2526401585 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]} v 0) v1 -- 0x7fca14106d00 con 0x7fca140fdee0 2023-07-14T18:11:10.173 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:11:09 smithi184 ceph-mon[98481]: from='client.? 172.21.15.163:0/3555897615' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]': finished 2023-07-14T18:11:10.173 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:11:09 smithi184 ceph-mon[98481]: osdmap e78: 12 total, 12 up, 12 in 2023-07-14T18:11:10.173 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:11:09 smithi184 ceph-mon[98481]: from='client.? 172.21.15.163:0/2417976398' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2023-07-14T18:11:10.174 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:11:09 smithi184 ceph-mon[98481]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2023-07-14T18:11:10.174 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:11:09 smithi184 ceph-mon[98481]: daemon mds.b assigned to filesystem cephfs as rank 0 2023-07-14T18:11:10.216 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:11:09 smithi163 ceph-mon[96576]: from='client.? 172.21.15.163:0/3555897615' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]': finished 2023-07-14T18:11:10.216 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:11:09 smithi163 ceph-mon[96576]: osdmap e78: 12 total, 12 up, 12 in 2023-07-14T18:11:10.216 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:11:09 smithi163 ceph-mon[96576]: from='client.? 172.21.15.163:0/2417976398' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2023-07-14T18:11:10.216 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:11:09 smithi163 ceph-mon[96576]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2023-07-14T18:11:10.216 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:11:09 smithi163 ceph-mon[96576]: daemon mds.b assigned to filesystem cephfs as rank 0 2023-07-14T18:11:10.748 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:10.708+0000 7fca11ffb700 1 -- 172.21.15.163:0/2526401585 <== mon.0 v2:172.21.15.163:3300/0 7 ==== mon_command_ack([{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]=0 v80) v1 ==== 157+0+0 (secure 0 0 0) 0x7fca04099700 con 0x7fca140fdee0 2023-07-14T18:11:10.751 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:10.711+0000 7fca1a796700 1 -- 172.21.15.163:0/2526401585 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7fca000a1150 msgr2=0x7fca000a3600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:11:10.751 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:10.711+0000 7fca1a796700 1 --2- 172.21.15.163:0/2526401585 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7fca000a1150 0x7fca000a3600 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fc9fc00bc10 tx=0x7fc9fc00b5f0 comp rx=0 tx=0).stop 2023-07-14T18:11:10.751 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:10.711+0000 7fca1a796700 1 -- 172.21.15.163:0/2526401585 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fca140fdee0 msgr2=0x7fca14195a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:11:10.751 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:10.711+0000 7fca1a796700 1 --2- 172.21.15.163:0/2526401585 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fca140fdee0 0x7fca14195a10 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fca0400d980 tx=0x7fca0400dc90 comp rx=0 tx=0).stop 2023-07-14T18:11:10.751 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:10.711+0000 7fca1a796700 1 -- 172.21.15.163:0/2526401585 shutdown_connections 2023-07-14T18:11:10.751 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:10.711+0000 7fca1a796700 1 --2- 172.21.15.163:0/2526401585 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7fca000a1150 0x7fca000a3600 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:10.752 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:10.711+0000 7fca1a796700 1 --2- 172.21.15.163:0/2526401585 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fca141018e0 0x7fca1419cfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:10.752 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:10.711+0000 7fca1a796700 1 --2- 172.21.15.163:0/2526401585 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fca140fdee0 0x7fca14195a10 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:10.752 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:10.711+0000 7fca1a796700 1 --2- 172.21.15.163:0/2526401585 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fca14100f50 0x7fca14195f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:10.752 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:10.711+0000 7fca1a796700 1 -- 172.21.15.163:0/2526401585 >> 172.21.15.163:0/2526401585 conn(0x7fca140f98a0 msgr2=0x7fca140fbb50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:11:10.752 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:10.711+0000 7fca1a796700 1 -- 172.21.15.163:0/2526401585 shutdown_connections 2023-07-14T18:11:10.752 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:10.711+0000 7fca1a796700 1 -- 172.21.15.163:0/2526401585 wait complete. 2023-07-14T18:11:10.763 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data_ec erasure cephfs_data_ec --pg_num_min 64 --target_size_ratio 0.9 2023-07-14T18:11:10.895 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:10.856+0000 7fe58b6ab700 1 -- 172.21.15.163:0/2255561858 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fe584105930 msgr2=0x7fe584107d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:11:10.896 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:10.856+0000 7fe58b6ab700 1 --2- 172.21.15.163:0/2255561858 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fe584105930 0x7fe584107d30 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fe57c00b0a0 tx=0x7fe57c00b3b0 comp rx=0 tx=0).stop 2023-07-14T18:11:10.896 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:10.856+0000 7fe58b6ab700 1 -- 172.21.15.163:0/2255561858 shutdown_connections 2023-07-14T18:11:10.896 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:10.856+0000 7fe58b6ab700 1 --2- 172.21.15.163:0/2255561858 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fe584105930 0x7fe584107d30 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:10.896 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:10.856+0000 7fe58b6ab700 1 --2- 172.21.15.163:0/2255561858 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe5841006f0 0x7fe584102ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:10.896 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:10.856+0000 7fe58b6ab700 1 --2- 172.21.15.163:0/2255561858 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe584103010 0x7fe5841053f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:10.897 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:10.856+0000 7fe58b6ab700 1 -- 172.21.15.163:0/2255561858 >> 172.21.15.163:0/2255561858 conn(0x7fe5840fa130 msgr2=0x7fe5840fc560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:11:10.897 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:10.856+0000 7fe58b6ab700 1 -- 172.21.15.163:0/2255561858 shutdown_connections 2023-07-14T18:11:10.897 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:10.856+0000 7fe58b6ab700 1 -- 172.21.15.163:0/2255561858 wait complete. 2023-07-14T18:11:10.898 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:10.857+0000 7fe58b6ab700 1 Processor -- start 2023-07-14T18:11:10.899 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:10.857+0000 7fe58b6ab700 1 -- start start 2023-07-14T18:11:10.899 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:10.857+0000 7fe58b6ab700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe5841006f0 0x7fe5841958b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:11:10.899 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:10.857+0000 7fe58b6ab700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fe584103010 0x7fe584195df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:11:10.899 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:10.857+0000 7fe58b6ab700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe584105930 0x7fe58419ce60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:11:10.899 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:10.857+0000 7fe58b6ab700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe58419d430 con 0x7fe584103010 2023-07-14T18:11:10.899 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:10.857+0000 7fe58b6ab700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe58419d570 con 0x7fe584105930 2023-07-14T18:11:10.900 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:10.857+0000 7fe58b6ab700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe58419d700 con 0x7fe5841006f0 2023-07-14T18:11:10.900 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:10.857+0000 7fe588c46700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fe584103010 0x7fe584195df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:11:10.900 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:10.857+0000 7fe588c46700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fe584103010 0x7fe584195df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:55746/0 (socket says 172.21.15.163:55746) 2023-07-14T18:11:10.900 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:10.857+0000 7fe588c46700 1 -- 172.21.15.163:0/2005120817 learned_addr learned my addr 172.21.15.163:0/2005120817 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:11:10.900 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:10.857+0000 7fe589447700 1 --2- 172.21.15.163:0/2005120817 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe5841006f0 0x7fe5841958b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:11:10.900 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:10.857+0000 7fe589c48700 1 --2- 172.21.15.163:0/2005120817 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe584105930 0x7fe58419ce60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:11:10.900 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:10.857+0000 7fe588c46700 1 -- 172.21.15.163:0/2005120817 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe5841006f0 msgr2=0x7fe5841958b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:11:10.900 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:10.857+0000 7fe588c46700 1 --2- 172.21.15.163:0/2005120817 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe5841006f0 0x7fe5841958b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:10.901 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:10.857+0000 7fe588c46700 1 -- 172.21.15.163:0/2005120817 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe584105930 msgr2=0x7fe58419ce60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:11:10.901 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:10.857+0000 7fe588c46700 1 --2- 172.21.15.163:0/2005120817 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe584105930 0x7fe58419ce60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:10.901 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:10.857+0000 7fe588c46700 1 -- 172.21.15.163:0/2005120817 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe57c009d00 con 0x7fe584103010 2023-07-14T18:11:10.901 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:10.857+0000 7fe589c48700 1 --2- 172.21.15.163:0/2005120817 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe584105930 0x7fe58419ce60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T18:11:10.901 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:10.858+0000 7fe588c46700 1 --2- 172.21.15.163:0/2005120817 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fe584103010 0x7fe584195df0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fe58000d980 tx=0x7fe58000dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:11:10.901 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:10.858+0000 7fe57a7fc700 1 -- 172.21.15.163:0/2005120817 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe580004220 con 0x7fe584103010 2023-07-14T18:11:10.901 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:10.858+0000 7fe58b6ab700 1 -- 172.21.15.163:0/2005120817 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe58419d9e0 con 0x7fe584103010 2023-07-14T18:11:10.902 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:10.858+0000 7fe57a7fc700 1 -- 172.21.15.163:0/2005120817 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fe580007640 con 0x7fe584103010 2023-07-14T18:11:10.902 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:10.858+0000 7fe57a7fc700 1 -- 172.21.15.163:0/2005120817 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5800055e0 con 0x7fe584103010 2023-07-14T18:11:10.902 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:10.858+0000 7fe58b6ab700 1 -- 172.21.15.163:0/2005120817 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe58419df40 con 0x7fe584103010 2023-07-14T18:11:10.902 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:10.859+0000 7fe58b6ab700 1 -- 172.21.15.163:0/2005120817 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe5840fbca0 con 0x7fe584103010 2023-07-14T18:11:10.903 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:10.860+0000 7fe57a7fc700 1 -- 172.21.15.163:0/2005120817 <== mon.0 v2:172.21.15.163:3300/0 4 ==== mgrmap(e 16) v1 ==== 135716+0+0 (secure 0 0 0) 0x7fe580004750 con 0x7fe584103010 2023-07-14T18:11:10.903 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:10.861+0000 7fe57a7fc700 1 --2- 172.21.15.163:0/2005120817 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7fe5700a11f0 0x7fe5700a36a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:11:10.903 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:10.861+0000 7fe589447700 1 --2- 172.21.15.163:0/2005120817 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7fe5700a11f0 0x7fe5700a36a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:11:10.903 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:10.861+0000 7fe57a7fc700 1 -- 172.21.15.163:0/2005120817 <== mon.0 v2:172.21.15.163:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 8205+0+0 (secure 0 0 0) 0x7fe5800ccbf0 con 0x7fe584103010 2023-07-14T18:11:10.903 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:10.862+0000 7fe589447700 1 --2- 172.21.15.163:0/2005120817 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7fe5700a11f0 0x7fe5700a36a0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fe574009c60 tx=0x7fe574009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:11:10.904 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:10.865+0000 7fe57a7fc700 1 -- 172.21.15.163:0/2005120817 <== mon.0 v2:172.21.15.163:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178025 (secure 0 0 0) 0x7fe580096360 con 0x7fe584103010 2023-07-14T18:11:11.024 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:11:10 smithi172 ceph-mon[97983]: pgmap v245: 97 pgs: 17 creating+peering, 4 active+clean, 76 unknown; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-07-14T18:11:11.024 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:11:10 smithi172 ceph-mon[97983]: osdmap e79: 12 total, 12 up, 12 in 2023-07-14T18:11:11.025 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:11:10 smithi172 ceph-mon[97983]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2023-07-14T18:11:11.025 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:11:10 smithi172 ceph-mon[97983]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2023-07-14T18:11:11.025 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:11:10 smithi172 ceph-mon[97983]: daemon mds.b is now active in filesystem cephfs as rank 0 2023-07-14T18:11:11.025 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:11:10 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:11:11.025 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:11:10 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:11:11.025 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:11:10 smithi172 ceph-mon[97983]: from='client.? 172.21.15.163:0/2526401585' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]: dispatch 2023-07-14T18:11:11.025 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:11:10 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:11:11.026 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:11:10 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:11:11.026 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:11:10 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:11:11.026 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:11:10 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:11:11.026 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:11:10 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T18:11:11.026 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:11:10 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-14T18:11:11.026 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:11:10 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:11:11.093 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:11.054+0000 7fe58b6ab700 1 -- 172.21.15.163:0/2005120817 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7fe58402cb90 con 0x7fe584103010 2023-07-14T18:11:11.173 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:11:10 smithi184 ceph-mon[98481]: pgmap v245: 97 pgs: 17 creating+peering, 4 active+clean, 76 unknown; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-07-14T18:11:11.174 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:11:10 smithi184 ceph-mon[98481]: osdmap e79: 12 total, 12 up, 12 in 2023-07-14T18:11:11.174 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:11:10 smithi184 ceph-mon[98481]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2023-07-14T18:11:11.174 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:11:10 smithi184 ceph-mon[98481]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2023-07-14T18:11:11.174 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:11:10 smithi184 ceph-mon[98481]: daemon mds.b is now active in filesystem cephfs as rank 0 2023-07-14T18:11:11.174 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:11:10 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:11:11.174 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:11:10 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:11:11.174 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:11:10 smithi184 ceph-mon[98481]: from='client.? 172.21.15.163:0/2526401585' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]: dispatch 2023-07-14T18:11:11.175 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:11:10 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:11:11.175 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:11:10 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:11:11.175 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:11:10 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:11:11.175 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:11:10 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:11:11.175 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:11:10 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T18:11:11.175 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:11:10 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-14T18:11:11.175 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:11:10 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:11:11.216 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:11:10 smithi163 ceph-mon[96576]: pgmap v245: 97 pgs: 17 creating+peering, 4 active+clean, 76 unknown; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-07-14T18:11:11.216 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:11:10 smithi163 ceph-mon[96576]: osdmap e79: 12 total, 12 up, 12 in 2023-07-14T18:11:11.216 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:11:10 smithi163 ceph-mon[96576]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2023-07-14T18:11:11.216 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:11:10 smithi163 ceph-mon[96576]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2023-07-14T18:11:11.216 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:11:10 smithi163 ceph-mon[96576]: daemon mds.b is now active in filesystem cephfs as rank 0 2023-07-14T18:11:11.217 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:11:10 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:11:11.217 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:11:10 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:11:11.217 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:11:10 smithi163 ceph-mon[96576]: from='client.? 172.21.15.163:0/2526401585' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]: dispatch 2023-07-14T18:11:11.217 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:11:10 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:11:11.217 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:11:10 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:11:11.217 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:11:10 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:11:11.217 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:11:10 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:11:11.217 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:11:10 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T18:11:11.218 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:11:10 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-14T18:11:11.218 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:11:10 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:11:12.024 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:11:11 smithi172 ceph-mon[97983]: from='client.? 172.21.15.163:0/2526401585' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]': finished 2023-07-14T18:11:12.024 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:11:11 smithi172 ceph-mon[97983]: osdmap e80: 12 total, 12 up, 12 in 2023-07-14T18:11:12.025 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:11:11 smithi172 ceph-mon[97983]: mds.? [v2:172.21.15.172:6838/3850440096,v1:172.21.15.172:6839/3850440096] up:active 2023-07-14T18:11:12.025 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:11:11 smithi172 ceph-mon[97983]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2023-07-14T18:11:12.025 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:11:11 smithi172 ceph-mon[97983]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2023-07-14T18:11:12.025 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:11:11 smithi172 ceph-mon[97983]: from='client.? 172.21.15.163:0/2005120817' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2023-07-14T18:11:12.173 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:11:11 smithi184 ceph-mon[98481]: from='client.? 172.21.15.163:0/2526401585' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]': finished 2023-07-14T18:11:12.174 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:11:11 smithi184 ceph-mon[98481]: osdmap e80: 12 total, 12 up, 12 in 2023-07-14T18:11:12.174 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:11:11 smithi184 ceph-mon[98481]: mds.? [v2:172.21.15.172:6838/3850440096,v1:172.21.15.172:6839/3850440096] up:active 2023-07-14T18:11:12.174 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:11:11 smithi184 ceph-mon[98481]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2023-07-14T18:11:12.175 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:11:11 smithi184 ceph-mon[98481]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2023-07-14T18:11:12.175 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:11:11 smithi184 ceph-mon[98481]: from='client.? 172.21.15.163:0/2005120817' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2023-07-14T18:11:12.216 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:11:11 smithi163 ceph-mon[96576]: from='client.? 172.21.15.163:0/2526401585' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]': finished 2023-07-14T18:11:12.216 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:11:11 smithi163 ceph-mon[96576]: osdmap e80: 12 total, 12 up, 12 in 2023-07-14T18:11:12.216 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:11:11 smithi163 ceph-mon[96576]: mds.? [v2:172.21.15.172:6838/3850440096,v1:172.21.15.172:6839/3850440096] up:active 2023-07-14T18:11:12.216 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:11:11 smithi163 ceph-mon[96576]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2023-07-14T18:11:12.216 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:11:11 smithi163 ceph-mon[96576]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2023-07-14T18:11:12.217 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:11:11 smithi163 ceph-mon[96576]: from='client.? 172.21.15.163:0/2005120817' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2023-07-14T18:11:12.802 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:12.763+0000 7fe57a7fc700 1 -- 172.21.15.163:0/2005120817 <== mon.0 v2:172.21.15.163:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data_ec' created v82) v1 ==== 228+0+0 (secure 0 0 0) 0x7fe580016020 con 0x7fe584103010 2023-07-14T18:11:12.808 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:12.770+0000 7fe58b6ab700 1 -- 172.21.15.163:0/2005120817 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7fe5700a11f0 msgr2=0x7fe5700a36a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:11:12.809 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:12.770+0000 7fe58b6ab700 1 --2- 172.21.15.163:0/2005120817 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7fe5700a11f0 0x7fe5700a36a0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fe574009c60 tx=0x7fe574009260 comp rx=0 tx=0).stop 2023-07-14T18:11:12.809 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:12.770+0000 7fe58b6ab700 1 -- 172.21.15.163:0/2005120817 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fe584103010 msgr2=0x7fe584195df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:11:12.809 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:12.770+0000 7fe58b6ab700 1 --2- 172.21.15.163:0/2005120817 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fe584103010 0x7fe584195df0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fe58000d980 tx=0x7fe58000dc90 comp rx=0 tx=0).stop 2023-07-14T18:11:12.809 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:12.770+0000 7fe58b6ab700 1 -- 172.21.15.163:0/2005120817 shutdown_connections 2023-07-14T18:11:12.809 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:12.770+0000 7fe58b6ab700 1 --2- 172.21.15.163:0/2005120817 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7fe5700a11f0 0x7fe5700a36a0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:12.809 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:12.770+0000 7fe58b6ab700 1 --2- 172.21.15.163:0/2005120817 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe5841006f0 0x7fe5841958b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:12.809 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:12.770+0000 7fe58b6ab700 1 --2- 172.21.15.163:0/2005120817 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe584105930 0x7fe58419ce60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:12.809 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:12.770+0000 7fe58b6ab700 1 --2- 172.21.15.163:0/2005120817 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fe584103010 0x7fe584195df0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:12.810 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:12.770+0000 7fe58b6ab700 1 -- 172.21.15.163:0/2005120817 >> 172.21.15.163:0/2005120817 conn(0x7fe5840fa130 msgr2=0x7fe584101350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:11:12.810 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:12.770+0000 7fe58b6ab700 1 -- 172.21.15.163:0/2005120817 shutdown_connections 2023-07-14T18:11:12.810 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:12.770+0000 7fe58b6ab700 1 -- 172.21.15.163:0/2005120817 wait complete. 2023-07-14T18:11:12.810 INFO:teuthology.orchestra.run.smithi163.stderr:pool 'cephfs_data_ec' created 2023-07-14T18:11:12.823 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool set cephfs_data_ec allow_ec_overwrites true 2023-07-14T18:11:12.949 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:12.910+0000 7fa4c6912700 1 -- 172.21.15.163:0/3675609765 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fa4c00feb10 msgr2=0x7fa4c00fef20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:11:12.949 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:12.910+0000 7fa4c6912700 1 --2- 172.21.15.163:0/3675609765 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fa4c00feb10 0x7fa4c00fef20 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fa4b0009990 tx=0x7fa4b0009ca0 comp rx=0 tx=0).stop 2023-07-14T18:11:12.949 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:12.910+0000 7fa4c6912700 1 -- 172.21.15.163:0/3675609765 shutdown_connections 2023-07-14T18:11:12.950 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:12.910+0000 7fa4c6912700 1 --2- 172.21.15.163:0/3675609765 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa4c0100690 0x7fa4c0106f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:12.950 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:12.910+0000 7fa4c6912700 1 --2- 172.21.15.163:0/3675609765 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fa4c00feb10 0x7fa4c00fef20 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:12.950 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:12.910+0000 7fa4c6912700 1 --2- 172.21.15.163:0/3675609765 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa4c00ffd00 0x7fa4c0100150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:12.950 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:12.910+0000 7fa4c6912700 1 -- 172.21.15.163:0/3675609765 >> 172.21.15.163:0/3675609765 conn(0x7fa4c00fa130 msgr2=0x7fa4c00fc560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:11:12.950 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:12.910+0000 7fa4c6912700 1 -- 172.21.15.163:0/3675609765 shutdown_connections 2023-07-14T18:11:12.950 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:12.910+0000 7fa4c6912700 1 -- 172.21.15.163:0/3675609765 wait complete. 2023-07-14T18:11:12.950 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:12.911+0000 7fa4c6912700 1 Processor -- start 2023-07-14T18:11:12.950 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:12.911+0000 7fa4c6912700 1 -- start start 2023-07-14T18:11:12.952 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:12.911+0000 7fa4c6912700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa4c00feb10 0x7fa4c0068370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:11:12.952 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:12.911+0000 7fa4c6912700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa4c00ffd00 0x7fa4c019a5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:11:12.952 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:12.911+0000 7fa4c6912700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fa4c0100690 0x7fa4c019cc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:11:12.952 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:12.911+0000 7fa4c6912700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4c019d420 con 0x7fa4c0100690 2023-07-14T18:11:12.953 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:12.911+0000 7fa4c6912700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4c019d590 con 0x7fa4c00ffd00 2023-07-14T18:11:12.953 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:12.911+0000 7fa4c6912700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4c019d750 con 0x7fa4c00feb10 2023-07-14T18:11:12.953 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:12.911+0000 7fa4c4eaf700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fa4c0100690 0x7fa4c019cc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:11:12.953 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:12.911+0000 7fa4c4eaf700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fa4c0100690 0x7fa4c019cc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:55770/0 (socket says 172.21.15.163:55770) 2023-07-14T18:11:12.953 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:12.911+0000 7fa4c4eaf700 1 -- 172.21.15.163:0/929878932 learned_addr learned my addr 172.21.15.163:0/929878932 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:11:12.953 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:12.911+0000 7fa4bf7fe700 1 --2- 172.21.15.163:0/929878932 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa4c00ffd00 0x7fa4c019a5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:11:12.953 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:12.911+0000 7fa4bffff700 1 --2- 172.21.15.163:0/929878932 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa4c00feb10 0x7fa4c0068370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:11:12.954 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:12.911+0000 7fa4c4eaf700 1 -- 172.21.15.163:0/929878932 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa4c00feb10 msgr2=0x7fa4c0068370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:11:12.954 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:12.911+0000 7fa4c4eaf700 1 --2- 172.21.15.163:0/929878932 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa4c00feb10 0x7fa4c0068370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:12.954 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:12.912+0000 7fa4c4eaf700 1 -- 172.21.15.163:0/929878932 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa4c00ffd00 msgr2=0x7fa4c019a5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:11:12.954 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:12.912+0000 7fa4c4eaf700 1 --2- 172.21.15.163:0/929878932 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa4c00ffd00 0x7fa4c019a5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:12.954 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:12.912+0000 7fa4c4eaf700 1 -- 172.21.15.163:0/929878932 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4b00095f0 con 0x7fa4c0100690 2023-07-14T18:11:12.954 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:12.912+0000 7fa4bffff700 1 --2- 172.21.15.163:0/929878932 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa4c00feb10 0x7fa4c0068370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T18:11:12.954 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:12.912+0000 7fa4c4eaf700 1 --2- 172.21.15.163:0/929878932 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fa4c0100690 0x7fa4c019cc80 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fa4b8007ee0 tx=0x7fa4b800d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:11:12.954 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:12.912+0000 7fa4bd7fa700 1 -- 172.21.15.163:0/929878932 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4b800ddd0 con 0x7fa4c0100690 2023-07-14T18:11:12.955 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:12.912+0000 7fa4c6912700 1 -- 172.21.15.163:0/929878932 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa4c019da30 con 0x7fa4c0100690 2023-07-14T18:11:12.955 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:12.912+0000 7fa4bd7fa700 1 -- 172.21.15.163:0/929878932 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fa4b800f040 con 0x7fa4c0100690 2023-07-14T18:11:12.955 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:12.912+0000 7fa4bd7fa700 1 -- 172.21.15.163:0/929878932 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4b80047d0 con 0x7fa4c0100690 2023-07-14T18:11:12.955 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:12.912+0000 7fa4c6912700 1 -- 172.21.15.163:0/929878932 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4c019df40 con 0x7fa4c0100690 2023-07-14T18:11:12.956 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:12.914+0000 7fa4bd7fa700 1 -- 172.21.15.163:0/929878932 <== mon.0 v2:172.21.15.163:3300/0 4 ==== mgrmap(e 16) v1 ==== 135716+0+0 (secure 0 0 0) 0x7fa4b8003a00 con 0x7fa4c0100690 2023-07-14T18:11:12.956 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:12.914+0000 7fa4c6912700 1 -- 172.21.15.163:0/929878932 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa4c0105df0 con 0x7fa4c0100690 2023-07-14T18:11:12.956 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:12.914+0000 7fa4bd7fa700 1 --2- 172.21.15.163:0/929878932 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7fa4a80a1150 0x7fa4a80a3600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:11:12.956 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:12.915+0000 7fa4bd7fa700 1 -- 172.21.15.163:0/929878932 <== mon.0 v2:172.21.15.163:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 8698+0+0 (secure 0 0 0) 0x7fa4b80cc440 con 0x7fa4c0100690 2023-07-14T18:11:12.956 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:12.915+0000 7fa4bffff700 1 --2- 172.21.15.163:0/929878932 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7fa4a80a1150 0x7fa4a80a3600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:11:12.956 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:12.915+0000 7fa4bffff700 1 --2- 172.21.15.163:0/929878932 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7fa4a80a1150 0x7fa4a80a3600 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fa4b0006010 tx=0x7fa4b0005960 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:11:12.957 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:12.919+0000 7fa4bd7fa700 1 -- 172.21.15.163:0/929878932 <== mon.0 v2:172.21.15.163:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178025 (secure 0 0 0) 0x7fa4b804e780 con 0x7fa4c0100690 2023-07-14T18:11:13.147 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:13.109+0000 7fa4c6912700 1 -- 172.21.15.163:0/929878932 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"} v 0) v1 -- 0x7fa4c00612c0 con 0x7fa4c0100690 2023-07-14T18:11:13.173 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:11:12 smithi184 ceph-mon[98481]: pgmap v248: 97 pgs: 17 creating+peering, 49 active+clean, 31 unknown; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s wr, 5 op/s 2023-07-14T18:11:13.174 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:11:12 smithi184 ceph-mon[98481]: osdmap e81: 12 total, 12 up, 12 in 2023-07-14T18:11:13.215 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:11:12 smithi163 ceph-mon[96576]: pgmap v248: 97 pgs: 17 creating+peering, 49 active+clean, 31 unknown; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s wr, 5 op/s 2023-07-14T18:11:13.216 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:11:12 smithi163 ceph-mon[96576]: osdmap e81: 12 total, 12 up, 12 in 2023-07-14T18:11:13.274 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:11:12 smithi172 ceph-mon[97983]: pgmap v248: 97 pgs: 17 creating+peering, 49 active+clean, 31 unknown; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s wr, 5 op/s 2023-07-14T18:11:13.274 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:11:12 smithi172 ceph-mon[97983]: osdmap e81: 12 total, 12 up, 12 in 2023-07-14T18:11:13.803 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:13.765+0000 7fa4bd7fa700 1 -- 172.21.15.163:0/929878932 <== mon.0 v2:172.21.15.163:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]=0 set pool 4 allow_ec_overwrites to true v83) v1 ==== 169+0+0 (secure 0 0 0) 0x7fa4b80959c0 con 0x7fa4c0100690 2023-07-14T18:11:13.809 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:13.771+0000 7fa4c6912700 1 -- 172.21.15.163:0/929878932 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7fa4a80a1150 msgr2=0x7fa4a80a3600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:11:13.810 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:13.771+0000 7fa4c6912700 1 --2- 172.21.15.163:0/929878932 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7fa4a80a1150 0x7fa4a80a3600 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fa4b0006010 tx=0x7fa4b0005960 comp rx=0 tx=0).stop 2023-07-14T18:11:13.810 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:13.771+0000 7fa4c6912700 1 -- 172.21.15.163:0/929878932 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fa4c0100690 msgr2=0x7fa4c019cc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:11:13.810 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:13.771+0000 7fa4c6912700 1 --2- 172.21.15.163:0/929878932 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fa4c0100690 0x7fa4c019cc80 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fa4b8007ee0 tx=0x7fa4b800d3b0 comp rx=0 tx=0).stop 2023-07-14T18:11:13.817 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:13.772+0000 7fa4c6912700 1 -- 172.21.15.163:0/929878932 shutdown_connections 2023-07-14T18:11:13.818 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:13.772+0000 7fa4c6912700 1 --2- 172.21.15.163:0/929878932 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7fa4a80a1150 0x7fa4a80a3600 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:13.818 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:13.772+0000 7fa4c6912700 1 --2- 172.21.15.163:0/929878932 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa4c00feb10 0x7fa4c0068370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:13.818 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:13.772+0000 7fa4c6912700 1 --2- 172.21.15.163:0/929878932 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fa4c0100690 0x7fa4c019cc80 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:13.819 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:13.772+0000 7fa4c6912700 1 --2- 172.21.15.163:0/929878932 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa4c00ffd00 0x7fa4c019a5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:13.819 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:13.772+0000 7fa4c6912700 1 -- 172.21.15.163:0/929878932 >> 172.21.15.163:0/929878932 conn(0x7fa4c00fa130 msgr2=0x7fa4c0102f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:11:13.819 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:13.773+0000 7fa4c6912700 1 -- 172.21.15.163:0/929878932 shutdown_connections 2023-07-14T18:11:13.819 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:13.775+0000 7fa4c6912700 1 -- 172.21.15.163:0/929878932 wait complete. 2023-07-14T18:11:13.820 INFO:teuthology.orchestra.run.smithi163.stderr:set pool 4 allow_ec_overwrites to true 2023-07-14T18:11:13.837 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs add_data_pool cephfs cephfs_data_ec 2023-07-14T18:11:13.966 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:13.927+0000 7f3ad52f2700 1 -- 172.21.15.163:0/3006266284 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f3ad0100240 msgr2=0x7f3ad0100650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:11:13.966 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:13.927+0000 7f3ad52f2700 1 --2- 172.21.15.163:0/3006266284 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f3ad0100240 0x7f3ad0100650 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f3ac8009990 tx=0x7f3ac8009ca0 comp rx=0 tx=0).stop 2023-07-14T18:11:13.967 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:13.927+0000 7f3ad52f2700 1 -- 172.21.15.163:0/3006266284 shutdown_connections 2023-07-14T18:11:13.967 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:13.927+0000 7f3ad52f2700 1 --2- 172.21.15.163:0/3006266284 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3ad00ff7b0 0x7f3ad0107060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:13.967 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:13.927+0000 7f3ad52f2700 1 --2- 172.21.15.163:0/3006266284 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f3ad0100240 0x7f3ad0100650 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:13.967 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:13.927+0000 7f3ad52f2700 1 --2- 172.21.15.163:0/3006266284 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3ad00fee00 0x7f3ad00ff270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:13.967 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:13.927+0000 7f3ad52f2700 1 -- 172.21.15.163:0/3006266284 >> 172.21.15.163:0/3006266284 conn(0x7f3ad00f9980 msgr2=0x7f3ad00fbd90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:11:13.967 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:13.927+0000 7f3ad52f2700 1 -- 172.21.15.163:0/3006266284 shutdown_connections 2023-07-14T18:11:13.967 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:13.927+0000 7f3ad52f2700 1 -- 172.21.15.163:0/3006266284 wait complete. 2023-07-14T18:11:13.968 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:13.928+0000 7f3ad52f2700 1 Processor -- start 2023-07-14T18:11:13.968 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:13.928+0000 7f3ad52f2700 1 -- start start 2023-07-14T18:11:13.970 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:13.928+0000 7f3ad52f2700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f3ad00fee00 0x7f3ad0194760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:11:13.970 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:13.928+0000 7f3ad52f2700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3ad00ff7b0 0x7f3ad0194ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:11:13.970 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:13.928+0000 7f3ad52f2700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3ad0100240 0x7f3ad019bd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:11:13.970 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:13.928+0000 7f3ad52f2700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ad019c2e0 con 0x7f3ad00fee00 2023-07-14T18:11:13.970 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:13.928+0000 7f3ad52f2700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ad019c420 con 0x7f3ad0100240 2023-07-14T18:11:13.970 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:13.928+0000 7f3ad52f2700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ad019c5b0 con 0x7f3ad00ff7b0 2023-07-14T18:11:13.971 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:13.928+0000 7f3aceffd700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f3ad00fee00 0x7f3ad0194760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:11:13.971 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:13.928+0000 7f3aceffd700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f3ad00fee00 0x7f3ad0194760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:55782/0 (socket says 172.21.15.163:55782) 2023-07-14T18:11:13.971 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:13.928+0000 7f3aceffd700 1 -- 172.21.15.163:0/2277447606 learned_addr learned my addr 172.21.15.163:0/2277447606 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:11:13.971 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:13.928+0000 7f3ace7fc700 1 --2- 172.21.15.163:0/2277447606 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3ad00ff7b0 0x7f3ad0194ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:11:13.971 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:13.928+0000 7f3acf7fe700 1 --2- 172.21.15.163:0/2277447606 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3ad0100240 0x7f3ad019bd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:11:13.971 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:13.929+0000 7f3aceffd700 1 -- 172.21.15.163:0/2277447606 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3ad00ff7b0 msgr2=0x7f3ad0194ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:11:13.971 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:13.929+0000 7f3aceffd700 1 --2- 172.21.15.163:0/2277447606 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3ad00ff7b0 0x7f3ad0194ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:13.972 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:13.929+0000 7f3aceffd700 1 -- 172.21.15.163:0/2277447606 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3ad0100240 msgr2=0x7f3ad019bd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:11:13.972 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:13.929+0000 7f3aceffd700 1 --2- 172.21.15.163:0/2277447606 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3ad0100240 0x7f3ad019bd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:13.972 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:13.929+0000 7f3aceffd700 1 -- 172.21.15.163:0/2277447606 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ac80095f0 con 0x7f3ad00fee00 2023-07-14T18:11:13.972 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:13.929+0000 7f3acf7fe700 1 --2- 172.21.15.163:0/2277447606 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3ad0100240 0x7f3ad019bd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T18:11:13.972 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:13.929+0000 7f3aceffd700 1 --2- 172.21.15.163:0/2277447606 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f3ad00fee00 0x7f3ad0194760 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f3ac8000c00 tx=0x7f3ac8003a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:11:13.973 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:13.929+0000 7f3ac7fff700 1 -- 172.21.15.163:0/2277447606 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ac801d070 con 0x7f3ad00fee00 2023-07-14T18:11:13.973 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:13.929+0000 7f3ac7fff700 1 -- 172.21.15.163:0/2277447606 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f3ac800bd70 con 0x7f3ad00fee00 2023-07-14T18:11:13.973 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:13.929+0000 7f3ad52f2700 1 -- 172.21.15.163:0/2277447606 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ad019c830 con 0x7f3ad00fee00 2023-07-14T18:11:13.973 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:13.929+0000 7f3ac7fff700 1 -- 172.21.15.163:0/2277447606 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ac8022d20 con 0x7f3ad00fee00 2023-07-14T18:11:13.973 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:13.929+0000 7f3ad52f2700 1 -- 172.21.15.163:0/2277447606 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ad019cc50 con 0x7f3ad00fee00 2023-07-14T18:11:13.973 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:13.930+0000 7f3ad52f2700 1 -- 172.21.15.163:0/2277447606 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3ad0106200 con 0x7f3ad00fee00 2023-07-14T18:11:13.973 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:13.931+0000 7f3ac7fff700 1 -- 172.21.15.163:0/2277447606 <== mon.0 v2:172.21.15.163:3300/0 4 ==== mgrmap(e 16) v1 ==== 135716+0+0 (secure 0 0 0) 0x7f3ac8022470 con 0x7f3ad00fee00 2023-07-14T18:11:13.974 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:13.931+0000 7f3ac7fff700 1 --2- 172.21.15.163:0/2277447606 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f3abc0a1150 0x7f3abc0a3600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:11:13.974 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:13.932+0000 7f3ac7fff700 1 -- 172.21.15.163:0/2277447606 <== mon.0 v2:172.21.15.163:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 8698+0+0 (secure 0 0 0) 0x7f3ac80ce8c0 con 0x7f3ad00fee00 2023-07-14T18:11:13.974 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:13.932+0000 7f3ace7fc700 1 --2- 172.21.15.163:0/2277447606 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f3abc0a1150 0x7f3abc0a3600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:11:13.975 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:13.932+0000 7f3ace7fc700 1 --2- 172.21.15.163:0/2277447606 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f3abc0a1150 0x7f3abc0a3600 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f3ab800ac50 tx=0x7f3ab800a380 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:11:13.975 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:13.935+0000 7f3ac7fff700 1 -- 172.21.15.163:0/2277447606 <== mon.0 v2:172.21.15.163:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178025 (secure 0 0 0) 0x7f3ac8097e70 con 0x7f3ad00fee00 2023-07-14T18:11:14.173 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:11:13 smithi184 ceph-mon[98481]: from='client.? 172.21.15.163:0/2005120817' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2023-07-14T18:11:14.174 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:11:13 smithi184 ceph-mon[98481]: osdmap e82: 12 total, 12 up, 12 in 2023-07-14T18:11:14.174 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:11:13 smithi184 ceph-mon[98481]: from='client.? 172.21.15.163:0/929878932' entity='client.admin' cmd=[{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]: dispatch 2023-07-14T18:11:14.174 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:11:13 smithi184 ceph-mon[98481]: from='client.? 172.21.15.163:0/929878932' entity='client.admin' cmd='[{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]': finished 2023-07-14T18:11:14.174 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:11:13 smithi184 ceph-mon[98481]: osdmap e83: 12 total, 12 up, 12 in 2023-07-14T18:11:14.208 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:14.169+0000 7f3ad52f2700 1 -- 172.21.15.163:0/2277447606 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"} v 0) v1 -- 0x7f3ad002c8e0 con 0x7f3ad00fee00 2023-07-14T18:11:14.216 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:11:13 smithi163 ceph-mon[96576]: from='client.? 172.21.15.163:0/2005120817' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2023-07-14T18:11:14.216 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:11:13 smithi163 ceph-mon[96576]: osdmap e82: 12 total, 12 up, 12 in 2023-07-14T18:11:14.216 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:11:13 smithi163 ceph-mon[96576]: from='client.? 172.21.15.163:0/929878932' entity='client.admin' cmd=[{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]: dispatch 2023-07-14T18:11:14.216 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:11:13 smithi163 ceph-mon[96576]: from='client.? 172.21.15.163:0/929878932' entity='client.admin' cmd='[{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]': finished 2023-07-14T18:11:14.216 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:11:13 smithi163 ceph-mon[96576]: osdmap e83: 12 total, 12 up, 12 in 2023-07-14T18:11:14.274 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:11:13 smithi172 ceph-mon[97983]: from='client.? 172.21.15.163:0/2005120817' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2023-07-14T18:11:14.274 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:11:13 smithi172 ceph-mon[97983]: osdmap e82: 12 total, 12 up, 12 in 2023-07-14T18:11:14.275 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:11:13 smithi172 ceph-mon[97983]: from='client.? 172.21.15.163:0/929878932' entity='client.admin' cmd=[{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]: dispatch 2023-07-14T18:11:14.275 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:11:13 smithi172 ceph-mon[97983]: from='client.? 172.21.15.163:0/929878932' entity='client.admin' cmd='[{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]': finished 2023-07-14T18:11:14.275 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:11:13 smithi172 ceph-mon[97983]: osdmap e83: 12 total, 12 up, 12 in 2023-07-14T18:11:14.774 INFO:journalctl@ceph.mds.b.smithi172.stdout:Jul 14 18:11:14 smithi172 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-mds-b[123259]: 2023-07-14T18:11:14.482+0000 7f9c11ca2700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-07-14T18:11:14.831 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:14.792+0000 7f3ac7fff700 1 -- 172.21.15.163:0/2277447606 <== mon.0 v2:172.21.15.163:3300/0 7 ==== mon_command_ack([{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]=0 added data pool 4 to fsmap v17) v1 ==== 137+0+0 (secure 0 0 0) 0x7f3ac809b490 con 0x7f3ad00fee00 2023-07-14T18:11:14.834 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:14.795+0000 7f3ad52f2700 1 -- 172.21.15.163:0/2277447606 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f3abc0a1150 msgr2=0x7f3abc0a3600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:11:14.834 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:14.795+0000 7f3ad52f2700 1 --2- 172.21.15.163:0/2277447606 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f3abc0a1150 0x7f3abc0a3600 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f3ab800ac50 tx=0x7f3ab800a380 comp rx=0 tx=0).stop 2023-07-14T18:11:14.835 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:14.795+0000 7f3ad52f2700 1 -- 172.21.15.163:0/2277447606 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f3ad00fee00 msgr2=0x7f3ad0194760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:11:14.835 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:14.795+0000 7f3ad52f2700 1 --2- 172.21.15.163:0/2277447606 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f3ad00fee00 0x7f3ad0194760 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f3ac8000c00 tx=0x7f3ac8003a50 comp rx=0 tx=0).stop 2023-07-14T18:11:14.835 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:14.796+0000 7f3ad52f2700 1 -- 172.21.15.163:0/2277447606 shutdown_connections 2023-07-14T18:11:14.835 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:14.796+0000 7f3ad52f2700 1 --2- 172.21.15.163:0/2277447606 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f3abc0a1150 0x7f3abc0a3600 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:14.835 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:14.796+0000 7f3ad52f2700 1 --2- 172.21.15.163:0/2277447606 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3ad0100240 0x7f3ad019bd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:14.835 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:14.796+0000 7f3ad52f2700 1 --2- 172.21.15.163:0/2277447606 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f3ad00fee00 0x7f3ad0194760 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:14.835 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:14.796+0000 7f3ad52f2700 1 --2- 172.21.15.163:0/2277447606 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3ad00ff7b0 0x7f3ad0194ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:14.836 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:14.796+0000 7f3ad52f2700 1 -- 172.21.15.163:0/2277447606 >> 172.21.15.163:0/2277447606 conn(0x7f3ad00f9980 msgr2=0x7f3ad0103340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:11:14.836 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:14.796+0000 7f3ad52f2700 1 -- 172.21.15.163:0/2277447606 shutdown_connections 2023-07-14T18:11:14.836 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:14.796+0000 7f3ad52f2700 1 -- 172.21.15.163:0/2277447606 wait complete. 2023-07-14T18:11:14.836 INFO:teuthology.orchestra.run.smithi163.stderr:added data pool 4 to fsmap 2023-07-14T18:11:14.849 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-14T18:11:14.978 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:14.939+0000 7f7d88b35700 1 -- 172.21.15.163:0/3294683590 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f7d84100120 msgr2=0x7f7d84100530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:11:14.979 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:14.939+0000 7f7d88b35700 1 --2- 172.21.15.163:0/3294683590 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f7d84100120 0x7f7d84100530 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f7d74009990 tx=0x7f7d74009ca0 comp rx=0 tx=0).stop 2023-07-14T18:11:14.979 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:14.940+0000 7f7d88b35700 1 -- 172.21.15.163:0/3294683590 shutdown_connections 2023-07-14T18:11:14.979 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:14.940+0000 7f7d88b35700 1 --2- 172.21.15.163:0/3294683590 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7d840ff720 0x7f7d84106fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:14.979 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:14.940+0000 7f7d88b35700 1 --2- 172.21.15.163:0/3294683590 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f7d84100120 0x7f7d84100530 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:14.979 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:14.940+0000 7f7d88b35700 1 --2- 172.21.15.163:0/3294683590 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7d840fed70 0x7f7d840ff1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:14.979 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:14.940+0000 7f7d88b35700 1 -- 172.21.15.163:0/3294683590 >> 172.21.15.163:0/3294683590 conn(0x7f7d840f98d0 msgr2=0x7f7d840fbd20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:11:14.979 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:14.940+0000 7f7d88b35700 1 -- 172.21.15.163:0/3294683590 shutdown_connections 2023-07-14T18:11:14.980 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:14.940+0000 7f7d88b35700 1 -- 172.21.15.163:0/3294683590 wait complete. 2023-07-14T18:11:14.981 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:14.940+0000 7f7d88b35700 1 Processor -- start 2023-07-14T18:11:14.981 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:14.940+0000 7f7d88b35700 1 -- start start 2023-07-14T18:11:14.982 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:14.941+0000 7f7d88b35700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7d840fed70 0x7f7d84195880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:11:14.982 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:14.941+0000 7f7d88b35700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f7d840ff720 0x7f7d84195dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:11:14.982 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:14.941+0000 7f7d88b35700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7d84100120 0x7f7d8419ce30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:11:14.982 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:14.941+0000 7f7d88b35700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d8419d400 con 0x7f7d840ff720 2023-07-14T18:11:14.982 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:14.941+0000 7f7d88b35700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d8419d540 con 0x7f7d840fed70 2023-07-14T18:11:14.982 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:14.941+0000 7f7d88b35700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d8419d6d0 con 0x7f7d84100120 2023-07-14T18:11:14.982 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:14.941+0000 7f7d81d9b700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f7d840ff720 0x7f7d84195dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:11:14.983 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:14.941+0000 7f7d81d9b700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f7d840ff720 0x7f7d84195dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:55796/0 (socket says 172.21.15.163:55796) 2023-07-14T18:11:14.983 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:14.941+0000 7f7d81d9b700 1 -- 172.21.15.163:0/3237967637 learned_addr learned my addr 172.21.15.163:0/3237967637 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:11:14.983 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:14.941+0000 7f7d8259c700 1 --2- 172.21.15.163:0/3237967637 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7d840fed70 0x7f7d84195880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:11:14.983 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:14.941+0000 7f7d82d9d700 1 --2- 172.21.15.163:0/3237967637 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7d84100120 0x7f7d8419ce30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:11:14.983 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:14.941+0000 7f7d81d9b700 1 -- 172.21.15.163:0/3237967637 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7d84100120 msgr2=0x7f7d8419ce30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:11:14.983 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:14.941+0000 7f7d81d9b700 1 --2- 172.21.15.163:0/3237967637 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7d84100120 0x7f7d8419ce30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:14.983 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:14.941+0000 7f7d81d9b700 1 -- 172.21.15.163:0/3237967637 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7d840fed70 msgr2=0x7f7d84195880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:11:14.983 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:14.941+0000 7f7d81d9b700 1 --2- 172.21.15.163:0/3237967637 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7d840fed70 0x7f7d84195880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:14.984 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:14.941+0000 7f7d81d9b700 1 -- 172.21.15.163:0/3237967637 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d740095f0 con 0x7f7d840ff720 2023-07-14T18:11:14.984 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:14.941+0000 7f7d82d9d700 1 --2- 172.21.15.163:0/3237967637 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7d84100120 0x7f7d8419ce30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T18:11:14.984 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:14.941+0000 7f7d81d9b700 1 --2- 172.21.15.163:0/3237967637 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f7d840ff720 0x7f7d84195dc0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f7d7800d980 tx=0x7f7d7800dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:11:14.984 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:14.941+0000 7f7d737fe700 1 -- 172.21.15.163:0/3237967637 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d78004020 con 0x7f7d840ff720 2023-07-14T18:11:14.984 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:14.941+0000 7f7d737fe700 1 -- 172.21.15.163:0/3237967637 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f7d78009730 con 0x7f7d840ff720 2023-07-14T18:11:14.984 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:14.941+0000 7f7d88b35700 1 -- 172.21.15.163:0/3237967637 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7d8419d9b0 con 0x7f7d840ff720 2023-07-14T18:11:14.985 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:14.941+0000 7f7d737fe700 1 -- 172.21.15.163:0/3237967637 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d78003a00 con 0x7f7d840ff720 2023-07-14T18:11:14.985 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:14.941+0000 7f7d88b35700 1 -- 172.21.15.163:0/3237967637 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d8419df10 con 0x7f7d840ff720 2023-07-14T18:11:14.985 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:14.942+0000 7f7d88b35700 1 -- 172.21.15.163:0/3237967637 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7d8410a230 con 0x7f7d840ff720 2023-07-14T18:11:14.985 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:14.943+0000 7f7d737fe700 1 -- 172.21.15.163:0/3237967637 <== mon.0 v2:172.21.15.163:3300/0 4 ==== mgrmap(e 16) v1 ==== 135716+0+0 (secure 0 0 0) 0x7f7d780098a0 con 0x7f7d840ff720 2023-07-14T18:11:14.986 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:14.944+0000 7f7d737fe700 1 --2- 172.21.15.163:0/3237967637 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f7d6c0a1220 0x7f7d6c0a36d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:11:14.986 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:14.944+0000 7f7d737fe700 1 -- 172.21.15.163:0/3237967637 <== mon.0 v2:172.21.15.163:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 8730+0+0 (secure 0 0 0) 0x7f7d780ccaa0 con 0x7f7d840ff720 2023-07-14T18:11:14.986 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:14.944+0000 7f7d8259c700 1 --2- 172.21.15.163:0/3237967637 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f7d6c0a1220 0x7f7d6c0a36d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:11:14.986 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:14.944+0000 7f7d8259c700 1 --2- 172.21.15.163:0/3237967637 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f7d6c0a1220 0x7f7d6c0a36d0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f7d74000c00 tx=0x7f7d7400b560 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:11:14.986 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:14.948+0000 7f7d737fe700 1 -- 172.21.15.163:0/3237967637 <== mon.0 v2:172.21.15.163:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178025 (secure 0 0 0) 0x7f7d78096080 con 0x7f7d840ff720 2023-07-14T18:11:15.173 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:11:14 smithi184 ceph-mon[98481]: pgmap v251: 129 pgs: 10 creating+peering, 76 active+clean, 43 unknown; 579 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s wr, 10 op/s 2023-07-14T18:11:15.173 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:11:14 smithi184 ceph-mon[98481]: from='client.? 172.21.15.163:0/2277447606' entity='client.admin' cmd=[{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]: dispatch 2023-07-14T18:11:15.215 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:15.177+0000 7f7d88b35700 1 -- 172.21.15.163:0/3237967637 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7d8410a420 con 0x7f7d840ff720 2023-07-14T18:11:15.216 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:11:14 smithi163 ceph-mon[96576]: pgmap v251: 129 pgs: 10 creating+peering, 76 active+clean, 43 unknown; 579 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s wr, 10 op/s 2023-07-14T18:11:15.216 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:11:14 smithi163 ceph-mon[96576]: from='client.? 172.21.15.163:0/2277447606' entity='client.admin' cmd=[{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]: dispatch 2023-07-14T18:11:15.217 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:15.178+0000 7f7d737fe700 1 -- 172.21.15.163:0/3237967637 <== mon.0 v2:172.21.15.163:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+10790 (secure 0 0 0) 0x7f7d78017090 con 0x7f7d840ff720 2023-07-14T18:11:15.217 INFO:teuthology.orchestra.run.smithi163.stdout: 2023-07-14T18:11:15.217 INFO:teuthology.orchestra.run.smithi163.stdout:{"epoch":17,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14562,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.163:6835/1058662632","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6834","nonce":1058662632},{"type":"v1","addr":"172.21.15.163:6835","nonce":1058662632}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":14568,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.163:6837/1107244425","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6836","nonce":1107244425},{"type":"v1","addr":"172.21.15.163:6837","nonce":1107244425}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5},{"gid":14640,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.163:6839/1337572937","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6838","nonce":1337572937},{"type":"v1","addr":"172.21.15.163:6839","nonce":1337572937}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":14652,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.163:6841/1032082642","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6840","nonce":1032082642},{"type":"v1","addr":"172.21.15.163:6841","nonce":1032082642}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":24421,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6833/797722972","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6832","nonce":797722972},{"type":"v1","addr":"172.21.15.184:6833","nonce":797722972}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":24431,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6833/1075696311","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":1075696311},{"type":"v1","addr":"172.21.15.172:6833","nonce":1075696311}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":24458,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6835/1158120127","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":1158120127},{"type":"v1","addr":"172.21.15.172:6835","nonce":1158120127}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":6},{"gid":24466,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6835/460134263","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6834","nonce":460134263},{"type":"v1","addr":"172.21.15.184:6835","nonce":460134263}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":7},{"gid":24478,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6837/3389277679","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6836","nonce":3389277679},{"type":"v1","addr":"172.21.15.184:6837","nonce":3389277679}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":8},{"gid":24479,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6837/3783835012","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":3783835012},{"type":"v1","addr":"172.21.15.172:6837","nonce":3783835012}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":9},{"gid":24493,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6839/2819059257","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6838","nonce":2819059257},{"type":"v1","addr":"172.21.15.184:6839","nonce":2819059257}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-14T18:11:09.109693+0000","modified":"2023-07-14T18:11:14.786969+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":24518},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24518":{"gid":24518,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.172:6839/3850440096","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6838","nonce":3850440096},{"type":"v1","addr":"172.21.15.172:6839","nonce":3850440096}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2023-07-14T18:11:15.218 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:15.180+0000 7f7d88b35700 1 -- 172.21.15.163:0/3237967637 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f7d6c0a1220 msgr2=0x7f7d6c0a36d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:11:15.219 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:15.180+0000 7f7d88b35700 1 --2- 172.21.15.163:0/3237967637 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f7d6c0a1220 0x7f7d6c0a36d0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f7d74000c00 tx=0x7f7d7400b560 comp rx=0 tx=0).stop 2023-07-14T18:11:15.219 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:15.180+0000 7f7d88b35700 1 -- 172.21.15.163:0/3237967637 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f7d840ff720 msgr2=0x7f7d84195dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:11:15.219 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:15.180+0000 7f7d88b35700 1 --2- 172.21.15.163:0/3237967637 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f7d840ff720 0x7f7d84195dc0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f7d7800d980 tx=0x7f7d7800dc90 comp rx=0 tx=0).stop 2023-07-14T18:11:15.219 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:15.180+0000 7f7d88b35700 1 -- 172.21.15.163:0/3237967637 shutdown_connections 2023-07-14T18:11:15.219 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:15.180+0000 7f7d88b35700 1 --2- 172.21.15.163:0/3237967637 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f7d6c0a1220 0x7f7d6c0a36d0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:15.219 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:15.180+0000 7f7d88b35700 1 --2- 172.21.15.163:0/3237967637 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7d84100120 0x7f7d8419ce30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:15.219 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:15.180+0000 7f7d88b35700 1 --2- 172.21.15.163:0/3237967637 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7d840fed70 0x7f7d84195880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:15.220 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:15.180+0000 7f7d88b35700 1 --2- 172.21.15.163:0/3237967637 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f7d840ff720 0x7f7d84195dc0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:15.220 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:15.180+0000 7f7d88b35700 1 -- 172.21.15.163:0/3237967637 >> 172.21.15.163:0/3237967637 conn(0x7f7d840f98d0 msgr2=0x7f7d840fdcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:11:15.220 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:15.180+0000 7f7d88b35700 1 -- 172.21.15.163:0/3237967637 shutdown_connections 2023-07-14T18:11:15.220 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:15.180+0000 7f7d88b35700 1 -- 172.21.15.163:0/3237967637 wait complete. 2023-07-14T18:11:15.220 INFO:teuthology.orchestra.run.smithi163.stderr:dumped fsmap epoch 17 2023-07-14T18:11:15.231 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-14T18:11:15.274 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:11:14 smithi172 ceph-mon[97983]: pgmap v251: 129 pgs: 10 creating+peering, 76 active+clean, 43 unknown; 579 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s wr, 10 op/s 2023-07-14T18:11:15.274 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:11:14 smithi172 ceph-mon[97983]: from='client.? 172.21.15.163:0/2277447606' entity='client.admin' cmd=[{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]: dispatch 2023-07-14T18:11:15.353 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:15.315+0000 7f6ff5cf3700 1 -- 172.21.15.163:0/949056520 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f6ff01006e0 msgr2=0x7f6ff0102ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:11:15.354 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:15.315+0000 7f6ff5cf3700 1 --2- 172.21.15.163:0/949056520 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f6ff01006e0 0x7f6ff0102ac0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f6fe0009990 tx=0x7f6fe0009ca0 comp rx=0 tx=0).stop 2023-07-14T18:11:15.354 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:15.315+0000 7f6ff5cf3700 1 -- 172.21.15.163:0/949056520 shutdown_connections 2023-07-14T18:11:15.354 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:15.315+0000 7f6ff5cf3700 1 --2- 172.21.15.163:0/949056520 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6ff0105920 0x7f6ff0107d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:15.354 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:15.315+0000 7f6ff5cf3700 1 --2- 172.21.15.163:0/949056520 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f6ff01006e0 0x7f6ff0102ac0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:15.354 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:15.315+0000 7f6ff5cf3700 1 --2- 172.21.15.163:0/949056520 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6ff0103000 0x7f6ff01053e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:15.354 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:15.315+0000 7f6ff5cf3700 1 -- 172.21.15.163:0/949056520 >> 172.21.15.163:0/949056520 conn(0x7f6ff00fa100 msgr2=0x7f6ff00fc550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:11:15.355 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:15.315+0000 7f6ff5cf3700 1 -- 172.21.15.163:0/949056520 shutdown_connections 2023-07-14T18:11:15.355 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:15.315+0000 7f6ff5cf3700 1 -- 172.21.15.163:0/949056520 wait complete. 2023-07-14T18:11:15.356 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:15.315+0000 7f6ff5cf3700 1 Processor -- start 2023-07-14T18:11:15.357 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:15.316+0000 7f6ff5cf3700 1 -- start start 2023-07-14T18:11:15.357 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:15.316+0000 7f6ff5cf3700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6ff01006e0 0x7f6ff01957e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:11:15.357 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:15.316+0000 7f6ff5cf3700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6ff0103000 0x7f6ff0195d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:11:15.357 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:15.316+0000 7f6ff5cf3700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f6ff0105920 0x7f6ff019cd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:11:15.357 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:15.316+0000 7f6ff5cf3700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ff019d360 con 0x7f6ff0105920 2023-07-14T18:11:15.357 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:15.316+0000 7f6ff5cf3700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ff019d4a0 con 0x7f6ff01006e0 2023-07-14T18:11:15.358 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:15.316+0000 7f6ff5cf3700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ff019d630 con 0x7f6ff0103000 2023-07-14T18:11:15.358 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:15.316+0000 7f6feffff700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f6ff0105920 0x7f6ff019cd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:11:15.358 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:15.316+0000 7f6feffff700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f6ff0105920 0x7f6ff019cd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:55812/0 (socket says 172.21.15.163:55812) 2023-07-14T18:11:15.358 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:15.316+0000 7f6feffff700 1 -- 172.21.15.163:0/1617114917 learned_addr learned my addr 172.21.15.163:0/1617114917 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:11:15.358 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:15.316+0000 7f6feeffd700 1 --2- 172.21.15.163:0/1617114917 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6ff0103000 0x7f6ff0195d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:11:15.358 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:15.316+0000 7f6fef7fe700 1 --2- 172.21.15.163:0/1617114917 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6ff01006e0 0x7f6ff01957e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:11:15.358 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:15.316+0000 7f6feffff700 1 -- 172.21.15.163:0/1617114917 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6ff0103000 msgr2=0x7f6ff0195d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:11:15.358 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:15.316+0000 7f6feffff700 1 --2- 172.21.15.163:0/1617114917 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6ff0103000 0x7f6ff0195d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:15.359 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:15.316+0000 7f6feffff700 1 -- 172.21.15.163:0/1617114917 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6ff01006e0 msgr2=0x7f6ff01957e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:11:15.359 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:15.316+0000 7f6feffff700 1 --2- 172.21.15.163:0/1617114917 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6ff01006e0 0x7f6ff01957e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:15.359 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:15.316+0000 7f6feffff700 1 -- 172.21.15.163:0/1617114917 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6fe00095f0 con 0x7f6ff0105920 2023-07-14T18:11:15.359 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:15.316+0000 7f6feffff700 1 --2- 172.21.15.163:0/1617114917 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f6ff0105920 0x7f6ff019cd90 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f6fe8007ee0 tx=0x7f6fe800d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:11:15.359 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:15.317+0000 7f6fecff9700 1 -- 172.21.15.163:0/1617114917 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fe8017070 con 0x7f6ff0105920 2023-07-14T18:11:15.359 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:15.317+0000 7f6ff5cf3700 1 -- 172.21.15.163:0/1617114917 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ff019d910 con 0x7f6ff0105920 2023-07-14T18:11:15.359 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:15.317+0000 7f6fecff9700 1 -- 172.21.15.163:0/1617114917 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f6fe800f040 con 0x7f6ff0105920 2023-07-14T18:11:15.359 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:15.317+0000 7f6fecff9700 1 -- 172.21.15.163:0/1617114917 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fe8005570 con 0x7f6ff0105920 2023-07-14T18:11:15.360 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:15.317+0000 7f6ff5cf3700 1 -- 172.21.15.163:0/1617114917 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ff019ddd0 con 0x7f6ff0105920 2023-07-14T18:11:15.360 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:15.318+0000 7f6ff5cf3700 1 -- 172.21.15.163:0/1617114917 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ff00fbc70 con 0x7f6ff0105920 2023-07-14T18:11:15.360 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:15.319+0000 7f6fecff9700 1 -- 172.21.15.163:0/1617114917 <== mon.0 v2:172.21.15.163:3300/0 4 ==== mgrmap(e 16) v1 ==== 135716+0+0 (secure 0 0 0) 0x7f6fe800db20 con 0x7f6ff0105920 2023-07-14T18:11:15.361 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:15.319+0000 7f6fecff9700 1 --2- 172.21.15.163:0/1617114917 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f6fdc0a11a0 0x7f6fdc0a3650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:11:15.361 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:15.319+0000 7f6fecff9700 1 -- 172.21.15.163:0/1617114917 <== mon.0 v2:172.21.15.163:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 8730+0+0 (secure 0 0 0) 0x7f6fe80cc8d0 con 0x7f6ff0105920 2023-07-14T18:11:15.361 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:15.319+0000 7f6fef7fe700 1 --2- 172.21.15.163:0/1617114917 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f6fdc0a11a0 0x7f6fdc0a3650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:11:15.361 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:15.320+0000 7f6fef7fe700 1 --2- 172.21.15.163:0/1617114917 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f6fdc0a11a0 0x7f6fdc0a3650 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f6fe0006010 tx=0x7f6fe0005960 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:11:15.361 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:15.323+0000 7f6fecff9700 1 -- 172.21.15.163:0/1617114917 <== mon.0 v2:172.21.15.163:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178025 (secure 0 0 0) 0x7f6fe8095e30 con 0x7f6ff0105920 2023-07-14T18:11:15.560 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:15.521+0000 7f6ff5cf3700 1 -- 172.21.15.163:0/1617114917 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6ff002c8e0 con 0x7f6ff0105920 2023-07-14T18:11:15.561 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:15.523+0000 7f6fecff9700 1 -- 172.21.15.163:0/1617114917 <== mon.0 v2:172.21.15.163:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v84) v1 ==== 74+0+24030 (secure 0 0 0) 0x7f6fe8099450 con 0x7f6ff0105920 2023-07-14T18:11:15.561 INFO:teuthology.orchestra.run.smithi163.stdout: 2023-07-14T18:11:15.562 INFO:teuthology.orchestra.run.smithi163.stdout:{"epoch":84,"fsid":"bf7326ec-2270-11ee-9b33-001a4aab830c","created":"2023-07-14T18:04:26.263517+0000","modified":"2023-07-14T18:11:14.170253+0000","last_up_change":"2023-07-14T18:10:27.514863+0000","last_in_change":"2023-07-14T18:10:10.726443+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-14T18:07:19.653852+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-07-14T18:11:07.314989+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-07-14T18:11:08.274627+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-07-14T18:11:11.991162+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"e6490568-046d-43ef-bb07-d79fb884b276","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6802","nonce":3124653025},{"type":"v1","addr":"172.21.15.163:6803","nonce":3124653025}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6804","nonce":3124653025},{"type":"v1","addr":"172.21.15.163:6805","nonce":3124653025}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6808","nonce":3124653025},{"type":"v1","addr":"172.21.15.163:6809","nonce":3124653025}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6806","nonce":3124653025},{"type":"v1","addr":"172.21.15.163:6807","nonce":3124653025}]},"public_addr":"172.21.15.163:6803/3124653025","cluster_addr":"172.21.15.163:6805/3124653025","heartbeat_back_addr":"172.21.15.163:6809/3124653025","heartbeat_front_addr":"172.21.15.163:6807/3124653025","state":["exists","up"]},{"osd":1,"uuid":"0af39bda-f096-4603-adcc-bf1988f36603","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":3774455900},{"type":"v1","addr":"172.21.15.172:6801","nonce":3774455900}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":3774455900},{"type":"v1","addr":"172.21.15.172:6803","nonce":3774455900}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":3774455900},{"type":"v1","addr":"172.21.15.172:6807","nonce":3774455900}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":3774455900},{"type":"v1","addr":"172.21.15.172:6805","nonce":3774455900}]},"public_addr":"172.21.15.172:6801/3774455900","cluster_addr":"172.21.15.172:6803/3774455900","heartbeat_back_addr":"172.21.15.172:6807/3774455900","heartbeat_front_addr":"172.21.15.172:6805/3774455900","state":["exists","up"]},{"osd":2,"uuid":"cc732c13-af0f-4199-98e6-fe960ed4e5dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":1976927678},{"type":"v1","addr":"172.21.15.184:6801","nonce":1976927678}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":1976927678},{"type":"v1","addr":"172.21.15.184:6803","nonce":1976927678}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":1976927678},{"type":"v1","addr":"172.21.15.184:6807","nonce":1976927678}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":1976927678},{"type":"v1","addr":"172.21.15.184:6805","nonce":1976927678}]},"public_addr":"172.21.15.184:6801/1976927678","cluster_addr":"172.21.15.184:6803/1976927678","heartbeat_back_addr":"172.21.15.184:6807/1976927678","heartbeat_front_addr":"172.21.15.184:6805/1976927678","state":["exists","up"]},{"osd":3,"uuid":"dcee9576-0bc6-4ab0-8f63-79eacd0eca5f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6810","nonce":2589130694},{"type":"v1","addr":"172.21.15.163:6811","nonce":2589130694}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6812","nonce":2589130694},{"type":"v1","addr":"172.21.15.163:6813","nonce":2589130694}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6816","nonce":2589130694},{"type":"v1","addr":"172.21.15.163:6817","nonce":2589130694}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6814","nonce":2589130694},{"type":"v1","addr":"172.21.15.163:6815","nonce":2589130694}]},"public_addr":"172.21.15.163:6811/2589130694","cluster_addr":"172.21.15.163:6813/2589130694","heartbeat_back_addr":"172.21.15.163:6817/2589130694","heartbeat_front_addr":"172.21.15.163:6815/2589130694","state":["exists","up"]},{"osd":4,"uuid":"055df823-b8b0-426a-83c2-f0d727932ad8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":3319632614},{"type":"v1","addr":"172.21.15.172:6809","nonce":3319632614}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6810","nonce":3319632614},{"type":"v1","addr":"172.21.15.172:6811","nonce":3319632614}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6814","nonce":3319632614},{"type":"v1","addr":"172.21.15.172:6815","nonce":3319632614}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":3319632614},{"type":"v1","addr":"172.21.15.172:6813","nonce":3319632614}]},"public_addr":"172.21.15.172:6809/3319632614","cluster_addr":"172.21.15.172:6811/3319632614","heartbeat_back_addr":"172.21.15.172:6815/3319632614","heartbeat_front_addr":"172.21.15.172:6813/3319632614","state":["exists","up"]},{"osd":5,"uuid":"ef5ef02a-b4e2-4790-9d27-f6d2247b25c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":2662084043},{"type":"v1","addr":"172.21.15.184:6809","nonce":2662084043}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6810","nonce":2662084043},{"type":"v1","addr":"172.21.15.184:6811","nonce":2662084043}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6814","nonce":2662084043},{"type":"v1","addr":"172.21.15.184:6815","nonce":2662084043}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6812","nonce":2662084043},{"type":"v1","addr":"172.21.15.184:6813","nonce":2662084043}]},"public_addr":"172.21.15.184:6809/2662084043","cluster_addr":"172.21.15.184:6811/2662084043","heartbeat_back_addr":"172.21.15.184:6815/2662084043","heartbeat_front_addr":"172.21.15.184:6813/2662084043","state":["exists","up"]},{"osd":6,"uuid":"dba754be-0fc5-4867-a6d5-cf97eb344f81","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":44,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6818","nonce":2530874117},{"type":"v1","addr":"172.21.15.163:6819","nonce":2530874117}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6820","nonce":2530874117},{"type":"v1","addr":"172.21.15.163:6821","nonce":2530874117}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6824","nonce":2530874117},{"type":"v1","addr":"172.21.15.163:6825","nonce":2530874117}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6822","nonce":2530874117},{"type":"v1","addr":"172.21.15.163:6823","nonce":2530874117}]},"public_addr":"172.21.15.163:6819/2530874117","cluster_addr":"172.21.15.163:6821/2530874117","heartbeat_back_addr":"172.21.15.163:6825/2530874117","heartbeat_front_addr":"172.21.15.163:6823/2530874117","state":["exists","up"]},{"osd":7,"uuid":"edd76e6b-6077-4619-b00d-1e906f70ddcc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":49,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":233511803},{"type":"v1","addr":"172.21.15.172:6817","nonce":233511803}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6818","nonce":233511803},{"type":"v1","addr":"172.21.15.172:6819","nonce":233511803}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":233511803},{"type":"v1","addr":"172.21.15.172:6823","nonce":233511803}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6820","nonce":233511803},{"type":"v1","addr":"172.21.15.172:6821","nonce":233511803}]},"public_addr":"172.21.15.172:6817/233511803","cluster_addr":"172.21.15.172:6819/233511803","heartbeat_back_addr":"172.21.15.172:6823/233511803","heartbeat_front_addr":"172.21.15.172:6821/233511803","state":["exists","up"]},{"osd":8,"uuid":"36559400-f33e-44e6-868a-316d34da457d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":56,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6816","nonce":290154343},{"type":"v1","addr":"172.21.15.184:6817","nonce":290154343}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6818","nonce":290154343},{"type":"v1","addr":"172.21.15.184:6819","nonce":290154343}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6822","nonce":290154343},{"type":"v1","addr":"172.21.15.184:6823","nonce":290154343}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6820","nonce":290154343},{"type":"v1","addr":"172.21.15.184:6821","nonce":290154343}]},"public_addr":"172.21.15.184:6817/290154343","cluster_addr":"172.21.15.184:6819/290154343","heartbeat_back_addr":"172.21.15.184:6823/290154343","heartbeat_front_addr":"172.21.15.184:6821/290154343","state":["exists","up"]},{"osd":9,"uuid":"d484f111-f36c-4c67-9a8a-ae03e7e0d137","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6826","nonce":3848110906},{"type":"v1","addr":"172.21.15.163:6827","nonce":3848110906}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6828","nonce":3848110906},{"type":"v1","addr":"172.21.15.163:6829","nonce":3848110906}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6832","nonce":3848110906},{"type":"v1","addr":"172.21.15.163:6833","nonce":3848110906}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6830","nonce":3848110906},{"type":"v1","addr":"172.21.15.163:6831","nonce":3848110906}]},"public_addr":"172.21.15.163:6827/3848110906","cluster_addr":"172.21.15.163:6829/3848110906","heartbeat_back_addr":"172.21.15.163:6833/3848110906","heartbeat_front_addr":"172.21.15.163:6831/3848110906","state":["exists","up"]},{"osd":10,"uuid":"d943f7c0-da3d-4605-9e23-0231e675c6be","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6824","nonce":3281085356},{"type":"v1","addr":"172.21.15.172:6825","nonce":3281085356}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":3281085356},{"type":"v1","addr":"172.21.15.172:6827","nonce":3281085356}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":3281085356},{"type":"v1","addr":"172.21.15.172:6831","nonce":3281085356}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6828","nonce":3281085356},{"type":"v1","addr":"172.21.15.172:6829","nonce":3281085356}]},"public_addr":"172.21.15.172:6825/3281085356","cluster_addr":"172.21.15.172:6827/3281085356","heartbeat_back_addr":"172.21.15.172:6831/3281085356","heartbeat_front_addr":"172.21.15.172:6829/3281085356","state":["exists","up"]},{"osd":11,"uuid":"09e610a8-408a-4119-a21b-c4de2810a538","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":75,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6824","nonce":3614578747},{"type":"v1","addr":"172.21.15.184:6825","nonce":3614578747}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6826","nonce":3614578747},{"type":"v1","addr":"172.21.15.184:6827","nonce":3614578747}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6830","nonce":3614578747},{"type":"v1","addr":"172.21.15.184:6831","nonce":3614578747}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6828","nonce":3614578747},{"type":"v1","addr":"172.21.15.184:6829","nonce":3614578747}]},"public_addr":"172.21.15.184:6825/3614578747","cluster_addr":"172.21.15.184:6827/3614578747","heartbeat_back_addr":"172.21.15.184:6831/3614578747","heartbeat_front_addr":"172.21.15.184:6829/3614578747","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T18:06:36.067578+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T18:06:57.095120+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T18:07:17.825363+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T18:07:38.977196+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T18:08:00.108709+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T18:08:20.700646+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T18:08:41.473899+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T18:09:02.856536+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T18:09:23.832722+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T18:09:44.860884+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T18:10:05.520678+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T18:10:26.426315+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.163:6801/1086512093":"2023-07-15T18:05:15.331458+0000","172.21.15.163:6800/1086512093":"2023-07-15T18:05:15.331458+0000","172.21.15.163:0/4235784810":"2023-07-15T18:05:15.331458+0000","172.21.15.163:6800/236891232":"2023-07-15T18:04:53.288443+0000","172.21.15.163:6801/236891232":"2023-07-15T18:04:53.288443+0000","172.21.15.163:0/3260193612":"2023-07-15T18:05:15.331458+0000","172.21.15.163:0/3513629472":"2023-07-15T18:04:53.288443+0000","172.21.15.163:0/1090329830":"2023-07-15T18:04:53.288443+0000","172.21.15.163:0/3868922045":"2023-07-15T18:05:15.331458+0000","172.21.15.163:0/2945662447":"2023-07-15T18:04:53.288443+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-14T18:11:15.563 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:15.525+0000 7f6ff5cf3700 1 -- 172.21.15.163:0/1617114917 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f6fdc0a11a0 msgr2=0x7f6fdc0a3650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:11:15.563 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:15.525+0000 7f6ff5cf3700 1 --2- 172.21.15.163:0/1617114917 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f6fdc0a11a0 0x7f6fdc0a3650 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f6fe0006010 tx=0x7f6fe0005960 comp rx=0 tx=0).stop 2023-07-14T18:11:15.564 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:15.525+0000 7f6ff5cf3700 1 -- 172.21.15.163:0/1617114917 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f6ff0105920 msgr2=0x7f6ff019cd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:11:15.564 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:15.525+0000 7f6ff5cf3700 1 --2- 172.21.15.163:0/1617114917 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f6ff0105920 0x7f6ff019cd90 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f6fe8007ee0 tx=0x7f6fe800d3b0 comp rx=0 tx=0).stop 2023-07-14T18:11:15.564 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:15.525+0000 7f6ff5cf3700 1 -- 172.21.15.163:0/1617114917 shutdown_connections 2023-07-14T18:11:15.564 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:15.525+0000 7f6ff5cf3700 1 --2- 172.21.15.163:0/1617114917 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f6fdc0a11a0 0x7f6fdc0a3650 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:15.564 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:15.525+0000 7f6ff5cf3700 1 --2- 172.21.15.163:0/1617114917 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f6ff0105920 0x7f6ff019cd90 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:15.564 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:15.525+0000 7f6ff5cf3700 1 --2- 172.21.15.163:0/1617114917 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6ff01006e0 0x7f6ff01957e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:15.565 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:15.525+0000 7f6ff5cf3700 1 --2- 172.21.15.163:0/1617114917 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6ff0103000 0x7f6ff0195d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:15.565 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:15.525+0000 7f6ff5cf3700 1 -- 172.21.15.163:0/1617114917 >> 172.21.15.163:0/1617114917 conn(0x7f6ff00fa100 msgr2=0x7f6ff0101340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:11:15.565 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:15.525+0000 7f6ff5cf3700 1 -- 172.21.15.163:0/1617114917 shutdown_connections 2023-07-14T18:11:15.565 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:15.525+0000 7f6ff5cf3700 1 -- 172.21.15.163:0/1617114917 wait complete. 2023-07-14T18:11:15.577 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-14T18:11:15.701 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:15.661+0000 7fe8aabca700 1 -- 172.21.15.163:0/2671733930 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fe8a4100680 msgr2=0x7fe8a4106f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:11:15.701 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:15.661+0000 7fe8aabca700 1 --2- 172.21.15.163:0/2671733930 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fe8a4100680 0x7fe8a4106f40 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fe89c00b0a0 tx=0x7fe89c00b3b0 comp rx=0 tx=0).stop 2023-07-14T18:11:15.701 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:15.661+0000 7fe8aabca700 1 -- 172.21.15.163:0/2671733930 shutdown_connections 2023-07-14T18:11:15.701 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:15.661+0000 7fe8aabca700 1 --2- 172.21.15.163:0/2671733930 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fe8a4100680 0x7fe8a4106f40 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:15.701 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:15.661+0000 7fe8aabca700 1 --2- 172.21.15.163:0/2671733930 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe8a40feb00 0x7fe8a40fef10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:15.702 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:15.661+0000 7fe8aabca700 1 --2- 172.21.15.163:0/2671733930 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe8a40ffcf0 0x7fe8a4100140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:15.702 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:15.661+0000 7fe8aabca700 1 -- 172.21.15.163:0/2671733930 >> 172.21.15.163:0/2671733930 conn(0x7fe8a40fa100 msgr2=0x7fe8a40fc550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:11:15.702 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:15.661+0000 7fe8aabca700 1 -- 172.21.15.163:0/2671733930 shutdown_connections 2023-07-14T18:11:15.702 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:15.661+0000 7fe8aabca700 1 -- 172.21.15.163:0/2671733930 wait complete. 2023-07-14T18:11:15.702 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:15.661+0000 7fe8aabca700 1 Processor -- start 2023-07-14T18:11:15.702 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:15.661+0000 7fe8aabca700 1 -- start start 2023-07-14T18:11:15.702 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:15.661+0000 7fe8aabca700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe8a40feb00 0x7fe8a4102a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:11:15.702 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:15.661+0000 7fe8aabca700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe8a40ffcf0 0x7fe8a41010d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:11:15.703 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:15.661+0000 7fe8aabca700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fe8a4100680 0x7fe8a4101610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:11:15.703 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:15.661+0000 7fe8aabca700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8a4101db0 con 0x7fe8a4100680 2023-07-14T18:11:15.703 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:15.661+0000 7fe8aabca700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8a4101f20 con 0x7fe8a40feb00 2023-07-14T18:11:15.703 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:15.661+0000 7fe8aabca700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8a419f950 con 0x7fe8a40ffcf0 2023-07-14T18:11:15.703 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:15.662+0000 7fe8a9167700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fe8a4100680 0x7fe8a4101610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:11:15.703 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:15.662+0000 7fe8a9167700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fe8a4100680 0x7fe8a4101610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:55826/0 (socket says 172.21.15.163:55826) 2023-07-14T18:11:15.703 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:15.662+0000 7fe8a9167700 1 -- 172.21.15.163:0/3715654348 learned_addr learned my addr 172.21.15.163:0/3715654348 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:11:15.703 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:15.662+0000 7fe8a8966700 1 --2- 172.21.15.163:0/3715654348 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe8a40feb00 0x7fe8a4102a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:11:15.704 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:15.662+0000 7fe8a3fff700 1 --2- 172.21.15.163:0/3715654348 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe8a40ffcf0 0x7fe8a41010d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:11:15.704 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:15.662+0000 7fe8a9167700 1 -- 172.21.15.163:0/3715654348 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe8a40ffcf0 msgr2=0x7fe8a41010d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:11:15.704 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:15.662+0000 7fe8a9167700 1 --2- 172.21.15.163:0/3715654348 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe8a40ffcf0 0x7fe8a41010d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:15.704 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:15.662+0000 7fe8a9167700 1 -- 172.21.15.163:0/3715654348 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe8a40feb00 msgr2=0x7fe8a4102a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:11:15.704 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:15.662+0000 7fe8a9167700 1 --2- 172.21.15.163:0/3715654348 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe8a40feb00 0x7fe8a4102a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:15.704 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:15.662+0000 7fe8a9167700 1 -- 172.21.15.163:0/3715654348 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe89c009d00 con 0x7fe8a4100680 2023-07-14T18:11:15.704 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:15.662+0000 7fe8a9167700 1 --2- 172.21.15.163:0/3715654348 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fe8a4100680 0x7fe8a4101610 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fe89c00bad0 tx=0x7fe89c00bb00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:11:15.705 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:15.662+0000 7fe8a1ffb700 1 -- 172.21.15.163:0/3715654348 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe89c00e040 con 0x7fe8a4100680 2023-07-14T18:11:15.705 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:15.662+0000 7fe8a1ffb700 1 -- 172.21.15.163:0/3715654348 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fe89c003c00 con 0x7fe8a4100680 2023-07-14T18:11:15.705 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:15.662+0000 7fe8aabca700 1 -- 172.21.15.163:0/3715654348 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe8a419fbd0 con 0x7fe8a4100680 2023-07-14T18:11:15.705 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:15.662+0000 7fe8a1ffb700 1 -- 172.21.15.163:0/3715654348 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe89c0052a0 con 0x7fe8a4100680 2023-07-14T18:11:15.705 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:15.662+0000 7fe8aabca700 1 -- 172.21.15.163:0/3715654348 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe8a41a0050 con 0x7fe8a4100680 2023-07-14T18:11:15.706 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:15.663+0000 7fe8aabca700 1 -- 172.21.15.163:0/3715654348 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe8a410a190 con 0x7fe8a4100680 2023-07-14T18:11:15.706 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:15.664+0000 7fe8a1ffb700 1 -- 172.21.15.163:0/3715654348 <== mon.0 v2:172.21.15.163:3300/0 4 ==== mgrmap(e 16) v1 ==== 135716+0+0 (secure 0 0 0) 0x7fe89c01d470 con 0x7fe8a4100680 2023-07-14T18:11:15.706 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:15.665+0000 7fe8a1ffb700 1 --2- 172.21.15.163:0/3715654348 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7fe8940a11a0 0x7fe8940a3650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:11:15.706 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:15.665+0000 7fe8a8966700 1 --2- 172.21.15.163:0/3715654348 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7fe8940a11a0 0x7fe8940a3650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:11:15.707 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:15.665+0000 7fe8a1ffb700 1 -- 172.21.15.163:0/3715654348 <== mon.0 v2:172.21.15.163:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 8730+0+0 (secure 0 0 0) 0x7fe89c0cdda0 con 0x7fe8a4100680 2023-07-14T18:11:15.707 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:15.665+0000 7fe8a8966700 1 --2- 172.21.15.163:0/3715654348 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7fe8940a11a0 0x7fe8940a3650 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fe8a40ffb50 tx=0x7fe89800b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:11:15.707 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:15.669+0000 7fe8a1ffb700 1 -- 172.21.15.163:0/3715654348 <== mon.0 v2:172.21.15.163:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178025 (secure 0 0 0) 0x7fe89c097390 con 0x7fe8a4100680 2023-07-14T18:11:15.899 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:15.860+0000 7fe8aabca700 1 -- 172.21.15.163:0/3715654348 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe8a41a0600 con 0x7fe8a4100680 2023-07-14T18:11:15.900 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:15.862+0000 7fe8a1ffb700 1 -- 172.21.15.163:0/3715654348 <== mon.0 v2:172.21.15.163:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v84) v1 ==== 74+0+24030 (secure 0 0 0) 0x7fe89c09a9b0 con 0x7fe8a4100680 2023-07-14T18:11:15.901 INFO:teuthology.orchestra.run.smithi163.stdout: 2023-07-14T18:11:15.901 INFO:teuthology.orchestra.run.smithi163.stdout:{"epoch":84,"fsid":"bf7326ec-2270-11ee-9b33-001a4aab830c","created":"2023-07-14T18:04:26.263517+0000","modified":"2023-07-14T18:11:14.170253+0000","last_up_change":"2023-07-14T18:10:27.514863+0000","last_in_change":"2023-07-14T18:10:10.726443+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-14T18:07:19.653852+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-07-14T18:11:07.314989+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-07-14T18:11:08.274627+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-07-14T18:11:11.991162+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"e6490568-046d-43ef-bb07-d79fb884b276","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6802","nonce":3124653025},{"type":"v1","addr":"172.21.15.163:6803","nonce":3124653025}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6804","nonce":3124653025},{"type":"v1","addr":"172.21.15.163:6805","nonce":3124653025}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6808","nonce":3124653025},{"type":"v1","addr":"172.21.15.163:6809","nonce":3124653025}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6806","nonce":3124653025},{"type":"v1","addr":"172.21.15.163:6807","nonce":3124653025}]},"public_addr":"172.21.15.163:6803/3124653025","cluster_addr":"172.21.15.163:6805/3124653025","heartbeat_back_addr":"172.21.15.163:6809/3124653025","heartbeat_front_addr":"172.21.15.163:6807/3124653025","state":["exists","up"]},{"osd":1,"uuid":"0af39bda-f096-4603-adcc-bf1988f36603","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":3774455900},{"type":"v1","addr":"172.21.15.172:6801","nonce":3774455900}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":3774455900},{"type":"v1","addr":"172.21.15.172:6803","nonce":3774455900}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":3774455900},{"type":"v1","addr":"172.21.15.172:6807","nonce":3774455900}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":3774455900},{"type":"v1","addr":"172.21.15.172:6805","nonce":3774455900}]},"public_addr":"172.21.15.172:6801/3774455900","cluster_addr":"172.21.15.172:6803/3774455900","heartbeat_back_addr":"172.21.15.172:6807/3774455900","heartbeat_front_addr":"172.21.15.172:6805/3774455900","state":["exists","up"]},{"osd":2,"uuid":"cc732c13-af0f-4199-98e6-fe960ed4e5dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":1976927678},{"type":"v1","addr":"172.21.15.184:6801","nonce":1976927678}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":1976927678},{"type":"v1","addr":"172.21.15.184:6803","nonce":1976927678}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":1976927678},{"type":"v1","addr":"172.21.15.184:6807","nonce":1976927678}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":1976927678},{"type":"v1","addr":"172.21.15.184:6805","nonce":1976927678}]},"public_addr":"172.21.15.184:6801/1976927678","cluster_addr":"172.21.15.184:6803/1976927678","heartbeat_back_addr":"172.21.15.184:6807/1976927678","heartbeat_front_addr":"172.21.15.184:6805/1976927678","state":["exists","up"]},{"osd":3,"uuid":"dcee9576-0bc6-4ab0-8f63-79eacd0eca5f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6810","nonce":2589130694},{"type":"v1","addr":"172.21.15.163:6811","nonce":2589130694}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6812","nonce":2589130694},{"type":"v1","addr":"172.21.15.163:6813","nonce":2589130694}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6816","nonce":2589130694},{"type":"v1","addr":"172.21.15.163:6817","nonce":2589130694}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6814","nonce":2589130694},{"type":"v1","addr":"172.21.15.163:6815","nonce":2589130694}]},"public_addr":"172.21.15.163:6811/2589130694","cluster_addr":"172.21.15.163:6813/2589130694","heartbeat_back_addr":"172.21.15.163:6817/2589130694","heartbeat_front_addr":"172.21.15.163:6815/2589130694","state":["exists","up"]},{"osd":4,"uuid":"055df823-b8b0-426a-83c2-f0d727932ad8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":3319632614},{"type":"v1","addr":"172.21.15.172:6809","nonce":3319632614}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6810","nonce":3319632614},{"type":"v1","addr":"172.21.15.172:6811","nonce":3319632614}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6814","nonce":3319632614},{"type":"v1","addr":"172.21.15.172:6815","nonce":3319632614}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":3319632614},{"type":"v1","addr":"172.21.15.172:6813","nonce":3319632614}]},"public_addr":"172.21.15.172:6809/3319632614","cluster_addr":"172.21.15.172:6811/3319632614","heartbeat_back_addr":"172.21.15.172:6815/3319632614","heartbeat_front_addr":"172.21.15.172:6813/3319632614","state":["exists","up"]},{"osd":5,"uuid":"ef5ef02a-b4e2-4790-9d27-f6d2247b25c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":2662084043},{"type":"v1","addr":"172.21.15.184:6809","nonce":2662084043}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6810","nonce":2662084043},{"type":"v1","addr":"172.21.15.184:6811","nonce":2662084043}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6814","nonce":2662084043},{"type":"v1","addr":"172.21.15.184:6815","nonce":2662084043}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6812","nonce":2662084043},{"type":"v1","addr":"172.21.15.184:6813","nonce":2662084043}]},"public_addr":"172.21.15.184:6809/2662084043","cluster_addr":"172.21.15.184:6811/2662084043","heartbeat_back_addr":"172.21.15.184:6815/2662084043","heartbeat_front_addr":"172.21.15.184:6813/2662084043","state":["exists","up"]},{"osd":6,"uuid":"dba754be-0fc5-4867-a6d5-cf97eb344f81","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":44,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6818","nonce":2530874117},{"type":"v1","addr":"172.21.15.163:6819","nonce":2530874117}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6820","nonce":2530874117},{"type":"v1","addr":"172.21.15.163:6821","nonce":2530874117}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6824","nonce":2530874117},{"type":"v1","addr":"172.21.15.163:6825","nonce":2530874117}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6822","nonce":2530874117},{"type":"v1","addr":"172.21.15.163:6823","nonce":2530874117}]},"public_addr":"172.21.15.163:6819/2530874117","cluster_addr":"172.21.15.163:6821/2530874117","heartbeat_back_addr":"172.21.15.163:6825/2530874117","heartbeat_front_addr":"172.21.15.163:6823/2530874117","state":["exists","up"]},{"osd":7,"uuid":"edd76e6b-6077-4619-b00d-1e906f70ddcc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":49,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":233511803},{"type":"v1","addr":"172.21.15.172:6817","nonce":233511803}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6818","nonce":233511803},{"type":"v1","addr":"172.21.15.172:6819","nonce":233511803}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":233511803},{"type":"v1","addr":"172.21.15.172:6823","nonce":233511803}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6820","nonce":233511803},{"type":"v1","addr":"172.21.15.172:6821","nonce":233511803}]},"public_addr":"172.21.15.172:6817/233511803","cluster_addr":"172.21.15.172:6819/233511803","heartbeat_back_addr":"172.21.15.172:6823/233511803","heartbeat_front_addr":"172.21.15.172:6821/233511803","state":["exists","up"]},{"osd":8,"uuid":"36559400-f33e-44e6-868a-316d34da457d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":56,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6816","nonce":290154343},{"type":"v1","addr":"172.21.15.184:6817","nonce":290154343}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6818","nonce":290154343},{"type":"v1","addr":"172.21.15.184:6819","nonce":290154343}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6822","nonce":290154343},{"type":"v1","addr":"172.21.15.184:6823","nonce":290154343}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6820","nonce":290154343},{"type":"v1","addr":"172.21.15.184:6821","nonce":290154343}]},"public_addr":"172.21.15.184:6817/290154343","cluster_addr":"172.21.15.184:6819/290154343","heartbeat_back_addr":"172.21.15.184:6823/290154343","heartbeat_front_addr":"172.21.15.184:6821/290154343","state":["exists","up"]},{"osd":9,"uuid":"d484f111-f36c-4c67-9a8a-ae03e7e0d137","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6826","nonce":3848110906},{"type":"v1","addr":"172.21.15.163:6827","nonce":3848110906}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6828","nonce":3848110906},{"type":"v1","addr":"172.21.15.163:6829","nonce":3848110906}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6832","nonce":3848110906},{"type":"v1","addr":"172.21.15.163:6833","nonce":3848110906}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6830","nonce":3848110906},{"type":"v1","addr":"172.21.15.163:6831","nonce":3848110906}]},"public_addr":"172.21.15.163:6827/3848110906","cluster_addr":"172.21.15.163:6829/3848110906","heartbeat_back_addr":"172.21.15.163:6833/3848110906","heartbeat_front_addr":"172.21.15.163:6831/3848110906","state":["exists","up"]},{"osd":10,"uuid":"d943f7c0-da3d-4605-9e23-0231e675c6be","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6824","nonce":3281085356},{"type":"v1","addr":"172.21.15.172:6825","nonce":3281085356}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":3281085356},{"type":"v1","addr":"172.21.15.172:6827","nonce":3281085356}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":3281085356},{"type":"v1","addr":"172.21.15.172:6831","nonce":3281085356}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6828","nonce":3281085356},{"type":"v1","addr":"172.21.15.172:6829","nonce":3281085356}]},"public_addr":"172.21.15.172:6825/3281085356","cluster_addr":"172.21.15.172:6827/3281085356","heartbeat_back_addr":"172.21.15.172:6831/3281085356","heartbeat_front_addr":"172.21.15.172:6829/3281085356","state":["exists","up"]},{"osd":11,"uuid":"09e610a8-408a-4119-a21b-c4de2810a538","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":75,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6824","nonce":3614578747},{"type":"v1","addr":"172.21.15.184:6825","nonce":3614578747}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6826","nonce":3614578747},{"type":"v1","addr":"172.21.15.184:6827","nonce":3614578747}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6830","nonce":3614578747},{"type":"v1","addr":"172.21.15.184:6831","nonce":3614578747}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6828","nonce":3614578747},{"type":"v1","addr":"172.21.15.184:6829","nonce":3614578747}]},"public_addr":"172.21.15.184:6825/3614578747","cluster_addr":"172.21.15.184:6827/3614578747","heartbeat_back_addr":"172.21.15.184:6831/3614578747","heartbeat_front_addr":"172.21.15.184:6829/3614578747","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T18:06:36.067578+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T18:06:57.095120+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T18:07:17.825363+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T18:07:38.977196+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T18:08:00.108709+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T18:08:20.700646+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T18:08:41.473899+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T18:09:02.856536+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T18:09:23.832722+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T18:09:44.860884+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T18:10:05.520678+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T18:10:26.426315+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.163:6801/1086512093":"2023-07-15T18:05:15.331458+0000","172.21.15.163:6800/1086512093":"2023-07-15T18:05:15.331458+0000","172.21.15.163:0/4235784810":"2023-07-15T18:05:15.331458+0000","172.21.15.163:6800/236891232":"2023-07-15T18:04:53.288443+0000","172.21.15.163:6801/236891232":"2023-07-15T18:04:53.288443+0000","172.21.15.163:0/3260193612":"2023-07-15T18:05:15.331458+0000","172.21.15.163:0/3513629472":"2023-07-15T18:04:53.288443+0000","172.21.15.163:0/1090329830":"2023-07-15T18:04:53.288443+0000","172.21.15.163:0/3868922045":"2023-07-15T18:05:15.331458+0000","172.21.15.163:0/2945662447":"2023-07-15T18:04:53.288443+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-14T18:11:15.903 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:15.864+0000 7fe8aabca700 1 -- 172.21.15.163:0/3715654348 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7fe8940a11a0 msgr2=0x7fe8940a3650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:11:15.903 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:15.864+0000 7fe8aabca700 1 --2- 172.21.15.163:0/3715654348 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7fe8940a11a0 0x7fe8940a3650 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fe8a40ffb50 tx=0x7fe89800b410 comp rx=0 tx=0).stop 2023-07-14T18:11:15.903 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:15.864+0000 7fe8aabca700 1 -- 172.21.15.163:0/3715654348 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fe8a4100680 msgr2=0x7fe8a4101610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:11:15.903 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:15.864+0000 7fe8aabca700 1 --2- 172.21.15.163:0/3715654348 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fe8a4100680 0x7fe8a4101610 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fe89c00bad0 tx=0x7fe89c00bb00 comp rx=0 tx=0).stop 2023-07-14T18:11:15.903 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:15.864+0000 7fe8aabca700 1 -- 172.21.15.163:0/3715654348 shutdown_connections 2023-07-14T18:11:15.904 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:15.864+0000 7fe8aabca700 1 --2- 172.21.15.163:0/3715654348 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7fe8940a11a0 0x7fe8940a3650 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:15.904 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:15.864+0000 7fe8aabca700 1 --2- 172.21.15.163:0/3715654348 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fe8a4100680 0x7fe8a4101610 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:15.904 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:15.864+0000 7fe8aabca700 1 --2- 172.21.15.163:0/3715654348 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe8a40feb00 0x7fe8a4102a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:15.904 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:15.864+0000 7fe8aabca700 1 --2- 172.21.15.163:0/3715654348 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe8a40ffcf0 0x7fe8a41010d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:15.904 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:15.864+0000 7fe8aabca700 1 -- 172.21.15.163:0/3715654348 >> 172.21.15.163:0/3715654348 conn(0x7fe8a40fa100 msgr2=0x7fe8a4067820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:11:15.904 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:15.864+0000 7fe8aabca700 1 -- 172.21.15.163:0/3715654348 shutdown_connections 2023-07-14T18:11:15.905 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:15.864+0000 7fe8aabca700 1 -- 172.21.15.163:0/3715654348 wait complete. 2023-07-14T18:11:15.932 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-14T18:11:16.055 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:16.014+0000 7fb37d6a6700 1 -- 172.21.15.163:0/4011174753 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fb3780ff7e0 msgr2=0x7fb3781070b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:11:16.055 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:16.014+0000 7fb37d6a6700 1 --2- 172.21.15.163:0/4011174753 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fb3780ff7e0 0x7fb3781070b0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fb37000b0a0 tx=0x7fb37000b3b0 comp rx=0 tx=0).stop 2023-07-14T18:11:16.055 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:16.014+0000 7fb37d6a6700 1 -- 172.21.15.163:0/4011174753 shutdown_connections 2023-07-14T18:11:16.055 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:16.014+0000 7fb37d6a6700 1 --2- 172.21.15.163:0/4011174753 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fb3780ff7e0 0x7fb3781070b0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:16.055 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:16.014+0000 7fb37d6a6700 1 --2- 172.21.15.163:0/4011174753 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb3781001b0 0x7fb3781005c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:16.055 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:16.014+0000 7fb37d6a6700 1 --2- 172.21.15.163:0/4011174753 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb3780fee50 0x7fb3780ff2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:16.056 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:16.014+0000 7fb37d6a6700 1 -- 172.21.15.163:0/4011174753 >> 172.21.15.163:0/4011174753 conn(0x7fb3780f9990 msgr2=0x7fb3780fbda0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:11:16.056 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:16.014+0000 7fb37d6a6700 1 -- 172.21.15.163:0/4011174753 shutdown_connections 2023-07-14T18:11:16.056 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:16.014+0000 7fb37d6a6700 1 -- 172.21.15.163:0/4011174753 wait complete. 2023-07-14T18:11:16.056 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:16.015+0000 7fb37d6a6700 1 Processor -- start 2023-07-14T18:11:16.056 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:16.015+0000 7fb37d6a6700 1 -- start start 2023-07-14T18:11:16.056 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:16.015+0000 7fb37d6a6700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb3780fee50 0x7fb378102c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:11:16.056 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:16.015+0000 7fb37d6a6700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb3780ff7e0 0x7fb378101240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:11:16.057 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:16.015+0000 7fb37d6a6700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fb3781001b0 0x7fb378101780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:11:16.057 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:16.015+0000 7fb37d6a6700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb378101f20 con 0x7fb3781001b0 2023-07-14T18:11:16.057 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:16.015+0000 7fb37d6a6700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb378102090 con 0x7fb3780ff7e0 2023-07-14T18:11:16.057 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:16.015+0000 7fb37d6a6700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb37819f970 con 0x7fb3780fee50 2023-07-14T18:11:16.057 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:16.015+0000 7fb3777fe700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fb3781001b0 0x7fb378101780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:11:16.057 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:16.015+0000 7fb3777fe700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fb3781001b0 0x7fb378101780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:55840/0 (socket says 172.21.15.163:55840) 2023-07-14T18:11:16.057 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:16.015+0000 7fb3777fe700 1 -- 172.21.15.163:0/2335422603 learned_addr learned my addr 172.21.15.163:0/2335422603 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:11:16.058 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:16.015+0000 7fb376ffd700 1 --2- 172.21.15.163:0/2335422603 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb3780fee50 0x7fb378102c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:11:16.058 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:16.015+0000 7fb3767fc700 1 --2- 172.21.15.163:0/2335422603 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb3780ff7e0 0x7fb378101240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:11:16.058 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:16.016+0000 7fb3777fe700 1 -- 172.21.15.163:0/2335422603 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb3780fee50 msgr2=0x7fb378102c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:11:16.058 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:16.016+0000 7fb3777fe700 1 --2- 172.21.15.163:0/2335422603 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb3780fee50 0x7fb378102c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:16.058 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:16.016+0000 7fb3777fe700 1 -- 172.21.15.163:0/2335422603 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb3780ff7e0 msgr2=0x7fb378101240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:11:16.058 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:16.016+0000 7fb3777fe700 1 --2- 172.21.15.163:0/2335422603 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb3780ff7e0 0x7fb378101240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:16.058 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:16.016+0000 7fb3777fe700 1 -- 172.21.15.163:0/2335422603 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb370009d00 con 0x7fb3781001b0 2023-07-14T18:11:16.059 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:16.016+0000 7fb3777fe700 1 --2- 172.21.15.163:0/2335422603 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fb3781001b0 0x7fb378101780 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fb37000b780 tx=0x7fb3700078e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:11:16.059 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:16.016+0000 7fb35ffff700 1 -- 172.21.15.163:0/2335422603 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb37000e040 con 0x7fb3781001b0 2023-07-14T18:11:16.059 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:16.016+0000 7fb37d6a6700 1 -- 172.21.15.163:0/2335422603 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb37819fbf0 con 0x7fb3781001b0 2023-07-14T18:11:16.060 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:16.016+0000 7fb35ffff700 1 -- 172.21.15.163:0/2335422603 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fb37000be80 con 0x7fb3781001b0 2023-07-14T18:11:16.060 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:16.016+0000 7fb35ffff700 1 -- 172.21.15.163:0/2335422603 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb37001dea0 con 0x7fb3781001b0 2023-07-14T18:11:16.061 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:16.016+0000 7fb37d6a6700 1 -- 172.21.15.163:0/2335422603 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb3781a0070 con 0x7fb3781001b0 2023-07-14T18:11:16.062 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:16.017+0000 7fb37d6a6700 1 -- 172.21.15.163:0/2335422603 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb37810a210 con 0x7fb3781001b0 2023-07-14T18:11:16.062 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:16.018+0000 7fb35ffff700 1 -- 172.21.15.163:0/2335422603 <== mon.0 v2:172.21.15.163:3300/0 4 ==== mgrmap(e 16) v1 ==== 135716+0+0 (secure 0 0 0) 0x7fb37001d470 con 0x7fb3781001b0 2023-07-14T18:11:16.062 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:16.019+0000 7fb35ffff700 1 --2- 172.21.15.163:0/2335422603 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7fb3600a11a0 0x7fb3600a3650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:11:16.063 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:16.019+0000 7fb376ffd700 1 --2- 172.21.15.163:0/2335422603 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7fb3600a11a0 0x7fb3600a3650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:11:16.063 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:16.019+0000 7fb35ffff700 1 -- 172.21.15.163:0/2335422603 <== mon.0 v2:172.21.15.163:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 8730+0+0 (secure 0 0 0) 0x7fb3700ce320 con 0x7fb3781001b0 2023-07-14T18:11:16.063 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:16.019+0000 7fb376ffd700 1 --2- 172.21.15.163:0/2335422603 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7fb3600a11a0 0x7fb3600a3650 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fb378068800 tx=0x7fb368009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:11:16.063 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:16.022+0000 7fb35ffff700 1 -- 172.21.15.163:0/2335422603 <== mon.0 v2:172.21.15.163:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178025 (secure 0 0 0) 0x7fb370097910 con 0x7fb3781001b0 2023-07-14T18:11:16.173 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:11:15 smithi184 ceph-mon[98481]: osdmap e84: 12 total, 12 up, 12 in 2023-07-14T18:11:16.174 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:11:15 smithi184 ceph-mon[98481]: from='client.? 172.21.15.163:0/2277447606' entity='client.admin' cmd='[{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]': finished 2023-07-14T18:11:16.174 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:11:15 smithi184 ceph-mon[98481]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2023-07-14T18:11:16.174 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:11:15 smithi184 ceph-mon[98481]: from='client.? 172.21.15.163:0/3237967637' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-07-14T18:11:16.174 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:11:15 smithi184 ceph-mon[98481]: pgmap v254: 129 pgs: 9 creating+peering, 106 active+clean, 14 unknown; 579 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s wr, 5 op/s 2023-07-14T18:11:16.174 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:11:15 smithi184 ceph-mon[98481]: from='client.? 172.21.15.163:0/1617114917' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-07-14T18:11:16.216 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:11:15 smithi163 ceph-mon[96576]: osdmap e84: 12 total, 12 up, 12 in 2023-07-14T18:11:16.216 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:11:15 smithi163 ceph-mon[96576]: from='client.? 172.21.15.163:0/2277447606' entity='client.admin' cmd='[{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]': finished 2023-07-14T18:11:16.216 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:11:15 smithi163 ceph-mon[96576]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2023-07-14T18:11:16.217 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:11:15 smithi163 ceph-mon[96576]: from='client.? 172.21.15.163:0/3237967637' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-07-14T18:11:16.217 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:11:15 smithi163 ceph-mon[96576]: pgmap v254: 129 pgs: 9 creating+peering, 106 active+clean, 14 unknown; 579 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s wr, 5 op/s 2023-07-14T18:11:16.217 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:11:15 smithi163 ceph-mon[96576]: from='client.? 172.21.15.163:0/1617114917' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-07-14T18:11:16.274 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:11:15 smithi172 ceph-mon[97983]: osdmap e84: 12 total, 12 up, 12 in 2023-07-14T18:11:16.275 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:11:15 smithi172 ceph-mon[97983]: from='client.? 172.21.15.163:0/2277447606' entity='client.admin' cmd='[{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]': finished 2023-07-14T18:11:16.275 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:11:15 smithi172 ceph-mon[97983]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2023-07-14T18:11:16.275 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:11:15 smithi172 ceph-mon[97983]: from='client.? 172.21.15.163:0/3237967637' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-07-14T18:11:16.275 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:11:15 smithi172 ceph-mon[97983]: pgmap v254: 129 pgs: 9 creating+peering, 106 active+clean, 14 unknown; 579 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s wr, 5 op/s 2023-07-14T18:11:16.275 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:11:15 smithi172 ceph-mon[97983]: from='client.? 172.21.15.163:0/1617114917' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-07-14T18:11:16.292 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:16.254+0000 7fb37d6a6700 1 -- 172.21.15.163:0/2335422603 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb3781a0620 con 0x7fb3781001b0 2023-07-14T18:11:16.293 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:16.255+0000 7fb35ffff700 1 -- 172.21.15.163:0/2335422603 <== mon.0 v2:172.21.15.163:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+10790 (secure 0 0 0) 0x7fb37009af30 con 0x7fb3781001b0 2023-07-14T18:11:16.293 INFO:teuthology.orchestra.run.smithi163.stdout: 2023-07-14T18:11:16.294 INFO:teuthology.orchestra.run.smithi163.stdout:{"epoch":17,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14562,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.163:6835/1058662632","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6834","nonce":1058662632},{"type":"v1","addr":"172.21.15.163:6835","nonce":1058662632}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":14568,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.163:6837/1107244425","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6836","nonce":1107244425},{"type":"v1","addr":"172.21.15.163:6837","nonce":1107244425}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5},{"gid":14640,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.163:6839/1337572937","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6838","nonce":1337572937},{"type":"v1","addr":"172.21.15.163:6839","nonce":1337572937}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":14652,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.163:6841/1032082642","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6840","nonce":1032082642},{"type":"v1","addr":"172.21.15.163:6841","nonce":1032082642}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":24421,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6833/797722972","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6832","nonce":797722972},{"type":"v1","addr":"172.21.15.184:6833","nonce":797722972}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":24431,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6833/1075696311","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":1075696311},{"type":"v1","addr":"172.21.15.172:6833","nonce":1075696311}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":24458,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6835/1158120127","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":1158120127},{"type":"v1","addr":"172.21.15.172:6835","nonce":1158120127}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":6},{"gid":24466,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6835/460134263","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6834","nonce":460134263},{"type":"v1","addr":"172.21.15.184:6835","nonce":460134263}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":7},{"gid":24478,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6837/3389277679","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6836","nonce":3389277679},{"type":"v1","addr":"172.21.15.184:6837","nonce":3389277679}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":8},{"gid":24479,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6837/3783835012","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":3783835012},{"type":"v1","addr":"172.21.15.172:6837","nonce":3783835012}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":9},{"gid":24493,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6839/2819059257","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6838","nonce":2819059257},{"type":"v1","addr":"172.21.15.184:6839","nonce":2819059257}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-14T18:11:09.109693+0000","modified":"2023-07-14T18:11:14.786969+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":24518},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24518":{"gid":24518,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.172:6839/3850440096","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6838","nonce":3850440096},{"type":"v1","addr":"172.21.15.172:6839","nonce":3850440096}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2023-07-14T18:11:16.295 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:16.257+0000 7fb37d6a6700 1 -- 172.21.15.163:0/2335422603 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7fb3600a11a0 msgr2=0x7fb3600a3650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:11:16.295 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:16.257+0000 7fb37d6a6700 1 --2- 172.21.15.163:0/2335422603 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7fb3600a11a0 0x7fb3600a3650 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fb378068800 tx=0x7fb368009260 comp rx=0 tx=0).stop 2023-07-14T18:11:16.296 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:16.257+0000 7fb37d6a6700 1 -- 172.21.15.163:0/2335422603 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fb3781001b0 msgr2=0x7fb378101780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:11:16.296 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:16.257+0000 7fb37d6a6700 1 --2- 172.21.15.163:0/2335422603 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fb3781001b0 0x7fb378101780 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fb37000b780 tx=0x7fb3700078e0 comp rx=0 tx=0).stop 2023-07-14T18:11:16.296 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:16.257+0000 7fb37d6a6700 1 -- 172.21.15.163:0/2335422603 shutdown_connections 2023-07-14T18:11:16.296 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:16.257+0000 7fb37d6a6700 1 --2- 172.21.15.163:0/2335422603 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7fb3600a11a0 0x7fb3600a3650 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:16.296 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:16.257+0000 7fb37d6a6700 1 --2- 172.21.15.163:0/2335422603 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb3780fee50 0x7fb378102c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:16.296 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:16.257+0000 7fb37d6a6700 1 --2- 172.21.15.163:0/2335422603 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fb3781001b0 0x7fb378101780 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:16.296 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:16.257+0000 7fb37d6a6700 1 --2- 172.21.15.163:0/2335422603 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb3780ff7e0 0x7fb378101240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:16.297 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:16.257+0000 7fb37d6a6700 1 -- 172.21.15.163:0/2335422603 >> 172.21.15.163:0/2335422603 conn(0x7fb3780f9990 msgr2=0x7fb3780fddc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:11:16.297 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:16.257+0000 7fb37d6a6700 1 -- 172.21.15.163:0/2335422603 shutdown_connections 2023-07-14T18:11:16.297 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:16.257+0000 7fb37d6a6700 1 -- 172.21.15.163:0/2335422603 wait complete. 2023-07-14T18:11:16.297 INFO:teuthology.orchestra.run.smithi163.stderr:dumped fsmap epoch 17 2023-07-14T18:11:16.308 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-14T18:11:16.431 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:16.391+0000 7f4b264d0700 1 -- 172.21.15.163:0/3857228699 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f4b20100680 msgr2=0x7f4b20106f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:11:16.432 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:16.391+0000 7f4b264d0700 1 --2- 172.21.15.163:0/3857228699 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f4b20100680 0x7f4b20106f40 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f4b1800b0a0 tx=0x7f4b1800b3b0 comp rx=0 tx=0).stop 2023-07-14T18:11:16.432 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:16.391+0000 7f4b264d0700 1 -- 172.21.15.163:0/3857228699 shutdown_connections 2023-07-14T18:11:16.432 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:16.391+0000 7f4b264d0700 1 --2- 172.21.15.163:0/3857228699 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4b200feb00 0x7f4b200fef10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:16.433 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:16.391+0000 7f4b264d0700 1 --2- 172.21.15.163:0/3857228699 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f4b20100680 0x7f4b20106f40 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:16.433 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:16.391+0000 7f4b264d0700 1 --2- 172.21.15.163:0/3857228699 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4b200ffcf0 0x7f4b20100140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:16.433 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:16.391+0000 7f4b264d0700 1 -- 172.21.15.163:0/3857228699 >> 172.21.15.163:0/3857228699 conn(0x7f4b200fa100 msgr2=0x7f4b200fc550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:11:16.433 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:16.391+0000 7f4b264d0700 1 -- 172.21.15.163:0/3857228699 shutdown_connections 2023-07-14T18:11:16.433 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:16.391+0000 7f4b264d0700 1 -- 172.21.15.163:0/3857228699 wait complete. 2023-07-14T18:11:16.433 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:16.392+0000 7f4b264d0700 1 Processor -- start 2023-07-14T18:11:16.433 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:16.392+0000 7f4b264d0700 1 -- start start 2023-07-14T18:11:16.434 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:16.392+0000 7f4b264d0700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f4b200feb00 0x7f4b20068330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:11:16.434 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:16.392+0000 7f4b264d0700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4b200ffcf0 0x7f4b2019a630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:11:16.434 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:16.392+0000 7f4b264d0700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4b20100680 0x7f4b2019cc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:11:16.434 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:16.392+0000 7f4b264d0700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b2019d450 con 0x7f4b200feb00 2023-07-14T18:11:16.434 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:16.392+0000 7f4b264d0700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b2019d5c0 con 0x7f4b200ffcf0 2023-07-14T18:11:16.434 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:16.392+0000 7f4b264d0700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b2019d780 con 0x7f4b20100680 2023-07-14T18:11:16.434 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:16.392+0000 7f4b1ffff700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f4b200feb00 0x7f4b20068330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:11:16.435 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:16.392+0000 7f4b1ffff700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f4b200feb00 0x7f4b20068330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:55850/0 (socket says 172.21.15.163:55850) 2023-07-14T18:11:16.435 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:16.392+0000 7f4b1ffff700 1 -- 172.21.15.163:0/1237305555 learned_addr learned my addr 172.21.15.163:0/1237305555 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:11:16.435 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:16.392+0000 7f4b17fff700 1 --2- 172.21.15.163:0/1237305555 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4b200ffcf0 0x7f4b2019a630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:11:16.435 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:16.392+0000 7f4b24a6d700 1 --2- 172.21.15.163:0/1237305555 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4b20100680 0x7f4b2019cc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:11:16.435 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:16.392+0000 7f4b1ffff700 1 -- 172.21.15.163:0/1237305555 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4b20100680 msgr2=0x7f4b2019cc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:11:16.435 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:16.392+0000 7f4b1ffff700 1 --2- 172.21.15.163:0/1237305555 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4b20100680 0x7f4b2019cc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:16.435 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:16.392+0000 7f4b1ffff700 1 -- 172.21.15.163:0/1237305555 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4b200ffcf0 msgr2=0x7f4b2019a630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:11:16.435 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:16.392+0000 7f4b1ffff700 1 --2- 172.21.15.163:0/1237305555 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4b200ffcf0 0x7f4b2019a630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:16.436 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:16.392+0000 7f4b1ffff700 1 -- 172.21.15.163:0/1237305555 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b18009d00 con 0x7f4b200feb00 2023-07-14T18:11:16.436 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:16.392+0000 7f4b1ffff700 1 --2- 172.21.15.163:0/1237305555 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f4b200feb00 0x7f4b20068330 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f4b1000d980 tx=0x7f4b1000dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:11:16.436 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:16.393+0000 7f4b1dffb700 1 -- 172.21.15.163:0/1237305555 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b10004020 con 0x7f4b200feb00 2023-07-14T18:11:16.436 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:16.393+0000 7f4b1dffb700 1 -- 172.21.15.163:0/1237305555 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f4b1000f690 con 0x7f4b200feb00 2023-07-14T18:11:16.436 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:16.393+0000 7f4b264d0700 1 -- 172.21.15.163:0/1237305555 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b2019da60 con 0x7f4b200feb00 2023-07-14T18:11:16.436 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:16.393+0000 7f4b1dffb700 1 -- 172.21.15.163:0/1237305555 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b100039e0 con 0x7f4b200feb00 2023-07-14T18:11:16.436 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:16.393+0000 7f4b264d0700 1 -- 172.21.15.163:0/1237305555 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b2019df70 con 0x7f4b200feb00 2023-07-14T18:11:16.437 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:16.394+0000 7f4b264d0700 1 -- 172.21.15.163:0/1237305555 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4b20106060 con 0x7f4b200feb00 2023-07-14T18:11:16.438 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:16.395+0000 7f4b1dffb700 1 -- 172.21.15.163:0/1237305555 <== mon.0 v2:172.21.15.163:3300/0 4 ==== mgrmap(e 16) v1 ==== 135716+0+0 (secure 0 0 0) 0x7f4b1000f800 con 0x7f4b200feb00 2023-07-14T18:11:16.438 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:16.396+0000 7f4b1dffb700 1 --2- 172.21.15.163:0/1237305555 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f4b0c0a11a0 0x7f4b0c0a3650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:11:16.438 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:16.396+0000 7f4b17fff700 1 --2- 172.21.15.163:0/1237305555 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f4b0c0a11a0 0x7f4b0c0a3650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:11:16.438 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:16.396+0000 7f4b1dffb700 1 -- 172.21.15.163:0/1237305555 <== mon.0 v2:172.21.15.163:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 8730+0+0 (secure 0 0 0) 0x7f4b100ccaa0 con 0x7f4b200feb00 2023-07-14T18:11:16.438 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:16.396+0000 7f4b17fff700 1 --2- 172.21.15.163:0/1237305555 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f4b0c0a11a0 0x7f4b0c0a3650 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f4b200680a0 tx=0x7f4b0800b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:11:16.438 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:16.399+0000 7f4b1dffb700 1 -- 172.21.15.163:0/1237305555 <== mon.0 v2:172.21.15.163:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178025 (secure 0 0 0) 0x7f4b10095fa0 con 0x7f4b200feb00 2023-07-14T18:11:16.628 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:16.589+0000 7f4b264d0700 1 -- 172.21.15.163:0/1237305555 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4b2002c9d0 con 0x7f4b200feb00 2023-07-14T18:11:16.629 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:16.591+0000 7f4b1dffb700 1 -- 172.21.15.163:0/1237305555 <== mon.0 v2:172.21.15.163:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v84) v1 ==== 74+0+24030 (secure 0 0 0) 0x7f4b100995c0 con 0x7f4b200feb00 2023-07-14T18:11:16.630 INFO:teuthology.orchestra.run.smithi163.stdout: 2023-07-14T18:11:16.630 INFO:teuthology.orchestra.run.smithi163.stdout:{"epoch":84,"fsid":"bf7326ec-2270-11ee-9b33-001a4aab830c","created":"2023-07-14T18:04:26.263517+0000","modified":"2023-07-14T18:11:14.170253+0000","last_up_change":"2023-07-14T18:10:27.514863+0000","last_in_change":"2023-07-14T18:10:10.726443+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-14T18:07:19.653852+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-07-14T18:11:07.314989+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-07-14T18:11:08.274627+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-07-14T18:11:11.991162+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"e6490568-046d-43ef-bb07-d79fb884b276","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6802","nonce":3124653025},{"type":"v1","addr":"172.21.15.163:6803","nonce":3124653025}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6804","nonce":3124653025},{"type":"v1","addr":"172.21.15.163:6805","nonce":3124653025}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6808","nonce":3124653025},{"type":"v1","addr":"172.21.15.163:6809","nonce":3124653025}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6806","nonce":3124653025},{"type":"v1","addr":"172.21.15.163:6807","nonce":3124653025}]},"public_addr":"172.21.15.163:6803/3124653025","cluster_addr":"172.21.15.163:6805/3124653025","heartbeat_back_addr":"172.21.15.163:6809/3124653025","heartbeat_front_addr":"172.21.15.163:6807/3124653025","state":["exists","up"]},{"osd":1,"uuid":"0af39bda-f096-4603-adcc-bf1988f36603","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":3774455900},{"type":"v1","addr":"172.21.15.172:6801","nonce":3774455900}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":3774455900},{"type":"v1","addr":"172.21.15.172:6803","nonce":3774455900}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":3774455900},{"type":"v1","addr":"172.21.15.172:6807","nonce":3774455900}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":3774455900},{"type":"v1","addr":"172.21.15.172:6805","nonce":3774455900}]},"public_addr":"172.21.15.172:6801/3774455900","cluster_addr":"172.21.15.172:6803/3774455900","heartbeat_back_addr":"172.21.15.172:6807/3774455900","heartbeat_front_addr":"172.21.15.172:6805/3774455900","state":["exists","up"]},{"osd":2,"uuid":"cc732c13-af0f-4199-98e6-fe960ed4e5dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":1976927678},{"type":"v1","addr":"172.21.15.184:6801","nonce":1976927678}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":1976927678},{"type":"v1","addr":"172.21.15.184:6803","nonce":1976927678}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":1976927678},{"type":"v1","addr":"172.21.15.184:6807","nonce":1976927678}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":1976927678},{"type":"v1","addr":"172.21.15.184:6805","nonce":1976927678}]},"public_addr":"172.21.15.184:6801/1976927678","cluster_addr":"172.21.15.184:6803/1976927678","heartbeat_back_addr":"172.21.15.184:6807/1976927678","heartbeat_front_addr":"172.21.15.184:6805/1976927678","state":["exists","up"]},{"osd":3,"uuid":"dcee9576-0bc6-4ab0-8f63-79eacd0eca5f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6810","nonce":2589130694},{"type":"v1","addr":"172.21.15.163:6811","nonce":2589130694}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6812","nonce":2589130694},{"type":"v1","addr":"172.21.15.163:6813","nonce":2589130694}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6816","nonce":2589130694},{"type":"v1","addr":"172.21.15.163:6817","nonce":2589130694}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6814","nonce":2589130694},{"type":"v1","addr":"172.21.15.163:6815","nonce":2589130694}]},"public_addr":"172.21.15.163:6811/2589130694","cluster_addr":"172.21.15.163:6813/2589130694","heartbeat_back_addr":"172.21.15.163:6817/2589130694","heartbeat_front_addr":"172.21.15.163:6815/2589130694","state":["exists","up"]},{"osd":4,"uuid":"055df823-b8b0-426a-83c2-f0d727932ad8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":3319632614},{"type":"v1","addr":"172.21.15.172:6809","nonce":3319632614}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6810","nonce":3319632614},{"type":"v1","addr":"172.21.15.172:6811","nonce":3319632614}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6814","nonce":3319632614},{"type":"v1","addr":"172.21.15.172:6815","nonce":3319632614}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":3319632614},{"type":"v1","addr":"172.21.15.172:6813","nonce":3319632614}]},"public_addr":"172.21.15.172:6809/3319632614","cluster_addr":"172.21.15.172:6811/3319632614","heartbeat_back_addr":"172.21.15.172:6815/3319632614","heartbeat_front_addr":"172.21.15.172:6813/3319632614","state":["exists","up"]},{"osd":5,"uuid":"ef5ef02a-b4e2-4790-9d27-f6d2247b25c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":2662084043},{"type":"v1","addr":"172.21.15.184:6809","nonce":2662084043}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6810","nonce":2662084043},{"type":"v1","addr":"172.21.15.184:6811","nonce":2662084043}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6814","nonce":2662084043},{"type":"v1","addr":"172.21.15.184:6815","nonce":2662084043}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6812","nonce":2662084043},{"type":"v1","addr":"172.21.15.184:6813","nonce":2662084043}]},"public_addr":"172.21.15.184:6809/2662084043","cluster_addr":"172.21.15.184:6811/2662084043","heartbeat_back_addr":"172.21.15.184:6815/2662084043","heartbeat_front_addr":"172.21.15.184:6813/2662084043","state":["exists","up"]},{"osd":6,"uuid":"dba754be-0fc5-4867-a6d5-cf97eb344f81","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":44,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6818","nonce":2530874117},{"type":"v1","addr":"172.21.15.163:6819","nonce":2530874117}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6820","nonce":2530874117},{"type":"v1","addr":"172.21.15.163:6821","nonce":2530874117}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6824","nonce":2530874117},{"type":"v1","addr":"172.21.15.163:6825","nonce":2530874117}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6822","nonce":2530874117},{"type":"v1","addr":"172.21.15.163:6823","nonce":2530874117}]},"public_addr":"172.21.15.163:6819/2530874117","cluster_addr":"172.21.15.163:6821/2530874117","heartbeat_back_addr":"172.21.15.163:6825/2530874117","heartbeat_front_addr":"172.21.15.163:6823/2530874117","state":["exists","up"]},{"osd":7,"uuid":"edd76e6b-6077-4619-b00d-1e906f70ddcc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":49,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":233511803},{"type":"v1","addr":"172.21.15.172:6817","nonce":233511803}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6818","nonce":233511803},{"type":"v1","addr":"172.21.15.172:6819","nonce":233511803}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":233511803},{"type":"v1","addr":"172.21.15.172:6823","nonce":233511803}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6820","nonce":233511803},{"type":"v1","addr":"172.21.15.172:6821","nonce":233511803}]},"public_addr":"172.21.15.172:6817/233511803","cluster_addr":"172.21.15.172:6819/233511803","heartbeat_back_addr":"172.21.15.172:6823/233511803","heartbeat_front_addr":"172.21.15.172:6821/233511803","state":["exists","up"]},{"osd":8,"uuid":"36559400-f33e-44e6-868a-316d34da457d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":56,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6816","nonce":290154343},{"type":"v1","addr":"172.21.15.184:6817","nonce":290154343}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6818","nonce":290154343},{"type":"v1","addr":"172.21.15.184:6819","nonce":290154343}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6822","nonce":290154343},{"type":"v1","addr":"172.21.15.184:6823","nonce":290154343}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6820","nonce":290154343},{"type":"v1","addr":"172.21.15.184:6821","nonce":290154343}]},"public_addr":"172.21.15.184:6817/290154343","cluster_addr":"172.21.15.184:6819/290154343","heartbeat_back_addr":"172.21.15.184:6823/290154343","heartbeat_front_addr":"172.21.15.184:6821/290154343","state":["exists","up"]},{"osd":9,"uuid":"d484f111-f36c-4c67-9a8a-ae03e7e0d137","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6826","nonce":3848110906},{"type":"v1","addr":"172.21.15.163:6827","nonce":3848110906}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6828","nonce":3848110906},{"type":"v1","addr":"172.21.15.163:6829","nonce":3848110906}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6832","nonce":3848110906},{"type":"v1","addr":"172.21.15.163:6833","nonce":3848110906}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6830","nonce":3848110906},{"type":"v1","addr":"172.21.15.163:6831","nonce":3848110906}]},"public_addr":"172.21.15.163:6827/3848110906","cluster_addr":"172.21.15.163:6829/3848110906","heartbeat_back_addr":"172.21.15.163:6833/3848110906","heartbeat_front_addr":"172.21.15.163:6831/3848110906","state":["exists","up"]},{"osd":10,"uuid":"d943f7c0-da3d-4605-9e23-0231e675c6be","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6824","nonce":3281085356},{"type":"v1","addr":"172.21.15.172:6825","nonce":3281085356}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":3281085356},{"type":"v1","addr":"172.21.15.172:6827","nonce":3281085356}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":3281085356},{"type":"v1","addr":"172.21.15.172:6831","nonce":3281085356}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6828","nonce":3281085356},{"type":"v1","addr":"172.21.15.172:6829","nonce":3281085356}]},"public_addr":"172.21.15.172:6825/3281085356","cluster_addr":"172.21.15.172:6827/3281085356","heartbeat_back_addr":"172.21.15.172:6831/3281085356","heartbeat_front_addr":"172.21.15.172:6829/3281085356","state":["exists","up"]},{"osd":11,"uuid":"09e610a8-408a-4119-a21b-c4de2810a538","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":75,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6824","nonce":3614578747},{"type":"v1","addr":"172.21.15.184:6825","nonce":3614578747}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6826","nonce":3614578747},{"type":"v1","addr":"172.21.15.184:6827","nonce":3614578747}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6830","nonce":3614578747},{"type":"v1","addr":"172.21.15.184:6831","nonce":3614578747}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6828","nonce":3614578747},{"type":"v1","addr":"172.21.15.184:6829","nonce":3614578747}]},"public_addr":"172.21.15.184:6825/3614578747","cluster_addr":"172.21.15.184:6827/3614578747","heartbeat_back_addr":"172.21.15.184:6831/3614578747","heartbeat_front_addr":"172.21.15.184:6829/3614578747","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T18:06:36.067578+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T18:06:57.095120+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T18:07:17.825363+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T18:07:38.977196+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T18:08:00.108709+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T18:08:20.700646+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T18:08:41.473899+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T18:09:02.856536+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T18:09:23.832722+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T18:09:44.860884+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T18:10:05.520678+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T18:10:26.426315+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.163:6801/1086512093":"2023-07-15T18:05:15.331458+0000","172.21.15.163:6800/1086512093":"2023-07-15T18:05:15.331458+0000","172.21.15.163:0/4235784810":"2023-07-15T18:05:15.331458+0000","172.21.15.163:6800/236891232":"2023-07-15T18:04:53.288443+0000","172.21.15.163:6801/236891232":"2023-07-15T18:04:53.288443+0000","172.21.15.163:0/3260193612":"2023-07-15T18:05:15.331458+0000","172.21.15.163:0/3513629472":"2023-07-15T18:04:53.288443+0000","172.21.15.163:0/1090329830":"2023-07-15T18:04:53.288443+0000","172.21.15.163:0/3868922045":"2023-07-15T18:05:15.331458+0000","172.21.15.163:0/2945662447":"2023-07-15T18:04:53.288443+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-14T18:11:16.631 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:16.593+0000 7f4b264d0700 1 -- 172.21.15.163:0/1237305555 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f4b0c0a11a0 msgr2=0x7f4b0c0a3650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:11:16.631 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:16.593+0000 7f4b264d0700 1 --2- 172.21.15.163:0/1237305555 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f4b0c0a11a0 0x7f4b0c0a3650 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f4b200680a0 tx=0x7f4b0800b410 comp rx=0 tx=0).stop 2023-07-14T18:11:16.632 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:16.593+0000 7f4b264d0700 1 -- 172.21.15.163:0/1237305555 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f4b200feb00 msgr2=0x7f4b20068330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:11:16.632 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:16.593+0000 7f4b264d0700 1 --2- 172.21.15.163:0/1237305555 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f4b200feb00 0x7f4b20068330 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f4b1000d980 tx=0x7f4b1000dc90 comp rx=0 tx=0).stop 2023-07-14T18:11:16.632 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:16.593+0000 7f4b264d0700 1 -- 172.21.15.163:0/1237305555 shutdown_connections 2023-07-14T18:11:16.632 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:16.593+0000 7f4b264d0700 1 --2- 172.21.15.163:0/1237305555 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f4b0c0a11a0 0x7f4b0c0a3650 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:16.632 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:16.593+0000 7f4b264d0700 1 --2- 172.21.15.163:0/1237305555 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4b20100680 0x7f4b2019cc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:16.632 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:16.593+0000 7f4b264d0700 1 --2- 172.21.15.163:0/1237305555 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f4b200feb00 0x7f4b20068330 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:16.632 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:16.593+0000 7f4b264d0700 1 --2- 172.21.15.163:0/1237305555 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4b200ffcf0 0x7f4b2019a630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:16.633 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:16.593+0000 7f4b264d0700 1 -- 172.21.15.163:0/1237305555 >> 172.21.15.163:0/1237305555 conn(0x7f4b200fa100 msgr2=0x7f4b201031a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:11:16.633 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:16.593+0000 7f4b264d0700 1 -- 172.21.15.163:0/1237305555 shutdown_connections 2023-07-14T18:11:16.633 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:16.593+0000 7f4b264d0700 1 -- 172.21.15.163:0/1237305555 wait complete. 2023-07-14T18:11:16.644 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 17, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-07-14T18:11:09.109693+0000', 'modified': '2023-07-14T18:11:14.786969+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 24518}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_24518': {'gid': 24518, 'name': 'b', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.172:6839/3850440096', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.172:6838', 'nonce': 3850440096}, {'type': 'v1', 'addr': '172.21.15.172:6839', 'nonce': 3850440096}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 1} 2023-07-14T18:11:16.645 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-07-14T18:11:16.645 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2023-07-14T18:11:16.769 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:16.730+0000 7fc1edeea700 1 -- 172.21.15.163:0/3813832445 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc1e80feb10 msgr2=0x7fc1e80fef20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:11:16.770 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:16.730+0000 7fc1edeea700 1 --2- 172.21.15.163:0/3813832445 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc1e80feb10 0x7fc1e80fef20 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fc1d0009990 tx=0x7fc1d0009ca0 comp rx=0 tx=0).stop 2023-07-14T18:11:16.770 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:16.730+0000 7fc1edeea700 1 -- 172.21.15.163:0/3813832445 shutdown_connections 2023-07-14T18:11:16.770 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:16.730+0000 7fc1edeea700 1 --2- 172.21.15.163:0/3813832445 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc1e8100690 0x7fc1e8106f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:16.770 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:16.730+0000 7fc1edeea700 1 --2- 172.21.15.163:0/3813832445 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc1e80feb10 0x7fc1e80fef20 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:16.770 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:16.730+0000 7fc1edeea700 1 --2- 172.21.15.163:0/3813832445 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc1e80ffd00 0x7fc1e8100150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:16.770 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:16.730+0000 7fc1edeea700 1 -- 172.21.15.163:0/3813832445 >> 172.21.15.163:0/3813832445 conn(0x7fc1e80fa130 msgr2=0x7fc1e80fc560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:11:16.770 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:16.730+0000 7fc1edeea700 1 -- 172.21.15.163:0/3813832445 shutdown_connections 2023-07-14T18:11:16.771 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:16.730+0000 7fc1edeea700 1 -- 172.21.15.163:0/3813832445 wait complete. 2023-07-14T18:11:16.771 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:16.731+0000 7fc1edeea700 1 Processor -- start 2023-07-14T18:11:16.773 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:16.731+0000 7fc1edeea700 1 -- start start 2023-07-14T18:11:16.773 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:16.731+0000 7fc1edeea700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc1e80feb10 0x7fc1e8194830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:11:16.773 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:16.731+0000 7fc1edeea700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc1e80ffd00 0x7fc1e8194d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:11:16.773 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:16.731+0000 7fc1edeea700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc1e8100690 0x7fc1e819bde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:11:16.773 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:16.731+0000 7fc1edeea700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1e819c3b0 con 0x7fc1e8100690 2023-07-14T18:11:16.773 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:16.731+0000 7fc1edeea700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1e819c4f0 con 0x7fc1e80feb10 2023-07-14T18:11:16.773 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:16.731+0000 7fc1edeea700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1e819c680 con 0x7fc1e80ffd00 2023-07-14T18:11:16.774 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:16.731+0000 7fc1e7fff700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc1e8100690 0x7fc1e819bde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:11:16.774 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:16.731+0000 7fc1e7fff700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc1e8100690 0x7fc1e819bde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:55868/0 (socket says 172.21.15.163:55868) 2023-07-14T18:11:16.774 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:16.731+0000 7fc1e7fff700 1 -- 172.21.15.163:0/815345974 learned_addr learned my addr 172.21.15.163:0/815345974 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:11:16.774 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:16.732+0000 7fc1e6ffd700 1 --2- 172.21.15.163:0/815345974 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc1e80ffd00 0x7fc1e8194d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:11:16.774 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:16.732+0000 7fc1e77fe700 1 --2- 172.21.15.163:0/815345974 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc1e80feb10 0x7fc1e8194830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:11:16.774 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:16.732+0000 7fc1e7fff700 1 -- 172.21.15.163:0/815345974 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc1e80ffd00 msgr2=0x7fc1e8194d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:11:16.774 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:16.732+0000 7fc1e7fff700 1 --2- 172.21.15.163:0/815345974 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc1e80ffd00 0x7fc1e8194d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:16.775 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:16.732+0000 7fc1e7fff700 1 -- 172.21.15.163:0/815345974 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc1e80feb10 msgr2=0x7fc1e8194830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:11:16.775 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:16.732+0000 7fc1e7fff700 1 --2- 172.21.15.163:0/815345974 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc1e80feb10 0x7fc1e8194830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:16.775 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:16.732+0000 7fc1e7fff700 1 -- 172.21.15.163:0/815345974 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1d00095f0 con 0x7fc1e8100690 2023-07-14T18:11:16.775 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:16.732+0000 7fc1e77fe700 1 --2- 172.21.15.163:0/815345974 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc1e80feb10 0x7fc1e8194830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T18:11:16.775 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:16.732+0000 7fc1e7fff700 1 --2- 172.21.15.163:0/815345974 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc1e8100690 0x7fc1e819bde0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fc1e0007ee0 tx=0x7fc1e000d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:11:16.775 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:16.732+0000 7fc1e4ff9700 1 -- 172.21.15.163:0/815345974 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1e0017070 con 0x7fc1e8100690 2023-07-14T18:11:16.775 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:16.732+0000 7fc1e4ff9700 1 -- 172.21.15.163:0/815345974 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fc1e000f040 con 0x7fc1e8100690 2023-07-14T18:11:16.775 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:16.732+0000 7fc1edeea700 1 -- 172.21.15.163:0/815345974 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc1e819c960 con 0x7fc1e8100690 2023-07-14T18:11:16.776 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:16.732+0000 7fc1e4ff9700 1 -- 172.21.15.163:0/815345974 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1e0005710 con 0x7fc1e8100690 2023-07-14T18:11:16.776 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:16.732+0000 7fc1edeea700 1 -- 172.21.15.163:0/815345974 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc1e819ce20 con 0x7fc1e8100690 2023-07-14T18:11:16.776 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:16.734+0000 7fc1e4ff9700 1 -- 172.21.15.163:0/815345974 <== mon.0 v2:172.21.15.163:3300/0 4 ==== mgrmap(e 16) v1 ==== 135716+0+0 (secure 0 0 0) 0x7fc1e0005870 con 0x7fc1e8100690 2023-07-14T18:11:16.781 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:16.735+0000 7fc1e4ff9700 1 --2- 172.21.15.163:0/815345974 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7fc1d40a1150 0x7fc1d40a3600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:11:16.781 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:16.735+0000 7fc1e77fe700 1 --2- 172.21.15.163:0/815345974 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7fc1d40a1150 0x7fc1d40a3600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:11:16.781 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:16.735+0000 7fc1e4ff9700 1 -- 172.21.15.163:0/815345974 <== mon.0 v2:172.21.15.163:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 8730+0+0 (secure 0 0 0) 0x7fc1e00cc370 con 0x7fc1e8100690 2023-07-14T18:11:16.781 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:16.735+0000 7fc1e77fe700 1 --2- 172.21.15.163:0/815345974 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7fc1d40a1150 0x7fc1d40a3600 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fc1d00098e0 tx=0x7fc1d0005fd0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:11:16.781 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:16.736+0000 7fc1fa082b80 1 Processor -- start 2023-07-14T18:11:16.781 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:16.736+0000 7fc1fa082b80 1 -- start start 2023-07-14T18:11:16.781 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:16.736+0000 7fc1fa082b80 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x564cb92cfec0 0x564cb92d02d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:11:16.782 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:16.736+0000 7fc1fa082b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564cb92d0810 0x564cb92d0e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:11:16.782 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:16.736+0000 7fc1fa082b80 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x564cb92d1410 0x564cb92d1880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:11:16.782 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:16.736+0000 7fc1fa082b80 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x564cb91d4c60 con 0x564cb92cfec0 2023-07-14T18:11:16.782 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:16.736+0000 7fc1fa082b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x564cb92279f0 con 0x564cb92d0810 2023-07-14T18:11:16.782 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:16.736+0000 7fc1fa082b80 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x564cb9220e80 con 0x564cb92d1410 2023-07-14T18:11:16.782 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:16.736+0000 7fc1e77fe700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x564cb92cfec0 0x564cb92d02d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:11:16.782 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:16.736+0000 7fc1e77fe700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x564cb92cfec0 0x564cb92d02d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:55872/0 (socket says 172.21.15.163:55872) 2023-07-14T18:11:16.783 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:16.736+0000 7fc1e77fe700 1 -- 172.21.15.163:0/4203211569 learned_addr learned my addr 172.21.15.163:0/4203211569 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:11:16.783 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:16.736+0000 7fc1e6ffd700 1 --2- 172.21.15.163:0/4203211569 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564cb92d0810 0x564cb92d0e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:11:16.783 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:16.736+0000 7fc1e7fff700 1 --2- 172.21.15.163:0/4203211569 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x564cb92d1410 0x564cb92d1880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:11:16.783 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:16.736+0000 7fc1e77fe700 1 -- 172.21.15.163:0/4203211569 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x564cb92d1410 msgr2=0x564cb92d1880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:11:16.783 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:16.736+0000 7fc1e77fe700 1 --2- 172.21.15.163:0/4203211569 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x564cb92d1410 0x564cb92d1880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:16.783 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:16.736+0000 7fc1e77fe700 1 -- 172.21.15.163:0/4203211569 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564cb92d0810 msgr2=0x564cb92d0e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:11:16.783 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:16.736+0000 7fc1e77fe700 1 --2- 172.21.15.163:0/4203211569 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564cb92d0810 0x564cb92d0e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:16.784 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:16.736+0000 7fc1e77fe700 1 -- 172.21.15.163:0/4203211569 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564cb904ed90 con 0x564cb92cfec0 2023-07-14T18:11:16.784 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:16.736+0000 7fc1e7fff700 1 --2- 172.21.15.163:0/4203211569 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x564cb92d1410 0x564cb92d1880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T18:11:16.784 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:16.736+0000 7fc1e77fe700 1 --2- 172.21.15.163:0/4203211569 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x564cb92cfec0 0x564cb92d02d0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fc1e80ffb60 tx=0x7fc1d001f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ece0c7537f1d6d8 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:11:16.784 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:16.737+0000 7fc1ddffb700 1 -- 172.21.15.163:0/4203211569 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1d002b070 con 0x564cb92cfec0 2023-07-14T18:11:16.784 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:16.737+0000 7fc1ddffb700 1 -- 172.21.15.163:0/4203211569 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fc1d001e040 con 0x564cb92cfec0 2023-07-14T18:11:16.784 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:16.737+0000 7fc1ddffb700 1 -- 172.21.15.163:0/4203211569 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1d000f750 con 0x564cb92cfec0 2023-07-14T18:11:16.784 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:16.737+0000 7fc1fa082b80 1 -- 172.21.15.163:0/4203211569 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x564cb92cfec0 msgr2=0x564cb92d02d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:11:16.785 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:16.737+0000 7fc1fa082b80 1 --2- 172.21.15.163:0/4203211569 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x564cb92cfec0 0x564cb92d02d0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fc1e80ffb60 tx=0x7fc1d001f000 comp rx=0 tx=0).stop 2023-07-14T18:11:16.785 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:16.737+0000 7fc1fa082b80 1 -- 172.21.15.163:0/4203211569 shutdown_connections 2023-07-14T18:11:16.785 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:16.737+0000 7fc1fa082b80 1 --2- 172.21.15.163:0/4203211569 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x564cb92d1410 0x564cb92d1880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:16.785 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:16.737+0000 7fc1fa082b80 1 --2- 172.21.15.163:0/4203211569 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x564cb92cfec0 0x564cb92d02d0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:16.785 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:16.737+0000 7fc1fa082b80 1 --2- 172.21.15.163:0/4203211569 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564cb92d0810 0x564cb92d0e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:16.785 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:16.737+0000 7fc1fa082b80 1 -- 172.21.15.163:0/4203211569 >> 172.21.15.163:0/4203211569 conn(0x564cb92c5630 msgr2=0x564cb92ca980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:11:16.785 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:16.737+0000 7fc1fa082b80 1 -- 172.21.15.163:0/4203211569 shutdown_connections 2023-07-14T18:11:16.786 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:16.737+0000 7fc1fa082b80 1 -- 172.21.15.163:0/4203211569 wait complete. 2023-07-14T18:11:16.786 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:16.738+0000 7fc1fa082b80 1 -- start start 2023-07-14T18:11:16.786 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:16.738+0000 7fc1fa082b80 1 Processor -- start 2023-07-14T18:11:16.786 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:16.738+0000 7fc1fa082b80 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x564cb92cfec0 0x564cb92e2080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:11:16.786 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:16.738+0000 7fc1fa082b80 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x564cb92d0810 0x564cb92e25c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:11:16.786 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:16.738+0000 7fc1fa082b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564cb92d1410 0x564cb92e9600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:11:16.786 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:16.738+0000 7fc1fa082b80 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x564cb91c0a70 con 0x564cb92cfec0 2023-07-14T18:11:16.786 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:16.738+0000 7fc1fa082b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x564cb91c0770 con 0x564cb92d1410 2023-07-14T18:11:16.787 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:16.738+0000 7fc1fa082b80 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x564cb90a48d0 con 0x564cb92d0810 2023-07-14T18:11:16.787 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:16.738+0000 7fc1fa082b80 10 client.0 _ll_register_callbacks cb 0x564cb91be710 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T18:11:16.787 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:16.738+0000 7fc1e77fe700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x564cb92cfec0 0x564cb92e2080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:11:16.787 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:16.738+0000 7fc1e77fe700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x564cb92cfec0 0x564cb92e2080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:55878/0 (socket says 172.21.15.163:55878) 2023-07-14T18:11:16.787 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:16.738+0000 7fc1e77fe700 1 -- 172.21.15.163:0/1152076863 learned_addr learned my addr 172.21.15.163:0/1152076863 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:11:16.787 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:16.738+0000 7fc1e6ffd700 1 --2- 172.21.15.163:0/1152076863 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x564cb92d0810 0x564cb92e25c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:11:16.787 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:16.738+0000 7fc1e77fe700 1 -- 172.21.15.163:0/1152076863 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x564cb92d0810 msgr2=0x564cb92e25c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:11:16.788 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:16.738+0000 7fc1e77fe700 1 --2- 172.21.15.163:0/1152076863 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x564cb92d0810 0x564cb92e25c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:16.788 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:16.738+0000 7fc1e77fe700 1 -- 172.21.15.163:0/1152076863 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564cb92d1410 msgr2=0x564cb92e9600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:11:16.788 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:16.738+0000 7fc1e7fff700 1 --2- 172.21.15.163:0/1152076863 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564cb92d1410 0x564cb92e9600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:11:16.788 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:16.738+0000 7fc1e77fe700 1 --2- 172.21.15.163:0/1152076863 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564cb92d1410 0x564cb92e9600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:16.788 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:16.738+0000 7fc1e77fe700 1 -- 172.21.15.163:0/1152076863 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc1e8107880 con 0x564cb92cfec0 2023-07-14T18:11:16.788 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:16.739+0000 7fc1e77fe700 1 --2- 172.21.15.163:0/1152076863 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x564cb92cfec0 0x564cb92e2080 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fc1d0009990 tx=0x7fc1d000fcd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1fb0139c42ef22e5 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:11:16.788 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:16.739+0000 7fc1c6ffd700 10 client.0 ms_handle_connect on v2:172.21.15.163:3300/0 2023-07-14T18:11:16.788 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:16.739+0000 7fc1c6ffd700 1 -- 172.21.15.163:0/1152076863 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1d002b070 con 0x564cb92cfec0 2023-07-14T18:11:16.789 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:16.739+0000 7fc1c6ffd700 1 -- 172.21.15.163:0/1152076863 <== mon.0 v2:172.21.15.163:3300/0 2 ==== osd_map(84..84 src has 1..84) v4 ==== 8730+0+0 (secure 0 0 0) 0x7fc1d0003c70 con 0x564cb92cfec0 2023-07-14T18:11:16.789 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:16.739+0000 7fc1fa082b80 1 -- 172.21.15.163:0/1152076863 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x564cb917a4a0 con 0x564cb92cfec0 2023-07-14T18:11:16.789 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:16.739+0000 7fc1c6ffd700 1 -- 172.21.15.163:0/1152076863 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc1d000b8c0 con 0x564cb92cfec0 2023-07-14T18:11:16.789 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:16.739+0000 7fc1fa082b80 10 client.14772 fetch_fsmap learned FSMap version 17 2023-07-14T18:11:16.789 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:16.739+0000 7fc1fa082b80 1 -- 172.21.15.163:0/1152076863 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=4+}) v3 -- 0x564cb9037c10 con 0x564cb92cfec0 2023-07-14T18:11:16.789 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:16.739+0000 7fc1c6ffd700 1 -- 172.21.15.163:0/1152076863 <== mon.0 v2:172.21.15.163:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x564cb917a4a0 con 0x564cb92cfec0 2023-07-14T18:11:16.789 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:16.739+0000 7fc1c6ffd700 1 -- 172.21.15.163:0/1152076863 <== mon.0 v2:172.21.15.163:3300/0 5 ==== fsmap(e 17) v1 ==== 7482+0+0 (secure 0 0 0) 0x7fc1d0004880 con 0x564cb92cfec0 2023-07-14T18:11:16.789 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:16.739+0000 7fc1fa082b80 10 client.14772 fetch_fsmap finished waiting for FSMap version 17 2023-07-14T18:11:16.790 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:16.739+0000 7fc1fa082b80 10 client.14772 resolve_mds: resolved name 'b' to daemon mds.b 2023-07-14T18:11:16.790 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:16.739+0000 7fc1fa082b80 20 client.14772 populate_metadata read hostname 'smithi163' 2023-07-14T18:11:16.790 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:16.739+0000 7fc1fa082b80 1 --2- 172.21.15.163:0/1152076863 >> [v2:172.21.15.172:6838/3850440096,v1:172.21.15.172:6839/3850440096] conn(0x564cb92ecde0 0x564cb92ec4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:11:16.790 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:16.739+0000 7fc1fa082b80 4 client.14772 mds_command: new command op to 24518 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-14T18:11:16.790 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:16.739+0000 7fc1fa082b80 1 -- 172.21.15.163:0/1152076863 --> [v2:172.21.15.172:6838/3850440096,v1:172.21.15.172:6839/3850440096] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x564cb929ed50 con 0x564cb92ecde0 2023-07-14T18:11:16.790 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:16.740+0000 7fc1e6ffd700 1 --2- 172.21.15.163:0/1152076863 >> [v2:172.21.15.172:6838/3850440096,v1:172.21.15.172:6839/3850440096] conn(0x564cb92ecde0 0x564cb92ec4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:11:16.790 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:16.740+0000 7fc1c6ffd700 10 client.14772 ms_handle_connect on v2:172.21.15.172:6838/3850440096 2023-07-14T18:11:16.791 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:16.740+0000 7fc1e6ffd700 1 --2- 172.21.15.163:0/1152076863 >> [v2:172.21.15.172:6838/3850440096,v1:172.21.15.172:6839/3850440096] conn(0x564cb92ecde0 0x564cb92ec4a0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=be48d8d848084875 server_cookie=aac1d28a8ac73ce in_seq=0 out_seq=0 2023-07-14T18:11:16.791 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:16.741+0000 7fc1c6ffd700 1 -- 172.21.15.163:0/1152076863 <== mds.0 v2:172.21.15.172:6838/3850440096 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18017 (crc 0 0 0) 0x564cb929ed50 con 0x564cb92ecde0 2023-07-14T18:11:16.791 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:16.741+0000 7fc1c6ffd700 10 client.14772 handle_command_reply: tid=0 2023-07-14T18:11:16.791 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:16.741+0000 7fc1fa082b80 1 client.14772 shutdown 2023-07-14T18:11:16.791 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:16.741+0000 7fc1fa082b80 1 -- 172.21.15.163:0/1152076863 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x564cb92cfec0 msgr2=0x564cb92e2080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:11:16.791 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:16.741+0000 7fc1fa082b80 1 --2- 172.21.15.163:0/1152076863 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x564cb92cfec0 0x564cb92e2080 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fc1d0009990 tx=0x7fc1d000fcd0 comp rx=0 tx=0).stop 2023-07-14T18:11:16.791 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:16.741+0000 7fc1fa082b80 1 -- 172.21.15.163:0/1152076863 shutdown_connections 2023-07-14T18:11:16.791 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:16.741+0000 7fc1fa082b80 1 --2- 172.21.15.163:0/1152076863 >> [v2:172.21.15.172:6838/3850440096,v1:172.21.15.172:6839/3850440096] conn(0x564cb92ecde0 0x564cb92ec4a0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:16.792 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:16.741+0000 7fc1fa082b80 1 --2- 172.21.15.163:0/1152076863 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564cb92d1410 0x564cb92e9600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:16.792 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:16.741+0000 7fc1c6ffd700 0 client.14772 ms_handle_reset on v2:172.21.15.172:6838/3850440096 2023-07-14T18:11:16.792 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:16.741+0000 7fc1fa082b80 1 --2- 172.21.15.163:0/1152076863 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x564cb92cfec0 0x564cb92e2080 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:16.792 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:16.741+0000 7fc1fa082b80 1 --2- 172.21.15.163:0/1152076863 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x564cb92d0810 0x564cb92e25c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:16.792 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:16.741+0000 7fc1fa082b80 1 -- 172.21.15.163:0/1152076863 >> 172.21.15.163:0/1152076863 conn(0x564cb92c5630 msgr2=0x564cb92c9600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:11:16.792 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:16.741+0000 7fc1fa082b80 1 -- 172.21.15.163:0/1152076863 shutdown_connections 2023-07-14T18:11:16.792 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:16.741+0000 7fc1fa082b80 1 -- 172.21.15.163:0/1152076863 wait complete. 2023-07-14T18:11:16.793 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:16.741+0000 7fc1fa082b80 20 client.14772 trim_cache size 0 max 16384 2023-07-14T18:11:16.798 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:16.758+0000 7fc1fa082b80 1 Processor -- start 2023-07-14T18:11:16.798 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:16.758+0000 7fc1fa082b80 1 -- start start 2023-07-14T18:11:16.798 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:16.759+0000 7fc1fa082b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564cb92cfec0 0x564cb92d2560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:11:16.798 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:16.759+0000 7fc1fa082b80 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x564cb92d0810 0x564cb92e95c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:11:16.798 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:16.759+0000 7fc1fa082b80 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x564cb92d1410 0x564cb92d2aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:11:16.799 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:16.759+0000 7fc1fa082b80 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x564cb917a4d0 con 0x564cb92d0810 2023-07-14T18:11:16.799 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:16.759+0000 7fc1fa082b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x564cb92cbe60 con 0x564cb92cfec0 2023-07-14T18:11:16.799 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:16.759+0000 7fc1fa082b80 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x564cb91ef790 con 0x564cb92d1410 2023-07-14T18:11:16.799 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:16.759+0000 7fc1e6ffd700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x564cb92d0810 0x564cb92e95c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:11:16.799 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:16.759+0000 7fc1e6ffd700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x564cb92d0810 0x564cb92e95c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:55888/0 (socket says 172.21.15.163:55888) 2023-07-14T18:11:16.799 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:16.759+0000 7fc1e6ffd700 1 -- 172.21.15.163:0/1512912828 learned_addr learned my addr 172.21.15.163:0/1512912828 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:11:16.799 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:16.759+0000 7fc1e77fe700 1 --2- 172.21.15.163:0/1512912828 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564cb92cfec0 0x564cb92d2560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:11:16.800 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:16.759+0000 7fc1e7fff700 1 --2- 172.21.15.163:0/1512912828 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x564cb92d1410 0x564cb92d2aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:11:16.800 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:16.759+0000 7fc1e6ffd700 1 -- 172.21.15.163:0/1512912828 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x564cb92d1410 msgr2=0x564cb92d2aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:11:16.800 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:16.759+0000 7fc1e6ffd700 1 --2- 172.21.15.163:0/1512912828 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x564cb92d1410 0x564cb92d2aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:16.800 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:16.759+0000 7fc1e6ffd700 1 -- 172.21.15.163:0/1512912828 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564cb92cfec0 msgr2=0x564cb92d2560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:11:16.800 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:16.759+0000 7fc1e6ffd700 1 --2- 172.21.15.163:0/1512912828 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564cb92cfec0 0x564cb92d2560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:16.800 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:16.759+0000 7fc1e6ffd700 1 -- 172.21.15.163:0/1512912828 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564cb9075200 con 0x564cb92d0810 2023-07-14T18:11:16.800 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:16.759+0000 7fc1e6ffd700 1 --2- 172.21.15.163:0/1512912828 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x564cb92d0810 0x564cb92e95c0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fc1d8005d90 tx=0x7fc1d8009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce6a5155925da76f server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:11:16.801 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:16.759+0000 7fc1de7fc700 1 -- 172.21.15.163:0/1512912828 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1d8017070 con 0x564cb92d0810 2023-07-14T18:11:16.801 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:16.759+0000 7fc1de7fc700 1 -- 172.21.15.163:0/1512912828 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fc1d8018040 con 0x564cb92d0810 2023-07-14T18:11:16.801 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:16.759+0000 7fc1de7fc700 1 -- 172.21.15.163:0/1512912828 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1d8010430 con 0x564cb92d0810 2023-07-14T18:11:16.804 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:16.760+0000 7fc1fa082b80 1 -- 172.21.15.163:0/1512912828 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x564cb92d0810 msgr2=0x564cb92e95c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:11:16.804 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:16.760+0000 7fc1fa082b80 1 --2- 172.21.15.163:0/1512912828 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x564cb92d0810 0x564cb92e95c0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fc1d8005d90 tx=0x7fc1d8009260 comp rx=0 tx=0).stop 2023-07-14T18:11:16.804 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:16.760+0000 7fc1fa082b80 1 -- 172.21.15.163:0/1512912828 shutdown_connections 2023-07-14T18:11:16.804 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:16.760+0000 7fc1fa082b80 1 --2- 172.21.15.163:0/1512912828 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x564cb92d1410 0x564cb92d2aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:16.804 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:16.760+0000 7fc1fa082b80 1 --2- 172.21.15.163:0/1512912828 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564cb92cfec0 0x564cb92d2560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:16.804 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:16.760+0000 7fc1fa082b80 1 --2- 172.21.15.163:0/1512912828 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x564cb92d0810 0x564cb92e95c0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:16.805 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:16.760+0000 7fc1fa082b80 1 -- 172.21.15.163:0/1512912828 >> 172.21.15.163:0/1512912828 conn(0x564cb92c5630 msgr2=0x564cb92dcfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:11:16.805 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:16.760+0000 7fc1fa082b80 1 -- 172.21.15.163:0/1512912828 shutdown_connections 2023-07-14T18:11:16.805 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:16.760+0000 7fc1fa082b80 1 -- 172.21.15.163:0/1512912828 wait complete. 2023-07-14T18:11:16.805 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:16.760+0000 7fc1fa082b80 1 -- start start 2023-07-14T18:11:16.805 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:16.760+0000 7fc1fa082b80 1 Processor -- start 2023-07-14T18:11:16.805 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:16.761+0000 7fc1fa082b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564cb92cfec0 0x564cb92e4e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:11:16.805 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:16.761+0000 7fc1fa082b80 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x564cb92d0810 0x564cb92e5370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:11:16.805 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:16.761+0000 7fc1fa082b80 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x564cb92d1410 0x564cb92e8390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:11:16.806 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:16.761+0000 7fc1fa082b80 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x564cb92e88d0 con 0x564cb92d0810 2023-07-14T18:11:16.806 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:16.761+0000 7fc1fa082b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x564cb92e8a40 con 0x564cb92cfec0 2023-07-14T18:11:16.806 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:16.761+0000 7fc1fa082b80 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x564cb92e8c00 con 0x564cb92d1410 2023-07-14T18:11:16.806 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:16.761+0000 7fc1fa082b80 10 client.0 _ll_register_callbacks cb 0x564cb91be710 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T18:11:16.806 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:16.761+0000 7fc1e6ffd700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x564cb92d0810 0x564cb92e5370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:11:16.806 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:16.761+0000 7fc1e6ffd700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x564cb92d0810 0x564cb92e5370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:55894/0 (socket says 172.21.15.163:55894) 2023-07-14T18:11:16.806 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:16.761+0000 7fc1e6ffd700 1 -- 172.21.15.163:0/1336570026 learned_addr learned my addr 172.21.15.163:0/1336570026 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:11:16.807 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:16.761+0000 7fc1e77fe700 1 --2- 172.21.15.163:0/1336570026 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564cb92cfec0 0x564cb92e4e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:11:16.807 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:16.761+0000 7fc1e7fff700 1 --2- 172.21.15.163:0/1336570026 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x564cb92d1410 0x564cb92e8390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:11:16.807 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:16.761+0000 7fc1e6ffd700 1 -- 172.21.15.163:0/1336570026 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x564cb92d1410 msgr2=0x564cb92e8390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:11:16.807 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:16.761+0000 7fc1e6ffd700 1 --2- 172.21.15.163:0/1336570026 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x564cb92d1410 0x564cb92e8390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:16.807 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:16.761+0000 7fc1e6ffd700 1 -- 172.21.15.163:0/1336570026 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564cb92cfec0 msgr2=0x564cb92e4e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:11:16.807 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:16.761+0000 7fc1e6ffd700 1 --2- 172.21.15.163:0/1336570026 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564cb92cfec0 0x564cb92e4e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:16.807 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:16.761+0000 7fc1e6ffd700 1 -- 172.21.15.163:0/1336570026 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc1d8009e50 con 0x564cb92d0810 2023-07-14T18:11:16.807 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:16.761+0000 7fc1e6ffd700 1 --2- 172.21.15.163:0/1336570026 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x564cb92d0810 0x564cb92e5370 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fc1d8009d40 tx=0x7fc1d8003d90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=87a7ef4725fed637 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:11:16.808 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:16.761+0000 7fc1c6ffd700 10 client.0 ms_handle_connect on v2:172.21.15.163:3300/0 2023-07-14T18:11:16.808 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:16.761+0000 7fc1c6ffd700 1 -- 172.21.15.163:0/1336570026 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1d8017030 con 0x564cb92d0810 2023-07-14T18:11:16.808 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:16.761+0000 7fc1c6ffd700 1 -- 172.21.15.163:0/1336570026 <== mon.0 v2:172.21.15.163:3300/0 2 ==== osd_map(84..84 src has 1..84) v4 ==== 8730+0+0 (secure 0 0 0) 0x7fc1d801eac0 con 0x564cb92d0810 2023-07-14T18:11:16.808 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:16.761+0000 7fc1fa082b80 1 -- 172.21.15.163:0/1336570026 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fc1d001e040 con 0x564cb92d0810 2023-07-14T18:11:16.808 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:16.762+0000 7fc1c6ffd700 1 -- 172.21.15.163:0/1336570026 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc1d801ecc0 con 0x564cb92d0810 2023-07-14T18:11:16.808 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:16.762+0000 7fc1fa082b80 10 client.14778 fetch_fsmap learned FSMap version 17 2023-07-14T18:11:16.808 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:16.762+0000 7fc1fa082b80 1 -- 172.21.15.163:0/1336570026 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=4+}) v3 -- 0x564cb904d260 con 0x564cb92d0810 2023-07-14T18:11:16.808 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:16.762+0000 7fc1c6ffd700 1 -- 172.21.15.163:0/1336570026 <== mon.0 v2:172.21.15.163:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fc1d803c020 con 0x564cb92d0810 2023-07-14T18:11:16.809 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:16.762+0000 7fc1c6ffd700 1 -- 172.21.15.163:0/1336570026 <== mon.0 v2:172.21.15.163:3300/0 5 ==== fsmap(e 17) v1 ==== 7482+0+0 (secure 0 0 0) 0x7fc1d8025070 con 0x564cb92d0810 2023-07-14T18:11:16.809 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:16.762+0000 7fc1fa082b80 10 client.14778 fetch_fsmap finished waiting for FSMap version 17 2023-07-14T18:11:16.809 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:16.762+0000 7fc1fa082b80 10 client.14778 resolve_mds: resolved name 'b' to daemon mds.b 2023-07-14T18:11:16.809 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:16.762+0000 7fc1fa082b80 20 client.14778 populate_metadata read hostname 'smithi163' 2023-07-14T18:11:16.809 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:16.762+0000 7fc1fa082b80 1 --2- 172.21.15.163:0/1336570026 >> [v2:172.21.15.172:6838/3850440096,v1:172.21.15.172:6839/3850440096] conn(0x564cb9346850 0x564cb93431e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:11:16.809 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:16.762+0000 7fc1fa082b80 4 client.14778 mds_command: new command op to 24518 tid=0[{"prefix": "status"}] 2023-07-14T18:11:16.809 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:16.762+0000 7fc1fa082b80 1 -- 172.21.15.163:0/1336570026 --> [v2:172.21.15.172:6838/3850440096,v1:172.21.15.172:6839/3850440096] -- command(tid 0: {"prefix": "status"}) v1 -- 0x564cb9219e60 con 0x564cb9346850 2023-07-14T18:11:16.810 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:16.762+0000 7fc1e77fe700 1 --2- 172.21.15.163:0/1336570026 >> [v2:172.21.15.172:6838/3850440096,v1:172.21.15.172:6839/3850440096] conn(0x564cb9346850 0x564cb93431e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:11:16.810 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:16.763+0000 7fc1c6ffd700 10 client.14778 ms_handle_connect on v2:172.21.15.172:6838/3850440096 2023-07-14T18:11:16.810 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:16.763+0000 7fc1e77fe700 1 --2- 172.21.15.163:0/1336570026 >> [v2:172.21.15.172:6838/3850440096,v1:172.21.15.172:6839/3850440096] conn(0x564cb9346850 0x564cb93431e0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=72099e9c62f3abf5 server_cookie=41b2e09586a2b5b4 in_seq=0 out_seq=0 2023-07-14T18:11:16.810 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:16.763+0000 7fc1c6ffd700 1 -- 172.21.15.163:0/1336570026 <== mds.0 v2:172.21.15.172:6838/3850440096 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+326 (crc 0 0 0) 0x564cb9219e60 con 0x564cb9346850 2023-07-14T18:11:16.810 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:16.763+0000 7fc1c6ffd700 10 client.14778 handle_command_reply: tid=0 2023-07-14T18:11:16.810 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:16.763+0000 7fc1fa082b80 1 client.14778 shutdown 2023-07-14T18:11:16.810 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:16.763+0000 7fc1fa082b80 1 -- 172.21.15.163:0/1336570026 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x564cb92d0810 msgr2=0x564cb92e5370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:11:16.811 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:16.763+0000 7fc1fa082b80 1 --2- 172.21.15.163:0/1336570026 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x564cb92d0810 0x564cb92e5370 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fc1d8009d40 tx=0x7fc1d8003d90 comp rx=0 tx=0).stop 2023-07-14T18:11:16.811 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:16.763+0000 7fc1fa082b80 1 -- 172.21.15.163:0/1336570026 shutdown_connections 2023-07-14T18:11:16.811 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:16.763+0000 7fc1fa082b80 1 --2- 172.21.15.163:0/1336570026 >> [v2:172.21.15.172:6838/3850440096,v1:172.21.15.172:6839/3850440096] conn(0x564cb9346850 0x564cb93431e0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:16.811 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:16.763+0000 7fc1fa082b80 1 --2- 172.21.15.163:0/1336570026 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x564cb92d1410 0x564cb92e8390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:16.811 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:16.763+0000 7fc1fa082b80 1 --2- 172.21.15.163:0/1336570026 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564cb92cfec0 0x564cb92e4e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:16.811 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:16.763+0000 7fc1c6ffd700 0 client.14778 ms_handle_reset on v2:172.21.15.172:6838/3850440096 2023-07-14T18:11:16.811 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:16.763+0000 7fc1fa082b80 1 --2- 172.21.15.163:0/1336570026 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x564cb92d0810 0x564cb92e5370 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:16.811 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:16.763+0000 7fc1fa082b80 1 -- 172.21.15.163:0/1336570026 >> 172.21.15.163:0/1336570026 conn(0x564cb92c5630 msgr2=0x564cb92d2560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:11:16.812 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:16.763+0000 7fc1fa082b80 1 -- 172.21.15.163:0/1336570026 shutdown_connections 2023-07-14T18:11:16.812 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:16.763+0000 7fc1fa082b80 1 -- 172.21.15.163:0/1336570026 wait complete. 2023-07-14T18:11:16.812 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:16.763+0000 7fc1fa082b80 20 client.14778 trim_cache size 0 max 16384 2023-07-14T18:11:16.812 INFO:teuthology.orchestra.run.smithi163.stdout:{ 2023-07-14T18:11:16.813 INFO:teuthology.orchestra.run.smithi163.stdout: "cluster_fsid": "bf7326ec-2270-11ee-9b33-001a4aab830c", 2023-07-14T18:11:16.813 INFO:teuthology.orchestra.run.smithi163.stdout: "whoami": 0, 2023-07-14T18:11:16.813 INFO:teuthology.orchestra.run.smithi163.stdout: "id": 24518, 2023-07-14T18:11:16.813 INFO:teuthology.orchestra.run.smithi163.stdout: "want_state": "up:active", 2023-07-14T18:11:16.813 INFO:teuthology.orchestra.run.smithi163.stdout: "state": "up:active", 2023-07-14T18:11:16.813 INFO:teuthology.orchestra.run.smithi163.stdout: "fs_name": "cephfs", 2023-07-14T18:11:16.813 INFO:teuthology.orchestra.run.smithi163.stdout: "rank_uptime": 7.0567449099999999, 2023-07-14T18:11:16.814 INFO:teuthology.orchestra.run.smithi163.stdout: "mdsmap_epoch": 17, 2023-07-14T18:11:16.814 INFO:teuthology.orchestra.run.smithi163.stdout: "osdmap_epoch": 84, 2023-07-14T18:11:16.814 INFO:teuthology.orchestra.run.smithi163.stdout: "osdmap_epoch_barrier": 83, 2023-07-14T18:11:16.814 INFO:teuthology.orchestra.run.smithi163.stdout: "uptime": 13.170862439 2023-07-14T18:11:16.814 INFO:teuthology.orchestra.run.smithi163.stdout:} 2023-07-14T18:11:16.815 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:16.764+0000 7fc1edeea700 1 -- 172.21.15.163:0/815345974 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7fc1d40a1150 msgr2=0x7fc1d40a3600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:11:16.815 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:16.764+0000 7fc1edeea700 1 --2- 172.21.15.163:0/815345974 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7fc1d40a1150 0x7fc1d40a3600 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fc1d00098e0 tx=0x7fc1d0005fd0 comp rx=0 tx=0).stop 2023-07-14T18:11:16.815 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:16.764+0000 7fc1edeea700 1 -- 172.21.15.163:0/815345974 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc1e8100690 msgr2=0x7fc1e819bde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:11:16.816 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:16.764+0000 7fc1edeea700 1 --2- 172.21.15.163:0/815345974 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc1e8100690 0x7fc1e819bde0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fc1e0007ee0 tx=0x7fc1e000d3b0 comp rx=0 tx=0).stop 2023-07-14T18:11:16.816 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:16.764+0000 7fc1edeea700 1 -- 172.21.15.163:0/815345974 shutdown_connections 2023-07-14T18:11:16.816 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:16.764+0000 7fc1edeea700 1 --2- 172.21.15.163:0/815345974 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7fc1d40a1150 0x7fc1d40a3600 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:16.816 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:16.764+0000 7fc1edeea700 1 --2- 172.21.15.163:0/815345974 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc1e8100690 0x7fc1e819bde0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:16.816 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:16.764+0000 7fc1edeea700 1 --2- 172.21.15.163:0/815345974 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc1e80feb10 0x7fc1e8194830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:16.816 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:16.764+0000 7fc1edeea700 1 --2- 172.21.15.163:0/815345974 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc1e80ffd00 0x7fc1e8194d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:16.816 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:16.764+0000 7fc1edeea700 1 -- 172.21.15.163:0/815345974 >> 172.21.15.163:0/815345974 conn(0x7fc1e80fa130 msgr2=0x7fc1e80fc4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:11:16.817 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:16.764+0000 7fc1edeea700 1 -- 172.21.15.163:0/815345974 shutdown_connections 2023-07-14T18:11:16.817 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:16.764+0000 7fc1edeea700 1 -- 172.21.15.163:0/815345974 wait complete. 2023-07-14T18:11:16.817 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-07-14T18:11:16.818 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2023-07-14T18:11:16.819 DEBUG:teuthology.orchestra.run.smithi163:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81c9387d2e7576da065747ec9c16d1c7d69016ec shell --fsid bf7326ec-2270-11ee-9b33-001a4aab830c -- ceph fs ls 2023-07-14T18:11:16.966 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:11:16 smithi163 ceph-mon[96576]: from='client.? 172.21.15.163:0/3715654348' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-07-14T18:11:16.966 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:11:16 smithi163 ceph-mon[96576]: from='client.? 172.21.15.163:0/2335422603' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-07-14T18:11:16.966 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:11:16 smithi163 ceph-mon[96576]: from='client.? 172.21.15.163:0/1237305555' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-07-14T18:11:17.173 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:11:16 smithi184 ceph-mon[98481]: from='client.? 172.21.15.163:0/3715654348' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-07-14T18:11:17.174 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:11:16 smithi184 ceph-mon[98481]: from='client.? 172.21.15.163:0/2335422603' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-07-14T18:11:17.174 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:11:16 smithi184 ceph-mon[98481]: from='client.? 172.21.15.163:0/1237305555' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-07-14T18:11:17.274 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:11:16 smithi172 ceph-mon[97983]: from='client.? 172.21.15.163:0/3715654348' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-07-14T18:11:17.275 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:11:16 smithi172 ceph-mon[97983]: from='client.? 172.21.15.163:0/2335422603' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-07-14T18:11:17.275 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:11:16 smithi172 ceph-mon[97983]: from='client.? 172.21.15.163:0/1237305555' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-07-14T18:11:17.366 INFO:teuthology.orchestra.run.smithi163.stderr:Inferring config /var/lib/ceph/bf7326ec-2270-11ee-9b33-001a4aab830c/mon.a/config 2023-07-14T18:11:18.173 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:11:17 smithi184 ceph-mon[98481]: pgmap v255: 129 pgs: 9 creating+peering, 109 active+clean, 11 unknown; 579 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s wr, 3 op/s 2023-07-14T18:11:18.216 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:11:17 smithi163 ceph-mon[96576]: pgmap v255: 129 pgs: 9 creating+peering, 109 active+clean, 11 unknown; 579 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s wr, 3 op/s 2023-07-14T18:11:18.274 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:11:17 smithi172 ceph-mon[97983]: pgmap v255: 129 pgs: 9 creating+peering, 109 active+clean, 11 unknown; 579 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s wr, 3 op/s 2023-07-14T18:11:18.435 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:18.397+0000 7fccb881c700 1 -- 172.21.15.163:0/1359803544 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fccb40ff360 msgr2=0x7fccb40ff7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:11:18.436 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:18.397+0000 7fccb881c700 1 --2- 172.21.15.163:0/1359803544 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fccb40ff360 0x7fccb40ff7d0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fcca80099c0 tx=0x7fcca8009cd0 comp rx=0 tx=0).stop 2023-07-14T18:11:18.436 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:18.397+0000 7fccb881c700 1 -- 172.21.15.163:0/1359803544 shutdown_connections 2023-07-14T18:11:18.436 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:18.397+0000 7fccb881c700 1 --2- 172.21.15.163:0/1359803544 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fccb4103ba0 0x7fccb4103f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:18.436 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:18.397+0000 7fccb881c700 1 --2- 172.21.15.163:0/1359803544 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fccb40ffd10 0x7fccb410ba40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:18.436 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:18.397+0000 7fccb881c700 1 --2- 172.21.15.163:0/1359803544 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fccb40ff360 0x7fccb40ff7d0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:18.436 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:18.397+0000 7fccb881c700 1 -- 172.21.15.163:0/1359803544 >> 172.21.15.163:0/1359803544 conn(0x7fccb4075280 msgr2=0x7fccb4075680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:11:18.437 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:18.397+0000 7fccb881c700 1 -- 172.21.15.163:0/1359803544 shutdown_connections 2023-07-14T18:11:18.437 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:18.397+0000 7fccb881c700 1 -- 172.21.15.163:0/1359803544 wait complete. 2023-07-14T18:11:18.437 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:18.398+0000 7fccb881c700 1 Processor -- start 2023-07-14T18:11:18.437 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:18.398+0000 7fccb881c700 1 -- start start 2023-07-14T18:11:18.440 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:18.398+0000 7fccb881c700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fccb40ff360 0x7fccb4196c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:11:18.440 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:18.398+0000 7fccb881c700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fccb40ffd10 0x7fccb4197170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:11:18.440 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:18.398+0000 7fccb881c700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fccb4103ba0 0x7fccb41a1cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:11:18.440 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:18.398+0000 7fccb881c700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fccb4197ab0 con 0x7fccb40ffd10 2023-07-14T18:11:18.441 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:18.398+0000 7fccb881c700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fccb41a21f0 con 0x7fccb40ff360 2023-07-14T18:11:18.441 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:18.398+0000 7fccb881c700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fccb41a23b0 con 0x7fccb4103ba0 2023-07-14T18:11:18.441 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:18.398+0000 7fccb1d9b700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fccb40ffd10 0x7fccb4197170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:11:18.441 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:18.398+0000 7fccb1d9b700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fccb40ffd10 0x7fccb4197170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:55906/0 (socket says 172.21.15.163:55906) 2023-07-14T18:11:18.441 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:18.398+0000 7fccb1d9b700 1 -- 172.21.15.163:0/58819280 learned_addr learned my addr 172.21.15.163:0/58819280 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:11:18.441 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:18.398+0000 7fccb259c700 1 --2- 172.21.15.163:0/58819280 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fccb40ff360 0x7fccb4196c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:11:18.441 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:18.398+0000 7fccb2d9d700 1 --2- 172.21.15.163:0/58819280 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fccb4103ba0 0x7fccb41a1cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:11:18.441 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:18.398+0000 7fccb1d9b700 1 -- 172.21.15.163:0/58819280 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fccb4103ba0 msgr2=0x7fccb41a1cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:11:18.442 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:18.398+0000 7fccb1d9b700 1 --2- 172.21.15.163:0/58819280 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fccb4103ba0 0x7fccb41a1cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:18.442 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:18.398+0000 7fccb1d9b700 1 -- 172.21.15.163:0/58819280 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fccb40ff360 msgr2=0x7fccb4196c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:11:18.442 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:18.398+0000 7fccb1d9b700 1 --2- 172.21.15.163:0/58819280 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fccb40ff360 0x7fccb4196c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:18.442 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:18.398+0000 7fccb1d9b700 1 -- 172.21.15.163:0/58819280 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcca80095f0 con 0x7fccb40ffd10 2023-07-14T18:11:18.442 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:18.398+0000 7fccb259c700 1 --2- 172.21.15.163:0/58819280 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fccb40ff360 0x7fccb4196c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T18:11:18.442 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:18.398+0000 7fccb2d9d700 1 --2- 172.21.15.163:0/58819280 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fccb4103ba0 0x7fccb41a1cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T18:11:18.442 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:18.398+0000 7fccb1d9b700 1 --2- 172.21.15.163:0/58819280 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fccb40ffd10 0x7fccb4197170 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fcca8009f50 tx=0x7fcca80047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:11:18.443 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:18.399+0000 7fcca37fe700 1 -- 172.21.15.163:0/58819280 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcca801d070 con 0x7fccb40ffd10 2023-07-14T18:11:18.443 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:18.399+0000 7fccb881c700 1 -- 172.21.15.163:0/58819280 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fccb4194ae0 con 0x7fccb40ffd10 2023-07-14T18:11:18.443 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:18.399+0000 7fcca37fe700 1 -- 172.21.15.163:0/58819280 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fcca8004040 con 0x7fccb40ffd10 2023-07-14T18:11:18.443 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:18.399+0000 7fcca37fe700 1 -- 172.21.15.163:0/58819280 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcca8022c80 con 0x7fccb40ffd10 2023-07-14T18:11:18.443 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:18.399+0000 7fccb881c700 1 -- 172.21.15.163:0/58819280 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fccb4194f80 con 0x7fccb40ffd10 2023-07-14T18:11:18.443 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:18.400+0000 7fccb881c700 1 -- 172.21.15.163:0/58819280 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fccb404e340 con 0x7fccb40ffd10 2023-07-14T18:11:18.443 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:18.401+0000 7fcca37fe700 1 -- 172.21.15.163:0/58819280 <== mon.0 v2:172.21.15.163:3300/0 4 ==== mgrmap(e 16) v1 ==== 135716+0+0 (secure 0 0 0) 0x7fcca8022470 con 0x7fccb40ffd10 2023-07-14T18:11:18.443 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:18.401+0000 7fcca37fe700 1 --2- 172.21.15.163:0/58819280 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7fcc9c0a1150 0x7fcc9c0a3600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:11:18.444 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:18.401+0000 7fccb259c700 1 --2- 172.21.15.163:0/58819280 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7fcc9c0a1150 0x7fcc9c0a3600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:11:18.444 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:18.401+0000 7fcca37fe700 1 -- 172.21.15.163:0/58819280 <== mon.0 v2:172.21.15.163:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 8730+0+0 (secure 0 0 0) 0x7fcca80cdfe0 con 0x7fccb40ffd10 2023-07-14T18:11:18.444 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:18.401+0000 7fccb259c700 1 --2- 172.21.15.163:0/58819280 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7fcc9c0a1150 0x7fcc9c0a3600 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fcca4007900 tx=0x7fcca4008040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:11:18.444 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:18.405+0000 7fcca37fe700 1 -- 172.21.15.163:0/58819280 <== mon.0 v2:172.21.15.163:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178025 (secure 0 0 0) 0x7fcca80975d0 con 0x7fccb40ffd10 2023-07-14T18:11:18.674 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:18.635+0000 7fccb881c700 1 -- 172.21.15.163:0/58819280 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fccb41951a0 con 0x7fccb40ffd10 2023-07-14T18:11:18.674 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:18.635+0000 7fcca37fe700 1 -- 172.21.15.163:0/58819280 <== mon.0 v2:172.21.15.163:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v17) v1 ==== 53+0+88 (secure 0 0 0) 0x7fcca809abf0 con 0x7fccb40ffd10 2023-07-14T18:11:18.674 INFO:teuthology.orchestra.run.smithi163.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2023-07-14T18:11:18.676 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:18.638+0000 7fccb881c700 1 -- 172.21.15.163:0/58819280 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7fcc9c0a1150 msgr2=0x7fcc9c0a3600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:11:18.677 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:18.638+0000 7fccb881c700 1 --2- 172.21.15.163:0/58819280 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7fcc9c0a1150 0x7fcc9c0a3600 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fcca4007900 tx=0x7fcca4008040 comp rx=0 tx=0).stop 2023-07-14T18:11:18.677 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:18.638+0000 7fccb881c700 1 -- 172.21.15.163:0/58819280 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fccb40ffd10 msgr2=0x7fccb4197170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:11:18.677 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:18.638+0000 7fccb881c700 1 --2- 172.21.15.163:0/58819280 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fccb40ffd10 0x7fccb4197170 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fcca8009f50 tx=0x7fcca80047c0 comp rx=0 tx=0).stop 2023-07-14T18:11:18.677 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:18.638+0000 7fccb881c700 1 -- 172.21.15.163:0/58819280 shutdown_connections 2023-07-14T18:11:18.677 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:18.638+0000 7fccb881c700 1 --2- 172.21.15.163:0/58819280 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7fcc9c0a1150 0x7fcc9c0a3600 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:18.677 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:18.638+0000 7fccb881c700 1 --2- 172.21.15.163:0/58819280 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fccb4103ba0 0x7fccb41a1cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:18.678 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:18.638+0000 7fccb881c700 1 --2- 172.21.15.163:0/58819280 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fccb40ff360 0x7fccb4196c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:18.678 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:18.638+0000 7fccb881c700 1 --2- 172.21.15.163:0/58819280 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fccb40ffd10 0x7fccb4197170 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:18.678 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:18.638+0000 7fccb881c700 1 -- 172.21.15.163:0/58819280 >> 172.21.15.163:0/58819280 conn(0x7fccb4075280 msgr2=0x7fccb40fbce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:11:18.678 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:18.638+0000 7fccb881c700 1 -- 172.21.15.163:0/58819280 shutdown_connections 2023-07-14T18:11:18.678 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:18.638+0000 7fccb881c700 1 -- 172.21.15.163:0/58819280 wait complete. 2023-07-14T18:11:18.966 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:11:18 smithi163 ceph-mon[96576]: from='client.? 172.21.15.163:0/58819280' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2023-07-14T18:11:19.011 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-07-14T18:11:19.012 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-07-14T18:11:19.012 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi163.front.sepia.ceph.com 2023-07-14T18:11:19.012 INFO:tasks.cephfs.mount:self.client.name = client.admin 2023-07-14T18:11:19.013 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2023-07-14T18:11:19.013 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-07-14T18:11:19.013 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-07-14T18:11:19.013 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-07-14T18:11:19.013 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.admin' 2023-07-14T18:11:19.014 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T18:11:19.014 DEBUG:teuthology.orchestra.run.smithi163:> ip addr 2023-07-14T18:11:19.032 INFO:teuthology.orchestra.run.smithi163.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-07-14T18:11:19.032 INFO:teuthology.orchestra.run.smithi163.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-07-14T18:11:19.032 INFO:teuthology.orchestra.run.smithi163.stdout: inet 127.0.0.1/8 scope host lo 2023-07-14T18:11:19.032 INFO:teuthology.orchestra.run.smithi163.stdout: valid_lft forever preferred_lft forever 2023-07-14T18:11:19.033 INFO:teuthology.orchestra.run.smithi163.stdout: inet6 ::1/128 scope host 2023-07-14T18:11:19.033 INFO:teuthology.orchestra.run.smithi163.stdout: valid_lft forever preferred_lft forever 2023-07-14T18:11:19.033 INFO:teuthology.orchestra.run.smithi163.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-07-14T18:11:19.033 INFO:teuthology.orchestra.run.smithi163.stdout: link/ether 0c:c4:7a:d9:38:06 brd ff:ff:ff:ff:ff:ff 2023-07-14T18:11:19.033 INFO:teuthology.orchestra.run.smithi163.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-07-14T18:11:19.033 INFO:teuthology.orchestra.run.smithi163.stdout: link/ether 0c:c4:7a:d9:38:07 brd ff:ff:ff:ff:ff:ff 2023-07-14T18:11:19.033 INFO:teuthology.orchestra.run.smithi163.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-07-14T18:11:19.034 INFO:teuthology.orchestra.run.smithi163.stdout: link/ether 0c:c4:7a:88:7d:5a brd ff:ff:ff:ff:ff:ff 2023-07-14T18:11:19.034 INFO:teuthology.orchestra.run.smithi163.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-07-14T18:11:19.034 INFO:teuthology.orchestra.run.smithi163.stdout: link/ether 0c:c4:7a:88:7d:5b brd ff:ff:ff:ff:ff:ff 2023-07-14T18:11:19.034 INFO:teuthology.orchestra.run.smithi163.stdout: inet 172.21.15.163/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-07-14T18:11:19.034 INFO:teuthology.orchestra.run.smithi163.stdout: valid_lft 41724sec preferred_lft 41724sec 2023-07-14T18:11:19.034 INFO:teuthology.orchestra.run.smithi163.stdout: inet6 fe80::6692:500b:f94:c3b8/64 scope link noprefixroute 2023-07-14T18:11:19.034 INFO:teuthology.orchestra.run.smithi163.stdout: valid_lft forever preferred_lft forever 2023-07-14T18:11:19.035 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-07-14T18:11:19.035 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T18:11:19.036 DEBUG:teuthology.orchestra.run.smithi163:> (cd / && exec bash -c ' 2023-07-14T18:11:19.036 DEBUG:teuthology.orchestra.run.smithi163:> set -e 2023-07-14T18:11:19.036 DEBUG:teuthology.orchestra.run.smithi163:> sudo ip link add name ceph-brx type bridge 2023-07-14T18:11:19.037 DEBUG:teuthology.orchestra.run.smithi163:> sudo ip addr flush dev ceph-brx 2023-07-14T18:11:19.037 DEBUG:teuthology.orchestra.run.smithi163:> sudo ip link set ceph-brx up 2023-07-14T18:11:19.037 DEBUG:teuthology.orchestra.run.smithi163:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-07-14T18:11:19.037 DEBUG:teuthology.orchestra.run.smithi163:> ') 2023-07-14T18:11:19.173 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:11:18 smithi184 ceph-mon[98481]: from='client.? 172.21.15.163:0/58819280' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2023-07-14T18:11:19.194 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T18:11:19.195 DEBUG:teuthology.orchestra.run.smithi163:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-07-14T18:11:19.222 INFO:teuthology.orchestra.run.smithi163.stdout:1 2023-07-14T18:11:19.223 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T18:11:19.224 DEBUG:teuthology.orchestra.run.smithi163:> route 2023-07-14T18:11:19.274 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:11:18 smithi172 ceph-mon[97983]: from='client.? 172.21.15.163:0/58819280' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2023-07-14T18:11:19.300 INFO:teuthology.orchestra.run.smithi163.stdout:Kernel IP routing table 2023-07-14T18:11:19.300 INFO:teuthology.orchestra.run.smithi163.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-07-14T18:11:19.300 INFO:teuthology.orchestra.run.smithi163.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-07-14T18:11:19.300 INFO:teuthology.orchestra.run.smithi163.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-07-14T18:11:19.300 INFO:teuthology.orchestra.run.smithi163.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-07-14T18:11:19.301 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T18:11:19.301 DEBUG:teuthology.orchestra.run.smithi163:> (cd / && exec bash -c ' 2023-07-14T18:11:19.302 DEBUG:teuthology.orchestra.run.smithi163:> set -e 2023-07-14T18:11:19.302 DEBUG:teuthology.orchestra.run.smithi163:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-07-14T18:11:19.302 DEBUG:teuthology.orchestra.run.smithi163:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-07-14T18:11:19.302 DEBUG:teuthology.orchestra.run.smithi163:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-07-14T18:11:19.303 DEBUG:teuthology.orchestra.run.smithi163:> ') 2023-07-14T18:11:19.563 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T18:11:19.563 DEBUG:teuthology.orchestra.run.smithi163:> ip netns list 2023-07-14T18:11:19.581 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T18:11:19.581 DEBUG:teuthology.orchestra.run.smithi163:> ip netns list-id 2023-07-14T18:11:19.638 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T18:11:19.639 DEBUG:teuthology.orchestra.run.smithi163:> (cd / && exec bash -c ' 2023-07-14T18:11:19.639 DEBUG:teuthology.orchestra.run.smithi163:> set -e 2023-07-14T18:11:19.640 DEBUG:teuthology.orchestra.run.smithi163:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.admin 2023-07-14T18:11:19.641 DEBUG:teuthology.orchestra.run.smithi163:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.admin 0 2023-07-14T18:11:19.641 DEBUG:teuthology.orchestra.run.smithi163:> ') 2023-07-14T18:11:19.732 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.admin' with 192.168.0.1/16 2023-07-14T18:11:19.733 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T18:11:19.734 DEBUG:teuthology.orchestra.run.smithi163:> (cd / && exec bash -c ' 2023-07-14T18:11:19.735 DEBUG:teuthology.orchestra.run.smithi163:> set -e 2023-07-14T18:11:19.735 DEBUG:teuthology.orchestra.run.smithi163:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.admin type veth peer name brx.0 2023-07-14T18:11:19.735 DEBUG:teuthology.orchestra.run.smithi163:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-07-14T18:11:19.735 DEBUG:teuthology.orchestra.run.smithi163:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set veth0 up 2023-07-14T18:11:19.736 DEBUG:teuthology.orchestra.run.smithi163:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set lo up 2023-07-14T18:11:19.736 DEBUG:teuthology.orchestra.run.smithi163:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip route add default via 192.168.255.254 2023-07-14T18:11:19.736 DEBUG:teuthology.orchestra.run.smithi163:> ') 2023-07-14T18:11:19.942 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T18:11:19.942 DEBUG:teuthology.orchestra.run.smithi163:> (cd / && exec bash -c ' 2023-07-14T18:11:19.943 DEBUG:teuthology.orchestra.run.smithi163:> set -e 2023-07-14T18:11:19.943 DEBUG:teuthology.orchestra.run.smithi163:> sudo ip link set brx.0 up 2023-07-14T18:11:19.943 DEBUG:teuthology.orchestra.run.smithi163:> sudo ip link set dev brx.0 master ceph-brx 2023-07-14T18:11:19.943 DEBUG:teuthology.orchestra.run.smithi163:> ') 2023-07-14T18:11:19.983 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:11:19 smithi163 ceph-mon[96576]: pgmap v256: 129 pgs: 129 active+clean; 579 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 616 B/s wr, 2 op/s 2023-07-14T18:11:20.042 INFO:tasks.cephfs.fuse_mount:Client client.admin config is {} 2023-07-14T18:11:20.043 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-07-14T18:11:20.043 DEBUG:teuthology.orchestra.run.smithi163:> mkdir -p -v /home/ubuntu/cephtest/mnt.admin 2023-07-14T18:11:20.099 INFO:teuthology.orchestra.run.smithi163.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.admin' 2023-07-14T18:11:20.100 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-07-14T18:11:20.100 DEBUG:teuthology.orchestra.run.smithi163:> chmod 0000 /home/ubuntu/cephtest/mnt.admin 2023-07-14T18:11:20.155 DEBUG:teuthology.orchestra.run.smithi163:> sudo modprobe fuse 2023-07-14T18:11:20.173 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:11:19 smithi184 ceph-mon[98481]: pgmap v256: 129 pgs: 129 active+clean; 579 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 616 B/s wr, 2 op/s 2023-07-14T18:11:20.222 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-07-14T18:11:20.223 DEBUG:teuthology.orchestra.run.smithi163:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-07-14T18:11:20.274 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:11:19 smithi172 ceph-mon[97983]: pgmap v256: 129 pgs: 129 active+clean; 579 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 616 B/s wr, 2 op/s 2023-07-14T18:11:20.288 INFO:teuthology.orchestra.run.smithi163.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-07-14T18:11:20.289 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-07-14T18:11:20.290 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T18:11:20.290 DEBUG:teuthology.orchestra.run.smithi163:> ls /sys/fs/fuse/connections 2023-07-14T18:11:20.347 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-07-14T18:11:20.347 DEBUG:teuthology.orchestra.run.smithi163:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.admin --id admin --client_fs=cephfs) 2023-07-14T18:11:20.389 DEBUG:teuthology.orchestra.run.smithi163:> sudo modprobe fuse 2023-07-14T18:11:20.415 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-07-14T18:11:20.416 DEBUG:teuthology.orchestra.run.smithi163:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-07-14T18:11:20.483 INFO:teuthology.orchestra.run.smithi163.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-07-14T18:11:20.484 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-07-14T18:11:20.484 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T18:11:20.485 DEBUG:teuthology.orchestra.run.smithi163:> ls /sys/fs/fuse/connections 2023-07-14T18:11:20.498 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi163.stderr:2023-07-14T18:11:20.460+0000 7fbeafadd5c0 -1 init, newargv = 0x55c191494bd0 newargc=15 2023-07-14T18:11:20.498 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi163.stderr:ceph-fuse[133712]: starting ceph client 2023-07-14T18:11:20.505 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi163.stderr:ceph-fuse[133712]: starting fuse 2023-07-14T18:11:20.515 INFO:teuthology.orchestra.run.smithi163.stdout:124 2023-07-14T18:11:20.515 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [124] 2023-07-14T18:11:20.516 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-07-14T18:11:20.516 DEBUG:teuthology.orchestra.run.smithi163:> import glob 2023-07-14T18:11:20.517 DEBUG:teuthology.orchestra.run.smithi163:> import re 2023-07-14T18:11:20.517 DEBUG:teuthology.orchestra.run.smithi163:> import os 2023-07-14T18:11:20.517 DEBUG:teuthology.orchestra.run.smithi163:> import subprocess 2023-07-14T18:11:20.518 DEBUG:teuthology.orchestra.run.smithi163:> 2023-07-14T18:11:20.519 DEBUG:teuthology.orchestra.run.smithi163:> def _find_admin_socket(client_name): 2023-07-14T18:11:20.519 DEBUG:teuthology.orchestra.run.smithi163:> asok_path = "/var/run/ceph/ceph-client.admin.*.asok" 2023-07-14T18:11:20.520 DEBUG:teuthology.orchestra.run.smithi163:> files = glob.glob(asok_path) 2023-07-14T18:11:20.521 DEBUG:teuthology.orchestra.run.smithi163:> mountpoint = "/home/ubuntu/cephtest/mnt.admin" 2023-07-14T18:11:20.521 DEBUG:teuthology.orchestra.run.smithi163:> 2023-07-14T18:11:20.522 DEBUG:teuthology.orchestra.run.smithi163:> # Given a non-glob path, it better be there 2023-07-14T18:11:20.522 DEBUG:teuthology.orchestra.run.smithi163:> if "*" not in asok_path: 2023-07-14T18:11:20.523 DEBUG:teuthology.orchestra.run.smithi163:> assert(len(files) == 1) 2023-07-14T18:11:20.523 DEBUG:teuthology.orchestra.run.smithi163:> return files[0] 2023-07-14T18:11:20.524 DEBUG:teuthology.orchestra.run.smithi163:> 2023-07-14T18:11:20.524 DEBUG:teuthology.orchestra.run.smithi163:> for f in files: 2023-07-14T18:11:20.525 DEBUG:teuthology.orchestra.run.smithi163:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-07-14T18:11:20.525 DEBUG:teuthology.orchestra.run.smithi163:> if os.path.exists("/proc/{0}".format(pid)): 2023-07-14T18:11:20.525 DEBUG:teuthology.orchestra.run.smithi163:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-07-14T18:11:20.526 DEBUG:teuthology.orchestra.run.smithi163:> contents = proc_f.read() 2023-07-14T18:11:20.526 DEBUG:teuthology.orchestra.run.smithi163:> if mountpoint in contents: 2023-07-14T18:11:20.526 DEBUG:teuthology.orchestra.run.smithi163:> return f 2023-07-14T18:11:20.526 DEBUG:teuthology.orchestra.run.smithi163:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-07-14T18:11:20.527 DEBUG:teuthology.orchestra.run.smithi163:> 2023-07-14T18:11:20.527 DEBUG:teuthology.orchestra.run.smithi163:> print(_find_admin_socket("client.admin")) 2023-07-14T18:11:20.527 DEBUG:teuthology.orchestra.run.smithi163:> ' 2023-07-14T18:11:20.638 INFO:teuthology.orchestra.run.smithi163.stdout:/var/run/ceph/ceph-client.admin.133712.asok 2023-07-14T18:11:20.821 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.admin.133712.asok 2023-07-14T18:11:20.822 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T18:11:20.822 DEBUG:teuthology.orchestra.run.smithi163:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.admin.133712.asok status 2023-07-14T18:11:20.979 INFO:teuthology.orchestra.run.smithi163.stdout:{ 2023-07-14T18:11:20.979 INFO:teuthology.orchestra.run.smithi163.stdout: "metadata": { 2023-07-14T18:11:20.979 INFO:teuthology.orchestra.run.smithi163.stdout: "ceph_sha1": "81c9387d2e7576da065747ec9c16d1c7d69016ec", 2023-07-14T18:11:20.979 INFO:teuthology.orchestra.run.smithi163.stdout: "ceph_version": "ceph version 18.0.0-4940-g81c9387d (81c9387d2e7576da065747ec9c16d1c7d69016ec) reef (dev)", 2023-07-14T18:11:20.979 INFO:teuthology.orchestra.run.smithi163.stdout: "entity_id": "admin", 2023-07-14T18:11:20.979 INFO:teuthology.orchestra.run.smithi163.stdout: "hostname": "smithi163", 2023-07-14T18:11:20.980 INFO:teuthology.orchestra.run.smithi163.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.admin", 2023-07-14T18:11:20.980 INFO:teuthology.orchestra.run.smithi163.stdout: "pid": "133712", 2023-07-14T18:11:20.980 INFO:teuthology.orchestra.run.smithi163.stdout: "root": "/" 2023-07-14T18:11:20.980 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:11:20.980 INFO:teuthology.orchestra.run.smithi163.stdout: "dentry_count": 0, 2023-07-14T18:11:20.980 INFO:teuthology.orchestra.run.smithi163.stdout: "dentry_pinned_count": 0, 2023-07-14T18:11:20.980 INFO:teuthology.orchestra.run.smithi163.stdout: "id": 14790, 2023-07-14T18:11:20.981 INFO:teuthology.orchestra.run.smithi163.stdout: "inst": { 2023-07-14T18:11:20.981 INFO:teuthology.orchestra.run.smithi163.stdout: "name": { 2023-07-14T18:11:20.981 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "client", 2023-07-14T18:11:20.981 INFO:teuthology.orchestra.run.smithi163.stdout: "num": 14790 2023-07-14T18:11:20.981 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:11:20.981 INFO:teuthology.orchestra.run.smithi163.stdout: "addr": { 2023-07-14T18:11:20.981 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "v1", 2023-07-14T18:11:20.981 INFO:teuthology.orchestra.run.smithi163.stdout: "addr": "192.168.0.1:0", 2023-07-14T18:11:20.982 INFO:teuthology.orchestra.run.smithi163.stdout: "nonce": 3921977254 2023-07-14T18:11:20.982 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-07-14T18:11:20.982 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:11:20.982 INFO:teuthology.orchestra.run.smithi163.stdout: "addr": { 2023-07-14T18:11:20.982 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "v1", 2023-07-14T18:11:20.982 INFO:teuthology.orchestra.run.smithi163.stdout: "addr": "192.168.0.1:0", 2023-07-14T18:11:20.982 INFO:teuthology.orchestra.run.smithi163.stdout: "nonce": 3921977254 2023-07-14T18:11:20.982 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:11:20.983 INFO:teuthology.orchestra.run.smithi163.stdout: "inst_str": "client.14790 192.168.0.1:0/3921977254", 2023-07-14T18:11:20.983 INFO:teuthology.orchestra.run.smithi163.stdout: "addr_str": "192.168.0.1:0/3921977254", 2023-07-14T18:11:20.983 INFO:teuthology.orchestra.run.smithi163.stdout: "inode_count": 1, 2023-07-14T18:11:20.983 INFO:teuthology.orchestra.run.smithi163.stdout: "mds_epoch": 17, 2023-07-14T18:11:20.983 INFO:teuthology.orchestra.run.smithi163.stdout: "osd_epoch": 84, 2023-07-14T18:11:20.983 INFO:teuthology.orchestra.run.smithi163.stdout: "osd_epoch_barrier": 0, 2023-07-14T18:11:20.983 INFO:teuthology.orchestra.run.smithi163.stdout: "blocklisted": false, 2023-07-14T18:11:20.983 INFO:teuthology.orchestra.run.smithi163.stdout: "fs_name": "cephfs" 2023-07-14T18:11:20.984 INFO:teuthology.orchestra.run.smithi163.stdout:} 2023-07-14T18:11:20.988 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T18:11:20.989 DEBUG:teuthology.orchestra.run.smithi163:> stat --file-system '--printf=%T 2023-07-14T18:11:20.989 DEBUG:teuthology.orchestra.run.smithi163:> ' -- /home/ubuntu/cephtest/mnt.admin 2023-07-14T18:11:21.006 INFO:teuthology.orchestra.run.smithi163.stdout:fuseblk 2023-07-14T18:11:21.006 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.admin 2023-07-14T18:11:21.007 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T18:11:21.007 DEBUG:teuthology.orchestra.run.smithi163:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.admin 2023-07-14T18:11:21.074 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T18:11:21.074 DEBUG:teuthology.orchestra.run.smithi163:> (cd /home/ubuntu/cephtest/mnt.admin && exec bash -c 'setfattr -n ceph.dir.layout.pool -v cephfs_data_ec . && getfattr -n ceph.dir.layout .') 2023-07-14T18:11:21.179 INFO:teuthology.orchestra.run.smithi163.stdout:# file: . 2023-07-14T18:11:21.179 INFO:teuthology.orchestra.run.smithi163.stdout:ceph.dir.layout="stripe_unit=4194304 stripe_count=1 object_size=4194304 pool=cephfs_data_ec" 2023-07-14T18:11:21.179 INFO:teuthology.orchestra.run.smithi163.stdout: 2023-07-14T18:11:21.179 DEBUG:teuthology.orchestra.run.smithi163:> set -ex 2023-07-14T18:11:21.180 DEBUG:teuthology.orchestra.run.smithi163:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-14T18:11:21.197 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-14T18:11:21.360 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:21.321+0000 7f729ae4a700 1 -- 172.21.15.163:0/2725001124 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f72940feb30 msgr2=0x7f72940fef40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:11:21.361 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:21.321+0000 7f729ae4a700 1 --2- 172.21.15.163:0/2725001124 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f72940feb30 0x7f72940fef40 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f7288009990 tx=0x7f7288009ca0 comp rx=0 tx=0).stop 2023-07-14T18:11:21.361 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:21.321+0000 7f729ae4a700 1 -- 172.21.15.163:0/2725001124 shutdown_connections 2023-07-14T18:11:21.361 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:21.321+0000 7f729ae4a700 1 --2- 172.21.15.163:0/2725001124 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f72941006b0 0x7f7294106f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:21.361 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:21.321+0000 7f729ae4a700 1 --2- 172.21.15.163:0/2725001124 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f72940feb30 0x7f72940fef40 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:21.362 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:21.321+0000 7f729ae4a700 1 --2- 172.21.15.163:0/2725001124 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f72940ffd20 0x7f7294100170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:21.362 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:21.321+0000 7f729ae4a700 1 -- 172.21.15.163:0/2725001124 >> 172.21.15.163:0/2725001124 conn(0x7f72940fa130 msgr2=0x7f72940fc580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:11:21.362 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:21.321+0000 7f729ae4a700 1 -- 172.21.15.163:0/2725001124 shutdown_connections 2023-07-14T18:11:21.362 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:21.322+0000 7f729ae4a700 1 -- 172.21.15.163:0/2725001124 wait complete. 2023-07-14T18:11:21.364 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:21.322+0000 7f729ae4a700 1 Processor -- start 2023-07-14T18:11:21.364 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:21.322+0000 7f729ae4a700 1 -- start start 2023-07-14T18:11:21.364 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:21.323+0000 7f729ae4a700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f72940feb30 0x7f7294194770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:11:21.364 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:21.323+0000 7f729ae4a700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f72940ffd20 0x7f7294194cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:11:21.365 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:21.323+0000 7f729ae4a700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f72941006b0 0x7f729419bd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:11:21.365 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:21.323+0000 7f729ae4a700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f729419c2f0 con 0x7f72941006b0 2023-07-14T18:11:21.365 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:21.323+0000 7f729ae4a700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f729419c430 con 0x7f72940ffd20 2023-07-14T18:11:21.366 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:21.323+0000 7f729ae4a700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f729419c5c0 con 0x7f72940feb30 2023-07-14T18:11:21.366 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:21.323+0000 7f72993e7700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f72941006b0 0x7f729419bd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:11:21.366 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:21.323+0000 7f72993e7700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f72941006b0 0x7f729419bd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:55936/0 (socket says 172.21.15.163:55936) 2023-07-14T18:11:21.366 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:21.323+0000 7f72993e7700 1 -- 172.21.15.163:0/1654930458 learned_addr learned my addr 172.21.15.163:0/1654930458 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:11:21.367 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:21.323+0000 7f7298be6700 1 --2- 172.21.15.163:0/1654930458 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f72940feb30 0x7f7294194770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:11:21.367 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:21.323+0000 7f7293fff700 1 --2- 172.21.15.163:0/1654930458 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f72940ffd20 0x7f7294194cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:11:21.367 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:21.323+0000 7f72993e7700 1 -- 172.21.15.163:0/1654930458 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f72940feb30 msgr2=0x7f7294194770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:11:21.367 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:21.323+0000 7f72993e7700 1 --2- 172.21.15.163:0/1654930458 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f72940feb30 0x7f7294194770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:21.368 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:21.323+0000 7f72993e7700 1 -- 172.21.15.163:0/1654930458 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f72940ffd20 msgr2=0x7f7294194cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:11:21.368 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:21.323+0000 7f72993e7700 1 --2- 172.21.15.163:0/1654930458 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f72940ffd20 0x7f7294194cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:21.368 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:21.323+0000 7f72993e7700 1 -- 172.21.15.163:0/1654930458 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72880095f0 con 0x7f72941006b0 2023-07-14T18:11:21.369 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:21.323+0000 7f72993e7700 1 --2- 172.21.15.163:0/1654930458 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f72941006b0 0x7f729419bd20 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f728c007ee0 tx=0x7f728c00d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:11:21.369 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:21.323+0000 7f7291ffb700 1 -- 172.21.15.163:0/1654930458 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f728c017070 con 0x7f72941006b0 2023-07-14T18:11:21.369 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:21.323+0000 7f7291ffb700 1 -- 172.21.15.163:0/1654930458 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f728c00f040 con 0x7f72941006b0 2023-07-14T18:11:21.369 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:21.323+0000 7f7291ffb700 1 -- 172.21.15.163:0/1654930458 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f728c005570 con 0x7f72941006b0 2023-07-14T18:11:21.370 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:21.323+0000 7f729ae4a700 1 -- 172.21.15.163:0/1654930458 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f729419c8a0 con 0x7f72941006b0 2023-07-14T18:11:21.370 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:21.324+0000 7f729ae4a700 1 -- 172.21.15.163:0/1654930458 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f729419cd60 con 0x7f72941006b0 2023-07-14T18:11:21.370 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:21.324+0000 7f729ae4a700 1 -- 172.21.15.163:0/1654930458 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f729410a1b0 con 0x7f72941006b0 2023-07-14T18:11:21.371 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:21.325+0000 7f7291ffb700 1 -- 172.21.15.163:0/1654930458 <== mon.0 v2:172.21.15.163:3300/0 4 ==== mgrmap(e 16) v1 ==== 135716+0+0 (secure 0 0 0) 0x7f728c00db20 con 0x7f72941006b0 2023-07-14T18:11:21.372 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:21.326+0000 7f7291ffb700 1 --2- 172.21.15.163:0/1654930458 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f72840a11a0 0x7f72840a3650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:11:21.372 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:21.326+0000 7f7298be6700 1 --2- 172.21.15.163:0/1654930458 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f72840a11a0 0x7f72840a3650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:11:21.373 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:21.326+0000 7f7291ffb700 1 -- 172.21.15.163:0/1654930458 <== mon.0 v2:172.21.15.163:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 8730+0+0 (secure 0 0 0) 0x7f728c0cc310 con 0x7f72941006b0 2023-07-14T18:11:21.373 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:21.326+0000 7f7298be6700 1 --2- 172.21.15.163:0/1654930458 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f72840a11a0 0x7f72840a3650 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f728800b5c0 tx=0x7f7288005960 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:11:21.373 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:21.330+0000 7f7291ffb700 1 -- 172.21.15.163:0/1654930458 <== mon.0 v2:172.21.15.163:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178025 (secure 0 0 0) 0x7f728c095810 con 0x7f72941006b0 2023-07-14T18:11:21.559 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:21.521+0000 7f729ae4a700 1 -- 172.21.15.163:0/1654930458 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7294105ab0 con 0x7f72941006b0 2023-07-14T18:11:21.561 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:21.522+0000 7f7291ffb700 1 -- 172.21.15.163:0/1654930458 <== mon.0 v2:172.21.15.163:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v84) v1 ==== 74+0+24030 (secure 0 0 0) 0x7f728c098e30 con 0x7f72941006b0 2023-07-14T18:11:21.561 INFO:teuthology.orchestra.run.smithi163.stdout: 2023-07-14T18:11:21.561 INFO:teuthology.orchestra.run.smithi163.stdout:{"epoch":84,"fsid":"bf7326ec-2270-11ee-9b33-001a4aab830c","created":"2023-07-14T18:04:26.263517+0000","modified":"2023-07-14T18:11:14.170253+0000","last_up_change":"2023-07-14T18:10:27.514863+0000","last_in_change":"2023-07-14T18:10:10.726443+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-14T18:07:19.653852+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-07-14T18:11:07.314989+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-07-14T18:11:08.274627+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-07-14T18:11:11.991162+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"e6490568-046d-43ef-bb07-d79fb884b276","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6802","nonce":3124653025},{"type":"v1","addr":"172.21.15.163:6803","nonce":3124653025}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6804","nonce":3124653025},{"type":"v1","addr":"172.21.15.163:6805","nonce":3124653025}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6808","nonce":3124653025},{"type":"v1","addr":"172.21.15.163:6809","nonce":3124653025}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6806","nonce":3124653025},{"type":"v1","addr":"172.21.15.163:6807","nonce":3124653025}]},"public_addr":"172.21.15.163:6803/3124653025","cluster_addr":"172.21.15.163:6805/3124653025","heartbeat_back_addr":"172.21.15.163:6809/3124653025","heartbeat_front_addr":"172.21.15.163:6807/3124653025","state":["exists","up"]},{"osd":1,"uuid":"0af39bda-f096-4603-adcc-bf1988f36603","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":3774455900},{"type":"v1","addr":"172.21.15.172:6801","nonce":3774455900}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":3774455900},{"type":"v1","addr":"172.21.15.172:6803","nonce":3774455900}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":3774455900},{"type":"v1","addr":"172.21.15.172:6807","nonce":3774455900}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":3774455900},{"type":"v1","addr":"172.21.15.172:6805","nonce":3774455900}]},"public_addr":"172.21.15.172:6801/3774455900","cluster_addr":"172.21.15.172:6803/3774455900","heartbeat_back_addr":"172.21.15.172:6807/3774455900","heartbeat_front_addr":"172.21.15.172:6805/3774455900","state":["exists","up"]},{"osd":2,"uuid":"cc732c13-af0f-4199-98e6-fe960ed4e5dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":1976927678},{"type":"v1","addr":"172.21.15.184:6801","nonce":1976927678}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":1976927678},{"type":"v1","addr":"172.21.15.184:6803","nonce":1976927678}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":1976927678},{"type":"v1","addr":"172.21.15.184:6807","nonce":1976927678}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":1976927678},{"type":"v1","addr":"172.21.15.184:6805","nonce":1976927678}]},"public_addr":"172.21.15.184:6801/1976927678","cluster_addr":"172.21.15.184:6803/1976927678","heartbeat_back_addr":"172.21.15.184:6807/1976927678","heartbeat_front_addr":"172.21.15.184:6805/1976927678","state":["exists","up"]},{"osd":3,"uuid":"dcee9576-0bc6-4ab0-8f63-79eacd0eca5f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6810","nonce":2589130694},{"type":"v1","addr":"172.21.15.163:6811","nonce":2589130694}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6812","nonce":2589130694},{"type":"v1","addr":"172.21.15.163:6813","nonce":2589130694}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6816","nonce":2589130694},{"type":"v1","addr":"172.21.15.163:6817","nonce":2589130694}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6814","nonce":2589130694},{"type":"v1","addr":"172.21.15.163:6815","nonce":2589130694}]},"public_addr":"172.21.15.163:6811/2589130694","cluster_addr":"172.21.15.163:6813/2589130694","heartbeat_back_addr":"172.21.15.163:6817/2589130694","heartbeat_front_addr":"172.21.15.163:6815/2589130694","state":["exists","up"]},{"osd":4,"uuid":"055df823-b8b0-426a-83c2-f0d727932ad8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":3319632614},{"type":"v1","addr":"172.21.15.172:6809","nonce":3319632614}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6810","nonce":3319632614},{"type":"v1","addr":"172.21.15.172:6811","nonce":3319632614}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6814","nonce":3319632614},{"type":"v1","addr":"172.21.15.172:6815","nonce":3319632614}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":3319632614},{"type":"v1","addr":"172.21.15.172:6813","nonce":3319632614}]},"public_addr":"172.21.15.172:6809/3319632614","cluster_addr":"172.21.15.172:6811/3319632614","heartbeat_back_addr":"172.21.15.172:6815/3319632614","heartbeat_front_addr":"172.21.15.172:6813/3319632614","state":["exists","up"]},{"osd":5,"uuid":"ef5ef02a-b4e2-4790-9d27-f6d2247b25c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":2662084043},{"type":"v1","addr":"172.21.15.184:6809","nonce":2662084043}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6810","nonce":2662084043},{"type":"v1","addr":"172.21.15.184:6811","nonce":2662084043}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6814","nonce":2662084043},{"type":"v1","addr":"172.21.15.184:6815","nonce":2662084043}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6812","nonce":2662084043},{"type":"v1","addr":"172.21.15.184:6813","nonce":2662084043}]},"public_addr":"172.21.15.184:6809/2662084043","cluster_addr":"172.21.15.184:6811/2662084043","heartbeat_back_addr":"172.21.15.184:6815/2662084043","heartbeat_front_addr":"172.21.15.184:6813/2662084043","state":["exists","up"]},{"osd":6,"uuid":"dba754be-0fc5-4867-a6d5-cf97eb344f81","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":44,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6818","nonce":2530874117},{"type":"v1","addr":"172.21.15.163:6819","nonce":2530874117}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6820","nonce":2530874117},{"type":"v1","addr":"172.21.15.163:6821","nonce":2530874117}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6824","nonce":2530874117},{"type":"v1","addr":"172.21.15.163:6825","nonce":2530874117}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6822","nonce":2530874117},{"type":"v1","addr":"172.21.15.163:6823","nonce":2530874117}]},"public_addr":"172.21.15.163:6819/2530874117","cluster_addr":"172.21.15.163:6821/2530874117","heartbeat_back_addr":"172.21.15.163:6825/2530874117","heartbeat_front_addr":"172.21.15.163:6823/2530874117","state":["exists","up"]},{"osd":7,"uuid":"edd76e6b-6077-4619-b00d-1e906f70ddcc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":49,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":233511803},{"type":"v1","addr":"172.21.15.172:6817","nonce":233511803}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6818","nonce":233511803},{"type":"v1","addr":"172.21.15.172:6819","nonce":233511803}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":233511803},{"type":"v1","addr":"172.21.15.172:6823","nonce":233511803}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6820","nonce":233511803},{"type":"v1","addr":"172.21.15.172:6821","nonce":233511803}]},"public_addr":"172.21.15.172:6817/233511803","cluster_addr":"172.21.15.172:6819/233511803","heartbeat_back_addr":"172.21.15.172:6823/233511803","heartbeat_front_addr":"172.21.15.172:6821/233511803","state":["exists","up"]},{"osd":8,"uuid":"36559400-f33e-44e6-868a-316d34da457d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":56,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6816","nonce":290154343},{"type":"v1","addr":"172.21.15.184:6817","nonce":290154343}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6818","nonce":290154343},{"type":"v1","addr":"172.21.15.184:6819","nonce":290154343}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6822","nonce":290154343},{"type":"v1","addr":"172.21.15.184:6823","nonce":290154343}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6820","nonce":290154343},{"type":"v1","addr":"172.21.15.184:6821","nonce":290154343}]},"public_addr":"172.21.15.184:6817/290154343","cluster_addr":"172.21.15.184:6819/290154343","heartbeat_back_addr":"172.21.15.184:6823/290154343","heartbeat_front_addr":"172.21.15.184:6821/290154343","state":["exists","up"]},{"osd":9,"uuid":"d484f111-f36c-4c67-9a8a-ae03e7e0d137","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6826","nonce":3848110906},{"type":"v1","addr":"172.21.15.163:6827","nonce":3848110906}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6828","nonce":3848110906},{"type":"v1","addr":"172.21.15.163:6829","nonce":3848110906}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6832","nonce":3848110906},{"type":"v1","addr":"172.21.15.163:6833","nonce":3848110906}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6830","nonce":3848110906},{"type":"v1","addr":"172.21.15.163:6831","nonce":3848110906}]},"public_addr":"172.21.15.163:6827/3848110906","cluster_addr":"172.21.15.163:6829/3848110906","heartbeat_back_addr":"172.21.15.163:6833/3848110906","heartbeat_front_addr":"172.21.15.163:6831/3848110906","state":["exists","up"]},{"osd":10,"uuid":"d943f7c0-da3d-4605-9e23-0231e675c6be","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6824","nonce":3281085356},{"type":"v1","addr":"172.21.15.172:6825","nonce":3281085356}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":3281085356},{"type":"v1","addr":"172.21.15.172:6827","nonce":3281085356}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":3281085356},{"type":"v1","addr":"172.21.15.172:6831","nonce":3281085356}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6828","nonce":3281085356},{"type":"v1","addr":"172.21.15.172:6829","nonce":3281085356}]},"public_addr":"172.21.15.172:6825/3281085356","cluster_addr":"172.21.15.172:6827/3281085356","heartbeat_back_addr":"172.21.15.172:6831/3281085356","heartbeat_front_addr":"172.21.15.172:6829/3281085356","state":["exists","up"]},{"osd":11,"uuid":"09e610a8-408a-4119-a21b-c4de2810a538","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":75,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6824","nonce":3614578747},{"type":"v1","addr":"172.21.15.184:6825","nonce":3614578747}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6826","nonce":3614578747},{"type":"v1","addr":"172.21.15.184:6827","nonce":3614578747}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6830","nonce":3614578747},{"type":"v1","addr":"172.21.15.184:6831","nonce":3614578747}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6828","nonce":3614578747},{"type":"v1","addr":"172.21.15.184:6829","nonce":3614578747}]},"public_addr":"172.21.15.184:6825/3614578747","cluster_addr":"172.21.15.184:6827/3614578747","heartbeat_back_addr":"172.21.15.184:6831/3614578747","heartbeat_front_addr":"172.21.15.184:6829/3614578747","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T18:06:36.067578+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T18:06:57.095120+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T18:07:17.825363+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T18:07:38.977196+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T18:08:00.108709+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T18:08:20.700646+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T18:08:41.473899+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T18:09:02.856536+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T18:09:23.832722+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T18:09:44.860884+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T18:10:05.520678+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T18:10:26.426315+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.163:6801/1086512093":"2023-07-15T18:05:15.331458+0000","172.21.15.163:6800/1086512093":"2023-07-15T18:05:15.331458+0000","172.21.15.163:0/4235784810":"2023-07-15T18:05:15.331458+0000","172.21.15.163:6800/236891232":"2023-07-15T18:04:53.288443+0000","172.21.15.163:6801/236891232":"2023-07-15T18:04:53.288443+0000","172.21.15.163:0/3260193612":"2023-07-15T18:05:15.331458+0000","172.21.15.163:0/3513629472":"2023-07-15T18:04:53.288443+0000","172.21.15.163:0/1090329830":"2023-07-15T18:04:53.288443+0000","172.21.15.163:0/3868922045":"2023-07-15T18:05:15.331458+0000","172.21.15.163:0/2945662447":"2023-07-15T18:04:53.288443+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-14T18:11:21.563 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:21.524+0000 7f729ae4a700 1 -- 172.21.15.163:0/1654930458 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f72840a11a0 msgr2=0x7f72840a3650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:11:21.563 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:21.524+0000 7f729ae4a700 1 --2- 172.21.15.163:0/1654930458 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f72840a11a0 0x7f72840a3650 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f728800b5c0 tx=0x7f7288005960 comp rx=0 tx=0).stop 2023-07-14T18:11:21.563 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:21.524+0000 7f729ae4a700 1 -- 172.21.15.163:0/1654930458 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f72941006b0 msgr2=0x7f729419bd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:11:21.563 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:21.524+0000 7f729ae4a700 1 --2- 172.21.15.163:0/1654930458 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f72941006b0 0x7f729419bd20 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f728c007ee0 tx=0x7f728c00d3b0 comp rx=0 tx=0).stop 2023-07-14T18:11:21.564 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:21.524+0000 7f729ae4a700 1 -- 172.21.15.163:0/1654930458 shutdown_connections 2023-07-14T18:11:21.564 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:21.524+0000 7f729ae4a700 1 --2- 172.21.15.163:0/1654930458 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f72840a11a0 0x7f72840a3650 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:21.564 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:21.524+0000 7f729ae4a700 1 --2- 172.21.15.163:0/1654930458 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f72940feb30 0x7f7294194770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:21.564 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:21.524+0000 7f729ae4a700 1 --2- 172.21.15.163:0/1654930458 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f72941006b0 0x7f729419bd20 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:21.564 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:21.524+0000 7f729ae4a700 1 --2- 172.21.15.163:0/1654930458 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f72940ffd20 0x7f7294194cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:21.564 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:21.524+0000 7f729ae4a700 1 -- 172.21.15.163:0/1654930458 >> 172.21.15.163:0/1654930458 conn(0x7f72940fa130 msgr2=0x7f72940fc410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:11:21.565 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:21.524+0000 7f729ae4a700 1 -- 172.21.15.163:0/1654930458 shutdown_connections 2023-07-14T18:11:21.565 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:21.524+0000 7f729ae4a700 1 -- 172.21.15.163:0/1654930458 wait complete. 2023-07-14T18:11:21.576 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-14T18:07:19.653852+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-14T18:11:07.314989+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '79', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-07-14T18:11:08.274627+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '80', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-07-14T18:11:11.991162+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '84', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-07-14T18:11:21.576 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-14T18:11:21.700 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:21.661+0000 7f7bd0ddd700 1 -- 172.21.15.163:0/3141304274 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f7bcc100e90 msgr2=0x7f7bcc1012e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:11:21.701 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:21.661+0000 7f7bd0ddd700 1 --2- 172.21.15.163:0/3141304274 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f7bcc100e90 0x7f7bcc1012e0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f7bc0009990 tx=0x7f7bc0009ca0 comp rx=0 tx=0).stop 2023-07-14T18:11:21.701 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:21.661+0000 7f7bd0ddd700 1 -- 172.21.15.163:0/3141304274 shutdown_connections 2023-07-14T18:11:21.701 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:21.661+0000 7f7bd0ddd700 1 --2- 172.21.15.163:0/3141304274 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7bcc0fdec0 0x7f7bcc0fe2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:21.701 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:21.661+0000 7f7bd0ddd700 1 --2- 172.21.15.163:0/3141304274 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7bcc101820 0x7f7bcc1080e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:21.701 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:21.661+0000 7f7bd0ddd700 1 --2- 172.21.15.163:0/3141304274 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f7bcc100e90 0x7f7bcc1012e0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:21.701 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:21.661+0000 7f7bd0ddd700 1 -- 172.21.15.163:0/3141304274 >> 172.21.15.163:0/3141304274 conn(0x7f7bcc0f98a0 msgr2=0x7f7bcc0fbcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:11:21.701 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:21.661+0000 7f7bd0ddd700 1 -- 172.21.15.163:0/3141304274 shutdown_connections 2023-07-14T18:11:21.702 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:21.661+0000 7f7bd0ddd700 1 -- 172.21.15.163:0/3141304274 wait complete. 2023-07-14T18:11:21.703 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:21.662+0000 7f7bd0ddd700 1 Processor -- start 2023-07-14T18:11:21.703 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:21.662+0000 7f7bd0ddd700 1 -- start start 2023-07-14T18:11:21.703 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:21.663+0000 7f7bd0ddd700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7bcc0fdec0 0x7f7bcc195840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:11:21.704 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:21.663+0000 7f7bd0ddd700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7bcc100e90 0x7f7bcc195d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:11:21.704 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:21.663+0000 7f7bd0ddd700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f7bcc101820 0x7f7bcc19cdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:11:21.704 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:21.663+0000 7f7bd0ddd700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7bcc19d3c0 con 0x7f7bcc101820 2023-07-14T18:11:21.704 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:21.663+0000 7f7bd0ddd700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7bcc19d500 con 0x7f7bcc100e90 2023-07-14T18:11:21.704 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:21.663+0000 7f7bd0ddd700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7bcc19d690 con 0x7f7bcc0fdec0 2023-07-14T18:11:21.704 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:21.663+0000 7f7bcad9d700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f7bcc101820 0x7f7bcc19cdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:11:21.704 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:21.663+0000 7f7bcad9d700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f7bcc101820 0x7f7bcc19cdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:55950/0 (socket says 172.21.15.163:55950) 2023-07-14T18:11:21.705 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:21.663+0000 7f7bcad9d700 1 -- 172.21.15.163:0/3868882862 learned_addr learned my addr 172.21.15.163:0/3868882862 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:11:21.705 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:21.663+0000 7f7bc9d9b700 1 --2- 172.21.15.163:0/3868882862 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7bcc100e90 0x7f7bcc195d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:11:21.705 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:21.663+0000 7f7bca59c700 1 --2- 172.21.15.163:0/3868882862 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7bcc0fdec0 0x7f7bcc195840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:11:21.705 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:21.663+0000 7f7bcad9d700 1 -- 172.21.15.163:0/3868882862 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7bcc0fdec0 msgr2=0x7f7bcc195840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:11:21.705 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:21.663+0000 7f7bcad9d700 1 --2- 172.21.15.163:0/3868882862 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7bcc0fdec0 0x7f7bcc195840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:21.705 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:21.663+0000 7f7bcad9d700 1 -- 172.21.15.163:0/3868882862 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7bcc100e90 msgr2=0x7f7bcc195d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:11:21.705 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:21.663+0000 7f7bcad9d700 1 --2- 172.21.15.163:0/3868882862 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7bcc100e90 0x7f7bcc195d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:21.706 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:21.663+0000 7f7bcad9d700 1 -- 172.21.15.163:0/3868882862 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7bc00095f0 con 0x7f7bcc101820 2023-07-14T18:11:21.706 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:21.663+0000 7f7bcad9d700 1 --2- 172.21.15.163:0/3868882862 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f7bcc101820 0x7f7bcc19cdf0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f7bc4007d70 tx=0x7f7bc400a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:11:21.706 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:21.663+0000 7f7bbb7fe700 1 -- 172.21.15.163:0/3868882862 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bc400ac90 con 0x7f7bcc101820 2023-07-14T18:11:21.706 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:21.663+0000 7f7bd0ddd700 1 -- 172.21.15.163:0/3868882862 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7bcc19d970 con 0x7f7bcc101820 2023-07-14T18:11:21.706 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:21.663+0000 7f7bbb7fe700 1 -- 172.21.15.163:0/3868882862 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f7bc400adf0 con 0x7f7bcc101820 2023-07-14T18:11:21.706 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:21.663+0000 7f7bbb7fe700 1 -- 172.21.15.163:0/3868882862 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bc40115e0 con 0x7f7bcc101820 2023-07-14T18:11:21.706 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:21.663+0000 7f7bd0ddd700 1 -- 172.21.15.163:0/3868882862 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7bcc19de80 con 0x7f7bcc101820 2023-07-14T18:11:21.706 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:21.664+0000 7f7bd0ddd700 1 -- 172.21.15.163:0/3868882862 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7bcc1072b0 con 0x7f7bcc101820 2023-07-14T18:11:21.707 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:21.665+0000 7f7bbb7fe700 1 -- 172.21.15.163:0/3868882862 <== mon.0 v2:172.21.15.163:3300/0 4 ==== mgrmap(e 16) v1 ==== 135716+0+0 (secure 0 0 0) 0x7f7bc4012420 con 0x7f7bcc101820 2023-07-14T18:11:21.707 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:21.666+0000 7f7bbb7fe700 1 --2- 172.21.15.163:0/3868882862 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f7bb40a1150 0x7f7bb40a3600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:11:21.707 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:21.666+0000 7f7bca59c700 1 --2- 172.21.15.163:0/3868882862 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f7bb40a1150 0x7f7bb40a3600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:11:21.708 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:21.666+0000 7f7bbb7fe700 1 -- 172.21.15.163:0/3868882862 <== mon.0 v2:172.21.15.163:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 8730+0+0 (secure 0 0 0) 0x7f7bc40ccc40 con 0x7f7bcc101820 2023-07-14T18:11:21.708 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:21.666+0000 7f7bca59c700 1 --2- 172.21.15.163:0/3868882862 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f7bb40a1150 0x7f7bb40a3600 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f7bcc0675a0 tx=0x7f7bbc007400 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:11:21.708 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:21.670+0000 7f7bbb7fe700 1 -- 172.21.15.163:0/3868882862 <== mon.0 v2:172.21.15.163:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178025 (secure 0 0 0) 0x7f7bc40961a0 con 0x7f7bcc101820 2023-07-14T18:11:21.903 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:21.865+0000 7f7bd0ddd700 1 -- 172.21.15.163:0/3868882862 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f7bcc061250 con 0x7f7bcc101820 2023-07-14T18:11:21.904 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:21.865+0000 7f7bbb7fe700 1 -- 172.21.15.163:0/3868882862 <== mon.0 v2:172.21.15.163:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v84) v1 ==== 93+0+10 (secure 0 0 0) 0x7f7bc40997c0 con 0x7f7bcc101820 2023-07-14T18:11:21.904 INFO:teuthology.orchestra.run.smithi163.stdout:pg_num: 1 2023-07-14T18:11:21.906 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:21.867+0000 7f7bd0ddd700 1 -- 172.21.15.163:0/3868882862 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f7bb40a1150 msgr2=0x7f7bb40a3600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:11:21.906 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:21.867+0000 7f7bd0ddd700 1 --2- 172.21.15.163:0/3868882862 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f7bb40a1150 0x7f7bb40a3600 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f7bcc0675a0 tx=0x7f7bbc007400 comp rx=0 tx=0).stop 2023-07-14T18:11:21.907 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:21.868+0000 7f7bd0ddd700 1 -- 172.21.15.163:0/3868882862 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f7bcc101820 msgr2=0x7f7bcc19cdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:11:21.907 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:21.868+0000 7f7bd0ddd700 1 --2- 172.21.15.163:0/3868882862 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f7bcc101820 0x7f7bcc19cdf0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f7bc4007d70 tx=0x7f7bc400a340 comp rx=0 tx=0).stop 2023-07-14T18:11:21.907 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:21.868+0000 7f7bd0ddd700 1 -- 172.21.15.163:0/3868882862 shutdown_connections 2023-07-14T18:11:21.907 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:21.868+0000 7f7bd0ddd700 1 --2- 172.21.15.163:0/3868882862 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f7bb40a1150 0x7f7bb40a3600 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:21.907 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:21.868+0000 7f7bd0ddd700 1 --2- 172.21.15.163:0/3868882862 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7bcc0fdec0 0x7f7bcc195840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:21.907 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:21.868+0000 7f7bd0ddd700 1 --2- 172.21.15.163:0/3868882862 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f7bcc101820 0x7f7bcc19cdf0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:21.907 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:21.868+0000 7f7bd0ddd700 1 --2- 172.21.15.163:0/3868882862 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7bcc100e90 0x7f7bcc195d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:21.907 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:21.868+0000 7f7bd0ddd700 1 -- 172.21.15.163:0/3868882862 >> 172.21.15.163:0/3868882862 conn(0x7f7bcc0f98a0 msgr2=0x7f7bcc1043f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:11:21.908 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:21.868+0000 7f7bd0ddd700 1 -- 172.21.15.163:0/3868882862 shutdown_connections 2023-07-14T18:11:21.908 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:21.868+0000 7f7bd0ddd700 1 -- 172.21.15.163:0/3868882862 wait complete. 2023-07-14T18:11:21.917 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:11:21 smithi163 ceph-mon[96576]: from='client.? 172.21.15.163:0/1654930458' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-07-14T18:11:21.919 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-14T18:11:22.042 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:22.003+0000 7fca34d8f700 1 -- 172.21.15.163:0/2361955057 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fca30100180 msgr2=0x7fca30100590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:11:22.042 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:22.003+0000 7fca34d8f700 1 --2- 172.21.15.163:0/2361955057 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fca30100180 0x7fca30100590 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fca24009990 tx=0x7fca24009ca0 comp rx=0 tx=0).stop 2023-07-14T18:11:22.042 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:22.003+0000 7fca34d8f700 1 -- 172.21.15.163:0/2361955057 shutdown_connections 2023-07-14T18:11:22.043 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:22.003+0000 7fca34d8f700 1 --2- 172.21.15.163:0/2361955057 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fca300ff6f0 0x7fca30106fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:22.043 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:22.003+0000 7fca34d8f700 1 --2- 172.21.15.163:0/2361955057 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fca30100180 0x7fca30100590 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:22.043 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:22.003+0000 7fca34d8f700 1 --2- 172.21.15.163:0/2361955057 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fca300fed40 0x7fca300ff1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:22.043 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:22.003+0000 7fca34d8f700 1 -- 172.21.15.163:0/2361955057 >> 172.21.15.163:0/2361955057 conn(0x7fca300f98a0 msgr2=0x7fca300fbcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:11:22.043 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:22.003+0000 7fca34d8f700 1 -- 172.21.15.163:0/2361955057 shutdown_connections 2023-07-14T18:11:22.043 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:22.003+0000 7fca34d8f700 1 -- 172.21.15.163:0/2361955057 wait complete. 2023-07-14T18:11:22.045 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:22.004+0000 7fca34d8f700 1 Processor -- start 2023-07-14T18:11:22.045 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:22.004+0000 7fca34d8f700 1 -- start start 2023-07-14T18:11:22.045 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:22.004+0000 7fca34d8f700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fca300fed40 0x7fca30195870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:11:22.046 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:22.004+0000 7fca34d8f700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fca300ff6f0 0x7fca30195db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:11:22.046 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:22.004+0000 7fca34d8f700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fca30100180 0x7fca3019ce20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:11:22.046 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:22.004+0000 7fca34d8f700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca3019d3f0 con 0x7fca30100180 2023-07-14T18:11:22.046 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:22.004+0000 7fca34d8f700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca3019d530 con 0x7fca300ff6f0 2023-07-14T18:11:22.046 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:22.004+0000 7fca34d8f700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca3019d6c0 con 0x7fca300fed40 2023-07-14T18:11:22.046 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:22.004+0000 7fca2ed9d700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fca30100180 0x7fca3019ce20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:11:22.046 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:22.004+0000 7fca2ed9d700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fca30100180 0x7fca3019ce20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:55984/0 (socket says 172.21.15.163:55984) 2023-07-14T18:11:22.047 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:22.004+0000 7fca2ed9d700 1 -- 172.21.15.163:0/3313598468 learned_addr learned my addr 172.21.15.163:0/3313598468 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:11:22.047 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:22.004+0000 7fca2e59c700 1 --2- 172.21.15.163:0/3313598468 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fca300fed40 0x7fca30195870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:11:22.047 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:22.004+0000 7fca2dd9b700 1 --2- 172.21.15.163:0/3313598468 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fca300ff6f0 0x7fca30195db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:11:22.047 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:22.004+0000 7fca2ed9d700 1 -- 172.21.15.163:0/3313598468 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fca300fed40 msgr2=0x7fca30195870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:11:22.047 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:22.004+0000 7fca2ed9d700 1 --2- 172.21.15.163:0/3313598468 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fca300fed40 0x7fca30195870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:22.047 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:22.004+0000 7fca2ed9d700 1 -- 172.21.15.163:0/3313598468 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fca300ff6f0 msgr2=0x7fca30195db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:11:22.047 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:22.004+0000 7fca2ed9d700 1 --2- 172.21.15.163:0/3313598468 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fca300ff6f0 0x7fca30195db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:22.047 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:22.004+0000 7fca2ed9d700 1 -- 172.21.15.163:0/3313598468 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca240095f0 con 0x7fca30100180 2023-07-14T18:11:22.048 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:22.005+0000 7fca2ed9d700 1 --2- 172.21.15.163:0/3313598468 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fca30100180 0x7fca3019ce20 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fca28007ee0 tx=0x7fca2800d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:11:22.048 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:22.005+0000 7fca1f7fe700 1 -- 172.21.15.163:0/3313598468 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca28017070 con 0x7fca30100180 2023-07-14T18:11:22.048 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:22.005+0000 7fca1f7fe700 1 -- 172.21.15.163:0/3313598468 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fca2800f040 con 0x7fca30100180 2023-07-14T18:11:22.048 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:22.005+0000 7fca34d8f700 1 -- 172.21.15.163:0/3313598468 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fca3019d9a0 con 0x7fca30100180 2023-07-14T18:11:22.048 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:22.005+0000 7fca1f7fe700 1 -- 172.21.15.163:0/3313598468 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca28005570 con 0x7fca30100180 2023-07-14T18:11:22.048 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:22.005+0000 7fca34d8f700 1 -- 172.21.15.163:0/3313598468 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca3019de60 con 0x7fca30100180 2023-07-14T18:11:22.049 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:22.006+0000 7fca34d8f700 1 -- 172.21.15.163:0/3313598468 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fca3010a180 con 0x7fca30100180 2023-07-14T18:11:22.049 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:22.007+0000 7fca1f7fe700 1 -- 172.21.15.163:0/3313598468 <== mon.0 v2:172.21.15.163:3300/0 4 ==== mgrmap(e 16) v1 ==== 135716+0+0 (secure 0 0 0) 0x7fca2800db20 con 0x7fca30100180 2023-07-14T18:11:22.050 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:22.008+0000 7fca1f7fe700 1 --2- 172.21.15.163:0/3313598468 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7fca180a1150 0x7fca180a3600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:11:22.050 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:22.008+0000 7fca2e59c700 1 --2- 172.21.15.163:0/3313598468 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7fca180a1150 0x7fca180a3600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:11:22.050 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:22.008+0000 7fca1f7fe700 1 -- 172.21.15.163:0/3313598468 <== mon.0 v2:172.21.15.163:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 8730+0+0 (secure 0 0 0) 0x7fca280cc8c0 con 0x7fca30100180 2023-07-14T18:11:22.050 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:22.008+0000 7fca2e59c700 1 --2- 172.21.15.163:0/3313598468 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7fca180a1150 0x7fca180a3600 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fca2400b5c0 tx=0x7fca24005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:11:22.050 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:22.011+0000 7fca1f7fe700 1 -- 172.21.15.163:0/3313598468 <== mon.0 v2:172.21.15.163:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178025 (secure 0 0 0) 0x7fca28095e20 con 0x7fca30100180 2023-07-14T18:11:22.173 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:11:21 smithi184 ceph-mon[98481]: from='client.? 172.21.15.163:0/1654930458' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-07-14T18:11:22.241 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:22.203+0000 7fca34d8f700 1 -- 172.21.15.163:0/3313598468 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fca3019e470 con 0x7fca30100180 2023-07-14T18:11:22.242 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:22.203+0000 7fca1f7fe700 1 -- 172.21.15.163:0/3313598468 <== mon.0 v2:172.21.15.163:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v84) v1 ==== 104+0+11 (secure 0 0 0) 0x7fca28099440 con 0x7fca30100180 2023-07-14T18:11:22.242 INFO:teuthology.orchestra.run.smithi163.stdout:pg_num: 32 2023-07-14T18:11:22.244 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:22.205+0000 7fca34d8f700 1 -- 172.21.15.163:0/3313598468 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7fca180a1150 msgr2=0x7fca180a3600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:11:22.244 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:22.205+0000 7fca34d8f700 1 --2- 172.21.15.163:0/3313598468 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7fca180a1150 0x7fca180a3600 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fca2400b5c0 tx=0x7fca24005fb0 comp rx=0 tx=0).stop 2023-07-14T18:11:22.245 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:22.205+0000 7fca34d8f700 1 -- 172.21.15.163:0/3313598468 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fca30100180 msgr2=0x7fca3019ce20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:11:22.245 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:22.205+0000 7fca34d8f700 1 --2- 172.21.15.163:0/3313598468 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fca30100180 0x7fca3019ce20 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fca28007ee0 tx=0x7fca2800d3b0 comp rx=0 tx=0).stop 2023-07-14T18:11:22.245 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:22.205+0000 7fca34d8f700 1 -- 172.21.15.163:0/3313598468 shutdown_connections 2023-07-14T18:11:22.246 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:22.205+0000 7fca34d8f700 1 --2- 172.21.15.163:0/3313598468 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7fca180a1150 0x7fca180a3600 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:22.246 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:22.205+0000 7fca34d8f700 1 --2- 172.21.15.163:0/3313598468 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fca300fed40 0x7fca30195870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:22.246 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:22.205+0000 7fca34d8f700 1 --2- 172.21.15.163:0/3313598468 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fca30100180 0x7fca3019ce20 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:22.246 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:22.205+0000 7fca34d8f700 1 --2- 172.21.15.163:0/3313598468 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fca300ff6f0 0x7fca30195db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:22.247 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:22.205+0000 7fca34d8f700 1 -- 172.21.15.163:0/3313598468 >> 172.21.15.163:0/3313598468 conn(0x7fca300f98a0 msgr2=0x7fca300fb3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:11:22.247 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:22.205+0000 7fca34d8f700 1 -- 172.21.15.163:0/3313598468 shutdown_connections 2023-07-14T18:11:22.247 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:22.205+0000 7fca34d8f700 1 -- 172.21.15.163:0/3313598468 wait complete. 2023-07-14T18:11:22.256 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-14T18:11:22.275 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:11:21 smithi172 ceph-mon[97983]: from='client.? 172.21.15.163:0/1654930458' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-07-14T18:11:22.384 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:22.343+0000 7f43f1a74700 1 -- 172.21.15.163:0/869579059 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f43ec1006c0 msgr2=0x7f43ec106f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:11:22.384 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:22.343+0000 7f43f1a74700 1 --2- 172.21.15.163:0/869579059 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f43ec1006c0 0x7f43ec106f80 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f43e400b0a0 tx=0x7f43e400b3b0 comp rx=0 tx=0).stop 2023-07-14T18:11:22.384 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:22.343+0000 7f43f1a74700 1 -- 172.21.15.163:0/869579059 shutdown_connections 2023-07-14T18:11:22.384 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:22.343+0000 7f43f1a74700 1 --2- 172.21.15.163:0/869579059 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f43ec0feb40 0x7f43ec0fef50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:22.385 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:22.343+0000 7f43f1a74700 1 --2- 172.21.15.163:0/869579059 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f43ec1006c0 0x7f43ec106f80 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:22.385 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:22.343+0000 7f43f1a74700 1 --2- 172.21.15.163:0/869579059 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f43ec0ffd30 0x7f43ec100180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:22.385 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:22.343+0000 7f43f1a74700 1 -- 172.21.15.163:0/869579059 >> 172.21.15.163:0/869579059 conn(0x7f43ec0fa160 msgr2=0x7f43ec0fc590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:11:22.385 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:22.343+0000 7f43f1a74700 1 -- 172.21.15.163:0/869579059 shutdown_connections 2023-07-14T18:11:22.385 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:22.343+0000 7f43f1a74700 1 -- 172.21.15.163:0/869579059 wait complete. 2023-07-14T18:11:22.385 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:22.344+0000 7f43f1a74700 1 Processor -- start 2023-07-14T18:11:22.386 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:22.344+0000 7f43f1a74700 1 -- start start 2023-07-14T18:11:22.386 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:22.344+0000 7f43f1a74700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f43ec0feb40 0x7f43ec194890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:11:22.386 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:22.344+0000 7f43f1a74700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f43ec0ffd30 0x7f43ec194dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:11:22.386 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:22.344+0000 7f43f1a74700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f43ec1006c0 0x7f43ec19be40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:11:22.386 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:22.344+0000 7f43f1a74700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43ec19c410 con 0x7f43ec1006c0 2023-07-14T18:11:22.386 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:22.344+0000 7f43f1a74700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43ec19c550 con 0x7f43ec0feb40 2023-07-14T18:11:22.386 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:22.344+0000 7f43f1a74700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43ec19c6e0 con 0x7f43ec0ffd30 2023-07-14T18:11:22.387 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:22.344+0000 7f43ebfff700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f43ec1006c0 0x7f43ec19be40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:11:22.387 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:22.344+0000 7f43ebfff700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f43ec1006c0 0x7f43ec19be40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:55998/0 (socket says 172.21.15.163:55998) 2023-07-14T18:11:22.387 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:22.344+0000 7f43ebfff700 1 -- 172.21.15.163:0/1389918711 learned_addr learned my addr 172.21.15.163:0/1389918711 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:11:22.387 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:22.345+0000 7f43eaffd700 1 --2- 172.21.15.163:0/1389918711 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f43ec0ffd30 0x7f43ec194dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:11:22.387 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:22.345+0000 7f43eb7fe700 1 --2- 172.21.15.163:0/1389918711 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f43ec0feb40 0x7f43ec194890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:11:22.387 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:22.345+0000 7f43ebfff700 1 -- 172.21.15.163:0/1389918711 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f43ec0ffd30 msgr2=0x7f43ec194dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:11:22.387 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:22.345+0000 7f43ebfff700 1 --2- 172.21.15.163:0/1389918711 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f43ec0ffd30 0x7f43ec194dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:22.388 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:22.345+0000 7f43ebfff700 1 -- 172.21.15.163:0/1389918711 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f43ec0feb40 msgr2=0x7f43ec194890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:11:22.388 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:22.345+0000 7f43ebfff700 1 --2- 172.21.15.163:0/1389918711 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f43ec0feb40 0x7f43ec194890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:22.388 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:22.345+0000 7f43ebfff700 1 -- 172.21.15.163:0/1389918711 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43e4009d00 con 0x7f43ec1006c0 2023-07-14T18:11:22.388 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:22.345+0000 7f43eb7fe700 1 --2- 172.21.15.163:0/1389918711 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f43ec0feb40 0x7f43ec194890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T18:11:22.388 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:22.345+0000 7f43eaffd700 1 --2- 172.21.15.163:0/1389918711 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f43ec0ffd30 0x7f43ec194dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T18:11:22.388 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:22.345+0000 7f43ebfff700 1 --2- 172.21.15.163:0/1389918711 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f43ec1006c0 0x7f43ec19be40 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f43e400b830 tx=0x7f43e4004d90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:11:22.388 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:22.345+0000 7f43e8ff9700 1 -- 172.21.15.163:0/1389918711 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43e400e040 con 0x7f43ec1006c0 2023-07-14T18:11:22.389 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:22.345+0000 7f43f1a74700 1 -- 172.21.15.163:0/1389918711 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f43ec19c960 con 0x7f43ec1006c0 2023-07-14T18:11:22.389 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:22.345+0000 7f43e8ff9700 1 -- 172.21.15.163:0/1389918711 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f43e4009440 con 0x7f43ec1006c0 2023-07-14T18:11:22.389 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:22.345+0000 7f43e8ff9700 1 -- 172.21.15.163:0/1389918711 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43e401dbe0 con 0x7f43ec1006c0 2023-07-14T18:11:22.389 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:22.345+0000 7f43f1a74700 1 -- 172.21.15.163:0/1389918711 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f43ec19cd80 con 0x7f43ec1006c0 2023-07-14T18:11:22.390 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:22.346+0000 7f43f1a74700 1 -- 172.21.15.163:0/1389918711 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f43ec1060f0 con 0x7f43ec1006c0 2023-07-14T18:11:22.390 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:22.347+0000 7f43e8ff9700 1 -- 172.21.15.163:0/1389918711 <== mon.0 v2:172.21.15.163:3300/0 4 ==== mgrmap(e 16) v1 ==== 135716+0+0 (secure 0 0 0) 0x7f43e4005450 con 0x7f43ec1006c0 2023-07-14T18:11:22.390 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:22.347+0000 7f43e8ff9700 1 --2- 172.21.15.163:0/1389918711 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f43d80a11d0 0x7f43d80a3680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:11:22.390 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:22.348+0000 7f43eb7fe700 1 --2- 172.21.15.163:0/1389918711 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f43d80a11d0 0x7f43d80a3680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:11:22.391 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:22.348+0000 7f43e8ff9700 1 -- 172.21.15.163:0/1389918711 <== mon.0 v2:172.21.15.163:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 8730+0+0 (secure 0 0 0) 0x7f43e40ce5c0 con 0x7f43ec1006c0 2023-07-14T18:11:22.391 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:22.348+0000 7f43eb7fe700 1 --2- 172.21.15.163:0/1389918711 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f43d80a11d0 0x7f43d80a3680 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f43dc005fd0 tx=0x7f43dc005f00 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:11:22.391 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:22.352+0000 7f43e8ff9700 1 -- 172.21.15.163:0/1389918711 <== mon.0 v2:172.21.15.163:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178025 (secure 0 0 0) 0x7f43e4097b50 con 0x7f43ec1006c0 2023-07-14T18:11:22.578 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:22.540+0000 7f43f1a74700 1 -- 172.21.15.163:0/1389918711 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f43ec061250 con 0x7f43ec1006c0 2023-07-14T18:11:22.579 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:22.540+0000 7f43e8ff9700 1 -- 172.21.15.163:0/1389918711 <== mon.0 v2:172.21.15.163:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v84) v1 ==== 100+0+11 (secure 0 0 0) 0x7f43e409b170 con 0x7f43ec1006c0 2023-07-14T18:11:22.579 INFO:teuthology.orchestra.run.smithi163.stdout:pg_num: 64 2023-07-14T18:11:22.581 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:22.542+0000 7f43f1a74700 1 -- 172.21.15.163:0/1389918711 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f43d80a11d0 msgr2=0x7f43d80a3680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:11:22.581 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:22.542+0000 7f43f1a74700 1 --2- 172.21.15.163:0/1389918711 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f43d80a11d0 0x7f43d80a3680 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f43dc005fd0 tx=0x7f43dc005f00 comp rx=0 tx=0).stop 2023-07-14T18:11:22.581 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:22.542+0000 7f43f1a74700 1 -- 172.21.15.163:0/1389918711 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f43ec1006c0 msgr2=0x7f43ec19be40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:11:22.581 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:22.542+0000 7f43f1a74700 1 --2- 172.21.15.163:0/1389918711 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f43ec1006c0 0x7f43ec19be40 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f43e400b830 tx=0x7f43e4004d90 comp rx=0 tx=0).stop 2023-07-14T18:11:22.582 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:22.542+0000 7f43f1a74700 1 -- 172.21.15.163:0/1389918711 shutdown_connections 2023-07-14T18:11:22.582 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:22.542+0000 7f43f1a74700 1 --2- 172.21.15.163:0/1389918711 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f43d80a11d0 0x7f43d80a3680 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:22.582 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:22.542+0000 7f43f1a74700 1 --2- 172.21.15.163:0/1389918711 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f43ec1006c0 0x7f43ec19be40 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:22.582 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:22.542+0000 7f43f1a74700 1 --2- 172.21.15.163:0/1389918711 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f43ec0feb40 0x7f43ec194890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:22.582 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:22.542+0000 7f43f1a74700 1 --2- 172.21.15.163:0/1389918711 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f43ec0ffd30 0x7f43ec194dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:22.582 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:22.542+0000 7f43f1a74700 1 -- 172.21.15.163:0/1389918711 >> 172.21.15.163:0/1389918711 conn(0x7f43ec0fa160 msgr2=0x7f43ec103230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:11:22.582 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:22.542+0000 7f43f1a74700 1 -- 172.21.15.163:0/1389918711 shutdown_connections 2023-07-14T18:11:22.583 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:22.542+0000 7f43f1a74700 1 -- 172.21.15.163:0/1389918711 wait complete. 2023-07-14T18:11:22.593 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-07-14T18:11:22.718 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:22.679+0000 7fcc2ebe6700 1 -- 172.21.15.163:0/1254757192 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fcc281018e0 msgr2=0x7fcc281081a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:11:22.718 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:22.679+0000 7fcc2ebe6700 1 --2- 172.21.15.163:0/1254757192 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fcc281018e0 0x7fcc281081a0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fcc2000b0a0 tx=0x7fcc2000b3b0 comp rx=0 tx=0).stop 2023-07-14T18:11:22.718 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:22.679+0000 7fcc2ebe6700 1 -- 172.21.15.163:0/1254757192 shutdown_connections 2023-07-14T18:11:22.718 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:22.679+0000 7fcc2ebe6700 1 --2- 172.21.15.163:0/1254757192 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fcc281018e0 0x7fcc281081a0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:22.718 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:22.679+0000 7fcc2ebe6700 1 --2- 172.21.15.163:0/1254757192 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcc280fdee0 0x7fcc280fe2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:22.719 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:22.679+0000 7fcc2ebe6700 1 --2- 172.21.15.163:0/1254757192 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcc28100f50 0x7fcc281013a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:22.719 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:22.679+0000 7fcc2ebe6700 1 -- 172.21.15.163:0/1254757192 >> 172.21.15.163:0/1254757192 conn(0x7fcc280f98a0 msgr2=0x7fcc280fbcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:11:22.719 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:22.679+0000 7fcc2ebe6700 1 -- 172.21.15.163:0/1254757192 shutdown_connections 2023-07-14T18:11:22.719 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:22.679+0000 7fcc2ebe6700 1 -- 172.21.15.163:0/1254757192 wait complete. 2023-07-14T18:11:22.719 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:22.679+0000 7fcc2ebe6700 1 Processor -- start 2023-07-14T18:11:22.719 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:22.679+0000 7fcc2ebe6700 1 -- start start 2023-07-14T18:11:22.721 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:22.679+0000 7fcc2ebe6700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcc280fdee0 0x7fcc28195910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:11:22.722 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:22.679+0000 7fcc2ebe6700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fcc28100f50 0x7fcc28195e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:11:22.722 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:22.679+0000 7fcc2ebe6700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcc281018e0 0x7fcc2819cec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:11:22.722 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:22.679+0000 7fcc2ebe6700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc2819d490 con 0x7fcc28100f50 2023-07-14T18:11:22.722 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:22.679+0000 7fcc2ebe6700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc2819d5d0 con 0x7fcc280fdee0 2023-07-14T18:11:22.722 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:22.679+0000 7fcc2ebe6700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc2819d760 con 0x7fcc281018e0 2023-07-14T18:11:22.723 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:22.680+0000 7fcc27fff700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fcc28100f50 0x7fcc28195e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:11:22.723 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:22.680+0000 7fcc27fff700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fcc28100f50 0x7fcc28195e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:56010/0 (socket says 172.21.15.163:56010) 2023-07-14T18:11:22.723 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:22.680+0000 7fcc27fff700 1 -- 172.21.15.163:0/1678563313 learned_addr learned my addr 172.21.15.163:0/1678563313 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:11:22.723 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:22.680+0000 7fcc2c982700 1 --2- 172.21.15.163:0/1678563313 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcc280fdee0 0x7fcc28195910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:11:22.723 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:22.680+0000 7fcc2d183700 1 --2- 172.21.15.163:0/1678563313 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcc281018e0 0x7fcc2819cec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:11:22.723 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:22.680+0000 7fcc27fff700 1 -- 172.21.15.163:0/1678563313 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcc281018e0 msgr2=0x7fcc2819cec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:11:22.723 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:22.680+0000 7fcc27fff700 1 --2- 172.21.15.163:0/1678563313 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcc281018e0 0x7fcc2819cec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:22.724 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:22.680+0000 7fcc27fff700 1 -- 172.21.15.163:0/1678563313 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcc280fdee0 msgr2=0x7fcc28195910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:11:22.724 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:22.680+0000 7fcc27fff700 1 --2- 172.21.15.163:0/1678563313 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcc280fdee0 0x7fcc28195910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:22.724 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:22.680+0000 7fcc27fff700 1 -- 172.21.15.163:0/1678563313 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc20009d00 con 0x7fcc28100f50 2023-07-14T18:11:22.724 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:22.680+0000 7fcc27fff700 1 --2- 172.21.15.163:0/1678563313 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fcc28100f50 0x7fcc28195e50 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fcc1400e9a0 tx=0x7fcc1400ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:11:22.724 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:22.680+0000 7fcc25ffb700 1 -- 172.21.15.163:0/1678563313 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc14009790 con 0x7fcc28100f50 2023-07-14T18:11:22.724 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:22.680+0000 7fcc25ffb700 1 -- 172.21.15.163:0/1678563313 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fcc14010430 con 0x7fcc28100f50 2023-07-14T18:11:22.725 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:22.680+0000 7fcc2ebe6700 1 -- 172.21.15.163:0/1678563313 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcc2819da40 con 0x7fcc28100f50 2023-07-14T18:11:22.725 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:22.680+0000 7fcc25ffb700 1 -- 172.21.15.163:0/1678563313 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc1400cea0 con 0x7fcc28100f50 2023-07-14T18:11:22.725 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:22.680+0000 7fcc2ebe6700 1 -- 172.21.15.163:0/1678563313 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcc2819df50 con 0x7fcc28100f50 2023-07-14T18:11:22.725 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:22.681+0000 7fcc2ebe6700 1 -- 172.21.15.163:0/1678563313 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcc28106ce0 con 0x7fcc28100f50 2023-07-14T18:11:22.725 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:22.682+0000 7fcc25ffb700 1 -- 172.21.15.163:0/1678563313 <== mon.0 v2:172.21.15.163:3300/0 4 ==== mgrmap(e 16) v1 ==== 135716+0+0 (secure 0 0 0) 0x7fcc140105a0 con 0x7fcc28100f50 2023-07-14T18:11:22.726 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:22.683+0000 7fcc25ffb700 1 --2- 172.21.15.163:0/1678563313 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7fcc180a1150 0x7fcc180a3600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:11:22.726 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:22.683+0000 7fcc25ffb700 1 -- 172.21.15.163:0/1678563313 <== mon.0 v2:172.21.15.163:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 8730+0+0 (secure 0 0 0) 0x7fcc14014070 con 0x7fcc28100f50 2023-07-14T18:11:22.726 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:22.683+0000 7fcc2c982700 1 --2- 172.21.15.163:0/1678563313 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7fcc180a1150 0x7fcc180a3600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:11:22.726 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:22.683+0000 7fcc2c982700 1 --2- 172.21.15.163:0/1678563313 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7fcc180a1150 0x7fcc180a3600 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fcc280674e0 tx=0x7fcc1c00b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:11:22.727 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:22.686+0000 7fcc25ffb700 1 -- 172.21.15.163:0/1678563313 <== mon.0 v2:172.21.15.163:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178025 (secure 0 0 0) 0x7fcc14096430 con 0x7fcc28100f50 2023-07-14T18:11:22.913 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:22.875+0000 7fcc2ebe6700 1 -- 172.21.15.163:0/1678563313 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fcc2802caf0 con 0x7fcc28100f50 2023-07-14T18:11:22.914 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:22.875+0000 7fcc25ffb700 1 -- 172.21.15.163:0/1678563313 <== mon.0 v2:172.21.15.163:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v84) v1 ==== 103+0+11 (secure 0 0 0) 0x7fcc140260a0 con 0x7fcc28100f50 2023-07-14T18:11:22.914 INFO:teuthology.orchestra.run.smithi163.stdout:pg_num: 32 2023-07-14T18:11:22.916 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:22.877+0000 7fcc2ebe6700 1 -- 172.21.15.163:0/1678563313 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7fcc180a1150 msgr2=0x7fcc180a3600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:11:22.916 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:22.877+0000 7fcc2ebe6700 1 --2- 172.21.15.163:0/1678563313 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7fcc180a1150 0x7fcc180a3600 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fcc280674e0 tx=0x7fcc1c00b410 comp rx=0 tx=0).stop 2023-07-14T18:11:22.916 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:22.877+0000 7fcc2ebe6700 1 -- 172.21.15.163:0/1678563313 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fcc28100f50 msgr2=0x7fcc28195e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:11:22.916 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:22.877+0000 7fcc2ebe6700 1 --2- 172.21.15.163:0/1678563313 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fcc28100f50 0x7fcc28195e50 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fcc1400e9a0 tx=0x7fcc1400ecb0 comp rx=0 tx=0).stop 2023-07-14T18:11:22.916 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:22.877+0000 7fcc2ebe6700 1 -- 172.21.15.163:0/1678563313 shutdown_connections 2023-07-14T18:11:22.917 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:22.877+0000 7fcc2ebe6700 1 --2- 172.21.15.163:0/1678563313 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7fcc180a1150 0x7fcc180a3600 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:22.917 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:22.877+0000 7fcc2ebe6700 1 --2- 172.21.15.163:0/1678563313 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcc281018e0 0x7fcc2819cec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:22.917 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:22.877+0000 7fcc2ebe6700 1 --2- 172.21.15.163:0/1678563313 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcc280fdee0 0x7fcc28195910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:22.917 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:22.877+0000 7fcc2ebe6700 1 --2- 172.21.15.163:0/1678563313 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fcc28100f50 0x7fcc28195e50 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:22.917 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:22.877+0000 7fcc2ebe6700 1 -- 172.21.15.163:0/1678563313 >> 172.21.15.163:0/1678563313 conn(0x7fcc280f98a0 msgr2=0x7fcc280fbb50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:11:22.917 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:22.877+0000 7fcc2ebe6700 1 -- 172.21.15.163:0/1678563313 shutdown_connections 2023-07-14T18:11:22.917 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:22.877+0000 7fcc2ebe6700 1 -- 172.21.15.163:0/1678563313 wait complete. 2023-07-14T18:11:22.927 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:11:22 smithi163 ceph-mon[96576]: pgmap v257: 129 pgs: 129 active+clean; 579 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 0 op/s 2023-07-14T18:11:22.927 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:11:22 smithi163 ceph-mon[96576]: from='client.? 172.21.15.163:0/3868882862' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-07-14T18:11:22.927 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:11:22 smithi163 ceph-mon[96576]: from='client.? 172.21.15.163:0/3313598468' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-07-14T18:11:22.927 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:11:22 smithi163 ceph-mon[96576]: from='client.? 172.21.15.163:0/1389918711' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-07-14T18:11:22.928 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-07-14T18:11:23.050 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:23.011+0000 7f3c3e928700 1 -- 172.21.15.163:0/1649875593 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f3c380ff750 msgr2=0x7f3c38107020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:11:23.050 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:23.011+0000 7f3c3e928700 1 --2- 172.21.15.163:0/1649875593 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f3c380ff750 0x7f3c38107020 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f3c3000b0a0 tx=0x7f3c3000b3b0 comp rx=0 tx=0).stop 2023-07-14T18:11:23.050 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:23.011+0000 7f3c3e928700 1 -- 172.21.15.163:0/1649875593 shutdown_connections 2023-07-14T18:11:23.051 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:23.011+0000 7f3c3e928700 1 --2- 172.21.15.163:0/1649875593 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3c38100120 0x7f3c38100530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:23.051 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:23.011+0000 7f3c3e928700 1 --2- 172.21.15.163:0/1649875593 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f3c380ff750 0x7f3c38107020 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:23.051 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:23.011+0000 7f3c3e928700 1 --2- 172.21.15.163:0/1649875593 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3c380fedc0 0x7f3c380ff210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:23.051 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:23.011+0000 7f3c3e928700 1 -- 172.21.15.163:0/1649875593 >> 172.21.15.163:0/1649875593 conn(0x7f3c380f98e0 msgr2=0x7f3c380fbd10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:11:23.051 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:23.011+0000 7f3c3e928700 1 -- 172.21.15.163:0/1649875593 shutdown_connections 2023-07-14T18:11:23.051 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:23.011+0000 7f3c3e928700 1 -- 172.21.15.163:0/1649875593 wait complete. 2023-07-14T18:11:23.051 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:23.011+0000 7f3c3e928700 1 Processor -- start 2023-07-14T18:11:23.051 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:23.012+0000 7f3c3e928700 1 -- start start 2023-07-14T18:11:23.053 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:23.012+0000 7f3c3e928700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3c380fedc0 0x7f3c38102b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:11:23.053 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:23.012+0000 7f3c3e928700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3c380ff750 0x7f3c381011b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:11:23.053 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:23.012+0000 7f3c3e928700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f3c38100120 0x7f3c381016f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:11:23.053 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:23.012+0000 7f3c3e928700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c38101e90 con 0x7f3c38100120 2023-07-14T18:11:23.054 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:23.012+0000 7f3c3e928700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c38102000 con 0x7f3c380ff750 2023-07-14T18:11:23.054 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:23.012+0000 7f3c3e928700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c3819fa20 con 0x7f3c380fedc0 2023-07-14T18:11:23.054 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:23.012+0000 7f3c3cec5700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f3c38100120 0x7f3c381016f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:11:23.054 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:23.012+0000 7f3c3cec5700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f3c38100120 0x7f3c381016f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:56026/0 (socket says 172.21.15.163:56026) 2023-07-14T18:11:23.054 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:23.012+0000 7f3c3cec5700 1 -- 172.21.15.163:0/1495521947 learned_addr learned my addr 172.21.15.163:0/1495521947 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:11:23.054 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:23.012+0000 7f3c377fe700 1 --2- 172.21.15.163:0/1495521947 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3c380ff750 0x7f3c381011b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:11:23.054 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:23.012+0000 7f3c37fff700 1 --2- 172.21.15.163:0/1495521947 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3c380fedc0 0x7f3c38102b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:11:23.055 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:23.012+0000 7f3c3cec5700 1 -- 172.21.15.163:0/1495521947 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3c380fedc0 msgr2=0x7f3c38102b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:11:23.055 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:23.012+0000 7f3c3cec5700 1 --2- 172.21.15.163:0/1495521947 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3c380fedc0 0x7f3c38102b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:23.055 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:23.012+0000 7f3c3cec5700 1 -- 172.21.15.163:0/1495521947 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3c380ff750 msgr2=0x7f3c381011b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:11:23.055 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:23.012+0000 7f3c3cec5700 1 --2- 172.21.15.163:0/1495521947 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3c380ff750 0x7f3c381011b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:23.055 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:23.012+0000 7f3c3cec5700 1 -- 172.21.15.163:0/1495521947 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c30009d00 con 0x7f3c38100120 2023-07-14T18:11:23.055 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:23.012+0000 7f3c3cec5700 1 --2- 172.21.15.163:0/1495521947 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f3c38100120 0x7f3c381016f0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f3c3000b070 tx=0x7f3c30004c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:11:23.055 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:23.013+0000 7f3c357fa700 1 -- 172.21.15.163:0/1495521947 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c3000e040 con 0x7f3c38100120 2023-07-14T18:11:23.055 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:23.013+0000 7f3c357fa700 1 -- 172.21.15.163:0/1495521947 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f3c30003e90 con 0x7f3c38100120 2023-07-14T18:11:23.056 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:23.013+0000 7f3c3e928700 1 -- 172.21.15.163:0/1495521947 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c3819fca0 con 0x7f3c38100120 2023-07-14T18:11:23.056 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:23.013+0000 7f3c357fa700 1 -- 172.21.15.163:0/1495521947 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c30004020 con 0x7f3c38100120 2023-07-14T18:11:23.056 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:23.013+0000 7f3c3e928700 1 -- 172.21.15.163:0/1495521947 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c381a0120 con 0x7f3c38100120 2023-07-14T18:11:23.056 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:23.014+0000 7f3c3e928700 1 -- 172.21.15.163:0/1495521947 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3c3810a220 con 0x7f3c38100120 2023-07-14T18:11:23.057 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:23.015+0000 7f3c357fa700 1 -- 172.21.15.163:0/1495521947 <== mon.0 v2:172.21.15.163:3300/0 4 ==== mgrmap(e 16) v1 ==== 135716+0+0 (secure 0 0 0) 0x7f3c30003a00 con 0x7f3c38100120 2023-07-14T18:11:23.057 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:23.015+0000 7f3c357fa700 1 --2- 172.21.15.163:0/1495521947 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f3c200a1150 0x7f3c200a3600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:11:23.057 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:23.015+0000 7f3c37fff700 1 --2- 172.21.15.163:0/1495521947 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f3c200a1150 0x7f3c200a3600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:11:23.057 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:23.015+0000 7f3c357fa700 1 -- 172.21.15.163:0/1495521947 <== mon.0 v2:172.21.15.163:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 8730+0+0 (secure 0 0 0) 0x7f3c300ce730 con 0x7f3c38100120 2023-07-14T18:11:23.057 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:23.016+0000 7f3c37fff700 1 --2- 172.21.15.163:0/1495521947 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f3c200a1150 0x7f3c200a3600 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f3c38068750 tx=0x7f3c2800a380 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:11:23.058 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:23.019+0000 7f3c357fa700 1 -- 172.21.15.163:0/1495521947 <== mon.0 v2:172.21.15.163:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178025 (secure 0 0 0) 0x7f3c30097d20 con 0x7f3c38100120 2023-07-14T18:11:23.173 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:11:22 smithi184 ceph-mon[98481]: pgmap v257: 129 pgs: 129 active+clean; 579 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 0 op/s 2023-07-14T18:11:23.174 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:11:22 smithi184 ceph-mon[98481]: from='client.? 172.21.15.163:0/3868882862' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-07-14T18:11:23.174 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:11:22 smithi184 ceph-mon[98481]: from='client.? 172.21.15.163:0/3313598468' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-07-14T18:11:23.174 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:11:22 smithi184 ceph-mon[98481]: from='client.? 172.21.15.163:0/1389918711' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-07-14T18:11:23.261 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:23.222+0000 7f3c3e928700 1 -- 172.21.15.163:0/1495521947 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f3c381a06d0 con 0x7f3c38100120 2023-07-14T18:11:23.261 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:23.223+0000 7f3c357fa700 1 -- 172.21.15.163:0/1495521947 <== mon.0 v2:172.21.15.163:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 10 entries v84) v1 ==== 81+0+600 (secure 0 0 0) 0x7f3c3009b340 con 0x7f3c38100120 2023-07-14T18:11:23.262 INFO:teuthology.orchestra.run.smithi163.stdout:172.21.15.163:6801/1086512093 2023-07-15T18:05:15.331458+0000 2023-07-14T18:11:23.262 INFO:teuthology.orchestra.run.smithi163.stdout:172.21.15.163:6800/1086512093 2023-07-15T18:05:15.331458+0000 2023-07-14T18:11:23.262 INFO:teuthology.orchestra.run.smithi163.stdout:172.21.15.163:0/4235784810 2023-07-15T18:05:15.331458+0000 2023-07-14T18:11:23.262 INFO:teuthology.orchestra.run.smithi163.stdout:172.21.15.163:6800/236891232 2023-07-15T18:04:53.288443+0000 2023-07-14T18:11:23.262 INFO:teuthology.orchestra.run.smithi163.stdout:172.21.15.163:6801/236891232 2023-07-15T18:04:53.288443+0000 2023-07-14T18:11:23.262 INFO:teuthology.orchestra.run.smithi163.stdout:172.21.15.163:0/3260193612 2023-07-15T18:05:15.331458+0000 2023-07-14T18:11:23.263 INFO:teuthology.orchestra.run.smithi163.stdout:172.21.15.163:0/3513629472 2023-07-15T18:04:53.288443+0000 2023-07-14T18:11:23.263 INFO:teuthology.orchestra.run.smithi163.stdout:172.21.15.163:0/1090329830 2023-07-15T18:04:53.288443+0000 2023-07-14T18:11:23.263 INFO:teuthology.orchestra.run.smithi163.stdout:172.21.15.163:0/3868922045 2023-07-15T18:05:15.331458+0000 2023-07-14T18:11:23.263 INFO:teuthology.orchestra.run.smithi163.stdout:172.21.15.163:0/2945662447 2023-07-15T18:04:53.288443+0000 2023-07-14T18:11:23.264 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:23.225+0000 7f3c3e928700 1 -- 172.21.15.163:0/1495521947 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f3c200a1150 msgr2=0x7f3c200a3600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:11:23.264 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:23.225+0000 7f3c3e928700 1 --2- 172.21.15.163:0/1495521947 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f3c200a1150 0x7f3c200a3600 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f3c38068750 tx=0x7f3c2800a380 comp rx=0 tx=0).stop 2023-07-14T18:11:23.264 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:23.225+0000 7f3c3e928700 1 -- 172.21.15.163:0/1495521947 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f3c38100120 msgr2=0x7f3c381016f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:11:23.264 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:23.225+0000 7f3c3e928700 1 --2- 172.21.15.163:0/1495521947 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f3c38100120 0x7f3c381016f0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f3c3000b070 tx=0x7f3c30004c80 comp rx=0 tx=0).stop 2023-07-14T18:11:23.264 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:23.225+0000 7f3c3e928700 1 -- 172.21.15.163:0/1495521947 shutdown_connections 2023-07-14T18:11:23.264 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:23.225+0000 7f3c3e928700 1 --2- 172.21.15.163:0/1495521947 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f3c200a1150 0x7f3c200a3600 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:23.265 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:23.225+0000 7f3c3e928700 1 --2- 172.21.15.163:0/1495521947 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3c380fedc0 0x7f3c38102b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:23.265 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:23.225+0000 7f3c3e928700 1 --2- 172.21.15.163:0/1495521947 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f3c38100120 0x7f3c381016f0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:23.265 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:23.225+0000 7f3c3e928700 1 --2- 172.21.15.163:0/1495521947 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3c380ff750 0x7f3c381011b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:23.265 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:23.225+0000 7f3c3e928700 1 -- 172.21.15.163:0/1495521947 >> 172.21.15.163:0/1495521947 conn(0x7f3c380f98e0 msgr2=0x7f3c380fdd90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:11:23.265 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:23.225+0000 7f3c3e928700 1 -- 172.21.15.163:0/1495521947 shutdown_connections 2023-07-14T18:11:23.265 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:23.225+0000 7f3c3e928700 1 -- 172.21.15.163:0/1495521947 wait complete. 2023-07-14T18:11:23.266 INFO:teuthology.orchestra.run.smithi163.stderr:listed 10 entries 2023-07-14T18:11:23.274 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:11:22 smithi172 ceph-mon[97983]: pgmap v257: 129 pgs: 129 active+clean; 579 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 0 op/s 2023-07-14T18:11:23.275 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:11:22 smithi172 ceph-mon[97983]: from='client.? 172.21.15.163:0/3868882862' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-07-14T18:11:23.275 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:11:22 smithi172 ceph-mon[97983]: from='client.? 172.21.15.163:0/3313598468' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-07-14T18:11:23.275 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:11:22 smithi172 ceph-mon[97983]: from='client.? 172.21.15.163:0/1389918711' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-07-14T18:11:23.276 DEBUG:teuthology.orchestra.run.smithi163:> set -ex 2023-07-14T18:11:23.276 DEBUG:teuthology.orchestra.run.smithi163:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-14T18:11:23.293 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-14T18:11:23.458 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:23.416+0000 7f8bed626700 1 -- 172.21.15.163:0/3354075201 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f8be8100710 msgr2=0x7f8be8102af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:11:23.459 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:23.416+0000 7f8bed626700 1 --2- 172.21.15.163:0/3354075201 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f8be8100710 0x7f8be8102af0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f8bd8009990 tx=0x7f8bd8009ca0 comp rx=0 tx=0).stop 2023-07-14T18:11:23.459 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:23.416+0000 7f8bed626700 1 -- 172.21.15.163:0/3354075201 shutdown_connections 2023-07-14T18:11:23.459 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:23.416+0000 7f8bed626700 1 --2- 172.21.15.163:0/3354075201 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8be8105950 0x7f8be8107d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:23.459 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:23.416+0000 7f8bed626700 1 --2- 172.21.15.163:0/3354075201 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f8be8100710 0x7f8be8102af0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:23.460 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:23.416+0000 7f8bed626700 1 --2- 172.21.15.163:0/3354075201 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8be8103030 0x7f8be8105410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:23.460 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:23.416+0000 7f8bed626700 1 -- 172.21.15.163:0/3354075201 >> 172.21.15.163:0/3354075201 conn(0x7f8be80fa130 msgr2=0x7f8be80fc580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:11:23.460 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:23.416+0000 7f8bed626700 1 -- 172.21.15.163:0/3354075201 shutdown_connections 2023-07-14T18:11:23.460 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:23.416+0000 7f8bed626700 1 -- 172.21.15.163:0/3354075201 wait complete. 2023-07-14T18:11:23.461 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:23.417+0000 7f8bed626700 1 Processor -- start 2023-07-14T18:11:23.461 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:23.417+0000 7f8bed626700 1 -- start start 2023-07-14T18:11:23.461 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:23.417+0000 7f8bed626700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8be8100710 0x7f8be8195790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:11:23.462 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:23.417+0000 7f8bed626700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f8be8103030 0x7f8be8195cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:11:23.462 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:23.417+0000 7f8bed626700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8be8105950 0x7f8be819cd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:11:23.462 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:23.417+0000 7f8bed626700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8be819d310 con 0x7f8be8103030 2023-07-14T18:11:23.462 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:23.417+0000 7f8bed626700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8be819d450 con 0x7f8be8100710 2023-07-14T18:11:23.463 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:23.417+0000 7f8bed626700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8be819d5e0 con 0x7f8be8105950 2023-07-14T18:11:23.463 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:23.417+0000 7f8be67fc700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f8be8103030 0x7f8be8195cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:11:23.463 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:23.417+0000 7f8be67fc700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f8be8103030 0x7f8be8195cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:56038/0 (socket says 172.21.15.163:56038) 2023-07-14T18:11:23.463 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:23.417+0000 7f8be67fc700 1 -- 172.21.15.163:0/4070672401 learned_addr learned my addr 172.21.15.163:0/4070672401 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:11:23.464 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:23.418+0000 7f8be6ffd700 1 --2- 172.21.15.163:0/4070672401 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8be8100710 0x7f8be8195790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:11:23.464 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:23.418+0000 7f8be77fe700 1 --2- 172.21.15.163:0/4070672401 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8be8105950 0x7f8be819cd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:11:23.464 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:23.418+0000 7f8be67fc700 1 -- 172.21.15.163:0/4070672401 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8be8105950 msgr2=0x7f8be819cd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:11:23.464 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:23.418+0000 7f8be67fc700 1 --2- 172.21.15.163:0/4070672401 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8be8105950 0x7f8be819cd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:23.465 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:23.418+0000 7f8be67fc700 1 -- 172.21.15.163:0/4070672401 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8be8100710 msgr2=0x7f8be8195790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:11:23.465 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:23.418+0000 7f8be67fc700 1 --2- 172.21.15.163:0/4070672401 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8be8100710 0x7f8be8195790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:23.465 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:23.418+0000 7f8be67fc700 1 -- 172.21.15.163:0/4070672401 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8bd80095f0 con 0x7f8be8103030 2023-07-14T18:11:23.465 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:23.418+0000 7f8be6ffd700 1 --2- 172.21.15.163:0/4070672401 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8be8100710 0x7f8be8195790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T18:11:23.466 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:23.418+0000 7f8be67fc700 1 --2- 172.21.15.163:0/4070672401 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f8be8103030 0x7f8be8195cd0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f8bdc00c9b0 tx=0x7f8bdc00cd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:11:23.466 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:23.418+0000 7f8bcffff700 1 -- 172.21.15.163:0/4070672401 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bdc007b00 con 0x7f8be8103030 2023-07-14T18:11:23.466 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:23.418+0000 7f8bcffff700 1 -- 172.21.15.163:0/4070672401 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f8bdc007c60 con 0x7f8be8103030 2023-07-14T18:11:23.467 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:23.418+0000 7f8bed626700 1 -- 172.21.15.163:0/4070672401 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8be819d8c0 con 0x7f8be8103030 2023-07-14T18:11:23.467 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:23.418+0000 7f8bcffff700 1 -- 172.21.15.163:0/4070672401 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bdc018660 con 0x7f8be8103030 2023-07-14T18:11:23.467 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:23.418+0000 7f8bed626700 1 -- 172.21.15.163:0/4070672401 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8be819ddd0 con 0x7f8be8103030 2023-07-14T18:11:23.467 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:23.419+0000 7f8bed626700 1 -- 172.21.15.163:0/4070672401 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8be80fbca0 con 0x7f8be8103030 2023-07-14T18:11:23.469 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:23.420+0000 7f8bcffff700 1 -- 172.21.15.163:0/4070672401 <== mon.0 v2:172.21.15.163:3300/0 4 ==== mgrmap(e 16) v1 ==== 135716+0+0 (secure 0 0 0) 0x7f8bdc00f450 con 0x7f8be8103030 2023-07-14T18:11:23.469 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:23.420+0000 7f8bcffff700 1 --2- 172.21.15.163:0/4070672401 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f8bd00a11a0 0x7f8bd00a3650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:11:23.469 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:23.421+0000 7f8be6ffd700 1 --2- 172.21.15.163:0/4070672401 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f8bd00a11a0 0x7f8bd00a3650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:11:23.470 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:23.421+0000 7f8bcffff700 1 -- 172.21.15.163:0/4070672401 <== mon.0 v2:172.21.15.163:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 8730+0+0 (secure 0 0 0) 0x7f8bdc0ccbc0 con 0x7f8be8103030 2023-07-14T18:11:23.470 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:23.421+0000 7f8be6ffd700 1 --2- 172.21.15.163:0/4070672401 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f8bd00a11a0 0x7f8bd00a3650 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f8bd80095c0 tx=0x7f8bd8009510 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:11:23.470 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:23.425+0000 7f8bcffff700 1 -- 172.21.15.163:0/4070672401 <== mon.0 v2:172.21.15.163:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178025 (secure 0 0 0) 0x7f8bdc096120 con 0x7f8be8103030 2023-07-14T18:11:23.656 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:23.617+0000 7f8bed626700 1 -- 172.21.15.163:0/4070672401 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8be802c8e0 con 0x7f8be8103030 2023-07-14T18:11:23.657 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:23.618+0000 7f8bcffff700 1 -- 172.21.15.163:0/4070672401 <== mon.0 v2:172.21.15.163:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v84) v1 ==== 74+0+24030 (secure 0 0 0) 0x7f8bdc099740 con 0x7f8be8103030 2023-07-14T18:11:23.658 INFO:teuthology.orchestra.run.smithi163.stdout: 2023-07-14T18:11:23.658 INFO:teuthology.orchestra.run.smithi163.stdout:{"epoch":84,"fsid":"bf7326ec-2270-11ee-9b33-001a4aab830c","created":"2023-07-14T18:04:26.263517+0000","modified":"2023-07-14T18:11:14.170253+0000","last_up_change":"2023-07-14T18:10:27.514863+0000","last_in_change":"2023-07-14T18:10:10.726443+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-14T18:07:19.653852+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-07-14T18:11:07.314989+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-07-14T18:11:08.274627+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-07-14T18:11:11.991162+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"e6490568-046d-43ef-bb07-d79fb884b276","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6802","nonce":3124653025},{"type":"v1","addr":"172.21.15.163:6803","nonce":3124653025}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6804","nonce":3124653025},{"type":"v1","addr":"172.21.15.163:6805","nonce":3124653025}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6808","nonce":3124653025},{"type":"v1","addr":"172.21.15.163:6809","nonce":3124653025}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6806","nonce":3124653025},{"type":"v1","addr":"172.21.15.163:6807","nonce":3124653025}]},"public_addr":"172.21.15.163:6803/3124653025","cluster_addr":"172.21.15.163:6805/3124653025","heartbeat_back_addr":"172.21.15.163:6809/3124653025","heartbeat_front_addr":"172.21.15.163:6807/3124653025","state":["exists","up"]},{"osd":1,"uuid":"0af39bda-f096-4603-adcc-bf1988f36603","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":3774455900},{"type":"v1","addr":"172.21.15.172:6801","nonce":3774455900}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":3774455900},{"type":"v1","addr":"172.21.15.172:6803","nonce":3774455900}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":3774455900},{"type":"v1","addr":"172.21.15.172:6807","nonce":3774455900}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":3774455900},{"type":"v1","addr":"172.21.15.172:6805","nonce":3774455900}]},"public_addr":"172.21.15.172:6801/3774455900","cluster_addr":"172.21.15.172:6803/3774455900","heartbeat_back_addr":"172.21.15.172:6807/3774455900","heartbeat_front_addr":"172.21.15.172:6805/3774455900","state":["exists","up"]},{"osd":2,"uuid":"cc732c13-af0f-4199-98e6-fe960ed4e5dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":1976927678},{"type":"v1","addr":"172.21.15.184:6801","nonce":1976927678}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":1976927678},{"type":"v1","addr":"172.21.15.184:6803","nonce":1976927678}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":1976927678},{"type":"v1","addr":"172.21.15.184:6807","nonce":1976927678}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":1976927678},{"type":"v1","addr":"172.21.15.184:6805","nonce":1976927678}]},"public_addr":"172.21.15.184:6801/1976927678","cluster_addr":"172.21.15.184:6803/1976927678","heartbeat_back_addr":"172.21.15.184:6807/1976927678","heartbeat_front_addr":"172.21.15.184:6805/1976927678","state":["exists","up"]},{"osd":3,"uuid":"dcee9576-0bc6-4ab0-8f63-79eacd0eca5f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6810","nonce":2589130694},{"type":"v1","addr":"172.21.15.163:6811","nonce":2589130694}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6812","nonce":2589130694},{"type":"v1","addr":"172.21.15.163:6813","nonce":2589130694}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6816","nonce":2589130694},{"type":"v1","addr":"172.21.15.163:6817","nonce":2589130694}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6814","nonce":2589130694},{"type":"v1","addr":"172.21.15.163:6815","nonce":2589130694}]},"public_addr":"172.21.15.163:6811/2589130694","cluster_addr":"172.21.15.163:6813/2589130694","heartbeat_back_addr":"172.21.15.163:6817/2589130694","heartbeat_front_addr":"172.21.15.163:6815/2589130694","state":["exists","up"]},{"osd":4,"uuid":"055df823-b8b0-426a-83c2-f0d727932ad8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":3319632614},{"type":"v1","addr":"172.21.15.172:6809","nonce":3319632614}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6810","nonce":3319632614},{"type":"v1","addr":"172.21.15.172:6811","nonce":3319632614}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6814","nonce":3319632614},{"type":"v1","addr":"172.21.15.172:6815","nonce":3319632614}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":3319632614},{"type":"v1","addr":"172.21.15.172:6813","nonce":3319632614}]},"public_addr":"172.21.15.172:6809/3319632614","cluster_addr":"172.21.15.172:6811/3319632614","heartbeat_back_addr":"172.21.15.172:6815/3319632614","heartbeat_front_addr":"172.21.15.172:6813/3319632614","state":["exists","up"]},{"osd":5,"uuid":"ef5ef02a-b4e2-4790-9d27-f6d2247b25c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":2662084043},{"type":"v1","addr":"172.21.15.184:6809","nonce":2662084043}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6810","nonce":2662084043},{"type":"v1","addr":"172.21.15.184:6811","nonce":2662084043}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6814","nonce":2662084043},{"type":"v1","addr":"172.21.15.184:6815","nonce":2662084043}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6812","nonce":2662084043},{"type":"v1","addr":"172.21.15.184:6813","nonce":2662084043}]},"public_addr":"172.21.15.184:6809/2662084043","cluster_addr":"172.21.15.184:6811/2662084043","heartbeat_back_addr":"172.21.15.184:6815/2662084043","heartbeat_front_addr":"172.21.15.184:6813/2662084043","state":["exists","up"]},{"osd":6,"uuid":"dba754be-0fc5-4867-a6d5-cf97eb344f81","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":44,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6818","nonce":2530874117},{"type":"v1","addr":"172.21.15.163:6819","nonce":2530874117}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6820","nonce":2530874117},{"type":"v1","addr":"172.21.15.163:6821","nonce":2530874117}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6824","nonce":2530874117},{"type":"v1","addr":"172.21.15.163:6825","nonce":2530874117}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6822","nonce":2530874117},{"type":"v1","addr":"172.21.15.163:6823","nonce":2530874117}]},"public_addr":"172.21.15.163:6819/2530874117","cluster_addr":"172.21.15.163:6821/2530874117","heartbeat_back_addr":"172.21.15.163:6825/2530874117","heartbeat_front_addr":"172.21.15.163:6823/2530874117","state":["exists","up"]},{"osd":7,"uuid":"edd76e6b-6077-4619-b00d-1e906f70ddcc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":49,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":233511803},{"type":"v1","addr":"172.21.15.172:6817","nonce":233511803}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6818","nonce":233511803},{"type":"v1","addr":"172.21.15.172:6819","nonce":233511803}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":233511803},{"type":"v1","addr":"172.21.15.172:6823","nonce":233511803}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6820","nonce":233511803},{"type":"v1","addr":"172.21.15.172:6821","nonce":233511803}]},"public_addr":"172.21.15.172:6817/233511803","cluster_addr":"172.21.15.172:6819/233511803","heartbeat_back_addr":"172.21.15.172:6823/233511803","heartbeat_front_addr":"172.21.15.172:6821/233511803","state":["exists","up"]},{"osd":8,"uuid":"36559400-f33e-44e6-868a-316d34da457d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":56,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6816","nonce":290154343},{"type":"v1","addr":"172.21.15.184:6817","nonce":290154343}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6818","nonce":290154343},{"type":"v1","addr":"172.21.15.184:6819","nonce":290154343}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6822","nonce":290154343},{"type":"v1","addr":"172.21.15.184:6823","nonce":290154343}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6820","nonce":290154343},{"type":"v1","addr":"172.21.15.184:6821","nonce":290154343}]},"public_addr":"172.21.15.184:6817/290154343","cluster_addr":"172.21.15.184:6819/290154343","heartbeat_back_addr":"172.21.15.184:6823/290154343","heartbeat_front_addr":"172.21.15.184:6821/290154343","state":["exists","up"]},{"osd":9,"uuid":"d484f111-f36c-4c67-9a8a-ae03e7e0d137","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6826","nonce":3848110906},{"type":"v1","addr":"172.21.15.163:6827","nonce":3848110906}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6828","nonce":3848110906},{"type":"v1","addr":"172.21.15.163:6829","nonce":3848110906}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6832","nonce":3848110906},{"type":"v1","addr":"172.21.15.163:6833","nonce":3848110906}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6830","nonce":3848110906},{"type":"v1","addr":"172.21.15.163:6831","nonce":3848110906}]},"public_addr":"172.21.15.163:6827/3848110906","cluster_addr":"172.21.15.163:6829/3848110906","heartbeat_back_addr":"172.21.15.163:6833/3848110906","heartbeat_front_addr":"172.21.15.163:6831/3848110906","state":["exists","up"]},{"osd":10,"uuid":"d943f7c0-da3d-4605-9e23-0231e675c6be","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6824","nonce":3281085356},{"type":"v1","addr":"172.21.15.172:6825","nonce":3281085356}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":3281085356},{"type":"v1","addr":"172.21.15.172:6827","nonce":3281085356}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":3281085356},{"type":"v1","addr":"172.21.15.172:6831","nonce":3281085356}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6828","nonce":3281085356},{"type":"v1","addr":"172.21.15.172:6829","nonce":3281085356}]},"public_addr":"172.21.15.172:6825/3281085356","cluster_addr":"172.21.15.172:6827/3281085356","heartbeat_back_addr":"172.21.15.172:6831/3281085356","heartbeat_front_addr":"172.21.15.172:6829/3281085356","state":["exists","up"]},{"osd":11,"uuid":"09e610a8-408a-4119-a21b-c4de2810a538","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":75,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6824","nonce":3614578747},{"type":"v1","addr":"172.21.15.184:6825","nonce":3614578747}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6826","nonce":3614578747},{"type":"v1","addr":"172.21.15.184:6827","nonce":3614578747}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6830","nonce":3614578747},{"type":"v1","addr":"172.21.15.184:6831","nonce":3614578747}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6828","nonce":3614578747},{"type":"v1","addr":"172.21.15.184:6829","nonce":3614578747}]},"public_addr":"172.21.15.184:6825/3614578747","cluster_addr":"172.21.15.184:6827/3614578747","heartbeat_back_addr":"172.21.15.184:6831/3614578747","heartbeat_front_addr":"172.21.15.184:6829/3614578747","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T18:06:36.067578+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T18:06:57.095120+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T18:07:17.825363+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T18:07:38.977196+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T18:08:00.108709+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T18:08:20.700646+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T18:08:41.473899+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T18:09:02.856536+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T18:09:23.832722+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T18:09:44.860884+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T18:10:05.520678+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T18:10:26.426315+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.163:6801/1086512093":"2023-07-15T18:05:15.331458+0000","172.21.15.163:6800/1086512093":"2023-07-15T18:05:15.331458+0000","172.21.15.163:0/4235784810":"2023-07-15T18:05:15.331458+0000","172.21.15.163:6800/236891232":"2023-07-15T18:04:53.288443+0000","172.21.15.163:6801/236891232":"2023-07-15T18:04:53.288443+0000","172.21.15.163:0/3260193612":"2023-07-15T18:05:15.331458+0000","172.21.15.163:0/3513629472":"2023-07-15T18:04:53.288443+0000","172.21.15.163:0/1090329830":"2023-07-15T18:04:53.288443+0000","172.21.15.163:0/3868922045":"2023-07-15T18:05:15.331458+0000","172.21.15.163:0/2945662447":"2023-07-15T18:04:53.288443+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-14T18:11:23.659 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:23.621+0000 7f8bed626700 1 -- 172.21.15.163:0/4070672401 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f8bd00a11a0 msgr2=0x7f8bd00a3650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:11:23.660 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:23.621+0000 7f8bed626700 1 --2- 172.21.15.163:0/4070672401 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f8bd00a11a0 0x7f8bd00a3650 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f8bd80095c0 tx=0x7f8bd8009510 comp rx=0 tx=0).stop 2023-07-14T18:11:23.660 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:23.621+0000 7f8bed626700 1 -- 172.21.15.163:0/4070672401 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f8be8103030 msgr2=0x7f8be8195cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:11:23.660 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:23.621+0000 7f8bed626700 1 --2- 172.21.15.163:0/4070672401 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f8be8103030 0x7f8be8195cd0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f8bdc00c9b0 tx=0x7f8bdc00cd70 comp rx=0 tx=0).stop 2023-07-14T18:11:23.660 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:23.621+0000 7f8bed626700 1 -- 172.21.15.163:0/4070672401 shutdown_connections 2023-07-14T18:11:23.660 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:23.621+0000 7f8bed626700 1 --2- 172.21.15.163:0/4070672401 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f8bd00a11a0 0x7f8bd00a3650 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:23.660 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:23.621+0000 7f8bed626700 1 --2- 172.21.15.163:0/4070672401 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8be8105950 0x7f8be819cd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:23.661 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:23.621+0000 7f8bed626700 1 --2- 172.21.15.163:0/4070672401 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8be8100710 0x7f8be8195790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:23.661 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:23.621+0000 7f8bed626700 1 --2- 172.21.15.163:0/4070672401 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f8be8103030 0x7f8be8195cd0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:23.661 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:23.621+0000 7f8bed626700 1 -- 172.21.15.163:0/4070672401 >> 172.21.15.163:0/4070672401 conn(0x7f8be80fa130 msgr2=0x7f8be8101370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:11:23.661 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:23.621+0000 7f8bed626700 1 -- 172.21.15.163:0/4070672401 shutdown_connections 2023-07-14T18:11:23.661 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:23.621+0000 7f8bed626700 1 -- 172.21.15.163:0/4070672401 wait complete. 2023-07-14T18:11:23.672 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-14T18:07:19.653852+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-14T18:11:07.314989+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '79', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-07-14T18:11:08.274627+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '80', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-07-14T18:11:11.991162+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '84', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-07-14T18:11:23.673 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-14T18:11:23.796 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:23.758+0000 7f6cfb6c2700 1 -- 172.21.15.163:0/3719068089 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f6cf4100690 msgr2=0x7f6cf4106f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:11:23.797 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:23.758+0000 7f6cfb6c2700 1 --2- 172.21.15.163:0/3719068089 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f6cf4100690 0x7f6cf4106f50 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f6cec00b0a0 tx=0x7f6cec00b3b0 comp rx=0 tx=0).stop 2023-07-14T18:11:23.797 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:23.758+0000 7f6cfb6c2700 1 -- 172.21.15.163:0/3719068089 shutdown_connections 2023-07-14T18:11:23.797 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:23.758+0000 7f6cfb6c2700 1 --2- 172.21.15.163:0/3719068089 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f6cf4100690 0x7f6cf4106f50 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:23.797 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:23.758+0000 7f6cfb6c2700 1 --2- 172.21.15.163:0/3719068089 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6cf40feb10 0x7f6cf40fef20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:23.797 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:23.758+0000 7f6cfb6c2700 1 --2- 172.21.15.163:0/3719068089 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6cf40ffd00 0x7f6cf4100150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:23.798 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:23.758+0000 7f6cfb6c2700 1 -- 172.21.15.163:0/3719068089 >> 172.21.15.163:0/3719068089 conn(0x7f6cf40fa130 msgr2=0x7f6cf40fc560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:11:23.798 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:23.758+0000 7f6cfb6c2700 1 -- 172.21.15.163:0/3719068089 shutdown_connections 2023-07-14T18:11:23.798 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:23.758+0000 7f6cfb6c2700 1 -- 172.21.15.163:0/3719068089 wait complete. 2023-07-14T18:11:23.801 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:23.758+0000 7f6cfb6c2700 1 Processor -- start 2023-07-14T18:11:23.801 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:23.758+0000 7f6cfb6c2700 1 -- start start 2023-07-14T18:11:23.802 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:23.758+0000 7f6cfb6c2700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6cf40feb10 0x7f6cf4068330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:11:23.802 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:23.758+0000 7f6cfb6c2700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6cf40ffd00 0x7f6cf419a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:11:23.802 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:23.758+0000 7f6cfb6c2700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f6cf4100690 0x7f6cf419cd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:11:23.803 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:23.758+0000 7f6cfb6c2700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6cf419d510 con 0x7f6cf4100690 2023-07-14T18:11:23.803 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:23.758+0000 7f6cfb6c2700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6cf419d680 con 0x7f6cf40feb10 2023-07-14T18:11:23.803 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:23.759+0000 7f6cfb6c2700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6cf419d840 con 0x7f6cf40ffd00 2023-07-14T18:11:23.804 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:23.759+0000 7f6cf9c5f700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f6cf4100690 0x7f6cf419cd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:11:23.804 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:23.759+0000 7f6cf9c5f700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f6cf4100690 0x7f6cf419cd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:56052/0 (socket says 172.21.15.163:56052) 2023-07-14T18:11:23.804 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:23.759+0000 7f6cf9c5f700 1 -- 172.21.15.163:0/2979194507 learned_addr learned my addr 172.21.15.163:0/2979194507 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:11:23.805 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:23.759+0000 7f6cf8c5d700 1 --2- 172.21.15.163:0/2979194507 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6cf40ffd00 0x7f6cf419a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:11:23.805 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:23.759+0000 7f6cf945e700 1 --2- 172.21.15.163:0/2979194507 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6cf40feb10 0x7f6cf4068330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:11:23.805 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:23.759+0000 7f6cf9c5f700 1 -- 172.21.15.163:0/2979194507 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6cf40ffd00 msgr2=0x7f6cf419a6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:11:23.805 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:23.759+0000 7f6cf9c5f700 1 --2- 172.21.15.163:0/2979194507 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6cf40ffd00 0x7f6cf419a6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:23.806 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:23.759+0000 7f6cf9c5f700 1 -- 172.21.15.163:0/2979194507 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6cf40feb10 msgr2=0x7f6cf4068330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:11:23.806 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:23.759+0000 7f6cf9c5f700 1 --2- 172.21.15.163:0/2979194507 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6cf40feb10 0x7f6cf4068330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:23.807 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:23.759+0000 7f6cf9c5f700 1 -- 172.21.15.163:0/2979194507 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6cec009d00 con 0x7f6cf4100690 2023-07-14T18:11:23.807 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:23.759+0000 7f6cf9c5f700 1 --2- 172.21.15.163:0/2979194507 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f6cf4100690 0x7f6cf419cd40 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f6cec00b070 tx=0x7f6cec004c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:11:23.807 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:23.759+0000 7f6cea7fc700 1 -- 172.21.15.163:0/2979194507 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cec00e040 con 0x7f6cf4100690 2023-07-14T18:11:23.807 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:23.759+0000 7f6cea7fc700 1 -- 172.21.15.163:0/2979194507 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f6cec003e90 con 0x7f6cf4100690 2023-07-14T18:11:23.808 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:23.759+0000 7f6cfb6c2700 1 -- 172.21.15.163:0/2979194507 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6cf419dac0 con 0x7f6cf4100690 2023-07-14T18:11:23.808 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:23.759+0000 7f6cea7fc700 1 -- 172.21.15.163:0/2979194507 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cec01b450 con 0x7f6cf4100690 2023-07-14T18:11:23.808 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:23.759+0000 7f6cfb6c2700 1 -- 172.21.15.163:0/2979194507 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6cf419df40 con 0x7f6cf4100690 2023-07-14T18:11:23.808 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:23.760+0000 7f6cfb6c2700 1 -- 172.21.15.163:0/2979194507 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6cf4105a40 con 0x7f6cf4100690 2023-07-14T18:11:23.809 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:23.761+0000 7f6cea7fc700 1 -- 172.21.15.163:0/2979194507 <== mon.0 v2:172.21.15.163:3300/0 4 ==== mgrmap(e 16) v1 ==== 135716+0+0 (secure 0 0 0) 0x7f6cec004000 con 0x7f6cf4100690 2023-07-14T18:11:23.809 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:23.762+0000 7f6cea7fc700 1 --2- 172.21.15.163:0/2979194507 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f6ce00a1150 0x7f6ce00a3600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:11:23.809 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:23.762+0000 7f6cea7fc700 1 -- 172.21.15.163:0/2979194507 <== mon.0 v2:172.21.15.163:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 8730+0+0 (secure 0 0 0) 0x7f6cec0ce6e0 con 0x7f6cf4100690 2023-07-14T18:11:23.810 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:23.762+0000 7f6cf945e700 1 --2- 172.21.15.163:0/2979194507 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f6ce00a1150 0x7f6ce00a3600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:11:23.810 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:23.762+0000 7f6cf945e700 1 --2- 172.21.15.163:0/2979194507 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f6ce00a1150 0x7f6ce00a3600 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f6cf40ffb60 tx=0x7f6cf0007400 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:11:23.810 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:23.765+0000 7f6cea7fc700 1 -- 172.21.15.163:0/2979194507 <== mon.0 v2:172.21.15.163:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178025 (secure 0 0 0) 0x7f6cec097cd0 con 0x7f6cf4100690 2023-07-14T18:11:23.966 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:11:23 smithi163 ceph-mon[96576]: from='client.? 172.21.15.163:0/1678563313' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2023-07-14T18:11:23.966 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:11:23 smithi163 ceph-mon[96576]: from='client.? 172.21.15.163:0/1495521947' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2023-07-14T18:11:23.966 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:11:23 smithi163 ceph-mon[96576]: from='client.? 172.21.15.163:0/4070672401' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-07-14T18:11:23.994 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:23.956+0000 7f6cfb6c2700 1 -- 172.21.15.163:0/2979194507 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f6cf402cb30 con 0x7f6cf4100690 2023-07-14T18:11:23.995 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:23.956+0000 7f6cea7fc700 1 -- 172.21.15.163:0/2979194507 <== mon.0 v2:172.21.15.163:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v84) v1 ==== 93+0+10 (secure 0 0 0) 0x7f6cec09b2f0 con 0x7f6cf4100690 2023-07-14T18:11:23.995 INFO:teuthology.orchestra.run.smithi163.stdout:pg_num: 1 2023-07-14T18:11:23.997 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:23.958+0000 7f6cfb6c2700 1 -- 172.21.15.163:0/2979194507 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f6ce00a1150 msgr2=0x7f6ce00a3600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:11:23.997 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:23.958+0000 7f6cfb6c2700 1 --2- 172.21.15.163:0/2979194507 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f6ce00a1150 0x7f6ce00a3600 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f6cf40ffb60 tx=0x7f6cf0007400 comp rx=0 tx=0).stop 2023-07-14T18:11:23.997 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:23.958+0000 7f6cfb6c2700 1 -- 172.21.15.163:0/2979194507 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f6cf4100690 msgr2=0x7f6cf419cd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:11:23.997 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:23.958+0000 7f6cfb6c2700 1 --2- 172.21.15.163:0/2979194507 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f6cf4100690 0x7f6cf419cd40 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f6cec00b070 tx=0x7f6cec004c80 comp rx=0 tx=0).stop 2023-07-14T18:11:23.998 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:23.958+0000 7f6cfb6c2700 1 -- 172.21.15.163:0/2979194507 shutdown_connections 2023-07-14T18:11:23.998 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:23.958+0000 7f6cfb6c2700 1 --2- 172.21.15.163:0/2979194507 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f6ce00a1150 0x7f6ce00a3600 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:23.998 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:23.958+0000 7f6cfb6c2700 1 --2- 172.21.15.163:0/2979194507 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f6cf4100690 0x7f6cf419cd40 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:23.998 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:23.958+0000 7f6cfb6c2700 1 --2- 172.21.15.163:0/2979194507 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6cf40feb10 0x7f6cf4068330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:23.998 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:23.958+0000 7f6cfb6c2700 1 --2- 172.21.15.163:0/2979194507 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6cf40ffd00 0x7f6cf419a6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:23.998 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:23.958+0000 7f6cfb6c2700 1 -- 172.21.15.163:0/2979194507 >> 172.21.15.163:0/2979194507 conn(0x7f6cf40fa130 msgr2=0x7f6cf40fc3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:11:23.998 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:23.958+0000 7f6cfb6c2700 1 -- 172.21.15.163:0/2979194507 shutdown_connections 2023-07-14T18:11:23.999 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:23.958+0000 7f6cfb6c2700 1 -- 172.21.15.163:0/2979194507 wait complete. 2023-07-14T18:11:24.009 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-14T18:11:24.133 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:24.094+0000 7ff534bb3700 1 -- 172.21.15.163:0/3007907721 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff530100770 msgr2=0x7ff530107010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:11:24.133 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:24.094+0000 7ff534bb3700 1 --2- 172.21.15.163:0/3007907721 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff530100770 0x7ff530107010 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7ff52800b0a0 tx=0x7ff52800b3b0 comp rx=0 tx=0).stop 2023-07-14T18:11:24.134 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:24.094+0000 7ff534bb3700 1 -- 172.21.15.163:0/3007907721 shutdown_connections 2023-07-14T18:11:24.134 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:24.094+0000 7ff534bb3700 1 --2- 172.21.15.163:0/3007907721 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff530100770 0x7ff530107010 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:24.134 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:24.094+0000 7ff534bb3700 1 --2- 172.21.15.163:0/3007907721 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff5300feb30 0x7ff5300fef40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:24.134 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:24.094+0000 7ff534bb3700 1 --2- 172.21.15.163:0/3007907721 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff5300ffdc0 0x7ff530100230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:24.134 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:24.094+0000 7ff534bb3700 1 -- 172.21.15.163:0/3007907721 >> 172.21.15.163:0/3007907721 conn(0x7ff5300fa150 msgr2=0x7ff5300fc580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:11:24.134 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:24.094+0000 7ff534bb3700 1 -- 172.21.15.163:0/3007907721 shutdown_connections 2023-07-14T18:11:24.134 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:24.094+0000 7ff534bb3700 1 -- 172.21.15.163:0/3007907721 wait complete. 2023-07-14T18:11:24.136 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:24.095+0000 7ff534bb3700 1 Processor -- start 2023-07-14T18:11:24.136 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:24.095+0000 7ff534bb3700 1 -- start start 2023-07-14T18:11:24.137 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:24.095+0000 7ff534bb3700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff5300feb30 0x7ff530102b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:11:24.137 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:24.095+0000 7ff534bb3700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff5300ffdc0 0x7ff5301011a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:11:24.137 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:24.095+0000 7ff534bb3700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff530100770 0x7ff5301016e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:11:24.137 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:24.095+0000 7ff534bb3700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff530101e80 con 0x7ff5300ffdc0 2023-07-14T18:11:24.137 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:24.095+0000 7ff534bb3700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff530101ff0 con 0x7ff530100770 2023-07-14T18:11:24.137 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:24.095+0000 7ff534bb3700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff53019f940 con 0x7ff5300feb30 2023-07-14T18:11:24.137 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:24.095+0000 7ff52dd9b700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff5300ffdc0 0x7ff5301011a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:11:24.137 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:24.095+0000 7ff52dd9b700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff5300ffdc0 0x7ff5301011a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:56064/0 (socket says 172.21.15.163:56064) 2023-07-14T18:11:24.138 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:24.095+0000 7ff52dd9b700 1 -- 172.21.15.163:0/2465144734 learned_addr learned my addr 172.21.15.163:0/2465144734 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:11:24.138 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:24.096+0000 7ff52ed9d700 1 --2- 172.21.15.163:0/2465144734 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff530100770 0x7ff5301016e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:11:24.138 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:24.096+0000 7ff52e59c700 1 --2- 172.21.15.163:0/2465144734 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff5300feb30 0x7ff530102b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:11:24.138 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:24.096+0000 7ff52dd9b700 1 -- 172.21.15.163:0/2465144734 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff5300feb30 msgr2=0x7ff530102b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:11:24.138 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:24.096+0000 7ff52dd9b700 1 --2- 172.21.15.163:0/2465144734 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff5300feb30 0x7ff530102b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:24.138 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:24.096+0000 7ff52dd9b700 1 -- 172.21.15.163:0/2465144734 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff530100770 msgr2=0x7ff5301016e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:11:24.138 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:24.096+0000 7ff52dd9b700 1 --2- 172.21.15.163:0/2465144734 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff530100770 0x7ff5301016e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:24.139 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:24.096+0000 7ff52dd9b700 1 -- 172.21.15.163:0/2465144734 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff528009d00 con 0x7ff5300ffdc0 2023-07-14T18:11:24.139 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:24.096+0000 7ff52e59c700 1 --2- 172.21.15.163:0/2465144734 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff5300feb30 0x7ff530102b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T18:11:24.139 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:24.096+0000 7ff52dd9b700 1 --2- 172.21.15.163:0/2465144734 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff5300ffdc0 0x7ff5301011a0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7ff52000c9b0 tx=0x7ff52000cd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:11:24.139 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:24.096+0000 7ff5277fe700 1 -- 172.21.15.163:0/2465144734 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff520007b00 con 0x7ff5300ffdc0 2023-07-14T18:11:24.139 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:24.096+0000 7ff534bb3700 1 -- 172.21.15.163:0/2465144734 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff53019fc20 con 0x7ff5300ffdc0 2023-07-14T18:11:24.139 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:24.096+0000 7ff5277fe700 1 -- 172.21.15.163:0/2465144734 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ff520007c60 con 0x7ff5300ffdc0 2023-07-14T18:11:24.139 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:24.096+0000 7ff5277fe700 1 -- 172.21.15.163:0/2465144734 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff520018660 con 0x7ff5300ffdc0 2023-07-14T18:11:24.139 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:24.096+0000 7ff534bb3700 1 -- 172.21.15.163:0/2465144734 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5301a0180 con 0x7ff5300ffdc0 2023-07-14T18:11:24.140 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:24.097+0000 7ff534bb3700 1 -- 172.21.15.163:0/2465144734 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff53010a160 con 0x7ff5300ffdc0 2023-07-14T18:11:24.140 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:24.098+0000 7ff5277fe700 1 -- 172.21.15.163:0/2465144734 <== mon.0 v2:172.21.15.163:3300/0 4 ==== mgrmap(e 16) v1 ==== 135716+0+0 (secure 0 0 0) 0x7ff52000f450 con 0x7ff5300ffdc0 2023-07-14T18:11:24.140 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:24.098+0000 7ff5277fe700 1 --2- 172.21.15.163:0/2465144734 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7ff51c0a1150 0x7ff51c0a3600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:11:24.141 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:24.099+0000 7ff52e59c700 1 --2- 172.21.15.163:0/2465144734 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7ff51c0a1150 0x7ff51c0a3600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:11:24.141 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:24.099+0000 7ff5277fe700 1 -- 172.21.15.163:0/2465144734 <== mon.0 v2:172.21.15.163:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 8730+0+0 (secure 0 0 0) 0x7ff5200ccb50 con 0x7ff5300ffdc0 2023-07-14T18:11:24.141 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:24.099+0000 7ff52e59c700 1 --2- 172.21.15.163:0/2465144734 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7ff51c0a1150 0x7ff51c0a3600 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7ff518009cb0 tx=0x7ff518009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:11:24.141 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:24.103+0000 7ff5277fe700 1 -- 172.21.15.163:0/2465144734 <== mon.0 v2:172.21.15.163:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178025 (secure 0 0 0) 0x7ff5200960b0 con 0x7ff5300ffdc0 2023-07-14T18:11:24.173 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:11:23 smithi184 ceph-mon[98481]: from='client.? 172.21.15.163:0/1678563313' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2023-07-14T18:11:24.174 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:11:23 smithi184 ceph-mon[98481]: from='client.? 172.21.15.163:0/1495521947' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2023-07-14T18:11:24.174 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:11:23 smithi184 ceph-mon[98481]: from='client.? 172.21.15.163:0/4070672401' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-07-14T18:11:24.274 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:11:23 smithi172 ceph-mon[97983]: from='client.? 172.21.15.163:0/1678563313' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2023-07-14T18:11:24.275 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:11:23 smithi172 ceph-mon[97983]: from='client.? 172.21.15.163:0/1495521947' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2023-07-14T18:11:24.275 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:11:23 smithi172 ceph-mon[97983]: from='client.? 172.21.15.163:0/4070672401' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-07-14T18:11:24.331 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:24.292+0000 7ff534bb3700 1 -- 172.21.15.163:0/2465144734 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7ff5301a0790 con 0x7ff5300ffdc0 2023-07-14T18:11:24.331 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:24.293+0000 7ff5277fe700 1 -- 172.21.15.163:0/2465144734 <== mon.0 v2:172.21.15.163:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v84) v1 ==== 104+0+11 (secure 0 0 0) 0x7ff5200996d0 con 0x7ff5300ffdc0 2023-07-14T18:11:24.332 INFO:teuthology.orchestra.run.smithi163.stdout:pg_num: 32 2023-07-14T18:11:24.333 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:24.294+0000 7ff534bb3700 1 -- 172.21.15.163:0/2465144734 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7ff51c0a1150 msgr2=0x7ff51c0a3600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:11:24.333 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:24.294+0000 7ff534bb3700 1 --2- 172.21.15.163:0/2465144734 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7ff51c0a1150 0x7ff51c0a3600 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7ff518009cb0 tx=0x7ff518009260 comp rx=0 tx=0).stop 2023-07-14T18:11:24.334 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:24.294+0000 7ff534bb3700 1 -- 172.21.15.163:0/2465144734 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff5300ffdc0 msgr2=0x7ff5301011a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:11:24.334 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:24.294+0000 7ff534bb3700 1 --2- 172.21.15.163:0/2465144734 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff5300ffdc0 0x7ff5301011a0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7ff52000c9b0 tx=0x7ff52000cd70 comp rx=0 tx=0).stop 2023-07-14T18:11:24.334 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:24.295+0000 7ff534bb3700 1 -- 172.21.15.163:0/2465144734 shutdown_connections 2023-07-14T18:11:24.334 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:24.295+0000 7ff534bb3700 1 --2- 172.21.15.163:0/2465144734 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7ff51c0a1150 0x7ff51c0a3600 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:24.334 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:24.295+0000 7ff534bb3700 1 --2- 172.21.15.163:0/2465144734 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff5300feb30 0x7ff530102b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:24.334 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:24.295+0000 7ff534bb3700 1 --2- 172.21.15.163:0/2465144734 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff530100770 0x7ff5301016e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:24.334 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:24.295+0000 7ff534bb3700 1 --2- 172.21.15.163:0/2465144734 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff5300ffdc0 0x7ff5301011a0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:24.335 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:24.295+0000 7ff534bb3700 1 -- 172.21.15.163:0/2465144734 >> 172.21.15.163:0/2465144734 conn(0x7ff5300fa150 msgr2=0x7ff5300689d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:11:24.335 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:24.295+0000 7ff534bb3700 1 -- 172.21.15.163:0/2465144734 shutdown_connections 2023-07-14T18:11:24.335 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:24.295+0000 7ff534bb3700 1 -- 172.21.15.163:0/2465144734 wait complete. 2023-07-14T18:11:24.345 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-14T18:11:24.471 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:24.431+0000 7f10328b3700 1 -- 172.21.15.163:0/4168235392 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f102c105890 msgr2=0x7f102c107cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:11:24.471 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:24.431+0000 7f10328b3700 1 --2- 172.21.15.163:0/4168235392 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f102c105890 0x7f102c107cf0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f102400b0a0 tx=0x7f102400b3b0 comp rx=0 tx=0).stop 2023-07-14T18:11:24.471 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:24.431+0000 7f10328b3700 1 -- 172.21.15.163:0/4168235392 shutdown_connections 2023-07-14T18:11:24.472 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:24.431+0000 7f10328b3700 1 --2- 172.21.15.163:0/4168235392 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f102c100650 0x7f102c102a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:24.472 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:24.431+0000 7f10328b3700 1 --2- 172.21.15.163:0/4168235392 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f102c105890 0x7f102c107cf0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:24.472 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:24.431+0000 7f10328b3700 1 --2- 172.21.15.163:0/4168235392 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f102c102f70 0x7f102c105350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:24.473 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:24.431+0000 7f10328b3700 1 -- 172.21.15.163:0/4168235392 >> 172.21.15.163:0/4168235392 conn(0x7f102c0fa0f0 msgr2=0x7f102c0fc520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:11:24.473 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:24.431+0000 7f10328b3700 1 -- 172.21.15.163:0/4168235392 shutdown_connections 2023-07-14T18:11:24.473 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:24.431+0000 7f10328b3700 1 -- 172.21.15.163:0/4168235392 wait complete. 2023-07-14T18:11:24.473 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:24.432+0000 7f10328b3700 1 Processor -- start 2023-07-14T18:11:24.473 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:24.432+0000 7f10328b3700 1 -- start start 2023-07-14T18:11:24.477 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:24.432+0000 7f10328b3700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f102c100650 0x7f102c1958c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:11:24.477 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:24.432+0000 7f10328b3700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f102c102f70 0x7f102c195e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:11:24.478 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:24.433+0000 7f10328b3700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f102c105890 0x7f102c19ce70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:11:24.478 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:24.433+0000 7f10328b3700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f102c19d440 con 0x7f102c102f70 2023-07-14T18:11:24.478 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:24.433+0000 7f10328b3700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f102c19d580 con 0x7f102c100650 2023-07-14T18:11:24.478 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:24.433+0000 7f10328b3700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f102c19d710 con 0x7f102c105890 2023-07-14T18:11:24.479 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:24.433+0000 7f102b7fe700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f102c102f70 0x7f102c195e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:11:24.479 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:24.433+0000 7f102b7fe700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f102c102f70 0x7f102c195e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:56078/0 (socket says 172.21.15.163:56078) 2023-07-14T18:11:24.479 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:24.433+0000 7f102b7fe700 1 -- 172.21.15.163:0/621990203 learned_addr learned my addr 172.21.15.163:0/621990203 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:11:24.479 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:24.433+0000 7f102bfff700 1 --2- 172.21.15.163:0/621990203 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f102c100650 0x7f102c1958c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:11:24.480 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:24.433+0000 7f1030e50700 1 --2- 172.21.15.163:0/621990203 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f102c105890 0x7f102c19ce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:11:24.480 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:24.433+0000 7f102b7fe700 1 -- 172.21.15.163:0/621990203 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f102c105890 msgr2=0x7f102c19ce70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:11:24.480 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:24.433+0000 7f102b7fe700 1 --2- 172.21.15.163:0/621990203 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f102c105890 0x7f102c19ce70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:24.480 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:24.433+0000 7f102b7fe700 1 -- 172.21.15.163:0/621990203 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f102c100650 msgr2=0x7f102c1958c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:11:24.481 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:24.433+0000 7f102b7fe700 1 --2- 172.21.15.163:0/621990203 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f102c100650 0x7f102c1958c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:24.481 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:24.433+0000 7f102b7fe700 1 -- 172.21.15.163:0/621990203 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1024009d00 con 0x7f102c102f70 2023-07-14T18:11:24.481 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:24.433+0000 7f102bfff700 1 --2- 172.21.15.163:0/621990203 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f102c100650 0x7f102c1958c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T18:11:24.481 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:24.433+0000 7f102b7fe700 1 --2- 172.21.15.163:0/621990203 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f102c102f70 0x7f102c195e00 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f102000e9a0 tx=0x7f102000ed60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:11:24.482 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:24.433+0000 7f10297fa700 1 -- 172.21.15.163:0/621990203 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1020009790 con 0x7f102c102f70 2023-07-14T18:11:24.482 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:24.433+0000 7f10328b3700 1 -- 172.21.15.163:0/621990203 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f102c19d9f0 con 0x7f102c102f70 2023-07-14T18:11:24.482 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:24.433+0000 7f10297fa700 1 -- 172.21.15.163:0/621990203 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f102000cbd0 con 0x7f102c102f70 2023-07-14T18:11:24.483 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:24.433+0000 7f10297fa700 1 -- 172.21.15.163:0/621990203 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1020018680 con 0x7f102c102f70 2023-07-14T18:11:24.483 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:24.433+0000 7f10328b3700 1 -- 172.21.15.163:0/621990203 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f102c19df50 con 0x7f102c102f70 2023-07-14T18:11:24.483 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:24.434+0000 7f10328b3700 1 -- 172.21.15.163:0/621990203 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f102c0fbc60 con 0x7f102c102f70 2023-07-14T18:11:24.483 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:24.435+0000 7f10297fa700 1 -- 172.21.15.163:0/621990203 <== mon.0 v2:172.21.15.163:3300/0 4 ==== mgrmap(e 16) v1 ==== 135716+0+0 (secure 0 0 0) 0x7f102000cd40 con 0x7f102c102f70 2023-07-14T18:11:24.484 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:24.436+0000 7f10297fa700 1 --2- 172.21.15.163:0/621990203 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f10140a1150 0x7f10140a3600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:11:24.484 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:24.436+0000 7f102bfff700 1 --2- 172.21.15.163:0/621990203 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f10140a1150 0x7f10140a3600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:11:24.484 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:24.436+0000 7f10297fa700 1 -- 172.21.15.163:0/621990203 <== mon.0 v2:172.21.15.163:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 8730+0+0 (secure 0 0 0) 0x7f1020014070 con 0x7f102c102f70 2023-07-14T18:11:24.485 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:24.436+0000 7f102bfff700 1 --2- 172.21.15.163:0/621990203 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f10140a1150 0x7f10140a3600 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f101c005fd0 tx=0x7f101c005f60 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:11:24.485 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:24.440+0000 7f10297fa700 1 -- 172.21.15.163:0/621990203 <== mon.0 v2:172.21.15.163:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178025 (secure 0 0 0) 0x7f1020051780 con 0x7f102c102f70 2023-07-14T18:11:24.665 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:24.625+0000 7f10328b3700 1 -- 172.21.15.163:0/621990203 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f102c061250 con 0x7f102c102f70 2023-07-14T18:11:24.665 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:24.626+0000 7f10297fa700 1 -- 172.21.15.163:0/621990203 <== mon.0 v2:172.21.15.163:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v84) v1 ==== 100+0+11 (secure 0 0 0) 0x7f1020099da0 con 0x7f102c102f70 2023-07-14T18:11:24.665 INFO:teuthology.orchestra.run.smithi163.stdout:pg_num: 64 2023-07-14T18:11:24.667 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:24.628+0000 7f10328b3700 1 -- 172.21.15.163:0/621990203 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f10140a1150 msgr2=0x7f10140a3600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:11:24.667 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:24.628+0000 7f10328b3700 1 --2- 172.21.15.163:0/621990203 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f10140a1150 0x7f10140a3600 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f101c005fd0 tx=0x7f101c005f60 comp rx=0 tx=0).stop 2023-07-14T18:11:24.668 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:24.628+0000 7f10328b3700 1 -- 172.21.15.163:0/621990203 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f102c102f70 msgr2=0x7f102c195e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:11:24.668 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:24.628+0000 7f10328b3700 1 --2- 172.21.15.163:0/621990203 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f102c102f70 0x7f102c195e00 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f102000e9a0 tx=0x7f102000ed60 comp rx=0 tx=0).stop 2023-07-14T18:11:24.668 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:24.628+0000 7f10328b3700 1 -- 172.21.15.163:0/621990203 shutdown_connections 2023-07-14T18:11:24.668 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:24.628+0000 7f10328b3700 1 --2- 172.21.15.163:0/621990203 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f10140a1150 0x7f10140a3600 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:24.668 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:24.628+0000 7f10328b3700 1 --2- 172.21.15.163:0/621990203 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f102c105890 0x7f102c19ce70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:24.669 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:24.628+0000 7f10328b3700 1 --2- 172.21.15.163:0/621990203 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f102c100650 0x7f102c1958c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:24.669 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:24.628+0000 7f10328b3700 1 --2- 172.21.15.163:0/621990203 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f102c102f70 0x7f102c195e00 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:24.669 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:24.628+0000 7f10328b3700 1 -- 172.21.15.163:0/621990203 >> 172.21.15.163:0/621990203 conn(0x7f102c0fa0f0 msgr2=0x7f102c1012b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:11:24.669 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:24.628+0000 7f10328b3700 1 -- 172.21.15.163:0/621990203 shutdown_connections 2023-07-14T18:11:24.669 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:24.628+0000 7f10328b3700 1 -- 172.21.15.163:0/621990203 wait complete. 2023-07-14T18:11:24.679 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-07-14T18:11:24.805 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:24.766+0000 7f1781f5c700 1 -- 172.21.15.163:0/3860391808 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f177c0ffd00 msgr2=0x7f177c100150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:11:24.805 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:24.766+0000 7f1781f5c700 1 --2- 172.21.15.163:0/3860391808 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f177c0ffd00 0x7f177c100150 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f176c009990 tx=0x7f176c009ca0 comp rx=0 tx=0).stop 2023-07-14T18:11:24.805 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:24.766+0000 7f1781f5c700 1 -- 172.21.15.163:0/3860391808 shutdown_connections 2023-07-14T18:11:24.806 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:24.766+0000 7f1781f5c700 1 --2- 172.21.15.163:0/3860391808 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f177c0feb10 0x7f177c0fef20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:24.806 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:24.766+0000 7f1781f5c700 1 --2- 172.21.15.163:0/3860391808 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f177c100690 0x7f177c106f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:24.806 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:24.766+0000 7f1781f5c700 1 --2- 172.21.15.163:0/3860391808 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f177c0ffd00 0x7f177c100150 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:24.806 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:24.766+0000 7f1781f5c700 1 -- 172.21.15.163:0/3860391808 >> 172.21.15.163:0/3860391808 conn(0x7f177c0fa130 msgr2=0x7f177c0fc560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:11:24.806 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:24.766+0000 7f1781f5c700 1 -- 172.21.15.163:0/3860391808 shutdown_connections 2023-07-14T18:11:24.806 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:24.766+0000 7f1781f5c700 1 -- 172.21.15.163:0/3860391808 wait complete. 2023-07-14T18:11:24.807 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:24.766+0000 7f1781f5c700 1 Processor -- start 2023-07-14T18:11:24.809 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:24.767+0000 7f1781f5c700 1 -- start start 2023-07-14T18:11:24.809 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:24.767+0000 7f1781f5c700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f177c0feb10 0x7f177c068310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:11:24.810 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:24.767+0000 7f1781f5c700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f177c0ffd00 0x7f177c19ca60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:11:24.810 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:24.767+0000 7f1781f5c700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f177c100690 0x7f177c19efb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:11:24.810 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:24.767+0000 7f1781f5c700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f177c19f660 con 0x7f177c100690 2023-07-14T18:11:24.810 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:24.767+0000 7f1781f5c700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f177c19f7d0 con 0x7f177c0ffd00 2023-07-14T18:11:24.810 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:24.767+0000 7f1781f5c700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f177c19f990 con 0x7f177c0feb10 2023-07-14T18:11:24.810 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:24.767+0000 7f177bfff700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f177c100690 0x7f177c19efb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:11:24.811 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:24.767+0000 7f177bfff700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f177c100690 0x7f177c19efb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:56098/0 (socket says 172.21.15.163:56098) 2023-07-14T18:11:24.811 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:24.767+0000 7f177bfff700 1 -- 172.21.15.163:0/1178597042 learned_addr learned my addr 172.21.15.163:0/1178597042 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:11:24.811 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:24.767+0000 7f177b7fe700 1 --2- 172.21.15.163:0/1178597042 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f177c0feb10 0x7f177c068310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:11:24.811 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:24.767+0000 7f177affd700 1 --2- 172.21.15.163:0/1178597042 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f177c0ffd00 0x7f177c19ca60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:11:24.811 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:24.767+0000 7f177bfff700 1 -- 172.21.15.163:0/1178597042 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f177c0feb10 msgr2=0x7f177c068310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:11:24.811 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:24.767+0000 7f177bfff700 1 --2- 172.21.15.163:0/1178597042 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f177c0feb10 0x7f177c068310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:24.811 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:24.767+0000 7f177bfff700 1 -- 172.21.15.163:0/1178597042 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f177c0ffd00 msgr2=0x7f177c19ca60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:11:24.812 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:24.767+0000 7f177bfff700 1 --2- 172.21.15.163:0/1178597042 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f177c0ffd00 0x7f177c19ca60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:24.812 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:24.767+0000 7f177bfff700 1 -- 172.21.15.163:0/1178597042 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f176c0095f0 con 0x7f177c100690 2023-07-14T18:11:24.812 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:24.767+0000 7f177b7fe700 1 --2- 172.21.15.163:0/1178597042 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f177c0feb10 0x7f177c068310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T18:11:24.812 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:24.767+0000 7f177bfff700 1 --2- 172.21.15.163:0/1178597042 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f177c100690 0x7f177c19efb0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f177400ef30 tx=0x7f177400c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:11:24.812 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:24.768+0000 7f1778ff9700 1 -- 172.21.15.163:0/1178597042 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1774018070 con 0x7f177c100690 2023-07-14T18:11:24.812 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:24.768+0000 7f1781f5c700 1 -- 172.21.15.163:0/1178597042 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f177c19fc10 con 0x7f177c100690 2023-07-14T18:11:24.812 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:24.768+0000 7f1778ff9700 1 -- 172.21.15.163:0/1178597042 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f177400f040 con 0x7f177c100690 2023-07-14T18:11:24.813 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:24.768+0000 7f1778ff9700 1 -- 172.21.15.163:0/1178597042 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1774003d00 con 0x7f177c100690 2023-07-14T18:11:24.813 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:24.768+0000 7f1781f5c700 1 -- 172.21.15.163:0/1178597042 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f177c1a0120 con 0x7f177c100690 2023-07-14T18:11:24.813 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:24.769+0000 7f1781f5c700 1 -- 172.21.15.163:0/1178597042 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f177c1061a0 con 0x7f177c100690 2023-07-14T18:11:24.813 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:24.770+0000 7f1778ff9700 1 -- 172.21.15.163:0/1178597042 <== mon.0 v2:172.21.15.163:3300/0 4 ==== mgrmap(e 16) v1 ==== 135716+0+0 (secure 0 0 0) 0x7f177400caa0 con 0x7f177c100690 2023-07-14T18:11:24.813 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:24.770+0000 7f1778ff9700 1 --2- 172.21.15.163:0/1178597042 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f17640a1150 0x7f17640a3600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:11:24.813 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:24.770+0000 7f177b7fe700 1 --2- 172.21.15.163:0/1178597042 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f17640a1150 0x7f17640a3600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:11:24.813 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:24.770+0000 7f1778ff9700 1 -- 172.21.15.163:0/1178597042 <== mon.0 v2:172.21.15.163:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 8730+0+0 (secure 0 0 0) 0x7f17740cd190 con 0x7f177c100690 2023-07-14T18:11:24.814 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:24.771+0000 7f177b7fe700 1 --2- 172.21.15.163:0/1178597042 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f17640a1150 0x7f17640a3600 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f1770005950 tx=0x7f17700058e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:11:24.814 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:24.773+0000 7f1778ff9700 1 -- 172.21.15.163:0/1178597042 <== mon.0 v2:172.21.15.163:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178025 (secure 0 0 0) 0x7f1774096780 con 0x7f177c100690 2023-07-14T18:11:24.966 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:11:24 smithi163 ceph-mon[96576]: pgmap v258: 129 pgs: 129 active+clean; 581 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 318 B/s wr, 0 op/s 2023-07-14T18:11:24.966 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:11:24 smithi163 ceph-mon[96576]: from='client.? 172.21.15.163:0/2979194507' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-07-14T18:11:24.966 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:11:24 smithi163 ceph-mon[96576]: from='client.? 172.21.15.163:0/2465144734' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-07-14T18:11:24.966 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:11:24 smithi163 ceph-mon[96576]: from='client.? 172.21.15.163:0/621990203' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-07-14T18:11:25.000 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:24.961+0000 7f1781f5c700 1 -- 172.21.15.163:0/1178597042 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f177c02c950 con 0x7f177c100690 2023-07-14T18:11:25.001 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:24.962+0000 7f1778ff9700 1 -- 172.21.15.163:0/1178597042 <== mon.0 v2:172.21.15.163:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v84) v1 ==== 103+0+11 (secure 0 0 0) 0x7f1774099da0 con 0x7f177c100690 2023-07-14T18:11:25.001 INFO:teuthology.orchestra.run.smithi163.stdout:pg_num: 32 2023-07-14T18:11:25.003 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:24.964+0000 7f1781f5c700 1 -- 172.21.15.163:0/1178597042 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f17640a1150 msgr2=0x7f17640a3600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:11:25.003 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:24.964+0000 7f1781f5c700 1 --2- 172.21.15.163:0/1178597042 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f17640a1150 0x7f17640a3600 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f1770005950 tx=0x7f17700058e0 comp rx=0 tx=0).stop 2023-07-14T18:11:25.003 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:24.964+0000 7f1781f5c700 1 -- 172.21.15.163:0/1178597042 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f177c100690 msgr2=0x7f177c19efb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:11:25.004 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:24.964+0000 7f1781f5c700 1 --2- 172.21.15.163:0/1178597042 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f177c100690 0x7f177c19efb0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f177400ef30 tx=0x7f177400c450 comp rx=0 tx=0).stop 2023-07-14T18:11:25.004 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:24.964+0000 7f1781f5c700 1 -- 172.21.15.163:0/1178597042 shutdown_connections 2023-07-14T18:11:25.004 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:24.964+0000 7f1781f5c700 1 --2- 172.21.15.163:0/1178597042 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f17640a1150 0x7f17640a3600 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:25.004 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:24.964+0000 7f1781f5c700 1 --2- 172.21.15.163:0/1178597042 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f177c0feb10 0x7f177c068310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:25.004 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:24.964+0000 7f1781f5c700 1 --2- 172.21.15.163:0/1178597042 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f177c100690 0x7f177c19efb0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:25.005 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:24.964+0000 7f1781f5c700 1 --2- 172.21.15.163:0/1178597042 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f177c0ffd00 0x7f177c19ca60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:25.006 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:24.964+0000 7f1781f5c700 1 -- 172.21.15.163:0/1178597042 >> 172.21.15.163:0/1178597042 conn(0x7f177c0fa130 msgr2=0x7f177c1032e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:11:25.006 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:24.964+0000 7f1781f5c700 1 -- 172.21.15.163:0/1178597042 shutdown_connections 2023-07-14T18:11:25.006 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:24.965+0000 7f1781f5c700 1 -- 172.21.15.163:0/1178597042 wait complete. 2023-07-14T18:11:25.015 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-07-14T18:11:25.138 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:25.099+0000 7f8df9d19700 1 -- 172.21.15.163:0/3766013462 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f8df40ffd00 msgr2=0x7f8df4100150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:11:25.138 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:25.099+0000 7f8df9d19700 1 --2- 172.21.15.163:0/3766013462 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f8df40ffd00 0x7f8df4100150 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f8de4009990 tx=0x7f8de4009ca0 comp rx=0 tx=0).stop 2023-07-14T18:11:25.138 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:25.099+0000 7f8df9d19700 1 -- 172.21.15.163:0/3766013462 shutdown_connections 2023-07-14T18:11:25.138 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:25.099+0000 7f8df9d19700 1 --2- 172.21.15.163:0/3766013462 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8df4100690 0x7f8df4106f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:25.138 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:25.099+0000 7f8df9d19700 1 --2- 172.21.15.163:0/3766013462 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8df40feb10 0x7f8df40fef20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:25.139 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:25.099+0000 7f8df9d19700 1 --2- 172.21.15.163:0/3766013462 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f8df40ffd00 0x7f8df4100150 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:25.139 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:25.099+0000 7f8df9d19700 1 -- 172.21.15.163:0/3766013462 >> 172.21.15.163:0/3766013462 conn(0x7f8df40fa130 msgr2=0x7f8df40fc560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:11:25.139 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:25.099+0000 7f8df9d19700 1 -- 172.21.15.163:0/3766013462 shutdown_connections 2023-07-14T18:11:25.139 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:25.099+0000 7f8df9d19700 1 -- 172.21.15.163:0/3766013462 wait complete. 2023-07-14T18:11:25.141 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:25.100+0000 7f8df9d19700 1 Processor -- start 2023-07-14T18:11:25.141 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:25.100+0000 7f8df9d19700 1 -- start start 2023-07-14T18:11:25.141 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:25.100+0000 7f8df9d19700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f8df40feb10 0x7f8df4194810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:11:25.141 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:25.100+0000 7f8df9d19700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8df40ffd00 0x7f8df4194d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:11:25.141 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:25.100+0000 7f8df9d19700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8df4100690 0x7f8df419bdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:11:25.141 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:25.100+0000 7f8df9d19700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8df419c390 con 0x7f8df40feb10 2023-07-14T18:11:25.142 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:25.100+0000 7f8df9d19700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8df419c4d0 con 0x7f8df40ffd00 2023-07-14T18:11:25.142 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:25.100+0000 7f8df9d19700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8df419c660 con 0x7f8df4100690 2023-07-14T18:11:25.142 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:25.100+0000 7f8df37fe700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f8df40feb10 0x7f8df4194810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:11:25.142 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:25.100+0000 7f8df37fe700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f8df40feb10 0x7f8df4194810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:56106/0 (socket says 172.21.15.163:56106) 2023-07-14T18:11:25.142 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:25.100+0000 7f8df37fe700 1 -- 172.21.15.163:0/1025227311 learned_addr learned my addr 172.21.15.163:0/1025227311 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:11:25.142 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:25.100+0000 7f8df2ffd700 1 --2- 172.21.15.163:0/1025227311 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8df40ffd00 0x7f8df4194d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:11:25.142 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:25.100+0000 7f8df37fe700 1 -- 172.21.15.163:0/1025227311 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8df4100690 msgr2=0x7f8df419bdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:11:25.142 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:25.100+0000 7f8df3fff700 1 --2- 172.21.15.163:0/1025227311 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8df4100690 0x7f8df419bdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:11:25.143 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:25.100+0000 7f8df37fe700 1 --2- 172.21.15.163:0/1025227311 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8df4100690 0x7f8df419bdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:25.143 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:25.100+0000 7f8df37fe700 1 -- 172.21.15.163:0/1025227311 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8df40ffd00 msgr2=0x7f8df4194d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:11:25.143 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:25.100+0000 7f8df37fe700 1 --2- 172.21.15.163:0/1025227311 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8df40ffd00 0x7f8df4194d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:25.143 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:25.101+0000 7f8df37fe700 1 -- 172.21.15.163:0/1025227311 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8de40095f0 con 0x7f8df40feb10 2023-07-14T18:11:25.143 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:25.101+0000 7f8df37fe700 1 --2- 172.21.15.163:0/1025227311 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f8df40feb10 0x7f8df4194810 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f8de800d980 tx=0x7f8de800dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:11:25.143 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:25.101+0000 7f8df0ff9700 1 -- 172.21.15.163:0/1025227311 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8de8004020 con 0x7f8df40feb10 2023-07-14T18:11:25.143 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:25.101+0000 7f8df0ff9700 1 -- 172.21.15.163:0/1025227311 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f8de8009730 con 0x7f8df40feb10 2023-07-14T18:11:25.144 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:25.101+0000 7f8df9d19700 1 -- 172.21.15.163:0/1025227311 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8df419c940 con 0x7f8df40feb10 2023-07-14T18:11:25.144 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:25.101+0000 7f8df0ff9700 1 -- 172.21.15.163:0/1025227311 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8de8003a00 con 0x7f8df40feb10 2023-07-14T18:11:25.144 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:25.101+0000 7f8df9d19700 1 -- 172.21.15.163:0/1025227311 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8df419cea0 con 0x7f8df40feb10 2023-07-14T18:11:25.144 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:25.102+0000 7f8df9d19700 1 -- 172.21.15.163:0/1025227311 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8df410a1e0 con 0x7f8df40feb10 2023-07-14T18:11:25.145 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:25.103+0000 7f8df0ff9700 1 -- 172.21.15.163:0/1025227311 <== mon.0 v2:172.21.15.163:3300/0 4 ==== mgrmap(e 16) v1 ==== 135716+0+0 (secure 0 0 0) 0x7f8de80098a0 con 0x7f8df40feb10 2023-07-14T18:11:25.145 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:25.103+0000 7f8df0ff9700 1 --2- 172.21.15.163:0/1025227311 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f8ddc0a11d0 0x7f8ddc0a3680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:11:25.145 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:25.104+0000 7f8df2ffd700 1 --2- 172.21.15.163:0/1025227311 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f8ddc0a11d0 0x7f8ddc0a3680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:11:25.145 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:25.104+0000 7f8df0ff9700 1 -- 172.21.15.163:0/1025227311 <== mon.0 v2:172.21.15.163:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 8730+0+0 (secure 0 0 0) 0x7f8de80cc770 con 0x7f8df40feb10 2023-07-14T18:11:25.145 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:25.104+0000 7f8df2ffd700 1 --2- 172.21.15.163:0/1025227311 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f8ddc0a11d0 0x7f8ddc0a3680 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f8de400c010 tx=0x7f8de4005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:11:25.146 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:25.108+0000 7f8df0ff9700 1 -- 172.21.15.163:0/1025227311 <== mon.0 v2:172.21.15.163:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178025 (secure 0 0 0) 0x7f8de8095cd0 con 0x7f8df40feb10 2023-07-14T18:11:25.173 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:11:24 smithi184 ceph-mon[98481]: pgmap v258: 129 pgs: 129 active+clean; 581 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 318 B/s wr, 0 op/s 2023-07-14T18:11:25.174 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:11:24 smithi184 ceph-mon[98481]: from='client.? 172.21.15.163:0/2979194507' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-07-14T18:11:25.174 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:11:24 smithi184 ceph-mon[98481]: from='client.? 172.21.15.163:0/2465144734' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-07-14T18:11:25.174 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:11:24 smithi184 ceph-mon[98481]: from='client.? 172.21.15.163:0/621990203' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-07-14T18:11:25.274 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:11:24 smithi172 ceph-mon[97983]: pgmap v258: 129 pgs: 129 active+clean; 581 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 318 B/s wr, 0 op/s 2023-07-14T18:11:25.275 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:11:24 smithi172 ceph-mon[97983]: from='client.? 172.21.15.163:0/2979194507' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-07-14T18:11:25.275 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:11:24 smithi172 ceph-mon[97983]: from='client.? 172.21.15.163:0/2465144734' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-07-14T18:11:25.275 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:11:24 smithi172 ceph-mon[97983]: from='client.? 172.21.15.163:0/621990203' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-07-14T18:11:25.349 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:25.311+0000 7f8df9d19700 1 -- 172.21.15.163:0/1025227311 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f8df410a370 con 0x7f8df40feb10 2023-07-14T18:11:25.350 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:25.311+0000 7f8df0ff9700 1 -- 172.21.15.163:0/1025227311 <== mon.0 v2:172.21.15.163:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 10 entries v84) v1 ==== 81+0+600 (secure 0 0 0) 0x7f8de80232f0 con 0x7f8df40feb10 2023-07-14T18:11:25.350 INFO:teuthology.orchestra.run.smithi163.stdout:172.21.15.163:6801/1086512093 2023-07-15T18:05:15.331458+0000 2023-07-14T18:11:25.350 INFO:teuthology.orchestra.run.smithi163.stdout:172.21.15.163:6800/1086512093 2023-07-15T18:05:15.331458+0000 2023-07-14T18:11:25.351 INFO:teuthology.orchestra.run.smithi163.stdout:172.21.15.163:0/4235784810 2023-07-15T18:05:15.331458+0000 2023-07-14T18:11:25.351 INFO:teuthology.orchestra.run.smithi163.stdout:172.21.15.163:6800/236891232 2023-07-15T18:04:53.288443+0000 2023-07-14T18:11:25.351 INFO:teuthology.orchestra.run.smithi163.stdout:172.21.15.163:6801/236891232 2023-07-15T18:04:53.288443+0000 2023-07-14T18:11:25.351 INFO:teuthology.orchestra.run.smithi163.stdout:172.21.15.163:0/3260193612 2023-07-15T18:05:15.331458+0000 2023-07-14T18:11:25.351 INFO:teuthology.orchestra.run.smithi163.stdout:172.21.15.163:0/3513629472 2023-07-15T18:04:53.288443+0000 2023-07-14T18:11:25.351 INFO:teuthology.orchestra.run.smithi163.stdout:172.21.15.163:0/1090329830 2023-07-15T18:04:53.288443+0000 2023-07-14T18:11:25.351 INFO:teuthology.orchestra.run.smithi163.stdout:172.21.15.163:0/3868922045 2023-07-15T18:05:15.331458+0000 2023-07-14T18:11:25.352 INFO:teuthology.orchestra.run.smithi163.stdout:172.21.15.163:0/2945662447 2023-07-15T18:04:53.288443+0000 2023-07-14T18:11:25.352 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:25.313+0000 7f8df9d19700 1 -- 172.21.15.163:0/1025227311 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f8ddc0a11d0 msgr2=0x7f8ddc0a3680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:11:25.352 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:25.313+0000 7f8df9d19700 1 --2- 172.21.15.163:0/1025227311 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f8ddc0a11d0 0x7f8ddc0a3680 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f8de400c010 tx=0x7f8de4005fb0 comp rx=0 tx=0).stop 2023-07-14T18:11:25.353 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:25.313+0000 7f8df9d19700 1 -- 172.21.15.163:0/1025227311 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f8df40feb10 msgr2=0x7f8df4194810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:11:25.353 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:25.313+0000 7f8df9d19700 1 --2- 172.21.15.163:0/1025227311 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f8df40feb10 0x7f8df4194810 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f8de800d980 tx=0x7f8de800dc90 comp rx=0 tx=0).stop 2023-07-14T18:11:25.353 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:25.313+0000 7f8df9d19700 1 -- 172.21.15.163:0/1025227311 shutdown_connections 2023-07-14T18:11:25.353 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:25.313+0000 7f8df9d19700 1 --2- 172.21.15.163:0/1025227311 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f8ddc0a11d0 0x7f8ddc0a3680 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:25.353 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:25.313+0000 7f8df9d19700 1 --2- 172.21.15.163:0/1025227311 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8df4100690 0x7f8df419bdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:25.353 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:25.313+0000 7f8df9d19700 1 --2- 172.21.15.163:0/1025227311 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f8df40feb10 0x7f8df4194810 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:25.353 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:25.313+0000 7f8df9d19700 1 --2- 172.21.15.163:0/1025227311 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8df40ffd00 0x7f8df4194d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:25.354 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:25.313+0000 7f8df9d19700 1 -- 172.21.15.163:0/1025227311 >> 172.21.15.163:0/1025227311 conn(0x7f8df40fa130 msgr2=0x7f8df40fc4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:11:25.354 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:25.313+0000 7f8df9d19700 1 -- 172.21.15.163:0/1025227311 shutdown_connections 2023-07-14T18:11:25.354 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:25.313+0000 7f8df9d19700 1 -- 172.21.15.163:0/1025227311 wait complete. 2023-07-14T18:11:25.354 INFO:teuthology.orchestra.run.smithi163.stderr:listed 10 entries 2023-07-14T18:11:25.364 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi163.front.sepia.ceph.com... 2023-07-14T18:11:25.364 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T18:11:25.365 DEBUG:teuthology.orchestra.run.smithi163:> sudo fusermount -u /home/ubuntu/cephtest/mnt.admin 2023-07-14T18:11:25.403 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi163.stderr:ceph-fuse[133712]: fuse finished with error 0 and tester_r 0 2023-07-14T18:11:25.405 INFO:teuthology.orchestra.run:waiting for 300 2023-07-14T18:11:25.482 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi163.front.sepia.ceph.com 2023-07-14T18:11:25.483 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T18:11:25.483 DEBUG:teuthology.orchestra.run.smithi163:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.admin) 2023-07-14T18:11:25.508 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-14T18:11:25.668 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:25.629+0000 7f8bb8daa700 1 -- 172.21.15.163:0/3229191975 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f8bb40feb00 msgr2=0x7f8bb40fef10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:11:25.668 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:25.629+0000 7f8bb8daa700 1 --2- 172.21.15.163:0/3229191975 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f8bb40feb00 0x7f8bb40fef10 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f8b9c009990 tx=0x7f8b9c009ca0 comp rx=0 tx=0).stop 2023-07-14T18:11:25.668 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:25.629+0000 7f8bb8daa700 1 -- 172.21.15.163:0/3229191975 shutdown_connections 2023-07-14T18:11:25.668 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:25.629+0000 7f8bb8daa700 1 --2- 172.21.15.163:0/3229191975 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8bb4100680 0x7f8bb4106f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:25.669 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:25.629+0000 7f8bb8daa700 1 --2- 172.21.15.163:0/3229191975 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f8bb40feb00 0x7f8bb40fef10 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:25.669 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:25.629+0000 7f8bb8daa700 1 --2- 172.21.15.163:0/3229191975 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8bb40ffcf0 0x7f8bb4100140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:25.669 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:25.629+0000 7f8bb8daa700 1 -- 172.21.15.163:0/3229191975 >> 172.21.15.163:0/3229191975 conn(0x7f8bb40fa100 msgr2=0x7f8bb40fc550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:11:25.669 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:25.629+0000 7f8bb8daa700 1 -- 172.21.15.163:0/3229191975 shutdown_connections 2023-07-14T18:11:25.669 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:25.629+0000 7f8bb8daa700 1 -- 172.21.15.163:0/3229191975 wait complete. 2023-07-14T18:11:25.671 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:25.630+0000 7f8bb8daa700 1 Processor -- start 2023-07-14T18:11:25.671 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:25.630+0000 7f8bb8daa700 1 -- start start 2023-07-14T18:11:25.671 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:25.630+0000 7f8bb8daa700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8bb40feb00 0x7f8bb4102a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:11:25.671 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:25.630+0000 7f8bb8daa700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8bb40ffcf0 0x7f8bb41010d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:11:25.671 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:25.630+0000 7f8bb8daa700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f8bb4100680 0x7f8bb4101610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:11:25.672 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:25.630+0000 7f8bb8daa700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8bb4101db0 con 0x7f8bb4100680 2023-07-14T18:11:25.672 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:25.630+0000 7f8bb8daa700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8bb4101f20 con 0x7f8bb40feb00 2023-07-14T18:11:25.672 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:25.630+0000 7f8bb8daa700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8bb419f8b0 con 0x7f8bb40ffcf0 2023-07-14T18:11:25.672 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:25.630+0000 7f8bb2d9d700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f8bb4100680 0x7f8bb4101610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:11:25.672 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:25.630+0000 7f8bb259c700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8bb40feb00 0x7f8bb4102a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:11:25.672 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:25.630+0000 7f8bb2d9d700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f8bb4100680 0x7f8bb4101610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:56122/0 (socket says 172.21.15.163:56122) 2023-07-14T18:11:25.672 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:25.630+0000 7f8bb259c700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8bb40feb00 0x7f8bb4102a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.163:56802/0 (socket says 172.21.15.163:56802) 2023-07-14T18:11:25.673 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:25.630+0000 7f8bb2d9d700 1 -- 172.21.15.163:0/881012526 learned_addr learned my addr 172.21.15.163:0/881012526 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:11:25.673 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:25.630+0000 7f8bb1d9b700 1 --2- 172.21.15.163:0/881012526 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8bb40ffcf0 0x7f8bb41010d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:11:25.673 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:25.630+0000 7f8bb2d9d700 1 -- 172.21.15.163:0/881012526 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8bb40ffcf0 msgr2=0x7f8bb41010d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:11:25.673 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:25.630+0000 7f8bb2d9d700 1 --2- 172.21.15.163:0/881012526 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8bb40ffcf0 0x7f8bb41010d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:25.673 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:25.630+0000 7f8bb2d9d700 1 -- 172.21.15.163:0/881012526 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8bb40feb00 msgr2=0x7f8bb4102a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:11:25.673 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:25.630+0000 7f8bb2d9d700 1 --2- 172.21.15.163:0/881012526 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8bb40feb00 0x7f8bb4102a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:25.673 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:25.630+0000 7f8bb2d9d700 1 -- 172.21.15.163:0/881012526 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b9c0095f0 con 0x7f8bb4100680 2023-07-14T18:11:25.673 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:25.630+0000 7f8bb1d9b700 1 --2- 172.21.15.163:0/881012526 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8bb40ffcf0 0x7f8bb41010d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T18:11:25.674 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:25.631+0000 7f8bb2d9d700 1 --2- 172.21.15.163:0/881012526 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f8bb4100680 0x7f8bb4101610 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f8bac00ada0 tx=0x7f8bac00c330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:11:25.674 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:25.631+0000 7f8bab7fe700 1 -- 172.21.15.163:0/881012526 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bac00f070 con 0x7f8bb4100680 2023-07-14T18:11:25.674 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:25.631+0000 7f8bb8daa700 1 -- 172.21.15.163:0/881012526 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8bb419fb90 con 0x7f8bb4100680 2023-07-14T18:11:25.674 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:25.631+0000 7f8bab7fe700 1 -- 172.21.15.163:0/881012526 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f8bac007b30 con 0x7f8bb4100680 2023-07-14T18:11:25.674 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:25.631+0000 7f8bab7fe700 1 -- 172.21.15.163:0/881012526 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bac005280 con 0x7f8bb4100680 2023-07-14T18:11:25.674 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:25.631+0000 7f8bb8daa700 1 -- 172.21.15.163:0/881012526 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8bb41a0050 con 0x7f8bb4100680 2023-07-14T18:11:25.674 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:25.632+0000 7f8bb8daa700 1 -- 172.21.15.163:0/881012526 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8bb410a180 con 0x7f8bb4100680 2023-07-14T18:11:25.675 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:25.633+0000 7f8bab7fe700 1 -- 172.21.15.163:0/881012526 <== mon.0 v2:172.21.15.163:3300/0 4 ==== mgrmap(e 16) v1 ==== 135716+0+0 (secure 0 0 0) 0x7f8bac00c980 con 0x7f8bb4100680 2023-07-14T18:11:25.675 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:25.633+0000 7f8bab7fe700 1 --2- 172.21.15.163:0/881012526 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f8ba00a11a0 0x7f8ba00a3650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:11:25.675 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:25.633+0000 7f8bab7fe700 1 -- 172.21.15.163:0/881012526 <== mon.0 v2:172.21.15.163:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 8730+0+0 (secure 0 0 0) 0x7f8bac0cc4c0 con 0x7f8bb4100680 2023-07-14T18:11:25.676 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:25.633+0000 7f8bb259c700 1 --2- 172.21.15.163:0/881012526 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f8ba00a11a0 0x7f8ba00a3650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:11:25.676 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:25.634+0000 7f8bb259c700 1 --2- 172.21.15.163:0/881012526 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f8ba00a11a0 0x7f8ba00a3650 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f8b9c00b5c0 tx=0x7f8b9c005960 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:11:25.676 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:25.637+0000 7f8bab7fe700 1 -- 172.21.15.163:0/881012526 <== mon.0 v2:172.21.15.163:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178025 (secure 0 0 0) 0x7f8bac095ab0 con 0x7f8bb4100680 2023-07-14T18:11:25.872 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:25.833+0000 7f8bb8daa700 1 -- 172.21.15.163:0/881012526 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8bb41a0600 con 0x7f8bb4100680 2023-07-14T18:11:25.873 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:25.834+0000 7f8bab7fe700 1 -- 172.21.15.163:0/881012526 <== mon.0 v2:172.21.15.163:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v84) v1 ==== 74+0+24030 (secure 0 0 0) 0x7f8bac00cc30 con 0x7f8bb4100680 2023-07-14T18:11:25.874 INFO:teuthology.orchestra.run.smithi163.stdout: 2023-07-14T18:11:25.874 INFO:teuthology.orchestra.run.smithi163.stdout:{"epoch":84,"fsid":"bf7326ec-2270-11ee-9b33-001a4aab830c","created":"2023-07-14T18:04:26.263517+0000","modified":"2023-07-14T18:11:14.170253+0000","last_up_change":"2023-07-14T18:10:27.514863+0000","last_in_change":"2023-07-14T18:10:10.726443+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-14T18:07:19.653852+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-07-14T18:11:07.314989+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-07-14T18:11:08.274627+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-07-14T18:11:11.991162+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"e6490568-046d-43ef-bb07-d79fb884b276","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6802","nonce":3124653025},{"type":"v1","addr":"172.21.15.163:6803","nonce":3124653025}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6804","nonce":3124653025},{"type":"v1","addr":"172.21.15.163:6805","nonce":3124653025}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6808","nonce":3124653025},{"type":"v1","addr":"172.21.15.163:6809","nonce":3124653025}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6806","nonce":3124653025},{"type":"v1","addr":"172.21.15.163:6807","nonce":3124653025}]},"public_addr":"172.21.15.163:6803/3124653025","cluster_addr":"172.21.15.163:6805/3124653025","heartbeat_back_addr":"172.21.15.163:6809/3124653025","heartbeat_front_addr":"172.21.15.163:6807/3124653025","state":["exists","up"]},{"osd":1,"uuid":"0af39bda-f096-4603-adcc-bf1988f36603","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":3774455900},{"type":"v1","addr":"172.21.15.172:6801","nonce":3774455900}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":3774455900},{"type":"v1","addr":"172.21.15.172:6803","nonce":3774455900}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":3774455900},{"type":"v1","addr":"172.21.15.172:6807","nonce":3774455900}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":3774455900},{"type":"v1","addr":"172.21.15.172:6805","nonce":3774455900}]},"public_addr":"172.21.15.172:6801/3774455900","cluster_addr":"172.21.15.172:6803/3774455900","heartbeat_back_addr":"172.21.15.172:6807/3774455900","heartbeat_front_addr":"172.21.15.172:6805/3774455900","state":["exists","up"]},{"osd":2,"uuid":"cc732c13-af0f-4199-98e6-fe960ed4e5dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":1976927678},{"type":"v1","addr":"172.21.15.184:6801","nonce":1976927678}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":1976927678},{"type":"v1","addr":"172.21.15.184:6803","nonce":1976927678}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":1976927678},{"type":"v1","addr":"172.21.15.184:6807","nonce":1976927678}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":1976927678},{"type":"v1","addr":"172.21.15.184:6805","nonce":1976927678}]},"public_addr":"172.21.15.184:6801/1976927678","cluster_addr":"172.21.15.184:6803/1976927678","heartbeat_back_addr":"172.21.15.184:6807/1976927678","heartbeat_front_addr":"172.21.15.184:6805/1976927678","state":["exists","up"]},{"osd":3,"uuid":"dcee9576-0bc6-4ab0-8f63-79eacd0eca5f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6810","nonce":2589130694},{"type":"v1","addr":"172.21.15.163:6811","nonce":2589130694}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6812","nonce":2589130694},{"type":"v1","addr":"172.21.15.163:6813","nonce":2589130694}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6816","nonce":2589130694},{"type":"v1","addr":"172.21.15.163:6817","nonce":2589130694}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6814","nonce":2589130694},{"type":"v1","addr":"172.21.15.163:6815","nonce":2589130694}]},"public_addr":"172.21.15.163:6811/2589130694","cluster_addr":"172.21.15.163:6813/2589130694","heartbeat_back_addr":"172.21.15.163:6817/2589130694","heartbeat_front_addr":"172.21.15.163:6815/2589130694","state":["exists","up"]},{"osd":4,"uuid":"055df823-b8b0-426a-83c2-f0d727932ad8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":3319632614},{"type":"v1","addr":"172.21.15.172:6809","nonce":3319632614}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6810","nonce":3319632614},{"type":"v1","addr":"172.21.15.172:6811","nonce":3319632614}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6814","nonce":3319632614},{"type":"v1","addr":"172.21.15.172:6815","nonce":3319632614}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":3319632614},{"type":"v1","addr":"172.21.15.172:6813","nonce":3319632614}]},"public_addr":"172.21.15.172:6809/3319632614","cluster_addr":"172.21.15.172:6811/3319632614","heartbeat_back_addr":"172.21.15.172:6815/3319632614","heartbeat_front_addr":"172.21.15.172:6813/3319632614","state":["exists","up"]},{"osd":5,"uuid":"ef5ef02a-b4e2-4790-9d27-f6d2247b25c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":2662084043},{"type":"v1","addr":"172.21.15.184:6809","nonce":2662084043}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6810","nonce":2662084043},{"type":"v1","addr":"172.21.15.184:6811","nonce":2662084043}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6814","nonce":2662084043},{"type":"v1","addr":"172.21.15.184:6815","nonce":2662084043}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6812","nonce":2662084043},{"type":"v1","addr":"172.21.15.184:6813","nonce":2662084043}]},"public_addr":"172.21.15.184:6809/2662084043","cluster_addr":"172.21.15.184:6811/2662084043","heartbeat_back_addr":"172.21.15.184:6815/2662084043","heartbeat_front_addr":"172.21.15.184:6813/2662084043","state":["exists","up"]},{"osd":6,"uuid":"dba754be-0fc5-4867-a6d5-cf97eb344f81","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":44,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6818","nonce":2530874117},{"type":"v1","addr":"172.21.15.163:6819","nonce":2530874117}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6820","nonce":2530874117},{"type":"v1","addr":"172.21.15.163:6821","nonce":2530874117}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6824","nonce":2530874117},{"type":"v1","addr":"172.21.15.163:6825","nonce":2530874117}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6822","nonce":2530874117},{"type":"v1","addr":"172.21.15.163:6823","nonce":2530874117}]},"public_addr":"172.21.15.163:6819/2530874117","cluster_addr":"172.21.15.163:6821/2530874117","heartbeat_back_addr":"172.21.15.163:6825/2530874117","heartbeat_front_addr":"172.21.15.163:6823/2530874117","state":["exists","up"]},{"osd":7,"uuid":"edd76e6b-6077-4619-b00d-1e906f70ddcc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":49,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":233511803},{"type":"v1","addr":"172.21.15.172:6817","nonce":233511803}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6818","nonce":233511803},{"type":"v1","addr":"172.21.15.172:6819","nonce":233511803}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":233511803},{"type":"v1","addr":"172.21.15.172:6823","nonce":233511803}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6820","nonce":233511803},{"type":"v1","addr":"172.21.15.172:6821","nonce":233511803}]},"public_addr":"172.21.15.172:6817/233511803","cluster_addr":"172.21.15.172:6819/233511803","heartbeat_back_addr":"172.21.15.172:6823/233511803","heartbeat_front_addr":"172.21.15.172:6821/233511803","state":["exists","up"]},{"osd":8,"uuid":"36559400-f33e-44e6-868a-316d34da457d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":56,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6816","nonce":290154343},{"type":"v1","addr":"172.21.15.184:6817","nonce":290154343}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6818","nonce":290154343},{"type":"v1","addr":"172.21.15.184:6819","nonce":290154343}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6822","nonce":290154343},{"type":"v1","addr":"172.21.15.184:6823","nonce":290154343}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6820","nonce":290154343},{"type":"v1","addr":"172.21.15.184:6821","nonce":290154343}]},"public_addr":"172.21.15.184:6817/290154343","cluster_addr":"172.21.15.184:6819/290154343","heartbeat_back_addr":"172.21.15.184:6823/290154343","heartbeat_front_addr":"172.21.15.184:6821/290154343","state":["exists","up"]},{"osd":9,"uuid":"d484f111-f36c-4c67-9a8a-ae03e7e0d137","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6826","nonce":3848110906},{"type":"v1","addr":"172.21.15.163:6827","nonce":3848110906}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6828","nonce":3848110906},{"type":"v1","addr":"172.21.15.163:6829","nonce":3848110906}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6832","nonce":3848110906},{"type":"v1","addr":"172.21.15.163:6833","nonce":3848110906}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6830","nonce":3848110906},{"type":"v1","addr":"172.21.15.163:6831","nonce":3848110906}]},"public_addr":"172.21.15.163:6827/3848110906","cluster_addr":"172.21.15.163:6829/3848110906","heartbeat_back_addr":"172.21.15.163:6833/3848110906","heartbeat_front_addr":"172.21.15.163:6831/3848110906","state":["exists","up"]},{"osd":10,"uuid":"d943f7c0-da3d-4605-9e23-0231e675c6be","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6824","nonce":3281085356},{"type":"v1","addr":"172.21.15.172:6825","nonce":3281085356}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":3281085356},{"type":"v1","addr":"172.21.15.172:6827","nonce":3281085356}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":3281085356},{"type":"v1","addr":"172.21.15.172:6831","nonce":3281085356}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6828","nonce":3281085356},{"type":"v1","addr":"172.21.15.172:6829","nonce":3281085356}]},"public_addr":"172.21.15.172:6825/3281085356","cluster_addr":"172.21.15.172:6827/3281085356","heartbeat_back_addr":"172.21.15.172:6831/3281085356","heartbeat_front_addr":"172.21.15.172:6829/3281085356","state":["exists","up"]},{"osd":11,"uuid":"09e610a8-408a-4119-a21b-c4de2810a538","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":75,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6824","nonce":3614578747},{"type":"v1","addr":"172.21.15.184:6825","nonce":3614578747}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6826","nonce":3614578747},{"type":"v1","addr":"172.21.15.184:6827","nonce":3614578747}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6830","nonce":3614578747},{"type":"v1","addr":"172.21.15.184:6831","nonce":3614578747}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6828","nonce":3614578747},{"type":"v1","addr":"172.21.15.184:6829","nonce":3614578747}]},"public_addr":"172.21.15.184:6825/3614578747","cluster_addr":"172.21.15.184:6827/3614578747","heartbeat_back_addr":"172.21.15.184:6831/3614578747","heartbeat_front_addr":"172.21.15.184:6829/3614578747","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T18:06:36.067578+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T18:06:57.095120+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T18:07:17.825363+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T18:07:38.977196+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T18:08:00.108709+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T18:08:20.700646+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T18:08:41.473899+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T18:09:02.856536+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T18:09:23.832722+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T18:09:44.860884+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T18:10:05.520678+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T18:10:26.426315+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.163:6801/1086512093":"2023-07-15T18:05:15.331458+0000","172.21.15.163:6800/1086512093":"2023-07-15T18:05:15.331458+0000","172.21.15.163:0/4235784810":"2023-07-15T18:05:15.331458+0000","172.21.15.163:6800/236891232":"2023-07-15T18:04:53.288443+0000","172.21.15.163:6801/236891232":"2023-07-15T18:04:53.288443+0000","172.21.15.163:0/3260193612":"2023-07-15T18:05:15.331458+0000","172.21.15.163:0/3513629472":"2023-07-15T18:04:53.288443+0000","172.21.15.163:0/1090329830":"2023-07-15T18:04:53.288443+0000","172.21.15.163:0/3868922045":"2023-07-15T18:05:15.331458+0000","172.21.15.163:0/2945662447":"2023-07-15T18:04:53.288443+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-14T18:11:25.876 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:25.837+0000 7f8bb8daa700 1 -- 172.21.15.163:0/881012526 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f8ba00a11a0 msgr2=0x7f8ba00a3650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:11:25.876 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:25.837+0000 7f8bb8daa700 1 --2- 172.21.15.163:0/881012526 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f8ba00a11a0 0x7f8ba00a3650 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f8b9c00b5c0 tx=0x7f8b9c005960 comp rx=0 tx=0).stop 2023-07-14T18:11:25.876 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:25.837+0000 7f8bb8daa700 1 -- 172.21.15.163:0/881012526 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f8bb4100680 msgr2=0x7f8bb4101610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:11:25.876 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:25.837+0000 7f8bb8daa700 1 --2- 172.21.15.163:0/881012526 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f8bb4100680 0x7f8bb4101610 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f8bac00ada0 tx=0x7f8bac00c330 comp rx=0 tx=0).stop 2023-07-14T18:11:25.876 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:25.837+0000 7f8bb8daa700 1 -- 172.21.15.163:0/881012526 shutdown_connections 2023-07-14T18:11:25.876 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:25.837+0000 7f8bb8daa700 1 --2- 172.21.15.163:0/881012526 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f8ba00a11a0 0x7f8ba00a3650 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:25.877 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:25.837+0000 7f8bb8daa700 1 --2- 172.21.15.163:0/881012526 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f8bb4100680 0x7f8bb4101610 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:25.877 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:25.837+0000 7f8bb8daa700 1 --2- 172.21.15.163:0/881012526 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8bb40feb00 0x7f8bb4102a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:25.877 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:25.837+0000 7f8bb8daa700 1 --2- 172.21.15.163:0/881012526 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8bb40ffcf0 0x7f8bb41010d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:25.877 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:25.837+0000 7f8bb8daa700 1 -- 172.21.15.163:0/881012526 >> 172.21.15.163:0/881012526 conn(0x7f8bb40fa100 msgr2=0x7f8bb4067820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:11:25.877 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:25.837+0000 7f8bb8daa700 1 -- 172.21.15.163:0/881012526 shutdown_connections 2023-07-14T18:11:25.877 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:25.837+0000 7f8bb8daa700 1 -- 172.21.15.163:0/881012526 wait complete. 2023-07-14T18:11:25.888 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-14T18:11:26.010 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:25.971+0000 7f9e39a87700 1 -- 172.21.15.163:0/2945168184 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f9e340ffd10 msgr2=0x7f9e34100160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:11:26.010 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:25.971+0000 7f9e39a87700 1 --2- 172.21.15.163:0/2945168184 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f9e340ffd10 0x7f9e34100160 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f9e24009990 tx=0x7f9e24009ca0 comp rx=0 tx=0).stop 2023-07-14T18:11:26.010 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:25.971+0000 7f9e39a87700 1 -- 172.21.15.163:0/2945168184 shutdown_connections 2023-07-14T18:11:26.010 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:25.971+0000 7f9e39a87700 1 --2- 172.21.15.163:0/2945168184 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9e341006a0 0x7f9e34106f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:26.010 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:25.971+0000 7f9e39a87700 1 --2- 172.21.15.163:0/2945168184 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9e340feb20 0x7f9e340fef30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:26.011 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:25.971+0000 7f9e39a87700 1 --2- 172.21.15.163:0/2945168184 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f9e340ffd10 0x7f9e34100160 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:26.011 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:25.971+0000 7f9e39a87700 1 -- 172.21.15.163:0/2945168184 >> 172.21.15.163:0/2945168184 conn(0x7f9e340fa100 msgr2=0x7f9e340fc570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:11:26.011 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:25.971+0000 7f9e39a87700 1 -- 172.21.15.163:0/2945168184 shutdown_connections 2023-07-14T18:11:26.011 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:25.971+0000 7f9e39a87700 1 -- 172.21.15.163:0/2945168184 wait complete. 2023-07-14T18:11:26.011 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:25.971+0000 7f9e39a87700 1 Processor -- start 2023-07-14T18:11:26.013 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:25.971+0000 7f9e39a87700 1 -- start start 2023-07-14T18:11:26.013 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:25.972+0000 7f9e39a87700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9e340feb20 0x7f9e34195810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:11:26.013 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:25.972+0000 7f9e39a87700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f9e340ffd10 0x7f9e34195d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:11:26.013 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:25.972+0000 7f9e39a87700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9e341006a0 0x7f9e3419cdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:11:26.013 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:25.972+0000 7f9e39a87700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e3419d390 con 0x7f9e340ffd10 2023-07-14T18:11:26.013 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:25.972+0000 7f9e39a87700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e3419d4d0 con 0x7f9e341006a0 2023-07-14T18:11:26.014 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:25.972+0000 7f9e39a87700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e3419d660 con 0x7f9e340feb20 2023-07-14T18:11:26.014 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:25.972+0000 7f9e32ffd700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f9e340ffd10 0x7f9e34195d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:11:26.014 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:25.972+0000 7f9e32ffd700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f9e340ffd10 0x7f9e34195d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:56136/0 (socket says 172.21.15.163:56136) 2023-07-14T18:11:26.014 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:25.972+0000 7f9e32ffd700 1 -- 172.21.15.163:0/1122311552 learned_addr learned my addr 172.21.15.163:0/1122311552 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:11:26.014 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:25.972+0000 7f9e33fff700 1 --2- 172.21.15.163:0/1122311552 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9e341006a0 0x7f9e3419cdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:11:26.014 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:25.972+0000 7f9e337fe700 1 --2- 172.21.15.163:0/1122311552 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9e340feb20 0x7f9e34195810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:11:26.014 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:25.972+0000 7f9e32ffd700 1 -- 172.21.15.163:0/1122311552 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9e340feb20 msgr2=0x7f9e34195810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:11:26.015 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:25.972+0000 7f9e32ffd700 1 --2- 172.21.15.163:0/1122311552 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9e340feb20 0x7f9e34195810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:26.015 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:25.972+0000 7f9e32ffd700 1 -- 172.21.15.163:0/1122311552 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9e341006a0 msgr2=0x7f9e3419cdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:11:26.015 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:25.972+0000 7f9e32ffd700 1 --2- 172.21.15.163:0/1122311552 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9e341006a0 0x7f9e3419cdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:26.015 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:25.972+0000 7f9e32ffd700 1 -- 172.21.15.163:0/1122311552 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e240095f0 con 0x7f9e340ffd10 2023-07-14T18:11:26.015 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:25.972+0000 7f9e32ffd700 1 --2- 172.21.15.163:0/1122311552 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f9e340ffd10 0x7f9e34195d50 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f9e24000c00 tx=0x7f9e24005740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:11:26.015 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:25.972+0000 7f9e30ff9700 1 -- 172.21.15.163:0/1122311552 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e2401d070 con 0x7f9e340ffd10 2023-07-14T18:11:26.015 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:25.972+0000 7f9e30ff9700 1 -- 172.21.15.163:0/1122311552 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f9e24003ec0 con 0x7f9e340ffd10 2023-07-14T18:11:26.015 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:25.972+0000 7f9e39a87700 1 -- 172.21.15.163:0/1122311552 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9e3419d8e0 con 0x7f9e340ffd10 2023-07-14T18:11:26.016 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:25.972+0000 7f9e30ff9700 1 -- 172.21.15.163:0/1122311552 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e24022ac0 con 0x7f9e340ffd10 2023-07-14T18:11:26.016 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:25.973+0000 7f9e39a87700 1 -- 172.21.15.163:0/1122311552 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9e3419dd00 con 0x7f9e340ffd10 2023-07-14T18:11:26.016 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:25.973+0000 7f9e39a87700 1 -- 172.21.15.163:0/1122311552 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9e3410a1f0 con 0x7f9e340ffd10 2023-07-14T18:11:26.016 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:25.975+0000 7f9e30ff9700 1 -- 172.21.15.163:0/1122311552 <== mon.0 v2:172.21.15.163:3300/0 4 ==== mgrmap(e 16) v1 ==== 135716+0+0 (secure 0 0 0) 0x7f9e24004030 con 0x7f9e340ffd10 2023-07-14T18:11:26.017 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:25.976+0000 7f9e30ff9700 1 --2- 172.21.15.163:0/1122311552 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f9e1c0a11a0 0x7f9e1c0a3650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:11:26.017 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:25.976+0000 7f9e30ff9700 1 -- 172.21.15.163:0/1122311552 <== mon.0 v2:172.21.15.163:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 8730+0+0 (secure 0 0 0) 0x7f9e240ce900 con 0x7f9e340ffd10 2023-07-14T18:11:26.017 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:25.976+0000 7f9e337fe700 1 --2- 172.21.15.163:0/1122311552 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f9e1c0a11a0 0x7f9e1c0a3650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:11:26.017 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:25.976+0000 7f9e337fe700 1 --2- 172.21.15.163:0/1122311552 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f9e1c0a11a0 0x7f9e1c0a3650 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f9e340ffb70 tx=0x7f9e28007400 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:11:26.018 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:25.979+0000 7f9e30ff9700 1 -- 172.21.15.163:0/1122311552 <== mon.0 v2:172.21.15.163:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178025 (secure 0 0 0) 0x7f9e24097e90 con 0x7f9e340ffd10 2023-07-14T18:11:26.173 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:11:25 smithi184 ceph-mon[98481]: from='client.? 172.21.15.163:0/1178597042' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2023-07-14T18:11:26.174 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:11:25 smithi184 ceph-mon[98481]: from='client.? 172.21.15.163:0/1025227311' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2023-07-14T18:11:26.206 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:26.167+0000 7f9e39a87700 1 -- 172.21.15.163:0/1122311552 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9e3419e340 con 0x7f9e340ffd10 2023-07-14T18:11:26.207 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:26.169+0000 7f9e30ff9700 1 -- 172.21.15.163:0/1122311552 <== mon.0 v2:172.21.15.163:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v84) v1 ==== 74+0+24030 (secure 0 0 0) 0x7f9e2409b4b0 con 0x7f9e340ffd10 2023-07-14T18:11:26.208 INFO:teuthology.orchestra.run.smithi163.stdout: 2023-07-14T18:11:26.208 INFO:teuthology.orchestra.run.smithi163.stdout:{"epoch":84,"fsid":"bf7326ec-2270-11ee-9b33-001a4aab830c","created":"2023-07-14T18:04:26.263517+0000","modified":"2023-07-14T18:11:14.170253+0000","last_up_change":"2023-07-14T18:10:27.514863+0000","last_in_change":"2023-07-14T18:10:10.726443+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-14T18:07:19.653852+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-07-14T18:11:07.314989+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-07-14T18:11:08.274627+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-07-14T18:11:11.991162+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"e6490568-046d-43ef-bb07-d79fb884b276","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6802","nonce":3124653025},{"type":"v1","addr":"172.21.15.163:6803","nonce":3124653025}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6804","nonce":3124653025},{"type":"v1","addr":"172.21.15.163:6805","nonce":3124653025}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6808","nonce":3124653025},{"type":"v1","addr":"172.21.15.163:6809","nonce":3124653025}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6806","nonce":3124653025},{"type":"v1","addr":"172.21.15.163:6807","nonce":3124653025}]},"public_addr":"172.21.15.163:6803/3124653025","cluster_addr":"172.21.15.163:6805/3124653025","heartbeat_back_addr":"172.21.15.163:6809/3124653025","heartbeat_front_addr":"172.21.15.163:6807/3124653025","state":["exists","up"]},{"osd":1,"uuid":"0af39bda-f096-4603-adcc-bf1988f36603","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":3774455900},{"type":"v1","addr":"172.21.15.172:6801","nonce":3774455900}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":3774455900},{"type":"v1","addr":"172.21.15.172:6803","nonce":3774455900}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":3774455900},{"type":"v1","addr":"172.21.15.172:6807","nonce":3774455900}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":3774455900},{"type":"v1","addr":"172.21.15.172:6805","nonce":3774455900}]},"public_addr":"172.21.15.172:6801/3774455900","cluster_addr":"172.21.15.172:6803/3774455900","heartbeat_back_addr":"172.21.15.172:6807/3774455900","heartbeat_front_addr":"172.21.15.172:6805/3774455900","state":["exists","up"]},{"osd":2,"uuid":"cc732c13-af0f-4199-98e6-fe960ed4e5dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":1976927678},{"type":"v1","addr":"172.21.15.184:6801","nonce":1976927678}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":1976927678},{"type":"v1","addr":"172.21.15.184:6803","nonce":1976927678}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":1976927678},{"type":"v1","addr":"172.21.15.184:6807","nonce":1976927678}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":1976927678},{"type":"v1","addr":"172.21.15.184:6805","nonce":1976927678}]},"public_addr":"172.21.15.184:6801/1976927678","cluster_addr":"172.21.15.184:6803/1976927678","heartbeat_back_addr":"172.21.15.184:6807/1976927678","heartbeat_front_addr":"172.21.15.184:6805/1976927678","state":["exists","up"]},{"osd":3,"uuid":"dcee9576-0bc6-4ab0-8f63-79eacd0eca5f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6810","nonce":2589130694},{"type":"v1","addr":"172.21.15.163:6811","nonce":2589130694}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6812","nonce":2589130694},{"type":"v1","addr":"172.21.15.163:6813","nonce":2589130694}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6816","nonce":2589130694},{"type":"v1","addr":"172.21.15.163:6817","nonce":2589130694}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6814","nonce":2589130694},{"type":"v1","addr":"172.21.15.163:6815","nonce":2589130694}]},"public_addr":"172.21.15.163:6811/2589130694","cluster_addr":"172.21.15.163:6813/2589130694","heartbeat_back_addr":"172.21.15.163:6817/2589130694","heartbeat_front_addr":"172.21.15.163:6815/2589130694","state":["exists","up"]},{"osd":4,"uuid":"055df823-b8b0-426a-83c2-f0d727932ad8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":3319632614},{"type":"v1","addr":"172.21.15.172:6809","nonce":3319632614}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6810","nonce":3319632614},{"type":"v1","addr":"172.21.15.172:6811","nonce":3319632614}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6814","nonce":3319632614},{"type":"v1","addr":"172.21.15.172:6815","nonce":3319632614}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":3319632614},{"type":"v1","addr":"172.21.15.172:6813","nonce":3319632614}]},"public_addr":"172.21.15.172:6809/3319632614","cluster_addr":"172.21.15.172:6811/3319632614","heartbeat_back_addr":"172.21.15.172:6815/3319632614","heartbeat_front_addr":"172.21.15.172:6813/3319632614","state":["exists","up"]},{"osd":5,"uuid":"ef5ef02a-b4e2-4790-9d27-f6d2247b25c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":2662084043},{"type":"v1","addr":"172.21.15.184:6809","nonce":2662084043}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6810","nonce":2662084043},{"type":"v1","addr":"172.21.15.184:6811","nonce":2662084043}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6814","nonce":2662084043},{"type":"v1","addr":"172.21.15.184:6815","nonce":2662084043}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6812","nonce":2662084043},{"type":"v1","addr":"172.21.15.184:6813","nonce":2662084043}]},"public_addr":"172.21.15.184:6809/2662084043","cluster_addr":"172.21.15.184:6811/2662084043","heartbeat_back_addr":"172.21.15.184:6815/2662084043","heartbeat_front_addr":"172.21.15.184:6813/2662084043","state":["exists","up"]},{"osd":6,"uuid":"dba754be-0fc5-4867-a6d5-cf97eb344f81","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":44,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6818","nonce":2530874117},{"type":"v1","addr":"172.21.15.163:6819","nonce":2530874117}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6820","nonce":2530874117},{"type":"v1","addr":"172.21.15.163:6821","nonce":2530874117}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6824","nonce":2530874117},{"type":"v1","addr":"172.21.15.163:6825","nonce":2530874117}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6822","nonce":2530874117},{"type":"v1","addr":"172.21.15.163:6823","nonce":2530874117}]},"public_addr":"172.21.15.163:6819/2530874117","cluster_addr":"172.21.15.163:6821/2530874117","heartbeat_back_addr":"172.21.15.163:6825/2530874117","heartbeat_front_addr":"172.21.15.163:6823/2530874117","state":["exists","up"]},{"osd":7,"uuid":"edd76e6b-6077-4619-b00d-1e906f70ddcc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":49,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":233511803},{"type":"v1","addr":"172.21.15.172:6817","nonce":233511803}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6818","nonce":233511803},{"type":"v1","addr":"172.21.15.172:6819","nonce":233511803}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":233511803},{"type":"v1","addr":"172.21.15.172:6823","nonce":233511803}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6820","nonce":233511803},{"type":"v1","addr":"172.21.15.172:6821","nonce":233511803}]},"public_addr":"172.21.15.172:6817/233511803","cluster_addr":"172.21.15.172:6819/233511803","heartbeat_back_addr":"172.21.15.172:6823/233511803","heartbeat_front_addr":"172.21.15.172:6821/233511803","state":["exists","up"]},{"osd":8,"uuid":"36559400-f33e-44e6-868a-316d34da457d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":56,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6816","nonce":290154343},{"type":"v1","addr":"172.21.15.184:6817","nonce":290154343}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6818","nonce":290154343},{"type":"v1","addr":"172.21.15.184:6819","nonce":290154343}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6822","nonce":290154343},{"type":"v1","addr":"172.21.15.184:6823","nonce":290154343}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6820","nonce":290154343},{"type":"v1","addr":"172.21.15.184:6821","nonce":290154343}]},"public_addr":"172.21.15.184:6817/290154343","cluster_addr":"172.21.15.184:6819/290154343","heartbeat_back_addr":"172.21.15.184:6823/290154343","heartbeat_front_addr":"172.21.15.184:6821/290154343","state":["exists","up"]},{"osd":9,"uuid":"d484f111-f36c-4c67-9a8a-ae03e7e0d137","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6826","nonce":3848110906},{"type":"v1","addr":"172.21.15.163:6827","nonce":3848110906}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6828","nonce":3848110906},{"type":"v1","addr":"172.21.15.163:6829","nonce":3848110906}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6832","nonce":3848110906},{"type":"v1","addr":"172.21.15.163:6833","nonce":3848110906}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6830","nonce":3848110906},{"type":"v1","addr":"172.21.15.163:6831","nonce":3848110906}]},"public_addr":"172.21.15.163:6827/3848110906","cluster_addr":"172.21.15.163:6829/3848110906","heartbeat_back_addr":"172.21.15.163:6833/3848110906","heartbeat_front_addr":"172.21.15.163:6831/3848110906","state":["exists","up"]},{"osd":10,"uuid":"d943f7c0-da3d-4605-9e23-0231e675c6be","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6824","nonce":3281085356},{"type":"v1","addr":"172.21.15.172:6825","nonce":3281085356}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":3281085356},{"type":"v1","addr":"172.21.15.172:6827","nonce":3281085356}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":3281085356},{"type":"v1","addr":"172.21.15.172:6831","nonce":3281085356}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6828","nonce":3281085356},{"type":"v1","addr":"172.21.15.172:6829","nonce":3281085356}]},"public_addr":"172.21.15.172:6825/3281085356","cluster_addr":"172.21.15.172:6827/3281085356","heartbeat_back_addr":"172.21.15.172:6831/3281085356","heartbeat_front_addr":"172.21.15.172:6829/3281085356","state":["exists","up"]},{"osd":11,"uuid":"09e610a8-408a-4119-a21b-c4de2810a538","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":75,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6824","nonce":3614578747},{"type":"v1","addr":"172.21.15.184:6825","nonce":3614578747}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6826","nonce":3614578747},{"type":"v1","addr":"172.21.15.184:6827","nonce":3614578747}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6830","nonce":3614578747},{"type":"v1","addr":"172.21.15.184:6831","nonce":3614578747}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6828","nonce":3614578747},{"type":"v1","addr":"172.21.15.184:6829","nonce":3614578747}]},"public_addr":"172.21.15.184:6825/3614578747","cluster_addr":"172.21.15.184:6827/3614578747","heartbeat_back_addr":"172.21.15.184:6831/3614578747","heartbeat_front_addr":"172.21.15.184:6829/3614578747","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T18:06:36.067578+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T18:06:57.095120+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T18:07:17.825363+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T18:07:38.977196+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T18:08:00.108709+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T18:08:20.700646+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T18:08:41.473899+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T18:09:02.856536+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T18:09:23.832722+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T18:09:44.860884+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T18:10:05.520678+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T18:10:26.426315+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.163:6801/1086512093":"2023-07-15T18:05:15.331458+0000","172.21.15.163:6800/1086512093":"2023-07-15T18:05:15.331458+0000","172.21.15.163:0/4235784810":"2023-07-15T18:05:15.331458+0000","172.21.15.163:6800/236891232":"2023-07-15T18:04:53.288443+0000","172.21.15.163:6801/236891232":"2023-07-15T18:04:53.288443+0000","172.21.15.163:0/3260193612":"2023-07-15T18:05:15.331458+0000","172.21.15.163:0/3513629472":"2023-07-15T18:04:53.288443+0000","172.21.15.163:0/1090329830":"2023-07-15T18:04:53.288443+0000","172.21.15.163:0/3868922045":"2023-07-15T18:05:15.331458+0000","172.21.15.163:0/2945662447":"2023-07-15T18:04:53.288443+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-14T18:11:26.210 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:26.171+0000 7f9e39a87700 1 -- 172.21.15.163:0/1122311552 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f9e1c0a11a0 msgr2=0x7f9e1c0a3650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:11:26.210 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:26.171+0000 7f9e39a87700 1 --2- 172.21.15.163:0/1122311552 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f9e1c0a11a0 0x7f9e1c0a3650 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f9e340ffb70 tx=0x7f9e28007400 comp rx=0 tx=0).stop 2023-07-14T18:11:26.210 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:26.171+0000 7f9e39a87700 1 -- 172.21.15.163:0/1122311552 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f9e340ffd10 msgr2=0x7f9e34195d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:11:26.210 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:26.171+0000 7f9e39a87700 1 --2- 172.21.15.163:0/1122311552 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f9e340ffd10 0x7f9e34195d50 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f9e24000c00 tx=0x7f9e24005740 comp rx=0 tx=0).stop 2023-07-14T18:11:26.210 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:26.171+0000 7f9e39a87700 1 -- 172.21.15.163:0/1122311552 shutdown_connections 2023-07-14T18:11:26.210 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:26.171+0000 7f9e39a87700 1 --2- 172.21.15.163:0/1122311552 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f9e1c0a11a0 0x7f9e1c0a3650 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:26.211 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:26.171+0000 7f9e39a87700 1 --2- 172.21.15.163:0/1122311552 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9e340feb20 0x7f9e34195810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:26.211 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:26.171+0000 7f9e39a87700 1 --2- 172.21.15.163:0/1122311552 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9e341006a0 0x7f9e3419cdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:26.211 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:26.171+0000 7f9e39a87700 1 --2- 172.21.15.163:0/1122311552 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f9e340ffd10 0x7f9e34195d50 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:26.211 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:26.171+0000 7f9e39a87700 1 -- 172.21.15.163:0/1122311552 >> 172.21.15.163:0/1122311552 conn(0x7f9e340fa100 msgr2=0x7f9e34068810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:11:26.211 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:26.171+0000 7f9e39a87700 1 -- 172.21.15.163:0/1122311552 shutdown_connections 2023-07-14T18:11:26.211 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:26.171+0000 7f9e39a87700 1 -- 172.21.15.163:0/1122311552 wait complete. 2023-07-14T18:11:26.216 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:11:25 smithi163 ceph-mon[96576]: from='client.? 172.21.15.163:0/1178597042' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2023-07-14T18:11:26.216 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:11:25 smithi163 ceph-mon[96576]: from='client.? 172.21.15.163:0/1025227311' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2023-07-14T18:11:26.223 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-07-14T18:11:26.274 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:11:25 smithi172 ceph-mon[97983]: from='client.? 172.21.15.163:0/1178597042' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2023-07-14T18:11:26.274 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:11:25 smithi172 ceph-mon[97983]: from='client.? 172.21.15.163:0/1025227311' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2023-07-14T18:11:26.347 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:26.308+0000 7fe40eacd700 1 -- 172.21.15.163:0/1650273026 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fe408100e90 msgr2=0x7fe4081012e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:11:26.347 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:26.308+0000 7fe40eacd700 1 --2- 172.21.15.163:0/1650273026 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fe408100e90 0x7fe4081012e0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fe3f4009990 tx=0x7fe3f4009ca0 comp rx=0 tx=0).stop 2023-07-14T18:11:26.347 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:26.308+0000 7fe40eacd700 1 -- 172.21.15.163:0/1650273026 shutdown_connections 2023-07-14T18:11:26.348 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:26.308+0000 7fe40eacd700 1 --2- 172.21.15.163:0/1650273026 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe4080fdec0 0x7fe4080fe2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:26.348 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:26.308+0000 7fe40eacd700 1 --2- 172.21.15.163:0/1650273026 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe408101820 0x7fe4081080e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:26.348 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:26.308+0000 7fe40eacd700 1 --2- 172.21.15.163:0/1650273026 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fe408100e90 0x7fe4081012e0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:26.348 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:26.308+0000 7fe40eacd700 1 -- 172.21.15.163:0/1650273026 >> 172.21.15.163:0/1650273026 conn(0x7fe4080f98a0 msgr2=0x7fe4080fbcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:11:26.348 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:26.308+0000 7fe40eacd700 1 -- 172.21.15.163:0/1650273026 shutdown_connections 2023-07-14T18:11:26.348 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:26.308+0000 7fe40eacd700 1 -- 172.21.15.163:0/1650273026 wait complete. 2023-07-14T18:11:26.350 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:26.309+0000 7fe40eacd700 1 Processor -- start 2023-07-14T18:11:26.350 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:26.309+0000 7fe40eacd700 1 -- start start 2023-07-14T18:11:26.350 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:26.309+0000 7fe40eacd700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe4080fdec0 0x7fe4081958d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:11:26.350 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:26.309+0000 7fe40eacd700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe408100e90 0x7fe408195e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:11:26.351 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:26.309+0000 7fe40eacd700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fe408101820 0x7fe40819ce80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:11:26.351 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:26.309+0000 7fe40eacd700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe40819d450 con 0x7fe408101820 2023-07-14T18:11:26.351 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:26.309+0000 7fe40eacd700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe40819d590 con 0x7fe408100e90 2023-07-14T18:11:26.351 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:26.309+0000 7fe40eacd700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe40819d720 con 0x7fe4080fdec0 2023-07-14T18:11:26.351 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:26.309+0000 7fe40d06a700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fe408101820 0x7fe40819ce80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:11:26.351 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:26.309+0000 7fe40d06a700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fe408101820 0x7fe40819ce80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:56152/0 (socket says 172.21.15.163:56152) 2023-07-14T18:11:26.351 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:26.309+0000 7fe40d06a700 1 -- 172.21.15.163:0/448488878 learned_addr learned my addr 172.21.15.163:0/448488878 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:11:26.352 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:26.309+0000 7fe407fff700 1 --2- 172.21.15.163:0/448488878 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe408100e90 0x7fe408195e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:11:26.352 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:26.309+0000 7fe40c869700 1 --2- 172.21.15.163:0/448488878 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe4080fdec0 0x7fe4081958d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:11:26.352 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:26.309+0000 7fe40d06a700 1 -- 172.21.15.163:0/448488878 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe4080fdec0 msgr2=0x7fe4081958d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:11:26.352 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:26.309+0000 7fe40d06a700 1 --2- 172.21.15.163:0/448488878 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe4080fdec0 0x7fe4081958d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:26.352 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:26.309+0000 7fe40d06a700 1 -- 172.21.15.163:0/448488878 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe408100e90 msgr2=0x7fe408195e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:11:26.352 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:26.309+0000 7fe40d06a700 1 --2- 172.21.15.163:0/448488878 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe408100e90 0x7fe408195e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:26.352 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:26.309+0000 7fe40d06a700 1 -- 172.21.15.163:0/448488878 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3f40095f0 con 0x7fe408101820 2023-07-14T18:11:26.353 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:26.309+0000 7fe40d06a700 1 --2- 172.21.15.163:0/448488878 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fe408101820 0x7fe40819ce80 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fe400007ee0 tx=0x7fe40000d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:11:26.353 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:26.310+0000 7fe405ffb700 1 -- 172.21.15.163:0/448488878 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe40000ddd0 con 0x7fe408101820 2023-07-14T18:11:26.353 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:26.310+0000 7fe405ffb700 1 -- 172.21.15.163:0/448488878 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fe40000f040 con 0x7fe408101820 2023-07-14T18:11:26.353 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:26.310+0000 7fe40eacd700 1 -- 172.21.15.163:0/448488878 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe40819da00 con 0x7fe408101820 2023-07-14T18:11:26.353 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:26.310+0000 7fe405ffb700 1 -- 172.21.15.163:0/448488878 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe400004870 con 0x7fe408101820 2023-07-14T18:11:26.353 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:26.310+0000 7fe40eacd700 1 -- 172.21.15.163:0/448488878 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe40819df10 con 0x7fe408101820 2023-07-14T18:11:26.353 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:26.311+0000 7fe40eacd700 1 -- 172.21.15.163:0/448488878 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe40810b280 con 0x7fe408101820 2023-07-14T18:11:26.353 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:26.312+0000 7fe405ffb700 1 -- 172.21.15.163:0/448488878 <== mon.0 v2:172.21.15.163:3300/0 4 ==== mgrmap(e 16) v1 ==== 135716+0+0 (secure 0 0 0) 0x7fe400003a00 con 0x7fe408101820 2023-07-14T18:11:26.354 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:26.312+0000 7fe405ffb700 1 --2- 172.21.15.163:0/448488878 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7fe3f80a1150 0x7fe3f80a3600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:11:26.354 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:26.312+0000 7fe40c869700 1 --2- 172.21.15.163:0/448488878 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7fe3f80a1150 0x7fe3f80a3600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:11:26.354 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:26.312+0000 7fe405ffb700 1 -- 172.21.15.163:0/448488878 <== mon.0 v2:172.21.15.163:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 8730+0+0 (secure 0 0 0) 0x7fe4000cc460 con 0x7fe408101820 2023-07-14T18:11:26.355 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:26.313+0000 7fe40c869700 1 --2- 172.21.15.163:0/448488878 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7fe3f80a1150 0x7fe3f80a3600 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fe3fc005fd0 tx=0x7fe3fc005dd0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:11:26.355 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:26.317+0000 7fe405ffb700 1 -- 172.21.15.163:0/448488878 <== mon.0 v2:172.21.15.163:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178025 (secure 0 0 0) 0x7fe40004e780 con 0x7fe408101820 2023-07-14T18:11:26.585 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:26.547+0000 7fe40eacd700 1 -- 172.21.15.163:0/448488878 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fe408106cb0 con 0x7fe408101820 2023-07-14T18:11:26.835 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:26.796+0000 7fe405ffb700 1 -- 172.21.15.163:0/448488878 <== mon.0 v2:172.21.15.163:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v18) v1 ==== 118+0+0 (secure 0 0 0) 0x7fe4000959c0 con 0x7fe408101820 2023-07-14T18:11:26.837 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:26.798+0000 7fe40eacd700 1 -- 172.21.15.163:0/448488878 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7fe3f80a1150 msgr2=0x7fe3f80a3600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:11:26.838 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:26.798+0000 7fe40eacd700 1 --2- 172.21.15.163:0/448488878 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7fe3f80a1150 0x7fe3f80a3600 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fe3fc005fd0 tx=0x7fe3fc005dd0 comp rx=0 tx=0).stop 2023-07-14T18:11:26.838 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:26.798+0000 7fe40eacd700 1 -- 172.21.15.163:0/448488878 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fe408101820 msgr2=0x7fe40819ce80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:11:26.838 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:26.798+0000 7fe40eacd700 1 --2- 172.21.15.163:0/448488878 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fe408101820 0x7fe40819ce80 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fe400007ee0 tx=0x7fe40000d3b0 comp rx=0 tx=0).stop 2023-07-14T18:11:26.838 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:26.798+0000 7fe40eacd700 1 -- 172.21.15.163:0/448488878 shutdown_connections 2023-07-14T18:11:26.838 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:26.798+0000 7fe40eacd700 1 --2- 172.21.15.163:0/448488878 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7fe3f80a1150 0x7fe3f80a3600 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:26.838 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:26.798+0000 7fe40eacd700 1 --2- 172.21.15.163:0/448488878 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe4080fdec0 0x7fe4081958d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:26.838 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:26.798+0000 7fe40eacd700 1 --2- 172.21.15.163:0/448488878 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fe408101820 0x7fe40819ce80 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:26.839 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:26.798+0000 7fe40eacd700 1 --2- 172.21.15.163:0/448488878 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe408100e90 0x7fe408195e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:26.839 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:26.798+0000 7fe40eacd700 1 -- 172.21.15.163:0/448488878 >> 172.21.15.163:0/448488878 conn(0x7fe4080f98a0 msgr2=0x7fe4080fbbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:11:26.839 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:26.799+0000 7fe40eacd700 1 -- 172.21.15.163:0/448488878 shutdown_connections 2023-07-14T18:11:26.839 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:26.799+0000 7fe40eacd700 1 -- 172.21.15.163:0/448488878 wait complete. 2023-07-14T18:11:26.850 DEBUG:tasks.cephfs.filesystem:fs_config: {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd'], 'max_mds': 5, 'session_timeout': 300, 'standby_replay': True, 'subvols': {'create': 2, 'subvol_options': '--namespace-isolated --size 25000000000'}} 2023-07-14T18:11:26.851 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs max_mds 5 2023-07-14T18:11:26.977 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:26.938+0000 7f5d164aa700 1 -- 172.21.15.163:0/3527856118 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f5d100ffd00 msgr2=0x7f5d10100150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:11:26.977 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:26.938+0000 7f5d164aa700 1 --2- 172.21.15.163:0/3527856118 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f5d100ffd00 0x7f5d10100150 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f5d04009990 tx=0x7f5d04009ca0 comp rx=0 tx=0).stop 2023-07-14T18:11:26.978 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:26.938+0000 7f5d164aa700 1 -- 172.21.15.163:0/3527856118 shutdown_connections 2023-07-14T18:11:26.978 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:26.938+0000 7f5d164aa700 1 --2- 172.21.15.163:0/3527856118 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5d100feb10 0x7f5d100fef20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:26.978 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:26.938+0000 7f5d164aa700 1 --2- 172.21.15.163:0/3527856118 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5d10100690 0x7f5d10106f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:26.978 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:26.938+0000 7f5d164aa700 1 --2- 172.21.15.163:0/3527856118 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f5d100ffd00 0x7f5d10100150 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:26.978 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:26.938+0000 7f5d164aa700 1 -- 172.21.15.163:0/3527856118 >> 172.21.15.163:0/3527856118 conn(0x7f5d100fa130 msgr2=0x7f5d100fc560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:11:26.978 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:26.938+0000 7f5d164aa700 1 -- 172.21.15.163:0/3527856118 shutdown_connections 2023-07-14T18:11:26.978 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:26.938+0000 7f5d164aa700 1 -- 172.21.15.163:0/3527856118 wait complete. 2023-07-14T18:11:26.978 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:26.939+0000 7f5d164aa700 1 Processor -- start 2023-07-14T18:11:26.979 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:26.939+0000 7f5d164aa700 1 -- start start 2023-07-14T18:11:26.980 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:26.939+0000 7f5d164aa700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f5d100feb10 0x7f5d10068330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:11:26.980 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:26.939+0000 7f5d164aa700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5d100ffd00 0x7f5d1019a660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:11:26.981 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:26.939+0000 7f5d164aa700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5d10100690 0x7f5d1019ccb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:11:26.981 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:26.939+0000 7f5d164aa700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d1019d480 con 0x7f5d100feb10 2023-07-14T18:11:26.981 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:26.939+0000 7f5d164aa700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d1019d5f0 con 0x7f5d100ffd00 2023-07-14T18:11:26.981 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:26.939+0000 7f5d164aa700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d1019d7b0 con 0x7f5d10100690 2023-07-14T18:11:26.981 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:26.939+0000 7f5d0ffff700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f5d100feb10 0x7f5d10068330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:11:26.981 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:26.939+0000 7f5d0ffff700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f5d100feb10 0x7f5d10068330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:56162/0 (socket says 172.21.15.163:56162) 2023-07-14T18:11:26.981 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:26.939+0000 7f5d0ffff700 1 -- 172.21.15.163:0/4099428602 learned_addr learned my addr 172.21.15.163:0/4099428602 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:11:26.982 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:26.939+0000 7f5d14a47700 1 --2- 172.21.15.163:0/4099428602 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5d10100690 0x7f5d1019ccb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:11:26.982 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:26.939+0000 7f5d0f7fe700 1 --2- 172.21.15.163:0/4099428602 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5d100ffd00 0x7f5d1019a660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:11:26.982 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:26.939+0000 7f5d0ffff700 1 -- 172.21.15.163:0/4099428602 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5d10100690 msgr2=0x7f5d1019ccb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:11:26.982 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:26.939+0000 7f5d0ffff700 1 --2- 172.21.15.163:0/4099428602 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5d10100690 0x7f5d1019ccb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:26.982 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:26.939+0000 7f5d0ffff700 1 -- 172.21.15.163:0/4099428602 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5d100ffd00 msgr2=0x7f5d1019a660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:11:26.982 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:26.939+0000 7f5d0ffff700 1 --2- 172.21.15.163:0/4099428602 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5d100ffd00 0x7f5d1019a660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:26.982 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:26.939+0000 7f5d0ffff700 1 -- 172.21.15.163:0/4099428602 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d040095f0 con 0x7f5d100feb10 2023-07-14T18:11:26.983 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:26.939+0000 7f5d14a47700 1 --2- 172.21.15.163:0/4099428602 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5d10100690 0x7f5d1019ccb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T18:11:26.983 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:26.939+0000 7f5d0ffff700 1 --2- 172.21.15.163:0/4099428602 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f5d100feb10 0x7f5d10068330 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f5d0000c970 tx=0x7f5d0000cd30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:11:26.983 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:26.940+0000 7f5d0d7fa700 1 -- 172.21.15.163:0/4099428602 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d00004220 con 0x7f5d100feb10 2023-07-14T18:11:26.983 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:26.940+0000 7f5d0d7fa700 1 -- 172.21.15.163:0/4099428602 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f5d00007d30 con 0x7f5d100feb10 2023-07-14T18:11:26.983 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:26.940+0000 7f5d164aa700 1 -- 172.21.15.163:0/4099428602 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5d1019da90 con 0x7f5d100feb10 2023-07-14T18:11:26.983 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:26.940+0000 7f5d0d7fa700 1 -- 172.21.15.163:0/4099428602 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d00003bf0 con 0x7f5d100feb10 2023-07-14T18:11:26.983 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:26.940+0000 7f5d164aa700 1 -- 172.21.15.163:0/4099428602 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5d1019dfa0 con 0x7f5d100feb10 2023-07-14T18:11:26.983 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:26.941+0000 7f5d164aa700 1 -- 172.21.15.163:0/4099428602 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5d1010a1e0 con 0x7f5d100feb10 2023-07-14T18:11:26.984 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:26.942+0000 7f5d0d7fa700 1 -- 172.21.15.163:0/4099428602 <== mon.0 v2:172.21.15.163:3300/0 4 ==== mgrmap(e 16) v1 ==== 135716+0+0 (secure 0 0 0) 0x7f5d00003d70 con 0x7f5d100feb10 2023-07-14T18:11:26.984 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:26.942+0000 7f5d0d7fa700 1 --2- 172.21.15.163:0/4099428602 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f5cf80a1150 0x7f5cf80a3600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:11:26.984 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:26.942+0000 7f5d0d7fa700 1 -- 172.21.15.163:0/4099428602 <== mon.0 v2:172.21.15.163:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 8730+0+0 (secure 0 0 0) 0x7f5d000ccba0 con 0x7f5d100feb10 2023-07-14T18:11:26.985 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:26.942+0000 7f5d0f7fe700 1 --2- 172.21.15.163:0/4099428602 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f5cf80a1150 0x7f5cf80a3600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:11:26.985 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:26.943+0000 7f5d0f7fe700 1 --2- 172.21.15.163:0/4099428602 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f5cf80a1150 0x7f5cf80a3600 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f5d0400b5c0 tx=0x7f5d04005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:11:26.985 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:26.946+0000 7f5d0d7fa700 1 -- 172.21.15.163:0/4099428602 <== mon.0 v2:172.21.15.163:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178025 (secure 0 0 0) 0x7f5d00096100 con 0x7f5d100feb10 2023-07-14T18:11:27.173 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:11:26 smithi184 ceph-mon[98481]: pgmap v259: 129 pgs: 129 active+clean; 581 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 289 B/s wr, 0 op/s 2023-07-14T18:11:27.174 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:11:26 smithi184 ceph-mon[98481]: from='client.? 172.21.15.163:0/881012526' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-07-14T18:11:27.174 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:11:26 smithi184 ceph-mon[98481]: from='client.? 172.21.15.163:0/1122311552' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-07-14T18:11:27.174 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:11:26 smithi184 ceph-mon[98481]: from='client.? 172.21.15.163:0/448488878' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2023-07-14T18:11:27.216 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:11:26 smithi163 ceph-mon[96576]: pgmap v259: 129 pgs: 129 active+clean; 581 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 289 B/s wr, 0 op/s 2023-07-14T18:11:27.216 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:11:26 smithi163 ceph-mon[96576]: from='client.? 172.21.15.163:0/881012526' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-07-14T18:11:27.216 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:11:26 smithi163 ceph-mon[96576]: from='client.? 172.21.15.163:0/1122311552' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-07-14T18:11:27.217 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:11:26 smithi163 ceph-mon[96576]: from='client.? 172.21.15.163:0/448488878' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2023-07-14T18:11:27.218 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:27.179+0000 7f5d164aa700 1 -- 172.21.15.163:0/4099428602 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"} v 0) v1 -- 0x7f5d10105af0 con 0x7f5d100feb10 2023-07-14T18:11:27.275 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:11:26 smithi172 ceph-mon[97983]: pgmap v259: 129 pgs: 129 active+clean; 581 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 289 B/s wr, 0 op/s 2023-07-14T18:11:27.275 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:11:26 smithi172 ceph-mon[97983]: from='client.? 172.21.15.163:0/881012526' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-07-14T18:11:27.275 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:11:26 smithi172 ceph-mon[97983]: from='client.? 172.21.15.163:0/1122311552' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-07-14T18:11:27.275 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:11:26 smithi172 ceph-mon[97983]: from='client.? 172.21.15.163:0/448488878' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2023-07-14T18:11:27.841 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:27.802+0000 7f5d0d7fa700 1 -- 172.21.15.163:0/4099428602 <== mon.0 v2:172.21.15.163:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]=0 v19) v1 ==== 105+0+0 (secure 0 0 0) 0x7f5d0001d0b0 con 0x7f5d100feb10 2023-07-14T18:11:27.844 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:27.805+0000 7f5d164aa700 1 -- 172.21.15.163:0/4099428602 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f5cf80a1150 msgr2=0x7f5cf80a3600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:11:27.845 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:27.805+0000 7f5d164aa700 1 --2- 172.21.15.163:0/4099428602 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f5cf80a1150 0x7f5cf80a3600 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f5d0400b5c0 tx=0x7f5d04005fb0 comp rx=0 tx=0).stop 2023-07-14T18:11:27.845 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:27.805+0000 7f5d164aa700 1 -- 172.21.15.163:0/4099428602 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f5d100feb10 msgr2=0x7f5d10068330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:11:27.845 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:27.805+0000 7f5d164aa700 1 --2- 172.21.15.163:0/4099428602 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f5d100feb10 0x7f5d10068330 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f5d0000c970 tx=0x7f5d0000cd30 comp rx=0 tx=0).stop 2023-07-14T18:11:27.845 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:27.805+0000 7f5d164aa700 1 -- 172.21.15.163:0/4099428602 shutdown_connections 2023-07-14T18:11:27.845 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:27.805+0000 7f5d164aa700 1 --2- 172.21.15.163:0/4099428602 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f5cf80a1150 0x7f5cf80a3600 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:27.845 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:27.805+0000 7f5d164aa700 1 --2- 172.21.15.163:0/4099428602 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5d10100690 0x7f5d1019ccb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:27.845 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:27.805+0000 7f5d164aa700 1 --2- 172.21.15.163:0/4099428602 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f5d100feb10 0x7f5d10068330 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:27.846 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:27.805+0000 7f5d164aa700 1 --2- 172.21.15.163:0/4099428602 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5d100ffd00 0x7f5d1019a660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:27.846 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:27.805+0000 7f5d164aa700 1 -- 172.21.15.163:0/4099428602 >> 172.21.15.163:0/4099428602 conn(0x7f5d100fa130 msgr2=0x7f5d100fc4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:11:27.846 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:27.806+0000 7f5d164aa700 1 -- 172.21.15.163:0/4099428602 shutdown_connections 2023-07-14T18:11:27.846 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:27.806+0000 7f5d164aa700 1 -- 172.21.15.163:0/4099428602 wait complete. 2023-07-14T18:11:27.863 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay true 2023-07-14T18:11:27.993 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:27.954+0000 7f4d10cbe700 1 -- 172.21.15.163:0/323241204 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f4d0c100e00 msgr2=0x7f4d0c101250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:11:27.993 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:27.954+0000 7f4d10cbe700 1 --2- 172.21.15.163:0/323241204 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f4d0c100e00 0x7f4d0c101250 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f4d00009990 tx=0x7f4d00009ca0 comp rx=0 tx=0).stop 2023-07-14T18:11:27.993 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:27.954+0000 7f4d10cbe700 1 -- 172.21.15.163:0/323241204 shutdown_connections 2023-07-14T18:11:27.993 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:27.954+0000 7f4d10cbe700 1 --2- 172.21.15.163:0/323241204 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4d0c101790 0x7f4d0c108050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:27.993 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:27.954+0000 7f4d10cbe700 1 --2- 172.21.15.163:0/323241204 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4d0c0ffc10 0x7f4d0c100020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:27.994 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:27.954+0000 7f4d10cbe700 1 --2- 172.21.15.163:0/323241204 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f4d0c100e00 0x7f4d0c101250 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:27.994 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:27.954+0000 7f4d10cbe700 1 -- 172.21.15.163:0/323241204 >> 172.21.15.163:0/323241204 conn(0x7f4d0c0fb250 msgr2=0x7f4d0c0fd660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:11:27.994 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:27.954+0000 7f4d10cbe700 1 -- 172.21.15.163:0/323241204 shutdown_connections 2023-07-14T18:11:27.994 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:27.954+0000 7f4d10cbe700 1 -- 172.21.15.163:0/323241204 wait complete. 2023-07-14T18:11:27.995 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:27.955+0000 7f4d10cbe700 1 Processor -- start 2023-07-14T18:11:27.996 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:27.955+0000 7f4d10cbe700 1 -- start start 2023-07-14T18:11:27.996 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:27.955+0000 7f4d10cbe700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f4d0c0ffc10 0x7f4d0c197a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:11:27.996 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:27.955+0000 7f4d10cbe700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4d0c100e00 0x7f4d0c197f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:11:27.996 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:27.955+0000 7f4d10cbe700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4d0c101790 0x7f4d0c19efe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:11:27.996 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:27.955+0000 7f4d10cbe700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d0c19f5b0 con 0x7f4d0c0ffc10 2023-07-14T18:11:27.996 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:27.955+0000 7f4d10cbe700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d0c19f6f0 con 0x7f4d0c101790 2023-07-14T18:11:27.997 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:27.955+0000 7f4d10cbe700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d0c19f880 con 0x7f4d0c100e00 2023-07-14T18:11:27.997 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:27.955+0000 7f4d0a59c700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f4d0c0ffc10 0x7f4d0c197a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:11:27.997 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:27.955+0000 7f4d0a59c700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f4d0c0ffc10 0x7f4d0c197a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:56176/0 (socket says 172.21.15.163:56176) 2023-07-14T18:11:27.997 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:27.955+0000 7f4d0a59c700 1 -- 172.21.15.163:0/3256993859 learned_addr learned my addr 172.21.15.163:0/3256993859 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:11:27.997 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:27.955+0000 7f4d0ad9d700 1 --2- 172.21.15.163:0/3256993859 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4d0c101790 0x7f4d0c19efe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:11:27.997 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:27.955+0000 7f4d0a59c700 1 -- 172.21.15.163:0/3256993859 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4d0c100e00 msgr2=0x7f4d0c197f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:11:27.997 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:27.955+0000 7f4d0a59c700 1 --2- 172.21.15.163:0/3256993859 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4d0c100e00 0x7f4d0c197f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:27.998 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:27.955+0000 7f4d0a59c700 1 -- 172.21.15.163:0/3256993859 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4d0c101790 msgr2=0x7f4d0c19efe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:11:27.998 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:27.955+0000 7f4d0a59c700 1 --2- 172.21.15.163:0/3256993859 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4d0c101790 0x7f4d0c19efe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:27.998 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:27.955+0000 7f4d0a59c700 1 -- 172.21.15.163:0/3256993859 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d000095f0 con 0x7f4d0c0ffc10 2023-07-14T18:11:27.998 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:27.955+0000 7f4d0a59c700 1 --2- 172.21.15.163:0/3256993859 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f4d0c0ffc10 0x7f4d0c197a30 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f4cfc00c990 tx=0x7f4cfc00cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:11:27.998 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:27.956+0000 7f4cfb7fe700 1 -- 172.21.15.163:0/3256993859 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cfc007b00 con 0x7f4d0c0ffc10 2023-07-14T18:11:27.998 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:27.956+0000 7f4d10cbe700 1 -- 172.21.15.163:0/3256993859 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d0c19fb60 con 0x7f4d0c0ffc10 2023-07-14T18:11:27.998 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:27.956+0000 7f4cfb7fe700 1 -- 172.21.15.163:0/3256993859 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f4cfc007c60 con 0x7f4d0c0ffc10 2023-07-14T18:11:27.998 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:27.956+0000 7f4cfb7fe700 1 -- 172.21.15.163:0/3256993859 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cfc018660 con 0x7f4d0c0ffc10 2023-07-14T18:11:27.999 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:27.956+0000 7f4d10cbe700 1 -- 172.21.15.163:0/3256993859 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d0c1a0070 con 0x7f4d0c0ffc10 2023-07-14T18:11:27.999 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:27.957+0000 7f4d10cbe700 1 -- 172.21.15.163:0/3256993859 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4d0c192180 con 0x7f4d0c0ffc10 2023-07-14T18:11:27.999 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:27.958+0000 7f4cfb7fe700 1 -- 172.21.15.163:0/3256993859 <== mon.0 v2:172.21.15.163:3300/0 4 ==== mgrmap(e 16) v1 ==== 135716+0+0 (secure 0 0 0) 0x7f4cfc00f450 con 0x7f4d0c0ffc10 2023-07-14T18:11:27.999 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:27.958+0000 7f4cfb7fe700 1 --2- 172.21.15.163:0/3256993859 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f4cf40a1150 0x7f4cf40a3600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:11:28.000 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:27.958+0000 7f4d09d9b700 1 --2- 172.21.15.163:0/3256993859 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f4cf40a1150 0x7f4cf40a3600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:11:28.000 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:27.958+0000 7f4cfb7fe700 1 -- 172.21.15.163:0/3256993859 <== mon.0 v2:172.21.15.163:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 8730+0+0 (secure 0 0 0) 0x7f4cfc0ccb50 con 0x7f4d0c0ffc10 2023-07-14T18:11:28.000 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:27.959+0000 7f4d09d9b700 1 --2- 172.21.15.163:0/3256993859 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f4cf40a1150 0x7f4cf40a3600 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f4d0000b5c0 tx=0x7f4d00005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:11:28.001 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:27.962+0000 7f4cfb7fe700 1 -- 172.21.15.163:0/3256993859 <== mon.0 v2:172.21.15.163:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178025 (secure 0 0 0) 0x7f4cfc0960b0 con 0x7f4d0c0ffc10 2023-07-14T18:11:28.174 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:11:27 smithi184 ceph-mon[98481]: from='client.? 172.21.15.163:0/448488878' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2023-07-14T18:11:28.174 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:11:27 smithi184 ceph-mon[98481]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2023-07-14T18:11:28.174 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:11:27 smithi184 ceph-mon[98481]: from='client.? 172.21.15.163:0/4099428602' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]: dispatch 2023-07-14T18:11:28.174 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:11:27 smithi184 ceph-mon[98481]: pgmap v260: 129 pgs: 129 active+clean; 581 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 255 B/s wr, 0 op/s 2023-07-14T18:11:28.216 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:11:27 smithi163 ceph-mon[96576]: from='client.? 172.21.15.163:0/448488878' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2023-07-14T18:11:28.217 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:11:27 smithi163 ceph-mon[96576]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2023-07-14T18:11:28.217 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:11:27 smithi163 ceph-mon[96576]: from='client.? 172.21.15.163:0/4099428602' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]: dispatch 2023-07-14T18:11:28.217 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:11:27 smithi163 ceph-mon[96576]: pgmap v260: 129 pgs: 129 active+clean; 581 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 255 B/s wr, 0 op/s 2023-07-14T18:11:28.234 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:28.195+0000 7f4d10cbe700 1 -- 172.21.15.163:0/3256993859 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"} v 0) v1 -- 0x7f4d0c02c8e0 con 0x7f4d0c0ffc10 2023-07-14T18:11:28.274 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:11:27 smithi172 ceph-mon[97983]: from='client.? 172.21.15.163:0/448488878' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2023-07-14T18:11:28.275 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:11:27 smithi172 ceph-mon[97983]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2023-07-14T18:11:28.275 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:11:27 smithi172 ceph-mon[97983]: from='client.? 172.21.15.163:0/4099428602' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]: dispatch 2023-07-14T18:11:28.275 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:11:27 smithi172 ceph-mon[97983]: pgmap v260: 129 pgs: 129 active+clean; 581 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 255 B/s wr, 0 op/s 2023-07-14T18:11:28.851 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:28.813+0000 7f4cfb7fe700 1 -- 172.21.15.163:0/3256993859 <== mon.0 v2:172.21.15.163:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]=0 v21) v1 ==== 121+0+0 (secure 0 0 0) 0x7f4cfc0996d0 con 0x7f4d0c0ffc10 2023-07-14T18:11:28.854 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:28.815+0000 7f4d10cbe700 1 -- 172.21.15.163:0/3256993859 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f4cf40a1150 msgr2=0x7f4cf40a3600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:11:28.854 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:28.815+0000 7f4d10cbe700 1 --2- 172.21.15.163:0/3256993859 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f4cf40a1150 0x7f4cf40a3600 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f4d0000b5c0 tx=0x7f4d00005fb0 comp rx=0 tx=0).stop 2023-07-14T18:11:28.855 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:28.815+0000 7f4d10cbe700 1 -- 172.21.15.163:0/3256993859 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f4d0c0ffc10 msgr2=0x7f4d0c197a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:11:28.855 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:28.815+0000 7f4d10cbe700 1 --2- 172.21.15.163:0/3256993859 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f4d0c0ffc10 0x7f4d0c197a30 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f4cfc00c990 tx=0x7f4cfc00cd50 comp rx=0 tx=0).stop 2023-07-14T18:11:28.855 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:28.815+0000 7f4d10cbe700 1 -- 172.21.15.163:0/3256993859 shutdown_connections 2023-07-14T18:11:28.855 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:28.815+0000 7f4d10cbe700 1 --2- 172.21.15.163:0/3256993859 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f4cf40a1150 0x7f4cf40a3600 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:28.855 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:28.815+0000 7f4d10cbe700 1 --2- 172.21.15.163:0/3256993859 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4d0c101790 0x7f4d0c19efe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:28.855 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:28.815+0000 7f4d10cbe700 1 --2- 172.21.15.163:0/3256993859 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f4d0c0ffc10 0x7f4d0c197a30 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:28.855 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:28.815+0000 7f4d10cbe700 1 --2- 172.21.15.163:0/3256993859 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4d0c100e00 0x7f4d0c197f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:28.856 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:28.815+0000 7f4d10cbe700 1 -- 172.21.15.163:0/3256993859 >> 172.21.15.163:0/3256993859 conn(0x7f4d0c0fb250 msgr2=0x7f4d0c106730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:11:28.856 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:28.816+0000 7f4d10cbe700 1 -- 172.21.15.163:0/3256993859 shutdown_connections 2023-07-14T18:11:28.856 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:28.816+0000 7f4d10cbe700 1 -- 172.21.15.163:0/3256993859 wait complete. 2023-07-14T18:11:28.873 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs session_timeout 300 2023-07-14T18:11:29.002 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:28.963+0000 7f4251159700 1 -- 172.21.15.163:0/2763306610 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f424c100e10 msgr2=0x7f424c101260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:11:29.003 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:28.963+0000 7f4251159700 1 --2- 172.21.15.163:0/2763306610 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f424c100e10 0x7f424c101260 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f4234009990 tx=0x7f4234009ca0 comp rx=0 tx=0).stop 2023-07-14T18:11:29.003 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:28.963+0000 7f4251159700 1 -- 172.21.15.163:0/2763306610 shutdown_connections 2023-07-14T18:11:29.003 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:28.963+0000 7f4251159700 1 --2- 172.21.15.163:0/2763306610 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f424c1017a0 0x7f424c108060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:29.003 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:28.963+0000 7f4251159700 1 --2- 172.21.15.163:0/2763306610 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f424c0ffc20 0x7f424c100030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:29.003 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:28.963+0000 7f4251159700 1 --2- 172.21.15.163:0/2763306610 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f424c100e10 0x7f424c101260 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:29.003 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:28.963+0000 7f4251159700 1 -- 172.21.15.163:0/2763306610 >> 172.21.15.163:0/2763306610 conn(0x7f424c0fb260 msgr2=0x7f424c0fd670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:11:29.003 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:28.963+0000 7f4251159700 1 -- 172.21.15.163:0/2763306610 shutdown_connections 2023-07-14T18:11:29.004 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:28.963+0000 7f4251159700 1 -- 172.21.15.163:0/2763306610 wait complete. 2023-07-14T18:11:29.005 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:28.964+0000 7f4251159700 1 Processor -- start 2023-07-14T18:11:29.006 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:28.964+0000 7f4251159700 1 -- start start 2023-07-14T18:11:29.006 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:28.964+0000 7f4251159700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f424c0ffc20 0x7f424c0743f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:11:29.006 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:28.964+0000 7f4251159700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f424c100e10 0x7f424c072a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:11:29.006 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:28.964+0000 7f4251159700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f424c1017a0 0x7f424c072f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:11:29.006 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:28.964+0000 7f4251159700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f424c199720 con 0x7f424c100e10 2023-07-14T18:11:29.006 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:28.964+0000 7f4251159700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f424c0734b0 con 0x7f424c1017a0 2023-07-14T18:11:29.006 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:28.964+0000 7f4251159700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f424c073670 con 0x7f424c0ffc20 2023-07-14T18:11:29.007 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:28.964+0000 7f424a59c700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f424c100e10 0x7f424c072a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:11:29.007 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:28.964+0000 7f424a59c700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f424c100e10 0x7f424c072a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:56190/0 (socket says 172.21.15.163:56190) 2023-07-14T18:11:29.007 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:28.964+0000 7f424a59c700 1 -- 172.21.15.163:0/1705618524 learned_addr learned my addr 172.21.15.163:0/1705618524 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:11:29.007 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:28.964+0000 7f424ad9d700 1 --2- 172.21.15.163:0/1705618524 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f424c0ffc20 0x7f424c0743f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:11:29.007 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:28.964+0000 7f424b59e700 1 --2- 172.21.15.163:0/1705618524 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f424c1017a0 0x7f424c072f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:11:29.007 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:28.965+0000 7f424a59c700 1 -- 172.21.15.163:0/1705618524 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f424c0ffc20 msgr2=0x7f424c0743f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:11:29.007 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:28.965+0000 7f424a59c700 1 --2- 172.21.15.163:0/1705618524 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f424c0ffc20 0x7f424c0743f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:29.007 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:28.965+0000 7f424a59c700 1 -- 172.21.15.163:0/1705618524 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f424c1017a0 msgr2=0x7f424c072f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:11:29.008 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:28.965+0000 7f424a59c700 1 --2- 172.21.15.163:0/1705618524 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f424c1017a0 0x7f424c072f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:29.008 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:28.965+0000 7f424a59c700 1 -- 172.21.15.163:0/1705618524 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42340095f0 con 0x7f424c100e10 2023-07-14T18:11:29.008 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:28.965+0000 7f424a59c700 1 --2- 172.21.15.163:0/1705618524 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f424c100e10 0x7f424c072a30 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f4234003a50 tx=0x7f4234009580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:11:29.008 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:28.965+0000 7f4243fff700 1 -- 172.21.15.163:0/1705618524 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f423401d070 con 0x7f424c100e10 2023-07-14T18:11:29.008 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:28.965+0000 7f4251159700 1 -- 172.21.15.163:0/1705618524 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f424c1a40d0 con 0x7f424c100e10 2023-07-14T18:11:29.008 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:28.965+0000 7f4243fff700 1 -- 172.21.15.163:0/1705618524 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f4234005a00 con 0x7f424c100e10 2023-07-14T18:11:29.008 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:28.965+0000 7f4243fff700 1 -- 172.21.15.163:0/1705618524 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4234005020 con 0x7f424c100e10 2023-07-14T18:11:29.009 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:28.965+0000 7f4251159700 1 -- 172.21.15.163:0/1705618524 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f424c1a4440 con 0x7f424c100e10 2023-07-14T18:11:29.009 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:28.966+0000 7f4251159700 1 -- 172.21.15.163:0/1705618524 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f424c106ba0 con 0x7f424c100e10 2023-07-14T18:11:29.009 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:28.967+0000 7f4243fff700 1 -- 172.21.15.163:0/1705618524 <== mon.0 v2:172.21.15.163:3300/0 4 ==== mgrmap(e 16) v1 ==== 135716+0+0 (secure 0 0 0) 0x7f4234004800 con 0x7f424c100e10 2023-07-14T18:11:29.009 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:28.967+0000 7f4243fff700 1 --2- 172.21.15.163:0/1705618524 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f42380a1150 0x7f42380a3600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:11:29.010 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:28.968+0000 7f424ad9d700 1 --2- 172.21.15.163:0/1705618524 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f42380a1150 0x7f42380a3600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:11:29.010 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:28.968+0000 7f4243fff700 1 -- 172.21.15.163:0/1705618524 <== mon.0 v2:172.21.15.163:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 8730+0+0 (secure 0 0 0) 0x7f42340cdd20 con 0x7f424c100e10 2023-07-14T18:11:29.010 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:28.968+0000 7f424ad9d700 1 --2- 172.21.15.163:0/1705618524 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f42380a1150 0x7f42380a3600 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f424c100c70 tx=0x7f423c00b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:11:29.010 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:28.972+0000 7f4243fff700 1 -- 172.21.15.163:0/1705618524 <== mon.0 v2:172.21.15.163:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178025 (secure 0 0 0) 0x7f42340973d0 con 0x7f424c100e10 2023-07-14T18:11:29.173 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:11:28 smithi184 ceph-mon[98481]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2023-07-14T18:11:29.174 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:11:28 smithi184 ceph-mon[98481]: from='client.? 172.21.15.163:0/4099428602' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]': finished 2023-07-14T18:11:29.174 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:11:28 smithi184 ceph-mon[98481]: daemon mds.i assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2023-07-14T18:11:29.174 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:11:28 smithi184 ceph-mon[98481]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2023-07-14T18:11:29.174 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:11:28 smithi184 ceph-mon[98481]: fsmap cephfs:2 {0=b=up:active,1=i=up:creating} 10 up:standby 2023-07-14T18:11:29.174 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:11:28 smithi184 ceph-mon[98481]: daemon mds.i is now active in filesystem cephfs as rank 1 2023-07-14T18:11:29.175 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:11:28 smithi184 ceph-mon[98481]: from='client.? 172.21.15.163:0/3256993859' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2023-07-14T18:11:29.216 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:11:28 smithi163 ceph-mon[96576]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2023-07-14T18:11:29.216 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:11:28 smithi163 ceph-mon[96576]: from='client.? 172.21.15.163:0/4099428602' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]': finished 2023-07-14T18:11:29.217 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:11:28 smithi163 ceph-mon[96576]: daemon mds.i assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2023-07-14T18:11:29.217 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:11:28 smithi163 ceph-mon[96576]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2023-07-14T18:11:29.217 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:11:28 smithi163 ceph-mon[96576]: fsmap cephfs:2 {0=b=up:active,1=i=up:creating} 10 up:standby 2023-07-14T18:11:29.217 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:11:28 smithi163 ceph-mon[96576]: daemon mds.i is now active in filesystem cephfs as rank 1 2023-07-14T18:11:29.217 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:11:28 smithi163 ceph-mon[96576]: from='client.? 172.21.15.163:0/3256993859' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2023-07-14T18:11:29.245 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:29.206+0000 7f4251159700 1 -- 172.21.15.163:0/1705618524 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} v 0) v1 -- 0x7f424c02c8e0 con 0x7f424c100e10 2023-07-14T18:11:29.275 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:11:28 smithi172 ceph-mon[97983]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2023-07-14T18:11:29.275 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:11:28 smithi172 ceph-mon[97983]: from='client.? 172.21.15.163:0/4099428602' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]': finished 2023-07-14T18:11:29.275 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:11:28 smithi172 ceph-mon[97983]: daemon mds.i assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2023-07-14T18:11:29.275 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:11:28 smithi172 ceph-mon[97983]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2023-07-14T18:11:29.275 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:11:28 smithi172 ceph-mon[97983]: fsmap cephfs:2 {0=b=up:active,1=i=up:creating} 10 up:standby 2023-07-14T18:11:29.275 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:11:28 smithi172 ceph-mon[97983]: daemon mds.i is now active in filesystem cephfs as rank 1 2023-07-14T18:11:29.276 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:11:28 smithi172 ceph-mon[97983]: from='client.? 172.21.15.163:0/3256993859' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2023-07-14T18:11:29.774 INFO:journalctl@ceph.mds.b.smithi172.stdout:Jul 14 18:11:29 smithi172 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-mds-b[123259]: 2023-07-14T18:11:29.483+0000 7f9c11ca2700 -1 mds.pinger is_rank_lagging: rank=1 was never sent ping request. 2023-07-14T18:11:29.864 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:29.826+0000 7f4243fff700 1 -- 172.21.15.163:0/1705618524 <== mon.0 v2:172.21.15.163:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]=0 v23) v1 ==== 115+0+0 (secure 0 0 0) 0x7f423400bd60 con 0x7f424c100e10 2023-07-14T18:11:29.867 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:29.828+0000 7f4251159700 1 -- 172.21.15.163:0/1705618524 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f42380a1150 msgr2=0x7f42380a3600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:11:29.867 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:29.828+0000 7f4251159700 1 --2- 172.21.15.163:0/1705618524 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f42380a1150 0x7f42380a3600 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f424c100c70 tx=0x7f423c00b410 comp rx=0 tx=0).stop 2023-07-14T18:11:29.867 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:29.828+0000 7f4251159700 1 -- 172.21.15.163:0/1705618524 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f424c100e10 msgr2=0x7f424c072a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:11:29.868 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:29.828+0000 7f4251159700 1 --2- 172.21.15.163:0/1705618524 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f424c100e10 0x7f424c072a30 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f4234003a50 tx=0x7f4234009580 comp rx=0 tx=0).stop 2023-07-14T18:11:29.868 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:29.828+0000 7f4251159700 1 -- 172.21.15.163:0/1705618524 shutdown_connections 2023-07-14T18:11:29.868 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:29.828+0000 7f4251159700 1 --2- 172.21.15.163:0/1705618524 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f42380a1150 0x7f42380a3600 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:29.868 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:29.828+0000 7f4251159700 1 --2- 172.21.15.163:0/1705618524 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f424c0ffc20 0x7f424c0743f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:29.868 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:29.828+0000 7f4251159700 1 --2- 172.21.15.163:0/1705618524 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f424c1017a0 0x7f424c072f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:29.868 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:29.828+0000 7f4251159700 1 --2- 172.21.15.163:0/1705618524 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f424c100e10 0x7f424c072a30 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:29.868 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:29.828+0000 7f4251159700 1 -- 172.21.15.163:0/1705618524 >> 172.21.15.163:0/1705618524 conn(0x7f424c0fb260 msgr2=0x7f424c0fd520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:11:29.869 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:29.828+0000 7f4251159700 1 -- 172.21.15.163:0/1705618524 shutdown_connections 2023-07-14T18:11:29.869 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:29.828+0000 7f4251159700 1 -- 172.21.15.163:0/1705618524 wait complete. 2023-07-14T18:11:29.884 DEBUG:tasks.cephfs.filesystem:Creating {'create': 2, 'subvol_options': '--namespace-isolated --size 25000000000'} subvols for filesystem 'cephfs' 2023-07-14T18:11:29.885 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume create cephfs sv_0 '' 2023-07-14T18:11:30.013 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:29.973+0000 7f8f6e2f4700 1 -- 172.21.15.163:0/1787686835 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f8f68100770 msgr2=0x7f8f68107010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:11:30.014 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:29.973+0000 7f8f6e2f4700 1 --2- 172.21.15.163:0/1787686835 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f8f68100770 0x7f8f68107010 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f8f6000b0a0 tx=0x7f8f6000b3b0 comp rx=0 tx=0).stop 2023-07-14T18:11:30.014 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:29.973+0000 7f8f6e2f4700 1 -- 172.21.15.163:0/1787686835 shutdown_connections 2023-07-14T18:11:30.014 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:29.973+0000 7f8f6e2f4700 1 --2- 172.21.15.163:0/1787686835 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f8f68100770 0x7f8f68107010 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:30.014 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:29.973+0000 7f8f6e2f4700 1 --2- 172.21.15.163:0/1787686835 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8f680feb30 0x7f8f680fef40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:30.014 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:29.973+0000 7f8f6e2f4700 1 --2- 172.21.15.163:0/1787686835 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8f680ffdc0 0x7f8f68100230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:30.014 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:29.973+0000 7f8f6e2f4700 1 -- 172.21.15.163:0/1787686835 >> 172.21.15.163:0/1787686835 conn(0x7f8f680fa150 msgr2=0x7f8f680fc580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:11:30.014 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:29.973+0000 7f8f6e2f4700 1 -- 172.21.15.163:0/1787686835 shutdown_connections 2023-07-14T18:11:30.015 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:29.973+0000 7f8f6e2f4700 1 -- 172.21.15.163:0/1787686835 wait complete. 2023-07-14T18:11:30.015 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:29.974+0000 7f8f6e2f4700 1 Processor -- start 2023-07-14T18:11:30.015 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:29.974+0000 7f8f6e2f4700 1 -- start start 2023-07-14T18:11:30.016 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:29.974+0000 7f8f6e2f4700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8f680feb30 0x7f8f68069520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:11:30.017 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:29.974+0000 7f8f6e2f4700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8f680ffdc0 0x7f8f6819a710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:11:30.017 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:29.974+0000 7f8f6e2f4700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f8f68100770 0x7f8f6819cda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:11:30.017 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:29.974+0000 7f8f6e2f4700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f6819d540 con 0x7f8f68100770 2023-07-14T18:11:30.017 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:29.974+0000 7f8f6e2f4700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f6819d6b0 con 0x7f8f680ffdc0 2023-07-14T18:11:30.017 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:29.974+0000 7f8f6e2f4700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f6819d870 con 0x7f8f680feb30 2023-07-14T18:11:30.017 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:29.974+0000 7f8f6c891700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f8f68100770 0x7f8f6819cda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:11:30.017 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:29.974+0000 7f8f6c891700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f8f68100770 0x7f8f6819cda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:56206/0 (socket says 172.21.15.163:56206) 2023-07-14T18:11:30.018 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:29.974+0000 7f8f6c891700 1 -- 172.21.15.163:0/1454229194 learned_addr learned my addr 172.21.15.163:0/1454229194 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:11:30.018 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:29.974+0000 7f8f67fff700 1 --2- 172.21.15.163:0/1454229194 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8f680feb30 0x7f8f68069520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:11:30.018 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:29.974+0000 7f8f5ffff700 1 --2- 172.21.15.163:0/1454229194 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8f680ffdc0 0x7f8f6819a710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:11:30.018 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:29.974+0000 7f8f6c891700 1 -- 172.21.15.163:0/1454229194 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8f680feb30 msgr2=0x7f8f68069520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:11:30.018 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:29.974+0000 7f8f6c891700 1 --2- 172.21.15.163:0/1454229194 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8f680feb30 0x7f8f68069520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:30.018 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:29.974+0000 7f8f6c891700 1 -- 172.21.15.163:0/1454229194 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8f680ffdc0 msgr2=0x7f8f6819a710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:11:30.018 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:29.974+0000 7f8f6c891700 1 --2- 172.21.15.163:0/1454229194 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8f680ffdc0 0x7f8f6819a710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:30.019 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:29.974+0000 7f8f6c891700 1 -- 172.21.15.163:0/1454229194 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f60009d00 con 0x7f8f68100770 2023-07-14T18:11:30.019 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:29.975+0000 7f8f6c891700 1 --2- 172.21.15.163:0/1454229194 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f8f68100770 0x7f8f6819cda0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f8f600062a0 tx=0x7f8f60004d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:11:30.019 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:29.975+0000 7f8f65ffb700 1 -- 172.21.15.163:0/1454229194 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f6000e040 con 0x7f8f68100770 2023-07-14T18:11:30.019 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:29.975+0000 7f8f65ffb700 1 -- 172.21.15.163:0/1454229194 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f8f60003e90 con 0x7f8f68100770 2023-07-14T18:11:30.019 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:29.975+0000 7f8f6e2f4700 1 -- 172.21.15.163:0/1454229194 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8f6819daf0 con 0x7f8f68100770 2023-07-14T18:11:30.019 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:29.975+0000 7f8f65ffb700 1 -- 172.21.15.163:0/1454229194 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f60004020 con 0x7f8f68100770 2023-07-14T18:11:30.019 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:29.975+0000 7f8f6e2f4700 1 -- 172.21.15.163:0/1454229194 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8f6819df70 con 0x7f8f68100770 2023-07-14T18:11:30.019 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:29.976+0000 7f8f6e2f4700 1 -- 172.21.15.163:0/1454229194 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8f681061c0 con 0x7f8f68100770 2023-07-14T18:11:30.020 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:29.977+0000 7f8f65ffb700 1 -- 172.21.15.163:0/1454229194 <== mon.0 v2:172.21.15.163:3300/0 4 ==== mgrmap(e 16) v1 ==== 135716+0+0 (secure 0 0 0) 0x7f8f60003a00 con 0x7f8f68100770 2023-07-14T18:11:30.020 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:29.977+0000 7f8f65ffb700 1 --2- 172.21.15.163:0/1454229194 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f8f540a1150 0x7f8f540a3600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:11:30.020 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:29.977+0000 7f8f65ffb700 1 -- 172.21.15.163:0/1454229194 <== mon.0 v2:172.21.15.163:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 8730+0+0 (secure 0 0 0) 0x7f8f600ce490 con 0x7f8f68100770 2023-07-14T18:11:30.021 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:29.977+0000 7f8f67fff700 1 --2- 172.21.15.163:0/1454229194 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f8f540a1150 0x7f8f540a3600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:11:30.021 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:29.978+0000 7f8f67fff700 1 --2- 172.21.15.163:0/1454229194 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f8f540a1150 0x7f8f540a3600 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f8f58005950 tx=0x7f8f5800b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:11:30.021 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:29.982+0000 7f8f65ffb700 1 -- 172.21.15.163:0/1454229194 <== mon.0 v2:172.21.15.163:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178025 (secure 0 0 0) 0x7f8f60097a80 con 0x7f8f68100770 2023-07-14T18:11:30.174 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:11:29 smithi184 ceph-mon[98481]: mds.? [v2:172.21.15.184:6838/2819059257,v1:172.21.15.184:6839/2819059257] up:active 2023-07-14T18:11:30.174 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:11:29 smithi184 ceph-mon[98481]: from='client.? 172.21.15.163:0/3256993859' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2023-07-14T18:11:30.174 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:11:29 smithi184 ceph-mon[98481]: daemon mds.h assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2023-07-14T18:11:30.174 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:11:29 smithi184 ceph-mon[98481]: fsmap cephfs:2 {0=b=up:active,1=i=up:active} 10 up:standby 2023-07-14T18:11:30.174 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:11:29 smithi184 ceph-mon[98481]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:creating} 9 up:standby 2023-07-14T18:11:30.174 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:11:29 smithi184 ceph-mon[98481]: daemon mds.h is now active in filesystem cephfs as rank 2 2023-07-14T18:11:30.175 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:11:29 smithi184 ceph-mon[98481]: from='client.? 172.21.15.163:0/1705618524' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2023-07-14T18:11:30.175 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:11:29 smithi184 ceph-mon[98481]: pgmap v261: 129 pgs: 129 active+clean; 581 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 597 B/s wr, 1 op/s 2023-07-14T18:11:30.216 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:11:29 smithi163 ceph-mon[96576]: mds.? [v2:172.21.15.184:6838/2819059257,v1:172.21.15.184:6839/2819059257] up:active 2023-07-14T18:11:30.216 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:11:29 smithi163 ceph-mon[96576]: from='client.? 172.21.15.163:0/3256993859' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2023-07-14T18:11:30.216 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:11:29 smithi163 ceph-mon[96576]: daemon mds.h assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2023-07-14T18:11:30.217 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:11:29 smithi163 ceph-mon[96576]: fsmap cephfs:2 {0=b=up:active,1=i=up:active} 10 up:standby 2023-07-14T18:11:30.217 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:11:29 smithi163 ceph-mon[96576]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:creating} 9 up:standby 2023-07-14T18:11:30.217 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:11:29 smithi163 ceph-mon[96576]: daemon mds.h is now active in filesystem cephfs as rank 2 2023-07-14T18:11:30.217 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:11:29 smithi163 ceph-mon[96576]: from='client.? 172.21.15.163:0/1705618524' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2023-07-14T18:11:30.217 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:11:29 smithi163 ceph-mon[96576]: pgmap v261: 129 pgs: 129 active+clean; 581 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 597 B/s wr, 1 op/s 2023-07-14T18:11:30.243 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:30.203+0000 7f8f6e2f4700 1 -- 172.21.15.163:0/1454229194 --> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "", "target": ["mon-mgr", ""]}) v1 -- 0x7f8f68060a80 con 0x7f8f540a1150 2023-07-14T18:11:30.275 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:11:29 smithi172 ceph-mon[97983]: mds.? [v2:172.21.15.184:6838/2819059257,v1:172.21.15.184:6839/2819059257] up:active 2023-07-14T18:11:30.275 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:11:29 smithi172 ceph-mon[97983]: from='client.? 172.21.15.163:0/3256993859' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2023-07-14T18:11:30.275 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:11:29 smithi172 ceph-mon[97983]: daemon mds.h assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2023-07-14T18:11:30.275 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:11:29 smithi172 ceph-mon[97983]: fsmap cephfs:2 {0=b=up:active,1=i=up:active} 10 up:standby 2023-07-14T18:11:30.275 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:11:29 smithi172 ceph-mon[97983]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:creating} 9 up:standby 2023-07-14T18:11:30.276 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:11:29 smithi172 ceph-mon[97983]: daemon mds.h is now active in filesystem cephfs as rank 2 2023-07-14T18:11:30.276 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:11:29 smithi172 ceph-mon[97983]: from='client.? 172.21.15.163:0/1705618524' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2023-07-14T18:11:30.276 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:11:29 smithi172 ceph-mon[97983]: pgmap v261: 129 pgs: 129 active+clean; 581 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 597 B/s wr, 1 op/s 2023-07-14T18:11:30.716 INFO:journalctl@ceph.mgr.x.smithi163.stdout:Jul 14 18:11:30 smithi163 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-mgr-x[96818]: 2023-07-14T18:11:30.208+0000 7fdf2901c700 -1 client.0 error registering admin socket command: (17) File exists 2023-07-14T18:11:30.716 INFO:journalctl@ceph.mgr.x.smithi163.stdout:Jul 14 18:11:30 smithi163 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-mgr-x[96818]: 2023-07-14T18:11:30.208+0000 7fdf2901c700 -1 client.0 error registering admin socket command: (17) File exists 2023-07-14T18:11:30.717 INFO:journalctl@ceph.mgr.x.smithi163.stdout:Jul 14 18:11:30 smithi163 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-mgr-x[96818]: 2023-07-14T18:11:30.208+0000 7fdf2901c700 -1 client.0 error registering admin socket command: (17) File exists 2023-07-14T18:11:30.717 INFO:journalctl@ceph.mgr.x.smithi163.stdout:Jul 14 18:11:30 smithi163 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-mgr-x[96818]: 2023-07-14T18:11:30.208+0000 7fdf2901c700 -1 client.0 error registering admin socket command: (17) File exists 2023-07-14T18:11:30.717 INFO:journalctl@ceph.mgr.x.smithi163.stdout:Jul 14 18:11:30 smithi163 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-mgr-x[96818]: 2023-07-14T18:11:30.208+0000 7fdf2901c700 -1 client.0 error registering admin socket command: (17) File exists 2023-07-14T18:11:30.833 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:30.793+0000 7f8f65ffb700 1 -- 172.21.15.163:0/1454229194 <== mgr.14152 v2:172.21.15.163:6800/1949590926 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f8f68060a80 con 0x7f8f540a1150 2023-07-14T18:11:30.835 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:30.795+0000 7f8f6e2f4700 1 -- 172.21.15.163:0/1454229194 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f8f540a1150 msgr2=0x7f8f540a3600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:11:30.836 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:30.795+0000 7f8f6e2f4700 1 --2- 172.21.15.163:0/1454229194 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f8f540a1150 0x7f8f540a3600 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f8f58005950 tx=0x7f8f5800b410 comp rx=0 tx=0).stop 2023-07-14T18:11:30.836 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:30.795+0000 7f8f6e2f4700 1 -- 172.21.15.163:0/1454229194 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f8f68100770 msgr2=0x7f8f6819cda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:11:30.836 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:30.795+0000 7f8f6e2f4700 1 --2- 172.21.15.163:0/1454229194 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f8f68100770 0x7f8f6819cda0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f8f600062a0 tx=0x7f8f60004d00 comp rx=0 tx=0).stop 2023-07-14T18:11:30.836 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:30.796+0000 7f8f6e2f4700 1 -- 172.21.15.163:0/1454229194 shutdown_connections 2023-07-14T18:11:30.836 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:30.796+0000 7f8f6e2f4700 1 --2- 172.21.15.163:0/1454229194 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f8f540a1150 0x7f8f540a3600 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:30.836 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:30.796+0000 7f8f6e2f4700 1 --2- 172.21.15.163:0/1454229194 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8f680feb30 0x7f8f68069520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:30.837 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:30.796+0000 7f8f6e2f4700 1 --2- 172.21.15.163:0/1454229194 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f8f68100770 0x7f8f6819cda0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:30.837 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:30.796+0000 7f8f6e2f4700 1 --2- 172.21.15.163:0/1454229194 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8f680ffdc0 0x7f8f6819a710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:30.837 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:30.796+0000 7f8f6e2f4700 1 -- 172.21.15.163:0/1454229194 >> 172.21.15.163:0/1454229194 conn(0x7f8f680fa150 msgr2=0x7f8f68103300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:11:30.837 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:30.796+0000 7f8f6e2f4700 1 -- 172.21.15.163:0/1454229194 shutdown_connections 2023-07-14T18:11:30.837 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:30.796+0000 7f8f6e2f4700 1 -- 172.21.15.163:0/1454229194 wait complete. 2023-07-14T18:11:30.850 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume getpath cephfs sv_0 2023-07-14T18:11:30.978 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:30.938+0000 7f104a1cb700 1 -- 172.21.15.163:0/387298854 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f10440feb10 msgr2=0x7f10440fef20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:11:30.979 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:30.938+0000 7f104a1cb700 1 --2- 172.21.15.163:0/387298854 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f10440feb10 0x7f10440fef20 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f1034009990 tx=0x7f1034009ca0 comp rx=0 tx=0).stop 2023-07-14T18:11:30.979 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:30.938+0000 7f104a1cb700 1 -- 172.21.15.163:0/387298854 shutdown_connections 2023-07-14T18:11:30.979 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:30.938+0000 7f104a1cb700 1 --2- 172.21.15.163:0/387298854 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1044100690 0x7f1044106f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:30.979 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:30.938+0000 7f104a1cb700 1 --2- 172.21.15.163:0/387298854 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f10440feb10 0x7f10440fef20 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:30.979 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:30.938+0000 7f104a1cb700 1 --2- 172.21.15.163:0/387298854 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f10440ffd00 0x7f1044100150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:30.979 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:30.938+0000 7f104a1cb700 1 -- 172.21.15.163:0/387298854 >> 172.21.15.163:0/387298854 conn(0x7f10440fa130 msgr2=0x7f10440fc560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:11:30.979 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:30.938+0000 7f104a1cb700 1 -- 172.21.15.163:0/387298854 shutdown_connections 2023-07-14T18:11:30.980 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:30.938+0000 7f104a1cb700 1 -- 172.21.15.163:0/387298854 wait complete. 2023-07-14T18:11:30.981 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:30.939+0000 7f104a1cb700 1 Processor -- start 2023-07-14T18:11:30.981 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:30.939+0000 7f104a1cb700 1 -- start start 2023-07-14T18:11:30.981 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:30.939+0000 7f104a1cb700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f10440feb10 0x7f1044102aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:11:30.982 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:30.939+0000 7f104a1cb700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f10440ffd00 0x7f10441010e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:11:30.982 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:30.939+0000 7f104a1cb700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f1044100690 0x7f1044101620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:11:30.982 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:30.939+0000 7f104a1cb700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1044101dc0 con 0x7f1044100690 2023-07-14T18:11:30.982 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:30.939+0000 7f104a1cb700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1044101f30 con 0x7f10440feb10 2023-07-14T18:11:30.982 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:30.939+0000 7f104a1cb700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f104419f9b0 con 0x7f10440ffd00 2023-07-14T18:11:30.982 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:30.939+0000 7f1043fff700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f1044100690 0x7f1044101620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:11:30.982 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:30.939+0000 7f1043fff700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f1044100690 0x7f1044101620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:56254/0 (socket says 172.21.15.163:56254) 2023-07-14T18:11:30.983 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:30.939+0000 7f1043fff700 1 -- 172.21.15.163:0/3975478623 learned_addr learned my addr 172.21.15.163:0/3975478623 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:11:30.983 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:30.940+0000 7f10437fe700 1 --2- 172.21.15.163:0/3975478623 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f10440feb10 0x7f1044102aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:11:30.983 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:30.940+0000 7f1042ffd700 1 --2- 172.21.15.163:0/3975478623 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f10440ffd00 0x7f10441010e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:11:30.983 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:30.940+0000 7f1043fff700 1 -- 172.21.15.163:0/3975478623 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f10440ffd00 msgr2=0x7f10441010e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:11:30.983 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:30.940+0000 7f1043fff700 1 --2- 172.21.15.163:0/3975478623 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f10440ffd00 0x7f10441010e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:30.983 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:30.940+0000 7f1043fff700 1 -- 172.21.15.163:0/3975478623 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f10440feb10 msgr2=0x7f1044102aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:11:30.983 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:30.940+0000 7f1043fff700 1 --2- 172.21.15.163:0/3975478623 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f10440feb10 0x7f1044102aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:30.984 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:30.940+0000 7f1043fff700 1 -- 172.21.15.163:0/3975478623 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10340095f0 con 0x7f1044100690 2023-07-14T18:11:30.984 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:30.940+0000 7f1043fff700 1 --2- 172.21.15.163:0/3975478623 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f1044100690 0x7f1044101620 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f103c00ada0 tx=0x7f103c00c330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:11:30.984 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:30.940+0000 7f1040ff9700 1 -- 172.21.15.163:0/3975478623 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f103c00f070 con 0x7f1044100690 2023-07-14T18:11:30.984 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:30.940+0000 7f104a1cb700 1 -- 172.21.15.163:0/3975478623 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f104419fc90 con 0x7f1044100690 2023-07-14T18:11:30.984 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:30.940+0000 7f1040ff9700 1 -- 172.21.15.163:0/3975478623 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f103c007b30 con 0x7f1044100690 2023-07-14T18:11:30.984 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:30.940+0000 7f1040ff9700 1 -- 172.21.15.163:0/3975478623 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f103c0053e0 con 0x7f1044100690 2023-07-14T18:11:30.984 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:30.940+0000 7f104a1cb700 1 -- 172.21.15.163:0/3975478623 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10441a0150 con 0x7f1044100690 2023-07-14T18:11:30.985 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:30.941+0000 7f104a1cb700 1 -- 172.21.15.163:0/3975478623 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f104410a210 con 0x7f1044100690 2023-07-14T18:11:30.985 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:30.942+0000 7f1040ff9700 1 -- 172.21.15.163:0/3975478623 <== mon.0 v2:172.21.15.163:3300/0 4 ==== mgrmap(e 16) v1 ==== 135716+0+0 (secure 0 0 0) 0x7f103c00c980 con 0x7f1044100690 2023-07-14T18:11:30.985 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:30.942+0000 7f1040ff9700 1 --2- 172.21.15.163:0/3975478623 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f102c0a1150 0x7f102c0a3600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:11:30.986 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:30.943+0000 7f10437fe700 1 --2- 172.21.15.163:0/3975478623 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f102c0a1150 0x7f102c0a3600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:11:30.986 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:30.943+0000 7f1040ff9700 1 -- 172.21.15.163:0/3975478623 <== mon.0 v2:172.21.15.163:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 8730+0+0 (secure 0 0 0) 0x7f103c0cc860 con 0x7f1044100690 2023-07-14T18:11:30.986 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:30.943+0000 7f10437fe700 1 --2- 172.21.15.163:0/3975478623 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f102c0a1150 0x7f102c0a3600 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f103400c010 tx=0x7f103400b540 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:11:30.986 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:30.946+0000 7f1040ff9700 1 -- 172.21.15.163:0/3975478623 <== mon.0 v2:172.21.15.163:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178025 (secure 0 0 0) 0x7f103c095e50 con 0x7f1044100690 2023-07-14T18:11:31.174 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:11:30 smithi184 ceph-mon[98481]: mds.? [v2:172.21.15.172:6836/3783835012,v1:172.21.15.172:6837/3783835012] up:active 2023-07-14T18:11:31.174 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:11:30 smithi184 ceph-mon[98481]: from='client.? 172.21.15.163:0/1705618524' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2023-07-14T18:11:31.174 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:11:30 smithi184 ceph-mon[98481]: daemon mds.c assigned to filesystem cephfs as rank 3 (now has 4 ranks) 2023-07-14T18:11:31.174 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:11:30 smithi184 ceph-mon[98481]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 9 up:standby 2023-07-14T18:11:31.174 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:11:30 smithi184 ceph-mon[98481]: fsmap cephfs:4 {0=b=up:active,1=i=up:active,2=h=up:active,3=c=up:creating} 8 up:standby 2023-07-14T18:11:31.175 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:11:30 smithi184 ceph-mon[98481]: daemon mds.c is now active in filesystem cephfs as rank 3 2023-07-14T18:11:31.175 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:11:30 smithi184 ceph-mon[98481]: from='client.14904 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "", "target": ["mon-mgr", ""]}]: dispatch 2023-07-14T18:11:31.175 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:11:30 smithi184 ceph-mon[98481]: mds.? [v2:172.21.15.184:6836/3389277679,v1:172.21.15.184:6837/3389277679] up:active 2023-07-14T18:11:31.175 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:11:30 smithi184 ceph-mon[98481]: daemon mds.a assigned to filesystem cephfs as rank 4 (now has 5 ranks) 2023-07-14T18:11:31.175 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:11:30 smithi184 ceph-mon[98481]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2023-07-14T18:11:31.175 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:11:30 smithi184 ceph-mon[98481]: Cluster is now healthy 2023-07-14T18:11:31.175 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:11:30 smithi184 ceph-mon[98481]: fsmap cephfs:4 {0=b=up:active,1=i=up:active,2=h=up:active,3=c=up:active} 4 up:standby-replay 4 up:standby 2023-07-14T18:11:31.175 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:11:30 smithi184 ceph-mon[98481]: fsmap cephfs:5 4 up:standby-replay 1 up:creating 3 up:standby 4 up:active 2023-07-14T18:11:31.176 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:11:30 smithi184 ceph-mon[98481]: daemon mds.a is now active in filesystem cephfs as rank 4 2023-07-14T18:11:31.209 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:31.170+0000 7f104a1cb700 1 -- 172.21.15.163:0/3975478623 --> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "sv_0", "target": ["mon-mgr", ""]}) v1 -- 0x7f1044067f30 con 0x7f102c0a1150 2023-07-14T18:11:31.213 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:31.174+0000 7f1040ff9700 1 -- 172.21.15.163:0/3975478623 <== mgr.14152 v2:172.21.15.163:6800/1949590926 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+60 (secure 0 0 0) 0x7f1044067f30 con 0x7f102c0a1150 2023-07-14T18:11:31.214 INFO:teuthology.orchestra.run.smithi163.stdout:/volumes/_nogroup/sv_0/bdaa90d5-6841-467b-a07c-ed561ecb0005 2023-07-14T18:11:31.216 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:31.176+0000 7f104a1cb700 1 -- 172.21.15.163:0/3975478623 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f102c0a1150 msgr2=0x7f102c0a3600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:11:31.216 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:31.176+0000 7f104a1cb700 1 --2- 172.21.15.163:0/3975478623 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f102c0a1150 0x7f102c0a3600 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f103400c010 tx=0x7f103400b540 comp rx=0 tx=0).stop 2023-07-14T18:11:31.216 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:31.176+0000 7f104a1cb700 1 -- 172.21.15.163:0/3975478623 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f1044100690 msgr2=0x7f1044101620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:11:31.216 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:31.176+0000 7f104a1cb700 1 --2- 172.21.15.163:0/3975478623 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f1044100690 0x7f1044101620 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f103c00ada0 tx=0x7f103c00c330 comp rx=0 tx=0).stop 2023-07-14T18:11:31.216 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:31.176+0000 7f104a1cb700 1 -- 172.21.15.163:0/3975478623 shutdown_connections 2023-07-14T18:11:31.217 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:31.176+0000 7f104a1cb700 1 --2- 172.21.15.163:0/3975478623 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f102c0a1150 0x7f102c0a3600 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:31.217 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:31.176+0000 7f104a1cb700 1 --2- 172.21.15.163:0/3975478623 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f1044100690 0x7f1044101620 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:31.217 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:31.176+0000 7f104a1cb700 1 --2- 172.21.15.163:0/3975478623 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f10440feb10 0x7f1044102aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:31.217 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:31.176+0000 7f104a1cb700 1 --2- 172.21.15.163:0/3975478623 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f10440ffd00 0x7f10441010e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:31.217 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:31.176+0000 7f104a1cb700 1 -- 172.21.15.163:0/3975478623 >> 172.21.15.163:0/3975478623 conn(0x7f10440fa130 msgr2=0x7f1044067820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:11:31.217 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:31.176+0000 7f104a1cb700 1 -- 172.21.15.163:0/3975478623 shutdown_connections 2023-07-14T18:11:31.218 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:11:30 smithi163 ceph-mon[96576]: mds.? [v2:172.21.15.172:6836/3783835012,v1:172.21.15.172:6837/3783835012] up:active 2023-07-14T18:11:31.218 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:11:30 smithi163 ceph-mon[96576]: from='client.? 172.21.15.163:0/1705618524' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2023-07-14T18:11:31.218 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:11:30 smithi163 ceph-mon[96576]: daemon mds.c assigned to filesystem cephfs as rank 3 (now has 4 ranks) 2023-07-14T18:11:31.218 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:11:30 smithi163 ceph-mon[96576]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 9 up:standby 2023-07-14T18:11:31.218 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:11:30 smithi163 ceph-mon[96576]: fsmap cephfs:4 {0=b=up:active,1=i=up:active,2=h=up:active,3=c=up:creating} 8 up:standby 2023-07-14T18:11:31.218 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:11:30 smithi163 ceph-mon[96576]: daemon mds.c is now active in filesystem cephfs as rank 3 2023-07-14T18:11:31.218 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:11:30 smithi163 ceph-mon[96576]: from='client.14904 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "", "target": ["mon-mgr", ""]}]: dispatch 2023-07-14T18:11:31.219 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:11:30 smithi163 ceph-mon[96576]: mds.? [v2:172.21.15.184:6836/3389277679,v1:172.21.15.184:6837/3389277679] up:active 2023-07-14T18:11:31.219 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:11:30 smithi163 ceph-mon[96576]: daemon mds.a assigned to filesystem cephfs as rank 4 (now has 5 ranks) 2023-07-14T18:11:31.219 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:11:30 smithi163 ceph-mon[96576]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2023-07-14T18:11:31.219 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:11:30 smithi163 ceph-mon[96576]: Cluster is now healthy 2023-07-14T18:11:31.219 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:11:30 smithi163 ceph-mon[96576]: fsmap cephfs:4 {0=b=up:active,1=i=up:active,2=h=up:active,3=c=up:active} 4 up:standby-replay 4 up:standby 2023-07-14T18:11:31.219 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:11:30 smithi163 ceph-mon[96576]: fsmap cephfs:5 4 up:standby-replay 1 up:creating 3 up:standby 4 up:active 2023-07-14T18:11:31.219 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:11:30 smithi163 ceph-mon[96576]: daemon mds.a is now active in filesystem cephfs as rank 4 2023-07-14T18:11:31.220 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:31.176+0000 7f104a1cb700 1 -- 172.21.15.163:0/3975478623 wait complete. 2023-07-14T18:11:31.228 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume create cephfs sv_1 '' 2023-07-14T18:11:31.274 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:11:30 smithi172 ceph-mon[97983]: mds.? [v2:172.21.15.172:6836/3783835012,v1:172.21.15.172:6837/3783835012] up:active 2023-07-14T18:11:31.275 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:11:30 smithi172 ceph-mon[97983]: from='client.? 172.21.15.163:0/1705618524' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2023-07-14T18:11:31.275 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:11:30 smithi172 ceph-mon[97983]: daemon mds.c assigned to filesystem cephfs as rank 3 (now has 4 ranks) 2023-07-14T18:11:31.275 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:11:30 smithi172 ceph-mon[97983]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 9 up:standby 2023-07-14T18:11:31.275 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:11:30 smithi172 ceph-mon[97983]: fsmap cephfs:4 {0=b=up:active,1=i=up:active,2=h=up:active,3=c=up:creating} 8 up:standby 2023-07-14T18:11:31.275 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:11:30 smithi172 ceph-mon[97983]: daemon mds.c is now active in filesystem cephfs as rank 3 2023-07-14T18:11:31.275 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:11:30 smithi172 ceph-mon[97983]: from='client.14904 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "", "target": ["mon-mgr", ""]}]: dispatch 2023-07-14T18:11:31.276 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:11:30 smithi172 ceph-mon[97983]: mds.? [v2:172.21.15.184:6836/3389277679,v1:172.21.15.184:6837/3389277679] up:active 2023-07-14T18:11:31.276 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:11:30 smithi172 ceph-mon[97983]: daemon mds.a assigned to filesystem cephfs as rank 4 (now has 5 ranks) 2023-07-14T18:11:31.276 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:11:30 smithi172 ceph-mon[97983]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2023-07-14T18:11:31.276 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:11:30 smithi172 ceph-mon[97983]: Cluster is now healthy 2023-07-14T18:11:31.276 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:11:30 smithi172 ceph-mon[97983]: fsmap cephfs:4 {0=b=up:active,1=i=up:active,2=h=up:active,3=c=up:active} 4 up:standby-replay 4 up:standby 2023-07-14T18:11:31.276 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:11:30 smithi172 ceph-mon[97983]: fsmap cephfs:5 4 up:standby-replay 1 up:creating 3 up:standby 4 up:active 2023-07-14T18:11:31.277 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:11:30 smithi172 ceph-mon[97983]: daemon mds.a is now active in filesystem cephfs as rank 4 2023-07-14T18:11:31.355 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:31.314+0000 7fb85844f700 1 -- 172.21.15.163:0/1023954410 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fb850100180 msgr2=0x7fb850100590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:11:31.355 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:31.314+0000 7fb85844f700 1 --2- 172.21.15.163:0/1023954410 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fb850100180 0x7fb850100590 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fb840009990 tx=0x7fb840009ca0 comp rx=0 tx=0).stop 2023-07-14T18:11:31.355 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:31.315+0000 7fb85844f700 1 -- 172.21.15.163:0/1023954410 shutdown_connections 2023-07-14T18:11:31.355 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:31.315+0000 7fb85844f700 1 --2- 172.21.15.163:0/1023954410 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb8500ff6f0 0x7fb850106fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:31.355 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:31.315+0000 7fb85844f700 1 --2- 172.21.15.163:0/1023954410 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fb850100180 0x7fb850100590 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:31.355 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:31.315+0000 7fb85844f700 1 --2- 172.21.15.163:0/1023954410 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb8500fed40 0x7fb8500ff1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:31.356 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:31.315+0000 7fb85844f700 1 -- 172.21.15.163:0/1023954410 >> 172.21.15.163:0/1023954410 conn(0x7fb8500f98a0 msgr2=0x7fb8500fbcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:11:31.356 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:31.315+0000 7fb85844f700 1 -- 172.21.15.163:0/1023954410 shutdown_connections 2023-07-14T18:11:31.356 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:31.315+0000 7fb85844f700 1 -- 172.21.15.163:0/1023954410 wait complete. 2023-07-14T18:11:31.358 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:31.315+0000 7fb85844f700 1 Processor -- start 2023-07-14T18:11:31.358 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:31.315+0000 7fb85844f700 1 -- start start 2023-07-14T18:11:31.358 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:31.315+0000 7fb85844f700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fb8500fed40 0x7fb850102f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:11:31.358 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:31.315+0000 7fb85844f700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb8500ff6f0 0x7fb8501015d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:11:31.358 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:31.315+0000 7fb85844f700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb850100180 0x7fb850101b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:11:31.358 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:31.315+0000 7fb85844f700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8501022b0 con 0x7fb8500fed40 2023-07-14T18:11:31.359 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:31.315+0000 7fb85844f700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb850102420 con 0x7fb8500ff6f0 2023-07-14T18:11:31.359 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:31.315+0000 7fb85844f700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb85019f950 con 0x7fb850100180 2023-07-14T18:11:31.359 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:31.315+0000 7fb8561eb700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fb8500fed40 0x7fb850102f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:11:31.359 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:31.316+0000 7fb8561eb700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fb8500fed40 0x7fb850102f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:56264/0 (socket says 172.21.15.163:56264) 2023-07-14T18:11:31.359 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:31.316+0000 7fb8561eb700 1 -- 172.21.15.163:0/649829933 learned_addr learned my addr 172.21.15.163:0/649829933 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:11:31.359 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:31.316+0000 7fb8569ec700 1 --2- 172.21.15.163:0/649829933 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb850100180 0x7fb850101b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:11:31.359 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:31.316+0000 7fb8559ea700 1 --2- 172.21.15.163:0/649829933 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb8500ff6f0 0x7fb8501015d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:11:31.359 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:31.316+0000 7fb8561eb700 1 -- 172.21.15.163:0/649829933 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb850100180 msgr2=0x7fb850101b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:11:31.360 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:31.316+0000 7fb8561eb700 1 --2- 172.21.15.163:0/649829933 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb850100180 0x7fb850101b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:31.360 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:31.316+0000 7fb8561eb700 1 -- 172.21.15.163:0/649829933 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb8500ff6f0 msgr2=0x7fb8501015d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:11:31.360 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:31.316+0000 7fb8561eb700 1 --2- 172.21.15.163:0/649829933 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb8500ff6f0 0x7fb8501015d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:31.360 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:31.316+0000 7fb8561eb700 1 -- 172.21.15.163:0/649829933 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8400095f0 con 0x7fb8500fed40 2023-07-14T18:11:31.360 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:31.316+0000 7fb8561eb700 1 --2- 172.21.15.163:0/649829933 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fb8500fed40 0x7fb850102f90 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fb840005910 tx=0x7fb840004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:11:31.360 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:31.316+0000 7fb8477fe700 1 -- 172.21.15.163:0/649829933 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb84001d070 con 0x7fb8500fed40 2023-07-14T18:11:31.360 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:31.316+0000 7fb8477fe700 1 -- 172.21.15.163:0/649829933 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fb8400054c0 con 0x7fb8500fed40 2023-07-14T18:11:31.361 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:31.316+0000 7fb85844f700 1 -- 172.21.15.163:0/649829933 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb85019fbd0 con 0x7fb8500fed40 2023-07-14T18:11:31.361 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:31.316+0000 7fb8477fe700 1 -- 172.21.15.163:0/649829933 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb840003ab0 con 0x7fb8500fed40 2023-07-14T18:11:31.361 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:31.316+0000 7fb85844f700 1 -- 172.21.15.163:0/649829933 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb85019fff0 con 0x7fb8500fed40 2023-07-14T18:11:31.361 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:31.317+0000 7fb85844f700 1 -- 172.21.15.163:0/649829933 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb850106dd0 con 0x7fb8500fed40 2023-07-14T18:11:31.361 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:31.318+0000 7fb8477fe700 1 -- 172.21.15.163:0/649829933 <== mon.0 v2:172.21.15.163:3300/0 4 ==== mgrmap(e 16) v1 ==== 135716+0+0 (secure 0 0 0) 0x7fb8400047a0 con 0x7fb8500fed40 2023-07-14T18:11:31.362 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:31.319+0000 7fb8477fe700 1 --2- 172.21.15.163:0/649829933 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7fb83c0a1150 0x7fb83c0a3600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:11:31.362 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:31.319+0000 7fb8559ea700 1 --2- 172.21.15.163:0/649829933 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7fb83c0a1150 0x7fb83c0a3600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:11:31.362 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:31.319+0000 7fb8477fe700 1 -- 172.21.15.163:0/649829933 <== mon.0 v2:172.21.15.163:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 8730+0+0 (secure 0 0 0) 0x7fb8400cdef0 con 0x7fb8500fed40 2023-07-14T18:11:31.362 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:31.319+0000 7fb8559ea700 1 --2- 172.21.15.163:0/649829933 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7fb83c0a1150 0x7fb83c0a3600 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fb84c00bbd0 tx=0x7fb84c00b5b0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:11:31.362 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:31.322+0000 7fb8477fe700 1 -- 172.21.15.163:0/649829933 <== mon.0 v2:172.21.15.163:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178025 (secure 0 0 0) 0x7fb8400974e0 con 0x7fb8500fed40 2023-07-14T18:11:31.581 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:31.542+0000 7fb85844f700 1 -- 172.21.15.163:0/649829933 --> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "", "target": ["mon-mgr", ""]}) v1 -- 0x7fb850060b10 con 0x7fb83c0a1150 2023-07-14T18:11:31.607 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:31.567+0000 7fb8477fe700 1 -- 172.21.15.163:0/649829933 <== mgr.14152 v2:172.21.15.163:6800/1949590926 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7fb850060b10 con 0x7fb83c0a1150 2023-07-14T18:11:31.609 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:31.569+0000 7fb85844f700 1 -- 172.21.15.163:0/649829933 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7fb83c0a1150 msgr2=0x7fb83c0a3600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:11:31.610 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:31.569+0000 7fb85844f700 1 --2- 172.21.15.163:0/649829933 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7fb83c0a1150 0x7fb83c0a3600 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fb84c00bbd0 tx=0x7fb84c00b5b0 comp rx=0 tx=0).stop 2023-07-14T18:11:31.610 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:31.569+0000 7fb85844f700 1 -- 172.21.15.163:0/649829933 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fb8500fed40 msgr2=0x7fb850102f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:11:31.610 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:31.569+0000 7fb85844f700 1 --2- 172.21.15.163:0/649829933 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fb8500fed40 0x7fb850102f90 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fb840005910 tx=0x7fb840004730 comp rx=0 tx=0).stop 2023-07-14T18:11:31.610 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:31.570+0000 7fb85844f700 1 -- 172.21.15.163:0/649829933 shutdown_connections 2023-07-14T18:11:31.610 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:31.570+0000 7fb85844f700 1 --2- 172.21.15.163:0/649829933 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7fb83c0a1150 0x7fb83c0a3600 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:31.610 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:31.570+0000 7fb85844f700 1 --2- 172.21.15.163:0/649829933 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb850100180 0x7fb850101b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:31.611 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:31.570+0000 7fb85844f700 1 --2- 172.21.15.163:0/649829933 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fb8500fed40 0x7fb850102f90 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:31.611 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:31.570+0000 7fb85844f700 1 --2- 172.21.15.163:0/649829933 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb8500ff6f0 0x7fb8501015d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:31.611 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:31.570+0000 7fb85844f700 1 -- 172.21.15.163:0/649829933 >> 172.21.15.163:0/649829933 conn(0x7fb8500f98a0 msgr2=0x7fb8500fbc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:11:31.611 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:31.570+0000 7fb85844f700 1 -- 172.21.15.163:0/649829933 shutdown_connections 2023-07-14T18:11:31.611 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:31.570+0000 7fb85844f700 1 -- 172.21.15.163:0/649829933 wait complete. 2023-07-14T18:11:31.622 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume getpath cephfs sv_1 2023-07-14T18:11:31.746 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:31.706+0000 7f99e64f2700 1 -- 172.21.15.163:0/1090726267 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f99e01006f0 msgr2=0x7f99e0102ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:11:31.746 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:31.706+0000 7f99e64f2700 1 --2- 172.21.15.163:0/1090726267 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f99e01006f0 0x7f99e0102ad0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f99c8009990 tx=0x7f99c8009ca0 comp rx=0 tx=0).stop 2023-07-14T18:11:31.746 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:31.706+0000 7f99e64f2700 1 -- 172.21.15.163:0/1090726267 shutdown_connections 2023-07-14T18:11:31.747 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:31.706+0000 7f99e64f2700 1 --2- 172.21.15.163:0/1090726267 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f99e0105930 0x7f99e0107d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:31.747 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:31.706+0000 7f99e64f2700 1 --2- 172.21.15.163:0/1090726267 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f99e01006f0 0x7f99e0102ad0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:31.747 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:31.706+0000 7f99e64f2700 1 --2- 172.21.15.163:0/1090726267 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f99e0103010 0x7f99e01053f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:31.747 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:31.706+0000 7f99e64f2700 1 -- 172.21.15.163:0/1090726267 >> 172.21.15.163:0/1090726267 conn(0x7f99e00fa130 msgr2=0x7f99e00fc560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:11:31.747 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:31.706+0000 7f99e64f2700 1 -- 172.21.15.163:0/1090726267 shutdown_connections 2023-07-14T18:11:31.747 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:31.706+0000 7f99e64f2700 1 -- 172.21.15.163:0/1090726267 wait complete. 2023-07-14T18:11:31.749 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:31.707+0000 7f99e64f2700 1 Processor -- start 2023-07-14T18:11:31.749 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:31.707+0000 7f99e64f2700 1 -- start start 2023-07-14T18:11:31.750 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:31.707+0000 7f99e64f2700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f99e01006f0 0x7f99e0195860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:11:31.750 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:31.707+0000 7f99e64f2700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f99e0103010 0x7f99e0195da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:11:31.750 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:31.707+0000 7f99e64f2700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f99e0105930 0x7f99e019ce10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:11:31.750 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:31.707+0000 7f99e64f2700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99e019d3e0 con 0x7f99e0105930 2023-07-14T18:11:31.750 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:31.707+0000 7f99e64f2700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99e019d520 con 0x7f99e0103010 2023-07-14T18:11:31.750 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:31.707+0000 7f99e64f2700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99e019d6b0 con 0x7f99e01006f0 2023-07-14T18:11:31.750 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:31.707+0000 7f99e4a8f700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f99e0105930 0x7f99e019ce10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:11:31.751 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:31.707+0000 7f99e4a8f700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f99e0105930 0x7f99e019ce10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:56284/0 (socket says 172.21.15.163:56284) 2023-07-14T18:11:31.751 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:31.707+0000 7f99e4a8f700 1 -- 172.21.15.163:0/2295748080 learned_addr learned my addr 172.21.15.163:0/2295748080 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:11:31.751 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:31.707+0000 7f99dffff700 1 --2- 172.21.15.163:0/2295748080 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f99e01006f0 0x7f99e0195860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:11:31.751 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:31.708+0000 7f99df7fe700 1 --2- 172.21.15.163:0/2295748080 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f99e0103010 0x7f99e0195da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:11:31.751 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:31.708+0000 7f99e4a8f700 1 -- 172.21.15.163:0/2295748080 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f99e01006f0 msgr2=0x7f99e0195860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:11:31.751 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:31.708+0000 7f99e4a8f700 1 --2- 172.21.15.163:0/2295748080 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f99e01006f0 0x7f99e0195860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:31.751 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:31.708+0000 7f99e4a8f700 1 -- 172.21.15.163:0/2295748080 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f99e0103010 msgr2=0x7f99e0195da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:11:31.751 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:31.708+0000 7f99e4a8f700 1 --2- 172.21.15.163:0/2295748080 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f99e0103010 0x7f99e0195da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:31.752 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:31.708+0000 7f99e4a8f700 1 -- 172.21.15.163:0/2295748080 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99c80095f0 con 0x7f99e0105930 2023-07-14T18:11:31.752 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:31.708+0000 7f99e4a8f700 1 --2- 172.21.15.163:0/2295748080 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f99e0105930 0x7f99e019ce10 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f99d800ef30 tx=0x7f99d800c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:11:31.752 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:31.708+0000 7f99dd7fa700 1 -- 172.21.15.163:0/2295748080 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99d8018070 con 0x7f99e0105930 2023-07-14T18:11:31.752 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:31.708+0000 7f99e64f2700 1 -- 172.21.15.163:0/2295748080 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f99e019d930 con 0x7f99e0105930 2023-07-14T18:11:31.752 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:31.708+0000 7f99dd7fa700 1 -- 172.21.15.163:0/2295748080 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f99d800f040 con 0x7f99e0105930 2023-07-14T18:11:31.752 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:31.708+0000 7f99dd7fa700 1 -- 172.21.15.163:0/2295748080 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99d800cc30 con 0x7f99e0105930 2023-07-14T18:11:31.752 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:31.708+0000 7f99e64f2700 1 -- 172.21.15.163:0/2295748080 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99e019de90 con 0x7f99e0105930 2023-07-14T18:11:31.753 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:31.709+0000 7f99e64f2700 1 -- 172.21.15.163:0/2295748080 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f99e010b2a0 con 0x7f99e0105930 2023-07-14T18:11:31.753 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:31.710+0000 7f99dd7fa700 1 -- 172.21.15.163:0/2295748080 <== mon.0 v2:172.21.15.163:3300/0 4 ==== mgrmap(e 16) v1 ==== 135716+0+0 (secure 0 0 0) 0x7f99d8007500 con 0x7f99e0105930 2023-07-14T18:11:31.754 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:31.711+0000 7f99dd7fa700 1 --2- 172.21.15.163:0/2295748080 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f99cc0a11d0 0x7f99cc0a3680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:11:31.754 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:31.711+0000 7f99dffff700 1 --2- 172.21.15.163:0/2295748080 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f99cc0a11d0 0x7f99cc0a3680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:11:31.754 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:31.711+0000 7f99dd7fa700 1 -- 172.21.15.163:0/2295748080 <== mon.0 v2:172.21.15.163:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 8730+0+0 (secure 0 0 0) 0x7f99d80cc5e0 con 0x7f99e0105930 2023-07-14T18:11:31.754 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:31.711+0000 7f99dffff700 1 --2- 172.21.15.163:0/2295748080 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f99cc0a11d0 0x7f99cc0a3680 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f99c8006010 tx=0x7f99c8005960 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:11:31.755 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:31.715+0000 7f99dd7fa700 1 -- 172.21.15.163:0/2295748080 <== mon.0 v2:172.21.15.163:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178025 (secure 0 0 0) 0x7f99d8099600 con 0x7f99e0105930 2023-07-14T18:11:31.881 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:31.841+0000 7f99dd7fa700 1 -- 172.21.15.163:0/2295748080 <== mon.0 v2:172.21.15.163:3300/0 7 ==== mgrmap(e 17) v1 ==== 135767+0+0 (secure 0 0 0) 0x7f99d8095f40 con 0x7f99e0105930 2023-07-14T18:11:31.988 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:31.948+0000 7f99e64f2700 1 -- 172.21.15.163:0/2295748080 --> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "sv_1", "target": ["mon-mgr", ""]}) v1 -- 0x7f99e01022b0 con 0x7f99cc0a11d0 2023-07-14T18:11:31.991 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:31.952+0000 7f99dd7fa700 1 -- 172.21.15.163:0/2295748080 <== mgr.14152 v2:172.21.15.163:6800/1949590926 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+60 (secure 0 0 0) 0x7f99e01022b0 con 0x7f99cc0a11d0 2023-07-14T18:11:31.992 INFO:teuthology.orchestra.run.smithi163.stdout:/volumes/_nogroup/sv_1/6e382ecc-947b-4fbb-baa5-aa139f9c16ba 2023-07-14T18:11:31.994 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:31.954+0000 7f99e64f2700 1 -- 172.21.15.163:0/2295748080 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f99cc0a11d0 msgr2=0x7f99cc0a3680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:11:31.994 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:31.954+0000 7f99e64f2700 1 --2- 172.21.15.163:0/2295748080 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f99cc0a11d0 0x7f99cc0a3680 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f99c8006010 tx=0x7f99c8005960 comp rx=0 tx=0).stop 2023-07-14T18:11:31.994 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:31.954+0000 7f99e64f2700 1 -- 172.21.15.163:0/2295748080 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f99e0105930 msgr2=0x7f99e019ce10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:11:31.994 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:31.954+0000 7f99e64f2700 1 --2- 172.21.15.163:0/2295748080 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f99e0105930 0x7f99e019ce10 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f99d800ef30 tx=0x7f99d800c3a0 comp rx=0 tx=0).stop 2023-07-14T18:11:31.994 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:31.954+0000 7f99e64f2700 1 -- 172.21.15.163:0/2295748080 shutdown_connections 2023-07-14T18:11:31.994 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:31.954+0000 7f99e64f2700 1 --2- 172.21.15.163:0/2295748080 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f99cc0a11d0 0x7f99cc0a3680 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:31.995 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:31.954+0000 7f99e64f2700 1 --2- 172.21.15.163:0/2295748080 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f99e01006f0 0x7f99e0195860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:31.995 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:31.954+0000 7f99e64f2700 1 --2- 172.21.15.163:0/2295748080 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f99e0105930 0x7f99e019ce10 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:31.995 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:31.954+0000 7f99e64f2700 1 --2- 172.21.15.163:0/2295748080 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f99e0103010 0x7f99e0195da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:31.995 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:31.954+0000 7f99e64f2700 1 -- 172.21.15.163:0/2295748080 >> 172.21.15.163:0/2295748080 conn(0x7f99e00fa130 msgr2=0x7f99e0101ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:11:31.995 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:31.954+0000 7f99e64f2700 1 -- 172.21.15.163:0/2295748080 shutdown_connections 2023-07-14T18:11:31.995 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:31.954+0000 7f99e64f2700 1 -- 172.21.15.163:0/2295748080 wait complete. 2023-07-14T18:11:32.006 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-14T18:11:32.128 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:32.088+0000 7f8318ce0700 1 -- 172.21.15.163:0/2001006497 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f83140ffcf0 msgr2=0x7f8314100140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:11:32.129 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:32.088+0000 7f8318ce0700 1 --2- 172.21.15.163:0/2001006497 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f83140ffcf0 0x7f8314100140 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f82fc009990 tx=0x7f82fc009ca0 comp rx=0 tx=0).stop 2023-07-14T18:11:32.129 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:32.088+0000 7f8318ce0700 1 -- 172.21.15.163:0/2001006497 shutdown_connections 2023-07-14T18:11:32.129 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:32.088+0000 7f8318ce0700 1 --2- 172.21.15.163:0/2001006497 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f83140feb00 0x7f83140fef10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:32.129 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:32.088+0000 7f8318ce0700 1 --2- 172.21.15.163:0/2001006497 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8314100680 0x7f8314106f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:32.129 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:32.088+0000 7f8318ce0700 1 --2- 172.21.15.163:0/2001006497 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f83140ffcf0 0x7f8314100140 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:32.129 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:32.088+0000 7f8318ce0700 1 -- 172.21.15.163:0/2001006497 >> 172.21.15.163:0/2001006497 conn(0x7f83140fa100 msgr2=0x7f83140fc550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:11:32.130 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:32.088+0000 7f8318ce0700 1 -- 172.21.15.163:0/2001006497 shutdown_connections 2023-07-14T18:11:32.130 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:32.088+0000 7f8318ce0700 1 -- 172.21.15.163:0/2001006497 wait complete. 2023-07-14T18:11:32.131 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:32.089+0000 7f8318ce0700 1 Processor -- start 2023-07-14T18:11:32.132 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:32.089+0000 7f8318ce0700 1 -- start start 2023-07-14T18:11:32.132 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:32.090+0000 7f8318ce0700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f83140feb00 0x7f8314068330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:11:32.132 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:32.090+0000 7f8318ce0700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f83140ffcf0 0x7f831419a5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:11:32.132 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:32.090+0000 7f8318ce0700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f8314100680 0x7f831419cc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:11:32.132 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:32.090+0000 7f8318ce0700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f831419d3f0 con 0x7f8314100680 2023-07-14T18:11:32.132 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:32.090+0000 7f8318ce0700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f831419d560 con 0x7f83140feb00 2023-07-14T18:11:32.132 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:32.090+0000 7f8318ce0700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f831419d720 con 0x7f83140ffcf0 2023-07-14T18:11:32.133 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:32.090+0000 7f8312d9d700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f8314100680 0x7f831419cc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:11:32.133 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:32.090+0000 7f8312d9d700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f8314100680 0x7f831419cc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:56312/0 (socket says 172.21.15.163:56312) 2023-07-14T18:11:32.133 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:32.090+0000 7f8312d9d700 1 -- 172.21.15.163:0/2129768535 learned_addr learned my addr 172.21.15.163:0/2129768535 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:11:32.133 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:32.090+0000 7f831259c700 1 --2- 172.21.15.163:0/2129768535 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f83140feb00 0x7f8314068330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:11:32.133 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:32.090+0000 7f8311d9b700 1 --2- 172.21.15.163:0/2129768535 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f83140ffcf0 0x7f831419a5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:11:32.133 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:32.090+0000 7f8312d9d700 1 -- 172.21.15.163:0/2129768535 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f83140ffcf0 msgr2=0x7f831419a5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:11:32.133 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:32.090+0000 7f8312d9d700 1 --2- 172.21.15.163:0/2129768535 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f83140ffcf0 0x7f831419a5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:32.133 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:32.090+0000 7f8312d9d700 1 -- 172.21.15.163:0/2129768535 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f83140feb00 msgr2=0x7f8314068330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:11:32.134 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:32.090+0000 7f8312d9d700 1 --2- 172.21.15.163:0/2129768535 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f83140feb00 0x7f8314068330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:32.134 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:32.090+0000 7f8312d9d700 1 -- 172.21.15.163:0/2129768535 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82fc0095f0 con 0x7f8314100680 2023-07-14T18:11:32.134 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:32.090+0000 7f831259c700 1 --2- 172.21.15.163:0/2129768535 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f83140feb00 0x7f8314068330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T18:11:32.134 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:32.090+0000 7f8312d9d700 1 --2- 172.21.15.163:0/2129768535 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f8314100680 0x7f831419cc20 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f830c00ada0 tx=0x7f830c00c330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:11:32.134 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:32.090+0000 7f830b7fe700 1 -- 172.21.15.163:0/2129768535 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f830c00f070 con 0x7f8314100680 2023-07-14T18:11:32.134 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:32.090+0000 7f830b7fe700 1 -- 172.21.15.163:0/2129768535 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f830c007b30 con 0x7f8314100680 2023-07-14T18:11:32.134 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:32.090+0000 7f8318ce0700 1 -- 172.21.15.163:0/2129768535 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f831419da00 con 0x7f8314100680 2023-07-14T18:11:32.134 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:32.090+0000 7f830b7fe700 1 -- 172.21.15.163:0/2129768535 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f830c005280 con 0x7f8314100680 2023-07-14T18:11:32.135 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:32.090+0000 7f8318ce0700 1 -- 172.21.15.163:0/2129768535 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f831419de90 con 0x7f8314100680 2023-07-14T18:11:32.135 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:32.091+0000 7f8318ce0700 1 -- 172.21.15.163:0/2129768535 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8314106140 con 0x7f8314100680 2023-07-14T18:11:32.135 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:32.092+0000 7f830b7fe700 1 -- 172.21.15.163:0/2129768535 <== mon.0 v2:172.21.15.163:3300/0 4 ==== mgrmap(e 17) v1 ==== 135767+0+0 (secure 0 0 0) 0x7f830c00c980 con 0x7f8314100680 2023-07-14T18:11:32.136 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:32.093+0000 7f830b7fe700 1 --2- 172.21.15.163:0/2129768535 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f83000a1220 0x7f83000a36d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:11:32.136 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:32.093+0000 7f831259c700 1 --2- 172.21.15.163:0/2129768535 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f83000a1220 0x7f83000a36d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:11:32.136 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:32.093+0000 7f830b7fe700 1 -- 172.21.15.163:0/2129768535 <== mon.0 v2:172.21.15.163:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 8730+0+0 (secure 0 0 0) 0x7f830c0cc840 con 0x7f8314100680 2023-07-14T18:11:32.136 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:32.093+0000 7f831259c700 1 --2- 172.21.15.163:0/2129768535 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f83000a1220 0x7f83000a36d0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f8304005950 tx=0x7f83040058e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:11:32.136 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:32.096+0000 7f830b7fe700 1 -- 172.21.15.163:0/2129768535 <== mon.0 v2:172.21.15.163:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178025 (secure 0 0 0) 0x7f830c095cd0 con 0x7f8314100680 2023-07-14T18:11:32.367 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:32.327+0000 7f8318ce0700 1 -- 172.21.15.163:0/2129768535 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f831402c8e0 con 0x7f8314100680 2023-07-14T18:11:32.368 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:32.327+0000 7f830b7fe700 1 -- 172.21.15.163:0/2129768535 <== mon.0 v2:172.21.15.163:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) v1 ==== 94+0+10899 (secure 0 0 0) 0x7f830c00cc30 con 0x7f8314100680 2023-07-14T18:11:32.369 INFO:teuthology.orchestra.run.smithi163.stdout: 2023-07-14T18:11:32.369 INFO:teuthology.orchestra.run.smithi163.stdout:{"epoch":28,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14562,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.163:6835/1058662632","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6834","nonce":1058662632},{"type":"v1","addr":"172.21.15.163:6835","nonce":1058662632}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":14568,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.163:6837/1107244425","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6836","nonce":1107244425},{"type":"v1","addr":"172.21.15.163:6837","nonce":1107244425}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":28,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-07-14T18:11:09.109693+0000","modified":"2023-07-14T18:11:31.766338+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24518,"mds_1":24493,"mds_2":24479,"mds_3":24478,"mds_4":14652},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14640":{"gid":14640,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.163:6839/1337572937","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6838","nonce":1337572937},{"type":"v1","addr":"172.21.15.163:6839","nonce":1337572937}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_14652":{"gid":14652,"name":"a","rank":4,"incarnation":26,"state":"up:active","state_seq":9,"addr":"172.21.15.163:6841/1032082642","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6840","nonce":1032082642},{"type":"v1","addr":"172.21.15.163:6841","nonce":1032082642}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24421":{"gid":24421,"name":"l","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.184:6833/797722972","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6832","nonce":797722972},{"type":"v1","addr":"172.21.15.184:6833","nonce":797722972}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24431":{"gid":24431,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6833/1075696311","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":1075696311},{"type":"v1","addr":"172.21.15.172:6833","nonce":1075696311}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24458":{"gid":24458,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6835/1158120127","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":1158120127},{"type":"v1","addr":"172.21.15.172:6835","nonce":1158120127}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24466":{"gid":24466,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.184:6835/460134263","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6834","nonce":460134263},{"type":"v1","addr":"172.21.15.184:6835","nonce":460134263}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24478":{"gid":24478,"name":"c","rank":3,"incarnation":24,"state":"up:active","state_seq":11,"addr":"172.21.15.184:6837/3389277679","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6836","nonce":3389277679},{"type":"v1","addr":"172.21.15.184:6837","nonce":3389277679}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24479":{"gid":24479,"name":"h","rank":2,"incarnation":22,"state":"up:active","state_seq":10,"addr":"172.21.15.172:6837/3783835012","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":3783835012},{"type":"v1","addr":"172.21.15.172:6837","nonce":3783835012}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24493":{"gid":24493,"name":"i","rank":1,"incarnation":20,"state":"up:active","state_seq":9,"addr":"172.21.15.184:6839/2819059257","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6838","nonce":2819059257},{"type":"v1","addr":"172.21.15.184:6839","nonce":2819059257}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24518":{"gid":24518,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.172:6839/3850440096","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6838","nonce":3850440096},{"type":"v1","addr":"172.21.15.172:6839","nonce":3850440096}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-07-14T18:11:32.371 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:32.329+0000 7f8318ce0700 1 -- 172.21.15.163:0/2129768535 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f83000a1220 msgr2=0x7f83000a36d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:11:32.371 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:32.329+0000 7f8318ce0700 1 --2- 172.21.15.163:0/2129768535 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f83000a1220 0x7f83000a36d0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f8304005950 tx=0x7f83040058e0 comp rx=0 tx=0).stop 2023-07-14T18:11:32.371 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:32.329+0000 7f8318ce0700 1 -- 172.21.15.163:0/2129768535 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f8314100680 msgr2=0x7f831419cc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:11:32.372 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:32.329+0000 7f8318ce0700 1 --2- 172.21.15.163:0/2129768535 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f8314100680 0x7f831419cc20 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f830c00ada0 tx=0x7f830c00c330 comp rx=0 tx=0).stop 2023-07-14T18:11:32.372 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:32.329+0000 7f8318ce0700 1 -- 172.21.15.163:0/2129768535 shutdown_connections 2023-07-14T18:11:32.372 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:32.329+0000 7f8318ce0700 1 --2- 172.21.15.163:0/2129768535 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f83000a1220 0x7f83000a36d0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:32.372 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:32.329+0000 7f8318ce0700 1 --2- 172.21.15.163:0/2129768535 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f8314100680 0x7f831419cc20 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:32.373 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:32.329+0000 7f8318ce0700 1 --2- 172.21.15.163:0/2129768535 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f83140feb00 0x7f8314068330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:32.373 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:32.329+0000 7f8318ce0700 1 --2- 172.21.15.163:0/2129768535 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f83140ffcf0 0x7f831419a5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:32.373 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:32.329+0000 7f8318ce0700 1 -- 172.21.15.163:0/2129768535 >> 172.21.15.163:0/2129768535 conn(0x7f83140fa100 msgr2=0x7f8314103280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:11:32.374 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:32.330+0000 7f8318ce0700 1 -- 172.21.15.163:0/2129768535 shutdown_connections 2023-07-14T18:11:32.374 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:32.330+0000 7f8318ce0700 1 -- 172.21.15.163:0/2129768535 wait complete. 2023-07-14T18:11:32.374 INFO:teuthology.orchestra.run.smithi163.stderr:dumped fsmap epoch 28 2023-07-14T18:11:32.382 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-14T18:11:32.504 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:32.464+0000 7f913dde2700 1 -- 172.21.15.163:0/906534953 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9138100e20 msgr2=0x7f9138101270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:11:32.505 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:32.464+0000 7f913dde2700 1 --2- 172.21.15.163:0/906534953 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9138100e20 0x7f9138101270 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f9128009990 tx=0x7f9128009ca0 comp rx=0 tx=0).stop 2023-07-14T18:11:32.505 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:32.464+0000 7f913dde2700 1 -- 172.21.15.163:0/906534953 shutdown_connections 2023-07-14T18:11:32.505 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:32.464+0000 7f913dde2700 1 --2- 172.21.15.163:0/906534953 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f91381017b0 0x7f9138108070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:32.505 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:32.464+0000 7f913dde2700 1 --2- 172.21.15.163:0/906534953 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f91380ffc30 0x7f9138100040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:32.505 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:32.464+0000 7f913dde2700 1 --2- 172.21.15.163:0/906534953 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9138100e20 0x7f9138101270 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:32.505 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:32.464+0000 7f913dde2700 1 -- 172.21.15.163:0/906534953 >> 172.21.15.163:0/906534953 conn(0x7f91380fb210 msgr2=0x7f91380fd680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:11:32.506 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:32.464+0000 7f913dde2700 1 -- 172.21.15.163:0/906534953 shutdown_connections 2023-07-14T18:11:32.506 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:32.464+0000 7f913dde2700 1 -- 172.21.15.163:0/906534953 wait complete. 2023-07-14T18:11:32.506 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:32.465+0000 7f913dde2700 1 Processor -- start 2023-07-14T18:11:32.508 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:32.465+0000 7f913dde2700 1 -- start start 2023-07-14T18:11:32.509 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:32.465+0000 7f913dde2700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f91380ffc30 0x7f91381957e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:11:32.509 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:32.465+0000 7f913dde2700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9138100e20 0x7f9138195d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:11:32.509 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:32.465+0000 7f913dde2700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f91381017b0 0x7f913819cd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:11:32.509 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:32.465+0000 7f913dde2700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f913819d360 con 0x7f91380ffc30 2023-07-14T18:11:32.509 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:32.465+0000 7f913dde2700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f913819d4a0 con 0x7f9138100e20 2023-07-14T18:11:32.510 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:32.465+0000 7f913dde2700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f913819d630 con 0x7f91381017b0 2023-07-14T18:11:32.510 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:32.465+0000 7f91377fe700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f91380ffc30 0x7f91381957e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:11:32.510 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:32.465+0000 7f91377fe700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f91380ffc30 0x7f91381957e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:56322/0 (socket says 172.21.15.163:56322) 2023-07-14T18:11:32.510 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:32.465+0000 7f91377fe700 1 -- 172.21.15.163:0/3097050259 learned_addr learned my addr 172.21.15.163:0/3097050259 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:11:32.510 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:32.466+0000 7f9136ffd700 1 --2- 172.21.15.163:0/3097050259 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9138100e20 0x7f9138195d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:11:32.510 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:32.466+0000 7f91377fe700 1 -- 172.21.15.163:0/3097050259 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f91381017b0 msgr2=0x7f913819cd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:11:32.511 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:32.466+0000 7f91377fe700 1 --2- 172.21.15.163:0/3097050259 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f91381017b0 0x7f913819cd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:32.511 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:32.466+0000 7f91377fe700 1 -- 172.21.15.163:0/3097050259 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9138100e20 msgr2=0x7f9138195d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:11:32.511 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:32.466+0000 7f91377fe700 1 --2- 172.21.15.163:0/3097050259 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9138100e20 0x7f9138195d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:32.511 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:32.466+0000 7f91377fe700 1 -- 172.21.15.163:0/3097050259 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91280095f0 con 0x7f91380ffc30 2023-07-14T18:11:32.511 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:32.466+0000 7f91377fe700 1 --2- 172.21.15.163:0/3097050259 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f91380ffc30 0x7f91381957e0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f912c00e8d0 tx=0x7f912c00ec90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:11:32.511 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:32.466+0000 7f9134ff9700 1 -- 172.21.15.163:0/3097050259 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f912c009770 con 0x7f91380ffc30 2023-07-14T18:11:32.512 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:32.466+0000 7f9134ff9700 1 -- 172.21.15.163:0/3097050259 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f912c00eed0 con 0x7f91380ffc30 2023-07-14T18:11:32.512 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:32.466+0000 7f913dde2700 1 -- 172.21.15.163:0/3097050259 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f913819d910 con 0x7f91380ffc30 2023-07-14T18:11:32.512 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:32.466+0000 7f9134ff9700 1 -- 172.21.15.163:0/3097050259 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f912c003c90 con 0x7f91380ffc30 2023-07-14T18:11:32.512 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:32.466+0000 7f913dde2700 1 -- 172.21.15.163:0/3097050259 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f913819ddd0 con 0x7f91380ffc30 2023-07-14T18:11:32.513 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:32.467+0000 7f913dde2700 1 -- 172.21.15.163:0/3097050259 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f913810b270 con 0x7f91380ffc30 2023-07-14T18:11:32.513 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:32.468+0000 7f9134ff9700 1 -- 172.21.15.163:0/3097050259 <== mon.0 v2:172.21.15.163:3300/0 4 ==== mgrmap(e 17) v1 ==== 135767+0+0 (secure 0 0 0) 0x7f912c003e10 con 0x7f91380ffc30 2023-07-14T18:11:32.513 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:32.469+0000 7f9134ff9700 1 --2- 172.21.15.163:0/3097050259 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f91200a1220 0x7f91200a36d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:11:32.513 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:32.469+0000 7f9136ffd700 1 --2- 172.21.15.163:0/3097050259 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f91200a1220 0x7f91200a36d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:11:32.514 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:32.469+0000 7f9134ff9700 1 -- 172.21.15.163:0/3097050259 <== mon.0 v2:172.21.15.163:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 8730+0+0 (secure 0 0 0) 0x7f912c014070 con 0x7f91380ffc30 2023-07-14T18:11:32.514 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:32.469+0000 7f9136ffd700 1 --2- 172.21.15.163:0/3097050259 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f91200a1220 0x7f91200a36d0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f912800b2e0 tx=0x7f9128005e80 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:11:32.515 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:32.472+0000 7f9134ff9700 1 -- 172.21.15.163:0/3097050259 <== mon.0 v2:172.21.15.163:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178025 (secure 0 0 0) 0x7f912c096430 con 0x7f91380ffc30 2023-07-14T18:11:32.703 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:32.663+0000 7f913dde2700 1 -- 172.21.15.163:0/3097050259 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f913810b460 con 0x7f91380ffc30 2023-07-14T18:11:32.704 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:32.664+0000 7f9134ff9700 1 -- 172.21.15.163:0/3097050259 <== mon.0 v2:172.21.15.163:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v84) v1 ==== 74+0+24030 (secure 0 0 0) 0x7f912c099a50 con 0x7f91380ffc30 2023-07-14T18:11:32.705 INFO:teuthology.orchestra.run.smithi163.stdout: 2023-07-14T18:11:32.705 INFO:teuthology.orchestra.run.smithi163.stdout:{"epoch":84,"fsid":"bf7326ec-2270-11ee-9b33-001a4aab830c","created":"2023-07-14T18:04:26.263517+0000","modified":"2023-07-14T18:11:14.170253+0000","last_up_change":"2023-07-14T18:10:27.514863+0000","last_in_change":"2023-07-14T18:10:10.726443+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-14T18:07:19.653852+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-07-14T18:11:07.314989+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-07-14T18:11:08.274627+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-07-14T18:11:11.991162+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"e6490568-046d-43ef-bb07-d79fb884b276","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6802","nonce":3124653025},{"type":"v1","addr":"172.21.15.163:6803","nonce":3124653025}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6804","nonce":3124653025},{"type":"v1","addr":"172.21.15.163:6805","nonce":3124653025}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6808","nonce":3124653025},{"type":"v1","addr":"172.21.15.163:6809","nonce":3124653025}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6806","nonce":3124653025},{"type":"v1","addr":"172.21.15.163:6807","nonce":3124653025}]},"public_addr":"172.21.15.163:6803/3124653025","cluster_addr":"172.21.15.163:6805/3124653025","heartbeat_back_addr":"172.21.15.163:6809/3124653025","heartbeat_front_addr":"172.21.15.163:6807/3124653025","state":["exists","up"]},{"osd":1,"uuid":"0af39bda-f096-4603-adcc-bf1988f36603","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":3774455900},{"type":"v1","addr":"172.21.15.172:6801","nonce":3774455900}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":3774455900},{"type":"v1","addr":"172.21.15.172:6803","nonce":3774455900}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":3774455900},{"type":"v1","addr":"172.21.15.172:6807","nonce":3774455900}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":3774455900},{"type":"v1","addr":"172.21.15.172:6805","nonce":3774455900}]},"public_addr":"172.21.15.172:6801/3774455900","cluster_addr":"172.21.15.172:6803/3774455900","heartbeat_back_addr":"172.21.15.172:6807/3774455900","heartbeat_front_addr":"172.21.15.172:6805/3774455900","state":["exists","up"]},{"osd":2,"uuid":"cc732c13-af0f-4199-98e6-fe960ed4e5dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":1976927678},{"type":"v1","addr":"172.21.15.184:6801","nonce":1976927678}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":1976927678},{"type":"v1","addr":"172.21.15.184:6803","nonce":1976927678}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":1976927678},{"type":"v1","addr":"172.21.15.184:6807","nonce":1976927678}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":1976927678},{"type":"v1","addr":"172.21.15.184:6805","nonce":1976927678}]},"public_addr":"172.21.15.184:6801/1976927678","cluster_addr":"172.21.15.184:6803/1976927678","heartbeat_back_addr":"172.21.15.184:6807/1976927678","heartbeat_front_addr":"172.21.15.184:6805/1976927678","state":["exists","up"]},{"osd":3,"uuid":"dcee9576-0bc6-4ab0-8f63-79eacd0eca5f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6810","nonce":2589130694},{"type":"v1","addr":"172.21.15.163:6811","nonce":2589130694}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6812","nonce":2589130694},{"type":"v1","addr":"172.21.15.163:6813","nonce":2589130694}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6816","nonce":2589130694},{"type":"v1","addr":"172.21.15.163:6817","nonce":2589130694}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6814","nonce":2589130694},{"type":"v1","addr":"172.21.15.163:6815","nonce":2589130694}]},"public_addr":"172.21.15.163:6811/2589130694","cluster_addr":"172.21.15.163:6813/2589130694","heartbeat_back_addr":"172.21.15.163:6817/2589130694","heartbeat_front_addr":"172.21.15.163:6815/2589130694","state":["exists","up"]},{"osd":4,"uuid":"055df823-b8b0-426a-83c2-f0d727932ad8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":3319632614},{"type":"v1","addr":"172.21.15.172:6809","nonce":3319632614}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6810","nonce":3319632614},{"type":"v1","addr":"172.21.15.172:6811","nonce":3319632614}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6814","nonce":3319632614},{"type":"v1","addr":"172.21.15.172:6815","nonce":3319632614}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":3319632614},{"type":"v1","addr":"172.21.15.172:6813","nonce":3319632614}]},"public_addr":"172.21.15.172:6809/3319632614","cluster_addr":"172.21.15.172:6811/3319632614","heartbeat_back_addr":"172.21.15.172:6815/3319632614","heartbeat_front_addr":"172.21.15.172:6813/3319632614","state":["exists","up"]},{"osd":5,"uuid":"ef5ef02a-b4e2-4790-9d27-f6d2247b25c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":2662084043},{"type":"v1","addr":"172.21.15.184:6809","nonce":2662084043}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6810","nonce":2662084043},{"type":"v1","addr":"172.21.15.184:6811","nonce":2662084043}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6814","nonce":2662084043},{"type":"v1","addr":"172.21.15.184:6815","nonce":2662084043}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6812","nonce":2662084043},{"type":"v1","addr":"172.21.15.184:6813","nonce":2662084043}]},"public_addr":"172.21.15.184:6809/2662084043","cluster_addr":"172.21.15.184:6811/2662084043","heartbeat_back_addr":"172.21.15.184:6815/2662084043","heartbeat_front_addr":"172.21.15.184:6813/2662084043","state":["exists","up"]},{"osd":6,"uuid":"dba754be-0fc5-4867-a6d5-cf97eb344f81","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":44,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6818","nonce":2530874117},{"type":"v1","addr":"172.21.15.163:6819","nonce":2530874117}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6820","nonce":2530874117},{"type":"v1","addr":"172.21.15.163:6821","nonce":2530874117}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6824","nonce":2530874117},{"type":"v1","addr":"172.21.15.163:6825","nonce":2530874117}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6822","nonce":2530874117},{"type":"v1","addr":"172.21.15.163:6823","nonce":2530874117}]},"public_addr":"172.21.15.163:6819/2530874117","cluster_addr":"172.21.15.163:6821/2530874117","heartbeat_back_addr":"172.21.15.163:6825/2530874117","heartbeat_front_addr":"172.21.15.163:6823/2530874117","state":["exists","up"]},{"osd":7,"uuid":"edd76e6b-6077-4619-b00d-1e906f70ddcc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":49,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":233511803},{"type":"v1","addr":"172.21.15.172:6817","nonce":233511803}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6818","nonce":233511803},{"type":"v1","addr":"172.21.15.172:6819","nonce":233511803}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":233511803},{"type":"v1","addr":"172.21.15.172:6823","nonce":233511803}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6820","nonce":233511803},{"type":"v1","addr":"172.21.15.172:6821","nonce":233511803}]},"public_addr":"172.21.15.172:6817/233511803","cluster_addr":"172.21.15.172:6819/233511803","heartbeat_back_addr":"172.21.15.172:6823/233511803","heartbeat_front_addr":"172.21.15.172:6821/233511803","state":["exists","up"]},{"osd":8,"uuid":"36559400-f33e-44e6-868a-316d34da457d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":56,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6816","nonce":290154343},{"type":"v1","addr":"172.21.15.184:6817","nonce":290154343}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6818","nonce":290154343},{"type":"v1","addr":"172.21.15.184:6819","nonce":290154343}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6822","nonce":290154343},{"type":"v1","addr":"172.21.15.184:6823","nonce":290154343}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6820","nonce":290154343},{"type":"v1","addr":"172.21.15.184:6821","nonce":290154343}]},"public_addr":"172.21.15.184:6817/290154343","cluster_addr":"172.21.15.184:6819/290154343","heartbeat_back_addr":"172.21.15.184:6823/290154343","heartbeat_front_addr":"172.21.15.184:6821/290154343","state":["exists","up"]},{"osd":9,"uuid":"d484f111-f36c-4c67-9a8a-ae03e7e0d137","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6826","nonce":3848110906},{"type":"v1","addr":"172.21.15.163:6827","nonce":3848110906}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6828","nonce":3848110906},{"type":"v1","addr":"172.21.15.163:6829","nonce":3848110906}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6832","nonce":3848110906},{"type":"v1","addr":"172.21.15.163:6833","nonce":3848110906}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6830","nonce":3848110906},{"type":"v1","addr":"172.21.15.163:6831","nonce":3848110906}]},"public_addr":"172.21.15.163:6827/3848110906","cluster_addr":"172.21.15.163:6829/3848110906","heartbeat_back_addr":"172.21.15.163:6833/3848110906","heartbeat_front_addr":"172.21.15.163:6831/3848110906","state":["exists","up"]},{"osd":10,"uuid":"d943f7c0-da3d-4605-9e23-0231e675c6be","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6824","nonce":3281085356},{"type":"v1","addr":"172.21.15.172:6825","nonce":3281085356}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":3281085356},{"type":"v1","addr":"172.21.15.172:6827","nonce":3281085356}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":3281085356},{"type":"v1","addr":"172.21.15.172:6831","nonce":3281085356}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6828","nonce":3281085356},{"type":"v1","addr":"172.21.15.172:6829","nonce":3281085356}]},"public_addr":"172.21.15.172:6825/3281085356","cluster_addr":"172.21.15.172:6827/3281085356","heartbeat_back_addr":"172.21.15.172:6831/3281085356","heartbeat_front_addr":"172.21.15.172:6829/3281085356","state":["exists","up"]},{"osd":11,"uuid":"09e610a8-408a-4119-a21b-c4de2810a538","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":75,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6824","nonce":3614578747},{"type":"v1","addr":"172.21.15.184:6825","nonce":3614578747}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6826","nonce":3614578747},{"type":"v1","addr":"172.21.15.184:6827","nonce":3614578747}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6830","nonce":3614578747},{"type":"v1","addr":"172.21.15.184:6831","nonce":3614578747}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6828","nonce":3614578747},{"type":"v1","addr":"172.21.15.184:6829","nonce":3614578747}]},"public_addr":"172.21.15.184:6825/3614578747","cluster_addr":"172.21.15.184:6827/3614578747","heartbeat_back_addr":"172.21.15.184:6831/3614578747","heartbeat_front_addr":"172.21.15.184:6829/3614578747","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T18:06:36.067578+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T18:06:57.095120+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T18:07:17.825363+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T18:07:38.977196+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T18:08:00.108709+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T18:08:20.700646+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T18:08:41.473899+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T18:09:02.856536+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T18:09:23.832722+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T18:09:44.860884+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T18:10:05.520678+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T18:10:26.426315+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.163:6801/1086512093":"2023-07-15T18:05:15.331458+0000","172.21.15.163:6800/1086512093":"2023-07-15T18:05:15.331458+0000","172.21.15.163:0/4235784810":"2023-07-15T18:05:15.331458+0000","172.21.15.163:6800/236891232":"2023-07-15T18:04:53.288443+0000","172.21.15.163:6801/236891232":"2023-07-15T18:04:53.288443+0000","172.21.15.163:0/3260193612":"2023-07-15T18:05:15.331458+0000","172.21.15.163:0/3513629472":"2023-07-15T18:04:53.288443+0000","172.21.15.163:0/1090329830":"2023-07-15T18:04:53.288443+0000","172.21.15.163:0/3868922045":"2023-07-15T18:05:15.331458+0000","172.21.15.163:0/2945662447":"2023-07-15T18:04:53.288443+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-14T18:11:32.707 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:32.667+0000 7f913dde2700 1 -- 172.21.15.163:0/3097050259 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f91200a1220 msgr2=0x7f91200a36d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:11:32.707 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:32.667+0000 7f913dde2700 1 --2- 172.21.15.163:0/3097050259 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f91200a1220 0x7f91200a36d0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f912800b2e0 tx=0x7f9128005e80 comp rx=0 tx=0).stop 2023-07-14T18:11:32.707 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:32.667+0000 7f913dde2700 1 -- 172.21.15.163:0/3097050259 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f91380ffc30 msgr2=0x7f91381957e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:11:32.707 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:32.667+0000 7f913dde2700 1 --2- 172.21.15.163:0/3097050259 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f91380ffc30 0x7f91381957e0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f912c00e8d0 tx=0x7f912c00ec90 comp rx=0 tx=0).stop 2023-07-14T18:11:32.707 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:32.667+0000 7f913dde2700 1 -- 172.21.15.163:0/3097050259 shutdown_connections 2023-07-14T18:11:32.707 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:32.667+0000 7f913dde2700 1 --2- 172.21.15.163:0/3097050259 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f91200a1220 0x7f91200a36d0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:32.708 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:32.667+0000 7f913dde2700 1 --2- 172.21.15.163:0/3097050259 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f91381017b0 0x7f913819cd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:32.708 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:32.667+0000 7f913dde2700 1 --2- 172.21.15.163:0/3097050259 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f91380ffc30 0x7f91381957e0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:32.708 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:32.667+0000 7f913dde2700 1 --2- 172.21.15.163:0/3097050259 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9138100e20 0x7f9138195d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:32.708 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:32.667+0000 7f913dde2700 1 -- 172.21.15.163:0/3097050259 >> 172.21.15.163:0/3097050259 conn(0x7f91380fb210 msgr2=0x7f91380fd480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:11:32.708 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:32.667+0000 7f913dde2700 1 -- 172.21.15.163:0/3097050259 shutdown_connections 2023-07-14T18:11:32.708 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:32.667+0000 7f913dde2700 1 -- 172.21.15.163:0/3097050259 wait complete. 2023-07-14T18:11:32.719 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-07-14T18:11:32.720 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-14T18:11:32.848 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:32.806+0000 7f30dfb8e700 1 -- 172.21.15.163:0/305345484 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f30d80ffc90 msgr2=0x7f30d81000e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:11:32.848 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:32.806+0000 7f30dfb8e700 1 --2- 172.21.15.163:0/305345484 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f30d80ffc90 0x7f30d81000e0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f30d4009990 tx=0x7f30d4009ca0 comp rx=0 tx=0).stop 2023-07-14T18:11:32.848 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:32.806+0000 7f30dfb8e700 1 -- 172.21.15.163:0/305345484 shutdown_connections 2023-07-14T18:11:32.848 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:32.806+0000 7f30dfb8e700 1 --2- 172.21.15.163:0/305345484 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f30d80feaa0 0x7f30d80feeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:32.849 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:32.806+0000 7f30dfb8e700 1 --2- 172.21.15.163:0/305345484 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f30d8100620 0x7f30d8106ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:32.849 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:32.806+0000 7f30dfb8e700 1 --2- 172.21.15.163:0/305345484 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f30d80ffc90 0x7f30d81000e0 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:32.849 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:32.806+0000 7f30dfb8e700 1 -- 172.21.15.163:0/305345484 >> 172.21.15.163:0/305345484 conn(0x7f30d80fa080 msgr2=0x7f30d80fc4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:11:32.849 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:32.806+0000 7f30dfb8e700 1 -- 172.21.15.163:0/305345484 shutdown_connections 2023-07-14T18:11:32.849 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:32.806+0000 7f30dfb8e700 1 -- 172.21.15.163:0/305345484 wait complete. 2023-07-14T18:11:32.849 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:32.807+0000 7f30dfb8e700 1 Processor -- start 2023-07-14T18:11:32.850 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:32.807+0000 7f30dfb8e700 1 -- start start 2023-07-14T18:11:32.850 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:32.807+0000 7f30dfb8e700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f30d80feaa0 0x7f30d8195790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:11:32.850 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:32.807+0000 7f30dfb8e700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f30d80ffc90 0x7f30d8195cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:11:32.850 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:32.807+0000 7f30dfb8e700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f30d8100620 0x7f30d819cd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:11:32.850 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:32.807+0000 7f30dfb8e700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30d819d310 con 0x7f30d80feaa0 2023-07-14T18:11:32.850 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:32.807+0000 7f30dfb8e700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30d819d450 con 0x7f30d80ffc90 2023-07-14T18:11:32.850 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:32.807+0000 7f30dfb8e700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30d819d5e0 con 0x7f30d8100620 2023-07-14T18:11:32.850 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:32.807+0000 7f30dd92a700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f30d80feaa0 0x7f30d8195790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:11:32.851 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:32.807+0000 7f30dd92a700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f30d80feaa0 0x7f30d8195790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:56336/0 (socket says 172.21.15.163:56336) 2023-07-14T18:11:32.851 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:32.807+0000 7f30dd92a700 1 -- 172.21.15.163:0/2807636706 learned_addr learned my addr 172.21.15.163:0/2807636706 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:11:32.851 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:32.807+0000 7f30de12b700 1 --2- 172.21.15.163:0/2807636706 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f30d8100620 0x7f30d819cd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:11:32.851 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:32.807+0000 7f30dd129700 1 --2- 172.21.15.163:0/2807636706 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f30d80ffc90 0x7f30d8195cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:11:32.851 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:32.808+0000 7f30dd92a700 1 -- 172.21.15.163:0/2807636706 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f30d8100620 msgr2=0x7f30d819cd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:11:32.851 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:32.808+0000 7f30dd92a700 1 --2- 172.21.15.163:0/2807636706 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f30d8100620 0x7f30d819cd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:32.851 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:32.808+0000 7f30dd92a700 1 -- 172.21.15.163:0/2807636706 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f30d80ffc90 msgr2=0x7f30d8195cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:11:32.852 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:32.808+0000 7f30dd92a700 1 --2- 172.21.15.163:0/2807636706 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f30d80ffc90 0x7f30d8195cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:32.852 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:32.808+0000 7f30dd92a700 1 -- 172.21.15.163:0/2807636706 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30d40095f0 con 0x7f30d80feaa0 2023-07-14T18:11:32.852 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:32.808+0000 7f30dd92a700 1 --2- 172.21.15.163:0/2807636706 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f30d80feaa0 0x7f30d8195790 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f30cc00d980 tx=0x7f30cc00dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:11:32.852 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:32.808+0000 7f30caffd700 1 -- 172.21.15.163:0/2807636706 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30cc00f890 con 0x7f30d80feaa0 2023-07-14T18:11:32.853 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:32.808+0000 7f30caffd700 1 -- 172.21.15.163:0/2807636706 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f30cc00fe80 con 0x7f30d80feaa0 2023-07-14T18:11:32.853 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:32.808+0000 7f30dfb8e700 1 -- 172.21.15.163:0/2807636706 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f30d819d8c0 con 0x7f30d80feaa0 2023-07-14T18:11:32.853 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:32.808+0000 7f30caffd700 1 -- 172.21.15.163:0/2807636706 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30cc019360 con 0x7f30d80feaa0 2023-07-14T18:11:32.853 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:32.808+0000 7f30dfb8e700 1 -- 172.21.15.163:0/2807636706 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f30d819de20 con 0x7f30d80feaa0 2023-07-14T18:11:32.854 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:32.809+0000 7f30dfb8e700 1 -- 172.21.15.163:0/2807636706 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f30d8106bd0 con 0x7f30d80feaa0 2023-07-14T18:11:32.854 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:32.810+0000 7f30caffd700 1 -- 172.21.15.163:0/2807636706 <== mon.0 v2:172.21.15.163:3300/0 4 ==== mgrmap(e 17) v1 ==== 135767+0+0 (secure 0 0 0) 0x7f30cc00f9f0 con 0x7f30d80feaa0 2023-07-14T18:11:32.854 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:32.810+0000 7f30caffd700 1 --2- 172.21.15.163:0/2807636706 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f30c40a12a0 0x7f30c40a3750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:11:32.855 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:32.810+0000 7f30dd129700 1 --2- 172.21.15.163:0/2807636706 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f30c40a12a0 0x7f30c40a3750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:11:32.855 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:32.810+0000 7f30caffd700 1 -- 172.21.15.163:0/2807636706 <== mon.0 v2:172.21.15.163:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 8730+0+0 (secure 0 0 0) 0x7f30cc0cc620 con 0x7f30d80feaa0 2023-07-14T18:11:32.855 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:32.811+0000 7f30dd129700 1 --2- 172.21.15.163:0/2807636706 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f30c40a12a0 0x7f30c40a3750 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f30d400c010 tx=0x7f30d4005960 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:11:32.855 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:32.815+0000 7f30caffd700 1 -- 172.21.15.163:0/2807636706 <== mon.0 v2:172.21.15.163:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178025 (secure 0 0 0) 0x7f30cc095a20 con 0x7f30d80feaa0 2023-07-14T18:11:33.039 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:32.999+0000 7f30dfb8e700 1 -- 172.21.15.163:0/2807636706 --> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f30d8060a80 con 0x7f30c40a12a0 2023-07-14T18:11:33.051 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:33.011+0000 7f30caffd700 1 -- 172.21.15.163:0/2807636706 <== mgr.14152 v2:172.21.15.163:6800/1949590926 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+417751 (secure 0 0 0) 0x7f30d8060a80 con 0x7f30c40a12a0 2023-07-14T18:11:33.057 INFO:teuthology.orchestra.run.smithi163.stdout: 2023-07-14T18:11:33.059 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:33.016+0000 7f30dfb8e700 1 -- 172.21.15.163:0/2807636706 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f30c40a12a0 msgr2=0x7f30c40a3750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:11:33.060 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:33.016+0000 7f30dfb8e700 1 --2- 172.21.15.163:0/2807636706 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f30c40a12a0 0x7f30c40a3750 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f30d400c010 tx=0x7f30d4005960 comp rx=0 tx=0).stop 2023-07-14T18:11:33.060 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:33.016+0000 7f30dfb8e700 1 -- 172.21.15.163:0/2807636706 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f30d80feaa0 msgr2=0x7f30d8195790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:11:33.060 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:33.016+0000 7f30dfb8e700 1 --2- 172.21.15.163:0/2807636706 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f30d80feaa0 0x7f30d8195790 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f30cc00d980 tx=0x7f30cc00dc90 comp rx=0 tx=0).stop 2023-07-14T18:11:33.060 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:33.016+0000 7f30dfb8e700 1 -- 172.21.15.163:0/2807636706 shutdown_connections 2023-07-14T18:11:33.060 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:33.016+0000 7f30dfb8e700 1 --2- 172.21.15.163:0/2807636706 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f30c40a12a0 0x7f30c40a3750 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:33.061 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:33.016+0000 7f30dfb8e700 1 --2- 172.21.15.163:0/2807636706 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f30d8100620 0x7f30d819cd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:33.061 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:33.016+0000 7f30dfb8e700 1 --2- 172.21.15.163:0/2807636706 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f30d80feaa0 0x7f30d8195790 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:33.061 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:33.016+0000 7f30dfb8e700 1 --2- 172.21.15.163:0/2807636706 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f30d80ffc90 0x7f30d8195cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:33.061 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:33.016+0000 7f30dfb8e700 1 -- 172.21.15.163:0/2807636706 >> 172.21.15.163:0/2807636706 conn(0x7f30d80fa080 msgr2=0x7f30d80fc340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:11:33.061 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:33.016+0000 7f30dfb8e700 1 -- 172.21.15.163:0/2807636706 shutdown_connections 2023-07-14T18:11:33.061 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:33.016+0000 7f30dfb8e700 1 -- 172.21.15.163:0/2807636706 wait complete. 2023-07-14T18:11:33.062 INFO:teuthology.orchestra.run.smithi163.stderr:dumped all 2023-07-14T18:11:33.067 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:11:32 smithi163 ceph-mon[96576]: from='client.14916 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2023-07-14T18:11:33.067 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:11:32 smithi163 ceph-mon[96576]: pgmap v262: 129 pgs: 129 active+clean; 583 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 597 B/s rd, 1.8 KiB/s wr, 7 op/s 2023-07-14T18:11:33.067 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:11:32 smithi163 ceph-mon[96576]: from='client.14922 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "", "target": ["mon-mgr", ""]}]: dispatch 2023-07-14T18:11:33.067 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:11:32 smithi163 ceph-mon[96576]: mds.? [v2:172.21.15.163:6840/1032082642,v1:172.21.15.163:6841/1032082642] up:active 2023-07-14T18:11:33.068 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:11:32 smithi163 ceph-mon[96576]: fsmap cephfs:5 4 up:standby-replay 3 up:standby 5 up:active 2023-07-14T18:11:33.068 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:11:32 smithi163 ceph-mon[96576]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-07-14T18:11:33.068 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:11:32 smithi163 ceph-mon[96576]: mgrmap e17: x(active, since 6m), standbys: z, y 2023-07-14T18:11:33.068 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:11:32 smithi163 ceph-mon[96576]: from='client.? 172.21.15.163:0/2129768535' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-07-14T18:11:33.068 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:11:32 smithi163 ceph-mon[96576]: from='client.? 172.21.15.163:0/3097050259' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-07-14T18:11:33.069 INFO:teuthology.orchestra.run.smithi163.stdout:{"pg_ready":true,"pg_map":{"version":262,"stamp":"2023-07-14T18:11:31.409422+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":597192,"num_objects":59,"num_object_clones":0,"num_object_copies":177,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":0,"num_read":133,"num_read_kb":116,"num_write":308,"num_write_kb":2974,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":38,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":246,"ondisk_log_size":246,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":419,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":336912,"kb_used_data":12696,"kb_used_omap":20,"kb_used_meta":324075,"kb_avail":1124604912,"statfs":{"total":1151940427776,"available":1151595429888,"internally_reserved":0,"allocated":13000704,"data_stored":7182219,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":21372,"internal_metadata":331852932},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":4462,"num_objects":35,"num_object_clones":0,"num_object_copies":105,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":82,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":24,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003446"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":20,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:11:15.117313+0000","last_change":"2023-07-14T18:11:09.713546+0000","last_active":"2023-07-14T18:11:15.117313+0000","last_peered":"2023-07-14T18:11:15.117313+0000","last_clean":"2023-07-14T18:11:15.117313+0000","last_became_active":"2023-07-14T18:11:09.713170+0000","last_became_peered":"2023-07-14T18:11:09.713170+0000","last_unstale":"2023-07-14T18:11:15.117313+0000","last_undegraded":"2023-07-14T18:11:15.117313+0000","last_fullsized":"2023-07-14T18:11:15.117313+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_clean_scrub_stamp":"2023-07-14T18:11:08.667354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T03:18:23.645436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":20,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:11:14.884660+0000","last_change":"2023-07-14T18:11:09.711619+0000","last_active":"2023-07-14T18:11:14.884660+0000","last_peered":"2023-07-14T18:11:14.884660+0000","last_clean":"2023-07-14T18:11:14.884660+0000","last_became_active":"2023-07-14T18:11:09.711249+0000","last_became_peered":"2023-07-14T18:11:09.711249+0000","last_unstale":"2023-07-14T18:11:14.884660+0000","last_undegraded":"2023-07-14T18:11:14.884660+0000","last_fullsized":"2023-07-14T18:11:14.884660+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_clean_scrub_stamp":"2023-07-14T18:11:08.667354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:15:46.939069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":20,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:11:14.884197+0000","last_change":"2023-07-14T18:11:09.705557+0000","last_active":"2023-07-14T18:11:14.884197+0000","last_peered":"2023-07-14T18:11:14.884197+0000","last_clean":"2023-07-14T18:11:14.884197+0000","last_became_active":"2023-07-14T18:11:09.705179+0000","last_became_peered":"2023-07-14T18:11:09.705179+0000","last_unstale":"2023-07-14T18:11:14.884197+0000","last_undegraded":"2023-07-14T18:11:14.884197+0000","last_fullsized":"2023-07-14T18:11:14.884197+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_clean_scrub_stamp":"2023-07-14T18:11:08.667354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:37:15.401517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":20,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:11:14.885864+0000","last_change":"2023-07-14T18:11:09.709234+0000","last_active":"2023-07-14T18:11:14.885864+0000","last_peered":"2023-07-14T18:11:14.885864+0000","last_clean":"2023-07-14T18:11:14.885864+0000","last_became_active":"2023-07-14T18:11:09.708855+0000","last_became_peered":"2023-07-14T18:11:09.708855+0000","last_unstale":"2023-07-14T18:11:14.885864+0000","last_undegraded":"2023-07-14T18:11:14.885864+0000","last_fullsized":"2023-07-14T18:11:14.885864+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_clean_scrub_stamp":"2023-07-14T18:11:08.667354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T03:28:37.657033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":20,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:11:14.884907+0000","last_change":"2023-07-14T18:11:09.704301+0000","last_active":"2023-07-14T18:11:14.884907+0000","last_peered":"2023-07-14T18:11:14.884907+0000","last_clean":"2023-07-14T18:11:14.884907+0000","last_became_active":"2023-07-14T18:11:09.703961+0000","last_became_peered":"2023-07-14T18:11:09.703961+0000","last_unstale":"2023-07-14T18:11:14.884907+0000","last_undegraded":"2023-07-14T18:11:14.884907+0000","last_fullsized":"2023-07-14T18:11:14.884907+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_clean_scrub_stamp":"2023-07-14T18:11:08.667354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T03:07:18.579761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":20,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:11:14.791451+0000","last_change":"2023-07-14T18:11:09.717667+0000","last_active":"2023-07-14T18:11:14.791451+0000","last_peered":"2023-07-14T18:11:14.791451+0000","last_clean":"2023-07-14T18:11:14.791451+0000","last_became_active":"2023-07-14T18:11:09.717146+0000","last_became_peered":"2023-07-14T18:11:09.717146+0000","last_unstale":"2023-07-14T18:11:14.791451+0000","last_undegraded":"2023-07-14T18:11:14.791451+0000","last_fullsized":"2023-07-14T18:11:14.791451+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_clean_scrub_stamp":"2023-07-14T18:11:08.667354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T05:43:55.497012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":18,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:11:14.884950+0000","last_change":"2023-07-14T18:11:09.713638+0000","last_active":"2023-07-14T18:11:14.884950+0000","last_peered":"2023-07-14T18:11:14.884950+0000","last_clean":"2023-07-14T18:11:14.884950+0000","last_became_active":"2023-07-14T18:11:09.707940+0000","last_became_peered":"2023-07-14T18:11:09.707940+0000","last_unstale":"2023-07-14T18:11:14.884950+0000","last_undegraded":"2023-07-14T18:11:14.884950+0000","last_fullsized":"2023-07-14T18:11:14.884950+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_clean_scrub_stamp":"2023-07-14T18:11:08.667354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:04:22.228548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":20,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:11:14.885659+0000","last_change":"2023-07-14T18:11:09.709804+0000","last_active":"2023-07-14T18:11:14.885659+0000","last_peered":"2023-07-14T18:11:14.885659+0000","last_clean":"2023-07-14T18:11:14.885659+0000","last_became_active":"2023-07-14T18:11:09.709385+0000","last_became_peered":"2023-07-14T18:11:09.709385+0000","last_unstale":"2023-07-14T18:11:14.885659+0000","last_undegraded":"2023-07-14T18:11:14.885659+0000","last_fullsized":"2023-07-14T18:11:14.885659+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_clean_scrub_stamp":"2023-07-14T18:11:08.667354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T05:15:54.972411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":20,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:11:14.885346+0000","last_change":"2023-07-14T18:11:09.710410+0000","last_active":"2023-07-14T18:11:14.885346+0000","last_peered":"2023-07-14T18:11:14.885346+0000","last_clean":"2023-07-14T18:11:14.885346+0000","last_became_active":"2023-07-14T18:11:09.710049+0000","last_became_peered":"2023-07-14T18:11:09.710049+0000","last_unstale":"2023-07-14T18:11:14.885346+0000","last_undegraded":"2023-07-14T18:11:14.885346+0000","last_fullsized":"2023-07-14T18:11:14.885346+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_clean_scrub_stamp":"2023-07-14T18:11:08.667354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:01:39.122213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":20,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:11:14.791867+0000","last_change":"2023-07-14T18:11:09.717681+0000","last_active":"2023-07-14T18:11:14.791867+0000","last_peered":"2023-07-14T18:11:14.791867+0000","last_clean":"2023-07-14T18:11:14.791867+0000","last_became_active":"2023-07-14T18:11:09.717209+0000","last_became_peered":"2023-07-14T18:11:09.717209+0000","last_unstale":"2023-07-14T18:11:14.791867+0000","last_undegraded":"2023-07-14T18:11:14.791867+0000","last_fullsized":"2023-07-14T18:11:14.791867+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_clean_scrub_stamp":"2023-07-14T18:11:08.667354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T02:14:23.927899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":18,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:11:14.885431+0000","last_change":"2023-07-14T18:11:09.716890+0000","last_active":"2023-07-14T18:11:14.885431+0000","last_peered":"2023-07-14T18:11:14.885431+0000","last_clean":"2023-07-14T18:11:14.885431+0000","last_became_active":"2023-07-14T18:11:09.708773+0000","last_became_peered":"2023-07-14T18:11:09.708773+0000","last_unstale":"2023-07-14T18:11:14.885431+0000","last_undegraded":"2023-07-14T18:11:14.885431+0000","last_fullsized":"2023-07-14T18:11:14.885431+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_clean_scrub_stamp":"2023-07-14T18:11:08.667354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T02:07:24.275839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":20,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:11:14.885714+0000","last_change":"2023-07-14T18:11:09.715119+0000","last_active":"2023-07-14T18:11:14.885714+0000","last_peered":"2023-07-14T18:11:14.885714+0000","last_clean":"2023-07-14T18:11:14.885714+0000","last_became_active":"2023-07-14T18:11:09.714680+0000","last_became_peered":"2023-07-14T18:11:09.714680+0000","last_unstale":"2023-07-14T18:11:14.885714+0000","last_undegraded":"2023-07-14T18:11:14.885714+0000","last_fullsized":"2023-07-14T18:11:14.885714+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_clean_scrub_stamp":"2023-07-14T18:11:08.667354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:57:07.824122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":20,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:11:14.791064+0000","last_change":"2023-07-14T18:11:09.711173+0000","last_active":"2023-07-14T18:11:14.791064+0000","last_peered":"2023-07-14T18:11:14.791064+0000","last_clean":"2023-07-14T18:11:14.791064+0000","last_became_active":"2023-07-14T18:11:09.710849+0000","last_became_peered":"2023-07-14T18:11:09.710849+0000","last_unstale":"2023-07-14T18:11:14.791064+0000","last_undegraded":"2023-07-14T18:11:14.791064+0000","last_fullsized":"2023-07-14T18:11:14.791064+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_clean_scrub_stamp":"2023-07-14T18:11:08.667354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:51:55.610741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":20,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:11:14.884136+0000","last_change":"2023-07-14T18:11:09.710448+0000","last_active":"2023-07-14T18:11:14.884136+0000","last_peered":"2023-07-14T18:11:14.884136+0000","last_clean":"2023-07-14T18:11:14.884136+0000","last_became_active":"2023-07-14T18:11:09.709804+0000","last_became_peered":"2023-07-14T18:11:09.709804+0000","last_unstale":"2023-07-14T18:11:14.884136+0000","last_undegraded":"2023-07-14T18:11:14.884136+0000","last_fullsized":"2023-07-14T18:11:14.884136+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_clean_scrub_stamp":"2023-07-14T18:11:08.667354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:56:21.024882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":20,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:11:14.884058+0000","last_change":"2023-07-14T18:11:09.714917+0000","last_active":"2023-07-14T18:11:14.884058+0000","last_peered":"2023-07-14T18:11:14.884058+0000","last_clean":"2023-07-14T18:11:14.884058+0000","last_became_active":"2023-07-14T18:11:09.714655+0000","last_became_peered":"2023-07-14T18:11:09.714655+0000","last_unstale":"2023-07-14T18:11:14.884058+0000","last_undegraded":"2023-07-14T18:11:14.884058+0000","last_fullsized":"2023-07-14T18:11:14.884058+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_clean_scrub_stamp":"2023-07-14T18:11:08.667354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:22:10.112893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":20,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:11:14.884405+0000","last_change":"2023-07-14T18:11:09.709149+0000","last_active":"2023-07-14T18:11:14.884405+0000","last_peered":"2023-07-14T18:11:14.884405+0000","last_clean":"2023-07-14T18:11:14.884405+0000","last_became_active":"2023-07-14T18:11:09.708692+0000","last_became_peered":"2023-07-14T18:11:09.708692+0000","last_unstale":"2023-07-14T18:11:14.884405+0000","last_undegraded":"2023-07-14T18:11:14.884405+0000","last_fullsized":"2023-07-14T18:11:14.884405+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_clean_scrub_stamp":"2023-07-14T18:11:08.667354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:02:35.757081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":20,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:11:15.117281+0000","last_change":"2023-07-14T18:11:09.720235+0000","last_active":"2023-07-14T18:11:15.117281+0000","last_peered":"2023-07-14T18:11:15.117281+0000","last_clean":"2023-07-14T18:11:15.117281+0000","last_became_active":"2023-07-14T18:11:09.719895+0000","last_became_peered":"2023-07-14T18:11:09.719895+0000","last_unstale":"2023-07-14T18:11:15.117281+0000","last_undegraded":"2023-07-14T18:11:15.117281+0000","last_fullsized":"2023-07-14T18:11:15.117281+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_clean_scrub_stamp":"2023-07-14T18:11:08.667354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:41:02.386421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":20,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:11:14.887035+0000","last_change":"2023-07-14T18:11:09.712390+0000","last_active":"2023-07-14T18:11:14.887035+0000","last_peered":"2023-07-14T18:11:14.887035+0000","last_clean":"2023-07-14T18:11:14.887035+0000","last_became_active":"2023-07-14T18:11:09.712074+0000","last_became_peered":"2023-07-14T18:11:09.712074+0000","last_unstale":"2023-07-14T18:11:14.887035+0000","last_undegraded":"2023-07-14T18:11:14.887035+0000","last_fullsized":"2023-07-14T18:11:14.887035+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_clean_scrub_stamp":"2023-07-14T18:11:08.667354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:26:16.089801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":20,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:11:14.885382+0000","last_change":"2023-07-14T18:11:09.709800+0000","last_active":"2023-07-14T18:11:14.885382+0000","last_peered":"2023-07-14T18:11:14.885382+0000","last_clean":"2023-07-14T18:11:14.885382+0000","last_became_active":"2023-07-14T18:11:09.709540+0000","last_became_peered":"2023-07-14T18:11:09.709540+0000","last_unstale":"2023-07-14T18:11:14.885382+0000","last_undegraded":"2023-07-14T18:11:14.885382+0000","last_fullsized":"2023-07-14T18:11:14.885382+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_clean_scrub_stamp":"2023-07-14T18:11:08.667354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:52:10.352194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":13,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:11:14.884081+0000","last_change":"2023-07-14T18:11:13.786505+0000","last_active":"2023-07-14T18:11:14.884081+0000","last_peered":"2023-07-14T18:11:14.884081+0000","last_clean":"2023-07-14T18:11:14.884081+0000","last_became_active":"2023-07-14T18:11:13.786141+0000","last_became_peered":"2023-07-14T18:11:13.786141+0000","last_unstale":"2023-07-14T18:11:14.884081+0000","last_undegraded":"2023-07-14T18:11:14.884081+0000","last_fullsized":"2023-07-14T18:11:14.884081+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:12.753466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:12.753466+0000","last_clean_scrub_stamp":"2023-07-14T18:11:12.753466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:26:53.748778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,9,0],"acting":[2,3,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"79'4","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:11:14.887241+0000","last_change":"2023-07-14T18:11:08.691446+0000","last_active":"2023-07-14T18:11:14.887241+0000","last_peered":"2023-07-14T18:11:14.887241+0000","last_clean":"2023-07-14T18:11:14.887241+0000","last_became_active":"2023-07-14T18:11:08.691129+0000","last_became_peered":"2023-07-14T18:11:08.691129+0000","last_unstale":"2023-07-14T18:11:14.887241+0000","last_undegraded":"2023-07-14T18:11:14.887241+0000","last_fullsized":"2023-07-14T18:11:14.887241+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:07.665746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:07.665746+0000","last_clean_scrub_stamp":"2023-07-14T18:11:07.665746+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T03:49:49.363087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":20,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:11:14.886188+0000","last_change":"2023-07-14T18:11:09.708155+0000","last_active":"2023-07-14T18:11:14.886188+0000","last_peered":"2023-07-14T18:11:14.886188+0000","last_clean":"2023-07-14T18:11:14.886188+0000","last_became_active":"2023-07-14T18:11:09.707856+0000","last_became_peered":"2023-07-14T18:11:09.707856+0000","last_unstale":"2023-07-14T18:11:14.886188+0000","last_undegraded":"2023-07-14T18:11:14.886188+0000","last_fullsized":"2023-07-14T18:11:14.886188+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_clean_scrub_stamp":"2023-07-14T18:11:08.667354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:45:23.390147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":13,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:11:14.885185+0000","last_change":"2023-07-14T18:11:13.776947+0000","last_active":"2023-07-14T18:11:14.885185+0000","last_peered":"2023-07-14T18:11:14.885185+0000","last_clean":"2023-07-14T18:11:14.885185+0000","last_became_active":"2023-07-14T18:11:13.776557+0000","last_became_peered":"2023-07-14T18:11:13.776557+0000","last_unstale":"2023-07-14T18:11:14.885185+0000","last_undegraded":"2023-07-14T18:11:14.885185+0000","last_fullsized":"2023-07-14T18:11:14.885185+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:12.753466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:12.753466+0000","last_clean_scrub_stamp":"2023-07-14T18:11:12.753466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T05:58:30.561744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,9,3],"acting":[4,6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1e","version":"84'2","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:11:14.886397+0000","last_change":"2023-07-14T18:11:08.690072+0000","last_active":"2023-07-14T18:11:14.886397+0000","last_peered":"2023-07-14T18:11:14.886397+0000","last_clean":"2023-07-14T18:11:14.886397+0000","last_became_active":"2023-07-14T18:11:08.689770+0000","last_became_peered":"2023-07-14T18:11:08.689770+0000","last_unstale":"2023-07-14T18:11:14.886397+0000","last_undegraded":"2023-07-14T18:11:14.886397+0000","last_fullsized":"2023-07-14T18:11:14.886397+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:07.665746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:07.665746+0000","last_clean_scrub_stamp":"2023-07-14T18:11:07.665746+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:22:28.360757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":20,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:11:14.885001+0000","last_change":"2023-07-14T18:11:09.706952+0000","last_active":"2023-07-14T18:11:14.885001+0000","last_peered":"2023-07-14T18:11:14.885001+0000","last_clean":"2023-07-14T18:11:14.885001+0000","last_became_active":"2023-07-14T18:11:09.706646+0000","last_became_peered":"2023-07-14T18:11:09.706646+0000","last_unstale":"2023-07-14T18:11:14.885001+0000","last_undegraded":"2023-07-14T18:11:14.885001+0000","last_fullsized":"2023-07-14T18:11:14.885001+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_clean_scrub_stamp":"2023-07-14T18:11:08.667354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:21:05.149853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":13,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:11:14.886418+0000","last_change":"2023-07-14T18:11:13.779167+0000","last_active":"2023-07-14T18:11:14.886418+0000","last_peered":"2023-07-14T18:11:14.886418+0000","last_clean":"2023-07-14T18:11:14.886418+0000","last_became_active":"2023-07-14T18:11:13.778486+0000","last_became_peered":"2023-07-14T18:11:13.778486+0000","last_unstale":"2023-07-14T18:11:14.886418+0000","last_undegraded":"2023-07-14T18:11:14.886418+0000","last_fullsized":"2023-07-14T18:11:14.886418+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:12.753466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:12.753466+0000","last_clean_scrub_stamp":"2023-07-14T18:11:12.753466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:34:58.614453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,9,5],"acting":[4,3,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"84'11","reported_seq":34,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:11:30.774003+0000","last_change":"2023-07-14T18:11:08.688289+0000","last_active":"2023-07-14T18:11:30.774003+0000","last_peered":"2023-07-14T18:11:30.774003+0000","last_clean":"2023-07-14T18:11:30.774003+0000","last_became_active":"2023-07-14T18:11:08.687994+0000","last_became_peered":"2023-07-14T18:11:08.687994+0000","last_unstale":"2023-07-14T18:11:30.774003+0000","last_undegraded":"2023-07-14T18:11:30.774003+0000","last_fullsized":"2023-07-14T18:11:30.774003+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:07.665746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:07.665746+0000","last_clean_scrub_stamp":"2023-07-14T18:11:07.665746+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:06:29.309813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":15,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":20,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:11:14.884723+0000","last_change":"2023-07-14T18:11:09.711910+0000","last_active":"2023-07-14T18:11:14.884723+0000","last_peered":"2023-07-14T18:11:14.884723+0000","last_clean":"2023-07-14T18:11:14.884723+0000","last_became_active":"2023-07-14T18:11:09.711634+0000","last_became_peered":"2023-07-14T18:11:09.711634+0000","last_unstale":"2023-07-14T18:11:14.884723+0000","last_undegraded":"2023-07-14T18:11:14.884723+0000","last_fullsized":"2023-07-14T18:11:14.884723+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_clean_scrub_stamp":"2023-07-14T18:11:08.667354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T02:17:27.837804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":13,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:11:14.885448+0000","last_change":"2023-07-14T18:11:13.778662+0000","last_active":"2023-07-14T18:11:14.885448+0000","last_peered":"2023-07-14T18:11:14.885448+0000","last_clean":"2023-07-14T18:11:14.885448+0000","last_became_active":"2023-07-14T18:11:13.777886+0000","last_became_peered":"2023-07-14T18:11:13.777886+0000","last_unstale":"2023-07-14T18:11:14.885448+0000","last_undegraded":"2023-07-14T18:11:14.885448+0000","last_fullsized":"2023-07-14T18:11:14.885448+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:12.753466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:12.753466+0000","last_clean_scrub_stamp":"2023-07-14T18:11:12.753466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:17:56.221852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"84'5","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:11:30.773276+0000","last_change":"2023-07-14T18:11:08.683774+0000","last_active":"2023-07-14T18:11:30.773276+0000","last_peered":"2023-07-14T18:11:30.773276+0000","last_clean":"2023-07-14T18:11:30.773276+0000","last_became_active":"2023-07-14T18:11:08.683458+0000","last_became_peered":"2023-07-14T18:11:08.683458+0000","last_unstale":"2023-07-14T18:11:30.773276+0000","last_undegraded":"2023-07-14T18:11:30.773276+0000","last_fullsized":"2023-07-14T18:11:30.773276+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:07.665746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:07.665746+0000","last_clean_scrub_stamp":"2023-07-14T18:11:07.665746+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:20:32.172917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":20,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:11:14.791559+0000","last_change":"2023-07-14T18:11:09.716041+0000","last_active":"2023-07-14T18:11:14.791559+0000","last_peered":"2023-07-14T18:11:14.791559+0000","last_clean":"2023-07-14T18:11:14.791559+0000","last_became_active":"2023-07-14T18:11:09.715367+0000","last_became_peered":"2023-07-14T18:11:09.715367+0000","last_unstale":"2023-07-14T18:11:14.791559+0000","last_undegraded":"2023-07-14T18:11:14.791559+0000","last_fullsized":"2023-07-14T18:11:14.791559+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_clean_scrub_stamp":"2023-07-14T18:11:08.667354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T01:34:04.989278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":13,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:11:14.885291+0000","last_change":"2023-07-14T18:11:13.776527+0000","last_active":"2023-07-14T18:11:14.885291+0000","last_peered":"2023-07-14T18:11:14.885291+0000","last_clean":"2023-07-14T18:11:14.885291+0000","last_became_active":"2023-07-14T18:11:13.776032+0000","last_became_peered":"2023-07-14T18:11:13.776032+0000","last_unstale":"2023-07-14T18:11:14.885291+0000","last_undegraded":"2023-07-14T18:11:14.885291+0000","last_fullsized":"2023-07-14T18:11:14.885291+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:12.753466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:12.753466+0000","last_clean_scrub_stamp":"2023-07-14T18:11:12.753466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:39:22.666498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"79'1","reported_seq":23,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:11:14.791336+0000","last_change":"2023-07-14T18:11:08.687533+0000","last_active":"2023-07-14T18:11:14.791336+0000","last_peered":"2023-07-14T18:11:14.791336+0000","last_clean":"2023-07-14T18:11:14.791336+0000","last_became_active":"2023-07-14T18:11:08.687242+0000","last_became_peered":"2023-07-14T18:11:08.687242+0000","last_unstale":"2023-07-14T18:11:14.791336+0000","last_undegraded":"2023-07-14T18:11:14.791336+0000","last_fullsized":"2023-07-14T18:11:14.791336+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:07.665746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:07.665746+0000","last_clean_scrub_stamp":"2023-07-14T18:11:07.665746+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T03:53:23.140121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":20,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:11:14.885376+0000","last_change":"2023-07-14T18:11:09.707937+0000","last_active":"2023-07-14T18:11:14.885376+0000","last_peered":"2023-07-14T18:11:14.885376+0000","last_clean":"2023-07-14T18:11:14.885376+0000","last_became_active":"2023-07-14T18:11:09.707637+0000","last_became_peered":"2023-07-14T18:11:09.707637+0000","last_unstale":"2023-07-14T18:11:14.885376+0000","last_undegraded":"2023-07-14T18:11:14.885376+0000","last_fullsized":"2023-07-14T18:11:14.885376+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_clean_scrub_stamp":"2023-07-14T18:11:08.667354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:08:40.577399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":13,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:11:14.884475+0000","last_change":"2023-07-14T18:11:13.791360+0000","last_active":"2023-07-14T18:11:14.884475+0000","last_peered":"2023-07-14T18:11:14.884475+0000","last_clean":"2023-07-14T18:11:14.884475+0000","last_became_active":"2023-07-14T18:11:13.790894+0000","last_became_peered":"2023-07-14T18:11:13.790894+0000","last_unstale":"2023-07-14T18:11:14.884475+0000","last_undegraded":"2023-07-14T18:11:14.884475+0000","last_fullsized":"2023-07-14T18:11:14.884475+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:12.753466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:12.753466+0000","last_clean_scrub_stamp":"2023-07-14T18:11:12.753466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:41:41.939841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,9,5],"acting":[2,6,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1a","version":"79'1","reported_seq":23,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:11:14.791350+0000","last_change":"2023-07-14T18:11:08.687315+0000","last_active":"2023-07-14T18:11:14.791350+0000","last_peered":"2023-07-14T18:11:14.791350+0000","last_clean":"2023-07-14T18:11:14.791350+0000","last_became_active":"2023-07-14T18:11:08.687061+0000","last_became_peered":"2023-07-14T18:11:08.687061+0000","last_unstale":"2023-07-14T18:11:14.791350+0000","last_undegraded":"2023-07-14T18:11:14.791350+0000","last_fullsized":"2023-07-14T18:11:14.791350+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:07.665746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:07.665746+0000","last_clean_scrub_stamp":"2023-07-14T18:11:07.665746+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:33:18.467402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":20,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:11:14.791635+0000","last_change":"2023-07-14T18:11:09.715816+0000","last_active":"2023-07-14T18:11:14.791635+0000","last_peered":"2023-07-14T18:11:14.791635+0000","last_clean":"2023-07-14T18:11:14.791635+0000","last_became_active":"2023-07-14T18:11:09.715038+0000","last_became_peered":"2023-07-14T18:11:09.715038+0000","last_unstale":"2023-07-14T18:11:14.791635+0000","last_undegraded":"2023-07-14T18:11:14.791635+0000","last_fullsized":"2023-07-14T18:11:14.791635+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_clean_scrub_stamp":"2023-07-14T18:11:08.667354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:25:18.981358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":13,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:11:15.117190+0000","last_change":"2023-07-14T18:11:13.791438+0000","last_active":"2023-07-14T18:11:15.117190+0000","last_peered":"2023-07-14T18:11:15.117190+0000","last_clean":"2023-07-14T18:11:15.117190+0000","last_became_active":"2023-07-14T18:11:13.790956+0000","last_became_peered":"2023-07-14T18:11:13.790956+0000","last_unstale":"2023-07-14T18:11:15.117190+0000","last_undegraded":"2023-07-14T18:11:15.117190+0000","last_fullsized":"2023-07-14T18:11:15.117190+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:12.753466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:12.753466+0000","last_clean_scrub_stamp":"2023-07-14T18:11:12.753466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:19:27.699147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.19","version":"84'2","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:11:28.829077+0000","last_change":"2023-07-14T18:11:08.693751+0000","last_active":"2023-07-14T18:11:28.829077+0000","last_peered":"2023-07-14T18:11:28.829077+0000","last_clean":"2023-07-14T18:11:28.829077+0000","last_became_active":"2023-07-14T18:11:08.693427+0000","last_became_peered":"2023-07-14T18:11:08.693427+0000","last_unstale":"2023-07-14T18:11:28.829077+0000","last_undegraded":"2023-07-14T18:11:28.829077+0000","last_fullsized":"2023-07-14T18:11:28.829077+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:07.665746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:07.665746+0000","last_clean_scrub_stamp":"2023-07-14T18:11:07.665746+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T01:10:23.727801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":20,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:11:14.885924+0000","last_change":"2023-07-14T18:11:09.709761+0000","last_active":"2023-07-14T18:11:14.885924+0000","last_peered":"2023-07-14T18:11:14.885924+0000","last_clean":"2023-07-14T18:11:14.885924+0000","last_became_active":"2023-07-14T18:11:09.709157+0000","last_became_peered":"2023-07-14T18:11:09.709157+0000","last_unstale":"2023-07-14T18:11:14.885924+0000","last_undegraded":"2023-07-14T18:11:14.885924+0000","last_fullsized":"2023-07-14T18:11:14.885924+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_clean_scrub_stamp":"2023-07-14T18:11:08.667354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:46:44.602802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":13,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:11:14.884393+0000","last_change":"2023-07-14T18:11:13.779265+0000","last_active":"2023-07-14T18:11:14.884393+0000","last_peered":"2023-07-14T18:11:14.884393+0000","last_clean":"2023-07-14T18:11:14.884393+0000","last_became_active":"2023-07-14T18:11:13.778865+0000","last_became_peered":"2023-07-14T18:11:13.778865+0000","last_unstale":"2023-07-14T18:11:14.884393+0000","last_undegraded":"2023-07-14T18:11:14.884393+0000","last_fullsized":"2023-07-14T18:11:14.884393+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:12.753466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:12.753466+0000","last_clean_scrub_stamp":"2023-07-14T18:11:12.753466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:19:57.552613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":22,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:11:14.790949+0000","last_change":"2023-07-14T18:11:08.684513+0000","last_active":"2023-07-14T18:11:14.790949+0000","last_peered":"2023-07-14T18:11:14.790949+0000","last_clean":"2023-07-14T18:11:14.790949+0000","last_became_active":"2023-07-14T18:11:08.684213+0000","last_became_peered":"2023-07-14T18:11:08.684213+0000","last_unstale":"2023-07-14T18:11:14.790949+0000","last_undegraded":"2023-07-14T18:11:14.790949+0000","last_fullsized":"2023-07-14T18:11:14.790949+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:07.665746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:07.665746+0000","last_clean_scrub_stamp":"2023-07-14T18:11:07.665746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:07:53.630240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":20,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:11:14.886595+0000","last_change":"2023-07-14T18:11:09.712427+0000","last_active":"2023-07-14T18:11:14.886595+0000","last_peered":"2023-07-14T18:11:14.886595+0000","last_clean":"2023-07-14T18:11:14.886595+0000","last_became_active":"2023-07-14T18:11:09.712104+0000","last_became_peered":"2023-07-14T18:11:09.712104+0000","last_unstale":"2023-07-14T18:11:14.886595+0000","last_undegraded":"2023-07-14T18:11:14.886595+0000","last_fullsized":"2023-07-14T18:11:14.886595+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_clean_scrub_stamp":"2023-07-14T18:11:08.667354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:27:36.074613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":13,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:11:14.884458+0000","last_change":"2023-07-14T18:11:13.777892+0000","last_active":"2023-07-14T18:11:14.884458+0000","last_peered":"2023-07-14T18:11:14.884458+0000","last_clean":"2023-07-14T18:11:14.884458+0000","last_became_active":"2023-07-14T18:11:13.777518+0000","last_became_peered":"2023-07-14T18:11:13.777518+0000","last_unstale":"2023-07-14T18:11:14.884458+0000","last_undegraded":"2023-07-14T18:11:14.884458+0000","last_fullsized":"2023-07-14T18:11:14.884458+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:12.753466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:12.753466+0000","last_clean_scrub_stamp":"2023-07-14T18:11:12.753466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T03:56:42.344672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.17","version":"84'3","reported_seq":25,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:11:27.818230+0000","last_change":"2023-07-14T18:11:08.684141+0000","last_active":"2023-07-14T18:11:27.818230+0000","last_peered":"2023-07-14T18:11:27.818230+0000","last_clean":"2023-07-14T18:11:27.818230+0000","last_became_active":"2023-07-14T18:11:08.683767+0000","last_became_peered":"2023-07-14T18:11:08.683767+0000","last_unstale":"2023-07-14T18:11:27.818230+0000","last_undegraded":"2023-07-14T18:11:27.818230+0000","last_fullsized":"2023-07-14T18:11:27.818230+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:07.665746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:07.665746+0000","last_clean_scrub_stamp":"2023-07-14T18:11:07.665746+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T02:05:02.791590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":20,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:11:14.885184+0000","last_change":"2023-07-14T18:11:09.710975+0000","last_active":"2023-07-14T18:11:14.885184+0000","last_peered":"2023-07-14T18:11:14.885184+0000","last_clean":"2023-07-14T18:11:14.885184+0000","last_became_active":"2023-07-14T18:11:09.710690+0000","last_became_peered":"2023-07-14T18:11:09.710690+0000","last_unstale":"2023-07-14T18:11:14.885184+0000","last_undegraded":"2023-07-14T18:11:14.885184+0000","last_fullsized":"2023-07-14T18:11:14.885184+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_clean_scrub_stamp":"2023-07-14T18:11:08.667354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T02:39:19.763017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":13,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:11:14.886369+0000","last_change":"2023-07-14T18:11:13.789251+0000","last_active":"2023-07-14T18:11:14.886369+0000","last_peered":"2023-07-14T18:11:14.886369+0000","last_clean":"2023-07-14T18:11:14.886369+0000","last_became_active":"2023-07-14T18:11:13.788742+0000","last_became_peered":"2023-07-14T18:11:13.788742+0000","last_unstale":"2023-07-14T18:11:14.886369+0000","last_undegraded":"2023-07-14T18:11:14.886369+0000","last_fullsized":"2023-07-14T18:11:14.886369+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:12.753466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:12.753466+0000","last_clean_scrub_stamp":"2023-07-14T18:11:12.753466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T04:39:11.465407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0,2,4],"acting":[9,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.16","version":"84'2","reported_seq":22,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:11:27.817241+0000","last_change":"2023-07-14T18:11:08.692093+0000","last_active":"2023-07-14T18:11:27.817241+0000","last_peered":"2023-07-14T18:11:27.817241+0000","last_clean":"2023-07-14T18:11:27.817241+0000","last_became_active":"2023-07-14T18:11:08.691806+0000","last_became_peered":"2023-07-14T18:11:08.691806+0000","last_unstale":"2023-07-14T18:11:27.817241+0000","last_undegraded":"2023-07-14T18:11:27.817241+0000","last_fullsized":"2023-07-14T18:11:27.817241+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:07.665746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:07.665746+0000","last_clean_scrub_stamp":"2023-07-14T18:11:07.665746+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:59:54.200134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":20,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:11:14.885119+0000","last_change":"2023-07-14T18:11:09.714965+0000","last_active":"2023-07-14T18:11:14.885119+0000","last_peered":"2023-07-14T18:11:14.885119+0000","last_clean":"2023-07-14T18:11:14.885119+0000","last_became_active":"2023-07-14T18:11:09.714676+0000","last_became_peered":"2023-07-14T18:11:09.714676+0000","last_unstale":"2023-07-14T18:11:14.885119+0000","last_undegraded":"2023-07-14T18:11:14.885119+0000","last_fullsized":"2023-07-14T18:11:14.885119+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_clean_scrub_stamp":"2023-07-14T18:11:08.667354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:10:38.185488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":13,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:11:14.886587+0000","last_change":"2023-07-14T18:11:13.779218+0000","last_active":"2023-07-14T18:11:14.886587+0000","last_peered":"2023-07-14T18:11:14.886587+0000","last_clean":"2023-07-14T18:11:14.886587+0000","last_became_active":"2023-07-14T18:11:13.778833+0000","last_became_peered":"2023-07-14T18:11:13.778833+0000","last_unstale":"2023-07-14T18:11:14.886587+0000","last_undegraded":"2023-07-14T18:11:14.886587+0000","last_fullsized":"2023-07-14T18:11:14.886587+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:12.753466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:12.753466+0000","last_clean_scrub_stamp":"2023-07-14T18:11:12.753466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:59:38.858950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,9],"acting":[4,1,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"79'3","reported_seq":25,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:11:14.791431+0000","last_change":"2023-07-14T18:11:08.681778+0000","last_active":"2023-07-14T18:11:14.791431+0000","last_peered":"2023-07-14T18:11:14.791431+0000","last_clean":"2023-07-14T18:11:14.791431+0000","last_became_active":"2023-07-14T18:11:08.681406+0000","last_became_peered":"2023-07-14T18:11:08.681406+0000","last_unstale":"2023-07-14T18:11:14.791431+0000","last_undegraded":"2023-07-14T18:11:14.791431+0000","last_fullsized":"2023-07-14T18:11:14.791431+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:07.665746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:07.665746+0000","last_clean_scrub_stamp":"2023-07-14T18:11:07.665746+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:23:04.400637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":20,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:11:14.884950+0000","last_change":"2023-07-14T18:11:09.703070+0000","last_active":"2023-07-14T18:11:14.884950+0000","last_peered":"2023-07-14T18:11:14.884950+0000","last_clean":"2023-07-14T18:11:14.884950+0000","last_became_active":"2023-07-14T18:11:09.702754+0000","last_became_peered":"2023-07-14T18:11:09.702754+0000","last_unstale":"2023-07-14T18:11:14.884950+0000","last_undegraded":"2023-07-14T18:11:14.884950+0000","last_fullsized":"2023-07-14T18:11:14.884950+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_clean_scrub_stamp":"2023-07-14T18:11:08.667354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:41:59.621911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":13,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:11:14.886380+0000","last_change":"2023-07-14T18:11:13.788077+0000","last_active":"2023-07-14T18:11:14.886380+0000","last_peered":"2023-07-14T18:11:14.886380+0000","last_clean":"2023-07-14T18:11:14.886380+0000","last_became_active":"2023-07-14T18:11:13.787719+0000","last_became_peered":"2023-07-14T18:11:13.787719+0000","last_unstale":"2023-07-14T18:11:14.886380+0000","last_undegraded":"2023-07-14T18:11:14.886380+0000","last_fullsized":"2023-07-14T18:11:14.886380+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:12.753466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:12.753466+0000","last_clean_scrub_stamp":"2023-07-14T18:11:12.753466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:28:37.419577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,11,5],"acting":[9,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.14","version":"84'12","reported_seq":34,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:11:27.817477+0000","last_change":"2023-07-14T18:11:08.690538+0000","last_active":"2023-07-14T18:11:27.817477+0000","last_peered":"2023-07-14T18:11:27.817477+0000","last_clean":"2023-07-14T18:11:27.817477+0000","last_became_active":"2023-07-14T18:11:08.690152+0000","last_became_peered":"2023-07-14T18:11:08.690152+0000","last_unstale":"2023-07-14T18:11:27.817477+0000","last_undegraded":"2023-07-14T18:11:27.817477+0000","last_fullsized":"2023-07-14T18:11:27.817477+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:07.665746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:07.665746+0000","last_clean_scrub_stamp":"2023-07-14T18:11:07.665746+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:27:49.760382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3794,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":20,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:11:14.885568+0000","last_change":"2023-07-14T18:11:09.710116+0000","last_active":"2023-07-14T18:11:14.885568+0000","last_peered":"2023-07-14T18:11:14.885568+0000","last_clean":"2023-07-14T18:11:14.885568+0000","last_became_active":"2023-07-14T18:11:09.709831+0000","last_became_peered":"2023-07-14T18:11:09.709831+0000","last_unstale":"2023-07-14T18:11:14.885568+0000","last_undegraded":"2023-07-14T18:11:14.885568+0000","last_fullsized":"2023-07-14T18:11:14.885568+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_clean_scrub_stamp":"2023-07-14T18:11:08.667354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T03:06:14.287734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":13,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:11:14.791956+0000","last_change":"2023-07-14T18:11:13.777434+0000","last_active":"2023-07-14T18:11:14.791956+0000","last_peered":"2023-07-14T18:11:14.791956+0000","last_clean":"2023-07-14T18:11:14.791956+0000","last_became_active":"2023-07-14T18:11:13.776670+0000","last_became_peered":"2023-07-14T18:11:13.776670+0000","last_unstale":"2023-07-14T18:11:14.791956+0000","last_undegraded":"2023-07-14T18:11:14.791956+0000","last_fullsized":"2023-07-14T18:11:14.791956+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:12.753466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:12.753466+0000","last_clean_scrub_stamp":"2023-07-14T18:11:12.753466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T02:09:40.305735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.13","version":"84'7","reported_seq":29,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:11:28.826657+0000","last_change":"2023-07-14T18:11:08.693172+0000","last_active":"2023-07-14T18:11:28.826657+0000","last_peered":"2023-07-14T18:11:28.826657+0000","last_clean":"2023-07-14T18:11:28.826657+0000","last_became_active":"2023-07-14T18:11:08.692846+0000","last_became_peered":"2023-07-14T18:11:08.692846+0000","last_unstale":"2023-07-14T18:11:28.826657+0000","last_undegraded":"2023-07-14T18:11:28.826657+0000","last_fullsized":"2023-07-14T18:11:28.826657+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:07.665746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:07.665746+0000","last_clean_scrub_stamp":"2023-07-14T18:11:07.665746+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:24:38.511637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":20,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:11:14.790941+0000","last_change":"2023-07-14T18:11:09.708480+0000","last_active":"2023-07-14T18:11:14.790941+0000","last_peered":"2023-07-14T18:11:14.790941+0000","last_clean":"2023-07-14T18:11:14.790941+0000","last_became_active":"2023-07-14T18:11:09.708170+0000","last_became_peered":"2023-07-14T18:11:09.708170+0000","last_unstale":"2023-07-14T18:11:14.790941+0000","last_undegraded":"2023-07-14T18:11:14.790941+0000","last_fullsized":"2023-07-14T18:11:14.790941+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_clean_scrub_stamp":"2023-07-14T18:11:08.667354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T04:03:41.097364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":13,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:11:15.116981+0000","last_change":"2023-07-14T18:11:13.792069+0000","last_active":"2023-07-14T18:11:15.116981+0000","last_peered":"2023-07-14T18:11:15.116981+0000","last_clean":"2023-07-14T18:11:15.116981+0000","last_became_active":"2023-07-14T18:11:13.791698+0000","last_became_peered":"2023-07-14T18:11:13.791698+0000","last_unstale":"2023-07-14T18:11:15.116981+0000","last_undegraded":"2023-07-14T18:11:15.116981+0000","last_fullsized":"2023-07-14T18:11:15.116981+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:12.753466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:12.753466+0000","last_clean_scrub_stamp":"2023-07-14T18:11:12.753466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:36:51.740650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":22,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:11:14.791333+0000","last_change":"2023-07-14T18:11:08.685028+0000","last_active":"2023-07-14T18:11:14.791333+0000","last_peered":"2023-07-14T18:11:14.791333+0000","last_clean":"2023-07-14T18:11:14.791333+0000","last_became_active":"2023-07-14T18:11:08.684701+0000","last_became_peered":"2023-07-14T18:11:08.684701+0000","last_unstale":"2023-07-14T18:11:14.791333+0000","last_undegraded":"2023-07-14T18:11:14.791333+0000","last_fullsized":"2023-07-14T18:11:14.791333+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:07.665746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:07.665746+0000","last_clean_scrub_stamp":"2023-07-14T18:11:07.665746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:48:38.822039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":18,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:11:14.886051+0000","last_change":"2023-07-14T18:11:09.717714+0000","last_active":"2023-07-14T18:11:14.886051+0000","last_peered":"2023-07-14T18:11:14.886051+0000","last_clean":"2023-07-14T18:11:14.886051+0000","last_became_active":"2023-07-14T18:11:09.717407+0000","last_became_peered":"2023-07-14T18:11:09.717407+0000","last_unstale":"2023-07-14T18:11:14.886051+0000","last_undegraded":"2023-07-14T18:11:14.886051+0000","last_fullsized":"2023-07-14T18:11:14.886051+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_clean_scrub_stamp":"2023-07-14T18:11:08.667354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T02:18:33.466738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":13,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:11:14.887107+0000","last_change":"2023-07-14T18:11:13.787754+0000","last_active":"2023-07-14T18:11:14.887107+0000","last_peered":"2023-07-14T18:11:14.887107+0000","last_clean":"2023-07-14T18:11:14.887107+0000","last_became_active":"2023-07-14T18:11:13.787250+0000","last_became_peered":"2023-07-14T18:11:13.787250+0000","last_unstale":"2023-07-14T18:11:14.887107+0000","last_undegraded":"2023-07-14T18:11:14.887107+0000","last_fullsized":"2023-07-14T18:11:14.887107+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:12.753466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:12.753466+0000","last_clean_scrub_stamp":"2023-07-14T18:11:12.753466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T03:54:39.337152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,0,3],"acting":[9,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":22,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:11:14.885236+0000","last_change":"2023-07-14T18:11:08.685327+0000","last_active":"2023-07-14T18:11:14.885236+0000","last_peered":"2023-07-14T18:11:14.885236+0000","last_clean":"2023-07-14T18:11:14.885236+0000","last_became_active":"2023-07-14T18:11:08.684969+0000","last_became_peered":"2023-07-14T18:11:08.684969+0000","last_unstale":"2023-07-14T18:11:14.885236+0000","last_undegraded":"2023-07-14T18:11:14.885236+0000","last_fullsized":"2023-07-14T18:11:14.885236+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:07.665746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:07.665746+0000","last_clean_scrub_stamp":"2023-07-14T18:11:07.665746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:38:18.572332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":18,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:11:14.886418+0000","last_change":"2023-07-14T18:11:09.721100+0000","last_active":"2023-07-14T18:11:14.886418+0000","last_peered":"2023-07-14T18:11:14.886418+0000","last_clean":"2023-07-14T18:11:14.886418+0000","last_became_active":"2023-07-14T18:11:09.720814+0000","last_became_peered":"2023-07-14T18:11:09.720814+0000","last_unstale":"2023-07-14T18:11:14.886418+0000","last_undegraded":"2023-07-14T18:11:14.886418+0000","last_fullsized":"2023-07-14T18:11:14.886418+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_clean_scrub_stamp":"2023-07-14T18:11:08.667354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:21:49.557811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":13,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:11:14.791294+0000","last_change":"2023-07-14T18:11:13.782152+0000","last_active":"2023-07-14T18:11:14.791294+0000","last_peered":"2023-07-14T18:11:14.791294+0000","last_clean":"2023-07-14T18:11:14.791294+0000","last_became_active":"2023-07-14T18:11:13.780580+0000","last_became_peered":"2023-07-14T18:11:13.780580+0000","last_unstale":"2023-07-14T18:11:14.791294+0000","last_undegraded":"2023-07-14T18:11:14.791294+0000","last_fullsized":"2023-07-14T18:11:14.791294+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:12.753466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:12.753466+0000","last_clean_scrub_stamp":"2023-07-14T18:11:12.753466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T05:13:05.195958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"84'17","reported_seq":40,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:11:30.764437+0000","last_change":"2023-07-14T18:11:08.688954+0000","last_active":"2023-07-14T18:11:30.764437+0000","last_peered":"2023-07-14T18:11:30.764437+0000","last_clean":"2023-07-14T18:11:30.764437+0000","last_became_active":"2023-07-14T18:11:08.688640+0000","last_became_peered":"2023-07-14T18:11:08.688640+0000","last_unstale":"2023-07-14T18:11:30.764437+0000","last_undegraded":"2023-07-14T18:11:30.764437+0000","last_fullsized":"2023-07-14T18:11:30.764437+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:07.665746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:07.665746+0000","last_clean_scrub_stamp":"2023-07-14T18:11:07.665746+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:21:30.166422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":20,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:11:14.791112+0000","last_change":"2023-07-14T18:11:09.710105+0000","last_active":"2023-07-14T18:11:14.791112+0000","last_peered":"2023-07-14T18:11:14.791112+0000","last_clean":"2023-07-14T18:11:14.791112+0000","last_became_active":"2023-07-14T18:11:09.709820+0000","last_became_peered":"2023-07-14T18:11:09.709820+0000","last_unstale":"2023-07-14T18:11:14.791112+0000","last_undegraded":"2023-07-14T18:11:14.791112+0000","last_fullsized":"2023-07-14T18:11:14.791112+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_clean_scrub_stamp":"2023-07-14T18:11:08.667354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:29:12.467495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":13,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:11:14.791138+0000","last_change":"2023-07-14T18:11:13.780122+0000","last_active":"2023-07-14T18:11:14.791138+0000","last_peered":"2023-07-14T18:11:14.791138+0000","last_clean":"2023-07-14T18:11:14.791138+0000","last_became_active":"2023-07-14T18:11:13.779774+0000","last_became_peered":"2023-07-14T18:11:13.779774+0000","last_unstale":"2023-07-14T18:11:14.791138+0000","last_undegraded":"2023-07-14T18:11:14.791138+0000","last_fullsized":"2023-07-14T18:11:14.791138+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:12.753466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:12.753466+0000","last_clean_scrub_stamp":"2023-07-14T18:11:12.753466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:30:22.618282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"84'2","reported_seq":25,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:11:29.872951+0000","last_change":"2023-07-14T18:11:08.686080+0000","last_active":"2023-07-14T18:11:29.872951+0000","last_peered":"2023-07-14T18:11:29.872951+0000","last_clean":"2023-07-14T18:11:29.872951+0000","last_became_active":"2023-07-14T18:11:08.685837+0000","last_became_peered":"2023-07-14T18:11:08.685837+0000","last_unstale":"2023-07-14T18:11:29.872951+0000","last_undegraded":"2023-07-14T18:11:29.872951+0000","last_fullsized":"2023-07-14T18:11:29.872951+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:07.665746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:07.665746+0000","last_clean_scrub_stamp":"2023-07-14T18:11:07.665746+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:51:30.759050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":20,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:11:15.117046+0000","last_change":"2023-07-14T18:11:09.712166+0000","last_active":"2023-07-14T18:11:15.117046+0000","last_peered":"2023-07-14T18:11:15.117046+0000","last_clean":"2023-07-14T18:11:15.117046+0000","last_became_active":"2023-07-14T18:11:09.711858+0000","last_became_peered":"2023-07-14T18:11:09.711858+0000","last_unstale":"2023-07-14T18:11:15.117046+0000","last_undegraded":"2023-07-14T18:11:15.117046+0000","last_fullsized":"2023-07-14T18:11:15.117046+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_clean_scrub_stamp":"2023-07-14T18:11:08.667354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:17:12.495175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":13,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:11:14.885280+0000","last_change":"2023-07-14T18:11:13.905188+0000","last_active":"2023-07-14T18:11:14.885280+0000","last_peered":"2023-07-14T18:11:14.885280+0000","last_clean":"2023-07-14T18:11:14.885280+0000","last_became_active":"2023-07-14T18:11:13.904779+0000","last_became_peered":"2023-07-14T18:11:13.904779+0000","last_unstale":"2023-07-14T18:11:14.885280+0000","last_undegraded":"2023-07-14T18:11:14.885280+0000","last_fullsized":"2023-07-14T18:11:14.885280+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:12.753466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:12.753466+0000","last_clean_scrub_stamp":"2023-07-14T18:11:12.753466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:58:40.490499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,9],"acting":[8,10,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:11:14.886870+0000","last_change":"2023-07-14T18:11:08.687838+0000","last_active":"2023-07-14T18:11:14.886870+0000","last_peered":"2023-07-14T18:11:14.886870+0000","last_clean":"2023-07-14T18:11:14.886870+0000","last_became_active":"2023-07-14T18:11:08.687522+0000","last_became_peered":"2023-07-14T18:11:08.687522+0000","last_unstale":"2023-07-14T18:11:14.886870+0000","last_undegraded":"2023-07-14T18:11:14.886870+0000","last_fullsized":"2023-07-14T18:11:14.886870+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:07.665746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:07.665746+0000","last_clean_scrub_stamp":"2023-07-14T18:11:07.665746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T01:12:01.083801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":20,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:11:14.791607+0000","last_change":"2023-07-14T18:11:09.704033+0000","last_active":"2023-07-14T18:11:14.791607+0000","last_peered":"2023-07-14T18:11:14.791607+0000","last_clean":"2023-07-14T18:11:14.791607+0000","last_became_active":"2023-07-14T18:11:09.703727+0000","last_became_peered":"2023-07-14T18:11:09.703727+0000","last_unstale":"2023-07-14T18:11:14.791607+0000","last_undegraded":"2023-07-14T18:11:14.791607+0000","last_fullsized":"2023-07-14T18:11:14.791607+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_clean_scrub_stamp":"2023-07-14T18:11:08.667354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T04:23:57.185860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":13,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:11:14.791177+0000","last_change":"2023-07-14T18:11:13.778207+0000","last_active":"2023-07-14T18:11:14.791177+0000","last_peered":"2023-07-14T18:11:14.791177+0000","last_clean":"2023-07-14T18:11:14.791177+0000","last_became_active":"2023-07-14T18:11:13.777847+0000","last_became_peered":"2023-07-14T18:11:13.777847+0000","last_unstale":"2023-07-14T18:11:14.791177+0000","last_undegraded":"2023-07-14T18:11:14.791177+0000","last_fullsized":"2023-07-14T18:11:14.791177+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:12.753466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:12.753466+0000","last_clean_scrub_stamp":"2023-07-14T18:11:12.753466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:48:12.622534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"84'1","reported_seq":21,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:11:14.885851+0000","last_change":"2023-07-14T18:11:08.683570+0000","last_active":"2023-07-14T18:11:14.885851+0000","last_peered":"2023-07-14T18:11:14.885851+0000","last_clean":"2023-07-14T18:11:14.885851+0000","last_became_active":"2023-07-14T18:11:08.683271+0000","last_became_peered":"2023-07-14T18:11:08.683271+0000","last_unstale":"2023-07-14T18:11:14.885851+0000","last_undegraded":"2023-07-14T18:11:14.885851+0000","last_fullsized":"2023-07-14T18:11:14.885851+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:07.665746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:07.665746+0000","last_clean_scrub_stamp":"2023-07-14T18:11:07.665746+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:27:31.589898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":20,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:11:14.791596+0000","last_change":"2023-07-14T18:11:09.718239+0000","last_active":"2023-07-14T18:11:14.791596+0000","last_peered":"2023-07-14T18:11:14.791596+0000","last_clean":"2023-07-14T18:11:14.791596+0000","last_became_active":"2023-07-14T18:11:09.717923+0000","last_became_peered":"2023-07-14T18:11:09.717923+0000","last_unstale":"2023-07-14T18:11:14.791596+0000","last_undegraded":"2023-07-14T18:11:14.791596+0000","last_fullsized":"2023-07-14T18:11:14.791596+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_clean_scrub_stamp":"2023-07-14T18:11:08.667354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T04:18:29.161266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":13,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:11:14.791411+0000","last_change":"2023-07-14T18:11:13.904652+0000","last_active":"2023-07-14T18:11:14.791411+0000","last_peered":"2023-07-14T18:11:14.791411+0000","last_clean":"2023-07-14T18:11:14.791411+0000","last_became_active":"2023-07-14T18:11:13.904237+0000","last_became_peered":"2023-07-14T18:11:13.904237+0000","last_unstale":"2023-07-14T18:11:14.791411+0000","last_undegraded":"2023-07-14T18:11:14.791411+0000","last_fullsized":"2023-07-14T18:11:14.791411+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:12.753466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:12.753466+0000","last_clean_scrub_stamp":"2023-07-14T18:11:12.753466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T05:43:29.030625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":20,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:11:14.791182+0000","last_change":"2023-07-14T18:11:09.707086+0000","last_active":"2023-07-14T18:11:14.791182+0000","last_peered":"2023-07-14T18:11:14.791182+0000","last_clean":"2023-07-14T18:11:14.791182+0000","last_became_active":"2023-07-14T18:11:09.705882+0000","last_became_peered":"2023-07-14T18:11:09.705882+0000","last_unstale":"2023-07-14T18:11:14.791182+0000","last_undegraded":"2023-07-14T18:11:14.791182+0000","last_fullsized":"2023-07-14T18:11:14.791182+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_clean_scrub_stamp":"2023-07-14T18:11:08.667354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T03:39:47.438151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"84'4","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:11:28.829172+0000","last_change":"2023-07-14T18:11:08.683447+0000","last_active":"2023-07-14T18:11:28.829172+0000","last_peered":"2023-07-14T18:11:28.829172+0000","last_clean":"2023-07-14T18:11:28.829172+0000","last_became_active":"2023-07-14T18:11:08.682822+0000","last_became_peered":"2023-07-14T18:11:08.682822+0000","last_unstale":"2023-07-14T18:11:28.829172+0000","last_undegraded":"2023-07-14T18:11:28.829172+0000","last_fullsized":"2023-07-14T18:11:28.829172+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:07.665746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:07.665746+0000","last_clean_scrub_stamp":"2023-07-14T18:11:07.665746+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:07:15.245024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":13,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:11:14.885169+0000","last_change":"2023-07-14T18:11:13.780698+0000","last_active":"2023-07-14T18:11:14.885169+0000","last_peered":"2023-07-14T18:11:14.885169+0000","last_clean":"2023-07-14T18:11:14.885169+0000","last_became_active":"2023-07-14T18:11:13.780310+0000","last_became_peered":"2023-07-14T18:11:13.780310+0000","last_unstale":"2023-07-14T18:11:14.885169+0000","last_undegraded":"2023-07-14T18:11:14.885169+0000","last_fullsized":"2023-07-14T18:11:14.885169+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:12.753466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:12.753466+0000","last_clean_scrub_stamp":"2023-07-14T18:11:12.753466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:45:25.175685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,9],"acting":[7,5,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":20,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:11:14.884951+0000","last_change":"2023-07-14T18:11:09.708728+0000","last_active":"2023-07-14T18:11:14.884951+0000","last_peered":"2023-07-14T18:11:14.884951+0000","last_clean":"2023-07-14T18:11:14.884951+0000","last_became_active":"2023-07-14T18:11:09.708345+0000","last_became_peered":"2023-07-14T18:11:09.708345+0000","last_unstale":"2023-07-14T18:11:14.884951+0000","last_undegraded":"2023-07-14T18:11:14.884951+0000","last_fullsized":"2023-07-14T18:11:14.884951+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_clean_scrub_stamp":"2023-07-14T18:11:08.667354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:19:56.524734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":22,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:11:14.886437+0000","last_change":"2023-07-14T18:11:08.684495+0000","last_active":"2023-07-14T18:11:14.886437+0000","last_peered":"2023-07-14T18:11:14.886437+0000","last_clean":"2023-07-14T18:11:14.886437+0000","last_became_active":"2023-07-14T18:11:08.684142+0000","last_became_peered":"2023-07-14T18:11:08.684142+0000","last_unstale":"2023-07-14T18:11:14.886437+0000","last_undegraded":"2023-07-14T18:11:14.886437+0000","last_fullsized":"2023-07-14T18:11:14.886437+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:07.665746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:07.665746+0000","last_clean_scrub_stamp":"2023-07-14T18:11:07.665746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T04:13:36.850275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"22'137","reported_seq":336,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:11:14.886019+0000","last_change":"2023-07-14T18:10:10.733548+0000","last_active":"2023-07-14T18:11:14.886019+0000","last_peered":"2023-07-14T18:11:14.886019+0000","last_clean":"2023-07-14T18:11:14.886019+0000","last_became_active":"2023-07-14T18:10:10.732994+0000","last_became_peered":"2023-07-14T18:10:10.732994+0000","last_unstale":"2023-07-14T18:11:14.886019+0000","last_undegraded":"2023-07-14T18:11:14.886019+0000","last_fullsized":"2023-07-14T18:11:14.886019+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:07:19.893754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:07:19.893754+0000","last_clean_scrub_stamp":"2023-07-14T18:07:19.893754+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T03:18:47.801203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":13,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:11:14.791877+0000","last_change":"2023-07-14T18:11:13.905811+0000","last_active":"2023-07-14T18:11:14.791877+0000","last_peered":"2023-07-14T18:11:14.791877+0000","last_clean":"2023-07-14T18:11:14.791877+0000","last_became_active":"2023-07-14T18:11:13.905390+0000","last_became_peered":"2023-07-14T18:11:13.905390+0000","last_unstale":"2023-07-14T18:11:14.791877+0000","last_undegraded":"2023-07-14T18:11:14.791877+0000","last_fullsized":"2023-07-14T18:11:14.791877+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:12.753466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:12.753466+0000","last_clean_scrub_stamp":"2023-07-14T18:11:12.753466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T03:55:38.653507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,6,10],"acting":[5,9,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":20,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:11:14.790613+0000","last_change":"2023-07-14T18:11:09.711008+0000","last_active":"2023-07-14T18:11:14.790613+0000","last_peered":"2023-07-14T18:11:14.790613+0000","last_clean":"2023-07-14T18:11:14.790613+0000","last_became_active":"2023-07-14T18:11:09.710555+0000","last_became_peered":"2023-07-14T18:11:09.710555+0000","last_unstale":"2023-07-14T18:11:14.790613+0000","last_undegraded":"2023-07-14T18:11:14.790613+0000","last_fullsized":"2023-07-14T18:11:14.790613+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_clean_scrub_stamp":"2023-07-14T18:11:08.667354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:14:16.607280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"84'3","reported_seq":23,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:11:28.825348+0000","last_change":"2023-07-14T18:11:08.689050+0000","last_active":"2023-07-14T18:11:28.825348+0000","last_peered":"2023-07-14T18:11:28.825348+0000","last_clean":"2023-07-14T18:11:28.825348+0000","last_became_active":"2023-07-14T18:11:08.688777+0000","last_became_peered":"2023-07-14T18:11:08.688777+0000","last_unstale":"2023-07-14T18:11:28.825348+0000","last_undegraded":"2023-07-14T18:11:28.825348+0000","last_fullsized":"2023-07-14T18:11:28.825348+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:07.665746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:07.665746+0000","last_clean_scrub_stamp":"2023-07-14T18:11:07.665746+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T01:15:28.678572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":13,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:11:15.116864+0000","last_change":"2023-07-14T18:11:13.776853+0000","last_active":"2023-07-14T18:11:15.116864+0000","last_peered":"2023-07-14T18:11:15.116864+0000","last_clean":"2023-07-14T18:11:15.116864+0000","last_became_active":"2023-07-14T18:11:13.776353+0000","last_became_peered":"2023-07-14T18:11:13.776353+0000","last_unstale":"2023-07-14T18:11:15.116864+0000","last_undegraded":"2023-07-14T18:11:15.116864+0000","last_fullsized":"2023-07-14T18:11:15.116864+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:12.753466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:12.753466+0000","last_clean_scrub_stamp":"2023-07-14T18:11:12.753466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:40:03.971774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.5","version":"84'4","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:11:30.766318+0000","last_change":"2023-07-14T18:11:08.691634+0000","last_active":"2023-07-14T18:11:30.766318+0000","last_peered":"2023-07-14T18:11:30.766318+0000","last_clean":"2023-07-14T18:11:30.766318+0000","last_became_active":"2023-07-14T18:11:08.691315+0000","last_became_peered":"2023-07-14T18:11:08.691315+0000","last_unstale":"2023-07-14T18:11:30.766318+0000","last_undegraded":"2023-07-14T18:11:30.766318+0000","last_fullsized":"2023-07-14T18:11:30.766318+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:07.665746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:07.665746+0000","last_clean_scrub_stamp":"2023-07-14T18:11:07.665746+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:52:43.536254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":20,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:11:14.791290+0000","last_change":"2023-07-14T18:11:09.707486+0000","last_active":"2023-07-14T18:11:14.791290+0000","last_peered":"2023-07-14T18:11:14.791290+0000","last_clean":"2023-07-14T18:11:14.791290+0000","last_became_active":"2023-07-14T18:11:09.707168+0000","last_became_peered":"2023-07-14T18:11:09.707168+0000","last_unstale":"2023-07-14T18:11:14.791290+0000","last_undegraded":"2023-07-14T18:11:14.791290+0000","last_fullsized":"2023-07-14T18:11:14.791290+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_clean_scrub_stamp":"2023-07-14T18:11:08.667354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T06:10:06.422348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":13,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:11:14.885841+0000","last_change":"2023-07-14T18:11:13.905898+0000","last_active":"2023-07-14T18:11:14.885841+0000","last_peered":"2023-07-14T18:11:14.885841+0000","last_clean":"2023-07-14T18:11:14.885841+0000","last_became_active":"2023-07-14T18:11:13.905482+0000","last_became_peered":"2023-07-14T18:11:13.905482+0000","last_unstale":"2023-07-14T18:11:14.885841+0000","last_undegraded":"2023-07-14T18:11:14.885841+0000","last_fullsized":"2023-07-14T18:11:14.885841+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:12.753466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:12.753466+0000","last_clean_scrub_stamp":"2023-07-14T18:11:12.753466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T01:29:14.269244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"82'1","reported_seq":23,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:11:14.886941+0000","last_change":"2023-07-14T18:11:08.692339+0000","last_active":"2023-07-14T18:11:14.886941+0000","last_peered":"2023-07-14T18:11:14.886941+0000","last_clean":"2023-07-14T18:11:14.886941+0000","last_became_active":"2023-07-14T18:11:08.692047+0000","last_became_peered":"2023-07-14T18:11:08.692047+0000","last_unstale":"2023-07-14T18:11:14.886941+0000","last_undegraded":"2023-07-14T18:11:14.886941+0000","last_fullsized":"2023-07-14T18:11:14.886941+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:07.665746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:07.665746+0000","last_clean_scrub_stamp":"2023-07-14T18:11:07.665746+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:12:32.523480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":20,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:11:14.886517+0000","last_change":"2023-07-14T18:11:09.709900+0000","last_active":"2023-07-14T18:11:14.886517+0000","last_peered":"2023-07-14T18:11:14.886517+0000","last_clean":"2023-07-14T18:11:14.886517+0000","last_became_active":"2023-07-14T18:11:09.709291+0000","last_became_peered":"2023-07-14T18:11:09.709291+0000","last_unstale":"2023-07-14T18:11:14.886517+0000","last_undegraded":"2023-07-14T18:11:14.886517+0000","last_fullsized":"2023-07-14T18:11:14.886517+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_clean_scrub_stamp":"2023-07-14T18:11:08.667354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:28:37.556066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":13,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:11:14.884032+0000","last_change":"2023-07-14T18:11:13.777493+0000","last_active":"2023-07-14T18:11:14.884032+0000","last_peered":"2023-07-14T18:11:14.884032+0000","last_clean":"2023-07-14T18:11:14.884032+0000","last_became_active":"2023-07-14T18:11:13.777110+0000","last_became_peered":"2023-07-14T18:11:13.777110+0000","last_unstale":"2023-07-14T18:11:14.884032+0000","last_undegraded":"2023-07-14T18:11:14.884032+0000","last_fullsized":"2023-07-14T18:11:14.884032+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:12.753466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:12.753466+0000","last_clean_scrub_stamp":"2023-07-14T18:11:12.753466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T04:26:56.453763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"79'2","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:11:14.885895+0000","last_change":"2023-07-14T18:11:08.686832+0000","last_active":"2023-07-14T18:11:14.885895+0000","last_peered":"2023-07-14T18:11:14.885895+0000","last_clean":"2023-07-14T18:11:14.885895+0000","last_became_active":"2023-07-14T18:11:08.686461+0000","last_became_peered":"2023-07-14T18:11:08.686461+0000","last_unstale":"2023-07-14T18:11:14.885895+0000","last_undegraded":"2023-07-14T18:11:14.885895+0000","last_fullsized":"2023-07-14T18:11:14.885895+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:07.665746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:07.665746+0000","last_clean_scrub_stamp":"2023-07-14T18:11:07.665746+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:28:44.517803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":20,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:11:14.884614+0000","last_change":"2023-07-14T18:11:09.715641+0000","last_active":"2023-07-14T18:11:14.884614+0000","last_peered":"2023-07-14T18:11:14.884614+0000","last_clean":"2023-07-14T18:11:14.884614+0000","last_became_active":"2023-07-14T18:11:09.715312+0000","last_became_peered":"2023-07-14T18:11:09.715312+0000","last_unstale":"2023-07-14T18:11:14.884614+0000","last_undegraded":"2023-07-14T18:11:14.884614+0000","last_fullsized":"2023-07-14T18:11:14.884614+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_clean_scrub_stamp":"2023-07-14T18:11:08.667354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:42:02.097258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":13,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:11:14.886127+0000","last_change":"2023-07-14T18:11:13.905856+0000","last_active":"2023-07-14T18:11:14.886127+0000","last_peered":"2023-07-14T18:11:14.886127+0000","last_clean":"2023-07-14T18:11:14.886127+0000","last_became_active":"2023-07-14T18:11:13.905441+0000","last_became_peered":"2023-07-14T18:11:13.905441+0000","last_unstale":"2023-07-14T18:11:14.886127+0000","last_undegraded":"2023-07-14T18:11:14.886127+0000","last_fullsized":"2023-07-14T18:11:14.886127+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:12.753466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:12.753466+0000","last_clean_scrub_stamp":"2023-07-14T18:11:12.753466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T04:13:12.089073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,9],"acting":[4,5,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"84'2","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:11:27.817107+0000","last_change":"2023-07-14T18:11:08.685683+0000","last_active":"2023-07-14T18:11:27.817107+0000","last_peered":"2023-07-14T18:11:27.817107+0000","last_clean":"2023-07-14T18:11:27.817107+0000","last_became_active":"2023-07-14T18:11:08.685371+0000","last_became_peered":"2023-07-14T18:11:08.685371+0000","last_unstale":"2023-07-14T18:11:27.817107+0000","last_undegraded":"2023-07-14T18:11:27.817107+0000","last_fullsized":"2023-07-14T18:11:27.817107+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:07.665746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:07.665746+0000","last_clean_scrub_stamp":"2023-07-14T18:11:07.665746+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:19:35.470859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":20,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:11:14.884696+0000","last_change":"2023-07-14T18:11:09.711219+0000","last_active":"2023-07-14T18:11:14.884696+0000","last_peered":"2023-07-14T18:11:14.884696+0000","last_clean":"2023-07-14T18:11:14.884696+0000","last_became_active":"2023-07-14T18:11:09.711019+0000","last_became_peered":"2023-07-14T18:11:09.711019+0000","last_unstale":"2023-07-14T18:11:14.884696+0000","last_undegraded":"2023-07-14T18:11:14.884696+0000","last_fullsized":"2023-07-14T18:11:14.884696+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_clean_scrub_stamp":"2023-07-14T18:11:08.667354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:14:56.588616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":13,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:11:14.887189+0000","last_change":"2023-07-14T18:11:13.788530+0000","last_active":"2023-07-14T18:11:14.887189+0000","last_peered":"2023-07-14T18:11:14.887189+0000","last_clean":"2023-07-14T18:11:14.887189+0000","last_became_active":"2023-07-14T18:11:13.787952+0000","last_became_peered":"2023-07-14T18:11:13.787952+0000","last_unstale":"2023-07-14T18:11:14.887189+0000","last_undegraded":"2023-07-14T18:11:14.887189+0000","last_fullsized":"2023-07-14T18:11:14.887189+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:12.753466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:12.753466+0000","last_clean_scrub_stamp":"2023-07-14T18:11:12.753466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:19:37.880630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.9","version":"84'7","reported_seq":29,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:11:30.772567+0000","last_change":"2023-07-14T18:11:08.692719+0000","last_active":"2023-07-14T18:11:30.772567+0000","last_peered":"2023-07-14T18:11:30.772567+0000","last_clean":"2023-07-14T18:11:30.772567+0000","last_became_active":"2023-07-14T18:11:08.692390+0000","last_became_peered":"2023-07-14T18:11:08.692390+0000","last_unstale":"2023-07-14T18:11:30.772567+0000","last_undegraded":"2023-07-14T18:11:30.772567+0000","last_fullsized":"2023-07-14T18:11:30.772567+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:07.665746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:07.665746+0000","last_clean_scrub_stamp":"2023-07-14T18:11:07.665746+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T04:19:14.229274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":20,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:11:15.116807+0000","last_change":"2023-07-14T18:11:09.719176+0000","last_active":"2023-07-14T18:11:15.116807+0000","last_peered":"2023-07-14T18:11:15.116807+0000","last_clean":"2023-07-14T18:11:15.116807+0000","last_became_active":"2023-07-14T18:11:09.712667+0000","last_became_peered":"2023-07-14T18:11:09.712667+0000","last_unstale":"2023-07-14T18:11:15.116807+0000","last_undegraded":"2023-07-14T18:11:15.116807+0000","last_fullsized":"2023-07-14T18:11:15.116807+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_clean_scrub_stamp":"2023-07-14T18:11:08.667354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:13:03.473559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":13,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:11:14.885541+0000","last_change":"2023-07-14T18:11:13.791717+0000","last_active":"2023-07-14T18:11:14.885541+0000","last_peered":"2023-07-14T18:11:14.885541+0000","last_clean":"2023-07-14T18:11:14.885541+0000","last_became_active":"2023-07-14T18:11:13.791280+0000","last_became_peered":"2023-07-14T18:11:13.791280+0000","last_unstale":"2023-07-14T18:11:14.885541+0000","last_undegraded":"2023-07-14T18:11:14.885541+0000","last_fullsized":"2023-07-14T18:11:14.885541+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:12.753466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:12.753466+0000","last_clean_scrub_stamp":"2023-07-14T18:11:12.753466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:02:11.918589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9,7,8],"acting":[4,9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"84'1","reported_seq":23,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:11:14.884580+0000","last_change":"2023-07-14T18:11:08.692842+0000","last_active":"2023-07-14T18:11:14.884580+0000","last_peered":"2023-07-14T18:11:14.884580+0000","last_clean":"2023-07-14T18:11:14.884580+0000","last_became_active":"2023-07-14T18:11:08.692534+0000","last_became_peered":"2023-07-14T18:11:08.692534+0000","last_unstale":"2023-07-14T18:11:14.884580+0000","last_undegraded":"2023-07-14T18:11:14.884580+0000","last_fullsized":"2023-07-14T18:11:14.884580+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:07.665746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:07.665746+0000","last_clean_scrub_stamp":"2023-07-14T18:11:07.665746+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T06:10:00.305017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":20,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:11:14.885673+0000","last_change":"2023-07-14T18:11:09.703665+0000","last_active":"2023-07-14T18:11:14.885673+0000","last_peered":"2023-07-14T18:11:14.885673+0000","last_clean":"2023-07-14T18:11:14.885673+0000","last_became_active":"2023-07-14T18:11:09.703288+0000","last_became_peered":"2023-07-14T18:11:09.703288+0000","last_unstale":"2023-07-14T18:11:14.885673+0000","last_undegraded":"2023-07-14T18:11:14.885673+0000","last_fullsized":"2023-07-14T18:11:14.885673+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_clean_scrub_stamp":"2023-07-14T18:11:08.667354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:03:08.989108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":13,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:11:14.885620+0000","last_change":"2023-07-14T18:11:13.904604+0000","last_active":"2023-07-14T18:11:14.885620+0000","last_peered":"2023-07-14T18:11:14.885620+0000","last_clean":"2023-07-14T18:11:14.885620+0000","last_became_active":"2023-07-14T18:11:13.904245+0000","last_became_peered":"2023-07-14T18:11:13.904245+0000","last_unstale":"2023-07-14T18:11:14.885620+0000","last_undegraded":"2023-07-14T18:11:14.885620+0000","last_fullsized":"2023-07-14T18:11:14.885620+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:12.753466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:12.753466+0000","last_clean_scrub_stamp":"2023-07-14T18:11:12.753466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:22:17.468414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.b","version":"84'4","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:11:27.818020+0000","last_change":"2023-07-14T18:11:08.689876+0000","last_active":"2023-07-14T18:11:27.818020+0000","last_peered":"2023-07-14T18:11:27.818020+0000","last_clean":"2023-07-14T18:11:27.818020+0000","last_became_active":"2023-07-14T18:11:08.689582+0000","last_became_peered":"2023-07-14T18:11:08.689582+0000","last_unstale":"2023-07-14T18:11:27.818020+0000","last_undegraded":"2023-07-14T18:11:27.818020+0000","last_fullsized":"2023-07-14T18:11:27.818020+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:07.665746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:07.665746+0000","last_clean_scrub_stamp":"2023-07-14T18:11:07.665746+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:43:59.769036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":18,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:11:14.885962+0000","last_change":"2023-07-14T18:11:09.708228+0000","last_active":"2023-07-14T18:11:14.885962+0000","last_peered":"2023-07-14T18:11:14.885962+0000","last_clean":"2023-07-14T18:11:14.885962+0000","last_became_active":"2023-07-14T18:11:09.707985+0000","last_became_peered":"2023-07-14T18:11:09.707985+0000","last_unstale":"2023-07-14T18:11:14.885962+0000","last_undegraded":"2023-07-14T18:11:14.885962+0000","last_fullsized":"2023-07-14T18:11:14.885962+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_clean_scrub_stamp":"2023-07-14T18:11:08.667354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:01:49.217181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":13,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:11:14.884724+0000","last_change":"2023-07-14T18:11:13.775297+0000","last_active":"2023-07-14T18:11:14.884724+0000","last_peered":"2023-07-14T18:11:14.884724+0000","last_clean":"2023-07-14T18:11:14.884724+0000","last_became_active":"2023-07-14T18:11:13.774857+0000","last_became_peered":"2023-07-14T18:11:13.774857+0000","last_unstale":"2023-07-14T18:11:14.884724+0000","last_undegraded":"2023-07-14T18:11:14.884724+0000","last_fullsized":"2023-07-14T18:11:14.884724+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:12.753466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:12.753466+0000","last_clean_scrub_stamp":"2023-07-14T18:11:12.753466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:27:32.913667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.c","version":"84'5","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:11:29.835855+0000","last_change":"2023-07-14T18:11:08.689560+0000","last_active":"2023-07-14T18:11:29.835855+0000","last_peered":"2023-07-14T18:11:29.835855+0000","last_clean":"2023-07-14T18:11:29.835855+0000","last_became_active":"2023-07-14T18:11:08.689249+0000","last_became_peered":"2023-07-14T18:11:08.689249+0000","last_unstale":"2023-07-14T18:11:29.835855+0000","last_undegraded":"2023-07-14T18:11:29.835855+0000","last_fullsized":"2023-07-14T18:11:29.835855+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:07.665746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:07.665746+0000","last_clean_scrub_stamp":"2023-07-14T18:11:07.665746+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:02:04.221663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1122,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":18,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:11:14.885567+0000","last_change":"2023-07-14T18:11:09.720321+0000","last_active":"2023-07-14T18:11:14.885567+0000","last_peered":"2023-07-14T18:11:14.885567+0000","last_clean":"2023-07-14T18:11:14.885567+0000","last_became_active":"2023-07-14T18:11:09.720080+0000","last_became_peered":"2023-07-14T18:11:09.720080+0000","last_unstale":"2023-07-14T18:11:14.885567+0000","last_undegraded":"2023-07-14T18:11:14.885567+0000","last_fullsized":"2023-07-14T18:11:14.885567+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_clean_scrub_stamp":"2023-07-14T18:11:08.667354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T02:20:48.603885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":13,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:11:14.884372+0000","last_change":"2023-07-14T18:11:13.779349+0000","last_active":"2023-07-14T18:11:14.884372+0000","last_peered":"2023-07-14T18:11:14.884372+0000","last_clean":"2023-07-14T18:11:14.884372+0000","last_became_active":"2023-07-14T18:11:13.778946+0000","last_became_peered":"2023-07-14T18:11:13.778946+0000","last_unstale":"2023-07-14T18:11:14.884372+0000","last_undegraded":"2023-07-14T18:11:14.884372+0000","last_fullsized":"2023-07-14T18:11:14.884372+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:12.753466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:12.753466+0000","last_clean_scrub_stamp":"2023-07-14T18:11:12.753466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T04:25:22.766441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9,1,4],"acting":[0,9,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"79'1","reported_seq":23,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:11:14.791713+0000","last_change":"2023-07-14T18:11:08.683760+0000","last_active":"2023-07-14T18:11:14.791713+0000","last_peered":"2023-07-14T18:11:14.791713+0000","last_clean":"2023-07-14T18:11:14.791713+0000","last_became_active":"2023-07-14T18:11:08.683461+0000","last_became_peered":"2023-07-14T18:11:08.683461+0000","last_unstale":"2023-07-14T18:11:14.791713+0000","last_undegraded":"2023-07-14T18:11:14.791713+0000","last_fullsized":"2023-07-14T18:11:14.791713+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:07.665746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:07.665746+0000","last_clean_scrub_stamp":"2023-07-14T18:11:07.665746+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:26:31.918002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":18,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:11:14.884846+0000","last_change":"2023-07-14T18:11:09.708701+0000","last_active":"2023-07-14T18:11:14.884846+0000","last_peered":"2023-07-14T18:11:14.884846+0000","last_clean":"2023-07-14T18:11:14.884846+0000","last_became_active":"2023-07-14T18:11:09.708410+0000","last_became_peered":"2023-07-14T18:11:09.708410+0000","last_unstale":"2023-07-14T18:11:14.884846+0000","last_undegraded":"2023-07-14T18:11:14.884846+0000","last_fullsized":"2023-07-14T18:11:14.884846+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_clean_scrub_stamp":"2023-07-14T18:11:08.667354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T05:04:14.745169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":13,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:11:14.790903+0000","last_change":"2023-07-14T18:11:13.776584+0000","last_active":"2023-07-14T18:11:14.790903+0000","last_peered":"2023-07-14T18:11:14.790903+0000","last_clean":"2023-07-14T18:11:14.790903+0000","last_became_active":"2023-07-14T18:11:13.775288+0000","last_became_peered":"2023-07-14T18:11:13.775288+0000","last_unstale":"2023-07-14T18:11:14.790903+0000","last_undegraded":"2023-07-14T18:11:14.790903+0000","last_fullsized":"2023-07-14T18:11:14.790903+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:12.753466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:12.753466+0000","last_clean_scrub_stamp":"2023-07-14T18:11:12.753466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T02:35:47.441794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"79'2","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:11:14.791343+0000","last_change":"2023-07-14T18:11:08.687332+0000","last_active":"2023-07-14T18:11:14.791343+0000","last_peered":"2023-07-14T18:11:14.791343+0000","last_clean":"2023-07-14T18:11:14.791343+0000","last_became_active":"2023-07-14T18:11:08.686902+0000","last_became_peered":"2023-07-14T18:11:08.686902+0000","last_unstale":"2023-07-14T18:11:14.791343+0000","last_undegraded":"2023-07-14T18:11:14.791343+0000","last_fullsized":"2023-07-14T18:11:14.791343+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:07.665746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:07.665746+0000","last_clean_scrub_stamp":"2023-07-14T18:11:07.665746+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:33:50.338931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":18,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:11:14.886168+0000","last_change":"2023-07-14T18:11:09.719308+0000","last_active":"2023-07-14T18:11:14.886168+0000","last_peered":"2023-07-14T18:11:14.886168+0000","last_clean":"2023-07-14T18:11:14.886168+0000","last_became_active":"2023-07-14T18:11:09.719038+0000","last_became_peered":"2023-07-14T18:11:09.719038+0000","last_unstale":"2023-07-14T18:11:14.886168+0000","last_undegraded":"2023-07-14T18:11:14.886168+0000","last_fullsized":"2023-07-14T18:11:14.886168+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_clean_scrub_stamp":"2023-07-14T18:11:08.667354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:21:02.431834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":20,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:11:15.116944+0000","last_change":"2023-07-14T18:11:09.710991+0000","last_active":"2023-07-14T18:11:15.116944+0000","last_peered":"2023-07-14T18:11:15.116944+0000","last_clean":"2023-07-14T18:11:15.116944+0000","last_became_active":"2023-07-14T18:11:09.710689+0000","last_became_peered":"2023-07-14T18:11:09.710689+0000","last_unstale":"2023-07-14T18:11:15.116944+0000","last_undegraded":"2023-07-14T18:11:15.116944+0000","last_fullsized":"2023-07-14T18:11:15.116944+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_clean_scrub_stamp":"2023-07-14T18:11:08.667354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:46:01.500390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":20,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:11:14.884240+0000","last_change":"2023-07-14T18:11:09.711793+0000","last_active":"2023-07-14T18:11:14.884240+0000","last_peered":"2023-07-14T18:11:14.884240+0000","last_clean":"2023-07-14T18:11:14.884240+0000","last_became_active":"2023-07-14T18:11:09.711488+0000","last_became_peered":"2023-07-14T18:11:09.711488+0000","last_unstale":"2023-07-14T18:11:14.884240+0000","last_undegraded":"2023-07-14T18:11:14.884240+0000","last_fullsized":"2023-07-14T18:11:14.884240+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_clean_scrub_stamp":"2023-07-14T18:11:08.667354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:57:04.042308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":20,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:11:14.883995+0000","last_change":"2023-07-14T18:11:09.707835+0000","last_active":"2023-07-14T18:11:14.883995+0000","last_peered":"2023-07-14T18:11:14.883995+0000","last_clean":"2023-07-14T18:11:14.883995+0000","last_became_active":"2023-07-14T18:11:09.706863+0000","last_became_peered":"2023-07-14T18:11:09.706863+0000","last_unstale":"2023-07-14T18:11:14.883995+0000","last_undegraded":"2023-07-14T18:11:14.883995+0000","last_fullsized":"2023-07-14T18:11:14.883995+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_clean_scrub_stamp":"2023-07-14T18:11:08.667354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T02:34:34.215440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":20,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:11:14.884701+0000","last_change":"2023-07-14T18:11:09.714879+0000","last_active":"2023-07-14T18:11:14.884701+0000","last_peered":"2023-07-14T18:11:14.884701+0000","last_clean":"2023-07-14T18:11:14.884701+0000","last_became_active":"2023-07-14T18:11:09.714583+0000","last_became_peered":"2023-07-14T18:11:09.714583+0000","last_unstale":"2023-07-14T18:11:14.884701+0000","last_undegraded":"2023-07-14T18:11:14.884701+0000","last_fullsized":"2023-07-14T18:11:14.884701+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_clean_scrub_stamp":"2023-07-14T18:11:08.667354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T03:37:12.524327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":20,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:11:14.790997+0000","last_change":"2023-07-14T18:11:09.710850+0000","last_active":"2023-07-14T18:11:14.790997+0000","last_peered":"2023-07-14T18:11:14.790997+0000","last_clean":"2023-07-14T18:11:14.790997+0000","last_became_active":"2023-07-14T18:11:09.710533+0000","last_became_peered":"2023-07-14T18:11:09.710533+0000","last_unstale":"2023-07-14T18:11:14.790997+0000","last_undegraded":"2023-07-14T18:11:14.790997+0000","last_fullsized":"2023-07-14T18:11:14.790997+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_clean_scrub_stamp":"2023-07-14T18:11:08.667354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T02:32:10.888054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":20,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:11:15.117230+0000","last_change":"2023-07-14T18:11:09.710457+0000","last_active":"2023-07-14T18:11:15.117230+0000","last_peered":"2023-07-14T18:11:15.117230+0000","last_clean":"2023-07-14T18:11:15.117230+0000","last_became_active":"2023-07-14T18:11:09.710163+0000","last_became_peered":"2023-07-14T18:11:09.710163+0000","last_unstale":"2023-07-14T18:11:15.117230+0000","last_undegraded":"2023-07-14T18:11:15.117230+0000","last_fullsized":"2023-07-14T18:11:15.117230+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_clean_scrub_stamp":"2023-07-14T18:11:08.667354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:05:12.700623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":20,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:11:14.884622+0000","last_change":"2023-07-14T18:11:09.709062+0000","last_active":"2023-07-14T18:11:14.884622+0000","last_peered":"2023-07-14T18:11:14.884622+0000","last_clean":"2023-07-14T18:11:14.884622+0000","last_became_active":"2023-07-14T18:11:09.708767+0000","last_became_peered":"2023-07-14T18:11:09.708767+0000","last_unstale":"2023-07-14T18:11:14.884622+0000","last_undegraded":"2023-07-14T18:11:14.884622+0000","last_fullsized":"2023-07-14T18:11:14.884622+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_clean_scrub_stamp":"2023-07-14T18:11:08.667354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T01:00:42.739345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":20,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:11:14.886746+0000","last_change":"2023-07-14T18:11:09.707279+0000","last_active":"2023-07-14T18:11:14.886746+0000","last_peered":"2023-07-14T18:11:14.886746+0000","last_clean":"2023-07-14T18:11:14.886746+0000","last_became_active":"2023-07-14T18:11:09.706972+0000","last_became_peered":"2023-07-14T18:11:09.706972+0000","last_unstale":"2023-07-14T18:11:14.886746+0000","last_undegraded":"2023-07-14T18:11:14.886746+0000","last_fullsized":"2023-07-14T18:11:14.886746+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_clean_scrub_stamp":"2023-07-14T18:11:08.667354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:02:52.034920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":20,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:11:14.791002+0000","last_change":"2023-07-14T18:11:09.709710+0000","last_active":"2023-07-14T18:11:14.791002+0000","last_peered":"2023-07-14T18:11:14.791002+0000","last_clean":"2023-07-14T18:11:14.791002+0000","last_became_active":"2023-07-14T18:11:09.709438+0000","last_became_peered":"2023-07-14T18:11:09.709438+0000","last_unstale":"2023-07-14T18:11:14.791002+0000","last_undegraded":"2023-07-14T18:11:14.791002+0000","last_fullsized":"2023-07-14T18:11:14.791002+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_clean_scrub_stamp":"2023-07-14T18:11:08.667354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T02:06:46.155849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":20,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:11:14.884619+0000","last_change":"2023-07-14T18:11:09.720216+0000","last_active":"2023-07-14T18:11:14.884619+0000","last_peered":"2023-07-14T18:11:14.884619+0000","last_clean":"2023-07-14T18:11:14.884619+0000","last_became_active":"2023-07-14T18:11:09.719775+0000","last_became_peered":"2023-07-14T18:11:09.719775+0000","last_unstale":"2023-07-14T18:11:14.884619+0000","last_undegraded":"2023-07-14T18:11:14.884619+0000","last_fullsized":"2023-07-14T18:11:14.884619+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_clean_scrub_stamp":"2023-07-14T18:11:08.667354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T03:06:39.685042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":20,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:11:14.885075+0000","last_change":"2023-07-14T18:11:09.708462+0000","last_active":"2023-07-14T18:11:14.885075+0000","last_peered":"2023-07-14T18:11:14.885075+0000","last_clean":"2023-07-14T18:11:14.885075+0000","last_became_active":"2023-07-14T18:11:09.705611+0000","last_became_peered":"2023-07-14T18:11:09.705611+0000","last_unstale":"2023-07-14T18:11:14.885075+0000","last_undegraded":"2023-07-14T18:11:14.885075+0000","last_fullsized":"2023-07-14T18:11:14.885075+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_clean_scrub_stamp":"2023-07-14T18:11:08.667354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:45:55.084603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":20,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:11:14.790949+0000","last_change":"2023-07-14T18:11:09.707560+0000","last_active":"2023-07-14T18:11:14.790949+0000","last_peered":"2023-07-14T18:11:14.790949+0000","last_clean":"2023-07-14T18:11:14.790949+0000","last_became_active":"2023-07-14T18:11:09.707216+0000","last_became_peered":"2023-07-14T18:11:09.707216+0000","last_unstale":"2023-07-14T18:11:14.790949+0000","last_undegraded":"2023-07-14T18:11:14.790949+0000","last_fullsized":"2023-07-14T18:11:14.790949+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_clean_scrub_stamp":"2023-07-14T18:11:08.667354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T05:53:45.047425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":20,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:11:15.117017+0000","last_change":"2023-07-14T18:11:09.712059+0000","last_active":"2023-07-14T18:11:15.117017+0000","last_peered":"2023-07-14T18:11:15.117017+0000","last_clean":"2023-07-14T18:11:15.117017+0000","last_became_active":"2023-07-14T18:11:09.711759+0000","last_became_peered":"2023-07-14T18:11:09.711759+0000","last_unstale":"2023-07-14T18:11:15.117017+0000","last_undegraded":"2023-07-14T18:11:15.117017+0000","last_fullsized":"2023-07-14T18:11:15.117017+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_clean_scrub_stamp":"2023-07-14T18:11:08.667354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:30:03.374413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4157440,"data_stored":4132576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":6824,"num_objects":57,"num_object_clones":0,"num_object_copies":171,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":57,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":127,"num_write_kb":36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":38,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":221184,"data_stored":20664,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":109,"ondisk_log_size":109,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":75,"seq":322122547215,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27916,"kb_used_data":900,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717236,"statfs":{"total":95995035648,"available":95966449664,"internally_reserved":0,"allocated":921600,"data_stored":449556,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60499999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52200000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56499999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35399999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84899999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.753}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67700000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79000000000000004}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94899999999999995}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.87}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.997}]}]},{"osd":10,"up_from":68,"seq":292057776146,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28528,"kb_used_data":1512,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716624,"statfs":{"total":95995035648,"available":95965822976,"internally_reserved":0,"allocated":1548288,"data_stored":1044343,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59499999999999997}]},{"osd":1,"last update":"Fri Jul 14 18:11:09 2023","interfaces":[{"interface":"back","average":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"last":0.41299999999999998},{"interface":"front","average":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"last":0.64100000000000001}]},{"osd":2,"last update":"Fri Jul 14 18:11:09 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":0.84799999999999998,"5min":0.84799999999999998,"15min":0.84799999999999998},"last":0.61599999999999999}]},{"osd":3,"last update":"Fri Jul 14 18:11:09 2023","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.96099999999999997,"5min":0.96099999999999997,"15min":0.96099999999999997},"last":0.44500000000000001},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":0.95099999999999996,"5min":0.95099999999999996,"15min":0.95099999999999996},"last":0.502}]},{"osd":4,"last update":"Fri Jul 14 18:11:09 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"last":0.46600000000000003},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.97599999999999998,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.65600000000000003}]},{"osd":5,"last update":"Fri Jul 14 18:11:09 2023","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":1.0049999999999999,"5min":1.0049999999999999,"15min":1.0049999999999999},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":0.89500000000000002},"last":0.71099999999999997}]},{"osd":6,"last update":"Fri Jul 14 18:11:09 2023","interfaces":[{"interface":"back","average":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.004,"5min":1.004,"15min":1.004},"last":0.67000000000000004},{"interface":"front","average":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"min":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.1040000000000001,"5min":1.1040000000000001,"15min":1.1040000000000001},"last":0.69899999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49399999999999999}]},{"osd":8,"last update":"Fri Jul 14 18:11:09 2023","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":0.753,"15min":0.753},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":1.038,"5min":1.038,"15min":1.038},"last":0.74099999999999999},{"interface":"front","average":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.0820000000000001,"5min":1.0820000000000001,"15min":1.0820000000000001},"last":0.68799999999999994}]},{"osd":9,"last update":"Fri Jul 14 18:11:09 2023","interfaces":[{"interface":"back","average":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"min":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"max":{"1min":1.018,"5min":1.018,"15min":1.018},"last":0.77100000000000002},{"interface":"front","average":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"min":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"max":{"1min":1.228,"5min":1.228,"15min":1.228},"last":0.72999999999999998}]},{"osd":11,"last update":"Fri Jul 14 18:11:27 2023","interfaces":[{"interface":"back","average":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":0.97899999999999998,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.75900000000000001},{"interface":"front","average":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.0309999999999999,"5min":1.0309999999999999,"15min":1.0309999999999999},"last":0.79200000000000004}]}]},{"osd":9,"up_from":63,"seq":270582939671,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27924,"kb_used_data":904,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717228,"statfs":{"total":95995035648,"available":95966441472,"internally_reserved":0,"allocated":925696,"data_stored":450138,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 18:10:48 2023","interfaces":[{"interface":"back","average":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"last":0.35199999999999998},{"interface":"front","average":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"last":0.27800000000000002}]},{"osd":1,"last update":"Fri Jul 14 18:10:48 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.94099999999999995,"5min":0.94099999999999995,"15min":0.94099999999999995},"last":0.63800000000000001},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.65100000000000002}]},{"osd":2,"last update":"Fri Jul 14 18:10:48 2023","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.89300000000000002,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.70899999999999996}]},{"osd":3,"last update":"Fri Jul 14 18:10:48 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"last":0.33400000000000002},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.32200000000000001}]},{"osd":4,"last update":"Fri Jul 14 18:10:48 2023","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.95499999999999996,"5min":0.95499999999999996,"15min":0.95499999999999996},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1,"5min":1,"15min":1},"last":0.76600000000000001}]},{"osd":5,"last update":"Fri Jul 14 18:10:48 2023","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":1.093,"5min":1.093,"15min":1.093},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.1100000000000001,"5min":1.1100000000000001,"15min":1.1100000000000001},"last":0.68000000000000005}]},{"osd":6,"last update":"Fri Jul 14 18:10:48 2023","interfaces":[{"interface":"back","average":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":1.069,"5min":1.069,"15min":1.069},"last":0.45800000000000002},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":1.0409999999999999,"5min":1.0409999999999999,"15min":1.0409999999999999},"last":0.57799999999999996}]},{"osd":7,"last update":"Fri Jul 14 18:10:48 2023","interfaces":[{"interface":"back","average":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.0329999999999999,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.69399999999999995},{"interface":"front","average":{"1min":0.746,"5min":0.746,"15min":0.746},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.1890000000000001,"5min":1.1890000000000001,"15min":1.1890000000000001},"last":0.58499999999999996}]},{"osd":8,"last update":"Fri Jul 14 18:10:48 2023","interfaces":[{"interface":"back","average":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":1.127,"5min":1.127,"15min":1.127},"last":0.75},{"interface":"front","average":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"min":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"max":{"1min":1.167,"5min":1.167,"15min":1.167},"last":0.57499999999999996}]},{"osd":10,"last update":"Fri Jul 14 18:11:08 2023","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.99099999999999999,"5min":0.99099999999999999,"15min":0.99099999999999999},"last":0.78700000000000003},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.0569999999999999,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":0.72899999999999998}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80400000000000005}]}]},{"osd":8,"up_from":56,"seq":240518168604,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27932,"kb_used_data":916,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717220,"statfs":{"total":95995035648,"available":95966433280,"internally_reserved":0,"allocated":937984,"data_stored":450013,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 18:11:29 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.54100000000000004,"15min":0.54200000000000004},"min":{"1min":0.40699999999999997,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.68300000000000005,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.44700000000000001},{"interface":"front","average":{"1min":0.51200000000000001,"5min":0.51900000000000002,"15min":0.52000000000000002},"min":{"1min":0.36199999999999999,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.75,"5min":0.78200000000000003,"15min":0.78200000000000003},"last":0.48999999999999999}]},{"osd":1,"last update":"Fri Jul 14 18:11:29 2023","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.61299999999999999,"15min":0.60999999999999999},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.93100000000000005,"5min":1.036,"15min":1.036},"last":0.46500000000000002},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"min":{"1min":0.40899999999999997,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.89500000000000002,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.55900000000000005}]},{"osd":2,"last update":"Fri Jul 14 18:11:29 2023","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.45700000000000002,"15min":0.45100000000000001},"min":{"1min":0.29199999999999998,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":1.032,"5min":1.032,"15min":1.032},"last":0.70899999999999996},{"interface":"front","average":{"1min":0.49099999999999999,"5min":0.47499999999999998,"15min":0.47299999999999998},"min":{"1min":0.33200000000000002,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":1.0449999999999999,"5min":1.0449999999999999,"15min":1.0449999999999999},"last":0.623}]},{"osd":3,"last update":"Fri Jul 14 18:11:29 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.57699999999999996,"15min":0.58299999999999996},"min":{"1min":0.42099999999999999,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.69799999999999995,"5min":0.77300000000000002,"15min":0.77300000000000002},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.58799999999999997,"15min":0.58999999999999997},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.77500000000000002,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.76400000000000001}]},{"osd":4,"last update":"Fri Jul 14 18:11:29 2023","interfaces":[{"interface":"back","average":{"1min":0.77500000000000002,"5min":0.66600000000000004,"15min":0.64800000000000002},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":2.5030000000000001,"5min":2.5030000000000001,"15min":2.5030000000000001},"last":0.97599999999999998},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.63900000000000001,"15min":0.63500000000000001},"min":{"1min":0.40600000000000003,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.81599999999999995}]},{"osd":5,"last update":"Fri Jul 14 18:11:29 2023","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.59299999999999997,"15min":0.58699999999999997},"min":{"1min":0.36099999999999999,"5min":0.316,"15min":0.316},"max":{"1min":0.98199999999999998,"5min":0.98199999999999998,"15min":0.98199999999999998},"last":0.66400000000000003},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.60099999999999998,"15min":0.59899999999999998},"min":{"1min":0.38600000000000001,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.84799999999999998}]},{"osd":6,"last update":"Fri Jul 14 18:11:29 2023","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"min":{"1min":0.45800000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.90700000000000003,"5min":0.90700000000000003,"15min":0.90700000000000003},"last":0.90700000000000003},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.69799999999999995,"15min":0.70299999999999996},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.89700000000000002,"5min":1.008,"15min":1.008},"last":0.73299999999999998}]},{"osd":7,"last update":"Fri Jul 14 18:11:29 2023","interfaces":[{"interface":"back","average":{"1min":0.83999999999999997,"5min":0.73799999999999999,"15min":0.72099999999999997},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":2.5550000000000002,"5min":2.5550000000000002,"15min":2.5550000000000002},"last":0.79700000000000004},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.71799999999999997,"15min":0.71499999999999997},"min":{"1min":0.52000000000000002,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.0529999999999999,"5min":1.0529999999999999,"15min":1.0529999999999999},"last":1.0529999999999999}]},{"osd":9,"last update":"Fri Jul 14 18:10:48 2023","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":0.94699999999999995,"5min":0.94699999999999995,"15min":0.94699999999999995},"last":1.0149999999999999},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.94899999999999995}]},{"osd":10,"last update":"Fri Jul 14 18:11:09 2023","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.024,"5min":1.024,"15min":1.024},"last":0.89100000000000001},{"interface":"front","average":{"1min":0.745,"5min":0.745,"15min":0.745},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.006,"5min":1.006,"15min":1.006},"last":1.0329999999999999}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92900000000000005}]}]},{"osd":7,"up_from":49,"seq":210453397535,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28512,"kb_used_data":1496,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716640,"statfs":{"total":95995035648,"available":95965839360,"internally_reserved":0,"allocated":1531904,"data_stored":1041620,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 18:11:06 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.55300000000000005,"15min":0.54600000000000004},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"last":0.38400000000000001},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"min":{"1min":0.35599999999999998,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.77900000000000003,"5min":0.84299999999999997,"15min":0.84299999999999997},"last":0.35599999999999998}]},{"osd":1,"last update":"Fri Jul 14 18:11:06 2023","interfaces":[{"interface":"back","average":{"1min":0.45100000000000001,"5min":0.41899999999999998,"15min":0.41399999999999998},"min":{"1min":0.29699999999999999,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.751,"5min":0.751,"15min":0.751},"last":0.47699999999999998},{"interface":"front","average":{"1min":0.45200000000000001,"5min":0.442,"15min":0.44},"min":{"1min":0.30399999999999999,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.41699999999999998}]},{"osd":2,"last update":"Fri Jul 14 18:11:06 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"min":{"1min":0.39100000000000001,"5min":0.313,"15min":0.313},"max":{"1min":0.70899999999999996,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.68400000000000005},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.60899999999999999,"15min":0.61299999999999999},"min":{"1min":0.40999999999999998,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"last":0.64300000000000002}]},{"osd":3,"last update":"Fri Jul 14 18:11:06 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.60599999999999998,"15min":0.59999999999999998},"min":{"1min":0.432,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.88100000000000001,"5min":0.88100000000000001,"15min":0.88100000000000001},"last":0.625}]},{"osd":4,"last update":"Fri Jul 14 18:11:06 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.52300000000000002,"15min":0.52000000000000002},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.47199999999999998,"5min":0.496,"15min":0.5},"min":{"1min":0.32100000000000001,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.44800000000000001}]},{"osd":5,"last update":"Fri Jul 14 18:11:06 2023","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.65600000000000003,"15min":0.66400000000000003},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.79000000000000004,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.82199999999999995},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.65000000000000002,"15min":0.65300000000000002},"min":{"1min":0.48899999999999999,"5min":0.38,"15min":0.38},"max":{"1min":0.81799999999999995,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.83599999999999997}]},{"osd":6,"last update":"Fri Jul 14 18:11:06 2023","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.67400000000000004,"15min":0.66800000000000004},"min":{"1min":0.504,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.89400000000000002,"5min":0.89400000000000002,"15min":0.89400000000000002},"last":0.66200000000000003},{"interface":"front","average":{"1min":0.625,"5min":0.66600000000000004,"15min":0.67300000000000004},"min":{"1min":0.40200000000000002,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.82599999999999996,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.55200000000000005}]},{"osd":8,"last update":"Fri Jul 14 18:11:27 2023","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.70899999999999996,"15min":0.70899999999999996},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":0.94399999999999995,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.79200000000000004},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.67700000000000005,"15min":0.67900000000000005},"min":{"1min":0.52400000000000002,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.873,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.77500000000000002}]},{"osd":9,"last update":"Fri Jul 14 18:10:48 2023","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"last":0.73199999999999998},{"interface":"front","average":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.0189999999999999,"5min":1.0189999999999999,"15min":1.0189999999999999},"last":0.76100000000000001}]},{"osd":10,"last update":"Fri Jul 14 18:11:08 2023","interfaces":[{"interface":"back","average":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.046,"5min":1.046,"15min":1.046},"last":0.71399999999999997},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":0.89500000000000002},"last":0.80600000000000005}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85799999999999998}]}]},{"osd":6,"up_from":44,"seq":188978561060,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27916,"kb_used_data":900,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717236,"statfs":{"total":95995035648,"available":95966449664,"internally_reserved":0,"allocated":921600,"data_stored":449556,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 18:10:43 2023","interfaces":[{"interface":"back","average":{"1min":0.41599999999999998,"5min":0.39900000000000002,"15min":0.39600000000000002},"min":{"1min":0.27500000000000002,"5min":0.217,"15min":0.217},"max":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"last":0.312},{"interface":"front","average":{"1min":0.439,"5min":0.41399999999999998,"15min":0.40999999999999998},"min":{"1min":0.27200000000000002,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"last":0.33300000000000002}]},{"osd":1,"last update":"Fri Jul 14 18:10:43 2023","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.54600000000000004,"15min":0.53200000000000003},"min":{"1min":0.46700000000000003,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":1.0389999999999999,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.41099999999999998},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.51800000000000002,"15min":0.50600000000000001},"min":{"1min":0.42399999999999999,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":1.048,"5min":1.048,"15min":1.048},"last":0.441}]},{"osd":2,"last update":"Fri Jul 14 18:10:43 2023","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.58399999999999996,"15min":0.57699999999999996},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":0.46100000000000002},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.58499999999999996,"15min":0.58299999999999996},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.78400000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.48199999999999998}]},{"osd":3,"last update":"Fri Jul 14 18:10:43 2023","interfaces":[{"interface":"back","average":{"1min":0.48099999999999998,"5min":0.44900000000000001,"15min":0.44400000000000001},"min":{"1min":0.31900000000000001,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.35899999999999999},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.498,"15min":0.49099999999999999},"min":{"1min":0.318,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"last":0.42799999999999999}]},{"osd":4,"last update":"Fri Jul 14 18:10:43 2023","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.624,"15min":0.60999999999999999},"min":{"1min":0.46400000000000002,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":1.087,"5min":1.087,"15min":1.087},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.629,"5min":0.57699999999999996,"15min":0.56899999999999995},"min":{"1min":0.42399999999999999,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":1.014,"5min":1.014,"15min":1.014},"last":0.46899999999999997}]},{"osd":5,"last update":"Fri Jul 14 18:10:43 2023","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.67600000000000005,"15min":0.67300000000000004},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.90800000000000003,"5min":0.95199999999999996,"15min":0.95199999999999996},"last":0.498},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.70599999999999996,"15min":0.69999999999999996},"min":{"1min":0.45600000000000002,"5min":0.443,"15min":0.443},"max":{"1min":0.86499999999999999,"5min":0.878,"15min":0.878},"last":0.54400000000000004}]},{"osd":7,"last update":"Fri Jul 14 18:11:13 2023","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.67000000000000004,"15min":0.66600000000000004},"min":{"1min":0.48199999999999998,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.96299999999999997,"5min":1.03,"15min":1.03},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.71099999999999997,"15min":0.70599999999999996},"min":{"1min":0.52400000000000002,"5min":0.443,"15min":0.443},"max":{"1min":1.0700000000000001,"5min":1.0700000000000001,"15min":1.0700000000000001},"last":0.58699999999999997}]},{"osd":8,"last update":"Fri Jul 14 18:10:25 2023","interfaces":[{"interface":"back","average":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"min":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":0.99399999999999999,"5min":0.99399999999999999,"15min":0.99399999999999999},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.51000000000000001}]},{"osd":9,"last update":"Fri Jul 14 18:10:50 2023","interfaces":[{"interface":"back","average":{"1min":0.752,"5min":0.752,"15min":0.752},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.0449999999999999,"5min":1.0449999999999999,"15min":1.0449999999999999},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":1.0249999999999999,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.56699999999999995}]},{"osd":10,"last update":"Fri Jul 14 18:11:13 2023","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":1.026,"5min":1.026,"15min":1.026},"last":0.63},{"interface":"front","average":{"1min":0.755,"5min":0.755,"15min":0.755},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":0.99399999999999999,"5min":0.99399999999999999,"15min":0.99399999999999999},"last":0.53400000000000003}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59799999999999998}]}]},{"osd":1,"up_from":13,"seq":55834574904,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27924,"kb_used_data":908,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717228,"statfs":{"total":95995035648,"available":95966441472,"internally_reserved":0,"allocated":929792,"data_stored":453077,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 18:11:05 2023","interfaces":[{"interface":"back","average":{"1min":0.63700000000000001,"5min":0.55500000000000005,"15min":0.53200000000000003},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.93899999999999995,"5min":0.98899999999999999,"15min":0.98899999999999999},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.54000000000000004,"15min":0.52500000000000002},"min":{"1min":0.35299999999999998,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.40699999999999997}]},{"osd":2,"last update":"Fri Jul 14 18:11:27 2023","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.55500000000000005,"15min":0.50800000000000001},"min":{"1min":0.34699999999999998,"5min":0.314,"15min":0.314},"max":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.34699999999999998},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.53600000000000003,"15min":0.49399999999999999},"min":{"1min":0.371,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"last":0.376}]},{"osd":3,"last update":"Fri Jul 14 18:10:48 2023","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.54300000000000004,"15min":0.52300000000000002},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"last":0.47399999999999998},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.58599999999999997,"15min":0.54200000000000004},"min":{"1min":0.45000000000000001,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.96799999999999997,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.65800000000000003}]},{"osd":4,"last update":"Fri Jul 14 18:11:05 2023","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.435,"15min":0.40699999999999997},"min":{"1min":0.245,"5min":0.245,"15min":0.245},"max":{"1min":0.879,"5min":0.879,"15min":0.879},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.437,"15min":0.40300000000000002},"min":{"1min":0.29299999999999998,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.77000000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"last":0.49299999999999999}]},{"osd":5,"last update":"Fri Jul 14 18:11:27 2023","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.62,"15min":0.59799999999999998},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.96599999999999997,"5min":0.96599999999999997,"15min":0.96599999999999997},"last":0.626},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.64500000000000002,"15min":0.61799999999999999},"min":{"1min":0.434,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"last":0.59099999999999997}]},{"osd":6,"last update":"Fri Jul 14 18:10:46 2023","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.624,"15min":0.61499999999999999},"min":{"1min":0.46700000000000003,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.93700000000000006,"5min":0.93700000000000006,"15min":0.93700000000000006},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.64900000000000002,"15min":0.64100000000000001},"min":{"1min":0.40899999999999997,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.91900000000000004,"5min":0.91900000000000004,"15min":0.91900000000000004},"last":0.67900000000000005}]},{"osd":7,"last update":"Fri Jul 14 18:11:10 2023","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.61299999999999999,"15min":0.60199999999999998},"min":{"1min":0.36899999999999999,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":1.0640000000000001,"5min":1.0640000000000001,"15min":1.0640000000000001},"last":0.72299999999999998},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.64400000000000002,"15min":0.64000000000000001},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":1.0489999999999999,"5min":1.0489999999999999,"15min":1.0489999999999999},"last":0.71299999999999997}]},{"osd":8,"last update":"Fri Jul 14 18:11:27 2023","interfaces":[{"interface":"back","average":{"1min":0.76900000000000002,"5min":0.752,"15min":0.749},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":1.054,"5min":1.054,"15min":1.054},"last":0.80100000000000005},{"interface":"front","average":{"1min":0.78500000000000003,"5min":0.76200000000000001,"15min":0.75800000000000001},"min":{"1min":0.48899999999999999,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":1.016,"5min":1.026,"15min":1.026},"last":0.77400000000000002}]},{"osd":9,"last update":"Fri Jul 14 18:10:48 2023","interfaces":[{"interface":"back","average":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"min":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":1.01,"5min":1.01,"15min":1.01},"last":0.69599999999999995},{"interface":"front","average":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.0589999999999999,"5min":1.0589999999999999,"15min":1.0589999999999999},"last":0.745}]},{"osd":10,"last update":"Fri Jul 14 18:11:10 2023","interfaces":[{"interface":"back","average":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.0649999999999999,"5min":1.0649999999999999,"15min":1.0649999999999999},"last":0.84799999999999998},{"interface":"front","average":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.0489999999999999,"5min":1.0489999999999999,"15min":1.0489999999999999},"last":0.76000000000000001}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81299999999999994}]}]},{"osd":0,"up_from":8,"seq":34359738429,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27932,"kb_used_data":904,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717220,"statfs":{"total":95995035648,"available":95966433280,"internally_reserved":0,"allocated":925696,"data_stored":449646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Jul 14 18:11:06 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.51800000000000002,"15min":0.50800000000000001},"min":{"1min":0.38200000000000001,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.82199999999999995,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.49099999999999999},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.52700000000000002,"15min":0.50700000000000001},"min":{"1min":0.40000000000000002,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.65700000000000003}]},{"osd":2,"last update":"Fri Jul 14 18:10:29 2023","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.57099999999999995,"15min":0.55800000000000005},"min":{"1min":0.41799999999999998,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.93799999999999994,"5min":0.93799999999999994,"15min":0.93799999999999994},"last":0.78900000000000003},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.53700000000000003,"15min":0.52100000000000002},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"last":0.71099999999999997}]},{"osd":3,"last update":"Fri Jul 14 18:09:46 2023","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.436,"15min":0.42599999999999999},"min":{"1min":0.29699999999999999,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"last":0.36799999999999999},{"interface":"front","average":{"1min":0.46700000000000003,"5min":0.42799999999999999,"15min":0.42199999999999999},"min":{"1min":0.33800000000000002,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.59999999999999998,"5min":0.621,"15min":0.621},"last":0.39200000000000002}]},{"osd":4,"last update":"Fri Jul 14 18:11:06 2023","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.52600000000000002,"15min":0.51000000000000001},"min":{"1min":0.38100000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.57099999999999995,"15min":0.54000000000000004},"min":{"1min":0.46999999999999997,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.83499999999999996,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.63500000000000001}]},{"osd":5,"last update":"Fri Jul 14 18:10:29 2023","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.54400000000000004,"15min":0.52200000000000002},"min":{"1min":0.46300000000000002,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":1.161,"5min":1.161,"15min":1.161},"last":0.57399999999999995},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.56100000000000005,"15min":0.54600000000000004},"min":{"1min":0.42199999999999999,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.879,"5min":0.879,"15min":0.879},"last":0.58699999999999997}]},{"osd":6,"last update":"Fri Jul 14 18:10:48 2023","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.52300000000000002,"15min":0.50800000000000001},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":1.0649999999999999,"5min":1.0649999999999999,"15min":1.0649999999999999},"last":0.40999999999999998},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.52600000000000002,"15min":0.51300000000000001},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":1.3460000000000001,"5min":1.3460000000000001,"15min":1.3460000000000001},"last":0.443}]},{"osd":7,"last update":"Fri Jul 14 18:11:07 2023","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.90100000000000002,"5min":1.204,"15min":1.204},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.72899999999999998,"15min":0.74099999999999999},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.92500000000000004,"5min":1.3080000000000001,"15min":1.3080000000000001},"last":0.64800000000000002}]},{"osd":8,"last update":"Fri Jul 14 18:10:29 2023","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":0.753,"15min":0.753},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":1.3819999999999999,"5min":1.3819999999999999,"15min":1.3819999999999999},"last":0.71999999999999997},{"interface":"front","average":{"1min":0.753,"5min":0.753,"15min":0.753},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.0289999999999999,"5min":1.0289999999999999,"15min":1.0289999999999999},"last":0.74299999999999999}]},{"osd":9,"last update":"Fri Jul 14 18:10:48 2023","interfaces":[{"interface":"back","average":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":1.133,"5min":1.133,"15min":1.133},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":1.28,"5min":1.28,"15min":1.28},"last":0.54100000000000004}]},{"osd":10,"last update":"Fri Jul 14 18:11:07 2023","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":0.97799999999999998,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":0.98299999999999998,"5min":0.98299999999999998,"15min":0.98299999999999998},"last":0.67900000000000005}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77900000000000003}]}]},{"osd":2,"up_from":18,"seq":77309411381,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27956,"kb_used_data":940,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717196,"statfs":{"total":95995035648,"available":95966408704,"internally_reserved":0,"allocated":962560,"data_stored":454953,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 18:11:23 2023","interfaces":[{"interface":"back","average":{"1min":0.46999999999999997,"5min":0.49099999999999999,"15min":0.47899999999999998},"min":{"1min":0.315,"5min":0.255,"15min":0.255},"max":{"1min":0.77500000000000002,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.59899999999999998},{"interface":"front","average":{"1min":0.49199999999999999,"5min":0.47699999999999998,"15min":0.47199999999999998},"min":{"1min":0.33600000000000002,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"last":0.443}]},{"osd":1,"last update":"Fri Jul 14 18:11:23 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.53500000000000003,"15min":0.50700000000000001},"min":{"1min":0.41199999999999998,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.97499999999999998,"5min":0.97499999999999998,"15min":0.97499999999999998},"last":0.82399999999999995},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.55000000000000004,"15min":0.502},"min":{"1min":0.44900000000000001,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":1.1279999999999999,"5min":1.1279999999999999,"15min":1.1279999999999999},"last":0.79400000000000004}]},{"osd":3,"last update":"Fri Jul 14 18:10:41 2023","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.55100000000000005,"15min":0.53500000000000003},"min":{"1min":0.41699999999999998,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.70899999999999996},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.54100000000000004,"15min":0.54100000000000004},"min":{"1min":0.38400000000000001,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.79100000000000004,"5min":0.82199999999999995,"15min":0.82199999999999995},"last":0.55200000000000005}]},{"osd":4,"last update":"Fri Jul 14 18:11:07 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.55200000000000005,"15min":0.54700000000000004},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.94399999999999995,"5min":0.94399999999999995,"15min":0.94399999999999995},"last":0.89900000000000002},{"interface":"front","average":{"1min":0.629,"5min":0.56100000000000005,"15min":0.53400000000000003},"min":{"1min":0.40000000000000002,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.80300000000000005,"5min":0.879,"15min":0.879},"last":0.93600000000000005}]},{"osd":5,"last update":"Fri Jul 14 18:11:28 2023","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.53700000000000003,"15min":0.51100000000000001},"min":{"1min":0.35199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":1.1719999999999999,"5min":1.1719999999999999,"15min":1.1719999999999999},"last":0.48299999999999998},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.52700000000000002,"15min":0.52500000000000002},"min":{"1min":0.32800000000000001,"5min":0.316,"15min":0.316},"max":{"1min":1.1499999999999999,"5min":1.1499999999999999,"15min":1.1499999999999999},"last":0.52000000000000002}]},{"osd":6,"last update":"Fri Jul 14 18:10:51 2023","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.64300000000000002,"15min":0.64700000000000002},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.92600000000000005,"5min":0.92600000000000005,"15min":0.92600000000000005},"last":0.64600000000000002},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.58999999999999997,"15min":0.58799999999999997},"min":{"1min":0.48799999999999999,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.67700000000000005}]},{"osd":7,"last update":"Fri Jul 14 18:11:07 2023","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.63300000000000001,"15min":0.63},"min":{"1min":0.48399999999999999,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1,"5min":1,"15min":1},"last":0.89000000000000001},{"interface":"front","average":{"1min":0.748,"5min":0.71599999999999997,"15min":0.70999999999999996},"min":{"1min":0.57399999999999995,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":0.90200000000000002,"5min":0.998,"15min":0.998},"last":0.879}]},{"osd":8,"last update":"Fri Jul 14 18:11:28 2023","interfaces":[{"interface":"back","average":{"1min":0.83099999999999996,"5min":0.65800000000000003,"15min":0.629},"min":{"1min":0.54800000000000004,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":1.4570000000000001,"5min":1.4570000000000001,"15min":1.4570000000000001},"last":0.746},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.59199999999999997,"15min":0.57799999999999996},"min":{"1min":0.46700000000000003,"5min":0.379,"15min":0.379},"max":{"1min":1.2769999999999999,"5min":1.2769999999999999,"15min":1.2769999999999999},"last":0.75900000000000001}]},{"osd":9,"last update":"Fri Jul 14 18:10:51 2023","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":0.97299999999999998,"5min":0.97299999999999998,"15min":0.97299999999999998},"last":0.84899999999999998},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.73399999999999999}]},{"osd":10,"last update":"Fri Jul 14 18:11:12 2023","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.81000000000000005},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"min":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":0.88700000000000001,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.91200000000000003}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83699999999999997}]}]},{"osd":3,"up_from":25,"seq":107374182448,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27936,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717216,"statfs":{"total":95995035648,"available":95966429184,"internally_reserved":0,"allocated":942080,"data_stored":449633,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 18:10:46 2023","interfaces":[{"interface":"back","average":{"1min":0.39900000000000002,"5min":0.374,"15min":0.36899999999999999},"min":{"1min":0.28100000000000003,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"last":0.29699999999999999},{"interface":"front","average":{"1min":0.44,"5min":0.39700000000000002,"15min":0.38700000000000001},"min":{"1min":0.27700000000000002,"5min":0.248,"15min":0.248},"max":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"last":0.317}]},{"osd":1,"last update":"Fri Jul 14 18:10:46 2023","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.52100000000000002,"15min":0.501},"min":{"1min":0.36499999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.75600000000000001,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.373},{"interface":"front","average":{"1min":0.621,"5min":0.54800000000000004,"15min":0.52400000000000002},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.90400000000000003,"5min":0.90400000000000003,"15min":0.90400000000000003},"last":0.438}]},{"osd":2,"last update":"Fri Jul 14 18:10:46 2023","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.57499999999999996,"15min":0.56899999999999995},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.84799999999999998,"5min":0.84799999999999998,"15min":0.84799999999999998},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.629,"5min":0.57599999999999996,"15min":0.56599999999999995},"min":{"1min":0.45500000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.55700000000000005}]},{"osd":4,"last update":"Fri Jul 14 18:11:06 2023","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.57099999999999995,"15min":0.54000000000000004},"min":{"1min":0.39300000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.58099999999999996,"15min":0.56399999999999995},"min":{"1min":0.42299999999999999,"5min":0.38,"15min":0.38},"max":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.42499999999999999}]},{"osd":5,"last update":"Fri Jul 14 18:11:30 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.60499999999999998,"15min":0.59699999999999998},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.84799999999999998,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.70799999999999996},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.58499999999999996,"15min":0.59099999999999997},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.70499999999999996,"5min":0.875,"15min":0.875},"last":0.65200000000000002}]},{"osd":6,"last update":"Fri Jul 14 18:10:46 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.54100000000000004,"15min":0.53100000000000003},"min":{"1min":0.35199999999999998,"5min":0.317,"15min":0.317},"max":{"1min":1.028,"5min":1.028,"15min":1.028},"last":0.40400000000000003},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.60099999999999998,"15min":0.59299999999999997},"min":{"1min":0.36599999999999999,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":1.0669999999999999,"5min":1.0669999999999999,"15min":1.0669999999999999},"last":0.502}]},{"osd":7,"last update":"Fri Jul 14 18:11:08 2023","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.71399999999999997,"15min":0.71599999999999997},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.008,"5min":1.014,"15min":1.014},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.66800000000000004,"15min":0.67600000000000005},"min":{"1min":0.41199999999999998,"5min":0.376,"15min":0.376},"max":{"1min":0.89100000000000001,"5min":1.131,"15min":1.131},"last":0.60399999999999998}]},{"osd":8,"last update":"Fri Jul 14 18:10:26 2023","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.046,"5min":1.046,"15min":1.046},"last":0.48299999999999998}]},{"osd":9,"last update":"Fri Jul 14 18:10:47 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.98999999999999999,"5min":0.98999999999999999,"15min":0.98999999999999999},"last":0.46400000000000002},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.997,"5min":0.997,"15min":0.997},"last":0.63600000000000001}]},{"osd":10,"last update":"Fri Jul 14 18:11:08 2023","interfaces":[{"interface":"back","average":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"min":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":1.0429999999999999,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.66900000000000004},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":0.95199999999999996,"5min":0.95199999999999996,"15min":0.95199999999999996},"last":0.52600000000000002}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.621}]}]},{"osd":4,"up_from":32,"seq":137438953516,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27924,"kb_used_data":904,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717228,"statfs":{"total":95995035648,"available":95966441472,"internally_reserved":0,"allocated":925696,"data_stored":449578,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 18:10:07 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.49099999999999999,"15min":0.48099999999999998},"min":{"1min":0.32100000000000001,"5min":0.313,"15min":0.313},"max":{"1min":1.347,"5min":1.347,"15min":1.347},"last":0.44400000000000001},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.50900000000000001,"15min":0.501},"min":{"1min":0.312,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":1.417,"5min":1.417,"15min":1.417},"last":0.53500000000000003}]},{"osd":1,"last update":"Fri Jul 14 18:11:10 2023","interfaces":[{"interface":"back","average":{"1min":0.432,"5min":0.39100000000000001,"15min":0.374},"min":{"1min":0.27500000000000002,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.68700000000000006,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.38400000000000001},{"interface":"front","average":{"1min":0.433,"5min":0.38600000000000001,"15min":0.36199999999999999},"min":{"1min":0.29099999999999998,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.626,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.41099999999999998}]},{"osd":2,"last update":"Fri Jul 14 18:11:10 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.54700000000000004,"15min":0.52900000000000003},"min":{"1min":0.39600000000000002,"5min":0.374,"15min":0.374},"max":{"1min":0.72799999999999998,"5min":1.4019999999999999,"15min":1.4019999999999999},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.55900000000000005,"15min":0.53400000000000003},"min":{"1min":0.38,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.82199999999999995,"5min":1.4750000000000001,"15min":1.4750000000000001},"last":0.54700000000000004}]},{"osd":3,"last update":"Fri Jul 14 18:11:10 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.52400000000000002,"15min":0.49199999999999999},"min":{"1min":0.38200000000000001,"5min":0.318,"15min":0.318},"max":{"1min":1.0309999999999999,"5min":1.054,"15min":1.054},"last":0.57399999999999995},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.54400000000000004,"15min":0.52800000000000002},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.84799999999999998,"5min":0.95299999999999996,"15min":0.95299999999999996},"last":0.45400000000000001}]},{"osd":5,"last update":"Fri Jul 14 18:10:31 2023","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.55700000000000005,"15min":0.53600000000000003},"min":{"1min":0.43099999999999999,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":1.177,"5min":1.177,"15min":1.177},"last":0.69399999999999995},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.58199999999999996,"15min":0.56100000000000005},"min":{"1min":0.52000000000000002,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":1.1220000000000001,"5min":1.1220000000000001,"15min":1.1220000000000001},"last":0.73999999999999999}]},{"osd":6,"last update":"Fri Jul 14 18:10:48 2023","interfaces":[{"interface":"back","average":{"1min":0.75800000000000001,"5min":0.628,"15min":0.60599999999999998},"min":{"1min":0.51800000000000002,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":1.101,"5min":1.101,"15min":1.101},"last":0.629},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.624,"15min":0.60799999999999998},"min":{"1min":0.44800000000000001,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":1.446,"5min":1.446,"15min":1.446},"last":0.60299999999999998}]},{"osd":7,"last update":"Fri Jul 14 18:11:10 2023","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.58599999999999997,"15min":0.57399999999999995},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.92200000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.65100000000000002},{"interface":"front","average":{"1min":0.68200000000000005,"5min":0.60999999999999999,"15min":0.59799999999999998},"min":{"1min":0.42999999999999999,"5min":0.316,"15min":0.316},"max":{"1min":1.004,"5min":1.0189999999999999,"15min":1.0189999999999999},"last":0.873}]},{"osd":8,"last update":"Fri Jul 14 18:10:25 2023","interfaces":[{"interface":"back","average":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.3740000000000001,"5min":1.3740000000000001,"15min":1.3740000000000001},"last":0.67100000000000004},{"interface":"front","average":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"min":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"max":{"1min":1.147,"5min":1.147,"15min":1.147},"last":0.80200000000000005}]},{"osd":9,"last update":"Fri Jul 14 18:10:48 2023","interfaces":[{"interface":"back","average":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.171,"5min":1.171,"15min":1.171},"last":0.77500000000000002},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.304,"5min":1.304,"15min":1.304},"last":0.53000000000000003}]},{"osd":10,"last update":"Fri Jul 14 18:11:10 2023","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.016,"5min":1.016,"15min":1.016},"last":0.68700000000000006},{"interface":"front","average":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"min":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"max":{"1min":1.196,"5min":1.196,"15min":1.196},"last":0.84899999999999998}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70899999999999996}]}]},{"osd":5,"up_from":37,"seq":158913789991,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28512,"kb_used_data":1492,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716640,"statfs":{"total":95995035648,"available":95965839360,"internally_reserved":0,"allocated":1527808,"data_stored":1040106,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 18:10:27 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.51500000000000001,"15min":0.51100000000000001},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":0.72499999999999998,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.51200000000000001,"5min":0.496,"15min":0.49399999999999999},"min":{"1min":0.35599999999999998,"5min":0.307,"15min":0.307},"max":{"1min":0.76000000000000001,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.627}]},{"osd":1,"last update":"Fri Jul 14 18:10:27 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.53500000000000003,"15min":0.52700000000000002},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.77900000000000003,"5min":0.85099999999999998,"15min":0.85099999999999998},"last":0.82099999999999995},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.55400000000000005,"15min":0.54400000000000004},"min":{"1min":0.40799999999999997,"5min":0.374,"15min":0.374},"max":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.77700000000000002}]},{"osd":2,"last update":"Fri Jul 14 18:10:27 2023","interfaces":[{"interface":"back","average":{"1min":0.48399999999999999,"5min":0.38700000000000001,"15min":0.371},"min":{"1min":0.312,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.48199999999999998,"5min":0.40699999999999997,"15min":0.39500000000000002},"min":{"1min":0.33000000000000002,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.745,"5min":0.745,"15min":0.745},"last":0.70299999999999996}]},{"osd":3,"last update":"Fri Jul 14 18:10:27 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.52100000000000002,"15min":0.51200000000000001},"min":{"1min":0.37,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.77100000000000002,"5min":0.82699999999999996,"15min":0.82699999999999996},"last":0.72699999999999998},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.51300000000000001,"15min":0.501},"min":{"1min":0.38900000000000001,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.74099999999999999}]},{"osd":4,"last update":"Fri Jul 14 18:10:27 2023","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.57799999999999996,"15min":0.56999999999999995},"min":{"1min":0.436,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.79800000000000004,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.84299999999999997},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.57399999999999995,"15min":0.56699999999999995},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.89200000000000002,"5min":0.89200000000000002,"15min":0.89200000000000002},"last":0.80600000000000005}]},{"osd":6,"last update":"Fri Jul 14 18:10:49 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.58399999999999996,"15min":0.57399999999999995},"min":{"1min":0.45800000000000002,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":1.0289999999999999,"5min":1.0289999999999999,"15min":1.0289999999999999},"last":0.76200000000000001},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.59599999999999997,"15min":0.58799999999999997},"min":{"1min":0.42599999999999999,"5min":0.371,"15min":0.371},"max":{"1min":0.94799999999999995,"5min":0.94799999999999995,"15min":0.94799999999999995},"last":0.875}]},{"osd":7,"last update":"Fri Jul 14 18:11:10 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.65400000000000003,"15min":0.64500000000000002},"min":{"1min":0.52000000000000002,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.0669999999999999,"5min":1.0669999999999999,"15min":1.0669999999999999},"last":0.89400000000000002},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.68200000000000005,"15min":0.67700000000000005},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":1.081,"5min":1.081,"15min":1.081},"last":0.96299999999999997}]},{"osd":8,"last update":"Fri Jul 14 18:10:27 2023","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.94799999999999995},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.96499999999999997,"5min":0.96499999999999997,"15min":0.96499999999999997},"last":0.90800000000000003}]},{"osd":9,"last update":"Fri Jul 14 18:10:49 2023","interfaces":[{"interface":"back","average":{"1min":0.748,"5min":0.748,"15min":0.748},"min":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1.2350000000000001,"5min":1.2350000000000001,"15min":1.2350000000000001},"last":0.86099999999999999},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":0.997,"5min":0.997,"15min":0.997},"last":0.93200000000000005}]},{"osd":10,"last update":"Fri Jul 14 18:11:10 2023","interfaces":[{"interface":"back","average":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":1.014,"5min":1.014,"15min":1.014},"last":0.92100000000000004},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.0489999999999999,"5min":1.0489999999999999,"15min":1.0489999999999999},"last":0.98699999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":694,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":4376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":5670,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":182,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":2368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":1500,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":4750,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-14T18:11:33.085 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-14T18:11:33.174 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:11:32 smithi184 ceph-mon[98481]: from='client.14916 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2023-07-14T18:11:33.174 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:11:32 smithi184 ceph-mon[98481]: pgmap v262: 129 pgs: 129 active+clean; 583 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 597 B/s rd, 1.8 KiB/s wr, 7 op/s 2023-07-14T18:11:33.174 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:11:32 smithi184 ceph-mon[98481]: from='client.14922 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "", "target": ["mon-mgr", ""]}]: dispatch 2023-07-14T18:11:33.174 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:11:32 smithi184 ceph-mon[98481]: mds.? [v2:172.21.15.163:6840/1032082642,v1:172.21.15.163:6841/1032082642] up:active 2023-07-14T18:11:33.175 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:11:32 smithi184 ceph-mon[98481]: fsmap cephfs:5 4 up:standby-replay 3 up:standby 5 up:active 2023-07-14T18:11:33.175 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:11:32 smithi184 ceph-mon[98481]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-07-14T18:11:33.175 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:11:32 smithi184 ceph-mon[98481]: mgrmap e17: x(active, since 6m), standbys: z, y 2023-07-14T18:11:33.175 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:11:32 smithi184 ceph-mon[98481]: from='client.? 172.21.15.163:0/2129768535' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-07-14T18:11:33.175 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:11:32 smithi184 ceph-mon[98481]: from='client.? 172.21.15.163:0/3097050259' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-07-14T18:11:33.234 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:33.191+0000 7f75399f6700 1 -- 172.21.15.163:0/1146337311 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f75341006b0 msgr2=0x7f7534106f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:11:33.234 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:33.191+0000 7f75399f6700 1 --2- 172.21.15.163:0/1146337311 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f75341006b0 0x7f7534106f70 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f752c00b0a0 tx=0x7f752c00b3b0 comp rx=0 tx=0).stop 2023-07-14T18:11:33.234 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:33.191+0000 7f75399f6700 1 -- 172.21.15.163:0/1146337311 shutdown_connections 2023-07-14T18:11:33.234 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:33.191+0000 7f75399f6700 1 --2- 172.21.15.163:0/1146337311 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f75340feb30 0x7f75340fef40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:33.235 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:33.191+0000 7f75399f6700 1 --2- 172.21.15.163:0/1146337311 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f75341006b0 0x7f7534106f70 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:33.235 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:33.191+0000 7f75399f6700 1 --2- 172.21.15.163:0/1146337311 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f75340ffd20 0x7f7534100170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:33.235 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:33.191+0000 7f75399f6700 1 -- 172.21.15.163:0/1146337311 >> 172.21.15.163:0/1146337311 conn(0x7f75340fa130 msgr2=0x7f75340fc580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:11:33.235 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:33.191+0000 7f75399f6700 1 -- 172.21.15.163:0/1146337311 shutdown_connections 2023-07-14T18:11:33.235 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:33.191+0000 7f75399f6700 1 -- 172.21.15.163:0/1146337311 wait complete. 2023-07-14T18:11:33.236 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:33.192+0000 7f75399f6700 1 Processor -- start 2023-07-14T18:11:33.236 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:33.192+0000 7f75399f6700 1 -- start start 2023-07-14T18:11:33.236 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:33.192+0000 7f75399f6700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f75340feb30 0x7f7534195960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:11:33.237 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:33.192+0000 7f75399f6700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f75340ffd20 0x7f7534195ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:11:33.237 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:33.192+0000 7f75399f6700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f75341006b0 0x7f753419cf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:11:33.237 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:33.192+0000 7f75399f6700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f753419d4e0 con 0x7f75341006b0 2023-07-14T18:11:33.237 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:33.192+0000 7f75399f6700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f753419d620 con 0x7f75340ffd20 2023-07-14T18:11:33.237 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:33.192+0000 7f75399f6700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f753419d7b0 con 0x7f75340feb30 2023-07-14T18:11:33.237 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:33.192+0000 7f75337fe700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f75341006b0 0x7f753419cf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:11:33.237 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:33.192+0000 7f75337fe700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f75341006b0 0x7f753419cf10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:56352/0 (socket says 172.21.15.163:56352) 2023-07-14T18:11:33.238 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:33.192+0000 7f75337fe700 1 -- 172.21.15.163:0/1430846420 learned_addr learned my addr 172.21.15.163:0/1430846420 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:11:33.238 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:33.192+0000 7f7532ffd700 1 --2- 172.21.15.163:0/1430846420 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f75340feb30 0x7f7534195960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:11:33.238 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:33.192+0000 7f75327fc700 1 --2- 172.21.15.163:0/1430846420 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f75340ffd20 0x7f7534195ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:11:33.238 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:33.192+0000 7f75337fe700 1 -- 172.21.15.163:0/1430846420 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f75340feb30 msgr2=0x7f7534195960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:11:33.238 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:33.192+0000 7f75337fe700 1 --2- 172.21.15.163:0/1430846420 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f75340feb30 0x7f7534195960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:33.238 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:33.192+0000 7f75337fe700 1 -- 172.21.15.163:0/1430846420 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f75340ffd20 msgr2=0x7f7534195ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:11:33.238 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:33.192+0000 7f75337fe700 1 --2- 172.21.15.163:0/1430846420 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f75340ffd20 0x7f7534195ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:33.239 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:33.192+0000 7f75337fe700 1 -- 172.21.15.163:0/1430846420 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f752c009d00 con 0x7f75341006b0 2023-07-14T18:11:33.239 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:33.192+0000 7f75327fc700 1 --2- 172.21.15.163:0/1430846420 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f75340ffd20 0x7f7534195ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T18:11:33.239 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:33.192+0000 7f7532ffd700 1 --2- 172.21.15.163:0/1430846420 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f75340feb30 0x7f7534195960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T18:11:33.239 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:33.193+0000 7f75337fe700 1 --2- 172.21.15.163:0/1430846420 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f75341006b0 0x7f753419cf10 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f752c0095e0 tx=0x7f752c00bb00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:11:33.239 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:33.193+0000 7f75389f4700 1 -- 172.21.15.163:0/1430846420 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f752c00e040 con 0x7f75341006b0 2023-07-14T18:11:33.239 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:33.193+0000 7f75389f4700 1 -- 172.21.15.163:0/1430846420 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f752c003c00 con 0x7f75341006b0 2023-07-14T18:11:33.239 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:33.193+0000 7f75399f6700 1 -- 172.21.15.163:0/1430846420 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f753419da30 con 0x7f75341006b0 2023-07-14T18:11:33.240 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:33.193+0000 7f75389f4700 1 -- 172.21.15.163:0/1430846420 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f752c0052a0 con 0x7f75341006b0 2023-07-14T18:11:33.240 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:33.193+0000 7f75399f6700 1 -- 172.21.15.163:0/1430846420 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f753419deb0 con 0x7f75341006b0 2023-07-14T18:11:33.240 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:33.194+0000 7f75399f6700 1 -- 172.21.15.163:0/1430846420 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f753410a1c0 con 0x7f75341006b0 2023-07-14T18:11:33.241 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:33.195+0000 7f75389f4700 1 -- 172.21.15.163:0/1430846420 <== mon.0 v2:172.21.15.163:3300/0 4 ==== mgrmap(e 17) v1 ==== 135767+0+0 (secure 0 0 0) 0x7f752c005610 con 0x7f75341006b0 2023-07-14T18:11:33.241 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:33.195+0000 7f75389f4700 1 --2- 172.21.15.163:0/1430846420 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f75200a1220 0x7f75200a36d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:11:33.241 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:33.195+0000 7f7532ffd700 1 --2- 172.21.15.163:0/1430846420 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f75200a1220 0x7f75200a36d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:11:33.241 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:33.195+0000 7f75389f4700 1 -- 172.21.15.163:0/1430846420 <== mon.0 v2:172.21.15.163:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 8730+0+0 (secure 0 0 0) 0x7f752c0ce210 con 0x7f75341006b0 2023-07-14T18:11:33.241 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:33.196+0000 7f7532ffd700 1 --2- 172.21.15.163:0/1430846420 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f75200a1220 0x7f75200a36d0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f75340ffb80 tx=0x7f7524009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:11:33.242 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:33.199+0000 7f75389f4700 1 -- 172.21.15.163:0/1430846420 <== mon.0 v2:172.21.15.163:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178025 (secure 0 0 0) 0x7f752c0976a0 con 0x7f75341006b0 2023-07-14T18:11:33.275 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:11:32 smithi172 ceph-mon[97983]: from='client.14916 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2023-07-14T18:11:33.275 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:11:32 smithi172 ceph-mon[97983]: pgmap v262: 129 pgs: 129 active+clean; 583 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 597 B/s rd, 1.8 KiB/s wr, 7 op/s 2023-07-14T18:11:33.275 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:11:32 smithi172 ceph-mon[97983]: from='client.14922 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "", "target": ["mon-mgr", ""]}]: dispatch 2023-07-14T18:11:33.275 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:11:32 smithi172 ceph-mon[97983]: mds.? [v2:172.21.15.163:6840/1032082642,v1:172.21.15.163:6841/1032082642] up:active 2023-07-14T18:11:33.276 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:11:32 smithi172 ceph-mon[97983]: fsmap cephfs:5 4 up:standby-replay 3 up:standby 5 up:active 2023-07-14T18:11:33.276 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:11:32 smithi172 ceph-mon[97983]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-07-14T18:11:33.276 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:11:32 smithi172 ceph-mon[97983]: mgrmap e17: x(active, since 6m), standbys: z, y 2023-07-14T18:11:33.276 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:11:32 smithi172 ceph-mon[97983]: from='client.? 172.21.15.163:0/2129768535' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-07-14T18:11:33.276 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:11:32 smithi172 ceph-mon[97983]: from='client.? 172.21.15.163:0/3097050259' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-07-14T18:11:33.425 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:33.385+0000 7f75399f6700 1 -- 172.21.15.163:0/1430846420 --> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f75340691b0 con 0x7f75200a1220 2023-07-14T18:11:33.437 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:33.397+0000 7f75389f4700 1 -- 172.21.15.163:0/1430846420 <== mgr.14152 v2:172.21.15.163:6800/1949590926 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+417751 (secure 0 0 0) 0x7f75340691b0 con 0x7f75200a1220 2023-07-14T18:11:33.441 INFO:teuthology.orchestra.run.smithi163.stdout: 2023-07-14T18:11:33.444 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:33.401+0000 7f75399f6700 1 -- 172.21.15.163:0/1430846420 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f75200a1220 msgr2=0x7f75200a36d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:11:33.444 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:33.401+0000 7f75399f6700 1 --2- 172.21.15.163:0/1430846420 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f75200a1220 0x7f75200a36d0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f75340ffb80 tx=0x7f7524009260 comp rx=0 tx=0).stop 2023-07-14T18:11:33.444 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:33.401+0000 7f75399f6700 1 -- 172.21.15.163:0/1430846420 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f75341006b0 msgr2=0x7f753419cf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:11:33.444 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:33.401+0000 7f75399f6700 1 --2- 172.21.15.163:0/1430846420 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f75341006b0 0x7f753419cf10 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f752c0095e0 tx=0x7f752c00bb00 comp rx=0 tx=0).stop 2023-07-14T18:11:33.444 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:33.401+0000 7f75399f6700 1 -- 172.21.15.163:0/1430846420 shutdown_connections 2023-07-14T18:11:33.444 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:33.401+0000 7f75399f6700 1 --2- 172.21.15.163:0/1430846420 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f75200a1220 0x7f75200a36d0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:33.445 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:33.401+0000 7f75399f6700 1 --2- 172.21.15.163:0/1430846420 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f75340feb30 0x7f7534195960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:33.445 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:33.401+0000 7f75399f6700 1 --2- 172.21.15.163:0/1430846420 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f75341006b0 0x7f753419cf10 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:33.445 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:33.401+0000 7f75399f6700 1 --2- 172.21.15.163:0/1430846420 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f75340ffd20 0x7f7534195ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:33.445 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:33.401+0000 7f75399f6700 1 -- 172.21.15.163:0/1430846420 >> 172.21.15.163:0/1430846420 conn(0x7f75340fa130 msgr2=0x7f7534068aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:11:33.445 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:33.401+0000 7f75399f6700 1 -- 172.21.15.163:0/1430846420 shutdown_connections 2023-07-14T18:11:33.445 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:33.401+0000 7f75399f6700 1 -- 172.21.15.163:0/1430846420 wait complete. 2023-07-14T18:11:33.445 INFO:teuthology.orchestra.run.smithi163.stderr:dumped all 2023-07-14T18:11:33.453 INFO:teuthology.orchestra.run.smithi163.stdout:{"pg_ready":true,"pg_map":{"version":262,"stamp":"2023-07-14T18:11:31.409422+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":597192,"num_objects":59,"num_object_clones":0,"num_object_copies":177,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":0,"num_read":133,"num_read_kb":116,"num_write":308,"num_write_kb":2974,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":38,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":246,"ondisk_log_size":246,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":419,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":336912,"kb_used_data":12696,"kb_used_omap":20,"kb_used_meta":324075,"kb_avail":1124604912,"statfs":{"total":1151940427776,"available":1151595429888,"internally_reserved":0,"allocated":13000704,"data_stored":7182219,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":21372,"internal_metadata":331852932},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":4462,"num_objects":35,"num_object_clones":0,"num_object_copies":105,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":82,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":24,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003446"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":20,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:11:15.117313+0000","last_change":"2023-07-14T18:11:09.713546+0000","last_active":"2023-07-14T18:11:15.117313+0000","last_peered":"2023-07-14T18:11:15.117313+0000","last_clean":"2023-07-14T18:11:15.117313+0000","last_became_active":"2023-07-14T18:11:09.713170+0000","last_became_peered":"2023-07-14T18:11:09.713170+0000","last_unstale":"2023-07-14T18:11:15.117313+0000","last_undegraded":"2023-07-14T18:11:15.117313+0000","last_fullsized":"2023-07-14T18:11:15.117313+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_clean_scrub_stamp":"2023-07-14T18:11:08.667354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T03:18:23.645436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":20,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:11:14.884660+0000","last_change":"2023-07-14T18:11:09.711619+0000","last_active":"2023-07-14T18:11:14.884660+0000","last_peered":"2023-07-14T18:11:14.884660+0000","last_clean":"2023-07-14T18:11:14.884660+0000","last_became_active":"2023-07-14T18:11:09.711249+0000","last_became_peered":"2023-07-14T18:11:09.711249+0000","last_unstale":"2023-07-14T18:11:14.884660+0000","last_undegraded":"2023-07-14T18:11:14.884660+0000","last_fullsized":"2023-07-14T18:11:14.884660+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_clean_scrub_stamp":"2023-07-14T18:11:08.667354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:15:46.939069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":20,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:11:14.884197+0000","last_change":"2023-07-14T18:11:09.705557+0000","last_active":"2023-07-14T18:11:14.884197+0000","last_peered":"2023-07-14T18:11:14.884197+0000","last_clean":"2023-07-14T18:11:14.884197+0000","last_became_active":"2023-07-14T18:11:09.705179+0000","last_became_peered":"2023-07-14T18:11:09.705179+0000","last_unstale":"2023-07-14T18:11:14.884197+0000","last_undegraded":"2023-07-14T18:11:14.884197+0000","last_fullsized":"2023-07-14T18:11:14.884197+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_clean_scrub_stamp":"2023-07-14T18:11:08.667354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:37:15.401517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":20,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:11:14.885864+0000","last_change":"2023-07-14T18:11:09.709234+0000","last_active":"2023-07-14T18:11:14.885864+0000","last_peered":"2023-07-14T18:11:14.885864+0000","last_clean":"2023-07-14T18:11:14.885864+0000","last_became_active":"2023-07-14T18:11:09.708855+0000","last_became_peered":"2023-07-14T18:11:09.708855+0000","last_unstale":"2023-07-14T18:11:14.885864+0000","last_undegraded":"2023-07-14T18:11:14.885864+0000","last_fullsized":"2023-07-14T18:11:14.885864+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_clean_scrub_stamp":"2023-07-14T18:11:08.667354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T03:28:37.657033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":20,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:11:14.884907+0000","last_change":"2023-07-14T18:11:09.704301+0000","last_active":"2023-07-14T18:11:14.884907+0000","last_peered":"2023-07-14T18:11:14.884907+0000","last_clean":"2023-07-14T18:11:14.884907+0000","last_became_active":"2023-07-14T18:11:09.703961+0000","last_became_peered":"2023-07-14T18:11:09.703961+0000","last_unstale":"2023-07-14T18:11:14.884907+0000","last_undegraded":"2023-07-14T18:11:14.884907+0000","last_fullsized":"2023-07-14T18:11:14.884907+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_clean_scrub_stamp":"2023-07-14T18:11:08.667354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T03:07:18.579761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":20,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:11:14.791451+0000","last_change":"2023-07-14T18:11:09.717667+0000","last_active":"2023-07-14T18:11:14.791451+0000","last_peered":"2023-07-14T18:11:14.791451+0000","last_clean":"2023-07-14T18:11:14.791451+0000","last_became_active":"2023-07-14T18:11:09.717146+0000","last_became_peered":"2023-07-14T18:11:09.717146+0000","last_unstale":"2023-07-14T18:11:14.791451+0000","last_undegraded":"2023-07-14T18:11:14.791451+0000","last_fullsized":"2023-07-14T18:11:14.791451+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_clean_scrub_stamp":"2023-07-14T18:11:08.667354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T05:43:55.497012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":18,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:11:14.884950+0000","last_change":"2023-07-14T18:11:09.713638+0000","last_active":"2023-07-14T18:11:14.884950+0000","last_peered":"2023-07-14T18:11:14.884950+0000","last_clean":"2023-07-14T18:11:14.884950+0000","last_became_active":"2023-07-14T18:11:09.707940+0000","last_became_peered":"2023-07-14T18:11:09.707940+0000","last_unstale":"2023-07-14T18:11:14.884950+0000","last_undegraded":"2023-07-14T18:11:14.884950+0000","last_fullsized":"2023-07-14T18:11:14.884950+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_clean_scrub_stamp":"2023-07-14T18:11:08.667354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:04:22.228548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":20,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:11:14.885659+0000","last_change":"2023-07-14T18:11:09.709804+0000","last_active":"2023-07-14T18:11:14.885659+0000","last_peered":"2023-07-14T18:11:14.885659+0000","last_clean":"2023-07-14T18:11:14.885659+0000","last_became_active":"2023-07-14T18:11:09.709385+0000","last_became_peered":"2023-07-14T18:11:09.709385+0000","last_unstale":"2023-07-14T18:11:14.885659+0000","last_undegraded":"2023-07-14T18:11:14.885659+0000","last_fullsized":"2023-07-14T18:11:14.885659+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_clean_scrub_stamp":"2023-07-14T18:11:08.667354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T05:15:54.972411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":20,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:11:14.885346+0000","last_change":"2023-07-14T18:11:09.710410+0000","last_active":"2023-07-14T18:11:14.885346+0000","last_peered":"2023-07-14T18:11:14.885346+0000","last_clean":"2023-07-14T18:11:14.885346+0000","last_became_active":"2023-07-14T18:11:09.710049+0000","last_became_peered":"2023-07-14T18:11:09.710049+0000","last_unstale":"2023-07-14T18:11:14.885346+0000","last_undegraded":"2023-07-14T18:11:14.885346+0000","last_fullsized":"2023-07-14T18:11:14.885346+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_clean_scrub_stamp":"2023-07-14T18:11:08.667354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:01:39.122213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":20,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:11:14.791867+0000","last_change":"2023-07-14T18:11:09.717681+0000","last_active":"2023-07-14T18:11:14.791867+0000","last_peered":"2023-07-14T18:11:14.791867+0000","last_clean":"2023-07-14T18:11:14.791867+0000","last_became_active":"2023-07-14T18:11:09.717209+0000","last_became_peered":"2023-07-14T18:11:09.717209+0000","last_unstale":"2023-07-14T18:11:14.791867+0000","last_undegraded":"2023-07-14T18:11:14.791867+0000","last_fullsized":"2023-07-14T18:11:14.791867+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_clean_scrub_stamp":"2023-07-14T18:11:08.667354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T02:14:23.927899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":18,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:11:14.885431+0000","last_change":"2023-07-14T18:11:09.716890+0000","last_active":"2023-07-14T18:11:14.885431+0000","last_peered":"2023-07-14T18:11:14.885431+0000","last_clean":"2023-07-14T18:11:14.885431+0000","last_became_active":"2023-07-14T18:11:09.708773+0000","last_became_peered":"2023-07-14T18:11:09.708773+0000","last_unstale":"2023-07-14T18:11:14.885431+0000","last_undegraded":"2023-07-14T18:11:14.885431+0000","last_fullsized":"2023-07-14T18:11:14.885431+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_clean_scrub_stamp":"2023-07-14T18:11:08.667354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T02:07:24.275839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":20,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:11:14.885714+0000","last_change":"2023-07-14T18:11:09.715119+0000","last_active":"2023-07-14T18:11:14.885714+0000","last_peered":"2023-07-14T18:11:14.885714+0000","last_clean":"2023-07-14T18:11:14.885714+0000","last_became_active":"2023-07-14T18:11:09.714680+0000","last_became_peered":"2023-07-14T18:11:09.714680+0000","last_unstale":"2023-07-14T18:11:14.885714+0000","last_undegraded":"2023-07-14T18:11:14.885714+0000","last_fullsized":"2023-07-14T18:11:14.885714+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_clean_scrub_stamp":"2023-07-14T18:11:08.667354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:57:07.824122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":20,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:11:14.791064+0000","last_change":"2023-07-14T18:11:09.711173+0000","last_active":"2023-07-14T18:11:14.791064+0000","last_peered":"2023-07-14T18:11:14.791064+0000","last_clean":"2023-07-14T18:11:14.791064+0000","last_became_active":"2023-07-14T18:11:09.710849+0000","last_became_peered":"2023-07-14T18:11:09.710849+0000","last_unstale":"2023-07-14T18:11:14.791064+0000","last_undegraded":"2023-07-14T18:11:14.791064+0000","last_fullsized":"2023-07-14T18:11:14.791064+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_clean_scrub_stamp":"2023-07-14T18:11:08.667354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:51:55.610741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":20,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:11:14.884136+0000","last_change":"2023-07-14T18:11:09.710448+0000","last_active":"2023-07-14T18:11:14.884136+0000","last_peered":"2023-07-14T18:11:14.884136+0000","last_clean":"2023-07-14T18:11:14.884136+0000","last_became_active":"2023-07-14T18:11:09.709804+0000","last_became_peered":"2023-07-14T18:11:09.709804+0000","last_unstale":"2023-07-14T18:11:14.884136+0000","last_undegraded":"2023-07-14T18:11:14.884136+0000","last_fullsized":"2023-07-14T18:11:14.884136+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_clean_scrub_stamp":"2023-07-14T18:11:08.667354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:56:21.024882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":20,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:11:14.884058+0000","last_change":"2023-07-14T18:11:09.714917+0000","last_active":"2023-07-14T18:11:14.884058+0000","last_peered":"2023-07-14T18:11:14.884058+0000","last_clean":"2023-07-14T18:11:14.884058+0000","last_became_active":"2023-07-14T18:11:09.714655+0000","last_became_peered":"2023-07-14T18:11:09.714655+0000","last_unstale":"2023-07-14T18:11:14.884058+0000","last_undegraded":"2023-07-14T18:11:14.884058+0000","last_fullsized":"2023-07-14T18:11:14.884058+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_clean_scrub_stamp":"2023-07-14T18:11:08.667354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:22:10.112893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":20,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:11:14.884405+0000","last_change":"2023-07-14T18:11:09.709149+0000","last_active":"2023-07-14T18:11:14.884405+0000","last_peered":"2023-07-14T18:11:14.884405+0000","last_clean":"2023-07-14T18:11:14.884405+0000","last_became_active":"2023-07-14T18:11:09.708692+0000","last_became_peered":"2023-07-14T18:11:09.708692+0000","last_unstale":"2023-07-14T18:11:14.884405+0000","last_undegraded":"2023-07-14T18:11:14.884405+0000","last_fullsized":"2023-07-14T18:11:14.884405+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_clean_scrub_stamp":"2023-07-14T18:11:08.667354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:02:35.757081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":20,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:11:15.117281+0000","last_change":"2023-07-14T18:11:09.720235+0000","last_active":"2023-07-14T18:11:15.117281+0000","last_peered":"2023-07-14T18:11:15.117281+0000","last_clean":"2023-07-14T18:11:15.117281+0000","last_became_active":"2023-07-14T18:11:09.719895+0000","last_became_peered":"2023-07-14T18:11:09.719895+0000","last_unstale":"2023-07-14T18:11:15.117281+0000","last_undegraded":"2023-07-14T18:11:15.117281+0000","last_fullsized":"2023-07-14T18:11:15.117281+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_clean_scrub_stamp":"2023-07-14T18:11:08.667354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:41:02.386421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":20,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:11:14.887035+0000","last_change":"2023-07-14T18:11:09.712390+0000","last_active":"2023-07-14T18:11:14.887035+0000","last_peered":"2023-07-14T18:11:14.887035+0000","last_clean":"2023-07-14T18:11:14.887035+0000","last_became_active":"2023-07-14T18:11:09.712074+0000","last_became_peered":"2023-07-14T18:11:09.712074+0000","last_unstale":"2023-07-14T18:11:14.887035+0000","last_undegraded":"2023-07-14T18:11:14.887035+0000","last_fullsized":"2023-07-14T18:11:14.887035+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_clean_scrub_stamp":"2023-07-14T18:11:08.667354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:26:16.089801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":20,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:11:14.885382+0000","last_change":"2023-07-14T18:11:09.709800+0000","last_active":"2023-07-14T18:11:14.885382+0000","last_peered":"2023-07-14T18:11:14.885382+0000","last_clean":"2023-07-14T18:11:14.885382+0000","last_became_active":"2023-07-14T18:11:09.709540+0000","last_became_peered":"2023-07-14T18:11:09.709540+0000","last_unstale":"2023-07-14T18:11:14.885382+0000","last_undegraded":"2023-07-14T18:11:14.885382+0000","last_fullsized":"2023-07-14T18:11:14.885382+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_clean_scrub_stamp":"2023-07-14T18:11:08.667354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:52:10.352194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":13,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:11:14.884081+0000","last_change":"2023-07-14T18:11:13.786505+0000","last_active":"2023-07-14T18:11:14.884081+0000","last_peered":"2023-07-14T18:11:14.884081+0000","last_clean":"2023-07-14T18:11:14.884081+0000","last_became_active":"2023-07-14T18:11:13.786141+0000","last_became_peered":"2023-07-14T18:11:13.786141+0000","last_unstale":"2023-07-14T18:11:14.884081+0000","last_undegraded":"2023-07-14T18:11:14.884081+0000","last_fullsized":"2023-07-14T18:11:14.884081+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:12.753466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:12.753466+0000","last_clean_scrub_stamp":"2023-07-14T18:11:12.753466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:26:53.748778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,9,0],"acting":[2,3,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"79'4","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:11:14.887241+0000","last_change":"2023-07-14T18:11:08.691446+0000","last_active":"2023-07-14T18:11:14.887241+0000","last_peered":"2023-07-14T18:11:14.887241+0000","last_clean":"2023-07-14T18:11:14.887241+0000","last_became_active":"2023-07-14T18:11:08.691129+0000","last_became_peered":"2023-07-14T18:11:08.691129+0000","last_unstale":"2023-07-14T18:11:14.887241+0000","last_undegraded":"2023-07-14T18:11:14.887241+0000","last_fullsized":"2023-07-14T18:11:14.887241+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:07.665746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:07.665746+0000","last_clean_scrub_stamp":"2023-07-14T18:11:07.665746+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T03:49:49.363087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":20,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:11:14.886188+0000","last_change":"2023-07-14T18:11:09.708155+0000","last_active":"2023-07-14T18:11:14.886188+0000","last_peered":"2023-07-14T18:11:14.886188+0000","last_clean":"2023-07-14T18:11:14.886188+0000","last_became_active":"2023-07-14T18:11:09.707856+0000","last_became_peered":"2023-07-14T18:11:09.707856+0000","last_unstale":"2023-07-14T18:11:14.886188+0000","last_undegraded":"2023-07-14T18:11:14.886188+0000","last_fullsized":"2023-07-14T18:11:14.886188+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_clean_scrub_stamp":"2023-07-14T18:11:08.667354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:45:23.390147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":13,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:11:14.885185+0000","last_change":"2023-07-14T18:11:13.776947+0000","last_active":"2023-07-14T18:11:14.885185+0000","last_peered":"2023-07-14T18:11:14.885185+0000","last_clean":"2023-07-14T18:11:14.885185+0000","last_became_active":"2023-07-14T18:11:13.776557+0000","last_became_peered":"2023-07-14T18:11:13.776557+0000","last_unstale":"2023-07-14T18:11:14.885185+0000","last_undegraded":"2023-07-14T18:11:14.885185+0000","last_fullsized":"2023-07-14T18:11:14.885185+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:12.753466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:12.753466+0000","last_clean_scrub_stamp":"2023-07-14T18:11:12.753466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T05:58:30.561744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,9,3],"acting":[4,6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1e","version":"84'2","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:11:14.886397+0000","last_change":"2023-07-14T18:11:08.690072+0000","last_active":"2023-07-14T18:11:14.886397+0000","last_peered":"2023-07-14T18:11:14.886397+0000","last_clean":"2023-07-14T18:11:14.886397+0000","last_became_active":"2023-07-14T18:11:08.689770+0000","last_became_peered":"2023-07-14T18:11:08.689770+0000","last_unstale":"2023-07-14T18:11:14.886397+0000","last_undegraded":"2023-07-14T18:11:14.886397+0000","last_fullsized":"2023-07-14T18:11:14.886397+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:07.665746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:07.665746+0000","last_clean_scrub_stamp":"2023-07-14T18:11:07.665746+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:22:28.360757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":20,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:11:14.885001+0000","last_change":"2023-07-14T18:11:09.706952+0000","last_active":"2023-07-14T18:11:14.885001+0000","last_peered":"2023-07-14T18:11:14.885001+0000","last_clean":"2023-07-14T18:11:14.885001+0000","last_became_active":"2023-07-14T18:11:09.706646+0000","last_became_peered":"2023-07-14T18:11:09.706646+0000","last_unstale":"2023-07-14T18:11:14.885001+0000","last_undegraded":"2023-07-14T18:11:14.885001+0000","last_fullsized":"2023-07-14T18:11:14.885001+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_clean_scrub_stamp":"2023-07-14T18:11:08.667354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:21:05.149853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":13,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:11:14.886418+0000","last_change":"2023-07-14T18:11:13.779167+0000","last_active":"2023-07-14T18:11:14.886418+0000","last_peered":"2023-07-14T18:11:14.886418+0000","last_clean":"2023-07-14T18:11:14.886418+0000","last_became_active":"2023-07-14T18:11:13.778486+0000","last_became_peered":"2023-07-14T18:11:13.778486+0000","last_unstale":"2023-07-14T18:11:14.886418+0000","last_undegraded":"2023-07-14T18:11:14.886418+0000","last_fullsized":"2023-07-14T18:11:14.886418+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:12.753466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:12.753466+0000","last_clean_scrub_stamp":"2023-07-14T18:11:12.753466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:34:58.614453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,9,5],"acting":[4,3,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"84'11","reported_seq":34,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:11:30.774003+0000","last_change":"2023-07-14T18:11:08.688289+0000","last_active":"2023-07-14T18:11:30.774003+0000","last_peered":"2023-07-14T18:11:30.774003+0000","last_clean":"2023-07-14T18:11:30.774003+0000","last_became_active":"2023-07-14T18:11:08.687994+0000","last_became_peered":"2023-07-14T18:11:08.687994+0000","last_unstale":"2023-07-14T18:11:30.774003+0000","last_undegraded":"2023-07-14T18:11:30.774003+0000","last_fullsized":"2023-07-14T18:11:30.774003+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:07.665746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:07.665746+0000","last_clean_scrub_stamp":"2023-07-14T18:11:07.665746+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:06:29.309813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":15,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":20,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:11:14.884723+0000","last_change":"2023-07-14T18:11:09.711910+0000","last_active":"2023-07-14T18:11:14.884723+0000","last_peered":"2023-07-14T18:11:14.884723+0000","last_clean":"2023-07-14T18:11:14.884723+0000","last_became_active":"2023-07-14T18:11:09.711634+0000","last_became_peered":"2023-07-14T18:11:09.711634+0000","last_unstale":"2023-07-14T18:11:14.884723+0000","last_undegraded":"2023-07-14T18:11:14.884723+0000","last_fullsized":"2023-07-14T18:11:14.884723+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_clean_scrub_stamp":"2023-07-14T18:11:08.667354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T02:17:27.837804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":13,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:11:14.885448+0000","last_change":"2023-07-14T18:11:13.778662+0000","last_active":"2023-07-14T18:11:14.885448+0000","last_peered":"2023-07-14T18:11:14.885448+0000","last_clean":"2023-07-14T18:11:14.885448+0000","last_became_active":"2023-07-14T18:11:13.777886+0000","last_became_peered":"2023-07-14T18:11:13.777886+0000","last_unstale":"2023-07-14T18:11:14.885448+0000","last_undegraded":"2023-07-14T18:11:14.885448+0000","last_fullsized":"2023-07-14T18:11:14.885448+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:12.753466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:12.753466+0000","last_clean_scrub_stamp":"2023-07-14T18:11:12.753466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:17:56.221852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"84'5","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:11:30.773276+0000","last_change":"2023-07-14T18:11:08.683774+0000","last_active":"2023-07-14T18:11:30.773276+0000","last_peered":"2023-07-14T18:11:30.773276+0000","last_clean":"2023-07-14T18:11:30.773276+0000","last_became_active":"2023-07-14T18:11:08.683458+0000","last_became_peered":"2023-07-14T18:11:08.683458+0000","last_unstale":"2023-07-14T18:11:30.773276+0000","last_undegraded":"2023-07-14T18:11:30.773276+0000","last_fullsized":"2023-07-14T18:11:30.773276+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:07.665746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:07.665746+0000","last_clean_scrub_stamp":"2023-07-14T18:11:07.665746+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:20:32.172917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":20,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:11:14.791559+0000","last_change":"2023-07-14T18:11:09.716041+0000","last_active":"2023-07-14T18:11:14.791559+0000","last_peered":"2023-07-14T18:11:14.791559+0000","last_clean":"2023-07-14T18:11:14.791559+0000","last_became_active":"2023-07-14T18:11:09.715367+0000","last_became_peered":"2023-07-14T18:11:09.715367+0000","last_unstale":"2023-07-14T18:11:14.791559+0000","last_undegraded":"2023-07-14T18:11:14.791559+0000","last_fullsized":"2023-07-14T18:11:14.791559+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_clean_scrub_stamp":"2023-07-14T18:11:08.667354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T01:34:04.989278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":13,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:11:14.885291+0000","last_change":"2023-07-14T18:11:13.776527+0000","last_active":"2023-07-14T18:11:14.885291+0000","last_peered":"2023-07-14T18:11:14.885291+0000","last_clean":"2023-07-14T18:11:14.885291+0000","last_became_active":"2023-07-14T18:11:13.776032+0000","last_became_peered":"2023-07-14T18:11:13.776032+0000","last_unstale":"2023-07-14T18:11:14.885291+0000","last_undegraded":"2023-07-14T18:11:14.885291+0000","last_fullsized":"2023-07-14T18:11:14.885291+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:12.753466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:12.753466+0000","last_clean_scrub_stamp":"2023-07-14T18:11:12.753466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:39:22.666498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"79'1","reported_seq":23,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:11:14.791336+0000","last_change":"2023-07-14T18:11:08.687533+0000","last_active":"2023-07-14T18:11:14.791336+0000","last_peered":"2023-07-14T18:11:14.791336+0000","last_clean":"2023-07-14T18:11:14.791336+0000","last_became_active":"2023-07-14T18:11:08.687242+0000","last_became_peered":"2023-07-14T18:11:08.687242+0000","last_unstale":"2023-07-14T18:11:14.791336+0000","last_undegraded":"2023-07-14T18:11:14.791336+0000","last_fullsized":"2023-07-14T18:11:14.791336+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:07.665746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:07.665746+0000","last_clean_scrub_stamp":"2023-07-14T18:11:07.665746+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T03:53:23.140121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":20,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:11:14.885376+0000","last_change":"2023-07-14T18:11:09.707937+0000","last_active":"2023-07-14T18:11:14.885376+0000","last_peered":"2023-07-14T18:11:14.885376+0000","last_clean":"2023-07-14T18:11:14.885376+0000","last_became_active":"2023-07-14T18:11:09.707637+0000","last_became_peered":"2023-07-14T18:11:09.707637+0000","last_unstale":"2023-07-14T18:11:14.885376+0000","last_undegraded":"2023-07-14T18:11:14.885376+0000","last_fullsized":"2023-07-14T18:11:14.885376+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_clean_scrub_stamp":"2023-07-14T18:11:08.667354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:08:40.577399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":13,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:11:14.884475+0000","last_change":"2023-07-14T18:11:13.791360+0000","last_active":"2023-07-14T18:11:14.884475+0000","last_peered":"2023-07-14T18:11:14.884475+0000","last_clean":"2023-07-14T18:11:14.884475+0000","last_became_active":"2023-07-14T18:11:13.790894+0000","last_became_peered":"2023-07-14T18:11:13.790894+0000","last_unstale":"2023-07-14T18:11:14.884475+0000","last_undegraded":"2023-07-14T18:11:14.884475+0000","last_fullsized":"2023-07-14T18:11:14.884475+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:12.753466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:12.753466+0000","last_clean_scrub_stamp":"2023-07-14T18:11:12.753466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:41:41.939841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,9,5],"acting":[2,6,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1a","version":"79'1","reported_seq":23,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:11:14.791350+0000","last_change":"2023-07-14T18:11:08.687315+0000","last_active":"2023-07-14T18:11:14.791350+0000","last_peered":"2023-07-14T18:11:14.791350+0000","last_clean":"2023-07-14T18:11:14.791350+0000","last_became_active":"2023-07-14T18:11:08.687061+0000","last_became_peered":"2023-07-14T18:11:08.687061+0000","last_unstale":"2023-07-14T18:11:14.791350+0000","last_undegraded":"2023-07-14T18:11:14.791350+0000","last_fullsized":"2023-07-14T18:11:14.791350+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:07.665746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:07.665746+0000","last_clean_scrub_stamp":"2023-07-14T18:11:07.665746+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:33:18.467402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":20,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:11:14.791635+0000","last_change":"2023-07-14T18:11:09.715816+0000","last_active":"2023-07-14T18:11:14.791635+0000","last_peered":"2023-07-14T18:11:14.791635+0000","last_clean":"2023-07-14T18:11:14.791635+0000","last_became_active":"2023-07-14T18:11:09.715038+0000","last_became_peered":"2023-07-14T18:11:09.715038+0000","last_unstale":"2023-07-14T18:11:14.791635+0000","last_undegraded":"2023-07-14T18:11:14.791635+0000","last_fullsized":"2023-07-14T18:11:14.791635+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_clean_scrub_stamp":"2023-07-14T18:11:08.667354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:25:18.981358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":13,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:11:15.117190+0000","last_change":"2023-07-14T18:11:13.791438+0000","last_active":"2023-07-14T18:11:15.117190+0000","last_peered":"2023-07-14T18:11:15.117190+0000","last_clean":"2023-07-14T18:11:15.117190+0000","last_became_active":"2023-07-14T18:11:13.790956+0000","last_became_peered":"2023-07-14T18:11:13.790956+0000","last_unstale":"2023-07-14T18:11:15.117190+0000","last_undegraded":"2023-07-14T18:11:15.117190+0000","last_fullsized":"2023-07-14T18:11:15.117190+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:12.753466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:12.753466+0000","last_clean_scrub_stamp":"2023-07-14T18:11:12.753466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:19:27.699147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.19","version":"84'2","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:11:28.829077+0000","last_change":"2023-07-14T18:11:08.693751+0000","last_active":"2023-07-14T18:11:28.829077+0000","last_peered":"2023-07-14T18:11:28.829077+0000","last_clean":"2023-07-14T18:11:28.829077+0000","last_became_active":"2023-07-14T18:11:08.693427+0000","last_became_peered":"2023-07-14T18:11:08.693427+0000","last_unstale":"2023-07-14T18:11:28.829077+0000","last_undegraded":"2023-07-14T18:11:28.829077+0000","last_fullsized":"2023-07-14T18:11:28.829077+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:07.665746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:07.665746+0000","last_clean_scrub_stamp":"2023-07-14T18:11:07.665746+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T01:10:23.727801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":20,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:11:14.885924+0000","last_change":"2023-07-14T18:11:09.709761+0000","last_active":"2023-07-14T18:11:14.885924+0000","last_peered":"2023-07-14T18:11:14.885924+0000","last_clean":"2023-07-14T18:11:14.885924+0000","last_became_active":"2023-07-14T18:11:09.709157+0000","last_became_peered":"2023-07-14T18:11:09.709157+0000","last_unstale":"2023-07-14T18:11:14.885924+0000","last_undegraded":"2023-07-14T18:11:14.885924+0000","last_fullsized":"2023-07-14T18:11:14.885924+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_clean_scrub_stamp":"2023-07-14T18:11:08.667354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:46:44.602802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":13,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:11:14.884393+0000","last_change":"2023-07-14T18:11:13.779265+0000","last_active":"2023-07-14T18:11:14.884393+0000","last_peered":"2023-07-14T18:11:14.884393+0000","last_clean":"2023-07-14T18:11:14.884393+0000","last_became_active":"2023-07-14T18:11:13.778865+0000","last_became_peered":"2023-07-14T18:11:13.778865+0000","last_unstale":"2023-07-14T18:11:14.884393+0000","last_undegraded":"2023-07-14T18:11:14.884393+0000","last_fullsized":"2023-07-14T18:11:14.884393+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:12.753466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:12.753466+0000","last_clean_scrub_stamp":"2023-07-14T18:11:12.753466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:19:57.552613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":22,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:11:14.790949+0000","last_change":"2023-07-14T18:11:08.684513+0000","last_active":"2023-07-14T18:11:14.790949+0000","last_peered":"2023-07-14T18:11:14.790949+0000","last_clean":"2023-07-14T18:11:14.790949+0000","last_became_active":"2023-07-14T18:11:08.684213+0000","last_became_peered":"2023-07-14T18:11:08.684213+0000","last_unstale":"2023-07-14T18:11:14.790949+0000","last_undegraded":"2023-07-14T18:11:14.790949+0000","last_fullsized":"2023-07-14T18:11:14.790949+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:07.665746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:07.665746+0000","last_clean_scrub_stamp":"2023-07-14T18:11:07.665746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:07:53.630240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":20,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:11:14.886595+0000","last_change":"2023-07-14T18:11:09.712427+0000","last_active":"2023-07-14T18:11:14.886595+0000","last_peered":"2023-07-14T18:11:14.886595+0000","last_clean":"2023-07-14T18:11:14.886595+0000","last_became_active":"2023-07-14T18:11:09.712104+0000","last_became_peered":"2023-07-14T18:11:09.712104+0000","last_unstale":"2023-07-14T18:11:14.886595+0000","last_undegraded":"2023-07-14T18:11:14.886595+0000","last_fullsized":"2023-07-14T18:11:14.886595+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_clean_scrub_stamp":"2023-07-14T18:11:08.667354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:27:36.074613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":13,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:11:14.884458+0000","last_change":"2023-07-14T18:11:13.777892+0000","last_active":"2023-07-14T18:11:14.884458+0000","last_peered":"2023-07-14T18:11:14.884458+0000","last_clean":"2023-07-14T18:11:14.884458+0000","last_became_active":"2023-07-14T18:11:13.777518+0000","last_became_peered":"2023-07-14T18:11:13.777518+0000","last_unstale":"2023-07-14T18:11:14.884458+0000","last_undegraded":"2023-07-14T18:11:14.884458+0000","last_fullsized":"2023-07-14T18:11:14.884458+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:12.753466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:12.753466+0000","last_clean_scrub_stamp":"2023-07-14T18:11:12.753466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T03:56:42.344672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.17","version":"84'3","reported_seq":25,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:11:27.818230+0000","last_change":"2023-07-14T18:11:08.684141+0000","last_active":"2023-07-14T18:11:27.818230+0000","last_peered":"2023-07-14T18:11:27.818230+0000","last_clean":"2023-07-14T18:11:27.818230+0000","last_became_active":"2023-07-14T18:11:08.683767+0000","last_became_peered":"2023-07-14T18:11:08.683767+0000","last_unstale":"2023-07-14T18:11:27.818230+0000","last_undegraded":"2023-07-14T18:11:27.818230+0000","last_fullsized":"2023-07-14T18:11:27.818230+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:07.665746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:07.665746+0000","last_clean_scrub_stamp":"2023-07-14T18:11:07.665746+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T02:05:02.791590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":20,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:11:14.885184+0000","last_change":"2023-07-14T18:11:09.710975+0000","last_active":"2023-07-14T18:11:14.885184+0000","last_peered":"2023-07-14T18:11:14.885184+0000","last_clean":"2023-07-14T18:11:14.885184+0000","last_became_active":"2023-07-14T18:11:09.710690+0000","last_became_peered":"2023-07-14T18:11:09.710690+0000","last_unstale":"2023-07-14T18:11:14.885184+0000","last_undegraded":"2023-07-14T18:11:14.885184+0000","last_fullsized":"2023-07-14T18:11:14.885184+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_clean_scrub_stamp":"2023-07-14T18:11:08.667354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T02:39:19.763017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":13,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:11:14.886369+0000","last_change":"2023-07-14T18:11:13.789251+0000","last_active":"2023-07-14T18:11:14.886369+0000","last_peered":"2023-07-14T18:11:14.886369+0000","last_clean":"2023-07-14T18:11:14.886369+0000","last_became_active":"2023-07-14T18:11:13.788742+0000","last_became_peered":"2023-07-14T18:11:13.788742+0000","last_unstale":"2023-07-14T18:11:14.886369+0000","last_undegraded":"2023-07-14T18:11:14.886369+0000","last_fullsized":"2023-07-14T18:11:14.886369+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:12.753466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:12.753466+0000","last_clean_scrub_stamp":"2023-07-14T18:11:12.753466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T04:39:11.465407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0,2,4],"acting":[9,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.16","version":"84'2","reported_seq":22,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:11:27.817241+0000","last_change":"2023-07-14T18:11:08.692093+0000","last_active":"2023-07-14T18:11:27.817241+0000","last_peered":"2023-07-14T18:11:27.817241+0000","last_clean":"2023-07-14T18:11:27.817241+0000","last_became_active":"2023-07-14T18:11:08.691806+0000","last_became_peered":"2023-07-14T18:11:08.691806+0000","last_unstale":"2023-07-14T18:11:27.817241+0000","last_undegraded":"2023-07-14T18:11:27.817241+0000","last_fullsized":"2023-07-14T18:11:27.817241+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:07.665746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:07.665746+0000","last_clean_scrub_stamp":"2023-07-14T18:11:07.665746+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:59:54.200134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":20,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:11:14.885119+0000","last_change":"2023-07-14T18:11:09.714965+0000","last_active":"2023-07-14T18:11:14.885119+0000","last_peered":"2023-07-14T18:11:14.885119+0000","last_clean":"2023-07-14T18:11:14.885119+0000","last_became_active":"2023-07-14T18:11:09.714676+0000","last_became_peered":"2023-07-14T18:11:09.714676+0000","last_unstale":"2023-07-14T18:11:14.885119+0000","last_undegraded":"2023-07-14T18:11:14.885119+0000","last_fullsized":"2023-07-14T18:11:14.885119+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_clean_scrub_stamp":"2023-07-14T18:11:08.667354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:10:38.185488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":13,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:11:14.886587+0000","last_change":"2023-07-14T18:11:13.779218+0000","last_active":"2023-07-14T18:11:14.886587+0000","last_peered":"2023-07-14T18:11:14.886587+0000","last_clean":"2023-07-14T18:11:14.886587+0000","last_became_active":"2023-07-14T18:11:13.778833+0000","last_became_peered":"2023-07-14T18:11:13.778833+0000","last_unstale":"2023-07-14T18:11:14.886587+0000","last_undegraded":"2023-07-14T18:11:14.886587+0000","last_fullsized":"2023-07-14T18:11:14.886587+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:12.753466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:12.753466+0000","last_clean_scrub_stamp":"2023-07-14T18:11:12.753466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:59:38.858950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,9],"acting":[4,1,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"79'3","reported_seq":25,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:11:14.791431+0000","last_change":"2023-07-14T18:11:08.681778+0000","last_active":"2023-07-14T18:11:14.791431+0000","last_peered":"2023-07-14T18:11:14.791431+0000","last_clean":"2023-07-14T18:11:14.791431+0000","last_became_active":"2023-07-14T18:11:08.681406+0000","last_became_peered":"2023-07-14T18:11:08.681406+0000","last_unstale":"2023-07-14T18:11:14.791431+0000","last_undegraded":"2023-07-14T18:11:14.791431+0000","last_fullsized":"2023-07-14T18:11:14.791431+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:07.665746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:07.665746+0000","last_clean_scrub_stamp":"2023-07-14T18:11:07.665746+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:23:04.400637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":20,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:11:14.884950+0000","last_change":"2023-07-14T18:11:09.703070+0000","last_active":"2023-07-14T18:11:14.884950+0000","last_peered":"2023-07-14T18:11:14.884950+0000","last_clean":"2023-07-14T18:11:14.884950+0000","last_became_active":"2023-07-14T18:11:09.702754+0000","last_became_peered":"2023-07-14T18:11:09.702754+0000","last_unstale":"2023-07-14T18:11:14.884950+0000","last_undegraded":"2023-07-14T18:11:14.884950+0000","last_fullsized":"2023-07-14T18:11:14.884950+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_clean_scrub_stamp":"2023-07-14T18:11:08.667354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:41:59.621911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":13,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:11:14.886380+0000","last_change":"2023-07-14T18:11:13.788077+0000","last_active":"2023-07-14T18:11:14.886380+0000","last_peered":"2023-07-14T18:11:14.886380+0000","last_clean":"2023-07-14T18:11:14.886380+0000","last_became_active":"2023-07-14T18:11:13.787719+0000","last_became_peered":"2023-07-14T18:11:13.787719+0000","last_unstale":"2023-07-14T18:11:14.886380+0000","last_undegraded":"2023-07-14T18:11:14.886380+0000","last_fullsized":"2023-07-14T18:11:14.886380+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:12.753466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:12.753466+0000","last_clean_scrub_stamp":"2023-07-14T18:11:12.753466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:28:37.419577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,11,5],"acting":[9,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.14","version":"84'12","reported_seq":34,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:11:27.817477+0000","last_change":"2023-07-14T18:11:08.690538+0000","last_active":"2023-07-14T18:11:27.817477+0000","last_peered":"2023-07-14T18:11:27.817477+0000","last_clean":"2023-07-14T18:11:27.817477+0000","last_became_active":"2023-07-14T18:11:08.690152+0000","last_became_peered":"2023-07-14T18:11:08.690152+0000","last_unstale":"2023-07-14T18:11:27.817477+0000","last_undegraded":"2023-07-14T18:11:27.817477+0000","last_fullsized":"2023-07-14T18:11:27.817477+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:07.665746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:07.665746+0000","last_clean_scrub_stamp":"2023-07-14T18:11:07.665746+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:27:49.760382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3794,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":20,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:11:14.885568+0000","last_change":"2023-07-14T18:11:09.710116+0000","last_active":"2023-07-14T18:11:14.885568+0000","last_peered":"2023-07-14T18:11:14.885568+0000","last_clean":"2023-07-14T18:11:14.885568+0000","last_became_active":"2023-07-14T18:11:09.709831+0000","last_became_peered":"2023-07-14T18:11:09.709831+0000","last_unstale":"2023-07-14T18:11:14.885568+0000","last_undegraded":"2023-07-14T18:11:14.885568+0000","last_fullsized":"2023-07-14T18:11:14.885568+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_clean_scrub_stamp":"2023-07-14T18:11:08.667354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T03:06:14.287734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":13,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:11:14.791956+0000","last_change":"2023-07-14T18:11:13.777434+0000","last_active":"2023-07-14T18:11:14.791956+0000","last_peered":"2023-07-14T18:11:14.791956+0000","last_clean":"2023-07-14T18:11:14.791956+0000","last_became_active":"2023-07-14T18:11:13.776670+0000","last_became_peered":"2023-07-14T18:11:13.776670+0000","last_unstale":"2023-07-14T18:11:14.791956+0000","last_undegraded":"2023-07-14T18:11:14.791956+0000","last_fullsized":"2023-07-14T18:11:14.791956+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:12.753466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:12.753466+0000","last_clean_scrub_stamp":"2023-07-14T18:11:12.753466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T02:09:40.305735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.13","version":"84'7","reported_seq":29,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:11:28.826657+0000","last_change":"2023-07-14T18:11:08.693172+0000","last_active":"2023-07-14T18:11:28.826657+0000","last_peered":"2023-07-14T18:11:28.826657+0000","last_clean":"2023-07-14T18:11:28.826657+0000","last_became_active":"2023-07-14T18:11:08.692846+0000","last_became_peered":"2023-07-14T18:11:08.692846+0000","last_unstale":"2023-07-14T18:11:28.826657+0000","last_undegraded":"2023-07-14T18:11:28.826657+0000","last_fullsized":"2023-07-14T18:11:28.826657+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:07.665746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:07.665746+0000","last_clean_scrub_stamp":"2023-07-14T18:11:07.665746+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:24:38.511637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":20,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:11:14.790941+0000","last_change":"2023-07-14T18:11:09.708480+0000","last_active":"2023-07-14T18:11:14.790941+0000","last_peered":"2023-07-14T18:11:14.790941+0000","last_clean":"2023-07-14T18:11:14.790941+0000","last_became_active":"2023-07-14T18:11:09.708170+0000","last_became_peered":"2023-07-14T18:11:09.708170+0000","last_unstale":"2023-07-14T18:11:14.790941+0000","last_undegraded":"2023-07-14T18:11:14.790941+0000","last_fullsized":"2023-07-14T18:11:14.790941+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_clean_scrub_stamp":"2023-07-14T18:11:08.667354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T04:03:41.097364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":13,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:11:15.116981+0000","last_change":"2023-07-14T18:11:13.792069+0000","last_active":"2023-07-14T18:11:15.116981+0000","last_peered":"2023-07-14T18:11:15.116981+0000","last_clean":"2023-07-14T18:11:15.116981+0000","last_became_active":"2023-07-14T18:11:13.791698+0000","last_became_peered":"2023-07-14T18:11:13.791698+0000","last_unstale":"2023-07-14T18:11:15.116981+0000","last_undegraded":"2023-07-14T18:11:15.116981+0000","last_fullsized":"2023-07-14T18:11:15.116981+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:12.753466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:12.753466+0000","last_clean_scrub_stamp":"2023-07-14T18:11:12.753466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:36:51.740650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":22,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:11:14.791333+0000","last_change":"2023-07-14T18:11:08.685028+0000","last_active":"2023-07-14T18:11:14.791333+0000","last_peered":"2023-07-14T18:11:14.791333+0000","last_clean":"2023-07-14T18:11:14.791333+0000","last_became_active":"2023-07-14T18:11:08.684701+0000","last_became_peered":"2023-07-14T18:11:08.684701+0000","last_unstale":"2023-07-14T18:11:14.791333+0000","last_undegraded":"2023-07-14T18:11:14.791333+0000","last_fullsized":"2023-07-14T18:11:14.791333+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:07.665746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:07.665746+0000","last_clean_scrub_stamp":"2023-07-14T18:11:07.665746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:48:38.822039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":18,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:11:14.886051+0000","last_change":"2023-07-14T18:11:09.717714+0000","last_active":"2023-07-14T18:11:14.886051+0000","last_peered":"2023-07-14T18:11:14.886051+0000","last_clean":"2023-07-14T18:11:14.886051+0000","last_became_active":"2023-07-14T18:11:09.717407+0000","last_became_peered":"2023-07-14T18:11:09.717407+0000","last_unstale":"2023-07-14T18:11:14.886051+0000","last_undegraded":"2023-07-14T18:11:14.886051+0000","last_fullsized":"2023-07-14T18:11:14.886051+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_clean_scrub_stamp":"2023-07-14T18:11:08.667354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T02:18:33.466738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":13,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:11:14.887107+0000","last_change":"2023-07-14T18:11:13.787754+0000","last_active":"2023-07-14T18:11:14.887107+0000","last_peered":"2023-07-14T18:11:14.887107+0000","last_clean":"2023-07-14T18:11:14.887107+0000","last_became_active":"2023-07-14T18:11:13.787250+0000","last_became_peered":"2023-07-14T18:11:13.787250+0000","last_unstale":"2023-07-14T18:11:14.887107+0000","last_undegraded":"2023-07-14T18:11:14.887107+0000","last_fullsized":"2023-07-14T18:11:14.887107+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:12.753466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:12.753466+0000","last_clean_scrub_stamp":"2023-07-14T18:11:12.753466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T03:54:39.337152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,0,3],"acting":[9,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":22,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:11:14.885236+0000","last_change":"2023-07-14T18:11:08.685327+0000","last_active":"2023-07-14T18:11:14.885236+0000","last_peered":"2023-07-14T18:11:14.885236+0000","last_clean":"2023-07-14T18:11:14.885236+0000","last_became_active":"2023-07-14T18:11:08.684969+0000","last_became_peered":"2023-07-14T18:11:08.684969+0000","last_unstale":"2023-07-14T18:11:14.885236+0000","last_undegraded":"2023-07-14T18:11:14.885236+0000","last_fullsized":"2023-07-14T18:11:14.885236+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:07.665746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:07.665746+0000","last_clean_scrub_stamp":"2023-07-14T18:11:07.665746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:38:18.572332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":18,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:11:14.886418+0000","last_change":"2023-07-14T18:11:09.721100+0000","last_active":"2023-07-14T18:11:14.886418+0000","last_peered":"2023-07-14T18:11:14.886418+0000","last_clean":"2023-07-14T18:11:14.886418+0000","last_became_active":"2023-07-14T18:11:09.720814+0000","last_became_peered":"2023-07-14T18:11:09.720814+0000","last_unstale":"2023-07-14T18:11:14.886418+0000","last_undegraded":"2023-07-14T18:11:14.886418+0000","last_fullsized":"2023-07-14T18:11:14.886418+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_clean_scrub_stamp":"2023-07-14T18:11:08.667354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:21:49.557811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":13,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:11:14.791294+0000","last_change":"2023-07-14T18:11:13.782152+0000","last_active":"2023-07-14T18:11:14.791294+0000","last_peered":"2023-07-14T18:11:14.791294+0000","last_clean":"2023-07-14T18:11:14.791294+0000","last_became_active":"2023-07-14T18:11:13.780580+0000","last_became_peered":"2023-07-14T18:11:13.780580+0000","last_unstale":"2023-07-14T18:11:14.791294+0000","last_undegraded":"2023-07-14T18:11:14.791294+0000","last_fullsized":"2023-07-14T18:11:14.791294+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:12.753466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:12.753466+0000","last_clean_scrub_stamp":"2023-07-14T18:11:12.753466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T05:13:05.195958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"84'17","reported_seq":40,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:11:30.764437+0000","last_change":"2023-07-14T18:11:08.688954+0000","last_active":"2023-07-14T18:11:30.764437+0000","last_peered":"2023-07-14T18:11:30.764437+0000","last_clean":"2023-07-14T18:11:30.764437+0000","last_became_active":"2023-07-14T18:11:08.688640+0000","last_became_peered":"2023-07-14T18:11:08.688640+0000","last_unstale":"2023-07-14T18:11:30.764437+0000","last_undegraded":"2023-07-14T18:11:30.764437+0000","last_fullsized":"2023-07-14T18:11:30.764437+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:07.665746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:07.665746+0000","last_clean_scrub_stamp":"2023-07-14T18:11:07.665746+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:21:30.166422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":20,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:11:14.791112+0000","last_change":"2023-07-14T18:11:09.710105+0000","last_active":"2023-07-14T18:11:14.791112+0000","last_peered":"2023-07-14T18:11:14.791112+0000","last_clean":"2023-07-14T18:11:14.791112+0000","last_became_active":"2023-07-14T18:11:09.709820+0000","last_became_peered":"2023-07-14T18:11:09.709820+0000","last_unstale":"2023-07-14T18:11:14.791112+0000","last_undegraded":"2023-07-14T18:11:14.791112+0000","last_fullsized":"2023-07-14T18:11:14.791112+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_clean_scrub_stamp":"2023-07-14T18:11:08.667354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:29:12.467495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":13,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:11:14.791138+0000","last_change":"2023-07-14T18:11:13.780122+0000","last_active":"2023-07-14T18:11:14.791138+0000","last_peered":"2023-07-14T18:11:14.791138+0000","last_clean":"2023-07-14T18:11:14.791138+0000","last_became_active":"2023-07-14T18:11:13.779774+0000","last_became_peered":"2023-07-14T18:11:13.779774+0000","last_unstale":"2023-07-14T18:11:14.791138+0000","last_undegraded":"2023-07-14T18:11:14.791138+0000","last_fullsized":"2023-07-14T18:11:14.791138+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:12.753466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:12.753466+0000","last_clean_scrub_stamp":"2023-07-14T18:11:12.753466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:30:22.618282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"84'2","reported_seq":25,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:11:29.872951+0000","last_change":"2023-07-14T18:11:08.686080+0000","last_active":"2023-07-14T18:11:29.872951+0000","last_peered":"2023-07-14T18:11:29.872951+0000","last_clean":"2023-07-14T18:11:29.872951+0000","last_became_active":"2023-07-14T18:11:08.685837+0000","last_became_peered":"2023-07-14T18:11:08.685837+0000","last_unstale":"2023-07-14T18:11:29.872951+0000","last_undegraded":"2023-07-14T18:11:29.872951+0000","last_fullsized":"2023-07-14T18:11:29.872951+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:07.665746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:07.665746+0000","last_clean_scrub_stamp":"2023-07-14T18:11:07.665746+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:51:30.759050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":20,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:11:15.117046+0000","last_change":"2023-07-14T18:11:09.712166+0000","last_active":"2023-07-14T18:11:15.117046+0000","last_peered":"2023-07-14T18:11:15.117046+0000","last_clean":"2023-07-14T18:11:15.117046+0000","last_became_active":"2023-07-14T18:11:09.711858+0000","last_became_peered":"2023-07-14T18:11:09.711858+0000","last_unstale":"2023-07-14T18:11:15.117046+0000","last_undegraded":"2023-07-14T18:11:15.117046+0000","last_fullsized":"2023-07-14T18:11:15.117046+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_clean_scrub_stamp":"2023-07-14T18:11:08.667354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:17:12.495175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":13,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:11:14.885280+0000","last_change":"2023-07-14T18:11:13.905188+0000","last_active":"2023-07-14T18:11:14.885280+0000","last_peered":"2023-07-14T18:11:14.885280+0000","last_clean":"2023-07-14T18:11:14.885280+0000","last_became_active":"2023-07-14T18:11:13.904779+0000","last_became_peered":"2023-07-14T18:11:13.904779+0000","last_unstale":"2023-07-14T18:11:14.885280+0000","last_undegraded":"2023-07-14T18:11:14.885280+0000","last_fullsized":"2023-07-14T18:11:14.885280+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:12.753466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:12.753466+0000","last_clean_scrub_stamp":"2023-07-14T18:11:12.753466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:58:40.490499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,9],"acting":[8,10,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:11:14.886870+0000","last_change":"2023-07-14T18:11:08.687838+0000","last_active":"2023-07-14T18:11:14.886870+0000","last_peered":"2023-07-14T18:11:14.886870+0000","last_clean":"2023-07-14T18:11:14.886870+0000","last_became_active":"2023-07-14T18:11:08.687522+0000","last_became_peered":"2023-07-14T18:11:08.687522+0000","last_unstale":"2023-07-14T18:11:14.886870+0000","last_undegraded":"2023-07-14T18:11:14.886870+0000","last_fullsized":"2023-07-14T18:11:14.886870+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:07.665746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:07.665746+0000","last_clean_scrub_stamp":"2023-07-14T18:11:07.665746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T01:12:01.083801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":20,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:11:14.791607+0000","last_change":"2023-07-14T18:11:09.704033+0000","last_active":"2023-07-14T18:11:14.791607+0000","last_peered":"2023-07-14T18:11:14.791607+0000","last_clean":"2023-07-14T18:11:14.791607+0000","last_became_active":"2023-07-14T18:11:09.703727+0000","last_became_peered":"2023-07-14T18:11:09.703727+0000","last_unstale":"2023-07-14T18:11:14.791607+0000","last_undegraded":"2023-07-14T18:11:14.791607+0000","last_fullsized":"2023-07-14T18:11:14.791607+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_clean_scrub_stamp":"2023-07-14T18:11:08.667354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T04:23:57.185860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":13,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:11:14.791177+0000","last_change":"2023-07-14T18:11:13.778207+0000","last_active":"2023-07-14T18:11:14.791177+0000","last_peered":"2023-07-14T18:11:14.791177+0000","last_clean":"2023-07-14T18:11:14.791177+0000","last_became_active":"2023-07-14T18:11:13.777847+0000","last_became_peered":"2023-07-14T18:11:13.777847+0000","last_unstale":"2023-07-14T18:11:14.791177+0000","last_undegraded":"2023-07-14T18:11:14.791177+0000","last_fullsized":"2023-07-14T18:11:14.791177+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:12.753466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:12.753466+0000","last_clean_scrub_stamp":"2023-07-14T18:11:12.753466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:48:12.622534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"84'1","reported_seq":21,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:11:14.885851+0000","last_change":"2023-07-14T18:11:08.683570+0000","last_active":"2023-07-14T18:11:14.885851+0000","last_peered":"2023-07-14T18:11:14.885851+0000","last_clean":"2023-07-14T18:11:14.885851+0000","last_became_active":"2023-07-14T18:11:08.683271+0000","last_became_peered":"2023-07-14T18:11:08.683271+0000","last_unstale":"2023-07-14T18:11:14.885851+0000","last_undegraded":"2023-07-14T18:11:14.885851+0000","last_fullsized":"2023-07-14T18:11:14.885851+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:07.665746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:07.665746+0000","last_clean_scrub_stamp":"2023-07-14T18:11:07.665746+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:27:31.589898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":20,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:11:14.791596+0000","last_change":"2023-07-14T18:11:09.718239+0000","last_active":"2023-07-14T18:11:14.791596+0000","last_peered":"2023-07-14T18:11:14.791596+0000","last_clean":"2023-07-14T18:11:14.791596+0000","last_became_active":"2023-07-14T18:11:09.717923+0000","last_became_peered":"2023-07-14T18:11:09.717923+0000","last_unstale":"2023-07-14T18:11:14.791596+0000","last_undegraded":"2023-07-14T18:11:14.791596+0000","last_fullsized":"2023-07-14T18:11:14.791596+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_clean_scrub_stamp":"2023-07-14T18:11:08.667354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T04:18:29.161266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":13,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:11:14.791411+0000","last_change":"2023-07-14T18:11:13.904652+0000","last_active":"2023-07-14T18:11:14.791411+0000","last_peered":"2023-07-14T18:11:14.791411+0000","last_clean":"2023-07-14T18:11:14.791411+0000","last_became_active":"2023-07-14T18:11:13.904237+0000","last_became_peered":"2023-07-14T18:11:13.904237+0000","last_unstale":"2023-07-14T18:11:14.791411+0000","last_undegraded":"2023-07-14T18:11:14.791411+0000","last_fullsized":"2023-07-14T18:11:14.791411+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:12.753466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:12.753466+0000","last_clean_scrub_stamp":"2023-07-14T18:11:12.753466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T05:43:29.030625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":20,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:11:14.791182+0000","last_change":"2023-07-14T18:11:09.707086+0000","last_active":"2023-07-14T18:11:14.791182+0000","last_peered":"2023-07-14T18:11:14.791182+0000","last_clean":"2023-07-14T18:11:14.791182+0000","last_became_active":"2023-07-14T18:11:09.705882+0000","last_became_peered":"2023-07-14T18:11:09.705882+0000","last_unstale":"2023-07-14T18:11:14.791182+0000","last_undegraded":"2023-07-14T18:11:14.791182+0000","last_fullsized":"2023-07-14T18:11:14.791182+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_clean_scrub_stamp":"2023-07-14T18:11:08.667354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T03:39:47.438151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"84'4","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:11:28.829172+0000","last_change":"2023-07-14T18:11:08.683447+0000","last_active":"2023-07-14T18:11:28.829172+0000","last_peered":"2023-07-14T18:11:28.829172+0000","last_clean":"2023-07-14T18:11:28.829172+0000","last_became_active":"2023-07-14T18:11:08.682822+0000","last_became_peered":"2023-07-14T18:11:08.682822+0000","last_unstale":"2023-07-14T18:11:28.829172+0000","last_undegraded":"2023-07-14T18:11:28.829172+0000","last_fullsized":"2023-07-14T18:11:28.829172+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:07.665746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:07.665746+0000","last_clean_scrub_stamp":"2023-07-14T18:11:07.665746+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:07:15.245024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":13,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:11:14.885169+0000","last_change":"2023-07-14T18:11:13.780698+0000","last_active":"2023-07-14T18:11:14.885169+0000","last_peered":"2023-07-14T18:11:14.885169+0000","last_clean":"2023-07-14T18:11:14.885169+0000","last_became_active":"2023-07-14T18:11:13.780310+0000","last_became_peered":"2023-07-14T18:11:13.780310+0000","last_unstale":"2023-07-14T18:11:14.885169+0000","last_undegraded":"2023-07-14T18:11:14.885169+0000","last_fullsized":"2023-07-14T18:11:14.885169+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:12.753466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:12.753466+0000","last_clean_scrub_stamp":"2023-07-14T18:11:12.753466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:45:25.175685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,9],"acting":[7,5,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":20,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:11:14.884951+0000","last_change":"2023-07-14T18:11:09.708728+0000","last_active":"2023-07-14T18:11:14.884951+0000","last_peered":"2023-07-14T18:11:14.884951+0000","last_clean":"2023-07-14T18:11:14.884951+0000","last_became_active":"2023-07-14T18:11:09.708345+0000","last_became_peered":"2023-07-14T18:11:09.708345+0000","last_unstale":"2023-07-14T18:11:14.884951+0000","last_undegraded":"2023-07-14T18:11:14.884951+0000","last_fullsized":"2023-07-14T18:11:14.884951+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_clean_scrub_stamp":"2023-07-14T18:11:08.667354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:19:56.524734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":22,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:11:14.886437+0000","last_change":"2023-07-14T18:11:08.684495+0000","last_active":"2023-07-14T18:11:14.886437+0000","last_peered":"2023-07-14T18:11:14.886437+0000","last_clean":"2023-07-14T18:11:14.886437+0000","last_became_active":"2023-07-14T18:11:08.684142+0000","last_became_peered":"2023-07-14T18:11:08.684142+0000","last_unstale":"2023-07-14T18:11:14.886437+0000","last_undegraded":"2023-07-14T18:11:14.886437+0000","last_fullsized":"2023-07-14T18:11:14.886437+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:07.665746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:07.665746+0000","last_clean_scrub_stamp":"2023-07-14T18:11:07.665746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T04:13:36.850275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"22'137","reported_seq":336,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:11:14.886019+0000","last_change":"2023-07-14T18:10:10.733548+0000","last_active":"2023-07-14T18:11:14.886019+0000","last_peered":"2023-07-14T18:11:14.886019+0000","last_clean":"2023-07-14T18:11:14.886019+0000","last_became_active":"2023-07-14T18:10:10.732994+0000","last_became_peered":"2023-07-14T18:10:10.732994+0000","last_unstale":"2023-07-14T18:11:14.886019+0000","last_undegraded":"2023-07-14T18:11:14.886019+0000","last_fullsized":"2023-07-14T18:11:14.886019+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:07:19.893754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:07:19.893754+0000","last_clean_scrub_stamp":"2023-07-14T18:07:19.893754+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T03:18:47.801203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":13,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:11:14.791877+0000","last_change":"2023-07-14T18:11:13.905811+0000","last_active":"2023-07-14T18:11:14.791877+0000","last_peered":"2023-07-14T18:11:14.791877+0000","last_clean":"2023-07-14T18:11:14.791877+0000","last_became_active":"2023-07-14T18:11:13.905390+0000","last_became_peered":"2023-07-14T18:11:13.905390+0000","last_unstale":"2023-07-14T18:11:14.791877+0000","last_undegraded":"2023-07-14T18:11:14.791877+0000","last_fullsized":"2023-07-14T18:11:14.791877+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:12.753466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:12.753466+0000","last_clean_scrub_stamp":"2023-07-14T18:11:12.753466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T03:55:38.653507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,6,10],"acting":[5,9,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":20,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:11:14.790613+0000","last_change":"2023-07-14T18:11:09.711008+0000","last_active":"2023-07-14T18:11:14.790613+0000","last_peered":"2023-07-14T18:11:14.790613+0000","last_clean":"2023-07-14T18:11:14.790613+0000","last_became_active":"2023-07-14T18:11:09.710555+0000","last_became_peered":"2023-07-14T18:11:09.710555+0000","last_unstale":"2023-07-14T18:11:14.790613+0000","last_undegraded":"2023-07-14T18:11:14.790613+0000","last_fullsized":"2023-07-14T18:11:14.790613+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_clean_scrub_stamp":"2023-07-14T18:11:08.667354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:14:16.607280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"84'3","reported_seq":23,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:11:28.825348+0000","last_change":"2023-07-14T18:11:08.689050+0000","last_active":"2023-07-14T18:11:28.825348+0000","last_peered":"2023-07-14T18:11:28.825348+0000","last_clean":"2023-07-14T18:11:28.825348+0000","last_became_active":"2023-07-14T18:11:08.688777+0000","last_became_peered":"2023-07-14T18:11:08.688777+0000","last_unstale":"2023-07-14T18:11:28.825348+0000","last_undegraded":"2023-07-14T18:11:28.825348+0000","last_fullsized":"2023-07-14T18:11:28.825348+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:07.665746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:07.665746+0000","last_clean_scrub_stamp":"2023-07-14T18:11:07.665746+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T01:15:28.678572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":13,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:11:15.116864+0000","last_change":"2023-07-14T18:11:13.776853+0000","last_active":"2023-07-14T18:11:15.116864+0000","last_peered":"2023-07-14T18:11:15.116864+0000","last_clean":"2023-07-14T18:11:15.116864+0000","last_became_active":"2023-07-14T18:11:13.776353+0000","last_became_peered":"2023-07-14T18:11:13.776353+0000","last_unstale":"2023-07-14T18:11:15.116864+0000","last_undegraded":"2023-07-14T18:11:15.116864+0000","last_fullsized":"2023-07-14T18:11:15.116864+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:12.753466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:12.753466+0000","last_clean_scrub_stamp":"2023-07-14T18:11:12.753466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:40:03.971774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.5","version":"84'4","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:11:30.766318+0000","last_change":"2023-07-14T18:11:08.691634+0000","last_active":"2023-07-14T18:11:30.766318+0000","last_peered":"2023-07-14T18:11:30.766318+0000","last_clean":"2023-07-14T18:11:30.766318+0000","last_became_active":"2023-07-14T18:11:08.691315+0000","last_became_peered":"2023-07-14T18:11:08.691315+0000","last_unstale":"2023-07-14T18:11:30.766318+0000","last_undegraded":"2023-07-14T18:11:30.766318+0000","last_fullsized":"2023-07-14T18:11:30.766318+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:07.665746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:07.665746+0000","last_clean_scrub_stamp":"2023-07-14T18:11:07.665746+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:52:43.536254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":20,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:11:14.791290+0000","last_change":"2023-07-14T18:11:09.707486+0000","last_active":"2023-07-14T18:11:14.791290+0000","last_peered":"2023-07-14T18:11:14.791290+0000","last_clean":"2023-07-14T18:11:14.791290+0000","last_became_active":"2023-07-14T18:11:09.707168+0000","last_became_peered":"2023-07-14T18:11:09.707168+0000","last_unstale":"2023-07-14T18:11:14.791290+0000","last_undegraded":"2023-07-14T18:11:14.791290+0000","last_fullsized":"2023-07-14T18:11:14.791290+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_clean_scrub_stamp":"2023-07-14T18:11:08.667354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T06:10:06.422348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":13,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:11:14.885841+0000","last_change":"2023-07-14T18:11:13.905898+0000","last_active":"2023-07-14T18:11:14.885841+0000","last_peered":"2023-07-14T18:11:14.885841+0000","last_clean":"2023-07-14T18:11:14.885841+0000","last_became_active":"2023-07-14T18:11:13.905482+0000","last_became_peered":"2023-07-14T18:11:13.905482+0000","last_unstale":"2023-07-14T18:11:14.885841+0000","last_undegraded":"2023-07-14T18:11:14.885841+0000","last_fullsized":"2023-07-14T18:11:14.885841+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:12.753466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:12.753466+0000","last_clean_scrub_stamp":"2023-07-14T18:11:12.753466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T01:29:14.269244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"82'1","reported_seq":23,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:11:14.886941+0000","last_change":"2023-07-14T18:11:08.692339+0000","last_active":"2023-07-14T18:11:14.886941+0000","last_peered":"2023-07-14T18:11:14.886941+0000","last_clean":"2023-07-14T18:11:14.886941+0000","last_became_active":"2023-07-14T18:11:08.692047+0000","last_became_peered":"2023-07-14T18:11:08.692047+0000","last_unstale":"2023-07-14T18:11:14.886941+0000","last_undegraded":"2023-07-14T18:11:14.886941+0000","last_fullsized":"2023-07-14T18:11:14.886941+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:07.665746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:07.665746+0000","last_clean_scrub_stamp":"2023-07-14T18:11:07.665746+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:12:32.523480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":20,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:11:14.886517+0000","last_change":"2023-07-14T18:11:09.709900+0000","last_active":"2023-07-14T18:11:14.886517+0000","last_peered":"2023-07-14T18:11:14.886517+0000","last_clean":"2023-07-14T18:11:14.886517+0000","last_became_active":"2023-07-14T18:11:09.709291+0000","last_became_peered":"2023-07-14T18:11:09.709291+0000","last_unstale":"2023-07-14T18:11:14.886517+0000","last_undegraded":"2023-07-14T18:11:14.886517+0000","last_fullsized":"2023-07-14T18:11:14.886517+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_clean_scrub_stamp":"2023-07-14T18:11:08.667354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:28:37.556066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":13,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:11:14.884032+0000","last_change":"2023-07-14T18:11:13.777493+0000","last_active":"2023-07-14T18:11:14.884032+0000","last_peered":"2023-07-14T18:11:14.884032+0000","last_clean":"2023-07-14T18:11:14.884032+0000","last_became_active":"2023-07-14T18:11:13.777110+0000","last_became_peered":"2023-07-14T18:11:13.777110+0000","last_unstale":"2023-07-14T18:11:14.884032+0000","last_undegraded":"2023-07-14T18:11:14.884032+0000","last_fullsized":"2023-07-14T18:11:14.884032+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:12.753466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:12.753466+0000","last_clean_scrub_stamp":"2023-07-14T18:11:12.753466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T04:26:56.453763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"79'2","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:11:14.885895+0000","last_change":"2023-07-14T18:11:08.686832+0000","last_active":"2023-07-14T18:11:14.885895+0000","last_peered":"2023-07-14T18:11:14.885895+0000","last_clean":"2023-07-14T18:11:14.885895+0000","last_became_active":"2023-07-14T18:11:08.686461+0000","last_became_peered":"2023-07-14T18:11:08.686461+0000","last_unstale":"2023-07-14T18:11:14.885895+0000","last_undegraded":"2023-07-14T18:11:14.885895+0000","last_fullsized":"2023-07-14T18:11:14.885895+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:07.665746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:07.665746+0000","last_clean_scrub_stamp":"2023-07-14T18:11:07.665746+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:28:44.517803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":20,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:11:14.884614+0000","last_change":"2023-07-14T18:11:09.715641+0000","last_active":"2023-07-14T18:11:14.884614+0000","last_peered":"2023-07-14T18:11:14.884614+0000","last_clean":"2023-07-14T18:11:14.884614+0000","last_became_active":"2023-07-14T18:11:09.715312+0000","last_became_peered":"2023-07-14T18:11:09.715312+0000","last_unstale":"2023-07-14T18:11:14.884614+0000","last_undegraded":"2023-07-14T18:11:14.884614+0000","last_fullsized":"2023-07-14T18:11:14.884614+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_clean_scrub_stamp":"2023-07-14T18:11:08.667354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:42:02.097258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":13,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:11:14.886127+0000","last_change":"2023-07-14T18:11:13.905856+0000","last_active":"2023-07-14T18:11:14.886127+0000","last_peered":"2023-07-14T18:11:14.886127+0000","last_clean":"2023-07-14T18:11:14.886127+0000","last_became_active":"2023-07-14T18:11:13.905441+0000","last_became_peered":"2023-07-14T18:11:13.905441+0000","last_unstale":"2023-07-14T18:11:14.886127+0000","last_undegraded":"2023-07-14T18:11:14.886127+0000","last_fullsized":"2023-07-14T18:11:14.886127+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:12.753466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:12.753466+0000","last_clean_scrub_stamp":"2023-07-14T18:11:12.753466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T04:13:12.089073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,9],"acting":[4,5,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"84'2","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:11:27.817107+0000","last_change":"2023-07-14T18:11:08.685683+0000","last_active":"2023-07-14T18:11:27.817107+0000","last_peered":"2023-07-14T18:11:27.817107+0000","last_clean":"2023-07-14T18:11:27.817107+0000","last_became_active":"2023-07-14T18:11:08.685371+0000","last_became_peered":"2023-07-14T18:11:08.685371+0000","last_unstale":"2023-07-14T18:11:27.817107+0000","last_undegraded":"2023-07-14T18:11:27.817107+0000","last_fullsized":"2023-07-14T18:11:27.817107+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:07.665746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:07.665746+0000","last_clean_scrub_stamp":"2023-07-14T18:11:07.665746+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:19:35.470859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":20,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:11:14.884696+0000","last_change":"2023-07-14T18:11:09.711219+0000","last_active":"2023-07-14T18:11:14.884696+0000","last_peered":"2023-07-14T18:11:14.884696+0000","last_clean":"2023-07-14T18:11:14.884696+0000","last_became_active":"2023-07-14T18:11:09.711019+0000","last_became_peered":"2023-07-14T18:11:09.711019+0000","last_unstale":"2023-07-14T18:11:14.884696+0000","last_undegraded":"2023-07-14T18:11:14.884696+0000","last_fullsized":"2023-07-14T18:11:14.884696+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_clean_scrub_stamp":"2023-07-14T18:11:08.667354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:14:56.588616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":13,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:11:14.887189+0000","last_change":"2023-07-14T18:11:13.788530+0000","last_active":"2023-07-14T18:11:14.887189+0000","last_peered":"2023-07-14T18:11:14.887189+0000","last_clean":"2023-07-14T18:11:14.887189+0000","last_became_active":"2023-07-14T18:11:13.787952+0000","last_became_peered":"2023-07-14T18:11:13.787952+0000","last_unstale":"2023-07-14T18:11:14.887189+0000","last_undegraded":"2023-07-14T18:11:14.887189+0000","last_fullsized":"2023-07-14T18:11:14.887189+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:12.753466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:12.753466+0000","last_clean_scrub_stamp":"2023-07-14T18:11:12.753466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:19:37.880630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.9","version":"84'7","reported_seq":29,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:11:30.772567+0000","last_change":"2023-07-14T18:11:08.692719+0000","last_active":"2023-07-14T18:11:30.772567+0000","last_peered":"2023-07-14T18:11:30.772567+0000","last_clean":"2023-07-14T18:11:30.772567+0000","last_became_active":"2023-07-14T18:11:08.692390+0000","last_became_peered":"2023-07-14T18:11:08.692390+0000","last_unstale":"2023-07-14T18:11:30.772567+0000","last_undegraded":"2023-07-14T18:11:30.772567+0000","last_fullsized":"2023-07-14T18:11:30.772567+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:07.665746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:07.665746+0000","last_clean_scrub_stamp":"2023-07-14T18:11:07.665746+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T04:19:14.229274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":20,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:11:15.116807+0000","last_change":"2023-07-14T18:11:09.719176+0000","last_active":"2023-07-14T18:11:15.116807+0000","last_peered":"2023-07-14T18:11:15.116807+0000","last_clean":"2023-07-14T18:11:15.116807+0000","last_became_active":"2023-07-14T18:11:09.712667+0000","last_became_peered":"2023-07-14T18:11:09.712667+0000","last_unstale":"2023-07-14T18:11:15.116807+0000","last_undegraded":"2023-07-14T18:11:15.116807+0000","last_fullsized":"2023-07-14T18:11:15.116807+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_clean_scrub_stamp":"2023-07-14T18:11:08.667354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:13:03.473559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":13,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:11:14.885541+0000","last_change":"2023-07-14T18:11:13.791717+0000","last_active":"2023-07-14T18:11:14.885541+0000","last_peered":"2023-07-14T18:11:14.885541+0000","last_clean":"2023-07-14T18:11:14.885541+0000","last_became_active":"2023-07-14T18:11:13.791280+0000","last_became_peered":"2023-07-14T18:11:13.791280+0000","last_unstale":"2023-07-14T18:11:14.885541+0000","last_undegraded":"2023-07-14T18:11:14.885541+0000","last_fullsized":"2023-07-14T18:11:14.885541+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:12.753466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:12.753466+0000","last_clean_scrub_stamp":"2023-07-14T18:11:12.753466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:02:11.918589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9,7,8],"acting":[4,9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"84'1","reported_seq":23,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:11:14.884580+0000","last_change":"2023-07-14T18:11:08.692842+0000","last_active":"2023-07-14T18:11:14.884580+0000","last_peered":"2023-07-14T18:11:14.884580+0000","last_clean":"2023-07-14T18:11:14.884580+0000","last_became_active":"2023-07-14T18:11:08.692534+0000","last_became_peered":"2023-07-14T18:11:08.692534+0000","last_unstale":"2023-07-14T18:11:14.884580+0000","last_undegraded":"2023-07-14T18:11:14.884580+0000","last_fullsized":"2023-07-14T18:11:14.884580+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:07.665746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:07.665746+0000","last_clean_scrub_stamp":"2023-07-14T18:11:07.665746+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T06:10:00.305017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":20,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:11:14.885673+0000","last_change":"2023-07-14T18:11:09.703665+0000","last_active":"2023-07-14T18:11:14.885673+0000","last_peered":"2023-07-14T18:11:14.885673+0000","last_clean":"2023-07-14T18:11:14.885673+0000","last_became_active":"2023-07-14T18:11:09.703288+0000","last_became_peered":"2023-07-14T18:11:09.703288+0000","last_unstale":"2023-07-14T18:11:14.885673+0000","last_undegraded":"2023-07-14T18:11:14.885673+0000","last_fullsized":"2023-07-14T18:11:14.885673+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_clean_scrub_stamp":"2023-07-14T18:11:08.667354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:03:08.989108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":13,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:11:14.885620+0000","last_change":"2023-07-14T18:11:13.904604+0000","last_active":"2023-07-14T18:11:14.885620+0000","last_peered":"2023-07-14T18:11:14.885620+0000","last_clean":"2023-07-14T18:11:14.885620+0000","last_became_active":"2023-07-14T18:11:13.904245+0000","last_became_peered":"2023-07-14T18:11:13.904245+0000","last_unstale":"2023-07-14T18:11:14.885620+0000","last_undegraded":"2023-07-14T18:11:14.885620+0000","last_fullsized":"2023-07-14T18:11:14.885620+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:12.753466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:12.753466+0000","last_clean_scrub_stamp":"2023-07-14T18:11:12.753466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:22:17.468414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.b","version":"84'4","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:11:27.818020+0000","last_change":"2023-07-14T18:11:08.689876+0000","last_active":"2023-07-14T18:11:27.818020+0000","last_peered":"2023-07-14T18:11:27.818020+0000","last_clean":"2023-07-14T18:11:27.818020+0000","last_became_active":"2023-07-14T18:11:08.689582+0000","last_became_peered":"2023-07-14T18:11:08.689582+0000","last_unstale":"2023-07-14T18:11:27.818020+0000","last_undegraded":"2023-07-14T18:11:27.818020+0000","last_fullsized":"2023-07-14T18:11:27.818020+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:07.665746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:07.665746+0000","last_clean_scrub_stamp":"2023-07-14T18:11:07.665746+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:43:59.769036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":18,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:11:14.885962+0000","last_change":"2023-07-14T18:11:09.708228+0000","last_active":"2023-07-14T18:11:14.885962+0000","last_peered":"2023-07-14T18:11:14.885962+0000","last_clean":"2023-07-14T18:11:14.885962+0000","last_became_active":"2023-07-14T18:11:09.707985+0000","last_became_peered":"2023-07-14T18:11:09.707985+0000","last_unstale":"2023-07-14T18:11:14.885962+0000","last_undegraded":"2023-07-14T18:11:14.885962+0000","last_fullsized":"2023-07-14T18:11:14.885962+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_clean_scrub_stamp":"2023-07-14T18:11:08.667354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:01:49.217181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":13,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:11:14.884724+0000","last_change":"2023-07-14T18:11:13.775297+0000","last_active":"2023-07-14T18:11:14.884724+0000","last_peered":"2023-07-14T18:11:14.884724+0000","last_clean":"2023-07-14T18:11:14.884724+0000","last_became_active":"2023-07-14T18:11:13.774857+0000","last_became_peered":"2023-07-14T18:11:13.774857+0000","last_unstale":"2023-07-14T18:11:14.884724+0000","last_undegraded":"2023-07-14T18:11:14.884724+0000","last_fullsized":"2023-07-14T18:11:14.884724+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:12.753466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:12.753466+0000","last_clean_scrub_stamp":"2023-07-14T18:11:12.753466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:27:32.913667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.c","version":"84'5","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:11:29.835855+0000","last_change":"2023-07-14T18:11:08.689560+0000","last_active":"2023-07-14T18:11:29.835855+0000","last_peered":"2023-07-14T18:11:29.835855+0000","last_clean":"2023-07-14T18:11:29.835855+0000","last_became_active":"2023-07-14T18:11:08.689249+0000","last_became_peered":"2023-07-14T18:11:08.689249+0000","last_unstale":"2023-07-14T18:11:29.835855+0000","last_undegraded":"2023-07-14T18:11:29.835855+0000","last_fullsized":"2023-07-14T18:11:29.835855+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:07.665746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:07.665746+0000","last_clean_scrub_stamp":"2023-07-14T18:11:07.665746+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:02:04.221663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1122,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":18,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:11:14.885567+0000","last_change":"2023-07-14T18:11:09.720321+0000","last_active":"2023-07-14T18:11:14.885567+0000","last_peered":"2023-07-14T18:11:14.885567+0000","last_clean":"2023-07-14T18:11:14.885567+0000","last_became_active":"2023-07-14T18:11:09.720080+0000","last_became_peered":"2023-07-14T18:11:09.720080+0000","last_unstale":"2023-07-14T18:11:14.885567+0000","last_undegraded":"2023-07-14T18:11:14.885567+0000","last_fullsized":"2023-07-14T18:11:14.885567+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_clean_scrub_stamp":"2023-07-14T18:11:08.667354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T02:20:48.603885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":13,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:11:14.884372+0000","last_change":"2023-07-14T18:11:13.779349+0000","last_active":"2023-07-14T18:11:14.884372+0000","last_peered":"2023-07-14T18:11:14.884372+0000","last_clean":"2023-07-14T18:11:14.884372+0000","last_became_active":"2023-07-14T18:11:13.778946+0000","last_became_peered":"2023-07-14T18:11:13.778946+0000","last_unstale":"2023-07-14T18:11:14.884372+0000","last_undegraded":"2023-07-14T18:11:14.884372+0000","last_fullsized":"2023-07-14T18:11:14.884372+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:12.753466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:12.753466+0000","last_clean_scrub_stamp":"2023-07-14T18:11:12.753466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T04:25:22.766441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9,1,4],"acting":[0,9,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"79'1","reported_seq":23,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:11:14.791713+0000","last_change":"2023-07-14T18:11:08.683760+0000","last_active":"2023-07-14T18:11:14.791713+0000","last_peered":"2023-07-14T18:11:14.791713+0000","last_clean":"2023-07-14T18:11:14.791713+0000","last_became_active":"2023-07-14T18:11:08.683461+0000","last_became_peered":"2023-07-14T18:11:08.683461+0000","last_unstale":"2023-07-14T18:11:14.791713+0000","last_undegraded":"2023-07-14T18:11:14.791713+0000","last_fullsized":"2023-07-14T18:11:14.791713+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:07.665746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:07.665746+0000","last_clean_scrub_stamp":"2023-07-14T18:11:07.665746+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:26:31.918002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":18,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:11:14.884846+0000","last_change":"2023-07-14T18:11:09.708701+0000","last_active":"2023-07-14T18:11:14.884846+0000","last_peered":"2023-07-14T18:11:14.884846+0000","last_clean":"2023-07-14T18:11:14.884846+0000","last_became_active":"2023-07-14T18:11:09.708410+0000","last_became_peered":"2023-07-14T18:11:09.708410+0000","last_unstale":"2023-07-14T18:11:14.884846+0000","last_undegraded":"2023-07-14T18:11:14.884846+0000","last_fullsized":"2023-07-14T18:11:14.884846+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_clean_scrub_stamp":"2023-07-14T18:11:08.667354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T05:04:14.745169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":13,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:11:14.790903+0000","last_change":"2023-07-14T18:11:13.776584+0000","last_active":"2023-07-14T18:11:14.790903+0000","last_peered":"2023-07-14T18:11:14.790903+0000","last_clean":"2023-07-14T18:11:14.790903+0000","last_became_active":"2023-07-14T18:11:13.775288+0000","last_became_peered":"2023-07-14T18:11:13.775288+0000","last_unstale":"2023-07-14T18:11:14.790903+0000","last_undegraded":"2023-07-14T18:11:14.790903+0000","last_fullsized":"2023-07-14T18:11:14.790903+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:12.753466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:12.753466+0000","last_clean_scrub_stamp":"2023-07-14T18:11:12.753466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T02:35:47.441794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"79'2","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:11:14.791343+0000","last_change":"2023-07-14T18:11:08.687332+0000","last_active":"2023-07-14T18:11:14.791343+0000","last_peered":"2023-07-14T18:11:14.791343+0000","last_clean":"2023-07-14T18:11:14.791343+0000","last_became_active":"2023-07-14T18:11:08.686902+0000","last_became_peered":"2023-07-14T18:11:08.686902+0000","last_unstale":"2023-07-14T18:11:14.791343+0000","last_undegraded":"2023-07-14T18:11:14.791343+0000","last_fullsized":"2023-07-14T18:11:14.791343+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:07.665746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:07.665746+0000","last_clean_scrub_stamp":"2023-07-14T18:11:07.665746+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:33:50.338931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":18,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:11:14.886168+0000","last_change":"2023-07-14T18:11:09.719308+0000","last_active":"2023-07-14T18:11:14.886168+0000","last_peered":"2023-07-14T18:11:14.886168+0000","last_clean":"2023-07-14T18:11:14.886168+0000","last_became_active":"2023-07-14T18:11:09.719038+0000","last_became_peered":"2023-07-14T18:11:09.719038+0000","last_unstale":"2023-07-14T18:11:14.886168+0000","last_undegraded":"2023-07-14T18:11:14.886168+0000","last_fullsized":"2023-07-14T18:11:14.886168+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_clean_scrub_stamp":"2023-07-14T18:11:08.667354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:21:02.431834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":20,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:11:15.116944+0000","last_change":"2023-07-14T18:11:09.710991+0000","last_active":"2023-07-14T18:11:15.116944+0000","last_peered":"2023-07-14T18:11:15.116944+0000","last_clean":"2023-07-14T18:11:15.116944+0000","last_became_active":"2023-07-14T18:11:09.710689+0000","last_became_peered":"2023-07-14T18:11:09.710689+0000","last_unstale":"2023-07-14T18:11:15.116944+0000","last_undegraded":"2023-07-14T18:11:15.116944+0000","last_fullsized":"2023-07-14T18:11:15.116944+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_clean_scrub_stamp":"2023-07-14T18:11:08.667354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:46:01.500390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":20,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:11:14.884240+0000","last_change":"2023-07-14T18:11:09.711793+0000","last_active":"2023-07-14T18:11:14.884240+0000","last_peered":"2023-07-14T18:11:14.884240+0000","last_clean":"2023-07-14T18:11:14.884240+0000","last_became_active":"2023-07-14T18:11:09.711488+0000","last_became_peered":"2023-07-14T18:11:09.711488+0000","last_unstale":"2023-07-14T18:11:14.884240+0000","last_undegraded":"2023-07-14T18:11:14.884240+0000","last_fullsized":"2023-07-14T18:11:14.884240+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_clean_scrub_stamp":"2023-07-14T18:11:08.667354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:57:04.042308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":20,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:11:14.883995+0000","last_change":"2023-07-14T18:11:09.707835+0000","last_active":"2023-07-14T18:11:14.883995+0000","last_peered":"2023-07-14T18:11:14.883995+0000","last_clean":"2023-07-14T18:11:14.883995+0000","last_became_active":"2023-07-14T18:11:09.706863+0000","last_became_peered":"2023-07-14T18:11:09.706863+0000","last_unstale":"2023-07-14T18:11:14.883995+0000","last_undegraded":"2023-07-14T18:11:14.883995+0000","last_fullsized":"2023-07-14T18:11:14.883995+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_clean_scrub_stamp":"2023-07-14T18:11:08.667354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T02:34:34.215440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":20,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:11:14.884701+0000","last_change":"2023-07-14T18:11:09.714879+0000","last_active":"2023-07-14T18:11:14.884701+0000","last_peered":"2023-07-14T18:11:14.884701+0000","last_clean":"2023-07-14T18:11:14.884701+0000","last_became_active":"2023-07-14T18:11:09.714583+0000","last_became_peered":"2023-07-14T18:11:09.714583+0000","last_unstale":"2023-07-14T18:11:14.884701+0000","last_undegraded":"2023-07-14T18:11:14.884701+0000","last_fullsized":"2023-07-14T18:11:14.884701+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_clean_scrub_stamp":"2023-07-14T18:11:08.667354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T03:37:12.524327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":20,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:11:14.790997+0000","last_change":"2023-07-14T18:11:09.710850+0000","last_active":"2023-07-14T18:11:14.790997+0000","last_peered":"2023-07-14T18:11:14.790997+0000","last_clean":"2023-07-14T18:11:14.790997+0000","last_became_active":"2023-07-14T18:11:09.710533+0000","last_became_peered":"2023-07-14T18:11:09.710533+0000","last_unstale":"2023-07-14T18:11:14.790997+0000","last_undegraded":"2023-07-14T18:11:14.790997+0000","last_fullsized":"2023-07-14T18:11:14.790997+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_clean_scrub_stamp":"2023-07-14T18:11:08.667354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T02:32:10.888054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":20,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:11:15.117230+0000","last_change":"2023-07-14T18:11:09.710457+0000","last_active":"2023-07-14T18:11:15.117230+0000","last_peered":"2023-07-14T18:11:15.117230+0000","last_clean":"2023-07-14T18:11:15.117230+0000","last_became_active":"2023-07-14T18:11:09.710163+0000","last_became_peered":"2023-07-14T18:11:09.710163+0000","last_unstale":"2023-07-14T18:11:15.117230+0000","last_undegraded":"2023-07-14T18:11:15.117230+0000","last_fullsized":"2023-07-14T18:11:15.117230+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_clean_scrub_stamp":"2023-07-14T18:11:08.667354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:05:12.700623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":20,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:11:14.884622+0000","last_change":"2023-07-14T18:11:09.709062+0000","last_active":"2023-07-14T18:11:14.884622+0000","last_peered":"2023-07-14T18:11:14.884622+0000","last_clean":"2023-07-14T18:11:14.884622+0000","last_became_active":"2023-07-14T18:11:09.708767+0000","last_became_peered":"2023-07-14T18:11:09.708767+0000","last_unstale":"2023-07-14T18:11:14.884622+0000","last_undegraded":"2023-07-14T18:11:14.884622+0000","last_fullsized":"2023-07-14T18:11:14.884622+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_clean_scrub_stamp":"2023-07-14T18:11:08.667354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T01:00:42.739345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":20,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:11:14.886746+0000","last_change":"2023-07-14T18:11:09.707279+0000","last_active":"2023-07-14T18:11:14.886746+0000","last_peered":"2023-07-14T18:11:14.886746+0000","last_clean":"2023-07-14T18:11:14.886746+0000","last_became_active":"2023-07-14T18:11:09.706972+0000","last_became_peered":"2023-07-14T18:11:09.706972+0000","last_unstale":"2023-07-14T18:11:14.886746+0000","last_undegraded":"2023-07-14T18:11:14.886746+0000","last_fullsized":"2023-07-14T18:11:14.886746+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_clean_scrub_stamp":"2023-07-14T18:11:08.667354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:02:52.034920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":20,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:11:14.791002+0000","last_change":"2023-07-14T18:11:09.709710+0000","last_active":"2023-07-14T18:11:14.791002+0000","last_peered":"2023-07-14T18:11:14.791002+0000","last_clean":"2023-07-14T18:11:14.791002+0000","last_became_active":"2023-07-14T18:11:09.709438+0000","last_became_peered":"2023-07-14T18:11:09.709438+0000","last_unstale":"2023-07-14T18:11:14.791002+0000","last_undegraded":"2023-07-14T18:11:14.791002+0000","last_fullsized":"2023-07-14T18:11:14.791002+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_clean_scrub_stamp":"2023-07-14T18:11:08.667354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T02:06:46.155849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":20,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:11:14.884619+0000","last_change":"2023-07-14T18:11:09.720216+0000","last_active":"2023-07-14T18:11:14.884619+0000","last_peered":"2023-07-14T18:11:14.884619+0000","last_clean":"2023-07-14T18:11:14.884619+0000","last_became_active":"2023-07-14T18:11:09.719775+0000","last_became_peered":"2023-07-14T18:11:09.719775+0000","last_unstale":"2023-07-14T18:11:14.884619+0000","last_undegraded":"2023-07-14T18:11:14.884619+0000","last_fullsized":"2023-07-14T18:11:14.884619+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_clean_scrub_stamp":"2023-07-14T18:11:08.667354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T03:06:39.685042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":20,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:11:14.885075+0000","last_change":"2023-07-14T18:11:09.708462+0000","last_active":"2023-07-14T18:11:14.885075+0000","last_peered":"2023-07-14T18:11:14.885075+0000","last_clean":"2023-07-14T18:11:14.885075+0000","last_became_active":"2023-07-14T18:11:09.705611+0000","last_became_peered":"2023-07-14T18:11:09.705611+0000","last_unstale":"2023-07-14T18:11:14.885075+0000","last_undegraded":"2023-07-14T18:11:14.885075+0000","last_fullsized":"2023-07-14T18:11:14.885075+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_clean_scrub_stamp":"2023-07-14T18:11:08.667354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:45:55.084603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":20,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:11:14.790949+0000","last_change":"2023-07-14T18:11:09.707560+0000","last_active":"2023-07-14T18:11:14.790949+0000","last_peered":"2023-07-14T18:11:14.790949+0000","last_clean":"2023-07-14T18:11:14.790949+0000","last_became_active":"2023-07-14T18:11:09.707216+0000","last_became_peered":"2023-07-14T18:11:09.707216+0000","last_unstale":"2023-07-14T18:11:14.790949+0000","last_undegraded":"2023-07-14T18:11:14.790949+0000","last_fullsized":"2023-07-14T18:11:14.790949+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_clean_scrub_stamp":"2023-07-14T18:11:08.667354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T05:53:45.047425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":20,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:11:15.117017+0000","last_change":"2023-07-14T18:11:09.712059+0000","last_active":"2023-07-14T18:11:15.117017+0000","last_peered":"2023-07-14T18:11:15.117017+0000","last_clean":"2023-07-14T18:11:15.117017+0000","last_became_active":"2023-07-14T18:11:09.711759+0000","last_became_peered":"2023-07-14T18:11:09.711759+0000","last_unstale":"2023-07-14T18:11:15.117017+0000","last_undegraded":"2023-07-14T18:11:15.117017+0000","last_fullsized":"2023-07-14T18:11:15.117017+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_clean_scrub_stamp":"2023-07-14T18:11:08.667354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:30:03.374413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4157440,"data_stored":4132576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":6824,"num_objects":57,"num_object_clones":0,"num_object_copies":171,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":57,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":127,"num_write_kb":36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":38,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":221184,"data_stored":20664,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":109,"ondisk_log_size":109,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":75,"seq":322122547215,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27916,"kb_used_data":900,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717236,"statfs":{"total":95995035648,"available":95966449664,"internally_reserved":0,"allocated":921600,"data_stored":449556,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60499999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52200000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56499999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35399999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84899999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.753}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67700000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79000000000000004}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94899999999999995}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.87}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.997}]}]},{"osd":10,"up_from":68,"seq":292057776146,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28528,"kb_used_data":1512,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716624,"statfs":{"total":95995035648,"available":95965822976,"internally_reserved":0,"allocated":1548288,"data_stored":1044343,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59499999999999997}]},{"osd":1,"last update":"Fri Jul 14 18:11:09 2023","interfaces":[{"interface":"back","average":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"last":0.41299999999999998},{"interface":"front","average":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"last":0.64100000000000001}]},{"osd":2,"last update":"Fri Jul 14 18:11:09 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":0.84799999999999998,"5min":0.84799999999999998,"15min":0.84799999999999998},"last":0.61599999999999999}]},{"osd":3,"last update":"Fri Jul 14 18:11:09 2023","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.96099999999999997,"5min":0.96099999999999997,"15min":0.96099999999999997},"last":0.44500000000000001},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":0.95099999999999996,"5min":0.95099999999999996,"15min":0.95099999999999996},"last":0.502}]},{"osd":4,"last update":"Fri Jul 14 18:11:09 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"last":0.46600000000000003},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.97599999999999998,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.65600000000000003}]},{"osd":5,"last update":"Fri Jul 14 18:11:09 2023","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":1.0049999999999999,"5min":1.0049999999999999,"15min":1.0049999999999999},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":0.89500000000000002},"last":0.71099999999999997}]},{"osd":6,"last update":"Fri Jul 14 18:11:09 2023","interfaces":[{"interface":"back","average":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.004,"5min":1.004,"15min":1.004},"last":0.67000000000000004},{"interface":"front","average":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"min":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.1040000000000001,"5min":1.1040000000000001,"15min":1.1040000000000001},"last":0.69899999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49399999999999999}]},{"osd":8,"last update":"Fri Jul 14 18:11:09 2023","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":0.753,"15min":0.753},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":1.038,"5min":1.038,"15min":1.038},"last":0.74099999999999999},{"interface":"front","average":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.0820000000000001,"5min":1.0820000000000001,"15min":1.0820000000000001},"last":0.68799999999999994}]},{"osd":9,"last update":"Fri Jul 14 18:11:09 2023","interfaces":[{"interface":"back","average":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"min":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"max":{"1min":1.018,"5min":1.018,"15min":1.018},"last":0.77100000000000002},{"interface":"front","average":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"min":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"max":{"1min":1.228,"5min":1.228,"15min":1.228},"last":0.72999999999999998}]},{"osd":11,"last update":"Fri Jul 14 18:11:27 2023","interfaces":[{"interface":"back","average":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":0.97899999999999998,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.75900000000000001},{"interface":"front","average":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.0309999999999999,"5min":1.0309999999999999,"15min":1.0309999999999999},"last":0.79200000000000004}]}]},{"osd":9,"up_from":63,"seq":270582939671,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27924,"kb_used_data":904,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717228,"statfs":{"total":95995035648,"available":95966441472,"internally_reserved":0,"allocated":925696,"data_stored":450138,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 18:10:48 2023","interfaces":[{"interface":"back","average":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"last":0.35199999999999998},{"interface":"front","average":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"last":0.27800000000000002}]},{"osd":1,"last update":"Fri Jul 14 18:10:48 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.94099999999999995,"5min":0.94099999999999995,"15min":0.94099999999999995},"last":0.63800000000000001},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.65100000000000002}]},{"osd":2,"last update":"Fri Jul 14 18:10:48 2023","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.89300000000000002,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.70899999999999996}]},{"osd":3,"last update":"Fri Jul 14 18:10:48 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"last":0.33400000000000002},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.32200000000000001}]},{"osd":4,"last update":"Fri Jul 14 18:10:48 2023","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.95499999999999996,"5min":0.95499999999999996,"15min":0.95499999999999996},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1,"5min":1,"15min":1},"last":0.76600000000000001}]},{"osd":5,"last update":"Fri Jul 14 18:10:48 2023","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":1.093,"5min":1.093,"15min":1.093},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.1100000000000001,"5min":1.1100000000000001,"15min":1.1100000000000001},"last":0.68000000000000005}]},{"osd":6,"last update":"Fri Jul 14 18:10:48 2023","interfaces":[{"interface":"back","average":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":1.069,"5min":1.069,"15min":1.069},"last":0.45800000000000002},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":1.0409999999999999,"5min":1.0409999999999999,"15min":1.0409999999999999},"last":0.57799999999999996}]},{"osd":7,"last update":"Fri Jul 14 18:10:48 2023","interfaces":[{"interface":"back","average":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.0329999999999999,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.69399999999999995},{"interface":"front","average":{"1min":0.746,"5min":0.746,"15min":0.746},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.1890000000000001,"5min":1.1890000000000001,"15min":1.1890000000000001},"last":0.58499999999999996}]},{"osd":8,"last update":"Fri Jul 14 18:10:48 2023","interfaces":[{"interface":"back","average":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":1.127,"5min":1.127,"15min":1.127},"last":0.75},{"interface":"front","average":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"min":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"max":{"1min":1.167,"5min":1.167,"15min":1.167},"last":0.57499999999999996}]},{"osd":10,"last update":"Fri Jul 14 18:11:08 2023","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.99099999999999999,"5min":0.99099999999999999,"15min":0.99099999999999999},"last":0.78700000000000003},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.0569999999999999,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":0.72899999999999998}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80400000000000005}]}]},{"osd":8,"up_from":56,"seq":240518168604,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27932,"kb_used_data":916,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717220,"statfs":{"total":95995035648,"available":95966433280,"internally_reserved":0,"allocated":937984,"data_stored":450013,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 18:11:29 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.54100000000000004,"15min":0.54200000000000004},"min":{"1min":0.40699999999999997,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.68300000000000005,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.44700000000000001},{"interface":"front","average":{"1min":0.51200000000000001,"5min":0.51900000000000002,"15min":0.52000000000000002},"min":{"1min":0.36199999999999999,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.75,"5min":0.78200000000000003,"15min":0.78200000000000003},"last":0.48999999999999999}]},{"osd":1,"last update":"Fri Jul 14 18:11:29 2023","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.61299999999999999,"15min":0.60999999999999999},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.93100000000000005,"5min":1.036,"15min":1.036},"last":0.46500000000000002},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"min":{"1min":0.40899999999999997,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.89500000000000002,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.55900000000000005}]},{"osd":2,"last update":"Fri Jul 14 18:11:29 2023","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.45700000000000002,"15min":0.45100000000000001},"min":{"1min":0.29199999999999998,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":1.032,"5min":1.032,"15min":1.032},"last":0.70899999999999996},{"interface":"front","average":{"1min":0.49099999999999999,"5min":0.47499999999999998,"15min":0.47299999999999998},"min":{"1min":0.33200000000000002,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":1.0449999999999999,"5min":1.0449999999999999,"15min":1.0449999999999999},"last":0.623}]},{"osd":3,"last update":"Fri Jul 14 18:11:29 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.57699999999999996,"15min":0.58299999999999996},"min":{"1min":0.42099999999999999,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.69799999999999995,"5min":0.77300000000000002,"15min":0.77300000000000002},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.58799999999999997,"15min":0.58999999999999997},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.77500000000000002,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.76400000000000001}]},{"osd":4,"last update":"Fri Jul 14 18:11:29 2023","interfaces":[{"interface":"back","average":{"1min":0.77500000000000002,"5min":0.66600000000000004,"15min":0.64800000000000002},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":2.5030000000000001,"5min":2.5030000000000001,"15min":2.5030000000000001},"last":0.97599999999999998},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.63900000000000001,"15min":0.63500000000000001},"min":{"1min":0.40600000000000003,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.81599999999999995}]},{"osd":5,"last update":"Fri Jul 14 18:11:29 2023","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.59299999999999997,"15min":0.58699999999999997},"min":{"1min":0.36099999999999999,"5min":0.316,"15min":0.316},"max":{"1min":0.98199999999999998,"5min":0.98199999999999998,"15min":0.98199999999999998},"last":0.66400000000000003},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.60099999999999998,"15min":0.59899999999999998},"min":{"1min":0.38600000000000001,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.84799999999999998}]},{"osd":6,"last update":"Fri Jul 14 18:11:29 2023","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"min":{"1min":0.45800000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.90700000000000003,"5min":0.90700000000000003,"15min":0.90700000000000003},"last":0.90700000000000003},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.69799999999999995,"15min":0.70299999999999996},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.89700000000000002,"5min":1.008,"15min":1.008},"last":0.73299999999999998}]},{"osd":7,"last update":"Fri Jul 14 18:11:29 2023","interfaces":[{"interface":"back","average":{"1min":0.83999999999999997,"5min":0.73799999999999999,"15min":0.72099999999999997},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":2.5550000000000002,"5min":2.5550000000000002,"15min":2.5550000000000002},"last":0.79700000000000004},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.71799999999999997,"15min":0.71499999999999997},"min":{"1min":0.52000000000000002,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.0529999999999999,"5min":1.0529999999999999,"15min":1.0529999999999999},"last":1.0529999999999999}]},{"osd":9,"last update":"Fri Jul 14 18:10:48 2023","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":0.94699999999999995,"5min":0.94699999999999995,"15min":0.94699999999999995},"last":1.0149999999999999},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.94899999999999995}]},{"osd":10,"last update":"Fri Jul 14 18:11:09 2023","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.024,"5min":1.024,"15min":1.024},"last":0.89100000000000001},{"interface":"front","average":{"1min":0.745,"5min":0.745,"15min":0.745},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.006,"5min":1.006,"15min":1.006},"last":1.0329999999999999}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92900000000000005}]}]},{"osd":7,"up_from":49,"seq":210453397535,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28512,"kb_used_data":1496,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716640,"statfs":{"total":95995035648,"available":95965839360,"internally_reserved":0,"allocated":1531904,"data_stored":1041620,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 18:11:06 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.55300000000000005,"15min":0.54600000000000004},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"last":0.38400000000000001},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"min":{"1min":0.35599999999999998,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.77900000000000003,"5min":0.84299999999999997,"15min":0.84299999999999997},"last":0.35599999999999998}]},{"osd":1,"last update":"Fri Jul 14 18:11:06 2023","interfaces":[{"interface":"back","average":{"1min":0.45100000000000001,"5min":0.41899999999999998,"15min":0.41399999999999998},"min":{"1min":0.29699999999999999,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.751,"5min":0.751,"15min":0.751},"last":0.47699999999999998},{"interface":"front","average":{"1min":0.45200000000000001,"5min":0.442,"15min":0.44},"min":{"1min":0.30399999999999999,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.41699999999999998}]},{"osd":2,"last update":"Fri Jul 14 18:11:06 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"min":{"1min":0.39100000000000001,"5min":0.313,"15min":0.313},"max":{"1min":0.70899999999999996,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.68400000000000005},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.60899999999999999,"15min":0.61299999999999999},"min":{"1min":0.40999999999999998,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"last":0.64300000000000002}]},{"osd":3,"last update":"Fri Jul 14 18:11:06 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.60599999999999998,"15min":0.59999999999999998},"min":{"1min":0.432,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.88100000000000001,"5min":0.88100000000000001,"15min":0.88100000000000001},"last":0.625}]},{"osd":4,"last update":"Fri Jul 14 18:11:06 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.52300000000000002,"15min":0.52000000000000002},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.47199999999999998,"5min":0.496,"15min":0.5},"min":{"1min":0.32100000000000001,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.44800000000000001}]},{"osd":5,"last update":"Fri Jul 14 18:11:06 2023","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.65600000000000003,"15min":0.66400000000000003},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.79000000000000004,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.82199999999999995},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.65000000000000002,"15min":0.65300000000000002},"min":{"1min":0.48899999999999999,"5min":0.38,"15min":0.38},"max":{"1min":0.81799999999999995,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.83599999999999997}]},{"osd":6,"last update":"Fri Jul 14 18:11:06 2023","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.67400000000000004,"15min":0.66800000000000004},"min":{"1min":0.504,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.89400000000000002,"5min":0.89400000000000002,"15min":0.89400000000000002},"last":0.66200000000000003},{"interface":"front","average":{"1min":0.625,"5min":0.66600000000000004,"15min":0.67300000000000004},"min":{"1min":0.40200000000000002,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.82599999999999996,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.55200000000000005}]},{"osd":8,"last update":"Fri Jul 14 18:11:27 2023","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.70899999999999996,"15min":0.70899999999999996},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":0.94399999999999995,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.79200000000000004},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.67700000000000005,"15min":0.67900000000000005},"min":{"1min":0.52400000000000002,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.873,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.77500000000000002}]},{"osd":9,"last update":"Fri Jul 14 18:10:48 2023","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"last":0.73199999999999998},{"interface":"front","average":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.0189999999999999,"5min":1.0189999999999999,"15min":1.0189999999999999},"last":0.76100000000000001}]},{"osd":10,"last update":"Fri Jul 14 18:11:08 2023","interfaces":[{"interface":"back","average":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.046,"5min":1.046,"15min":1.046},"last":0.71399999999999997},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":0.89500000000000002},"last":0.80600000000000005}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85799999999999998}]}]},{"osd":6,"up_from":44,"seq":188978561060,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27916,"kb_used_data":900,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717236,"statfs":{"total":95995035648,"available":95966449664,"internally_reserved":0,"allocated":921600,"data_stored":449556,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 18:10:43 2023","interfaces":[{"interface":"back","average":{"1min":0.41599999999999998,"5min":0.39900000000000002,"15min":0.39600000000000002},"min":{"1min":0.27500000000000002,"5min":0.217,"15min":0.217},"max":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"last":0.312},{"interface":"front","average":{"1min":0.439,"5min":0.41399999999999998,"15min":0.40999999999999998},"min":{"1min":0.27200000000000002,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"last":0.33300000000000002}]},{"osd":1,"last update":"Fri Jul 14 18:10:43 2023","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.54600000000000004,"15min":0.53200000000000003},"min":{"1min":0.46700000000000003,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":1.0389999999999999,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.41099999999999998},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.51800000000000002,"15min":0.50600000000000001},"min":{"1min":0.42399999999999999,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":1.048,"5min":1.048,"15min":1.048},"last":0.441}]},{"osd":2,"last update":"Fri Jul 14 18:10:43 2023","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.58399999999999996,"15min":0.57699999999999996},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":0.46100000000000002},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.58499999999999996,"15min":0.58299999999999996},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.78400000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.48199999999999998}]},{"osd":3,"last update":"Fri Jul 14 18:10:43 2023","interfaces":[{"interface":"back","average":{"1min":0.48099999999999998,"5min":0.44900000000000001,"15min":0.44400000000000001},"min":{"1min":0.31900000000000001,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.35899999999999999},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.498,"15min":0.49099999999999999},"min":{"1min":0.318,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"last":0.42799999999999999}]},{"osd":4,"last update":"Fri Jul 14 18:10:43 2023","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.624,"15min":0.60999999999999999},"min":{"1min":0.46400000000000002,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":1.087,"5min":1.087,"15min":1.087},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.629,"5min":0.57699999999999996,"15min":0.56899999999999995},"min":{"1min":0.42399999999999999,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":1.014,"5min":1.014,"15min":1.014},"last":0.46899999999999997}]},{"osd":5,"last update":"Fri Jul 14 18:10:43 2023","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.67600000000000005,"15min":0.67300000000000004},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.90800000000000003,"5min":0.95199999999999996,"15min":0.95199999999999996},"last":0.498},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.70599999999999996,"15min":0.69999999999999996},"min":{"1min":0.45600000000000002,"5min":0.443,"15min":0.443},"max":{"1min":0.86499999999999999,"5min":0.878,"15min":0.878},"last":0.54400000000000004}]},{"osd":7,"last update":"Fri Jul 14 18:11:13 2023","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.67000000000000004,"15min":0.66600000000000004},"min":{"1min":0.48199999999999998,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.96299999999999997,"5min":1.03,"15min":1.03},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.71099999999999997,"15min":0.70599999999999996},"min":{"1min":0.52400000000000002,"5min":0.443,"15min":0.443},"max":{"1min":1.0700000000000001,"5min":1.0700000000000001,"15min":1.0700000000000001},"last":0.58699999999999997}]},{"osd":8,"last update":"Fri Jul 14 18:10:25 2023","interfaces":[{"interface":"back","average":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"min":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":0.99399999999999999,"5min":0.99399999999999999,"15min":0.99399999999999999},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.51000000000000001}]},{"osd":9,"last update":"Fri Jul 14 18:10:50 2023","interfaces":[{"interface":"back","average":{"1min":0.752,"5min":0.752,"15min":0.752},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.0449999999999999,"5min":1.0449999999999999,"15min":1.0449999999999999},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":1.0249999999999999,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.56699999999999995}]},{"osd":10,"last update":"Fri Jul 14 18:11:13 2023","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":1.026,"5min":1.026,"15min":1.026},"last":0.63},{"interface":"front","average":{"1min":0.755,"5min":0.755,"15min":0.755},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":0.99399999999999999,"5min":0.99399999999999999,"15min":0.99399999999999999},"last":0.53400000000000003}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59799999999999998}]}]},{"osd":1,"up_from":13,"seq":55834574904,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27924,"kb_used_data":908,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717228,"statfs":{"total":95995035648,"available":95966441472,"internally_reserved":0,"allocated":929792,"data_stored":453077,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 18:11:05 2023","interfaces":[{"interface":"back","average":{"1min":0.63700000000000001,"5min":0.55500000000000005,"15min":0.53200000000000003},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.93899999999999995,"5min":0.98899999999999999,"15min":0.98899999999999999},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.54000000000000004,"15min":0.52500000000000002},"min":{"1min":0.35299999999999998,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.40699999999999997}]},{"osd":2,"last update":"Fri Jul 14 18:11:27 2023","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.55500000000000005,"15min":0.50800000000000001},"min":{"1min":0.34699999999999998,"5min":0.314,"15min":0.314},"max":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.34699999999999998},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.53600000000000003,"15min":0.49399999999999999},"min":{"1min":0.371,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"last":0.376}]},{"osd":3,"last update":"Fri Jul 14 18:10:48 2023","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.54300000000000004,"15min":0.52300000000000002},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"last":0.47399999999999998},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.58599999999999997,"15min":0.54200000000000004},"min":{"1min":0.45000000000000001,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.96799999999999997,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.65800000000000003}]},{"osd":4,"last update":"Fri Jul 14 18:11:05 2023","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.435,"15min":0.40699999999999997},"min":{"1min":0.245,"5min":0.245,"15min":0.245},"max":{"1min":0.879,"5min":0.879,"15min":0.879},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.437,"15min":0.40300000000000002},"min":{"1min":0.29299999999999998,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.77000000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"last":0.49299999999999999}]},{"osd":5,"last update":"Fri Jul 14 18:11:27 2023","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.62,"15min":0.59799999999999998},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.96599999999999997,"5min":0.96599999999999997,"15min":0.96599999999999997},"last":0.626},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.64500000000000002,"15min":0.61799999999999999},"min":{"1min":0.434,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"last":0.59099999999999997}]},{"osd":6,"last update":"Fri Jul 14 18:10:46 2023","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.624,"15min":0.61499999999999999},"min":{"1min":0.46700000000000003,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.93700000000000006,"5min":0.93700000000000006,"15min":0.93700000000000006},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.64900000000000002,"15min":0.64100000000000001},"min":{"1min":0.40899999999999997,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.91900000000000004,"5min":0.91900000000000004,"15min":0.91900000000000004},"last":0.67900000000000005}]},{"osd":7,"last update":"Fri Jul 14 18:11:10 2023","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.61299999999999999,"15min":0.60199999999999998},"min":{"1min":0.36899999999999999,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":1.0640000000000001,"5min":1.0640000000000001,"15min":1.0640000000000001},"last":0.72299999999999998},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.64400000000000002,"15min":0.64000000000000001},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":1.0489999999999999,"5min":1.0489999999999999,"15min":1.0489999999999999},"last":0.71299999999999997}]},{"osd":8,"last update":"Fri Jul 14 18:11:27 2023","interfaces":[{"interface":"back","average":{"1min":0.76900000000000002,"5min":0.752,"15min":0.749},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":1.054,"5min":1.054,"15min":1.054},"last":0.80100000000000005},{"interface":"front","average":{"1min":0.78500000000000003,"5min":0.76200000000000001,"15min":0.75800000000000001},"min":{"1min":0.48899999999999999,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":1.016,"5min":1.026,"15min":1.026},"last":0.77400000000000002}]},{"osd":9,"last update":"Fri Jul 14 18:10:48 2023","interfaces":[{"interface":"back","average":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"min":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":1.01,"5min":1.01,"15min":1.01},"last":0.69599999999999995},{"interface":"front","average":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.0589999999999999,"5min":1.0589999999999999,"15min":1.0589999999999999},"last":0.745}]},{"osd":10,"last update":"Fri Jul 14 18:11:10 2023","interfaces":[{"interface":"back","average":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.0649999999999999,"5min":1.0649999999999999,"15min":1.0649999999999999},"last":0.84799999999999998},{"interface":"front","average":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.0489999999999999,"5min":1.0489999999999999,"15min":1.0489999999999999},"last":0.76000000000000001}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81299999999999994}]}]},{"osd":0,"up_from":8,"seq":34359738429,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27932,"kb_used_data":904,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717220,"statfs":{"total":95995035648,"available":95966433280,"internally_reserved":0,"allocated":925696,"data_stored":449646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Jul 14 18:11:06 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.51800000000000002,"15min":0.50800000000000001},"min":{"1min":0.38200000000000001,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.82199999999999995,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.49099999999999999},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.52700000000000002,"15min":0.50700000000000001},"min":{"1min":0.40000000000000002,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.65700000000000003}]},{"osd":2,"last update":"Fri Jul 14 18:10:29 2023","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.57099999999999995,"15min":0.55800000000000005},"min":{"1min":0.41799999999999998,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.93799999999999994,"5min":0.93799999999999994,"15min":0.93799999999999994},"last":0.78900000000000003},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.53700000000000003,"15min":0.52100000000000002},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"last":0.71099999999999997}]},{"osd":3,"last update":"Fri Jul 14 18:09:46 2023","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.436,"15min":0.42599999999999999},"min":{"1min":0.29699999999999999,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"last":0.36799999999999999},{"interface":"front","average":{"1min":0.46700000000000003,"5min":0.42799999999999999,"15min":0.42199999999999999},"min":{"1min":0.33800000000000002,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.59999999999999998,"5min":0.621,"15min":0.621},"last":0.39200000000000002}]},{"osd":4,"last update":"Fri Jul 14 18:11:06 2023","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.52600000000000002,"15min":0.51000000000000001},"min":{"1min":0.38100000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.57099999999999995,"15min":0.54000000000000004},"min":{"1min":0.46999999999999997,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.83499999999999996,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.63500000000000001}]},{"osd":5,"last update":"Fri Jul 14 18:10:29 2023","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.54400000000000004,"15min":0.52200000000000002},"min":{"1min":0.46300000000000002,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":1.161,"5min":1.161,"15min":1.161},"last":0.57399999999999995},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.56100000000000005,"15min":0.54600000000000004},"min":{"1min":0.42199999999999999,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.879,"5min":0.879,"15min":0.879},"last":0.58699999999999997}]},{"osd":6,"last update":"Fri Jul 14 18:10:48 2023","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.52300000000000002,"15min":0.50800000000000001},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":1.0649999999999999,"5min":1.0649999999999999,"15min":1.0649999999999999},"last":0.40999999999999998},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.52600000000000002,"15min":0.51300000000000001},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":1.3460000000000001,"5min":1.3460000000000001,"15min":1.3460000000000001},"last":0.443}]},{"osd":7,"last update":"Fri Jul 14 18:11:07 2023","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.90100000000000002,"5min":1.204,"15min":1.204},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.72899999999999998,"15min":0.74099999999999999},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.92500000000000004,"5min":1.3080000000000001,"15min":1.3080000000000001},"last":0.64800000000000002}]},{"osd":8,"last update":"Fri Jul 14 18:10:29 2023","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":0.753,"15min":0.753},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":1.3819999999999999,"5min":1.3819999999999999,"15min":1.3819999999999999},"last":0.71999999999999997},{"interface":"front","average":{"1min":0.753,"5min":0.753,"15min":0.753},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.0289999999999999,"5min":1.0289999999999999,"15min":1.0289999999999999},"last":0.74299999999999999}]},{"osd":9,"last update":"Fri Jul 14 18:10:48 2023","interfaces":[{"interface":"back","average":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":1.133,"5min":1.133,"15min":1.133},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":1.28,"5min":1.28,"15min":1.28},"last":0.54100000000000004}]},{"osd":10,"last update":"Fri Jul 14 18:11:07 2023","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":0.97799999999999998,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":0.98299999999999998,"5min":0.98299999999999998,"15min":0.98299999999999998},"last":0.67900000000000005}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77900000000000003}]}]},{"osd":2,"up_from":18,"seq":77309411381,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27956,"kb_used_data":940,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717196,"statfs":{"total":95995035648,"available":95966408704,"internally_reserved":0,"allocated":962560,"data_stored":454953,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 18:11:23 2023","interfaces":[{"interface":"back","average":{"1min":0.46999999999999997,"5min":0.49099999999999999,"15min":0.47899999999999998},"min":{"1min":0.315,"5min":0.255,"15min":0.255},"max":{"1min":0.77500000000000002,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.59899999999999998},{"interface":"front","average":{"1min":0.49199999999999999,"5min":0.47699999999999998,"15min":0.47199999999999998},"min":{"1min":0.33600000000000002,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"last":0.443}]},{"osd":1,"last update":"Fri Jul 14 18:11:23 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.53500000000000003,"15min":0.50700000000000001},"min":{"1min":0.41199999999999998,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.97499999999999998,"5min":0.97499999999999998,"15min":0.97499999999999998},"last":0.82399999999999995},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.55000000000000004,"15min":0.502},"min":{"1min":0.44900000000000001,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":1.1279999999999999,"5min":1.1279999999999999,"15min":1.1279999999999999},"last":0.79400000000000004}]},{"osd":3,"last update":"Fri Jul 14 18:10:41 2023","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.55100000000000005,"15min":0.53500000000000003},"min":{"1min":0.41699999999999998,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.70899999999999996},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.54100000000000004,"15min":0.54100000000000004},"min":{"1min":0.38400000000000001,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.79100000000000004,"5min":0.82199999999999995,"15min":0.82199999999999995},"last":0.55200000000000005}]},{"osd":4,"last update":"Fri Jul 14 18:11:07 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.55200000000000005,"15min":0.54700000000000004},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.94399999999999995,"5min":0.94399999999999995,"15min":0.94399999999999995},"last":0.89900000000000002},{"interface":"front","average":{"1min":0.629,"5min":0.56100000000000005,"15min":0.53400000000000003},"min":{"1min":0.40000000000000002,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.80300000000000005,"5min":0.879,"15min":0.879},"last":0.93600000000000005}]},{"osd":5,"last update":"Fri Jul 14 18:11:28 2023","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.53700000000000003,"15min":0.51100000000000001},"min":{"1min":0.35199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":1.1719999999999999,"5min":1.1719999999999999,"15min":1.1719999999999999},"last":0.48299999999999998},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.52700000000000002,"15min":0.52500000000000002},"min":{"1min":0.32800000000000001,"5min":0.316,"15min":0.316},"max":{"1min":1.1499999999999999,"5min":1.1499999999999999,"15min":1.1499999999999999},"last":0.52000000000000002}]},{"osd":6,"last update":"Fri Jul 14 18:10:51 2023","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.64300000000000002,"15min":0.64700000000000002},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.92600000000000005,"5min":0.92600000000000005,"15min":0.92600000000000005},"last":0.64600000000000002},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.58999999999999997,"15min":0.58799999999999997},"min":{"1min":0.48799999999999999,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.67700000000000005}]},{"osd":7,"last update":"Fri Jul 14 18:11:07 2023","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.63300000000000001,"15min":0.63},"min":{"1min":0.48399999999999999,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1,"5min":1,"15min":1},"last":0.89000000000000001},{"interface":"front","average":{"1min":0.748,"5min":0.71599999999999997,"15min":0.70999999999999996},"min":{"1min":0.57399999999999995,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":0.90200000000000002,"5min":0.998,"15min":0.998},"last":0.879}]},{"osd":8,"last update":"Fri Jul 14 18:11:28 2023","interfaces":[{"interface":"back","average":{"1min":0.83099999999999996,"5min":0.65800000000000003,"15min":0.629},"min":{"1min":0.54800000000000004,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":1.4570000000000001,"5min":1.4570000000000001,"15min":1.4570000000000001},"last":0.746},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.59199999999999997,"15min":0.57799999999999996},"min":{"1min":0.46700000000000003,"5min":0.379,"15min":0.379},"max":{"1min":1.2769999999999999,"5min":1.2769999999999999,"15min":1.2769999999999999},"last":0.75900000000000001}]},{"osd":9,"last update":"Fri Jul 14 18:10:51 2023","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":0.97299999999999998,"5min":0.97299999999999998,"15min":0.97299999999999998},"last":0.84899999999999998},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.73399999999999999}]},{"osd":10,"last update":"Fri Jul 14 18:11:12 2023","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.81000000000000005},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"min":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":0.88700000000000001,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.91200000000000003}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83699999999999997}]}]},{"osd":3,"up_from":25,"seq":107374182448,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27936,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717216,"statfs":{"total":95995035648,"available":95966429184,"internally_reserved":0,"allocated":942080,"data_stored":449633,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 18:10:46 2023","interfaces":[{"interface":"back","average":{"1min":0.39900000000000002,"5min":0.374,"15min":0.36899999999999999},"min":{"1min":0.28100000000000003,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"last":0.29699999999999999},{"interface":"front","average":{"1min":0.44,"5min":0.39700000000000002,"15min":0.38700000000000001},"min":{"1min":0.27700000000000002,"5min":0.248,"15min":0.248},"max":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"last":0.317}]},{"osd":1,"last update":"Fri Jul 14 18:10:46 2023","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.52100000000000002,"15min":0.501},"min":{"1min":0.36499999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.75600000000000001,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.373},{"interface":"front","average":{"1min":0.621,"5min":0.54800000000000004,"15min":0.52400000000000002},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.90400000000000003,"5min":0.90400000000000003,"15min":0.90400000000000003},"last":0.438}]},{"osd":2,"last update":"Fri Jul 14 18:10:46 2023","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.57499999999999996,"15min":0.56899999999999995},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.84799999999999998,"5min":0.84799999999999998,"15min":0.84799999999999998},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.629,"5min":0.57599999999999996,"15min":0.56599999999999995},"min":{"1min":0.45500000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.55700000000000005}]},{"osd":4,"last update":"Fri Jul 14 18:11:06 2023","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.57099999999999995,"15min":0.54000000000000004},"min":{"1min":0.39300000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.58099999999999996,"15min":0.56399999999999995},"min":{"1min":0.42299999999999999,"5min":0.38,"15min":0.38},"max":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.42499999999999999}]},{"osd":5,"last update":"Fri Jul 14 18:11:30 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.60499999999999998,"15min":0.59699999999999998},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.84799999999999998,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.70799999999999996},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.58499999999999996,"15min":0.59099999999999997},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.70499999999999996,"5min":0.875,"15min":0.875},"last":0.65200000000000002}]},{"osd":6,"last update":"Fri Jul 14 18:10:46 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.54100000000000004,"15min":0.53100000000000003},"min":{"1min":0.35199999999999998,"5min":0.317,"15min":0.317},"max":{"1min":1.028,"5min":1.028,"15min":1.028},"last":0.40400000000000003},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.60099999999999998,"15min":0.59299999999999997},"min":{"1min":0.36599999999999999,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":1.0669999999999999,"5min":1.0669999999999999,"15min":1.0669999999999999},"last":0.502}]},{"osd":7,"last update":"Fri Jul 14 18:11:08 2023","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.71399999999999997,"15min":0.71599999999999997},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.008,"5min":1.014,"15min":1.014},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.66800000000000004,"15min":0.67600000000000005},"min":{"1min":0.41199999999999998,"5min":0.376,"15min":0.376},"max":{"1min":0.89100000000000001,"5min":1.131,"15min":1.131},"last":0.60399999999999998}]},{"osd":8,"last update":"Fri Jul 14 18:10:26 2023","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.046,"5min":1.046,"15min":1.046},"last":0.48299999999999998}]},{"osd":9,"last update":"Fri Jul 14 18:10:47 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.98999999999999999,"5min":0.98999999999999999,"15min":0.98999999999999999},"last":0.46400000000000002},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.997,"5min":0.997,"15min":0.997},"last":0.63600000000000001}]},{"osd":10,"last update":"Fri Jul 14 18:11:08 2023","interfaces":[{"interface":"back","average":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"min":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":1.0429999999999999,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.66900000000000004},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":0.95199999999999996,"5min":0.95199999999999996,"15min":0.95199999999999996},"last":0.52600000000000002}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.621}]}]},{"osd":4,"up_from":32,"seq":137438953516,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27924,"kb_used_data":904,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717228,"statfs":{"total":95995035648,"available":95966441472,"internally_reserved":0,"allocated":925696,"data_stored":449578,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 18:10:07 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.49099999999999999,"15min":0.48099999999999998},"min":{"1min":0.32100000000000001,"5min":0.313,"15min":0.313},"max":{"1min":1.347,"5min":1.347,"15min":1.347},"last":0.44400000000000001},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.50900000000000001,"15min":0.501},"min":{"1min":0.312,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":1.417,"5min":1.417,"15min":1.417},"last":0.53500000000000003}]},{"osd":1,"last update":"Fri Jul 14 18:11:10 2023","interfaces":[{"interface":"back","average":{"1min":0.432,"5min":0.39100000000000001,"15min":0.374},"min":{"1min":0.27500000000000002,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.68700000000000006,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.38400000000000001},{"interface":"front","average":{"1min":0.433,"5min":0.38600000000000001,"15min":0.36199999999999999},"min":{"1min":0.29099999999999998,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.626,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.41099999999999998}]},{"osd":2,"last update":"Fri Jul 14 18:11:10 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.54700000000000004,"15min":0.52900000000000003},"min":{"1min":0.39600000000000002,"5min":0.374,"15min":0.374},"max":{"1min":0.72799999999999998,"5min":1.4019999999999999,"15min":1.4019999999999999},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.55900000000000005,"15min":0.53400000000000003},"min":{"1min":0.38,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.82199999999999995,"5min":1.4750000000000001,"15min":1.4750000000000001},"last":0.54700000000000004}]},{"osd":3,"last update":"Fri Jul 14 18:11:10 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.52400000000000002,"15min":0.49199999999999999},"min":{"1min":0.38200000000000001,"5min":0.318,"15min":0.318},"max":{"1min":1.0309999999999999,"5min":1.054,"15min":1.054},"last":0.57399999999999995},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.54400000000000004,"15min":0.52800000000000002},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.84799999999999998,"5min":0.95299999999999996,"15min":0.95299999999999996},"last":0.45400000000000001}]},{"osd":5,"last update":"Fri Jul 14 18:10:31 2023","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.55700000000000005,"15min":0.53600000000000003},"min":{"1min":0.43099999999999999,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":1.177,"5min":1.177,"15min":1.177},"last":0.69399999999999995},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.58199999999999996,"15min":0.56100000000000005},"min":{"1min":0.52000000000000002,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":1.1220000000000001,"5min":1.1220000000000001,"15min":1.1220000000000001},"last":0.73999999999999999}]},{"osd":6,"last update":"Fri Jul 14 18:10:48 2023","interfaces":[{"interface":"back","average":{"1min":0.75800000000000001,"5min":0.628,"15min":0.60599999999999998},"min":{"1min":0.51800000000000002,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":1.101,"5min":1.101,"15min":1.101},"last":0.629},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.624,"15min":0.60799999999999998},"min":{"1min":0.44800000000000001,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":1.446,"5min":1.446,"15min":1.446},"last":0.60299999999999998}]},{"osd":7,"last update":"Fri Jul 14 18:11:10 2023","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.58599999999999997,"15min":0.57399999999999995},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.92200000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.65100000000000002},{"interface":"front","average":{"1min":0.68200000000000005,"5min":0.60999999999999999,"15min":0.59799999999999998},"min":{"1min":0.42999999999999999,"5min":0.316,"15min":0.316},"max":{"1min":1.004,"5min":1.0189999999999999,"15min":1.0189999999999999},"last":0.873}]},{"osd":8,"last update":"Fri Jul 14 18:10:25 2023","interfaces":[{"interface":"back","average":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.3740000000000001,"5min":1.3740000000000001,"15min":1.3740000000000001},"last":0.67100000000000004},{"interface":"front","average":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"min":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"max":{"1min":1.147,"5min":1.147,"15min":1.147},"last":0.80200000000000005}]},{"osd":9,"last update":"Fri Jul 14 18:10:48 2023","interfaces":[{"interface":"back","average":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.171,"5min":1.171,"15min":1.171},"last":0.77500000000000002},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.304,"5min":1.304,"15min":1.304},"last":0.53000000000000003}]},{"osd":10,"last update":"Fri Jul 14 18:11:10 2023","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.016,"5min":1.016,"15min":1.016},"last":0.68700000000000006},{"interface":"front","average":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"min":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"max":{"1min":1.196,"5min":1.196,"15min":1.196},"last":0.84899999999999998}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70899999999999996}]}]},{"osd":5,"up_from":37,"seq":158913789991,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28512,"kb_used_data":1492,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716640,"statfs":{"total":95995035648,"available":95965839360,"internally_reserved":0,"allocated":1527808,"data_stored":1040106,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 18:10:27 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.51500000000000001,"15min":0.51100000000000001},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":0.72499999999999998,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.51200000000000001,"5min":0.496,"15min":0.49399999999999999},"min":{"1min":0.35599999999999998,"5min":0.307,"15min":0.307},"max":{"1min":0.76000000000000001,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.627}]},{"osd":1,"last update":"Fri Jul 14 18:10:27 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.53500000000000003,"15min":0.52700000000000002},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.77900000000000003,"5min":0.85099999999999998,"15min":0.85099999999999998},"last":0.82099999999999995},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.55400000000000005,"15min":0.54400000000000004},"min":{"1min":0.40799999999999997,"5min":0.374,"15min":0.374},"max":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.77700000000000002}]},{"osd":2,"last update":"Fri Jul 14 18:10:27 2023","interfaces":[{"interface":"back","average":{"1min":0.48399999999999999,"5min":0.38700000000000001,"15min":0.371},"min":{"1min":0.312,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.48199999999999998,"5min":0.40699999999999997,"15min":0.39500000000000002},"min":{"1min":0.33000000000000002,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.745,"5min":0.745,"15min":0.745},"last":0.70299999999999996}]},{"osd":3,"last update":"Fri Jul 14 18:10:27 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.52100000000000002,"15min":0.51200000000000001},"min":{"1min":0.37,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.77100000000000002,"5min":0.82699999999999996,"15min":0.82699999999999996},"last":0.72699999999999998},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.51300000000000001,"15min":0.501},"min":{"1min":0.38900000000000001,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.74099999999999999}]},{"osd":4,"last update":"Fri Jul 14 18:10:27 2023","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.57799999999999996,"15min":0.56999999999999995},"min":{"1min":0.436,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.79800000000000004,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.84299999999999997},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.57399999999999995,"15min":0.56699999999999995},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.89200000000000002,"5min":0.89200000000000002,"15min":0.89200000000000002},"last":0.80600000000000005}]},{"osd":6,"last update":"Fri Jul 14 18:10:49 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.58399999999999996,"15min":0.57399999999999995},"min":{"1min":0.45800000000000002,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":1.0289999999999999,"5min":1.0289999999999999,"15min":1.0289999999999999},"last":0.76200000000000001},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.59599999999999997,"15min":0.58799999999999997},"min":{"1min":0.42599999999999999,"5min":0.371,"15min":0.371},"max":{"1min":0.94799999999999995,"5min":0.94799999999999995,"15min":0.94799999999999995},"last":0.875}]},{"osd":7,"last update":"Fri Jul 14 18:11:10 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.65400000000000003,"15min":0.64500000000000002},"min":{"1min":0.52000000000000002,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.0669999999999999,"5min":1.0669999999999999,"15min":1.0669999999999999},"last":0.89400000000000002},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.68200000000000005,"15min":0.67700000000000005},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":1.081,"5min":1.081,"15min":1.081},"last":0.96299999999999997}]},{"osd":8,"last update":"Fri Jul 14 18:10:27 2023","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.94799999999999995},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.96499999999999997,"5min":0.96499999999999997,"15min":0.96499999999999997},"last":0.90800000000000003}]},{"osd":9,"last update":"Fri Jul 14 18:10:49 2023","interfaces":[{"interface":"back","average":{"1min":0.748,"5min":0.748,"15min":0.748},"min":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1.2350000000000001,"5min":1.2350000000000001,"15min":1.2350000000000001},"last":0.86099999999999999},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":0.997,"5min":0.997,"15min":0.997},"last":0.93200000000000005}]},{"osd":10,"last update":"Fri Jul 14 18:11:10 2023","interfaces":[{"interface":"back","average":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":1.014,"5min":1.014,"15min":1.014},"last":0.92100000000000004},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.0489999999999999,"5min":1.0489999999999999,"15min":1.0489999999999999},"last":0.98699999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":694,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":4376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":5670,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":182,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":2368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":1500,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":4750,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-14T18:11:33.464 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-07-14T18:11:33.465 INFO:tasks.cephadm:Setting up client nodes... 2023-07-14T18:11:33.465 DEBUG:teuthology.orchestra.run.smithi163:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81c9387d2e7576da065747ec9c16d1c7d69016ec shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bf7326ec-2270-11ee-9b33-001a4aab830c -- ceph auth get-or-create client.0 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2023-07-14T18:11:34.049 INFO:teuthology.orchestra.run.smithi163.stderr:Inferring config /var/lib/ceph/bf7326ec-2270-11ee-9b33-001a4aab830c/mon.a/config 2023-07-14T18:11:34.174 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:11:33 smithi184 ceph-mon[98481]: from='client.14928 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2023-07-14T18:11:34.216 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:11:33 smithi163 ceph-mon[96576]: from='client.14928 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2023-07-14T18:11:34.274 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:11:33 smithi172 ceph-mon[97983]: from='client.14928 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2023-07-14T18:11:34.774 INFO:journalctl@ceph.mds.b.smithi172.stdout:Jul 14 18:11:34 smithi172 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-mds-b[123259]: 2023-07-14T18:11:34.483+0000 7f9c11ca2700 -1 mds.pinger is_rank_lagging: rank=3 was never sent ping request. 2023-07-14T18:11:34.775 INFO:journalctl@ceph.mds.b.smithi172.stdout:Jul 14 18:11:34 smithi172 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-mds-b[123259]: 2023-07-14T18:11:34.483+0000 7f9c11ca2700 -1 mds.pinger is_rank_lagging: rank=4 was never sent ping request. 2023-07-14T18:11:34.966 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:11:34 smithi163 ceph-mon[96576]: from='client.14946 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-07-14T18:11:34.966 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:11:34 smithi163 ceph-mon[96576]: from='client.14952 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-07-14T18:11:34.967 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:11:34 smithi163 ceph-mon[96576]: pgmap v263: 129 pgs: 129 active+clean; 620 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 7.0 KiB/s wr, 16 op/s 2023-07-14T18:11:35.173 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:11:34 smithi184 ceph-mon[98481]: from='client.14946 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-07-14T18:11:35.174 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:11:34 smithi184 ceph-mon[98481]: from='client.14952 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-07-14T18:11:35.174 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:11:34 smithi184 ceph-mon[98481]: pgmap v263: 129 pgs: 129 active+clean; 620 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 7.0 KiB/s wr, 16 op/s 2023-07-14T18:11:35.275 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:11:34 smithi172 ceph-mon[97983]: from='client.14946 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-07-14T18:11:35.275 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:11:34 smithi172 ceph-mon[97983]: from='client.14952 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-07-14T18:11:35.275 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:11:34 smithi172 ceph-mon[97983]: pgmap v263: 129 pgs: 129 active+clean; 620 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 7.0 KiB/s wr, 16 op/s 2023-07-14T18:11:35.473 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:35.433+0000 7f59031a0700 1 -- 172.21.15.163:0/146366163 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f58fc100610 msgr2=0x7f58fc106ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:11:35.473 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:35.433+0000 7f59031a0700 1 --2- 172.21.15.163:0/146366163 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f58fc100610 0x7f58fc106ed0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f58f400b0a0 tx=0x7f58f400b3b0 comp rx=0 tx=0).stop 2023-07-14T18:11:35.473 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:35.433+0000 7f59031a0700 1 -- 172.21.15.163:0/146366163 shutdown_connections 2023-07-14T18:11:35.474 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:35.433+0000 7f59031a0700 1 --2- 172.21.15.163:0/146366163 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f58fc100610 0x7f58fc106ed0 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:35.474 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:35.433+0000 7f59031a0700 1 --2- 172.21.15.163:0/146366163 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f58fc0fea80 0x7f58fc0fee90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:35.474 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:35.433+0000 7f59031a0700 1 --2- 172.21.15.163:0/146366163 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f58fc0ffc80 0x7f58fc1000d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:35.475 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:35.433+0000 7f59031a0700 1 -- 172.21.15.163:0/146366163 >> 172.21.15.163:0/146366163 conn(0x7f58fc0fa0f0 msgr2=0x7f58fc0fc500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:11:35.475 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:35.433+0000 7f59031a0700 1 -- 172.21.15.163:0/146366163 shutdown_connections 2023-07-14T18:11:35.475 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:35.433+0000 7f59031a0700 1 -- 172.21.15.163:0/146366163 wait complete. 2023-07-14T18:11:35.479 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:35.433+0000 7f59031a0700 1 Processor -- start 2023-07-14T18:11:35.479 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:35.433+0000 7f59031a0700 1 -- start start 2023-07-14T18:11:35.480 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:35.433+0000 7f59031a0700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f58fc0fea80 0x7f58fc068c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:11:35.480 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:35.433+0000 7f59031a0700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f58fc0ffc80 0x7f58fc19ca10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:11:35.480 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:35.433+0000 7f59031a0700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f58fc100610 0x7f58fc19ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:11:35.480 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:35.433+0000 7f59031a0700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58fc19f610 con 0x7f58fc0ffc80 2023-07-14T18:11:35.481 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:35.433+0000 7f59031a0700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58fc19f780 con 0x7f58fc0fea80 2023-07-14T18:11:35.481 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:35.433+0000 7f59031a0700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58fc19f940 con 0x7f58fc100610 2023-07-14T18:11:35.481 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:35.434+0000 7f590199d700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f58fc0ffc80 0x7f58fc19ca10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:11:35.482 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:35.434+0000 7f590199d700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f58fc0ffc80 0x7f58fc19ca10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:56364/0 (socket says 172.21.15.163:56364) 2023-07-14T18:11:35.482 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:35.434+0000 7f590199d700 1 -- 172.21.15.163:0/2091733139 learned_addr learned my addr 172.21.15.163:0/2091733139 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:11:35.482 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:35.434+0000 7f590219e700 1 --2- 172.21.15.163:0/2091733139 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f58fc0fea80 0x7f58fc068c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:11:35.482 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:35.434+0000 7f590299f700 1 --2- 172.21.15.163:0/2091733139 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f58fc100610 0x7f58fc19ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:11:35.483 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:35.434+0000 7f590199d700 1 -- 172.21.15.163:0/2091733139 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f58fc100610 msgr2=0x7f58fc19ef60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:11:35.483 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:35.434+0000 7f590199d700 1 --2- 172.21.15.163:0/2091733139 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f58fc100610 0x7f58fc19ef60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:35.483 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:35.434+0000 7f590199d700 1 -- 172.21.15.163:0/2091733139 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f58fc0fea80 msgr2=0x7f58fc068c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:11:35.483 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:35.434+0000 7f590199d700 1 --2- 172.21.15.163:0/2091733139 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f58fc0fea80 0x7f58fc068c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:35.484 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:35.434+0000 7f590199d700 1 -- 172.21.15.163:0/2091733139 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58f4009d00 con 0x7f58fc0ffc80 2023-07-14T18:11:35.484 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:35.434+0000 7f590199d700 1 --2- 172.21.15.163:0/2091733139 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f58fc0ffc80 0x7f58fc19ca10 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f58ec00b530 tx=0x7f58ec00b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:11:35.484 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:35.434+0000 7f58f37fe700 1 -- 172.21.15.163:0/2091733139 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58ec011830 con 0x7f58fc0ffc80 2023-07-14T18:11:35.484 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:35.434+0000 7f58f37fe700 1 -- 172.21.15.163:0/2091733139 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f58ec011e20 con 0x7f58fc0ffc80 2023-07-14T18:11:35.485 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:35.434+0000 7f59031a0700 1 -- 172.21.15.163:0/2091733139 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f58fc19fc20 con 0x7f58fc0ffc80 2023-07-14T18:11:35.485 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:35.434+0000 7f58f37fe700 1 -- 172.21.15.163:0/2091733139 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58ec00f2e0 con 0x7f58fc0ffc80 2023-07-14T18:11:35.485 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:35.434+0000 7f59031a0700 1 -- 172.21.15.163:0/2091733139 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f58fc1a0120 con 0x7f58fc0ffc80 2023-07-14T18:11:35.485 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:35.435+0000 7f59031a0700 1 -- 172.21.15.163:0/2091733139 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f58fc1060b0 con 0x7f58fc0ffc80 2023-07-14T18:11:35.485 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:35.436+0000 7f58f37fe700 1 -- 172.21.15.163:0/2091733139 <== mon.0 v2:172.21.15.163:3300/0 4 ==== mgrmap(e 17) v1 ==== 135767+0+0 (secure 0 0 0) 0x7f58ec011990 con 0x7f58fc0ffc80 2023-07-14T18:11:35.485 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:35.437+0000 7f58f37fe700 1 --2- 172.21.15.163:0/2091733139 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f58e80a11e0 0x7f58e80a3690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:11:35.485 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:35.437+0000 7f590219e700 1 --2- 172.21.15.163:0/2091733139 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f58e80a11e0 0x7f58e80a3690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:11:35.486 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:35.437+0000 7f58f37fe700 1 -- 172.21.15.163:0/2091733139 <== mon.0 v2:172.21.15.163:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 8730+0+0 (secure 0 0 0) 0x7f58ec0cc6d0 con 0x7f58fc0ffc80 2023-07-14T18:11:35.486 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:35.437+0000 7f590219e700 1 --2- 172.21.15.163:0/2091733139 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f58e80a11e0 0x7f58e80a3690 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f58fc0ffae0 tx=0x7f58f8007400 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:11:35.486 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:35.441+0000 7f58f37fe700 1 -- 172.21.15.163:0/2091733139 <== mon.0 v2:172.21.15.163:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178025 (secure 0 0 0) 0x7f58ec095be0 con 0x7f58fc0ffc80 2023-07-14T18:11:35.740 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:35.700+0000 7f59031a0700 1 -- 172.21.15.163:0/2091733139 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} v 0) v1 -- 0x7f58fc02cb90 con 0x7f58fc0ffc80 2023-07-14T18:11:35.744 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:35.705+0000 7f58f37fe700 1 -- 172.21.15.163:0/2091733139 <== mon.0 v2:172.21.15.163:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]=0 v31) v1 ==== 170+0+59 (secure 0 0 0) 0x7f58ec099200 con 0x7f58fc0ffc80 2023-07-14T18:11:35.745 INFO:teuthology.orchestra.run.smithi163.stdout:[client.0] 2023-07-14T18:11:35.745 INFO:teuthology.orchestra.run.smithi163.stdout: key = AQDXj7FkL7vZKRAAI3xeZiOKI00zDQuHpERevA== 2023-07-14T18:11:35.747 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:35.707+0000 7f59031a0700 1 -- 172.21.15.163:0/2091733139 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f58e80a11e0 msgr2=0x7f58e80a3690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:11:35.747 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:35.707+0000 7f59031a0700 1 --2- 172.21.15.163:0/2091733139 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f58e80a11e0 0x7f58e80a3690 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f58fc0ffae0 tx=0x7f58f8007400 comp rx=0 tx=0).stop 2023-07-14T18:11:35.747 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:35.707+0000 7f59031a0700 1 -- 172.21.15.163:0/2091733139 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f58fc0ffc80 msgr2=0x7f58fc19ca10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:11:35.747 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:35.707+0000 7f59031a0700 1 --2- 172.21.15.163:0/2091733139 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f58fc0ffc80 0x7f58fc19ca10 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f58ec00b530 tx=0x7f58ec00b840 comp rx=0 tx=0).stop 2023-07-14T18:11:35.747 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:35.707+0000 7f59031a0700 1 -- 172.21.15.163:0/2091733139 shutdown_connections 2023-07-14T18:11:35.747 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:35.707+0000 7f59031a0700 1 --2- 172.21.15.163:0/2091733139 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f58e80a11e0 0x7f58e80a3690 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:35.748 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:35.707+0000 7f59031a0700 1 --2- 172.21.15.163:0/2091733139 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f58fc100610 0x7f58fc19ef60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:35.748 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:35.707+0000 7f59031a0700 1 --2- 172.21.15.163:0/2091733139 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f58fc0fea80 0x7f58fc068c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:35.748 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:35.707+0000 7f59031a0700 1 --2- 172.21.15.163:0/2091733139 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f58fc0ffc80 0x7f58fc19ca10 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:35.748 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:35.707+0000 7f59031a0700 1 -- 172.21.15.163:0/2091733139 >> 172.21.15.163:0/2091733139 conn(0x7f58fc0fa0f0 msgr2=0x7f58fc1031f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:11:35.748 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:35.707+0000 7f59031a0700 1 -- 172.21.15.163:0/2091733139 shutdown_connections 2023-07-14T18:11:35.748 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:35.707+0000 7f59031a0700 1 -- 172.21.15.163:0/2091733139 wait complete. 2023-07-14T18:11:36.086 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:11:35 smithi163 ceph-mon[96576]: from='client.? 172.21.15.163:0/2091733139' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2023-07-14T18:11:36.087 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:11:35 smithi163 ceph-mon[96576]: from='client.? 172.21.15.163:0/2091733139' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2023-07-14T18:11:36.110 DEBUG:teuthology.orchestra.run.smithi163:> set -ex 2023-07-14T18:11:36.111 DEBUG:teuthology.orchestra.run.smithi163:> sudo dd of=/etc/ceph/ceph.client.0.keyring 2023-07-14T18:11:36.111 DEBUG:teuthology.orchestra.run.smithi163:> sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2023-07-14T18:11:36.153 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2023-07-14T18:11:36.154 INFO:tasks.cephadm.ceph_manager.ceph:waiting for mgr available 2023-07-14T18:11:36.154 DEBUG:teuthology.orchestra.run.smithi163:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81c9387d2e7576da065747ec9c16d1c7d69016ec shell --fsid bf7326ec-2270-11ee-9b33-001a4aab830c -- ceph mgr dump --format=json 2023-07-14T18:11:36.174 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:11:35 smithi184 ceph-mon[98481]: from='client.? 172.21.15.163:0/2091733139' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2023-07-14T18:11:36.174 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:11:35 smithi184 ceph-mon[98481]: from='client.? 172.21.15.163:0/2091733139' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2023-07-14T18:11:36.275 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:11:35 smithi172 ceph-mon[97983]: from='client.? 172.21.15.163:0/2091733139' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2023-07-14T18:11:36.275 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:11:35 smithi172 ceph-mon[97983]: from='client.? 172.21.15.163:0/2091733139' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2023-07-14T18:11:36.743 INFO:teuthology.orchestra.run.smithi163.stderr:Inferring config /var/lib/ceph/bf7326ec-2270-11ee-9b33-001a4aab830c/mon.a/config 2023-07-14T18:11:37.140 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:11:36 smithi163 ceph-mon[96576]: pgmap v264: 129 pgs: 129 active+clean; 621 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 7.5 KiB/s wr, 19 op/s 2023-07-14T18:11:37.174 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:11:36 smithi184 ceph-mon[98481]: pgmap v264: 129 pgs: 129 active+clean; 621 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 7.5 KiB/s wr, 19 op/s 2023-07-14T18:11:37.274 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:11:36 smithi172 ceph-mon[97983]: pgmap v264: 129 pgs: 129 active+clean; 621 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 7.5 KiB/s wr, 19 op/s 2023-07-14T18:11:37.938 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:37.897+0000 7f62660ea700 1 -- 172.21.15.163:0/118654192 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f62600febc0 msgr2=0x7f626010cb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:11:37.938 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:37.897+0000 7f62660ea700 1 --2- 172.21.15.163:0/118654192 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f62600febc0 0x7f626010cb30 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f625800b0a0 tx=0x7f625800b3b0 comp rx=0 tx=0).stop 2023-07-14T18:11:37.938 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:37.897+0000 7f62660ea700 1 -- 172.21.15.163:0/118654192 shutdown_connections 2023-07-14T18:11:37.938 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:37.897+0000 7f62660ea700 1 --2- 172.21.15.163:0/118654192 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6260104c70 0x7f6260105040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:37.939 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:37.897+0000 7f62660ea700 1 --2- 172.21.15.163:0/118654192 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f62600febc0 0x7f626010cb30 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:37.939 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:37.897+0000 7f62660ea700 1 --2- 172.21.15.163:0/118654192 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f62600fe210 0x7f62600fe680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:37.939 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:37.897+0000 7f62660ea700 1 -- 172.21.15.163:0/118654192 >> 172.21.15.163:0/118654192 conn(0x7f6260075280 msgr2=0x7f6260075680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:11:37.939 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:37.897+0000 7f62660ea700 1 -- 172.21.15.163:0/118654192 shutdown_connections 2023-07-14T18:11:37.939 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:37.897+0000 7f62660ea700 1 -- 172.21.15.163:0/118654192 wait complete. 2023-07-14T18:11:37.941 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:37.898+0000 7f62660ea700 1 Processor -- start 2023-07-14T18:11:37.941 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:37.898+0000 7f62660ea700 1 -- start start 2023-07-14T18:11:37.941 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:37.898+0000 7f62660ea700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f62600fe210 0x7f6260195da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:11:37.941 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:37.898+0000 7f62660ea700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f62600febc0 0x7f62601962e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:11:37.942 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:37.898+0000 7f62660ea700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6260104c70 0x7f626019a750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:11:37.942 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:37.898+0000 7f62660ea700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f626019ad60 con 0x7f62600febc0 2023-07-14T18:11:37.942 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:37.898+0000 7f62660ea700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f626019aed0 con 0x7f62600fe210 2023-07-14T18:11:37.942 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:37.898+0000 7f62660ea700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f626019b090 con 0x7f6260104c70 2023-07-14T18:11:37.942 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:37.899+0000 7f625effd700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f62600febc0 0x7f62601962e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:11:37.942 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:37.899+0000 7f625effd700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f62600febc0 0x7f62601962e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:56378/0 (socket says 172.21.15.163:56378) 2023-07-14T18:11:37.942 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:37.899+0000 7f625effd700 1 -- 172.21.15.163:0/473189468 learned_addr learned my addr 172.21.15.163:0/473189468 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:11:37.943 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:37.899+0000 7f625f7fe700 1 --2- 172.21.15.163:0/473189468 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f62600fe210 0x7f6260195da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:11:37.943 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:37.899+0000 7f625ffff700 1 --2- 172.21.15.163:0/473189468 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6260104c70 0x7f626019a750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:11:37.943 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:37.899+0000 7f625effd700 1 -- 172.21.15.163:0/473189468 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6260104c70 msgr2=0x7f626019a750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:11:37.943 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:37.899+0000 7f625effd700 1 --2- 172.21.15.163:0/473189468 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6260104c70 0x7f626019a750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:37.943 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:37.899+0000 7f625effd700 1 -- 172.21.15.163:0/473189468 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f62600fe210 msgr2=0x7f6260195da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:11:37.943 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:37.899+0000 7f625effd700 1 --2- 172.21.15.163:0/473189468 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f62600fe210 0x7f6260195da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:37.944 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:37.899+0000 7f625effd700 1 -- 172.21.15.163:0/473189468 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6258009d00 con 0x7f62600febc0 2023-07-14T18:11:37.944 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:37.899+0000 7f625effd700 1 --2- 172.21.15.163:0/473189468 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f62600febc0 0x7f62601962e0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f625000e9a0 tx=0x7f625000ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:11:37.944 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:37.899+0000 7f625cff9700 1 -- 172.21.15.163:0/473189468 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6250009790 con 0x7f62600febc0 2023-07-14T18:11:37.944 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:37.899+0000 7f62660ea700 1 -- 172.21.15.163:0/473189468 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f626019b370 con 0x7f62600febc0 2023-07-14T18:11:37.944 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:37.899+0000 7f625cff9700 1 -- 172.21.15.163:0/473189468 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f625000cbd0 con 0x7f62600febc0 2023-07-14T18:11:37.944 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:37.899+0000 7f625cff9700 1 -- 172.21.15.163:0/473189468 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6250018680 con 0x7f62600febc0 2023-07-14T18:11:37.944 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:37.899+0000 7f62660ea700 1 -- 172.21.15.163:0/473189468 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f62601a2bd0 con 0x7f62600febc0 2023-07-14T18:11:37.945 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:37.900+0000 7f62660ea700 1 -- 172.21.15.163:0/473189468 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f626004e340 con 0x7f62600febc0 2023-07-14T18:11:37.945 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:37.902+0000 7f625cff9700 1 -- 172.21.15.163:0/473189468 <== mon.0 v2:172.21.15.163:3300/0 4 ==== mgrmap(e 17) v1 ==== 135767+0+0 (secure 0 0 0) 0x7f625000cd40 con 0x7f62600febc0 2023-07-14T18:11:37.945 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:37.902+0000 7f625cff9700 1 --2- 172.21.15.163:0/473189468 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f624c0a1260 0x7f624c0a3710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:11:37.946 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:37.902+0000 7f625f7fe700 1 --2- 172.21.15.163:0/473189468 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f624c0a1260 0x7f624c0a3710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:11:37.946 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:37.902+0000 7f625cff9700 1 -- 172.21.15.163:0/473189468 <== mon.0 v2:172.21.15.163:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 8730+0+0 (secure 0 0 0) 0x7f6250014070 con 0x7f62600febc0 2023-07-14T18:11:37.946 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:37.903+0000 7f625f7fe700 1 --2- 172.21.15.163:0/473189468 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f624c0a1260 0x7f624c0a3710 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f6248009c60 tx=0x7f6248009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:11:37.946 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:37.906+0000 7f625cff9700 1 -- 172.21.15.163:0/473189468 <== mon.0 v2:172.21.15.163:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178025 (secure 0 0 0) 0x7f62500966a0 con 0x7f62600febc0 2023-07-14T18:11:38.184 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:38.144+0000 7f62660ea700 1 -- 172.21.15.163:0/473189468 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7f62601a2dc0 con 0x7f62600febc0 2023-07-14T18:11:38.188 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:38.148+0000 7f625cff9700 1 -- 172.21.15.163:0/473189468 <== mon.0 v2:172.21.15.163:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v17) v1 ==== 74+0+260132 (secure 0 0 0) 0x7f6250099cc0 con 0x7f62600febc0 2023-07-14T18:11:38.191 INFO:teuthology.orchestra.run.smithi163.stdout: 2023-07-14T18:11:38.193 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:38.151+0000 7f62660ea700 1 -- 172.21.15.163:0/473189468 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f624c0a1260 msgr2=0x7f624c0a3710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:11:38.193 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:38.151+0000 7f62660ea700 1 --2- 172.21.15.163:0/473189468 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f624c0a1260 0x7f624c0a3710 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f6248009c60 tx=0x7f6248009260 comp rx=0 tx=0).stop 2023-07-14T18:11:38.193 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:38.151+0000 7f62660ea700 1 -- 172.21.15.163:0/473189468 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f62600febc0 msgr2=0x7f62601962e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:11:38.193 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:38.151+0000 7f62660ea700 1 --2- 172.21.15.163:0/473189468 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f62600febc0 0x7f62601962e0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f625000e9a0 tx=0x7f625000ecb0 comp rx=0 tx=0).stop 2023-07-14T18:11:38.194 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:38.151+0000 7f62660ea700 1 -- 172.21.15.163:0/473189468 shutdown_connections 2023-07-14T18:11:38.194 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:38.151+0000 7f62660ea700 1 --2- 172.21.15.163:0/473189468 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f624c0a1260 0x7f624c0a3710 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:38.194 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:38.151+0000 7f62660ea700 1 --2- 172.21.15.163:0/473189468 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6260104c70 0x7f626019a750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:38.194 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:38.151+0000 7f62660ea700 1 --2- 172.21.15.163:0/473189468 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f62600fe210 0x7f6260195da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:38.195 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:38.151+0000 7f62660ea700 1 --2- 172.21.15.163:0/473189468 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f62600febc0 0x7f62601962e0 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:38.195 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:38.151+0000 7f62660ea700 1 -- 172.21.15.163:0/473189468 >> 172.21.15.163:0/473189468 conn(0x7f6260075280 msgr2=0x7f62600fcaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:11:38.195 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:38.151+0000 7f62660ea700 1 -- 172.21.15.163:0/473189468 shutdown_connections 2023-07-14T18:11:38.196 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:38.151+0000 7f62660ea700 1 -- 172.21.15.163:0/473189468 wait complete. 2023-07-14T18:11:38.596 INFO:teuthology.orchestra.run.smithi163.stdout:{"epoch":17,"active_gid":14152,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6800","nonce":1949590926},{"type":"v1","addr":"172.21.15.163:6801","nonce":1949590926}]},"active_addr":"172.21.15.163:6801/1949590926","active_change":"2023-07-14T18:05:15.331571+0000","active_mgr_features":4540138322906710015,"available":true,"standbys":[{"gid":24109,"name":"z","mgr_features":4540138322906710015,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"alertmanager_web_password":{"name":"alertmanager_web_password","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Alertmanager web password","long_desc":"","tags":[],"see_also":[]},"alertmanager_web_user":{"name":"alertmanager_web_user","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Alertmanager web user","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"prometheus_web_password":{"name":"prometheus_web_password","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Prometheus web password","long_desc":"","tags":[],"see_also":[]},"prometheus_web_user":{"name":"prometheus_web_user","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Prometheus web user","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"noautoscale":{"name":"noautoscale","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"global autoscale flag","long_desc":"Option to turn on/off the autoscaler for all pools","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]},{"gid":24113,"name":"y","mgr_features":4540138322906710015,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"alertmanager_web_password":{"name":"alertmanager_web_password","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Alertmanager web password","long_desc":"","tags":[],"see_also":[]},"alertmanager_web_user":{"name":"alertmanager_web_user","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Alertmanager web user","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"prometheus_web_password":{"name":"prometheus_web_password","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Prometheus web password","long_desc":"","tags":[],"see_also":[]},"prometheus_web_user":{"name":"prometheus_web_user","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Prometheus web user","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"noautoscale":{"name":"noautoscale","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"global autoscale flag","long_desc":"Option to turn on/off the autoscaler for all pools","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["cephadm","dashboard","iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"alertmanager_web_password":{"name":"alertmanager_web_password","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Alertmanager web password","long_desc":"","tags":[],"see_also":[]},"alertmanager_web_user":{"name":"alertmanager_web_user","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Alertmanager web user","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"prometheus_web_password":{"name":"prometheus_web_password","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Prometheus web password","long_desc":"","tags":[],"see_also":[]},"prometheus_web_user":{"name":"prometheus_web_user","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Prometheus web user","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"noautoscale":{"name":"noautoscale","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"global autoscale flag","long_desc":"Option to turn on/off the autoscaler for all pools","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{"dashboard":"https://172.21.15.163:8443/"},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":3,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.163:0","nonce":606557271}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.163:0","nonce":1374381674}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.163:0","nonce":3447485118}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.163:0","nonce":4095099911}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.163:0","nonce":53982726}]}]} 2023-07-14T18:11:38.604 INFO:tasks.cephadm.ceph_manager.ceph:mgr available! 2023-07-14T18:11:38.604 INFO:tasks.cephadm.ceph_manager.ceph:waiting for all up 2023-07-14T18:11:38.604 DEBUG:teuthology.orchestra.run.smithi163:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81c9387d2e7576da065747ec9c16d1c7d69016ec shell --fsid bf7326ec-2270-11ee-9b33-001a4aab830c -- ceph osd dump --format=json 2023-07-14T18:11:38.966 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:11:38 smithi163 ceph-mon[96576]: pgmap v265: 129 pgs: 129 active+clean; 621 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 7.5 KiB/s wr, 19 op/s 2023-07-14T18:11:38.967 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:11:38 smithi163 ceph-mon[96576]: from='client.? 172.21.15.163:0/473189468' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2023-07-14T18:11:39.158 INFO:teuthology.orchestra.run.smithi163.stderr:Inferring config /var/lib/ceph/bf7326ec-2270-11ee-9b33-001a4aab830c/mon.a/config 2023-07-14T18:11:39.174 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:11:38 smithi184 ceph-mon[98481]: pgmap v265: 129 pgs: 129 active+clean; 621 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 7.5 KiB/s wr, 19 op/s 2023-07-14T18:11:39.174 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:11:38 smithi184 ceph-mon[98481]: from='client.? 172.21.15.163:0/473189468' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2023-07-14T18:11:39.274 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:11:38 smithi172 ceph-mon[97983]: pgmap v265: 129 pgs: 129 active+clean; 621 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 7.5 KiB/s wr, 19 op/s 2023-07-14T18:11:39.275 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:11:38 smithi172 ceph-mon[97983]: from='client.? 172.21.15.163:0/473189468' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2023-07-14T18:11:40.375 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:40.334+0000 7f857b991700 1 -- 172.21.15.163:0/970711186 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f857410a2d0 msgr2=0x7f857410c730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:11:40.375 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:40.334+0000 7f857b991700 1 --2- 172.21.15.163:0/970711186 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f857410a2d0 0x7f857410c730 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f856c00b0a0 tx=0x7f856c00b3b0 comp rx=0 tx=0).stop 2023-07-14T18:11:40.375 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:40.334+0000 7f857b991700 1 -- 172.21.15.163:0/970711186 shutdown_connections 2023-07-14T18:11:40.376 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:40.334+0000 7f857b991700 1 --2- 172.21.15.163:0/970711186 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8574100f80 0x7f8574101350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:40.376 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:40.334+0000 7f857b991700 1 --2- 172.21.15.163:0/970711186 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f857410a2d0 0x7f857410c730 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:40.376 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:40.334+0000 7f857b991700 1 --2- 172.21.15.163:0/970711186 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8574101890 0x7f8574109d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:40.376 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:40.334+0000 7f857b991700 1 -- 172.21.15.163:0/970711186 >> 172.21.15.163:0/970711186 conn(0x7f85740fa720 msgr2=0x7f85740fcb30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:11:40.376 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:40.335+0000 7f857b991700 1 -- 172.21.15.163:0/970711186 shutdown_connections 2023-07-14T18:11:40.376 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:40.335+0000 7f857b991700 1 -- 172.21.15.163:0/970711186 wait complete. 2023-07-14T18:11:40.376 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:40.335+0000 7f857b991700 1 Processor -- start 2023-07-14T18:11:40.377 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:40.335+0000 7f857b991700 1 -- start start 2023-07-14T18:11:40.378 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:40.335+0000 7f857b991700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f8574100f80 0x7f8574198040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:11:40.378 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:40.335+0000 7f857b991700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8574101890 0x7f8574198580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:11:40.378 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:40.335+0000 7f857b991700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f857410a2d0 0x7f857419c9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:11:40.378 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:40.335+0000 7f857b991700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f857419d000 con 0x7f8574100f80 2023-07-14T18:11:40.378 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:40.335+0000 7f857b991700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f857419d170 con 0x7f857410a2d0 2023-07-14T18:11:40.379 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:40.335+0000 7f857b991700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f857419d330 con 0x7f8574101890 2023-07-14T18:11:40.379 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:40.336+0000 7f857972d700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f8574100f80 0x7f8574198040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:11:40.379 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:40.336+0000 7f857972d700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f8574100f80 0x7f8574198040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:56390/0 (socket says 172.21.15.163:56390) 2023-07-14T18:11:40.379 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:40.336+0000 7f857972d700 1 -- 172.21.15.163:0/2673714747 learned_addr learned my addr 172.21.15.163:0/2673714747 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:11:40.379 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:40.336+0000 7f8579f2e700 1 --2- 172.21.15.163:0/2673714747 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f857410a2d0 0x7f857419c9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:11:40.379 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:40.336+0000 7f8578f2c700 1 --2- 172.21.15.163:0/2673714747 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8574101890 0x7f8574198580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:11:40.379 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:40.336+0000 7f857972d700 1 -- 172.21.15.163:0/2673714747 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8574101890 msgr2=0x7f8574198580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:11:40.380 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:40.336+0000 7f857972d700 1 --2- 172.21.15.163:0/2673714747 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8574101890 0x7f8574198580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:40.380 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:40.336+0000 7f857972d700 1 -- 172.21.15.163:0/2673714747 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f857410a2d0 msgr2=0x7f857419c9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:11:40.380 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:40.336+0000 7f857972d700 1 --2- 172.21.15.163:0/2673714747 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f857410a2d0 0x7f857419c9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:40.380 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:40.336+0000 7f857972d700 1 -- 172.21.15.163:0/2673714747 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f856c009d00 con 0x7f8574100f80 2023-07-14T18:11:40.380 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:40.336+0000 7f857972d700 1 --2- 172.21.15.163:0/2673714747 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f8574100f80 0x7f8574198040 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f856400b530 tx=0x7f856400b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:11:40.380 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:40.336+0000 7f856a7fc700 1 -- 172.21.15.163:0/2673714747 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8564011830 con 0x7f8574100f80 2023-07-14T18:11:40.380 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:40.336+0000 7f857b991700 1 -- 172.21.15.163:0/2673714747 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f857419d610 con 0x7f8574100f80 2023-07-14T18:11:40.380 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:40.336+0000 7f856a7fc700 1 -- 172.21.15.163:0/2673714747 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f8564011e20 con 0x7f8574100f80 2023-07-14T18:11:40.381 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:40.336+0000 7f856a7fc700 1 -- 172.21.15.163:0/2673714747 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f856400f2e0 con 0x7f8574100f80 2023-07-14T18:11:40.381 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:40.336+0000 7f857b991700 1 -- 172.21.15.163:0/2673714747 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f85741a4e70 con 0x7f8574100f80 2023-07-14T18:11:40.381 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:40.337+0000 7f857b991700 1 -- 172.21.15.163:0/2673714747 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f857404e340 con 0x7f8574100f80 2023-07-14T18:11:40.382 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:40.338+0000 7f856a7fc700 1 -- 172.21.15.163:0/2673714747 <== mon.0 v2:172.21.15.163:3300/0 4 ==== mgrmap(e 17) v1 ==== 135767+0+0 (secure 0 0 0) 0x7f8564011990 con 0x7f8574100f80 2023-07-14T18:11:40.382 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:40.339+0000 7f856a7fc700 1 --2- 172.21.15.163:0/2673714747 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f85600a11e0 0x7f85600a3690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:11:40.382 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:40.339+0000 7f8578f2c700 1 --2- 172.21.15.163:0/2673714747 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f85600a11e0 0x7f85600a3690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:11:40.382 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:40.339+0000 7f856a7fc700 1 -- 172.21.15.163:0/2673714747 <== mon.0 v2:172.21.15.163:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 8730+0+0 (secure 0 0 0) 0x7f85640cc6d0 con 0x7f8574100f80 2023-07-14T18:11:40.382 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:40.339+0000 7f8578f2c700 1 --2- 172.21.15.163:0/2673714747 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f85600a11e0 0x7f85600a3690 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f8570005950 tx=0x7f85700058e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:11:40.383 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:40.343+0000 7f856a7fc700 1 -- 172.21.15.163:0/2673714747 <== mon.0 v2:172.21.15.163:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178025 (secure 0 0 0) 0x7f8564095be0 con 0x7f8574100f80 2023-07-14T18:11:40.570 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:40.530+0000 7f857b991700 1 -- 172.21.15.163:0/2673714747 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f85741993a0 con 0x7f8574100f80 2023-07-14T18:11:40.572 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:40.532+0000 7f856a7fc700 1 -- 172.21.15.163:0/2673714747 <== mon.0 v2:172.21.15.163:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v84) v1 ==== 74+0+24030 (secure 0 0 0) 0x7f8564099200 con 0x7f8574100f80 2023-07-14T18:11:40.572 INFO:teuthology.orchestra.run.smithi163.stdout: 2023-07-14T18:11:40.572 INFO:teuthology.orchestra.run.smithi163.stdout:{"epoch":84,"fsid":"bf7326ec-2270-11ee-9b33-001a4aab830c","created":"2023-07-14T18:04:26.263517+0000","modified":"2023-07-14T18:11:14.170253+0000","last_up_change":"2023-07-14T18:10:27.514863+0000","last_in_change":"2023-07-14T18:10:10.726443+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-14T18:07:19.653852+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-07-14T18:11:07.314989+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-07-14T18:11:08.274627+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-07-14T18:11:11.991162+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"e6490568-046d-43ef-bb07-d79fb884b276","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6802","nonce":3124653025},{"type":"v1","addr":"172.21.15.163:6803","nonce":3124653025}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6804","nonce":3124653025},{"type":"v1","addr":"172.21.15.163:6805","nonce":3124653025}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6808","nonce":3124653025},{"type":"v1","addr":"172.21.15.163:6809","nonce":3124653025}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6806","nonce":3124653025},{"type":"v1","addr":"172.21.15.163:6807","nonce":3124653025}]},"public_addr":"172.21.15.163:6803/3124653025","cluster_addr":"172.21.15.163:6805/3124653025","heartbeat_back_addr":"172.21.15.163:6809/3124653025","heartbeat_front_addr":"172.21.15.163:6807/3124653025","state":["exists","up"]},{"osd":1,"uuid":"0af39bda-f096-4603-adcc-bf1988f36603","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":3774455900},{"type":"v1","addr":"172.21.15.172:6801","nonce":3774455900}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":3774455900},{"type":"v1","addr":"172.21.15.172:6803","nonce":3774455900}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":3774455900},{"type":"v1","addr":"172.21.15.172:6807","nonce":3774455900}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":3774455900},{"type":"v1","addr":"172.21.15.172:6805","nonce":3774455900}]},"public_addr":"172.21.15.172:6801/3774455900","cluster_addr":"172.21.15.172:6803/3774455900","heartbeat_back_addr":"172.21.15.172:6807/3774455900","heartbeat_front_addr":"172.21.15.172:6805/3774455900","state":["exists","up"]},{"osd":2,"uuid":"cc732c13-af0f-4199-98e6-fe960ed4e5dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":1976927678},{"type":"v1","addr":"172.21.15.184:6801","nonce":1976927678}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":1976927678},{"type":"v1","addr":"172.21.15.184:6803","nonce":1976927678}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":1976927678},{"type":"v1","addr":"172.21.15.184:6807","nonce":1976927678}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":1976927678},{"type":"v1","addr":"172.21.15.184:6805","nonce":1976927678}]},"public_addr":"172.21.15.184:6801/1976927678","cluster_addr":"172.21.15.184:6803/1976927678","heartbeat_back_addr":"172.21.15.184:6807/1976927678","heartbeat_front_addr":"172.21.15.184:6805/1976927678","state":["exists","up"]},{"osd":3,"uuid":"dcee9576-0bc6-4ab0-8f63-79eacd0eca5f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6810","nonce":2589130694},{"type":"v1","addr":"172.21.15.163:6811","nonce":2589130694}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6812","nonce":2589130694},{"type":"v1","addr":"172.21.15.163:6813","nonce":2589130694}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6816","nonce":2589130694},{"type":"v1","addr":"172.21.15.163:6817","nonce":2589130694}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6814","nonce":2589130694},{"type":"v1","addr":"172.21.15.163:6815","nonce":2589130694}]},"public_addr":"172.21.15.163:6811/2589130694","cluster_addr":"172.21.15.163:6813/2589130694","heartbeat_back_addr":"172.21.15.163:6817/2589130694","heartbeat_front_addr":"172.21.15.163:6815/2589130694","state":["exists","up"]},{"osd":4,"uuid":"055df823-b8b0-426a-83c2-f0d727932ad8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":3319632614},{"type":"v1","addr":"172.21.15.172:6809","nonce":3319632614}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6810","nonce":3319632614},{"type":"v1","addr":"172.21.15.172:6811","nonce":3319632614}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6814","nonce":3319632614},{"type":"v1","addr":"172.21.15.172:6815","nonce":3319632614}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":3319632614},{"type":"v1","addr":"172.21.15.172:6813","nonce":3319632614}]},"public_addr":"172.21.15.172:6809/3319632614","cluster_addr":"172.21.15.172:6811/3319632614","heartbeat_back_addr":"172.21.15.172:6815/3319632614","heartbeat_front_addr":"172.21.15.172:6813/3319632614","state":["exists","up"]},{"osd":5,"uuid":"ef5ef02a-b4e2-4790-9d27-f6d2247b25c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":2662084043},{"type":"v1","addr":"172.21.15.184:6809","nonce":2662084043}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6810","nonce":2662084043},{"type":"v1","addr":"172.21.15.184:6811","nonce":2662084043}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6814","nonce":2662084043},{"type":"v1","addr":"172.21.15.184:6815","nonce":2662084043}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6812","nonce":2662084043},{"type":"v1","addr":"172.21.15.184:6813","nonce":2662084043}]},"public_addr":"172.21.15.184:6809/2662084043","cluster_addr":"172.21.15.184:6811/2662084043","heartbeat_back_addr":"172.21.15.184:6815/2662084043","heartbeat_front_addr":"172.21.15.184:6813/2662084043","state":["exists","up"]},{"osd":6,"uuid":"dba754be-0fc5-4867-a6d5-cf97eb344f81","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":44,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6818","nonce":2530874117},{"type":"v1","addr":"172.21.15.163:6819","nonce":2530874117}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6820","nonce":2530874117},{"type":"v1","addr":"172.21.15.163:6821","nonce":2530874117}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6824","nonce":2530874117},{"type":"v1","addr":"172.21.15.163:6825","nonce":2530874117}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6822","nonce":2530874117},{"type":"v1","addr":"172.21.15.163:6823","nonce":2530874117}]},"public_addr":"172.21.15.163:6819/2530874117","cluster_addr":"172.21.15.163:6821/2530874117","heartbeat_back_addr":"172.21.15.163:6825/2530874117","heartbeat_front_addr":"172.21.15.163:6823/2530874117","state":["exists","up"]},{"osd":7,"uuid":"edd76e6b-6077-4619-b00d-1e906f70ddcc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":49,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":233511803},{"type":"v1","addr":"172.21.15.172:6817","nonce":233511803}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6818","nonce":233511803},{"type":"v1","addr":"172.21.15.172:6819","nonce":233511803}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":233511803},{"type":"v1","addr":"172.21.15.172:6823","nonce":233511803}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6820","nonce":233511803},{"type":"v1","addr":"172.21.15.172:6821","nonce":233511803}]},"public_addr":"172.21.15.172:6817/233511803","cluster_addr":"172.21.15.172:6819/233511803","heartbeat_back_addr":"172.21.15.172:6823/233511803","heartbeat_front_addr":"172.21.15.172:6821/233511803","state":["exists","up"]},{"osd":8,"uuid":"36559400-f33e-44e6-868a-316d34da457d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":56,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6816","nonce":290154343},{"type":"v1","addr":"172.21.15.184:6817","nonce":290154343}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6818","nonce":290154343},{"type":"v1","addr":"172.21.15.184:6819","nonce":290154343}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6822","nonce":290154343},{"type":"v1","addr":"172.21.15.184:6823","nonce":290154343}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6820","nonce":290154343},{"type":"v1","addr":"172.21.15.184:6821","nonce":290154343}]},"public_addr":"172.21.15.184:6817/290154343","cluster_addr":"172.21.15.184:6819/290154343","heartbeat_back_addr":"172.21.15.184:6823/290154343","heartbeat_front_addr":"172.21.15.184:6821/290154343","state":["exists","up"]},{"osd":9,"uuid":"d484f111-f36c-4c67-9a8a-ae03e7e0d137","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6826","nonce":3848110906},{"type":"v1","addr":"172.21.15.163:6827","nonce":3848110906}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6828","nonce":3848110906},{"type":"v1","addr":"172.21.15.163:6829","nonce":3848110906}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6832","nonce":3848110906},{"type":"v1","addr":"172.21.15.163:6833","nonce":3848110906}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6830","nonce":3848110906},{"type":"v1","addr":"172.21.15.163:6831","nonce":3848110906}]},"public_addr":"172.21.15.163:6827/3848110906","cluster_addr":"172.21.15.163:6829/3848110906","heartbeat_back_addr":"172.21.15.163:6833/3848110906","heartbeat_front_addr":"172.21.15.163:6831/3848110906","state":["exists","up"]},{"osd":10,"uuid":"d943f7c0-da3d-4605-9e23-0231e675c6be","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6824","nonce":3281085356},{"type":"v1","addr":"172.21.15.172:6825","nonce":3281085356}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":3281085356},{"type":"v1","addr":"172.21.15.172:6827","nonce":3281085356}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":3281085356},{"type":"v1","addr":"172.21.15.172:6831","nonce":3281085356}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6828","nonce":3281085356},{"type":"v1","addr":"172.21.15.172:6829","nonce":3281085356}]},"public_addr":"172.21.15.172:6825/3281085356","cluster_addr":"172.21.15.172:6827/3281085356","heartbeat_back_addr":"172.21.15.172:6831/3281085356","heartbeat_front_addr":"172.21.15.172:6829/3281085356","state":["exists","up"]},{"osd":11,"uuid":"09e610a8-408a-4119-a21b-c4de2810a538","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":75,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6824","nonce":3614578747},{"type":"v1","addr":"172.21.15.184:6825","nonce":3614578747}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6826","nonce":3614578747},{"type":"v1","addr":"172.21.15.184:6827","nonce":3614578747}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6830","nonce":3614578747},{"type":"v1","addr":"172.21.15.184:6831","nonce":3614578747}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6828","nonce":3614578747},{"type":"v1","addr":"172.21.15.184:6829","nonce":3614578747}]},"public_addr":"172.21.15.184:6825/3614578747","cluster_addr":"172.21.15.184:6827/3614578747","heartbeat_back_addr":"172.21.15.184:6831/3614578747","heartbeat_front_addr":"172.21.15.184:6829/3614578747","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T18:06:36.067578+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T18:06:57.095120+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T18:07:17.825363+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T18:07:38.977196+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T18:08:00.108709+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T18:08:20.700646+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T18:08:41.473899+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T18:09:02.856536+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T18:09:23.832722+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T18:09:44.860884+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T18:10:05.520678+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T18:10:26.426315+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.163:6801/1086512093":"2023-07-15T18:05:15.331458+0000","172.21.15.163:6800/1086512093":"2023-07-15T18:05:15.331458+0000","172.21.15.163:0/4235784810":"2023-07-15T18:05:15.331458+0000","172.21.15.163:6800/236891232":"2023-07-15T18:04:53.288443+0000","172.21.15.163:6801/236891232":"2023-07-15T18:04:53.288443+0000","172.21.15.163:0/3260193612":"2023-07-15T18:05:15.331458+0000","172.21.15.163:0/3513629472":"2023-07-15T18:04:53.288443+0000","172.21.15.163:0/1090329830":"2023-07-15T18:04:53.288443+0000","172.21.15.163:0/3868922045":"2023-07-15T18:05:15.331458+0000","172.21.15.163:0/2945662447":"2023-07-15T18:04:53.288443+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-14T18:11:40.574 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:40.534+0000 7f857b991700 1 -- 172.21.15.163:0/2673714747 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f85600a11e0 msgr2=0x7f85600a3690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:11:40.574 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:40.534+0000 7f857b991700 1 --2- 172.21.15.163:0/2673714747 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f85600a11e0 0x7f85600a3690 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f8570005950 tx=0x7f85700058e0 comp rx=0 tx=0).stop 2023-07-14T18:11:40.574 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:40.534+0000 7f857b991700 1 -- 172.21.15.163:0/2673714747 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f8574100f80 msgr2=0x7f8574198040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:11:40.574 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:40.534+0000 7f857b991700 1 --2- 172.21.15.163:0/2673714747 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f8574100f80 0x7f8574198040 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f856400b530 tx=0x7f856400b840 comp rx=0 tx=0).stop 2023-07-14T18:11:40.574 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:40.534+0000 7f857b991700 1 -- 172.21.15.163:0/2673714747 shutdown_connections 2023-07-14T18:11:40.574 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:40.534+0000 7f857b991700 1 --2- 172.21.15.163:0/2673714747 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f85600a11e0 0x7f85600a3690 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:40.575 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:40.534+0000 7f857b991700 1 --2- 172.21.15.163:0/2673714747 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f857410a2d0 0x7f857419c9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:40.575 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:40.534+0000 7f857b991700 1 --2- 172.21.15.163:0/2673714747 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f8574100f80 0x7f8574198040 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:40.575 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:40.534+0000 7f857b991700 1 --2- 172.21.15.163:0/2673714747 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8574101890 0x7f8574198580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:40.575 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:40.534+0000 7f857b991700 1 -- 172.21.15.163:0/2673714747 >> 172.21.15.163:0/2673714747 conn(0x7f85740fa720 msgr2=0x7f857410c480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:11:40.575 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:40.534+0000 7f857b991700 1 -- 172.21.15.163:0/2673714747 shutdown_connections 2023-07-14T18:11:40.575 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:40.534+0000 7f857b991700 1 -- 172.21.15.163:0/2673714747 wait complete. 2023-07-14T18:11:40.961 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:11:40 smithi163 ceph-mon[96576]: pgmap v266: 129 pgs: 129 active+clean; 625 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 9.4 KiB/s rd, 8.0 KiB/s wr, 23 op/s 2023-07-14T18:11:40.961 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:11:40 smithi163 ceph-mon[96576]: from='client.? 172.21.15.163:0/2673714747' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-07-14T18:11:41.022 INFO:tasks.cephadm.ceph_manager.ceph:all up! 2023-07-14T18:11:41.023 DEBUG:teuthology.orchestra.run.smithi163:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81c9387d2e7576da065747ec9c16d1c7d69016ec shell --fsid bf7326ec-2270-11ee-9b33-001a4aab830c -- ceph osd dump --format=json 2023-07-14T18:11:41.174 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:11:40 smithi184 ceph-mon[98481]: pgmap v266: 129 pgs: 129 active+clean; 625 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 9.4 KiB/s rd, 8.0 KiB/s wr, 23 op/s 2023-07-14T18:11:41.174 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:11:40 smithi184 ceph-mon[98481]: from='client.? 172.21.15.163:0/2673714747' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-07-14T18:11:41.274 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:11:40 smithi172 ceph-mon[97983]: pgmap v266: 129 pgs: 129 active+clean; 625 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 9.4 KiB/s rd, 8.0 KiB/s wr, 23 op/s 2023-07-14T18:11:41.275 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:11:40 smithi172 ceph-mon[97983]: from='client.? 172.21.15.163:0/2673714747' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-07-14T18:11:41.576 INFO:teuthology.orchestra.run.smithi163.stderr:Inferring config /var/lib/ceph/bf7326ec-2270-11ee-9b33-001a4aab830c/mon.a/config 2023-07-14T18:11:42.681 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:42.640+0000 7fa294953700 1 -- 172.21.15.163:0/292545501 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fa290100f20 msgr2=0x7fa2901012f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:11:42.682 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:42.640+0000 7fa294953700 1 --2- 172.21.15.163:0/292545501 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fa290100f20 0x7fa2901012f0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fa280009990 tx=0x7fa280009ca0 comp rx=0 tx=0).stop 2023-07-14T18:11:42.682 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:42.640+0000 7fa294953700 1 -- 172.21.15.163:0/292545501 shutdown_connections 2023-07-14T18:11:42.682 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:42.640+0000 7fa294953700 1 --2- 172.21.15.163:0/292545501 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa29010a270 0x7fa29010c6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:42.682 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:42.640+0000 7fa294953700 1 --2- 172.21.15.163:0/292545501 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fa290100f20 0x7fa2901012f0 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:42.682 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:42.640+0000 7fa294953700 1 --2- 172.21.15.163:0/292545501 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa290101830 0x7fa290109d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:42.682 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:42.640+0000 7fa294953700 1 -- 172.21.15.163:0/292545501 >> 172.21.15.163:0/292545501 conn(0x7fa290075ca0 msgr2=0x7fa2900760a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:11:42.682 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:42.640+0000 7fa294953700 1 -- 172.21.15.163:0/292545501 shutdown_connections 2023-07-14T18:11:42.683 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:42.640+0000 7fa294953700 1 -- 172.21.15.163:0/292545501 wait complete. 2023-07-14T18:11:42.683 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:42.641+0000 7fa294953700 1 Processor -- start 2023-07-14T18:11:42.683 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:42.641+0000 7fa294953700 1 -- start start 2023-07-14T18:11:42.683 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:42.641+0000 7fa294953700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa290100f20 0x7fa290197ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:11:42.683 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:42.641+0000 7fa294953700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa290101830 0x7fa290198420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:11:42.683 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:42.641+0000 7fa294953700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fa29010a270 0x7fa29019c820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:11:42.683 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:42.641+0000 7fa294953700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa29019ce30 con 0x7fa29010a270 2023-07-14T18:11:42.683 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:42.641+0000 7fa294953700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa29019cfa0 con 0x7fa290101830 2023-07-14T18:11:42.684 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:42.641+0000 7fa294953700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa29019d160 con 0x7fa290100f20 2023-07-14T18:11:42.685 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:42.642+0000 7fa28dd9b700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa290101830 0x7fa290198420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:11:42.686 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:42.642+0000 7fa28dd9b700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa290101830 0x7fa290198420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.163:57088/0 (socket says 172.21.15.163:57088) 2023-07-14T18:11:42.686 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:42.642+0000 7fa28ed9d700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fa29010a270 0x7fa29019c820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:11:42.686 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:42.642+0000 7fa28dd9b700 1 -- 172.21.15.163:0/2160756146 learned_addr learned my addr 172.21.15.163:0/2160756146 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:11:42.686 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:42.642+0000 7fa28e59c700 1 --2- 172.21.15.163:0/2160756146 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa290100f20 0x7fa290197ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:11:42.686 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:42.642+0000 7fa28ed9d700 1 -- 172.21.15.163:0/2160756146 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa290100f20 msgr2=0x7fa290197ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:11:42.686 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:42.642+0000 7fa28ed9d700 1 --2- 172.21.15.163:0/2160756146 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa290100f20 0x7fa290197ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:42.686 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:42.642+0000 7fa28ed9d700 1 -- 172.21.15.163:0/2160756146 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa290101830 msgr2=0x7fa290198420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:11:42.687 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:42.642+0000 7fa28ed9d700 1 --2- 172.21.15.163:0/2160756146 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa290101830 0x7fa290198420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:42.687 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:42.642+0000 7fa28ed9d700 1 -- 172.21.15.163:0/2160756146 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2800095f0 con 0x7fa29010a270 2023-07-14T18:11:42.687 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:42.642+0000 7fa28ed9d700 1 --2- 172.21.15.163:0/2160756146 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fa29010a270 0x7fa29019c820 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fa288007f10 tx=0x7fa28800d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:11:42.687 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:42.642+0000 7fa27f7fe700 1 -- 172.21.15.163:0/2160756146 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa288004db0 con 0x7fa29010a270 2023-07-14T18:11:42.687 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:42.642+0000 7fa27f7fe700 1 -- 172.21.15.163:0/2160756146 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fa28800f040 con 0x7fa29010a270 2023-07-14T18:11:42.688 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:42.642+0000 7fa27f7fe700 1 -- 172.21.15.163:0/2160756146 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa288005850 con 0x7fa29010a270 2023-07-14T18:11:42.688 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:42.642+0000 7fa294953700 1 -- 172.21.15.163:0/2160756146 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa29019d440 con 0x7fa29010a270 2023-07-14T18:11:42.688 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:42.642+0000 7fa294953700 1 -- 172.21.15.163:0/2160756146 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2901a4ca0 con 0x7fa29010a270 2023-07-14T18:11:42.689 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:42.643+0000 7fa294953700 1 -- 172.21.15.163:0/2160756146 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa29004e340 con 0x7fa29010a270 2023-07-14T18:11:42.689 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:42.644+0000 7fa27f7fe700 1 -- 172.21.15.163:0/2160756146 <== mon.0 v2:172.21.15.163:3300/0 4 ==== mgrmap(e 17) v1 ==== 135767+0+0 (secure 0 0 0) 0x7fa28800db20 con 0x7fa29010a270 2023-07-14T18:11:42.689 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:42.645+0000 7fa27f7fe700 1 --2- 172.21.15.163:0/2160756146 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7fa2780a11e0 0x7fa2780a3690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:11:42.689 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:42.645+0000 7fa27f7fe700 1 -- 172.21.15.163:0/2160756146 <== mon.0 v2:172.21.15.163:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 8730+0+0 (secure 0 0 0) 0x7fa2880ccbc0 con 0x7fa29010a270 2023-07-14T18:11:42.690 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:42.645+0000 7fa28e59c700 1 --2- 172.21.15.163:0/2160756146 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7fa2780a11e0 0x7fa2780a3690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:11:42.690 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:42.645+0000 7fa28e59c700 1 --2- 172.21.15.163:0/2160756146 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7fa2780a11e0 0x7fa2780a3690 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fa28000b5c0 tx=0x7fa280005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:11:42.690 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:42.648+0000 7fa27f7fe700 1 -- 172.21.15.163:0/2160756146 <== mon.0 v2:172.21.15.163:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178025 (secure 0 0 0) 0x7fa288095fc0 con 0x7fa29010a270 2023-07-14T18:11:42.878 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:42.838+0000 7fa294953700 1 -- 172.21.15.163:0/2160756146 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa2901a4e30 con 0x7fa29010a270 2023-07-14T18:11:42.879 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:42.839+0000 7fa27f7fe700 1 -- 172.21.15.163:0/2160756146 <== mon.0 v2:172.21.15.163:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v84) v1 ==== 74+0+24030 (secure 0 0 0) 0x7fa288023020 con 0x7fa29010a270 2023-07-14T18:11:42.880 INFO:teuthology.orchestra.run.smithi163.stdout: 2023-07-14T18:11:42.880 INFO:teuthology.orchestra.run.smithi163.stdout:{"epoch":84,"fsid":"bf7326ec-2270-11ee-9b33-001a4aab830c","created":"2023-07-14T18:04:26.263517+0000","modified":"2023-07-14T18:11:14.170253+0000","last_up_change":"2023-07-14T18:10:27.514863+0000","last_in_change":"2023-07-14T18:10:10.726443+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-14T18:07:19.653852+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-07-14T18:11:07.314989+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-07-14T18:11:08.274627+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-07-14T18:11:11.991162+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"e6490568-046d-43ef-bb07-d79fb884b276","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6802","nonce":3124653025},{"type":"v1","addr":"172.21.15.163:6803","nonce":3124653025}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6804","nonce":3124653025},{"type":"v1","addr":"172.21.15.163:6805","nonce":3124653025}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6808","nonce":3124653025},{"type":"v1","addr":"172.21.15.163:6809","nonce":3124653025}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6806","nonce":3124653025},{"type":"v1","addr":"172.21.15.163:6807","nonce":3124653025}]},"public_addr":"172.21.15.163:6803/3124653025","cluster_addr":"172.21.15.163:6805/3124653025","heartbeat_back_addr":"172.21.15.163:6809/3124653025","heartbeat_front_addr":"172.21.15.163:6807/3124653025","state":["exists","up"]},{"osd":1,"uuid":"0af39bda-f096-4603-adcc-bf1988f36603","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":3774455900},{"type":"v1","addr":"172.21.15.172:6801","nonce":3774455900}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":3774455900},{"type":"v1","addr":"172.21.15.172:6803","nonce":3774455900}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":3774455900},{"type":"v1","addr":"172.21.15.172:6807","nonce":3774455900}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":3774455900},{"type":"v1","addr":"172.21.15.172:6805","nonce":3774455900}]},"public_addr":"172.21.15.172:6801/3774455900","cluster_addr":"172.21.15.172:6803/3774455900","heartbeat_back_addr":"172.21.15.172:6807/3774455900","heartbeat_front_addr":"172.21.15.172:6805/3774455900","state":["exists","up"]},{"osd":2,"uuid":"cc732c13-af0f-4199-98e6-fe960ed4e5dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":1976927678},{"type":"v1","addr":"172.21.15.184:6801","nonce":1976927678}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":1976927678},{"type":"v1","addr":"172.21.15.184:6803","nonce":1976927678}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":1976927678},{"type":"v1","addr":"172.21.15.184:6807","nonce":1976927678}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":1976927678},{"type":"v1","addr":"172.21.15.184:6805","nonce":1976927678}]},"public_addr":"172.21.15.184:6801/1976927678","cluster_addr":"172.21.15.184:6803/1976927678","heartbeat_back_addr":"172.21.15.184:6807/1976927678","heartbeat_front_addr":"172.21.15.184:6805/1976927678","state":["exists","up"]},{"osd":3,"uuid":"dcee9576-0bc6-4ab0-8f63-79eacd0eca5f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6810","nonce":2589130694},{"type":"v1","addr":"172.21.15.163:6811","nonce":2589130694}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6812","nonce":2589130694},{"type":"v1","addr":"172.21.15.163:6813","nonce":2589130694}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6816","nonce":2589130694},{"type":"v1","addr":"172.21.15.163:6817","nonce":2589130694}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6814","nonce":2589130694},{"type":"v1","addr":"172.21.15.163:6815","nonce":2589130694}]},"public_addr":"172.21.15.163:6811/2589130694","cluster_addr":"172.21.15.163:6813/2589130694","heartbeat_back_addr":"172.21.15.163:6817/2589130694","heartbeat_front_addr":"172.21.15.163:6815/2589130694","state":["exists","up"]},{"osd":4,"uuid":"055df823-b8b0-426a-83c2-f0d727932ad8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":3319632614},{"type":"v1","addr":"172.21.15.172:6809","nonce":3319632614}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6810","nonce":3319632614},{"type":"v1","addr":"172.21.15.172:6811","nonce":3319632614}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6814","nonce":3319632614},{"type":"v1","addr":"172.21.15.172:6815","nonce":3319632614}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":3319632614},{"type":"v1","addr":"172.21.15.172:6813","nonce":3319632614}]},"public_addr":"172.21.15.172:6809/3319632614","cluster_addr":"172.21.15.172:6811/3319632614","heartbeat_back_addr":"172.21.15.172:6815/3319632614","heartbeat_front_addr":"172.21.15.172:6813/3319632614","state":["exists","up"]},{"osd":5,"uuid":"ef5ef02a-b4e2-4790-9d27-f6d2247b25c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":2662084043},{"type":"v1","addr":"172.21.15.184:6809","nonce":2662084043}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6810","nonce":2662084043},{"type":"v1","addr":"172.21.15.184:6811","nonce":2662084043}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6814","nonce":2662084043},{"type":"v1","addr":"172.21.15.184:6815","nonce":2662084043}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6812","nonce":2662084043},{"type":"v1","addr":"172.21.15.184:6813","nonce":2662084043}]},"public_addr":"172.21.15.184:6809/2662084043","cluster_addr":"172.21.15.184:6811/2662084043","heartbeat_back_addr":"172.21.15.184:6815/2662084043","heartbeat_front_addr":"172.21.15.184:6813/2662084043","state":["exists","up"]},{"osd":6,"uuid":"dba754be-0fc5-4867-a6d5-cf97eb344f81","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":44,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6818","nonce":2530874117},{"type":"v1","addr":"172.21.15.163:6819","nonce":2530874117}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6820","nonce":2530874117},{"type":"v1","addr":"172.21.15.163:6821","nonce":2530874117}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6824","nonce":2530874117},{"type":"v1","addr":"172.21.15.163:6825","nonce":2530874117}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6822","nonce":2530874117},{"type":"v1","addr":"172.21.15.163:6823","nonce":2530874117}]},"public_addr":"172.21.15.163:6819/2530874117","cluster_addr":"172.21.15.163:6821/2530874117","heartbeat_back_addr":"172.21.15.163:6825/2530874117","heartbeat_front_addr":"172.21.15.163:6823/2530874117","state":["exists","up"]},{"osd":7,"uuid":"edd76e6b-6077-4619-b00d-1e906f70ddcc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":49,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":233511803},{"type":"v1","addr":"172.21.15.172:6817","nonce":233511803}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6818","nonce":233511803},{"type":"v1","addr":"172.21.15.172:6819","nonce":233511803}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":233511803},{"type":"v1","addr":"172.21.15.172:6823","nonce":233511803}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6820","nonce":233511803},{"type":"v1","addr":"172.21.15.172:6821","nonce":233511803}]},"public_addr":"172.21.15.172:6817/233511803","cluster_addr":"172.21.15.172:6819/233511803","heartbeat_back_addr":"172.21.15.172:6823/233511803","heartbeat_front_addr":"172.21.15.172:6821/233511803","state":["exists","up"]},{"osd":8,"uuid":"36559400-f33e-44e6-868a-316d34da457d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":56,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6816","nonce":290154343},{"type":"v1","addr":"172.21.15.184:6817","nonce":290154343}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6818","nonce":290154343},{"type":"v1","addr":"172.21.15.184:6819","nonce":290154343}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6822","nonce":290154343},{"type":"v1","addr":"172.21.15.184:6823","nonce":290154343}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6820","nonce":290154343},{"type":"v1","addr":"172.21.15.184:6821","nonce":290154343}]},"public_addr":"172.21.15.184:6817/290154343","cluster_addr":"172.21.15.184:6819/290154343","heartbeat_back_addr":"172.21.15.184:6823/290154343","heartbeat_front_addr":"172.21.15.184:6821/290154343","state":["exists","up"]},{"osd":9,"uuid":"d484f111-f36c-4c67-9a8a-ae03e7e0d137","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6826","nonce":3848110906},{"type":"v1","addr":"172.21.15.163:6827","nonce":3848110906}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6828","nonce":3848110906},{"type":"v1","addr":"172.21.15.163:6829","nonce":3848110906}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6832","nonce":3848110906},{"type":"v1","addr":"172.21.15.163:6833","nonce":3848110906}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6830","nonce":3848110906},{"type":"v1","addr":"172.21.15.163:6831","nonce":3848110906}]},"public_addr":"172.21.15.163:6827/3848110906","cluster_addr":"172.21.15.163:6829/3848110906","heartbeat_back_addr":"172.21.15.163:6833/3848110906","heartbeat_front_addr":"172.21.15.163:6831/3848110906","state":["exists","up"]},{"osd":10,"uuid":"d943f7c0-da3d-4605-9e23-0231e675c6be","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6824","nonce":3281085356},{"type":"v1","addr":"172.21.15.172:6825","nonce":3281085356}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":3281085356},{"type":"v1","addr":"172.21.15.172:6827","nonce":3281085356}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":3281085356},{"type":"v1","addr":"172.21.15.172:6831","nonce":3281085356}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6828","nonce":3281085356},{"type":"v1","addr":"172.21.15.172:6829","nonce":3281085356}]},"public_addr":"172.21.15.172:6825/3281085356","cluster_addr":"172.21.15.172:6827/3281085356","heartbeat_back_addr":"172.21.15.172:6831/3281085356","heartbeat_front_addr":"172.21.15.172:6829/3281085356","state":["exists","up"]},{"osd":11,"uuid":"09e610a8-408a-4119-a21b-c4de2810a538","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":75,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6824","nonce":3614578747},{"type":"v1","addr":"172.21.15.184:6825","nonce":3614578747}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6826","nonce":3614578747},{"type":"v1","addr":"172.21.15.184:6827","nonce":3614578747}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6830","nonce":3614578747},{"type":"v1","addr":"172.21.15.184:6831","nonce":3614578747}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6828","nonce":3614578747},{"type":"v1","addr":"172.21.15.184:6829","nonce":3614578747}]},"public_addr":"172.21.15.184:6825/3614578747","cluster_addr":"172.21.15.184:6827/3614578747","heartbeat_back_addr":"172.21.15.184:6831/3614578747","heartbeat_front_addr":"172.21.15.184:6829/3614578747","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T18:06:36.067578+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T18:06:57.095120+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T18:07:17.825363+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T18:07:38.977196+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T18:08:00.108709+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T18:08:20.700646+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T18:08:41.473899+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T18:09:02.856536+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T18:09:23.832722+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T18:09:44.860884+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T18:10:05.520678+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T18:10:26.426315+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.163:6801/1086512093":"2023-07-15T18:05:15.331458+0000","172.21.15.163:6800/1086512093":"2023-07-15T18:05:15.331458+0000","172.21.15.163:0/4235784810":"2023-07-15T18:05:15.331458+0000","172.21.15.163:6800/236891232":"2023-07-15T18:04:53.288443+0000","172.21.15.163:6801/236891232":"2023-07-15T18:04:53.288443+0000","172.21.15.163:0/3260193612":"2023-07-15T18:05:15.331458+0000","172.21.15.163:0/3513629472":"2023-07-15T18:04:53.288443+0000","172.21.15.163:0/1090329830":"2023-07-15T18:04:53.288443+0000","172.21.15.163:0/3868922045":"2023-07-15T18:05:15.331458+0000","172.21.15.163:0/2945662447":"2023-07-15T18:04:53.288443+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-14T18:11:42.882 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:42.842+0000 7fa294953700 1 -- 172.21.15.163:0/2160756146 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7fa2780a11e0 msgr2=0x7fa2780a3690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:11:42.882 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:42.842+0000 7fa294953700 1 --2- 172.21.15.163:0/2160756146 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7fa2780a11e0 0x7fa2780a3690 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fa28000b5c0 tx=0x7fa280005fb0 comp rx=0 tx=0).stop 2023-07-14T18:11:42.882 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:42.842+0000 7fa294953700 1 -- 172.21.15.163:0/2160756146 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fa29010a270 msgr2=0x7fa29019c820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:11:42.882 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:42.842+0000 7fa294953700 1 --2- 172.21.15.163:0/2160756146 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fa29010a270 0x7fa29019c820 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fa288007f10 tx=0x7fa28800d3b0 comp rx=0 tx=0).stop 2023-07-14T18:11:42.882 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:42.842+0000 7fa294953700 1 -- 172.21.15.163:0/2160756146 shutdown_connections 2023-07-14T18:11:42.883 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:42.842+0000 7fa294953700 1 --2- 172.21.15.163:0/2160756146 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7fa2780a11e0 0x7fa2780a3690 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:42.883 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:42.842+0000 7fa294953700 1 --2- 172.21.15.163:0/2160756146 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa290100f20 0x7fa290197ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:42.883 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:42.842+0000 7fa294953700 1 --2- 172.21.15.163:0/2160756146 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fa29010a270 0x7fa29019c820 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:42.883 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:42.842+0000 7fa294953700 1 --2- 172.21.15.163:0/2160756146 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa290101830 0x7fa290198420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:42.883 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:42.842+0000 7fa294953700 1 -- 172.21.15.163:0/2160756146 >> 172.21.15.163:0/2160756146 conn(0x7fa290075ca0 msgr2=0x7fa29010a6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:11:42.883 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:42.842+0000 7fa294953700 1 -- 172.21.15.163:0/2160756146 shutdown_connections 2023-07-14T18:11:42.883 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:42.842+0000 7fa294953700 1 -- 172.21.15.163:0/2160756146 wait complete. 2023-07-14T18:11:43.174 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:11:42 smithi184 ceph-mon[98481]: pgmap v267: 129 pgs: 129 active+clean; 625 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 9.4 KiB/s rd, 7.7 KiB/s wr, 22 op/s 2023-07-14T18:11:43.216 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:11:42 smithi163 ceph-mon[96576]: pgmap v267: 129 pgs: 129 active+clean; 625 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 9.4 KiB/s rd, 7.7 KiB/s wr, 22 op/s 2023-07-14T18:11:43.239 DEBUG:teuthology.orchestra.run.smithi163:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81c9387d2e7576da065747ec9c16d1c7d69016ec shell --fsid bf7326ec-2270-11ee-9b33-001a4aab830c -- ceph tell osd.0 flush_pg_stats 2023-07-14T18:11:43.240 DEBUG:teuthology.orchestra.run.smithi163:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81c9387d2e7576da065747ec9c16d1c7d69016ec shell --fsid bf7326ec-2270-11ee-9b33-001a4aab830c -- ceph tell osd.1 flush_pg_stats 2023-07-14T18:11:43.240 DEBUG:teuthology.orchestra.run.smithi163:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81c9387d2e7576da065747ec9c16d1c7d69016ec shell --fsid bf7326ec-2270-11ee-9b33-001a4aab830c -- ceph tell osd.2 flush_pg_stats 2023-07-14T18:11:43.241 DEBUG:teuthology.orchestra.run.smithi163:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81c9387d2e7576da065747ec9c16d1c7d69016ec shell --fsid bf7326ec-2270-11ee-9b33-001a4aab830c -- ceph tell osd.3 flush_pg_stats 2023-07-14T18:11:43.241 DEBUG:teuthology.orchestra.run.smithi163:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81c9387d2e7576da065747ec9c16d1c7d69016ec shell --fsid bf7326ec-2270-11ee-9b33-001a4aab830c -- ceph tell osd.4 flush_pg_stats 2023-07-14T18:11:43.242 DEBUG:teuthology.orchestra.run.smithi163:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81c9387d2e7576da065747ec9c16d1c7d69016ec shell --fsid bf7326ec-2270-11ee-9b33-001a4aab830c -- ceph tell osd.5 flush_pg_stats 2023-07-14T18:11:43.242 DEBUG:teuthology.orchestra.run.smithi163:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81c9387d2e7576da065747ec9c16d1c7d69016ec shell --fsid bf7326ec-2270-11ee-9b33-001a4aab830c -- ceph tell osd.6 flush_pg_stats 2023-07-14T18:11:43.243 DEBUG:teuthology.orchestra.run.smithi163:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81c9387d2e7576da065747ec9c16d1c7d69016ec shell --fsid bf7326ec-2270-11ee-9b33-001a4aab830c -- ceph tell osd.7 flush_pg_stats 2023-07-14T18:11:43.243 DEBUG:teuthology.orchestra.run.smithi163:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81c9387d2e7576da065747ec9c16d1c7d69016ec shell --fsid bf7326ec-2270-11ee-9b33-001a4aab830c -- ceph tell osd.8 flush_pg_stats 2023-07-14T18:11:43.244 DEBUG:teuthology.orchestra.run.smithi163:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81c9387d2e7576da065747ec9c16d1c7d69016ec shell --fsid bf7326ec-2270-11ee-9b33-001a4aab830c -- ceph tell osd.9 flush_pg_stats 2023-07-14T18:11:43.244 DEBUG:teuthology.orchestra.run.smithi163:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81c9387d2e7576da065747ec9c16d1c7d69016ec shell --fsid bf7326ec-2270-11ee-9b33-001a4aab830c -- ceph tell osd.10 flush_pg_stats 2023-07-14T18:11:43.245 DEBUG:teuthology.orchestra.run.smithi163:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81c9387d2e7576da065747ec9c16d1c7d69016ec shell --fsid bf7326ec-2270-11ee-9b33-001a4aab830c -- ceph tell osd.11 flush_pg_stats 2023-07-14T18:11:43.274 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:11:42 smithi172 ceph-mon[97983]: pgmap v267: 129 pgs: 129 active+clean; 625 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 9.4 KiB/s rd, 7.7 KiB/s wr, 22 op/s 2023-07-14T18:11:44.042 INFO:teuthology.orchestra.run.smithi163.stderr:Inferring config /var/lib/ceph/bf7326ec-2270-11ee-9b33-001a4aab830c/mon.a/config 2023-07-14T18:11:44.115 INFO:teuthology.orchestra.run.smithi163.stderr:Inferring config /var/lib/ceph/bf7326ec-2270-11ee-9b33-001a4aab830c/mon.a/config 2023-07-14T18:11:44.133 INFO:teuthology.orchestra.run.smithi163.stderr:Inferring config /var/lib/ceph/bf7326ec-2270-11ee-9b33-001a4aab830c/mon.a/config 2023-07-14T18:11:44.174 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:11:43 smithi184 ceph-mon[98481]: from='client.? 172.21.15.163:0/2160756146' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-07-14T18:11:44.217 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:11:43 smithi163 ceph-mon[96576]: from='client.? 172.21.15.163:0/2160756146' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-07-14T18:11:44.225 INFO:teuthology.orchestra.run.smithi163.stderr:Inferring config /var/lib/ceph/bf7326ec-2270-11ee-9b33-001a4aab830c/mon.a/config 2023-07-14T18:11:44.226 INFO:teuthology.orchestra.run.smithi163.stderr:Inferring config /var/lib/ceph/bf7326ec-2270-11ee-9b33-001a4aab830c/mon.a/config 2023-07-14T18:11:44.275 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:11:43 smithi172 ceph-mon[97983]: from='client.? 172.21.15.163:0/2160756146' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-07-14T18:11:44.342 INFO:teuthology.orchestra.run.smithi163.stderr:Inferring config /var/lib/ceph/bf7326ec-2270-11ee-9b33-001a4aab830c/mon.a/config 2023-07-14T18:11:44.343 INFO:teuthology.orchestra.run.smithi163.stderr:Inferring config /var/lib/ceph/bf7326ec-2270-11ee-9b33-001a4aab830c/mon.a/config 2023-07-14T18:11:44.504 INFO:teuthology.orchestra.run.smithi163.stderr:Inferring config /var/lib/ceph/bf7326ec-2270-11ee-9b33-001a4aab830c/mon.a/config 2023-07-14T18:11:44.508 INFO:teuthology.orchestra.run.smithi163.stderr:Inferring config /var/lib/ceph/bf7326ec-2270-11ee-9b33-001a4aab830c/mon.a/config 2023-07-14T18:11:44.774 INFO:teuthology.orchestra.run.smithi163.stderr:Inferring config /var/lib/ceph/bf7326ec-2270-11ee-9b33-001a4aab830c/mon.a/config 2023-07-14T18:11:44.867 INFO:teuthology.orchestra.run.smithi163.stderr:Inferring config /var/lib/ceph/bf7326ec-2270-11ee-9b33-001a4aab830c/mon.a/config 2023-07-14T18:11:44.941 INFO:teuthology.orchestra.run.smithi163.stderr:Inferring config /var/lib/ceph/bf7326ec-2270-11ee-9b33-001a4aab830c/mon.a/config 2023-07-14T18:11:45.174 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:11:44 smithi184 ceph-mon[98481]: pgmap v268: 129 pgs: 129 active+clean; 638 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 7.7 KiB/s wr, 20 op/s 2023-07-14T18:11:45.186 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:11:44 smithi163 ceph-mon[96576]: pgmap v268: 129 pgs: 129 active+clean; 638 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 7.7 KiB/s wr, 20 op/s 2023-07-14T18:11:45.275 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:11:44 smithi172 ceph-mon[97983]: pgmap v268: 129 pgs: 129 active+clean; 638 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 7.7 KiB/s wr, 20 op/s 2023-07-14T18:11:47.067 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:11:46 smithi163 ceph-mon[96576]: pgmap v269: 129 pgs: 129 active+clean; 638 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 2.5 KiB/s wr, 12 op/s 2023-07-14T18:11:47.174 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:11:46 smithi184 ceph-mon[98481]: pgmap v269: 129 pgs: 129 active+clean; 638 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 2.5 KiB/s wr, 12 op/s 2023-07-14T18:11:47.275 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:11:46 smithi172 ceph-mon[97983]: pgmap v269: 129 pgs: 129 active+clean; 638 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 2.5 KiB/s wr, 12 op/s 2023-07-14T18:11:48.435 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:48.393+0000 7f0d7715e700 1 -- 172.21.15.163:0/1904803274 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f0d700ff7e0 msgr2=0x7f0d701037b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:11:48.435 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:48.393+0000 7f0d7715e700 1 --2- 172.21.15.163:0/1904803274 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f0d700ff7e0 0x7f0d701037b0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f0d5c0099c0 tx=0x7f0d5c009cd0 comp rx=0 tx=0).stop 2023-07-14T18:11:48.435 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:48.393+0000 7f0d7715e700 1 -- 172.21.15.163:0/1904803274 shutdown_connections 2023-07-14T18:11:48.436 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:48.393+0000 7f0d7715e700 1 --2- 172.21.15.163:0/1904803274 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0d700fee40 0x7f0d700ff210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:48.436 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:48.393+0000 7f0d7715e700 1 --2- 172.21.15.163:0/1904803274 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0d70103ee0 0x7f0d7010ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:48.436 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:48.393+0000 7f0d7715e700 1 --2- 172.21.15.163:0/1904803274 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f0d700ff7e0 0x7f0d701037b0 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:48.436 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:48.393+0000 7f0d7715e700 1 -- 172.21.15.163:0/1904803274 >> 172.21.15.163:0/1904803274 conn(0x7f0d70075ca0 msgr2=0x7f0d700760a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:11:48.436 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:48.393+0000 7f0d7715e700 1 -- 172.21.15.163:0/1904803274 shutdown_connections 2023-07-14T18:11:48.436 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:48.393+0000 7f0d7715e700 1 -- 172.21.15.163:0/1904803274 wait complete. 2023-07-14T18:11:48.437 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:48.394+0000 7f0d7715e700 1 Processor -- start 2023-07-14T18:11:48.437 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:48.394+0000 7f0d7715e700 1 -- start start 2023-07-14T18:11:48.437 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:48.394+0000 7f0d7715e700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0d700fee40 0x7f0d70196b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:11:48.437 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:48.394+0000 7f0d7715e700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f0d700ff7e0 0x7f0d70197050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:11:48.437 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:48.394+0000 7f0d7715e700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0d70103ee0 0x7f0d701a1b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:11:48.437 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:48.394+0000 7f0d7715e700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d70197990 con 0x7f0d700ff7e0 2023-07-14T18:11:48.438 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:48.394+0000 7f0d7715e700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d701a20d0 con 0x7f0d70103ee0 2023-07-14T18:11:48.438 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:48.394+0000 7f0d7715e700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d701a2290 con 0x7f0d700fee40 2023-07-14T18:11:48.438 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:48.394+0000 7f0d6ffff700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f0d700ff7e0 0x7f0d70197050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:11:48.438 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:48.394+0000 7f0d6ffff700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f0d700ff7e0 0x7f0d70197050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:56416/0 (socket says 172.21.15.163:56416) 2023-07-14T18:11:48.438 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:48.394+0000 7f0d6ffff700 1 -- 172.21.15.163:0/3565068425 learned_addr learned my addr 172.21.15.163:0/3565068425 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:11:48.438 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:48.394+0000 7f0d74efa700 1 --2- 172.21.15.163:0/3565068425 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0d700fee40 0x7f0d70196b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:11:48.438 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:48.394+0000 7f0d756fb700 1 --2- 172.21.15.163:0/3565068425 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0d70103ee0 0x7f0d701a1b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:11:48.439 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:48.394+0000 7f0d6ffff700 1 -- 172.21.15.163:0/3565068425 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0d700fee40 msgr2=0x7f0d70196b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:11:48.439 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:48.394+0000 7f0d6ffff700 1 --2- 172.21.15.163:0/3565068425 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0d700fee40 0x7f0d70196b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:48.439 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:48.394+0000 7f0d6ffff700 1 -- 172.21.15.163:0/3565068425 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0d70103ee0 msgr2=0x7f0d701a1b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:11:48.439 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:48.394+0000 7f0d6ffff700 1 --2- 172.21.15.163:0/3565068425 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0d70103ee0 0x7f0d701a1b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:48.439 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:48.395+0000 7f0d6ffff700 1 -- 172.21.15.163:0/3565068425 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d5c0095f0 con 0x7f0d700ff7e0 2023-07-14T18:11:48.440 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:48.395+0000 7f0d756fb700 1 --2- 172.21.15.163:0/3565068425 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0d70103ee0 0x7f0d701a1b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T18:11:48.440 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:48.395+0000 7f0d6ffff700 1 --2- 172.21.15.163:0/3565068425 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f0d700ff7e0 0x7f0d70197050 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f0d5c006010 tx=0x7f0d5c009510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:11:48.440 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:48.395+0000 7f0d6dffb700 1 -- 172.21.15.163:0/3565068425 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d5c01d070 con 0x7f0d700ff7e0 2023-07-14T18:11:48.440 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:48.395+0000 7f0d6dffb700 1 -- 172.21.15.163:0/3565068425 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f0d5c004100 con 0x7f0d700ff7e0 2023-07-14T18:11:48.440 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:48.395+0000 7f0d7715e700 1 -- 172.21.15.163:0/3565068425 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d701a2510 con 0x7f0d700ff7e0 2023-07-14T18:11:48.440 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:48.395+0000 7f0d6dffb700 1 -- 172.21.15.163:0/3565068425 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d5c022d70 con 0x7f0d700ff7e0 2023-07-14T18:11:48.441 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:48.395+0000 7f0d7715e700 1 -- 172.21.15.163:0/3565068425 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d701a2980 con 0x7f0d700ff7e0 2023-07-14T18:11:48.442 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:48.396+0000 7f0d7715e700 1 -- 172.21.15.163:0/3565068425 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f0d7004e340 con 0x7f0d700ff7e0 2023-07-14T18:11:48.442 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:48.397+0000 7f0d6dffb700 1 -- 172.21.15.163:0/3565068425 <== mon.0 v2:172.21.15.163:3300/0 4 ==== mgrmap(e 17) v1 ==== 135767+0+0 (secure 0 0 0) 0x7f0d5c022570 con 0x7f0d700ff7e0 2023-07-14T18:11:48.442 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:48.398+0000 7f0d6dffb700 1 --2- 172.21.15.163:0/3565068425 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f0d600a1260 0x7f0d600a3710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:11:48.442 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:48.398+0000 7f0d74efa700 1 --2- 172.21.15.163:0/3565068425 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f0d600a1260 0x7f0d600a3710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:11:48.442 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:48.398+0000 7f0d6dffb700 1 -- 172.21.15.163:0/3565068425 <== mon.0 v2:172.21.15.163:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 8730+0+0 (secure 0 0 0) 0x7f0d5c0cea30 con 0x7f0d700ff7e0 2023-07-14T18:11:48.442 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:48.398+0000 7f0d6dffb700 1 --2- 172.21.15.163:0/3565068425 >> [v2:172.21.15.163:6826/3848110906,v1:172.21.15.163:6827/3848110906] conn(0x7f0d600abdd0 0x7f0d600ae200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:11:48.442 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:48.398+0000 7f0d6dffb700 1 -- 172.21.15.163:0/3565068425 --> [v2:172.21.15.163:6826/3848110906,v1:172.21.15.163:6827/3848110906] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f0d600ae8d0 con 0x7f0d600abdd0 2023-07-14T18:11:48.443 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:48.398+0000 7f0d6dffb700 1 -- 172.21.15.163:0/3565068425 <== mon.0 v2:172.21.15.163:3300/0 6 ==== mon_get_version_reply(handle=1 version=84) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0d5c0cee40 con 0x7f0d700ff7e0 2023-07-14T18:11:48.443 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:48.398+0000 7f0d756fb700 1 --2- 172.21.15.163:0/3565068425 >> [v2:172.21.15.163:6826/3848110906,v1:172.21.15.163:6827/3848110906] conn(0x7f0d600abdd0 0x7f0d600ae200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:11:48.443 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:48.398+0000 7f0d74efa700 1 --2- 172.21.15.163:0/3565068425 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f0d600a1260 0x7f0d600a3710 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f0d64005950 tx=0x7f0d640058e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:11:48.443 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:48.398+0000 7f0d756fb700 1 --2- 172.21.15.163:0/3565068425 >> [v2:172.21.15.163:6826/3848110906,v1:172.21.15.163:6827/3848110906] conn(0x7f0d600abdd0 0x7f0d600ae200 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.9 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:11:48.443 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:48.399+0000 7f0d6dffb700 1 -- 172.21.15.163:0/3565068425 <== osd.9 v2:172.21.15.163:6826/3848110906 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f0d600ae8d0 con 0x7f0d600abdd0 2023-07-14T18:11:48.454 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:48.414+0000 7f0d7715e700 1 -- 172.21.15.163:0/3565068425 --> [v2:172.21.15.163:6826/3848110906,v1:172.21.15.163:6827/3848110906] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f0d7010ec30 con 0x7f0d600abdd0 2023-07-14T18:11:48.455 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:48.415+0000 7f0d6dffb700 1 -- 172.21.15.163:0/3565068425 <== osd.9 v2:172.21.15.163:6826/3848110906 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7f0d68009900 con 0x7f0d600abdd0 2023-07-14T18:11:48.456 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:48.415+0000 7f0d7715e700 1 -- 172.21.15.163:0/3565068425 >> [v2:172.21.15.163:6826/3848110906,v1:172.21.15.163:6827/3848110906] conn(0x7f0d600abdd0 msgr2=0x7f0d600ae200 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:11:48.456 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:48.415+0000 7f0d7715e700 1 --2- 172.21.15.163:0/3565068425 >> [v2:172.21.15.163:6826/3848110906,v1:172.21.15.163:6827/3848110906] conn(0x7f0d600abdd0 0x7f0d600ae200 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:48.456 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:48.415+0000 7f0d7715e700 1 -- 172.21.15.163:0/3565068425 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f0d600a1260 msgr2=0x7f0d600a3710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:11:48.456 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:48.415+0000 7f0d7715e700 1 --2- 172.21.15.163:0/3565068425 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f0d600a1260 0x7f0d600a3710 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f0d64005950 tx=0x7f0d640058e0 comp rx=0 tx=0).stop 2023-07-14T18:11:48.456 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:48.415+0000 7f0d7715e700 1 -- 172.21.15.163:0/3565068425 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f0d700ff7e0 msgr2=0x7f0d70197050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:11:48.456 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:48.415+0000 7f0d7715e700 1 --2- 172.21.15.163:0/3565068425 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f0d700ff7e0 0x7f0d70197050 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f0d5c006010 tx=0x7f0d5c009510 comp rx=0 tx=0).stop 2023-07-14T18:11:48.456 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:48.415+0000 7f0d756fb700 1 -- 172.21.15.163:0/3565068425 reap_dead start 2023-07-14T18:11:48.457 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:48.415+0000 7f0d7715e700 1 -- 172.21.15.163:0/3565068425 shutdown_connections 2023-07-14T18:11:48.457 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:48.415+0000 7f0d7715e700 1 -- 172.21.15.163:0/3565068425 >> 172.21.15.163:0/3565068425 conn(0x7f0d70075ca0 msgr2=0x7f0d700fc4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:11:48.457 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:48.415+0000 7f0d7715e700 1 -- 172.21.15.163:0/3565068425 shutdown_connections 2023-07-14T18:11:48.457 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:48.415+0000 7f0d7715e700 1 -- 172.21.15.163:0/3565068425 wait complete. 2023-07-14T18:11:49.140 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:11:48 smithi163 ceph-mon[96576]: pgmap v270: 129 pgs: 129 active+clean; 638 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 1.7 KiB/s wr, 9 op/s 2023-07-14T18:11:49.174 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:11:48 smithi184 ceph-mon[98481]: pgmap v270: 129 pgs: 129 active+clean; 638 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 1.7 KiB/s wr, 9 op/s 2023-07-14T18:11:49.275 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:11:48 smithi172 ceph-mon[97983]: pgmap v270: 129 pgs: 129 active+clean; 638 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 1.7 KiB/s wr, 9 op/s 2023-07-14T18:11:50.252 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:50.091+0000 7f59a3b6b700 1 -- 172.21.15.163:0/2648023432 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f599c10c660 msgr2=0x7f599c10ea40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:11:50.252 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:50.091+0000 7f59a3b6b700 1 --2- 172.21.15.163:0/2648023432 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f599c10c660 0x7f599c10ea40 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f599400b0a0 tx=0x7f599400b3b0 comp rx=0 tx=0).stop 2023-07-14T18:11:50.252 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:50.091+0000 7f59a3b6b700 1 -- 172.21.15.163:0/2648023432 shutdown_connections 2023-07-14T18:11:50.252 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:50.091+0000 7f59a3b6b700 1 --2- 172.21.15.163:0/2648023432 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f599c10c660 0x7f599c10ea40 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:50.252 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:50.091+0000 7f59a3b6b700 1 --2- 172.21.15.163:0/2648023432 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f599c0feab0 0x7f599c0fee80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:50.253 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:50.091+0000 7f59a3b6b700 1 --2- 172.21.15.163:0/2648023432 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f599c0ff3c0 0x7f599c10c120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:50.253 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:50.091+0000 7f59a3b6b700 1 -- 172.21.15.163:0/2648023432 >> 172.21.15.163:0/2648023432 conn(0x7f599c075ca0 msgr2=0x7f599c0760a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:11:50.253 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:50.092+0000 7f59a3b6b700 1 -- 172.21.15.163:0/2648023432 shutdown_connections 2023-07-14T18:11:50.253 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:50.092+0000 7f59a3b6b700 1 -- 172.21.15.163:0/2648023432 wait complete. 2023-07-14T18:11:50.253 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:50.092+0000 7f59a3b6b700 1 Processor -- start 2023-07-14T18:11:50.253 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:50.092+0000 7f59a3b6b700 1 -- start start 2023-07-14T18:11:50.253 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:50.093+0000 7f59a3b6b700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f599c0feab0 0x7f599c197ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:11:50.254 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:50.093+0000 7f59a3b6b700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f599c0ff3c0 0x7f599c198530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:11:50.254 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:50.093+0000 7f59a3b6b700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f599c10c660 0x7f599c19c9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:11:50.254 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:50.093+0000 7f59a3b6b700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f599c19cfb0 con 0x7f599c10c660 2023-07-14T18:11:50.254 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:50.093+0000 7f59a3b6b700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f599c19d120 con 0x7f599c0ff3c0 2023-07-14T18:11:50.254 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:50.093+0000 7f59a3b6b700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f599c19d2e0 con 0x7f599c0feab0 2023-07-14T18:11:50.254 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:50.093+0000 7f59a2108700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f599c10c660 0x7f599c19c9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:11:50.254 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:50.093+0000 7f59a2108700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f599c10c660 0x7f599c19c9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:56434/0 (socket says 172.21.15.163:56434) 2023-07-14T18:11:50.254 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:50.093+0000 7f59a2108700 1 -- 172.21.15.163:0/2683370364 learned_addr learned my addr 172.21.15.163:0/2683370364 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:11:50.255 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:50.093+0000 7f59a1106700 1 --2- 172.21.15.163:0/2683370364 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f599c0ff3c0 0x7f599c198530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:11:50.255 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:50.093+0000 7f59a1907700 1 --2- 172.21.15.163:0/2683370364 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f599c0feab0 0x7f599c197ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:11:50.255 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:50.093+0000 7f59a2108700 1 -- 172.21.15.163:0/2683370364 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f599c0feab0 msgr2=0x7f599c197ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:11:50.255 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:50.093+0000 7f59a2108700 1 --2- 172.21.15.163:0/2683370364 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f599c0feab0 0x7f599c197ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:50.255 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:50.093+0000 7f59a2108700 1 -- 172.21.15.163:0/2683370364 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f599c0ff3c0 msgr2=0x7f599c198530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:11:50.255 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:50.093+0000 7f59a2108700 1 --2- 172.21.15.163:0/2683370364 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f599c0ff3c0 0x7f599c198530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:50.255 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:50.093+0000 7f59a2108700 1 -- 172.21.15.163:0/2683370364 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5994009d00 con 0x7f599c10c660 2023-07-14T18:11:50.255 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:50.093+0000 7f59a2108700 1 --2- 172.21.15.163:0/2683370364 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f599c10c660 0x7f599c19c9a0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f5994009440 tx=0x7f5994009520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:11:50.256 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:50.094+0000 7f5992ffd700 1 -- 172.21.15.163:0/2683370364 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f599400e040 con 0x7f599c10c660 2023-07-14T18:11:50.256 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:50.094+0000 7f5992ffd700 1 -- 172.21.15.163:0/2683370364 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f599401b8e0 con 0x7f599c10c660 2023-07-14T18:11:50.256 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:50.094+0000 7f59a3b6b700 1 -- 172.21.15.163:0/2683370364 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f599c19d560 con 0x7f599c10c660 2023-07-14T18:11:50.256 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:50.094+0000 7f5992ffd700 1 -- 172.21.15.163:0/2683370364 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5994005550 con 0x7f599c10c660 2023-07-14T18:11:50.256 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:50.094+0000 7f59a3b6b700 1 -- 172.21.15.163:0/2683370364 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f599c1a4e20 con 0x7f599c10c660 2023-07-14T18:11:50.256 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:50.095+0000 7f59a3b6b700 1 -- 172.21.15.163:0/2683370364 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f599c111f50 con 0x7f599c10c660 2023-07-14T18:11:50.256 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:50.096+0000 7f5992ffd700 1 -- 172.21.15.163:0/2683370364 <== mon.0 v2:172.21.15.163:3300/0 4 ==== mgrmap(e 17) v1 ==== 135767+0+0 (secure 0 0 0) 0x7f599401ba50 con 0x7f599c10c660 2023-07-14T18:11:50.257 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:50.097+0000 7f5992ffd700 1 --2- 172.21.15.163:0/2683370364 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f59880a1260 0x7f59880a3710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:11:50.257 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:50.097+0000 7f59a1907700 1 --2- 172.21.15.163:0/2683370364 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f59880a1260 0x7f59880a3710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:11:50.257 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:50.097+0000 7f5992ffd700 1 -- 172.21.15.163:0/2683370364 <== mon.0 v2:172.21.15.163:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 8730+0+0 (secure 0 0 0) 0x7f59940ce900 con 0x7f599c10c660 2023-07-14T18:11:50.257 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:50.098+0000 7f5992ffd700 1 --2- 172.21.15.163:0/2683370364 >> [v2:172.21.15.172:6824/3281085356,v1:172.21.15.172:6825/3281085356] conn(0x7f59880abdd0 0x7f59880ae200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:11:50.257 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:50.098+0000 7f5992ffd700 1 -- 172.21.15.163:0/2683370364 --> [v2:172.21.15.172:6824/3281085356,v1:172.21.15.172:6825/3281085356] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f59880ae8d0 con 0x7f59880abdd0 2023-07-14T18:11:50.257 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:50.098+0000 7f5992ffd700 1 -- 172.21.15.163:0/2683370364 <== mon.0 v2:172.21.15.163:3300/0 6 ==== mon_get_version_reply(handle=1 version=84) v2 ==== 24+0+0 (secure 0 0 0) 0x7f59940ced00 con 0x7f599c10c660 2023-07-14T18:11:50.257 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:50.098+0000 7f59a1907700 1 --2- 172.21.15.163:0/2683370364 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f59880a1260 0x7f59880a3710 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f5998005950 tx=0x7f59980058e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:11:50.257 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:50.098+0000 7f59a1106700 1 --2- 172.21.15.163:0/2683370364 >> [v2:172.21.15.172:6824/3281085356,v1:172.21.15.172:6825/3281085356] conn(0x7f59880abdd0 0x7f59880ae200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:11:50.258 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:50.098+0000 7f59a1106700 1 --2- 172.21.15.163:0/2683370364 >> [v2:172.21.15.172:6824/3281085356,v1:172.21.15.172:6825/3281085356] conn(0x7f59880abdd0 0x7f59880ae200 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.10 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:11:50.258 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:50.099+0000 7f5992ffd700 1 -- 172.21.15.163:0/2683370364 <== osd.10 v2:172.21.15.172:6824/3281085356 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f59880ae8d0 con 0x7f59880abdd0 2023-07-14T18:11:50.258 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:50.123+0000 7f59a3b6b700 1 -- 172.21.15.163:0/2683370364 --> [v2:172.21.15.172:6824/3281085356,v1:172.21.15.172:6825/3281085356] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f599c04e340 con 0x7f59880abdd0 2023-07-14T18:11:50.258 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:50.124+0000 7f5992ffd700 1 -- 172.21.15.163:0/2683370364 <== osd.10 v2:172.21.15.172:6824/3281085356 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7f599c04e340 con 0x7f59880abdd0 2023-07-14T18:11:50.258 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:50.124+0000 7f59a3b6b700 1 -- 172.21.15.163:0/2683370364 >> [v2:172.21.15.172:6824/3281085356,v1:172.21.15.172:6825/3281085356] conn(0x7f59880abdd0 msgr2=0x7f59880ae200 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:11:50.259 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:50.124+0000 7f59a3b6b700 1 --2- 172.21.15.163:0/2683370364 >> [v2:172.21.15.172:6824/3281085356,v1:172.21.15.172:6825/3281085356] conn(0x7f59880abdd0 0x7f59880ae200 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:50.259 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:50.124+0000 7f59a3b6b700 1 -- 172.21.15.163:0/2683370364 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f59880a1260 msgr2=0x7f59880a3710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:11:50.259 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:50.124+0000 7f59a3b6b700 1 --2- 172.21.15.163:0/2683370364 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f59880a1260 0x7f59880a3710 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f5998005950 tx=0x7f59980058e0 comp rx=0 tx=0).stop 2023-07-14T18:11:50.259 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:50.124+0000 7f59a3b6b700 1 -- 172.21.15.163:0/2683370364 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f599c10c660 msgr2=0x7f599c19c9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:11:50.259 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:50.124+0000 7f59a3b6b700 1 --2- 172.21.15.163:0/2683370364 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f599c10c660 0x7f599c19c9a0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f5994009440 tx=0x7f5994009520 comp rx=0 tx=0).stop 2023-07-14T18:11:50.259 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:50.124+0000 7f59a2108700 1 -- 172.21.15.163:0/2683370364 reap_dead start 2023-07-14T18:11:50.259 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:50.124+0000 7f59a3b6b700 1 -- 172.21.15.163:0/2683370364 shutdown_connections 2023-07-14T18:11:50.260 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:50.124+0000 7f59a3b6b700 1 -- 172.21.15.163:0/2683370364 >> 172.21.15.163:0/2683370364 conn(0x7f599c075ca0 msgr2=0x7f599c0fc4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:11:50.260 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:50.124+0000 7f59a3b6b700 1 -- 172.21.15.163:0/2683370364 shutdown_connections 2023-07-14T18:11:50.260 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:50.124+0000 7f59a3b6b700 1 -- 172.21.15.163:0/2683370364 wait complete. 2023-07-14T18:11:50.316 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:50.169+0000 7faef3cbc700 1 -- 172.21.15.163:0/1784859360 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7faeec0fee20 msgr2=0x7faeec0ff1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:11:50.316 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:50.169+0000 7faef3cbc700 1 --2- 172.21.15.163:0/1784859360 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7faeec0fee20 0x7faeec0ff1f0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7faedc0099c0 tx=0x7faedc009cd0 comp rx=0 tx=0).stop 2023-07-14T18:11:50.316 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:50.169+0000 7faef3cbc700 1 -- 172.21.15.163:0/1784859360 shutdown_connections 2023-07-14T18:11:50.317 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:50.169+0000 7faef3cbc700 1 --2- 172.21.15.163:0/1784859360 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7faeec103ec0 0x7faeec10ba40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:50.317 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:50.169+0000 7faef3cbc700 1 --2- 172.21.15.163:0/1784859360 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7faeec0fee20 0x7faeec0ff1f0 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:50.317 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:50.169+0000 7faef3cbc700 1 --2- 172.21.15.163:0/1784859360 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7faeec0ff7c0 0x7faeec103790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:50.317 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:50.169+0000 7faef3cbc700 1 -- 172.21.15.163:0/1784859360 >> 172.21.15.163:0/1784859360 conn(0x7faeec0fa6a0 msgr2=0x7faeec0fcab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:11:50.317 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:50.169+0000 7faef3cbc700 1 -- 172.21.15.163:0/1784859360 shutdown_connections 2023-07-14T18:11:50.317 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:50.169+0000 7faef3cbc700 1 -- 172.21.15.163:0/1784859360 wait complete. 2023-07-14T18:11:50.317 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:50.169+0000 7faef3cbc700 1 Processor -- start 2023-07-14T18:11:50.318 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:50.170+0000 7faef3cbc700 1 -- start start 2023-07-14T18:11:50.318 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:50.170+0000 7faef3cbc700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7faeec0fee20 0x7faeec19a930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:11:50.318 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:50.170+0000 7faef3cbc700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7faeec0ff7c0 0x7faeec19ae70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:11:50.318 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:50.170+0000 7faef3cbc700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7faeec103ec0 0x7faeec1949b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:11:50.318 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:50.170+0000 7faef3cbc700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faeec195020 con 0x7faeec103ec0 2023-07-14T18:11:50.318 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:50.170+0000 7faef3cbc700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faeec195190 con 0x7faeec0ff7c0 2023-07-14T18:11:50.318 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:50.170+0000 7faef3cbc700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faeec195350 con 0x7faeec0fee20 2023-07-14T18:11:50.318 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:50.170+0000 7faef2259700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7faeec103ec0 0x7faeec1949b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:11:50.319 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:50.170+0000 7faef2259700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7faeec103ec0 0x7faeec1949b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:56450/0 (socket says 172.21.15.163:56450) 2023-07-14T18:11:50.319 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:50.170+0000 7faef2259700 1 -- 172.21.15.163:0/1017826205 learned_addr learned my addr 172.21.15.163:0/1017826205 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:11:50.319 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:50.170+0000 7faef1a58700 1 --2- 172.21.15.163:0/1017826205 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7faeec0fee20 0x7faeec19a930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:11:50.319 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:50.170+0000 7faef1257700 1 --2- 172.21.15.163:0/1017826205 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7faeec0ff7c0 0x7faeec19ae70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:11:50.319 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:50.170+0000 7faef2259700 1 -- 172.21.15.163:0/1017826205 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7faeec0fee20 msgr2=0x7faeec19a930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:11:50.319 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:50.170+0000 7faef2259700 1 --2- 172.21.15.163:0/1017826205 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7faeec0fee20 0x7faeec19a930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:50.319 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:50.170+0000 7faef2259700 1 -- 172.21.15.163:0/1017826205 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7faeec0ff7c0 msgr2=0x7faeec19ae70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:11:50.320 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:50.170+0000 7faef2259700 1 --2- 172.21.15.163:0/1017826205 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7faeec0ff7c0 0x7faeec19ae70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:50.320 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:50.170+0000 7faef2259700 1 -- 172.21.15.163:0/1017826205 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faedc0095f0 con 0x7faeec103ec0 2023-07-14T18:11:50.320 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:50.170+0000 7faef2259700 1 --2- 172.21.15.163:0/1017826205 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7faeec103ec0 0x7faeec1949b0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7faee400e580 tx=0x7faee400e890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:11:50.320 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:50.171+0000 7faee2ffd700 1 -- 172.21.15.163:0/1017826205 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faee4004db0 con 0x7faeec103ec0 2023-07-14T18:11:50.320 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:50.171+0000 7faee2ffd700 1 -- 172.21.15.163:0/1017826205 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7faee4003e90 con 0x7faeec103ec0 2023-07-14T18:11:50.320 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:50.171+0000 7faef3cbc700 1 -- 172.21.15.163:0/1017826205 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faeec195630 con 0x7faeec103ec0 2023-07-14T18:11:50.320 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:50.171+0000 7faee2ffd700 1 -- 172.21.15.163:0/1017826205 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faee4004490 con 0x7faeec103ec0 2023-07-14T18:11:50.320 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:50.171+0000 7faef3cbc700 1 -- 172.21.15.163:0/1017826205 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faeec068c70 con 0x7faeec103ec0 2023-07-14T18:11:50.321 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:50.171+0000 7faef3cbc700 1 -- 172.21.15.163:0/1017826205 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7faeec10ebe0 con 0x7faeec103ec0 2023-07-14T18:11:50.321 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:50.173+0000 7faee2ffd700 1 -- 172.21.15.163:0/1017826205 <== mon.0 v2:172.21.15.163:3300/0 4 ==== mgrmap(e 17) v1 ==== 135767+0+0 (secure 0 0 0) 0x7faee40046f0 con 0x7faeec103ec0 2023-07-14T18:11:50.321 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:50.173+0000 7faee2ffd700 1 --2- 172.21.15.163:0/1017826205 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7faed80a11e0 0x7faed80a3690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:11:50.321 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:50.173+0000 7faee2ffd700 1 -- 172.21.15.163:0/1017826205 <== mon.0 v2:172.21.15.163:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 8730+0+0 (secure 0 0 0) 0x7faee4016070 con 0x7faeec103ec0 2023-07-14T18:11:50.322 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:50.173+0000 7faef1a58700 1 --2- 172.21.15.163:0/1017826205 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7faed80a11e0 0x7faed80a3690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:11:50.322 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:50.173+0000 7faee2ffd700 1 --2- 172.21.15.163:0/1017826205 >> [v2:172.21.15.172:6800/3774455900,v1:172.21.15.172:6801/3774455900] conn(0x7faed80abd50 0x7faed80ae180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:11:50.322 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:50.173+0000 7faee2ffd700 1 -- 172.21.15.163:0/1017826205 --> [v2:172.21.15.172:6800/3774455900,v1:172.21.15.172:6801/3774455900] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7faed80ae850 con 0x7faed80abd50 2023-07-14T18:11:50.322 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:50.173+0000 7faee2ffd700 1 -- 172.21.15.163:0/1017826205 <== mon.0 v2:172.21.15.163:3300/0 6 ==== mon_get_version_reply(handle=1 version=84) v2 ==== 24+0+0 (secure 0 0 0) 0x7faee40cf140 con 0x7faeec103ec0 2023-07-14T18:11:50.322 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:50.173+0000 7faef1a58700 1 --2- 172.21.15.163:0/1017826205 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7faed80a11e0 0x7faed80a3690 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7faedc00b580 tx=0x7faedc005c00 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:11:50.322 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:50.174+0000 7faef1257700 1 --2- 172.21.15.163:0/1017826205 >> [v2:172.21.15.172:6800/3774455900,v1:172.21.15.172:6801/3774455900] conn(0x7faed80abd50 0x7faed80ae180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:11:50.322 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:50.174+0000 7faef1257700 1 --2- 172.21.15.163:0/1017826205 >> [v2:172.21.15.172:6800/3774455900,v1:172.21.15.172:6801/3774455900] conn(0x7faed80abd50 0x7faed80ae180 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:11:50.322 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:50.175+0000 7faee2ffd700 1 -- 172.21.15.163:0/1017826205 <== osd.1 v2:172.21.15.172:6800/3774455900 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7faed80ae850 con 0x7faed80abd50 2023-07-14T18:11:50.323 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:50.190+0000 7faef3cbc700 1 -- 172.21.15.163:0/1017826205 --> [v2:172.21.15.172:6800/3774455900,v1:172.21.15.172:6801/3774455900] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7faeec0fbb80 con 0x7faed80abd50 2023-07-14T18:11:50.323 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:50.191+0000 7faee2ffd700 1 -- 172.21.15.163:0/1017826205 <== osd.1 v2:172.21.15.172:6800/3774455900 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7faeec0fbb80 con 0x7faed80abd50 2023-07-14T18:11:50.323 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:50.191+0000 7faef3cbc700 1 -- 172.21.15.163:0/1017826205 >> [v2:172.21.15.172:6800/3774455900,v1:172.21.15.172:6801/3774455900] conn(0x7faed80abd50 msgr2=0x7faed80ae180 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:11:50.323 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:50.191+0000 7faef3cbc700 1 --2- 172.21.15.163:0/1017826205 >> [v2:172.21.15.172:6800/3774455900,v1:172.21.15.172:6801/3774455900] conn(0x7faed80abd50 0x7faed80ae180 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:50.323 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:50.191+0000 7faef3cbc700 1 -- 172.21.15.163:0/1017826205 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7faed80a11e0 msgr2=0x7faed80a3690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:11:50.323 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:50.191+0000 7faef3cbc700 1 --2- 172.21.15.163:0/1017826205 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7faed80a11e0 0x7faed80a3690 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7faedc00b580 tx=0x7faedc005c00 comp rx=0 tx=0).stop 2023-07-14T18:11:50.323 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:50.191+0000 7faef3cbc700 1 -- 172.21.15.163:0/1017826205 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7faeec103ec0 msgr2=0x7faeec1949b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:11:50.324 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:50.191+0000 7faef3cbc700 1 --2- 172.21.15.163:0/1017826205 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7faeec103ec0 0x7faeec1949b0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7faee400e580 tx=0x7faee400e890 comp rx=0 tx=0).stop 2023-07-14T18:11:50.324 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:50.191+0000 7faef2259700 1 -- 172.21.15.163:0/1017826205 reap_dead start 2023-07-14T18:11:50.324 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:50.192+0000 7faef3cbc700 1 -- 172.21.15.163:0/1017826205 shutdown_connections 2023-07-14T18:11:50.324 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:50.192+0000 7faef3cbc700 1 -- 172.21.15.163:0/1017826205 >> 172.21.15.163:0/1017826205 conn(0x7faeec0fa6a0 msgr2=0x7faeec0fb1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:11:50.324 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:50.192+0000 7faef3cbc700 1 -- 172.21.15.163:0/1017826205 shutdown_connections 2023-07-14T18:11:50.324 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:50.192+0000 7faef3cbc700 1 -- 172.21.15.163:0/1017826205 wait complete. 2023-07-14T18:11:50.898 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:11:50 smithi163 ceph-mon[96576]: pgmap v271: 129 pgs: 129 active+clean; 638 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 7.8 KiB/s rd, 1.7 KiB/s wr, 12 op/s 2023-07-14T18:11:51.174 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:11:50 smithi184 ceph-mon[98481]: pgmap v271: 129 pgs: 129 active+clean; 638 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 7.8 KiB/s rd, 1.7 KiB/s wr, 12 op/s 2023-07-14T18:11:51.225 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:51.184+0000 7fce65281700 1 -- 172.21.15.163:0/3654738018 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fce600febc0 msgr2=0x7fce6010cb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:11:51.225 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:51.184+0000 7fce65281700 1 --2- 172.21.15.163:0/3654738018 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fce600febc0 0x7fce6010cb30 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fce5800b0a0 tx=0x7fce5800b3b0 comp rx=0 tx=0).stop 2023-07-14T18:11:51.225 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:51.184+0000 7fce65281700 1 -- 172.21.15.163:0/3654738018 shutdown_connections 2023-07-14T18:11:51.226 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:51.184+0000 7fce65281700 1 --2- 172.21.15.163:0/3654738018 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fce600febc0 0x7fce6010cb30 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:51.226 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:51.184+0000 7fce65281700 1 --2- 172.21.15.163:0/3654738018 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fce60104c70 0x7fce60105040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:51.226 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:51.184+0000 7fce65281700 1 --2- 172.21.15.163:0/3654738018 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fce600fe210 0x7fce600fe680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:51.227 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:51.184+0000 7fce65281700 1 -- 172.21.15.163:0/3654738018 >> 172.21.15.163:0/3654738018 conn(0x7fce60075280 msgr2=0x7fce60075680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:11:51.227 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:51.184+0000 7fce65281700 1 -- 172.21.15.163:0/3654738018 shutdown_connections 2023-07-14T18:11:51.227 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:51.184+0000 7fce65281700 1 -- 172.21.15.163:0/3654738018 wait complete. 2023-07-14T18:11:51.231 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:51.185+0000 7fce65281700 1 Processor -- start 2023-07-14T18:11:51.231 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:51.185+0000 7fce65281700 1 -- start start 2023-07-14T18:11:51.232 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:51.186+0000 7fce65281700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fce600fe210 0x7fce600ff3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:11:51.232 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:51.186+0000 7fce65281700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fce600febc0 0x7fce600ff930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:11:51.232 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:51.186+0000 7fce65281700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fce60104c70 0x7fce601a3fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:11:51.233 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:51.186+0000 7fce65281700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce60100220 con 0x7fce600fe210 2023-07-14T18:11:51.233 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:51.186+0000 7fce65281700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce601a4520 con 0x7fce600febc0 2023-07-14T18:11:51.233 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:51.186+0000 7fce65281700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce601a4690 con 0x7fce60104c70 2023-07-14T18:11:51.233 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:51.186+0000 7fce5effd700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fce600fe210 0x7fce600ff3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:11:51.233 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:51.186+0000 7fce5effd700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fce600fe210 0x7fce600ff3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:56458/0 (socket says 172.21.15.163:56458) 2023-07-14T18:11:51.234 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:51.186+0000 7fce5effd700 1 -- 172.21.15.163:0/1255171062 learned_addr learned my addr 172.21.15.163:0/1255171062 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:11:51.234 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:51.186+0000 7fce5e7fc700 1 --2- 172.21.15.163:0/1255171062 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fce600febc0 0x7fce600ff930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:11:51.234 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:51.186+0000 7fce5f7fe700 1 --2- 172.21.15.163:0/1255171062 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fce60104c70 0x7fce601a3fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:11:51.234 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:51.186+0000 7fce5effd700 1 -- 172.21.15.163:0/1255171062 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fce60104c70 msgr2=0x7fce601a3fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:11:51.235 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:51.186+0000 7fce5effd700 1 --2- 172.21.15.163:0/1255171062 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fce60104c70 0x7fce601a3fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:51.235 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:51.186+0000 7fce5effd700 1 -- 172.21.15.163:0/1255171062 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fce600febc0 msgr2=0x7fce600ff930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:11:51.235 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:51.186+0000 7fce5effd700 1 --2- 172.21.15.163:0/1255171062 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fce600febc0 0x7fce600ff930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:51.236 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:51.186+0000 7fce5effd700 1 -- 172.21.15.163:0/1255171062 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce58009d00 con 0x7fce600fe210 2023-07-14T18:11:51.236 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:51.186+0000 7fce5effd700 1 --2- 172.21.15.163:0/1255171062 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fce600fe210 0x7fce600ff3f0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fce5000d980 tx=0x7fce5000dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:11:51.236 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:51.186+0000 7fce47fff700 1 -- 172.21.15.163:0/1255171062 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce50004220 con 0x7fce600fe210 2023-07-14T18:11:51.236 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:51.186+0000 7fce65281700 1 -- 172.21.15.163:0/1255171062 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fce601a4910 con 0x7fce600fe210 2023-07-14T18:11:51.236 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:51.186+0000 7fce47fff700 1 -- 172.21.15.163:0/1255171062 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fce50007640 con 0x7fce600fe210 2023-07-14T18:11:51.236 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:51.187+0000 7fce47fff700 1 -- 172.21.15.163:0/1255171062 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce500055e0 con 0x7fce600fe210 2023-07-14T18:11:51.237 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:51.187+0000 7fce65281700 1 -- 172.21.15.163:0/1255171062 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fce601a4e60 con 0x7fce600fe210 2023-07-14T18:11:51.237 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:51.187+0000 7fce65281700 1 -- 172.21.15.163:0/1255171062 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fce6010fe30 con 0x7fce600fe210 2023-07-14T18:11:51.237 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:51.189+0000 7fce47fff700 1 -- 172.21.15.163:0/1255171062 <== mon.0 v2:172.21.15.163:3300/0 4 ==== mgrmap(e 17) v1 ==== 135767+0+0 (secure 0 0 0) 0x7fce50004750 con 0x7fce600fe210 2023-07-14T18:11:51.237 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:51.189+0000 7fce47fff700 1 --2- 172.21.15.163:0/1255171062 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7fce480a11e0 0x7fce480a3690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:11:51.237 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:51.189+0000 7fce47fff700 1 -- 172.21.15.163:0/1255171062 <== mon.0 v2:172.21.15.163:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 8730+0+0 (secure 0 0 0) 0x7fce500cd060 con 0x7fce600fe210 2023-07-14T18:11:51.237 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:51.189+0000 7fce5e7fc700 1 --2- 172.21.15.163:0/1255171062 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7fce480a11e0 0x7fce480a3690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:11:51.237 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:51.190+0000 7fce47fff700 1 --2- 172.21.15.163:0/1255171062 >> [v2:172.21.15.172:6808/3319632614,v1:172.21.15.172:6809/3319632614] conn(0x7fce480abcd0 0x7fce480ae100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:11:51.238 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:51.190+0000 7fce47fff700 1 -- 172.21.15.163:0/1255171062 --> [v2:172.21.15.172:6808/3319632614,v1:172.21.15.172:6809/3319632614] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fce480ae7d0 con 0x7fce480abcd0 2023-07-14T18:11:51.238 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:51.190+0000 7fce47fff700 1 -- 172.21.15.163:0/1255171062 <== mon.0 v2:172.21.15.163:3300/0 6 ==== mon_get_version_reply(handle=1 version=84) v2 ==== 24+0+0 (secure 0 0 0) 0x7fce500cd470 con 0x7fce600fe210 2023-07-14T18:11:51.238 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:51.190+0000 7fce5e7fc700 1 --2- 172.21.15.163:0/1255171062 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7fce480a11e0 0x7fce480a3690 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fce60100be0 tx=0x7fce5400b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:11:51.238 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:51.190+0000 7fce5f7fe700 1 --2- 172.21.15.163:0/1255171062 >> [v2:172.21.15.172:6808/3319632614,v1:172.21.15.172:6809/3319632614] conn(0x7fce480abcd0 0x7fce480ae100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:11:51.238 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:51.190+0000 7fce5f7fe700 1 --2- 172.21.15.163:0/1255171062 >> [v2:172.21.15.172:6808/3319632614,v1:172.21.15.172:6809/3319632614] conn(0x7fce480abcd0 0x7fce480ae100 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:11:51.238 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:51.191+0000 7fce47fff700 1 -- 172.21.15.163:0/1255171062 <== osd.4 v2:172.21.15.172:6808/3319632614 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7fce480ae7d0 con 0x7fce480abcd0 2023-07-14T18:11:51.247 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:51.207+0000 7fce65281700 1 -- 172.21.15.163:0/1255171062 --> [v2:172.21.15.172:6808/3319632614,v1:172.21.15.172:6809/3319632614] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fce6004e340 con 0x7fce480abcd0 2023-07-14T18:11:51.247 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:51.207+0000 7fce47fff700 1 -- 172.21.15.163:0/1255171062 <== osd.4 v2:172.21.15.172:6808/3319632614 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7fce6004e340 con 0x7fce480abcd0 2023-07-14T18:11:51.248 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:51.208+0000 7fce65281700 1 -- 172.21.15.163:0/1255171062 >> [v2:172.21.15.172:6808/3319632614,v1:172.21.15.172:6809/3319632614] conn(0x7fce480abcd0 msgr2=0x7fce480ae100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:11:51.248 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:51.208+0000 7fce65281700 1 --2- 172.21.15.163:0/1255171062 >> [v2:172.21.15.172:6808/3319632614,v1:172.21.15.172:6809/3319632614] conn(0x7fce480abcd0 0x7fce480ae100 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:51.248 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:51.208+0000 7fce65281700 1 -- 172.21.15.163:0/1255171062 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7fce480a11e0 msgr2=0x7fce480a3690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:11:51.249 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:51.208+0000 7fce65281700 1 --2- 172.21.15.163:0/1255171062 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7fce480a11e0 0x7fce480a3690 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fce60100be0 tx=0x7fce5400b410 comp rx=0 tx=0).stop 2023-07-14T18:11:51.249 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:51.208+0000 7fce65281700 1 -- 172.21.15.163:0/1255171062 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fce600fe210 msgr2=0x7fce600ff3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:11:51.249 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:51.208+0000 7fce65281700 1 --2- 172.21.15.163:0/1255171062 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fce600fe210 0x7fce600ff3f0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fce5000d980 tx=0x7fce5000dc90 comp rx=0 tx=0).stop 2023-07-14T18:11:51.249 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:51.208+0000 7fce5f7fe700 1 -- 172.21.15.163:0/1255171062 reap_dead start 2023-07-14T18:11:51.249 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:51.208+0000 7fce65281700 1 -- 172.21.15.163:0/1255171062 shutdown_connections 2023-07-14T18:11:51.249 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:51.208+0000 7fce65281700 1 -- 172.21.15.163:0/1255171062 >> 172.21.15.163:0/1255171062 conn(0x7fce60075280 msgr2=0x7fce600fca00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:11:51.249 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:51.208+0000 7fce65281700 1 -- 172.21.15.163:0/1255171062 shutdown_connections 2023-07-14T18:11:51.250 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:51.208+0000 7fce65281700 1 -- 172.21.15.163:0/1255171062 wait complete. 2023-07-14T18:11:51.275 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:11:50 smithi172 ceph-mon[97983]: pgmap v271: 129 pgs: 129 active+clean; 638 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 7.8 KiB/s rd, 1.7 KiB/s wr, 12 op/s 2023-07-14T18:11:51.294 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:51.254+0000 7f3669bae700 1 -- 172.21.15.163:0/1098605493 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f3664103ee0 msgr2=0x7f366410ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:11:51.294 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:51.254+0000 7f3669bae700 1 --2- 172.21.15.163:0/1098605493 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f3664103ee0 0x7f366410ba60 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f365c00b0d0 tx=0x7f365c00b3e0 comp rx=0 tx=0).stop 2023-07-14T18:11:51.294 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:51.254+0000 7f3669bae700 1 -- 172.21.15.163:0/1098605493 shutdown_connections 2023-07-14T18:11:51.295 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:51.254+0000 7f3669bae700 1 --2- 172.21.15.163:0/1098605493 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f36640fee40 0x7f36640ff210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:51.295 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:51.254+0000 7f3669bae700 1 --2- 172.21.15.163:0/1098605493 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f3664103ee0 0x7f366410ba60 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:51.295 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:51.254+0000 7f3669bae700 1 --2- 172.21.15.163:0/1098605493 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f36640ff7e0 0x7f36641037b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:51.295 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:51.254+0000 7f3669bae700 1 -- 172.21.15.163:0/1098605493 >> 172.21.15.163:0/1098605493 conn(0x7f3664075ca0 msgr2=0x7f36640760a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:11:51.295 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:51.254+0000 7f3669bae700 1 -- 172.21.15.163:0/1098605493 shutdown_connections 2023-07-14T18:11:51.295 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:51.254+0000 7f3669bae700 1 -- 172.21.15.163:0/1098605493 wait complete. 2023-07-14T18:11:51.297 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:51.254+0000 7f3669bae700 1 Processor -- start 2023-07-14T18:11:51.297 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:51.255+0000 7f3669bae700 1 -- start start 2023-07-14T18:11:51.297 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:51.255+0000 7f3669bae700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f36640fee40 0x7f366419aa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:11:51.297 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:51.255+0000 7f3669bae700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f36640ff7e0 0x7f366419afc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:11:51.298 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:51.255+0000 7f3669bae700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f3664103ee0 0x7f3664194a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:11:51.298 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:51.255+0000 7f3669bae700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3664195220 con 0x7f3664103ee0 2023-07-14T18:11:51.298 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:51.255+0000 7f3669bae700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3664195390 con 0x7f36640ff7e0 2023-07-14T18:11:51.298 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:51.255+0000 7f3669bae700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3664195550 con 0x7f36640fee40 2023-07-14T18:11:51.298 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:51.255+0000 7f3663fff700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f3664103ee0 0x7f3664194a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:11:51.298 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:51.255+0000 7f3663fff700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f3664103ee0 0x7f3664194a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:56478/0 (socket says 172.21.15.163:56478) 2023-07-14T18:11:51.298 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:51.255+0000 7f3663fff700 1 -- 172.21.15.163:0/1257287533 learned_addr learned my addr 172.21.15.163:0/1257287533 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:11:51.299 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:51.255+0000 7f36637fe700 1 --2- 172.21.15.163:0/1257287533 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f36640fee40 0x7f366419aa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:11:51.299 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:51.255+0000 7f3663fff700 1 -- 172.21.15.163:0/1257287533 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f36640fee40 msgr2=0x7f366419aa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:11:51.299 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:51.255+0000 7f3662ffd700 1 --2- 172.21.15.163:0/1257287533 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f36640ff7e0 0x7f366419afc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:11:51.299 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:51.255+0000 7f3663fff700 1 --2- 172.21.15.163:0/1257287533 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f36640fee40 0x7f366419aa80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:51.299 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:51.255+0000 7f3663fff700 1 -- 172.21.15.163:0/1257287533 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f36640ff7e0 msgr2=0x7f366419afc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:11:51.299 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:51.255+0000 7f3663fff700 1 --2- 172.21.15.163:0/1257287533 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f36640ff7e0 0x7f366419afc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:51.300 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:51.255+0000 7f3663fff700 1 -- 172.21.15.163:0/1257287533 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f365c009d00 con 0x7f3664103ee0 2023-07-14T18:11:51.300 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:51.256+0000 7f36637fe700 1 --2- 172.21.15.163:0/1257287533 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f36640fee40 0x7f366419aa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T18:11:51.300 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:51.256+0000 7f3663fff700 1 --2- 172.21.15.163:0/1257287533 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f3664103ee0 0x7f3664194a70 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f365c009fd0 tx=0x7f365c009430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:11:51.300 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:51.256+0000 7f3660ff9700 1 -- 172.21.15.163:0/1257287533 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f365c00e040 con 0x7f3664103ee0 2023-07-14T18:11:51.300 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:51.256+0000 7f3660ff9700 1 -- 172.21.15.163:0/1257287533 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f365c004e40 con 0x7f3664103ee0 2023-07-14T18:11:51.300 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:51.256+0000 7f3660ff9700 1 -- 172.21.15.163:0/1257287533 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f365c012a10 con 0x7f3664103ee0 2023-07-14T18:11:51.300 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:51.256+0000 7f3669bae700 1 -- 172.21.15.163:0/1257287533 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f36641957d0 con 0x7f3664103ee0 2023-07-14T18:11:51.300 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:51.256+0000 7f3669bae700 1 -- 172.21.15.163:0/1257287533 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f36640682d0 con 0x7f3664103ee0 2023-07-14T18:11:51.301 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:51.257+0000 7f3669bae700 1 -- 172.21.15.163:0/1257287533 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f366410ebf0 con 0x7f3664103ee0 2023-07-14T18:11:51.301 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:51.258+0000 7f3660ff9700 1 -- 172.21.15.163:0/1257287533 <== mon.0 v2:172.21.15.163:3300/0 4 ==== mgrmap(e 17) v1 ==== 135767+0+0 (secure 0 0 0) 0x7f365c012b70 con 0x7f3664103ee0 2023-07-14T18:11:51.302 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:51.258+0000 7f3660ff9700 1 --2- 172.21.15.163:0/1257287533 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f364c0a1260 0x7f364c0a3710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:11:51.302 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:51.258+0000 7f36637fe700 1 --2- 172.21.15.163:0/1257287533 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f364c0a1260 0x7f364c0a3710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:11:51.302 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:51.259+0000 7f3660ff9700 1 -- 172.21.15.163:0/1257287533 <== mon.0 v2:172.21.15.163:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 8730+0+0 (secure 0 0 0) 0x7f365c0d05e0 con 0x7f3664103ee0 2023-07-14T18:11:51.302 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:51.259+0000 7f3660ff9700 1 --2- 172.21.15.163:0/1257287533 >> [v2:172.21.15.163:6802/3124653025,v1:172.21.15.163:6803/3124653025] conn(0x7f364c0abdd0 0x7f364c0ae200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:11:51.302 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:51.259+0000 7f3660ff9700 1 -- 172.21.15.163:0/1257287533 --> [v2:172.21.15.163:6802/3124653025,v1:172.21.15.163:6803/3124653025] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f364c0ae8d0 con 0x7f364c0abdd0 2023-07-14T18:11:51.302 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:51.259+0000 7f3660ff9700 1 -- 172.21.15.163:0/1257287533 <== mon.0 v2:172.21.15.163:3300/0 6 ==== mon_get_version_reply(handle=1 version=84) v2 ==== 24+0+0 (secure 0 0 0) 0x7f365c0d09f0 con 0x7f3664103ee0 2023-07-14T18:11:51.303 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:51.259+0000 7f3662ffd700 1 --2- 172.21.15.163:0/1257287533 >> [v2:172.21.15.163:6802/3124653025,v1:172.21.15.163:6803/3124653025] conn(0x7f364c0abdd0 0x7f364c0ae200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:11:51.303 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:51.259+0000 7f36637fe700 1 --2- 172.21.15.163:0/1257287533 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f364c0a1260 0x7f364c0a3710 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f3654005fd0 tx=0x7f3654005e30 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:11:51.303 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:51.259+0000 7f3662ffd700 1 --2- 172.21.15.163:0/1257287533 >> [v2:172.21.15.163:6802/3124653025,v1:172.21.15.163:6803/3124653025] conn(0x7f364c0abdd0 0x7f364c0ae200 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:11:51.303 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:51.260+0000 7f3660ff9700 1 -- 172.21.15.163:0/1257287533 <== osd.0 v2:172.21.15.163:6802/3124653025 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f364c0ae8d0 con 0x7f364c0abdd0 2023-07-14T18:11:51.315 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:51.275+0000 7f3669bae700 1 -- 172.21.15.163:0/1257287533 --> [v2:172.21.15.163:6802/3124653025,v1:172.21.15.163:6803/3124653025] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f366404e340 con 0x7f364c0abdd0 2023-07-14T18:11:51.316 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:51.276+0000 7f3660ff9700 1 -- 172.21.15.163:0/1257287533 <== osd.0 v2:172.21.15.163:6802/3124653025 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f366404e340 con 0x7f364c0abdd0 2023-07-14T18:11:51.317 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:51.276+0000 7f3669bae700 1 -- 172.21.15.163:0/1257287533 >> [v2:172.21.15.163:6802/3124653025,v1:172.21.15.163:6803/3124653025] conn(0x7f364c0abdd0 msgr2=0x7f364c0ae200 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:11:51.317 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:51.276+0000 7f3669bae700 1 --2- 172.21.15.163:0/1257287533 >> [v2:172.21.15.163:6802/3124653025,v1:172.21.15.163:6803/3124653025] conn(0x7f364c0abdd0 0x7f364c0ae200 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:51.317 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:51.276+0000 7f3669bae700 1 -- 172.21.15.163:0/1257287533 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f364c0a1260 msgr2=0x7f364c0a3710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:11:51.317 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:51.276+0000 7f3669bae700 1 --2- 172.21.15.163:0/1257287533 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f364c0a1260 0x7f364c0a3710 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f3654005fd0 tx=0x7f3654005e30 comp rx=0 tx=0).stop 2023-07-14T18:11:51.317 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:51.276+0000 7f3669bae700 1 -- 172.21.15.163:0/1257287533 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f3664103ee0 msgr2=0x7f3664194a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:11:51.317 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:51.276+0000 7f3669bae700 1 --2- 172.21.15.163:0/1257287533 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f3664103ee0 0x7f3664194a70 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f365c009fd0 tx=0x7f365c009430 comp rx=0 tx=0).stop 2023-07-14T18:11:51.318 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:51.276+0000 7f3663fff700 1 -- 172.21.15.163:0/1257287533 reap_dead start 2023-07-14T18:11:51.318 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:51.276+0000 7f3669bae700 1 -- 172.21.15.163:0/1257287533 shutdown_connections 2023-07-14T18:11:51.318 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:51.276+0000 7f3669bae700 1 -- 172.21.15.163:0/1257287533 >> 172.21.15.163:0/1257287533 conn(0x7f3664075ca0 msgr2=0x7f36640fc4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:11:51.318 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:51.276+0000 7f3669bae700 1 -- 172.21.15.163:0/1257287533 shutdown_connections 2023-07-14T18:11:51.318 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:51.276+0000 7f3669bae700 1 -- 172.21.15.163:0/1257287533 wait complete. 2023-07-14T18:11:51.611 INFO:teuthology.orchestra.run.smithi163.stdout:292057776151 2023-07-14T18:11:51.612 DEBUG:teuthology.orchestra.run.smithi163:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81c9387d2e7576da065747ec9c16d1c7d69016ec shell --fsid bf7326ec-2270-11ee-9b33-001a4aab830c -- ceph osd last-stat-seq osd.10 2023-07-14T18:11:52.043 INFO:teuthology.orchestra.run.smithi163.stdout:55834574909 2023-07-14T18:11:52.043 DEBUG:teuthology.orchestra.run.smithi163:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81c9387d2e7576da065747ec9c16d1c7d69016ec shell --fsid bf7326ec-2270-11ee-9b33-001a4aab830c -- ceph osd last-stat-seq osd.1 2023-07-14T18:11:52.222 INFO:teuthology.orchestra.run.smithi163.stdout:137438953521 2023-07-14T18:11:52.222 DEBUG:teuthology.orchestra.run.smithi163:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81c9387d2e7576da065747ec9c16d1c7d69016ec shell --fsid bf7326ec-2270-11ee-9b33-001a4aab830c -- ceph osd last-stat-seq osd.4 2023-07-14T18:11:52.598 INFO:teuthology.orchestra.run.smithi163.stdout:270582939676 2023-07-14T18:11:52.599 DEBUG:teuthology.orchestra.run.smithi163:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81c9387d2e7576da065747ec9c16d1c7d69016ec shell --fsid bf7326ec-2270-11ee-9b33-001a4aab830c -- ceph osd last-stat-seq osd.9 2023-07-14T18:11:52.659 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:52.618+0000 7fa7ee5a1700 1 -- 172.21.15.163:0/3690892721 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fa7e80ff3b0 msgr2=0x7fa7e810b840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:11:52.659 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:52.618+0000 7fa7ee5a1700 1 --2- 172.21.15.163:0/3690892721 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fa7e80ff3b0 0x7fa7e810b840 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fa7e000b0a0 tx=0x7fa7e000b3b0 comp rx=0 tx=0).stop 2023-07-14T18:11:52.659 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:52.618+0000 7fa7ee5a1700 1 -- 172.21.15.163:0/3690892721 shutdown_connections 2023-07-14T18:11:52.659 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:52.618+0000 7fa7ee5a1700 1 --2- 172.21.15.163:0/3690892721 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa7e8104a00 0x7fa7e8104dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:52.659 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:52.618+0000 7fa7ee5a1700 1 --2- 172.21.15.163:0/3690892721 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fa7e80ff3b0 0x7fa7e810b840 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:52.660 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:52.618+0000 7fa7ee5a1700 1 --2- 172.21.15.163:0/3690892721 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa7e80fea00 0x7fa7e80fee70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:52.660 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:52.618+0000 7fa7ee5a1700 1 -- 172.21.15.163:0/3690892721 >> 172.21.15.163:0/3690892721 conn(0x7fa7e80fa580 msgr2=0x7fa7e80fc990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:11:52.660 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:52.618+0000 7fa7ee5a1700 1 -- 172.21.15.163:0/3690892721 shutdown_connections 2023-07-14T18:11:52.660 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:52.618+0000 7fa7ee5a1700 1 -- 172.21.15.163:0/3690892721 wait complete. 2023-07-14T18:11:52.661 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:52.619+0000 7fa7ee5a1700 1 Processor -- start 2023-07-14T18:11:52.661 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:52.619+0000 7fa7ee5a1700 1 -- start start 2023-07-14T18:11:52.662 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:52.619+0000 7fa7ee5a1700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa7e80fea00 0x7fa7e819a6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:11:52.662 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:52.619+0000 7fa7ee5a1700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fa7e80ff3b0 0x7fa7e819ac20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:11:52.662 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:52.619+0000 7fa7ee5a1700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa7e8104a00 0x7fa7e81947b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:11:52.662 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:52.619+0000 7fa7ee5a1700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7e8194e20 con 0x7fa7e80ff3b0 2023-07-14T18:11:52.662 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:52.619+0000 7fa7ee5a1700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7e8194f90 con 0x7fa7e8104a00 2023-07-14T18:11:52.662 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:52.619+0000 7fa7ee5a1700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7e8195150 con 0x7fa7e80fea00 2023-07-14T18:11:52.662 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:52.619+0000 7fa7ecd9e700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fa7e80ff3b0 0x7fa7e819ac20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:11:52.663 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:52.619+0000 7fa7ecd9e700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fa7e80ff3b0 0x7fa7e819ac20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:56508/0 (socket says 172.21.15.163:56508) 2023-07-14T18:11:52.663 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:52.619+0000 7fa7ecd9e700 1 -- 172.21.15.163:0/2276404329 learned_addr learned my addr 172.21.15.163:0/2276404329 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:11:52.663 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:52.619+0000 7fa7ed59f700 1 --2- 172.21.15.163:0/2276404329 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa7e80fea00 0x7fa7e819a6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:11:52.663 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:52.619+0000 7fa7edda0700 1 --2- 172.21.15.163:0/2276404329 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa7e8104a00 0x7fa7e81947b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:11:52.663 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:52.620+0000 7fa7ecd9e700 1 -- 172.21.15.163:0/2276404329 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa7e80fea00 msgr2=0x7fa7e819a6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:11:52.663 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:52.620+0000 7fa7ecd9e700 1 --2- 172.21.15.163:0/2276404329 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa7e80fea00 0x7fa7e819a6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:52.663 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:52.620+0000 7fa7ecd9e700 1 -- 172.21.15.163:0/2276404329 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa7e8104a00 msgr2=0x7fa7e81947b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:11:52.664 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:52.620+0000 7fa7ecd9e700 1 --2- 172.21.15.163:0/2276404329 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa7e8104a00 0x7fa7e81947b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:52.664 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:52.620+0000 7fa7ecd9e700 1 -- 172.21.15.163:0/2276404329 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7e0009d00 con 0x7fa7e80ff3b0 2023-07-14T18:11:52.664 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:52.620+0000 7fa7ecd9e700 1 --2- 172.21.15.163:0/2276404329 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fa7e80ff3b0 0x7fa7e819ac20 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fa7d800c9b0 tx=0x7fa7d800ccc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:11:52.664 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:52.620+0000 7fa7de7fc700 1 -- 172.21.15.163:0/2276404329 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7d8007b00 con 0x7fa7e80ff3b0 2023-07-14T18:11:52.664 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:52.620+0000 7fa7ee5a1700 1 -- 172.21.15.163:0/2276404329 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa7e8195430 con 0x7fa7e80ff3b0 2023-07-14T18:11:52.664 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:52.620+0000 7fa7de7fc700 1 -- 172.21.15.163:0/2276404329 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fa7d800ce50 con 0x7fa7e80ff3b0 2023-07-14T18:11:52.664 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:52.620+0000 7fa7de7fc700 1 -- 172.21.15.163:0/2276404329 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7d8018400 con 0x7fa7e80ff3b0 2023-07-14T18:11:52.664 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:52.620+0000 7fa7ee5a1700 1 -- 172.21.15.163:0/2276404329 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa7e80682d0 con 0x7fa7e80ff3b0 2023-07-14T18:11:52.665 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:52.621+0000 7fa7ee5a1700 1 -- 172.21.15.163:0/2276404329 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fa7e804eb90 con 0x7fa7e80ff3b0 2023-07-14T18:11:52.665 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:52.623+0000 7fa7de7fc700 1 -- 172.21.15.163:0/2276404329 <== mon.0 v2:172.21.15.163:3300/0 4 ==== mgrmap(e 17) v1 ==== 135767+0+0 (secure 0 0 0) 0x7fa7d800f450 con 0x7fa7e80ff3b0 2023-07-14T18:11:52.666 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:52.623+0000 7fa7de7fc700 1 --2- 172.21.15.163:0/2276404329 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7fa7d40a11e0 0x7fa7d40a3690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:11:52.666 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:52.623+0000 7fa7de7fc700 1 -- 172.21.15.163:0/2276404329 <== mon.0 v2:172.21.15.163:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 8730+0+0 (secure 0 0 0) 0x7fa7d80cd060 con 0x7fa7e80ff3b0 2023-07-14T18:11:52.666 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:52.623+0000 7fa7ed59f700 1 --2- 172.21.15.163:0/2276404329 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7fa7d40a11e0 0x7fa7d40a3690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:11:52.666 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:52.623+0000 7fa7de7fc700 1 --2- 172.21.15.163:0/2276404329 >> [v2:172.21.15.184:6808/2662084043,v1:172.21.15.184:6809/2662084043] conn(0x7fa7d40abd50 0x7fa7d40ae180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:11:52.666 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:52.623+0000 7fa7de7fc700 1 -- 172.21.15.163:0/2276404329 --> [v2:172.21.15.184:6808/2662084043,v1:172.21.15.184:6809/2662084043] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fa7d40ae850 con 0x7fa7d40abd50 2023-07-14T18:11:52.666 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:52.623+0000 7fa7de7fc700 1 -- 172.21.15.163:0/2276404329 <== mon.0 v2:172.21.15.163:3300/0 6 ==== mon_get_version_reply(handle=1 version=84) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa7d80cd470 con 0x7fa7e80ff3b0 2023-07-14T18:11:52.667 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:52.624+0000 7fa7edda0700 1 --2- 172.21.15.163:0/2276404329 >> [v2:172.21.15.184:6808/2662084043,v1:172.21.15.184:6809/2662084043] conn(0x7fa7d40abd50 0x7fa7d40ae180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:11:52.667 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:52.624+0000 7fa7ed59f700 1 --2- 172.21.15.163:0/2276404329 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7fa7d40a11e0 0x7fa7d40a3690 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fa7e80ffb40 tx=0x7fa7e400a3b0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:11:52.667 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:52.624+0000 7fa7edda0700 1 --2- 172.21.15.163:0/2276404329 >> [v2:172.21.15.184:6808/2662084043,v1:172.21.15.184:6809/2662084043] conn(0x7fa7d40abd50 0x7fa7d40ae180 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:11:52.667 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:52.625+0000 7fa7de7fc700 1 -- 172.21.15.163:0/2276404329 <== osd.5 v2:172.21.15.184:6808/2662084043 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7fa7d40ae850 con 0x7fa7d40abd50 2023-07-14T18:11:52.685 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:52.645+0000 7fa7ee5a1700 1 -- 172.21.15.163:0/2276404329 --> [v2:172.21.15.184:6808/2662084043,v1:172.21.15.184:6809/2662084043] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fa7e810ea60 con 0x7fa7d40abd50 2023-07-14T18:11:52.686 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:52.646+0000 7fa7de7fc700 1 -- 172.21.15.163:0/2276404329 <== osd.5 v2:172.21.15.184:6808/2662084043 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7fa7e0009b80 con 0x7fa7d40abd50 2023-07-14T18:11:52.691 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:52.648+0000 7fa7ee5a1700 1 -- 172.21.15.163:0/2276404329 >> [v2:172.21.15.184:6808/2662084043,v1:172.21.15.184:6809/2662084043] conn(0x7fa7d40abd50 msgr2=0x7fa7d40ae180 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:11:52.691 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:52.648+0000 7fa7ee5a1700 1 --2- 172.21.15.163:0/2276404329 >> [v2:172.21.15.184:6808/2662084043,v1:172.21.15.184:6809/2662084043] conn(0x7fa7d40abd50 0x7fa7d40ae180 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:52.691 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:52.648+0000 7fa7ee5a1700 1 -- 172.21.15.163:0/2276404329 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7fa7d40a11e0 msgr2=0x7fa7d40a3690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:11:52.691 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:52.648+0000 7fa7ee5a1700 1 --2- 172.21.15.163:0/2276404329 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7fa7d40a11e0 0x7fa7d40a3690 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fa7e80ffb40 tx=0x7fa7e400a3b0 comp rx=0 tx=0).stop 2023-07-14T18:11:52.691 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:52.648+0000 7fa7ee5a1700 1 -- 172.21.15.163:0/2276404329 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fa7e80ff3b0 msgr2=0x7fa7e819ac20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:11:52.692 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:52.648+0000 7fa7ee5a1700 1 --2- 172.21.15.163:0/2276404329 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fa7e80ff3b0 0x7fa7e819ac20 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fa7d800c9b0 tx=0x7fa7d800ccc0 comp rx=0 tx=0).stop 2023-07-14T18:11:52.692 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:52.648+0000 7fa7edda0700 1 -- 172.21.15.163:0/2276404329 reap_dead start 2023-07-14T18:11:52.692 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:52.650+0000 7fa7ee5a1700 1 -- 172.21.15.163:0/2276404329 shutdown_connections 2023-07-14T18:11:52.692 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:52.650+0000 7fa7ee5a1700 1 -- 172.21.15.163:0/2276404329 >> 172.21.15.163:0/2276404329 conn(0x7fa7e80fa580 msgr2=0x7fa7e8105810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:11:52.694 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:52.653+0000 7fa7ee5a1700 1 -- 172.21.15.163:0/2276404329 shutdown_connections 2023-07-14T18:11:52.694 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:52.654+0000 7fa7ee5a1700 1 -- 172.21.15.163:0/2276404329 wait complete. 2023-07-14T18:11:52.798 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:52.522+0000 7ff664577700 1 -- 172.21.15.163:0/1905804008 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff65c10a270 msgr2=0x7ff65c10c6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:11:52.799 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:52.522+0000 7ff664577700 1 --2- 172.21.15.163:0/1905804008 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff65c10a270 0x7ff65c10c6b0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7ff65400b0a0 tx=0x7ff65400b3b0 comp rx=0 tx=0).stop 2023-07-14T18:11:52.799 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:52.523+0000 7ff664577700 1 -- 172.21.15.163:0/1905804008 shutdown_connections 2023-07-14T18:11:52.799 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:52.523+0000 7ff664577700 1 --2- 172.21.15.163:0/1905804008 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff65c10a270 0x7ff65c10c6b0 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:52.799 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:52.523+0000 7ff664577700 1 --2- 172.21.15.163:0/1905804008 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff65c100f20 0x7ff65c1012f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:52.799 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:52.523+0000 7ff664577700 1 --2- 172.21.15.163:0/1905804008 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff65c101830 0x7ff65c109d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:52.799 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:52.523+0000 7ff664577700 1 -- 172.21.15.163:0/1905804008 >> 172.21.15.163:0/1905804008 conn(0x7ff65c075ca0 msgr2=0x7ff65c0760a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:11:52.799 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:52.523+0000 7ff664577700 1 -- 172.21.15.163:0/1905804008 shutdown_connections 2023-07-14T18:11:52.800 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:52.523+0000 7ff664577700 1 -- 172.21.15.163:0/1905804008 wait complete. 2023-07-14T18:11:52.800 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:52.523+0000 7ff664577700 1 Processor -- start 2023-07-14T18:11:52.800 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:52.524+0000 7ff664577700 1 -- start start 2023-07-14T18:11:52.800 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:52.524+0000 7ff664577700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff65c100f20 0x7ff65c195db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:11:52.800 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:52.524+0000 7ff664577700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff65c101830 0x7ff65c1962f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:11:52.800 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:52.524+0000 7ff664577700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff65c10a270 0x7ff65c19a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:11:52.800 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:52.524+0000 7ff664577700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff65c19ad70 con 0x7ff65c101830 2023-07-14T18:11:52.801 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:52.524+0000 7ff664577700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff65c19aee0 con 0x7ff65c100f20 2023-07-14T18:11:52.801 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:52.524+0000 7ff664577700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff65c19b0a0 con 0x7ff65c10a270 2023-07-14T18:11:52.801 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:52.524+0000 7ff661b12700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff65c101830 0x7ff65c1962f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:11:52.801 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:52.524+0000 7ff661b12700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff65c101830 0x7ff65c1962f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:56492/0 (socket says 172.21.15.163:56492) 2023-07-14T18:11:52.801 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:52.524+0000 7ff661b12700 1 -- 172.21.15.163:0/2659894124 learned_addr learned my addr 172.21.15.163:0/2659894124 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:11:52.801 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:52.524+0000 7ff662b14700 1 --2- 172.21.15.163:0/2659894124 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff65c10a270 0x7ff65c19a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:11:52.801 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:52.524+0000 7ff662313700 1 --2- 172.21.15.163:0/2659894124 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff65c100f20 0x7ff65c195db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:11:52.801 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:52.524+0000 7ff661b12700 1 -- 172.21.15.163:0/2659894124 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff65c10a270 msgr2=0x7ff65c19a760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:11:52.802 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:52.524+0000 7ff661b12700 1 --2- 172.21.15.163:0/2659894124 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff65c10a270 0x7ff65c19a760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:52.802 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:52.524+0000 7ff661b12700 1 -- 172.21.15.163:0/2659894124 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff65c100f20 msgr2=0x7ff65c195db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:11:52.802 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:52.524+0000 7ff661b12700 1 --2- 172.21.15.163:0/2659894124 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff65c100f20 0x7ff65c195db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:52.802 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:52.524+0000 7ff661b12700 1 -- 172.21.15.163:0/2659894124 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff654009d00 con 0x7ff65c101830 2023-07-14T18:11:52.802 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:52.524+0000 7ff662313700 1 --2- 172.21.15.163:0/2659894124 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff65c100f20 0x7ff65c195db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T18:11:52.802 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:52.524+0000 7ff661b12700 1 --2- 172.21.15.163:0/2659894124 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff65c101830 0x7ff65c1962f0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7ff64c00e9a0 tx=0x7ff64c00ed60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:11:52.802 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:52.525+0000 7ff6537fe700 1 -- 172.21.15.163:0/2659894124 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff64c009790 con 0x7ff65c101830 2023-07-14T18:11:52.803 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:52.525+0000 7ff6537fe700 1 -- 172.21.15.163:0/2659894124 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ff64c00cbd0 con 0x7ff65c101830 2023-07-14T18:11:52.803 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:52.525+0000 7ff664577700 1 -- 172.21.15.163:0/2659894124 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff65c19b380 con 0x7ff65c101830 2023-07-14T18:11:52.803 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:52.525+0000 7ff6537fe700 1 -- 172.21.15.163:0/2659894124 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff64c018680 con 0x7ff65c101830 2023-07-14T18:11:52.803 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:52.525+0000 7ff664577700 1 -- 172.21.15.163:0/2659894124 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff65c1a2be0 con 0x7ff65c101830 2023-07-14T18:11:52.803 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:52.526+0000 7ff664577700 1 -- 172.21.15.163:0/2659894124 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7ff65c10fcb0 con 0x7ff65c101830 2023-07-14T18:11:52.803 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:52.527+0000 7ff6537fe700 1 -- 172.21.15.163:0/2659894124 <== mon.0 v2:172.21.15.163:3300/0 4 ==== mgrmap(e 17) v1 ==== 135767+0+0 (secure 0 0 0) 0x7ff64c00cd40 con 0x7ff65c101830 2023-07-14T18:11:52.803 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:52.528+0000 7ff6537fe700 1 --2- 172.21.15.163:0/2659894124 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7ff6480a1260 0x7ff6480a3710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:11:52.803 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:52.528+0000 7ff662313700 1 --2- 172.21.15.163:0/2659894124 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7ff6480a1260 0x7ff6480a3710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:11:52.804 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:52.528+0000 7ff6537fe700 1 -- 172.21.15.163:0/2659894124 <== mon.0 v2:172.21.15.163:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 8730+0+0 (secure 0 0 0) 0x7ff64c014070 con 0x7ff65c101830 2023-07-14T18:11:52.804 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:52.528+0000 7ff6537fe700 1 --2- 172.21.15.163:0/2659894124 >> [v2:172.21.15.172:6816/233511803,v1:172.21.15.172:6817/233511803] conn(0x7ff6480abdd0 0x7ff6480ae200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:11:52.804 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:52.528+0000 7ff6537fe700 1 -- 172.21.15.163:0/2659894124 --> [v2:172.21.15.172:6816/233511803,v1:172.21.15.172:6817/233511803] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7ff6480ae8d0 con 0x7ff6480abdd0 2023-07-14T18:11:52.804 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:52.528+0000 7ff6537fe700 1 -- 172.21.15.163:0/2659894124 <== mon.0 v2:172.21.15.163:3300/0 6 ==== mon_get_version_reply(handle=1 version=84) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff64c0d0020 con 0x7ff65c101830 2023-07-14T18:11:52.804 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:52.529+0000 7ff662313700 1 --2- 172.21.15.163:0/2659894124 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7ff6480a1260 0x7ff6480a3710 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7ff658005d90 tx=0x7ff658005d00 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:11:52.804 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:52.529+0000 7ff662b14700 1 --2- 172.21.15.163:0/2659894124 >> [v2:172.21.15.172:6816/233511803,v1:172.21.15.172:6817/233511803] conn(0x7ff6480abdd0 0x7ff6480ae200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:11:52.804 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:52.529+0000 7ff662b14700 1 --2- 172.21.15.163:0/2659894124 >> [v2:172.21.15.172:6816/233511803,v1:172.21.15.172:6817/233511803] conn(0x7ff6480abdd0 0x7ff6480ae200 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:11:52.805 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:52.530+0000 7ff6537fe700 1 -- 172.21.15.163:0/2659894124 <== osd.7 v2:172.21.15.172:6816/233511803 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7ff6480ae8d0 con 0x7ff6480abdd0 2023-07-14T18:11:52.805 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:52.551+0000 7ff664577700 1 -- 172.21.15.163:0/2659894124 --> [v2:172.21.15.172:6816/233511803,v1:172.21.15.172:6817/233511803] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7ff65c04e340 con 0x7ff6480abdd0 2023-07-14T18:11:52.805 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:52.552+0000 7ff6537fe700 1 -- 172.21.15.163:0/2659894124 <== osd.7 v2:172.21.15.172:6816/233511803 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7ff65c04e340 con 0x7ff6480abdd0 2023-07-14T18:11:52.805 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:52.553+0000 7ff664577700 1 -- 172.21.15.163:0/2659894124 >> [v2:172.21.15.172:6816/233511803,v1:172.21.15.172:6817/233511803] conn(0x7ff6480abdd0 msgr2=0x7ff6480ae200 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:11:52.805 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:52.553+0000 7ff664577700 1 --2- 172.21.15.163:0/2659894124 >> [v2:172.21.15.172:6816/233511803,v1:172.21.15.172:6817/233511803] conn(0x7ff6480abdd0 0x7ff6480ae200 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:52.805 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:52.553+0000 7ff664577700 1 -- 172.21.15.163:0/2659894124 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7ff6480a1260 msgr2=0x7ff6480a3710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:11:52.805 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:52.553+0000 7ff664577700 1 --2- 172.21.15.163:0/2659894124 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7ff6480a1260 0x7ff6480a3710 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7ff658005d90 tx=0x7ff658005d00 comp rx=0 tx=0).stop 2023-07-14T18:11:52.805 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:52.553+0000 7ff664577700 1 -- 172.21.15.163:0/2659894124 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff65c101830 msgr2=0x7ff65c1962f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:11:52.806 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:52.553+0000 7ff664577700 1 --2- 172.21.15.163:0/2659894124 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff65c101830 0x7ff65c1962f0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7ff64c00e9a0 tx=0x7ff64c00ed60 comp rx=0 tx=0).stop 2023-07-14T18:11:52.806 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:52.553+0000 7ff662b14700 1 -- 172.21.15.163:0/2659894124 reap_dead start 2023-07-14T18:11:52.806 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:52.553+0000 7ff664577700 1 -- 172.21.15.163:0/2659894124 shutdown_connections 2023-07-14T18:11:52.806 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:52.553+0000 7ff664577700 1 -- 172.21.15.163:0/2659894124 >> 172.21.15.163:0/2659894124 conn(0x7ff65c075ca0 msgr2=0x7ff65c10a6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:11:52.806 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:52.553+0000 7ff664577700 1 -- 172.21.15.163:0/2659894124 shutdown_connections 2023-07-14T18:11:52.806 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:52.553+0000 7ff664577700 1 -- 172.21.15.163:0/2659894124 wait complete. 2023-07-14T18:11:52.959 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:52.919+0000 7f55a3a22700 1 -- 172.21.15.163:0/3503825932 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f559c0feeb0 msgr2=0x7f559c0ff280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:11:52.960 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:52.919+0000 7f55a3a22700 1 --2- 172.21.15.163:0/3503825932 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f559c0feeb0 0x7f559c0ff280 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f55980099c0 tx=0x7f5598009cd0 comp rx=0 tx=0).stop 2023-07-14T18:11:52.960 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:52.919+0000 7f55a3a22700 1 -- 172.21.15.163:0/3503825932 shutdown_connections 2023-07-14T18:11:52.960 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:52.919+0000 7f55a3a22700 1 --2- 172.21.15.163:0/3503825932 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f559c103f50 0x7f559c10bad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:52.960 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:52.919+0000 7f55a3a22700 1 --2- 172.21.15.163:0/3503825932 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f559c0feeb0 0x7f559c0ff280 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:52.960 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:52.919+0000 7f55a3a22700 1 --2- 172.21.15.163:0/3503825932 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f559c0ff850 0x7f559c103820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:52.960 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:52.919+0000 7f55a3a22700 1 -- 172.21.15.163:0/3503825932 >> 172.21.15.163:0/3503825932 conn(0x7f559c075ab0 msgr2=0x7f559c075eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:11:52.960 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:52.919+0000 7f55a3a22700 1 -- 172.21.15.163:0/3503825932 shutdown_connections 2023-07-14T18:11:52.961 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:52.919+0000 7f55a3a22700 1 -- 172.21.15.163:0/3503825932 wait complete. 2023-07-14T18:11:52.962 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:52.920+0000 7f55a3a22700 1 Processor -- start 2023-07-14T18:11:52.962 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:52.920+0000 7f55a3a22700 1 -- start start 2023-07-14T18:11:52.962 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:52.920+0000 7f55a3a22700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f559c0feeb0 0x7f559c1008c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:11:52.962 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:52.920+0000 7f55a3a22700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f559c0ff850 0x7f559c100e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:11:52.963 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:52.920+0000 7f55a3a22700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f559c103f50 0x7f559c1a3eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:11:52.963 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:52.920+0000 7f55a3a22700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f559c1016f0 con 0x7f559c0ff850 2023-07-14T18:11:52.963 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:52.920+0000 7f55a3a22700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f559c1a43f0 con 0x7f559c0feeb0 2023-07-14T18:11:52.963 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:52.920+0000 7f55a3a22700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f559c1a4560 con 0x7f559c103f50 2023-07-14T18:11:52.963 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:52.920+0000 7f55a0fbd700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f559c0ff850 0x7f559c100e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:11:52.963 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:52.920+0000 7f55a0fbd700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f559c0ff850 0x7f559c100e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:56522/0 (socket says 172.21.15.163:56522) 2023-07-14T18:11:52.963 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:52.920+0000 7f55a0fbd700 1 -- 172.21.15.163:0/4144842633 learned_addr learned my addr 172.21.15.163:0/4144842633 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:11:52.964 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:52.920+0000 7f55a17be700 1 --2- 172.21.15.163:0/4144842633 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f559c0feeb0 0x7f559c1008c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:11:52.964 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:52.920+0000 7f55a1fbf700 1 --2- 172.21.15.163:0/4144842633 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f559c103f50 0x7f559c1a3eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:11:52.964 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:52.920+0000 7f55a0fbd700 1 -- 172.21.15.163:0/4144842633 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f559c103f50 msgr2=0x7f559c1a3eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:11:52.964 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:52.920+0000 7f55a0fbd700 1 --2- 172.21.15.163:0/4144842633 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f559c103f50 0x7f559c1a3eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:52.964 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:52.920+0000 7f55a0fbd700 1 -- 172.21.15.163:0/4144842633 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f559c0feeb0 msgr2=0x7f559c1008c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:11:52.964 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:52.920+0000 7f55a0fbd700 1 --2- 172.21.15.163:0/4144842633 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f559c0feeb0 0x7f559c1008c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:52.964 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:52.920+0000 7f55a0fbd700 1 -- 172.21.15.163:0/4144842633 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55980095f0 con 0x7f559c0ff850 2023-07-14T18:11:52.964 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:52.920+0000 7f55a17be700 1 --2- 172.21.15.163:0/4144842633 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f559c0feeb0 0x7f559c1008c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T18:11:52.965 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:52.921+0000 7f55a0fbd700 1 --2- 172.21.15.163:0/4144842633 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f559c0ff850 0x7f559c100e00 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f558c00e970 tx=0x7f558c00ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:11:52.965 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:52.921+0000 7f55927fc700 1 -- 172.21.15.163:0/4144842633 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f558c009790 con 0x7f559c0ff850 2023-07-14T18:11:52.965 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:52.921+0000 7f55927fc700 1 -- 172.21.15.163:0/4144842633 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f558c00eec0 con 0x7f559c0ff850 2023-07-14T18:11:52.965 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:52.921+0000 7f55a3a22700 1 -- 172.21.15.163:0/4144842633 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f559c1a47e0 con 0x7f559c0ff850 2023-07-14T18:11:52.965 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:52.921+0000 7f55927fc700 1 -- 172.21.15.163:0/4144842633 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f558c0054f0 con 0x7f559c0ff850 2023-07-14T18:11:52.965 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:52.921+0000 7f55a3a22700 1 -- 172.21.15.163:0/4144842633 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f559c1a4d30 con 0x7f559c0ff850 2023-07-14T18:11:52.965 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:52.922+0000 7f55a3a22700 1 -- 172.21.15.163:0/4144842633 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f559c10ec70 con 0x7f559c0ff850 2023-07-14T18:11:52.966 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:52.923+0000 7f55927fc700 1 -- 172.21.15.163:0/4144842633 <== mon.0 v2:172.21.15.163:3300/0 4 ==== mgrmap(e 17) v1 ==== 135767+0+0 (secure 0 0 0) 0x7f558c004750 con 0x7f559c0ff850 2023-07-14T18:11:52.966 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:52.924+0000 7f55927fc700 1 --2- 172.21.15.163:0/4144842633 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f55880a1260 0x7f55880a3710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:11:52.967 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:52.924+0000 7f55a17be700 1 --2- 172.21.15.163:0/4144842633 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f55880a1260 0x7f55880a3710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:11:52.967 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:52.924+0000 7f55927fc700 1 -- 172.21.15.163:0/4144842633 <== mon.0 v2:172.21.15.163:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 8730+0+0 (secure 0 0 0) 0x7f558c014070 con 0x7f559c0ff850 2023-07-14T18:11:52.967 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:52.924+0000 7f55927fc700 1 --2- 172.21.15.163:0/4144842633 >> [v2:172.21.15.184:6824/3614578747,v1:172.21.15.184:6825/3614578747] conn(0x7f55880abdd0 0x7f55880ae200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:11:52.967 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:52.924+0000 7f55927fc700 1 -- 172.21.15.163:0/4144842633 --> [v2:172.21.15.184:6824/3614578747,v1:172.21.15.184:6825/3614578747] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f55880ae8d0 con 0x7f55880abdd0 2023-07-14T18:11:52.967 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:52.924+0000 7f55927fc700 1 -- 172.21.15.163:0/4144842633 <== mon.0 v2:172.21.15.163:3300/0 6 ==== mon_get_version_reply(handle=1 version=84) v2 ==== 24+0+0 (secure 0 0 0) 0x7f558c0cd4b0 con 0x7f559c0ff850 2023-07-14T18:11:52.967 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:52.924+0000 7f55a17be700 1 --2- 172.21.15.163:0/4144842633 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f55880a1260 0x7f55880a3710 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f559800b580 tx=0x7f559801a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:11:52.967 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:52.924+0000 7f55a1fbf700 1 --2- 172.21.15.163:0/4144842633 >> [v2:172.21.15.184:6824/3614578747,v1:172.21.15.184:6825/3614578747] conn(0x7f55880abdd0 0x7f55880ae200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:11:52.968 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:52.925+0000 7f55a1fbf700 1 --2- 172.21.15.163:0/4144842633 >> [v2:172.21.15.184:6824/3614578747,v1:172.21.15.184:6825/3614578747] conn(0x7f55880abdd0 0x7f55880ae200 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.11 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:11:52.968 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:52.926+0000 7f55927fc700 1 -- 172.21.15.163:0/4144842633 <== osd.11 v2:172.21.15.184:6824/3614578747 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f55880ae8d0 con 0x7f55880abdd0 2023-07-14T18:11:52.981 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:52.941+0000 7f55a3a22700 1 -- 172.21.15.163:0/4144842633 --> [v2:172.21.15.184:6824/3614578747,v1:172.21.15.184:6825/3614578747] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f559c04e340 con 0x7f55880abdd0 2023-07-14T18:11:52.982 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:52.942+0000 7f55927fc700 1 -- 172.21.15.163:0/4144842633 <== osd.11 v2:172.21.15.184:6824/3614578747 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7f559c04e340 con 0x7f55880abdd0 2023-07-14T18:11:52.983 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:52.942+0000 7f55a3a22700 1 -- 172.21.15.163:0/4144842633 >> [v2:172.21.15.184:6824/3614578747,v1:172.21.15.184:6825/3614578747] conn(0x7f55880abdd0 msgr2=0x7f55880ae200 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:11:52.983 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:52.942+0000 7f55a3a22700 1 --2- 172.21.15.163:0/4144842633 >> [v2:172.21.15.184:6824/3614578747,v1:172.21.15.184:6825/3614578747] conn(0x7f55880abdd0 0x7f55880ae200 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:52.983 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:52.942+0000 7f55a3a22700 1 -- 172.21.15.163:0/4144842633 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f55880a1260 msgr2=0x7f55880a3710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:11:52.983 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:52.942+0000 7f55a3a22700 1 --2- 172.21.15.163:0/4144842633 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f55880a1260 0x7f55880a3710 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f559800b580 tx=0x7f559801a040 comp rx=0 tx=0).stop 2023-07-14T18:11:52.983 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:52.942+0000 7f55a3a22700 1 -- 172.21.15.163:0/4144842633 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f559c0ff850 msgr2=0x7f559c100e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:11:52.984 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:52.942+0000 7f55a3a22700 1 --2- 172.21.15.163:0/4144842633 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f559c0ff850 0x7f559c100e00 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f558c00e970 tx=0x7f558c00ec80 comp rx=0 tx=0).stop 2023-07-14T18:11:52.984 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:52.942+0000 7f55a1fbf700 1 -- 172.21.15.163:0/4144842633 reap_dead start 2023-07-14T18:11:52.984 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:52.942+0000 7f55a3a22700 1 -- 172.21.15.163:0/4144842633 shutdown_connections 2023-07-14T18:11:52.984 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:52.942+0000 7f55a3a22700 1 -- 172.21.15.163:0/4144842633 >> 172.21.15.163:0/4144842633 conn(0x7f559c075ab0 msgr2=0x7f559c102b40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:11:52.985 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:52.942+0000 7f55a3a22700 1 -- 172.21.15.163:0/4144842633 shutdown_connections 2023-07-14T18:11:52.985 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:52.942+0000 7f55a3a22700 1 -- 172.21.15.163:0/4144842633 wait complete. 2023-07-14T18:11:53.073 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:11:52 smithi163 ceph-mon[96576]: pgmap v272: 129 pgs: 129 active+clean; 641 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 1.7 KiB/s wr, 11 op/s 2023-07-14T18:11:53.174 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:11:52 smithi184 ceph-mon[98481]: pgmap v272: 129 pgs: 129 active+clean; 641 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 1.7 KiB/s wr, 11 op/s 2023-07-14T18:11:53.257 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:53.216+0000 7fed9f7a8700 1 -- 172.21.15.163:0/1678293387 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fed98101830 msgr2=0x7fed98109d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:11:53.257 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:53.216+0000 7fed9f7a8700 1 --2- 172.21.15.163:0/1678293387 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fed98101830 0x7fed98109d30 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fed88009990 tx=0x7fed88009ca0 comp rx=0 tx=0).stop 2023-07-14T18:11:53.257 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:53.216+0000 7fed9f7a8700 1 -- 172.21.15.163:0/1678293387 shutdown_connections 2023-07-14T18:11:53.257 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:53.216+0000 7fed9f7a8700 1 --2- 172.21.15.163:0/1678293387 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fed9810a270 0x7fed9810c6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:53.258 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:53.216+0000 7fed9f7a8700 1 --2- 172.21.15.163:0/1678293387 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fed98100f20 0x7fed981012f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:53.258 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:53.216+0000 7fed9f7a8700 1 --2- 172.21.15.163:0/1678293387 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fed98101830 0x7fed98109d30 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:53.258 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:53.216+0000 7fed9f7a8700 1 -- 172.21.15.163:0/1678293387 >> 172.21.15.163:0/1678293387 conn(0x7fed98075ca0 msgr2=0x7fed980760a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:11:53.258 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:53.217+0000 7fed9f7a8700 1 -- 172.21.15.163:0/1678293387 shutdown_connections 2023-07-14T18:11:53.258 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:53.217+0000 7fed9f7a8700 1 -- 172.21.15.163:0/1678293387 wait complete. 2023-07-14T18:11:53.260 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:53.217+0000 7fed9f7a8700 1 Processor -- start 2023-07-14T18:11:53.260 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:53.217+0000 7fed9f7a8700 1 -- start start 2023-07-14T18:11:53.260 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:53.217+0000 7fed9f7a8700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fed98100f20 0x7fed980feb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:11:53.260 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:53.217+0000 7fed9f7a8700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fed98101830 0x7fed980ff0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:11:53.260 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:53.217+0000 7fed9f7a8700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fed9810a270 0x7fed980ff640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:11:53.260 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:53.217+0000 7fed9f7a8700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed981a4180 con 0x7fed9810a270 2023-07-14T18:11:53.260 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:53.217+0000 7fed9f7a8700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed981a42f0 con 0x7fed98101830 2023-07-14T18:11:53.261 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:53.217+0000 7fed9f7a8700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed981a44b0 con 0x7fed98100f20 2023-07-14T18:11:53.261 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:53.217+0000 7fed9dd45700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fed9810a270 0x7fed980ff640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:11:53.261 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:53.218+0000 7fed9dd45700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fed9810a270 0x7fed980ff640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:56540/0 (socket says 172.21.15.163:56540) 2023-07-14T18:11:53.261 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:53.218+0000 7fed9dd45700 1 -- 172.21.15.163:0/4055086198 learned_addr learned my addr 172.21.15.163:0/4055086198 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:11:53.261 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:53.218+0000 7fed9cd43700 1 --2- 172.21.15.163:0/4055086198 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fed98101830 0x7fed980ff0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:11:53.261 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:53.218+0000 7fed9d544700 1 --2- 172.21.15.163:0/4055086198 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fed98100f20 0x7fed980feb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:11:53.261 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:53.218+0000 7fed9dd45700 1 -- 172.21.15.163:0/4055086198 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fed98100f20 msgr2=0x7fed980feb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:11:53.262 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:53.218+0000 7fed9dd45700 1 --2- 172.21.15.163:0/4055086198 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fed98100f20 0x7fed980feb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:53.262 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:53.218+0000 7fed9dd45700 1 -- 172.21.15.163:0/4055086198 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fed98101830 msgr2=0x7fed980ff0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:11:53.262 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:53.218+0000 7fed9dd45700 1 --2- 172.21.15.163:0/4055086198 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fed98101830 0x7fed980ff0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:53.262 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:53.218+0000 7fed9dd45700 1 -- 172.21.15.163:0/4055086198 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed880095f0 con 0x7fed9810a270 2023-07-14T18:11:53.262 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:53.218+0000 7fed9cd43700 1 --2- 172.21.15.163:0/4055086198 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fed98101830 0x7fed980ff0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T18:11:53.262 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:53.218+0000 7fed9dd45700 1 --2- 172.21.15.163:0/4055086198 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fed9810a270 0x7fed980ff640 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fed9000b9e0 tx=0x7fed9000bda0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:11:53.262 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:53.218+0000 7fed8e7fc700 1 -- 172.21.15.163:0/4055086198 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed9000c950 con 0x7fed9810a270 2023-07-14T18:11:53.262 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:53.218+0000 7fed8e7fc700 1 -- 172.21.15.163:0/4055086198 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fed90014440 con 0x7fed9810a270 2023-07-14T18:11:53.263 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:53.218+0000 7fed9f7a8700 1 -- 172.21.15.163:0/4055086198 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fed981a4790 con 0x7fed9810a270 2023-07-14T18:11:53.263 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:53.218+0000 7fed8e7fc700 1 -- 172.21.15.163:0/4055086198 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed900075d0 con 0x7fed9810a270 2023-07-14T18:11:53.263 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:53.218+0000 7fed9f7a8700 1 -- 172.21.15.163:0/4055086198 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed981a4c90 con 0x7fed9810a270 2023-07-14T18:11:53.263 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:53.219+0000 7fed9f7a8700 1 -- 172.21.15.163:0/4055086198 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fed9804e340 con 0x7fed9810a270 2023-07-14T18:11:53.264 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:53.221+0000 7fed8e7fc700 1 -- 172.21.15.163:0/4055086198 <== mon.0 v2:172.21.15.163:3300/0 4 ==== mgrmap(e 17) v1 ==== 135767+0+0 (secure 0 0 0) 0x7fed900145b0 con 0x7fed9810a270 2023-07-14T18:11:53.264 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:53.221+0000 7fed8e7fc700 1 --2- 172.21.15.163:0/4055086198 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7fed840a11e0 0x7fed840a3690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:11:53.264 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:53.222+0000 7fed8e7fc700 1 -- 172.21.15.163:0/4055086198 <== mon.0 v2:172.21.15.163:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 8730+0+0 (secure 0 0 0) 0x7fed90006e40 con 0x7fed9810a270 2023-07-14T18:11:53.264 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:53.222+0000 7fed9d544700 1 --2- 172.21.15.163:0/4055086198 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7fed840a11e0 0x7fed840a3690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:11:53.265 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:53.222+0000 7fed8e7fc700 1 --2- 172.21.15.163:0/4055086198 >> [v2:172.21.15.184:6816/290154343,v1:172.21.15.184:6817/290154343] conn(0x7fed840abd50 0x7fed840ae180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:11:53.265 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:53.222+0000 7fed8e7fc700 1 -- 172.21.15.163:0/4055086198 --> [v2:172.21.15.184:6816/290154343,v1:172.21.15.184:6817/290154343] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fed840ae850 con 0x7fed840abd50 2023-07-14T18:11:53.265 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:53.222+0000 7fed8e7fc700 1 -- 172.21.15.163:0/4055086198 <== mon.0 v2:172.21.15.163:3300/0 6 ==== mon_get_version_reply(handle=1 version=84) v2 ==== 24+0+0 (secure 0 0 0) 0x7fed900cd0c0 con 0x7fed9810a270 2023-07-14T18:11:53.265 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:53.222+0000 7fed9cd43700 1 --2- 172.21.15.163:0/4055086198 >> [v2:172.21.15.184:6816/290154343,v1:172.21.15.184:6817/290154343] conn(0x7fed840abd50 0x7fed840ae180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:11:53.265 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:53.222+0000 7fed9d544700 1 --2- 172.21.15.163:0/4055086198 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7fed840a11e0 0x7fed840a3690 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fed94009bf0 tx=0x7fed94009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:11:53.265 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:53.222+0000 7fed9cd43700 1 --2- 172.21.15.163:0/4055086198 >> [v2:172.21.15.184:6816/290154343,v1:172.21.15.184:6817/290154343] conn(0x7fed840abd50 0x7fed840ae180 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:11:53.265 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:53.223+0000 7fed8e7fc700 1 -- 172.21.15.163:0/4055086198 <== osd.8 v2:172.21.15.184:6816/290154343 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7fed840ae850 con 0x7fed840abd50 2023-07-14T18:11:53.275 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:11:52 smithi172 ceph-mon[97983]: pgmap v272: 129 pgs: 129 active+clean; 641 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 1.7 KiB/s wr, 11 op/s 2023-07-14T18:11:53.279 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:53.239+0000 7fed9f7a8700 1 -- 172.21.15.163:0/4055086198 --> [v2:172.21.15.184:6816/290154343,v1:172.21.15.184:6817/290154343] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fed9810fd80 con 0x7fed840abd50 2023-07-14T18:11:53.280 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:53.240+0000 7fed8e7fc700 1 -- 172.21.15.163:0/4055086198 <== osd.8 v2:172.21.15.184:6816/290154343 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7fed8801e040 con 0x7fed840abd50 2023-07-14T18:11:53.281 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:53.240+0000 7fed9f7a8700 1 -- 172.21.15.163:0/4055086198 >> [v2:172.21.15.184:6816/290154343,v1:172.21.15.184:6817/290154343] conn(0x7fed840abd50 msgr2=0x7fed840ae180 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:11:53.281 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:53.240+0000 7fed9f7a8700 1 --2- 172.21.15.163:0/4055086198 >> [v2:172.21.15.184:6816/290154343,v1:172.21.15.184:6817/290154343] conn(0x7fed840abd50 0x7fed840ae180 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:53.281 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:53.240+0000 7fed9f7a8700 1 -- 172.21.15.163:0/4055086198 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7fed840a11e0 msgr2=0x7fed840a3690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:11:53.281 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:53.240+0000 7fed9f7a8700 1 --2- 172.21.15.163:0/4055086198 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7fed840a11e0 0x7fed840a3690 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fed94009bf0 tx=0x7fed94009260 comp rx=0 tx=0).stop 2023-07-14T18:11:53.281 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:53.240+0000 7fed9f7a8700 1 -- 172.21.15.163:0/4055086198 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fed9810a270 msgr2=0x7fed980ff640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:11:53.282 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:53.240+0000 7fed9f7a8700 1 --2- 172.21.15.163:0/4055086198 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fed9810a270 0x7fed980ff640 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fed9000b9e0 tx=0x7fed9000bda0 comp rx=0 tx=0).stop 2023-07-14T18:11:53.282 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:53.240+0000 7fed9dd45700 1 -- 172.21.15.163:0/4055086198 reap_dead start 2023-07-14T18:11:53.282 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:53.240+0000 7fed9f7a8700 1 -- 172.21.15.163:0/4055086198 shutdown_connections 2023-07-14T18:11:53.282 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:53.240+0000 7fed9f7a8700 1 -- 172.21.15.163:0/4055086198 >> 172.21.15.163:0/4055086198 conn(0x7fed98075ca0 msgr2=0x7fed98101c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:11:53.283 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:53.241+0000 7fed9f7a8700 1 -- 172.21.15.163:0/4055086198 shutdown_connections 2023-07-14T18:11:53.283 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:53.242+0000 7fed9f7a8700 1 -- 172.21.15.163:0/4055086198 wait complete. 2023-07-14T18:11:53.515 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:53.286+0000 7f7ce94bf700 1 -- 172.21.15.163:0/3540795199 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f7ce40fee40 msgr2=0x7f7ce40ff210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:11:53.515 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:53.286+0000 7f7ce94bf700 1 --2- 172.21.15.163:0/3540795199 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f7ce40fee40 0x7f7ce40ff210 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f7cd80099c0 tx=0x7f7cd8009cd0 comp rx=0 tx=0).stop 2023-07-14T18:11:53.516 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:53.286+0000 7f7ce94bf700 1 -- 172.21.15.163:0/3540795199 shutdown_connections 2023-07-14T18:11:53.516 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:53.286+0000 7f7ce94bf700 1 --2- 172.21.15.163:0/3540795199 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7ce4103ee0 0x7f7ce410ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:53.516 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:53.286+0000 7f7ce94bf700 1 --2- 172.21.15.163:0/3540795199 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f7ce40fee40 0x7f7ce40ff210 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:53.516 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:53.286+0000 7f7ce94bf700 1 --2- 172.21.15.163:0/3540795199 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7ce40ff7e0 0x7f7ce41037b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:53.516 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:53.286+0000 7f7ce94bf700 1 -- 172.21.15.163:0/3540795199 >> 172.21.15.163:0/3540795199 conn(0x7f7ce4075ca0 msgr2=0x7f7ce40760a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:11:53.516 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:53.286+0000 7f7ce94bf700 1 -- 172.21.15.163:0/3540795199 shutdown_connections 2023-07-14T18:11:53.517 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:53.286+0000 7f7ce94bf700 1 -- 172.21.15.163:0/3540795199 wait complete. 2023-07-14T18:11:53.517 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:53.287+0000 7f7ce94bf700 1 Processor -- start 2023-07-14T18:11:53.517 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:53.287+0000 7f7ce94bf700 1 -- start start 2023-07-14T18:11:53.517 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:53.287+0000 7f7ce94bf700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f7ce40fee40 0x7f7ce419a9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:11:53.517 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:53.287+0000 7f7ce94bf700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7ce40ff7e0 0x7f7ce419aef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:11:53.517 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:53.287+0000 7f7ce94bf700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7ce4103ee0 0x7f7ce4194a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:11:53.517 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:53.287+0000 7f7ce94bf700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ce41950a0 con 0x7f7ce40fee40 2023-07-14T18:11:53.517 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:53.287+0000 7f7ce94bf700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ce4195210 con 0x7f7ce4103ee0 2023-07-14T18:11:53.518 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:53.287+0000 7f7ce94bf700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ce41953d0 con 0x7f7ce40ff7e0 2023-07-14T18:11:53.518 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:53.287+0000 7f7ce2ffd700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f7ce40fee40 0x7f7ce419a9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:11:53.518 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:53.287+0000 7f7ce2ffd700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f7ce40fee40 0x7f7ce419a9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:56552/0 (socket says 172.21.15.163:56552) 2023-07-14T18:11:53.518 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:53.287+0000 7f7ce2ffd700 1 -- 172.21.15.163:0/3984362241 learned_addr learned my addr 172.21.15.163:0/3984362241 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:11:53.518 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:53.287+0000 7f7ce37fe700 1 --2- 172.21.15.163:0/3984362241 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7ce4103ee0 0x7f7ce4194a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:11:53.518 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:53.287+0000 7f7ce27fc700 1 --2- 172.21.15.163:0/3984362241 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7ce40ff7e0 0x7f7ce419aef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:11:53.518 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:53.287+0000 7f7ce2ffd700 1 -- 172.21.15.163:0/3984362241 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7ce40ff7e0 msgr2=0x7f7ce419aef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:11:53.518 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:53.287+0000 7f7ce2ffd700 1 --2- 172.21.15.163:0/3984362241 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7ce40ff7e0 0x7f7ce419aef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:53.519 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:53.287+0000 7f7ce2ffd700 1 -- 172.21.15.163:0/3984362241 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7ce4103ee0 msgr2=0x7f7ce4194a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:11:53.519 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:53.287+0000 7f7ce2ffd700 1 --2- 172.21.15.163:0/3984362241 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7ce4103ee0 0x7f7ce4194a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:53.519 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:53.287+0000 7f7ce2ffd700 1 -- 172.21.15.163:0/3984362241 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7cd4009520 con 0x7f7ce40fee40 2023-07-14T18:11:53.519 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:53.288+0000 7f7ce2ffd700 1 --2- 172.21.15.163:0/3984362241 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f7ce40fee40 0x7f7ce419a9b0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f7cd8009fd0 tx=0x7f7cd800f740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:11:53.519 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:53.288+0000 7f7ccbfff700 1 -- 172.21.15.163:0/3984362241 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cd801d070 con 0x7f7ce40fee40 2023-07-14T18:11:53.519 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:53.288+0000 7f7ce94bf700 1 -- 172.21.15.163:0/3984362241 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7cd80095f0 con 0x7f7ce40fee40 2023-07-14T18:11:53.519 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:53.288+0000 7f7ccbfff700 1 -- 172.21.15.163:0/3984362241 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f7cd80054c0 con 0x7f7ce40fee40 2023-07-14T18:11:53.520 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:53.288+0000 7f7ccbfff700 1 -- 172.21.15.163:0/3984362241 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cd8004b30 con 0x7f7ce40fee40 2023-07-14T18:11:53.520 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:53.288+0000 7f7ce94bf700 1 -- 172.21.15.163:0/3984362241 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ce41a17d0 con 0x7f7ce40fee40 2023-07-14T18:11:53.520 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:53.289+0000 7f7ce94bf700 1 -- 172.21.15.163:0/3984362241 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f7ce410ec50 con 0x7f7ce40fee40 2023-07-14T18:11:53.520 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:53.290+0000 7f7ccbfff700 1 -- 172.21.15.163:0/3984362241 <== mon.0 v2:172.21.15.163:3300/0 4 ==== mgrmap(e 17) v1 ==== 135767+0+0 (secure 0 0 0) 0x7f7cd800fc30 con 0x7f7ce40fee40 2023-07-14T18:11:53.520 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:53.290+0000 7f7ccbfff700 1 --2- 172.21.15.163:0/3984362241 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f7ccc0a11e0 0x7f7ccc0a3690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:11:53.521 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:53.291+0000 7f7ce27fc700 1 --2- 172.21.15.163:0/3984362241 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f7ccc0a11e0 0x7f7ccc0a3690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:11:53.521 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:53.291+0000 7f7ccbfff700 1 -- 172.21.15.163:0/3984362241 <== mon.0 v2:172.21.15.163:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 8730+0+0 (secure 0 0 0) 0x7f7cd80ce190 con 0x7f7ce40fee40 2023-07-14T18:11:53.521 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:53.291+0000 7f7ccbfff700 1 --2- 172.21.15.163:0/3984362241 >> [v2:172.21.15.163:6818/2530874117,v1:172.21.15.163:6819/2530874117] conn(0x7f7ccc0abd50 0x7f7ccc0ae180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:11:53.521 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:53.291+0000 7f7ccbfff700 1 -- 172.21.15.163:0/3984362241 --> [v2:172.21.15.163:6818/2530874117,v1:172.21.15.163:6819/2530874117] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f7ccc0ae850 con 0x7f7ccc0abd50 2023-07-14T18:11:53.521 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:53.291+0000 7f7ccbfff700 1 -- 172.21.15.163:0/3984362241 <== mon.0 v2:172.21.15.163:3300/0 6 ==== mon_get_version_reply(handle=1 version=84) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7cd80ce630 con 0x7f7ce40fee40 2023-07-14T18:11:53.521 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:53.291+0000 7f7ce37fe700 1 --2- 172.21.15.163:0/3984362241 >> [v2:172.21.15.163:6818/2530874117,v1:172.21.15.163:6819/2530874117] conn(0x7f7ccc0abd50 0x7f7ccc0ae180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:11:53.521 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:53.291+0000 7f7ce27fc700 1 --2- 172.21.15.163:0/3984362241 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f7ccc0a11e0 0x7f7ccc0a3690 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f7ce4077340 tx=0x7f7cd4009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:11:53.522 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:53.291+0000 7f7ce37fe700 1 --2- 172.21.15.163:0/3984362241 >> [v2:172.21.15.163:6818/2530874117,v1:172.21.15.163:6819/2530874117] conn(0x7f7ccc0abd50 0x7f7ccc0ae180 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:11:53.522 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:53.292+0000 7f7ccbfff700 1 -- 172.21.15.163:0/3984362241 <== osd.6 v2:172.21.15.163:6818/2530874117 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f7ccc0ae850 con 0x7f7ccc0abd50 2023-07-14T18:11:53.522 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:53.308+0000 7f7ce94bf700 1 -- 172.21.15.163:0/3984362241 --> [v2:172.21.15.163:6818/2530874117,v1:172.21.15.163:6819/2530874117] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f7ce40fcec0 con 0x7f7ccc0abd50 2023-07-14T18:11:53.522 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:53.308+0000 7f7ccbfff700 1 -- 172.21.15.163:0/3984362241 <== osd.6 v2:172.21.15.163:6818/2530874117 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7f7ce40fcec0 con 0x7f7ccc0abd50 2023-07-14T18:11:53.522 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:53.308+0000 7f7ce94bf700 1 -- 172.21.15.163:0/3984362241 >> [v2:172.21.15.163:6818/2530874117,v1:172.21.15.163:6819/2530874117] conn(0x7f7ccc0abd50 msgr2=0x7f7ccc0ae180 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:11:53.522 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:53.308+0000 7f7ce94bf700 1 --2- 172.21.15.163:0/3984362241 >> [v2:172.21.15.163:6818/2530874117,v1:172.21.15.163:6819/2530874117] conn(0x7f7ccc0abd50 0x7f7ccc0ae180 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:53.522 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:53.309+0000 7f7ce94bf700 1 -- 172.21.15.163:0/3984362241 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f7ccc0a11e0 msgr2=0x7f7ccc0a3690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:11:53.522 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:53.309+0000 7f7ce94bf700 1 --2- 172.21.15.163:0/3984362241 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f7ccc0a11e0 0x7f7ccc0a3690 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f7ce4077340 tx=0x7f7cd4009260 comp rx=0 tx=0).stop 2023-07-14T18:11:53.523 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:53.309+0000 7f7ce94bf700 1 -- 172.21.15.163:0/3984362241 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f7ce40fee40 msgr2=0x7f7ce419a9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:11:53.523 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:53.309+0000 7f7ce94bf700 1 --2- 172.21.15.163:0/3984362241 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f7ce40fee40 0x7f7ce419a9b0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f7cd8009fd0 tx=0x7f7cd800f740 comp rx=0 tx=0).stop 2023-07-14T18:11:53.523 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:53.309+0000 7f7ce37fe700 1 -- 172.21.15.163:0/3984362241 reap_dead start 2023-07-14T18:11:53.523 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:53.309+0000 7f7ce94bf700 1 -- 172.21.15.163:0/3984362241 shutdown_connections 2023-07-14T18:11:53.523 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:53.309+0000 7f7ce94bf700 1 -- 172.21.15.163:0/3984362241 >> 172.21.15.163:0/3984362241 conn(0x7f7ce4075ca0 msgr2=0x7f7ce40fc4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:11:53.523 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:53.309+0000 7f7ce94bf700 1 -- 172.21.15.163:0/3984362241 shutdown_connections 2023-07-14T18:11:53.523 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:53.309+0000 7f7ce94bf700 1 -- 172.21.15.163:0/3984362241 wait complete. 2023-07-14T18:11:53.921 INFO:teuthology.orchestra.run.smithi163.stdout:34359738434 2023-07-14T18:11:53.922 DEBUG:teuthology.orchestra.run.smithi163:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81c9387d2e7576da065747ec9c16d1c7d69016ec shell --fsid bf7326ec-2270-11ee-9b33-001a4aab830c -- ceph osd last-stat-seq osd.0 2023-07-14T18:11:54.130 INFO:teuthology.orchestra.run.smithi163.stdout:240518168609 2023-07-14T18:11:54.131 DEBUG:teuthology.orchestra.run.smithi163:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81c9387d2e7576da065747ec9c16d1c7d69016ec shell --fsid bf7326ec-2270-11ee-9b33-001a4aab830c -- ceph osd last-stat-seq osd.8 2023-07-14T18:11:54.622 INFO:teuthology.orchestra.run.smithi163.stdout:322122547220 2023-07-14T18:11:54.623 DEBUG:teuthology.orchestra.run.smithi163:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81c9387d2e7576da065747ec9c16d1c7d69016ec shell --fsid bf7326ec-2270-11ee-9b33-001a4aab830c -- ceph osd last-stat-seq osd.11 2023-07-14T18:11:54.645 INFO:teuthology.orchestra.run.smithi163.stdout:188978561065 2023-07-14T18:11:54.646 DEBUG:teuthology.orchestra.run.smithi163:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81c9387d2e7576da065747ec9c16d1c7d69016ec shell --fsid bf7326ec-2270-11ee-9b33-001a4aab830c -- ceph osd last-stat-seq osd.6 2023-07-14T18:11:54.803 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:54.762+0000 7fc9b1616700 1 -- 172.21.15.163:0/3925182486 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc9ac1007a0 msgr2=0x7fc9ac100c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:11:54.803 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:54.762+0000 7fc9b1616700 1 --2- 172.21.15.163:0/3925182486 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc9ac1007a0 0x7fc9ac100c10 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fc9a00099c0 tx=0x7fc9a0009cd0 comp rx=0 tx=0).stop 2023-07-14T18:11:54.804 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:54.762+0000 7fc9b1616700 1 -- 172.21.15.163:0/3925182486 shutdown_connections 2023-07-14T18:11:54.804 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:54.762+0000 7fc9b1616700 1 --2- 172.21.15.163:0/3925182486 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc9ac0fef40 0x7fc9ac0ff310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:54.804 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:54.762+0000 7fc9b1616700 1 --2- 172.21.15.163:0/3925182486 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc9ac101150 0x7fc9ac10bb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:54.804 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:54.762+0000 7fc9b1616700 1 --2- 172.21.15.163:0/3925182486 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc9ac1007a0 0x7fc9ac100c10 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:54.804 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:54.762+0000 7fc9b1616700 1 -- 172.21.15.163:0/3925182486 >> 172.21.15.163:0/3925182486 conn(0x7fc9ac075c90 msgr2=0x7fc9ac076090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:11:54.804 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:54.763+0000 7fc9b1616700 1 -- 172.21.15.163:0/3925182486 shutdown_connections 2023-07-14T18:11:54.804 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:54.763+0000 7fc9b1616700 1 -- 172.21.15.163:0/3925182486 wait complete. 2023-07-14T18:11:54.806 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:54.763+0000 7fc9b1616700 1 Processor -- start 2023-07-14T18:11:54.806 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:54.763+0000 7fc9b1616700 1 -- start start 2023-07-14T18:11:54.806 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:54.764+0000 7fc9b1616700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc9ac0fef40 0x7fc9ac110d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:11:54.806 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:54.764+0000 7fc9b1616700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc9ac1007a0 0x7fc9ac10f420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:11:54.806 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:54.764+0000 7fc9b1616700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc9ac101150 0x7fc9ac10f960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:11:54.806 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:54.764+0000 7fc9b1616700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9ac10ff30 con 0x7fc9ac101150 2023-07-14T18:11:54.807 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:54.764+0000 7fc9b1616700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9ac1100a0 con 0x7fc9ac0fef40 2023-07-14T18:11:54.807 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:54.764+0000 7fc9b1616700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9ac110260 con 0x7fc9ac1007a0 2023-07-14T18:11:54.807 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:54.764+0000 7fc9ab7fe700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc9ac101150 0x7fc9ac10f960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:11:54.807 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:54.764+0000 7fc9ab7fe700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc9ac101150 0x7fc9ac10f960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:56568/0 (socket says 172.21.15.163:56568) 2023-07-14T18:11:54.807 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:54.764+0000 7fc9ab7fe700 1 -- 172.21.15.163:0/3691726788 learned_addr learned my addr 172.21.15.163:0/3691726788 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:11:54.807 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:54.764+0000 7fc9aaffd700 1 --2- 172.21.15.163:0/3691726788 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc9ac0fef40 0x7fc9ac110d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:11:54.807 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:54.764+0000 7fc9aa7fc700 1 --2- 172.21.15.163:0/3691726788 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc9ac1007a0 0x7fc9ac10f420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:11:54.808 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:54.764+0000 7fc9ab7fe700 1 -- 172.21.15.163:0/3691726788 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc9ac1007a0 msgr2=0x7fc9ac10f420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:11:54.808 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:54.764+0000 7fc9ab7fe700 1 --2- 172.21.15.163:0/3691726788 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc9ac1007a0 0x7fc9ac10f420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:54.808 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:54.764+0000 7fc9ab7fe700 1 -- 172.21.15.163:0/3691726788 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc9ac0fef40 msgr2=0x7fc9ac110d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:11:54.808 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:54.764+0000 7fc9ab7fe700 1 --2- 172.21.15.163:0/3691726788 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc9ac0fef40 0x7fc9ac110d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:54.808 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:54.764+0000 7fc9ab7fe700 1 -- 172.21.15.163:0/3691726788 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9a00095f0 con 0x7fc9ac101150 2023-07-14T18:11:54.808 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:54.765+0000 7fc9aa7fc700 1 --2- 172.21.15.163:0/3691726788 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc9ac1007a0 0x7fc9ac10f420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T18:11:54.808 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:54.765+0000 7fc9ab7fe700 1 --2- 172.21.15.163:0/3691726788 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc9ac101150 0x7fc9ac10f960 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fc9a400add0 tx=0x7fc9a400c330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:11:54.809 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:54.765+0000 7fc993fff700 1 -- 172.21.15.163:0/3691726788 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9a400f070 con 0x7fc9ac101150 2023-07-14T18:11:54.809 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:54.765+0000 7fc993fff700 1 -- 172.21.15.163:0/3691726788 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fc9a400ae00 con 0x7fc9ac101150 2023-07-14T18:11:54.809 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:54.765+0000 7fc993fff700 1 -- 172.21.15.163:0/3691726788 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9a4005280 con 0x7fc9ac101150 2023-07-14T18:11:54.809 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:54.765+0000 7fc9b1616700 1 -- 172.21.15.163:0/3691726788 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc9ac1a4820 con 0x7fc9ac101150 2023-07-14T18:11:54.809 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:54.765+0000 7fc9b1616700 1 -- 172.21.15.163:0/3691726788 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9ac1a4ca0 con 0x7fc9ac101150 2023-07-14T18:11:54.810 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:54.766+0000 7fc9b1616700 1 -- 172.21.15.163:0/3691726788 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fc9ac04e340 con 0x7fc9ac101150 2023-07-14T18:11:54.810 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:54.769+0000 7fc993fff700 1 -- 172.21.15.163:0/3691726788 <== mon.0 v2:172.21.15.163:3300/0 4 ==== mgrmap(e 17) v1 ==== 135767+0+0 (secure 0 0 0) 0x7fc9a400c890 con 0x7fc9ac101150 2023-07-14T18:11:54.810 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:54.770+0000 7fc993fff700 1 --2- 172.21.15.163:0/3691726788 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7fc9940a11e0 0x7fc9940a3690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:11:54.811 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:54.770+0000 7fc993fff700 1 -- 172.21.15.163:0/3691726788 <== mon.0 v2:172.21.15.163:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 8730+0+0 (secure 0 0 0) 0x7fc9a40ccfb0 con 0x7fc9ac101150 2023-07-14T18:11:54.811 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:54.770+0000 7fc9aaffd700 1 --2- 172.21.15.163:0/3691726788 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7fc9940a11e0 0x7fc9940a3690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:11:54.811 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:54.770+0000 7fc993fff700 1 --2- 172.21.15.163:0/3691726788 >> [v2:172.21.15.184:6800/1976927678,v1:172.21.15.184:6801/1976927678] conn(0x7fc9940abd50 0x7fc9940ae180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:11:54.811 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:54.770+0000 7fc993fff700 1 -- 172.21.15.163:0/3691726788 --> [v2:172.21.15.184:6800/1976927678,v1:172.21.15.184:6801/1976927678] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fc9940ae850 con 0x7fc9940abd50 2023-07-14T18:11:54.811 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:54.770+0000 7fc993fff700 1 -- 172.21.15.163:0/3691726788 <== mon.0 v2:172.21.15.163:3300/0 6 ==== mon_get_version_reply(handle=1 version=84) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc9a40cd3c0 con 0x7fc9ac101150 2023-07-14T18:11:54.811 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:54.770+0000 7fc9aa7fc700 1 --2- 172.21.15.163:0/3691726788 >> [v2:172.21.15.184:6800/1976927678,v1:172.21.15.184:6801/1976927678] conn(0x7fc9940abd50 0x7fc9940ae180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:11:54.811 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:54.770+0000 7fc9aaffd700 1 --2- 172.21.15.163:0/3691726788 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7fc9940a11e0 0x7fc9940a3690 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fc99c009c60 tx=0x7fc99c009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:11:54.812 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:54.771+0000 7fc9aa7fc700 1 --2- 172.21.15.163:0/3691726788 >> [v2:172.21.15.184:6800/1976927678,v1:172.21.15.184:6801/1976927678] conn(0x7fc9940abd50 0x7fc9940ae180 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:11:54.813 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:54.773+0000 7fc993fff700 1 -- 172.21.15.163:0/3691726788 <== osd.2 v2:172.21.15.184:6800/1976927678 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7fc9940ae850 con 0x7fc9940abd50 2023-07-14T18:11:54.833 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:54.793+0000 7fc9b1616700 1 -- 172.21.15.163:0/3691726788 --> [v2:172.21.15.184:6800/1976927678,v1:172.21.15.184:6801/1976927678] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fc9ac068d70 con 0x7fc9940abd50 2023-07-14T18:11:54.834 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:54.794+0000 7fc993fff700 1 -- 172.21.15.163:0/3691726788 <== osd.2 v2:172.21.15.184:6800/1976927678 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fc9ac068d70 con 0x7fc9940abd50 2023-07-14T18:11:54.834 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:54.794+0000 7fc9b1616700 1 -- 172.21.15.163:0/3691726788 >> [v2:172.21.15.184:6800/1976927678,v1:172.21.15.184:6801/1976927678] conn(0x7fc9940abd50 msgr2=0x7fc9940ae180 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:11:54.834 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:54.794+0000 7fc9b1616700 1 --2- 172.21.15.163:0/3691726788 >> [v2:172.21.15.184:6800/1976927678,v1:172.21.15.184:6801/1976927678] conn(0x7fc9940abd50 0x7fc9940ae180 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:54.835 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:54.794+0000 7fc9b1616700 1 -- 172.21.15.163:0/3691726788 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7fc9940a11e0 msgr2=0x7fc9940a3690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:11:54.835 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:54.794+0000 7fc9b1616700 1 --2- 172.21.15.163:0/3691726788 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7fc9940a11e0 0x7fc9940a3690 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fc99c009c60 tx=0x7fc99c009260 comp rx=0 tx=0).stop 2023-07-14T18:11:54.835 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:54.794+0000 7fc9b1616700 1 -- 172.21.15.163:0/3691726788 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc9ac101150 msgr2=0x7fc9ac10f960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:11:54.835 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:54.794+0000 7fc9b1616700 1 --2- 172.21.15.163:0/3691726788 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc9ac101150 0x7fc9ac10f960 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fc9a400add0 tx=0x7fc9a400c330 comp rx=0 tx=0).stop 2023-07-14T18:11:54.836 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:54.794+0000 7fc9ab7fe700 1 -- 172.21.15.163:0/3691726788 reap_dead start 2023-07-14T18:11:54.836 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:54.794+0000 7fc9b1616700 1 -- 172.21.15.163:0/3691726788 shutdown_connections 2023-07-14T18:11:54.836 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:54.794+0000 7fc9b1616700 1 -- 172.21.15.163:0/3691726788 >> 172.21.15.163:0/3691726788 conn(0x7fc9ac075c90 msgr2=0x7fc9ac068420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:11:54.836 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:54.795+0000 7fc9b1616700 1 -- 172.21.15.163:0/3691726788 shutdown_connections 2023-07-14T18:11:54.836 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:54.795+0000 7fc9b1616700 1 -- 172.21.15.163:0/3691726788 wait complete. 2023-07-14T18:11:54.846 INFO:teuthology.orchestra.run.smithi163.stdout:158913789996 2023-07-14T18:11:54.847 DEBUG:teuthology.orchestra.run.smithi163:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81c9387d2e7576da065747ec9c16d1c7d69016ec shell --fsid bf7326ec-2270-11ee-9b33-001a4aab830c -- ceph osd last-stat-seq osd.5 2023-07-14T18:11:54.941 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:54.900+0000 7f7941924700 1 --2- 172.21.15.163:0/2314556565 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f793c0febc0 0x7f793c10cb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T18:11:54.942 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:54.901+0000 7f7943387700 1 -- 172.21.15.163:0/2314556565 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f793c0fe210 msgr2=0x7f793c0fe680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:11:54.942 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:54.901+0000 7f7943387700 1 --2- 172.21.15.163:0/2314556565 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f793c0fe210 0x7f793c0fe680 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f792c009990 tx=0x7f792c009ca0 comp rx=0 tx=0).stop 2023-07-14T18:11:54.945 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:54.904+0000 7f7943387700 1 -- 172.21.15.163:0/2314556565 shutdown_connections 2023-07-14T18:11:54.945 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:54.904+0000 7f7943387700 1 --2- 172.21.15.163:0/2314556565 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f793c0febc0 0x7f793c10cb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:54.945 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:54.904+0000 7f7943387700 1 --2- 172.21.15.163:0/2314556565 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f793c104c70 0x7f793c105040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:54.945 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:54.904+0000 7f7943387700 1 --2- 172.21.15.163:0/2314556565 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f793c0fe210 0x7f793c0fe680 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:54.945 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:54.904+0000 7f7943387700 1 -- 172.21.15.163:0/2314556565 >> 172.21.15.163:0/2314556565 conn(0x7f793c075280 msgr2=0x7f793c075680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:11:54.945 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:54.904+0000 7f7943387700 1 -- 172.21.15.163:0/2314556565 shutdown_connections 2023-07-14T18:11:54.946 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:54.904+0000 7f7943387700 1 -- 172.21.15.163:0/2314556565 wait complete. 2023-07-14T18:11:54.947 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:54.905+0000 7f7943387700 1 Processor -- start 2023-07-14T18:11:54.947 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:54.905+0000 7f7943387700 1 -- start start 2023-07-14T18:11:54.947 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:54.906+0000 7f7943387700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f793c0fe210 0x7f793c113b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:11:54.947 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:54.906+0000 7f7943387700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f793c0febc0 0x7f793c1140a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:11:54.947 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:54.906+0000 7f7943387700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f793c104c70 0x7f793c10ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:11:54.948 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:54.906+0000 7f7943387700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f793c10f3c0 con 0x7f793c0fe210 2023-07-14T18:11:54.948 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:54.906+0000 7f7943387700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f793c10f530 con 0x7f793c104c70 2023-07-14T18:11:54.948 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:54.906+0000 7f7943387700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f793c10f6f0 con 0x7f793c0febc0 2023-07-14T18:11:54.948 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:54.906+0000 7f7941123700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f793c0fe210 0x7f793c113b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:11:54.948 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:54.906+0000 7f7941123700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f793c0fe210 0x7f793c113b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:56584/0 (socket says 172.21.15.163:56584) 2023-07-14T18:11:54.948 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:54.906+0000 7f7941123700 1 -- 172.21.15.163:0/3653674004 learned_addr learned my addr 172.21.15.163:0/3653674004 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:11:54.948 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:54.906+0000 7f7941924700 1 --2- 172.21.15.163:0/3653674004 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f793c104c70 0x7f793c10ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:11:54.949 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:54.906+0000 7f7940922700 1 --2- 172.21.15.163:0/3653674004 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f793c0febc0 0x7f793c1140a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:11:54.949 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:54.906+0000 7f7941123700 1 -- 172.21.15.163:0/3653674004 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f793c0febc0 msgr2=0x7f793c1140a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:11:54.949 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:54.906+0000 7f7941123700 1 --2- 172.21.15.163:0/3653674004 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f793c0febc0 0x7f793c1140a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:54.949 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:54.906+0000 7f7941123700 1 -- 172.21.15.163:0/3653674004 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f793c104c70 msgr2=0x7f793c10ebf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:11:54.949 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:54.906+0000 7f7941123700 1 --2- 172.21.15.163:0/3653674004 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f793c104c70 0x7f793c10ebf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:54.949 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:54.906+0000 7f7941123700 1 -- 172.21.15.163:0/3653674004 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f792c0095f0 con 0x7f793c0fe210 2023-07-14T18:11:54.949 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:54.906+0000 7f7941123700 1 --2- 172.21.15.163:0/3653674004 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f793c0fe210 0x7f793c113b40 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f793800d950 tx=0x7f793800dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:11:54.949 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:54.907+0000 7f79327fc700 1 -- 172.21.15.163:0/3653674004 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f793800f890 con 0x7f793c0fe210 2023-07-14T18:11:54.950 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:54.907+0000 7f7943387700 1 -- 172.21.15.163:0/3653674004 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f793c10f9d0 con 0x7f793c0fe210 2023-07-14T18:11:54.950 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:54.907+0000 7f79327fc700 1 -- 172.21.15.163:0/3653674004 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f793800fe80 con 0x7f793c0fe210 2023-07-14T18:11:54.950 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:54.907+0000 7f7943387700 1 -- 172.21.15.163:0/3653674004 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f793c119c00 con 0x7f793c0fe210 2023-07-14T18:11:54.950 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:54.907+0000 7f79327fc700 1 -- 172.21.15.163:0/3653674004 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f793800e3b0 con 0x7f793c0fe210 2023-07-14T18:11:54.951 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:54.909+0000 7f79327fc700 1 -- 172.21.15.163:0/3653674004 <== mon.0 v2:172.21.15.163:3300/0 4 ==== mgrmap(e 17) v1 ==== 135767+0+0 (secure 0 0 0) 0x7f7938010460 con 0x7f793c0fe210 2023-07-14T18:11:54.951 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:54.909+0000 7f79327fc700 1 --2- 172.21.15.163:0/3653674004 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f79280a1260 0x7f79280a3710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:11:54.951 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:54.909+0000 7f7940922700 1 --2- 172.21.15.163:0/3653674004 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f79280a1260 0x7f79280a3710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:11:54.951 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:54.909+0000 7f79327fc700 1 -- 172.21.15.163:0/3653674004 <== mon.0 v2:172.21.15.163:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 8730+0+0 (secure 0 0 0) 0x7f79380cccc0 con 0x7f793c0fe210 2023-07-14T18:11:54.951 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:54.910+0000 7f7943387700 1 --2- 172.21.15.163:0/3653674004 >> [v2:172.21.15.163:6810/2589130694,v1:172.21.15.163:6811/2589130694] conn(0x7f793c119e70 0x7f793c11a240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:11:54.952 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:54.910+0000 7f7943387700 1 -- 172.21.15.163:0/3653674004 --> [v2:172.21.15.163:6810/2589130694,v1:172.21.15.163:6811/2589130694] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f793c04e340 con 0x7f793c119e70 2023-07-14T18:11:54.952 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:54.910+0000 7f7941924700 1 --2- 172.21.15.163:0/3653674004 >> [v2:172.21.15.163:6810/2589130694,v1:172.21.15.163:6811/2589130694] conn(0x7f793c119e70 0x7f793c11a240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:11:54.952 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:54.910+0000 7f7940922700 1 --2- 172.21.15.163:0/3653674004 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f79280a1260 0x7f79280a3710 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f793c1062b0 tx=0x7f792c005c00 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:11:54.952 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:54.910+0000 7f7941924700 1 --2- 172.21.15.163:0/3653674004 >> [v2:172.21.15.163:6810/2589130694,v1:172.21.15.163:6811/2589130694] conn(0x7f793c119e70 0x7f793c11a240 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:11:54.952 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:54.911+0000 7f79327fc700 1 -- 172.21.15.163:0/3653674004 <== osd.3 v2:172.21.15.163:6810/2589130694 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f793c04e340 con 0x7f793c119e70 2023-07-14T18:11:54.967 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:54.927+0000 7f7943387700 1 -- 172.21.15.163:0/3653674004 --> [v2:172.21.15.163:6810/2589130694,v1:172.21.15.163:6811/2589130694] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f793c1076c0 con 0x7f793c119e70 2023-07-14T18:11:54.967 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:54.927+0000 7f79327fc700 1 -- 172.21.15.163:0/3653674004 <== osd.3 v2:172.21.15.163:6810/2589130694 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7f793c1076c0 con 0x7f793c119e70 2023-07-14T18:11:54.968 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:54.927+0000 7f7943387700 1 -- 172.21.15.163:0/3653674004 >> [v2:172.21.15.163:6810/2589130694,v1:172.21.15.163:6811/2589130694] conn(0x7f793c119e70 msgr2=0x7f793c11a240 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:11:54.968 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:54.927+0000 7f7943387700 1 --2- 172.21.15.163:0/3653674004 >> [v2:172.21.15.163:6810/2589130694,v1:172.21.15.163:6811/2589130694] conn(0x7f793c119e70 0x7f793c11a240 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:54.968 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:54.927+0000 7f7943387700 1 -- 172.21.15.163:0/3653674004 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f79280a1260 msgr2=0x7f79280a3710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:11:54.969 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:54.927+0000 7f7943387700 1 --2- 172.21.15.163:0/3653674004 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f79280a1260 0x7f79280a3710 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f793c1062b0 tx=0x7f792c005c00 comp rx=0 tx=0).stop 2023-07-14T18:11:54.969 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:54.927+0000 7f7943387700 1 -- 172.21.15.163:0/3653674004 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f793c0fe210 msgr2=0x7f793c113b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:11:54.969 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:54.927+0000 7f7943387700 1 --2- 172.21.15.163:0/3653674004 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f793c0fe210 0x7f793c113b40 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f793800d950 tx=0x7f793800dc60 comp rx=0 tx=0).stop 2023-07-14T18:11:54.969 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:54.928+0000 7f7941924700 1 -- 172.21.15.163:0/3653674004 reap_dead start 2023-07-14T18:11:54.969 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:54.928+0000 7f7943387700 1 -- 172.21.15.163:0/3653674004 shutdown_connections 2023-07-14T18:11:54.969 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:54.928+0000 7f7943387700 1 -- 172.21.15.163:0/3653674004 >> 172.21.15.163:0/3653674004 conn(0x7f793c075280 msgr2=0x7f793c106aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:11:54.969 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:54.928+0000 7f7943387700 1 -- 172.21.15.163:0/3653674004 shutdown_connections 2023-07-14T18:11:54.970 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:54.928+0000 7f7943387700 1 -- 172.21.15.163:0/3653674004 wait complete. 2023-07-14T18:11:55.174 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:11:54 smithi184 ceph-mon[98481]: pgmap v273: 129 pgs: 129 active+clean; 641 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 1.7 KiB/s wr, 12 op/s 2023-07-14T18:11:55.216 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:11:54 smithi163 ceph-mon[96576]: pgmap v273: 129 pgs: 129 active+clean; 641 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 1.7 KiB/s wr, 12 op/s 2023-07-14T18:11:55.275 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:11:54 smithi172 ceph-mon[97983]: pgmap v273: 129 pgs: 129 active+clean; 641 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 1.7 KiB/s wr, 12 op/s 2023-07-14T18:11:55.518 INFO:teuthology.orchestra.run.smithi163.stdout:210453397540 2023-07-14T18:11:55.519 DEBUG:teuthology.orchestra.run.smithi163:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81c9387d2e7576da065747ec9c16d1c7d69016ec shell --fsid bf7326ec-2270-11ee-9b33-001a4aab830c -- ceph osd last-stat-seq osd.7 2023-07-14T18:11:55.630 INFO:teuthology.orchestra.run.smithi163.stdout:107374182453 2023-07-14T18:11:55.631 DEBUG:teuthology.orchestra.run.smithi163:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81c9387d2e7576da065747ec9c16d1c7d69016ec shell --fsid bf7326ec-2270-11ee-9b33-001a4aab830c -- ceph osd last-stat-seq osd.3 2023-07-14T18:11:55.833 INFO:teuthology.orchestra.run.smithi163.stderr:Inferring config /var/lib/ceph/bf7326ec-2270-11ee-9b33-001a4aab830c/mon.a/config 2023-07-14T18:11:55.847 INFO:teuthology.orchestra.run.smithi163.stdout:77309411386 2023-07-14T18:11:55.847 DEBUG:teuthology.orchestra.run.smithi163:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81c9387d2e7576da065747ec9c16d1c7d69016ec shell --fsid bf7326ec-2270-11ee-9b33-001a4aab830c -- ceph osd last-stat-seq osd.2 2023-07-14T18:11:56.044 INFO:teuthology.orchestra.run.smithi163.stderr:Inferring config /var/lib/ceph/bf7326ec-2270-11ee-9b33-001a4aab830c/mon.a/config 2023-07-14T18:11:56.084 INFO:teuthology.orchestra.run.smithi163.stderr:Inferring config /var/lib/ceph/bf7326ec-2270-11ee-9b33-001a4aab830c/mon.a/config 2023-07-14T18:11:56.165 INFO:teuthology.orchestra.run.smithi163.stderr:Inferring config /var/lib/ceph/bf7326ec-2270-11ee-9b33-001a4aab830c/mon.a/config 2023-07-14T18:11:56.235 INFO:teuthology.orchestra.run.smithi163.stderr:Inferring config /var/lib/ceph/bf7326ec-2270-11ee-9b33-001a4aab830c/mon.a/config 2023-07-14T18:11:56.236 INFO:teuthology.orchestra.run.smithi163.stderr:Inferring config /var/lib/ceph/bf7326ec-2270-11ee-9b33-001a4aab830c/mon.a/config 2023-07-14T18:11:56.238 INFO:teuthology.orchestra.run.smithi163.stderr:Inferring config /var/lib/ceph/bf7326ec-2270-11ee-9b33-001a4aab830c/mon.a/config 2023-07-14T18:11:56.466 INFO:teuthology.orchestra.run.smithi163.stderr:Inferring config /var/lib/ceph/bf7326ec-2270-11ee-9b33-001a4aab830c/mon.a/config 2023-07-14T18:11:56.967 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:11:56 smithi163 ceph-mon[96576]: pgmap v274: 129 pgs: 129 active+clean; 641 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 426 B/s wr, 9 op/s 2023-07-14T18:11:57.174 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:11:56 smithi184 ceph-mon[98481]: pgmap v274: 129 pgs: 129 active+clean; 641 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 426 B/s wr, 9 op/s 2023-07-14T18:11:57.180 INFO:teuthology.orchestra.run.smithi163.stderr:Inferring config /var/lib/ceph/bf7326ec-2270-11ee-9b33-001a4aab830c/mon.a/config 2023-07-14T18:11:57.275 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:11:56 smithi172 ceph-mon[97983]: pgmap v274: 129 pgs: 129 active+clean; 641 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 426 B/s wr, 9 op/s 2023-07-14T18:11:57.524 INFO:teuthology.orchestra.run.smithi163.stderr:Inferring config /var/lib/ceph/bf7326ec-2270-11ee-9b33-001a4aab830c/mon.a/config 2023-07-14T18:11:58.966 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:11:58 smithi163 ceph-mon[96576]: pgmap v275: 129 pgs: 129 active+clean; 641 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 426 B/s wr, 8 op/s 2023-07-14T18:11:59.174 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:11:58 smithi184 ceph-mon[98481]: pgmap v275: 129 pgs: 129 active+clean; 641 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 426 B/s wr, 8 op/s 2023-07-14T18:11:59.275 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:11:58 smithi172 ceph-mon[97983]: pgmap v275: 129 pgs: 129 active+clean; 641 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 426 B/s wr, 8 op/s 2023-07-14T18:11:59.488 INFO:teuthology.orchestra.run.smithi163.stderr:Inferring config /var/lib/ceph/bf7326ec-2270-11ee-9b33-001a4aab830c/mon.a/config 2023-07-14T18:11:59.988 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:59.948+0000 7febc52eb700 1 -- 172.21.15.163:0/861285453 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7febc00fe550 msgr2=0x7febc00fe920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:11:59.988 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:59.948+0000 7febc52eb700 1 --2- 172.21.15.163:0/861285453 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7febc00fe550 0x7febc00fe920 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7febb00099c0 tx=0x7febb0009cd0 comp rx=0 tx=0).stop 2023-07-14T18:11:59.989 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:59.948+0000 7febc52eb700 1 -- 172.21.15.163:0/861285453 shutdown_connections 2023-07-14T18:11:59.989 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:59.948+0000 7febc52eb700 1 --2- 172.21.15.163:0/861285453 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7febc0105090 0x7febc010cc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:59.989 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:59.948+0000 7febc52eb700 1 --2- 172.21.15.163:0/861285453 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7febc00fe550 0x7febc00fe920 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:59.989 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:59.948+0000 7febc52eb700 1 --2- 172.21.15.163:0/861285453 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7febc00feef0 0x7febc0104960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:59.989 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:59.948+0000 7febc52eb700 1 -- 172.21.15.163:0/861285453 >> 172.21.15.163:0/861285453 conn(0x7febc00751e0 msgr2=0x7febc00755e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:11:59.989 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:59.948+0000 7febc52eb700 1 -- 172.21.15.163:0/861285453 shutdown_connections 2023-07-14T18:11:59.990 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:59.948+0000 7febc52eb700 1 -- 172.21.15.163:0/861285453 wait complete. 2023-07-14T18:11:59.991 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:59.949+0000 7febc52eb700 1 Processor -- start 2023-07-14T18:11:59.991 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:59.949+0000 7febc52eb700 1 -- start start 2023-07-14T18:11:59.992 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:59.949+0000 7febc52eb700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7febc00fe550 0x7febc019b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:11:59.992 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:59.949+0000 7febc52eb700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7febc00feef0 0x7febc019bf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:11:59.992 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:59.949+0000 7febc52eb700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7febc0105090 0x7febc0195a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:11:59.992 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:59.949+0000 7febc52eb700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febc01960c0 con 0x7febc00fe550 2023-07-14T18:11:59.992 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:59.949+0000 7febc52eb700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febc0196230 con 0x7febc00feef0 2023-07-14T18:11:59.992 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:59.949+0000 7febc52eb700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febc01963f0 con 0x7febc0105090 2023-07-14T18:11:59.992 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:59.949+0000 7febbeffd700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7febc00fe550 0x7febc019b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:11:59.993 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:59.949+0000 7febbeffd700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7febc00fe550 0x7febc019b9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:56598/0 (socket says 172.21.15.163:56598) 2023-07-14T18:11:59.993 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:59.949+0000 7febbeffd700 1 -- 172.21.15.163:0/1465288692 learned_addr learned my addr 172.21.15.163:0/1465288692 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:11:59.993 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:59.949+0000 7febbf7fe700 1 --2- 172.21.15.163:0/1465288692 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7febc0105090 0x7febc0195a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:11:59.993 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:59.949+0000 7febbe7fc700 1 --2- 172.21.15.163:0/1465288692 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7febc00feef0 0x7febc019bf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:11:59.993 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:59.950+0000 7febbeffd700 1 -- 172.21.15.163:0/1465288692 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7febc0105090 msgr2=0x7febc0195a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:11:59.993 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:59.950+0000 7febbeffd700 1 --2- 172.21.15.163:0/1465288692 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7febc0105090 0x7febc0195a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:59.993 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:59.950+0000 7febbeffd700 1 -- 172.21.15.163:0/1465288692 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7febc00feef0 msgr2=0x7febc019bf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:11:59.993 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:59.950+0000 7febbeffd700 1 --2- 172.21.15.163:0/1465288692 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7febc00feef0 0x7febc019bf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:11:59.994 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:59.950+0000 7febbeffd700 1 -- 172.21.15.163:0/1465288692 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febb00095f0 con 0x7febc00fe550 2023-07-14T18:11:59.994 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:59.950+0000 7febbf7fe700 1 --2- 172.21.15.163:0/1465288692 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7febc0105090 0x7febc0195a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T18:11:59.994 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:59.950+0000 7febbeffd700 1 --2- 172.21.15.163:0/1465288692 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7febc00fe550 0x7febc019b9d0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7febb0009f50 tx=0x7febb00047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:11:59.994 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:59.950+0000 7feba7fff700 1 -- 172.21.15.163:0/1465288692 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febb001d070 con 0x7febc00fe550 2023-07-14T18:11:59.994 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:59.950+0000 7febc52eb700 1 -- 172.21.15.163:0/1465288692 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7febc0196670 con 0x7febc00fe550 2023-07-14T18:11:59.994 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:59.950+0000 7feba7fff700 1 -- 172.21.15.163:0/1465288692 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7febb0004040 con 0x7febc00fe550 2023-07-14T18:11:59.994 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:59.950+0000 7feba7fff700 1 -- 172.21.15.163:0/1465288692 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febb0022c80 con 0x7febc00fe550 2023-07-14T18:11:59.994 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:59.950+0000 7febc52eb700 1 -- 172.21.15.163:0/1465288692 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7febc01a29c0 con 0x7febc00fe550 2023-07-14T18:11:59.995 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:59.952+0000 7febc52eb700 1 -- 172.21.15.163:0/1465288692 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7febc004e340 con 0x7febc00fe550 2023-07-14T18:11:59.995 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:59.952+0000 7feba7fff700 1 -- 172.21.15.163:0/1465288692 <== mon.0 v2:172.21.15.163:3300/0 4 ==== mgrmap(e 17) v1 ==== 135767+0+0 (secure 0 0 0) 0x7febb0022470 con 0x7febc00fe550 2023-07-14T18:11:59.996 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:59.953+0000 7feba7fff700 1 --2- 172.21.15.163:0/1465288692 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7feba80a11e0 0x7feba80a3690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:11:59.996 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:59.953+0000 7feba7fff700 1 -- 172.21.15.163:0/1465288692 <== mon.0 v2:172.21.15.163:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 8730+0+0 (secure 0 0 0) 0x7febb00ce170 con 0x7febc00fe550 2023-07-14T18:11:59.996 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:59.953+0000 7febbe7fc700 1 --2- 172.21.15.163:0/1465288692 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7feba80a11e0 0x7feba80a3690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:11:59.996 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:59.953+0000 7febbe7fc700 1 --2- 172.21.15.163:0/1465288692 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7feba80a11e0 0x7feba80a3690 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7febb4005ea0 tx=0x7febb4005e30 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:11:59.996 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:11:59.957+0000 7feba7fff700 1 -- 172.21.15.163:0/1465288692 <== mon.0 v2:172.21.15.163:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178025 (secure 0 0 0) 0x7febb0097600 con 0x7febc00fe550 2023-07-14T18:12:00.192 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:00.152+0000 7febc52eb700 1 -- 172.21.15.163:0/1465288692 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7febc01a2b50 con 0x7febc00fe550 2023-07-14T18:12:00.192 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:00.152+0000 7feba7fff700 1 -- 172.21.15.163:0/1465288692 <== mon.0 v2:172.21.15.163:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7febb009ac20 con 0x7febc00fe550 2023-07-14T18:12:00.192 INFO:teuthology.orchestra.run.smithi163.stdout:55834574910 2023-07-14T18:12:00.194 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:00.154+0000 7febc52eb700 1 -- 172.21.15.163:0/1465288692 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7feba80a11e0 msgr2=0x7feba80a3690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:12:00.194 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:00.154+0000 7febc52eb700 1 --2- 172.21.15.163:0/1465288692 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7feba80a11e0 0x7feba80a3690 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7febb4005ea0 tx=0x7febb4005e30 comp rx=0 tx=0).stop 2023-07-14T18:12:00.194 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:00.154+0000 7febc52eb700 1 -- 172.21.15.163:0/1465288692 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7febc00fe550 msgr2=0x7febc019b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:12:00.195 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:00.154+0000 7febc52eb700 1 --2- 172.21.15.163:0/1465288692 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7febc00fe550 0x7febc019b9d0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7febb0009f50 tx=0x7febb00047c0 comp rx=0 tx=0).stop 2023-07-14T18:12:00.195 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:00.154+0000 7febc52eb700 1 -- 172.21.15.163:0/1465288692 shutdown_connections 2023-07-14T18:12:00.195 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:00.154+0000 7febc52eb700 1 --2- 172.21.15.163:0/1465288692 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7feba80a11e0 0x7feba80a3690 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:00.195 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:00.154+0000 7febc52eb700 1 --2- 172.21.15.163:0/1465288692 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7febc0105090 0x7febc0195a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:00.195 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:00.154+0000 7febc52eb700 1 --2- 172.21.15.163:0/1465288692 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7febc00fe550 0x7febc019b9d0 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:00.195 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:00.154+0000 7febc52eb700 1 --2- 172.21.15.163:0/1465288692 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7febc00feef0 0x7febc019bf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:00.195 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:00.154+0000 7febc52eb700 1 -- 172.21.15.163:0/1465288692 >> 172.21.15.163:0/1465288692 conn(0x7febc00751e0 msgr2=0x7febc00fbf40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:12:00.195 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:00.155+0000 7febc52eb700 1 -- 172.21.15.163:0/1465288692 shutdown_connections 2023-07-14T18:12:00.196 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:00.155+0000 7febc52eb700 1 -- 172.21.15.163:0/1465288692 wait complete. 2023-07-14T18:12:01.011 INFO:tasks.cephadm.ceph_manager.ceph:need seq 55834574909 got 55834574910 for osd.1 2023-07-14T18:12:01.012 DEBUG:teuthology.parallel:result is None 2023-07-14T18:12:01.083 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:12:00 smithi163 ceph-mon[96576]: pgmap v276: 129 pgs: 129 active+clean; 641 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 426 B/s wr, 11 op/s 2023-07-14T18:12:01.083 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:12:00 smithi163 ceph-mon[96576]: from='client.? 172.21.15.163:0/1465288692' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2023-07-14T18:12:01.174 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:12:00 smithi184 ceph-mon[98481]: pgmap v276: 129 pgs: 129 active+clean; 641 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 426 B/s wr, 11 op/s 2023-07-14T18:12:01.174 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:12:00 smithi184 ceph-mon[98481]: from='client.? 172.21.15.163:0/1465288692' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2023-07-14T18:12:01.250 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:01.209+0000 7fbc0a544700 1 -- 172.21.15.163:0/3759841551 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fbc040fff30 msgr2=0x7fbc04100300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:12:01.250 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:01.209+0000 7fbc0a544700 1 --2- 172.21.15.163:0/3759841551 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fbc040fff30 0x7fbc04100300 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fbbf40099c0 tx=0x7fbbf4009cd0 comp rx=0 tx=0).stop 2023-07-14T18:12:01.250 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:01.209+0000 7fbc0a544700 1 -- 172.21.15.163:0/3759841551 shutdown_connections 2023-07-14T18:12:01.251 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:01.209+0000 7fbc0a544700 1 --2- 172.21.15.163:0/3759841551 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbc04104fd0 0x7fbc0410cb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:01.251 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:01.210+0000 7fbc0a544700 1 --2- 172.21.15.163:0/3759841551 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fbc040fff30 0x7fbc04100300 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:01.251 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:01.210+0000 7fbc0a544700 1 --2- 172.21.15.163:0/3759841551 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbc041008d0 0x7fbc041048a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:01.251 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:01.210+0000 7fbc0a544700 1 -- 172.21.15.163:0/3759841551 >> 172.21.15.163:0/3759841551 conn(0x7fbc040fb790 msgr2=0x7fbc040fdba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:12:01.251 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:01.210+0000 7fbc0a544700 1 -- 172.21.15.163:0/3759841551 shutdown_connections 2023-07-14T18:12:01.251 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:01.210+0000 7fbc0a544700 1 -- 172.21.15.163:0/3759841551 wait complete. 2023-07-14T18:12:01.251 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:01.210+0000 7fbc0a544700 1 Processor -- start 2023-07-14T18:12:01.252 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:01.211+0000 7fbc0a544700 1 -- start start 2023-07-14T18:12:01.253 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:01.211+0000 7fbc0a544700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fbc040fff30 0x7fbc0419ba10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:12:01.253 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:01.211+0000 7fbc0a544700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbc041008d0 0x7fbc0419bf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:12:01.254 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:01.211+0000 7fbc0a544700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbc04104fd0 0x7fbc04195a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:12:01.254 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:01.211+0000 7fbc0a544700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc04196100 con 0x7fbc040fff30 2023-07-14T18:12:01.254 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:01.211+0000 7fbc0a544700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc04196270 con 0x7fbc04104fd0 2023-07-14T18:12:01.254 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:01.211+0000 7fbc0a544700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc04196430 con 0x7fbc041008d0 2023-07-14T18:12:01.254 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:01.211+0000 7fbc03fff700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fbc040fff30 0x7fbc0419ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:12:01.254 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:01.211+0000 7fbc03fff700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fbc040fff30 0x7fbc0419ba10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:56612/0 (socket says 172.21.15.163:56612) 2023-07-14T18:12:01.254 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:01.211+0000 7fbc03fff700 1 -- 172.21.15.163:0/4234016672 learned_addr learned my addr 172.21.15.163:0/4234016672 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:12:01.255 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:01.211+0000 7fbc037fe700 1 --2- 172.21.15.163:0/4234016672 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbc041008d0 0x7fbc0419bf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:12:01.255 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:01.211+0000 7fbc08ae1700 1 --2- 172.21.15.163:0/4234016672 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbc04104fd0 0x7fbc04195a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:12:01.255 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:01.211+0000 7fbc03fff700 1 -- 172.21.15.163:0/4234016672 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbc041008d0 msgr2=0x7fbc0419bf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:12:01.255 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:01.211+0000 7fbc03fff700 1 --2- 172.21.15.163:0/4234016672 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbc041008d0 0x7fbc0419bf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:01.255 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:01.211+0000 7fbc03fff700 1 -- 172.21.15.163:0/4234016672 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbc04104fd0 msgr2=0x7fbc04195a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:12:01.255 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:01.211+0000 7fbc03fff700 1 --2- 172.21.15.163:0/4234016672 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbc04104fd0 0x7fbc04195a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:01.256 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:01.211+0000 7fbc03fff700 1 -- 172.21.15.163:0/4234016672 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbf40095f0 con 0x7fbc040fff30 2023-07-14T18:12:01.256 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:01.212+0000 7fbc03fff700 1 --2- 172.21.15.163:0/4234016672 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fbc040fff30 0x7fbc0419ba10 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fbbf4009f50 tx=0x7fbbf4005740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:12:01.256 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:01.212+0000 7fbc017fa700 1 -- 172.21.15.163:0/4234016672 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbf401d070 con 0x7fbc040fff30 2023-07-14T18:12:01.256 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:01.212+0000 7fbc017fa700 1 -- 172.21.15.163:0/4234016672 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fbbf4003fc0 con 0x7fbc040fff30 2023-07-14T18:12:01.256 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:01.212+0000 7fbc0a544700 1 -- 172.21.15.163:0/4234016672 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbc041966b0 con 0x7fbc040fff30 2023-07-14T18:12:01.256 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:01.212+0000 7fbc017fa700 1 -- 172.21.15.163:0/4234016672 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbf4022d10 con 0x7fbc040fff30 2023-07-14T18:12:01.256 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:01.212+0000 7fbc0a544700 1 -- 172.21.15.163:0/4234016672 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbc041a2a00 con 0x7fbc040fff30 2023-07-14T18:12:01.257 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:01.213+0000 7fbc0a544700 1 -- 172.21.15.163:0/4234016672 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbc0404e340 con 0x7fbc040fff30 2023-07-14T18:12:01.257 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:01.215+0000 7fbc017fa700 1 -- 172.21.15.163:0/4234016672 <== mon.0 v2:172.21.15.163:3300/0 4 ==== mgrmap(e 17) v1 ==== 135767+0+0 (secure 0 0 0) 0x7fbbf4022470 con 0x7fbc040fff30 2023-07-14T18:12:01.257 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:01.216+0000 7fbc017fa700 1 --2- 172.21.15.163:0/4234016672 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7fbbec0a11e0 0x7fbbec0a3690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:12:01.258 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:01.216+0000 7fbc017fa700 1 -- 172.21.15.163:0/4234016672 <== mon.0 v2:172.21.15.163:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 8730+0+0 (secure 0 0 0) 0x7fbbf40ce760 con 0x7fbc040fff30 2023-07-14T18:12:01.258 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:01.216+0000 7fbc037fe700 1 --2- 172.21.15.163:0/4234016672 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7fbbec0a11e0 0x7fbbec0a3690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:12:01.258 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:01.216+0000 7fbc037fe700 1 --2- 172.21.15.163:0/4234016672 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7fbbec0a11e0 0x7fbbec0a3690 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fbc040fbbf0 tx=0x7fbbf80073d0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:12:01.259 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:01.219+0000 7fbc017fa700 1 -- 172.21.15.163:0/4234016672 <== mon.0 v2:172.21.15.163:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178025 (secure 0 0 0) 0x7fbbf4097bf0 con 0x7fbc040fff30 2023-07-14T18:12:01.275 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:12:00 smithi172 ceph-mon[97983]: pgmap v276: 129 pgs: 129 active+clean; 641 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 426 B/s wr, 11 op/s 2023-07-14T18:12:01.275 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:12:00 smithi172 ceph-mon[97983]: from='client.? 172.21.15.163:0/1465288692' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2023-07-14T18:12:01.336 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:01.296+0000 7f9030128700 1 -- 172.21.15.163:0/3397778845 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f9028104c70 msgr2=0x7f9028105040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:12:01.336 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:01.296+0000 7f9030128700 1 --2- 172.21.15.163:0/3397778845 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f9028104c70 0x7f9028105040 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f9018009990 tx=0x7f9018009ca0 comp rx=0 tx=0).stop 2023-07-14T18:12:01.336 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:01.296+0000 7f9030128700 1 -- 172.21.15.163:0/3397778845 shutdown_connections 2023-07-14T18:12:01.337 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:01.296+0000 7f9030128700 1 --2- 172.21.15.163:0/3397778845 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f90280febc0 0x7f902810cb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:01.337 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:01.296+0000 7f9030128700 1 --2- 172.21.15.163:0/3397778845 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f9028104c70 0x7f9028105040 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:01.337 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:01.296+0000 7f9030128700 1 --2- 172.21.15.163:0/3397778845 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f90280fe210 0x7f90280fe680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:01.337 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:01.296+0000 7f9030128700 1 -- 172.21.15.163:0/3397778845 >> 172.21.15.163:0/3397778845 conn(0x7f9028075280 msgr2=0x7f9028075680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:12:01.337 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:01.296+0000 7f9030128700 1 -- 172.21.15.163:0/3397778845 shutdown_connections 2023-07-14T18:12:01.337 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:01.296+0000 7f9030128700 1 -- 172.21.15.163:0/3397778845 wait complete. 2023-07-14T18:12:01.337 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:01.297+0000 7f9030128700 1 Processor -- start 2023-07-14T18:12:01.338 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:01.297+0000 7f9030128700 1 -- start start 2023-07-14T18:12:01.339 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:01.297+0000 7f9030128700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f90280fe210 0x7f902819baa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:12:01.339 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:01.297+0000 7f9030128700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f90280febc0 0x7f902819bfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:12:01.339 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:01.297+0000 7f9030128700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9028104c70 0x7f9028195a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:12:01.339 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:01.297+0000 7f9030128700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9028196240 con 0x7f90280fe210 2023-07-14T18:12:01.339 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:01.297+0000 7f9030128700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90281963b0 con 0x7f90280febc0 2023-07-14T18:12:01.340 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:01.297+0000 7f9030128700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9028196570 con 0x7f9028104c70 2023-07-14T18:12:01.340 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:01.297+0000 7f902dec4700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f90280fe210 0x7f902819baa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:12:01.340 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:01.297+0000 7f902dec4700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f90280fe210 0x7f902819baa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:56626/0 (socket says 172.21.15.163:56626) 2023-07-14T18:12:01.340 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:01.297+0000 7f902dec4700 1 -- 172.21.15.163:0/2824335600 learned_addr learned my addr 172.21.15.163:0/2824335600 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:12:01.340 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:01.297+0000 7f902d6c3700 1 --2- 172.21.15.163:0/2824335600 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f90280febc0 0x7f902819bfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:12:01.341 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:01.297+0000 7f902e6c5700 1 --2- 172.21.15.163:0/2824335600 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9028104c70 0x7f9028195a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:12:01.341 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:01.297+0000 7f902dec4700 1 -- 172.21.15.163:0/2824335600 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9028104c70 msgr2=0x7f9028195a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:12:01.341 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:01.297+0000 7f902dec4700 1 --2- 172.21.15.163:0/2824335600 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9028104c70 0x7f9028195a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:01.341 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:01.297+0000 7f902dec4700 1 -- 172.21.15.163:0/2824335600 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f90280febc0 msgr2=0x7f902819bfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:12:01.341 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:01.297+0000 7f902dec4700 1 --2- 172.21.15.163:0/2824335600 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f90280febc0 0x7f902819bfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:01.341 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:01.297+0000 7f902dec4700 1 -- 172.21.15.163:0/2824335600 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90180095f0 con 0x7f90280fe210 2023-07-14T18:12:01.342 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:01.297+0000 7f902d6c3700 1 --2- 172.21.15.163:0/2824335600 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f90280febc0 0x7f902819bfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T18:12:01.342 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:01.297+0000 7f902dec4700 1 --2- 172.21.15.163:0/2824335600 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f90280fe210 0x7f902819baa0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f9018005910 tx=0x7f90180047b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:12:01.342 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:01.298+0000 7f901effd700 1 -- 172.21.15.163:0/2824335600 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f901801d070 con 0x7f90280fe210 2023-07-14T18:12:01.342 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:01.298+0000 7f901effd700 1 -- 172.21.15.163:0/2824335600 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f901800fbb0 con 0x7f90280fe210 2023-07-14T18:12:01.342 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:01.298+0000 7f9030128700 1 -- 172.21.15.163:0/2824335600 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f90281967f0 con 0x7f90280fe210 2023-07-14T18:12:01.342 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:01.298+0000 7f9030128700 1 -- 172.21.15.163:0/2824335600 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f90281a2a20 con 0x7f90280fe210 2023-07-14T18:12:01.342 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:01.298+0000 7f901effd700 1 -- 172.21.15.163:0/2824335600 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90180173f0 con 0x7f90280fe210 2023-07-14T18:12:01.342 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:01.299+0000 7f9030128700 1 -- 172.21.15.163:0/2824335600 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f900c005320 con 0x7f90280fe210 2023-07-14T18:12:01.343 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:01.300+0000 7f901effd700 1 -- 172.21.15.163:0/2824335600 <== mon.0 v2:172.21.15.163:3300/0 4 ==== mgrmap(e 17) v1 ==== 135767+0+0 (secure 0 0 0) 0x7f9018017550 con 0x7f90280fe210 2023-07-14T18:12:01.343 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:01.300+0000 7f901effd700 1 --2- 172.21.15.163:0/2824335600 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f90140a1260 0x7f90140a3710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:12:01.344 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:01.301+0000 7f902d6c3700 1 --2- 172.21.15.163:0/2824335600 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f90140a1260 0x7f90140a3710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:12:01.344 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:01.301+0000 7f901effd700 1 -- 172.21.15.163:0/2824335600 <== mon.0 v2:172.21.15.163:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 8730+0+0 (secure 0 0 0) 0x7f90180cddb0 con 0x7f90280fe210 2023-07-14T18:12:01.344 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:01.301+0000 7f902d6c3700 1 --2- 172.21.15.163:0/2824335600 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f90140a1260 0x7f90140a3710 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f9024005950 tx=0x7f90240058e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:12:01.344 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:01.305+0000 7f901effd700 1 -- 172.21.15.163:0/2824335600 <== mon.0 v2:172.21.15.163:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178025 (secure 0 0 0) 0x7f901805b780 con 0x7f90280fe210 2023-07-14T18:12:01.414 INFO:teuthology.orchestra.run.smithi163.stderr:Inferring config /var/lib/ceph/bf7326ec-2270-11ee-9b33-001a4aab830c/mon.a/config 2023-07-14T18:12:01.476 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:01.436+0000 7fbc0a544700 1 -- 172.21.15.163:0/4234016672 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 11} v 0) v1 -- 0x7fbc04196fa0 con 0x7fbc040fff30 2023-07-14T18:12:01.476 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:01.436+0000 7fbc017fa700 1 -- 172.21.15.163:0/4234016672 <== mon.0 v2:172.21.15.163:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 11}]=0 v0) v1 ==== 75+0+13 (secure 0 0 0) 0x7fbbf409b210 con 0x7fbc040fff30 2023-07-14T18:12:01.476 INFO:teuthology.orchestra.run.smithi163.stdout:322122547222 2023-07-14T18:12:01.478 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:01.438+0000 7fbc0a544700 1 -- 172.21.15.163:0/4234016672 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7fbbec0a11e0 msgr2=0x7fbbec0a3690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:12:01.478 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:01.438+0000 7fbc0a544700 1 --2- 172.21.15.163:0/4234016672 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7fbbec0a11e0 0x7fbbec0a3690 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fbc040fbbf0 tx=0x7fbbf80073d0 comp rx=0 tx=0).stop 2023-07-14T18:12:01.478 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:01.438+0000 7fbc0a544700 1 -- 172.21.15.163:0/4234016672 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fbc040fff30 msgr2=0x7fbc0419ba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:12:01.478 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:01.438+0000 7fbc0a544700 1 --2- 172.21.15.163:0/4234016672 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fbc040fff30 0x7fbc0419ba10 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fbbf4009f50 tx=0x7fbbf4005740 comp rx=0 tx=0).stop 2023-07-14T18:12:01.478 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:01.438+0000 7fbc0a544700 1 -- 172.21.15.163:0/4234016672 shutdown_connections 2023-07-14T18:12:01.479 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:01.438+0000 7fbc0a544700 1 --2- 172.21.15.163:0/4234016672 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7fbbec0a11e0 0x7fbbec0a3690 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:01.479 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:01.438+0000 7fbc0a544700 1 --2- 172.21.15.163:0/4234016672 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbc04104fd0 0x7fbc04195a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:01.479 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:01.438+0000 7fbc0a544700 1 --2- 172.21.15.163:0/4234016672 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fbc040fff30 0x7fbc0419ba10 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:01.479 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:01.438+0000 7fbc0a544700 1 --2- 172.21.15.163:0/4234016672 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbc041008d0 0x7fbc0419bf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:01.479 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:01.438+0000 7fbc0a544700 1 -- 172.21.15.163:0/4234016672 >> 172.21.15.163:0/4234016672 conn(0x7fbc040fb790 msgr2=0x7fbc040fc250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:12:01.479 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:01.438+0000 7fbc0a544700 1 -- 172.21.15.163:0/4234016672 shutdown_connections 2023-07-14T18:12:01.479 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:01.439+0000 7fbc0a544700 1 -- 172.21.15.163:0/4234016672 wait complete. 2023-07-14T18:12:01.555 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:01.515+0000 7f9030128700 1 -- 172.21.15.163:0/2824335600 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f900c005cc0 con 0x7f90280fe210 2023-07-14T18:12:01.555 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:01.515+0000 7f901effd700 1 -- 172.21.15.163:0/2824335600 <== mon.0 v2:172.21.15.163:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f9018097240 con 0x7f90280fe210 2023-07-14T18:12:01.555 INFO:teuthology.orchestra.run.smithi163.stdout:137438953523 2023-07-14T18:12:01.557 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:01.518+0000 7f9030128700 1 -- 172.21.15.163:0/2824335600 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f90140a1260 msgr2=0x7f90140a3710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:12:01.558 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:01.518+0000 7f9030128700 1 --2- 172.21.15.163:0/2824335600 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f90140a1260 0x7f90140a3710 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f9024005950 tx=0x7f90240058e0 comp rx=0 tx=0).stop 2023-07-14T18:12:01.558 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:01.518+0000 7f9030128700 1 -- 172.21.15.163:0/2824335600 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f90280fe210 msgr2=0x7f902819baa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:12:01.558 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:01.518+0000 7f9030128700 1 --2- 172.21.15.163:0/2824335600 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f90280fe210 0x7f902819baa0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f9018005910 tx=0x7f90180047b0 comp rx=0 tx=0).stop 2023-07-14T18:12:01.558 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:01.518+0000 7f9030128700 1 -- 172.21.15.163:0/2824335600 shutdown_connections 2023-07-14T18:12:01.558 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:01.518+0000 7f9030128700 1 --2- 172.21.15.163:0/2824335600 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f90140a1260 0x7f90140a3710 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:01.559 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:01.518+0000 7f9030128700 1 --2- 172.21.15.163:0/2824335600 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9028104c70 0x7f9028195a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:01.559 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:01.518+0000 7f9030128700 1 --2- 172.21.15.163:0/2824335600 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f90280fe210 0x7f902819baa0 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:01.559 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:01.518+0000 7f9030128700 1 --2- 172.21.15.163:0/2824335600 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f90280febc0 0x7f902819bfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:01.559 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:01.518+0000 7f9030128700 1 -- 172.21.15.163:0/2824335600 >> 172.21.15.163:0/2824335600 conn(0x7f9028075280 msgr2=0x7f90280fbce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:12:01.559 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:01.518+0000 7f9030128700 1 -- 172.21.15.163:0/2824335600 shutdown_connections 2023-07-14T18:12:01.559 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:01.518+0000 7f9030128700 1 -- 172.21.15.163:0/2824335600 wait complete. 2023-07-14T18:12:01.982 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:01.941+0000 7fc87e6fb700 1 -- 172.21.15.163:0/2143143703 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc878104fd0 msgr2=0x7fc87810cb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:12:01.982 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:01.941+0000 7fc87e6fb700 1 --2- 172.21.15.163:0/2143143703 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc878104fd0 0x7fc87810cb50 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fc87000b0d0 tx=0x7fc87000b3e0 comp rx=0 tx=0).stop 2023-07-14T18:12:01.983 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:01.941+0000 7fc87e6fb700 1 -- 172.21.15.163:0/2143143703 shutdown_connections 2023-07-14T18:12:01.983 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:01.941+0000 7fc87e6fb700 1 --2- 172.21.15.163:0/2143143703 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc8780fff30 0x7fc878100300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:01.983 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:01.941+0000 7fc87e6fb700 1 --2- 172.21.15.163:0/2143143703 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc878104fd0 0x7fc87810cb50 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:01.983 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:01.941+0000 7fc87e6fb700 1 --2- 172.21.15.163:0/2143143703 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc8781008d0 0x7fc8781048a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:01.983 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:01.941+0000 7fc87e6fb700 1 -- 172.21.15.163:0/2143143703 >> 172.21.15.163:0/2143143703 conn(0x7fc8780fb790 msgr2=0x7fc8780fdba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:12:01.983 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:01.941+0000 7fc87e6fb700 1 -- 172.21.15.163:0/2143143703 shutdown_connections 2023-07-14T18:12:01.983 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:01.942+0000 7fc87e6fb700 1 -- 172.21.15.163:0/2143143703 wait complete. 2023-07-14T18:12:01.984 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:01.942+0000 7fc87e6fb700 1 Processor -- start 2023-07-14T18:12:01.984 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:01.942+0000 7fc87e6fb700 1 -- start start 2023-07-14T18:12:01.984 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:01.942+0000 7fc87e6fb700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc8780fff30 0x7fc87819bab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:12:01.984 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:01.942+0000 7fc87e6fb700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc8781008d0 0x7fc87819bff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:12:01.984 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:01.942+0000 7fc87e6fb700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc878104fd0 0x7fc878195b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:12:01.984 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:01.943+0000 7fc87e6fb700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8781961a0 con 0x7fc878104fd0 2023-07-14T18:12:01.984 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:01.943+0000 7fc87e6fb700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc878196310 con 0x7fc8780fff30 2023-07-14T18:12:01.985 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:01.943+0000 7fc87e6fb700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8781964d0 con 0x7fc8781008d0 2023-07-14T18:12:01.985 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:01.943+0000 7fc87cc98700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc878104fd0 0x7fc878195b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:12:01.985 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:01.943+0000 7fc87cc98700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc878104fd0 0x7fc878195b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:56644/0 (socket says 172.21.15.163:56644) 2023-07-14T18:12:01.985 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:01.943+0000 7fc87cc98700 1 -- 172.21.15.163:0/3611937935 learned_addr learned my addr 172.21.15.163:0/3611937935 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:12:01.985 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:01.943+0000 7fc877fff700 1 --2- 172.21.15.163:0/3611937935 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc8780fff30 0x7fc87819bab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:12:01.985 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:01.943+0000 7fc8777fe700 1 --2- 172.21.15.163:0/3611937935 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc8781008d0 0x7fc87819bff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:12:01.985 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:01.943+0000 7fc87cc98700 1 -- 172.21.15.163:0/3611937935 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc8781008d0 msgr2=0x7fc87819bff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:12:01.985 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:01.943+0000 7fc87cc98700 1 --2- 172.21.15.163:0/3611937935 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc8781008d0 0x7fc87819bff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:01.986 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:01.943+0000 7fc87cc98700 1 -- 172.21.15.163:0/3611937935 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc8780fff30 msgr2=0x7fc87819bab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:12:01.986 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:01.943+0000 7fc87cc98700 1 --2- 172.21.15.163:0/3611937935 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc8780fff30 0x7fc87819bab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:01.986 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:01.943+0000 7fc87cc98700 1 -- 172.21.15.163:0/3611937935 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc870009d00 con 0x7fc878104fd0 2023-07-14T18:12:01.986 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:01.943+0000 7fc877fff700 1 --2- 172.21.15.163:0/3611937935 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc8780fff30 0x7fc87819bab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T18:12:01.986 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:01.943+0000 7fc8777fe700 1 --2- 172.21.15.163:0/3611937935 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc8781008d0 0x7fc87819bff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T18:12:01.987 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:01.943+0000 7fc87cc98700 1 --2- 172.21.15.163:0/3611937935 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc878104fd0 0x7fc878195b30 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fc870009380 tx=0x7fc870009460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:12:01.987 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:01.943+0000 7fc8757fa700 1 -- 172.21.15.163:0/3611937935 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc87000e040 con 0x7fc878104fd0 2023-07-14T18:12:01.988 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:01.943+0000 7fc87e6fb700 1 -- 172.21.15.163:0/3611937935 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc878196750 con 0x7fc878104fd0 2023-07-14T18:12:01.988 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:01.943+0000 7fc8757fa700 1 -- 172.21.15.163:0/3611937935 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fc870003e10 con 0x7fc878104fd0 2023-07-14T18:12:01.988 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:01.943+0000 7fc8757fa700 1 -- 172.21.15.163:0/3611937935 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc870012a80 con 0x7fc878104fd0 2023-07-14T18:12:01.988 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:01.944+0000 7fc87e6fb700 1 -- 172.21.15.163:0/3611937935 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc8781a2aa0 con 0x7fc878104fd0 2023-07-14T18:12:01.988 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:01.944+0000 7fc87e6fb700 1 -- 172.21.15.163:0/3611937935 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc878196960 con 0x7fc878104fd0 2023-07-14T18:12:01.988 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:01.946+0000 7fc8757fa700 1 -- 172.21.15.163:0/3611937935 <== mon.0 v2:172.21.15.163:3300/0 4 ==== mgrmap(e 17) v1 ==== 135767+0+0 (secure 0 0 0) 0x7fc870012be0 con 0x7fc878104fd0 2023-07-14T18:12:01.988 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:01.946+0000 7fc8757fa700 1 --2- 172.21.15.163:0/3611937935 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7fc8600a11e0 0x7fc8600a3690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:12:01.989 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:01.946+0000 7fc877fff700 1 --2- 172.21.15.163:0/3611937935 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7fc8600a11e0 0x7fc8600a3690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:12:01.989 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:01.946+0000 7fc8757fa700 1 -- 172.21.15.163:0/3611937935 <== mon.0 v2:172.21.15.163:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 8730+0+0 (secure 0 0 0) 0x7fc8700cecb0 con 0x7fc878104fd0 2023-07-14T18:12:01.989 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:01.947+0000 7fc877fff700 1 --2- 172.21.15.163:0/3611937935 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7fc8600a11e0 0x7fc8600a3690 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fc868005fd0 tx=0x7fc868005e30 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:12:01.989 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:01.950+0000 7fc8757fa700 1 -- 172.21.15.163:0/3611937935 <== mon.0 v2:172.21.15.163:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178025 (secure 0 0 0) 0x7fc8700980e0 con 0x7fc878104fd0 2023-07-14T18:12:02.082 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:12:01 smithi163 ceph-mon[96576]: from='client.? 172.21.15.163:0/4234016672' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2023-07-14T18:12:02.083 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:12:01 smithi163 ceph-mon[96576]: from='client.? 172.21.15.163:0/2824335600' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2023-07-14T18:12:02.174 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:12:01 smithi184 ceph-mon[98481]: from='client.? 172.21.15.163:0/4234016672' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2023-07-14T18:12:02.174 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:12:01 smithi184 ceph-mon[98481]: from='client.? 172.21.15.163:0/2824335600' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2023-07-14T18:12:02.199 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:02.159+0000 7fc87e6fb700 1 -- 172.21.15.163:0/3611937935 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 8} v 0) v1 -- 0x7fc87804e340 con 0x7fc878104fd0 2023-07-14T18:12:02.199 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:02.159+0000 7fc8757fa700 1 -- 172.21.15.163:0/3611937935 <== mon.0 v2:172.21.15.163:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 8}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fc87009b700 con 0x7fc878104fd0 2023-07-14T18:12:02.199 INFO:teuthology.orchestra.run.smithi163.stdout:240518168611 2023-07-14T18:12:02.232 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:02.162+0000 7fc87e6fb700 1 -- 172.21.15.163:0/3611937935 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7fc8600a11e0 msgr2=0x7fc8600a3690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:12:02.232 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:02.162+0000 7fc87e6fb700 1 --2- 172.21.15.163:0/3611937935 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7fc8600a11e0 0x7fc8600a3690 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fc868005fd0 tx=0x7fc868005e30 comp rx=0 tx=0).stop 2023-07-14T18:12:02.232 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:02.162+0000 7fc87e6fb700 1 -- 172.21.15.163:0/3611937935 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc878104fd0 msgr2=0x7fc878195b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:12:02.233 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:02.162+0000 7fc87e6fb700 1 --2- 172.21.15.163:0/3611937935 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc878104fd0 0x7fc878195b30 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fc870009380 tx=0x7fc870009460 comp rx=0 tx=0).stop 2023-07-14T18:12:02.233 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:02.162+0000 7fc87e6fb700 1 -- 172.21.15.163:0/3611937935 shutdown_connections 2023-07-14T18:12:02.233 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:02.162+0000 7fc87e6fb700 1 --2- 172.21.15.163:0/3611937935 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7fc8600a11e0 0x7fc8600a3690 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:02.233 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:02.162+0000 7fc87e6fb700 1 --2- 172.21.15.163:0/3611937935 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc878104fd0 0x7fc878195b30 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:02.233 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:02.162+0000 7fc87e6fb700 1 --2- 172.21.15.163:0/3611937935 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc8780fff30 0x7fc87819bab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:02.233 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:02.162+0000 7fc87e6fb700 1 --2- 172.21.15.163:0/3611937935 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc8781008d0 0x7fc87819bff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:02.233 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:02.162+0000 7fc87e6fb700 1 -- 172.21.15.163:0/3611937935 >> 172.21.15.163:0/3611937935 conn(0x7fc8780fb790 msgr2=0x7fc8780fc1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:12:02.234 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:02.162+0000 7fc87e6fb700 1 -- 172.21.15.163:0/3611937935 shutdown_connections 2023-07-14T18:12:02.234 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:02.162+0000 7fc87e6fb700 1 -- 172.21.15.163:0/3611937935 wait complete. 2023-07-14T18:12:02.275 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:12:01 smithi172 ceph-mon[97983]: from='client.? 172.21.15.163:0/4234016672' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2023-07-14T18:12:02.275 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:12:01 smithi172 ceph-mon[97983]: from='client.? 172.21.15.163:0/2824335600' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2023-07-14T18:12:02.800 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:02.761+0000 7fa874541700 1 -- 172.21.15.163:0/3565682618 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fa86c0ffdb0 msgr2=0x7fa86c10ba80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:12:02.801 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:02.761+0000 7fa874541700 1 --2- 172.21.15.163:0/3565682618 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fa86c0ffdb0 0x7fa86c10ba80 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fa86400b0d0 tx=0x7fa86400b3e0 comp rx=0 tx=0).stop 2023-07-14T18:12:02.801 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:02.761+0000 7fa874541700 1 -- 172.21.15.163:0/3565682618 shutdown_connections 2023-07-14T18:12:02.801 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:02.761+0000 7fa874541700 1 --2- 172.21.15.163:0/3565682618 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa86c103be0 0x7fa86c103fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:02.801 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:02.761+0000 7fa874541700 1 --2- 172.21.15.163:0/3565682618 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fa86c0ffdb0 0x7fa86c10ba80 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:02.801 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:02.761+0000 7fa874541700 1 --2- 172.21.15.163:0/3565682618 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa86c0ff400 0x7fa86c0ff870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:02.802 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:02.761+0000 7fa874541700 1 -- 172.21.15.163:0/3565682618 >> 172.21.15.163:0/3565682618 conn(0x7fa86c0751e0 msgr2=0x7fa86c0755e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:12:02.802 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:02.761+0000 7fa874541700 1 -- 172.21.15.163:0/3565682618 shutdown_connections 2023-07-14T18:12:02.802 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:02.761+0000 7fa874541700 1 -- 172.21.15.163:0/3565682618 wait complete. 2023-07-14T18:12:02.803 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:02.762+0000 7fa874541700 1 Processor -- start 2023-07-14T18:12:02.803 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:02.762+0000 7fa874541700 1 -- start start 2023-07-14T18:12:02.804 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:02.762+0000 7fa874541700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa86c0ff400 0x7fa86c196b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:12:02.804 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:02.762+0000 7fa874541700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fa86c0ffdb0 0x7fa86c1970a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:12:02.804 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:02.762+0000 7fa874541700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa86c103be0 0x7fa86c1a1be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:12:02.804 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:02.762+0000 7fa874541700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa86c1a2120 con 0x7fa86c0ffdb0 2023-07-14T18:12:02.804 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:02.762+0000 7fa874541700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa86c1a2260 con 0x7fa86c0ff400 2023-07-14T18:12:02.804 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:02.762+0000 7fa874541700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa86c1a23a0 con 0x7fa86c103be0 2023-07-14T18:12:02.804 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:02.762+0000 7fa871adc700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fa86c0ffdb0 0x7fa86c1970a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:12:02.805 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:02.762+0000 7fa871adc700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fa86c0ffdb0 0x7fa86c1970a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:56656/0 (socket says 172.21.15.163:56656) 2023-07-14T18:12:02.805 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:02.762+0000 7fa871adc700 1 -- 172.21.15.163:0/1805271562 learned_addr learned my addr 172.21.15.163:0/1805271562 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:12:02.805 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:02.762+0000 7fa872ade700 1 --2- 172.21.15.163:0/1805271562 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa86c103be0 0x7fa86c1a1be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:12:02.805 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:02.762+0000 7fa8722dd700 1 --2- 172.21.15.163:0/1805271562 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa86c0ff400 0x7fa86c196b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:12:02.805 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:02.762+0000 7fa871adc700 1 -- 172.21.15.163:0/1805271562 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa86c103be0 msgr2=0x7fa86c1a1be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:12:02.805 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:02.762+0000 7fa871adc700 1 --2- 172.21.15.163:0/1805271562 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa86c103be0 0x7fa86c1a1be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:02.805 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:02.762+0000 7fa871adc700 1 -- 172.21.15.163:0/1805271562 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa86c0ff400 msgr2=0x7fa86c196b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:12:02.805 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:02.762+0000 7fa871adc700 1 --2- 172.21.15.163:0/1805271562 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa86c0ff400 0x7fa86c196b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:02.806 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:02.762+0000 7fa871adc700 1 -- 172.21.15.163:0/1805271562 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa864009d00 con 0x7fa86c0ffdb0 2023-07-14T18:12:02.806 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:02.762+0000 7fa871adc700 1 --2- 172.21.15.163:0/1805271562 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fa86c0ffdb0 0x7fa86c1970a0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fa85c00e9a0 tx=0x7fa85c00ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:12:02.806 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:02.762+0000 7fa8637fe700 1 -- 172.21.15.163:0/1805271562 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa85c009790 con 0x7fa86c0ffdb0 2023-07-14T18:12:02.806 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:02.763+0000 7fa8637fe700 1 -- 172.21.15.163:0/1805271562 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fa85c00cbd0 con 0x7fa86c0ffdb0 2023-07-14T18:12:02.806 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:02.763+0000 7fa874541700 1 -- 172.21.15.163:0/1805271562 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa86c194a70 con 0x7fa86c0ffdb0 2023-07-14T18:12:02.806 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:02.763+0000 7fa8637fe700 1 -- 172.21.15.163:0/1805271562 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa85c018680 con 0x7fa86c0ffdb0 2023-07-14T18:12:02.806 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:02.763+0000 7fa874541700 1 -- 172.21.15.163:0/1805271562 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa86c194f70 con 0x7fa86c0ffdb0 2023-07-14T18:12:02.807 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:02.763+0000 7fa874541700 1 -- 172.21.15.163:0/1805271562 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa86c04e340 con 0x7fa86c0ffdb0 2023-07-14T18:12:02.807 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:02.765+0000 7fa8637fe700 1 -- 172.21.15.163:0/1805271562 <== mon.0 v2:172.21.15.163:3300/0 4 ==== mgrmap(e 17) v1 ==== 135767+0+0 (secure 0 0 0) 0x7fa85c00cd40 con 0x7fa86c0ffdb0 2023-07-14T18:12:02.807 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:02.765+0000 7fa8637fe700 1 --2- 172.21.15.163:0/1805271562 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7fa8580a11e0 0x7fa8580a3690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:12:02.807 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:02.765+0000 7fa8722dd700 1 --2- 172.21.15.163:0/1805271562 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7fa8580a11e0 0x7fa8580a3690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:12:02.808 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:02.765+0000 7fa8637fe700 1 -- 172.21.15.163:0/1805271562 <== mon.0 v2:172.21.15.163:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 8730+0+0 (secure 0 0 0) 0x7fa85c014070 con 0x7fa86c0ffdb0 2023-07-14T18:12:02.808 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:02.766+0000 7fa8722dd700 1 --2- 172.21.15.163:0/1805271562 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7fa8580a11e0 0x7fa8580a3690 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fa868009bd0 tx=0x7fa868009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:12:02.808 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:02.769+0000 7fa8637fe700 1 -- 172.21.15.163:0/1805271562 <== mon.0 v2:172.21.15.163:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178025 (secure 0 0 0) 0x7fa85c0966f0 con 0x7fa86c0ffdb0 2023-07-14T18:12:03.014 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:02.975+0000 7fa874541700 1 -- 172.21.15.163:0/1805271562 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7fa86c0fe940 con 0x7fa86c0ffdb0 2023-07-14T18:12:03.015 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:02.975+0000 7fa8637fe700 1 -- 172.21.15.163:0/1805271562 <== mon.0 v2:172.21.15.163:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fa85c099d10 con 0x7fa86c0ffdb0 2023-07-14T18:12:03.015 INFO:teuthology.orchestra.run.smithi163.stdout:158913789998 2023-07-14T18:12:03.017 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:02.978+0000 7fa874541700 1 -- 172.21.15.163:0/1805271562 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7fa8580a11e0 msgr2=0x7fa8580a3690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:12:03.017 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:02.978+0000 7fa874541700 1 --2- 172.21.15.163:0/1805271562 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7fa8580a11e0 0x7fa8580a3690 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fa868009bd0 tx=0x7fa868009260 comp rx=0 tx=0).stop 2023-07-14T18:12:03.017 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:02.978+0000 7fa874541700 1 -- 172.21.15.163:0/1805271562 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fa86c0ffdb0 msgr2=0x7fa86c1970a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:12:03.018 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:02.978+0000 7fa874541700 1 --2- 172.21.15.163:0/1805271562 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fa86c0ffdb0 0x7fa86c1970a0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fa85c00e9a0 tx=0x7fa85c00ecb0 comp rx=0 tx=0).stop 2023-07-14T18:12:03.018 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:02.978+0000 7fa874541700 1 -- 172.21.15.163:0/1805271562 shutdown_connections 2023-07-14T18:12:03.018 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:02.978+0000 7fa874541700 1 --2- 172.21.15.163:0/1805271562 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7fa8580a11e0 0x7fa8580a3690 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:03.018 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:02.978+0000 7fa874541700 1 --2- 172.21.15.163:0/1805271562 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa86c103be0 0x7fa86c1a1be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:03.018 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:02.978+0000 7fa874541700 1 --2- 172.21.15.163:0/1805271562 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa86c0ff400 0x7fa86c196b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:03.018 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:02.978+0000 7fa874541700 1 --2- 172.21.15.163:0/1805271562 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fa86c0ffdb0 0x7fa86c1970a0 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:03.018 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:02.978+0000 7fa874541700 1 -- 172.21.15.163:0/1805271562 >> 172.21.15.163:0/1805271562 conn(0x7fa86c0751e0 msgr2=0x7fa86c0fc7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:12:03.019 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:02.978+0000 7fa874541700 1 -- 172.21.15.163:0/1805271562 shutdown_connections 2023-07-14T18:12:03.019 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:02.978+0000 7fa874541700 1 -- 172.21.15.163:0/1805271562 wait complete. 2023-07-14T18:12:03.026 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:12:02 smithi163 ceph-mon[96576]: pgmap v277: 129 pgs: 129 active+clean; 641 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 426 B/s wr, 9 op/s 2023-07-14T18:12:03.027 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:12:02 smithi163 ceph-mon[96576]: from='client.? 172.21.15.163:0/3611937935' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2023-07-14T18:12:03.174 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:12:02 smithi184 ceph-mon[98481]: pgmap v277: 129 pgs: 129 active+clean; 641 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 426 B/s wr, 9 op/s 2023-07-14T18:12:03.175 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:12:02 smithi184 ceph-mon[98481]: from='client.? 172.21.15.163:0/3611937935' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2023-07-14T18:12:03.230 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:03.177+0000 7fc93ee7c700 1 -- 172.21.15.163:0/351805393 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc9380ff7e0 msgr2=0x7fc9381037b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:12:03.230 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:03.177+0000 7fc93ee7c700 1 --2- 172.21.15.163:0/351805393 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc9380ff7e0 0x7fc9381037b0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fc9240099c0 tx=0x7fc924009cd0 comp rx=0 tx=0).stop 2023-07-14T18:12:03.230 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:03.177+0000 7fc93ee7c700 1 -- 172.21.15.163:0/351805393 shutdown_connections 2023-07-14T18:12:03.230 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:03.177+0000 7fc93ee7c700 1 --2- 172.21.15.163:0/351805393 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc938103ee0 0x7fc93810ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:03.230 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:03.177+0000 7fc93ee7c700 1 --2- 172.21.15.163:0/351805393 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc9380fee40 0x7fc9380ff210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:03.231 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:03.177+0000 7fc93ee7c700 1 --2- 172.21.15.163:0/351805393 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc9380ff7e0 0x7fc9381037b0 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:03.231 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:03.177+0000 7fc93ee7c700 1 -- 172.21.15.163:0/351805393 >> 172.21.15.163:0/351805393 conn(0x7fc938075ca0 msgr2=0x7fc9380760a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:12:03.231 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:03.177+0000 7fc93ee7c700 1 -- 172.21.15.163:0/351805393 shutdown_connections 2023-07-14T18:12:03.231 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:03.177+0000 7fc93ee7c700 1 -- 172.21.15.163:0/351805393 wait complete. 2023-07-14T18:12:03.231 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:03.178+0000 7fc93ee7c700 1 Processor -- start 2023-07-14T18:12:03.231 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:03.178+0000 7fc93ee7c700 1 -- start start 2023-07-14T18:12:03.231 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:03.178+0000 7fc93ee7c700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc9380fee40 0x7fc938195cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:12:03.232 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:03.178+0000 7fc93ee7c700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc9380ff7e0 0x7fc938196210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:12:03.232 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:03.178+0000 7fc93ee7c700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc938103ee0 0x7fc9381995d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:12:03.232 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:03.178+0000 7fc93ee7c700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc938199bd0 con 0x7fc9380fee40 2023-07-14T18:12:03.232 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:03.178+0000 7fc93ee7c700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc938199d40 con 0x7fc938103ee0 2023-07-14T18:12:03.232 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:03.178+0000 7fc93ee7c700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc938199f00 con 0x7fc9380ff7e0 2023-07-14T18:12:03.232 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:03.178+0000 7fc93cc18700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc9380fee40 0x7fc938195cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:12:03.232 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:03.178+0000 7fc93cc18700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc9380fee40 0x7fc938195cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:56668/0 (socket says 172.21.15.163:56668) 2023-07-14T18:12:03.233 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:03.178+0000 7fc93cc18700 1 -- 172.21.15.163:0/3279781754 learned_addr learned my addr 172.21.15.163:0/3279781754 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:12:03.233 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:03.178+0000 7fc93d419700 1 --2- 172.21.15.163:0/3279781754 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc938103ee0 0x7fc9381995d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:12:03.233 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:03.178+0000 7fc937fff700 1 --2- 172.21.15.163:0/3279781754 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc9380ff7e0 0x7fc938196210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:12:03.233 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:03.178+0000 7fc93cc18700 1 -- 172.21.15.163:0/3279781754 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc9380ff7e0 msgr2=0x7fc938196210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:12:03.233 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:03.178+0000 7fc93cc18700 1 --2- 172.21.15.163:0/3279781754 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc9380ff7e0 0x7fc938196210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:03.233 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:03.178+0000 7fc93cc18700 1 -- 172.21.15.163:0/3279781754 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc938103ee0 msgr2=0x7fc9381995d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:12:03.233 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:03.178+0000 7fc93cc18700 1 --2- 172.21.15.163:0/3279781754 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc938103ee0 0x7fc9381995d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:03.234 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:03.178+0000 7fc93cc18700 1 -- 172.21.15.163:0/3279781754 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9240095f0 con 0x7fc9380fee40 2023-07-14T18:12:03.234 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:03.178+0000 7fc937fff700 1 --2- 172.21.15.163:0/3279781754 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc9380ff7e0 0x7fc938196210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T18:12:03.234 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:03.178+0000 7fc93d419700 1 --2- 172.21.15.163:0/3279781754 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc938103ee0 0x7fc9381995d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T18:12:03.234 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:03.179+0000 7fc93cc18700 1 --2- 172.21.15.163:0/3279781754 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc9380fee40 0x7fc938195cd0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fc92c00d950 tx=0x7fc92c00dd10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:12:03.234 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:03.179+0000 7fc935ffb700 1 -- 172.21.15.163:0/3279781754 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc92c009b40 con 0x7fc9380fee40 2023-07-14T18:12:03.234 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:03.179+0000 7fc935ffb700 1 -- 172.21.15.163:0/3279781754 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fc92c009ca0 con 0x7fc9380fee40 2023-07-14T18:12:03.234 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:03.179+0000 7fc93ee7c700 1 -- 172.21.15.163:0/3279781754 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc93819a1e0 con 0x7fc9380fee40 2023-07-14T18:12:03.235 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:03.179+0000 7fc935ffb700 1 -- 172.21.15.163:0/3279781754 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc92c00f620 con 0x7fc9380fee40 2023-07-14T18:12:03.235 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:03.179+0000 7fc93ee7c700 1 -- 172.21.15.163:0/3279781754 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9381a2b30 con 0x7fc9380fee40 2023-07-14T18:12:03.235 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:03.180+0000 7fc93ee7c700 1 -- 172.21.15.163:0/3279781754 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc93804e340 con 0x7fc9380fee40 2023-07-14T18:12:03.235 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:03.181+0000 7fc935ffb700 1 -- 172.21.15.163:0/3279781754 <== mon.0 v2:172.21.15.163:3300/0 4 ==== mgrmap(e 17) v1 ==== 135767+0+0 (secure 0 0 0) 0x7fc92c010460 con 0x7fc9380fee40 2023-07-14T18:12:03.235 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:03.181+0000 7fc935ffb700 1 --2- 172.21.15.163:0/3279781754 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7fc9280a11e0 0x7fc9280a3690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:12:03.235 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:03.182+0000 7fc937fff700 1 --2- 172.21.15.163:0/3279781754 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7fc9280a11e0 0x7fc9280a3690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:12:03.235 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:03.182+0000 7fc935ffb700 1 -- 172.21.15.163:0/3279781754 <== mon.0 v2:172.21.15.163:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 8730+0+0 (secure 0 0 0) 0x7fc92c0cd040 con 0x7fc9380fee40 2023-07-14T18:12:03.236 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:03.182+0000 7fc937fff700 1 --2- 172.21.15.163:0/3279781754 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7fc9280a11e0 0x7fc9280a3690 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fc924006010 tx=0x7fc924000bc0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:12:03.236 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:03.186+0000 7fc935ffb700 1 -- 172.21.15.163:0/3279781754 <== mon.0 v2:172.21.15.163:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178025 (secure 0 0 0) 0x7fc92c096440 con 0x7fc9380fee40 2023-07-14T18:12:03.275 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:12:02 smithi172 ceph-mon[97983]: pgmap v277: 129 pgs: 129 active+clean; 641 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 426 B/s wr, 9 op/s 2023-07-14T18:12:03.275 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:12:02 smithi172 ceph-mon[97983]: from='client.? 172.21.15.163:0/3611937935' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2023-07-14T18:12:03.425 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:03.385+0000 7fc93ee7c700 1 -- 172.21.15.163:0/3279781754 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fc9381a2dc0 con 0x7fc9380fee40 2023-07-14T18:12:03.426 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:03.386+0000 7fc935ffb700 1 -- 172.21.15.163:0/3279781754 <== mon.0 v2:172.21.15.163:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fc92c099a60 con 0x7fc9380fee40 2023-07-14T18:12:03.426 INFO:teuthology.orchestra.run.smithi163.stdout:34359738436 2023-07-14T18:12:03.428 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:03.388+0000 7fc93ee7c700 1 -- 172.21.15.163:0/3279781754 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7fc9280a11e0 msgr2=0x7fc9280a3690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:12:03.428 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:03.388+0000 7fc93ee7c700 1 --2- 172.21.15.163:0/3279781754 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7fc9280a11e0 0x7fc9280a3690 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fc924006010 tx=0x7fc924000bc0 comp rx=0 tx=0).stop 2023-07-14T18:12:03.428 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:03.388+0000 7fc93ee7c700 1 -- 172.21.15.163:0/3279781754 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc9380fee40 msgr2=0x7fc938195cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:12:03.428 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:03.388+0000 7fc93ee7c700 1 --2- 172.21.15.163:0/3279781754 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc9380fee40 0x7fc938195cd0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fc92c00d950 tx=0x7fc92c00dd10 comp rx=0 tx=0).stop 2023-07-14T18:12:03.428 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:03.388+0000 7fc93ee7c700 1 -- 172.21.15.163:0/3279781754 shutdown_connections 2023-07-14T18:12:03.428 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:03.388+0000 7fc93ee7c700 1 --2- 172.21.15.163:0/3279781754 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7fc9280a11e0 0x7fc9280a3690 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:03.429 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:03.388+0000 7fc93ee7c700 1 --2- 172.21.15.163:0/3279781754 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc938103ee0 0x7fc9381995d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:03.429 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:03.388+0000 7fc93ee7c700 1 --2- 172.21.15.163:0/3279781754 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc9380fee40 0x7fc938195cd0 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:03.429 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:03.388+0000 7fc93ee7c700 1 --2- 172.21.15.163:0/3279781754 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc9380ff7e0 0x7fc938196210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:03.429 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:03.388+0000 7fc93ee7c700 1 -- 172.21.15.163:0/3279781754 >> 172.21.15.163:0/3279781754 conn(0x7fc938075ca0 msgr2=0x7fc938068220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:12:03.429 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:03.389+0000 7fc93ee7c700 1 -- 172.21.15.163:0/3279781754 shutdown_connections 2023-07-14T18:12:03.430 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:03.389+0000 7fc93ee7c700 1 -- 172.21.15.163:0/3279781754 wait complete. 2023-07-14T18:12:03.454 INFO:tasks.cephadm.ceph_manager.ceph:need seq 322122547220 got 322122547222 for osd.11 2023-07-14T18:12:03.454 DEBUG:teuthology.parallel:result is None 2023-07-14T18:12:03.913 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:03.455+0000 7fd9c05ea700 1 -- 172.21.15.163:0/2623809466 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fd9b80ff860 msgr2=0x7fd9b8103830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:12:03.914 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:03.455+0000 7fd9c05ea700 1 --2- 172.21.15.163:0/2623809466 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fd9b80ff860 0x7fd9b8103830 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fd9a80099c0 tx=0x7fd9a8009cd0 comp rx=0 tx=0).stop 2023-07-14T18:12:03.914 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:03.455+0000 7fd9c05ea700 1 -- 172.21.15.163:0/2623809466 shutdown_connections 2023-07-14T18:12:03.914 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:03.455+0000 7fd9c05ea700 1 --2- 172.21.15.163:0/2623809466 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd9b80feec0 0x7fd9b80ff290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:03.914 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:03.455+0000 7fd9c05ea700 1 --2- 172.21.15.163:0/2623809466 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd9b8103f60 0x7fd9b810bae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:03.914 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:03.455+0000 7fd9c05ea700 1 --2- 172.21.15.163:0/2623809466 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fd9b80ff860 0x7fd9b8103830 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:03.915 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:03.455+0000 7fd9c05ea700 1 -- 172.21.15.163:0/2623809466 >> 172.21.15.163:0/2623809466 conn(0x7fd9b80fa720 msgr2=0x7fd9b80fcb30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:12:03.915 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:03.455+0000 7fd9c05ea700 1 -- 172.21.15.163:0/2623809466 shutdown_connections 2023-07-14T18:12:03.915 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:03.455+0000 7fd9c05ea700 1 -- 172.21.15.163:0/2623809466 wait complete. 2023-07-14T18:12:03.915 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:03.456+0000 7fd9c05ea700 1 Processor -- start 2023-07-14T18:12:03.915 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:03.456+0000 7fd9c05ea700 1 -- start start 2023-07-14T18:12:03.915 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:03.456+0000 7fd9c05ea700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fd9b80feec0 0x7fd9b8197eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:12:03.915 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:03.456+0000 7fd9c05ea700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd9b80ff860 0x7fd9b81983f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:12:03.916 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:03.456+0000 7fd9c05ea700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd9b8103f60 0x7fd9b819c860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:12:03.916 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:03.456+0000 7fd9c05ea700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9b819ce70 con 0x7fd9b80feec0 2023-07-14T18:12:03.916 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:03.456+0000 7fd9c05ea700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9b819cfe0 con 0x7fd9b80ff860 2023-07-14T18:12:03.916 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:03.456+0000 7fd9c05ea700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9b819d1a0 con 0x7fd9b8103f60 2023-07-14T18:12:03.916 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:03.457+0000 7fd9be386700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fd9b80feec0 0x7fd9b8197eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:12:03.916 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:03.457+0000 7fd9be386700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fd9b80feec0 0x7fd9b8197eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:56682/0 (socket says 172.21.15.163:56682) 2023-07-14T18:12:03.917 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:03.457+0000 7fd9be386700 1 -- 172.21.15.163:0/3438611482 learned_addr learned my addr 172.21.15.163:0/3438611482 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:12:03.917 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:03.457+0000 7fd9bdb85700 1 --2- 172.21.15.163:0/3438611482 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd9b80ff860 0x7fd9b81983f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:12:03.917 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:03.457+0000 7fd9beb87700 1 --2- 172.21.15.163:0/3438611482 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd9b8103f60 0x7fd9b819c860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:12:03.917 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:03.457+0000 7fd9be386700 1 -- 172.21.15.163:0/3438611482 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd9b8103f60 msgr2=0x7fd9b819c860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:12:03.917 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:03.457+0000 7fd9be386700 1 --2- 172.21.15.163:0/3438611482 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd9b8103f60 0x7fd9b819c860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:03.917 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:03.457+0000 7fd9be386700 1 -- 172.21.15.163:0/3438611482 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd9b80ff860 msgr2=0x7fd9b81983f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:12:03.917 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:03.457+0000 7fd9be386700 1 --2- 172.21.15.163:0/3438611482 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd9b80ff860 0x7fd9b81983f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:03.917 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:03.457+0000 7fd9be386700 1 -- 172.21.15.163:0/3438611482 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9a80095f0 con 0x7fd9b80feec0 2023-07-14T18:12:03.918 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:03.457+0000 7fd9bdb85700 1 --2- 172.21.15.163:0/3438611482 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd9b80ff860 0x7fd9b81983f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T18:12:03.918 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:03.457+0000 7fd9be386700 1 --2- 172.21.15.163:0/3438611482 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fd9b80feec0 0x7fd9b8197eb0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fd9b4007a00 tx=0x7fd9b4007dc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:12:03.918 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:03.457+0000 7fd9af7fe700 1 -- 172.21.15.163:0/3438611482 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9b4010070 con 0x7fd9b80feec0 2023-07-14T18:12:03.918 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:03.457+0000 7fd9c05ea700 1 -- 172.21.15.163:0/3438611482 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd9b819d480 con 0x7fd9b80feec0 2023-07-14T18:12:03.918 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:03.457+0000 7fd9af7fe700 1 -- 172.21.15.163:0/3438611482 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fd9b400b660 con 0x7fd9b80feec0 2023-07-14T18:12:03.918 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:03.457+0000 7fd9af7fe700 1 -- 172.21.15.163:0/3438611482 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9b4003970 con 0x7fd9b80feec0 2023-07-14T18:12:03.918 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:03.457+0000 7fd9c05ea700 1 -- 172.21.15.163:0/3438611482 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd9b81a4ce0 con 0x7fd9b80feec0 2023-07-14T18:12:03.919 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:03.458+0000 7fd9c05ea700 1 -- 172.21.15.163:0/3438611482 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd9b80682d0 con 0x7fd9b80feec0 2023-07-14T18:12:03.919 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:03.461+0000 7fd9af7fe700 1 -- 172.21.15.163:0/3438611482 <== mon.0 v2:172.21.15.163:3300/0 4 ==== mgrmap(e 17) v1 ==== 135767+0+0 (secure 0 0 0) 0x7fd9b4003ad0 con 0x7fd9b80feec0 2023-07-14T18:12:03.919 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:03.461+0000 7fd9af7fe700 1 --2- 172.21.15.163:0/3438611482 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7fd9a40a11e0 0x7fd9a40a3690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:12:03.919 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:03.462+0000 7fd9bdb85700 1 --2- 172.21.15.163:0/3438611482 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7fd9a40a11e0 0x7fd9a40a3690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:12:03.919 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:03.462+0000 7fd9af7fe700 1 -- 172.21.15.163:0/3438611482 <== mon.0 v2:172.21.15.163:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 8730+0+0 (secure 0 0 0) 0x7fd9b40cc800 con 0x7fd9b80feec0 2023-07-14T18:12:03.919 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:03.462+0000 7fd9bdb85700 1 --2- 172.21.15.163:0/3438611482 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7fd9a40a11e0 0x7fd9a40a3690 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fd9a800b580 tx=0x7fd9a801a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:12:03.919 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:03.467+0000 7fd9af7fe700 1 -- 172.21.15.163:0/3438611482 <== mon.0 v2:172.21.15.163:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178025 (secure 0 0 0) 0x7fd9b4095c00 con 0x7fd9b80feec0 2023-07-14T18:12:03.919 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:03.675+0000 7fd9c05ea700 1 -- 172.21.15.163:0/3438611482 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fd9b804e340 con 0x7fd9b80feec0 2023-07-14T18:12:03.920 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:03.675+0000 7fd9af7fe700 1 -- 172.21.15.163:0/3438611482 <== mon.0 v2:172.21.15.163:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fd9b4099220 con 0x7fd9b80feec0 2023-07-14T18:12:03.920 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:03.677+0000 7fd9c05ea700 1 -- 172.21.15.163:0/3438611482 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7fd9a40a11e0 msgr2=0x7fd9a40a3690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:12:03.920 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:03.677+0000 7fd9c05ea700 1 --2- 172.21.15.163:0/3438611482 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7fd9a40a11e0 0x7fd9a40a3690 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fd9a800b580 tx=0x7fd9a801a040 comp rx=0 tx=0).stop 2023-07-14T18:12:03.920 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:03.677+0000 7fd9c05ea700 1 -- 172.21.15.163:0/3438611482 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fd9b80feec0 msgr2=0x7fd9b8197eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:12:03.920 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:03.677+0000 7fd9c05ea700 1 --2- 172.21.15.163:0/3438611482 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fd9b80feec0 0x7fd9b8197eb0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fd9b4007a00 tx=0x7fd9b4007dc0 comp rx=0 tx=0).stop 2023-07-14T18:12:03.920 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:03.677+0000 7fd9c05ea700 1 -- 172.21.15.163:0/3438611482 shutdown_connections 2023-07-14T18:12:03.921 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:03.677+0000 7fd9c05ea700 1 --2- 172.21.15.163:0/3438611482 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7fd9a40a11e0 0x7fd9a40a3690 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:03.921 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:03.677+0000 7fd9c05ea700 1 --2- 172.21.15.163:0/3438611482 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd9b8103f60 0x7fd9b819c860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:03.921 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:03.677+0000 7fd9c05ea700 1 --2- 172.21.15.163:0/3438611482 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fd9b80feec0 0x7fd9b8197eb0 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:03.921 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:03.677+0000 7fd9c05ea700 1 --2- 172.21.15.163:0/3438611482 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd9b80ff860 0x7fd9b81983f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:03.921 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:03.677+0000 7fd9c05ea700 1 -- 172.21.15.163:0/3438611482 >> 172.21.15.163:0/3438611482 conn(0x7fd9b80fa720 msgr2=0x7fd9b80fb380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:12:03.921 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:03.677+0000 7fd9c05ea700 1 -- 172.21.15.163:0/3438611482 shutdown_connections 2023-07-14T18:12:03.921 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:03.677+0000 7fd9c05ea700 1 -- 172.21.15.163:0/3438611482 wait complete. 2023-07-14T18:12:03.922 INFO:teuthology.orchestra.run.smithi163.stdout:107374182455 2023-07-14T18:12:03.967 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:12:03 smithi163 ceph-mon[96576]: from='client.? 172.21.15.163:0/1805271562' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2023-07-14T18:12:03.967 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:12:03 smithi163 ceph-mon[96576]: from='client.? 172.21.15.163:0/3279781754' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2023-07-14T18:12:03.967 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:12:03 smithi163 ceph-mon[96576]: from='client.? 172.21.15.163:0/3438611482' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2023-07-14T18:12:04.139 INFO:tasks.cephadm.ceph_manager.ceph:need seq 34359738434 got 34359738436 for osd.0 2023-07-14T18:12:04.139 DEBUG:teuthology.parallel:result is None 2023-07-14T18:12:04.153 INFO:tasks.cephadm.ceph_manager.ceph:need seq 240518168609 got 240518168611 for osd.8 2023-07-14T18:12:04.153 DEBUG:teuthology.parallel:result is None 2023-07-14T18:12:04.174 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:12:03 smithi184 ceph-mon[98481]: from='client.? 172.21.15.163:0/1805271562' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2023-07-14T18:12:04.175 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:12:03 smithi184 ceph-mon[98481]: from='client.? 172.21.15.163:0/3279781754' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2023-07-14T18:12:04.175 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:12:03 smithi184 ceph-mon[98481]: from='client.? 172.21.15.163:0/3438611482' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2023-07-14T18:12:04.219 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:04.179+0000 7f6fddde7700 1 -- 172.21.15.163:0/1625493653 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f6fd81018c0 msgr2=0x7f6fd8109d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:12:04.219 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:04.179+0000 7f6fddde7700 1 --2- 172.21.15.163:0/1625493653 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f6fd81018c0 0x7f6fd8109d30 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f6fcc009990 tx=0x7f6fcc009ca0 comp rx=0 tx=0).stop 2023-07-14T18:12:04.219 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:04.179+0000 7f6fddde7700 1 -- 172.21.15.163:0/1625493653 shutdown_connections 2023-07-14T18:12:04.219 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:04.179+0000 7f6fddde7700 1 --2- 172.21.15.163:0/1625493653 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6fd810a3a0 0x7f6fd810c7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:04.220 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:04.179+0000 7f6fddde7700 1 --2- 172.21.15.163:0/1625493653 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6fd8100f20 0x7f6fd81012f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:04.220 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:04.179+0000 7f6fddde7700 1 --2- 172.21.15.163:0/1625493653 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f6fd81018c0 0x7f6fd8109d30 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:04.220 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:04.179+0000 7f6fddde7700 1 -- 172.21.15.163:0/1625493653 >> 172.21.15.163:0/1625493653 conn(0x7f6fd8075c90 msgr2=0x7f6fd8076090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:12:04.220 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:04.179+0000 7f6fddde7700 1 -- 172.21.15.163:0/1625493653 shutdown_connections 2023-07-14T18:12:04.220 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:04.179+0000 7f6fddde7700 1 -- 172.21.15.163:0/1625493653 wait complete. 2023-07-14T18:12:04.221 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:04.180+0000 7f6fddde7700 1 Processor -- start 2023-07-14T18:12:04.222 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:04.180+0000 7f6fddde7700 1 -- start start 2023-07-14T18:12:04.222 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:04.180+0000 7f6fddde7700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f6fd8100f20 0x7f6fd8195db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:12:04.222 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:04.180+0000 7f6fddde7700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6fd81018c0 0x7f6fd81962f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:12:04.222 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:04.180+0000 7f6fddde7700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6fd810a3a0 0x7f6fd819a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:12:04.222 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:04.180+0000 7f6fddde7700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fd819ad70 con 0x7f6fd8100f20 2023-07-14T18:12:04.222 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:04.180+0000 7f6fddde7700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fd819aee0 con 0x7f6fd81018c0 2023-07-14T18:12:04.222 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:04.180+0000 7f6fddde7700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fd819b0a0 con 0x7f6fd810a3a0 2023-07-14T18:12:04.223 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:04.180+0000 7f6fd77fe700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f6fd8100f20 0x7f6fd8195db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:12:04.223 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:04.180+0000 7f6fd77fe700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f6fd8100f20 0x7f6fd8195db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:56696/0 (socket says 172.21.15.163:56696) 2023-07-14T18:12:04.223 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:04.180+0000 7f6fd77fe700 1 -- 172.21.15.163:0/240108610 learned_addr learned my addr 172.21.15.163:0/240108610 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:12:04.223 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:04.181+0000 7f6fd6ffd700 1 --2- 172.21.15.163:0/240108610 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6fd81018c0 0x7f6fd81962f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:12:04.223 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:04.181+0000 7f6fd7fff700 1 --2- 172.21.15.163:0/240108610 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6fd810a3a0 0x7f6fd819a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:12:04.223 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:04.181+0000 7f6fd77fe700 1 -- 172.21.15.163:0/240108610 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6fd810a3a0 msgr2=0x7f6fd819a760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:12:04.223 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:04.181+0000 7f6fd77fe700 1 --2- 172.21.15.163:0/240108610 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6fd810a3a0 0x7f6fd819a760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:04.224 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:04.181+0000 7f6fd77fe700 1 -- 172.21.15.163:0/240108610 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6fd81018c0 msgr2=0x7f6fd81962f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:12:04.224 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:04.181+0000 7f6fd77fe700 1 --2- 172.21.15.163:0/240108610 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6fd81018c0 0x7f6fd81962f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:04.224 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:04.181+0000 7f6fd77fe700 1 -- 172.21.15.163:0/240108610 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6fcc0095f0 con 0x7f6fd8100f20 2023-07-14T18:12:04.224 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:04.181+0000 7f6fd6ffd700 1 --2- 172.21.15.163:0/240108610 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6fd81018c0 0x7f6fd81962f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T18:12:04.224 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:04.181+0000 7f6fd7fff700 1 --2- 172.21.15.163:0/240108610 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6fd810a3a0 0x7f6fd819a760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T18:12:04.224 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:04.181+0000 7f6fd77fe700 1 --2- 172.21.15.163:0/240108610 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f6fd8100f20 0x7f6fd8195db0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f6fc800e9a0 tx=0x7f6fc800ed60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:12:04.224 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:04.181+0000 7f6fd4ff9700 1 -- 172.21.15.163:0/240108610 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fc8009790 con 0x7f6fd8100f20 2023-07-14T18:12:04.224 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:04.181+0000 7f6fddde7700 1 -- 172.21.15.163:0/240108610 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6fd819b380 con 0x7f6fd8100f20 2023-07-14T18:12:04.225 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:04.181+0000 7f6fd4ff9700 1 -- 172.21.15.163:0/240108610 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f6fc800cbd0 con 0x7f6fd8100f20 2023-07-14T18:12:04.225 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:04.181+0000 7f6fd4ff9700 1 -- 172.21.15.163:0/240108610 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fc8018680 con 0x7f6fd8100f20 2023-07-14T18:12:04.225 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:04.181+0000 7f6fddde7700 1 -- 172.21.15.163:0/240108610 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6fd81a2be0 con 0x7f6fd8100f20 2023-07-14T18:12:04.225 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:04.182+0000 7f6fddde7700 1 -- 172.21.15.163:0/240108610 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6fd8104b70 con 0x7f6fd8100f20 2023-07-14T18:12:04.226 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:04.183+0000 7f6fd4ff9700 1 -- 172.21.15.163:0/240108610 <== mon.0 v2:172.21.15.163:3300/0 4 ==== mgrmap(e 17) v1 ==== 135767+0+0 (secure 0 0 0) 0x7f6fc800cd40 con 0x7f6fd8100f20 2023-07-14T18:12:04.226 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:04.184+0000 7f6fd4ff9700 1 --2- 172.21.15.163:0/240108610 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f6fc00a11e0 0x7f6fc00a3690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:12:04.226 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:04.184+0000 7f6fd4ff9700 1 -- 172.21.15.163:0/240108610 <== mon.0 v2:172.21.15.163:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 8730+0+0 (secure 0 0 0) 0x7f6fc8014070 con 0x7f6fd8100f20 2023-07-14T18:12:04.226 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:04.184+0000 7f6fd6ffd700 1 --2- 172.21.15.163:0/240108610 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f6fc00a11e0 0x7f6fc00a3690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:12:04.226 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:04.184+0000 7f6fd6ffd700 1 --2- 172.21.15.163:0/240108610 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f6fc00a11e0 0x7f6fc00a3690 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f6fcc00b2e0 tx=0x7f6fcc005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:12:04.227 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:04.187+0000 7f6fd4ff9700 1 -- 172.21.15.163:0/240108610 <== mon.0 v2:172.21.15.163:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178025 (secure 0 0 0) 0x7f6fc80965e0 con 0x7f6fd8100f20 2023-07-14T18:12:04.254 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:04.214+0000 7fb2e5e59700 1 -- 172.21.15.163:0/1523523776 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fb2e00fff30 msgr2=0x7fb2e0100300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:12:04.254 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:04.214+0000 7fb2e5e59700 1 --2- 172.21.15.163:0/1523523776 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fb2e00fff30 0x7fb2e0100300 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fb2d00099c0 tx=0x7fb2d0009cd0 comp rx=0 tx=0).stop 2023-07-14T18:12:04.254 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:04.214+0000 7fb2e5e59700 1 -- 172.21.15.163:0/1523523776 shutdown_connections 2023-07-14T18:12:04.255 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:04.214+0000 7fb2e5e59700 1 --2- 172.21.15.163:0/1523523776 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb2e0104fd0 0x7fb2e010cb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:04.255 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:04.214+0000 7fb2e5e59700 1 --2- 172.21.15.163:0/1523523776 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fb2e00fff30 0x7fb2e0100300 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:04.255 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:04.214+0000 7fb2e5e59700 1 --2- 172.21.15.163:0/1523523776 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb2e01008d0 0x7fb2e01048a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:04.255 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:04.214+0000 7fb2e5e59700 1 -- 172.21.15.163:0/1523523776 >> 172.21.15.163:0/1523523776 conn(0x7fb2e00fb7d0 msgr2=0x7fb2e00fdbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:12:04.255 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:04.214+0000 7fb2e5e59700 1 -- 172.21.15.163:0/1523523776 shutdown_connections 2023-07-14T18:12:04.255 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:04.214+0000 7fb2e5e59700 1 -- 172.21.15.163:0/1523523776 wait complete. 2023-07-14T18:12:04.257 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:04.215+0000 7fb2e5e59700 1 Processor -- start 2023-07-14T18:12:04.257 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:04.215+0000 7fb2e5e59700 1 -- start start 2023-07-14T18:12:04.257 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:04.216+0000 7fb2e5e59700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb2e00fff30 0x7fb2e019ba10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:12:04.257 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:04.216+0000 7fb2e5e59700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb2e01008d0 0x7fb2e019bf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:12:04.257 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:04.216+0000 7fb2e5e59700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fb2e0104fd0 0x7fb2e0195a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:12:04.258 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:04.216+0000 7fb2e5e59700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2e0196100 con 0x7fb2e0104fd0 2023-07-14T18:12:04.258 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:04.216+0000 7fb2e5e59700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2e0196270 con 0x7fb2e01008d0 2023-07-14T18:12:04.258 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:04.216+0000 7fb2e5e59700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2e0196430 con 0x7fb2e00fff30 2023-07-14T18:12:04.258 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:04.216+0000 7fb2dffff700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fb2e0104fd0 0x7fb2e0195a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:12:04.258 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:04.216+0000 7fb2dffff700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fb2e0104fd0 0x7fb2e0195a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:56714/0 (socket says 172.21.15.163:56714) 2023-07-14T18:12:04.258 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:04.216+0000 7fb2dffff700 1 -- 172.21.15.163:0/745254944 learned_addr learned my addr 172.21.15.163:0/745254944 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:12:04.258 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:04.216+0000 7fb2deffd700 1 --2- 172.21.15.163:0/745254944 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb2e01008d0 0x7fb2e019bf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:12:04.259 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:04.216+0000 7fb2df7fe700 1 --2- 172.21.15.163:0/745254944 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb2e00fff30 0x7fb2e019ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:12:04.259 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:04.216+0000 7fb2dffff700 1 -- 172.21.15.163:0/745254944 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb2e00fff30 msgr2=0x7fb2e019ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:12:04.259 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:04.216+0000 7fb2dffff700 1 --2- 172.21.15.163:0/745254944 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb2e00fff30 0x7fb2e019ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:04.259 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:04.216+0000 7fb2dffff700 1 -- 172.21.15.163:0/745254944 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb2e01008d0 msgr2=0x7fb2e019bf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:12:04.260 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:04.216+0000 7fb2dffff700 1 --2- 172.21.15.163:0/745254944 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb2e01008d0 0x7fb2e019bf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:04.260 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:04.216+0000 7fb2dffff700 1 -- 172.21.15.163:0/745254944 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2d00095f0 con 0x7fb2e0104fd0 2023-07-14T18:12:04.260 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:04.216+0000 7fb2dffff700 1 --2- 172.21.15.163:0/745254944 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fb2e0104fd0 0x7fb2e0195a90 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fb2d800ef30 tx=0x7fb2d800c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:12:04.260 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:04.216+0000 7fb2dcff9700 1 -- 172.21.15.163:0/745254944 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2d8018070 con 0x7fb2e0104fd0 2023-07-14T18:12:04.260 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:04.216+0000 7fb2dcff9700 1 -- 172.21.15.163:0/745254944 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fb2d800f040 con 0x7fb2e0104fd0 2023-07-14T18:12:04.260 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:04.216+0000 7fb2e5e59700 1 -- 172.21.15.163:0/745254944 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb2e01966b0 con 0x7fb2e0104fd0 2023-07-14T18:12:04.260 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:04.216+0000 7fb2dcff9700 1 -- 172.21.15.163:0/745254944 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2d800cbc0 con 0x7fb2e0104fd0 2023-07-14T18:12:04.261 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:04.217+0000 7fb2e5e59700 1 -- 172.21.15.163:0/745254944 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2e01a2a00 con 0x7fb2e0104fd0 2023-07-14T18:12:04.261 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:04.217+0000 7fb2e5e59700 1 -- 172.21.15.163:0/745254944 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb2e004e340 con 0x7fb2e0104fd0 2023-07-14T18:12:04.261 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:04.219+0000 7fb2dcff9700 1 -- 172.21.15.163:0/745254944 <== mon.0 v2:172.21.15.163:3300/0 4 ==== mgrmap(e 17) v1 ==== 135767+0+0 (secure 0 0 0) 0x7fb2d800cd20 con 0x7fb2e0104fd0 2023-07-14T18:12:04.262 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:04.220+0000 7fb2dcff9700 1 --2- 172.21.15.163:0/745254944 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7fb2c80a11e0 0x7fb2c80a3690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:12:04.262 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:04.220+0000 7fb2dcff9700 1 -- 172.21.15.163:0/745254944 <== mon.0 v2:172.21.15.163:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 8730+0+0 (secure 0 0 0) 0x7fb2d80cc9e0 con 0x7fb2e0104fd0 2023-07-14T18:12:04.262 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:04.220+0000 7fb2df7fe700 1 --2- 172.21.15.163:0/745254944 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7fb2c80a11e0 0x7fb2c80a3690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:12:04.262 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:04.220+0000 7fb2df7fe700 1 --2- 172.21.15.163:0/745254944 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7fb2c80a11e0 0x7fb2c80a3690 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fb2d000b580 tx=0x7fb2d0005be0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:12:04.262 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:04.223+0000 7fb2dcff9700 1 -- 172.21.15.163:0/745254944 <== mon.0 v2:172.21.15.163:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178025 (secure 0 0 0) 0x7fb2d8095de0 con 0x7fb2e0104fd0 2023-07-14T18:12:04.275 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:12:03 smithi172 ceph-mon[97983]: from='client.? 172.21.15.163:0/1805271562' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2023-07-14T18:12:04.276 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:12:03 smithi172 ceph-mon[97983]: from='client.? 172.21.15.163:0/3279781754' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2023-07-14T18:12:04.276 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:12:03 smithi172 ceph-mon[97983]: from='client.? 172.21.15.163:0/3438611482' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2023-07-14T18:12:04.428 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:04.388+0000 7f6fddde7700 1 -- 172.21.15.163:0/240108610 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 9} v 0) v1 -- 0x7f6fd8197210 con 0x7f6fd8100f20 2023-07-14T18:12:04.429 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:04.389+0000 7f6fd4ff9700 1 -- 172.21.15.163:0/240108610 <== mon.0 v2:172.21.15.163:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 9}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f6fc8026090 con 0x7f6fd8100f20 2023-07-14T18:12:04.429 INFO:teuthology.orchestra.run.smithi163.stdout:270582939679 2023-07-14T18:12:04.431 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:04.391+0000 7f6fddde7700 1 -- 172.21.15.163:0/240108610 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f6fc00a11e0 msgr2=0x7f6fc00a3690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:12:04.431 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:04.391+0000 7f6fddde7700 1 --2- 172.21.15.163:0/240108610 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f6fc00a11e0 0x7f6fc00a3690 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f6fcc00b2e0 tx=0x7f6fcc005fb0 comp rx=0 tx=0).stop 2023-07-14T18:12:04.431 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:04.391+0000 7f6fddde7700 1 -- 172.21.15.163:0/240108610 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f6fd8100f20 msgr2=0x7f6fd8195db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:12:04.431 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:04.391+0000 7f6fddde7700 1 --2- 172.21.15.163:0/240108610 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f6fd8100f20 0x7f6fd8195db0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f6fc800e9a0 tx=0x7f6fc800ed60 comp rx=0 tx=0).stop 2023-07-14T18:12:04.432 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:04.391+0000 7f6fddde7700 1 -- 172.21.15.163:0/240108610 shutdown_connections 2023-07-14T18:12:04.432 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:04.391+0000 7f6fddde7700 1 --2- 172.21.15.163:0/240108610 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f6fc00a11e0 0x7f6fc00a3690 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:04.432 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:04.391+0000 7f6fddde7700 1 --2- 172.21.15.163:0/240108610 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6fd810a3a0 0x7f6fd819a760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:04.432 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:04.391+0000 7f6fddde7700 1 --2- 172.21.15.163:0/240108610 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f6fd8100f20 0x7f6fd8195db0 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:04.432 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:04.391+0000 7f6fddde7700 1 --2- 172.21.15.163:0/240108610 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6fd81018c0 0x7f6fd81962f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:04.433 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:04.391+0000 7f6fddde7700 1 -- 172.21.15.163:0/240108610 >> 172.21.15.163:0/240108610 conn(0x7f6fd8075c90 msgr2=0x7f6fd8101cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:12:04.433 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:04.391+0000 7f6fddde7700 1 -- 172.21.15.163:0/240108610 shutdown_connections 2023-07-14T18:12:04.433 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:04.391+0000 7f6fddde7700 1 -- 172.21.15.163:0/240108610 wait complete. 2023-07-14T18:12:04.463 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:04.423+0000 7fb2e5e59700 1 -- 172.21.15.163:0/745254944 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 10} v 0) v1 -- 0x7fb2e0196fa0 con 0x7fb2e0104fd0 2023-07-14T18:12:04.464 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:04.424+0000 7fb2dcff9700 1 -- 172.21.15.163:0/745254944 <== mon.0 v2:172.21.15.163:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 10}]=0 v0) v1 ==== 75+0+13 (secure 0 0 0) 0x7fb2d8099400 con 0x7fb2e0104fd0 2023-07-14T18:12:04.464 INFO:teuthology.orchestra.run.smithi163.stdout:292057776154 2023-07-14T18:12:04.465 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:04.426+0000 7fb2e5e59700 1 -- 172.21.15.163:0/745254944 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7fb2c80a11e0 msgr2=0x7fb2c80a3690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:12:04.465 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:04.426+0000 7fb2e5e59700 1 --2- 172.21.15.163:0/745254944 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7fb2c80a11e0 0x7fb2c80a3690 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fb2d000b580 tx=0x7fb2d0005be0 comp rx=0 tx=0).stop 2023-07-14T18:12:04.466 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:04.426+0000 7fb2e5e59700 1 -- 172.21.15.163:0/745254944 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fb2e0104fd0 msgr2=0x7fb2e0195a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:12:04.466 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:04.426+0000 7fb2e5e59700 1 --2- 172.21.15.163:0/745254944 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fb2e0104fd0 0x7fb2e0195a90 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fb2d800ef30 tx=0x7fb2d800c3a0 comp rx=0 tx=0).stop 2023-07-14T18:12:04.466 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:04.426+0000 7fb2e5e59700 1 -- 172.21.15.163:0/745254944 shutdown_connections 2023-07-14T18:12:04.466 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:04.426+0000 7fb2e5e59700 1 --2- 172.21.15.163:0/745254944 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7fb2c80a11e0 0x7fb2c80a3690 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:04.466 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:04.426+0000 7fb2e5e59700 1 --2- 172.21.15.163:0/745254944 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb2e00fff30 0x7fb2e019ba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:04.466 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:04.426+0000 7fb2e5e59700 1 --2- 172.21.15.163:0/745254944 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fb2e0104fd0 0x7fb2e0195a90 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:04.466 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:04.426+0000 7fb2e5e59700 1 --2- 172.21.15.163:0/745254944 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb2e01008d0 0x7fb2e019bf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:04.467 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:04.426+0000 7fb2e5e59700 1 -- 172.21.15.163:0/745254944 >> 172.21.15.163:0/745254944 conn(0x7fb2e00fb7d0 msgr2=0x7fb2e0103880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:12:04.467 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:04.426+0000 7fb2e5e59700 1 -- 172.21.15.163:0/745254944 shutdown_connections 2023-07-14T18:12:04.467 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:04.426+0000 7fb2e5e59700 1 -- 172.21.15.163:0/745254944 wait complete. 2023-07-14T18:12:04.719 INFO:tasks.cephadm.ceph_manager.ceph:need seq 158913789996 got 158913789998 for osd.5 2023-07-14T18:12:04.720 DEBUG:teuthology.parallel:result is None 2023-07-14T18:12:04.965 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:12:04 smithi163 ceph-mon[96576]: pgmap v278: 129 pgs: 129 active+clean; 643 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 170 B/s wr, 10 op/s 2023-07-14T18:12:04.966 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:12:04 smithi163 ceph-mon[96576]: from='client.? 172.21.15.163:0/240108610' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2023-07-14T18:12:04.966 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:12:04 smithi163 ceph-mon[96576]: from='client.? 172.21.15.163:0/745254944' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2023-07-14T18:12:05.119 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:05.080+0000 7f90086b5700 1 -- 172.21.15.163:0/410269451 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f90000fff40 msgr2=0x7f9000100310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:12:05.120 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:05.080+0000 7f90086b5700 1 --2- 172.21.15.163:0/410269451 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f90000fff40 0x7f9000100310 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f8ff00099c0 tx=0x7f8ff0009cd0 comp rx=0 tx=0).stop 2023-07-14T18:12:05.120 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:05.080+0000 7f90086b5700 1 -- 172.21.15.163:0/410269451 shutdown_connections 2023-07-14T18:12:05.120 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:05.080+0000 7f90086b5700 1 --2- 172.21.15.163:0/410269451 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9000104fe0 0x7f900010cb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:05.120 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:05.080+0000 7f90086b5700 1 --2- 172.21.15.163:0/410269451 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f90000fff40 0x7f9000100310 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:05.120 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:05.080+0000 7f90086b5700 1 --2- 172.21.15.163:0/410269451 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f90001008e0 0x7f90001048b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:05.121 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:05.080+0000 7f90086b5700 1 -- 172.21.15.163:0/410269451 >> 172.21.15.163:0/410269451 conn(0x7f90000fb7c0 msgr2=0x7f90000fdbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:12:05.121 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:05.080+0000 7f90086b5700 1 -- 172.21.15.163:0/410269451 shutdown_connections 2023-07-14T18:12:05.121 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:05.080+0000 7f90086b5700 1 -- 172.21.15.163:0/410269451 wait complete. 2023-07-14T18:12:05.122 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:05.080+0000 7f90086b5700 1 Processor -- start 2023-07-14T18:12:05.123 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:05.080+0000 7f90086b5700 1 -- start start 2023-07-14T18:12:05.123 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:05.081+0000 7f90086b5700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f90000fff40 0x7f900019b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:12:05.123 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:05.081+0000 7f90086b5700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f90001008e0 0x7f900019bf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:12:05.123 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:05.081+0000 7f90086b5700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f9000104fe0 0x7f9000195a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:12:05.123 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:05.081+0000 7f90086b5700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90001960b0 con 0x7f9000104fe0 2023-07-14T18:12:05.123 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:05.081+0000 7f90086b5700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9000196220 con 0x7f90001008e0 2023-07-14T18:12:05.123 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:05.081+0000 7f90086b5700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90001963e0 con 0x7f90000fff40 2023-07-14T18:12:05.124 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:05.081+0000 7f9006c52700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f9000104fe0 0x7f9000195a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:12:05.124 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:05.081+0000 7f9006c52700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f9000104fe0 0x7f9000195a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:56726/0 (socket says 172.21.15.163:56726) 2023-07-14T18:12:05.124 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:05.081+0000 7f9006c52700 1 -- 172.21.15.163:0/2000612492 learned_addr learned my addr 172.21.15.163:0/2000612492 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:12:05.124 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:05.081+0000 7f9005c50700 1 --2- 172.21.15.163:0/2000612492 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f90001008e0 0x7f900019bf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:12:05.124 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:05.081+0000 7f9006451700 1 --2- 172.21.15.163:0/2000612492 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f90000fff40 0x7f900019b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:12:05.124 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:05.081+0000 7f9006c52700 1 -- 172.21.15.163:0/2000612492 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f90000fff40 msgr2=0x7f900019b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:12:05.124 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:05.081+0000 7f9006c52700 1 --2- 172.21.15.163:0/2000612492 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f90000fff40 0x7f900019b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:05.125 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:05.081+0000 7f9006c52700 1 -- 172.21.15.163:0/2000612492 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f90001008e0 msgr2=0x7f900019bf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:12:05.125 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:05.081+0000 7f9006c52700 1 --2- 172.21.15.163:0/2000612492 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f90001008e0 0x7f900019bf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:05.125 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:05.081+0000 7f9006c52700 1 -- 172.21.15.163:0/2000612492 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ff00095f0 con 0x7f9000104fe0 2023-07-14T18:12:05.125 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:05.081+0000 7f9006c52700 1 --2- 172.21.15.163:0/2000612492 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f9000104fe0 0x7f9000195a40 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f8ff8007d70 tx=0x7f8ff800a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:12:05.125 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:05.081+0000 7f8ff77fe700 1 -- 172.21.15.163:0/2000612492 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ff800ac90 con 0x7f9000104fe0 2023-07-14T18:12:05.125 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:05.081+0000 7f8ff77fe700 1 -- 172.21.15.163:0/2000612492 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f8ff800adf0 con 0x7f9000104fe0 2023-07-14T18:12:05.125 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:05.081+0000 7f90086b5700 1 -- 172.21.15.163:0/2000612492 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f90001966c0 con 0x7f9000104fe0 2023-07-14T18:12:05.125 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:05.081+0000 7f8ff77fe700 1 -- 172.21.15.163:0/2000612492 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ff80115e0 con 0x7f9000104fe0 2023-07-14T18:12:05.126 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:05.082+0000 7f90086b5700 1 -- 172.21.15.163:0/2000612492 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f90001a29b0 con 0x7f9000104fe0 2023-07-14T18:12:05.126 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:05.083+0000 7f90086b5700 1 -- 172.21.15.163:0/2000612492 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f900004e340 con 0x7f9000104fe0 2023-07-14T18:12:05.126 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:05.084+0000 7f8ff77fe700 1 -- 172.21.15.163:0/2000612492 <== mon.0 v2:172.21.15.163:3300/0 4 ==== mgrmap(e 17) v1 ==== 135767+0+0 (secure 0 0 0) 0x7f8ff8012420 con 0x7f9000104fe0 2023-07-14T18:12:05.127 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:05.084+0000 7f8ff77fe700 1 --2- 172.21.15.163:0/2000612492 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f8fec0a11e0 0x7f8fec0a3690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:12:05.127 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:05.084+0000 7f9006451700 1 --2- 172.21.15.163:0/2000612492 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f8fec0a11e0 0x7f8fec0a3690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:12:05.127 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:05.084+0000 7f8ff77fe700 1 -- 172.21.15.163:0/2000612492 <== mon.0 v2:172.21.15.163:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 8730+0+0 (secure 0 0 0) 0x7f8ff80ccca0 con 0x7f9000104fe0 2023-07-14T18:12:05.127 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:05.085+0000 7f9006451700 1 --2- 172.21.15.163:0/2000612492 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f8fec0a11e0 0x7f8fec0a3690 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f8ff000b580 tx=0x7f8ff0009f10 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:12:05.128 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:05.088+0000 7f8ff77fe700 1 -- 172.21.15.163:0/2000612492 <== mon.0 v2:172.21.15.163:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178025 (secure 0 0 0) 0x7f8ff80961b0 con 0x7f9000104fe0 2023-07-14T18:12:05.174 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:12:04 smithi184 ceph-mon[98481]: pgmap v278: 129 pgs: 129 active+clean; 643 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 170 B/s wr, 10 op/s 2023-07-14T18:12:05.175 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:12:04 smithi184 ceph-mon[98481]: from='client.? 172.21.15.163:0/240108610' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2023-07-14T18:12:05.175 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:12:04 smithi184 ceph-mon[98481]: from='client.? 172.21.15.163:0/745254944' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2023-07-14T18:12:05.275 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:12:04 smithi172 ceph-mon[97983]: pgmap v278: 129 pgs: 129 active+clean; 643 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 170 B/s wr, 10 op/s 2023-07-14T18:12:05.276 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:12:04 smithi172 ceph-mon[97983]: from='client.? 172.21.15.163:0/240108610' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2023-07-14T18:12:05.276 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:12:04 smithi172 ceph-mon[97983]: from='client.? 172.21.15.163:0/745254944' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2023-07-14T18:12:05.321 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:05.281+0000 7f90086b5700 1 -- 172.21.15.163:0/2000612492 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f90001a2d30 con 0x7f9000104fe0 2023-07-14T18:12:05.321 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:05.281+0000 7f8ff77fe700 1 -- 172.21.15.163:0/2000612492 <== mon.0 v2:172.21.15.163:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f8ff80997d0 con 0x7f9000104fe0 2023-07-14T18:12:05.322 INFO:teuthology.orchestra.run.smithi163.stdout:210453397542 2023-07-14T18:12:05.323 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:05.283+0000 7f90086b5700 1 -- 172.21.15.163:0/2000612492 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f8fec0a11e0 msgr2=0x7f8fec0a3690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:12:05.323 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:05.283+0000 7f90086b5700 1 --2- 172.21.15.163:0/2000612492 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f8fec0a11e0 0x7f8fec0a3690 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f8ff000b580 tx=0x7f8ff0009f10 comp rx=0 tx=0).stop 2023-07-14T18:12:05.323 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:05.283+0000 7f90086b5700 1 -- 172.21.15.163:0/2000612492 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f9000104fe0 msgr2=0x7f9000195a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:12:05.324 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:05.283+0000 7f90086b5700 1 --2- 172.21.15.163:0/2000612492 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f9000104fe0 0x7f9000195a40 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f8ff8007d70 tx=0x7f8ff800a340 comp rx=0 tx=0).stop 2023-07-14T18:12:05.324 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:05.283+0000 7f90086b5700 1 -- 172.21.15.163:0/2000612492 shutdown_connections 2023-07-14T18:12:05.324 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:05.283+0000 7f90086b5700 1 --2- 172.21.15.163:0/2000612492 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f8fec0a11e0 0x7f8fec0a3690 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:05.324 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:05.283+0000 7f90086b5700 1 --2- 172.21.15.163:0/2000612492 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f90000fff40 0x7f900019b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:05.324 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:05.283+0000 7f90086b5700 1 --2- 172.21.15.163:0/2000612492 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f9000104fe0 0x7f9000195a40 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:05.324 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:05.284+0000 7f90086b5700 1 --2- 172.21.15.163:0/2000612492 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f90001008e0 0x7f900019bf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:05.325 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:05.284+0000 7f90086b5700 1 -- 172.21.15.163:0/2000612492 >> 172.21.15.163:0/2000612492 conn(0x7f90000fb7c0 msgr2=0x7f9000103890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:12:05.325 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:05.284+0000 7f90086b5700 1 -- 172.21.15.163:0/2000612492 shutdown_connections 2023-07-14T18:12:05.325 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:05.284+0000 7f90086b5700 1 -- 172.21.15.163:0/2000612492 wait complete. 2023-07-14T18:12:05.513 INFO:tasks.cephadm.ceph_manager.ceph:need seq 292057776151 got 292057776154 for osd.10 2023-07-14T18:12:05.513 DEBUG:teuthology.parallel:result is None 2023-07-14T18:12:05.591 INFO:tasks.cephadm.ceph_manager.ceph:need seq 270582939676 got 270582939679 for osd.9 2023-07-14T18:12:05.591 DEBUG:teuthology.parallel:result is None 2023-07-14T18:12:05.689 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:05.649+0000 7f8adfdf1700 1 -- 172.21.15.163:0/2640693643 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f8ad8100990 msgr2=0x7f8ad8104960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:12:05.689 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:05.649+0000 7f8adfdf1700 1 --2- 172.21.15.163:0/2640693643 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f8ad8100990 0x7f8ad8104960 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f8ac80099c0 tx=0x7f8ac8009cd0 comp rx=0 tx=0).stop 2023-07-14T18:12:05.689 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:05.649+0000 7f8adfdf1700 1 -- 172.21.15.163:0/2640693643 shutdown_connections 2023-07-14T18:12:05.689 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:05.649+0000 7f8adfdf1700 1 --2- 172.21.15.163:0/2640693643 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8ad80ffff0 0x7f8ad81003c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:05.690 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:05.649+0000 7f8adfdf1700 1 --2- 172.21.15.163:0/2640693643 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8ad8105090 0x7f8ad810cc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:05.690 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:05.649+0000 7f8adfdf1700 1 --2- 172.21.15.163:0/2640693643 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f8ad8100990 0x7f8ad8104960 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:05.690 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:05.649+0000 7f8adfdf1700 1 -- 172.21.15.163:0/2640693643 >> 172.21.15.163:0/2640693643 conn(0x7f8ad8077d00 msgr2=0x7f8ad8078100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:12:05.690 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:05.649+0000 7f8adfdf1700 1 -- 172.21.15.163:0/2640693643 shutdown_connections 2023-07-14T18:12:05.690 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:05.649+0000 7f8adfdf1700 1 -- 172.21.15.163:0/2640693643 wait complete. 2023-07-14T18:12:05.690 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:05.649+0000 7f8adfdf1700 1 Processor -- start 2023-07-14T18:12:05.691 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:05.649+0000 7f8adfdf1700 1 -- start start 2023-07-14T18:12:05.692 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:05.650+0000 7f8adfdf1700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f8ad80ffff0 0x7f8ad8072940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:12:05.692 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:05.650+0000 7f8adfdf1700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8ad8100990 0x7f8ad8072e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:12:05.692 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:05.650+0000 7f8adfdf1700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8ad8105090 0x7f8ad8073400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:12:05.692 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:05.650+0000 7f8adfdf1700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ad81a4170 con 0x7f8ad80ffff0 2023-07-14T18:12:05.693 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:05.650+0000 7f8adfdf1700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ad81a42e0 con 0x7f8ad8105090 2023-07-14T18:12:05.693 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:05.650+0000 7f8adfdf1700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ad81a44a0 con 0x7f8ad8100990 2023-07-14T18:12:05.693 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:05.650+0000 7f8addb8d700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f8ad80ffff0 0x7f8ad8072940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:12:05.693 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:05.650+0000 7f8addb8d700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f8ad80ffff0 0x7f8ad8072940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:56736/0 (socket says 172.21.15.163:56736) 2023-07-14T18:12:05.693 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:05.650+0000 7f8addb8d700 1 -- 172.21.15.163:0/1391899679 learned_addr learned my addr 172.21.15.163:0/1391899679 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:12:05.694 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:05.650+0000 7f8add38c700 1 --2- 172.21.15.163:0/1391899679 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8ad8100990 0x7f8ad8072e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:12:05.694 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:05.650+0000 7f8ade38e700 1 --2- 172.21.15.163:0/1391899679 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8ad8105090 0x7f8ad8073400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:12:05.694 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:05.650+0000 7f8addb8d700 1 -- 172.21.15.163:0/1391899679 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8ad8100990 msgr2=0x7f8ad8072e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:12:05.694 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:05.650+0000 7f8addb8d700 1 --2- 172.21.15.163:0/1391899679 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8ad8100990 0x7f8ad8072e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:05.694 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:05.650+0000 7f8addb8d700 1 -- 172.21.15.163:0/1391899679 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8ad8105090 msgr2=0x7f8ad8073400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:12:05.694 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:05.650+0000 7f8addb8d700 1 --2- 172.21.15.163:0/1391899679 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8ad8105090 0x7f8ad8073400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:05.694 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:05.650+0000 7f8addb8d700 1 -- 172.21.15.163:0/1391899679 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ac80095f0 con 0x7f8ad80ffff0 2023-07-14T18:12:05.695 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:05.650+0000 7f8addb8d700 1 --2- 172.21.15.163:0/1391899679 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f8ad80ffff0 0x7f8ad8072940 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f8ad400d950 tx=0x7f8ad400dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:12:05.695 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:05.650+0000 7f8aceffd700 1 -- 172.21.15.163:0/1391899679 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ad400f890 con 0x7f8ad80ffff0 2023-07-14T18:12:05.695 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:05.650+0000 7f8aceffd700 1 -- 172.21.15.163:0/1391899679 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f8ad400fe80 con 0x7f8ad80ffff0 2023-07-14T18:12:05.695 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:05.650+0000 7f8aceffd700 1 -- 172.21.15.163:0/1391899679 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ad400e3b0 con 0x7f8ad80ffff0 2023-07-14T18:12:05.695 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:05.650+0000 7f8adfdf1700 1 -- 172.21.15.163:0/1391899679 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ad81a4780 con 0x7f8ad80ffff0 2023-07-14T18:12:05.695 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:05.650+0000 7f8adfdf1700 1 -- 172.21.15.163:0/1391899679 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ad81a4c50 con 0x7f8ad80ffff0 2023-07-14T18:12:05.695 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:05.651+0000 7f8adfdf1700 1 -- 172.21.15.163:0/1391899679 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8ad804e340 con 0x7f8ad80ffff0 2023-07-14T18:12:05.695 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:05.653+0000 7f8aceffd700 1 -- 172.21.15.163:0/1391899679 <== mon.0 v2:172.21.15.163:3300/0 4 ==== mgrmap(e 17) v1 ==== 135767+0+0 (secure 0 0 0) 0x7f8ad4010460 con 0x7f8ad80ffff0 2023-07-14T18:12:05.696 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:05.653+0000 7f8aceffd700 1 --2- 172.21.15.163:0/1391899679 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f8ac40a1260 0x7f8ac40a3710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:12:05.696 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:05.653+0000 7f8add38c700 1 --2- 172.21.15.163:0/1391899679 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f8ac40a1260 0x7f8ac40a3710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:12:05.697 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:05.653+0000 7f8aceffd700 1 -- 172.21.15.163:0/1391899679 <== mon.0 v2:172.21.15.163:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 8730+0+0 (secure 0 0 0) 0x7f8ad40cca60 con 0x7f8ad80ffff0 2023-07-14T18:12:05.697 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:05.654+0000 7f8add38c700 1 --2- 172.21.15.163:0/1391899679 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f8ac40a1260 0x7f8ac40a3710 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f8ac8006010 tx=0x7f8ac8009f10 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:12:05.697 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:05.657+0000 7f8aceffd700 1 -- 172.21.15.163:0/1391899679 <== mon.0 v2:172.21.15.163:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178025 (secure 0 0 0) 0x7f8ad4095e60 con 0x7f8ad80ffff0 2023-07-14T18:12:05.897 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:05.857+0000 7f8adfdf1700 1 -- 172.21.15.163:0/1391899679 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f8ad8073e70 con 0x7f8ad80ffff0 2023-07-14T18:12:05.898 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:05.858+0000 7f8aceffd700 1 -- 172.21.15.163:0/1391899679 <== mon.0 v2:172.21.15.163:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f8ad4099480 con 0x7f8ad80ffff0 2023-07-14T18:12:05.898 INFO:teuthology.orchestra.run.smithi163.stdout:188978561068 2023-07-14T18:12:05.899 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:05.860+0000 7f8adfdf1700 1 -- 172.21.15.163:0/1391899679 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f8ac40a1260 msgr2=0x7f8ac40a3710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:12:05.900 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:05.860+0000 7f8adfdf1700 1 --2- 172.21.15.163:0/1391899679 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f8ac40a1260 0x7f8ac40a3710 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f8ac8006010 tx=0x7f8ac8009f10 comp rx=0 tx=0).stop 2023-07-14T18:12:05.900 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:05.860+0000 7f8adfdf1700 1 -- 172.21.15.163:0/1391899679 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f8ad80ffff0 msgr2=0x7f8ad8072940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:12:05.900 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:05.860+0000 7f8adfdf1700 1 --2- 172.21.15.163:0/1391899679 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f8ad80ffff0 0x7f8ad8072940 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f8ad400d950 tx=0x7f8ad400dc60 comp rx=0 tx=0).stop 2023-07-14T18:12:05.900 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:05.860+0000 7f8adfdf1700 1 -- 172.21.15.163:0/1391899679 shutdown_connections 2023-07-14T18:12:05.900 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:05.860+0000 7f8adfdf1700 1 --2- 172.21.15.163:0/1391899679 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f8ac40a1260 0x7f8ac40a3710 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:05.900 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:05.860+0000 7f8adfdf1700 1 --2- 172.21.15.163:0/1391899679 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8ad8105090 0x7f8ad8073400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:05.900 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:05.860+0000 7f8adfdf1700 1 --2- 172.21.15.163:0/1391899679 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f8ad80ffff0 0x7f8ad8072940 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:05.901 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:05.860+0000 7f8adfdf1700 1 --2- 172.21.15.163:0/1391899679 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8ad8100990 0x7f8ad8072e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:05.901 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:05.860+0000 7f8adfdf1700 1 -- 172.21.15.163:0/1391899679 >> 172.21.15.163:0/1391899679 conn(0x7f8ad8077d00 msgr2=0x7f8ad8103940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:12:05.901 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:05.860+0000 7f8adfdf1700 1 -- 172.21.15.163:0/1391899679 shutdown_connections 2023-07-14T18:12:05.901 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:05.860+0000 7f8adfdf1700 1 -- 172.21.15.163:0/1391899679 wait complete. 2023-07-14T18:12:06.014 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:12:05 smithi163 ceph-mon[96576]: from='client.? 172.21.15.163:0/2000612492' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2023-07-14T18:12:06.014 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:12:05 smithi163 ceph-mon[96576]: pgmap v279: 129 pgs: 129 active+clean; 643 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 170 B/s wr, 9 op/s 2023-07-14T18:12:06.127 INFO:tasks.cephadm.ceph_manager.ceph:need seq 107374182453 got 107374182455 for osd.3 2023-07-14T18:12:06.127 DEBUG:teuthology.parallel:result is None 2023-07-14T18:12:06.174 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:12:05 smithi184 ceph-mon[98481]: from='client.? 172.21.15.163:0/2000612492' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2023-07-14T18:12:06.175 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:12:05 smithi184 ceph-mon[98481]: pgmap v279: 129 pgs: 129 active+clean; 643 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 170 B/s wr, 9 op/s 2023-07-14T18:12:06.275 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:12:05 smithi172 ceph-mon[97983]: from='client.? 172.21.15.163:0/2000612492' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2023-07-14T18:12:06.276 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:12:05 smithi172 ceph-mon[97983]: pgmap v279: 129 pgs: 129 active+clean; 643 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 170 B/s wr, 9 op/s 2023-07-14T18:12:06.359 INFO:tasks.cephadm.ceph_manager.ceph:need seq 137438953521 got 137438953523 for osd.4 2023-07-14T18:12:06.360 DEBUG:teuthology.parallel:result is None 2023-07-14T18:12:06.508 INFO:tasks.cephadm.ceph_manager.ceph:need seq 188978561065 got 188978561068 for osd.6 2023-07-14T18:12:06.509 DEBUG:teuthology.parallel:result is None 2023-07-14T18:12:06.837 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:06.796+0000 7fba4f01d700 1 -- 172.21.15.163:0/3700388588 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fba48105090 msgr2=0x7fba4810cc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:12:06.838 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:06.796+0000 7fba4f01d700 1 --2- 172.21.15.163:0/3700388588 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fba48105090 0x7fba4810cc10 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fba4000b0d0 tx=0x7fba4000b3e0 comp rx=0 tx=0).stop 2023-07-14T18:12:06.838 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:06.797+0000 7fba4f01d700 1 -- 172.21.15.163:0/3700388588 shutdown_connections 2023-07-14T18:12:06.838 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:06.797+0000 7fba4f01d700 1 --2- 172.21.15.163:0/3700388588 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fba48105090 0x7fba4810cc10 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:06.838 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:06.797+0000 7fba4f01d700 1 --2- 172.21.15.163:0/3700388588 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fba480ffff0 0x7fba481003c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:06.838 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:06.797+0000 7fba4f01d700 1 --2- 172.21.15.163:0/3700388588 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fba48100990 0x7fba48104960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:06.838 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:06.797+0000 7fba4f01d700 1 -- 172.21.15.163:0/3700388588 >> 172.21.15.163:0/3700388588 conn(0x7fba48077d00 msgr2=0x7fba48078100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:12:06.839 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:06.797+0000 7fba4f01d700 1 -- 172.21.15.163:0/3700388588 shutdown_connections 2023-07-14T18:12:06.839 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:06.797+0000 7fba4f01d700 1 -- 172.21.15.163:0/3700388588 wait complete. 2023-07-14T18:12:06.839 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:06.797+0000 7fba4f01d700 1 Processor -- start 2023-07-14T18:12:06.839 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:06.797+0000 7fba4f01d700 1 -- start start 2023-07-14T18:12:06.839 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:06.797+0000 7fba4f01d700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fba480ffff0 0x7fba48195dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:12:06.839 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:06.797+0000 7fba4f01d700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fba48100990 0x7fba48196310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:12:06.839 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:06.797+0000 7fba4f01d700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fba48105090 0x7fba4819a780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:12:06.839 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:06.797+0000 7fba4f01d700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba4819ad90 con 0x7fba48100990 2023-07-14T18:12:06.840 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:06.797+0000 7fba4f01d700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba4819af00 con 0x7fba48105090 2023-07-14T18:12:06.840 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:06.797+0000 7fba4f01d700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba4819b0c0 con 0x7fba480ffff0 2023-07-14T18:12:06.840 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:06.798+0000 7fba47fff700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fba48100990 0x7fba48196310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:12:06.840 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:06.798+0000 7fba47fff700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fba48100990 0x7fba48196310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:56750/0 (socket says 172.21.15.163:56750) 2023-07-14T18:12:06.840 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:06.798+0000 7fba47fff700 1 -- 172.21.15.163:0/1608319514 learned_addr learned my addr 172.21.15.163:0/1608319514 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:12:06.840 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:06.798+0000 7fba4d5ba700 1 --2- 172.21.15.163:0/1608319514 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fba48105090 0x7fba4819a780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:12:06.840 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:06.798+0000 7fba4cdb9700 1 --2- 172.21.15.163:0/1608319514 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fba480ffff0 0x7fba48195dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:12:06.841 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:06.798+0000 7fba47fff700 1 -- 172.21.15.163:0/1608319514 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fba480ffff0 msgr2=0x7fba48195dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:12:06.841 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:06.798+0000 7fba47fff700 1 --2- 172.21.15.163:0/1608319514 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fba480ffff0 0x7fba48195dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:06.841 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:06.798+0000 7fba47fff700 1 -- 172.21.15.163:0/1608319514 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fba48105090 msgr2=0x7fba4819a780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:12:06.841 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:06.798+0000 7fba47fff700 1 --2- 172.21.15.163:0/1608319514 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fba48105090 0x7fba4819a780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:06.841 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:06.798+0000 7fba47fff700 1 -- 172.21.15.163:0/1608319514 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba40009d00 con 0x7fba48100990 2023-07-14T18:12:06.841 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:06.798+0000 7fba4cdb9700 1 --2- 172.21.15.163:0/1608319514 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fba480ffff0 0x7fba48195dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T18:12:06.841 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:06.798+0000 7fba47fff700 1 --2- 172.21.15.163:0/1608319514 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fba48100990 0x7fba48196310 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fba3400d980 tx=0x7fba3400dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:12:06.842 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:06.798+0000 7fba45ffb700 1 -- 172.21.15.163:0/1608319514 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba34009930 con 0x7fba48100990 2023-07-14T18:12:06.843 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:06.798+0000 7fba45ffb700 1 -- 172.21.15.163:0/1608319514 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fba34010460 con 0x7fba48100990 2023-07-14T18:12:06.843 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:06.798+0000 7fba4f01d700 1 -- 172.21.15.163:0/1608319514 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fba4819b3a0 con 0x7fba48100990 2023-07-14T18:12:06.843 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:06.798+0000 7fba45ffb700 1 -- 172.21.15.163:0/1608319514 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba3400f620 con 0x7fba48100990 2023-07-14T18:12:06.843 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:06.798+0000 7fba4f01d700 1 -- 172.21.15.163:0/1608319514 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba481a2c00 con 0x7fba48100990 2023-07-14T18:12:06.843 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:06.799+0000 7fba4f01d700 1 -- 172.21.15.163:0/1608319514 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fba4804e340 con 0x7fba48100990 2023-07-14T18:12:06.843 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:06.800+0000 7fba45ffb700 1 -- 172.21.15.163:0/1608319514 <== mon.0 v2:172.21.15.163:3300/0 4 ==== mgrmap(e 17) v1 ==== 135767+0+0 (secure 0 0 0) 0x7fba340105d0 con 0x7fba48100990 2023-07-14T18:12:06.844 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:06.801+0000 7fba45ffb700 1 --2- 172.21.15.163:0/1608319514 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7fba380a1260 0x7fba380a3710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:12:06.844 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:06.801+0000 7fba4cdb9700 1 --2- 172.21.15.163:0/1608319514 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7fba380a1260 0x7fba380a3710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:12:06.844 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:06.801+0000 7fba45ffb700 1 -- 172.21.15.163:0/1608319514 <== mon.0 v2:172.21.15.163:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 8730+0+0 (secure 0 0 0) 0x7fba340cc620 con 0x7fba48100990 2023-07-14T18:12:06.844 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:06.801+0000 7fba4cdb9700 1 --2- 172.21.15.163:0/1608319514 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7fba380a1260 0x7fba380a3710 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fba3c005950 tx=0x7fba3c0058e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:12:06.845 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:06.805+0000 7fba45ffb700 1 -- 172.21.15.163:0/1608319514 <== mon.0 v2:172.21.15.163:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178025 (secure 0 0 0) 0x7fba34095a20 con 0x7fba48100990 2023-07-14T18:12:06.907 INFO:tasks.cephadm.ceph_manager.ceph:need seq 210453397540 got 210453397542 for osd.7 2023-07-14T18:12:06.907 DEBUG:teuthology.parallel:result is None 2023-07-14T18:12:07.037 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:06.997+0000 7fba4f01d700 1 -- 172.21.15.163:0/1608319514 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fba481a2ec0 con 0x7fba48100990 2023-07-14T18:12:07.037 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:06.997+0000 7fba45ffb700 1 -- 172.21.15.163:0/1608319514 <== mon.0 v2:172.21.15.163:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fba34099040 con 0x7fba48100990 2023-07-14T18:12:07.037 INFO:teuthology.orchestra.run.smithi163.stdout:77309411389 2023-07-14T18:12:07.039 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:07.000+0000 7fba4f01d700 1 -- 172.21.15.163:0/1608319514 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7fba380a1260 msgr2=0x7fba380a3710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:12:07.040 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:07.000+0000 7fba4f01d700 1 --2- 172.21.15.163:0/1608319514 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7fba380a1260 0x7fba380a3710 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fba3c005950 tx=0x7fba3c0058e0 comp rx=0 tx=0).stop 2023-07-14T18:12:07.040 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:07.000+0000 7fba4f01d700 1 -- 172.21.15.163:0/1608319514 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fba48100990 msgr2=0x7fba48196310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:12:07.040 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:07.000+0000 7fba4f01d700 1 --2- 172.21.15.163:0/1608319514 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fba48100990 0x7fba48196310 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fba3400d980 tx=0x7fba3400dc90 comp rx=0 tx=0).stop 2023-07-14T18:12:07.040 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:07.000+0000 7fba4f01d700 1 -- 172.21.15.163:0/1608319514 shutdown_connections 2023-07-14T18:12:07.040 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:07.000+0000 7fba4f01d700 1 --2- 172.21.15.163:0/1608319514 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7fba380a1260 0x7fba380a3710 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:07.040 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:07.000+0000 7fba4f01d700 1 --2- 172.21.15.163:0/1608319514 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fba480ffff0 0x7fba48195dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:07.041 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:07.000+0000 7fba4f01d700 1 --2- 172.21.15.163:0/1608319514 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fba48105090 0x7fba4819a780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:07.041 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:07.000+0000 7fba4f01d700 1 --2- 172.21.15.163:0/1608319514 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fba48100990 0x7fba48196310 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:07.041 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:07.000+0000 7fba4f01d700 1 -- 172.21.15.163:0/1608319514 >> 172.21.15.163:0/1608319514 conn(0x7fba48077d00 msgr2=0x7fba480fd8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:12:07.041 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:07.000+0000 7fba4f01d700 1 -- 172.21.15.163:0/1608319514 shutdown_connections 2023-07-14T18:12:07.041 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:07.000+0000 7fba4f01d700 1 -- 172.21.15.163:0/1608319514 wait complete. 2023-07-14T18:12:07.174 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:12:06 smithi184 ceph-mon[98481]: from='client.? 172.21.15.163:0/1391899679' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2023-07-14T18:12:07.180 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:12:06 smithi163 ceph-mon[96576]: from='client.? 172.21.15.163:0/1391899679' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2023-07-14T18:12:07.275 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:12:06 smithi172 ceph-mon[97983]: from='client.? 172.21.15.163:0/1391899679' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2023-07-14T18:12:07.424 INFO:tasks.cephadm.ceph_manager.ceph:need seq 77309411386 got 77309411389 for osd.2 2023-07-14T18:12:07.425 DEBUG:teuthology.parallel:result is None 2023-07-14T18:12:07.425 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2023-07-14T18:12:07.425 DEBUG:teuthology.orchestra.run.smithi163:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81c9387d2e7576da065747ec9c16d1c7d69016ec shell --fsid bf7326ec-2270-11ee-9b33-001a4aab830c -- ceph pg dump --format=json 2023-07-14T18:12:07.983 INFO:teuthology.orchestra.run.smithi163.stderr:Inferring config /var/lib/ceph/bf7326ec-2270-11ee-9b33-001a4aab830c/mon.a/config 2023-07-14T18:12:08.170 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:12:07 smithi163 ceph-mon[96576]: from='client.? 172.21.15.163:0/1608319514' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2023-07-14T18:12:08.170 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:12:07 smithi163 ceph-mon[96576]: pgmap v280: 129 pgs: 129 active+clean; 643 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 170 B/s wr, 8 op/s 2023-07-14T18:12:08.174 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:12:07 smithi184 ceph-mon[98481]: from='client.? 172.21.15.163:0/1608319514' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2023-07-14T18:12:08.174 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:12:07 smithi184 ceph-mon[98481]: pgmap v280: 129 pgs: 129 active+clean; 643 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 170 B/s wr, 8 op/s 2023-07-14T18:12:08.275 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:12:07 smithi172 ceph-mon[97983]: from='client.? 172.21.15.163:0/1608319514' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2023-07-14T18:12:08.276 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:12:07 smithi172 ceph-mon[97983]: pgmap v280: 129 pgs: 129 active+clean; 643 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 170 B/s wr, 8 op/s 2023-07-14T18:12:09.174 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:09.134+0000 7fa20452d700 1 -- 172.21.15.163:0/2574120480 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fa1fc0ff7e0 msgr2=0x7fa1fc1037b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:12:09.174 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:09.134+0000 7fa20452d700 1 --2- 172.21.15.163:0/2574120480 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fa1fc0ff7e0 0x7fa1fc1037b0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fa1f80099c0 tx=0x7fa1f8009cd0 comp rx=0 tx=0).stop 2023-07-14T18:12:09.175 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:09.134+0000 7fa20452d700 1 -- 172.21.15.163:0/2574120480 shutdown_connections 2023-07-14T18:12:09.175 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:09.134+0000 7fa20452d700 1 --2- 172.21.15.163:0/2574120480 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa1fc103ee0 0x7fa1fc10ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:09.175 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:09.134+0000 7fa20452d700 1 --2- 172.21.15.163:0/2574120480 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa1fc0fee40 0x7fa1fc0ff210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:09.176 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:09.134+0000 7fa20452d700 1 --2- 172.21.15.163:0/2574120480 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fa1fc0ff7e0 0x7fa1fc1037b0 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:09.176 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:09.134+0000 7fa20452d700 1 -- 172.21.15.163:0/2574120480 >> 172.21.15.163:0/2574120480 conn(0x7fa1fc075ca0 msgr2=0x7fa1fc0760a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:12:09.176 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:09.134+0000 7fa20452d700 1 -- 172.21.15.163:0/2574120480 shutdown_connections 2023-07-14T18:12:09.176 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:09.134+0000 7fa20452d700 1 -- 172.21.15.163:0/2574120480 wait complete. 2023-07-14T18:12:09.180 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:09.135+0000 7fa20452d700 1 Processor -- start 2023-07-14T18:12:09.180 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:09.135+0000 7fa20452d700 1 -- start start 2023-07-14T18:12:09.180 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:09.135+0000 7fa20452d700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa1fc0fee40 0x7fa1fc100850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:12:09.181 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:09.135+0000 7fa20452d700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fa1fc0ff7e0 0x7fa1fc100d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:12:09.181 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:09.135+0000 7fa20452d700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa1fc103ee0 0x7fa1fc101310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:12:09.181 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:09.135+0000 7fa20452d700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1fc1a4250 con 0x7fa1fc0ff7e0 2023-07-14T18:12:09.181 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:09.135+0000 7fa20452d700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1fc1a43c0 con 0x7fa1fc0fee40 2023-07-14T18:12:09.182 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:09.135+0000 7fa20452d700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1fc1a4580 con 0x7fa1fc103ee0 2023-07-14T18:12:09.182 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:09.135+0000 7fa201ac8700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fa1fc0ff7e0 0x7fa1fc100d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:12:09.182 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:09.135+0000 7fa201ac8700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fa1fc0ff7e0 0x7fa1fc100d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:56762/0 (socket says 172.21.15.163:56762) 2023-07-14T18:12:09.182 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:09.135+0000 7fa201ac8700 1 -- 172.21.15.163:0/1223095940 learned_addr learned my addr 172.21.15.163:0/1223095940 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:12:09.183 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:09.135+0000 7fa2022c9700 1 --2- 172.21.15.163:0/1223095940 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa1fc0fee40 0x7fa1fc100850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:12:09.183 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:09.135+0000 7fa202aca700 1 --2- 172.21.15.163:0/1223095940 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa1fc103ee0 0x7fa1fc101310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:12:09.183 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:09.135+0000 7fa201ac8700 1 -- 172.21.15.163:0/1223095940 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa1fc103ee0 msgr2=0x7fa1fc101310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:12:09.183 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:09.135+0000 7fa201ac8700 1 --2- 172.21.15.163:0/1223095940 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa1fc103ee0 0x7fa1fc101310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:09.184 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:09.135+0000 7fa201ac8700 1 -- 172.21.15.163:0/1223095940 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa1fc0fee40 msgr2=0x7fa1fc100850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:12:09.184 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:09.135+0000 7fa201ac8700 1 --2- 172.21.15.163:0/1223095940 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa1fc0fee40 0x7fa1fc100850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:09.184 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:09.135+0000 7fa201ac8700 1 -- 172.21.15.163:0/1223095940 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1f80095f0 con 0x7fa1fc0ff7e0 2023-07-14T18:12:09.185 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:09.135+0000 7fa202aca700 1 --2- 172.21.15.163:0/1223095940 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa1fc103ee0 0x7fa1fc101310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T18:12:09.185 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:09.135+0000 7fa2022c9700 1 --2- 172.21.15.163:0/1223095940 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa1fc0fee40 0x7fa1fc100850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T18:12:09.185 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:09.136+0000 7fa201ac8700 1 --2- 172.21.15.163:0/1223095940 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fa1fc0ff7e0 0x7fa1fc100d90 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fa1f8006010 tx=0x7fa1f8009510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:12:09.185 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:09.136+0000 7fa1f37fe700 1 -- 172.21.15.163:0/1223095940 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1f801d070 con 0x7fa1fc0ff7e0 2023-07-14T18:12:09.186 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:09.136+0000 7fa20452d700 1 -- 172.21.15.163:0/1223095940 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa1fc1a4800 con 0x7fa1fc0ff7e0 2023-07-14T18:12:09.186 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:09.136+0000 7fa1f37fe700 1 -- 172.21.15.163:0/1223095940 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fa1f8004100 con 0x7fa1fc0ff7e0 2023-07-14T18:12:09.186 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:09.136+0000 7fa1f37fe700 1 -- 172.21.15.163:0/1223095940 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1f8022d70 con 0x7fa1fc0ff7e0 2023-07-14T18:12:09.186 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:09.136+0000 7fa20452d700 1 -- 172.21.15.163:0/1223095940 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa1fc1a4c70 con 0x7fa1fc0ff7e0 2023-07-14T18:12:09.187 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:09.137+0000 7fa20452d700 1 -- 172.21.15.163:0/1223095940 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa1fc1081c0 con 0x7fa1fc0ff7e0 2023-07-14T18:12:09.187 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:09.138+0000 7fa1f37fe700 1 -- 172.21.15.163:0/1223095940 <== mon.0 v2:172.21.15.163:3300/0 4 ==== mgrmap(e 17) v1 ==== 135767+0+0 (secure 0 0 0) 0x7fa1f8022570 con 0x7fa1fc0ff7e0 2023-07-14T18:12:09.187 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:09.138+0000 7fa1f37fe700 1 --2- 172.21.15.163:0/1223095940 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7fa1e80a11e0 0x7fa1e80a3690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:12:09.187 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:09.138+0000 7fa2022c9700 1 --2- 172.21.15.163:0/1223095940 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7fa1e80a11e0 0x7fa1e80a3690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:12:09.188 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:09.138+0000 7fa1f37fe700 1 -- 172.21.15.163:0/1223095940 <== mon.0 v2:172.21.15.163:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 8730+0+0 (secure 0 0 0) 0x7fa1f80ce830 con 0x7fa1fc0ff7e0 2023-07-14T18:12:09.188 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:09.139+0000 7fa2022c9700 1 --2- 172.21.15.163:0/1223095940 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7fa1e80a11e0 0x7fa1e80a3690 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fa1ec005950 tx=0x7fa1ec0058e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:12:09.189 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:09.142+0000 7fa1f37fe700 1 -- 172.21.15.163:0/1223095940 <== mon.0 v2:172.21.15.163:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178025 (secure 0 0 0) 0x7fa1f8097cc0 con 0x7fa1fc0ff7e0 2023-07-14T18:12:09.363 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:09.323+0000 7fa20452d700 1 -- 172.21.15.163:0/1223095940 --> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fa1fc101e20 con 0x7fa1e80a11e0 2023-07-14T18:12:09.374 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:09.335+0000 7fa1f37fe700 1 -- 172.21.15.163:0/1223095940 <== mgr.14152 v2:172.21.15.163:6800/1949590926 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+422613 (secure 0 0 0) 0x7fa1fc101e20 con 0x7fa1e80a11e0 2023-07-14T18:12:09.378 INFO:teuthology.orchestra.run.smithi163.stdout: 2023-07-14T18:12:09.381 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:09.338+0000 7fa20452d700 1 -- 172.21.15.163:0/1223095940 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7fa1e80a11e0 msgr2=0x7fa1e80a3690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:12:09.381 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:09.338+0000 7fa20452d700 1 --2- 172.21.15.163:0/1223095940 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7fa1e80a11e0 0x7fa1e80a3690 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fa1ec005950 tx=0x7fa1ec0058e0 comp rx=0 tx=0).stop 2023-07-14T18:12:09.381 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:09.338+0000 7fa20452d700 1 -- 172.21.15.163:0/1223095940 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fa1fc0ff7e0 msgr2=0x7fa1fc100d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:12:09.381 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:09.338+0000 7fa20452d700 1 --2- 172.21.15.163:0/1223095940 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fa1fc0ff7e0 0x7fa1fc100d90 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fa1f8006010 tx=0x7fa1f8009510 comp rx=0 tx=0).stop 2023-07-14T18:12:09.382 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:09.339+0000 7fa20452d700 1 -- 172.21.15.163:0/1223095940 shutdown_connections 2023-07-14T18:12:09.382 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:09.339+0000 7fa20452d700 1 --2- 172.21.15.163:0/1223095940 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7fa1e80a11e0 0x7fa1e80a3690 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:09.382 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:09.339+0000 7fa20452d700 1 --2- 172.21.15.163:0/1223095940 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa1fc103ee0 0x7fa1fc101310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:09.382 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:09.339+0000 7fa20452d700 1 --2- 172.21.15.163:0/1223095940 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa1fc0fee40 0x7fa1fc100850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:09.382 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:09.339+0000 7fa20452d700 1 --2- 172.21.15.163:0/1223095940 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fa1fc0ff7e0 0x7fa1fc100d90 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:09.382 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:09.339+0000 7fa20452d700 1 -- 172.21.15.163:0/1223095940 >> 172.21.15.163:0/1223095940 conn(0x7fa1fc075ca0 msgr2=0x7fa1fc068240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:12:09.383 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:09.339+0000 7fa20452d700 1 -- 172.21.15.163:0/1223095940 shutdown_connections 2023-07-14T18:12:09.383 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:09.339+0000 7fa20452d700 1 -- 172.21.15.163:0/1223095940 wait complete. 2023-07-14T18:12:09.383 INFO:teuthology.orchestra.run.smithi163.stderr:dumped all 2023-07-14T18:12:09.742 INFO:teuthology.orchestra.run.smithi163.stdout:{"pg_ready":true,"pg_map":{"version":280,"stamp":"2023-07-14T18:12:07.419594+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":658071,"num_objects":102,"num_object_clones":0,"num_object_copies":308,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":493,"num_read_kb":366,"num_write":416,"num_write_kb":3073,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":344,"ondisk_log_size":344,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":419,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":337296,"kb_used_data":13104,"kb_used_omap":20,"kb_used_meta":324075,"kb_avail":1124604528,"statfs":{"total":1151940427776,"available":1151595036672,"internally_reserved":0,"allocated":13418496,"data_stored":7399426,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":21372,"internal_metadata":331852932},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1652,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":101,"num_read_kb":52,"num_write":1,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003025"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":20,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:11:15.117313+0000","last_change":"2023-07-14T18:11:09.713546+0000","last_active":"2023-07-14T18:11:15.117313+0000","last_peered":"2023-07-14T18:11:15.117313+0000","last_clean":"2023-07-14T18:11:15.117313+0000","last_became_active":"2023-07-14T18:11:09.713170+0000","last_became_peered":"2023-07-14T18:11:09.713170+0000","last_unstale":"2023-07-14T18:11:15.117313+0000","last_undegraded":"2023-07-14T18:11:15.117313+0000","last_fullsized":"2023-07-14T18:11:15.117313+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_clean_scrub_stamp":"2023-07-14T18:11:08.667354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T03:18:23.645436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":20,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:11:14.884660+0000","last_change":"2023-07-14T18:11:09.711619+0000","last_active":"2023-07-14T18:11:14.884660+0000","last_peered":"2023-07-14T18:11:14.884660+0000","last_clean":"2023-07-14T18:11:14.884660+0000","last_became_active":"2023-07-14T18:11:09.711249+0000","last_became_peered":"2023-07-14T18:11:09.711249+0000","last_unstale":"2023-07-14T18:11:14.884660+0000","last_undegraded":"2023-07-14T18:11:14.884660+0000","last_fullsized":"2023-07-14T18:11:14.884660+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_clean_scrub_stamp":"2023-07-14T18:11:08.667354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:15:46.939069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":20,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:11:14.884197+0000","last_change":"2023-07-14T18:11:09.705557+0000","last_active":"2023-07-14T18:11:14.884197+0000","last_peered":"2023-07-14T18:11:14.884197+0000","last_clean":"2023-07-14T18:11:14.884197+0000","last_became_active":"2023-07-14T18:11:09.705179+0000","last_became_peered":"2023-07-14T18:11:09.705179+0000","last_unstale":"2023-07-14T18:11:14.884197+0000","last_undegraded":"2023-07-14T18:11:14.884197+0000","last_fullsized":"2023-07-14T18:11:14.884197+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_clean_scrub_stamp":"2023-07-14T18:11:08.667354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:37:15.401517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":20,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:11:14.885864+0000","last_change":"2023-07-14T18:11:09.709234+0000","last_active":"2023-07-14T18:11:14.885864+0000","last_peered":"2023-07-14T18:11:14.885864+0000","last_clean":"2023-07-14T18:11:14.885864+0000","last_became_active":"2023-07-14T18:11:09.708855+0000","last_became_peered":"2023-07-14T18:11:09.708855+0000","last_unstale":"2023-07-14T18:11:14.885864+0000","last_undegraded":"2023-07-14T18:11:14.885864+0000","last_fullsized":"2023-07-14T18:11:14.885864+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_clean_scrub_stamp":"2023-07-14T18:11:08.667354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T03:28:37.657033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":20,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:11:14.884907+0000","last_change":"2023-07-14T18:11:09.704301+0000","last_active":"2023-07-14T18:11:14.884907+0000","last_peered":"2023-07-14T18:11:14.884907+0000","last_clean":"2023-07-14T18:11:14.884907+0000","last_became_active":"2023-07-14T18:11:09.703961+0000","last_became_peered":"2023-07-14T18:11:09.703961+0000","last_unstale":"2023-07-14T18:11:14.884907+0000","last_undegraded":"2023-07-14T18:11:14.884907+0000","last_fullsized":"2023-07-14T18:11:14.884907+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_clean_scrub_stamp":"2023-07-14T18:11:08.667354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T03:07:18.579761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":20,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:11:14.791451+0000","last_change":"2023-07-14T18:11:09.717667+0000","last_active":"2023-07-14T18:11:14.791451+0000","last_peered":"2023-07-14T18:11:14.791451+0000","last_clean":"2023-07-14T18:11:14.791451+0000","last_became_active":"2023-07-14T18:11:09.717146+0000","last_became_peered":"2023-07-14T18:11:09.717146+0000","last_unstale":"2023-07-14T18:11:14.791451+0000","last_undegraded":"2023-07-14T18:11:14.791451+0000","last_fullsized":"2023-07-14T18:11:14.791451+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_clean_scrub_stamp":"2023-07-14T18:11:08.667354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T05:43:55.497012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":18,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:11:14.884950+0000","last_change":"2023-07-14T18:11:09.713638+0000","last_active":"2023-07-14T18:11:14.884950+0000","last_peered":"2023-07-14T18:11:14.884950+0000","last_clean":"2023-07-14T18:11:14.884950+0000","last_became_active":"2023-07-14T18:11:09.707940+0000","last_became_peered":"2023-07-14T18:11:09.707940+0000","last_unstale":"2023-07-14T18:11:14.884950+0000","last_undegraded":"2023-07-14T18:11:14.884950+0000","last_fullsized":"2023-07-14T18:11:14.884950+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_clean_scrub_stamp":"2023-07-14T18:11:08.667354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:04:22.228548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":20,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:11:14.885659+0000","last_change":"2023-07-14T18:11:09.709804+0000","last_active":"2023-07-14T18:11:14.885659+0000","last_peered":"2023-07-14T18:11:14.885659+0000","last_clean":"2023-07-14T18:11:14.885659+0000","last_became_active":"2023-07-14T18:11:09.709385+0000","last_became_peered":"2023-07-14T18:11:09.709385+0000","last_unstale":"2023-07-14T18:11:14.885659+0000","last_undegraded":"2023-07-14T18:11:14.885659+0000","last_fullsized":"2023-07-14T18:11:14.885659+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_clean_scrub_stamp":"2023-07-14T18:11:08.667354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T05:15:54.972411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":20,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:11:14.885346+0000","last_change":"2023-07-14T18:11:09.710410+0000","last_active":"2023-07-14T18:11:14.885346+0000","last_peered":"2023-07-14T18:11:14.885346+0000","last_clean":"2023-07-14T18:11:14.885346+0000","last_became_active":"2023-07-14T18:11:09.710049+0000","last_became_peered":"2023-07-14T18:11:09.710049+0000","last_unstale":"2023-07-14T18:11:14.885346+0000","last_undegraded":"2023-07-14T18:11:14.885346+0000","last_fullsized":"2023-07-14T18:11:14.885346+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_clean_scrub_stamp":"2023-07-14T18:11:08.667354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:01:39.122213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":20,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:11:14.791867+0000","last_change":"2023-07-14T18:11:09.717681+0000","last_active":"2023-07-14T18:11:14.791867+0000","last_peered":"2023-07-14T18:11:14.791867+0000","last_clean":"2023-07-14T18:11:14.791867+0000","last_became_active":"2023-07-14T18:11:09.717209+0000","last_became_peered":"2023-07-14T18:11:09.717209+0000","last_unstale":"2023-07-14T18:11:14.791867+0000","last_undegraded":"2023-07-14T18:11:14.791867+0000","last_fullsized":"2023-07-14T18:11:14.791867+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_clean_scrub_stamp":"2023-07-14T18:11:08.667354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T02:14:23.927899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":18,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:11:14.885431+0000","last_change":"2023-07-14T18:11:09.716890+0000","last_active":"2023-07-14T18:11:14.885431+0000","last_peered":"2023-07-14T18:11:14.885431+0000","last_clean":"2023-07-14T18:11:14.885431+0000","last_became_active":"2023-07-14T18:11:09.708773+0000","last_became_peered":"2023-07-14T18:11:09.708773+0000","last_unstale":"2023-07-14T18:11:14.885431+0000","last_undegraded":"2023-07-14T18:11:14.885431+0000","last_fullsized":"2023-07-14T18:11:14.885431+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_clean_scrub_stamp":"2023-07-14T18:11:08.667354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T02:07:24.275839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":20,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:11:14.885714+0000","last_change":"2023-07-14T18:11:09.715119+0000","last_active":"2023-07-14T18:11:14.885714+0000","last_peered":"2023-07-14T18:11:14.885714+0000","last_clean":"2023-07-14T18:11:14.885714+0000","last_became_active":"2023-07-14T18:11:09.714680+0000","last_became_peered":"2023-07-14T18:11:09.714680+0000","last_unstale":"2023-07-14T18:11:14.885714+0000","last_undegraded":"2023-07-14T18:11:14.885714+0000","last_fullsized":"2023-07-14T18:11:14.885714+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_clean_scrub_stamp":"2023-07-14T18:11:08.667354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:57:07.824122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":20,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:11:14.791064+0000","last_change":"2023-07-14T18:11:09.711173+0000","last_active":"2023-07-14T18:11:14.791064+0000","last_peered":"2023-07-14T18:11:14.791064+0000","last_clean":"2023-07-14T18:11:14.791064+0000","last_became_active":"2023-07-14T18:11:09.710849+0000","last_became_peered":"2023-07-14T18:11:09.710849+0000","last_unstale":"2023-07-14T18:11:14.791064+0000","last_undegraded":"2023-07-14T18:11:14.791064+0000","last_fullsized":"2023-07-14T18:11:14.791064+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_clean_scrub_stamp":"2023-07-14T18:11:08.667354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:51:55.610741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":20,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:11:14.884136+0000","last_change":"2023-07-14T18:11:09.710448+0000","last_active":"2023-07-14T18:11:14.884136+0000","last_peered":"2023-07-14T18:11:14.884136+0000","last_clean":"2023-07-14T18:11:14.884136+0000","last_became_active":"2023-07-14T18:11:09.709804+0000","last_became_peered":"2023-07-14T18:11:09.709804+0000","last_unstale":"2023-07-14T18:11:14.884136+0000","last_undegraded":"2023-07-14T18:11:14.884136+0000","last_fullsized":"2023-07-14T18:11:14.884136+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_clean_scrub_stamp":"2023-07-14T18:11:08.667354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:56:21.024882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":20,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:11:14.884058+0000","last_change":"2023-07-14T18:11:09.714917+0000","last_active":"2023-07-14T18:11:14.884058+0000","last_peered":"2023-07-14T18:11:14.884058+0000","last_clean":"2023-07-14T18:11:14.884058+0000","last_became_active":"2023-07-14T18:11:09.714655+0000","last_became_peered":"2023-07-14T18:11:09.714655+0000","last_unstale":"2023-07-14T18:11:14.884058+0000","last_undegraded":"2023-07-14T18:11:14.884058+0000","last_fullsized":"2023-07-14T18:11:14.884058+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_clean_scrub_stamp":"2023-07-14T18:11:08.667354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:22:10.112893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":20,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:11:14.884405+0000","last_change":"2023-07-14T18:11:09.709149+0000","last_active":"2023-07-14T18:11:14.884405+0000","last_peered":"2023-07-14T18:11:14.884405+0000","last_clean":"2023-07-14T18:11:14.884405+0000","last_became_active":"2023-07-14T18:11:09.708692+0000","last_became_peered":"2023-07-14T18:11:09.708692+0000","last_unstale":"2023-07-14T18:11:14.884405+0000","last_undegraded":"2023-07-14T18:11:14.884405+0000","last_fullsized":"2023-07-14T18:11:14.884405+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_clean_scrub_stamp":"2023-07-14T18:11:08.667354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:02:35.757081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":20,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:11:15.117281+0000","last_change":"2023-07-14T18:11:09.720235+0000","last_active":"2023-07-14T18:11:15.117281+0000","last_peered":"2023-07-14T18:11:15.117281+0000","last_clean":"2023-07-14T18:11:15.117281+0000","last_became_active":"2023-07-14T18:11:09.719895+0000","last_became_peered":"2023-07-14T18:11:09.719895+0000","last_unstale":"2023-07-14T18:11:15.117281+0000","last_undegraded":"2023-07-14T18:11:15.117281+0000","last_fullsized":"2023-07-14T18:11:15.117281+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_clean_scrub_stamp":"2023-07-14T18:11:08.667354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:41:02.386421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":20,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:11:14.887035+0000","last_change":"2023-07-14T18:11:09.712390+0000","last_active":"2023-07-14T18:11:14.887035+0000","last_peered":"2023-07-14T18:11:14.887035+0000","last_clean":"2023-07-14T18:11:14.887035+0000","last_became_active":"2023-07-14T18:11:09.712074+0000","last_became_peered":"2023-07-14T18:11:09.712074+0000","last_unstale":"2023-07-14T18:11:14.887035+0000","last_undegraded":"2023-07-14T18:11:14.887035+0000","last_fullsized":"2023-07-14T18:11:14.887035+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_clean_scrub_stamp":"2023-07-14T18:11:08.667354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:26:16.089801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":20,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:11:14.885382+0000","last_change":"2023-07-14T18:11:09.709800+0000","last_active":"2023-07-14T18:11:14.885382+0000","last_peered":"2023-07-14T18:11:14.885382+0000","last_clean":"2023-07-14T18:11:14.885382+0000","last_became_active":"2023-07-14T18:11:09.709540+0000","last_became_peered":"2023-07-14T18:11:09.709540+0000","last_unstale":"2023-07-14T18:11:14.885382+0000","last_undegraded":"2023-07-14T18:11:14.885382+0000","last_fullsized":"2023-07-14T18:11:14.885382+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_clean_scrub_stamp":"2023-07-14T18:11:08.667354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:52:10.352194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":13,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:11:14.884081+0000","last_change":"2023-07-14T18:11:13.786505+0000","last_active":"2023-07-14T18:11:14.884081+0000","last_peered":"2023-07-14T18:11:14.884081+0000","last_clean":"2023-07-14T18:11:14.884081+0000","last_became_active":"2023-07-14T18:11:13.786141+0000","last_became_peered":"2023-07-14T18:11:13.786141+0000","last_unstale":"2023-07-14T18:11:14.884081+0000","last_undegraded":"2023-07-14T18:11:14.884081+0000","last_fullsized":"2023-07-14T18:11:14.884081+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:12.753466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:12.753466+0000","last_clean_scrub_stamp":"2023-07-14T18:11:12.753466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:26:53.748778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,9,0],"acting":[2,3,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"84'13","reported_seq":67,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:12:00.821742+0000","last_change":"2023-07-14T18:11:08.691446+0000","last_active":"2023-07-14T18:12:00.821742+0000","last_peered":"2023-07-14T18:12:00.821742+0000","last_clean":"2023-07-14T18:12:00.821742+0000","last_became_active":"2023-07-14T18:11:08.691129+0000","last_became_peered":"2023-07-14T18:11:08.691129+0000","last_unstale":"2023-07-14T18:12:00.821742+0000","last_undegraded":"2023-07-14T18:12:00.821742+0000","last_fullsized":"2023-07-14T18:12:00.821742+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:07.665746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:07.665746+0000","last_clean_scrub_stamp":"2023-07-14T18:11:07.665746+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T03:49:49.363087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":32,"num_read_kb":32,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":20,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:11:14.886188+0000","last_change":"2023-07-14T18:11:09.708155+0000","last_active":"2023-07-14T18:11:14.886188+0000","last_peered":"2023-07-14T18:11:14.886188+0000","last_clean":"2023-07-14T18:11:14.886188+0000","last_became_active":"2023-07-14T18:11:09.707856+0000","last_became_peered":"2023-07-14T18:11:09.707856+0000","last_unstale":"2023-07-14T18:11:14.886188+0000","last_undegraded":"2023-07-14T18:11:14.886188+0000","last_fullsized":"2023-07-14T18:11:14.886188+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_clean_scrub_stamp":"2023-07-14T18:11:08.667354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:45:23.390147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":13,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:11:14.885185+0000","last_change":"2023-07-14T18:11:13.776947+0000","last_active":"2023-07-14T18:11:14.885185+0000","last_peered":"2023-07-14T18:11:14.885185+0000","last_clean":"2023-07-14T18:11:14.885185+0000","last_became_active":"2023-07-14T18:11:13.776557+0000","last_became_peered":"2023-07-14T18:11:13.776557+0000","last_unstale":"2023-07-14T18:11:14.885185+0000","last_undegraded":"2023-07-14T18:11:14.885185+0000","last_fullsized":"2023-07-14T18:11:14.885185+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:12.753466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:12.753466+0000","last_clean_scrub_stamp":"2023-07-14T18:11:12.753466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T05:58:30.561744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,9,3],"acting":[4,6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1e","version":"84'2","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:11:14.886397+0000","last_change":"2023-07-14T18:11:08.690072+0000","last_active":"2023-07-14T18:11:14.886397+0000","last_peered":"2023-07-14T18:11:14.886397+0000","last_clean":"2023-07-14T18:11:14.886397+0000","last_became_active":"2023-07-14T18:11:08.689770+0000","last_became_peered":"2023-07-14T18:11:08.689770+0000","last_unstale":"2023-07-14T18:11:14.886397+0000","last_undegraded":"2023-07-14T18:11:14.886397+0000","last_fullsized":"2023-07-14T18:11:14.886397+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:07.665746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:07.665746+0000","last_clean_scrub_stamp":"2023-07-14T18:11:07.665746+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:22:28.360757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":20,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:11:14.885001+0000","last_change":"2023-07-14T18:11:09.706952+0000","last_active":"2023-07-14T18:11:14.885001+0000","last_peered":"2023-07-14T18:11:14.885001+0000","last_clean":"2023-07-14T18:11:14.885001+0000","last_became_active":"2023-07-14T18:11:09.706646+0000","last_became_peered":"2023-07-14T18:11:09.706646+0000","last_unstale":"2023-07-14T18:11:14.885001+0000","last_undegraded":"2023-07-14T18:11:14.885001+0000","last_fullsized":"2023-07-14T18:11:14.885001+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_clean_scrub_stamp":"2023-07-14T18:11:08.667354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:21:05.149853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":13,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:11:14.886418+0000","last_change":"2023-07-14T18:11:13.779167+0000","last_active":"2023-07-14T18:11:14.886418+0000","last_peered":"2023-07-14T18:11:14.886418+0000","last_clean":"2023-07-14T18:11:14.886418+0000","last_became_active":"2023-07-14T18:11:13.778486+0000","last_became_peered":"2023-07-14T18:11:13.778486+0000","last_unstale":"2023-07-14T18:11:14.886418+0000","last_undegraded":"2023-07-14T18:11:14.886418+0000","last_fullsized":"2023-07-14T18:11:14.886418+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:12.753466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:12.753466+0000","last_clean_scrub_stamp":"2023-07-14T18:11:12.753466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:34:58.614453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,9,5],"acting":[4,3,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"84'12","reported_seq":35,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:11:30.774235+0000","last_change":"2023-07-14T18:11:08.688289+0000","last_active":"2023-07-14T18:11:30.774235+0000","last_peered":"2023-07-14T18:11:30.774235+0000","last_clean":"2023-07-14T18:11:30.774235+0000","last_became_active":"2023-07-14T18:11:08.687994+0000","last_became_peered":"2023-07-14T18:11:08.687994+0000","last_unstale":"2023-07-14T18:11:30.774235+0000","last_undegraded":"2023-07-14T18:11:30.774235+0000","last_fullsized":"2023-07-14T18:11:30.774235+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:07.665746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:07.665746+0000","last_clean_scrub_stamp":"2023-07-14T18:11:07.665746+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:06:29.309813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":20,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:11:14.884723+0000","last_change":"2023-07-14T18:11:09.711910+0000","last_active":"2023-07-14T18:11:14.884723+0000","last_peered":"2023-07-14T18:11:14.884723+0000","last_clean":"2023-07-14T18:11:14.884723+0000","last_became_active":"2023-07-14T18:11:09.711634+0000","last_became_peered":"2023-07-14T18:11:09.711634+0000","last_unstale":"2023-07-14T18:11:14.884723+0000","last_undegraded":"2023-07-14T18:11:14.884723+0000","last_fullsized":"2023-07-14T18:11:14.884723+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_clean_scrub_stamp":"2023-07-14T18:11:08.667354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T02:17:27.837804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":13,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:11:14.885448+0000","last_change":"2023-07-14T18:11:13.778662+0000","last_active":"2023-07-14T18:11:14.885448+0000","last_peered":"2023-07-14T18:11:14.885448+0000","last_clean":"2023-07-14T18:11:14.885448+0000","last_became_active":"2023-07-14T18:11:13.777886+0000","last_became_peered":"2023-07-14T18:11:13.777886+0000","last_unstale":"2023-07-14T18:11:14.885448+0000","last_undegraded":"2023-07-14T18:11:14.885448+0000","last_fullsized":"2023-07-14T18:11:14.885448+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:12.753466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:12.753466+0000","last_clean_scrub_stamp":"2023-07-14T18:11:12.753466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:17:56.221852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"84'5","reported_seq":28,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:11:30.773437+0000","last_change":"2023-07-14T18:11:08.683774+0000","last_active":"2023-07-14T18:11:30.773437+0000","last_peered":"2023-07-14T18:11:30.773437+0000","last_clean":"2023-07-14T18:11:30.773437+0000","last_became_active":"2023-07-14T18:11:08.683458+0000","last_became_peered":"2023-07-14T18:11:08.683458+0000","last_unstale":"2023-07-14T18:11:30.773437+0000","last_undegraded":"2023-07-14T18:11:30.773437+0000","last_fullsized":"2023-07-14T18:11:30.773437+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:07.665746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:07.665746+0000","last_clean_scrub_stamp":"2023-07-14T18:11:07.665746+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:20:32.172917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":20,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:11:14.791559+0000","last_change":"2023-07-14T18:11:09.716041+0000","last_active":"2023-07-14T18:11:14.791559+0000","last_peered":"2023-07-14T18:11:14.791559+0000","last_clean":"2023-07-14T18:11:14.791559+0000","last_became_active":"2023-07-14T18:11:09.715367+0000","last_became_peered":"2023-07-14T18:11:09.715367+0000","last_unstale":"2023-07-14T18:11:14.791559+0000","last_undegraded":"2023-07-14T18:11:14.791559+0000","last_fullsized":"2023-07-14T18:11:14.791559+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_clean_scrub_stamp":"2023-07-14T18:11:08.667354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T01:34:04.989278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":13,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:11:14.885291+0000","last_change":"2023-07-14T18:11:13.776527+0000","last_active":"2023-07-14T18:11:14.885291+0000","last_peered":"2023-07-14T18:11:14.885291+0000","last_clean":"2023-07-14T18:11:14.885291+0000","last_became_active":"2023-07-14T18:11:13.776032+0000","last_became_peered":"2023-07-14T18:11:13.776032+0000","last_unstale":"2023-07-14T18:11:14.885291+0000","last_undegraded":"2023-07-14T18:11:14.885291+0000","last_fullsized":"2023-07-14T18:11:14.885291+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:12.753466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:12.753466+0000","last_clean_scrub_stamp":"2023-07-14T18:11:12.753466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:39:22.666498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"84'5","reported_seq":61,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:12:00.815521+0000","last_change":"2023-07-14T18:11:08.687533+0000","last_active":"2023-07-14T18:12:00.815521+0000","last_peered":"2023-07-14T18:12:00.815521+0000","last_clean":"2023-07-14T18:12:00.815521+0000","last_became_active":"2023-07-14T18:11:08.687242+0000","last_became_peered":"2023-07-14T18:11:08.687242+0000","last_unstale":"2023-07-14T18:12:00.815521+0000","last_undegraded":"2023-07-14T18:12:00.815521+0000","last_fullsized":"2023-07-14T18:12:00.815521+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:07.665746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:07.665746+0000","last_clean_scrub_stamp":"2023-07-14T18:11:07.665746+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T03:53:23.140121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":574,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":34,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":20,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:11:14.885376+0000","last_change":"2023-07-14T18:11:09.707937+0000","last_active":"2023-07-14T18:11:14.885376+0000","last_peered":"2023-07-14T18:11:14.885376+0000","last_clean":"2023-07-14T18:11:14.885376+0000","last_became_active":"2023-07-14T18:11:09.707637+0000","last_became_peered":"2023-07-14T18:11:09.707637+0000","last_unstale":"2023-07-14T18:11:14.885376+0000","last_undegraded":"2023-07-14T18:11:14.885376+0000","last_fullsized":"2023-07-14T18:11:14.885376+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_clean_scrub_stamp":"2023-07-14T18:11:08.667354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:08:40.577399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":13,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:11:14.884475+0000","last_change":"2023-07-14T18:11:13.791360+0000","last_active":"2023-07-14T18:11:14.884475+0000","last_peered":"2023-07-14T18:11:14.884475+0000","last_clean":"2023-07-14T18:11:14.884475+0000","last_became_active":"2023-07-14T18:11:13.790894+0000","last_became_peered":"2023-07-14T18:11:13.790894+0000","last_unstale":"2023-07-14T18:11:14.884475+0000","last_undegraded":"2023-07-14T18:11:14.884475+0000","last_fullsized":"2023-07-14T18:11:14.884475+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:12.753466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:12.753466+0000","last_clean_scrub_stamp":"2023-07-14T18:11:12.753466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:41:41.939841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,9,5],"acting":[2,6,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1a","version":"84'7","reported_seq":29,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:11:29.839469+0000","last_change":"2023-07-14T18:11:08.687315+0000","last_active":"2023-07-14T18:11:29.839469+0000","last_peered":"2023-07-14T18:11:29.839469+0000","last_clean":"2023-07-14T18:11:29.839469+0000","last_became_active":"2023-07-14T18:11:08.687061+0000","last_became_peered":"2023-07-14T18:11:08.687061+0000","last_unstale":"2023-07-14T18:11:29.839469+0000","last_undegraded":"2023-07-14T18:11:29.839469+0000","last_fullsized":"2023-07-14T18:11:29.839469+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:07.665746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:07.665746+0000","last_clean_scrub_stamp":"2023-07-14T18:11:07.665746+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:33:18.467402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":20,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:11:14.791635+0000","last_change":"2023-07-14T18:11:09.715816+0000","last_active":"2023-07-14T18:11:14.791635+0000","last_peered":"2023-07-14T18:11:14.791635+0000","last_clean":"2023-07-14T18:11:14.791635+0000","last_became_active":"2023-07-14T18:11:09.715038+0000","last_became_peered":"2023-07-14T18:11:09.715038+0000","last_unstale":"2023-07-14T18:11:14.791635+0000","last_undegraded":"2023-07-14T18:11:14.791635+0000","last_fullsized":"2023-07-14T18:11:14.791635+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_clean_scrub_stamp":"2023-07-14T18:11:08.667354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:25:18.981358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":13,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:11:15.117190+0000","last_change":"2023-07-14T18:11:13.791438+0000","last_active":"2023-07-14T18:11:15.117190+0000","last_peered":"2023-07-14T18:11:15.117190+0000","last_clean":"2023-07-14T18:11:15.117190+0000","last_became_active":"2023-07-14T18:11:13.790956+0000","last_became_peered":"2023-07-14T18:11:13.790956+0000","last_unstale":"2023-07-14T18:11:15.117190+0000","last_undegraded":"2023-07-14T18:11:15.117190+0000","last_fullsized":"2023-07-14T18:11:15.117190+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:12.753466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:12.753466+0000","last_clean_scrub_stamp":"2023-07-14T18:11:12.753466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:19:27.699147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.19","version":"84'3","reported_seq":25,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:11:28.829267+0000","last_change":"2023-07-14T18:11:08.693751+0000","last_active":"2023-07-14T18:11:28.829267+0000","last_peered":"2023-07-14T18:11:28.829267+0000","last_clean":"2023-07-14T18:11:28.829267+0000","last_became_active":"2023-07-14T18:11:08.693427+0000","last_became_peered":"2023-07-14T18:11:08.693427+0000","last_unstale":"2023-07-14T18:11:28.829267+0000","last_undegraded":"2023-07-14T18:11:28.829267+0000","last_fullsized":"2023-07-14T18:11:28.829267+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:07.665746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:07.665746+0000","last_clean_scrub_stamp":"2023-07-14T18:11:07.665746+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T01:10:23.727801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":20,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:11:14.885924+0000","last_change":"2023-07-14T18:11:09.709761+0000","last_active":"2023-07-14T18:11:14.885924+0000","last_peered":"2023-07-14T18:11:14.885924+0000","last_clean":"2023-07-14T18:11:14.885924+0000","last_became_active":"2023-07-14T18:11:09.709157+0000","last_became_peered":"2023-07-14T18:11:09.709157+0000","last_unstale":"2023-07-14T18:11:14.885924+0000","last_undegraded":"2023-07-14T18:11:14.885924+0000","last_fullsized":"2023-07-14T18:11:14.885924+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_clean_scrub_stamp":"2023-07-14T18:11:08.667354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:46:44.602802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":13,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:11:14.884393+0000","last_change":"2023-07-14T18:11:13.779265+0000","last_active":"2023-07-14T18:11:14.884393+0000","last_peered":"2023-07-14T18:11:14.884393+0000","last_clean":"2023-07-14T18:11:14.884393+0000","last_became_active":"2023-07-14T18:11:13.778865+0000","last_became_peered":"2023-07-14T18:11:13.778865+0000","last_unstale":"2023-07-14T18:11:14.884393+0000","last_undegraded":"2023-07-14T18:11:14.884393+0000","last_fullsized":"2023-07-14T18:11:14.884393+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:12.753466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:12.753466+0000","last_clean_scrub_stamp":"2023-07-14T18:11:12.753466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:19:57.552613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.18","version":"84'3","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:11:30.768842+0000","last_change":"2023-07-14T18:11:08.684513+0000","last_active":"2023-07-14T18:11:30.768842+0000","last_peered":"2023-07-14T18:11:30.768842+0000","last_clean":"2023-07-14T18:11:30.768842+0000","last_became_active":"2023-07-14T18:11:08.684213+0000","last_became_peered":"2023-07-14T18:11:08.684213+0000","last_unstale":"2023-07-14T18:11:30.768842+0000","last_undegraded":"2023-07-14T18:11:30.768842+0000","last_fullsized":"2023-07-14T18:11:30.768842+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:07.665746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:07.665746+0000","last_clean_scrub_stamp":"2023-07-14T18:11:07.665746+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:07:53.630240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":20,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:11:14.886595+0000","last_change":"2023-07-14T18:11:09.712427+0000","last_active":"2023-07-14T18:11:14.886595+0000","last_peered":"2023-07-14T18:11:14.886595+0000","last_clean":"2023-07-14T18:11:14.886595+0000","last_became_active":"2023-07-14T18:11:09.712104+0000","last_became_peered":"2023-07-14T18:11:09.712104+0000","last_unstale":"2023-07-14T18:11:14.886595+0000","last_undegraded":"2023-07-14T18:11:14.886595+0000","last_fullsized":"2023-07-14T18:11:14.886595+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_clean_scrub_stamp":"2023-07-14T18:11:08.667354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:27:36.074613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":13,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:11:14.884458+0000","last_change":"2023-07-14T18:11:13.777892+0000","last_active":"2023-07-14T18:11:14.884458+0000","last_peered":"2023-07-14T18:11:14.884458+0000","last_clean":"2023-07-14T18:11:14.884458+0000","last_became_active":"2023-07-14T18:11:13.777518+0000","last_became_peered":"2023-07-14T18:11:13.777518+0000","last_unstale":"2023-07-14T18:11:14.884458+0000","last_undegraded":"2023-07-14T18:11:14.884458+0000","last_fullsized":"2023-07-14T18:11:14.884458+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:12.753466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:12.753466+0000","last_clean_scrub_stamp":"2023-07-14T18:11:12.753466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T03:56:42.344672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.17","version":"84'4","reported_seq":92,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:12:02.817781+0000","last_change":"2023-07-14T18:11:08.684141+0000","last_active":"2023-07-14T18:12:02.817781+0000","last_peered":"2023-07-14T18:12:02.817781+0000","last_clean":"2023-07-14T18:12:02.817781+0000","last_became_active":"2023-07-14T18:11:08.683767+0000","last_became_peered":"2023-07-14T18:11:08.683767+0000","last_unstale":"2023-07-14T18:12:02.817781+0000","last_undegraded":"2023-07-14T18:12:02.817781+0000","last_fullsized":"2023-07-14T18:12:02.817781+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:07.665746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:07.665746+0000","last_clean_scrub_stamp":"2023-07-14T18:11:07.665746+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T02:05:02.791590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":66,"num_read_kb":66,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":20,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:11:14.885184+0000","last_change":"2023-07-14T18:11:09.710975+0000","last_active":"2023-07-14T18:11:14.885184+0000","last_peered":"2023-07-14T18:11:14.885184+0000","last_clean":"2023-07-14T18:11:14.885184+0000","last_became_active":"2023-07-14T18:11:09.710690+0000","last_became_peered":"2023-07-14T18:11:09.710690+0000","last_unstale":"2023-07-14T18:11:14.885184+0000","last_undegraded":"2023-07-14T18:11:14.885184+0000","last_fullsized":"2023-07-14T18:11:14.885184+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_clean_scrub_stamp":"2023-07-14T18:11:08.667354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T02:39:19.763017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":13,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:11:14.886369+0000","last_change":"2023-07-14T18:11:13.789251+0000","last_active":"2023-07-14T18:11:14.886369+0000","last_peered":"2023-07-14T18:11:14.886369+0000","last_clean":"2023-07-14T18:11:14.886369+0000","last_became_active":"2023-07-14T18:11:13.788742+0000","last_became_peered":"2023-07-14T18:11:13.788742+0000","last_unstale":"2023-07-14T18:11:14.886369+0000","last_undegraded":"2023-07-14T18:11:14.886369+0000","last_fullsized":"2023-07-14T18:11:14.886369+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:12.753466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:12.753466+0000","last_clean_scrub_stamp":"2023-07-14T18:11:12.753466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T04:39:11.465407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0,2,4],"acting":[9,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.16","version":"84'4","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:11:30.771801+0000","last_change":"2023-07-14T18:11:08.692093+0000","last_active":"2023-07-14T18:11:30.771801+0000","last_peered":"2023-07-14T18:11:30.771801+0000","last_clean":"2023-07-14T18:11:30.771801+0000","last_became_active":"2023-07-14T18:11:08.691806+0000","last_became_peered":"2023-07-14T18:11:08.691806+0000","last_unstale":"2023-07-14T18:11:30.771801+0000","last_undegraded":"2023-07-14T18:11:30.771801+0000","last_fullsized":"2023-07-14T18:11:30.771801+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:07.665746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:07.665746+0000","last_clean_scrub_stamp":"2023-07-14T18:11:07.665746+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:59:54.200134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":20,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:11:14.885119+0000","last_change":"2023-07-14T18:11:09.714965+0000","last_active":"2023-07-14T18:11:14.885119+0000","last_peered":"2023-07-14T18:11:14.885119+0000","last_clean":"2023-07-14T18:11:14.885119+0000","last_became_active":"2023-07-14T18:11:09.714676+0000","last_became_peered":"2023-07-14T18:11:09.714676+0000","last_unstale":"2023-07-14T18:11:14.885119+0000","last_undegraded":"2023-07-14T18:11:14.885119+0000","last_fullsized":"2023-07-14T18:11:14.885119+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_clean_scrub_stamp":"2023-07-14T18:11:08.667354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:10:38.185488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":13,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:11:14.886587+0000","last_change":"2023-07-14T18:11:13.779218+0000","last_active":"2023-07-14T18:11:14.886587+0000","last_peered":"2023-07-14T18:11:14.886587+0000","last_clean":"2023-07-14T18:11:14.886587+0000","last_became_active":"2023-07-14T18:11:13.778833+0000","last_became_peered":"2023-07-14T18:11:13.778833+0000","last_unstale":"2023-07-14T18:11:14.886587+0000","last_undegraded":"2023-07-14T18:11:14.886587+0000","last_fullsized":"2023-07-14T18:11:14.886587+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:12.753466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:12.753466+0000","last_clean_scrub_stamp":"2023-07-14T18:11:12.753466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:59:38.858950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,9],"acting":[4,1,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"84'5","reported_seq":28,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:11:29.838574+0000","last_change":"2023-07-14T18:11:08.681778+0000","last_active":"2023-07-14T18:11:29.838574+0000","last_peered":"2023-07-14T18:11:29.838574+0000","last_clean":"2023-07-14T18:11:29.838574+0000","last_became_active":"2023-07-14T18:11:08.681406+0000","last_became_peered":"2023-07-14T18:11:08.681406+0000","last_unstale":"2023-07-14T18:11:29.838574+0000","last_undegraded":"2023-07-14T18:11:29.838574+0000","last_fullsized":"2023-07-14T18:11:29.838574+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:07.665746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:07.665746+0000","last_clean_scrub_stamp":"2023-07-14T18:11:07.665746+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:23:04.400637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":20,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:11:14.884950+0000","last_change":"2023-07-14T18:11:09.703070+0000","last_active":"2023-07-14T18:11:14.884950+0000","last_peered":"2023-07-14T18:11:14.884950+0000","last_clean":"2023-07-14T18:11:14.884950+0000","last_became_active":"2023-07-14T18:11:09.702754+0000","last_became_peered":"2023-07-14T18:11:09.702754+0000","last_unstale":"2023-07-14T18:11:14.884950+0000","last_undegraded":"2023-07-14T18:11:14.884950+0000","last_fullsized":"2023-07-14T18:11:14.884950+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_clean_scrub_stamp":"2023-07-14T18:11:08.667354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:41:59.621911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":13,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:11:14.886380+0000","last_change":"2023-07-14T18:11:13.788077+0000","last_active":"2023-07-14T18:11:14.886380+0000","last_peered":"2023-07-14T18:11:14.886380+0000","last_clean":"2023-07-14T18:11:14.886380+0000","last_became_active":"2023-07-14T18:11:13.787719+0000","last_became_peered":"2023-07-14T18:11:13.787719+0000","last_unstale":"2023-07-14T18:11:14.886380+0000","last_undegraded":"2023-07-14T18:11:14.886380+0000","last_fullsized":"2023-07-14T18:11:14.886380+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:12.753466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:12.753466+0000","last_clean_scrub_stamp":"2023-07-14T18:11:12.753466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:28:37.419577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,11,5],"acting":[9,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.14","version":"84'33","reported_seq":128,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:12:02.818079+0000","last_change":"2023-07-14T18:11:08.690538+0000","last_active":"2023-07-14T18:12:02.818079+0000","last_peered":"2023-07-14T18:12:02.818079+0000","last_clean":"2023-07-14T18:12:02.818079+0000","last_became_active":"2023-07-14T18:11:08.690152+0000","last_became_peered":"2023-07-14T18:11:08.690152+0000","last_unstale":"2023-07-14T18:12:02.818079+0000","last_undegraded":"2023-07-14T18:12:02.818079+0000","last_fullsized":"2023-07-14T18:12:02.818079+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:07.665746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:07.665746+0000","last_clean_scrub_stamp":"2023-07-14T18:11:07.665746+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:27:49.760382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":60837,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":73,"num_read_kb":96,"num_write":35,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":20,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:11:14.885568+0000","last_change":"2023-07-14T18:11:09.710116+0000","last_active":"2023-07-14T18:11:14.885568+0000","last_peered":"2023-07-14T18:11:14.885568+0000","last_clean":"2023-07-14T18:11:14.885568+0000","last_became_active":"2023-07-14T18:11:09.709831+0000","last_became_peered":"2023-07-14T18:11:09.709831+0000","last_unstale":"2023-07-14T18:11:14.885568+0000","last_undegraded":"2023-07-14T18:11:14.885568+0000","last_fullsized":"2023-07-14T18:11:14.885568+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_clean_scrub_stamp":"2023-07-14T18:11:08.667354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T03:06:14.287734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":13,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:11:14.791956+0000","last_change":"2023-07-14T18:11:13.777434+0000","last_active":"2023-07-14T18:11:14.791956+0000","last_peered":"2023-07-14T18:11:14.791956+0000","last_clean":"2023-07-14T18:11:14.791956+0000","last_became_active":"2023-07-14T18:11:13.776670+0000","last_became_peered":"2023-07-14T18:11:13.776670+0000","last_unstale":"2023-07-14T18:11:14.791956+0000","last_undegraded":"2023-07-14T18:11:14.791956+0000","last_fullsized":"2023-07-14T18:11:14.791956+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:12.753466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:12.753466+0000","last_clean_scrub_stamp":"2023-07-14T18:11:12.753466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T02:09:40.305735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.13","version":"84'9","reported_seq":33,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:11:30.770744+0000","last_change":"2023-07-14T18:11:08.693172+0000","last_active":"2023-07-14T18:11:30.770744+0000","last_peered":"2023-07-14T18:11:30.770744+0000","last_clean":"2023-07-14T18:11:30.770744+0000","last_became_active":"2023-07-14T18:11:08.692846+0000","last_became_peered":"2023-07-14T18:11:08.692846+0000","last_unstale":"2023-07-14T18:11:30.770744+0000","last_undegraded":"2023-07-14T18:11:30.770744+0000","last_fullsized":"2023-07-14T18:11:30.770744+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:07.665746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:07.665746+0000","last_clean_scrub_stamp":"2023-07-14T18:11:07.665746+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:24:38.511637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":20,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:11:14.790941+0000","last_change":"2023-07-14T18:11:09.708480+0000","last_active":"2023-07-14T18:11:14.790941+0000","last_peered":"2023-07-14T18:11:14.790941+0000","last_clean":"2023-07-14T18:11:14.790941+0000","last_became_active":"2023-07-14T18:11:09.708170+0000","last_became_peered":"2023-07-14T18:11:09.708170+0000","last_unstale":"2023-07-14T18:11:14.790941+0000","last_undegraded":"2023-07-14T18:11:14.790941+0000","last_fullsized":"2023-07-14T18:11:14.790941+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_clean_scrub_stamp":"2023-07-14T18:11:08.667354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T04:03:41.097364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":13,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:11:15.116981+0000","last_change":"2023-07-14T18:11:13.792069+0000","last_active":"2023-07-14T18:11:15.116981+0000","last_peered":"2023-07-14T18:11:15.116981+0000","last_clean":"2023-07-14T18:11:15.116981+0000","last_became_active":"2023-07-14T18:11:13.791698+0000","last_became_peered":"2023-07-14T18:11:13.791698+0000","last_unstale":"2023-07-14T18:11:15.116981+0000","last_undegraded":"2023-07-14T18:11:15.116981+0000","last_fullsized":"2023-07-14T18:11:15.116981+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:12.753466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:12.753466+0000","last_clean_scrub_stamp":"2023-07-14T18:11:12.753466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:36:51.740650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.12","version":"84'5","reported_seq":28,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:11:30.775116+0000","last_change":"2023-07-14T18:11:08.685028+0000","last_active":"2023-07-14T18:11:30.775116+0000","last_peered":"2023-07-14T18:11:30.775116+0000","last_clean":"2023-07-14T18:11:30.775116+0000","last_became_active":"2023-07-14T18:11:08.684701+0000","last_became_peered":"2023-07-14T18:11:08.684701+0000","last_unstale":"2023-07-14T18:11:30.775116+0000","last_undegraded":"2023-07-14T18:11:30.775116+0000","last_fullsized":"2023-07-14T18:11:30.775116+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:07.665746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:07.665746+0000","last_clean_scrub_stamp":"2023-07-14T18:11:07.665746+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:48:38.822039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":18,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:11:14.886051+0000","last_change":"2023-07-14T18:11:09.717714+0000","last_active":"2023-07-14T18:11:14.886051+0000","last_peered":"2023-07-14T18:11:14.886051+0000","last_clean":"2023-07-14T18:11:14.886051+0000","last_became_active":"2023-07-14T18:11:09.717407+0000","last_became_peered":"2023-07-14T18:11:09.717407+0000","last_unstale":"2023-07-14T18:11:14.886051+0000","last_undegraded":"2023-07-14T18:11:14.886051+0000","last_fullsized":"2023-07-14T18:11:14.886051+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_clean_scrub_stamp":"2023-07-14T18:11:08.667354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T02:18:33.466738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":13,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:11:14.887107+0000","last_change":"2023-07-14T18:11:13.787754+0000","last_active":"2023-07-14T18:11:14.887107+0000","last_peered":"2023-07-14T18:11:14.887107+0000","last_clean":"2023-07-14T18:11:14.887107+0000","last_became_active":"2023-07-14T18:11:13.787250+0000","last_became_peered":"2023-07-14T18:11:13.787250+0000","last_unstale":"2023-07-14T18:11:14.887107+0000","last_undegraded":"2023-07-14T18:11:14.887107+0000","last_fullsized":"2023-07-14T18:11:14.887107+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:12.753466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:12.753466+0000","last_clean_scrub_stamp":"2023-07-14T18:11:12.753466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T03:54:39.337152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,0,3],"acting":[9,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.11","version":"84'6","reported_seq":62,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:12:00.815186+0000","last_change":"2023-07-14T18:11:08.685327+0000","last_active":"2023-07-14T18:12:00.815186+0000","last_peered":"2023-07-14T18:12:00.815186+0000","last_clean":"2023-07-14T18:12:00.815186+0000","last_became_active":"2023-07-14T18:11:08.684969+0000","last_became_peered":"2023-07-14T18:11:08.684969+0000","last_unstale":"2023-07-14T18:12:00.815186+0000","last_undegraded":"2023-07-14T18:12:00.815186+0000","last_fullsized":"2023-07-14T18:12:00.815186+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:07.665746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:07.665746+0000","last_clean_scrub_stamp":"2023-07-14T18:11:07.665746+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:38:18.572332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":930,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":35,"num_read_kb":3,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":18,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:11:14.886418+0000","last_change":"2023-07-14T18:11:09.721100+0000","last_active":"2023-07-14T18:11:14.886418+0000","last_peered":"2023-07-14T18:11:14.886418+0000","last_clean":"2023-07-14T18:11:14.886418+0000","last_became_active":"2023-07-14T18:11:09.720814+0000","last_became_peered":"2023-07-14T18:11:09.720814+0000","last_unstale":"2023-07-14T18:11:14.886418+0000","last_undegraded":"2023-07-14T18:11:14.886418+0000","last_fullsized":"2023-07-14T18:11:14.886418+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_clean_scrub_stamp":"2023-07-14T18:11:08.667354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:21:49.557811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":13,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:11:14.791294+0000","last_change":"2023-07-14T18:11:13.782152+0000","last_active":"2023-07-14T18:11:14.791294+0000","last_peered":"2023-07-14T18:11:14.791294+0000","last_clean":"2023-07-14T18:11:14.791294+0000","last_became_active":"2023-07-14T18:11:13.780580+0000","last_became_peered":"2023-07-14T18:11:13.780580+0000","last_unstale":"2023-07-14T18:11:14.791294+0000","last_undegraded":"2023-07-14T18:11:14.791294+0000","last_fullsized":"2023-07-14T18:11:14.791294+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:12.753466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:12.753466+0000","last_clean_scrub_stamp":"2023-07-14T18:11:12.753466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T05:13:05.195958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"84'17","reported_seq":40,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:11:30.764437+0000","last_change":"2023-07-14T18:11:08.688954+0000","last_active":"2023-07-14T18:11:30.764437+0000","last_peered":"2023-07-14T18:11:30.764437+0000","last_clean":"2023-07-14T18:11:30.764437+0000","last_became_active":"2023-07-14T18:11:08.688640+0000","last_became_peered":"2023-07-14T18:11:08.688640+0000","last_unstale":"2023-07-14T18:11:30.764437+0000","last_undegraded":"2023-07-14T18:11:30.764437+0000","last_fullsized":"2023-07-14T18:11:30.764437+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:07.665746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:07.665746+0000","last_clean_scrub_stamp":"2023-07-14T18:11:07.665746+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:21:30.166422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":20,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:11:14.791112+0000","last_change":"2023-07-14T18:11:09.710105+0000","last_active":"2023-07-14T18:11:14.791112+0000","last_peered":"2023-07-14T18:11:14.791112+0000","last_clean":"2023-07-14T18:11:14.791112+0000","last_became_active":"2023-07-14T18:11:09.709820+0000","last_became_peered":"2023-07-14T18:11:09.709820+0000","last_unstale":"2023-07-14T18:11:14.791112+0000","last_undegraded":"2023-07-14T18:11:14.791112+0000","last_fullsized":"2023-07-14T18:11:14.791112+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_clean_scrub_stamp":"2023-07-14T18:11:08.667354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:29:12.467495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":13,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:11:14.791138+0000","last_change":"2023-07-14T18:11:13.780122+0000","last_active":"2023-07-14T18:11:14.791138+0000","last_peered":"2023-07-14T18:11:14.791138+0000","last_clean":"2023-07-14T18:11:14.791138+0000","last_became_active":"2023-07-14T18:11:13.779774+0000","last_became_peered":"2023-07-14T18:11:13.779774+0000","last_unstale":"2023-07-14T18:11:14.791138+0000","last_undegraded":"2023-07-14T18:11:14.791138+0000","last_fullsized":"2023-07-14T18:11:14.791138+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:12.753466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:12.753466+0000","last_clean_scrub_stamp":"2023-07-14T18:11:12.753466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:30:22.618282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"84'2","reported_seq":25,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:11:29.872951+0000","last_change":"2023-07-14T18:11:08.686080+0000","last_active":"2023-07-14T18:11:29.872951+0000","last_peered":"2023-07-14T18:11:29.872951+0000","last_clean":"2023-07-14T18:11:29.872951+0000","last_became_active":"2023-07-14T18:11:08.685837+0000","last_became_peered":"2023-07-14T18:11:08.685837+0000","last_unstale":"2023-07-14T18:11:29.872951+0000","last_undegraded":"2023-07-14T18:11:29.872951+0000","last_fullsized":"2023-07-14T18:11:29.872951+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:07.665746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:07.665746+0000","last_clean_scrub_stamp":"2023-07-14T18:11:07.665746+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:51:30.759050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":20,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:11:15.117046+0000","last_change":"2023-07-14T18:11:09.712166+0000","last_active":"2023-07-14T18:11:15.117046+0000","last_peered":"2023-07-14T18:11:15.117046+0000","last_clean":"2023-07-14T18:11:15.117046+0000","last_became_active":"2023-07-14T18:11:09.711858+0000","last_became_peered":"2023-07-14T18:11:09.711858+0000","last_unstale":"2023-07-14T18:11:15.117046+0000","last_undegraded":"2023-07-14T18:11:15.117046+0000","last_fullsized":"2023-07-14T18:11:15.117046+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_clean_scrub_stamp":"2023-07-14T18:11:08.667354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:17:12.495175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":13,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:11:14.885280+0000","last_change":"2023-07-14T18:11:13.905188+0000","last_active":"2023-07-14T18:11:14.885280+0000","last_peered":"2023-07-14T18:11:14.885280+0000","last_clean":"2023-07-14T18:11:14.885280+0000","last_became_active":"2023-07-14T18:11:13.904779+0000","last_became_peered":"2023-07-14T18:11:13.904779+0000","last_unstale":"2023-07-14T18:11:14.885280+0000","last_undegraded":"2023-07-14T18:11:14.885280+0000","last_fullsized":"2023-07-14T18:11:14.885280+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:12.753466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:12.753466+0000","last_clean_scrub_stamp":"2023-07-14T18:11:12.753466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:58:40.490499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,9],"acting":[8,10,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.4","version":"84'1","reported_seq":23,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:11:14.886899+0000","last_change":"2023-07-14T18:11:08.687838+0000","last_active":"2023-07-14T18:11:14.886899+0000","last_peered":"2023-07-14T18:11:14.886899+0000","last_clean":"2023-07-14T18:11:14.886899+0000","last_became_active":"2023-07-14T18:11:08.687522+0000","last_became_peered":"2023-07-14T18:11:08.687522+0000","last_unstale":"2023-07-14T18:11:14.886899+0000","last_undegraded":"2023-07-14T18:11:14.886899+0000","last_fullsized":"2023-07-14T18:11:14.886899+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:07.665746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:07.665746+0000","last_clean_scrub_stamp":"2023-07-14T18:11:07.665746+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T01:12:01.083801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":20,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:11:14.791607+0000","last_change":"2023-07-14T18:11:09.704033+0000","last_active":"2023-07-14T18:11:14.791607+0000","last_peered":"2023-07-14T18:11:14.791607+0000","last_clean":"2023-07-14T18:11:14.791607+0000","last_became_active":"2023-07-14T18:11:09.703727+0000","last_became_peered":"2023-07-14T18:11:09.703727+0000","last_unstale":"2023-07-14T18:11:14.791607+0000","last_undegraded":"2023-07-14T18:11:14.791607+0000","last_fullsized":"2023-07-14T18:11:14.791607+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_clean_scrub_stamp":"2023-07-14T18:11:08.667354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T04:23:57.185860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":13,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:11:14.791177+0000","last_change":"2023-07-14T18:11:13.778207+0000","last_active":"2023-07-14T18:11:14.791177+0000","last_peered":"2023-07-14T18:11:14.791177+0000","last_clean":"2023-07-14T18:11:14.791177+0000","last_became_active":"2023-07-14T18:11:13.777847+0000","last_became_peered":"2023-07-14T18:11:13.777847+0000","last_unstale":"2023-07-14T18:11:14.791177+0000","last_undegraded":"2023-07-14T18:11:14.791177+0000","last_fullsized":"2023-07-14T18:11:14.791177+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:12.753466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:12.753466+0000","last_clean_scrub_stamp":"2023-07-14T18:11:12.753466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:48:12.622534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"84'5","reported_seq":60,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:12:03.826171+0000","last_change":"2023-07-14T18:11:08.683570+0000","last_active":"2023-07-14T18:12:03.826171+0000","last_peered":"2023-07-14T18:12:03.826171+0000","last_clean":"2023-07-14T18:12:03.826171+0000","last_became_active":"2023-07-14T18:11:08.683271+0000","last_became_peered":"2023-07-14T18:11:08.683271+0000","last_unstale":"2023-07-14T18:12:03.826171+0000","last_undegraded":"2023-07-14T18:12:03.826171+0000","last_fullsized":"2023-07-14T18:12:03.826171+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:07.665746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:07.665746+0000","last_clean_scrub_stamp":"2023-07-14T18:11:07.665746+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:27:31.589898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":540,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":35,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":20,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:11:14.791596+0000","last_change":"2023-07-14T18:11:09.718239+0000","last_active":"2023-07-14T18:11:14.791596+0000","last_peered":"2023-07-14T18:11:14.791596+0000","last_clean":"2023-07-14T18:11:14.791596+0000","last_became_active":"2023-07-14T18:11:09.717923+0000","last_became_peered":"2023-07-14T18:11:09.717923+0000","last_unstale":"2023-07-14T18:11:14.791596+0000","last_undegraded":"2023-07-14T18:11:14.791596+0000","last_fullsized":"2023-07-14T18:11:14.791596+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_clean_scrub_stamp":"2023-07-14T18:11:08.667354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T04:18:29.161266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":13,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:11:14.791411+0000","last_change":"2023-07-14T18:11:13.904652+0000","last_active":"2023-07-14T18:11:14.791411+0000","last_peered":"2023-07-14T18:11:14.791411+0000","last_clean":"2023-07-14T18:11:14.791411+0000","last_became_active":"2023-07-14T18:11:13.904237+0000","last_became_peered":"2023-07-14T18:11:13.904237+0000","last_unstale":"2023-07-14T18:11:14.791411+0000","last_undegraded":"2023-07-14T18:11:14.791411+0000","last_fullsized":"2023-07-14T18:11:14.791411+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:12.753466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:12.753466+0000","last_clean_scrub_stamp":"2023-07-14T18:11:12.753466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T05:43:29.030625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":20,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:11:14.791182+0000","last_change":"2023-07-14T18:11:09.707086+0000","last_active":"2023-07-14T18:11:14.791182+0000","last_peered":"2023-07-14T18:11:14.791182+0000","last_clean":"2023-07-14T18:11:14.791182+0000","last_became_active":"2023-07-14T18:11:09.705882+0000","last_became_peered":"2023-07-14T18:11:09.705882+0000","last_unstale":"2023-07-14T18:11:14.791182+0000","last_undegraded":"2023-07-14T18:11:14.791182+0000","last_fullsized":"2023-07-14T18:11:14.791182+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_clean_scrub_stamp":"2023-07-14T18:11:08.667354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T03:39:47.438151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"84'5","reported_seq":62,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:12:02.817553+0000","last_change":"2023-07-14T18:11:08.683447+0000","last_active":"2023-07-14T18:12:02.817553+0000","last_peered":"2023-07-14T18:12:02.817553+0000","last_clean":"2023-07-14T18:12:02.817553+0000","last_became_active":"2023-07-14T18:11:08.682822+0000","last_became_peered":"2023-07-14T18:11:08.682822+0000","last_unstale":"2023-07-14T18:12:02.817553+0000","last_undegraded":"2023-07-14T18:12:02.817553+0000","last_fullsized":"2023-07-14T18:12:02.817553+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:07.665746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:07.665746+0000","last_clean_scrub_stamp":"2023-07-14T18:11:07.665746+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:07:15.245024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":35,"num_read_kb":35,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.5","version":"84'1","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:11:14.903879+0000","last_change":"2023-07-14T18:11:13.780698+0000","last_active":"2023-07-14T18:11:14.903879+0000","last_peered":"2023-07-14T18:11:14.903879+0000","last_clean":"2023-07-14T18:11:14.903879+0000","last_became_active":"2023-07-14T18:11:13.780310+0000","last_became_peered":"2023-07-14T18:11:13.780310+0000","last_unstale":"2023-07-14T18:11:14.903879+0000","last_undegraded":"2023-07-14T18:11:14.903879+0000","last_fullsized":"2023-07-14T18:11:14.903879+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:12.753466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:12.753466+0000","last_clean_scrub_stamp":"2023-07-14T18:11:12.753466+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:45:25.175685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":123,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,9],"acting":[7,5,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":20,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:11:14.884951+0000","last_change":"2023-07-14T18:11:09.708728+0000","last_active":"2023-07-14T18:11:14.884951+0000","last_peered":"2023-07-14T18:11:14.884951+0000","last_clean":"2023-07-14T18:11:14.884951+0000","last_became_active":"2023-07-14T18:11:09.708345+0000","last_became_peered":"2023-07-14T18:11:09.708345+0000","last_unstale":"2023-07-14T18:11:14.884951+0000","last_undegraded":"2023-07-14T18:11:14.884951+0000","last_fullsized":"2023-07-14T18:11:14.884951+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_clean_scrub_stamp":"2023-07-14T18:11:08.667354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:19:56.524734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"84'6","reported_seq":31,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:11:30.773955+0000","last_change":"2023-07-14T18:11:08.684495+0000","last_active":"2023-07-14T18:11:30.773955+0000","last_peered":"2023-07-14T18:11:30.773955+0000","last_clean":"2023-07-14T18:11:30.773955+0000","last_became_active":"2023-07-14T18:11:08.684142+0000","last_became_peered":"2023-07-14T18:11:08.684142+0000","last_unstale":"2023-07-14T18:11:30.773955+0000","last_undegraded":"2023-07-14T18:11:30.773955+0000","last_fullsized":"2023-07-14T18:11:30.773955+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:07.665746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:07.665746+0000","last_clean_scrub_stamp":"2023-07-14T18:11:07.665746+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T04:13:36.850275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"22'137","reported_seq":336,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:11:14.886019+0000","last_change":"2023-07-14T18:10:10.733548+0000","last_active":"2023-07-14T18:11:14.886019+0000","last_peered":"2023-07-14T18:11:14.886019+0000","last_clean":"2023-07-14T18:11:14.886019+0000","last_became_active":"2023-07-14T18:10:10.732994+0000","last_became_peered":"2023-07-14T18:10:10.732994+0000","last_unstale":"2023-07-14T18:11:14.886019+0000","last_undegraded":"2023-07-14T18:11:14.886019+0000","last_fullsized":"2023-07-14T18:11:14.886019+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:07:19.893754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:07:19.893754+0000","last_clean_scrub_stamp":"2023-07-14T18:07:19.893754+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T03:18:47.801203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":13,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:11:14.791877+0000","last_change":"2023-07-14T18:11:13.905811+0000","last_active":"2023-07-14T18:11:14.791877+0000","last_peered":"2023-07-14T18:11:14.791877+0000","last_clean":"2023-07-14T18:11:14.791877+0000","last_became_active":"2023-07-14T18:11:13.905390+0000","last_became_peered":"2023-07-14T18:11:13.905390+0000","last_unstale":"2023-07-14T18:11:14.791877+0000","last_undegraded":"2023-07-14T18:11:14.791877+0000","last_fullsized":"2023-07-14T18:11:14.791877+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:12.753466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:12.753466+0000","last_clean_scrub_stamp":"2023-07-14T18:11:12.753466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T03:55:38.653507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,6,10],"acting":[5,9,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":20,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:11:14.790613+0000","last_change":"2023-07-14T18:11:09.711008+0000","last_active":"2023-07-14T18:11:14.790613+0000","last_peered":"2023-07-14T18:11:14.790613+0000","last_clean":"2023-07-14T18:11:14.790613+0000","last_became_active":"2023-07-14T18:11:09.710555+0000","last_became_peered":"2023-07-14T18:11:09.710555+0000","last_unstale":"2023-07-14T18:11:14.790613+0000","last_undegraded":"2023-07-14T18:11:14.790613+0000","last_fullsized":"2023-07-14T18:11:14.790613+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_clean_scrub_stamp":"2023-07-14T18:11:08.667354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:14:16.607280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"84'4","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:11:28.825844+0000","last_change":"2023-07-14T18:11:08.689050+0000","last_active":"2023-07-14T18:11:28.825844+0000","last_peered":"2023-07-14T18:11:28.825844+0000","last_clean":"2023-07-14T18:11:28.825844+0000","last_became_active":"2023-07-14T18:11:08.688777+0000","last_became_peered":"2023-07-14T18:11:08.688777+0000","last_unstale":"2023-07-14T18:11:28.825844+0000","last_undegraded":"2023-07-14T18:11:28.825844+0000","last_fullsized":"2023-07-14T18:11:28.825844+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:07.665746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:07.665746+0000","last_clean_scrub_stamp":"2023-07-14T18:11:07.665746+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T01:15:28.678572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":13,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:11:15.116864+0000","last_change":"2023-07-14T18:11:13.776853+0000","last_active":"2023-07-14T18:11:15.116864+0000","last_peered":"2023-07-14T18:11:15.116864+0000","last_clean":"2023-07-14T18:11:15.116864+0000","last_became_active":"2023-07-14T18:11:13.776353+0000","last_became_peered":"2023-07-14T18:11:13.776353+0000","last_unstale":"2023-07-14T18:11:15.116864+0000","last_undegraded":"2023-07-14T18:11:15.116864+0000","last_fullsized":"2023-07-14T18:11:15.116864+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:12.753466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:12.753466+0000","last_clean_scrub_stamp":"2023-07-14T18:11:12.753466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:40:03.971774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.5","version":"84'4","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:11:30.766318+0000","last_change":"2023-07-14T18:11:08.691634+0000","last_active":"2023-07-14T18:11:30.766318+0000","last_peered":"2023-07-14T18:11:30.766318+0000","last_clean":"2023-07-14T18:11:30.766318+0000","last_became_active":"2023-07-14T18:11:08.691315+0000","last_became_peered":"2023-07-14T18:11:08.691315+0000","last_unstale":"2023-07-14T18:11:30.766318+0000","last_undegraded":"2023-07-14T18:11:30.766318+0000","last_fullsized":"2023-07-14T18:11:30.766318+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:07.665746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:07.665746+0000","last_clean_scrub_stamp":"2023-07-14T18:11:07.665746+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:52:43.536254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":20,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:11:14.791290+0000","last_change":"2023-07-14T18:11:09.707486+0000","last_active":"2023-07-14T18:11:14.791290+0000","last_peered":"2023-07-14T18:11:14.791290+0000","last_clean":"2023-07-14T18:11:14.791290+0000","last_became_active":"2023-07-14T18:11:09.707168+0000","last_became_peered":"2023-07-14T18:11:09.707168+0000","last_unstale":"2023-07-14T18:11:14.791290+0000","last_undegraded":"2023-07-14T18:11:14.791290+0000","last_fullsized":"2023-07-14T18:11:14.791290+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_clean_scrub_stamp":"2023-07-14T18:11:08.667354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T06:10:06.422348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":13,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:11:14.885841+0000","last_change":"2023-07-14T18:11:13.905898+0000","last_active":"2023-07-14T18:11:14.885841+0000","last_peered":"2023-07-14T18:11:14.885841+0000","last_clean":"2023-07-14T18:11:14.885841+0000","last_became_active":"2023-07-14T18:11:13.905482+0000","last_became_peered":"2023-07-14T18:11:13.905482+0000","last_unstale":"2023-07-14T18:11:14.885841+0000","last_undegraded":"2023-07-14T18:11:14.885841+0000","last_fullsized":"2023-07-14T18:11:14.885841+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:12.753466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:12.753466+0000","last_clean_scrub_stamp":"2023-07-14T18:11:12.753466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T01:29:14.269244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"84'9","reported_seq":31,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:11:33.596873+0000","last_change":"2023-07-14T18:11:08.692339+0000","last_active":"2023-07-14T18:11:33.596873+0000","last_peered":"2023-07-14T18:11:33.596873+0000","last_clean":"2023-07-14T18:11:33.596873+0000","last_became_active":"2023-07-14T18:11:08.692047+0000","last_became_peered":"2023-07-14T18:11:08.692047+0000","last_unstale":"2023-07-14T18:11:33.596873+0000","last_undegraded":"2023-07-14T18:11:33.596873+0000","last_fullsized":"2023-07-14T18:11:33.596873+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:07.665746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:07.665746+0000","last_clean_scrub_stamp":"2023-07-14T18:11:07.665746+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:12:32.523480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":20,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:11:14.886517+0000","last_change":"2023-07-14T18:11:09.709900+0000","last_active":"2023-07-14T18:11:14.886517+0000","last_peered":"2023-07-14T18:11:14.886517+0000","last_clean":"2023-07-14T18:11:14.886517+0000","last_became_active":"2023-07-14T18:11:09.709291+0000","last_became_peered":"2023-07-14T18:11:09.709291+0000","last_unstale":"2023-07-14T18:11:14.886517+0000","last_undegraded":"2023-07-14T18:11:14.886517+0000","last_fullsized":"2023-07-14T18:11:14.886517+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_clean_scrub_stamp":"2023-07-14T18:11:08.667354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:28:37.556066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":13,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:11:14.884032+0000","last_change":"2023-07-14T18:11:13.777493+0000","last_active":"2023-07-14T18:11:14.884032+0000","last_peered":"2023-07-14T18:11:14.884032+0000","last_clean":"2023-07-14T18:11:14.884032+0000","last_became_active":"2023-07-14T18:11:13.777110+0000","last_became_peered":"2023-07-14T18:11:13.777110+0000","last_unstale":"2023-07-14T18:11:14.884032+0000","last_undegraded":"2023-07-14T18:11:14.884032+0000","last_fullsized":"2023-07-14T18:11:14.884032+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:12.753466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:12.753466+0000","last_clean_scrub_stamp":"2023-07-14T18:11:12.753466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T04:26:56.453763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"84'7","reported_seq":30,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:11:30.772553+0000","last_change":"2023-07-14T18:11:08.686832+0000","last_active":"2023-07-14T18:11:30.772553+0000","last_peered":"2023-07-14T18:11:30.772553+0000","last_clean":"2023-07-14T18:11:30.772553+0000","last_became_active":"2023-07-14T18:11:08.686461+0000","last_became_peered":"2023-07-14T18:11:08.686461+0000","last_unstale":"2023-07-14T18:11:30.772553+0000","last_undegraded":"2023-07-14T18:11:30.772553+0000","last_fullsized":"2023-07-14T18:11:30.772553+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:07.665746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:07.665746+0000","last_clean_scrub_stamp":"2023-07-14T18:11:07.665746+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:28:44.517803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":20,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:11:14.884614+0000","last_change":"2023-07-14T18:11:09.715641+0000","last_active":"2023-07-14T18:11:14.884614+0000","last_peered":"2023-07-14T18:11:14.884614+0000","last_clean":"2023-07-14T18:11:14.884614+0000","last_became_active":"2023-07-14T18:11:09.715312+0000","last_became_peered":"2023-07-14T18:11:09.715312+0000","last_unstale":"2023-07-14T18:11:14.884614+0000","last_undegraded":"2023-07-14T18:11:14.884614+0000","last_fullsized":"2023-07-14T18:11:14.884614+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_clean_scrub_stamp":"2023-07-14T18:11:08.667354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:42:02.097258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":13,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:11:14.886127+0000","last_change":"2023-07-14T18:11:13.905856+0000","last_active":"2023-07-14T18:11:14.886127+0000","last_peered":"2023-07-14T18:11:14.886127+0000","last_clean":"2023-07-14T18:11:14.886127+0000","last_became_active":"2023-07-14T18:11:13.905441+0000","last_became_peered":"2023-07-14T18:11:13.905441+0000","last_unstale":"2023-07-14T18:11:14.886127+0000","last_undegraded":"2023-07-14T18:11:14.886127+0000","last_fullsized":"2023-07-14T18:11:14.886127+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:12.753466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:12.753466+0000","last_clean_scrub_stamp":"2023-07-14T18:11:12.753466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T04:13:12.089073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,9],"acting":[4,5,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"84'2","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:11:27.817107+0000","last_change":"2023-07-14T18:11:08.685683+0000","last_active":"2023-07-14T18:11:27.817107+0000","last_peered":"2023-07-14T18:11:27.817107+0000","last_clean":"2023-07-14T18:11:27.817107+0000","last_became_active":"2023-07-14T18:11:08.685371+0000","last_became_peered":"2023-07-14T18:11:08.685371+0000","last_unstale":"2023-07-14T18:11:27.817107+0000","last_undegraded":"2023-07-14T18:11:27.817107+0000","last_fullsized":"2023-07-14T18:11:27.817107+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:07.665746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:07.665746+0000","last_clean_scrub_stamp":"2023-07-14T18:11:07.665746+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:19:35.470859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":20,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:11:14.884696+0000","last_change":"2023-07-14T18:11:09.711219+0000","last_active":"2023-07-14T18:11:14.884696+0000","last_peered":"2023-07-14T18:11:14.884696+0000","last_clean":"2023-07-14T18:11:14.884696+0000","last_became_active":"2023-07-14T18:11:09.711019+0000","last_became_peered":"2023-07-14T18:11:09.711019+0000","last_unstale":"2023-07-14T18:11:14.884696+0000","last_undegraded":"2023-07-14T18:11:14.884696+0000","last_fullsized":"2023-07-14T18:11:14.884696+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_clean_scrub_stamp":"2023-07-14T18:11:08.667354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:14:56.588616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":13,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:11:14.887189+0000","last_change":"2023-07-14T18:11:13.788530+0000","last_active":"2023-07-14T18:11:14.887189+0000","last_peered":"2023-07-14T18:11:14.887189+0000","last_clean":"2023-07-14T18:11:14.887189+0000","last_became_active":"2023-07-14T18:11:13.787952+0000","last_became_peered":"2023-07-14T18:11:13.787952+0000","last_unstale":"2023-07-14T18:11:14.887189+0000","last_undegraded":"2023-07-14T18:11:14.887189+0000","last_fullsized":"2023-07-14T18:11:14.887189+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:12.753466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:12.753466+0000","last_clean_scrub_stamp":"2023-07-14T18:11:12.753466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:19:37.880630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.9","version":"84'7","reported_seq":29,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:11:30.772567+0000","last_change":"2023-07-14T18:11:08.692719+0000","last_active":"2023-07-14T18:11:30.772567+0000","last_peered":"2023-07-14T18:11:30.772567+0000","last_clean":"2023-07-14T18:11:30.772567+0000","last_became_active":"2023-07-14T18:11:08.692390+0000","last_became_peered":"2023-07-14T18:11:08.692390+0000","last_unstale":"2023-07-14T18:11:30.772567+0000","last_undegraded":"2023-07-14T18:11:30.772567+0000","last_fullsized":"2023-07-14T18:11:30.772567+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:07.665746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:07.665746+0000","last_clean_scrub_stamp":"2023-07-14T18:11:07.665746+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T04:19:14.229274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":20,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:11:15.116807+0000","last_change":"2023-07-14T18:11:09.719176+0000","last_active":"2023-07-14T18:11:15.116807+0000","last_peered":"2023-07-14T18:11:15.116807+0000","last_clean":"2023-07-14T18:11:15.116807+0000","last_became_active":"2023-07-14T18:11:09.712667+0000","last_became_peered":"2023-07-14T18:11:09.712667+0000","last_unstale":"2023-07-14T18:11:15.116807+0000","last_undegraded":"2023-07-14T18:11:15.116807+0000","last_fullsized":"2023-07-14T18:11:15.116807+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_clean_scrub_stamp":"2023-07-14T18:11:08.667354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:13:03.473559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.c","version":"84'1","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:11:17.415960+0000","last_change":"2023-07-14T18:11:13.791717+0000","last_active":"2023-07-14T18:11:17.415960+0000","last_peered":"2023-07-14T18:11:17.415960+0000","last_clean":"2023-07-14T18:11:17.415960+0000","last_became_active":"2023-07-14T18:11:13.791280+0000","last_became_peered":"2023-07-14T18:11:13.791280+0000","last_unstale":"2023-07-14T18:11:17.415960+0000","last_undegraded":"2023-07-14T18:11:17.415960+0000","last_fullsized":"2023-07-14T18:11:17.415960+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:12.753466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:12.753466+0000","last_clean_scrub_stamp":"2023-07-14T18:11:12.753466+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:02:11.918589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":123,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9,7,8],"acting":[4,9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"84'3","reported_seq":25,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:11:32.074026+0000","last_change":"2023-07-14T18:11:08.692842+0000","last_active":"2023-07-14T18:11:32.074026+0000","last_peered":"2023-07-14T18:11:32.074026+0000","last_clean":"2023-07-14T18:11:32.074026+0000","last_became_active":"2023-07-14T18:11:08.692534+0000","last_became_peered":"2023-07-14T18:11:08.692534+0000","last_unstale":"2023-07-14T18:11:32.074026+0000","last_undegraded":"2023-07-14T18:11:32.074026+0000","last_fullsized":"2023-07-14T18:11:32.074026+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:07.665746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:07.665746+0000","last_clean_scrub_stamp":"2023-07-14T18:11:07.665746+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T06:10:00.305017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":20,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:11:14.885673+0000","last_change":"2023-07-14T18:11:09.703665+0000","last_active":"2023-07-14T18:11:14.885673+0000","last_peered":"2023-07-14T18:11:14.885673+0000","last_clean":"2023-07-14T18:11:14.885673+0000","last_became_active":"2023-07-14T18:11:09.703288+0000","last_became_peered":"2023-07-14T18:11:09.703288+0000","last_unstale":"2023-07-14T18:11:14.885673+0000","last_undegraded":"2023-07-14T18:11:14.885673+0000","last_fullsized":"2023-07-14T18:11:14.885673+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_clean_scrub_stamp":"2023-07-14T18:11:08.667354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:03:08.989108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":13,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:11:14.885620+0000","last_change":"2023-07-14T18:11:13.904604+0000","last_active":"2023-07-14T18:11:14.885620+0000","last_peered":"2023-07-14T18:11:14.885620+0000","last_clean":"2023-07-14T18:11:14.885620+0000","last_became_active":"2023-07-14T18:11:13.904245+0000","last_became_peered":"2023-07-14T18:11:13.904245+0000","last_unstale":"2023-07-14T18:11:14.885620+0000","last_undegraded":"2023-07-14T18:11:14.885620+0000","last_fullsized":"2023-07-14T18:11:14.885620+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:12.753466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:12.753466+0000","last_clean_scrub_stamp":"2023-07-14T18:11:12.753466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:22:17.468414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.b","version":"84'4","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:11:27.818020+0000","last_change":"2023-07-14T18:11:08.689876+0000","last_active":"2023-07-14T18:11:27.818020+0000","last_peered":"2023-07-14T18:11:27.818020+0000","last_clean":"2023-07-14T18:11:27.818020+0000","last_became_active":"2023-07-14T18:11:08.689582+0000","last_became_peered":"2023-07-14T18:11:08.689582+0000","last_unstale":"2023-07-14T18:11:27.818020+0000","last_undegraded":"2023-07-14T18:11:27.818020+0000","last_fullsized":"2023-07-14T18:11:27.818020+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:07.665746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:07.665746+0000","last_clean_scrub_stamp":"2023-07-14T18:11:07.665746+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:43:59.769036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":18,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:11:14.885962+0000","last_change":"2023-07-14T18:11:09.708228+0000","last_active":"2023-07-14T18:11:14.885962+0000","last_peered":"2023-07-14T18:11:14.885962+0000","last_clean":"2023-07-14T18:11:14.885962+0000","last_became_active":"2023-07-14T18:11:09.707985+0000","last_became_peered":"2023-07-14T18:11:09.707985+0000","last_unstale":"2023-07-14T18:11:14.885962+0000","last_undegraded":"2023-07-14T18:11:14.885962+0000","last_fullsized":"2023-07-14T18:11:14.885962+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_clean_scrub_stamp":"2023-07-14T18:11:08.667354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:01:49.217181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":13,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:11:14.884724+0000","last_change":"2023-07-14T18:11:13.775297+0000","last_active":"2023-07-14T18:11:14.884724+0000","last_peered":"2023-07-14T18:11:14.884724+0000","last_clean":"2023-07-14T18:11:14.884724+0000","last_became_active":"2023-07-14T18:11:13.774857+0000","last_became_peered":"2023-07-14T18:11:13.774857+0000","last_unstale":"2023-07-14T18:11:14.884724+0000","last_undegraded":"2023-07-14T18:11:14.884724+0000","last_fullsized":"2023-07-14T18:11:14.884724+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:12.753466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:12.753466+0000","last_clean_scrub_stamp":"2023-07-14T18:11:12.753466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:27:32.913667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.c","version":"84'5","reported_seq":64,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:12:03.820078+0000","last_change":"2023-07-14T18:11:08.689560+0000","last_active":"2023-07-14T18:12:03.820078+0000","last_peered":"2023-07-14T18:12:03.820078+0000","last_clean":"2023-07-14T18:12:03.820078+0000","last_became_active":"2023-07-14T18:11:08.689249+0000","last_became_peered":"2023-07-14T18:11:08.689249+0000","last_unstale":"2023-07-14T18:12:03.820078+0000","last_undegraded":"2023-07-14T18:12:03.820078+0000","last_fullsized":"2023-07-14T18:12:03.820078+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:07.665746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:07.665746+0000","last_clean_scrub_stamp":"2023-07-14T18:11:07.665746+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:02:04.221663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1122,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":37,"num_read_kb":2,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":18,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:11:14.885567+0000","last_change":"2023-07-14T18:11:09.720321+0000","last_active":"2023-07-14T18:11:14.885567+0000","last_peered":"2023-07-14T18:11:14.885567+0000","last_clean":"2023-07-14T18:11:14.885567+0000","last_became_active":"2023-07-14T18:11:09.720080+0000","last_became_peered":"2023-07-14T18:11:09.720080+0000","last_unstale":"2023-07-14T18:11:14.885567+0000","last_undegraded":"2023-07-14T18:11:14.885567+0000","last_fullsized":"2023-07-14T18:11:14.885567+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_clean_scrub_stamp":"2023-07-14T18:11:08.667354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T02:20:48.603885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":13,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:11:14.884372+0000","last_change":"2023-07-14T18:11:13.779349+0000","last_active":"2023-07-14T18:11:14.884372+0000","last_peered":"2023-07-14T18:11:14.884372+0000","last_clean":"2023-07-14T18:11:14.884372+0000","last_became_active":"2023-07-14T18:11:13.778946+0000","last_became_peered":"2023-07-14T18:11:13.778946+0000","last_unstale":"2023-07-14T18:11:14.884372+0000","last_undegraded":"2023-07-14T18:11:14.884372+0000","last_fullsized":"2023-07-14T18:11:14.884372+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:12.753466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:12.753466+0000","last_clean_scrub_stamp":"2023-07-14T18:11:12.753466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T04:25:22.766441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9,1,4],"acting":[0,9,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"84'3","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:11:30.764580+0000","last_change":"2023-07-14T18:11:08.683760+0000","last_active":"2023-07-14T18:11:30.764580+0000","last_peered":"2023-07-14T18:11:30.764580+0000","last_clean":"2023-07-14T18:11:30.764580+0000","last_became_active":"2023-07-14T18:11:08.683461+0000","last_became_peered":"2023-07-14T18:11:08.683461+0000","last_unstale":"2023-07-14T18:11:30.764580+0000","last_undegraded":"2023-07-14T18:11:30.764580+0000","last_fullsized":"2023-07-14T18:11:30.764580+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:07.665746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:07.665746+0000","last_clean_scrub_stamp":"2023-07-14T18:11:07.665746+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:26:31.918002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":18,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:11:14.884846+0000","last_change":"2023-07-14T18:11:09.708701+0000","last_active":"2023-07-14T18:11:14.884846+0000","last_peered":"2023-07-14T18:11:14.884846+0000","last_clean":"2023-07-14T18:11:14.884846+0000","last_became_active":"2023-07-14T18:11:09.708410+0000","last_became_peered":"2023-07-14T18:11:09.708410+0000","last_unstale":"2023-07-14T18:11:14.884846+0000","last_undegraded":"2023-07-14T18:11:14.884846+0000","last_fullsized":"2023-07-14T18:11:14.884846+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_clean_scrub_stamp":"2023-07-14T18:11:08.667354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T05:04:14.745169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":13,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:11:14.790903+0000","last_change":"2023-07-14T18:11:13.776584+0000","last_active":"2023-07-14T18:11:14.790903+0000","last_peered":"2023-07-14T18:11:14.790903+0000","last_clean":"2023-07-14T18:11:14.790903+0000","last_became_active":"2023-07-14T18:11:13.775288+0000","last_became_peered":"2023-07-14T18:11:13.775288+0000","last_unstale":"2023-07-14T18:11:14.790903+0000","last_undegraded":"2023-07-14T18:11:14.790903+0000","last_fullsized":"2023-07-14T18:11:14.790903+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:12.753466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:12.753466+0000","last_clean_scrub_stamp":"2023-07-14T18:11:12.753466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T02:35:47.441794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"84'5","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:11:30.770745+0000","last_change":"2023-07-14T18:11:08.687332+0000","last_active":"2023-07-14T18:11:30.770745+0000","last_peered":"2023-07-14T18:11:30.770745+0000","last_clean":"2023-07-14T18:11:30.770745+0000","last_became_active":"2023-07-14T18:11:08.686902+0000","last_became_peered":"2023-07-14T18:11:08.686902+0000","last_unstale":"2023-07-14T18:11:30.770745+0000","last_undegraded":"2023-07-14T18:11:30.770745+0000","last_fullsized":"2023-07-14T18:11:30.770745+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:07.665746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:07.665746+0000","last_clean_scrub_stamp":"2023-07-14T18:11:07.665746+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:33:50.338931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":18,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:11:14.886168+0000","last_change":"2023-07-14T18:11:09.719308+0000","last_active":"2023-07-14T18:11:14.886168+0000","last_peered":"2023-07-14T18:11:14.886168+0000","last_clean":"2023-07-14T18:11:14.886168+0000","last_became_active":"2023-07-14T18:11:09.719038+0000","last_became_peered":"2023-07-14T18:11:09.719038+0000","last_unstale":"2023-07-14T18:11:14.886168+0000","last_undegraded":"2023-07-14T18:11:14.886168+0000","last_fullsized":"2023-07-14T18:11:14.886168+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_clean_scrub_stamp":"2023-07-14T18:11:08.667354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:21:02.431834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":20,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:11:15.116944+0000","last_change":"2023-07-14T18:11:09.710991+0000","last_active":"2023-07-14T18:11:15.116944+0000","last_peered":"2023-07-14T18:11:15.116944+0000","last_clean":"2023-07-14T18:11:15.116944+0000","last_became_active":"2023-07-14T18:11:09.710689+0000","last_became_peered":"2023-07-14T18:11:09.710689+0000","last_unstale":"2023-07-14T18:11:15.116944+0000","last_undegraded":"2023-07-14T18:11:15.116944+0000","last_fullsized":"2023-07-14T18:11:15.116944+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_clean_scrub_stamp":"2023-07-14T18:11:08.667354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:46:01.500390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":20,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:11:14.884240+0000","last_change":"2023-07-14T18:11:09.711793+0000","last_active":"2023-07-14T18:11:14.884240+0000","last_peered":"2023-07-14T18:11:14.884240+0000","last_clean":"2023-07-14T18:11:14.884240+0000","last_became_active":"2023-07-14T18:11:09.711488+0000","last_became_peered":"2023-07-14T18:11:09.711488+0000","last_unstale":"2023-07-14T18:11:14.884240+0000","last_undegraded":"2023-07-14T18:11:14.884240+0000","last_fullsized":"2023-07-14T18:11:14.884240+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_clean_scrub_stamp":"2023-07-14T18:11:08.667354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:57:04.042308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":20,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:11:14.883995+0000","last_change":"2023-07-14T18:11:09.707835+0000","last_active":"2023-07-14T18:11:14.883995+0000","last_peered":"2023-07-14T18:11:14.883995+0000","last_clean":"2023-07-14T18:11:14.883995+0000","last_became_active":"2023-07-14T18:11:09.706863+0000","last_became_peered":"2023-07-14T18:11:09.706863+0000","last_unstale":"2023-07-14T18:11:14.883995+0000","last_undegraded":"2023-07-14T18:11:14.883995+0000","last_fullsized":"2023-07-14T18:11:14.883995+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_clean_scrub_stamp":"2023-07-14T18:11:08.667354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T02:34:34.215440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":20,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:11:14.884701+0000","last_change":"2023-07-14T18:11:09.714879+0000","last_active":"2023-07-14T18:11:14.884701+0000","last_peered":"2023-07-14T18:11:14.884701+0000","last_clean":"2023-07-14T18:11:14.884701+0000","last_became_active":"2023-07-14T18:11:09.714583+0000","last_became_peered":"2023-07-14T18:11:09.714583+0000","last_unstale":"2023-07-14T18:11:14.884701+0000","last_undegraded":"2023-07-14T18:11:14.884701+0000","last_fullsized":"2023-07-14T18:11:14.884701+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_clean_scrub_stamp":"2023-07-14T18:11:08.667354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T03:37:12.524327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":20,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:11:14.790997+0000","last_change":"2023-07-14T18:11:09.710850+0000","last_active":"2023-07-14T18:11:14.790997+0000","last_peered":"2023-07-14T18:11:14.790997+0000","last_clean":"2023-07-14T18:11:14.790997+0000","last_became_active":"2023-07-14T18:11:09.710533+0000","last_became_peered":"2023-07-14T18:11:09.710533+0000","last_unstale":"2023-07-14T18:11:14.790997+0000","last_undegraded":"2023-07-14T18:11:14.790997+0000","last_fullsized":"2023-07-14T18:11:14.790997+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_clean_scrub_stamp":"2023-07-14T18:11:08.667354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T02:32:10.888054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":20,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:11:15.117230+0000","last_change":"2023-07-14T18:11:09.710457+0000","last_active":"2023-07-14T18:11:15.117230+0000","last_peered":"2023-07-14T18:11:15.117230+0000","last_clean":"2023-07-14T18:11:15.117230+0000","last_became_active":"2023-07-14T18:11:09.710163+0000","last_became_peered":"2023-07-14T18:11:09.710163+0000","last_unstale":"2023-07-14T18:11:15.117230+0000","last_undegraded":"2023-07-14T18:11:15.117230+0000","last_fullsized":"2023-07-14T18:11:15.117230+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_clean_scrub_stamp":"2023-07-14T18:11:08.667354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:05:12.700623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":20,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:11:14.884622+0000","last_change":"2023-07-14T18:11:09.709062+0000","last_active":"2023-07-14T18:11:14.884622+0000","last_peered":"2023-07-14T18:11:14.884622+0000","last_clean":"2023-07-14T18:11:14.884622+0000","last_became_active":"2023-07-14T18:11:09.708767+0000","last_became_peered":"2023-07-14T18:11:09.708767+0000","last_unstale":"2023-07-14T18:11:14.884622+0000","last_undegraded":"2023-07-14T18:11:14.884622+0000","last_fullsized":"2023-07-14T18:11:14.884622+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_clean_scrub_stamp":"2023-07-14T18:11:08.667354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T01:00:42.739345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":20,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:11:14.886746+0000","last_change":"2023-07-14T18:11:09.707279+0000","last_active":"2023-07-14T18:11:14.886746+0000","last_peered":"2023-07-14T18:11:14.886746+0000","last_clean":"2023-07-14T18:11:14.886746+0000","last_became_active":"2023-07-14T18:11:09.706972+0000","last_became_peered":"2023-07-14T18:11:09.706972+0000","last_unstale":"2023-07-14T18:11:14.886746+0000","last_undegraded":"2023-07-14T18:11:14.886746+0000","last_fullsized":"2023-07-14T18:11:14.886746+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_clean_scrub_stamp":"2023-07-14T18:11:08.667354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:02:52.034920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":20,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:11:14.791002+0000","last_change":"2023-07-14T18:11:09.709710+0000","last_active":"2023-07-14T18:11:14.791002+0000","last_peered":"2023-07-14T18:11:14.791002+0000","last_clean":"2023-07-14T18:11:14.791002+0000","last_became_active":"2023-07-14T18:11:09.709438+0000","last_became_peered":"2023-07-14T18:11:09.709438+0000","last_unstale":"2023-07-14T18:11:14.791002+0000","last_undegraded":"2023-07-14T18:11:14.791002+0000","last_fullsized":"2023-07-14T18:11:14.791002+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_clean_scrub_stamp":"2023-07-14T18:11:08.667354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T02:06:46.155849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":20,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:11:14.884619+0000","last_change":"2023-07-14T18:11:09.720216+0000","last_active":"2023-07-14T18:11:14.884619+0000","last_peered":"2023-07-14T18:11:14.884619+0000","last_clean":"2023-07-14T18:11:14.884619+0000","last_became_active":"2023-07-14T18:11:09.719775+0000","last_became_peered":"2023-07-14T18:11:09.719775+0000","last_unstale":"2023-07-14T18:11:14.884619+0000","last_undegraded":"2023-07-14T18:11:14.884619+0000","last_fullsized":"2023-07-14T18:11:14.884619+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_clean_scrub_stamp":"2023-07-14T18:11:08.667354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T03:06:39.685042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":20,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:11:14.885075+0000","last_change":"2023-07-14T18:11:09.708462+0000","last_active":"2023-07-14T18:11:14.885075+0000","last_peered":"2023-07-14T18:11:14.885075+0000","last_clean":"2023-07-14T18:11:14.885075+0000","last_became_active":"2023-07-14T18:11:09.705611+0000","last_became_peered":"2023-07-14T18:11:09.705611+0000","last_unstale":"2023-07-14T18:11:14.885075+0000","last_undegraded":"2023-07-14T18:11:14.885075+0000","last_fullsized":"2023-07-14T18:11:14.885075+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_clean_scrub_stamp":"2023-07-14T18:11:08.667354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:45:55.084603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":20,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:11:14.790949+0000","last_change":"2023-07-14T18:11:09.707560+0000","last_active":"2023-07-14T18:11:14.790949+0000","last_peered":"2023-07-14T18:11:14.790949+0000","last_clean":"2023-07-14T18:11:14.790949+0000","last_became_active":"2023-07-14T18:11:09.707216+0000","last_became_peered":"2023-07-14T18:11:09.707216+0000","last_unstale":"2023-07-14T18:11:14.790949+0000","last_undegraded":"2023-07-14T18:11:14.790949+0000","last_fullsized":"2023-07-14T18:11:14.790949+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_clean_scrub_stamp":"2023-07-14T18:11:08.667354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T05:53:45.047425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":20,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:11:15.117017+0000","last_change":"2023-07-14T18:11:09.712059+0000","last_active":"2023-07-14T18:11:15.117017+0000","last_peered":"2023-07-14T18:11:15.117017+0000","last_clean":"2023-07-14T18:11:15.117017+0000","last_became_active":"2023-07-14T18:11:09.711759+0000","last_became_peered":"2023-07-14T18:11:09.711759+0000","last_unstale":"2023-07-14T18:11:15.117017+0000","last_undegraded":"2023-07-14T18:11:15.117017+0000","last_fullsized":"2023-07-14T18:11:15.117017+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_clean_scrub_stamp":"2023-07-14T18:11:08.667354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:30:03.374413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":246,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":32768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4157440,"data_stored":4132576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":67457,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":367,"num_read_kb":257,"num_write":233,"num_write_kb":133,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":565248,"data_stored":202371,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":205,"ondisk_log_size":205,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":75,"seq":322122547223,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27932,"kb_used_data":916,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717220,"statfs":{"total":95995035648,"available":95966433280,"internally_reserved":0,"allocated":937984,"data_stored":454796,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 18:11:30 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"last":0.69199999999999995}]},{"osd":1,"last update":"Fri Jul 14 18:11:30 2023","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.754},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.624}]},{"osd":2,"last update":"Fri Jul 14 18:11:30 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.495},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"last":0.60399999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35399999999999998}]},{"osd":4,"last update":"Fri Jul 14 18:11:30 2023","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.72499999999999998},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.70699999999999996}]},{"osd":5,"last update":"Fri Jul 14 18:11:30 2023","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.63,"5min":0.63,"15min":0.63},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.54700000000000004}]},{"osd":6,"last update":"Fri Jul 14 18:11:30 2023","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.91600000000000004,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.749,"5min":0.749,"15min":0.749},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.73899999999999999}]},{"osd":7,"last update":"Fri Jul 14 18:11:30 2023","interfaces":[{"interface":"back","average":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":0.95699999999999996,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.84399999999999997},{"interface":"front","average":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":0.99299999999999999,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.76800000000000002}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79500000000000004}]},{"osd":9,"last update":"Fri Jul 14 18:11:30 2023","interfaces":[{"interface":"back","average":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":1.1419999999999999,"5min":1.1419999999999999,"15min":1.1419999999999999},"last":0.81699999999999995},{"interface":"front","average":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.042,"5min":1.042,"15min":1.042},"last":0.86899999999999999}]},{"osd":10,"last update":"Fri Jul 14 18:11:30 2023","interfaces":[{"interface":"back","average":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.0800000000000001,"5min":1.0800000000000001,"15min":1.0800000000000001},"last":0.83299999999999996},{"interface":"front","average":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.177,"5min":1.177,"15min":1.177},"last":0.85599999999999998}]}]},{"osd":10,"up_from":68,"seq":292057776154,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28604,"kb_used_data":1588,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716548,"statfs":{"total":95995035648,"available":95965745152,"internally_reserved":0,"allocated":1626112,"data_stored":1102508,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54900000000000004}]},{"osd":1,"last update":"Fri Jul 14 18:11:09 2023","interfaces":[{"interface":"back","average":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"last":0.436}]},{"osd":2,"last update":"Fri Jul 14 18:11:09 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"last":0.47999999999999998},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":0.84799999999999998,"5min":0.84799999999999998,"15min":0.84799999999999998},"last":0.45900000000000002}]},{"osd":3,"last update":"Fri Jul 14 18:11:09 2023","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.96099999999999997,"5min":0.96099999999999997,"15min":0.96099999999999997},"last":0.40300000000000002},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":0.95099999999999996,"5min":0.95099999999999996,"15min":0.95099999999999996},"last":0.35399999999999998}]},{"osd":4,"last update":"Fri Jul 14 18:11:09 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"last":0.496},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.97599999999999998,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.53000000000000003}]},{"osd":5,"last update":"Fri Jul 14 18:11:09 2023","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":1.0049999999999999,"5min":1.0049999999999999,"15min":1.0049999999999999},"last":0.68300000000000005},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":0.89500000000000002},"last":0.61499999999999999}]},{"osd":6,"last update":"Fri Jul 14 18:11:09 2023","interfaces":[{"interface":"back","average":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.004,"5min":1.004,"15min":1.004},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"min":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.1040000000000001,"5min":1.1040000000000001,"15min":1.1040000000000001},"last":0.58199999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49399999999999999}]},{"osd":8,"last update":"Fri Jul 14 18:11:09 2023","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":0.753,"15min":0.753},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":1.038,"5min":1.038,"15min":1.038},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.0820000000000001,"5min":1.0820000000000001,"15min":1.0820000000000001},"last":0.59399999999999997}]},{"osd":9,"last update":"Fri Jul 14 18:11:09 2023","interfaces":[{"interface":"back","average":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"min":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"max":{"1min":1.018,"5min":1.018,"15min":1.018},"last":0.627},{"interface":"front","average":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"min":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"max":{"1min":1.228,"5min":1.228,"15min":1.228},"last":0.63700000000000001}]},{"osd":11,"last update":"Fri Jul 14 18:11:27 2023","interfaces":[{"interface":"back","average":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":0.97899999999999998,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.66300000000000003},{"interface":"front","average":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.0309999999999999,"5min":1.0309999999999999,"15min":1.0309999999999999},"last":0.65100000000000002}]}]},{"osd":9,"up_from":63,"seq":270582939679,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27960,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717192,"statfs":{"total":95995035648,"available":95966404608,"internally_reserved":0,"allocated":966656,"data_stored":458870,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 18:11:50 2023","interfaces":[{"interface":"back","average":{"1min":0.35299999999999998,"5min":0.41299999999999998,"15min":0.42299999999999999},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.622,"5min":0.63200000000000001,"15min":0.63200000000000001},"last":0.32200000000000001},{"interface":"front","average":{"1min":0.37,"5min":0.432,"15min":0.442},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.57499999999999996,"5min":0.68899999999999995,"15min":0.68899999999999995},"last":0.34699999999999998}]},{"osd":1,"last update":"Fri Jul 14 18:11:50 2023","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.57599999999999996,"15min":0.58399999999999996},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.93100000000000005,"5min":0.94099999999999995,"15min":0.94099999999999995},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.59499999999999997,"15min":0.60499999999999998},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.73999999999999999,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.47499999999999998}]},{"osd":2,"last update":"Fri Jul 14 18:11:50 2023","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.59799999999999998,"15min":0.60599999999999998},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.81200000000000006,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.63700000000000001},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.61799999999999999,"15min":0.627},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.76100000000000001,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.54000000000000004}]},{"osd":3,"last update":"Fri Jul 14 18:11:50 2023","interfaces":[{"interface":"back","average":{"1min":0.40600000000000003,"5min":0.51300000000000001,"15min":0.53100000000000003},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.64200000000000002,"5min":0.75700000000000001,"15min":0.75700000000000001},"last":0.28000000000000003},{"interface":"front","average":{"1min":0.40699999999999997,"5min":0.51300000000000001,"15min":0.53100000000000003},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":0.58499999999999996,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.30399999999999999}]},{"osd":4,"last update":"Fri Jul 14 18:11:50 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.65900000000000003,"15min":0.67800000000000005},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.84299999999999997,"5min":0.95499999999999996,"15min":0.95499999999999996},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.64900000000000002,"15min":0.65900000000000003},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.90300000000000002,"5min":1,"15min":1},"last":0.629}]},{"osd":5,"last update":"Fri Jul 14 18:11:50 2023","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.68000000000000005,"15min":0.69499999999999995},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.80300000000000005,"5min":1.093,"15min":1.093},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.67800000000000005,"15min":0.69399999999999995},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.89100000000000001,"5min":1.1100000000000001,"15min":1.1100000000000001},"last":0.49299999999999999}]},{"osd":6,"last update":"Fri Jul 14 18:10:48 2023","interfaces":[{"interface":"back","average":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":1.069,"5min":1.069,"15min":1.069},"last":0.45800000000000002},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":1.0409999999999999,"5min":1.0409999999999999,"15min":1.0409999999999999},"last":0.57799999999999996}]},{"osd":7,"last update":"Fri Jul 14 18:11:50 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.71199999999999997,"15min":0.72899999999999998},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.92500000000000004,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.68300000000000005},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.71699999999999997,"15min":0.73599999999999999},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.85399999999999998,"5min":1.1890000000000001,"15min":1.1890000000000001},"last":0.59499999999999997}]},{"osd":8,"last update":"Fri Jul 14 18:11:50 2023","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.74399999999999999,"15min":0.76200000000000001},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.79900000000000004,"5min":1.127,"15min":1.127},"last":0.50700000000000001},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.75700000000000001,"15min":0.77500000000000002},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":0.86699999999999999,"5min":1.167,"15min":1.167},"last":0.52600000000000002}]},{"osd":10,"last update":"Fri Jul 14 18:11:08 2023","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.99099999999999999,"5min":0.99099999999999999,"15min":0.99099999999999999},"last":0.65800000000000003},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.0569999999999999,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":0.66600000000000004}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64700000000000002}]}]},{"osd":8,"up_from":56,"seq":240518168612,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27948,"kb_used_data":932,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717204,"statfs":{"total":95995035648,"available":95966416896,"internally_reserved":0,"allocated":954368,"data_stored":454871,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 18:11:29 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.54100000000000004,"15min":0.54200000000000004},"min":{"1min":0.40699999999999997,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.68300000000000005,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.50800000000000001},{"interface":"front","average":{"1min":0.51200000000000001,"5min":0.51900000000000002,"15min":0.52000000000000002},"min":{"1min":0.36199999999999999,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.75,"5min":0.78200000000000003,"15min":0.78200000000000003},"last":0.52800000000000002}]},{"osd":1,"last update":"Fri Jul 14 18:11:29 2023","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.61299999999999999,"15min":0.60999999999999999},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.93100000000000005,"5min":1.036,"15min":1.036},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"min":{"1min":0.40899999999999997,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.89500000000000002,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.64500000000000002}]},{"osd":2,"last update":"Fri Jul 14 18:11:29 2023","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.45700000000000002,"15min":0.45100000000000001},"min":{"1min":0.29199999999999998,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":1.032,"5min":1.032,"15min":1.032},"last":0.80300000000000005},{"interface":"front","average":{"1min":0.49099999999999999,"5min":0.47499999999999998,"15min":0.47299999999999998},"min":{"1min":0.33200000000000002,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":1.0449999999999999,"5min":1.0449999999999999,"15min":1.0449999999999999},"last":0.60099999999999998}]},{"osd":3,"last update":"Fri Jul 14 18:11:29 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.57699999999999996,"15min":0.58299999999999996},"min":{"1min":0.42099999999999999,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.69799999999999995,"5min":0.77300000000000002,"15min":0.77300000000000002},"last":0.68000000000000005},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.58799999999999997,"15min":0.58999999999999997},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.77500000000000002,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.71299999999999997}]},{"osd":4,"last update":"Fri Jul 14 18:11:29 2023","interfaces":[{"interface":"back","average":{"1min":0.77500000000000002,"5min":0.66600000000000004,"15min":0.64800000000000002},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":2.5030000000000001,"5min":2.5030000000000001,"15min":2.5030000000000001},"last":0.75600000000000001},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.63900000000000001,"15min":0.63500000000000001},"min":{"1min":0.40600000000000003,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.66400000000000003}]},{"osd":5,"last update":"Fri Jul 14 18:11:29 2023","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.59299999999999997,"15min":0.58699999999999997},"min":{"1min":0.36099999999999999,"5min":0.316,"15min":0.316},"max":{"1min":0.98199999999999998,"5min":0.98199999999999998,"15min":0.98199999999999998},"last":0.69499999999999995},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.60099999999999998,"15min":0.59899999999999998},"min":{"1min":0.38600000000000001,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.83099999999999996}]},{"osd":6,"last update":"Fri Jul 14 18:11:29 2023","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"min":{"1min":0.45800000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.90700000000000003,"5min":0.90700000000000003,"15min":0.90700000000000003},"last":0.85099999999999998},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.69799999999999995,"15min":0.70299999999999996},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.89700000000000002,"5min":1.008,"15min":1.008},"last":0.78500000000000003}]},{"osd":7,"last update":"Fri Jul 14 18:11:29 2023","interfaces":[{"interface":"back","average":{"1min":0.83999999999999997,"5min":0.73799999999999999,"15min":0.72099999999999997},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":2.5550000000000002,"5min":2.5550000000000002,"15min":2.5550000000000002},"last":0.86699999999999999},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.71799999999999997,"15min":0.71499999999999997},"min":{"1min":0.52000000000000002,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.0529999999999999,"5min":1.0529999999999999,"15min":1.0529999999999999},"last":0.92700000000000005}]},{"osd":9,"last update":"Fri Jul 14 18:11:50 2023","interfaces":[{"interface":"back","average":{"1min":0.80800000000000005,"5min":0.70499999999999996,"15min":0.68799999999999994},"min":{"1min":0.57099999999999995,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.0609999999999999,"5min":1.0609999999999999,"15min":1.0609999999999999},"last":0.88100000000000001},{"interface":"front","average":{"1min":0.94699999999999995,"5min":0.745,"15min":0.71099999999999997},"min":{"1min":0.56299999999999994,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":2.5339999999999998,"5min":2.5339999999999998,"15min":2.5339999999999998},"last":0.89500000000000002}]},{"osd":10,"last update":"Fri Jul 14 18:11:09 2023","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.024,"5min":1.024,"15min":1.024},"last":0.81899999999999995},{"interface":"front","average":{"1min":0.745,"5min":0.745,"15min":0.745},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.006,"5min":1.006,"15min":1.006},"last":0.91800000000000004}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90800000000000003}]}]},{"osd":7,"up_from":49,"seq":210453397543,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28536,"kb_used_data":1520,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716616,"statfs":{"total":95995035648,"available":95965814784,"internally_reserved":0,"allocated":1556480,"data_stored":1051504,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 18:11:06 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.55300000000000005,"15min":0.54600000000000004},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"last":0.38400000000000001},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"min":{"1min":0.35599999999999998,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.77900000000000003,"5min":0.84299999999999997,"15min":0.84299999999999997},"last":0.35599999999999998}]},{"osd":1,"last update":"Fri Jul 14 18:11:06 2023","interfaces":[{"interface":"back","average":{"1min":0.45100000000000001,"5min":0.41899999999999998,"15min":0.41399999999999998},"min":{"1min":0.29699999999999999,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.751,"5min":0.751,"15min":0.751},"last":0.44600000000000001},{"interface":"front","average":{"1min":0.45200000000000001,"5min":0.442,"15min":0.44},"min":{"1min":0.30399999999999999,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.48099999999999998}]},{"osd":2,"last update":"Fri Jul 14 18:11:06 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"min":{"1min":0.39100000000000001,"5min":0.313,"15min":0.313},"max":{"1min":0.70899999999999996,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.69399999999999995},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.60899999999999999,"15min":0.61299999999999999},"min":{"1min":0.40999999999999998,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"last":0.66100000000000003}]},{"osd":3,"last update":"Fri Jul 14 18:11:06 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.60599999999999998,"15min":0.59999999999999998},"min":{"1min":0.432,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.88100000000000001,"5min":0.88100000000000001,"15min":0.88100000000000001},"last":0.68100000000000005}]},{"osd":4,"last update":"Fri Jul 14 18:11:06 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.52300000000000002,"15min":0.52000000000000002},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"last":0.622},{"interface":"front","average":{"1min":0.47199999999999998,"5min":0.496,"15min":0.5},"min":{"1min":0.32100000000000001,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.51500000000000001}]},{"osd":5,"last update":"Fri Jul 14 18:11:06 2023","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.65600000000000003,"15min":0.66400000000000003},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.79000000000000004,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.65000000000000002,"15min":0.65300000000000002},"min":{"1min":0.48899999999999999,"5min":0.38,"15min":0.38},"max":{"1min":0.81799999999999995,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.72599999999999998}]},{"osd":6,"last update":"Fri Jul 14 18:11:06 2023","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.67400000000000004,"15min":0.66800000000000004},"min":{"1min":0.504,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.89400000000000002,"5min":0.89400000000000002,"15min":0.89400000000000002},"last":0.71499999999999997},{"interface":"front","average":{"1min":0.625,"5min":0.66600000000000004,"15min":0.67300000000000004},"min":{"1min":0.40200000000000002,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.82599999999999996,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.59499999999999997}]},{"osd":8,"last update":"Fri Jul 14 18:11:27 2023","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.70899999999999996,"15min":0.70899999999999996},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":0.94399999999999995,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.76300000000000001},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.67700000000000005,"15min":0.67900000000000005},"min":{"1min":0.52400000000000002,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.873,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.753}]},{"osd":9,"last update":"Fri Jul 14 18:11:52 2023","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.66800000000000004,"15min":0.66900000000000004},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.90800000000000003,"5min":0.90800000000000003,"15min":0.90800000000000003},"last":0.81699999999999995},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.747,"15min":0.753},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":0.90800000000000003,"5min":1.0189999999999999,"15min":1.0189999999999999},"last":0.74199999999999999}]},{"osd":10,"last update":"Fri Jul 14 18:11:08 2023","interfaces":[{"interface":"back","average":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.046,"5min":1.046,"15min":1.046},"last":0.80000000000000004},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":0.89500000000000002},"last":0.77500000000000002}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84499999999999997}]}]},{"osd":6,"up_from":44,"seq":188978561068,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27932,"kb_used_data":916,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717220,"statfs":{"total":95995035648,"available":95966433280,"internally_reserved":0,"allocated":937984,"data_stored":450230,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 18:11:46 2023","interfaces":[{"interface":"back","average":{"1min":0.39500000000000002,"5min":0.39900000000000002,"15min":0.39600000000000002},"min":{"1min":0.312,"5min":0.217,"15min":0.217},"max":{"1min":0.51500000000000001,"5min":0.67300000000000004,"15min":0.67300000000000004},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.41599999999999998,"5min":0.41499999999999998,"15min":0.40999999999999998},"min":{"1min":0.26700000000000002,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.58999999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"last":0.63700000000000001}]},{"osd":1,"last update":"Fri Jul 14 18:11:46 2023","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.55900000000000005,"15min":0.53700000000000003},"min":{"1min":0.40999999999999998,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.81000000000000005,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.65500000000000003},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.53300000000000003,"15min":0.51100000000000001},"min":{"1min":0.441,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.75,"5min":1.048,"15min":1.048},"last":0.48399999999999999}]},{"osd":2,"last update":"Fri Jul 14 18:11:46 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.59299999999999997,"15min":0.57999999999999996},"min":{"1min":0.46100000000000002,"5min":0.379,"15min":0.379},"max":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.72599999999999998},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.58599999999999997,"15min":0.58299999999999996},"min":{"1min":0.44500000000000001,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.53900000000000003}]},{"osd":3,"last update":"Fri Jul 14 18:11:46 2023","interfaces":[{"interface":"back","average":{"1min":0.42399999999999999,"5min":0.44600000000000001,"15min":0.443},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.59499999999999997,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.35999999999999999},{"interface":"front","average":{"1min":0.499,"5min":0.5,"15min":0.49199999999999999},"min":{"1min":0.38,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.73799999999999999,"5min":0.83399999999999996,"15min":0.83399999999999996},"last":0.68200000000000005}]},{"osd":4,"last update":"Fri Jul 14 18:11:46 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.626,"15min":0.61099999999999999},"min":{"1min":0.46899999999999997,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.81899999999999995,"5min":1.087,"15min":1.087},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.58699999999999997,"15min":0.57199999999999995},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.85699999999999998,"5min":1.014,"15min":1.014},"last":0.69699999999999995}]},{"osd":5,"last update":"Fri Jul 14 18:11:46 2023","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.67800000000000005,"15min":0.67400000000000004},"min":{"1min":0.435,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.97799999999999998,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.754},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.70399999999999996,"15min":0.69899999999999995},"min":{"1min":0.51500000000000001,"5min":0.443,"15min":0.443},"max":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.71599999999999997}]},{"osd":7,"last update":"Fri Jul 14 18:11:13 2023","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.67000000000000004,"15min":0.66600000000000004},"min":{"1min":0.48199999999999998,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.96299999999999997,"5min":1.03,"15min":1.03},"last":0.77600000000000002},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.71099999999999997,"15min":0.70599999999999996},"min":{"1min":0.52400000000000002,"5min":0.443,"15min":0.443},"max":{"1min":1.0700000000000001,"5min":1.0700000000000001,"15min":1.0700000000000001},"last":0.78400000000000003}]},{"osd":8,"last update":"Fri Jul 14 18:11:30 2023","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.76200000000000001,"15min":0.77600000000000002},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.89600000000000002,"5min":0.99399999999999999,"15min":0.99399999999999999},"last":0.76500000000000001},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.68300000000000005,"15min":0.69399999999999995},"min":{"1min":0.443,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.78500000000000003,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.62}]},{"osd":9,"last update":"Fri Jul 14 18:11:52 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.72499999999999998,"15min":0.74299999999999999},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.88700000000000001,"5min":1.0449999999999999,"15min":1.0449999999999999},"last":1.022},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.76100000000000001,"15min":0.78300000000000003},"min":{"1min":0.505,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.80800000000000005,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.745}]},{"osd":10,"last update":"Fri Jul 14 18:11:13 2023","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":1.026,"5min":1.026,"15min":1.026},"last":0.73499999999999999},{"interface":"front","average":{"1min":0.755,"5min":0.755,"15min":0.755},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":0.99399999999999999,"5min":0.99399999999999999,"15min":0.99399999999999999},"last":0.97099999999999997}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.002}]}]},{"osd":1,"up_from":13,"seq":55834574912,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27992,"kb_used_data":976,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717160,"statfs":{"total":95995035648,"available":95966371840,"internally_reserved":0,"allocated":999424,"data_stored":511824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 18:11:05 2023","interfaces":[{"interface":"back","average":{"1min":0.63700000000000001,"5min":0.55500000000000005,"15min":0.53200000000000003},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.93899999999999995,"5min":0.98899999999999999,"15min":0.98899999999999999},"last":0.42599999999999999},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.54000000000000004,"15min":0.52500000000000002},"min":{"1min":0.35299999999999998,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.58499999999999996}]},{"osd":2,"last update":"Fri Jul 14 18:11:27 2023","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.55500000000000005,"15min":0.50800000000000001},"min":{"1min":0.34699999999999998,"5min":0.314,"15min":0.314},"max":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.64700000000000002},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.53600000000000003,"15min":0.49399999999999999},"min":{"1min":0.371,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"last":0.624}]},{"osd":3,"last update":"Fri Jul 14 18:11:50 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.55900000000000005,"15min":0.52800000000000002},"min":{"1min":0.36199999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.86799999999999999,"5min":0.86799999999999999,"15min":0.86799999999999999},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.61899999999999999,"15min":0.55300000000000005},"min":{"1min":0.439,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":1.0229999999999999,"5min":1.0229999999999999,"15min":1.0229999999999999},"last":0.54900000000000004}]},{"osd":4,"last update":"Fri Jul 14 18:11:05 2023","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.435,"15min":0.40699999999999997},"min":{"1min":0.245,"5min":0.245,"15min":0.245},"max":{"1min":0.879,"5min":0.879,"15min":0.879},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.437,"15min":0.40300000000000002},"min":{"1min":0.29299999999999998,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.77000000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"last":0.46800000000000003}]},{"osd":5,"last update":"Fri Jul 14 18:11:27 2023","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.62,"15min":0.59799999999999998},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.96599999999999997,"5min":0.96599999999999997,"15min":0.96599999999999997},"last":0.72999999999999998},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.64500000000000002,"15min":0.61799999999999999},"min":{"1min":0.434,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"last":0.81599999999999995}]},{"osd":6,"last update":"Fri Jul 14 18:11:46 2023","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.627,"15min":0.61599999999999999},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.80100000000000005,"5min":0.93700000000000006,"15min":0.93700000000000006},"last":0.69799999999999995},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.66100000000000003,"15min":0.64500000000000002},"min":{"1min":0.40500000000000003,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.97299999999999998,"5min":0.97299999999999998,"15min":0.97299999999999998},"last":0.67200000000000004}]},{"osd":7,"last update":"Fri Jul 14 18:11:10 2023","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.61299999999999999,"15min":0.60199999999999998},"min":{"1min":0.36899999999999999,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":1.0640000000000001,"5min":1.0640000000000001,"15min":1.0640000000000001},"last":0.68600000000000005},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.64400000000000002,"15min":0.64000000000000001},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":1.0489999999999999,"5min":1.0489999999999999,"15min":1.0489999999999999},"last":0.79900000000000004}]},{"osd":8,"last update":"Fri Jul 14 18:11:27 2023","interfaces":[{"interface":"back","average":{"1min":0.76900000000000002,"5min":0.752,"15min":0.749},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":1.054,"5min":1.054,"15min":1.054},"last":0.873},{"interface":"front","average":{"1min":0.78500000000000003,"5min":0.76200000000000001,"15min":0.75800000000000001},"min":{"1min":0.48899999999999999,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":1.016,"5min":1.026,"15min":1.026},"last":0.78600000000000003}]},{"osd":9,"last update":"Fri Jul 14 18:11:50 2023","interfaces":[{"interface":"back","average":{"1min":0.74199999999999999,"5min":0.75900000000000001,"15min":0.76200000000000001},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.98199999999999998,"5min":1.01,"15min":1.01},"last":0.76600000000000001},{"interface":"front","average":{"1min":0.78600000000000003,"5min":0.81599999999999995,"15min":0.82099999999999995},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.0149999999999999,"5min":1.0589999999999999,"15min":1.0589999999999999},"last":0.84499999999999997}]},{"osd":10,"last update":"Fri Jul 14 18:11:10 2023","interfaces":[{"interface":"back","average":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.0649999999999999,"5min":1.0649999999999999,"15min":1.0649999999999999},"last":0.74399999999999999},{"interface":"front","average":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.0489999999999999,"5min":1.0489999999999999,"15min":1.0489999999999999},"last":0.85999999999999999}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83099999999999996}]}]},{"osd":0,"up_from":8,"seq":34359738437,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27956,"kb_used_data":940,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717196,"statfs":{"total":95995035648,"available":95966408704,"internally_reserved":0,"allocated":962560,"data_stored":451686,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Jul 14 18:11:06 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.51800000000000002,"15min":0.50800000000000001},"min":{"1min":0.38200000000000001,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.82199999999999995,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.52700000000000002,"15min":0.50700000000000001},"min":{"1min":0.40000000000000002,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.51300000000000001}]},{"osd":2,"last update":"Fri Jul 14 18:11:33 2023","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.58199999999999996,"15min":0.56200000000000006},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.83899999999999997,"5min":0.93799999999999994,"15min":0.93799999999999994},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.54800000000000004,"15min":0.52500000000000002},"min":{"1min":0.371,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.81599999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"last":0.70399999999999996}]},{"osd":3,"last update":"Fri Jul 14 18:09:46 2023","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.436,"15min":0.42599999999999999},"min":{"1min":0.29699999999999999,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"last":0.44500000000000001},{"interface":"front","average":{"1min":0.46700000000000003,"5min":0.42799999999999999,"15min":0.42199999999999999},"min":{"1min":0.33800000000000002,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.59999999999999998,"5min":0.621,"15min":0.621},"last":0.47899999999999998}]},{"osd":4,"last update":"Fri Jul 14 18:11:06 2023","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.52600000000000002,"15min":0.51000000000000001},"min":{"1min":0.38100000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"last":0.65600000000000003},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.57099999999999995,"15min":0.54000000000000004},"min":{"1min":0.46999999999999997,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.83499999999999996,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.64100000000000001}]},{"osd":5,"last update":"Fri Jul 14 18:11:33 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.54900000000000004,"15min":0.52300000000000002},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.71199999999999997,"5min":1.161,"15min":1.161},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.56799999999999995,"15min":0.54800000000000004},"min":{"1min":0.41999999999999998,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.85499999999999998,"5min":0.879,"15min":0.879},"last":0.61699999999999999}]},{"osd":6,"last update":"Fri Jul 14 18:11:48 2023","interfaces":[{"interface":"back","average":{"1min":0.41999999999999998,"5min":0.50700000000000001,"15min":0.503},"min":{"1min":0.28999999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.58999999999999997,"5min":1.0649999999999999,"15min":1.0649999999999999},"last":0.67000000000000004},{"interface":"front","average":{"1min":0.47999999999999998,"5min":0.52100000000000002,"15min":0.51100000000000001},"min":{"1min":0.34499999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.68700000000000006,"5min":1.3460000000000001,"15min":1.3460000000000001},"last":0.52900000000000003}]},{"osd":7,"last update":"Fri Jul 14 18:11:07 2023","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.90100000000000002,"5min":1.204,"15min":1.204},"last":0.72199999999999998},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.72899999999999998,"15min":0.74099999999999999},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.92500000000000004,"5min":1.3080000000000001,"15min":1.3080000000000001},"last":0.73399999999999999}]},{"osd":8,"last update":"Fri Jul 14 18:11:33 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.72599999999999998,"15min":0.74399999999999999},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.81200000000000006,"5min":1.3819999999999999,"15min":1.3819999999999999},"last":0.68400000000000005},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.73199999999999998,"15min":0.746},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":0.92200000000000004,"5min":1.0289999999999999,"15min":1.0289999999999999},"last":0.80900000000000005}]},{"osd":9,"last update":"Fri Jul 14 18:11:48 2023","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.69699999999999995,"15min":0.72399999999999998},"min":{"1min":0.36599999999999999,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.84399999999999997,"5min":1.133,"15min":1.133},"last":0.751},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.69499999999999995,"15min":0.71699999999999997},"min":{"1min":0.435,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.72699999999999998,"5min":1.28,"15min":1.28},"last":0.63200000000000001}]},{"osd":10,"last update":"Fri Jul 14 18:11:07 2023","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":0.97799999999999998,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.76400000000000001},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":0.98299999999999998,"5min":0.98299999999999998,"15min":0.98299999999999998},"last":0.77900000000000003}]},{"osd":11,"last update":"Fri Jul 14 18:11:33 2023","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.78800000000000003},{"interface":"front","average":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":0.90000000000000002,"5min":0.90000000000000002,"15min":0.90000000000000002},"last":0.71199999999999997}]}]},{"osd":2,"up_from":18,"seq":77309411389,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28012,"kb_used_data":996,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717140,"statfs":{"total":95995035648,"available":95966351360,"internally_reserved":0,"allocated":1019904,"data_stored":511996,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 18:11:23 2023","interfaces":[{"interface":"back","average":{"1min":0.46999999999999997,"5min":0.49099999999999999,"15min":0.47899999999999998},"min":{"1min":0.315,"5min":0.255,"15min":0.255},"max":{"1min":0.77500000000000002,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.49199999999999999,"5min":0.47699999999999998,"15min":0.47199999999999998},"min":{"1min":0.33600000000000002,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"last":0.48199999999999998}]},{"osd":1,"last update":"Fri Jul 14 18:11:23 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.53500000000000003,"15min":0.50700000000000001},"min":{"1min":0.41199999999999998,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.97499999999999998,"5min":0.97499999999999998,"15min":0.97499999999999998},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.55000000000000004,"15min":0.502},"min":{"1min":0.44900000000000001,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":1.1279999999999999,"5min":1.1279999999999999,"15min":1.1279999999999999},"last":0.81999999999999995}]},{"osd":3,"last update":"Fri Jul 14 18:11:45 2023","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.57599999999999996,"15min":0.54400000000000004},"min":{"1min":0.44600000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.51800000000000002},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.55700000000000005,"15min":0.54600000000000004},"min":{"1min":0.41899999999999998,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.64100000000000001}]},{"osd":4,"last update":"Fri Jul 14 18:11:07 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.55200000000000005,"15min":0.54700000000000004},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.94399999999999995,"5min":0.94399999999999995,"15min":0.94399999999999995},"last":0.89500000000000002},{"interface":"front","average":{"1min":0.629,"5min":0.56100000000000005,"15min":0.53400000000000003},"min":{"1min":0.40000000000000002,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.80300000000000005,"5min":0.879,"15min":0.879},"last":0.66700000000000004}]},{"osd":5,"last update":"Fri Jul 14 18:11:28 2023","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.53700000000000003,"15min":0.51100000000000001},"min":{"1min":0.35199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":1.1719999999999999,"5min":1.1719999999999999,"15min":1.1719999999999999},"last":0.69999999999999996},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.52700000000000002,"15min":0.52500000000000002},"min":{"1min":0.32800000000000001,"5min":0.316,"15min":0.316},"max":{"1min":1.1499999999999999,"5min":1.1499999999999999,"15min":1.1499999999999999},"last":0.621}]},{"osd":6,"last update":"Fri Jul 14 18:11:52 2023","interfaces":[{"interface":"back","average":{"1min":0.78200000000000003,"5min":0.67000000000000004,"15min":0.65600000000000003},"min":{"1min":0.505,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":2.3170000000000002,"5min":2.3170000000000002,"15min":2.3170000000000002},"last":0.76300000000000001},{"interface":"front","average":{"1min":0.753,"5min":0.623,"15min":0.59899999999999998},"min":{"1min":0.52700000000000002,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":2.3050000000000002,"5min":2.3050000000000002,"15min":2.3050000000000002},"last":0.73999999999999999}]},{"osd":7,"last update":"Fri Jul 14 18:11:07 2023","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.63300000000000001,"15min":0.63},"min":{"1min":0.48399999999999999,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1,"5min":1,"15min":1},"last":0.78400000000000003},{"interface":"front","average":{"1min":0.748,"5min":0.71599999999999997,"15min":0.70999999999999996},"min":{"1min":0.57399999999999995,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":0.90200000000000002,"5min":0.998,"15min":0.998},"last":0.92100000000000004}]},{"osd":8,"last update":"Fri Jul 14 18:11:28 2023","interfaces":[{"interface":"back","average":{"1min":0.83099999999999996,"5min":0.65800000000000003,"15min":0.629},"min":{"1min":0.54800000000000004,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":1.4570000000000001,"5min":1.4570000000000001,"15min":1.4570000000000001},"last":0.86299999999999999},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.59199999999999997,"15min":0.57799999999999996},"min":{"1min":0.46700000000000003,"5min":0.379,"15min":0.379},"max":{"1min":1.2769999999999999,"5min":1.2769999999999999,"15min":1.2769999999999999},"last":0.72299999999999998}]},{"osd":9,"last update":"Fri Jul 14 18:11:52 2023","interfaces":[{"interface":"back","average":{"1min":0.85699999999999998,"5min":0.72699999999999998,"15min":0.70499999999999996},"min":{"1min":0.59599999999999997,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.0960000000000001,"5min":1.0960000000000001,"15min":1.0960000000000001},"last":0.94799999999999995},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.65400000000000003,"15min":0.64200000000000002},"min":{"1min":0.55200000000000005,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":0.90600000000000003,"5min":0.90600000000000003,"15min":0.90600000000000003},"last":0.79600000000000004}]},{"osd":10,"last update":"Fri Jul 14 18:11:12 2023","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.82999999999999996},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"min":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":0.88700000000000001,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.84599999999999997}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.877}]}]},{"osd":3,"up_from":25,"seq":107374182456,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27940,"kb_used_data":924,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717212,"statfs":{"total":95995035648,"available":95966425088,"internally_reserved":0,"allocated":946176,"data_stored":449655,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 18:11:46 2023","interfaces":[{"interface":"back","average":{"1min":0.35299999999999998,"5min":0.372,"15min":0.36799999999999999},"min":{"1min":0.26100000000000001,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":0.56899999999999995,"5min":0.65700000000000003,"15min":0.65700000000000003},"last":0.26200000000000001},{"interface":"front","average":{"1min":0.45300000000000001,"5min":0.41099999999999998,"15min":0.39200000000000002},"min":{"1min":0.248,"5min":0.248,"15min":0.248},"max":{"1min":1.786,"5min":1.786,"15min":1.786},"last":0.29699999999999999}]},{"osd":1,"last update":"Fri Jul 14 18:11:46 2023","interfaces":[{"interface":"back","average":{"1min":0.68600000000000005,"5min":0.56000000000000005,"15min":0.51400000000000001},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":3.4369999999999998,"5min":3.4369999999999998,"15min":3.4369999999999998},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.55400000000000005,"15min":0.52600000000000002},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.71999999999999997,"5min":0.90400000000000003,"15min":0.90400000000000003},"last":0.59999999999999998}]},{"osd":2,"last update":"Fri Jul 14 18:11:46 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.58999999999999997,"15min":0.57399999999999995},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":3.4540000000000002,"5min":3.4540000000000002,"15min":3.4540000000000002},"last":0.498},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.57099999999999995,"15min":0.56499999999999995},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.71199999999999997,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.55500000000000005}]},{"osd":4,"last update":"Fri Jul 14 18:11:06 2023","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.57099999999999995,"15min":0.54000000000000004},"min":{"1min":0.39300000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.51800000000000002},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.58099999999999996,"15min":0.56399999999999995},"min":{"1min":0.42299999999999999,"5min":0.38,"15min":0.38},"max":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.48799999999999999}]},{"osd":5,"last update":"Fri Jul 14 18:11:30 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.60499999999999998,"15min":0.59699999999999998},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.84799999999999998,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.47399999999999998},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.58499999999999996,"15min":0.59099999999999997},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.70499999999999996,"5min":0.875,"15min":0.875},"last":0.54700000000000004}]},{"osd":6,"last update":"Fri Jul 14 18:11:46 2023","interfaces":[{"interface":"back","average":{"1min":0.48299999999999998,"5min":0.53200000000000003,"15min":0.52800000000000002},"min":{"1min":0.33300000000000002,"5min":0.317,"15min":0.317},"max":{"1min":0.77800000000000002,"5min":1.028,"15min":1.028},"last":0.41099999999999998},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.59399999999999997,"15min":0.59099999999999997},"min":{"1min":0.39600000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.92300000000000004,"5min":1.0669999999999999,"15min":1.0669999999999999},"last":0.376}]},{"osd":7,"last update":"Fri Jul 14 18:11:08 2023","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.71399999999999997,"15min":0.71599999999999997},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.008,"5min":1.014,"15min":1.014},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.66800000000000004,"15min":0.67600000000000005},"min":{"1min":0.41199999999999998,"5min":0.376,"15min":0.376},"max":{"1min":0.89100000000000001,"5min":1.131,"15min":1.131},"last":0.46300000000000002}]},{"osd":8,"last update":"Fri Jul 14 18:10:26 2023","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.046,"5min":1.046,"15min":1.046},"last":0.48299999999999998}]},{"osd":9,"last update":"Fri Jul 14 18:11:50 2023","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":0.57699999999999996,"15min":0.58799999999999997},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.75900000000000001,"5min":0.98999999999999999,"15min":0.98999999999999999},"last":0.32900000000000001},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.70699999999999996,"15min":0.72299999999999998},"min":{"1min":0.38200000000000001,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.96299999999999997,"5min":0.997,"15min":0.997},"last":0.441}]},{"osd":10,"last update":"Fri Jul 14 18:11:08 2023","interfaces":[{"interface":"back","average":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"min":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":1.0429999999999999,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.628},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":0.95199999999999996,"5min":0.95199999999999996,"15min":0.95199999999999996},"last":0.53200000000000003}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58199999999999996}]}]},{"osd":4,"up_from":32,"seq":137438953524,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27940,"kb_used_data":924,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717212,"statfs":{"total":95995035648,"available":95966425088,"internally_reserved":0,"allocated":946176,"data_stored":454694,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 18:10:07 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.49099999999999999,"15min":0.48099999999999998},"min":{"1min":0.32100000000000001,"5min":0.313,"15min":0.313},"max":{"1min":1.347,"5min":1.347,"15min":1.347},"last":0.44400000000000001},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.50900000000000001,"15min":0.501},"min":{"1min":0.312,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":1.417,"5min":1.417,"15min":1.417},"last":0.53500000000000003}]},{"osd":1,"last update":"Fri Jul 14 18:11:10 2023","interfaces":[{"interface":"back","average":{"1min":0.432,"5min":0.39100000000000001,"15min":0.374},"min":{"1min":0.27500000000000002,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.68700000000000006,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.47499999999999998},{"interface":"front","average":{"1min":0.433,"5min":0.38600000000000001,"15min":0.36199999999999999},"min":{"1min":0.29099999999999998,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.626,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.503}]},{"osd":2,"last update":"Fri Jul 14 18:11:10 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.54700000000000004,"15min":0.52900000000000003},"min":{"1min":0.39600000000000002,"5min":0.374,"15min":0.374},"max":{"1min":0.72799999999999998,"5min":1.4019999999999999,"15min":1.4019999999999999},"last":0.753},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.55900000000000005,"15min":0.53400000000000003},"min":{"1min":0.38,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.82199999999999995,"5min":1.4750000000000001,"15min":1.4750000000000001},"last":0.66900000000000004}]},{"osd":3,"last update":"Fri Jul 14 18:11:10 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.52400000000000002,"15min":0.49199999999999999},"min":{"1min":0.38200000000000001,"5min":0.318,"15min":0.318},"max":{"1min":1.0309999999999999,"5min":1.054,"15min":1.054},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.54400000000000004,"15min":0.52800000000000002},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.84799999999999998,"5min":0.95299999999999996,"15min":0.95299999999999996},"last":0.53800000000000003}]},{"osd":5,"last update":"Fri Jul 14 18:11:34 2023","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.58599999999999997,"15min":0.54600000000000004},"min":{"1min":0.45700000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.875,"5min":1.177,"15min":1.177},"last":0.89500000000000002},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.60999999999999999,"15min":0.56999999999999995},"min":{"1min":0.41699999999999998,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.876,"5min":1.1220000000000001,"15min":1.1220000000000001},"last":0.77400000000000002}]},{"osd":6,"last update":"Fri Jul 14 18:11:51 2023","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.64200000000000002,"15min":0.61099999999999999},"min":{"1min":0.47599999999999998,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.83499999999999996,"5min":1.101,"15min":1.101},"last":0.70199999999999996},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.63400000000000001,"15min":0.61199999999999999},"min":{"1min":0.52300000000000002,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.78300000000000003,"5min":1.446,"15min":1.446},"last":0.58299999999999996}]},{"osd":7,"last update":"Fri Jul 14 18:11:10 2023","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.58599999999999997,"15min":0.57399999999999995},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.92200000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.63},{"interface":"front","average":{"1min":0.68200000000000005,"5min":0.60999999999999999,"15min":0.59799999999999998},"min":{"1min":0.42999999999999999,"5min":0.316,"15min":0.316},"max":{"1min":1.004,"5min":1.0189999999999999,"15min":1.0189999999999999},"last":0.73899999999999999}]},{"osd":8,"last update":"Fri Jul 14 18:11:29 2023","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.68799999999999994,"15min":0.69099999999999995},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.84099999999999997,"5min":1.3740000000000001,"15min":1.3740000000000001},"last":0.79500000000000004},{"interface":"front","average":{"1min":0.79700000000000004,"5min":0.78300000000000003,"15min":0.78100000000000003},"min":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":0.98099999999999998,"5min":1.147,"15min":1.147},"last":0.85399999999999998}]},{"osd":9,"last update":"Fri Jul 14 18:11:51 2023","interfaces":[{"interface":"back","average":{"1min":0.78500000000000003,"5min":0.81399999999999995,"15min":0.81899999999999995},"min":{"1min":0.63800000000000001,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":0.98499999999999999,"5min":1.171,"15min":1.171},"last":0.80800000000000005},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.70999999999999996,"15min":0.71699999999999997},"min":{"1min":0.51300000000000001,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":0.85199999999999998,"5min":1.304,"15min":1.304},"last":0.60399999999999998}]},{"osd":10,"last update":"Fri Jul 14 18:11:10 2023","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.016,"5min":1.016,"15min":1.016},"last":0.72299999999999998},{"interface":"front","average":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"min":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"max":{"1min":1.196,"5min":1.196,"15min":1.196},"last":0.876}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83799999999999997}]}]},{"osd":5,"up_from":37,"seq":158913789999,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28544,"kb_used_data":1528,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716608,"statfs":{"total":95995035648,"available":95965806592,"internally_reserved":0,"allocated":1564672,"data_stored":1046792,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 18:11:30 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.52200000000000002,"15min":0.51400000000000001},"min":{"1min":0.435,"5min":0.318,"15min":0.318},"max":{"1min":0.74099999999999999,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.51300000000000001,"15min":0.499},"min":{"1min":0.32900000000000001,"5min":0.307,"15min":0.307},"max":{"1min":0.77000000000000002,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.51300000000000001}]},{"osd":1,"last update":"Fri Jul 14 18:11:30 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.55600000000000005,"15min":0.53400000000000003},"min":{"1min":0.371,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.88400000000000001,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.629,"5min":0.57199999999999995,"15min":0.55000000000000004},"min":{"1min":0.46300000000000002,"5min":0.374,"15min":0.374},"max":{"1min":0.90400000000000003,"5min":0.90400000000000003,"15min":0.90400000000000003},"last":0.75800000000000001}]},{"osd":2,"last update":"Fri Jul 14 18:11:30 2023","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.41799999999999998,"15min":0.38100000000000001},"min":{"1min":0.30299999999999999,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.40500000000000003},{"interface":"front","average":{"1min":0.51700000000000002,"5min":0.433,"15min":0.40300000000000002},"min":{"1min":0.34499999999999997,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.751,"5min":0.751,"15min":0.751},"last":0.44400000000000001}]},{"osd":3,"last update":"Fri Jul 14 18:11:30 2023","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.53600000000000003,"15min":0.51700000000000002},"min":{"1min":0.40600000000000003,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"last":0.64300000000000002},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.53200000000000003,"15min":0.50700000000000001},"min":{"1min":0.38500000000000001,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"last":0.57999999999999996}]},{"osd":4,"last update":"Fri Jul 14 18:11:30 2023","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.59599999999999997,"15min":0.57599999999999996},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.72799999999999998},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.59899999999999998,"15min":0.57499999999999996},"min":{"1min":0.40899999999999997,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":1.1379999999999999,"5min":1.1379999999999999,"15min":1.1379999999999999},"last":0.77400000000000002}]},{"osd":6,"last update":"Fri Jul 14 18:11:50 2023","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.59699999999999998,"15min":0.57799999999999996},"min":{"1min":0.40000000000000002,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.93400000000000005,"5min":1.0289999999999999,"15min":1.0289999999999999},"last":0.70999999999999996},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.60899999999999999,"15min":0.59299999999999997},"min":{"1min":0.38700000000000001,"5min":0.371,"15min":0.371},"max":{"1min":0.96599999999999997,"5min":0.96599999999999997,"15min":0.96599999999999997},"last":0.63}]},{"osd":7,"last update":"Fri Jul 14 18:11:10 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.65400000000000003,"15min":0.64500000000000002},"min":{"1min":0.52000000000000002,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.0669999999999999,"5min":1.0669999999999999,"15min":1.0669999999999999},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.68200000000000005,"15min":0.67700000000000005},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":1.081,"5min":1.081,"15min":1.081},"last":0.68899999999999995}]},{"osd":8,"last update":"Fri Jul 14 18:11:30 2023","interfaces":[{"interface":"back","average":{"1min":0.70999999999999996,"5min":0.67500000000000004,"15min":0.66900000000000004},"min":{"1min":0.501,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.99399999999999999,"5min":0.99399999999999999,"15min":0.99399999999999999},"last":0.80600000000000005},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.65500000000000003,"15min":0.64900000000000002},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":1.1859999999999999,"5min":1.1859999999999999,"15min":1.1859999999999999},"last":0.82199999999999995}]},{"osd":9,"last update":"Fri Jul 14 18:11:50 2023","interfaces":[{"interface":"back","average":{"1min":0.73999999999999999,"5min":0.746,"15min":0.747},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":1.0429999999999999,"5min":1.2350000000000001,"15min":1.2350000000000001},"last":0.85199999999999998},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.73399999999999999,"15min":0.73399999999999999},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":1.0920000000000001,"5min":1.0920000000000001,"15min":1.0920000000000001},"last":0.79000000000000004}]},{"osd":10,"last update":"Fri Jul 14 18:11:10 2023","interfaces":[{"interface":"back","average":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":1.014,"5min":1.014,"15min":1.014},"last":0.83599999999999997},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.0489999999999999,"5min":1.0489999999999999,"15min":1.0489999999999999},"last":0.74299999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2130,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":62541,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":62713,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1042,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":2772,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":674,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":3388,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":1500,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":62915,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1144,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-14T18:12:09.806 DEBUG:teuthology.orchestra.run.smithi163:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81c9387d2e7576da065747ec9c16d1c7d69016ec shell --fsid bf7326ec-2270-11ee-9b33-001a4aab830c -- ceph pg dump --format=json 2023-07-14T18:12:10.361 INFO:teuthology.orchestra.run.smithi163.stderr:Inferring config /var/lib/ceph/bf7326ec-2270-11ee-9b33-001a4aab830c/mon.a/config 2023-07-14T18:12:10.775 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:12:10 smithi172 ceph-mon[97983]: from='client.15126 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-07-14T18:12:10.776 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:12:10 smithi172 ceph-mon[97983]: pgmap v281: 129 pgs: 129 active+clean; 643 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 170 B/s wr, 11 op/s 2023-07-14T18:12:10.776 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:12:10 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-14T18:12:10.924 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:12:10 smithi184 ceph-mon[98481]: from='client.15126 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-07-14T18:12:10.925 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:12:10 smithi184 ceph-mon[98481]: pgmap v281: 129 pgs: 129 active+clean; 643 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 170 B/s wr, 11 op/s 2023-07-14T18:12:10.925 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:12:10 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-14T18:12:10.967 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:12:10 smithi163 ceph-mon[96576]: from='client.15126 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-07-14T18:12:10.967 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:12:10 smithi163 ceph-mon[96576]: pgmap v281: 129 pgs: 129 active+clean; 643 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 170 B/s wr, 11 op/s 2023-07-14T18:12:10.967 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:12:10 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-14T18:12:11.895 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:11.823+0000 7f1f9875d700 1 -- 172.21.15.163:0/2779556009 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f1f90103f50 msgr2=0x7f1f9010bb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:12:11.895 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:11.823+0000 7f1f9875d700 1 --2- 172.21.15.163:0/2779556009 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f1f90103f50 0x7f1f9010bb10 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f1f8800b0d0 tx=0x7f1f8800b3e0 comp rx=0 tx=0).stop 2023-07-14T18:12:11.896 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:11.823+0000 7f1f9875d700 1 -- 172.21.15.163:0/2779556009 shutdown_connections 2023-07-14T18:12:11.896 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:11.823+0000 7f1f9875d700 1 --2- 172.21.15.163:0/2779556009 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f1f90103f50 0x7f1f9010bb10 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:11.896 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:11.823+0000 7f1f9875d700 1 --2- 172.21.15.163:0/2779556009 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1f900ff580 0x7f1f900ff950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:11.896 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:11.823+0000 7f1f9875d700 1 --2- 172.21.15.163:0/2779556009 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1f900fff20 0x7f1f90103820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:11.896 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:11.823+0000 7f1f9875d700 1 -- 172.21.15.163:0/2779556009 >> 172.21.15.163:0/2779556009 conn(0x7f1f90075280 msgr2=0x7f1f90075680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:12:11.896 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:11.823+0000 7f1f9875d700 1 -- 172.21.15.163:0/2779556009 shutdown_connections 2023-07-14T18:12:11.897 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:11.823+0000 7f1f9875d700 1 -- 172.21.15.163:0/2779556009 wait complete. 2023-07-14T18:12:11.897 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:11.824+0000 7f1f9875d700 1 Processor -- start 2023-07-14T18:12:11.897 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:11.824+0000 7f1f9875d700 1 -- start start 2023-07-14T18:12:11.897 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:11.824+0000 7f1f9875d700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f1f900ff580 0x7f1f90196c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:12:11.897 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:11.824+0000 7f1f9875d700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1f900fff20 0x7f1f90197160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:12:11.897 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:11.824+0000 7f1f9875d700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1f90103f50 0x7f1f901a1ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:12:11.897 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:11.824+0000 7f1f9875d700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f90197aa0 con 0x7f1f900ff580 2023-07-14T18:12:11.898 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:11.824+0000 7f1f9875d700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f901a21e0 con 0x7f1f90103f50 2023-07-14T18:12:11.898 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:11.824+0000 7f1f9875d700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f901a23a0 con 0x7f1f900fff20 2023-07-14T18:12:11.898 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:11.824+0000 7f1f964f9700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f1f900ff580 0x7f1f90196c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:12:11.898 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:11.825+0000 7f1f964f9700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f1f900ff580 0x7f1f90196c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:56772/0 (socket says 172.21.15.163:56772) 2023-07-14T18:12:11.898 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:11.825+0000 7f1f964f9700 1 -- 172.21.15.163:0/3591283747 learned_addr learned my addr 172.21.15.163:0/3591283747 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:12:11.898 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:11.825+0000 7f1f95cf8700 1 --2- 172.21.15.163:0/3591283747 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1f900fff20 0x7f1f90197160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:12:11.898 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:11.825+0000 7f1f96cfa700 1 --2- 172.21.15.163:0/3591283747 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1f90103f50 0x7f1f901a1ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:12:11.899 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:11.825+0000 7f1f964f9700 1 -- 172.21.15.163:0/3591283747 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1f900fff20 msgr2=0x7f1f90197160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:12:11.899 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:11.825+0000 7f1f964f9700 1 --2- 172.21.15.163:0/3591283747 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1f900fff20 0x7f1f90197160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:11.899 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:11.825+0000 7f1f964f9700 1 -- 172.21.15.163:0/3591283747 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1f90103f50 msgr2=0x7f1f901a1ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:12:11.899 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:11.825+0000 7f1f964f9700 1 --2- 172.21.15.163:0/3591283747 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1f90103f50 0x7f1f901a1ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:11.899 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:11.825+0000 7f1f964f9700 1 -- 172.21.15.163:0/3591283747 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f88009d00 con 0x7f1f900ff580 2023-07-14T18:12:11.899 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:11.825+0000 7f1f964f9700 1 --2- 172.21.15.163:0/3591283747 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f1f900ff580 0x7f1f90196c20 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f1f8000d950 tx=0x7f1f8000dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:12:11.899 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:11.825+0000 7f1f877fe700 1 -- 172.21.15.163:0/3591283747 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f8000f890 con 0x7f1f900ff580 2023-07-14T18:12:11.900 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:11.825+0000 7f1f877fe700 1 -- 172.21.15.163:0/3591283747 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f1f8000fe80 con 0x7f1f900ff580 2023-07-14T18:12:11.900 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:11.825+0000 7f1f9875d700 1 -- 172.21.15.163:0/3591283747 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1f901a2680 con 0x7f1f900ff580 2023-07-14T18:12:11.900 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:11.825+0000 7f1f877fe700 1 -- 172.21.15.163:0/3591283747 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f8000e3b0 con 0x7f1f900ff580 2023-07-14T18:12:11.900 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:11.825+0000 7f1f9875d700 1 -- 172.21.15.163:0/3591283747 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1f901a2bd0 con 0x7f1f900ff580 2023-07-14T18:12:11.900 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:11.826+0000 7f1f9875d700 1 -- 172.21.15.163:0/3591283747 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1f9004e340 con 0x7f1f900ff580 2023-07-14T18:12:11.900 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:11.827+0000 7f1f877fe700 1 -- 172.21.15.163:0/3591283747 <== mon.0 v2:172.21.15.163:3300/0 4 ==== mgrmap(e 17) v1 ==== 135767+0+0 (secure 0 0 0) 0x7f1f80010460 con 0x7f1f900ff580 2023-07-14T18:12:11.900 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:11.828+0000 7f1f877fe700 1 --2- 172.21.15.163:0/3591283747 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f1f7c0a1260 0x7f1f7c0a3710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:12:11.901 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:11.828+0000 7f1f877fe700 1 -- 172.21.15.163:0/3591283747 <== mon.0 v2:172.21.15.163:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 8730+0+0 (secure 0 0 0) 0x7f1f800cc980 con 0x7f1f900ff580 2023-07-14T18:12:11.901 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:11.828+0000 7f1f95cf8700 1 --2- 172.21.15.163:0/3591283747 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f1f7c0a1260 0x7f1f7c0a3710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:12:11.901 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:11.828+0000 7f1f95cf8700 1 --2- 172.21.15.163:0/3591283747 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f1f7c0a1260 0x7f1f7c0a3710 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f1f900feae0 tx=0x7f1f8c009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:12:11.901 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:11.831+0000 7f1f877fe700 1 -- 172.21.15.163:0/3591283747 <== mon.0 v2:172.21.15.163:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178025 (secure 0 0 0) 0x7f1f80095d80 con 0x7f1f900ff580 2023-07-14T18:12:12.064 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:12.025+0000 7f1f9875d700 1 -- 172.21.15.163:0/3591283747 --> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f1f900fc3f0 con 0x7f1f7c0a1260 2023-07-14T18:12:12.077 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:12.038+0000 7f1f877fe700 1 -- 172.21.15.163:0/3591283747 <== mgr.14152 v2:172.21.15.163:6800/1949590926 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+423651 (secure 0 0 0) 0x7f1f900fc3f0 con 0x7f1f7c0a1260 2023-07-14T18:12:12.081 INFO:teuthology.orchestra.run.smithi163.stdout: 2023-07-14T18:12:12.084 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:12.042+0000 7f1f9875d700 1 -- 172.21.15.163:0/3591283747 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f1f7c0a1260 msgr2=0x7f1f7c0a3710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:12:12.084 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:12.042+0000 7f1f9875d700 1 --2- 172.21.15.163:0/3591283747 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f1f7c0a1260 0x7f1f7c0a3710 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f1f900feae0 tx=0x7f1f8c009260 comp rx=0 tx=0).stop 2023-07-14T18:12:12.084 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:12.042+0000 7f1f9875d700 1 -- 172.21.15.163:0/3591283747 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f1f900ff580 msgr2=0x7f1f90196c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:12:12.084 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:12.042+0000 7f1f9875d700 1 --2- 172.21.15.163:0/3591283747 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f1f900ff580 0x7f1f90196c20 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f1f8000d950 tx=0x7f1f8000dc60 comp rx=0 tx=0).stop 2023-07-14T18:12:12.084 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:12.042+0000 7f1f9875d700 1 -- 172.21.15.163:0/3591283747 shutdown_connections 2023-07-14T18:12:12.084 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:12.042+0000 7f1f9875d700 1 --2- 172.21.15.163:0/3591283747 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f1f7c0a1260 0x7f1f7c0a3710 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:12.085 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:12.042+0000 7f1f9875d700 1 --2- 172.21.15.163:0/3591283747 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1f90103f50 0x7f1f901a1ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:12.085 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:12.042+0000 7f1f9875d700 1 --2- 172.21.15.163:0/3591283747 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f1f900ff580 0x7f1f90196c20 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:12.085 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:12.042+0000 7f1f9875d700 1 --2- 172.21.15.163:0/3591283747 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1f900fff20 0x7f1f90197160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:12.085 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:12.042+0000 7f1f9875d700 1 -- 172.21.15.163:0/3591283747 >> 172.21.15.163:0/3591283747 conn(0x7f1f90075280 msgr2=0x7f1f900fbce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:12:12.085 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:12.042+0000 7f1f9875d700 1 -- 172.21.15.163:0/3591283747 shutdown_connections 2023-07-14T18:12:12.085 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:12.042+0000 7f1f9875d700 1 -- 172.21.15.163:0/3591283747 wait complete. 2023-07-14T18:12:12.085 INFO:teuthology.orchestra.run.smithi163.stderr:dumped all 2023-07-14T18:12:12.521 INFO:teuthology.orchestra.run.smithi163.stdout:{"pg_ready":true,"pg_map":{"version":282,"stamp":"2023-07-14T18:12:11.420560+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":658071,"num_objects":102,"num_object_clones":0,"num_object_copies":308,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":543,"num_read_kb":391,"num_write":416,"num_write_kb":3073,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":344,"ondisk_log_size":344,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":419,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":337296,"kb_used_data":13104,"kb_used_omap":20,"kb_used_meta":324075,"kb_avail":1124604528,"statfs":{"total":1151940427776,"available":1151595036672,"internally_reserved":0,"allocated":13418496,"data_stored":7399426,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":21372,"internal_metadata":331852932},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1652,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":111,"num_read_kb":52,"num_write":1,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003010"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":20,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:11:15.117313+0000","last_change":"2023-07-14T18:11:09.713546+0000","last_active":"2023-07-14T18:11:15.117313+0000","last_peered":"2023-07-14T18:11:15.117313+0000","last_clean":"2023-07-14T18:11:15.117313+0000","last_became_active":"2023-07-14T18:11:09.713170+0000","last_became_peered":"2023-07-14T18:11:09.713170+0000","last_unstale":"2023-07-14T18:11:15.117313+0000","last_undegraded":"2023-07-14T18:11:15.117313+0000","last_fullsized":"2023-07-14T18:11:15.117313+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_clean_scrub_stamp":"2023-07-14T18:11:08.667354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T03:18:23.645436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":20,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:11:14.884660+0000","last_change":"2023-07-14T18:11:09.711619+0000","last_active":"2023-07-14T18:11:14.884660+0000","last_peered":"2023-07-14T18:11:14.884660+0000","last_clean":"2023-07-14T18:11:14.884660+0000","last_became_active":"2023-07-14T18:11:09.711249+0000","last_became_peered":"2023-07-14T18:11:09.711249+0000","last_unstale":"2023-07-14T18:11:14.884660+0000","last_undegraded":"2023-07-14T18:11:14.884660+0000","last_fullsized":"2023-07-14T18:11:14.884660+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_clean_scrub_stamp":"2023-07-14T18:11:08.667354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:15:46.939069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":20,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:11:14.884197+0000","last_change":"2023-07-14T18:11:09.705557+0000","last_active":"2023-07-14T18:11:14.884197+0000","last_peered":"2023-07-14T18:11:14.884197+0000","last_clean":"2023-07-14T18:11:14.884197+0000","last_became_active":"2023-07-14T18:11:09.705179+0000","last_became_peered":"2023-07-14T18:11:09.705179+0000","last_unstale":"2023-07-14T18:11:14.884197+0000","last_undegraded":"2023-07-14T18:11:14.884197+0000","last_fullsized":"2023-07-14T18:11:14.884197+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_clean_scrub_stamp":"2023-07-14T18:11:08.667354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:37:15.401517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":20,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:11:14.885864+0000","last_change":"2023-07-14T18:11:09.709234+0000","last_active":"2023-07-14T18:11:14.885864+0000","last_peered":"2023-07-14T18:11:14.885864+0000","last_clean":"2023-07-14T18:11:14.885864+0000","last_became_active":"2023-07-14T18:11:09.708855+0000","last_became_peered":"2023-07-14T18:11:09.708855+0000","last_unstale":"2023-07-14T18:11:14.885864+0000","last_undegraded":"2023-07-14T18:11:14.885864+0000","last_fullsized":"2023-07-14T18:11:14.885864+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_clean_scrub_stamp":"2023-07-14T18:11:08.667354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T03:28:37.657033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":20,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:11:14.884907+0000","last_change":"2023-07-14T18:11:09.704301+0000","last_active":"2023-07-14T18:11:14.884907+0000","last_peered":"2023-07-14T18:11:14.884907+0000","last_clean":"2023-07-14T18:11:14.884907+0000","last_became_active":"2023-07-14T18:11:09.703961+0000","last_became_peered":"2023-07-14T18:11:09.703961+0000","last_unstale":"2023-07-14T18:11:14.884907+0000","last_undegraded":"2023-07-14T18:11:14.884907+0000","last_fullsized":"2023-07-14T18:11:14.884907+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_clean_scrub_stamp":"2023-07-14T18:11:08.667354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T03:07:18.579761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":20,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:11:14.791451+0000","last_change":"2023-07-14T18:11:09.717667+0000","last_active":"2023-07-14T18:11:14.791451+0000","last_peered":"2023-07-14T18:11:14.791451+0000","last_clean":"2023-07-14T18:11:14.791451+0000","last_became_active":"2023-07-14T18:11:09.717146+0000","last_became_peered":"2023-07-14T18:11:09.717146+0000","last_unstale":"2023-07-14T18:11:14.791451+0000","last_undegraded":"2023-07-14T18:11:14.791451+0000","last_fullsized":"2023-07-14T18:11:14.791451+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_clean_scrub_stamp":"2023-07-14T18:11:08.667354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T05:43:55.497012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":18,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:11:14.884950+0000","last_change":"2023-07-14T18:11:09.713638+0000","last_active":"2023-07-14T18:11:14.884950+0000","last_peered":"2023-07-14T18:11:14.884950+0000","last_clean":"2023-07-14T18:11:14.884950+0000","last_became_active":"2023-07-14T18:11:09.707940+0000","last_became_peered":"2023-07-14T18:11:09.707940+0000","last_unstale":"2023-07-14T18:11:14.884950+0000","last_undegraded":"2023-07-14T18:11:14.884950+0000","last_fullsized":"2023-07-14T18:11:14.884950+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_clean_scrub_stamp":"2023-07-14T18:11:08.667354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:04:22.228548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":20,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:11:14.885659+0000","last_change":"2023-07-14T18:11:09.709804+0000","last_active":"2023-07-14T18:11:14.885659+0000","last_peered":"2023-07-14T18:11:14.885659+0000","last_clean":"2023-07-14T18:11:14.885659+0000","last_became_active":"2023-07-14T18:11:09.709385+0000","last_became_peered":"2023-07-14T18:11:09.709385+0000","last_unstale":"2023-07-14T18:11:14.885659+0000","last_undegraded":"2023-07-14T18:11:14.885659+0000","last_fullsized":"2023-07-14T18:11:14.885659+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_clean_scrub_stamp":"2023-07-14T18:11:08.667354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T05:15:54.972411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":20,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:11:14.885346+0000","last_change":"2023-07-14T18:11:09.710410+0000","last_active":"2023-07-14T18:11:14.885346+0000","last_peered":"2023-07-14T18:11:14.885346+0000","last_clean":"2023-07-14T18:11:14.885346+0000","last_became_active":"2023-07-14T18:11:09.710049+0000","last_became_peered":"2023-07-14T18:11:09.710049+0000","last_unstale":"2023-07-14T18:11:14.885346+0000","last_undegraded":"2023-07-14T18:11:14.885346+0000","last_fullsized":"2023-07-14T18:11:14.885346+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_clean_scrub_stamp":"2023-07-14T18:11:08.667354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:01:39.122213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":20,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:11:14.791867+0000","last_change":"2023-07-14T18:11:09.717681+0000","last_active":"2023-07-14T18:11:14.791867+0000","last_peered":"2023-07-14T18:11:14.791867+0000","last_clean":"2023-07-14T18:11:14.791867+0000","last_became_active":"2023-07-14T18:11:09.717209+0000","last_became_peered":"2023-07-14T18:11:09.717209+0000","last_unstale":"2023-07-14T18:11:14.791867+0000","last_undegraded":"2023-07-14T18:11:14.791867+0000","last_fullsized":"2023-07-14T18:11:14.791867+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_clean_scrub_stamp":"2023-07-14T18:11:08.667354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T02:14:23.927899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":18,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:11:14.885431+0000","last_change":"2023-07-14T18:11:09.716890+0000","last_active":"2023-07-14T18:11:14.885431+0000","last_peered":"2023-07-14T18:11:14.885431+0000","last_clean":"2023-07-14T18:11:14.885431+0000","last_became_active":"2023-07-14T18:11:09.708773+0000","last_became_peered":"2023-07-14T18:11:09.708773+0000","last_unstale":"2023-07-14T18:11:14.885431+0000","last_undegraded":"2023-07-14T18:11:14.885431+0000","last_fullsized":"2023-07-14T18:11:14.885431+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_clean_scrub_stamp":"2023-07-14T18:11:08.667354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T02:07:24.275839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":20,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:11:14.885714+0000","last_change":"2023-07-14T18:11:09.715119+0000","last_active":"2023-07-14T18:11:14.885714+0000","last_peered":"2023-07-14T18:11:14.885714+0000","last_clean":"2023-07-14T18:11:14.885714+0000","last_became_active":"2023-07-14T18:11:09.714680+0000","last_became_peered":"2023-07-14T18:11:09.714680+0000","last_unstale":"2023-07-14T18:11:14.885714+0000","last_undegraded":"2023-07-14T18:11:14.885714+0000","last_fullsized":"2023-07-14T18:11:14.885714+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_clean_scrub_stamp":"2023-07-14T18:11:08.667354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:57:07.824122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":20,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:11:14.791064+0000","last_change":"2023-07-14T18:11:09.711173+0000","last_active":"2023-07-14T18:11:14.791064+0000","last_peered":"2023-07-14T18:11:14.791064+0000","last_clean":"2023-07-14T18:11:14.791064+0000","last_became_active":"2023-07-14T18:11:09.710849+0000","last_became_peered":"2023-07-14T18:11:09.710849+0000","last_unstale":"2023-07-14T18:11:14.791064+0000","last_undegraded":"2023-07-14T18:11:14.791064+0000","last_fullsized":"2023-07-14T18:11:14.791064+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_clean_scrub_stamp":"2023-07-14T18:11:08.667354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:51:55.610741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":20,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:11:14.884136+0000","last_change":"2023-07-14T18:11:09.710448+0000","last_active":"2023-07-14T18:11:14.884136+0000","last_peered":"2023-07-14T18:11:14.884136+0000","last_clean":"2023-07-14T18:11:14.884136+0000","last_became_active":"2023-07-14T18:11:09.709804+0000","last_became_peered":"2023-07-14T18:11:09.709804+0000","last_unstale":"2023-07-14T18:11:14.884136+0000","last_undegraded":"2023-07-14T18:11:14.884136+0000","last_fullsized":"2023-07-14T18:11:14.884136+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_clean_scrub_stamp":"2023-07-14T18:11:08.667354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:56:21.024882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":20,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:11:14.884058+0000","last_change":"2023-07-14T18:11:09.714917+0000","last_active":"2023-07-14T18:11:14.884058+0000","last_peered":"2023-07-14T18:11:14.884058+0000","last_clean":"2023-07-14T18:11:14.884058+0000","last_became_active":"2023-07-14T18:11:09.714655+0000","last_became_peered":"2023-07-14T18:11:09.714655+0000","last_unstale":"2023-07-14T18:11:14.884058+0000","last_undegraded":"2023-07-14T18:11:14.884058+0000","last_fullsized":"2023-07-14T18:11:14.884058+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_clean_scrub_stamp":"2023-07-14T18:11:08.667354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:22:10.112893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":20,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:11:14.884405+0000","last_change":"2023-07-14T18:11:09.709149+0000","last_active":"2023-07-14T18:11:14.884405+0000","last_peered":"2023-07-14T18:11:14.884405+0000","last_clean":"2023-07-14T18:11:14.884405+0000","last_became_active":"2023-07-14T18:11:09.708692+0000","last_became_peered":"2023-07-14T18:11:09.708692+0000","last_unstale":"2023-07-14T18:11:14.884405+0000","last_undegraded":"2023-07-14T18:11:14.884405+0000","last_fullsized":"2023-07-14T18:11:14.884405+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_clean_scrub_stamp":"2023-07-14T18:11:08.667354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:02:35.757081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":20,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:11:15.117281+0000","last_change":"2023-07-14T18:11:09.720235+0000","last_active":"2023-07-14T18:11:15.117281+0000","last_peered":"2023-07-14T18:11:15.117281+0000","last_clean":"2023-07-14T18:11:15.117281+0000","last_became_active":"2023-07-14T18:11:09.719895+0000","last_became_peered":"2023-07-14T18:11:09.719895+0000","last_unstale":"2023-07-14T18:11:15.117281+0000","last_undegraded":"2023-07-14T18:11:15.117281+0000","last_fullsized":"2023-07-14T18:11:15.117281+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_clean_scrub_stamp":"2023-07-14T18:11:08.667354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:41:02.386421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":20,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:11:14.887035+0000","last_change":"2023-07-14T18:11:09.712390+0000","last_active":"2023-07-14T18:11:14.887035+0000","last_peered":"2023-07-14T18:11:14.887035+0000","last_clean":"2023-07-14T18:11:14.887035+0000","last_became_active":"2023-07-14T18:11:09.712074+0000","last_became_peered":"2023-07-14T18:11:09.712074+0000","last_unstale":"2023-07-14T18:11:14.887035+0000","last_undegraded":"2023-07-14T18:11:14.887035+0000","last_fullsized":"2023-07-14T18:11:14.887035+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_clean_scrub_stamp":"2023-07-14T18:11:08.667354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:26:16.089801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":20,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:11:14.885382+0000","last_change":"2023-07-14T18:11:09.709800+0000","last_active":"2023-07-14T18:11:14.885382+0000","last_peered":"2023-07-14T18:11:14.885382+0000","last_clean":"2023-07-14T18:11:14.885382+0000","last_became_active":"2023-07-14T18:11:09.709540+0000","last_became_peered":"2023-07-14T18:11:09.709540+0000","last_unstale":"2023-07-14T18:11:14.885382+0000","last_undegraded":"2023-07-14T18:11:14.885382+0000","last_fullsized":"2023-07-14T18:11:14.885382+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_clean_scrub_stamp":"2023-07-14T18:11:08.667354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:52:10.352194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":13,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:11:14.884081+0000","last_change":"2023-07-14T18:11:13.786505+0000","last_active":"2023-07-14T18:11:14.884081+0000","last_peered":"2023-07-14T18:11:14.884081+0000","last_clean":"2023-07-14T18:11:14.884081+0000","last_became_active":"2023-07-14T18:11:13.786141+0000","last_became_peered":"2023-07-14T18:11:13.786141+0000","last_unstale":"2023-07-14T18:11:14.884081+0000","last_undegraded":"2023-07-14T18:11:14.884081+0000","last_fullsized":"2023-07-14T18:11:14.884081+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:12.753466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:12.753466+0000","last_clean_scrub_stamp":"2023-07-14T18:11:12.753466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:26:53.748778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,9,0],"acting":[2,3,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"84'13","reported_seq":72,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:12:05.828094+0000","last_change":"2023-07-14T18:11:08.691446+0000","last_active":"2023-07-14T18:12:05.828094+0000","last_peered":"2023-07-14T18:12:05.828094+0000","last_clean":"2023-07-14T18:12:05.828094+0000","last_became_active":"2023-07-14T18:11:08.691129+0000","last_became_peered":"2023-07-14T18:11:08.691129+0000","last_unstale":"2023-07-14T18:12:05.828094+0000","last_undegraded":"2023-07-14T18:12:05.828094+0000","last_fullsized":"2023-07-14T18:12:05.828094+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:07.665746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:07.665746+0000","last_clean_scrub_stamp":"2023-07-14T18:11:07.665746+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T03:49:49.363087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":37,"num_read_kb":37,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":20,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:11:14.886188+0000","last_change":"2023-07-14T18:11:09.708155+0000","last_active":"2023-07-14T18:11:14.886188+0000","last_peered":"2023-07-14T18:11:14.886188+0000","last_clean":"2023-07-14T18:11:14.886188+0000","last_became_active":"2023-07-14T18:11:09.707856+0000","last_became_peered":"2023-07-14T18:11:09.707856+0000","last_unstale":"2023-07-14T18:11:14.886188+0000","last_undegraded":"2023-07-14T18:11:14.886188+0000","last_fullsized":"2023-07-14T18:11:14.886188+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_clean_scrub_stamp":"2023-07-14T18:11:08.667354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:45:23.390147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":13,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:11:14.885185+0000","last_change":"2023-07-14T18:11:13.776947+0000","last_active":"2023-07-14T18:11:14.885185+0000","last_peered":"2023-07-14T18:11:14.885185+0000","last_clean":"2023-07-14T18:11:14.885185+0000","last_became_active":"2023-07-14T18:11:13.776557+0000","last_became_peered":"2023-07-14T18:11:13.776557+0000","last_unstale":"2023-07-14T18:11:14.885185+0000","last_undegraded":"2023-07-14T18:11:14.885185+0000","last_fullsized":"2023-07-14T18:11:14.885185+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:12.753466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:12.753466+0000","last_clean_scrub_stamp":"2023-07-14T18:11:12.753466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T05:58:30.561744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,9,3],"acting":[4,6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1e","version":"84'2","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:11:14.886397+0000","last_change":"2023-07-14T18:11:08.690072+0000","last_active":"2023-07-14T18:11:14.886397+0000","last_peered":"2023-07-14T18:11:14.886397+0000","last_clean":"2023-07-14T18:11:14.886397+0000","last_became_active":"2023-07-14T18:11:08.689770+0000","last_became_peered":"2023-07-14T18:11:08.689770+0000","last_unstale":"2023-07-14T18:11:14.886397+0000","last_undegraded":"2023-07-14T18:11:14.886397+0000","last_fullsized":"2023-07-14T18:11:14.886397+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:07.665746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:07.665746+0000","last_clean_scrub_stamp":"2023-07-14T18:11:07.665746+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:22:28.360757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":20,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:11:14.885001+0000","last_change":"2023-07-14T18:11:09.706952+0000","last_active":"2023-07-14T18:11:14.885001+0000","last_peered":"2023-07-14T18:11:14.885001+0000","last_clean":"2023-07-14T18:11:14.885001+0000","last_became_active":"2023-07-14T18:11:09.706646+0000","last_became_peered":"2023-07-14T18:11:09.706646+0000","last_unstale":"2023-07-14T18:11:14.885001+0000","last_undegraded":"2023-07-14T18:11:14.885001+0000","last_fullsized":"2023-07-14T18:11:14.885001+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_clean_scrub_stamp":"2023-07-14T18:11:08.667354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:21:05.149853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":13,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:11:14.886418+0000","last_change":"2023-07-14T18:11:13.779167+0000","last_active":"2023-07-14T18:11:14.886418+0000","last_peered":"2023-07-14T18:11:14.886418+0000","last_clean":"2023-07-14T18:11:14.886418+0000","last_became_active":"2023-07-14T18:11:13.778486+0000","last_became_peered":"2023-07-14T18:11:13.778486+0000","last_unstale":"2023-07-14T18:11:14.886418+0000","last_undegraded":"2023-07-14T18:11:14.886418+0000","last_fullsized":"2023-07-14T18:11:14.886418+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:12.753466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:12.753466+0000","last_clean_scrub_stamp":"2023-07-14T18:11:12.753466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:34:58.614453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,9,5],"acting":[4,3,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"84'12","reported_seq":35,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:11:30.774235+0000","last_change":"2023-07-14T18:11:08.688289+0000","last_active":"2023-07-14T18:11:30.774235+0000","last_peered":"2023-07-14T18:11:30.774235+0000","last_clean":"2023-07-14T18:11:30.774235+0000","last_became_active":"2023-07-14T18:11:08.687994+0000","last_became_peered":"2023-07-14T18:11:08.687994+0000","last_unstale":"2023-07-14T18:11:30.774235+0000","last_undegraded":"2023-07-14T18:11:30.774235+0000","last_fullsized":"2023-07-14T18:11:30.774235+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:07.665746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:07.665746+0000","last_clean_scrub_stamp":"2023-07-14T18:11:07.665746+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:06:29.309813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":20,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:11:14.884723+0000","last_change":"2023-07-14T18:11:09.711910+0000","last_active":"2023-07-14T18:11:14.884723+0000","last_peered":"2023-07-14T18:11:14.884723+0000","last_clean":"2023-07-14T18:11:14.884723+0000","last_became_active":"2023-07-14T18:11:09.711634+0000","last_became_peered":"2023-07-14T18:11:09.711634+0000","last_unstale":"2023-07-14T18:11:14.884723+0000","last_undegraded":"2023-07-14T18:11:14.884723+0000","last_fullsized":"2023-07-14T18:11:14.884723+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_clean_scrub_stamp":"2023-07-14T18:11:08.667354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T02:17:27.837804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":13,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:11:14.885448+0000","last_change":"2023-07-14T18:11:13.778662+0000","last_active":"2023-07-14T18:11:14.885448+0000","last_peered":"2023-07-14T18:11:14.885448+0000","last_clean":"2023-07-14T18:11:14.885448+0000","last_became_active":"2023-07-14T18:11:13.777886+0000","last_became_peered":"2023-07-14T18:11:13.777886+0000","last_unstale":"2023-07-14T18:11:14.885448+0000","last_undegraded":"2023-07-14T18:11:14.885448+0000","last_fullsized":"2023-07-14T18:11:14.885448+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:12.753466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:12.753466+0000","last_clean_scrub_stamp":"2023-07-14T18:11:12.753466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:17:56.221852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"84'5","reported_seq":28,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:11:30.773437+0000","last_change":"2023-07-14T18:11:08.683774+0000","last_active":"2023-07-14T18:11:30.773437+0000","last_peered":"2023-07-14T18:11:30.773437+0000","last_clean":"2023-07-14T18:11:30.773437+0000","last_became_active":"2023-07-14T18:11:08.683458+0000","last_became_peered":"2023-07-14T18:11:08.683458+0000","last_unstale":"2023-07-14T18:11:30.773437+0000","last_undegraded":"2023-07-14T18:11:30.773437+0000","last_fullsized":"2023-07-14T18:11:30.773437+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:07.665746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:07.665746+0000","last_clean_scrub_stamp":"2023-07-14T18:11:07.665746+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:20:32.172917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":20,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:11:14.791559+0000","last_change":"2023-07-14T18:11:09.716041+0000","last_active":"2023-07-14T18:11:14.791559+0000","last_peered":"2023-07-14T18:11:14.791559+0000","last_clean":"2023-07-14T18:11:14.791559+0000","last_became_active":"2023-07-14T18:11:09.715367+0000","last_became_peered":"2023-07-14T18:11:09.715367+0000","last_unstale":"2023-07-14T18:11:14.791559+0000","last_undegraded":"2023-07-14T18:11:14.791559+0000","last_fullsized":"2023-07-14T18:11:14.791559+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_clean_scrub_stamp":"2023-07-14T18:11:08.667354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T01:34:04.989278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":13,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:11:14.885291+0000","last_change":"2023-07-14T18:11:13.776527+0000","last_active":"2023-07-14T18:11:14.885291+0000","last_peered":"2023-07-14T18:11:14.885291+0000","last_clean":"2023-07-14T18:11:14.885291+0000","last_became_active":"2023-07-14T18:11:13.776032+0000","last_became_peered":"2023-07-14T18:11:13.776032+0000","last_unstale":"2023-07-14T18:11:14.885291+0000","last_undegraded":"2023-07-14T18:11:14.885291+0000","last_fullsized":"2023-07-14T18:11:14.885291+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:12.753466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:12.753466+0000","last_clean_scrub_stamp":"2023-07-14T18:11:12.753466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:39:22.666498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"84'5","reported_seq":66,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:12:05.822768+0000","last_change":"2023-07-14T18:11:08.687533+0000","last_active":"2023-07-14T18:12:05.822768+0000","last_peered":"2023-07-14T18:12:05.822768+0000","last_clean":"2023-07-14T18:12:05.822768+0000","last_became_active":"2023-07-14T18:11:08.687242+0000","last_became_peered":"2023-07-14T18:11:08.687242+0000","last_unstale":"2023-07-14T18:12:05.822768+0000","last_undegraded":"2023-07-14T18:12:05.822768+0000","last_fullsized":"2023-07-14T18:12:05.822768+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:07.665746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:07.665746+0000","last_clean_scrub_stamp":"2023-07-14T18:11:07.665746+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T03:53:23.140121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":574,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":39,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":20,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:11:14.885376+0000","last_change":"2023-07-14T18:11:09.707937+0000","last_active":"2023-07-14T18:11:14.885376+0000","last_peered":"2023-07-14T18:11:14.885376+0000","last_clean":"2023-07-14T18:11:14.885376+0000","last_became_active":"2023-07-14T18:11:09.707637+0000","last_became_peered":"2023-07-14T18:11:09.707637+0000","last_unstale":"2023-07-14T18:11:14.885376+0000","last_undegraded":"2023-07-14T18:11:14.885376+0000","last_fullsized":"2023-07-14T18:11:14.885376+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_clean_scrub_stamp":"2023-07-14T18:11:08.667354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:08:40.577399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":13,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:11:14.884475+0000","last_change":"2023-07-14T18:11:13.791360+0000","last_active":"2023-07-14T18:11:14.884475+0000","last_peered":"2023-07-14T18:11:14.884475+0000","last_clean":"2023-07-14T18:11:14.884475+0000","last_became_active":"2023-07-14T18:11:13.790894+0000","last_became_peered":"2023-07-14T18:11:13.790894+0000","last_unstale":"2023-07-14T18:11:14.884475+0000","last_undegraded":"2023-07-14T18:11:14.884475+0000","last_fullsized":"2023-07-14T18:11:14.884475+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:12.753466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:12.753466+0000","last_clean_scrub_stamp":"2023-07-14T18:11:12.753466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:41:41.939841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,9,5],"acting":[2,6,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1a","version":"84'7","reported_seq":29,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:11:29.839469+0000","last_change":"2023-07-14T18:11:08.687315+0000","last_active":"2023-07-14T18:11:29.839469+0000","last_peered":"2023-07-14T18:11:29.839469+0000","last_clean":"2023-07-14T18:11:29.839469+0000","last_became_active":"2023-07-14T18:11:08.687061+0000","last_became_peered":"2023-07-14T18:11:08.687061+0000","last_unstale":"2023-07-14T18:11:29.839469+0000","last_undegraded":"2023-07-14T18:11:29.839469+0000","last_fullsized":"2023-07-14T18:11:29.839469+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:07.665746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:07.665746+0000","last_clean_scrub_stamp":"2023-07-14T18:11:07.665746+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:33:18.467402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":20,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:11:14.791635+0000","last_change":"2023-07-14T18:11:09.715816+0000","last_active":"2023-07-14T18:11:14.791635+0000","last_peered":"2023-07-14T18:11:14.791635+0000","last_clean":"2023-07-14T18:11:14.791635+0000","last_became_active":"2023-07-14T18:11:09.715038+0000","last_became_peered":"2023-07-14T18:11:09.715038+0000","last_unstale":"2023-07-14T18:11:14.791635+0000","last_undegraded":"2023-07-14T18:11:14.791635+0000","last_fullsized":"2023-07-14T18:11:14.791635+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_clean_scrub_stamp":"2023-07-14T18:11:08.667354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:25:18.981358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":13,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:11:15.117190+0000","last_change":"2023-07-14T18:11:13.791438+0000","last_active":"2023-07-14T18:11:15.117190+0000","last_peered":"2023-07-14T18:11:15.117190+0000","last_clean":"2023-07-14T18:11:15.117190+0000","last_became_active":"2023-07-14T18:11:13.790956+0000","last_became_peered":"2023-07-14T18:11:13.790956+0000","last_unstale":"2023-07-14T18:11:15.117190+0000","last_undegraded":"2023-07-14T18:11:15.117190+0000","last_fullsized":"2023-07-14T18:11:15.117190+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:12.753466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:12.753466+0000","last_clean_scrub_stamp":"2023-07-14T18:11:12.753466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:19:27.699147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.19","version":"84'3","reported_seq":25,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:11:28.829267+0000","last_change":"2023-07-14T18:11:08.693751+0000","last_active":"2023-07-14T18:11:28.829267+0000","last_peered":"2023-07-14T18:11:28.829267+0000","last_clean":"2023-07-14T18:11:28.829267+0000","last_became_active":"2023-07-14T18:11:08.693427+0000","last_became_peered":"2023-07-14T18:11:08.693427+0000","last_unstale":"2023-07-14T18:11:28.829267+0000","last_undegraded":"2023-07-14T18:11:28.829267+0000","last_fullsized":"2023-07-14T18:11:28.829267+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:07.665746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:07.665746+0000","last_clean_scrub_stamp":"2023-07-14T18:11:07.665746+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T01:10:23.727801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":20,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:11:14.885924+0000","last_change":"2023-07-14T18:11:09.709761+0000","last_active":"2023-07-14T18:11:14.885924+0000","last_peered":"2023-07-14T18:11:14.885924+0000","last_clean":"2023-07-14T18:11:14.885924+0000","last_became_active":"2023-07-14T18:11:09.709157+0000","last_became_peered":"2023-07-14T18:11:09.709157+0000","last_unstale":"2023-07-14T18:11:14.885924+0000","last_undegraded":"2023-07-14T18:11:14.885924+0000","last_fullsized":"2023-07-14T18:11:14.885924+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_clean_scrub_stamp":"2023-07-14T18:11:08.667354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:46:44.602802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":13,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:11:14.884393+0000","last_change":"2023-07-14T18:11:13.779265+0000","last_active":"2023-07-14T18:11:14.884393+0000","last_peered":"2023-07-14T18:11:14.884393+0000","last_clean":"2023-07-14T18:11:14.884393+0000","last_became_active":"2023-07-14T18:11:13.778865+0000","last_became_peered":"2023-07-14T18:11:13.778865+0000","last_unstale":"2023-07-14T18:11:14.884393+0000","last_undegraded":"2023-07-14T18:11:14.884393+0000","last_fullsized":"2023-07-14T18:11:14.884393+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:12.753466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:12.753466+0000","last_clean_scrub_stamp":"2023-07-14T18:11:12.753466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:19:57.552613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.18","version":"84'3","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:11:30.768842+0000","last_change":"2023-07-14T18:11:08.684513+0000","last_active":"2023-07-14T18:11:30.768842+0000","last_peered":"2023-07-14T18:11:30.768842+0000","last_clean":"2023-07-14T18:11:30.768842+0000","last_became_active":"2023-07-14T18:11:08.684213+0000","last_became_peered":"2023-07-14T18:11:08.684213+0000","last_unstale":"2023-07-14T18:11:30.768842+0000","last_undegraded":"2023-07-14T18:11:30.768842+0000","last_fullsized":"2023-07-14T18:11:30.768842+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:07.665746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:07.665746+0000","last_clean_scrub_stamp":"2023-07-14T18:11:07.665746+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:07:53.630240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":20,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:11:14.886595+0000","last_change":"2023-07-14T18:11:09.712427+0000","last_active":"2023-07-14T18:11:14.886595+0000","last_peered":"2023-07-14T18:11:14.886595+0000","last_clean":"2023-07-14T18:11:14.886595+0000","last_became_active":"2023-07-14T18:11:09.712104+0000","last_became_peered":"2023-07-14T18:11:09.712104+0000","last_unstale":"2023-07-14T18:11:14.886595+0000","last_undegraded":"2023-07-14T18:11:14.886595+0000","last_fullsized":"2023-07-14T18:11:14.886595+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_clean_scrub_stamp":"2023-07-14T18:11:08.667354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:27:36.074613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":13,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:11:14.884458+0000","last_change":"2023-07-14T18:11:13.777892+0000","last_active":"2023-07-14T18:11:14.884458+0000","last_peered":"2023-07-14T18:11:14.884458+0000","last_clean":"2023-07-14T18:11:14.884458+0000","last_became_active":"2023-07-14T18:11:13.777518+0000","last_became_peered":"2023-07-14T18:11:13.777518+0000","last_unstale":"2023-07-14T18:11:14.884458+0000","last_undegraded":"2023-07-14T18:11:14.884458+0000","last_fullsized":"2023-07-14T18:11:14.884458+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:12.753466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:12.753466+0000","last_clean_scrub_stamp":"2023-07-14T18:11:12.753466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T03:56:42.344672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.17","version":"84'4","reported_seq":102,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:12:07.824958+0000","last_change":"2023-07-14T18:11:08.684141+0000","last_active":"2023-07-14T18:12:07.824958+0000","last_peered":"2023-07-14T18:12:07.824958+0000","last_clean":"2023-07-14T18:12:07.824958+0000","last_became_active":"2023-07-14T18:11:08.683767+0000","last_became_peered":"2023-07-14T18:11:08.683767+0000","last_unstale":"2023-07-14T18:12:07.824958+0000","last_undegraded":"2023-07-14T18:12:07.824958+0000","last_fullsized":"2023-07-14T18:12:07.824958+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:07.665746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:07.665746+0000","last_clean_scrub_stamp":"2023-07-14T18:11:07.665746+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T02:05:02.791590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":76,"num_read_kb":76,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":20,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:11:14.885184+0000","last_change":"2023-07-14T18:11:09.710975+0000","last_active":"2023-07-14T18:11:14.885184+0000","last_peered":"2023-07-14T18:11:14.885184+0000","last_clean":"2023-07-14T18:11:14.885184+0000","last_became_active":"2023-07-14T18:11:09.710690+0000","last_became_peered":"2023-07-14T18:11:09.710690+0000","last_unstale":"2023-07-14T18:11:14.885184+0000","last_undegraded":"2023-07-14T18:11:14.885184+0000","last_fullsized":"2023-07-14T18:11:14.885184+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_clean_scrub_stamp":"2023-07-14T18:11:08.667354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T02:39:19.763017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":13,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:11:14.886369+0000","last_change":"2023-07-14T18:11:13.789251+0000","last_active":"2023-07-14T18:11:14.886369+0000","last_peered":"2023-07-14T18:11:14.886369+0000","last_clean":"2023-07-14T18:11:14.886369+0000","last_became_active":"2023-07-14T18:11:13.788742+0000","last_became_peered":"2023-07-14T18:11:13.788742+0000","last_unstale":"2023-07-14T18:11:14.886369+0000","last_undegraded":"2023-07-14T18:11:14.886369+0000","last_fullsized":"2023-07-14T18:11:14.886369+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:12.753466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:12.753466+0000","last_clean_scrub_stamp":"2023-07-14T18:11:12.753466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T04:39:11.465407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0,2,4],"acting":[9,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.16","version":"84'4","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:11:30.771801+0000","last_change":"2023-07-14T18:11:08.692093+0000","last_active":"2023-07-14T18:11:30.771801+0000","last_peered":"2023-07-14T18:11:30.771801+0000","last_clean":"2023-07-14T18:11:30.771801+0000","last_became_active":"2023-07-14T18:11:08.691806+0000","last_became_peered":"2023-07-14T18:11:08.691806+0000","last_unstale":"2023-07-14T18:11:30.771801+0000","last_undegraded":"2023-07-14T18:11:30.771801+0000","last_fullsized":"2023-07-14T18:11:30.771801+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:07.665746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:07.665746+0000","last_clean_scrub_stamp":"2023-07-14T18:11:07.665746+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:59:54.200134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":20,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:11:14.885119+0000","last_change":"2023-07-14T18:11:09.714965+0000","last_active":"2023-07-14T18:11:14.885119+0000","last_peered":"2023-07-14T18:11:14.885119+0000","last_clean":"2023-07-14T18:11:14.885119+0000","last_became_active":"2023-07-14T18:11:09.714676+0000","last_became_peered":"2023-07-14T18:11:09.714676+0000","last_unstale":"2023-07-14T18:11:14.885119+0000","last_undegraded":"2023-07-14T18:11:14.885119+0000","last_fullsized":"2023-07-14T18:11:14.885119+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_clean_scrub_stamp":"2023-07-14T18:11:08.667354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:10:38.185488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":13,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:11:14.886587+0000","last_change":"2023-07-14T18:11:13.779218+0000","last_active":"2023-07-14T18:11:14.886587+0000","last_peered":"2023-07-14T18:11:14.886587+0000","last_clean":"2023-07-14T18:11:14.886587+0000","last_became_active":"2023-07-14T18:11:13.778833+0000","last_became_peered":"2023-07-14T18:11:13.778833+0000","last_unstale":"2023-07-14T18:11:14.886587+0000","last_undegraded":"2023-07-14T18:11:14.886587+0000","last_fullsized":"2023-07-14T18:11:14.886587+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:12.753466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:12.753466+0000","last_clean_scrub_stamp":"2023-07-14T18:11:12.753466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:59:38.858950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,9],"acting":[4,1,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"84'5","reported_seq":28,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:11:29.838574+0000","last_change":"2023-07-14T18:11:08.681778+0000","last_active":"2023-07-14T18:11:29.838574+0000","last_peered":"2023-07-14T18:11:29.838574+0000","last_clean":"2023-07-14T18:11:29.838574+0000","last_became_active":"2023-07-14T18:11:08.681406+0000","last_became_peered":"2023-07-14T18:11:08.681406+0000","last_unstale":"2023-07-14T18:11:29.838574+0000","last_undegraded":"2023-07-14T18:11:29.838574+0000","last_fullsized":"2023-07-14T18:11:29.838574+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:07.665746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:07.665746+0000","last_clean_scrub_stamp":"2023-07-14T18:11:07.665746+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:23:04.400637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":20,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:11:14.884950+0000","last_change":"2023-07-14T18:11:09.703070+0000","last_active":"2023-07-14T18:11:14.884950+0000","last_peered":"2023-07-14T18:11:14.884950+0000","last_clean":"2023-07-14T18:11:14.884950+0000","last_became_active":"2023-07-14T18:11:09.702754+0000","last_became_peered":"2023-07-14T18:11:09.702754+0000","last_unstale":"2023-07-14T18:11:14.884950+0000","last_undegraded":"2023-07-14T18:11:14.884950+0000","last_fullsized":"2023-07-14T18:11:14.884950+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_clean_scrub_stamp":"2023-07-14T18:11:08.667354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:41:59.621911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":13,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:11:14.886380+0000","last_change":"2023-07-14T18:11:13.788077+0000","last_active":"2023-07-14T18:11:14.886380+0000","last_peered":"2023-07-14T18:11:14.886380+0000","last_clean":"2023-07-14T18:11:14.886380+0000","last_became_active":"2023-07-14T18:11:13.787719+0000","last_became_peered":"2023-07-14T18:11:13.787719+0000","last_unstale":"2023-07-14T18:11:14.886380+0000","last_undegraded":"2023-07-14T18:11:14.886380+0000","last_fullsized":"2023-07-14T18:11:14.886380+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:12.753466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:12.753466+0000","last_clean_scrub_stamp":"2023-07-14T18:11:12.753466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:28:37.419577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,11,5],"acting":[9,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.14","version":"84'33","reported_seq":138,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:12:07.825198+0000","last_change":"2023-07-14T18:11:08.690538+0000","last_active":"2023-07-14T18:12:07.825198+0000","last_peered":"2023-07-14T18:12:07.825198+0000","last_clean":"2023-07-14T18:12:07.825198+0000","last_became_active":"2023-07-14T18:11:08.690152+0000","last_became_peered":"2023-07-14T18:11:08.690152+0000","last_unstale":"2023-07-14T18:12:07.825198+0000","last_undegraded":"2023-07-14T18:12:07.825198+0000","last_fullsized":"2023-07-14T18:12:07.825198+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:07.665746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:07.665746+0000","last_clean_scrub_stamp":"2023-07-14T18:11:07.665746+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:27:49.760382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":60837,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":83,"num_read_kb":101,"num_write":35,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":20,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:11:14.885568+0000","last_change":"2023-07-14T18:11:09.710116+0000","last_active":"2023-07-14T18:11:14.885568+0000","last_peered":"2023-07-14T18:11:14.885568+0000","last_clean":"2023-07-14T18:11:14.885568+0000","last_became_active":"2023-07-14T18:11:09.709831+0000","last_became_peered":"2023-07-14T18:11:09.709831+0000","last_unstale":"2023-07-14T18:11:14.885568+0000","last_undegraded":"2023-07-14T18:11:14.885568+0000","last_fullsized":"2023-07-14T18:11:14.885568+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_clean_scrub_stamp":"2023-07-14T18:11:08.667354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T03:06:14.287734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":13,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:11:14.791956+0000","last_change":"2023-07-14T18:11:13.777434+0000","last_active":"2023-07-14T18:11:14.791956+0000","last_peered":"2023-07-14T18:11:14.791956+0000","last_clean":"2023-07-14T18:11:14.791956+0000","last_became_active":"2023-07-14T18:11:13.776670+0000","last_became_peered":"2023-07-14T18:11:13.776670+0000","last_unstale":"2023-07-14T18:11:14.791956+0000","last_undegraded":"2023-07-14T18:11:14.791956+0000","last_fullsized":"2023-07-14T18:11:14.791956+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:12.753466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:12.753466+0000","last_clean_scrub_stamp":"2023-07-14T18:11:12.753466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T02:09:40.305735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.13","version":"84'9","reported_seq":33,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:11:30.770744+0000","last_change":"2023-07-14T18:11:08.693172+0000","last_active":"2023-07-14T18:11:30.770744+0000","last_peered":"2023-07-14T18:11:30.770744+0000","last_clean":"2023-07-14T18:11:30.770744+0000","last_became_active":"2023-07-14T18:11:08.692846+0000","last_became_peered":"2023-07-14T18:11:08.692846+0000","last_unstale":"2023-07-14T18:11:30.770744+0000","last_undegraded":"2023-07-14T18:11:30.770744+0000","last_fullsized":"2023-07-14T18:11:30.770744+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:07.665746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:07.665746+0000","last_clean_scrub_stamp":"2023-07-14T18:11:07.665746+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:24:38.511637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":20,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:11:14.790941+0000","last_change":"2023-07-14T18:11:09.708480+0000","last_active":"2023-07-14T18:11:14.790941+0000","last_peered":"2023-07-14T18:11:14.790941+0000","last_clean":"2023-07-14T18:11:14.790941+0000","last_became_active":"2023-07-14T18:11:09.708170+0000","last_became_peered":"2023-07-14T18:11:09.708170+0000","last_unstale":"2023-07-14T18:11:14.790941+0000","last_undegraded":"2023-07-14T18:11:14.790941+0000","last_fullsized":"2023-07-14T18:11:14.790941+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_clean_scrub_stamp":"2023-07-14T18:11:08.667354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T04:03:41.097364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":13,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:11:15.116981+0000","last_change":"2023-07-14T18:11:13.792069+0000","last_active":"2023-07-14T18:11:15.116981+0000","last_peered":"2023-07-14T18:11:15.116981+0000","last_clean":"2023-07-14T18:11:15.116981+0000","last_became_active":"2023-07-14T18:11:13.791698+0000","last_became_peered":"2023-07-14T18:11:13.791698+0000","last_unstale":"2023-07-14T18:11:15.116981+0000","last_undegraded":"2023-07-14T18:11:15.116981+0000","last_fullsized":"2023-07-14T18:11:15.116981+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:12.753466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:12.753466+0000","last_clean_scrub_stamp":"2023-07-14T18:11:12.753466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:36:51.740650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.12","version":"84'5","reported_seq":28,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:11:30.775116+0000","last_change":"2023-07-14T18:11:08.685028+0000","last_active":"2023-07-14T18:11:30.775116+0000","last_peered":"2023-07-14T18:11:30.775116+0000","last_clean":"2023-07-14T18:11:30.775116+0000","last_became_active":"2023-07-14T18:11:08.684701+0000","last_became_peered":"2023-07-14T18:11:08.684701+0000","last_unstale":"2023-07-14T18:11:30.775116+0000","last_undegraded":"2023-07-14T18:11:30.775116+0000","last_fullsized":"2023-07-14T18:11:30.775116+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:07.665746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:07.665746+0000","last_clean_scrub_stamp":"2023-07-14T18:11:07.665746+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:48:38.822039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":18,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:11:14.886051+0000","last_change":"2023-07-14T18:11:09.717714+0000","last_active":"2023-07-14T18:11:14.886051+0000","last_peered":"2023-07-14T18:11:14.886051+0000","last_clean":"2023-07-14T18:11:14.886051+0000","last_became_active":"2023-07-14T18:11:09.717407+0000","last_became_peered":"2023-07-14T18:11:09.717407+0000","last_unstale":"2023-07-14T18:11:14.886051+0000","last_undegraded":"2023-07-14T18:11:14.886051+0000","last_fullsized":"2023-07-14T18:11:14.886051+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_clean_scrub_stamp":"2023-07-14T18:11:08.667354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T02:18:33.466738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":13,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:11:14.887107+0000","last_change":"2023-07-14T18:11:13.787754+0000","last_active":"2023-07-14T18:11:14.887107+0000","last_peered":"2023-07-14T18:11:14.887107+0000","last_clean":"2023-07-14T18:11:14.887107+0000","last_became_active":"2023-07-14T18:11:13.787250+0000","last_became_peered":"2023-07-14T18:11:13.787250+0000","last_unstale":"2023-07-14T18:11:14.887107+0000","last_undegraded":"2023-07-14T18:11:14.887107+0000","last_fullsized":"2023-07-14T18:11:14.887107+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:12.753466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:12.753466+0000","last_clean_scrub_stamp":"2023-07-14T18:11:12.753466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T03:54:39.337152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,0,3],"acting":[9,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.11","version":"84'6","reported_seq":67,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:12:05.822412+0000","last_change":"2023-07-14T18:11:08.685327+0000","last_active":"2023-07-14T18:12:05.822412+0000","last_peered":"2023-07-14T18:12:05.822412+0000","last_clean":"2023-07-14T18:12:05.822412+0000","last_became_active":"2023-07-14T18:11:08.684969+0000","last_became_peered":"2023-07-14T18:11:08.684969+0000","last_unstale":"2023-07-14T18:12:05.822412+0000","last_undegraded":"2023-07-14T18:12:05.822412+0000","last_fullsized":"2023-07-14T18:12:05.822412+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:07.665746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:07.665746+0000","last_clean_scrub_stamp":"2023-07-14T18:11:07.665746+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:38:18.572332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":930,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":40,"num_read_kb":3,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":18,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:11:14.886418+0000","last_change":"2023-07-14T18:11:09.721100+0000","last_active":"2023-07-14T18:11:14.886418+0000","last_peered":"2023-07-14T18:11:14.886418+0000","last_clean":"2023-07-14T18:11:14.886418+0000","last_became_active":"2023-07-14T18:11:09.720814+0000","last_became_peered":"2023-07-14T18:11:09.720814+0000","last_unstale":"2023-07-14T18:11:14.886418+0000","last_undegraded":"2023-07-14T18:11:14.886418+0000","last_fullsized":"2023-07-14T18:11:14.886418+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_clean_scrub_stamp":"2023-07-14T18:11:08.667354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:21:49.557811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":13,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:11:14.791294+0000","last_change":"2023-07-14T18:11:13.782152+0000","last_active":"2023-07-14T18:11:14.791294+0000","last_peered":"2023-07-14T18:11:14.791294+0000","last_clean":"2023-07-14T18:11:14.791294+0000","last_became_active":"2023-07-14T18:11:13.780580+0000","last_became_peered":"2023-07-14T18:11:13.780580+0000","last_unstale":"2023-07-14T18:11:14.791294+0000","last_undegraded":"2023-07-14T18:11:14.791294+0000","last_fullsized":"2023-07-14T18:11:14.791294+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:12.753466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:12.753466+0000","last_clean_scrub_stamp":"2023-07-14T18:11:12.753466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T05:13:05.195958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"84'17","reported_seq":40,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:11:30.764437+0000","last_change":"2023-07-14T18:11:08.688954+0000","last_active":"2023-07-14T18:11:30.764437+0000","last_peered":"2023-07-14T18:11:30.764437+0000","last_clean":"2023-07-14T18:11:30.764437+0000","last_became_active":"2023-07-14T18:11:08.688640+0000","last_became_peered":"2023-07-14T18:11:08.688640+0000","last_unstale":"2023-07-14T18:11:30.764437+0000","last_undegraded":"2023-07-14T18:11:30.764437+0000","last_fullsized":"2023-07-14T18:11:30.764437+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:07.665746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:07.665746+0000","last_clean_scrub_stamp":"2023-07-14T18:11:07.665746+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:21:30.166422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":20,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:11:14.791112+0000","last_change":"2023-07-14T18:11:09.710105+0000","last_active":"2023-07-14T18:11:14.791112+0000","last_peered":"2023-07-14T18:11:14.791112+0000","last_clean":"2023-07-14T18:11:14.791112+0000","last_became_active":"2023-07-14T18:11:09.709820+0000","last_became_peered":"2023-07-14T18:11:09.709820+0000","last_unstale":"2023-07-14T18:11:14.791112+0000","last_undegraded":"2023-07-14T18:11:14.791112+0000","last_fullsized":"2023-07-14T18:11:14.791112+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_clean_scrub_stamp":"2023-07-14T18:11:08.667354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:29:12.467495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":13,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:11:14.791138+0000","last_change":"2023-07-14T18:11:13.780122+0000","last_active":"2023-07-14T18:11:14.791138+0000","last_peered":"2023-07-14T18:11:14.791138+0000","last_clean":"2023-07-14T18:11:14.791138+0000","last_became_active":"2023-07-14T18:11:13.779774+0000","last_became_peered":"2023-07-14T18:11:13.779774+0000","last_unstale":"2023-07-14T18:11:14.791138+0000","last_undegraded":"2023-07-14T18:11:14.791138+0000","last_fullsized":"2023-07-14T18:11:14.791138+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:12.753466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:12.753466+0000","last_clean_scrub_stamp":"2023-07-14T18:11:12.753466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:30:22.618282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"84'2","reported_seq":25,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:11:29.872951+0000","last_change":"2023-07-14T18:11:08.686080+0000","last_active":"2023-07-14T18:11:29.872951+0000","last_peered":"2023-07-14T18:11:29.872951+0000","last_clean":"2023-07-14T18:11:29.872951+0000","last_became_active":"2023-07-14T18:11:08.685837+0000","last_became_peered":"2023-07-14T18:11:08.685837+0000","last_unstale":"2023-07-14T18:11:29.872951+0000","last_undegraded":"2023-07-14T18:11:29.872951+0000","last_fullsized":"2023-07-14T18:11:29.872951+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:07.665746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:07.665746+0000","last_clean_scrub_stamp":"2023-07-14T18:11:07.665746+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:51:30.759050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":20,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:11:15.117046+0000","last_change":"2023-07-14T18:11:09.712166+0000","last_active":"2023-07-14T18:11:15.117046+0000","last_peered":"2023-07-14T18:11:15.117046+0000","last_clean":"2023-07-14T18:11:15.117046+0000","last_became_active":"2023-07-14T18:11:09.711858+0000","last_became_peered":"2023-07-14T18:11:09.711858+0000","last_unstale":"2023-07-14T18:11:15.117046+0000","last_undegraded":"2023-07-14T18:11:15.117046+0000","last_fullsized":"2023-07-14T18:11:15.117046+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_clean_scrub_stamp":"2023-07-14T18:11:08.667354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:17:12.495175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":13,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:11:14.885280+0000","last_change":"2023-07-14T18:11:13.905188+0000","last_active":"2023-07-14T18:11:14.885280+0000","last_peered":"2023-07-14T18:11:14.885280+0000","last_clean":"2023-07-14T18:11:14.885280+0000","last_became_active":"2023-07-14T18:11:13.904779+0000","last_became_peered":"2023-07-14T18:11:13.904779+0000","last_unstale":"2023-07-14T18:11:14.885280+0000","last_undegraded":"2023-07-14T18:11:14.885280+0000","last_fullsized":"2023-07-14T18:11:14.885280+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:12.753466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:12.753466+0000","last_clean_scrub_stamp":"2023-07-14T18:11:12.753466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:58:40.490499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,9],"acting":[8,10,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.4","version":"84'1","reported_seq":23,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:11:14.886899+0000","last_change":"2023-07-14T18:11:08.687838+0000","last_active":"2023-07-14T18:11:14.886899+0000","last_peered":"2023-07-14T18:11:14.886899+0000","last_clean":"2023-07-14T18:11:14.886899+0000","last_became_active":"2023-07-14T18:11:08.687522+0000","last_became_peered":"2023-07-14T18:11:08.687522+0000","last_unstale":"2023-07-14T18:11:14.886899+0000","last_undegraded":"2023-07-14T18:11:14.886899+0000","last_fullsized":"2023-07-14T18:11:14.886899+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:07.665746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:07.665746+0000","last_clean_scrub_stamp":"2023-07-14T18:11:07.665746+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T01:12:01.083801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":20,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:11:14.791607+0000","last_change":"2023-07-14T18:11:09.704033+0000","last_active":"2023-07-14T18:11:14.791607+0000","last_peered":"2023-07-14T18:11:14.791607+0000","last_clean":"2023-07-14T18:11:14.791607+0000","last_became_active":"2023-07-14T18:11:09.703727+0000","last_became_peered":"2023-07-14T18:11:09.703727+0000","last_unstale":"2023-07-14T18:11:14.791607+0000","last_undegraded":"2023-07-14T18:11:14.791607+0000","last_fullsized":"2023-07-14T18:11:14.791607+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_clean_scrub_stamp":"2023-07-14T18:11:08.667354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T04:23:57.185860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":13,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:11:14.791177+0000","last_change":"2023-07-14T18:11:13.778207+0000","last_active":"2023-07-14T18:11:14.791177+0000","last_peered":"2023-07-14T18:11:14.791177+0000","last_clean":"2023-07-14T18:11:14.791177+0000","last_became_active":"2023-07-14T18:11:13.777847+0000","last_became_peered":"2023-07-14T18:11:13.777847+0000","last_unstale":"2023-07-14T18:11:14.791177+0000","last_undegraded":"2023-07-14T18:11:14.791177+0000","last_fullsized":"2023-07-14T18:11:14.791177+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:12.753466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:12.753466+0000","last_clean_scrub_stamp":"2023-07-14T18:11:12.753466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:48:12.622534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"84'5","reported_seq":65,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:12:08.832393+0000","last_change":"2023-07-14T18:11:08.683570+0000","last_active":"2023-07-14T18:12:08.832393+0000","last_peered":"2023-07-14T18:12:08.832393+0000","last_clean":"2023-07-14T18:12:08.832393+0000","last_became_active":"2023-07-14T18:11:08.683271+0000","last_became_peered":"2023-07-14T18:11:08.683271+0000","last_unstale":"2023-07-14T18:12:08.832393+0000","last_undegraded":"2023-07-14T18:12:08.832393+0000","last_fullsized":"2023-07-14T18:12:08.832393+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:07.665746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:07.665746+0000","last_clean_scrub_stamp":"2023-07-14T18:11:07.665746+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:27:31.589898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":540,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":40,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":20,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:11:14.791596+0000","last_change":"2023-07-14T18:11:09.718239+0000","last_active":"2023-07-14T18:11:14.791596+0000","last_peered":"2023-07-14T18:11:14.791596+0000","last_clean":"2023-07-14T18:11:14.791596+0000","last_became_active":"2023-07-14T18:11:09.717923+0000","last_became_peered":"2023-07-14T18:11:09.717923+0000","last_unstale":"2023-07-14T18:11:14.791596+0000","last_undegraded":"2023-07-14T18:11:14.791596+0000","last_fullsized":"2023-07-14T18:11:14.791596+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_clean_scrub_stamp":"2023-07-14T18:11:08.667354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T04:18:29.161266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":13,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:11:14.791411+0000","last_change":"2023-07-14T18:11:13.904652+0000","last_active":"2023-07-14T18:11:14.791411+0000","last_peered":"2023-07-14T18:11:14.791411+0000","last_clean":"2023-07-14T18:11:14.791411+0000","last_became_active":"2023-07-14T18:11:13.904237+0000","last_became_peered":"2023-07-14T18:11:13.904237+0000","last_unstale":"2023-07-14T18:11:14.791411+0000","last_undegraded":"2023-07-14T18:11:14.791411+0000","last_fullsized":"2023-07-14T18:11:14.791411+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:12.753466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:12.753466+0000","last_clean_scrub_stamp":"2023-07-14T18:11:12.753466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T05:43:29.030625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":20,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:11:14.791182+0000","last_change":"2023-07-14T18:11:09.707086+0000","last_active":"2023-07-14T18:11:14.791182+0000","last_peered":"2023-07-14T18:11:14.791182+0000","last_clean":"2023-07-14T18:11:14.791182+0000","last_became_active":"2023-07-14T18:11:09.705882+0000","last_became_peered":"2023-07-14T18:11:09.705882+0000","last_unstale":"2023-07-14T18:11:14.791182+0000","last_undegraded":"2023-07-14T18:11:14.791182+0000","last_fullsized":"2023-07-14T18:11:14.791182+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_clean_scrub_stamp":"2023-07-14T18:11:08.667354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T03:39:47.438151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"84'5","reported_seq":67,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:12:07.824550+0000","last_change":"2023-07-14T18:11:08.683447+0000","last_active":"2023-07-14T18:12:07.824550+0000","last_peered":"2023-07-14T18:12:07.824550+0000","last_clean":"2023-07-14T18:12:07.824550+0000","last_became_active":"2023-07-14T18:11:08.682822+0000","last_became_peered":"2023-07-14T18:11:08.682822+0000","last_unstale":"2023-07-14T18:12:07.824550+0000","last_undegraded":"2023-07-14T18:12:07.824550+0000","last_fullsized":"2023-07-14T18:12:07.824550+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:07.665746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:07.665746+0000","last_clean_scrub_stamp":"2023-07-14T18:11:07.665746+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:07:15.245024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":40,"num_read_kb":40,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.5","version":"84'1","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:11:14.903879+0000","last_change":"2023-07-14T18:11:13.780698+0000","last_active":"2023-07-14T18:11:14.903879+0000","last_peered":"2023-07-14T18:11:14.903879+0000","last_clean":"2023-07-14T18:11:14.903879+0000","last_became_active":"2023-07-14T18:11:13.780310+0000","last_became_peered":"2023-07-14T18:11:13.780310+0000","last_unstale":"2023-07-14T18:11:14.903879+0000","last_undegraded":"2023-07-14T18:11:14.903879+0000","last_fullsized":"2023-07-14T18:11:14.903879+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:12.753466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:12.753466+0000","last_clean_scrub_stamp":"2023-07-14T18:11:12.753466+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:45:25.175685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":123,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,9],"acting":[7,5,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":20,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:11:14.884951+0000","last_change":"2023-07-14T18:11:09.708728+0000","last_active":"2023-07-14T18:11:14.884951+0000","last_peered":"2023-07-14T18:11:14.884951+0000","last_clean":"2023-07-14T18:11:14.884951+0000","last_became_active":"2023-07-14T18:11:09.708345+0000","last_became_peered":"2023-07-14T18:11:09.708345+0000","last_unstale":"2023-07-14T18:11:14.884951+0000","last_undegraded":"2023-07-14T18:11:14.884951+0000","last_fullsized":"2023-07-14T18:11:14.884951+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_clean_scrub_stamp":"2023-07-14T18:11:08.667354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:19:56.524734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"84'6","reported_seq":31,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:11:30.773955+0000","last_change":"2023-07-14T18:11:08.684495+0000","last_active":"2023-07-14T18:11:30.773955+0000","last_peered":"2023-07-14T18:11:30.773955+0000","last_clean":"2023-07-14T18:11:30.773955+0000","last_became_active":"2023-07-14T18:11:08.684142+0000","last_became_peered":"2023-07-14T18:11:08.684142+0000","last_unstale":"2023-07-14T18:11:30.773955+0000","last_undegraded":"2023-07-14T18:11:30.773955+0000","last_fullsized":"2023-07-14T18:11:30.773955+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:07.665746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:07.665746+0000","last_clean_scrub_stamp":"2023-07-14T18:11:07.665746+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T04:13:36.850275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"22'137","reported_seq":336,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:11:14.886019+0000","last_change":"2023-07-14T18:10:10.733548+0000","last_active":"2023-07-14T18:11:14.886019+0000","last_peered":"2023-07-14T18:11:14.886019+0000","last_clean":"2023-07-14T18:11:14.886019+0000","last_became_active":"2023-07-14T18:10:10.732994+0000","last_became_peered":"2023-07-14T18:10:10.732994+0000","last_unstale":"2023-07-14T18:11:14.886019+0000","last_undegraded":"2023-07-14T18:11:14.886019+0000","last_fullsized":"2023-07-14T18:11:14.886019+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:07:19.893754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:07:19.893754+0000","last_clean_scrub_stamp":"2023-07-14T18:07:19.893754+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T03:18:47.801203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":13,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:11:14.791877+0000","last_change":"2023-07-14T18:11:13.905811+0000","last_active":"2023-07-14T18:11:14.791877+0000","last_peered":"2023-07-14T18:11:14.791877+0000","last_clean":"2023-07-14T18:11:14.791877+0000","last_became_active":"2023-07-14T18:11:13.905390+0000","last_became_peered":"2023-07-14T18:11:13.905390+0000","last_unstale":"2023-07-14T18:11:14.791877+0000","last_undegraded":"2023-07-14T18:11:14.791877+0000","last_fullsized":"2023-07-14T18:11:14.791877+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:12.753466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:12.753466+0000","last_clean_scrub_stamp":"2023-07-14T18:11:12.753466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T03:55:38.653507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,6,10],"acting":[5,9,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":20,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:11:14.790613+0000","last_change":"2023-07-14T18:11:09.711008+0000","last_active":"2023-07-14T18:11:14.790613+0000","last_peered":"2023-07-14T18:11:14.790613+0000","last_clean":"2023-07-14T18:11:14.790613+0000","last_became_active":"2023-07-14T18:11:09.710555+0000","last_became_peered":"2023-07-14T18:11:09.710555+0000","last_unstale":"2023-07-14T18:11:14.790613+0000","last_undegraded":"2023-07-14T18:11:14.790613+0000","last_fullsized":"2023-07-14T18:11:14.790613+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_clean_scrub_stamp":"2023-07-14T18:11:08.667354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:14:16.607280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"84'4","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:11:28.825844+0000","last_change":"2023-07-14T18:11:08.689050+0000","last_active":"2023-07-14T18:11:28.825844+0000","last_peered":"2023-07-14T18:11:28.825844+0000","last_clean":"2023-07-14T18:11:28.825844+0000","last_became_active":"2023-07-14T18:11:08.688777+0000","last_became_peered":"2023-07-14T18:11:08.688777+0000","last_unstale":"2023-07-14T18:11:28.825844+0000","last_undegraded":"2023-07-14T18:11:28.825844+0000","last_fullsized":"2023-07-14T18:11:28.825844+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:07.665746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:07.665746+0000","last_clean_scrub_stamp":"2023-07-14T18:11:07.665746+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T01:15:28.678572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":13,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:11:15.116864+0000","last_change":"2023-07-14T18:11:13.776853+0000","last_active":"2023-07-14T18:11:15.116864+0000","last_peered":"2023-07-14T18:11:15.116864+0000","last_clean":"2023-07-14T18:11:15.116864+0000","last_became_active":"2023-07-14T18:11:13.776353+0000","last_became_peered":"2023-07-14T18:11:13.776353+0000","last_unstale":"2023-07-14T18:11:15.116864+0000","last_undegraded":"2023-07-14T18:11:15.116864+0000","last_fullsized":"2023-07-14T18:11:15.116864+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:12.753466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:12.753466+0000","last_clean_scrub_stamp":"2023-07-14T18:11:12.753466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:40:03.971774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.5","version":"84'4","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:11:30.766318+0000","last_change":"2023-07-14T18:11:08.691634+0000","last_active":"2023-07-14T18:11:30.766318+0000","last_peered":"2023-07-14T18:11:30.766318+0000","last_clean":"2023-07-14T18:11:30.766318+0000","last_became_active":"2023-07-14T18:11:08.691315+0000","last_became_peered":"2023-07-14T18:11:08.691315+0000","last_unstale":"2023-07-14T18:11:30.766318+0000","last_undegraded":"2023-07-14T18:11:30.766318+0000","last_fullsized":"2023-07-14T18:11:30.766318+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:07.665746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:07.665746+0000","last_clean_scrub_stamp":"2023-07-14T18:11:07.665746+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:52:43.536254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":20,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:11:14.791290+0000","last_change":"2023-07-14T18:11:09.707486+0000","last_active":"2023-07-14T18:11:14.791290+0000","last_peered":"2023-07-14T18:11:14.791290+0000","last_clean":"2023-07-14T18:11:14.791290+0000","last_became_active":"2023-07-14T18:11:09.707168+0000","last_became_peered":"2023-07-14T18:11:09.707168+0000","last_unstale":"2023-07-14T18:11:14.791290+0000","last_undegraded":"2023-07-14T18:11:14.791290+0000","last_fullsized":"2023-07-14T18:11:14.791290+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_clean_scrub_stamp":"2023-07-14T18:11:08.667354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T06:10:06.422348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":13,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:11:14.885841+0000","last_change":"2023-07-14T18:11:13.905898+0000","last_active":"2023-07-14T18:11:14.885841+0000","last_peered":"2023-07-14T18:11:14.885841+0000","last_clean":"2023-07-14T18:11:14.885841+0000","last_became_active":"2023-07-14T18:11:13.905482+0000","last_became_peered":"2023-07-14T18:11:13.905482+0000","last_unstale":"2023-07-14T18:11:14.885841+0000","last_undegraded":"2023-07-14T18:11:14.885841+0000","last_fullsized":"2023-07-14T18:11:14.885841+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:12.753466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:12.753466+0000","last_clean_scrub_stamp":"2023-07-14T18:11:12.753466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T01:29:14.269244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"84'9","reported_seq":31,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:11:33.596873+0000","last_change":"2023-07-14T18:11:08.692339+0000","last_active":"2023-07-14T18:11:33.596873+0000","last_peered":"2023-07-14T18:11:33.596873+0000","last_clean":"2023-07-14T18:11:33.596873+0000","last_became_active":"2023-07-14T18:11:08.692047+0000","last_became_peered":"2023-07-14T18:11:08.692047+0000","last_unstale":"2023-07-14T18:11:33.596873+0000","last_undegraded":"2023-07-14T18:11:33.596873+0000","last_fullsized":"2023-07-14T18:11:33.596873+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:07.665746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:07.665746+0000","last_clean_scrub_stamp":"2023-07-14T18:11:07.665746+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:12:32.523480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":20,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:11:14.886517+0000","last_change":"2023-07-14T18:11:09.709900+0000","last_active":"2023-07-14T18:11:14.886517+0000","last_peered":"2023-07-14T18:11:14.886517+0000","last_clean":"2023-07-14T18:11:14.886517+0000","last_became_active":"2023-07-14T18:11:09.709291+0000","last_became_peered":"2023-07-14T18:11:09.709291+0000","last_unstale":"2023-07-14T18:11:14.886517+0000","last_undegraded":"2023-07-14T18:11:14.886517+0000","last_fullsized":"2023-07-14T18:11:14.886517+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_clean_scrub_stamp":"2023-07-14T18:11:08.667354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:28:37.556066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":13,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:11:14.884032+0000","last_change":"2023-07-14T18:11:13.777493+0000","last_active":"2023-07-14T18:11:14.884032+0000","last_peered":"2023-07-14T18:11:14.884032+0000","last_clean":"2023-07-14T18:11:14.884032+0000","last_became_active":"2023-07-14T18:11:13.777110+0000","last_became_peered":"2023-07-14T18:11:13.777110+0000","last_unstale":"2023-07-14T18:11:14.884032+0000","last_undegraded":"2023-07-14T18:11:14.884032+0000","last_fullsized":"2023-07-14T18:11:14.884032+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:12.753466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:12.753466+0000","last_clean_scrub_stamp":"2023-07-14T18:11:12.753466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T04:26:56.453763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"84'7","reported_seq":30,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:11:30.772553+0000","last_change":"2023-07-14T18:11:08.686832+0000","last_active":"2023-07-14T18:11:30.772553+0000","last_peered":"2023-07-14T18:11:30.772553+0000","last_clean":"2023-07-14T18:11:30.772553+0000","last_became_active":"2023-07-14T18:11:08.686461+0000","last_became_peered":"2023-07-14T18:11:08.686461+0000","last_unstale":"2023-07-14T18:11:30.772553+0000","last_undegraded":"2023-07-14T18:11:30.772553+0000","last_fullsized":"2023-07-14T18:11:30.772553+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:07.665746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:07.665746+0000","last_clean_scrub_stamp":"2023-07-14T18:11:07.665746+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:28:44.517803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":20,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:11:14.884614+0000","last_change":"2023-07-14T18:11:09.715641+0000","last_active":"2023-07-14T18:11:14.884614+0000","last_peered":"2023-07-14T18:11:14.884614+0000","last_clean":"2023-07-14T18:11:14.884614+0000","last_became_active":"2023-07-14T18:11:09.715312+0000","last_became_peered":"2023-07-14T18:11:09.715312+0000","last_unstale":"2023-07-14T18:11:14.884614+0000","last_undegraded":"2023-07-14T18:11:14.884614+0000","last_fullsized":"2023-07-14T18:11:14.884614+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_clean_scrub_stamp":"2023-07-14T18:11:08.667354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:42:02.097258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":13,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:11:14.886127+0000","last_change":"2023-07-14T18:11:13.905856+0000","last_active":"2023-07-14T18:11:14.886127+0000","last_peered":"2023-07-14T18:11:14.886127+0000","last_clean":"2023-07-14T18:11:14.886127+0000","last_became_active":"2023-07-14T18:11:13.905441+0000","last_became_peered":"2023-07-14T18:11:13.905441+0000","last_unstale":"2023-07-14T18:11:14.886127+0000","last_undegraded":"2023-07-14T18:11:14.886127+0000","last_fullsized":"2023-07-14T18:11:14.886127+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:12.753466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:12.753466+0000","last_clean_scrub_stamp":"2023-07-14T18:11:12.753466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T04:13:12.089073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,9],"acting":[4,5,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"84'2","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:11:27.817107+0000","last_change":"2023-07-14T18:11:08.685683+0000","last_active":"2023-07-14T18:11:27.817107+0000","last_peered":"2023-07-14T18:11:27.817107+0000","last_clean":"2023-07-14T18:11:27.817107+0000","last_became_active":"2023-07-14T18:11:08.685371+0000","last_became_peered":"2023-07-14T18:11:08.685371+0000","last_unstale":"2023-07-14T18:11:27.817107+0000","last_undegraded":"2023-07-14T18:11:27.817107+0000","last_fullsized":"2023-07-14T18:11:27.817107+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:07.665746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:07.665746+0000","last_clean_scrub_stamp":"2023-07-14T18:11:07.665746+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:19:35.470859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":20,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:11:14.884696+0000","last_change":"2023-07-14T18:11:09.711219+0000","last_active":"2023-07-14T18:11:14.884696+0000","last_peered":"2023-07-14T18:11:14.884696+0000","last_clean":"2023-07-14T18:11:14.884696+0000","last_became_active":"2023-07-14T18:11:09.711019+0000","last_became_peered":"2023-07-14T18:11:09.711019+0000","last_unstale":"2023-07-14T18:11:14.884696+0000","last_undegraded":"2023-07-14T18:11:14.884696+0000","last_fullsized":"2023-07-14T18:11:14.884696+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_clean_scrub_stamp":"2023-07-14T18:11:08.667354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:14:56.588616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":13,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:11:14.887189+0000","last_change":"2023-07-14T18:11:13.788530+0000","last_active":"2023-07-14T18:11:14.887189+0000","last_peered":"2023-07-14T18:11:14.887189+0000","last_clean":"2023-07-14T18:11:14.887189+0000","last_became_active":"2023-07-14T18:11:13.787952+0000","last_became_peered":"2023-07-14T18:11:13.787952+0000","last_unstale":"2023-07-14T18:11:14.887189+0000","last_undegraded":"2023-07-14T18:11:14.887189+0000","last_fullsized":"2023-07-14T18:11:14.887189+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:12.753466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:12.753466+0000","last_clean_scrub_stamp":"2023-07-14T18:11:12.753466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:19:37.880630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.9","version":"84'7","reported_seq":29,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:11:30.772567+0000","last_change":"2023-07-14T18:11:08.692719+0000","last_active":"2023-07-14T18:11:30.772567+0000","last_peered":"2023-07-14T18:11:30.772567+0000","last_clean":"2023-07-14T18:11:30.772567+0000","last_became_active":"2023-07-14T18:11:08.692390+0000","last_became_peered":"2023-07-14T18:11:08.692390+0000","last_unstale":"2023-07-14T18:11:30.772567+0000","last_undegraded":"2023-07-14T18:11:30.772567+0000","last_fullsized":"2023-07-14T18:11:30.772567+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:07.665746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:07.665746+0000","last_clean_scrub_stamp":"2023-07-14T18:11:07.665746+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T04:19:14.229274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":20,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:11:15.116807+0000","last_change":"2023-07-14T18:11:09.719176+0000","last_active":"2023-07-14T18:11:15.116807+0000","last_peered":"2023-07-14T18:11:15.116807+0000","last_clean":"2023-07-14T18:11:15.116807+0000","last_became_active":"2023-07-14T18:11:09.712667+0000","last_became_peered":"2023-07-14T18:11:09.712667+0000","last_unstale":"2023-07-14T18:11:15.116807+0000","last_undegraded":"2023-07-14T18:11:15.116807+0000","last_fullsized":"2023-07-14T18:11:15.116807+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_clean_scrub_stamp":"2023-07-14T18:11:08.667354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:13:03.473559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.c","version":"84'1","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:11:17.415960+0000","last_change":"2023-07-14T18:11:13.791717+0000","last_active":"2023-07-14T18:11:17.415960+0000","last_peered":"2023-07-14T18:11:17.415960+0000","last_clean":"2023-07-14T18:11:17.415960+0000","last_became_active":"2023-07-14T18:11:13.791280+0000","last_became_peered":"2023-07-14T18:11:13.791280+0000","last_unstale":"2023-07-14T18:11:17.415960+0000","last_undegraded":"2023-07-14T18:11:17.415960+0000","last_fullsized":"2023-07-14T18:11:17.415960+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:12.753466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:12.753466+0000","last_clean_scrub_stamp":"2023-07-14T18:11:12.753466+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:02:11.918589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":123,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9,7,8],"acting":[4,9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"84'3","reported_seq":25,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:11:32.074026+0000","last_change":"2023-07-14T18:11:08.692842+0000","last_active":"2023-07-14T18:11:32.074026+0000","last_peered":"2023-07-14T18:11:32.074026+0000","last_clean":"2023-07-14T18:11:32.074026+0000","last_became_active":"2023-07-14T18:11:08.692534+0000","last_became_peered":"2023-07-14T18:11:08.692534+0000","last_unstale":"2023-07-14T18:11:32.074026+0000","last_undegraded":"2023-07-14T18:11:32.074026+0000","last_fullsized":"2023-07-14T18:11:32.074026+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:07.665746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:07.665746+0000","last_clean_scrub_stamp":"2023-07-14T18:11:07.665746+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T06:10:00.305017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":20,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:11:14.885673+0000","last_change":"2023-07-14T18:11:09.703665+0000","last_active":"2023-07-14T18:11:14.885673+0000","last_peered":"2023-07-14T18:11:14.885673+0000","last_clean":"2023-07-14T18:11:14.885673+0000","last_became_active":"2023-07-14T18:11:09.703288+0000","last_became_peered":"2023-07-14T18:11:09.703288+0000","last_unstale":"2023-07-14T18:11:14.885673+0000","last_undegraded":"2023-07-14T18:11:14.885673+0000","last_fullsized":"2023-07-14T18:11:14.885673+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_clean_scrub_stamp":"2023-07-14T18:11:08.667354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:03:08.989108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":13,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:11:14.885620+0000","last_change":"2023-07-14T18:11:13.904604+0000","last_active":"2023-07-14T18:11:14.885620+0000","last_peered":"2023-07-14T18:11:14.885620+0000","last_clean":"2023-07-14T18:11:14.885620+0000","last_became_active":"2023-07-14T18:11:13.904245+0000","last_became_peered":"2023-07-14T18:11:13.904245+0000","last_unstale":"2023-07-14T18:11:14.885620+0000","last_undegraded":"2023-07-14T18:11:14.885620+0000","last_fullsized":"2023-07-14T18:11:14.885620+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:12.753466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:12.753466+0000","last_clean_scrub_stamp":"2023-07-14T18:11:12.753466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:22:17.468414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.b","version":"84'4","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:11:27.818020+0000","last_change":"2023-07-14T18:11:08.689876+0000","last_active":"2023-07-14T18:11:27.818020+0000","last_peered":"2023-07-14T18:11:27.818020+0000","last_clean":"2023-07-14T18:11:27.818020+0000","last_became_active":"2023-07-14T18:11:08.689582+0000","last_became_peered":"2023-07-14T18:11:08.689582+0000","last_unstale":"2023-07-14T18:11:27.818020+0000","last_undegraded":"2023-07-14T18:11:27.818020+0000","last_fullsized":"2023-07-14T18:11:27.818020+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:07.665746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:07.665746+0000","last_clean_scrub_stamp":"2023-07-14T18:11:07.665746+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:43:59.769036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":18,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:11:14.885962+0000","last_change":"2023-07-14T18:11:09.708228+0000","last_active":"2023-07-14T18:11:14.885962+0000","last_peered":"2023-07-14T18:11:14.885962+0000","last_clean":"2023-07-14T18:11:14.885962+0000","last_became_active":"2023-07-14T18:11:09.707985+0000","last_became_peered":"2023-07-14T18:11:09.707985+0000","last_unstale":"2023-07-14T18:11:14.885962+0000","last_undegraded":"2023-07-14T18:11:14.885962+0000","last_fullsized":"2023-07-14T18:11:14.885962+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_clean_scrub_stamp":"2023-07-14T18:11:08.667354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:01:49.217181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":13,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:11:14.884724+0000","last_change":"2023-07-14T18:11:13.775297+0000","last_active":"2023-07-14T18:11:14.884724+0000","last_peered":"2023-07-14T18:11:14.884724+0000","last_clean":"2023-07-14T18:11:14.884724+0000","last_became_active":"2023-07-14T18:11:13.774857+0000","last_became_peered":"2023-07-14T18:11:13.774857+0000","last_unstale":"2023-07-14T18:11:14.884724+0000","last_undegraded":"2023-07-14T18:11:14.884724+0000","last_fullsized":"2023-07-14T18:11:14.884724+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:12.753466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:12.753466+0000","last_clean_scrub_stamp":"2023-07-14T18:11:12.753466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:27:32.913667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.c","version":"84'5","reported_seq":69,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:12:08.827221+0000","last_change":"2023-07-14T18:11:08.689560+0000","last_active":"2023-07-14T18:12:08.827221+0000","last_peered":"2023-07-14T18:12:08.827221+0000","last_clean":"2023-07-14T18:12:08.827221+0000","last_became_active":"2023-07-14T18:11:08.689249+0000","last_became_peered":"2023-07-14T18:11:08.689249+0000","last_unstale":"2023-07-14T18:12:08.827221+0000","last_undegraded":"2023-07-14T18:12:08.827221+0000","last_fullsized":"2023-07-14T18:12:08.827221+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:07.665746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:07.665746+0000","last_clean_scrub_stamp":"2023-07-14T18:11:07.665746+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:02:04.221663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1122,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":42,"num_read_kb":2,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":18,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:11:14.885567+0000","last_change":"2023-07-14T18:11:09.720321+0000","last_active":"2023-07-14T18:11:14.885567+0000","last_peered":"2023-07-14T18:11:14.885567+0000","last_clean":"2023-07-14T18:11:14.885567+0000","last_became_active":"2023-07-14T18:11:09.720080+0000","last_became_peered":"2023-07-14T18:11:09.720080+0000","last_unstale":"2023-07-14T18:11:14.885567+0000","last_undegraded":"2023-07-14T18:11:14.885567+0000","last_fullsized":"2023-07-14T18:11:14.885567+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_clean_scrub_stamp":"2023-07-14T18:11:08.667354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T02:20:48.603885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":13,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:11:14.884372+0000","last_change":"2023-07-14T18:11:13.779349+0000","last_active":"2023-07-14T18:11:14.884372+0000","last_peered":"2023-07-14T18:11:14.884372+0000","last_clean":"2023-07-14T18:11:14.884372+0000","last_became_active":"2023-07-14T18:11:13.778946+0000","last_became_peered":"2023-07-14T18:11:13.778946+0000","last_unstale":"2023-07-14T18:11:14.884372+0000","last_undegraded":"2023-07-14T18:11:14.884372+0000","last_fullsized":"2023-07-14T18:11:14.884372+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:12.753466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:12.753466+0000","last_clean_scrub_stamp":"2023-07-14T18:11:12.753466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T04:25:22.766441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9,1,4],"acting":[0,9,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"84'3","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:11:30.764580+0000","last_change":"2023-07-14T18:11:08.683760+0000","last_active":"2023-07-14T18:11:30.764580+0000","last_peered":"2023-07-14T18:11:30.764580+0000","last_clean":"2023-07-14T18:11:30.764580+0000","last_became_active":"2023-07-14T18:11:08.683461+0000","last_became_peered":"2023-07-14T18:11:08.683461+0000","last_unstale":"2023-07-14T18:11:30.764580+0000","last_undegraded":"2023-07-14T18:11:30.764580+0000","last_fullsized":"2023-07-14T18:11:30.764580+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:07.665746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:07.665746+0000","last_clean_scrub_stamp":"2023-07-14T18:11:07.665746+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:26:31.918002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":18,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:11:14.884846+0000","last_change":"2023-07-14T18:11:09.708701+0000","last_active":"2023-07-14T18:11:14.884846+0000","last_peered":"2023-07-14T18:11:14.884846+0000","last_clean":"2023-07-14T18:11:14.884846+0000","last_became_active":"2023-07-14T18:11:09.708410+0000","last_became_peered":"2023-07-14T18:11:09.708410+0000","last_unstale":"2023-07-14T18:11:14.884846+0000","last_undegraded":"2023-07-14T18:11:14.884846+0000","last_fullsized":"2023-07-14T18:11:14.884846+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_clean_scrub_stamp":"2023-07-14T18:11:08.667354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T05:04:14.745169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":13,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:11:14.790903+0000","last_change":"2023-07-14T18:11:13.776584+0000","last_active":"2023-07-14T18:11:14.790903+0000","last_peered":"2023-07-14T18:11:14.790903+0000","last_clean":"2023-07-14T18:11:14.790903+0000","last_became_active":"2023-07-14T18:11:13.775288+0000","last_became_peered":"2023-07-14T18:11:13.775288+0000","last_unstale":"2023-07-14T18:11:14.790903+0000","last_undegraded":"2023-07-14T18:11:14.790903+0000","last_fullsized":"2023-07-14T18:11:14.790903+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:12.753466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:12.753466+0000","last_clean_scrub_stamp":"2023-07-14T18:11:12.753466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T02:35:47.441794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"84'5","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:11:30.770745+0000","last_change":"2023-07-14T18:11:08.687332+0000","last_active":"2023-07-14T18:11:30.770745+0000","last_peered":"2023-07-14T18:11:30.770745+0000","last_clean":"2023-07-14T18:11:30.770745+0000","last_became_active":"2023-07-14T18:11:08.686902+0000","last_became_peered":"2023-07-14T18:11:08.686902+0000","last_unstale":"2023-07-14T18:11:30.770745+0000","last_undegraded":"2023-07-14T18:11:30.770745+0000","last_fullsized":"2023-07-14T18:11:30.770745+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:07.665746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:07.665746+0000","last_clean_scrub_stamp":"2023-07-14T18:11:07.665746+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:33:50.338931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":18,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:11:14.886168+0000","last_change":"2023-07-14T18:11:09.719308+0000","last_active":"2023-07-14T18:11:14.886168+0000","last_peered":"2023-07-14T18:11:14.886168+0000","last_clean":"2023-07-14T18:11:14.886168+0000","last_became_active":"2023-07-14T18:11:09.719038+0000","last_became_peered":"2023-07-14T18:11:09.719038+0000","last_unstale":"2023-07-14T18:11:14.886168+0000","last_undegraded":"2023-07-14T18:11:14.886168+0000","last_fullsized":"2023-07-14T18:11:14.886168+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_clean_scrub_stamp":"2023-07-14T18:11:08.667354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:21:02.431834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":20,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:11:15.116944+0000","last_change":"2023-07-14T18:11:09.710991+0000","last_active":"2023-07-14T18:11:15.116944+0000","last_peered":"2023-07-14T18:11:15.116944+0000","last_clean":"2023-07-14T18:11:15.116944+0000","last_became_active":"2023-07-14T18:11:09.710689+0000","last_became_peered":"2023-07-14T18:11:09.710689+0000","last_unstale":"2023-07-14T18:11:15.116944+0000","last_undegraded":"2023-07-14T18:11:15.116944+0000","last_fullsized":"2023-07-14T18:11:15.116944+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_clean_scrub_stamp":"2023-07-14T18:11:08.667354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:46:01.500390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":20,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:11:14.884240+0000","last_change":"2023-07-14T18:11:09.711793+0000","last_active":"2023-07-14T18:11:14.884240+0000","last_peered":"2023-07-14T18:11:14.884240+0000","last_clean":"2023-07-14T18:11:14.884240+0000","last_became_active":"2023-07-14T18:11:09.711488+0000","last_became_peered":"2023-07-14T18:11:09.711488+0000","last_unstale":"2023-07-14T18:11:14.884240+0000","last_undegraded":"2023-07-14T18:11:14.884240+0000","last_fullsized":"2023-07-14T18:11:14.884240+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_clean_scrub_stamp":"2023-07-14T18:11:08.667354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:57:04.042308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":20,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:11:14.883995+0000","last_change":"2023-07-14T18:11:09.707835+0000","last_active":"2023-07-14T18:11:14.883995+0000","last_peered":"2023-07-14T18:11:14.883995+0000","last_clean":"2023-07-14T18:11:14.883995+0000","last_became_active":"2023-07-14T18:11:09.706863+0000","last_became_peered":"2023-07-14T18:11:09.706863+0000","last_unstale":"2023-07-14T18:11:14.883995+0000","last_undegraded":"2023-07-14T18:11:14.883995+0000","last_fullsized":"2023-07-14T18:11:14.883995+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_clean_scrub_stamp":"2023-07-14T18:11:08.667354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T02:34:34.215440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":20,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:11:14.884701+0000","last_change":"2023-07-14T18:11:09.714879+0000","last_active":"2023-07-14T18:11:14.884701+0000","last_peered":"2023-07-14T18:11:14.884701+0000","last_clean":"2023-07-14T18:11:14.884701+0000","last_became_active":"2023-07-14T18:11:09.714583+0000","last_became_peered":"2023-07-14T18:11:09.714583+0000","last_unstale":"2023-07-14T18:11:14.884701+0000","last_undegraded":"2023-07-14T18:11:14.884701+0000","last_fullsized":"2023-07-14T18:11:14.884701+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_clean_scrub_stamp":"2023-07-14T18:11:08.667354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T03:37:12.524327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":20,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:11:14.790997+0000","last_change":"2023-07-14T18:11:09.710850+0000","last_active":"2023-07-14T18:11:14.790997+0000","last_peered":"2023-07-14T18:11:14.790997+0000","last_clean":"2023-07-14T18:11:14.790997+0000","last_became_active":"2023-07-14T18:11:09.710533+0000","last_became_peered":"2023-07-14T18:11:09.710533+0000","last_unstale":"2023-07-14T18:11:14.790997+0000","last_undegraded":"2023-07-14T18:11:14.790997+0000","last_fullsized":"2023-07-14T18:11:14.790997+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_clean_scrub_stamp":"2023-07-14T18:11:08.667354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T02:32:10.888054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":20,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:11:15.117230+0000","last_change":"2023-07-14T18:11:09.710457+0000","last_active":"2023-07-14T18:11:15.117230+0000","last_peered":"2023-07-14T18:11:15.117230+0000","last_clean":"2023-07-14T18:11:15.117230+0000","last_became_active":"2023-07-14T18:11:09.710163+0000","last_became_peered":"2023-07-14T18:11:09.710163+0000","last_unstale":"2023-07-14T18:11:15.117230+0000","last_undegraded":"2023-07-14T18:11:15.117230+0000","last_fullsized":"2023-07-14T18:11:15.117230+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_clean_scrub_stamp":"2023-07-14T18:11:08.667354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:05:12.700623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":20,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:11:14.884622+0000","last_change":"2023-07-14T18:11:09.709062+0000","last_active":"2023-07-14T18:11:14.884622+0000","last_peered":"2023-07-14T18:11:14.884622+0000","last_clean":"2023-07-14T18:11:14.884622+0000","last_became_active":"2023-07-14T18:11:09.708767+0000","last_became_peered":"2023-07-14T18:11:09.708767+0000","last_unstale":"2023-07-14T18:11:14.884622+0000","last_undegraded":"2023-07-14T18:11:14.884622+0000","last_fullsized":"2023-07-14T18:11:14.884622+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_clean_scrub_stamp":"2023-07-14T18:11:08.667354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T01:00:42.739345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":20,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:11:14.886746+0000","last_change":"2023-07-14T18:11:09.707279+0000","last_active":"2023-07-14T18:11:14.886746+0000","last_peered":"2023-07-14T18:11:14.886746+0000","last_clean":"2023-07-14T18:11:14.886746+0000","last_became_active":"2023-07-14T18:11:09.706972+0000","last_became_peered":"2023-07-14T18:11:09.706972+0000","last_unstale":"2023-07-14T18:11:14.886746+0000","last_undegraded":"2023-07-14T18:11:14.886746+0000","last_fullsized":"2023-07-14T18:11:14.886746+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_clean_scrub_stamp":"2023-07-14T18:11:08.667354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:02:52.034920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":20,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:11:14.791002+0000","last_change":"2023-07-14T18:11:09.709710+0000","last_active":"2023-07-14T18:11:14.791002+0000","last_peered":"2023-07-14T18:11:14.791002+0000","last_clean":"2023-07-14T18:11:14.791002+0000","last_became_active":"2023-07-14T18:11:09.709438+0000","last_became_peered":"2023-07-14T18:11:09.709438+0000","last_unstale":"2023-07-14T18:11:14.791002+0000","last_undegraded":"2023-07-14T18:11:14.791002+0000","last_fullsized":"2023-07-14T18:11:14.791002+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_clean_scrub_stamp":"2023-07-14T18:11:08.667354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T02:06:46.155849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":20,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:11:14.884619+0000","last_change":"2023-07-14T18:11:09.720216+0000","last_active":"2023-07-14T18:11:14.884619+0000","last_peered":"2023-07-14T18:11:14.884619+0000","last_clean":"2023-07-14T18:11:14.884619+0000","last_became_active":"2023-07-14T18:11:09.719775+0000","last_became_peered":"2023-07-14T18:11:09.719775+0000","last_unstale":"2023-07-14T18:11:14.884619+0000","last_undegraded":"2023-07-14T18:11:14.884619+0000","last_fullsized":"2023-07-14T18:11:14.884619+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_clean_scrub_stamp":"2023-07-14T18:11:08.667354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T03:06:39.685042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":20,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:11:14.885075+0000","last_change":"2023-07-14T18:11:09.708462+0000","last_active":"2023-07-14T18:11:14.885075+0000","last_peered":"2023-07-14T18:11:14.885075+0000","last_clean":"2023-07-14T18:11:14.885075+0000","last_became_active":"2023-07-14T18:11:09.705611+0000","last_became_peered":"2023-07-14T18:11:09.705611+0000","last_unstale":"2023-07-14T18:11:14.885075+0000","last_undegraded":"2023-07-14T18:11:14.885075+0000","last_fullsized":"2023-07-14T18:11:14.885075+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_clean_scrub_stamp":"2023-07-14T18:11:08.667354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:45:55.084603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":20,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:11:14.790949+0000","last_change":"2023-07-14T18:11:09.707560+0000","last_active":"2023-07-14T18:11:14.790949+0000","last_peered":"2023-07-14T18:11:14.790949+0000","last_clean":"2023-07-14T18:11:14.790949+0000","last_became_active":"2023-07-14T18:11:09.707216+0000","last_became_peered":"2023-07-14T18:11:09.707216+0000","last_unstale":"2023-07-14T18:11:14.790949+0000","last_undegraded":"2023-07-14T18:11:14.790949+0000","last_fullsized":"2023-07-14T18:11:14.790949+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_clean_scrub_stamp":"2023-07-14T18:11:08.667354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T05:53:45.047425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":20,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-14T18:11:15.117017+0000","last_change":"2023-07-14T18:11:09.712059+0000","last_active":"2023-07-14T18:11:15.117017+0000","last_peered":"2023-07-14T18:11:15.117017+0000","last_clean":"2023-07-14T18:11:15.117017+0000","last_became_active":"2023-07-14T18:11:09.711759+0000","last_became_peered":"2023-07-14T18:11:09.711759+0000","last_unstale":"2023-07-14T18:11:15.117017+0000","last_undegraded":"2023-07-14T18:11:15.117017+0000","last_fullsized":"2023-07-14T18:11:15.117017+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_clean_scrub_stamp":"2023-07-14T18:11:08.667354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:30:03.374413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":246,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":32768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4157440,"data_stored":4132576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":67457,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":417,"num_read_kb":282,"num_write":233,"num_write_kb":133,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":565248,"data_stored":202371,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":205,"ondisk_log_size":205,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":75,"seq":322122547224,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27932,"kb_used_data":916,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717220,"statfs":{"total":95995035648,"available":95966433280,"internally_reserved":0,"allocated":937984,"data_stored":454796,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 18:11:30 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"last":0.70399999999999996},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"last":0.626}]},{"osd":1,"last update":"Fri Jul 14 18:11:30 2023","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.76600000000000001}]},{"osd":2,"last update":"Fri Jul 14 18:11:30 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.38400000000000001},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"last":0.40899999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35399999999999998}]},{"osd":4,"last update":"Fri Jul 14 18:11:30 2023","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.65100000000000002}]},{"osd":5,"last update":"Fri Jul 14 18:11:30 2023","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.63,"5min":0.63,"15min":0.63},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.51300000000000001}]},{"osd":6,"last update":"Fri Jul 14 18:11:30 2023","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.91600000000000004,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.749,"5min":0.749,"15min":0.749},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.68300000000000005}]},{"osd":7,"last update":"Fri Jul 14 18:11:30 2023","interfaces":[{"interface":"back","average":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":0.95699999999999996,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":0.99299999999999999,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.73599999999999999}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.495}]},{"osd":9,"last update":"Fri Jul 14 18:11:30 2023","interfaces":[{"interface":"back","average":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":1.1419999999999999,"5min":1.1419999999999999,"15min":1.1419999999999999},"last":0.751},{"interface":"front","average":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.042,"5min":1.042,"15min":1.042},"last":0.66900000000000004}]},{"osd":10,"last update":"Fri Jul 14 18:11:30 2023","interfaces":[{"interface":"back","average":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.0800000000000001,"5min":1.0800000000000001,"15min":1.0800000000000001},"last":0.80200000000000005},{"interface":"front","average":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.177,"5min":1.177,"15min":1.177},"last":0.77600000000000002}]}]},{"osd":10,"up_from":68,"seq":292057776155,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28604,"kb_used_data":1588,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716548,"statfs":{"total":95995035648,"available":95965745152,"internally_reserved":0,"allocated":1626112,"data_stored":1102508,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55600000000000005}]},{"osd":1,"last update":"Fri Jul 14 18:11:09 2023","interfaces":[{"interface":"back","average":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"last":0.34799999999999998},{"interface":"front","average":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"last":0.38100000000000001}]},{"osd":2,"last update":"Fri Jul 14 18:11:09 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":0.84799999999999998,"5min":0.84799999999999998,"15min":0.84799999999999998},"last":0.66400000000000003}]},{"osd":3,"last update":"Fri Jul 14 18:11:09 2023","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.96099999999999997,"5min":0.96099999999999997,"15min":0.96099999999999997},"last":0.42099999999999999},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":0.95099999999999996,"5min":0.95099999999999996,"15min":0.95099999999999996},"last":0.52200000000000002}]},{"osd":4,"last update":"Fri Jul 14 18:11:09 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"last":0.47299999999999998},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.97599999999999998,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.48299999999999998}]},{"osd":5,"last update":"Fri Jul 14 18:11:09 2023","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":1.0049999999999999,"5min":1.0049999999999999,"15min":1.0049999999999999},"last":0.72499999999999998},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":0.89500000000000002},"last":0.63100000000000001}]},{"osd":6,"last update":"Fri Jul 14 18:11:09 2023","interfaces":[{"interface":"back","average":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.004,"5min":1.004,"15min":1.004},"last":0.50800000000000001},{"interface":"front","average":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"min":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.1040000000000001,"5min":1.1040000000000001,"15min":1.1040000000000001},"last":0.61599999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49399999999999999}]},{"osd":8,"last update":"Fri Jul 14 18:11:09 2023","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":0.753,"15min":0.753},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":1.038,"5min":1.038,"15min":1.038},"last":0.74399999999999999},{"interface":"front","average":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.0820000000000001,"5min":1.0820000000000001,"15min":1.0820000000000001},"last":0.68200000000000005}]},{"osd":9,"last update":"Fri Jul 14 18:11:09 2023","interfaces":[{"interface":"back","average":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"min":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"max":{"1min":1.018,"5min":1.018,"15min":1.018},"last":0.64800000000000002},{"interface":"front","average":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"min":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"max":{"1min":1.228,"5min":1.228,"15min":1.228},"last":0.53600000000000003}]},{"osd":11,"last update":"Fri Jul 14 18:11:27 2023","interfaces":[{"interface":"back","average":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":0.97899999999999998,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.69599999999999995},{"interface":"front","average":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.0309999999999999,"5min":1.0309999999999999,"15min":1.0309999999999999},"last":0.70799999999999996}]}]},{"osd":9,"up_from":63,"seq":270582939680,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27960,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717192,"statfs":{"total":95995035648,"available":95966404608,"internally_reserved":0,"allocated":966656,"data_stored":458870,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 18:11:50 2023","interfaces":[{"interface":"back","average":{"1min":0.35299999999999998,"5min":0.41299999999999998,"15min":0.42299999999999999},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.622,"5min":0.63200000000000001,"15min":0.63200000000000001},"last":0.32200000000000001},{"interface":"front","average":{"1min":0.37,"5min":0.432,"15min":0.442},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.57499999999999996,"5min":0.68899999999999995,"15min":0.68899999999999995},"last":0.34699999999999998}]},{"osd":1,"last update":"Fri Jul 14 18:11:50 2023","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.57599999999999996,"15min":0.58399999999999996},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.93100000000000005,"5min":0.94099999999999995,"15min":0.94099999999999995},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.59499999999999997,"15min":0.60499999999999998},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.73999999999999999,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.47499999999999998}]},{"osd":2,"last update":"Fri Jul 14 18:11:50 2023","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.59799999999999998,"15min":0.60599999999999998},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.81200000000000006,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.63700000000000001},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.61799999999999999,"15min":0.627},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.76100000000000001,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.54000000000000004}]},{"osd":3,"last update":"Fri Jul 14 18:11:50 2023","interfaces":[{"interface":"back","average":{"1min":0.40600000000000003,"5min":0.51300000000000001,"15min":0.53100000000000003},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.64200000000000002,"5min":0.75700000000000001,"15min":0.75700000000000001},"last":0.28000000000000003},{"interface":"front","average":{"1min":0.40699999999999997,"5min":0.51300000000000001,"15min":0.53100000000000003},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":0.58499999999999996,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.30399999999999999}]},{"osd":4,"last update":"Fri Jul 14 18:11:50 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.65900000000000003,"15min":0.67800000000000005},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.84299999999999997,"5min":0.95499999999999996,"15min":0.95499999999999996},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.64900000000000002,"15min":0.65900000000000003},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.90300000000000002,"5min":1,"15min":1},"last":0.629}]},{"osd":5,"last update":"Fri Jul 14 18:11:50 2023","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.68000000000000005,"15min":0.69499999999999995},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.80300000000000005,"5min":1.093,"15min":1.093},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.67800000000000005,"15min":0.69399999999999995},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.89100000000000001,"5min":1.1100000000000001,"15min":1.1100000000000001},"last":0.49299999999999999}]},{"osd":6,"last update":"Fri Jul 14 18:10:48 2023","interfaces":[{"interface":"back","average":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":1.069,"5min":1.069,"15min":1.069},"last":0.45800000000000002},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":1.0409999999999999,"5min":1.0409999999999999,"15min":1.0409999999999999},"last":0.57799999999999996}]},{"osd":7,"last update":"Fri Jul 14 18:11:50 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.71199999999999997,"15min":0.72899999999999998},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.92500000000000004,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.68300000000000005},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.71699999999999997,"15min":0.73599999999999999},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.85399999999999998,"5min":1.1890000000000001,"15min":1.1890000000000001},"last":0.59499999999999997}]},{"osd":8,"last update":"Fri Jul 14 18:11:50 2023","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.74399999999999999,"15min":0.76200000000000001},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.79900000000000004,"5min":1.127,"15min":1.127},"last":0.50700000000000001},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.75700000000000001,"15min":0.77500000000000002},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":0.86699999999999999,"5min":1.167,"15min":1.167},"last":0.52600000000000002}]},{"osd":10,"last update":"Fri Jul 14 18:11:08 2023","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.99099999999999999,"5min":0.99099999999999999,"15min":0.99099999999999999},"last":0.65800000000000003},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.0569999999999999,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":0.66600000000000004}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64700000000000002}]}]},{"osd":8,"up_from":56,"seq":240518168613,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27948,"kb_used_data":932,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717204,"statfs":{"total":95995035648,"available":95966416896,"internally_reserved":0,"allocated":954368,"data_stored":454871,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 18:11:29 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.54100000000000004,"15min":0.54200000000000004},"min":{"1min":0.40699999999999997,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.68300000000000005,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.51200000000000001,"5min":0.51900000000000002,"15min":0.52000000000000002},"min":{"1min":0.36199999999999999,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.75,"5min":0.78200000000000003,"15min":0.78200000000000003},"last":0.55200000000000005}]},{"osd":1,"last update":"Fri Jul 14 18:11:29 2023","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.61299999999999999,"15min":0.60999999999999999},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.93100000000000005,"5min":1.036,"15min":1.036},"last":0.90200000000000002},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"min":{"1min":0.40899999999999997,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.89500000000000002,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.81100000000000005}]},{"osd":2,"last update":"Fri Jul 14 18:11:29 2023","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.45700000000000002,"15min":0.45100000000000001},"min":{"1min":0.29199999999999998,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":1.032,"5min":1.032,"15min":1.032},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.49099999999999999,"5min":0.47499999999999998,"15min":0.47299999999999998},"min":{"1min":0.33200000000000002,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":1.0449999999999999,"5min":1.0449999999999999,"15min":1.0449999999999999},"last":0.57499999999999996}]},{"osd":3,"last update":"Fri Jul 14 18:11:29 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.57699999999999996,"15min":0.58299999999999996},"min":{"1min":0.42099999999999999,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.69799999999999995,"5min":0.77300000000000002,"15min":0.77300000000000002},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.58799999999999997,"15min":0.58999999999999997},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.77500000000000002,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.626}]},{"osd":4,"last update":"Fri Jul 14 18:11:29 2023","interfaces":[{"interface":"back","average":{"1min":0.77500000000000002,"5min":0.66600000000000004,"15min":0.64800000000000002},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":2.5030000000000001,"5min":2.5030000000000001,"15min":2.5030000000000001},"last":0.68600000000000005},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.63900000000000001,"15min":0.63500000000000001},"min":{"1min":0.40600000000000003,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.749}]},{"osd":5,"last update":"Fri Jul 14 18:11:29 2023","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.59299999999999997,"15min":0.58699999999999997},"min":{"1min":0.36099999999999999,"5min":0.316,"15min":0.316},"max":{"1min":0.98199999999999998,"5min":0.98199999999999998,"15min":0.98199999999999998},"last":0.64600000000000002},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.60099999999999998,"15min":0.59899999999999998},"min":{"1min":0.38600000000000001,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.70799999999999996}]},{"osd":6,"last update":"Fri Jul 14 18:11:29 2023","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"min":{"1min":0.45800000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.90700000000000003,"5min":0.90700000000000003,"15min":0.90700000000000003},"last":0.85199999999999998},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.69799999999999995,"15min":0.70299999999999996},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.89700000000000002,"5min":1.008,"15min":1.008},"last":0.875}]},{"osd":7,"last update":"Fri Jul 14 18:11:29 2023","interfaces":[{"interface":"back","average":{"1min":0.83999999999999997,"5min":0.73799999999999999,"15min":0.72099999999999997},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":2.5550000000000002,"5min":2.5550000000000002,"15min":2.5550000000000002},"last":0.91900000000000004},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.71799999999999997,"15min":0.71499999999999997},"min":{"1min":0.52000000000000002,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.0529999999999999,"5min":1.0529999999999999,"15min":1.0529999999999999},"last":0.73199999999999998}]},{"osd":9,"last update":"Fri Jul 14 18:11:50 2023","interfaces":[{"interface":"back","average":{"1min":0.80800000000000005,"5min":0.70499999999999996,"15min":0.68799999999999994},"min":{"1min":0.57099999999999995,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.0609999999999999,"5min":1.0609999999999999,"15min":1.0609999999999999},"last":0.78900000000000003},{"interface":"front","average":{"1min":0.94699999999999995,"5min":0.745,"15min":0.71099999999999997},"min":{"1min":0.56299999999999994,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":2.5339999999999998,"5min":2.5339999999999998,"15min":2.5339999999999998},"last":0.93500000000000005}]},{"osd":10,"last update":"Fri Jul 14 18:11:09 2023","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.024,"5min":1.024,"15min":1.024},"last":0.94799999999999995},{"interface":"front","average":{"1min":0.745,"5min":0.745,"15min":0.745},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.006,"5min":1.006,"15min":1.006},"last":0.96099999999999997}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83899999999999997}]}]},{"osd":7,"up_from":49,"seq":210453397544,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28536,"kb_used_data":1520,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716616,"statfs":{"total":95995035648,"available":95965814784,"internally_reserved":0,"allocated":1556480,"data_stored":1051504,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 18:11:06 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.55300000000000005,"15min":0.54600000000000004},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"last":0.38400000000000001},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"min":{"1min":0.35599999999999998,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.77900000000000003,"5min":0.84299999999999997,"15min":0.84299999999999997},"last":0.35599999999999998}]},{"osd":1,"last update":"Fri Jul 14 18:12:06 2023","interfaces":[{"interface":"back","average":{"1min":0.42499999999999999,"5min":0.42199999999999999,"15min":0.41499999999999998},"min":{"1min":0.29599999999999999,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.56100000000000005,"5min":0.751,"15min":0.751},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.46200000000000002,"5min":0.44600000000000001,"15min":0.442},"min":{"1min":0.28000000000000003,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.70599999999999996,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.51500000000000001}]},{"osd":2,"last update":"Fri Jul 14 18:12:06 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.58999999999999997,"15min":0.58499999999999996},"min":{"1min":0.35299999999999998,"5min":0.313,"15min":0.313},"max":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"last":0.81200000000000006},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.61299999999999999,"15min":0.61499999999999999},"min":{"1min":0.436,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.75800000000000001,"5min":0.81499999999999995,"15min":0.81499999999999995},"last":0.70099999999999996}]},{"osd":3,"last update":"Fri Jul 14 18:12:06 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.56499999999999995,"15min":0.56200000000000006},"min":{"1min":0.41899999999999998,"5min":0.379,"15min":0.379},"max":{"1min":0.877,"5min":0.877,"15min":0.877},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.60499999999999998,"15min":0.59899999999999998},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.84799999999999998,"5min":0.88100000000000001,"15min":0.88100000000000001},"last":0.68600000000000005}]},{"osd":4,"last update":"Fri Jul 14 18:12:06 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.52700000000000002,"15min":0.52100000000000002},"min":{"1min":0.36099999999999999,"5min":0.316,"15min":0.316},"max":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.63700000000000001},{"interface":"front","average":{"1min":0.47999999999999998,"5min":0.49199999999999999,"15min":0.499},"min":{"1min":0.309,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.65800000000000003,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.56699999999999995}]},{"osd":5,"last update":"Fri Jul 14 18:12:06 2023","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.65700000000000003,"15min":0.66400000000000003},"min":{"1min":0.503,"5min":0.373,"15min":0.373},"max":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"last":0.73999999999999999},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.65500000000000003,"15min":0.65500000000000003},"min":{"1min":0.51700000000000002,"5min":0.38,"15min":0.38},"max":{"1min":0.89200000000000002,"5min":0.89200000000000002,"15min":0.89200000000000002},"last":0.77500000000000002}]},{"osd":6,"last update":"Fri Jul 14 18:12:06 2023","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.67100000000000004,"15min":0.66700000000000004},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":0.90700000000000003,"5min":0.90700000000000003,"15min":0.90700000000000003},"last":0.72099999999999997},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.65200000000000002,"15min":0.66800000000000004},"min":{"1min":0.373,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.84499999999999997,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.65800000000000003}]},{"osd":8,"last update":"Fri Jul 14 18:11:27 2023","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.70899999999999996,"15min":0.70899999999999996},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":0.94399999999999995,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.75800000000000001},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.67700000000000005,"15min":0.67900000000000005},"min":{"1min":0.52400000000000002,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.873,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.873}]},{"osd":9,"last update":"Fri Jul 14 18:11:52 2023","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.66800000000000004,"15min":0.66900000000000004},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.90800000000000003,"5min":0.90800000000000003,"15min":0.90800000000000003},"last":0.84099999999999997},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.747,"15min":0.753},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":0.90800000000000003,"5min":1.0189999999999999,"15min":1.0189999999999999},"last":0.79800000000000004}]},{"osd":10,"last update":"Fri Jul 14 18:12:09 2023","interfaces":[{"interface":"back","average":{"1min":0.751,"5min":0.74199999999999999,"15min":0.73999999999999999},"min":{"1min":0.503,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.024,"5min":1.046,"15min":1.046},"last":0.85699999999999998},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.66100000000000003,"15min":0.65100000000000002},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.878,"5min":0.89500000000000002,"15min":0.89500000000000002},"last":0.89000000000000001}]},{"osd":11,"last update":"Fri Jul 14 18:12:09 2023","interfaces":[{"interface":"back","average":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"min":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"max":{"1min":0.95199999999999996,"5min":0.95199999999999996,"15min":0.95199999999999996},"last":0.92300000000000004},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":0.93400000000000005,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.90700000000000003}]}]},{"osd":6,"up_from":44,"seq":188978561069,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27932,"kb_used_data":916,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717220,"statfs":{"total":95995035648,"available":95966433280,"internally_reserved":0,"allocated":937984,"data_stored":450230,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 18:11:46 2023","interfaces":[{"interface":"back","average":{"1min":0.39500000000000002,"5min":0.39900000000000002,"15min":0.39600000000000002},"min":{"1min":0.312,"5min":0.217,"15min":0.217},"max":{"1min":0.51500000000000001,"5min":0.67300000000000004,"15min":0.67300000000000004},"last":0.33000000000000002},{"interface":"front","average":{"1min":0.41599999999999998,"5min":0.41499999999999998,"15min":0.40999999999999998},"min":{"1min":0.26700000000000002,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.58999999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"last":0.36699999999999999}]},{"osd":1,"last update":"Fri Jul 14 18:11:46 2023","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.55900000000000005,"15min":0.53700000000000003},"min":{"1min":0.40999999999999998,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.81000000000000005,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.50700000000000001},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.53300000000000003,"15min":0.51100000000000001},"min":{"1min":0.441,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.75,"5min":1.048,"15min":1.048},"last":0.42899999999999999}]},{"osd":2,"last update":"Fri Jul 14 18:11:46 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.59299999999999997,"15min":0.57999999999999996},"min":{"1min":0.46100000000000002,"5min":0.379,"15min":0.379},"max":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.48999999999999999},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.58599999999999997,"15min":0.58299999999999996},"min":{"1min":0.44500000000000001,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.44}]},{"osd":3,"last update":"Fri Jul 14 18:11:46 2023","interfaces":[{"interface":"back","average":{"1min":0.42399999999999999,"5min":0.44600000000000001,"15min":0.443},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.59499999999999997,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.34899999999999998},{"interface":"front","average":{"1min":0.499,"5min":0.5,"15min":0.49199999999999999},"min":{"1min":0.38,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.73799999999999999,"5min":0.83399999999999996,"15min":0.83399999999999996},"last":0.52200000000000002}]},{"osd":4,"last update":"Fri Jul 14 18:11:46 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.626,"15min":0.61099999999999999},"min":{"1min":0.46899999999999997,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.81899999999999995,"5min":1.087,"15min":1.087},"last":0.47299999999999998},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.58699999999999997,"15min":0.57199999999999995},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.85699999999999998,"5min":1.014,"15min":1.014},"last":0.45900000000000002}]},{"osd":5,"last update":"Fri Jul 14 18:11:46 2023","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.67800000000000005,"15min":0.67400000000000004},"min":{"1min":0.435,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.97799999999999998,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.72299999999999998},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.70399999999999996,"15min":0.69899999999999995},"min":{"1min":0.51500000000000001,"5min":0.443,"15min":0.443},"max":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.67700000000000005}]},{"osd":7,"last update":"Fri Jul 14 18:11:13 2023","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.67000000000000004,"15min":0.66600000000000004},"min":{"1min":0.48199999999999998,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.96299999999999997,"5min":1.03,"15min":1.03},"last":0.68899999999999995},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.71099999999999997,"15min":0.70599999999999996},"min":{"1min":0.52400000000000002,"5min":0.443,"15min":0.443},"max":{"1min":1.0700000000000001,"5min":1.0700000000000001,"15min":1.0700000000000001},"last":0.57199999999999995}]},{"osd":8,"last update":"Fri Jul 14 18:11:30 2023","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.76200000000000001,"15min":0.77600000000000002},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.89600000000000002,"5min":0.99399999999999999,"15min":0.99399999999999999},"last":0.65300000000000002},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.68300000000000005,"15min":0.69399999999999995},"min":{"1min":0.443,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.78500000000000003,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.56499999999999995}]},{"osd":9,"last update":"Fri Jul 14 18:11:52 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.72499999999999998,"15min":0.74299999999999999},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.88700000000000001,"5min":1.0449999999999999,"15min":1.0449999999999999},"last":0.66300000000000003},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.76100000000000001,"15min":0.78300000000000003},"min":{"1min":0.505,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.80800000000000005,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.53900000000000003}]},{"osd":10,"last update":"Fri Jul 14 18:11:13 2023","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":1.026,"5min":1.026,"15min":1.026},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.755,"5min":0.755,"15min":0.755},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":0.99399999999999999,"5min":0.99399999999999999,"15min":0.99399999999999999},"last":0.63400000000000001}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70799999999999996}]}]},{"osd":1,"up_from":13,"seq":55834574913,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27992,"kb_used_data":976,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717160,"statfs":{"total":95995035648,"available":95966371840,"internally_reserved":0,"allocated":999424,"data_stored":511824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 18:12:07 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.56399999999999995,"15min":0.53500000000000003},"min":{"1min":0.34000000000000002,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.76800000000000002,"5min":0.98899999999999999,"15min":0.98899999999999999},"last":0.496},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.55400000000000005,"15min":0.53000000000000003},"min":{"1min":0.40699999999999997,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.91000000000000003,"5min":0.91000000000000003,"15min":0.91000000000000003},"last":0.52200000000000002}]},{"osd":2,"last update":"Fri Jul 14 18:11:27 2023","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.55500000000000005,"15min":0.50800000000000001},"min":{"1min":0.34699999999999998,"5min":0.314,"15min":0.314},"max":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.75900000000000001},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.53600000000000003,"15min":0.49399999999999999},"min":{"1min":0.371,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"last":0.74199999999999999}]},{"osd":3,"last update":"Fri Jul 14 18:11:50 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.55900000000000005,"15min":0.52800000000000002},"min":{"1min":0.36199999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.86799999999999999,"5min":0.86799999999999999,"15min":0.86799999999999999},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.61899999999999999,"15min":0.55300000000000005},"min":{"1min":0.439,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":1.0229999999999999,"5min":1.0229999999999999,"15min":1.0229999999999999},"last":0.69799999999999995}]},{"osd":4,"last update":"Fri Jul 14 18:12:07 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.46899999999999997,"15min":0.41799999999999998},"min":{"1min":0.36399999999999999,"5min":0.245,"15min":0.245},"max":{"1min":0.95299999999999996,"5min":0.95299999999999996,"15min":0.95299999999999996},"last":0.63700000000000001},{"interface":"front","average":{"1min":0.51300000000000001,"5min":0.46300000000000002,"15min":0.41199999999999998},"min":{"1min":0.32700000000000001,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.69199999999999995,"5min":0.77600000000000002,"15min":0.77600000000000002},"last":0.55500000000000005}]},{"osd":5,"last update":"Fri Jul 14 18:11:27 2023","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.62,"15min":0.59799999999999998},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.96599999999999997,"5min":0.96599999999999997,"15min":0.96599999999999997},"last":0.81499999999999995},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.64500000000000002,"15min":0.61799999999999999},"min":{"1min":0.434,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"last":0.876}]},{"osd":6,"last update":"Fri Jul 14 18:11:46 2023","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.627,"15min":0.61599999999999999},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.80100000000000005,"5min":0.93700000000000006,"15min":0.93700000000000006},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.66100000000000003,"15min":0.64500000000000002},"min":{"1min":0.40500000000000003,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.97299999999999998,"5min":0.97299999999999998,"15min":0.97299999999999998},"last":0.72399999999999998}]},{"osd":7,"last update":"Fri Jul 14 18:11:10 2023","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.61299999999999999,"15min":0.60199999999999998},"min":{"1min":0.36899999999999999,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":1.0640000000000001,"5min":1.0640000000000001,"15min":1.0640000000000001},"last":0.84199999999999997},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.64400000000000002,"15min":0.64000000000000001},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":1.0489999999999999,"5min":1.0489999999999999,"15min":1.0489999999999999},"last":0.67700000000000005}]},{"osd":8,"last update":"Fri Jul 14 18:11:27 2023","interfaces":[{"interface":"back","average":{"1min":0.76900000000000002,"5min":0.752,"15min":0.749},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":1.054,"5min":1.054,"15min":1.054},"last":0.89900000000000002},{"interface":"front","average":{"1min":0.78500000000000003,"5min":0.76200000000000001,"15min":0.75800000000000001},"min":{"1min":0.48899999999999999,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":1.016,"5min":1.026,"15min":1.026},"last":0.95699999999999996}]},{"osd":9,"last update":"Fri Jul 14 18:11:50 2023","interfaces":[{"interface":"back","average":{"1min":0.74199999999999999,"5min":0.75900000000000001,"15min":0.76200000000000001},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.98199999999999998,"5min":1.01,"15min":1.01},"last":0.93400000000000005},{"interface":"front","average":{"1min":0.78600000000000003,"5min":0.81599999999999995,"15min":0.82099999999999995},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.0149999999999999,"5min":1.0589999999999999,"15min":1.0589999999999999},"last":0.86299999999999999}]},{"osd":10,"last update":"Fri Jul 14 18:11:10 2023","interfaces":[{"interface":"back","average":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.0649999999999999,"5min":1.0649999999999999,"15min":1.0649999999999999},"last":0.91400000000000003},{"interface":"front","average":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.0489999999999999,"5min":1.0489999999999999,"15min":1.0489999999999999},"last":0.97799999999999998}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0049999999999999}]}]},{"osd":0,"up_from":8,"seq":34359738438,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27956,"kb_used_data":940,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717196,"statfs":{"total":95995035648,"available":95966408704,"internally_reserved":0,"allocated":962560,"data_stored":451686,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Jul 14 18:12:07 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.52600000000000002,"15min":0.51100000000000001},"min":{"1min":0.437,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.68300000000000005,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.5},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.53600000000000003,"15min":0.51000000000000001},"min":{"1min":0.35399999999999998,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.76400000000000001,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.48899999999999999}]},{"osd":2,"last update":"Fri Jul 14 18:11:33 2023","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.58199999999999996,"15min":0.56200000000000006},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.83899999999999997,"5min":0.93799999999999994,"15min":0.93799999999999994},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.54800000000000004,"15min":0.52500000000000002},"min":{"1min":0.371,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.81599999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"last":0.42599999999999999}]},{"osd":3,"last update":"Fri Jul 14 18:09:46 2023","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.436,"15min":0.42599999999999999},"min":{"1min":0.29699999999999999,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"last":0.27900000000000003},{"interface":"front","average":{"1min":0.46700000000000003,"5min":0.42799999999999999,"15min":0.42199999999999999},"min":{"1min":0.33800000000000002,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.59999999999999998,"5min":0.621,"15min":0.621},"last":0.35499999999999998}]},{"osd":4,"last update":"Fri Jul 14 18:12:07 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.53800000000000003,"15min":0.51400000000000001},"min":{"1min":0.42499999999999999,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.67300000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.54400000000000004},"min":{"1min":0.41199999999999998,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.80000000000000004,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.52100000000000002}]},{"osd":5,"last update":"Fri Jul 14 18:11:33 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.54900000000000004,"15min":0.52300000000000002},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.71199999999999997,"5min":1.161,"15min":1.161},"last":0.439},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.56799999999999995,"15min":0.54800000000000004},"min":{"1min":0.41999999999999998,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.85499999999999998,"5min":0.879,"15min":0.879},"last":0.51200000000000001}]},{"osd":6,"last update":"Fri Jul 14 18:11:48 2023","interfaces":[{"interface":"back","average":{"1min":0.41999999999999998,"5min":0.50700000000000001,"15min":0.503},"min":{"1min":0.28999999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.58999999999999997,"5min":1.0649999999999999,"15min":1.0649999999999999},"last":0.29899999999999999},{"interface":"front","average":{"1min":0.47999999999999998,"5min":0.52100000000000002,"15min":0.51100000000000001},"min":{"1min":0.34499999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.68700000000000006,"5min":1.3460000000000001,"15min":1.3460000000000001},"last":0.33000000000000002}]},{"osd":7,"last update":"Fri Jul 14 18:11:07 2023","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.90100000000000002,"5min":1.204,"15min":1.204},"last":0.55200000000000005},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.72899999999999998,"15min":0.74099999999999999},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.92500000000000004,"5min":1.3080000000000001,"15min":1.3080000000000001},"last":0.58299999999999996}]},{"osd":8,"last update":"Fri Jul 14 18:11:33 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.72599999999999998,"15min":0.74399999999999999},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.81200000000000006,"5min":1.3819999999999999,"15min":1.3819999999999999},"last":0.47399999999999998},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.73199999999999998,"15min":0.746},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":0.92200000000000004,"5min":1.0289999999999999,"15min":1.0289999999999999},"last":0.56299999999999994}]},{"osd":9,"last update":"Fri Jul 14 18:11:48 2023","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.69699999999999995,"15min":0.72399999999999998},"min":{"1min":0.36599999999999999,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.84399999999999997,"5min":1.133,"15min":1.133},"last":0.44700000000000001},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.69499999999999995,"15min":0.71699999999999997},"min":{"1min":0.435,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.72699999999999998,"5min":1.28,"15min":1.28},"last":0.41599999999999998}]},{"osd":10,"last update":"Fri Jul 14 18:11:07 2023","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":0.97799999999999998,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.46400000000000002},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":0.98299999999999998,"5min":0.98299999999999998,"15min":0.98299999999999998},"last":0.59099999999999997}]},{"osd":11,"last update":"Fri Jul 14 18:11:33 2023","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":0.90000000000000002,"5min":0.90000000000000002,"15min":0.90000000000000002},"last":0.60799999999999998}]}]},{"osd":2,"up_from":18,"seq":77309411390,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28012,"kb_used_data":996,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717140,"statfs":{"total":95995035648,"available":95966351360,"internally_reserved":0,"allocated":1019904,"data_stored":511996,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 18:11:23 2023","interfaces":[{"interface":"back","average":{"1min":0.46999999999999997,"5min":0.49099999999999999,"15min":0.47899999999999998},"min":{"1min":0.315,"5min":0.255,"15min":0.255},"max":{"1min":0.77500000000000002,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.66900000000000004},{"interface":"front","average":{"1min":0.49199999999999999,"5min":0.47699999999999998,"15min":0.47199999999999998},"min":{"1min":0.33600000000000002,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"last":0.51700000000000002}]},{"osd":1,"last update":"Fri Jul 14 18:11:23 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.53500000000000003,"15min":0.50700000000000001},"min":{"1min":0.41199999999999998,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.97499999999999998,"5min":0.97499999999999998,"15min":0.97499999999999998},"last":0.88700000000000001},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.55000000000000004,"15min":0.502},"min":{"1min":0.44900000000000001,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":1.1279999999999999,"5min":1.1279999999999999,"15min":1.1279999999999999},"last":0.92400000000000004}]},{"osd":3,"last update":"Fri Jul 14 18:11:45 2023","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.57599999999999996,"15min":0.54400000000000004},"min":{"1min":0.44600000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.95299999999999996},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.55700000000000005,"15min":0.54600000000000004},"min":{"1min":0.41899999999999998,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.76100000000000001}]},{"osd":4,"last update":"Fri Jul 14 18:11:07 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.55200000000000005,"15min":0.54700000000000004},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.94399999999999995,"5min":0.94399999999999995,"15min":0.94399999999999995},"last":0.79500000000000004},{"interface":"front","average":{"1min":0.629,"5min":0.56100000000000005,"15min":0.53400000000000003},"min":{"1min":0.40000000000000002,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.80300000000000005,"5min":0.879,"15min":0.879},"last":0.77800000000000002}]},{"osd":5,"last update":"Fri Jul 14 18:11:28 2023","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.53700000000000003,"15min":0.51100000000000001},"min":{"1min":0.35199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":1.1719999999999999,"5min":1.1719999999999999,"15min":1.1719999999999999},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.52700000000000002,"15min":0.52500000000000002},"min":{"1min":0.32800000000000001,"5min":0.316,"15min":0.316},"max":{"1min":1.1499999999999999,"5min":1.1499999999999999,"15min":1.1499999999999999},"last":0.72099999999999997}]},{"osd":6,"last update":"Fri Jul 14 18:11:52 2023","interfaces":[{"interface":"back","average":{"1min":0.78200000000000003,"5min":0.67000000000000004,"15min":0.65600000000000003},"min":{"1min":0.505,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":2.3170000000000002,"5min":2.3170000000000002,"15min":2.3170000000000002},"last":0.873},{"interface":"front","average":{"1min":0.753,"5min":0.623,"15min":0.59899999999999998},"min":{"1min":0.52700000000000002,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":2.3050000000000002,"5min":2.3050000000000002,"15min":2.3050000000000002},"last":0.69099999999999995}]},{"osd":7,"last update":"Fri Jul 14 18:11:07 2023","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.63300000000000001,"15min":0.63},"min":{"1min":0.48399999999999999,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1,"5min":1,"15min":1},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.748,"5min":0.71599999999999997,"15min":0.70999999999999996},"min":{"1min":0.57399999999999995,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":0.90200000000000002,"5min":0.998,"15min":0.998},"last":0.82499999999999996}]},{"osd":8,"last update":"Fri Jul 14 18:11:28 2023","interfaces":[{"interface":"back","average":{"1min":0.83099999999999996,"5min":0.65800000000000003,"15min":0.629},"min":{"1min":0.54800000000000004,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":1.4570000000000001,"5min":1.4570000000000001,"15min":1.4570000000000001},"last":0.745},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.59199999999999997,"15min":0.57799999999999996},"min":{"1min":0.46700000000000003,"5min":0.379,"15min":0.379},"max":{"1min":1.2769999999999999,"5min":1.2769999999999999,"15min":1.2769999999999999},"last":0.83799999999999997}]},{"osd":9,"last update":"Fri Jul 14 18:11:52 2023","interfaces":[{"interface":"back","average":{"1min":0.85699999999999998,"5min":0.72699999999999998,"15min":0.70499999999999996},"min":{"1min":0.59599999999999997,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.0960000000000001,"5min":1.0960000000000001,"15min":1.0960000000000001},"last":0.97799999999999998},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.65400000000000003,"15min":0.64200000000000002},"min":{"1min":0.55200000000000005,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":0.90600000000000003,"5min":0.90600000000000003,"15min":0.90600000000000003},"last":0.81100000000000005}]},{"osd":10,"last update":"Fri Jul 14 18:11:12 2023","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.85699999999999998},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"min":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":0.88700000000000001,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.91100000000000003}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89700000000000002}]}]},{"osd":3,"up_from":25,"seq":107374182457,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27940,"kb_used_data":924,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717212,"statfs":{"total":95995035648,"available":95966425088,"internally_reserved":0,"allocated":946176,"data_stored":449655,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 18:11:46 2023","interfaces":[{"interface":"back","average":{"1min":0.35299999999999998,"5min":0.372,"15min":0.36799999999999999},"min":{"1min":0.26100000000000001,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":0.56899999999999995,"5min":0.65700000000000003,"15min":0.65700000000000003},"last":0.371},{"interface":"front","average":{"1min":0.45300000000000001,"5min":0.41099999999999998,"15min":0.39200000000000002},"min":{"1min":0.248,"5min":0.248,"15min":0.248},"max":{"1min":1.786,"5min":1.786,"15min":1.786},"last":0.28499999999999998}]},{"osd":1,"last update":"Fri Jul 14 18:11:46 2023","interfaces":[{"interface":"back","average":{"1min":0.68600000000000005,"5min":0.56000000000000005,"15min":0.51400000000000001},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":3.4369999999999998,"5min":3.4369999999999998,"15min":3.4369999999999998},"last":1.246},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.55400000000000005,"15min":0.52600000000000002},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.71999999999999997,"5min":0.90400000000000003,"15min":0.90400000000000003},"last":1.2969999999999999}]},{"osd":2,"last update":"Fri Jul 14 18:11:46 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.58999999999999997,"15min":0.57399999999999995},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":3.4540000000000002,"5min":3.4540000000000002,"15min":3.4540000000000002},"last":0.34300000000000003},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.57099999999999995,"15min":0.56499999999999995},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.71199999999999997,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.41899999999999998}]},{"osd":4,"last update":"Fri Jul 14 18:12:06 2023","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.58299999999999996,"15min":0.54400000000000004},"min":{"1min":0.42999999999999999,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.73499999999999999,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":1.1539999999999999},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.58099999999999996,"15min":0.56399999999999995},"min":{"1min":0.42499999999999999,"5min":0.38,"15min":0.38},"max":{"1min":0.72699999999999998,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":1.2849999999999999}]},{"osd":5,"last update":"Fri Jul 14 18:11:30 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.60499999999999998,"15min":0.59699999999999998},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.84799999999999998,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.35999999999999999},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.58499999999999996,"15min":0.59099999999999997},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.70499999999999996,"5min":0.875,"15min":0.875},"last":0.38900000000000001}]},{"osd":6,"last update":"Fri Jul 14 18:11:46 2023","interfaces":[{"interface":"back","average":{"1min":0.48299999999999998,"5min":0.53200000000000003,"15min":0.52800000000000002},"min":{"1min":0.33300000000000002,"5min":0.317,"15min":0.317},"max":{"1min":0.77800000000000002,"5min":1.028,"15min":1.028},"last":0.45400000000000001},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.59399999999999997,"15min":0.59099999999999997},"min":{"1min":0.39600000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.92300000000000004,"5min":1.0669999999999999,"15min":1.0669999999999999},"last":0.40699999999999997}]},{"osd":7,"last update":"Fri Jul 14 18:12:10 2023","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.71099999999999997,"15min":0.71499999999999997},"min":{"1min":0.53600000000000003,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.391,"5min":1.391,"15min":1.391},"last":1.391},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.65300000000000002,"15min":0.67100000000000004},"min":{"1min":0.46300000000000002,"5min":0.376,"15min":0.376},"max":{"1min":1.0660000000000001,"5min":1.131,"15min":1.131},"last":1.0660000000000001}]},{"osd":8,"last update":"Fri Jul 14 18:10:26 2023","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.046,"5min":1.046,"15min":1.046},"last":0.48299999999999998}]},{"osd":9,"last update":"Fri Jul 14 18:11:50 2023","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":0.57699999999999996,"15min":0.58799999999999997},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.75900000000000001,"5min":0.98999999999999999,"15min":0.98999999999999999},"last":0.439},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.70699999999999996,"15min":0.72299999999999998},"min":{"1min":0.38200000000000001,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.96299999999999997,"5min":0.997,"15min":0.997},"last":0.42899999999999999}]},{"osd":10,"last update":"Fri Jul 14 18:12:10 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.77200000000000002,"15min":0.77800000000000002},"min":{"1min":0.56799999999999995,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":1.272,"5min":1.272,"15min":1.272},"last":1.272},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.71999999999999997,"15min":0.72899999999999998},"min":{"1min":0.52600000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.2629999999999999,"5min":1.2629999999999999,"15min":1.2629999999999999},"last":1.2629999999999999}]},{"osd":11,"last update":"Fri Jul 14 18:12:10 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"last":0.47399999999999998},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":0.89700000000000002,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.46700000000000003}]}]},{"osd":4,"up_from":32,"seq":137438953525,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27940,"kb_used_data":924,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717212,"statfs":{"total":95995035648,"available":95966425088,"internally_reserved":0,"allocated":946176,"data_stored":454694,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 18:10:07 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.49099999999999999,"15min":0.48099999999999998},"min":{"1min":0.32100000000000001,"5min":0.313,"15min":0.313},"max":{"1min":1.347,"5min":1.347,"15min":1.347},"last":0.44400000000000001},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.50900000000000001,"15min":0.501},"min":{"1min":0.312,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":1.417,"5min":1.417,"15min":1.417},"last":0.53500000000000003}]},{"osd":1,"last update":"Fri Jul 14 18:11:10 2023","interfaces":[{"interface":"back","average":{"1min":0.432,"5min":0.39100000000000001,"15min":0.374},"min":{"1min":0.27500000000000002,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.68700000000000006,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.376},{"interface":"front","average":{"1min":0.433,"5min":0.38600000000000001,"15min":0.36199999999999999},"min":{"1min":0.29099999999999998,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.626,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.41299999999999998}]},{"osd":2,"last update":"Fri Jul 14 18:11:10 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.54700000000000004,"15min":0.52900000000000003},"min":{"1min":0.39600000000000002,"5min":0.374,"15min":0.374},"max":{"1min":0.72799999999999998,"5min":1.4019999999999999,"15min":1.4019999999999999},"last":0.745},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.55900000000000005,"15min":0.53400000000000003},"min":{"1min":0.38,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.82199999999999995,"5min":1.4750000000000001,"15min":1.4750000000000001},"last":0.56299999999999994}]},{"osd":3,"last update":"Fri Jul 14 18:11:10 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.52400000000000002,"15min":0.49199999999999999},"min":{"1min":0.38200000000000001,"5min":0.318,"15min":0.318},"max":{"1min":1.0309999999999999,"5min":1.054,"15min":1.054},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.54400000000000004,"15min":0.52800000000000002},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.84799999999999998,"5min":0.95299999999999996,"15min":0.95299999999999996},"last":0.64900000000000002}]},{"osd":5,"last update":"Fri Jul 14 18:11:34 2023","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.58599999999999997,"15min":0.54600000000000004},"min":{"1min":0.45700000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.875,"5min":1.177,"15min":1.177},"last":0.86099999999999999},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.60999999999999999,"15min":0.56999999999999995},"min":{"1min":0.41699999999999998,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.876,"5min":1.1220000000000001,"15min":1.1220000000000001},"last":0.70599999999999996}]},{"osd":6,"last update":"Fri Jul 14 18:11:51 2023","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.64200000000000002,"15min":0.61099999999999999},"min":{"1min":0.47599999999999998,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.83499999999999996,"5min":1.101,"15min":1.101},"last":0.623},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.63400000000000001,"15min":0.61199999999999999},"min":{"1min":0.52300000000000002,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.78300000000000003,"5min":1.446,"15min":1.446},"last":0.67000000000000004}]},{"osd":7,"last update":"Fri Jul 14 18:11:10 2023","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.58599999999999997,"15min":0.57399999999999995},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.92200000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.77600000000000002},{"interface":"front","average":{"1min":0.68200000000000005,"5min":0.60999999999999999,"15min":0.59799999999999998},"min":{"1min":0.42999999999999999,"5min":0.316,"15min":0.316},"max":{"1min":1.004,"5min":1.0189999999999999,"15min":1.0189999999999999},"last":0.83299999999999996}]},{"osd":8,"last update":"Fri Jul 14 18:11:29 2023","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.68799999999999994,"15min":0.69099999999999995},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.84099999999999997,"5min":1.3740000000000001,"15min":1.3740000000000001},"last":0.79200000000000004},{"interface":"front","average":{"1min":0.79700000000000004,"5min":0.78300000000000003,"15min":0.78100000000000003},"min":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":0.98099999999999998,"5min":1.147,"15min":1.147},"last":0.90600000000000003}]},{"osd":9,"last update":"Fri Jul 14 18:11:51 2023","interfaces":[{"interface":"back","average":{"1min":0.78500000000000003,"5min":0.81399999999999995,"15min":0.81899999999999995},"min":{"1min":0.63800000000000001,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":0.98499999999999999,"5min":1.171,"15min":1.171},"last":0.75800000000000001},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.70999999999999996,"15min":0.71699999999999997},"min":{"1min":0.51300000000000001,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":0.85199999999999998,"5min":1.304,"15min":1.304},"last":0.69199999999999995}]},{"osd":10,"last update":"Fri Jul 14 18:11:10 2023","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.016,"5min":1.016,"15min":1.016},"last":0.72799999999999998},{"interface":"front","average":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"min":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"max":{"1min":1.196,"5min":1.196,"15min":1.196},"last":0.80100000000000005}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81299999999999994}]}]},{"osd":5,"up_from":37,"seq":158913790000,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28544,"kb_used_data":1528,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716608,"statfs":{"total":95995035648,"available":95965806592,"internally_reserved":0,"allocated":1564672,"data_stored":1046792,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 18:11:30 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.52200000000000002,"15min":0.51400000000000001},"min":{"1min":0.435,"5min":0.318,"15min":0.318},"max":{"1min":0.74099999999999999,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.51300000000000001,"15min":0.499},"min":{"1min":0.32900000000000001,"5min":0.307,"15min":0.307},"max":{"1min":0.77000000000000002,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.49199999999999999}]},{"osd":1,"last update":"Fri Jul 14 18:11:30 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.55600000000000005,"15min":0.53400000000000003},"min":{"1min":0.371,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.88400000000000001,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.81599999999999995},{"interface":"front","average":{"1min":0.629,"5min":0.57199999999999995,"15min":0.55000000000000004},"min":{"1min":0.46300000000000002,"5min":0.374,"15min":0.374},"max":{"1min":0.90400000000000003,"5min":0.90400000000000003,"15min":0.90400000000000003},"last":0.75800000000000001}]},{"osd":2,"last update":"Fri Jul 14 18:11:30 2023","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.41799999999999998,"15min":0.38100000000000001},"min":{"1min":0.30299999999999999,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.51700000000000002,"5min":0.433,"15min":0.40300000000000002},"min":{"1min":0.34499999999999997,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.751,"5min":0.751,"15min":0.751},"last":0.625}]},{"osd":3,"last update":"Fri Jul 14 18:11:30 2023","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.53600000000000003,"15min":0.51700000000000002},"min":{"1min":0.40600000000000003,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.53200000000000003,"15min":0.50700000000000001},"min":{"1min":0.38500000000000001,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"last":0.51300000000000001}]},{"osd":4,"last update":"Fri Jul 14 18:11:30 2023","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.59599999999999997,"15min":0.57599999999999996},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.71699999999999997},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.59899999999999998,"15min":0.57499999999999996},"min":{"1min":0.40899999999999997,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":1.1379999999999999,"5min":1.1379999999999999,"15min":1.1379999999999999},"last":0.83399999999999996}]},{"osd":6,"last update":"Fri Jul 14 18:11:50 2023","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.59699999999999998,"15min":0.57799999999999996},"min":{"1min":0.40000000000000002,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.93400000000000005,"5min":1.0289999999999999,"15min":1.0289999999999999},"last":0.65300000000000002},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.60899999999999999,"15min":0.59299999999999997},"min":{"1min":0.38700000000000001,"5min":0.371,"15min":0.371},"max":{"1min":0.96599999999999997,"5min":0.96599999999999997,"15min":0.96599999999999997},"last":0.67400000000000004}]},{"osd":7,"last update":"Fri Jul 14 18:11:10 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.65400000000000003,"15min":0.64500000000000002},"min":{"1min":0.52000000000000002,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.0669999999999999,"5min":1.0669999999999999,"15min":1.0669999999999999},"last":0.80400000000000005},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.68200000000000005,"15min":0.67700000000000005},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":1.081,"5min":1.081,"15min":1.081},"last":0.86699999999999999}]},{"osd":8,"last update":"Fri Jul 14 18:11:30 2023","interfaces":[{"interface":"back","average":{"1min":0.70999999999999996,"5min":0.67500000000000004,"15min":0.66900000000000004},"min":{"1min":0.501,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.99399999999999999,"5min":0.99399999999999999,"15min":0.99399999999999999},"last":0.84999999999999998},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.65500000000000003,"15min":0.64900000000000002},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":1.1859999999999999,"5min":1.1859999999999999,"15min":1.1859999999999999},"last":0.70299999999999996}]},{"osd":9,"last update":"Fri Jul 14 18:11:50 2023","interfaces":[{"interface":"back","average":{"1min":0.73999999999999999,"5min":0.746,"15min":0.747},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":1.0429999999999999,"5min":1.2350000000000001,"15min":1.2350000000000001},"last":0.77900000000000003},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.73399999999999999,"15min":0.73399999999999999},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":1.0920000000000001,"5min":1.0920000000000001,"15min":1.0920000000000001},"last":0.74099999999999999}]},{"osd":10,"last update":"Fri Jul 14 18:11:10 2023","interfaces":[{"interface":"back","average":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":1.014,"5min":1.014,"15min":1.014},"last":0.88200000000000001},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.0489999999999999,"5min":1.0489999999999999,"15min":1.0489999999999999},"last":0.89500000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2130,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":62541,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":62713,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1042,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":2772,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":674,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":3388,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":1500,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":62915,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1144,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-14T18:12:12.531 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2023-07-14T18:12:12.532 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2023-07-14T18:12:12.532 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy 2023-07-14T18:12:12.533 DEBUG:teuthology.orchestra.run.smithi163:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81c9387d2e7576da065747ec9c16d1c7d69016ec shell --fsid bf7326ec-2270-11ee-9b33-001a4aab830c -- ceph health --format=json 2023-07-14T18:12:13.094 INFO:teuthology.orchestra.run.smithi163.stderr:Inferring config /var/lib/ceph/bf7326ec-2270-11ee-9b33-001a4aab830c/mon.a/config 2023-07-14T18:12:13.175 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:12:12 smithi184 ceph-mon[98481]: pgmap v282: 129 pgs: 129 active+clean; 643 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 170 B/s wr, 9 op/s 2023-07-14T18:12:13.217 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:12:12 smithi163 ceph-mon[96576]: pgmap v282: 129 pgs: 129 active+clean; 643 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 170 B/s wr, 9 op/s 2023-07-14T18:12:13.275 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:12:12 smithi172 ceph-mon[97983]: pgmap v282: 129 pgs: 129 active+clean; 643 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 170 B/s wr, 9 op/s 2023-07-14T18:12:13.967 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:12:13 smithi163 ceph-mon[96576]: from='client.15132 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-07-14T18:12:13.968 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:12:13 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:12:13.968 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:12:13 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:12:13.968 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:12:13 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:12:13.968 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:12:13 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:12:13.968 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:12:13 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:12:13.968 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:12:13 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:12:14.175 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:12:13 smithi184 ceph-mon[98481]: from='client.15132 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-07-14T18:12:14.175 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:12:13 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:12:14.175 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:12:13 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:12:14.175 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:12:13 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:12:14.175 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:12:13 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:12:14.176 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:12:13 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:12:14.176 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:12:13 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:12:14.275 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:12:13 smithi172 ceph-mon[97983]: from='client.15132 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-07-14T18:12:14.276 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:12:13 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:12:14.276 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:12:13 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:12:14.276 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:12:13 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:12:14.276 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:12:13 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:12:14.276 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:12:13 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:12:14.277 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:12:13 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:12:14.315 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:14.274+0000 7f142507b700 1 -- 172.21.15.163:0/1798247179 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f1420100f20 msgr2=0x7f14201012f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:12:14.315 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:14.274+0000 7f142507b700 1 --2- 172.21.15.163:0/1798247179 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f1420100f20 0x7f14201012f0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f1410009990 tx=0x7f1410009ca0 comp rx=0 tx=0).stop 2023-07-14T18:12:14.315 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:14.274+0000 7f142507b700 1 -- 172.21.15.163:0/1798247179 shutdown_connections 2023-07-14T18:12:14.315 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:14.274+0000 7f142507b700 1 --2- 172.21.15.163:0/1798247179 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f142010a270 0x7f142010c6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:14.315 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:14.274+0000 7f142507b700 1 --2- 172.21.15.163:0/1798247179 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f1420100f20 0x7f14201012f0 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:14.316 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:14.274+0000 7f142507b700 1 --2- 172.21.15.163:0/1798247179 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1420101830 0x7f1420109d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:14.316 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:14.274+0000 7f142507b700 1 -- 172.21.15.163:0/1798247179 >> 172.21.15.163:0/1798247179 conn(0x7f1420075ca0 msgr2=0x7f14200760a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:12:14.316 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:14.274+0000 7f142507b700 1 -- 172.21.15.163:0/1798247179 shutdown_connections 2023-07-14T18:12:14.316 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:14.274+0000 7f142507b700 1 -- 172.21.15.163:0/1798247179 wait complete. 2023-07-14T18:12:14.318 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:14.274+0000 7f142507b700 1 Processor -- start 2023-07-14T18:12:14.318 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:14.275+0000 7f142507b700 1 -- start start 2023-07-14T18:12:14.318 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:14.275+0000 7f142507b700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1420100f20 0x7f14200feb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:12:14.318 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:14.275+0000 7f142507b700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1420101830 0x7f14200ff0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:12:14.318 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:14.275+0000 7f142507b700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f142010a270 0x7f14200ff640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:12:14.319 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:14.275+0000 7f142507b700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14201a4170 con 0x7f142010a270 2023-07-14T18:12:14.319 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:14.275+0000 7f142507b700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14201a42e0 con 0x7f1420101830 2023-07-14T18:12:14.319 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:14.275+0000 7f142507b700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14201a44a0 con 0x7f1420100f20 2023-07-14T18:12:14.319 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:14.275+0000 7f141f59e700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f142010a270 0x7f14200ff640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:12:14.319 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:14.275+0000 7f141f59e700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f142010a270 0x7f14200ff640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:56788/0 (socket says 172.21.15.163:56788) 2023-07-14T18:12:14.319 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:14.275+0000 7f141f59e700 1 -- 172.21.15.163:0/1065431239 learned_addr learned my addr 172.21.15.163:0/1065431239 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:12:14.319 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:14.275+0000 7f141e59c700 1 --2- 172.21.15.163:0/1065431239 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1420101830 0x7f14200ff0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:12:14.319 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:14.275+0000 7f141ed9d700 1 --2- 172.21.15.163:0/1065431239 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1420100f20 0x7f14200feb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:12:14.320 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:14.275+0000 7f141f59e700 1 -- 172.21.15.163:0/1065431239 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1420100f20 msgr2=0x7f14200feb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:12:14.320 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:14.275+0000 7f141f59e700 1 --2- 172.21.15.163:0/1065431239 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1420100f20 0x7f14200feb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:14.320 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:14.275+0000 7f141f59e700 1 -- 172.21.15.163:0/1065431239 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1420101830 msgr2=0x7f14200ff0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:12:14.320 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:14.275+0000 7f141f59e700 1 --2- 172.21.15.163:0/1065431239 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1420101830 0x7f14200ff0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:14.320 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:14.275+0000 7f141f59e700 1 -- 172.21.15.163:0/1065431239 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14100095f0 con 0x7f142010a270 2023-07-14T18:12:14.320 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:14.276+0000 7f141f59e700 1 --2- 172.21.15.163:0/1065431239 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f142010a270 0x7f14200ff640 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f141800efc0 tx=0x7f141800c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:12:14.320 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:14.276+0000 7f1407fff700 1 -- 172.21.15.163:0/1065431239 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1418018070 con 0x7f142010a270 2023-07-14T18:12:14.321 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:14.276+0000 7f142507b700 1 -- 172.21.15.163:0/1065431239 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f14201a4720 con 0x7f142010a270 2023-07-14T18:12:14.321 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:14.276+0000 7f1407fff700 1 -- 172.21.15.163:0/1065431239 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f141800f040 con 0x7f142010a270 2023-07-14T18:12:14.321 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:14.276+0000 7f1407fff700 1 -- 172.21.15.163:0/1065431239 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f141800cbb0 con 0x7f142010a270 2023-07-14T18:12:14.321 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:14.276+0000 7f142507b700 1 -- 172.21.15.163:0/1065431239 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f14201a4bd0 con 0x7f142010a270 2023-07-14T18:12:14.321 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:14.277+0000 7f142507b700 1 -- 172.21.15.163:0/1065431239 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1420104ae0 con 0x7f142010a270 2023-07-14T18:12:14.322 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:14.278+0000 7f1407fff700 1 -- 172.21.15.163:0/1065431239 <== mon.0 v2:172.21.15.163:3300/0 4 ==== mgrmap(e 17) v1 ==== 135767+0+0 (secure 0 0 0) 0x7f141800cd70 con 0x7f142010a270 2023-07-14T18:12:14.322 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:14.279+0000 7f1407fff700 1 --2- 172.21.15.163:0/1065431239 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f14080a1260 0x7f14080a3710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:12:14.322 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:14.279+0000 7f141ed9d700 1 --2- 172.21.15.163:0/1065431239 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f14080a1260 0x7f14080a3710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:12:14.322 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:14.279+0000 7f1407fff700 1 -- 172.21.15.163:0/1065431239 <== mon.0 v2:172.21.15.163:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 8730+0+0 (secure 0 0 0) 0x7f14180cc6d0 con 0x7f142010a270 2023-07-14T18:12:14.322 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:14.279+0000 7f141ed9d700 1 --2- 172.21.15.163:0/1065431239 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f14080a1260 0x7f14080a3710 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f1410006010 tx=0x7f141000b260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:12:14.323 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:14.283+0000 7f1407fff700 1 -- 172.21.15.163:0/1065431239 <== mon.0 v2:172.21.15.163:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178025 (secure 0 0 0) 0x7f1418095b00 con 0x7f142010a270 2023-07-14T18:12:14.552 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:14.511+0000 7f142507b700 1 -- 172.21.15.163:0/1065431239 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f142004e340 con 0x7f142010a270 2023-07-14T18:12:14.552 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:14.511+0000 7f1407fff700 1 -- 172.21.15.163:0/1065431239 <== mon.0 v2:172.21.15.163:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7f1418099120 con 0x7f142010a270 2023-07-14T18:12:14.553 INFO:teuthology.orchestra.run.smithi163.stdout: 2023-07-14T18:12:14.553 INFO:teuthology.orchestra.run.smithi163.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2023-07-14T18:12:14.554 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:14.513+0000 7f142507b700 1 -- 172.21.15.163:0/1065431239 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f14080a1260 msgr2=0x7f14080a3710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:12:14.554 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:14.513+0000 7f142507b700 1 --2- 172.21.15.163:0/1065431239 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f14080a1260 0x7f14080a3710 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f1410006010 tx=0x7f141000b260 comp rx=0 tx=0).stop 2023-07-14T18:12:14.555 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:14.513+0000 7f142507b700 1 -- 172.21.15.163:0/1065431239 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f142010a270 msgr2=0x7f14200ff640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:12:14.555 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:14.513+0000 7f142507b700 1 --2- 172.21.15.163:0/1065431239 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f142010a270 0x7f14200ff640 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f141800efc0 tx=0x7f141800c3a0 comp rx=0 tx=0).stop 2023-07-14T18:12:14.555 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:14.513+0000 7f142507b700 1 -- 172.21.15.163:0/1065431239 shutdown_connections 2023-07-14T18:12:14.555 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:14.513+0000 7f142507b700 1 --2- 172.21.15.163:0/1065431239 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f14080a1260 0x7f14080a3710 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:14.555 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:14.513+0000 7f142507b700 1 --2- 172.21.15.163:0/1065431239 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1420100f20 0x7f14200feb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:14.555 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:14.513+0000 7f142507b700 1 --2- 172.21.15.163:0/1065431239 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f142010a270 0x7f14200ff640 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:14.555 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:14.513+0000 7f142507b700 1 --2- 172.21.15.163:0/1065431239 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1420101830 0x7f14200ff0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:14.555 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:14.513+0000 7f142507b700 1 -- 172.21.15.163:0/1065431239 >> 172.21.15.163:0/1065431239 conn(0x7f1420075ca0 msgr2=0x7f1420101c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:12:14.556 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:14.514+0000 7f142507b700 1 -- 172.21.15.163:0/1065431239 shutdown_connections 2023-07-14T18:12:14.556 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:14.514+0000 7f142507b700 1 -- 172.21.15.163:0/1065431239 wait complete. 2023-07-14T18:12:14.895 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:12:14 smithi163 ceph-mon[96576]: pgmap v283: 129 pgs: 129 active+clean; 643 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 170 B/s wr, 11 op/s 2023-07-14T18:12:14.896 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:12:14 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T18:12:14.896 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:12:14 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-14T18:12:14.896 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:12:14 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:12:14.896 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:12:14 smithi163 ceph-mon[96576]: from='client.? 172.21.15.163:0/1065431239' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2023-07-14T18:12:14.958 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy done 2023-07-14T18:12:14.959 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-14T18:12:15.083 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:15.042+0000 7fb08096a700 1 -- 172.21.15.163:0/1889400618 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fb07c1006e0 msgr2=0x7fb07c102ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:12:15.083 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:15.042+0000 7fb08096a700 1 --2- 172.21.15.163:0/1889400618 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fb07c1006e0 0x7fb07c102ac0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fb070009990 tx=0x7fb070009ca0 comp rx=0 tx=0).stop 2023-07-14T18:12:15.084 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:15.042+0000 7fb08096a700 1 -- 172.21.15.163:0/1889400618 shutdown_connections 2023-07-14T18:12:15.084 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:15.042+0000 7fb08096a700 1 --2- 172.21.15.163:0/1889400618 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb07c105920 0x7fb07c107d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:15.084 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:15.042+0000 7fb08096a700 1 --2- 172.21.15.163:0/1889400618 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fb07c1006e0 0x7fb07c102ac0 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:15.084 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:15.042+0000 7fb08096a700 1 --2- 172.21.15.163:0/1889400618 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb07c103000 0x7fb07c1053e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:15.084 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:15.042+0000 7fb08096a700 1 -- 172.21.15.163:0/1889400618 >> 172.21.15.163:0/1889400618 conn(0x7fb07c0fa100 msgr2=0x7fb07c0fc550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:12:15.084 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:15.042+0000 7fb08096a700 1 -- 172.21.15.163:0/1889400618 shutdown_connections 2023-07-14T18:12:15.085 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:15.042+0000 7fb08096a700 1 -- 172.21.15.163:0/1889400618 wait complete. 2023-07-14T18:12:15.086 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:15.043+0000 7fb08096a700 1 Processor -- start 2023-07-14T18:12:15.086 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:15.043+0000 7fb08096a700 1 -- start start 2023-07-14T18:12:15.087 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:15.043+0000 7fb08096a700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb07c1006e0 0x7fb07c100050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:12:15.087 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:15.043+0000 7fb08096a700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fb07c103000 0x7fb07c0fe690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:12:15.087 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:15.043+0000 7fb08096a700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb07c105920 0x7fb07c0febd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:12:15.087 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:15.043+0000 7fb08096a700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb07c0ff370 con 0x7fb07c103000 2023-07-14T18:12:15.087 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:15.043+0000 7fb08096a700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb07c0ff4e0 con 0x7fb07c105920 2023-07-14T18:12:15.087 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:15.043+0000 7fb08096a700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb07c19f800 con 0x7fb07c1006e0 2023-07-14T18:12:15.088 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:15.043+0000 7fb079d9b700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fb07c103000 0x7fb07c0fe690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:12:15.088 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:15.043+0000 7fb079d9b700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fb07c103000 0x7fb07c0fe690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:56798/0 (socket says 172.21.15.163:56798) 2023-07-14T18:12:15.088 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:15.043+0000 7fb079d9b700 1 -- 172.21.15.163:0/875585679 learned_addr learned my addr 172.21.15.163:0/875585679 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:12:15.088 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:15.043+0000 7fb07a59c700 1 --2- 172.21.15.163:0/875585679 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb07c1006e0 0x7fb07c100050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:12:15.088 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:15.043+0000 7fb07ad9d700 1 --2- 172.21.15.163:0/875585679 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb07c105920 0x7fb07c0febd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:12:15.089 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:15.044+0000 7fb079d9b700 1 -- 172.21.15.163:0/875585679 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb07c1006e0 msgr2=0x7fb07c100050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:12:15.089 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:15.044+0000 7fb079d9b700 1 --2- 172.21.15.163:0/875585679 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb07c1006e0 0x7fb07c100050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:15.089 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:15.044+0000 7fb079d9b700 1 -- 172.21.15.163:0/875585679 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb07c105920 msgr2=0x7fb07c0febd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:12:15.089 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:15.044+0000 7fb079d9b700 1 --2- 172.21.15.163:0/875585679 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb07c105920 0x7fb07c0febd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:15.089 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:15.044+0000 7fb079d9b700 1 -- 172.21.15.163:0/875585679 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0700095f0 con 0x7fb07c103000 2023-07-14T18:12:15.090 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:15.044+0000 7fb079d9b700 1 --2- 172.21.15.163:0/875585679 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fb07c103000 0x7fb07c0fe690 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fb06c00d950 tx=0x7fb06c00dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:12:15.090 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:15.044+0000 7fb06b7fe700 1 -- 172.21.15.163:0/875585679 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb06c00f890 con 0x7fb07c103000 2023-07-14T18:12:15.090 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:15.044+0000 7fb06b7fe700 1 -- 172.21.15.163:0/875585679 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fb06c00fe80 con 0x7fb07c103000 2023-07-14T18:12:15.091 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:15.044+0000 7fb08096a700 1 -- 172.21.15.163:0/875585679 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb07c19fae0 con 0x7fb07c103000 2023-07-14T18:12:15.091 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:15.044+0000 7fb06b7fe700 1 -- 172.21.15.163:0/875585679 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb06c00e3b0 con 0x7fb07c103000 2023-07-14T18:12:15.091 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:15.044+0000 7fb08096a700 1 -- 172.21.15.163:0/875585679 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb07c19fff0 con 0x7fb07c103000 2023-07-14T18:12:15.091 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:15.045+0000 7fb08096a700 1 -- 172.21.15.163:0/875585679 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb07c0fbc70 con 0x7fb07c103000 2023-07-14T18:12:15.093 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:15.046+0000 7fb06b7fe700 1 -- 172.21.15.163:0/875585679 <== mon.0 v2:172.21.15.163:3300/0 4 ==== mgrmap(e 17) v1 ==== 135767+0+0 (secure 0 0 0) 0x7fb06c010460 con 0x7fb07c103000 2023-07-14T18:12:15.093 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:15.046+0000 7fb06b7fe700 1 --2- 172.21.15.163:0/875585679 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7fb0640a1220 0x7fb0640a36d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:12:15.093 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:15.047+0000 7fb06b7fe700 1 -- 172.21.15.163:0/875585679 <== mon.0 v2:172.21.15.163:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 8730+0+0 (secure 0 0 0) 0x7fb06c0cca00 con 0x7fb07c103000 2023-07-14T18:12:15.093 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:15.047+0000 7fb07a59c700 1 --2- 172.21.15.163:0/875585679 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7fb0640a1220 0x7fb0640a36d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:12:15.093 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:15.047+0000 7fb07a59c700 1 --2- 172.21.15.163:0/875585679 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7fb0640a1220 0x7fb0640a36d0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fb07000b5c0 tx=0x7fb070005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:12:15.093 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:15.050+0000 7fb06b7fe700 1 -- 172.21.15.163:0/875585679 <== mon.0 v2:172.21.15.163:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178025 (secure 0 0 0) 0x7fb06c095e00 con 0x7fb07c103000 2023-07-14T18:12:15.174 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:12:14 smithi184 ceph-mon[98481]: pgmap v283: 129 pgs: 129 active+clean; 643 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 170 B/s wr, 11 op/s 2023-07-14T18:12:15.175 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:12:14 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T18:12:15.175 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:12:14 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-14T18:12:15.175 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:12:14 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:12:15.175 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:12:14 smithi184 ceph-mon[98481]: from='client.? 172.21.15.163:0/1065431239' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2023-07-14T18:12:15.275 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:12:14 smithi172 ceph-mon[97983]: pgmap v283: 129 pgs: 129 active+clean; 643 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 170 B/s wr, 11 op/s 2023-07-14T18:12:15.276 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:12:14 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T18:12:15.276 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:12:14 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-14T18:12:15.276 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:12:14 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:12:15.276 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:12:14 smithi172 ceph-mon[97983]: from='client.? 172.21.15.163:0/1065431239' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2023-07-14T18:12:15.283 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:15.242+0000 7fb08096a700 1 -- 172.21.15.163:0/875585679 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb07c02cb30 con 0x7fb07c103000 2023-07-14T18:12:15.284 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:15.244+0000 7fb06b7fe700 1 -- 172.21.15.163:0/875585679 <== mon.0 v2:172.21.15.163:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v84) v1 ==== 74+0+24030 (secure 0 0 0) 0x7fb06c016090 con 0x7fb07c103000 2023-07-14T18:12:15.285 INFO:teuthology.orchestra.run.smithi163.stdout: 2023-07-14T18:12:15.285 INFO:teuthology.orchestra.run.smithi163.stdout:{"epoch":84,"fsid":"bf7326ec-2270-11ee-9b33-001a4aab830c","created":"2023-07-14T18:04:26.263517+0000","modified":"2023-07-14T18:11:14.170253+0000","last_up_change":"2023-07-14T18:10:27.514863+0000","last_in_change":"2023-07-14T18:10:10.726443+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-14T18:07:19.653852+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-07-14T18:11:07.314989+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-07-14T18:11:08.274627+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-07-14T18:11:11.991162+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"e6490568-046d-43ef-bb07-d79fb884b276","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6802","nonce":3124653025},{"type":"v1","addr":"172.21.15.163:6803","nonce":3124653025}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6804","nonce":3124653025},{"type":"v1","addr":"172.21.15.163:6805","nonce":3124653025}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6808","nonce":3124653025},{"type":"v1","addr":"172.21.15.163:6809","nonce":3124653025}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6806","nonce":3124653025},{"type":"v1","addr":"172.21.15.163:6807","nonce":3124653025}]},"public_addr":"172.21.15.163:6803/3124653025","cluster_addr":"172.21.15.163:6805/3124653025","heartbeat_back_addr":"172.21.15.163:6809/3124653025","heartbeat_front_addr":"172.21.15.163:6807/3124653025","state":["exists","up"]},{"osd":1,"uuid":"0af39bda-f096-4603-adcc-bf1988f36603","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":3774455900},{"type":"v1","addr":"172.21.15.172:6801","nonce":3774455900}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":3774455900},{"type":"v1","addr":"172.21.15.172:6803","nonce":3774455900}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":3774455900},{"type":"v1","addr":"172.21.15.172:6807","nonce":3774455900}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":3774455900},{"type":"v1","addr":"172.21.15.172:6805","nonce":3774455900}]},"public_addr":"172.21.15.172:6801/3774455900","cluster_addr":"172.21.15.172:6803/3774455900","heartbeat_back_addr":"172.21.15.172:6807/3774455900","heartbeat_front_addr":"172.21.15.172:6805/3774455900","state":["exists","up"]},{"osd":2,"uuid":"cc732c13-af0f-4199-98e6-fe960ed4e5dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":1976927678},{"type":"v1","addr":"172.21.15.184:6801","nonce":1976927678}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":1976927678},{"type":"v1","addr":"172.21.15.184:6803","nonce":1976927678}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":1976927678},{"type":"v1","addr":"172.21.15.184:6807","nonce":1976927678}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":1976927678},{"type":"v1","addr":"172.21.15.184:6805","nonce":1976927678}]},"public_addr":"172.21.15.184:6801/1976927678","cluster_addr":"172.21.15.184:6803/1976927678","heartbeat_back_addr":"172.21.15.184:6807/1976927678","heartbeat_front_addr":"172.21.15.184:6805/1976927678","state":["exists","up"]},{"osd":3,"uuid":"dcee9576-0bc6-4ab0-8f63-79eacd0eca5f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6810","nonce":2589130694},{"type":"v1","addr":"172.21.15.163:6811","nonce":2589130694}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6812","nonce":2589130694},{"type":"v1","addr":"172.21.15.163:6813","nonce":2589130694}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6816","nonce":2589130694},{"type":"v1","addr":"172.21.15.163:6817","nonce":2589130694}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6814","nonce":2589130694},{"type":"v1","addr":"172.21.15.163:6815","nonce":2589130694}]},"public_addr":"172.21.15.163:6811/2589130694","cluster_addr":"172.21.15.163:6813/2589130694","heartbeat_back_addr":"172.21.15.163:6817/2589130694","heartbeat_front_addr":"172.21.15.163:6815/2589130694","state":["exists","up"]},{"osd":4,"uuid":"055df823-b8b0-426a-83c2-f0d727932ad8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":3319632614},{"type":"v1","addr":"172.21.15.172:6809","nonce":3319632614}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6810","nonce":3319632614},{"type":"v1","addr":"172.21.15.172:6811","nonce":3319632614}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6814","nonce":3319632614},{"type":"v1","addr":"172.21.15.172:6815","nonce":3319632614}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":3319632614},{"type":"v1","addr":"172.21.15.172:6813","nonce":3319632614}]},"public_addr":"172.21.15.172:6809/3319632614","cluster_addr":"172.21.15.172:6811/3319632614","heartbeat_back_addr":"172.21.15.172:6815/3319632614","heartbeat_front_addr":"172.21.15.172:6813/3319632614","state":["exists","up"]},{"osd":5,"uuid":"ef5ef02a-b4e2-4790-9d27-f6d2247b25c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":2662084043},{"type":"v1","addr":"172.21.15.184:6809","nonce":2662084043}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6810","nonce":2662084043},{"type":"v1","addr":"172.21.15.184:6811","nonce":2662084043}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6814","nonce":2662084043},{"type":"v1","addr":"172.21.15.184:6815","nonce":2662084043}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6812","nonce":2662084043},{"type":"v1","addr":"172.21.15.184:6813","nonce":2662084043}]},"public_addr":"172.21.15.184:6809/2662084043","cluster_addr":"172.21.15.184:6811/2662084043","heartbeat_back_addr":"172.21.15.184:6815/2662084043","heartbeat_front_addr":"172.21.15.184:6813/2662084043","state":["exists","up"]},{"osd":6,"uuid":"dba754be-0fc5-4867-a6d5-cf97eb344f81","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":44,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6818","nonce":2530874117},{"type":"v1","addr":"172.21.15.163:6819","nonce":2530874117}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6820","nonce":2530874117},{"type":"v1","addr":"172.21.15.163:6821","nonce":2530874117}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6824","nonce":2530874117},{"type":"v1","addr":"172.21.15.163:6825","nonce":2530874117}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6822","nonce":2530874117},{"type":"v1","addr":"172.21.15.163:6823","nonce":2530874117}]},"public_addr":"172.21.15.163:6819/2530874117","cluster_addr":"172.21.15.163:6821/2530874117","heartbeat_back_addr":"172.21.15.163:6825/2530874117","heartbeat_front_addr":"172.21.15.163:6823/2530874117","state":["exists","up"]},{"osd":7,"uuid":"edd76e6b-6077-4619-b00d-1e906f70ddcc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":49,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":233511803},{"type":"v1","addr":"172.21.15.172:6817","nonce":233511803}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6818","nonce":233511803},{"type":"v1","addr":"172.21.15.172:6819","nonce":233511803}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":233511803},{"type":"v1","addr":"172.21.15.172:6823","nonce":233511803}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6820","nonce":233511803},{"type":"v1","addr":"172.21.15.172:6821","nonce":233511803}]},"public_addr":"172.21.15.172:6817/233511803","cluster_addr":"172.21.15.172:6819/233511803","heartbeat_back_addr":"172.21.15.172:6823/233511803","heartbeat_front_addr":"172.21.15.172:6821/233511803","state":["exists","up"]},{"osd":8,"uuid":"36559400-f33e-44e6-868a-316d34da457d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":56,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6816","nonce":290154343},{"type":"v1","addr":"172.21.15.184:6817","nonce":290154343}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6818","nonce":290154343},{"type":"v1","addr":"172.21.15.184:6819","nonce":290154343}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6822","nonce":290154343},{"type":"v1","addr":"172.21.15.184:6823","nonce":290154343}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6820","nonce":290154343},{"type":"v1","addr":"172.21.15.184:6821","nonce":290154343}]},"public_addr":"172.21.15.184:6817/290154343","cluster_addr":"172.21.15.184:6819/290154343","heartbeat_back_addr":"172.21.15.184:6823/290154343","heartbeat_front_addr":"172.21.15.184:6821/290154343","state":["exists","up"]},{"osd":9,"uuid":"d484f111-f36c-4c67-9a8a-ae03e7e0d137","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6826","nonce":3848110906},{"type":"v1","addr":"172.21.15.163:6827","nonce":3848110906}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6828","nonce":3848110906},{"type":"v1","addr":"172.21.15.163:6829","nonce":3848110906}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6832","nonce":3848110906},{"type":"v1","addr":"172.21.15.163:6833","nonce":3848110906}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6830","nonce":3848110906},{"type":"v1","addr":"172.21.15.163:6831","nonce":3848110906}]},"public_addr":"172.21.15.163:6827/3848110906","cluster_addr":"172.21.15.163:6829/3848110906","heartbeat_back_addr":"172.21.15.163:6833/3848110906","heartbeat_front_addr":"172.21.15.163:6831/3848110906","state":["exists","up"]},{"osd":10,"uuid":"d943f7c0-da3d-4605-9e23-0231e675c6be","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6824","nonce":3281085356},{"type":"v1","addr":"172.21.15.172:6825","nonce":3281085356}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":3281085356},{"type":"v1","addr":"172.21.15.172:6827","nonce":3281085356}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":3281085356},{"type":"v1","addr":"172.21.15.172:6831","nonce":3281085356}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6828","nonce":3281085356},{"type":"v1","addr":"172.21.15.172:6829","nonce":3281085356}]},"public_addr":"172.21.15.172:6825/3281085356","cluster_addr":"172.21.15.172:6827/3281085356","heartbeat_back_addr":"172.21.15.172:6831/3281085356","heartbeat_front_addr":"172.21.15.172:6829/3281085356","state":["exists","up"]},{"osd":11,"uuid":"09e610a8-408a-4119-a21b-c4de2810a538","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":75,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6824","nonce":3614578747},{"type":"v1","addr":"172.21.15.184:6825","nonce":3614578747}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6826","nonce":3614578747},{"type":"v1","addr":"172.21.15.184:6827","nonce":3614578747}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6830","nonce":3614578747},{"type":"v1","addr":"172.21.15.184:6831","nonce":3614578747}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6828","nonce":3614578747},{"type":"v1","addr":"172.21.15.184:6829","nonce":3614578747}]},"public_addr":"172.21.15.184:6825/3614578747","cluster_addr":"172.21.15.184:6827/3614578747","heartbeat_back_addr":"172.21.15.184:6831/3614578747","heartbeat_front_addr":"172.21.15.184:6829/3614578747","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T18:06:36.067578+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T18:06:57.095120+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T18:07:17.825363+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T18:07:38.977196+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T18:08:00.108709+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T18:08:20.700646+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T18:08:41.473899+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T18:09:02.856536+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T18:09:23.832722+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T18:09:44.860884+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T18:10:05.520678+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T18:10:26.426315+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.163:6801/1086512093":"2023-07-15T18:05:15.331458+0000","172.21.15.163:6800/1086512093":"2023-07-15T18:05:15.331458+0000","172.21.15.163:0/4235784810":"2023-07-15T18:05:15.331458+0000","172.21.15.163:6800/236891232":"2023-07-15T18:04:53.288443+0000","172.21.15.163:6801/236891232":"2023-07-15T18:04:53.288443+0000","172.21.15.163:0/3260193612":"2023-07-15T18:05:15.331458+0000","172.21.15.163:0/3513629472":"2023-07-15T18:04:53.288443+0000","172.21.15.163:0/1090329830":"2023-07-15T18:04:53.288443+0000","172.21.15.163:0/3868922045":"2023-07-15T18:05:15.331458+0000","172.21.15.163:0/2945662447":"2023-07-15T18:04:53.288443+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-14T18:12:15.287 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:15.246+0000 7fb08096a700 1 -- 172.21.15.163:0/875585679 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7fb0640a1220 msgr2=0x7fb0640a36d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:12:15.287 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:15.246+0000 7fb08096a700 1 --2- 172.21.15.163:0/875585679 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7fb0640a1220 0x7fb0640a36d0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fb07000b5c0 tx=0x7fb070005fb0 comp rx=0 tx=0).stop 2023-07-14T18:12:15.287 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:15.246+0000 7fb08096a700 1 -- 172.21.15.163:0/875585679 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fb07c103000 msgr2=0x7fb07c0fe690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:12:15.287 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:15.246+0000 7fb08096a700 1 --2- 172.21.15.163:0/875585679 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fb07c103000 0x7fb07c0fe690 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fb06c00d950 tx=0x7fb06c00dc60 comp rx=0 tx=0).stop 2023-07-14T18:12:15.287 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:15.246+0000 7fb08096a700 1 -- 172.21.15.163:0/875585679 shutdown_connections 2023-07-14T18:12:15.288 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:15.246+0000 7fb08096a700 1 --2- 172.21.15.163:0/875585679 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7fb0640a1220 0x7fb0640a36d0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:15.288 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:15.246+0000 7fb08096a700 1 --2- 172.21.15.163:0/875585679 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb07c1006e0 0x7fb07c100050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:15.288 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:15.246+0000 7fb08096a700 1 --2- 172.21.15.163:0/875585679 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb07c105920 0x7fb07c0febd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:15.288 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:15.246+0000 7fb08096a700 1 --2- 172.21.15.163:0/875585679 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fb07c103000 0x7fb07c0fe690 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:15.288 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:15.246+0000 7fb08096a700 1 -- 172.21.15.163:0/875585679 >> 172.21.15.163:0/875585679 conn(0x7fb07c0fa100 msgr2=0x7fb07c101360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:12:15.288 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:15.246+0000 7fb08096a700 1 -- 172.21.15.163:0/875585679 shutdown_connections 2023-07-14T18:12:15.288 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:15.246+0000 7fb08096a700 1 -- 172.21.15.163:0/875585679 wait complete. 2023-07-14T18:12:15.299 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-14T18:07:19.653852+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-14T18:11:07.314989+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '79', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-07-14T18:11:08.274627+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '80', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-07-14T18:11:11.991162+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '84', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-07-14T18:12:15.300 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-14T18:12:15.428 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:15.386+0000 7f9c08a55700 1 -- 172.21.15.163:0/3345822636 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f9c040ff710 msgr2=0x7f9c04106fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:12:15.428 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:15.386+0000 7f9c08a55700 1 --2- 172.21.15.163:0/3345822636 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f9c040ff710 0x7f9c04106fe0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f9bfc00b0a0 tx=0x7f9bfc00b3b0 comp rx=0 tx=0).stop 2023-07-14T18:12:15.428 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:15.386+0000 7f9c08a55700 1 -- 172.21.15.163:0/3345822636 shutdown_connections 2023-07-14T18:12:15.428 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:15.386+0000 7f9c08a55700 1 --2- 172.21.15.163:0/3345822636 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9c041000e0 0x7f9c041004f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:15.428 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:15.386+0000 7f9c08a55700 1 --2- 172.21.15.163:0/3345822636 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f9c040ff710 0x7f9c04106fe0 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:15.429 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:15.386+0000 7f9c08a55700 1 --2- 172.21.15.163:0/3345822636 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9c040fed80 0x7f9c040ff1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:15.429 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:15.386+0000 7f9c08a55700 1 -- 172.21.15.163:0/3345822636 >> 172.21.15.163:0/3345822636 conn(0x7f9c040f98a0 msgr2=0x7f9c040fbcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:12:15.429 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:15.386+0000 7f9c08a55700 1 -- 172.21.15.163:0/3345822636 shutdown_connections 2023-07-14T18:12:15.429 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:15.386+0000 7f9c08a55700 1 -- 172.21.15.163:0/3345822636 wait complete. 2023-07-14T18:12:15.429 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:15.387+0000 7f9c08a55700 1 Processor -- start 2023-07-14T18:12:15.429 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:15.387+0000 7f9c08a55700 1 -- start start 2023-07-14T18:12:15.431 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:15.387+0000 7f9c08a55700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9c040fed80 0x7f9c04194870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:12:15.431 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:15.387+0000 7f9c08a55700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f9c040ff710 0x7f9c04194db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:12:15.431 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:15.387+0000 7f9c08a55700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9c041000e0 0x7f9c0419be20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:12:15.432 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:15.387+0000 7f9c08a55700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c0419c3f0 con 0x7f9c040ff710 2023-07-14T18:12:15.432 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:15.387+0000 7f9c08a55700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c0419c530 con 0x7f9c041000e0 2023-07-14T18:12:15.432 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:15.387+0000 7f9c08a55700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c0419c6c0 con 0x7f9c040fed80 2023-07-14T18:12:15.432 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:15.387+0000 7f9c01d9b700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f9c040ff710 0x7f9c04194db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:12:15.432 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:15.387+0000 7f9c01d9b700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f9c040ff710 0x7f9c04194db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:56810/0 (socket says 172.21.15.163:56810) 2023-07-14T18:12:15.432 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:15.387+0000 7f9c01d9b700 1 -- 172.21.15.163:0/2944210250 learned_addr learned my addr 172.21.15.163:0/2944210250 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:12:15.432 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:15.388+0000 7f9c0259c700 1 --2- 172.21.15.163:0/2944210250 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9c040fed80 0x7f9c04194870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:12:15.433 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:15.388+0000 7f9c02d9d700 1 --2- 172.21.15.163:0/2944210250 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9c041000e0 0x7f9c0419be20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:12:15.433 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:15.388+0000 7f9c01d9b700 1 -- 172.21.15.163:0/2944210250 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9c040fed80 msgr2=0x7f9c04194870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:12:15.433 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:15.388+0000 7f9c01d9b700 1 --2- 172.21.15.163:0/2944210250 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9c040fed80 0x7f9c04194870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:15.433 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:15.388+0000 7f9c01d9b700 1 -- 172.21.15.163:0/2944210250 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9c041000e0 msgr2=0x7f9c0419be20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:12:15.433 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:15.388+0000 7f9c01d9b700 1 --2- 172.21.15.163:0/2944210250 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9c041000e0 0x7f9c0419be20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:15.434 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:15.388+0000 7f9c01d9b700 1 -- 172.21.15.163:0/2944210250 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9bfc009d00 con 0x7f9c040ff710 2023-07-14T18:12:15.434 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:15.388+0000 7f9c02d9d700 1 --2- 172.21.15.163:0/2944210250 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9c041000e0 0x7f9c0419be20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T18:12:15.434 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:15.388+0000 7f9c01d9b700 1 --2- 172.21.15.163:0/2944210250 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f9c040ff710 0x7f9c04194db0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f9bf400d950 tx=0x7f9bf400dd10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:12:15.434 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:15.388+0000 7f9bf37fe700 1 -- 172.21.15.163:0/2944210250 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bf4009b40 con 0x7f9c040ff710 2023-07-14T18:12:15.434 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:15.388+0000 7f9bf37fe700 1 -- 172.21.15.163:0/2944210250 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f9bf4009ca0 con 0x7f9c040ff710 2023-07-14T18:12:15.434 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:15.388+0000 7f9c08a55700 1 -- 172.21.15.163:0/2944210250 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9c0419c9a0 con 0x7f9c040ff710 2023-07-14T18:12:15.434 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:15.388+0000 7f9bf37fe700 1 -- 172.21.15.163:0/2944210250 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bf400f620 con 0x7f9c040ff710 2023-07-14T18:12:15.435 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:15.388+0000 7f9c08a55700 1 -- 172.21.15.163:0/2944210250 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c0419ceb0 con 0x7f9c040ff710 2023-07-14T18:12:15.435 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:15.389+0000 7f9c08a55700 1 -- 172.21.15.163:0/2944210250 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9c0410a190 con 0x7f9c040ff710 2023-07-14T18:12:15.435 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:15.390+0000 7f9bf37fe700 1 -- 172.21.15.163:0/2944210250 <== mon.0 v2:172.21.15.163:3300/0 4 ==== mgrmap(e 17) v1 ==== 135767+0+0 (secure 0 0 0) 0x7f9bf4010460 con 0x7f9c040ff710 2023-07-14T18:12:15.435 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:15.391+0000 7f9bf37fe700 1 --2- 172.21.15.163:0/2944210250 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f9bec0a11e0 0x7f9bec0a3690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:12:15.436 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:15.391+0000 7f9c0259c700 1 --2- 172.21.15.163:0/2944210250 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f9bec0a11e0 0x7f9bec0a3690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:12:15.436 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:15.391+0000 7f9bf37fe700 1 -- 172.21.15.163:0/2944210250 <== mon.0 v2:172.21.15.163:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 8730+0+0 (secure 0 0 0) 0x7f9bf40cd0d0 con 0x7f9c040ff710 2023-07-14T18:12:15.436 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:15.391+0000 7f9c0259c700 1 --2- 172.21.15.163:0/2944210250 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f9bec0a11e0 0x7f9bec0a3690 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f9bf8005fd0 tx=0x7f9bf8005dd0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:12:15.436 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:15.394+0000 7f9bf37fe700 1 -- 172.21.15.163:0/2944210250 <== mon.0 v2:172.21.15.163:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178025 (secure 0 0 0) 0x7f9bf4096470 con 0x7f9c040ff710 2023-07-14T18:12:15.625 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:15.584+0000 7f9c08a55700 1 -- 172.21.15.163:0/2944210250 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f9c04105ad0 con 0x7f9c040ff710 2023-07-14T18:12:15.625 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:15.584+0000 7f9bf37fe700 1 -- 172.21.15.163:0/2944210250 <== mon.0 v2:172.21.15.163:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v84) v1 ==== 93+0+10 (secure 0 0 0) 0x7f9bf40160a0 con 0x7f9c040ff710 2023-07-14T18:12:15.625 INFO:teuthology.orchestra.run.smithi163.stdout:pg_num: 1 2023-07-14T18:12:15.627 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:15.586+0000 7f9c08a55700 1 -- 172.21.15.163:0/2944210250 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f9bec0a11e0 msgr2=0x7f9bec0a3690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:12:15.627 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:15.586+0000 7f9c08a55700 1 --2- 172.21.15.163:0/2944210250 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f9bec0a11e0 0x7f9bec0a3690 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f9bf8005fd0 tx=0x7f9bf8005dd0 comp rx=0 tx=0).stop 2023-07-14T18:12:15.628 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:15.586+0000 7f9c08a55700 1 -- 172.21.15.163:0/2944210250 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f9c040ff710 msgr2=0x7f9c04194db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:12:15.628 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:15.586+0000 7f9c08a55700 1 --2- 172.21.15.163:0/2944210250 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f9c040ff710 0x7f9c04194db0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f9bf400d950 tx=0x7f9bf400dd10 comp rx=0 tx=0).stop 2023-07-14T18:12:15.628 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:15.587+0000 7f9c08a55700 1 -- 172.21.15.163:0/2944210250 shutdown_connections 2023-07-14T18:12:15.628 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:15.587+0000 7f9c08a55700 1 --2- 172.21.15.163:0/2944210250 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f9bec0a11e0 0x7f9bec0a3690 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:15.628 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:15.587+0000 7f9c08a55700 1 --2- 172.21.15.163:0/2944210250 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9c040fed80 0x7f9c04194870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:15.628 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:15.587+0000 7f9c08a55700 1 --2- 172.21.15.163:0/2944210250 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9c041000e0 0x7f9c0419be20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:15.628 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:15.587+0000 7f9c08a55700 1 --2- 172.21.15.163:0/2944210250 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f9c040ff710 0x7f9c04194db0 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:15.629 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:15.587+0000 7f9c08a55700 1 -- 172.21.15.163:0/2944210250 >> 172.21.15.163:0/2944210250 conn(0x7f9c040f98a0 msgr2=0x7f9c040fbb20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:12:15.629 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:15.587+0000 7f9c08a55700 1 -- 172.21.15.163:0/2944210250 shutdown_connections 2023-07-14T18:12:15.629 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:15.587+0000 7f9c08a55700 1 -- 172.21.15.163:0/2944210250 wait complete. 2023-07-14T18:12:15.640 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-14T18:12:15.764 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:15.723+0000 7fe66e584700 1 -- 172.21.15.163:0/1635799936 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fe6680fedc0 msgr2=0x7fe6680ff230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:12:15.765 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:15.723+0000 7fe66e584700 1 --2- 172.21.15.163:0/1635799936 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fe6680fedc0 0x7fe6680ff230 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fe658009990 tx=0x7fe658009ca0 comp rx=0 tx=0).stop 2023-07-14T18:12:15.765 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:15.723+0000 7fe66e584700 1 -- 172.21.15.163:0/1635799936 shutdown_connections 2023-07-14T18:12:15.765 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:15.723+0000 7fe66e584700 1 --2- 172.21.15.163:0/1635799936 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe6681000d0 0x7fe6681004e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:15.766 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:15.723+0000 7fe66e584700 1 --2- 172.21.15.163:0/1635799936 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe6680ff770 0x7fe668107020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:15.766 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:15.723+0000 7fe66e584700 1 --2- 172.21.15.163:0/1635799936 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fe6680fedc0 0x7fe6680ff230 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:15.766 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:15.723+0000 7fe66e584700 1 -- 172.21.15.163:0/1635799936 >> 172.21.15.163:0/1635799936 conn(0x7fe6680f98a0 msgr2=0x7fe6680fbcf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:12:15.766 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:15.723+0000 7fe66e584700 1 -- 172.21.15.163:0/1635799936 shutdown_connections 2023-07-14T18:12:15.766 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:15.723+0000 7fe66e584700 1 -- 172.21.15.163:0/1635799936 wait complete. 2023-07-14T18:12:15.766 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:15.724+0000 7fe66e584700 1 Processor -- start 2023-07-14T18:12:15.766 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:15.724+0000 7fe66e584700 1 -- start start 2023-07-14T18:12:15.768 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:15.724+0000 7fe66e584700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe6680fedc0 0x7fe6680fe820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:12:15.768 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:15.724+0000 7fe66e584700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fe6680ff770 0x7fe66819a5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:12:15.769 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:15.724+0000 7fe66e584700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe6681000d0 0x7fe66819cc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:12:15.769 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:15.724+0000 7fe66e584700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe66819d3a0 con 0x7fe6680ff770 2023-07-14T18:12:15.769 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:15.724+0000 7fe66e584700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe66819d510 con 0x7fe6680fedc0 2023-07-14T18:12:15.769 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:15.724+0000 7fe66e584700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe66819d6d0 con 0x7fe6681000d0 2023-07-14T18:12:15.769 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:15.724+0000 7fe6677fe700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fe6680ff770 0x7fe66819a5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:12:15.769 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:15.724+0000 7fe6677fe700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fe6680ff770 0x7fe66819a5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:56824/0 (socket says 172.21.15.163:56824) 2023-07-14T18:12:15.769 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:15.724+0000 7fe6677fe700 1 -- 172.21.15.163:0/904259773 learned_addr learned my addr 172.21.15.163:0/904259773 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:12:15.770 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:15.724+0000 7fe667fff700 1 --2- 172.21.15.163:0/904259773 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe6680fedc0 0x7fe6680fe820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:12:15.770 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:15.725+0000 7fe66cb21700 1 --2- 172.21.15.163:0/904259773 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe6681000d0 0x7fe66819cc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:12:15.770 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:15.725+0000 7fe6677fe700 1 -- 172.21.15.163:0/904259773 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe6681000d0 msgr2=0x7fe66819cc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:12:15.770 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:15.725+0000 7fe6677fe700 1 --2- 172.21.15.163:0/904259773 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe6681000d0 0x7fe66819cc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:15.770 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:15.725+0000 7fe6677fe700 1 -- 172.21.15.163:0/904259773 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe6680fedc0 msgr2=0x7fe6680fe820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:12:15.770 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:15.725+0000 7fe6677fe700 1 --2- 172.21.15.163:0/904259773 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe6680fedc0 0x7fe6680fe820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:15.770 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:15.725+0000 7fe6677fe700 1 -- 172.21.15.163:0/904259773 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6580095f0 con 0x7fe6680ff770 2023-07-14T18:12:15.771 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:15.725+0000 7fe6677fe700 1 --2- 172.21.15.163:0/904259773 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fe6680ff770 0x7fe66819a5c0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fe6580098e0 tx=0x7fe658004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:12:15.771 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:15.725+0000 7fe6657fa700 1 -- 172.21.15.163:0/904259773 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe65801d070 con 0x7fe6680ff770 2023-07-14T18:12:15.771 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:15.725+0000 7fe6657fa700 1 -- 172.21.15.163:0/904259773 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fe65800bdd0 con 0x7fe6680ff770 2023-07-14T18:12:15.771 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:15.725+0000 7fe66e584700 1 -- 172.21.15.163:0/904259773 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe66819d950 con 0x7fe6680ff770 2023-07-14T18:12:15.771 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:15.725+0000 7fe6657fa700 1 -- 172.21.15.163:0/904259773 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe658022da0 con 0x7fe6680ff770 2023-07-14T18:12:15.771 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:15.725+0000 7fe66e584700 1 -- 172.21.15.163:0/904259773 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe66819dd70 con 0x7fe6680ff770 2023-07-14T18:12:15.771 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:15.726+0000 7fe66e584700 1 -- 172.21.15.163:0/904259773 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe6681061f0 con 0x7fe6680ff770 2023-07-14T18:12:15.771 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:15.727+0000 7fe6657fa700 1 -- 172.21.15.163:0/904259773 <== mon.0 v2:172.21.15.163:3300/0 4 ==== mgrmap(e 17) v1 ==== 135767+0+0 (secure 0 0 0) 0x7fe65800b940 con 0x7fe6680ff770 2023-07-14T18:12:15.772 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:15.728+0000 7fe6657fa700 1 --2- 172.21.15.163:0/904259773 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7fe6500a11e0 0x7fe6500a3690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:12:15.772 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:15.728+0000 7fe667fff700 1 --2- 172.21.15.163:0/904259773 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7fe6500a11e0 0x7fe6500a3690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:12:15.772 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:15.728+0000 7fe6657fa700 1 -- 172.21.15.163:0/904259773 <== mon.0 v2:172.21.15.163:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 8730+0+0 (secure 0 0 0) 0x7fe6580ce600 con 0x7fe6680ff770 2023-07-14T18:12:15.772 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:15.728+0000 7fe667fff700 1 --2- 172.21.15.163:0/904259773 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7fe6500a11e0 0x7fe6500a3690 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fe6680ffdf0 tx=0x7fe65c00b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:12:15.773 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:15.731+0000 7fe6657fa700 1 -- 172.21.15.163:0/904259773 <== mon.0 v2:172.21.15.163:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178025 (secure 0 0 0) 0x7fe658097a30 con 0x7fe6680ff770 2023-07-14T18:12:15.967 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:12:15 smithi163 ceph-mon[96576]: from='client.? 172.21.15.163:0/875585679' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-07-14T18:12:15.967 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:12:15 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.8", "id": [2, 11]}]: dispatch 2023-07-14T18:12:15.967 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:12:15 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1", "id": [4, 9]}]: dispatch 2023-07-14T18:12:15.968 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:12:15 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.6", "id": [4, 6]}]: dispatch 2023-07-14T18:12:15.968 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:12:15 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.25", "id": [5, 9]}]: dispatch 2023-07-14T18:12:15.968 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:12:15 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.27", "id": [4, 8]}]: dispatch 2023-07-14T18:12:15.968 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:12:15 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2d", "id": [3, 9]}]: dispatch 2023-07-14T18:12:15.968 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:12:15 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [5, 8]}]: dispatch 2023-07-14T18:12:15.968 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:12:15 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [9, 10]}]: dispatch 2023-07-14T18:12:15.968 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:12:15 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [9, 8]}]: dispatch 2023-07-14T18:12:15.969 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:12:15 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [9, 8]}]: dispatch 2023-07-14T18:12:15.969 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:12:15 smithi163 ceph-mon[96576]: from='client.? 172.21.15.163:0/2944210250' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-07-14T18:12:15.970 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:15.929+0000 7fe66e584700 1 -- 172.21.15.163:0/904259773 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fe66802caf0 con 0x7fe6680ff770 2023-07-14T18:12:15.970 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:15.929+0000 7fe6657fa700 1 -- 172.21.15.163:0/904259773 <== mon.0 v2:172.21.15.163:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v85) v1 ==== 104+0+11 (secure 0 0 0) 0x7fe65809b050 con 0x7fe6680ff770 2023-07-14T18:12:15.970 INFO:teuthology.orchestra.run.smithi163.stdout:pg_num: 32 2023-07-14T18:12:15.972 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:15.931+0000 7fe66e584700 1 -- 172.21.15.163:0/904259773 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7fe6500a11e0 msgr2=0x7fe6500a3690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:12:15.972 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:15.931+0000 7fe66e584700 1 --2- 172.21.15.163:0/904259773 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7fe6500a11e0 0x7fe6500a3690 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fe6680ffdf0 tx=0x7fe65c00b410 comp rx=0 tx=0).stop 2023-07-14T18:12:15.973 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:15.931+0000 7fe66e584700 1 -- 172.21.15.163:0/904259773 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fe6680ff770 msgr2=0x7fe66819a5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:12:15.973 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:15.931+0000 7fe66e584700 1 --2- 172.21.15.163:0/904259773 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fe6680ff770 0x7fe66819a5c0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fe6580098e0 tx=0x7fe658004730 comp rx=0 tx=0).stop 2023-07-14T18:12:15.973 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:15.932+0000 7fe66e584700 1 -- 172.21.15.163:0/904259773 shutdown_connections 2023-07-14T18:12:15.973 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:15.932+0000 7fe66e584700 1 --2- 172.21.15.163:0/904259773 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7fe6500a11e0 0x7fe6500a3690 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:15.973 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:15.932+0000 7fe66e584700 1 --2- 172.21.15.163:0/904259773 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe6681000d0 0x7fe66819cc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:15.973 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:15.932+0000 7fe66e584700 1 --2- 172.21.15.163:0/904259773 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe6680fedc0 0x7fe6680fe820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:15.973 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:15.932+0000 7fe66e584700 1 --2- 172.21.15.163:0/904259773 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fe6680ff770 0x7fe66819a5c0 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:15.974 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:15.932+0000 7fe66e584700 1 -- 172.21.15.163:0/904259773 >> 172.21.15.163:0/904259773 conn(0x7fe6680f98a0 msgr2=0x7fe668103330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:12:15.974 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:15.932+0000 7fe66e584700 1 -- 172.21.15.163:0/904259773 shutdown_connections 2023-07-14T18:12:15.974 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:15.932+0000 7fe66e584700 1 -- 172.21.15.163:0/904259773 wait complete. 2023-07-14T18:12:15.985 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-14T18:12:16.111 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:16.070+0000 7f92e20b2700 1 -- 172.21.15.163:0/2134691386 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f92dc0feb10 msgr2=0x7f92dc0fef20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:12:16.111 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:16.070+0000 7f92e20b2700 1 --2- 172.21.15.163:0/2134691386 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f92dc0feb10 0x7f92dc0fef20 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f92d0009990 tx=0x7f92d0009ca0 comp rx=0 tx=0).stop 2023-07-14T18:12:16.111 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:16.070+0000 7f92e20b2700 1 -- 172.21.15.163:0/2134691386 shutdown_connections 2023-07-14T18:12:16.111 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:16.070+0000 7f92e20b2700 1 --2- 172.21.15.163:0/2134691386 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f92dc100690 0x7f92dc106f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:16.111 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:16.070+0000 7f92e20b2700 1 --2- 172.21.15.163:0/2134691386 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f92dc0feb10 0x7f92dc0fef20 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:16.112 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:16.070+0000 7f92e20b2700 1 --2- 172.21.15.163:0/2134691386 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f92dc0ffd00 0x7f92dc100150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:16.112 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:16.070+0000 7f92e20b2700 1 -- 172.21.15.163:0/2134691386 >> 172.21.15.163:0/2134691386 conn(0x7f92dc0fa130 msgr2=0x7f92dc0fc560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:12:16.112 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:16.070+0000 7f92e20b2700 1 -- 172.21.15.163:0/2134691386 shutdown_connections 2023-07-14T18:12:16.112 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:16.070+0000 7f92e20b2700 1 -- 172.21.15.163:0/2134691386 wait complete. 2023-07-14T18:12:16.112 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:16.070+0000 7f92e20b2700 1 Processor -- start 2023-07-14T18:12:16.114 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:16.070+0000 7f92e20b2700 1 -- start start 2023-07-14T18:12:16.114 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:16.071+0000 7f92e20b2700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f92dc0feb10 0x7f92dc102aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:12:16.114 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:16.071+0000 7f92e20b2700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f92dc0ffd00 0x7f92dc1010e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:12:16.114 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:16.071+0000 7f92e20b2700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f92dc100690 0x7f92dc101620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:12:16.114 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:16.071+0000 7f92e20b2700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92dc101dc0 con 0x7f92dc0feb10 2023-07-14T18:12:16.114 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:16.071+0000 7f92e20b2700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92dc101f30 con 0x7f92dc100690 2023-07-14T18:12:16.115 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:16.071+0000 7f92e20b2700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92dc19f8d0 con 0x7f92dc0ffd00 2023-07-14T18:12:16.115 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:16.071+0000 7f92db7fe700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f92dc0feb10 0x7f92dc102aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:12:16.115 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:16.071+0000 7f92db7fe700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f92dc0feb10 0x7f92dc102aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:56836/0 (socket says 172.21.15.163:56836) 2023-07-14T18:12:16.115 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:16.071+0000 7f92db7fe700 1 -- 172.21.15.163:0/2121785242 learned_addr learned my addr 172.21.15.163:0/2121785242 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:12:16.115 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:16.071+0000 7f92dbfff700 1 --2- 172.21.15.163:0/2121785242 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f92dc100690 0x7f92dc101620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:12:16.115 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:16.071+0000 7f92daffd700 1 --2- 172.21.15.163:0/2121785242 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f92dc0ffd00 0x7f92dc1010e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:12:16.115 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:16.071+0000 7f92db7fe700 1 -- 172.21.15.163:0/2121785242 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f92dc0ffd00 msgr2=0x7f92dc1010e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:12:16.116 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:16.071+0000 7f92db7fe700 1 --2- 172.21.15.163:0/2121785242 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f92dc0ffd00 0x7f92dc1010e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:16.116 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:16.071+0000 7f92db7fe700 1 -- 172.21.15.163:0/2121785242 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f92dc100690 msgr2=0x7f92dc101620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:12:16.116 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:16.071+0000 7f92db7fe700 1 --2- 172.21.15.163:0/2121785242 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f92dc100690 0x7f92dc101620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:16.116 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:16.071+0000 7f92db7fe700 1 -- 172.21.15.163:0/2121785242 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92d00095f0 con 0x7f92dc0feb10 2023-07-14T18:12:16.116 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:16.071+0000 7f92daffd700 1 --2- 172.21.15.163:0/2121785242 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f92dc0ffd00 0x7f92dc1010e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T18:12:16.116 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:16.071+0000 7f92db7fe700 1 --2- 172.21.15.163:0/2121785242 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f92dc0feb10 0x7f92dc102aa0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f92d0004730 tx=0x7f92d0009580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:12:16.116 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:16.071+0000 7f92d8ff9700 1 -- 172.21.15.163:0/2121785242 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92d001d070 con 0x7f92dc0feb10 2023-07-14T18:12:16.116 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:16.071+0000 7f92d8ff9700 1 -- 172.21.15.163:0/2121785242 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f92d0004080 con 0x7f92dc0feb10 2023-07-14T18:12:16.117 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:16.071+0000 7f92e20b2700 1 -- 172.21.15.163:0/2121785242 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f92dc19fb50 con 0x7f92dc0feb10 2023-07-14T18:12:16.117 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:16.071+0000 7f92d8ff9700 1 -- 172.21.15.163:0/2121785242 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92d0005290 con 0x7f92dc0feb10 2023-07-14T18:12:16.117 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:16.071+0000 7f92e20b2700 1 -- 172.21.15.163:0/2121785242 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f92dc19ff70 con 0x7f92dc0feb10 2023-07-14T18:12:16.117 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:16.073+0000 7f92e20b2700 1 -- 172.21.15.163:0/2121785242 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f92dc10a200 con 0x7f92dc0feb10 2023-07-14T18:12:16.118 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:16.074+0000 7f92d8ff9700 1 -- 172.21.15.163:0/2121785242 <== mon.0 v2:172.21.15.163:3300/0 4 ==== mgrmap(e 17) v1 ==== 135767+0+0 (secure 0 0 0) 0x7f92d0004810 con 0x7f92dc0feb10 2023-07-14T18:12:16.118 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:16.074+0000 7f92d8ff9700 1 --2- 172.21.15.163:0/2121785242 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f92c40a11e0 0x7f92c40a3690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:12:16.118 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:16.075+0000 7f92daffd700 1 --2- 172.21.15.163:0/2121785242 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f92c40a11e0 0x7f92c40a3690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:12:16.118 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:16.075+0000 7f92d8ff9700 1 -- 172.21.15.163:0/2121785242 <== mon.0 v2:172.21.15.163:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 9020+0+0 (secure 0 0 0) 0x7f92d00ce220 con 0x7f92dc0feb10 2023-07-14T18:12:16.118 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:16.075+0000 7f92daffd700 1 --2- 172.21.15.163:0/2121785242 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f92c40a11e0 0x7f92c40a3690 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f92cc005fd0 tx=0x7f92cc005e20 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:12:16.119 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:16.078+0000 7f92d8ff9700 1 -- 172.21.15.163:0/2121785242 <== mon.0 v2:172.21.15.163:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178025 (secure 0 0 0) 0x7f92d0097590 con 0x7f92dc0feb10 2023-07-14T18:12:16.174 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:12:15 smithi184 ceph-mon[98481]: from='client.? 172.21.15.163:0/875585679' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-07-14T18:12:16.175 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:12:15 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.8", "id": [2, 11]}]: dispatch 2023-07-14T18:12:16.175 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:12:15 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1", "id": [4, 9]}]: dispatch 2023-07-14T18:12:16.175 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:12:15 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.6", "id": [4, 6]}]: dispatch 2023-07-14T18:12:16.175 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:12:15 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.25", "id": [5, 9]}]: dispatch 2023-07-14T18:12:16.175 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:12:15 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.27", "id": [4, 8]}]: dispatch 2023-07-14T18:12:16.176 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:12:15 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2d", "id": [3, 9]}]: dispatch 2023-07-14T18:12:16.176 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:12:15 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [5, 8]}]: dispatch 2023-07-14T18:12:16.176 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:12:15 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [9, 10]}]: dispatch 2023-07-14T18:12:16.176 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:12:15 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [9, 8]}]: dispatch 2023-07-14T18:12:16.176 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:12:15 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [9, 8]}]: dispatch 2023-07-14T18:12:16.176 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:12:15 smithi184 ceph-mon[98481]: from='client.? 172.21.15.163:0/2944210250' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-07-14T18:12:16.276 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:12:15 smithi172 ceph-mon[97983]: from='client.? 172.21.15.163:0/875585679' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-07-14T18:12:16.276 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:12:15 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.8", "id": [2, 11]}]: dispatch 2023-07-14T18:12:16.276 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:12:15 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1", "id": [4, 9]}]: dispatch 2023-07-14T18:12:16.276 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:12:15 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.6", "id": [4, 6]}]: dispatch 2023-07-14T18:12:16.276 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:12:15 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.25", "id": [5, 9]}]: dispatch 2023-07-14T18:12:16.276 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:12:15 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.27", "id": [4, 8]}]: dispatch 2023-07-14T18:12:16.277 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:12:15 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2d", "id": [3, 9]}]: dispatch 2023-07-14T18:12:16.277 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:12:15 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [5, 8]}]: dispatch 2023-07-14T18:12:16.277 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:12:15 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [9, 10]}]: dispatch 2023-07-14T18:12:16.277 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:12:15 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [9, 8]}]: dispatch 2023-07-14T18:12:16.277 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:12:15 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [9, 8]}]: dispatch 2023-07-14T18:12:16.277 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:12:15 smithi172 ceph-mon[97983]: from='client.? 172.21.15.163:0/2944210250' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-07-14T18:12:16.306 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:16.266+0000 7f92e20b2700 1 -- 172.21.15.163:0/2121785242 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f92dc1a0580 con 0x7f92dc0feb10 2023-07-14T18:12:16.307 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:16.266+0000 7f92d8ff9700 1 -- 172.21.15.163:0/2121785242 <== mon.0 v2:172.21.15.163:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v85) v1 ==== 100+0+11 (secure 0 0 0) 0x7f92d0095e60 con 0x7f92dc0feb10 2023-07-14T18:12:16.307 INFO:teuthology.orchestra.run.smithi163.stdout:pg_num: 64 2023-07-14T18:12:16.309 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:16.268+0000 7f92e20b2700 1 -- 172.21.15.163:0/2121785242 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f92c40a11e0 msgr2=0x7f92c40a3690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:12:16.309 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:16.268+0000 7f92e20b2700 1 --2- 172.21.15.163:0/2121785242 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f92c40a11e0 0x7f92c40a3690 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f92cc005fd0 tx=0x7f92cc005e20 comp rx=0 tx=0).stop 2023-07-14T18:12:16.309 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:16.268+0000 7f92e20b2700 1 -- 172.21.15.163:0/2121785242 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f92dc0feb10 msgr2=0x7f92dc102aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:12:16.309 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:16.268+0000 7f92e20b2700 1 --2- 172.21.15.163:0/2121785242 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f92dc0feb10 0x7f92dc102aa0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f92d0004730 tx=0x7f92d0009580 comp rx=0 tx=0).stop 2023-07-14T18:12:16.310 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:16.268+0000 7f92e20b2700 1 -- 172.21.15.163:0/2121785242 shutdown_connections 2023-07-14T18:12:16.310 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:16.268+0000 7f92e20b2700 1 --2- 172.21.15.163:0/2121785242 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f92c40a11e0 0x7f92c40a3690 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:16.310 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:16.268+0000 7f92e20b2700 1 --2- 172.21.15.163:0/2121785242 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f92dc100690 0x7f92dc101620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:16.310 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:16.268+0000 7f92e20b2700 1 --2- 172.21.15.163:0/2121785242 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f92dc0feb10 0x7f92dc102aa0 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:16.310 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:16.268+0000 7f92e20b2700 1 --2- 172.21.15.163:0/2121785242 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f92dc0ffd00 0x7f92dc1010e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:16.310 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:16.268+0000 7f92e20b2700 1 -- 172.21.15.163:0/2121785242 >> 172.21.15.163:0/2121785242 conn(0x7f92dc0fa130 msgr2=0x7f92dc0677e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:12:16.310 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:16.268+0000 7f92e20b2700 1 -- 172.21.15.163:0/2121785242 shutdown_connections 2023-07-14T18:12:16.310 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:16.268+0000 7f92e20b2700 1 -- 172.21.15.163:0/2121785242 wait complete. 2023-07-14T18:12:16.322 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-07-14T18:12:16.447 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:16.406+0000 7f5d67fc6700 1 -- 172.21.15.163:0/2676649502 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f5d600fdf20 msgr2=0x7f5d600fe330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:12:16.447 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:16.406+0000 7f5d67fc6700 1 --2- 172.21.15.163:0/2676649502 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f5d600fdf20 0x7f5d600fe330 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f5d5c009990 tx=0x7f5d5c009ca0 comp rx=0 tx=0).stop 2023-07-14T18:12:16.447 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:16.406+0000 7f5d67fc6700 1 -- 172.21.15.163:0/2676649502 shutdown_connections 2023-07-14T18:12:16.447 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:16.406+0000 7f5d67fc6700 1 --2- 172.21.15.163:0/2676649502 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5d60101920 0x7f5d601081e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:16.447 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:16.406+0000 7f5d67fc6700 1 --2- 172.21.15.163:0/2676649502 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f5d600fdf20 0x7f5d600fe330 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:16.448 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:16.406+0000 7f5d67fc6700 1 --2- 172.21.15.163:0/2676649502 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5d60100f90 0x7f5d601013e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:16.448 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:16.406+0000 7f5d67fc6700 1 -- 172.21.15.163:0/2676649502 >> 172.21.15.163:0/2676649502 conn(0x7f5d600f98e0 msgr2=0x7f5d600fbd10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:12:16.448 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:16.406+0000 7f5d67fc6700 1 -- 172.21.15.163:0/2676649502 shutdown_connections 2023-07-14T18:12:16.448 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:16.406+0000 7f5d67fc6700 1 -- 172.21.15.163:0/2676649502 wait complete. 2023-07-14T18:12:16.450 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:16.407+0000 7f5d67fc6700 1 Processor -- start 2023-07-14T18:12:16.450 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:16.407+0000 7f5d67fc6700 1 -- start start 2023-07-14T18:12:16.450 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:16.407+0000 7f5d67fc6700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5d600fdf20 0x7f5d60195850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:12:16.450 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:16.407+0000 7f5d67fc6700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f5d60100f90 0x7f5d60195d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:12:16.451 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:16.407+0000 7f5d67fc6700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5d60101920 0x7f5d6019ce00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:12:16.451 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:16.407+0000 7f5d67fc6700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d6019d3d0 con 0x7f5d60100f90 2023-07-14T18:12:16.451 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:16.407+0000 7f5d67fc6700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d6019d510 con 0x7f5d600fdf20 2023-07-14T18:12:16.451 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:16.407+0000 7f5d67fc6700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d6019d6a0 con 0x7f5d60101920 2023-07-14T18:12:16.451 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:16.407+0000 7f5d65561700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f5d60100f90 0x7f5d60195d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:12:16.451 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:16.407+0000 7f5d65561700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f5d60100f90 0x7f5d60195d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:56856/0 (socket says 172.21.15.163:56856) 2023-07-14T18:12:16.451 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:16.407+0000 7f5d65561700 1 -- 172.21.15.163:0/59711654 learned_addr learned my addr 172.21.15.163:0/59711654 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:12:16.451 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:16.407+0000 7f5d65d62700 1 --2- 172.21.15.163:0/59711654 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5d600fdf20 0x7f5d60195850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:12:16.452 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:16.407+0000 7f5d65561700 1 -- 172.21.15.163:0/59711654 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5d60101920 msgr2=0x7f5d6019ce00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:12:16.452 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:16.407+0000 7f5d66563700 1 --2- 172.21.15.163:0/59711654 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5d60101920 0x7f5d6019ce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:12:16.452 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:16.407+0000 7f5d65561700 1 --2- 172.21.15.163:0/59711654 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5d60101920 0x7f5d6019ce00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:16.452 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:16.407+0000 7f5d65561700 1 -- 172.21.15.163:0/59711654 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5d600fdf20 msgr2=0x7f5d60195850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:12:16.452 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:16.407+0000 7f5d65561700 1 --2- 172.21.15.163:0/59711654 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5d600fdf20 0x7f5d60195850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:16.452 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:16.407+0000 7f5d65561700 1 -- 172.21.15.163:0/59711654 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d5c0095f0 con 0x7f5d60100f90 2023-07-14T18:12:16.452 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:16.407+0000 7f5d65561700 1 --2- 172.21.15.163:0/59711654 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f5d60100f90 0x7f5d60195d90 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f5d5000e9a0 tx=0x7f5d5000ed60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:12:16.453 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:16.408+0000 7f5d56ffd700 1 -- 172.21.15.163:0/59711654 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d50009790 con 0x7f5d60100f90 2023-07-14T18:12:16.453 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:16.408+0000 7f5d56ffd700 1 -- 172.21.15.163:0/59711654 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f5d5000cbd0 con 0x7f5d60100f90 2023-07-14T18:12:16.453 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:16.408+0000 7f5d67fc6700 1 -- 172.21.15.163:0/59711654 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5d6019d980 con 0x7f5d60100f90 2023-07-14T18:12:16.453 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:16.408+0000 7f5d56ffd700 1 -- 172.21.15.163:0/59711654 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d50018680 con 0x7f5d60100f90 2023-07-14T18:12:16.453 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:16.408+0000 7f5d67fc6700 1 -- 172.21.15.163:0/59711654 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5d6019dee0 con 0x7f5d60100f90 2023-07-14T18:12:16.453 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:16.409+0000 7f5d67fc6700 1 -- 172.21.15.163:0/59711654 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5d60107380 con 0x7f5d60100f90 2023-07-14T18:12:16.454 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:16.410+0000 7f5d56ffd700 1 -- 172.21.15.163:0/59711654 <== mon.0 v2:172.21.15.163:3300/0 4 ==== mgrmap(e 17) v1 ==== 135767+0+0 (secure 0 0 0) 0x7f5d5000cd40 con 0x7f5d60100f90 2023-07-14T18:12:16.454 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:16.410+0000 7f5d56ffd700 1 --2- 172.21.15.163:0/59711654 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f5d4c0a1260 0x7f5d4c0a3710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:12:16.454 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:16.410+0000 7f5d56ffd700 1 -- 172.21.15.163:0/59711654 <== mon.0 v2:172.21.15.163:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 9020+0+0 (secure 0 0 0) 0x7f5d50014070 con 0x7f5d60100f90 2023-07-14T18:12:16.455 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:16.410+0000 7f5d65d62700 1 --2- 172.21.15.163:0/59711654 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f5d4c0a1260 0x7f5d4c0a3710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:12:16.455 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:16.411+0000 7f5d65d62700 1 --2- 172.21.15.163:0/59711654 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f5d4c0a1260 0x7f5d4c0a3710 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f5d5c005910 tx=0x7f5d5c00b260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:12:16.455 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:16.413+0000 7f5d56ffd700 1 -- 172.21.15.163:0/59711654 <== mon.0 v2:172.21.15.163:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178025 (secure 0 0 0) 0x7f5d50096570 con 0x7f5d60100f90 2023-07-14T18:12:16.642 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:16.602+0000 7f5d67fc6700 1 -- 172.21.15.163:0/59711654 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f5d6002caf0 con 0x7f5d60100f90 2023-07-14T18:12:16.643 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:16.602+0000 7f5d56ffd700 1 -- 172.21.15.163:0/59711654 <== mon.0 v2:172.21.15.163:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v85) v1 ==== 103+0+11 (secure 0 0 0) 0x7f5d500260a0 con 0x7f5d60100f90 2023-07-14T18:12:16.643 INFO:teuthology.orchestra.run.smithi163.stdout:pg_num: 32 2023-07-14T18:12:16.645 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:16.604+0000 7f5d67fc6700 1 -- 172.21.15.163:0/59711654 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f5d4c0a1260 msgr2=0x7f5d4c0a3710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:12:16.645 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:16.604+0000 7f5d67fc6700 1 --2- 172.21.15.163:0/59711654 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f5d4c0a1260 0x7f5d4c0a3710 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f5d5c005910 tx=0x7f5d5c00b260 comp rx=0 tx=0).stop 2023-07-14T18:12:16.645 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:16.604+0000 7f5d67fc6700 1 -- 172.21.15.163:0/59711654 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f5d60100f90 msgr2=0x7f5d60195d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:12:16.646 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:16.604+0000 7f5d67fc6700 1 --2- 172.21.15.163:0/59711654 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f5d60100f90 0x7f5d60195d90 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f5d5000e9a0 tx=0x7f5d5000ed60 comp rx=0 tx=0).stop 2023-07-14T18:12:16.646 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:16.604+0000 7f5d67fc6700 1 -- 172.21.15.163:0/59711654 shutdown_connections 2023-07-14T18:12:16.646 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:16.604+0000 7f5d67fc6700 1 --2- 172.21.15.163:0/59711654 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f5d4c0a1260 0x7f5d4c0a3710 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:16.646 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:16.604+0000 7f5d67fc6700 1 --2- 172.21.15.163:0/59711654 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5d60101920 0x7f5d6019ce00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:16.646 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:16.604+0000 7f5d67fc6700 1 --2- 172.21.15.163:0/59711654 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5d600fdf20 0x7f5d60195850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:16.646 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:16.604+0000 7f5d67fc6700 1 --2- 172.21.15.163:0/59711654 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f5d60100f90 0x7f5d60195d90 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:16.646 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:16.604+0000 7f5d67fc6700 1 -- 172.21.15.163:0/59711654 >> 172.21.15.163:0/59711654 conn(0x7f5d600f98e0 msgr2=0x7f5d601044c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:12:16.646 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:16.604+0000 7f5d67fc6700 1 -- 172.21.15.163:0/59711654 shutdown_connections 2023-07-14T18:12:16.647 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:16.604+0000 7f5d67fc6700 1 -- 172.21.15.163:0/59711654 wait complete. 2023-07-14T18:12:16.658 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-14T18:12:16.779 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:16.738+0000 7fdbf4617700 1 -- 172.21.15.163:0/315260174 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fdbec0ffd30 msgr2=0x7fdbec100180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:12:16.779 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:16.738+0000 7fdbf4617700 1 --2- 172.21.15.163:0/315260174 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fdbec0ffd30 0x7fdbec100180 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fdbe8009990 tx=0x7fdbe8009ca0 comp rx=0 tx=0).stop 2023-07-14T18:12:16.779 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:16.738+0000 7fdbf4617700 1 -- 172.21.15.163:0/315260174 shutdown_connections 2023-07-14T18:12:16.779 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:16.738+0000 7fdbf4617700 1 --2- 172.21.15.163:0/315260174 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fdbec0feb40 0x7fdbec0fef50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:16.780 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:16.738+0000 7fdbf4617700 1 --2- 172.21.15.163:0/315260174 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdbec1006c0 0x7fdbec106f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:16.780 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:16.738+0000 7fdbf4617700 1 --2- 172.21.15.163:0/315260174 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fdbec0ffd30 0x7fdbec100180 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:16.780 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:16.738+0000 7fdbf4617700 1 -- 172.21.15.163:0/315260174 >> 172.21.15.163:0/315260174 conn(0x7fdbec0fa160 msgr2=0x7fdbec0fc590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:12:16.780 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:16.738+0000 7fdbf4617700 1 -- 172.21.15.163:0/315260174 shutdown_connections 2023-07-14T18:12:16.780 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:16.738+0000 7fdbf4617700 1 -- 172.21.15.163:0/315260174 wait complete. 2023-07-14T18:12:16.782 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:16.739+0000 7fdbf4617700 1 Processor -- start 2023-07-14T18:12:16.782 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:16.739+0000 7fdbf4617700 1 -- start start 2023-07-14T18:12:16.782 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:16.739+0000 7fdbf4617700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdbec0feb40 0x7fdbec069300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:12:16.782 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:16.739+0000 7fdbf4617700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fdbec0ffd30 0x7fdbec19a500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:12:16.783 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:16.739+0000 7fdbf4617700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fdbec1006c0 0x7fdbec19cb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:12:16.783 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:16.739+0000 7fdbf4617700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbec19d320 con 0x7fdbec0ffd30 2023-07-14T18:12:16.783 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:16.739+0000 7fdbf4617700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbec19d490 con 0x7fdbec0feb40 2023-07-14T18:12:16.783 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:16.739+0000 7fdbf4617700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbec19d650 con 0x7fdbec1006c0 2023-07-14T18:12:16.783 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:16.739+0000 7fdbf1bb2700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fdbec0ffd30 0x7fdbec19a500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:12:16.783 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:16.739+0000 7fdbf1bb2700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fdbec0ffd30 0x7fdbec19a500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:56870/0 (socket says 172.21.15.163:56870) 2023-07-14T18:12:16.783 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:16.739+0000 7fdbf1bb2700 1 -- 172.21.15.163:0/1754280058 learned_addr learned my addr 172.21.15.163:0/1754280058 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:12:16.783 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:16.739+0000 7fdbf2bb4700 1 --2- 172.21.15.163:0/1754280058 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fdbec1006c0 0x7fdbec19cb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:12:16.784 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:16.739+0000 7fdbf23b3700 1 --2- 172.21.15.163:0/1754280058 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdbec0feb40 0x7fdbec069300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:12:16.784 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:16.739+0000 7fdbf1bb2700 1 -- 172.21.15.163:0/1754280058 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fdbec1006c0 msgr2=0x7fdbec19cb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:12:16.784 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:16.739+0000 7fdbf1bb2700 1 --2- 172.21.15.163:0/1754280058 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fdbec1006c0 0x7fdbec19cb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:16.784 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:16.739+0000 7fdbf1bb2700 1 -- 172.21.15.163:0/1754280058 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdbec0feb40 msgr2=0x7fdbec069300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:12:16.784 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:16.739+0000 7fdbf1bb2700 1 --2- 172.21.15.163:0/1754280058 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdbec0feb40 0x7fdbec069300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:16.784 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:16.739+0000 7fdbf1bb2700 1 -- 172.21.15.163:0/1754280058 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdbe80095f0 con 0x7fdbec0ffd30 2023-07-14T18:12:16.784 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:16.739+0000 7fdbf1bb2700 1 --2- 172.21.15.163:0/1754280058 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fdbec0ffd30 0x7fdbec19a500 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7fdbe8003a50 tx=0x7fdbe8009580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:12:16.785 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:16.739+0000 7fdbdf7fe700 1 -- 172.21.15.163:0/1754280058 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbe801d070 con 0x7fdbec0ffd30 2023-07-14T18:12:16.785 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:16.740+0000 7fdbdf7fe700 1 -- 172.21.15.163:0/1754280058 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fdbe8005a00 con 0x7fdbec0ffd30 2023-07-14T18:12:16.785 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:16.740+0000 7fdbf4617700 1 -- 172.21.15.163:0/1754280058 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdbec19d8d0 con 0x7fdbec0ffd30 2023-07-14T18:12:16.785 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:16.740+0000 7fdbdf7fe700 1 -- 172.21.15.163:0/1754280058 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbe8005280 con 0x7fdbec0ffd30 2023-07-14T18:12:16.785 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:16.740+0000 7fdbf4617700 1 -- 172.21.15.163:0/1754280058 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdbec19dd20 con 0x7fdbec0ffd30 2023-07-14T18:12:16.785 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:16.741+0000 7fdbf4617700 1 -- 172.21.15.163:0/1754280058 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdbec1060d0 con 0x7fdbec0ffd30 2023-07-14T18:12:16.785 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:16.741+0000 7fdbdf7fe700 1 -- 172.21.15.163:0/1754280058 <== mon.0 v2:172.21.15.163:3300/0 4 ==== mgrmap(e 17) v1 ==== 135767+0+0 (secure 0 0 0) 0x7fdbe80053e0 con 0x7fdbec0ffd30 2023-07-14T18:12:16.786 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:16.742+0000 7fdbdf7fe700 1 --2- 172.21.15.163:0/1754280058 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7fdbd80a1220 0x7fdbd80a36d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:12:16.786 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:16.742+0000 7fdbdf7fe700 1 -- 172.21.15.163:0/1754280058 <== mon.0 v2:172.21.15.163:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 9020+0+0 (secure 0 0 0) 0x7fdbe80cdf20 con 0x7fdbec0ffd30 2023-07-14T18:12:16.787 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:16.742+0000 7fdbf23b3700 1 --2- 172.21.15.163:0/1754280058 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7fdbd80a1220 0x7fdbd80a36d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:12:16.787 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:16.743+0000 7fdbf23b3700 1 --2- 172.21.15.163:0/1754280058 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7fdbd80a1220 0x7fdbd80a36d0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fdbec0ffb90 tx=0x7fdbe000b5b0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:12:16.787 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:16.746+0000 7fdbdf7fe700 1 -- 172.21.15.163:0/1754280058 <== mon.0 v2:172.21.15.163:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178025 (secure 0 0 0) 0x7fdbe805b780 con 0x7fdbec0ffd30 2023-07-14T18:12:16.967 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:12:16 smithi163 ceph-mon[96576]: pgmap v284: 129 pgs: 129 active+clean; 643 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-07-14T18:12:16.967 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:12:16 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.8", "id": [2, 11]}]': finished 2023-07-14T18:12:16.968 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:12:16 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1", "id": [4, 9]}]': finished 2023-07-14T18:12:16.968 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:12:16 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.6", "id": [4, 6]}]': finished 2023-07-14T18:12:16.968 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:12:16 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.25", "id": [5, 9]}]': finished 2023-07-14T18:12:16.968 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:12:16 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.27", "id": [4, 8]}]': finished 2023-07-14T18:12:16.968 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:12:16 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2d", "id": [3, 9]}]': finished 2023-07-14T18:12:16.968 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:12:16 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [5, 8]}]': finished 2023-07-14T18:12:16.969 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:12:16 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [9, 10]}]': finished 2023-07-14T18:12:16.969 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:12:16 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [9, 8]}]': finished 2023-07-14T18:12:16.969 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:12:16 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [9, 8]}]': finished 2023-07-14T18:12:16.969 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:12:16 smithi163 ceph-mon[96576]: osdmap e85: 12 total, 12 up, 12 in 2023-07-14T18:12:16.969 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:12:16 smithi163 ceph-mon[96576]: from='client.? 172.21.15.163:0/904259773' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-07-14T18:12:16.969 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:12:16 smithi163 ceph-mon[96576]: from='client.? 172.21.15.163:0/2121785242' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-07-14T18:12:16.969 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:12:16 smithi163 ceph-mon[96576]: from='client.? 172.21.15.163:0/59711654' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2023-07-14T18:12:17.029 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:16.989+0000 7fdbf4617700 1 -- 172.21.15.163:0/1754280058 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fdbec02c8e0 con 0x7fdbec0ffd30 2023-07-14T18:12:17.030 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:16.989+0000 7fdbdf7fe700 1 -- 172.21.15.163:0/1754280058 <== mon.0 v2:172.21.15.163:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) v1 ==== 94+0+10899 (secure 0 0 0) 0x7fdbe8097290 con 0x7fdbec0ffd30 2023-07-14T18:12:17.030 INFO:teuthology.orchestra.run.smithi163.stdout: 2023-07-14T18:12:17.031 INFO:teuthology.orchestra.run.smithi163.stdout:{"epoch":28,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14562,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.163:6835/1058662632","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6834","nonce":1058662632},{"type":"v1","addr":"172.21.15.163:6835","nonce":1058662632}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":14568,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.163:6837/1107244425","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6836","nonce":1107244425},{"type":"v1","addr":"172.21.15.163:6837","nonce":1107244425}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":28,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-07-14T18:11:09.109693+0000","modified":"2023-07-14T18:11:31.766338+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24518,"mds_1":24493,"mds_2":24479,"mds_3":24478,"mds_4":14652},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14640":{"gid":14640,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.163:6839/1337572937","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6838","nonce":1337572937},{"type":"v1","addr":"172.21.15.163:6839","nonce":1337572937}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_14652":{"gid":14652,"name":"a","rank":4,"incarnation":26,"state":"up:active","state_seq":9,"addr":"172.21.15.163:6841/1032082642","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6840","nonce":1032082642},{"type":"v1","addr":"172.21.15.163:6841","nonce":1032082642}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24421":{"gid":24421,"name":"l","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.184:6833/797722972","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6832","nonce":797722972},{"type":"v1","addr":"172.21.15.184:6833","nonce":797722972}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24431":{"gid":24431,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6833/1075696311","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":1075696311},{"type":"v1","addr":"172.21.15.172:6833","nonce":1075696311}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24458":{"gid":24458,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6835/1158120127","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":1158120127},{"type":"v1","addr":"172.21.15.172:6835","nonce":1158120127}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24466":{"gid":24466,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.184:6835/460134263","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6834","nonce":460134263},{"type":"v1","addr":"172.21.15.184:6835","nonce":460134263}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24478":{"gid":24478,"name":"c","rank":3,"incarnation":24,"state":"up:active","state_seq":11,"addr":"172.21.15.184:6837/3389277679","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6836","nonce":3389277679},{"type":"v1","addr":"172.21.15.184:6837","nonce":3389277679}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24479":{"gid":24479,"name":"h","rank":2,"incarnation":22,"state":"up:active","state_seq":10,"addr":"172.21.15.172:6837/3783835012","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":3783835012},{"type":"v1","addr":"172.21.15.172:6837","nonce":3783835012}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24493":{"gid":24493,"name":"i","rank":1,"incarnation":20,"state":"up:active","state_seq":9,"addr":"172.21.15.184:6839/2819059257","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6838","nonce":2819059257},{"type":"v1","addr":"172.21.15.184:6839","nonce":2819059257}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24518":{"gid":24518,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.172:6839/3850440096","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6838","nonce":3850440096},{"type":"v1","addr":"172.21.15.172:6839","nonce":3850440096}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-07-14T18:12:17.032 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:16.991+0000 7fdbf4617700 1 -- 172.21.15.163:0/1754280058 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7fdbd80a1220 msgr2=0x7fdbd80a36d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:12:17.033 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:16.991+0000 7fdbf4617700 1 --2- 172.21.15.163:0/1754280058 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7fdbd80a1220 0x7fdbd80a36d0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fdbec0ffb90 tx=0x7fdbe000b5b0 comp rx=0 tx=0).stop 2023-07-14T18:12:17.033 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:16.991+0000 7fdbf4617700 1 -- 172.21.15.163:0/1754280058 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fdbec0ffd30 msgr2=0x7fdbec19a500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:12:17.033 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:16.991+0000 7fdbf4617700 1 --2- 172.21.15.163:0/1754280058 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fdbec0ffd30 0x7fdbec19a500 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7fdbe8003a50 tx=0x7fdbe8009580 comp rx=0 tx=0).stop 2023-07-14T18:12:17.033 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:16.992+0000 7fdbf4617700 1 -- 172.21.15.163:0/1754280058 shutdown_connections 2023-07-14T18:12:17.033 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:16.992+0000 7fdbf4617700 1 --2- 172.21.15.163:0/1754280058 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7fdbd80a1220 0x7fdbd80a36d0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:17.034 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:16.992+0000 7fdbf4617700 1 --2- 172.21.15.163:0/1754280058 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fdbec1006c0 0x7fdbec19cb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:17.034 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:16.992+0000 7fdbf4617700 1 --2- 172.21.15.163:0/1754280058 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdbec0feb40 0x7fdbec069300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:17.034 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:16.992+0000 7fdbf4617700 1 --2- 172.21.15.163:0/1754280058 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fdbec0ffd30 0x7fdbec19a500 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:17.034 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:16.992+0000 7fdbf4617700 1 -- 172.21.15.163:0/1754280058 >> 172.21.15.163:0/1754280058 conn(0x7fdbec0fa160 msgr2=0x7fdbec103210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:12:17.034 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:16.992+0000 7fdbf4617700 1 -- 172.21.15.163:0/1754280058 shutdown_connections 2023-07-14T18:12:17.034 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:16.992+0000 7fdbf4617700 1 -- 172.21.15.163:0/1754280058 wait complete. 2023-07-14T18:12:17.035 INFO:teuthology.orchestra.run.smithi163.stderr:dumped fsmap epoch 28 2023-07-14T18:12:17.045 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-14T18:12:17.167 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:17.126+0000 7fed47cb2700 1 -- 172.21.15.163:0/3388279446 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fed400feb00 msgr2=0x7fed400fef10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:12:17.168 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:17.126+0000 7fed47cb2700 1 --2- 172.21.15.163:0/3388279446 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fed400feb00 0x7fed400fef10 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fed30009990 tx=0x7fed30009ca0 comp rx=0 tx=0).stop 2023-07-14T18:12:17.168 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:17.126+0000 7fed47cb2700 1 -- 172.21.15.163:0/3388279446 shutdown_connections 2023-07-14T18:12:17.168 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:17.126+0000 7fed47cb2700 1 --2- 172.21.15.163:0/3388279446 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fed40100680 0x7fed40106f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:17.168 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:17.126+0000 7fed47cb2700 1 --2- 172.21.15.163:0/3388279446 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fed400feb00 0x7fed400fef10 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:17.168 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:17.126+0000 7fed47cb2700 1 --2- 172.21.15.163:0/3388279446 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fed400ffcf0 0x7fed40100140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:17.168 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:17.126+0000 7fed47cb2700 1 -- 172.21.15.163:0/3388279446 >> 172.21.15.163:0/3388279446 conn(0x7fed400fa100 msgr2=0x7fed400fc550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:12:17.168 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:17.126+0000 7fed47cb2700 1 -- 172.21.15.163:0/3388279446 shutdown_connections 2023-07-14T18:12:17.169 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:17.126+0000 7fed47cb2700 1 -- 172.21.15.163:0/3388279446 wait complete. 2023-07-14T18:12:17.169 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:17.126+0000 7fed47cb2700 1 Processor -- start 2023-07-14T18:12:17.169 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:17.126+0000 7fed47cb2700 1 -- start start 2023-07-14T18:12:17.169 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:17.127+0000 7fed47cb2700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fed400feb00 0x7fed40195870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:12:17.169 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:17.127+0000 7fed47cb2700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fed400ffcf0 0x7fed40195db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:12:17.169 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:17.127+0000 7fed47cb2700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fed40100680 0x7fed4019ce20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:12:17.169 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:17.127+0000 7fed47cb2700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed4019d3f0 con 0x7fed400feb00 2023-07-14T18:12:17.170 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:17.127+0000 7fed47cb2700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed4019d530 con 0x7fed400ffcf0 2023-07-14T18:12:17.170 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:17.127+0000 7fed47cb2700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed4019d6c0 con 0x7fed40100680 2023-07-14T18:12:17.170 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:17.127+0000 7fed45a4e700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fed400feb00 0x7fed40195870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:12:17.170 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:17.127+0000 7fed45a4e700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fed400feb00 0x7fed40195870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:56882/0 (socket says 172.21.15.163:56882) 2023-07-14T18:12:17.170 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:17.127+0000 7fed45a4e700 1 -- 172.21.15.163:0/918164134 learned_addr learned my addr 172.21.15.163:0/918164134 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:12:17.170 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:17.127+0000 7fed4524d700 1 --2- 172.21.15.163:0/918164134 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fed400ffcf0 0x7fed40195db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:12:17.170 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:17.127+0000 7fed4624f700 1 --2- 172.21.15.163:0/918164134 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fed40100680 0x7fed4019ce20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:12:17.172 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:17.127+0000 7fed45a4e700 1 -- 172.21.15.163:0/918164134 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fed40100680 msgr2=0x7fed4019ce20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:12:17.172 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:17.127+0000 7fed45a4e700 1 --2- 172.21.15.163:0/918164134 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fed40100680 0x7fed4019ce20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:17.172 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:17.127+0000 7fed45a4e700 1 -- 172.21.15.163:0/918164134 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fed400ffcf0 msgr2=0x7fed40195db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:12:17.172 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:17.127+0000 7fed45a4e700 1 --2- 172.21.15.163:0/918164134 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fed400ffcf0 0x7fed40195db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:17.172 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:17.127+0000 7fed45a4e700 1 -- 172.21.15.163:0/918164134 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed300095f0 con 0x7fed400feb00 2023-07-14T18:12:17.172 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:17.127+0000 7fed45a4e700 1 --2- 172.21.15.163:0/918164134 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fed400feb00 0x7fed40195870 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fed30000c00 tx=0x7fed300047b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:12:17.173 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:17.127+0000 7fed36ffd700 1 -- 172.21.15.163:0/918164134 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed3001d070 con 0x7fed400feb00 2023-07-14T18:12:17.173 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:17.127+0000 7fed47cb2700 1 -- 172.21.15.163:0/918164134 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fed4019d940 con 0x7fed400feb00 2023-07-14T18:12:17.173 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:17.127+0000 7fed36ffd700 1 -- 172.21.15.163:0/918164134 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fed30003f40 con 0x7fed400feb00 2023-07-14T18:12:17.173 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:17.127+0000 7fed36ffd700 1 -- 172.21.15.163:0/918164134 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed30022bf0 con 0x7fed400feb00 2023-07-14T18:12:17.173 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:17.127+0000 7fed47cb2700 1 -- 172.21.15.163:0/918164134 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed4019ddf0 con 0x7fed400feb00 2023-07-14T18:12:17.173 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:17.128+0000 7fed47cb2700 1 -- 172.21.15.163:0/918164134 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fed4010a1a0 con 0x7fed400feb00 2023-07-14T18:12:17.173 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:17.129+0000 7fed36ffd700 1 -- 172.21.15.163:0/918164134 <== mon.0 v2:172.21.15.163:3300/0 4 ==== mgrmap(e 17) v1 ==== 135767+0+0 (secure 0 0 0) 0x7fed30022d50 con 0x7fed400feb00 2023-07-14T18:12:17.174 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:17.130+0000 7fed36ffd700 1 --2- 172.21.15.163:0/918164134 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7fed2c0a1220 0x7fed2c0a36d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:12:17.174 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:17.130+0000 7fed36ffd700 1 -- 172.21.15.163:0/918164134 <== mon.0 v2:172.21.15.163:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 9020+0+0 (secure 0 0 0) 0x7fed300ce690 con 0x7fed400feb00 2023-07-14T18:12:17.174 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:17.130+0000 7fed4524d700 1 --2- 172.21.15.163:0/918164134 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7fed2c0a1220 0x7fed2c0a36d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:12:17.174 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:17.130+0000 7fed4524d700 1 --2- 172.21.15.163:0/918164134 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7fed2c0a1220 0x7fed2c0a36d0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fed3c004630 tx=0x7fed3c00b3c0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:12:17.174 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:17.133+0000 7fed36ffd700 1 -- 172.21.15.163:0/918164134 <== mon.0 v2:172.21.15.163:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178025 (secure 0 0 0) 0x7fed30097a00 con 0x7fed400feb00 2023-07-14T18:12:17.175 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:12:16 smithi184 ceph-mon[98481]: pgmap v284: 129 pgs: 129 active+clean; 643 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-07-14T18:12:17.175 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:12:16 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.8", "id": [2, 11]}]': finished 2023-07-14T18:12:17.175 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:12:16 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1", "id": [4, 9]}]': finished 2023-07-14T18:12:17.175 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:12:16 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.6", "id": [4, 6]}]': finished 2023-07-14T18:12:17.175 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:12:16 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.25", "id": [5, 9]}]': finished 2023-07-14T18:12:17.175 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:12:16 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.27", "id": [4, 8]}]': finished 2023-07-14T18:12:17.176 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:12:16 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2d", "id": [3, 9]}]': finished 2023-07-14T18:12:17.176 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:12:16 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [5, 8]}]': finished 2023-07-14T18:12:17.176 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:12:16 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [9, 10]}]': finished 2023-07-14T18:12:17.176 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:12:16 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [9, 8]}]': finished 2023-07-14T18:12:17.176 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:12:16 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [9, 8]}]': finished 2023-07-14T18:12:17.176 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:12:16 smithi184 ceph-mon[98481]: osdmap e85: 12 total, 12 up, 12 in 2023-07-14T18:12:17.176 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:12:16 smithi184 ceph-mon[98481]: from='client.? 172.21.15.163:0/904259773' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-07-14T18:12:17.177 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:12:16 smithi184 ceph-mon[98481]: from='client.? 172.21.15.163:0/2121785242' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-07-14T18:12:17.177 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:12:16 smithi184 ceph-mon[98481]: from='client.? 172.21.15.163:0/59711654' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2023-07-14T18:12:17.276 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:12:16 smithi172 ceph-mon[97983]: pgmap v284: 129 pgs: 129 active+clean; 643 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-07-14T18:12:17.276 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:12:16 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.8", "id": [2, 11]}]': finished 2023-07-14T18:12:17.276 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:12:16 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1", "id": [4, 9]}]': finished 2023-07-14T18:12:17.276 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:12:16 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.6", "id": [4, 6]}]': finished 2023-07-14T18:12:17.276 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:12:16 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.25", "id": [5, 9]}]': finished 2023-07-14T18:12:17.277 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:12:16 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.27", "id": [4, 8]}]': finished 2023-07-14T18:12:17.277 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:12:16 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2d", "id": [3, 9]}]': finished 2023-07-14T18:12:17.277 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:12:16 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [5, 8]}]': finished 2023-07-14T18:12:17.277 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:12:16 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [9, 10]}]': finished 2023-07-14T18:12:17.277 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:12:16 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [9, 8]}]': finished 2023-07-14T18:12:17.277 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:12:16 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [9, 8]}]': finished 2023-07-14T18:12:17.277 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:12:16 smithi172 ceph-mon[97983]: osdmap e85: 12 total, 12 up, 12 in 2023-07-14T18:12:17.277 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:12:16 smithi172 ceph-mon[97983]: from='client.? 172.21.15.163:0/904259773' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-07-14T18:12:17.278 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:12:16 smithi172 ceph-mon[97983]: from='client.? 172.21.15.163:0/2121785242' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-07-14T18:12:17.278 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:12:16 smithi172 ceph-mon[97983]: from='client.? 172.21.15.163:0/59711654' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2023-07-14T18:12:17.363 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:17.322+0000 7fed47cb2700 1 -- 172.21.15.163:0/918164134 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fed4019e3d0 con 0x7fed400feb00 2023-07-14T18:12:17.365 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:17.324+0000 7fed36ffd700 1 -- 172.21.15.163:0/918164134 <== mon.0 v2:172.21.15.163:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v86) v1 ==== 74+0+24500 (secure 0 0 0) 0x7fed3009b020 con 0x7fed400feb00 2023-07-14T18:12:17.366 INFO:teuthology.orchestra.run.smithi163.stdout: 2023-07-14T18:12:17.366 INFO:teuthology.orchestra.run.smithi163.stdout:{"epoch":86,"fsid":"bf7326ec-2270-11ee-9b33-001a4aab830c","created":"2023-07-14T18:04:26.263517+0000","modified":"2023-07-14T18:12:16.776609+0000","last_up_change":"2023-07-14T18:10:27.514863+0000","last_in_change":"2023-07-14T18:10:10.726443+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-14T18:07:19.653852+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-07-14T18:11:07.314989+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-07-14T18:11:08.274627+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-07-14T18:11:11.991162+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"e6490568-046d-43ef-bb07-d79fb884b276","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6802","nonce":3124653025},{"type":"v1","addr":"172.21.15.163:6803","nonce":3124653025}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6804","nonce":3124653025},{"type":"v1","addr":"172.21.15.163:6805","nonce":3124653025}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6808","nonce":3124653025},{"type":"v1","addr":"172.21.15.163:6809","nonce":3124653025}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6806","nonce":3124653025},{"type":"v1","addr":"172.21.15.163:6807","nonce":3124653025}]},"public_addr":"172.21.15.163:6803/3124653025","cluster_addr":"172.21.15.163:6805/3124653025","heartbeat_back_addr":"172.21.15.163:6809/3124653025","heartbeat_front_addr":"172.21.15.163:6807/3124653025","state":["exists","up"]},{"osd":1,"uuid":"0af39bda-f096-4603-adcc-bf1988f36603","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":3774455900},{"type":"v1","addr":"172.21.15.172:6801","nonce":3774455900}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":3774455900},{"type":"v1","addr":"172.21.15.172:6803","nonce":3774455900}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":3774455900},{"type":"v1","addr":"172.21.15.172:6807","nonce":3774455900}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":3774455900},{"type":"v1","addr":"172.21.15.172:6805","nonce":3774455900}]},"public_addr":"172.21.15.172:6801/3774455900","cluster_addr":"172.21.15.172:6803/3774455900","heartbeat_back_addr":"172.21.15.172:6807/3774455900","heartbeat_front_addr":"172.21.15.172:6805/3774455900","state":["exists","up"]},{"osd":2,"uuid":"cc732c13-af0f-4199-98e6-fe960ed4e5dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":1976927678},{"type":"v1","addr":"172.21.15.184:6801","nonce":1976927678}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":1976927678},{"type":"v1","addr":"172.21.15.184:6803","nonce":1976927678}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":1976927678},{"type":"v1","addr":"172.21.15.184:6807","nonce":1976927678}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":1976927678},{"type":"v1","addr":"172.21.15.184:6805","nonce":1976927678}]},"public_addr":"172.21.15.184:6801/1976927678","cluster_addr":"172.21.15.184:6803/1976927678","heartbeat_back_addr":"172.21.15.184:6807/1976927678","heartbeat_front_addr":"172.21.15.184:6805/1976927678","state":["exists","up"]},{"osd":3,"uuid":"dcee9576-0bc6-4ab0-8f63-79eacd0eca5f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6810","nonce":2589130694},{"type":"v1","addr":"172.21.15.163:6811","nonce":2589130694}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6812","nonce":2589130694},{"type":"v1","addr":"172.21.15.163:6813","nonce":2589130694}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6816","nonce":2589130694},{"type":"v1","addr":"172.21.15.163:6817","nonce":2589130694}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6814","nonce":2589130694},{"type":"v1","addr":"172.21.15.163:6815","nonce":2589130694}]},"public_addr":"172.21.15.163:6811/2589130694","cluster_addr":"172.21.15.163:6813/2589130694","heartbeat_back_addr":"172.21.15.163:6817/2589130694","heartbeat_front_addr":"172.21.15.163:6815/2589130694","state":["exists","up"]},{"osd":4,"uuid":"055df823-b8b0-426a-83c2-f0d727932ad8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":3319632614},{"type":"v1","addr":"172.21.15.172:6809","nonce":3319632614}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6810","nonce":3319632614},{"type":"v1","addr":"172.21.15.172:6811","nonce":3319632614}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6814","nonce":3319632614},{"type":"v1","addr":"172.21.15.172:6815","nonce":3319632614}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":3319632614},{"type":"v1","addr":"172.21.15.172:6813","nonce":3319632614}]},"public_addr":"172.21.15.172:6809/3319632614","cluster_addr":"172.21.15.172:6811/3319632614","heartbeat_back_addr":"172.21.15.172:6815/3319632614","heartbeat_front_addr":"172.21.15.172:6813/3319632614","state":["exists","up"]},{"osd":5,"uuid":"ef5ef02a-b4e2-4790-9d27-f6d2247b25c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":2662084043},{"type":"v1","addr":"172.21.15.184:6809","nonce":2662084043}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6810","nonce":2662084043},{"type":"v1","addr":"172.21.15.184:6811","nonce":2662084043}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6814","nonce":2662084043},{"type":"v1","addr":"172.21.15.184:6815","nonce":2662084043}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6812","nonce":2662084043},{"type":"v1","addr":"172.21.15.184:6813","nonce":2662084043}]},"public_addr":"172.21.15.184:6809/2662084043","cluster_addr":"172.21.15.184:6811/2662084043","heartbeat_back_addr":"172.21.15.184:6815/2662084043","heartbeat_front_addr":"172.21.15.184:6813/2662084043","state":["exists","up"]},{"osd":6,"uuid":"dba754be-0fc5-4867-a6d5-cf97eb344f81","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":44,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6818","nonce":2530874117},{"type":"v1","addr":"172.21.15.163:6819","nonce":2530874117}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6820","nonce":2530874117},{"type":"v1","addr":"172.21.15.163:6821","nonce":2530874117}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6824","nonce":2530874117},{"type":"v1","addr":"172.21.15.163:6825","nonce":2530874117}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6822","nonce":2530874117},{"type":"v1","addr":"172.21.15.163:6823","nonce":2530874117}]},"public_addr":"172.21.15.163:6819/2530874117","cluster_addr":"172.21.15.163:6821/2530874117","heartbeat_back_addr":"172.21.15.163:6825/2530874117","heartbeat_front_addr":"172.21.15.163:6823/2530874117","state":["exists","up"]},{"osd":7,"uuid":"edd76e6b-6077-4619-b00d-1e906f70ddcc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":49,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":233511803},{"type":"v1","addr":"172.21.15.172:6817","nonce":233511803}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6818","nonce":233511803},{"type":"v1","addr":"172.21.15.172:6819","nonce":233511803}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":233511803},{"type":"v1","addr":"172.21.15.172:6823","nonce":233511803}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6820","nonce":233511803},{"type":"v1","addr":"172.21.15.172:6821","nonce":233511803}]},"public_addr":"172.21.15.172:6817/233511803","cluster_addr":"172.21.15.172:6819/233511803","heartbeat_back_addr":"172.21.15.172:6823/233511803","heartbeat_front_addr":"172.21.15.172:6821/233511803","state":["exists","up"]},{"osd":8,"uuid":"36559400-f33e-44e6-868a-316d34da457d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":56,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6816","nonce":290154343},{"type":"v1","addr":"172.21.15.184:6817","nonce":290154343}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6818","nonce":290154343},{"type":"v1","addr":"172.21.15.184:6819","nonce":290154343}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6822","nonce":290154343},{"type":"v1","addr":"172.21.15.184:6823","nonce":290154343}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6820","nonce":290154343},{"type":"v1","addr":"172.21.15.184:6821","nonce":290154343}]},"public_addr":"172.21.15.184:6817/290154343","cluster_addr":"172.21.15.184:6819/290154343","heartbeat_back_addr":"172.21.15.184:6823/290154343","heartbeat_front_addr":"172.21.15.184:6821/290154343","state":["exists","up"]},{"osd":9,"uuid":"d484f111-f36c-4c67-9a8a-ae03e7e0d137","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6826","nonce":3848110906},{"type":"v1","addr":"172.21.15.163:6827","nonce":3848110906}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6828","nonce":3848110906},{"type":"v1","addr":"172.21.15.163:6829","nonce":3848110906}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6832","nonce":3848110906},{"type":"v1","addr":"172.21.15.163:6833","nonce":3848110906}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6830","nonce":3848110906},{"type":"v1","addr":"172.21.15.163:6831","nonce":3848110906}]},"public_addr":"172.21.15.163:6827/3848110906","cluster_addr":"172.21.15.163:6829/3848110906","heartbeat_back_addr":"172.21.15.163:6833/3848110906","heartbeat_front_addr":"172.21.15.163:6831/3848110906","state":["exists","up"]},{"osd":10,"uuid":"d943f7c0-da3d-4605-9e23-0231e675c6be","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6824","nonce":3281085356},{"type":"v1","addr":"172.21.15.172:6825","nonce":3281085356}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":3281085356},{"type":"v1","addr":"172.21.15.172:6827","nonce":3281085356}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":3281085356},{"type":"v1","addr":"172.21.15.172:6831","nonce":3281085356}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6828","nonce":3281085356},{"type":"v1","addr":"172.21.15.172:6829","nonce":3281085356}]},"public_addr":"172.21.15.172:6825/3281085356","cluster_addr":"172.21.15.172:6827/3281085356","heartbeat_back_addr":"172.21.15.172:6831/3281085356","heartbeat_front_addr":"172.21.15.172:6829/3281085356","state":["exists","up"]},{"osd":11,"uuid":"09e610a8-408a-4119-a21b-c4de2810a538","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":75,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6824","nonce":3614578747},{"type":"v1","addr":"172.21.15.184:6825","nonce":3614578747}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6826","nonce":3614578747},{"type":"v1","addr":"172.21.15.184:6827","nonce":3614578747}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6830","nonce":3614578747},{"type":"v1","addr":"172.21.15.184:6831","nonce":3614578747}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6828","nonce":3614578747},{"type":"v1","addr":"172.21.15.184:6829","nonce":3614578747}]},"public_addr":"172.21.15.184:6825/3614578747","cluster_addr":"172.21.15.184:6827/3614578747","heartbeat_back_addr":"172.21.15.184:6831/3614578747","heartbeat_front_addr":"172.21.15.184:6829/3614578747","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T18:06:36.067578+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T18:06:57.095120+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T18:07:17.825363+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T18:07:38.977196+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T18:08:00.108709+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T18:08:20.700646+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T18:08:41.473899+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T18:09:02.856536+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T18:09:23.832722+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T18:09:44.860884+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T18:10:05.520678+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T18:10:26.426315+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.8","mappings":[{"from":2,"to":11}]},{"pgid":"3.1","mappings":[{"from":4,"to":9}]},{"pgid":"3.6","mappings":[{"from":4,"to":6}]},{"pgid":"3.25","mappings":[{"from":5,"to":9}]},{"pgid":"3.27","mappings":[{"from":4,"to":8}]},{"pgid":"3.2d","mappings":[{"from":3,"to":9}]},{"pgid":"4.a","mappings":[{"from":5,"to":8}]},{"pgid":"4.12","mappings":[{"from":9,"to":10}]},{"pgid":"4.14","mappings":[{"from":9,"to":8}]},{"pgid":"4.17","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.163:6801/1086512093":"2023-07-15T18:05:15.331458+0000","172.21.15.163:6800/1086512093":"2023-07-15T18:05:15.331458+0000","172.21.15.163:0/4235784810":"2023-07-15T18:05:15.331458+0000","172.21.15.163:6800/236891232":"2023-07-15T18:04:53.288443+0000","172.21.15.163:6801/236891232":"2023-07-15T18:04:53.288443+0000","172.21.15.163:0/3260193612":"2023-07-15T18:05:15.331458+0000","172.21.15.163:0/3513629472":"2023-07-15T18:04:53.288443+0000","172.21.15.163:0/1090329830":"2023-07-15T18:04:53.288443+0000","172.21.15.163:0/3868922045":"2023-07-15T18:05:15.331458+0000","172.21.15.163:0/2945662447":"2023-07-15T18:04:53.288443+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-14T18:12:17.367 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:17.326+0000 7fed47cb2700 1 -- 172.21.15.163:0/918164134 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7fed2c0a1220 msgr2=0x7fed2c0a36d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:12:17.367 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:17.326+0000 7fed47cb2700 1 --2- 172.21.15.163:0/918164134 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7fed2c0a1220 0x7fed2c0a36d0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fed3c004630 tx=0x7fed3c00b3c0 comp rx=0 tx=0).stop 2023-07-14T18:12:17.368 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:17.326+0000 7fed47cb2700 1 -- 172.21.15.163:0/918164134 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fed400feb00 msgr2=0x7fed40195870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:12:17.368 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:17.326+0000 7fed47cb2700 1 --2- 172.21.15.163:0/918164134 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fed400feb00 0x7fed40195870 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fed30000c00 tx=0x7fed300047b0 comp rx=0 tx=0).stop 2023-07-14T18:12:17.368 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:17.326+0000 7fed47cb2700 1 -- 172.21.15.163:0/918164134 shutdown_connections 2023-07-14T18:12:17.368 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:17.326+0000 7fed47cb2700 1 --2- 172.21.15.163:0/918164134 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7fed2c0a1220 0x7fed2c0a36d0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:17.368 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:17.326+0000 7fed47cb2700 1 --2- 172.21.15.163:0/918164134 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fed40100680 0x7fed4019ce20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:17.369 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:17.326+0000 7fed47cb2700 1 --2- 172.21.15.163:0/918164134 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fed400feb00 0x7fed40195870 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:17.369 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:17.326+0000 7fed47cb2700 1 --2- 172.21.15.163:0/918164134 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fed400ffcf0 0x7fed40195db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:17.369 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:17.326+0000 7fed47cb2700 1 -- 172.21.15.163:0/918164134 >> 172.21.15.163:0/918164134 conn(0x7fed400fa100 msgr2=0x7fed40067800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:12:17.369 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:17.326+0000 7fed47cb2700 1 -- 172.21.15.163:0/918164134 shutdown_connections 2023-07-14T18:12:17.369 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:17.326+0000 7fed47cb2700 1 -- 172.21.15.163:0/918164134 wait complete. 2023-07-14T18:12:17.380 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-14T18:07:19.653852+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-14T18:11:07.314989+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '79', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-07-14T18:11:08.274627+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '80', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-07-14T18:11:11.991162+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '84', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-07-14T18:12:17.381 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-14T18:12:17.508 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:17.464+0000 7f7bc1e44700 1 -- 172.21.15.163:0/2319187593 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f7bbc1006c0 msgr2=0x7f7bbc106f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:12:17.508 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:17.464+0000 7f7bc1e44700 1 --2- 172.21.15.163:0/2319187593 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f7bbc1006c0 0x7f7bbc106f80 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f7bb400b0a0 tx=0x7f7bb400b3b0 comp rx=0 tx=0).stop 2023-07-14T18:12:17.509 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:17.464+0000 7f7bc1e44700 1 -- 172.21.15.163:0/2319187593 shutdown_connections 2023-07-14T18:12:17.509 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:17.464+0000 7f7bc1e44700 1 --2- 172.21.15.163:0/2319187593 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f7bbc1006c0 0x7f7bbc106f80 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:17.509 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:17.464+0000 7f7bc1e44700 1 --2- 172.21.15.163:0/2319187593 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7bbc0feb40 0x7f7bbc0fef50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:17.509 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:17.464+0000 7f7bc1e44700 1 --2- 172.21.15.163:0/2319187593 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7bbc0ffd30 0x7f7bbc100180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:17.509 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:17.464+0000 7f7bc1e44700 1 -- 172.21.15.163:0/2319187593 >> 172.21.15.163:0/2319187593 conn(0x7f7bbc0fa160 msgr2=0x7f7bbc0fc590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:12:17.509 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:17.464+0000 7f7bc1e44700 1 -- 172.21.15.163:0/2319187593 shutdown_connections 2023-07-14T18:12:17.509 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:17.464+0000 7f7bc1e44700 1 -- 172.21.15.163:0/2319187593 wait complete. 2023-07-14T18:12:17.510 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:17.465+0000 7f7bc1e44700 1 Processor -- start 2023-07-14T18:12:17.510 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:17.465+0000 7f7bc1e44700 1 -- start start 2023-07-14T18:12:17.510 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:17.465+0000 7f7bc1e44700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7bbc0feb40 0x7f7bbc102a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:12:17.510 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:17.465+0000 7f7bc1e44700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7bbc0ffd30 0x7f7bbc101110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:12:17.511 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:17.465+0000 7f7bc1e44700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f7bbc1006c0 0x7f7bbc101650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:12:17.511 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:17.465+0000 7f7bc1e44700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7bbc101df0 con 0x7f7bbc1006c0 2023-07-14T18:12:17.511 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:17.465+0000 7f7bc1e44700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7bbc101f60 con 0x7f7bbc0feb40 2023-07-14T18:12:17.511 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:17.465+0000 7f7bc1e44700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7bbc19fa40 con 0x7f7bbc0ffd30 2023-07-14T18:12:17.511 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:17.465+0000 7f7bbbfff700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f7bbc1006c0 0x7f7bbc101650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:12:17.511 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:17.465+0000 7f7bbbfff700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f7bbc1006c0 0x7f7bbc101650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:56900/0 (socket says 172.21.15.163:56900) 2023-07-14T18:12:17.512 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:17.465+0000 7f7bbbfff700 1 -- 172.21.15.163:0/2086666325 learned_addr learned my addr 172.21.15.163:0/2086666325 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:12:17.512 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:17.465+0000 7f7bbaffd700 1 --2- 172.21.15.163:0/2086666325 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7bbc0ffd30 0x7f7bbc101110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:12:17.512 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:17.465+0000 7f7bbb7fe700 1 --2- 172.21.15.163:0/2086666325 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7bbc0feb40 0x7f7bbc102a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:12:17.512 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:17.466+0000 7f7bbbfff700 1 -- 172.21.15.163:0/2086666325 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7bbc0ffd30 msgr2=0x7f7bbc101110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:12:17.512 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:17.466+0000 7f7bbbfff700 1 --2- 172.21.15.163:0/2086666325 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7bbc0ffd30 0x7f7bbc101110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:17.513 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:17.466+0000 7f7bbbfff700 1 -- 172.21.15.163:0/2086666325 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7bbc0feb40 msgr2=0x7f7bbc102a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:12:17.513 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:17.466+0000 7f7bbbfff700 1 --2- 172.21.15.163:0/2086666325 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7bbc0feb40 0x7f7bbc102a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:17.513 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:17.466+0000 7f7bbbfff700 1 -- 172.21.15.163:0/2086666325 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7bb4009d00 con 0x7f7bbc1006c0 2023-07-14T18:12:17.513 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:17.466+0000 7f7bbbfff700 1 --2- 172.21.15.163:0/2086666325 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f7bbc1006c0 0x7f7bbc101650 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f7bb400b830 tx=0x7f7bb4004ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:12:17.513 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:17.466+0000 7f7bb8ff9700 1 -- 172.21.15.163:0/2086666325 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bb400e040 con 0x7f7bbc1006c0 2023-07-14T18:12:17.513 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:17.466+0000 7f7bc1e44700 1 -- 172.21.15.163:0/2086666325 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7bbc19fc70 con 0x7f7bbc1006c0 2023-07-14T18:12:17.514 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:17.466+0000 7f7bb8ff9700 1 -- 172.21.15.163:0/2086666325 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f7bb4009440 con 0x7f7bbc1006c0 2023-07-14T18:12:17.514 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:17.466+0000 7f7bb8ff9700 1 -- 172.21.15.163:0/2086666325 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bb401dc00 con 0x7f7bbc1006c0 2023-07-14T18:12:17.514 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:17.466+0000 7f7bc1e44700 1 -- 172.21.15.163:0/2086666325 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7bbc1a00f0 con 0x7f7bbc1006c0 2023-07-14T18:12:17.514 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:17.467+0000 7f7bc1e44700 1 -- 172.21.15.163:0/2086666325 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7bbc10a1d0 con 0x7f7bbc1006c0 2023-07-14T18:12:17.515 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:17.468+0000 7f7bb8ff9700 1 -- 172.21.15.163:0/2086666325 <== mon.0 v2:172.21.15.163:3300/0 4 ==== mgrmap(e 17) v1 ==== 135767+0+0 (secure 0 0 0) 0x7f7bb4005450 con 0x7f7bbc1006c0 2023-07-14T18:12:17.516 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:17.469+0000 7f7bb8ff9700 1 --2- 172.21.15.163:0/2086666325 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f7ba80a11e0 0x7f7ba80a3690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:12:17.516 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:17.469+0000 7f7bbb7fe700 1 --2- 172.21.15.163:0/2086666325 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f7ba80a11e0 0x7f7ba80a3690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:12:17.516 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:17.469+0000 7f7bb8ff9700 1 -- 172.21.15.163:0/2086666325 <== mon.0 v2:172.21.15.163:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 9020+0+0 (secure 0 0 0) 0x7f7bb40ceff0 con 0x7f7bbc1006c0 2023-07-14T18:12:17.516 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:17.469+0000 7f7bbb7fe700 1 --2- 172.21.15.163:0/2086666325 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f7ba80a11e0 0x7f7ba80a3690 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f7bac005950 tx=0x7f7bac0058e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:12:17.516 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:17.473+0000 7f7bb8ff9700 1 -- 172.21.15.163:0/2086666325 <== mon.0 v2:172.21.15.163:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178025 (secure 0 0 0) 0x7f7bb4098360 con 0x7f7bbc1006c0 2023-07-14T18:12:17.703 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:17.662+0000 7f7bc1e44700 1 -- 172.21.15.163:0/2086666325 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f7bbc1a06a0 con 0x7f7bbc1006c0 2023-07-14T18:12:17.703 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:17.662+0000 7f7bb8ff9700 1 -- 172.21.15.163:0/2086666325 <== mon.0 v2:172.21.15.163:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v86) v1 ==== 93+0+10 (secure 0 0 0) 0x7f7bb409b980 con 0x7f7bbc1006c0 2023-07-14T18:12:17.704 INFO:teuthology.orchestra.run.smithi163.stdout:pg_num: 1 2023-07-14T18:12:17.705 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:17.664+0000 7f7bc1e44700 1 -- 172.21.15.163:0/2086666325 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f7ba80a11e0 msgr2=0x7f7ba80a3690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:12:17.705 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:17.664+0000 7f7bc1e44700 1 --2- 172.21.15.163:0/2086666325 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f7ba80a11e0 0x7f7ba80a3690 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f7bac005950 tx=0x7f7bac0058e0 comp rx=0 tx=0).stop 2023-07-14T18:12:17.706 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:17.664+0000 7f7bc1e44700 1 -- 172.21.15.163:0/2086666325 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f7bbc1006c0 msgr2=0x7f7bbc101650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:12:17.706 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:17.664+0000 7f7bc1e44700 1 --2- 172.21.15.163:0/2086666325 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f7bbc1006c0 0x7f7bbc101650 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f7bb400b830 tx=0x7f7bb4004ce0 comp rx=0 tx=0).stop 2023-07-14T18:12:17.706 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:17.664+0000 7f7bc1e44700 1 -- 172.21.15.163:0/2086666325 shutdown_connections 2023-07-14T18:12:17.706 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:17.664+0000 7f7bc1e44700 1 --2- 172.21.15.163:0/2086666325 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f7ba80a11e0 0x7f7ba80a3690 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:17.706 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:17.664+0000 7f7bc1e44700 1 --2- 172.21.15.163:0/2086666325 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f7bbc1006c0 0x7f7bbc101650 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:17.706 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:17.664+0000 7f7bc1e44700 1 --2- 172.21.15.163:0/2086666325 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7bbc0feb40 0x7f7bbc102a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:17.706 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:17.664+0000 7f7bc1e44700 1 --2- 172.21.15.163:0/2086666325 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7bbc0ffd30 0x7f7bbc101110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:17.706 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:17.664+0000 7f7bc1e44700 1 -- 172.21.15.163:0/2086666325 >> 172.21.15.163:0/2086666325 conn(0x7f7bbc0fa160 msgr2=0x7f7bbc0687b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:12:17.707 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:17.665+0000 7f7bc1e44700 1 -- 172.21.15.163:0/2086666325 shutdown_connections 2023-07-14T18:12:17.707 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:17.665+0000 7f7bc1e44700 1 -- 172.21.15.163:0/2086666325 wait complete. 2023-07-14T18:12:17.718 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-14T18:12:17.847 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:17.805+0000 7fa4a7e58700 1 -- 172.21.15.163:0/2017194840 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fa4a0100e00 msgr2=0x7fa4a0101250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:12:17.848 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:17.805+0000 7fa4a7e58700 1 --2- 172.21.15.163:0/2017194840 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fa4a0100e00 0x7fa4a0101250 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fa490009990 tx=0x7fa490009ca0 comp rx=0 tx=0).stop 2023-07-14T18:12:17.848 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:17.805+0000 7fa4a7e58700 1 -- 172.21.15.163:0/2017194840 shutdown_connections 2023-07-14T18:12:17.849 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:17.805+0000 7fa4a7e58700 1 --2- 172.21.15.163:0/2017194840 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa4a0101790 0x7fa4a0108050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:17.849 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:17.805+0000 7fa4a7e58700 1 --2- 172.21.15.163:0/2017194840 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa4a00ffc10 0x7fa4a0100020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:17.849 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:17.805+0000 7fa4a7e58700 1 --2- 172.21.15.163:0/2017194840 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fa4a0100e00 0x7fa4a0101250 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:17.849 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:17.805+0000 7fa4a7e58700 1 -- 172.21.15.163:0/2017194840 >> 172.21.15.163:0/2017194840 conn(0x7fa4a00fb250 msgr2=0x7fa4a00fd660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:12:17.849 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:17.805+0000 7fa4a7e58700 1 -- 172.21.15.163:0/2017194840 shutdown_connections 2023-07-14T18:12:17.849 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:17.805+0000 7fa4a7e58700 1 -- 172.21.15.163:0/2017194840 wait complete. 2023-07-14T18:12:17.850 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:17.806+0000 7fa4a7e58700 1 Processor -- start 2023-07-14T18:12:17.850 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:17.806+0000 7fa4a7e58700 1 -- start start 2023-07-14T18:12:17.850 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:17.806+0000 7fa4a7e58700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa4a00ffc10 0x7fa4a0195800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:12:17.850 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:17.806+0000 7fa4a7e58700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa4a0100e00 0x7fa4a0195d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:12:17.850 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:17.806+0000 7fa4a7e58700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fa4a0101790 0x7fa4a019cdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:12:17.850 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:17.806+0000 7fa4a7e58700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4a019d380 con 0x7fa4a0101790 2023-07-14T18:12:17.850 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:17.806+0000 7fa4a7e58700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4a019d4c0 con 0x7fa4a00ffc10 2023-07-14T18:12:17.850 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:17.806+0000 7fa4a7e58700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4a019d650 con 0x7fa4a0100e00 2023-07-14T18:12:17.851 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:17.806+0000 7fa4a63f5700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fa4a0101790 0x7fa4a019cdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:12:17.851 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:17.806+0000 7fa4a63f5700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fa4a0101790 0x7fa4a019cdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:56914/0 (socket says 172.21.15.163:56914) 2023-07-14T18:12:17.851 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:17.806+0000 7fa4a63f5700 1 -- 172.21.15.163:0/3691784774 learned_addr learned my addr 172.21.15.163:0/3691784774 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:12:17.851 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:17.806+0000 7fa4a53f3700 1 --2- 172.21.15.163:0/3691784774 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa4a0100e00 0x7fa4a0195d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:12:17.851 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:17.806+0000 7fa4a5bf4700 1 --2- 172.21.15.163:0/3691784774 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa4a00ffc10 0x7fa4a0195800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:12:17.851 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:17.806+0000 7fa4a63f5700 1 -- 172.21.15.163:0/3691784774 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa4a0100e00 msgr2=0x7fa4a0195d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:12:17.851 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:17.806+0000 7fa4a63f5700 1 --2- 172.21.15.163:0/3691784774 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa4a0100e00 0x7fa4a0195d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:17.851 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:17.806+0000 7fa4a63f5700 1 -- 172.21.15.163:0/3691784774 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa4a00ffc10 msgr2=0x7fa4a0195800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:12:17.852 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:17.806+0000 7fa4a63f5700 1 --2- 172.21.15.163:0/3691784774 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa4a00ffc10 0x7fa4a0195800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:17.852 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:17.806+0000 7fa4a63f5700 1 -- 172.21.15.163:0/3691784774 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4900095f0 con 0x7fa4a0101790 2023-07-14T18:12:17.852 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:17.806+0000 7fa4a63f5700 1 --2- 172.21.15.163:0/3691784774 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fa4a0101790 0x7fa4a019cdb0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fa49800ef30 tx=0x7fa49800c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:12:17.852 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:17.807+0000 7fa496ffd700 1 -- 172.21.15.163:0/3691784774 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa498018070 con 0x7fa4a0101790 2023-07-14T18:12:17.852 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:17.807+0000 7fa496ffd700 1 -- 172.21.15.163:0/3691784774 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fa49800f040 con 0x7fa4a0101790 2023-07-14T18:12:17.853 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:17.807+0000 7fa4a7e58700 1 -- 172.21.15.163:0/3691784774 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa4a019d8d0 con 0x7fa4a0101790 2023-07-14T18:12:17.853 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:17.807+0000 7fa496ffd700 1 -- 172.21.15.163:0/3691784774 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa49800cc70 con 0x7fa4a0101790 2023-07-14T18:12:17.853 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:17.807+0000 7fa4a7e58700 1 -- 172.21.15.163:0/3691784774 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4a019dd90 con 0x7fa4a0101790 2023-07-14T18:12:17.854 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:17.808+0000 7fa4a7e58700 1 -- 172.21.15.163:0/3691784774 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa4a0106b40 con 0x7fa4a0101790 2023-07-14T18:12:17.854 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:17.809+0000 7fa496ffd700 1 -- 172.21.15.163:0/3691784774 <== mon.0 v2:172.21.15.163:3300/0 4 ==== mgrmap(e 17) v1 ==== 135767+0+0 (secure 0 0 0) 0x7fa498003a00 con 0x7fa4a0101790 2023-07-14T18:12:17.854 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:17.810+0000 7fa496ffd700 1 --2- 172.21.15.163:0/3691784774 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7fa48c0a11e0 0x7fa48c0a3690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:12:17.855 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:17.810+0000 7fa496ffd700 1 -- 172.21.15.163:0/3691784774 <== mon.0 v2:172.21.15.163:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 9020+0+0 (secure 0 0 0) 0x7fa4980ccf00 con 0x7fa4a0101790 2023-07-14T18:12:17.855 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:17.810+0000 7fa4a5bf4700 1 --2- 172.21.15.163:0/3691784774 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7fa48c0a11e0 0x7fa48c0a3690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:12:17.856 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:17.810+0000 7fa4a5bf4700 1 --2- 172.21.15.163:0/3691784774 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7fa48c0a11e0 0x7fa48c0a3690 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fa49c005fd0 tx=0x7fa49c005e50 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:12:17.856 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:17.813+0000 7fa496ffd700 1 -- 172.21.15.163:0/3691784774 <== mon.0 v2:172.21.15.163:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178025 (secure 0 0 0) 0x7fa498096270 con 0x7fa4a0101790 2023-07-14T18:12:17.967 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:12:17 smithi163 ceph-mon[96576]: osdmap e86: 12 total, 12 up, 12 in 2023-07-14T18:12:17.967 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:12:17 smithi163 ceph-mon[96576]: from='client.? 172.21.15.163:0/1754280058' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-07-14T18:12:17.967 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:12:17 smithi163 ceph-mon[96576]: from='client.? 172.21.15.163:0/918164134' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-07-14T18:12:17.967 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:12:17 smithi163 ceph-mon[96576]: from='client.? 172.21.15.163:0/2086666325' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-07-14T18:12:18.044 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:18.003+0000 7fa4a7e58700 1 -- 172.21.15.163:0/3691784774 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fa4a002cd60 con 0x7fa4a0101790 2023-07-14T18:12:18.045 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:18.004+0000 7fa496ffd700 1 -- 172.21.15.163:0/3691784774 <== mon.0 v2:172.21.15.163:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v86) v1 ==== 104+0+11 (secure 0 0 0) 0x7fa4a002cd60 con 0x7fa4a0101790 2023-07-14T18:12:18.045 INFO:teuthology.orchestra.run.smithi163.stdout:pg_num: 32 2023-07-14T18:12:18.047 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:18.006+0000 7fa4a7e58700 1 -- 172.21.15.163:0/3691784774 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7fa48c0a11e0 msgr2=0x7fa48c0a3690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:12:18.047 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:18.006+0000 7fa4a7e58700 1 --2- 172.21.15.163:0/3691784774 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7fa48c0a11e0 0x7fa48c0a3690 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fa49c005fd0 tx=0x7fa49c005e50 comp rx=0 tx=0).stop 2023-07-14T18:12:18.047 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:18.006+0000 7fa4a7e58700 1 -- 172.21.15.163:0/3691784774 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fa4a0101790 msgr2=0x7fa4a019cdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:12:18.047 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:18.006+0000 7fa4a7e58700 1 --2- 172.21.15.163:0/3691784774 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fa4a0101790 0x7fa4a019cdb0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fa49800ef30 tx=0x7fa49800c3a0 comp rx=0 tx=0).stop 2023-07-14T18:12:18.048 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:18.006+0000 7fa4a7e58700 1 -- 172.21.15.163:0/3691784774 shutdown_connections 2023-07-14T18:12:18.048 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:18.006+0000 7fa4a7e58700 1 --2- 172.21.15.163:0/3691784774 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7fa48c0a11e0 0x7fa48c0a3690 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:18.048 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:18.006+0000 7fa4a7e58700 1 --2- 172.21.15.163:0/3691784774 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fa4a0101790 0x7fa4a019cdb0 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:18.048 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:18.006+0000 7fa4a7e58700 1 --2- 172.21.15.163:0/3691784774 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa4a00ffc10 0x7fa4a0195800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:18.048 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:18.006+0000 7fa4a7e58700 1 --2- 172.21.15.163:0/3691784774 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa4a0100e00 0x7fa4a0195d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:18.048 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:18.006+0000 7fa4a7e58700 1 -- 172.21.15.163:0/3691784774 >> 172.21.15.163:0/3691784774 conn(0x7fa4a00fb250 msgr2=0x7fa4a00fd510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:12:18.048 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:18.006+0000 7fa4a7e58700 1 -- 172.21.15.163:0/3691784774 shutdown_connections 2023-07-14T18:12:18.049 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:18.006+0000 7fa4a7e58700 1 -- 172.21.15.163:0/3691784774 wait complete. 2023-07-14T18:12:18.059 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-14T18:12:18.175 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:12:17 smithi184 ceph-mon[98481]: osdmap e86: 12 total, 12 up, 12 in 2023-07-14T18:12:18.175 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:12:17 smithi184 ceph-mon[98481]: from='client.? 172.21.15.163:0/1754280058' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-07-14T18:12:18.175 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:12:17 smithi184 ceph-mon[98481]: from='client.? 172.21.15.163:0/918164134' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-07-14T18:12:18.175 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:12:17 smithi184 ceph-mon[98481]: from='client.? 172.21.15.163:0/2086666325' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-07-14T18:12:18.183 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:18.142+0000 7f9f61585700 1 -- 172.21.15.163:0/2829481962 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f9f5c100e20 msgr2=0x7f9f5c101270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:12:18.184 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:18.142+0000 7f9f61585700 1 --2- 172.21.15.163:0/2829481962 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f9f5c100e20 0x7f9f5c101270 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f9f50009990 tx=0x7f9f50009ca0 comp rx=0 tx=0).stop 2023-07-14T18:12:18.184 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:18.142+0000 7f9f61585700 1 -- 172.21.15.163:0/2829481962 shutdown_connections 2023-07-14T18:12:18.184 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:18.142+0000 7f9f61585700 1 --2- 172.21.15.163:0/2829481962 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9f5c0ffc30 0x7f9f5c100040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:18.184 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:18.142+0000 7f9f61585700 1 --2- 172.21.15.163:0/2829481962 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9f5c1017b0 0x7f9f5c108070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:18.184 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:18.142+0000 7f9f61585700 1 --2- 172.21.15.163:0/2829481962 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f9f5c100e20 0x7f9f5c101270 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:18.184 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:18.142+0000 7f9f61585700 1 -- 172.21.15.163:0/2829481962 >> 172.21.15.163:0/2829481962 conn(0x7f9f5c0fb290 msgr2=0x7f9f5c0fd6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:12:18.185 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:18.142+0000 7f9f61585700 1 -- 172.21.15.163:0/2829481962 shutdown_connections 2023-07-14T18:12:18.185 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:18.142+0000 7f9f61585700 1 -- 172.21.15.163:0/2829481962 wait complete. 2023-07-14T18:12:18.185 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:18.143+0000 7f9f61585700 1 Processor -- start 2023-07-14T18:12:18.190 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:18.143+0000 7f9f61585700 1 -- start start 2023-07-14T18:12:18.191 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:18.143+0000 7f9f61585700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9f5c0ffc30 0x7f9f5c195830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:12:18.191 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:18.143+0000 7f9f61585700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f9f5c100e20 0x7f9f5c195d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:12:18.192 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:18.143+0000 7f9f61585700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9f5c1017b0 0x7f9f5c19cde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:12:18.192 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:18.143+0000 7f9f61585700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f5c19d3b0 con 0x7f9f5c100e20 2023-07-14T18:12:18.192 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:18.143+0000 7f9f61585700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f5c19d4f0 con 0x7f9f5c1017b0 2023-07-14T18:12:18.192 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:18.143+0000 7f9f61585700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f5c19d680 con 0x7f9f5c0ffc30 2023-07-14T18:12:18.193 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:18.143+0000 7f9f5a7fc700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f9f5c100e20 0x7f9f5c195d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:12:18.193 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:18.143+0000 7f9f5a7fc700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f9f5c100e20 0x7f9f5c195d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:56924/0 (socket says 172.21.15.163:56924) 2023-07-14T18:12:18.193 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:18.143+0000 7f9f5a7fc700 1 -- 172.21.15.163:0/494750641 learned_addr learned my addr 172.21.15.163:0/494750641 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:12:18.193 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:18.144+0000 7f9f5affd700 1 --2- 172.21.15.163:0/494750641 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9f5c0ffc30 0x7f9f5c195830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:12:18.194 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:18.144+0000 7f9f5a7fc700 1 -- 172.21.15.163:0/494750641 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9f5c0ffc30 msgr2=0x7f9f5c195830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:12:18.194 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:18.144+0000 7f9f5a7fc700 1 --2- 172.21.15.163:0/494750641 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9f5c0ffc30 0x7f9f5c195830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:18.194 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:18.144+0000 7f9f5b7fe700 1 --2- 172.21.15.163:0/494750641 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9f5c1017b0 0x7f9f5c19cde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:12:18.195 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:18.144+0000 7f9f5a7fc700 1 -- 172.21.15.163:0/494750641 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9f5c1017b0 msgr2=0x7f9f5c19cde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:12:18.195 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:18.144+0000 7f9f5a7fc700 1 --2- 172.21.15.163:0/494750641 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9f5c1017b0 0x7f9f5c19cde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:18.195 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:18.144+0000 7f9f5a7fc700 1 -- 172.21.15.163:0/494750641 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f500095f0 con 0x7f9f5c100e20 2023-07-14T18:12:18.195 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:18.144+0000 7f9f5a7fc700 1 --2- 172.21.15.163:0/494750641 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f9f5c100e20 0x7f9f5c195d70 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f9f50003ec0 tx=0x7f9f50005ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:12:18.196 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:18.144+0000 7f9f43fff700 1 -- 172.21.15.163:0/494750641 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f5001d070 con 0x7f9f5c100e20 2023-07-14T18:12:18.196 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:18.144+0000 7f9f61585700 1 -- 172.21.15.163:0/494750641 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9f5c19d900 con 0x7f9f5c100e20 2023-07-14T18:12:18.196 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:18.144+0000 7f9f43fff700 1 -- 172.21.15.163:0/494750641 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f9f50004830 con 0x7f9f5c100e20 2023-07-14T18:12:18.196 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:18.144+0000 7f9f43fff700 1 -- 172.21.15.163:0/494750641 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f50005350 con 0x7f9f5c100e20 2023-07-14T18:12:18.197 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:18.144+0000 7f9f61585700 1 -- 172.21.15.163:0/494750641 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f5c19dd20 con 0x7f9f5c100e20 2023-07-14T18:12:18.197 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:18.145+0000 7f9f61585700 1 -- 172.21.15.163:0/494750641 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9f5c106b60 con 0x7f9f5c100e20 2023-07-14T18:12:18.197 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:18.146+0000 7f9f43fff700 1 -- 172.21.15.163:0/494750641 <== mon.0 v2:172.21.15.163:3300/0 4 ==== mgrmap(e 17) v1 ==== 135767+0+0 (secure 0 0 0) 0x7f9f500054b0 con 0x7f9f5c100e20 2023-07-14T18:12:18.197 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:18.146+0000 7f9f43fff700 1 --2- 172.21.15.163:0/494750641 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f9f440a1260 0x7f9f440a3710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:12:18.198 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:18.147+0000 7f9f5affd700 1 --2- 172.21.15.163:0/494750641 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f9f440a1260 0x7f9f440a3710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:12:18.198 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:18.147+0000 7f9f43fff700 1 -- 172.21.15.163:0/494750641 <== mon.0 v2:172.21.15.163:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 9020+0+0 (secure 0 0 0) 0x7f9f500ce6a0 con 0x7f9f5c100e20 2023-07-14T18:12:18.198 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:18.147+0000 7f9f5affd700 1 --2- 172.21.15.163:0/494750641 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f9f440a1260 0x7f9f440a3710 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f9f5c100c80 tx=0x7f9f4c009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:12:18.199 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:18.150+0000 7f9f43fff700 1 -- 172.21.15.163:0/494750641 <== mon.0 v2:172.21.15.163:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178025 (secure 0 0 0) 0x7f9f500979b0 con 0x7f9f5c100e20 2023-07-14T18:12:18.276 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:12:17 smithi172 ceph-mon[97983]: osdmap e86: 12 total, 12 up, 12 in 2023-07-14T18:12:18.276 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:12:17 smithi172 ceph-mon[97983]: from='client.? 172.21.15.163:0/1754280058' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-07-14T18:12:18.276 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:12:17 smithi172 ceph-mon[97983]: from='client.? 172.21.15.163:0/918164134' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-07-14T18:12:18.276 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:12:17 smithi172 ceph-mon[97983]: from='client.? 172.21.15.163:0/2086666325' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-07-14T18:12:18.379 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:18.338+0000 7f9f61585700 1 -- 172.21.15.163:0/494750641 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f9f5c02c8e0 con 0x7f9f5c100e20 2023-07-14T18:12:18.379 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:18.339+0000 7f9f43fff700 1 -- 172.21.15.163:0/494750641 <== mon.0 v2:172.21.15.163:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v86) v1 ==== 100+0+11 (secure 0 0 0) 0x7f9f50030020 con 0x7f9f5c100e20 2023-07-14T18:12:18.380 INFO:teuthology.orchestra.run.smithi163.stdout:pg_num: 64 2023-07-14T18:12:18.381 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:18.341+0000 7f9f61585700 1 -- 172.21.15.163:0/494750641 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f9f440a1260 msgr2=0x7f9f440a3710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:12:18.382 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:18.341+0000 7f9f61585700 1 --2- 172.21.15.163:0/494750641 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f9f440a1260 0x7f9f440a3710 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f9f5c100c80 tx=0x7f9f4c009260 comp rx=0 tx=0).stop 2023-07-14T18:12:18.382 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:18.341+0000 7f9f61585700 1 -- 172.21.15.163:0/494750641 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f9f5c100e20 msgr2=0x7f9f5c195d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:12:18.382 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:18.341+0000 7f9f61585700 1 --2- 172.21.15.163:0/494750641 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f9f5c100e20 0x7f9f5c195d70 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f9f50003ec0 tx=0x7f9f50005ef0 comp rx=0 tx=0).stop 2023-07-14T18:12:18.382 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:18.341+0000 7f9f61585700 1 -- 172.21.15.163:0/494750641 shutdown_connections 2023-07-14T18:12:18.382 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:18.341+0000 7f9f61585700 1 --2- 172.21.15.163:0/494750641 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f9f440a1260 0x7f9f440a3710 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:18.382 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:18.341+0000 7f9f61585700 1 --2- 172.21.15.163:0/494750641 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9f5c0ffc30 0x7f9f5c195830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:18.383 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:18.341+0000 7f9f61585700 1 --2- 172.21.15.163:0/494750641 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9f5c1017b0 0x7f9f5c19cde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:18.383 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:18.341+0000 7f9f61585700 1 --2- 172.21.15.163:0/494750641 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f9f5c100e20 0x7f9f5c195d70 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:18.383 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:18.341+0000 7f9f61585700 1 -- 172.21.15.163:0/494750641 >> 172.21.15.163:0/494750641 conn(0x7f9f5c0fb290 msgr2=0x7f9f5c0fe530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:12:18.383 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:18.341+0000 7f9f61585700 1 -- 172.21.15.163:0/494750641 shutdown_connections 2023-07-14T18:12:18.383 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:18.341+0000 7f9f61585700 1 -- 172.21.15.163:0/494750641 wait complete. 2023-07-14T18:12:18.394 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-07-14T18:12:18.519 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:18.478+0000 7f82f521c700 1 -- 172.21.15.163:0/120899751 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f82f0103010 msgr2=0x7f82f01053f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:12:18.519 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:18.478+0000 7f82f521c700 1 --2- 172.21.15.163:0/120899751 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f82f0103010 0x7f82f01053f0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f82d8009990 tx=0x7f82d8009ca0 comp rx=0 tx=0).stop 2023-07-14T18:12:18.519 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:18.478+0000 7f82f521c700 1 -- 172.21.15.163:0/120899751 shutdown_connections 2023-07-14T18:12:18.519 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:18.478+0000 7f82f521c700 1 --2- 172.21.15.163:0/120899751 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f82f0105930 0x7f82f0107d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:18.520 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:18.478+0000 7f82f521c700 1 --2- 172.21.15.163:0/120899751 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f82f01006f0 0x7f82f0102ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:18.520 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:18.478+0000 7f82f521c700 1 --2- 172.21.15.163:0/120899751 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f82f0103010 0x7f82f01053f0 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:18.520 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:18.478+0000 7f82f521c700 1 -- 172.21.15.163:0/120899751 >> 172.21.15.163:0/120899751 conn(0x7f82f00fa130 msgr2=0x7f82f00fc560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:12:18.520 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:18.478+0000 7f82f521c700 1 -- 172.21.15.163:0/120899751 shutdown_connections 2023-07-14T18:12:18.520 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:18.478+0000 7f82f521c700 1 -- 172.21.15.163:0/120899751 wait complete. 2023-07-14T18:12:18.522 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:18.478+0000 7f82f521c700 1 Processor -- start 2023-07-14T18:12:18.522 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:18.479+0000 7f82f521c700 1 -- start start 2023-07-14T18:12:18.522 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:18.479+0000 7f82f521c700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f82f01006f0 0x7f82f0100060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:12:18.522 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:18.479+0000 7f82f521c700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f82f0103010 0x7f82f00fe6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:12:18.522 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:18.479+0000 7f82f521c700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f82f0105930 0x7f82f00febe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:12:18.522 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:18.479+0000 7f82f521c700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82f00ff380 con 0x7f82f0103010 2023-07-14T18:12:18.523 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:18.479+0000 7f82f521c700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82f00ff4f0 con 0x7f82f01006f0 2023-07-14T18:12:18.523 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:18.479+0000 7f82f521c700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82f019f8b0 con 0x7f82f0105930 2023-07-14T18:12:18.523 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:18.479+0000 7f82ee59c700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f82f0103010 0x7f82f00fe6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:12:18.523 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:18.479+0000 7f82ee59c700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f82f0103010 0x7f82f00fe6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:56938/0 (socket says 172.21.15.163:56938) 2023-07-14T18:12:18.523 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:18.479+0000 7f82ee59c700 1 -- 172.21.15.163:0/3332999781 learned_addr learned my addr 172.21.15.163:0/3332999781 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:12:18.523 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:18.479+0000 7f82eed9d700 1 --2- 172.21.15.163:0/3332999781 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f82f01006f0 0x7f82f0100060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:12:18.523 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:18.479+0000 7f82ef59e700 1 --2- 172.21.15.163:0/3332999781 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f82f0105930 0x7f82f00febe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:12:18.523 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:18.479+0000 7f82ee59c700 1 -- 172.21.15.163:0/3332999781 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f82f0105930 msgr2=0x7f82f00febe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:12:18.524 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:18.479+0000 7f82ee59c700 1 --2- 172.21.15.163:0/3332999781 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f82f0105930 0x7f82f00febe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:18.524 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:18.479+0000 7f82ee59c700 1 -- 172.21.15.163:0/3332999781 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f82f01006f0 msgr2=0x7f82f0100060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:12:18.524 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:18.479+0000 7f82ee59c700 1 --2- 172.21.15.163:0/3332999781 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f82f01006f0 0x7f82f0100060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:18.524 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:18.479+0000 7f82ee59c700 1 -- 172.21.15.163:0/3332999781 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82d80095f0 con 0x7f82f0103010 2023-07-14T18:12:18.524 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:18.480+0000 7f82ee59c700 1 --2- 172.21.15.163:0/3332999781 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f82f0103010 0x7f82f00fe6a0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f82d8006010 tx=0x7f82d8004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:12:18.524 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:18.480+0000 7f82e7fff700 1 -- 172.21.15.163:0/3332999781 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82d801d070 con 0x7f82f0103010 2023-07-14T18:12:18.524 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:18.480+0000 7f82e7fff700 1 -- 172.21.15.163:0/3332999781 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f82d80041b0 con 0x7f82f0103010 2023-07-14T18:12:18.525 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:18.480+0000 7f82f521c700 1 -- 172.21.15.163:0/3332999781 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f82f019fb30 con 0x7f82f0103010 2023-07-14T18:12:18.525 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:18.480+0000 7f82e7fff700 1 -- 172.21.15.163:0/3332999781 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82d8022da0 con 0x7f82f0103010 2023-07-14T18:12:18.525 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:18.480+0000 7f82f521c700 1 -- 172.21.15.163:0/3332999781 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f82f019ff50 con 0x7f82f0103010 2023-07-14T18:12:18.525 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:18.481+0000 7f82f521c700 1 -- 172.21.15.163:0/3332999781 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f82f00fbca0 con 0x7f82f0103010 2023-07-14T18:12:18.526 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:18.482+0000 7f82e7fff700 1 -- 172.21.15.163:0/3332999781 <== mon.0 v2:172.21.15.163:3300/0 4 ==== mgrmap(e 17) v1 ==== 135767+0+0 (secure 0 0 0) 0x7f82d8022570 con 0x7f82f0103010 2023-07-14T18:12:18.526 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:18.482+0000 7f82e7fff700 1 --2- 172.21.15.163:0/3332999781 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f82dc0a11e0 0x7f82dc0a3690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:12:18.526 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:18.482+0000 7f82e7fff700 1 -- 172.21.15.163:0/3332999781 <== mon.0 v2:172.21.15.163:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 9020+0+0 (secure 0 0 0) 0x7f82d80ce390 con 0x7f82f0103010 2023-07-14T18:12:18.526 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:18.482+0000 7f82eed9d700 1 --2- 172.21.15.163:0/3332999781 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f82dc0a11e0 0x7f82dc0a3690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:12:18.526 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:18.483+0000 7f82eed9d700 1 --2- 172.21.15.163:0/3332999781 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f82dc0a11e0 0x7f82dc0a3690 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f82e000bbd0 tx=0x7f82e000b5b0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:12:18.527 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:18.487+0000 7f82e7fff700 1 -- 172.21.15.163:0/3332999781 <== mon.0 v2:172.21.15.163:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178025 (secure 0 0 0) 0x7f82d80976a0 con 0x7f82f0103010 2023-07-14T18:12:18.717 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:18.676+0000 7f82f521c700 1 -- 172.21.15.163:0/3332999781 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f82f010b2f0 con 0x7f82f0103010 2023-07-14T18:12:18.718 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:18.677+0000 7f82e7fff700 1 -- 172.21.15.163:0/3332999781 <== mon.0 v2:172.21.15.163:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v86) v1 ==== 103+0+11 (secure 0 0 0) 0x7f82d809acc0 con 0x7f82f0103010 2023-07-14T18:12:18.718 INFO:teuthology.orchestra.run.smithi163.stdout:pg_num: 32 2023-07-14T18:12:18.720 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:18.679+0000 7f82f521c700 1 -- 172.21.15.163:0/3332999781 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f82dc0a11e0 msgr2=0x7f82dc0a3690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:12:18.720 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:18.679+0000 7f82f521c700 1 --2- 172.21.15.163:0/3332999781 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f82dc0a11e0 0x7f82dc0a3690 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f82e000bbd0 tx=0x7f82e000b5b0 comp rx=0 tx=0).stop 2023-07-14T18:12:18.720 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:18.679+0000 7f82f521c700 1 -- 172.21.15.163:0/3332999781 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f82f0103010 msgr2=0x7f82f00fe6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:12:18.720 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:18.679+0000 7f82f521c700 1 --2- 172.21.15.163:0/3332999781 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f82f0103010 0x7f82f00fe6a0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f82d8006010 tx=0x7f82d8004730 comp rx=0 tx=0).stop 2023-07-14T18:12:18.721 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:18.679+0000 7f82f521c700 1 -- 172.21.15.163:0/3332999781 shutdown_connections 2023-07-14T18:12:18.721 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:18.679+0000 7f82f521c700 1 --2- 172.21.15.163:0/3332999781 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f82dc0a11e0 0x7f82dc0a3690 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:18.721 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:18.679+0000 7f82f521c700 1 --2- 172.21.15.163:0/3332999781 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f82f0105930 0x7f82f00febe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:18.722 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:18.679+0000 7f82f521c700 1 --2- 172.21.15.163:0/3332999781 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f82f01006f0 0x7f82f0100060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:18.722 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:18.679+0000 7f82f521c700 1 --2- 172.21.15.163:0/3332999781 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f82f0103010 0x7f82f00fe6a0 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:18.722 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:18.679+0000 7f82f521c700 1 -- 172.21.15.163:0/3332999781 >> 172.21.15.163:0/3332999781 conn(0x7f82f00fa130 msgr2=0x7f82f0101350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:12:18.722 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:18.679+0000 7f82f521c700 1 -- 172.21.15.163:0/3332999781 shutdown_connections 2023-07-14T18:12:18.722 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:18.679+0000 7f82f521c700 1 -- 172.21.15.163:0/3332999781 wait complete. 2023-07-14T18:12:18.733 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-14T18:12:18.859 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:18.815+0000 7f57e3ecc700 1 -- 172.21.15.163:0/2063432763 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f57dc0ffcf0 msgr2=0x7f57dc100140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:12:18.859 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:18.815+0000 7f57e3ecc700 1 --2- 172.21.15.163:0/2063432763 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f57dc0ffcf0 0x7f57dc100140 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f57d8009990 tx=0x7f57d8009ca0 comp rx=0 tx=0).stop 2023-07-14T18:12:18.860 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:18.815+0000 7f57e3ecc700 1 -- 172.21.15.163:0/2063432763 shutdown_connections 2023-07-14T18:12:18.860 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:18.815+0000 7f57e3ecc700 1 --2- 172.21.15.163:0/2063432763 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f57dc0feb00 0x7f57dc0fef10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:18.860 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:18.815+0000 7f57e3ecc700 1 --2- 172.21.15.163:0/2063432763 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f57dc100680 0x7f57dc106f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:18.861 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:18.815+0000 7f57e3ecc700 1 --2- 172.21.15.163:0/2063432763 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f57dc0ffcf0 0x7f57dc100140 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:18.861 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:18.815+0000 7f57e3ecc700 1 -- 172.21.15.163:0/2063432763 >> 172.21.15.163:0/2063432763 conn(0x7f57dc0fa100 msgr2=0x7f57dc0fc550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:12:18.861 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:18.815+0000 7f57e3ecc700 1 -- 172.21.15.163:0/2063432763 shutdown_connections 2023-07-14T18:12:18.861 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:18.815+0000 7f57e3ecc700 1 -- 172.21.15.163:0/2063432763 wait complete. 2023-07-14T18:12:18.861 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:18.815+0000 7f57e3ecc700 1 Processor -- start 2023-07-14T18:12:18.861 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:18.816+0000 7f57e3ecc700 1 -- start start 2023-07-14T18:12:18.862 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:18.816+0000 7f57e3ecc700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f57dc0feb00 0x7f57dc194750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:12:18.862 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:18.816+0000 7f57e3ecc700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f57dc0ffcf0 0x7f57dc194c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:12:18.862 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:18.816+0000 7f57e3ecc700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f57dc100680 0x7f57dc19bd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:12:18.862 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:18.816+0000 7f57e3ecc700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57dc19c2d0 con 0x7f57dc0ffcf0 2023-07-14T18:12:18.862 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:18.816+0000 7f57e3ecc700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57dc19c410 con 0x7f57dc0feb00 2023-07-14T18:12:18.862 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:18.816+0000 7f57e3ecc700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57dc19c5a0 con 0x7f57dc100680 2023-07-14T18:12:18.862 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:18.816+0000 7f57e1467700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f57dc0ffcf0 0x7f57dc194c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:12:18.863 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:18.816+0000 7f57e1467700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f57dc0ffcf0 0x7f57dc194c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:56952/0 (socket says 172.21.15.163:56952) 2023-07-14T18:12:18.863 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:18.816+0000 7f57e1467700 1 -- 172.21.15.163:0/816737012 learned_addr learned my addr 172.21.15.163:0/816737012 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:12:18.863 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:18.816+0000 7f57e2469700 1 --2- 172.21.15.163:0/816737012 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f57dc100680 0x7f57dc19bd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:12:18.863 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:18.816+0000 7f57e1c68700 1 --2- 172.21.15.163:0/816737012 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f57dc0feb00 0x7f57dc194750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:12:18.863 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:18.816+0000 7f57e1467700 1 -- 172.21.15.163:0/816737012 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f57dc100680 msgr2=0x7f57dc19bd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:12:18.863 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:18.816+0000 7f57e1467700 1 --2- 172.21.15.163:0/816737012 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f57dc100680 0x7f57dc19bd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:18.864 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:18.816+0000 7f57e1467700 1 -- 172.21.15.163:0/816737012 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f57dc0feb00 msgr2=0x7f57dc194750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:12:18.864 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:18.816+0000 7f57e1467700 1 --2- 172.21.15.163:0/816737012 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f57dc0feb00 0x7f57dc194750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:18.864 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:18.816+0000 7f57e1467700 1 -- 172.21.15.163:0/816737012 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57d80095f0 con 0x7f57dc0ffcf0 2023-07-14T18:12:18.864 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:18.816+0000 7f57e1467700 1 --2- 172.21.15.163:0/816737012 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f57dc0ffcf0 0x7f57dc194c90 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f57d8006010 tx=0x7f57d8004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:12:18.864 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:18.816+0000 7f57d2ffd700 1 -- 172.21.15.163:0/816737012 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57d801d070 con 0x7f57dc0ffcf0 2023-07-14T18:12:18.864 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:18.816+0000 7f57e3ecc700 1 -- 172.21.15.163:0/816737012 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f57dc19c820 con 0x7f57dc0ffcf0 2023-07-14T18:12:18.865 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:18.816+0000 7f57d2ffd700 1 -- 172.21.15.163:0/816737012 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f57d80054c0 con 0x7f57dc0ffcf0 2023-07-14T18:12:18.865 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:18.816+0000 7f57d2ffd700 1 -- 172.21.15.163:0/816737012 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57d8003ab0 con 0x7f57dc0ffcf0 2023-07-14T18:12:18.865 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:18.817+0000 7f57e3ecc700 1 -- 172.21.15.163:0/816737012 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f57dc19cc40 con 0x7f57dc0ffcf0 2023-07-14T18:12:18.865 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:18.818+0000 7f57e3ecc700 1 -- 172.21.15.163:0/816737012 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f57dc105a30 con 0x7f57dc0ffcf0 2023-07-14T18:12:18.866 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:18.819+0000 7f57d2ffd700 1 -- 172.21.15.163:0/816737012 <== mon.0 v2:172.21.15.163:3300/0 4 ==== mgrmap(e 17) v1 ==== 135767+0+0 (secure 0 0 0) 0x7f57d80047a0 con 0x7f57dc0ffcf0 2023-07-14T18:12:18.866 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:18.819+0000 7f57d2ffd700 1 --2- 172.21.15.163:0/816737012 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f57c80a1220 0x7f57c80a36d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:12:18.866 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:18.819+0000 7f57e1c68700 1 --2- 172.21.15.163:0/816737012 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f57c80a1220 0x7f57c80a36d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:12:18.866 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:18.819+0000 7f57d2ffd700 1 -- 172.21.15.163:0/816737012 <== mon.0 v2:172.21.15.163:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 9020+0+0 (secure 0 0 0) 0x7f57d80ce160 con 0x7f57dc0ffcf0 2023-07-14T18:12:18.866 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:18.820+0000 7f57e1c68700 1 --2- 172.21.15.163:0/816737012 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f57c80a1220 0x7f57c80a36d0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f57dc0ffb50 tx=0x7f57cc00b5b0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:12:18.867 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:18.823+0000 7f57d2ffd700 1 -- 172.21.15.163:0/816737012 <== mon.0 v2:172.21.15.163:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178025 (secure 0 0 0) 0x7f57d8097470 con 0x7f57dc0ffcf0 2023-07-14T18:12:19.100 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:19.059+0000 7f57e3ecc700 1 -- 172.21.15.163:0/816737012 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f57dc02c8e0 con 0x7f57dc0ffcf0 2023-07-14T18:12:19.101 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:19.059+0000 7f57d2ffd700 1 -- 172.21.15.163:0/816737012 <== mon.0 v2:172.21.15.163:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) v1 ==== 94+0+10899 (secure 0 0 0) 0x7f57d809aa90 con 0x7f57dc0ffcf0 2023-07-14T18:12:19.101 INFO:teuthology.orchestra.run.smithi163.stdout: 2023-07-14T18:12:19.102 INFO:teuthology.orchestra.run.smithi163.stdout:{"epoch":28,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14562,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.163:6835/1058662632","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6834","nonce":1058662632},{"type":"v1","addr":"172.21.15.163:6835","nonce":1058662632}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":14568,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.163:6837/1107244425","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6836","nonce":1107244425},{"type":"v1","addr":"172.21.15.163:6837","nonce":1107244425}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":28,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-07-14T18:11:09.109693+0000","modified":"2023-07-14T18:11:31.766338+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24518,"mds_1":24493,"mds_2":24479,"mds_3":24478,"mds_4":14652},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14640":{"gid":14640,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.163:6839/1337572937","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6838","nonce":1337572937},{"type":"v1","addr":"172.21.15.163:6839","nonce":1337572937}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_14652":{"gid":14652,"name":"a","rank":4,"incarnation":26,"state":"up:active","state_seq":9,"addr":"172.21.15.163:6841/1032082642","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6840","nonce":1032082642},{"type":"v1","addr":"172.21.15.163:6841","nonce":1032082642}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24421":{"gid":24421,"name":"l","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.184:6833/797722972","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6832","nonce":797722972},{"type":"v1","addr":"172.21.15.184:6833","nonce":797722972}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24431":{"gid":24431,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6833/1075696311","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":1075696311},{"type":"v1","addr":"172.21.15.172:6833","nonce":1075696311}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24458":{"gid":24458,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6835/1158120127","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":1158120127},{"type":"v1","addr":"172.21.15.172:6835","nonce":1158120127}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24466":{"gid":24466,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.184:6835/460134263","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6834","nonce":460134263},{"type":"v1","addr":"172.21.15.184:6835","nonce":460134263}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24478":{"gid":24478,"name":"c","rank":3,"incarnation":24,"state":"up:active","state_seq":11,"addr":"172.21.15.184:6837/3389277679","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6836","nonce":3389277679},{"type":"v1","addr":"172.21.15.184:6837","nonce":3389277679}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24479":{"gid":24479,"name":"h","rank":2,"incarnation":22,"state":"up:active","state_seq":10,"addr":"172.21.15.172:6837/3783835012","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":3783835012},{"type":"v1","addr":"172.21.15.172:6837","nonce":3783835012}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24493":{"gid":24493,"name":"i","rank":1,"incarnation":20,"state":"up:active","state_seq":9,"addr":"172.21.15.184:6839/2819059257","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6838","nonce":2819059257},{"type":"v1","addr":"172.21.15.184:6839","nonce":2819059257}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24518":{"gid":24518,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.172:6839/3850440096","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6838","nonce":3850440096},{"type":"v1","addr":"172.21.15.172:6839","nonce":3850440096}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-07-14T18:12:19.103 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:19.062+0000 7f57e3ecc700 1 -- 172.21.15.163:0/816737012 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f57c80a1220 msgr2=0x7f57c80a36d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:12:19.103 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:19.062+0000 7f57e3ecc700 1 --2- 172.21.15.163:0/816737012 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f57c80a1220 0x7f57c80a36d0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f57dc0ffb50 tx=0x7f57cc00b5b0 comp rx=0 tx=0).stop 2023-07-14T18:12:19.104 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:19.062+0000 7f57e3ecc700 1 -- 172.21.15.163:0/816737012 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f57dc0ffcf0 msgr2=0x7f57dc194c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:12:19.104 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:19.062+0000 7f57e3ecc700 1 --2- 172.21.15.163:0/816737012 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f57dc0ffcf0 0x7f57dc194c90 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f57d8006010 tx=0x7f57d8004730 comp rx=0 tx=0).stop 2023-07-14T18:12:19.104 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:19.062+0000 7f57e3ecc700 1 -- 172.21.15.163:0/816737012 shutdown_connections 2023-07-14T18:12:19.104 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:19.062+0000 7f57e3ecc700 1 --2- 172.21.15.163:0/816737012 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f57c80a1220 0x7f57c80a36d0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:19.104 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:19.062+0000 7f57e3ecc700 1 --2- 172.21.15.163:0/816737012 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f57dc100680 0x7f57dc19bd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:19.105 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:19.062+0000 7f57e3ecc700 1 --2- 172.21.15.163:0/816737012 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f57dc0feb00 0x7f57dc194750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:19.105 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:19.062+0000 7f57e3ecc700 1 --2- 172.21.15.163:0/816737012 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f57dc0ffcf0 0x7f57dc194c90 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:19.105 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:19.062+0000 7f57e3ecc700 1 -- 172.21.15.163:0/816737012 >> 172.21.15.163:0/816737012 conn(0x7f57dc0fa100 msgr2=0x7f57dc0fc380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:12:19.105 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:19.062+0000 7f57e3ecc700 1 -- 172.21.15.163:0/816737012 shutdown_connections 2023-07-14T18:12:19.105 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:19.062+0000 7f57e3ecc700 1 -- 172.21.15.163:0/816737012 wait complete. 2023-07-14T18:12:19.105 INFO:teuthology.orchestra.run.smithi163.stderr:dumped fsmap epoch 28 2023-07-14T18:12:19.114 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:12:18 smithi163 ceph-mon[96576]: pgmap v287: 129 pgs: 2 peering, 127 active+clean; 643 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 7 op/s 2023-07-14T18:12:19.114 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:12:18 smithi163 ceph-mon[96576]: Health check failed: Reduced data availability: 1 pg inactive, 2 pgs peering (PG_AVAILABILITY) 2023-07-14T18:12:19.114 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:12:18 smithi163 ceph-mon[96576]: from='client.? 172.21.15.163:0/3691784774' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-07-14T18:12:19.115 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:12:18 smithi163 ceph-mon[96576]: from='client.? 172.21.15.163:0/494750641' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-07-14T18:12:19.115 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:12:18 smithi163 ceph-mon[96576]: from='client.? 172.21.15.163:0/3332999781' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2023-07-14T18:12:19.116 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-14T18:12:19.175 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:12:18 smithi184 ceph-mon[98481]: pgmap v287: 129 pgs: 2 peering, 127 active+clean; 643 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 7 op/s 2023-07-14T18:12:19.175 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:12:18 smithi184 ceph-mon[98481]: Health check failed: Reduced data availability: 1 pg inactive, 2 pgs peering (PG_AVAILABILITY) 2023-07-14T18:12:19.175 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:12:18 smithi184 ceph-mon[98481]: from='client.? 172.21.15.163:0/3691784774' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-07-14T18:12:19.175 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:12:18 smithi184 ceph-mon[98481]: from='client.? 172.21.15.163:0/494750641' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-07-14T18:12:19.175 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:12:18 smithi184 ceph-mon[98481]: from='client.? 172.21.15.163:0/3332999781' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2023-07-14T18:12:19.238 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:19.197+0000 7f696842f700 1 -- 172.21.15.163:0/1419566991 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f6960100e90 msgr2=0x7f69601012e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:12:19.238 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:19.197+0000 7f696842f700 1 --2- 172.21.15.163:0/1419566991 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f6960100e90 0x7f69601012e0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f6950009990 tx=0x7f6950009ca0 comp rx=0 tx=0).stop 2023-07-14T18:12:19.238 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:19.197+0000 7f696842f700 1 -- 172.21.15.163:0/1419566991 shutdown_connections 2023-07-14T18:12:19.239 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:19.197+0000 7f696842f700 1 --2- 172.21.15.163:0/1419566991 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6960101820 0x7f69601080e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:19.239 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:19.197+0000 7f696842f700 1 --2- 172.21.15.163:0/1419566991 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f69600fdec0 0x7f69600fe2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:19.239 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:19.197+0000 7f696842f700 1 --2- 172.21.15.163:0/1419566991 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f6960100e90 0x7f69601012e0 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:19.239 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:19.197+0000 7f696842f700 1 -- 172.21.15.163:0/1419566991 >> 172.21.15.163:0/1419566991 conn(0x7f69600f98a0 msgr2=0x7f69600fbcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:12:19.239 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:19.197+0000 7f696842f700 1 -- 172.21.15.163:0/1419566991 shutdown_connections 2023-07-14T18:12:19.239 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:19.197+0000 7f696842f700 1 -- 172.21.15.163:0/1419566991 wait complete. 2023-07-14T18:12:19.241 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:19.198+0000 7f696842f700 1 Processor -- start 2023-07-14T18:12:19.241 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:19.198+0000 7f696842f700 1 -- start start 2023-07-14T18:12:19.241 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:19.198+0000 7f696842f700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f69600fdec0 0x7f6960195810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:12:19.242 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:19.198+0000 7f696842f700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6960100e90 0x7f6960195d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:12:19.242 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:19.198+0000 7f696842f700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f6960101820 0x7f696019cdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:12:19.242 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:19.198+0000 7f696842f700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f696019d390 con 0x7f6960101820 2023-07-14T18:12:19.242 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:19.198+0000 7f696842f700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f696019d4d0 con 0x7f69600fdec0 2023-07-14T18:12:19.242 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:19.198+0000 7f696842f700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f696019d660 con 0x7f6960100e90 2023-07-14T18:12:19.242 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:19.198+0000 7f69669cc700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f6960101820 0x7f696019cdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:12:19.242 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:19.198+0000 7f69669cc700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f6960101820 0x7f696019cdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:56968/0 (socket says 172.21.15.163:56968) 2023-07-14T18:12:19.242 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:19.198+0000 7f69669cc700 1 -- 172.21.15.163:0/120120817 learned_addr learned my addr 172.21.15.163:0/120120817 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:12:19.243 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:19.198+0000 7f69661cb700 1 --2- 172.21.15.163:0/120120817 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f69600fdec0 0x7f6960195810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:12:19.243 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:19.198+0000 7f69669cc700 1 -- 172.21.15.163:0/120120817 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6960100e90 msgr2=0x7f6960195d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:12:19.243 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:19.198+0000 7f69669cc700 1 --2- 172.21.15.163:0/120120817 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6960100e90 0x7f6960195d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:19.243 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:19.198+0000 7f69669cc700 1 -- 172.21.15.163:0/120120817 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f69600fdec0 msgr2=0x7f6960195810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:12:19.243 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:19.198+0000 7f69669cc700 1 --2- 172.21.15.163:0/120120817 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f69600fdec0 0x7f6960195810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:19.244 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:19.198+0000 7f69669cc700 1 -- 172.21.15.163:0/120120817 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69500095f0 con 0x7f6960101820 2023-07-14T18:12:19.244 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:19.198+0000 7f69661cb700 1 --2- 172.21.15.163:0/120120817 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f69600fdec0 0x7f6960195810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T18:12:19.244 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:19.198+0000 7f69669cc700 1 --2- 172.21.15.163:0/120120817 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f6960101820 0x7f696019cdc0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f6958007ee0 tx=0x7f695800d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:12:19.244 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:19.199+0000 7f69577fe700 1 -- 172.21.15.163:0/120120817 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f695800ddd0 con 0x7f6960101820 2023-07-14T18:12:19.245 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:19.199+0000 7f69577fe700 1 -- 172.21.15.163:0/120120817 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f695800f040 con 0x7f6960101820 2023-07-14T18:12:19.245 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:19.199+0000 7f69577fe700 1 -- 172.21.15.163:0/120120817 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6958004870 con 0x7f6960101820 2023-07-14T18:12:19.245 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:19.199+0000 7f696842f700 1 -- 172.21.15.163:0/120120817 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f696019d940 con 0x7f6960101820 2023-07-14T18:12:19.246 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:19.199+0000 7f696842f700 1 -- 172.21.15.163:0/120120817 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f696019de50 con 0x7f6960101820 2023-07-14T18:12:19.246 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:19.200+0000 7f696842f700 1 -- 172.21.15.163:0/120120817 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6960106c20 con 0x7f6960101820 2023-07-14T18:12:19.247 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:19.201+0000 7f69577fe700 1 -- 172.21.15.163:0/120120817 <== mon.0 v2:172.21.15.163:3300/0 4 ==== mgrmap(e 17) v1 ==== 135767+0+0 (secure 0 0 0) 0x7f6958003a00 con 0x7f6960101820 2023-07-14T18:12:19.248 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:19.201+0000 7f69577fe700 1 --2- 172.21.15.163:0/120120817 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f694c0a12a0 0x7f694c0a3750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:12:19.248 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:19.201+0000 7f69577fe700 1 -- 172.21.15.163:0/120120817 <== mon.0 v2:172.21.15.163:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 9020+0+0 (secure 0 0 0) 0x7f69580cc6d0 con 0x7f6960101820 2023-07-14T18:12:19.248 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:19.201+0000 7f69661cb700 1 --2- 172.21.15.163:0/120120817 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f694c0a12a0 0x7f694c0a3750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:12:19.249 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:19.202+0000 7f69661cb700 1 --2- 172.21.15.163:0/120120817 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f694c0a12a0 0x7f694c0a3750 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f695c005fd0 tx=0x7f695c005f00 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:12:19.249 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:19.205+0000 7f69577fe700 1 -- 172.21.15.163:0/120120817 <== mon.0 v2:172.21.15.163:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178025 (secure 0 0 0) 0x7f695804e780 con 0x7f6960101820 2023-07-14T18:12:19.275 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:12:18 smithi172 ceph-mon[97983]: pgmap v287: 129 pgs: 2 peering, 127 active+clean; 643 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 7 op/s 2023-07-14T18:12:19.276 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:12:18 smithi172 ceph-mon[97983]: Health check failed: Reduced data availability: 1 pg inactive, 2 pgs peering (PG_AVAILABILITY) 2023-07-14T18:12:19.276 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:12:18 smithi172 ceph-mon[97983]: from='client.? 172.21.15.163:0/3691784774' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-07-14T18:12:19.276 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:12:18 smithi172 ceph-mon[97983]: from='client.? 172.21.15.163:0/494750641' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-07-14T18:12:19.276 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:12:18 smithi172 ceph-mon[97983]: from='client.? 172.21.15.163:0/3332999781' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2023-07-14T18:12:19.435 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:19.394+0000 7f696842f700 1 -- 172.21.15.163:0/120120817 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f696002c8e0 con 0x7f6960101820 2023-07-14T18:12:19.436 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:19.396+0000 7f69577fe700 1 -- 172.21.15.163:0/120120817 <== mon.0 v2:172.21.15.163:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v86) v1 ==== 74+0+24500 (secure 0 0 0) 0x7f69580959b0 con 0x7f6960101820 2023-07-14T18:12:19.437 INFO:teuthology.orchestra.run.smithi163.stdout: 2023-07-14T18:12:19.437 INFO:teuthology.orchestra.run.smithi163.stdout:{"epoch":86,"fsid":"bf7326ec-2270-11ee-9b33-001a4aab830c","created":"2023-07-14T18:04:26.263517+0000","modified":"2023-07-14T18:12:16.776609+0000","last_up_change":"2023-07-14T18:10:27.514863+0000","last_in_change":"2023-07-14T18:10:10.726443+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-14T18:07:19.653852+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-07-14T18:11:07.314989+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-07-14T18:11:08.274627+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-07-14T18:11:11.991162+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"e6490568-046d-43ef-bb07-d79fb884b276","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6802","nonce":3124653025},{"type":"v1","addr":"172.21.15.163:6803","nonce":3124653025}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6804","nonce":3124653025},{"type":"v1","addr":"172.21.15.163:6805","nonce":3124653025}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6808","nonce":3124653025},{"type":"v1","addr":"172.21.15.163:6809","nonce":3124653025}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6806","nonce":3124653025},{"type":"v1","addr":"172.21.15.163:6807","nonce":3124653025}]},"public_addr":"172.21.15.163:6803/3124653025","cluster_addr":"172.21.15.163:6805/3124653025","heartbeat_back_addr":"172.21.15.163:6809/3124653025","heartbeat_front_addr":"172.21.15.163:6807/3124653025","state":["exists","up"]},{"osd":1,"uuid":"0af39bda-f096-4603-adcc-bf1988f36603","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":3774455900},{"type":"v1","addr":"172.21.15.172:6801","nonce":3774455900}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":3774455900},{"type":"v1","addr":"172.21.15.172:6803","nonce":3774455900}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":3774455900},{"type":"v1","addr":"172.21.15.172:6807","nonce":3774455900}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":3774455900},{"type":"v1","addr":"172.21.15.172:6805","nonce":3774455900}]},"public_addr":"172.21.15.172:6801/3774455900","cluster_addr":"172.21.15.172:6803/3774455900","heartbeat_back_addr":"172.21.15.172:6807/3774455900","heartbeat_front_addr":"172.21.15.172:6805/3774455900","state":["exists","up"]},{"osd":2,"uuid":"cc732c13-af0f-4199-98e6-fe960ed4e5dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":1976927678},{"type":"v1","addr":"172.21.15.184:6801","nonce":1976927678}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":1976927678},{"type":"v1","addr":"172.21.15.184:6803","nonce":1976927678}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":1976927678},{"type":"v1","addr":"172.21.15.184:6807","nonce":1976927678}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":1976927678},{"type":"v1","addr":"172.21.15.184:6805","nonce":1976927678}]},"public_addr":"172.21.15.184:6801/1976927678","cluster_addr":"172.21.15.184:6803/1976927678","heartbeat_back_addr":"172.21.15.184:6807/1976927678","heartbeat_front_addr":"172.21.15.184:6805/1976927678","state":["exists","up"]},{"osd":3,"uuid":"dcee9576-0bc6-4ab0-8f63-79eacd0eca5f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6810","nonce":2589130694},{"type":"v1","addr":"172.21.15.163:6811","nonce":2589130694}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6812","nonce":2589130694},{"type":"v1","addr":"172.21.15.163:6813","nonce":2589130694}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6816","nonce":2589130694},{"type":"v1","addr":"172.21.15.163:6817","nonce":2589130694}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6814","nonce":2589130694},{"type":"v1","addr":"172.21.15.163:6815","nonce":2589130694}]},"public_addr":"172.21.15.163:6811/2589130694","cluster_addr":"172.21.15.163:6813/2589130694","heartbeat_back_addr":"172.21.15.163:6817/2589130694","heartbeat_front_addr":"172.21.15.163:6815/2589130694","state":["exists","up"]},{"osd":4,"uuid":"055df823-b8b0-426a-83c2-f0d727932ad8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":3319632614},{"type":"v1","addr":"172.21.15.172:6809","nonce":3319632614}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6810","nonce":3319632614},{"type":"v1","addr":"172.21.15.172:6811","nonce":3319632614}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6814","nonce":3319632614},{"type":"v1","addr":"172.21.15.172:6815","nonce":3319632614}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":3319632614},{"type":"v1","addr":"172.21.15.172:6813","nonce":3319632614}]},"public_addr":"172.21.15.172:6809/3319632614","cluster_addr":"172.21.15.172:6811/3319632614","heartbeat_back_addr":"172.21.15.172:6815/3319632614","heartbeat_front_addr":"172.21.15.172:6813/3319632614","state":["exists","up"]},{"osd":5,"uuid":"ef5ef02a-b4e2-4790-9d27-f6d2247b25c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":2662084043},{"type":"v1","addr":"172.21.15.184:6809","nonce":2662084043}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6810","nonce":2662084043},{"type":"v1","addr":"172.21.15.184:6811","nonce":2662084043}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6814","nonce":2662084043},{"type":"v1","addr":"172.21.15.184:6815","nonce":2662084043}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6812","nonce":2662084043},{"type":"v1","addr":"172.21.15.184:6813","nonce":2662084043}]},"public_addr":"172.21.15.184:6809/2662084043","cluster_addr":"172.21.15.184:6811/2662084043","heartbeat_back_addr":"172.21.15.184:6815/2662084043","heartbeat_front_addr":"172.21.15.184:6813/2662084043","state":["exists","up"]},{"osd":6,"uuid":"dba754be-0fc5-4867-a6d5-cf97eb344f81","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":44,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6818","nonce":2530874117},{"type":"v1","addr":"172.21.15.163:6819","nonce":2530874117}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6820","nonce":2530874117},{"type":"v1","addr":"172.21.15.163:6821","nonce":2530874117}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6824","nonce":2530874117},{"type":"v1","addr":"172.21.15.163:6825","nonce":2530874117}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6822","nonce":2530874117},{"type":"v1","addr":"172.21.15.163:6823","nonce":2530874117}]},"public_addr":"172.21.15.163:6819/2530874117","cluster_addr":"172.21.15.163:6821/2530874117","heartbeat_back_addr":"172.21.15.163:6825/2530874117","heartbeat_front_addr":"172.21.15.163:6823/2530874117","state":["exists","up"]},{"osd":7,"uuid":"edd76e6b-6077-4619-b00d-1e906f70ddcc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":49,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":233511803},{"type":"v1","addr":"172.21.15.172:6817","nonce":233511803}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6818","nonce":233511803},{"type":"v1","addr":"172.21.15.172:6819","nonce":233511803}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":233511803},{"type":"v1","addr":"172.21.15.172:6823","nonce":233511803}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6820","nonce":233511803},{"type":"v1","addr":"172.21.15.172:6821","nonce":233511803}]},"public_addr":"172.21.15.172:6817/233511803","cluster_addr":"172.21.15.172:6819/233511803","heartbeat_back_addr":"172.21.15.172:6823/233511803","heartbeat_front_addr":"172.21.15.172:6821/233511803","state":["exists","up"]},{"osd":8,"uuid":"36559400-f33e-44e6-868a-316d34da457d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":56,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6816","nonce":290154343},{"type":"v1","addr":"172.21.15.184:6817","nonce":290154343}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6818","nonce":290154343},{"type":"v1","addr":"172.21.15.184:6819","nonce":290154343}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6822","nonce":290154343},{"type":"v1","addr":"172.21.15.184:6823","nonce":290154343}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6820","nonce":290154343},{"type":"v1","addr":"172.21.15.184:6821","nonce":290154343}]},"public_addr":"172.21.15.184:6817/290154343","cluster_addr":"172.21.15.184:6819/290154343","heartbeat_back_addr":"172.21.15.184:6823/290154343","heartbeat_front_addr":"172.21.15.184:6821/290154343","state":["exists","up"]},{"osd":9,"uuid":"d484f111-f36c-4c67-9a8a-ae03e7e0d137","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6826","nonce":3848110906},{"type":"v1","addr":"172.21.15.163:6827","nonce":3848110906}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6828","nonce":3848110906},{"type":"v1","addr":"172.21.15.163:6829","nonce":3848110906}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6832","nonce":3848110906},{"type":"v1","addr":"172.21.15.163:6833","nonce":3848110906}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6830","nonce":3848110906},{"type":"v1","addr":"172.21.15.163:6831","nonce":3848110906}]},"public_addr":"172.21.15.163:6827/3848110906","cluster_addr":"172.21.15.163:6829/3848110906","heartbeat_back_addr":"172.21.15.163:6833/3848110906","heartbeat_front_addr":"172.21.15.163:6831/3848110906","state":["exists","up"]},{"osd":10,"uuid":"d943f7c0-da3d-4605-9e23-0231e675c6be","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6824","nonce":3281085356},{"type":"v1","addr":"172.21.15.172:6825","nonce":3281085356}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":3281085356},{"type":"v1","addr":"172.21.15.172:6827","nonce":3281085356}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":3281085356},{"type":"v1","addr":"172.21.15.172:6831","nonce":3281085356}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6828","nonce":3281085356},{"type":"v1","addr":"172.21.15.172:6829","nonce":3281085356}]},"public_addr":"172.21.15.172:6825/3281085356","cluster_addr":"172.21.15.172:6827/3281085356","heartbeat_back_addr":"172.21.15.172:6831/3281085356","heartbeat_front_addr":"172.21.15.172:6829/3281085356","state":["exists","up"]},{"osd":11,"uuid":"09e610a8-408a-4119-a21b-c4de2810a538","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":75,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6824","nonce":3614578747},{"type":"v1","addr":"172.21.15.184:6825","nonce":3614578747}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6826","nonce":3614578747},{"type":"v1","addr":"172.21.15.184:6827","nonce":3614578747}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6830","nonce":3614578747},{"type":"v1","addr":"172.21.15.184:6831","nonce":3614578747}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6828","nonce":3614578747},{"type":"v1","addr":"172.21.15.184:6829","nonce":3614578747}]},"public_addr":"172.21.15.184:6825/3614578747","cluster_addr":"172.21.15.184:6827/3614578747","heartbeat_back_addr":"172.21.15.184:6831/3614578747","heartbeat_front_addr":"172.21.15.184:6829/3614578747","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T18:06:36.067578+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T18:06:57.095120+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T18:07:17.825363+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T18:07:38.977196+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T18:08:00.108709+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T18:08:20.700646+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T18:08:41.473899+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T18:09:02.856536+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T18:09:23.832722+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T18:09:44.860884+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T18:10:05.520678+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T18:10:26.426315+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.8","mappings":[{"from":2,"to":11}]},{"pgid":"3.1","mappings":[{"from":4,"to":9}]},{"pgid":"3.6","mappings":[{"from":4,"to":6}]},{"pgid":"3.25","mappings":[{"from":5,"to":9}]},{"pgid":"3.27","mappings":[{"from":4,"to":8}]},{"pgid":"3.2d","mappings":[{"from":3,"to":9}]},{"pgid":"4.a","mappings":[{"from":5,"to":8}]},{"pgid":"4.12","mappings":[{"from":9,"to":10}]},{"pgid":"4.14","mappings":[{"from":9,"to":8}]},{"pgid":"4.17","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.163:6801/1086512093":"2023-07-15T18:05:15.331458+0000","172.21.15.163:6800/1086512093":"2023-07-15T18:05:15.331458+0000","172.21.15.163:0/4235784810":"2023-07-15T18:05:15.331458+0000","172.21.15.163:6800/236891232":"2023-07-15T18:04:53.288443+0000","172.21.15.163:6801/236891232":"2023-07-15T18:04:53.288443+0000","172.21.15.163:0/3260193612":"2023-07-15T18:05:15.331458+0000","172.21.15.163:0/3513629472":"2023-07-15T18:04:53.288443+0000","172.21.15.163:0/1090329830":"2023-07-15T18:04:53.288443+0000","172.21.15.163:0/3868922045":"2023-07-15T18:05:15.331458+0000","172.21.15.163:0/2945662447":"2023-07-15T18:04:53.288443+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-14T18:12:19.439 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:19.398+0000 7f696842f700 1 -- 172.21.15.163:0/120120817 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f694c0a12a0 msgr2=0x7f694c0a3750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:12:19.439 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:19.398+0000 7f696842f700 1 --2- 172.21.15.163:0/120120817 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f694c0a12a0 0x7f694c0a3750 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f695c005fd0 tx=0x7f695c005f00 comp rx=0 tx=0).stop 2023-07-14T18:12:19.439 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:19.398+0000 7f696842f700 1 -- 172.21.15.163:0/120120817 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f6960101820 msgr2=0x7f696019cdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:12:19.439 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:19.398+0000 7f696842f700 1 --2- 172.21.15.163:0/120120817 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f6960101820 0x7f696019cdc0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f6958007ee0 tx=0x7f695800d3b0 comp rx=0 tx=0).stop 2023-07-14T18:12:19.440 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:19.398+0000 7f696842f700 1 -- 172.21.15.163:0/120120817 shutdown_connections 2023-07-14T18:12:19.440 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:19.398+0000 7f696842f700 1 --2- 172.21.15.163:0/120120817 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f694c0a12a0 0x7f694c0a3750 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:19.440 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:19.398+0000 7f696842f700 1 --2- 172.21.15.163:0/120120817 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f6960101820 0x7f696019cdc0 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:19.440 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:19.398+0000 7f696842f700 1 --2- 172.21.15.163:0/120120817 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f69600fdec0 0x7f6960195810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:19.440 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:19.398+0000 7f696842f700 1 --2- 172.21.15.163:0/120120817 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6960100e90 0x7f6960195d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:19.441 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:19.398+0000 7f696842f700 1 -- 172.21.15.163:0/120120817 >> 172.21.15.163:0/120120817 conn(0x7f69600f98a0 msgr2=0x7f69600fbb50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:12:19.441 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:19.398+0000 7f696842f700 1 -- 172.21.15.163:0/120120817 shutdown_connections 2023-07-14T18:12:19.441 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:19.398+0000 7f696842f700 1 -- 172.21.15.163:0/120120817 wait complete. 2023-07-14T18:12:19.452 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-14T18:12:19.575 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:19.534+0000 7f1dc13e5700 1 -- 172.21.15.163:0/1015098251 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f1dbc0ffd40 msgr2=0x7f1dbc100190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:12:19.575 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:19.534+0000 7f1dc13e5700 1 --2- 172.21.15.163:0/1015098251 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f1dbc0ffd40 0x7f1dbc100190 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f1dac009990 tx=0x7f1dac009ca0 comp rx=0 tx=0).stop 2023-07-14T18:12:19.575 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:19.534+0000 7f1dc13e5700 1 -- 172.21.15.163:0/1015098251 shutdown_connections 2023-07-14T18:12:19.575 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:19.534+0000 7f1dc13e5700 1 --2- 172.21.15.163:0/1015098251 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1dbc0feb50 0x7f1dbc0fef60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:19.575 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:19.534+0000 7f1dc13e5700 1 --2- 172.21.15.163:0/1015098251 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1dbc1006d0 0x7f1dbc106f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:19.576 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:19.534+0000 7f1dc13e5700 1 --2- 172.21.15.163:0/1015098251 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f1dbc0ffd40 0x7f1dbc100190 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:19.576 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:19.534+0000 7f1dc13e5700 1 -- 172.21.15.163:0/1015098251 >> 172.21.15.163:0/1015098251 conn(0x7f1dbc0fa150 msgr2=0x7f1dbc0fc5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:12:19.576 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:19.534+0000 7f1dc13e5700 1 -- 172.21.15.163:0/1015098251 shutdown_connections 2023-07-14T18:12:19.576 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:19.534+0000 7f1dc13e5700 1 -- 172.21.15.163:0/1015098251 wait complete. 2023-07-14T18:12:19.576 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:19.534+0000 7f1dc13e5700 1 Processor -- start 2023-07-14T18:12:19.578 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:19.534+0000 7f1dc13e5700 1 -- start start 2023-07-14T18:12:19.578 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:19.535+0000 7f1dc13e5700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1dbc0feb50 0x7f1dbc069590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:12:19.578 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:19.535+0000 7f1dc13e5700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f1dbc0ffd40 0x7f1dbc19a510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:12:19.578 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:19.535+0000 7f1dc13e5700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1dbc1006d0 0x7f1dbc19cb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:12:19.579 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:19.535+0000 7f1dc13e5700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1dbc19d330 con 0x7f1dbc0ffd40 2023-07-14T18:12:19.579 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:19.535+0000 7f1dc13e5700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1dbc19d4a0 con 0x7f1dbc1006d0 2023-07-14T18:12:19.579 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:19.535+0000 7f1dc13e5700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1dbc19d660 con 0x7f1dbc0feb50 2023-07-14T18:12:19.579 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:19.535+0000 7f1dba7fc700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f1dbc0ffd40 0x7f1dbc19a510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:12:19.579 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:19.535+0000 7f1dba7fc700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f1dbc0ffd40 0x7f1dbc19a510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:56978/0 (socket says 172.21.15.163:56978) 2023-07-14T18:12:19.579 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:19.535+0000 7f1dba7fc700 1 -- 172.21.15.163:0/3639579266 learned_addr learned my addr 172.21.15.163:0/3639579266 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:12:19.579 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:19.535+0000 7f1dbaffd700 1 --2- 172.21.15.163:0/3639579266 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1dbc0feb50 0x7f1dbc069590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:12:19.580 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:19.535+0000 7f1dbb7fe700 1 --2- 172.21.15.163:0/3639579266 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1dbc1006d0 0x7f1dbc19cb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:12:19.580 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:19.535+0000 7f1dba7fc700 1 -- 172.21.15.163:0/3639579266 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1dbc0feb50 msgr2=0x7f1dbc069590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:12:19.580 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:19.535+0000 7f1dba7fc700 1 --2- 172.21.15.163:0/3639579266 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1dbc0feb50 0x7f1dbc069590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:19.580 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:19.535+0000 7f1dba7fc700 1 -- 172.21.15.163:0/3639579266 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1dbc1006d0 msgr2=0x7f1dbc19cb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:12:19.580 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:19.535+0000 7f1dba7fc700 1 --2- 172.21.15.163:0/3639579266 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1dbc1006d0 0x7f1dbc19cb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:19.580 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:19.535+0000 7f1dba7fc700 1 -- 172.21.15.163:0/3639579266 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1dac0095f0 con 0x7f1dbc0ffd40 2023-07-14T18:12:19.580 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:19.535+0000 7f1dbaffd700 1 --2- 172.21.15.163:0/3639579266 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1dbc0feb50 0x7f1dbc069590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T18:12:19.580 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:19.535+0000 7f1dba7fc700 1 --2- 172.21.15.163:0/3639579266 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f1dbc0ffd40 0x7f1dbc19a510 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f1dac005f50 tx=0x7f1dac0040b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:12:19.581 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:19.535+0000 7f1da3fff700 1 -- 172.21.15.163:0/3639579266 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1dac01d070 con 0x7f1dbc0ffd40 2023-07-14T18:12:19.581 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:19.535+0000 7f1da3fff700 1 -- 172.21.15.163:0/3639579266 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f1dac0041d0 con 0x7f1dbc0ffd40 2023-07-14T18:12:19.581 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:19.535+0000 7f1dc13e5700 1 -- 172.21.15.163:0/3639579266 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1dbc19d8e0 con 0x7f1dbc0ffd40 2023-07-14T18:12:19.581 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:19.535+0000 7f1da3fff700 1 -- 172.21.15.163:0/3639579266 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1dac00f6c0 con 0x7f1dbc0ffd40 2023-07-14T18:12:19.581 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:19.535+0000 7f1dc13e5700 1 -- 172.21.15.163:0/3639579266 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1dbc19dd60 con 0x7f1dbc0ffd40 2023-07-14T18:12:19.581 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:19.536+0000 7f1dc13e5700 1 -- 172.21.15.163:0/3639579266 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1dbc1060c0 con 0x7f1dbc0ffd40 2023-07-14T18:12:19.581 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:19.537+0000 7f1da3fff700 1 -- 172.21.15.163:0/3639579266 <== mon.0 v2:172.21.15.163:3300/0 4 ==== mgrmap(e 17) v1 ==== 135767+0+0 (secure 0 0 0) 0x7f1dac022470 con 0x7f1dbc0ffd40 2023-07-14T18:12:19.582 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:19.538+0000 7f1da3fff700 1 --2- 172.21.15.163:0/3639579266 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f1da40a12a0 0x7f1da40a3750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:12:19.582 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:19.538+0000 7f1dbaffd700 1 --2- 172.21.15.163:0/3639579266 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f1da40a12a0 0x7f1da40a3750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:12:19.583 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:19.538+0000 7f1da3fff700 1 -- 172.21.15.163:0/3639579266 <== mon.0 v2:172.21.15.163:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 9020+0+0 (secure 0 0 0) 0x7f1dac0ce4a0 con 0x7f1dbc0ffd40 2023-07-14T18:12:19.583 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:19.538+0000 7f1dbaffd700 1 --2- 172.21.15.163:0/3639579266 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f1da40a12a0 0x7f1da40a3750 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f1db0005950 tx=0x7f1db00058e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:12:19.583 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:19.542+0000 7f1da3fff700 1 -- 172.21.15.163:0/3639579266 <== mon.0 v2:172.21.15.163:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178025 (secure 0 0 0) 0x7f1dac097810 con 0x7f1dbc0ffd40 2023-07-14T18:12:19.816 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:19.775+0000 7f1dc13e5700 1 -- 172.21.15.163:0/3639579266 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1dbc02c8e0 con 0x7f1dbc0ffd40 2023-07-14T18:12:19.817 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:19.776+0000 7f1da3fff700 1 -- 172.21.15.163:0/3639579266 <== mon.0 v2:172.21.15.163:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) v1 ==== 94+0+10899 (secure 0 0 0) 0x7f1dac09ae30 con 0x7f1dbc0ffd40 2023-07-14T18:12:19.817 INFO:teuthology.orchestra.run.smithi163.stdout: 2023-07-14T18:12:19.817 INFO:teuthology.orchestra.run.smithi163.stdout:{"epoch":28,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14562,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.163:6835/1058662632","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6834","nonce":1058662632},{"type":"v1","addr":"172.21.15.163:6835","nonce":1058662632}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":14568,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.163:6837/1107244425","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6836","nonce":1107244425},{"type":"v1","addr":"172.21.15.163:6837","nonce":1107244425}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":28,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-07-14T18:11:09.109693+0000","modified":"2023-07-14T18:11:31.766338+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24518,"mds_1":24493,"mds_2":24479,"mds_3":24478,"mds_4":14652},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14640":{"gid":14640,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.163:6839/1337572937","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6838","nonce":1337572937},{"type":"v1","addr":"172.21.15.163:6839","nonce":1337572937}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_14652":{"gid":14652,"name":"a","rank":4,"incarnation":26,"state":"up:active","state_seq":9,"addr":"172.21.15.163:6841/1032082642","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6840","nonce":1032082642},{"type":"v1","addr":"172.21.15.163:6841","nonce":1032082642}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24421":{"gid":24421,"name":"l","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.184:6833/797722972","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6832","nonce":797722972},{"type":"v1","addr":"172.21.15.184:6833","nonce":797722972}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24431":{"gid":24431,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6833/1075696311","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":1075696311},{"type":"v1","addr":"172.21.15.172:6833","nonce":1075696311}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24458":{"gid":24458,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6835/1158120127","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":1158120127},{"type":"v1","addr":"172.21.15.172:6835","nonce":1158120127}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24466":{"gid":24466,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.184:6835/460134263","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6834","nonce":460134263},{"type":"v1","addr":"172.21.15.184:6835","nonce":460134263}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24478":{"gid":24478,"name":"c","rank":3,"incarnation":24,"state":"up:active","state_seq":11,"addr":"172.21.15.184:6837/3389277679","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6836","nonce":3389277679},{"type":"v1","addr":"172.21.15.184:6837","nonce":3389277679}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24479":{"gid":24479,"name":"h","rank":2,"incarnation":22,"state":"up:active","state_seq":10,"addr":"172.21.15.172:6837/3783835012","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":3783835012},{"type":"v1","addr":"172.21.15.172:6837","nonce":3783835012}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24493":{"gid":24493,"name":"i","rank":1,"incarnation":20,"state":"up:active","state_seq":9,"addr":"172.21.15.184:6839/2819059257","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6838","nonce":2819059257},{"type":"v1","addr":"172.21.15.184:6839","nonce":2819059257}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24518":{"gid":24518,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.172:6839/3850440096","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6838","nonce":3850440096},{"type":"v1","addr":"172.21.15.172:6839","nonce":3850440096}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-07-14T18:12:19.819 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:19.778+0000 7f1dc13e5700 1 -- 172.21.15.163:0/3639579266 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f1da40a12a0 msgr2=0x7f1da40a3750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:12:19.819 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:19.778+0000 7f1dc13e5700 1 --2- 172.21.15.163:0/3639579266 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f1da40a12a0 0x7f1da40a3750 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f1db0005950 tx=0x7f1db00058e0 comp rx=0 tx=0).stop 2023-07-14T18:12:19.819 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:19.778+0000 7f1dc13e5700 1 -- 172.21.15.163:0/3639579266 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f1dbc0ffd40 msgr2=0x7f1dbc19a510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:12:19.820 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:19.778+0000 7f1dc13e5700 1 --2- 172.21.15.163:0/3639579266 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f1dbc0ffd40 0x7f1dbc19a510 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f1dac005f50 tx=0x7f1dac0040b0 comp rx=0 tx=0).stop 2023-07-14T18:12:19.820 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:19.778+0000 7f1dc13e5700 1 -- 172.21.15.163:0/3639579266 shutdown_connections 2023-07-14T18:12:19.820 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:19.778+0000 7f1dc13e5700 1 --2- 172.21.15.163:0/3639579266 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f1da40a12a0 0x7f1da40a3750 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:19.820 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:19.778+0000 7f1dc13e5700 1 --2- 172.21.15.163:0/3639579266 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1dbc0feb50 0x7f1dbc069590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:19.820 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:19.778+0000 7f1dc13e5700 1 --2- 172.21.15.163:0/3639579266 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1dbc1006d0 0x7f1dbc19cb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:19.820 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:19.778+0000 7f1dc13e5700 1 --2- 172.21.15.163:0/3639579266 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f1dbc0ffd40 0x7f1dbc19a510 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:19.821 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:19.778+0000 7f1dc13e5700 1 -- 172.21.15.163:0/3639579266 >> 172.21.15.163:0/3639579266 conn(0x7f1dbc0fa150 msgr2=0x7f1dbc103200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:12:19.821 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:19.778+0000 7f1dc13e5700 1 -- 172.21.15.163:0/3639579266 shutdown_connections 2023-07-14T18:12:19.821 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:19.778+0000 7f1dc13e5700 1 -- 172.21.15.163:0/3639579266 wait complete. 2023-07-14T18:12:19.821 INFO:teuthology.orchestra.run.smithi163.stderr:dumped fsmap epoch 28 2023-07-14T18:12:19.833 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 28, 'flags': 50, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False, 'balance_automate': False}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2023-07-14T18:11:09.109693+0000', 'modified': '2023-07-14T18:11:31.766338+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 5, 'in': [0, 1, 2, 3, 4], 'up': {'mds_0': 24518, 'mds_1': 24493, 'mds_2': 24479, 'mds_3': 24478, 'mds_4': 14652}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_14640': {'gid': 14640, 'name': 'g', 'rank': 4, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.163:6839/1337572937', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.163:6838', 'nonce': 1337572937}, {'type': 'v1', 'addr': '172.21.15.163:6839', 'nonce': 1337572937}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}, 'gid_14652': {'gid': 14652, 'name': 'a', 'rank': 4, 'incarnation': 26, 'state': 'up:active', 'state_seq': 9, 'addr': '172.21.15.163:6841/1032082642', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.163:6840', 'nonce': 1032082642}, {'type': 'v1', 'addr': '172.21.15.163:6841', 'nonce': 1032082642}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}, 'gid_24421': {'gid': 24421, 'name': 'l', 'rank': 3, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.184:6833/797722972', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.184:6832', 'nonce': 797722972}, {'type': 'v1', 'addr': '172.21.15.184:6833', 'nonce': 797722972}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}, 'gid_24431': {'gid': 24431, 'name': 'k', 'rank': 2, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.172:6833/1075696311', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.172:6832', 'nonce': 1075696311}, {'type': 'v1', 'addr': '172.21.15.172:6833', 'nonce': 1075696311}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}, 'gid_24458': {'gid': 24458, 'name': 'e', 'rank': 1, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.172:6835/1158120127', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.172:6834', 'nonce': 1158120127}, {'type': 'v1', 'addr': '172.21.15.172:6835', 'nonce': 1158120127}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}, 'gid_24466': {'gid': 24466, 'name': 'f', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.184:6835/460134263', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.184:6834', 'nonce': 460134263}, {'type': 'v1', 'addr': '172.21.15.184:6835', 'nonce': 460134263}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}, 'gid_24478': {'gid': 24478, 'name': 'c', 'rank': 3, 'incarnation': 24, 'state': 'up:active', 'state_seq': 11, 'addr': '172.21.15.184:6837/3389277679', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.184:6836', 'nonce': 3389277679}, {'type': 'v1', 'addr': '172.21.15.184:6837', 'nonce': 3389277679}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}, 'gid_24479': {'gid': 24479, 'name': 'h', 'rank': 2, 'incarnation': 22, 'state': 'up:active', 'state_seq': 10, 'addr': '172.21.15.172:6837/3783835012', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.172:6836', 'nonce': 3783835012}, {'type': 'v1', 'addr': '172.21.15.172:6837', 'nonce': 3783835012}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}, 'gid_24493': {'gid': 24493, 'name': 'i', 'rank': 1, 'incarnation': 20, 'state': 'up:active', 'state_seq': 9, 'addr': '172.21.15.184:6839/2819059257', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.184:6838', 'nonce': 2819059257}, {'type': 'v1', 'addr': '172.21.15.184:6839', 'nonce': 2819059257}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}, 'gid_24518': {'gid': 24518, 'name': 'b', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.172:6839/3850440096', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.172:6838', 'nonce': 3850440096}, {'type': 'v1', 'addr': '172.21.15.172:6839', 'nonce': 3850440096}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-07-14T18:12:19.833 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 5/5 2023-07-14T18:12:19.833 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2023-07-14T18:12:19.957 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:19.916+0000 7f9a14cfe700 1 -- 172.21.15.163:0/3593869645 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f9a10100690 msgr2=0x7f9a10106f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:12:19.957 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:19.916+0000 7f9a14cfe700 1 --2- 172.21.15.163:0/3593869645 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f9a10100690 0x7f9a10106f50 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f9a00009990 tx=0x7f9a00009ca0 comp rx=0 tx=0).stop 2023-07-14T18:12:19.957 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:19.916+0000 7f9a14cfe700 1 -- 172.21.15.163:0/3593869645 shutdown_connections 2023-07-14T18:12:19.958 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:19.916+0000 7f9a14cfe700 1 --2- 172.21.15.163:0/3593869645 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f9a10100690 0x7f9a10106f50 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:19.958 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:19.916+0000 7f9a14cfe700 1 --2- 172.21.15.163:0/3593869645 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9a100feb10 0x7f9a100fef20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:19.958 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:19.916+0000 7f9a14cfe700 1 --2- 172.21.15.163:0/3593869645 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9a100ffd00 0x7f9a10100150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:19.958 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:19.916+0000 7f9a14cfe700 1 -- 172.21.15.163:0/3593869645 >> 172.21.15.163:0/3593869645 conn(0x7f9a100fa130 msgr2=0x7f9a100fc560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:12:19.958 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:19.916+0000 7f9a14cfe700 1 -- 172.21.15.163:0/3593869645 shutdown_connections 2023-07-14T18:12:19.958 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:19.916+0000 7f9a14cfe700 1 -- 172.21.15.163:0/3593869645 wait complete. 2023-07-14T18:12:19.960 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:19.917+0000 7f9a14cfe700 1 Processor -- start 2023-07-14T18:12:19.960 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:19.917+0000 7f9a14cfe700 1 -- start start 2023-07-14T18:12:19.961 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:19.917+0000 7f9a14cfe700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f9a100feb10 0x7f9a10194730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:12:19.961 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:19.917+0000 7f9a14cfe700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9a100ffd00 0x7f9a10194c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:12:19.961 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:19.917+0000 7f9a14cfe700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9a10100690 0x7f9a1019bce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:12:19.961 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:19.917+0000 7f9a14cfe700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a1019c2b0 con 0x7f9a100feb10 2023-07-14T18:12:19.962 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:19.917+0000 7f9a14cfe700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a1019c3f0 con 0x7f9a10100690 2023-07-14T18:12:19.962 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:19.917+0000 7f9a14cfe700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a1019c580 con 0x7f9a100ffd00 2023-07-14T18:12:19.962 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:19.917+0000 7f9a0e59c700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f9a100feb10 0x7f9a10194730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:12:19.962 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:19.917+0000 7f9a0e59c700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f9a100feb10 0x7f9a10194730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:56990/0 (socket says 172.21.15.163:56990) 2023-07-14T18:12:19.963 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:19.917+0000 7f9a0e59c700 1 -- 172.21.15.163:0/688416349 learned_addr learned my addr 172.21.15.163:0/688416349 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:12:19.963 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:19.917+0000 7f9a0ed9d700 1 --2- 172.21.15.163:0/688416349 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9a10100690 0x7f9a1019bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:12:19.963 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:19.918+0000 7f9a0dd9b700 1 --2- 172.21.15.163:0/688416349 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9a100ffd00 0x7f9a10194c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:12:19.964 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:19.918+0000 7f9a0e59c700 1 -- 172.21.15.163:0/688416349 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9a100ffd00 msgr2=0x7f9a10194c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:12:19.964 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:19.918+0000 7f9a0e59c700 1 --2- 172.21.15.163:0/688416349 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9a100ffd00 0x7f9a10194c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:19.964 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:19.918+0000 7f9a0e59c700 1 -- 172.21.15.163:0/688416349 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9a10100690 msgr2=0x7f9a1019bce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:12:19.964 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:19.918+0000 7f9a0e59c700 1 --2- 172.21.15.163:0/688416349 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9a10100690 0x7f9a1019bce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:19.965 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:19.918+0000 7f9a0e59c700 1 -- 172.21.15.163:0/688416349 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a000095f0 con 0x7f9a100feb10 2023-07-14T18:12:19.965 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:19.918+0000 7f9a0ed9d700 1 --2- 172.21.15.163:0/688416349 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9a10100690 0x7f9a1019bce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T18:12:19.965 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:19.918+0000 7f9a0dd9b700 1 --2- 172.21.15.163:0/688416349 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9a100ffd00 0x7f9a10194c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T18:12:19.966 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:19.918+0000 7f9a0e59c700 1 --2- 172.21.15.163:0/688416349 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f9a100feb10 0x7f9a10194730 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f9a08007ee0 tx=0x7f9a0800f5c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:12:19.966 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:19.918+0000 7f9a077fe700 1 -- 172.21.15.163:0/688416349 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a0800fea0 con 0x7f9a100feb10 2023-07-14T18:12:19.966 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:19.918+0000 7f9a077fe700 1 -- 172.21.15.163:0/688416349 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f9a08003e90 con 0x7f9a100feb10 2023-07-14T18:12:19.967 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:19.918+0000 7f9a14cfe700 1 -- 172.21.15.163:0/688416349 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9a10067800 con 0x7f9a100feb10 2023-07-14T18:12:19.967 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:19.918+0000 7f9a077fe700 1 -- 172.21.15.163:0/688416349 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a080126c0 con 0x7f9a100feb10 2023-07-14T18:12:19.967 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:19.918+0000 7f9a14cfe700 1 -- 172.21.15.163:0/688416349 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a10067d10 con 0x7f9a100feb10 2023-07-14T18:12:19.974 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:19.920+0000 7f9a077fe700 1 -- 172.21.15.163:0/688416349 <== mon.0 v2:172.21.15.163:3300/0 4 ==== mgrmap(e 17) v1 ==== 135767+0+0 (secure 0 0 0) 0x7f9a08003a00 con 0x7f9a100feb10 2023-07-14T18:12:19.974 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:19.920+0000 7f9a077fe700 1 --2- 172.21.15.163:0/688416349 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f99fc0a11e0 0x7f99fc0a3690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:12:19.975 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:19.921+0000 7f9a0dd9b700 1 --2- 172.21.15.163:0/688416349 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f99fc0a11e0 0x7f99fc0a3690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:12:19.975 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:19.921+0000 7f9a077fe700 1 -- 172.21.15.163:0/688416349 <== mon.0 v2:172.21.15.163:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 9020+0+0 (secure 0 0 0) 0x7f9a080cf170 con 0x7f9a100feb10 2023-07-14T18:12:19.975 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:19.921+0000 7f9a0dd9b700 1 --2- 172.21.15.163:0/688416349 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f99fc0a11e0 0x7f99fc0a3690 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f99f8009be0 tx=0x7f99f8009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:12:19.975 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:19.921+0000 7f9a20e96b80 1 Processor -- start 2023-07-14T18:12:19.975 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:19.921+0000 7f9a20e96b80 1 -- start start 2023-07-14T18:12:19.975 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:19.922+0000 7f9a20e96b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e3f83b4f10 0x55e3f83b5320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:12:19.976 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:19.922+0000 7f9a20e96b80 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e3f83b5860 0x55e3f83b5e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:12:19.976 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:19.922+0000 7f9a20e96b80 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55e3f83b6460 0x55e3f83b68d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:12:19.976 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:19.922+0000 7f9a20e96b80 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e3f82b9c60 con 0x55e3f83b6460 2023-07-14T18:12:19.976 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:19.922+0000 7f9a20e96b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e3f830c9f0 con 0x55e3f83b4f10 2023-07-14T18:12:19.976 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:19.922+0000 7f9a20e96b80 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e3f8305e80 con 0x55e3f83b5860 2023-07-14T18:12:19.976 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:19.922+0000 7f9a0ed9d700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55e3f83b6460 0x55e3f83b68d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:12:19.976 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:19.922+0000 7f9a0ed9d700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55e3f83b6460 0x55e3f83b68d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:57002/0 (socket says 172.21.15.163:57002) 2023-07-14T18:12:19.977 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:19.922+0000 7f9a0ed9d700 1 -- 172.21.15.163:0/1318981952 learned_addr learned my addr 172.21.15.163:0/1318981952 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:12:19.977 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:19.922+0000 7f9a0dd9b700 1 --2- 172.21.15.163:0/1318981952 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e3f83b5860 0x55e3f83b5e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:12:19.977 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:19.922+0000 7f9a0e59c700 1 --2- 172.21.15.163:0/1318981952 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e3f83b4f10 0x55e3f83b5320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:12:19.977 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:19.922+0000 7f9a0ed9d700 1 -- 172.21.15.163:0/1318981952 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e3f83b5860 msgr2=0x55e3f83b5e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:12:19.977 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:19.922+0000 7f9a0ed9d700 1 --2- 172.21.15.163:0/1318981952 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e3f83b5860 0x55e3f83b5e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:19.977 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:19.922+0000 7f9a0ed9d700 1 -- 172.21.15.163:0/1318981952 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e3f83b4f10 msgr2=0x55e3f83b5320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:12:19.977 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:19.922+0000 7f9a0ed9d700 1 --2- 172.21.15.163:0/1318981952 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e3f83b4f10 0x55e3f83b5320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:19.977 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:19.922+0000 7f9a0ed9d700 1 -- 172.21.15.163:0/1318981952 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e3f8133d90 con 0x55e3f83b6460 2023-07-14T18:12:19.978 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:19.922+0000 7f9a0ed9d700 1 --2- 172.21.15.163:0/1318981952 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55e3f83b6460 0x55e3f83b68d0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f9a0000b2e0 tx=0x7f9a00005c40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e793ce931372af2b server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:12:19.978 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:19.922+0000 7f9a04ff9700 1 -- 172.21.15.163:0/1318981952 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a000047e0 con 0x55e3f83b6460 2023-07-14T18:12:19.978 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:19.922+0000 7f9a04ff9700 1 -- 172.21.15.163:0/1318981952 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f9a0001e040 con 0x55e3f83b6460 2023-07-14T18:12:19.978 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:19.922+0000 7f9a04ff9700 1 -- 172.21.15.163:0/1318981952 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a00003680 con 0x55e3f83b6460 2023-07-14T18:12:19.978 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:19.923+0000 7f9a20e96b80 1 -- 172.21.15.163:0/1318981952 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55e3f83b6460 msgr2=0x55e3f83b68d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:12:19.979 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:19.923+0000 7f9a20e96b80 1 --2- 172.21.15.163:0/1318981952 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55e3f83b6460 0x55e3f83b68d0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f9a0000b2e0 tx=0x7f9a00005c40 comp rx=0 tx=0).stop 2023-07-14T18:12:19.979 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:19.923+0000 7f9a20e96b80 1 -- 172.21.15.163:0/1318981952 shutdown_connections 2023-07-14T18:12:19.979 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:19.923+0000 7f9a20e96b80 1 --2- 172.21.15.163:0/1318981952 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55e3f83b6460 0x55e3f83b68d0 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:19.979 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:19.923+0000 7f9a20e96b80 1 --2- 172.21.15.163:0/1318981952 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e3f83b4f10 0x55e3f83b5320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:19.979 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:19.923+0000 7f9a20e96b80 1 --2- 172.21.15.163:0/1318981952 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e3f83b5860 0x55e3f83b5e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:19.979 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:19.923+0000 7f9a20e96b80 1 -- 172.21.15.163:0/1318981952 >> 172.21.15.163:0/1318981952 conn(0x55e3f83aa630 msgr2=0x55e3f83af980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:12:19.979 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:19.923+0000 7f9a20e96b80 1 -- 172.21.15.163:0/1318981952 shutdown_connections 2023-07-14T18:12:19.980 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:19.923+0000 7f9a20e96b80 1 -- 172.21.15.163:0/1318981952 wait complete. 2023-07-14T18:12:19.980 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:19.924+0000 7f9a20e96b80 1 -- start start 2023-07-14T18:12:19.980 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:19.924+0000 7f9a20e96b80 1 Processor -- start 2023-07-14T18:12:19.980 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:19.924+0000 7f9a20e96b80 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e3f83b4f10 0x55e3f83be8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:12:19.980 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:19.924+0000 7f9a20e96b80 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55e3f83b5860 0x55e3f83bedf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:12:19.980 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:19.924+0000 7f9a20e96b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e3f83b6460 0x55e3f83c5e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:12:19.980 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:19.924+0000 7f9a20e96b80 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e3f82a5a70 con 0x55e3f83b5860 2023-07-14T18:12:19.981 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:19.924+0000 7f9a20e96b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e3f82a5770 con 0x55e3f83b6460 2023-07-14T18:12:19.981 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:19.924+0000 7f9a20e96b80 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e3f81898d0 con 0x55e3f83b4f10 2023-07-14T18:12:19.981 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:19.924+0000 7f9a20e96b80 10 client.0 _ll_register_callbacks cb 0x55e3f82a3710 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T18:12:19.981 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:19.924+0000 7f9a0dd9b700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55e3f83b5860 0x55e3f83bedf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:12:19.981 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:19.924+0000 7f9a0dd9b700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55e3f83b5860 0x55e3f83bedf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:57006/0 (socket says 172.21.15.163:57006) 2023-07-14T18:12:19.981 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:19.924+0000 7f9a0dd9b700 1 -- 172.21.15.163:0/3170360214 learned_addr learned my addr 172.21.15.163:0/3170360214 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:12:19.981 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:19.924+0000 7f9a0ed9d700 1 --2- 172.21.15.163:0/3170360214 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e3f83b6460 0x55e3f83c5e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:12:19.981 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:19.924+0000 7f9a0e59c700 1 --2- 172.21.15.163:0/3170360214 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e3f83b4f10 0x55e3f83be8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:12:19.982 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:19.924+0000 7f9a0dd9b700 1 -- 172.21.15.163:0/3170360214 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e3f83b4f10 msgr2=0x55e3f83be8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:12:19.982 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:19.924+0000 7f9a0dd9b700 1 --2- 172.21.15.163:0/3170360214 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e3f83b4f10 0x55e3f83be8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:19.982 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:19.924+0000 7f9a0dd9b700 1 -- 172.21.15.163:0/3170360214 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e3f83b6460 msgr2=0x55e3f83c5e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:12:19.982 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:19.924+0000 7f9a0dd9b700 1 --2- 172.21.15.163:0/3170360214 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e3f83b6460 0x55e3f83c5e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:19.982 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:19.924+0000 7f9a0dd9b700 1 -- 172.21.15.163:0/3170360214 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a10107880 con 0x55e3f83b5860 2023-07-14T18:12:19.982 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:19.924+0000 7f9a0dd9b700 1 --2- 172.21.15.163:0/3170360214 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55e3f83b5860 0x55e3f83bedf0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f99f8012450 tx=0x7f99f8004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a1e39af0443a337 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:12:19.982 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:19.924+0000 7f99f5ffb700 10 client.0 ms_handle_connect on v2:172.21.15.163:3300/0 2023-07-14T18:12:19.983 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:19.925+0000 7f99f5ffb700 1 -- 172.21.15.163:0/3170360214 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99f8010a30 con 0x55e3f83b5860 2023-07-14T18:12:19.983 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:19.925+0000 7f9a20e96b80 1 -- 172.21.15.163:0/3170360214 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55e3f825f4a0 con 0x55e3f83b5860 2023-07-14T18:12:19.983 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:19.925+0000 7f99f5ffb700 1 -- 172.21.15.163:0/3170360214 <== mon.0 v2:172.21.15.163:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 9020+0+0 (secure 0 0 0) 0x7f99f8020430 con 0x55e3f83b5860 2023-07-14T18:12:19.983 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:19.925+0000 7f99f5ffb700 1 -- 172.21.15.163:0/3170360214 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7f99f8029670 con 0x55e3f83b5860 2023-07-14T18:12:19.983 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:19.925+0000 7f9a20e96b80 10 client.15234 fetch_fsmap learned FSMap version 28 2023-07-14T18:12:19.983 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:19.925+0000 7f9a20e96b80 1 -- 172.21.15.163:0/3170360214 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) v3 -- 0x55e3f811cc10 con 0x55e3f83b5860 2023-07-14T18:12:19.983 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:19.925+0000 7f99f5ffb700 1 -- 172.21.15.163:0/3170360214 <== mon.0 v2:172.21.15.163:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55e3f825f4a0 con 0x55e3f83b5860 2023-07-14T18:12:19.983 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:19.925+0000 7f99f5ffb700 1 -- 172.21.15.163:0/3170360214 <== mon.0 v2:172.21.15.163:3300/0 5 ==== fsmap(e 28) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f99f8020990 con 0x55e3f83b5860 2023-07-14T18:12:19.984 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:19.925+0000 7f9a20e96b80 10 client.15234 fetch_fsmap finished waiting for FSMap version 28 2023-07-14T18:12:19.984 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:19.925+0000 7f9a20e96b80 10 client.15234 resolve_mds: resolved name 'a' to daemon mds.a 2023-07-14T18:12:19.984 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:19.925+0000 7f9a20e96b80 20 client.15234 populate_metadata read hostname 'smithi163' 2023-07-14T18:12:19.984 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:19.925+0000 7f9a20e96b80 1 --2- 172.21.15.163:0/3170360214 >> [v2:172.21.15.163:6840/1032082642,v1:172.21.15.163:6841/1032082642] conn(0x55e3f83c9be0 0x55e3f83c8fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:12:19.984 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:19.925+0000 7f9a20e96b80 4 client.15234 mds_command: new command op to 14652 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-14T18:12:19.984 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:19.925+0000 7f9a20e96b80 1 -- 172.21.15.163:0/3170360214 --> [v2:172.21.15.163:6840/1032082642,v1:172.21.15.163:6841/1032082642] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55e3f8383d50 con 0x55e3f83c9be0 2023-07-14T18:12:19.985 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:19.925+0000 7f9a0e59c700 1 --2- 172.21.15.163:0/3170360214 >> [v2:172.21.15.163:6840/1032082642,v1:172.21.15.163:6841/1032082642] conn(0x55e3f83c9be0 0x55e3f83c8fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:12:19.985 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:19.926+0000 7f99f5ffb700 10 client.15234 ms_handle_connect on v2:172.21.15.163:6840/1032082642 2023-07-14T18:12:19.985 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:19.926+0000 7f9a0e59c700 1 --2- 172.21.15.163:0/3170360214 >> [v2:172.21.15.163:6840/1032082642,v1:172.21.15.163:6841/1032082642] conn(0x55e3f83c9be0 0x55e3f83c8fe0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=69ab61a1be8191d1 server_cookie=17a22354ccf30f77 in_seq=0 out_seq=0 2023-07-14T18:12:19.985 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:19.926+0000 7f99f5ffb700 1 -- 172.21.15.163:0/3170360214 <== mds.4 v2:172.21.15.163:6840/1032082642 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18017 (crc 0 0 0) 0x55e3f8383d50 con 0x55e3f83c9be0 2023-07-14T18:12:19.985 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:19.926+0000 7f99f5ffb700 10 client.15234 handle_command_reply: tid=0 2023-07-14T18:12:19.985 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:19.926+0000 7f9a20e96b80 1 client.15234 shutdown 2023-07-14T18:12:19.985 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:19.926+0000 7f9a20e96b80 1 -- 172.21.15.163:0/3170360214 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55e3f83b5860 msgr2=0x55e3f83bedf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:12:19.986 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:19.926+0000 7f9a20e96b80 1 --2- 172.21.15.163:0/3170360214 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55e3f83b5860 0x55e3f83bedf0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f99f8012450 tx=0x7f99f8004750 comp rx=0 tx=0).stop 2023-07-14T18:12:19.986 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:19.926+0000 7f9a20e96b80 1 -- 172.21.15.163:0/3170360214 shutdown_connections 2023-07-14T18:12:19.986 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:19.926+0000 7f9a20e96b80 1 --2- 172.21.15.163:0/3170360214 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e3f83b4f10 0x55e3f83be8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:19.986 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:19.926+0000 7f9a20e96b80 1 --2- 172.21.15.163:0/3170360214 >> [v2:172.21.15.163:6840/1032082642,v1:172.21.15.163:6841/1032082642] conn(0x55e3f83c9be0 0x55e3f83c8fe0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:19.986 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:19.926+0000 7f9a20e96b80 1 --2- 172.21.15.163:0/3170360214 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e3f83b6460 0x55e3f83c5e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:19.986 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:19.926+0000 7f99f5ffb700 0 client.15234 ms_handle_reset on v2:172.21.15.163:6840/1032082642 2023-07-14T18:12:19.986 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:19.926+0000 7f9a20e96b80 1 --2- 172.21.15.163:0/3170360214 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55e3f83b5860 0x55e3f83bedf0 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:19.986 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:19.927+0000 7f9a20e96b80 1 -- 172.21.15.163:0/3170360214 >> 172.21.15.163:0/3170360214 conn(0x55e3f83aa630 msgr2=0x55e3f83ae600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:12:19.987 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:19.927+0000 7f9a20e96b80 1 -- 172.21.15.163:0/3170360214 shutdown_connections 2023-07-14T18:12:19.987 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:19.927+0000 7f9a20e96b80 1 -- 172.21.15.163:0/3170360214 wait complete. 2023-07-14T18:12:19.987 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:19.927+0000 7f9a20e96b80 20 client.15234 trim_cache size 0 max 16384 2023-07-14T18:12:19.995 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:19.944+0000 7f9a20e96b80 1 Processor -- start 2023-07-14T18:12:19.995 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:19.944+0000 7f9a20e96b80 1 -- start start 2023-07-14T18:12:19.995 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:19.944+0000 7f9a20e96b80 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55e3f83b4f10 0x55e3f83bd5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:12:19.996 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:19.944+0000 7f9a20e96b80 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e3f83b5860 0x55e3f83c5df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:12:19.996 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:19.944+0000 7f9a20e96b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e3f83b6460 0x55e3f83af0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:12:19.996 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:19.944+0000 7f9a20e96b80 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e3f8383d50 con 0x55e3f83b4f10 2023-07-14T18:12:19.996 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:19.944+0000 7f9a20e96b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e3f82d4790 con 0x55e3f83b6460 2023-07-14T18:12:19.996 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:19.944+0000 7f9a20e96b80 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e3f8195de0 con 0x55e3f83b5860 2023-07-14T18:12:19.996 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:19.944+0000 7f9a0e59c700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55e3f83b4f10 0x55e3f83bd5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:12:19.996 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:19.944+0000 7f9a0e59c700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55e3f83b4f10 0x55e3f83bd5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:57012/0 (socket says 172.21.15.163:57012) 2023-07-14T18:12:19.997 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:19.944+0000 7f9a0e59c700 1 -- 172.21.15.163:0/463710247 learned_addr learned my addr 172.21.15.163:0/463710247 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:12:19.997 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:19.944+0000 7f9a0dd9b700 1 --2- 172.21.15.163:0/463710247 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e3f83b5860 0x55e3f83c5df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:12:19.997 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:19.944+0000 7f9a0e59c700 1 -- 172.21.15.163:0/463710247 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e3f83b5860 msgr2=0x55e3f83c5df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:12:19.997 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:19.944+0000 7f9a0ed9d700 1 --2- 172.21.15.163:0/463710247 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e3f83b6460 0x55e3f83af0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:12:19.997 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:19.944+0000 7f9a0e59c700 1 --2- 172.21.15.163:0/463710247 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e3f83b5860 0x55e3f83c5df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:19.997 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:19.944+0000 7f9a0e59c700 1 -- 172.21.15.163:0/463710247 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e3f83b6460 msgr2=0x55e3f83af0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:12:19.997 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:19.944+0000 7f9a0e59c700 1 --2- 172.21.15.163:0/463710247 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e3f83b6460 0x55e3f83af0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:19.998 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:19.944+0000 7f9a0e59c700 1 -- 172.21.15.163:0/463710247 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e3f815a200 con 0x55e3f83b4f10 2023-07-14T18:12:19.998 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:19.944+0000 7f9a0dd9b700 1 --2- 172.21.15.163:0/463710247 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e3f83b5860 0x55e3f83c5df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T18:12:19.998 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:19.945+0000 7f9a0e59c700 1 --2- 172.21.15.163:0/463710247 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55e3f83b4f10 0x55e3f83bd5f0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f9a0809c0a0 tx=0x7f9a0809bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e1e7aa3659148f77 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:12:19.998 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:19.945+0000 7f9a057fa700 1 -- 172.21.15.163:0/463710247 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a08004000 con 0x55e3f83b4f10 2023-07-14T18:12:19.999 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:19.945+0000 7f9a057fa700 1 -- 172.21.15.163:0/463710247 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f9a0809a4b0 con 0x55e3f83b4f10 2023-07-14T18:12:19.999 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:19.945+0000 7f9a057fa700 1 -- 172.21.15.163:0/463710247 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a0809c5d0 con 0x55e3f83b4f10 2023-07-14T18:12:19.999 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:19.945+0000 7f9a20e96b80 1 -- 172.21.15.163:0/463710247 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55e3f83b4f10 msgr2=0x55e3f83bd5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:12:19.999 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:19.945+0000 7f9a20e96b80 1 --2- 172.21.15.163:0/463710247 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55e3f83b4f10 0x55e3f83bd5f0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f9a0809c0a0 tx=0x7f9a0809bee0 comp rx=0 tx=0).stop 2023-07-14T18:12:19.999 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:19.945+0000 7f9a20e96b80 1 -- 172.21.15.163:0/463710247 shutdown_connections 2023-07-14T18:12:19.999 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:19.945+0000 7f9a20e96b80 1 --2- 172.21.15.163:0/463710247 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e3f83b6460 0x55e3f83af0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:19.999 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:19.945+0000 7f9a20e96b80 1 --2- 172.21.15.163:0/463710247 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55e3f83b4f10 0x55e3f83bd5f0 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:19.999 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:19.945+0000 7f9a20e96b80 1 --2- 172.21.15.163:0/463710247 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e3f83b5860 0x55e3f83c5df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:20.000 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:19.945+0000 7f9a20e96b80 1 -- 172.21.15.163:0/463710247 >> 172.21.15.163:0/463710247 conn(0x55e3f83aa630 msgr2=0x55e3f83abb00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:12:20.000 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:19.945+0000 7f9a20e96b80 1 -- 172.21.15.163:0/463710247 shutdown_connections 2023-07-14T18:12:20.000 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:19.945+0000 7f9a20e96b80 1 -- 172.21.15.163:0/463710247 wait complete. 2023-07-14T18:12:20.000 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:19.946+0000 7f9a20e96b80 1 -- start start 2023-07-14T18:12:20.000 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:19.946+0000 7f9a20e96b80 1 Processor -- start 2023-07-14T18:12:20.000 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:19.946+0000 7f9a20e96b80 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55e3f83b4f10 0x55e3f83c1060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:12:20.000 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:19.946+0000 7f9a20e96b80 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e3f83b5860 0x55e3f83c15a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:12:20.001 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:19.946+0000 7f9a20e96b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e3f83b6460 0x55e3f841d860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:12:20.001 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:19.946+0000 7f9a20e96b80 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e3f83c1bc0 con 0x55e3f83b4f10 2023-07-14T18:12:20.001 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:19.946+0000 7f9a20e96b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e3f841dda0 con 0x55e3f83b6460 2023-07-14T18:12:20.001 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:19.946+0000 7f9a20e96b80 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e3f841dee0 con 0x55e3f83b5860 2023-07-14T18:12:20.001 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:19.946+0000 7f9a20e96b80 10 client.0 _ll_register_callbacks cb 0x7f99f8010c20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T18:12:20.001 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:19.946+0000 7f9a0e59c700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55e3f83b4f10 0x55e3f83c1060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:12:20.001 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:19.946+0000 7f9a0e59c700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55e3f83b4f10 0x55e3f83c1060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:57018/0 (socket says 172.21.15.163:57018) 2023-07-14T18:12:20.002 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:19.946+0000 7f9a0e59c700 1 -- 172.21.15.163:0/3855083860 learned_addr learned my addr 172.21.15.163:0/3855083860 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:12:20.002 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:19.946+0000 7f9a0e59c700 1 -- 172.21.15.163:0/3855083860 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e3f83b5860 msgr2=0x55e3f83c15a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:12:20.002 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:19.946+0000 7f9a0e59c700 1 --2- 172.21.15.163:0/3855083860 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e3f83b5860 0x55e3f83c15a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:20.002 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:19.946+0000 7f9a0e59c700 1 -- 172.21.15.163:0/3855083860 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e3f83b6460 msgr2=0x55e3f841d860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:12:20.002 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:19.946+0000 7f9a0e59c700 1 --2- 172.21.15.163:0/3855083860 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e3f83b6460 0x55e3f841d860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:20.002 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:19.946+0000 7f9a0e59c700 1 -- 172.21.15.163:0/3855083860 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a10067d10 con 0x55e3f83b4f10 2023-07-14T18:12:20.002 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:19.946+0000 7f9a0e59c700 1 --2- 172.21.15.163:0/3855083860 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55e3f83b4f10 0x55e3f83c1060 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f9a0809be10 tx=0x7f9a0809a370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f4cf6fad6a1fdde7 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:12:20.002 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:19.946+0000 7f99f5ffb700 10 client.0 ms_handle_connect on v2:172.21.15.163:3300/0 2023-07-14T18:12:20.003 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:19.947+0000 7f99f5ffb700 1 -- 172.21.15.163:0/3855083860 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a08004330 con 0x55e3f83b4f10 2023-07-14T18:12:20.003 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:19.947+0000 7f99f5ffb700 1 -- 172.21.15.163:0/3855083860 <== mon.0 v2:172.21.15.163:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 9020+0+0 (secure 0 0 0) 0x7f9a0809c370 con 0x55e3f83b4f10 2023-07-14T18:12:20.003 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:19.947+0000 7f9a20e96b80 1 -- 172.21.15.163:0/3855083860 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f9a0001e040 con 0x55e3f83b4f10 2023-07-14T18:12:20.003 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:19.947+0000 7f99f5ffb700 1 -- 172.21.15.163:0/3855083860 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9a0809c530 con 0x55e3f83b4f10 2023-07-14T18:12:20.003 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:19.947+0000 7f9a20e96b80 10 client.15240 fetch_fsmap learned FSMap version 28 2023-07-14T18:12:20.003 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:19.947+0000 7f9a20e96b80 1 -- 172.21.15.163:0/3855083860 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) v3 -- 0x55e3f8132260 con 0x55e3f83b4f10 2023-07-14T18:12:20.003 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:19.947+0000 7f99f5ffb700 1 -- 172.21.15.163:0/3855083860 <== mon.0 v2:172.21.15.163:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f9a0001e040 con 0x55e3f83b4f10 2023-07-14T18:12:20.004 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:19.947+0000 7f99f5ffb700 1 -- 172.21.15.163:0/3855083860 <== mon.0 v2:172.21.15.163:3300/0 5 ==== fsmap(e 28) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f9a08097fb0 con 0x55e3f83b4f10 2023-07-14T18:12:20.004 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:19.947+0000 7f9a20e96b80 10 client.15240 fetch_fsmap finished waiting for FSMap version 28 2023-07-14T18:12:20.004 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:19.947+0000 7f9a20e96b80 10 client.15240 resolve_mds: resolved name 'a' to daemon mds.a 2023-07-14T18:12:20.004 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:19.947+0000 7f9a20e96b80 20 client.15240 populate_metadata read hostname 'smithi163' 2023-07-14T18:12:20.004 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:19.947+0000 7f9a20e96b80 1 --2- 172.21.15.163:0/3855083860 >> [v2:172.21.15.163:6840/1032082642,v1:172.21.15.163:6841/1032082642] conn(0x55e3f8422760 0x55e3f841f150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:12:20.004 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:19.947+0000 7f9a20e96b80 4 client.15240 mds_command: new command op to 14652 tid=0[{"prefix": "status"}] 2023-07-14T18:12:20.005 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:19.947+0000 7f9a20e96b80 1 -- 172.21.15.163:0/3855083860 --> [v2:172.21.15.163:6840/1032082642,v1:172.21.15.163:6841/1032082642] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55e3f82fee60 con 0x55e3f8422760 2023-07-14T18:12:20.005 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:19.947+0000 7f9a0dd9b700 1 --2- 172.21.15.163:0/3855083860 >> [v2:172.21.15.163:6840/1032082642,v1:172.21.15.163:6841/1032082642] conn(0x55e3f8422760 0x55e3f841f150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:12:20.005 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:19.948+0000 7f9a0dd9b700 1 --2- 172.21.15.163:0/3855083860 >> [v2:172.21.15.163:6840/1032082642,v1:172.21.15.163:6841/1032082642] conn(0x55e3f8422760 0x55e3f841f150 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=d57028e3175b660a server_cookie=9c2769ad4e7ac05f in_seq=0 out_seq=0 2023-07-14T18:12:20.005 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:19.948+0000 7f99f5ffb700 10 client.15240 ms_handle_connect on v2:172.21.15.163:6840/1032082642 2023-07-14T18:12:20.005 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:19.948+0000 7f99f5ffb700 1 -- 172.21.15.163:0/3855083860 <== mds.4 v2:172.21.15.163:6840/1032082642 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+332 (crc 0 0 0) 0x55e3f82fee60 con 0x55e3f8422760 2023-07-14T18:12:20.005 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:19.948+0000 7f99f5ffb700 10 client.15240 handle_command_reply: tid=0 2023-07-14T18:12:20.005 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:19.948+0000 7f9a20e96b80 1 client.15240 shutdown 2023-07-14T18:12:20.006 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:19.948+0000 7f9a20e96b80 1 -- 172.21.15.163:0/3855083860 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55e3f83b4f10 msgr2=0x55e3f83c1060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:12:20.006 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:19.948+0000 7f9a20e96b80 1 --2- 172.21.15.163:0/3855083860 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55e3f83b4f10 0x55e3f83c1060 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f9a0809be10 tx=0x7f9a0809a370 comp rx=0 tx=0).stop 2023-07-14T18:12:20.006 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:19.948+0000 7f9a20e96b80 1 -- 172.21.15.163:0/3855083860 shutdown_connections 2023-07-14T18:12:20.006 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:19.948+0000 7f9a20e96b80 1 --2- 172.21.15.163:0/3855083860 >> [v2:172.21.15.163:6840/1032082642,v1:172.21.15.163:6841/1032082642] conn(0x55e3f8422760 0x55e3f841f150 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:20.006 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:19.948+0000 7f9a20e96b80 1 --2- 172.21.15.163:0/3855083860 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e3f83b6460 0x55e3f841d860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:20.006 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:19.948+0000 7f99f5ffb700 0 client.15240 ms_handle_reset on v2:172.21.15.163:6840/1032082642 2023-07-14T18:12:20.006 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:19.948+0000 7f9a20e96b80 1 --2- 172.21.15.163:0/3855083860 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55e3f83b4f10 0x55e3f83c1060 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:20.006 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:19.948+0000 7f9a20e96b80 1 --2- 172.21.15.163:0/3855083860 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e3f83b5860 0x55e3f83c15a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:20.007 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:19.948+0000 7f9a20e96b80 1 -- 172.21.15.163:0/3855083860 >> 172.21.15.163:0/3855083860 conn(0x55e3f83aa630 msgr2=0x55e3f83bd5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:12:20.007 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:19.948+0000 7f9a20e96b80 1 -- 172.21.15.163:0/3855083860 shutdown_connections 2023-07-14T18:12:20.007 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:19.948+0000 7f9a20e96b80 1 -- 172.21.15.163:0/3855083860 wait complete. 2023-07-14T18:12:20.007 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:19.948+0000 7f9a20e96b80 20 client.15240 trim_cache size 0 max 16384 2023-07-14T18:12:20.007 INFO:teuthology.orchestra.run.smithi163.stdout:{ 2023-07-14T18:12:20.008 INFO:teuthology.orchestra.run.smithi163.stdout: "cluster_fsid": "bf7326ec-2270-11ee-9b33-001a4aab830c", 2023-07-14T18:12:20.008 INFO:teuthology.orchestra.run.smithi163.stdout: "whoami": 4, 2023-07-14T18:12:20.008 INFO:teuthology.orchestra.run.smithi163.stdout: "id": 14652, 2023-07-14T18:12:20.008 INFO:teuthology.orchestra.run.smithi163.stdout: "want_state": "up:active", 2023-07-14T18:12:20.008 INFO:teuthology.orchestra.run.smithi163.stdout: "state": "up:active", 2023-07-14T18:12:20.008 INFO:teuthology.orchestra.run.smithi163.stdout: "fs_name": "cephfs", 2023-07-14T18:12:20.008 INFO:teuthology.orchestra.run.smithi163.stdout: "rank_uptime": 49.186725887999998, 2023-07-14T18:12:20.009 INFO:teuthology.orchestra.run.smithi163.stdout: "mdsmap_epoch": 28, 2023-07-14T18:12:20.009 INFO:teuthology.orchestra.run.smithi163.stdout: "osdmap_epoch": 86, 2023-07-14T18:12:20.009 INFO:teuthology.orchestra.run.smithi163.stdout: "osdmap_epoch_barrier": 84, 2023-07-14T18:12:20.009 INFO:teuthology.orchestra.run.smithi163.stdout: "uptime": 78.578807303000005 2023-07-14T18:12:20.009 INFO:teuthology.orchestra.run.smithi163.stdout:} 2023-07-14T18:12:20.010 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:19.949+0000 7f9a14cfe700 1 -- 172.21.15.163:0/688416349 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f99fc0a11e0 msgr2=0x7f99fc0a3690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:12:20.010 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:19.949+0000 7f9a14cfe700 1 --2- 172.21.15.163:0/688416349 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f99fc0a11e0 0x7f99fc0a3690 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f99f8009be0 tx=0x7f99f8009260 comp rx=0 tx=0).stop 2023-07-14T18:12:20.011 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:19.949+0000 7f9a14cfe700 1 -- 172.21.15.163:0/688416349 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f9a100feb10 msgr2=0x7f9a10194730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:12:20.011 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:19.949+0000 7f9a14cfe700 1 --2- 172.21.15.163:0/688416349 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f9a100feb10 0x7f9a10194730 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f9a08007ee0 tx=0x7f9a0800f5c0 comp rx=0 tx=0).stop 2023-07-14T18:12:20.011 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:19.949+0000 7f9a14cfe700 1 -- 172.21.15.163:0/688416349 shutdown_connections 2023-07-14T18:12:20.011 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:19.949+0000 7f9a14cfe700 1 --2- 172.21.15.163:0/688416349 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f99fc0a11e0 0x7f99fc0a3690 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:20.011 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:19.949+0000 7f9a14cfe700 1 --2- 172.21.15.163:0/688416349 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9a10100690 0x7f9a1019bce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:20.011 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:19.949+0000 7f9a14cfe700 1 --2- 172.21.15.163:0/688416349 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f9a100feb10 0x7f9a10194730 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:20.011 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:19.949+0000 7f9a14cfe700 1 --2- 172.21.15.163:0/688416349 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9a100ffd00 0x7f9a10194c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:20.012 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:19.949+0000 7f9a14cfe700 1 -- 172.21.15.163:0/688416349 >> 172.21.15.163:0/688416349 conn(0x7f9a100fa130 msgr2=0x7f9a10103240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:12:20.012 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:19.949+0000 7f9a14cfe700 1 -- 172.21.15.163:0/688416349 shutdown_connections 2023-07-14T18:12:20.012 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:19.949+0000 7f9a14cfe700 1 -- 172.21.15.163:0/688416349 wait complete. 2023-07-14T18:12:20.012 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2023-07-14T18:12:20.135 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.093+0000 7f2abaa1c700 1 -- 172.21.15.163:0/3979332492 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f2ab4100e10 msgr2=0x7f2ab4101260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:12:20.135 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.093+0000 7f2abaa1c700 1 --2- 172.21.15.163:0/3979332492 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f2ab4100e10 0x7f2ab4101260 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f2aa8009990 tx=0x7f2aa8009ca0 comp rx=0 tx=0).stop 2023-07-14T18:12:20.135 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.093+0000 7f2abaa1c700 1 -- 172.21.15.163:0/3979332492 shutdown_connections 2023-07-14T18:12:20.136 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.093+0000 7f2abaa1c700 1 --2- 172.21.15.163:0/3979332492 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2ab40ffc20 0x7f2ab4100030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:20.136 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.093+0000 7f2abaa1c700 1 --2- 172.21.15.163:0/3979332492 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2ab41017a0 0x7f2ab4108060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:20.136 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.093+0000 7f2abaa1c700 1 --2- 172.21.15.163:0/3979332492 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f2ab4100e10 0x7f2ab4101260 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:20.136 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.094+0000 7f2abaa1c700 1 -- 172.21.15.163:0/3979332492 >> 172.21.15.163:0/3979332492 conn(0x7f2ab40fb260 msgr2=0x7f2ab40fd670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:12:20.137 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.094+0000 7f2abaa1c700 1 -- 172.21.15.163:0/3979332492 shutdown_connections 2023-07-14T18:12:20.137 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.094+0000 7f2abaa1c700 1 -- 172.21.15.163:0/3979332492 wait complete. 2023-07-14T18:12:20.137 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.094+0000 7f2abaa1c700 1 Processor -- start 2023-07-14T18:12:20.137 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.094+0000 7f2abaa1c700 1 -- start start 2023-07-14T18:12:20.139 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.094+0000 7f2abaa1c700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2ab40ffc20 0x7f2ab4195880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:12:20.139 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.094+0000 7f2abaa1c700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2ab4100e10 0x7f2ab4195dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:12:20.139 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.094+0000 7f2abaa1c700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f2ab41017a0 0x7f2ab419ce30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:12:20.139 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.094+0000 7f2abaa1c700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ab419d400 con 0x7f2ab41017a0 2023-07-14T18:12:20.139 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.094+0000 7f2abaa1c700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ab419d540 con 0x7f2ab40ffc20 2023-07-14T18:12:20.140 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.094+0000 7f2abaa1c700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ab419d6d0 con 0x7f2ab4100e10 2023-07-14T18:12:20.140 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.095+0000 7f2ab8fb9700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f2ab41017a0 0x7f2ab419ce30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:12:20.140 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.095+0000 7f2ab37fe700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2ab4100e10 0x7f2ab4195dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:12:20.140 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.095+0000 7f2ab8fb9700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f2ab41017a0 0x7f2ab419ce30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:57036/0 (socket says 172.21.15.163:57036) 2023-07-14T18:12:20.140 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.095+0000 7f2ab8fb9700 1 -- 172.21.15.163:0/1442165454 learned_addr learned my addr 172.21.15.163:0/1442165454 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:12:20.140 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.095+0000 7f2ab3fff700 1 --2- 172.21.15.163:0/1442165454 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2ab40ffc20 0x7f2ab4195880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:12:20.140 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.095+0000 7f2ab8fb9700 1 -- 172.21.15.163:0/1442165454 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2ab4100e10 msgr2=0x7f2ab4195dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:12:20.141 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.095+0000 7f2ab8fb9700 1 --2- 172.21.15.163:0/1442165454 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2ab4100e10 0x7f2ab4195dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:20.141 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.095+0000 7f2ab8fb9700 1 -- 172.21.15.163:0/1442165454 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2ab40ffc20 msgr2=0x7f2ab4195880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:12:20.141 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.095+0000 7f2ab8fb9700 1 --2- 172.21.15.163:0/1442165454 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2ab40ffc20 0x7f2ab4195880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:20.141 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.095+0000 7f2ab8fb9700 1 -- 172.21.15.163:0/1442165454 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2aa80095f0 con 0x7f2ab41017a0 2023-07-14T18:12:20.141 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.095+0000 7f2ab8fb9700 1 --2- 172.21.15.163:0/1442165454 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f2ab41017a0 0x7f2ab419ce30 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f2aac00ef30 tx=0x7f2aac00c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:12:20.141 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.095+0000 7f2ab17fa700 1 -- 172.21.15.163:0/1442165454 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2aac018070 con 0x7f2ab41017a0 2023-07-14T18:12:20.141 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.095+0000 7f2abaa1c700 1 -- 172.21.15.163:0/1442165454 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ab419d950 con 0x7f2ab41017a0 2023-07-14T18:12:20.142 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.095+0000 7f2ab17fa700 1 -- 172.21.15.163:0/1442165454 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f2aac00f040 con 0x7f2ab41017a0 2023-07-14T18:12:20.142 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.095+0000 7f2ab17fa700 1 -- 172.21.15.163:0/1442165454 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2aac00cc30 con 0x7f2ab41017a0 2023-07-14T18:12:20.142 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.095+0000 7f2abaa1c700 1 -- 172.21.15.163:0/1442165454 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ab419deb0 con 0x7f2ab41017a0 2023-07-14T18:12:20.142 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.097+0000 7f2ab17fa700 1 -- 172.21.15.163:0/1442165454 <== mon.0 v2:172.21.15.163:3300/0 4 ==== mgrmap(e 17) v1 ==== 135767+0+0 (secure 0 0 0) 0x7f2aac007500 con 0x7f2ab41017a0 2023-07-14T18:12:20.142 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.098+0000 7f2ab17fa700 1 --2- 172.21.15.163:0/1442165454 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f2a9c0a11e0 0x7f2a9c0a3690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:12:20.142 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.098+0000 7f2ab3fff700 1 --2- 172.21.15.163:0/1442165454 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f2a9c0a11e0 0x7f2a9c0a3690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:12:20.142 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.098+0000 7f2ab17fa700 1 -- 172.21.15.163:0/1442165454 <== mon.0 v2:172.21.15.163:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 9020+0+0 (secure 0 0 0) 0x7f2aac0cc8c0 con 0x7f2ab41017a0 2023-07-14T18:12:20.147 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.099+0000 7f2ab3fff700 1 --2- 172.21.15.163:0/1442165454 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f2a9c0a11e0 0x7f2a9c0a3690 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f2ab4100c70 tx=0x7f2aa4009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:12:20.147 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.099+0000 7f2ac6bb4b80 1 Processor -- start 2023-07-14T18:12:20.148 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.099+0000 7f2ac6bb4b80 1 -- start start 2023-07-14T18:12:20.148 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.099+0000 7f2ac6bb4b80 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55d70a125f10 0x55d70a126320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:12:20.148 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.099+0000 7f2ac6bb4b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d70a126860 0x55d70a126e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:12:20.148 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.099+0000 7f2ac6bb4b80 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55d70a127460 0x55d70a1278d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:12:20.148 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.099+0000 7f2ac6bb4b80 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d70a02ac60 con 0x55d70a127460 2023-07-14T18:12:20.148 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.099+0000 7f2ac6bb4b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d70a07d9f0 con 0x55d70a126860 2023-07-14T18:12:20.148 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.099+0000 7f2ac6bb4b80 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d70a076e80 con 0x55d70a125f10 2023-07-14T18:12:20.149 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.099+0000 7f2ab8fb9700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55d70a127460 0x55d70a1278d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:12:20.149 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.099+0000 7f2ab8fb9700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55d70a127460 0x55d70a1278d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:57044/0 (socket says 172.21.15.163:57044) 2023-07-14T18:12:20.149 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.099+0000 7f2ab8fb9700 1 -- 172.21.15.163:0/241870127 learned_addr learned my addr 172.21.15.163:0/241870127 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:12:20.149 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.099+0000 7f2ab37fe700 1 --2- 172.21.15.163:0/241870127 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d70a126860 0x55d70a126e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:12:20.149 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.100+0000 7f2ab3fff700 1 --2- 172.21.15.163:0/241870127 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55d70a125f10 0x55d70a126320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:12:20.149 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.100+0000 7f2ab8fb9700 1 -- 172.21.15.163:0/241870127 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55d70a125f10 msgr2=0x55d70a126320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:12:20.149 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.100+0000 7f2ab8fb9700 1 --2- 172.21.15.163:0/241870127 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55d70a125f10 0x55d70a126320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:20.150 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.100+0000 7f2ab8fb9700 1 -- 172.21.15.163:0/241870127 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d70a126860 msgr2=0x55d70a126e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:12:20.150 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.100+0000 7f2ab8fb9700 1 --2- 172.21.15.163:0/241870127 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d70a126860 0x55d70a126e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:20.150 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.100+0000 7f2ab8fb9700 1 -- 172.21.15.163:0/241870127 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d709ea4d90 con 0x55d70a127460 2023-07-14T18:12:20.150 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.100+0000 7f2ab37fe700 1 --2- 172.21.15.163:0/241870127 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d70a126860 0x55d70a126e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T18:12:20.150 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.100+0000 7f2ab8fb9700 1 --2- 172.21.15.163:0/241870127 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55d70a127460 0x55d70a1278d0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f2aac095df0 tx=0x7f2aac099970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f71c1b0c4ffb06b9 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:12:20.150 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.100+0000 7f2a9a7fc700 1 -- 172.21.15.163:0/241870127 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2aac0092e0 con 0x55d70a127460 2023-07-14T18:12:20.150 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.100+0000 7f2a9a7fc700 1 -- 172.21.15.163:0/241870127 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f2aac084040 con 0x55d70a127460 2023-07-14T18:12:20.151 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.100+0000 7f2a9a7fc700 1 -- 172.21.15.163:0/241870127 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2aac098de0 con 0x55d70a127460 2023-07-14T18:12:20.151 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.101+0000 7f2ac6bb4b80 1 -- 172.21.15.163:0/241870127 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55d70a127460 msgr2=0x55d70a1278d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:12:20.151 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.101+0000 7f2ac6bb4b80 1 --2- 172.21.15.163:0/241870127 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55d70a127460 0x55d70a1278d0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f2aac095df0 tx=0x7f2aac099970 comp rx=0 tx=0).stop 2023-07-14T18:12:20.151 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.101+0000 7f2ac6bb4b80 1 -- 172.21.15.163:0/241870127 shutdown_connections 2023-07-14T18:12:20.151 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.101+0000 7f2ac6bb4b80 1 --2- 172.21.15.163:0/241870127 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55d70a125f10 0x55d70a126320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:20.151 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.101+0000 7f2ac6bb4b80 1 --2- 172.21.15.163:0/241870127 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55d70a127460 0x55d70a1278d0 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:20.151 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.101+0000 7f2ac6bb4b80 1 --2- 172.21.15.163:0/241870127 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d70a126860 0x55d70a126e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:20.151 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.101+0000 7f2ac6bb4b80 1 -- 172.21.15.163:0/241870127 >> 172.21.15.163:0/241870127 conn(0x55d70a11b630 msgr2=0x55d70a120980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:12:20.152 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.101+0000 7f2ac6bb4b80 1 -- 172.21.15.163:0/241870127 shutdown_connections 2023-07-14T18:12:20.152 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.101+0000 7f2ac6bb4b80 1 -- 172.21.15.163:0/241870127 wait complete. 2023-07-14T18:12:20.152 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.101+0000 7f2ac6bb4b80 1 -- start start 2023-07-14T18:12:20.152 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.101+0000 7f2ac6bb4b80 1 Processor -- start 2023-07-14T18:12:20.152 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.102+0000 7f2ac6bb4b80 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55d70a125f10 0x55d70a12f950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:12:20.152 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.102+0000 7f2ac6bb4b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d70a126860 0x55d70a12fe90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:12:20.152 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.102+0000 7f2ac6bb4b80 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55d70a127460 0x55d70a136ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:12:20.153 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.102+0000 7f2ac6bb4b80 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d70a016a70 con 0x55d70a125f10 2023-07-14T18:12:20.153 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.102+0000 7f2ac6bb4b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d70a016770 con 0x55d70a126860 2023-07-14T18:12:20.153 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.102+0000 7f2ac6bb4b80 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d709efa8d0 con 0x55d70a127460 2023-07-14T18:12:20.153 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.102+0000 7f2ac6bb4b80 10 client.0 _ll_register_callbacks cb 0x55d70a014710 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T18:12:20.153 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.102+0000 7f2ab3fff700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55d70a125f10 0x55d70a12f950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:12:20.153 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.102+0000 7f2ab3fff700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55d70a125f10 0x55d70a12f950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:57046/0 (socket says 172.21.15.163:57046) 2023-07-14T18:12:20.153 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.102+0000 7f2ab3fff700 1 -- 172.21.15.163:0/3813971356 learned_addr learned my addr 172.21.15.163:0/3813971356 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:12:20.154 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.102+0000 7f2ab8fb9700 1 --2- 172.21.15.163:0/3813971356 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55d70a127460 0x55d70a136ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:12:20.154 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.102+0000 7f2ab37fe700 1 --2- 172.21.15.163:0/3813971356 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d70a126860 0x55d70a12fe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:12:20.154 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.102+0000 7f2ab3fff700 1 -- 172.21.15.163:0/3813971356 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55d70a127460 msgr2=0x55d70a136ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:12:20.154 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.102+0000 7f2ab3fff700 1 --2- 172.21.15.163:0/3813971356 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55d70a127460 0x55d70a136ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:20.154 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.102+0000 7f2ab3fff700 1 -- 172.21.15.163:0/3813971356 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d70a126860 msgr2=0x55d70a12fe90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:12:20.154 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.102+0000 7f2ab3fff700 1 --2- 172.21.15.163:0/3813971356 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d70a126860 0x55d70a12fe90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:20.155 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.102+0000 7f2ab3fff700 1 -- 172.21.15.163:0/3813971356 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ab419deb0 con 0x55d70a125f10 2023-07-14T18:12:20.155 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.102+0000 7f2ab8fb9700 1 --2- 172.21.15.163:0/3813971356 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55d70a127460 0x55d70a136ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T18:12:20.155 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.102+0000 7f2ab3fff700 1 --2- 172.21.15.163:0/3813971356 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55d70a125f10 0x55d70a12f950 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f2aa4012930 tx=0x7f2aa40047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=29445171636d4cf0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:12:20.155 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.102+0000 7f2a937fe700 10 client.0 ms_handle_connect on v2:172.21.15.163:3300/0 2023-07-14T18:12:20.155 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.102+0000 7f2a937fe700 1 -- 172.21.15.163:0/3813971356 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2aa401f850 con 0x55d70a125f10 2023-07-14T18:12:20.155 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.102+0000 7f2ac6bb4b80 1 -- 172.21.15.163:0/3813971356 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55d709fd04a0 con 0x55d70a125f10 2023-07-14T18:12:20.155 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.102+0000 7f2a937fe700 1 -- 172.21.15.163:0/3813971356 <== mon.0 v2:172.21.15.163:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 9020+0+0 (secure 0 0 0) 0x7f2aa4018070 con 0x55d70a125f10 2023-07-14T18:12:20.156 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.103+0000 7f2a937fe700 1 -- 172.21.15.163:0/3813971356 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2aa401f9b0 con 0x55d70a125f10 2023-07-14T18:12:20.156 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.103+0000 7f2ac6bb4b80 10 client.15252 fetch_fsmap learned FSMap version 28 2023-07-14T18:12:20.156 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.103+0000 7f2ac6bb4b80 1 -- 172.21.15.163:0/3813971356 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) v3 -- 0x55d709e8dc10 con 0x55d70a125f10 2023-07-14T18:12:20.156 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.103+0000 7f2a937fe700 1 -- 172.21.15.163:0/3813971356 <== mon.0 v2:172.21.15.163:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55d709fd04a0 con 0x55d70a125f10 2023-07-14T18:12:20.156 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.103+0000 7f2a937fe700 1 -- 172.21.15.163:0/3813971356 <== mon.0 v2:172.21.15.163:3300/0 5 ==== fsmap(e 28) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f2aa4029b90 con 0x55d70a125f10 2023-07-14T18:12:20.156 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.103+0000 7f2ac6bb4b80 10 client.15252 fetch_fsmap finished waiting for FSMap version 28 2023-07-14T18:12:20.157 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.103+0000 7f2ac6bb4b80 10 client.15252 resolve_mds: resolved name 'c' to daemon mds.c 2023-07-14T18:12:20.157 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.103+0000 7f2ac6bb4b80 20 client.15252 populate_metadata read hostname 'smithi163' 2023-07-14T18:12:20.157 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.103+0000 7f2ac6bb4b80 1 --2- 172.21.15.163:0/3813971356 >> [v2:172.21.15.184:6836/3389277679,v1:172.21.15.184:6837/3389277679] conn(0x55d70a13ac80 0x55d70a13a030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:12:20.157 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.103+0000 7f2ac6bb4b80 4 client.15252 mds_command: new command op to 24478 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-14T18:12:20.157 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.103+0000 7f2ac6bb4b80 1 -- 172.21.15.163:0/3813971356 --> [v2:172.21.15.184:6836/3389277679,v1:172.21.15.184:6837/3389277679] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55d70a0f4d50 con 0x55d70a13ac80 2023-07-14T18:12:20.157 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.103+0000 7f2ab37fe700 1 --2- 172.21.15.163:0/3813971356 >> [v2:172.21.15.184:6836/3389277679,v1:172.21.15.184:6837/3389277679] conn(0x55d70a13ac80 0x55d70a13a030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:12:20.158 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.104+0000 7f2a937fe700 10 client.15252 ms_handle_connect on v2:172.21.15.184:6836/3389277679 2023-07-14T18:12:20.158 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.104+0000 7f2ab37fe700 1 --2- 172.21.15.163:0/3813971356 >> [v2:172.21.15.184:6836/3389277679,v1:172.21.15.184:6837/3389277679] conn(0x55d70a13ac80 0x55d70a13a030 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=e95824e18e5dcf2c server_cookie=681642d3faa3804b in_seq=0 out_seq=0 2023-07-14T18:12:20.158 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.104+0000 7f2a937fe700 1 -- 172.21.15.163:0/3813971356 <== mds.3 v2:172.21.15.184:6836/3389277679 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18017 (crc 0 0 0) 0x55d70a0f4d50 con 0x55d70a13ac80 2023-07-14T18:12:20.158 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.104+0000 7f2a937fe700 10 client.15252 handle_command_reply: tid=0 2023-07-14T18:12:20.159 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.104+0000 7f2ac6bb4b80 1 client.15252 shutdown 2023-07-14T18:12:20.159 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.105+0000 7f2ac6bb4b80 1 -- 172.21.15.163:0/3813971356 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55d70a125f10 msgr2=0x55d70a12f950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:12:20.159 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.105+0000 7f2ac6bb4b80 1 --2- 172.21.15.163:0/3813971356 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55d70a125f10 0x55d70a12f950 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f2aa4012930 tx=0x7f2aa40047c0 comp rx=0 tx=0).stop 2023-07-14T18:12:20.159 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.105+0000 7f2ac6bb4b80 1 -- 172.21.15.163:0/3813971356 shutdown_connections 2023-07-14T18:12:20.160 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.105+0000 7f2ac6bb4b80 1 --2- 172.21.15.163:0/3813971356 >> [v2:172.21.15.184:6836/3389277679,v1:172.21.15.184:6837/3389277679] conn(0x55d70a13ac80 0x55d70a13a030 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:20.160 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.105+0000 7f2ac6bb4b80 1 --2- 172.21.15.163:0/3813971356 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55d70a127460 0x55d70a136ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:20.160 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.105+0000 7f2a937fe700 0 client.15252 ms_handle_reset on v2:172.21.15.184:6836/3389277679 2023-07-14T18:12:20.161 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.105+0000 7f2ac6bb4b80 1 --2- 172.21.15.163:0/3813971356 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55d70a125f10 0x55d70a12f950 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:20.161 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.105+0000 7f2ac6bb4b80 1 --2- 172.21.15.163:0/3813971356 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d70a126860 0x55d70a12fe90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:20.161 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.105+0000 7f2ac6bb4b80 1 -- 172.21.15.163:0/3813971356 >> 172.21.15.163:0/3813971356 conn(0x55d70a11b630 msgr2=0x55d70a11f600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:12:20.161 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.105+0000 7f2ac6bb4b80 1 -- 172.21.15.163:0/3813971356 shutdown_connections 2023-07-14T18:12:20.162 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.105+0000 7f2ac6bb4b80 1 -- 172.21.15.163:0/3813971356 wait complete. 2023-07-14T18:12:20.162 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.105+0000 7f2ac6bb4b80 20 client.15252 trim_cache size 0 max 16384 2023-07-14T18:12:20.170 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.122+0000 7f2ac6bb4b80 1 Processor -- start 2023-07-14T18:12:20.170 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.123+0000 7f2ac6bb4b80 1 -- start start 2023-07-14T18:12:20.170 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.123+0000 7f2ac6bb4b80 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55d70a125f10 0x55d70a13a030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:12:20.170 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.123+0000 7f2ac6bb4b80 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55d70a126860 0x55d70a13a570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:12:20.170 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.123+0000 7f2ac6bb4b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d70a127460 0x55d70a136e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:12:20.171 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.123+0000 7f2ac6bb4b80 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d70a130850 con 0x55d70a125f10 2023-07-14T18:12:20.171 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.123+0000 7f2ac6bb4b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d70a0f4d50 con 0x55d70a127460 2023-07-14T18:12:20.171 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.123+0000 7f2ac6bb4b80 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d70a130b40 con 0x55d70a126860 2023-07-14T18:12:20.171 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.123+0000 7f2ab3fff700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55d70a125f10 0x55d70a13a030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:12:20.171 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.123+0000 7f2ab3fff700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55d70a125f10 0x55d70a13a030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:57054/0 (socket says 172.21.15.163:57054) 2023-07-14T18:12:20.171 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.123+0000 7f2ab3fff700 1 -- 172.21.15.163:0/3528588533 learned_addr learned my addr 172.21.15.163:0/3528588533 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:12:20.171 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.123+0000 7f2ab8fb9700 1 --2- 172.21.15.163:0/3528588533 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d70a127460 0x55d70a136e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:12:20.172 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.123+0000 7f2ab37fe700 1 --2- 172.21.15.163:0/3528588533 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55d70a126860 0x55d70a13a570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:12:20.172 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.123+0000 7f2ab3fff700 1 -- 172.21.15.163:0/3528588533 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55d70a126860 msgr2=0x55d70a13a570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:12:20.172 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.123+0000 7f2ab3fff700 1 --2- 172.21.15.163:0/3528588533 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55d70a126860 0x55d70a13a570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:20.172 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.123+0000 7f2ab3fff700 1 -- 172.21.15.163:0/3528588533 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d70a127460 msgr2=0x55d70a136e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:12:20.172 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.123+0000 7f2ab3fff700 1 --2- 172.21.15.163:0/3528588533 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d70a127460 0x55d70a136e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:20.172 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.123+0000 7f2ab3fff700 1 -- 172.21.15.163:0/3528588533 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d709ecb200 con 0x55d70a125f10 2023-07-14T18:12:20.172 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.123+0000 7f2ab3fff700 1 --2- 172.21.15.163:0/3528588533 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55d70a125f10 0x55d70a13a030 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f2aa4012900 tx=0x7f2aa40204d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a27349fcf4324c4f server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:12:20.173 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.123+0000 7f2a9affd700 1 -- 172.21.15.163:0/3528588533 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2aa4009920 con 0x55d70a125f10 2023-07-14T18:12:20.173 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.123+0000 7f2a9affd700 1 -- 172.21.15.163:0/3528588533 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f2aa4024070 con 0x55d70a125f10 2023-07-14T18:12:20.173 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.123+0000 7f2a9affd700 1 -- 172.21.15.163:0/3528588533 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2aa401fb30 con 0x55d70a125f10 2023-07-14T18:12:20.173 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.124+0000 7f2ac6bb4b80 1 -- 172.21.15.163:0/3528588533 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55d70a125f10 msgr2=0x55d70a13a030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:12:20.173 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.124+0000 7f2ac6bb4b80 1 --2- 172.21.15.163:0/3528588533 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55d70a125f10 0x55d70a13a030 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f2aa4012900 tx=0x7f2aa40204d0 comp rx=0 tx=0).stop 2023-07-14T18:12:20.173 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.124+0000 7f2ac6bb4b80 1 -- 172.21.15.163:0/3528588533 shutdown_connections 2023-07-14T18:12:20.173 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.124+0000 7f2ac6bb4b80 1 --2- 172.21.15.163:0/3528588533 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d70a127460 0x55d70a136e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:20.174 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.124+0000 7f2ac6bb4b80 1 --2- 172.21.15.163:0/3528588533 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55d70a125f10 0x55d70a13a030 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:20.174 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.124+0000 7f2ac6bb4b80 1 --2- 172.21.15.163:0/3528588533 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55d70a126860 0x55d70a13a570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:20.174 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.124+0000 7f2ac6bb4b80 1 -- 172.21.15.163:0/3528588533 >> 172.21.15.163:0/3528588533 conn(0x55d70a11b630 msgr2=0x55d70a12d7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:12:20.174 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.124+0000 7f2ac6bb4b80 1 -- 172.21.15.163:0/3528588533 shutdown_connections 2023-07-14T18:12:20.174 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.124+0000 7f2ac6bb4b80 1 -- 172.21.15.163:0/3528588533 wait complete. 2023-07-14T18:12:20.174 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.124+0000 7f2ac6bb4b80 1 -- start start 2023-07-14T18:12:20.174 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.125+0000 7f2ac6bb4b80 1 Processor -- start 2023-07-14T18:12:20.175 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.125+0000 7f2ac6bb4b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d70a125f10 0x55d70a134de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:12:20.175 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.125+0000 7f2ac6bb4b80 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55d70a126860 0x55d70a18c8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:12:20.175 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.125+0000 7f2ac6bb4b80 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55d70a127460 0x55d70a18ee20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:12:20.175 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.125+0000 7f2ac6bb4b80 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d70a18f440 con 0x55d70a127460 2023-07-14T18:12:20.175 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.125+0000 7f2ac6bb4b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d70a18f5b0 con 0x55d70a125f10 2023-07-14T18:12:20.175 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.125+0000 7f2ac6bb4b80 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d70a18f770 con 0x55d70a126860 2023-07-14T18:12:20.175 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.125+0000 7f2ac6bb4b80 10 client.0 _ll_register_callbacks cb 0x7f2aa4012450 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T18:12:20.176 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.125+0000 7f2ab8fb9700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55d70a127460 0x55d70a18ee20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:12:20.176 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.125+0000 7f2ab8fb9700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55d70a127460 0x55d70a18ee20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:57064/0 (socket says 172.21.15.163:57064) 2023-07-14T18:12:20.176 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.125+0000 7f2ab8fb9700 1 -- 172.21.15.163:0/2786278562 learned_addr learned my addr 172.21.15.163:0/2786278562 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:12:20.176 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.125+0000 7f2ab3fff700 1 --2- 172.21.15.163:0/2786278562 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d70a125f10 0x55d70a134de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:12:20.176 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.125+0000 7f2ab37fe700 1 --2- 172.21.15.163:0/2786278562 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55d70a126860 0x55d70a18c8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:12:20.176 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.125+0000 7f2ab8fb9700 1 -- 172.21.15.163:0/2786278562 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55d70a126860 msgr2=0x55d70a18c8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:12:20.176 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.125+0000 7f2ab8fb9700 1 --2- 172.21.15.163:0/2786278562 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55d70a126860 0x55d70a18c8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:20.176 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.125+0000 7f2ab8fb9700 1 -- 172.21.15.163:0/2786278562 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d70a125f10 msgr2=0x55d70a134de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:12:20.177 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.125+0000 7f2ab8fb9700 1 --2- 172.21.15.163:0/2786278562 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d70a125f10 0x55d70a134de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:20.177 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.125+0000 7f2ab8fb9700 1 -- 172.21.15.163:0/2786278562 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55d709e8dc10 con 0x55d70a127460 2023-07-14T18:12:20.177 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.125+0000 7f2ab8fb9700 1 --2- 172.21.15.163:0/2786278562 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55d70a127460 0x55d70a18ee20 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f2aac009f40 tx=0x7f2aac0a1d70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b45c07cd3ab61d3 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:12:20.177 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.125+0000 7f2a937fe700 10 client.0 ms_handle_connect on v2:172.21.15.163:3300/0 2023-07-14T18:12:20.177 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.126+0000 7f2a937fe700 1 -- 172.21.15.163:0/2786278562 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2aac099430 con 0x55d70a127460 2023-07-14T18:12:20.177 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.126+0000 7f2a937fe700 1 -- 172.21.15.163:0/2786278562 <== mon.0 v2:172.21.15.163:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 9020+0+0 (secure 0 0 0) 0x7f2aac097c90 con 0x55d70a127460 2023-07-14T18:12:20.177 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.126+0000 7f2ac6bb4b80 1 -- 172.21.15.163:0/2786278562 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f2aac084040 con 0x55d70a127460 2023-07-14T18:12:20.178 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.126+0000 7f2a937fe700 1 -- 172.21.15.163:0/2786278562 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2aac0ca1b0 con 0x55d70a127460 2023-07-14T18:12:20.178 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.126+0000 7f2ac6bb4b80 10 client.15258 fetch_fsmap learned FSMap version 28 2023-07-14T18:12:20.178 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.126+0000 7f2ac6bb4b80 1 -- 172.21.15.163:0/2786278562 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) v3 -- 0x55d709ea3260 con 0x55d70a127460 2023-07-14T18:12:20.178 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.126+0000 7f2a937fe700 1 -- 172.21.15.163:0/2786278562 <== mon.0 v2:172.21.15.163:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f2aac084040 con 0x55d70a127460 2023-07-14T18:12:20.178 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.126+0000 7f2a937fe700 1 -- 172.21.15.163:0/2786278562 <== mon.0 v2:172.21.15.163:3300/0 5 ==== fsmap(e 28) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f2aac0b9080 con 0x55d70a127460 2023-07-14T18:12:20.178 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.126+0000 7f2ac6bb4b80 10 client.15258 fetch_fsmap finished waiting for FSMap version 28 2023-07-14T18:12:20.178 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.126+0000 7f2ac6bb4b80 10 client.15258 resolve_mds: resolved name 'c' to daemon mds.c 2023-07-14T18:12:20.179 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.126+0000 7f2ac6bb4b80 20 client.15258 populate_metadata read hostname 'smithi163' 2023-07-14T18:12:20.179 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.126+0000 7f2ac6bb4b80 1 --2- 172.21.15.163:0/2786278562 >> [v2:172.21.15.184:6836/3389277679,v1:172.21.15.184:6837/3389277679] conn(0x55d70a13ac80 0x55d70a190b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:12:20.179 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.126+0000 7f2ac6bb4b80 4 client.15258 mds_command: new command op to 24478 tid=0[{"prefix": "status"}] 2023-07-14T18:12:20.179 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.126+0000 7f2ac6bb4b80 1 -- 172.21.15.163:0/2786278562 --> [v2:172.21.15.184:6836/3389277679,v1:172.21.15.184:6837/3389277679] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55d70a06fe60 con 0x55d70a13ac80 2023-07-14T18:12:20.179 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.126+0000 7f2ab3fff700 1 --2- 172.21.15.163:0/2786278562 >> [v2:172.21.15.184:6836/3389277679,v1:172.21.15.184:6837/3389277679] conn(0x55d70a13ac80 0x55d70a190b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:12:20.179 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.127+0000 7f2a937fe700 10 client.15258 ms_handle_connect on v2:172.21.15.184:6836/3389277679 2023-07-14T18:12:20.179 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.127+0000 7f2ab3fff700 1 --2- 172.21.15.163:0/2786278562 >> [v2:172.21.15.184:6836/3389277679,v1:172.21.15.184:6837/3389277679] conn(0x55d70a13ac80 0x55d70a190b60 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=4ab28a56f46b6c8 server_cookie=b5c254507b545866 in_seq=0 out_seq=0 2023-07-14T18:12:20.179 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.127+0000 7f2a937fe700 1 -- 172.21.15.163:0/2786278562 <== mds.3 v2:172.21.15.184:6836/3389277679 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+332 (crc 0 0 0) 0x55d70a06fe60 con 0x55d70a13ac80 2023-07-14T18:12:20.180 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.127+0000 7f2a937fe700 10 client.15258 handle_command_reply: tid=0 2023-07-14T18:12:20.180 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.127+0000 7f2ac6bb4b80 1 client.15258 shutdown 2023-07-14T18:12:20.180 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.127+0000 7f2ac6bb4b80 1 -- 172.21.15.163:0/2786278562 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55d70a127460 msgr2=0x55d70a18ee20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:12:20.180 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.127+0000 7f2ac6bb4b80 1 --2- 172.21.15.163:0/2786278562 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55d70a127460 0x55d70a18ee20 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f2aac009f40 tx=0x7f2aac0a1d70 comp rx=0 tx=0).stop 2023-07-14T18:12:20.180 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.127+0000 7f2ac6bb4b80 1 -- 172.21.15.163:0/2786278562 shutdown_connections 2023-07-14T18:12:20.180 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.127+0000 7f2ac6bb4b80 1 --2- 172.21.15.163:0/2786278562 >> [v2:172.21.15.184:6836/3389277679,v1:172.21.15.184:6837/3389277679] conn(0x55d70a13ac80 0x55d70a190b60 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:20.180 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.127+0000 7f2ac6bb4b80 1 --2- 172.21.15.163:0/2786278562 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55d70a127460 0x55d70a18ee20 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:20.181 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.127+0000 7f2a937fe700 0 client.15258 ms_handle_reset on v2:172.21.15.184:6836/3389277679 2023-07-14T18:12:20.181 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.127+0000 7f2ac6bb4b80 1 --2- 172.21.15.163:0/2786278562 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d70a125f10 0x55d70a134de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:20.181 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.127+0000 7f2ac6bb4b80 1 --2- 172.21.15.163:0/2786278562 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55d70a126860 0x55d70a18c8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:20.181 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.127+0000 7f2ac6bb4b80 1 -- 172.21.15.163:0/2786278562 >> 172.21.15.163:0/2786278562 conn(0x55d70a11b630 msgr2=0x55d70a12a320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:12:20.181 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.127+0000 7f2ac6bb4b80 1 -- 172.21.15.163:0/2786278562 shutdown_connections 2023-07-14T18:12:20.181 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.127+0000 7f2ac6bb4b80 1 -- 172.21.15.163:0/2786278562 wait complete. 2023-07-14T18:12:20.181 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.127+0000 7f2ac6bb4b80 20 client.15258 trim_cache size 0 max 16384 2023-07-14T18:12:20.182 INFO:teuthology.orchestra.run.smithi163.stdout:{ 2023-07-14T18:12:20.182 INFO:teuthology.orchestra.run.smithi163.stdout: "cluster_fsid": "bf7326ec-2270-11ee-9b33-001a4aab830c", 2023-07-14T18:12:20.182 INFO:teuthology.orchestra.run.smithi163.stdout: "whoami": 3, 2023-07-14T18:12:20.182 INFO:teuthology.orchestra.run.smithi163.stdout: "id": 24478, 2023-07-14T18:12:20.182 INFO:teuthology.orchestra.run.smithi163.stdout: "want_state": "up:active", 2023-07-14T18:12:20.182 INFO:teuthology.orchestra.run.smithi163.stdout: "state": "up:active", 2023-07-14T18:12:20.183 INFO:teuthology.orchestra.run.smithi163.stdout: "fs_name": "cephfs", 2023-07-14T18:12:20.183 INFO:teuthology.orchestra.run.smithi163.stdout: "rank_uptime": 50.299236053000001, 2023-07-14T18:12:20.183 INFO:teuthology.orchestra.run.smithi163.stdout: "mdsmap_epoch": 28, 2023-07-14T18:12:20.183 INFO:teuthology.orchestra.run.smithi163.stdout: "osdmap_epoch": 86, 2023-07-14T18:12:20.183 INFO:teuthology.orchestra.run.smithi163.stdout: "osdmap_epoch_barrier": 84, 2023-07-14T18:12:20.183 INFO:teuthology.orchestra.run.smithi163.stdout: "uptime": 87.556557337000001 2023-07-14T18:12:20.183 INFO:teuthology.orchestra.run.smithi163.stdout:} 2023-07-14T18:12:20.184 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.128+0000 7f2abaa1c700 1 -- 172.21.15.163:0/1442165454 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f2a9c0a11e0 msgr2=0x7f2a9c0a3690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:12:20.184 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.128+0000 7f2abaa1c700 1 --2- 172.21.15.163:0/1442165454 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f2a9c0a11e0 0x7f2a9c0a3690 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f2ab4100c70 tx=0x7f2aa4009260 comp rx=0 tx=0).stop 2023-07-14T18:12:20.185 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.128+0000 7f2abaa1c700 1 -- 172.21.15.163:0/1442165454 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f2ab41017a0 msgr2=0x7f2ab419ce30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:12:20.185 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.128+0000 7f2abaa1c700 1 --2- 172.21.15.163:0/1442165454 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f2ab41017a0 0x7f2ab419ce30 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f2aac00ef30 tx=0x7f2aac00c3a0 comp rx=0 tx=0).stop 2023-07-14T18:12:20.185 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.128+0000 7f2abaa1c700 1 -- 172.21.15.163:0/1442165454 shutdown_connections 2023-07-14T18:12:20.185 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.128+0000 7f2abaa1c700 1 --2- 172.21.15.163:0/1442165454 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f2a9c0a11e0 0x7f2a9c0a3690 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:20.185 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.128+0000 7f2abaa1c700 1 --2- 172.21.15.163:0/1442165454 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f2ab41017a0 0x7f2ab419ce30 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:20.185 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.128+0000 7f2abaa1c700 1 --2- 172.21.15.163:0/1442165454 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2ab40ffc20 0x7f2ab4195880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:20.185 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.128+0000 7f2abaa1c700 1 --2- 172.21.15.163:0/1442165454 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2ab4100e10 0x7f2ab4195dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:20.186 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.128+0000 7f2abaa1c700 1 -- 172.21.15.163:0/1442165454 >> 172.21.15.163:0/1442165454 conn(0x7f2ab40fb260 msgr2=0x7f2ab40fd520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:12:20.186 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.128+0000 7f2abaa1c700 1 -- 172.21.15.163:0/1442165454 shutdown_connections 2023-07-14T18:12:20.186 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.128+0000 7f2abaa1c700 1 -- 172.21.15.163:0/1442165454 wait complete. 2023-07-14T18:12:20.186 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:12:19 smithi163 ceph-mon[96576]: from='client.? 172.21.15.163:0/816737012' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-07-14T18:12:20.187 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:12:19 smithi163 ceph-mon[96576]: from='client.? 172.21.15.163:0/120120817' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-07-14T18:12:20.187 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:12:19 smithi163 ceph-mon[96576]: from='client.? 172.21.15.163:0/3639579266' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-07-14T18:12:20.188 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.h status 2023-07-14T18:12:20.188 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:12:19 smithi184 ceph-mon[98481]: from='client.? 172.21.15.163:0/816737012' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-07-14T18:12:20.189 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:12:19 smithi184 ceph-mon[98481]: from='client.? 172.21.15.163:0/120120817' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-07-14T18:12:20.189 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:12:19 smithi184 ceph-mon[98481]: from='client.? 172.21.15.163:0/3639579266' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-07-14T18:12:20.275 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:12:19 smithi172 ceph-mon[97983]: from='client.? 172.21.15.163:0/816737012' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-07-14T18:12:20.276 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:12:19 smithi172 ceph-mon[97983]: from='client.? 172.21.15.163:0/120120817' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-07-14T18:12:20.276 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:12:19 smithi172 ceph-mon[97983]: from='client.? 172.21.15.163:0/3639579266' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-07-14T18:12:20.311 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.270+0000 7facfdbe8700 1 -- 172.21.15.163:0/1617552609 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7facf80ffd60 msgr2=0x7facf81001b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:12:20.312 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.270+0000 7facfdbe8700 1 --2- 172.21.15.163:0/1617552609 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7facf80ffd60 0x7facf81001b0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7facec009990 tx=0x7facec009ca0 comp rx=0 tx=0).stop 2023-07-14T18:12:20.312 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.270+0000 7facfdbe8700 1 -- 172.21.15.163:0/1617552609 shutdown_connections 2023-07-14T18:12:20.312 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.270+0000 7facfdbe8700 1 --2- 172.21.15.163:0/1617552609 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7facf80feb70 0x7facf80fef80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:20.312 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.270+0000 7facfdbe8700 1 --2- 172.21.15.163:0/1617552609 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7facf81006f0 0x7facf8106fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:20.312 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.270+0000 7facfdbe8700 1 --2- 172.21.15.163:0/1617552609 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7facf80ffd60 0x7facf81001b0 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:20.312 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.270+0000 7facfdbe8700 1 -- 172.21.15.163:0/1617552609 >> 172.21.15.163:0/1617552609 conn(0x7facf80fa190 msgr2=0x7facf80fc5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:12:20.313 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.270+0000 7facfdbe8700 1 -- 172.21.15.163:0/1617552609 shutdown_connections 2023-07-14T18:12:20.313 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.270+0000 7facfdbe8700 1 -- 172.21.15.163:0/1617552609 wait complete. 2023-07-14T18:12:20.314 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.271+0000 7facfdbe8700 1 Processor -- start 2023-07-14T18:12:20.315 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.271+0000 7facfdbe8700 1 -- start start 2023-07-14T18:12:20.315 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.271+0000 7facfdbe8700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7facf80feb70 0x7facf8069500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:12:20.315 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.271+0000 7facfdbe8700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7facf80ffd60 0x7facf819a5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:12:20.315 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.271+0000 7facfdbe8700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7facf81006f0 0x7facf819cc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:12:20.315 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.271+0000 7facfdbe8700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7facf819d410 con 0x7facf81006f0 2023-07-14T18:12:20.315 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.271+0000 7facfdbe8700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7facf819d580 con 0x7facf80ffd60 2023-07-14T18:12:20.315 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.271+0000 7facfdbe8700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7facf819d740 con 0x7facf80feb70 2023-07-14T18:12:20.315 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.271+0000 7facf7fff700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7facf81006f0 0x7facf819cc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:12:20.316 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.271+0000 7facf7fff700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7facf81006f0 0x7facf819cc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:57078/0 (socket says 172.21.15.163:57078) 2023-07-14T18:12:20.316 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.271+0000 7facf7fff700 1 -- 172.21.15.163:0/2102822571 learned_addr learned my addr 172.21.15.163:0/2102822571 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:12:20.316 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.271+0000 7facf77fe700 1 --2- 172.21.15.163:0/2102822571 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7facf80feb70 0x7facf8069500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:12:20.316 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.272+0000 7facf6ffd700 1 --2- 172.21.15.163:0/2102822571 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7facf80ffd60 0x7facf819a5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:12:20.316 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.272+0000 7facf7fff700 1 -- 172.21.15.163:0/2102822571 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7facf80feb70 msgr2=0x7facf8069500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:12:20.316 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.272+0000 7facf7fff700 1 --2- 172.21.15.163:0/2102822571 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7facf80feb70 0x7facf8069500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:20.316 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.272+0000 7facf7fff700 1 -- 172.21.15.163:0/2102822571 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7facf80ffd60 msgr2=0x7facf819a5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:12:20.317 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.272+0000 7facf7fff700 1 --2- 172.21.15.163:0/2102822571 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7facf80ffd60 0x7facf819a5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:20.317 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.272+0000 7facf7fff700 1 -- 172.21.15.163:0/2102822571 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7facec0095f0 con 0x7facf81006f0 2023-07-14T18:12:20.317 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.272+0000 7facf7fff700 1 --2- 172.21.15.163:0/2102822571 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7facf81006f0 0x7facf819cc40 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7facf000ef30 tx=0x7facf000c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:12:20.317 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.272+0000 7facf4ff9700 1 -- 172.21.15.163:0/2102822571 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facf0018070 con 0x7facf81006f0 2023-07-14T18:12:20.317 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.272+0000 7facf4ff9700 1 -- 172.21.15.163:0/2102822571 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7facf000f040 con 0x7facf81006f0 2023-07-14T18:12:20.317 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.272+0000 7facfdbe8700 1 -- 172.21.15.163:0/2102822571 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7facf819d9c0 con 0x7facf81006f0 2023-07-14T18:12:20.317 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.272+0000 7facf4ff9700 1 -- 172.21.15.163:0/2102822571 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facf000cc70 con 0x7facf81006f0 2023-07-14T18:12:20.317 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.272+0000 7facfdbe8700 1 -- 172.21.15.163:0/2102822571 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7facf819ded0 con 0x7facf81006f0 2023-07-14T18:12:20.321 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.274+0000 7facf4ff9700 1 -- 172.21.15.163:0/2102822571 <== mon.0 v2:172.21.15.163:3300/0 4 ==== mgrmap(e 17) v1 ==== 135767+0+0 (secure 0 0 0) 0x7facf0007500 con 0x7facf81006f0 2023-07-14T18:12:20.321 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.275+0000 7facf4ff9700 1 --2- 172.21.15.163:0/2102822571 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7face00a1260 0x7face00a3710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:12:20.322 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.275+0000 7facf77fe700 1 --2- 172.21.15.163:0/2102822571 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7face00a1260 0x7face00a3710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:12:20.322 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.275+0000 7facf4ff9700 1 -- 172.21.15.163:0/2102822571 <== mon.0 v2:172.21.15.163:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 9020+0+0 (secure 0 0 0) 0x7facf00cc8a0 con 0x7facf81006f0 2023-07-14T18:12:20.322 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.276+0000 7facf77fe700 1 --2- 172.21.15.163:0/2102822571 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7face00a1260 0x7face00a3710 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7facf80ffbc0 tx=0x7face8009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:12:20.322 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.276+0000 7fad09d80b80 1 Processor -- start 2023-07-14T18:12:20.322 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.276+0000 7fad09d80b80 1 -- start start 2023-07-14T18:12:20.322 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.276+0000 7fad09d80b80 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55718c411f10 0x55718c412320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:12:20.322 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.276+0000 7fad09d80b80 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55718c412860 0x55718c412e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:12:20.322 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.276+0000 7fad09d80b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55718c413460 0x55718c4138d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:12:20.323 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.276+0000 7fad09d80b80 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x55718c316c60 con 0x55718c411f10 2023-07-14T18:12:20.323 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.276+0000 7fad09d80b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x55718c3699f0 con 0x55718c413460 2023-07-14T18:12:20.323 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.276+0000 7fad09d80b80 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x55718c362e80 con 0x55718c412860 2023-07-14T18:12:20.323 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.276+0000 7facf77fe700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55718c411f10 0x55718c412320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:12:20.323 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.276+0000 7facf77fe700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55718c411f10 0x55718c412320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:57082/0 (socket says 172.21.15.163:57082) 2023-07-14T18:12:20.323 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.276+0000 7facf77fe700 1 -- 172.21.15.163:0/585179389 learned_addr learned my addr 172.21.15.163:0/585179389 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:12:20.323 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.277+0000 7facf7fff700 1 --2- 172.21.15.163:0/585179389 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55718c413460 0x55718c4138d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:12:20.324 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.277+0000 7facf6ffd700 1 --2- 172.21.15.163:0/585179389 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55718c412860 0x55718c412e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:12:20.324 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.277+0000 7facf77fe700 1 -- 172.21.15.163:0/585179389 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55718c412860 msgr2=0x55718c412e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:12:20.324 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.277+0000 7facf77fe700 1 --2- 172.21.15.163:0/585179389 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55718c412860 0x55718c412e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:20.324 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.277+0000 7facf77fe700 1 -- 172.21.15.163:0/585179389 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55718c413460 msgr2=0x55718c4138d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:12:20.324 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.277+0000 7facf77fe700 1 --2- 172.21.15.163:0/585179389 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55718c413460 0x55718c4138d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:20.324 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.277+0000 7facf77fe700 1 -- 172.21.15.163:0/585179389 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55718c190d90 con 0x55718c411f10 2023-07-14T18:12:20.324 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.277+0000 7facf77fe700 1 --2- 172.21.15.163:0/585179389 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55718c411f10 0x55718c412320 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7face8011d50 tx=0x7face8014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=991aacc86822f40c server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:12:20.324 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.277+0000 7facddffb700 1 -- 172.21.15.163:0/585179389 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7face800edd0 con 0x55718c411f10 2023-07-14T18:12:20.325 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.277+0000 7facddffb700 1 -- 172.21.15.163:0/585179389 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7face8021070 con 0x55718c411f10 2023-07-14T18:12:20.325 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.277+0000 7facddffb700 1 -- 172.21.15.163:0/585179389 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7face801d670 con 0x55718c411f10 2023-07-14T18:12:20.325 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.278+0000 7fad09d80b80 1 -- 172.21.15.163:0/585179389 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55718c411f10 msgr2=0x55718c412320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:12:20.325 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.278+0000 7fad09d80b80 1 --2- 172.21.15.163:0/585179389 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55718c411f10 0x55718c412320 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7face8011d50 tx=0x7face8014000 comp rx=0 tx=0).stop 2023-07-14T18:12:20.325 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.278+0000 7fad09d80b80 1 -- 172.21.15.163:0/585179389 shutdown_connections 2023-07-14T18:12:20.325 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.278+0000 7fad09d80b80 1 --2- 172.21.15.163:0/585179389 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55718c413460 0x55718c4138d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:20.325 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.278+0000 7fad09d80b80 1 --2- 172.21.15.163:0/585179389 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55718c411f10 0x55718c412320 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:20.326 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.278+0000 7fad09d80b80 1 --2- 172.21.15.163:0/585179389 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55718c412860 0x55718c412e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:20.326 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.278+0000 7fad09d80b80 1 -- 172.21.15.163:0/585179389 >> 172.21.15.163:0/585179389 conn(0x55718c407630 msgr2=0x55718c40c980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:12:20.326 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.278+0000 7fad09d80b80 1 -- 172.21.15.163:0/585179389 shutdown_connections 2023-07-14T18:12:20.326 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.278+0000 7fad09d80b80 1 -- 172.21.15.163:0/585179389 wait complete. 2023-07-14T18:12:20.326 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.278+0000 7fad09d80b80 1 -- start start 2023-07-14T18:12:20.326 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.278+0000 7fad09d80b80 1 Processor -- start 2023-07-14T18:12:20.326 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.278+0000 7fad09d80b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55718c411f10 0x55718c41b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:12:20.326 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.278+0000 7fad09d80b80 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55718c412860 0x55718c41bdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:12:20.327 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.278+0000 7fad09d80b80 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55718c413460 0x55718c422e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:12:20.327 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.278+0000 7fad09d80b80 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x55718c302a70 con 0x55718c413460 2023-07-14T18:12:20.327 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.278+0000 7fad09d80b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x55718c302770 con 0x55718c411f10 2023-07-14T18:12:20.327 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.278+0000 7fad09d80b80 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x55718c1e68d0 con 0x55718c412860 2023-07-14T18:12:20.327 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.279+0000 7fad09d80b80 10 client.0 _ll_register_callbacks cb 0x55718c300710 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T18:12:20.327 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.279+0000 7facf7fff700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55718c413460 0x55718c422e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:12:20.327 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.279+0000 7facf7fff700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55718c413460 0x55718c422e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:57092/0 (socket says 172.21.15.163:57092) 2023-07-14T18:12:20.327 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.279+0000 7facf7fff700 1 -- 172.21.15.163:0/453515182 learned_addr learned my addr 172.21.15.163:0/453515182 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:12:20.328 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.279+0000 7facf6ffd700 1 --2- 172.21.15.163:0/453515182 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55718c412860 0x55718c41bdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:12:20.328 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.279+0000 7facf77fe700 1 --2- 172.21.15.163:0/453515182 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55718c411f10 0x55718c41b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:12:20.328 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.279+0000 7facf7fff700 1 -- 172.21.15.163:0/453515182 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55718c412860 msgr2=0x55718c41bdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:12:20.328 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.279+0000 7facf7fff700 1 --2- 172.21.15.163:0/453515182 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55718c412860 0x55718c41bdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:20.328 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.279+0000 7facf7fff700 1 -- 172.21.15.163:0/453515182 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55718c411f10 msgr2=0x55718c41b8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:12:20.328 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.279+0000 7facf7fff700 1 --2- 172.21.15.163:0/453515182 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55718c411f10 0x55718c41b8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:20.328 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.279+0000 7facf7fff700 1 -- 172.21.15.163:0/453515182 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7face8017070 con 0x55718c413460 2023-07-14T18:12:20.329 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.279+0000 7facf7fff700 1 --2- 172.21.15.163:0/453515182 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55718c413460 0x55718c422e30 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7facf00995d0 tx=0x7facf0099e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b31bc5e77c4f7054 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:12:20.329 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.279+0000 7facd6ffd700 10 client.0 ms_handle_connect on v2:172.21.15.163:3300/0 2023-07-14T18:12:20.329 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.279+0000 7facd6ffd700 1 -- 172.21.15.163:0/453515182 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facf00ca190 con 0x55718c413460 2023-07-14T18:12:20.329 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.279+0000 7facd6ffd700 1 -- 172.21.15.163:0/453515182 <== mon.0 v2:172.21.15.163:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 9020+0+0 (secure 0 0 0) 0x7facf00a1800 con 0x55718c413460 2023-07-14T18:12:20.329 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.279+0000 7fad09d80b80 1 -- 172.21.15.163:0/453515182 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55718c2bc4a0 con 0x55718c413460 2023-07-14T18:12:20.329 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.279+0000 7facd6ffd700 1 -- 172.21.15.163:0/453515182 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7facf00a19c0 con 0x55718c413460 2023-07-14T18:12:20.329 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.279+0000 7fad09d80b80 10 client.15270 fetch_fsmap learned FSMap version 28 2023-07-14T18:12:20.329 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.279+0000 7fad09d80b80 1 -- 172.21.15.163:0/453515182 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) v3 -- 0x55718c179c10 con 0x55718c413460 2023-07-14T18:12:20.330 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.279+0000 7facd6ffd700 1 -- 172.21.15.163:0/453515182 <== mon.0 v2:172.21.15.163:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55718c2bc4a0 con 0x55718c413460 2023-07-14T18:12:20.330 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.280+0000 7facd6ffd700 1 -- 172.21.15.163:0/453515182 <== mon.0 v2:172.21.15.163:3300/0 5 ==== fsmap(e 28) v1 ==== 7470+0+0 (secure 0 0 0) 0x7facf00956c0 con 0x55718c413460 2023-07-14T18:12:20.330 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.280+0000 7fad09d80b80 10 client.15270 fetch_fsmap finished waiting for FSMap version 28 2023-07-14T18:12:20.330 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.280+0000 7fad09d80b80 10 client.15270 resolve_mds: resolved name 'h' to daemon mds.h 2023-07-14T18:12:20.330 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.280+0000 7fad09d80b80 20 client.15270 populate_metadata read hostname 'smithi163' 2023-07-14T18:12:20.330 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.280+0000 7fad09d80b80 1 --2- 172.21.15.163:0/453515182 >> [v2:172.21.15.172:6836/3783835012,v1:172.21.15.172:6837/3783835012] conn(0x55718c426b50 0x55718c425fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:12:20.330 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.280+0000 7fad09d80b80 4 client.15270 mds_command: new command op to 24479 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-14T18:12:20.330 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.280+0000 7fad09d80b80 1 -- 172.21.15.163:0/453515182 --> [v2:172.21.15.172:6836/3783835012,v1:172.21.15.172:6837/3783835012] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55718c3e0d50 con 0x55718c426b50 2023-07-14T18:12:20.331 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.280+0000 7facf77fe700 1 --2- 172.21.15.163:0/453515182 >> [v2:172.21.15.172:6836/3783835012,v1:172.21.15.172:6837/3783835012] conn(0x55718c426b50 0x55718c425fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:12:20.331 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.280+0000 7facd6ffd700 10 client.15270 ms_handle_connect on v2:172.21.15.172:6836/3783835012 2023-07-14T18:12:20.331 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.280+0000 7facf77fe700 1 --2- 172.21.15.163:0/453515182 >> [v2:172.21.15.172:6836/3783835012,v1:172.21.15.172:6837/3783835012] conn(0x55718c426b50 0x55718c425fe0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=25af37198dd8a3d3 server_cookie=6b38719ce075e49c in_seq=0 out_seq=0 2023-07-14T18:12:20.332 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.281+0000 7facd6ffd700 1 -- 172.21.15.163:0/453515182 <== mds.2 v2:172.21.15.172:6836/3783835012 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18017 (crc 0 0 0) 0x55718c3e0d50 con 0x55718c426b50 2023-07-14T18:12:20.332 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.281+0000 7facd6ffd700 10 client.15270 handle_command_reply: tid=0 2023-07-14T18:12:20.332 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.281+0000 7fad09d80b80 1 client.15270 shutdown 2023-07-14T18:12:20.332 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.282+0000 7fad09d80b80 1 -- 172.21.15.163:0/453515182 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55718c413460 msgr2=0x55718c422e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:12:20.332 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.282+0000 7fad09d80b80 1 --2- 172.21.15.163:0/453515182 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55718c413460 0x55718c422e30 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7facf00995d0 tx=0x7facf0099e10 comp rx=0 tx=0).stop 2023-07-14T18:12:20.333 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.282+0000 7fad09d80b80 1 -- 172.21.15.163:0/453515182 shutdown_connections 2023-07-14T18:12:20.333 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.282+0000 7fad09d80b80 1 --2- 172.21.15.163:0/453515182 >> [v2:172.21.15.172:6836/3783835012,v1:172.21.15.172:6837/3783835012] conn(0x55718c426b50 0x55718c425fe0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:20.333 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.282+0000 7fad09d80b80 1 --2- 172.21.15.163:0/453515182 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55718c413460 0x55718c422e30 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:20.333 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.282+0000 7fad09d80b80 1 --2- 172.21.15.163:0/453515182 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55718c411f10 0x55718c41b8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:20.333 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.282+0000 7facd6ffd700 0 client.15270 ms_handle_reset on v2:172.21.15.172:6836/3783835012 2023-07-14T18:12:20.333 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.282+0000 7fad09d80b80 1 --2- 172.21.15.163:0/453515182 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55718c412860 0x55718c41bdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:20.333 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.282+0000 7fad09d80b80 1 -- 172.21.15.163:0/453515182 >> 172.21.15.163:0/453515182 conn(0x55718c407630 msgr2=0x55718c40b600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:12:20.334 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.282+0000 7fad09d80b80 1 -- 172.21.15.163:0/453515182 shutdown_connections 2023-07-14T18:12:20.334 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.282+0000 7fad09d80b80 1 -- 172.21.15.163:0/453515182 wait complete. 2023-07-14T18:12:20.334 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.282+0000 7fad09d80b80 20 client.15270 trim_cache size 0 max 16384 2023-07-14T18:12:20.341 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.299+0000 7fad09d80b80 1 Processor -- start 2023-07-14T18:12:20.341 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.299+0000 7fad09d80b80 1 -- start start 2023-07-14T18:12:20.342 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.299+0000 7fad09d80b80 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55718c411f10 0x55718c419750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:12:20.342 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.299+0000 7fad09d80b80 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55718c412860 0x55718c419c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:12:20.342 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.299+0000 7fad09d80b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55718c413460 0x55718c422df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:12:20.342 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.299+0000 7fad09d80b80 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x55718c2bc4a0 con 0x55718c411f10 2023-07-14T18:12:20.342 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.299+0000 7fad09d80b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x55718c331790 con 0x55718c413460 2023-07-14T18:12:20.342 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.299+0000 7fad09d80b80 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x55718c1f2de0 con 0x55718c412860 2023-07-14T18:12:20.342 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.300+0000 7facf77fe700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55718c411f10 0x55718c419750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:12:20.343 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.300+0000 7facf77fe700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55718c411f10 0x55718c419750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:57098/0 (socket says 172.21.15.163:57098) 2023-07-14T18:12:20.343 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.300+0000 7facf77fe700 1 -- 172.21.15.163:0/1464191295 learned_addr learned my addr 172.21.15.163:0/1464191295 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:12:20.343 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.300+0000 7facf7fff700 1 --2- 172.21.15.163:0/1464191295 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55718c413460 0x55718c422df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:12:20.343 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.300+0000 7facf6ffd700 1 --2- 172.21.15.163:0/1464191295 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55718c412860 0x55718c419c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:12:20.343 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.300+0000 7facf77fe700 1 -- 172.21.15.163:0/1464191295 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55718c412860 msgr2=0x55718c419c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:12:20.343 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.300+0000 7facf77fe700 1 --2- 172.21.15.163:0/1464191295 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55718c412860 0x55718c419c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:20.343 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.300+0000 7facf77fe700 1 -- 172.21.15.163:0/1464191295 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55718c413460 msgr2=0x55718c422df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:12:20.343 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.300+0000 7facf77fe700 1 --2- 172.21.15.163:0/1464191295 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55718c413460 0x55718c422df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:20.344 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.300+0000 7facf77fe700 1 -- 172.21.15.163:0/1464191295 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55718c1b7200 con 0x55718c411f10 2023-07-14T18:12:20.344 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.300+0000 7facf6ffd700 1 --2- 172.21.15.163:0/1464191295 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55718c412860 0x55718c419c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T18:12:20.344 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.300+0000 7facf77fe700 1 --2- 172.21.15.163:0/1464191295 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55718c411f10 0x55718c419750 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7face8011d20 tx=0x7face800ebd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5eaef65ee6a73c2e server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:12:20.344 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.300+0000 7facde7fc700 1 -- 172.21.15.163:0/1464191295 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7face8036070 con 0x55718c411f10 2023-07-14T18:12:20.344 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.300+0000 7facde7fc700 1 -- 172.21.15.163:0/1464191295 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7face8032960 con 0x55718c411f10 2023-07-14T18:12:20.344 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.300+0000 7facde7fc700 1 -- 172.21.15.163:0/1464191295 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7face8004280 con 0x55718c411f10 2023-07-14T18:12:20.347 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.301+0000 7fad09d80b80 1 -- 172.21.15.163:0/1464191295 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55718c411f10 msgr2=0x55718c419750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:12:20.347 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.301+0000 7fad09d80b80 1 --2- 172.21.15.163:0/1464191295 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55718c411f10 0x55718c419750 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7face8011d20 tx=0x7face800ebd0 comp rx=0 tx=0).stop 2023-07-14T18:12:20.348 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.301+0000 7fad09d80b80 1 -- 172.21.15.163:0/1464191295 shutdown_connections 2023-07-14T18:12:20.348 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.301+0000 7fad09d80b80 1 --2- 172.21.15.163:0/1464191295 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55718c413460 0x55718c422df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:20.348 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.301+0000 7fad09d80b80 1 --2- 172.21.15.163:0/1464191295 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55718c411f10 0x55718c419750 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:20.348 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.301+0000 7fad09d80b80 1 --2- 172.21.15.163:0/1464191295 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55718c412860 0x55718c419c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:20.348 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.301+0000 7fad09d80b80 1 -- 172.21.15.163:0/1464191295 >> 172.21.15.163:0/1464191295 conn(0x55718c407630 msgr2=0x55718c425fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:12:20.348 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.301+0000 7fad09d80b80 1 -- 172.21.15.163:0/1464191295 shutdown_connections 2023-07-14T18:12:20.348 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.301+0000 7fad09d80b80 1 -- 172.21.15.163:0/1464191295 wait complete. 2023-07-14T18:12:20.349 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.301+0000 7fad09d80b80 1 -- start start 2023-07-14T18:12:20.349 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.301+0000 7fad09d80b80 1 Processor -- start 2023-07-14T18:12:20.349 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.302+0000 7fad09d80b80 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55718c411f10 0x55718c40c8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:12:20.349 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.302+0000 7fad09d80b80 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55718c412860 0x55718c422df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:12:20.349 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.302+0000 7fad09d80b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55718c413460 0x55718c47a7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:12:20.349 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.302+0000 7fad09d80b80 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x55718c47ad80 con 0x55718c412860 2023-07-14T18:12:20.349 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.302+0000 7fad09d80b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x55718c47aef0 con 0x55718c413460 2023-07-14T18:12:20.350 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.302+0000 7fad09d80b80 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x55718c47b0b0 con 0x55718c411f10 2023-07-14T18:12:20.350 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.302+0000 7fad09d80b80 10 client.0 _ll_register_callbacks cb 0x7facf0099230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T18:12:20.350 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.302+0000 7facf6ffd700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55718c412860 0x55718c422df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:12:20.350 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.302+0000 7facf6ffd700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55718c412860 0x55718c422df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:57104/0 (socket says 172.21.15.163:57104) 2023-07-14T18:12:20.350 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.302+0000 7facf6ffd700 1 -- 172.21.15.163:0/1985135371 learned_addr learned my addr 172.21.15.163:0/1985135371 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:12:20.350 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.302+0000 7facf7fff700 1 --2- 172.21.15.163:0/1985135371 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55718c413460 0x55718c47a7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:12:20.350 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.302+0000 7facf77fe700 1 --2- 172.21.15.163:0/1985135371 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55718c411f10 0x55718c40c8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:12:20.350 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.302+0000 7facf6ffd700 1 -- 172.21.15.163:0/1985135371 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55718c411f10 msgr2=0x55718c40c8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:12:20.351 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.302+0000 7facf6ffd700 1 --2- 172.21.15.163:0/1985135371 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55718c411f10 0x55718c40c8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:20.351 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.302+0000 7facf6ffd700 1 -- 172.21.15.163:0/1985135371 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55718c413460 msgr2=0x55718c47a7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:12:20.351 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.302+0000 7facf6ffd700 1 --2- 172.21.15.163:0/1985135371 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55718c413460 0x55718c47a7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:20.351 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.302+0000 7facf6ffd700 1 -- 172.21.15.163:0/1985135371 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7face802a040 con 0x55718c412860 2023-07-14T18:12:20.351 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.302+0000 7facf6ffd700 1 --2- 172.21.15.163:0/1985135371 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55718c412860 0x55718c422df0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7facf8069270 tx=0x7facec004230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=351882fb641d48f6 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:12:20.351 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.302+0000 7facd6ffd700 10 client.0 ms_handle_connect on v2:172.21.15.163:3300/0 2023-07-14T18:12:20.351 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.302+0000 7facd6ffd700 1 -- 172.21.15.163:0/1985135371 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facec00b6b0 con 0x55718c412860 2023-07-14T18:12:20.351 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.302+0000 7facd6ffd700 1 -- 172.21.15.163:0/1985135371 <== mon.0 v2:172.21.15.163:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 9020+0+0 (secure 0 0 0) 0x7facec00b810 con 0x55718c412860 2023-07-14T18:12:20.352 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.302+0000 7fad09d80b80 1 -- 172.21.15.163:0/1985135371 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7face8021070 con 0x55718c412860 2023-07-14T18:12:20.352 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.302+0000 7facd6ffd700 1 -- 172.21.15.163:0/1985135371 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7facec00b9d0 con 0x55718c412860 2023-07-14T18:12:20.352 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.302+0000 7fad09d80b80 10 client.15276 fetch_fsmap learned FSMap version 28 2023-07-14T18:12:20.352 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.303+0000 7fad09d80b80 1 -- 172.21.15.163:0/1985135371 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) v3 -- 0x55718c18f260 con 0x55718c412860 2023-07-14T18:12:20.352 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.303+0000 7facd6ffd700 1 -- 172.21.15.163:0/1985135371 <== mon.0 v2:172.21.15.163:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7face8021070 con 0x55718c412860 2023-07-14T18:12:20.352 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.303+0000 7facd6ffd700 1 -- 172.21.15.163:0/1985135371 <== mon.0 v2:172.21.15.163:3300/0 5 ==== fsmap(e 28) v1 ==== 7470+0+0 (secure 0 0 0) 0x7facec025bc0 con 0x55718c412860 2023-07-14T18:12:20.352 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.303+0000 7fad09d80b80 10 client.15276 fetch_fsmap finished waiting for FSMap version 28 2023-07-14T18:12:20.353 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.303+0000 7fad09d80b80 10 client.15276 resolve_mds: resolved name 'h' to daemon mds.h 2023-07-14T18:12:20.353 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.303+0000 7fad09d80b80 20 client.15276 populate_metadata read hostname 'smithi163' 2023-07-14T18:12:20.353 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.303+0000 7fad09d80b80 1 --2- 172.21.15.163:0/1985135371 >> [v2:172.21.15.172:6836/3783835012,v1:172.21.15.172:6837/3783835012] conn(0x55718c47fef0 0x55718c47c860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:12:20.353 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.303+0000 7fad09d80b80 4 client.15276 mds_command: new command op to 24479 tid=0[{"prefix": "status"}] 2023-07-14T18:12:20.353 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.303+0000 7fad09d80b80 1 -- 172.21.15.163:0/1985135371 --> [v2:172.21.15.172:6836/3783835012,v1:172.21.15.172:6837/3783835012] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55718c35be60 con 0x55718c47fef0 2023-07-14T18:12:20.353 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.303+0000 7facf77fe700 1 --2- 172.21.15.163:0/1985135371 >> [v2:172.21.15.172:6836/3783835012,v1:172.21.15.172:6837/3783835012] conn(0x55718c47fef0 0x55718c47c860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:12:20.353 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.304+0000 7facd6ffd700 10 client.15276 ms_handle_connect on v2:172.21.15.172:6836/3783835012 2023-07-14T18:12:20.354 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.304+0000 7facf77fe700 1 --2- 172.21.15.163:0/1985135371 >> [v2:172.21.15.172:6836/3783835012,v1:172.21.15.172:6837/3783835012] conn(0x55718c47fef0 0x55718c47c860 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=2d806db55f4448f0 server_cookie=e289d92805fbf812 in_seq=0 out_seq=0 2023-07-14T18:12:20.354 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.304+0000 7facd6ffd700 1 -- 172.21.15.163:0/1985135371 <== mds.2 v2:172.21.15.172:6836/3783835012 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+332 (crc 0 0 0) 0x55718c35be60 con 0x55718c47fef0 2023-07-14T18:12:20.354 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.304+0000 7facd6ffd700 10 client.15276 handle_command_reply: tid=0 2023-07-14T18:12:20.354 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.304+0000 7fad09d80b80 1 client.15276 shutdown 2023-07-14T18:12:20.354 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.304+0000 7fad09d80b80 1 -- 172.21.15.163:0/1985135371 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55718c412860 msgr2=0x55718c422df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:12:20.354 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.304+0000 7fad09d80b80 1 --2- 172.21.15.163:0/1985135371 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55718c412860 0x55718c422df0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7facf8069270 tx=0x7facec004230 comp rx=0 tx=0).stop 2023-07-14T18:12:20.354 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.304+0000 7fad09d80b80 1 -- 172.21.15.163:0/1985135371 shutdown_connections 2023-07-14T18:12:20.354 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.304+0000 7fad09d80b80 1 --2- 172.21.15.163:0/1985135371 >> [v2:172.21.15.172:6836/3783835012,v1:172.21.15.172:6837/3783835012] conn(0x55718c47fef0 0x55718c47c860 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:20.355 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.304+0000 7fad09d80b80 1 --2- 172.21.15.163:0/1985135371 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55718c411f10 0x55718c40c8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:20.355 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.304+0000 7facd6ffd700 0 client.15276 ms_handle_reset on v2:172.21.15.172:6836/3783835012 2023-07-14T18:12:20.355 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.304+0000 7fad09d80b80 1 --2- 172.21.15.163:0/1985135371 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55718c413460 0x55718c47a7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:20.355 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.304+0000 7fad09d80b80 1 --2- 172.21.15.163:0/1985135371 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55718c412860 0x55718c422df0 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:20.355 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.304+0000 7fad09d80b80 1 -- 172.21.15.163:0/1985135371 >> 172.21.15.163:0/1985135371 conn(0x55718c407630 msgr2=0x55718c419750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:12:20.355 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.304+0000 7fad09d80b80 1 -- 172.21.15.163:0/1985135371 shutdown_connections 2023-07-14T18:12:20.355 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.304+0000 7fad09d80b80 1 -- 172.21.15.163:0/1985135371 wait complete. 2023-07-14T18:12:20.355 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.304+0000 7fad09d80b80 20 client.15276 trim_cache size 0 max 16384 2023-07-14T18:12:20.356 INFO:teuthology.orchestra.run.smithi163.stdout:{ 2023-07-14T18:12:20.356 INFO:teuthology.orchestra.run.smithi163.stdout: "cluster_fsid": "bf7326ec-2270-11ee-9b33-001a4aab830c", 2023-07-14T18:12:20.356 INFO:teuthology.orchestra.run.smithi163.stdout: "whoami": 2, 2023-07-14T18:12:20.356 INFO:teuthology.orchestra.run.smithi163.stdout: "id": 24479, 2023-07-14T18:12:20.356 INFO:teuthology.orchestra.run.smithi163.stdout: "want_state": "up:active", 2023-07-14T18:12:20.357 INFO:teuthology.orchestra.run.smithi163.stdout: "state": "up:active", 2023-07-14T18:12:20.357 INFO:teuthology.orchestra.run.smithi163.stdout: "fs_name": "cephfs", 2023-07-14T18:12:20.357 INFO:teuthology.orchestra.run.smithi163.stdout: "rank_uptime": 51.487549768999997, 2023-07-14T18:12:20.357 INFO:teuthology.orchestra.run.smithi163.stdout: "mdsmap_epoch": 28, 2023-07-14T18:12:20.357 INFO:teuthology.orchestra.run.smithi163.stdout: "osdmap_epoch": 86, 2023-07-14T18:12:20.357 INFO:teuthology.orchestra.run.smithi163.stdout: "osdmap_epoch_barrier": 84, 2023-07-14T18:12:20.357 INFO:teuthology.orchestra.run.smithi163.stdout: "uptime": 85.436375701000003 2023-07-14T18:12:20.357 INFO:teuthology.orchestra.run.smithi163.stdout:} 2023-07-14T18:12:20.358 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.305+0000 7facfdbe8700 1 -- 172.21.15.163:0/2102822571 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7face00a1260 msgr2=0x7face00a3710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:12:20.359 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.305+0000 7facfdbe8700 1 --2- 172.21.15.163:0/2102822571 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7face00a1260 0x7face00a3710 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7facf80ffbc0 tx=0x7face8009260 comp rx=0 tx=0).stop 2023-07-14T18:12:20.359 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.305+0000 7facfdbe8700 1 -- 172.21.15.163:0/2102822571 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7facf81006f0 msgr2=0x7facf819cc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:12:20.359 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.305+0000 7facfdbe8700 1 --2- 172.21.15.163:0/2102822571 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7facf81006f0 0x7facf819cc40 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7facf000ef30 tx=0x7facf000c3a0 comp rx=0 tx=0).stop 2023-07-14T18:12:20.359 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.305+0000 7facfdbe8700 1 -- 172.21.15.163:0/2102822571 shutdown_connections 2023-07-14T18:12:20.359 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.305+0000 7facfdbe8700 1 --2- 172.21.15.163:0/2102822571 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7face00a1260 0x7face00a3710 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:20.359 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.305+0000 7facfdbe8700 1 --2- 172.21.15.163:0/2102822571 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7facf80feb70 0x7facf8069500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:20.359 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.305+0000 7facfdbe8700 1 --2- 172.21.15.163:0/2102822571 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7facf81006f0 0x7facf819cc40 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:20.360 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.305+0000 7facfdbe8700 1 --2- 172.21.15.163:0/2102822571 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7facf80ffd60 0x7facf819a5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:20.360 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.305+0000 7facfdbe8700 1 -- 172.21.15.163:0/2102822571 >> 172.21.15.163:0/2102822571 conn(0x7facf80fa190 msgr2=0x7facf80fc480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:12:20.360 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.305+0000 7facfdbe8700 1 -- 172.21.15.163:0/2102822571 shutdown_connections 2023-07-14T18:12:20.360 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.305+0000 7facfdbe8700 1 -- 172.21.15.163:0/2102822571 wait complete. 2023-07-14T18:12:20.360 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.i status 2023-07-14T18:12:20.484 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.443+0000 7f4b28b06700 1 -- 172.21.15.163:0/2843564006 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f4b240ffdc0 msgr2=0x7f4b24100230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:12:20.484 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.443+0000 7f4b28b06700 1 --2- 172.21.15.163:0/2843564006 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f4b240ffdc0 0x7f4b24100230 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f4b14009990 tx=0x7f4b14009ca0 comp rx=0 tx=0).stop 2023-07-14T18:12:20.484 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.443+0000 7f4b28b06700 1 -- 172.21.15.163:0/2843564006 shutdown_connections 2023-07-14T18:12:20.485 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.443+0000 7f4b28b06700 1 --2- 172.21.15.163:0/2843564006 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4b24100770 0x7f4b24107010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:20.485 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.443+0000 7f4b28b06700 1 --2- 172.21.15.163:0/2843564006 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4b240feb30 0x7f4b240fef40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:20.485 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.443+0000 7f4b28b06700 1 --2- 172.21.15.163:0/2843564006 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f4b240ffdc0 0x7f4b24100230 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:20.485 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.443+0000 7f4b28b06700 1 -- 172.21.15.163:0/2843564006 >> 172.21.15.163:0/2843564006 conn(0x7f4b240fa150 msgr2=0x7f4b240fc580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:12:20.485 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.443+0000 7f4b28b06700 1 -- 172.21.15.163:0/2843564006 shutdown_connections 2023-07-14T18:12:20.485 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.443+0000 7f4b28b06700 1 -- 172.21.15.163:0/2843564006 wait complete. 2023-07-14T18:12:20.487 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.444+0000 7f4b28b06700 1 Processor -- start 2023-07-14T18:12:20.487 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.444+0000 7f4b28b06700 1 -- start start 2023-07-14T18:12:20.487 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.444+0000 7f4b28b06700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4b240feb30 0x7f4b241958b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:12:20.488 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.444+0000 7f4b28b06700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f4b240ffdc0 0x7f4b24195df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:12:20.488 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.444+0000 7f4b28b06700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4b24100770 0x7f4b2419ce60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:12:20.488 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.444+0000 7f4b28b06700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b2419d430 con 0x7f4b240ffdc0 2023-07-14T18:12:20.488 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.444+0000 7f4b28b06700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b2419d570 con 0x7f4b240feb30 2023-07-14T18:12:20.488 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.444+0000 7f4b28b06700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b2419d700 con 0x7f4b24100770 2023-07-14T18:12:20.488 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.444+0000 7f4b21d9b700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f4b240ffdc0 0x7f4b24195df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:12:20.489 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.444+0000 7f4b21d9b700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f4b240ffdc0 0x7f4b24195df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:57118/0 (socket says 172.21.15.163:57118) 2023-07-14T18:12:20.489 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.444+0000 7f4b21d9b700 1 -- 172.21.15.163:0/863712490 learned_addr learned my addr 172.21.15.163:0/863712490 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:12:20.489 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.444+0000 7f4b2259c700 1 --2- 172.21.15.163:0/863712490 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4b240feb30 0x7f4b241958b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:12:20.489 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.444+0000 7f4b22d9d700 1 --2- 172.21.15.163:0/863712490 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4b24100770 0x7f4b2419ce60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:12:20.489 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.444+0000 7f4b21d9b700 1 -- 172.21.15.163:0/863712490 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4b24100770 msgr2=0x7f4b2419ce60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:12:20.489 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.444+0000 7f4b21d9b700 1 --2- 172.21.15.163:0/863712490 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4b24100770 0x7f4b2419ce60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:20.489 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.444+0000 7f4b21d9b700 1 -- 172.21.15.163:0/863712490 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4b240feb30 msgr2=0x7f4b241958b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:12:20.489 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.444+0000 7f4b21d9b700 1 --2- 172.21.15.163:0/863712490 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4b240feb30 0x7f4b241958b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:20.490 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.444+0000 7f4b21d9b700 1 -- 172.21.15.163:0/863712490 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b140095f0 con 0x7f4b240ffdc0 2023-07-14T18:12:20.490 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.444+0000 7f4b21d9b700 1 --2- 172.21.15.163:0/863712490 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f4b240ffdc0 0x7f4b24195df0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f4b14005950 tx=0x7f4b14009580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:12:20.490 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.445+0000 7f4b137fe700 1 -- 172.21.15.163:0/863712490 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b1401d070 con 0x7f4b240ffdc0 2023-07-14T18:12:20.490 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.445+0000 7f4b28b06700 1 -- 172.21.15.163:0/863712490 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b2419d980 con 0x7f4b240ffdc0 2023-07-14T18:12:20.490 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.445+0000 7f4b137fe700 1 -- 172.21.15.163:0/863712490 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f4b1400bd70 con 0x7f4b240ffdc0 2023-07-14T18:12:20.490 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.445+0000 7f4b137fe700 1 -- 172.21.15.163:0/863712490 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b14022d40 con 0x7f4b240ffdc0 2023-07-14T18:12:20.490 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.445+0000 7f4b28b06700 1 -- 172.21.15.163:0/863712490 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b2419dda0 con 0x7f4b240ffdc0 2023-07-14T18:12:20.495 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.447+0000 7f4b137fe700 1 -- 172.21.15.163:0/863712490 <== mon.0 v2:172.21.15.163:3300/0 4 ==== mgrmap(e 17) v1 ==== 135767+0+0 (secure 0 0 0) 0x7f4b14022470 con 0x7f4b240ffdc0 2023-07-14T18:12:20.495 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.447+0000 7f4b137fe700 1 --2- 172.21.15.163:0/863712490 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f4b0c0a11e0 0x7f4b0c0a3690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:12:20.496 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.447+0000 7f4b137fe700 1 -- 172.21.15.163:0/863712490 <== mon.0 v2:172.21.15.163:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 9020+0+0 (secure 0 0 0) 0x7f4b140ce2b0 con 0x7f4b240ffdc0 2023-07-14T18:12:20.496 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.447+0000 7f4b2259c700 1 --2- 172.21.15.163:0/863712490 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f4b0c0a11e0 0x7f4b0c0a3690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:12:20.496 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.448+0000 7f4b2259c700 1 --2- 172.21.15.163:0/863712490 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f4b0c0a11e0 0x7f4b0c0a3690 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f4b18005950 tx=0x7f4b1800b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:12:20.496 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.448+0000 7f4b34c9eb80 1 Processor -- start 2023-07-14T18:12:20.496 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.448+0000 7f4b34c9eb80 1 -- start start 2023-07-14T18:12:20.496 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.448+0000 7f4b34c9eb80 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x562fc2fd02d0 0x562fc2fd06e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:12:20.497 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.448+0000 7f4b34c9eb80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562fc2fd0c20 0x562fc2fd12c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:12:20.497 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.448+0000 7f4b34c9eb80 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x562fc2fd1850 0x562fc2fd1cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:12:20.497 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.448+0000 7f4b34c9eb80 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x562fc2ed0c60 con 0x562fc2fd02d0 2023-07-14T18:12:20.497 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.448+0000 7f4b34c9eb80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x562fc2f239f0 con 0x562fc2fd0c20 2023-07-14T18:12:20.497 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.448+0000 7f4b34c9eb80 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x562fc2f1ce80 con 0x562fc2fd1850 2023-07-14T18:12:20.497 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.449+0000 7f4b2259c700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x562fc2fd02d0 0x562fc2fd06e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:12:20.497 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.449+0000 7f4b2259c700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x562fc2fd02d0 0x562fc2fd06e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:57124/0 (socket says 172.21.15.163:57124) 2023-07-14T18:12:20.497 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.449+0000 7f4b2259c700 1 -- 172.21.15.163:0/4176982178 learned_addr learned my addr 172.21.15.163:0/4176982178 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:12:20.498 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.449+0000 7f4b21d9b700 1 --2- 172.21.15.163:0/4176982178 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562fc2fd0c20 0x562fc2fd12c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:12:20.498 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.449+0000 7f4b22d9d700 1 --2- 172.21.15.163:0/4176982178 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x562fc2fd1850 0x562fc2fd1cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:12:20.498 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.449+0000 7f4b2259c700 1 -- 172.21.15.163:0/4176982178 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x562fc2fd1850 msgr2=0x562fc2fd1cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:12:20.498 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.449+0000 7f4b2259c700 1 --2- 172.21.15.163:0/4176982178 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x562fc2fd1850 0x562fc2fd1cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:20.498 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.449+0000 7f4b2259c700 1 -- 172.21.15.163:0/4176982178 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562fc2fd0c20 msgr2=0x562fc2fd12c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:12:20.498 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.449+0000 7f4b2259c700 1 --2- 172.21.15.163:0/4176982178 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562fc2fd0c20 0x562fc2fd12c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:20.498 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.449+0000 7f4b2259c700 1 -- 172.21.15.163:0/4176982178 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562fc2d4ad90 con 0x562fc2fd02d0 2023-07-14T18:12:20.498 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.449+0000 7f4b21d9b700 1 --2- 172.21.15.163:0/4176982178 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562fc2fd0c20 0x562fc2fd12c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T18:12:20.499 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.449+0000 7f4b2259c700 1 --2- 172.21.15.163:0/4176982178 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x562fc2fd02d0 0x562fc2fd06e0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f4b18010fa0 tx=0x7f4b18013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b9ddd36a3d73002 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:12:20.499 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.449+0000 7f4b10ff9700 1 -- 172.21.15.163:0/4176982178 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b1801e620 con 0x562fc2fd02d0 2023-07-14T18:12:20.499 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.449+0000 7f4b10ff9700 1 -- 172.21.15.163:0/4176982178 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f4b18015070 con 0x562fc2fd02d0 2023-07-14T18:12:20.499 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.449+0000 7f4b10ff9700 1 -- 172.21.15.163:0/4176982178 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b1801c910 con 0x562fc2fd02d0 2023-07-14T18:12:20.499 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.450+0000 7f4b34c9eb80 1 -- 172.21.15.163:0/4176982178 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x562fc2fd02d0 msgr2=0x562fc2fd06e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:12:20.499 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.450+0000 7f4b34c9eb80 1 --2- 172.21.15.163:0/4176982178 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x562fc2fd02d0 0x562fc2fd06e0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f4b18010fa0 tx=0x7f4b18013000 comp rx=0 tx=0).stop 2023-07-14T18:12:20.499 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.450+0000 7f4b34c9eb80 1 -- 172.21.15.163:0/4176982178 shutdown_connections 2023-07-14T18:12:20.499 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.450+0000 7f4b34c9eb80 1 --2- 172.21.15.163:0/4176982178 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x562fc2fd1850 0x562fc2fd1cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:20.500 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.450+0000 7f4b34c9eb80 1 --2- 172.21.15.163:0/4176982178 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x562fc2fd02d0 0x562fc2fd06e0 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:20.500 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.450+0000 7f4b34c9eb80 1 --2- 172.21.15.163:0/4176982178 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562fc2fd0c20 0x562fc2fd12c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:20.500 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.450+0000 7f4b34c9eb80 1 -- 172.21.15.163:0/4176982178 >> 172.21.15.163:0/4176982178 conn(0x562fc2fc1630 msgr2=0x562fc2fc6980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:12:20.500 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.450+0000 7f4b34c9eb80 1 -- 172.21.15.163:0/4176982178 shutdown_connections 2023-07-14T18:12:20.500 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.450+0000 7f4b34c9eb80 1 -- 172.21.15.163:0/4176982178 wait complete. 2023-07-14T18:12:20.500 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.450+0000 7f4b34c9eb80 1 -- start start 2023-07-14T18:12:20.500 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.451+0000 7f4b34c9eb80 1 Processor -- start 2023-07-14T18:12:20.501 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.451+0000 7f4b34c9eb80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562fc2fd02d0 0x562fc2fd9dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:12:20.501 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.451+0000 7f4b34c9eb80 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x562fc2fd0c20 0x562fc2fda310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:12:20.501 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.451+0000 7f4b34c9eb80 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x562fc2fd1850 0x562fc2fe1350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:12:20.501 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.451+0000 7f4b34c9eb80 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x562fc2ebca70 con 0x562fc2fd0c20 2023-07-14T18:12:20.501 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.451+0000 7f4b34c9eb80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x562fc2ebc770 con 0x562fc2fd02d0 2023-07-14T18:12:20.501 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.451+0000 7f4b34c9eb80 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x562fc2da08d0 con 0x562fc2fd1850 2023-07-14T18:12:20.501 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.451+0000 7f4b34c9eb80 10 client.0 _ll_register_callbacks cb 0x562fc2eba710 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T18:12:20.501 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.451+0000 7f4b21d9b700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x562fc2fd0c20 0x562fc2fda310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:12:20.502 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.451+0000 7f4b21d9b700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x562fc2fd0c20 0x562fc2fda310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:57132/0 (socket says 172.21.15.163:57132) 2023-07-14T18:12:20.502 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.451+0000 7f4b21d9b700 1 -- 172.21.15.163:0/2836646543 learned_addr learned my addr 172.21.15.163:0/2836646543 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:12:20.502 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.451+0000 7f4b22d9d700 1 --2- 172.21.15.163:0/2836646543 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x562fc2fd1850 0x562fc2fe1350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:12:20.502 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.451+0000 7f4b2259c700 1 --2- 172.21.15.163:0/2836646543 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562fc2fd02d0 0x562fc2fd9dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:12:20.502 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.451+0000 7f4b21d9b700 1 -- 172.21.15.163:0/2836646543 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x562fc2fd1850 msgr2=0x562fc2fe1350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:12:20.503 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.451+0000 7f4b21d9b700 1 --2- 172.21.15.163:0/2836646543 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x562fc2fd1850 0x562fc2fe1350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:20.503 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.451+0000 7f4b21d9b700 1 -- 172.21.15.163:0/2836646543 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562fc2fd02d0 msgr2=0x562fc2fd9dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:12:20.503 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.451+0000 7f4b21d9b700 1 --2- 172.21.15.163:0/2836646543 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562fc2fd02d0 0x562fc2fd9dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:20.503 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.451+0000 7f4b21d9b700 1 -- 172.21.15.163:0/2836646543 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b18010c50 con 0x562fc2fd0c20 2023-07-14T18:12:20.503 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.451+0000 7f4b21d9b700 1 --2- 172.21.15.163:0/2836646543 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x562fc2fd0c20 0x562fc2fda310 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f4b14097d50 tx=0x7f4b1409ac40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bfddb6c76aa1be2a server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:12:20.503 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.451+0000 7f4b09ffb700 10 client.0 ms_handle_connect on v2:172.21.15.163:3300/0 2023-07-14T18:12:20.503 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.451+0000 7f4b09ffb700 1 -- 172.21.15.163:0/2836646543 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b14022ea0 con 0x562fc2fd0c20 2023-07-14T18:12:20.504 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.452+0000 7f4b09ffb700 1 -- 172.21.15.163:0/2836646543 <== mon.0 v2:172.21.15.163:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 9020+0+0 (secure 0 0 0) 0x7f4b1409f0d0 con 0x562fc2fd0c20 2023-07-14T18:12:20.504 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.452+0000 7f4b34c9eb80 1 -- 172.21.15.163:0/2836646543 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x562fc2e764a0 con 0x562fc2fd0c20 2023-07-14T18:12:20.504 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.452+0000 7f4b09ffb700 1 -- 172.21.15.163:0/2836646543 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4b1409f310 con 0x562fc2fd0c20 2023-07-14T18:12:20.504 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.452+0000 7f4b34c9eb80 10 client.15288 fetch_fsmap learned FSMap version 28 2023-07-14T18:12:20.504 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.452+0000 7f4b34c9eb80 1 -- 172.21.15.163:0/2836646543 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) v3 -- 0x562fc2d33c10 con 0x562fc2fd0c20 2023-07-14T18:12:20.504 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.452+0000 7f4b09ffb700 1 -- 172.21.15.163:0/2836646543 <== mon.0 v2:172.21.15.163:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f4b140c9080 con 0x562fc2fd0c20 2023-07-14T18:12:20.504 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.452+0000 7f4b09ffb700 1 -- 172.21.15.163:0/2836646543 <== mon.0 v2:172.21.15.163:3300/0 5 ==== fsmap(e 28) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f4b140a32a0 con 0x562fc2fd0c20 2023-07-14T18:12:20.505 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.452+0000 7f4b34c9eb80 10 client.15288 fetch_fsmap finished waiting for FSMap version 28 2023-07-14T18:12:20.505 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.452+0000 7f4b34c9eb80 10 client.15288 resolve_mds: resolved name 'i' to daemon mds.i 2023-07-14T18:12:20.505 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.452+0000 7f4b34c9eb80 20 client.15288 populate_metadata read hostname 'smithi163' 2023-07-14T18:12:20.505 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.452+0000 7f4b34c9eb80 1 --2- 172.21.15.163:0/2836646543 >> [v2:172.21.15.184:6838/2819059257,v1:172.21.15.184:6839/2819059257] conn(0x562fc2fe4cb0 0x562fc2fe4280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:12:20.505 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.452+0000 7f4b34c9eb80 4 client.15288 mds_command: new command op to 24493 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-14T18:12:20.505 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.452+0000 7f4b34c9eb80 1 -- 172.21.15.163:0/2836646543 --> [v2:172.21.15.184:6838/2819059257,v1:172.21.15.184:6839/2819059257] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x562fc2f9ad50 con 0x562fc2fe4cb0 2023-07-14T18:12:20.505 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.453+0000 7f4b2259c700 1 --2- 172.21.15.163:0/2836646543 >> [v2:172.21.15.184:6838/2819059257,v1:172.21.15.184:6839/2819059257] conn(0x562fc2fe4cb0 0x562fc2fe4280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:12:20.506 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.453+0000 7f4b09ffb700 10 client.15288 ms_handle_connect on v2:172.21.15.184:6838/2819059257 2023-07-14T18:12:20.506 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.453+0000 7f4b2259c700 1 --2- 172.21.15.163:0/2836646543 >> [v2:172.21.15.184:6838/2819059257,v1:172.21.15.184:6839/2819059257] conn(0x562fc2fe4cb0 0x562fc2fe4280 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=77683c4ddaff1b46 server_cookie=f826adb086135732 in_seq=0 out_seq=0 2023-07-14T18:12:20.506 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.454+0000 7f4b09ffb700 1 -- 172.21.15.163:0/2836646543 <== mds.1 v2:172.21.15.184:6838/2819059257 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18017 (crc 0 0 0) 0x562fc2f9ad50 con 0x562fc2fe4cb0 2023-07-14T18:12:20.506 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.454+0000 7f4b09ffb700 10 client.15288 handle_command_reply: tid=0 2023-07-14T18:12:20.506 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.454+0000 7f4b34c9eb80 1 client.15288 shutdown 2023-07-14T18:12:20.506 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.454+0000 7f4b34c9eb80 1 -- 172.21.15.163:0/2836646543 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x562fc2fd0c20 msgr2=0x562fc2fda310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:12:20.506 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.454+0000 7f4b34c9eb80 1 --2- 172.21.15.163:0/2836646543 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x562fc2fd0c20 0x562fc2fda310 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f4b14097d50 tx=0x7f4b1409ac40 comp rx=0 tx=0).stop 2023-07-14T18:12:20.507 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.454+0000 7f4b34c9eb80 1 -- 172.21.15.163:0/2836646543 shutdown_connections 2023-07-14T18:12:20.507 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.454+0000 7f4b34c9eb80 1 --2- 172.21.15.163:0/2836646543 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x562fc2fd1850 0x562fc2fe1350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:20.507 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.454+0000 7f4b34c9eb80 1 --2- 172.21.15.163:0/2836646543 >> [v2:172.21.15.184:6838/2819059257,v1:172.21.15.184:6839/2819059257] conn(0x562fc2fe4cb0 0x562fc2fe4280 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:20.507 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.454+0000 7f4b34c9eb80 1 --2- 172.21.15.163:0/2836646543 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562fc2fd02d0 0x562fc2fd9dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:20.507 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.454+0000 7f4b09ffb700 0 client.15288 ms_handle_reset on v2:172.21.15.184:6838/2819059257 2023-07-14T18:12:20.507 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.454+0000 7f4b34c9eb80 1 --2- 172.21.15.163:0/2836646543 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x562fc2fd0c20 0x562fc2fda310 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:20.507 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.454+0000 7f4b34c9eb80 1 -- 172.21.15.163:0/2836646543 >> 172.21.15.163:0/2836646543 conn(0x562fc2fc1630 msgr2=0x562fc2fc5600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:12:20.507 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.454+0000 7f4b34c9eb80 1 -- 172.21.15.163:0/2836646543 shutdown_connections 2023-07-14T18:12:20.508 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.454+0000 7f4b34c9eb80 1 -- 172.21.15.163:0/2836646543 wait complete. 2023-07-14T18:12:20.508 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.454+0000 7f4b34c9eb80 20 client.15288 trim_cache size 0 max 16384 2023-07-14T18:12:20.513 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.471+0000 7f4b34c9eb80 1 Processor -- start 2023-07-14T18:12:20.513 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.471+0000 7f4b34c9eb80 1 -- start start 2023-07-14T18:12:20.513 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.471+0000 7f4b34c9eb80 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x562fc2fd02d0 0x562fc2fd7c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:12:20.513 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.471+0000 7f4b34c9eb80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562fc2fd0c20 0x562fc2fe12e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:12:20.513 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.471+0000 7f4b34c9eb80 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x562fc2fd1850 0x562fc2fd47c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:12:20.513 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.471+0000 7f4b34c9eb80 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x562fc2ec6470 con 0x562fc2fd02d0 2023-07-14T18:12:20.514 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.471+0000 7f4b34c9eb80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x562fc2eeb790 con 0x562fc2fd0c20 2023-07-14T18:12:20.514 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.471+0000 7f4b34c9eb80 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x562fc2edb480 con 0x562fc2fd1850 2023-07-14T18:12:20.514 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.471+0000 7f4b2259c700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x562fc2fd02d0 0x562fc2fd7c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:12:20.514 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.471+0000 7f4b2259c700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x562fc2fd02d0 0x562fc2fd7c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:57138/0 (socket says 172.21.15.163:57138) 2023-07-14T18:12:20.514 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.471+0000 7f4b2259c700 1 -- 172.21.15.163:0/1070451173 learned_addr learned my addr 172.21.15.163:0/1070451173 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:12:20.514 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.472+0000 7f4b21d9b700 1 --2- 172.21.15.163:0/1070451173 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562fc2fd0c20 0x562fc2fe12e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:12:20.514 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.472+0000 7f4b2259c700 1 -- 172.21.15.163:0/1070451173 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x562fc2fd1850 msgr2=0x562fc2fd47c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:12:20.515 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.472+0000 7f4b2259c700 1 --2- 172.21.15.163:0/1070451173 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x562fc2fd1850 0x562fc2fd47c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:20.515 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.472+0000 7f4b2259c700 1 -- 172.21.15.163:0/1070451173 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562fc2fd0c20 msgr2=0x562fc2fe12e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:12:20.515 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.472+0000 7f4b2259c700 1 --2- 172.21.15.163:0/1070451173 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562fc2fd0c20 0x562fc2fe12e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:20.515 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.472+0000 7f4b2259c700 1 -- 172.21.15.163:0/1070451173 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562fc2d71200 con 0x562fc2fd02d0 2023-07-14T18:12:20.515 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.472+0000 7f4b2259c700 1 --2- 172.21.15.163:0/1070451173 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x562fc2fd02d0 0x562fc2fd7c90 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f4b18010f40 tx=0x7f4b1801ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ed3de0dd3e0c1ea server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:12:20.515 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.472+0000 7f4b117fa700 1 -- 172.21.15.163:0/1070451173 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b18005520 con 0x562fc2fd02d0 2023-07-14T18:12:20.515 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.472+0000 7f4b117fa700 1 -- 172.21.15.163:0/1070451173 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f4b18038070 con 0x562fc2fd02d0 2023-07-14T18:12:20.515 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.472+0000 7f4b117fa700 1 -- 172.21.15.163:0/1070451173 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b18034dd0 con 0x562fc2fd02d0 2023-07-14T18:12:20.519 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.472+0000 7f4b34c9eb80 1 -- 172.21.15.163:0/1070451173 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x562fc2fd02d0 msgr2=0x562fc2fd7c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:12:20.519 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.472+0000 7f4b34c9eb80 1 --2- 172.21.15.163:0/1070451173 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x562fc2fd02d0 0x562fc2fd7c90 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f4b18010f40 tx=0x7f4b1801ee80 comp rx=0 tx=0).stop 2023-07-14T18:12:20.519 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.472+0000 7f4b34c9eb80 1 -- 172.21.15.163:0/1070451173 shutdown_connections 2023-07-14T18:12:20.520 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.472+0000 7f4b34c9eb80 1 --2- 172.21.15.163:0/1070451173 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x562fc2fd1850 0x562fc2fd47c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:20.520 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.472+0000 7f4b34c9eb80 1 --2- 172.21.15.163:0/1070451173 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x562fc2fd02d0 0x562fc2fd7c90 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:20.520 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.472+0000 7f4b34c9eb80 1 --2- 172.21.15.163:0/1070451173 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562fc2fd0c20 0x562fc2fe12e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:20.520 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.472+0000 7f4b34c9eb80 1 -- 172.21.15.163:0/1070451173 >> 172.21.15.163:0/1070451173 conn(0x562fc2fc1630 msgr2=0x562fc2fd8a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:12:20.520 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.472+0000 7f4b34c9eb80 1 -- 172.21.15.163:0/1070451173 shutdown_connections 2023-07-14T18:12:20.520 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.472+0000 7f4b34c9eb80 1 -- 172.21.15.163:0/1070451173 wait complete. 2023-07-14T18:12:20.521 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.473+0000 7f4b34c9eb80 1 -- start start 2023-07-14T18:12:20.521 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.473+0000 7f4b34c9eb80 1 Processor -- start 2023-07-14T18:12:20.521 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.473+0000 7f4b34c9eb80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562fc2fd02d0 0x562fc2fdc950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:12:20.521 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.473+0000 7f4b34c9eb80 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x562fc2fd0c20 0x562fc2fdce90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:12:20.521 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.473+0000 7f4b34c9eb80 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x562fc2fd1850 0x562fc2fdfce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:12:20.521 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.473+0000 7f4b34c9eb80 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x562fc2fe0220 con 0x562fc2fd0c20 2023-07-14T18:12:20.521 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.473+0000 7f4b34c9eb80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x562fc2fe0390 con 0x562fc2fd02d0 2023-07-14T18:12:20.521 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.473+0000 7f4b34c9eb80 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x562fc2fe0550 con 0x562fc2fd1850 2023-07-14T18:12:20.522 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.473+0000 7f4b34c9eb80 10 client.0 _ll_register_callbacks cb 0x7f4b1409b0b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T18:12:20.522 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.473+0000 7f4b21d9b700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x562fc2fd0c20 0x562fc2fdce90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:12:20.522 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.473+0000 7f4b21d9b700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x562fc2fd0c20 0x562fc2fdce90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:57146/0 (socket says 172.21.15.163:57146) 2023-07-14T18:12:20.522 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.473+0000 7f4b21d9b700 1 -- 172.21.15.163:0/1911779594 learned_addr learned my addr 172.21.15.163:0/1911779594 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:12:20.522 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.473+0000 7f4b22d9d700 1 --2- 172.21.15.163:0/1911779594 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x562fc2fd1850 0x562fc2fdfce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:12:20.522 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.473+0000 7f4b2259c700 1 --2- 172.21.15.163:0/1911779594 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562fc2fd02d0 0x562fc2fdc950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:12:20.522 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.474+0000 7f4b21d9b700 1 -- 172.21.15.163:0/1911779594 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x562fc2fd1850 msgr2=0x562fc2fdfce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:12:20.523 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.474+0000 7f4b21d9b700 1 --2- 172.21.15.163:0/1911779594 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x562fc2fd1850 0x562fc2fdfce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:20.523 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.474+0000 7f4b21d9b700 1 -- 172.21.15.163:0/1911779594 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562fc2fd02d0 msgr2=0x562fc2fdc950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:12:20.523 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.474+0000 7f4b21d9b700 1 --2- 172.21.15.163:0/1911779594 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562fc2fd02d0 0x562fc2fdc950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:20.523 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.474+0000 7f4b21d9b700 1 -- 172.21.15.163:0/1911779594 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x562fc2d4ad90 con 0x562fc2fd0c20 2023-07-14T18:12:20.524 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.474+0000 7f4b22d9d700 1 --2- 172.21.15.163:0/1911779594 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x562fc2fd1850 0x562fc2fdfce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T18:12:20.524 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.474+0000 7f4b2259c700 1 --2- 172.21.15.163:0/1911779594 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562fc2fd02d0 0x562fc2fdc950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T18:12:20.524 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.474+0000 7f4b21d9b700 1 --2- 172.21.15.163:0/1911779594 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x562fc2fd0c20 0x562fc2fdce90 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f4b140ce280 tx=0x7f4b14009ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=52bf23a9ba81a89e server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:12:20.524 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.474+0000 7f4b09ffb700 10 client.0 ms_handle_connect on v2:172.21.15.163:3300/0 2023-07-14T18:12:20.524 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.474+0000 7f4b09ffb700 1 -- 172.21.15.163:0/1911779594 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b14022ea0 con 0x562fc2fd0c20 2023-07-14T18:12:20.524 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.474+0000 7f4b09ffb700 1 -- 172.21.15.163:0/1911779594 <== mon.0 v2:172.21.15.163:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 9020+0+0 (secure 0 0 0) 0x7f4b1409f0d0 con 0x562fc2fd0c20 2023-07-14T18:12:20.524 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.474+0000 7f4b34c9eb80 1 -- 172.21.15.163:0/1911779594 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f4b18015070 con 0x562fc2fd0c20 2023-07-14T18:12:20.525 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.474+0000 7f4b09ffb700 1 -- 172.21.15.163:0/1911779594 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4b140971f0 con 0x562fc2fd0c20 2023-07-14T18:12:20.525 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.474+0000 7f4b34c9eb80 10 client.15294 fetch_fsmap learned FSMap version 28 2023-07-14T18:12:20.525 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.474+0000 7f4b34c9eb80 1 -- 172.21.15.163:0/1911779594 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) v3 -- 0x562fc2d49260 con 0x562fc2fd0c20 2023-07-14T18:12:20.525 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.474+0000 7f4b09ffb700 1 -- 172.21.15.163:0/1911779594 <== mon.0 v2:172.21.15.163:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f4b18015070 con 0x562fc2fd0c20 2023-07-14T18:12:20.525 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.474+0000 7f4b09ffb700 1 -- 172.21.15.163:0/1911779594 <== mon.0 v2:172.21.15.163:3300/0 5 ==== fsmap(e 28) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f4b14067100 con 0x562fc2fd0c20 2023-07-14T18:12:20.525 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.474+0000 7f4b34c9eb80 10 client.15294 fetch_fsmap finished waiting for FSMap version 28 2023-07-14T18:12:20.525 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.474+0000 7f4b34c9eb80 10 client.15294 resolve_mds: resolved name 'i' to daemon mds.i 2023-07-14T18:12:20.526 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.474+0000 7f4b34c9eb80 20 client.15294 populate_metadata read hostname 'smithi163' 2023-07-14T18:12:20.526 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.474+0000 7f4b34c9eb80 1 --2- 172.21.15.163:0/1911779594 >> [v2:172.21.15.184:6838/2819059257,v1:172.21.15.184:6839/2819059257] conn(0x562fc303de20 0x562fc303a920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:12:20.526 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.474+0000 7f4b34c9eb80 4 client.15294 mds_command: new command op to 24493 tid=0[{"prefix": "status"}] 2023-07-14T18:12:20.526 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.474+0000 7f4b34c9eb80 1 -- 172.21.15.163:0/1911779594 --> [v2:172.21.15.184:6838/2819059257,v1:172.21.15.184:6839/2819059257] -- command(tid 0: {"prefix": "status"}) v1 -- 0x562fc2f15e60 con 0x562fc303de20 2023-07-14T18:12:20.526 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.475+0000 7f4b2259c700 1 --2- 172.21.15.163:0/1911779594 >> [v2:172.21.15.184:6838/2819059257,v1:172.21.15.184:6839/2819059257] conn(0x562fc303de20 0x562fc303a920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:12:20.526 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.475+0000 7f4b2259c700 1 --2- 172.21.15.163:0/1911779594 >> [v2:172.21.15.184:6838/2819059257,v1:172.21.15.184:6839/2819059257] conn(0x562fc303de20 0x562fc303a920 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=ee9972657deb594 server_cookie=7e1a9ff1138c99e8 in_seq=0 out_seq=0 2023-07-14T18:12:20.526 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.475+0000 7f4b09ffb700 10 client.15294 ms_handle_connect on v2:172.21.15.184:6838/2819059257 2023-07-14T18:12:20.526 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.475+0000 7f4b09ffb700 1 -- 172.21.15.163:0/1911779594 <== mds.1 v2:172.21.15.184:6838/2819059257 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+332 (crc 0 0 0) 0x562fc2f15e60 con 0x562fc303de20 2023-07-14T18:12:20.527 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.475+0000 7f4b09ffb700 10 client.15294 handle_command_reply: tid=0 2023-07-14T18:12:20.527 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.475+0000 7f4b34c9eb80 1 client.15294 shutdown 2023-07-14T18:12:20.527 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.475+0000 7f4b34c9eb80 1 -- 172.21.15.163:0/1911779594 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x562fc2fd0c20 msgr2=0x562fc2fdce90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:12:20.527 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.475+0000 7f4b34c9eb80 1 --2- 172.21.15.163:0/1911779594 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x562fc2fd0c20 0x562fc2fdce90 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f4b140ce280 tx=0x7f4b14009ca0 comp rx=0 tx=0).stop 2023-07-14T18:12:20.527 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.475+0000 7f4b34c9eb80 1 -- 172.21.15.163:0/1911779594 shutdown_connections 2023-07-14T18:12:20.527 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.475+0000 7f4b34c9eb80 1 --2- 172.21.15.163:0/1911779594 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x562fc2fd1850 0x562fc2fdfce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:20.527 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.475+0000 7f4b34c9eb80 1 --2- 172.21.15.163:0/1911779594 >> [v2:172.21.15.184:6838/2819059257,v1:172.21.15.184:6839/2819059257] conn(0x562fc303de20 0x562fc303a920 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:20.527 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.475+0000 7f4b34c9eb80 1 --2- 172.21.15.163:0/1911779594 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562fc2fd02d0 0x562fc2fdc950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:20.528 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.475+0000 7f4b09ffb700 0 client.15294 ms_handle_reset on v2:172.21.15.184:6838/2819059257 2023-07-14T18:12:20.528 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.475+0000 7f4b34c9eb80 1 --2- 172.21.15.163:0/1911779594 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x562fc2fd0c20 0x562fc2fdce90 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:20.528 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.475+0000 7f4b34c9eb80 1 -- 172.21.15.163:0/1911779594 >> 172.21.15.163:0/1911779594 conn(0x562fc2fc1630 msgr2=0x562fc2fd7c90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:12:20.528 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.475+0000 7f4b34c9eb80 1 -- 172.21.15.163:0/1911779594 shutdown_connections 2023-07-14T18:12:20.528 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.475+0000 7f4b34c9eb80 1 -- 172.21.15.163:0/1911779594 wait complete. 2023-07-14T18:12:20.528 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.476+0000 7f4b34c9eb80 20 client.15294 trim_cache size 0 max 16384 2023-07-14T18:12:20.529 INFO:teuthology.orchestra.run.smithi163.stdout:{ 2023-07-14T18:12:20.529 INFO:teuthology.orchestra.run.smithi163.stdout: "cluster_fsid": "bf7326ec-2270-11ee-9b33-001a4aab830c", 2023-07-14T18:12:20.529 INFO:teuthology.orchestra.run.smithi163.stdout: "whoami": 1, 2023-07-14T18:12:20.529 INFO:teuthology.orchestra.run.smithi163.stdout: "id": 24493, 2023-07-14T18:12:20.529 INFO:teuthology.orchestra.run.smithi163.stdout: "want_state": "up:active", 2023-07-14T18:12:20.529 INFO:teuthology.orchestra.run.smithi163.stdout: "state": "up:active", 2023-07-14T18:12:20.530 INFO:teuthology.orchestra.run.smithi163.stdout: "fs_name": "cephfs", 2023-07-14T18:12:20.530 INFO:teuthology.orchestra.run.smithi163.stdout: "rank_uptime": 52.668454130000001, 2023-07-14T18:12:20.530 INFO:teuthology.orchestra.run.smithi163.stdout: "mdsmap_epoch": 28, 2023-07-14T18:12:20.530 INFO:teuthology.orchestra.run.smithi163.stdout: "osdmap_epoch": 86, 2023-07-14T18:12:20.530 INFO:teuthology.orchestra.run.smithi163.stdout: "osdmap_epoch_barrier": 84, 2023-07-14T18:12:20.530 INFO:teuthology.orchestra.run.smithi163.stdout: "uptime": 83.406665756999999 2023-07-14T18:12:20.530 INFO:teuthology.orchestra.run.smithi163.stdout:} 2023-07-14T18:12:20.531 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.476+0000 7f4b28b06700 1 -- 172.21.15.163:0/863712490 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f4b0c0a11e0 msgr2=0x7f4b0c0a3690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:12:20.532 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.476+0000 7f4b28b06700 1 --2- 172.21.15.163:0/863712490 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f4b0c0a11e0 0x7f4b0c0a3690 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f4b18005950 tx=0x7f4b1800b410 comp rx=0 tx=0).stop 2023-07-14T18:12:20.532 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.476+0000 7f4b28b06700 1 -- 172.21.15.163:0/863712490 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f4b240ffdc0 msgr2=0x7f4b24195df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:12:20.532 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.476+0000 7f4b28b06700 1 --2- 172.21.15.163:0/863712490 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f4b240ffdc0 0x7f4b24195df0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f4b14005950 tx=0x7f4b14009580 comp rx=0 tx=0).stop 2023-07-14T18:12:20.532 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.476+0000 7f4b28b06700 1 -- 172.21.15.163:0/863712490 shutdown_connections 2023-07-14T18:12:20.532 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.476+0000 7f4b28b06700 1 --2- 172.21.15.163:0/863712490 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f4b0c0a11e0 0x7f4b0c0a3690 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:20.532 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.476+0000 7f4b28b06700 1 --2- 172.21.15.163:0/863712490 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4b24100770 0x7f4b2419ce60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:20.533 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.476+0000 7f4b28b06700 1 --2- 172.21.15.163:0/863712490 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4b240feb30 0x7f4b241958b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:20.533 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.476+0000 7f4b28b06700 1 --2- 172.21.15.163:0/863712490 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f4b240ffdc0 0x7f4b24195df0 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:20.533 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.476+0000 7f4b28b06700 1 -- 172.21.15.163:0/863712490 >> 172.21.15.163:0/863712490 conn(0x7f4b240fa150 msgr2=0x7f4b240fc480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:12:20.533 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.476+0000 7f4b28b06700 1 -- 172.21.15.163:0/863712490 shutdown_connections 2023-07-14T18:12:20.533 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.476+0000 7f4b28b06700 1 -- 172.21.15.163:0/863712490 wait complete. 2023-07-14T18:12:20.533 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2023-07-14T18:12:20.658 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.615+0000 7f17601d2700 1 -- 172.21.15.163:0/2547133770 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f17581017a0 msgr2=0x7f1758108060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:12:20.658 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.615+0000 7f17601d2700 1 --2- 172.21.15.163:0/2547133770 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f17581017a0 0x7f1758108060 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f175000b0a0 tx=0x7f175000b3b0 comp rx=0 tx=0).stop 2023-07-14T18:12:20.658 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.615+0000 7f17601d2700 1 -- 172.21.15.163:0/2547133770 shutdown_connections 2023-07-14T18:12:20.658 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.615+0000 7f17601d2700 1 --2- 172.21.15.163:0/2547133770 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f17580ffc20 0x7f1758100030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:20.658 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.615+0000 7f17601d2700 1 --2- 172.21.15.163:0/2547133770 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f17581017a0 0x7f1758108060 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:20.659 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.615+0000 7f17601d2700 1 --2- 172.21.15.163:0/2547133770 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1758100e10 0x7f1758101260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:20.659 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.615+0000 7f17601d2700 1 -- 172.21.15.163:0/2547133770 >> 172.21.15.163:0/2547133770 conn(0x7f17580fb260 msgr2=0x7f17580fd670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:12:20.659 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.615+0000 7f17601d2700 1 -- 172.21.15.163:0/2547133770 shutdown_connections 2023-07-14T18:12:20.659 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.615+0000 7f17601d2700 1 -- 172.21.15.163:0/2547133770 wait complete. 2023-07-14T18:12:20.659 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.616+0000 7f17601d2700 1 Processor -- start 2023-07-14T18:12:20.659 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.616+0000 7f17601d2700 1 -- start start 2023-07-14T18:12:20.660 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.616+0000 7f17601d2700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f17580ffc20 0x7f17580743f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:12:20.660 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.616+0000 7f17601d2700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1758100e10 0x7f1758072a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:12:20.660 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.616+0000 7f17601d2700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f17581017a0 0x7f1758072f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:12:20.661 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.616+0000 7f17601d2700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1758073710 con 0x7f17581017a0 2023-07-14T18:12:20.661 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.616+0000 7f17601d2700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1758073880 con 0x7f17580ffc20 2023-07-14T18:12:20.661 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.616+0000 7f17601d2700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f175819f9f0 con 0x7f1758100e10 2023-07-14T18:12:20.661 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.616+0000 7f175e76f700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f17581017a0 0x7f1758072f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:12:20.661 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.616+0000 7f175e76f700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f17581017a0 0x7f1758072f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:57160/0 (socket says 172.21.15.163:57160) 2023-07-14T18:12:20.661 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.616+0000 7f175e76f700 1 -- 172.21.15.163:0/781344572 learned_addr learned my addr 172.21.15.163:0/781344572 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:12:20.661 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.616+0000 7f175d76d700 1 --2- 172.21.15.163:0/781344572 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1758100e10 0x7f1758072a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:12:20.662 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.616+0000 7f175df6e700 1 --2- 172.21.15.163:0/781344572 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f17580ffc20 0x7f17580743f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:12:20.662 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.616+0000 7f175e76f700 1 -- 172.21.15.163:0/781344572 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1758100e10 msgr2=0x7f1758072a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:12:20.662 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.616+0000 7f175e76f700 1 --2- 172.21.15.163:0/781344572 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1758100e10 0x7f1758072a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:20.662 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.616+0000 7f175e76f700 1 -- 172.21.15.163:0/781344572 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f17580ffc20 msgr2=0x7f17580743f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:12:20.662 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.616+0000 7f175e76f700 1 --2- 172.21.15.163:0/781344572 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f17580ffc20 0x7f17580743f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:20.663 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.616+0000 7f175e76f700 1 -- 172.21.15.163:0/781344572 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1750009d00 con 0x7f17581017a0 2023-07-14T18:12:20.663 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.617+0000 7f175e76f700 1 --2- 172.21.15.163:0/781344572 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f17581017a0 0x7f1758072f70 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f175000b830 tx=0x7f1750004ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:12:20.663 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.617+0000 7f174effd700 1 -- 172.21.15.163:0/781344572 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f175000e040 con 0x7f17581017a0 2023-07-14T18:12:20.663 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.617+0000 7f174effd700 1 -- 172.21.15.163:0/781344572 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f1750009440 con 0x7f17581017a0 2023-07-14T18:12:20.663 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.617+0000 7f174effd700 1 -- 172.21.15.163:0/781344572 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f175001db60 con 0x7f17581017a0 2023-07-14T18:12:20.663 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.617+0000 7f17601d2700 1 -- 172.21.15.163:0/781344572 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f175819fc70 con 0x7f17581017a0 2023-07-14T18:12:20.664 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.617+0000 7f17601d2700 1 -- 172.21.15.163:0/781344572 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f17581a0090 con 0x7f17581017a0 2023-07-14T18:12:20.675 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.619+0000 7f174effd700 1 -- 172.21.15.163:0/781344572 <== mon.0 v2:172.21.15.163:3300/0 4 ==== mgrmap(e 17) v1 ==== 135767+0+0 (secure 0 0 0) 0x7f1750005450 con 0x7f17581017a0 2023-07-14T18:12:20.675 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.619+0000 7f174effd700 1 --2- 172.21.15.163:0/781344572 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f17440a12e0 0x7f17440a3790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:12:20.675 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.620+0000 7f174effd700 1 -- 172.21.15.163:0/781344572 <== mon.0 v2:172.21.15.163:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 9020+0+0 (secure 0 0 0) 0x7f17500ce6b0 con 0x7f17581017a0 2023-07-14T18:12:20.676 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.620+0000 7f175df6e700 1 --2- 172.21.15.163:0/781344572 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f17440a12e0 0x7f17440a3790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:12:20.676 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.620+0000 7f175df6e700 1 --2- 172.21.15.163:0/781344572 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f17440a12e0 0x7f17440a3790 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f1758100c70 tx=0x7f174800b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:12:20.676 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.620+0000 7f176c36ab80 1 Processor -- start 2023-07-14T18:12:20.676 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.620+0000 7f176c36ab80 1 -- start start 2023-07-14T18:12:20.677 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.621+0000 7f176c36ab80 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55a079e3bf10 0x55a079e3c320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:12:20.677 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.621+0000 7f176c36ab80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a079e3c860 0x55a079e3ce80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:12:20.677 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.621+0000 7f176c36ab80 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a079e3d460 0x55a079e3d8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:12:20.677 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.621+0000 7f176c36ab80 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a079d40c60 con 0x55a079e3bf10 2023-07-14T18:12:20.677 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.621+0000 7f176c36ab80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a079d939f0 con 0x55a079e3c860 2023-07-14T18:12:20.677 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.621+0000 7f176c36ab80 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a079d8ce80 con 0x55a079e3d460 2023-07-14T18:12:20.678 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.621+0000 7f175df6e700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55a079e3bf10 0x55a079e3c320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:12:20.678 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.621+0000 7f175df6e700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55a079e3bf10 0x55a079e3c320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:57164/0 (socket says 172.21.15.163:57164) 2023-07-14T18:12:20.678 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.621+0000 7f175df6e700 1 -- 172.21.15.163:0/3090788734 learned_addr learned my addr 172.21.15.163:0/3090788734 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:12:20.678 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.621+0000 7f175d76d700 1 --2- 172.21.15.163:0/3090788734 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a079e3c860 0x55a079e3ce80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:12:20.678 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.621+0000 7f175e76f700 1 --2- 172.21.15.163:0/3090788734 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a079e3d460 0x55a079e3d8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:12:20.678 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.621+0000 7f175df6e700 1 -- 172.21.15.163:0/3090788734 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a079e3d460 msgr2=0x55a079e3d8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:12:20.678 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.621+0000 7f175df6e700 1 --2- 172.21.15.163:0/3090788734 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a079e3d460 0x55a079e3d8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:20.679 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.621+0000 7f175df6e700 1 -- 172.21.15.163:0/3090788734 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a079e3c860 msgr2=0x55a079e3ce80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:12:20.679 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.621+0000 7f175df6e700 1 --2- 172.21.15.163:0/3090788734 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a079e3c860 0x55a079e3ce80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:20.679 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.621+0000 7f175df6e700 1 -- 172.21.15.163:0/3090788734 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a079bbad90 con 0x55a079e3bf10 2023-07-14T18:12:20.679 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.621+0000 7f175e76f700 1 --2- 172.21.15.163:0/3090788734 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a079e3d460 0x55a079e3d8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T18:12:20.680 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.621+0000 7f175df6e700 1 --2- 172.21.15.163:0/3090788734 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55a079e3bf10 0x55a079e3c320 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f1748010fa0 tx=0x7f1748013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a8422a9b7ef09d3b server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:12:20.680 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.621+0000 7f1743fff700 1 -- 172.21.15.163:0/3090788734 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1748011db0 con 0x55a079e3bf10 2023-07-14T18:12:20.680 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.621+0000 7f1743fff700 1 -- 172.21.15.163:0/3090788734 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f1748015070 con 0x55a079e3bf10 2023-07-14T18:12:20.680 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.621+0000 7f1743fff700 1 -- 172.21.15.163:0/3090788734 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f174801c5d0 con 0x55a079e3bf10 2023-07-14T18:12:20.681 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.622+0000 7f176c36ab80 1 -- 172.21.15.163:0/3090788734 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55a079e3bf10 msgr2=0x55a079e3c320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:12:20.681 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.622+0000 7f176c36ab80 1 --2- 172.21.15.163:0/3090788734 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55a079e3bf10 0x55a079e3c320 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f1748010fa0 tx=0x7f1748013000 comp rx=0 tx=0).stop 2023-07-14T18:12:20.681 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.622+0000 7f176c36ab80 1 -- 172.21.15.163:0/3090788734 shutdown_connections 2023-07-14T18:12:20.682 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.622+0000 7f176c36ab80 1 --2- 172.21.15.163:0/3090788734 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a079e3d460 0x55a079e3d8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:20.682 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.622+0000 7f176c36ab80 1 --2- 172.21.15.163:0/3090788734 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55a079e3bf10 0x55a079e3c320 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:20.682 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.622+0000 7f176c36ab80 1 --2- 172.21.15.163:0/3090788734 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a079e3c860 0x55a079e3ce80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:20.682 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.622+0000 7f176c36ab80 1 -- 172.21.15.163:0/3090788734 >> 172.21.15.163:0/3090788734 conn(0x55a079e31630 msgr2=0x55a079e36980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:12:20.683 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.622+0000 7f176c36ab80 1 -- 172.21.15.163:0/3090788734 shutdown_connections 2023-07-14T18:12:20.683 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.622+0000 7f176c36ab80 1 -- 172.21.15.163:0/3090788734 wait complete. 2023-07-14T18:12:20.683 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.622+0000 7f176c36ab80 1 -- start start 2023-07-14T18:12:20.683 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.623+0000 7f176c36ab80 1 Processor -- start 2023-07-14T18:12:20.684 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.623+0000 7f176c36ab80 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a079e3bf10 0x55a079e458a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:12:20.684 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.623+0000 7f176c36ab80 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55a079e3c860 0x55a079e45de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:12:20.684 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.623+0000 7f176c36ab80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a079e3d460 0x55a079e4ce20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:12:20.685 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.623+0000 7f176c36ab80 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a079d2ca70 con 0x55a079e3c860 2023-07-14T18:12:20.685 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.623+0000 7f176c36ab80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a079d2c770 con 0x55a079e3d460 2023-07-14T18:12:20.685 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.623+0000 7f176c36ab80 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a079c108d0 con 0x55a079e3bf10 2023-07-14T18:12:20.685 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.623+0000 7f176c36ab80 10 client.0 _ll_register_callbacks cb 0x55a079d2a710 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T18:12:20.686 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.623+0000 7f175d76d700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55a079e3c860 0x55a079e45de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:12:20.686 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.623+0000 7f175d76d700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55a079e3c860 0x55a079e45de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:57172/0 (socket says 172.21.15.163:57172) 2023-07-14T18:12:20.686 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.623+0000 7f175d76d700 1 -- 172.21.15.163:0/265396740 learned_addr learned my addr 172.21.15.163:0/265396740 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:12:20.687 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.623+0000 7f175e76f700 1 --2- 172.21.15.163:0/265396740 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a079e3d460 0x55a079e4ce20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:12:20.687 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.624+0000 7f175d76d700 1 -- 172.21.15.163:0/265396740 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a079e3bf10 msgr2=0x55a079e458a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:12:20.687 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.624+0000 7f175df6e700 1 --2- 172.21.15.163:0/265396740 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a079e3bf10 0x55a079e458a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:12:20.688 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.624+0000 7f175d76d700 1 --2- 172.21.15.163:0/265396740 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a079e3bf10 0x55a079e458a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:20.688 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.624+0000 7f175d76d700 1 -- 172.21.15.163:0/265396740 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a079e3d460 msgr2=0x55a079e4ce20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:12:20.688 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.624+0000 7f175d76d700 1 --2- 172.21.15.163:0/265396740 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a079e3d460 0x55a079e4ce20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:20.688 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.624+0000 7f175d76d700 1 -- 172.21.15.163:0/265396740 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1748010c50 con 0x55a079e3c860 2023-07-14T18:12:20.688 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.624+0000 7f175df6e700 1 --2- 172.21.15.163:0/265396740 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a079e3bf10 0x55a079e458a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T18:12:20.688 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.624+0000 7f175d76d700 1 --2- 172.21.15.163:0/265396740 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55a079e3c860 0x55a079e45de0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f1754007fd0 tx=0x7f17540117d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=70bcdb9b3af987b0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:12:20.688 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.624+0000 7f17417fa700 10 client.0 ms_handle_connect on v2:172.21.15.163:3300/0 2023-07-14T18:12:20.689 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.624+0000 7f17417fa700 1 -- 172.21.15.163:0/265396740 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1754016070 con 0x55a079e3c860 2023-07-14T18:12:20.689 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.624+0000 7f17417fa700 1 -- 172.21.15.163:0/265396740 <== mon.0 v2:172.21.15.163:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 9020+0+0 (secure 0 0 0) 0x7f1754004030 con 0x55a079e3c860 2023-07-14T18:12:20.689 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.624+0000 7f176c36ab80 1 -- 172.21.15.163:0/265396740 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55a079ce64a0 con 0x55a079e3c860 2023-07-14T18:12:20.689 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.624+0000 7f17417fa700 1 -- 172.21.15.163:0/265396740 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7f17540041f0 con 0x55a079e3c860 2023-07-14T18:12:20.689 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.624+0000 7f176c36ab80 10 client.15306 fetch_fsmap learned FSMap version 28 2023-07-14T18:12:20.689 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.624+0000 7f176c36ab80 1 -- 172.21.15.163:0/265396740 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) v3 -- 0x55a079ba3c10 con 0x55a079e3c860 2023-07-14T18:12:20.689 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.624+0000 7f17417fa700 1 -- 172.21.15.163:0/265396740 <== mon.0 v2:172.21.15.163:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55a079ce64a0 con 0x55a079e3c860 2023-07-14T18:12:20.690 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.624+0000 7f17417fa700 1 -- 172.21.15.163:0/265396740 <== mon.0 v2:172.21.15.163:3300/0 5 ==== fsmap(e 28) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f1754010640 con 0x55a079e3c860 2023-07-14T18:12:20.690 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.624+0000 7f176c36ab80 10 client.15306 fetch_fsmap finished waiting for FSMap version 28 2023-07-14T18:12:20.690 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.624+0000 7f176c36ab80 10 client.15306 resolve_mds: resolved name 'b' to daemon mds.b 2023-07-14T18:12:20.690 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.624+0000 7f176c36ab80 20 client.15306 populate_metadata read hostname 'smithi163' 2023-07-14T18:12:20.690 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.624+0000 7f176c36ab80 1 --2- 172.21.15.163:0/265396740 >> [v2:172.21.15.172:6838/3850440096,v1:172.21.15.172:6839/3850440096] conn(0x55a079e50c00 0x55a079e4ffd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:12:20.690 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.624+0000 7f176c36ab80 4 client.15306 mds_command: new command op to 24518 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-14T18:12:20.690 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.624+0000 7f176c36ab80 1 -- 172.21.15.163:0/265396740 --> [v2:172.21.15.172:6838/3850440096,v1:172.21.15.172:6839/3850440096] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55a079e0ad50 con 0x55a079e50c00 2023-07-14T18:12:20.691 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.625+0000 7f175df6e700 1 --2- 172.21.15.163:0/265396740 >> [v2:172.21.15.172:6838/3850440096,v1:172.21.15.172:6839/3850440096] conn(0x55a079e50c00 0x55a079e4ffd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:12:20.691 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.625+0000 7f175df6e700 1 --2- 172.21.15.163:0/265396740 >> [v2:172.21.15.172:6838/3850440096,v1:172.21.15.172:6839/3850440096] conn(0x55a079e50c00 0x55a079e4ffd0 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5be0dcf820146e2d server_cookie=2f3f58e192cbc972 in_seq=0 out_seq=0 2023-07-14T18:12:20.691 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.625+0000 7f17417fa700 10 client.15306 ms_handle_connect on v2:172.21.15.172:6838/3850440096 2023-07-14T18:12:20.691 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.626+0000 7f17417fa700 1 -- 172.21.15.163:0/265396740 <== mds.0 v2:172.21.15.172:6838/3850440096 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18017 (crc 0 0 0) 0x55a079e0ad50 con 0x55a079e50c00 2023-07-14T18:12:20.691 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.626+0000 7f17417fa700 10 client.15306 handle_command_reply: tid=0 2023-07-14T18:12:20.691 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.626+0000 7f176c36ab80 1 client.15306 shutdown 2023-07-14T18:12:20.691 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.626+0000 7f176c36ab80 1 -- 172.21.15.163:0/265396740 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55a079e3c860 msgr2=0x55a079e45de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:12:20.691 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.626+0000 7f176c36ab80 1 --2- 172.21.15.163:0/265396740 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55a079e3c860 0x55a079e45de0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f1754007fd0 tx=0x7f17540117d0 comp rx=0 tx=0).stop 2023-07-14T18:12:20.692 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.626+0000 7f176c36ab80 1 -- 172.21.15.163:0/265396740 shutdown_connections 2023-07-14T18:12:20.692 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.626+0000 7f176c36ab80 1 --2- 172.21.15.163:0/265396740 >> [v2:172.21.15.172:6838/3850440096,v1:172.21.15.172:6839/3850440096] conn(0x55a079e50c00 0x55a079e4ffd0 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:20.692 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.626+0000 7f176c36ab80 1 --2- 172.21.15.163:0/265396740 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a079e3bf10 0x55a079e458a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:20.692 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.626+0000 7f176c36ab80 1 --2- 172.21.15.163:0/265396740 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a079e3d460 0x55a079e4ce20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:20.692 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.626+0000 7f176c36ab80 1 --2- 172.21.15.163:0/265396740 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55a079e3c860 0x55a079e45de0 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:20.692 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.626+0000 7f17417fa700 0 client.15306 ms_handle_reset on v2:172.21.15.172:6838/3850440096 2023-07-14T18:12:20.693 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.626+0000 7f176c36ab80 1 -- 172.21.15.163:0/265396740 >> 172.21.15.163:0/265396740 conn(0x55a079e31630 msgr2=0x55a079e35600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:12:20.693 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.626+0000 7f176c36ab80 1 -- 172.21.15.163:0/265396740 shutdown_connections 2023-07-14T18:12:20.693 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.626+0000 7f176c36ab80 1 -- 172.21.15.163:0/265396740 wait complete. 2023-07-14T18:12:20.693 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.626+0000 7f176c36ab80 20 client.15306 trim_cache size 0 max 16384 2023-07-14T18:12:20.697 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.644+0000 7f176c36ab80 1 Processor -- start 2023-07-14T18:12:20.698 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.644+0000 7f176c36ab80 1 -- start start 2023-07-14T18:12:20.698 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.644+0000 7f176c36ab80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a079e3bf10 0x55a079e360a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:12:20.698 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.644+0000 7f176c36ab80 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55a079e3c860 0x55a079e4cde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:12:20.699 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.644+0000 7f176c36ab80 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a079e3d460 0x55a079e43770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:12:20.699 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.644+0000 7f176c36ab80 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a079d5b790 con 0x55a079e3c860 2023-07-14T18:12:20.699 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.644+0000 7f176c36ab80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a079c1cde0 con 0x55a079e3bf10 2023-07-14T18:12:20.699 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.644+0000 7f176c36ab80 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a079d4b480 con 0x55a079e3d460 2023-07-14T18:12:20.700 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.644+0000 7f175d76d700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55a079e3c860 0x55a079e4cde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:12:20.700 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.644+0000 7f175d76d700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55a079e3c860 0x55a079e4cde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:57180/0 (socket says 172.21.15.163:57180) 2023-07-14T18:12:20.700 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.644+0000 7f175d76d700 1 -- 172.21.15.163:0/3610259834 learned_addr learned my addr 172.21.15.163:0/3610259834 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:12:20.700 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.644+0000 7f175e76f700 1 --2- 172.21.15.163:0/3610259834 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a079e3d460 0x55a079e43770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:12:20.701 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.644+0000 7f175d76d700 1 -- 172.21.15.163:0/3610259834 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a079e3d460 msgr2=0x55a079e43770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:12:20.701 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.644+0000 7f175d76d700 1 --2- 172.21.15.163:0/3610259834 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a079e3d460 0x55a079e43770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:20.701 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.644+0000 7f175d76d700 1 -- 172.21.15.163:0/3610259834 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a079e3bf10 msgr2=0x55a079e360a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:12:20.702 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.644+0000 7f175df6e700 1 --2- 172.21.15.163:0/3610259834 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a079e3bf10 0x55a079e360a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:12:20.702 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.644+0000 7f175d76d700 1 --2- 172.21.15.163:0/3610259834 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a079e3bf10 0x55a079e360a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:20.702 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.644+0000 7f175d76d700 1 -- 172.21.15.163:0/3610259834 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a079be1200 con 0x55a079e3c860 2023-07-14T18:12:20.702 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.644+0000 7f175df6e700 1 --2- 172.21.15.163:0/3610259834 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a079e3bf10 0x55a079e360a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T18:12:20.703 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.644+0000 7f175d76d700 1 --2- 172.21.15.163:0/3610259834 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55a079e3c860 0x55a079e4cde0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f1754000c00 tx=0x7f1754005960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ef00b9dc757a43f server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:12:20.703 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.645+0000 7f174cff9700 1 -- 172.21.15.163:0/3610259834 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1754016070 con 0x55a079e3c860 2023-07-14T18:12:20.703 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.645+0000 7f174cff9700 1 -- 172.21.15.163:0/3610259834 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f1754017040 con 0x55a079e3c860 2023-07-14T18:12:20.704 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.645+0000 7f174cff9700 1 -- 172.21.15.163:0/3610259834 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17540038e0 con 0x55a079e3c860 2023-07-14T18:12:20.704 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.645+0000 7f176c36ab80 1 -- 172.21.15.163:0/3610259834 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55a079e3c860 msgr2=0x55a079e4cde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:12:20.704 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.645+0000 7f176c36ab80 1 --2- 172.21.15.163:0/3610259834 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55a079e3c860 0x55a079e4cde0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f1754000c00 tx=0x7f1754005960 comp rx=0 tx=0).stop 2023-07-14T18:12:20.704 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.645+0000 7f176c36ab80 1 -- 172.21.15.163:0/3610259834 shutdown_connections 2023-07-14T18:12:20.704 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.645+0000 7f176c36ab80 1 --2- 172.21.15.163:0/3610259834 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a079e3d460 0x55a079e43770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:20.705 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.645+0000 7f176c36ab80 1 --2- 172.21.15.163:0/3610259834 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a079e3bf10 0x55a079e360a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:20.705 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.645+0000 7f176c36ab80 1 --2- 172.21.15.163:0/3610259834 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55a079e3c860 0x55a079e4cde0 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:20.705 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.645+0000 7f176c36ab80 1 -- 172.21.15.163:0/3610259834 >> 172.21.15.163:0/3610259834 conn(0x55a079e31630 msgr2=0x55a079e32b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:12:20.705 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.645+0000 7f176c36ab80 1 -- 172.21.15.163:0/3610259834 shutdown_connections 2023-07-14T18:12:20.706 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.645+0000 7f176c36ab80 1 -- 172.21.15.163:0/3610259834 wait complete. 2023-07-14T18:12:20.706 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.645+0000 7f176c36ab80 1 -- start start 2023-07-14T18:12:20.706 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.646+0000 7f176c36ab80 1 Processor -- start 2023-07-14T18:12:20.706 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.646+0000 7f176c36ab80 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55a079e3bf10 0x55a079e48110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:12:20.706 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.646+0000 7f176c36ab80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a079e3c860 0x55a079e48650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:12:20.706 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.646+0000 7f176c36ab80 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a079e3d460 0x55a079e4b670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:12:20.706 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.646+0000 7f176c36ab80 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a079e4bbb0 con 0x55a079e3bf10 2023-07-14T18:12:20.706 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.646+0000 7f176c36ab80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a079e4bd20 con 0x55a079e3c860 2023-07-14T18:12:20.707 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.646+0000 7f176c36ab80 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a079e4bee0 con 0x55a079e3d460 2023-07-14T18:12:20.707 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.646+0000 7f176c36ab80 10 client.0 _ll_register_callbacks cb 0x7f1754007aa0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T18:12:20.707 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.646+0000 7f175df6e700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55a079e3bf10 0x55a079e48110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:12:20.707 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.646+0000 7f175df6e700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55a079e3bf10 0x55a079e48110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:57184/0 (socket says 172.21.15.163:57184) 2023-07-14T18:12:20.707 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.646+0000 7f175df6e700 1 -- 172.21.15.163:0/2265457574 learned_addr learned my addr 172.21.15.163:0/2265457574 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:12:20.707 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.646+0000 7f175df6e700 1 -- 172.21.15.163:0/2265457574 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a079e3d460 msgr2=0x55a079e4b670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:12:20.707 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.646+0000 7f175df6e700 1 --2- 172.21.15.163:0/2265457574 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a079e3d460 0x55a079e4b670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:20.708 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.646+0000 7f175df6e700 1 -- 172.21.15.163:0/2265457574 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a079e3c860 msgr2=0x55a079e48650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:12:20.708 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.646+0000 7f175df6e700 1 --2- 172.21.15.163:0/2265457574 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a079e3c860 0x55a079e48650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:20.708 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.646+0000 7f175df6e700 1 -- 172.21.15.163:0/2265457574 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55a079ba3c10 con 0x55a079e3bf10 2023-07-14T18:12:20.708 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.647+0000 7f175df6e700 1 --2- 172.21.15.163:0/2265457574 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55a079e3bf10 0x55a079e48110 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f1748011010 tx=0x7f174800b480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ebd71098b9ac99a1 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:12:20.708 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.647+0000 7f17417fa700 10 client.0 ms_handle_connect on v2:172.21.15.163:3300/0 2023-07-14T18:12:20.708 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.647+0000 7f17417fa700 1 -- 172.21.15.163:0/2265457574 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f174801e520 con 0x55a079e3bf10 2023-07-14T18:12:20.708 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.647+0000 7f176c36ab80 1 -- 172.21.15.163:0/2265457574 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f1748015070 con 0x55a079e3bf10 2023-07-14T18:12:20.709 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.647+0000 7f17417fa700 1 -- 172.21.15.163:0/2265457574 <== mon.0 v2:172.21.15.163:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 9020+0+0 (secure 0 0 0) 0x7f1748017070 con 0x55a079e3bf10 2023-07-14T18:12:20.709 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.647+0000 7f17417fa700 1 -- 172.21.15.163:0/2265457574 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7f174801e680 con 0x55a079e3bf10 2023-07-14T18:12:20.709 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.647+0000 7f176c36ab80 10 client.15312 fetch_fsmap learned FSMap version 28 2023-07-14T18:12:20.709 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.647+0000 7f176c36ab80 1 -- 172.21.15.163:0/2265457574 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) v3 -- 0x55a079bb9260 con 0x55a079e3bf10 2023-07-14T18:12:20.709 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.647+0000 7f17417fa700 1 -- 172.21.15.163:0/2265457574 <== mon.0 v2:172.21.15.163:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f1748015070 con 0x55a079e3bf10 2023-07-14T18:12:20.710 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.647+0000 7f17417fa700 1 -- 172.21.15.163:0/2265457574 <== mon.0 v2:172.21.15.163:3300/0 5 ==== fsmap(e 28) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f1748031410 con 0x55a079e3bf10 2023-07-14T18:12:20.710 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.647+0000 7f176c36ab80 10 client.15312 fetch_fsmap finished waiting for FSMap version 28 2023-07-14T18:12:20.710 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.647+0000 7f176c36ab80 10 client.15312 resolve_mds: resolved name 'b' to daemon mds.b 2023-07-14T18:12:20.710 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.647+0000 7f176c36ab80 20 client.15312 populate_metadata read hostname 'smithi163' 2023-07-14T18:12:20.710 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.647+0000 7f176c36ab80 1 --2- 172.21.15.163:0/2265457574 >> [v2:172.21.15.172:6838/3850440096,v1:172.21.15.172:6839/3850440096] conn(0x55a079eaa120 0x55a079ea69d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:12:20.710 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.647+0000 7f176c36ab80 4 client.15312 mds_command: new command op to 24518 tid=0[{"prefix": "status"}] 2023-07-14T18:12:20.710 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.647+0000 7f176c36ab80 1 -- 172.21.15.163:0/2265457574 --> [v2:172.21.15.172:6838/3850440096,v1:172.21.15.172:6839/3850440096] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55a079d85e60 con 0x55a079eaa120 2023-07-14T18:12:20.711 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.648+0000 7f175d76d700 1 --2- 172.21.15.163:0/2265457574 >> [v2:172.21.15.172:6838/3850440096,v1:172.21.15.172:6839/3850440096] conn(0x55a079eaa120 0x55a079ea69d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:12:20.711 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.648+0000 7f17417fa700 10 client.15312 ms_handle_connect on v2:172.21.15.172:6838/3850440096 2023-07-14T18:12:20.711 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.648+0000 7f175d76d700 1 --2- 172.21.15.163:0/2265457574 >> [v2:172.21.15.172:6838/3850440096,v1:172.21.15.172:6839/3850440096] conn(0x55a079eaa120 0x55a079ea69d0 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d9d4f86972b13aed server_cookie=7a07550386a122ed in_seq=0 out_seq=0 2023-07-14T18:12:20.711 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.648+0000 7f17417fa700 1 -- 172.21.15.163:0/2265457574 <== mds.0 v2:172.21.15.172:6838/3850440096 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+332 (crc 0 0 0) 0x55a079d85e60 con 0x55a079eaa120 2023-07-14T18:12:20.711 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.648+0000 7f17417fa700 10 client.15312 handle_command_reply: tid=0 2023-07-14T18:12:20.711 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.648+0000 7f176c36ab80 1 client.15312 shutdown 2023-07-14T18:12:20.712 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.648+0000 7f176c36ab80 1 -- 172.21.15.163:0/2265457574 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55a079e3bf10 msgr2=0x55a079e48110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:12:20.712 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.648+0000 7f176c36ab80 1 --2- 172.21.15.163:0/2265457574 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55a079e3bf10 0x55a079e48110 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f1748011010 tx=0x7f174800b480 comp rx=0 tx=0).stop 2023-07-14T18:12:20.712 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.648+0000 7f176c36ab80 1 -- 172.21.15.163:0/2265457574 shutdown_connections 2023-07-14T18:12:20.713 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.648+0000 7f176c36ab80 1 --2- 172.21.15.163:0/2265457574 >> [v2:172.21.15.172:6838/3850440096,v1:172.21.15.172:6839/3850440096] conn(0x55a079eaa120 0x55a079ea69d0 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:20.713 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.648+0000 7f176c36ab80 1 --2- 172.21.15.163:0/2265457574 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a079e3d460 0x55a079e4b670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:20.713 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.648+0000 7f17417fa700 0 client.15312 ms_handle_reset on v2:172.21.15.172:6838/3850440096 2023-07-14T18:12:20.713 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.648+0000 7f176c36ab80 1 --2- 172.21.15.163:0/2265457574 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55a079e3bf10 0x55a079e48110 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:20.714 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.648+0000 7f176c36ab80 1 --2- 172.21.15.163:0/2265457574 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a079e3c860 0x55a079e48650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:20.714 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.648+0000 7f176c36ab80 1 -- 172.21.15.163:0/2265457574 >> 172.21.15.163:0/2265457574 conn(0x55a079e31630 msgr2=0x55a079e360a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:12:20.714 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.648+0000 7f176c36ab80 1 -- 172.21.15.163:0/2265457574 shutdown_connections 2023-07-14T18:12:20.714 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.649+0000 7f176c36ab80 1 -- 172.21.15.163:0/2265457574 wait complete. 2023-07-14T18:12:20.715 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.649+0000 7f176c36ab80 20 client.15312 trim_cache size 0 max 16384 2023-07-14T18:12:20.715 INFO:teuthology.orchestra.run.smithi163.stdout:{ 2023-07-14T18:12:20.716 INFO:teuthology.orchestra.run.smithi163.stdout: "cluster_fsid": "bf7326ec-2270-11ee-9b33-001a4aab830c", 2023-07-14T18:12:20.716 INFO:teuthology.orchestra.run.smithi163.stdout: "whoami": 0, 2023-07-14T18:12:20.716 INFO:teuthology.orchestra.run.smithi163.stdout: "id": 24518, 2023-07-14T18:12:20.717 INFO:teuthology.orchestra.run.smithi163.stdout: "want_state": "up:active", 2023-07-14T18:12:20.717 INFO:teuthology.orchestra.run.smithi163.stdout: "state": "up:active", 2023-07-14T18:12:20.717 INFO:teuthology.orchestra.run.smithi163.stdout: "fs_name": "cephfs", 2023-07-14T18:12:20.717 INFO:teuthology.orchestra.run.smithi163.stdout: "rank_uptime": 70.943013133999997, 2023-07-14T18:12:20.718 INFO:teuthology.orchestra.run.smithi163.stdout: "mdsmap_epoch": 28, 2023-07-14T18:12:20.718 INFO:teuthology.orchestra.run.smithi163.stdout: "osdmap_epoch": 86, 2023-07-14T18:12:20.718 INFO:teuthology.orchestra.run.smithi163.stdout: "osdmap_epoch_barrier": 84, 2023-07-14T18:12:20.718 INFO:teuthology.orchestra.run.smithi163.stdout: "uptime": 77.057121316999996 2023-07-14T18:12:20.718 INFO:teuthology.orchestra.run.smithi163.stdout:} 2023-07-14T18:12:20.719 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.649+0000 7f17601d2700 1 -- 172.21.15.163:0/781344572 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f17440a12e0 msgr2=0x7f17440a3790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:12:20.720 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.649+0000 7f17601d2700 1 --2- 172.21.15.163:0/781344572 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f17440a12e0 0x7f17440a3790 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f1758100c70 tx=0x7f174800b410 comp rx=0 tx=0).stop 2023-07-14T18:12:20.720 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.649+0000 7f17601d2700 1 -- 172.21.15.163:0/781344572 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f17581017a0 msgr2=0x7f1758072f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:12:20.720 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.649+0000 7f17601d2700 1 --2- 172.21.15.163:0/781344572 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f17581017a0 0x7f1758072f70 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f175000b830 tx=0x7f1750004ce0 comp rx=0 tx=0).stop 2023-07-14T18:12:20.720 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.649+0000 7f17601d2700 1 -- 172.21.15.163:0/781344572 shutdown_connections 2023-07-14T18:12:20.720 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.649+0000 7f17601d2700 1 --2- 172.21.15.163:0/781344572 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f17440a12e0 0x7f17440a3790 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:20.720 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.649+0000 7f17601d2700 1 --2- 172.21.15.163:0/781344572 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f17581017a0 0x7f1758072f70 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:20.721 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.649+0000 7f17601d2700 1 --2- 172.21.15.163:0/781344572 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f17580ffc20 0x7f17580743f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:20.721 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.649+0000 7f17601d2700 1 --2- 172.21.15.163:0/781344572 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1758100e10 0x7f1758072a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:20.721 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.649+0000 7f17601d2700 1 -- 172.21.15.163:0/781344572 >> 172.21.15.163:0/781344572 conn(0x7f17580fb260 msgr2=0x7f17581042f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:12:20.721 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.649+0000 7f17601d2700 1 -- 172.21.15.163:0/781344572 shutdown_connections 2023-07-14T18:12:20.722 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:20.649+0000 7f17601d2700 1 -- 172.21.15.163:0/781344572 wait complete. 2023-07-14T18:12:20.722 INFO:tasks.cephadm:Setup complete, yielding 2023-07-14T18:12:20.723 INFO:teuthology.run_tasks:Running task cephadm.shell... 2023-07-14T18:12:20.734 INFO:tasks.cephadm:Running commands on role mon.a host ubuntu@smithi163.front.sepia.ceph.com 2023-07-14T18:12:20.734 DEBUG:teuthology.orchestra.run.smithi163:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81c9387d2e7576da065747ec9c16d1c7d69016ec shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bf7326ec-2270-11ee-9b33-001a4aab830c -- bash -c 'ceph orch status' 2023-07-14T18:12:21.175 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:12:20 smithi184 ceph-mon[98481]: pgmap v288: 129 pgs: 2 peering, 127 active+clean; 643 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-07-14T18:12:21.217 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:12:20 smithi163 ceph-mon[96576]: pgmap v288: 129 pgs: 2 peering, 127 active+clean; 643 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-07-14T18:12:21.275 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:12:20 smithi172 ceph-mon[97983]: pgmap v288: 129 pgs: 2 peering, 127 active+clean; 643 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-07-14T18:12:21.286 INFO:teuthology.orchestra.run.smithi163.stderr:Inferring config /var/lib/ceph/bf7326ec-2270-11ee-9b33-001a4aab830c/mon.a/config 2023-07-14T18:12:22.060 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:12:21 smithi163 ceph-mon[96576]: pgmap v289: 129 pgs: 129 active+clean; 643 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 8 op/s; 0 B/s, 0 objects/s recovering 2023-07-14T18:12:22.061 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:12:21 smithi163 ceph-mon[96576]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg inactive, 2 pgs peering) 2023-07-14T18:12:22.061 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:12:21 smithi163 ceph-mon[96576]: Cluster is now healthy 2023-07-14T18:12:22.175 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:12:21 smithi184 ceph-mon[98481]: pgmap v289: 129 pgs: 129 active+clean; 643 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 8 op/s; 0 B/s, 0 objects/s recovering 2023-07-14T18:12:22.175 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:12:21 smithi184 ceph-mon[98481]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg inactive, 2 pgs peering) 2023-07-14T18:12:22.175 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:12:21 smithi184 ceph-mon[98481]: Cluster is now healthy 2023-07-14T18:12:22.275 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:12:21 smithi172 ceph-mon[97983]: pgmap v289: 129 pgs: 129 active+clean; 643 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 8 op/s; 0 B/s, 0 objects/s recovering 2023-07-14T18:12:22.276 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:12:21 smithi172 ceph-mon[97983]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg inactive, 2 pgs peering) 2023-07-14T18:12:22.276 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:12:21 smithi172 ceph-mon[97983]: Cluster is now healthy 2023-07-14T18:12:22.515 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:22.473+0000 7f2e51100700 1 -- 172.21.15.163:0/3715021345 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f2e4c1030c0 msgr2=0x7f2e4c1054a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:12:22.516 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:22.473+0000 7f2e51100700 1 --2- 172.21.15.163:0/3715021345 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f2e4c1030c0 0x7f2e4c1054a0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f2e40009990 tx=0x7f2e40009ca0 comp rx=0 tx=0).stop 2023-07-14T18:12:22.516 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:22.473+0000 7f2e51100700 1 -- 172.21.15.163:0/3715021345 shutdown_connections 2023-07-14T18:12:22.516 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:22.473+0000 7f2e51100700 1 --2- 172.21.15.163:0/3715021345 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2e4c1007a0 0x7f2e4c102b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:22.516 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:22.473+0000 7f2e51100700 1 --2- 172.21.15.163:0/3715021345 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2e4c1059e0 0x7f2e4c107de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:22.516 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:22.473+0000 7f2e51100700 1 --2- 172.21.15.163:0/3715021345 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f2e4c1030c0 0x7f2e4c1054a0 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:22.517 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:22.473+0000 7f2e51100700 1 -- 172.21.15.163:0/3715021345 >> 172.21.15.163:0/3715021345 conn(0x7f2e4c0fa1e0 msgr2=0x7f2e4c0fc630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:12:22.517 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:22.473+0000 7f2e51100700 1 -- 172.21.15.163:0/3715021345 shutdown_connections 2023-07-14T18:12:22.517 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:22.474+0000 7f2e51100700 1 -- 172.21.15.163:0/3715021345 wait complete. 2023-07-14T18:12:22.517 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:22.474+0000 7f2e51100700 1 Processor -- start 2023-07-14T18:12:22.517 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:22.475+0000 7f2e51100700 1 -- start start 2023-07-14T18:12:22.518 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:22.475+0000 7f2e51100700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2e4c1007a0 0x7f2e4c195850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:12:22.519 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:22.475+0000 7f2e51100700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f2e4c1030c0 0x7f2e4c195d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:12:22.519 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:22.475+0000 7f2e51100700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2e4c1059e0 0x7f2e4c19ce10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:12:22.519 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:22.475+0000 7f2e51100700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e4c19d3e0 con 0x7f2e4c1030c0 2023-07-14T18:12:22.519 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:22.475+0000 7f2e51100700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e4c19d520 con 0x7f2e4c1007a0 2023-07-14T18:12:22.519 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:22.475+0000 7f2e51100700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e4c19d6b0 con 0x7f2e4c1059e0 2023-07-14T18:12:22.519 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:22.475+0000 7f2e4a59c700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f2e4c1030c0 0x7f2e4c195d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:12:22.519 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:22.475+0000 7f2e4a59c700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f2e4c1030c0 0x7f2e4c195d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:57198/0 (socket says 172.21.15.163:57198) 2023-07-14T18:12:22.520 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:22.475+0000 7f2e4a59c700 1 -- 172.21.15.163:0/2278294262 learned_addr learned my addr 172.21.15.163:0/2278294262 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:12:22.520 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:22.475+0000 7f2e4ad9d700 1 --2- 172.21.15.163:0/2278294262 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2e4c1007a0 0x7f2e4c195850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:12:22.520 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:22.475+0000 7f2e4b59e700 1 --2- 172.21.15.163:0/2278294262 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2e4c1059e0 0x7f2e4c19ce10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:12:22.520 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:22.475+0000 7f2e4a59c700 1 -- 172.21.15.163:0/2278294262 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2e4c1059e0 msgr2=0x7f2e4c19ce10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:12:22.520 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:22.475+0000 7f2e4a59c700 1 --2- 172.21.15.163:0/2278294262 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2e4c1059e0 0x7f2e4c19ce10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:22.520 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:22.475+0000 7f2e4a59c700 1 -- 172.21.15.163:0/2278294262 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2e4c1007a0 msgr2=0x7f2e4c195850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:12:22.520 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:22.475+0000 7f2e4a59c700 1 --2- 172.21.15.163:0/2278294262 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2e4c1007a0 0x7f2e4c195850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:22.521 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:22.475+0000 7f2e4a59c700 1 -- 172.21.15.163:0/2278294262 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e400095f0 con 0x7f2e4c1030c0 2023-07-14T18:12:22.521 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:22.475+0000 7f2e4a59c700 1 --2- 172.21.15.163:0/2278294262 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f2e4c1030c0 0x7f2e4c195d90 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f2e400059d0 tx=0x7f2e40003a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:12:22.521 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:22.476+0000 7f2e33fff700 1 -- 172.21.15.163:0/2278294262 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e4001d070 con 0x7f2e4c1030c0 2023-07-14T18:12:22.521 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:22.476+0000 7f2e33fff700 1 -- 172.21.15.163:0/2278294262 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f2e4000bd70 con 0x7f2e4c1030c0 2023-07-14T18:12:22.521 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:22.476+0000 7f2e51100700 1 -- 172.21.15.163:0/2278294262 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e4c19d930 con 0x7f2e4c1030c0 2023-07-14T18:12:22.521 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:22.476+0000 7f2e33fff700 1 -- 172.21.15.163:0/2278294262 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e40022cd0 con 0x7f2e4c1030c0 2023-07-14T18:12:22.521 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:22.476+0000 7f2e51100700 1 -- 172.21.15.163:0/2278294262 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e4c19dda0 con 0x7f2e4c1030c0 2023-07-14T18:12:22.521 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:22.477+0000 7f2e51100700 1 -- 172.21.15.163:0/2278294262 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2e4c0fbd50 con 0x7f2e4c1030c0 2023-07-14T18:12:22.522 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:22.478+0000 7f2e33fff700 1 -- 172.21.15.163:0/2278294262 <== mon.0 v2:172.21.15.163:3300/0 4 ==== mgrmap(e 17) v1 ==== 135767+0+0 (secure 0 0 0) 0x7f2e40022470 con 0x7f2e4c1030c0 2023-07-14T18:12:22.522 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:22.478+0000 7f2e33fff700 1 --2- 172.21.15.163:0/2278294262 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f2e340a1260 0x7f2e340a3710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:12:22.522 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:22.478+0000 7f2e33fff700 1 -- 172.21.15.163:0/2278294262 <== mon.0 v2:172.21.15.163:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 9020+0+0 (secure 0 0 0) 0x7f2e400ce300 con 0x7f2e4c1030c0 2023-07-14T18:12:22.523 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:22.478+0000 7f2e4ad9d700 1 --2- 172.21.15.163:0/2278294262 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f2e340a1260 0x7f2e340a3710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:12:22.523 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:22.479+0000 7f2e4ad9d700 1 --2- 172.21.15.163:0/2278294262 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f2e340a1260 0x7f2e340a3710 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f2e3c00ac50 tx=0x7f2e3c00a380 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:12:22.523 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:22.483+0000 7f2e33fff700 1 -- 172.21.15.163:0/2278294262 <== mon.0 v2:172.21.15.163:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178025 (secure 0 0 0) 0x7f2e40097710 con 0x7f2e4c1030c0 2023-07-14T18:12:22.724 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:22.683+0000 7f2e51100700 1 -- 172.21.15.163:0/2278294262 --> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] -- mgr_command(tid 0: {"prefix": "orch status", "target": ["mon-mgr", ""]}) v1 -- 0x7f2e4c060a80 con 0x7f2e340a1260 2023-07-14T18:12:22.725 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:22.685+0000 7f2e33fff700 1 -- 172.21.15.163:0/2278294262 <== mgr.14152 v2:172.21.15.163:6800/1949590926 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+43 (secure 0 0 0) 0x7f2e4c060a80 con 0x7f2e340a1260 2023-07-14T18:12:22.726 INFO:teuthology.orchestra.run.smithi163.stdout:Backend: cephadm 2023-07-14T18:12:22.726 INFO:teuthology.orchestra.run.smithi163.stdout:Available: Yes 2023-07-14T18:12:22.726 INFO:teuthology.orchestra.run.smithi163.stdout:Paused: No 2023-07-14T18:12:22.727 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:22.687+0000 7f2e51100700 1 -- 172.21.15.163:0/2278294262 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f2e340a1260 msgr2=0x7f2e340a3710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:12:22.728 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:22.687+0000 7f2e51100700 1 --2- 172.21.15.163:0/2278294262 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f2e340a1260 0x7f2e340a3710 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f2e3c00ac50 tx=0x7f2e3c00a380 comp rx=0 tx=0).stop 2023-07-14T18:12:22.728 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:22.687+0000 7f2e51100700 1 -- 172.21.15.163:0/2278294262 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f2e4c1030c0 msgr2=0x7f2e4c195d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:12:22.728 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:22.687+0000 7f2e51100700 1 --2- 172.21.15.163:0/2278294262 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f2e4c1030c0 0x7f2e4c195d90 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f2e400059d0 tx=0x7f2e40003a50 comp rx=0 tx=0).stop 2023-07-14T18:12:22.728 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:22.687+0000 7f2e51100700 1 -- 172.21.15.163:0/2278294262 shutdown_connections 2023-07-14T18:12:22.728 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:22.687+0000 7f2e51100700 1 --2- 172.21.15.163:0/2278294262 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f2e340a1260 0x7f2e340a3710 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:22.729 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:22.687+0000 7f2e51100700 1 --2- 172.21.15.163:0/2278294262 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2e4c1059e0 0x7f2e4c19ce10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:22.729 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:22.687+0000 7f2e51100700 1 --2- 172.21.15.163:0/2278294262 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2e4c1007a0 0x7f2e4c195850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:22.729 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:22.687+0000 7f2e51100700 1 --2- 172.21.15.163:0/2278294262 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f2e4c1030c0 0x7f2e4c195d90 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:22.729 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:22.687+0000 7f2e51100700 1 -- 172.21.15.163:0/2278294262 >> 172.21.15.163:0/2278294262 conn(0x7f2e4c0fa1e0 msgr2=0x7f2e4c101400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:12:22.729 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:22.687+0000 7f2e51100700 1 -- 172.21.15.163:0/2278294262 shutdown_connections 2023-07-14T18:12:22.729 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:22.687+0000 7f2e51100700 1 -- 172.21.15.163:0/2278294262 wait complete. 2023-07-14T18:12:23.106 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:12:22 smithi163 ceph-mon[96576]: from='client.15318 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2023-07-14T18:12:23.134 DEBUG:teuthology.orchestra.run.smithi163:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81c9387d2e7576da065747ec9c16d1c7d69016ec shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bf7326ec-2270-11ee-9b33-001a4aab830c -- bash -c 'ceph orch ps' 2023-07-14T18:12:23.175 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:12:22 smithi184 ceph-mon[98481]: from='client.15318 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2023-07-14T18:12:23.275 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:12:22 smithi172 ceph-mon[97983]: from='client.15318 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2023-07-14T18:12:23.687 INFO:teuthology.orchestra.run.smithi163.stderr:Inferring config /var/lib/ceph/bf7326ec-2270-11ee-9b33-001a4aab830c/mon.a/config 2023-07-14T18:12:24.175 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:12:23 smithi184 ceph-mon[98481]: pgmap v290: 129 pgs: 129 active+clean; 643 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 10 op/s; 0 B/s, 0 objects/s recovering 2023-07-14T18:12:24.178 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:12:23 smithi163 ceph-mon[96576]: pgmap v290: 129 pgs: 129 active+clean; 643 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 10 op/s; 0 B/s, 0 objects/s recovering 2023-07-14T18:12:24.275 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:12:23 smithi172 ceph-mon[97983]: pgmap v290: 129 pgs: 129 active+clean; 643 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 10 op/s; 0 B/s, 0 objects/s recovering 2023-07-14T18:12:24.893 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:24.850+0000 7f74f8513700 1 -- 172.21.15.163:0/3944678476 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f74f00febb0 msgr2=0x7f74f00fefc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:12:24.893 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:24.850+0000 7f74f8513700 1 --2- 172.21.15.163:0/3944678476 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f74f00febb0 0x7f74f00fefc0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f74ec009990 tx=0x7f74ec009ca0 comp rx=0 tx=0).stop 2023-07-14T18:12:24.893 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:24.850+0000 7f74f8513700 1 -- 172.21.15.163:0/3944678476 shutdown_connections 2023-07-14T18:12:24.893 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:24.850+0000 7f74f8513700 1 --2- 172.21.15.163:0/3944678476 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f74f0100740 0x7f74f0107000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:24.893 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:24.850+0000 7f74f8513700 1 --2- 172.21.15.163:0/3944678476 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f74f00febb0 0x7f74f00fefc0 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:24.894 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:24.850+0000 7f74f8513700 1 --2- 172.21.15.163:0/3944678476 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f74f00ffdb0 0x7f74f0100200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:24.894 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:24.850+0000 7f74f8513700 1 -- 172.21.15.163:0/3944678476 >> 172.21.15.163:0/3944678476 conn(0x7f74f00fa1e0 msgr2=0x7f74f00fc630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:12:24.894 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:24.850+0000 7f74f8513700 1 -- 172.21.15.163:0/3944678476 shutdown_connections 2023-07-14T18:12:24.894 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:24.850+0000 7f74f8513700 1 -- 172.21.15.163:0/3944678476 wait complete. 2023-07-14T18:12:24.894 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:24.850+0000 7f74f8513700 1 Processor -- start 2023-07-14T18:12:24.895 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:24.850+0000 7f74f8513700 1 -- start start 2023-07-14T18:12:24.895 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:24.850+0000 7f74f8513700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f74f00febb0 0x7f74f0068c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:12:24.895 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:24.851+0000 7f74f8513700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f74f00ffdb0 0x7f74f019a620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:12:24.895 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:24.851+0000 7f74f8513700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f74f0100740 0x7f74f019cc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:12:24.895 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:24.851+0000 7f74f8513700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74f019d400 con 0x7f74f00ffdb0 2023-07-14T18:12:24.895 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:24.851+0000 7f74f8513700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74f019d570 con 0x7f74f0100740 2023-07-14T18:12:24.895 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:24.851+0000 7f74f8513700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74f019d730 con 0x7f74f00febb0 2023-07-14T18:12:24.895 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:24.851+0000 7f74f5aae700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f74f00ffdb0 0x7f74f019a620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:12:24.896 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:24.851+0000 7f74f5aae700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f74f00ffdb0 0x7f74f019a620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:57210/0 (socket says 172.21.15.163:57210) 2023-07-14T18:12:24.896 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:24.851+0000 7f74f5aae700 1 -- 172.21.15.163:0/3464943547 learned_addr learned my addr 172.21.15.163:0/3464943547 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:12:24.896 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:24.851+0000 7f74f62af700 1 --2- 172.21.15.163:0/3464943547 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f74f00febb0 0x7f74f0068c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:12:24.896 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:24.851+0000 7f74f6ab0700 1 --2- 172.21.15.163:0/3464943547 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f74f0100740 0x7f74f019cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:12:24.896 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:24.851+0000 7f74f5aae700 1 -- 172.21.15.163:0/3464943547 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f74f00febb0 msgr2=0x7f74f0068c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:12:24.896 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:24.851+0000 7f74f5aae700 1 --2- 172.21.15.163:0/3464943547 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f74f00febb0 0x7f74f0068c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:24.896 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:24.851+0000 7f74f5aae700 1 -- 172.21.15.163:0/3464943547 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f74f0100740 msgr2=0x7f74f019cc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:12:24.897 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:24.851+0000 7f74f5aae700 1 --2- 172.21.15.163:0/3464943547 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f74f0100740 0x7f74f019cc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:24.897 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:24.851+0000 7f74f5aae700 1 -- 172.21.15.163:0/3464943547 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74ec0095f0 con 0x7f74f00ffdb0 2023-07-14T18:12:24.897 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:24.851+0000 7f74f5aae700 1 --2- 172.21.15.163:0/3464943547 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f74f00ffdb0 0x7f74f019a620 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f74e000e9a0 tx=0x7f74e000ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:12:24.897 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:24.851+0000 7f74e77fe700 1 -- 172.21.15.163:0/3464943547 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74e0009790 con 0x7f74f00ffdb0 2023-07-14T18:12:24.897 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:24.851+0000 7f74f8513700 1 -- 172.21.15.163:0/3464943547 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f74f0194450 con 0x7f74f00ffdb0 2023-07-14T18:12:24.897 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:24.851+0000 7f74e77fe700 1 -- 172.21.15.163:0/3464943547 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f74e000ce20 con 0x7f74f00ffdb0 2023-07-14T18:12:24.897 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:24.851+0000 7f74e77fe700 1 -- 172.21.15.163:0/3464943547 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74e0018420 con 0x7f74f00ffdb0 2023-07-14T18:12:24.897 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:24.851+0000 7f74f8513700 1 -- 172.21.15.163:0/3464943547 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f74f0194950 con 0x7f74f00ffdb0 2023-07-14T18:12:24.898 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:24.853+0000 7f74f8513700 1 -- 172.21.15.163:0/3464943547 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f74f0106250 con 0x7f74f00ffdb0 2023-07-14T18:12:24.898 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:24.854+0000 7f74e77fe700 1 -- 172.21.15.163:0/3464943547 <== mon.0 v2:172.21.15.163:3300/0 4 ==== mgrmap(e 17) v1 ==== 135767+0+0 (secure 0 0 0) 0x7f74e000c990 con 0x7f74f00ffdb0 2023-07-14T18:12:24.899 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:24.854+0000 7f74e77fe700 1 --2- 172.21.15.163:0/3464943547 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f74dc0a11e0 0x7f74dc0a3690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:12:24.899 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:24.854+0000 7f74f62af700 1 --2- 172.21.15.163:0/3464943547 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f74dc0a11e0 0x7f74dc0a3690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:12:24.899 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:24.854+0000 7f74e77fe700 1 -- 172.21.15.163:0/3464943547 <== mon.0 v2:172.21.15.163:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 9020+0+0 (secure 0 0 0) 0x7f74e0014070 con 0x7f74f00ffdb0 2023-07-14T18:12:24.899 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:24.855+0000 7f74f62af700 1 --2- 172.21.15.163:0/3464943547 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f74dc0a11e0 0x7f74dc0a3690 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f74ec005910 tx=0x7f74ec005960 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:12:24.899 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:24.858+0000 7f74e77fe700 1 -- 172.21.15.163:0/3464943547 <== mon.0 v2:172.21.15.163:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178025 (secure 0 0 0) 0x7f74e0051780 con 0x7f74f00ffdb0 2023-07-14T18:12:25.094 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:25.053+0000 7f74f8513700 1 -- 172.21.15.163:0/3464943547 --> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f74f0195d60 con 0x7f74dc0a11e0 2023-07-14T18:12:25.107 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:25.066+0000 7f74e77fe700 1 -- 172.21.15.163:0/3464943547 <== mgr.14152 v2:172.21.15.163:6800/1949590926 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+4185 (secure 0 0 0) 0x7f74f0195d60 con 0x7f74dc0a11e0 2023-07-14T18:12:25.107 INFO:teuthology.orchestra.run.smithi163.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2023-07-14T18:12:25.107 INFO:teuthology.orchestra.run.smithi163.stdout:mds.a smithi163 running (84s) - 83s - - 18.0.0-4940-g81c9387d 219b180907a8 5fc461a57d18 2023-07-14T18:12:25.107 INFO:teuthology.orchestra.run.smithi163.stdout:mds.b smithi172 running (81s) - 81s 31.0M - 18.0.0-4940-g81c9387d 219b180907a8 0448994255cf 2023-07-14T18:12:25.107 INFO:teuthology.orchestra.run.smithi163.stdout:mds.c smithi184 running (92s) - 92s 21.1M - 18.0.0-4940-g81c9387d 219b180907a8 90cff0cb1f48 2023-07-14T18:12:25.108 INFO:teuthology.orchestra.run.smithi163.stdout:mds.d smithi163 running (99s) - 98s - - 18.0.0-4940-g81c9387d 219b180907a8 78a7b48c8688 2023-07-14T18:12:25.108 INFO:teuthology.orchestra.run.smithi163.stdout:mds.e smithi172 running (97s) - 96s 18.0M - 18.0.0-4940-g81c9387d 219b180907a8 4952fddfb071 2023-07-14T18:12:25.108 INFO:teuthology.orchestra.run.smithi163.stdout:mds.f smithi184 running (95s) - 94s 20.3M - 18.0.0-4940-g81c9387d 219b180907a8 0c5d36ffdefc 2023-07-14T18:12:25.108 INFO:teuthology.orchestra.run.smithi163.stdout:mds.g smithi163 running (86s) - 85s - - 18.0.0-4940-g81c9387d 219b180907a8 7677e3c28fd6 2023-07-14T18:12:25.108 INFO:teuthology.orchestra.run.smithi163.stdout:mds.h smithi172 running (90s) - 90s 20.1M - 18.0.0-4940-g81c9387d 219b180907a8 f0d0d8642ba7 2023-07-14T18:12:25.108 INFO:teuthology.orchestra.run.smithi163.stdout:mds.i smithi184 running (88s) - 87s 18.8M - 18.0.0-4940-g81c9387d 219b180907a8 b58e0819e177 2023-07-14T18:12:25.109 INFO:teuthology.orchestra.run.smithi163.stdout:mds.j smithi163 running (101s) - 101s - - 18.0.0-4940-g81c9387d 219b180907a8 eb0e5a7f7518 2023-07-14T18:12:25.109 INFO:teuthology.orchestra.run.smithi163.stdout:mds.k smithi172 running (103s) - 103s 19.0M - 18.0.0-4940-g81c9387d 219b180907a8 83e8e29972ac 2023-07-14T18:12:25.109 INFO:teuthology.orchestra.run.smithi163.stdout:mds.l smithi184 running (105s) - 105s 19.8M - 18.0.0-4940-g81c9387d 219b180907a8 8b0027c4fd29 2023-07-14T18:12:25.109 INFO:teuthology.orchestra.run.smithi163.stdout:mgr.x smithi163 *:9283,8765 running (7m) - 7m - - 18.0.0-4940-g81c9387d 219b180907a8 6e6b00232d00 2023-07-14T18:12:25.109 INFO:teuthology.orchestra.run.smithi163.stdout:mgr.y smithi172 *:8443,8765 running (6m) - 6m 445M - 18.0.0-4940-g81c9387d 219b180907a8 2d0c5ad99722 2023-07-14T18:12:25.109 INFO:teuthology.orchestra.run.smithi163.stdout:mgr.z smithi184 *:8443,8765 running (6m) - 6m 445M - 18.0.0-4940-g81c9387d 219b180907a8 a10ee43ef151 2023-07-14T18:12:25.109 INFO:teuthology.orchestra.run.smithi163.stdout:mon.a smithi163 running (7m) - 7m - 2048M 18.0.0-4940-g81c9387d 219b180907a8 67f0da97dc03 2023-07-14T18:12:25.109 INFO:teuthology.orchestra.run.smithi163.stdout:mon.b smithi172 running (6m) - 6m 60.7M 2048M 18.0.0-4940-g81c9387d 219b180907a8 eaaf358d8bbc 2023-07-14T18:12:25.110 INFO:teuthology.orchestra.run.smithi163.stdout:mon.c smithi184 running (6m) - 6m 60.2M 2048M 18.0.0-4940-g81c9387d 219b180907a8 04a57f5d1797 2023-07-14T18:12:25.110 INFO:teuthology.orchestra.run.smithi163.stdout:osd.0 smithi163 running (5m) - 5m - 4292M 18.0.0-4940-g81c9387d 219b180907a8 523b66683c45 2023-07-14T18:12:25.110 INFO:teuthology.orchestra.run.smithi163.stdout:osd.1 smithi172 running (5m) - 5m 78.3M 4292M 18.0.0-4940-g81c9387d 219b180907a8 12bebe67c331 2023-07-14T18:12:25.110 INFO:teuthology.orchestra.run.smithi163.stdout:osd.2 smithi184 running (5m) - 5m 77.7M 4292M 18.0.0-4940-g81c9387d 219b180907a8 577318fb4c6d 2023-07-14T18:12:25.110 INFO:teuthology.orchestra.run.smithi163.stdout:osd.3 smithi163 running (4m) - 4m - 4292M 18.0.0-4940-g81c9387d 219b180907a8 188f6dc65730 2023-07-14T18:12:25.110 INFO:teuthology.orchestra.run.smithi163.stdout:osd.4 smithi172 running (4m) - 4m 62.6M 4292M 18.0.0-4940-g81c9387d 219b180907a8 ca493110bfde 2023-07-14T18:12:25.110 INFO:teuthology.orchestra.run.smithi163.stdout:osd.5 smithi184 running (4m) - 4m 68.0M 4292M 18.0.0-4940-g81c9387d 219b180907a8 b5ad0a88d931 2023-07-14T18:12:25.110 INFO:teuthology.orchestra.run.smithi163.stdout:osd.6 smithi163 running (3m) - 3m - 4292M 18.0.0-4940-g81c9387d 219b180907a8 5f864cf471e7 2023-07-14T18:12:25.111 INFO:teuthology.orchestra.run.smithi163.stdout:osd.7 smithi172 running (3m) - 3m 66.1M 4292M 18.0.0-4940-g81c9387d 219b180907a8 31e645c4128e 2023-07-14T18:12:25.111 INFO:teuthology.orchestra.run.smithi163.stdout:osd.8 smithi184 running (3m) - 3m 64.9M 4292M 18.0.0-4940-g81c9387d 219b180907a8 34744623046d 2023-07-14T18:12:25.111 INFO:teuthology.orchestra.run.smithi163.stdout:osd.9 smithi163 running (2m) - 2m - 4292M 18.0.0-4940-g81c9387d 219b180907a8 f54bbd574eba 2023-07-14T18:12:25.111 INFO:teuthology.orchestra.run.smithi163.stdout:osd.10 smithi172 running (2m) - 2m 63.2M 4292M 18.0.0-4940-g81c9387d 219b180907a8 6d369d39ba26 2023-07-14T18:12:25.111 INFO:teuthology.orchestra.run.smithi163.stdout:osd.11 smithi184 running (2m) - 2m 54.2M 4292M 18.0.0-4940-g81c9387d 219b180907a8 63404a5118ea 2023-07-14T18:12:25.112 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:25.068+0000 7f74f8513700 1 -- 172.21.15.163:0/3464943547 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f74dc0a11e0 msgr2=0x7f74dc0a3690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:12:25.112 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:25.068+0000 7f74f8513700 1 --2- 172.21.15.163:0/3464943547 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f74dc0a11e0 0x7f74dc0a3690 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f74ec005910 tx=0x7f74ec005960 comp rx=0 tx=0).stop 2023-07-14T18:12:25.112 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:25.068+0000 7f74f8513700 1 -- 172.21.15.163:0/3464943547 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f74f00ffdb0 msgr2=0x7f74f019a620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:12:25.112 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:25.068+0000 7f74f8513700 1 --2- 172.21.15.163:0/3464943547 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f74f00ffdb0 0x7f74f019a620 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f74e000e9a0 tx=0x7f74e000ecb0 comp rx=0 tx=0).stop 2023-07-14T18:12:25.112 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:25.068+0000 7f74f8513700 1 -- 172.21.15.163:0/3464943547 shutdown_connections 2023-07-14T18:12:25.113 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:25.068+0000 7f74f8513700 1 --2- 172.21.15.163:0/3464943547 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f74dc0a11e0 0x7f74dc0a3690 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:25.113 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:25.068+0000 7f74f8513700 1 --2- 172.21.15.163:0/3464943547 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f74f00febb0 0x7f74f0068c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:25.113 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:25.068+0000 7f74f8513700 1 --2- 172.21.15.163:0/3464943547 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f74f0100740 0x7f74f019cc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:25.113 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:25.068+0000 7f74f8513700 1 --2- 172.21.15.163:0/3464943547 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f74f00ffdb0 0x7f74f019a620 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:25.113 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:25.068+0000 7f74f8513700 1 -- 172.21.15.163:0/3464943547 >> 172.21.15.163:0/3464943547 conn(0x7f74f00fa1e0 msgr2=0x7f74f0103390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:12:25.114 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:25.068+0000 7f74f8513700 1 -- 172.21.15.163:0/3464943547 shutdown_connections 2023-07-14T18:12:25.114 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:25.068+0000 7f74f8513700 1 -- 172.21.15.163:0/3464943547 wait complete. 2023-07-14T18:12:25.547 DEBUG:teuthology.orchestra.run.smithi163:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81c9387d2e7576da065747ec9c16d1c7d69016ec shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bf7326ec-2270-11ee-9b33-001a4aab830c -- bash -c 'ceph orch ls' 2023-07-14T18:12:26.101 INFO:teuthology.orchestra.run.smithi163.stderr:Inferring config /var/lib/ceph/bf7326ec-2270-11ee-9b33-001a4aab830c/mon.a/config 2023-07-14T18:12:26.967 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:12:26 smithi163 ceph-mon[96576]: from='client.15324 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-07-14T18:12:26.968 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:12:26 smithi163 ceph-mon[96576]: pgmap v291: 129 pgs: 129 active+clean; 643 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 10 op/s; 0 B/s, 0 objects/s recovering 2023-07-14T18:12:27.175 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:12:26 smithi184 ceph-mon[98481]: from='client.15324 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-07-14T18:12:27.175 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:12:26 smithi184 ceph-mon[98481]: pgmap v291: 129 pgs: 129 active+clean; 643 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 10 op/s; 0 B/s, 0 objects/s recovering 2023-07-14T18:12:27.276 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:12:26 smithi172 ceph-mon[97983]: from='client.15324 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-07-14T18:12:27.276 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:12:26 smithi172 ceph-mon[97983]: pgmap v291: 129 pgs: 129 active+clean; 643 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 10 op/s; 0 B/s, 0 objects/s recovering 2023-07-14T18:12:27.313 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:27.270+0000 7f019de68700 1 -- 172.21.15.163:0/2013076733 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f01980fe3f0 msgr2=0x7f01981082d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:12:27.313 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:27.270+0000 7f019de68700 1 --2- 172.21.15.163:0/2013076733 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f01980fe3f0 0x7f01981082d0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f019000b0d0 tx=0x7f019000b3e0 comp rx=0 tx=0).stop 2023-07-14T18:12:27.314 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:27.270+0000 7f019de68700 1 -- 172.21.15.163:0/2013076733 shutdown_connections 2023-07-14T18:12:27.314 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:27.270+0000 7f019de68700 1 --2- 172.21.15.163:0/2013076733 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f01981012e0 0x7f01981016f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:27.314 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:27.270+0000 7f019de68700 1 --2- 172.21.15.163:0/2013076733 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f01980fe3f0 0x7f01981082d0 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:27.314 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:27.270+0000 7f019de68700 1 --2- 172.21.15.163:0/2013076733 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0198101cc0 0x7f01980fdd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:27.314 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:27.270+0000 7f019de68700 1 -- 172.21.15.163:0/2013076733 >> 172.21.15.163:0/2013076733 conn(0x7f01980f9990 msgr2=0x7f01980fbdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:12:27.314 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:27.270+0000 7f019de68700 1 -- 172.21.15.163:0/2013076733 shutdown_connections 2023-07-14T18:12:27.314 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:27.270+0000 7f019de68700 1 -- 172.21.15.163:0/2013076733 wait complete. 2023-07-14T18:12:27.315 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:27.271+0000 7f019de68700 1 Processor -- start 2023-07-14T18:12:27.315 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:27.271+0000 7f019de68700 1 -- start start 2023-07-14T18:12:27.315 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:27.271+0000 7f019de68700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f01980fe3f0 0x7f0198195a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:12:27.315 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:27.271+0000 7f019de68700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f01981012e0 0x7f0198195f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:12:27.315 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:27.271+0000 7f019de68700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0198101cc0 0x7f019819cfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:12:27.315 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:27.271+0000 7f019de68700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f019819d5b0 con 0x7f01980fe3f0 2023-07-14T18:12:27.316 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:27.271+0000 7f019de68700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f019819d6f0 con 0x7f0198101cc0 2023-07-14T18:12:27.316 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:27.271+0000 7f019de68700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f019819d880 con 0x7f01981012e0 2023-07-14T18:12:27.316 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:27.271+0000 7f01977fe700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f01980fe3f0 0x7f0198195a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:12:27.316 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:27.271+0000 7f01977fe700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f01980fe3f0 0x7f0198195a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:57222/0 (socket says 172.21.15.163:57222) 2023-07-14T18:12:27.316 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:27.271+0000 7f01977fe700 1 -- 172.21.15.163:0/1902104999 learned_addr learned my addr 172.21.15.163:0/1902104999 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:12:27.316 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:27.271+0000 7f018ffff700 1 --2- 172.21.15.163:0/1902104999 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f01981012e0 0x7f0198195f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:12:27.316 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:27.271+0000 7f0197fff700 1 --2- 172.21.15.163:0/1902104999 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0198101cc0 0x7f019819cfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:12:27.317 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:27.271+0000 7f01977fe700 1 -- 172.21.15.163:0/1902104999 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f01981012e0 msgr2=0x7f0198195f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:12:27.317 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:27.271+0000 7f01977fe700 1 --2- 172.21.15.163:0/1902104999 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f01981012e0 0x7f0198195f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:27.317 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:27.271+0000 7f01977fe700 1 -- 172.21.15.163:0/1902104999 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0198101cc0 msgr2=0x7f019819cfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:12:27.317 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:27.271+0000 7f01977fe700 1 --2- 172.21.15.163:0/1902104999 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0198101cc0 0x7f019819cfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:27.317 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:27.271+0000 7f01977fe700 1 -- 172.21.15.163:0/1902104999 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0190009d00 con 0x7f01980fe3f0 2023-07-14T18:12:27.317 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:27.271+0000 7f0197fff700 1 --2- 172.21.15.163:0/1902104999 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0198101cc0 0x7f019819cfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T18:12:27.317 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:27.271+0000 7f01977fe700 1 --2- 172.21.15.163:0/1902104999 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f01980fe3f0 0x7f0198195a20 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f018800c9a0 tx=0x7f018800cd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:12:27.317 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:27.272+0000 7f01957fa700 1 -- 172.21.15.163:0/1902104999 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0188004220 con 0x7f01980fe3f0 2023-07-14T18:12:27.318 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:27.272+0000 7f01957fa700 1 -- 172.21.15.163:0/1902104999 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f0188007cf0 con 0x7f01980fe3f0 2023-07-14T18:12:27.318 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:27.272+0000 7f019de68700 1 -- 172.21.15.163:0/1902104999 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f019819db60 con 0x7f01980fe3f0 2023-07-14T18:12:27.318 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:27.272+0000 7f01957fa700 1 -- 172.21.15.163:0/1902104999 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0188003c30 con 0x7f01980fe3f0 2023-07-14T18:12:27.318 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:27.272+0000 7f019de68700 1 -- 172.21.15.163:0/1902104999 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f019819e060 con 0x7f01980fe3f0 2023-07-14T18:12:27.319 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:27.273+0000 7f019de68700 1 -- 172.21.15.163:0/1902104999 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0198107470 con 0x7f01980fe3f0 2023-07-14T18:12:27.319 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:27.274+0000 7f01957fa700 1 -- 172.21.15.163:0/1902104999 <== mon.0 v2:172.21.15.163:3300/0 4 ==== mgrmap(e 17) v1 ==== 135767+0+0 (secure 0 0 0) 0x7f0188004380 con 0x7f01980fe3f0 2023-07-14T18:12:27.319 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:27.274+0000 7f01957fa700 1 --2- 172.21.15.163:0/1902104999 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f01840a11e0 0x7f01840a3690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:12:27.319 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:27.274+0000 7f01957fa700 1 -- 172.21.15.163:0/1902104999 <== mon.0 v2:172.21.15.163:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 9020+0+0 (secure 0 0 0) 0x7f01880ccd60 con 0x7f01980fe3f0 2023-07-14T18:12:27.320 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:27.274+0000 7f018ffff700 1 --2- 172.21.15.163:0/1902104999 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f01840a11e0 0x7f01840a3690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:12:27.320 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:27.275+0000 7f018ffff700 1 --2- 172.21.15.163:0/1902104999 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f01840a11e0 0x7f01840a3690 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f0180005fd0 tx=0x7f0180005f60 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:12:27.320 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:27.278+0000 7f01957fa700 1 -- 172.21.15.163:0/1902104999 <== mon.0 v2:172.21.15.163:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178025 (secure 0 0 0) 0x7f0188096040 con 0x7f01980fe3f0 2023-07-14T18:12:27.514 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:27.473+0000 7f019de68700 1 -- 172.21.15.163:0/1902104999 --> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] -- mgr_command(tid 0: {"prefix": "orch ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f0198060a80 con 0x7f01840a11e0 2023-07-14T18:12:27.518 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:27.478+0000 7f01957fa700 1 -- 172.21.15.163:0/1902104999 <== mgr.14152 v2:172.21.15.163:6800/1949590926 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+985 (secure 0 0 0) 0x7f0198060a80 con 0x7f01840a11e0 2023-07-14T18:12:27.519 INFO:teuthology.orchestra.run.smithi163.stdout:NAME PORTS RUNNING REFRESHED AGE PLACEMENT 2023-07-14T18:12:27.519 INFO:teuthology.orchestra.run.smithi163.stdout:mds.all 12/12 - 110s smithi163=a;smithi163=d;smithi163=g;smithi163=j;smithi172=b;smithi172=e;smithi172=h;smithi172=k;smithi184=c;smithi184=f;smithi184=i;smithi184=l;count:12 2023-07-14T18:12:27.519 INFO:teuthology.orchestra.run.smithi163.stdout:mgr 3/3 - 6m smithi163=x;smithi172=y;smithi184=z;count:3 2023-07-14T18:12:27.519 INFO:teuthology.orchestra.run.smithi163.stdout:mon 3/3 - 6m smithi163:172.21.15.163=a;smithi172:172.21.15.172=b;smithi184:172.21.15.184=c;count:3 2023-07-14T18:12:27.519 INFO:teuthology.orchestra.run.smithi163.stdout:osd 12 - - 2023-07-14T18:12:27.521 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:27.480+0000 7f019de68700 1 -- 172.21.15.163:0/1902104999 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f01840a11e0 msgr2=0x7f01840a3690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:12:27.521 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:27.480+0000 7f019de68700 1 --2- 172.21.15.163:0/1902104999 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f01840a11e0 0x7f01840a3690 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f0180005fd0 tx=0x7f0180005f60 comp rx=0 tx=0).stop 2023-07-14T18:12:27.521 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:27.480+0000 7f019de68700 1 -- 172.21.15.163:0/1902104999 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f01980fe3f0 msgr2=0x7f0198195a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:12:27.521 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:27.480+0000 7f019de68700 1 --2- 172.21.15.163:0/1902104999 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f01980fe3f0 0x7f0198195a20 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f018800c9a0 tx=0x7f018800cd60 comp rx=0 tx=0).stop 2023-07-14T18:12:27.522 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:27.480+0000 7f019de68700 1 -- 172.21.15.163:0/1902104999 shutdown_connections 2023-07-14T18:12:27.522 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:27.480+0000 7f019de68700 1 --2- 172.21.15.163:0/1902104999 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f01840a11e0 0x7f01840a3690 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:27.522 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:27.480+0000 7f019de68700 1 --2- 172.21.15.163:0/1902104999 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0198101cc0 0x7f019819cfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:27.522 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:27.480+0000 7f019de68700 1 --2- 172.21.15.163:0/1902104999 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f01980fe3f0 0x7f0198195a20 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:27.522 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:27.480+0000 7f019de68700 1 --2- 172.21.15.163:0/1902104999 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f01981012e0 0x7f0198195f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:27.522 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:27.480+0000 7f019de68700 1 -- 172.21.15.163:0/1902104999 >> 172.21.15.163:0/1902104999 conn(0x7f01980f9990 msgr2=0x7f01981045b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:12:27.522 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:27.480+0000 7f019de68700 1 -- 172.21.15.163:0/1902104999 shutdown_connections 2023-07-14T18:12:27.522 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:27.480+0000 7f019de68700 1 -- 172.21.15.163:0/1902104999 wait complete. 2023-07-14T18:12:27.865 DEBUG:teuthology.orchestra.run.smithi163:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81c9387d2e7576da065747ec9c16d1c7d69016ec shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bf7326ec-2270-11ee-9b33-001a4aab830c -- bash -c 'ceph orch host ls' 2023-07-14T18:12:28.418 INFO:teuthology.orchestra.run.smithi163.stderr:Inferring config /var/lib/ceph/bf7326ec-2270-11ee-9b33-001a4aab830c/mon.a/config 2023-07-14T18:12:28.935 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:12:28 smithi163 ceph-mon[96576]: pgmap v292: 129 pgs: 129 active+clean; 643 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 9 op/s; 0 B/s, 0 objects/s recovering 2023-07-14T18:12:28.936 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:12:28 smithi163 ceph-mon[96576]: from='client.15330 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2023-07-14T18:12:29.175 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:12:28 smithi184 ceph-mon[98481]: pgmap v292: 129 pgs: 129 active+clean; 643 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 9 op/s; 0 B/s, 0 objects/s recovering 2023-07-14T18:12:29.175 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:12:28 smithi184 ceph-mon[98481]: from='client.15330 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2023-07-14T18:12:29.276 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:12:28 smithi172 ceph-mon[97983]: pgmap v292: 129 pgs: 129 active+clean; 643 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 9 op/s; 0 B/s, 0 objects/s recovering 2023-07-14T18:12:29.276 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:12:28 smithi172 ceph-mon[97983]: from='client.15330 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2023-07-14T18:12:29.628 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:29.586+0000 7f9881587700 1 -- 172.21.15.163:0/2340442642 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f987c0ffe60 msgr2=0x7f987c1002b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:12:29.628 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:29.586+0000 7f9881587700 1 --2- 172.21.15.163:0/2340442642 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f987c0ffe60 0x7f987c1002b0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f9870009990 tx=0x7f9870009ca0 comp rx=0 tx=0).stop 2023-07-14T18:12:29.629 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:29.586+0000 7f9881587700 1 -- 172.21.15.163:0/2340442642 shutdown_connections 2023-07-14T18:12:29.629 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:29.586+0000 7f9881587700 1 --2- 172.21.15.163:0/2340442642 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f987c1007f0 0x7f987c1070b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:29.629 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:29.586+0000 7f9881587700 1 --2- 172.21.15.163:0/2340442642 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f987c0fec60 0x7f987c0ff070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:29.629 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:29.586+0000 7f9881587700 1 --2- 172.21.15.163:0/2340442642 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f987c0ffe60 0x7f987c1002b0 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:29.629 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:29.586+0000 7f9881587700 1 -- 172.21.15.163:0/2340442642 >> 172.21.15.163:0/2340442642 conn(0x7f987c0fa2b0 msgr2=0x7f987c0fc6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:12:29.629 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:29.586+0000 7f9881587700 1 -- 172.21.15.163:0/2340442642 shutdown_connections 2023-07-14T18:12:29.629 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:29.586+0000 7f9881587700 1 -- 172.21.15.163:0/2340442642 wait complete. 2023-07-14T18:12:29.630 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:29.587+0000 7f9881587700 1 Processor -- start 2023-07-14T18:12:29.630 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:29.587+0000 7f9881587700 1 -- start start 2023-07-14T18:12:29.631 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:29.587+0000 7f9881587700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f987c0fec60 0x7f987c0695c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:12:29.631 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:29.587+0000 7f9881587700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f987c0ffe60 0x7f987c19a630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:12:29.631 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:29.587+0000 7f9881587700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f987c1007f0 0x7f987c19cc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:12:29.632 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:29.587+0000 7f9881587700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f987c19d410 con 0x7f987c0ffe60 2023-07-14T18:12:29.632 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:29.587+0000 7f9881587700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f987c19d580 con 0x7f987c0fec60 2023-07-14T18:12:29.632 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:29.587+0000 7f9881587700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f987c19d740 con 0x7f987c1007f0 2023-07-14T18:12:29.632 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:29.587+0000 7f987a7fc700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f987c0ffe60 0x7f987c19a630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:12:29.632 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:29.587+0000 7f987a7fc700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f987c0ffe60 0x7f987c19a630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:57238/0 (socket says 172.21.15.163:57238) 2023-07-14T18:12:29.632 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:29.587+0000 7f987a7fc700 1 -- 172.21.15.163:0/115476378 learned_addr learned my addr 172.21.15.163:0/115476378 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:12:29.633 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:29.587+0000 7f987affd700 1 --2- 172.21.15.163:0/115476378 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f987c0fec60 0x7f987c0695c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:12:29.633 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:29.588+0000 7f987b7fe700 1 --2- 172.21.15.163:0/115476378 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f987c1007f0 0x7f987c19cc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:12:29.633 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:29.588+0000 7f987a7fc700 1 -- 172.21.15.163:0/115476378 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f987c1007f0 msgr2=0x7f987c19cc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:12:29.633 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:29.588+0000 7f987a7fc700 1 --2- 172.21.15.163:0/115476378 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f987c1007f0 0x7f987c19cc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:29.633 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:29.588+0000 7f987a7fc700 1 -- 172.21.15.163:0/115476378 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f987c0fec60 msgr2=0x7f987c0695c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:12:29.633 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:29.588+0000 7f987a7fc700 1 --2- 172.21.15.163:0/115476378 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f987c0fec60 0x7f987c0695c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:29.633 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:29.588+0000 7f987a7fc700 1 -- 172.21.15.163:0/115476378 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98700095f0 con 0x7f987c0ffe60 2023-07-14T18:12:29.634 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:29.588+0000 7f987a7fc700 1 --2- 172.21.15.163:0/115476378 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f987c0ffe60 0x7f987c19a630 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f9870006010 tx=0x7f9870004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:12:29.634 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:29.588+0000 7f9863fff700 1 -- 172.21.15.163:0/115476378 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f987001d070 con 0x7f987c0ffe60 2023-07-14T18:12:29.634 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:29.588+0000 7f9881587700 1 -- 172.21.15.163:0/115476378 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f987c19d9c0 con 0x7f987c0ffe60 2023-07-14T18:12:29.634 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:29.588+0000 7f9863fff700 1 -- 172.21.15.163:0/115476378 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f9870004000 con 0x7f987c0ffe60 2023-07-14T18:12:29.634 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:29.588+0000 7f9863fff700 1 -- 172.21.15.163:0/115476378 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9870022b90 con 0x7f987c0ffe60 2023-07-14T18:12:29.634 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:29.588+0000 7f9881587700 1 -- 172.21.15.163:0/115476378 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f987c19de30 con 0x7f987c0ffe60 2023-07-14T18:12:29.634 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:29.589+0000 7f9881587700 1 -- 172.21.15.163:0/115476378 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f987c106300 con 0x7f987c0ffe60 2023-07-14T18:12:29.635 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:29.590+0000 7f9863fff700 1 -- 172.21.15.163:0/115476378 <== mon.0 v2:172.21.15.163:3300/0 4 ==== mgrmap(e 17) v1 ==== 135767+0+0 (secure 0 0 0) 0x7f9870003b70 con 0x7f987c0ffe60 2023-07-14T18:12:29.635 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:29.591+0000 7f9863fff700 1 --2- 172.21.15.163:0/115476378 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f98640a1260 0x7f98640a3710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:12:29.635 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:29.591+0000 7f987affd700 1 --2- 172.21.15.163:0/115476378 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f98640a1260 0x7f98640a3710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:12:29.636 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:29.591+0000 7f9863fff700 1 -- 172.21.15.163:0/115476378 <== mon.0 v2:172.21.15.163:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 9020+0+0 (secure 0 0 0) 0x7f98700ce480 con 0x7f987c0ffe60 2023-07-14T18:12:29.636 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:29.592+0000 7f987affd700 1 --2- 172.21.15.163:0/115476378 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f98640a1260 0x7f98640a3710 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f987c0ffcc0 tx=0x7f986c00b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:12:29.636 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:29.595+0000 7f9863fff700 1 -- 172.21.15.163:0/115476378 <== mon.0 v2:172.21.15.163:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178025 (secure 0 0 0) 0x7f9870097790 con 0x7f987c0ffe60 2023-07-14T18:12:29.833 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:29.791+0000 7f9881587700 1 -- 172.21.15.163:0/115476378 --> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f987c060a80 con 0x7f98640a1260 2023-07-14T18:12:29.834 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:29.793+0000 7f9863fff700 1 -- 172.21.15.163:0/115476378 <== mgr.14152 v2:172.21.15.163:6800/1949590926 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+191 (secure 0 0 0) 0x7f987c060a80 con 0x7f98640a1260 2023-07-14T18:12:29.834 INFO:teuthology.orchestra.run.smithi163.stdout:HOST ADDR LABELS STATUS 2023-07-14T18:12:29.834 INFO:teuthology.orchestra.run.smithi163.stdout:smithi163 172.21.15.163 2023-07-14T18:12:29.834 INFO:teuthology.orchestra.run.smithi163.stdout:smithi172 172.21.15.172 2023-07-14T18:12:29.835 INFO:teuthology.orchestra.run.smithi163.stdout:smithi184 172.21.15.184 2023-07-14T18:12:29.835 INFO:teuthology.orchestra.run.smithi163.stdout:3 hosts in cluster 2023-07-14T18:12:29.836 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:29.795+0000 7f9881587700 1 -- 172.21.15.163:0/115476378 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f98640a1260 msgr2=0x7f98640a3710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:12:29.836 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:29.795+0000 7f9881587700 1 --2- 172.21.15.163:0/115476378 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f98640a1260 0x7f98640a3710 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f987c0ffcc0 tx=0x7f986c00b410 comp rx=0 tx=0).stop 2023-07-14T18:12:29.837 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:29.795+0000 7f9881587700 1 -- 172.21.15.163:0/115476378 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f987c0ffe60 msgr2=0x7f987c19a630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:12:29.837 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:29.795+0000 7f9881587700 1 --2- 172.21.15.163:0/115476378 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f987c0ffe60 0x7f987c19a630 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f9870006010 tx=0x7f9870004730 comp rx=0 tx=0).stop 2023-07-14T18:12:29.837 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:29.795+0000 7f9881587700 1 -- 172.21.15.163:0/115476378 shutdown_connections 2023-07-14T18:12:29.837 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:29.795+0000 7f9881587700 1 --2- 172.21.15.163:0/115476378 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f98640a1260 0x7f98640a3710 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:29.837 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:29.795+0000 7f9881587700 1 --2- 172.21.15.163:0/115476378 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f987c1007f0 0x7f987c19cc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:29.837 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:29.795+0000 7f9881587700 1 --2- 172.21.15.163:0/115476378 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f987c0fec60 0x7f987c0695c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:29.837 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:29.795+0000 7f9881587700 1 --2- 172.21.15.163:0/115476378 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f987c0ffe60 0x7f987c19a630 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:29.838 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:29.795+0000 7f9881587700 1 -- 172.21.15.163:0/115476378 >> 172.21.15.163:0/115476378 conn(0x7f987c0fa2b0 msgr2=0x7f987c103440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:12:29.838 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:29.795+0000 7f9881587700 1 -- 172.21.15.163:0/115476378 shutdown_connections 2023-07-14T18:12:29.838 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:29.795+0000 7f9881587700 1 -- 172.21.15.163:0/115476378 wait complete. 2023-07-14T18:12:30.166 DEBUG:teuthology.orchestra.run.smithi163:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81c9387d2e7576da065747ec9c16d1c7d69016ec shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bf7326ec-2270-11ee-9b33-001a4aab830c -- bash -c 'ceph orch device ls' 2023-07-14T18:12:30.723 INFO:teuthology.orchestra.run.smithi163.stderr:Inferring config /var/lib/ceph/bf7326ec-2270-11ee-9b33-001a4aab830c/mon.a/config 2023-07-14T18:12:31.135 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:12:30 smithi163 ceph-mon[96576]: pgmap v293: 129 pgs: 129 active+clean; 643 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s; 0 B/s, 0 objects/s recovering 2023-07-14T18:12:31.135 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:12:30 smithi163 ceph-mon[96576]: from='client.15336 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2023-07-14T18:12:31.175 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:12:30 smithi184 ceph-mon[98481]: pgmap v293: 129 pgs: 129 active+clean; 643 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s; 0 B/s, 0 objects/s recovering 2023-07-14T18:12:31.175 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:12:30 smithi184 ceph-mon[98481]: from='client.15336 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2023-07-14T18:12:31.275 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:12:30 smithi172 ceph-mon[97983]: pgmap v293: 129 pgs: 129 active+clean; 643 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s; 0 B/s, 0 objects/s recovering 2023-07-14T18:12:31.276 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:12:30 smithi172 ceph-mon[97983]: from='client.15336 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2023-07-14T18:12:31.945 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:31.902+0000 7fc01bb69700 1 -- 172.21.15.163:0/3046286663 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc014100740 msgr2=0x7fc014107000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:12:31.945 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:31.902+0000 7fc01bb69700 1 --2- 172.21.15.163:0/3046286663 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc014100740 0x7fc014107000 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7fc00c00b0a0 tx=0x7fc00c00b3b0 comp rx=0 tx=0).stop 2023-07-14T18:12:31.945 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:31.902+0000 7fc01bb69700 1 -- 172.21.15.163:0/3046286663 shutdown_connections 2023-07-14T18:12:31.945 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:31.902+0000 7fc01bb69700 1 --2- 172.21.15.163:0/3046286663 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc014100740 0x7fc014107000 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:31.946 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:31.902+0000 7fc01bb69700 1 --2- 172.21.15.163:0/3046286663 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc0140febb0 0x7fc0140fefc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:31.946 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:31.902+0000 7fc01bb69700 1 --2- 172.21.15.163:0/3046286663 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc0140ffdb0 0x7fc014100200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:31.946 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:31.902+0000 7fc01bb69700 1 -- 172.21.15.163:0/3046286663 >> 172.21.15.163:0/3046286663 conn(0x7fc0140fa1e0 msgr2=0x7fc0140fc630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:12:31.946 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:31.902+0000 7fc01bb69700 1 -- 172.21.15.163:0/3046286663 shutdown_connections 2023-07-14T18:12:31.946 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:31.902+0000 7fc01bb69700 1 -- 172.21.15.163:0/3046286663 wait complete. 2023-07-14T18:12:31.946 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:31.903+0000 7fc01bb69700 1 Processor -- start 2023-07-14T18:12:31.946 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:31.903+0000 7fc01bb69700 1 -- start start 2023-07-14T18:12:31.947 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:31.903+0000 7fc01bb69700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc0140febb0 0x7fc014195a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:12:31.947 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:31.903+0000 7fc01bb69700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc0140ffdb0 0x7fc014195fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:12:31.947 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:31.903+0000 7fc01bb69700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc014100740 0x7fc01419d020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:12:31.947 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:31.903+0000 7fc01bb69700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc01419d5f0 con 0x7fc014100740 2023-07-14T18:12:31.947 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:31.903+0000 7fc01bb69700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc01419d730 con 0x7fc0140ffdb0 2023-07-14T18:12:31.947 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:31.903+0000 7fc01bb69700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc01419d8c0 con 0x7fc0140febb0 2023-07-14T18:12:31.947 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:31.903+0000 7fc01a106700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc014100740 0x7fc01419d020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:12:31.947 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:31.903+0000 7fc01a106700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc014100740 0x7fc01419d020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:57252/0 (socket says 172.21.15.163:57252) 2023-07-14T18:12:31.948 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:31.903+0000 7fc01a106700 1 -- 172.21.15.163:0/344601926 learned_addr learned my addr 172.21.15.163:0/344601926 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:12:31.948 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:31.903+0000 7fc019905700 1 --2- 172.21.15.163:0/344601926 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc0140febb0 0x7fc014195a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:12:31.948 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:31.903+0000 7fc019104700 1 --2- 172.21.15.163:0/344601926 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc0140ffdb0 0x7fc014195fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:12:31.948 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:31.904+0000 7fc01a106700 1 -- 172.21.15.163:0/344601926 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc0140febb0 msgr2=0x7fc014195a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:12:31.948 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:31.904+0000 7fc01a106700 1 --2- 172.21.15.163:0/344601926 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc0140febb0 0x7fc014195a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:31.948 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:31.904+0000 7fc01a106700 1 -- 172.21.15.163:0/344601926 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc0140ffdb0 msgr2=0x7fc014195fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:12:31.948 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:31.904+0000 7fc01a106700 1 --2- 172.21.15.163:0/344601926 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc0140ffdb0 0x7fc014195fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:31.949 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:31.904+0000 7fc01a106700 1 -- 172.21.15.163:0/344601926 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc00c009d00 con 0x7fc014100740 2023-07-14T18:12:31.949 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:31.904+0000 7fc019104700 1 --2- 172.21.15.163:0/344601926 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc0140ffdb0 0x7fc014195fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T18:12:31.949 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:31.904+0000 7fc01a106700 1 --2- 172.21.15.163:0/344601926 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc014100740 0x7fc01419d020 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7fc00c0079c0 tx=0x7fc00c00bd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:12:31.949 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:31.904+0000 7fc006ffd700 1 -- 172.21.15.163:0/344601926 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc00c00e040 con 0x7fc014100740 2023-07-14T18:12:31.949 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:31.904+0000 7fc006ffd700 1 -- 172.21.15.163:0/344601926 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fc00c004e60 con 0x7fc014100740 2023-07-14T18:12:31.949 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:31.904+0000 7fc01bb69700 1 -- 172.21.15.163:0/344601926 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc01419db40 con 0x7fc014100740 2023-07-14T18:12:31.949 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:31.904+0000 7fc006ffd700 1 -- 172.21.15.163:0/344601926 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc00c0052a0 con 0x7fc014100740 2023-07-14T18:12:31.950 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:31.904+0000 7fc01bb69700 1 -- 172.21.15.163:0/344601926 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc01419dfb0 con 0x7fc014100740 2023-07-14T18:12:31.950 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:31.905+0000 7fc01bb69700 1 -- 172.21.15.163:0/344601926 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc01410a1e0 con 0x7fc014100740 2023-07-14T18:12:31.951 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:31.906+0000 7fc006ffd700 1 -- 172.21.15.163:0/344601926 <== mon.0 v2:172.21.15.163:3300/0 4 ==== mgrmap(e 17) v1 ==== 135767+0+0 (secure 0 0 0) 0x7fc00c01d470 con 0x7fc014100740 2023-07-14T18:12:31.951 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:31.906+0000 7fc006ffd700 1 --2- 172.21.15.163:0/344601926 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7fc0000a12e0 0x7fc0000a3790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:12:31.951 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:31.907+0000 7fc019905700 1 --2- 172.21.15.163:0/344601926 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7fc0000a12e0 0x7fc0000a3790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:12:31.951 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:31.907+0000 7fc006ffd700 1 -- 172.21.15.163:0/344601926 <== mon.0 v2:172.21.15.163:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 9020+0+0 (secure 0 0 0) 0x7fc00c0ce950 con 0x7fc014100740 2023-07-14T18:12:31.951 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:31.907+0000 7fc019905700 1 --2- 172.21.15.163:0/344601926 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7fc0000a12e0 0x7fc0000a3790 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fc0140ffc10 tx=0x7fc010009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:12:31.952 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:31.910+0000 7fc006ffd700 1 -- 172.21.15.163:0/344601926 <== mon.0 v2:172.21.15.163:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178025 (secure 0 0 0) 0x7fc00c097c60 con 0x7fc014100740 2023-07-14T18:12:32.145 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:32.103+0000 7fc01bb69700 1 -- 172.21.15.163:0/344601926 --> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] -- mgr_command(tid 0: {"prefix": "orch device ls", "target": ["mon-mgr", ""]}) v1 -- 0x7fc014069120 con 0x7fc0000a12e0 2023-07-14T18:12:32.146 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:32.105+0000 7fc006ffd700 1 -- 172.21.15.163:0/344601926 <== mgr.14152 v2:172.21.15.163:6800/1949590926 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+492 (secure 0 0 0) 0x7fc014069120 con 0x7fc0000a12e0 2023-07-14T18:12:32.147 INFO:teuthology.orchestra.run.smithi163.stdout:HOST PATH TYPE DEVICE ID SIZE AVAILABLE REFRESHED REJECT REASONS 2023-07-14T18:12:32.147 INFO:teuthology.orchestra.run.smithi163.stdout:smithi163 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_CVFT623300GU400BGN 372G No 2m ago LVM detected, locked 2023-07-14T18:12:32.147 INFO:teuthology.orchestra.run.smithi163.stdout:smithi172 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_CVFT6233005M400BGN 372G No 2m ago LVM detected, locked 2023-07-14T18:12:32.148 INFO:teuthology.orchestra.run.smithi163.stdout:smithi184 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_CVFT626500CE400BGN 372G No 2m ago LVM detected, locked 2023-07-14T18:12:32.149 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:32.107+0000 7fc01bb69700 1 -- 172.21.15.163:0/344601926 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7fc0000a12e0 msgr2=0x7fc0000a3790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:12:32.149 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:32.107+0000 7fc01bb69700 1 --2- 172.21.15.163:0/344601926 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7fc0000a12e0 0x7fc0000a3790 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fc0140ffc10 tx=0x7fc010009260 comp rx=0 tx=0).stop 2023-07-14T18:12:32.149 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:32.107+0000 7fc01bb69700 1 -- 172.21.15.163:0/344601926 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc014100740 msgr2=0x7fc01419d020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:12:32.150 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:32.107+0000 7fc01bb69700 1 --2- 172.21.15.163:0/344601926 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc014100740 0x7fc01419d020 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7fc00c0079c0 tx=0x7fc00c00bd40 comp rx=0 tx=0).stop 2023-07-14T18:12:32.150 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:32.107+0000 7fc01bb69700 1 -- 172.21.15.163:0/344601926 shutdown_connections 2023-07-14T18:12:32.150 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:32.107+0000 7fc01bb69700 1 --2- 172.21.15.163:0/344601926 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7fc0000a12e0 0x7fc0000a3790 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:32.150 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:32.107+0000 7fc01bb69700 1 --2- 172.21.15.163:0/344601926 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc0140febb0 0x7fc014195a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:32.151 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:32.107+0000 7fc01bb69700 1 --2- 172.21.15.163:0/344601926 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc014100740 0x7fc01419d020 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:32.151 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:32.107+0000 7fc01bb69700 1 --2- 172.21.15.163:0/344601926 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc0140ffdb0 0x7fc014195fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:32.151 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:32.107+0000 7fc01bb69700 1 -- 172.21.15.163:0/344601926 >> 172.21.15.163:0/344601926 conn(0x7fc0140fa1e0 msgr2=0x7fc014068a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:12:32.151 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:32.107+0000 7fc01bb69700 1 -- 172.21.15.163:0/344601926 shutdown_connections 2023-07-14T18:12:32.152 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:32.107+0000 7fc01bb69700 1 -- 172.21.15.163:0/344601926 wait complete. 2023-07-14T18:12:32.586 INFO:teuthology.run_tasks:Running task cephadm.shell... 2023-07-14T18:12:32.595 INFO:tasks.cephadm:Running commands on role mon.a host ubuntu@smithi163.front.sepia.ceph.com 2023-07-14T18:12:32.596 DEBUG:teuthology.orchestra.run.smithi163:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81c9387d2e7576da065747ec9c16d1c7d69016ec shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bf7326ec-2270-11ee-9b33-001a4aab830c -- bash -c 'ceph fs dump' 2023-07-14T18:12:32.967 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:12:32 smithi163 ceph-mon[96576]: pgmap v294: 129 pgs: 129 active+clean; 643 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s; 0 B/s, 0 objects/s recovering 2023-07-14T18:12:33.151 INFO:teuthology.orchestra.run.smithi163.stderr:Inferring config /var/lib/ceph/bf7326ec-2270-11ee-9b33-001a4aab830c/mon.a/config 2023-07-14T18:12:33.175 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:12:32 smithi184 ceph-mon[98481]: pgmap v294: 129 pgs: 129 active+clean; 643 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s; 0 B/s, 0 objects/s recovering 2023-07-14T18:12:33.276 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:12:32 smithi172 ceph-mon[97983]: pgmap v294: 129 pgs: 129 active+clean; 643 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s; 0 B/s, 0 objects/s recovering 2023-07-14T18:12:33.965 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:12:33 smithi163 ceph-mon[96576]: from='client.15342 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2023-07-14T18:12:34.175 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:12:33 smithi184 ceph-mon[98481]: from='client.15342 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2023-07-14T18:12:34.276 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:12:33 smithi172 ceph-mon[97983]: from='client.15342 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2023-07-14T18:12:34.356 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:34.314+0000 7f9782b53700 1 -- 172.21.15.163:0/2836425213 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f977c100810 msgr2=0x7f977c1070d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:12:34.356 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:34.314+0000 7f9782b53700 1 --2- 172.21.15.163:0/2836425213 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f977c100810 0x7f977c1070d0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f977400b0a0 tx=0x7f977400b3b0 comp rx=0 tx=0).stop 2023-07-14T18:12:34.356 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:34.314+0000 7f9782b53700 1 -- 172.21.15.163:0/2836425213 shutdown_connections 2023-07-14T18:12:34.356 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:34.314+0000 7f9782b53700 1 --2- 172.21.15.163:0/2836425213 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f977c100810 0x7f977c1070d0 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:34.357 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:34.314+0000 7f9782b53700 1 --2- 172.21.15.163:0/2836425213 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f977c0fec80 0x7f977c0ff090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:34.357 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:34.314+0000 7f9782b53700 1 --2- 172.21.15.163:0/2836425213 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f977c0ffe80 0x7f977c1002d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:34.357 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:34.314+0000 7f9782b53700 1 -- 172.21.15.163:0/2836425213 >> 172.21.15.163:0/2836425213 conn(0x7f977c0fa2d0 msgr2=0x7f977c0fc700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:12:34.357 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:34.314+0000 7f9782b53700 1 -- 172.21.15.163:0/2836425213 shutdown_connections 2023-07-14T18:12:34.357 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:34.314+0000 7f9782b53700 1 -- 172.21.15.163:0/2836425213 wait complete. 2023-07-14T18:12:34.357 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:34.315+0000 7f9782b53700 1 Processor -- start 2023-07-14T18:12:34.357 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:34.315+0000 7f9782b53700 1 -- start start 2023-07-14T18:12:34.359 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:34.315+0000 7f9782b53700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f977c0fec80 0x7f977c069600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:12:34.359 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:34.315+0000 7f9782b53700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f977c0ffe80 0x7f977c19a770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:12:34.359 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:34.315+0000 7f9782b53700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f977c100810 0x7f977c19cdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:12:34.359 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:34.315+0000 7f9782b53700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f977c19d550 con 0x7f977c0fec80 2023-07-14T18:12:34.359 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:34.315+0000 7f9782b53700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f977c19d6c0 con 0x7f977c0ffe80 2023-07-14T18:12:34.360 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:34.315+0000 7f9782b53700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f977c19d880 con 0x7f977c100810 2023-07-14T18:12:34.360 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:34.315+0000 7f97808ef700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f977c0fec80 0x7f977c069600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:12:34.360 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:34.315+0000 7f97808ef700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f977c0fec80 0x7f977c069600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:57260/0 (socket says 172.21.15.163:57260) 2023-07-14T18:12:34.360 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:34.315+0000 7f97808ef700 1 -- 172.21.15.163:0/1324784630 learned_addr learned my addr 172.21.15.163:0/1324784630 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:12:34.360 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:34.315+0000 7f977bfff700 1 --2- 172.21.15.163:0/1324784630 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f977c0ffe80 0x7f977c19a770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:12:34.360 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:34.315+0000 7f97808ef700 1 -- 172.21.15.163:0/1324784630 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f977c100810 msgr2=0x7f977c19cdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:12:34.360 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:34.315+0000 7f97808ef700 1 --2- 172.21.15.163:0/1324784630 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f977c100810 0x7f977c19cdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:34.360 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:34.315+0000 7f97808ef700 1 -- 172.21.15.163:0/1324784630 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f977c0ffe80 msgr2=0x7f977c19a770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:12:34.361 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:34.315+0000 7f97808ef700 1 --2- 172.21.15.163:0/1324784630 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f977c0ffe80 0x7f977c19a770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:34.361 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:34.315+0000 7f97808ef700 1 -- 172.21.15.163:0/1324784630 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9774009d00 con 0x7f977c0fec80 2023-07-14T18:12:34.361 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:34.315+0000 7f977bfff700 1 --2- 172.21.15.163:0/1324784630 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f977c0ffe80 0x7f977c19a770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T18:12:34.361 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:34.316+0000 7f97808ef700 1 --2- 172.21.15.163:0/1324784630 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f977c0fec80 0x7f977c069600 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f977000d980 tx=0x7f977000dd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:12:34.361 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:34.316+0000 7f9779ffb700 1 -- 172.21.15.163:0/1324784630 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f977000de60 con 0x7f977c0fec80 2023-07-14T18:12:34.361 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:34.316+0000 7f9779ffb700 1 -- 172.21.15.163:0/1324784630 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f97700044b0 con 0x7f977c0fec80 2023-07-14T18:12:34.361 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:34.316+0000 7f9782b53700 1 -- 172.21.15.163:0/1324784630 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f977c19db60 con 0x7f977c0fec80 2023-07-14T18:12:34.362 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:34.316+0000 7f9779ffb700 1 -- 172.21.15.163:0/1324784630 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9770003b40 con 0x7f977c0fec80 2023-07-14T18:12:34.362 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:34.316+0000 7f9782b53700 1 -- 172.21.15.163:0/1324784630 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f977c19e060 con 0x7f977c0fec80 2023-07-14T18:12:34.362 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:34.317+0000 7f9782b53700 1 -- 172.21.15.163:0/1324784630 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f977c1062c0 con 0x7f977c0fec80 2023-07-14T18:12:34.363 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:34.318+0000 7f9779ffb700 1 -- 172.21.15.163:0/1324784630 <== mon.0 v2:172.21.15.163:3300/0 4 ==== mgrmap(e 17) v1 ==== 135767+0+0 (secure 0 0 0) 0x7f9770003ca0 con 0x7f977c0fec80 2023-07-14T18:12:34.363 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:34.318+0000 7f9779ffb700 1 --2- 172.21.15.163:0/1324784630 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f976c0a11e0 0x7f976c0a3690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:12:34.363 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:34.319+0000 7f977bfff700 1 --2- 172.21.15.163:0/1324784630 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f976c0a11e0 0x7f976c0a3690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:12:34.363 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:34.319+0000 7f9779ffb700 1 -- 172.21.15.163:0/1324784630 <== mon.0 v2:172.21.15.163:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 9020+0+0 (secure 0 0 0) 0x7f97700ccb40 con 0x7f977c0fec80 2023-07-14T18:12:34.363 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:34.319+0000 7f977bfff700 1 --2- 172.21.15.163:0/1324784630 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f976c0a11e0 0x7f976c0a3690 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f9768005fd0 tx=0x7f9768005ee0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:12:34.364 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:34.323+0000 7f9779ffb700 1 -- 172.21.15.163:0/1324784630 <== mon.0 v2:172.21.15.163:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178025 (secure 0 0 0) 0x7f9770095dc0 con 0x7f977c0fec80 2023-07-14T18:12:34.591 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:34.549+0000 7f9782b53700 1 -- 172.21.15.163:0/1324784630 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f977c02cab0 con 0x7f977c0fec80 2023-07-14T18:12:34.591 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:34.550+0000 7f9779ffb700 1 -- 172.21.15.163:0/1324784630 <== mon.0 v2:172.21.15.163:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 28 v28) v1 ==== 76+0+2941 (secure 0 0 0) 0x7f9770009940 con 0x7f977c0fec80 2023-07-14T18:12:34.592 INFO:teuthology.orchestra.run.smithi163.stdout:e28 2023-07-14T18:12:34.592 INFO:teuthology.orchestra.run.smithi163.stdout:enable_multiple, ever_enabled_multiple: 1,1 2023-07-14T18:12:34.592 INFO:teuthology.orchestra.run.smithi163.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-07-14T18:12:34.592 INFO:teuthology.orchestra.run.smithi163.stdout:legacy client fscid: 1 2023-07-14T18:12:34.592 INFO:teuthology.orchestra.run.smithi163.stdout: 2023-07-14T18:12:34.593 INFO:teuthology.orchestra.run.smithi163.stdout:Filesystem 'cephfs' (1) 2023-07-14T18:12:34.593 INFO:teuthology.orchestra.run.smithi163.stdout:fs_name cephfs 2023-07-14T18:12:34.593 INFO:teuthology.orchestra.run.smithi163.stdout:epoch 28 2023-07-14T18:12:34.593 INFO:teuthology.orchestra.run.smithi163.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2023-07-14T18:12:34.593 INFO:teuthology.orchestra.run.smithi163.stdout:created 2023-07-14T18:11:09.109693+0000 2023-07-14T18:12:34.593 INFO:teuthology.orchestra.run.smithi163.stdout:modified 2023-07-14T18:11:31.766338+0000 2023-07-14T18:12:34.593 INFO:teuthology.orchestra.run.smithi163.stdout:tableserver 0 2023-07-14T18:12:34.594 INFO:teuthology.orchestra.run.smithi163.stdout:root 0 2023-07-14T18:12:34.594 INFO:teuthology.orchestra.run.smithi163.stdout:session_timeout 300 2023-07-14T18:12:34.594 INFO:teuthology.orchestra.run.smithi163.stdout:session_autoclose 300 2023-07-14T18:12:34.594 INFO:teuthology.orchestra.run.smithi163.stdout:max_file_size 1099511627776 2023-07-14T18:12:34.594 INFO:teuthology.orchestra.run.smithi163.stdout:max_xattr_size 65536 2023-07-14T18:12:34.594 INFO:teuthology.orchestra.run.smithi163.stdout:required_client_features {} 2023-07-14T18:12:34.594 INFO:teuthology.orchestra.run.smithi163.stdout:last_failure 0 2023-07-14T18:12:34.594 INFO:teuthology.orchestra.run.smithi163.stdout:last_failure_osd_epoch 0 2023-07-14T18:12:34.595 INFO:teuthology.orchestra.run.smithi163.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-07-14T18:12:34.595 INFO:teuthology.orchestra.run.smithi163.stdout:max_mds 5 2023-07-14T18:12:34.595 INFO:teuthology.orchestra.run.smithi163.stdout:in 0,1,2,3,4 2023-07-14T18:12:34.595 INFO:teuthology.orchestra.run.smithi163.stdout:up {0=24518,1=24493,2=24479,3=24478,4=14652} 2023-07-14T18:12:34.595 INFO:teuthology.orchestra.run.smithi163.stdout:failed 2023-07-14T18:12:34.595 INFO:teuthology.orchestra.run.smithi163.stdout:damaged 2023-07-14T18:12:34.595 INFO:teuthology.orchestra.run.smithi163.stdout:stopped 2023-07-14T18:12:34.596 INFO:teuthology.orchestra.run.smithi163.stdout:data_pools [3,4] 2023-07-14T18:12:34.596 INFO:teuthology.orchestra.run.smithi163.stdout:metadata_pool 2 2023-07-14T18:12:34.596 INFO:teuthology.orchestra.run.smithi163.stdout:inline_data disabled 2023-07-14T18:12:34.596 INFO:teuthology.orchestra.run.smithi163.stdout:balancer 2023-07-14T18:12:34.596 INFO:teuthology.orchestra.run.smithi163.stdout:bal_rank_mask -1 2023-07-14T18:12:34.596 INFO:teuthology.orchestra.run.smithi163.stdout:standby_count_wanted 0 2023-07-14T18:12:34.596 INFO:teuthology.orchestra.run.smithi163.stdout:[mds.b{0:24518} state up:active seq 3 addr [v2:172.21.15.172:6838/3850440096,v1:172.21.15.172:6839/3850440096] compat {c=[1],r=[1],i=[7ff]}] 2023-07-14T18:12:34.596 INFO:teuthology.orchestra.run.smithi163.stdout:[mds.f{0:24466} state up:standby-replay seq 1 addr [v2:172.21.15.184:6834/460134263,v1:172.21.15.184:6835/460134263] compat {c=[1],r=[1],i=[7ff]}] 2023-07-14T18:12:34.597 INFO:teuthology.orchestra.run.smithi163.stdout:[mds.i{1:24493} state up:active seq 9 addr [v2:172.21.15.184:6838/2819059257,v1:172.21.15.184:6839/2819059257] compat {c=[1],r=[1],i=[7ff]}] 2023-07-14T18:12:34.597 INFO:teuthology.orchestra.run.smithi163.stdout:[mds.e{1:24458} state up:standby-replay seq 1 addr [v2:172.21.15.172:6834/1158120127,v1:172.21.15.172:6835/1158120127] compat {c=[1],r=[1],i=[7ff]}] 2023-07-14T18:12:34.597 INFO:teuthology.orchestra.run.smithi163.stdout:[mds.h{2:24479} state up:active seq 10 addr [v2:172.21.15.172:6836/3783835012,v1:172.21.15.172:6837/3783835012] compat {c=[1],r=[1],i=[7ff]}] 2023-07-14T18:12:34.597 INFO:teuthology.orchestra.run.smithi163.stdout:[mds.k{2:24431} state up:standby-replay seq 1 addr [v2:172.21.15.172:6832/1075696311,v1:172.21.15.172:6833/1075696311] compat {c=[1],r=[1],i=[7ff]}] 2023-07-14T18:12:34.597 INFO:teuthology.orchestra.run.smithi163.stdout:[mds.c{3:24478} state up:active seq 11 addr [v2:172.21.15.184:6836/3389277679,v1:172.21.15.184:6837/3389277679] compat {c=[1],r=[1],i=[7ff]}] 2023-07-14T18:12:34.597 INFO:teuthology.orchestra.run.smithi163.stdout:[mds.l{3:24421} state up:standby-replay seq 1 addr [v2:172.21.15.184:6832/797722972,v1:172.21.15.184:6833/797722972] compat {c=[1],r=[1],i=[7ff]}] 2023-07-14T18:12:34.597 INFO:teuthology.orchestra.run.smithi163.stdout:[mds.a{4:14652} state up:active seq 9 addr [v2:172.21.15.163:6840/1032082642,v1:172.21.15.163:6841/1032082642] compat {c=[1],r=[1],i=[7ff]}] 2023-07-14T18:12:34.597 INFO:teuthology.orchestra.run.smithi163.stdout:[mds.g{4:14640} state up:standby-replay seq 1 addr [v2:172.21.15.163:6838/1337572937,v1:172.21.15.163:6839/1337572937] compat {c=[1],r=[1],i=[7ff]}] 2023-07-14T18:12:34.598 INFO:teuthology.orchestra.run.smithi163.stdout: 2023-07-14T18:12:34.598 INFO:teuthology.orchestra.run.smithi163.stdout: 2023-07-14T18:12:34.598 INFO:teuthology.orchestra.run.smithi163.stdout:Standby daemons: 2023-07-14T18:12:34.598 INFO:teuthology.orchestra.run.smithi163.stdout: 2023-07-14T18:12:34.598 INFO:teuthology.orchestra.run.smithi163.stdout:[mds.j{-1:14562} state up:standby seq 1 addr [v2:172.21.15.163:6834/1058662632,v1:172.21.15.163:6835/1058662632] compat {c=[1],r=[1],i=[7ff]}] 2023-07-14T18:12:34.598 INFO:teuthology.orchestra.run.smithi163.stdout:[mds.d{-1:14568} state up:standby seq 1 addr [v2:172.21.15.163:6836/1107244425,v1:172.21.15.163:6837/1107244425] compat {c=[1],r=[1],i=[7ff]}] 2023-07-14T18:12:34.599 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:34.552+0000 7f9782b53700 1 -- 172.21.15.163:0/1324784630 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f976c0a11e0 msgr2=0x7f976c0a3690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:12:34.599 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:34.552+0000 7f9782b53700 1 --2- 172.21.15.163:0/1324784630 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f976c0a11e0 0x7f976c0a3690 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f9768005fd0 tx=0x7f9768005ee0 comp rx=0 tx=0).stop 2023-07-14T18:12:34.599 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:34.552+0000 7f9782b53700 1 -- 172.21.15.163:0/1324784630 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f977c0fec80 msgr2=0x7f977c069600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:12:34.599 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:34.552+0000 7f9782b53700 1 --2- 172.21.15.163:0/1324784630 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f977c0fec80 0x7f977c069600 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f977000d980 tx=0x7f977000dd40 comp rx=0 tx=0).stop 2023-07-14T18:12:34.599 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:34.552+0000 7f9782b53700 1 -- 172.21.15.163:0/1324784630 shutdown_connections 2023-07-14T18:12:34.600 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:34.552+0000 7f9782b53700 1 --2- 172.21.15.163:0/1324784630 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f976c0a11e0 0x7f976c0a3690 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:34.600 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:34.552+0000 7f9782b53700 1 --2- 172.21.15.163:0/1324784630 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f977c100810 0x7f977c19cdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:34.600 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:34.552+0000 7f9782b53700 1 --2- 172.21.15.163:0/1324784630 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f977c0fec80 0x7f977c069600 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:34.600 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:34.552+0000 7f9782b53700 1 --2- 172.21.15.163:0/1324784630 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f977c0ffe80 0x7f977c19a770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:34.600 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:34.552+0000 7f9782b53700 1 -- 172.21.15.163:0/1324784630 >> 172.21.15.163:0/1324784630 conn(0x7f977c0fa2d0 msgr2=0x7f977c103400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:12:34.600 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:34.552+0000 7f9782b53700 1 -- 172.21.15.163:0/1324784630 shutdown_connections 2023-07-14T18:12:34.600 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:34.552+0000 7f9782b53700 1 -- 172.21.15.163:0/1324784630 wait complete. 2023-07-14T18:12:34.601 INFO:teuthology.orchestra.run.smithi163.stderr:dumped fsmap epoch 28 2023-07-14T18:12:34.933 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:12:34 smithi163 ceph-mon[96576]: pgmap v295: 129 pgs: 129 active+clean; 643 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-07-14T18:12:34.934 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:12:34 smithi163 ceph-mon[96576]: from='client.? 172.21.15.163:0/1324784630' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-07-14T18:12:35.014 DEBUG:teuthology.orchestra.run.smithi163:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81c9387d2e7576da065747ec9c16d1c7d69016ec shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bf7326ec-2270-11ee-9b33-001a4aab830c -- bash -c 'ceph osd dump' 2023-07-14T18:12:35.175 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:12:34 smithi184 ceph-mon[98481]: pgmap v295: 129 pgs: 129 active+clean; 643 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-07-14T18:12:35.175 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:12:34 smithi184 ceph-mon[98481]: from='client.? 172.21.15.163:0/1324784630' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-07-14T18:12:35.276 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:12:34 smithi172 ceph-mon[97983]: pgmap v295: 129 pgs: 129 active+clean; 643 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-07-14T18:12:35.276 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:12:34 smithi172 ceph-mon[97983]: from='client.? 172.21.15.163:0/1324784630' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-07-14T18:12:35.566 INFO:teuthology.orchestra.run.smithi163.stderr:Inferring config /var/lib/ceph/bf7326ec-2270-11ee-9b33-001a4aab830c/mon.a/config 2023-07-14T18:12:36.802 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:36.759+0000 7f269a788700 1 -- 172.21.15.163:0/3579843067 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f26941007b0 msgr2=0x7f2694107050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:12:36.802 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:36.759+0000 7f269a788700 1 --2- 172.21.15.163:0/3579843067 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f26941007b0 0x7f2694107050 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f268c00b0a0 tx=0x7f268c00b3b0 comp rx=0 tx=0).stop 2023-07-14T18:12:36.802 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:36.759+0000 7f269a788700 1 -- 172.21.15.163:0/3579843067 shutdown_connections 2023-07-14T18:12:36.803 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:36.759+0000 7f269a788700 1 --2- 172.21.15.163:0/3579843067 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f26940ff0e0 0x7f26940ff4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:36.803 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:36.759+0000 7f269a788700 1 --2- 172.21.15.163:0/3579843067 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f26941007b0 0x7f2694107050 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:36.803 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:36.759+0000 7f269a788700 1 --2- 172.21.15.163:0/3579843067 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f26940ffe00 0x7f2694100270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:36.803 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:36.759+0000 7f269a788700 1 -- 172.21.15.163:0/3579843067 >> 172.21.15.163:0/3579843067 conn(0x7f26940f9990 msgr2=0x7f26940fbdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:12:36.803 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:36.759+0000 7f269a788700 1 -- 172.21.15.163:0/3579843067 shutdown_connections 2023-07-14T18:12:36.803 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:36.759+0000 7f269a788700 1 -- 172.21.15.163:0/3579843067 wait complete. 2023-07-14T18:12:36.803 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:36.759+0000 7f269a788700 1 Processor -- start 2023-07-14T18:12:36.804 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:36.760+0000 7f269a788700 1 -- start start 2023-07-14T18:12:36.804 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:36.760+0000 7f269a788700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f26940ff0e0 0x7f2694194920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:12:36.804 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:36.760+0000 7f269a788700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f26940ffe00 0x7f2694194e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:12:36.804 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:36.760+0000 7f269a788700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f26941007b0 0x7f269419bee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:12:36.804 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:36.760+0000 7f269a788700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f269419c4b0 con 0x7f26940ff0e0 2023-07-14T18:12:36.804 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:36.760+0000 7f269a788700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f269419c5f0 con 0x7f26940ffe00 2023-07-14T18:12:36.804 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:36.760+0000 7f269a788700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f269419c780 con 0x7f26941007b0 2023-07-14T18:12:36.805 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:36.760+0000 7f2693fff700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f26940ff0e0 0x7f2694194920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:12:36.805 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:36.760+0000 7f2693fff700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f26940ff0e0 0x7f2694194920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:57274/0 (socket says 172.21.15.163:57274) 2023-07-14T18:12:36.805 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:36.760+0000 7f2693fff700 1 -- 172.21.15.163:0/1537503134 learned_addr learned my addr 172.21.15.163:0/1537503134 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:12:36.805 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:36.760+0000 7f26937fe700 1 --2- 172.21.15.163:0/1537503134 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f26940ffe00 0x7f2694194e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:12:36.805 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:36.760+0000 7f2698d25700 1 --2- 172.21.15.163:0/1537503134 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f26941007b0 0x7f269419bee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:12:36.805 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:36.760+0000 7f2693fff700 1 -- 172.21.15.163:0/1537503134 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f26941007b0 msgr2=0x7f269419bee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:12:36.805 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:36.760+0000 7f2693fff700 1 --2- 172.21.15.163:0/1537503134 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f26941007b0 0x7f269419bee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:36.806 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:36.760+0000 7f2693fff700 1 -- 172.21.15.163:0/1537503134 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f26940ffe00 msgr2=0x7f2694194e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:12:36.806 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:36.760+0000 7f2693fff700 1 --2- 172.21.15.163:0/1537503134 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f26940ffe00 0x7f2694194e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:36.806 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:36.760+0000 7f2693fff700 1 -- 172.21.15.163:0/1537503134 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f268c009d00 con 0x7f26940ff0e0 2023-07-14T18:12:36.806 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:36.760+0000 7f2693fff700 1 --2- 172.21.15.163:0/1537503134 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f26940ff0e0 0x7f2694194920 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f268400e9a0 tx=0x7f268400ed60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:12:36.806 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:36.761+0000 7f26917fa700 1 -- 172.21.15.163:0/1537503134 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2684009790 con 0x7f26940ff0e0 2023-07-14T18:12:36.806 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:36.761+0000 7f269a788700 1 -- 172.21.15.163:0/1537503134 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f269419ca60 con 0x7f26940ff0e0 2023-07-14T18:12:36.806 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:36.761+0000 7f26917fa700 1 -- 172.21.15.163:0/1537503134 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f26840044b0 con 0x7f26940ff0e0 2023-07-14T18:12:36.806 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:36.761+0000 7f26917fa700 1 -- 172.21.15.163:0/1537503134 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2684003d00 con 0x7f26940ff0e0 2023-07-14T18:12:36.807 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:36.761+0000 7f269a788700 1 -- 172.21.15.163:0/1537503134 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f269419cf60 con 0x7f26940ff0e0 2023-07-14T18:12:36.807 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:36.762+0000 7f269a788700 1 -- 172.21.15.163:0/1537503134 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f269410a260 con 0x7f26940ff0e0 2023-07-14T18:12:36.807 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:36.763+0000 7f26917fa700 1 -- 172.21.15.163:0/1537503134 <== mon.0 v2:172.21.15.163:3300/0 4 ==== mgrmap(e 17) v1 ==== 135767+0+0 (secure 0 0 0) 0x7f2684003e60 con 0x7f26940ff0e0 2023-07-14T18:12:36.808 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:36.763+0000 7f26917fa700 1 --2- 172.21.15.163:0/1537503134 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f26800a11e0 0x7f26800a3690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:12:36.808 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:36.764+0000 7f26937fe700 1 --2- 172.21.15.163:0/1537503134 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f26800a11e0 0x7f26800a3690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:12:36.808 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:36.764+0000 7f26917fa700 1 -- 172.21.15.163:0/1537503134 <== mon.0 v2:172.21.15.163:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 9020+0+0 (secure 0 0 0) 0x7f2684014070 con 0x7f26940ff0e0 2023-07-14T18:12:36.808 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:36.764+0000 7f26937fe700 1 --2- 172.21.15.163:0/1537503134 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f26800a11e0 0x7f26800a3690 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f26940fee10 tx=0x7f267c009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:12:36.808 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:36.767+0000 7f26917fa700 1 -- 172.21.15.163:0/1537503134 <== mon.0 v2:172.21.15.163:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178025 (secure 0 0 0) 0x7f26840964e0 con 0x7f26940ff0e0 2023-07-14T18:12:36.967 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:12:36 smithi163 ceph-mon[96576]: pgmap v296: 129 pgs: 129 active+clean; 643 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-07-14T18:12:37.000 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:36.959+0000 7f269a788700 1 -- 172.21.15.163:0/1537503134 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "osd dump"} v 0) v1 -- 0x7f269410a480 con 0x7f26940ff0e0 2023-07-14T18:12:37.001 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:36.959+0000 7f26917fa700 1 -- 172.21.15.163:0/1537503134 <== mon.0 v2:172.21.15.163:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump"}]=0 v86) v1 ==== 56+0+5630 (secure 0 0 0) 0x7f2684099b00 con 0x7f26940ff0e0 2023-07-14T18:12:37.001 INFO:teuthology.orchestra.run.smithi163.stdout:epoch 86 2023-07-14T18:12:37.001 INFO:teuthology.orchestra.run.smithi163.stdout:fsid bf7326ec-2270-11ee-9b33-001a4aab830c 2023-07-14T18:12:37.001 INFO:teuthology.orchestra.run.smithi163.stdout:created 2023-07-14T18:04:26.263517+0000 2023-07-14T18:12:37.001 INFO:teuthology.orchestra.run.smithi163.stdout:modified 2023-07-14T18:12:16.776609+0000 2023-07-14T18:12:37.002 INFO:teuthology.orchestra.run.smithi163.stdout:flags sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit 2023-07-14T18:12:37.002 INFO:teuthology.orchestra.run.smithi163.stdout:crush_version 27 2023-07-14T18:12:37.002 INFO:teuthology.orchestra.run.smithi163.stdout:full_ratio 0.95 2023-07-14T18:12:37.002 INFO:teuthology.orchestra.run.smithi163.stdout:backfillfull_ratio 0.9 2023-07-14T18:12:37.002 INFO:teuthology.orchestra.run.smithi163.stdout:nearfull_ratio 0.85 2023-07-14T18:12:37.002 INFO:teuthology.orchestra.run.smithi163.stdout:require_min_compat_client luminous 2023-07-14T18:12:37.002 INFO:teuthology.orchestra.run.smithi163.stdout:min_compat_client luminous 2023-07-14T18:12:37.003 INFO:teuthology.orchestra.run.smithi163.stdout:require_osd_release reef 2023-07-14T18:12:37.003 INFO:teuthology.orchestra.run.smithi163.stdout:stretch_mode_enabled false 2023-07-14T18:12:37.003 INFO:teuthology.orchestra.run.smithi163.stdout:pool 1 '.mgr' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 1 pgp_num 1 autoscale_mode off last_change 21 flags hashpspool stripe_width 0 pg_num_max 32 pg_num_min 1 application mgr read_balance_score 12.00 2023-07-14T18:12:37.003 INFO:teuthology.orchestra.run.smithi163.stdout:pool 2 'cephfs_metadata' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 32 pgp_num 32 autoscale_mode off last_change 79 flags hashpspool stripe_width 0 pg_autoscale_bias 4 pg_num_min 16 recovery_priority 5 application cephfs read_balance_score 2.25 2023-07-14T18:12:37.003 INFO:teuthology.orchestra.run.smithi163.stdout:pool 3 'cephfs_data' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 64 pgp_num 64 autoscale_mode off last_change 80 flags hashpspool stripe_width 0 pg_num_min 64 target_size_ratio 0.05 application cephfs read_balance_score 1.50 2023-07-14T18:12:37.003 INFO:teuthology.orchestra.run.smithi163.stdout:pool 4 'cephfs_data_ec' erasure profile cephfs_data_ec size 4 min_size 3 crush_rule 1 object_hash rjenkins pg_num 32 pgp_num 32 autoscale_mode off last_change 84 flags hashpspool,ec_overwrites stripe_width 8192 pg_num_min 64 target_size_ratio 0.9 application cephfs 2023-07-14T18:12:37.003 INFO:teuthology.orchestra.run.smithi163.stdout:max_osd 12 2023-07-14T18:12:37.003 INFO:teuthology.orchestra.run.smithi163.stdout:osd.0 up in weight 1 up_from 8 up_thru 85 down_at 0 last_clean_interval [0,0) [v2:172.21.15.163:6802/3124653025,v1:172.21.15.163:6803/3124653025] [v2:172.21.15.163:6804/3124653025,v1:172.21.15.163:6805/3124653025] exists,up e6490568-046d-43ef-bb07-d79fb884b276 2023-07-14T18:12:37.004 INFO:teuthology.orchestra.run.smithi163.stdout:osd.1 up in weight 1 up_from 13 up_thru 85 down_at 0 last_clean_interval [0,0) [v2:172.21.15.172:6800/3774455900,v1:172.21.15.172:6801/3774455900] [v2:172.21.15.172:6802/3774455900,v1:172.21.15.172:6803/3774455900] exists,up 0af39bda-f096-4603-adcc-bf1988f36603 2023-07-14T18:12:37.004 INFO:teuthology.orchestra.run.smithi163.stdout:osd.2 up in weight 1 up_from 18 up_thru 85 down_at 0 last_clean_interval [0,0) [v2:172.21.15.184:6800/1976927678,v1:172.21.15.184:6801/1976927678] [v2:172.21.15.184:6802/1976927678,v1:172.21.15.184:6803/1976927678] exists,up cc732c13-af0f-4199-98e6-fe960ed4e5dc 2023-07-14T18:12:37.004 INFO:teuthology.orchestra.run.smithi163.stdout:osd.3 up in weight 1 up_from 25 up_thru 85 down_at 0 last_clean_interval [0,0) [v2:172.21.15.163:6810/2589130694,v1:172.21.15.163:6811/2589130694] [v2:172.21.15.163:6812/2589130694,v1:172.21.15.163:6813/2589130694] exists,up dcee9576-0bc6-4ab0-8f63-79eacd0eca5f 2023-07-14T18:12:37.004 INFO:teuthology.orchestra.run.smithi163.stdout:osd.4 up in weight 1 up_from 32 up_thru 82 down_at 0 last_clean_interval [0,0) [v2:172.21.15.172:6808/3319632614,v1:172.21.15.172:6809/3319632614] [v2:172.21.15.172:6810/3319632614,v1:172.21.15.172:6811/3319632614] exists,up 055df823-b8b0-426a-83c2-f0d727932ad8 2023-07-14T18:12:37.004 INFO:teuthology.orchestra.run.smithi163.stdout:osd.5 up in weight 1 up_from 37 up_thru 82 down_at 0 last_clean_interval [0,0) [v2:172.21.15.184:6808/2662084043,v1:172.21.15.184:6809/2662084043] [v2:172.21.15.184:6810/2662084043,v1:172.21.15.184:6811/2662084043] exists,up ef5ef02a-b4e2-4790-9d27-f6d2247b25c8 2023-07-14T18:12:37.004 INFO:teuthology.orchestra.run.smithi163.stdout:osd.6 up in weight 1 up_from 44 up_thru 85 down_at 0 last_clean_interval [0,0) [v2:172.21.15.163:6818/2530874117,v1:172.21.15.163:6819/2530874117] [v2:172.21.15.163:6820/2530874117,v1:172.21.15.163:6821/2530874117] exists,up dba754be-0fc5-4867-a6d5-cf97eb344f81 2023-07-14T18:12:37.004 INFO:teuthology.orchestra.run.smithi163.stdout:osd.7 up in weight 1 up_from 49 up_thru 82 down_at 0 last_clean_interval [0,0) [v2:172.21.15.172:6816/233511803,v1:172.21.15.172:6817/233511803] [v2:172.21.15.172:6818/233511803,v1:172.21.15.172:6819/233511803] exists,up edd76e6b-6077-4619-b00d-1e906f70ddcc 2023-07-14T18:12:37.005 INFO:teuthology.orchestra.run.smithi163.stdout:osd.8 up in weight 1 up_from 56 up_thru 85 down_at 0 last_clean_interval [0,0) [v2:172.21.15.184:6816/290154343,v1:172.21.15.184:6817/290154343] [v2:172.21.15.184:6818/290154343,v1:172.21.15.184:6819/290154343] exists,up 36559400-f33e-44e6-868a-316d34da457d 2023-07-14T18:12:37.005 INFO:teuthology.orchestra.run.smithi163.stdout:osd.9 up in weight 1 up_from 63 up_thru 82 down_at 0 last_clean_interval [0,0) [v2:172.21.15.163:6826/3848110906,v1:172.21.15.163:6827/3848110906] [v2:172.21.15.163:6828/3848110906,v1:172.21.15.163:6829/3848110906] exists,up d484f111-f36c-4c67-9a8a-ae03e7e0d137 2023-07-14T18:12:37.005 INFO:teuthology.orchestra.run.smithi163.stdout:osd.10 up in weight 1 up_from 68 up_thru 85 down_at 0 last_clean_interval [0,0) [v2:172.21.15.172:6824/3281085356,v1:172.21.15.172:6825/3281085356] [v2:172.21.15.172:6826/3281085356,v1:172.21.15.172:6827/3281085356] exists,up d943f7c0-da3d-4605-9e23-0231e675c6be 2023-07-14T18:12:37.005 INFO:teuthology.orchestra.run.smithi163.stdout:osd.11 up in weight 1 up_from 75 up_thru 85 down_at 0 last_clean_interval [0,0) [v2:172.21.15.184:6824/3614578747,v1:172.21.15.184:6825/3614578747] [v2:172.21.15.184:6826/3614578747,v1:172.21.15.184:6827/3614578747] exists,up 09e610a8-408a-4119-a21b-c4de2810a538 2023-07-14T18:12:37.005 INFO:teuthology.orchestra.run.smithi163.stdout:pg_upmap_items 2.8 [2,11] 2023-07-14T18:12:37.005 INFO:teuthology.orchestra.run.smithi163.stdout:pg_upmap_items 3.1 [4,9] 2023-07-14T18:12:37.005 INFO:teuthology.orchestra.run.smithi163.stdout:pg_upmap_items 3.6 [4,6] 2023-07-14T18:12:37.005 INFO:teuthology.orchestra.run.smithi163.stdout:pg_upmap_items 3.25 [5,9] 2023-07-14T18:12:37.006 INFO:teuthology.orchestra.run.smithi163.stdout:pg_upmap_items 3.27 [4,8] 2023-07-14T18:12:37.006 INFO:teuthology.orchestra.run.smithi163.stdout:pg_upmap_items 3.2d [3,9] 2023-07-14T18:12:37.006 INFO:teuthology.orchestra.run.smithi163.stdout:pg_upmap_items 4.a [5,8] 2023-07-14T18:12:37.006 INFO:teuthology.orchestra.run.smithi163.stdout:pg_upmap_items 4.12 [9,10] 2023-07-14T18:12:37.006 INFO:teuthology.orchestra.run.smithi163.stdout:pg_upmap_items 4.14 [9,8] 2023-07-14T18:12:37.006 INFO:teuthology.orchestra.run.smithi163.stdout:pg_upmap_items 4.17 [9,8] 2023-07-14T18:12:37.006 INFO:teuthology.orchestra.run.smithi163.stdout:blocklist 172.21.15.163:6801/1086512093 expires 2023-07-15T18:05:15.331458+0000 2023-07-14T18:12:37.006 INFO:teuthology.orchestra.run.smithi163.stdout:blocklist 172.21.15.163:6800/1086512093 expires 2023-07-15T18:05:15.331458+0000 2023-07-14T18:12:37.007 INFO:teuthology.orchestra.run.smithi163.stdout:blocklist 172.21.15.163:0/4235784810 expires 2023-07-15T18:05:15.331458+0000 2023-07-14T18:12:37.007 INFO:teuthology.orchestra.run.smithi163.stdout:blocklist 172.21.15.163:6800/236891232 expires 2023-07-15T18:04:53.288443+0000 2023-07-14T18:12:37.007 INFO:teuthology.orchestra.run.smithi163.stdout:blocklist 172.21.15.163:6801/236891232 expires 2023-07-15T18:04:53.288443+0000 2023-07-14T18:12:37.007 INFO:teuthology.orchestra.run.smithi163.stdout:blocklist 172.21.15.163:0/3260193612 expires 2023-07-15T18:05:15.331458+0000 2023-07-14T18:12:37.007 INFO:teuthology.orchestra.run.smithi163.stdout:blocklist 172.21.15.163:0/3513629472 expires 2023-07-15T18:04:53.288443+0000 2023-07-14T18:12:37.007 INFO:teuthology.orchestra.run.smithi163.stdout:blocklist 172.21.15.163:0/1090329830 expires 2023-07-15T18:04:53.288443+0000 2023-07-14T18:12:37.007 INFO:teuthology.orchestra.run.smithi163.stdout:blocklist 172.21.15.163:0/3868922045 expires 2023-07-15T18:05:15.331458+0000 2023-07-14T18:12:37.007 INFO:teuthology.orchestra.run.smithi163.stdout:blocklist 172.21.15.163:0/2945662447 expires 2023-07-15T18:04:53.288443+0000 2023-07-14T18:12:37.008 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:36.962+0000 7f269a788700 1 -- 172.21.15.163:0/1537503134 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f26800a11e0 msgr2=0x7f26800a3690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:12:37.008 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:36.962+0000 7f269a788700 1 --2- 172.21.15.163:0/1537503134 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f26800a11e0 0x7f26800a3690 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f26940fee10 tx=0x7f267c009260 comp rx=0 tx=0).stop 2023-07-14T18:12:37.009 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:36.962+0000 7f269a788700 1 -- 172.21.15.163:0/1537503134 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f26940ff0e0 msgr2=0x7f2694194920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:12:37.009 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:36.962+0000 7f269a788700 1 --2- 172.21.15.163:0/1537503134 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f26940ff0e0 0x7f2694194920 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f268400e9a0 tx=0x7f268400ed60 comp rx=0 tx=0).stop 2023-07-14T18:12:37.009 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:36.962+0000 7f269a788700 1 -- 172.21.15.163:0/1537503134 shutdown_connections 2023-07-14T18:12:37.009 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:36.962+0000 7f269a788700 1 --2- 172.21.15.163:0/1537503134 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f26800a11e0 0x7f26800a3690 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:37.009 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:36.962+0000 7f269a788700 1 --2- 172.21.15.163:0/1537503134 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f26941007b0 0x7f269419bee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:37.009 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:36.962+0000 7f269a788700 1 --2- 172.21.15.163:0/1537503134 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f26940ff0e0 0x7f2694194920 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:37.009 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:36.962+0000 7f269a788700 1 --2- 172.21.15.163:0/1537503134 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f26940ffe00 0x7f2694194e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:37.009 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:36.962+0000 7f269a788700 1 -- 172.21.15.163:0/1537503134 >> 172.21.15.163:0/1537503134 conn(0x7f26940f9990 msgr2=0x7f2694103340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:12:37.010 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:36.962+0000 7f269a788700 1 -- 172.21.15.163:0/1537503134 shutdown_connections 2023-07-14T18:12:37.010 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:36.962+0000 7f269a788700 1 -- 172.21.15.163:0/1537503134 wait complete. 2023-07-14T18:12:37.175 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:12:36 smithi184 ceph-mon[98481]: pgmap v296: 129 pgs: 129 active+clean; 643 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-07-14T18:12:37.276 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:12:36 smithi172 ceph-mon[97983]: pgmap v296: 129 pgs: 129 active+clean; 643 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-07-14T18:12:37.429 INFO:teuthology.run_tasks:Running task fs.ready... 2023-07-14T18:12:37.442 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-14T18:12:37.569 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:37.527+0000 7f87ba68a700 1 -- 172.21.15.163:0/442056707 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f87b4100680 msgr2=0x7f87b4106f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:12:37.569 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:37.527+0000 7f87ba68a700 1 --2- 172.21.15.163:0/442056707 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f87b4100680 0x7f87b4106f40 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f87ac00b0a0 tx=0x7f87ac00b3b0 comp rx=0 tx=0).stop 2023-07-14T18:12:37.569 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:37.527+0000 7f87ba68a700 1 -- 172.21.15.163:0/442056707 shutdown_connections 2023-07-14T18:12:37.570 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:37.527+0000 7f87ba68a700 1 --2- 172.21.15.163:0/442056707 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f87b4100680 0x7f87b4106f40 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:37.570 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:37.527+0000 7f87ba68a700 1 --2- 172.21.15.163:0/442056707 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f87b40feb00 0x7f87b40fef10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:37.570 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:37.527+0000 7f87ba68a700 1 --2- 172.21.15.163:0/442056707 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f87b40ffcf0 0x7f87b4100140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:37.570 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:37.527+0000 7f87ba68a700 1 -- 172.21.15.163:0/442056707 >> 172.21.15.163:0/442056707 conn(0x7f87b40fa100 msgr2=0x7f87b40fc550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:12:37.570 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:37.527+0000 7f87ba68a700 1 -- 172.21.15.163:0/442056707 shutdown_connections 2023-07-14T18:12:37.570 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:37.527+0000 7f87ba68a700 1 -- 172.21.15.163:0/442056707 wait complete. 2023-07-14T18:12:37.570 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:37.528+0000 7f87ba68a700 1 Processor -- start 2023-07-14T18:12:37.570 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:37.528+0000 7f87ba68a700 1 -- start start 2023-07-14T18:12:37.572 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:37.528+0000 7f87ba68a700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f87b40feb00 0x7f87b4197b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:12:37.572 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:37.528+0000 7f87ba68a700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f87b40ffcf0 0x7f87b4198090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:12:37.572 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:37.528+0000 7f87ba68a700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f87b4100680 0x7f87b419f100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:12:37.573 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:37.528+0000 7f87ba68a700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87b419f6d0 con 0x7f87b40ffcf0 2023-07-14T18:12:37.573 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:37.528+0000 7f87ba68a700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87b419f810 con 0x7f87b4100680 2023-07-14T18:12:37.573 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:37.528+0000 7f87ba68a700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87b419f9a0 con 0x7f87b40feb00 2023-07-14T18:12:37.573 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:37.528+0000 7f87b37fe700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f87b40ffcf0 0x7f87b4198090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:12:37.573 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:37.528+0000 7f87b37fe700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f87b40ffcf0 0x7f87b4198090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:57286/0 (socket says 172.21.15.163:57286) 2023-07-14T18:12:37.573 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:37.528+0000 7f87b37fe700 1 -- 172.21.15.163:0/1595975035 learned_addr learned my addr 172.21.15.163:0/1595975035 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:12:37.573 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:37.529+0000 7f87b8c27700 1 --2- 172.21.15.163:0/1595975035 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f87b4100680 0x7f87b419f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:12:37.574 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:37.529+0000 7f87b3fff700 1 --2- 172.21.15.163:0/1595975035 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f87b40feb00 0x7f87b4197b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:12:37.574 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:37.529+0000 7f87b37fe700 1 -- 172.21.15.163:0/1595975035 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f87b40feb00 msgr2=0x7f87b4197b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:12:37.574 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:37.529+0000 7f87b37fe700 1 --2- 172.21.15.163:0/1595975035 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f87b40feb00 0x7f87b4197b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:37.574 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:37.529+0000 7f87b37fe700 1 -- 172.21.15.163:0/1595975035 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f87b4100680 msgr2=0x7f87b419f100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:12:37.574 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:37.529+0000 7f87b37fe700 1 --2- 172.21.15.163:0/1595975035 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f87b4100680 0x7f87b419f100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:37.574 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:37.529+0000 7f87b37fe700 1 -- 172.21.15.163:0/1595975035 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87ac009d00 con 0x7f87b40ffcf0 2023-07-14T18:12:37.574 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:37.529+0000 7f87b37fe700 1 --2- 172.21.15.163:0/1595975035 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f87b40ffcf0 0x7f87b4198090 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f87a400e9a0 tx=0x7f87a400ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:12:37.574 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:37.529+0000 7f87b17fa700 1 -- 172.21.15.163:0/1595975035 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87a4009790 con 0x7f87b40ffcf0 2023-07-14T18:12:37.575 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:37.529+0000 7f87b17fa700 1 -- 172.21.15.163:0/1595975035 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f87a4010430 con 0x7f87b40ffcf0 2023-07-14T18:12:37.575 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:37.529+0000 7f87ba68a700 1 -- 172.21.15.163:0/1595975035 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f87b419fc80 con 0x7f87b40ffcf0 2023-07-14T18:12:37.575 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:37.529+0000 7f87b17fa700 1 -- 172.21.15.163:0/1595975035 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87a400cea0 con 0x7f87b40ffcf0 2023-07-14T18:12:37.575 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:37.529+0000 7f87ba68a700 1 -- 172.21.15.163:0/1595975035 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f87b41a0190 con 0x7f87b40ffcf0 2023-07-14T18:12:37.575 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:37.530+0000 7f87ba68a700 1 -- 172.21.15.163:0/1595975035 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f87b410a1e0 con 0x7f87b40ffcf0 2023-07-14T18:12:37.576 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:37.531+0000 7f87b17fa700 1 -- 172.21.15.163:0/1595975035 <== mon.0 v2:172.21.15.163:3300/0 4 ==== mgrmap(e 17) v1 ==== 135767+0+0 (secure 0 0 0) 0x7f87a40105a0 con 0x7f87b40ffcf0 2023-07-14T18:12:37.576 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:37.532+0000 7f87b17fa700 1 --2- 172.21.15.163:0/1595975035 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f879c0a12a0 0x7f879c0a3750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:12:37.576 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:37.532+0000 7f87b3fff700 1 --2- 172.21.15.163:0/1595975035 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f879c0a12a0 0x7f879c0a3750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:12:37.576 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:37.532+0000 7f87b17fa700 1 -- 172.21.15.163:0/1595975035 <== mon.0 v2:172.21.15.163:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 9020+0+0 (secure 0 0 0) 0x7f87a4014070 con 0x7f87b40ffcf0 2023-07-14T18:12:37.576 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:37.532+0000 7f87b3fff700 1 --2- 172.21.15.163:0/1595975035 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f879c0a12a0 0x7f879c0a3750 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f87b40ffb50 tx=0x7f87a800b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:12:37.577 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:37.536+0000 7f87b17fa700 1 -- 172.21.15.163:0/1595975035 <== mon.0 v2:172.21.15.163:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178025 (secure 0 0 0) 0x7f87a4096400 con 0x7f87b40ffcf0 2023-07-14T18:12:37.771 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:37.730+0000 7f87ba68a700 1 -- 172.21.15.163:0/1595975035 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f87b41a07a0 con 0x7f87b40ffcf0 2023-07-14T18:12:37.773 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:37.732+0000 7f87b17fa700 1 -- 172.21.15.163:0/1595975035 <== mon.0 v2:172.21.15.163:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v86) v1 ==== 74+0+24500 (secure 0 0 0) 0x7f87a4099a20 con 0x7f87b40ffcf0 2023-07-14T18:12:37.773 INFO:teuthology.orchestra.run.smithi163.stdout: 2023-07-14T18:12:37.774 INFO:teuthology.orchestra.run.smithi163.stdout:{"epoch":86,"fsid":"bf7326ec-2270-11ee-9b33-001a4aab830c","created":"2023-07-14T18:04:26.263517+0000","modified":"2023-07-14T18:12:16.776609+0000","last_up_change":"2023-07-14T18:10:27.514863+0000","last_in_change":"2023-07-14T18:10:10.726443+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-14T18:07:19.653852+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-07-14T18:11:07.314989+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-07-14T18:11:08.274627+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-07-14T18:11:11.991162+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"e6490568-046d-43ef-bb07-d79fb884b276","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6802","nonce":3124653025},{"type":"v1","addr":"172.21.15.163:6803","nonce":3124653025}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6804","nonce":3124653025},{"type":"v1","addr":"172.21.15.163:6805","nonce":3124653025}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6808","nonce":3124653025},{"type":"v1","addr":"172.21.15.163:6809","nonce":3124653025}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6806","nonce":3124653025},{"type":"v1","addr":"172.21.15.163:6807","nonce":3124653025}]},"public_addr":"172.21.15.163:6803/3124653025","cluster_addr":"172.21.15.163:6805/3124653025","heartbeat_back_addr":"172.21.15.163:6809/3124653025","heartbeat_front_addr":"172.21.15.163:6807/3124653025","state":["exists","up"]},{"osd":1,"uuid":"0af39bda-f096-4603-adcc-bf1988f36603","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":3774455900},{"type":"v1","addr":"172.21.15.172:6801","nonce":3774455900}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":3774455900},{"type":"v1","addr":"172.21.15.172:6803","nonce":3774455900}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":3774455900},{"type":"v1","addr":"172.21.15.172:6807","nonce":3774455900}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":3774455900},{"type":"v1","addr":"172.21.15.172:6805","nonce":3774455900}]},"public_addr":"172.21.15.172:6801/3774455900","cluster_addr":"172.21.15.172:6803/3774455900","heartbeat_back_addr":"172.21.15.172:6807/3774455900","heartbeat_front_addr":"172.21.15.172:6805/3774455900","state":["exists","up"]},{"osd":2,"uuid":"cc732c13-af0f-4199-98e6-fe960ed4e5dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":1976927678},{"type":"v1","addr":"172.21.15.184:6801","nonce":1976927678}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":1976927678},{"type":"v1","addr":"172.21.15.184:6803","nonce":1976927678}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":1976927678},{"type":"v1","addr":"172.21.15.184:6807","nonce":1976927678}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":1976927678},{"type":"v1","addr":"172.21.15.184:6805","nonce":1976927678}]},"public_addr":"172.21.15.184:6801/1976927678","cluster_addr":"172.21.15.184:6803/1976927678","heartbeat_back_addr":"172.21.15.184:6807/1976927678","heartbeat_front_addr":"172.21.15.184:6805/1976927678","state":["exists","up"]},{"osd":3,"uuid":"dcee9576-0bc6-4ab0-8f63-79eacd0eca5f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6810","nonce":2589130694},{"type":"v1","addr":"172.21.15.163:6811","nonce":2589130694}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6812","nonce":2589130694},{"type":"v1","addr":"172.21.15.163:6813","nonce":2589130694}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6816","nonce":2589130694},{"type":"v1","addr":"172.21.15.163:6817","nonce":2589130694}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6814","nonce":2589130694},{"type":"v1","addr":"172.21.15.163:6815","nonce":2589130694}]},"public_addr":"172.21.15.163:6811/2589130694","cluster_addr":"172.21.15.163:6813/2589130694","heartbeat_back_addr":"172.21.15.163:6817/2589130694","heartbeat_front_addr":"172.21.15.163:6815/2589130694","state":["exists","up"]},{"osd":4,"uuid":"055df823-b8b0-426a-83c2-f0d727932ad8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":3319632614},{"type":"v1","addr":"172.21.15.172:6809","nonce":3319632614}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6810","nonce":3319632614},{"type":"v1","addr":"172.21.15.172:6811","nonce":3319632614}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6814","nonce":3319632614},{"type":"v1","addr":"172.21.15.172:6815","nonce":3319632614}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":3319632614},{"type":"v1","addr":"172.21.15.172:6813","nonce":3319632614}]},"public_addr":"172.21.15.172:6809/3319632614","cluster_addr":"172.21.15.172:6811/3319632614","heartbeat_back_addr":"172.21.15.172:6815/3319632614","heartbeat_front_addr":"172.21.15.172:6813/3319632614","state":["exists","up"]},{"osd":5,"uuid":"ef5ef02a-b4e2-4790-9d27-f6d2247b25c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":2662084043},{"type":"v1","addr":"172.21.15.184:6809","nonce":2662084043}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6810","nonce":2662084043},{"type":"v1","addr":"172.21.15.184:6811","nonce":2662084043}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6814","nonce":2662084043},{"type":"v1","addr":"172.21.15.184:6815","nonce":2662084043}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6812","nonce":2662084043},{"type":"v1","addr":"172.21.15.184:6813","nonce":2662084043}]},"public_addr":"172.21.15.184:6809/2662084043","cluster_addr":"172.21.15.184:6811/2662084043","heartbeat_back_addr":"172.21.15.184:6815/2662084043","heartbeat_front_addr":"172.21.15.184:6813/2662084043","state":["exists","up"]},{"osd":6,"uuid":"dba754be-0fc5-4867-a6d5-cf97eb344f81","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":44,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6818","nonce":2530874117},{"type":"v1","addr":"172.21.15.163:6819","nonce":2530874117}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6820","nonce":2530874117},{"type":"v1","addr":"172.21.15.163:6821","nonce":2530874117}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6824","nonce":2530874117},{"type":"v1","addr":"172.21.15.163:6825","nonce":2530874117}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6822","nonce":2530874117},{"type":"v1","addr":"172.21.15.163:6823","nonce":2530874117}]},"public_addr":"172.21.15.163:6819/2530874117","cluster_addr":"172.21.15.163:6821/2530874117","heartbeat_back_addr":"172.21.15.163:6825/2530874117","heartbeat_front_addr":"172.21.15.163:6823/2530874117","state":["exists","up"]},{"osd":7,"uuid":"edd76e6b-6077-4619-b00d-1e906f70ddcc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":49,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":233511803},{"type":"v1","addr":"172.21.15.172:6817","nonce":233511803}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6818","nonce":233511803},{"type":"v1","addr":"172.21.15.172:6819","nonce":233511803}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":233511803},{"type":"v1","addr":"172.21.15.172:6823","nonce":233511803}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6820","nonce":233511803},{"type":"v1","addr":"172.21.15.172:6821","nonce":233511803}]},"public_addr":"172.21.15.172:6817/233511803","cluster_addr":"172.21.15.172:6819/233511803","heartbeat_back_addr":"172.21.15.172:6823/233511803","heartbeat_front_addr":"172.21.15.172:6821/233511803","state":["exists","up"]},{"osd":8,"uuid":"36559400-f33e-44e6-868a-316d34da457d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":56,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6816","nonce":290154343},{"type":"v1","addr":"172.21.15.184:6817","nonce":290154343}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6818","nonce":290154343},{"type":"v1","addr":"172.21.15.184:6819","nonce":290154343}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6822","nonce":290154343},{"type":"v1","addr":"172.21.15.184:6823","nonce":290154343}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6820","nonce":290154343},{"type":"v1","addr":"172.21.15.184:6821","nonce":290154343}]},"public_addr":"172.21.15.184:6817/290154343","cluster_addr":"172.21.15.184:6819/290154343","heartbeat_back_addr":"172.21.15.184:6823/290154343","heartbeat_front_addr":"172.21.15.184:6821/290154343","state":["exists","up"]},{"osd":9,"uuid":"d484f111-f36c-4c67-9a8a-ae03e7e0d137","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6826","nonce":3848110906},{"type":"v1","addr":"172.21.15.163:6827","nonce":3848110906}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6828","nonce":3848110906},{"type":"v1","addr":"172.21.15.163:6829","nonce":3848110906}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6832","nonce":3848110906},{"type":"v1","addr":"172.21.15.163:6833","nonce":3848110906}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6830","nonce":3848110906},{"type":"v1","addr":"172.21.15.163:6831","nonce":3848110906}]},"public_addr":"172.21.15.163:6827/3848110906","cluster_addr":"172.21.15.163:6829/3848110906","heartbeat_back_addr":"172.21.15.163:6833/3848110906","heartbeat_front_addr":"172.21.15.163:6831/3848110906","state":["exists","up"]},{"osd":10,"uuid":"d943f7c0-da3d-4605-9e23-0231e675c6be","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6824","nonce":3281085356},{"type":"v1","addr":"172.21.15.172:6825","nonce":3281085356}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":3281085356},{"type":"v1","addr":"172.21.15.172:6827","nonce":3281085356}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":3281085356},{"type":"v1","addr":"172.21.15.172:6831","nonce":3281085356}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6828","nonce":3281085356},{"type":"v1","addr":"172.21.15.172:6829","nonce":3281085356}]},"public_addr":"172.21.15.172:6825/3281085356","cluster_addr":"172.21.15.172:6827/3281085356","heartbeat_back_addr":"172.21.15.172:6831/3281085356","heartbeat_front_addr":"172.21.15.172:6829/3281085356","state":["exists","up"]},{"osd":11,"uuid":"09e610a8-408a-4119-a21b-c4de2810a538","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":75,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6824","nonce":3614578747},{"type":"v1","addr":"172.21.15.184:6825","nonce":3614578747}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6826","nonce":3614578747},{"type":"v1","addr":"172.21.15.184:6827","nonce":3614578747}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6830","nonce":3614578747},{"type":"v1","addr":"172.21.15.184:6831","nonce":3614578747}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6828","nonce":3614578747},{"type":"v1","addr":"172.21.15.184:6829","nonce":3614578747}]},"public_addr":"172.21.15.184:6825/3614578747","cluster_addr":"172.21.15.184:6827/3614578747","heartbeat_back_addr":"172.21.15.184:6831/3614578747","heartbeat_front_addr":"172.21.15.184:6829/3614578747","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T18:06:36.067578+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T18:06:57.095120+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T18:07:17.825363+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T18:07:38.977196+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T18:08:00.108709+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T18:08:20.700646+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T18:08:41.473899+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T18:09:02.856536+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T18:09:23.832722+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T18:09:44.860884+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T18:10:05.520678+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T18:10:26.426315+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.8","mappings":[{"from":2,"to":11}]},{"pgid":"3.1","mappings":[{"from":4,"to":9}]},{"pgid":"3.6","mappings":[{"from":4,"to":6}]},{"pgid":"3.25","mappings":[{"from":5,"to":9}]},{"pgid":"3.27","mappings":[{"from":4,"to":8}]},{"pgid":"3.2d","mappings":[{"from":3,"to":9}]},{"pgid":"4.a","mappings":[{"from":5,"to":8}]},{"pgid":"4.12","mappings":[{"from":9,"to":10}]},{"pgid":"4.14","mappings":[{"from":9,"to":8}]},{"pgid":"4.17","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.163:6801/1086512093":"2023-07-15T18:05:15.331458+0000","172.21.15.163:6800/1086512093":"2023-07-15T18:05:15.331458+0000","172.21.15.163:0/4235784810":"2023-07-15T18:05:15.331458+0000","172.21.15.163:6800/236891232":"2023-07-15T18:04:53.288443+0000","172.21.15.163:6801/236891232":"2023-07-15T18:04:53.288443+0000","172.21.15.163:0/3260193612":"2023-07-15T18:05:15.331458+0000","172.21.15.163:0/3513629472":"2023-07-15T18:04:53.288443+0000","172.21.15.163:0/1090329830":"2023-07-15T18:04:53.288443+0000","172.21.15.163:0/3868922045":"2023-07-15T18:05:15.331458+0000","172.21.15.163:0/2945662447":"2023-07-15T18:04:53.288443+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-14T18:12:37.775 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:37.734+0000 7f87ba68a700 1 -- 172.21.15.163:0/1595975035 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f879c0a12a0 msgr2=0x7f879c0a3750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:12:37.776 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:37.734+0000 7f87ba68a700 1 --2- 172.21.15.163:0/1595975035 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f879c0a12a0 0x7f879c0a3750 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f87b40ffb50 tx=0x7f87a800b410 comp rx=0 tx=0).stop 2023-07-14T18:12:37.776 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:37.734+0000 7f87ba68a700 1 -- 172.21.15.163:0/1595975035 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f87b40ffcf0 msgr2=0x7f87b4198090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:12:37.776 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:37.734+0000 7f87ba68a700 1 --2- 172.21.15.163:0/1595975035 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f87b40ffcf0 0x7f87b4198090 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f87a400e9a0 tx=0x7f87a400ecb0 comp rx=0 tx=0).stop 2023-07-14T18:12:37.776 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:37.734+0000 7f87ba68a700 1 -- 172.21.15.163:0/1595975035 shutdown_connections 2023-07-14T18:12:37.776 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:37.734+0000 7f87ba68a700 1 --2- 172.21.15.163:0/1595975035 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f879c0a12a0 0x7f879c0a3750 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:37.776 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:37.734+0000 7f87ba68a700 1 --2- 172.21.15.163:0/1595975035 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f87b40feb00 0x7f87b4197b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:37.777 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:37.734+0000 7f87ba68a700 1 --2- 172.21.15.163:0/1595975035 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f87b4100680 0x7f87b419f100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:37.777 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:37.734+0000 7f87ba68a700 1 --2- 172.21.15.163:0/1595975035 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f87b40ffcf0 0x7f87b4198090 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:37.777 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:37.734+0000 7f87ba68a700 1 -- 172.21.15.163:0/1595975035 >> 172.21.15.163:0/1595975035 conn(0x7f87b40fa100 msgr2=0x7f87b40677e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:12:37.777 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:37.734+0000 7f87ba68a700 1 -- 172.21.15.163:0/1595975035 shutdown_connections 2023-07-14T18:12:37.777 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:37.734+0000 7f87ba68a700 1 -- 172.21.15.163:0/1595975035 wait complete. 2023-07-14T18:12:37.789 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-14T18:07:19.653852+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-14T18:11:07.314989+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '79', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-07-14T18:11:08.274627+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '80', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-07-14T18:11:11.991162+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '84', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-07-14T18:12:37.790 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-14T18:12:37.916 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:37.874+0000 7f8ae48f0700 1 -- 172.21.15.163:0/3899734251 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f8ae00feb10 msgr2=0x7f8ae00fef20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:12:37.916 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:37.874+0000 7f8ae48f0700 1 --2- 172.21.15.163:0/3899734251 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f8ae00feb10 0x7f8ae00fef20 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f8ad0009990 tx=0x7f8ad0009ca0 comp rx=0 tx=0).stop 2023-07-14T18:12:37.916 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:37.874+0000 7f8ae48f0700 1 -- 172.21.15.163:0/3899734251 shutdown_connections 2023-07-14T18:12:37.916 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:37.874+0000 7f8ae48f0700 1 --2- 172.21.15.163:0/3899734251 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8ae0100690 0x7f8ae0106f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:37.916 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:37.874+0000 7f8ae48f0700 1 --2- 172.21.15.163:0/3899734251 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f8ae00feb10 0x7f8ae00fef20 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:37.917 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:37.874+0000 7f8ae48f0700 1 --2- 172.21.15.163:0/3899734251 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8ae00ffd00 0x7f8ae0100150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:37.917 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:37.874+0000 7f8ae48f0700 1 -- 172.21.15.163:0/3899734251 >> 172.21.15.163:0/3899734251 conn(0x7f8ae00fa130 msgr2=0x7f8ae00fc560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:12:37.917 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:37.874+0000 7f8ae48f0700 1 -- 172.21.15.163:0/3899734251 shutdown_connections 2023-07-14T18:12:37.917 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:37.874+0000 7f8ae48f0700 1 -- 172.21.15.163:0/3899734251 wait complete. 2023-07-14T18:12:37.919 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:37.875+0000 7f8ae48f0700 1 Processor -- start 2023-07-14T18:12:37.919 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:37.875+0000 7f8ae48f0700 1 -- start start 2023-07-14T18:12:37.919 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:37.875+0000 7f8ae48f0700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8ae00feb10 0x7f8ae0194840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:12:37.919 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:37.875+0000 7f8ae48f0700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8ae00ffd00 0x7f8ae0194d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:12:37.920 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:37.875+0000 7f8ae48f0700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f8ae0100690 0x7f8ae019bdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:12:37.920 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:37.875+0000 7f8ae48f0700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ae019c3c0 con 0x7f8ae0100690 2023-07-14T18:12:37.920 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:37.875+0000 7f8ae48f0700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ae019c500 con 0x7f8ae00feb10 2023-07-14T18:12:37.920 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:37.875+0000 7f8ae48f0700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ae019c690 con 0x7f8ae00ffd00 2023-07-14T18:12:37.920 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:37.875+0000 7f8aded9d700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f8ae0100690 0x7f8ae019bdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:12:37.920 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:37.875+0000 7f8aded9d700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f8ae0100690 0x7f8ae019bdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:57302/0 (socket says 172.21.15.163:57302) 2023-07-14T18:12:37.920 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:37.875+0000 7f8aded9d700 1 -- 172.21.15.163:0/4011030769 learned_addr learned my addr 172.21.15.163:0/4011030769 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:12:37.921 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:37.876+0000 7f8ade59c700 1 --2- 172.21.15.163:0/4011030769 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8ae00feb10 0x7f8ae0194840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:12:37.921 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:37.876+0000 7f8addd9b700 1 --2- 172.21.15.163:0/4011030769 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8ae00ffd00 0x7f8ae0194d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:12:37.921 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:37.876+0000 7f8aded9d700 1 -- 172.21.15.163:0/4011030769 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8ae00ffd00 msgr2=0x7f8ae0194d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:12:37.921 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:37.876+0000 7f8aded9d700 1 --2- 172.21.15.163:0/4011030769 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8ae00ffd00 0x7f8ae0194d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:37.922 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:37.876+0000 7f8aded9d700 1 -- 172.21.15.163:0/4011030769 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8ae00feb10 msgr2=0x7f8ae0194840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:12:37.922 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:37.876+0000 7f8aded9d700 1 --2- 172.21.15.163:0/4011030769 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8ae00feb10 0x7f8ae0194840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:37.922 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:37.876+0000 7f8aded9d700 1 -- 172.21.15.163:0/4011030769 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ad00095f0 con 0x7f8ae0100690 2023-07-14T18:12:37.922 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:37.876+0000 7f8aded9d700 1 --2- 172.21.15.163:0/4011030769 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f8ae0100690 0x7f8ae019bdf0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f8ad800ada0 tx=0x7f8ad800c330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:12:37.922 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:37.876+0000 7f8ad77fe700 1 -- 172.21.15.163:0/4011030769 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ad800f070 con 0x7f8ae0100690 2023-07-14T18:12:37.922 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:37.876+0000 7f8ae48f0700 1 -- 172.21.15.163:0/4011030769 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ae019c970 con 0x7f8ae0100690 2023-07-14T18:12:37.922 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:37.876+0000 7f8ad77fe700 1 -- 172.21.15.163:0/4011030769 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f8ad8007b30 con 0x7f8ae0100690 2023-07-14T18:12:37.923 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:37.876+0000 7f8ad77fe700 1 -- 172.21.15.163:0/4011030769 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ad80053e0 con 0x7f8ae0100690 2023-07-14T18:12:37.923 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:37.876+0000 7f8ae48f0700 1 -- 172.21.15.163:0/4011030769 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ae019ce80 con 0x7f8ae0100690 2023-07-14T18:12:37.923 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:37.877+0000 7f8ae48f0700 1 -- 172.21.15.163:0/4011030769 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8ae0106200 con 0x7f8ae0100690 2023-07-14T18:12:37.924 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:37.878+0000 7f8ad77fe700 1 -- 172.21.15.163:0/4011030769 <== mon.0 v2:172.21.15.163:3300/0 4 ==== mgrmap(e 17) v1 ==== 135767+0+0 (secure 0 0 0) 0x7f8ad800c980 con 0x7f8ae0100690 2023-07-14T18:12:37.924 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:37.879+0000 7f8ad77fe700 1 --2- 172.21.15.163:0/4011030769 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f8acc0a11e0 0x7f8acc0a3690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:12:37.924 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:37.879+0000 7f8ade59c700 1 --2- 172.21.15.163:0/4011030769 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f8acc0a11e0 0x7f8acc0a3690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:12:37.924 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:37.879+0000 7f8ad77fe700 1 -- 172.21.15.163:0/4011030769 <== mon.0 v2:172.21.15.163:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 9020+0+0 (secure 0 0 0) 0x7f8ad80cca60 con 0x7f8ae0100690 2023-07-14T18:12:37.924 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:37.879+0000 7f8ade59c700 1 --2- 172.21.15.163:0/4011030769 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f8acc0a11e0 0x7f8acc0a3690 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f8ad000c010 tx=0x7f8ad000b540 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:12:37.924 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:37.882+0000 7f8ad77fe700 1 -- 172.21.15.163:0/4011030769 <== mon.0 v2:172.21.15.163:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178025 (secure 0 0 0) 0x7f8ad8095e80 con 0x7f8ae0100690 2023-07-14T18:12:38.112 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:38.071+0000 7f8ae48f0700 1 -- 172.21.15.163:0/4011030769 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f8ae002caf0 con 0x7f8ae0100690 2023-07-14T18:12:38.113 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:38.071+0000 7f8ad77fe700 1 -- 172.21.15.163:0/4011030769 <== mon.0 v2:172.21.15.163:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v86) v1 ==== 93+0+10 (secure 0 0 0) 0x7f8ad800cc30 con 0x7f8ae0100690 2023-07-14T18:12:38.113 INFO:teuthology.orchestra.run.smithi163.stdout:pg_num: 1 2023-07-14T18:12:38.115 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:38.073+0000 7f8ae48f0700 1 -- 172.21.15.163:0/4011030769 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f8acc0a11e0 msgr2=0x7f8acc0a3690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:12:38.115 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:38.074+0000 7f8ae48f0700 1 --2- 172.21.15.163:0/4011030769 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f8acc0a11e0 0x7f8acc0a3690 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f8ad000c010 tx=0x7f8ad000b540 comp rx=0 tx=0).stop 2023-07-14T18:12:38.115 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:38.074+0000 7f8ae48f0700 1 -- 172.21.15.163:0/4011030769 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f8ae0100690 msgr2=0x7f8ae019bdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:12:38.116 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:38.074+0000 7f8ae48f0700 1 --2- 172.21.15.163:0/4011030769 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f8ae0100690 0x7f8ae019bdf0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f8ad800ada0 tx=0x7f8ad800c330 comp rx=0 tx=0).stop 2023-07-14T18:12:38.116 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:38.074+0000 7f8ae48f0700 1 -- 172.21.15.163:0/4011030769 shutdown_connections 2023-07-14T18:12:38.116 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:38.074+0000 7f8ae48f0700 1 --2- 172.21.15.163:0/4011030769 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f8acc0a11e0 0x7f8acc0a3690 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:38.116 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:38.074+0000 7f8ae48f0700 1 --2- 172.21.15.163:0/4011030769 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f8ae0100690 0x7f8ae019bdf0 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:38.116 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:38.074+0000 7f8ae48f0700 1 --2- 172.21.15.163:0/4011030769 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8ae00feb10 0x7f8ae0194840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:38.116 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:38.074+0000 7f8ae48f0700 1 --2- 172.21.15.163:0/4011030769 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8ae00ffd00 0x7f8ae0194d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:38.117 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:38.074+0000 7f8ae48f0700 1 -- 172.21.15.163:0/4011030769 >> 172.21.15.163:0/4011030769 conn(0x7f8ae00fa130 msgr2=0x7f8ae0103340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:12:38.117 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:38.074+0000 7f8ae48f0700 1 -- 172.21.15.163:0/4011030769 shutdown_connections 2023-07-14T18:12:38.117 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:38.074+0000 7f8ae48f0700 1 -- 172.21.15.163:0/4011030769 wait complete. 2023-07-14T18:12:38.126 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:12:37 smithi163 ceph-mon[96576]: from='client.? 172.21.15.163:0/1537503134' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2023-07-14T18:12:38.127 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:12:37 smithi163 ceph-mon[96576]: from='client.? 172.21.15.163:0/1595975035' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-07-14T18:12:38.128 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-14T18:12:38.175 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:12:37 smithi184 ceph-mon[98481]: from='client.? 172.21.15.163:0/1537503134' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2023-07-14T18:12:38.175 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:12:37 smithi184 ceph-mon[98481]: from='client.? 172.21.15.163:0/1595975035' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-07-14T18:12:38.253 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:38.211+0000 7f92bd33f700 1 -- 172.21.15.163:0/324869440 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f92b81006d0 msgr2=0x7f92b8106f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:12:38.253 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:38.211+0000 7f92bd33f700 1 --2- 172.21.15.163:0/324869440 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f92b81006d0 0x7f92b8106f90 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f92b000b0a0 tx=0x7f92b000b3b0 comp rx=0 tx=0).stop 2023-07-14T18:12:38.253 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:38.211+0000 7f92bd33f700 1 -- 172.21.15.163:0/324869440 shutdown_connections 2023-07-14T18:12:38.253 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:38.211+0000 7f92bd33f700 1 --2- 172.21.15.163:0/324869440 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f92b81006d0 0x7f92b8106f90 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:38.253 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:38.211+0000 7f92bd33f700 1 --2- 172.21.15.163:0/324869440 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f92b80feb50 0x7f92b80fef60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:38.253 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:38.211+0000 7f92bd33f700 1 --2- 172.21.15.163:0/324869440 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f92b80ffd40 0x7f92b8100190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:38.254 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:38.211+0000 7f92bd33f700 1 -- 172.21.15.163:0/324869440 >> 172.21.15.163:0/324869440 conn(0x7f92b80fa150 msgr2=0x7f92b80fc5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:12:38.254 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:38.211+0000 7f92bd33f700 1 -- 172.21.15.163:0/324869440 shutdown_connections 2023-07-14T18:12:38.254 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:38.211+0000 7f92bd33f700 1 -- 172.21.15.163:0/324869440 wait complete. 2023-07-14T18:12:38.254 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:38.212+0000 7f92bd33f700 1 Processor -- start 2023-07-14T18:12:38.256 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:38.212+0000 7f92bd33f700 1 -- start start 2023-07-14T18:12:38.256 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:38.212+0000 7f92bd33f700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f92b80feb50 0x7f92b81959b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:12:38.256 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:38.212+0000 7f92bd33f700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f92b80ffd40 0x7f92b8195ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:12:38.256 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:38.212+0000 7f92bd33f700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f92b81006d0 0x7f92b819cf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:12:38.257 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:38.212+0000 7f92bd33f700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92b819d530 con 0x7f92b81006d0 2023-07-14T18:12:38.257 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:38.212+0000 7f92bd33f700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92b819d670 con 0x7f92b80ffd40 2023-07-14T18:12:38.257 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:38.212+0000 7f92bd33f700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92b819d800 con 0x7f92b80feb50 2023-07-14T18:12:38.257 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:38.212+0000 7f92b77fe700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f92b81006d0 0x7f92b819cf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:12:38.257 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:38.212+0000 7f92b77fe700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f92b81006d0 0x7f92b819cf60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:57316/0 (socket says 172.21.15.163:57316) 2023-07-14T18:12:38.257 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:38.212+0000 7f92b77fe700 1 -- 172.21.15.163:0/1225915688 learned_addr learned my addr 172.21.15.163:0/1225915688 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:12:38.257 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:38.212+0000 7f92b6ffd700 1 --2- 172.21.15.163:0/1225915688 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f92b80feb50 0x7f92b81959b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:12:38.258 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:38.212+0000 7f92b67fc700 1 --2- 172.21.15.163:0/1225915688 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f92b80ffd40 0x7f92b8195ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:12:38.258 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:38.212+0000 7f92b77fe700 1 -- 172.21.15.163:0/1225915688 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f92b80feb50 msgr2=0x7f92b81959b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:12:38.258 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:38.212+0000 7f92b77fe700 1 --2- 172.21.15.163:0/1225915688 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f92b80feb50 0x7f92b81959b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:38.258 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:38.212+0000 7f92b77fe700 1 -- 172.21.15.163:0/1225915688 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f92b80ffd40 msgr2=0x7f92b8195ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:12:38.258 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:38.212+0000 7f92b77fe700 1 --2- 172.21.15.163:0/1225915688 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f92b80ffd40 0x7f92b8195ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:38.258 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:38.212+0000 7f92b77fe700 1 -- 172.21.15.163:0/1225915688 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92b0009d00 con 0x7f92b81006d0 2023-07-14T18:12:38.258 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:38.212+0000 7f92b67fc700 1 --2- 172.21.15.163:0/1225915688 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f92b80ffd40 0x7f92b8195ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T18:12:38.258 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:38.213+0000 7f92b77fe700 1 --2- 172.21.15.163:0/1225915688 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f92b81006d0 0x7f92b819cf60 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f92b0008e10 tx=0x7f92b0008e40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:12:38.259 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:38.213+0000 7f92affff700 1 -- 172.21.15.163:0/1225915688 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92b000e040 con 0x7f92b81006d0 2023-07-14T18:12:38.259 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:38.213+0000 7f92affff700 1 -- 172.21.15.163:0/1225915688 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f92b0004e90 con 0x7f92b81006d0 2023-07-14T18:12:38.259 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:38.213+0000 7f92affff700 1 -- 172.21.15.163:0/1225915688 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92b001dce0 con 0x7f92b81006d0 2023-07-14T18:12:38.259 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:38.213+0000 7f92bd33f700 1 -- 172.21.15.163:0/1225915688 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f92b819da80 con 0x7f92b81006d0 2023-07-14T18:12:38.259 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:38.213+0000 7f92bd33f700 1 -- 172.21.15.163:0/1225915688 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f92b819deb0 con 0x7f92b81006d0 2023-07-14T18:12:38.259 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:38.214+0000 7f92bd33f700 1 -- 172.21.15.163:0/1225915688 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f92b810a1e0 con 0x7f92b81006d0 2023-07-14T18:12:38.259 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:38.215+0000 7f92affff700 1 -- 172.21.15.163:0/1225915688 <== mon.0 v2:172.21.15.163:3300/0 4 ==== mgrmap(e 17) v1 ==== 135767+0+0 (secure 0 0 0) 0x7f92b001d470 con 0x7f92b81006d0 2023-07-14T18:12:38.260 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:38.215+0000 7f92affff700 1 --2- 172.21.15.163:0/1225915688 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f92a40a11e0 0x7f92a40a3690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:12:38.260 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:38.216+0000 7f92b6ffd700 1 --2- 172.21.15.163:0/1225915688 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f92a40a11e0 0x7f92a40a3690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:12:38.260 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:38.216+0000 7f92affff700 1 -- 172.21.15.163:0/1225915688 <== mon.0 v2:172.21.15.163:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 9020+0+0 (secure 0 0 0) 0x7f92b00cded0 con 0x7f92b81006d0 2023-07-14T18:12:38.261 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:38.216+0000 7f92b6ffd700 1 --2- 172.21.15.163:0/1225915688 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f92a40a11e0 0x7f92a40a3690 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f92b80ffba0 tx=0x7f92a8009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:12:38.261 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:38.220+0000 7f92affff700 1 -- 172.21.15.163:0/1225915688 <== mon.0 v2:172.21.15.163:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178025 (secure 0 0 0) 0x7f92b00971e0 con 0x7f92b81006d0 2023-07-14T18:12:38.276 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:12:37 smithi172 ceph-mon[97983]: from='client.? 172.21.15.163:0/1537503134' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2023-07-14T18:12:38.276 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:12:37 smithi172 ceph-mon[97983]: from='client.? 172.21.15.163:0/1595975035' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-07-14T18:12:38.450 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:38.409+0000 7f92bd33f700 1 -- 172.21.15.163:0/1225915688 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f92b819e4c0 con 0x7f92b81006d0 2023-07-14T18:12:38.451 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:38.409+0000 7f92affff700 1 -- 172.21.15.163:0/1225915688 <== mon.0 v2:172.21.15.163:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v86) v1 ==== 104+0+11 (secure 0 0 0) 0x7f92b009a800 con 0x7f92b81006d0 2023-07-14T18:12:38.451 INFO:teuthology.orchestra.run.smithi163.stdout:pg_num: 32 2023-07-14T18:12:38.453 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:38.411+0000 7f92bd33f700 1 -- 172.21.15.163:0/1225915688 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f92a40a11e0 msgr2=0x7f92a40a3690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:12:38.453 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:38.411+0000 7f92bd33f700 1 --2- 172.21.15.163:0/1225915688 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f92a40a11e0 0x7f92a40a3690 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f92b80ffba0 tx=0x7f92a8009260 comp rx=0 tx=0).stop 2023-07-14T18:12:38.453 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:38.411+0000 7f92bd33f700 1 -- 172.21.15.163:0/1225915688 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f92b81006d0 msgr2=0x7f92b819cf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:12:38.453 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:38.411+0000 7f92bd33f700 1 --2- 172.21.15.163:0/1225915688 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f92b81006d0 0x7f92b819cf60 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f92b0008e10 tx=0x7f92b0008e40 comp rx=0 tx=0).stop 2023-07-14T18:12:38.453 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:38.411+0000 7f92bd33f700 1 -- 172.21.15.163:0/1225915688 shutdown_connections 2023-07-14T18:12:38.453 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:38.411+0000 7f92bd33f700 1 --2- 172.21.15.163:0/1225915688 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f92a40a11e0 0x7f92a40a3690 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:38.454 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:38.411+0000 7f92bd33f700 1 --2- 172.21.15.163:0/1225915688 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f92b80feb50 0x7f92b81959b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:38.454 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:38.411+0000 7f92bd33f700 1 --2- 172.21.15.163:0/1225915688 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f92b81006d0 0x7f92b819cf60 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:38.454 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:38.411+0000 7f92bd33f700 1 --2- 172.21.15.163:0/1225915688 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f92b80ffd40 0x7f92b8195ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:38.454 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:38.411+0000 7f92bd33f700 1 -- 172.21.15.163:0/1225915688 >> 172.21.15.163:0/1225915688 conn(0x7f92b80fa150 msgr2=0x7f92b8068a50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:12:38.454 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:38.412+0000 7f92bd33f700 1 -- 172.21.15.163:0/1225915688 shutdown_connections 2023-07-14T18:12:38.454 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:38.412+0000 7f92bd33f700 1 -- 172.21.15.163:0/1225915688 wait complete. 2023-07-14T18:12:38.465 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-14T18:12:38.591 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:38.549+0000 7f4c8f089700 1 -- 172.21.15.163:0/880618394 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f4c88100e10 msgr2=0x7f4c88101260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:12:38.591 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:38.549+0000 7f4c8f089700 1 --2- 172.21.15.163:0/880618394 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f4c88100e10 0x7f4c88101260 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f4c74009990 tx=0x7f4c74009ca0 comp rx=0 tx=0).stop 2023-07-14T18:12:38.591 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:38.549+0000 7f4c8f089700 1 -- 172.21.15.163:0/880618394 shutdown_connections 2023-07-14T18:12:38.591 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:38.549+0000 7f4c8f089700 1 --2- 172.21.15.163:0/880618394 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4c880ffc20 0x7f4c88100030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:38.592 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:38.549+0000 7f4c8f089700 1 --2- 172.21.15.163:0/880618394 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4c881017a0 0x7f4c88108060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:38.592 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:38.549+0000 7f4c8f089700 1 --2- 172.21.15.163:0/880618394 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f4c88100e10 0x7f4c88101260 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:38.592 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:38.549+0000 7f4c8f089700 1 -- 172.21.15.163:0/880618394 >> 172.21.15.163:0/880618394 conn(0x7f4c880fb260 msgr2=0x7f4c880fd670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:12:38.592 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:38.549+0000 7f4c8f089700 1 -- 172.21.15.163:0/880618394 shutdown_connections 2023-07-14T18:12:38.592 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:38.549+0000 7f4c8f089700 1 -- 172.21.15.163:0/880618394 wait complete. 2023-07-14T18:12:38.592 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:38.550+0000 7f4c8f089700 1 Processor -- start 2023-07-14T18:12:38.592 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:38.550+0000 7f4c8f089700 1 -- start start 2023-07-14T18:12:38.593 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:38.550+0000 7f4c8f089700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f4c880ffc20 0x7f4c881958f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:12:38.593 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:38.550+0000 7f4c8f089700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4c88100e10 0x7f4c88195e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:12:38.593 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:38.550+0000 7f4c8f089700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4c881017a0 0x7f4c8819cea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:12:38.593 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:38.550+0000 7f4c8f089700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c8819d470 con 0x7f4c880ffc20 2023-07-14T18:12:38.593 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:38.550+0000 7f4c8f089700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c8819d5b0 con 0x7f4c881017a0 2023-07-14T18:12:38.593 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:38.550+0000 7f4c8f089700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c8819d740 con 0x7f4c88100e10 2023-07-14T18:12:38.593 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:38.550+0000 7f4c8ce25700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f4c880ffc20 0x7f4c881958f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:12:38.593 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:38.550+0000 7f4c8ce25700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f4c880ffc20 0x7f4c881958f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:57326/0 (socket says 172.21.15.163:57326) 2023-07-14T18:12:38.594 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:38.550+0000 7f4c8ce25700 1 -- 172.21.15.163:0/3856044798 learned_addr learned my addr 172.21.15.163:0/3856044798 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:12:38.594 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:38.550+0000 7f4c87fff700 1 --2- 172.21.15.163:0/3856044798 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4c88100e10 0x7f4c88195e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:12:38.594 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:38.550+0000 7f4c8d626700 1 --2- 172.21.15.163:0/3856044798 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4c881017a0 0x7f4c8819cea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:12:38.594 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:38.550+0000 7f4c8ce25700 1 -- 172.21.15.163:0/3856044798 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4c88100e10 msgr2=0x7f4c88195e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:12:38.594 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:38.550+0000 7f4c8ce25700 1 --2- 172.21.15.163:0/3856044798 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4c88100e10 0x7f4c88195e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:38.594 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:38.550+0000 7f4c8ce25700 1 -- 172.21.15.163:0/3856044798 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4c881017a0 msgr2=0x7f4c8819cea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:12:38.594 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:38.550+0000 7f4c8ce25700 1 --2- 172.21.15.163:0/3856044798 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4c881017a0 0x7f4c8819cea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:38.594 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:38.550+0000 7f4c8ce25700 1 -- 172.21.15.163:0/3856044798 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c740095f0 con 0x7f4c880ffc20 2023-07-14T18:12:38.595 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:38.550+0000 7f4c87fff700 1 --2- 172.21.15.163:0/3856044798 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4c88100e10 0x7f4c88195e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T18:12:38.595 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:38.550+0000 7f4c8d626700 1 --2- 172.21.15.163:0/3856044798 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4c881017a0 0x7f4c8819cea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T18:12:38.595 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:38.550+0000 7f4c8ce25700 1 --2- 172.21.15.163:0/3856044798 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f4c880ffc20 0x7f4c881958f0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f4c7c00e970 tx=0x7f4c7c00ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:12:38.595 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:38.551+0000 7f4c85ffb700 1 -- 172.21.15.163:0/3856044798 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c7c009790 con 0x7f4c880ffc20 2023-07-14T18:12:38.595 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:38.551+0000 7f4c85ffb700 1 -- 172.21.15.163:0/3856044798 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f4c7c0044b0 con 0x7f4c880ffc20 2023-07-14T18:12:38.595 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:38.551+0000 7f4c8f089700 1 -- 172.21.15.163:0/3856044798 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4c8819da20 con 0x7f4c880ffc20 2023-07-14T18:12:38.595 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:38.551+0000 7f4c85ffb700 1 -- 172.21.15.163:0/3856044798 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c7c003dd0 con 0x7f4c880ffc20 2023-07-14T18:12:38.596 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:38.551+0000 7f4c8f089700 1 -- 172.21.15.163:0/3856044798 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c8819df30 con 0x7f4c880ffc20 2023-07-14T18:12:38.596 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:38.552+0000 7f4c8f089700 1 -- 172.21.15.163:0/3856044798 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4c881072b0 con 0x7f4c880ffc20 2023-07-14T18:12:38.597 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:38.553+0000 7f4c85ffb700 1 -- 172.21.15.163:0/3856044798 <== mon.0 v2:172.21.15.163:3300/0 4 ==== mgrmap(e 17) v1 ==== 135767+0+0 (secure 0 0 0) 0x7f4c7c004000 con 0x7f4c880ffc20 2023-07-14T18:12:38.597 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:38.553+0000 7f4c85ffb700 1 --2- 172.21.15.163:0/3856044798 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f4c780a11e0 0x7f4c780a3690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:12:38.597 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:38.553+0000 7f4c85ffb700 1 -- 172.21.15.163:0/3856044798 <== mon.0 v2:172.21.15.163:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 9020+0+0 (secure 0 0 0) 0x7f4c7c014070 con 0x7f4c880ffc20 2023-07-14T18:12:38.597 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:38.553+0000 7f4c87fff700 1 --2- 172.21.15.163:0/3856044798 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f4c780a11e0 0x7f4c780a3690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:12:38.597 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:38.554+0000 7f4c87fff700 1 --2- 172.21.15.163:0/3856044798 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f4c780a11e0 0x7f4c780a3690 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f4c740059d0 tx=0x7f4c74005960 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:12:38.597 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:38.557+0000 7f4c85ffb700 1 -- 172.21.15.163:0/3856044798 <== mon.0 v2:172.21.15.163:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178025 (secure 0 0 0) 0x7f4c7c096420 con 0x7f4c880ffc20 2023-07-14T18:12:38.787 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:38.747+0000 7f4c8f089700 1 -- 172.21.15.163:0/3856044798 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f4c8802c8e0 con 0x7f4c880ffc20 2023-07-14T18:12:38.788 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:38.748+0000 7f4c85ffb700 1 -- 172.21.15.163:0/3856044798 <== mon.0 v2:172.21.15.163:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v86) v1 ==== 100+0+11 (secure 0 0 0) 0x7f4c7c099a40 con 0x7f4c880ffc20 2023-07-14T18:12:38.788 INFO:teuthology.orchestra.run.smithi163.stdout:pg_num: 64 2023-07-14T18:12:38.790 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:38.750+0000 7f4c8f089700 1 -- 172.21.15.163:0/3856044798 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f4c780a11e0 msgr2=0x7f4c780a3690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:12:38.790 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:38.750+0000 7f4c8f089700 1 --2- 172.21.15.163:0/3856044798 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f4c780a11e0 0x7f4c780a3690 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f4c740059d0 tx=0x7f4c74005960 comp rx=0 tx=0).stop 2023-07-14T18:12:38.790 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:38.750+0000 7f4c8f089700 1 -- 172.21.15.163:0/3856044798 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f4c880ffc20 msgr2=0x7f4c881958f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:12:38.790 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:38.750+0000 7f4c8f089700 1 --2- 172.21.15.163:0/3856044798 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f4c880ffc20 0x7f4c881958f0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f4c7c00e970 tx=0x7f4c7c00ed30 comp rx=0 tx=0).stop 2023-07-14T18:12:38.791 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:38.750+0000 7f4c8f089700 1 -- 172.21.15.163:0/3856044798 shutdown_connections 2023-07-14T18:12:38.791 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:38.750+0000 7f4c8f089700 1 --2- 172.21.15.163:0/3856044798 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f4c780a11e0 0x7f4c780a3690 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:38.791 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:38.750+0000 7f4c8f089700 1 --2- 172.21.15.163:0/3856044798 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4c881017a0 0x7f4c8819cea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:38.791 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:38.750+0000 7f4c8f089700 1 --2- 172.21.15.163:0/3856044798 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f4c880ffc20 0x7f4c881958f0 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:38.791 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:38.750+0000 7f4c8f089700 1 --2- 172.21.15.163:0/3856044798 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4c88100e10 0x7f4c88195e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:38.791 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:38.750+0000 7f4c8f089700 1 -- 172.21.15.163:0/3856044798 >> 172.21.15.163:0/3856044798 conn(0x7f4c880fb260 msgr2=0x7f4c881043f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:12:38.791 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:38.750+0000 7f4c8f089700 1 -- 172.21.15.163:0/3856044798 shutdown_connections 2023-07-14T18:12:38.792 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:38.750+0000 7f4c8f089700 1 -- 172.21.15.163:0/3856044798 wait complete. 2023-07-14T18:12:38.802 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-07-14T18:12:38.929 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:38.888+0000 7f283c0d5700 1 -- 172.21.15.163:0/3631893700 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f28340ffc30 msgr2=0x7f2834100040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:12:38.929 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:38.888+0000 7f283c0d5700 1 --2- 172.21.15.163:0/3631893700 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f28340ffc30 0x7f2834100040 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f2824009990 tx=0x7f2824009ca0 comp rx=0 tx=0).stop 2023-07-14T18:12:38.929 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:38.888+0000 7f283c0d5700 1 -- 172.21.15.163:0/3631893700 shutdown_connections 2023-07-14T18:12:38.929 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:38.888+0000 7f283c0d5700 1 --2- 172.21.15.163:0/3631893700 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f28341017b0 0x7f2834108070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:38.930 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:38.888+0000 7f283c0d5700 1 --2- 172.21.15.163:0/3631893700 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f28340ffc30 0x7f2834100040 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:38.930 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:38.888+0000 7f283c0d5700 1 --2- 172.21.15.163:0/3631893700 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2834100e20 0x7f2834101270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:38.930 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:38.888+0000 7f283c0d5700 1 -- 172.21.15.163:0/3631893700 >> 172.21.15.163:0/3631893700 conn(0x7f28340fb290 msgr2=0x7f28340fd6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:12:38.930 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:38.888+0000 7f283c0d5700 1 -- 172.21.15.163:0/3631893700 shutdown_connections 2023-07-14T18:12:38.930 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:38.888+0000 7f283c0d5700 1 -- 172.21.15.163:0/3631893700 wait complete. 2023-07-14T18:12:38.930 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:38.889+0000 7f283c0d5700 1 Processor -- start 2023-07-14T18:12:38.930 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:38.889+0000 7f283c0d5700 1 -- start start 2023-07-14T18:12:38.932 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:38.889+0000 7f283c0d5700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f28340ffc30 0x7f28341958e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:12:38.932 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:38.889+0000 7f283c0d5700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2834100e20 0x7f2834195e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:12:38.932 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:38.889+0000 7f283c0d5700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f28341017b0 0x7f283419ce90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:12:38.933 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:38.889+0000 7f283c0d5700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f283419d460 con 0x7f28340ffc30 2023-07-14T18:12:38.933 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:38.889+0000 7f283c0d5700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f283419d5a0 con 0x7f28341017b0 2023-07-14T18:12:38.933 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:38.889+0000 7f283c0d5700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f283419d730 con 0x7f2834100e20 2023-07-14T18:12:38.933 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:38.889+0000 7f2839e71700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f28340ffc30 0x7f28341958e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:12:38.933 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:38.889+0000 7f2839e71700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f28340ffc30 0x7f28341958e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:57340/0 (socket says 172.21.15.163:57340) 2023-07-14T18:12:38.933 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:38.889+0000 7f2839e71700 1 -- 172.21.15.163:0/214308954 learned_addr learned my addr 172.21.15.163:0/214308954 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:12:38.933 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:38.889+0000 7f2839670700 1 --2- 172.21.15.163:0/214308954 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2834100e20 0x7f2834195e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:12:38.933 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:38.889+0000 7f283a672700 1 --2- 172.21.15.163:0/214308954 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f28341017b0 0x7f283419ce90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:12:38.934 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:38.889+0000 7f2839e71700 1 -- 172.21.15.163:0/214308954 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2834100e20 msgr2=0x7f2834195e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:12:38.934 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:38.889+0000 7f2839e71700 1 --2- 172.21.15.163:0/214308954 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2834100e20 0x7f2834195e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:38.934 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:38.889+0000 7f2839e71700 1 -- 172.21.15.163:0/214308954 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f28341017b0 msgr2=0x7f283419ce90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:12:38.934 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:38.889+0000 7f2839e71700 1 --2- 172.21.15.163:0/214308954 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f28341017b0 0x7f283419ce90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:38.934 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:38.889+0000 7f2839e71700 1 -- 172.21.15.163:0/214308954 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28240095f0 con 0x7f28340ffc30 2023-07-14T18:12:38.934 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:38.889+0000 7f2839e71700 1 --2- 172.21.15.163:0/214308954 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f28340ffc30 0x7f28341958e0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f2824004730 tx=0x7f2824009580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:12:38.934 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:38.889+0000 7f282affd700 1 -- 172.21.15.163:0/214308954 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f282401d070 con 0x7f28340ffc30 2023-07-14T18:12:38.935 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:38.889+0000 7f282affd700 1 -- 172.21.15.163:0/214308954 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f2824004080 con 0x7f28340ffc30 2023-07-14T18:12:38.935 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:38.889+0000 7f283c0d5700 1 -- 172.21.15.163:0/214308954 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f283419d9b0 con 0x7f28340ffc30 2023-07-14T18:12:38.935 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:38.889+0000 7f282affd700 1 -- 172.21.15.163:0/214308954 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2824005290 con 0x7f28340ffc30 2023-07-14T18:12:38.935 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:38.890+0000 7f283c0d5700 1 -- 172.21.15.163:0/214308954 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f283419de30 con 0x7f28340ffc30 2023-07-14T18:12:38.935 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:38.890+0000 7f283c0d5700 1 -- 172.21.15.163:0/214308954 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f283410b300 con 0x7f28340ffc30 2023-07-14T18:12:38.935 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:38.892+0000 7f282affd700 1 -- 172.21.15.163:0/214308954 <== mon.0 v2:172.21.15.163:3300/0 4 ==== mgrmap(e 17) v1 ==== 135767+0+0 (secure 0 0 0) 0x7f2824004810 con 0x7f28340ffc30 2023-07-14T18:12:38.936 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:38.892+0000 7f282affd700 1 --2- 172.21.15.163:0/214308954 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f28200a1260 0x7f28200a3710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:12:38.936 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:38.893+0000 7f282affd700 1 -- 172.21.15.163:0/214308954 <== mon.0 v2:172.21.15.163:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 9020+0+0 (secure 0 0 0) 0x7f28240ce160 con 0x7f28340ffc30 2023-07-14T18:12:38.936 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:38.893+0000 7f2839670700 1 --2- 172.21.15.163:0/214308954 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f28200a1260 0x7f28200a3710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:12:38.937 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:38.893+0000 7f2839670700 1 --2- 172.21.15.163:0/214308954 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f28200a1260 0x7f28200a3710 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f2830005fd0 tx=0x7f283000a560 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:12:38.937 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:38.896+0000 7f282affd700 1 -- 172.21.15.163:0/214308954 <== mon.0 v2:172.21.15.163:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178025 (secure 0 0 0) 0x7f28240974d0 con 0x7f28340ffc30 2023-07-14T18:12:39.126 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:39.086+0000 7f283c0d5700 1 -- 172.21.15.163:0/214308954 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f2834106c00 con 0x7f28340ffc30 2023-07-14T18:12:39.127 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:39.086+0000 7f282affd700 1 -- 172.21.15.163:0/214308954 <== mon.0 v2:172.21.15.163:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v86) v1 ==== 103+0+11 (secure 0 0 0) 0x7f282409aaf0 con 0x7f28340ffc30 2023-07-14T18:12:39.127 INFO:teuthology.orchestra.run.smithi163.stdout:pg_num: 32 2023-07-14T18:12:39.129 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:39.088+0000 7f283c0d5700 1 -- 172.21.15.163:0/214308954 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f28200a1260 msgr2=0x7f28200a3710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:12:39.129 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:39.088+0000 7f283c0d5700 1 --2- 172.21.15.163:0/214308954 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f28200a1260 0x7f28200a3710 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f2830005fd0 tx=0x7f283000a560 comp rx=0 tx=0).stop 2023-07-14T18:12:39.129 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:39.088+0000 7f283c0d5700 1 -- 172.21.15.163:0/214308954 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f28340ffc30 msgr2=0x7f28341958e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:12:39.129 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:39.088+0000 7f283c0d5700 1 --2- 172.21.15.163:0/214308954 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f28340ffc30 0x7f28341958e0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f2824004730 tx=0x7f2824009580 comp rx=0 tx=0).stop 2023-07-14T18:12:39.129 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:39.088+0000 7f283c0d5700 1 -- 172.21.15.163:0/214308954 shutdown_connections 2023-07-14T18:12:39.130 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:39.088+0000 7f283c0d5700 1 --2- 172.21.15.163:0/214308954 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f28200a1260 0x7f28200a3710 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:39.130 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:39.088+0000 7f283c0d5700 1 --2- 172.21.15.163:0/214308954 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f28341017b0 0x7f283419ce90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:39.130 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:39.088+0000 7f283c0d5700 1 --2- 172.21.15.163:0/214308954 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f28340ffc30 0x7f28341958e0 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:39.130 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:39.088+0000 7f283c0d5700 1 --2- 172.21.15.163:0/214308954 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2834100e20 0x7f2834195e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:39.130 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:39.089+0000 7f283c0d5700 1 -- 172.21.15.163:0/214308954 >> 172.21.15.163:0/214308954 conn(0x7f28340fb290 msgr2=0x7f28340fe600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:12:39.130 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:39.089+0000 7f283c0d5700 1 -- 172.21.15.163:0/214308954 shutdown_connections 2023-07-14T18:12:39.130 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:39.089+0000 7f283c0d5700 1 -- 172.21.15.163:0/214308954 wait complete. 2023-07-14T18:12:39.140 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:12:38 smithi163 ceph-mon[96576]: pgmap v297: 129 pgs: 129 active+clean; 643 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-07-14T18:12:39.140 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:12:38 smithi163 ceph-mon[96576]: from='client.? 172.21.15.163:0/4011030769' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-07-14T18:12:39.140 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:12:38 smithi163 ceph-mon[96576]: from='client.? 172.21.15.163:0/1225915688' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-07-14T18:12:39.140 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:12:38 smithi163 ceph-mon[96576]: from='client.? 172.21.15.163:0/3856044798' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-07-14T18:12:39.141 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-14T18:12:39.175 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:12:38 smithi184 ceph-mon[98481]: pgmap v297: 129 pgs: 129 active+clean; 643 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-07-14T18:12:39.175 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:12:38 smithi184 ceph-mon[98481]: from='client.? 172.21.15.163:0/4011030769' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-07-14T18:12:39.175 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:12:38 smithi184 ceph-mon[98481]: from='client.? 172.21.15.163:0/1225915688' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-07-14T18:12:39.176 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:12:38 smithi184 ceph-mon[98481]: from='client.? 172.21.15.163:0/3856044798' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-07-14T18:12:39.263 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:39.222+0000 7fcc971bd700 1 -- 172.21.15.163:0/3003110408 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fcc900fed40 msgr2=0x7fcc900ff1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:12:39.263 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:39.222+0000 7fcc971bd700 1 --2- 172.21.15.163:0/3003110408 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fcc900fed40 0x7fcc900ff1b0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7fcc7c009990 tx=0x7fcc7c009ca0 comp rx=0 tx=0).stop 2023-07-14T18:12:39.263 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:39.222+0000 7fcc971bd700 1 -- 172.21.15.163:0/3003110408 shutdown_connections 2023-07-14T18:12:39.264 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:39.222+0000 7fcc971bd700 1 --2- 172.21.15.163:0/3003110408 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcc90100180 0x7fcc90100590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:39.264 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:39.222+0000 7fcc971bd700 1 --2- 172.21.15.163:0/3003110408 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcc900ff6f0 0x7fcc90106fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:39.264 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:39.222+0000 7fcc971bd700 1 --2- 172.21.15.163:0/3003110408 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fcc900fed40 0x7fcc900ff1b0 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:39.264 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:39.222+0000 7fcc971bd700 1 -- 172.21.15.163:0/3003110408 >> 172.21.15.163:0/3003110408 conn(0x7fcc900f98a0 msgr2=0x7fcc900fbcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:12:39.264 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:39.223+0000 7fcc971bd700 1 -- 172.21.15.163:0/3003110408 shutdown_connections 2023-07-14T18:12:39.264 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:39.223+0000 7fcc971bd700 1 -- 172.21.15.163:0/3003110408 wait complete. 2023-07-14T18:12:39.264 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:39.223+0000 7fcc971bd700 1 Processor -- start 2023-07-14T18:12:39.265 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:39.223+0000 7fcc971bd700 1 -- start start 2023-07-14T18:12:39.266 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:39.223+0000 7fcc971bd700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcc900fed40 0x7fcc90195770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:12:39.267 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:39.223+0000 7fcc971bd700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcc900ff6f0 0x7fcc90195cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:12:39.267 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:39.223+0000 7fcc971bd700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fcc90100180 0x7fcc9019cd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:12:39.267 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:39.223+0000 7fcc971bd700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc9019d2f0 con 0x7fcc90100180 2023-07-14T18:12:39.267 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:39.223+0000 7fcc971bd700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc9019d430 con 0x7fcc900ff6f0 2023-07-14T18:12:39.267 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:39.223+0000 7fcc971bd700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc9019d5c0 con 0x7fcc900fed40 2023-07-14T18:12:39.267 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:39.223+0000 7fcc9575a700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fcc90100180 0x7fcc9019cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:12:39.267 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:39.223+0000 7fcc9575a700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fcc90100180 0x7fcc9019cd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:57358/0 (socket says 172.21.15.163:57358) 2023-07-14T18:12:39.268 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:39.223+0000 7fcc9575a700 1 -- 172.21.15.163:0/2395712702 learned_addr learned my addr 172.21.15.163:0/2395712702 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:12:39.268 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:39.224+0000 7fcc94f59700 1 --2- 172.21.15.163:0/2395712702 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcc900fed40 0x7fcc90195770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:12:39.268 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:39.224+0000 7fcc8ffff700 1 --2- 172.21.15.163:0/2395712702 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcc900ff6f0 0x7fcc90195cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:12:39.268 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:39.224+0000 7fcc9575a700 1 -- 172.21.15.163:0/2395712702 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcc900fed40 msgr2=0x7fcc90195770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:12:39.268 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:39.224+0000 7fcc9575a700 1 --2- 172.21.15.163:0/2395712702 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcc900fed40 0x7fcc90195770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:39.268 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:39.224+0000 7fcc9575a700 1 -- 172.21.15.163:0/2395712702 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcc900ff6f0 msgr2=0x7fcc90195cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:12:39.268 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:39.224+0000 7fcc9575a700 1 --2- 172.21.15.163:0/2395712702 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcc900ff6f0 0x7fcc90195cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:39.269 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:39.224+0000 7fcc9575a700 1 -- 172.21.15.163:0/2395712702 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc7c0095f0 con 0x7fcc90100180 2023-07-14T18:12:39.269 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:39.224+0000 7fcc8ffff700 1 --2- 172.21.15.163:0/2395712702 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcc900ff6f0 0x7fcc90195cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T18:12:39.269 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:39.224+0000 7fcc94f59700 1 --2- 172.21.15.163:0/2395712702 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcc900fed40 0x7fcc90195770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T18:12:39.269 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:39.224+0000 7fcc9575a700 1 --2- 172.21.15.163:0/2395712702 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fcc90100180 0x7fcc9019cd20 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7fcc88007ee0 tx=0x7fcc8800d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:12:39.269 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:39.224+0000 7fcc8dffb700 1 -- 172.21.15.163:0/2395712702 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc8800ddd0 con 0x7fcc90100180 2023-07-14T18:12:39.269 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:39.224+0000 7fcc8dffb700 1 -- 172.21.15.163:0/2395712702 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fcc8800f040 con 0x7fcc90100180 2023-07-14T18:12:39.269 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:39.224+0000 7fcc971bd700 1 -- 172.21.15.163:0/2395712702 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcc9019d8a0 con 0x7fcc90100180 2023-07-14T18:12:39.270 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:39.224+0000 7fcc8dffb700 1 -- 172.21.15.163:0/2395712702 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc88004870 con 0x7fcc90100180 2023-07-14T18:12:39.270 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:39.224+0000 7fcc971bd700 1 -- 172.21.15.163:0/2395712702 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcc9019de00 con 0x7fcc90100180 2023-07-14T18:12:39.270 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:39.225+0000 7fcc971bd700 1 -- 172.21.15.163:0/2395712702 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcc9010a180 con 0x7fcc90100180 2023-07-14T18:12:39.270 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:39.226+0000 7fcc8dffb700 1 -- 172.21.15.163:0/2395712702 <== mon.0 v2:172.21.15.163:3300/0 4 ==== mgrmap(e 17) v1 ==== 135767+0+0 (secure 0 0 0) 0x7fcc88003a00 con 0x7fcc90100180 2023-07-14T18:12:39.270 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:39.227+0000 7fcc8dffb700 1 --2- 172.21.15.163:0/2395712702 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7fcc800a12a0 0x7fcc800a3750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:12:39.271 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:39.227+0000 7fcc8dffb700 1 -- 172.21.15.163:0/2395712702 <== mon.0 v2:172.21.15.163:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 9020+0+0 (secure 0 0 0) 0x7fcc880cc750 con 0x7fcc90100180 2023-07-14T18:12:39.271 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:39.227+0000 7fcc94f59700 1 --2- 172.21.15.163:0/2395712702 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7fcc800a12a0 0x7fcc800a3750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:12:39.271 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:39.227+0000 7fcc94f59700 1 --2- 172.21.15.163:0/2395712702 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7fcc800a12a0 0x7fcc800a3750 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fcc84005fd0 tx=0x7fcc8400a5e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:12:39.271 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:39.231+0000 7fcc8dffb700 1 -- 172.21.15.163:0/2395712702 <== mon.0 v2:172.21.15.163:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178025 (secure 0 0 0) 0x7fcc8804e780 con 0x7fcc90100180 2023-07-14T18:12:39.276 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:12:38 smithi172 ceph-mon[97983]: pgmap v297: 129 pgs: 129 active+clean; 643 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-07-14T18:12:39.276 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:12:38 smithi172 ceph-mon[97983]: from='client.? 172.21.15.163:0/4011030769' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-07-14T18:12:39.276 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:12:38 smithi172 ceph-mon[97983]: from='client.? 172.21.15.163:0/1225915688' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-07-14T18:12:39.276 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:12:38 smithi172 ceph-mon[97983]: from='client.? 172.21.15.163:0/3856044798' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-07-14T18:12:39.504 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:39.463+0000 7fcc971bd700 1 -- 172.21.15.163:0/2395712702 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fcc9019e3e0 con 0x7fcc90100180 2023-07-14T18:12:39.504 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:39.464+0000 7fcc8dffb700 1 -- 172.21.15.163:0/2395712702 <== mon.0 v2:172.21.15.163:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) v1 ==== 94+0+10899 (secure 0 0 0) 0x7fcc88095a30 con 0x7fcc90100180 2023-07-14T18:12:39.505 INFO:teuthology.orchestra.run.smithi163.stdout: 2023-07-14T18:12:39.505 INFO:teuthology.orchestra.run.smithi163.stdout:{"epoch":28,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14562,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.163:6835/1058662632","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6834","nonce":1058662632},{"type":"v1","addr":"172.21.15.163:6835","nonce":1058662632}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":14568,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.163:6837/1107244425","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6836","nonce":1107244425},{"type":"v1","addr":"172.21.15.163:6837","nonce":1107244425}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":28,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-07-14T18:11:09.109693+0000","modified":"2023-07-14T18:11:31.766338+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24518,"mds_1":24493,"mds_2":24479,"mds_3":24478,"mds_4":14652},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14640":{"gid":14640,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.163:6839/1337572937","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6838","nonce":1337572937},{"type":"v1","addr":"172.21.15.163:6839","nonce":1337572937}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_14652":{"gid":14652,"name":"a","rank":4,"incarnation":26,"state":"up:active","state_seq":9,"addr":"172.21.15.163:6841/1032082642","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6840","nonce":1032082642},{"type":"v1","addr":"172.21.15.163:6841","nonce":1032082642}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24421":{"gid":24421,"name":"l","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.184:6833/797722972","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6832","nonce":797722972},{"type":"v1","addr":"172.21.15.184:6833","nonce":797722972}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24431":{"gid":24431,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6833/1075696311","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":1075696311},{"type":"v1","addr":"172.21.15.172:6833","nonce":1075696311}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24458":{"gid":24458,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6835/1158120127","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":1158120127},{"type":"v1","addr":"172.21.15.172:6835","nonce":1158120127}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24466":{"gid":24466,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.184:6835/460134263","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6834","nonce":460134263},{"type":"v1","addr":"172.21.15.184:6835","nonce":460134263}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24478":{"gid":24478,"name":"c","rank":3,"incarnation":24,"state":"up:active","state_seq":11,"addr":"172.21.15.184:6837/3389277679","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6836","nonce":3389277679},{"type":"v1","addr":"172.21.15.184:6837","nonce":3389277679}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24479":{"gid":24479,"name":"h","rank":2,"incarnation":22,"state":"up:active","state_seq":10,"addr":"172.21.15.172:6837/3783835012","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":3783835012},{"type":"v1","addr":"172.21.15.172:6837","nonce":3783835012}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24493":{"gid":24493,"name":"i","rank":1,"incarnation":20,"state":"up:active","state_seq":9,"addr":"172.21.15.184:6839/2819059257","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6838","nonce":2819059257},{"type":"v1","addr":"172.21.15.184:6839","nonce":2819059257}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24518":{"gid":24518,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.172:6839/3850440096","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6838","nonce":3850440096},{"type":"v1","addr":"172.21.15.172:6839","nonce":3850440096}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-07-14T18:12:39.507 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:39.466+0000 7fcc971bd700 1 -- 172.21.15.163:0/2395712702 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7fcc800a12a0 msgr2=0x7fcc800a3750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:12:39.507 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:39.466+0000 7fcc971bd700 1 --2- 172.21.15.163:0/2395712702 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7fcc800a12a0 0x7fcc800a3750 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fcc84005fd0 tx=0x7fcc8400a5e0 comp rx=0 tx=0).stop 2023-07-14T18:12:39.507 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:39.466+0000 7fcc971bd700 1 -- 172.21.15.163:0/2395712702 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fcc90100180 msgr2=0x7fcc9019cd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:12:39.508 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:39.466+0000 7fcc971bd700 1 --2- 172.21.15.163:0/2395712702 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fcc90100180 0x7fcc9019cd20 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7fcc88007ee0 tx=0x7fcc8800d3b0 comp rx=0 tx=0).stop 2023-07-14T18:12:39.508 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:39.466+0000 7fcc971bd700 1 -- 172.21.15.163:0/2395712702 shutdown_connections 2023-07-14T18:12:39.508 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:39.466+0000 7fcc971bd700 1 --2- 172.21.15.163:0/2395712702 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7fcc800a12a0 0x7fcc800a3750 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:39.508 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:39.466+0000 7fcc971bd700 1 --2- 172.21.15.163:0/2395712702 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcc900fed40 0x7fcc90195770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:39.508 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:39.466+0000 7fcc971bd700 1 --2- 172.21.15.163:0/2395712702 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fcc90100180 0x7fcc9019cd20 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:39.509 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:39.466+0000 7fcc971bd700 1 --2- 172.21.15.163:0/2395712702 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcc900ff6f0 0x7fcc90195cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:39.509 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:39.466+0000 7fcc971bd700 1 -- 172.21.15.163:0/2395712702 >> 172.21.15.163:0/2395712702 conn(0x7fcc900f98a0 msgr2=0x7fcc900fdd30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:12:39.509 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:39.466+0000 7fcc971bd700 1 -- 172.21.15.163:0/2395712702 shutdown_connections 2023-07-14T18:12:39.509 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:39.467+0000 7fcc971bd700 1 -- 172.21.15.163:0/2395712702 wait complete. 2023-07-14T18:12:39.510 INFO:teuthology.orchestra.run.smithi163.stderr:dumped fsmap epoch 28 2023-07-14T18:12:39.519 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-14T18:12:39.641 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:39.600+0000 7f033bd99700 1 -- 172.21.15.163:0/4056425696 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f03340ffc30 msgr2=0x7f0334100040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:12:39.641 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:39.600+0000 7f033bd99700 1 --2- 172.21.15.163:0/4056425696 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f03340ffc30 0x7f0334100040 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f0330009990 tx=0x7f0330009ca0 comp rx=0 tx=0).stop 2023-07-14T18:12:39.642 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:39.600+0000 7f033bd99700 1 -- 172.21.15.163:0/4056425696 shutdown_connections 2023-07-14T18:12:39.642 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:39.600+0000 7f033bd99700 1 --2- 172.21.15.163:0/4056425696 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f03341017b0 0x7f0334108070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:39.642 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:39.600+0000 7f033bd99700 1 --2- 172.21.15.163:0/4056425696 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f03340ffc30 0x7f0334100040 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:39.642 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:39.600+0000 7f033bd99700 1 --2- 172.21.15.163:0/4056425696 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0334100e20 0x7f0334101270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:39.642 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:39.601+0000 7f033bd99700 1 -- 172.21.15.163:0/4056425696 >> 172.21.15.163:0/4056425696 conn(0x7f03340fb210 msgr2=0x7f03340fd680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:12:39.642 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:39.601+0000 7f033bd99700 1 -- 172.21.15.163:0/4056425696 shutdown_connections 2023-07-14T18:12:39.642 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:39.601+0000 7f033bd99700 1 -- 172.21.15.163:0/4056425696 wait complete. 2023-07-14T18:12:39.643 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:39.601+0000 7f033bd99700 1 Processor -- start 2023-07-14T18:12:39.643 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:39.601+0000 7f033bd99700 1 -- start start 2023-07-14T18:12:39.644 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:39.601+0000 7f033bd99700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f03340ffc30 0x7f03340743f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:12:39.644 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:39.601+0000 7f033bd99700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0334100e20 0x7f0334072a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:12:39.645 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:39.601+0000 7f033bd99700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f03341017b0 0x7f0334072f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:12:39.645 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:39.601+0000 7f033bd99700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0334073710 con 0x7f03340ffc30 2023-07-14T18:12:39.645 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:39.601+0000 7f033bd99700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0334073880 con 0x7f0334100e20 2023-07-14T18:12:39.645 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:39.601+0000 7f033bd99700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f033419f8a0 con 0x7f03341017b0 2023-07-14T18:12:39.645 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:39.601+0000 7f0339b35700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f03340ffc30 0x7f03340743f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:12:39.645 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:39.602+0000 7f0339b35700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f03340ffc30 0x7f03340743f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:57368/0 (socket says 172.21.15.163:57368) 2023-07-14T18:12:39.645 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:39.602+0000 7f0339b35700 1 -- 172.21.15.163:0/1496913470 learned_addr learned my addr 172.21.15.163:0/1496913470 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:12:39.646 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:39.602+0000 7f033a336700 1 --2- 172.21.15.163:0/1496913470 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f03341017b0 0x7f0334072f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:12:39.646 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:39.602+0000 7f0339334700 1 --2- 172.21.15.163:0/1496913470 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0334100e20 0x7f0334072a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:12:39.646 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:39.602+0000 7f0339b35700 1 -- 172.21.15.163:0/1496913470 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f03341017b0 msgr2=0x7f0334072f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:12:39.646 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:39.602+0000 7f0339b35700 1 --2- 172.21.15.163:0/1496913470 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f03341017b0 0x7f0334072f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:39.646 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:39.602+0000 7f0339b35700 1 -- 172.21.15.163:0/1496913470 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0334100e20 msgr2=0x7f0334072a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:12:39.646 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:39.602+0000 7f0339b35700 1 --2- 172.21.15.163:0/1496913470 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0334100e20 0x7f0334072a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:39.646 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:39.602+0000 7f0339b35700 1 -- 172.21.15.163:0/1496913470 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03300095f0 con 0x7f03340ffc30 2023-07-14T18:12:39.646 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:39.602+0000 7f0339b35700 1 --2- 172.21.15.163:0/1496913470 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f03340ffc30 0x7f03340743f0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f0330000c00 tx=0x7f03300047b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:12:39.647 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:39.602+0000 7f032affd700 1 -- 172.21.15.163:0/1496913470 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f033001d070 con 0x7f03340ffc30 2023-07-14T18:12:39.647 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:39.602+0000 7f032affd700 1 -- 172.21.15.163:0/1496913470 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f0330003f40 con 0x7f03340ffc30 2023-07-14T18:12:39.647 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:39.602+0000 7f032affd700 1 -- 172.21.15.163:0/1496913470 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0330022bf0 con 0x7f03340ffc30 2023-07-14T18:12:39.647 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:39.602+0000 7f033bd99700 1 -- 172.21.15.163:0/1496913470 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f033419fb20 con 0x7f03340ffc30 2023-07-14T18:12:39.647 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:39.602+0000 7f033bd99700 1 -- 172.21.15.163:0/1496913470 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f033419ffd0 con 0x7f03340ffc30 2023-07-14T18:12:39.647 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:39.603+0000 7f033bd99700 1 -- 172.21.15.163:0/1496913470 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f033410b2b0 con 0x7f03340ffc30 2023-07-14T18:12:39.647 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:39.604+0000 7f032affd700 1 -- 172.21.15.163:0/1496913470 <== mon.0 v2:172.21.15.163:3300/0 4 ==== mgrmap(e 17) v1 ==== 135767+0+0 (secure 0 0 0) 0x7f0330022d50 con 0x7f03340ffc30 2023-07-14T18:12:39.648 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:39.605+0000 7f032affd700 1 --2- 172.21.15.163:0/1496913470 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f03200a12a0 0x7f03200a3750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:12:39.648 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:39.605+0000 7f0339334700 1 --2- 172.21.15.163:0/1496913470 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f03200a12a0 0x7f03200a3750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:12:39.648 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:39.605+0000 7f032affd700 1 -- 172.21.15.163:0/1496913470 <== mon.0 v2:172.21.15.163:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 9020+0+0 (secure 0 0 0) 0x7f03300cdf30 con 0x7f03340ffc30 2023-07-14T18:12:39.648 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:39.605+0000 7f0339334700 1 --2- 172.21.15.163:0/1496913470 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f03200a12a0 0x7f03200a3750 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f0324007c60 tx=0x7f03240073d0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:12:39.649 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:39.609+0000 7f032affd700 1 -- 172.21.15.163:0/1496913470 <== mon.0 v2:172.21.15.163:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178025 (secure 0 0 0) 0x7f0330097240 con 0x7f03340ffc30 2023-07-14T18:12:39.841 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:39.800+0000 7f033bd99700 1 -- 172.21.15.163:0/1496913470 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0334106b80 con 0x7f03340ffc30 2023-07-14T18:12:39.843 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:39.802+0000 7f032affd700 1 -- 172.21.15.163:0/1496913470 <== mon.0 v2:172.21.15.163:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v86) v1 ==== 74+0+24500 (secure 0 0 0) 0x7f033009a860 con 0x7f03340ffc30 2023-07-14T18:12:39.843 INFO:teuthology.orchestra.run.smithi163.stdout: 2023-07-14T18:12:39.843 INFO:teuthology.orchestra.run.smithi163.stdout:{"epoch":86,"fsid":"bf7326ec-2270-11ee-9b33-001a4aab830c","created":"2023-07-14T18:04:26.263517+0000","modified":"2023-07-14T18:12:16.776609+0000","last_up_change":"2023-07-14T18:10:27.514863+0000","last_in_change":"2023-07-14T18:10:10.726443+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-14T18:07:19.653852+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-07-14T18:11:07.314989+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-07-14T18:11:08.274627+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-07-14T18:11:11.991162+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"e6490568-046d-43ef-bb07-d79fb884b276","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6802","nonce":3124653025},{"type":"v1","addr":"172.21.15.163:6803","nonce":3124653025}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6804","nonce":3124653025},{"type":"v1","addr":"172.21.15.163:6805","nonce":3124653025}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6808","nonce":3124653025},{"type":"v1","addr":"172.21.15.163:6809","nonce":3124653025}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6806","nonce":3124653025},{"type":"v1","addr":"172.21.15.163:6807","nonce":3124653025}]},"public_addr":"172.21.15.163:6803/3124653025","cluster_addr":"172.21.15.163:6805/3124653025","heartbeat_back_addr":"172.21.15.163:6809/3124653025","heartbeat_front_addr":"172.21.15.163:6807/3124653025","state":["exists","up"]},{"osd":1,"uuid":"0af39bda-f096-4603-adcc-bf1988f36603","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":3774455900},{"type":"v1","addr":"172.21.15.172:6801","nonce":3774455900}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":3774455900},{"type":"v1","addr":"172.21.15.172:6803","nonce":3774455900}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":3774455900},{"type":"v1","addr":"172.21.15.172:6807","nonce":3774455900}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":3774455900},{"type":"v1","addr":"172.21.15.172:6805","nonce":3774455900}]},"public_addr":"172.21.15.172:6801/3774455900","cluster_addr":"172.21.15.172:6803/3774455900","heartbeat_back_addr":"172.21.15.172:6807/3774455900","heartbeat_front_addr":"172.21.15.172:6805/3774455900","state":["exists","up"]},{"osd":2,"uuid":"cc732c13-af0f-4199-98e6-fe960ed4e5dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":1976927678},{"type":"v1","addr":"172.21.15.184:6801","nonce":1976927678}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":1976927678},{"type":"v1","addr":"172.21.15.184:6803","nonce":1976927678}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":1976927678},{"type":"v1","addr":"172.21.15.184:6807","nonce":1976927678}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":1976927678},{"type":"v1","addr":"172.21.15.184:6805","nonce":1976927678}]},"public_addr":"172.21.15.184:6801/1976927678","cluster_addr":"172.21.15.184:6803/1976927678","heartbeat_back_addr":"172.21.15.184:6807/1976927678","heartbeat_front_addr":"172.21.15.184:6805/1976927678","state":["exists","up"]},{"osd":3,"uuid":"dcee9576-0bc6-4ab0-8f63-79eacd0eca5f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6810","nonce":2589130694},{"type":"v1","addr":"172.21.15.163:6811","nonce":2589130694}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6812","nonce":2589130694},{"type":"v1","addr":"172.21.15.163:6813","nonce":2589130694}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6816","nonce":2589130694},{"type":"v1","addr":"172.21.15.163:6817","nonce":2589130694}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6814","nonce":2589130694},{"type":"v1","addr":"172.21.15.163:6815","nonce":2589130694}]},"public_addr":"172.21.15.163:6811/2589130694","cluster_addr":"172.21.15.163:6813/2589130694","heartbeat_back_addr":"172.21.15.163:6817/2589130694","heartbeat_front_addr":"172.21.15.163:6815/2589130694","state":["exists","up"]},{"osd":4,"uuid":"055df823-b8b0-426a-83c2-f0d727932ad8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":3319632614},{"type":"v1","addr":"172.21.15.172:6809","nonce":3319632614}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6810","nonce":3319632614},{"type":"v1","addr":"172.21.15.172:6811","nonce":3319632614}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6814","nonce":3319632614},{"type":"v1","addr":"172.21.15.172:6815","nonce":3319632614}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":3319632614},{"type":"v1","addr":"172.21.15.172:6813","nonce":3319632614}]},"public_addr":"172.21.15.172:6809/3319632614","cluster_addr":"172.21.15.172:6811/3319632614","heartbeat_back_addr":"172.21.15.172:6815/3319632614","heartbeat_front_addr":"172.21.15.172:6813/3319632614","state":["exists","up"]},{"osd":5,"uuid":"ef5ef02a-b4e2-4790-9d27-f6d2247b25c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":2662084043},{"type":"v1","addr":"172.21.15.184:6809","nonce":2662084043}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6810","nonce":2662084043},{"type":"v1","addr":"172.21.15.184:6811","nonce":2662084043}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6814","nonce":2662084043},{"type":"v1","addr":"172.21.15.184:6815","nonce":2662084043}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6812","nonce":2662084043},{"type":"v1","addr":"172.21.15.184:6813","nonce":2662084043}]},"public_addr":"172.21.15.184:6809/2662084043","cluster_addr":"172.21.15.184:6811/2662084043","heartbeat_back_addr":"172.21.15.184:6815/2662084043","heartbeat_front_addr":"172.21.15.184:6813/2662084043","state":["exists","up"]},{"osd":6,"uuid":"dba754be-0fc5-4867-a6d5-cf97eb344f81","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":44,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6818","nonce":2530874117},{"type":"v1","addr":"172.21.15.163:6819","nonce":2530874117}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6820","nonce":2530874117},{"type":"v1","addr":"172.21.15.163:6821","nonce":2530874117}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6824","nonce":2530874117},{"type":"v1","addr":"172.21.15.163:6825","nonce":2530874117}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6822","nonce":2530874117},{"type":"v1","addr":"172.21.15.163:6823","nonce":2530874117}]},"public_addr":"172.21.15.163:6819/2530874117","cluster_addr":"172.21.15.163:6821/2530874117","heartbeat_back_addr":"172.21.15.163:6825/2530874117","heartbeat_front_addr":"172.21.15.163:6823/2530874117","state":["exists","up"]},{"osd":7,"uuid":"edd76e6b-6077-4619-b00d-1e906f70ddcc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":49,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":233511803},{"type":"v1","addr":"172.21.15.172:6817","nonce":233511803}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6818","nonce":233511803},{"type":"v1","addr":"172.21.15.172:6819","nonce":233511803}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":233511803},{"type":"v1","addr":"172.21.15.172:6823","nonce":233511803}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6820","nonce":233511803},{"type":"v1","addr":"172.21.15.172:6821","nonce":233511803}]},"public_addr":"172.21.15.172:6817/233511803","cluster_addr":"172.21.15.172:6819/233511803","heartbeat_back_addr":"172.21.15.172:6823/233511803","heartbeat_front_addr":"172.21.15.172:6821/233511803","state":["exists","up"]},{"osd":8,"uuid":"36559400-f33e-44e6-868a-316d34da457d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":56,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6816","nonce":290154343},{"type":"v1","addr":"172.21.15.184:6817","nonce":290154343}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6818","nonce":290154343},{"type":"v1","addr":"172.21.15.184:6819","nonce":290154343}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6822","nonce":290154343},{"type":"v1","addr":"172.21.15.184:6823","nonce":290154343}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6820","nonce":290154343},{"type":"v1","addr":"172.21.15.184:6821","nonce":290154343}]},"public_addr":"172.21.15.184:6817/290154343","cluster_addr":"172.21.15.184:6819/290154343","heartbeat_back_addr":"172.21.15.184:6823/290154343","heartbeat_front_addr":"172.21.15.184:6821/290154343","state":["exists","up"]},{"osd":9,"uuid":"d484f111-f36c-4c67-9a8a-ae03e7e0d137","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6826","nonce":3848110906},{"type":"v1","addr":"172.21.15.163:6827","nonce":3848110906}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6828","nonce":3848110906},{"type":"v1","addr":"172.21.15.163:6829","nonce":3848110906}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6832","nonce":3848110906},{"type":"v1","addr":"172.21.15.163:6833","nonce":3848110906}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6830","nonce":3848110906},{"type":"v1","addr":"172.21.15.163:6831","nonce":3848110906}]},"public_addr":"172.21.15.163:6827/3848110906","cluster_addr":"172.21.15.163:6829/3848110906","heartbeat_back_addr":"172.21.15.163:6833/3848110906","heartbeat_front_addr":"172.21.15.163:6831/3848110906","state":["exists","up"]},{"osd":10,"uuid":"d943f7c0-da3d-4605-9e23-0231e675c6be","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6824","nonce":3281085356},{"type":"v1","addr":"172.21.15.172:6825","nonce":3281085356}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":3281085356},{"type":"v1","addr":"172.21.15.172:6827","nonce":3281085356}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":3281085356},{"type":"v1","addr":"172.21.15.172:6831","nonce":3281085356}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6828","nonce":3281085356},{"type":"v1","addr":"172.21.15.172:6829","nonce":3281085356}]},"public_addr":"172.21.15.172:6825/3281085356","cluster_addr":"172.21.15.172:6827/3281085356","heartbeat_back_addr":"172.21.15.172:6831/3281085356","heartbeat_front_addr":"172.21.15.172:6829/3281085356","state":["exists","up"]},{"osd":11,"uuid":"09e610a8-408a-4119-a21b-c4de2810a538","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":75,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6824","nonce":3614578747},{"type":"v1","addr":"172.21.15.184:6825","nonce":3614578747}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6826","nonce":3614578747},{"type":"v1","addr":"172.21.15.184:6827","nonce":3614578747}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6830","nonce":3614578747},{"type":"v1","addr":"172.21.15.184:6831","nonce":3614578747}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6828","nonce":3614578747},{"type":"v1","addr":"172.21.15.184:6829","nonce":3614578747}]},"public_addr":"172.21.15.184:6825/3614578747","cluster_addr":"172.21.15.184:6827/3614578747","heartbeat_back_addr":"172.21.15.184:6831/3614578747","heartbeat_front_addr":"172.21.15.184:6829/3614578747","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T18:06:36.067578+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T18:06:57.095120+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T18:07:17.825363+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T18:07:38.977196+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T18:08:00.108709+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T18:08:20.700646+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T18:08:41.473899+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T18:09:02.856536+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T18:09:23.832722+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T18:09:44.860884+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T18:10:05.520678+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T18:10:26.426315+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.8","mappings":[{"from":2,"to":11}]},{"pgid":"3.1","mappings":[{"from":4,"to":9}]},{"pgid":"3.6","mappings":[{"from":4,"to":6}]},{"pgid":"3.25","mappings":[{"from":5,"to":9}]},{"pgid":"3.27","mappings":[{"from":4,"to":8}]},{"pgid":"3.2d","mappings":[{"from":3,"to":9}]},{"pgid":"4.a","mappings":[{"from":5,"to":8}]},{"pgid":"4.12","mappings":[{"from":9,"to":10}]},{"pgid":"4.14","mappings":[{"from":9,"to":8}]},{"pgid":"4.17","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.163:6801/1086512093":"2023-07-15T18:05:15.331458+0000","172.21.15.163:6800/1086512093":"2023-07-15T18:05:15.331458+0000","172.21.15.163:0/4235784810":"2023-07-15T18:05:15.331458+0000","172.21.15.163:6800/236891232":"2023-07-15T18:04:53.288443+0000","172.21.15.163:6801/236891232":"2023-07-15T18:04:53.288443+0000","172.21.15.163:0/3260193612":"2023-07-15T18:05:15.331458+0000","172.21.15.163:0/3513629472":"2023-07-15T18:04:53.288443+0000","172.21.15.163:0/1090329830":"2023-07-15T18:04:53.288443+0000","172.21.15.163:0/3868922045":"2023-07-15T18:05:15.331458+0000","172.21.15.163:0/2945662447":"2023-07-15T18:04:53.288443+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-14T18:12:39.847 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:39.805+0000 7f033bd99700 1 -- 172.21.15.163:0/1496913470 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f03200a12a0 msgr2=0x7f03200a3750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:12:39.847 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:39.805+0000 7f033bd99700 1 --2- 172.21.15.163:0/1496913470 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f03200a12a0 0x7f03200a3750 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f0324007c60 tx=0x7f03240073d0 comp rx=0 tx=0).stop 2023-07-14T18:12:39.847 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:39.805+0000 7f033bd99700 1 -- 172.21.15.163:0/1496913470 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f03340ffc30 msgr2=0x7f03340743f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:12:39.848 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:39.805+0000 7f033bd99700 1 --2- 172.21.15.163:0/1496913470 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f03340ffc30 0x7f03340743f0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f0330000c00 tx=0x7f03300047b0 comp rx=0 tx=0).stop 2023-07-14T18:12:39.848 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:39.805+0000 7f033bd99700 1 -- 172.21.15.163:0/1496913470 shutdown_connections 2023-07-14T18:12:39.848 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:39.805+0000 7f033bd99700 1 --2- 172.21.15.163:0/1496913470 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f03200a12a0 0x7f03200a3750 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:39.848 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:39.805+0000 7f033bd99700 1 --2- 172.21.15.163:0/1496913470 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f03341017b0 0x7f0334072f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:39.849 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:39.805+0000 7f033bd99700 1 --2- 172.21.15.163:0/1496913470 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f03340ffc30 0x7f03340743f0 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:39.849 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:39.805+0000 7f033bd99700 1 --2- 172.21.15.163:0/1496913470 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0334100e20 0x7f0334072a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:39.849 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:39.805+0000 7f033bd99700 1 -- 172.21.15.163:0/1496913470 >> 172.21.15.163:0/1496913470 conn(0x7f03340fb210 msgr2=0x7f03340fd4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:12:39.849 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:39.805+0000 7f033bd99700 1 -- 172.21.15.163:0/1496913470 shutdown_connections 2023-07-14T18:12:39.849 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:39.805+0000 7f033bd99700 1 -- 172.21.15.163:0/1496913470 wait complete. 2023-07-14T18:12:39.858 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-14T18:07:19.653852+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-14T18:11:07.314989+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '79', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-07-14T18:11:08.274627+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '80', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-07-14T18:11:11.991162+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '84', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-07-14T18:12:39.859 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-14T18:12:39.984 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:39.944+0000 7f3a50ef8700 1 -- 172.21.15.163:0/1054258372 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f3a4c100690 msgr2=0x7f3a4c106f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:12:39.985 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:39.944+0000 7f3a50ef8700 1 --2- 172.21.15.163:0/1054258372 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f3a4c100690 0x7f3a4c106f50 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f3a4400b0a0 tx=0x7f3a4400b3b0 comp rx=0 tx=0).stop 2023-07-14T18:12:39.985 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:39.944+0000 7f3a50ef8700 1 -- 172.21.15.163:0/1054258372 shutdown_connections 2023-07-14T18:12:39.985 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:39.944+0000 7f3a50ef8700 1 --2- 172.21.15.163:0/1054258372 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f3a4c100690 0x7f3a4c106f50 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:39.985 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:39.944+0000 7f3a50ef8700 1 --2- 172.21.15.163:0/1054258372 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3a4c0feb10 0x7f3a4c0fef20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:39.985 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:39.944+0000 7f3a50ef8700 1 --2- 172.21.15.163:0/1054258372 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3a4c0ffd00 0x7f3a4c100150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:39.985 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:39.944+0000 7f3a50ef8700 1 -- 172.21.15.163:0/1054258372 >> 172.21.15.163:0/1054258372 conn(0x7f3a4c0fa130 msgr2=0x7f3a4c0fc560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:12:39.986 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:39.944+0000 7f3a50ef8700 1 -- 172.21.15.163:0/1054258372 shutdown_connections 2023-07-14T18:12:39.986 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:39.944+0000 7f3a50ef8700 1 -- 172.21.15.163:0/1054258372 wait complete. 2023-07-14T18:12:39.987 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:39.945+0000 7f3a50ef8700 1 Processor -- start 2023-07-14T18:12:39.988 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:39.945+0000 7f3a50ef8700 1 -- start start 2023-07-14T18:12:39.988 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:39.945+0000 7f3a50ef8700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3a4c0feb10 0x7f3a4c1959a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:12:39.988 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:39.945+0000 7f3a50ef8700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3a4c0ffd00 0x7f3a4c195ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:12:39.988 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:39.945+0000 7f3a50ef8700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f3a4c100690 0x7f3a4c19cf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:12:39.988 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:39.945+0000 7f3a50ef8700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a4c19d520 con 0x7f3a4c100690 2023-07-14T18:12:39.988 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:39.945+0000 7f3a50ef8700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a4c19d660 con 0x7f3a4c0ffd00 2023-07-14T18:12:39.988 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:39.945+0000 7f3a50ef8700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a4c19d7f0 con 0x7f3a4c0feb10 2023-07-14T18:12:39.989 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:39.945+0000 7f3a4ad9d700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f3a4c100690 0x7f3a4c19cf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:12:39.989 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:39.945+0000 7f3a4ad9d700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f3a4c100690 0x7f3a4c19cf50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:57386/0 (socket says 172.21.15.163:57386) 2023-07-14T18:12:39.989 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:39.945+0000 7f3a4ad9d700 1 -- 172.21.15.163:0/2113463585 learned_addr learned my addr 172.21.15.163:0/2113463585 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:12:39.989 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:39.945+0000 7f3a4a59c700 1 --2- 172.21.15.163:0/2113463585 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3a4c0feb10 0x7f3a4c1959a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:12:39.989 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:39.945+0000 7f3a49d9b700 1 --2- 172.21.15.163:0/2113463585 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3a4c0ffd00 0x7f3a4c195ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:12:39.989 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:39.945+0000 7f3a4ad9d700 1 -- 172.21.15.163:0/2113463585 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3a4c0feb10 msgr2=0x7f3a4c1959a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:12:39.989 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:39.945+0000 7f3a4ad9d700 1 --2- 172.21.15.163:0/2113463585 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3a4c0feb10 0x7f3a4c1959a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:39.990 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:39.945+0000 7f3a4ad9d700 1 -- 172.21.15.163:0/2113463585 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3a4c0ffd00 msgr2=0x7f3a4c195ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:12:39.990 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:39.945+0000 7f3a4ad9d700 1 --2- 172.21.15.163:0/2113463585 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3a4c0ffd00 0x7f3a4c195ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:39.990 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:39.945+0000 7f3a4ad9d700 1 -- 172.21.15.163:0/2113463585 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a44009d00 con 0x7f3a4c100690 2023-07-14T18:12:39.990 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:39.946+0000 7f3a4ad9d700 1 --2- 172.21.15.163:0/2113463585 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f3a4c100690 0x7f3a4c19cf50 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f3a44009fd0 tx=0x7f3a4400bc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:12:39.990 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:39.946+0000 7f3a3b7fe700 1 -- 172.21.15.163:0/2113463585 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a4400e040 con 0x7f3a4c100690 2023-07-14T18:12:39.990 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:39.946+0000 7f3a3b7fe700 1 -- 172.21.15.163:0/2113463585 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f3a44007760 con 0x7f3a4c100690 2023-07-14T18:12:39.990 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:39.946+0000 7f3a3b7fe700 1 -- 172.21.15.163:0/2113463585 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a4401b6c0 con 0x7f3a4c100690 2023-07-14T18:12:39.990 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:39.946+0000 7f3a50ef8700 1 -- 172.21.15.163:0/2113463585 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3a4c19da70 con 0x7f3a4c100690 2023-07-14T18:12:39.991 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:39.946+0000 7f3a50ef8700 1 -- 172.21.15.163:0/2113463585 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a4c19de90 con 0x7f3a4c100690 2023-07-14T18:12:39.991 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:39.947+0000 7f3a50ef8700 1 -- 172.21.15.163:0/2113463585 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3a4c10a1f0 con 0x7f3a4c100690 2023-07-14T18:12:39.992 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:39.948+0000 7f3a3b7fe700 1 -- 172.21.15.163:0/2113463585 <== mon.0 v2:172.21.15.163:3300/0 4 ==== mgrmap(e 17) v1 ==== 135767+0+0 (secure 0 0 0) 0x7f3a4401d470 con 0x7f3a4c100690 2023-07-14T18:12:39.992 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:39.948+0000 7f3a3b7fe700 1 --2- 172.21.15.163:0/2113463585 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f3a340a1260 0x7f3a340a3710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:12:39.992 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:39.948+0000 7f3a3b7fe700 1 -- 172.21.15.163:0/2113463585 <== mon.0 v2:172.21.15.163:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 9020+0+0 (secure 0 0 0) 0x7f3a440ce3c0 con 0x7f3a4c100690 2023-07-14T18:12:39.992 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:39.948+0000 7f3a4a59c700 1 --2- 172.21.15.163:0/2113463585 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f3a340a1260 0x7f3a340a3710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:12:39.993 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:39.949+0000 7f3a4a59c700 1 --2- 172.21.15.163:0/2113463585 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f3a340a1260 0x7f3a340a3710 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f3a4c0ffb60 tx=0x7f3a40009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:12:39.993 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:39.951+0000 7f3a3b7fe700 1 -- 172.21.15.163:0/2113463585 <== mon.0 v2:172.21.15.163:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178025 (secure 0 0 0) 0x7f3a44097730 con 0x7f3a4c100690 2023-07-14T18:12:40.175 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:12:39 smithi184 ceph-mon[98481]: from='client.? 172.21.15.163:0/214308954' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2023-07-14T18:12:40.175 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:12:39 smithi184 ceph-mon[98481]: from='client.? 172.21.15.163:0/2395712702' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-07-14T18:12:40.178 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:40.138+0000 7f3a50ef8700 1 -- 172.21.15.163:0/2113463585 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f3a4c19e4a0 con 0x7f3a4c100690 2023-07-14T18:12:40.179 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:40.138+0000 7f3a3b7fe700 1 -- 172.21.15.163:0/2113463585 <== mon.0 v2:172.21.15.163:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v86) v1 ==== 93+0+10 (secure 0 0 0) 0x7f3a4409ad50 con 0x7f3a4c100690 2023-07-14T18:12:40.179 INFO:teuthology.orchestra.run.smithi163.stdout:pg_num: 1 2023-07-14T18:12:40.181 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:40.141+0000 7f3a50ef8700 1 -- 172.21.15.163:0/2113463585 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f3a340a1260 msgr2=0x7f3a340a3710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:12:40.181 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:40.141+0000 7f3a50ef8700 1 --2- 172.21.15.163:0/2113463585 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f3a340a1260 0x7f3a340a3710 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f3a4c0ffb60 tx=0x7f3a40009260 comp rx=0 tx=0).stop 2023-07-14T18:12:40.181 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:40.141+0000 7f3a50ef8700 1 -- 172.21.15.163:0/2113463585 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f3a4c100690 msgr2=0x7f3a4c19cf50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:12:40.182 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:40.141+0000 7f3a50ef8700 1 --2- 172.21.15.163:0/2113463585 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f3a4c100690 0x7f3a4c19cf50 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f3a44009fd0 tx=0x7f3a4400bc80 comp rx=0 tx=0).stop 2023-07-14T18:12:40.182 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:40.141+0000 7f3a50ef8700 1 -- 172.21.15.163:0/2113463585 shutdown_connections 2023-07-14T18:12:40.182 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:40.141+0000 7f3a50ef8700 1 --2- 172.21.15.163:0/2113463585 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f3a340a1260 0x7f3a340a3710 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:40.182 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:40.141+0000 7f3a50ef8700 1 --2- 172.21.15.163:0/2113463585 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3a4c0feb10 0x7f3a4c1959a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:40.182 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:40.141+0000 7f3a50ef8700 1 --2- 172.21.15.163:0/2113463585 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f3a4c100690 0x7f3a4c19cf50 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:40.182 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:40.141+0000 7f3a50ef8700 1 --2- 172.21.15.163:0/2113463585 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3a4c0ffd00 0x7f3a4c195ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:40.182 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:40.141+0000 7f3a50ef8700 1 -- 172.21.15.163:0/2113463585 >> 172.21.15.163:0/2113463585 conn(0x7f3a4c0fa130 msgr2=0x7f3a4c0677c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:12:40.183 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:40.141+0000 7f3a50ef8700 1 -- 172.21.15.163:0/2113463585 shutdown_connections 2023-07-14T18:12:40.183 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:40.141+0000 7f3a50ef8700 1 -- 172.21.15.163:0/2113463585 wait complete. 2023-07-14T18:12:40.192 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:12:39 smithi163 ceph-mon[96576]: from='client.? 172.21.15.163:0/214308954' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2023-07-14T18:12:40.193 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:12:39 smithi163 ceph-mon[96576]: from='client.? 172.21.15.163:0/2395712702' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-07-14T18:12:40.193 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-14T18:12:40.276 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:12:39 smithi172 ceph-mon[97983]: from='client.? 172.21.15.163:0/214308954' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2023-07-14T18:12:40.276 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:12:39 smithi172 ceph-mon[97983]: from='client.? 172.21.15.163:0/2395712702' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-07-14T18:12:40.319 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:40.279+0000 7f3af8d26700 1 -- 172.21.15.163:0/578770935 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f3af40feb30 msgr2=0x7f3af40fef40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:12:40.319 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:40.279+0000 7f3af8d26700 1 --2- 172.21.15.163:0/578770935 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f3af40feb30 0x7f3af40fef40 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f3ae4009990 tx=0x7f3ae4009ca0 comp rx=0 tx=0).stop 2023-07-14T18:12:40.320 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:40.279+0000 7f3af8d26700 1 -- 172.21.15.163:0/578770935 shutdown_connections 2023-07-14T18:12:40.320 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:40.279+0000 7f3af8d26700 1 --2- 172.21.15.163:0/578770935 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3af4100770 0x7f3af4107010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:40.320 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:40.279+0000 7f3af8d26700 1 --2- 172.21.15.163:0/578770935 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f3af40feb30 0x7f3af40fef40 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:40.320 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:40.279+0000 7f3af8d26700 1 --2- 172.21.15.163:0/578770935 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3af40ffdc0 0x7f3af4100230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:40.320 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:40.279+0000 7f3af8d26700 1 -- 172.21.15.163:0/578770935 >> 172.21.15.163:0/578770935 conn(0x7f3af40fa150 msgr2=0x7f3af40fc580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:12:40.320 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:40.279+0000 7f3af8d26700 1 -- 172.21.15.163:0/578770935 shutdown_connections 2023-07-14T18:12:40.320 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:40.279+0000 7f3af8d26700 1 -- 172.21.15.163:0/578770935 wait complete. 2023-07-14T18:12:40.322 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:40.279+0000 7f3af8d26700 1 Processor -- start 2023-07-14T18:12:40.322 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:40.280+0000 7f3af8d26700 1 -- start start 2023-07-14T18:12:40.322 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:40.280+0000 7f3af8d26700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3af40feb30 0x7f3af4195860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:12:40.322 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:40.280+0000 7f3af8d26700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3af40ffdc0 0x7f3af4195da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:12:40.323 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:40.280+0000 7f3af8d26700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f3af4100770 0x7f3af419ce10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:12:40.323 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:40.280+0000 7f3af8d26700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3af419d3e0 con 0x7f3af4100770 2023-07-14T18:12:40.323 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:40.280+0000 7f3af8d26700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3af419d520 con 0x7f3af40feb30 2023-07-14T18:12:40.323 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:40.280+0000 7f3af8d26700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3af419d6b0 con 0x7f3af40ffdc0 2023-07-14T18:12:40.323 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:40.280+0000 7f3af2d9d700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f3af4100770 0x7f3af419ce10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:12:40.323 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:40.280+0000 7f3af2d9d700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f3af4100770 0x7f3af419ce10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:57400/0 (socket says 172.21.15.163:57400) 2023-07-14T18:12:40.323 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:40.280+0000 7f3af2d9d700 1 -- 172.21.15.163:0/85403331 learned_addr learned my addr 172.21.15.163:0/85403331 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:12:40.324 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:40.280+0000 7f3af1d9b700 1 --2- 172.21.15.163:0/85403331 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3af40ffdc0 0x7f3af4195da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:12:40.324 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:40.280+0000 7f3af259c700 1 --2- 172.21.15.163:0/85403331 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3af40feb30 0x7f3af4195860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:12:40.324 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:40.280+0000 7f3af2d9d700 1 -- 172.21.15.163:0/85403331 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3af40ffdc0 msgr2=0x7f3af4195da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:12:40.324 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:40.280+0000 7f3af2d9d700 1 --2- 172.21.15.163:0/85403331 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3af40ffdc0 0x7f3af4195da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:40.324 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:40.280+0000 7f3af2d9d700 1 -- 172.21.15.163:0/85403331 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3af40feb30 msgr2=0x7f3af4195860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:12:40.324 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:40.280+0000 7f3af2d9d700 1 --2- 172.21.15.163:0/85403331 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3af40feb30 0x7f3af4195860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:40.324 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:40.280+0000 7f3af2d9d700 1 -- 172.21.15.163:0/85403331 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ae40095f0 con 0x7f3af4100770 2023-07-14T18:12:40.325 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:40.280+0000 7f3af2d9d700 1 --2- 172.21.15.163:0/85403331 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f3af4100770 0x7f3af419ce10 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f3aec007ee0 tx=0x7f3aec00d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:12:40.325 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:40.280+0000 7f3ae37fe700 1 -- 172.21.15.163:0/85403331 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3aec017070 con 0x7f3af4100770 2023-07-14T18:12:40.325 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:40.280+0000 7f3ae37fe700 1 -- 172.21.15.163:0/85403331 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f3aec00f040 con 0x7f3af4100770 2023-07-14T18:12:40.325 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:40.280+0000 7f3af8d26700 1 -- 172.21.15.163:0/85403331 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3af419d990 con 0x7f3af4100770 2023-07-14T18:12:40.325 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:40.280+0000 7f3ae37fe700 1 -- 172.21.15.163:0/85403331 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3aec005710 con 0x7f3af4100770 2023-07-14T18:12:40.325 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:40.281+0000 7f3af8d26700 1 -- 172.21.15.163:0/85403331 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3af419de50 con 0x7f3af4100770 2023-07-14T18:12:40.325 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:40.281+0000 7f3af8d26700 1 -- 172.21.15.163:0/85403331 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3af4106d00 con 0x7f3af4100770 2023-07-14T18:12:40.326 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:40.283+0000 7f3ae37fe700 1 -- 172.21.15.163:0/85403331 <== mon.0 v2:172.21.15.163:3300/0 4 ==== mgrmap(e 17) v1 ==== 135767+0+0 (secure 0 0 0) 0x7f3aec005870 con 0x7f3af4100770 2023-07-14T18:12:40.326 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:40.283+0000 7f3ae37fe700 1 --2- 172.21.15.163:0/85403331 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f3adc0a11e0 0x7f3adc0a3690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:12:40.326 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:40.283+0000 7f3ae37fe700 1 -- 172.21.15.163:0/85403331 <== mon.0 v2:172.21.15.163:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 9020+0+0 (secure 0 0 0) 0x7f3aec0ccc60 con 0x7f3af4100770 2023-07-14T18:12:40.326 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:40.283+0000 7f3af259c700 1 --2- 172.21.15.163:0/85403331 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f3adc0a11e0 0x7f3adc0a3690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:12:40.327 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:40.284+0000 7f3af259c700 1 --2- 172.21.15.163:0/85403331 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f3adc0a11e0 0x7f3adc0a3690 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f3ae4006010 tx=0x7f3ae400b260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:12:40.327 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:40.286+0000 7f3ae37fe700 1 -- 172.21.15.163:0/85403331 <== mon.0 v2:172.21.15.163:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178025 (secure 0 0 0) 0x7f3aec095f40 con 0x7f3af4100770 2023-07-14T18:12:40.516 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:40.475+0000 7f3af8d26700 1 -- 172.21.15.163:0/85403331 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f3af402caf0 con 0x7f3af4100770 2023-07-14T18:12:40.516 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:40.476+0000 7f3ae37fe700 1 -- 172.21.15.163:0/85403331 <== mon.0 v2:172.21.15.163:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v86) v1 ==== 104+0+11 (secure 0 0 0) 0x7f3aec099560 con 0x7f3af4100770 2023-07-14T18:12:40.517 INFO:teuthology.orchestra.run.smithi163.stdout:pg_num: 32 2023-07-14T18:12:40.518 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:40.478+0000 7f3af8d26700 1 -- 172.21.15.163:0/85403331 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f3adc0a11e0 msgr2=0x7f3adc0a3690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:12:40.518 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:40.478+0000 7f3af8d26700 1 --2- 172.21.15.163:0/85403331 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f3adc0a11e0 0x7f3adc0a3690 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f3ae4006010 tx=0x7f3ae400b260 comp rx=0 tx=0).stop 2023-07-14T18:12:40.518 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:40.478+0000 7f3af8d26700 1 -- 172.21.15.163:0/85403331 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f3af4100770 msgr2=0x7f3af419ce10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:12:40.519 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:40.478+0000 7f3af8d26700 1 --2- 172.21.15.163:0/85403331 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f3af4100770 0x7f3af419ce10 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f3aec007ee0 tx=0x7f3aec00d3b0 comp rx=0 tx=0).stop 2023-07-14T18:12:40.519 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:40.478+0000 7f3af8d26700 1 -- 172.21.15.163:0/85403331 shutdown_connections 2023-07-14T18:12:40.519 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:40.478+0000 7f3af8d26700 1 --2- 172.21.15.163:0/85403331 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f3adc0a11e0 0x7f3adc0a3690 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:40.519 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:40.478+0000 7f3af8d26700 1 --2- 172.21.15.163:0/85403331 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f3af4100770 0x7f3af419ce10 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:40.519 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:40.478+0000 7f3af8d26700 1 --2- 172.21.15.163:0/85403331 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3af40feb30 0x7f3af4195860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:40.519 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:40.478+0000 7f3af8d26700 1 --2- 172.21.15.163:0/85403331 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3af40ffdc0 0x7f3af4195da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:40.519 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:40.478+0000 7f3af8d26700 1 -- 172.21.15.163:0/85403331 >> 172.21.15.163:0/85403331 conn(0x7f3af40fa150 msgr2=0x7f3af40fc3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:12:40.520 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:40.478+0000 7f3af8d26700 1 -- 172.21.15.163:0/85403331 shutdown_connections 2023-07-14T18:12:40.520 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:40.478+0000 7f3af8d26700 1 -- 172.21.15.163:0/85403331 wait complete. 2023-07-14T18:12:40.530 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-14T18:12:40.655 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:40.614+0000 7ff562b48700 1 -- 172.21.15.163:0/801217641 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff55c0feb30 msgr2=0x7ff55c0fef40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:12:40.655 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:40.614+0000 7ff562b48700 1 --2- 172.21.15.163:0/801217641 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff55c0feb30 0x7ff55c0fef40 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7ff550009990 tx=0x7ff550009ca0 comp rx=0 tx=0).stop 2023-07-14T18:12:40.656 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:40.615+0000 7ff562b48700 1 -- 172.21.15.163:0/801217641 shutdown_connections 2023-07-14T18:12:40.656 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:40.615+0000 7ff562b48700 1 --2- 172.21.15.163:0/801217641 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff55c100770 0x7ff55c107010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:40.656 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:40.615+0000 7ff562b48700 1 --2- 172.21.15.163:0/801217641 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff55c0feb30 0x7ff55c0fef40 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:40.656 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:40.615+0000 7ff562b48700 1 --2- 172.21.15.163:0/801217641 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff55c0ffdc0 0x7ff55c100230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:40.656 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:40.615+0000 7ff562b48700 1 -- 172.21.15.163:0/801217641 >> 172.21.15.163:0/801217641 conn(0x7ff55c0fa150 msgr2=0x7ff55c0fc580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:12:40.656 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:40.615+0000 7ff562b48700 1 -- 172.21.15.163:0/801217641 shutdown_connections 2023-07-14T18:12:40.656 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:40.615+0000 7ff562b48700 1 -- 172.21.15.163:0/801217641 wait complete. 2023-07-14T18:12:40.657 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:40.615+0000 7ff562b48700 1 Processor -- start 2023-07-14T18:12:40.657 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:40.615+0000 7ff562b48700 1 -- start start 2023-07-14T18:12:40.658 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:40.615+0000 7ff562b48700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff55c0feb30 0x7ff55c1958c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:12:40.658 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:40.615+0000 7ff562b48700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff55c0ffdc0 0x7ff55c195e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:12:40.659 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:40.615+0000 7ff562b48700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff55c100770 0x7ff55c19ce70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:12:40.659 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:40.615+0000 7ff562b48700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff55c19d440 con 0x7ff55c0ffdc0 2023-07-14T18:12:40.659 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:40.615+0000 7ff562b48700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff55c19d580 con 0x7ff55c100770 2023-07-14T18:12:40.659 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:40.615+0000 7ff562b48700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff55c19d710 con 0x7ff55c0feb30 2023-07-14T18:12:40.659 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:40.615+0000 7ff55bfff700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff55c0ffdc0 0x7ff55c195e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:12:40.659 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:40.615+0000 7ff55bfff700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff55c0ffdc0 0x7ff55c195e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:57412/0 (socket says 172.21.15.163:57412) 2023-07-14T18:12:40.659 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:40.615+0000 7ff55bfff700 1 -- 172.21.15.163:0/2353231078 learned_addr learned my addr 172.21.15.163:0/2353231078 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:12:40.660 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:40.616+0000 7ff5608e4700 1 --2- 172.21.15.163:0/2353231078 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff55c0feb30 0x7ff55c1958c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:12:40.660 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:40.616+0000 7ff5610e5700 1 --2- 172.21.15.163:0/2353231078 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff55c100770 0x7ff55c19ce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:12:40.660 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:40.616+0000 7ff55bfff700 1 -- 172.21.15.163:0/2353231078 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff55c0feb30 msgr2=0x7ff55c1958c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:12:40.660 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:40.616+0000 7ff55bfff700 1 --2- 172.21.15.163:0/2353231078 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff55c0feb30 0x7ff55c1958c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:40.660 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:40.616+0000 7ff55bfff700 1 -- 172.21.15.163:0/2353231078 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff55c100770 msgr2=0x7ff55c19ce70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:12:40.660 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:40.616+0000 7ff55bfff700 1 --2- 172.21.15.163:0/2353231078 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff55c100770 0x7ff55c19ce70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:40.660 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:40.616+0000 7ff55bfff700 1 -- 172.21.15.163:0/2353231078 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5500095f0 con 0x7ff55c0ffdc0 2023-07-14T18:12:40.660 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:40.616+0000 7ff55bfff700 1 --2- 172.21.15.163:0/2353231078 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff55c0ffdc0 0x7ff55c195e00 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7ff54800d950 tx=0x7ff54800dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:12:40.661 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:40.616+0000 7ff559ffb700 1 -- 172.21.15.163:0/2353231078 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff548009940 con 0x7ff55c0ffdc0 2023-07-14T18:12:40.661 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:40.616+0000 7ff559ffb700 1 -- 172.21.15.163:0/2353231078 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ff548010460 con 0x7ff55c0ffdc0 2023-07-14T18:12:40.661 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:40.616+0000 7ff562b48700 1 -- 172.21.15.163:0/2353231078 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff55c19d9f0 con 0x7ff55c0ffdc0 2023-07-14T18:12:40.661 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:40.616+0000 7ff559ffb700 1 -- 172.21.15.163:0/2353231078 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff54800f620 con 0x7ff55c0ffdc0 2023-07-14T18:12:40.661 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:40.616+0000 7ff562b48700 1 -- 172.21.15.163:0/2353231078 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff55c19df00 con 0x7ff55c0ffdc0 2023-07-14T18:12:40.661 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:40.617+0000 7ff562b48700 1 -- 172.21.15.163:0/2353231078 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff55c10a1b0 con 0x7ff55c0ffdc0 2023-07-14T18:12:40.662 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:40.619+0000 7ff559ffb700 1 -- 172.21.15.163:0/2353231078 <== mon.0 v2:172.21.15.163:3300/0 4 ==== mgrmap(e 17) v1 ==== 135767+0+0 (secure 0 0 0) 0x7ff5480105d0 con 0x7ff55c0ffdc0 2023-07-14T18:12:40.662 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:40.619+0000 7ff559ffb700 1 --2- 172.21.15.163:0/2353231078 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7ff54c0a11e0 0x7ff54c0a3690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:12:40.662 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:40.620+0000 7ff5608e4700 1 --2- 172.21.15.163:0/2353231078 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7ff54c0a11e0 0x7ff54c0a3690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:12:40.662 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:40.620+0000 7ff559ffb700 1 -- 172.21.15.163:0/2353231078 <== mon.0 v2:172.21.15.163:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 9020+0+0 (secure 0 0 0) 0x7ff5480ccc70 con 0x7ff55c0ffdc0 2023-07-14T18:12:40.663 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:40.620+0000 7ff5608e4700 1 --2- 172.21.15.163:0/2353231078 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7ff54c0a11e0 0x7ff54c0a3690 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7ff55000b5c0 tx=0x7ff550005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:12:40.663 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:40.623+0000 7ff559ffb700 1 -- 172.21.15.163:0/2353231078 <== mon.0 v2:172.21.15.163:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178025 (secure 0 0 0) 0x7ff548095ef0 con 0x7ff55c0ffdc0 2023-07-14T18:12:40.856 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:40.816+0000 7ff562b48700 1 -- 172.21.15.163:0/2353231078 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7ff55c19e510 con 0x7ff55c0ffdc0 2023-07-14T18:12:40.857 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:40.816+0000 7ff559ffb700 1 -- 172.21.15.163:0/2353231078 <== mon.0 v2:172.21.15.163:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v86) v1 ==== 100+0+11 (secure 0 0 0) 0x7ff5480200a0 con 0x7ff55c0ffdc0 2023-07-14T18:12:40.857 INFO:teuthology.orchestra.run.smithi163.stdout:pg_num: 64 2023-07-14T18:12:40.859 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:40.818+0000 7ff562b48700 1 -- 172.21.15.163:0/2353231078 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7ff54c0a11e0 msgr2=0x7ff54c0a3690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:12:40.859 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:40.818+0000 7ff562b48700 1 --2- 172.21.15.163:0/2353231078 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7ff54c0a11e0 0x7ff54c0a3690 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7ff55000b5c0 tx=0x7ff550005fb0 comp rx=0 tx=0).stop 2023-07-14T18:12:40.859 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:40.819+0000 7ff562b48700 1 -- 172.21.15.163:0/2353231078 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff55c0ffdc0 msgr2=0x7ff55c195e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:12:40.859 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:40.819+0000 7ff562b48700 1 --2- 172.21.15.163:0/2353231078 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff55c0ffdc0 0x7ff55c195e00 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7ff54800d950 tx=0x7ff54800dc60 comp rx=0 tx=0).stop 2023-07-14T18:12:40.860 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:40.819+0000 7ff562b48700 1 -- 172.21.15.163:0/2353231078 shutdown_connections 2023-07-14T18:12:40.860 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:40.819+0000 7ff562b48700 1 --2- 172.21.15.163:0/2353231078 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7ff54c0a11e0 0x7ff54c0a3690 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:40.860 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:40.819+0000 7ff562b48700 1 --2- 172.21.15.163:0/2353231078 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff55c0feb30 0x7ff55c1958c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:40.860 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:40.819+0000 7ff562b48700 1 --2- 172.21.15.163:0/2353231078 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff55c100770 0x7ff55c19ce70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:40.860 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:40.819+0000 7ff562b48700 1 --2- 172.21.15.163:0/2353231078 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff55c0ffdc0 0x7ff55c195e00 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:40.860 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:40.819+0000 7ff562b48700 1 -- 172.21.15.163:0/2353231078 >> 172.21.15.163:0/2353231078 conn(0x7ff55c0fa150 msgr2=0x7ff55c068950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:12:40.860 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:40.819+0000 7ff562b48700 1 -- 172.21.15.163:0/2353231078 shutdown_connections 2023-07-14T18:12:40.860 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:40.819+0000 7ff562b48700 1 -- 172.21.15.163:0/2353231078 wait complete. 2023-07-14T18:12:40.871 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-07-14T18:12:40.997 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:40.956+0000 7fd2ddbc3700 1 -- 172.21.15.163:0/4282180555 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fd2d81017f0 msgr2=0x7fd2d81080b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:12:40.997 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:40.956+0000 7fd2ddbc3700 1 --2- 172.21.15.163:0/4282180555 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fd2d81017f0 0x7fd2d81080b0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7fd2d000b0a0 tx=0x7fd2d000b3b0 comp rx=0 tx=0).stop 2023-07-14T18:12:40.997 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:40.956+0000 7fd2ddbc3700 1 -- 172.21.15.163:0/4282180555 shutdown_connections 2023-07-14T18:12:40.997 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:40.956+0000 7fd2ddbc3700 1 --2- 172.21.15.163:0/4282180555 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fd2d81017f0 0x7fd2d81080b0 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:40.997 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:40.956+0000 7fd2ddbc3700 1 --2- 172.21.15.163:0/4282180555 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd2d80ffc70 0x7fd2d8100080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:40.997 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:40.956+0000 7fd2ddbc3700 1 --2- 172.21.15.163:0/4282180555 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd2d8100e60 0x7fd2d81012b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:40.998 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:40.956+0000 7fd2ddbc3700 1 -- 172.21.15.163:0/4282180555 >> 172.21.15.163:0/4282180555 conn(0x7fd2d80fb290 msgr2=0x7fd2d80fd6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:12:40.998 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:40.956+0000 7fd2ddbc3700 1 -- 172.21.15.163:0/4282180555 shutdown_connections 2023-07-14T18:12:40.998 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:40.956+0000 7fd2ddbc3700 1 -- 172.21.15.163:0/4282180555 wait complete. 2023-07-14T18:12:40.998 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:40.957+0000 7fd2ddbc3700 1 Processor -- start 2023-07-14T18:12:41.000 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:40.957+0000 7fd2ddbc3700 1 -- start start 2023-07-14T18:12:41.000 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:40.957+0000 7fd2ddbc3700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd2d80ffc70 0x7fd2d8197ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:12:41.000 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:40.957+0000 7fd2ddbc3700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fd2d8100e60 0x7fd2d8198010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:12:41.000 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:40.957+0000 7fd2ddbc3700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd2d81017f0 0x7fd2d819f080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:12:41.000 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:40.957+0000 7fd2ddbc3700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2d819f650 con 0x7fd2d8100e60 2023-07-14T18:12:41.000 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:40.957+0000 7fd2ddbc3700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2d819f790 con 0x7fd2d80ffc70 2023-07-14T18:12:41.001 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:40.957+0000 7fd2ddbc3700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2d819f920 con 0x7fd2d81017f0 2023-07-14T18:12:41.001 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:40.957+0000 7fd2d6ffd700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fd2d8100e60 0x7fd2d8198010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:12:41.001 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:40.957+0000 7fd2d6ffd700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fd2d8100e60 0x7fd2d8198010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:57426/0 (socket says 172.21.15.163:57426) 2023-07-14T18:12:41.001 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:40.957+0000 7fd2d6ffd700 1 -- 172.21.15.163:0/1864866315 learned_addr learned my addr 172.21.15.163:0/1864866315 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:12:41.001 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:40.957+0000 7fd2d7fff700 1 --2- 172.21.15.163:0/1864866315 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd2d81017f0 0x7fd2d819f080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:12:41.001 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:40.957+0000 7fd2d77fe700 1 --2- 172.21.15.163:0/1864866315 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd2d80ffc70 0x7fd2d8197ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:12:41.001 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:40.957+0000 7fd2d6ffd700 1 -- 172.21.15.163:0/1864866315 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd2d81017f0 msgr2=0x7fd2d819f080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:12:41.002 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:40.957+0000 7fd2d6ffd700 1 --2- 172.21.15.163:0/1864866315 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd2d81017f0 0x7fd2d819f080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:41.002 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:40.957+0000 7fd2d6ffd700 1 -- 172.21.15.163:0/1864866315 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd2d80ffc70 msgr2=0x7fd2d8197ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:12:41.002 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:40.957+0000 7fd2d6ffd700 1 --2- 172.21.15.163:0/1864866315 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd2d80ffc70 0x7fd2d8197ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:41.002 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:40.957+0000 7fd2d6ffd700 1 -- 172.21.15.163:0/1864866315 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2d0009d00 con 0x7fd2d8100e60 2023-07-14T18:12:41.002 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:40.957+0000 7fd2d77fe700 1 --2- 172.21.15.163:0/1864866315 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd2d80ffc70 0x7fd2d8197ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T18:12:41.002 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:40.957+0000 7fd2d6ffd700 1 --2- 172.21.15.163:0/1864866315 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fd2d8100e60 0x7fd2d8198010 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7fd2c800d950 tx=0x7fd2c800dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:12:41.002 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:40.958+0000 7fd2d4ff9700 1 -- 172.21.15.163:0/1864866315 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2c8009940 con 0x7fd2d8100e60 2023-07-14T18:12:41.002 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:40.958+0000 7fd2d4ff9700 1 -- 172.21.15.163:0/1864866315 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fd2c8010460 con 0x7fd2d8100e60 2023-07-14T18:12:41.003 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:40.958+0000 7fd2ddbc3700 1 -- 172.21.15.163:0/1864866315 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd2d819fc00 con 0x7fd2d8100e60 2023-07-14T18:12:41.003 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:40.958+0000 7fd2d4ff9700 1 -- 172.21.15.163:0/1864866315 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2c800f620 con 0x7fd2d8100e60 2023-07-14T18:12:41.003 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:40.958+0000 7fd2ddbc3700 1 -- 172.21.15.163:0/1864866315 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2d81a0110 con 0x7fd2d8100e60 2023-07-14T18:12:41.003 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:40.959+0000 7fd2ddbc3700 1 -- 172.21.15.163:0/1864866315 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd2d810b290 con 0x7fd2d8100e60 2023-07-14T18:12:41.004 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:40.960+0000 7fd2d4ff9700 1 -- 172.21.15.163:0/1864866315 <== mon.0 v2:172.21.15.163:3300/0 4 ==== mgrmap(e 17) v1 ==== 135767+0+0 (secure 0 0 0) 0x7fd2c80105d0 con 0x7fd2d8100e60 2023-07-14T18:12:41.004 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:40.961+0000 7fd2d4ff9700 1 --2- 172.21.15.163:0/1864866315 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7fd2c00a11e0 0x7fd2c00a3690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:12:41.004 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:40.961+0000 7fd2d4ff9700 1 -- 172.21.15.163:0/1864866315 <== mon.0 v2:172.21.15.163:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 9020+0+0 (secure 0 0 0) 0x7fd2c80ccc10 con 0x7fd2d8100e60 2023-07-14T18:12:41.004 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:40.961+0000 7fd2d77fe700 1 --2- 172.21.15.163:0/1864866315 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7fd2c00a11e0 0x7fd2c00a3690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:12:41.004 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:40.962+0000 7fd2d77fe700 1 --2- 172.21.15.163:0/1864866315 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7fd2c00a11e0 0x7fd2c00a3690 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fd2d8100cc0 tx=0x7fd2cc00a680 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:12:41.005 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:40.965+0000 7fd2d4ff9700 1 -- 172.21.15.163:0/1864866315 <== mon.0 v2:172.21.15.163:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178025 (secure 0 0 0) 0x7fd2c8095ef0 con 0x7fd2d8100e60 2023-07-14T18:12:41.175 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:12:40 smithi184 ceph-mon[98481]: pgmap v298: 129 pgs: 129 active+clean; 643 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-07-14T18:12:41.175 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:12:40 smithi184 ceph-mon[98481]: from='client.? 172.21.15.163:0/1496913470' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-07-14T18:12:41.176 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:12:40 smithi184 ceph-mon[98481]: from='client.? 172.21.15.163:0/2113463585' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-07-14T18:12:41.176 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:12:40 smithi184 ceph-mon[98481]: from='client.? 172.21.15.163:0/85403331' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-07-14T18:12:41.191 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:41.151+0000 7fd2ddbc3700 1 -- 172.21.15.163:0/1864866315 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fd2d81a06c0 con 0x7fd2d8100e60 2023-07-14T18:12:41.191 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:41.151+0000 7fd2d4ff9700 1 -- 172.21.15.163:0/1864866315 <== mon.0 v2:172.21.15.163:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v86) v1 ==== 103+0+11 (secure 0 0 0) 0x7fd2c80200a0 con 0x7fd2d8100e60 2023-07-14T18:12:41.192 INFO:teuthology.orchestra.run.smithi163.stdout:pg_num: 32 2023-07-14T18:12:41.193 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:41.153+0000 7fd2ddbc3700 1 -- 172.21.15.163:0/1864866315 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7fd2c00a11e0 msgr2=0x7fd2c00a3690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:12:41.194 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:41.153+0000 7fd2ddbc3700 1 --2- 172.21.15.163:0/1864866315 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7fd2c00a11e0 0x7fd2c00a3690 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fd2d8100cc0 tx=0x7fd2cc00a680 comp rx=0 tx=0).stop 2023-07-14T18:12:41.194 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:41.153+0000 7fd2ddbc3700 1 -- 172.21.15.163:0/1864866315 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fd2d8100e60 msgr2=0x7fd2d8198010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:12:41.194 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:41.153+0000 7fd2ddbc3700 1 --2- 172.21.15.163:0/1864866315 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fd2d8100e60 0x7fd2d8198010 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7fd2c800d950 tx=0x7fd2c800dc60 comp rx=0 tx=0).stop 2023-07-14T18:12:41.194 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:41.153+0000 7fd2ddbc3700 1 -- 172.21.15.163:0/1864866315 shutdown_connections 2023-07-14T18:12:41.194 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:41.153+0000 7fd2ddbc3700 1 --2- 172.21.15.163:0/1864866315 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7fd2c00a11e0 0x7fd2c00a3690 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:41.194 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:41.153+0000 7fd2ddbc3700 1 --2- 172.21.15.163:0/1864866315 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd2d81017f0 0x7fd2d819f080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:41.194 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:41.153+0000 7fd2ddbc3700 1 --2- 172.21.15.163:0/1864866315 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd2d80ffc70 0x7fd2d8197ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:41.195 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:41.153+0000 7fd2ddbc3700 1 --2- 172.21.15.163:0/1864866315 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fd2d8100e60 0x7fd2d8198010 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:41.195 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:41.153+0000 7fd2ddbc3700 1 -- 172.21.15.163:0/1864866315 >> 172.21.15.163:0/1864866315 conn(0x7fd2d80fb290 msgr2=0x7fd2d80fd410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:12:41.195 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:41.153+0000 7fd2ddbc3700 1 -- 172.21.15.163:0/1864866315 shutdown_connections 2023-07-14T18:12:41.195 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:41.153+0000 7fd2ddbc3700 1 -- 172.21.15.163:0/1864866315 wait complete. 2023-07-14T18:12:41.205 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:12:40 smithi163 ceph-mon[96576]: pgmap v298: 129 pgs: 129 active+clean; 643 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-07-14T18:12:41.205 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:12:40 smithi163 ceph-mon[96576]: from='client.? 172.21.15.163:0/1496913470' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-07-14T18:12:41.205 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:12:40 smithi163 ceph-mon[96576]: from='client.? 172.21.15.163:0/2113463585' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-07-14T18:12:41.205 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:12:40 smithi163 ceph-mon[96576]: from='client.? 172.21.15.163:0/85403331' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-07-14T18:12:41.206 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-14T18:12:41.276 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:12:40 smithi172 ceph-mon[97983]: pgmap v298: 129 pgs: 129 active+clean; 643 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-07-14T18:12:41.276 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:12:40 smithi172 ceph-mon[97983]: from='client.? 172.21.15.163:0/1496913470' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-07-14T18:12:41.276 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:12:40 smithi172 ceph-mon[97983]: from='client.? 172.21.15.163:0/2113463585' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-07-14T18:12:41.276 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:12:40 smithi172 ceph-mon[97983]: from='client.? 172.21.15.163:0/85403331' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-07-14T18:12:41.328 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:41.287+0000 7f3581089700 1 -- 172.21.15.163:0/3829764270 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f357c100680 msgr2=0x7f357c106f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:12:41.328 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:41.287+0000 7f3581089700 1 --2- 172.21.15.163:0/3829764270 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f357c100680 0x7f357c106f40 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f357400b0a0 tx=0x7f357400b3b0 comp rx=0 tx=0).stop 2023-07-14T18:12:41.328 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:41.287+0000 7f3581089700 1 -- 172.21.15.163:0/3829764270 shutdown_connections 2023-07-14T18:12:41.328 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:41.287+0000 7f3581089700 1 --2- 172.21.15.163:0/3829764270 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f357c0feb00 0x7f357c0fef10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:41.328 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:41.287+0000 7f3581089700 1 --2- 172.21.15.163:0/3829764270 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f357c100680 0x7f357c106f40 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:41.329 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:41.287+0000 7f3581089700 1 --2- 172.21.15.163:0/3829764270 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f357c0ffcf0 0x7f357c100140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:41.329 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:41.287+0000 7f3581089700 1 -- 172.21.15.163:0/3829764270 >> 172.21.15.163:0/3829764270 conn(0x7f357c0fa100 msgr2=0x7f357c0fc550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:12:41.329 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:41.287+0000 7f3581089700 1 -- 172.21.15.163:0/3829764270 shutdown_connections 2023-07-14T18:12:41.329 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:41.287+0000 7f3581089700 1 -- 172.21.15.163:0/3829764270 wait complete. 2023-07-14T18:12:41.331 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:41.288+0000 7f3581089700 1 Processor -- start 2023-07-14T18:12:41.331 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:41.288+0000 7f3581089700 1 -- start start 2023-07-14T18:12:41.331 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:41.288+0000 7f3581089700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f357c0feb00 0x7f357c195860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:12:41.331 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:41.288+0000 7f3581089700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f357c0ffcf0 0x7f357c195da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:12:41.331 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:41.288+0000 7f3581089700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f357c100680 0x7f357c19ce10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:12:41.331 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:41.288+0000 7f3581089700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f357c19d3e0 con 0x7f357c0feb00 2023-07-14T18:12:41.331 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:41.288+0000 7f3581089700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f357c19d520 con 0x7f357c0ffcf0 2023-07-14T18:12:41.332 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:41.288+0000 7f3581089700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f357c19d6b0 con 0x7f357c100680 2023-07-14T18:12:41.332 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:41.288+0000 7f357ad9d700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f357c0feb00 0x7f357c195860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:12:41.332 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:41.288+0000 7f357ad9d700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f357c0feb00 0x7f357c195860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:57438/0 (socket says 172.21.15.163:57438) 2023-07-14T18:12:41.332 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:41.288+0000 7f357ad9d700 1 -- 172.21.15.163:0/1831197290 learned_addr learned my addr 172.21.15.163:0/1831197290 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:12:41.332 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:41.289+0000 7f357b59e700 1 --2- 172.21.15.163:0/1831197290 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f357c100680 0x7f357c19ce10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:12:41.332 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:41.289+0000 7f357a59c700 1 --2- 172.21.15.163:0/1831197290 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f357c0ffcf0 0x7f357c195da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:12:41.332 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:41.289+0000 7f357ad9d700 1 -- 172.21.15.163:0/1831197290 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f357c100680 msgr2=0x7f357c19ce10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:12:41.333 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:41.289+0000 7f357ad9d700 1 --2- 172.21.15.163:0/1831197290 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f357c100680 0x7f357c19ce10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:41.333 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:41.289+0000 7f357ad9d700 1 -- 172.21.15.163:0/1831197290 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f357c0ffcf0 msgr2=0x7f357c195da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:12:41.333 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:41.289+0000 7f357ad9d700 1 --2- 172.21.15.163:0/1831197290 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f357c0ffcf0 0x7f357c195da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:41.333 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:41.289+0000 7f357ad9d700 1 -- 172.21.15.163:0/1831197290 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3574009d00 con 0x7f357c0feb00 2023-07-14T18:12:41.333 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:41.289+0000 7f357a59c700 1 --2- 172.21.15.163:0/1831197290 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f357c0ffcf0 0x7f357c195da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T18:12:41.333 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:41.289+0000 7f357ad9d700 1 --2- 172.21.15.163:0/1831197290 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f357c0feb00 0x7f357c195860 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f356c00c990 tx=0x7f356c00cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:12:41.333 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:41.289+0000 7f3563fff700 1 -- 172.21.15.163:0/1831197290 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f356c007b00 con 0x7f357c0feb00 2023-07-14T18:12:41.333 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:41.289+0000 7f3563fff700 1 -- 172.21.15.163:0/1831197290 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f356c007c60 con 0x7f357c0feb00 2023-07-14T18:12:41.334 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:41.289+0000 7f3581089700 1 -- 172.21.15.163:0/1831197290 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f357c19d990 con 0x7f357c0feb00 2023-07-14T18:12:41.334 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:41.289+0000 7f3563fff700 1 -- 172.21.15.163:0/1831197290 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f356c018660 con 0x7f357c0feb00 2023-07-14T18:12:41.334 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:41.289+0000 7f3581089700 1 -- 172.21.15.163:0/1831197290 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f357c19dea0 con 0x7f357c0feb00 2023-07-14T18:12:41.334 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:41.290+0000 7f3581089700 1 -- 172.21.15.163:0/1831197290 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f357c10a190 con 0x7f357c0feb00 2023-07-14T18:12:41.335 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:41.291+0000 7f3563fff700 1 -- 172.21.15.163:0/1831197290 <== mon.0 v2:172.21.15.163:3300/0 4 ==== mgrmap(e 17) v1 ==== 135767+0+0 (secure 0 0 0) 0x7f356c00f450 con 0x7f357c0feb00 2023-07-14T18:12:41.335 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:41.291+0000 7f3563fff700 1 --2- 172.21.15.163:0/1831197290 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f35640a1220 0x7f35640a36d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:12:41.335 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:41.292+0000 7f357a59c700 1 --2- 172.21.15.163:0/1831197290 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f35640a1220 0x7f35640a36d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:12:41.335 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:41.292+0000 7f3563fff700 1 -- 172.21.15.163:0/1831197290 <== mon.0 v2:172.21.15.163:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 9020+0+0 (secure 0 0 0) 0x7f356c0cce10 con 0x7f357c0feb00 2023-07-14T18:12:41.335 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:41.292+0000 7f357a59c700 1 --2- 172.21.15.163:0/1831197290 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f35640a1220 0x7f35640a36d0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f3570009be0 tx=0x7f3570009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:12:41.336 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:41.296+0000 7f3563fff700 1 -- 172.21.15.163:0/1831197290 <== mon.0 v2:172.21.15.163:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178025 (secure 0 0 0) 0x7f356c0960f0 con 0x7f357c0feb00 2023-07-14T18:12:41.568 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:41.528+0000 7f3581089700 1 -- 172.21.15.163:0/1831197290 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f357c19e510 con 0x7f357c0feb00 2023-07-14T18:12:41.569 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:41.529+0000 7f3563fff700 1 -- 172.21.15.163:0/1831197290 <== mon.0 v2:172.21.15.163:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) v1 ==== 94+0+10899 (secure 0 0 0) 0x7f356c099710 con 0x7f357c0feb00 2023-07-14T18:12:41.569 INFO:teuthology.orchestra.run.smithi163.stdout: 2023-07-14T18:12:41.570 INFO:teuthology.orchestra.run.smithi163.stdout:{"epoch":28,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14562,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.163:6835/1058662632","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6834","nonce":1058662632},{"type":"v1","addr":"172.21.15.163:6835","nonce":1058662632}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":14568,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.163:6837/1107244425","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6836","nonce":1107244425},{"type":"v1","addr":"172.21.15.163:6837","nonce":1107244425}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":28,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-07-14T18:11:09.109693+0000","modified":"2023-07-14T18:11:31.766338+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24518,"mds_1":24493,"mds_2":24479,"mds_3":24478,"mds_4":14652},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14640":{"gid":14640,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.163:6839/1337572937","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6838","nonce":1337572937},{"type":"v1","addr":"172.21.15.163:6839","nonce":1337572937}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_14652":{"gid":14652,"name":"a","rank":4,"incarnation":26,"state":"up:active","state_seq":9,"addr":"172.21.15.163:6841/1032082642","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6840","nonce":1032082642},{"type":"v1","addr":"172.21.15.163:6841","nonce":1032082642}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24421":{"gid":24421,"name":"l","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.184:6833/797722972","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6832","nonce":797722972},{"type":"v1","addr":"172.21.15.184:6833","nonce":797722972}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24431":{"gid":24431,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6833/1075696311","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":1075696311},{"type":"v1","addr":"172.21.15.172:6833","nonce":1075696311}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24458":{"gid":24458,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6835/1158120127","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":1158120127},{"type":"v1","addr":"172.21.15.172:6835","nonce":1158120127}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24466":{"gid":24466,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.184:6835/460134263","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6834","nonce":460134263},{"type":"v1","addr":"172.21.15.184:6835","nonce":460134263}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24478":{"gid":24478,"name":"c","rank":3,"incarnation":24,"state":"up:active","state_seq":11,"addr":"172.21.15.184:6837/3389277679","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6836","nonce":3389277679},{"type":"v1","addr":"172.21.15.184:6837","nonce":3389277679}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24479":{"gid":24479,"name":"h","rank":2,"incarnation":22,"state":"up:active","state_seq":10,"addr":"172.21.15.172:6837/3783835012","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":3783835012},{"type":"v1","addr":"172.21.15.172:6837","nonce":3783835012}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24493":{"gid":24493,"name":"i","rank":1,"incarnation":20,"state":"up:active","state_seq":9,"addr":"172.21.15.184:6839/2819059257","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6838","nonce":2819059257},{"type":"v1","addr":"172.21.15.184:6839","nonce":2819059257}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24518":{"gid":24518,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.172:6839/3850440096","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6838","nonce":3850440096},{"type":"v1","addr":"172.21.15.172:6839","nonce":3850440096}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-07-14T18:12:41.571 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:41.531+0000 7f3581089700 1 -- 172.21.15.163:0/1831197290 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f35640a1220 msgr2=0x7f35640a36d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:12:41.571 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:41.531+0000 7f3581089700 1 --2- 172.21.15.163:0/1831197290 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f35640a1220 0x7f35640a36d0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f3570009be0 tx=0x7f3570009260 comp rx=0 tx=0).stop 2023-07-14T18:12:41.572 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:41.531+0000 7f3581089700 1 -- 172.21.15.163:0/1831197290 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f357c0feb00 msgr2=0x7f357c195860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:12:41.572 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:41.531+0000 7f3581089700 1 --2- 172.21.15.163:0/1831197290 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f357c0feb00 0x7f357c195860 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f356c00c990 tx=0x7f356c00cd50 comp rx=0 tx=0).stop 2023-07-14T18:12:41.572 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:41.531+0000 7f3581089700 1 -- 172.21.15.163:0/1831197290 shutdown_connections 2023-07-14T18:12:41.572 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:41.531+0000 7f3581089700 1 --2- 172.21.15.163:0/1831197290 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f35640a1220 0x7f35640a36d0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:41.572 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:41.531+0000 7f3581089700 1 --2- 172.21.15.163:0/1831197290 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f357c100680 0x7f357c19ce10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:41.572 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:41.531+0000 7f3581089700 1 --2- 172.21.15.163:0/1831197290 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f357c0feb00 0x7f357c195860 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:41.572 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:41.531+0000 7f3581089700 1 --2- 172.21.15.163:0/1831197290 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f357c0ffcf0 0x7f357c195da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:41.573 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:41.531+0000 7f3581089700 1 -- 172.21.15.163:0/1831197290 >> 172.21.15.163:0/1831197290 conn(0x7f357c0fa100 msgr2=0x7f357c067820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:12:41.573 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:41.531+0000 7f3581089700 1 -- 172.21.15.163:0/1831197290 shutdown_connections 2023-07-14T18:12:41.573 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:41.531+0000 7f3581089700 1 -- 172.21.15.163:0/1831197290 wait complete. 2023-07-14T18:12:41.573 INFO:teuthology.orchestra.run.smithi163.stderr:dumped fsmap epoch 28 2023-07-14T18:12:41.584 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-14T18:12:41.706 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:41.666+0000 7fece178a700 1 -- 172.21.15.163:0/3104886244 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fecdc100e20 msgr2=0x7fecdc101270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:12:41.707 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:41.666+0000 7fece178a700 1 --2- 172.21.15.163:0/3104886244 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fecdc100e20 0x7fecdc101270 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7feccc009990 tx=0x7feccc009ca0 comp rx=0 tx=0).stop 2023-07-14T18:12:41.707 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:41.666+0000 7fece178a700 1 -- 172.21.15.163:0/3104886244 shutdown_connections 2023-07-14T18:12:41.707 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:41.666+0000 7fece178a700 1 --2- 172.21.15.163:0/3104886244 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fecdc0ffc30 0x7fecdc100040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:41.707 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:41.666+0000 7fece178a700 1 --2- 172.21.15.163:0/3104886244 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fecdc1017b0 0x7fecdc108070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:41.707 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:41.666+0000 7fece178a700 1 --2- 172.21.15.163:0/3104886244 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fecdc100e20 0x7fecdc101270 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:41.707 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:41.666+0000 7fece178a700 1 -- 172.21.15.163:0/3104886244 >> 172.21.15.163:0/3104886244 conn(0x7fecdc0fb210 msgr2=0x7fecdc0fd680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:12:41.707 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:41.666+0000 7fece178a700 1 -- 172.21.15.163:0/3104886244 shutdown_connections 2023-07-14T18:12:41.708 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:41.666+0000 7fece178a700 1 -- 172.21.15.163:0/3104886244 wait complete. 2023-07-14T18:12:41.708 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:41.666+0000 7fece178a700 1 Processor -- start 2023-07-14T18:12:41.709 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:41.667+0000 7fece178a700 1 -- start start 2023-07-14T18:12:41.710 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:41.667+0000 7fece178a700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fecdc0ffc30 0x7fecdc195820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:12:41.710 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:41.667+0000 7fece178a700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fecdc100e20 0x7fecdc195d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:12:41.710 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:41.667+0000 7fece178a700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fecdc1017b0 0x7fecdc19cdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:12:41.710 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:41.667+0000 7fece178a700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecdc19d3a0 con 0x7fecdc0ffc30 2023-07-14T18:12:41.710 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:41.667+0000 7fece178a700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecdc19d4e0 con 0x7fecdc1017b0 2023-07-14T18:12:41.710 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:41.667+0000 7fece178a700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecdc19d670 con 0x7fecdc100e20 2023-07-14T18:12:41.710 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:41.667+0000 7fecdaffd700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fecdc0ffc30 0x7fecdc195820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:12:41.711 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:41.667+0000 7fecdaffd700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fecdc0ffc30 0x7fecdc195820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:57452/0 (socket says 172.21.15.163:57452) 2023-07-14T18:12:41.711 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:41.667+0000 7fecdaffd700 1 -- 172.21.15.163:0/3242121750 learned_addr learned my addr 172.21.15.163:0/3242121750 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:12:41.711 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:41.667+0000 7fecda7fc700 1 --2- 172.21.15.163:0/3242121750 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fecdc100e20 0x7fecdc195d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:12:41.711 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:41.667+0000 7fecdb7fe700 1 --2- 172.21.15.163:0/3242121750 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fecdc1017b0 0x7fecdc19cdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:12:41.711 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:41.667+0000 7fecdaffd700 1 -- 172.21.15.163:0/3242121750 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fecdc100e20 msgr2=0x7fecdc195d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:12:41.711 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:41.667+0000 7fecdaffd700 1 --2- 172.21.15.163:0/3242121750 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fecdc100e20 0x7fecdc195d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:41.711 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:41.667+0000 7fecdaffd700 1 -- 172.21.15.163:0/3242121750 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fecdc1017b0 msgr2=0x7fecdc19cdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:12:41.711 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:41.667+0000 7fecdaffd700 1 --2- 172.21.15.163:0/3242121750 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fecdc1017b0 0x7fecdc19cdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:41.712 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:41.667+0000 7fecdaffd700 1 -- 172.21.15.163:0/3242121750 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feccc0095f0 con 0x7fecdc0ffc30 2023-07-14T18:12:41.712 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:41.667+0000 7fecdaffd700 1 --2- 172.21.15.163:0/3242121750 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fecdc0ffc30 0x7fecdc195820 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7fecd000d980 tx=0x7fecd000dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:12:41.712 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:41.667+0000 7fecc3fff700 1 -- 172.21.15.163:0/3242121750 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecd0004020 con 0x7fecdc0ffc30 2023-07-14T18:12:41.712 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:41.668+0000 7fece178a700 1 -- 172.21.15.163:0/3242121750 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fecdc19d950 con 0x7fecdc0ffc30 2023-07-14T18:12:41.712 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:41.668+0000 7fecc3fff700 1 -- 172.21.15.163:0/3242121750 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fecd000f690 con 0x7fecdc0ffc30 2023-07-14T18:12:41.712 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:41.668+0000 7fecc3fff700 1 -- 172.21.15.163:0/3242121750 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecd00039e0 con 0x7fecdc0ffc30 2023-07-14T18:12:41.712 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:41.668+0000 7fece178a700 1 -- 172.21.15.163:0/3242121750 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fecdc19de60 con 0x7fecdc0ffc30 2023-07-14T18:12:41.713 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:41.668+0000 7fece178a700 1 -- 172.21.15.163:0/3242121750 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fecdc107120 con 0x7fecdc0ffc30 2023-07-14T18:12:41.713 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:41.670+0000 7fecc3fff700 1 -- 172.21.15.163:0/3242121750 <== mon.0 v2:172.21.15.163:3300/0 4 ==== mgrmap(e 17) v1 ==== 135767+0+0 (secure 0 0 0) 0x7fecd000f800 con 0x7fecdc0ffc30 2023-07-14T18:12:41.713 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:41.670+0000 7fecc3fff700 1 --2- 172.21.15.163:0/3242121750 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7fecc40a1220 0x7fecc40a36d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:12:41.714 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:41.670+0000 7fecda7fc700 1 --2- 172.21.15.163:0/3242121750 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7fecc40a1220 0x7fecc40a36d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:12:41.714 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:41.670+0000 7fecc3fff700 1 -- 172.21.15.163:0/3242121750 <== mon.0 v2:172.21.15.163:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 9020+0+0 (secure 0 0 0) 0x7fecd00cccf0 con 0x7fecdc0ffc30 2023-07-14T18:12:41.714 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:41.671+0000 7fecda7fc700 1 --2- 172.21.15.163:0/3242121750 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7fecc40a1220 0x7fecc40a36d0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7feccc00c010 tx=0x7feccc005960 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:12:41.714 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:41.674+0000 7fecc3fff700 1 -- 172.21.15.163:0/3242121750 <== mon.0 v2:172.21.15.163:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178025 (secure 0 0 0) 0x7fecd0095fd0 con 0x7fecdc0ffc30 2023-07-14T18:12:41.909 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:41.869+0000 7fece178a700 1 -- 172.21.15.163:0/3242121750 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fecdc02cb10 con 0x7fecdc0ffc30 2023-07-14T18:12:41.910 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:41.870+0000 7fecc3fff700 1 -- 172.21.15.163:0/3242121750 <== mon.0 v2:172.21.15.163:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v86) v1 ==== 74+0+24500 (secure 0 0 0) 0x7fecd00995f0 con 0x7fecdc0ffc30 2023-07-14T18:12:41.911 INFO:teuthology.orchestra.run.smithi163.stdout: 2023-07-14T18:12:41.911 INFO:teuthology.orchestra.run.smithi163.stdout:{"epoch":86,"fsid":"bf7326ec-2270-11ee-9b33-001a4aab830c","created":"2023-07-14T18:04:26.263517+0000","modified":"2023-07-14T18:12:16.776609+0000","last_up_change":"2023-07-14T18:10:27.514863+0000","last_in_change":"2023-07-14T18:10:10.726443+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-14T18:07:19.653852+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-07-14T18:11:07.314989+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-07-14T18:11:08.274627+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-07-14T18:11:11.991162+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"e6490568-046d-43ef-bb07-d79fb884b276","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6802","nonce":3124653025},{"type":"v1","addr":"172.21.15.163:6803","nonce":3124653025}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6804","nonce":3124653025},{"type":"v1","addr":"172.21.15.163:6805","nonce":3124653025}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6808","nonce":3124653025},{"type":"v1","addr":"172.21.15.163:6809","nonce":3124653025}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6806","nonce":3124653025},{"type":"v1","addr":"172.21.15.163:6807","nonce":3124653025}]},"public_addr":"172.21.15.163:6803/3124653025","cluster_addr":"172.21.15.163:6805/3124653025","heartbeat_back_addr":"172.21.15.163:6809/3124653025","heartbeat_front_addr":"172.21.15.163:6807/3124653025","state":["exists","up"]},{"osd":1,"uuid":"0af39bda-f096-4603-adcc-bf1988f36603","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":3774455900},{"type":"v1","addr":"172.21.15.172:6801","nonce":3774455900}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":3774455900},{"type":"v1","addr":"172.21.15.172:6803","nonce":3774455900}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":3774455900},{"type":"v1","addr":"172.21.15.172:6807","nonce":3774455900}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":3774455900},{"type":"v1","addr":"172.21.15.172:6805","nonce":3774455900}]},"public_addr":"172.21.15.172:6801/3774455900","cluster_addr":"172.21.15.172:6803/3774455900","heartbeat_back_addr":"172.21.15.172:6807/3774455900","heartbeat_front_addr":"172.21.15.172:6805/3774455900","state":["exists","up"]},{"osd":2,"uuid":"cc732c13-af0f-4199-98e6-fe960ed4e5dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":1976927678},{"type":"v1","addr":"172.21.15.184:6801","nonce":1976927678}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":1976927678},{"type":"v1","addr":"172.21.15.184:6803","nonce":1976927678}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":1976927678},{"type":"v1","addr":"172.21.15.184:6807","nonce":1976927678}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":1976927678},{"type":"v1","addr":"172.21.15.184:6805","nonce":1976927678}]},"public_addr":"172.21.15.184:6801/1976927678","cluster_addr":"172.21.15.184:6803/1976927678","heartbeat_back_addr":"172.21.15.184:6807/1976927678","heartbeat_front_addr":"172.21.15.184:6805/1976927678","state":["exists","up"]},{"osd":3,"uuid":"dcee9576-0bc6-4ab0-8f63-79eacd0eca5f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6810","nonce":2589130694},{"type":"v1","addr":"172.21.15.163:6811","nonce":2589130694}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6812","nonce":2589130694},{"type":"v1","addr":"172.21.15.163:6813","nonce":2589130694}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6816","nonce":2589130694},{"type":"v1","addr":"172.21.15.163:6817","nonce":2589130694}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6814","nonce":2589130694},{"type":"v1","addr":"172.21.15.163:6815","nonce":2589130694}]},"public_addr":"172.21.15.163:6811/2589130694","cluster_addr":"172.21.15.163:6813/2589130694","heartbeat_back_addr":"172.21.15.163:6817/2589130694","heartbeat_front_addr":"172.21.15.163:6815/2589130694","state":["exists","up"]},{"osd":4,"uuid":"055df823-b8b0-426a-83c2-f0d727932ad8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":3319632614},{"type":"v1","addr":"172.21.15.172:6809","nonce":3319632614}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6810","nonce":3319632614},{"type":"v1","addr":"172.21.15.172:6811","nonce":3319632614}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6814","nonce":3319632614},{"type":"v1","addr":"172.21.15.172:6815","nonce":3319632614}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":3319632614},{"type":"v1","addr":"172.21.15.172:6813","nonce":3319632614}]},"public_addr":"172.21.15.172:6809/3319632614","cluster_addr":"172.21.15.172:6811/3319632614","heartbeat_back_addr":"172.21.15.172:6815/3319632614","heartbeat_front_addr":"172.21.15.172:6813/3319632614","state":["exists","up"]},{"osd":5,"uuid":"ef5ef02a-b4e2-4790-9d27-f6d2247b25c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":2662084043},{"type":"v1","addr":"172.21.15.184:6809","nonce":2662084043}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6810","nonce":2662084043},{"type":"v1","addr":"172.21.15.184:6811","nonce":2662084043}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6814","nonce":2662084043},{"type":"v1","addr":"172.21.15.184:6815","nonce":2662084043}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6812","nonce":2662084043},{"type":"v1","addr":"172.21.15.184:6813","nonce":2662084043}]},"public_addr":"172.21.15.184:6809/2662084043","cluster_addr":"172.21.15.184:6811/2662084043","heartbeat_back_addr":"172.21.15.184:6815/2662084043","heartbeat_front_addr":"172.21.15.184:6813/2662084043","state":["exists","up"]},{"osd":6,"uuid":"dba754be-0fc5-4867-a6d5-cf97eb344f81","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":44,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6818","nonce":2530874117},{"type":"v1","addr":"172.21.15.163:6819","nonce":2530874117}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6820","nonce":2530874117},{"type":"v1","addr":"172.21.15.163:6821","nonce":2530874117}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6824","nonce":2530874117},{"type":"v1","addr":"172.21.15.163:6825","nonce":2530874117}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6822","nonce":2530874117},{"type":"v1","addr":"172.21.15.163:6823","nonce":2530874117}]},"public_addr":"172.21.15.163:6819/2530874117","cluster_addr":"172.21.15.163:6821/2530874117","heartbeat_back_addr":"172.21.15.163:6825/2530874117","heartbeat_front_addr":"172.21.15.163:6823/2530874117","state":["exists","up"]},{"osd":7,"uuid":"edd76e6b-6077-4619-b00d-1e906f70ddcc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":49,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":233511803},{"type":"v1","addr":"172.21.15.172:6817","nonce":233511803}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6818","nonce":233511803},{"type":"v1","addr":"172.21.15.172:6819","nonce":233511803}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":233511803},{"type":"v1","addr":"172.21.15.172:6823","nonce":233511803}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6820","nonce":233511803},{"type":"v1","addr":"172.21.15.172:6821","nonce":233511803}]},"public_addr":"172.21.15.172:6817/233511803","cluster_addr":"172.21.15.172:6819/233511803","heartbeat_back_addr":"172.21.15.172:6823/233511803","heartbeat_front_addr":"172.21.15.172:6821/233511803","state":["exists","up"]},{"osd":8,"uuid":"36559400-f33e-44e6-868a-316d34da457d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":56,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6816","nonce":290154343},{"type":"v1","addr":"172.21.15.184:6817","nonce":290154343}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6818","nonce":290154343},{"type":"v1","addr":"172.21.15.184:6819","nonce":290154343}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6822","nonce":290154343},{"type":"v1","addr":"172.21.15.184:6823","nonce":290154343}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6820","nonce":290154343},{"type":"v1","addr":"172.21.15.184:6821","nonce":290154343}]},"public_addr":"172.21.15.184:6817/290154343","cluster_addr":"172.21.15.184:6819/290154343","heartbeat_back_addr":"172.21.15.184:6823/290154343","heartbeat_front_addr":"172.21.15.184:6821/290154343","state":["exists","up"]},{"osd":9,"uuid":"d484f111-f36c-4c67-9a8a-ae03e7e0d137","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6826","nonce":3848110906},{"type":"v1","addr":"172.21.15.163:6827","nonce":3848110906}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6828","nonce":3848110906},{"type":"v1","addr":"172.21.15.163:6829","nonce":3848110906}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6832","nonce":3848110906},{"type":"v1","addr":"172.21.15.163:6833","nonce":3848110906}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6830","nonce":3848110906},{"type":"v1","addr":"172.21.15.163:6831","nonce":3848110906}]},"public_addr":"172.21.15.163:6827/3848110906","cluster_addr":"172.21.15.163:6829/3848110906","heartbeat_back_addr":"172.21.15.163:6833/3848110906","heartbeat_front_addr":"172.21.15.163:6831/3848110906","state":["exists","up"]},{"osd":10,"uuid":"d943f7c0-da3d-4605-9e23-0231e675c6be","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6824","nonce":3281085356},{"type":"v1","addr":"172.21.15.172:6825","nonce":3281085356}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":3281085356},{"type":"v1","addr":"172.21.15.172:6827","nonce":3281085356}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":3281085356},{"type":"v1","addr":"172.21.15.172:6831","nonce":3281085356}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6828","nonce":3281085356},{"type":"v1","addr":"172.21.15.172:6829","nonce":3281085356}]},"public_addr":"172.21.15.172:6825/3281085356","cluster_addr":"172.21.15.172:6827/3281085356","heartbeat_back_addr":"172.21.15.172:6831/3281085356","heartbeat_front_addr":"172.21.15.172:6829/3281085356","state":["exists","up"]},{"osd":11,"uuid":"09e610a8-408a-4119-a21b-c4de2810a538","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":75,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6824","nonce":3614578747},{"type":"v1","addr":"172.21.15.184:6825","nonce":3614578747}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6826","nonce":3614578747},{"type":"v1","addr":"172.21.15.184:6827","nonce":3614578747}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6830","nonce":3614578747},{"type":"v1","addr":"172.21.15.184:6831","nonce":3614578747}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6828","nonce":3614578747},{"type":"v1","addr":"172.21.15.184:6829","nonce":3614578747}]},"public_addr":"172.21.15.184:6825/3614578747","cluster_addr":"172.21.15.184:6827/3614578747","heartbeat_back_addr":"172.21.15.184:6831/3614578747","heartbeat_front_addr":"172.21.15.184:6829/3614578747","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T18:06:36.067578+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T18:06:57.095120+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T18:07:17.825363+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T18:07:38.977196+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T18:08:00.108709+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T18:08:20.700646+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T18:08:41.473899+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T18:09:02.856536+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T18:09:23.832722+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T18:09:44.860884+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T18:10:05.520678+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T18:10:26.426315+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.8","mappings":[{"from":2,"to":11}]},{"pgid":"3.1","mappings":[{"from":4,"to":9}]},{"pgid":"3.6","mappings":[{"from":4,"to":6}]},{"pgid":"3.25","mappings":[{"from":5,"to":9}]},{"pgid":"3.27","mappings":[{"from":4,"to":8}]},{"pgid":"3.2d","mappings":[{"from":3,"to":9}]},{"pgid":"4.a","mappings":[{"from":5,"to":8}]},{"pgid":"4.12","mappings":[{"from":9,"to":10}]},{"pgid":"4.14","mappings":[{"from":9,"to":8}]},{"pgid":"4.17","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.163:6801/1086512093":"2023-07-15T18:05:15.331458+0000","172.21.15.163:6800/1086512093":"2023-07-15T18:05:15.331458+0000","172.21.15.163:0/4235784810":"2023-07-15T18:05:15.331458+0000","172.21.15.163:6800/236891232":"2023-07-15T18:04:53.288443+0000","172.21.15.163:6801/236891232":"2023-07-15T18:04:53.288443+0000","172.21.15.163:0/3260193612":"2023-07-15T18:05:15.331458+0000","172.21.15.163:0/3513629472":"2023-07-15T18:04:53.288443+0000","172.21.15.163:0/1090329830":"2023-07-15T18:04:53.288443+0000","172.21.15.163:0/3868922045":"2023-07-15T18:05:15.331458+0000","172.21.15.163:0/2945662447":"2023-07-15T18:04:53.288443+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-14T18:12:41.913 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:41.873+0000 7fece178a700 1 -- 172.21.15.163:0/3242121750 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7fecc40a1220 msgr2=0x7fecc40a36d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:12:41.913 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:41.873+0000 7fece178a700 1 --2- 172.21.15.163:0/3242121750 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7fecc40a1220 0x7fecc40a36d0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7feccc00c010 tx=0x7feccc005960 comp rx=0 tx=0).stop 2023-07-14T18:12:41.914 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:41.873+0000 7fece178a700 1 -- 172.21.15.163:0/3242121750 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fecdc0ffc30 msgr2=0x7fecdc195820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:12:41.914 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:41.873+0000 7fece178a700 1 --2- 172.21.15.163:0/3242121750 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fecdc0ffc30 0x7fecdc195820 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7fecd000d980 tx=0x7fecd000dc90 comp rx=0 tx=0).stop 2023-07-14T18:12:41.914 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:41.873+0000 7fece178a700 1 -- 172.21.15.163:0/3242121750 shutdown_connections 2023-07-14T18:12:41.914 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:41.873+0000 7fece178a700 1 --2- 172.21.15.163:0/3242121750 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7fecc40a1220 0x7fecc40a36d0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:41.914 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:41.873+0000 7fece178a700 1 --2- 172.21.15.163:0/3242121750 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fecdc1017b0 0x7fecdc19cdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:41.914 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:41.873+0000 7fece178a700 1 --2- 172.21.15.163:0/3242121750 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fecdc0ffc30 0x7fecdc195820 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:41.914 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:41.873+0000 7fece178a700 1 --2- 172.21.15.163:0/3242121750 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fecdc100e20 0x7fecdc195d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:41.915 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:41.873+0000 7fece178a700 1 -- 172.21.15.163:0/3242121750 >> 172.21.15.163:0/3242121750 conn(0x7fecdc0fb210 msgr2=0x7fecdc104260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:12:41.915 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:41.873+0000 7fece178a700 1 -- 172.21.15.163:0/3242121750 shutdown_connections 2023-07-14T18:12:41.915 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:41.873+0000 7fece178a700 1 -- 172.21.15.163:0/3242121750 wait complete. 2023-07-14T18:12:41.926 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 28, 'flags': 50, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False, 'balance_automate': False}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2023-07-14T18:11:09.109693+0000', 'modified': '2023-07-14T18:11:31.766338+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 5, 'in': [0, 1, 2, 3, 4], 'up': {'mds_0': 24518, 'mds_1': 24493, 'mds_2': 24479, 'mds_3': 24478, 'mds_4': 14652}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_14640': {'gid': 14640, 'name': 'g', 'rank': 4, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.163:6839/1337572937', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.163:6838', 'nonce': 1337572937}, {'type': 'v1', 'addr': '172.21.15.163:6839', 'nonce': 1337572937}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}, 'gid_14652': {'gid': 14652, 'name': 'a', 'rank': 4, 'incarnation': 26, 'state': 'up:active', 'state_seq': 9, 'addr': '172.21.15.163:6841/1032082642', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.163:6840', 'nonce': 1032082642}, {'type': 'v1', 'addr': '172.21.15.163:6841', 'nonce': 1032082642}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}, 'gid_24421': {'gid': 24421, 'name': 'l', 'rank': 3, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.184:6833/797722972', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.184:6832', 'nonce': 797722972}, {'type': 'v1', 'addr': '172.21.15.184:6833', 'nonce': 797722972}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}, 'gid_24431': {'gid': 24431, 'name': 'k', 'rank': 2, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.172:6833/1075696311', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.172:6832', 'nonce': 1075696311}, {'type': 'v1', 'addr': '172.21.15.172:6833', 'nonce': 1075696311}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}, 'gid_24458': {'gid': 24458, 'name': 'e', 'rank': 1, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.172:6835/1158120127', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.172:6834', 'nonce': 1158120127}, {'type': 'v1', 'addr': '172.21.15.172:6835', 'nonce': 1158120127}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}, 'gid_24466': {'gid': 24466, 'name': 'f', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.184:6835/460134263', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.184:6834', 'nonce': 460134263}, {'type': 'v1', 'addr': '172.21.15.184:6835', 'nonce': 460134263}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}, 'gid_24478': {'gid': 24478, 'name': 'c', 'rank': 3, 'incarnation': 24, 'state': 'up:active', 'state_seq': 11, 'addr': '172.21.15.184:6837/3389277679', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.184:6836', 'nonce': 3389277679}, {'type': 'v1', 'addr': '172.21.15.184:6837', 'nonce': 3389277679}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}, 'gid_24479': {'gid': 24479, 'name': 'h', 'rank': 2, 'incarnation': 22, 'state': 'up:active', 'state_seq': 10, 'addr': '172.21.15.172:6837/3783835012', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.172:6836', 'nonce': 3783835012}, {'type': 'v1', 'addr': '172.21.15.172:6837', 'nonce': 3783835012}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}, 'gid_24493': {'gid': 24493, 'name': 'i', 'rank': 1, 'incarnation': 20, 'state': 'up:active', 'state_seq': 9, 'addr': '172.21.15.184:6839/2819059257', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.184:6838', 'nonce': 2819059257}, {'type': 'v1', 'addr': '172.21.15.184:6839', 'nonce': 2819059257}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}, 'gid_24518': {'gid': 24518, 'name': 'b', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.172:6839/3850440096', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.172:6838', 'nonce': 3850440096}, {'type': 'v1', 'addr': '172.21.15.172:6839', 'nonce': 3850440096}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-07-14T18:12:41.927 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 5/5 2023-07-14T18:12:41.927 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2023-07-14T18:12:42.050 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.010+0000 7f76fbe33700 1 -- 172.21.15.163:0/939314272 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f76f40ffd00 msgr2=0x7f76f4100150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:12:42.051 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.010+0000 7f76fbe33700 1 --2- 172.21.15.163:0/939314272 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f76f40ffd00 0x7f76f4100150 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f76f0009990 tx=0x7f76f0009ca0 comp rx=0 tx=0).stop 2023-07-14T18:12:42.051 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.010+0000 7f76fbe33700 1 -- 172.21.15.163:0/939314272 shutdown_connections 2023-07-14T18:12:42.051 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.010+0000 7f76fbe33700 1 --2- 172.21.15.163:0/939314272 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f76f4100690 0x7f76f4106f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:42.051 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.010+0000 7f76fbe33700 1 --2- 172.21.15.163:0/939314272 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f76f40feb10 0x7f76f40fef20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:42.051 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.010+0000 7f76fbe33700 1 --2- 172.21.15.163:0/939314272 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f76f40ffd00 0x7f76f4100150 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:42.051 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.010+0000 7f76fbe33700 1 -- 172.21.15.163:0/939314272 >> 172.21.15.163:0/939314272 conn(0x7f76f40fa130 msgr2=0x7f76f40fc560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:12:42.052 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.010+0000 7f76fbe33700 1 -- 172.21.15.163:0/939314272 shutdown_connections 2023-07-14T18:12:42.052 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.010+0000 7f76fbe33700 1 -- 172.21.15.163:0/939314272 wait complete. 2023-07-14T18:12:42.052 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.010+0000 7f76fbe33700 1 Processor -- start 2023-07-14T18:12:42.052 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.010+0000 7f76fbe33700 1 -- start start 2023-07-14T18:12:42.053 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.011+0000 7f76fbe33700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f76f40feb10 0x7f76f41958f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:12:42.054 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.011+0000 7f76fbe33700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f76f40ffd00 0x7f76f4195e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:12:42.054 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.011+0000 7f76fbe33700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f76f4100690 0x7f76f419cea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:12:42.054 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.011+0000 7f76fbe33700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76f419d470 con 0x7f76f40ffd00 2023-07-14T18:12:42.054 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.011+0000 7f76fbe33700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76f419d5b0 con 0x7f76f40feb10 2023-07-14T18:12:42.054 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.011+0000 7f76fbe33700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76f419d740 con 0x7f76f4100690 2023-07-14T18:12:42.054 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.011+0000 7f76f93ce700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f76f40ffd00 0x7f76f4195e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:12:42.054 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.011+0000 7f76f93ce700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f76f40ffd00 0x7f76f4195e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:57468/0 (socket says 172.21.15.163:57468) 2023-07-14T18:12:42.055 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.011+0000 7f76f93ce700 1 -- 172.21.15.163:0/3394956599 learned_addr learned my addr 172.21.15.163:0/3394956599 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:12:42.055 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.011+0000 7f76f9bcf700 1 --2- 172.21.15.163:0/3394956599 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f76f40feb10 0x7f76f41958f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:12:42.055 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.011+0000 7f76fa3d0700 1 --2- 172.21.15.163:0/3394956599 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f76f4100690 0x7f76f419cea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:12:42.055 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.011+0000 7f76f93ce700 1 -- 172.21.15.163:0/3394956599 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f76f4100690 msgr2=0x7f76f419cea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:12:42.055 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.011+0000 7f76f93ce700 1 --2- 172.21.15.163:0/3394956599 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f76f4100690 0x7f76f419cea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:42.055 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.011+0000 7f76f93ce700 1 -- 172.21.15.163:0/3394956599 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f76f40feb10 msgr2=0x7f76f41958f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:12:42.055 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.011+0000 7f76f93ce700 1 --2- 172.21.15.163:0/3394956599 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f76f40feb10 0x7f76f41958f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:42.056 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.011+0000 7f76f93ce700 1 -- 172.21.15.163:0/3394956599 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76f00095f0 con 0x7f76f40ffd00 2023-07-14T18:12:42.056 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.011+0000 7f76f93ce700 1 --2- 172.21.15.163:0/3394956599 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f76f40ffd00 0x7f76f4195e30 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f76f0005f50 tx=0x7f76f00047a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:12:42.056 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.011+0000 7f76eaffd700 1 -- 172.21.15.163:0/3394956599 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76f001d070 con 0x7f76f40ffd00 2023-07-14T18:12:42.056 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.011+0000 7f76eaffd700 1 -- 172.21.15.163:0/3394956599 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f76f0004810 con 0x7f76f40ffd00 2023-07-14T18:12:42.056 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.011+0000 7f76eaffd700 1 -- 172.21.15.163:0/3394956599 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76f0005340 con 0x7f76f40ffd00 2023-07-14T18:12:42.056 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.011+0000 7f76fbe33700 1 -- 172.21.15.163:0/3394956599 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f76f419d9c0 con 0x7f76f40ffd00 2023-07-14T18:12:42.056 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.011+0000 7f76fbe33700 1 -- 172.21.15.163:0/3394956599 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f76f419dde0 con 0x7f76f40ffd00 2023-07-14T18:12:42.056 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.013+0000 7f76eaffd700 1 -- 172.21.15.163:0/3394956599 <== mon.0 v2:172.21.15.163:3300/0 4 ==== mgrmap(e 17) v1 ==== 135767+0+0 (secure 0 0 0) 0x7f76f0004980 con 0x7f76f40ffd00 2023-07-14T18:12:42.061 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.014+0000 7f76eaffd700 1 --2- 172.21.15.163:0/3394956599 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f76e00a1260 0x7f76e00a3710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:12:42.061 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.014+0000 7f76eaffd700 1 -- 172.21.15.163:0/3394956599 <== mon.0 v2:172.21.15.163:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 9020+0+0 (secure 0 0 0) 0x7f76f00cdf30 con 0x7f76f40ffd00 2023-07-14T18:12:42.061 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.014+0000 7f76f9bcf700 1 --2- 172.21.15.163:0/3394956599 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f76e00a1260 0x7f76e00a3710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:12:42.061 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.014+0000 7f76f9bcf700 1 --2- 172.21.15.163:0/3394956599 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f76e00a1260 0x7f76e00a3710 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f76f40ffb60 tx=0x7f76e400b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:12:42.062 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.015+0000 7f7707fcbb80 1 Processor -- start 2023-07-14T18:12:42.062 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.015+0000 7f7707fcbb80 1 -- start start 2023-07-14T18:12:42.062 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.015+0000 7f7707fcbb80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560470ccdf10 0x560470cce320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:12:42.062 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.015+0000 7f7707fcbb80 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x560470cce860 0x560470ccee80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:12:42.062 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.015+0000 7f7707fcbb80 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x560470ccf460 0x560470ccf8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:12:42.062 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.015+0000 7f7707fcbb80 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x560470bd2c60 con 0x560470ccf460 2023-07-14T18:12:42.062 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.015+0000 7f7707fcbb80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x560470c259f0 con 0x560470ccdf10 2023-07-14T18:12:42.062 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.015+0000 7f7707fcbb80 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x560470c1ee80 con 0x560470cce860 2023-07-14T18:12:42.063 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.016+0000 7f76fa3d0700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x560470ccf460 0x560470ccf8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:12:42.063 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.016+0000 7f76fa3d0700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x560470ccf460 0x560470ccf8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:57478/0 (socket says 172.21.15.163:57478) 2023-07-14T18:12:42.063 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.016+0000 7f76fa3d0700 1 -- 172.21.15.163:0/39164395 learned_addr learned my addr 172.21.15.163:0/39164395 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:12:42.063 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.016+0000 7f76f9bcf700 1 --2- 172.21.15.163:0/39164395 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560470ccdf10 0x560470cce320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:12:42.063 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.016+0000 7f76f93ce700 1 --2- 172.21.15.163:0/39164395 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x560470cce860 0x560470ccee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:12:42.063 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.016+0000 7f76fa3d0700 1 -- 172.21.15.163:0/39164395 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x560470cce860 msgr2=0x560470ccee80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:12:42.063 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.016+0000 7f76fa3d0700 1 --2- 172.21.15.163:0/39164395 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x560470cce860 0x560470ccee80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:42.063 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.016+0000 7f76fa3d0700 1 -- 172.21.15.163:0/39164395 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560470ccdf10 msgr2=0x560470cce320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:12:42.064 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.016+0000 7f76fa3d0700 1 --2- 172.21.15.163:0/39164395 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560470ccdf10 0x560470cce320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:42.064 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.016+0000 7f76fa3d0700 1 -- 172.21.15.163:0/39164395 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560470a4cd90 con 0x560470ccf460 2023-07-14T18:12:42.064 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.016+0000 7f76fa3d0700 1 --2- 172.21.15.163:0/39164395 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x560470ccf460 0x560470ccf8d0 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f76ec009440 tx=0x7f76ec009920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f3a5d4c249de1c5 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:12:42.064 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.016+0000 7f76dffff700 1 -- 172.21.15.163:0/39164395 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76ec00e070 con 0x560470ccf460 2023-07-14T18:12:42.064 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.016+0000 7f76dffff700 1 -- 172.21.15.163:0/39164395 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f76ec00f040 con 0x560470ccf460 2023-07-14T18:12:42.064 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.016+0000 7f76dffff700 1 -- 172.21.15.163:0/39164395 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76ec015a30 con 0x560470ccf460 2023-07-14T18:12:42.064 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.017+0000 7f7707fcbb80 1 -- 172.21.15.163:0/39164395 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x560470ccf460 msgr2=0x560470ccf8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:12:42.065 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.017+0000 7f7707fcbb80 1 --2- 172.21.15.163:0/39164395 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x560470ccf460 0x560470ccf8d0 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f76ec009440 tx=0x7f76ec009920 comp rx=0 tx=0).stop 2023-07-14T18:12:42.065 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.017+0000 7f7707fcbb80 1 -- 172.21.15.163:0/39164395 shutdown_connections 2023-07-14T18:12:42.065 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.017+0000 7f7707fcbb80 1 --2- 172.21.15.163:0/39164395 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x560470ccf460 0x560470ccf8d0 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:42.065 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.017+0000 7f7707fcbb80 1 --2- 172.21.15.163:0/39164395 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560470ccdf10 0x560470cce320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:42.065 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.017+0000 7f7707fcbb80 1 --2- 172.21.15.163:0/39164395 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x560470cce860 0x560470ccee80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:42.065 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.017+0000 7f7707fcbb80 1 -- 172.21.15.163:0/39164395 >> 172.21.15.163:0/39164395 conn(0x560470cc3630 msgr2=0x560470cc8980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:12:42.065 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.017+0000 7f7707fcbb80 1 -- 172.21.15.163:0/39164395 shutdown_connections 2023-07-14T18:12:42.065 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.017+0000 7f7707fcbb80 1 -- 172.21.15.163:0/39164395 wait complete. 2023-07-14T18:12:42.066 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.017+0000 7f7707fcbb80 1 -- start start 2023-07-14T18:12:42.066 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.017+0000 7f7707fcbb80 1 Processor -- start 2023-07-14T18:12:42.066 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.018+0000 7f7707fcbb80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560470ccdf10 0x560470cd78c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:12:42.066 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.018+0000 7f7707fcbb80 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x560470cce860 0x560470cd7e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:12:42.066 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.018+0000 7f7707fcbb80 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x560470ccf460 0x560470cdee40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:12:42.066 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.018+0000 7f7707fcbb80 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x560470bbea70 con 0x560470ccf460 2023-07-14T18:12:42.066 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.018+0000 7f7707fcbb80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x560470bbe770 con 0x560470ccdf10 2023-07-14T18:12:42.066 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.018+0000 7f7707fcbb80 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x560470aa28d0 con 0x560470cce860 2023-07-14T18:12:42.067 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.018+0000 7f7707fcbb80 10 client.0 _ll_register_callbacks cb 0x560470bbc710 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T18:12:42.067 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.018+0000 7f76fa3d0700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x560470ccf460 0x560470cdee40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:12:42.067 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.018+0000 7f76fa3d0700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x560470ccf460 0x560470cdee40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:57484/0 (socket says 172.21.15.163:57484) 2023-07-14T18:12:42.067 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.018+0000 7f76fa3d0700 1 -- 172.21.15.163:0/1699385219 learned_addr learned my addr 172.21.15.163:0/1699385219 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:12:42.067 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.018+0000 7f76f9bcf700 1 --2- 172.21.15.163:0/1699385219 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560470ccdf10 0x560470cd78c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:12:42.067 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.018+0000 7f76f93ce700 1 --2- 172.21.15.163:0/1699385219 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x560470cce860 0x560470cd7e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:12:42.067 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.018+0000 7f76fa3d0700 1 -- 172.21.15.163:0/1699385219 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x560470cce860 msgr2=0x560470cd7e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:12:42.067 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.018+0000 7f76fa3d0700 1 --2- 172.21.15.163:0/1699385219 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x560470cce860 0x560470cd7e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:42.068 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.018+0000 7f76fa3d0700 1 -- 172.21.15.163:0/1699385219 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560470ccdf10 msgr2=0x560470cd78c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:12:42.068 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.018+0000 7f76fa3d0700 1 --2- 172.21.15.163:0/1699385219 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560470ccdf10 0x560470cd78c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:42.068 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.018+0000 7f76fa3d0700 1 -- 172.21.15.163:0/1699385219 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f76ec0090f0 con 0x560470ccf460 2023-07-14T18:12:42.068 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.018+0000 7f76fa3d0700 1 --2- 172.21.15.163:0/1699385219 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x560470ccf460 0x560470cdee40 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f76ec016a20 tx=0x7f76ec016a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0b60abcfc213835 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:12:42.068 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.018+0000 7f76dd7fa700 10 client.0 ms_handle_connect on v2:172.21.15.163:3300/0 2023-07-14T18:12:42.068 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.019+0000 7f76dd7fa700 1 -- 172.21.15.163:0/1699385219 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76ec00e040 con 0x560470ccf460 2023-07-14T18:12:42.068 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.019+0000 7f7707fcbb80 1 -- 172.21.15.163:0/1699385219 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x560470b784a0 con 0x560470ccf460 2023-07-14T18:12:42.069 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.019+0000 7f76dd7fa700 1 -- 172.21.15.163:0/1699385219 <== mon.0 v2:172.21.15.163:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 9020+0+0 (secure 0 0 0) 0x7f76ec013750 con 0x560470ccf460 2023-07-14T18:12:42.069 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.019+0000 7f76dd7fa700 1 -- 172.21.15.163:0/1699385219 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7f76ec013910 con 0x560470ccf460 2023-07-14T18:12:42.069 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.019+0000 7f7707fcbb80 10 client.15444 fetch_fsmap learned FSMap version 28 2023-07-14T18:12:42.069 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.019+0000 7f7707fcbb80 1 -- 172.21.15.163:0/1699385219 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) v3 -- 0x560470a35c10 con 0x560470ccf460 2023-07-14T18:12:42.069 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.019+0000 7f76dd7fa700 1 -- 172.21.15.163:0/1699385219 <== mon.0 v2:172.21.15.163:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x560470b784a0 con 0x560470ccf460 2023-07-14T18:12:42.069 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.019+0000 7f76dd7fa700 1 -- 172.21.15.163:0/1699385219 <== mon.0 v2:172.21.15.163:3300/0 5 ==== fsmap(e 28) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f76ec01c050 con 0x560470ccf460 2023-07-14T18:12:42.069 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.019+0000 7f7707fcbb80 10 client.15444 fetch_fsmap finished waiting for FSMap version 28 2023-07-14T18:12:42.069 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.019+0000 7f7707fcbb80 10 client.15444 resolve_mds: resolved name 'a' to daemon mds.a 2023-07-14T18:12:42.070 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.019+0000 7f7707fcbb80 20 client.15444 populate_metadata read hostname 'smithi163' 2023-07-14T18:12:42.070 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.019+0000 7f7707fcbb80 1 --2- 172.21.15.163:0/1699385219 >> [v2:172.21.15.163:6840/1032082642,v1:172.21.15.163:6841/1032082642] conn(0x560470ce2a80 0x560470ce1e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:12:42.070 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.019+0000 7f7707fcbb80 4 client.15444 mds_command: new command op to 14652 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-14T18:12:42.070 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.019+0000 7f7707fcbb80 1 -- 172.21.15.163:0/1699385219 --> [v2:172.21.15.163:6840/1032082642,v1:172.21.15.163:6841/1032082642] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x560470c9cd50 con 0x560470ce2a80 2023-07-14T18:12:42.070 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.019+0000 7f76f9bcf700 1 --2- 172.21.15.163:0/1699385219 >> [v2:172.21.15.163:6840/1032082642,v1:172.21.15.163:6841/1032082642] conn(0x560470ce2a80 0x560470ce1e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:12:42.070 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.020+0000 7f76f9bcf700 1 --2- 172.21.15.163:0/1699385219 >> [v2:172.21.15.163:6840/1032082642,v1:172.21.15.163:6841/1032082642] conn(0x560470ce2a80 0x560470ce1e90 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=b3c4bb062294e752 server_cookie=fbf0257db69e24fc in_seq=0 out_seq=0 2023-07-14T18:12:42.070 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.020+0000 7f76dd7fa700 10 client.15444 ms_handle_connect on v2:172.21.15.163:6840/1032082642 2023-07-14T18:12:42.070 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.020+0000 7f76dd7fa700 1 -- 172.21.15.163:0/1699385219 <== mds.4 v2:172.21.15.163:6840/1032082642 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18017 (crc 0 0 0) 0x560470c9cd50 con 0x560470ce2a80 2023-07-14T18:12:42.071 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.020+0000 7f76dd7fa700 10 client.15444 handle_command_reply: tid=0 2023-07-14T18:12:42.071 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.020+0000 7f7707fcbb80 1 client.15444 shutdown 2023-07-14T18:12:42.071 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.020+0000 7f7707fcbb80 1 -- 172.21.15.163:0/1699385219 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x560470ccf460 msgr2=0x560470cdee40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:12:42.071 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.020+0000 7f7707fcbb80 1 --2- 172.21.15.163:0/1699385219 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x560470ccf460 0x560470cdee40 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f76ec016a20 tx=0x7f76ec016a50 comp rx=0 tx=0).stop 2023-07-14T18:12:42.071 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.020+0000 7f7707fcbb80 1 -- 172.21.15.163:0/1699385219 shutdown_connections 2023-07-14T18:12:42.071 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.020+0000 7f7707fcbb80 1 --2- 172.21.15.163:0/1699385219 >> [v2:172.21.15.163:6840/1032082642,v1:172.21.15.163:6841/1032082642] conn(0x560470ce2a80 0x560470ce1e90 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:42.071 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.020+0000 7f7707fcbb80 1 --2- 172.21.15.163:0/1699385219 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x560470ccf460 0x560470cdee40 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:42.072 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.020+0000 7f7707fcbb80 1 --2- 172.21.15.163:0/1699385219 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560470ccdf10 0x560470cd78c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:42.072 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.020+0000 7f7707fcbb80 1 --2- 172.21.15.163:0/1699385219 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x560470cce860 0x560470cd7e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:42.072 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.020+0000 7f76dd7fa700 0 client.15444 ms_handle_reset on v2:172.21.15.163:6840/1032082642 2023-07-14T18:12:42.072 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.020+0000 7f7707fcbb80 1 -- 172.21.15.163:0/1699385219 >> 172.21.15.163:0/1699385219 conn(0x560470cc3630 msgr2=0x560470cc7600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:12:42.072 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.020+0000 7f7707fcbb80 1 -- 172.21.15.163:0/1699385219 shutdown_connections 2023-07-14T18:12:42.072 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.020+0000 7f7707fcbb80 1 -- 172.21.15.163:0/1699385219 wait complete. 2023-07-14T18:12:42.072 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.021+0000 7f7707fcbb80 20 client.15444 trim_cache size 0 max 16384 2023-07-14T18:12:42.079 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.038+0000 7f7707fcbb80 1 Processor -- start 2023-07-14T18:12:42.079 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.038+0000 7f7707fcbb80 1 -- start start 2023-07-14T18:12:42.079 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.038+0000 7f7707fcbb80 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x560470ccdf10 0x560470cc80a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:12:42.079 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.038+0000 7f7707fcbb80 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x560470cce860 0x560470cdee00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:12:42.080 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.038+0000 7f7707fcbb80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560470ccf460 0x560470ce1e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:12:42.080 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.038+0000 7f7707fcbb80 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x560470b784d0 con 0x560470ccdf10 2023-07-14T18:12:42.080 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.038+0000 7f7707fcbb80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x560470bed7c0 con 0x560470ccf460 2023-07-14T18:12:42.080 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.038+0000 7f7707fcbb80 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x560470bdd480 con 0x560470cce860 2023-07-14T18:12:42.080 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.038+0000 7f76f9bcf700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x560470ccdf10 0x560470cc80a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:12:42.080 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.038+0000 7f76f9bcf700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x560470ccdf10 0x560470cc80a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:57488/0 (socket says 172.21.15.163:57488) 2023-07-14T18:12:42.080 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.038+0000 7f76f9bcf700 1 -- 172.21.15.163:0/1340703168 learned_addr learned my addr 172.21.15.163:0/1340703168 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:12:42.081 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.038+0000 7f76fa3d0700 1 --2- 172.21.15.163:0/1340703168 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560470ccf460 0x560470ce1e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:12:42.081 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.038+0000 7f76f93ce700 1 --2- 172.21.15.163:0/1340703168 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x560470cce860 0x560470cdee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:12:42.081 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.038+0000 7f76f9bcf700 1 -- 172.21.15.163:0/1340703168 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x560470cce860 msgr2=0x560470cdee00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:12:42.081 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.038+0000 7f76f9bcf700 1 --2- 172.21.15.163:0/1340703168 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x560470cce860 0x560470cdee00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:42.081 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.038+0000 7f76f9bcf700 1 -- 172.21.15.163:0/1340703168 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560470ccf460 msgr2=0x560470ce1e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:12:42.081 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.038+0000 7f76f9bcf700 1 --2- 172.21.15.163:0/1340703168 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560470ccf460 0x560470ce1e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:42.081 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.038+0000 7f76f9bcf700 1 -- 172.21.15.163:0/1340703168 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560470a73200 con 0x560470ccdf10 2023-07-14T18:12:42.081 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.039+0000 7f76fa3d0700 1 --2- 172.21.15.163:0/1340703168 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560470ccf460 0x560470ce1e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T18:12:42.082 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.039+0000 7f76f9bcf700 1 --2- 172.21.15.163:0/1340703168 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x560470ccdf10 0x560470cc80a0 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x560470bc85a0 tx=0x7f76e4013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a914d3688839228 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:12:42.082 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.039+0000 7f76e8ff9700 1 -- 172.21.15.163:0/1340703168 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76e4024040 con 0x560470ccdf10 2023-07-14T18:12:42.082 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.039+0000 7f76e8ff9700 1 -- 172.21.15.163:0/1340703168 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f76e4015070 con 0x560470ccdf10 2023-07-14T18:12:42.082 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.039+0000 7f76e8ff9700 1 -- 172.21.15.163:0/1340703168 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76e4029aa0 con 0x560470ccdf10 2023-07-14T18:12:42.085 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.039+0000 7f7707fcbb80 1 -- 172.21.15.163:0/1340703168 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x560470ccdf10 msgr2=0x560470cc80a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:12:42.086 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.039+0000 7f7707fcbb80 1 --2- 172.21.15.163:0/1340703168 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x560470ccdf10 0x560470cc80a0 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x560470bc85a0 tx=0x7f76e4013000 comp rx=0 tx=0).stop 2023-07-14T18:12:42.086 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.039+0000 7f7707fcbb80 1 -- 172.21.15.163:0/1340703168 shutdown_connections 2023-07-14T18:12:42.086 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.039+0000 7f7707fcbb80 1 --2- 172.21.15.163:0/1340703168 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560470ccf460 0x560470ce1e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:42.086 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.039+0000 7f7707fcbb80 1 --2- 172.21.15.163:0/1340703168 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x560470ccdf10 0x560470cc80a0 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:42.086 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.039+0000 7f7707fcbb80 1 --2- 172.21.15.163:0/1340703168 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x560470cce860 0x560470cdee00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:42.086 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.039+0000 7f7707fcbb80 1 -- 172.21.15.163:0/1340703168 >> 172.21.15.163:0/1340703168 conn(0x560470cc3630 msgr2=0x560470cc4b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:12:42.086 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.039+0000 7f7707fcbb80 1 -- 172.21.15.163:0/1340703168 shutdown_connections 2023-07-14T18:12:42.087 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.039+0000 7f7707fcbb80 1 -- 172.21.15.163:0/1340703168 wait complete. 2023-07-14T18:12:42.087 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.040+0000 7f7707fcbb80 1 -- start start 2023-07-14T18:12:42.087 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.040+0000 7f7707fcbb80 1 Processor -- start 2023-07-14T18:12:42.087 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.040+0000 7f7707fcbb80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560470ccdf10 0x560470cda420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:12:42.087 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.040+0000 7f7707fcbb80 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x560470cce860 0x560470cda960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:12:42.087 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.040+0000 7f7707fcbb80 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x560470ccf460 0x560470cdd980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:12:42.087 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.040+0000 7f7707fcbb80 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x560470cddec0 con 0x560470ccf460 2023-07-14T18:12:42.087 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.040+0000 7f7707fcbb80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x560470cde030 con 0x560470ccdf10 2023-07-14T18:12:42.088 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.040+0000 7f7707fcbb80 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x560470cde1f0 con 0x560470cce860 2023-07-14T18:12:42.088 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.040+0000 7f7707fcbb80 10 client.0 _ll_register_callbacks cb 0x7f76f0097340 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T18:12:42.088 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.040+0000 7f76fa3d0700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x560470ccf460 0x560470cdd980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:12:42.088 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.040+0000 7f76fa3d0700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x560470ccf460 0x560470cdd980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:57498/0 (socket says 172.21.15.163:57498) 2023-07-14T18:12:42.088 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.040+0000 7f76fa3d0700 1 -- 172.21.15.163:0/862585287 learned_addr learned my addr 172.21.15.163:0/862585287 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:12:42.088 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.040+0000 7f76f93ce700 1 --2- 172.21.15.163:0/862585287 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x560470cce860 0x560470cda960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:12:42.088 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.040+0000 7f76f9bcf700 1 --2- 172.21.15.163:0/862585287 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560470ccdf10 0x560470cda420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:12:42.089 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.041+0000 7f76fa3d0700 1 -- 172.21.15.163:0/862585287 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x560470cce860 msgr2=0x560470cda960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:12:42.089 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.041+0000 7f76fa3d0700 1 --2- 172.21.15.163:0/862585287 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x560470cce860 0x560470cda960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:42.089 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.041+0000 7f76fa3d0700 1 -- 172.21.15.163:0/862585287 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560470ccdf10 msgr2=0x560470cda420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:12:42.089 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.041+0000 7f76fa3d0700 1 --2- 172.21.15.163:0/862585287 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560470ccdf10 0x560470cda420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:42.089 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.041+0000 7f76fa3d0700 1 -- 172.21.15.163:0/862585287 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f76e4011440 con 0x560470ccf460 2023-07-14T18:12:42.089 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.041+0000 7f76f9bcf700 1 --2- 172.21.15.163:0/862585287 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560470ccdf10 0x560470cda420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T18:12:42.089 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.041+0000 7f76fa3d0700 1 --2- 172.21.15.163:0/862585287 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x560470ccf460 0x560470cdd980 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f76ec009550 tx=0x7f76ec01f6d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d577aac3f12284d server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:12:42.089 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.041+0000 7f76dd7fa700 10 client.0 ms_handle_connect on v2:172.21.15.163:3300/0 2023-07-14T18:12:42.090 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.041+0000 7f76dd7fa700 1 -- 172.21.15.163:0/862585287 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76ec00e070 con 0x560470ccf460 2023-07-14T18:12:42.090 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.041+0000 7f7707fcbb80 1 -- 172.21.15.163:0/862585287 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f76ec00f040 con 0x560470ccf460 2023-07-14T18:12:42.090 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.041+0000 7f76dd7fa700 1 -- 172.21.15.163:0/862585287 <== mon.0 v2:172.21.15.163:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 9020+0+0 (secure 0 0 0) 0x7f76ec01fcc0 con 0x560470ccf460 2023-07-14T18:12:42.090 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.041+0000 7f76dd7fa700 1 -- 172.21.15.163:0/862585287 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7f76ec009990 con 0x560470ccf460 2023-07-14T18:12:42.090 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.041+0000 7f7707fcbb80 10 client.15450 fetch_fsmap learned FSMap version 28 2023-07-14T18:12:42.090 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.041+0000 7f7707fcbb80 1 -- 172.21.15.163:0/862585287 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) v3 -- 0x560470a4b260 con 0x560470ccf460 2023-07-14T18:12:42.090 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.041+0000 7f76dd7fa700 1 -- 172.21.15.163:0/862585287 <== mon.0 v2:172.21.15.163:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f76ec00f040 con 0x560470ccf460 2023-07-14T18:12:42.090 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.041+0000 7f76dd7fa700 1 -- 172.21.15.163:0/862585287 <== mon.0 v2:172.21.15.163:3300/0 5 ==== fsmap(e 28) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f76ec01c050 con 0x560470ccf460 2023-07-14T18:12:42.091 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.041+0000 7f7707fcbb80 10 client.15450 fetch_fsmap finished waiting for FSMap version 28 2023-07-14T18:12:42.091 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.041+0000 7f7707fcbb80 10 client.15450 resolve_mds: resolved name 'a' to daemon mds.a 2023-07-14T18:12:42.091 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.042+0000 7f7707fcbb80 20 client.15450 populate_metadata read hostname 'smithi163' 2023-07-14T18:12:42.091 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.042+0000 7f7707fcbb80 1 --2- 172.21.15.163:0/862585287 >> [v2:172.21.15.163:6840/1032082642,v1:172.21.15.163:6841/1032082642] conn(0x560470d3bf00 0x560470d388f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:12:42.091 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.042+0000 7f7707fcbb80 4 client.15450 mds_command: new command op to 14652 tid=0[{"prefix": "status"}] 2023-07-14T18:12:42.091 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.042+0000 7f7707fcbb80 1 -- 172.21.15.163:0/862585287 --> [v2:172.21.15.163:6840/1032082642,v1:172.21.15.163:6841/1032082642] -- command(tid 0: {"prefix": "status"}) v1 -- 0x560470c17e60 con 0x560470d3bf00 2023-07-14T18:12:42.091 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.042+0000 7f76f9bcf700 1 --2- 172.21.15.163:0/862585287 >> [v2:172.21.15.163:6840/1032082642,v1:172.21.15.163:6841/1032082642] conn(0x560470d3bf00 0x560470d388f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:12:42.091 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.042+0000 7f76f9bcf700 1 --2- 172.21.15.163:0/862585287 >> [v2:172.21.15.163:6840/1032082642,v1:172.21.15.163:6841/1032082642] conn(0x560470d3bf00 0x560470d388f0 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=cb6f811e5d514f7b server_cookie=72248269ad4d799 in_seq=0 out_seq=0 2023-07-14T18:12:42.092 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.042+0000 7f76dd7fa700 10 client.15450 ms_handle_connect on v2:172.21.15.163:6840/1032082642 2023-07-14T18:12:42.092 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.042+0000 7f76dd7fa700 1 -- 172.21.15.163:0/862585287 <== mds.4 v2:172.21.15.163:6840/1032082642 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+332 (crc 0 0 0) 0x560470c17e60 con 0x560470d3bf00 2023-07-14T18:12:42.092 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.042+0000 7f76dd7fa700 10 client.15450 handle_command_reply: tid=0 2023-07-14T18:12:42.092 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.042+0000 7f7707fcbb80 1 client.15450 shutdown 2023-07-14T18:12:42.092 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.042+0000 7f7707fcbb80 1 -- 172.21.15.163:0/862585287 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x560470ccf460 msgr2=0x560470cdd980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:12:42.092 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.042+0000 7f7707fcbb80 1 --2- 172.21.15.163:0/862585287 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x560470ccf460 0x560470cdd980 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f76ec009550 tx=0x7f76ec01f6d0 comp rx=0 tx=0).stop 2023-07-14T18:12:42.092 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.042+0000 7f7707fcbb80 1 -- 172.21.15.163:0/862585287 shutdown_connections 2023-07-14T18:12:42.093 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.042+0000 7f7707fcbb80 1 --2- 172.21.15.163:0/862585287 >> [v2:172.21.15.163:6840/1032082642,v1:172.21.15.163:6841/1032082642] conn(0x560470d3bf00 0x560470d388f0 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:42.093 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.042+0000 7f7707fcbb80 1 --2- 172.21.15.163:0/862585287 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x560470ccf460 0x560470cdd980 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:42.093 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.042+0000 7f76dd7fa700 0 client.15450 ms_handle_reset on v2:172.21.15.163:6840/1032082642 2023-07-14T18:12:42.093 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.042+0000 7f7707fcbb80 1 --2- 172.21.15.163:0/862585287 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560470ccdf10 0x560470cda420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:42.093 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.042+0000 7f7707fcbb80 1 --2- 172.21.15.163:0/862585287 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x560470cce860 0x560470cda960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:42.093 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.042+0000 7f7707fcbb80 1 -- 172.21.15.163:0/862585287 >> 172.21.15.163:0/862585287 conn(0x560470cc3630 msgr2=0x560470cc80a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:12:42.093 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.042+0000 7f7707fcbb80 1 -- 172.21.15.163:0/862585287 shutdown_connections 2023-07-14T18:12:42.093 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.042+0000 7f7707fcbb80 1 -- 172.21.15.163:0/862585287 wait complete. 2023-07-14T18:12:42.094 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.043+0000 7f7707fcbb80 20 client.15450 trim_cache size 0 max 16384 2023-07-14T18:12:42.094 INFO:teuthology.orchestra.run.smithi163.stdout:{ 2023-07-14T18:12:42.094 INFO:teuthology.orchestra.run.smithi163.stdout: "cluster_fsid": "bf7326ec-2270-11ee-9b33-001a4aab830c", 2023-07-14T18:12:42.094 INFO:teuthology.orchestra.run.smithi163.stdout: "whoami": 4, 2023-07-14T18:12:42.094 INFO:teuthology.orchestra.run.smithi163.stdout: "id": 14652, 2023-07-14T18:12:42.095 INFO:teuthology.orchestra.run.smithi163.stdout: "want_state": "up:active", 2023-07-14T18:12:42.095 INFO:teuthology.orchestra.run.smithi163.stdout: "state": "up:active", 2023-07-14T18:12:42.095 INFO:teuthology.orchestra.run.smithi163.stdout: "fs_name": "cephfs", 2023-07-14T18:12:42.095 INFO:teuthology.orchestra.run.smithi163.stdout: "rank_uptime": 71.280080283000004, 2023-07-14T18:12:42.095 INFO:teuthology.orchestra.run.smithi163.stdout: "mdsmap_epoch": 28, 2023-07-14T18:12:42.095 INFO:teuthology.orchestra.run.smithi163.stdout: "osdmap_epoch": 86, 2023-07-14T18:12:42.095 INFO:teuthology.orchestra.run.smithi163.stdout: "osdmap_epoch_barrier": 84, 2023-07-14T18:12:42.095 INFO:teuthology.orchestra.run.smithi163.stdout: "uptime": 100.67216215400001 2023-07-14T18:12:42.096 INFO:teuthology.orchestra.run.smithi163.stdout:} 2023-07-14T18:12:42.097 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.043+0000 7f76fbe33700 1 -- 172.21.15.163:0/3394956599 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f76e00a1260 msgr2=0x7f76e00a3710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:12:42.097 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.043+0000 7f76fbe33700 1 --2- 172.21.15.163:0/3394956599 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f76e00a1260 0x7f76e00a3710 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f76f40ffb60 tx=0x7f76e400b410 comp rx=0 tx=0).stop 2023-07-14T18:12:42.097 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.043+0000 7f76fbe33700 1 -- 172.21.15.163:0/3394956599 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f76f40ffd00 msgr2=0x7f76f4195e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:12:42.097 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.043+0000 7f76fbe33700 1 --2- 172.21.15.163:0/3394956599 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f76f40ffd00 0x7f76f4195e30 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f76f0005f50 tx=0x7f76f00047a0 comp rx=0 tx=0).stop 2023-07-14T18:12:42.097 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.043+0000 7f76fbe33700 1 -- 172.21.15.163:0/3394956599 shutdown_connections 2023-07-14T18:12:42.097 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.043+0000 7f76fbe33700 1 --2- 172.21.15.163:0/3394956599 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f76e00a1260 0x7f76e00a3710 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:42.098 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.043+0000 7f76fbe33700 1 --2- 172.21.15.163:0/3394956599 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f76f4100690 0x7f76f419cea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:42.098 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.043+0000 7f76fbe33700 1 --2- 172.21.15.163:0/3394956599 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f76f40feb10 0x7f76f41958f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:42.098 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.043+0000 7f76fbe33700 1 --2- 172.21.15.163:0/3394956599 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f76f40ffd00 0x7f76f4195e30 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:42.098 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.043+0000 7f76fbe33700 1 -- 172.21.15.163:0/3394956599 >> 172.21.15.163:0/3394956599 conn(0x7f76f40fa130 msgr2=0x7f76f40687b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:12:42.098 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.043+0000 7f76fbe33700 1 -- 172.21.15.163:0/3394956599 shutdown_connections 2023-07-14T18:12:42.098 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.043+0000 7f76fbe33700 1 -- 172.21.15.163:0/3394956599 wait complete. 2023-07-14T18:12:42.099 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2023-07-14T18:12:42.122 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:12:41 smithi163 ceph-mon[96576]: from='client.? 172.21.15.163:0/2353231078' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-07-14T18:12:42.122 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:12:41 smithi163 ceph-mon[96576]: from='client.? 172.21.15.163:0/1864866315' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2023-07-14T18:12:42.122 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:12:41 smithi163 ceph-mon[96576]: pgmap v299: 129 pgs: 129 active+clean; 643 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-07-14T18:12:42.122 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:12:41 smithi163 ceph-mon[96576]: from='client.? 172.21.15.163:0/1831197290' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-07-14T18:12:42.175 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:12:41 smithi184 ceph-mon[98481]: from='client.? 172.21.15.163:0/2353231078' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-07-14T18:12:42.175 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:12:41 smithi184 ceph-mon[98481]: from='client.? 172.21.15.163:0/1864866315' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2023-07-14T18:12:42.176 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:12:41 smithi184 ceph-mon[98481]: pgmap v299: 129 pgs: 129 active+clean; 643 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-07-14T18:12:42.176 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:12:41 smithi184 ceph-mon[98481]: from='client.? 172.21.15.163:0/1831197290' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-07-14T18:12:42.221 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.181+0000 7f87c89be700 1 -- 172.21.15.163:0/3151190702 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f87c40ff470 msgr2=0x7f87c40ff8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:12:42.222 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.181+0000 7f87c89be700 1 --2- 172.21.15.163:0/3151190702 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f87c40ff470 0x7f87c40ff8c0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f87b400aaa0 tx=0x7f87b400adb0 comp rx=0 tx=0).stop 2023-07-14T18:12:42.222 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.181+0000 7f87c89be700 1 -- 172.21.15.163:0/3151190702 shutdown_connections 2023-07-14T18:12:42.222 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.181+0000 7f87c89be700 1 --2- 172.21.15.163:0/3151190702 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f87c40fe280 0x7f87c40fe690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:42.222 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.181+0000 7f87c89be700 1 --2- 172.21.15.163:0/3151190702 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f87c40ffe00 0x7f87c41066c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:42.222 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.181+0000 7f87c89be700 1 --2- 172.21.15.163:0/3151190702 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f87c40ff470 0x7f87c40ff8c0 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:42.222 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.181+0000 7f87c89be700 1 -- 172.21.15.163:0/3151190702 >> 172.21.15.163:0/3151190702 conn(0x7f87c40f98a0 msgr2=0x7f87c40fbcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:12:42.223 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.181+0000 7f87c89be700 1 -- 172.21.15.163:0/3151190702 shutdown_connections 2023-07-14T18:12:42.223 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.181+0000 7f87c89be700 1 -- 172.21.15.163:0/3151190702 wait complete. 2023-07-14T18:12:42.224 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.182+0000 7f87c89be700 1 Processor -- start 2023-07-14T18:12:42.225 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.182+0000 7f87c89be700 1 -- start start 2023-07-14T18:12:42.225 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.182+0000 7f87c89be700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f87c40fe280 0x7f87c41958c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:12:42.225 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.182+0000 7f87c89be700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f87c40ff470 0x7f87c4195e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:12:42.225 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.182+0000 7f87c89be700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f87c40ffe00 0x7f87c419ce70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:12:42.225 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.182+0000 7f87c89be700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87c419d440 con 0x7f87c40ffe00 2023-07-14T18:12:42.225 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.182+0000 7f87c89be700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87c419d580 con 0x7f87c40ff470 2023-07-14T18:12:42.225 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.182+0000 7f87c89be700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87c419d710 con 0x7f87c40fe280 2023-07-14T18:12:42.226 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.182+0000 7f87c2d9d700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f87c40ffe00 0x7f87c419ce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:12:42.226 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.182+0000 7f87c2d9d700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f87c40ffe00 0x7f87c419ce70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:57512/0 (socket says 172.21.15.163:57512) 2023-07-14T18:12:42.226 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.182+0000 7f87c2d9d700 1 -- 172.21.15.163:0/893110476 learned_addr learned my addr 172.21.15.163:0/893110476 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:12:42.226 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.182+0000 7f87c259c700 1 --2- 172.21.15.163:0/893110476 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f87c40fe280 0x7f87c41958c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:12:42.226 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.182+0000 7f87c1d9b700 1 --2- 172.21.15.163:0/893110476 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f87c40ff470 0x7f87c4195e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:12:42.226 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.182+0000 7f87c2d9d700 1 -- 172.21.15.163:0/893110476 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f87c40fe280 msgr2=0x7f87c41958c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:12:42.226 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.182+0000 7f87c2d9d700 1 --2- 172.21.15.163:0/893110476 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f87c40fe280 0x7f87c41958c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:42.227 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.182+0000 7f87c2d9d700 1 -- 172.21.15.163:0/893110476 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f87c40ff470 msgr2=0x7f87c4195e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:12:42.227 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.182+0000 7f87c2d9d700 1 --2- 172.21.15.163:0/893110476 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f87c40ff470 0x7f87c4195e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:42.227 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.182+0000 7f87c2d9d700 1 -- 172.21.15.163:0/893110476 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87bc009c40 con 0x7f87c40ffe00 2023-07-14T18:12:42.227 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.182+0000 7f87c1d9b700 1 --2- 172.21.15.163:0/893110476 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f87c40ff470 0x7f87c4195e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T18:12:42.227 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.182+0000 7f87c2d9d700 1 --2- 172.21.15.163:0/893110476 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f87c40ffe00 0x7f87c419ce70 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f87bc00c370 tx=0x7f87bc00c680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:12:42.227 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.183+0000 7f87b37fe700 1 -- 172.21.15.163:0/893110476 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87bc017070 con 0x7f87c40ffe00 2023-07-14T18:12:42.227 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.183+0000 7f87b37fe700 1 -- 172.21.15.163:0/893110476 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f87bc00f040 con 0x7f87c40ffe00 2023-07-14T18:12:42.227 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.183+0000 7f87c89be700 1 -- 172.21.15.163:0/893110476 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f87b400a700 con 0x7f87c40ffe00 2023-07-14T18:12:42.228 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.183+0000 7f87b37fe700 1 -- 172.21.15.163:0/893110476 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87bc00e050 con 0x7f87c40ffe00 2023-07-14T18:12:42.228 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.183+0000 7f87c89be700 1 -- 172.21.15.163:0/893110476 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f87c419dd10 con 0x7f87c40ffe00 2023-07-14T18:12:42.232 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.185+0000 7f87b37fe700 1 -- 172.21.15.163:0/893110476 <== mon.0 v2:172.21.15.163:3300/0 4 ==== mgrmap(e 17) v1 ==== 135767+0+0 (secure 0 0 0) 0x7f87bc003a00 con 0x7f87c40ffe00 2023-07-14T18:12:42.233 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.185+0000 7f87b37fe700 1 --2- 172.21.15.163:0/893110476 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f87ac0a11e0 0x7f87ac0a3690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:12:42.233 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.185+0000 7f87c259c700 1 --2- 172.21.15.163:0/893110476 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f87ac0a11e0 0x7f87ac0a3690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:12:42.233 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.185+0000 7f87b37fe700 1 -- 172.21.15.163:0/893110476 <== mon.0 v2:172.21.15.163:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 9020+0+0 (secure 0 0 0) 0x7f87bc0cc700 con 0x7f87c40ffe00 2023-07-14T18:12:42.233 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.186+0000 7f87c259c700 1 --2- 172.21.15.163:0/893110476 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f87ac0a11e0 0x7f87ac0a3690 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f87c40ff2d0 tx=0x7f87b8009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:12:42.233 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.186+0000 7f87d4b56b80 1 Processor -- start 2023-07-14T18:12:42.233 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.186+0000 7f87d4b56b80 1 -- start start 2023-07-14T18:12:42.233 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.186+0000 7f87d4b56b80 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x557aa3d9f2d0 0x557aa3d9f6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:12:42.234 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.186+0000 7f87d4b56b80 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x557aa3d9fc20 0x557aa3da02b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:12:42.234 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.186+0000 7f87d4b56b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557aa3da0840 0x557aa3da0c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:12:42.234 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.186+0000 7f87d4b56b80 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x557aa3c9fc60 con 0x557aa3d9f2d0 2023-07-14T18:12:42.234 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.186+0000 7f87d4b56b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x557aa3cf29f0 con 0x557aa3da0840 2023-07-14T18:12:42.234 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.186+0000 7f87d4b56b80 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x557aa3cebe80 con 0x557aa3d9fc20 2023-07-14T18:12:42.234 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.187+0000 7f87c259c700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x557aa3d9f2d0 0x557aa3d9f6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:12:42.234 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.187+0000 7f87c259c700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x557aa3d9f2d0 0x557aa3d9f6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:57516/0 (socket says 172.21.15.163:57516) 2023-07-14T18:12:42.234 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.187+0000 7f87c259c700 1 -- 172.21.15.163:0/3114712779 learned_addr learned my addr 172.21.15.163:0/3114712779 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:12:42.235 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.187+0000 7f87c1d9b700 1 --2- 172.21.15.163:0/3114712779 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x557aa3d9fc20 0x557aa3da02b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:12:42.235 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.187+0000 7f87c2d9d700 1 --2- 172.21.15.163:0/3114712779 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557aa3da0840 0x557aa3da0c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:12:42.235 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.187+0000 7f87c259c700 1 -- 172.21.15.163:0/3114712779 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x557aa3d9fc20 msgr2=0x557aa3da02b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:12:42.235 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.187+0000 7f87c259c700 1 --2- 172.21.15.163:0/3114712779 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x557aa3d9fc20 0x557aa3da02b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:42.235 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.187+0000 7f87c259c700 1 -- 172.21.15.163:0/3114712779 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557aa3da0840 msgr2=0x557aa3da0c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:12:42.235 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.187+0000 7f87c259c700 1 --2- 172.21.15.163:0/3114712779 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557aa3da0840 0x557aa3da0c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:42.235 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.187+0000 7f87c259c700 1 -- 172.21.15.163:0/3114712779 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557aa3b19d90 con 0x557aa3d9f2d0 2023-07-14T18:12:42.236 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.187+0000 7f87c2d9d700 1 --2- 172.21.15.163:0/3114712779 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557aa3da0840 0x557aa3da0c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T18:12:42.236 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.187+0000 7f87c259c700 1 --2- 172.21.15.163:0/3114712779 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x557aa3d9f2d0 0x557aa3d9f6e0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f87b8011d50 tx=0x7f87b8014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a063611d376e9b17 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:12:42.236 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.187+0000 7f87b0ff9700 1 -- 172.21.15.163:0/3114712779 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87b800ed20 con 0x557aa3d9f2d0 2023-07-14T18:12:42.236 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.187+0000 7f87b0ff9700 1 -- 172.21.15.163:0/3114712779 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f87b8021070 con 0x557aa3d9f2d0 2023-07-14T18:12:42.236 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.187+0000 7f87b0ff9700 1 -- 172.21.15.163:0/3114712779 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87b801d670 con 0x557aa3d9f2d0 2023-07-14T18:12:42.236 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.188+0000 7f87d4b56b80 1 -- 172.21.15.163:0/3114712779 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x557aa3d9f2d0 msgr2=0x557aa3d9f6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:12:42.236 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.188+0000 7f87d4b56b80 1 --2- 172.21.15.163:0/3114712779 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x557aa3d9f2d0 0x557aa3d9f6e0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f87b8011d50 tx=0x7f87b8014000 comp rx=0 tx=0).stop 2023-07-14T18:12:42.236 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.188+0000 7f87d4b56b80 1 -- 172.21.15.163:0/3114712779 shutdown_connections 2023-07-14T18:12:42.237 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.188+0000 7f87d4b56b80 1 --2- 172.21.15.163:0/3114712779 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557aa3da0840 0x557aa3da0c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:42.237 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.188+0000 7f87d4b56b80 1 --2- 172.21.15.163:0/3114712779 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x557aa3d9f2d0 0x557aa3d9f6e0 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:42.237 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.188+0000 7f87d4b56b80 1 --2- 172.21.15.163:0/3114712779 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x557aa3d9fc20 0x557aa3da02b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:42.237 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.188+0000 7f87d4b56b80 1 -- 172.21.15.163:0/3114712779 >> 172.21.15.163:0/3114712779 conn(0x557aa3d90630 msgr2=0x557aa3d95980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:12:42.237 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.188+0000 7f87d4b56b80 1 -- 172.21.15.163:0/3114712779 shutdown_connections 2023-07-14T18:12:42.237 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.188+0000 7f87d4b56b80 1 -- 172.21.15.163:0/3114712779 wait complete. 2023-07-14T18:12:42.237 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.188+0000 7f87d4b56b80 1 -- start start 2023-07-14T18:12:42.238 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.188+0000 7f87d4b56b80 1 Processor -- start 2023-07-14T18:12:42.238 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.189+0000 7f87d4b56b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557aa3d9f2d0 0x557aa3da8d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:12:42.238 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.189+0000 7f87d4b56b80 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x557aa3d9fc20 0x557aa3da9270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:12:42.238 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.189+0000 7f87d4b56b80 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x557aa3da0840 0x557aa3db02b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:12:42.238 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.189+0000 7f87d4b56b80 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x557aa3c8ba70 con 0x557aa3da0840 2023-07-14T18:12:42.238 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.189+0000 7f87d4b56b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x557aa3c8b770 con 0x557aa3d9f2d0 2023-07-14T18:12:42.238 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.189+0000 7f87d4b56b80 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x557aa3b6f8d0 con 0x557aa3d9fc20 2023-07-14T18:12:42.238 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.189+0000 7f87d4b56b80 10 client.0 _ll_register_callbacks cb 0x557aa3c89710 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T18:12:42.239 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.189+0000 7f87c2d9d700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x557aa3da0840 0x557aa3db02b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:12:42.239 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.189+0000 7f87c2d9d700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x557aa3da0840 0x557aa3db02b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:57526/0 (socket says 172.21.15.163:57526) 2023-07-14T18:12:42.239 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.189+0000 7f87c2d9d700 1 -- 172.21.15.163:0/3981474327 learned_addr learned my addr 172.21.15.163:0/3981474327 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:12:42.239 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.189+0000 7f87c1d9b700 1 --2- 172.21.15.163:0/3981474327 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x557aa3d9fc20 0x557aa3da9270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:12:42.239 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.189+0000 7f87c259c700 1 --2- 172.21.15.163:0/3981474327 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557aa3d9f2d0 0x557aa3da8d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:12:42.239 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.189+0000 7f87c2d9d700 1 -- 172.21.15.163:0/3981474327 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x557aa3d9fc20 msgr2=0x557aa3da9270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:12:42.239 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.189+0000 7f87c2d9d700 1 --2- 172.21.15.163:0/3981474327 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x557aa3d9fc20 0x557aa3da9270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:42.239 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.189+0000 7f87c2d9d700 1 -- 172.21.15.163:0/3981474327 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557aa3d9f2d0 msgr2=0x557aa3da8d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:12:42.240 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.189+0000 7f87c2d9d700 1 --2- 172.21.15.163:0/3981474327 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557aa3d9f2d0 0x557aa3da8d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:42.240 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.189+0000 7f87c2d9d700 1 -- 172.21.15.163:0/3981474327 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f87b8017070 con 0x557aa3da0840 2023-07-14T18:12:42.240 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.189+0000 7f87c2d9d700 1 --2- 172.21.15.163:0/3981474327 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x557aa3da0840 0x557aa3db02b0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f87bc000f80 tx=0x7f87bc099790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c2902b7003fc29e server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:12:42.240 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.189+0000 7f87a9ffb700 10 client.0 ms_handle_connect on v2:172.21.15.163:3300/0 2023-07-14T18:12:42.240 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.189+0000 7f87a9ffb700 1 -- 172.21.15.163:0/3981474327 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87bc0a1af0 con 0x557aa3da0840 2023-07-14T18:12:42.240 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.189+0000 7f87a9ffb700 1 -- 172.21.15.163:0/3981474327 <== mon.0 v2:172.21.15.163:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 9020+0+0 (secure 0 0 0) 0x7f87bc009040 con 0x557aa3da0840 2023-07-14T18:12:42.240 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.189+0000 7f87d4b56b80 1 -- 172.21.15.163:0/3981474327 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x557aa3c454a0 con 0x557aa3da0840 2023-07-14T18:12:42.241 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.190+0000 7f87a9ffb700 1 -- 172.21.15.163:0/3981474327 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7f87bc0c9ff0 con 0x557aa3da0840 2023-07-14T18:12:42.241 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.190+0000 7f87d4b56b80 10 client.15462 fetch_fsmap learned FSMap version 28 2023-07-14T18:12:42.241 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.190+0000 7f87d4b56b80 1 -- 172.21.15.163:0/3981474327 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) v3 -- 0x557aa3b02c10 con 0x557aa3da0840 2023-07-14T18:12:42.241 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.190+0000 7f87a9ffb700 1 -- 172.21.15.163:0/3981474327 <== mon.0 v2:172.21.15.163:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x557aa3c454a0 con 0x557aa3da0840 2023-07-14T18:12:42.241 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.190+0000 7f87a9ffb700 1 -- 172.21.15.163:0/3981474327 <== mon.0 v2:172.21.15.163:3300/0 5 ==== fsmap(e 28) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f87bc0a1660 con 0x557aa3da0840 2023-07-14T18:12:42.241 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.190+0000 7f87d4b56b80 10 client.15462 fetch_fsmap finished waiting for FSMap version 28 2023-07-14T18:12:42.241 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.190+0000 7f87d4b56b80 10 client.15462 resolve_mds: resolved name 'c' to daemon mds.c 2023-07-14T18:12:42.241 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.190+0000 7f87d4b56b80 20 client.15462 populate_metadata read hostname 'smithi163' 2023-07-14T18:12:42.242 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.190+0000 7f87d4b56b80 1 --2- 172.21.15.163:0/3981474327 >> [v2:172.21.15.184:6836/3389277679,v1:172.21.15.184:6837/3389277679] conn(0x557aa3db3ee0 0x557aa3db3320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:12:42.242 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.190+0000 7f87d4b56b80 4 client.15462 mds_command: new command op to 24478 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-14T18:12:42.242 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.190+0000 7f87d4b56b80 1 -- 172.21.15.163:0/3981474327 --> [v2:172.21.15.184:6836/3389277679,v1:172.21.15.184:6837/3389277679] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x557aa3d69d50 con 0x557aa3db3ee0 2023-07-14T18:12:42.242 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.190+0000 7f87c259c700 1 --2- 172.21.15.163:0/3981474327 >> [v2:172.21.15.184:6836/3389277679,v1:172.21.15.184:6837/3389277679] conn(0x557aa3db3ee0 0x557aa3db3320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:12:42.242 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.191+0000 7f87a9ffb700 10 client.15462 ms_handle_connect on v2:172.21.15.184:6836/3389277679 2023-07-14T18:12:42.242 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.191+0000 7f87c259c700 1 --2- 172.21.15.163:0/3981474327 >> [v2:172.21.15.184:6836/3389277679,v1:172.21.15.184:6837/3389277679] conn(0x557aa3db3ee0 0x557aa3db3320 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=f43e4fcc7cdc8348 server_cookie=242052257b6197b2 in_seq=0 out_seq=0 2023-07-14T18:12:42.242 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.191+0000 7f87a9ffb700 1 -- 172.21.15.163:0/3981474327 <== mds.3 v2:172.21.15.184:6836/3389277679 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18017 (crc 0 0 0) 0x557aa3d69d50 con 0x557aa3db3ee0 2023-07-14T18:12:42.243 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.191+0000 7f87a9ffb700 10 client.15462 handle_command_reply: tid=0 2023-07-14T18:12:42.243 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.191+0000 7f87d4b56b80 1 client.15462 shutdown 2023-07-14T18:12:42.243 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.192+0000 7f87d4b56b80 1 -- 172.21.15.163:0/3981474327 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x557aa3da0840 msgr2=0x557aa3db02b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:12:42.243 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.192+0000 7f87d4b56b80 1 --2- 172.21.15.163:0/3981474327 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x557aa3da0840 0x557aa3db02b0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f87bc000f80 tx=0x7f87bc099790 comp rx=0 tx=0).stop 2023-07-14T18:12:42.243 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.192+0000 7f87d4b56b80 1 -- 172.21.15.163:0/3981474327 shutdown_connections 2023-07-14T18:12:42.243 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.192+0000 7f87d4b56b80 1 --2- 172.21.15.163:0/3981474327 >> [v2:172.21.15.184:6836/3389277679,v1:172.21.15.184:6837/3389277679] conn(0x557aa3db3ee0 0x557aa3db3320 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:42.243 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.192+0000 7f87d4b56b80 1 --2- 172.21.15.163:0/3981474327 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x557aa3da0840 0x557aa3db02b0 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:42.243 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.192+0000 7f87a9ffb700 0 client.15462 ms_handle_reset on v2:172.21.15.184:6836/3389277679 2023-07-14T18:12:42.244 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.192+0000 7f87d4b56b80 1 --2- 172.21.15.163:0/3981474327 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557aa3d9f2d0 0x557aa3da8d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:42.244 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.192+0000 7f87d4b56b80 1 --2- 172.21.15.163:0/3981474327 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x557aa3d9fc20 0x557aa3da9270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:42.244 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.192+0000 7f87d4b56b80 1 -- 172.21.15.163:0/3981474327 >> 172.21.15.163:0/3981474327 conn(0x557aa3d90630 msgr2=0x557aa3d94600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:12:42.244 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.192+0000 7f87d4b56b80 1 -- 172.21.15.163:0/3981474327 shutdown_connections 2023-07-14T18:12:42.244 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.192+0000 7f87d4b56b80 1 -- 172.21.15.163:0/3981474327 wait complete. 2023-07-14T18:12:42.244 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.192+0000 7f87d4b56b80 20 client.15462 trim_cache size 0 max 16384 2023-07-14T18:12:42.250 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.209+0000 7f87d4b56b80 1 Processor -- start 2023-07-14T18:12:42.250 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.209+0000 7f87d4b56b80 1 -- start start 2023-07-14T18:12:42.251 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.209+0000 7f87d4b56b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557aa3d9f2d0 0x557aa3db3320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:12:42.251 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.209+0000 7f87d4b56b80 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x557aa3d9fc20 0x557aa3db0270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:12:42.251 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.209+0000 7f87d4b56b80 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x557aa3da0840 0x557aa3da6b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:12:42.251 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.209+0000 7f87d4b56b80 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x557aa3d69d80 con 0x557aa3da0840 2023-07-14T18:12:42.251 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.209+0000 7f87d4b56b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x557aa3c454d0 con 0x557aa3d9f2d0 2023-07-14T18:12:42.251 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.209+0000 7f87d4b56b80 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x557aa3cba790 con 0x557aa3d9fc20 2023-07-14T18:12:42.251 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.209+0000 7f87c2d9d700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x557aa3da0840 0x557aa3da6b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:12:42.252 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.209+0000 7f87c2d9d700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x557aa3da0840 0x557aa3da6b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:57534/0 (socket says 172.21.15.163:57534) 2023-07-14T18:12:42.252 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.209+0000 7f87c2d9d700 1 -- 172.21.15.163:0/232003099 learned_addr learned my addr 172.21.15.163:0/232003099 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:12:42.252 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.209+0000 7f87c259c700 1 --2- 172.21.15.163:0/232003099 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557aa3d9f2d0 0x557aa3db3320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:12:42.252 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.209+0000 7f87c1d9b700 1 --2- 172.21.15.163:0/232003099 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x557aa3d9fc20 0x557aa3db0270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:12:42.252 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.209+0000 7f87c2d9d700 1 -- 172.21.15.163:0/232003099 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x557aa3d9fc20 msgr2=0x557aa3db0270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:12:42.252 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.209+0000 7f87c2d9d700 1 --2- 172.21.15.163:0/232003099 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x557aa3d9fc20 0x557aa3db0270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:42.252 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.209+0000 7f87c2d9d700 1 -- 172.21.15.163:0/232003099 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557aa3d9f2d0 msgr2=0x557aa3db3320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:12:42.252 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.209+0000 7f87c2d9d700 1 --2- 172.21.15.163:0/232003099 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557aa3d9f2d0 0x557aa3db3320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:42.253 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.209+0000 7f87c2d9d700 1 -- 172.21.15.163:0/232003099 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557aa3b40200 con 0x557aa3da0840 2023-07-14T18:12:42.253 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.209+0000 7f87c259c700 1 --2- 172.21.15.163:0/232003099 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557aa3d9f2d0 0x557aa3db3320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T18:12:42.253 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.209+0000 7f87c1d9b700 1 --2- 172.21.15.163:0/232003099 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x557aa3d9fc20 0x557aa3db0270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T18:12:42.253 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.209+0000 7f87c2d9d700 1 --2- 172.21.15.163:0/232003099 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x557aa3da0840 0x557aa3da6b80 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f87bc096110 tx=0x7f87bc099470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=495eb7372d236cc1 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:12:42.253 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.209+0000 7f87b17fa700 1 -- 172.21.15.163:0/232003099 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87bc0b0e40 con 0x557aa3da0840 2023-07-14T18:12:42.253 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.210+0000 7f87b17fa700 1 -- 172.21.15.163:0/232003099 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f87bc0a1af0 con 0x557aa3da0840 2023-07-14T18:12:42.253 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.210+0000 7f87b17fa700 1 -- 172.21.15.163:0/232003099 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87bc098b90 con 0x557aa3da0840 2023-07-14T18:12:42.254 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.210+0000 7f87d4b56b80 1 -- 172.21.15.163:0/232003099 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x557aa3da0840 msgr2=0x557aa3da6b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:12:42.254 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.210+0000 7f87d4b56b80 1 --2- 172.21.15.163:0/232003099 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x557aa3da0840 0x557aa3da6b80 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f87bc096110 tx=0x7f87bc099470 comp rx=0 tx=0).stop 2023-07-14T18:12:42.254 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.210+0000 7f87d4b56b80 1 -- 172.21.15.163:0/232003099 shutdown_connections 2023-07-14T18:12:42.254 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.210+0000 7f87d4b56b80 1 --2- 172.21.15.163:0/232003099 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x557aa3da0840 0x557aa3da6b80 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:42.254 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.210+0000 7f87d4b56b80 1 --2- 172.21.15.163:0/232003099 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557aa3d9f2d0 0x557aa3db3320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:42.254 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.210+0000 7f87d4b56b80 1 --2- 172.21.15.163:0/232003099 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x557aa3d9fc20 0x557aa3db0270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:42.254 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.210+0000 7f87d4b56b80 1 -- 172.21.15.163:0/232003099 >> 172.21.15.163:0/232003099 conn(0x557aa3d90630 msgr2=0x557aa3da7a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:12:42.254 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.210+0000 7f87d4b56b80 1 -- 172.21.15.163:0/232003099 shutdown_connections 2023-07-14T18:12:42.255 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.210+0000 7f87d4b56b80 1 -- 172.21.15.163:0/232003099 wait complete. 2023-07-14T18:12:42.257 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.210+0000 7f87d4b56b80 1 -- start start 2023-07-14T18:12:42.257 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.210+0000 7f87d4b56b80 1 Processor -- start 2023-07-14T18:12:42.258 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.211+0000 7f87d4b56b80 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x557aa3d9f2d0 0x557aa3dab4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:12:42.258 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.211+0000 7f87d4b56b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557aa3d9fc20 0x557aa3daba20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:12:42.258 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.211+0000 7f87d4b56b80 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x557aa3da0840 0x557aa3e07b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:12:42.258 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.211+0000 7f87d4b56b80 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x557aa3db03f0 con 0x557aa3da0840 2023-07-14T18:12:42.258 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.211+0000 7f87d4b56b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x557aa3db0560 con 0x557aa3d9fc20 2023-07-14T18:12:42.258 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.211+0000 7f87d4b56b80 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x557aa3e08080 con 0x557aa3d9f2d0 2023-07-14T18:12:42.258 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.211+0000 7f87d4b56b80 10 client.0 _ll_register_callbacks cb 0x7f87bc099270 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T18:12:42.259 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.211+0000 7f87c2d9d700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x557aa3da0840 0x557aa3e07b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:12:42.259 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.211+0000 7f87c2d9d700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x557aa3da0840 0x557aa3e07b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:57540/0 (socket says 172.21.15.163:57540) 2023-07-14T18:12:42.259 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.211+0000 7f87c2d9d700 1 -- 172.21.15.163:0/3943873603 learned_addr learned my addr 172.21.15.163:0/3943873603 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:12:42.259 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.211+0000 7f87c1d9b700 1 --2- 172.21.15.163:0/3943873603 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557aa3d9fc20 0x557aa3daba20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:12:42.259 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.211+0000 7f87c259c700 1 --2- 172.21.15.163:0/3943873603 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x557aa3d9f2d0 0x557aa3dab4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:12:42.259 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.211+0000 7f87c2d9d700 1 -- 172.21.15.163:0/3943873603 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x557aa3d9f2d0 msgr2=0x557aa3dab4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:12:42.259 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.211+0000 7f87c2d9d700 1 --2- 172.21.15.163:0/3943873603 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x557aa3d9f2d0 0x557aa3dab4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:42.259 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.211+0000 7f87c2d9d700 1 -- 172.21.15.163:0/3943873603 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557aa3d9fc20 msgr2=0x557aa3daba20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:12:42.260 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.211+0000 7f87c2d9d700 1 --2- 172.21.15.163:0/3943873603 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557aa3d9fc20 0x557aa3daba20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:42.260 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.211+0000 7f87c2d9d700 1 -- 172.21.15.163:0/3943873603 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x557aa3b02c10 con 0x557aa3da0840 2023-07-14T18:12:42.260 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.211+0000 7f87c2d9d700 1 --2- 172.21.15.163:0/3943873603 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x557aa3da0840 0x557aa3e07b40 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f87bc0840d0 tx=0x7f87bc0a1a10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=516c547278885ab7 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:12:42.260 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.211+0000 7f87a9ffb700 10 client.0 ms_handle_connect on v2:172.21.15.163:3300/0 2023-07-14T18:12:42.260 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.211+0000 7f87a9ffb700 1 -- 172.21.15.163:0/3943873603 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87bc098b90 con 0x557aa3da0840 2023-07-14T18:12:42.260 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.211+0000 7f87a9ffb700 1 -- 172.21.15.163:0/3943873603 <== mon.0 v2:172.21.15.163:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 9020+0+0 (secure 0 0 0) 0x7f87bc084150 con 0x557aa3da0840 2023-07-14T18:12:42.260 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.211+0000 7f87d4b56b80 1 -- 172.21.15.163:0/3943873603 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f87b8021070 con 0x557aa3da0840 2023-07-14T18:12:42.260 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.212+0000 7f87a9ffb700 1 -- 172.21.15.163:0/3943873603 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7f87bc098cf0 con 0x557aa3da0840 2023-07-14T18:12:42.261 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.212+0000 7f87d4b56b80 10 client.15468 fetch_fsmap learned FSMap version 28 2023-07-14T18:12:42.261 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.212+0000 7f87d4b56b80 1 -- 172.21.15.163:0/3943873603 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) v3 -- 0x557aa3b18260 con 0x557aa3da0840 2023-07-14T18:12:42.261 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.212+0000 7f87a9ffb700 1 -- 172.21.15.163:0/3943873603 <== mon.0 v2:172.21.15.163:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f87bc07c020 con 0x557aa3da0840 2023-07-14T18:12:42.261 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.212+0000 7f87a9ffb700 1 -- 172.21.15.163:0/3943873603 <== mon.0 v2:172.21.15.163:3300/0 5 ==== fsmap(e 28) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f87bc09ad00 con 0x557aa3da0840 2023-07-14T18:12:42.261 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.212+0000 7f87d4b56b80 10 client.15468 fetch_fsmap finished waiting for FSMap version 28 2023-07-14T18:12:42.261 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.212+0000 7f87d4b56b80 10 client.15468 resolve_mds: resolved name 'c' to daemon mds.c 2023-07-14T18:12:42.261 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.212+0000 7f87d4b56b80 20 client.15468 populate_metadata read hostname 'smithi163' 2023-07-14T18:12:42.262 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.212+0000 7f87d4b56b80 1 --2- 172.21.15.163:0/3943873603 >> [v2:172.21.15.184:6836/3389277679,v1:172.21.15.184:6837/3389277679] conn(0x557aa3e0c560 0x557aa3e09120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:12:42.262 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.212+0000 7f87d4b56b80 4 client.15468 mds_command: new command op to 24478 tid=0[{"prefix": "status"}] 2023-07-14T18:12:42.262 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.212+0000 7f87d4b56b80 1 -- 172.21.15.163:0/3943873603 --> [v2:172.21.15.184:6836/3389277679,v1:172.21.15.184:6837/3389277679] -- command(tid 0: {"prefix": "status"}) v1 -- 0x557aa3ce4e60 con 0x557aa3e0c560 2023-07-14T18:12:42.262 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.212+0000 7f87c259c700 1 --2- 172.21.15.163:0/3943873603 >> [v2:172.21.15.184:6836/3389277679,v1:172.21.15.184:6837/3389277679] conn(0x557aa3e0c560 0x557aa3e09120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:12:42.262 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.212+0000 7f87a9ffb700 10 client.15468 ms_handle_connect on v2:172.21.15.184:6836/3389277679 2023-07-14T18:12:42.262 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.212+0000 7f87c259c700 1 --2- 172.21.15.163:0/3943873603 >> [v2:172.21.15.184:6836/3389277679,v1:172.21.15.184:6837/3389277679] conn(0x557aa3e0c560 0x557aa3e09120 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=2e1df7c7aa7568c5 server_cookie=db691536b23eb873 in_seq=0 out_seq=0 2023-07-14T18:12:42.262 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.213+0000 7f87a9ffb700 1 -- 172.21.15.163:0/3943873603 <== mds.3 v2:172.21.15.184:6836/3389277679 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+332 (crc 0 0 0) 0x557aa3ce4e60 con 0x557aa3e0c560 2023-07-14T18:12:42.262 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.213+0000 7f87a9ffb700 10 client.15468 handle_command_reply: tid=0 2023-07-14T18:12:42.263 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.213+0000 7f87d4b56b80 1 client.15468 shutdown 2023-07-14T18:12:42.263 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.213+0000 7f87d4b56b80 1 -- 172.21.15.163:0/3943873603 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x557aa3da0840 msgr2=0x557aa3e07b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:12:42.263 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.213+0000 7f87d4b56b80 1 --2- 172.21.15.163:0/3943873603 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x557aa3da0840 0x557aa3e07b40 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f87bc0840d0 tx=0x7f87bc0a1a10 comp rx=0 tx=0).stop 2023-07-14T18:12:42.263 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.213+0000 7f87d4b56b80 1 -- 172.21.15.163:0/3943873603 shutdown_connections 2023-07-14T18:12:42.263 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.213+0000 7f87d4b56b80 1 --2- 172.21.15.163:0/3943873603 >> [v2:172.21.15.184:6836/3389277679,v1:172.21.15.184:6837/3389277679] conn(0x557aa3e0c560 0x557aa3e09120 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:42.263 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.213+0000 7f87d4b56b80 1 --2- 172.21.15.163:0/3943873603 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x557aa3d9f2d0 0x557aa3dab4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:42.263 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.213+0000 7f87a9ffb700 0 client.15468 ms_handle_reset on v2:172.21.15.184:6836/3389277679 2023-07-14T18:12:42.263 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.213+0000 7f87d4b56b80 1 --2- 172.21.15.163:0/3943873603 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x557aa3da0840 0x557aa3e07b40 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:42.264 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.213+0000 7f87d4b56b80 1 --2- 172.21.15.163:0/3943873603 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557aa3d9fc20 0x557aa3daba20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:42.264 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.213+0000 7f87d4b56b80 1 -- 172.21.15.163:0/3943873603 >> 172.21.15.163:0/3943873603 conn(0x557aa3d90630 msgr2=0x557aa3db3320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:12:42.264 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.213+0000 7f87d4b56b80 1 -- 172.21.15.163:0/3943873603 shutdown_connections 2023-07-14T18:12:42.264 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.213+0000 7f87d4b56b80 1 -- 172.21.15.163:0/3943873603 wait complete. 2023-07-14T18:12:42.264 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.213+0000 7f87d4b56b80 20 client.15468 trim_cache size 0 max 16384 2023-07-14T18:12:42.265 INFO:teuthology.orchestra.run.smithi163.stdout:{ 2023-07-14T18:12:42.265 INFO:teuthology.orchestra.run.smithi163.stdout: "cluster_fsid": "bf7326ec-2270-11ee-9b33-001a4aab830c", 2023-07-14T18:12:42.265 INFO:teuthology.orchestra.run.smithi163.stdout: "whoami": 3, 2023-07-14T18:12:42.265 INFO:teuthology.orchestra.run.smithi163.stdout: "id": 24478, 2023-07-14T18:12:42.265 INFO:teuthology.orchestra.run.smithi163.stdout: "want_state": "up:active", 2023-07-14T18:12:42.265 INFO:teuthology.orchestra.run.smithi163.stdout: "state": "up:active", 2023-07-14T18:12:42.265 INFO:teuthology.orchestra.run.smithi163.stdout: "fs_name": "cephfs", 2023-07-14T18:12:42.266 INFO:teuthology.orchestra.run.smithi163.stdout: "rank_uptime": 72.383945776999994, 2023-07-14T18:12:42.266 INFO:teuthology.orchestra.run.smithi163.stdout: "mdsmap_epoch": 28, 2023-07-14T18:12:42.266 INFO:teuthology.orchestra.run.smithi163.stdout: "osdmap_epoch": 86, 2023-07-14T18:12:42.266 INFO:teuthology.orchestra.run.smithi163.stdout: "osdmap_epoch_barrier": 84, 2023-07-14T18:12:42.266 INFO:teuthology.orchestra.run.smithi163.stdout: "uptime": 109.64126355499999 2023-07-14T18:12:42.266 INFO:teuthology.orchestra.run.smithi163.stdout:} 2023-07-14T18:12:42.267 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.213+0000 7f87c89be700 1 -- 172.21.15.163:0/893110476 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f87ac0a11e0 msgr2=0x7f87ac0a3690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:12:42.268 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.213+0000 7f87c89be700 1 --2- 172.21.15.163:0/893110476 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f87ac0a11e0 0x7f87ac0a3690 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f87c40ff2d0 tx=0x7f87b8009260 comp rx=0 tx=0).stop 2023-07-14T18:12:42.268 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.213+0000 7f87c89be700 1 -- 172.21.15.163:0/893110476 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f87c40ffe00 msgr2=0x7f87c419ce70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:12:42.268 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.213+0000 7f87c89be700 1 --2- 172.21.15.163:0/893110476 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f87c40ffe00 0x7f87c419ce70 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f87bc00c370 tx=0x7f87bc00c680 comp rx=0 tx=0).stop 2023-07-14T18:12:42.268 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.213+0000 7f87c89be700 1 -- 172.21.15.163:0/893110476 shutdown_connections 2023-07-14T18:12:42.268 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.213+0000 7f87c89be700 1 --2- 172.21.15.163:0/893110476 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f87ac0a11e0 0x7f87ac0a3690 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:42.268 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.213+0000 7f87c89be700 1 --2- 172.21.15.163:0/893110476 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f87c40fe280 0x7f87c41958c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:42.268 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.213+0000 7f87c89be700 1 --2- 172.21.15.163:0/893110476 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f87c40ffe00 0x7f87c419ce70 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:42.269 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.213+0000 7f87c89be700 1 --2- 172.21.15.163:0/893110476 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f87c40ff470 0x7f87c4195e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:42.269 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.213+0000 7f87c89be700 1 -- 172.21.15.163:0/893110476 >> 172.21.15.163:0/893110476 conn(0x7f87c40f98a0 msgr2=0x7f87c4104ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:12:42.269 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.214+0000 7f87c89be700 1 -- 172.21.15.163:0/893110476 shutdown_connections 2023-07-14T18:12:42.269 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.214+0000 7f87c89be700 1 -- 172.21.15.163:0/893110476 wait complete. 2023-07-14T18:12:42.269 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.h status 2023-07-14T18:12:42.276 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:12:41 smithi172 ceph-mon[97983]: from='client.? 172.21.15.163:0/2353231078' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-07-14T18:12:42.276 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:12:41 smithi172 ceph-mon[97983]: from='client.? 172.21.15.163:0/1864866315' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2023-07-14T18:12:42.276 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:12:41 smithi172 ceph-mon[97983]: pgmap v299: 129 pgs: 129 active+clean; 643 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-07-14T18:12:42.276 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:12:41 smithi172 ceph-mon[97983]: from='client.? 172.21.15.163:0/1831197290' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-07-14T18:12:42.432 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.391+0000 7fb15df88700 1 -- 172.21.15.163:0/3823133024 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fb1580ffdc0 msgr2=0x7fb158100230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:12:42.432 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.391+0000 7fb15df88700 1 --2- 172.21.15.163:0/3823133024 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fb1580ffdc0 0x7fb158100230 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7fb14c009990 tx=0x7fb14c009ca0 comp rx=0 tx=0).stop 2023-07-14T18:12:42.432 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.391+0000 7fb15df88700 1 -- 172.21.15.163:0/3823133024 shutdown_connections 2023-07-14T18:12:42.433 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.391+0000 7fb15df88700 1 --2- 172.21.15.163:0/3823133024 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb1580feb30 0x7fb1580fef40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:42.433 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.391+0000 7fb15df88700 1 --2- 172.21.15.163:0/3823133024 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb158100770 0x7fb158107010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:42.433 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.391+0000 7fb15df88700 1 --2- 172.21.15.163:0/3823133024 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fb1580ffdc0 0x7fb158100230 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:42.433 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.391+0000 7fb15df88700 1 -- 172.21.15.163:0/3823133024 >> 172.21.15.163:0/3823133024 conn(0x7fb1580fa150 msgr2=0x7fb1580fc580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:12:42.433 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.391+0000 7fb15df88700 1 -- 172.21.15.163:0/3823133024 shutdown_connections 2023-07-14T18:12:42.433 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.391+0000 7fb15df88700 1 -- 172.21.15.163:0/3823133024 wait complete. 2023-07-14T18:12:42.433 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.392+0000 7fb15df88700 1 Processor -- start 2023-07-14T18:12:42.434 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.392+0000 7fb15df88700 1 -- start start 2023-07-14T18:12:42.435 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.392+0000 7fb15df88700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb1580feb30 0x7fb158194770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:12:42.435 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.392+0000 7fb15df88700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb1580ffdc0 0x7fb158194cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:12:42.435 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.392+0000 7fb15df88700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fb158100770 0x7fb15819bd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:12:42.436 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.392+0000 7fb15df88700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb15819c2f0 con 0x7fb158100770 2023-07-14T18:12:42.436 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.392+0000 7fb15df88700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb15819c430 con 0x7fb1580feb30 2023-07-14T18:12:42.436 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.392+0000 7fb15df88700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb15819c5c0 con 0x7fb1580ffdc0 2023-07-14T18:12:42.436 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.392+0000 7fb157fff700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fb158100770 0x7fb15819bd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:12:42.436 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.392+0000 7fb157fff700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fb158100770 0x7fb15819bd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:57554/0 (socket says 172.21.15.163:57554) 2023-07-14T18:12:42.436 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.392+0000 7fb157fff700 1 -- 172.21.15.163:0/837900815 learned_addr learned my addr 172.21.15.163:0/837900815 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:12:42.436 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.392+0000 7fb156ffd700 1 --2- 172.21.15.163:0/837900815 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb1580ffdc0 0x7fb158194cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:12:42.437 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.392+0000 7fb1577fe700 1 --2- 172.21.15.163:0/837900815 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb1580feb30 0x7fb158194770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:12:42.437 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.392+0000 7fb157fff700 1 -- 172.21.15.163:0/837900815 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb1580ffdc0 msgr2=0x7fb158194cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:12:42.437 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.392+0000 7fb157fff700 1 --2- 172.21.15.163:0/837900815 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb1580ffdc0 0x7fb158194cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:42.437 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.392+0000 7fb157fff700 1 -- 172.21.15.163:0/837900815 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb1580feb30 msgr2=0x7fb158194770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:12:42.437 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.392+0000 7fb157fff700 1 --2- 172.21.15.163:0/837900815 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb1580feb30 0x7fb158194770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:42.437 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.392+0000 7fb157fff700 1 -- 172.21.15.163:0/837900815 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb14c0095f0 con 0x7fb158100770 2023-07-14T18:12:42.437 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.392+0000 7fb156ffd700 1 --2- 172.21.15.163:0/837900815 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb1580ffdc0 0x7fb158194cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T18:12:42.438 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.393+0000 7fb157fff700 1 --2- 172.21.15.163:0/837900815 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fb158100770 0x7fb15819bd20 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7fb15000ef30 tx=0x7fb15000c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:12:42.438 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.393+0000 7fb154ff9700 1 -- 172.21.15.163:0/837900815 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb150018070 con 0x7fb158100770 2023-07-14T18:12:42.438 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.393+0000 7fb15df88700 1 -- 172.21.15.163:0/837900815 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb15819c840 con 0x7fb158100770 2023-07-14T18:12:42.438 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.393+0000 7fb154ff9700 1 -- 172.21.15.163:0/837900815 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fb15000f040 con 0x7fb158100770 2023-07-14T18:12:42.438 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.393+0000 7fb154ff9700 1 -- 172.21.15.163:0/837900815 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb15000cc70 con 0x7fb158100770 2023-07-14T18:12:42.438 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.393+0000 7fb15df88700 1 -- 172.21.15.163:0/837900815 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb15819cd00 con 0x7fb158100770 2023-07-14T18:12:42.438 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.395+0000 7fb154ff9700 1 -- 172.21.15.163:0/837900815 <== mon.0 v2:172.21.15.163:3300/0 4 ==== mgrmap(e 17) v1 ==== 135767+0+0 (secure 0 0 0) 0x7fb150007500 con 0x7fb158100770 2023-07-14T18:12:42.446 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.395+0000 7fb154ff9700 1 --2- 172.21.15.163:0/837900815 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7fb1400a11e0 0x7fb1400a3690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:12:42.447 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.396+0000 7fb1577fe700 1 --2- 172.21.15.163:0/837900815 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7fb1400a11e0 0x7fb1400a3690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:12:42.447 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.396+0000 7fb154ff9700 1 -- 172.21.15.163:0/837900815 <== mon.0 v2:172.21.15.163:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 9020+0+0 (secure 0 0 0) 0x7fb1500cc910 con 0x7fb158100770 2023-07-14T18:12:42.447 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.396+0000 7fb1577fe700 1 --2- 172.21.15.163:0/837900815 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7fb1400a11e0 0x7fb1400a3690 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fb148005950 tx=0x7fb14800a300 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:12:42.447 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.396+0000 7fb16a120b80 1 Processor -- start 2023-07-14T18:12:42.447 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.396+0000 7fb16a120b80 1 -- start start 2023-07-14T18:12:42.448 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.396+0000 7fb16a120b80 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x564d29e86360 0x564d29e86770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:12:42.448 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.396+0000 7fb16a120b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564d29e84c40 0x564d29e850b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:12:42.448 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.397+0000 7fb16a120b80 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x564d29e855f0 0x564d29e91290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:12:42.448 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.397+0000 7fb16a120b80 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x564d29d89c60 con 0x564d29e855f0 2023-07-14T18:12:42.448 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.397+0000 7fb16a120b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x564d29ddc9f0 con 0x564d29e84c40 2023-07-14T18:12:42.448 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.397+0000 7fb16a120b80 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x564d29dd5e80 con 0x564d29e86360 2023-07-14T18:12:42.448 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.397+0000 7fb157fff700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x564d29e855f0 0x564d29e91290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:12:42.449 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.397+0000 7fb157fff700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x564d29e855f0 0x564d29e91290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:57562/0 (socket says 172.21.15.163:57562) 2023-07-14T18:12:42.449 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.397+0000 7fb157fff700 1 -- 172.21.15.163:0/1797723383 learned_addr learned my addr 172.21.15.163:0/1797723383 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:12:42.449 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.397+0000 7fb156ffd700 1 --2- 172.21.15.163:0/1797723383 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564d29e84c40 0x564d29e850b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:12:42.449 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.397+0000 7fb1577fe700 1 --2- 172.21.15.163:0/1797723383 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x564d29e86360 0x564d29e86770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:12:42.449 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.397+0000 7fb157fff700 1 -- 172.21.15.163:0/1797723383 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x564d29e86360 msgr2=0x564d29e86770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:12:42.449 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.397+0000 7fb157fff700 1 --2- 172.21.15.163:0/1797723383 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x564d29e86360 0x564d29e86770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:42.449 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.397+0000 7fb157fff700 1 -- 172.21.15.163:0/1797723383 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564d29e84c40 msgr2=0x564d29e850b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:12:42.449 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.397+0000 7fb157fff700 1 --2- 172.21.15.163:0/1797723383 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564d29e84c40 0x564d29e850b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:42.450 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.397+0000 7fb157fff700 1 -- 172.21.15.163:0/1797723383 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564d29c03d90 con 0x564d29e855f0 2023-07-14T18:12:42.450 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.397+0000 7fb1577fe700 1 --2- 172.21.15.163:0/1797723383 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x564d29e86360 0x564d29e86770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T18:12:42.450 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.397+0000 7fb157fff700 1 --2- 172.21.15.163:0/1797723383 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x564d29e855f0 0x564d29e91290 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7fb150095e40 tx=0x7fb150099840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b590ac86041d382a server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:12:42.450 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.397+0000 7fb13dffb700 1 -- 172.21.15.163:0/1797723383 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb15009d970 con 0x564d29e855f0 2023-07-14T18:12:42.450 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.397+0000 7fb13dffb700 1 -- 172.21.15.163:0/1797723383 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fb1500a1d00 con 0x564d29e855f0 2023-07-14T18:12:42.450 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.397+0000 7fb13dffb700 1 -- 172.21.15.163:0/1797723383 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb150099050 con 0x564d29e855f0 2023-07-14T18:12:42.450 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.398+0000 7fb16a120b80 1 -- 172.21.15.163:0/1797723383 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x564d29e855f0 msgr2=0x564d29e91290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:12:42.451 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.398+0000 7fb16a120b80 1 --2- 172.21.15.163:0/1797723383 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x564d29e855f0 0x564d29e91290 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7fb150095e40 tx=0x7fb150099840 comp rx=0 tx=0).stop 2023-07-14T18:12:42.451 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.398+0000 7fb16a120b80 1 -- 172.21.15.163:0/1797723383 shutdown_connections 2023-07-14T18:12:42.451 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.398+0000 7fb16a120b80 1 --2- 172.21.15.163:0/1797723383 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x564d29e86360 0x564d29e86770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:42.451 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.398+0000 7fb16a120b80 1 --2- 172.21.15.163:0/1797723383 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x564d29e855f0 0x564d29e91290 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:42.451 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.398+0000 7fb16a120b80 1 --2- 172.21.15.163:0/1797723383 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564d29e84c40 0x564d29e850b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:42.451 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.398+0000 7fb16a120b80 1 -- 172.21.15.163:0/1797723383 >> 172.21.15.163:0/1797723383 conn(0x564d29e7a630 msgr2=0x564d29e7f980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:12:42.451 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.398+0000 7fb16a120b80 1 -- 172.21.15.163:0/1797723383 shutdown_connections 2023-07-14T18:12:42.451 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.398+0000 7fb16a120b80 1 -- 172.21.15.163:0/1797723383 wait complete. 2023-07-14T18:12:42.452 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.398+0000 7fb16a120b80 1 -- start start 2023-07-14T18:12:42.452 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.399+0000 7fb16a120b80 1 Processor -- start 2023-07-14T18:12:42.452 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.399+0000 7fb16a120b80 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x564d29e84c40 0x564d29e92cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:12:42.452 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.399+0000 7fb16a120b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564d29e855f0 0x564d29e93210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:12:42.452 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.399+0000 7fb16a120b80 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x564d29e86360 0x564d29e9a250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:12:42.452 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.399+0000 7fb16a120b80 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x564d29d75a70 con 0x564d29e84c40 2023-07-14T18:12:42.452 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.399+0000 7fb16a120b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x564d29d75770 con 0x564d29e855f0 2023-07-14T18:12:42.453 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.399+0000 7fb16a120b80 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x564d29c598d0 con 0x564d29e86360 2023-07-14T18:12:42.453 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.399+0000 7fb16a120b80 10 client.0 _ll_register_callbacks cb 0x564d29d73710 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T18:12:42.453 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.399+0000 7fb1577fe700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x564d29e84c40 0x564d29e92cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:12:42.453 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.399+0000 7fb1577fe700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x564d29e84c40 0x564d29e92cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:57564/0 (socket says 172.21.15.163:57564) 2023-07-14T18:12:42.453 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.399+0000 7fb1577fe700 1 -- 172.21.15.163:0/3736670652 learned_addr learned my addr 172.21.15.163:0/3736670652 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:12:42.453 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.399+0000 7fb157fff700 1 --2- 172.21.15.163:0/3736670652 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x564d29e86360 0x564d29e9a250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:12:42.453 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.399+0000 7fb156ffd700 1 --2- 172.21.15.163:0/3736670652 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564d29e855f0 0x564d29e93210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:12:42.453 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.399+0000 7fb1577fe700 1 -- 172.21.15.163:0/3736670652 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x564d29e86360 msgr2=0x564d29e9a250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:12:42.454 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.399+0000 7fb1577fe700 1 --2- 172.21.15.163:0/3736670652 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x564d29e86360 0x564d29e9a250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:42.454 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.399+0000 7fb1577fe700 1 -- 172.21.15.163:0/3736670652 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564d29e855f0 msgr2=0x564d29e93210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:12:42.454 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.399+0000 7fb1577fe700 1 --2- 172.21.15.163:0/3736670652 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564d29e855f0 0x564d29e93210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:42.454 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.399+0000 7fb1577fe700 1 -- 172.21.15.163:0/3736670652 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb15819cd00 con 0x564d29e84c40 2023-07-14T18:12:42.454 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.399+0000 7fb1577fe700 1 --2- 172.21.15.163:0/3736670652 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x564d29e84c40 0x564d29e92cd0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7fb14801db10 tx=0x7fb1480047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6adf072405213246 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:12:42.454 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.399+0000 7fb136ffd700 10 client.0 ms_handle_connect on v2:172.21.15.163:3300/0 2023-07-14T18:12:42.454 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.399+0000 7fb136ffd700 1 -- 172.21.15.163:0/3736670652 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb148004a30 con 0x564d29e84c40 2023-07-14T18:12:42.455 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.399+0000 7fb136ffd700 1 -- 172.21.15.163:0/3736670652 <== mon.0 v2:172.21.15.163:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 9020+0+0 (secure 0 0 0) 0x7fb148004b90 con 0x564d29e84c40 2023-07-14T18:12:42.455 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.399+0000 7fb16a120b80 1 -- 172.21.15.163:0/3736670652 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x564d29d2f4a0 con 0x564d29e84c40 2023-07-14T18:12:42.455 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.400+0000 7fb136ffd700 1 -- 172.21.15.163:0/3736670652 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb148004d50 con 0x564d29e84c40 2023-07-14T18:12:42.455 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.400+0000 7fb16a120b80 10 client.15480 fetch_fsmap learned FSMap version 28 2023-07-14T18:12:42.455 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.400+0000 7fb16a120b80 1 -- 172.21.15.163:0/3736670652 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) v3 -- 0x564d29becc10 con 0x564d29e84c40 2023-07-14T18:12:42.455 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.400+0000 7fb136ffd700 1 -- 172.21.15.163:0/3736670652 <== mon.0 v2:172.21.15.163:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x564d29d2f4a0 con 0x564d29e84c40 2023-07-14T18:12:42.455 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.400+0000 7fb136ffd700 1 -- 172.21.15.163:0/3736670652 <== mon.0 v2:172.21.15.163:3300/0 5 ==== fsmap(e 28) v1 ==== 7470+0+0 (secure 0 0 0) 0x7fb148010900 con 0x564d29e84c40 2023-07-14T18:12:42.456 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.400+0000 7fb16a120b80 10 client.15480 fetch_fsmap finished waiting for FSMap version 28 2023-07-14T18:12:42.456 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.400+0000 7fb16a120b80 10 client.15480 resolve_mds: resolved name 'h' to daemon mds.h 2023-07-14T18:12:42.456 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.400+0000 7fb16a120b80 20 client.15480 populate_metadata read hostname 'smithi163' 2023-07-14T18:12:42.456 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.400+0000 7fb16a120b80 1 --2- 172.21.15.163:0/3736670652 >> [v2:172.21.15.172:6836/3783835012,v1:172.21.15.172:6837/3783835012] conn(0x564d29e9df70 0x564d29e9d350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:12:42.456 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.400+0000 7fb16a120b80 4 client.15480 mds_command: new command op to 24479 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-14T18:12:42.456 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.400+0000 7fb16a120b80 1 -- 172.21.15.163:0/3736670652 --> [v2:172.21.15.172:6836/3783835012,v1:172.21.15.172:6837/3783835012] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x564d29e53d50 con 0x564d29e9df70 2023-07-14T18:12:42.456 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.400+0000 7fb156ffd700 1 --2- 172.21.15.163:0/3736670652 >> [v2:172.21.15.172:6836/3783835012,v1:172.21.15.172:6837/3783835012] conn(0x564d29e9df70 0x564d29e9d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:12:42.457 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.401+0000 7fb136ffd700 10 client.15480 ms_handle_connect on v2:172.21.15.172:6836/3783835012 2023-07-14T18:12:42.457 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.401+0000 7fb156ffd700 1 --2- 172.21.15.163:0/3736670652 >> [v2:172.21.15.172:6836/3783835012,v1:172.21.15.172:6837/3783835012] conn(0x564d29e9df70 0x564d29e9d350 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=70bf76ac91144f42 server_cookie=1f769f71cbe1cee1 in_seq=0 out_seq=0 2023-07-14T18:12:42.457 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.402+0000 7fb136ffd700 1 -- 172.21.15.163:0/3736670652 <== mds.2 v2:172.21.15.172:6836/3783835012 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18017 (crc 0 0 0) 0x564d29e53d50 con 0x564d29e9df70 2023-07-14T18:12:42.457 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.402+0000 7fb136ffd700 10 client.15480 handle_command_reply: tid=0 2023-07-14T18:12:42.457 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.402+0000 7fb16a120b80 1 client.15480 shutdown 2023-07-14T18:12:42.457 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.402+0000 7fb16a120b80 1 -- 172.21.15.163:0/3736670652 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x564d29e84c40 msgr2=0x564d29e92cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:12:42.457 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.402+0000 7fb16a120b80 1 --2- 172.21.15.163:0/3736670652 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x564d29e84c40 0x564d29e92cd0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7fb14801db10 tx=0x7fb1480047c0 comp rx=0 tx=0).stop 2023-07-14T18:12:42.458 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.402+0000 7fb16a120b80 1 -- 172.21.15.163:0/3736670652 shutdown_connections 2023-07-14T18:12:42.458 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.402+0000 7fb16a120b80 1 --2- 172.21.15.163:0/3736670652 >> [v2:172.21.15.172:6836/3783835012,v1:172.21.15.172:6837/3783835012] conn(0x564d29e9df70 0x564d29e9d350 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:42.458 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.402+0000 7fb16a120b80 1 --2- 172.21.15.163:0/3736670652 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x564d29e86360 0x564d29e9a250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:42.458 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.402+0000 7fb136ffd700 0 client.15480 ms_handle_reset on v2:172.21.15.172:6836/3783835012 2023-07-14T18:12:42.458 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.402+0000 7fb16a120b80 1 --2- 172.21.15.163:0/3736670652 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x564d29e84c40 0x564d29e92cd0 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:42.458 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.402+0000 7fb16a120b80 1 --2- 172.21.15.163:0/3736670652 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564d29e855f0 0x564d29e93210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:42.458 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.402+0000 7fb16a120b80 1 -- 172.21.15.163:0/3736670652 >> 172.21.15.163:0/3736670652 conn(0x564d29e7a630 msgr2=0x564d29e7e600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:12:42.458 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.402+0000 7fb16a120b80 1 -- 172.21.15.163:0/3736670652 shutdown_connections 2023-07-14T18:12:42.459 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.402+0000 7fb16a120b80 1 -- 172.21.15.163:0/3736670652 wait complete. 2023-07-14T18:12:42.459 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.402+0000 7fb16a120b80 20 client.15480 trim_cache size 0 max 16384 2023-07-14T18:12:42.461 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.420+0000 7fb16a120b80 1 Processor -- start 2023-07-14T18:12:42.461 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.420+0000 7fb16a120b80 1 -- start start 2023-07-14T18:12:42.461 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.420+0000 7fb16a120b80 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x564d29e84c40 0x564d29e90e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:12:42.461 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.420+0000 7fb16a120b80 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x564d29e855f0 0x564d29e913a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:12:42.462 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.420+0000 7fb16a120b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564d29e86360 0x564d29e9a210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:12:42.462 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.420+0000 7fb16a120b80 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x564d29e93bd0 con 0x564d29e855f0 2023-07-14T18:12:42.462 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.420+0000 7fb16a120b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x564d29e53d50 con 0x564d29e86360 2023-07-14T18:12:42.462 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.420+0000 7fb16a120b80 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x564d29d7f470 con 0x564d29e84c40 2023-07-14T18:12:42.462 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.420+0000 7fb156ffd700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x564d29e855f0 0x564d29e913a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:12:42.462 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.420+0000 7fb156ffd700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x564d29e855f0 0x564d29e913a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:57574/0 (socket says 172.21.15.163:57574) 2023-07-14T18:12:42.462 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.420+0000 7fb156ffd700 1 -- 172.21.15.163:0/3547530514 learned_addr learned my addr 172.21.15.163:0/3547530514 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:12:42.462 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.420+0000 7fb1577fe700 1 --2- 172.21.15.163:0/3547530514 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x564d29e84c40 0x564d29e90e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:12:42.463 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.420+0000 7fb157fff700 1 --2- 172.21.15.163:0/3547530514 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564d29e86360 0x564d29e9a210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:12:42.463 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.420+0000 7fb156ffd700 1 -- 172.21.15.163:0/3547530514 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x564d29e84c40 msgr2=0x564d29e90e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:12:42.463 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.420+0000 7fb156ffd700 1 --2- 172.21.15.163:0/3547530514 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x564d29e84c40 0x564d29e90e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:42.463 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.420+0000 7fb156ffd700 1 -- 172.21.15.163:0/3547530514 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564d29e86360 msgr2=0x564d29e9a210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:12:42.463 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.420+0000 7fb156ffd700 1 --2- 172.21.15.163:0/3547530514 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564d29e86360 0x564d29e9a210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:42.463 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.420+0000 7fb156ffd700 1 -- 172.21.15.163:0/3547530514 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564d29c2a200 con 0x564d29e855f0 2023-07-14T18:12:42.463 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.420+0000 7fb1577fe700 1 --2- 172.21.15.163:0/3547530514 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x564d29e84c40 0x564d29e90e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T18:12:42.464 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.420+0000 7fb157fff700 1 --2- 172.21.15.163:0/3547530514 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564d29e86360 0x564d29e9a210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T18:12:42.464 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.420+0000 7fb156ffd700 1 --2- 172.21.15.163:0/3547530514 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x564d29e855f0 0x564d29e913a0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7fb14c00b2e0 tx=0x7fb14c009310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f1efe80d331b850f server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:12:42.464 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.421+0000 7fb13e7fc700 1 -- 172.21.15.163:0/3547530514 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb14c003a30 con 0x564d29e855f0 2023-07-14T18:12:42.464 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.421+0000 7fb13e7fc700 1 -- 172.21.15.163:0/3547530514 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fb14c01e040 con 0x564d29e855f0 2023-07-14T18:12:42.464 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.421+0000 7fb13e7fc700 1 -- 172.21.15.163:0/3547530514 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb14c00f6c0 con 0x564d29e855f0 2023-07-14T18:12:42.468 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.421+0000 7fb16a120b80 1 -- 172.21.15.163:0/3547530514 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x564d29e855f0 msgr2=0x564d29e913a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:12:42.468 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.421+0000 7fb16a120b80 1 --2- 172.21.15.163:0/3547530514 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x564d29e855f0 0x564d29e913a0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7fb14c00b2e0 tx=0x7fb14c009310 comp rx=0 tx=0).stop 2023-07-14T18:12:42.468 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.421+0000 7fb16a120b80 1 -- 172.21.15.163:0/3547530514 shutdown_connections 2023-07-14T18:12:42.468 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.421+0000 7fb16a120b80 1 --2- 172.21.15.163:0/3547530514 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x564d29e84c40 0x564d29e90e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:42.469 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.421+0000 7fb16a120b80 1 --2- 172.21.15.163:0/3547530514 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564d29e86360 0x564d29e9a210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:42.469 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.421+0000 7fb16a120b80 1 --2- 172.21.15.163:0/3547530514 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x564d29e855f0 0x564d29e913a0 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:42.469 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.421+0000 7fb16a120b80 1 -- 172.21.15.163:0/3547530514 >> 172.21.15.163:0/3547530514 conn(0x564d29e7a630 msgr2=0x564d29e9d350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:12:42.469 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.421+0000 7fb16a120b80 1 -- 172.21.15.163:0/3547530514 shutdown_connections 2023-07-14T18:12:42.469 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.421+0000 7fb16a120b80 1 -- 172.21.15.163:0/3547530514 wait complete. 2023-07-14T18:12:42.469 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.421+0000 7fb16a120b80 1 -- start start 2023-07-14T18:12:42.469 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.422+0000 7fb16a120b80 1 Processor -- start 2023-07-14T18:12:42.469 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.422+0000 7fb16a120b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564d29e84c40 0x564d29e975c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:12:42.470 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.422+0000 7fb16a120b80 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x564d29e855f0 0x564d29e97b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:12:42.470 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.422+0000 7fb16a120b80 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x564d29e86360 0x564d29e98b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:12:42.470 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.422+0000 7fb16a120b80 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x564d29e99050 con 0x564d29e855f0 2023-07-14T18:12:42.470 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.422+0000 7fb16a120b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x564d29e991c0 con 0x564d29e84c40 2023-07-14T18:12:42.470 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.422+0000 7fb16a120b80 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x564d29e99380 con 0x564d29e86360 2023-07-14T18:12:42.470 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.422+0000 7fb16a120b80 10 client.0 _ll_register_callbacks cb 0x7fb14801d430 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T18:12:42.470 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.422+0000 7fb156ffd700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x564d29e855f0 0x564d29e97b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:12:42.471 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.422+0000 7fb156ffd700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x564d29e855f0 0x564d29e97b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:57580/0 (socket says 172.21.15.163:57580) 2023-07-14T18:12:42.471 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.422+0000 7fb156ffd700 1 -- 172.21.15.163:0/2158780593 learned_addr learned my addr 172.21.15.163:0/2158780593 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:12:42.471 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.422+0000 7fb1577fe700 1 --2- 172.21.15.163:0/2158780593 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564d29e84c40 0x564d29e975c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:12:42.471 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.422+0000 7fb157fff700 1 --2- 172.21.15.163:0/2158780593 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x564d29e86360 0x564d29e98b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:12:42.471 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.422+0000 7fb156ffd700 1 -- 172.21.15.163:0/2158780593 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x564d29e86360 msgr2=0x564d29e98b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:12:42.471 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.422+0000 7fb156ffd700 1 --2- 172.21.15.163:0/2158780593 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x564d29e86360 0x564d29e98b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:42.471 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.422+0000 7fb156ffd700 1 -- 172.21.15.163:0/2158780593 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564d29e84c40 msgr2=0x564d29e975c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:12:42.471 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.422+0000 7fb156ffd700 1 --2- 172.21.15.163:0/2158780593 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564d29e84c40 0x564d29e975c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:42.472 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.422+0000 7fb156ffd700 1 -- 172.21.15.163:0/2158780593 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb158107880 con 0x564d29e855f0 2023-07-14T18:12:42.472 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.422+0000 7fb1577fe700 1 --2- 172.21.15.163:0/2158780593 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564d29e84c40 0x564d29e975c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T18:12:42.472 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.423+0000 7fb156ffd700 1 --2- 172.21.15.163:0/2158780593 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x564d29e855f0 0x564d29e97b00 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7fb14c000c00 tx=0x7fb14c00b710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa757ef685f2a9cc server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:12:42.472 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.423+0000 7fb136ffd700 10 client.0 ms_handle_connect on v2:172.21.15.163:3300/0 2023-07-14T18:12:42.472 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.423+0000 7fb136ffd700 1 -- 172.21.15.163:0/2158780593 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb14c003a30 con 0x564d29e855f0 2023-07-14T18:12:42.472 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.423+0000 7fb16a120b80 1 -- 172.21.15.163:0/2158780593 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fb1500a1d00 con 0x564d29e855f0 2023-07-14T18:12:42.473 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.423+0000 7fb136ffd700 1 -- 172.21.15.163:0/2158780593 <== mon.0 v2:172.21.15.163:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 9020+0+0 (secure 0 0 0) 0x7fb14c003b90 con 0x564d29e855f0 2023-07-14T18:12:42.473 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.423+0000 7fb136ffd700 1 -- 172.21.15.163:0/2158780593 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb14c00f460 con 0x564d29e855f0 2023-07-14T18:12:42.473 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.423+0000 7fb16a120b80 10 client.15486 fetch_fsmap learned FSMap version 28 2023-07-14T18:12:42.473 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.423+0000 7fb16a120b80 1 -- 172.21.15.163:0/2158780593 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) v3 -- 0x564d29c02260 con 0x564d29e855f0 2023-07-14T18:12:42.473 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.423+0000 7fb136ffd700 1 -- 172.21.15.163:0/2158780593 <== mon.0 v2:172.21.15.163:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fb1500a1d00 con 0x564d29e855f0 2023-07-14T18:12:42.473 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.423+0000 7fb136ffd700 1 -- 172.21.15.163:0/2158780593 <== mon.0 v2:172.21.15.163:3300/0 5 ==== fsmap(e 28) v1 ==== 7470+0+0 (secure 0 0 0) 0x7fb14c02f540 con 0x564d29e855f0 2023-07-14T18:12:42.473 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.423+0000 7fb16a120b80 10 client.15486 fetch_fsmap finished waiting for FSMap version 28 2023-07-14T18:12:42.474 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.423+0000 7fb16a120b80 10 client.15486 resolve_mds: resolved name 'h' to daemon mds.h 2023-07-14T18:12:42.474 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.423+0000 7fb16a120b80 20 client.15486 populate_metadata read hostname 'smithi163' 2023-07-14T18:12:42.474 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.423+0000 7fb16a120b80 1 --2- 172.21.15.163:0/2158780593 >> [v2:172.21.15.172:6836/3783835012,v1:172.21.15.172:6837/3783835012] conn(0x564d29e9df70 0x564d29ef3c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:12:42.474 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.423+0000 7fb16a120b80 4 client.15486 mds_command: new command op to 24479 tid=0[{"prefix": "status"}] 2023-07-14T18:12:42.474 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.423+0000 7fb16a120b80 1 -- 172.21.15.163:0/2158780593 --> [v2:172.21.15.172:6836/3783835012,v1:172.21.15.172:6837/3783835012] -- command(tid 0: {"prefix": "status"}) v1 -- 0x564d29dcee60 con 0x564d29e9df70 2023-07-14T18:12:42.475 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.423+0000 7fb1577fe700 1 --2- 172.21.15.163:0/2158780593 >> [v2:172.21.15.172:6836/3783835012,v1:172.21.15.172:6837/3783835012] conn(0x564d29e9df70 0x564d29ef3c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:12:42.475 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.424+0000 7fb136ffd700 10 client.15486 ms_handle_connect on v2:172.21.15.172:6836/3783835012 2023-07-14T18:12:42.475 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.424+0000 7fb1577fe700 1 --2- 172.21.15.163:0/2158780593 >> [v2:172.21.15.172:6836/3783835012,v1:172.21.15.172:6837/3783835012] conn(0x564d29e9df70 0x564d29ef3c00 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=4d210e2ab5cf2d7f server_cookie=a63f78cf092d908e in_seq=0 out_seq=0 2023-07-14T18:12:42.476 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.424+0000 7fb136ffd700 1 -- 172.21.15.163:0/2158780593 <== mds.2 v2:172.21.15.172:6836/3783835012 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+332 (crc 0 0 0) 0x564d29dcee60 con 0x564d29e9df70 2023-07-14T18:12:42.476 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.424+0000 7fb136ffd700 10 client.15486 handle_command_reply: tid=0 2023-07-14T18:12:42.476 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.424+0000 7fb16a120b80 1 client.15486 shutdown 2023-07-14T18:12:42.476 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.424+0000 7fb16a120b80 1 -- 172.21.15.163:0/2158780593 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x564d29e855f0 msgr2=0x564d29e97b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:12:42.476 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.424+0000 7fb16a120b80 1 --2- 172.21.15.163:0/2158780593 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x564d29e855f0 0x564d29e97b00 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7fb14c000c00 tx=0x7fb14c00b710 comp rx=0 tx=0).stop 2023-07-14T18:12:42.476 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.424+0000 7fb16a120b80 1 -- 172.21.15.163:0/2158780593 shutdown_connections 2023-07-14T18:12:42.477 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.424+0000 7fb16a120b80 1 --2- 172.21.15.163:0/2158780593 >> [v2:172.21.15.172:6836/3783835012,v1:172.21.15.172:6837/3783835012] conn(0x564d29e9df70 0x564d29ef3c00 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:42.477 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.424+0000 7fb16a120b80 1 --2- 172.21.15.163:0/2158780593 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x564d29e86360 0x564d29e98b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:42.477 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.424+0000 7fb16a120b80 1 --2- 172.21.15.163:0/2158780593 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564d29e84c40 0x564d29e975c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:42.477 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.424+0000 7fb136ffd700 0 client.15486 ms_handle_reset on v2:172.21.15.172:6836/3783835012 2023-07-14T18:12:42.477 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.424+0000 7fb16a120b80 1 --2- 172.21.15.163:0/2158780593 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x564d29e855f0 0x564d29e97b00 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:42.477 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.424+0000 7fb16a120b80 1 -- 172.21.15.163:0/2158780593 >> 172.21.15.163:0/2158780593 conn(0x564d29e7a630 msgr2=0x564d29e8d9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:12:42.477 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.424+0000 7fb16a120b80 1 -- 172.21.15.163:0/2158780593 shutdown_connections 2023-07-14T18:12:42.478 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.424+0000 7fb16a120b80 1 -- 172.21.15.163:0/2158780593 wait complete. 2023-07-14T18:12:42.478 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.425+0000 7fb16a120b80 20 client.15486 trim_cache size 0 max 16384 2023-07-14T18:12:42.478 INFO:teuthology.orchestra.run.smithi163.stdout:{ 2023-07-14T18:12:42.478 INFO:teuthology.orchestra.run.smithi163.stdout: "cluster_fsid": "bf7326ec-2270-11ee-9b33-001a4aab830c", 2023-07-14T18:12:42.478 INFO:teuthology.orchestra.run.smithi163.stdout: "whoami": 2, 2023-07-14T18:12:42.479 INFO:teuthology.orchestra.run.smithi163.stdout: "id": 24479, 2023-07-14T18:12:42.479 INFO:teuthology.orchestra.run.smithi163.stdout: "want_state": "up:active", 2023-07-14T18:12:42.479 INFO:teuthology.orchestra.run.smithi163.stdout: "state": "up:active", 2023-07-14T18:12:42.479 INFO:teuthology.orchestra.run.smithi163.stdout: "fs_name": "cephfs", 2023-07-14T18:12:42.479 INFO:teuthology.orchestra.run.smithi163.stdout: "rank_uptime": 73.606835786000005, 2023-07-14T18:12:42.479 INFO:teuthology.orchestra.run.smithi163.stdout: "mdsmap_epoch": 28, 2023-07-14T18:12:42.479 INFO:teuthology.orchestra.run.smithi163.stdout: "osdmap_epoch": 86, 2023-07-14T18:12:42.480 INFO:teuthology.orchestra.run.smithi163.stdout: "osdmap_epoch_barrier": 84, 2023-07-14T18:12:42.480 INFO:teuthology.orchestra.run.smithi163.stdout: "uptime": 107.55566221399999 2023-07-14T18:12:42.480 INFO:teuthology.orchestra.run.smithi163.stdout:} 2023-07-14T18:12:42.481 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.425+0000 7fb15df88700 1 -- 172.21.15.163:0/837900815 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7fb1400a11e0 msgr2=0x7fb1400a3690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:12:42.481 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.425+0000 7fb15df88700 1 --2- 172.21.15.163:0/837900815 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7fb1400a11e0 0x7fb1400a3690 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fb148005950 tx=0x7fb14800a300 comp rx=0 tx=0).stop 2023-07-14T18:12:42.481 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.425+0000 7fb15df88700 1 -- 172.21.15.163:0/837900815 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fb158100770 msgr2=0x7fb15819bd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:12:42.481 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.425+0000 7fb15df88700 1 --2- 172.21.15.163:0/837900815 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fb158100770 0x7fb15819bd20 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7fb15000ef30 tx=0x7fb15000c3a0 comp rx=0 tx=0).stop 2023-07-14T18:12:42.482 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.425+0000 7fb15df88700 1 -- 172.21.15.163:0/837900815 shutdown_connections 2023-07-14T18:12:42.482 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.425+0000 7fb15df88700 1 --2- 172.21.15.163:0/837900815 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7fb1400a11e0 0x7fb1400a3690 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:42.482 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.425+0000 7fb15df88700 1 --2- 172.21.15.163:0/837900815 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fb158100770 0x7fb15819bd20 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:42.482 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.425+0000 7fb15df88700 1 --2- 172.21.15.163:0/837900815 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb1580feb30 0x7fb158194770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:42.482 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.425+0000 7fb15df88700 1 --2- 172.21.15.163:0/837900815 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb1580ffdc0 0x7fb158194cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:42.482 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.425+0000 7fb15df88700 1 -- 172.21.15.163:0/837900815 >> 172.21.15.163:0/837900815 conn(0x7fb1580fa150 msgr2=0x7fb1580fc3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:12:42.483 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.425+0000 7fb15df88700 1 -- 172.21.15.163:0/837900815 shutdown_connections 2023-07-14T18:12:42.483 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.425+0000 7fb15df88700 1 -- 172.21.15.163:0/837900815 wait complete. 2023-07-14T18:12:42.483 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.i status 2023-07-14T18:12:42.606 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.566+0000 7f17c4471700 1 -- 172.21.15.163:0/2396811026 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f17bc0feb10 msgr2=0x7f17bc0fef20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:12:42.607 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.566+0000 7f17c4471700 1 --2- 172.21.15.163:0/2396811026 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f17bc0feb10 0x7f17bc0fef20 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f17ac009990 tx=0x7f17ac009ca0 comp rx=0 tx=0).stop 2023-07-14T18:12:42.607 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.566+0000 7f17c4471700 1 -- 172.21.15.163:0/2396811026 shutdown_connections 2023-07-14T18:12:42.607 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.566+0000 7f17c4471700 1 --2- 172.21.15.163:0/2396811026 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f17bc100690 0x7f17bc106f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:42.607 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.566+0000 7f17c4471700 1 --2- 172.21.15.163:0/2396811026 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f17bc0feb10 0x7f17bc0fef20 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:42.607 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.566+0000 7f17c4471700 1 --2- 172.21.15.163:0/2396811026 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f17bc0ffd00 0x7f17bc100150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:42.607 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.566+0000 7f17c4471700 1 -- 172.21.15.163:0/2396811026 >> 172.21.15.163:0/2396811026 conn(0x7f17bc0fa130 msgr2=0x7f17bc0fc560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:12:42.607 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.566+0000 7f17c4471700 1 -- 172.21.15.163:0/2396811026 shutdown_connections 2023-07-14T18:12:42.608 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.566+0000 7f17c4471700 1 -- 172.21.15.163:0/2396811026 wait complete. 2023-07-14T18:12:42.608 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.566+0000 7f17c4471700 1 Processor -- start 2023-07-14T18:12:42.608 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.566+0000 7f17c4471700 1 -- start start 2023-07-14T18:12:42.609 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.566+0000 7f17c4471700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f17bc0feb10 0x7f17bc1958a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:12:42.610 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.566+0000 7f17c4471700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f17bc0ffd00 0x7f17bc195de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:12:42.610 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.566+0000 7f17c4471700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f17bc100690 0x7f17bc19ce50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:12:42.610 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.566+0000 7f17c4471700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17bc19d420 con 0x7f17bc0ffd00 2023-07-14T18:12:42.610 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.566+0000 7f17c4471700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17bc19d560 con 0x7f17bc0feb10 2023-07-14T18:12:42.610 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.566+0000 7f17c4471700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17bc19d6f0 con 0x7f17bc100690 2023-07-14T18:12:42.610 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.567+0000 7f17c1a0c700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f17bc0ffd00 0x7f17bc195de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:12:42.610 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.567+0000 7f17c1a0c700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f17bc0ffd00 0x7f17bc195de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:57594/0 (socket says 172.21.15.163:57594) 2023-07-14T18:12:42.611 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.567+0000 7f17c1a0c700 1 -- 172.21.15.163:0/16549005 learned_addr learned my addr 172.21.15.163:0/16549005 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:12:42.611 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.567+0000 7f17c2a0e700 1 --2- 172.21.15.163:0/16549005 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f17bc100690 0x7f17bc19ce50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:12:42.611 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.567+0000 7f17c220d700 1 --2- 172.21.15.163:0/16549005 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f17bc0feb10 0x7f17bc1958a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:12:42.611 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.567+0000 7f17c1a0c700 1 -- 172.21.15.163:0/16549005 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f17bc100690 msgr2=0x7f17bc19ce50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:12:42.611 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.567+0000 7f17c1a0c700 1 --2- 172.21.15.163:0/16549005 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f17bc100690 0x7f17bc19ce50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:42.611 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.567+0000 7f17c1a0c700 1 -- 172.21.15.163:0/16549005 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f17bc0feb10 msgr2=0x7f17bc1958a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:12:42.611 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.567+0000 7f17c1a0c700 1 --2- 172.21.15.163:0/16549005 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f17bc0feb10 0x7f17bc1958a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:42.612 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.567+0000 7f17c1a0c700 1 -- 172.21.15.163:0/16549005 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17ac0095f0 con 0x7f17bc0ffd00 2023-07-14T18:12:42.612 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.567+0000 7f17c220d700 1 --2- 172.21.15.163:0/16549005 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f17bc0feb10 0x7f17bc1958a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T18:12:42.612 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.567+0000 7f17c1a0c700 1 --2- 172.21.15.163:0/16549005 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f17bc0ffd00 0x7f17bc195de0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f17b800d950 tx=0x7f17b800dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:12:42.612 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.567+0000 7f17b37fe700 1 -- 172.21.15.163:0/16549005 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17b8009940 con 0x7f17bc0ffd00 2023-07-14T18:12:42.612 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.567+0000 7f17b37fe700 1 -- 172.21.15.163:0/16549005 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f17b8010460 con 0x7f17bc0ffd00 2023-07-14T18:12:42.612 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.567+0000 7f17b37fe700 1 -- 172.21.15.163:0/16549005 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17b800f620 con 0x7f17bc0ffd00 2023-07-14T18:12:42.612 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.567+0000 7f17c4471700 1 -- 172.21.15.163:0/16549005 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f17bc19d9d0 con 0x7f17bc0ffd00 2023-07-14T18:12:42.613 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.567+0000 7f17c4471700 1 -- 172.21.15.163:0/16549005 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f17bc19de90 con 0x7f17bc0ffd00 2023-07-14T18:12:42.613 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.569+0000 7f17b37fe700 1 -- 172.21.15.163:0/16549005 <== mon.0 v2:172.21.15.163:3300/0 4 ==== mgrmap(e 17) v1 ==== 135767+0+0 (secure 0 0 0) 0x7f17b80105d0 con 0x7f17bc0ffd00 2023-07-14T18:12:42.617 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.570+0000 7f17b37fe700 1 --2- 172.21.15.163:0/16549005 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f17a80a11e0 0x7f17a80a3690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:12:42.617 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.570+0000 7f17c220d700 1 --2- 172.21.15.163:0/16549005 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f17a80a11e0 0x7f17a80a3690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:12:42.617 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.570+0000 7f17b37fe700 1 -- 172.21.15.163:0/16549005 <== mon.0 v2:172.21.15.163:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 9020+0+0 (secure 0 0 0) 0x7f17b80ccc60 con 0x7f17bc0ffd00 2023-07-14T18:12:42.617 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.570+0000 7f17c220d700 1 --2- 172.21.15.163:0/16549005 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f17a80a11e0 0x7f17a80a3690 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f17ac00c010 tx=0x7f17ac00b540 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:12:42.617 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.571+0000 7f17d0609b80 1 Processor -- start 2023-07-14T18:12:42.618 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.571+0000 7f17d0609b80 1 -- start start 2023-07-14T18:12:42.618 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.571+0000 7f17d0609b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556a91816f10 0x556a91817320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:12:42.618 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.571+0000 7f17d0609b80 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x556a91817860 0x556a91817e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:12:42.618 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.571+0000 7f17d0609b80 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x556a91818460 0x556a918188d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:12:42.618 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.571+0000 7f17d0609b80 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x556a9171bc60 con 0x556a91817860 2023-07-14T18:12:42.618 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.571+0000 7f17d0609b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x556a9176e9f0 con 0x556a91816f10 2023-07-14T18:12:42.618 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.571+0000 7f17d0609b80 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x556a91767e80 con 0x556a91818460 2023-07-14T18:12:42.619 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.571+0000 7f17c1a0c700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x556a91817860 0x556a91817e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:12:42.619 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.571+0000 7f17c1a0c700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x556a91817860 0x556a91817e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:57602/0 (socket says 172.21.15.163:57602) 2023-07-14T18:12:42.619 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.571+0000 7f17c1a0c700 1 -- 172.21.15.163:0/1628665607 learned_addr learned my addr 172.21.15.163:0/1628665607 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:12:42.619 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.571+0000 7f17c220d700 1 --2- 172.21.15.163:0/1628665607 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556a91816f10 0x556a91817320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:12:42.619 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.572+0000 7f17c2a0e700 1 --2- 172.21.15.163:0/1628665607 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x556a91818460 0x556a918188d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:12:42.619 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.572+0000 7f17c1a0c700 1 -- 172.21.15.163:0/1628665607 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x556a91818460 msgr2=0x556a918188d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:12:42.619 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.572+0000 7f17c1a0c700 1 --2- 172.21.15.163:0/1628665607 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x556a91818460 0x556a918188d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:42.620 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.572+0000 7f17c1a0c700 1 -- 172.21.15.163:0/1628665607 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556a91816f10 msgr2=0x556a91817320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:12:42.620 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.572+0000 7f17c1a0c700 1 --2- 172.21.15.163:0/1628665607 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556a91816f10 0x556a91817320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:42.620 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.572+0000 7f17c1a0c700 1 -- 172.21.15.163:0/1628665607 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556a91595d90 con 0x556a91817860 2023-07-14T18:12:42.620 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.572+0000 7f17c1a0c700 1 --2- 172.21.15.163:0/1628665607 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x556a91817860 0x556a91817e80 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f17b80a1ac0 tx=0x7f17b8099580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d2b9b1d1efc0323 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:12:42.620 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.572+0000 7f17b0daa700 1 -- 172.21.15.163:0/1628665607 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17b809dbd0 con 0x556a91817860 2023-07-14T18:12:42.621 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.572+0000 7f17b0daa700 1 -- 172.21.15.163:0/1628665607 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f17b80a1ff0 con 0x556a91817860 2023-07-14T18:12:42.621 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.572+0000 7f17b0daa700 1 -- 172.21.15.163:0/1628665607 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17b80992d0 con 0x556a91817860 2023-07-14T18:12:42.621 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.573+0000 7f17d0609b80 1 -- 172.21.15.163:0/1628665607 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x556a91817860 msgr2=0x556a91817e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:12:42.621 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.573+0000 7f17d0609b80 1 --2- 172.21.15.163:0/1628665607 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x556a91817860 0x556a91817e80 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f17b80a1ac0 tx=0x7f17b8099580 comp rx=0 tx=0).stop 2023-07-14T18:12:42.621 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.573+0000 7f17d0609b80 1 -- 172.21.15.163:0/1628665607 shutdown_connections 2023-07-14T18:12:42.621 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.573+0000 7f17d0609b80 1 --2- 172.21.15.163:0/1628665607 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x556a91818460 0x556a918188d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:42.621 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.573+0000 7f17d0609b80 1 --2- 172.21.15.163:0/1628665607 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556a91816f10 0x556a91817320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:42.622 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.573+0000 7f17d0609b80 1 --2- 172.21.15.163:0/1628665607 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x556a91817860 0x556a91817e80 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:42.622 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.573+0000 7f17d0609b80 1 -- 172.21.15.163:0/1628665607 >> 172.21.15.163:0/1628665607 conn(0x556a9180c630 msgr2=0x556a91811980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:12:42.622 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.573+0000 7f17d0609b80 1 -- 172.21.15.163:0/1628665607 shutdown_connections 2023-07-14T18:12:42.622 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.573+0000 7f17d0609b80 1 -- 172.21.15.163:0/1628665607 wait complete. 2023-07-14T18:12:42.622 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.573+0000 7f17d0609b80 1 -- start start 2023-07-14T18:12:42.622 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.573+0000 7f17d0609b80 1 Processor -- start 2023-07-14T18:12:42.623 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.573+0000 7f17d0609b80 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x556a91816f10 0x556a918207e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:12:42.623 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.573+0000 7f17d0609b80 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x556a91817860 0x556a91820d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:12:42.623 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.573+0000 7f17d0609b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556a91818460 0x556a91827d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:12:42.623 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.573+0000 7f17d0609b80 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x556a91707a70 con 0x556a91816f10 2023-07-14T18:12:42.623 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.573+0000 7f17d0609b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x556a91707770 con 0x556a91818460 2023-07-14T18:12:42.624 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.573+0000 7f17d0609b80 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x556a915eb8d0 con 0x556a91817860 2023-07-14T18:12:42.624 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.573+0000 7f17d0609b80 10 client.0 _ll_register_callbacks cb 0x556a91705710 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T18:12:42.624 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.573+0000 7f17c220d700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x556a91816f10 0x556a918207e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:12:42.625 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.573+0000 7f17c220d700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x556a91816f10 0x556a918207e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:57606/0 (socket says 172.21.15.163:57606) 2023-07-14T18:12:42.625 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.573+0000 7f17c220d700 1 -- 172.21.15.163:0/411398664 learned_addr learned my addr 172.21.15.163:0/411398664 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:12:42.625 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.574+0000 7f17c1a0c700 1 --2- 172.21.15.163:0/411398664 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x556a91817860 0x556a91820d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:12:42.625 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.574+0000 7f17c2a0e700 1 --2- 172.21.15.163:0/411398664 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556a91818460 0x556a91827d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:12:42.626 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.574+0000 7f17c220d700 1 -- 172.21.15.163:0/411398664 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x556a91817860 msgr2=0x556a91820d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:12:42.626 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.574+0000 7f17c220d700 1 --2- 172.21.15.163:0/411398664 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x556a91817860 0x556a91820d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:42.626 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.574+0000 7f17c220d700 1 -- 172.21.15.163:0/411398664 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556a91818460 msgr2=0x556a91827d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:12:42.627 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.574+0000 7f17c220d700 1 --2- 172.21.15.163:0/411398664 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556a91818460 0x556a91827d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:42.627 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.574+0000 7f17c220d700 1 -- 172.21.15.163:0/411398664 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f17bc19de90 con 0x556a91816f10 2023-07-14T18:12:42.627 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.574+0000 7f17c1a0c700 1 --2- 172.21.15.163:0/411398664 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x556a91817860 0x556a91820d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T18:12:42.627 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.574+0000 7f17c220d700 1 --2- 172.21.15.163:0/411398664 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x556a91816f10 0x556a918207e0 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f17ac015000 tx=0x7f17ac009ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=19949d73f1883b6c server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:12:42.628 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.574+0000 7f17a5ffb700 10 client.0 ms_handle_connect on v2:172.21.15.163:3300/0 2023-07-14T18:12:42.628 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.574+0000 7f17a5ffb700 1 -- 172.21.15.163:0/411398664 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17ac0041a0 con 0x556a91816f10 2023-07-14T18:12:42.628 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.574+0000 7f17a5ffb700 1 -- 172.21.15.163:0/411398664 <== mon.0 v2:172.21.15.163:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 9020+0+0 (secure 0 0 0) 0x7f17ac00f460 con 0x556a91816f10 2023-07-14T18:12:42.628 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.574+0000 7f17d0609b80 1 -- 172.21.15.163:0/411398664 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x556a916c14a0 con 0x556a91816f10 2023-07-14T18:12:42.628 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.574+0000 7f17a5ffb700 1 -- 172.21.15.163:0/411398664 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7f17ac00f620 con 0x556a91816f10 2023-07-14T18:12:42.629 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.574+0000 7f17d0609b80 10 client.15498 fetch_fsmap learned FSMap version 28 2023-07-14T18:12:42.629 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.574+0000 7f17d0609b80 1 -- 172.21.15.163:0/411398664 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) v3 -- 0x556a9157ec10 con 0x556a91816f10 2023-07-14T18:12:42.629 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.574+0000 7f17a5ffb700 1 -- 172.21.15.163:0/411398664 <== mon.0 v2:172.21.15.163:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x556a916c14a0 con 0x556a91816f10 2023-07-14T18:12:42.630 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.574+0000 7f17a5ffb700 1 -- 172.21.15.163:0/411398664 <== mon.0 v2:172.21.15.163:3300/0 5 ==== fsmap(e 28) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f17ac024790 con 0x556a91816f10 2023-07-14T18:12:42.630 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.575+0000 7f17d0609b80 10 client.15498 fetch_fsmap finished waiting for FSMap version 28 2023-07-14T18:12:42.630 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.575+0000 7f17d0609b80 10 client.15498 resolve_mds: resolved name 'i' to daemon mds.i 2023-07-14T18:12:42.630 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.575+0000 7f17d0609b80 20 client.15498 populate_metadata read hostname 'smithi163' 2023-07-14T18:12:42.631 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.575+0000 7f17d0609b80 1 --2- 172.21.15.163:0/411398664 >> [v2:172.21.15.184:6838/2819059257,v1:172.21.15.184:6839/2819059257] conn(0x556a9182ba60 0x556a9182ae60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:12:42.631 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.575+0000 7f17d0609b80 4 client.15498 mds_command: new command op to 24493 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-14T18:12:42.631 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.575+0000 7f17d0609b80 1 -- 172.21.15.163:0/411398664 --> [v2:172.21.15.184:6838/2819059257,v1:172.21.15.184:6839/2819059257] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x556a917e5d50 con 0x556a9182ba60 2023-07-14T18:12:42.631 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.575+0000 7f17c1a0c700 1 --2- 172.21.15.163:0/411398664 >> [v2:172.21.15.184:6838/2819059257,v1:172.21.15.184:6839/2819059257] conn(0x556a9182ba60 0x556a9182ae60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:12:42.632 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.575+0000 7f17a5ffb700 10 client.15498 ms_handle_connect on v2:172.21.15.184:6838/2819059257 2023-07-14T18:12:42.632 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.575+0000 7f17c1a0c700 1 --2- 172.21.15.163:0/411398664 >> [v2:172.21.15.184:6838/2819059257,v1:172.21.15.184:6839/2819059257] conn(0x556a9182ba60 0x556a9182ae60 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=f3a7c22446da981e server_cookie=3ebe722417766fb6 in_seq=0 out_seq=0 2023-07-14T18:12:42.632 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.576+0000 7f17a5ffb700 1 -- 172.21.15.163:0/411398664 <== mds.1 v2:172.21.15.184:6838/2819059257 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18017 (crc 0 0 0) 0x556a917e5d50 con 0x556a9182ba60 2023-07-14T18:12:42.632 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.576+0000 7f17a5ffb700 10 client.15498 handle_command_reply: tid=0 2023-07-14T18:12:42.633 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.576+0000 7f17d0609b80 1 client.15498 shutdown 2023-07-14T18:12:42.633 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.576+0000 7f17d0609b80 1 -- 172.21.15.163:0/411398664 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x556a91816f10 msgr2=0x556a918207e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:12:42.633 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.576+0000 7f17d0609b80 1 --2- 172.21.15.163:0/411398664 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x556a91816f10 0x556a918207e0 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f17ac015000 tx=0x7f17ac009ca0 comp rx=0 tx=0).stop 2023-07-14T18:12:42.633 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.576+0000 7f17d0609b80 1 -- 172.21.15.163:0/411398664 shutdown_connections 2023-07-14T18:12:42.634 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.576+0000 7f17d0609b80 1 --2- 172.21.15.163:0/411398664 >> [v2:172.21.15.184:6838/2819059257,v1:172.21.15.184:6839/2819059257] conn(0x556a9182ba60 0x556a9182ae60 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:42.634 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.576+0000 7f17d0609b80 1 --2- 172.21.15.163:0/411398664 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556a91818460 0x556a91827d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:42.634 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.576+0000 7f17d0609b80 1 --2- 172.21.15.163:0/411398664 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x556a91816f10 0x556a918207e0 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:42.634 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.576+0000 7f17d0609b80 1 --2- 172.21.15.163:0/411398664 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x556a91817860 0x556a91820d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:42.635 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.576+0000 7f17a5ffb700 0 client.15498 ms_handle_reset on v2:172.21.15.184:6838/2819059257 2023-07-14T18:12:42.635 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.576+0000 7f17d0609b80 1 -- 172.21.15.163:0/411398664 >> 172.21.15.163:0/411398664 conn(0x556a9180c630 msgr2=0x556a91810600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:12:42.635 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.576+0000 7f17d0609b80 1 -- 172.21.15.163:0/411398664 shutdown_connections 2023-07-14T18:12:42.635 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.576+0000 7f17d0609b80 1 -- 172.21.15.163:0/411398664 wait complete. 2023-07-14T18:12:42.636 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.576+0000 7f17d0609b80 20 client.15498 trim_cache size 0 max 16384 2023-07-14T18:12:42.644 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.593+0000 7f17d0609b80 1 Processor -- start 2023-07-14T18:12:42.644 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.593+0000 7f17d0609b80 1 -- start start 2023-07-14T18:12:42.644 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.593+0000 7f17d0609b80 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x556a91816f10 0x556a9181b3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:12:42.645 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.593+0000 7f17d0609b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556a91817860 0x556a9181b8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:12:42.645 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.593+0000 7f17d0609b80 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x556a91818460 0x556a91820590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:12:42.645 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.593+0000 7f17d0609b80 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x556a917e5d50 con 0x556a91816f10 2023-07-14T18:12:42.645 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.593+0000 7f17d0609b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x556a916c14a0 con 0x556a91817860 2023-07-14T18:12:42.645 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.593+0000 7f17d0609b80 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x556a9180e6b0 con 0x556a91818460 2023-07-14T18:12:42.645 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.593+0000 7f17c220d700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x556a91816f10 0x556a9181b3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:12:42.645 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.593+0000 7f17c220d700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x556a91816f10 0x556a9181b3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:57614/0 (socket says 172.21.15.163:57614) 2023-07-14T18:12:42.645 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.593+0000 7f17c220d700 1 -- 172.21.15.163:0/1708345255 learned_addr learned my addr 172.21.15.163:0/1708345255 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:12:42.646 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.594+0000 7f17c220d700 1 -- 172.21.15.163:0/1708345255 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x556a91818460 msgr2=0x556a91820590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:12:42.646 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.594+0000 7f17c220d700 1 --2- 172.21.15.163:0/1708345255 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x556a91818460 0x556a91820590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:42.646 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.594+0000 7f17c220d700 1 -- 172.21.15.163:0/1708345255 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556a91817860 msgr2=0x556a9181b8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:12:42.646 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.594+0000 7f17c220d700 1 --2- 172.21.15.163:0/1708345255 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556a91817860 0x556a9181b8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:42.646 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.594+0000 7f17c220d700 1 -- 172.21.15.163:0/1708345255 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556a915bc200 con 0x556a91816f10 2023-07-14T18:12:42.646 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.594+0000 7f17c220d700 1 --2- 172.21.15.163:0/1708345255 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x556a91816f10 0x556a9181b3b0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f17ac009990 tx=0x7f17ac005760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be8519202e57b583 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:12:42.646 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.594+0000 7f17b15ab700 1 -- 172.21.15.163:0/1708345255 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17ac0041a0 con 0x556a91816f10 2023-07-14T18:12:42.647 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.594+0000 7f17b15ab700 1 -- 172.21.15.163:0/1708345255 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f17ac02c040 con 0x556a91816f10 2023-07-14T18:12:42.647 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.594+0000 7f17b15ab700 1 -- 172.21.15.163:0/1708345255 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17ac00f9a0 con 0x556a91816f10 2023-07-14T18:12:42.647 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.594+0000 7f17d0609b80 1 -- 172.21.15.163:0/1708345255 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x556a91816f10 msgr2=0x556a9181b3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:12:42.647 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.594+0000 7f17d0609b80 1 --2- 172.21.15.163:0/1708345255 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x556a91816f10 0x556a9181b3b0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f17ac009990 tx=0x7f17ac005760 comp rx=0 tx=0).stop 2023-07-14T18:12:42.647 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.594+0000 7f17d0609b80 1 -- 172.21.15.163:0/1708345255 shutdown_connections 2023-07-14T18:12:42.647 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.594+0000 7f17d0609b80 1 --2- 172.21.15.163:0/1708345255 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x556a91818460 0x556a91820590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:42.647 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.594+0000 7f17d0609b80 1 --2- 172.21.15.163:0/1708345255 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x556a91816f10 0x556a9181b3b0 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:42.647 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.594+0000 7f17d0609b80 1 --2- 172.21.15.163:0/1708345255 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556a91817860 0x556a9181b8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:42.648 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.594+0000 7f17d0609b80 1 -- 172.21.15.163:0/1708345255 >> 172.21.15.163:0/1708345255 conn(0x556a9180c630 msgr2=0x556a9182ae60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:12:42.648 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.595+0000 7f17d0609b80 1 -- 172.21.15.163:0/1708345255 shutdown_connections 2023-07-14T18:12:42.648 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.595+0000 7f17d0609b80 1 -- 172.21.15.163:0/1708345255 wait complete. 2023-07-14T18:12:42.648 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.595+0000 7f17d0609b80 1 -- start start 2023-07-14T18:12:42.648 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.595+0000 7f17d0609b80 1 Processor -- start 2023-07-14T18:12:42.648 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.595+0000 7f17d0609b80 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x556a91816f10 0x556a9187ca60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:12:42.648 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.595+0000 7f17d0609b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556a91817860 0x556a9187cfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:12:42.649 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.595+0000 7f17d0609b80 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x556a91818460 0x556a91883fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:12:42.649 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.595+0000 7f17d0609b80 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x556a91884520 con 0x556a91818460 2023-07-14T18:12:42.649 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.595+0000 7f17d0609b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x556a91884660 con 0x556a91817860 2023-07-14T18:12:42.649 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.595+0000 7f17d0609b80 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x556a918847f0 con 0x556a91816f10 2023-07-14T18:12:42.649 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.595+0000 7f17d0609b80 10 client.0 _ll_register_callbacks cb 0x7f17ac00bac0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T18:12:42.649 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.595+0000 7f17c2a0e700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x556a91818460 0x556a91883fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:12:42.649 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.595+0000 7f17c2a0e700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x556a91818460 0x556a91883fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:57624/0 (socket says 172.21.15.163:57624) 2023-07-14T18:12:42.649 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.595+0000 7f17c2a0e700 1 -- 172.21.15.163:0/3263682375 learned_addr learned my addr 172.21.15.163:0/3263682375 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:12:42.650 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.595+0000 7f17c1a0c700 1 --2- 172.21.15.163:0/3263682375 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556a91817860 0x556a9187cfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:12:42.650 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.595+0000 7f17c220d700 1 --2- 172.21.15.163:0/3263682375 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x556a91816f10 0x556a9187ca60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:12:42.650 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.595+0000 7f17c2a0e700 1 -- 172.21.15.163:0/3263682375 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x556a91816f10 msgr2=0x556a9187ca60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:12:42.650 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.595+0000 7f17c2a0e700 1 --2- 172.21.15.163:0/3263682375 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x556a91816f10 0x556a9187ca60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:42.650 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.595+0000 7f17c2a0e700 1 -- 172.21.15.163:0/3263682375 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556a91817860 msgr2=0x556a9187cfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:12:42.650 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.595+0000 7f17c2a0e700 1 --2- 172.21.15.163:0/3263682375 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556a91817860 0x556a9187cfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:42.650 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.595+0000 7f17c2a0e700 1 -- 172.21.15.163:0/3263682375 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x556a9157ec10 con 0x556a91818460 2023-07-14T18:12:42.651 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.596+0000 7f17c1a0c700 1 --2- 172.21.15.163:0/3263682375 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556a91817860 0x556a9187cfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T18:12:42.651 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.596+0000 7f17c220d700 1 --2- 172.21.15.163:0/3263682375 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x556a91816f10 0x556a9187ca60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T18:12:42.651 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.596+0000 7f17c2a0e700 1 --2- 172.21.15.163:0/3263682375 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x556a91818460 0x556a91883fe0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f17b4004b10 tx=0x7f17b4004320 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d9b266edb840fa97 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:12:42.651 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.596+0000 7f17a5ffb700 10 client.0 ms_handle_connect on v2:172.21.15.163:3300/0 2023-07-14T18:12:42.651 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.596+0000 7f17a5ffb700 1 -- 172.21.15.163:0/3263682375 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17b4003a20 con 0x556a91818460 2023-07-14T18:12:42.651 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.596+0000 7f17a5ffb700 1 -- 172.21.15.163:0/3263682375 <== mon.0 v2:172.21.15.163:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 9020+0+0 (secure 0 0 0) 0x7f17b4007710 con 0x556a91818460 2023-07-14T18:12:42.651 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.596+0000 7f17d0609b80 1 -- 172.21.15.163:0/3263682375 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f17b80a1ff0 con 0x556a91818460 2023-07-14T18:12:42.651 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.596+0000 7f17a5ffb700 1 -- 172.21.15.163:0/3263682375 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7f17b4007950 con 0x556a91818460 2023-07-14T18:12:42.652 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.596+0000 7f17d0609b80 10 client.15504 fetch_fsmap learned FSMap version 28 2023-07-14T18:12:42.652 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.596+0000 7f17d0609b80 1 -- 172.21.15.163:0/3263682375 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) v3 -- 0x556a91594260 con 0x556a91818460 2023-07-14T18:12:42.652 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.596+0000 7f17a5ffb700 1 -- 172.21.15.163:0/3263682375 <== mon.0 v2:172.21.15.163:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f17b80a1ff0 con 0x556a91818460 2023-07-14T18:12:42.652 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.596+0000 7f17a5ffb700 1 -- 172.21.15.163:0/3263682375 <== mon.0 v2:172.21.15.163:3300/0 5 ==== fsmap(e 28) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f17b4014070 con 0x556a91818460 2023-07-14T18:12:42.652 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.596+0000 7f17d0609b80 10 client.15504 fetch_fsmap finished waiting for FSMap version 28 2023-07-14T18:12:42.652 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.596+0000 7f17d0609b80 10 client.15504 resolve_mds: resolved name 'i' to daemon mds.i 2023-07-14T18:12:42.652 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.596+0000 7f17d0609b80 20 client.15504 populate_metadata read hostname 'smithi163' 2023-07-14T18:12:42.653 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.596+0000 7f17d0609b80 1 --2- 172.21.15.163:0/3263682375 >> [v2:172.21.15.184:6838/2819059257,v1:172.21.15.184:6839/2819059257] conn(0x556a91889660 0x556a91886030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:12:42.653 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.596+0000 7f17d0609b80 4 client.15504 mds_command: new command op to 24493 tid=0[{"prefix": "status"}] 2023-07-14T18:12:42.653 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.596+0000 7f17d0609b80 1 -- 172.21.15.163:0/3263682375 --> [v2:172.21.15.184:6838/2819059257,v1:172.21.15.184:6839/2819059257] -- command(tid 0: {"prefix": "status"}) v1 -- 0x556a91760e60 con 0x556a91889660 2023-07-14T18:12:42.653 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.597+0000 7f17c220d700 1 --2- 172.21.15.163:0/3263682375 >> [v2:172.21.15.184:6838/2819059257,v1:172.21.15.184:6839/2819059257] conn(0x556a91889660 0x556a91886030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:12:42.653 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.597+0000 7f17a5ffb700 10 client.15504 ms_handle_connect on v2:172.21.15.184:6838/2819059257 2023-07-14T18:12:42.653 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.597+0000 7f17c220d700 1 --2- 172.21.15.163:0/3263682375 >> [v2:172.21.15.184:6838/2819059257,v1:172.21.15.184:6839/2819059257] conn(0x556a91889660 0x556a91886030 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=e4c38c55b15a0e01 server_cookie=3c575265a068c4ae in_seq=0 out_seq=0 2023-07-14T18:12:42.653 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.597+0000 7f17a5ffb700 1 -- 172.21.15.163:0/3263682375 <== mds.1 v2:172.21.15.184:6838/2819059257 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+327 (crc 0 0 0) 0x556a91760e60 con 0x556a91889660 2023-07-14T18:12:42.653 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.597+0000 7f17a5ffb700 10 client.15504 handle_command_reply: tid=0 2023-07-14T18:12:42.654 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.597+0000 7f17d0609b80 1 client.15504 shutdown 2023-07-14T18:12:42.654 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.597+0000 7f17d0609b80 1 -- 172.21.15.163:0/3263682375 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x556a91818460 msgr2=0x556a91883fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:12:42.654 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.597+0000 7f17d0609b80 1 --2- 172.21.15.163:0/3263682375 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x556a91818460 0x556a91883fe0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f17b4004b10 tx=0x7f17b4004320 comp rx=0 tx=0).stop 2023-07-14T18:12:42.654 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.597+0000 7f17d0609b80 1 -- 172.21.15.163:0/3263682375 shutdown_connections 2023-07-14T18:12:42.654 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.597+0000 7f17d0609b80 1 --2- 172.21.15.163:0/3263682375 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x556a91816f10 0x556a9187ca60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:42.654 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.597+0000 7f17d0609b80 1 --2- 172.21.15.163:0/3263682375 >> [v2:172.21.15.184:6838/2819059257,v1:172.21.15.184:6839/2819059257] conn(0x556a91889660 0x556a91886030 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:42.654 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.597+0000 7f17d0609b80 1 --2- 172.21.15.163:0/3263682375 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x556a91818460 0x556a91883fe0 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:42.655 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.597+0000 7f17a5ffb700 0 client.15504 ms_handle_reset on v2:172.21.15.184:6838/2819059257 2023-07-14T18:12:42.655 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.597+0000 7f17d0609b80 1 --2- 172.21.15.163:0/3263682375 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556a91817860 0x556a9187cfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:42.655 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.597+0000 7f17d0609b80 1 -- 172.21.15.163:0/3263682375 >> 172.21.15.163:0/3263682375 conn(0x556a9180c630 msgr2=0x556a9181b3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:12:42.655 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.597+0000 7f17d0609b80 1 -- 172.21.15.163:0/3263682375 shutdown_connections 2023-07-14T18:12:42.655 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.598+0000 7f17d0609b80 1 -- 172.21.15.163:0/3263682375 wait complete. 2023-07-14T18:12:42.655 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.598+0000 7f17d0609b80 20 client.15504 trim_cache size 0 max 16384 2023-07-14T18:12:42.656 INFO:teuthology.orchestra.run.smithi163.stdout:{ 2023-07-14T18:12:42.656 INFO:teuthology.orchestra.run.smithi163.stdout: "cluster_fsid": "bf7326ec-2270-11ee-9b33-001a4aab830c", 2023-07-14T18:12:42.656 INFO:teuthology.orchestra.run.smithi163.stdout: "whoami": 1, 2023-07-14T18:12:42.656 INFO:teuthology.orchestra.run.smithi163.stdout: "id": 24493, 2023-07-14T18:12:42.656 INFO:teuthology.orchestra.run.smithi163.stdout: "want_state": "up:active", 2023-07-14T18:12:42.657 INFO:teuthology.orchestra.run.smithi163.stdout: "state": "up:active", 2023-07-14T18:12:42.657 INFO:teuthology.orchestra.run.smithi163.stdout: "fs_name": "cephfs", 2023-07-14T18:12:42.657 INFO:teuthology.orchestra.run.smithi163.stdout: "rank_uptime": 74.789528872999995, 2023-07-14T18:12:42.657 INFO:teuthology.orchestra.run.smithi163.stdout: "mdsmap_epoch": 28, 2023-07-14T18:12:42.657 INFO:teuthology.orchestra.run.smithi163.stdout: "osdmap_epoch": 86, 2023-07-14T18:12:42.657 INFO:teuthology.orchestra.run.smithi163.stdout: "osdmap_epoch_barrier": 84, 2023-07-14T18:12:42.657 INFO:teuthology.orchestra.run.smithi163.stdout: "uptime": 105.527740298 2023-07-14T18:12:42.658 INFO:teuthology.orchestra.run.smithi163.stdout:} 2023-07-14T18:12:42.659 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.598+0000 7f17c4471700 1 -- 172.21.15.163:0/16549005 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f17a80a11e0 msgr2=0x7f17a80a3690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:12:42.659 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.598+0000 7f17c4471700 1 --2- 172.21.15.163:0/16549005 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f17a80a11e0 0x7f17a80a3690 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f17ac00c010 tx=0x7f17ac00b540 comp rx=0 tx=0).stop 2023-07-14T18:12:42.659 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.598+0000 7f17c4471700 1 -- 172.21.15.163:0/16549005 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f17bc0ffd00 msgr2=0x7f17bc195de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:12:42.659 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.598+0000 7f17c4471700 1 --2- 172.21.15.163:0/16549005 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f17bc0ffd00 0x7f17bc195de0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f17b800d950 tx=0x7f17b800dc60 comp rx=0 tx=0).stop 2023-07-14T18:12:42.660 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.598+0000 7f17c4471700 1 -- 172.21.15.163:0/16549005 shutdown_connections 2023-07-14T18:12:42.660 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.598+0000 7f17c4471700 1 --2- 172.21.15.163:0/16549005 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f17a80a11e0 0x7f17a80a3690 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:42.660 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.598+0000 7f17c4471700 1 --2- 172.21.15.163:0/16549005 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f17bc100690 0x7f17bc19ce50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:42.660 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.598+0000 7f17c4471700 1 --2- 172.21.15.163:0/16549005 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f17bc0feb10 0x7f17bc1958a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:42.660 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.598+0000 7f17c4471700 1 --2- 172.21.15.163:0/16549005 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f17bc0ffd00 0x7f17bc195de0 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:42.660 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.598+0000 7f17c4471700 1 -- 172.21.15.163:0/16549005 >> 172.21.15.163:0/16549005 conn(0x7f17bc0fa130 msgr2=0x7f17bc068850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:12:42.661 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.598+0000 7f17c4471700 1 -- 172.21.15.163:0/16549005 shutdown_connections 2023-07-14T18:12:42.661 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.598+0000 7f17c4471700 1 -- 172.21.15.163:0/16549005 wait complete. 2023-07-14T18:12:42.661 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2023-07-14T18:12:42.784 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.744+0000 7f1d4041e700 1 -- 172.21.15.163:0/2444093052 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f1d380feb20 msgr2=0x7f1d380fef30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:12:42.785 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.744+0000 7f1d4041e700 1 --2- 172.21.15.163:0/2444093052 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f1d380feb20 0x7f1d380fef30 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f1d28009990 tx=0x7f1d28009ca0 comp rx=0 tx=0).stop 2023-07-14T18:12:42.785 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.744+0000 7f1d4041e700 1 -- 172.21.15.163:0/2444093052 shutdown_connections 2023-07-14T18:12:42.785 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.744+0000 7f1d4041e700 1 --2- 172.21.15.163:0/2444093052 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1d381006a0 0x7f1d38106f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:42.785 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.744+0000 7f1d4041e700 1 --2- 172.21.15.163:0/2444093052 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f1d380feb20 0x7f1d380fef30 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:42.785 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.744+0000 7f1d4041e700 1 --2- 172.21.15.163:0/2444093052 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1d380ffd10 0x7f1d38100160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:42.785 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.744+0000 7f1d4041e700 1 -- 172.21.15.163:0/2444093052 >> 172.21.15.163:0/2444093052 conn(0x7f1d380fa160 msgr2=0x7f1d380fc570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:12:42.785 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.744+0000 7f1d4041e700 1 -- 172.21.15.163:0/2444093052 shutdown_connections 2023-07-14T18:12:42.785 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.744+0000 7f1d4041e700 1 -- 172.21.15.163:0/2444093052 wait complete. 2023-07-14T18:12:42.787 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.744+0000 7f1d4041e700 1 Processor -- start 2023-07-14T18:12:42.787 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.744+0000 7f1d4041e700 1 -- start start 2023-07-14T18:12:42.788 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.745+0000 7f1d4041e700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1d380feb20 0x7f1d381947e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:12:42.788 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.745+0000 7f1d4041e700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f1d380ffd10 0x7f1d38194d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:12:42.788 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.745+0000 7f1d4041e700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1d381006a0 0x7f1d3819bd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:12:42.788 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.745+0000 7f1d4041e700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d3819c360 con 0x7f1d380ffd10 2023-07-14T18:12:42.788 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.745+0000 7f1d4041e700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d3819c4a0 con 0x7f1d380feb20 2023-07-14T18:12:42.788 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.745+0000 7f1d4041e700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d3819c630 con 0x7f1d381006a0 2023-07-14T18:12:42.788 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.745+0000 7f1d3d9b9700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f1d380ffd10 0x7f1d38194d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:12:42.789 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.745+0000 7f1d3e1ba700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1d380feb20 0x7f1d381947e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:12:42.789 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.745+0000 7f1d3d9b9700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f1d380ffd10 0x7f1d38194d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:57636/0 (socket says 172.21.15.163:57636) 2023-07-14T18:12:42.789 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.745+0000 7f1d3d9b9700 1 -- 172.21.15.163:0/4219042759 learned_addr learned my addr 172.21.15.163:0/4219042759 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:12:42.789 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.745+0000 7f1d3e9bb700 1 --2- 172.21.15.163:0/4219042759 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1d381006a0 0x7f1d3819bd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:12:42.789 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.745+0000 7f1d3d9b9700 1 -- 172.21.15.163:0/4219042759 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1d381006a0 msgr2=0x7f1d3819bd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:12:42.789 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.745+0000 7f1d3d9b9700 1 --2- 172.21.15.163:0/4219042759 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1d381006a0 0x7f1d3819bd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:42.789 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.745+0000 7f1d3d9b9700 1 -- 172.21.15.163:0/4219042759 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1d380feb20 msgr2=0x7f1d381947e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:12:42.789 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.745+0000 7f1d3d9b9700 1 --2- 172.21.15.163:0/4219042759 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1d380feb20 0x7f1d381947e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:42.790 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.745+0000 7f1d3d9b9700 1 -- 172.21.15.163:0/4219042759 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d280095f0 con 0x7f1d380ffd10 2023-07-14T18:12:42.790 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.745+0000 7f1d3e1ba700 1 --2- 172.21.15.163:0/4219042759 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1d380feb20 0x7f1d381947e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T18:12:42.790 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.745+0000 7f1d3d9b9700 1 --2- 172.21.15.163:0/4219042759 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f1d380ffd10 0x7f1d38194d20 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f1d3400d980 tx=0x7f1d3400dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:12:42.790 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.745+0000 7f1d2f7fe700 1 -- 172.21.15.163:0/4219042759 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d34004220 con 0x7f1d380ffd10 2023-07-14T18:12:42.790 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.745+0000 7f1d4041e700 1 -- 172.21.15.163:0/4219042759 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1d3819c910 con 0x7f1d380ffd10 2023-07-14T18:12:42.790 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.745+0000 7f1d2f7fe700 1 -- 172.21.15.163:0/4219042759 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f1d34007640 con 0x7f1d380ffd10 2023-07-14T18:12:42.790 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.745+0000 7f1d2f7fe700 1 -- 172.21.15.163:0/4219042759 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d34005660 con 0x7f1d380ffd10 2023-07-14T18:12:42.791 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.745+0000 7f1d4041e700 1 -- 172.21.15.163:0/4219042759 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d3819ce20 con 0x7f1d380ffd10 2023-07-14T18:12:42.795 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.747+0000 7f1d2f7fe700 1 -- 172.21.15.163:0/4219042759 <== mon.0 v2:172.21.15.163:3300/0 4 ==== mgrmap(e 17) v1 ==== 135767+0+0 (secure 0 0 0) 0x7f1d34004750 con 0x7f1d380ffd10 2023-07-14T18:12:42.795 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.748+0000 7f1d2f7fe700 1 --2- 172.21.15.163:0/4219042759 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f1d240a11e0 0x7f1d240a3690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:12:42.795 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.748+0000 7f1d3e1ba700 1 --2- 172.21.15.163:0/4219042759 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f1d240a11e0 0x7f1d240a3690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:12:42.795 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.748+0000 7f1d2f7fe700 1 -- 172.21.15.163:0/4219042759 <== mon.0 v2:172.21.15.163:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 9020+0+0 (secure 0 0 0) 0x7f1d340ccc20 con 0x7f1d380ffd10 2023-07-14T18:12:42.795 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.749+0000 7f1d3e1ba700 1 --2- 172.21.15.163:0/4219042759 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f1d240a11e0 0x7f1d240a3690 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f1d2800b5c0 tx=0x7f1d28005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:12:42.795 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.749+0000 7f1d4c5b6b80 1 Processor -- start 2023-07-14T18:12:42.795 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.750+0000 7f1d4c5b6b80 1 -- start start 2023-07-14T18:12:42.796 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.750+0000 7f1d4c5b6b80 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55bfd2a64f10 0x55bfd2a65320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:12:42.796 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.750+0000 7f1d4c5b6b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bfd2a65860 0x55bfd2a65e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:12:42.796 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.750+0000 7f1d4c5b6b80 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55bfd2a66460 0x55bfd2a668d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:12:42.796 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.750+0000 7f1d4c5b6b80 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bfd2969c60 con 0x55bfd2a64f10 2023-07-14T18:12:42.796 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.750+0000 7f1d4c5b6b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bfd29bc9f0 con 0x55bfd2a65860 2023-07-14T18:12:42.796 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.750+0000 7f1d4c5b6b80 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bfd29b5e80 con 0x55bfd2a66460 2023-07-14T18:12:42.796 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.750+0000 7f1d3e1ba700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55bfd2a64f10 0x55bfd2a65320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:12:42.797 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.750+0000 7f1d3e1ba700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55bfd2a64f10 0x55bfd2a65320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:57642/0 (socket says 172.21.15.163:57642) 2023-07-14T18:12:42.797 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.750+0000 7f1d3e1ba700 1 -- 172.21.15.163:0/188259211 learned_addr learned my addr 172.21.15.163:0/188259211 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:12:42.797 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.750+0000 7f1d3d9b9700 1 --2- 172.21.15.163:0/188259211 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bfd2a65860 0x55bfd2a65e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:12:42.797 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.750+0000 7f1d3e9bb700 1 --2- 172.21.15.163:0/188259211 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55bfd2a66460 0x55bfd2a668d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:12:42.797 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.750+0000 7f1d3e1ba700 1 -- 172.21.15.163:0/188259211 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55bfd2a66460 msgr2=0x55bfd2a668d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:12:42.797 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.750+0000 7f1d3e1ba700 1 --2- 172.21.15.163:0/188259211 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55bfd2a66460 0x55bfd2a668d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:42.797 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.750+0000 7f1d3e1ba700 1 -- 172.21.15.163:0/188259211 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bfd2a65860 msgr2=0x55bfd2a65e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:12:42.798 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.750+0000 7f1d3e1ba700 1 --2- 172.21.15.163:0/188259211 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bfd2a65860 0x55bfd2a65e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:42.798 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.750+0000 7f1d3e1ba700 1 -- 172.21.15.163:0/188259211 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55bfd27e3d90 con 0x55bfd2a64f10 2023-07-14T18:12:42.798 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.750+0000 7f1d3e1ba700 1 --2- 172.21.15.163:0/188259211 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55bfd2a64f10 0x55bfd2a65320 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f1d28005800 tx=0x7f1d28020000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f2a6ba4a7589c412 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:12:42.798 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.750+0000 7f1d2cdaa700 1 -- 172.21.15.163:0/188259211 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d2802b070 con 0x55bfd2a64f10 2023-07-14T18:12:42.798 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.751+0000 7f1d2cdaa700 1 -- 172.21.15.163:0/188259211 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f1d2801e040 con 0x55bfd2a64f10 2023-07-14T18:12:42.798 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.751+0000 7f1d2cdaa700 1 -- 172.21.15.163:0/188259211 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d280048b0 con 0x55bfd2a64f10 2023-07-14T18:12:42.798 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.751+0000 7f1d4c5b6b80 1 -- 172.21.15.163:0/188259211 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55bfd2a64f10 msgr2=0x55bfd2a65320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:12:42.798 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.751+0000 7f1d4c5b6b80 1 --2- 172.21.15.163:0/188259211 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55bfd2a64f10 0x55bfd2a65320 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f1d28005800 tx=0x7f1d28020000 comp rx=0 tx=0).stop 2023-07-14T18:12:42.799 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.751+0000 7f1d4c5b6b80 1 -- 172.21.15.163:0/188259211 shutdown_connections 2023-07-14T18:12:42.799 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.751+0000 7f1d4c5b6b80 1 --2- 172.21.15.163:0/188259211 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55bfd2a66460 0x55bfd2a668d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:42.799 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.751+0000 7f1d4c5b6b80 1 --2- 172.21.15.163:0/188259211 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55bfd2a64f10 0x55bfd2a65320 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:42.799 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.751+0000 7f1d4c5b6b80 1 --2- 172.21.15.163:0/188259211 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bfd2a65860 0x55bfd2a65e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:42.799 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.751+0000 7f1d4c5b6b80 1 -- 172.21.15.163:0/188259211 >> 172.21.15.163:0/188259211 conn(0x55bfd2a5a630 msgr2=0x55bfd2a5f980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:12:42.799 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.751+0000 7f1d4c5b6b80 1 -- 172.21.15.163:0/188259211 shutdown_connections 2023-07-14T18:12:42.799 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.751+0000 7f1d4c5b6b80 1 -- 172.21.15.163:0/188259211 wait complete. 2023-07-14T18:12:42.799 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.752+0000 7f1d4c5b6b80 1 -- start start 2023-07-14T18:12:42.800 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.752+0000 7f1d4c5b6b80 1 Processor -- start 2023-07-14T18:12:42.800 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.752+0000 7f1d4c5b6b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bfd2a64f10 0x55bfd2a6e8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:12:42.800 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.752+0000 7f1d4c5b6b80 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55bfd2a65860 0x55bfd2a6ede0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:12:42.800 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.752+0000 7f1d4c5b6b80 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55bfd2a66460 0x55bfd2a75e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:12:42.800 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.752+0000 7f1d4c5b6b80 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bfd2955a70 con 0x55bfd2a66460 2023-07-14T18:12:42.800 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.752+0000 7f1d4c5b6b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bfd2955770 con 0x55bfd2a64f10 2023-07-14T18:12:42.800 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.752+0000 7f1d4c5b6b80 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bfd28398d0 con 0x55bfd2a65860 2023-07-14T18:12:42.801 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.752+0000 7f1d4c5b6b80 10 client.0 _ll_register_callbacks cb 0x55bfd2953710 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T18:12:42.801 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.752+0000 7f1d3e9bb700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55bfd2a66460 0x55bfd2a75e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:12:42.801 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.752+0000 7f1d3e9bb700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55bfd2a66460 0x55bfd2a75e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:57650/0 (socket says 172.21.15.163:57650) 2023-07-14T18:12:42.801 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.752+0000 7f1d3e9bb700 1 -- 172.21.15.163:0/2732945891 learned_addr learned my addr 172.21.15.163:0/2732945891 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:12:42.801 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.752+0000 7f1d3d9b9700 1 --2- 172.21.15.163:0/2732945891 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55bfd2a65860 0x55bfd2a6ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:12:42.801 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.752+0000 7f1d3e1ba700 1 --2- 172.21.15.163:0/2732945891 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bfd2a64f10 0x55bfd2a6e8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:12:42.801 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.753+0000 7f1d3e9bb700 1 -- 172.21.15.163:0/2732945891 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55bfd2a65860 msgr2=0x55bfd2a6ede0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:12:42.801 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.753+0000 7f1d3e9bb700 1 --2- 172.21.15.163:0/2732945891 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55bfd2a65860 0x55bfd2a6ede0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:42.802 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.753+0000 7f1d3e9bb700 1 -- 172.21.15.163:0/2732945891 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bfd2a64f10 msgr2=0x55bfd2a6e8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:12:42.802 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.753+0000 7f1d3e9bb700 1 --2- 172.21.15.163:0/2732945891 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bfd2a64f10 0x55bfd2a6e8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:42.802 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.753+0000 7f1d3e9bb700 1 -- 172.21.15.163:0/2732945891 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d38107890 con 0x55bfd2a66460 2023-07-14T18:12:42.802 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.753+0000 7f1d3e1ba700 1 --2- 172.21.15.163:0/2732945891 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bfd2a64f10 0x55bfd2a6e8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T18:12:42.802 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.753+0000 7f1d3e9bb700 1 --2- 172.21.15.163:0/2732945891 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55bfd2a66460 0x55bfd2a75e20 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f1d300042a0 tx=0x7f1d300042d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6bdd3560e043c7ed server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:12:42.802 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.753+0000 7f1d21ffb700 10 client.0 ms_handle_connect on v2:172.21.15.163:3300/0 2023-07-14T18:12:42.802 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.753+0000 7f1d21ffb700 1 -- 172.21.15.163:0/2732945891 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d30004bb0 con 0x55bfd2a66460 2023-07-14T18:12:42.802 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.753+0000 7f1d21ffb700 1 -- 172.21.15.163:0/2732945891 <== mon.0 v2:172.21.15.163:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 9020+0+0 (secure 0 0 0) 0x7f1d30004d10 con 0x55bfd2a66460 2023-07-14T18:12:42.803 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.753+0000 7f1d4c5b6b80 1 -- 172.21.15.163:0/2732945891 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55bfd290f4a0 con 0x55bfd2a66460 2023-07-14T18:12:42.803 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.753+0000 7f1d21ffb700 1 -- 172.21.15.163:0/2732945891 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1d30007710 con 0x55bfd2a66460 2023-07-14T18:12:42.803 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.753+0000 7f1d4c5b6b80 10 client.15516 fetch_fsmap learned FSMap version 28 2023-07-14T18:12:42.803 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.753+0000 7f1d4c5b6b80 1 -- 172.21.15.163:0/2732945891 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) v3 -- 0x55bfd27ccc10 con 0x55bfd2a66460 2023-07-14T18:12:42.803 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.753+0000 7f1d21ffb700 1 -- 172.21.15.163:0/2732945891 <== mon.0 v2:172.21.15.163:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55bfd290f4a0 con 0x55bfd2a66460 2023-07-14T18:12:42.803 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.753+0000 7f1d21ffb700 1 -- 172.21.15.163:0/2732945891 <== mon.0 v2:172.21.15.163:3300/0 5 ==== fsmap(e 28) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f1d30016990 con 0x55bfd2a66460 2023-07-14T18:12:42.803 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.753+0000 7f1d4c5b6b80 10 client.15516 fetch_fsmap finished waiting for FSMap version 28 2023-07-14T18:12:42.804 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.753+0000 7f1d4c5b6b80 10 client.15516 resolve_mds: resolved name 'b' to daemon mds.b 2023-07-14T18:12:42.804 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.753+0000 7f1d4c5b6b80 20 client.15516 populate_metadata read hostname 'smithi163' 2023-07-14T18:12:42.804 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.753+0000 7f1d4c5b6b80 1 --2- 172.21.15.163:0/2732945891 >> [v2:172.21.15.172:6838/3850440096,v1:172.21.15.172:6839/3850440096] conn(0x55bfd2a79bd0 0x55bfd2a78f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:12:42.804 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.753+0000 7f1d4c5b6b80 4 client.15516 mds_command: new command op to 24518 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-14T18:12:42.804 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.753+0000 7f1d4c5b6b80 1 -- 172.21.15.163:0/2732945891 --> [v2:172.21.15.172:6838/3850440096,v1:172.21.15.172:6839/3850440096] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55bfd2a33d50 con 0x55bfd2a79bd0 2023-07-14T18:12:42.804 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.754+0000 7f1d3e1ba700 1 --2- 172.21.15.163:0/2732945891 >> [v2:172.21.15.172:6838/3850440096,v1:172.21.15.172:6839/3850440096] conn(0x55bfd2a79bd0 0x55bfd2a78f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:12:42.804 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.754+0000 7f1d21ffb700 10 client.15516 ms_handle_connect on v2:172.21.15.172:6838/3850440096 2023-07-14T18:12:42.805 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.754+0000 7f1d3e1ba700 1 --2- 172.21.15.163:0/2732945891 >> [v2:172.21.15.172:6838/3850440096,v1:172.21.15.172:6839/3850440096] conn(0x55bfd2a79bd0 0x55bfd2a78f80 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5b0aeb9467b67a69 server_cookie=40d5b51d19757a7c in_seq=0 out_seq=0 2023-07-14T18:12:42.805 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.755+0000 7f1d21ffb700 1 -- 172.21.15.163:0/2732945891 <== mds.0 v2:172.21.15.172:6838/3850440096 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18017 (crc 0 0 0) 0x55bfd2a33d50 con 0x55bfd2a79bd0 2023-07-14T18:12:42.806 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.755+0000 7f1d21ffb700 10 client.15516 handle_command_reply: tid=0 2023-07-14T18:12:42.806 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.755+0000 7f1d4c5b6b80 1 client.15516 shutdown 2023-07-14T18:12:42.806 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.755+0000 7f1d4c5b6b80 1 -- 172.21.15.163:0/2732945891 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55bfd2a66460 msgr2=0x55bfd2a75e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:12:42.806 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.755+0000 7f1d4c5b6b80 1 --2- 172.21.15.163:0/2732945891 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55bfd2a66460 0x55bfd2a75e20 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f1d300042a0 tx=0x7f1d300042d0 comp rx=0 tx=0).stop 2023-07-14T18:12:42.806 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.755+0000 7f1d4c5b6b80 1 -- 172.21.15.163:0/2732945891 shutdown_connections 2023-07-14T18:12:42.806 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.755+0000 7f1d4c5b6b80 1 --2- 172.21.15.163:0/2732945891 >> [v2:172.21.15.172:6838/3850440096,v1:172.21.15.172:6839/3850440096] conn(0x55bfd2a79bd0 0x55bfd2a78f80 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:42.806 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.755+0000 7f1d4c5b6b80 1 --2- 172.21.15.163:0/2732945891 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55bfd2a66460 0x55bfd2a75e20 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:42.807 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.755+0000 7f1d21ffb700 0 client.15516 ms_handle_reset on v2:172.21.15.172:6838/3850440096 2023-07-14T18:12:42.807 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.755+0000 7f1d4c5b6b80 1 --2- 172.21.15.163:0/2732945891 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bfd2a64f10 0x55bfd2a6e8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:42.807 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.755+0000 7f1d4c5b6b80 1 --2- 172.21.15.163:0/2732945891 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55bfd2a65860 0x55bfd2a6ede0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:42.807 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.755+0000 7f1d4c5b6b80 1 -- 172.21.15.163:0/2732945891 >> 172.21.15.163:0/2732945891 conn(0x55bfd2a5a630 msgr2=0x55bfd2a5e600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:12:42.807 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.755+0000 7f1d4c5b6b80 1 -- 172.21.15.163:0/2732945891 shutdown_connections 2023-07-14T18:12:42.807 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.755+0000 7f1d4c5b6b80 1 -- 172.21.15.163:0/2732945891 wait complete. 2023-07-14T18:12:42.807 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.755+0000 7f1d4c5b6b80 20 client.15516 trim_cache size 0 max 16384 2023-07-14T18:12:42.814 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.773+0000 7f1d4c5b6b80 1 Processor -- start 2023-07-14T18:12:42.814 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.773+0000 7f1d4c5b6b80 1 -- start start 2023-07-14T18:12:42.814 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.773+0000 7f1d4c5b6b80 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55bfd2a64f10 0x55bfd2a5f0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:12:42.814 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.773+0000 7f1d4c5b6b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bfd2a65860 0x55bfd2a82960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:12:42.814 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.773+0000 7f1d4c5b6b80 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55bfd2a66460 0x55bfd2a6c830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:12:42.814 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.773+0000 7f1d4c5b6b80 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bfd2984790 con 0x55bfd2a66460 2023-07-14T18:12:42.815 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.773+0000 7f1d4c5b6b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bfd2845de0 con 0x55bfd2a65860 2023-07-14T18:12:42.815 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.773+0000 7f1d4c5b6b80 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bfd2951d50 con 0x55bfd2a64f10 2023-07-14T18:12:42.815 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.773+0000 7f1d3e9bb700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55bfd2a66460 0x55bfd2a6c830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:12:42.815 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.773+0000 7f1d3e9bb700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55bfd2a66460 0x55bfd2a6c830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:57660/0 (socket says 172.21.15.163:57660) 2023-07-14T18:12:42.815 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.773+0000 7f1d3e9bb700 1 -- 172.21.15.163:0/475474149 learned_addr learned my addr 172.21.15.163:0/475474149 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:12:42.815 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.773+0000 7f1d3e1ba700 1 --2- 172.21.15.163:0/475474149 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55bfd2a64f10 0x55bfd2a5f0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:12:42.815 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.773+0000 7f1d3d9b9700 1 --2- 172.21.15.163:0/475474149 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bfd2a65860 0x55bfd2a82960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:12:42.815 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.773+0000 7f1d3e9bb700 1 -- 172.21.15.163:0/475474149 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55bfd2a64f10 msgr2=0x55bfd2a5f0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:12:42.816 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.773+0000 7f1d3e9bb700 1 --2- 172.21.15.163:0/475474149 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55bfd2a64f10 0x55bfd2a5f0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:42.816 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.773+0000 7f1d3e9bb700 1 -- 172.21.15.163:0/475474149 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bfd2a65860 msgr2=0x55bfd2a82960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:12:42.816 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.773+0000 7f1d3e9bb700 1 --2- 172.21.15.163:0/475474149 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bfd2a65860 0x55bfd2a82960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:42.816 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.773+0000 7f1d3e9bb700 1 -- 172.21.15.163:0/475474149 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55bfd280a200 con 0x55bfd2a66460 2023-07-14T18:12:42.816 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.773+0000 7f1d3d9b9700 1 --2- 172.21.15.163:0/475474149 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bfd2a65860 0x55bfd2a82960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T18:12:42.816 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.773+0000 7f1d3e9bb700 1 --2- 172.21.15.163:0/475474149 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55bfd2a66460 0x55bfd2a6c830 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f1d30027fd0 tx=0x7f1d30009210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e3b9b24bd9f285c server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:12:42.816 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.773+0000 7f1d2d5ab700 1 -- 172.21.15.163:0/475474149 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d300153e0 con 0x55bfd2a66460 2023-07-14T18:12:42.817 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.773+0000 7f1d2d5ab700 1 -- 172.21.15.163:0/475474149 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f1d3000f040 con 0x55bfd2a66460 2023-07-14T18:12:42.817 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.773+0000 7f1d2d5ab700 1 -- 172.21.15.163:0/475474149 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d30007970 con 0x55bfd2a66460 2023-07-14T18:12:42.819 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.774+0000 7f1d4c5b6b80 1 -- 172.21.15.163:0/475474149 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55bfd2a66460 msgr2=0x55bfd2a6c830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:12:42.820 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.774+0000 7f1d4c5b6b80 1 --2- 172.21.15.163:0/475474149 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55bfd2a66460 0x55bfd2a6c830 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f1d30027fd0 tx=0x7f1d30009210 comp rx=0 tx=0).stop 2023-07-14T18:12:42.820 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.774+0000 7f1d4c5b6b80 1 -- 172.21.15.163:0/475474149 shutdown_connections 2023-07-14T18:12:42.820 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.774+0000 7f1d4c5b6b80 1 --2- 172.21.15.163:0/475474149 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55bfd2a64f10 0x55bfd2a5f0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:42.820 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.774+0000 7f1d4c5b6b80 1 --2- 172.21.15.163:0/475474149 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55bfd2a66460 0x55bfd2a6c830 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:42.820 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.774+0000 7f1d4c5b6b80 1 --2- 172.21.15.163:0/475474149 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bfd2a65860 0x55bfd2a82960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:42.820 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.774+0000 7f1d4c5b6b80 1 -- 172.21.15.163:0/475474149 >> 172.21.15.163:0/475474149 conn(0x55bfd2a5a630 msgr2=0x55bfd2a6d5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:12:42.821 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.774+0000 7f1d4c5b6b80 1 -- 172.21.15.163:0/475474149 shutdown_connections 2023-07-14T18:12:42.821 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.774+0000 7f1d4c5b6b80 1 -- 172.21.15.163:0/475474149 wait complete. 2023-07-14T18:12:42.821 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.774+0000 7f1d4c5b6b80 1 -- start start 2023-07-14T18:12:42.821 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.774+0000 7f1d4c5b6b80 1 Processor -- start 2023-07-14T18:12:42.821 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.775+0000 7f1d4c5b6b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bfd2a64f10 0x55bfd2a7de10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:12:42.821 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.775+0000 7f1d4c5b6b80 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55bfd2a65860 0x55bfd2a7e350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:12:42.821 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.775+0000 7f1d4c5b6b80 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55bfd2a66460 0x55bfd2a81370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:12:42.821 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.775+0000 7f1d4c5b6b80 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bfd2a818b0 con 0x55bfd2a66460 2023-07-14T18:12:42.822 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.775+0000 7f1d4c5b6b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bfd2a81a20 con 0x55bfd2a64f10 2023-07-14T18:12:42.822 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.775+0000 7f1d4c5b6b80 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bfd2a81be0 con 0x55bfd2a65860 2023-07-14T18:12:42.822 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.775+0000 7f1d4c5b6b80 10 client.0 _ll_register_callbacks cb 0x55bfd2953710 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T18:12:42.822 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.775+0000 7f1d3e1ba700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bfd2a64f10 0x55bfd2a7de10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:12:42.822 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.775+0000 7f1d3e9bb700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55bfd2a66460 0x55bfd2a81370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:12:42.822 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.775+0000 7f1d3e1ba700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bfd2a64f10 0x55bfd2a7de10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.163:58346/0 (socket says 172.21.15.163:58346) 2023-07-14T18:12:42.822 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.775+0000 7f1d3e1ba700 1 -- 172.21.15.163:0/84489721 learned_addr learned my addr 172.21.15.163:0/84489721 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:12:42.823 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.775+0000 7f1d3d9b9700 1 --2- 172.21.15.163:0/84489721 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55bfd2a65860 0x55bfd2a7e350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:12:42.823 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.775+0000 7f1d3e9bb700 1 -- 172.21.15.163:0/84489721 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55bfd2a65860 msgr2=0x55bfd2a7e350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:12:42.823 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.775+0000 7f1d3e9bb700 1 --2- 172.21.15.163:0/84489721 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55bfd2a65860 0x55bfd2a7e350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:42.823 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.775+0000 7f1d3e9bb700 1 -- 172.21.15.163:0/84489721 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bfd2a64f10 msgr2=0x55bfd2a7de10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:12:42.823 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.775+0000 7f1d3e9bb700 1 --2- 172.21.15.163:0/84489721 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bfd2a64f10 0x55bfd2a7de10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:42.823 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.775+0000 7f1d3e9bb700 1 -- 172.21.15.163:0/84489721 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55bfd27ccc10 con 0x55bfd2a66460 2023-07-14T18:12:42.823 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.775+0000 7f1d3e9bb700 1 --2- 172.21.15.163:0/84489721 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55bfd2a66460 0x55bfd2a81370 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x55bfd2a7abf0 tx=0x7f1d30003ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e42eccad68476d33 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:12:42.823 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.775+0000 7f1d21ffb700 10 client.0 ms_handle_connect on v2:172.21.15.163:3300/0 2023-07-14T18:12:42.824 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.775+0000 7f1d21ffb700 1 -- 172.21.15.163:0/84489721 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d30003e70 con 0x55bfd2a66460 2023-07-14T18:12:42.824 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.775+0000 7f1d21ffb700 1 -- 172.21.15.163:0/84489721 <== mon.0 v2:172.21.15.163:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 9020+0+0 (secure 0 0 0) 0x7f1d30016640 con 0x55bfd2a66460 2023-07-14T18:12:42.824 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.775+0000 7f1d4c5b6b80 1 -- 172.21.15.163:0/84489721 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f1d2801e040 con 0x55bfd2a66460 2023-07-14T18:12:42.824 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.775+0000 7f1d21ffb700 1 -- 172.21.15.163:0/84489721 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1d30016800 con 0x55bfd2a66460 2023-07-14T18:12:42.824 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.776+0000 7f1d4c5b6b80 10 client.15522 fetch_fsmap learned FSMap version 28 2023-07-14T18:12:42.824 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.776+0000 7f1d4c5b6b80 1 -- 172.21.15.163:0/84489721 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) v3 -- 0x55bfd27e2260 con 0x55bfd2a66460 2023-07-14T18:12:42.824 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.776+0000 7f1d21ffb700 1 -- 172.21.15.163:0/84489721 <== mon.0 v2:172.21.15.163:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f1d2801e040 con 0x55bfd2a66460 2023-07-14T18:12:42.824 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.776+0000 7f1d21ffb700 1 -- 172.21.15.163:0/84489721 <== mon.0 v2:172.21.15.163:3300/0 5 ==== fsmap(e 28) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f1d30030070 con 0x55bfd2a66460 2023-07-14T18:12:42.825 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.776+0000 7f1d4c5b6b80 10 client.15522 fetch_fsmap finished waiting for FSMap version 28 2023-07-14T18:12:42.825 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.776+0000 7f1d4c5b6b80 10 client.15522 resolve_mds: resolved name 'b' to daemon mds.b 2023-07-14T18:12:42.825 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.776+0000 7f1d4c5b6b80 20 client.15522 populate_metadata read hostname 'smithi163' 2023-07-14T18:12:42.825 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.776+0000 7f1d4c5b6b80 1 --2- 172.21.15.163:0/84489721 >> [v2:172.21.15.172:6838/3850440096,v1:172.21.15.172:6839/3850440096] conn(0x55bfd2ad2d40 0x55bfd2acf880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:12:42.825 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.776+0000 7f1d4c5b6b80 4 client.15522 mds_command: new command op to 24518 tid=0[{"prefix": "status"}] 2023-07-14T18:12:42.825 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.776+0000 7f1d4c5b6b80 1 -- 172.21.15.163:0/84489721 --> [v2:172.21.15.172:6838/3850440096,v1:172.21.15.172:6839/3850440096] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55bfd29aee60 con 0x55bfd2ad2d40 2023-07-14T18:12:42.825 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.776+0000 7f1d3e1ba700 1 --2- 172.21.15.163:0/84489721 >> [v2:172.21.15.172:6838/3850440096,v1:172.21.15.172:6839/3850440096] conn(0x55bfd2ad2d40 0x55bfd2acf880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:12:42.826 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.776+0000 7f1d21ffb700 10 client.15522 ms_handle_connect on v2:172.21.15.172:6838/3850440096 2023-07-14T18:12:42.826 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.776+0000 7f1d3e1ba700 1 --2- 172.21.15.163:0/84489721 >> [v2:172.21.15.172:6838/3850440096,v1:172.21.15.172:6839/3850440096] conn(0x55bfd2ad2d40 0x55bfd2acf880 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1d0188582b3aa9a server_cookie=54fdac31e072ba3b in_seq=0 out_seq=0 2023-07-14T18:12:42.826 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.777+0000 7f1d21ffb700 1 -- 172.21.15.163:0/84489721 <== mds.0 v2:172.21.15.172:6838/3850440096 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+332 (crc 0 0 0) 0x55bfd29aee60 con 0x55bfd2ad2d40 2023-07-14T18:12:42.826 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.777+0000 7f1d21ffb700 10 client.15522 handle_command_reply: tid=0 2023-07-14T18:12:42.826 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.777+0000 7f1d4c5b6b80 1 client.15522 shutdown 2023-07-14T18:12:42.826 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.777+0000 7f1d4c5b6b80 1 -- 172.21.15.163:0/84489721 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55bfd2a66460 msgr2=0x55bfd2a81370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:12:42.826 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.777+0000 7f1d4c5b6b80 1 --2- 172.21.15.163:0/84489721 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55bfd2a66460 0x55bfd2a81370 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x55bfd2a7abf0 tx=0x7f1d30003ac0 comp rx=0 tx=0).stop 2023-07-14T18:12:42.826 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.777+0000 7f1d4c5b6b80 1 -- 172.21.15.163:0/84489721 shutdown_connections 2023-07-14T18:12:42.827 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.777+0000 7f1d4c5b6b80 1 --2- 172.21.15.163:0/84489721 >> [v2:172.21.15.172:6838/3850440096,v1:172.21.15.172:6839/3850440096] conn(0x55bfd2ad2d40 0x55bfd2acf880 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:42.827 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.777+0000 7f1d4c5b6b80 1 --2- 172.21.15.163:0/84489721 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55bfd2a66460 0x55bfd2a81370 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:42.827 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.777+0000 7f1d4c5b6b80 1 --2- 172.21.15.163:0/84489721 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bfd2a64f10 0x55bfd2a7de10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:42.827 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.777+0000 7f1d4c5b6b80 1 --2- 172.21.15.163:0/84489721 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55bfd2a65860 0x55bfd2a7e350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:42.827 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.777+0000 7f1d21ffb700 0 client.15522 ms_handle_reset on v2:172.21.15.172:6838/3850440096 2023-07-14T18:12:42.827 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.777+0000 7f1d4c5b6b80 1 -- 172.21.15.163:0/84489721 >> 172.21.15.163:0/84489721 conn(0x55bfd2a5a630 msgr2=0x55bfd2a6c830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:12:42.827 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.777+0000 7f1d4c5b6b80 1 -- 172.21.15.163:0/84489721 shutdown_connections 2023-07-14T18:12:42.827 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.777+0000 7f1d4c5b6b80 1 -- 172.21.15.163:0/84489721 wait complete. 2023-07-14T18:12:42.828 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.777+0000 7f1d4c5b6b80 20 client.15522 trim_cache size 0 max 16384 2023-07-14T18:12:42.828 INFO:teuthology.orchestra.run.smithi163.stdout:{ 2023-07-14T18:12:42.828 INFO:teuthology.orchestra.run.smithi163.stdout: "cluster_fsid": "bf7326ec-2270-11ee-9b33-001a4aab830c", 2023-07-14T18:12:42.828 INFO:teuthology.orchestra.run.smithi163.stdout: "whoami": 0, 2023-07-14T18:12:42.828 INFO:teuthology.orchestra.run.smithi163.stdout: "id": 24518, 2023-07-14T18:12:42.829 INFO:teuthology.orchestra.run.smithi163.stdout: "want_state": "up:active", 2023-07-14T18:12:42.829 INFO:teuthology.orchestra.run.smithi163.stdout: "state": "up:active", 2023-07-14T18:12:42.829 INFO:teuthology.orchestra.run.smithi163.stdout: "fs_name": "cephfs", 2023-07-14T18:12:42.829 INFO:teuthology.orchestra.run.smithi163.stdout: "rank_uptime": 93.070480696000004, 2023-07-14T18:12:42.829 INFO:teuthology.orchestra.run.smithi163.stdout: "mdsmap_epoch": 28, 2023-07-14T18:12:42.829 INFO:teuthology.orchestra.run.smithi163.stdout: "osdmap_epoch": 86, 2023-07-14T18:12:42.829 INFO:teuthology.orchestra.run.smithi163.stdout: "osdmap_epoch_barrier": 84, 2023-07-14T18:12:42.829 INFO:teuthology.orchestra.run.smithi163.stdout: "uptime": 99.184589243999994 2023-07-14T18:12:42.830 INFO:teuthology.orchestra.run.smithi163.stdout:} 2023-07-14T18:12:42.830 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.777+0000 7f1d4041e700 1 -- 172.21.15.163:0/4219042759 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f1d240a11e0 msgr2=0x7f1d240a3690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:12:42.831 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.777+0000 7f1d4041e700 1 --2- 172.21.15.163:0/4219042759 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f1d240a11e0 0x7f1d240a3690 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f1d2800b5c0 tx=0x7f1d28005fb0 comp rx=0 tx=0).stop 2023-07-14T18:12:42.831 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.777+0000 7f1d4041e700 1 -- 172.21.15.163:0/4219042759 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f1d380ffd10 msgr2=0x7f1d38194d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:12:42.831 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.777+0000 7f1d4041e700 1 --2- 172.21.15.163:0/4219042759 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f1d380ffd10 0x7f1d38194d20 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f1d3400d980 tx=0x7f1d3400dc90 comp rx=0 tx=0).stop 2023-07-14T18:12:42.831 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.777+0000 7f1d4041e700 1 -- 172.21.15.163:0/4219042759 shutdown_connections 2023-07-14T18:12:42.831 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.777+0000 7f1d4041e700 1 --2- 172.21.15.163:0/4219042759 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f1d240a11e0 0x7f1d240a3690 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:42.831 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.777+0000 7f1d4041e700 1 --2- 172.21.15.163:0/4219042759 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1d381006a0 0x7f1d3819bd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:42.832 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.777+0000 7f1d4041e700 1 --2- 172.21.15.163:0/4219042759 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1d380feb20 0x7f1d381947e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:42.832 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.777+0000 7f1d4041e700 1 --2- 172.21.15.163:0/4219042759 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f1d380ffd10 0x7f1d38194d20 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:42.832 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.777+0000 7f1d4041e700 1 -- 172.21.15.163:0/4219042759 >> 172.21.15.163:0/4219042759 conn(0x7f1d380fa160 msgr2=0x7f1d380fc480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:12:42.832 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.778+0000 7f1d4041e700 1 -- 172.21.15.163:0/4219042759 shutdown_connections 2023-07-14T18:12:42.832 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:42.778+0000 7f1d4041e700 1 -- 172.21.15.163:0/4219042759 wait complete. 2023-07-14T18:12:42.832 INFO:teuthology.run_tasks:Running task ceph-fuse... 2023-07-14T18:12:42.842 INFO:tasks.ceph_fuse:Running ceph_fuse task... 2023-07-14T18:12:42.843 INFO:tasks.ceph_fuse:config is {'client.0': {}} 2023-07-14T18:12:42.843 INFO:tasks.ceph_fuse:client.0 config is {'mount_subvol_num': 0} 2023-07-14T18:12:42.843 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-07-14T18:12:42.844 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-07-14T18:12:42.844 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T18:12:42.844 DEBUG:teuthology.orchestra.run.smithi163:> ip netns list 2023-07-14T18:12:42.861 INFO:teuthology.orchestra.run.smithi163.stdout:ceph-ns--home-ubuntu-cephtest-mnt.admin (id: 0) 2023-07-14T18:12:42.861 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T18:12:42.862 DEBUG:teuthology.orchestra.run.smithi163:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.admin 2023-07-14T18:12:42.939 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T18:12:42.940 DEBUG:teuthology.orchestra.run.smithi163:> sudo ip link delete ceph-brx 2023-07-14T18:12:43.044 INFO:tasks.ceph_fuse:Mounting ceph-fuse clients... 2023-07-14T18:12:43.044 DEBUG:teuthology.orchestra.run.smithi163:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81c9387d2e7576da065747ec9c16d1c7d69016ec shell --fsid bf7326ec-2270-11ee-9b33-001a4aab830c -- ceph fs ls 2023-07-14T18:12:43.175 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:12:42 smithi184 ceph-mon[98481]: from='client.? 172.21.15.163:0/3242121750' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-07-14T18:12:43.217 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:12:42 smithi163 ceph-mon[96576]: from='client.? 172.21.15.163:0/3242121750' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-07-14T18:12:43.276 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:12:42 smithi172 ceph-mon[97983]: from='client.? 172.21.15.163:0/3242121750' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-07-14T18:12:43.599 INFO:teuthology.orchestra.run.smithi163.stderr:Inferring config /var/lib/ceph/bf7326ec-2270-11ee-9b33-001a4aab830c/mon.a/config 2023-07-14T18:12:44.100 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:12:43 smithi163 ceph-mon[96576]: pgmap v300: 129 pgs: 129 active+clean; 643 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-07-14T18:12:44.175 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:12:43 smithi184 ceph-mon[98481]: pgmap v300: 129 pgs: 129 active+clean; 643 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-07-14T18:12:44.276 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:12:43 smithi172 ceph-mon[97983]: pgmap v300: 129 pgs: 129 active+clean; 643 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-07-14T18:12:44.806 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:44.765+0000 7fc632167700 1 -- 172.21.15.163:0/1523897369 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc62c1007a0 msgr2=0x7fc62c100c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:12:44.806 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:44.765+0000 7fc632167700 1 --2- 172.21.15.163:0/1523897369 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc62c1007a0 0x7fc62c100c10 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7fc61c0099c0 tx=0x7fc61c009cd0 comp rx=0 tx=0).stop 2023-07-14T18:12:44.806 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:44.765+0000 7fc632167700 1 -- 172.21.15.163:0/1523897369 shutdown_connections 2023-07-14T18:12:44.806 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:44.765+0000 7fc632167700 1 --2- 172.21.15.163:0/1523897369 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc62c101150 0x7fc62c10bb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:44.806 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:44.765+0000 7fc632167700 1 --2- 172.21.15.163:0/1523897369 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc62c0fef40 0x7fc62c0ff310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:44.807 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:44.765+0000 7fc632167700 1 --2- 172.21.15.163:0/1523897369 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc62c1007a0 0x7fc62c100c10 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:44.807 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:44.765+0000 7fc632167700 1 -- 172.21.15.163:0/1523897369 >> 172.21.15.163:0/1523897369 conn(0x7fc62c075c90 msgr2=0x7fc62c076090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:12:44.807 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:44.765+0000 7fc632167700 1 -- 172.21.15.163:0/1523897369 shutdown_connections 2023-07-14T18:12:44.807 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:44.765+0000 7fc632167700 1 -- 172.21.15.163:0/1523897369 wait complete. 2023-07-14T18:12:44.809 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:44.766+0000 7fc632167700 1 Processor -- start 2023-07-14T18:12:44.809 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:44.766+0000 7fc632167700 1 -- start start 2023-07-14T18:12:44.809 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:44.766+0000 7fc632167700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc62c0fef40 0x7fc62c195d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:12:44.810 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:44.766+0000 7fc632167700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc62c1007a0 0x7fc62c1962c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:12:44.810 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:44.766+0000 7fc632167700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc62c101150 0x7fc62c19a730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:12:44.810 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:44.766+0000 7fc632167700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc62c19ad40 con 0x7fc62c101150 2023-07-14T18:12:44.810 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:44.766+0000 7fc632167700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc62c19aeb0 con 0x7fc62c0fef40 2023-07-14T18:12:44.810 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:44.766+0000 7fc632167700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc62c19b070 con 0x7fc62c1007a0 2023-07-14T18:12:44.810 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:44.767+0000 7fc62bfff700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc62c101150 0x7fc62c19a730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:12:44.811 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:44.767+0000 7fc62bfff700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc62c101150 0x7fc62c19a730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:57678/0 (socket says 172.21.15.163:57678) 2023-07-14T18:12:44.811 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:44.767+0000 7fc62bfff700 1 -- 172.21.15.163:0/3548571526 learned_addr learned my addr 172.21.15.163:0/3548571526 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:12:44.811 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:44.767+0000 7fc62b7fe700 1 --2- 172.21.15.163:0/3548571526 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc62c0fef40 0x7fc62c195d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:12:44.811 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:44.767+0000 7fc62affd700 1 --2- 172.21.15.163:0/3548571526 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc62c1007a0 0x7fc62c1962c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:12:44.811 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:44.767+0000 7fc62bfff700 1 -- 172.21.15.163:0/3548571526 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc62c1007a0 msgr2=0x7fc62c1962c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:12:44.811 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:44.767+0000 7fc62bfff700 1 --2- 172.21.15.163:0/3548571526 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc62c1007a0 0x7fc62c1962c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:44.811 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:44.767+0000 7fc62bfff700 1 -- 172.21.15.163:0/3548571526 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc62c0fef40 msgr2=0x7fc62c195d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:12:44.811 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:44.767+0000 7fc62bfff700 1 --2- 172.21.15.163:0/3548571526 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc62c0fef40 0x7fc62c195d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:44.812 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:44.767+0000 7fc62bfff700 1 -- 172.21.15.163:0/3548571526 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc61c0095f0 con 0x7fc62c101150 2023-07-14T18:12:44.812 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:44.767+0000 7fc62affd700 1 --2- 172.21.15.163:0/3548571526 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc62c1007a0 0x7fc62c1962c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T18:12:44.812 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:44.767+0000 7fc62bfff700 1 --2- 172.21.15.163:0/3548571526 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc62c101150 0x7fc62c19a730 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7fc624007ee0 tx=0x7fc62400d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:12:44.812 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:44.767+0000 7fc628ff9700 1 -- 172.21.15.163:0/3548571526 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc624017070 con 0x7fc62c101150 2023-07-14T18:12:44.812 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:44.767+0000 7fc632167700 1 -- 172.21.15.163:0/3548571526 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc62c19b350 con 0x7fc62c101150 2023-07-14T18:12:44.812 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:44.767+0000 7fc628ff9700 1 -- 172.21.15.163:0/3548571526 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fc62400f040 con 0x7fc62c101150 2023-07-14T18:12:44.812 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:44.767+0000 7fc628ff9700 1 -- 172.21.15.163:0/3548571526 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc624005710 con 0x7fc62c101150 2023-07-14T18:12:44.813 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:44.767+0000 7fc632167700 1 -- 172.21.15.163:0/3548571526 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc62c1a2bb0 con 0x7fc62c101150 2023-07-14T18:12:44.813 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:44.768+0000 7fc632167700 1 -- 172.21.15.163:0/3548571526 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc62c108230 con 0x7fc62c101150 2023-07-14T18:12:44.813 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:44.769+0000 7fc628ff9700 1 -- 172.21.15.163:0/3548571526 <== mon.0 v2:172.21.15.163:3300/0 4 ==== mgrmap(e 17) v1 ==== 135767+0+0 (secure 0 0 0) 0x7fc624005870 con 0x7fc62c101150 2023-07-14T18:12:44.814 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:44.770+0000 7fc628ff9700 1 --2- 172.21.15.163:0/3548571526 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7fc6140a11e0 0x7fc6140a3690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:12:44.814 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:44.770+0000 7fc62b7fe700 1 --2- 172.21.15.163:0/3548571526 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7fc6140a11e0 0x7fc6140a3690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:12:44.814 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:44.770+0000 7fc628ff9700 1 -- 172.21.15.163:0/3548571526 <== mon.0 v2:172.21.15.163:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 9020+0+0 (secure 0 0 0) 0x7fc6240ccb30 con 0x7fc62c101150 2023-07-14T18:12:44.814 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:44.770+0000 7fc62b7fe700 1 --2- 172.21.15.163:0/3548571526 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7fc6140a11e0 0x7fc6140a3690 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fc620007be0 tx=0x7fc6200073d0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:12:44.814 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:44.774+0000 7fc628ff9700 1 -- 172.21.15.163:0/3548571526 <== mon.0 v2:172.21.15.163:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178025 (secure 0 0 0) 0x7fc624095e10 con 0x7fc62c101150 2023-07-14T18:12:45.043 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:45.002+0000 7fc632167700 1 -- 172.21.15.163:0/3548571526 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fc62c04e340 con 0x7fc62c101150 2023-07-14T18:12:45.043 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:45.003+0000 7fc628ff9700 1 -- 172.21.15.163:0/3548571526 <== mon.0 v2:172.21.15.163:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v28) v1 ==== 53+0+88 (secure 0 0 0) 0x7fc624099430 con 0x7fc62c101150 2023-07-14T18:12:45.044 INFO:teuthology.orchestra.run.smithi163.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2023-07-14T18:12:45.045 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:45.005+0000 7fc632167700 1 -- 172.21.15.163:0/3548571526 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7fc6140a11e0 msgr2=0x7fc6140a3690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:12:45.046 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:45.005+0000 7fc632167700 1 --2- 172.21.15.163:0/3548571526 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7fc6140a11e0 0x7fc6140a3690 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fc620007be0 tx=0x7fc6200073d0 comp rx=0 tx=0).stop 2023-07-14T18:12:45.046 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:45.005+0000 7fc632167700 1 -- 172.21.15.163:0/3548571526 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc62c101150 msgr2=0x7fc62c19a730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:12:45.046 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:45.005+0000 7fc632167700 1 --2- 172.21.15.163:0/3548571526 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc62c101150 0x7fc62c19a730 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7fc624007ee0 tx=0x7fc62400d3b0 comp rx=0 tx=0).stop 2023-07-14T18:12:45.047 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:45.005+0000 7fc632167700 1 -- 172.21.15.163:0/3548571526 shutdown_connections 2023-07-14T18:12:45.047 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:45.005+0000 7fc632167700 1 --2- 172.21.15.163:0/3548571526 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7fc6140a11e0 0x7fc6140a3690 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:45.047 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:45.005+0000 7fc632167700 1 --2- 172.21.15.163:0/3548571526 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc62c101150 0x7fc62c19a730 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:45.048 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:45.005+0000 7fc632167700 1 --2- 172.21.15.163:0/3548571526 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc62c0fef40 0x7fc62c195d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:45.048 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:45.005+0000 7fc632167700 1 --2- 172.21.15.163:0/3548571526 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc62c1007a0 0x7fc62c1962c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:45.048 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:45.005+0000 7fc632167700 1 -- 172.21.15.163:0/3548571526 >> 172.21.15.163:0/3548571526 conn(0x7fc62c075c90 msgr2=0x7fc62c068ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:12:45.048 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:45.005+0000 7fc632167700 1 -- 172.21.15.163:0/3548571526 shutdown_connections 2023-07-14T18:12:45.049 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:45.005+0000 7fc632167700 1 -- 172.21.15.163:0/3548571526 wait complete. 2023-07-14T18:12:45.425 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:12:45 smithi184 ceph-mon[98481]: from='client.? 172.21.15.163:0/3548571526' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2023-07-14T18:12:45.445 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:12:45 smithi163 ceph-mon[96576]: from='client.? 172.21.15.163:0/3548571526' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2023-07-14T18:12:45.446 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-07-14T18:12:45.447 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-07-14T18:12:45.447 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi163.front.sepia.ceph.com 2023-07-14T18:12:45.448 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-07-14T18:12:45.448 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-07-14T18:12:45.449 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-07-14T18:12:45.449 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-07-14T18:12:45.449 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-07-14T18:12:45.450 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2023-07-14T18:12:45.450 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T18:12:45.451 DEBUG:teuthology.orchestra.run.smithi163:> ip addr 2023-07-14T18:12:45.483 INFO:teuthology.orchestra.run.smithi163.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-07-14T18:12:45.483 INFO:teuthology.orchestra.run.smithi163.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-07-14T18:12:45.483 INFO:teuthology.orchestra.run.smithi163.stdout: inet 127.0.0.1/8 scope host lo 2023-07-14T18:12:45.483 INFO:teuthology.orchestra.run.smithi163.stdout: valid_lft forever preferred_lft forever 2023-07-14T18:12:45.484 INFO:teuthology.orchestra.run.smithi163.stdout: inet6 ::1/128 scope host 2023-07-14T18:12:45.484 INFO:teuthology.orchestra.run.smithi163.stdout: valid_lft forever preferred_lft forever 2023-07-14T18:12:45.484 INFO:teuthology.orchestra.run.smithi163.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-07-14T18:12:45.484 INFO:teuthology.orchestra.run.smithi163.stdout: link/ether 0c:c4:7a:d9:38:06 brd ff:ff:ff:ff:ff:ff 2023-07-14T18:12:45.484 INFO:teuthology.orchestra.run.smithi163.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-07-14T18:12:45.485 INFO:teuthology.orchestra.run.smithi163.stdout: link/ether 0c:c4:7a:d9:38:07 brd ff:ff:ff:ff:ff:ff 2023-07-14T18:12:45.485 INFO:teuthology.orchestra.run.smithi163.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-07-14T18:12:45.485 INFO:teuthology.orchestra.run.smithi163.stdout: link/ether 0c:c4:7a:88:7d:5a brd ff:ff:ff:ff:ff:ff 2023-07-14T18:12:45.485 INFO:teuthology.orchestra.run.smithi163.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-07-14T18:12:45.485 INFO:teuthology.orchestra.run.smithi163.stdout: link/ether 0c:c4:7a:88:7d:5b brd ff:ff:ff:ff:ff:ff 2023-07-14T18:12:45.485 INFO:teuthology.orchestra.run.smithi163.stdout: inet 172.21.15.163/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-07-14T18:12:45.486 INFO:teuthology.orchestra.run.smithi163.stdout: valid_lft 41637sec preferred_lft 41637sec 2023-07-14T18:12:45.486 INFO:teuthology.orchestra.run.smithi163.stdout: inet6 fe80::6692:500b:f94:c3b8/64 scope link noprefixroute 2023-07-14T18:12:45.486 INFO:teuthology.orchestra.run.smithi163.stdout: valid_lft forever preferred_lft forever 2023-07-14T18:12:45.486 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-07-14T18:12:45.486 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T18:12:45.487 DEBUG:teuthology.orchestra.run.smithi163:> (cd / && exec bash -c ' 2023-07-14T18:12:45.487 DEBUG:teuthology.orchestra.run.smithi163:> set -e 2023-07-14T18:12:45.487 DEBUG:teuthology.orchestra.run.smithi163:> sudo ip link add name ceph-brx type bridge 2023-07-14T18:12:45.487 DEBUG:teuthology.orchestra.run.smithi163:> sudo ip addr flush dev ceph-brx 2023-07-14T18:12:45.488 DEBUG:teuthology.orchestra.run.smithi163:> sudo ip link set ceph-brx up 2023-07-14T18:12:45.488 DEBUG:teuthology.orchestra.run.smithi163:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-07-14T18:12:45.488 DEBUG:teuthology.orchestra.run.smithi163:> ') 2023-07-14T18:12:45.527 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:12:45 smithi172 ceph-mon[97983]: from='client.? 172.21.15.163:0/3548571526' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2023-07-14T18:12:45.603 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T18:12:45.603 DEBUG:teuthology.orchestra.run.smithi163:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-07-14T18:12:45.629 INFO:teuthology.orchestra.run.smithi163.stdout:1 2023-07-14T18:12:45.630 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T18:12:45.630 DEBUG:teuthology.orchestra.run.smithi163:> route 2023-07-14T18:12:45.689 INFO:teuthology.orchestra.run.smithi163.stdout:Kernel IP routing table 2023-07-14T18:12:45.689 INFO:teuthology.orchestra.run.smithi163.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-07-14T18:12:45.689 INFO:teuthology.orchestra.run.smithi163.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-07-14T18:12:45.689 INFO:teuthology.orchestra.run.smithi163.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-07-14T18:12:45.689 INFO:teuthology.orchestra.run.smithi163.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-07-14T18:12:45.690 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T18:12:45.690 DEBUG:teuthology.orchestra.run.smithi163:> (cd / && exec bash -c ' 2023-07-14T18:12:45.690 DEBUG:teuthology.orchestra.run.smithi163:> set -e 2023-07-14T18:12:45.691 DEBUG:teuthology.orchestra.run.smithi163:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-07-14T18:12:45.691 DEBUG:teuthology.orchestra.run.smithi163:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-07-14T18:12:45.691 DEBUG:teuthology.orchestra.run.smithi163:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-07-14T18:12:45.691 DEBUG:teuthology.orchestra.run.smithi163:> ') 2023-07-14T18:12:45.797 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T18:12:45.797 DEBUG:teuthology.orchestra.run.smithi163:> ip netns list 2023-07-14T18:12:45.814 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T18:12:45.814 DEBUG:teuthology.orchestra.run.smithi163:> ip netns list-id 2023-07-14T18:12:45.871 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T18:12:45.872 DEBUG:teuthology.orchestra.run.smithi163:> (cd / && exec bash -c ' 2023-07-14T18:12:45.872 DEBUG:teuthology.orchestra.run.smithi163:> set -e 2023-07-14T18:12:45.872 DEBUG:teuthology.orchestra.run.smithi163:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2023-07-14T18:12:45.872 DEBUG:teuthology.orchestra.run.smithi163:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2023-07-14T18:12:45.873 DEBUG:teuthology.orchestra.run.smithi163:> ') 2023-07-14T18:12:45.965 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2023-07-14T18:12:45.966 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T18:12:45.966 DEBUG:teuthology.orchestra.run.smithi163:> (cd / && exec bash -c ' 2023-07-14T18:12:45.966 DEBUG:teuthology.orchestra.run.smithi163:> set -e 2023-07-14T18:12:45.966 DEBUG:teuthology.orchestra.run.smithi163:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2023-07-14T18:12:45.967 DEBUG:teuthology.orchestra.run.smithi163:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-07-14T18:12:45.967 DEBUG:teuthology.orchestra.run.smithi163:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2023-07-14T18:12:45.967 DEBUG:teuthology.orchestra.run.smithi163:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2023-07-14T18:12:45.967 DEBUG:teuthology.orchestra.run.smithi163:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2023-07-14T18:12:45.967 DEBUG:teuthology.orchestra.run.smithi163:> ') 2023-07-14T18:12:46.153 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T18:12:46.154 DEBUG:teuthology.orchestra.run.smithi163:> (cd / && exec bash -c ' 2023-07-14T18:12:46.154 DEBUG:teuthology.orchestra.run.smithi163:> set -e 2023-07-14T18:12:46.154 DEBUG:teuthology.orchestra.run.smithi163:> sudo ip link set brx.0 up 2023-07-14T18:12:46.155 DEBUG:teuthology.orchestra.run.smithi163:> sudo ip link set dev brx.0 master ceph-brx 2023-07-14T18:12:46.155 DEBUG:teuthology.orchestra.run.smithi163:> ') 2023-07-14T18:12:46.260 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {'mount_subvol_num': 0} 2023-07-14T18:12:46.261 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-07-14T18:12:46.261 DEBUG:teuthology.orchestra.run.smithi163:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-07-14T18:12:46.281 INFO:teuthology.orchestra.run.smithi163.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-07-14T18:12:46.281 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-07-14T18:12:46.282 DEBUG:teuthology.orchestra.run.smithi163:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-07-14T18:12:46.337 DEBUG:teuthology.orchestra.run.smithi163:> sudo modprobe fuse 2023-07-14T18:12:46.404 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-07-14T18:12:46.405 DEBUG:teuthology.orchestra.run.smithi163:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-07-14T18:12:46.472 INFO:teuthology.orchestra.run.smithi163.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-07-14T18:12:46.472 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-07-14T18:12:46.473 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T18:12:46.473 DEBUG:teuthology.orchestra.run.smithi163:> ls /sys/fs/fuse/connections 2023-07-14T18:12:46.530 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-07-14T18:12:46.530 DEBUG:teuthology.orchestra.run.smithi163:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0 --client_mountpoint=/volumes/_nogroup/sv_0/bdaa90d5-6841-467b-a07c-ed561ecb0005 --client_fs=cephfs) 2023-07-14T18:12:46.572 DEBUG:teuthology.orchestra.run.smithi163:> sudo modprobe fuse 2023-07-14T18:12:46.597 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-07-14T18:12:46.598 DEBUG:teuthology.orchestra.run.smithi163:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-07-14T18:12:46.659 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi163.stderr:2023-07-14T18:12:46.619+0000 7fe72fff75c0 -1 init, newargv = 0x55fd112a0cc0 newargc=15 2023-07-14T18:12:46.660 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi163.stderr:ceph-fuse[146701]: starting ceph client 2023-07-14T18:12:46.667 INFO:teuthology.orchestra.run.smithi163.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-07-14T18:12:46.668 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-07-14T18:12:46.669 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T18:12:46.669 DEBUG:teuthology.orchestra.run.smithi163:> ls /sys/fs/fuse/connections 2023-07-14T18:12:46.681 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi163.stderr:ceph-fuse[146701]: starting fuse 2023-07-14T18:12:46.697 INFO:teuthology.orchestra.run.smithi163.stdout:124 2023-07-14T18:12:46.698 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [124] 2023-07-14T18:12:46.698 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-07-14T18:12:46.698 DEBUG:teuthology.orchestra.run.smithi163:> import glob 2023-07-14T18:12:46.699 DEBUG:teuthology.orchestra.run.smithi163:> import re 2023-07-14T18:12:46.699 DEBUG:teuthology.orchestra.run.smithi163:> import os 2023-07-14T18:12:46.699 DEBUG:teuthology.orchestra.run.smithi163:> import subprocess 2023-07-14T18:12:46.699 DEBUG:teuthology.orchestra.run.smithi163:> 2023-07-14T18:12:46.700 DEBUG:teuthology.orchestra.run.smithi163:> def _find_admin_socket(client_name): 2023-07-14T18:12:46.700 DEBUG:teuthology.orchestra.run.smithi163:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2023-07-14T18:12:46.700 DEBUG:teuthology.orchestra.run.smithi163:> files = glob.glob(asok_path) 2023-07-14T18:12:46.700 DEBUG:teuthology.orchestra.run.smithi163:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2023-07-14T18:12:46.701 DEBUG:teuthology.orchestra.run.smithi163:> 2023-07-14T18:12:46.702 DEBUG:teuthology.orchestra.run.smithi163:> # Given a non-glob path, it better be there 2023-07-14T18:12:46.702 DEBUG:teuthology.orchestra.run.smithi163:> if "*" not in asok_path: 2023-07-14T18:12:46.702 DEBUG:teuthology.orchestra.run.smithi163:> assert(len(files) == 1) 2023-07-14T18:12:46.703 DEBUG:teuthology.orchestra.run.smithi163:> return files[0] 2023-07-14T18:12:46.703 DEBUG:teuthology.orchestra.run.smithi163:> 2023-07-14T18:12:46.703 DEBUG:teuthology.orchestra.run.smithi163:> for f in files: 2023-07-14T18:12:46.703 DEBUG:teuthology.orchestra.run.smithi163:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-07-14T18:12:46.703 DEBUG:teuthology.orchestra.run.smithi163:> if os.path.exists("/proc/{0}".format(pid)): 2023-07-14T18:12:46.704 DEBUG:teuthology.orchestra.run.smithi163:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-07-14T18:12:46.704 DEBUG:teuthology.orchestra.run.smithi163:> contents = proc_f.read() 2023-07-14T18:12:46.704 DEBUG:teuthology.orchestra.run.smithi163:> if mountpoint in contents: 2023-07-14T18:12:46.705 DEBUG:teuthology.orchestra.run.smithi163:> return f 2023-07-14T18:12:46.705 DEBUG:teuthology.orchestra.run.smithi163:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-07-14T18:12:46.705 DEBUG:teuthology.orchestra.run.smithi163:> 2023-07-14T18:12:46.705 DEBUG:teuthology.orchestra.run.smithi163:> print(_find_admin_socket("client.0")) 2023-07-14T18:12:46.706 DEBUG:teuthology.orchestra.run.smithi163:> ' 2023-07-14T18:12:46.822 INFO:teuthology.orchestra.run.smithi163.stdout:/var/run/ceph/ceph-client.0.146701.asok 2023-07-14T18:12:46.967 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:12:46 smithi163 ceph-mon[96576]: pgmap v301: 129 pgs: 129 active+clean; 643 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-07-14T18:12:46.968 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:12:46 smithi163 ceph-mon[96576]: mgrmap e18: x(active, since 7m), standbys: z, y 2023-07-14T18:12:47.004 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.146701.asok 2023-07-14T18:12:47.004 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T18:12:47.005 DEBUG:teuthology.orchestra.run.smithi163:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.146701.asok status 2023-07-14T18:12:47.161 INFO:teuthology.orchestra.run.smithi163.stdout:{ 2023-07-14T18:12:47.162 INFO:teuthology.orchestra.run.smithi163.stdout: "metadata": { 2023-07-14T18:12:47.162 INFO:teuthology.orchestra.run.smithi163.stdout: "ceph_sha1": "81c9387d2e7576da065747ec9c16d1c7d69016ec", 2023-07-14T18:12:47.162 INFO:teuthology.orchestra.run.smithi163.stdout: "ceph_version": "ceph version 18.0.0-4940-g81c9387d (81c9387d2e7576da065747ec9c16d1c7d69016ec) reef (dev)", 2023-07-14T18:12:47.163 INFO:teuthology.orchestra.run.smithi163.stdout: "entity_id": "0", 2023-07-14T18:12:47.163 INFO:teuthology.orchestra.run.smithi163.stdout: "hostname": "smithi163", 2023-07-14T18:12:47.163 INFO:teuthology.orchestra.run.smithi163.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2023-07-14T18:12:47.163 INFO:teuthology.orchestra.run.smithi163.stdout: "pid": "146701", 2023-07-14T18:12:47.163 INFO:teuthology.orchestra.run.smithi163.stdout: "root": "/volumes/_nogroup/sv_0/bdaa90d5-6841-467b-a07c-ed561ecb0005" 2023-07-14T18:12:47.163 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:12:47.163 INFO:teuthology.orchestra.run.smithi163.stdout: "dentry_count": 0, 2023-07-14T18:12:47.164 INFO:teuthology.orchestra.run.smithi163.stdout: "dentry_pinned_count": 0, 2023-07-14T18:12:47.164 INFO:teuthology.orchestra.run.smithi163.stdout: "id": 15534, 2023-07-14T18:12:47.164 INFO:teuthology.orchestra.run.smithi163.stdout: "inst": { 2023-07-14T18:12:47.164 INFO:teuthology.orchestra.run.smithi163.stdout: "name": { 2023-07-14T18:12:47.164 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "client", 2023-07-14T18:12:47.164 INFO:teuthology.orchestra.run.smithi163.stdout: "num": 15534 2023-07-14T18:12:47.164 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:12:47.165 INFO:teuthology.orchestra.run.smithi163.stdout: "addr": { 2023-07-14T18:12:47.165 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "v1", 2023-07-14T18:12:47.165 INFO:teuthology.orchestra.run.smithi163.stdout: "addr": "192.168.0.1:0", 2023-07-14T18:12:47.165 INFO:teuthology.orchestra.run.smithi163.stdout: "nonce": 2518742483 2023-07-14T18:12:47.165 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-07-14T18:12:47.165 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:12:47.165 INFO:teuthology.orchestra.run.smithi163.stdout: "addr": { 2023-07-14T18:12:47.165 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "v1", 2023-07-14T18:12:47.166 INFO:teuthology.orchestra.run.smithi163.stdout: "addr": "192.168.0.1:0", 2023-07-14T18:12:47.166 INFO:teuthology.orchestra.run.smithi163.stdout: "nonce": 2518742483 2023-07-14T18:12:47.166 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:12:47.166 INFO:teuthology.orchestra.run.smithi163.stdout: "inst_str": "client.15534 192.168.0.1:0/2518742483", 2023-07-14T18:12:47.166 INFO:teuthology.orchestra.run.smithi163.stdout: "addr_str": "192.168.0.1:0/2518742483", 2023-07-14T18:12:47.166 INFO:teuthology.orchestra.run.smithi163.stdout: "inode_count": 5, 2023-07-14T18:12:47.166 INFO:teuthology.orchestra.run.smithi163.stdout: "mds_epoch": 28, 2023-07-14T18:12:47.166 INFO:teuthology.orchestra.run.smithi163.stdout: "osd_epoch": 86, 2023-07-14T18:12:47.167 INFO:teuthology.orchestra.run.smithi163.stdout: "osd_epoch_barrier": 0, 2023-07-14T18:12:47.167 INFO:teuthology.orchestra.run.smithi163.stdout: "blocklisted": false, 2023-07-14T18:12:47.167 INFO:teuthology.orchestra.run.smithi163.stdout: "fs_name": "cephfs" 2023-07-14T18:12:47.167 INFO:teuthology.orchestra.run.smithi163.stdout:} 2023-07-14T18:12:47.171 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T18:12:47.172 DEBUG:teuthology.orchestra.run.smithi163:> stat --file-system '--printf=%T 2023-07-14T18:12:47.172 DEBUG:teuthology.orchestra.run.smithi163:> ' -- /home/ubuntu/cephtest/mnt.0 2023-07-14T18:12:47.175 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:12:46 smithi184 ceph-mon[98481]: pgmap v301: 129 pgs: 129 active+clean; 643 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-07-14T18:12:47.175 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:12:46 smithi184 ceph-mon[98481]: mgrmap e18: x(active, since 7m), standbys: z, y 2023-07-14T18:12:47.189 INFO:teuthology.orchestra.run.smithi163.stdout:fuseblk 2023-07-14T18:12:47.189 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2023-07-14T18:12:47.190 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T18:12:47.190 DEBUG:teuthology.orchestra.run.smithi163:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-07-14T18:12:47.258 INFO:teuthology.run_tasks:Running task exec... 2023-07-14T18:12:47.277 INFO:teuthology.task.exec:Executing custom commands... 2023-07-14T18:12:47.277 INFO:teuthology.task.exec:Running commands on role mon.a host ubuntu@smithi163.front.sepia.ceph.com 2023-07-14T18:12:47.277 DEBUG:teuthology.orchestra.run.smithi163:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs set cephfs balance_automate true' 2023-07-14T18:12:47.278 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:12:46 smithi172 ceph-mon[97983]: pgmap v301: 129 pgs: 129 active+clean; 643 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-07-14T18:12:47.278 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:12:46 smithi172 ceph-mon[97983]: mgrmap e18: x(active, since 7m), standbys: z, y 2023-07-14T18:12:47.425 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:47.380+0000 7fc40c244700 1 -- 172.21.15.163:0/2876276854 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc4040ffd30 msgr2=0x7fc404100180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:12:47.425 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:47.380+0000 7fc40c244700 1 --2- 172.21.15.163:0/2876276854 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc4040ffd30 0x7fc404100180 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7fc3f4009990 tx=0x7fc3f4009ca0 comp rx=0 tx=0).stop 2023-07-14T18:12:47.426 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:47.380+0000 7fc40c244700 1 -- 172.21.15.163:0/2876276854 shutdown_connections 2023-07-14T18:12:47.426 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:47.380+0000 7fc40c244700 1 --2- 172.21.15.163:0/2876276854 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc4040feb40 0x7fc4040fef50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:47.426 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:47.380+0000 7fc40c244700 1 --2- 172.21.15.163:0/2876276854 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc4041006c0 0x7fc404106f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:47.426 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:47.380+0000 7fc40c244700 1 --2- 172.21.15.163:0/2876276854 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc4040ffd30 0x7fc404100180 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:47.427 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:47.380+0000 7fc40c244700 1 -- 172.21.15.163:0/2876276854 >> 172.21.15.163:0/2876276854 conn(0x7fc4040fa160 msgr2=0x7fc4040fc590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:12:47.427 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:47.381+0000 7fc40c244700 1 -- 172.21.15.163:0/2876276854 shutdown_connections 2023-07-14T18:12:47.427 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:47.381+0000 7fc40c244700 1 -- 172.21.15.163:0/2876276854 wait complete. 2023-07-14T18:12:47.428 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:47.381+0000 7fc40c244700 1 Processor -- start 2023-07-14T18:12:47.428 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:47.381+0000 7fc40c244700 1 -- start start 2023-07-14T18:12:47.428 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:47.381+0000 7fc40c244700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc4040feb40 0x7fc4041948b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:12:47.428 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:47.381+0000 7fc40c244700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc4040ffd30 0x7fc404194df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:12:47.428 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:47.381+0000 7fc40c244700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc4041006c0 0x7fc404195c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:12:47.429 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:47.381+0000 7fc40c244700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4041962d0 con 0x7fc4040feb40 2023-07-14T18:12:47.429 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:47.381+0000 7fc40c244700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc404196440 con 0x7fc4041006c0 2023-07-14T18:12:47.429 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:47.381+0000 7fc40c244700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc404196600 con 0x7fc4040ffd30 2023-07-14T18:12:47.429 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:47.381+0000 7fc409fe0700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc4040feb40 0x7fc4041948b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:12:47.430 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:47.382+0000 7fc409fe0700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc4040feb40 0x7fc4041948b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:57708/0 (socket says 172.21.15.163:57708) 2023-07-14T18:12:47.430 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:47.382+0000 7fc409fe0700 1 -- 172.21.15.163:0/4126438538 learned_addr learned my addr 172.21.15.163:0/4126438538 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:12:47.430 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:47.382+0000 7fc40a7e1700 1 --2- 172.21.15.163:0/4126438538 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc4041006c0 0x7fc404195c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:12:47.431 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:47.382+0000 7fc4097df700 1 --2- 172.21.15.163:0/4126438538 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc4040ffd30 0x7fc404194df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:12:47.431 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:47.382+0000 7fc409fe0700 1 -- 172.21.15.163:0/4126438538 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc4040ffd30 msgr2=0x7fc404194df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:12:47.431 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:47.382+0000 7fc409fe0700 1 --2- 172.21.15.163:0/4126438538 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc4040ffd30 0x7fc404194df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:47.431 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:47.382+0000 7fc409fe0700 1 -- 172.21.15.163:0/4126438538 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc4041006c0 msgr2=0x7fc404195c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:12:47.431 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:47.382+0000 7fc409fe0700 1 --2- 172.21.15.163:0/4126438538 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc4041006c0 0x7fc404195c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:47.431 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:47.382+0000 7fc409fe0700 1 -- 172.21.15.163:0/4126438538 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3f40095f0 con 0x7fc4040feb40 2023-07-14T18:12:47.431 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:47.382+0000 7fc409fe0700 1 --2- 172.21.15.163:0/4126438538 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc4040feb40 0x7fc4041948b0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7fc40000c970 tx=0x7fc40000cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:12:47.432 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:47.382+0000 7fc3faffd700 1 -- 172.21.15.163:0/4126438538 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc400004220 con 0x7fc4040feb40 2023-07-14T18:12:47.432 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:47.382+0000 7fc40c244700 1 -- 172.21.15.163:0/4126438538 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc4041968e0 con 0x7fc4040feb40 2023-07-14T18:12:47.432 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:47.382+0000 7fc3faffd700 1 -- 172.21.15.163:0/4126438538 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fc400007d30 con 0x7fc4040feb40 2023-07-14T18:12:47.432 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:47.382+0000 7fc3faffd700 1 -- 172.21.15.163:0/4126438538 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc400003b30 con 0x7fc4040feb40 2023-07-14T18:12:47.432 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:47.382+0000 7fc40c244700 1 -- 172.21.15.163:0/4126438538 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc40419d0a0 con 0x7fc4040feb40 2023-07-14T18:12:47.432 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:47.383+0000 7fc40c244700 1 -- 172.21.15.163:0/4126438538 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc40404e420 con 0x7fc4040feb40 2023-07-14T18:12:47.432 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:47.384+0000 7fc3faffd700 1 -- 172.21.15.163:0/4126438538 <== mon.0 v2:172.21.15.163:3300/0 4 ==== mgrmap(e 18) v1 ==== 135716+0+0 (secure 0 0 0) 0x7fc400003cb0 con 0x7fc4040feb40 2023-07-14T18:12:47.433 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:47.385+0000 7fc3faffd700 1 --2- 172.21.15.163:0/4126438538 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7fc3f00a1150 0x7fc3f00a3600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:12:47.433 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:47.385+0000 7fc4097df700 1 --2- 172.21.15.163:0/4126438538 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7fc3f00a1150 0x7fc3f00a3600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:12:47.433 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:47.385+0000 7fc3faffd700 1 -- 172.21.15.163:0/4126438538 <== mon.0 v2:172.21.15.163:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 9020+0+0 (secure 0 0 0) 0x7fc4000cc890 con 0x7fc4040feb40 2023-07-14T18:12:47.434 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:47.385+0000 7fc4097df700 1 --2- 172.21.15.163:0/4126438538 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7fc3f00a1150 0x7fc3f00a3600 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fc3f400c010 tx=0x7fc3f400b540 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:12:47.434 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:47.389+0000 7fc3faffd700 1 -- 172.21.15.163:0/4126438538 <== mon.0 v2:172.21.15.163:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178025 (secure 0 0 0) 0x7fc400095c70 con 0x7fc4040feb40 2023-07-14T18:12:47.661 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:47.621+0000 7fc40c244700 1 -- 172.21.15.163:0/4126438538 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"} v 0) v1 -- 0x7fc404105ac0 con 0x7fc4040feb40 2023-07-14T18:12:47.827 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:47.787+0000 7fc3faffd700 1 -- 172.21.15.163:0/4126438538 <== mon.0 v2:172.21.15.163:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]=0 v29) v1 ==== 117+0+0 (secure 0 0 0) 0x7fc400099290 con 0x7fc4040feb40 2023-07-14T18:12:47.829 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:47.789+0000 7fc40c244700 1 -- 172.21.15.163:0/4126438538 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7fc3f00a1150 msgr2=0x7fc3f00a3600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:12:47.829 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:47.789+0000 7fc40c244700 1 --2- 172.21.15.163:0/4126438538 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7fc3f00a1150 0x7fc3f00a3600 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fc3f400c010 tx=0x7fc3f400b540 comp rx=0 tx=0).stop 2023-07-14T18:12:47.829 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:47.789+0000 7fc40c244700 1 -- 172.21.15.163:0/4126438538 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc4040feb40 msgr2=0x7fc4041948b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:12:47.830 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:47.789+0000 7fc40c244700 1 --2- 172.21.15.163:0/4126438538 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc4040feb40 0x7fc4041948b0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7fc40000c970 tx=0x7fc40000cc80 comp rx=0 tx=0).stop 2023-07-14T18:12:47.830 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:47.789+0000 7fc40c244700 1 -- 172.21.15.163:0/4126438538 shutdown_connections 2023-07-14T18:12:47.830 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:47.789+0000 7fc40c244700 1 --2- 172.21.15.163:0/4126438538 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7fc3f00a1150 0x7fc3f00a3600 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:47.830 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:47.789+0000 7fc40c244700 1 --2- 172.21.15.163:0/4126438538 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc4041006c0 0x7fc404195c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:47.830 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:47.789+0000 7fc40c244700 1 --2- 172.21.15.163:0/4126438538 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc4040feb40 0x7fc4041948b0 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:47.831 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:47.789+0000 7fc40c244700 1 --2- 172.21.15.163:0/4126438538 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc4040ffd30 0x7fc404194df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:47.831 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:47.789+0000 7fc40c244700 1 -- 172.21.15.163:0/4126438538 >> 172.21.15.163:0/4126438538 conn(0x7fc4040fa160 msgr2=0x7fc4040fc3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:12:47.831 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:47.789+0000 7fc40c244700 1 -- 172.21.15.163:0/4126438538 shutdown_connections 2023-07-14T18:12:47.831 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:47.789+0000 7fc40c244700 1 -- 172.21.15.163:0/4126438538 wait complete. 2023-07-14T18:12:47.841 INFO:teuthology.run_tasks:Running task check-counter... 2023-07-14T18:12:47.854 INFO:teuthology.run_tasks:Running task fwd_scrub... 2023-07-14T18:12:47.865 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-14T18:12:47.990 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:47.948+0000 7f23df44f700 1 -- 172.21.15.163:0/2834117896 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f23d80ff710 msgr2=0x7f23d8106fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:12:47.990 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:47.948+0000 7f23df44f700 1 --2- 172.21.15.163:0/2834117896 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f23d80ff710 0x7f23d8106fe0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f23d000b0a0 tx=0x7f23d000b3b0 comp rx=0 tx=0).stop 2023-07-14T18:12:47.990 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:47.948+0000 7f23df44f700 1 -- 172.21.15.163:0/2834117896 shutdown_connections 2023-07-14T18:12:47.991 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:47.948+0000 7f23df44f700 1 --2- 172.21.15.163:0/2834117896 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f23d80ff710 0x7f23d8106fe0 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:47.991 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:47.948+0000 7f23df44f700 1 --2- 172.21.15.163:0/2834117896 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f23d81000e0 0x7f23d81004f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:47.991 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:47.948+0000 7f23df44f700 1 --2- 172.21.15.163:0/2834117896 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f23d80fed80 0x7f23d80ff1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:47.991 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:47.948+0000 7f23df44f700 1 -- 172.21.15.163:0/2834117896 >> 172.21.15.163:0/2834117896 conn(0x7f23d80f98a0 msgr2=0x7f23d80fbcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:12:47.991 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:47.948+0000 7f23df44f700 1 -- 172.21.15.163:0/2834117896 shutdown_connections 2023-07-14T18:12:47.992 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:47.948+0000 7f23df44f700 1 -- 172.21.15.163:0/2834117896 wait complete. 2023-07-14T18:12:47.992 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:47.948+0000 7f23df44f700 1 Processor -- start 2023-07-14T18:12:47.992 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:47.948+0000 7f23df44f700 1 -- start start 2023-07-14T18:12:47.992 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:47.949+0000 7f23df44f700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f23d80fed80 0x7f23d8194850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:12:47.992 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:47.949+0000 7f23df44f700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f23d80ff710 0x7f23d8194d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:12:47.992 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:47.949+0000 7f23df44f700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f23d81000e0 0x7f23d819be00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:12:47.992 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:47.949+0000 7f23df44f700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23d819c3d0 con 0x7f23d80ff710 2023-07-14T18:12:47.993 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:47.949+0000 7f23df44f700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23d819c510 con 0x7f23d81000e0 2023-07-14T18:12:47.993 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:47.949+0000 7f23df44f700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23d819c6a0 con 0x7f23d80fed80 2023-07-14T18:12:47.993 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:47.949+0000 7f23dc9ea700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f23d80ff710 0x7f23d8194d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:12:47.993 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:47.949+0000 7f23dc9ea700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f23d80ff710 0x7f23d8194d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:57724/0 (socket says 172.21.15.163:57724) 2023-07-14T18:12:47.993 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:47.949+0000 7f23dc9ea700 1 -- 172.21.15.163:0/4210787994 learned_addr learned my addr 172.21.15.163:0/4210787994 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:12:47.993 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:47.949+0000 7f23dd1eb700 1 --2- 172.21.15.163:0/4210787994 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f23d80fed80 0x7f23d8194850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:12:47.993 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:47.949+0000 7f23dd9ec700 1 --2- 172.21.15.163:0/4210787994 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f23d81000e0 0x7f23d819be00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:12:47.993 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:47.949+0000 7f23dc9ea700 1 -- 172.21.15.163:0/4210787994 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f23d80fed80 msgr2=0x7f23d8194850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:12:47.994 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:47.949+0000 7f23dc9ea700 1 --2- 172.21.15.163:0/4210787994 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f23d80fed80 0x7f23d8194850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:47.994 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:47.949+0000 7f23dc9ea700 1 -- 172.21.15.163:0/4210787994 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f23d81000e0 msgr2=0x7f23d819be00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:12:47.994 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:47.949+0000 7f23dc9ea700 1 --2- 172.21.15.163:0/4210787994 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f23d81000e0 0x7f23d819be00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:47.994 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:47.949+0000 7f23dc9ea700 1 -- 172.21.15.163:0/4210787994 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23d0009d00 con 0x7f23d80ff710 2023-07-14T18:12:47.994 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:47.949+0000 7f23dc9ea700 1 --2- 172.21.15.163:0/4210787994 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f23d80ff710 0x7f23d8194d90 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f23c800d950 tx=0x7f23c800dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:12:47.994 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:47.949+0000 7f23ce7fc700 1 -- 172.21.15.163:0/4210787994 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23c800f890 con 0x7f23d80ff710 2023-07-14T18:12:47.994 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:47.949+0000 7f23df44f700 1 -- 172.21.15.163:0/4210787994 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f23d819c980 con 0x7f23d80ff710 2023-07-14T18:12:47.995 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:47.949+0000 7f23ce7fc700 1 -- 172.21.15.163:0/4210787994 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f23c800fe80 con 0x7f23d80ff710 2023-07-14T18:12:47.995 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:47.949+0000 7f23ce7fc700 1 -- 172.21.15.163:0/4210787994 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23c800e3b0 con 0x7f23d80ff710 2023-07-14T18:12:47.995 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:47.949+0000 7f23df44f700 1 -- 172.21.15.163:0/4210787994 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f23d819cee0 con 0x7f23d80ff710 2023-07-14T18:12:47.996 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:47.950+0000 7f23df44f700 1 -- 172.21.15.163:0/4210787994 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f23d8106100 con 0x7f23d80ff710 2023-07-14T18:12:47.996 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:47.951+0000 7f23ce7fc700 1 -- 172.21.15.163:0/4210787994 <== mon.0 v2:172.21.15.163:3300/0 4 ==== mgrmap(e 18) v1 ==== 135716+0+0 (secure 0 0 0) 0x7f23c8010460 con 0x7f23d80ff710 2023-07-14T18:12:47.996 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:47.952+0000 7f23ce7fc700 1 --2- 172.21.15.163:0/4210787994 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f23c40a11a0 0x7f23c40a3650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:12:47.996 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:47.952+0000 7f23dd1eb700 1 --2- 172.21.15.163:0/4210787994 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f23c40a11a0 0x7f23c40a3650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:12:47.996 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:47.952+0000 7f23ce7fc700 1 -- 172.21.15.163:0/4210787994 <== mon.0 v2:172.21.15.163:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 9020+0+0 (secure 0 0 0) 0x7f23c80cc9c0 con 0x7f23d80ff710 2023-07-14T18:12:47.996 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:47.952+0000 7f23dd1eb700 1 --2- 172.21.15.163:0/4210787994 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f23c40a11a0 0x7f23c40a3650 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f23d8067560 tx=0x7f23d400b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:12:47.997 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:47.956+0000 7f23ce7fc700 1 -- 172.21.15.163:0/4210787994 <== mon.0 v2:172.21.15.163:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178025 (secure 0 0 0) 0x7f23c8095e00 con 0x7f23d80ff710 2023-07-14T18:12:48.175 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:12:47 smithi184 ceph-mon[98481]: from='client.? 172.21.15.163:0/4126438538' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]: dispatch 2023-07-14T18:12:48.186 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:48.145+0000 7f23df44f700 1 -- 172.21.15.163:0/4210787994 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f23d8061250 con 0x7f23d80ff710 2023-07-14T18:12:48.187 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:48.147+0000 7f23ce7fc700 1 -- 172.21.15.163:0/4210787994 <== mon.0 v2:172.21.15.163:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v86) v1 ==== 74+0+24500 (secure 0 0 0) 0x7f23c8016090 con 0x7f23d80ff710 2023-07-14T18:12:48.188 INFO:teuthology.orchestra.run.smithi163.stdout: 2023-07-14T18:12:48.188 INFO:teuthology.orchestra.run.smithi163.stdout:{"epoch":86,"fsid":"bf7326ec-2270-11ee-9b33-001a4aab830c","created":"2023-07-14T18:04:26.263517+0000","modified":"2023-07-14T18:12:16.776609+0000","last_up_change":"2023-07-14T18:10:27.514863+0000","last_in_change":"2023-07-14T18:10:10.726443+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-14T18:07:19.653852+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-07-14T18:11:07.314989+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-07-14T18:11:08.274627+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-07-14T18:11:11.991162+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"e6490568-046d-43ef-bb07-d79fb884b276","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6802","nonce":3124653025},{"type":"v1","addr":"172.21.15.163:6803","nonce":3124653025}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6804","nonce":3124653025},{"type":"v1","addr":"172.21.15.163:6805","nonce":3124653025}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6808","nonce":3124653025},{"type":"v1","addr":"172.21.15.163:6809","nonce":3124653025}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6806","nonce":3124653025},{"type":"v1","addr":"172.21.15.163:6807","nonce":3124653025}]},"public_addr":"172.21.15.163:6803/3124653025","cluster_addr":"172.21.15.163:6805/3124653025","heartbeat_back_addr":"172.21.15.163:6809/3124653025","heartbeat_front_addr":"172.21.15.163:6807/3124653025","state":["exists","up"]},{"osd":1,"uuid":"0af39bda-f096-4603-adcc-bf1988f36603","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":3774455900},{"type":"v1","addr":"172.21.15.172:6801","nonce":3774455900}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":3774455900},{"type":"v1","addr":"172.21.15.172:6803","nonce":3774455900}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":3774455900},{"type":"v1","addr":"172.21.15.172:6807","nonce":3774455900}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":3774455900},{"type":"v1","addr":"172.21.15.172:6805","nonce":3774455900}]},"public_addr":"172.21.15.172:6801/3774455900","cluster_addr":"172.21.15.172:6803/3774455900","heartbeat_back_addr":"172.21.15.172:6807/3774455900","heartbeat_front_addr":"172.21.15.172:6805/3774455900","state":["exists","up"]},{"osd":2,"uuid":"cc732c13-af0f-4199-98e6-fe960ed4e5dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":1976927678},{"type":"v1","addr":"172.21.15.184:6801","nonce":1976927678}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":1976927678},{"type":"v1","addr":"172.21.15.184:6803","nonce":1976927678}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":1976927678},{"type":"v1","addr":"172.21.15.184:6807","nonce":1976927678}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":1976927678},{"type":"v1","addr":"172.21.15.184:6805","nonce":1976927678}]},"public_addr":"172.21.15.184:6801/1976927678","cluster_addr":"172.21.15.184:6803/1976927678","heartbeat_back_addr":"172.21.15.184:6807/1976927678","heartbeat_front_addr":"172.21.15.184:6805/1976927678","state":["exists","up"]},{"osd":3,"uuid":"dcee9576-0bc6-4ab0-8f63-79eacd0eca5f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6810","nonce":2589130694},{"type":"v1","addr":"172.21.15.163:6811","nonce":2589130694}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6812","nonce":2589130694},{"type":"v1","addr":"172.21.15.163:6813","nonce":2589130694}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6816","nonce":2589130694},{"type":"v1","addr":"172.21.15.163:6817","nonce":2589130694}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6814","nonce":2589130694},{"type":"v1","addr":"172.21.15.163:6815","nonce":2589130694}]},"public_addr":"172.21.15.163:6811/2589130694","cluster_addr":"172.21.15.163:6813/2589130694","heartbeat_back_addr":"172.21.15.163:6817/2589130694","heartbeat_front_addr":"172.21.15.163:6815/2589130694","state":["exists","up"]},{"osd":4,"uuid":"055df823-b8b0-426a-83c2-f0d727932ad8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":3319632614},{"type":"v1","addr":"172.21.15.172:6809","nonce":3319632614}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6810","nonce":3319632614},{"type":"v1","addr":"172.21.15.172:6811","nonce":3319632614}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6814","nonce":3319632614},{"type":"v1","addr":"172.21.15.172:6815","nonce":3319632614}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":3319632614},{"type":"v1","addr":"172.21.15.172:6813","nonce":3319632614}]},"public_addr":"172.21.15.172:6809/3319632614","cluster_addr":"172.21.15.172:6811/3319632614","heartbeat_back_addr":"172.21.15.172:6815/3319632614","heartbeat_front_addr":"172.21.15.172:6813/3319632614","state":["exists","up"]},{"osd":5,"uuid":"ef5ef02a-b4e2-4790-9d27-f6d2247b25c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":2662084043},{"type":"v1","addr":"172.21.15.184:6809","nonce":2662084043}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6810","nonce":2662084043},{"type":"v1","addr":"172.21.15.184:6811","nonce":2662084043}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6814","nonce":2662084043},{"type":"v1","addr":"172.21.15.184:6815","nonce":2662084043}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6812","nonce":2662084043},{"type":"v1","addr":"172.21.15.184:6813","nonce":2662084043}]},"public_addr":"172.21.15.184:6809/2662084043","cluster_addr":"172.21.15.184:6811/2662084043","heartbeat_back_addr":"172.21.15.184:6815/2662084043","heartbeat_front_addr":"172.21.15.184:6813/2662084043","state":["exists","up"]},{"osd":6,"uuid":"dba754be-0fc5-4867-a6d5-cf97eb344f81","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":44,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6818","nonce":2530874117},{"type":"v1","addr":"172.21.15.163:6819","nonce":2530874117}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6820","nonce":2530874117},{"type":"v1","addr":"172.21.15.163:6821","nonce":2530874117}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6824","nonce":2530874117},{"type":"v1","addr":"172.21.15.163:6825","nonce":2530874117}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6822","nonce":2530874117},{"type":"v1","addr":"172.21.15.163:6823","nonce":2530874117}]},"public_addr":"172.21.15.163:6819/2530874117","cluster_addr":"172.21.15.163:6821/2530874117","heartbeat_back_addr":"172.21.15.163:6825/2530874117","heartbeat_front_addr":"172.21.15.163:6823/2530874117","state":["exists","up"]},{"osd":7,"uuid":"edd76e6b-6077-4619-b00d-1e906f70ddcc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":49,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":233511803},{"type":"v1","addr":"172.21.15.172:6817","nonce":233511803}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6818","nonce":233511803},{"type":"v1","addr":"172.21.15.172:6819","nonce":233511803}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":233511803},{"type":"v1","addr":"172.21.15.172:6823","nonce":233511803}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6820","nonce":233511803},{"type":"v1","addr":"172.21.15.172:6821","nonce":233511803}]},"public_addr":"172.21.15.172:6817/233511803","cluster_addr":"172.21.15.172:6819/233511803","heartbeat_back_addr":"172.21.15.172:6823/233511803","heartbeat_front_addr":"172.21.15.172:6821/233511803","state":["exists","up"]},{"osd":8,"uuid":"36559400-f33e-44e6-868a-316d34da457d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":56,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6816","nonce":290154343},{"type":"v1","addr":"172.21.15.184:6817","nonce":290154343}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6818","nonce":290154343},{"type":"v1","addr":"172.21.15.184:6819","nonce":290154343}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6822","nonce":290154343},{"type":"v1","addr":"172.21.15.184:6823","nonce":290154343}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6820","nonce":290154343},{"type":"v1","addr":"172.21.15.184:6821","nonce":290154343}]},"public_addr":"172.21.15.184:6817/290154343","cluster_addr":"172.21.15.184:6819/290154343","heartbeat_back_addr":"172.21.15.184:6823/290154343","heartbeat_front_addr":"172.21.15.184:6821/290154343","state":["exists","up"]},{"osd":9,"uuid":"d484f111-f36c-4c67-9a8a-ae03e7e0d137","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6826","nonce":3848110906},{"type":"v1","addr":"172.21.15.163:6827","nonce":3848110906}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6828","nonce":3848110906},{"type":"v1","addr":"172.21.15.163:6829","nonce":3848110906}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6832","nonce":3848110906},{"type":"v1","addr":"172.21.15.163:6833","nonce":3848110906}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6830","nonce":3848110906},{"type":"v1","addr":"172.21.15.163:6831","nonce":3848110906}]},"public_addr":"172.21.15.163:6827/3848110906","cluster_addr":"172.21.15.163:6829/3848110906","heartbeat_back_addr":"172.21.15.163:6833/3848110906","heartbeat_front_addr":"172.21.15.163:6831/3848110906","state":["exists","up"]},{"osd":10,"uuid":"d943f7c0-da3d-4605-9e23-0231e675c6be","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6824","nonce":3281085356},{"type":"v1","addr":"172.21.15.172:6825","nonce":3281085356}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":3281085356},{"type":"v1","addr":"172.21.15.172:6827","nonce":3281085356}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":3281085356},{"type":"v1","addr":"172.21.15.172:6831","nonce":3281085356}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6828","nonce":3281085356},{"type":"v1","addr":"172.21.15.172:6829","nonce":3281085356}]},"public_addr":"172.21.15.172:6825/3281085356","cluster_addr":"172.21.15.172:6827/3281085356","heartbeat_back_addr":"172.21.15.172:6831/3281085356","heartbeat_front_addr":"172.21.15.172:6829/3281085356","state":["exists","up"]},{"osd":11,"uuid":"09e610a8-408a-4119-a21b-c4de2810a538","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":75,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6824","nonce":3614578747},{"type":"v1","addr":"172.21.15.184:6825","nonce":3614578747}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6826","nonce":3614578747},{"type":"v1","addr":"172.21.15.184:6827","nonce":3614578747}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6830","nonce":3614578747},{"type":"v1","addr":"172.21.15.184:6831","nonce":3614578747}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6828","nonce":3614578747},{"type":"v1","addr":"172.21.15.184:6829","nonce":3614578747}]},"public_addr":"172.21.15.184:6825/3614578747","cluster_addr":"172.21.15.184:6827/3614578747","heartbeat_back_addr":"172.21.15.184:6831/3614578747","heartbeat_front_addr":"172.21.15.184:6829/3614578747","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T18:06:36.067578+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T18:06:57.095120+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T18:07:17.825363+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T18:07:38.977196+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T18:08:00.108709+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T18:08:20.700646+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T18:08:41.473899+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T18:09:02.856536+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T18:09:23.832722+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T18:09:44.860884+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T18:10:05.520678+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T18:10:26.426315+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.8","mappings":[{"from":2,"to":11}]},{"pgid":"3.1","mappings":[{"from":4,"to":9}]},{"pgid":"3.6","mappings":[{"from":4,"to":6}]},{"pgid":"3.25","mappings":[{"from":5,"to":9}]},{"pgid":"3.27","mappings":[{"from":4,"to":8}]},{"pgid":"3.2d","mappings":[{"from":3,"to":9}]},{"pgid":"4.a","mappings":[{"from":5,"to":8}]},{"pgid":"4.12","mappings":[{"from":9,"to":10}]},{"pgid":"4.14","mappings":[{"from":9,"to":8}]},{"pgid":"4.17","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.163:6801/1086512093":"2023-07-15T18:05:15.331458+0000","172.21.15.163:6800/1086512093":"2023-07-15T18:05:15.331458+0000","172.21.15.163:0/4235784810":"2023-07-15T18:05:15.331458+0000","172.21.15.163:6800/236891232":"2023-07-15T18:04:53.288443+0000","172.21.15.163:6801/236891232":"2023-07-15T18:04:53.288443+0000","172.21.15.163:0/3260193612":"2023-07-15T18:05:15.331458+0000","172.21.15.163:0/3513629472":"2023-07-15T18:04:53.288443+0000","172.21.15.163:0/1090329830":"2023-07-15T18:04:53.288443+0000","172.21.15.163:0/3868922045":"2023-07-15T18:05:15.331458+0000","172.21.15.163:0/2945662447":"2023-07-15T18:04:53.288443+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-14T18:12:48.189 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:48.149+0000 7f23df44f700 1 -- 172.21.15.163:0/4210787994 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f23c40a11a0 msgr2=0x7f23c40a3650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:12:48.190 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:48.149+0000 7f23df44f700 1 --2- 172.21.15.163:0/4210787994 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f23c40a11a0 0x7f23c40a3650 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f23d8067560 tx=0x7f23d400b410 comp rx=0 tx=0).stop 2023-07-14T18:12:48.190 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:48.149+0000 7f23df44f700 1 -- 172.21.15.163:0/4210787994 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f23d80ff710 msgr2=0x7f23d8194d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:12:48.190 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:48.149+0000 7f23df44f700 1 --2- 172.21.15.163:0/4210787994 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f23d80ff710 0x7f23d8194d90 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f23c800d950 tx=0x7f23c800dc60 comp rx=0 tx=0).stop 2023-07-14T18:12:48.190 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:48.149+0000 7f23df44f700 1 -- 172.21.15.163:0/4210787994 shutdown_connections 2023-07-14T18:12:48.190 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:48.149+0000 7f23df44f700 1 --2- 172.21.15.163:0/4210787994 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f23c40a11a0 0x7f23c40a3650 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:48.190 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:48.149+0000 7f23df44f700 1 --2- 172.21.15.163:0/4210787994 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f23d80fed80 0x7f23d8194850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:48.191 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:48.149+0000 7f23df44f700 1 --2- 172.21.15.163:0/4210787994 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f23d81000e0 0x7f23d819be00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:48.191 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:48.149+0000 7f23df44f700 1 --2- 172.21.15.163:0/4210787994 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f23d80ff710 0x7f23d8194d90 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:48.191 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:48.149+0000 7f23df44f700 1 -- 172.21.15.163:0/4210787994 >> 172.21.15.163:0/4210787994 conn(0x7f23d80f98a0 msgr2=0x7f23d8103240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:12:48.191 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:48.149+0000 7f23df44f700 1 -- 172.21.15.163:0/4210787994 shutdown_connections 2023-07-14T18:12:48.191 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:48.149+0000 7f23df44f700 1 -- 172.21.15.163:0/4210787994 wait complete. 2023-07-14T18:12:48.200 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:12:47 smithi163 ceph-mon[96576]: from='client.? 172.21.15.163:0/4126438538' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]: dispatch 2023-07-14T18:12:48.202 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-14T18:07:19.653852+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-14T18:11:07.314989+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '79', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-07-14T18:11:08.274627+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '80', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-07-14T18:11:11.991162+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '84', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-07-14T18:12:48.203 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-14T18:12:48.276 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:12:47 smithi172 ceph-mon[97983]: from='client.? 172.21.15.163:0/4126438538' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]: dispatch 2023-07-14T18:12:48.327 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:48.286+0000 7f1bcc229700 1 -- 172.21.15.163:0/3414886241 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f1bc40ffd00 msgr2=0x7f1bc4100150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:12:48.327 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:48.286+0000 7f1bcc229700 1 --2- 172.21.15.163:0/3414886241 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f1bc40ffd00 0x7f1bc4100150 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f1bc0009990 tx=0x7f1bc0009ca0 comp rx=0 tx=0).stop 2023-07-14T18:12:48.327 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:48.286+0000 7f1bcc229700 1 -- 172.21.15.163:0/3414886241 shutdown_connections 2023-07-14T18:12:48.327 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:48.286+0000 7f1bcc229700 1 --2- 172.21.15.163:0/3414886241 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1bc40feb10 0x7f1bc40fef20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:48.328 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:48.286+0000 7f1bcc229700 1 --2- 172.21.15.163:0/3414886241 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1bc4100690 0x7f1bc4106f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:48.328 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:48.286+0000 7f1bcc229700 1 --2- 172.21.15.163:0/3414886241 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f1bc40ffd00 0x7f1bc4100150 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:48.328 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:48.286+0000 7f1bcc229700 1 -- 172.21.15.163:0/3414886241 >> 172.21.15.163:0/3414886241 conn(0x7f1bc40fa130 msgr2=0x7f1bc40fc560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:12:48.328 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:48.286+0000 7f1bcc229700 1 -- 172.21.15.163:0/3414886241 shutdown_connections 2023-07-14T18:12:48.328 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:48.286+0000 7f1bcc229700 1 -- 172.21.15.163:0/3414886241 wait complete. 2023-07-14T18:12:48.330 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:48.287+0000 7f1bcc229700 1 Processor -- start 2023-07-14T18:12:48.330 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:48.287+0000 7f1bcc229700 1 -- start start 2023-07-14T18:12:48.330 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:48.287+0000 7f1bcc229700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1bc40feb10 0x7f1bc4068330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:12:48.331 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:48.287+0000 7f1bcc229700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f1bc40ffd00 0x7f1bc419a5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:12:48.331 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:48.287+0000 7f1bcc229700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1bc4100690 0x7f1bc419cc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:12:48.331 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:48.287+0000 7f1bcc229700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1bc419d3e0 con 0x7f1bc40ffd00 2023-07-14T18:12:48.331 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:48.287+0000 7f1bcc229700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1bc419d550 con 0x7f1bc40feb10 2023-07-14T18:12:48.331 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:48.287+0000 7f1bcc229700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1bc419d710 con 0x7f1bc4100690 2023-07-14T18:12:48.331 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:48.287+0000 7f1bc97c4700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f1bc40ffd00 0x7f1bc419a5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:12:48.331 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:48.287+0000 7f1bc97c4700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f1bc40ffd00 0x7f1bc419a5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:57738/0 (socket says 172.21.15.163:57738) 2023-07-14T18:12:48.331 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:48.287+0000 7f1bc97c4700 1 -- 172.21.15.163:0/789779203 learned_addr learned my addr 172.21.15.163:0/789779203 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:12:48.332 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:48.287+0000 7f1bc9fc5700 1 --2- 172.21.15.163:0/789779203 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1bc40feb10 0x7f1bc4068330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:12:48.332 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:48.287+0000 7f1bca7c6700 1 --2- 172.21.15.163:0/789779203 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1bc4100690 0x7f1bc419cc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:12:48.332 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:48.287+0000 7f1bc97c4700 1 -- 172.21.15.163:0/789779203 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1bc4100690 msgr2=0x7f1bc419cc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:12:48.332 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:48.287+0000 7f1bc97c4700 1 --2- 172.21.15.163:0/789779203 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1bc4100690 0x7f1bc419cc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:48.332 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:48.287+0000 7f1bc97c4700 1 -- 172.21.15.163:0/789779203 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1bc40feb10 msgr2=0x7f1bc4068330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:12:48.332 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:48.287+0000 7f1bc97c4700 1 --2- 172.21.15.163:0/789779203 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1bc40feb10 0x7f1bc4068330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:48.332 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:48.287+0000 7f1bc97c4700 1 -- 172.21.15.163:0/789779203 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1bc00095f0 con 0x7f1bc40ffd00 2023-07-14T18:12:48.333 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:48.287+0000 7f1bca7c6700 1 --2- 172.21.15.163:0/789779203 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1bc4100690 0x7f1bc419cc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T18:12:48.333 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:48.287+0000 7f1bc9fc5700 1 --2- 172.21.15.163:0/789779203 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1bc40feb10 0x7f1bc4068330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T18:12:48.333 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:48.288+0000 7f1bc97c4700 1 --2- 172.21.15.163:0/789779203 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f1bc40ffd00 0x7f1bc419a5c0 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f1bc0003a50 tx=0x7f1bc0009580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:12:48.333 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:48.288+0000 7f1bb6ffd700 1 -- 172.21.15.163:0/789779203 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bc001d070 con 0x7f1bc40ffd00 2023-07-14T18:12:48.333 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:48.288+0000 7f1bcc229700 1 -- 172.21.15.163:0/789779203 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1bc419d990 con 0x7f1bc40ffd00 2023-07-14T18:12:48.333 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:48.288+0000 7f1bb6ffd700 1 -- 172.21.15.163:0/789779203 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f1bc0005a00 con 0x7f1bc40ffd00 2023-07-14T18:12:48.333 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:48.288+0000 7f1bb6ffd700 1 -- 172.21.15.163:0/789779203 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bc0005280 con 0x7f1bc40ffd00 2023-07-14T18:12:48.333 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:48.288+0000 7f1bcc229700 1 -- 172.21.15.163:0/789779203 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1bc419dde0 con 0x7f1bc40ffd00 2023-07-14T18:12:48.334 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:48.289+0000 7f1bcc229700 1 -- 172.21.15.163:0/789779203 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1bc4106150 con 0x7f1bc40ffd00 2023-07-14T18:12:48.334 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:48.290+0000 7f1bb6ffd700 1 -- 172.21.15.163:0/789779203 <== mon.0 v2:172.21.15.163:3300/0 4 ==== mgrmap(e 18) v1 ==== 135716+0+0 (secure 0 0 0) 0x7f1bc00053e0 con 0x7f1bc40ffd00 2023-07-14T18:12:48.334 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:48.290+0000 7f1bb6ffd700 1 --2- 172.21.15.163:0/789779203 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f1bb00a1150 0x7f1bb00a3600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:12:48.335 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:48.290+0000 7f1bc9fc5700 1 --2- 172.21.15.163:0/789779203 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f1bb00a1150 0x7f1bb00a3600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:12:48.336 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:48.290+0000 7f1bb6ffd700 1 -- 172.21.15.163:0/789779203 <== mon.0 v2:172.21.15.163:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 9020+0+0 (secure 0 0 0) 0x7f1bc00cdd90 con 0x7f1bc40ffd00 2023-07-14T18:12:48.336 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:48.291+0000 7f1bc9fc5700 1 --2- 172.21.15.163:0/789779203 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f1bb00a1150 0x7f1bb00a3600 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f1bb8005fd0 tx=0x7f1bb8005e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:12:48.336 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:48.294+0000 7f1bb6ffd700 1 -- 172.21.15.163:0/789779203 <== mon.0 v2:172.21.15.163:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178025 (secure 0 0 0) 0x7f1bc005b780 con 0x7f1bc40ffd00 2023-07-14T18:12:48.526 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:48.485+0000 7f1bcc229700 1 -- 172.21.15.163:0/789779203 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f1bc40612f0 con 0x7f1bc40ffd00 2023-07-14T18:12:48.527 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:48.486+0000 7f1bb6ffd700 1 -- 172.21.15.163:0/789779203 <== mon.0 v2:172.21.15.163:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v86) v1 ==== 93+0+10 (secure 0 0 0) 0x7f1bc0097260 con 0x7f1bc40ffd00 2023-07-14T18:12:48.527 INFO:teuthology.orchestra.run.smithi163.stdout:pg_num: 1 2023-07-14T18:12:48.528 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:48.488+0000 7f1bcc229700 1 -- 172.21.15.163:0/789779203 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f1bb00a1150 msgr2=0x7f1bb00a3600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:12:48.528 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:48.488+0000 7f1bcc229700 1 --2- 172.21.15.163:0/789779203 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f1bb00a1150 0x7f1bb00a3600 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f1bb8005fd0 tx=0x7f1bb8005e40 comp rx=0 tx=0).stop 2023-07-14T18:12:48.529 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:48.488+0000 7f1bcc229700 1 -- 172.21.15.163:0/789779203 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f1bc40ffd00 msgr2=0x7f1bc419a5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:12:48.529 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:48.488+0000 7f1bcc229700 1 --2- 172.21.15.163:0/789779203 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f1bc40ffd00 0x7f1bc419a5c0 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f1bc0003a50 tx=0x7f1bc0009580 comp rx=0 tx=0).stop 2023-07-14T18:12:48.529 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:48.488+0000 7f1bcc229700 1 -- 172.21.15.163:0/789779203 shutdown_connections 2023-07-14T18:12:48.529 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:48.488+0000 7f1bcc229700 1 --2- 172.21.15.163:0/789779203 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f1bb00a1150 0x7f1bb00a3600 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:48.529 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:48.488+0000 7f1bcc229700 1 --2- 172.21.15.163:0/789779203 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1bc4100690 0x7f1bc419cc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:48.529 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:48.488+0000 7f1bcc229700 1 --2- 172.21.15.163:0/789779203 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1bc40feb10 0x7f1bc4068330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:48.529 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:48.488+0000 7f1bcc229700 1 --2- 172.21.15.163:0/789779203 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f1bc40ffd00 0x7f1bc419a5c0 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:48.530 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:48.488+0000 7f1bcc229700 1 -- 172.21.15.163:0/789779203 >> 172.21.15.163:0/789779203 conn(0x7f1bc40fa130 msgr2=0x7f1bc4103290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:12:48.530 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:48.488+0000 7f1bcc229700 1 -- 172.21.15.163:0/789779203 shutdown_connections 2023-07-14T18:12:48.530 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:48.488+0000 7f1bcc229700 1 -- 172.21.15.163:0/789779203 wait complete. 2023-07-14T18:12:48.540 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-14T18:12:48.667 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:48.626+0000 7f6a3e7c1700 1 -- 172.21.15.163:0/2532563174 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f6a380ff750 msgr2=0x7f6a38107000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:12:48.667 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:48.626+0000 7f6a3e7c1700 1 --2- 172.21.15.163:0/2532563174 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f6a380ff750 0x7f6a38107000 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f6a3000b0a0 tx=0x7f6a3000b3b0 comp rx=0 tx=0).stop 2023-07-14T18:12:48.667 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:48.626+0000 7f6a3e7c1700 1 -- 172.21.15.163:0/2532563174 shutdown_connections 2023-07-14T18:12:48.667 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:48.626+0000 7f6a3e7c1700 1 --2- 172.21.15.163:0/2532563174 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f6a380ff750 0x7f6a38107000 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:48.667 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:48.626+0000 7f6a3e7c1700 1 --2- 172.21.15.163:0/2532563174 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6a38100100 0x7f6a38100510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:48.668 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:48.626+0000 7f6a3e7c1700 1 --2- 172.21.15.163:0/2532563174 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6a380feda0 0x7f6a380ff210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:48.668 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:48.626+0000 7f6a3e7c1700 1 -- 172.21.15.163:0/2532563174 >> 172.21.15.163:0/2532563174 conn(0x7f6a380f98a0 msgr2=0x7f6a380fbcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:12:48.668 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:48.626+0000 7f6a3e7c1700 1 -- 172.21.15.163:0/2532563174 shutdown_connections 2023-07-14T18:12:48.668 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:48.626+0000 7f6a3e7c1700 1 -- 172.21.15.163:0/2532563174 wait complete. 2023-07-14T18:12:48.668 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:48.626+0000 7f6a3e7c1700 1 Processor -- start 2023-07-14T18:12:48.668 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:48.627+0000 7f6a3e7c1700 1 -- start start 2023-07-14T18:12:48.670 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:48.627+0000 7f6a3e7c1700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6a380feda0 0x7f6a380fe820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:12:48.670 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:48.627+0000 7f6a3e7c1700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f6a380ff750 0x7f6a3819a6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:12:48.670 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:48.627+0000 7f6a3e7c1700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6a38100100 0x7f6a3819cd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:12:48.670 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:48.627+0000 7f6a3e7c1700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a3819d4d0 con 0x7f6a380ff750 2023-07-14T18:12:48.670 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:48.627+0000 7f6a3e7c1700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a3819d640 con 0x7f6a380feda0 2023-07-14T18:12:48.671 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:48.627+0000 7f6a3e7c1700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a3819d800 con 0x7f6a38100100 2023-07-14T18:12:48.671 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:48.627+0000 7f6a2ffff700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f6a380ff750 0x7f6a3819a6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:12:48.671 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:48.627+0000 7f6a2ffff700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f6a380ff750 0x7f6a3819a6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:57756/0 (socket says 172.21.15.163:57756) 2023-07-14T18:12:48.671 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:48.627+0000 7f6a2ffff700 1 -- 172.21.15.163:0/3689893066 learned_addr learned my addr 172.21.15.163:0/3689893066 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:12:48.671 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:48.627+0000 7f6a37fff700 1 --2- 172.21.15.163:0/3689893066 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6a380feda0 0x7f6a380fe820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:12:48.671 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:48.627+0000 7f6a3cd5e700 1 --2- 172.21.15.163:0/3689893066 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6a38100100 0x7f6a3819cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:12:48.671 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:48.627+0000 7f6a2ffff700 1 -- 172.21.15.163:0/3689893066 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6a38100100 msgr2=0x7f6a3819cd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:12:48.672 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:48.627+0000 7f6a2ffff700 1 --2- 172.21.15.163:0/3689893066 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6a38100100 0x7f6a3819cd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:48.672 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:48.627+0000 7f6a2ffff700 1 -- 172.21.15.163:0/3689893066 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6a380feda0 msgr2=0x7f6a380fe820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:12:48.672 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:48.627+0000 7f6a2ffff700 1 --2- 172.21.15.163:0/3689893066 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6a380feda0 0x7f6a380fe820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:48.672 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:48.627+0000 7f6a2ffff700 1 -- 172.21.15.163:0/3689893066 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a30009d00 con 0x7f6a380ff750 2023-07-14T18:12:48.672 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:48.627+0000 7f6a2ffff700 1 --2- 172.21.15.163:0/3689893066 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f6a380ff750 0x7f6a3819a6b0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f6a2000d980 tx=0x7f6a2000dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:12:48.672 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:48.627+0000 7f6a35ffb700 1 -- 172.21.15.163:0/3689893066 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a20004020 con 0x7f6a380ff750 2023-07-14T18:12:48.672 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:48.627+0000 7f6a35ffb700 1 -- 172.21.15.163:0/3689893066 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f6a2000f690 con 0x7f6a380ff750 2023-07-14T18:12:48.672 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:48.627+0000 7f6a3e7c1700 1 -- 172.21.15.163:0/3689893066 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a3819dae0 con 0x7f6a380ff750 2023-07-14T18:12:48.673 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:48.628+0000 7f6a35ffb700 1 -- 172.21.15.163:0/3689893066 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a200039e0 con 0x7f6a380ff750 2023-07-14T18:12:48.673 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:48.628+0000 7f6a3e7c1700 1 -- 172.21.15.163:0/3689893066 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a3819e040 con 0x7f6a380ff750 2023-07-14T18:12:48.673 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:48.628+0000 7f6a3e7c1700 1 -- 172.21.15.163:0/3689893066 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6a38105b40 con 0x7f6a380ff750 2023-07-14T18:12:48.673 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:48.629+0000 7f6a35ffb700 1 -- 172.21.15.163:0/3689893066 <== mon.0 v2:172.21.15.163:3300/0 4 ==== mgrmap(e 18) v1 ==== 135716+0+0 (secure 0 0 0) 0x7f6a2000f800 con 0x7f6a380ff750 2023-07-14T18:12:48.674 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:48.630+0000 7f6a35ffb700 1 --2- 172.21.15.163:0/3689893066 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f6a240a11d0 0x7f6a240a3680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:12:48.674 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:48.630+0000 7f6a37fff700 1 --2- 172.21.15.163:0/3689893066 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f6a240a11d0 0x7f6a240a3680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:12:48.674 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:48.630+0000 7f6a35ffb700 1 -- 172.21.15.163:0/3689893066 <== mon.0 v2:172.21.15.163:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 9020+0+0 (secure 0 0 0) 0x7f6a200cc770 con 0x7f6a380ff750 2023-07-14T18:12:48.674 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:48.630+0000 7f6a37fff700 1 --2- 172.21.15.163:0/3689893066 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f6a240a11d0 0x7f6a240a3680 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f6a38067540 tx=0x7f6a2800b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:12:48.674 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:48.634+0000 7f6a35ffb700 1 -- 172.21.15.163:0/3689893066 <== mon.0 v2:172.21.15.163:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178025 (secure 0 0 0) 0x7f6a20095bb0 con 0x7f6a380ff750 2023-07-14T18:12:48.864 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:48.824+0000 7f6a3e7c1700 1 -- 172.21.15.163:0/3689893066 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f6a380612f0 con 0x7f6a380ff750 2023-07-14T18:12:48.865 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:48.824+0000 7f6a35ffb700 1 -- 172.21.15.163:0/3689893066 <== mon.0 v2:172.21.15.163:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v86) v1 ==== 104+0+11 (secure 0 0 0) 0x7f6a200991d0 con 0x7f6a380ff750 2023-07-14T18:12:48.865 INFO:teuthology.orchestra.run.smithi163.stdout:pg_num: 32 2023-07-14T18:12:48.867 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:48.826+0000 7f6a3e7c1700 1 -- 172.21.15.163:0/3689893066 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f6a240a11d0 msgr2=0x7f6a240a3680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:12:48.867 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:48.826+0000 7f6a3e7c1700 1 --2- 172.21.15.163:0/3689893066 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f6a240a11d0 0x7f6a240a3680 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f6a38067540 tx=0x7f6a2800b410 comp rx=0 tx=0).stop 2023-07-14T18:12:48.867 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:48.826+0000 7f6a3e7c1700 1 -- 172.21.15.163:0/3689893066 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f6a380ff750 msgr2=0x7f6a3819a6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:12:48.867 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:48.826+0000 7f6a3e7c1700 1 --2- 172.21.15.163:0/3689893066 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f6a380ff750 0x7f6a3819a6b0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f6a2000d980 tx=0x7f6a2000dc90 comp rx=0 tx=0).stop 2023-07-14T18:12:48.868 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:48.826+0000 7f6a3e7c1700 1 -- 172.21.15.163:0/3689893066 shutdown_connections 2023-07-14T18:12:48.868 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:48.826+0000 7f6a3e7c1700 1 --2- 172.21.15.163:0/3689893066 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f6a240a11d0 0x7f6a240a3680 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:48.868 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:48.826+0000 7f6a3e7c1700 1 --2- 172.21.15.163:0/3689893066 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6a38100100 0x7f6a3819cd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:48.868 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:48.826+0000 7f6a3e7c1700 1 --2- 172.21.15.163:0/3689893066 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6a380feda0 0x7f6a380fe820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:48.868 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:48.826+0000 7f6a3e7c1700 1 --2- 172.21.15.163:0/3689893066 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f6a380ff750 0x7f6a3819a6b0 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:48.869 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:48.826+0000 7f6a3e7c1700 1 -- 172.21.15.163:0/3689893066 >> 172.21.15.163:0/3689893066 conn(0x7f6a380f98a0 msgr2=0x7f6a380fbb30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:12:48.869 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:48.826+0000 7f6a3e7c1700 1 -- 172.21.15.163:0/3689893066 shutdown_connections 2023-07-14T18:12:48.869 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:48.826+0000 7f6a3e7c1700 1 -- 172.21.15.163:0/3689893066 wait complete. 2023-07-14T18:12:48.879 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-14T18:12:49.005 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:48.964+0000 7f2599e47700 1 -- 172.21.15.163:0/799110775 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f2594100720 msgr2=0x7f2594106fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:12:49.005 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:48.964+0000 7f2599e47700 1 --2- 172.21.15.163:0/799110775 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f2594100720 0x7f2594106fc0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f258c00b0a0 tx=0x7f258c00b3b0 comp rx=0 tx=0).stop 2023-07-14T18:12:49.005 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:48.964+0000 7f2599e47700 1 -- 172.21.15.163:0/799110775 shutdown_connections 2023-07-14T18:12:49.006 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:48.964+0000 7f2599e47700 1 --2- 172.21.15.163:0/799110775 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f2594100720 0x7f2594106fc0 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:49.006 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:48.964+0000 7f2599e47700 1 --2- 172.21.15.163:0/799110775 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f25940ff060 0x7f25940ff470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:49.006 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:48.964+0000 7f2599e47700 1 --2- 172.21.15.163:0/799110775 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f25940ffd70 0x7f25941001e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:49.006 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:48.964+0000 7f2599e47700 1 -- 172.21.15.163:0/799110775 >> 172.21.15.163:0/799110775 conn(0x7f25940f98e0 msgr2=0x7f25940fbd10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:12:49.006 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:48.964+0000 7f2599e47700 1 -- 172.21.15.163:0/799110775 shutdown_connections 2023-07-14T18:12:49.006 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:48.964+0000 7f2599e47700 1 -- 172.21.15.163:0/799110775 wait complete. 2023-07-14T18:12:49.006 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:48.965+0000 7f2599e47700 1 Processor -- start 2023-07-14T18:12:49.008 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:48.965+0000 7f2599e47700 1 -- start start 2023-07-14T18:12:49.008 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:48.965+0000 7f2599e47700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f25940ff060 0x7f25940fe740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:12:49.008 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:48.965+0000 7f2599e47700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f25940ffd70 0x7f259419a5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:12:49.009 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:48.965+0000 7f2599e47700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f2594100720 0x7f259419cc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:12:49.009 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:48.965+0000 7f2599e47700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f259419d3e0 con 0x7f2594100720 2023-07-14T18:12:49.009 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:48.965+0000 7f2599e47700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f259419d550 con 0x7f25940ffd70 2023-07-14T18:12:49.009 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:48.965+0000 7f2599e47700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f259419d710 con 0x7f25940ff060 2023-07-14T18:12:49.009 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:48.965+0000 7f2593fff700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f2594100720 0x7f259419cc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:12:49.009 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:48.965+0000 7f2593fff700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f2594100720 0x7f259419cc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:57772/0 (socket says 172.21.15.163:57772) 2023-07-14T18:12:49.009 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:48.965+0000 7f2593fff700 1 -- 172.21.15.163:0/696129272 learned_addr learned my addr 172.21.15.163:0/696129272 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:12:49.009 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:48.965+0000 7f25937fe700 1 --2- 172.21.15.163:0/696129272 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f25940ff060 0x7f25940fe740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:12:49.010 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:48.966+0000 7f2592ffd700 1 --2- 172.21.15.163:0/696129272 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f25940ffd70 0x7f259419a5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:12:49.010 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:48.966+0000 7f2593fff700 1 -- 172.21.15.163:0/696129272 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f25940ff060 msgr2=0x7f25940fe740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:12:49.010 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:48.966+0000 7f2593fff700 1 --2- 172.21.15.163:0/696129272 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f25940ff060 0x7f25940fe740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:49.010 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:48.966+0000 7f2593fff700 1 -- 172.21.15.163:0/696129272 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f25940ffd70 msgr2=0x7f259419a5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:12:49.010 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:48.966+0000 7f2593fff700 1 --2- 172.21.15.163:0/696129272 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f25940ffd70 0x7f259419a5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:49.010 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:48.966+0000 7f2593fff700 1 -- 172.21.15.163:0/696129272 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f258c009d00 con 0x7f2594100720 2023-07-14T18:12:49.010 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:48.966+0000 7f2593fff700 1 --2- 172.21.15.163:0/696129272 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f2594100720 0x7f259419cc10 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f258c00b070 tx=0x7f258c004d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:12:49.010 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:48.966+0000 7f2590ff9700 1 -- 172.21.15.163:0/696129272 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f258c00e040 con 0x7f2594100720 2023-07-14T18:12:49.011 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:48.966+0000 7f2590ff9700 1 -- 172.21.15.163:0/696129272 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f258c01bcf0 con 0x7f2594100720 2023-07-14T18:12:49.011 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:48.966+0000 7f2599e47700 1 -- 172.21.15.163:0/696129272 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f259419d990 con 0x7f2594100720 2023-07-14T18:12:49.011 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:48.966+0000 7f2590ff9700 1 -- 172.21.15.163:0/696129272 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f258c005870 con 0x7f2594100720 2023-07-14T18:12:49.011 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:48.966+0000 7f2599e47700 1 -- 172.21.15.163:0/696129272 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f259419de10 con 0x7f2594100720 2023-07-14T18:12:49.011 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:48.967+0000 7f2599e47700 1 -- 172.21.15.163:0/696129272 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f259410a1d0 con 0x7f2594100720 2023-07-14T18:12:49.012 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:48.968+0000 7f2590ff9700 1 -- 172.21.15.163:0/696129272 <== mon.0 v2:172.21.15.163:3300/0 4 ==== mgrmap(e 18) v1 ==== 135716+0+0 (secure 0 0 0) 0x7f258c005040 con 0x7f2594100720 2023-07-14T18:12:49.012 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:48.969+0000 7f2590ff9700 1 --2- 172.21.15.163:0/696129272 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f25800a1150 0x7f25800a3600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:12:49.012 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:48.969+0000 7f2590ff9700 1 -- 172.21.15.163:0/696129272 <== mon.0 v2:172.21.15.163:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 9020+0+0 (secure 0 0 0) 0x7f258c0cf1f0 con 0x7f2594100720 2023-07-14T18:12:49.012 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:48.969+0000 7f25937fe700 1 --2- 172.21.15.163:0/696129272 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f25800a1150 0x7f25800a3600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:12:49.013 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:48.969+0000 7f25937fe700 1 --2- 172.21.15.163:0/696129272 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f25800a1150 0x7f25800a3600 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f2594068500 tx=0x7f258400a3b0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:12:49.013 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:48.972+0000 7f2590ff9700 1 -- 172.21.15.163:0/696129272 <== mon.0 v2:172.21.15.163:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178025 (secure 0 0 0) 0x7f258c098660 con 0x7f2594100720 2023-07-14T18:12:49.175 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:12:48 smithi184 ceph-mon[98481]: pgmap v302: 129 pgs: 129 active+clean; 643 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 170 B/s wr, 9 op/s 2023-07-14T18:12:49.175 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:12:48 smithi184 ceph-mon[98481]: from='client.? 172.21.15.163:0/4126438538' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]': finished 2023-07-14T18:12:49.176 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:12:48 smithi184 ceph-mon[98481]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-07-14T18:12:49.176 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:12:48 smithi184 ceph-mon[98481]: from='client.? 172.21.15.163:0/4210787994' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-07-14T18:12:49.176 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:12:48 smithi184 ceph-mon[98481]: from='client.? 172.21.15.163:0/789779203' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-07-14T18:12:49.201 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:49.160+0000 7f2599e47700 1 -- 172.21.15.163:0/696129272 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f2594105960 con 0x7f2594100720 2023-07-14T18:12:49.201 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:49.160+0000 7f2590ff9700 1 -- 172.21.15.163:0/696129272 <== mon.0 v2:172.21.15.163:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v86) v1 ==== 100+0+11 (secure 0 0 0) 0x7f258c09bc80 con 0x7f2594100720 2023-07-14T18:12:49.202 INFO:teuthology.orchestra.run.smithi163.stdout:pg_num: 64 2023-07-14T18:12:49.203 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:49.163+0000 7f2599e47700 1 -- 172.21.15.163:0/696129272 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f25800a1150 msgr2=0x7f25800a3600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:12:49.203 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:49.163+0000 7f2599e47700 1 --2- 172.21.15.163:0/696129272 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f25800a1150 0x7f25800a3600 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f2594068500 tx=0x7f258400a3b0 comp rx=0 tx=0).stop 2023-07-14T18:12:49.204 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:49.163+0000 7f2599e47700 1 -- 172.21.15.163:0/696129272 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f2594100720 msgr2=0x7f259419cc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:12:49.204 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:49.163+0000 7f2599e47700 1 --2- 172.21.15.163:0/696129272 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f2594100720 0x7f259419cc10 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f258c00b070 tx=0x7f258c004d00 comp rx=0 tx=0).stop 2023-07-14T18:12:49.204 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:49.163+0000 7f2599e47700 1 -- 172.21.15.163:0/696129272 shutdown_connections 2023-07-14T18:12:49.204 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:49.163+0000 7f2599e47700 1 --2- 172.21.15.163:0/696129272 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f25800a1150 0x7f25800a3600 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:49.204 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:49.163+0000 7f2599e47700 1 --2- 172.21.15.163:0/696129272 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f25940ff060 0x7f25940fe740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:49.204 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:49.163+0000 7f2599e47700 1 --2- 172.21.15.163:0/696129272 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f2594100720 0x7f259419cc10 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:49.204 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:49.163+0000 7f2599e47700 1 --2- 172.21.15.163:0/696129272 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f25940ffd70 0x7f259419a5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:49.205 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:49.163+0000 7f2599e47700 1 -- 172.21.15.163:0/696129272 >> 172.21.15.163:0/696129272 conn(0x7f25940f98e0 msgr2=0x7f25940fba50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:12:49.205 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:49.163+0000 7f2599e47700 1 -- 172.21.15.163:0/696129272 shutdown_connections 2023-07-14T18:12:49.205 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:49.163+0000 7f2599e47700 1 -- 172.21.15.163:0/696129272 wait complete. 2023-07-14T18:12:49.214 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:12:48 smithi163 ceph-mon[96576]: pgmap v302: 129 pgs: 129 active+clean; 643 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 170 B/s wr, 9 op/s 2023-07-14T18:12:49.214 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:12:48 smithi163 ceph-mon[96576]: from='client.? 172.21.15.163:0/4126438538' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]': finished 2023-07-14T18:12:49.215 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:12:48 smithi163 ceph-mon[96576]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-07-14T18:12:49.215 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:12:48 smithi163 ceph-mon[96576]: from='client.? 172.21.15.163:0/4210787994' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-07-14T18:12:49.215 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:12:48 smithi163 ceph-mon[96576]: from='client.? 172.21.15.163:0/789779203' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-07-14T18:12:49.216 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-07-14T18:12:49.276 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:12:48 smithi172 ceph-mon[97983]: pgmap v302: 129 pgs: 129 active+clean; 643 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 170 B/s wr, 9 op/s 2023-07-14T18:12:49.276 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:12:48 smithi172 ceph-mon[97983]: from='client.? 172.21.15.163:0/4126438538' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]': finished 2023-07-14T18:12:49.277 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:12:48 smithi172 ceph-mon[97983]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-07-14T18:12:49.277 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:12:48 smithi172 ceph-mon[97983]: from='client.? 172.21.15.163:0/4210787994' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-07-14T18:12:49.277 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:12:48 smithi172 ceph-mon[97983]: from='client.? 172.21.15.163:0/789779203' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-07-14T18:12:49.341 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:49.299+0000 7f591309c700 1 -- 172.21.15.163:0/2893841443 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f590c0fdfa0 msgr2=0x7f590c0fe3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:12:49.341 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:49.299+0000 7f591309c700 1 --2- 172.21.15.163:0/2893841443 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f590c0fdfa0 0x7f590c0fe3b0 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f590400b0a0 tx=0x7f590400b3b0 comp rx=0 tx=0).stop 2023-07-14T18:12:49.341 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:49.299+0000 7f591309c700 1 -- 172.21.15.163:0/2893841443 shutdown_connections 2023-07-14T18:12:49.341 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:49.299+0000 7f591309c700 1 --2- 172.21.15.163:0/2893841443 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f590c1019a0 0x7f590c108260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:49.341 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:49.299+0000 7f591309c700 1 --2- 172.21.15.163:0/2893841443 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f590c0fdfa0 0x7f590c0fe3b0 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:49.342 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:49.299+0000 7f591309c700 1 --2- 172.21.15.163:0/2893841443 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f590c101010 0x7f590c101460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:49.342 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:49.299+0000 7f591309c700 1 -- 172.21.15.163:0/2893841443 >> 172.21.15.163:0/2893841443 conn(0x7f590c0f9980 msgr2=0x7f590c0fbd90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:12:49.342 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:49.299+0000 7f591309c700 1 -- 172.21.15.163:0/2893841443 shutdown_connections 2023-07-14T18:12:49.342 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:49.299+0000 7f591309c700 1 -- 172.21.15.163:0/2893841443 wait complete. 2023-07-14T18:12:49.342 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:49.300+0000 7f591309c700 1 Processor -- start 2023-07-14T18:12:49.343 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:49.300+0000 7f591309c700 1 -- start start 2023-07-14T18:12:49.343 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:49.300+0000 7f591309c700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f590c0fdfa0 0x7f590c100980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:12:49.343 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:49.300+0000 7f591309c700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f590c101010 0x7f590c0fefc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:12:49.343 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:49.300+0000 7f591309c700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f590c1019a0 0x7f590c0ff500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:12:49.343 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:49.300+0000 7f591309c700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f590c0ffca0 con 0x7f590c101010 2023-07-14T18:12:49.343 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:49.300+0000 7f591309c700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f590c0ffe10 con 0x7f590c1019a0 2023-07-14T18:12:49.343 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:49.300+0000 7f591309c700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f590c19f940 con 0x7f590c0fdfa0 2023-07-14T18:12:49.344 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:49.300+0000 7f590bfff700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f590c101010 0x7f590c0fefc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:12:49.344 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:49.300+0000 7f590bfff700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f590c101010 0x7f590c0fefc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:57784/0 (socket says 172.21.15.163:57784) 2023-07-14T18:12:49.344 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:49.300+0000 7f590bfff700 1 -- 172.21.15.163:0/3452501604 learned_addr learned my addr 172.21.15.163:0/3452501604 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:12:49.344 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:49.300+0000 7f5911639700 1 --2- 172.21.15.163:0/3452501604 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f590c1019a0 0x7f590c0ff500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:12:49.344 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:49.300+0000 7f5910e38700 1 --2- 172.21.15.163:0/3452501604 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f590c0fdfa0 0x7f590c100980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:12:49.344 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:49.300+0000 7f590bfff700 1 -- 172.21.15.163:0/3452501604 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f590c0fdfa0 msgr2=0x7f590c100980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:12:49.345 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:49.300+0000 7f590bfff700 1 --2- 172.21.15.163:0/3452501604 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f590c0fdfa0 0x7f590c100980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:49.345 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:49.300+0000 7f590bfff700 1 -- 172.21.15.163:0/3452501604 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f590c1019a0 msgr2=0x7f590c0ff500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:12:49.345 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:49.300+0000 7f590bfff700 1 --2- 172.21.15.163:0/3452501604 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f590c1019a0 0x7f590c0ff500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:49.345 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:49.300+0000 7f590bfff700 1 -- 172.21.15.163:0/3452501604 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5904009d00 con 0x7f590c101010 2023-07-14T18:12:49.345 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:49.301+0000 7f590bfff700 1 --2- 172.21.15.163:0/3452501604 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f590c101010 0x7f590c0fefc0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f58f400c9b0 tx=0x7f58f400ccc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:12:49.346 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:49.301+0000 7f5909ffb700 1 -- 172.21.15.163:0/3452501604 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58f4007b00 con 0x7f590c101010 2023-07-14T18:12:49.346 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:49.301+0000 7f5909ffb700 1 -- 172.21.15.163:0/3452501604 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f58f400ce50 con 0x7f590c101010 2023-07-14T18:12:49.346 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:49.301+0000 7f591309c700 1 -- 172.21.15.163:0/3452501604 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f590c19fc20 con 0x7f590c101010 2023-07-14T18:12:49.347 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:49.301+0000 7f5909ffb700 1 -- 172.21.15.163:0/3452501604 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58f4018420 con 0x7f590c101010 2023-07-14T18:12:49.347 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:49.301+0000 7f591309c700 1 -- 172.21.15.163:0/3452501604 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f590c1a0180 con 0x7f590c101010 2023-07-14T18:12:49.347 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:49.302+0000 7f591309c700 1 -- 172.21.15.163:0/3452501604 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f590c107390 con 0x7f590c101010 2023-07-14T18:12:49.347 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:49.303+0000 7f5909ffb700 1 -- 172.21.15.163:0/3452501604 <== mon.0 v2:172.21.15.163:3300/0 4 ==== mgrmap(e 18) v1 ==== 135716+0+0 (secure 0 0 0) 0x7f58f400f450 con 0x7f590c101010 2023-07-14T18:12:49.347 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:49.303+0000 7f5909ffb700 1 --2- 172.21.15.163:0/3452501604 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f58f80a11d0 0x7f58f80a3680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:12:49.347 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:49.304+0000 7f5909ffb700 1 -- 172.21.15.163:0/3452501604 <== mon.0 v2:172.21.15.163:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 9020+0+0 (secure 0 0 0) 0x7f58f40ccd40 con 0x7f590c101010 2023-07-14T18:12:49.347 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:49.304+0000 7f5910e38700 1 --2- 172.21.15.163:0/3452501604 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f58f80a11d0 0x7f58f80a3680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:12:49.348 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:49.304+0000 7f5910e38700 1 --2- 172.21.15.163:0/3452501604 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f58f80a11d0 0x7f58f80a3680 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f5904007a30 tx=0x7f590400b7b0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:12:49.348 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:49.307+0000 7f5909ffb700 1 -- 172.21.15.163:0/3452501604 <== mon.0 v2:172.21.15.163:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178025 (secure 0 0 0) 0x7f58f4096290 con 0x7f590c101010 2023-07-14T18:12:49.537 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:49.497+0000 7f591309c700 1 -- 172.21.15.163:0/3452501604 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f590c02ca70 con 0x7f590c101010 2023-07-14T18:12:49.538 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:49.497+0000 7f5909ffb700 1 -- 172.21.15.163:0/3452501604 <== mon.0 v2:172.21.15.163:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v86) v1 ==== 103+0+11 (secure 0 0 0) 0x7f58f400f700 con 0x7f590c101010 2023-07-14T18:12:49.538 INFO:teuthology.orchestra.run.smithi163.stdout:pg_num: 32 2023-07-14T18:12:49.540 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:49.499+0000 7f591309c700 1 -- 172.21.15.163:0/3452501604 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f58f80a11d0 msgr2=0x7f58f80a3680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:12:49.540 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:49.499+0000 7f591309c700 1 --2- 172.21.15.163:0/3452501604 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f58f80a11d0 0x7f58f80a3680 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f5904007a30 tx=0x7f590400b7b0 comp rx=0 tx=0).stop 2023-07-14T18:12:49.541 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:49.499+0000 7f591309c700 1 -- 172.21.15.163:0/3452501604 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f590c101010 msgr2=0x7f590c0fefc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:12:49.541 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:49.499+0000 7f591309c700 1 --2- 172.21.15.163:0/3452501604 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f590c101010 0x7f590c0fefc0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f58f400c9b0 tx=0x7f58f400ccc0 comp rx=0 tx=0).stop 2023-07-14T18:12:49.541 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:49.499+0000 7f591309c700 1 -- 172.21.15.163:0/3452501604 shutdown_connections 2023-07-14T18:12:49.541 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:49.499+0000 7f591309c700 1 --2- 172.21.15.163:0/3452501604 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f58f80a11d0 0x7f58f80a3680 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:49.542 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:49.499+0000 7f591309c700 1 --2- 172.21.15.163:0/3452501604 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f590c0fdfa0 0x7f590c100980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:49.542 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:49.499+0000 7f591309c700 1 --2- 172.21.15.163:0/3452501604 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f590c1019a0 0x7f590c0ff500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:49.542 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:49.499+0000 7f591309c700 1 --2- 172.21.15.163:0/3452501604 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f590c101010 0x7f590c0fefc0 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:49.542 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:49.499+0000 7f591309c700 1 -- 172.21.15.163:0/3452501604 >> 172.21.15.163:0/3452501604 conn(0x7f590c0f9980 msgr2=0x7f590c1044d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:12:49.543 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:49.499+0000 7f591309c700 1 -- 172.21.15.163:0/3452501604 shutdown_connections 2023-07-14T18:12:49.543 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:49.499+0000 7f591309c700 1 -- 172.21.15.163:0/3452501604 wait complete. 2023-07-14T18:12:49.552 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-14T18:12:49.675 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:49.634+0000 7f55d2f5e700 1 -- 172.21.15.163:0/2104636955 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f55cc1006a0 msgr2=0x7f55cc106f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:12:49.675 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:49.634+0000 7f55d2f5e700 1 --2- 172.21.15.163:0/2104636955 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f55cc1006a0 0x7f55cc106f60 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f55c400b0a0 tx=0x7f55c400b3b0 comp rx=0 tx=0).stop 2023-07-14T18:12:49.675 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:49.634+0000 7f55d2f5e700 1 -- 172.21.15.163:0/2104636955 shutdown_connections 2023-07-14T18:12:49.675 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:49.634+0000 7f55d2f5e700 1 --2- 172.21.15.163:0/2104636955 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f55cc1006a0 0x7f55cc106f60 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:49.676 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:49.634+0000 7f55d2f5e700 1 --2- 172.21.15.163:0/2104636955 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f55cc0feb20 0x7f55cc0fef30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:49.676 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:49.634+0000 7f55d2f5e700 1 --2- 172.21.15.163:0/2104636955 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f55cc0ffd10 0x7f55cc100160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:49.676 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:49.634+0000 7f55d2f5e700 1 -- 172.21.15.163:0/2104636955 >> 172.21.15.163:0/2104636955 conn(0x7f55cc0fa100 msgr2=0x7f55cc0fc570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:12:49.676 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:49.634+0000 7f55d2f5e700 1 -- 172.21.15.163:0/2104636955 shutdown_connections 2023-07-14T18:12:49.676 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:49.634+0000 7f55d2f5e700 1 -- 172.21.15.163:0/2104636955 wait complete. 2023-07-14T18:12:49.676 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:49.635+0000 7f55d2f5e700 1 Processor -- start 2023-07-14T18:12:49.676 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:49.635+0000 7f55d2f5e700 1 -- start start 2023-07-14T18:12:49.678 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:49.635+0000 7f55d2f5e700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f55cc0feb20 0x7f55cc1958f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:12:49.678 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:49.635+0000 7f55d2f5e700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f55cc0ffd10 0x7f55cc195e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:12:49.678 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:49.635+0000 7f55d2f5e700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f55cc1006a0 0x7f55cc19cea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:12:49.678 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:49.635+0000 7f55d2f5e700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55cc19d470 con 0x7f55cc0ffd10 2023-07-14T18:12:49.679 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:49.635+0000 7f55d2f5e700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55cc19d5b0 con 0x7f55cc0feb20 2023-07-14T18:12:49.679 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:49.635+0000 7f55d2f5e700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55cc19d740 con 0x7f55cc1006a0 2023-07-14T18:12:49.679 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:49.635+0000 7f55cbfff700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f55cc0ffd10 0x7f55cc195e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:12:49.679 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:49.635+0000 7f55cbfff700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f55cc0ffd10 0x7f55cc195e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:57798/0 (socket says 172.21.15.163:57798) 2023-07-14T18:12:49.679 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:49.635+0000 7f55d0cfa700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f55cc0feb20 0x7f55cc1958f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:12:49.679 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:49.635+0000 7f55cbfff700 1 -- 172.21.15.163:0/1949644872 learned_addr learned my addr 172.21.15.163:0/1949644872 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:12:49.679 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:49.635+0000 7f55d14fb700 1 --2- 172.21.15.163:0/1949644872 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f55cc1006a0 0x7f55cc19cea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:12:49.680 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:49.635+0000 7f55cbfff700 1 -- 172.21.15.163:0/1949644872 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f55cc1006a0 msgr2=0x7f55cc19cea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:12:49.680 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:49.635+0000 7f55cbfff700 1 --2- 172.21.15.163:0/1949644872 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f55cc1006a0 0x7f55cc19cea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:49.680 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:49.635+0000 7f55cbfff700 1 -- 172.21.15.163:0/1949644872 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f55cc0feb20 msgr2=0x7f55cc1958f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:12:49.680 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:49.635+0000 7f55cbfff700 1 --2- 172.21.15.163:0/1949644872 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f55cc0feb20 0x7f55cc1958f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:49.680 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:49.635+0000 7f55cbfff700 1 -- 172.21.15.163:0/1949644872 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55c4009d00 con 0x7f55cc0ffd10 2023-07-14T18:12:49.680 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:49.635+0000 7f55cbfff700 1 --2- 172.21.15.163:0/1949644872 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f55cc0ffd10 0x7f55cc195e30 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f55b800e9a0 tx=0x7f55b800ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:12:49.680 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:49.636+0000 7f55c9ffb700 1 -- 172.21.15.163:0/1949644872 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55b8009790 con 0x7f55cc0ffd10 2023-07-14T18:12:49.681 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:49.636+0000 7f55d2f5e700 1 -- 172.21.15.163:0/1949644872 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f55cc19da20 con 0x7f55cc0ffd10 2023-07-14T18:12:49.681 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:49.636+0000 7f55c9ffb700 1 -- 172.21.15.163:0/1949644872 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f55b8010430 con 0x7f55cc0ffd10 2023-07-14T18:12:49.681 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:49.636+0000 7f55c9ffb700 1 -- 172.21.15.163:0/1949644872 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55b800cea0 con 0x7f55cc0ffd10 2023-07-14T18:12:49.681 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:49.636+0000 7f55d2f5e700 1 -- 172.21.15.163:0/1949644872 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f55cc19df30 con 0x7f55cc0ffd10 2023-07-14T18:12:49.681 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:49.637+0000 7f55d2f5e700 1 -- 172.21.15.163:0/1949644872 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f55cc10a1b0 con 0x7f55cc0ffd10 2023-07-14T18:12:49.681 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:49.638+0000 7f55c9ffb700 1 -- 172.21.15.163:0/1949644872 <== mon.0 v2:172.21.15.163:3300/0 4 ==== mgrmap(e 18) v1 ==== 135716+0+0 (secure 0 0 0) 0x7f55b80105a0 con 0x7f55cc0ffd10 2023-07-14T18:12:49.682 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:49.638+0000 7f55c9ffb700 1 --2- 172.21.15.163:0/1949644872 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f55bc0a11a0 0x7f55bc0a3650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:12:49.682 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:49.638+0000 7f55d0cfa700 1 --2- 172.21.15.163:0/1949644872 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f55bc0a11a0 0x7f55bc0a3650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:12:49.682 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:49.638+0000 7f55c9ffb700 1 -- 172.21.15.163:0/1949644872 <== mon.0 v2:172.21.15.163:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 9020+0+0 (secure 0 0 0) 0x7f55b8014070 con 0x7f55cc0ffd10 2023-07-14T18:12:49.682 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:49.639+0000 7f55d0cfa700 1 --2- 172.21.15.163:0/1949644872 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f55bc0a11a0 0x7f55bc0a3650 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f55cc0ffb70 tx=0x7f55c0009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:12:49.683 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:49.642+0000 7f55c9ffb700 1 -- 172.21.15.163:0/1949644872 <== mon.0 v2:172.21.15.163:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178025 (secure 0 0 0) 0x7f55b8051780 con 0x7f55cc0ffd10 2023-07-14T18:12:49.877 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:49.837+0000 7f55d2f5e700 1 -- 172.21.15.163:0/1949644872 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f55cc19e4e0 con 0x7f55cc0ffd10 2023-07-14T18:12:49.879 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:49.839+0000 7f55c9ffb700 1 -- 172.21.15.163:0/1949644872 <== mon.0 v2:172.21.15.163:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v86) v1 ==== 74+0+24500 (secure 0 0 0) 0x7f55b80962b0 con 0x7f55cc0ffd10 2023-07-14T18:12:49.879 INFO:teuthology.orchestra.run.smithi163.stdout: 2023-07-14T18:12:49.880 INFO:teuthology.orchestra.run.smithi163.stdout:{"epoch":86,"fsid":"bf7326ec-2270-11ee-9b33-001a4aab830c","created":"2023-07-14T18:04:26.263517+0000","modified":"2023-07-14T18:12:16.776609+0000","last_up_change":"2023-07-14T18:10:27.514863+0000","last_in_change":"2023-07-14T18:10:10.726443+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-14T18:07:19.653852+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-07-14T18:11:07.314989+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-07-14T18:11:08.274627+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-07-14T18:11:11.991162+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"e6490568-046d-43ef-bb07-d79fb884b276","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6802","nonce":3124653025},{"type":"v1","addr":"172.21.15.163:6803","nonce":3124653025}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6804","nonce":3124653025},{"type":"v1","addr":"172.21.15.163:6805","nonce":3124653025}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6808","nonce":3124653025},{"type":"v1","addr":"172.21.15.163:6809","nonce":3124653025}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6806","nonce":3124653025},{"type":"v1","addr":"172.21.15.163:6807","nonce":3124653025}]},"public_addr":"172.21.15.163:6803/3124653025","cluster_addr":"172.21.15.163:6805/3124653025","heartbeat_back_addr":"172.21.15.163:6809/3124653025","heartbeat_front_addr":"172.21.15.163:6807/3124653025","state":["exists","up"]},{"osd":1,"uuid":"0af39bda-f096-4603-adcc-bf1988f36603","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":3774455900},{"type":"v1","addr":"172.21.15.172:6801","nonce":3774455900}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":3774455900},{"type":"v1","addr":"172.21.15.172:6803","nonce":3774455900}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":3774455900},{"type":"v1","addr":"172.21.15.172:6807","nonce":3774455900}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":3774455900},{"type":"v1","addr":"172.21.15.172:6805","nonce":3774455900}]},"public_addr":"172.21.15.172:6801/3774455900","cluster_addr":"172.21.15.172:6803/3774455900","heartbeat_back_addr":"172.21.15.172:6807/3774455900","heartbeat_front_addr":"172.21.15.172:6805/3774455900","state":["exists","up"]},{"osd":2,"uuid":"cc732c13-af0f-4199-98e6-fe960ed4e5dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":1976927678},{"type":"v1","addr":"172.21.15.184:6801","nonce":1976927678}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":1976927678},{"type":"v1","addr":"172.21.15.184:6803","nonce":1976927678}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":1976927678},{"type":"v1","addr":"172.21.15.184:6807","nonce":1976927678}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":1976927678},{"type":"v1","addr":"172.21.15.184:6805","nonce":1976927678}]},"public_addr":"172.21.15.184:6801/1976927678","cluster_addr":"172.21.15.184:6803/1976927678","heartbeat_back_addr":"172.21.15.184:6807/1976927678","heartbeat_front_addr":"172.21.15.184:6805/1976927678","state":["exists","up"]},{"osd":3,"uuid":"dcee9576-0bc6-4ab0-8f63-79eacd0eca5f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6810","nonce":2589130694},{"type":"v1","addr":"172.21.15.163:6811","nonce":2589130694}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6812","nonce":2589130694},{"type":"v1","addr":"172.21.15.163:6813","nonce":2589130694}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6816","nonce":2589130694},{"type":"v1","addr":"172.21.15.163:6817","nonce":2589130694}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6814","nonce":2589130694},{"type":"v1","addr":"172.21.15.163:6815","nonce":2589130694}]},"public_addr":"172.21.15.163:6811/2589130694","cluster_addr":"172.21.15.163:6813/2589130694","heartbeat_back_addr":"172.21.15.163:6817/2589130694","heartbeat_front_addr":"172.21.15.163:6815/2589130694","state":["exists","up"]},{"osd":4,"uuid":"055df823-b8b0-426a-83c2-f0d727932ad8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":3319632614},{"type":"v1","addr":"172.21.15.172:6809","nonce":3319632614}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6810","nonce":3319632614},{"type":"v1","addr":"172.21.15.172:6811","nonce":3319632614}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6814","nonce":3319632614},{"type":"v1","addr":"172.21.15.172:6815","nonce":3319632614}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":3319632614},{"type":"v1","addr":"172.21.15.172:6813","nonce":3319632614}]},"public_addr":"172.21.15.172:6809/3319632614","cluster_addr":"172.21.15.172:6811/3319632614","heartbeat_back_addr":"172.21.15.172:6815/3319632614","heartbeat_front_addr":"172.21.15.172:6813/3319632614","state":["exists","up"]},{"osd":5,"uuid":"ef5ef02a-b4e2-4790-9d27-f6d2247b25c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":2662084043},{"type":"v1","addr":"172.21.15.184:6809","nonce":2662084043}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6810","nonce":2662084043},{"type":"v1","addr":"172.21.15.184:6811","nonce":2662084043}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6814","nonce":2662084043},{"type":"v1","addr":"172.21.15.184:6815","nonce":2662084043}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6812","nonce":2662084043},{"type":"v1","addr":"172.21.15.184:6813","nonce":2662084043}]},"public_addr":"172.21.15.184:6809/2662084043","cluster_addr":"172.21.15.184:6811/2662084043","heartbeat_back_addr":"172.21.15.184:6815/2662084043","heartbeat_front_addr":"172.21.15.184:6813/2662084043","state":["exists","up"]},{"osd":6,"uuid":"dba754be-0fc5-4867-a6d5-cf97eb344f81","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":44,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6818","nonce":2530874117},{"type":"v1","addr":"172.21.15.163:6819","nonce":2530874117}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6820","nonce":2530874117},{"type":"v1","addr":"172.21.15.163:6821","nonce":2530874117}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6824","nonce":2530874117},{"type":"v1","addr":"172.21.15.163:6825","nonce":2530874117}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6822","nonce":2530874117},{"type":"v1","addr":"172.21.15.163:6823","nonce":2530874117}]},"public_addr":"172.21.15.163:6819/2530874117","cluster_addr":"172.21.15.163:6821/2530874117","heartbeat_back_addr":"172.21.15.163:6825/2530874117","heartbeat_front_addr":"172.21.15.163:6823/2530874117","state":["exists","up"]},{"osd":7,"uuid":"edd76e6b-6077-4619-b00d-1e906f70ddcc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":49,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":233511803},{"type":"v1","addr":"172.21.15.172:6817","nonce":233511803}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6818","nonce":233511803},{"type":"v1","addr":"172.21.15.172:6819","nonce":233511803}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":233511803},{"type":"v1","addr":"172.21.15.172:6823","nonce":233511803}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6820","nonce":233511803},{"type":"v1","addr":"172.21.15.172:6821","nonce":233511803}]},"public_addr":"172.21.15.172:6817/233511803","cluster_addr":"172.21.15.172:6819/233511803","heartbeat_back_addr":"172.21.15.172:6823/233511803","heartbeat_front_addr":"172.21.15.172:6821/233511803","state":["exists","up"]},{"osd":8,"uuid":"36559400-f33e-44e6-868a-316d34da457d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":56,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6816","nonce":290154343},{"type":"v1","addr":"172.21.15.184:6817","nonce":290154343}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6818","nonce":290154343},{"type":"v1","addr":"172.21.15.184:6819","nonce":290154343}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6822","nonce":290154343},{"type":"v1","addr":"172.21.15.184:6823","nonce":290154343}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6820","nonce":290154343},{"type":"v1","addr":"172.21.15.184:6821","nonce":290154343}]},"public_addr":"172.21.15.184:6817/290154343","cluster_addr":"172.21.15.184:6819/290154343","heartbeat_back_addr":"172.21.15.184:6823/290154343","heartbeat_front_addr":"172.21.15.184:6821/290154343","state":["exists","up"]},{"osd":9,"uuid":"d484f111-f36c-4c67-9a8a-ae03e7e0d137","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6826","nonce":3848110906},{"type":"v1","addr":"172.21.15.163:6827","nonce":3848110906}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6828","nonce":3848110906},{"type":"v1","addr":"172.21.15.163:6829","nonce":3848110906}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6832","nonce":3848110906},{"type":"v1","addr":"172.21.15.163:6833","nonce":3848110906}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6830","nonce":3848110906},{"type":"v1","addr":"172.21.15.163:6831","nonce":3848110906}]},"public_addr":"172.21.15.163:6827/3848110906","cluster_addr":"172.21.15.163:6829/3848110906","heartbeat_back_addr":"172.21.15.163:6833/3848110906","heartbeat_front_addr":"172.21.15.163:6831/3848110906","state":["exists","up"]},{"osd":10,"uuid":"d943f7c0-da3d-4605-9e23-0231e675c6be","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6824","nonce":3281085356},{"type":"v1","addr":"172.21.15.172:6825","nonce":3281085356}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":3281085356},{"type":"v1","addr":"172.21.15.172:6827","nonce":3281085356}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":3281085356},{"type":"v1","addr":"172.21.15.172:6831","nonce":3281085356}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6828","nonce":3281085356},{"type":"v1","addr":"172.21.15.172:6829","nonce":3281085356}]},"public_addr":"172.21.15.172:6825/3281085356","cluster_addr":"172.21.15.172:6827/3281085356","heartbeat_back_addr":"172.21.15.172:6831/3281085356","heartbeat_front_addr":"172.21.15.172:6829/3281085356","state":["exists","up"]},{"osd":11,"uuid":"09e610a8-408a-4119-a21b-c4de2810a538","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":75,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6824","nonce":3614578747},{"type":"v1","addr":"172.21.15.184:6825","nonce":3614578747}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6826","nonce":3614578747},{"type":"v1","addr":"172.21.15.184:6827","nonce":3614578747}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6830","nonce":3614578747},{"type":"v1","addr":"172.21.15.184:6831","nonce":3614578747}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6828","nonce":3614578747},{"type":"v1","addr":"172.21.15.184:6829","nonce":3614578747}]},"public_addr":"172.21.15.184:6825/3614578747","cluster_addr":"172.21.15.184:6827/3614578747","heartbeat_back_addr":"172.21.15.184:6831/3614578747","heartbeat_front_addr":"172.21.15.184:6829/3614578747","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T18:06:36.067578+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T18:06:57.095120+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T18:07:17.825363+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T18:07:38.977196+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T18:08:00.108709+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T18:08:20.700646+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T18:08:41.473899+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T18:09:02.856536+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T18:09:23.832722+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T18:09:44.860884+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T18:10:05.520678+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T18:10:26.426315+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.8","mappings":[{"from":2,"to":11}]},{"pgid":"3.1","mappings":[{"from":4,"to":9}]},{"pgid":"3.6","mappings":[{"from":4,"to":6}]},{"pgid":"3.25","mappings":[{"from":5,"to":9}]},{"pgid":"3.27","mappings":[{"from":4,"to":8}]},{"pgid":"3.2d","mappings":[{"from":3,"to":9}]},{"pgid":"4.a","mappings":[{"from":5,"to":8}]},{"pgid":"4.12","mappings":[{"from":9,"to":10}]},{"pgid":"4.14","mappings":[{"from":9,"to":8}]},{"pgid":"4.17","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.163:6801/1086512093":"2023-07-15T18:05:15.331458+0000","172.21.15.163:6800/1086512093":"2023-07-15T18:05:15.331458+0000","172.21.15.163:0/4235784810":"2023-07-15T18:05:15.331458+0000","172.21.15.163:6800/236891232":"2023-07-15T18:04:53.288443+0000","172.21.15.163:6801/236891232":"2023-07-15T18:04:53.288443+0000","172.21.15.163:0/3260193612":"2023-07-15T18:05:15.331458+0000","172.21.15.163:0/3513629472":"2023-07-15T18:04:53.288443+0000","172.21.15.163:0/1090329830":"2023-07-15T18:04:53.288443+0000","172.21.15.163:0/3868922045":"2023-07-15T18:05:15.331458+0000","172.21.15.163:0/2945662447":"2023-07-15T18:04:53.288443+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-14T18:12:49.881 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:49.841+0000 7f55d2f5e700 1 -- 172.21.15.163:0/1949644872 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f55bc0a11a0 msgr2=0x7f55bc0a3650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:12:49.882 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:49.841+0000 7f55d2f5e700 1 --2- 172.21.15.163:0/1949644872 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f55bc0a11a0 0x7f55bc0a3650 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f55cc0ffb70 tx=0x7f55c0009260 comp rx=0 tx=0).stop 2023-07-14T18:12:49.882 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:49.841+0000 7f55d2f5e700 1 -- 172.21.15.163:0/1949644872 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f55cc0ffd10 msgr2=0x7f55cc195e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:12:49.882 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:49.841+0000 7f55d2f5e700 1 --2- 172.21.15.163:0/1949644872 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f55cc0ffd10 0x7f55cc195e30 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f55b800e9a0 tx=0x7f55b800ecb0 comp rx=0 tx=0).stop 2023-07-14T18:12:49.882 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:49.841+0000 7f55d2f5e700 1 -- 172.21.15.163:0/1949644872 shutdown_connections 2023-07-14T18:12:49.882 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:49.841+0000 7f55d2f5e700 1 --2- 172.21.15.163:0/1949644872 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f55bc0a11a0 0x7f55bc0a3650 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:49.882 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:49.841+0000 7f55d2f5e700 1 --2- 172.21.15.163:0/1949644872 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f55cc1006a0 0x7f55cc19cea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:49.883 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:49.841+0000 7f55d2f5e700 1 --2- 172.21.15.163:0/1949644872 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f55cc0feb20 0x7f55cc1958f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:49.883 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:49.841+0000 7f55d2f5e700 1 --2- 172.21.15.163:0/1949644872 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f55cc0ffd10 0x7f55cc195e30 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:49.883 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:49.841+0000 7f55d2f5e700 1 -- 172.21.15.163:0/1949644872 >> 172.21.15.163:0/1949644872 conn(0x7f55cc0fa100 msgr2=0x7f55cc0fa8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:12:49.883 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:49.841+0000 7f55d2f5e700 1 -- 172.21.15.163:0/1949644872 shutdown_connections 2023-07-14T18:12:49.883 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:49.841+0000 7f55d2f5e700 1 -- 172.21.15.163:0/1949644872 wait complete. 2023-07-14T18:12:49.894 INFO:tasks.fwd_scrub.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-14T18:07:19.653852+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-14T18:11:07.314989+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '79', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-07-14T18:11:08.274627+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '80', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-07-14T18:11:11.991162+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '84', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-07-14T18:12:49.895 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-14T18:12:50.022 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:49.980+0000 7fc333364700 1 -- 172.21.15.163:0/3292491025 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc32c0feb10 msgr2=0x7fc32c0fef20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:12:50.022 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:49.980+0000 7fc333364700 1 --2- 172.21.15.163:0/3292491025 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc32c0feb10 0x7fc32c0fef20 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7fc328009990 tx=0x7fc328009ca0 comp rx=0 tx=0).stop 2023-07-14T18:12:50.022 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:49.980+0000 7fc333364700 1 -- 172.21.15.163:0/3292491025 shutdown_connections 2023-07-14T18:12:50.022 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:49.980+0000 7fc333364700 1 --2- 172.21.15.163:0/3292491025 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc32c100690 0x7fc32c106f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:50.023 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:49.980+0000 7fc333364700 1 --2- 172.21.15.163:0/3292491025 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc32c0feb10 0x7fc32c0fef20 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:50.023 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:49.980+0000 7fc333364700 1 --2- 172.21.15.163:0/3292491025 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc32c0ffd00 0x7fc32c100150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:50.023 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:49.980+0000 7fc333364700 1 -- 172.21.15.163:0/3292491025 >> 172.21.15.163:0/3292491025 conn(0x7fc32c0fa130 msgr2=0x7fc32c0fc560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:12:50.023 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:49.980+0000 7fc333364700 1 -- 172.21.15.163:0/3292491025 shutdown_connections 2023-07-14T18:12:50.023 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:49.980+0000 7fc333364700 1 -- 172.21.15.163:0/3292491025 wait complete. 2023-07-14T18:12:50.023 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:49.980+0000 7fc333364700 1 Processor -- start 2023-07-14T18:12:50.023 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:49.980+0000 7fc333364700 1 -- start start 2023-07-14T18:12:50.024 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:49.980+0000 7fc333364700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc32c0feb10 0x7fc32c069360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:12:50.024 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:49.980+0000 7fc333364700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc32c0ffd00 0x7fc32c19a5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:12:50.024 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:49.980+0000 7fc333364700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc32c100690 0x7fc32c19cc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:12:50.024 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:49.980+0000 7fc333364700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc32c19d3d0 con 0x7fc32c100690 2023-07-14T18:12:50.024 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:49.980+0000 7fc333364700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc32c19d540 con 0x7fc32c0ffd00 2023-07-14T18:12:50.024 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:49.980+0000 7fc333364700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc32c19d700 con 0x7fc32c0feb10 2023-07-14T18:12:50.024 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:49.981+0000 7fc331901700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc32c100690 0x7fc32c19cc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:12:50.025 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:49.981+0000 7fc331901700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc32c100690 0x7fc32c19cc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:57814/0 (socket says 172.21.15.163:57814) 2023-07-14T18:12:50.025 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:49.981+0000 7fc331100700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc32c0feb10 0x7fc32c069360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:12:50.025 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:49.981+0000 7fc331901700 1 -- 172.21.15.163:0/1555932697 learned_addr learned my addr 172.21.15.163:0/1555932697 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:12:50.025 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:49.981+0000 7fc3308ff700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc32c0ffd00 0x7fc32c19a5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:12:50.025 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:49.981+0000 7fc331901700 1 -- 172.21.15.163:0/1555932697 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc32c0feb10 msgr2=0x7fc32c069360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:12:50.025 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:49.981+0000 7fc331901700 1 --2- 172.21.15.163:0/1555932697 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc32c0feb10 0x7fc32c069360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:50.025 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:49.981+0000 7fc331901700 1 -- 172.21.15.163:0/1555932697 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc32c0ffd00 msgr2=0x7fc32c19a5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:12:50.025 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:49.981+0000 7fc331901700 1 --2- 172.21.15.163:0/1555932697 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc32c0ffd00 0x7fc32c19a5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:50.026 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:49.981+0000 7fc331901700 1 -- 172.21.15.163:0/1555932697 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3280095f0 con 0x7fc32c100690 2023-07-14T18:12:50.026 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:49.981+0000 7fc331901700 1 --2- 172.21.15.163:0/1555932697 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc32c100690 0x7fc32c19cc00 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7fc324007ee0 tx=0x7fc32400d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:12:50.026 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:49.981+0000 7fc3227fc700 1 -- 172.21.15.163:0/1555932697 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc324017070 con 0x7fc32c100690 2023-07-14T18:12:50.026 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:49.981+0000 7fc3227fc700 1 -- 172.21.15.163:0/1555932697 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fc32400f040 con 0x7fc32c100690 2023-07-14T18:12:50.026 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:49.981+0000 7fc333364700 1 -- 172.21.15.163:0/1555932697 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc32c19d9e0 con 0x7fc32c100690 2023-07-14T18:12:50.026 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:49.981+0000 7fc3227fc700 1 -- 172.21.15.163:0/1555932697 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc324005570 con 0x7fc32c100690 2023-07-14T18:12:50.026 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:49.981+0000 7fc333364700 1 -- 172.21.15.163:0/1555932697 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc32c19dea0 con 0x7fc32c100690 2023-07-14T18:12:50.027 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:49.982+0000 7fc333364700 1 -- 172.21.15.163:0/1555932697 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc32c105af0 con 0x7fc32c100690 2023-07-14T18:12:50.027 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:49.983+0000 7fc3227fc700 1 -- 172.21.15.163:0/1555932697 <== mon.0 v2:172.21.15.163:3300/0 4 ==== mgrmap(e 18) v1 ==== 135716+0+0 (secure 0 0 0) 0x7fc32400db20 con 0x7fc32c100690 2023-07-14T18:12:50.027 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:49.984+0000 7fc3227fc700 1 --2- 172.21.15.163:0/1555932697 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7fc3180a1150 0x7fc3180a3600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:12:50.028 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:49.984+0000 7fc331100700 1 --2- 172.21.15.163:0/1555932697 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7fc3180a1150 0x7fc3180a3600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:12:50.028 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:49.984+0000 7fc3227fc700 1 -- 172.21.15.163:0/1555932697 <== mon.0 v2:172.21.15.163:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 9020+0+0 (secure 0 0 0) 0x7fc3240cc2d0 con 0x7fc32c100690 2023-07-14T18:12:50.028 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:49.984+0000 7fc331100700 1 --2- 172.21.15.163:0/1555932697 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7fc3180a1150 0x7fc3180a3600 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fc32800b5c0 tx=0x7fc328005960 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:12:50.028 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:49.988+0000 7fc3227fc700 1 -- 172.21.15.163:0/1555932697 <== mon.0 v2:172.21.15.163:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178025 (secure 0 0 0) 0x7fc3240957b0 con 0x7fc32c100690 2023-07-14T18:12:50.175 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:12:49 smithi184 ceph-mon[98481]: from='client.? 172.21.15.163:0/3689893066' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-07-14T18:12:50.176 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:12:49 smithi184 ceph-mon[98481]: from='client.? 172.21.15.163:0/696129272' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-07-14T18:12:50.176 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:12:49 smithi184 ceph-mon[98481]: from='client.? 172.21.15.163:0/3452501604' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2023-07-14T18:12:50.218 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:12:49 smithi163 ceph-mon[96576]: from='client.? 172.21.15.163:0/3689893066' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-07-14T18:12:50.218 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:12:49 smithi163 ceph-mon[96576]: from='client.? 172.21.15.163:0/696129272' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-07-14T18:12:50.218 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:12:49 smithi163 ceph-mon[96576]: from='client.? 172.21.15.163:0/3452501604' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2023-07-14T18:12:50.219 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:50.179+0000 7fc333364700 1 -- 172.21.15.163:0/1555932697 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fc32c02cb00 con 0x7fc32c100690 2023-07-14T18:12:50.219 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:50.179+0000 7fc3227fc700 1 -- 172.21.15.163:0/1555932697 <== mon.0 v2:172.21.15.163:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v86) v1 ==== 93+0+10 (secure 0 0 0) 0x7fc324098dd0 con 0x7fc32c100690 2023-07-14T18:12:50.220 INFO:teuthology.orchestra.run.smithi163.stdout:pg_num: 1 2023-07-14T18:12:50.222 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:50.181+0000 7fc333364700 1 -- 172.21.15.163:0/1555932697 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7fc3180a1150 msgr2=0x7fc3180a3600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:12:50.222 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:50.181+0000 7fc333364700 1 --2- 172.21.15.163:0/1555932697 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7fc3180a1150 0x7fc3180a3600 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fc32800b5c0 tx=0x7fc328005960 comp rx=0 tx=0).stop 2023-07-14T18:12:50.222 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:50.181+0000 7fc333364700 1 -- 172.21.15.163:0/1555932697 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc32c100690 msgr2=0x7fc32c19cc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:12:50.222 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:50.181+0000 7fc333364700 1 --2- 172.21.15.163:0/1555932697 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc32c100690 0x7fc32c19cc00 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7fc324007ee0 tx=0x7fc32400d3b0 comp rx=0 tx=0).stop 2023-07-14T18:12:50.222 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:50.181+0000 7fc333364700 1 -- 172.21.15.163:0/1555932697 shutdown_connections 2023-07-14T18:12:50.223 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:50.181+0000 7fc333364700 1 --2- 172.21.15.163:0/1555932697 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7fc3180a1150 0x7fc3180a3600 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:50.223 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:50.181+0000 7fc333364700 1 --2- 172.21.15.163:0/1555932697 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc32c0feb10 0x7fc32c069360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:50.223 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:50.181+0000 7fc333364700 1 --2- 172.21.15.163:0/1555932697 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc32c100690 0x7fc32c19cc00 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:50.223 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:50.181+0000 7fc333364700 1 --2- 172.21.15.163:0/1555932697 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc32c0ffd00 0x7fc32c19a5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:50.223 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:50.181+0000 7fc333364700 1 -- 172.21.15.163:0/1555932697 >> 172.21.15.163:0/1555932697 conn(0x7fc32c0fa130 msgr2=0x7fc32c0fc450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:12:50.223 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:50.181+0000 7fc333364700 1 -- 172.21.15.163:0/1555932697 shutdown_connections 2023-07-14T18:12:50.223 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:50.181+0000 7fc333364700 1 -- 172.21.15.163:0/1555932697 wait complete. 2023-07-14T18:12:50.234 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-14T18:12:50.276 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:12:49 smithi172 ceph-mon[97983]: from='client.? 172.21.15.163:0/3689893066' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-07-14T18:12:50.276 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:12:49 smithi172 ceph-mon[97983]: from='client.? 172.21.15.163:0/696129272' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-07-14T18:12:50.277 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:12:49 smithi172 ceph-mon[97983]: from='client.? 172.21.15.163:0/3452501604' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2023-07-14T18:12:50.358 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:50.318+0000 7f86c37ee700 1 -- 172.21.15.163:0/3489914447 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f86bc100e90 msgr2=0x7f86bc1012e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:12:50.359 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:50.318+0000 7f86c37ee700 1 --2- 172.21.15.163:0/3489914447 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f86bc100e90 0x7f86bc1012e0 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f86b8009990 tx=0x7f86b8009ca0 comp rx=0 tx=0).stop 2023-07-14T18:12:50.359 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:50.318+0000 7f86c37ee700 1 -- 172.21.15.163:0/3489914447 shutdown_connections 2023-07-14T18:12:50.359 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:50.318+0000 7f86c37ee700 1 --2- 172.21.15.163:0/3489914447 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f86bc101820 0x7f86bc1080e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:50.359 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:50.318+0000 7f86c37ee700 1 --2- 172.21.15.163:0/3489914447 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f86bc0fdec0 0x7f86bc0fe2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:50.359 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:50.318+0000 7f86c37ee700 1 --2- 172.21.15.163:0/3489914447 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f86bc100e90 0x7f86bc1012e0 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:50.360 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:50.318+0000 7f86c37ee700 1 -- 172.21.15.163:0/3489914447 >> 172.21.15.163:0/3489914447 conn(0x7f86bc0f98a0 msgr2=0x7f86bc0fbcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:12:50.360 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:50.318+0000 7f86c37ee700 1 -- 172.21.15.163:0/3489914447 shutdown_connections 2023-07-14T18:12:50.360 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:50.318+0000 7f86c37ee700 1 -- 172.21.15.163:0/3489914447 wait complete. 2023-07-14T18:12:50.362 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:50.319+0000 7f86c37ee700 1 Processor -- start 2023-07-14T18:12:50.362 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:50.319+0000 7f86c37ee700 1 -- start start 2023-07-14T18:12:50.362 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:50.319+0000 7f86c37ee700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f86bc0fdec0 0x7f86bc1958a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:12:50.362 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:50.319+0000 7f86c37ee700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f86bc100e90 0x7f86bc195de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:12:50.363 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:50.319+0000 7f86c37ee700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f86bc101820 0x7f86bc19ce50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:12:50.363 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:50.319+0000 7f86c37ee700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86bc19d420 con 0x7f86bc0fdec0 2023-07-14T18:12:50.363 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:50.319+0000 7f86c37ee700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86bc19d560 con 0x7f86bc100e90 2023-07-14T18:12:50.363 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:50.319+0000 7f86c37ee700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86bc19d6f0 con 0x7f86bc101820 2023-07-14T18:12:50.363 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:50.319+0000 7f86c158a700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f86bc0fdec0 0x7f86bc1958a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:12:50.363 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:50.319+0000 7f86c158a700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f86bc0fdec0 0x7f86bc1958a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:57824/0 (socket says 172.21.15.163:57824) 2023-07-14T18:12:50.363 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:50.319+0000 7f86c158a700 1 -- 172.21.15.163:0/2343489526 learned_addr learned my addr 172.21.15.163:0/2343489526 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:12:50.364 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:50.319+0000 7f86c1d8b700 1 --2- 172.21.15.163:0/2343489526 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f86bc101820 0x7f86bc19ce50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:12:50.364 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:50.319+0000 7f86c158a700 1 -- 172.21.15.163:0/2343489526 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f86bc101820 msgr2=0x7f86bc19ce50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:12:50.364 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:50.319+0000 7f86c158a700 1 --2- 172.21.15.163:0/2343489526 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f86bc101820 0x7f86bc19ce50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:50.364 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:50.319+0000 7f86c158a700 1 -- 172.21.15.163:0/2343489526 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f86bc100e90 msgr2=0x7f86bc195de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:12:50.364 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:50.319+0000 7f86c0d89700 1 --2- 172.21.15.163:0/2343489526 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f86bc100e90 0x7f86bc195de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:12:50.364 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:50.319+0000 7f86c158a700 1 --2- 172.21.15.163:0/2343489526 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f86bc100e90 0x7f86bc195de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:50.364 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:50.319+0000 7f86c158a700 1 -- 172.21.15.163:0/2343489526 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86b80095f0 con 0x7f86bc0fdec0 2023-07-14T18:12:50.365 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:50.319+0000 7f86c0d89700 1 --2- 172.21.15.163:0/2343489526 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f86bc100e90 0x7f86bc195de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T18:12:50.365 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:50.320+0000 7f86c158a700 1 --2- 172.21.15.163:0/2343489526 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f86bc0fdec0 0x7f86bc1958a0 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f86ac00d980 tx=0x7f86ac00dd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:12:50.365 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:50.320+0000 7f86b27fc700 1 -- 172.21.15.163:0/2343489526 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86ac00de60 con 0x7f86bc0fdec0 2023-07-14T18:12:50.365 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:50.320+0000 7f86b27fc700 1 -- 172.21.15.163:0/2343489526 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f86ac0044b0 con 0x7f86bc0fdec0 2023-07-14T18:12:50.365 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:50.320+0000 7f86c37ee700 1 -- 172.21.15.163:0/2343489526 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f86bc19d9d0 con 0x7f86bc0fdec0 2023-07-14T18:12:50.365 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:50.320+0000 7f86b27fc700 1 -- 172.21.15.163:0/2343489526 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86ac003b40 con 0x7f86bc0fdec0 2023-07-14T18:12:50.365 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:50.320+0000 7f86c37ee700 1 -- 172.21.15.163:0/2343489526 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86bc19dee0 con 0x7f86bc0fdec0 2023-07-14T18:12:50.365 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:50.321+0000 7f86c37ee700 1 -- 172.21.15.163:0/2343489526 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f86bc10b280 con 0x7f86bc0fdec0 2023-07-14T18:12:50.366 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:50.322+0000 7f86b27fc700 1 -- 172.21.15.163:0/2343489526 <== mon.0 v2:172.21.15.163:3300/0 4 ==== mgrmap(e 18) v1 ==== 135716+0+0 (secure 0 0 0) 0x7f86ac004870 con 0x7f86bc0fdec0 2023-07-14T18:12:50.366 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:50.322+0000 7f86b27fc700 1 --2- 172.21.15.163:0/2343489526 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f86a80a1150 0x7f86a80a3600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:12:50.367 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:50.322+0000 7f86c0d89700 1 --2- 172.21.15.163:0/2343489526 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f86a80a1150 0x7f86a80a3600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:12:50.367 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:50.322+0000 7f86b27fc700 1 -- 172.21.15.163:0/2343489526 <== mon.0 v2:172.21.15.163:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 9020+0+0 (secure 0 0 0) 0x7f86ac0cccd0 con 0x7f86bc0fdec0 2023-07-14T18:12:50.367 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:50.323+0000 7f86c0d89700 1 --2- 172.21.15.163:0/2343489526 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f86a80a1150 0x7f86a80a3600 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f86b800b2e0 tx=0x7f86b8005e80 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:12:50.367 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:50.326+0000 7f86b27fc700 1 -- 172.21.15.163:0/2343489526 <== mon.0 v2:172.21.15.163:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178025 (secure 0 0 0) 0x7f86ac096110 con 0x7f86bc0fdec0 2023-07-14T18:12:50.554 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:50.514+0000 7f86c37ee700 1 -- 172.21.15.163:0/2343489526 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f86bc106c80 con 0x7f86bc0fdec0 2023-07-14T18:12:50.555 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:50.514+0000 7f86b27fc700 1 -- 172.21.15.163:0/2343489526 <== mon.0 v2:172.21.15.163:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v86) v1 ==== 104+0+11 (secure 0 0 0) 0x7f86ac009940 con 0x7f86bc0fdec0 2023-07-14T18:12:50.555 INFO:teuthology.orchestra.run.smithi163.stdout:pg_num: 32 2023-07-14T18:12:50.557 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:50.516+0000 7f86c37ee700 1 -- 172.21.15.163:0/2343489526 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f86a80a1150 msgr2=0x7f86a80a3600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:12:50.557 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:50.516+0000 7f86c37ee700 1 --2- 172.21.15.163:0/2343489526 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f86a80a1150 0x7f86a80a3600 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f86b800b2e0 tx=0x7f86b8005e80 comp rx=0 tx=0).stop 2023-07-14T18:12:50.557 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:50.516+0000 7f86c37ee700 1 -- 172.21.15.163:0/2343489526 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f86bc0fdec0 msgr2=0x7f86bc1958a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:12:50.557 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:50.516+0000 7f86c37ee700 1 --2- 172.21.15.163:0/2343489526 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f86bc0fdec0 0x7f86bc1958a0 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f86ac00d980 tx=0x7f86ac00dd40 comp rx=0 tx=0).stop 2023-07-14T18:12:50.557 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:50.516+0000 7f86c37ee700 1 -- 172.21.15.163:0/2343489526 shutdown_connections 2023-07-14T18:12:50.558 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:50.516+0000 7f86c37ee700 1 --2- 172.21.15.163:0/2343489526 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f86a80a1150 0x7f86a80a3600 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:50.558 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:50.516+0000 7f86c37ee700 1 --2- 172.21.15.163:0/2343489526 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f86bc101820 0x7f86bc19ce50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:50.558 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:50.516+0000 7f86c37ee700 1 --2- 172.21.15.163:0/2343489526 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f86bc0fdec0 0x7f86bc1958a0 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:50.558 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:50.516+0000 7f86c37ee700 1 --2- 172.21.15.163:0/2343489526 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f86bc100e90 0x7f86bc195de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:50.558 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:50.516+0000 7f86c37ee700 1 -- 172.21.15.163:0/2343489526 >> 172.21.15.163:0/2343489526 conn(0x7f86bc0f98a0 msgr2=0x7f86bc0fbc00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:12:50.558 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:50.516+0000 7f86c37ee700 1 -- 172.21.15.163:0/2343489526 shutdown_connections 2023-07-14T18:12:50.558 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:50.516+0000 7f86c37ee700 1 -- 172.21.15.163:0/2343489526 wait complete. 2023-07-14T18:12:50.569 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-14T18:12:50.693 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:50.652+0000 7f2b95f69700 1 -- 172.21.15.163:0/1957566878 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f2b901006f0 msgr2=0x7f2b90102ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:12:50.693 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:50.652+0000 7f2b95f69700 1 --2- 172.21.15.163:0/1957566878 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f2b901006f0 0x7f2b90102ad0 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f2b80009990 tx=0x7f2b80009ca0 comp rx=0 tx=0).stop 2023-07-14T18:12:50.694 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:50.652+0000 7f2b95f69700 1 -- 172.21.15.163:0/1957566878 shutdown_connections 2023-07-14T18:12:50.694 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:50.652+0000 7f2b95f69700 1 --2- 172.21.15.163:0/1957566878 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2b90105930 0x7f2b90107d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:50.694 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:50.652+0000 7f2b95f69700 1 --2- 172.21.15.163:0/1957566878 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f2b901006f0 0x7f2b90102ad0 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:50.694 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:50.652+0000 7f2b95f69700 1 --2- 172.21.15.163:0/1957566878 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2b90103010 0x7f2b901053f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:50.694 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:50.652+0000 7f2b95f69700 1 -- 172.21.15.163:0/1957566878 >> 172.21.15.163:0/1957566878 conn(0x7f2b900fa130 msgr2=0x7f2b900fc560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:12:50.694 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:50.652+0000 7f2b95f69700 1 -- 172.21.15.163:0/1957566878 shutdown_connections 2023-07-14T18:12:50.694 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:50.652+0000 7f2b95f69700 1 -- 172.21.15.163:0/1957566878 wait complete. 2023-07-14T18:12:50.695 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:50.653+0000 7f2b95f69700 1 Processor -- start 2023-07-14T18:12:50.696 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:50.653+0000 7f2b95f69700 1 -- start start 2023-07-14T18:12:50.697 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:50.653+0000 7f2b95f69700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2b901006f0 0x7f2b90100060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:12:50.697 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:50.653+0000 7f2b95f69700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f2b90103010 0x7f2b900fe6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:12:50.697 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:50.653+0000 7f2b95f69700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2b90105930 0x7f2b900febe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:12:50.697 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:50.653+0000 7f2b95f69700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b900ff380 con 0x7f2b90103010 2023-07-14T18:12:50.698 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:50.653+0000 7f2b95f69700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b900ff4f0 con 0x7f2b901006f0 2023-07-14T18:12:50.698 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:50.653+0000 7f2b95f69700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b9019f7f0 con 0x7f2b90105930 2023-07-14T18:12:50.698 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:50.653+0000 7f2b8effd700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f2b90103010 0x7f2b900fe6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:12:50.698 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:50.653+0000 7f2b8effd700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f2b90103010 0x7f2b900fe6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:57840/0 (socket says 172.21.15.163:57840) 2023-07-14T18:12:50.698 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:50.653+0000 7f2b8effd700 1 -- 172.21.15.163:0/2749376171 learned_addr learned my addr 172.21.15.163:0/2749376171 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:12:50.698 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:50.653+0000 7f2b8ffff700 1 --2- 172.21.15.163:0/2749376171 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2b90105930 0x7f2b900febe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:12:50.698 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:50.653+0000 7f2b8f7fe700 1 --2- 172.21.15.163:0/2749376171 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2b901006f0 0x7f2b90100060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:12:50.699 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:50.654+0000 7f2b8effd700 1 -- 172.21.15.163:0/2749376171 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2b90105930 msgr2=0x7f2b900febe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:12:50.699 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:50.654+0000 7f2b8effd700 1 --2- 172.21.15.163:0/2749376171 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2b90105930 0x7f2b900febe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:50.699 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:50.654+0000 7f2b8effd700 1 -- 172.21.15.163:0/2749376171 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2b901006f0 msgr2=0x7f2b90100060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:12:50.699 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:50.654+0000 7f2b8effd700 1 --2- 172.21.15.163:0/2749376171 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2b901006f0 0x7f2b90100060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:50.699 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:50.654+0000 7f2b8effd700 1 -- 172.21.15.163:0/2749376171 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b800095f0 con 0x7f2b90103010 2023-07-14T18:12:50.700 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:50.654+0000 7f2b8f7fe700 1 --2- 172.21.15.163:0/2749376171 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2b901006f0 0x7f2b90100060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T18:12:50.700 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:50.654+0000 7f2b8effd700 1 --2- 172.21.15.163:0/2749376171 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f2b90103010 0x7f2b900fe6a0 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f2b7800c9b0 tx=0x7f2b7800ccc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:12:50.700 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:50.654+0000 7f2b8cff9700 1 -- 172.21.15.163:0/2749376171 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b78007b00 con 0x7f2b90103010 2023-07-14T18:12:50.700 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:50.654+0000 7f2b8cff9700 1 -- 172.21.15.163:0/2749376171 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f2b78007c60 con 0x7f2b90103010 2023-07-14T18:12:50.700 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:50.654+0000 7f2b95f69700 1 -- 172.21.15.163:0/2749376171 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2b9019fad0 con 0x7f2b90103010 2023-07-14T18:12:50.700 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:50.654+0000 7f2b8cff9700 1 -- 172.21.15.163:0/2749376171 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b78018660 con 0x7f2b90103010 2023-07-14T18:12:50.701 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:50.654+0000 7f2b95f69700 1 -- 172.21.15.163:0/2749376171 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b9019ffe0 con 0x7f2b90103010 2023-07-14T18:12:50.701 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:50.655+0000 7f2b95f69700 1 -- 172.21.15.163:0/2749376171 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2b900fbca0 con 0x7f2b90103010 2023-07-14T18:12:50.701 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:50.656+0000 7f2b8cff9700 1 -- 172.21.15.163:0/2749376171 <== mon.0 v2:172.21.15.163:3300/0 4 ==== mgrmap(e 18) v1 ==== 135716+0+0 (secure 0 0 0) 0x7f2b7800f450 con 0x7f2b90103010 2023-07-14T18:12:50.702 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:50.657+0000 7f2b8cff9700 1 --2- 172.21.15.163:0/2749376171 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f2b7c0a1150 0x7f2b7c0a3600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:12:50.702 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:50.657+0000 7f2b8f7fe700 1 --2- 172.21.15.163:0/2749376171 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f2b7c0a1150 0x7f2b7c0a3600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:12:50.702 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:50.657+0000 7f2b8cff9700 1 -- 172.21.15.163:0/2749376171 <== mon.0 v2:172.21.15.163:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 9020+0+0 (secure 0 0 0) 0x7f2b780ccc40 con 0x7f2b90103010 2023-07-14T18:12:50.702 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:50.657+0000 7f2b8f7fe700 1 --2- 172.21.15.163:0/2749376171 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f2b7c0a1150 0x7f2b7c0a3600 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f2b8000b5c0 tx=0x7f2b80005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:12:50.702 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:50.661+0000 7f2b8cff9700 1 -- 172.21.15.163:0/2749376171 <== mon.0 v2:172.21.15.163:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178025 (secure 0 0 0) 0x7f2b78096080 con 0x7f2b90103010 2023-07-14T18:12:50.892 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:50.852+0000 7f2b95f69700 1 -- 172.21.15.163:0/2749376171 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f2b9002cd70 con 0x7f2b90103010 2023-07-14T18:12:50.893 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:50.852+0000 7f2b8cff9700 1 -- 172.21.15.163:0/2749376171 <== mon.0 v2:172.21.15.163:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v86) v1 ==== 100+0+11 (secure 0 0 0) 0x7f2b7800fe60 con 0x7f2b90103010 2023-07-14T18:12:50.893 INFO:teuthology.orchestra.run.smithi163.stdout:pg_num: 64 2023-07-14T18:12:50.895 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:50.854+0000 7f2b95f69700 1 -- 172.21.15.163:0/2749376171 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f2b7c0a1150 msgr2=0x7f2b7c0a3600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:12:50.895 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:50.854+0000 7f2b95f69700 1 --2- 172.21.15.163:0/2749376171 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f2b7c0a1150 0x7f2b7c0a3600 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f2b8000b5c0 tx=0x7f2b80005fb0 comp rx=0 tx=0).stop 2023-07-14T18:12:50.895 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:50.854+0000 7f2b95f69700 1 -- 172.21.15.163:0/2749376171 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f2b90103010 msgr2=0x7f2b900fe6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:12:50.896 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:50.854+0000 7f2b95f69700 1 --2- 172.21.15.163:0/2749376171 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f2b90103010 0x7f2b900fe6a0 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f2b7800c9b0 tx=0x7f2b7800ccc0 comp rx=0 tx=0).stop 2023-07-14T18:12:50.896 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:50.854+0000 7f2b95f69700 1 -- 172.21.15.163:0/2749376171 shutdown_connections 2023-07-14T18:12:50.896 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:50.854+0000 7f2b95f69700 1 --2- 172.21.15.163:0/2749376171 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f2b7c0a1150 0x7f2b7c0a3600 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:50.896 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:50.854+0000 7f2b95f69700 1 --2- 172.21.15.163:0/2749376171 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2b90105930 0x7f2b900febe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:50.896 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:50.854+0000 7f2b95f69700 1 --2- 172.21.15.163:0/2749376171 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2b901006f0 0x7f2b90100060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:50.896 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:50.854+0000 7f2b95f69700 1 --2- 172.21.15.163:0/2749376171 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f2b90103010 0x7f2b900fe6a0 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:50.896 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:50.854+0000 7f2b95f69700 1 -- 172.21.15.163:0/2749376171 >> 172.21.15.163:0/2749376171 conn(0x7f2b900fa130 msgr2=0x7f2b90101350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:12:50.897 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:50.855+0000 7f2b95f69700 1 -- 172.21.15.163:0/2749376171 shutdown_connections 2023-07-14T18:12:50.897 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:50.855+0000 7f2b95f69700 1 -- 172.21.15.163:0/2749376171 wait complete. 2023-07-14T18:12:50.907 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-07-14T18:12:51.032 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:50.991+0000 7fc374a11700 1 -- 172.21.15.163:0/1062978011 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc3700fed00 msgr2=0x7fc3700ff170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:12:51.032 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:50.991+0000 7fc374a11700 1 --2- 172.21.15.163:0/1062978011 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc3700fed00 0x7fc3700ff170 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7fc360009990 tx=0x7fc360009ca0 comp rx=0 tx=0).stop 2023-07-14T18:12:51.032 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:50.991+0000 7fc374a11700 1 -- 172.21.15.163:0/1062978011 shutdown_connections 2023-07-14T18:12:51.033 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:50.991+0000 7fc374a11700 1 --2- 172.21.15.163:0/1062978011 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc3701000b0 0x7fc3701004c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:51.033 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:50.991+0000 7fc374a11700 1 --2- 172.21.15.163:0/1062978011 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc3700ff6b0 0x7fc370106f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:51.033 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:50.991+0000 7fc374a11700 1 --2- 172.21.15.163:0/1062978011 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc3700fed00 0x7fc3700ff170 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:51.033 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:50.991+0000 7fc374a11700 1 -- 172.21.15.163:0/1062978011 >> 172.21.15.163:0/1062978011 conn(0x7fc3700f98a0 msgr2=0x7fc3700fbcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:12:51.033 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:50.991+0000 7fc374a11700 1 -- 172.21.15.163:0/1062978011 shutdown_connections 2023-07-14T18:12:51.033 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:50.991+0000 7fc374a11700 1 -- 172.21.15.163:0/1062978011 wait complete. 2023-07-14T18:12:51.035 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:50.992+0000 7fc374a11700 1 Processor -- start 2023-07-14T18:12:51.035 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:50.992+0000 7fc374a11700 1 -- start start 2023-07-14T18:12:51.035 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:50.993+0000 7fc374a11700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc3700fed00 0x7fc3701947c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:12:51.036 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:50.993+0000 7fc374a11700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc3700ff6b0 0x7fc370194d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:12:51.036 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:50.993+0000 7fc374a11700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc3701000b0 0x7fc37019bd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:12:51.036 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:50.993+0000 7fc374a11700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc37019c340 con 0x7fc3700fed00 2023-07-14T18:12:51.036 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:50.993+0000 7fc374a11700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc37019c480 con 0x7fc3701000b0 2023-07-14T18:12:51.036 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:50.993+0000 7fc374a11700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc37019c610 con 0x7fc3700ff6b0 2023-07-14T18:12:51.036 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:50.993+0000 7fc36e59c700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc3700fed00 0x7fc3701947c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:12:51.036 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:50.993+0000 7fc36e59c700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc3700fed00 0x7fc3701947c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:57852/0 (socket says 172.21.15.163:57852) 2023-07-14T18:12:51.037 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:50.993+0000 7fc36e59c700 1 -- 172.21.15.163:0/2049254837 learned_addr learned my addr 172.21.15.163:0/2049254837 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:12:51.037 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:50.993+0000 7fc36dd9b700 1 --2- 172.21.15.163:0/2049254837 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc3700ff6b0 0x7fc370194d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:12:51.037 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:50.993+0000 7fc36ed9d700 1 --2- 172.21.15.163:0/2049254837 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc3701000b0 0x7fc37019bd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:12:51.037 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:50.993+0000 7fc36e59c700 1 -- 172.21.15.163:0/2049254837 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc3700ff6b0 msgr2=0x7fc370194d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:12:51.037 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:50.993+0000 7fc36e59c700 1 --2- 172.21.15.163:0/2049254837 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc3700ff6b0 0x7fc370194d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:51.037 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:50.993+0000 7fc36e59c700 1 -- 172.21.15.163:0/2049254837 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc3701000b0 msgr2=0x7fc37019bd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:12:51.037 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:50.993+0000 7fc36e59c700 1 --2- 172.21.15.163:0/2049254837 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc3701000b0 0x7fc37019bd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:51.038 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:50.993+0000 7fc36e59c700 1 -- 172.21.15.163:0/2049254837 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3600095f0 con 0x7fc3700fed00 2023-07-14T18:12:51.038 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:50.993+0000 7fc36ed9d700 1 --2- 172.21.15.163:0/2049254837 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc3701000b0 0x7fc37019bd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T18:12:51.038 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:50.993+0000 7fc36e59c700 1 --2- 172.21.15.163:0/2049254837 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc3700fed00 0x7fc3701947c0 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7fc358007910 tx=0x7fc358007c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:12:51.038 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:50.993+0000 7fc3677fe700 1 -- 172.21.15.163:0/2049254837 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc358012070 con 0x7fc3700fed00 2023-07-14T18:12:51.038 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:50.993+0000 7fc374a11700 1 -- 172.21.15.163:0/2049254837 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc3700fdc50 con 0x7fc3700fed00 2023-07-14T18:12:51.038 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:50.993+0000 7fc3677fe700 1 -- 172.21.15.163:0/2049254837 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fc35800d810 con 0x7fc3700fed00 2023-07-14T18:12:51.038 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:50.993+0000 7fc3677fe700 1 -- 172.21.15.163:0/2049254837 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc358005280 con 0x7fc3700fed00 2023-07-14T18:12:51.038 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:50.993+0000 7fc374a11700 1 -- 172.21.15.163:0/2049254837 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3700fe1b0 con 0x7fc3700fed00 2023-07-14T18:12:51.039 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:50.994+0000 7fc374a11700 1 -- 172.21.15.163:0/2049254837 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc370066b30 con 0x7fc3700fed00 2023-07-14T18:12:51.039 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:50.995+0000 7fc3677fe700 1 -- 172.21.15.163:0/2049254837 <== mon.0 v2:172.21.15.163:3300/0 4 ==== mgrmap(e 18) v1 ==== 135716+0+0 (secure 0 0 0) 0x7fc358016070 con 0x7fc3700fed00 2023-07-14T18:12:51.039 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:50.996+0000 7fc3677fe700 1 --2- 172.21.15.163:0/2049254837 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7fc35c0a1150 0x7fc35c0a3600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:12:51.039 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:50.996+0000 7fc36dd9b700 1 --2- 172.21.15.163:0/2049254837 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7fc35c0a1150 0x7fc35c0a3600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:12:51.040 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:50.996+0000 7fc3677fe700 1 -- 172.21.15.163:0/2049254837 <== mon.0 v2:172.21.15.163:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 9020+0+0 (secure 0 0 0) 0x7fc3580ce610 con 0x7fc3700fed00 2023-07-14T18:12:51.040 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:50.996+0000 7fc36dd9b700 1 --2- 172.21.15.163:0/2049254837 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7fc35c0a1150 0x7fc35c0a3600 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fc360006010 tx=0x7fc36000b260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:12:51.040 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:50.999+0000 7fc3677fe700 1 -- 172.21.15.163:0/2049254837 <== mon.0 v2:172.21.15.163:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178025 (secure 0 0 0) 0x7fc3580979f0 con 0x7fc3700fed00 2023-07-14T18:12:51.175 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:12:50 smithi184 ceph-mon[98481]: pgmap v303: 129 pgs: 129 active+clean; 644 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 938 B/s wr, 12 op/s 2023-07-14T18:12:51.175 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:12:50 smithi184 ceph-mon[98481]: from='client.? 172.21.15.163:0/1949644872' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-07-14T18:12:51.176 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:12:50 smithi184 ceph-mon[98481]: from='client.? 172.21.15.163:0/1555932697' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-07-14T18:12:51.176 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:12:50 smithi184 ceph-mon[98481]: from='client.? 172.21.15.163:0/2343489526' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-07-14T18:12:51.218 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:12:50 smithi163 ceph-mon[96576]: pgmap v303: 129 pgs: 129 active+clean; 644 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 938 B/s wr, 12 op/s 2023-07-14T18:12:51.218 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:12:50 smithi163 ceph-mon[96576]: from='client.? 172.21.15.163:0/1949644872' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-07-14T18:12:51.218 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:12:50 smithi163 ceph-mon[96576]: from='client.? 172.21.15.163:0/1555932697' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-07-14T18:12:51.218 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:12:50 smithi163 ceph-mon[96576]: from='client.? 172.21.15.163:0/2343489526' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-07-14T18:12:51.240 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:51.199+0000 7fc374a11700 1 -- 172.21.15.163:0/2049254837 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fc370105a00 con 0x7fc3700fed00 2023-07-14T18:12:51.240 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:51.200+0000 7fc3677fe700 1 -- 172.21.15.163:0/2049254837 <== mon.0 v2:172.21.15.163:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v86) v1 ==== 103+0+11 (secure 0 0 0) 0x7fc35801c020 con 0x7fc3700fed00 2023-07-14T18:12:51.241 INFO:teuthology.orchestra.run.smithi163.stdout:pg_num: 32 2023-07-14T18:12:51.243 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:51.202+0000 7fc374a11700 1 -- 172.21.15.163:0/2049254837 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7fc35c0a1150 msgr2=0x7fc35c0a3600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:12:51.243 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:51.202+0000 7fc374a11700 1 --2- 172.21.15.163:0/2049254837 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7fc35c0a1150 0x7fc35c0a3600 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fc360006010 tx=0x7fc36000b260 comp rx=0 tx=0).stop 2023-07-14T18:12:51.243 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:51.202+0000 7fc374a11700 1 -- 172.21.15.163:0/2049254837 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc3700fed00 msgr2=0x7fc3701947c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:12:51.243 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:51.202+0000 7fc374a11700 1 --2- 172.21.15.163:0/2049254837 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc3700fed00 0x7fc3701947c0 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7fc358007910 tx=0x7fc358007c20 comp rx=0 tx=0).stop 2023-07-14T18:12:51.244 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:51.202+0000 7fc374a11700 1 -- 172.21.15.163:0/2049254837 shutdown_connections 2023-07-14T18:12:51.244 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:51.202+0000 7fc374a11700 1 --2- 172.21.15.163:0/2049254837 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7fc35c0a1150 0x7fc35c0a3600 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:51.244 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:51.202+0000 7fc374a11700 1 --2- 172.21.15.163:0/2049254837 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc3701000b0 0x7fc37019bd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:51.244 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:51.202+0000 7fc374a11700 1 --2- 172.21.15.163:0/2049254837 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc3700fed00 0x7fc3701947c0 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:51.244 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:51.202+0000 7fc374a11700 1 --2- 172.21.15.163:0/2049254837 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc3700ff6b0 0x7fc370194d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:51.244 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:51.202+0000 7fc374a11700 1 -- 172.21.15.163:0/2049254837 >> 172.21.15.163:0/2049254837 conn(0x7fc3700f98a0 msgr2=0x7fc3700fbbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:12:51.244 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:51.203+0000 7fc374a11700 1 -- 172.21.15.163:0/2049254837 shutdown_connections 2023-07-14T18:12:51.245 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:51.203+0000 7fc374a11700 1 -- 172.21.15.163:0/2049254837 wait complete. 2023-07-14T18:12:51.255 INFO:tasks.fwd_scrub:Wait for all MDSs to reach steady state... 2023-07-14T18:12:51.255 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-14T18:12:51.276 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:12:50 smithi172 ceph-mon[97983]: pgmap v303: 129 pgs: 129 active+clean; 644 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 938 B/s wr, 12 op/s 2023-07-14T18:12:51.276 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:12:50 smithi172 ceph-mon[97983]: from='client.? 172.21.15.163:0/1949644872' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-07-14T18:12:51.277 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:12:50 smithi172 ceph-mon[97983]: from='client.? 172.21.15.163:0/1555932697' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-07-14T18:12:51.277 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:12:50 smithi172 ceph-mon[97983]: from='client.? 172.21.15.163:0/2343489526' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-07-14T18:12:51.377 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:51.336+0000 7ff11cd62700 1 -- 172.21.15.163:0/1411436729 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff1180feb00 msgr2=0x7ff1180fef10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:12:51.377 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:51.336+0000 7ff11cd62700 1 --2- 172.21.15.163:0/1411436729 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff1180feb00 0x7ff1180fef10 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7ff108009990 tx=0x7ff108009ca0 comp rx=0 tx=0).stop 2023-07-14T18:12:51.378 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:51.337+0000 7ff11cd62700 1 -- 172.21.15.163:0/1411436729 shutdown_connections 2023-07-14T18:12:51.378 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:51.337+0000 7ff11cd62700 1 --2- 172.21.15.163:0/1411436729 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff118100680 0x7ff118106f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:51.378 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:51.337+0000 7ff11cd62700 1 --2- 172.21.15.163:0/1411436729 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff1180feb00 0x7ff1180fef10 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:51.378 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:51.337+0000 7ff11cd62700 1 --2- 172.21.15.163:0/1411436729 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff1180ffcf0 0x7ff118100140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:51.378 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:51.337+0000 7ff11cd62700 1 -- 172.21.15.163:0/1411436729 >> 172.21.15.163:0/1411436729 conn(0x7ff1180fa100 msgr2=0x7ff1180fc550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:12:51.378 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:51.337+0000 7ff11cd62700 1 -- 172.21.15.163:0/1411436729 shutdown_connections 2023-07-14T18:12:51.378 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:51.337+0000 7ff11cd62700 1 -- 172.21.15.163:0/1411436729 wait complete. 2023-07-14T18:12:51.380 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:51.337+0000 7ff11cd62700 1 Processor -- start 2023-07-14T18:12:51.380 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:51.337+0000 7ff11cd62700 1 -- start start 2023-07-14T18:12:51.381 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:51.337+0000 7ff11cd62700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff1180feb00 0x7ff118068310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:12:51.381 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:51.338+0000 7ff11cd62700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff1180ffcf0 0x7ff11819a530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:12:51.381 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:51.338+0000 7ff11cd62700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff118100680 0x7ff11819cb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:12:51.381 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:51.338+0000 7ff11cd62700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff11819d310 con 0x7ff118100680 2023-07-14T18:12:51.381 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:51.338+0000 7ff11cd62700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff11819d480 con 0x7ff1180ffcf0 2023-07-14T18:12:51.381 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:51.338+0000 7ff11cd62700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff11819d640 con 0x7ff1180feb00 2023-07-14T18:12:51.381 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:51.338+0000 7ff116d9d700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff118100680 0x7ff11819cb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:12:51.382 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:51.338+0000 7ff116d9d700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff118100680 0x7ff11819cb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:57870/0 (socket says 172.21.15.163:57870) 2023-07-14T18:12:51.382 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:51.338+0000 7ff116d9d700 1 -- 172.21.15.163:0/3952050385 learned_addr learned my addr 172.21.15.163:0/3952050385 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:12:51.382 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:51.338+0000 7ff115d9b700 1 --2- 172.21.15.163:0/3952050385 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff1180ffcf0 0x7ff11819a530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:12:51.382 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:51.338+0000 7ff11659c700 1 --2- 172.21.15.163:0/3952050385 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff1180feb00 0x7ff118068310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:12:51.382 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:51.338+0000 7ff116d9d700 1 -- 172.21.15.163:0/3952050385 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff1180feb00 msgr2=0x7ff118068310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:12:51.382 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:51.338+0000 7ff116d9d700 1 --2- 172.21.15.163:0/3952050385 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff1180feb00 0x7ff118068310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:51.382 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:51.338+0000 7ff116d9d700 1 -- 172.21.15.163:0/3952050385 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff1180ffcf0 msgr2=0x7ff11819a530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:12:51.382 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:51.338+0000 7ff116d9d700 1 --2- 172.21.15.163:0/3952050385 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff1180ffcf0 0x7ff11819a530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:51.383 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:51.338+0000 7ff116d9d700 1 -- 172.21.15.163:0/3952050385 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1080095f0 con 0x7ff118100680 2023-07-14T18:12:51.383 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:51.338+0000 7ff116d9d700 1 --2- 172.21.15.163:0/3952050385 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff118100680 0x7ff11819cb70 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7ff11000ada0 tx=0x7ff11000c330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:12:51.383 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:51.338+0000 7ff1077fe700 1 -- 172.21.15.163:0/3952050385 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff11000f070 con 0x7ff118100680 2023-07-14T18:12:51.383 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:51.338+0000 7ff11cd62700 1 -- 172.21.15.163:0/3952050385 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff11819d920 con 0x7ff118100680 2023-07-14T18:12:51.383 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:51.338+0000 7ff1077fe700 1 -- 172.21.15.163:0/3952050385 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ff110007b30 con 0x7ff118100680 2023-07-14T18:12:51.383 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:51.338+0000 7ff1077fe700 1 -- 172.21.15.163:0/3952050385 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff110005280 con 0x7ff118100680 2023-07-14T18:12:51.383 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:51.338+0000 7ff11cd62700 1 -- 172.21.15.163:0/3952050385 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff11819de30 con 0x7ff118100680 2023-07-14T18:12:51.384 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:51.339+0000 7ff11cd62700 1 -- 172.21.15.163:0/3952050385 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff1181060a0 con 0x7ff118100680 2023-07-14T18:12:51.384 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:51.341+0000 7ff1077fe700 1 -- 172.21.15.163:0/3952050385 <== mon.0 v2:172.21.15.163:3300/0 4 ==== mgrmap(e 18) v1 ==== 135716+0+0 (secure 0 0 0) 0x7ff11000a090 con 0x7ff118100680 2023-07-14T18:12:51.384 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:51.342+0000 7ff1077fe700 1 --2- 172.21.15.163:0/3952050385 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7ff1000a11a0 0x7ff1000a3650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:12:51.385 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:51.342+0000 7ff11659c700 1 --2- 172.21.15.163:0/3952050385 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7ff1000a11a0 0x7ff1000a3650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:12:51.385 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:51.342+0000 7ff1077fe700 1 -- 172.21.15.163:0/3952050385 <== mon.0 v2:172.21.15.163:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 9020+0+0 (secure 0 0 0) 0x7ff1100cc7c0 con 0x7ff118100680 2023-07-14T18:12:51.385 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:51.342+0000 7ff11659c700 1 --2- 172.21.15.163:0/3952050385 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7ff1000a11a0 0x7ff1000a3650 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7ff10800b5c0 tx=0x7ff108005960 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:12:51.385 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:51.345+0000 7ff1077fe700 1 -- 172.21.15.163:0/3952050385 <== mon.0 v2:172.21.15.163:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178025 (secure 0 0 0) 0x7ff110095c30 con 0x7ff118100680 2023-07-14T18:12:51.617 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:51.576+0000 7ff11cd62700 1 -- 172.21.15.163:0/3952050385 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff11802c8e0 con 0x7ff118100680 2023-07-14T18:12:51.617 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:51.577+0000 7ff1077fe700 1 -- 172.21.15.163:0/3952050385 <== mon.0 v2:172.21.15.163:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) v1 ==== 94+0+10901 (secure 0 0 0) 0x7ff110099250 con 0x7ff118100680 2023-07-14T18:12:51.618 INFO:teuthology.orchestra.run.smithi163.stdout: 2023-07-14T18:12:51.618 INFO:teuthology.orchestra.run.smithi163.stdout:{"epoch":29,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14562,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.163:6835/1058662632","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6834","nonce":1058662632},{"type":"v1","addr":"172.21.15.163:6835","nonce":1058662632}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":14568,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.163:6837/1107244425","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6836","nonce":1107244425},{"type":"v1","addr":"172.21.15.163:6837","nonce":1107244425}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":29,"flags":178,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"balance_automate":true},"ever_allowed_features":160,"explicitly_allowed_features":160,"created":"2023-07-14T18:11:09.109693+0000","modified":"2023-07-14T18:12:47.779723+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24518,"mds_1":24493,"mds_2":24479,"mds_3":24478,"mds_4":14652},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14640":{"gid":14640,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.163:6839/1337572937","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6838","nonce":1337572937},{"type":"v1","addr":"172.21.15.163:6839","nonce":1337572937}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_14652":{"gid":14652,"name":"a","rank":4,"incarnation":26,"state":"up:active","state_seq":9,"addr":"172.21.15.163:6841/1032082642","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6840","nonce":1032082642},{"type":"v1","addr":"172.21.15.163:6841","nonce":1032082642}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24421":{"gid":24421,"name":"l","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.184:6833/797722972","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6832","nonce":797722972},{"type":"v1","addr":"172.21.15.184:6833","nonce":797722972}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24431":{"gid":24431,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6833/1075696311","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":1075696311},{"type":"v1","addr":"172.21.15.172:6833","nonce":1075696311}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24458":{"gid":24458,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6835/1158120127","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":1158120127},{"type":"v1","addr":"172.21.15.172:6835","nonce":1158120127}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24466":{"gid":24466,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.184:6835/460134263","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6834","nonce":460134263},{"type":"v1","addr":"172.21.15.184:6835","nonce":460134263}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24478":{"gid":24478,"name":"c","rank":3,"incarnation":24,"state":"up:active","state_seq":11,"addr":"172.21.15.184:6837/3389277679","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6836","nonce":3389277679},{"type":"v1","addr":"172.21.15.184:6837","nonce":3389277679}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24479":{"gid":24479,"name":"h","rank":2,"incarnation":22,"state":"up:active","state_seq":10,"addr":"172.21.15.172:6837/3783835012","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":3783835012},{"type":"v1","addr":"172.21.15.172:6837","nonce":3783835012}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24493":{"gid":24493,"name":"i","rank":1,"incarnation":20,"state":"up:active","state_seq":9,"addr":"172.21.15.184:6839/2819059257","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6838","nonce":2819059257},{"type":"v1","addr":"172.21.15.184:6839","nonce":2819059257}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24518":{"gid":24518,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.172:6839/3850440096","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6838","nonce":3850440096},{"type":"v1","addr":"172.21.15.172:6839","nonce":3850440096}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-07-14T18:12:51.620 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:51.579+0000 7ff11cd62700 1 -- 172.21.15.163:0/3952050385 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7ff1000a11a0 msgr2=0x7ff1000a3650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:12:51.620 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:51.579+0000 7ff11cd62700 1 --2- 172.21.15.163:0/3952050385 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7ff1000a11a0 0x7ff1000a3650 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7ff10800b5c0 tx=0x7ff108005960 comp rx=0 tx=0).stop 2023-07-14T18:12:51.620 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:51.579+0000 7ff11cd62700 1 -- 172.21.15.163:0/3952050385 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff118100680 msgr2=0x7ff11819cb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:12:51.620 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:51.579+0000 7ff11cd62700 1 --2- 172.21.15.163:0/3952050385 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff118100680 0x7ff11819cb70 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7ff11000ada0 tx=0x7ff11000c330 comp rx=0 tx=0).stop 2023-07-14T18:12:51.620 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:51.579+0000 7ff11cd62700 1 -- 172.21.15.163:0/3952050385 shutdown_connections 2023-07-14T18:12:51.620 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:51.579+0000 7ff11cd62700 1 --2- 172.21.15.163:0/3952050385 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7ff1000a11a0 0x7ff1000a3650 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:51.621 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:51.579+0000 7ff11cd62700 1 --2- 172.21.15.163:0/3952050385 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff1180feb00 0x7ff118068310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:51.621 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:51.579+0000 7ff11cd62700 1 --2- 172.21.15.163:0/3952050385 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff118100680 0x7ff11819cb70 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:51.621 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:51.579+0000 7ff11cd62700 1 --2- 172.21.15.163:0/3952050385 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff1180ffcf0 0x7ff11819a530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:51.621 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:51.579+0000 7ff11cd62700 1 -- 172.21.15.163:0/3952050385 >> 172.21.15.163:0/3952050385 conn(0x7ff1180fa100 msgr2=0x7ff1181031e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:12:51.621 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:51.579+0000 7ff11cd62700 1 -- 172.21.15.163:0/3952050385 shutdown_connections 2023-07-14T18:12:51.621 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:51.579+0000 7ff11cd62700 1 -- 172.21.15.163:0/3952050385 wait complete. 2023-07-14T18:12:51.622 INFO:teuthology.orchestra.run.smithi163.stderr:dumped fsmap epoch 29 2023-07-14T18:12:51.632 INFO:tasks.fwd_scrub:Ready to start scrub thrashing 2023-07-14T18:12:51.632 INFO:tasks.fwd_scrub.ceph_manager:waiting for clean 2023-07-14T18:12:51.633 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-14T18:12:51.754 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:51.714+0000 7f4487967700 1 -- 172.21.15.163:0/1754283719 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f44800ffd10 msgr2=0x7f4480100160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:12:51.755 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:51.714+0000 7f4487967700 1 --2- 172.21.15.163:0/1754283719 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f44800ffd10 0x7f4480100160 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f447c009990 tx=0x7f447c009ca0 comp rx=0 tx=0).stop 2023-07-14T18:12:51.755 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:51.714+0000 7f4487967700 1 -- 172.21.15.163:0/1754283719 shutdown_connections 2023-07-14T18:12:51.755 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:51.714+0000 7f4487967700 1 --2- 172.21.15.163:0/1754283719 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f44800feb20 0x7f44800fef30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:51.755 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:51.714+0000 7f4487967700 1 --2- 172.21.15.163:0/1754283719 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f44801006a0 0x7f4480106f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:51.755 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:51.714+0000 7f4487967700 1 --2- 172.21.15.163:0/1754283719 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f44800ffd10 0x7f4480100160 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:51.756 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:51.714+0000 7f4487967700 1 -- 172.21.15.163:0/1754283719 >> 172.21.15.163:0/1754283719 conn(0x7f44800fa100 msgr2=0x7f44800fc570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:12:51.756 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:51.714+0000 7f4487967700 1 -- 172.21.15.163:0/1754283719 shutdown_connections 2023-07-14T18:12:51.756 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:51.714+0000 7f4487967700 1 -- 172.21.15.163:0/1754283719 wait complete. 2023-07-14T18:12:51.758 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:51.715+0000 7f4487967700 1 Processor -- start 2023-07-14T18:12:51.758 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:51.715+0000 7f4487967700 1 -- start start 2023-07-14T18:12:51.758 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:51.715+0000 7f4487967700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f44800feb20 0x7f4480069340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:12:51.758 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:51.715+0000 7f4487967700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f44800ffd10 0x7f448019a5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:12:51.758 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:51.715+0000 7f4487967700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f44801006a0 0x7f448019cc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:12:51.758 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:51.715+0000 7f4487967700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f448019d3b0 con 0x7f44800feb20 2023-07-14T18:12:51.758 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:51.715+0000 7f4487967700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f448019d520 con 0x7f44801006a0 2023-07-14T18:12:51.759 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:51.715+0000 7f4487967700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f448019d6e0 con 0x7f44800ffd10 2023-07-14T18:12:51.759 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:51.715+0000 7f4485703700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f44800feb20 0x7f4480069340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:12:51.759 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:51.715+0000 7f4485703700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f44800feb20 0x7f4480069340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:57880/0 (socket says 172.21.15.163:57880) 2023-07-14T18:12:51.759 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:51.715+0000 7f4485703700 1 -- 172.21.15.163:0/2492032177 learned_addr learned my addr 172.21.15.163:0/2492032177 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:12:51.759 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:51.715+0000 7f4484f02700 1 --2- 172.21.15.163:0/2492032177 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f44800ffd10 0x7f448019a5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:12:51.759 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:51.715+0000 7f4485f04700 1 --2- 172.21.15.163:0/2492032177 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f44801006a0 0x7f448019cc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:12:51.759 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:51.715+0000 7f4485703700 1 -- 172.21.15.163:0/2492032177 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f44800ffd10 msgr2=0x7f448019a5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:12:51.760 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:51.715+0000 7f4485703700 1 --2- 172.21.15.163:0/2492032177 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f44800ffd10 0x7f448019a5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:51.760 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:51.715+0000 7f4485703700 1 -- 172.21.15.163:0/2492032177 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f44801006a0 msgr2=0x7f448019cc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:12:51.760 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:51.715+0000 7f4485703700 1 --2- 172.21.15.163:0/2492032177 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f44801006a0 0x7f448019cc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:51.760 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:51.715+0000 7f4485703700 1 -- 172.21.15.163:0/2492032177 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f447c0095f0 con 0x7f44800feb20 2023-07-14T18:12:51.760 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:51.715+0000 7f4485f04700 1 --2- 172.21.15.163:0/2492032177 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f44801006a0 0x7f448019cc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T18:12:51.760 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:51.715+0000 7f4485703700 1 --2- 172.21.15.163:0/2492032177 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f44800feb20 0x7f4480069340 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f447000e970 tx=0x7f447000ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:12:51.760 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:51.716+0000 7f44767fc700 1 -- 172.21.15.163:0/2492032177 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4470009790 con 0x7f44800feb20 2023-07-14T18:12:51.760 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:51.716+0000 7f44767fc700 1 -- 172.21.15.163:0/2492032177 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f447000eec0 con 0x7f44800feb20 2023-07-14T18:12:51.761 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:51.716+0000 7f44767fc700 1 -- 172.21.15.163:0/2492032177 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4470003c10 con 0x7f44800feb20 2023-07-14T18:12:51.761 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:51.716+0000 7f4487967700 1 -- 172.21.15.163:0/2492032177 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f448019d9c0 con 0x7f44800feb20 2023-07-14T18:12:51.761 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:51.716+0000 7f4487967700 1 -- 172.21.15.163:0/2492032177 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f448019de80 con 0x7f44800feb20 2023-07-14T18:12:51.761 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:51.717+0000 7f4487967700 1 -- 172.21.15.163:0/2492032177 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f44801060e0 con 0x7f44800feb20 2023-07-14T18:12:51.762 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:51.718+0000 7f44767fc700 1 -- 172.21.15.163:0/2492032177 <== mon.0 v2:172.21.15.163:3300/0 4 ==== mgrmap(e 18) v1 ==== 135716+0+0 (secure 0 0 0) 0x7f4470004870 con 0x7f44800feb20 2023-07-14T18:12:51.762 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:51.719+0000 7f44767fc700 1 --2- 172.21.15.163:0/2492032177 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f446c0a1220 0x7f446c0a36d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:12:51.762 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:51.719+0000 7f4484f02700 1 --2- 172.21.15.163:0/2492032177 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f446c0a1220 0x7f446c0a36d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:12:51.762 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:51.719+0000 7f44767fc700 1 -- 172.21.15.163:0/2492032177 <== mon.0 v2:172.21.15.163:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 9020+0+0 (secure 0 0 0) 0x7f4470014070 con 0x7f44800feb20 2023-07-14T18:12:51.762 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:51.719+0000 7f4484f02700 1 --2- 172.21.15.163:0/2492032177 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f446c0a1220 0x7f446c0a36d0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f447c006010 tx=0x7f447c00b260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:12:51.763 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:51.722+0000 7f44767fc700 1 -- 172.21.15.163:0/2492032177 <== mon.0 v2:172.21.15.163:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178025 (secure 0 0 0) 0x7f44700963b0 con 0x7f44800feb20 2023-07-14T18:12:51.955 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:51.914+0000 7f4487967700 1 -- 172.21.15.163:0/2492032177 --> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f4480060a80 con 0x7f446c0a1220 2023-07-14T18:12:51.967 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:51.926+0000 7f44767fc700 1 -- 172.21.15.163:0/2492032177 <== mgr.14152 v2:172.21.15.163:6800/1949590926 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+427232 (secure 0 0 0) 0x7f4480060a80 con 0x7f446c0a1220 2023-07-14T18:12:51.970 INFO:teuthology.orchestra.run.smithi163.stdout: 2023-07-14T18:12:51.970 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:12:51 smithi163 ceph-mon[96576]: from='client.? 172.21.15.163:0/2749376171' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-07-14T18:12:51.971 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:12:51 smithi163 ceph-mon[96576]: from='client.? 172.21.15.163:0/2049254837' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2023-07-14T18:12:51.971 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:12:51 smithi163 ceph-mon[96576]: from='client.? 172.21.15.163:0/3952050385' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-07-14T18:12:51.976 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:51.930+0000 7f4487967700 1 -- 172.21.15.163:0/2492032177 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f446c0a1220 msgr2=0x7f446c0a36d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:12:51.977 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:51.930+0000 7f4487967700 1 --2- 172.21.15.163:0/2492032177 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f446c0a1220 0x7f446c0a36d0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f447c006010 tx=0x7f447c00b260 comp rx=0 tx=0).stop 2023-07-14T18:12:51.977 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:51.930+0000 7f4487967700 1 -- 172.21.15.163:0/2492032177 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f44800feb20 msgr2=0x7f4480069340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:12:51.977 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:51.930+0000 7f4487967700 1 --2- 172.21.15.163:0/2492032177 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f44800feb20 0x7f4480069340 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f447000e970 tx=0x7f447000ec80 comp rx=0 tx=0).stop 2023-07-14T18:12:51.977 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:51.930+0000 7f4487967700 1 -- 172.21.15.163:0/2492032177 shutdown_connections 2023-07-14T18:12:51.977 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:51.930+0000 7f4487967700 1 --2- 172.21.15.163:0/2492032177 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f446c0a1220 0x7f446c0a36d0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:51.978 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:51.931+0000 7f4487967700 1 --2- 172.21.15.163:0/2492032177 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f44801006a0 0x7f448019cc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:51.978 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:51.931+0000 7f4487967700 1 --2- 172.21.15.163:0/2492032177 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f44800feb20 0x7f4480069340 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:51.978 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:51.931+0000 7f4487967700 1 --2- 172.21.15.163:0/2492032177 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f44800ffd10 0x7f448019a5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:51.978 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:51.931+0000 7f4487967700 1 -- 172.21.15.163:0/2492032177 >> 172.21.15.163:0/2492032177 conn(0x7f44800fa100 msgr2=0x7f4480103220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:12:51.978 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:51.931+0000 7f4487967700 1 -- 172.21.15.163:0/2492032177 shutdown_connections 2023-07-14T18:12:51.978 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:51.931+0000 7f4487967700 1 -- 172.21.15.163:0/2492032177 wait complete. 2023-07-14T18:12:51.978 INFO:teuthology.orchestra.run.smithi163.stderr:dumped all 2023-07-14T18:12:51.983 INFO:teuthology.orchestra.run.smithi163.stdout:{"pg_ready":true,"pg_map":{"version":304,"stamp":"2023-07-14T18:12:51.435959+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":660956,"num_objects":102,"num_object_clones":0,"num_object_copies":308,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":950,"num_read_kb":598,"num_write":433,"num_write_kb":3088,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":859,"ondisk_log_size":859,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":419,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":337688,"kb_used_data":13496,"kb_used_omap":20,"kb_used_meta":324075,"kb_avail":1124604136,"statfs":{"total":1151940427776,"available":1151594635264,"internally_reserved":0,"allocated":13819904,"data_stored":7645729,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":21372,"internal_metadata":331852932},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":39,"apply_latency_ms":39,"commit_latency_ns":39000000,"apply_latency_ns":39000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2885,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":117,"num_read_kb":57,"num_write":17,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.007430"},"pg_stats":[{"pgid":"3.3f","version":"86'8","reported_seq":32,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T18:12:45.460577+0000","last_change":"2023-07-14T18:11:09.713546+0000","last_active":"2023-07-14T18:12:45.460577+0000","last_peered":"2023-07-14T18:12:45.460577+0000","last_clean":"2023-07-14T18:12:45.460577+0000","last_became_active":"2023-07-14T18:11:09.713170+0000","last_became_peered":"2023-07-14T18:11:09.713170+0000","last_unstale":"2023-07-14T18:12:45.460577+0000","last_undegraded":"2023-07-14T18:12:45.460577+0000","last_fullsized":"2023-07-14T18:12:45.460577+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_clean_scrub_stamp":"2023-07-14T18:11:08.667354+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T03:40:36.998253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"86'4","reported_seq":28,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T18:12:45.441618+0000","last_change":"2023-07-14T18:11:09.711619+0000","last_active":"2023-07-14T18:12:45.441618+0000","last_peered":"2023-07-14T18:12:45.441618+0000","last_clean":"2023-07-14T18:12:45.441618+0000","last_became_active":"2023-07-14T18:11:09.711249+0000","last_became_peered":"2023-07-14T18:11:09.711249+0000","last_unstale":"2023-07-14T18:12:45.441618+0000","last_undegraded":"2023-07-14T18:12:45.441618+0000","last_fullsized":"2023-07-14T18:12:45.441618+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_clean_scrub_stamp":"2023-07-14T18:11:08.667354+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T02:13:28.408928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"86'7","reported_seq":31,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T18:12:45.448220+0000","last_change":"2023-07-14T18:11:09.705557+0000","last_active":"2023-07-14T18:12:45.448220+0000","last_peered":"2023-07-14T18:12:45.448220+0000","last_clean":"2023-07-14T18:12:45.448220+0000","last_became_active":"2023-07-14T18:11:09.705179+0000","last_became_peered":"2023-07-14T18:11:09.705179+0000","last_unstale":"2023-07-14T18:12:45.448220+0000","last_undegraded":"2023-07-14T18:12:45.448220+0000","last_fullsized":"2023-07-14T18:12:45.448220+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_clean_scrub_stamp":"2023-07-14T18:11:08.667354+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:59:15.173719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"86'8","reported_seq":32,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T18:12:45.449133+0000","last_change":"2023-07-14T18:11:09.709234+0000","last_active":"2023-07-14T18:12:45.449133+0000","last_peered":"2023-07-14T18:12:45.449133+0000","last_clean":"2023-07-14T18:12:45.449133+0000","last_became_active":"2023-07-14T18:11:09.708855+0000","last_became_peered":"2023-07-14T18:11:09.708855+0000","last_unstale":"2023-07-14T18:12:45.449133+0000","last_undegraded":"2023-07-14T18:12:45.449133+0000","last_fullsized":"2023-07-14T18:12:45.449133+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_clean_scrub_stamp":"2023-07-14T18:11:08.667354+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:35:24.047137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"86'4","reported_seq":28,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T18:12:45.443286+0000","last_change":"2023-07-14T18:11:09.704301+0000","last_active":"2023-07-14T18:12:45.443286+0000","last_peered":"2023-07-14T18:12:45.443286+0000","last_clean":"2023-07-14T18:12:45.443286+0000","last_became_active":"2023-07-14T18:11:09.703961+0000","last_became_peered":"2023-07-14T18:11:09.703961+0000","last_unstale":"2023-07-14T18:12:45.443286+0000","last_undegraded":"2023-07-14T18:12:45.443286+0000","last_fullsized":"2023-07-14T18:12:45.443286+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_clean_scrub_stamp":"2023-07-14T18:11:08.667354+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:53:53.273088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"86'6","reported_seq":30,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T18:12:45.453093+0000","last_change":"2023-07-14T18:11:09.717667+0000","last_active":"2023-07-14T18:12:45.453093+0000","last_peered":"2023-07-14T18:12:45.453093+0000","last_clean":"2023-07-14T18:12:45.453093+0000","last_became_active":"2023-07-14T18:11:09.717146+0000","last_became_peered":"2023-07-14T18:11:09.717146+0000","last_unstale":"2023-07-14T18:12:45.453093+0000","last_undegraded":"2023-07-14T18:12:45.453093+0000","last_fullsized":"2023-07-14T18:12:45.453093+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_clean_scrub_stamp":"2023-07-14T18:11:08.667354+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T03:28:45.689618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"86'5","reported_seq":27,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T18:12:45.441864+0000","last_change":"2023-07-14T18:11:09.713638+0000","last_active":"2023-07-14T18:12:45.441864+0000","last_peered":"2023-07-14T18:12:45.441864+0000","last_clean":"2023-07-14T18:12:45.441864+0000","last_became_active":"2023-07-14T18:11:09.707940+0000","last_became_peered":"2023-07-14T18:11:09.707940+0000","last_unstale":"2023-07-14T18:12:45.441864+0000","last_undegraded":"2023-07-14T18:12:45.441864+0000","last_fullsized":"2023-07-14T18:12:45.441864+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_clean_scrub_stamp":"2023-07-14T18:11:08.667354+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:50:20.740517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"86'9","reported_seq":33,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T18:12:45.446140+0000","last_change":"2023-07-14T18:11:09.709804+0000","last_active":"2023-07-14T18:12:45.446140+0000","last_peered":"2023-07-14T18:12:45.446140+0000","last_clean":"2023-07-14T18:12:45.446140+0000","last_became_active":"2023-07-14T18:11:09.709385+0000","last_became_peered":"2023-07-14T18:11:09.709385+0000","last_unstale":"2023-07-14T18:12:45.446140+0000","last_undegraded":"2023-07-14T18:12:45.446140+0000","last_fullsized":"2023-07-14T18:12:45.446140+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_clean_scrub_stamp":"2023-07-14T18:11:08.667354+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T02:39:39.063898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"86'11","reported_seq":35,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T18:12:45.459915+0000","last_change":"2023-07-14T18:11:09.710410+0000","last_active":"2023-07-14T18:12:45.459915+0000","last_peered":"2023-07-14T18:12:45.459915+0000","last_clean":"2023-07-14T18:12:45.459915+0000","last_became_active":"2023-07-14T18:11:09.710049+0000","last_became_peered":"2023-07-14T18:11:09.710049+0000","last_unstale":"2023-07-14T18:12:45.459915+0000","last_undegraded":"2023-07-14T18:12:45.459915+0000","last_fullsized":"2023-07-14T18:12:45.459915+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_clean_scrub_stamp":"2023-07-14T18:11:08.667354+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:25:16.811711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"86'16","reported_seq":40,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T18:12:45.453260+0000","last_change":"2023-07-14T18:11:09.717681+0000","last_active":"2023-07-14T18:12:45.453260+0000","last_peered":"2023-07-14T18:12:45.453260+0000","last_clean":"2023-07-14T18:12:45.453260+0000","last_became_active":"2023-07-14T18:11:09.717209+0000","last_became_peered":"2023-07-14T18:11:09.717209+0000","last_unstale":"2023-07-14T18:12:45.453260+0000","last_undegraded":"2023-07-14T18:12:45.453260+0000","last_fullsized":"2023-07-14T18:12:45.453260+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_clean_scrub_stamp":"2023-07-14T18:11:08.667354+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:46:36.145271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"86'6","reported_seq":28,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T18:12:45.458937+0000","last_change":"2023-07-14T18:11:09.716890+0000","last_active":"2023-07-14T18:12:45.458937+0000","last_peered":"2023-07-14T18:12:45.458937+0000","last_clean":"2023-07-14T18:12:45.458937+0000","last_became_active":"2023-07-14T18:11:09.708773+0000","last_became_peered":"2023-07-14T18:11:09.708773+0000","last_unstale":"2023-07-14T18:12:45.458937+0000","last_undegraded":"2023-07-14T18:12:45.458937+0000","last_fullsized":"2023-07-14T18:12:45.458937+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_clean_scrub_stamp":"2023-07-14T18:11:08.667354+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:20:10.630301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"86'7","reported_seq":31,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T18:12:45.449001+0000","last_change":"2023-07-14T18:11:09.715119+0000","last_active":"2023-07-14T18:12:45.449001+0000","last_peered":"2023-07-14T18:12:45.449001+0000","last_clean":"2023-07-14T18:12:45.449001+0000","last_became_active":"2023-07-14T18:11:09.714680+0000","last_became_peered":"2023-07-14T18:11:09.714680+0000","last_unstale":"2023-07-14T18:12:45.449001+0000","last_undegraded":"2023-07-14T18:12:45.449001+0000","last_fullsized":"2023-07-14T18:12:45.449001+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_clean_scrub_stamp":"2023-07-14T18:11:08.667354+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T02:09:45.252484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"86'10","reported_seq":34,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T18:12:45.452938+0000","last_change":"2023-07-14T18:11:09.711173+0000","last_active":"2023-07-14T18:12:45.452938+0000","last_peered":"2023-07-14T18:12:45.452938+0000","last_clean":"2023-07-14T18:12:45.452938+0000","last_became_active":"2023-07-14T18:11:09.710849+0000","last_became_peered":"2023-07-14T18:11:09.710849+0000","last_unstale":"2023-07-14T18:12:45.452938+0000","last_undegraded":"2023-07-14T18:12:45.452938+0000","last_fullsized":"2023-07-14T18:12:45.452938+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_clean_scrub_stamp":"2023-07-14T18:11:08.667354+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:26:29.490965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"86'7","reported_seq":31,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T18:12:45.441004+0000","last_change":"2023-07-14T18:11:09.710448+0000","last_active":"2023-07-14T18:12:45.441004+0000","last_peered":"2023-07-14T18:12:45.441004+0000","last_clean":"2023-07-14T18:12:45.441004+0000","last_became_active":"2023-07-14T18:11:09.709804+0000","last_became_peered":"2023-07-14T18:11:09.709804+0000","last_unstale":"2023-07-14T18:12:45.441004+0000","last_undegraded":"2023-07-14T18:12:45.441004+0000","last_fullsized":"2023-07-14T18:12:45.441004+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_clean_scrub_stamp":"2023-07-14T18:11:08.667354+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T05:07:41.470601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"86'7","reported_seq":31,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T18:12:45.447823+0000","last_change":"2023-07-14T18:11:09.714917+0000","last_active":"2023-07-14T18:12:45.447823+0000","last_peered":"2023-07-14T18:12:45.447823+0000","last_clean":"2023-07-14T18:12:45.447823+0000","last_became_active":"2023-07-14T18:11:09.714655+0000","last_became_peered":"2023-07-14T18:11:09.714655+0000","last_unstale":"2023-07-14T18:12:45.447823+0000","last_undegraded":"2023-07-14T18:12:45.447823+0000","last_fullsized":"2023-07-14T18:12:45.447823+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_clean_scrub_stamp":"2023-07-14T18:11:08.667354+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T01:03:06.999938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"86'9","reported_seq":33,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T18:12:45.456009+0000","last_change":"2023-07-14T18:11:09.709149+0000","last_active":"2023-07-14T18:12:45.456009+0000","last_peered":"2023-07-14T18:12:45.456009+0000","last_clean":"2023-07-14T18:12:45.456009+0000","last_became_active":"2023-07-14T18:11:09.708692+0000","last_became_peered":"2023-07-14T18:11:09.708692+0000","last_unstale":"2023-07-14T18:12:45.456009+0000","last_undegraded":"2023-07-14T18:12:45.456009+0000","last_fullsized":"2023-07-14T18:12:45.456009+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_clean_scrub_stamp":"2023-07-14T18:11:08.667354+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:38:32.969267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"86'8","reported_seq":32,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T18:12:45.460687+0000","last_change":"2023-07-14T18:11:09.720235+0000","last_active":"2023-07-14T18:12:45.460687+0000","last_peered":"2023-07-14T18:12:45.460687+0000","last_clean":"2023-07-14T18:12:45.460687+0000","last_became_active":"2023-07-14T18:11:09.719895+0000","last_became_peered":"2023-07-14T18:11:09.719895+0000","last_unstale":"2023-07-14T18:12:45.460687+0000","last_undegraded":"2023-07-14T18:12:45.460687+0000","last_fullsized":"2023-07-14T18:12:45.460687+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_clean_scrub_stamp":"2023-07-14T18:11:08.667354+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T01:21:08.877374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"86'10","reported_seq":34,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T18:12:45.446473+0000","last_change":"2023-07-14T18:11:09.712390+0000","last_active":"2023-07-14T18:12:45.446473+0000","last_peered":"2023-07-14T18:12:45.446473+0000","last_clean":"2023-07-14T18:12:45.446473+0000","last_became_active":"2023-07-14T18:11:09.712074+0000","last_became_peered":"2023-07-14T18:11:09.712074+0000","last_unstale":"2023-07-14T18:12:45.446473+0000","last_undegraded":"2023-07-14T18:12:45.446473+0000","last_fullsized":"2023-07-14T18:12:45.446473+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_clean_scrub_stamp":"2023-07-14T18:11:08.667354+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:45:31.539804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"86'7","reported_seq":37,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T18:12:45.448352+0000","last_change":"2023-07-14T18:12:16.821031+0000","last_active":"2023-07-14T18:12:45.448352+0000","last_peered":"2023-07-14T18:12:45.448352+0000","last_clean":"2023-07-14T18:12:45.448352+0000","last_became_active":"2023-07-14T18:12:16.820659+0000","last_became_peered":"2023-07-14T18:12:16.820659+0000","last_unstale":"2023-07-14T18:12:45.448352+0000","last_undegraded":"2023-07-14T18:12:45.448352+0000","last_fullsized":"2023-07-14T18:12:45.448352+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_clean_scrub_stamp":"2023-07-14T18:11:08.667354+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:32:09.374522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,9,6],"acting":[2,9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T18:12:16.783949+0000","last_change":"2023-07-14T18:11:13.786505+0000","last_active":"2023-07-14T18:12:16.783949+0000","last_peered":"2023-07-14T18:12:16.783949+0000","last_clean":"2023-07-14T18:12:16.783949+0000","last_became_active":"2023-07-14T18:11:13.786141+0000","last_became_peered":"2023-07-14T18:11:13.786141+0000","last_unstale":"2023-07-14T18:12:16.783949+0000","last_undegraded":"2023-07-14T18:12:16.783949+0000","last_fullsized":"2023-07-14T18:12:16.783949+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:12.753466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:12.753466+0000","last_clean_scrub_stamp":"2023-07-14T18:11:12.753466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:31:14.426319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,9,0],"acting":[2,3,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"86'14","reported_seq":117,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T18:12:46.639522+0000","last_change":"2023-07-14T18:11:08.691446+0000","last_active":"2023-07-14T18:12:46.639522+0000","last_peered":"2023-07-14T18:12:46.639522+0000","last_clean":"2023-07-14T18:12:46.639522+0000","last_became_active":"2023-07-14T18:11:08.691129+0000","last_became_peered":"2023-07-14T18:11:08.691129+0000","last_unstale":"2023-07-14T18:12:46.639522+0000","last_undegraded":"2023-07-14T18:12:46.639522+0000","last_fullsized":"2023-07-14T18:12:46.639522+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:07.665746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:07.665746+0000","last_clean_scrub_stamp":"2023-07-14T18:11:07.665746+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:05:56.745631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":77,"num_read_kb":77,"num_write":15,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"86'5","reported_seq":29,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T18:12:45.435818+0000","last_change":"2023-07-14T18:11:09.708155+0000","last_active":"2023-07-14T18:12:45.435818+0000","last_peered":"2023-07-14T18:12:45.435818+0000","last_clean":"2023-07-14T18:12:45.435818+0000","last_became_active":"2023-07-14T18:11:09.707856+0000","last_became_peered":"2023-07-14T18:11:09.707856+0000","last_unstale":"2023-07-14T18:12:45.435818+0000","last_undegraded":"2023-07-14T18:12:45.435818+0000","last_fullsized":"2023-07-14T18:12:45.435818+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_clean_scrub_stamp":"2023-07-14T18:11:08.667354+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T01:19:38.619686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T18:12:16.781206+0000","last_change":"2023-07-14T18:11:13.776947+0000","last_active":"2023-07-14T18:12:16.781206+0000","last_peered":"2023-07-14T18:12:16.781206+0000","last_clean":"2023-07-14T18:12:16.781206+0000","last_became_active":"2023-07-14T18:11:13.776557+0000","last_became_peered":"2023-07-14T18:11:13.776557+0000","last_unstale":"2023-07-14T18:12:16.781206+0000","last_undegraded":"2023-07-14T18:12:16.781206+0000","last_fullsized":"2023-07-14T18:12:16.781206+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:12.753466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:12.753466+0000","last_clean_scrub_stamp":"2023-07-14T18:11:12.753466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:02:05.693156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,9,3],"acting":[4,6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1e","version":"84'2","reported_seq":28,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T18:12:16.780754+0000","last_change":"2023-07-14T18:11:08.690072+0000","last_active":"2023-07-14T18:12:16.780754+0000","last_peered":"2023-07-14T18:12:16.780754+0000","last_clean":"2023-07-14T18:12:16.780754+0000","last_became_active":"2023-07-14T18:11:08.689770+0000","last_became_peered":"2023-07-14T18:11:08.689770+0000","last_unstale":"2023-07-14T18:12:16.780754+0000","last_undegraded":"2023-07-14T18:12:16.780754+0000","last_fullsized":"2023-07-14T18:12:16.780754+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:07.665746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:07.665746+0000","last_clean_scrub_stamp":"2023-07-14T18:11:07.665746+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T03:14:32.886334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"86'6","reported_seq":30,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T18:12:45.459717+0000","last_change":"2023-07-14T18:11:09.706952+0000","last_active":"2023-07-14T18:12:45.459717+0000","last_peered":"2023-07-14T18:12:45.459717+0000","last_clean":"2023-07-14T18:12:45.459717+0000","last_became_active":"2023-07-14T18:11:09.706646+0000","last_became_peered":"2023-07-14T18:11:09.706646+0000","last_unstale":"2023-07-14T18:12:45.459717+0000","last_undegraded":"2023-07-14T18:12:45.459717+0000","last_fullsized":"2023-07-14T18:12:45.459717+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_clean_scrub_stamp":"2023-07-14T18:11:08.667354+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:27:36.385233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T18:12:16.781483+0000","last_change":"2023-07-14T18:11:13.779167+0000","last_active":"2023-07-14T18:12:16.781483+0000","last_peered":"2023-07-14T18:12:16.781483+0000","last_clean":"2023-07-14T18:12:16.781483+0000","last_became_active":"2023-07-14T18:11:13.778486+0000","last_became_peered":"2023-07-14T18:11:13.778486+0000","last_unstale":"2023-07-14T18:12:16.781483+0000","last_undegraded":"2023-07-14T18:12:16.781483+0000","last_fullsized":"2023-07-14T18:12:16.781483+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:12.753466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:12.753466+0000","last_clean_scrub_stamp":"2023-07-14T18:11:12.753466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:43:53.682087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,9,5],"acting":[4,3,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"84'12","reported_seq":39,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T18:12:16.785096+0000","last_change":"2023-07-14T18:11:08.688289+0000","last_active":"2023-07-14T18:12:16.785096+0000","last_peered":"2023-07-14T18:12:16.785096+0000","last_clean":"2023-07-14T18:12:16.785096+0000","last_became_active":"2023-07-14T18:11:08.687994+0000","last_became_peered":"2023-07-14T18:11:08.687994+0000","last_unstale":"2023-07-14T18:12:16.785096+0000","last_undegraded":"2023-07-14T18:12:16.785096+0000","last_fullsized":"2023-07-14T18:12:16.785096+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:07.665746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:07.665746+0000","last_clean_scrub_stamp":"2023-07-14T18:11:07.665746+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:47:18.133067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"86'9","reported_seq":33,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T18:12:45.459908+0000","last_change":"2023-07-14T18:11:09.711910+0000","last_active":"2023-07-14T18:12:45.459908+0000","last_peered":"2023-07-14T18:12:45.459908+0000","last_clean":"2023-07-14T18:12:45.459908+0000","last_became_active":"2023-07-14T18:11:09.711634+0000","last_became_peered":"2023-07-14T18:11:09.711634+0000","last_unstale":"2023-07-14T18:12:45.459908+0000","last_undegraded":"2023-07-14T18:12:45.459908+0000","last_fullsized":"2023-07-14T18:12:45.459908+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_clean_scrub_stamp":"2023-07-14T18:11:08.667354+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:25:00.505872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T18:12:16.781337+0000","last_change":"2023-07-14T18:11:13.778662+0000","last_active":"2023-07-14T18:12:16.781337+0000","last_peered":"2023-07-14T18:12:16.781337+0000","last_clean":"2023-07-14T18:12:16.781337+0000","last_became_active":"2023-07-14T18:11:13.777886+0000","last_became_peered":"2023-07-14T18:11:13.777886+0000","last_unstale":"2023-07-14T18:12:16.781337+0000","last_undegraded":"2023-07-14T18:12:16.781337+0000","last_fullsized":"2023-07-14T18:12:16.781337+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:12.753466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:12.753466+0000","last_clean_scrub_stamp":"2023-07-14T18:11:12.753466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T02:12:35.751856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"84'5","reported_seq":32,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T18:12:16.785924+0000","last_change":"2023-07-14T18:11:08.683774+0000","last_active":"2023-07-14T18:12:16.785924+0000","last_peered":"2023-07-14T18:12:16.785924+0000","last_clean":"2023-07-14T18:12:16.785924+0000","last_became_active":"2023-07-14T18:11:08.683458+0000","last_became_peered":"2023-07-14T18:11:08.683458+0000","last_unstale":"2023-07-14T18:12:16.785924+0000","last_undegraded":"2023-07-14T18:12:16.785924+0000","last_fullsized":"2023-07-14T18:12:16.785924+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:07.665746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:07.665746+0000","last_clean_scrub_stamp":"2023-07-14T18:11:07.665746+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T04:36:23.290219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"86'15","reported_seq":39,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T18:12:45.456481+0000","last_change":"2023-07-14T18:11:09.716041+0000","last_active":"2023-07-14T18:12:45.456481+0000","last_peered":"2023-07-14T18:12:45.456481+0000","last_clean":"2023-07-14T18:12:45.456481+0000","last_became_active":"2023-07-14T18:11:09.715367+0000","last_became_peered":"2023-07-14T18:11:09.715367+0000","last_unstale":"2023-07-14T18:12:45.456481+0000","last_undegraded":"2023-07-14T18:12:45.456481+0000","last_fullsized":"2023-07-14T18:12:45.456481+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_clean_scrub_stamp":"2023-07-14T18:11:08.667354+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T03:55:10.713872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T18:12:16.784204+0000","last_change":"2023-07-14T18:11:13.776527+0000","last_active":"2023-07-14T18:12:16.784204+0000","last_peered":"2023-07-14T18:12:16.784204+0000","last_clean":"2023-07-14T18:12:16.784204+0000","last_became_active":"2023-07-14T18:11:13.776032+0000","last_became_peered":"2023-07-14T18:11:13.776032+0000","last_unstale":"2023-07-14T18:12:16.784204+0000","last_undegraded":"2023-07-14T18:12:16.784204+0000","last_fullsized":"2023-07-14T18:12:16.784204+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:12.753466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:12.753466+0000","last_clean_scrub_stamp":"2023-07-14T18:11:12.753466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:28:26.705389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"86'6","reported_seq":112,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T18:12:46.881557+0000","last_change":"2023-07-14T18:11:08.687533+0000","last_active":"2023-07-14T18:12:46.881557+0000","last_peered":"2023-07-14T18:12:46.881557+0000","last_clean":"2023-07-14T18:12:46.881557+0000","last_became_active":"2023-07-14T18:11:08.687242+0000","last_became_peered":"2023-07-14T18:11:08.687242+0000","last_unstale":"2023-07-14T18:12:46.881557+0000","last_undegraded":"2023-07-14T18:12:46.881557+0000","last_fullsized":"2023-07-14T18:12:46.881557+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:07.665746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:07.665746+0000","last_clean_scrub_stamp":"2023-07-14T18:11:07.665746+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:35:48.553302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1073,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":80,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"86'7","reported_seq":31,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T18:12:45.438169+0000","last_change":"2023-07-14T18:11:09.707937+0000","last_active":"2023-07-14T18:12:45.438169+0000","last_peered":"2023-07-14T18:12:45.438169+0000","last_clean":"2023-07-14T18:12:45.438169+0000","last_became_active":"2023-07-14T18:11:09.707637+0000","last_became_peered":"2023-07-14T18:11:09.707637+0000","last_unstale":"2023-07-14T18:12:45.438169+0000","last_undegraded":"2023-07-14T18:12:45.438169+0000","last_fullsized":"2023-07-14T18:12:45.438169+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_clean_scrub_stamp":"2023-07-14T18:11:08.667354+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T01:53:50.131794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T18:12:16.783721+0000","last_change":"2023-07-14T18:11:13.791360+0000","last_active":"2023-07-14T18:12:16.783721+0000","last_peered":"2023-07-14T18:12:16.783721+0000","last_clean":"2023-07-14T18:12:16.783721+0000","last_became_active":"2023-07-14T18:11:13.790894+0000","last_became_peered":"2023-07-14T18:11:13.790894+0000","last_unstale":"2023-07-14T18:12:16.783721+0000","last_undegraded":"2023-07-14T18:12:16.783721+0000","last_fullsized":"2023-07-14T18:12:16.783721+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:12.753466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:12.753466+0000","last_clean_scrub_stamp":"2023-07-14T18:11:12.753466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:35:28.884052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,9,5],"acting":[2,6,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1a","version":"84'7","reported_seq":33,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T18:12:16.784280+0000","last_change":"2023-07-14T18:11:08.687315+0000","last_active":"2023-07-14T18:12:16.784280+0000","last_peered":"2023-07-14T18:12:16.784280+0000","last_clean":"2023-07-14T18:12:16.784280+0000","last_became_active":"2023-07-14T18:11:08.687061+0000","last_became_peered":"2023-07-14T18:11:08.687061+0000","last_unstale":"2023-07-14T18:12:16.784280+0000","last_undegraded":"2023-07-14T18:12:16.784280+0000","last_fullsized":"2023-07-14T18:12:16.784280+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:07.665746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:07.665746+0000","last_clean_scrub_stamp":"2023-07-14T18:11:07.665746+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:42:54.830869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"86'8","reported_seq":32,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T18:12:45.448831+0000","last_change":"2023-07-14T18:11:09.715816+0000","last_active":"2023-07-14T18:12:45.448831+0000","last_peered":"2023-07-14T18:12:45.448831+0000","last_clean":"2023-07-14T18:12:45.448831+0000","last_became_active":"2023-07-14T18:11:09.715038+0000","last_became_peered":"2023-07-14T18:11:09.715038+0000","last_unstale":"2023-07-14T18:12:45.448831+0000","last_undegraded":"2023-07-14T18:12:45.448831+0000","last_fullsized":"2023-07-14T18:12:45.448831+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_clean_scrub_stamp":"2023-07-14T18:11:08.667354+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:42:32.821947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T18:12:16.785977+0000","last_change":"2023-07-14T18:11:13.791438+0000","last_active":"2023-07-14T18:12:16.785977+0000","last_peered":"2023-07-14T18:12:16.785977+0000","last_clean":"2023-07-14T18:12:16.785977+0000","last_became_active":"2023-07-14T18:11:13.790956+0000","last_became_peered":"2023-07-14T18:11:13.790956+0000","last_unstale":"2023-07-14T18:12:16.785977+0000","last_undegraded":"2023-07-14T18:12:16.785977+0000","last_fullsized":"2023-07-14T18:12:16.785977+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:12.753466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:12.753466+0000","last_clean_scrub_stamp":"2023-07-14T18:11:12.753466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:12:53.328964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.19","version":"84'3","reported_seq":29,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T18:12:16.784139+0000","last_change":"2023-07-14T18:11:08.693751+0000","last_active":"2023-07-14T18:12:16.784139+0000","last_peered":"2023-07-14T18:12:16.784139+0000","last_clean":"2023-07-14T18:12:16.784139+0000","last_became_active":"2023-07-14T18:11:08.693427+0000","last_became_peered":"2023-07-14T18:11:08.693427+0000","last_unstale":"2023-07-14T18:12:16.784139+0000","last_undegraded":"2023-07-14T18:12:16.784139+0000","last_fullsized":"2023-07-14T18:12:16.784139+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:07.665746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:07.665746+0000","last_clean_scrub_stamp":"2023-07-14T18:11:07.665746+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T02:11:51.982350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"86'8","reported_seq":32,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T18:12:45.445843+0000","last_change":"2023-07-14T18:11:09.709761+0000","last_active":"2023-07-14T18:12:45.445843+0000","last_peered":"2023-07-14T18:12:45.445843+0000","last_clean":"2023-07-14T18:12:45.445843+0000","last_became_active":"2023-07-14T18:11:09.709157+0000","last_became_peered":"2023-07-14T18:11:09.709157+0000","last_unstale":"2023-07-14T18:12:45.445843+0000","last_undegraded":"2023-07-14T18:12:45.445843+0000","last_fullsized":"2023-07-14T18:12:45.445843+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_clean_scrub_stamp":"2023-07-14T18:11:08.667354+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T04:58:39.280985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T18:12:16.783570+0000","last_change":"2023-07-14T18:11:13.779265+0000","last_active":"2023-07-14T18:12:16.783570+0000","last_peered":"2023-07-14T18:12:16.783570+0000","last_clean":"2023-07-14T18:12:16.783570+0000","last_became_active":"2023-07-14T18:11:13.778865+0000","last_became_peered":"2023-07-14T18:11:13.778865+0000","last_unstale":"2023-07-14T18:12:16.783570+0000","last_undegraded":"2023-07-14T18:12:16.783570+0000","last_fullsized":"2023-07-14T18:12:16.783570+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:12.753466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:12.753466+0000","last_clean_scrub_stamp":"2023-07-14T18:11:12.753466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T05:03:04.869864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.18","version":"84'3","reported_seq":30,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T18:12:16.780833+0000","last_change":"2023-07-14T18:11:08.684513+0000","last_active":"2023-07-14T18:12:16.780833+0000","last_peered":"2023-07-14T18:12:16.780833+0000","last_clean":"2023-07-14T18:12:16.780833+0000","last_became_active":"2023-07-14T18:11:08.684213+0000","last_became_peered":"2023-07-14T18:11:08.684213+0000","last_unstale":"2023-07-14T18:12:16.780833+0000","last_undegraded":"2023-07-14T18:12:16.780833+0000","last_fullsized":"2023-07-14T18:12:16.780833+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:07.665746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:07.665746+0000","last_clean_scrub_stamp":"2023-07-14T18:11:07.665746+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:55:49.407191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"86'11","reported_seq":35,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T18:12:45.439367+0000","last_change":"2023-07-14T18:11:09.712427+0000","last_active":"2023-07-14T18:12:45.439367+0000","last_peered":"2023-07-14T18:12:45.439367+0000","last_clean":"2023-07-14T18:12:45.439367+0000","last_became_active":"2023-07-14T18:11:09.712104+0000","last_became_peered":"2023-07-14T18:11:09.712104+0000","last_unstale":"2023-07-14T18:12:45.439367+0000","last_undegraded":"2023-07-14T18:12:45.439367+0000","last_fullsized":"2023-07-14T18:12:45.439367+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_clean_scrub_stamp":"2023-07-14T18:11:08.667354+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:03:50.820456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T18:12:16.779940+0000","last_change":"2023-07-14T18:11:13.777892+0000","last_active":"2023-07-14T18:12:16.779940+0000","last_peered":"2023-07-14T18:12:16.779940+0000","last_clean":"2023-07-14T18:12:16.779940+0000","last_became_active":"2023-07-14T18:11:13.777518+0000","last_became_peered":"2023-07-14T18:11:13.777518+0000","last_unstale":"2023-07-14T18:12:16.779940+0000","last_undegraded":"2023-07-14T18:12:16.779940+0000","last_fullsized":"2023-07-14T18:12:16.779940+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:12.753466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:12.753466+0000","last_clean_scrub_stamp":"2023-07-14T18:11:12.753466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T02:25:56.668715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.17","version":"86'6","reported_seq":188,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T18:12:47.883339+0000","last_change":"2023-07-14T18:11:08.684141+0000","last_active":"2023-07-14T18:12:47.883339+0000","last_peered":"2023-07-14T18:12:47.883339+0000","last_clean":"2023-07-14T18:12:47.883339+0000","last_became_active":"2023-07-14T18:11:08.683767+0000","last_became_peered":"2023-07-14T18:11:08.683767+0000","last_unstale":"2023-07-14T18:12:47.883339+0000","last_undegraded":"2023-07-14T18:12:47.883339+0000","last_fullsized":"2023-07-14T18:12:47.883339+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:07.665746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:07.665746+0000","last_clean_scrub_stamp":"2023-07-14T18:11:07.665746+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T05:36:42.284552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":156,"num_read_kb":156,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"86'10","reported_seq":34,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T18:12:45.459551+0000","last_change":"2023-07-14T18:11:09.710975+0000","last_active":"2023-07-14T18:12:45.459551+0000","last_peered":"2023-07-14T18:12:45.459551+0000","last_clean":"2023-07-14T18:12:45.459551+0000","last_became_active":"2023-07-14T18:11:09.710690+0000","last_became_peered":"2023-07-14T18:11:09.710690+0000","last_unstale":"2023-07-14T18:12:45.459551+0000","last_undegraded":"2023-07-14T18:12:45.459551+0000","last_fullsized":"2023-07-14T18:12:45.459551+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_clean_scrub_stamp":"2023-07-14T18:11:08.667354+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:39:03.999443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T18:12:16.819496+0000","last_change":"2023-07-14T18:11:13.789251+0000","last_active":"2023-07-14T18:12:16.819496+0000","last_peered":"2023-07-14T18:12:16.819496+0000","last_clean":"2023-07-14T18:12:16.819496+0000","last_became_active":"2023-07-14T18:11:13.788742+0000","last_became_peered":"2023-07-14T18:11:13.788742+0000","last_unstale":"2023-07-14T18:12:16.819496+0000","last_undegraded":"2023-07-14T18:12:16.819496+0000","last_fullsized":"2023-07-14T18:12:16.819496+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:12.753466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:12.753466+0000","last_clean_scrub_stamp":"2023-07-14T18:11:12.753466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T03:20:00.785057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0,2,4],"acting":[9,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.16","version":"84'4","reported_seq":28,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T18:12:16.844891+0000","last_change":"2023-07-14T18:11:08.692093+0000","last_active":"2023-07-14T18:12:16.844891+0000","last_peered":"2023-07-14T18:12:16.844891+0000","last_clean":"2023-07-14T18:12:16.844891+0000","last_became_active":"2023-07-14T18:11:08.691806+0000","last_became_peered":"2023-07-14T18:11:08.691806+0000","last_unstale":"2023-07-14T18:12:16.844891+0000","last_undegraded":"2023-07-14T18:12:16.844891+0000","last_fullsized":"2023-07-14T18:12:16.844891+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:07.665746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:07.665746+0000","last_clean_scrub_stamp":"2023-07-14T18:11:07.665746+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:21:48.736019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"86'9","reported_seq":33,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T18:12:45.448023+0000","last_change":"2023-07-14T18:11:09.714965+0000","last_active":"2023-07-14T18:12:45.448023+0000","last_peered":"2023-07-14T18:12:45.448023+0000","last_clean":"2023-07-14T18:12:45.448023+0000","last_became_active":"2023-07-14T18:11:09.714676+0000","last_became_peered":"2023-07-14T18:11:09.714676+0000","last_unstale":"2023-07-14T18:12:45.448023+0000","last_undegraded":"2023-07-14T18:12:45.448023+0000","last_fullsized":"2023-07-14T18:12:45.448023+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_clean_scrub_stamp":"2023-07-14T18:11:08.667354+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:24:25.210635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T18:12:16.781786+0000","last_change":"2023-07-14T18:11:13.779218+0000","last_active":"2023-07-14T18:12:16.781786+0000","last_peered":"2023-07-14T18:12:16.781786+0000","last_clean":"2023-07-14T18:12:16.781786+0000","last_became_active":"2023-07-14T18:11:13.778833+0000","last_became_peered":"2023-07-14T18:11:13.778833+0000","last_unstale":"2023-07-14T18:12:16.781786+0000","last_undegraded":"2023-07-14T18:12:16.781786+0000","last_fullsized":"2023-07-14T18:12:16.781786+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:12.753466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:12.753466+0000","last_clean_scrub_stamp":"2023-07-14T18:11:12.753466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:07:21.597981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,9],"acting":[4,1,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"84'5","reported_seq":32,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T18:12:16.781131+0000","last_change":"2023-07-14T18:11:08.681778+0000","last_active":"2023-07-14T18:12:16.781131+0000","last_peered":"2023-07-14T18:12:16.781131+0000","last_clean":"2023-07-14T18:12:16.781131+0000","last_became_active":"2023-07-14T18:11:08.681406+0000","last_became_peered":"2023-07-14T18:11:08.681406+0000","last_unstale":"2023-07-14T18:12:16.781131+0000","last_undegraded":"2023-07-14T18:12:16.781131+0000","last_fullsized":"2023-07-14T18:12:16.781131+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:07.665746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:07.665746+0000","last_clean_scrub_stamp":"2023-07-14T18:11:07.665746+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T03:36:14.531699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"86'11","reported_seq":35,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T18:12:45.460044+0000","last_change":"2023-07-14T18:11:09.703070+0000","last_active":"2023-07-14T18:12:45.460044+0000","last_peered":"2023-07-14T18:12:45.460044+0000","last_clean":"2023-07-14T18:12:45.460044+0000","last_became_active":"2023-07-14T18:11:09.702754+0000","last_became_peered":"2023-07-14T18:11:09.702754+0000","last_unstale":"2023-07-14T18:12:45.460044+0000","last_undegraded":"2023-07-14T18:12:45.460044+0000","last_fullsized":"2023-07-14T18:12:45.460044+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_clean_scrub_stamp":"2023-07-14T18:11:08.667354+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:33:45.980597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T18:12:16.789910+0000","last_change":"2023-07-14T18:12:16.789325+0000","last_active":"2023-07-14T18:12:16.789910+0000","last_peered":"2023-07-14T18:12:16.789910+0000","last_clean":"2023-07-14T18:12:16.789910+0000","last_became_active":"2023-07-14T18:12:16.788834+0000","last_became_peered":"2023-07-14T18:12:16.788834+0000","last_unstale":"2023-07-14T18:12:16.789910+0000","last_undegraded":"2023-07-14T18:12:16.789910+0000","last_fullsized":"2023-07-14T18:12:16.789910+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:12.753466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:12.753466+0000","last_clean_scrub_stamp":"2023-07-14T18:11:12.753466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:12:10.461021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,11,5],"acting":[10,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.14","version":"86'37","reported_seq":228,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T18:12:47.883703+0000","last_change":"2023-07-14T18:11:08.690538+0000","last_active":"2023-07-14T18:12:47.883703+0000","last_peered":"2023-07-14T18:12:47.883703+0000","last_clean":"2023-07-14T18:12:47.883703+0000","last_became_active":"2023-07-14T18:11:08.690152+0000","last_became_peered":"2023-07-14T18:11:08.690152+0000","last_unstale":"2023-07-14T18:12:47.883703+0000","last_undegraded":"2023-07-14T18:12:47.883703+0000","last_fullsized":"2023-07-14T18:12:47.883703+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:07.665746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:07.665746+0000","last_clean_scrub_stamp":"2023-07-14T18:11:07.665746+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:01:20.282110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":61585,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":165,"num_read_kb":143,"num_write":39,"num_write_kb":76,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"86'6","reported_seq":30,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T18:12:45.442428+0000","last_change":"2023-07-14T18:11:09.710116+0000","last_active":"2023-07-14T18:12:45.442428+0000","last_peered":"2023-07-14T18:12:45.442428+0000","last_clean":"2023-07-14T18:12:45.442428+0000","last_became_active":"2023-07-14T18:11:09.709831+0000","last_became_peered":"2023-07-14T18:11:09.709831+0000","last_unstale":"2023-07-14T18:12:45.442428+0000","last_undegraded":"2023-07-14T18:12:45.442428+0000","last_fullsized":"2023-07-14T18:12:45.442428+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_clean_scrub_stamp":"2023-07-14T18:11:08.667354+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T02:26:12.205510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T18:12:16.782224+0000","last_change":"2023-07-14T18:11:13.777434+0000","last_active":"2023-07-14T18:12:16.782224+0000","last_peered":"2023-07-14T18:12:16.782224+0000","last_clean":"2023-07-14T18:12:16.782224+0000","last_became_active":"2023-07-14T18:11:13.776670+0000","last_became_peered":"2023-07-14T18:11:13.776670+0000","last_unstale":"2023-07-14T18:12:16.782224+0000","last_undegraded":"2023-07-14T18:12:16.782224+0000","last_fullsized":"2023-07-14T18:12:16.782224+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:12.753466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:12.753466+0000","last_clean_scrub_stamp":"2023-07-14T18:11:12.753466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:07:14.576233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.13","version":"84'9","reported_seq":37,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T18:12:16.783466+0000","last_change":"2023-07-14T18:11:08.693172+0000","last_active":"2023-07-14T18:12:16.783466+0000","last_peered":"2023-07-14T18:12:16.783466+0000","last_clean":"2023-07-14T18:12:16.783466+0000","last_became_active":"2023-07-14T18:11:08.692846+0000","last_became_peered":"2023-07-14T18:11:08.692846+0000","last_unstale":"2023-07-14T18:12:16.783466+0000","last_undegraded":"2023-07-14T18:12:16.783466+0000","last_fullsized":"2023-07-14T18:12:16.783466+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:07.665746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:07.665746+0000","last_clean_scrub_stamp":"2023-07-14T18:11:07.665746+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:36:37.277838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"86'9","reported_seq":33,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T18:12:45.448686+0000","last_change":"2023-07-14T18:11:09.708480+0000","last_active":"2023-07-14T18:12:45.448686+0000","last_peered":"2023-07-14T18:12:45.448686+0000","last_clean":"2023-07-14T18:12:45.448686+0000","last_became_active":"2023-07-14T18:11:09.708170+0000","last_became_peered":"2023-07-14T18:11:09.708170+0000","last_unstale":"2023-07-14T18:12:45.448686+0000","last_undegraded":"2023-07-14T18:12:45.448686+0000","last_fullsized":"2023-07-14T18:12:45.448686+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_clean_scrub_stamp":"2023-07-14T18:11:08.667354+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T02:05:02.970953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":24,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T18:12:16.846239+0000","last_change":"2023-07-14T18:12:16.846239+0000","last_active":"2023-07-14T18:12:16.846239+0000","last_peered":"2023-07-14T18:12:16.846239+0000","last_clean":"2023-07-14T18:12:16.846239+0000","last_became_active":"2023-07-14T18:12:16.845489+0000","last_became_peered":"2023-07-14T18:12:16.845489+0000","last_unstale":"2023-07-14T18:12:16.846239+0000","last_undegraded":"2023-07-14T18:12:16.846239+0000","last_fullsized":"2023-07-14T18:12:16.846239+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:12.753466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:12.753466+0000","last_clean_scrub_stamp":"2023-07-14T18:11:12.753466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T05:12:40.610555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,7,6],"acting":[11,8,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.12","version":"84'5","reported_seq":32,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T18:12:16.781367+0000","last_change":"2023-07-14T18:11:08.685028+0000","last_active":"2023-07-14T18:12:16.781367+0000","last_peered":"2023-07-14T18:12:16.781367+0000","last_clean":"2023-07-14T18:12:16.781367+0000","last_became_active":"2023-07-14T18:11:08.684701+0000","last_became_peered":"2023-07-14T18:11:08.684701+0000","last_unstale":"2023-07-14T18:12:16.781367+0000","last_undegraded":"2023-07-14T18:12:16.781367+0000","last_fullsized":"2023-07-14T18:12:16.781367+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:07.665746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:07.665746+0000","last_clean_scrub_stamp":"2023-07-14T18:11:07.665746+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:40:38.432876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"86'15","reported_seq":37,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T18:12:45.454427+0000","last_change":"2023-07-14T18:11:09.717714+0000","last_active":"2023-07-14T18:12:45.454427+0000","last_peered":"2023-07-14T18:12:45.454427+0000","last_clean":"2023-07-14T18:12:45.454427+0000","last_became_active":"2023-07-14T18:11:09.717407+0000","last_became_peered":"2023-07-14T18:11:09.717407+0000","last_unstale":"2023-07-14T18:12:45.454427+0000","last_undegraded":"2023-07-14T18:12:45.454427+0000","last_fullsized":"2023-07-14T18:12:45.454427+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_clean_scrub_stamp":"2023-07-14T18:11:08.667354+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:12:24.283577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T18:12:16.845564+0000","last_change":"2023-07-14T18:12:16.845564+0000","last_active":"2023-07-14T18:12:16.845564+0000","last_peered":"2023-07-14T18:12:16.845564+0000","last_clean":"2023-07-14T18:12:16.845564+0000","last_became_active":"2023-07-14T18:12:16.845084+0000","last_became_peered":"2023-07-14T18:12:16.845084+0000","last_unstale":"2023-07-14T18:12:16.845564+0000","last_undegraded":"2023-07-14T18:12:16.845564+0000","last_fullsized":"2023-07-14T18:12:16.845564+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:12.753466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:12.753466+0000","last_clean_scrub_stamp":"2023-07-14T18:11:12.753466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:52:49.779161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,7,0,3],"acting":[8,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.11","version":"86'8","reported_seq":115,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T18:12:46.881854+0000","last_change":"2023-07-14T18:11:08.685327+0000","last_active":"2023-07-14T18:12:46.881854+0000","last_peered":"2023-07-14T18:12:46.881854+0000","last_clean":"2023-07-14T18:12:46.881854+0000","last_became_active":"2023-07-14T18:11:08.684969+0000","last_became_peered":"2023-07-14T18:11:08.684969+0000","last_unstale":"2023-07-14T18:12:46.881854+0000","last_undegraded":"2023-07-14T18:12:46.881854+0000","last_fullsized":"2023-07-14T18:12:46.881854+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:07.665746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:07.665746+0000","last_clean_scrub_stamp":"2023-07-14T18:11:07.665746+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:42:58.262688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1570,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":82,"num_read_kb":5,"num_write":8,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"86'6","reported_seq":28,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T18:12:45.439837+0000","last_change":"2023-07-14T18:11:09.721100+0000","last_active":"2023-07-14T18:12:45.439837+0000","last_peered":"2023-07-14T18:12:45.439837+0000","last_clean":"2023-07-14T18:12:45.439837+0000","last_became_active":"2023-07-14T18:11:09.720814+0000","last_became_peered":"2023-07-14T18:11:09.720814+0000","last_unstale":"2023-07-14T18:12:45.439837+0000","last_undegraded":"2023-07-14T18:12:45.439837+0000","last_fullsized":"2023-07-14T18:12:45.439837+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_clean_scrub_stamp":"2023-07-14T18:11:08.667354+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T02:25:55.031694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T18:12:16.785211+0000","last_change":"2023-07-14T18:11:13.782152+0000","last_active":"2023-07-14T18:12:16.785211+0000","last_peered":"2023-07-14T18:12:16.785211+0000","last_clean":"2023-07-14T18:12:16.785211+0000","last_became_active":"2023-07-14T18:11:13.780580+0000","last_became_peered":"2023-07-14T18:11:13.780580+0000","last_unstale":"2023-07-14T18:12:16.785211+0000","last_undegraded":"2023-07-14T18:12:16.785211+0000","last_fullsized":"2023-07-14T18:12:16.785211+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:12.753466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:12.753466+0000","last_clean_scrub_stamp":"2023-07-14T18:11:12.753466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T05:55:08.131862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"84'17","reported_seq":44,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T18:12:16.784517+0000","last_change":"2023-07-14T18:11:08.688954+0000","last_active":"2023-07-14T18:12:16.784517+0000","last_peered":"2023-07-14T18:12:16.784517+0000","last_clean":"2023-07-14T18:12:16.784517+0000","last_became_active":"2023-07-14T18:11:08.688640+0000","last_became_peered":"2023-07-14T18:11:08.688640+0000","last_unstale":"2023-07-14T18:12:16.784517+0000","last_undegraded":"2023-07-14T18:12:16.784517+0000","last_fullsized":"2023-07-14T18:12:16.784517+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:07.665746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:07.665746+0000","last_clean_scrub_stamp":"2023-07-14T18:11:07.665746+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T01:34:25.106586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"86'6","reported_seq":30,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T18:12:45.448705+0000","last_change":"2023-07-14T18:11:09.710105+0000","last_active":"2023-07-14T18:12:45.448705+0000","last_peered":"2023-07-14T18:12:45.448705+0000","last_clean":"2023-07-14T18:12:45.448705+0000","last_became_active":"2023-07-14T18:11:09.709820+0000","last_became_peered":"2023-07-14T18:11:09.709820+0000","last_unstale":"2023-07-14T18:12:45.448705+0000","last_undegraded":"2023-07-14T18:12:45.448705+0000","last_fullsized":"2023-07-14T18:12:45.448705+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_clean_scrub_stamp":"2023-07-14T18:11:08.667354+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:41:52.837220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T18:12:16.781623+0000","last_change":"2023-07-14T18:11:13.780122+0000","last_active":"2023-07-14T18:12:16.781623+0000","last_peered":"2023-07-14T18:12:16.781623+0000","last_clean":"2023-07-14T18:12:16.781623+0000","last_became_active":"2023-07-14T18:11:13.779774+0000","last_became_peered":"2023-07-14T18:11:13.779774+0000","last_unstale":"2023-07-14T18:12:16.781623+0000","last_undegraded":"2023-07-14T18:12:16.781623+0000","last_fullsized":"2023-07-14T18:12:16.781623+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:12.753466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:12.753466+0000","last_clean_scrub_stamp":"2023-07-14T18:11:12.753466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T04:27:27.478680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"86'3","reported_seq":30,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T18:12:16.784347+0000","last_change":"2023-07-14T18:11:08.686080+0000","last_active":"2023-07-14T18:12:16.784347+0000","last_peered":"2023-07-14T18:12:16.784347+0000","last_clean":"2023-07-14T18:12:16.784347+0000","last_became_active":"2023-07-14T18:11:08.685837+0000","last_became_peered":"2023-07-14T18:11:08.685837+0000","last_unstale":"2023-07-14T18:12:16.784347+0000","last_undegraded":"2023-07-14T18:12:16.784347+0000","last_fullsized":"2023-07-14T18:12:16.784347+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:07.665746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:07.665746+0000","last_clean_scrub_stamp":"2023-07-14T18:11:07.665746+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:30:04.697099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"86'5","reported_seq":29,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T18:12:45.455440+0000","last_change":"2023-07-14T18:11:09.712166+0000","last_active":"2023-07-14T18:12:45.455440+0000","last_peered":"2023-07-14T18:12:45.455440+0000","last_clean":"2023-07-14T18:12:45.455440+0000","last_became_active":"2023-07-14T18:11:09.711858+0000","last_became_peered":"2023-07-14T18:11:09.711858+0000","last_unstale":"2023-07-14T18:12:45.455440+0000","last_undegraded":"2023-07-14T18:12:45.455440+0000","last_fullsized":"2023-07-14T18:12:45.455440+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_clean_scrub_stamp":"2023-07-14T18:11:08.667354+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T02:46:06.166324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T18:12:16.783856+0000","last_change":"2023-07-14T18:11:13.905188+0000","last_active":"2023-07-14T18:12:16.783856+0000","last_peered":"2023-07-14T18:12:16.783856+0000","last_clean":"2023-07-14T18:12:16.783856+0000","last_became_active":"2023-07-14T18:11:13.904779+0000","last_became_peered":"2023-07-14T18:11:13.904779+0000","last_unstale":"2023-07-14T18:12:16.783856+0000","last_undegraded":"2023-07-14T18:12:16.783856+0000","last_fullsized":"2023-07-14T18:12:16.783856+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:12.753466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:12.753466+0000","last_clean_scrub_stamp":"2023-07-14T18:11:12.753466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:03:59.732151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,9],"acting":[8,10,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.4","version":"84'1","reported_seq":27,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T18:12:16.819781+0000","last_change":"2023-07-14T18:11:08.687838+0000","last_active":"2023-07-14T18:12:16.819781+0000","last_peered":"2023-07-14T18:12:16.819781+0000","last_clean":"2023-07-14T18:12:16.819781+0000","last_became_active":"2023-07-14T18:11:08.687522+0000","last_became_peered":"2023-07-14T18:11:08.687522+0000","last_unstale":"2023-07-14T18:12:16.819781+0000","last_undegraded":"2023-07-14T18:12:16.819781+0000","last_fullsized":"2023-07-14T18:12:16.819781+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:07.665746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:07.665746+0000","last_clean_scrub_stamp":"2023-07-14T18:11:07.665746+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T01:02:10.989054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"86'4","reported_seq":28,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T18:12:45.453640+0000","last_change":"2023-07-14T18:11:09.704033+0000","last_active":"2023-07-14T18:12:45.453640+0000","last_peered":"2023-07-14T18:12:45.453640+0000","last_clean":"2023-07-14T18:12:45.453640+0000","last_became_active":"2023-07-14T18:11:09.703727+0000","last_became_peered":"2023-07-14T18:11:09.703727+0000","last_unstale":"2023-07-14T18:12:45.453640+0000","last_undegraded":"2023-07-14T18:12:45.453640+0000","last_fullsized":"2023-07-14T18:12:45.453640+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_clean_scrub_stamp":"2023-07-14T18:11:08.667354+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:12:28.187627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T18:12:16.784685+0000","last_change":"2023-07-14T18:11:13.778207+0000","last_active":"2023-07-14T18:12:16.784685+0000","last_peered":"2023-07-14T18:12:16.784685+0000","last_clean":"2023-07-14T18:12:16.784685+0000","last_became_active":"2023-07-14T18:11:13.777847+0000","last_became_peered":"2023-07-14T18:11:13.777847+0000","last_unstale":"2023-07-14T18:12:16.784685+0000","last_undegraded":"2023-07-14T18:12:16.784685+0000","last_fullsized":"2023-07-14T18:12:16.784685+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:12.753466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:12.753466+0000","last_clean_scrub_stamp":"2023-07-14T18:11:12.753466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:35:45.808281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"86'6","reported_seq":111,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T18:12:48.884059+0000","last_change":"2023-07-14T18:11:08.683570+0000","last_active":"2023-07-14T18:12:48.884059+0000","last_peered":"2023-07-14T18:12:48.884059+0000","last_clean":"2023-07-14T18:12:48.884059+0000","last_became_active":"2023-07-14T18:11:08.683271+0000","last_became_peered":"2023-07-14T18:11:08.683271+0000","last_unstale":"2023-07-14T18:12:48.884059+0000","last_undegraded":"2023-07-14T18:12:48.884059+0000","last_fullsized":"2023-07-14T18:12:48.884059+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:07.665746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:07.665746+0000","last_clean_scrub_stamp":"2023-07-14T18:11:07.665746+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:09:15.993784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1039,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":81,"num_read_kb":2,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"86'7","reported_seq":31,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T18:12:45.451711+0000","last_change":"2023-07-14T18:11:09.718239+0000","last_active":"2023-07-14T18:12:45.451711+0000","last_peered":"2023-07-14T18:12:45.451711+0000","last_clean":"2023-07-14T18:12:45.451711+0000","last_became_active":"2023-07-14T18:11:09.717923+0000","last_became_peered":"2023-07-14T18:11:09.717923+0000","last_unstale":"2023-07-14T18:12:45.451711+0000","last_undegraded":"2023-07-14T18:12:45.451711+0000","last_fullsized":"2023-07-14T18:12:45.451711+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_clean_scrub_stamp":"2023-07-14T18:11:08.667354+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T04:14:10.672827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T18:12:16.784912+0000","last_change":"2023-07-14T18:11:13.904652+0000","last_active":"2023-07-14T18:12:16.784912+0000","last_peered":"2023-07-14T18:12:16.784912+0000","last_clean":"2023-07-14T18:12:16.784912+0000","last_became_active":"2023-07-14T18:11:13.904237+0000","last_became_peered":"2023-07-14T18:11:13.904237+0000","last_unstale":"2023-07-14T18:12:16.784912+0000","last_undegraded":"2023-07-14T18:12:16.784912+0000","last_fullsized":"2023-07-14T18:12:16.784912+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:12.753466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:12.753466+0000","last_clean_scrub_stamp":"2023-07-14T18:11:12.753466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:43:21.460670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"86'8","reported_seq":32,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T18:12:45.455030+0000","last_change":"2023-07-14T18:11:09.707086+0000","last_active":"2023-07-14T18:12:45.455030+0000","last_peered":"2023-07-14T18:12:45.455030+0000","last_clean":"2023-07-14T18:12:45.455030+0000","last_became_active":"2023-07-14T18:11:09.705882+0000","last_became_peered":"2023-07-14T18:11:09.705882+0000","last_unstale":"2023-07-14T18:12:45.455030+0000","last_undegraded":"2023-07-14T18:12:45.455030+0000","last_fullsized":"2023-07-14T18:12:45.455030+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_clean_scrub_stamp":"2023-07-14T18:11:08.667354+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:19:33.907849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"86'6","reported_seq":112,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T18:12:47.883218+0000","last_change":"2023-07-14T18:11:08.683447+0000","last_active":"2023-07-14T18:12:47.883218+0000","last_peered":"2023-07-14T18:12:47.883218+0000","last_clean":"2023-07-14T18:12:47.883218+0000","last_became_active":"2023-07-14T18:11:08.682822+0000","last_became_peered":"2023-07-14T18:11:08.682822+0000","last_unstale":"2023-07-14T18:12:47.883218+0000","last_undegraded":"2023-07-14T18:12:47.883218+0000","last_fullsized":"2023-07-14T18:12:47.883218+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:07.665746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:07.665746+0000","last_clean_scrub_stamp":"2023-07-14T18:11:07.665746+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T03:36:18.950081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":80,"num_read_kb":80,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.5","version":"84'1","reported_seq":18,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T18:12:16.844599+0000","last_change":"2023-07-14T18:11:13.780698+0000","last_active":"2023-07-14T18:12:16.844599+0000","last_peered":"2023-07-14T18:12:16.844599+0000","last_clean":"2023-07-14T18:12:16.844599+0000","last_became_active":"2023-07-14T18:11:13.780310+0000","last_became_peered":"2023-07-14T18:11:13.780310+0000","last_unstale":"2023-07-14T18:12:16.844599+0000","last_undegraded":"2023-07-14T18:12:16.844599+0000","last_fullsized":"2023-07-14T18:12:16.844599+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:12.753466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:12.753466+0000","last_clean_scrub_stamp":"2023-07-14T18:11:12.753466+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T06:08:42.872042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":123,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,9],"acting":[7,5,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"86'8","reported_seq":32,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T18:12:45.454252+0000","last_change":"2023-07-14T18:11:09.708728+0000","last_active":"2023-07-14T18:12:45.454252+0000","last_peered":"2023-07-14T18:12:45.454252+0000","last_clean":"2023-07-14T18:12:45.454252+0000","last_became_active":"2023-07-14T18:11:09.708345+0000","last_became_peered":"2023-07-14T18:11:09.708345+0000","last_unstale":"2023-07-14T18:12:45.454252+0000","last_undegraded":"2023-07-14T18:12:45.454252+0000","last_fullsized":"2023-07-14T18:12:45.454252+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_clean_scrub_stamp":"2023-07-14T18:11:08.667354+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:19:40.073079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"84'6","reported_seq":35,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T18:12:16.781636+0000","last_change":"2023-07-14T18:11:08.684495+0000","last_active":"2023-07-14T18:12:16.781636+0000","last_peered":"2023-07-14T18:12:16.781636+0000","last_clean":"2023-07-14T18:12:16.781636+0000","last_became_active":"2023-07-14T18:11:08.684142+0000","last_became_peered":"2023-07-14T18:11:08.684142+0000","last_unstale":"2023-07-14T18:12:16.781636+0000","last_undegraded":"2023-07-14T18:12:16.781636+0000","last_fullsized":"2023-07-14T18:12:16.781636+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:07.665746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:07.665746+0000","last_clean_scrub_stamp":"2023-07-14T18:11:07.665746+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:11:12.155016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"22'137","reported_seq":340,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T18:12:16.844065+0000","last_change":"2023-07-14T18:10:10.733548+0000","last_active":"2023-07-14T18:12:16.844065+0000","last_peered":"2023-07-14T18:12:16.844065+0000","last_clean":"2023-07-14T18:12:16.844065+0000","last_became_active":"2023-07-14T18:10:10.732994+0000","last_became_peered":"2023-07-14T18:10:10.732994+0000","last_unstale":"2023-07-14T18:12:16.844065+0000","last_undegraded":"2023-07-14T18:12:16.844065+0000","last_fullsized":"2023-07-14T18:12:16.844065+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:07:19.893754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:07:19.893754+0000","last_clean_scrub_stamp":"2023-07-14T18:07:19.893754+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:16:39.410680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T18:12:16.781799+0000","last_change":"2023-07-14T18:11:13.905811+0000","last_active":"2023-07-14T18:12:16.781799+0000","last_peered":"2023-07-14T18:12:16.781799+0000","last_clean":"2023-07-14T18:12:16.781799+0000","last_became_active":"2023-07-14T18:11:13.905390+0000","last_became_peered":"2023-07-14T18:11:13.905390+0000","last_unstale":"2023-07-14T18:12:16.781799+0000","last_undegraded":"2023-07-14T18:12:16.781799+0000","last_fullsized":"2023-07-14T18:12:16.781799+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:12.753466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:12.753466+0000","last_clean_scrub_stamp":"2023-07-14T18:11:12.753466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:36:37.437843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,6,10],"acting":[5,9,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1","version":"86'5","reported_seq":35,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T18:12:45.449824+0000","last_change":"2023-07-14T18:12:16.820762+0000","last_active":"2023-07-14T18:12:45.449824+0000","last_peered":"2023-07-14T18:12:45.449824+0000","last_clean":"2023-07-14T18:12:45.449824+0000","last_became_active":"2023-07-14T18:12:16.820314+0000","last_became_peered":"2023-07-14T18:12:16.820314+0000","last_unstale":"2023-07-14T18:12:45.449824+0000","last_undegraded":"2023-07-14T18:12:45.449824+0000","last_fullsized":"2023-07-14T18:12:45.449824+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_clean_scrub_stamp":"2023-07-14T18:11:08.667354+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:41:31.599732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,9,2],"acting":[6,9,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"84'4","reported_seq":28,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T18:12:16.844495+0000","last_change":"2023-07-14T18:11:08.689050+0000","last_active":"2023-07-14T18:12:16.844495+0000","last_peered":"2023-07-14T18:12:16.844495+0000","last_clean":"2023-07-14T18:12:16.844495+0000","last_became_active":"2023-07-14T18:11:08.688777+0000","last_became_peered":"2023-07-14T18:11:08.688777+0000","last_unstale":"2023-07-14T18:12:16.844495+0000","last_undegraded":"2023-07-14T18:12:16.844495+0000","last_fullsized":"2023-07-14T18:12:16.844495+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:07.665746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:07.665746+0000","last_clean_scrub_stamp":"2023-07-14T18:11:07.665746+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:55:29.518680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T18:12:16.784706+0000","last_change":"2023-07-14T18:11:13.776853+0000","last_active":"2023-07-14T18:12:16.784706+0000","last_peered":"2023-07-14T18:12:16.784706+0000","last_clean":"2023-07-14T18:12:16.784706+0000","last_became_active":"2023-07-14T18:11:13.776353+0000","last_became_peered":"2023-07-14T18:11:13.776353+0000","last_unstale":"2023-07-14T18:12:16.784706+0000","last_undegraded":"2023-07-14T18:12:16.784706+0000","last_fullsized":"2023-07-14T18:12:16.784706+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:12.753466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:12.753466+0000","last_clean_scrub_stamp":"2023-07-14T18:11:12.753466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:43:50.815992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.5","version":"84'4","reported_seq":31,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T18:12:16.784876+0000","last_change":"2023-07-14T18:11:08.691634+0000","last_active":"2023-07-14T18:12:16.784876+0000","last_peered":"2023-07-14T18:12:16.784876+0000","last_clean":"2023-07-14T18:12:16.784876+0000","last_became_active":"2023-07-14T18:11:08.691315+0000","last_became_peered":"2023-07-14T18:11:08.691315+0000","last_unstale":"2023-07-14T18:12:16.784876+0000","last_undegraded":"2023-07-14T18:12:16.784876+0000","last_fullsized":"2023-07-14T18:12:16.784876+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:07.665746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:07.665746+0000","last_clean_scrub_stamp":"2023-07-14T18:11:07.665746+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:24:13.839686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"86'9","reported_seq":33,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T18:12:45.449178+0000","last_change":"2023-07-14T18:11:09.707486+0000","last_active":"2023-07-14T18:12:45.449178+0000","last_peered":"2023-07-14T18:12:45.449178+0000","last_clean":"2023-07-14T18:12:45.449178+0000","last_became_active":"2023-07-14T18:11:09.707168+0000","last_became_peered":"2023-07-14T18:11:09.707168+0000","last_unstale":"2023-07-14T18:12:45.449178+0000","last_undegraded":"2023-07-14T18:12:45.449178+0000","last_fullsized":"2023-07-14T18:12:45.449178+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_clean_scrub_stamp":"2023-07-14T18:11:08.667354+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T02:05:41.913228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T18:12:16.779820+0000","last_change":"2023-07-14T18:11:13.905898+0000","last_active":"2023-07-14T18:12:16.779820+0000","last_peered":"2023-07-14T18:12:16.779820+0000","last_clean":"2023-07-14T18:12:16.779820+0000","last_became_active":"2023-07-14T18:11:13.905482+0000","last_became_peered":"2023-07-14T18:11:13.905482+0000","last_unstale":"2023-07-14T18:12:16.779820+0000","last_undegraded":"2023-07-14T18:12:16.779820+0000","last_fullsized":"2023-07-14T18:12:16.779820+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:12.753466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:12.753466+0000","last_clean_scrub_stamp":"2023-07-14T18:11:12.753466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T05:46:41.734287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"84'9","reported_seq":35,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T18:12:16.819945+0000","last_change":"2023-07-14T18:11:08.692339+0000","last_active":"2023-07-14T18:12:16.819945+0000","last_peered":"2023-07-14T18:12:16.819945+0000","last_clean":"2023-07-14T18:12:16.819945+0000","last_became_active":"2023-07-14T18:11:08.692047+0000","last_became_peered":"2023-07-14T18:11:08.692047+0000","last_unstale":"2023-07-14T18:12:16.819945+0000","last_undegraded":"2023-07-14T18:12:16.819945+0000","last_fullsized":"2023-07-14T18:12:16.819945+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:07.665746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:07.665746+0000","last_clean_scrub_stamp":"2023-07-14T18:11:07.665746+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T04:39:07.444831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"86'5","reported_seq":29,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T18:12:45.442930+0000","last_change":"2023-07-14T18:11:09.709900+0000","last_active":"2023-07-14T18:12:45.442930+0000","last_peered":"2023-07-14T18:12:45.442930+0000","last_clean":"2023-07-14T18:12:45.442930+0000","last_became_active":"2023-07-14T18:11:09.709291+0000","last_became_peered":"2023-07-14T18:11:09.709291+0000","last_unstale":"2023-07-14T18:12:45.442930+0000","last_undegraded":"2023-07-14T18:12:45.442930+0000","last_fullsized":"2023-07-14T18:12:45.442930+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_clean_scrub_stamp":"2023-07-14T18:11:08.667354+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:49:34.349407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T18:12:16.783030+0000","last_change":"2023-07-14T18:11:13.777493+0000","last_active":"2023-07-14T18:12:16.783030+0000","last_peered":"2023-07-14T18:12:16.783030+0000","last_clean":"2023-07-14T18:12:16.783030+0000","last_became_active":"2023-07-14T18:11:13.777110+0000","last_became_peered":"2023-07-14T18:11:13.777110+0000","last_unstale":"2023-07-14T18:12:16.783030+0000","last_undegraded":"2023-07-14T18:12:16.783030+0000","last_fullsized":"2023-07-14T18:12:16.783030+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:12.753466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:12.753466+0000","last_clean_scrub_stamp":"2023-07-14T18:11:12.753466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T05:10:40.176326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"84'7","reported_seq":34,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T18:12:16.781941+0000","last_change":"2023-07-14T18:11:08.686832+0000","last_active":"2023-07-14T18:12:16.781941+0000","last_peered":"2023-07-14T18:12:16.781941+0000","last_clean":"2023-07-14T18:12:16.781941+0000","last_became_active":"2023-07-14T18:11:08.686461+0000","last_became_peered":"2023-07-14T18:11:08.686461+0000","last_unstale":"2023-07-14T18:12:16.781941+0000","last_undegraded":"2023-07-14T18:12:16.781941+0000","last_fullsized":"2023-07-14T18:12:16.781941+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:07.665746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:07.665746+0000","last_clean_scrub_stamp":"2023-07-14T18:11:07.665746+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:19:33.834375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"86'7","reported_seq":37,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T18:12:45.443847+0000","last_change":"2023-07-14T18:12:16.787772+0000","last_active":"2023-07-14T18:12:45.443847+0000","last_peered":"2023-07-14T18:12:45.443847+0000","last_clean":"2023-07-14T18:12:45.443847+0000","last_became_active":"2023-07-14T18:12:16.787380+0000","last_became_peered":"2023-07-14T18:12:16.787380+0000","last_unstale":"2023-07-14T18:12:45.443847+0000","last_undegraded":"2023-07-14T18:12:45.443847+0000","last_fullsized":"2023-07-14T18:12:45.443847+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_clean_scrub_stamp":"2023-07-14T18:11:08.667354+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:59:19.831682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,6],"acting":[0,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T18:12:16.781766+0000","last_change":"2023-07-14T18:11:13.905856+0000","last_active":"2023-07-14T18:12:16.781766+0000","last_peered":"2023-07-14T18:12:16.781766+0000","last_clean":"2023-07-14T18:12:16.781766+0000","last_became_active":"2023-07-14T18:11:13.905441+0000","last_became_peered":"2023-07-14T18:11:13.905441+0000","last_unstale":"2023-07-14T18:12:16.781766+0000","last_undegraded":"2023-07-14T18:12:16.781766+0000","last_fullsized":"2023-07-14T18:12:16.781766+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:12.753466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:12.753466+0000","last_clean_scrub_stamp":"2023-07-14T18:11:12.753466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:50:48.995276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,9],"acting":[4,5,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"84'2","reported_seq":38,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T18:12:16.791966+0000","last_change":"2023-07-14T18:12:16.791966+0000","last_active":"2023-07-14T18:12:16.791966+0000","last_peered":"2023-07-14T18:12:16.791966+0000","last_clean":"2023-07-14T18:12:16.791966+0000","last_became_active":"2023-07-14T18:12:16.788710+0000","last_became_peered":"2023-07-14T18:12:16.788710+0000","last_unstale":"2023-07-14T18:12:16.791966+0000","last_undegraded":"2023-07-14T18:12:16.791966+0000","last_fullsized":"2023-07-14T18:12:16.791966+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:07.665746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:07.665746+0000","last_clean_scrub_stamp":"2023-07-14T18:11:07.665746+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T01:02:37.127435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,11,0],"acting":[1,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"86'2","reported_seq":26,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T18:12:45.412509+0000","last_change":"2023-07-14T18:11:09.711219+0000","last_active":"2023-07-14T18:12:45.412509+0000","last_peered":"2023-07-14T18:12:45.412509+0000","last_clean":"2023-07-14T18:12:45.412509+0000","last_became_active":"2023-07-14T18:11:09.711019+0000","last_became_peered":"2023-07-14T18:11:09.711019+0000","last_unstale":"2023-07-14T18:12:45.412509+0000","last_undegraded":"2023-07-14T18:12:45.412509+0000","last_fullsized":"2023-07-14T18:12:45.412509+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_clean_scrub_stamp":"2023-07-14T18:11:08.667354+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:05:55.303542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T18:12:16.820136+0000","last_change":"2023-07-14T18:11:13.788530+0000","last_active":"2023-07-14T18:12:16.820136+0000","last_peered":"2023-07-14T18:12:16.820136+0000","last_clean":"2023-07-14T18:12:16.820136+0000","last_became_active":"2023-07-14T18:11:13.787952+0000","last_became_peered":"2023-07-14T18:11:13.787952+0000","last_unstale":"2023-07-14T18:12:16.820136+0000","last_undegraded":"2023-07-14T18:12:16.820136+0000","last_fullsized":"2023-07-14T18:12:16.820136+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:12.753466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:12.753466+0000","last_clean_scrub_stamp":"2023-07-14T18:11:12.753466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T04:35:56.383081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.9","version":"84'7","reported_seq":33,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T18:12:16.780010+0000","last_change":"2023-07-14T18:11:08.692719+0000","last_active":"2023-07-14T18:12:16.780010+0000","last_peered":"2023-07-14T18:12:16.780010+0000","last_clean":"2023-07-14T18:12:16.780010+0000","last_became_active":"2023-07-14T18:11:08.692390+0000","last_became_peered":"2023-07-14T18:11:08.692390+0000","last_unstale":"2023-07-14T18:12:16.780010+0000","last_undegraded":"2023-07-14T18:12:16.780010+0000","last_fullsized":"2023-07-14T18:12:16.780010+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:07.665746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:07.665746+0000","last_clean_scrub_stamp":"2023-07-14T18:11:07.665746+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T02:05:19.785021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"86'9","reported_seq":33,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T18:12:45.446489+0000","last_change":"2023-07-14T18:11:09.719176+0000","last_active":"2023-07-14T18:12:45.446489+0000","last_peered":"2023-07-14T18:12:45.446489+0000","last_clean":"2023-07-14T18:12:45.446489+0000","last_became_active":"2023-07-14T18:11:09.712667+0000","last_became_peered":"2023-07-14T18:11:09.712667+0000","last_unstale":"2023-07-14T18:12:45.446489+0000","last_undegraded":"2023-07-14T18:12:45.446489+0000","last_fullsized":"2023-07-14T18:12:45.446489+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_clean_scrub_stamp":"2023-07-14T18:11:08.667354+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T05:35:42.346860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.c","version":"84'1","reported_seq":18,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T18:12:16.782001+0000","last_change":"2023-07-14T18:11:13.791717+0000","last_active":"2023-07-14T18:12:16.782001+0000","last_peered":"2023-07-14T18:12:16.782001+0000","last_clean":"2023-07-14T18:12:16.782001+0000","last_became_active":"2023-07-14T18:11:13.791280+0000","last_became_peered":"2023-07-14T18:11:13.791280+0000","last_unstale":"2023-07-14T18:12:16.782001+0000","last_undegraded":"2023-07-14T18:12:16.782001+0000","last_fullsized":"2023-07-14T18:12:16.782001+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:12.753466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:12.753466+0000","last_clean_scrub_stamp":"2023-07-14T18:11:12.753466+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T03:27:09.430530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":123,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9,7,8],"acting":[4,9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"86'4","reported_seq":30,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T18:12:16.783186+0000","last_change":"2023-07-14T18:11:08.692842+0000","last_active":"2023-07-14T18:12:16.783186+0000","last_peered":"2023-07-14T18:12:16.783186+0000","last_clean":"2023-07-14T18:12:16.783186+0000","last_became_active":"2023-07-14T18:11:08.692534+0000","last_became_peered":"2023-07-14T18:11:08.692534+0000","last_unstale":"2023-07-14T18:12:16.783186+0000","last_undegraded":"2023-07-14T18:12:16.783186+0000","last_fullsized":"2023-07-14T18:12:16.783186+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:07.665746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:07.665746+0000","last_clean_scrub_stamp":"2023-07-14T18:11:07.665746+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:42:27.899061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"86'8","reported_seq":32,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T18:12:45.444887+0000","last_change":"2023-07-14T18:11:09.703665+0000","last_active":"2023-07-14T18:12:45.444887+0000","last_peered":"2023-07-14T18:12:45.444887+0000","last_clean":"2023-07-14T18:12:45.444887+0000","last_became_active":"2023-07-14T18:11:09.703288+0000","last_became_peered":"2023-07-14T18:11:09.703288+0000","last_unstale":"2023-07-14T18:12:45.444887+0000","last_undegraded":"2023-07-14T18:12:45.444887+0000","last_fullsized":"2023-07-14T18:12:45.444887+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_clean_scrub_stamp":"2023-07-14T18:11:08.667354+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T03:51:36.436982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T18:12:16.781732+0000","last_change":"2023-07-14T18:11:13.904604+0000","last_active":"2023-07-14T18:12:16.781732+0000","last_peered":"2023-07-14T18:12:16.781732+0000","last_clean":"2023-07-14T18:12:16.781732+0000","last_became_active":"2023-07-14T18:11:13.904245+0000","last_became_peered":"2023-07-14T18:11:13.904245+0000","last_unstale":"2023-07-14T18:12:16.781732+0000","last_undegraded":"2023-07-14T18:12:16.781732+0000","last_fullsized":"2023-07-14T18:12:16.781732+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:12.753466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:12.753466+0000","last_clean_scrub_stamp":"2023-07-14T18:11:12.753466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:25:41.179580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.b","version":"84'4","reported_seq":31,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T18:12:16.783387+0000","last_change":"2023-07-14T18:11:08.689876+0000","last_active":"2023-07-14T18:12:16.783387+0000","last_peered":"2023-07-14T18:12:16.783387+0000","last_clean":"2023-07-14T18:12:16.783387+0000","last_became_active":"2023-07-14T18:11:08.689582+0000","last_became_peered":"2023-07-14T18:11:08.689582+0000","last_unstale":"2023-07-14T18:12:16.783387+0000","last_undegraded":"2023-07-14T18:12:16.783387+0000","last_fullsized":"2023-07-14T18:12:16.783387+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:07.665746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:07.665746+0000","last_clean_scrub_stamp":"2023-07-14T18:11:07.665746+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:15:32.216414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"86'5","reported_seq":27,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T18:12:45.459728+0000","last_change":"2023-07-14T18:11:09.708228+0000","last_active":"2023-07-14T18:12:45.459728+0000","last_peered":"2023-07-14T18:12:45.459728+0000","last_clean":"2023-07-14T18:12:45.459728+0000","last_became_active":"2023-07-14T18:11:09.707985+0000","last_became_peered":"2023-07-14T18:11:09.707985+0000","last_unstale":"2023-07-14T18:12:45.459728+0000","last_undegraded":"2023-07-14T18:12:45.459728+0000","last_fullsized":"2023-07-14T18:12:45.459728+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_clean_scrub_stamp":"2023-07-14T18:11:08.667354+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:27:07.492845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":24,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T18:12:16.846372+0000","last_change":"2023-07-14T18:12:16.846372+0000","last_active":"2023-07-14T18:12:16.846372+0000","last_peered":"2023-07-14T18:12:16.846372+0000","last_clean":"2023-07-14T18:12:16.846372+0000","last_became_active":"2023-07-14T18:12:16.845694+0000","last_became_peered":"2023-07-14T18:12:16.845694+0000","last_unstale":"2023-07-14T18:12:16.846372+0000","last_undegraded":"2023-07-14T18:12:16.846372+0000","last_fullsized":"2023-07-14T18:12:16.846372+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:12.753466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:12.753466+0000","last_clean_scrub_stamp":"2023-07-14T18:11:12.753466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:47:51.174102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,6,7],"acting":[1,8,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.c","version":"86'6","reported_seq":115,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T18:12:48.885610+0000","last_change":"2023-07-14T18:11:08.689560+0000","last_active":"2023-07-14T18:12:48.885610+0000","last_peered":"2023-07-14T18:12:48.885610+0000","last_clean":"2023-07-14T18:12:48.885610+0000","last_became_active":"2023-07-14T18:11:08.689249+0000","last_became_peered":"2023-07-14T18:11:08.689249+0000","last_unstale":"2023-07-14T18:12:48.885610+0000","last_undegraded":"2023-07-14T18:12:48.885610+0000","last_fullsized":"2023-07-14T18:12:48.885610+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:07.665746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:07.665746+0000","last_clean_scrub_stamp":"2023-07-14T18:11:07.665746+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T02:27:36.887787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1621,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":83,"num_read_kb":3,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"86'7","reported_seq":29,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T18:12:45.459191+0000","last_change":"2023-07-14T18:11:09.720321+0000","last_active":"2023-07-14T18:12:45.459191+0000","last_peered":"2023-07-14T18:12:45.459191+0000","last_clean":"2023-07-14T18:12:45.459191+0000","last_became_active":"2023-07-14T18:11:09.720080+0000","last_became_peered":"2023-07-14T18:11:09.720080+0000","last_unstale":"2023-07-14T18:12:45.459191+0000","last_undegraded":"2023-07-14T18:12:45.459191+0000","last_fullsized":"2023-07-14T18:12:45.459191+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_clean_scrub_stamp":"2023-07-14T18:11:08.667354+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:26:11.524921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T18:12:16.782707+0000","last_change":"2023-07-14T18:11:13.779349+0000","last_active":"2023-07-14T18:12:16.782707+0000","last_peered":"2023-07-14T18:12:16.782707+0000","last_clean":"2023-07-14T18:12:16.782707+0000","last_became_active":"2023-07-14T18:11:13.778946+0000","last_became_peered":"2023-07-14T18:11:13.778946+0000","last_unstale":"2023-07-14T18:12:16.782707+0000","last_undegraded":"2023-07-14T18:12:16.782707+0000","last_fullsized":"2023-07-14T18:12:16.782707+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:12.753466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:12.753466+0000","last_clean_scrub_stamp":"2023-07-14T18:11:12.753466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T03:24:52.587800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9,1,4],"acting":[0,9,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"84'3","reported_seq":30,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T18:12:16.781388+0000","last_change":"2023-07-14T18:11:08.683760+0000","last_active":"2023-07-14T18:12:16.781388+0000","last_peered":"2023-07-14T18:12:16.781388+0000","last_clean":"2023-07-14T18:12:16.781388+0000","last_became_active":"2023-07-14T18:11:08.683461+0000","last_became_peered":"2023-07-14T18:11:08.683461+0000","last_unstale":"2023-07-14T18:12:16.781388+0000","last_undegraded":"2023-07-14T18:12:16.781388+0000","last_fullsized":"2023-07-14T18:12:16.781388+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:07.665746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:07.665746+0000","last_clean_scrub_stamp":"2023-07-14T18:11:07.665746+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T03:06:03.065563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"86'6","reported_seq":28,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T18:12:45.444674+0000","last_change":"2023-07-14T18:11:09.708701+0000","last_active":"2023-07-14T18:12:45.444674+0000","last_peered":"2023-07-14T18:12:45.444674+0000","last_clean":"2023-07-14T18:12:45.444674+0000","last_became_active":"2023-07-14T18:11:09.708410+0000","last_became_peered":"2023-07-14T18:11:09.708410+0000","last_unstale":"2023-07-14T18:12:45.444674+0000","last_undegraded":"2023-07-14T18:12:45.444674+0000","last_fullsized":"2023-07-14T18:12:45.444674+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_clean_scrub_stamp":"2023-07-14T18:11:08.667354+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T01:30:56.495611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T18:12:16.780683+0000","last_change":"2023-07-14T18:11:13.776584+0000","last_active":"2023-07-14T18:12:16.780683+0000","last_peered":"2023-07-14T18:12:16.780683+0000","last_clean":"2023-07-14T18:12:16.780683+0000","last_became_active":"2023-07-14T18:11:13.775288+0000","last_became_peered":"2023-07-14T18:11:13.775288+0000","last_unstale":"2023-07-14T18:12:16.780683+0000","last_undegraded":"2023-07-14T18:12:16.780683+0000","last_fullsized":"2023-07-14T18:12:16.780683+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:12.753466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:12.753466+0000","last_clean_scrub_stamp":"2023-07-14T18:11:12.753466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:11:20.760087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"84'5","reported_seq":31,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T18:12:16.785299+0000","last_change":"2023-07-14T18:11:08.687332+0000","last_active":"2023-07-14T18:12:16.785299+0000","last_peered":"2023-07-14T18:12:16.785299+0000","last_clean":"2023-07-14T18:12:16.785299+0000","last_became_active":"2023-07-14T18:11:08.686902+0000","last_became_peered":"2023-07-14T18:11:08.686902+0000","last_unstale":"2023-07-14T18:12:16.785299+0000","last_undegraded":"2023-07-14T18:12:16.785299+0000","last_fullsized":"2023-07-14T18:12:16.785299+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:07.665746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:07.665746+0000","last_clean_scrub_stamp":"2023-07-14T18:11:07.665746+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T01:01:07.005031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"86'9","reported_seq":31,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T18:12:45.444970+0000","last_change":"2023-07-14T18:11:09.719308+0000","last_active":"2023-07-14T18:12:45.444970+0000","last_peered":"2023-07-14T18:12:45.444970+0000","last_clean":"2023-07-14T18:12:45.444970+0000","last_became_active":"2023-07-14T18:11:09.719038+0000","last_became_peered":"2023-07-14T18:11:09.719038+0000","last_unstale":"2023-07-14T18:12:45.444970+0000","last_undegraded":"2023-07-14T18:12:45.444970+0000","last_fullsized":"2023-07-14T18:12:45.444970+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_clean_scrub_stamp":"2023-07-14T18:11:08.667354+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:07:46.868778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"86'9","reported_seq":33,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T18:12:45.446725+0000","last_change":"2023-07-14T18:11:09.710991+0000","last_active":"2023-07-14T18:12:45.446725+0000","last_peered":"2023-07-14T18:12:45.446725+0000","last_clean":"2023-07-14T18:12:45.446725+0000","last_became_active":"2023-07-14T18:11:09.710689+0000","last_became_peered":"2023-07-14T18:11:09.710689+0000","last_unstale":"2023-07-14T18:12:45.446725+0000","last_undegraded":"2023-07-14T18:12:45.446725+0000","last_fullsized":"2023-07-14T18:12:45.446725+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_clean_scrub_stamp":"2023-07-14T18:11:08.667354+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T02:50:07.310782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"86'12","reported_seq":36,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T18:12:45.455658+0000","last_change":"2023-07-14T18:11:09.711793+0000","last_active":"2023-07-14T18:12:45.455658+0000","last_peered":"2023-07-14T18:12:45.455658+0000","last_clean":"2023-07-14T18:12:45.455658+0000","last_became_active":"2023-07-14T18:11:09.711488+0000","last_became_peered":"2023-07-14T18:11:09.711488+0000","last_unstale":"2023-07-14T18:12:45.455658+0000","last_undegraded":"2023-07-14T18:12:45.455658+0000","last_fullsized":"2023-07-14T18:12:45.455658+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_clean_scrub_stamp":"2023-07-14T18:11:08.667354+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:55:49.699586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"86'8","reported_seq":32,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T18:12:45.447129+0000","last_change":"2023-07-14T18:11:09.707835+0000","last_active":"2023-07-14T18:12:45.447129+0000","last_peered":"2023-07-14T18:12:45.447129+0000","last_clean":"2023-07-14T18:12:45.447129+0000","last_became_active":"2023-07-14T18:11:09.706863+0000","last_became_peered":"2023-07-14T18:11:09.706863+0000","last_unstale":"2023-07-14T18:12:45.447129+0000","last_undegraded":"2023-07-14T18:12:45.447129+0000","last_fullsized":"2023-07-14T18:12:45.447129+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_clean_scrub_stamp":"2023-07-14T18:11:08.667354+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T03:37:49.528129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"86'7","reported_seq":31,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T18:12:45.447310+0000","last_change":"2023-07-14T18:11:09.714879+0000","last_active":"2023-07-14T18:12:45.447310+0000","last_peered":"2023-07-14T18:12:45.447310+0000","last_clean":"2023-07-14T18:12:45.447310+0000","last_became_active":"2023-07-14T18:11:09.714583+0000","last_became_peered":"2023-07-14T18:11:09.714583+0000","last_unstale":"2023-07-14T18:12:45.447310+0000","last_undegraded":"2023-07-14T18:12:45.447310+0000","last_fullsized":"2023-07-14T18:12:45.447310+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_clean_scrub_stamp":"2023-07-14T18:11:08.667354+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:17:18.081609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"86'4","reported_seq":28,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T18:12:45.451968+0000","last_change":"2023-07-14T18:11:09.710850+0000","last_active":"2023-07-14T18:12:45.451968+0000","last_peered":"2023-07-14T18:12:45.451968+0000","last_clean":"2023-07-14T18:12:45.451968+0000","last_became_active":"2023-07-14T18:11:09.710533+0000","last_became_peered":"2023-07-14T18:11:09.710533+0000","last_unstale":"2023-07-14T18:12:45.451968+0000","last_undegraded":"2023-07-14T18:12:45.451968+0000","last_fullsized":"2023-07-14T18:12:45.451968+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_clean_scrub_stamp":"2023-07-14T18:11:08.667354+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:14:51.244833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"86'6","reported_seq":36,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T18:12:45.440899+0000","last_change":"2023-07-14T18:12:16.821049+0000","last_active":"2023-07-14T18:12:45.440899+0000","last_peered":"2023-07-14T18:12:45.440899+0000","last_clean":"2023-07-14T18:12:45.440899+0000","last_became_active":"2023-07-14T18:12:16.820665+0000","last_became_peered":"2023-07-14T18:12:16.820665+0000","last_unstale":"2023-07-14T18:12:45.440899+0000","last_undegraded":"2023-07-14T18:12:45.440899+0000","last_fullsized":"2023-07-14T18:12:45.440899+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_clean_scrub_stamp":"2023-07-14T18:11:08.667354+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:30:07.485544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,9],"acting":[11,8,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"86'15","reported_seq":39,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T18:12:45.458860+0000","last_change":"2023-07-14T18:11:09.709062+0000","last_active":"2023-07-14T18:12:45.458860+0000","last_peered":"2023-07-14T18:12:45.458860+0000","last_clean":"2023-07-14T18:12:45.458860+0000","last_became_active":"2023-07-14T18:11:09.708767+0000","last_became_peered":"2023-07-14T18:11:09.708767+0000","last_unstale":"2023-07-14T18:12:45.458860+0000","last_undegraded":"2023-07-14T18:12:45.458860+0000","last_fullsized":"2023-07-14T18:12:45.458860+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_clean_scrub_stamp":"2023-07-14T18:11:08.667354+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:39:06.654097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"86'2","reported_seq":32,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T18:12:45.443758+0000","last_change":"2023-07-14T18:12:16.787468+0000","last_active":"2023-07-14T18:12:45.443758+0000","last_peered":"2023-07-14T18:12:45.443758+0000","last_clean":"2023-07-14T18:12:45.443758+0000","last_became_active":"2023-07-14T18:12:16.786920+0000","last_became_peered":"2023-07-14T18:12:16.786920+0000","last_unstale":"2023-07-14T18:12:45.443758+0000","last_undegraded":"2023-07-14T18:12:45.443758+0000","last_fullsized":"2023-07-14T18:12:45.443758+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_clean_scrub_stamp":"2023-07-14T18:11:08.667354+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:58:18.718547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,8,2],"acting":[3,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"86'6","reported_seq":30,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T18:12:45.442021+0000","last_change":"2023-07-14T18:11:09.709710+0000","last_active":"2023-07-14T18:12:45.442021+0000","last_peered":"2023-07-14T18:12:45.442021+0000","last_clean":"2023-07-14T18:12:45.442021+0000","last_became_active":"2023-07-14T18:11:09.709438+0000","last_became_peered":"2023-07-14T18:11:09.709438+0000","last_unstale":"2023-07-14T18:12:45.442021+0000","last_undegraded":"2023-07-14T18:12:45.442021+0000","last_fullsized":"2023-07-14T18:12:45.442021+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_clean_scrub_stamp":"2023-07-14T18:11:08.667354+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T01:54:00.369337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"86'8","reported_seq":32,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T18:12:45.443921+0000","last_change":"2023-07-14T18:11:09.720216+0000","last_active":"2023-07-14T18:12:45.443921+0000","last_peered":"2023-07-14T18:12:45.443921+0000","last_clean":"2023-07-14T18:12:45.443921+0000","last_became_active":"2023-07-14T18:11:09.719775+0000","last_became_peered":"2023-07-14T18:11:09.719775+0000","last_unstale":"2023-07-14T18:12:45.443921+0000","last_undegraded":"2023-07-14T18:12:45.443921+0000","last_fullsized":"2023-07-14T18:12:45.443921+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_clean_scrub_stamp":"2023-07-14T18:11:08.667354+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:43:40.113898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"86'10","reported_seq":34,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T18:12:45.458305+0000","last_change":"2023-07-14T18:11:09.708462+0000","last_active":"2023-07-14T18:12:45.458305+0000","last_peered":"2023-07-14T18:12:45.458305+0000","last_clean":"2023-07-14T18:12:45.458305+0000","last_became_active":"2023-07-14T18:11:09.705611+0000","last_became_peered":"2023-07-14T18:11:09.705611+0000","last_unstale":"2023-07-14T18:12:45.458305+0000","last_undegraded":"2023-07-14T18:12:45.458305+0000","last_fullsized":"2023-07-14T18:12:45.458305+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_clean_scrub_stamp":"2023-07-14T18:11:08.667354+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T02:02:51.560219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"86'11","reported_seq":35,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T18:12:45.447550+0000","last_change":"2023-07-14T18:11:09.707560+0000","last_active":"2023-07-14T18:12:45.447550+0000","last_peered":"2023-07-14T18:12:45.447550+0000","last_clean":"2023-07-14T18:12:45.447550+0000","last_became_active":"2023-07-14T18:11:09.707216+0000","last_became_peered":"2023-07-14T18:11:09.707216+0000","last_unstale":"2023-07-14T18:12:45.447550+0000","last_undegraded":"2023-07-14T18:12:45.447550+0000","last_fullsized":"2023-07-14T18:12:45.447550+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_clean_scrub_stamp":"2023-07-14T18:11:08.667354+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:03:49.501892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"86'8","reported_seq":32,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T18:12:45.455791+0000","last_change":"2023-07-14T18:11:09.712059+0000","last_active":"2023-07-14T18:12:45.455791+0000","last_peered":"2023-07-14T18:12:45.455791+0000","last_clean":"2023-07-14T18:12:45.455791+0000","last_became_active":"2023-07-14T18:11:09.711759+0000","last_became_peered":"2023-07-14T18:11:09.711759+0000","last_unstale":"2023-07-14T18:12:45.455791+0000","last_undegraded":"2023-07-14T18:12:45.455791+0000","last_fullsized":"2023-07-14T18:12:45.455791+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_clean_scrub_stamp":"2023-07-14T18:11:08.667354+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:13:46.454186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":246,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":32768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":500,"ondisk_log_size":500,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4157440,"data_stored":4132576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":70342,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":824,"num_read_kb":489,"num_write":250,"num_write_kb":148,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":573440,"data_stored":219666,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":220,"ondisk_log_size":220,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":75,"seq":322122547232,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27964,"kb_used_data":948,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717188,"statfs":{"total":95995035648,"available":95966400512,"internally_reserved":0,"allocated":970752,"data_stored":474379,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 18:12:34 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.55400000000000005,"15min":0.55800000000000005},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.42499999999999999},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.57999999999999996,"15min":0.58199999999999996},"min":{"1min":0.41999999999999998,"5min":0.315,"15min":0.315},"max":{"1min":0.75800000000000001,"5min":0.85099999999999998,"15min":0.85099999999999998},"last":0.46500000000000002}]},{"osd":1,"last update":"Fri Jul 14 18:12:34 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.64300000000000002,"15min":0.64100000000000001},"min":{"1min":0.46300000000000002,"5min":0.439,"15min":0.439},"max":{"1min":0.78600000000000003,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.67700000000000005,"5min":0.64800000000000002,"15min":0.64300000000000002},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.83899999999999997,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.67000000000000004}]},{"osd":2,"last update":"Fri Jul 14 18:12:34 2023","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.54100000000000004,"15min":0.54900000000000004},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.749,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.501,"5min":0.53500000000000003,"15min":0.54100000000000004},"min":{"1min":0.39200000000000002,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.63500000000000001,"5min":0.69899999999999995,"15min":0.69899999999999995},"last":0.39900000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35399999999999998}]},{"osd":4,"last update":"Fri Jul 14 18:12:34 2023","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.68600000000000005,"15min":0.68500000000000005},"min":{"1min":0.55800000000000005,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.88800000000000001,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.72199999999999998,"15min":0.72799999999999998},"min":{"1min":0.57999999999999996,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":0.89300000000000002,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.72999999999999998}]},{"osd":5,"last update":"Fri Jul 14 18:12:34 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.63300000000000001,"15min":0.63700000000000001},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.65000000000000002},{"interface":"front","average":{"1min":0.623,"5min":0.628,"15min":0.629},"min":{"1min":0.44700000000000001,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.85599999999999998,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.58699999999999997}]},{"osd":6,"last update":"Fri Jul 14 18:12:34 2023","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.70399999999999996,"15min":0.70599999999999996},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":1.048,"5min":1.048,"15min":1.048},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.746,"15min":0.748},"min":{"1min":0.54600000000000004,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.71199999999999997}]},{"osd":7,"last update":"Fri Jul 14 18:12:34 2023","interfaces":[{"interface":"back","average":{"1min":0.73799999999999999,"5min":0.75900000000000001,"15min":0.76300000000000001},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":0.92000000000000004,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.78000000000000003,"5min":0.79200000000000004,"15min":0.79400000000000004},"min":{"1min":0.56100000000000005,"5min":0.496,"15min":0.496},"max":{"1min":0.95599999999999996,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.76200000000000001}]},{"osd":8,"last update":"Fri Jul 14 18:12:14 2023","interfaces":[{"interface":"back","average":{"1min":0.747,"5min":0.747,"15min":0.747},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":1.038,"5min":1.038,"15min":1.038},"last":0.82199999999999995},{"interface":"front","average":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"min":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":0.98999999999999999,"5min":0.98999999999999999,"15min":0.98999999999999999},"last":0.77900000000000003}]},{"osd":9,"last update":"Fri Jul 14 18:12:34 2023","interfaces":[{"interface":"back","average":{"1min":0.81799999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"min":{"1min":0.61799999999999999,"5min":0.498,"15min":0.498},"max":{"1min":1.0089999999999999,"5min":1.1419999999999999,"15min":1.1419999999999999},"last":0.747},{"interface":"front","average":{"1min":0.77600000000000002,"5min":0.80200000000000005,"15min":0.80600000000000005},"min":{"1min":0.53100000000000003,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":0.96299999999999997,"5min":1.042,"15min":1.042},"last":0.69699999999999995}]},{"osd":10,"last update":"Fri Jul 14 18:12:34 2023","interfaces":[{"interface":"back","average":{"1min":0.84299999999999997,"5min":0.83499999999999996,"15min":0.83399999999999996},"min":{"1min":0.69499999999999995,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.0129999999999999,"5min":1.0800000000000001,"15min":1.0800000000000001},"last":0.79200000000000004},{"interface":"front","average":{"1min":0.83999999999999997,"5min":0.85199999999999998,"15min":0.85399999999999998},"min":{"1min":0.65700000000000003,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":0.99299999999999999,"5min":1.177,"15min":1.177},"last":0.80600000000000005}]}]},{"osd":10,"up_from":68,"seq":292057776163,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28636,"kb_used_data":1620,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716516,"statfs":{"total":95995035648,"available":95965712384,"internally_reserved":0,"allocated":1658880,"data_stored":1122980,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 18:12:09 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"last":0.40799999999999997}]},{"osd":1,"last update":"Fri Jul 14 18:12:14 2023","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.45600000000000002,"15min":0.44900000000000001},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.64600000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"last":0.502},{"interface":"front","average":{"1min":0.496,"5min":0.49199999999999999,"15min":0.49199999999999999},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.69299999999999995,"5min":0.71099999999999997,"15min":0.71099999999999997},"last":0.44400000000000001}]},{"osd":2,"last update":"Fri Jul 14 18:12:14 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.63200000000000001,"15min":0.63200000000000001},"min":{"1min":0.47999999999999998,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.89700000000000002,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.71799999999999997},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.61399999999999999,"15min":0.60499999999999998},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.83599999999999997,"5min":0.84799999999999998,"15min":0.84799999999999998},"last":0.54600000000000004}]},{"osd":3,"last update":"Fri Jul 14 18:12:14 2023","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.626,"15min":0.64600000000000002},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.622,"5min":0.96099999999999997,"15min":0.96099999999999997},"last":0.47499999999999998},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.65600000000000003,"15min":0.66400000000000003},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.78700000000000003,"5min":0.95099999999999996,"15min":0.95099999999999996},"last":0.60299999999999998}]},{"osd":4,"last update":"Fri Jul 14 18:12:14 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.86799999999999999,"5min":0.86799999999999999,"15min":0.86799999999999999},"last":0.68400000000000005},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.57699999999999996,"15min":0.58299999999999996},"min":{"1min":0.42899999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.745,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.627}]},{"osd":5,"last update":"Fri Jul 14 18:12:14 2023","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.71199999999999997,"15min":0.71599999999999997},"min":{"1min":0.52400000000000002,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.81599999999999995,"5min":1.0049999999999999,"15min":1.0049999999999999},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.69199999999999995,"15min":0.68400000000000005},"min":{"1min":0.58399999999999996,"5min":0.438,"15min":0.438},"max":{"1min":0.93100000000000005,"5min":0.93100000000000005,"15min":0.93100000000000005},"last":0.66300000000000003}]},{"osd":6,"last update":"Fri Jul 14 18:12:14 2023","interfaces":[{"interface":"back","average":{"1min":0.64900000000000002,"5min":0.69699999999999995,"15min":0.70499999999999996},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.878,"5min":1.004,"15min":1.004},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.748,"15min":0.75600000000000001},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":0.91200000000000003,"5min":1.1040000000000001,"15min":1.1040000000000001},"last":0.73699999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49399999999999999}]},{"osd":8,"last update":"Fri Jul 14 18:12:14 2023","interfaces":[{"interface":"back","average":{"1min":0.75900000000000001,"5min":0.754,"15min":0.753},"min":{"1min":0.51300000000000001,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.96599999999999997,"5min":1.038,"15min":1.038},"last":0.80100000000000005},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.78900000000000003,"15min":0.79900000000000004},"min":{"1min":0.57699999999999996,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":0.86399999999999999,"5min":1.0820000000000001,"15min":1.0820000000000001},"last":0.75900000000000001}]},{"osd":9,"last update":"Fri Jul 14 18:12:14 2023","interfaces":[{"interface":"back","average":{"1min":0.84199999999999997,"5min":0.80500000000000005,"15min":0.79900000000000004},"min":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"max":{"1min":2.5649999999999999,"5min":2.5649999999999999,"15min":2.5649999999999999},"last":0.76800000000000002},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.81399999999999995,"15min":0.83699999999999997},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":0.89600000000000002,"5min":1.228,"15min":1.228},"last":0.78300000000000003}]},{"osd":11,"last update":"Fri Jul 14 18:12:32 2023","interfaces":[{"interface":"back","average":{"1min":0.77500000000000002,"5min":0.78500000000000003,"15min":0.78700000000000003},"min":{"1min":0.66300000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":0.95799999999999996,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.70499999999999996},{"interface":"front","average":{"1min":0.80300000000000005,"5min":0.81100000000000005,"15min":0.81299999999999994},"min":{"1min":0.65100000000000002,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":0.98999999999999999,"5min":1.0309999999999999,"15min":1.0309999999999999},"last":0.82999999999999996}]}]},{"osd":9,"up_from":63,"seq":270582939688,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27992,"kb_used_data":976,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717160,"statfs":{"total":95995035648,"available":95966371840,"internally_reserved":0,"allocated":999424,"data_stored":477954,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 18:11:50 2023","interfaces":[{"interface":"back","average":{"1min":0.35299999999999998,"5min":0.41299999999999998,"15min":0.42299999999999999},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.622,"5min":0.63200000000000001,"15min":0.63200000000000001},"last":0.34399999999999997},{"interface":"front","average":{"1min":0.37,"5min":0.432,"15min":0.442},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.57499999999999996,"5min":0.68899999999999995,"15min":0.68899999999999995},"last":0.371}]},{"osd":1,"last update":"Fri Jul 14 18:11:50 2023","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.57599999999999996,"15min":0.58399999999999996},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.93100000000000005,"5min":0.94099999999999995,"15min":0.94099999999999995},"last":0.69399999999999995},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.59499999999999997,"15min":0.60499999999999998},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.73999999999999999,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.623}]},{"osd":2,"last update":"Fri Jul 14 18:11:50 2023","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.59799999999999998,"15min":0.60599999999999998},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.81200000000000006,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.61799999999999999,"15min":0.627},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.76100000000000001,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.65800000000000003}]},{"osd":3,"last update":"Fri Jul 14 18:11:50 2023","interfaces":[{"interface":"back","average":{"1min":0.40600000000000003,"5min":0.51300000000000001,"15min":0.53100000000000003},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.64200000000000002,"5min":0.75700000000000001,"15min":0.75700000000000001},"last":0.312},{"interface":"front","average":{"1min":0.40699999999999997,"5min":0.51300000000000001,"15min":0.53100000000000003},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":0.58499999999999996,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.39300000000000002}]},{"osd":4,"last update":"Fri Jul 14 18:11:50 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.65900000000000003,"15min":0.67800000000000005},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.84299999999999997,"5min":0.95499999999999996,"15min":0.95499999999999996},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.64900000000000002,"15min":0.65900000000000003},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.90300000000000002,"5min":1,"15min":1},"last":0.72999999999999998}]},{"osd":5,"last update":"Fri Jul 14 18:11:50 2023","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.68000000000000005,"15min":0.69499999999999995},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.80300000000000005,"5min":1.093,"15min":1.093},"last":0.63700000000000001},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.67800000000000005,"15min":0.69399999999999995},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.89100000000000001,"5min":1.1100000000000001,"15min":1.1100000000000001},"last":0.71999999999999997}]},{"osd":6,"last update":"Fri Jul 14 18:10:48 2023","interfaces":[{"interface":"back","average":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":1.069,"5min":1.069,"15min":1.069},"last":0.45800000000000002},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":1.0409999999999999,"5min":1.0409999999999999,"15min":1.0409999999999999},"last":0.57799999999999996}]},{"osd":7,"last update":"Fri Jul 14 18:11:50 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.71199999999999997,"15min":0.72899999999999998},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.92500000000000004,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.71699999999999997,"15min":0.73599999999999999},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.85399999999999998,"5min":1.1890000000000001,"15min":1.1890000000000001},"last":0.64700000000000002}]},{"osd":8,"last update":"Fri Jul 14 18:11:50 2023","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.74399999999999999,"15min":0.76200000000000001},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.79900000000000004,"5min":1.127,"15min":1.127},"last":0.70799999999999996},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.75700000000000001,"15min":0.77500000000000002},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":0.86699999999999999,"5min":1.167,"15min":1.167},"last":0.61399999999999999}]},{"osd":10,"last update":"Fri Jul 14 18:12:09 2023","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.68500000000000005,"15min":0.69099999999999995},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.88,"5min":0.99099999999999999,"15min":0.99099999999999999},"last":0.74099999999999999},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.69899999999999995,"15min":0.70499999999999996},"min":{"1min":0.54900000000000004,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":0.94199999999999995,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":0.55500000000000005}]},{"osd":11,"last update":"Fri Jul 14 18:12:13 2023","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"min":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"last":0.68600000000000005},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.0229999999999999,"5min":1.0229999999999999,"15min":1.0229999999999999},"last":0.754}]}]},{"osd":8,"up_from":56,"seq":240518168621,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27980,"kb_used_data":964,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717172,"statfs":{"total":95995035648,"available":95966384128,"internally_reserved":0,"allocated":987136,"data_stored":473955,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 18:12:33 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.54900000000000004,"15min":0.54500000000000004},"min":{"1min":0.441,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.73499999999999999,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.52800000000000002,"15min":0.52300000000000002},"min":{"1min":0.41199999999999998,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.72099999999999997,"5min":0.78200000000000003,"15min":0.78200000000000003},"last":0.50600000000000001}]},{"osd":1,"last update":"Fri Jul 14 18:12:33 2023","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.628,"15min":0.61499999999999999},"min":{"1min":0.50900000000000001,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.90200000000000002,"5min":1.036,"15min":1.036},"last":0.74099999999999999},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.64500000000000002,"15min":0.63500000000000001},"min":{"1min":0.55600000000000005,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.90800000000000003,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.69899999999999995}]},{"osd":2,"last update":"Fri Jul 14 18:12:33 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.48299999999999998,"15min":0.46000000000000002},"min":{"1min":0.39100000000000001,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.80300000000000005,"5min":1.032,"15min":1.032},"last":0.45600000000000002},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.49099999999999999,"15min":0.47799999999999998},"min":{"1min":0.38500000000000001,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.81999999999999995,"5min":1.0449999999999999,"15min":1.0449999999999999},"last":0.56799999999999995}]},{"osd":3,"last update":"Fri Jul 14 18:12:33 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.58099999999999996,"15min":0.58399999999999996},"min":{"1min":0.433,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.60299999999999998,"15min":0.59499999999999997},"min":{"1min":0.438,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.97599999999999998,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.53700000000000003}]},{"osd":4,"last update":"Fri Jul 14 18:12:33 2023","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.68400000000000005,"15min":0.65400000000000003},"min":{"1min":0.60899999999999999,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":1.0189999999999999,"5min":2.5030000000000001,"15min":2.5030000000000001},"last":0.65900000000000003},{"interface":"front","average":{"1min":0.746,"5min":0.66100000000000003,"15min":0.64300000000000002},"min":{"1min":0.52800000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":1.0069999999999999,"5min":1.0069999999999999,"15min":1.0069999999999999},"last":0.63900000000000001}]},{"osd":5,"last update":"Fri Jul 14 18:12:33 2023","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.60699999999999998,"15min":0.59199999999999997},"min":{"1min":0.41699999999999998,"5min":0.316,"15min":0.316},"max":{"1min":1.0189999999999999,"5min":1.0189999999999999,"15min":1.0189999999999999},"last":0.622},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.61399999999999999,"15min":0.60399999999999998},"min":{"1min":0.46899999999999997,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.72299999999999998}]},{"osd":6,"last update":"Fri Jul 14 18:12:33 2023","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.69199999999999995,"15min":0.68000000000000005},"min":{"1min":0.61299999999999999,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":1.006,"5min":1.006,"15min":1.006},"last":0.68300000000000005},{"interface":"front","average":{"1min":0.77200000000000002,"5min":0.71099999999999997,"15min":0.70699999999999996},"min":{"1min":0.53400000000000003,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.98999999999999999,"5min":1.008,"15min":1.008},"last":0.76700000000000002}]},{"osd":7,"last update":"Fri Jul 14 18:12:33 2023","interfaces":[{"interface":"back","average":{"1min":0.81699999999999995,"5min":0.75900000000000001,"15min":0.72799999999999998},"min":{"1min":0.64300000000000002,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":1.0349999999999999,"5min":2.5550000000000002,"15min":2.5550000000000002},"last":0.82199999999999995},{"interface":"front","average":{"1min":0.82699999999999996,"5min":0.74099999999999999,"15min":0.72299999999999998},"min":{"1min":0.71799999999999997,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.125,"5min":1.125,"15min":1.125},"last":0.83199999999999996}]},{"osd":9,"last update":"Fri Jul 14 18:11:50 2023","interfaces":[{"interface":"back","average":{"1min":0.80800000000000005,"5min":0.70499999999999996,"15min":0.68799999999999994},"min":{"1min":0.57099999999999995,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.0609999999999999,"5min":1.0609999999999999,"15min":1.0609999999999999},"last":0.78800000000000003},{"interface":"front","average":{"1min":0.94699999999999995,"5min":0.745,"15min":0.71099999999999997},"min":{"1min":0.56299999999999994,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":2.5339999999999998,"5min":2.5339999999999998,"15min":2.5339999999999998},"last":0.79600000000000004}]},{"osd":10,"last update":"Fri Jul 14 18:12:11 2023","interfaces":[{"interface":"back","average":{"1min":0.875,"5min":0.75900000000000001,"15min":0.73999999999999999},"min":{"1min":0.77600000000000002,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.0740000000000001,"5min":1.0740000000000001,"15min":1.0740000000000001},"last":0.85999999999999999},{"interface":"front","average":{"1min":0.91900000000000004,"5min":0.77900000000000003,"15min":0.75600000000000001},"min":{"1min":0.79200000000000004,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.115,"5min":1.115,"15min":1.115},"last":0.873}]},{"osd":11,"last update":"Fri Jul 14 18:12:11 2023","interfaces":[{"interface":"back","average":{"1min":0.86099999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"min":{"1min":0.623,"5min":0.623,"15min":0.623},"max":{"1min":1.101,"5min":1.101,"15min":1.101},"last":0.81100000000000005},{"interface":"front","average":{"1min":0.88600000000000001,"5min":0.88600000000000001,"15min":0.88600000000000001},"min":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":1.089,"5min":1.089,"15min":1.089},"last":0.84599999999999997}]}]},{"osd":7,"up_from":49,"seq":210453397552,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28568,"kb_used_data":1552,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716584,"statfs":{"total":95995035648,"available":95965782016,"internally_reserved":0,"allocated":1589248,"data_stored":1072226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 18:11:06 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.55300000000000005,"15min":0.54600000000000004},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"last":0.38400000000000001},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"min":{"1min":0.35599999999999998,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.77900000000000003,"5min":0.84299999999999997,"15min":0.84299999999999997},"last":0.35599999999999998}]},{"osd":1,"last update":"Fri Jul 14 18:12:06 2023","interfaces":[{"interface":"back","average":{"1min":0.42499999999999999,"5min":0.42199999999999999,"15min":0.41499999999999998},"min":{"1min":0.29599999999999999,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.56100000000000005,"5min":0.751,"15min":0.751},"last":0.39200000000000002},{"interface":"front","average":{"1min":0.46200000000000002,"5min":0.44600000000000001,"15min":0.442},"min":{"1min":0.28000000000000003,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.70599999999999996,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.432}]},{"osd":2,"last update":"Fri Jul 14 18:12:06 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.58999999999999997,"15min":0.58499999999999996},"min":{"1min":0.35299999999999998,"5min":0.313,"15min":0.313},"max":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"last":0.70899999999999996},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.61299999999999999,"15min":0.61499999999999999},"min":{"1min":0.436,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.75800000000000001,"5min":0.81499999999999995,"15min":0.81499999999999995},"last":0.69499999999999995}]},{"osd":3,"last update":"Fri Jul 14 18:12:06 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.56499999999999995,"15min":0.56200000000000006},"min":{"1min":0.41899999999999998,"5min":0.379,"15min":0.379},"max":{"1min":0.877,"5min":0.877,"15min":0.877},"last":0.51500000000000001},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.60499999999999998,"15min":0.59899999999999998},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.84799999999999998,"5min":0.88100000000000001,"15min":0.88100000000000001},"last":0.55600000000000005}]},{"osd":4,"last update":"Fri Jul 14 18:12:06 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.52700000000000002,"15min":0.52100000000000002},"min":{"1min":0.36099999999999999,"5min":0.316,"15min":0.316},"max":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.47999999999999998,"5min":0.49199999999999999,"15min":0.499},"min":{"1min":0.309,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.65800000000000003,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.46100000000000002}]},{"osd":5,"last update":"Fri Jul 14 18:12:06 2023","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.65700000000000003,"15min":0.66400000000000003},"min":{"1min":0.503,"5min":0.373,"15min":0.373},"max":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"last":0.65600000000000003},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.65500000000000003,"15min":0.65500000000000003},"min":{"1min":0.51700000000000002,"5min":0.38,"15min":0.38},"max":{"1min":0.89200000000000002,"5min":0.89200000000000002,"15min":0.89200000000000002},"last":0.745}]},{"osd":6,"last update":"Fri Jul 14 18:12:06 2023","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.67100000000000004,"15min":0.66700000000000004},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":0.90700000000000003,"5min":0.90700000000000003,"15min":0.90700000000000003},"last":0.67600000000000005},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.65200000000000002,"15min":0.66800000000000004},"min":{"1min":0.373,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.84499999999999997,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.57499999999999996}]},{"osd":8,"last update":"Fri Jul 14 18:12:28 2023","interfaces":[{"interface":"back","average":{"1min":0.77100000000000002,"5min":0.72199999999999998,"15min":0.71299999999999997},"min":{"1min":0.59199999999999997,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":0.997,"5min":0.997,"15min":0.997},"last":0.78600000000000003},{"interface":"front","average":{"1min":0.747,"5min":0.69099999999999995,"15min":0.68400000000000005},"min":{"1min":0.58499999999999996,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.88300000000000001,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.77200000000000002}]},{"osd":9,"last update":"Fri Jul 14 18:11:52 2023","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.66800000000000004,"15min":0.66900000000000004},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.90800000000000003,"5min":0.90800000000000003,"15min":0.90800000000000003},"last":0.79800000000000004},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.747,"15min":0.753},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":0.90800000000000003,"5min":1.0189999999999999,"15min":1.0189999999999999},"last":0.73299999999999998}]},{"osd":10,"last update":"Fri Jul 14 18:12:09 2023","interfaces":[{"interface":"back","average":{"1min":0.751,"5min":0.74199999999999999,"15min":0.73999999999999999},"min":{"1min":0.503,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.024,"5min":1.046,"15min":1.046},"last":0.75800000000000001},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.66100000000000003,"15min":0.65100000000000002},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.878,"5min":0.89500000000000002,"15min":0.89500000000000002},"last":0.63400000000000001}]},{"osd":11,"last update":"Fri Jul 14 18:12:09 2023","interfaces":[{"interface":"back","average":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"min":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"max":{"1min":0.95199999999999996,"5min":0.95199999999999996,"15min":0.95199999999999996},"last":0.82599999999999996},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":0.93400000000000005,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.81100000000000005}]}]},{"osd":6,"up_from":44,"seq":188978561077,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27964,"kb_used_data":948,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717188,"statfs":{"total":95995035648,"available":95966400512,"internally_reserved":0,"allocated":970752,"data_stored":469813,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 18:12:47 2023","interfaces":[{"interface":"back","average":{"1min":0.377,"5min":0.39500000000000002,"15min":0.39500000000000002},"min":{"1min":0.28100000000000003,"5min":0.217,"15min":0.217},"max":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.40300000000000002},{"interface":"front","average":{"1min":0.40899999999999997,"5min":0.41599999999999998,"15min":0.40999999999999998},"min":{"1min":0.27600000000000002,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.64800000000000002,"5min":0.71899999999999997,"15min":0.71899999999999997},"last":0.41999999999999998}]},{"osd":1,"last update":"Fri Jul 14 18:12:47 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.57399999999999995,"15min":0.54200000000000004},"min":{"1min":0.38,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.96899999999999997,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.51600000000000001,"5min":0.53600000000000003,"15min":0.51200000000000001},"min":{"1min":0.379,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.97699999999999998,"5min":1.048,"15min":1.048},"last":0.45900000000000002}]},{"osd":2,"last update":"Fri Jul 14 18:12:47 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.59399999999999997,"15min":0.57999999999999996},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.82799999999999996,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.64700000000000002},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.57799999999999996,"15min":0.57999999999999996},"min":{"1min":0.38,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"last":0.59599999999999997}]},{"osd":3,"last update":"Fri Jul 14 18:12:47 2023","interfaces":[{"interface":"back","average":{"1min":0.38300000000000001,"5min":0.434,"15min":0.439},"min":{"1min":0.30299999999999999,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.625,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.38500000000000001},{"interface":"front","average":{"1min":0.46800000000000003,"5min":0.496,"15min":0.48999999999999999},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.68999999999999995,"5min":0.83399999999999996,"15min":0.83399999999999996},"last":0.53400000000000003}]},{"osd":4,"last update":"Fri Jul 14 18:12:47 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.622,"15min":0.60999999999999999},"min":{"1min":0.42199999999999999,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.93100000000000005,"5min":1.087,"15min":1.087},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.58799999999999997,"15min":0.57199999999999995},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.93999999999999995,"5min":1.014,"15min":1.014},"last":0.51500000000000001}]},{"osd":5,"last update":"Fri Jul 14 18:12:47 2023","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.66900000000000004,"15min":0.67100000000000004},"min":{"1min":0.42099999999999999,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.92100000000000004,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.69399999999999995,"15min":0.69599999999999995},"min":{"1min":0.46200000000000002,"5min":0.443,"15min":0.443},"max":{"1min":0.98599999999999999,"5min":0.98599999999999999,"15min":0.98599999999999999},"last":0.67200000000000004}]},{"osd":7,"last update":"Fri Jul 14 18:12:13 2023","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.67000000000000004,"15min":0.66600000000000004},"min":{"1min":0.5,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.86099999999999999,"5min":1.03,"15min":1.03},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.70599999999999996,"15min":0.70399999999999996},"min":{"1min":0.50600000000000001,"5min":0.443,"15min":0.443},"max":{"1min":0.93100000000000005,"5min":1.0700000000000001,"15min":1.0700000000000001},"last":0.69999999999999996}]},{"osd":8,"last update":"Fri Jul 14 18:12:31 2023","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.74299999999999999,"15min":0.76900000000000002},"min":{"1min":0.46300000000000002,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.95599999999999996,"5min":0.99399999999999999,"15min":0.99399999999999999},"last":0.72699999999999998},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.66700000000000004,"15min":0.68899999999999995},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.94499999999999995,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.622}]},{"osd":9,"last update":"Fri Jul 14 18:11:52 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.72499999999999998,"15min":0.74299999999999999},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.88700000000000001,"5min":1.0449999999999999,"15min":1.0449999999999999},"last":0.73699999999999999},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.76100000000000001,"15min":0.78300000000000003},"min":{"1min":0.505,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.80800000000000005,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.747}]},{"osd":10,"last update":"Fri Jul 14 18:12:13 2023","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.69899999999999995,"15min":0.70499999999999996},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.879,"5min":1.026,"15min":1.026},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.746,"15min":0.752},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":0.97099999999999997,"5min":0.99399999999999999,"15min":0.99399999999999999},"last":0.68400000000000005}]},{"osd":11,"last update":"Fri Jul 14 18:12:13 2023","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.755,"15min":0.755},"min":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":1.002,"5min":1.002,"15min":1.002},"last":0.71699999999999997},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"min":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"max":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.77700000000000002}]}]},{"osd":1,"up_from":13,"seq":55834574921,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28028,"kb_used_data":1012,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717124,"statfs":{"total":95995035648,"available":95966334976,"internally_reserved":0,"allocated":1036288,"data_stored":536475,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 18:12:07 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.56399999999999995,"15min":0.53500000000000003},"min":{"1min":0.34000000000000002,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.76800000000000002,"5min":0.98899999999999999,"15min":0.98899999999999999},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.55400000000000005,"15min":0.53000000000000003},"min":{"1min":0.40699999999999997,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.91000000000000003,"5min":0.91000000000000003,"15min":0.91000000000000003},"last":0.51000000000000001}]},{"osd":2,"last update":"Fri Jul 14 18:12:32 2023","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.59499999999999997,"15min":0.52100000000000002},"min":{"1min":0.38800000000000001,"5min":0.314,"15min":0.314},"max":{"1min":1.056,"5min":1.056,"15min":1.056},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.57699999999999996,"15min":0.50800000000000001},"min":{"1min":0.44900000000000001,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.91000000000000003,"5min":0.91000000000000003,"15min":0.91000000000000003},"last":0.61099999999999999}]},{"osd":3,"last update":"Fri Jul 14 18:11:50 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.55900000000000005,"15min":0.52800000000000002},"min":{"1min":0.36199999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.86799999999999999,"5min":0.86799999999999999,"15min":0.86799999999999999},"last":0.44},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.61899999999999999,"15min":0.55300000000000005},"min":{"1min":0.439,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":1.0229999999999999,"5min":1.0229999999999999,"15min":1.0229999999999999},"last":0.63400000000000001}]},{"osd":4,"last update":"Fri Jul 14 18:12:07 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.46899999999999997,"15min":0.41799999999999998},"min":{"1min":0.36399999999999999,"5min":0.245,"15min":0.245},"max":{"1min":0.95299999999999996,"5min":0.95299999999999996,"15min":0.95299999999999996},"last":0.36699999999999999},{"interface":"front","average":{"1min":0.51300000000000001,"5min":0.46300000000000002,"15min":0.41199999999999998},"min":{"1min":0.32700000000000001,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.69199999999999995,"5min":0.77600000000000002,"15min":0.77600000000000002},"last":0.41099999999999998}]},{"osd":5,"last update":"Fri Jul 14 18:12:32 2023","interfaces":[{"interface":"back","average":{"1min":0.74099999999999999,"5min":0.65100000000000002,"15min":0.60899999999999999},"min":{"1min":0.46800000000000003,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.94299999999999995,"5min":0.96599999999999997,"15min":0.96599999999999997},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.77500000000000002,"5min":0.67900000000000005,"15min":0.629},"min":{"1min":0.53200000000000003,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":1.04,"5min":1.04,"15min":1.04},"last":0.65600000000000003}]},{"osd":6,"last update":"Fri Jul 14 18:12:47 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.63300000000000001,"15min":0.61799999999999999},"min":{"1min":0.503,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.81999999999999995,"5min":0.93700000000000006,"15min":0.93700000000000006},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.68200000000000005,"5min":0.67000000000000004,"15min":0.64800000000000002},"min":{"1min":0.42699999999999999,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.83299999999999996,"5min":0.97299999999999998,"15min":0.97299999999999998},"last":0.67200000000000004}]},{"osd":7,"last update":"Fri Jul 14 18:12:12 2023","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.63500000000000001,"15min":0.60899999999999999},"min":{"1min":0.41499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":1.109,"5min":1.109,"15min":1.109},"last":0.69199999999999995},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.65200000000000002,"15min":0.64200000000000002},"min":{"1min":0.36899999999999999,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":1.002,"5min":1.0489999999999999,"15min":1.0489999999999999},"last":0.77400000000000002}]},{"osd":8,"last update":"Fri Jul 14 18:12:32 2023","interfaces":[{"interface":"back","average":{"1min":0.82799999999999996,"5min":0.76800000000000002,"15min":0.754},"min":{"1min":0.54200000000000004,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":1.0700000000000001,"5min":1.0700000000000001,"15min":1.0700000000000001},"last":0.80700000000000005},{"interface":"front","average":{"1min":0.84599999999999997,"5min":0.78000000000000003,"15min":0.76400000000000001},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":1.155,"5min":1.155,"15min":1.155},"last":0.75800000000000001}]},{"osd":9,"last update":"Fri Jul 14 18:11:50 2023","interfaces":[{"interface":"back","average":{"1min":0.74199999999999999,"5min":0.75900000000000001,"15min":0.76200000000000001},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.98199999999999998,"5min":1.01,"15min":1.01},"last":0.72199999999999998},{"interface":"front","average":{"1min":0.78600000000000003,"5min":0.81599999999999995,"15min":0.82099999999999995},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.0149999999999999,"5min":1.0589999999999999,"15min":1.0589999999999999},"last":0.70899999999999996}]},{"osd":10,"last update":"Fri Jul 14 18:12:12 2023","interfaces":[{"interface":"back","average":{"1min":0.81799999999999995,"5min":0.81100000000000005,"15min":0.81000000000000005},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.0860000000000001,"5min":1.0860000000000001,"15min":1.0860000000000001},"last":0.82099999999999995},{"interface":"front","average":{"1min":0.79800000000000004,"5min":0.78800000000000003,"15min":0.78600000000000003},"min":{"1min":0.495,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.097,"5min":1.097,"15min":1.097},"last":0.79100000000000004}]},{"osd":11,"last update":"Fri Jul 14 18:12:12 2023","interfaces":[{"interface":"back","average":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"min":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.1339999999999999,"5min":1.1339999999999999,"15min":1.1339999999999999},"last":0.85899999999999999},{"interface":"front","average":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"min":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":1.125,"5min":1.125,"15min":1.125},"last":0.84499999999999997}]}]},{"osd":0,"up_from":8,"seq":34359738446,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27988,"kb_used_data":972,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717164,"statfs":{"total":95995035648,"available":95966375936,"internally_reserved":0,"allocated":995328,"data_stored":471269,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Jul 14 18:12:07 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.52600000000000002,"15min":0.51100000000000001},"min":{"1min":0.437,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.68300000000000005,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.53600000000000003,"15min":0.51000000000000001},"min":{"1min":0.35399999999999998,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.76400000000000001,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.69799999999999995}]},{"osd":2,"last update":"Fri Jul 14 18:12:38 2023","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.57599999999999996,"15min":0.56000000000000005},"min":{"1min":0.39800000000000002,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.69999999999999996,"5min":0.93799999999999994,"15min":0.93799999999999994},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.55800000000000005,"15min":0.52800000000000002},"min":{"1min":0.379,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.73499999999999999,"5min":0.82399999999999995,"15min":0.82399999999999995},"last":0.46999999999999997}]},{"osd":3,"last update":"Fri Jul 14 18:12:13 2023","interfaces":[{"interface":"back","average":{"1min":0.377,"5min":0.377,"15min":0.377},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"last":0.40600000000000003},{"interface":"front","average":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"last":0.38200000000000001}]},{"osd":4,"last update":"Fri Jul 14 18:12:07 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.53800000000000003,"15min":0.51400000000000001},"min":{"1min":0.42499999999999999,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.67300000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.54400000000000004},"min":{"1min":0.41199999999999998,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.80000000000000004,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.65100000000000002}]},{"osd":5,"last update":"Fri Jul 14 18:12:38 2023","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.55600000000000005,"15min":0.52600000000000002},"min":{"1min":0.439,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.70399999999999996,"5min":1.161,"15min":1.161},"last":0.51600000000000001},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.56999999999999995,"15min":0.54900000000000004},"min":{"1min":0.41699999999999998,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.69099999999999995,"5min":0.879,"15min":0.879},"last":0.503}]},{"osd":6,"last update":"Fri Jul 14 18:11:48 2023","interfaces":[{"interface":"back","average":{"1min":0.41999999999999998,"5min":0.50700000000000001,"15min":0.503},"min":{"1min":0.28999999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.58999999999999997,"5min":1.0649999999999999,"15min":1.0649999999999999},"last":0.436},{"interface":"front","average":{"1min":0.47999999999999998,"5min":0.52100000000000002,"15min":0.51100000000000001},"min":{"1min":0.34499999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.68700000000000006,"5min":1.3460000000000001,"15min":1.3460000000000001},"last":0.55200000000000005}]},{"osd":7,"last update":"Fri Jul 14 18:12:14 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"last":0.73299999999999998},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"last":0.61399999999999999}]},{"osd":8,"last update":"Fri Jul 14 18:12:38 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.69799999999999995,"15min":0.73399999999999999},"min":{"1min":0.434,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.73099999999999998,"5min":1.3819999999999999,"15min":1.3819999999999999},"last":0.68400000000000005},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.71399999999999997,"15min":0.73999999999999999},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.82399999999999995,"5min":1.0289999999999999,"15min":1.0289999999999999},"last":0.66900000000000004}]},{"osd":9,"last update":"Fri Jul 14 18:11:48 2023","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.69699999999999995,"15min":0.72399999999999998},"min":{"1min":0.36599999999999999,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.84399999999999997,"5min":1.133,"15min":1.133},"last":0.76600000000000001},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.69499999999999995,"15min":0.71699999999999997},"min":{"1min":0.435,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.72699999999999998,"5min":1.28,"15min":1.28},"last":0.63700000000000001}]},{"osd":10,"last update":"Fri Jul 14 18:12:13 2023","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":0.70499999999999996,"15min":0.71299999999999997},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.80300000000000005,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.70899999999999996},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.72499999999999998,"15min":0.73699999999999999},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":0.878,"5min":0.98299999999999998,"15min":0.98299999999999998},"last":0.79700000000000004}]},{"osd":11,"last update":"Fri Jul 14 18:12:38 2023","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.70499999999999996,"15min":0.70699999999999996},"min":{"1min":0.59999999999999998,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":0.84499999999999997,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.747},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.67900000000000005,"15min":0.68100000000000005},"min":{"1min":0.57799999999999996,"5min":0.499,"15min":0.499},"max":{"1min":0.75,"5min":0.90000000000000002,"15min":0.90000000000000002},"last":0.72299999999999998}]}]},{"osd":2,"up_from":18,"seq":77309411398,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28048,"kb_used_data":1032,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717104,"statfs":{"total":95995035648,"available":95966314496,"internally_reserved":0,"allocated":1056768,"data_stored":537146,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 18:12:28 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.51500000000000001,"15min":0.48699999999999999},"min":{"1min":0.376,"5min":0.255,"15min":0.255},"max":{"1min":1.0449999999999999,"5min":1.0449999999999999,"15min":1.0449999999999999},"last":0.46899999999999997},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.497,"15min":0.47899999999999998},"min":{"1min":0.39600000000000002,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":1.9990000000000001,"5min":1.9990000000000001,"15min":1.9990000000000001},"last":0.44}]},{"osd":1,"last update":"Fri Jul 14 18:12:28 2023","interfaces":[{"interface":"back","average":{"1min":0.64800000000000002,"5min":0.56599999999999995,"15min":0.51700000000000002},"min":{"1min":0.375,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.88700000000000001,"5min":0.97499999999999998,"15min":0.97499999999999998},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.59899999999999998,"15min":0.51900000000000002},"min":{"1min":0.46800000000000003,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.93600000000000005,"5min":1.1279999999999999,"15min":1.1279999999999999},"last":0.69999999999999996}]},{"osd":3,"last update":"Fri Jul 14 18:12:48 2023","interfaces":[{"interface":"back","average":{"1min":0.72099999999999997,"5min":0.61399999999999999,"15min":0.55600000000000005},"min":{"1min":0.41999999999999998,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":1.9390000000000001,"5min":1.9390000000000001,"15min":1.9390000000000001},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.71799999999999997,"5min":0.59199999999999997,"15min":0.55800000000000005},"min":{"1min":0.39900000000000002,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":1.9630000000000001,"5min":1.9630000000000001,"15min":1.9630000000000001},"last":0.56000000000000005}]},{"osd":4,"last update":"Fri Jul 14 18:12:12 2023","interfaces":[{"interface":"back","average":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":1.0209999999999999,"5min":1.0209999999999999,"15min":1.0209999999999999},"last":0.75800000000000001},{"interface":"front","average":{"1min":0.745,"5min":0.745,"15min":0.745},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":0.93700000000000006,"5min":0.93700000000000006,"15min":0.93700000000000006},"last":0.68500000000000005}]},{"osd":5,"last update":"Fri Jul 14 18:12:28 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.55100000000000005,"15min":0.51500000000000001},"min":{"1min":0.32900000000000001,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.92900000000000005,"5min":1.1719999999999999,"15min":1.1719999999999999},"last":0.82799999999999996},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.54400000000000004,"15min":0.53100000000000003},"min":{"1min":0.40400000000000003,"5min":0.316,"15min":0.316},"max":{"1min":0.878,"5min":1.1499999999999999,"15min":1.1499999999999999},"last":0.621}]},{"osd":6,"last update":"Fri Jul 14 18:11:52 2023","interfaces":[{"interface":"back","average":{"1min":0.78200000000000003,"5min":0.67000000000000004,"15min":0.65600000000000003},"min":{"1min":0.505,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":2.3170000000000002,"5min":2.3170000000000002,"15min":2.3170000000000002},"last":0.78300000000000003},{"interface":"front","average":{"1min":0.753,"5min":0.623,"15min":0.59899999999999998},"min":{"1min":0.52700000000000002,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":2.3050000000000002,"5min":2.3050000000000002,"15min":2.3050000000000002},"last":0.66900000000000004}]},{"osd":7,"last update":"Fri Jul 14 18:12:12 2023","interfaces":[{"interface":"back","average":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"min":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.008,"5min":1.008,"15min":1.008},"last":0.745},{"interface":"front","average":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"min":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":1.0720000000000001,"5min":1.0720000000000001,"15min":1.0720000000000001},"last":0.85799999999999998}]},{"osd":8,"last update":"Fri Jul 14 18:12:28 2023","interfaces":[{"interface":"back","average":{"1min":0.76500000000000001,"5min":0.68799999999999994,"15min":0.63900000000000001},"min":{"1min":0.434,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":1.093,"5min":1.4570000000000001,"15min":1.4570000000000001},"last":0.88},{"interface":"front","average":{"1min":0.71799999999999997,"5min":0.622,"15min":0.58799999999999997},"min":{"1min":0.47699999999999998,"5min":0.379,"15min":0.379},"max":{"1min":0.95199999999999996,"5min":1.2769999999999999,"15min":1.2769999999999999},"last":0.86899999999999999}]},{"osd":9,"last update":"Fri Jul 14 18:11:52 2023","interfaces":[{"interface":"back","average":{"1min":0.85699999999999998,"5min":0.72699999999999998,"15min":0.70499999999999996},"min":{"1min":0.59599999999999997,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.0960000000000001,"5min":1.0960000000000001,"15min":1.0960000000000001},"last":0.89900000000000002},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.65400000000000003,"15min":0.64200000000000002},"min":{"1min":0.55200000000000005,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":0.90600000000000003,"5min":0.90600000000000003,"15min":0.90600000000000003},"last":0.76900000000000002}]},{"osd":10,"last update":"Fri Jul 14 18:12:12 2023","interfaces":[{"interface":"back","average":{"1min":0.79600000000000004,"5min":0.69599999999999995,"15min":0.68000000000000005},"min":{"1min":0.60599999999999998,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.0229999999999999,"5min":1.0229999999999999,"15min":1.0229999999999999},"last":0.73299999999999998},{"interface":"front","average":{"1min":0.85799999999999998,"5min":0.73699999999999999,"15min":0.71699999999999997},"min":{"1min":0.67400000000000004,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.0629999999999999,"5min":1.0629999999999999,"15min":1.0629999999999999},"last":0.79300000000000004}]},{"osd":11,"last update":"Fri Jul 14 18:12:12 2023","interfaces":[{"interface":"back","average":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"min":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"max":{"1min":0.97999999999999998,"5min":0.97999999999999998,"15min":0.97999999999999998},"last":0.81299999999999994},{"interface":"front","average":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"min":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"max":{"1min":1.006,"5min":1.006,"15min":1.006},"last":0.84199999999999997}]}]},{"osd":3,"up_from":25,"seq":107374182465,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27972,"kb_used_data":956,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717180,"statfs":{"total":95995035648,"available":95966392320,"internally_reserved":0,"allocated":978944,"data_stored":468739,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 18:12:49 2023","interfaces":[{"interface":"back","average":{"1min":0.35399999999999998,"5min":0.36899999999999999,"15min":0.36699999999999999},"min":{"1min":0.26200000000000001,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":0.46000000000000002,"5min":0.65700000000000003,"15min":0.65700000000000003},"last":0.27100000000000002},{"interface":"front","average":{"1min":0.33500000000000002,"5min":0.40200000000000002,"15min":0.38900000000000001},"min":{"1min":0.27600000000000002,"5min":0.248,"15min":0.248},"max":{"1min":0.41499999999999998,"5min":1.786,"15min":1.786},"last":0.23599999999999999}]},{"osd":1,"last update":"Fri Jul 14 18:12:49 2023","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.58199999999999996,"15min":0.52100000000000002},"min":{"1min":0.436,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":1.246,"5min":3.4369999999999998,"15min":3.4369999999999998},"last":0.52400000000000002},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.58099999999999996,"15min":0.53500000000000003},"min":{"1min":0.42399999999999999,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":1.2969999999999999,"5min":1.2969999999999999,"15min":1.2969999999999999},"last":0.45600000000000002}]},{"osd":2,"last update":"Fri Jul 14 18:12:49 2023","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.57499999999999996,"15min":0.56899999999999995},"min":{"1min":0.34300000000000003,"5min":0.307,"15min":0.307},"max":{"1min":0.66300000000000003,"5min":3.4540000000000002,"15min":3.4540000000000002},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.51800000000000002,"5min":0.56200000000000006,"15min":0.56200000000000006},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.75800000000000001,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.64700000000000002}]},{"osd":4,"last update":"Fri Jul 14 18:12:06 2023","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.58299999999999996,"15min":0.54400000000000004},"min":{"1min":0.42999999999999999,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.73499999999999999,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.58099999999999996,"15min":0.56399999999999995},"min":{"1min":0.42499999999999999,"5min":0.38,"15min":0.38},"max":{"1min":0.72699999999999998,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.38200000000000001}]},{"osd":5,"last update":"Fri Jul 14 18:12:31 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.59999999999999998,"15min":0.59499999999999997},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.79400000000000004,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.57299999999999995,"15min":0.58699999999999997},"min":{"1min":0.38900000000000001,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.72299999999999998,"5min":0.875,"15min":0.875},"last":0.63600000000000001}]},{"osd":6,"last update":"Fri Jul 14 18:12:49 2023","interfaces":[{"interface":"back","average":{"1min":0.42399999999999999,"5min":0.51200000000000001,"15min":0.52200000000000002},"min":{"1min":0.34599999999999997,"5min":0.317,"15min":0.317},"max":{"1min":0.63200000000000001,"5min":1.028,"15min":1.028},"last":0.34100000000000003},{"interface":"front","average":{"1min":0.501,"5min":0.57599999999999996,"15min":0.58499999999999996},"min":{"1min":0.376,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.68300000000000005,"5min":1.0669999999999999,"15min":1.0669999999999999},"last":0.36799999999999999}]},{"osd":7,"last update":"Fri Jul 14 18:12:10 2023","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.71099999999999997,"15min":0.71499999999999997},"min":{"1min":0.53600000000000003,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.391,"5min":1.391,"15min":1.391},"last":0.40100000000000002},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.65300000000000002,"15min":0.67100000000000004},"min":{"1min":0.46300000000000002,"5min":0.376,"15min":0.376},"max":{"1min":1.0660000000000001,"5min":1.131,"15min":1.131},"last":0.53700000000000003}]},{"osd":8,"last update":"Fri Jul 14 18:10:26 2023","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.046,"5min":1.046,"15min":1.046},"last":0.61099999999999999}]},{"osd":9,"last update":"Fri Jul 14 18:11:50 2023","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":0.57699999999999996,"15min":0.58799999999999997},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.75900000000000001,"5min":0.98999999999999999,"15min":0.98999999999999999},"last":0.48099999999999998},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.70699999999999996,"15min":0.72299999999999998},"min":{"1min":0.38200000000000001,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.96299999999999997,"5min":0.997,"15min":0.997},"last":0.32200000000000001}]},{"osd":10,"last update":"Fri Jul 14 18:12:10 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.77200000000000002,"15min":0.77800000000000002},"min":{"1min":0.56799999999999995,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":1.272,"5min":1.272,"15min":1.272},"last":0.42799999999999999},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.71999999999999997,"15min":0.72899999999999998},"min":{"1min":0.52600000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.2629999999999999,"5min":1.2629999999999999,"15min":1.2629999999999999},"last":0.56899999999999995}]},{"osd":11,"last update":"Fri Jul 14 18:12:10 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":0.89700000000000002,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.625}]}]},{"osd":4,"up_from":32,"seq":137438953533,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27972,"kb_used_data":956,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717180,"statfs":{"total":95995035648,"available":95966392320,"internally_reserved":0,"allocated":978944,"data_stored":474418,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 18:10:07 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.49099999999999999,"15min":0.48099999999999998},"min":{"1min":0.32100000000000001,"5min":0.313,"15min":0.313},"max":{"1min":1.347,"5min":1.347,"15min":1.347},"last":0.44400000000000001},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.50900000000000001,"15min":0.501},"min":{"1min":0.312,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":1.417,"5min":1.417,"15min":1.417},"last":0.53500000000000003}]},{"osd":1,"last update":"Fri Jul 14 18:12:14 2023","interfaces":[{"interface":"back","average":{"1min":0.441,"5min":0.40600000000000003,"15min":0.379},"min":{"1min":0.309,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.56200000000000006,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.46400000000000002,"5min":0.40899999999999997,"15min":0.36899999999999999},"min":{"1min":0.28899999999999998,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.74199999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.54800000000000004}]},{"osd":2,"last update":"Fri Jul 14 18:12:14 2023","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.57099999999999995,"15min":0.53700000000000003},"min":{"1min":0.44800000000000001,"5min":0.374,"15min":0.374},"max":{"1min":0.753,"5min":1.4019999999999999,"15min":1.4019999999999999},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.58299999999999996,"15min":0.54200000000000004},"min":{"1min":0.52900000000000003,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.82699999999999996,"5min":1.4750000000000001,"15min":1.4750000000000001},"last":0.65100000000000002}]},{"osd":3,"last update":"Fri Jul 14 18:12:14 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.55000000000000004,"15min":0.501},"min":{"1min":0.39100000000000001,"5min":0.318,"15min":0.318},"max":{"1min":0.81399999999999995,"5min":1.054,"15min":1.054},"last":0.81399999999999995},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.54900000000000004,"15min":0.53000000000000003},"min":{"1min":0.40799999999999997,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.65600000000000003,"5min":0.95299999999999996,"15min":0.95299999999999996},"last":0.68899999999999995}]},{"osd":5,"last update":"Fri Jul 14 18:12:36 2023","interfaces":[{"interface":"back","average":{"1min":0.76900000000000002,"5min":0.63400000000000001,"15min":0.56200000000000006},"min":{"1min":0.59199999999999997,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.90400000000000003,"5min":1.177,"15min":1.177},"last":0.70899999999999996},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.65300000000000002,"15min":0.58499999999999996},"min":{"1min":0.48699999999999999,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":1.0109999999999999,"5min":1.1220000000000001,"15min":1.1220000000000001},"last":0.85799999999999998}]},{"osd":6,"last update":"Fri Jul 14 18:11:51 2023","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.64200000000000002,"15min":0.61099999999999999},"min":{"1min":0.47599999999999998,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.83499999999999996,"5min":1.101,"15min":1.101},"last":0.76600000000000001},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.63400000000000001,"15min":0.61199999999999999},"min":{"1min":0.52300000000000002,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.78300000000000003,"5min":1.446,"15min":1.446},"last":0.73099999999999998}]},{"osd":7,"last update":"Fri Jul 14 18:12:14 2023","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.60599999999999998,"15min":0.57999999999999996},"min":{"1min":0.439,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.92100000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.93700000000000006},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.63900000000000001,"15min":0.60799999999999998},"min":{"1min":0.50700000000000001,"5min":0.316,"15min":0.316},"max":{"1min":0.95099999999999996,"5min":1.0189999999999999,"15min":1.0189999999999999},"last":1.0449999999999999}]},{"osd":8,"last update":"Fri Jul 14 18:12:34 2023","interfaces":[{"interface":"back","average":{"1min":0.72199999999999998,"5min":0.69399999999999995,"15min":0.69299999999999995},"min":{"1min":0.56599999999999995,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.93200000000000005,"5min":1.3740000000000001,"15min":1.3740000000000001},"last":0.84399999999999997},{"interface":"front","average":{"1min":0.86799999999999999,"5min":0.80100000000000005,"15min":0.78700000000000003},"min":{"1min":0.66700000000000004,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.0880000000000001,"5min":1.147,"15min":1.147},"last":0.99099999999999999}]},{"osd":9,"last update":"Fri Jul 14 18:11:51 2023","interfaces":[{"interface":"back","average":{"1min":0.78500000000000003,"5min":0.81399999999999995,"15min":0.81899999999999995},"min":{"1min":0.63800000000000001,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":0.98499999999999999,"5min":1.171,"15min":1.171},"last":0.90300000000000002},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.70999999999999996,"15min":0.71699999999999997},"min":{"1min":0.51300000000000001,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":0.85199999999999998,"5min":1.304,"15min":1.304},"last":0.88700000000000001}]},{"osd":10,"last update":"Fri Jul 14 18:12:14 2023","interfaces":[{"interface":"back","average":{"1min":0.747,"5min":0.73999999999999999,"15min":0.73899999999999999},"min":{"1min":0.58299999999999996,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":0.90400000000000003,"5min":1.016,"15min":1.016},"last":0.79500000000000004},{"interface":"front","average":{"1min":0.83999999999999997,"5min":0.82599999999999996,"15min":0.82399999999999995},"min":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.038,"5min":1.196,"15min":1.196},"last":1.0169999999999999}]},{"osd":11,"last update":"Fri Jul 14 18:12:08 2023","interfaces":[{"interface":"back","average":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"min":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"max":{"1min":0.96799999999999997,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.83299999999999996},{"interface":"front","average":{"1min":0.90800000000000003,"5min":0.90800000000000003,"15min":0.90800000000000003},"min":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"max":{"1min":1.0620000000000001,"5min":1.0620000000000001,"15min":1.0620000000000001},"last":0.95699999999999996}]}]},{"osd":5,"up_from":37,"seq":158913790008,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28576,"kb_used_data":1560,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716576,"statfs":{"total":95995035648,"available":95965773824,"internally_reserved":0,"allocated":1597440,"data_stored":1066375,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 18:12:31 2023","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.52700000000000002,"15min":0.51500000000000001},"min":{"1min":0.37,"5min":0.318,"15min":0.318},"max":{"1min":0.79000000000000004,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.47699999999999998},{"interface":"front","average":{"1min":0.501,"5min":0.51500000000000001,"15min":0.5},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.77100000000000002,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.49399999999999999}]},{"osd":1,"last update":"Fri Jul 14 18:12:31 2023","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.58099999999999996,"15min":0.54300000000000004},"min":{"1min":0.442,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.81599999999999995,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.59299999999999997,"15min":0.55700000000000005},"min":{"1min":0.38300000000000001,"5min":0.374,"15min":0.374},"max":{"1min":0.79200000000000004,"5min":0.90400000000000003,"15min":0.90400000000000003},"last":0.53600000000000003}]},{"osd":2,"last update":"Fri Jul 14 18:12:31 2023","interfaces":[{"interface":"back","average":{"1min":0.46899999999999997,"5min":0.44,"15min":0.38800000000000001},"min":{"1min":0.308,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.61299999999999999,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.67600000000000005},{"interface":"front","average":{"1min":0.44500000000000001,"5min":0.44400000000000001,"15min":0.40699999999999997},"min":{"1min":0.31,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.64300000000000002,"5min":0.751,"15min":0.751},"last":0.374}]},{"osd":3,"last update":"Fri Jul 14 18:12:31 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.55000000000000004,"15min":0.52200000000000002},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.82399999999999995,"5min":0.90300000000000002,"15min":0.90300000000000002},"last":0.40100000000000002},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.54500000000000004,"15min":0.51100000000000001},"min":{"1min":0.40300000000000002,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.442}]},{"osd":4,"last update":"Fri Jul 14 18:12:31 2023","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.61699999999999999,"15min":0.58299999999999996},"min":{"1min":0.53300000000000003,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.84599999999999997,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.51500000000000001},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.628,"15min":0.58499999999999996},"min":{"1min":0.42399999999999999,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.87,"5min":1.1379999999999999,"15min":1.1379999999999999},"last":0.66100000000000003}]},{"osd":6,"last update":"Fri Jul 14 18:11:50 2023","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.59699999999999998,"15min":0.57799999999999996},"min":{"1min":0.40000000000000002,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.93400000000000005,"5min":1.0289999999999999,"15min":1.0289999999999999},"last":0.54800000000000004},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.60899999999999999,"15min":0.59299999999999997},"min":{"1min":0.38700000000000001,"5min":0.371,"15min":0.371},"max":{"1min":0.96599999999999997,"5min":0.96599999999999997,"15min":0.96599999999999997},"last":0.52400000000000002}]},{"osd":7,"last update":"Fri Jul 14 18:12:12 2023","interfaces":[{"interface":"back","average":{"1min":0.72099999999999997,"5min":0.67000000000000004,"15min":0.65000000000000002},"min":{"1min":0.58599999999999997,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.89400000000000002,"5min":1.0669999999999999,"15min":1.0669999999999999},"last":0.625},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.69999999999999996,"15min":0.68300000000000005},"min":{"1min":0.54500000000000004,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":1.0269999999999999,"5min":1.081,"15min":1.081},"last":0.72199999999999998}]},{"osd":8,"last update":"Fri Jul 14 18:12:31 2023","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":0.67500000000000004,"15min":0.66900000000000004},"min":{"1min":0.42799999999999999,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.84999999999999998,"5min":0.99399999999999999,"15min":0.99399999999999999},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.65500000000000003,"15min":0.64900000000000002},"min":{"1min":0.45100000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.82199999999999995,"5min":1.1859999999999999,"15min":1.1859999999999999},"last":0.59599999999999997}]},{"osd":9,"last update":"Fri Jul 14 18:11:50 2023","interfaces":[{"interface":"back","average":{"1min":0.73999999999999999,"5min":0.746,"15min":0.747},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":1.0429999999999999,"5min":1.2350000000000001,"15min":1.2350000000000001},"last":0.70799999999999996},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.73399999999999999,"15min":0.73399999999999999},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":1.0920000000000001,"5min":1.0920000000000001,"15min":1.0920000000000001},"last":0.64500000000000002}]},{"osd":10,"last update":"Fri Jul 14 18:12:12 2023","interfaces":[{"interface":"back","average":{"1min":0.80700000000000005,"5min":0.77900000000000003,"15min":0.77400000000000002},"min":{"1min":0.53100000000000003,"5min":0.495,"15min":0.495},"max":{"1min":1.0669999999999999,"5min":1.0669999999999999,"15min":1.0669999999999999},"last":0.69099999999999995},{"interface":"front","average":{"1min":0.81399999999999995,"5min":0.77500000000000002,"15min":0.76900000000000002},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.1399999999999999,"5min":1.1399999999999999,"15min":1.1399999999999999},"last":0.753}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2629,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":68108,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":106496,"data_stored":68779,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3271,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1173,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":5026,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":1500,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":64303,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1643,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-14T18:12:51.994 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-14T18:12:52.145 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:52.104+0000 7ff251ff6700 1 -- 172.21.15.163:0/767321972 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff24c0ffd40 msgr2=0x7ff24c100190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:12:52.145 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:52.104+0000 7ff251ff6700 1 --2- 172.21.15.163:0/767321972 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff24c0ffd40 0x7ff24c100190 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7ff234009990 tx=0x7ff234009ca0 comp rx=0 tx=0).stop 2023-07-14T18:12:52.145 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:52.104+0000 7ff251ff6700 1 -- 172.21.15.163:0/767321972 shutdown_connections 2023-07-14T18:12:52.146 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:52.104+0000 7ff251ff6700 1 --2- 172.21.15.163:0/767321972 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff24c1006d0 0x7ff24c106f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:52.146 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:52.104+0000 7ff251ff6700 1 --2- 172.21.15.163:0/767321972 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff24c0feb50 0x7ff24c0fef60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:52.146 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:52.104+0000 7ff251ff6700 1 --2- 172.21.15.163:0/767321972 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff24c0ffd40 0x7ff24c100190 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:52.146 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:52.104+0000 7ff251ff6700 1 -- 172.21.15.163:0/767321972 >> 172.21.15.163:0/767321972 conn(0x7ff24c0fa150 msgr2=0x7ff24c0fc5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:12:52.146 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:52.104+0000 7ff251ff6700 1 -- 172.21.15.163:0/767321972 shutdown_connections 2023-07-14T18:12:52.146 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:52.104+0000 7ff251ff6700 1 -- 172.21.15.163:0/767321972 wait complete. 2023-07-14T18:12:52.147 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:52.105+0000 7ff251ff6700 1 Processor -- start 2023-07-14T18:12:52.149 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:52.105+0000 7ff251ff6700 1 -- start start 2023-07-14T18:12:52.149 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:52.105+0000 7ff251ff6700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff24c0feb50 0x7ff24c194700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:12:52.149 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:52.105+0000 7ff251ff6700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff24c0ffd40 0x7ff24c194c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:12:52.149 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:52.105+0000 7ff251ff6700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff24c1006d0 0x7ff24c19bcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:12:52.149 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:52.105+0000 7ff251ff6700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff24c19c280 con 0x7ff24c1006d0 2023-07-14T18:12:52.149 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:52.105+0000 7ff251ff6700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff24c19c3c0 con 0x7ff24c0ffd40 2023-07-14T18:12:52.150 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:52.105+0000 7ff251ff6700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff24c19c550 con 0x7ff24c0feb50 2023-07-14T18:12:52.150 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:52.105+0000 7ff24bfff700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff24c1006d0 0x7ff24c19bcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:12:52.150 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:52.105+0000 7ff24bfff700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff24c1006d0 0x7ff24c19bcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:57898/0 (socket says 172.21.15.163:57898) 2023-07-14T18:12:52.150 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:52.105+0000 7ff24bfff700 1 -- 172.21.15.163:0/2940286563 learned_addr learned my addr 172.21.15.163:0/2940286563 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:12:52.150 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:52.105+0000 7ff24affd700 1 --2- 172.21.15.163:0/2940286563 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff24c0ffd40 0x7ff24c194c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:12:52.150 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:52.105+0000 7ff24b7fe700 1 --2- 172.21.15.163:0/2940286563 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff24c0feb50 0x7ff24c194700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:12:52.150 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:52.105+0000 7ff24bfff700 1 -- 172.21.15.163:0/2940286563 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff24c0feb50 msgr2=0x7ff24c194700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:12:52.151 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:52.105+0000 7ff24bfff700 1 --2- 172.21.15.163:0/2940286563 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff24c0feb50 0x7ff24c194700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:52.151 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:52.105+0000 7ff24bfff700 1 -- 172.21.15.163:0/2940286563 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff24c0ffd40 msgr2=0x7ff24c194c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:12:52.151 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:52.105+0000 7ff24bfff700 1 --2- 172.21.15.163:0/2940286563 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff24c0ffd40 0x7ff24c194c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:52.151 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:52.105+0000 7ff24bfff700 1 -- 172.21.15.163:0/2940286563 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2340095f0 con 0x7ff24c1006d0 2023-07-14T18:12:52.151 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:52.105+0000 7ff24affd700 1 --2- 172.21.15.163:0/2940286563 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff24c0ffd40 0x7ff24c194c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T18:12:52.151 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:52.106+0000 7ff24bfff700 1 --2- 172.21.15.163:0/2940286563 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff24c1006d0 0x7ff24c19bcb0 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7ff244007d70 tx=0x7ff24400a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:12:52.151 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:52.106+0000 7ff248ff9700 1 -- 172.21.15.163:0/2940286563 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff24400ad40 con 0x7ff24c1006d0 2023-07-14T18:12:52.151 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:52.106+0000 7ff251ff6700 1 -- 172.21.15.163:0/2940286563 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff24c19c830 con 0x7ff24c1006d0 2023-07-14T18:12:52.152 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:52.106+0000 7ff248ff9700 1 -- 172.21.15.163:0/2940286563 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ff2440128b0 con 0x7ff24c1006d0 2023-07-14T18:12:52.152 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:52.106+0000 7ff248ff9700 1 -- 172.21.15.163:0/2940286563 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2440116b0 con 0x7ff24c1006d0 2023-07-14T18:12:52.152 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:52.106+0000 7ff251ff6700 1 -- 172.21.15.163:0/2940286563 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff24c19ccf0 con 0x7ff24c1006d0 2023-07-14T18:12:52.152 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:52.107+0000 7ff251ff6700 1 -- 172.21.15.163:0/2940286563 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff24c10a220 con 0x7ff24c1006d0 2023-07-14T18:12:52.152 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:52.108+0000 7ff248ff9700 1 -- 172.21.15.163:0/2940286563 <== mon.0 v2:172.21.15.163:3300/0 4 ==== mgrmap(e 18) v1 ==== 135716+0+0 (secure 0 0 0) 0x7ff244012a20 con 0x7ff24c1006d0 2023-07-14T18:12:52.152 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:52.108+0000 7ff248ff9700 1 --2- 172.21.15.163:0/2940286563 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7ff2380a11a0 0x7ff2380a3650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:12:52.153 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:52.108+0000 7ff248ff9700 1 -- 172.21.15.163:0/2940286563 <== mon.0 v2:172.21.15.163:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 9020+0+0 (secure 0 0 0) 0x7ff2440cd330 con 0x7ff24c1006d0 2023-07-14T18:12:52.153 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:52.108+0000 7ff24b7fe700 1 --2- 172.21.15.163:0/2940286563 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7ff2380a11a0 0x7ff2380a3650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:12:52.153 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:52.109+0000 7ff24b7fe700 1 --2- 172.21.15.163:0/2940286563 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7ff2380a11a0 0x7ff2380a3650 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7ff23c005950 tx=0x7ff23c0058e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:12:52.153 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:52.112+0000 7ff248ff9700 1 -- 172.21.15.163:0/2940286563 <== mon.0 v2:172.21.15.163:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178025 (secure 0 0 0) 0x7ff244096770 con 0x7ff24c1006d0 2023-07-14T18:12:52.175 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:12:51 smithi184 ceph-mon[98481]: from='client.? 172.21.15.163:0/2749376171' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-07-14T18:12:52.175 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:12:51 smithi184 ceph-mon[98481]: from='client.? 172.21.15.163:0/2049254837' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2023-07-14T18:12:52.176 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:12:51 smithi184 ceph-mon[98481]: from='client.? 172.21.15.163:0/3952050385' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-07-14T18:12:52.276 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:12:51 smithi172 ceph-mon[97983]: from='client.? 172.21.15.163:0/2749376171' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-07-14T18:12:52.276 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:12:51 smithi172 ceph-mon[97983]: from='client.? 172.21.15.163:0/2049254837' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2023-07-14T18:12:52.276 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:12:51 smithi172 ceph-mon[97983]: from='client.? 172.21.15.163:0/3952050385' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-07-14T18:12:52.335 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:52.295+0000 7ff251ff6700 1 -- 172.21.15.163:0/2940286563 --> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7ff24c060a80 con 0x7ff2380a11a0 2023-07-14T18:12:52.347 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:52.306+0000 7ff248ff9700 1 -- 172.21.15.163:0/2940286563 <== mgr.14152 v2:172.21.15.163:6800/1949590926 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+427232 (secure 0 0 0) 0x7ff24c060a80 con 0x7ff2380a11a0 2023-07-14T18:12:52.353 INFO:teuthology.orchestra.run.smithi163.stdout: 2023-07-14T18:12:52.356 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:52.310+0000 7ff251ff6700 1 -- 172.21.15.163:0/2940286563 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7ff2380a11a0 msgr2=0x7ff2380a3650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:12:52.356 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:52.310+0000 7ff251ff6700 1 --2- 172.21.15.163:0/2940286563 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7ff2380a11a0 0x7ff2380a3650 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7ff23c005950 tx=0x7ff23c0058e0 comp rx=0 tx=0).stop 2023-07-14T18:12:52.356 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:52.310+0000 7ff251ff6700 1 -- 172.21.15.163:0/2940286563 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff24c1006d0 msgr2=0x7ff24c19bcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:12:52.357 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:52.310+0000 7ff251ff6700 1 --2- 172.21.15.163:0/2940286563 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff24c1006d0 0x7ff24c19bcb0 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7ff244007d70 tx=0x7ff24400a340 comp rx=0 tx=0).stop 2023-07-14T18:12:52.357 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:52.310+0000 7ff251ff6700 1 -- 172.21.15.163:0/2940286563 shutdown_connections 2023-07-14T18:12:52.357 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:52.310+0000 7ff251ff6700 1 --2- 172.21.15.163:0/2940286563 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7ff2380a11a0 0x7ff2380a3650 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:52.357 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:52.310+0000 7ff251ff6700 1 --2- 172.21.15.163:0/2940286563 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff24c0feb50 0x7ff24c194700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:52.358 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:52.310+0000 7ff251ff6700 1 --2- 172.21.15.163:0/2940286563 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff24c1006d0 0x7ff24c19bcb0 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:52.358 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:52.310+0000 7ff251ff6700 1 --2- 172.21.15.163:0/2940286563 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff24c0ffd40 0x7ff24c194c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:52.358 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:52.310+0000 7ff251ff6700 1 -- 172.21.15.163:0/2940286563 >> 172.21.15.163:0/2940286563 conn(0x7ff24c0fa150 msgr2=0x7ff24c0fc370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:12:52.358 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:52.310+0000 7ff251ff6700 1 -- 172.21.15.163:0/2940286563 shutdown_connections 2023-07-14T18:12:52.359 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:52.310+0000 7ff251ff6700 1 -- 172.21.15.163:0/2940286563 wait complete. 2023-07-14T18:12:52.359 INFO:teuthology.orchestra.run.smithi163.stderr:dumped all 2023-07-14T18:12:52.363 INFO:teuthology.orchestra.run.smithi163.stdout:{"pg_ready":true,"pg_map":{"version":304,"stamp":"2023-07-14T18:12:51.435959+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":660956,"num_objects":102,"num_object_clones":0,"num_object_copies":308,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":950,"num_read_kb":598,"num_write":433,"num_write_kb":3088,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":859,"ondisk_log_size":859,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":419,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":337688,"kb_used_data":13496,"kb_used_omap":20,"kb_used_meta":324075,"kb_avail":1124604136,"statfs":{"total":1151940427776,"available":1151594635264,"internally_reserved":0,"allocated":13819904,"data_stored":7645729,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":21372,"internal_metadata":331852932},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":39,"apply_latency_ms":39,"commit_latency_ns":39000000,"apply_latency_ns":39000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2885,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":117,"num_read_kb":57,"num_write":17,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.007430"},"pg_stats":[{"pgid":"3.3f","version":"86'8","reported_seq":32,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T18:12:45.460577+0000","last_change":"2023-07-14T18:11:09.713546+0000","last_active":"2023-07-14T18:12:45.460577+0000","last_peered":"2023-07-14T18:12:45.460577+0000","last_clean":"2023-07-14T18:12:45.460577+0000","last_became_active":"2023-07-14T18:11:09.713170+0000","last_became_peered":"2023-07-14T18:11:09.713170+0000","last_unstale":"2023-07-14T18:12:45.460577+0000","last_undegraded":"2023-07-14T18:12:45.460577+0000","last_fullsized":"2023-07-14T18:12:45.460577+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_clean_scrub_stamp":"2023-07-14T18:11:08.667354+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T03:40:36.998253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"86'4","reported_seq":28,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T18:12:45.441618+0000","last_change":"2023-07-14T18:11:09.711619+0000","last_active":"2023-07-14T18:12:45.441618+0000","last_peered":"2023-07-14T18:12:45.441618+0000","last_clean":"2023-07-14T18:12:45.441618+0000","last_became_active":"2023-07-14T18:11:09.711249+0000","last_became_peered":"2023-07-14T18:11:09.711249+0000","last_unstale":"2023-07-14T18:12:45.441618+0000","last_undegraded":"2023-07-14T18:12:45.441618+0000","last_fullsized":"2023-07-14T18:12:45.441618+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_clean_scrub_stamp":"2023-07-14T18:11:08.667354+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T02:13:28.408928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"86'7","reported_seq":31,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T18:12:45.448220+0000","last_change":"2023-07-14T18:11:09.705557+0000","last_active":"2023-07-14T18:12:45.448220+0000","last_peered":"2023-07-14T18:12:45.448220+0000","last_clean":"2023-07-14T18:12:45.448220+0000","last_became_active":"2023-07-14T18:11:09.705179+0000","last_became_peered":"2023-07-14T18:11:09.705179+0000","last_unstale":"2023-07-14T18:12:45.448220+0000","last_undegraded":"2023-07-14T18:12:45.448220+0000","last_fullsized":"2023-07-14T18:12:45.448220+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_clean_scrub_stamp":"2023-07-14T18:11:08.667354+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:59:15.173719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"86'8","reported_seq":32,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T18:12:45.449133+0000","last_change":"2023-07-14T18:11:09.709234+0000","last_active":"2023-07-14T18:12:45.449133+0000","last_peered":"2023-07-14T18:12:45.449133+0000","last_clean":"2023-07-14T18:12:45.449133+0000","last_became_active":"2023-07-14T18:11:09.708855+0000","last_became_peered":"2023-07-14T18:11:09.708855+0000","last_unstale":"2023-07-14T18:12:45.449133+0000","last_undegraded":"2023-07-14T18:12:45.449133+0000","last_fullsized":"2023-07-14T18:12:45.449133+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_clean_scrub_stamp":"2023-07-14T18:11:08.667354+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:35:24.047137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"86'4","reported_seq":28,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T18:12:45.443286+0000","last_change":"2023-07-14T18:11:09.704301+0000","last_active":"2023-07-14T18:12:45.443286+0000","last_peered":"2023-07-14T18:12:45.443286+0000","last_clean":"2023-07-14T18:12:45.443286+0000","last_became_active":"2023-07-14T18:11:09.703961+0000","last_became_peered":"2023-07-14T18:11:09.703961+0000","last_unstale":"2023-07-14T18:12:45.443286+0000","last_undegraded":"2023-07-14T18:12:45.443286+0000","last_fullsized":"2023-07-14T18:12:45.443286+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_clean_scrub_stamp":"2023-07-14T18:11:08.667354+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:53:53.273088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"86'6","reported_seq":30,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T18:12:45.453093+0000","last_change":"2023-07-14T18:11:09.717667+0000","last_active":"2023-07-14T18:12:45.453093+0000","last_peered":"2023-07-14T18:12:45.453093+0000","last_clean":"2023-07-14T18:12:45.453093+0000","last_became_active":"2023-07-14T18:11:09.717146+0000","last_became_peered":"2023-07-14T18:11:09.717146+0000","last_unstale":"2023-07-14T18:12:45.453093+0000","last_undegraded":"2023-07-14T18:12:45.453093+0000","last_fullsized":"2023-07-14T18:12:45.453093+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_clean_scrub_stamp":"2023-07-14T18:11:08.667354+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T03:28:45.689618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"86'5","reported_seq":27,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T18:12:45.441864+0000","last_change":"2023-07-14T18:11:09.713638+0000","last_active":"2023-07-14T18:12:45.441864+0000","last_peered":"2023-07-14T18:12:45.441864+0000","last_clean":"2023-07-14T18:12:45.441864+0000","last_became_active":"2023-07-14T18:11:09.707940+0000","last_became_peered":"2023-07-14T18:11:09.707940+0000","last_unstale":"2023-07-14T18:12:45.441864+0000","last_undegraded":"2023-07-14T18:12:45.441864+0000","last_fullsized":"2023-07-14T18:12:45.441864+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_clean_scrub_stamp":"2023-07-14T18:11:08.667354+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:50:20.740517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"86'9","reported_seq":33,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T18:12:45.446140+0000","last_change":"2023-07-14T18:11:09.709804+0000","last_active":"2023-07-14T18:12:45.446140+0000","last_peered":"2023-07-14T18:12:45.446140+0000","last_clean":"2023-07-14T18:12:45.446140+0000","last_became_active":"2023-07-14T18:11:09.709385+0000","last_became_peered":"2023-07-14T18:11:09.709385+0000","last_unstale":"2023-07-14T18:12:45.446140+0000","last_undegraded":"2023-07-14T18:12:45.446140+0000","last_fullsized":"2023-07-14T18:12:45.446140+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_clean_scrub_stamp":"2023-07-14T18:11:08.667354+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T02:39:39.063898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"86'11","reported_seq":35,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T18:12:45.459915+0000","last_change":"2023-07-14T18:11:09.710410+0000","last_active":"2023-07-14T18:12:45.459915+0000","last_peered":"2023-07-14T18:12:45.459915+0000","last_clean":"2023-07-14T18:12:45.459915+0000","last_became_active":"2023-07-14T18:11:09.710049+0000","last_became_peered":"2023-07-14T18:11:09.710049+0000","last_unstale":"2023-07-14T18:12:45.459915+0000","last_undegraded":"2023-07-14T18:12:45.459915+0000","last_fullsized":"2023-07-14T18:12:45.459915+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_clean_scrub_stamp":"2023-07-14T18:11:08.667354+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:25:16.811711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"86'16","reported_seq":40,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T18:12:45.453260+0000","last_change":"2023-07-14T18:11:09.717681+0000","last_active":"2023-07-14T18:12:45.453260+0000","last_peered":"2023-07-14T18:12:45.453260+0000","last_clean":"2023-07-14T18:12:45.453260+0000","last_became_active":"2023-07-14T18:11:09.717209+0000","last_became_peered":"2023-07-14T18:11:09.717209+0000","last_unstale":"2023-07-14T18:12:45.453260+0000","last_undegraded":"2023-07-14T18:12:45.453260+0000","last_fullsized":"2023-07-14T18:12:45.453260+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_clean_scrub_stamp":"2023-07-14T18:11:08.667354+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:46:36.145271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"86'6","reported_seq":28,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T18:12:45.458937+0000","last_change":"2023-07-14T18:11:09.716890+0000","last_active":"2023-07-14T18:12:45.458937+0000","last_peered":"2023-07-14T18:12:45.458937+0000","last_clean":"2023-07-14T18:12:45.458937+0000","last_became_active":"2023-07-14T18:11:09.708773+0000","last_became_peered":"2023-07-14T18:11:09.708773+0000","last_unstale":"2023-07-14T18:12:45.458937+0000","last_undegraded":"2023-07-14T18:12:45.458937+0000","last_fullsized":"2023-07-14T18:12:45.458937+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_clean_scrub_stamp":"2023-07-14T18:11:08.667354+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:20:10.630301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"86'7","reported_seq":31,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T18:12:45.449001+0000","last_change":"2023-07-14T18:11:09.715119+0000","last_active":"2023-07-14T18:12:45.449001+0000","last_peered":"2023-07-14T18:12:45.449001+0000","last_clean":"2023-07-14T18:12:45.449001+0000","last_became_active":"2023-07-14T18:11:09.714680+0000","last_became_peered":"2023-07-14T18:11:09.714680+0000","last_unstale":"2023-07-14T18:12:45.449001+0000","last_undegraded":"2023-07-14T18:12:45.449001+0000","last_fullsized":"2023-07-14T18:12:45.449001+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_clean_scrub_stamp":"2023-07-14T18:11:08.667354+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T02:09:45.252484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"86'10","reported_seq":34,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T18:12:45.452938+0000","last_change":"2023-07-14T18:11:09.711173+0000","last_active":"2023-07-14T18:12:45.452938+0000","last_peered":"2023-07-14T18:12:45.452938+0000","last_clean":"2023-07-14T18:12:45.452938+0000","last_became_active":"2023-07-14T18:11:09.710849+0000","last_became_peered":"2023-07-14T18:11:09.710849+0000","last_unstale":"2023-07-14T18:12:45.452938+0000","last_undegraded":"2023-07-14T18:12:45.452938+0000","last_fullsized":"2023-07-14T18:12:45.452938+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_clean_scrub_stamp":"2023-07-14T18:11:08.667354+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:26:29.490965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"86'7","reported_seq":31,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T18:12:45.441004+0000","last_change":"2023-07-14T18:11:09.710448+0000","last_active":"2023-07-14T18:12:45.441004+0000","last_peered":"2023-07-14T18:12:45.441004+0000","last_clean":"2023-07-14T18:12:45.441004+0000","last_became_active":"2023-07-14T18:11:09.709804+0000","last_became_peered":"2023-07-14T18:11:09.709804+0000","last_unstale":"2023-07-14T18:12:45.441004+0000","last_undegraded":"2023-07-14T18:12:45.441004+0000","last_fullsized":"2023-07-14T18:12:45.441004+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_clean_scrub_stamp":"2023-07-14T18:11:08.667354+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T05:07:41.470601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"86'7","reported_seq":31,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T18:12:45.447823+0000","last_change":"2023-07-14T18:11:09.714917+0000","last_active":"2023-07-14T18:12:45.447823+0000","last_peered":"2023-07-14T18:12:45.447823+0000","last_clean":"2023-07-14T18:12:45.447823+0000","last_became_active":"2023-07-14T18:11:09.714655+0000","last_became_peered":"2023-07-14T18:11:09.714655+0000","last_unstale":"2023-07-14T18:12:45.447823+0000","last_undegraded":"2023-07-14T18:12:45.447823+0000","last_fullsized":"2023-07-14T18:12:45.447823+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_clean_scrub_stamp":"2023-07-14T18:11:08.667354+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T01:03:06.999938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"86'9","reported_seq":33,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T18:12:45.456009+0000","last_change":"2023-07-14T18:11:09.709149+0000","last_active":"2023-07-14T18:12:45.456009+0000","last_peered":"2023-07-14T18:12:45.456009+0000","last_clean":"2023-07-14T18:12:45.456009+0000","last_became_active":"2023-07-14T18:11:09.708692+0000","last_became_peered":"2023-07-14T18:11:09.708692+0000","last_unstale":"2023-07-14T18:12:45.456009+0000","last_undegraded":"2023-07-14T18:12:45.456009+0000","last_fullsized":"2023-07-14T18:12:45.456009+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_clean_scrub_stamp":"2023-07-14T18:11:08.667354+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:38:32.969267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"86'8","reported_seq":32,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T18:12:45.460687+0000","last_change":"2023-07-14T18:11:09.720235+0000","last_active":"2023-07-14T18:12:45.460687+0000","last_peered":"2023-07-14T18:12:45.460687+0000","last_clean":"2023-07-14T18:12:45.460687+0000","last_became_active":"2023-07-14T18:11:09.719895+0000","last_became_peered":"2023-07-14T18:11:09.719895+0000","last_unstale":"2023-07-14T18:12:45.460687+0000","last_undegraded":"2023-07-14T18:12:45.460687+0000","last_fullsized":"2023-07-14T18:12:45.460687+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_clean_scrub_stamp":"2023-07-14T18:11:08.667354+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T01:21:08.877374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"86'10","reported_seq":34,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T18:12:45.446473+0000","last_change":"2023-07-14T18:11:09.712390+0000","last_active":"2023-07-14T18:12:45.446473+0000","last_peered":"2023-07-14T18:12:45.446473+0000","last_clean":"2023-07-14T18:12:45.446473+0000","last_became_active":"2023-07-14T18:11:09.712074+0000","last_became_peered":"2023-07-14T18:11:09.712074+0000","last_unstale":"2023-07-14T18:12:45.446473+0000","last_undegraded":"2023-07-14T18:12:45.446473+0000","last_fullsized":"2023-07-14T18:12:45.446473+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_clean_scrub_stamp":"2023-07-14T18:11:08.667354+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:45:31.539804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"86'7","reported_seq":37,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T18:12:45.448352+0000","last_change":"2023-07-14T18:12:16.821031+0000","last_active":"2023-07-14T18:12:45.448352+0000","last_peered":"2023-07-14T18:12:45.448352+0000","last_clean":"2023-07-14T18:12:45.448352+0000","last_became_active":"2023-07-14T18:12:16.820659+0000","last_became_peered":"2023-07-14T18:12:16.820659+0000","last_unstale":"2023-07-14T18:12:45.448352+0000","last_undegraded":"2023-07-14T18:12:45.448352+0000","last_fullsized":"2023-07-14T18:12:45.448352+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_clean_scrub_stamp":"2023-07-14T18:11:08.667354+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:32:09.374522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,9,6],"acting":[2,9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T18:12:16.783949+0000","last_change":"2023-07-14T18:11:13.786505+0000","last_active":"2023-07-14T18:12:16.783949+0000","last_peered":"2023-07-14T18:12:16.783949+0000","last_clean":"2023-07-14T18:12:16.783949+0000","last_became_active":"2023-07-14T18:11:13.786141+0000","last_became_peered":"2023-07-14T18:11:13.786141+0000","last_unstale":"2023-07-14T18:12:16.783949+0000","last_undegraded":"2023-07-14T18:12:16.783949+0000","last_fullsized":"2023-07-14T18:12:16.783949+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:12.753466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:12.753466+0000","last_clean_scrub_stamp":"2023-07-14T18:11:12.753466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:31:14.426319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,9,0],"acting":[2,3,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"86'14","reported_seq":117,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T18:12:46.639522+0000","last_change":"2023-07-14T18:11:08.691446+0000","last_active":"2023-07-14T18:12:46.639522+0000","last_peered":"2023-07-14T18:12:46.639522+0000","last_clean":"2023-07-14T18:12:46.639522+0000","last_became_active":"2023-07-14T18:11:08.691129+0000","last_became_peered":"2023-07-14T18:11:08.691129+0000","last_unstale":"2023-07-14T18:12:46.639522+0000","last_undegraded":"2023-07-14T18:12:46.639522+0000","last_fullsized":"2023-07-14T18:12:46.639522+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:07.665746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:07.665746+0000","last_clean_scrub_stamp":"2023-07-14T18:11:07.665746+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:05:56.745631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":77,"num_read_kb":77,"num_write":15,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"86'5","reported_seq":29,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T18:12:45.435818+0000","last_change":"2023-07-14T18:11:09.708155+0000","last_active":"2023-07-14T18:12:45.435818+0000","last_peered":"2023-07-14T18:12:45.435818+0000","last_clean":"2023-07-14T18:12:45.435818+0000","last_became_active":"2023-07-14T18:11:09.707856+0000","last_became_peered":"2023-07-14T18:11:09.707856+0000","last_unstale":"2023-07-14T18:12:45.435818+0000","last_undegraded":"2023-07-14T18:12:45.435818+0000","last_fullsized":"2023-07-14T18:12:45.435818+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_clean_scrub_stamp":"2023-07-14T18:11:08.667354+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T01:19:38.619686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T18:12:16.781206+0000","last_change":"2023-07-14T18:11:13.776947+0000","last_active":"2023-07-14T18:12:16.781206+0000","last_peered":"2023-07-14T18:12:16.781206+0000","last_clean":"2023-07-14T18:12:16.781206+0000","last_became_active":"2023-07-14T18:11:13.776557+0000","last_became_peered":"2023-07-14T18:11:13.776557+0000","last_unstale":"2023-07-14T18:12:16.781206+0000","last_undegraded":"2023-07-14T18:12:16.781206+0000","last_fullsized":"2023-07-14T18:12:16.781206+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:12.753466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:12.753466+0000","last_clean_scrub_stamp":"2023-07-14T18:11:12.753466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:02:05.693156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,9,3],"acting":[4,6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1e","version":"84'2","reported_seq":28,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T18:12:16.780754+0000","last_change":"2023-07-14T18:11:08.690072+0000","last_active":"2023-07-14T18:12:16.780754+0000","last_peered":"2023-07-14T18:12:16.780754+0000","last_clean":"2023-07-14T18:12:16.780754+0000","last_became_active":"2023-07-14T18:11:08.689770+0000","last_became_peered":"2023-07-14T18:11:08.689770+0000","last_unstale":"2023-07-14T18:12:16.780754+0000","last_undegraded":"2023-07-14T18:12:16.780754+0000","last_fullsized":"2023-07-14T18:12:16.780754+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:07.665746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:07.665746+0000","last_clean_scrub_stamp":"2023-07-14T18:11:07.665746+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T03:14:32.886334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"86'6","reported_seq":30,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T18:12:45.459717+0000","last_change":"2023-07-14T18:11:09.706952+0000","last_active":"2023-07-14T18:12:45.459717+0000","last_peered":"2023-07-14T18:12:45.459717+0000","last_clean":"2023-07-14T18:12:45.459717+0000","last_became_active":"2023-07-14T18:11:09.706646+0000","last_became_peered":"2023-07-14T18:11:09.706646+0000","last_unstale":"2023-07-14T18:12:45.459717+0000","last_undegraded":"2023-07-14T18:12:45.459717+0000","last_fullsized":"2023-07-14T18:12:45.459717+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_clean_scrub_stamp":"2023-07-14T18:11:08.667354+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:27:36.385233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T18:12:16.781483+0000","last_change":"2023-07-14T18:11:13.779167+0000","last_active":"2023-07-14T18:12:16.781483+0000","last_peered":"2023-07-14T18:12:16.781483+0000","last_clean":"2023-07-14T18:12:16.781483+0000","last_became_active":"2023-07-14T18:11:13.778486+0000","last_became_peered":"2023-07-14T18:11:13.778486+0000","last_unstale":"2023-07-14T18:12:16.781483+0000","last_undegraded":"2023-07-14T18:12:16.781483+0000","last_fullsized":"2023-07-14T18:12:16.781483+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:12.753466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:12.753466+0000","last_clean_scrub_stamp":"2023-07-14T18:11:12.753466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:43:53.682087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,9,5],"acting":[4,3,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"84'12","reported_seq":39,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T18:12:16.785096+0000","last_change":"2023-07-14T18:11:08.688289+0000","last_active":"2023-07-14T18:12:16.785096+0000","last_peered":"2023-07-14T18:12:16.785096+0000","last_clean":"2023-07-14T18:12:16.785096+0000","last_became_active":"2023-07-14T18:11:08.687994+0000","last_became_peered":"2023-07-14T18:11:08.687994+0000","last_unstale":"2023-07-14T18:12:16.785096+0000","last_undegraded":"2023-07-14T18:12:16.785096+0000","last_fullsized":"2023-07-14T18:12:16.785096+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:07.665746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:07.665746+0000","last_clean_scrub_stamp":"2023-07-14T18:11:07.665746+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:47:18.133067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"86'9","reported_seq":33,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T18:12:45.459908+0000","last_change":"2023-07-14T18:11:09.711910+0000","last_active":"2023-07-14T18:12:45.459908+0000","last_peered":"2023-07-14T18:12:45.459908+0000","last_clean":"2023-07-14T18:12:45.459908+0000","last_became_active":"2023-07-14T18:11:09.711634+0000","last_became_peered":"2023-07-14T18:11:09.711634+0000","last_unstale":"2023-07-14T18:12:45.459908+0000","last_undegraded":"2023-07-14T18:12:45.459908+0000","last_fullsized":"2023-07-14T18:12:45.459908+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_clean_scrub_stamp":"2023-07-14T18:11:08.667354+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:25:00.505872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T18:12:16.781337+0000","last_change":"2023-07-14T18:11:13.778662+0000","last_active":"2023-07-14T18:12:16.781337+0000","last_peered":"2023-07-14T18:12:16.781337+0000","last_clean":"2023-07-14T18:12:16.781337+0000","last_became_active":"2023-07-14T18:11:13.777886+0000","last_became_peered":"2023-07-14T18:11:13.777886+0000","last_unstale":"2023-07-14T18:12:16.781337+0000","last_undegraded":"2023-07-14T18:12:16.781337+0000","last_fullsized":"2023-07-14T18:12:16.781337+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:12.753466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:12.753466+0000","last_clean_scrub_stamp":"2023-07-14T18:11:12.753466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T02:12:35.751856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"84'5","reported_seq":32,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T18:12:16.785924+0000","last_change":"2023-07-14T18:11:08.683774+0000","last_active":"2023-07-14T18:12:16.785924+0000","last_peered":"2023-07-14T18:12:16.785924+0000","last_clean":"2023-07-14T18:12:16.785924+0000","last_became_active":"2023-07-14T18:11:08.683458+0000","last_became_peered":"2023-07-14T18:11:08.683458+0000","last_unstale":"2023-07-14T18:12:16.785924+0000","last_undegraded":"2023-07-14T18:12:16.785924+0000","last_fullsized":"2023-07-14T18:12:16.785924+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:07.665746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:07.665746+0000","last_clean_scrub_stamp":"2023-07-14T18:11:07.665746+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T04:36:23.290219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"86'15","reported_seq":39,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T18:12:45.456481+0000","last_change":"2023-07-14T18:11:09.716041+0000","last_active":"2023-07-14T18:12:45.456481+0000","last_peered":"2023-07-14T18:12:45.456481+0000","last_clean":"2023-07-14T18:12:45.456481+0000","last_became_active":"2023-07-14T18:11:09.715367+0000","last_became_peered":"2023-07-14T18:11:09.715367+0000","last_unstale":"2023-07-14T18:12:45.456481+0000","last_undegraded":"2023-07-14T18:12:45.456481+0000","last_fullsized":"2023-07-14T18:12:45.456481+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_clean_scrub_stamp":"2023-07-14T18:11:08.667354+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T03:55:10.713872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T18:12:16.784204+0000","last_change":"2023-07-14T18:11:13.776527+0000","last_active":"2023-07-14T18:12:16.784204+0000","last_peered":"2023-07-14T18:12:16.784204+0000","last_clean":"2023-07-14T18:12:16.784204+0000","last_became_active":"2023-07-14T18:11:13.776032+0000","last_became_peered":"2023-07-14T18:11:13.776032+0000","last_unstale":"2023-07-14T18:12:16.784204+0000","last_undegraded":"2023-07-14T18:12:16.784204+0000","last_fullsized":"2023-07-14T18:12:16.784204+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:12.753466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:12.753466+0000","last_clean_scrub_stamp":"2023-07-14T18:11:12.753466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:28:26.705389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"86'6","reported_seq":112,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T18:12:46.881557+0000","last_change":"2023-07-14T18:11:08.687533+0000","last_active":"2023-07-14T18:12:46.881557+0000","last_peered":"2023-07-14T18:12:46.881557+0000","last_clean":"2023-07-14T18:12:46.881557+0000","last_became_active":"2023-07-14T18:11:08.687242+0000","last_became_peered":"2023-07-14T18:11:08.687242+0000","last_unstale":"2023-07-14T18:12:46.881557+0000","last_undegraded":"2023-07-14T18:12:46.881557+0000","last_fullsized":"2023-07-14T18:12:46.881557+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:07.665746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:07.665746+0000","last_clean_scrub_stamp":"2023-07-14T18:11:07.665746+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:35:48.553302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1073,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":80,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"86'7","reported_seq":31,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T18:12:45.438169+0000","last_change":"2023-07-14T18:11:09.707937+0000","last_active":"2023-07-14T18:12:45.438169+0000","last_peered":"2023-07-14T18:12:45.438169+0000","last_clean":"2023-07-14T18:12:45.438169+0000","last_became_active":"2023-07-14T18:11:09.707637+0000","last_became_peered":"2023-07-14T18:11:09.707637+0000","last_unstale":"2023-07-14T18:12:45.438169+0000","last_undegraded":"2023-07-14T18:12:45.438169+0000","last_fullsized":"2023-07-14T18:12:45.438169+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_clean_scrub_stamp":"2023-07-14T18:11:08.667354+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T01:53:50.131794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T18:12:16.783721+0000","last_change":"2023-07-14T18:11:13.791360+0000","last_active":"2023-07-14T18:12:16.783721+0000","last_peered":"2023-07-14T18:12:16.783721+0000","last_clean":"2023-07-14T18:12:16.783721+0000","last_became_active":"2023-07-14T18:11:13.790894+0000","last_became_peered":"2023-07-14T18:11:13.790894+0000","last_unstale":"2023-07-14T18:12:16.783721+0000","last_undegraded":"2023-07-14T18:12:16.783721+0000","last_fullsized":"2023-07-14T18:12:16.783721+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:12.753466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:12.753466+0000","last_clean_scrub_stamp":"2023-07-14T18:11:12.753466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:35:28.884052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,9,5],"acting":[2,6,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1a","version":"84'7","reported_seq":33,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T18:12:16.784280+0000","last_change":"2023-07-14T18:11:08.687315+0000","last_active":"2023-07-14T18:12:16.784280+0000","last_peered":"2023-07-14T18:12:16.784280+0000","last_clean":"2023-07-14T18:12:16.784280+0000","last_became_active":"2023-07-14T18:11:08.687061+0000","last_became_peered":"2023-07-14T18:11:08.687061+0000","last_unstale":"2023-07-14T18:12:16.784280+0000","last_undegraded":"2023-07-14T18:12:16.784280+0000","last_fullsized":"2023-07-14T18:12:16.784280+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:07.665746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:07.665746+0000","last_clean_scrub_stamp":"2023-07-14T18:11:07.665746+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:42:54.830869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"86'8","reported_seq":32,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T18:12:45.448831+0000","last_change":"2023-07-14T18:11:09.715816+0000","last_active":"2023-07-14T18:12:45.448831+0000","last_peered":"2023-07-14T18:12:45.448831+0000","last_clean":"2023-07-14T18:12:45.448831+0000","last_became_active":"2023-07-14T18:11:09.715038+0000","last_became_peered":"2023-07-14T18:11:09.715038+0000","last_unstale":"2023-07-14T18:12:45.448831+0000","last_undegraded":"2023-07-14T18:12:45.448831+0000","last_fullsized":"2023-07-14T18:12:45.448831+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_clean_scrub_stamp":"2023-07-14T18:11:08.667354+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:42:32.821947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T18:12:16.785977+0000","last_change":"2023-07-14T18:11:13.791438+0000","last_active":"2023-07-14T18:12:16.785977+0000","last_peered":"2023-07-14T18:12:16.785977+0000","last_clean":"2023-07-14T18:12:16.785977+0000","last_became_active":"2023-07-14T18:11:13.790956+0000","last_became_peered":"2023-07-14T18:11:13.790956+0000","last_unstale":"2023-07-14T18:12:16.785977+0000","last_undegraded":"2023-07-14T18:12:16.785977+0000","last_fullsized":"2023-07-14T18:12:16.785977+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:12.753466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:12.753466+0000","last_clean_scrub_stamp":"2023-07-14T18:11:12.753466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:12:53.328964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.19","version":"84'3","reported_seq":29,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T18:12:16.784139+0000","last_change":"2023-07-14T18:11:08.693751+0000","last_active":"2023-07-14T18:12:16.784139+0000","last_peered":"2023-07-14T18:12:16.784139+0000","last_clean":"2023-07-14T18:12:16.784139+0000","last_became_active":"2023-07-14T18:11:08.693427+0000","last_became_peered":"2023-07-14T18:11:08.693427+0000","last_unstale":"2023-07-14T18:12:16.784139+0000","last_undegraded":"2023-07-14T18:12:16.784139+0000","last_fullsized":"2023-07-14T18:12:16.784139+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:07.665746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:07.665746+0000","last_clean_scrub_stamp":"2023-07-14T18:11:07.665746+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T02:11:51.982350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"86'8","reported_seq":32,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T18:12:45.445843+0000","last_change":"2023-07-14T18:11:09.709761+0000","last_active":"2023-07-14T18:12:45.445843+0000","last_peered":"2023-07-14T18:12:45.445843+0000","last_clean":"2023-07-14T18:12:45.445843+0000","last_became_active":"2023-07-14T18:11:09.709157+0000","last_became_peered":"2023-07-14T18:11:09.709157+0000","last_unstale":"2023-07-14T18:12:45.445843+0000","last_undegraded":"2023-07-14T18:12:45.445843+0000","last_fullsized":"2023-07-14T18:12:45.445843+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_clean_scrub_stamp":"2023-07-14T18:11:08.667354+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T04:58:39.280985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T18:12:16.783570+0000","last_change":"2023-07-14T18:11:13.779265+0000","last_active":"2023-07-14T18:12:16.783570+0000","last_peered":"2023-07-14T18:12:16.783570+0000","last_clean":"2023-07-14T18:12:16.783570+0000","last_became_active":"2023-07-14T18:11:13.778865+0000","last_became_peered":"2023-07-14T18:11:13.778865+0000","last_unstale":"2023-07-14T18:12:16.783570+0000","last_undegraded":"2023-07-14T18:12:16.783570+0000","last_fullsized":"2023-07-14T18:12:16.783570+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:12.753466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:12.753466+0000","last_clean_scrub_stamp":"2023-07-14T18:11:12.753466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T05:03:04.869864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.18","version":"84'3","reported_seq":30,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T18:12:16.780833+0000","last_change":"2023-07-14T18:11:08.684513+0000","last_active":"2023-07-14T18:12:16.780833+0000","last_peered":"2023-07-14T18:12:16.780833+0000","last_clean":"2023-07-14T18:12:16.780833+0000","last_became_active":"2023-07-14T18:11:08.684213+0000","last_became_peered":"2023-07-14T18:11:08.684213+0000","last_unstale":"2023-07-14T18:12:16.780833+0000","last_undegraded":"2023-07-14T18:12:16.780833+0000","last_fullsized":"2023-07-14T18:12:16.780833+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:07.665746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:07.665746+0000","last_clean_scrub_stamp":"2023-07-14T18:11:07.665746+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:55:49.407191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"86'11","reported_seq":35,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T18:12:45.439367+0000","last_change":"2023-07-14T18:11:09.712427+0000","last_active":"2023-07-14T18:12:45.439367+0000","last_peered":"2023-07-14T18:12:45.439367+0000","last_clean":"2023-07-14T18:12:45.439367+0000","last_became_active":"2023-07-14T18:11:09.712104+0000","last_became_peered":"2023-07-14T18:11:09.712104+0000","last_unstale":"2023-07-14T18:12:45.439367+0000","last_undegraded":"2023-07-14T18:12:45.439367+0000","last_fullsized":"2023-07-14T18:12:45.439367+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_clean_scrub_stamp":"2023-07-14T18:11:08.667354+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:03:50.820456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T18:12:16.779940+0000","last_change":"2023-07-14T18:11:13.777892+0000","last_active":"2023-07-14T18:12:16.779940+0000","last_peered":"2023-07-14T18:12:16.779940+0000","last_clean":"2023-07-14T18:12:16.779940+0000","last_became_active":"2023-07-14T18:11:13.777518+0000","last_became_peered":"2023-07-14T18:11:13.777518+0000","last_unstale":"2023-07-14T18:12:16.779940+0000","last_undegraded":"2023-07-14T18:12:16.779940+0000","last_fullsized":"2023-07-14T18:12:16.779940+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:12.753466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:12.753466+0000","last_clean_scrub_stamp":"2023-07-14T18:11:12.753466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T02:25:56.668715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.17","version":"86'6","reported_seq":188,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T18:12:47.883339+0000","last_change":"2023-07-14T18:11:08.684141+0000","last_active":"2023-07-14T18:12:47.883339+0000","last_peered":"2023-07-14T18:12:47.883339+0000","last_clean":"2023-07-14T18:12:47.883339+0000","last_became_active":"2023-07-14T18:11:08.683767+0000","last_became_peered":"2023-07-14T18:11:08.683767+0000","last_unstale":"2023-07-14T18:12:47.883339+0000","last_undegraded":"2023-07-14T18:12:47.883339+0000","last_fullsized":"2023-07-14T18:12:47.883339+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:07.665746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:07.665746+0000","last_clean_scrub_stamp":"2023-07-14T18:11:07.665746+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T05:36:42.284552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":156,"num_read_kb":156,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"86'10","reported_seq":34,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T18:12:45.459551+0000","last_change":"2023-07-14T18:11:09.710975+0000","last_active":"2023-07-14T18:12:45.459551+0000","last_peered":"2023-07-14T18:12:45.459551+0000","last_clean":"2023-07-14T18:12:45.459551+0000","last_became_active":"2023-07-14T18:11:09.710690+0000","last_became_peered":"2023-07-14T18:11:09.710690+0000","last_unstale":"2023-07-14T18:12:45.459551+0000","last_undegraded":"2023-07-14T18:12:45.459551+0000","last_fullsized":"2023-07-14T18:12:45.459551+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_clean_scrub_stamp":"2023-07-14T18:11:08.667354+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:39:03.999443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T18:12:16.819496+0000","last_change":"2023-07-14T18:11:13.789251+0000","last_active":"2023-07-14T18:12:16.819496+0000","last_peered":"2023-07-14T18:12:16.819496+0000","last_clean":"2023-07-14T18:12:16.819496+0000","last_became_active":"2023-07-14T18:11:13.788742+0000","last_became_peered":"2023-07-14T18:11:13.788742+0000","last_unstale":"2023-07-14T18:12:16.819496+0000","last_undegraded":"2023-07-14T18:12:16.819496+0000","last_fullsized":"2023-07-14T18:12:16.819496+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:12.753466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:12.753466+0000","last_clean_scrub_stamp":"2023-07-14T18:11:12.753466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T03:20:00.785057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0,2,4],"acting":[9,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.16","version":"84'4","reported_seq":28,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T18:12:16.844891+0000","last_change":"2023-07-14T18:11:08.692093+0000","last_active":"2023-07-14T18:12:16.844891+0000","last_peered":"2023-07-14T18:12:16.844891+0000","last_clean":"2023-07-14T18:12:16.844891+0000","last_became_active":"2023-07-14T18:11:08.691806+0000","last_became_peered":"2023-07-14T18:11:08.691806+0000","last_unstale":"2023-07-14T18:12:16.844891+0000","last_undegraded":"2023-07-14T18:12:16.844891+0000","last_fullsized":"2023-07-14T18:12:16.844891+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:07.665746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:07.665746+0000","last_clean_scrub_stamp":"2023-07-14T18:11:07.665746+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:21:48.736019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"86'9","reported_seq":33,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T18:12:45.448023+0000","last_change":"2023-07-14T18:11:09.714965+0000","last_active":"2023-07-14T18:12:45.448023+0000","last_peered":"2023-07-14T18:12:45.448023+0000","last_clean":"2023-07-14T18:12:45.448023+0000","last_became_active":"2023-07-14T18:11:09.714676+0000","last_became_peered":"2023-07-14T18:11:09.714676+0000","last_unstale":"2023-07-14T18:12:45.448023+0000","last_undegraded":"2023-07-14T18:12:45.448023+0000","last_fullsized":"2023-07-14T18:12:45.448023+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_clean_scrub_stamp":"2023-07-14T18:11:08.667354+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:24:25.210635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T18:12:16.781786+0000","last_change":"2023-07-14T18:11:13.779218+0000","last_active":"2023-07-14T18:12:16.781786+0000","last_peered":"2023-07-14T18:12:16.781786+0000","last_clean":"2023-07-14T18:12:16.781786+0000","last_became_active":"2023-07-14T18:11:13.778833+0000","last_became_peered":"2023-07-14T18:11:13.778833+0000","last_unstale":"2023-07-14T18:12:16.781786+0000","last_undegraded":"2023-07-14T18:12:16.781786+0000","last_fullsized":"2023-07-14T18:12:16.781786+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:12.753466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:12.753466+0000","last_clean_scrub_stamp":"2023-07-14T18:11:12.753466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:07:21.597981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,9],"acting":[4,1,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"84'5","reported_seq":32,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T18:12:16.781131+0000","last_change":"2023-07-14T18:11:08.681778+0000","last_active":"2023-07-14T18:12:16.781131+0000","last_peered":"2023-07-14T18:12:16.781131+0000","last_clean":"2023-07-14T18:12:16.781131+0000","last_became_active":"2023-07-14T18:11:08.681406+0000","last_became_peered":"2023-07-14T18:11:08.681406+0000","last_unstale":"2023-07-14T18:12:16.781131+0000","last_undegraded":"2023-07-14T18:12:16.781131+0000","last_fullsized":"2023-07-14T18:12:16.781131+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:07.665746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:07.665746+0000","last_clean_scrub_stamp":"2023-07-14T18:11:07.665746+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T03:36:14.531699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"86'11","reported_seq":35,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T18:12:45.460044+0000","last_change":"2023-07-14T18:11:09.703070+0000","last_active":"2023-07-14T18:12:45.460044+0000","last_peered":"2023-07-14T18:12:45.460044+0000","last_clean":"2023-07-14T18:12:45.460044+0000","last_became_active":"2023-07-14T18:11:09.702754+0000","last_became_peered":"2023-07-14T18:11:09.702754+0000","last_unstale":"2023-07-14T18:12:45.460044+0000","last_undegraded":"2023-07-14T18:12:45.460044+0000","last_fullsized":"2023-07-14T18:12:45.460044+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_clean_scrub_stamp":"2023-07-14T18:11:08.667354+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:33:45.980597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T18:12:16.789910+0000","last_change":"2023-07-14T18:12:16.789325+0000","last_active":"2023-07-14T18:12:16.789910+0000","last_peered":"2023-07-14T18:12:16.789910+0000","last_clean":"2023-07-14T18:12:16.789910+0000","last_became_active":"2023-07-14T18:12:16.788834+0000","last_became_peered":"2023-07-14T18:12:16.788834+0000","last_unstale":"2023-07-14T18:12:16.789910+0000","last_undegraded":"2023-07-14T18:12:16.789910+0000","last_fullsized":"2023-07-14T18:12:16.789910+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:12.753466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:12.753466+0000","last_clean_scrub_stamp":"2023-07-14T18:11:12.753466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:12:10.461021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,11,5],"acting":[10,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.14","version":"86'37","reported_seq":228,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T18:12:47.883703+0000","last_change":"2023-07-14T18:11:08.690538+0000","last_active":"2023-07-14T18:12:47.883703+0000","last_peered":"2023-07-14T18:12:47.883703+0000","last_clean":"2023-07-14T18:12:47.883703+0000","last_became_active":"2023-07-14T18:11:08.690152+0000","last_became_peered":"2023-07-14T18:11:08.690152+0000","last_unstale":"2023-07-14T18:12:47.883703+0000","last_undegraded":"2023-07-14T18:12:47.883703+0000","last_fullsized":"2023-07-14T18:12:47.883703+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:07.665746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:07.665746+0000","last_clean_scrub_stamp":"2023-07-14T18:11:07.665746+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:01:20.282110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":61585,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":165,"num_read_kb":143,"num_write":39,"num_write_kb":76,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"86'6","reported_seq":30,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T18:12:45.442428+0000","last_change":"2023-07-14T18:11:09.710116+0000","last_active":"2023-07-14T18:12:45.442428+0000","last_peered":"2023-07-14T18:12:45.442428+0000","last_clean":"2023-07-14T18:12:45.442428+0000","last_became_active":"2023-07-14T18:11:09.709831+0000","last_became_peered":"2023-07-14T18:11:09.709831+0000","last_unstale":"2023-07-14T18:12:45.442428+0000","last_undegraded":"2023-07-14T18:12:45.442428+0000","last_fullsized":"2023-07-14T18:12:45.442428+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_clean_scrub_stamp":"2023-07-14T18:11:08.667354+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T02:26:12.205510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T18:12:16.782224+0000","last_change":"2023-07-14T18:11:13.777434+0000","last_active":"2023-07-14T18:12:16.782224+0000","last_peered":"2023-07-14T18:12:16.782224+0000","last_clean":"2023-07-14T18:12:16.782224+0000","last_became_active":"2023-07-14T18:11:13.776670+0000","last_became_peered":"2023-07-14T18:11:13.776670+0000","last_unstale":"2023-07-14T18:12:16.782224+0000","last_undegraded":"2023-07-14T18:12:16.782224+0000","last_fullsized":"2023-07-14T18:12:16.782224+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:12.753466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:12.753466+0000","last_clean_scrub_stamp":"2023-07-14T18:11:12.753466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:07:14.576233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.13","version":"84'9","reported_seq":37,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T18:12:16.783466+0000","last_change":"2023-07-14T18:11:08.693172+0000","last_active":"2023-07-14T18:12:16.783466+0000","last_peered":"2023-07-14T18:12:16.783466+0000","last_clean":"2023-07-14T18:12:16.783466+0000","last_became_active":"2023-07-14T18:11:08.692846+0000","last_became_peered":"2023-07-14T18:11:08.692846+0000","last_unstale":"2023-07-14T18:12:16.783466+0000","last_undegraded":"2023-07-14T18:12:16.783466+0000","last_fullsized":"2023-07-14T18:12:16.783466+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:07.665746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:07.665746+0000","last_clean_scrub_stamp":"2023-07-14T18:11:07.665746+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:36:37.277838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"86'9","reported_seq":33,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T18:12:45.448686+0000","last_change":"2023-07-14T18:11:09.708480+0000","last_active":"2023-07-14T18:12:45.448686+0000","last_peered":"2023-07-14T18:12:45.448686+0000","last_clean":"2023-07-14T18:12:45.448686+0000","last_became_active":"2023-07-14T18:11:09.708170+0000","last_became_peered":"2023-07-14T18:11:09.708170+0000","last_unstale":"2023-07-14T18:12:45.448686+0000","last_undegraded":"2023-07-14T18:12:45.448686+0000","last_fullsized":"2023-07-14T18:12:45.448686+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_clean_scrub_stamp":"2023-07-14T18:11:08.667354+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T02:05:02.970953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":24,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T18:12:16.846239+0000","last_change":"2023-07-14T18:12:16.846239+0000","last_active":"2023-07-14T18:12:16.846239+0000","last_peered":"2023-07-14T18:12:16.846239+0000","last_clean":"2023-07-14T18:12:16.846239+0000","last_became_active":"2023-07-14T18:12:16.845489+0000","last_became_peered":"2023-07-14T18:12:16.845489+0000","last_unstale":"2023-07-14T18:12:16.846239+0000","last_undegraded":"2023-07-14T18:12:16.846239+0000","last_fullsized":"2023-07-14T18:12:16.846239+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:12.753466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:12.753466+0000","last_clean_scrub_stamp":"2023-07-14T18:11:12.753466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T05:12:40.610555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,7,6],"acting":[11,8,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.12","version":"84'5","reported_seq":32,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T18:12:16.781367+0000","last_change":"2023-07-14T18:11:08.685028+0000","last_active":"2023-07-14T18:12:16.781367+0000","last_peered":"2023-07-14T18:12:16.781367+0000","last_clean":"2023-07-14T18:12:16.781367+0000","last_became_active":"2023-07-14T18:11:08.684701+0000","last_became_peered":"2023-07-14T18:11:08.684701+0000","last_unstale":"2023-07-14T18:12:16.781367+0000","last_undegraded":"2023-07-14T18:12:16.781367+0000","last_fullsized":"2023-07-14T18:12:16.781367+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:07.665746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:07.665746+0000","last_clean_scrub_stamp":"2023-07-14T18:11:07.665746+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:40:38.432876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"86'15","reported_seq":37,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T18:12:45.454427+0000","last_change":"2023-07-14T18:11:09.717714+0000","last_active":"2023-07-14T18:12:45.454427+0000","last_peered":"2023-07-14T18:12:45.454427+0000","last_clean":"2023-07-14T18:12:45.454427+0000","last_became_active":"2023-07-14T18:11:09.717407+0000","last_became_peered":"2023-07-14T18:11:09.717407+0000","last_unstale":"2023-07-14T18:12:45.454427+0000","last_undegraded":"2023-07-14T18:12:45.454427+0000","last_fullsized":"2023-07-14T18:12:45.454427+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_clean_scrub_stamp":"2023-07-14T18:11:08.667354+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:12:24.283577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T18:12:16.845564+0000","last_change":"2023-07-14T18:12:16.845564+0000","last_active":"2023-07-14T18:12:16.845564+0000","last_peered":"2023-07-14T18:12:16.845564+0000","last_clean":"2023-07-14T18:12:16.845564+0000","last_became_active":"2023-07-14T18:12:16.845084+0000","last_became_peered":"2023-07-14T18:12:16.845084+0000","last_unstale":"2023-07-14T18:12:16.845564+0000","last_undegraded":"2023-07-14T18:12:16.845564+0000","last_fullsized":"2023-07-14T18:12:16.845564+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:12.753466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:12.753466+0000","last_clean_scrub_stamp":"2023-07-14T18:11:12.753466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:52:49.779161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,7,0,3],"acting":[8,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.11","version":"86'8","reported_seq":115,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T18:12:46.881854+0000","last_change":"2023-07-14T18:11:08.685327+0000","last_active":"2023-07-14T18:12:46.881854+0000","last_peered":"2023-07-14T18:12:46.881854+0000","last_clean":"2023-07-14T18:12:46.881854+0000","last_became_active":"2023-07-14T18:11:08.684969+0000","last_became_peered":"2023-07-14T18:11:08.684969+0000","last_unstale":"2023-07-14T18:12:46.881854+0000","last_undegraded":"2023-07-14T18:12:46.881854+0000","last_fullsized":"2023-07-14T18:12:46.881854+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:07.665746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:07.665746+0000","last_clean_scrub_stamp":"2023-07-14T18:11:07.665746+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:42:58.262688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1570,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":82,"num_read_kb":5,"num_write":8,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"86'6","reported_seq":28,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T18:12:45.439837+0000","last_change":"2023-07-14T18:11:09.721100+0000","last_active":"2023-07-14T18:12:45.439837+0000","last_peered":"2023-07-14T18:12:45.439837+0000","last_clean":"2023-07-14T18:12:45.439837+0000","last_became_active":"2023-07-14T18:11:09.720814+0000","last_became_peered":"2023-07-14T18:11:09.720814+0000","last_unstale":"2023-07-14T18:12:45.439837+0000","last_undegraded":"2023-07-14T18:12:45.439837+0000","last_fullsized":"2023-07-14T18:12:45.439837+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_clean_scrub_stamp":"2023-07-14T18:11:08.667354+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T02:25:55.031694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T18:12:16.785211+0000","last_change":"2023-07-14T18:11:13.782152+0000","last_active":"2023-07-14T18:12:16.785211+0000","last_peered":"2023-07-14T18:12:16.785211+0000","last_clean":"2023-07-14T18:12:16.785211+0000","last_became_active":"2023-07-14T18:11:13.780580+0000","last_became_peered":"2023-07-14T18:11:13.780580+0000","last_unstale":"2023-07-14T18:12:16.785211+0000","last_undegraded":"2023-07-14T18:12:16.785211+0000","last_fullsized":"2023-07-14T18:12:16.785211+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:12.753466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:12.753466+0000","last_clean_scrub_stamp":"2023-07-14T18:11:12.753466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T05:55:08.131862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"84'17","reported_seq":44,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T18:12:16.784517+0000","last_change":"2023-07-14T18:11:08.688954+0000","last_active":"2023-07-14T18:12:16.784517+0000","last_peered":"2023-07-14T18:12:16.784517+0000","last_clean":"2023-07-14T18:12:16.784517+0000","last_became_active":"2023-07-14T18:11:08.688640+0000","last_became_peered":"2023-07-14T18:11:08.688640+0000","last_unstale":"2023-07-14T18:12:16.784517+0000","last_undegraded":"2023-07-14T18:12:16.784517+0000","last_fullsized":"2023-07-14T18:12:16.784517+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:07.665746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:07.665746+0000","last_clean_scrub_stamp":"2023-07-14T18:11:07.665746+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T01:34:25.106586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"86'6","reported_seq":30,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T18:12:45.448705+0000","last_change":"2023-07-14T18:11:09.710105+0000","last_active":"2023-07-14T18:12:45.448705+0000","last_peered":"2023-07-14T18:12:45.448705+0000","last_clean":"2023-07-14T18:12:45.448705+0000","last_became_active":"2023-07-14T18:11:09.709820+0000","last_became_peered":"2023-07-14T18:11:09.709820+0000","last_unstale":"2023-07-14T18:12:45.448705+0000","last_undegraded":"2023-07-14T18:12:45.448705+0000","last_fullsized":"2023-07-14T18:12:45.448705+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_clean_scrub_stamp":"2023-07-14T18:11:08.667354+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:41:52.837220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T18:12:16.781623+0000","last_change":"2023-07-14T18:11:13.780122+0000","last_active":"2023-07-14T18:12:16.781623+0000","last_peered":"2023-07-14T18:12:16.781623+0000","last_clean":"2023-07-14T18:12:16.781623+0000","last_became_active":"2023-07-14T18:11:13.779774+0000","last_became_peered":"2023-07-14T18:11:13.779774+0000","last_unstale":"2023-07-14T18:12:16.781623+0000","last_undegraded":"2023-07-14T18:12:16.781623+0000","last_fullsized":"2023-07-14T18:12:16.781623+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:12.753466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:12.753466+0000","last_clean_scrub_stamp":"2023-07-14T18:11:12.753466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T04:27:27.478680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"86'3","reported_seq":30,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T18:12:16.784347+0000","last_change":"2023-07-14T18:11:08.686080+0000","last_active":"2023-07-14T18:12:16.784347+0000","last_peered":"2023-07-14T18:12:16.784347+0000","last_clean":"2023-07-14T18:12:16.784347+0000","last_became_active":"2023-07-14T18:11:08.685837+0000","last_became_peered":"2023-07-14T18:11:08.685837+0000","last_unstale":"2023-07-14T18:12:16.784347+0000","last_undegraded":"2023-07-14T18:12:16.784347+0000","last_fullsized":"2023-07-14T18:12:16.784347+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:07.665746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:07.665746+0000","last_clean_scrub_stamp":"2023-07-14T18:11:07.665746+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:30:04.697099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"86'5","reported_seq":29,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T18:12:45.455440+0000","last_change":"2023-07-14T18:11:09.712166+0000","last_active":"2023-07-14T18:12:45.455440+0000","last_peered":"2023-07-14T18:12:45.455440+0000","last_clean":"2023-07-14T18:12:45.455440+0000","last_became_active":"2023-07-14T18:11:09.711858+0000","last_became_peered":"2023-07-14T18:11:09.711858+0000","last_unstale":"2023-07-14T18:12:45.455440+0000","last_undegraded":"2023-07-14T18:12:45.455440+0000","last_fullsized":"2023-07-14T18:12:45.455440+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_clean_scrub_stamp":"2023-07-14T18:11:08.667354+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T02:46:06.166324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T18:12:16.783856+0000","last_change":"2023-07-14T18:11:13.905188+0000","last_active":"2023-07-14T18:12:16.783856+0000","last_peered":"2023-07-14T18:12:16.783856+0000","last_clean":"2023-07-14T18:12:16.783856+0000","last_became_active":"2023-07-14T18:11:13.904779+0000","last_became_peered":"2023-07-14T18:11:13.904779+0000","last_unstale":"2023-07-14T18:12:16.783856+0000","last_undegraded":"2023-07-14T18:12:16.783856+0000","last_fullsized":"2023-07-14T18:12:16.783856+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:12.753466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:12.753466+0000","last_clean_scrub_stamp":"2023-07-14T18:11:12.753466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:03:59.732151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,9],"acting":[8,10,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.4","version":"84'1","reported_seq":27,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T18:12:16.819781+0000","last_change":"2023-07-14T18:11:08.687838+0000","last_active":"2023-07-14T18:12:16.819781+0000","last_peered":"2023-07-14T18:12:16.819781+0000","last_clean":"2023-07-14T18:12:16.819781+0000","last_became_active":"2023-07-14T18:11:08.687522+0000","last_became_peered":"2023-07-14T18:11:08.687522+0000","last_unstale":"2023-07-14T18:12:16.819781+0000","last_undegraded":"2023-07-14T18:12:16.819781+0000","last_fullsized":"2023-07-14T18:12:16.819781+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:07.665746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:07.665746+0000","last_clean_scrub_stamp":"2023-07-14T18:11:07.665746+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T01:02:10.989054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"86'4","reported_seq":28,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T18:12:45.453640+0000","last_change":"2023-07-14T18:11:09.704033+0000","last_active":"2023-07-14T18:12:45.453640+0000","last_peered":"2023-07-14T18:12:45.453640+0000","last_clean":"2023-07-14T18:12:45.453640+0000","last_became_active":"2023-07-14T18:11:09.703727+0000","last_became_peered":"2023-07-14T18:11:09.703727+0000","last_unstale":"2023-07-14T18:12:45.453640+0000","last_undegraded":"2023-07-14T18:12:45.453640+0000","last_fullsized":"2023-07-14T18:12:45.453640+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_clean_scrub_stamp":"2023-07-14T18:11:08.667354+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:12:28.187627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T18:12:16.784685+0000","last_change":"2023-07-14T18:11:13.778207+0000","last_active":"2023-07-14T18:12:16.784685+0000","last_peered":"2023-07-14T18:12:16.784685+0000","last_clean":"2023-07-14T18:12:16.784685+0000","last_became_active":"2023-07-14T18:11:13.777847+0000","last_became_peered":"2023-07-14T18:11:13.777847+0000","last_unstale":"2023-07-14T18:12:16.784685+0000","last_undegraded":"2023-07-14T18:12:16.784685+0000","last_fullsized":"2023-07-14T18:12:16.784685+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:12.753466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:12.753466+0000","last_clean_scrub_stamp":"2023-07-14T18:11:12.753466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:35:45.808281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"86'6","reported_seq":111,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T18:12:48.884059+0000","last_change":"2023-07-14T18:11:08.683570+0000","last_active":"2023-07-14T18:12:48.884059+0000","last_peered":"2023-07-14T18:12:48.884059+0000","last_clean":"2023-07-14T18:12:48.884059+0000","last_became_active":"2023-07-14T18:11:08.683271+0000","last_became_peered":"2023-07-14T18:11:08.683271+0000","last_unstale":"2023-07-14T18:12:48.884059+0000","last_undegraded":"2023-07-14T18:12:48.884059+0000","last_fullsized":"2023-07-14T18:12:48.884059+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:07.665746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:07.665746+0000","last_clean_scrub_stamp":"2023-07-14T18:11:07.665746+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:09:15.993784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1039,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":81,"num_read_kb":2,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"86'7","reported_seq":31,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T18:12:45.451711+0000","last_change":"2023-07-14T18:11:09.718239+0000","last_active":"2023-07-14T18:12:45.451711+0000","last_peered":"2023-07-14T18:12:45.451711+0000","last_clean":"2023-07-14T18:12:45.451711+0000","last_became_active":"2023-07-14T18:11:09.717923+0000","last_became_peered":"2023-07-14T18:11:09.717923+0000","last_unstale":"2023-07-14T18:12:45.451711+0000","last_undegraded":"2023-07-14T18:12:45.451711+0000","last_fullsized":"2023-07-14T18:12:45.451711+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_clean_scrub_stamp":"2023-07-14T18:11:08.667354+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T04:14:10.672827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T18:12:16.784912+0000","last_change":"2023-07-14T18:11:13.904652+0000","last_active":"2023-07-14T18:12:16.784912+0000","last_peered":"2023-07-14T18:12:16.784912+0000","last_clean":"2023-07-14T18:12:16.784912+0000","last_became_active":"2023-07-14T18:11:13.904237+0000","last_became_peered":"2023-07-14T18:11:13.904237+0000","last_unstale":"2023-07-14T18:12:16.784912+0000","last_undegraded":"2023-07-14T18:12:16.784912+0000","last_fullsized":"2023-07-14T18:12:16.784912+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:12.753466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:12.753466+0000","last_clean_scrub_stamp":"2023-07-14T18:11:12.753466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:43:21.460670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"86'8","reported_seq":32,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T18:12:45.455030+0000","last_change":"2023-07-14T18:11:09.707086+0000","last_active":"2023-07-14T18:12:45.455030+0000","last_peered":"2023-07-14T18:12:45.455030+0000","last_clean":"2023-07-14T18:12:45.455030+0000","last_became_active":"2023-07-14T18:11:09.705882+0000","last_became_peered":"2023-07-14T18:11:09.705882+0000","last_unstale":"2023-07-14T18:12:45.455030+0000","last_undegraded":"2023-07-14T18:12:45.455030+0000","last_fullsized":"2023-07-14T18:12:45.455030+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_clean_scrub_stamp":"2023-07-14T18:11:08.667354+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:19:33.907849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"86'6","reported_seq":112,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T18:12:47.883218+0000","last_change":"2023-07-14T18:11:08.683447+0000","last_active":"2023-07-14T18:12:47.883218+0000","last_peered":"2023-07-14T18:12:47.883218+0000","last_clean":"2023-07-14T18:12:47.883218+0000","last_became_active":"2023-07-14T18:11:08.682822+0000","last_became_peered":"2023-07-14T18:11:08.682822+0000","last_unstale":"2023-07-14T18:12:47.883218+0000","last_undegraded":"2023-07-14T18:12:47.883218+0000","last_fullsized":"2023-07-14T18:12:47.883218+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:07.665746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:07.665746+0000","last_clean_scrub_stamp":"2023-07-14T18:11:07.665746+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T03:36:18.950081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":80,"num_read_kb":80,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.5","version":"84'1","reported_seq":18,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T18:12:16.844599+0000","last_change":"2023-07-14T18:11:13.780698+0000","last_active":"2023-07-14T18:12:16.844599+0000","last_peered":"2023-07-14T18:12:16.844599+0000","last_clean":"2023-07-14T18:12:16.844599+0000","last_became_active":"2023-07-14T18:11:13.780310+0000","last_became_peered":"2023-07-14T18:11:13.780310+0000","last_unstale":"2023-07-14T18:12:16.844599+0000","last_undegraded":"2023-07-14T18:12:16.844599+0000","last_fullsized":"2023-07-14T18:12:16.844599+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:12.753466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:12.753466+0000","last_clean_scrub_stamp":"2023-07-14T18:11:12.753466+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T06:08:42.872042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":123,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,9],"acting":[7,5,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"86'8","reported_seq":32,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T18:12:45.454252+0000","last_change":"2023-07-14T18:11:09.708728+0000","last_active":"2023-07-14T18:12:45.454252+0000","last_peered":"2023-07-14T18:12:45.454252+0000","last_clean":"2023-07-14T18:12:45.454252+0000","last_became_active":"2023-07-14T18:11:09.708345+0000","last_became_peered":"2023-07-14T18:11:09.708345+0000","last_unstale":"2023-07-14T18:12:45.454252+0000","last_undegraded":"2023-07-14T18:12:45.454252+0000","last_fullsized":"2023-07-14T18:12:45.454252+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_clean_scrub_stamp":"2023-07-14T18:11:08.667354+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:19:40.073079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"84'6","reported_seq":35,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T18:12:16.781636+0000","last_change":"2023-07-14T18:11:08.684495+0000","last_active":"2023-07-14T18:12:16.781636+0000","last_peered":"2023-07-14T18:12:16.781636+0000","last_clean":"2023-07-14T18:12:16.781636+0000","last_became_active":"2023-07-14T18:11:08.684142+0000","last_became_peered":"2023-07-14T18:11:08.684142+0000","last_unstale":"2023-07-14T18:12:16.781636+0000","last_undegraded":"2023-07-14T18:12:16.781636+0000","last_fullsized":"2023-07-14T18:12:16.781636+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:07.665746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:07.665746+0000","last_clean_scrub_stamp":"2023-07-14T18:11:07.665746+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:11:12.155016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"22'137","reported_seq":340,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T18:12:16.844065+0000","last_change":"2023-07-14T18:10:10.733548+0000","last_active":"2023-07-14T18:12:16.844065+0000","last_peered":"2023-07-14T18:12:16.844065+0000","last_clean":"2023-07-14T18:12:16.844065+0000","last_became_active":"2023-07-14T18:10:10.732994+0000","last_became_peered":"2023-07-14T18:10:10.732994+0000","last_unstale":"2023-07-14T18:12:16.844065+0000","last_undegraded":"2023-07-14T18:12:16.844065+0000","last_fullsized":"2023-07-14T18:12:16.844065+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:07:19.893754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:07:19.893754+0000","last_clean_scrub_stamp":"2023-07-14T18:07:19.893754+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:16:39.410680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T18:12:16.781799+0000","last_change":"2023-07-14T18:11:13.905811+0000","last_active":"2023-07-14T18:12:16.781799+0000","last_peered":"2023-07-14T18:12:16.781799+0000","last_clean":"2023-07-14T18:12:16.781799+0000","last_became_active":"2023-07-14T18:11:13.905390+0000","last_became_peered":"2023-07-14T18:11:13.905390+0000","last_unstale":"2023-07-14T18:12:16.781799+0000","last_undegraded":"2023-07-14T18:12:16.781799+0000","last_fullsized":"2023-07-14T18:12:16.781799+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:12.753466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:12.753466+0000","last_clean_scrub_stamp":"2023-07-14T18:11:12.753466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:36:37.437843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,6,10],"acting":[5,9,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1","version":"86'5","reported_seq":35,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T18:12:45.449824+0000","last_change":"2023-07-14T18:12:16.820762+0000","last_active":"2023-07-14T18:12:45.449824+0000","last_peered":"2023-07-14T18:12:45.449824+0000","last_clean":"2023-07-14T18:12:45.449824+0000","last_became_active":"2023-07-14T18:12:16.820314+0000","last_became_peered":"2023-07-14T18:12:16.820314+0000","last_unstale":"2023-07-14T18:12:45.449824+0000","last_undegraded":"2023-07-14T18:12:45.449824+0000","last_fullsized":"2023-07-14T18:12:45.449824+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_clean_scrub_stamp":"2023-07-14T18:11:08.667354+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:41:31.599732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,9,2],"acting":[6,9,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"84'4","reported_seq":28,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T18:12:16.844495+0000","last_change":"2023-07-14T18:11:08.689050+0000","last_active":"2023-07-14T18:12:16.844495+0000","last_peered":"2023-07-14T18:12:16.844495+0000","last_clean":"2023-07-14T18:12:16.844495+0000","last_became_active":"2023-07-14T18:11:08.688777+0000","last_became_peered":"2023-07-14T18:11:08.688777+0000","last_unstale":"2023-07-14T18:12:16.844495+0000","last_undegraded":"2023-07-14T18:12:16.844495+0000","last_fullsized":"2023-07-14T18:12:16.844495+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:07.665746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:07.665746+0000","last_clean_scrub_stamp":"2023-07-14T18:11:07.665746+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:55:29.518680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T18:12:16.784706+0000","last_change":"2023-07-14T18:11:13.776853+0000","last_active":"2023-07-14T18:12:16.784706+0000","last_peered":"2023-07-14T18:12:16.784706+0000","last_clean":"2023-07-14T18:12:16.784706+0000","last_became_active":"2023-07-14T18:11:13.776353+0000","last_became_peered":"2023-07-14T18:11:13.776353+0000","last_unstale":"2023-07-14T18:12:16.784706+0000","last_undegraded":"2023-07-14T18:12:16.784706+0000","last_fullsized":"2023-07-14T18:12:16.784706+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:12.753466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:12.753466+0000","last_clean_scrub_stamp":"2023-07-14T18:11:12.753466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:43:50.815992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.5","version":"84'4","reported_seq":31,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T18:12:16.784876+0000","last_change":"2023-07-14T18:11:08.691634+0000","last_active":"2023-07-14T18:12:16.784876+0000","last_peered":"2023-07-14T18:12:16.784876+0000","last_clean":"2023-07-14T18:12:16.784876+0000","last_became_active":"2023-07-14T18:11:08.691315+0000","last_became_peered":"2023-07-14T18:11:08.691315+0000","last_unstale":"2023-07-14T18:12:16.784876+0000","last_undegraded":"2023-07-14T18:12:16.784876+0000","last_fullsized":"2023-07-14T18:12:16.784876+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:07.665746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:07.665746+0000","last_clean_scrub_stamp":"2023-07-14T18:11:07.665746+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:24:13.839686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"86'9","reported_seq":33,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T18:12:45.449178+0000","last_change":"2023-07-14T18:11:09.707486+0000","last_active":"2023-07-14T18:12:45.449178+0000","last_peered":"2023-07-14T18:12:45.449178+0000","last_clean":"2023-07-14T18:12:45.449178+0000","last_became_active":"2023-07-14T18:11:09.707168+0000","last_became_peered":"2023-07-14T18:11:09.707168+0000","last_unstale":"2023-07-14T18:12:45.449178+0000","last_undegraded":"2023-07-14T18:12:45.449178+0000","last_fullsized":"2023-07-14T18:12:45.449178+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_clean_scrub_stamp":"2023-07-14T18:11:08.667354+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T02:05:41.913228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T18:12:16.779820+0000","last_change":"2023-07-14T18:11:13.905898+0000","last_active":"2023-07-14T18:12:16.779820+0000","last_peered":"2023-07-14T18:12:16.779820+0000","last_clean":"2023-07-14T18:12:16.779820+0000","last_became_active":"2023-07-14T18:11:13.905482+0000","last_became_peered":"2023-07-14T18:11:13.905482+0000","last_unstale":"2023-07-14T18:12:16.779820+0000","last_undegraded":"2023-07-14T18:12:16.779820+0000","last_fullsized":"2023-07-14T18:12:16.779820+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:12.753466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:12.753466+0000","last_clean_scrub_stamp":"2023-07-14T18:11:12.753466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T05:46:41.734287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"84'9","reported_seq":35,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T18:12:16.819945+0000","last_change":"2023-07-14T18:11:08.692339+0000","last_active":"2023-07-14T18:12:16.819945+0000","last_peered":"2023-07-14T18:12:16.819945+0000","last_clean":"2023-07-14T18:12:16.819945+0000","last_became_active":"2023-07-14T18:11:08.692047+0000","last_became_peered":"2023-07-14T18:11:08.692047+0000","last_unstale":"2023-07-14T18:12:16.819945+0000","last_undegraded":"2023-07-14T18:12:16.819945+0000","last_fullsized":"2023-07-14T18:12:16.819945+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:07.665746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:07.665746+0000","last_clean_scrub_stamp":"2023-07-14T18:11:07.665746+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T04:39:07.444831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"86'5","reported_seq":29,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T18:12:45.442930+0000","last_change":"2023-07-14T18:11:09.709900+0000","last_active":"2023-07-14T18:12:45.442930+0000","last_peered":"2023-07-14T18:12:45.442930+0000","last_clean":"2023-07-14T18:12:45.442930+0000","last_became_active":"2023-07-14T18:11:09.709291+0000","last_became_peered":"2023-07-14T18:11:09.709291+0000","last_unstale":"2023-07-14T18:12:45.442930+0000","last_undegraded":"2023-07-14T18:12:45.442930+0000","last_fullsized":"2023-07-14T18:12:45.442930+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_clean_scrub_stamp":"2023-07-14T18:11:08.667354+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:49:34.349407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T18:12:16.783030+0000","last_change":"2023-07-14T18:11:13.777493+0000","last_active":"2023-07-14T18:12:16.783030+0000","last_peered":"2023-07-14T18:12:16.783030+0000","last_clean":"2023-07-14T18:12:16.783030+0000","last_became_active":"2023-07-14T18:11:13.777110+0000","last_became_peered":"2023-07-14T18:11:13.777110+0000","last_unstale":"2023-07-14T18:12:16.783030+0000","last_undegraded":"2023-07-14T18:12:16.783030+0000","last_fullsized":"2023-07-14T18:12:16.783030+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:12.753466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:12.753466+0000","last_clean_scrub_stamp":"2023-07-14T18:11:12.753466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T05:10:40.176326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"84'7","reported_seq":34,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T18:12:16.781941+0000","last_change":"2023-07-14T18:11:08.686832+0000","last_active":"2023-07-14T18:12:16.781941+0000","last_peered":"2023-07-14T18:12:16.781941+0000","last_clean":"2023-07-14T18:12:16.781941+0000","last_became_active":"2023-07-14T18:11:08.686461+0000","last_became_peered":"2023-07-14T18:11:08.686461+0000","last_unstale":"2023-07-14T18:12:16.781941+0000","last_undegraded":"2023-07-14T18:12:16.781941+0000","last_fullsized":"2023-07-14T18:12:16.781941+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:07.665746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:07.665746+0000","last_clean_scrub_stamp":"2023-07-14T18:11:07.665746+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:19:33.834375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"86'7","reported_seq":37,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T18:12:45.443847+0000","last_change":"2023-07-14T18:12:16.787772+0000","last_active":"2023-07-14T18:12:45.443847+0000","last_peered":"2023-07-14T18:12:45.443847+0000","last_clean":"2023-07-14T18:12:45.443847+0000","last_became_active":"2023-07-14T18:12:16.787380+0000","last_became_peered":"2023-07-14T18:12:16.787380+0000","last_unstale":"2023-07-14T18:12:45.443847+0000","last_undegraded":"2023-07-14T18:12:45.443847+0000","last_fullsized":"2023-07-14T18:12:45.443847+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_clean_scrub_stamp":"2023-07-14T18:11:08.667354+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:59:19.831682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,6],"acting":[0,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T18:12:16.781766+0000","last_change":"2023-07-14T18:11:13.905856+0000","last_active":"2023-07-14T18:12:16.781766+0000","last_peered":"2023-07-14T18:12:16.781766+0000","last_clean":"2023-07-14T18:12:16.781766+0000","last_became_active":"2023-07-14T18:11:13.905441+0000","last_became_peered":"2023-07-14T18:11:13.905441+0000","last_unstale":"2023-07-14T18:12:16.781766+0000","last_undegraded":"2023-07-14T18:12:16.781766+0000","last_fullsized":"2023-07-14T18:12:16.781766+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:12.753466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:12.753466+0000","last_clean_scrub_stamp":"2023-07-14T18:11:12.753466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:50:48.995276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,9],"acting":[4,5,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"84'2","reported_seq":38,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T18:12:16.791966+0000","last_change":"2023-07-14T18:12:16.791966+0000","last_active":"2023-07-14T18:12:16.791966+0000","last_peered":"2023-07-14T18:12:16.791966+0000","last_clean":"2023-07-14T18:12:16.791966+0000","last_became_active":"2023-07-14T18:12:16.788710+0000","last_became_peered":"2023-07-14T18:12:16.788710+0000","last_unstale":"2023-07-14T18:12:16.791966+0000","last_undegraded":"2023-07-14T18:12:16.791966+0000","last_fullsized":"2023-07-14T18:12:16.791966+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:07.665746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:07.665746+0000","last_clean_scrub_stamp":"2023-07-14T18:11:07.665746+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T01:02:37.127435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,11,0],"acting":[1,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"86'2","reported_seq":26,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T18:12:45.412509+0000","last_change":"2023-07-14T18:11:09.711219+0000","last_active":"2023-07-14T18:12:45.412509+0000","last_peered":"2023-07-14T18:12:45.412509+0000","last_clean":"2023-07-14T18:12:45.412509+0000","last_became_active":"2023-07-14T18:11:09.711019+0000","last_became_peered":"2023-07-14T18:11:09.711019+0000","last_unstale":"2023-07-14T18:12:45.412509+0000","last_undegraded":"2023-07-14T18:12:45.412509+0000","last_fullsized":"2023-07-14T18:12:45.412509+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_clean_scrub_stamp":"2023-07-14T18:11:08.667354+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:05:55.303542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T18:12:16.820136+0000","last_change":"2023-07-14T18:11:13.788530+0000","last_active":"2023-07-14T18:12:16.820136+0000","last_peered":"2023-07-14T18:12:16.820136+0000","last_clean":"2023-07-14T18:12:16.820136+0000","last_became_active":"2023-07-14T18:11:13.787952+0000","last_became_peered":"2023-07-14T18:11:13.787952+0000","last_unstale":"2023-07-14T18:12:16.820136+0000","last_undegraded":"2023-07-14T18:12:16.820136+0000","last_fullsized":"2023-07-14T18:12:16.820136+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:12.753466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:12.753466+0000","last_clean_scrub_stamp":"2023-07-14T18:11:12.753466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T04:35:56.383081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.9","version":"84'7","reported_seq":33,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T18:12:16.780010+0000","last_change":"2023-07-14T18:11:08.692719+0000","last_active":"2023-07-14T18:12:16.780010+0000","last_peered":"2023-07-14T18:12:16.780010+0000","last_clean":"2023-07-14T18:12:16.780010+0000","last_became_active":"2023-07-14T18:11:08.692390+0000","last_became_peered":"2023-07-14T18:11:08.692390+0000","last_unstale":"2023-07-14T18:12:16.780010+0000","last_undegraded":"2023-07-14T18:12:16.780010+0000","last_fullsized":"2023-07-14T18:12:16.780010+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:07.665746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:07.665746+0000","last_clean_scrub_stamp":"2023-07-14T18:11:07.665746+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T02:05:19.785021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"86'9","reported_seq":33,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T18:12:45.446489+0000","last_change":"2023-07-14T18:11:09.719176+0000","last_active":"2023-07-14T18:12:45.446489+0000","last_peered":"2023-07-14T18:12:45.446489+0000","last_clean":"2023-07-14T18:12:45.446489+0000","last_became_active":"2023-07-14T18:11:09.712667+0000","last_became_peered":"2023-07-14T18:11:09.712667+0000","last_unstale":"2023-07-14T18:12:45.446489+0000","last_undegraded":"2023-07-14T18:12:45.446489+0000","last_fullsized":"2023-07-14T18:12:45.446489+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_clean_scrub_stamp":"2023-07-14T18:11:08.667354+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T05:35:42.346860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.c","version":"84'1","reported_seq":18,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T18:12:16.782001+0000","last_change":"2023-07-14T18:11:13.791717+0000","last_active":"2023-07-14T18:12:16.782001+0000","last_peered":"2023-07-14T18:12:16.782001+0000","last_clean":"2023-07-14T18:12:16.782001+0000","last_became_active":"2023-07-14T18:11:13.791280+0000","last_became_peered":"2023-07-14T18:11:13.791280+0000","last_unstale":"2023-07-14T18:12:16.782001+0000","last_undegraded":"2023-07-14T18:12:16.782001+0000","last_fullsized":"2023-07-14T18:12:16.782001+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:12.753466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:12.753466+0000","last_clean_scrub_stamp":"2023-07-14T18:11:12.753466+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T03:27:09.430530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":123,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9,7,8],"acting":[4,9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"86'4","reported_seq":30,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T18:12:16.783186+0000","last_change":"2023-07-14T18:11:08.692842+0000","last_active":"2023-07-14T18:12:16.783186+0000","last_peered":"2023-07-14T18:12:16.783186+0000","last_clean":"2023-07-14T18:12:16.783186+0000","last_became_active":"2023-07-14T18:11:08.692534+0000","last_became_peered":"2023-07-14T18:11:08.692534+0000","last_unstale":"2023-07-14T18:12:16.783186+0000","last_undegraded":"2023-07-14T18:12:16.783186+0000","last_fullsized":"2023-07-14T18:12:16.783186+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:07.665746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:07.665746+0000","last_clean_scrub_stamp":"2023-07-14T18:11:07.665746+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:42:27.899061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"86'8","reported_seq":32,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T18:12:45.444887+0000","last_change":"2023-07-14T18:11:09.703665+0000","last_active":"2023-07-14T18:12:45.444887+0000","last_peered":"2023-07-14T18:12:45.444887+0000","last_clean":"2023-07-14T18:12:45.444887+0000","last_became_active":"2023-07-14T18:11:09.703288+0000","last_became_peered":"2023-07-14T18:11:09.703288+0000","last_unstale":"2023-07-14T18:12:45.444887+0000","last_undegraded":"2023-07-14T18:12:45.444887+0000","last_fullsized":"2023-07-14T18:12:45.444887+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_clean_scrub_stamp":"2023-07-14T18:11:08.667354+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T03:51:36.436982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T18:12:16.781732+0000","last_change":"2023-07-14T18:11:13.904604+0000","last_active":"2023-07-14T18:12:16.781732+0000","last_peered":"2023-07-14T18:12:16.781732+0000","last_clean":"2023-07-14T18:12:16.781732+0000","last_became_active":"2023-07-14T18:11:13.904245+0000","last_became_peered":"2023-07-14T18:11:13.904245+0000","last_unstale":"2023-07-14T18:12:16.781732+0000","last_undegraded":"2023-07-14T18:12:16.781732+0000","last_fullsized":"2023-07-14T18:12:16.781732+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:12.753466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:12.753466+0000","last_clean_scrub_stamp":"2023-07-14T18:11:12.753466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:25:41.179580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.b","version":"84'4","reported_seq":31,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T18:12:16.783387+0000","last_change":"2023-07-14T18:11:08.689876+0000","last_active":"2023-07-14T18:12:16.783387+0000","last_peered":"2023-07-14T18:12:16.783387+0000","last_clean":"2023-07-14T18:12:16.783387+0000","last_became_active":"2023-07-14T18:11:08.689582+0000","last_became_peered":"2023-07-14T18:11:08.689582+0000","last_unstale":"2023-07-14T18:12:16.783387+0000","last_undegraded":"2023-07-14T18:12:16.783387+0000","last_fullsized":"2023-07-14T18:12:16.783387+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:07.665746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:07.665746+0000","last_clean_scrub_stamp":"2023-07-14T18:11:07.665746+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:15:32.216414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"86'5","reported_seq":27,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T18:12:45.459728+0000","last_change":"2023-07-14T18:11:09.708228+0000","last_active":"2023-07-14T18:12:45.459728+0000","last_peered":"2023-07-14T18:12:45.459728+0000","last_clean":"2023-07-14T18:12:45.459728+0000","last_became_active":"2023-07-14T18:11:09.707985+0000","last_became_peered":"2023-07-14T18:11:09.707985+0000","last_unstale":"2023-07-14T18:12:45.459728+0000","last_undegraded":"2023-07-14T18:12:45.459728+0000","last_fullsized":"2023-07-14T18:12:45.459728+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_clean_scrub_stamp":"2023-07-14T18:11:08.667354+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:27:07.492845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":24,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T18:12:16.846372+0000","last_change":"2023-07-14T18:12:16.846372+0000","last_active":"2023-07-14T18:12:16.846372+0000","last_peered":"2023-07-14T18:12:16.846372+0000","last_clean":"2023-07-14T18:12:16.846372+0000","last_became_active":"2023-07-14T18:12:16.845694+0000","last_became_peered":"2023-07-14T18:12:16.845694+0000","last_unstale":"2023-07-14T18:12:16.846372+0000","last_undegraded":"2023-07-14T18:12:16.846372+0000","last_fullsized":"2023-07-14T18:12:16.846372+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:12.753466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:12.753466+0000","last_clean_scrub_stamp":"2023-07-14T18:11:12.753466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:47:51.174102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,6,7],"acting":[1,8,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.c","version":"86'6","reported_seq":115,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T18:12:48.885610+0000","last_change":"2023-07-14T18:11:08.689560+0000","last_active":"2023-07-14T18:12:48.885610+0000","last_peered":"2023-07-14T18:12:48.885610+0000","last_clean":"2023-07-14T18:12:48.885610+0000","last_became_active":"2023-07-14T18:11:08.689249+0000","last_became_peered":"2023-07-14T18:11:08.689249+0000","last_unstale":"2023-07-14T18:12:48.885610+0000","last_undegraded":"2023-07-14T18:12:48.885610+0000","last_fullsized":"2023-07-14T18:12:48.885610+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:07.665746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:07.665746+0000","last_clean_scrub_stamp":"2023-07-14T18:11:07.665746+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T02:27:36.887787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1621,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":83,"num_read_kb":3,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"86'7","reported_seq":29,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T18:12:45.459191+0000","last_change":"2023-07-14T18:11:09.720321+0000","last_active":"2023-07-14T18:12:45.459191+0000","last_peered":"2023-07-14T18:12:45.459191+0000","last_clean":"2023-07-14T18:12:45.459191+0000","last_became_active":"2023-07-14T18:11:09.720080+0000","last_became_peered":"2023-07-14T18:11:09.720080+0000","last_unstale":"2023-07-14T18:12:45.459191+0000","last_undegraded":"2023-07-14T18:12:45.459191+0000","last_fullsized":"2023-07-14T18:12:45.459191+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_clean_scrub_stamp":"2023-07-14T18:11:08.667354+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:26:11.524921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T18:12:16.782707+0000","last_change":"2023-07-14T18:11:13.779349+0000","last_active":"2023-07-14T18:12:16.782707+0000","last_peered":"2023-07-14T18:12:16.782707+0000","last_clean":"2023-07-14T18:12:16.782707+0000","last_became_active":"2023-07-14T18:11:13.778946+0000","last_became_peered":"2023-07-14T18:11:13.778946+0000","last_unstale":"2023-07-14T18:12:16.782707+0000","last_undegraded":"2023-07-14T18:12:16.782707+0000","last_fullsized":"2023-07-14T18:12:16.782707+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:12.753466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:12.753466+0000","last_clean_scrub_stamp":"2023-07-14T18:11:12.753466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T03:24:52.587800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9,1,4],"acting":[0,9,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"84'3","reported_seq":30,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T18:12:16.781388+0000","last_change":"2023-07-14T18:11:08.683760+0000","last_active":"2023-07-14T18:12:16.781388+0000","last_peered":"2023-07-14T18:12:16.781388+0000","last_clean":"2023-07-14T18:12:16.781388+0000","last_became_active":"2023-07-14T18:11:08.683461+0000","last_became_peered":"2023-07-14T18:11:08.683461+0000","last_unstale":"2023-07-14T18:12:16.781388+0000","last_undegraded":"2023-07-14T18:12:16.781388+0000","last_fullsized":"2023-07-14T18:12:16.781388+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:07.665746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:07.665746+0000","last_clean_scrub_stamp":"2023-07-14T18:11:07.665746+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T03:06:03.065563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"86'6","reported_seq":28,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T18:12:45.444674+0000","last_change":"2023-07-14T18:11:09.708701+0000","last_active":"2023-07-14T18:12:45.444674+0000","last_peered":"2023-07-14T18:12:45.444674+0000","last_clean":"2023-07-14T18:12:45.444674+0000","last_became_active":"2023-07-14T18:11:09.708410+0000","last_became_peered":"2023-07-14T18:11:09.708410+0000","last_unstale":"2023-07-14T18:12:45.444674+0000","last_undegraded":"2023-07-14T18:12:45.444674+0000","last_fullsized":"2023-07-14T18:12:45.444674+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_clean_scrub_stamp":"2023-07-14T18:11:08.667354+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T01:30:56.495611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T18:12:16.780683+0000","last_change":"2023-07-14T18:11:13.776584+0000","last_active":"2023-07-14T18:12:16.780683+0000","last_peered":"2023-07-14T18:12:16.780683+0000","last_clean":"2023-07-14T18:12:16.780683+0000","last_became_active":"2023-07-14T18:11:13.775288+0000","last_became_peered":"2023-07-14T18:11:13.775288+0000","last_unstale":"2023-07-14T18:12:16.780683+0000","last_undegraded":"2023-07-14T18:12:16.780683+0000","last_fullsized":"2023-07-14T18:12:16.780683+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:12.753466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:12.753466+0000","last_clean_scrub_stamp":"2023-07-14T18:11:12.753466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:11:20.760087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"84'5","reported_seq":31,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T18:12:16.785299+0000","last_change":"2023-07-14T18:11:08.687332+0000","last_active":"2023-07-14T18:12:16.785299+0000","last_peered":"2023-07-14T18:12:16.785299+0000","last_clean":"2023-07-14T18:12:16.785299+0000","last_became_active":"2023-07-14T18:11:08.686902+0000","last_became_peered":"2023-07-14T18:11:08.686902+0000","last_unstale":"2023-07-14T18:12:16.785299+0000","last_undegraded":"2023-07-14T18:12:16.785299+0000","last_fullsized":"2023-07-14T18:12:16.785299+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:07.665746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:07.665746+0000","last_clean_scrub_stamp":"2023-07-14T18:11:07.665746+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T01:01:07.005031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"86'9","reported_seq":31,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T18:12:45.444970+0000","last_change":"2023-07-14T18:11:09.719308+0000","last_active":"2023-07-14T18:12:45.444970+0000","last_peered":"2023-07-14T18:12:45.444970+0000","last_clean":"2023-07-14T18:12:45.444970+0000","last_became_active":"2023-07-14T18:11:09.719038+0000","last_became_peered":"2023-07-14T18:11:09.719038+0000","last_unstale":"2023-07-14T18:12:45.444970+0000","last_undegraded":"2023-07-14T18:12:45.444970+0000","last_fullsized":"2023-07-14T18:12:45.444970+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_clean_scrub_stamp":"2023-07-14T18:11:08.667354+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:07:46.868778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"86'9","reported_seq":33,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T18:12:45.446725+0000","last_change":"2023-07-14T18:11:09.710991+0000","last_active":"2023-07-14T18:12:45.446725+0000","last_peered":"2023-07-14T18:12:45.446725+0000","last_clean":"2023-07-14T18:12:45.446725+0000","last_became_active":"2023-07-14T18:11:09.710689+0000","last_became_peered":"2023-07-14T18:11:09.710689+0000","last_unstale":"2023-07-14T18:12:45.446725+0000","last_undegraded":"2023-07-14T18:12:45.446725+0000","last_fullsized":"2023-07-14T18:12:45.446725+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_clean_scrub_stamp":"2023-07-14T18:11:08.667354+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T02:50:07.310782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"86'12","reported_seq":36,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T18:12:45.455658+0000","last_change":"2023-07-14T18:11:09.711793+0000","last_active":"2023-07-14T18:12:45.455658+0000","last_peered":"2023-07-14T18:12:45.455658+0000","last_clean":"2023-07-14T18:12:45.455658+0000","last_became_active":"2023-07-14T18:11:09.711488+0000","last_became_peered":"2023-07-14T18:11:09.711488+0000","last_unstale":"2023-07-14T18:12:45.455658+0000","last_undegraded":"2023-07-14T18:12:45.455658+0000","last_fullsized":"2023-07-14T18:12:45.455658+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_clean_scrub_stamp":"2023-07-14T18:11:08.667354+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:55:49.699586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"86'8","reported_seq":32,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T18:12:45.447129+0000","last_change":"2023-07-14T18:11:09.707835+0000","last_active":"2023-07-14T18:12:45.447129+0000","last_peered":"2023-07-14T18:12:45.447129+0000","last_clean":"2023-07-14T18:12:45.447129+0000","last_became_active":"2023-07-14T18:11:09.706863+0000","last_became_peered":"2023-07-14T18:11:09.706863+0000","last_unstale":"2023-07-14T18:12:45.447129+0000","last_undegraded":"2023-07-14T18:12:45.447129+0000","last_fullsized":"2023-07-14T18:12:45.447129+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_clean_scrub_stamp":"2023-07-14T18:11:08.667354+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T03:37:49.528129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"86'7","reported_seq":31,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T18:12:45.447310+0000","last_change":"2023-07-14T18:11:09.714879+0000","last_active":"2023-07-14T18:12:45.447310+0000","last_peered":"2023-07-14T18:12:45.447310+0000","last_clean":"2023-07-14T18:12:45.447310+0000","last_became_active":"2023-07-14T18:11:09.714583+0000","last_became_peered":"2023-07-14T18:11:09.714583+0000","last_unstale":"2023-07-14T18:12:45.447310+0000","last_undegraded":"2023-07-14T18:12:45.447310+0000","last_fullsized":"2023-07-14T18:12:45.447310+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_clean_scrub_stamp":"2023-07-14T18:11:08.667354+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:17:18.081609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"86'4","reported_seq":28,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T18:12:45.451968+0000","last_change":"2023-07-14T18:11:09.710850+0000","last_active":"2023-07-14T18:12:45.451968+0000","last_peered":"2023-07-14T18:12:45.451968+0000","last_clean":"2023-07-14T18:12:45.451968+0000","last_became_active":"2023-07-14T18:11:09.710533+0000","last_became_peered":"2023-07-14T18:11:09.710533+0000","last_unstale":"2023-07-14T18:12:45.451968+0000","last_undegraded":"2023-07-14T18:12:45.451968+0000","last_fullsized":"2023-07-14T18:12:45.451968+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_clean_scrub_stamp":"2023-07-14T18:11:08.667354+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:14:51.244833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"86'6","reported_seq":36,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T18:12:45.440899+0000","last_change":"2023-07-14T18:12:16.821049+0000","last_active":"2023-07-14T18:12:45.440899+0000","last_peered":"2023-07-14T18:12:45.440899+0000","last_clean":"2023-07-14T18:12:45.440899+0000","last_became_active":"2023-07-14T18:12:16.820665+0000","last_became_peered":"2023-07-14T18:12:16.820665+0000","last_unstale":"2023-07-14T18:12:45.440899+0000","last_undegraded":"2023-07-14T18:12:45.440899+0000","last_fullsized":"2023-07-14T18:12:45.440899+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_clean_scrub_stamp":"2023-07-14T18:11:08.667354+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:30:07.485544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,9],"acting":[11,8,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"86'15","reported_seq":39,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T18:12:45.458860+0000","last_change":"2023-07-14T18:11:09.709062+0000","last_active":"2023-07-14T18:12:45.458860+0000","last_peered":"2023-07-14T18:12:45.458860+0000","last_clean":"2023-07-14T18:12:45.458860+0000","last_became_active":"2023-07-14T18:11:09.708767+0000","last_became_peered":"2023-07-14T18:11:09.708767+0000","last_unstale":"2023-07-14T18:12:45.458860+0000","last_undegraded":"2023-07-14T18:12:45.458860+0000","last_fullsized":"2023-07-14T18:12:45.458860+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_clean_scrub_stamp":"2023-07-14T18:11:08.667354+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:39:06.654097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"86'2","reported_seq":32,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T18:12:45.443758+0000","last_change":"2023-07-14T18:12:16.787468+0000","last_active":"2023-07-14T18:12:45.443758+0000","last_peered":"2023-07-14T18:12:45.443758+0000","last_clean":"2023-07-14T18:12:45.443758+0000","last_became_active":"2023-07-14T18:12:16.786920+0000","last_became_peered":"2023-07-14T18:12:16.786920+0000","last_unstale":"2023-07-14T18:12:45.443758+0000","last_undegraded":"2023-07-14T18:12:45.443758+0000","last_fullsized":"2023-07-14T18:12:45.443758+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_clean_scrub_stamp":"2023-07-14T18:11:08.667354+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:58:18.718547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,8,2],"acting":[3,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"86'6","reported_seq":30,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T18:12:45.442021+0000","last_change":"2023-07-14T18:11:09.709710+0000","last_active":"2023-07-14T18:12:45.442021+0000","last_peered":"2023-07-14T18:12:45.442021+0000","last_clean":"2023-07-14T18:12:45.442021+0000","last_became_active":"2023-07-14T18:11:09.709438+0000","last_became_peered":"2023-07-14T18:11:09.709438+0000","last_unstale":"2023-07-14T18:12:45.442021+0000","last_undegraded":"2023-07-14T18:12:45.442021+0000","last_fullsized":"2023-07-14T18:12:45.442021+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_clean_scrub_stamp":"2023-07-14T18:11:08.667354+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T01:54:00.369337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"86'8","reported_seq":32,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T18:12:45.443921+0000","last_change":"2023-07-14T18:11:09.720216+0000","last_active":"2023-07-14T18:12:45.443921+0000","last_peered":"2023-07-14T18:12:45.443921+0000","last_clean":"2023-07-14T18:12:45.443921+0000","last_became_active":"2023-07-14T18:11:09.719775+0000","last_became_peered":"2023-07-14T18:11:09.719775+0000","last_unstale":"2023-07-14T18:12:45.443921+0000","last_undegraded":"2023-07-14T18:12:45.443921+0000","last_fullsized":"2023-07-14T18:12:45.443921+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_clean_scrub_stamp":"2023-07-14T18:11:08.667354+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:43:40.113898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"86'10","reported_seq":34,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T18:12:45.458305+0000","last_change":"2023-07-14T18:11:09.708462+0000","last_active":"2023-07-14T18:12:45.458305+0000","last_peered":"2023-07-14T18:12:45.458305+0000","last_clean":"2023-07-14T18:12:45.458305+0000","last_became_active":"2023-07-14T18:11:09.705611+0000","last_became_peered":"2023-07-14T18:11:09.705611+0000","last_unstale":"2023-07-14T18:12:45.458305+0000","last_undegraded":"2023-07-14T18:12:45.458305+0000","last_fullsized":"2023-07-14T18:12:45.458305+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_clean_scrub_stamp":"2023-07-14T18:11:08.667354+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T02:02:51.560219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"86'11","reported_seq":35,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T18:12:45.447550+0000","last_change":"2023-07-14T18:11:09.707560+0000","last_active":"2023-07-14T18:12:45.447550+0000","last_peered":"2023-07-14T18:12:45.447550+0000","last_clean":"2023-07-14T18:12:45.447550+0000","last_became_active":"2023-07-14T18:11:09.707216+0000","last_became_peered":"2023-07-14T18:11:09.707216+0000","last_unstale":"2023-07-14T18:12:45.447550+0000","last_undegraded":"2023-07-14T18:12:45.447550+0000","last_fullsized":"2023-07-14T18:12:45.447550+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_clean_scrub_stamp":"2023-07-14T18:11:08.667354+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:03:49.501892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"86'8","reported_seq":32,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T18:12:45.455791+0000","last_change":"2023-07-14T18:11:09.712059+0000","last_active":"2023-07-14T18:12:45.455791+0000","last_peered":"2023-07-14T18:12:45.455791+0000","last_clean":"2023-07-14T18:12:45.455791+0000","last_became_active":"2023-07-14T18:11:09.711759+0000","last_became_peered":"2023-07-14T18:11:09.711759+0000","last_unstale":"2023-07-14T18:12:45.455791+0000","last_undegraded":"2023-07-14T18:12:45.455791+0000","last_fullsized":"2023-07-14T18:12:45.455791+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_clean_scrub_stamp":"2023-07-14T18:11:08.667354+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:13:46.454186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":246,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":32768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":500,"ondisk_log_size":500,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4157440,"data_stored":4132576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":70342,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":824,"num_read_kb":489,"num_write":250,"num_write_kb":148,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":573440,"data_stored":219666,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":220,"ondisk_log_size":220,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":75,"seq":322122547232,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27964,"kb_used_data":948,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717188,"statfs":{"total":95995035648,"available":95966400512,"internally_reserved":0,"allocated":970752,"data_stored":474379,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 18:12:34 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.55400000000000005,"15min":0.55800000000000005},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.42499999999999999},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.57999999999999996,"15min":0.58199999999999996},"min":{"1min":0.41999999999999998,"5min":0.315,"15min":0.315},"max":{"1min":0.75800000000000001,"5min":0.85099999999999998,"15min":0.85099999999999998},"last":0.46500000000000002}]},{"osd":1,"last update":"Fri Jul 14 18:12:34 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.64300000000000002,"15min":0.64100000000000001},"min":{"1min":0.46300000000000002,"5min":0.439,"15min":0.439},"max":{"1min":0.78600000000000003,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.67700000000000005,"5min":0.64800000000000002,"15min":0.64300000000000002},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.83899999999999997,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.67000000000000004}]},{"osd":2,"last update":"Fri Jul 14 18:12:34 2023","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.54100000000000004,"15min":0.54900000000000004},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.749,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.501,"5min":0.53500000000000003,"15min":0.54100000000000004},"min":{"1min":0.39200000000000002,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.63500000000000001,"5min":0.69899999999999995,"15min":0.69899999999999995},"last":0.39900000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35399999999999998}]},{"osd":4,"last update":"Fri Jul 14 18:12:34 2023","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.68600000000000005,"15min":0.68500000000000005},"min":{"1min":0.55800000000000005,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.88800000000000001,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.72199999999999998,"15min":0.72799999999999998},"min":{"1min":0.57999999999999996,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":0.89300000000000002,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.72999999999999998}]},{"osd":5,"last update":"Fri Jul 14 18:12:34 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.63300000000000001,"15min":0.63700000000000001},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.65000000000000002},{"interface":"front","average":{"1min":0.623,"5min":0.628,"15min":0.629},"min":{"1min":0.44700000000000001,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.85599999999999998,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.58699999999999997}]},{"osd":6,"last update":"Fri Jul 14 18:12:34 2023","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.70399999999999996,"15min":0.70599999999999996},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":1.048,"5min":1.048,"15min":1.048},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.746,"15min":0.748},"min":{"1min":0.54600000000000004,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.71199999999999997}]},{"osd":7,"last update":"Fri Jul 14 18:12:34 2023","interfaces":[{"interface":"back","average":{"1min":0.73799999999999999,"5min":0.75900000000000001,"15min":0.76300000000000001},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":0.92000000000000004,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.78000000000000003,"5min":0.79200000000000004,"15min":0.79400000000000004},"min":{"1min":0.56100000000000005,"5min":0.496,"15min":0.496},"max":{"1min":0.95599999999999996,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.76200000000000001}]},{"osd":8,"last update":"Fri Jul 14 18:12:14 2023","interfaces":[{"interface":"back","average":{"1min":0.747,"5min":0.747,"15min":0.747},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":1.038,"5min":1.038,"15min":1.038},"last":0.82199999999999995},{"interface":"front","average":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"min":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":0.98999999999999999,"5min":0.98999999999999999,"15min":0.98999999999999999},"last":0.77900000000000003}]},{"osd":9,"last update":"Fri Jul 14 18:12:34 2023","interfaces":[{"interface":"back","average":{"1min":0.81799999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"min":{"1min":0.61799999999999999,"5min":0.498,"15min":0.498},"max":{"1min":1.0089999999999999,"5min":1.1419999999999999,"15min":1.1419999999999999},"last":0.747},{"interface":"front","average":{"1min":0.77600000000000002,"5min":0.80200000000000005,"15min":0.80600000000000005},"min":{"1min":0.53100000000000003,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":0.96299999999999997,"5min":1.042,"15min":1.042},"last":0.69699999999999995}]},{"osd":10,"last update":"Fri Jul 14 18:12:34 2023","interfaces":[{"interface":"back","average":{"1min":0.84299999999999997,"5min":0.83499999999999996,"15min":0.83399999999999996},"min":{"1min":0.69499999999999995,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.0129999999999999,"5min":1.0800000000000001,"15min":1.0800000000000001},"last":0.79200000000000004},{"interface":"front","average":{"1min":0.83999999999999997,"5min":0.85199999999999998,"15min":0.85399999999999998},"min":{"1min":0.65700000000000003,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":0.99299999999999999,"5min":1.177,"15min":1.177},"last":0.80600000000000005}]}]},{"osd":10,"up_from":68,"seq":292057776163,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28636,"kb_used_data":1620,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716516,"statfs":{"total":95995035648,"available":95965712384,"internally_reserved":0,"allocated":1658880,"data_stored":1122980,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 18:12:09 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"last":0.40799999999999997}]},{"osd":1,"last update":"Fri Jul 14 18:12:14 2023","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.45600000000000002,"15min":0.44900000000000001},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.64600000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"last":0.502},{"interface":"front","average":{"1min":0.496,"5min":0.49199999999999999,"15min":0.49199999999999999},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.69299999999999995,"5min":0.71099999999999997,"15min":0.71099999999999997},"last":0.44400000000000001}]},{"osd":2,"last update":"Fri Jul 14 18:12:14 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.63200000000000001,"15min":0.63200000000000001},"min":{"1min":0.47999999999999998,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.89700000000000002,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.71799999999999997},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.61399999999999999,"15min":0.60499999999999998},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.83599999999999997,"5min":0.84799999999999998,"15min":0.84799999999999998},"last":0.54600000000000004}]},{"osd":3,"last update":"Fri Jul 14 18:12:14 2023","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.626,"15min":0.64600000000000002},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.622,"5min":0.96099999999999997,"15min":0.96099999999999997},"last":0.47499999999999998},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.65600000000000003,"15min":0.66400000000000003},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.78700000000000003,"5min":0.95099999999999996,"15min":0.95099999999999996},"last":0.60299999999999998}]},{"osd":4,"last update":"Fri Jul 14 18:12:14 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.86799999999999999,"5min":0.86799999999999999,"15min":0.86799999999999999},"last":0.68400000000000005},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.57699999999999996,"15min":0.58299999999999996},"min":{"1min":0.42899999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.745,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.627}]},{"osd":5,"last update":"Fri Jul 14 18:12:14 2023","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.71199999999999997,"15min":0.71599999999999997},"min":{"1min":0.52400000000000002,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.81599999999999995,"5min":1.0049999999999999,"15min":1.0049999999999999},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.69199999999999995,"15min":0.68400000000000005},"min":{"1min":0.58399999999999996,"5min":0.438,"15min":0.438},"max":{"1min":0.93100000000000005,"5min":0.93100000000000005,"15min":0.93100000000000005},"last":0.66300000000000003}]},{"osd":6,"last update":"Fri Jul 14 18:12:14 2023","interfaces":[{"interface":"back","average":{"1min":0.64900000000000002,"5min":0.69699999999999995,"15min":0.70499999999999996},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.878,"5min":1.004,"15min":1.004},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.748,"15min":0.75600000000000001},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":0.91200000000000003,"5min":1.1040000000000001,"15min":1.1040000000000001},"last":0.73699999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49399999999999999}]},{"osd":8,"last update":"Fri Jul 14 18:12:14 2023","interfaces":[{"interface":"back","average":{"1min":0.75900000000000001,"5min":0.754,"15min":0.753},"min":{"1min":0.51300000000000001,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.96599999999999997,"5min":1.038,"15min":1.038},"last":0.80100000000000005},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.78900000000000003,"15min":0.79900000000000004},"min":{"1min":0.57699999999999996,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":0.86399999999999999,"5min":1.0820000000000001,"15min":1.0820000000000001},"last":0.75900000000000001}]},{"osd":9,"last update":"Fri Jul 14 18:12:14 2023","interfaces":[{"interface":"back","average":{"1min":0.84199999999999997,"5min":0.80500000000000005,"15min":0.79900000000000004},"min":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"max":{"1min":2.5649999999999999,"5min":2.5649999999999999,"15min":2.5649999999999999},"last":0.76800000000000002},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.81399999999999995,"15min":0.83699999999999997},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":0.89600000000000002,"5min":1.228,"15min":1.228},"last":0.78300000000000003}]},{"osd":11,"last update":"Fri Jul 14 18:12:32 2023","interfaces":[{"interface":"back","average":{"1min":0.77500000000000002,"5min":0.78500000000000003,"15min":0.78700000000000003},"min":{"1min":0.66300000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":0.95799999999999996,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.70499999999999996},{"interface":"front","average":{"1min":0.80300000000000005,"5min":0.81100000000000005,"15min":0.81299999999999994},"min":{"1min":0.65100000000000002,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":0.98999999999999999,"5min":1.0309999999999999,"15min":1.0309999999999999},"last":0.82999999999999996}]}]},{"osd":9,"up_from":63,"seq":270582939688,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27992,"kb_used_data":976,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717160,"statfs":{"total":95995035648,"available":95966371840,"internally_reserved":0,"allocated":999424,"data_stored":477954,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 18:11:50 2023","interfaces":[{"interface":"back","average":{"1min":0.35299999999999998,"5min":0.41299999999999998,"15min":0.42299999999999999},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.622,"5min":0.63200000000000001,"15min":0.63200000000000001},"last":0.34399999999999997},{"interface":"front","average":{"1min":0.37,"5min":0.432,"15min":0.442},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.57499999999999996,"5min":0.68899999999999995,"15min":0.68899999999999995},"last":0.371}]},{"osd":1,"last update":"Fri Jul 14 18:11:50 2023","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.57599999999999996,"15min":0.58399999999999996},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.93100000000000005,"5min":0.94099999999999995,"15min":0.94099999999999995},"last":0.69399999999999995},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.59499999999999997,"15min":0.60499999999999998},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.73999999999999999,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.623}]},{"osd":2,"last update":"Fri Jul 14 18:11:50 2023","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.59799999999999998,"15min":0.60599999999999998},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.81200000000000006,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.61799999999999999,"15min":0.627},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.76100000000000001,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.65800000000000003}]},{"osd":3,"last update":"Fri Jul 14 18:11:50 2023","interfaces":[{"interface":"back","average":{"1min":0.40600000000000003,"5min":0.51300000000000001,"15min":0.53100000000000003},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.64200000000000002,"5min":0.75700000000000001,"15min":0.75700000000000001},"last":0.312},{"interface":"front","average":{"1min":0.40699999999999997,"5min":0.51300000000000001,"15min":0.53100000000000003},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":0.58499999999999996,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.39300000000000002}]},{"osd":4,"last update":"Fri Jul 14 18:11:50 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.65900000000000003,"15min":0.67800000000000005},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.84299999999999997,"5min":0.95499999999999996,"15min":0.95499999999999996},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.64900000000000002,"15min":0.65900000000000003},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.90300000000000002,"5min":1,"15min":1},"last":0.72999999999999998}]},{"osd":5,"last update":"Fri Jul 14 18:11:50 2023","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.68000000000000005,"15min":0.69499999999999995},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.80300000000000005,"5min":1.093,"15min":1.093},"last":0.63700000000000001},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.67800000000000005,"15min":0.69399999999999995},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.89100000000000001,"5min":1.1100000000000001,"15min":1.1100000000000001},"last":0.71999999999999997}]},{"osd":6,"last update":"Fri Jul 14 18:10:48 2023","interfaces":[{"interface":"back","average":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":1.069,"5min":1.069,"15min":1.069},"last":0.45800000000000002},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":1.0409999999999999,"5min":1.0409999999999999,"15min":1.0409999999999999},"last":0.57799999999999996}]},{"osd":7,"last update":"Fri Jul 14 18:11:50 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.71199999999999997,"15min":0.72899999999999998},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.92500000000000004,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.71699999999999997,"15min":0.73599999999999999},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.85399999999999998,"5min":1.1890000000000001,"15min":1.1890000000000001},"last":0.64700000000000002}]},{"osd":8,"last update":"Fri Jul 14 18:11:50 2023","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.74399999999999999,"15min":0.76200000000000001},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.79900000000000004,"5min":1.127,"15min":1.127},"last":0.70799999999999996},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.75700000000000001,"15min":0.77500000000000002},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":0.86699999999999999,"5min":1.167,"15min":1.167},"last":0.61399999999999999}]},{"osd":10,"last update":"Fri Jul 14 18:12:09 2023","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.68500000000000005,"15min":0.69099999999999995},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.88,"5min":0.99099999999999999,"15min":0.99099999999999999},"last":0.74099999999999999},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.69899999999999995,"15min":0.70499999999999996},"min":{"1min":0.54900000000000004,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":0.94199999999999995,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":0.55500000000000005}]},{"osd":11,"last update":"Fri Jul 14 18:12:13 2023","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"min":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"last":0.68600000000000005},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.0229999999999999,"5min":1.0229999999999999,"15min":1.0229999999999999},"last":0.754}]}]},{"osd":8,"up_from":56,"seq":240518168621,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27980,"kb_used_data":964,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717172,"statfs":{"total":95995035648,"available":95966384128,"internally_reserved":0,"allocated":987136,"data_stored":473955,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 18:12:33 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.54900000000000004,"15min":0.54500000000000004},"min":{"1min":0.441,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.73499999999999999,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.52800000000000002,"15min":0.52300000000000002},"min":{"1min":0.41199999999999998,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.72099999999999997,"5min":0.78200000000000003,"15min":0.78200000000000003},"last":0.50600000000000001}]},{"osd":1,"last update":"Fri Jul 14 18:12:33 2023","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.628,"15min":0.61499999999999999},"min":{"1min":0.50900000000000001,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.90200000000000002,"5min":1.036,"15min":1.036},"last":0.74099999999999999},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.64500000000000002,"15min":0.63500000000000001},"min":{"1min":0.55600000000000005,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.90800000000000003,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.69899999999999995}]},{"osd":2,"last update":"Fri Jul 14 18:12:33 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.48299999999999998,"15min":0.46000000000000002},"min":{"1min":0.39100000000000001,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.80300000000000005,"5min":1.032,"15min":1.032},"last":0.45600000000000002},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.49099999999999999,"15min":0.47799999999999998},"min":{"1min":0.38500000000000001,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.81999999999999995,"5min":1.0449999999999999,"15min":1.0449999999999999},"last":0.56799999999999995}]},{"osd":3,"last update":"Fri Jul 14 18:12:33 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.58099999999999996,"15min":0.58399999999999996},"min":{"1min":0.433,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.60299999999999998,"15min":0.59499999999999997},"min":{"1min":0.438,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.97599999999999998,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.53700000000000003}]},{"osd":4,"last update":"Fri Jul 14 18:12:33 2023","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.68400000000000005,"15min":0.65400000000000003},"min":{"1min":0.60899999999999999,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":1.0189999999999999,"5min":2.5030000000000001,"15min":2.5030000000000001},"last":0.65900000000000003},{"interface":"front","average":{"1min":0.746,"5min":0.66100000000000003,"15min":0.64300000000000002},"min":{"1min":0.52800000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":1.0069999999999999,"5min":1.0069999999999999,"15min":1.0069999999999999},"last":0.63900000000000001}]},{"osd":5,"last update":"Fri Jul 14 18:12:33 2023","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.60699999999999998,"15min":0.59199999999999997},"min":{"1min":0.41699999999999998,"5min":0.316,"15min":0.316},"max":{"1min":1.0189999999999999,"5min":1.0189999999999999,"15min":1.0189999999999999},"last":0.622},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.61399999999999999,"15min":0.60399999999999998},"min":{"1min":0.46899999999999997,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.72299999999999998}]},{"osd":6,"last update":"Fri Jul 14 18:12:33 2023","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.69199999999999995,"15min":0.68000000000000005},"min":{"1min":0.61299999999999999,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":1.006,"5min":1.006,"15min":1.006},"last":0.68300000000000005},{"interface":"front","average":{"1min":0.77200000000000002,"5min":0.71099999999999997,"15min":0.70699999999999996},"min":{"1min":0.53400000000000003,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.98999999999999999,"5min":1.008,"15min":1.008},"last":0.76700000000000002}]},{"osd":7,"last update":"Fri Jul 14 18:12:33 2023","interfaces":[{"interface":"back","average":{"1min":0.81699999999999995,"5min":0.75900000000000001,"15min":0.72799999999999998},"min":{"1min":0.64300000000000002,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":1.0349999999999999,"5min":2.5550000000000002,"15min":2.5550000000000002},"last":0.82199999999999995},{"interface":"front","average":{"1min":0.82699999999999996,"5min":0.74099999999999999,"15min":0.72299999999999998},"min":{"1min":0.71799999999999997,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.125,"5min":1.125,"15min":1.125},"last":0.83199999999999996}]},{"osd":9,"last update":"Fri Jul 14 18:11:50 2023","interfaces":[{"interface":"back","average":{"1min":0.80800000000000005,"5min":0.70499999999999996,"15min":0.68799999999999994},"min":{"1min":0.57099999999999995,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.0609999999999999,"5min":1.0609999999999999,"15min":1.0609999999999999},"last":0.78800000000000003},{"interface":"front","average":{"1min":0.94699999999999995,"5min":0.745,"15min":0.71099999999999997},"min":{"1min":0.56299999999999994,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":2.5339999999999998,"5min":2.5339999999999998,"15min":2.5339999999999998},"last":0.79600000000000004}]},{"osd":10,"last update":"Fri Jul 14 18:12:11 2023","interfaces":[{"interface":"back","average":{"1min":0.875,"5min":0.75900000000000001,"15min":0.73999999999999999},"min":{"1min":0.77600000000000002,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.0740000000000001,"5min":1.0740000000000001,"15min":1.0740000000000001},"last":0.85999999999999999},{"interface":"front","average":{"1min":0.91900000000000004,"5min":0.77900000000000003,"15min":0.75600000000000001},"min":{"1min":0.79200000000000004,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.115,"5min":1.115,"15min":1.115},"last":0.873}]},{"osd":11,"last update":"Fri Jul 14 18:12:11 2023","interfaces":[{"interface":"back","average":{"1min":0.86099999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"min":{"1min":0.623,"5min":0.623,"15min":0.623},"max":{"1min":1.101,"5min":1.101,"15min":1.101},"last":0.81100000000000005},{"interface":"front","average":{"1min":0.88600000000000001,"5min":0.88600000000000001,"15min":0.88600000000000001},"min":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":1.089,"5min":1.089,"15min":1.089},"last":0.84599999999999997}]}]},{"osd":7,"up_from":49,"seq":210453397552,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28568,"kb_used_data":1552,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716584,"statfs":{"total":95995035648,"available":95965782016,"internally_reserved":0,"allocated":1589248,"data_stored":1072226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 18:11:06 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.55300000000000005,"15min":0.54600000000000004},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"last":0.38400000000000001},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"min":{"1min":0.35599999999999998,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.77900000000000003,"5min":0.84299999999999997,"15min":0.84299999999999997},"last":0.35599999999999998}]},{"osd":1,"last update":"Fri Jul 14 18:12:06 2023","interfaces":[{"interface":"back","average":{"1min":0.42499999999999999,"5min":0.42199999999999999,"15min":0.41499999999999998},"min":{"1min":0.29599999999999999,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.56100000000000005,"5min":0.751,"15min":0.751},"last":0.39200000000000002},{"interface":"front","average":{"1min":0.46200000000000002,"5min":0.44600000000000001,"15min":0.442},"min":{"1min":0.28000000000000003,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.70599999999999996,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.432}]},{"osd":2,"last update":"Fri Jul 14 18:12:06 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.58999999999999997,"15min":0.58499999999999996},"min":{"1min":0.35299999999999998,"5min":0.313,"15min":0.313},"max":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"last":0.70899999999999996},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.61299999999999999,"15min":0.61499999999999999},"min":{"1min":0.436,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.75800000000000001,"5min":0.81499999999999995,"15min":0.81499999999999995},"last":0.69499999999999995}]},{"osd":3,"last update":"Fri Jul 14 18:12:06 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.56499999999999995,"15min":0.56200000000000006},"min":{"1min":0.41899999999999998,"5min":0.379,"15min":0.379},"max":{"1min":0.877,"5min":0.877,"15min":0.877},"last":0.51500000000000001},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.60499999999999998,"15min":0.59899999999999998},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.84799999999999998,"5min":0.88100000000000001,"15min":0.88100000000000001},"last":0.55600000000000005}]},{"osd":4,"last update":"Fri Jul 14 18:12:06 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.52700000000000002,"15min":0.52100000000000002},"min":{"1min":0.36099999999999999,"5min":0.316,"15min":0.316},"max":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.47999999999999998,"5min":0.49199999999999999,"15min":0.499},"min":{"1min":0.309,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.65800000000000003,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.46100000000000002}]},{"osd":5,"last update":"Fri Jul 14 18:12:06 2023","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.65700000000000003,"15min":0.66400000000000003},"min":{"1min":0.503,"5min":0.373,"15min":0.373},"max":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"last":0.65600000000000003},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.65500000000000003,"15min":0.65500000000000003},"min":{"1min":0.51700000000000002,"5min":0.38,"15min":0.38},"max":{"1min":0.89200000000000002,"5min":0.89200000000000002,"15min":0.89200000000000002},"last":0.745}]},{"osd":6,"last update":"Fri Jul 14 18:12:06 2023","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.67100000000000004,"15min":0.66700000000000004},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":0.90700000000000003,"5min":0.90700000000000003,"15min":0.90700000000000003},"last":0.67600000000000005},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.65200000000000002,"15min":0.66800000000000004},"min":{"1min":0.373,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.84499999999999997,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.57499999999999996}]},{"osd":8,"last update":"Fri Jul 14 18:12:28 2023","interfaces":[{"interface":"back","average":{"1min":0.77100000000000002,"5min":0.72199999999999998,"15min":0.71299999999999997},"min":{"1min":0.59199999999999997,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":0.997,"5min":0.997,"15min":0.997},"last":0.78600000000000003},{"interface":"front","average":{"1min":0.747,"5min":0.69099999999999995,"15min":0.68400000000000005},"min":{"1min":0.58499999999999996,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.88300000000000001,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.77200000000000002}]},{"osd":9,"last update":"Fri Jul 14 18:11:52 2023","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.66800000000000004,"15min":0.66900000000000004},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.90800000000000003,"5min":0.90800000000000003,"15min":0.90800000000000003},"last":0.79800000000000004},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.747,"15min":0.753},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":0.90800000000000003,"5min":1.0189999999999999,"15min":1.0189999999999999},"last":0.73299999999999998}]},{"osd":10,"last update":"Fri Jul 14 18:12:09 2023","interfaces":[{"interface":"back","average":{"1min":0.751,"5min":0.74199999999999999,"15min":0.73999999999999999},"min":{"1min":0.503,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.024,"5min":1.046,"15min":1.046},"last":0.75800000000000001},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.66100000000000003,"15min":0.65100000000000002},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.878,"5min":0.89500000000000002,"15min":0.89500000000000002},"last":0.63400000000000001}]},{"osd":11,"last update":"Fri Jul 14 18:12:09 2023","interfaces":[{"interface":"back","average":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"min":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"max":{"1min":0.95199999999999996,"5min":0.95199999999999996,"15min":0.95199999999999996},"last":0.82599999999999996},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":0.93400000000000005,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.81100000000000005}]}]},{"osd":6,"up_from":44,"seq":188978561077,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27964,"kb_used_data":948,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717188,"statfs":{"total":95995035648,"available":95966400512,"internally_reserved":0,"allocated":970752,"data_stored":469813,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 18:12:47 2023","interfaces":[{"interface":"back","average":{"1min":0.377,"5min":0.39500000000000002,"15min":0.39500000000000002},"min":{"1min":0.28100000000000003,"5min":0.217,"15min":0.217},"max":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.40300000000000002},{"interface":"front","average":{"1min":0.40899999999999997,"5min":0.41599999999999998,"15min":0.40999999999999998},"min":{"1min":0.27600000000000002,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.64800000000000002,"5min":0.71899999999999997,"15min":0.71899999999999997},"last":0.41999999999999998}]},{"osd":1,"last update":"Fri Jul 14 18:12:47 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.57399999999999995,"15min":0.54200000000000004},"min":{"1min":0.38,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.96899999999999997,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.51600000000000001,"5min":0.53600000000000003,"15min":0.51200000000000001},"min":{"1min":0.379,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.97699999999999998,"5min":1.048,"15min":1.048},"last":0.45900000000000002}]},{"osd":2,"last update":"Fri Jul 14 18:12:47 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.59399999999999997,"15min":0.57999999999999996},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.82799999999999996,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.64700000000000002},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.57799999999999996,"15min":0.57999999999999996},"min":{"1min":0.38,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"last":0.59599999999999997}]},{"osd":3,"last update":"Fri Jul 14 18:12:47 2023","interfaces":[{"interface":"back","average":{"1min":0.38300000000000001,"5min":0.434,"15min":0.439},"min":{"1min":0.30299999999999999,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.625,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.38500000000000001},{"interface":"front","average":{"1min":0.46800000000000003,"5min":0.496,"15min":0.48999999999999999},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.68999999999999995,"5min":0.83399999999999996,"15min":0.83399999999999996},"last":0.53400000000000003}]},{"osd":4,"last update":"Fri Jul 14 18:12:47 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.622,"15min":0.60999999999999999},"min":{"1min":0.42199999999999999,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.93100000000000005,"5min":1.087,"15min":1.087},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.58799999999999997,"15min":0.57199999999999995},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.93999999999999995,"5min":1.014,"15min":1.014},"last":0.51500000000000001}]},{"osd":5,"last update":"Fri Jul 14 18:12:47 2023","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.66900000000000004,"15min":0.67100000000000004},"min":{"1min":0.42099999999999999,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.92100000000000004,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.69399999999999995,"15min":0.69599999999999995},"min":{"1min":0.46200000000000002,"5min":0.443,"15min":0.443},"max":{"1min":0.98599999999999999,"5min":0.98599999999999999,"15min":0.98599999999999999},"last":0.67200000000000004}]},{"osd":7,"last update":"Fri Jul 14 18:12:13 2023","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.67000000000000004,"15min":0.66600000000000004},"min":{"1min":0.5,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.86099999999999999,"5min":1.03,"15min":1.03},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.70599999999999996,"15min":0.70399999999999996},"min":{"1min":0.50600000000000001,"5min":0.443,"15min":0.443},"max":{"1min":0.93100000000000005,"5min":1.0700000000000001,"15min":1.0700000000000001},"last":0.69999999999999996}]},{"osd":8,"last update":"Fri Jul 14 18:12:31 2023","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.74299999999999999,"15min":0.76900000000000002},"min":{"1min":0.46300000000000002,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.95599999999999996,"5min":0.99399999999999999,"15min":0.99399999999999999},"last":0.72699999999999998},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.66700000000000004,"15min":0.68899999999999995},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.94499999999999995,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.622}]},{"osd":9,"last update":"Fri Jul 14 18:11:52 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.72499999999999998,"15min":0.74299999999999999},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.88700000000000001,"5min":1.0449999999999999,"15min":1.0449999999999999},"last":0.73699999999999999},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.76100000000000001,"15min":0.78300000000000003},"min":{"1min":0.505,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.80800000000000005,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.747}]},{"osd":10,"last update":"Fri Jul 14 18:12:13 2023","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.69899999999999995,"15min":0.70499999999999996},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.879,"5min":1.026,"15min":1.026},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.746,"15min":0.752},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":0.97099999999999997,"5min":0.99399999999999999,"15min":0.99399999999999999},"last":0.68400000000000005}]},{"osd":11,"last update":"Fri Jul 14 18:12:13 2023","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.755,"15min":0.755},"min":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":1.002,"5min":1.002,"15min":1.002},"last":0.71699999999999997},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"min":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"max":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.77700000000000002}]}]},{"osd":1,"up_from":13,"seq":55834574921,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28028,"kb_used_data":1012,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717124,"statfs":{"total":95995035648,"available":95966334976,"internally_reserved":0,"allocated":1036288,"data_stored":536475,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 18:12:07 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.56399999999999995,"15min":0.53500000000000003},"min":{"1min":0.34000000000000002,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.76800000000000002,"5min":0.98899999999999999,"15min":0.98899999999999999},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.55400000000000005,"15min":0.53000000000000003},"min":{"1min":0.40699999999999997,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.91000000000000003,"5min":0.91000000000000003,"15min":0.91000000000000003},"last":0.51000000000000001}]},{"osd":2,"last update":"Fri Jul 14 18:12:32 2023","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.59499999999999997,"15min":0.52100000000000002},"min":{"1min":0.38800000000000001,"5min":0.314,"15min":0.314},"max":{"1min":1.056,"5min":1.056,"15min":1.056},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.57699999999999996,"15min":0.50800000000000001},"min":{"1min":0.44900000000000001,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.91000000000000003,"5min":0.91000000000000003,"15min":0.91000000000000003},"last":0.61099999999999999}]},{"osd":3,"last update":"Fri Jul 14 18:11:50 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.55900000000000005,"15min":0.52800000000000002},"min":{"1min":0.36199999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.86799999999999999,"5min":0.86799999999999999,"15min":0.86799999999999999},"last":0.44},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.61899999999999999,"15min":0.55300000000000005},"min":{"1min":0.439,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":1.0229999999999999,"5min":1.0229999999999999,"15min":1.0229999999999999},"last":0.63400000000000001}]},{"osd":4,"last update":"Fri Jul 14 18:12:07 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.46899999999999997,"15min":0.41799999999999998},"min":{"1min":0.36399999999999999,"5min":0.245,"15min":0.245},"max":{"1min":0.95299999999999996,"5min":0.95299999999999996,"15min":0.95299999999999996},"last":0.36699999999999999},{"interface":"front","average":{"1min":0.51300000000000001,"5min":0.46300000000000002,"15min":0.41199999999999998},"min":{"1min":0.32700000000000001,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.69199999999999995,"5min":0.77600000000000002,"15min":0.77600000000000002},"last":0.41099999999999998}]},{"osd":5,"last update":"Fri Jul 14 18:12:32 2023","interfaces":[{"interface":"back","average":{"1min":0.74099999999999999,"5min":0.65100000000000002,"15min":0.60899999999999999},"min":{"1min":0.46800000000000003,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.94299999999999995,"5min":0.96599999999999997,"15min":0.96599999999999997},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.77500000000000002,"5min":0.67900000000000005,"15min":0.629},"min":{"1min":0.53200000000000003,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":1.04,"5min":1.04,"15min":1.04},"last":0.65600000000000003}]},{"osd":6,"last update":"Fri Jul 14 18:12:47 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.63300000000000001,"15min":0.61799999999999999},"min":{"1min":0.503,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.81999999999999995,"5min":0.93700000000000006,"15min":0.93700000000000006},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.68200000000000005,"5min":0.67000000000000004,"15min":0.64800000000000002},"min":{"1min":0.42699999999999999,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.83299999999999996,"5min":0.97299999999999998,"15min":0.97299999999999998},"last":0.67200000000000004}]},{"osd":7,"last update":"Fri Jul 14 18:12:12 2023","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.63500000000000001,"15min":0.60899999999999999},"min":{"1min":0.41499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":1.109,"5min":1.109,"15min":1.109},"last":0.69199999999999995},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.65200000000000002,"15min":0.64200000000000002},"min":{"1min":0.36899999999999999,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":1.002,"5min":1.0489999999999999,"15min":1.0489999999999999},"last":0.77400000000000002}]},{"osd":8,"last update":"Fri Jul 14 18:12:32 2023","interfaces":[{"interface":"back","average":{"1min":0.82799999999999996,"5min":0.76800000000000002,"15min":0.754},"min":{"1min":0.54200000000000004,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":1.0700000000000001,"5min":1.0700000000000001,"15min":1.0700000000000001},"last":0.80700000000000005},{"interface":"front","average":{"1min":0.84599999999999997,"5min":0.78000000000000003,"15min":0.76400000000000001},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":1.155,"5min":1.155,"15min":1.155},"last":0.75800000000000001}]},{"osd":9,"last update":"Fri Jul 14 18:11:50 2023","interfaces":[{"interface":"back","average":{"1min":0.74199999999999999,"5min":0.75900000000000001,"15min":0.76200000000000001},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.98199999999999998,"5min":1.01,"15min":1.01},"last":0.72199999999999998},{"interface":"front","average":{"1min":0.78600000000000003,"5min":0.81599999999999995,"15min":0.82099999999999995},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.0149999999999999,"5min":1.0589999999999999,"15min":1.0589999999999999},"last":0.70899999999999996}]},{"osd":10,"last update":"Fri Jul 14 18:12:12 2023","interfaces":[{"interface":"back","average":{"1min":0.81799999999999995,"5min":0.81100000000000005,"15min":0.81000000000000005},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.0860000000000001,"5min":1.0860000000000001,"15min":1.0860000000000001},"last":0.82099999999999995},{"interface":"front","average":{"1min":0.79800000000000004,"5min":0.78800000000000003,"15min":0.78600000000000003},"min":{"1min":0.495,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.097,"5min":1.097,"15min":1.097},"last":0.79100000000000004}]},{"osd":11,"last update":"Fri Jul 14 18:12:12 2023","interfaces":[{"interface":"back","average":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"min":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.1339999999999999,"5min":1.1339999999999999,"15min":1.1339999999999999},"last":0.85899999999999999},{"interface":"front","average":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"min":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":1.125,"5min":1.125,"15min":1.125},"last":0.84499999999999997}]}]},{"osd":0,"up_from":8,"seq":34359738446,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27988,"kb_used_data":972,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717164,"statfs":{"total":95995035648,"available":95966375936,"internally_reserved":0,"allocated":995328,"data_stored":471269,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Jul 14 18:12:07 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.52600000000000002,"15min":0.51100000000000001},"min":{"1min":0.437,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.68300000000000005,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.53600000000000003,"15min":0.51000000000000001},"min":{"1min":0.35399999999999998,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.76400000000000001,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.69799999999999995}]},{"osd":2,"last update":"Fri Jul 14 18:12:38 2023","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.57599999999999996,"15min":0.56000000000000005},"min":{"1min":0.39800000000000002,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.69999999999999996,"5min":0.93799999999999994,"15min":0.93799999999999994},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.55800000000000005,"15min":0.52800000000000002},"min":{"1min":0.379,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.73499999999999999,"5min":0.82399999999999995,"15min":0.82399999999999995},"last":0.46999999999999997}]},{"osd":3,"last update":"Fri Jul 14 18:12:13 2023","interfaces":[{"interface":"back","average":{"1min":0.377,"5min":0.377,"15min":0.377},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"last":0.40600000000000003},{"interface":"front","average":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"last":0.38200000000000001}]},{"osd":4,"last update":"Fri Jul 14 18:12:07 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.53800000000000003,"15min":0.51400000000000001},"min":{"1min":0.42499999999999999,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.67300000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.54400000000000004},"min":{"1min":0.41199999999999998,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.80000000000000004,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.65100000000000002}]},{"osd":5,"last update":"Fri Jul 14 18:12:38 2023","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.55600000000000005,"15min":0.52600000000000002},"min":{"1min":0.439,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.70399999999999996,"5min":1.161,"15min":1.161},"last":0.51600000000000001},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.56999999999999995,"15min":0.54900000000000004},"min":{"1min":0.41699999999999998,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.69099999999999995,"5min":0.879,"15min":0.879},"last":0.503}]},{"osd":6,"last update":"Fri Jul 14 18:11:48 2023","interfaces":[{"interface":"back","average":{"1min":0.41999999999999998,"5min":0.50700000000000001,"15min":0.503},"min":{"1min":0.28999999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.58999999999999997,"5min":1.0649999999999999,"15min":1.0649999999999999},"last":0.436},{"interface":"front","average":{"1min":0.47999999999999998,"5min":0.52100000000000002,"15min":0.51100000000000001},"min":{"1min":0.34499999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.68700000000000006,"5min":1.3460000000000001,"15min":1.3460000000000001},"last":0.55200000000000005}]},{"osd":7,"last update":"Fri Jul 14 18:12:14 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"last":0.73299999999999998},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"last":0.61399999999999999}]},{"osd":8,"last update":"Fri Jul 14 18:12:38 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.69799999999999995,"15min":0.73399999999999999},"min":{"1min":0.434,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.73099999999999998,"5min":1.3819999999999999,"15min":1.3819999999999999},"last":0.68400000000000005},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.71399999999999997,"15min":0.73999999999999999},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.82399999999999995,"5min":1.0289999999999999,"15min":1.0289999999999999},"last":0.66900000000000004}]},{"osd":9,"last update":"Fri Jul 14 18:11:48 2023","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.69699999999999995,"15min":0.72399999999999998},"min":{"1min":0.36599999999999999,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.84399999999999997,"5min":1.133,"15min":1.133},"last":0.76600000000000001},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.69499999999999995,"15min":0.71699999999999997},"min":{"1min":0.435,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.72699999999999998,"5min":1.28,"15min":1.28},"last":0.63700000000000001}]},{"osd":10,"last update":"Fri Jul 14 18:12:13 2023","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":0.70499999999999996,"15min":0.71299999999999997},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.80300000000000005,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.70899999999999996},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.72499999999999998,"15min":0.73699999999999999},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":0.878,"5min":0.98299999999999998,"15min":0.98299999999999998},"last":0.79700000000000004}]},{"osd":11,"last update":"Fri Jul 14 18:12:38 2023","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.70499999999999996,"15min":0.70699999999999996},"min":{"1min":0.59999999999999998,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":0.84499999999999997,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.747},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.67900000000000005,"15min":0.68100000000000005},"min":{"1min":0.57799999999999996,"5min":0.499,"15min":0.499},"max":{"1min":0.75,"5min":0.90000000000000002,"15min":0.90000000000000002},"last":0.72299999999999998}]}]},{"osd":2,"up_from":18,"seq":77309411398,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28048,"kb_used_data":1032,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717104,"statfs":{"total":95995035648,"available":95966314496,"internally_reserved":0,"allocated":1056768,"data_stored":537146,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 18:12:28 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.51500000000000001,"15min":0.48699999999999999},"min":{"1min":0.376,"5min":0.255,"15min":0.255},"max":{"1min":1.0449999999999999,"5min":1.0449999999999999,"15min":1.0449999999999999},"last":0.46899999999999997},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.497,"15min":0.47899999999999998},"min":{"1min":0.39600000000000002,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":1.9990000000000001,"5min":1.9990000000000001,"15min":1.9990000000000001},"last":0.44}]},{"osd":1,"last update":"Fri Jul 14 18:12:28 2023","interfaces":[{"interface":"back","average":{"1min":0.64800000000000002,"5min":0.56599999999999995,"15min":0.51700000000000002},"min":{"1min":0.375,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.88700000000000001,"5min":0.97499999999999998,"15min":0.97499999999999998},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.59899999999999998,"15min":0.51900000000000002},"min":{"1min":0.46800000000000003,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.93600000000000005,"5min":1.1279999999999999,"15min":1.1279999999999999},"last":0.69999999999999996}]},{"osd":3,"last update":"Fri Jul 14 18:12:48 2023","interfaces":[{"interface":"back","average":{"1min":0.72099999999999997,"5min":0.61399999999999999,"15min":0.55600000000000005},"min":{"1min":0.41999999999999998,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":1.9390000000000001,"5min":1.9390000000000001,"15min":1.9390000000000001},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.71799999999999997,"5min":0.59199999999999997,"15min":0.55800000000000005},"min":{"1min":0.39900000000000002,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":1.9630000000000001,"5min":1.9630000000000001,"15min":1.9630000000000001},"last":0.56000000000000005}]},{"osd":4,"last update":"Fri Jul 14 18:12:12 2023","interfaces":[{"interface":"back","average":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":1.0209999999999999,"5min":1.0209999999999999,"15min":1.0209999999999999},"last":0.75800000000000001},{"interface":"front","average":{"1min":0.745,"5min":0.745,"15min":0.745},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":0.93700000000000006,"5min":0.93700000000000006,"15min":0.93700000000000006},"last":0.68500000000000005}]},{"osd":5,"last update":"Fri Jul 14 18:12:28 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.55100000000000005,"15min":0.51500000000000001},"min":{"1min":0.32900000000000001,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.92900000000000005,"5min":1.1719999999999999,"15min":1.1719999999999999},"last":0.82799999999999996},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.54400000000000004,"15min":0.53100000000000003},"min":{"1min":0.40400000000000003,"5min":0.316,"15min":0.316},"max":{"1min":0.878,"5min":1.1499999999999999,"15min":1.1499999999999999},"last":0.621}]},{"osd":6,"last update":"Fri Jul 14 18:11:52 2023","interfaces":[{"interface":"back","average":{"1min":0.78200000000000003,"5min":0.67000000000000004,"15min":0.65600000000000003},"min":{"1min":0.505,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":2.3170000000000002,"5min":2.3170000000000002,"15min":2.3170000000000002},"last":0.78300000000000003},{"interface":"front","average":{"1min":0.753,"5min":0.623,"15min":0.59899999999999998},"min":{"1min":0.52700000000000002,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":2.3050000000000002,"5min":2.3050000000000002,"15min":2.3050000000000002},"last":0.66900000000000004}]},{"osd":7,"last update":"Fri Jul 14 18:12:12 2023","interfaces":[{"interface":"back","average":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"min":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.008,"5min":1.008,"15min":1.008},"last":0.745},{"interface":"front","average":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"min":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":1.0720000000000001,"5min":1.0720000000000001,"15min":1.0720000000000001},"last":0.85799999999999998}]},{"osd":8,"last update":"Fri Jul 14 18:12:28 2023","interfaces":[{"interface":"back","average":{"1min":0.76500000000000001,"5min":0.68799999999999994,"15min":0.63900000000000001},"min":{"1min":0.434,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":1.093,"5min":1.4570000000000001,"15min":1.4570000000000001},"last":0.88},{"interface":"front","average":{"1min":0.71799999999999997,"5min":0.622,"15min":0.58799999999999997},"min":{"1min":0.47699999999999998,"5min":0.379,"15min":0.379},"max":{"1min":0.95199999999999996,"5min":1.2769999999999999,"15min":1.2769999999999999},"last":0.86899999999999999}]},{"osd":9,"last update":"Fri Jul 14 18:11:52 2023","interfaces":[{"interface":"back","average":{"1min":0.85699999999999998,"5min":0.72699999999999998,"15min":0.70499999999999996},"min":{"1min":0.59599999999999997,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.0960000000000001,"5min":1.0960000000000001,"15min":1.0960000000000001},"last":0.89900000000000002},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.65400000000000003,"15min":0.64200000000000002},"min":{"1min":0.55200000000000005,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":0.90600000000000003,"5min":0.90600000000000003,"15min":0.90600000000000003},"last":0.76900000000000002}]},{"osd":10,"last update":"Fri Jul 14 18:12:12 2023","interfaces":[{"interface":"back","average":{"1min":0.79600000000000004,"5min":0.69599999999999995,"15min":0.68000000000000005},"min":{"1min":0.60599999999999998,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.0229999999999999,"5min":1.0229999999999999,"15min":1.0229999999999999},"last":0.73299999999999998},{"interface":"front","average":{"1min":0.85799999999999998,"5min":0.73699999999999999,"15min":0.71699999999999997},"min":{"1min":0.67400000000000004,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.0629999999999999,"5min":1.0629999999999999,"15min":1.0629999999999999},"last":0.79300000000000004}]},{"osd":11,"last update":"Fri Jul 14 18:12:12 2023","interfaces":[{"interface":"back","average":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"min":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"max":{"1min":0.97999999999999998,"5min":0.97999999999999998,"15min":0.97999999999999998},"last":0.81299999999999994},{"interface":"front","average":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"min":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"max":{"1min":1.006,"5min":1.006,"15min":1.006},"last":0.84199999999999997}]}]},{"osd":3,"up_from":25,"seq":107374182465,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27972,"kb_used_data":956,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717180,"statfs":{"total":95995035648,"available":95966392320,"internally_reserved":0,"allocated":978944,"data_stored":468739,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 18:12:49 2023","interfaces":[{"interface":"back","average":{"1min":0.35399999999999998,"5min":0.36899999999999999,"15min":0.36699999999999999},"min":{"1min":0.26200000000000001,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":0.46000000000000002,"5min":0.65700000000000003,"15min":0.65700000000000003},"last":0.27100000000000002},{"interface":"front","average":{"1min":0.33500000000000002,"5min":0.40200000000000002,"15min":0.38900000000000001},"min":{"1min":0.27600000000000002,"5min":0.248,"15min":0.248},"max":{"1min":0.41499999999999998,"5min":1.786,"15min":1.786},"last":0.23599999999999999}]},{"osd":1,"last update":"Fri Jul 14 18:12:49 2023","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.58199999999999996,"15min":0.52100000000000002},"min":{"1min":0.436,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":1.246,"5min":3.4369999999999998,"15min":3.4369999999999998},"last":0.52400000000000002},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.58099999999999996,"15min":0.53500000000000003},"min":{"1min":0.42399999999999999,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":1.2969999999999999,"5min":1.2969999999999999,"15min":1.2969999999999999},"last":0.45600000000000002}]},{"osd":2,"last update":"Fri Jul 14 18:12:49 2023","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.57499999999999996,"15min":0.56899999999999995},"min":{"1min":0.34300000000000003,"5min":0.307,"15min":0.307},"max":{"1min":0.66300000000000003,"5min":3.4540000000000002,"15min":3.4540000000000002},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.51800000000000002,"5min":0.56200000000000006,"15min":0.56200000000000006},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.75800000000000001,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.64700000000000002}]},{"osd":4,"last update":"Fri Jul 14 18:12:06 2023","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.58299999999999996,"15min":0.54400000000000004},"min":{"1min":0.42999999999999999,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.73499999999999999,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.58099999999999996,"15min":0.56399999999999995},"min":{"1min":0.42499999999999999,"5min":0.38,"15min":0.38},"max":{"1min":0.72699999999999998,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.38200000000000001}]},{"osd":5,"last update":"Fri Jul 14 18:12:31 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.59999999999999998,"15min":0.59499999999999997},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.79400000000000004,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.57299999999999995,"15min":0.58699999999999997},"min":{"1min":0.38900000000000001,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.72299999999999998,"5min":0.875,"15min":0.875},"last":0.63600000000000001}]},{"osd":6,"last update":"Fri Jul 14 18:12:49 2023","interfaces":[{"interface":"back","average":{"1min":0.42399999999999999,"5min":0.51200000000000001,"15min":0.52200000000000002},"min":{"1min":0.34599999999999997,"5min":0.317,"15min":0.317},"max":{"1min":0.63200000000000001,"5min":1.028,"15min":1.028},"last":0.34100000000000003},{"interface":"front","average":{"1min":0.501,"5min":0.57599999999999996,"15min":0.58499999999999996},"min":{"1min":0.376,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.68300000000000005,"5min":1.0669999999999999,"15min":1.0669999999999999},"last":0.36799999999999999}]},{"osd":7,"last update":"Fri Jul 14 18:12:10 2023","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.71099999999999997,"15min":0.71499999999999997},"min":{"1min":0.53600000000000003,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.391,"5min":1.391,"15min":1.391},"last":0.40100000000000002},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.65300000000000002,"15min":0.67100000000000004},"min":{"1min":0.46300000000000002,"5min":0.376,"15min":0.376},"max":{"1min":1.0660000000000001,"5min":1.131,"15min":1.131},"last":0.53700000000000003}]},{"osd":8,"last update":"Fri Jul 14 18:10:26 2023","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.046,"5min":1.046,"15min":1.046},"last":0.61099999999999999}]},{"osd":9,"last update":"Fri Jul 14 18:11:50 2023","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":0.57699999999999996,"15min":0.58799999999999997},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.75900000000000001,"5min":0.98999999999999999,"15min":0.98999999999999999},"last":0.48099999999999998},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.70699999999999996,"15min":0.72299999999999998},"min":{"1min":0.38200000000000001,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.96299999999999997,"5min":0.997,"15min":0.997},"last":0.32200000000000001}]},{"osd":10,"last update":"Fri Jul 14 18:12:10 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.77200000000000002,"15min":0.77800000000000002},"min":{"1min":0.56799999999999995,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":1.272,"5min":1.272,"15min":1.272},"last":0.42799999999999999},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.71999999999999997,"15min":0.72899999999999998},"min":{"1min":0.52600000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.2629999999999999,"5min":1.2629999999999999,"15min":1.2629999999999999},"last":0.56899999999999995}]},{"osd":11,"last update":"Fri Jul 14 18:12:10 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":0.89700000000000002,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.625}]}]},{"osd":4,"up_from":32,"seq":137438953533,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27972,"kb_used_data":956,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717180,"statfs":{"total":95995035648,"available":95966392320,"internally_reserved":0,"allocated":978944,"data_stored":474418,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 18:10:07 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.49099999999999999,"15min":0.48099999999999998},"min":{"1min":0.32100000000000001,"5min":0.313,"15min":0.313},"max":{"1min":1.347,"5min":1.347,"15min":1.347},"last":0.44400000000000001},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.50900000000000001,"15min":0.501},"min":{"1min":0.312,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":1.417,"5min":1.417,"15min":1.417},"last":0.53500000000000003}]},{"osd":1,"last update":"Fri Jul 14 18:12:14 2023","interfaces":[{"interface":"back","average":{"1min":0.441,"5min":0.40600000000000003,"15min":0.379},"min":{"1min":0.309,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.56200000000000006,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.46400000000000002,"5min":0.40899999999999997,"15min":0.36899999999999999},"min":{"1min":0.28899999999999998,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.74199999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.54800000000000004}]},{"osd":2,"last update":"Fri Jul 14 18:12:14 2023","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.57099999999999995,"15min":0.53700000000000003},"min":{"1min":0.44800000000000001,"5min":0.374,"15min":0.374},"max":{"1min":0.753,"5min":1.4019999999999999,"15min":1.4019999999999999},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.58299999999999996,"15min":0.54200000000000004},"min":{"1min":0.52900000000000003,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.82699999999999996,"5min":1.4750000000000001,"15min":1.4750000000000001},"last":0.65100000000000002}]},{"osd":3,"last update":"Fri Jul 14 18:12:14 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.55000000000000004,"15min":0.501},"min":{"1min":0.39100000000000001,"5min":0.318,"15min":0.318},"max":{"1min":0.81399999999999995,"5min":1.054,"15min":1.054},"last":0.81399999999999995},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.54900000000000004,"15min":0.53000000000000003},"min":{"1min":0.40799999999999997,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.65600000000000003,"5min":0.95299999999999996,"15min":0.95299999999999996},"last":0.68899999999999995}]},{"osd":5,"last update":"Fri Jul 14 18:12:36 2023","interfaces":[{"interface":"back","average":{"1min":0.76900000000000002,"5min":0.63400000000000001,"15min":0.56200000000000006},"min":{"1min":0.59199999999999997,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.90400000000000003,"5min":1.177,"15min":1.177},"last":0.70899999999999996},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.65300000000000002,"15min":0.58499999999999996},"min":{"1min":0.48699999999999999,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":1.0109999999999999,"5min":1.1220000000000001,"15min":1.1220000000000001},"last":0.85799999999999998}]},{"osd":6,"last update":"Fri Jul 14 18:11:51 2023","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.64200000000000002,"15min":0.61099999999999999},"min":{"1min":0.47599999999999998,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.83499999999999996,"5min":1.101,"15min":1.101},"last":0.76600000000000001},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.63400000000000001,"15min":0.61199999999999999},"min":{"1min":0.52300000000000002,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.78300000000000003,"5min":1.446,"15min":1.446},"last":0.73099999999999998}]},{"osd":7,"last update":"Fri Jul 14 18:12:14 2023","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.60599999999999998,"15min":0.57999999999999996},"min":{"1min":0.439,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.92100000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.93700000000000006},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.63900000000000001,"15min":0.60799999999999998},"min":{"1min":0.50700000000000001,"5min":0.316,"15min":0.316},"max":{"1min":0.95099999999999996,"5min":1.0189999999999999,"15min":1.0189999999999999},"last":1.0449999999999999}]},{"osd":8,"last update":"Fri Jul 14 18:12:34 2023","interfaces":[{"interface":"back","average":{"1min":0.72199999999999998,"5min":0.69399999999999995,"15min":0.69299999999999995},"min":{"1min":0.56599999999999995,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.93200000000000005,"5min":1.3740000000000001,"15min":1.3740000000000001},"last":0.84399999999999997},{"interface":"front","average":{"1min":0.86799999999999999,"5min":0.80100000000000005,"15min":0.78700000000000003},"min":{"1min":0.66700000000000004,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.0880000000000001,"5min":1.147,"15min":1.147},"last":0.99099999999999999}]},{"osd":9,"last update":"Fri Jul 14 18:11:51 2023","interfaces":[{"interface":"back","average":{"1min":0.78500000000000003,"5min":0.81399999999999995,"15min":0.81899999999999995},"min":{"1min":0.63800000000000001,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":0.98499999999999999,"5min":1.171,"15min":1.171},"last":0.90300000000000002},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.70999999999999996,"15min":0.71699999999999997},"min":{"1min":0.51300000000000001,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":0.85199999999999998,"5min":1.304,"15min":1.304},"last":0.88700000000000001}]},{"osd":10,"last update":"Fri Jul 14 18:12:14 2023","interfaces":[{"interface":"back","average":{"1min":0.747,"5min":0.73999999999999999,"15min":0.73899999999999999},"min":{"1min":0.58299999999999996,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":0.90400000000000003,"5min":1.016,"15min":1.016},"last":0.79500000000000004},{"interface":"front","average":{"1min":0.83999999999999997,"5min":0.82599999999999996,"15min":0.82399999999999995},"min":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.038,"5min":1.196,"15min":1.196},"last":1.0169999999999999}]},{"osd":11,"last update":"Fri Jul 14 18:12:08 2023","interfaces":[{"interface":"back","average":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"min":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"max":{"1min":0.96799999999999997,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.83299999999999996},{"interface":"front","average":{"1min":0.90800000000000003,"5min":0.90800000000000003,"15min":0.90800000000000003},"min":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"max":{"1min":1.0620000000000001,"5min":1.0620000000000001,"15min":1.0620000000000001},"last":0.95699999999999996}]}]},{"osd":5,"up_from":37,"seq":158913790008,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28576,"kb_used_data":1560,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716576,"statfs":{"total":95995035648,"available":95965773824,"internally_reserved":0,"allocated":1597440,"data_stored":1066375,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 18:12:31 2023","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.52700000000000002,"15min":0.51500000000000001},"min":{"1min":0.37,"5min":0.318,"15min":0.318},"max":{"1min":0.79000000000000004,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.47699999999999998},{"interface":"front","average":{"1min":0.501,"5min":0.51500000000000001,"15min":0.5},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.77100000000000002,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.49399999999999999}]},{"osd":1,"last update":"Fri Jul 14 18:12:31 2023","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.58099999999999996,"15min":0.54300000000000004},"min":{"1min":0.442,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.81599999999999995,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.59299999999999997,"15min":0.55700000000000005},"min":{"1min":0.38300000000000001,"5min":0.374,"15min":0.374},"max":{"1min":0.79200000000000004,"5min":0.90400000000000003,"15min":0.90400000000000003},"last":0.53600000000000003}]},{"osd":2,"last update":"Fri Jul 14 18:12:31 2023","interfaces":[{"interface":"back","average":{"1min":0.46899999999999997,"5min":0.44,"15min":0.38800000000000001},"min":{"1min":0.308,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.61299999999999999,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.67600000000000005},{"interface":"front","average":{"1min":0.44500000000000001,"5min":0.44400000000000001,"15min":0.40699999999999997},"min":{"1min":0.31,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.64300000000000002,"5min":0.751,"15min":0.751},"last":0.374}]},{"osd":3,"last update":"Fri Jul 14 18:12:31 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.55000000000000004,"15min":0.52200000000000002},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.82399999999999995,"5min":0.90300000000000002,"15min":0.90300000000000002},"last":0.40100000000000002},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.54500000000000004,"15min":0.51100000000000001},"min":{"1min":0.40300000000000002,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.442}]},{"osd":4,"last update":"Fri Jul 14 18:12:31 2023","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.61699999999999999,"15min":0.58299999999999996},"min":{"1min":0.53300000000000003,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.84599999999999997,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.51500000000000001},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.628,"15min":0.58499999999999996},"min":{"1min":0.42399999999999999,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.87,"5min":1.1379999999999999,"15min":1.1379999999999999},"last":0.66100000000000003}]},{"osd":6,"last update":"Fri Jul 14 18:11:50 2023","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.59699999999999998,"15min":0.57799999999999996},"min":{"1min":0.40000000000000002,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.93400000000000005,"5min":1.0289999999999999,"15min":1.0289999999999999},"last":0.54800000000000004},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.60899999999999999,"15min":0.59299999999999997},"min":{"1min":0.38700000000000001,"5min":0.371,"15min":0.371},"max":{"1min":0.96599999999999997,"5min":0.96599999999999997,"15min":0.96599999999999997},"last":0.52400000000000002}]},{"osd":7,"last update":"Fri Jul 14 18:12:12 2023","interfaces":[{"interface":"back","average":{"1min":0.72099999999999997,"5min":0.67000000000000004,"15min":0.65000000000000002},"min":{"1min":0.58599999999999997,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.89400000000000002,"5min":1.0669999999999999,"15min":1.0669999999999999},"last":0.625},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.69999999999999996,"15min":0.68300000000000005},"min":{"1min":0.54500000000000004,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":1.0269999999999999,"5min":1.081,"15min":1.081},"last":0.72199999999999998}]},{"osd":8,"last update":"Fri Jul 14 18:12:31 2023","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":0.67500000000000004,"15min":0.66900000000000004},"min":{"1min":0.42799999999999999,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.84999999999999998,"5min":0.99399999999999999,"15min":0.99399999999999999},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.65500000000000003,"15min":0.64900000000000002},"min":{"1min":0.45100000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.82199999999999995,"5min":1.1859999999999999,"15min":1.1859999999999999},"last":0.59599999999999997}]},{"osd":9,"last update":"Fri Jul 14 18:11:50 2023","interfaces":[{"interface":"back","average":{"1min":0.73999999999999999,"5min":0.746,"15min":0.747},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":1.0429999999999999,"5min":1.2350000000000001,"15min":1.2350000000000001},"last":0.70799999999999996},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.73399999999999999,"15min":0.73399999999999999},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":1.0920000000000001,"5min":1.0920000000000001,"15min":1.0920000000000001},"last":0.64500000000000002}]},{"osd":10,"last update":"Fri Jul 14 18:12:12 2023","interfaces":[{"interface":"back","average":{"1min":0.80700000000000005,"5min":0.77900000000000003,"15min":0.77400000000000002},"min":{"1min":0.53100000000000003,"5min":0.495,"15min":0.495},"max":{"1min":1.0669999999999999,"5min":1.0669999999999999,"15min":1.0669999999999999},"last":0.69099999999999995},{"interface":"front","average":{"1min":0.81399999999999995,"5min":0.77500000000000002,"15min":0.76900000000000002},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.1399999999999999,"5min":1.1399999999999999,"15min":1.1399999999999999},"last":0.753}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2629,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":68108,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":106496,"data_stored":68779,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3271,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1173,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":5026,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":1500,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":64303,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1643,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-14T18:12:52.373 INFO:tasks.fwd_scrub.ceph_manager:clean! 2023-07-14T18:12:52.374 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-14T18:12:52.525 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:52.484+0000 7f3e7a5d4700 1 -- 172.21.15.163:0/2796379298 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f3e740fdf10 msgr2=0x7f3e740fe320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:12:52.525 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:52.484+0000 7f3e7a5d4700 1 --2- 172.21.15.163:0/2796379298 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f3e740fdf10 0x7f3e740fe320 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f3e64009990 tx=0x7f3e64009ca0 comp rx=0 tx=0).stop 2023-07-14T18:12:52.525 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:52.484+0000 7f3e7a5d4700 1 -- 172.21.15.163:0/2796379298 shutdown_connections 2023-07-14T18:12:52.525 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:52.484+0000 7f3e7a5d4700 1 --2- 172.21.15.163:0/2796379298 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3e74101870 0x7f3e74108130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:52.525 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:52.484+0000 7f3e7a5d4700 1 --2- 172.21.15.163:0/2796379298 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f3e740fdf10 0x7f3e740fe320 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:52.526 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:52.484+0000 7f3e7a5d4700 1 --2- 172.21.15.163:0/2796379298 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3e74100ee0 0x7f3e74101330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:52.526 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:52.484+0000 7f3e7a5d4700 1 -- 172.21.15.163:0/2796379298 >> 172.21.15.163:0/2796379298 conn(0x7f3e740f98d0 msgr2=0x7f3e740fbd20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:12:52.526 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:52.484+0000 7f3e7a5d4700 1 -- 172.21.15.163:0/2796379298 shutdown_connections 2023-07-14T18:12:52.526 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:52.484+0000 7f3e7a5d4700 1 -- 172.21.15.163:0/2796379298 wait complete. 2023-07-14T18:12:52.528 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:52.485+0000 7f3e7a5d4700 1 Processor -- start 2023-07-14T18:12:52.528 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:52.485+0000 7f3e7a5d4700 1 -- start start 2023-07-14T18:12:52.528 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:52.485+0000 7f3e7a5d4700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3e740fdf10 0x7f3e74195900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:12:52.528 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:52.485+0000 7f3e7a5d4700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f3e74100ee0 0x7f3e74195e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:12:52.528 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:52.485+0000 7f3e7a5d4700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3e74101870 0x7f3e7419ceb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:12:52.528 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:52.485+0000 7f3e7a5d4700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e7419d480 con 0x7f3e74100ee0 2023-07-14T18:12:52.529 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:52.485+0000 7f3e7a5d4700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e7419d5c0 con 0x7f3e74101870 2023-07-14T18:12:52.529 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:52.485+0000 7f3e7a5d4700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e7419d750 con 0x7f3e740fdf10 2023-07-14T18:12:52.529 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:52.485+0000 7f3e6bfff700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f3e74100ee0 0x7f3e74195e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:12:52.529 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:52.485+0000 7f3e6bfff700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f3e74100ee0 0x7f3e74195e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:57908/0 (socket says 172.21.15.163:57908) 2023-07-14T18:12:52.529 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:52.485+0000 7f3e6bfff700 1 -- 172.21.15.163:0/2004891148 learned_addr learned my addr 172.21.15.163:0/2004891148 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:12:52.529 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:52.485+0000 7f3e73fff700 1 --2- 172.21.15.163:0/2004891148 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3e740fdf10 0x7f3e74195900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:12:52.529 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:52.485+0000 7f3e78b71700 1 --2- 172.21.15.163:0/2004891148 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3e74101870 0x7f3e7419ceb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:12:52.529 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:52.485+0000 7f3e6bfff700 1 -- 172.21.15.163:0/2004891148 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3e740fdf10 msgr2=0x7f3e74195900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:12:52.530 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:52.485+0000 7f3e6bfff700 1 --2- 172.21.15.163:0/2004891148 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3e740fdf10 0x7f3e74195900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:52.530 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:52.485+0000 7f3e6bfff700 1 -- 172.21.15.163:0/2004891148 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3e74101870 msgr2=0x7f3e7419ceb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:12:52.530 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:52.485+0000 7f3e6bfff700 1 --2- 172.21.15.163:0/2004891148 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3e74101870 0x7f3e7419ceb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:52.530 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:52.485+0000 7f3e6bfff700 1 -- 172.21.15.163:0/2004891148 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e640095f0 con 0x7f3e74100ee0 2023-07-14T18:12:52.530 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:52.485+0000 7f3e73fff700 1 --2- 172.21.15.163:0/2004891148 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3e740fdf10 0x7f3e74195900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T18:12:52.530 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:52.485+0000 7f3e78b71700 1 --2- 172.21.15.163:0/2004891148 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3e74101870 0x7f3e7419ceb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T18:12:52.530 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:52.486+0000 7f3e6bfff700 1 --2- 172.21.15.163:0/2004891148 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f3e74100ee0 0x7f3e74195e40 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f3e5c00e9a0 tx=0x7f3e5c00ed60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:12:52.531 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:52.486+0000 7f3e71ffb700 1 -- 172.21.15.163:0/2004891148 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e5c009790 con 0x7f3e74100ee0 2023-07-14T18:12:52.531 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:52.486+0000 7f3e71ffb700 1 -- 172.21.15.163:0/2004891148 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f3e5c00cbd0 con 0x7f3e74100ee0 2023-07-14T18:12:52.531 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:52.486+0000 7f3e7a5d4700 1 -- 172.21.15.163:0/2004891148 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3e7419da30 con 0x7f3e74100ee0 2023-07-14T18:12:52.531 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:52.486+0000 7f3e71ffb700 1 -- 172.21.15.163:0/2004891148 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e5c018680 con 0x7f3e74100ee0 2023-07-14T18:12:52.531 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:52.486+0000 7f3e7a5d4700 1 -- 172.21.15.163:0/2004891148 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e7419df40 con 0x7f3e74100ee0 2023-07-14T18:12:52.531 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:52.487+0000 7f3e7a5d4700 1 -- 172.21.15.163:0/2004891148 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3e741072b0 con 0x7f3e74100ee0 2023-07-14T18:12:52.532 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:52.488+0000 7f3e71ffb700 1 -- 172.21.15.163:0/2004891148 <== mon.0 v2:172.21.15.163:3300/0 4 ==== mgrmap(e 18) v1 ==== 135716+0+0 (secure 0 0 0) 0x7f3e5c00cd40 con 0x7f3e74100ee0 2023-07-14T18:12:52.532 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:52.488+0000 7f3e71ffb700 1 --2- 172.21.15.163:0/2004891148 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f3e600a11a0 0x7f3e600a3650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:12:52.532 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:52.488+0000 7f3e73fff700 1 --2- 172.21.15.163:0/2004891148 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f3e600a11a0 0x7f3e600a3650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:12:52.532 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:52.488+0000 7f3e71ffb700 1 -- 172.21.15.163:0/2004891148 <== mon.0 v2:172.21.15.163:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 9020+0+0 (secure 0 0 0) 0x7f3e5c014070 con 0x7f3e74100ee0 2023-07-14T18:12:52.532 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:52.489+0000 7f3e73fff700 1 --2- 172.21.15.163:0/2004891148 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f3e600a11a0 0x7f3e600a3650 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f3e640098e0 tx=0x7f3e64005fd0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:12:52.533 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:52.493+0000 7f3e71ffb700 1 -- 172.21.15.163:0/2004891148 <== mon.0 v2:172.21.15.163:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178025 (secure 0 0 0) 0x7f3e5c051780 con 0x7f3e74100ee0 2023-07-14T18:12:52.717 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:52.677+0000 7f3e7a5d4700 1 -- 172.21.15.163:0/2004891148 --> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f3e74060a80 con 0x7f3e600a11a0 2023-07-14T18:12:52.730 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:52.689+0000 7f3e71ffb700 1 -- 172.21.15.163:0/2004891148 <== mgr.14152 v2:172.21.15.163:6800/1949590926 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+427232 (secure 0 0 0) 0x7f3e74060a80 con 0x7f3e600a11a0 2023-07-14T18:12:52.734 INFO:teuthology.orchestra.run.smithi163.stdout: 2023-07-14T18:12:52.736 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:52.693+0000 7f3e7a5d4700 1 -- 172.21.15.163:0/2004891148 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f3e600a11a0 msgr2=0x7f3e600a3650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:12:52.736 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:52.693+0000 7f3e7a5d4700 1 --2- 172.21.15.163:0/2004891148 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f3e600a11a0 0x7f3e600a3650 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f3e640098e0 tx=0x7f3e64005fd0 comp rx=0 tx=0).stop 2023-07-14T18:12:52.737 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:52.693+0000 7f3e7a5d4700 1 -- 172.21.15.163:0/2004891148 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f3e74100ee0 msgr2=0x7f3e74195e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:12:52.737 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:52.693+0000 7f3e7a5d4700 1 --2- 172.21.15.163:0/2004891148 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f3e74100ee0 0x7f3e74195e40 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f3e5c00e9a0 tx=0x7f3e5c00ed60 comp rx=0 tx=0).stop 2023-07-14T18:12:52.737 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:52.693+0000 7f3e7a5d4700 1 -- 172.21.15.163:0/2004891148 shutdown_connections 2023-07-14T18:12:52.737 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:52.693+0000 7f3e7a5d4700 1 --2- 172.21.15.163:0/2004891148 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f3e600a11a0 0x7f3e600a3650 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:52.737 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:52.693+0000 7f3e7a5d4700 1 --2- 172.21.15.163:0/2004891148 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3e740fdf10 0x7f3e74195900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:52.737 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:52.693+0000 7f3e7a5d4700 1 --2- 172.21.15.163:0/2004891148 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3e74101870 0x7f3e7419ceb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:52.738 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:52.693+0000 7f3e7a5d4700 1 --2- 172.21.15.163:0/2004891148 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f3e74100ee0 0x7f3e74195e40 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:52.738 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:52.693+0000 7f3e7a5d4700 1 -- 172.21.15.163:0/2004891148 >> 172.21.15.163:0/2004891148 conn(0x7f3e740f98d0 msgr2=0x7f3e741043f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:12:52.738 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:52.693+0000 7f3e7a5d4700 1 -- 172.21.15.163:0/2004891148 shutdown_connections 2023-07-14T18:12:52.738 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:52.693+0000 7f3e7a5d4700 1 -- 172.21.15.163:0/2004891148 wait complete. 2023-07-14T18:12:52.738 INFO:teuthology.orchestra.run.smithi163.stderr:dumped all 2023-07-14T18:12:52.746 INFO:teuthology.orchestra.run.smithi163.stdout:{"pg_ready":true,"pg_map":{"version":304,"stamp":"2023-07-14T18:12:51.435959+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":660956,"num_objects":102,"num_object_clones":0,"num_object_copies":308,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":950,"num_read_kb":598,"num_write":433,"num_write_kb":3088,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":859,"ondisk_log_size":859,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":419,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":337688,"kb_used_data":13496,"kb_used_omap":20,"kb_used_meta":324075,"kb_avail":1124604136,"statfs":{"total":1151940427776,"available":1151594635264,"internally_reserved":0,"allocated":13819904,"data_stored":7645729,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":21372,"internal_metadata":331852932},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":39,"apply_latency_ms":39,"commit_latency_ns":39000000,"apply_latency_ns":39000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2885,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":117,"num_read_kb":57,"num_write":17,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.007430"},"pg_stats":[{"pgid":"3.3f","version":"86'8","reported_seq":32,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T18:12:45.460577+0000","last_change":"2023-07-14T18:11:09.713546+0000","last_active":"2023-07-14T18:12:45.460577+0000","last_peered":"2023-07-14T18:12:45.460577+0000","last_clean":"2023-07-14T18:12:45.460577+0000","last_became_active":"2023-07-14T18:11:09.713170+0000","last_became_peered":"2023-07-14T18:11:09.713170+0000","last_unstale":"2023-07-14T18:12:45.460577+0000","last_undegraded":"2023-07-14T18:12:45.460577+0000","last_fullsized":"2023-07-14T18:12:45.460577+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_clean_scrub_stamp":"2023-07-14T18:11:08.667354+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T03:40:36.998253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"86'4","reported_seq":28,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T18:12:45.441618+0000","last_change":"2023-07-14T18:11:09.711619+0000","last_active":"2023-07-14T18:12:45.441618+0000","last_peered":"2023-07-14T18:12:45.441618+0000","last_clean":"2023-07-14T18:12:45.441618+0000","last_became_active":"2023-07-14T18:11:09.711249+0000","last_became_peered":"2023-07-14T18:11:09.711249+0000","last_unstale":"2023-07-14T18:12:45.441618+0000","last_undegraded":"2023-07-14T18:12:45.441618+0000","last_fullsized":"2023-07-14T18:12:45.441618+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_clean_scrub_stamp":"2023-07-14T18:11:08.667354+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T02:13:28.408928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"86'7","reported_seq":31,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T18:12:45.448220+0000","last_change":"2023-07-14T18:11:09.705557+0000","last_active":"2023-07-14T18:12:45.448220+0000","last_peered":"2023-07-14T18:12:45.448220+0000","last_clean":"2023-07-14T18:12:45.448220+0000","last_became_active":"2023-07-14T18:11:09.705179+0000","last_became_peered":"2023-07-14T18:11:09.705179+0000","last_unstale":"2023-07-14T18:12:45.448220+0000","last_undegraded":"2023-07-14T18:12:45.448220+0000","last_fullsized":"2023-07-14T18:12:45.448220+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_clean_scrub_stamp":"2023-07-14T18:11:08.667354+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:59:15.173719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"86'8","reported_seq":32,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T18:12:45.449133+0000","last_change":"2023-07-14T18:11:09.709234+0000","last_active":"2023-07-14T18:12:45.449133+0000","last_peered":"2023-07-14T18:12:45.449133+0000","last_clean":"2023-07-14T18:12:45.449133+0000","last_became_active":"2023-07-14T18:11:09.708855+0000","last_became_peered":"2023-07-14T18:11:09.708855+0000","last_unstale":"2023-07-14T18:12:45.449133+0000","last_undegraded":"2023-07-14T18:12:45.449133+0000","last_fullsized":"2023-07-14T18:12:45.449133+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_clean_scrub_stamp":"2023-07-14T18:11:08.667354+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:35:24.047137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"86'4","reported_seq":28,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T18:12:45.443286+0000","last_change":"2023-07-14T18:11:09.704301+0000","last_active":"2023-07-14T18:12:45.443286+0000","last_peered":"2023-07-14T18:12:45.443286+0000","last_clean":"2023-07-14T18:12:45.443286+0000","last_became_active":"2023-07-14T18:11:09.703961+0000","last_became_peered":"2023-07-14T18:11:09.703961+0000","last_unstale":"2023-07-14T18:12:45.443286+0000","last_undegraded":"2023-07-14T18:12:45.443286+0000","last_fullsized":"2023-07-14T18:12:45.443286+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_clean_scrub_stamp":"2023-07-14T18:11:08.667354+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:53:53.273088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"86'6","reported_seq":30,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T18:12:45.453093+0000","last_change":"2023-07-14T18:11:09.717667+0000","last_active":"2023-07-14T18:12:45.453093+0000","last_peered":"2023-07-14T18:12:45.453093+0000","last_clean":"2023-07-14T18:12:45.453093+0000","last_became_active":"2023-07-14T18:11:09.717146+0000","last_became_peered":"2023-07-14T18:11:09.717146+0000","last_unstale":"2023-07-14T18:12:45.453093+0000","last_undegraded":"2023-07-14T18:12:45.453093+0000","last_fullsized":"2023-07-14T18:12:45.453093+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_clean_scrub_stamp":"2023-07-14T18:11:08.667354+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T03:28:45.689618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"86'5","reported_seq":27,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T18:12:45.441864+0000","last_change":"2023-07-14T18:11:09.713638+0000","last_active":"2023-07-14T18:12:45.441864+0000","last_peered":"2023-07-14T18:12:45.441864+0000","last_clean":"2023-07-14T18:12:45.441864+0000","last_became_active":"2023-07-14T18:11:09.707940+0000","last_became_peered":"2023-07-14T18:11:09.707940+0000","last_unstale":"2023-07-14T18:12:45.441864+0000","last_undegraded":"2023-07-14T18:12:45.441864+0000","last_fullsized":"2023-07-14T18:12:45.441864+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_clean_scrub_stamp":"2023-07-14T18:11:08.667354+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:50:20.740517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"86'9","reported_seq":33,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T18:12:45.446140+0000","last_change":"2023-07-14T18:11:09.709804+0000","last_active":"2023-07-14T18:12:45.446140+0000","last_peered":"2023-07-14T18:12:45.446140+0000","last_clean":"2023-07-14T18:12:45.446140+0000","last_became_active":"2023-07-14T18:11:09.709385+0000","last_became_peered":"2023-07-14T18:11:09.709385+0000","last_unstale":"2023-07-14T18:12:45.446140+0000","last_undegraded":"2023-07-14T18:12:45.446140+0000","last_fullsized":"2023-07-14T18:12:45.446140+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_clean_scrub_stamp":"2023-07-14T18:11:08.667354+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T02:39:39.063898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"86'11","reported_seq":35,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T18:12:45.459915+0000","last_change":"2023-07-14T18:11:09.710410+0000","last_active":"2023-07-14T18:12:45.459915+0000","last_peered":"2023-07-14T18:12:45.459915+0000","last_clean":"2023-07-14T18:12:45.459915+0000","last_became_active":"2023-07-14T18:11:09.710049+0000","last_became_peered":"2023-07-14T18:11:09.710049+0000","last_unstale":"2023-07-14T18:12:45.459915+0000","last_undegraded":"2023-07-14T18:12:45.459915+0000","last_fullsized":"2023-07-14T18:12:45.459915+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_clean_scrub_stamp":"2023-07-14T18:11:08.667354+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:25:16.811711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"86'16","reported_seq":40,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T18:12:45.453260+0000","last_change":"2023-07-14T18:11:09.717681+0000","last_active":"2023-07-14T18:12:45.453260+0000","last_peered":"2023-07-14T18:12:45.453260+0000","last_clean":"2023-07-14T18:12:45.453260+0000","last_became_active":"2023-07-14T18:11:09.717209+0000","last_became_peered":"2023-07-14T18:11:09.717209+0000","last_unstale":"2023-07-14T18:12:45.453260+0000","last_undegraded":"2023-07-14T18:12:45.453260+0000","last_fullsized":"2023-07-14T18:12:45.453260+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_clean_scrub_stamp":"2023-07-14T18:11:08.667354+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:46:36.145271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"86'6","reported_seq":28,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T18:12:45.458937+0000","last_change":"2023-07-14T18:11:09.716890+0000","last_active":"2023-07-14T18:12:45.458937+0000","last_peered":"2023-07-14T18:12:45.458937+0000","last_clean":"2023-07-14T18:12:45.458937+0000","last_became_active":"2023-07-14T18:11:09.708773+0000","last_became_peered":"2023-07-14T18:11:09.708773+0000","last_unstale":"2023-07-14T18:12:45.458937+0000","last_undegraded":"2023-07-14T18:12:45.458937+0000","last_fullsized":"2023-07-14T18:12:45.458937+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_clean_scrub_stamp":"2023-07-14T18:11:08.667354+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:20:10.630301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"86'7","reported_seq":31,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T18:12:45.449001+0000","last_change":"2023-07-14T18:11:09.715119+0000","last_active":"2023-07-14T18:12:45.449001+0000","last_peered":"2023-07-14T18:12:45.449001+0000","last_clean":"2023-07-14T18:12:45.449001+0000","last_became_active":"2023-07-14T18:11:09.714680+0000","last_became_peered":"2023-07-14T18:11:09.714680+0000","last_unstale":"2023-07-14T18:12:45.449001+0000","last_undegraded":"2023-07-14T18:12:45.449001+0000","last_fullsized":"2023-07-14T18:12:45.449001+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_clean_scrub_stamp":"2023-07-14T18:11:08.667354+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T02:09:45.252484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"86'10","reported_seq":34,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T18:12:45.452938+0000","last_change":"2023-07-14T18:11:09.711173+0000","last_active":"2023-07-14T18:12:45.452938+0000","last_peered":"2023-07-14T18:12:45.452938+0000","last_clean":"2023-07-14T18:12:45.452938+0000","last_became_active":"2023-07-14T18:11:09.710849+0000","last_became_peered":"2023-07-14T18:11:09.710849+0000","last_unstale":"2023-07-14T18:12:45.452938+0000","last_undegraded":"2023-07-14T18:12:45.452938+0000","last_fullsized":"2023-07-14T18:12:45.452938+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_clean_scrub_stamp":"2023-07-14T18:11:08.667354+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:26:29.490965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"86'7","reported_seq":31,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T18:12:45.441004+0000","last_change":"2023-07-14T18:11:09.710448+0000","last_active":"2023-07-14T18:12:45.441004+0000","last_peered":"2023-07-14T18:12:45.441004+0000","last_clean":"2023-07-14T18:12:45.441004+0000","last_became_active":"2023-07-14T18:11:09.709804+0000","last_became_peered":"2023-07-14T18:11:09.709804+0000","last_unstale":"2023-07-14T18:12:45.441004+0000","last_undegraded":"2023-07-14T18:12:45.441004+0000","last_fullsized":"2023-07-14T18:12:45.441004+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_clean_scrub_stamp":"2023-07-14T18:11:08.667354+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T05:07:41.470601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"86'7","reported_seq":31,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T18:12:45.447823+0000","last_change":"2023-07-14T18:11:09.714917+0000","last_active":"2023-07-14T18:12:45.447823+0000","last_peered":"2023-07-14T18:12:45.447823+0000","last_clean":"2023-07-14T18:12:45.447823+0000","last_became_active":"2023-07-14T18:11:09.714655+0000","last_became_peered":"2023-07-14T18:11:09.714655+0000","last_unstale":"2023-07-14T18:12:45.447823+0000","last_undegraded":"2023-07-14T18:12:45.447823+0000","last_fullsized":"2023-07-14T18:12:45.447823+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_clean_scrub_stamp":"2023-07-14T18:11:08.667354+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T01:03:06.999938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"86'9","reported_seq":33,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T18:12:45.456009+0000","last_change":"2023-07-14T18:11:09.709149+0000","last_active":"2023-07-14T18:12:45.456009+0000","last_peered":"2023-07-14T18:12:45.456009+0000","last_clean":"2023-07-14T18:12:45.456009+0000","last_became_active":"2023-07-14T18:11:09.708692+0000","last_became_peered":"2023-07-14T18:11:09.708692+0000","last_unstale":"2023-07-14T18:12:45.456009+0000","last_undegraded":"2023-07-14T18:12:45.456009+0000","last_fullsized":"2023-07-14T18:12:45.456009+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_clean_scrub_stamp":"2023-07-14T18:11:08.667354+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:38:32.969267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"86'8","reported_seq":32,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T18:12:45.460687+0000","last_change":"2023-07-14T18:11:09.720235+0000","last_active":"2023-07-14T18:12:45.460687+0000","last_peered":"2023-07-14T18:12:45.460687+0000","last_clean":"2023-07-14T18:12:45.460687+0000","last_became_active":"2023-07-14T18:11:09.719895+0000","last_became_peered":"2023-07-14T18:11:09.719895+0000","last_unstale":"2023-07-14T18:12:45.460687+0000","last_undegraded":"2023-07-14T18:12:45.460687+0000","last_fullsized":"2023-07-14T18:12:45.460687+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_clean_scrub_stamp":"2023-07-14T18:11:08.667354+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T01:21:08.877374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"86'10","reported_seq":34,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T18:12:45.446473+0000","last_change":"2023-07-14T18:11:09.712390+0000","last_active":"2023-07-14T18:12:45.446473+0000","last_peered":"2023-07-14T18:12:45.446473+0000","last_clean":"2023-07-14T18:12:45.446473+0000","last_became_active":"2023-07-14T18:11:09.712074+0000","last_became_peered":"2023-07-14T18:11:09.712074+0000","last_unstale":"2023-07-14T18:12:45.446473+0000","last_undegraded":"2023-07-14T18:12:45.446473+0000","last_fullsized":"2023-07-14T18:12:45.446473+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_clean_scrub_stamp":"2023-07-14T18:11:08.667354+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:45:31.539804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"86'7","reported_seq":37,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T18:12:45.448352+0000","last_change":"2023-07-14T18:12:16.821031+0000","last_active":"2023-07-14T18:12:45.448352+0000","last_peered":"2023-07-14T18:12:45.448352+0000","last_clean":"2023-07-14T18:12:45.448352+0000","last_became_active":"2023-07-14T18:12:16.820659+0000","last_became_peered":"2023-07-14T18:12:16.820659+0000","last_unstale":"2023-07-14T18:12:45.448352+0000","last_undegraded":"2023-07-14T18:12:45.448352+0000","last_fullsized":"2023-07-14T18:12:45.448352+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_clean_scrub_stamp":"2023-07-14T18:11:08.667354+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:32:09.374522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,9,6],"acting":[2,9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T18:12:16.783949+0000","last_change":"2023-07-14T18:11:13.786505+0000","last_active":"2023-07-14T18:12:16.783949+0000","last_peered":"2023-07-14T18:12:16.783949+0000","last_clean":"2023-07-14T18:12:16.783949+0000","last_became_active":"2023-07-14T18:11:13.786141+0000","last_became_peered":"2023-07-14T18:11:13.786141+0000","last_unstale":"2023-07-14T18:12:16.783949+0000","last_undegraded":"2023-07-14T18:12:16.783949+0000","last_fullsized":"2023-07-14T18:12:16.783949+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:12.753466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:12.753466+0000","last_clean_scrub_stamp":"2023-07-14T18:11:12.753466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:31:14.426319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,9,0],"acting":[2,3,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"86'14","reported_seq":117,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T18:12:46.639522+0000","last_change":"2023-07-14T18:11:08.691446+0000","last_active":"2023-07-14T18:12:46.639522+0000","last_peered":"2023-07-14T18:12:46.639522+0000","last_clean":"2023-07-14T18:12:46.639522+0000","last_became_active":"2023-07-14T18:11:08.691129+0000","last_became_peered":"2023-07-14T18:11:08.691129+0000","last_unstale":"2023-07-14T18:12:46.639522+0000","last_undegraded":"2023-07-14T18:12:46.639522+0000","last_fullsized":"2023-07-14T18:12:46.639522+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:07.665746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:07.665746+0000","last_clean_scrub_stamp":"2023-07-14T18:11:07.665746+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:05:56.745631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":77,"num_read_kb":77,"num_write":15,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"86'5","reported_seq":29,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T18:12:45.435818+0000","last_change":"2023-07-14T18:11:09.708155+0000","last_active":"2023-07-14T18:12:45.435818+0000","last_peered":"2023-07-14T18:12:45.435818+0000","last_clean":"2023-07-14T18:12:45.435818+0000","last_became_active":"2023-07-14T18:11:09.707856+0000","last_became_peered":"2023-07-14T18:11:09.707856+0000","last_unstale":"2023-07-14T18:12:45.435818+0000","last_undegraded":"2023-07-14T18:12:45.435818+0000","last_fullsized":"2023-07-14T18:12:45.435818+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_clean_scrub_stamp":"2023-07-14T18:11:08.667354+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T01:19:38.619686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T18:12:16.781206+0000","last_change":"2023-07-14T18:11:13.776947+0000","last_active":"2023-07-14T18:12:16.781206+0000","last_peered":"2023-07-14T18:12:16.781206+0000","last_clean":"2023-07-14T18:12:16.781206+0000","last_became_active":"2023-07-14T18:11:13.776557+0000","last_became_peered":"2023-07-14T18:11:13.776557+0000","last_unstale":"2023-07-14T18:12:16.781206+0000","last_undegraded":"2023-07-14T18:12:16.781206+0000","last_fullsized":"2023-07-14T18:12:16.781206+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:12.753466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:12.753466+0000","last_clean_scrub_stamp":"2023-07-14T18:11:12.753466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:02:05.693156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,9,3],"acting":[4,6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1e","version":"84'2","reported_seq":28,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T18:12:16.780754+0000","last_change":"2023-07-14T18:11:08.690072+0000","last_active":"2023-07-14T18:12:16.780754+0000","last_peered":"2023-07-14T18:12:16.780754+0000","last_clean":"2023-07-14T18:12:16.780754+0000","last_became_active":"2023-07-14T18:11:08.689770+0000","last_became_peered":"2023-07-14T18:11:08.689770+0000","last_unstale":"2023-07-14T18:12:16.780754+0000","last_undegraded":"2023-07-14T18:12:16.780754+0000","last_fullsized":"2023-07-14T18:12:16.780754+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:07.665746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:07.665746+0000","last_clean_scrub_stamp":"2023-07-14T18:11:07.665746+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T03:14:32.886334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"86'6","reported_seq":30,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T18:12:45.459717+0000","last_change":"2023-07-14T18:11:09.706952+0000","last_active":"2023-07-14T18:12:45.459717+0000","last_peered":"2023-07-14T18:12:45.459717+0000","last_clean":"2023-07-14T18:12:45.459717+0000","last_became_active":"2023-07-14T18:11:09.706646+0000","last_became_peered":"2023-07-14T18:11:09.706646+0000","last_unstale":"2023-07-14T18:12:45.459717+0000","last_undegraded":"2023-07-14T18:12:45.459717+0000","last_fullsized":"2023-07-14T18:12:45.459717+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_clean_scrub_stamp":"2023-07-14T18:11:08.667354+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:27:36.385233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T18:12:16.781483+0000","last_change":"2023-07-14T18:11:13.779167+0000","last_active":"2023-07-14T18:12:16.781483+0000","last_peered":"2023-07-14T18:12:16.781483+0000","last_clean":"2023-07-14T18:12:16.781483+0000","last_became_active":"2023-07-14T18:11:13.778486+0000","last_became_peered":"2023-07-14T18:11:13.778486+0000","last_unstale":"2023-07-14T18:12:16.781483+0000","last_undegraded":"2023-07-14T18:12:16.781483+0000","last_fullsized":"2023-07-14T18:12:16.781483+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:12.753466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:12.753466+0000","last_clean_scrub_stamp":"2023-07-14T18:11:12.753466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:43:53.682087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,9,5],"acting":[4,3,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"84'12","reported_seq":39,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T18:12:16.785096+0000","last_change":"2023-07-14T18:11:08.688289+0000","last_active":"2023-07-14T18:12:16.785096+0000","last_peered":"2023-07-14T18:12:16.785096+0000","last_clean":"2023-07-14T18:12:16.785096+0000","last_became_active":"2023-07-14T18:11:08.687994+0000","last_became_peered":"2023-07-14T18:11:08.687994+0000","last_unstale":"2023-07-14T18:12:16.785096+0000","last_undegraded":"2023-07-14T18:12:16.785096+0000","last_fullsized":"2023-07-14T18:12:16.785096+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:07.665746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:07.665746+0000","last_clean_scrub_stamp":"2023-07-14T18:11:07.665746+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:47:18.133067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"86'9","reported_seq":33,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T18:12:45.459908+0000","last_change":"2023-07-14T18:11:09.711910+0000","last_active":"2023-07-14T18:12:45.459908+0000","last_peered":"2023-07-14T18:12:45.459908+0000","last_clean":"2023-07-14T18:12:45.459908+0000","last_became_active":"2023-07-14T18:11:09.711634+0000","last_became_peered":"2023-07-14T18:11:09.711634+0000","last_unstale":"2023-07-14T18:12:45.459908+0000","last_undegraded":"2023-07-14T18:12:45.459908+0000","last_fullsized":"2023-07-14T18:12:45.459908+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_clean_scrub_stamp":"2023-07-14T18:11:08.667354+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:25:00.505872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T18:12:16.781337+0000","last_change":"2023-07-14T18:11:13.778662+0000","last_active":"2023-07-14T18:12:16.781337+0000","last_peered":"2023-07-14T18:12:16.781337+0000","last_clean":"2023-07-14T18:12:16.781337+0000","last_became_active":"2023-07-14T18:11:13.777886+0000","last_became_peered":"2023-07-14T18:11:13.777886+0000","last_unstale":"2023-07-14T18:12:16.781337+0000","last_undegraded":"2023-07-14T18:12:16.781337+0000","last_fullsized":"2023-07-14T18:12:16.781337+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:12.753466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:12.753466+0000","last_clean_scrub_stamp":"2023-07-14T18:11:12.753466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T02:12:35.751856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"84'5","reported_seq":32,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T18:12:16.785924+0000","last_change":"2023-07-14T18:11:08.683774+0000","last_active":"2023-07-14T18:12:16.785924+0000","last_peered":"2023-07-14T18:12:16.785924+0000","last_clean":"2023-07-14T18:12:16.785924+0000","last_became_active":"2023-07-14T18:11:08.683458+0000","last_became_peered":"2023-07-14T18:11:08.683458+0000","last_unstale":"2023-07-14T18:12:16.785924+0000","last_undegraded":"2023-07-14T18:12:16.785924+0000","last_fullsized":"2023-07-14T18:12:16.785924+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:07.665746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:07.665746+0000","last_clean_scrub_stamp":"2023-07-14T18:11:07.665746+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T04:36:23.290219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"86'15","reported_seq":39,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T18:12:45.456481+0000","last_change":"2023-07-14T18:11:09.716041+0000","last_active":"2023-07-14T18:12:45.456481+0000","last_peered":"2023-07-14T18:12:45.456481+0000","last_clean":"2023-07-14T18:12:45.456481+0000","last_became_active":"2023-07-14T18:11:09.715367+0000","last_became_peered":"2023-07-14T18:11:09.715367+0000","last_unstale":"2023-07-14T18:12:45.456481+0000","last_undegraded":"2023-07-14T18:12:45.456481+0000","last_fullsized":"2023-07-14T18:12:45.456481+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_clean_scrub_stamp":"2023-07-14T18:11:08.667354+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T03:55:10.713872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T18:12:16.784204+0000","last_change":"2023-07-14T18:11:13.776527+0000","last_active":"2023-07-14T18:12:16.784204+0000","last_peered":"2023-07-14T18:12:16.784204+0000","last_clean":"2023-07-14T18:12:16.784204+0000","last_became_active":"2023-07-14T18:11:13.776032+0000","last_became_peered":"2023-07-14T18:11:13.776032+0000","last_unstale":"2023-07-14T18:12:16.784204+0000","last_undegraded":"2023-07-14T18:12:16.784204+0000","last_fullsized":"2023-07-14T18:12:16.784204+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:12.753466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:12.753466+0000","last_clean_scrub_stamp":"2023-07-14T18:11:12.753466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:28:26.705389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"86'6","reported_seq":112,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T18:12:46.881557+0000","last_change":"2023-07-14T18:11:08.687533+0000","last_active":"2023-07-14T18:12:46.881557+0000","last_peered":"2023-07-14T18:12:46.881557+0000","last_clean":"2023-07-14T18:12:46.881557+0000","last_became_active":"2023-07-14T18:11:08.687242+0000","last_became_peered":"2023-07-14T18:11:08.687242+0000","last_unstale":"2023-07-14T18:12:46.881557+0000","last_undegraded":"2023-07-14T18:12:46.881557+0000","last_fullsized":"2023-07-14T18:12:46.881557+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:07.665746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:07.665746+0000","last_clean_scrub_stamp":"2023-07-14T18:11:07.665746+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:35:48.553302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1073,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":80,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"86'7","reported_seq":31,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T18:12:45.438169+0000","last_change":"2023-07-14T18:11:09.707937+0000","last_active":"2023-07-14T18:12:45.438169+0000","last_peered":"2023-07-14T18:12:45.438169+0000","last_clean":"2023-07-14T18:12:45.438169+0000","last_became_active":"2023-07-14T18:11:09.707637+0000","last_became_peered":"2023-07-14T18:11:09.707637+0000","last_unstale":"2023-07-14T18:12:45.438169+0000","last_undegraded":"2023-07-14T18:12:45.438169+0000","last_fullsized":"2023-07-14T18:12:45.438169+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_clean_scrub_stamp":"2023-07-14T18:11:08.667354+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T01:53:50.131794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T18:12:16.783721+0000","last_change":"2023-07-14T18:11:13.791360+0000","last_active":"2023-07-14T18:12:16.783721+0000","last_peered":"2023-07-14T18:12:16.783721+0000","last_clean":"2023-07-14T18:12:16.783721+0000","last_became_active":"2023-07-14T18:11:13.790894+0000","last_became_peered":"2023-07-14T18:11:13.790894+0000","last_unstale":"2023-07-14T18:12:16.783721+0000","last_undegraded":"2023-07-14T18:12:16.783721+0000","last_fullsized":"2023-07-14T18:12:16.783721+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:12.753466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:12.753466+0000","last_clean_scrub_stamp":"2023-07-14T18:11:12.753466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:35:28.884052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,9,5],"acting":[2,6,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1a","version":"84'7","reported_seq":33,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T18:12:16.784280+0000","last_change":"2023-07-14T18:11:08.687315+0000","last_active":"2023-07-14T18:12:16.784280+0000","last_peered":"2023-07-14T18:12:16.784280+0000","last_clean":"2023-07-14T18:12:16.784280+0000","last_became_active":"2023-07-14T18:11:08.687061+0000","last_became_peered":"2023-07-14T18:11:08.687061+0000","last_unstale":"2023-07-14T18:12:16.784280+0000","last_undegraded":"2023-07-14T18:12:16.784280+0000","last_fullsized":"2023-07-14T18:12:16.784280+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:07.665746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:07.665746+0000","last_clean_scrub_stamp":"2023-07-14T18:11:07.665746+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:42:54.830869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"86'8","reported_seq":32,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T18:12:45.448831+0000","last_change":"2023-07-14T18:11:09.715816+0000","last_active":"2023-07-14T18:12:45.448831+0000","last_peered":"2023-07-14T18:12:45.448831+0000","last_clean":"2023-07-14T18:12:45.448831+0000","last_became_active":"2023-07-14T18:11:09.715038+0000","last_became_peered":"2023-07-14T18:11:09.715038+0000","last_unstale":"2023-07-14T18:12:45.448831+0000","last_undegraded":"2023-07-14T18:12:45.448831+0000","last_fullsized":"2023-07-14T18:12:45.448831+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_clean_scrub_stamp":"2023-07-14T18:11:08.667354+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:42:32.821947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T18:12:16.785977+0000","last_change":"2023-07-14T18:11:13.791438+0000","last_active":"2023-07-14T18:12:16.785977+0000","last_peered":"2023-07-14T18:12:16.785977+0000","last_clean":"2023-07-14T18:12:16.785977+0000","last_became_active":"2023-07-14T18:11:13.790956+0000","last_became_peered":"2023-07-14T18:11:13.790956+0000","last_unstale":"2023-07-14T18:12:16.785977+0000","last_undegraded":"2023-07-14T18:12:16.785977+0000","last_fullsized":"2023-07-14T18:12:16.785977+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:12.753466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:12.753466+0000","last_clean_scrub_stamp":"2023-07-14T18:11:12.753466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:12:53.328964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.19","version":"84'3","reported_seq":29,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T18:12:16.784139+0000","last_change":"2023-07-14T18:11:08.693751+0000","last_active":"2023-07-14T18:12:16.784139+0000","last_peered":"2023-07-14T18:12:16.784139+0000","last_clean":"2023-07-14T18:12:16.784139+0000","last_became_active":"2023-07-14T18:11:08.693427+0000","last_became_peered":"2023-07-14T18:11:08.693427+0000","last_unstale":"2023-07-14T18:12:16.784139+0000","last_undegraded":"2023-07-14T18:12:16.784139+0000","last_fullsized":"2023-07-14T18:12:16.784139+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:07.665746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:07.665746+0000","last_clean_scrub_stamp":"2023-07-14T18:11:07.665746+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T02:11:51.982350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"86'8","reported_seq":32,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T18:12:45.445843+0000","last_change":"2023-07-14T18:11:09.709761+0000","last_active":"2023-07-14T18:12:45.445843+0000","last_peered":"2023-07-14T18:12:45.445843+0000","last_clean":"2023-07-14T18:12:45.445843+0000","last_became_active":"2023-07-14T18:11:09.709157+0000","last_became_peered":"2023-07-14T18:11:09.709157+0000","last_unstale":"2023-07-14T18:12:45.445843+0000","last_undegraded":"2023-07-14T18:12:45.445843+0000","last_fullsized":"2023-07-14T18:12:45.445843+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_clean_scrub_stamp":"2023-07-14T18:11:08.667354+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T04:58:39.280985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T18:12:16.783570+0000","last_change":"2023-07-14T18:11:13.779265+0000","last_active":"2023-07-14T18:12:16.783570+0000","last_peered":"2023-07-14T18:12:16.783570+0000","last_clean":"2023-07-14T18:12:16.783570+0000","last_became_active":"2023-07-14T18:11:13.778865+0000","last_became_peered":"2023-07-14T18:11:13.778865+0000","last_unstale":"2023-07-14T18:12:16.783570+0000","last_undegraded":"2023-07-14T18:12:16.783570+0000","last_fullsized":"2023-07-14T18:12:16.783570+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:12.753466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:12.753466+0000","last_clean_scrub_stamp":"2023-07-14T18:11:12.753466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T05:03:04.869864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.18","version":"84'3","reported_seq":30,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T18:12:16.780833+0000","last_change":"2023-07-14T18:11:08.684513+0000","last_active":"2023-07-14T18:12:16.780833+0000","last_peered":"2023-07-14T18:12:16.780833+0000","last_clean":"2023-07-14T18:12:16.780833+0000","last_became_active":"2023-07-14T18:11:08.684213+0000","last_became_peered":"2023-07-14T18:11:08.684213+0000","last_unstale":"2023-07-14T18:12:16.780833+0000","last_undegraded":"2023-07-14T18:12:16.780833+0000","last_fullsized":"2023-07-14T18:12:16.780833+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:07.665746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:07.665746+0000","last_clean_scrub_stamp":"2023-07-14T18:11:07.665746+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:55:49.407191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"86'11","reported_seq":35,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T18:12:45.439367+0000","last_change":"2023-07-14T18:11:09.712427+0000","last_active":"2023-07-14T18:12:45.439367+0000","last_peered":"2023-07-14T18:12:45.439367+0000","last_clean":"2023-07-14T18:12:45.439367+0000","last_became_active":"2023-07-14T18:11:09.712104+0000","last_became_peered":"2023-07-14T18:11:09.712104+0000","last_unstale":"2023-07-14T18:12:45.439367+0000","last_undegraded":"2023-07-14T18:12:45.439367+0000","last_fullsized":"2023-07-14T18:12:45.439367+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_clean_scrub_stamp":"2023-07-14T18:11:08.667354+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:03:50.820456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T18:12:16.779940+0000","last_change":"2023-07-14T18:11:13.777892+0000","last_active":"2023-07-14T18:12:16.779940+0000","last_peered":"2023-07-14T18:12:16.779940+0000","last_clean":"2023-07-14T18:12:16.779940+0000","last_became_active":"2023-07-14T18:11:13.777518+0000","last_became_peered":"2023-07-14T18:11:13.777518+0000","last_unstale":"2023-07-14T18:12:16.779940+0000","last_undegraded":"2023-07-14T18:12:16.779940+0000","last_fullsized":"2023-07-14T18:12:16.779940+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:12.753466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:12.753466+0000","last_clean_scrub_stamp":"2023-07-14T18:11:12.753466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T02:25:56.668715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.17","version":"86'6","reported_seq":188,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T18:12:47.883339+0000","last_change":"2023-07-14T18:11:08.684141+0000","last_active":"2023-07-14T18:12:47.883339+0000","last_peered":"2023-07-14T18:12:47.883339+0000","last_clean":"2023-07-14T18:12:47.883339+0000","last_became_active":"2023-07-14T18:11:08.683767+0000","last_became_peered":"2023-07-14T18:11:08.683767+0000","last_unstale":"2023-07-14T18:12:47.883339+0000","last_undegraded":"2023-07-14T18:12:47.883339+0000","last_fullsized":"2023-07-14T18:12:47.883339+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:07.665746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:07.665746+0000","last_clean_scrub_stamp":"2023-07-14T18:11:07.665746+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T05:36:42.284552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":156,"num_read_kb":156,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"86'10","reported_seq":34,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T18:12:45.459551+0000","last_change":"2023-07-14T18:11:09.710975+0000","last_active":"2023-07-14T18:12:45.459551+0000","last_peered":"2023-07-14T18:12:45.459551+0000","last_clean":"2023-07-14T18:12:45.459551+0000","last_became_active":"2023-07-14T18:11:09.710690+0000","last_became_peered":"2023-07-14T18:11:09.710690+0000","last_unstale":"2023-07-14T18:12:45.459551+0000","last_undegraded":"2023-07-14T18:12:45.459551+0000","last_fullsized":"2023-07-14T18:12:45.459551+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_clean_scrub_stamp":"2023-07-14T18:11:08.667354+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:39:03.999443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T18:12:16.819496+0000","last_change":"2023-07-14T18:11:13.789251+0000","last_active":"2023-07-14T18:12:16.819496+0000","last_peered":"2023-07-14T18:12:16.819496+0000","last_clean":"2023-07-14T18:12:16.819496+0000","last_became_active":"2023-07-14T18:11:13.788742+0000","last_became_peered":"2023-07-14T18:11:13.788742+0000","last_unstale":"2023-07-14T18:12:16.819496+0000","last_undegraded":"2023-07-14T18:12:16.819496+0000","last_fullsized":"2023-07-14T18:12:16.819496+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:12.753466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:12.753466+0000","last_clean_scrub_stamp":"2023-07-14T18:11:12.753466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T03:20:00.785057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0,2,4],"acting":[9,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.16","version":"84'4","reported_seq":28,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T18:12:16.844891+0000","last_change":"2023-07-14T18:11:08.692093+0000","last_active":"2023-07-14T18:12:16.844891+0000","last_peered":"2023-07-14T18:12:16.844891+0000","last_clean":"2023-07-14T18:12:16.844891+0000","last_became_active":"2023-07-14T18:11:08.691806+0000","last_became_peered":"2023-07-14T18:11:08.691806+0000","last_unstale":"2023-07-14T18:12:16.844891+0000","last_undegraded":"2023-07-14T18:12:16.844891+0000","last_fullsized":"2023-07-14T18:12:16.844891+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:07.665746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:07.665746+0000","last_clean_scrub_stamp":"2023-07-14T18:11:07.665746+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:21:48.736019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"86'9","reported_seq":33,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T18:12:45.448023+0000","last_change":"2023-07-14T18:11:09.714965+0000","last_active":"2023-07-14T18:12:45.448023+0000","last_peered":"2023-07-14T18:12:45.448023+0000","last_clean":"2023-07-14T18:12:45.448023+0000","last_became_active":"2023-07-14T18:11:09.714676+0000","last_became_peered":"2023-07-14T18:11:09.714676+0000","last_unstale":"2023-07-14T18:12:45.448023+0000","last_undegraded":"2023-07-14T18:12:45.448023+0000","last_fullsized":"2023-07-14T18:12:45.448023+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_clean_scrub_stamp":"2023-07-14T18:11:08.667354+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:24:25.210635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T18:12:16.781786+0000","last_change":"2023-07-14T18:11:13.779218+0000","last_active":"2023-07-14T18:12:16.781786+0000","last_peered":"2023-07-14T18:12:16.781786+0000","last_clean":"2023-07-14T18:12:16.781786+0000","last_became_active":"2023-07-14T18:11:13.778833+0000","last_became_peered":"2023-07-14T18:11:13.778833+0000","last_unstale":"2023-07-14T18:12:16.781786+0000","last_undegraded":"2023-07-14T18:12:16.781786+0000","last_fullsized":"2023-07-14T18:12:16.781786+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:12.753466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:12.753466+0000","last_clean_scrub_stamp":"2023-07-14T18:11:12.753466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:07:21.597981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,9],"acting":[4,1,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"84'5","reported_seq":32,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T18:12:16.781131+0000","last_change":"2023-07-14T18:11:08.681778+0000","last_active":"2023-07-14T18:12:16.781131+0000","last_peered":"2023-07-14T18:12:16.781131+0000","last_clean":"2023-07-14T18:12:16.781131+0000","last_became_active":"2023-07-14T18:11:08.681406+0000","last_became_peered":"2023-07-14T18:11:08.681406+0000","last_unstale":"2023-07-14T18:12:16.781131+0000","last_undegraded":"2023-07-14T18:12:16.781131+0000","last_fullsized":"2023-07-14T18:12:16.781131+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:07.665746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:07.665746+0000","last_clean_scrub_stamp":"2023-07-14T18:11:07.665746+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T03:36:14.531699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"86'11","reported_seq":35,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T18:12:45.460044+0000","last_change":"2023-07-14T18:11:09.703070+0000","last_active":"2023-07-14T18:12:45.460044+0000","last_peered":"2023-07-14T18:12:45.460044+0000","last_clean":"2023-07-14T18:12:45.460044+0000","last_became_active":"2023-07-14T18:11:09.702754+0000","last_became_peered":"2023-07-14T18:11:09.702754+0000","last_unstale":"2023-07-14T18:12:45.460044+0000","last_undegraded":"2023-07-14T18:12:45.460044+0000","last_fullsized":"2023-07-14T18:12:45.460044+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_clean_scrub_stamp":"2023-07-14T18:11:08.667354+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:33:45.980597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T18:12:16.789910+0000","last_change":"2023-07-14T18:12:16.789325+0000","last_active":"2023-07-14T18:12:16.789910+0000","last_peered":"2023-07-14T18:12:16.789910+0000","last_clean":"2023-07-14T18:12:16.789910+0000","last_became_active":"2023-07-14T18:12:16.788834+0000","last_became_peered":"2023-07-14T18:12:16.788834+0000","last_unstale":"2023-07-14T18:12:16.789910+0000","last_undegraded":"2023-07-14T18:12:16.789910+0000","last_fullsized":"2023-07-14T18:12:16.789910+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:12.753466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:12.753466+0000","last_clean_scrub_stamp":"2023-07-14T18:11:12.753466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:12:10.461021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,11,5],"acting":[10,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.14","version":"86'37","reported_seq":228,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T18:12:47.883703+0000","last_change":"2023-07-14T18:11:08.690538+0000","last_active":"2023-07-14T18:12:47.883703+0000","last_peered":"2023-07-14T18:12:47.883703+0000","last_clean":"2023-07-14T18:12:47.883703+0000","last_became_active":"2023-07-14T18:11:08.690152+0000","last_became_peered":"2023-07-14T18:11:08.690152+0000","last_unstale":"2023-07-14T18:12:47.883703+0000","last_undegraded":"2023-07-14T18:12:47.883703+0000","last_fullsized":"2023-07-14T18:12:47.883703+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:07.665746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:07.665746+0000","last_clean_scrub_stamp":"2023-07-14T18:11:07.665746+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:01:20.282110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":61585,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":165,"num_read_kb":143,"num_write":39,"num_write_kb":76,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"86'6","reported_seq":30,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T18:12:45.442428+0000","last_change":"2023-07-14T18:11:09.710116+0000","last_active":"2023-07-14T18:12:45.442428+0000","last_peered":"2023-07-14T18:12:45.442428+0000","last_clean":"2023-07-14T18:12:45.442428+0000","last_became_active":"2023-07-14T18:11:09.709831+0000","last_became_peered":"2023-07-14T18:11:09.709831+0000","last_unstale":"2023-07-14T18:12:45.442428+0000","last_undegraded":"2023-07-14T18:12:45.442428+0000","last_fullsized":"2023-07-14T18:12:45.442428+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_clean_scrub_stamp":"2023-07-14T18:11:08.667354+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T02:26:12.205510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T18:12:16.782224+0000","last_change":"2023-07-14T18:11:13.777434+0000","last_active":"2023-07-14T18:12:16.782224+0000","last_peered":"2023-07-14T18:12:16.782224+0000","last_clean":"2023-07-14T18:12:16.782224+0000","last_became_active":"2023-07-14T18:11:13.776670+0000","last_became_peered":"2023-07-14T18:11:13.776670+0000","last_unstale":"2023-07-14T18:12:16.782224+0000","last_undegraded":"2023-07-14T18:12:16.782224+0000","last_fullsized":"2023-07-14T18:12:16.782224+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:12.753466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:12.753466+0000","last_clean_scrub_stamp":"2023-07-14T18:11:12.753466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:07:14.576233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.13","version":"84'9","reported_seq":37,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T18:12:16.783466+0000","last_change":"2023-07-14T18:11:08.693172+0000","last_active":"2023-07-14T18:12:16.783466+0000","last_peered":"2023-07-14T18:12:16.783466+0000","last_clean":"2023-07-14T18:12:16.783466+0000","last_became_active":"2023-07-14T18:11:08.692846+0000","last_became_peered":"2023-07-14T18:11:08.692846+0000","last_unstale":"2023-07-14T18:12:16.783466+0000","last_undegraded":"2023-07-14T18:12:16.783466+0000","last_fullsized":"2023-07-14T18:12:16.783466+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:07.665746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:07.665746+0000","last_clean_scrub_stamp":"2023-07-14T18:11:07.665746+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:36:37.277838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"86'9","reported_seq":33,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T18:12:45.448686+0000","last_change":"2023-07-14T18:11:09.708480+0000","last_active":"2023-07-14T18:12:45.448686+0000","last_peered":"2023-07-14T18:12:45.448686+0000","last_clean":"2023-07-14T18:12:45.448686+0000","last_became_active":"2023-07-14T18:11:09.708170+0000","last_became_peered":"2023-07-14T18:11:09.708170+0000","last_unstale":"2023-07-14T18:12:45.448686+0000","last_undegraded":"2023-07-14T18:12:45.448686+0000","last_fullsized":"2023-07-14T18:12:45.448686+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_clean_scrub_stamp":"2023-07-14T18:11:08.667354+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T02:05:02.970953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":24,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T18:12:16.846239+0000","last_change":"2023-07-14T18:12:16.846239+0000","last_active":"2023-07-14T18:12:16.846239+0000","last_peered":"2023-07-14T18:12:16.846239+0000","last_clean":"2023-07-14T18:12:16.846239+0000","last_became_active":"2023-07-14T18:12:16.845489+0000","last_became_peered":"2023-07-14T18:12:16.845489+0000","last_unstale":"2023-07-14T18:12:16.846239+0000","last_undegraded":"2023-07-14T18:12:16.846239+0000","last_fullsized":"2023-07-14T18:12:16.846239+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:12.753466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:12.753466+0000","last_clean_scrub_stamp":"2023-07-14T18:11:12.753466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T05:12:40.610555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,7,6],"acting":[11,8,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.12","version":"84'5","reported_seq":32,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T18:12:16.781367+0000","last_change":"2023-07-14T18:11:08.685028+0000","last_active":"2023-07-14T18:12:16.781367+0000","last_peered":"2023-07-14T18:12:16.781367+0000","last_clean":"2023-07-14T18:12:16.781367+0000","last_became_active":"2023-07-14T18:11:08.684701+0000","last_became_peered":"2023-07-14T18:11:08.684701+0000","last_unstale":"2023-07-14T18:12:16.781367+0000","last_undegraded":"2023-07-14T18:12:16.781367+0000","last_fullsized":"2023-07-14T18:12:16.781367+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:07.665746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:07.665746+0000","last_clean_scrub_stamp":"2023-07-14T18:11:07.665746+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:40:38.432876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"86'15","reported_seq":37,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T18:12:45.454427+0000","last_change":"2023-07-14T18:11:09.717714+0000","last_active":"2023-07-14T18:12:45.454427+0000","last_peered":"2023-07-14T18:12:45.454427+0000","last_clean":"2023-07-14T18:12:45.454427+0000","last_became_active":"2023-07-14T18:11:09.717407+0000","last_became_peered":"2023-07-14T18:11:09.717407+0000","last_unstale":"2023-07-14T18:12:45.454427+0000","last_undegraded":"2023-07-14T18:12:45.454427+0000","last_fullsized":"2023-07-14T18:12:45.454427+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_clean_scrub_stamp":"2023-07-14T18:11:08.667354+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:12:24.283577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T18:12:16.845564+0000","last_change":"2023-07-14T18:12:16.845564+0000","last_active":"2023-07-14T18:12:16.845564+0000","last_peered":"2023-07-14T18:12:16.845564+0000","last_clean":"2023-07-14T18:12:16.845564+0000","last_became_active":"2023-07-14T18:12:16.845084+0000","last_became_peered":"2023-07-14T18:12:16.845084+0000","last_unstale":"2023-07-14T18:12:16.845564+0000","last_undegraded":"2023-07-14T18:12:16.845564+0000","last_fullsized":"2023-07-14T18:12:16.845564+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:12.753466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:12.753466+0000","last_clean_scrub_stamp":"2023-07-14T18:11:12.753466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:52:49.779161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,7,0,3],"acting":[8,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.11","version":"86'8","reported_seq":115,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T18:12:46.881854+0000","last_change":"2023-07-14T18:11:08.685327+0000","last_active":"2023-07-14T18:12:46.881854+0000","last_peered":"2023-07-14T18:12:46.881854+0000","last_clean":"2023-07-14T18:12:46.881854+0000","last_became_active":"2023-07-14T18:11:08.684969+0000","last_became_peered":"2023-07-14T18:11:08.684969+0000","last_unstale":"2023-07-14T18:12:46.881854+0000","last_undegraded":"2023-07-14T18:12:46.881854+0000","last_fullsized":"2023-07-14T18:12:46.881854+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:07.665746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:07.665746+0000","last_clean_scrub_stamp":"2023-07-14T18:11:07.665746+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:42:58.262688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1570,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":82,"num_read_kb":5,"num_write":8,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"86'6","reported_seq":28,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T18:12:45.439837+0000","last_change":"2023-07-14T18:11:09.721100+0000","last_active":"2023-07-14T18:12:45.439837+0000","last_peered":"2023-07-14T18:12:45.439837+0000","last_clean":"2023-07-14T18:12:45.439837+0000","last_became_active":"2023-07-14T18:11:09.720814+0000","last_became_peered":"2023-07-14T18:11:09.720814+0000","last_unstale":"2023-07-14T18:12:45.439837+0000","last_undegraded":"2023-07-14T18:12:45.439837+0000","last_fullsized":"2023-07-14T18:12:45.439837+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_clean_scrub_stamp":"2023-07-14T18:11:08.667354+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T02:25:55.031694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T18:12:16.785211+0000","last_change":"2023-07-14T18:11:13.782152+0000","last_active":"2023-07-14T18:12:16.785211+0000","last_peered":"2023-07-14T18:12:16.785211+0000","last_clean":"2023-07-14T18:12:16.785211+0000","last_became_active":"2023-07-14T18:11:13.780580+0000","last_became_peered":"2023-07-14T18:11:13.780580+0000","last_unstale":"2023-07-14T18:12:16.785211+0000","last_undegraded":"2023-07-14T18:12:16.785211+0000","last_fullsized":"2023-07-14T18:12:16.785211+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:12.753466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:12.753466+0000","last_clean_scrub_stamp":"2023-07-14T18:11:12.753466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T05:55:08.131862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"84'17","reported_seq":44,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T18:12:16.784517+0000","last_change":"2023-07-14T18:11:08.688954+0000","last_active":"2023-07-14T18:12:16.784517+0000","last_peered":"2023-07-14T18:12:16.784517+0000","last_clean":"2023-07-14T18:12:16.784517+0000","last_became_active":"2023-07-14T18:11:08.688640+0000","last_became_peered":"2023-07-14T18:11:08.688640+0000","last_unstale":"2023-07-14T18:12:16.784517+0000","last_undegraded":"2023-07-14T18:12:16.784517+0000","last_fullsized":"2023-07-14T18:12:16.784517+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:07.665746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:07.665746+0000","last_clean_scrub_stamp":"2023-07-14T18:11:07.665746+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T01:34:25.106586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"86'6","reported_seq":30,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T18:12:45.448705+0000","last_change":"2023-07-14T18:11:09.710105+0000","last_active":"2023-07-14T18:12:45.448705+0000","last_peered":"2023-07-14T18:12:45.448705+0000","last_clean":"2023-07-14T18:12:45.448705+0000","last_became_active":"2023-07-14T18:11:09.709820+0000","last_became_peered":"2023-07-14T18:11:09.709820+0000","last_unstale":"2023-07-14T18:12:45.448705+0000","last_undegraded":"2023-07-14T18:12:45.448705+0000","last_fullsized":"2023-07-14T18:12:45.448705+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_clean_scrub_stamp":"2023-07-14T18:11:08.667354+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:41:52.837220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T18:12:16.781623+0000","last_change":"2023-07-14T18:11:13.780122+0000","last_active":"2023-07-14T18:12:16.781623+0000","last_peered":"2023-07-14T18:12:16.781623+0000","last_clean":"2023-07-14T18:12:16.781623+0000","last_became_active":"2023-07-14T18:11:13.779774+0000","last_became_peered":"2023-07-14T18:11:13.779774+0000","last_unstale":"2023-07-14T18:12:16.781623+0000","last_undegraded":"2023-07-14T18:12:16.781623+0000","last_fullsized":"2023-07-14T18:12:16.781623+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:12.753466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:12.753466+0000","last_clean_scrub_stamp":"2023-07-14T18:11:12.753466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T04:27:27.478680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"86'3","reported_seq":30,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T18:12:16.784347+0000","last_change":"2023-07-14T18:11:08.686080+0000","last_active":"2023-07-14T18:12:16.784347+0000","last_peered":"2023-07-14T18:12:16.784347+0000","last_clean":"2023-07-14T18:12:16.784347+0000","last_became_active":"2023-07-14T18:11:08.685837+0000","last_became_peered":"2023-07-14T18:11:08.685837+0000","last_unstale":"2023-07-14T18:12:16.784347+0000","last_undegraded":"2023-07-14T18:12:16.784347+0000","last_fullsized":"2023-07-14T18:12:16.784347+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:07.665746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:07.665746+0000","last_clean_scrub_stamp":"2023-07-14T18:11:07.665746+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:30:04.697099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"86'5","reported_seq":29,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T18:12:45.455440+0000","last_change":"2023-07-14T18:11:09.712166+0000","last_active":"2023-07-14T18:12:45.455440+0000","last_peered":"2023-07-14T18:12:45.455440+0000","last_clean":"2023-07-14T18:12:45.455440+0000","last_became_active":"2023-07-14T18:11:09.711858+0000","last_became_peered":"2023-07-14T18:11:09.711858+0000","last_unstale":"2023-07-14T18:12:45.455440+0000","last_undegraded":"2023-07-14T18:12:45.455440+0000","last_fullsized":"2023-07-14T18:12:45.455440+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_clean_scrub_stamp":"2023-07-14T18:11:08.667354+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T02:46:06.166324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T18:12:16.783856+0000","last_change":"2023-07-14T18:11:13.905188+0000","last_active":"2023-07-14T18:12:16.783856+0000","last_peered":"2023-07-14T18:12:16.783856+0000","last_clean":"2023-07-14T18:12:16.783856+0000","last_became_active":"2023-07-14T18:11:13.904779+0000","last_became_peered":"2023-07-14T18:11:13.904779+0000","last_unstale":"2023-07-14T18:12:16.783856+0000","last_undegraded":"2023-07-14T18:12:16.783856+0000","last_fullsized":"2023-07-14T18:12:16.783856+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:12.753466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:12.753466+0000","last_clean_scrub_stamp":"2023-07-14T18:11:12.753466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:03:59.732151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,9],"acting":[8,10,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.4","version":"84'1","reported_seq":27,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T18:12:16.819781+0000","last_change":"2023-07-14T18:11:08.687838+0000","last_active":"2023-07-14T18:12:16.819781+0000","last_peered":"2023-07-14T18:12:16.819781+0000","last_clean":"2023-07-14T18:12:16.819781+0000","last_became_active":"2023-07-14T18:11:08.687522+0000","last_became_peered":"2023-07-14T18:11:08.687522+0000","last_unstale":"2023-07-14T18:12:16.819781+0000","last_undegraded":"2023-07-14T18:12:16.819781+0000","last_fullsized":"2023-07-14T18:12:16.819781+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:07.665746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:07.665746+0000","last_clean_scrub_stamp":"2023-07-14T18:11:07.665746+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T01:02:10.989054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"86'4","reported_seq":28,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T18:12:45.453640+0000","last_change":"2023-07-14T18:11:09.704033+0000","last_active":"2023-07-14T18:12:45.453640+0000","last_peered":"2023-07-14T18:12:45.453640+0000","last_clean":"2023-07-14T18:12:45.453640+0000","last_became_active":"2023-07-14T18:11:09.703727+0000","last_became_peered":"2023-07-14T18:11:09.703727+0000","last_unstale":"2023-07-14T18:12:45.453640+0000","last_undegraded":"2023-07-14T18:12:45.453640+0000","last_fullsized":"2023-07-14T18:12:45.453640+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_clean_scrub_stamp":"2023-07-14T18:11:08.667354+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:12:28.187627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T18:12:16.784685+0000","last_change":"2023-07-14T18:11:13.778207+0000","last_active":"2023-07-14T18:12:16.784685+0000","last_peered":"2023-07-14T18:12:16.784685+0000","last_clean":"2023-07-14T18:12:16.784685+0000","last_became_active":"2023-07-14T18:11:13.777847+0000","last_became_peered":"2023-07-14T18:11:13.777847+0000","last_unstale":"2023-07-14T18:12:16.784685+0000","last_undegraded":"2023-07-14T18:12:16.784685+0000","last_fullsized":"2023-07-14T18:12:16.784685+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:12.753466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:12.753466+0000","last_clean_scrub_stamp":"2023-07-14T18:11:12.753466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:35:45.808281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"86'6","reported_seq":111,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T18:12:48.884059+0000","last_change":"2023-07-14T18:11:08.683570+0000","last_active":"2023-07-14T18:12:48.884059+0000","last_peered":"2023-07-14T18:12:48.884059+0000","last_clean":"2023-07-14T18:12:48.884059+0000","last_became_active":"2023-07-14T18:11:08.683271+0000","last_became_peered":"2023-07-14T18:11:08.683271+0000","last_unstale":"2023-07-14T18:12:48.884059+0000","last_undegraded":"2023-07-14T18:12:48.884059+0000","last_fullsized":"2023-07-14T18:12:48.884059+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:07.665746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:07.665746+0000","last_clean_scrub_stamp":"2023-07-14T18:11:07.665746+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:09:15.993784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1039,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":81,"num_read_kb":2,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"86'7","reported_seq":31,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T18:12:45.451711+0000","last_change":"2023-07-14T18:11:09.718239+0000","last_active":"2023-07-14T18:12:45.451711+0000","last_peered":"2023-07-14T18:12:45.451711+0000","last_clean":"2023-07-14T18:12:45.451711+0000","last_became_active":"2023-07-14T18:11:09.717923+0000","last_became_peered":"2023-07-14T18:11:09.717923+0000","last_unstale":"2023-07-14T18:12:45.451711+0000","last_undegraded":"2023-07-14T18:12:45.451711+0000","last_fullsized":"2023-07-14T18:12:45.451711+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_clean_scrub_stamp":"2023-07-14T18:11:08.667354+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T04:14:10.672827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T18:12:16.784912+0000","last_change":"2023-07-14T18:11:13.904652+0000","last_active":"2023-07-14T18:12:16.784912+0000","last_peered":"2023-07-14T18:12:16.784912+0000","last_clean":"2023-07-14T18:12:16.784912+0000","last_became_active":"2023-07-14T18:11:13.904237+0000","last_became_peered":"2023-07-14T18:11:13.904237+0000","last_unstale":"2023-07-14T18:12:16.784912+0000","last_undegraded":"2023-07-14T18:12:16.784912+0000","last_fullsized":"2023-07-14T18:12:16.784912+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:12.753466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:12.753466+0000","last_clean_scrub_stamp":"2023-07-14T18:11:12.753466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:43:21.460670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"86'8","reported_seq":32,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T18:12:45.455030+0000","last_change":"2023-07-14T18:11:09.707086+0000","last_active":"2023-07-14T18:12:45.455030+0000","last_peered":"2023-07-14T18:12:45.455030+0000","last_clean":"2023-07-14T18:12:45.455030+0000","last_became_active":"2023-07-14T18:11:09.705882+0000","last_became_peered":"2023-07-14T18:11:09.705882+0000","last_unstale":"2023-07-14T18:12:45.455030+0000","last_undegraded":"2023-07-14T18:12:45.455030+0000","last_fullsized":"2023-07-14T18:12:45.455030+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_clean_scrub_stamp":"2023-07-14T18:11:08.667354+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:19:33.907849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"86'6","reported_seq":112,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T18:12:47.883218+0000","last_change":"2023-07-14T18:11:08.683447+0000","last_active":"2023-07-14T18:12:47.883218+0000","last_peered":"2023-07-14T18:12:47.883218+0000","last_clean":"2023-07-14T18:12:47.883218+0000","last_became_active":"2023-07-14T18:11:08.682822+0000","last_became_peered":"2023-07-14T18:11:08.682822+0000","last_unstale":"2023-07-14T18:12:47.883218+0000","last_undegraded":"2023-07-14T18:12:47.883218+0000","last_fullsized":"2023-07-14T18:12:47.883218+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:07.665746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:07.665746+0000","last_clean_scrub_stamp":"2023-07-14T18:11:07.665746+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T03:36:18.950081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":80,"num_read_kb":80,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.5","version":"84'1","reported_seq":18,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T18:12:16.844599+0000","last_change":"2023-07-14T18:11:13.780698+0000","last_active":"2023-07-14T18:12:16.844599+0000","last_peered":"2023-07-14T18:12:16.844599+0000","last_clean":"2023-07-14T18:12:16.844599+0000","last_became_active":"2023-07-14T18:11:13.780310+0000","last_became_peered":"2023-07-14T18:11:13.780310+0000","last_unstale":"2023-07-14T18:12:16.844599+0000","last_undegraded":"2023-07-14T18:12:16.844599+0000","last_fullsized":"2023-07-14T18:12:16.844599+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:12.753466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:12.753466+0000","last_clean_scrub_stamp":"2023-07-14T18:11:12.753466+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T06:08:42.872042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":123,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,9],"acting":[7,5,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"86'8","reported_seq":32,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T18:12:45.454252+0000","last_change":"2023-07-14T18:11:09.708728+0000","last_active":"2023-07-14T18:12:45.454252+0000","last_peered":"2023-07-14T18:12:45.454252+0000","last_clean":"2023-07-14T18:12:45.454252+0000","last_became_active":"2023-07-14T18:11:09.708345+0000","last_became_peered":"2023-07-14T18:11:09.708345+0000","last_unstale":"2023-07-14T18:12:45.454252+0000","last_undegraded":"2023-07-14T18:12:45.454252+0000","last_fullsized":"2023-07-14T18:12:45.454252+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_clean_scrub_stamp":"2023-07-14T18:11:08.667354+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:19:40.073079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"84'6","reported_seq":35,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T18:12:16.781636+0000","last_change":"2023-07-14T18:11:08.684495+0000","last_active":"2023-07-14T18:12:16.781636+0000","last_peered":"2023-07-14T18:12:16.781636+0000","last_clean":"2023-07-14T18:12:16.781636+0000","last_became_active":"2023-07-14T18:11:08.684142+0000","last_became_peered":"2023-07-14T18:11:08.684142+0000","last_unstale":"2023-07-14T18:12:16.781636+0000","last_undegraded":"2023-07-14T18:12:16.781636+0000","last_fullsized":"2023-07-14T18:12:16.781636+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:07.665746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:07.665746+0000","last_clean_scrub_stamp":"2023-07-14T18:11:07.665746+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:11:12.155016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"22'137","reported_seq":340,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T18:12:16.844065+0000","last_change":"2023-07-14T18:10:10.733548+0000","last_active":"2023-07-14T18:12:16.844065+0000","last_peered":"2023-07-14T18:12:16.844065+0000","last_clean":"2023-07-14T18:12:16.844065+0000","last_became_active":"2023-07-14T18:10:10.732994+0000","last_became_peered":"2023-07-14T18:10:10.732994+0000","last_unstale":"2023-07-14T18:12:16.844065+0000","last_undegraded":"2023-07-14T18:12:16.844065+0000","last_fullsized":"2023-07-14T18:12:16.844065+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:07:19.893754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:07:19.893754+0000","last_clean_scrub_stamp":"2023-07-14T18:07:19.893754+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:16:39.410680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T18:12:16.781799+0000","last_change":"2023-07-14T18:11:13.905811+0000","last_active":"2023-07-14T18:12:16.781799+0000","last_peered":"2023-07-14T18:12:16.781799+0000","last_clean":"2023-07-14T18:12:16.781799+0000","last_became_active":"2023-07-14T18:11:13.905390+0000","last_became_peered":"2023-07-14T18:11:13.905390+0000","last_unstale":"2023-07-14T18:12:16.781799+0000","last_undegraded":"2023-07-14T18:12:16.781799+0000","last_fullsized":"2023-07-14T18:12:16.781799+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:12.753466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:12.753466+0000","last_clean_scrub_stamp":"2023-07-14T18:11:12.753466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:36:37.437843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,6,10],"acting":[5,9,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1","version":"86'5","reported_seq":35,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T18:12:45.449824+0000","last_change":"2023-07-14T18:12:16.820762+0000","last_active":"2023-07-14T18:12:45.449824+0000","last_peered":"2023-07-14T18:12:45.449824+0000","last_clean":"2023-07-14T18:12:45.449824+0000","last_became_active":"2023-07-14T18:12:16.820314+0000","last_became_peered":"2023-07-14T18:12:16.820314+0000","last_unstale":"2023-07-14T18:12:45.449824+0000","last_undegraded":"2023-07-14T18:12:45.449824+0000","last_fullsized":"2023-07-14T18:12:45.449824+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_clean_scrub_stamp":"2023-07-14T18:11:08.667354+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:41:31.599732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,9,2],"acting":[6,9,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"84'4","reported_seq":28,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T18:12:16.844495+0000","last_change":"2023-07-14T18:11:08.689050+0000","last_active":"2023-07-14T18:12:16.844495+0000","last_peered":"2023-07-14T18:12:16.844495+0000","last_clean":"2023-07-14T18:12:16.844495+0000","last_became_active":"2023-07-14T18:11:08.688777+0000","last_became_peered":"2023-07-14T18:11:08.688777+0000","last_unstale":"2023-07-14T18:12:16.844495+0000","last_undegraded":"2023-07-14T18:12:16.844495+0000","last_fullsized":"2023-07-14T18:12:16.844495+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:07.665746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:07.665746+0000","last_clean_scrub_stamp":"2023-07-14T18:11:07.665746+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:55:29.518680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T18:12:16.784706+0000","last_change":"2023-07-14T18:11:13.776853+0000","last_active":"2023-07-14T18:12:16.784706+0000","last_peered":"2023-07-14T18:12:16.784706+0000","last_clean":"2023-07-14T18:12:16.784706+0000","last_became_active":"2023-07-14T18:11:13.776353+0000","last_became_peered":"2023-07-14T18:11:13.776353+0000","last_unstale":"2023-07-14T18:12:16.784706+0000","last_undegraded":"2023-07-14T18:12:16.784706+0000","last_fullsized":"2023-07-14T18:12:16.784706+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:12.753466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:12.753466+0000","last_clean_scrub_stamp":"2023-07-14T18:11:12.753466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:43:50.815992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.5","version":"84'4","reported_seq":31,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T18:12:16.784876+0000","last_change":"2023-07-14T18:11:08.691634+0000","last_active":"2023-07-14T18:12:16.784876+0000","last_peered":"2023-07-14T18:12:16.784876+0000","last_clean":"2023-07-14T18:12:16.784876+0000","last_became_active":"2023-07-14T18:11:08.691315+0000","last_became_peered":"2023-07-14T18:11:08.691315+0000","last_unstale":"2023-07-14T18:12:16.784876+0000","last_undegraded":"2023-07-14T18:12:16.784876+0000","last_fullsized":"2023-07-14T18:12:16.784876+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:07.665746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:07.665746+0000","last_clean_scrub_stamp":"2023-07-14T18:11:07.665746+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:24:13.839686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"86'9","reported_seq":33,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T18:12:45.449178+0000","last_change":"2023-07-14T18:11:09.707486+0000","last_active":"2023-07-14T18:12:45.449178+0000","last_peered":"2023-07-14T18:12:45.449178+0000","last_clean":"2023-07-14T18:12:45.449178+0000","last_became_active":"2023-07-14T18:11:09.707168+0000","last_became_peered":"2023-07-14T18:11:09.707168+0000","last_unstale":"2023-07-14T18:12:45.449178+0000","last_undegraded":"2023-07-14T18:12:45.449178+0000","last_fullsized":"2023-07-14T18:12:45.449178+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_clean_scrub_stamp":"2023-07-14T18:11:08.667354+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T02:05:41.913228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T18:12:16.779820+0000","last_change":"2023-07-14T18:11:13.905898+0000","last_active":"2023-07-14T18:12:16.779820+0000","last_peered":"2023-07-14T18:12:16.779820+0000","last_clean":"2023-07-14T18:12:16.779820+0000","last_became_active":"2023-07-14T18:11:13.905482+0000","last_became_peered":"2023-07-14T18:11:13.905482+0000","last_unstale":"2023-07-14T18:12:16.779820+0000","last_undegraded":"2023-07-14T18:12:16.779820+0000","last_fullsized":"2023-07-14T18:12:16.779820+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:12.753466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:12.753466+0000","last_clean_scrub_stamp":"2023-07-14T18:11:12.753466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T05:46:41.734287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"84'9","reported_seq":35,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T18:12:16.819945+0000","last_change":"2023-07-14T18:11:08.692339+0000","last_active":"2023-07-14T18:12:16.819945+0000","last_peered":"2023-07-14T18:12:16.819945+0000","last_clean":"2023-07-14T18:12:16.819945+0000","last_became_active":"2023-07-14T18:11:08.692047+0000","last_became_peered":"2023-07-14T18:11:08.692047+0000","last_unstale":"2023-07-14T18:12:16.819945+0000","last_undegraded":"2023-07-14T18:12:16.819945+0000","last_fullsized":"2023-07-14T18:12:16.819945+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:07.665746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:07.665746+0000","last_clean_scrub_stamp":"2023-07-14T18:11:07.665746+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T04:39:07.444831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"86'5","reported_seq":29,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T18:12:45.442930+0000","last_change":"2023-07-14T18:11:09.709900+0000","last_active":"2023-07-14T18:12:45.442930+0000","last_peered":"2023-07-14T18:12:45.442930+0000","last_clean":"2023-07-14T18:12:45.442930+0000","last_became_active":"2023-07-14T18:11:09.709291+0000","last_became_peered":"2023-07-14T18:11:09.709291+0000","last_unstale":"2023-07-14T18:12:45.442930+0000","last_undegraded":"2023-07-14T18:12:45.442930+0000","last_fullsized":"2023-07-14T18:12:45.442930+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_clean_scrub_stamp":"2023-07-14T18:11:08.667354+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:49:34.349407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T18:12:16.783030+0000","last_change":"2023-07-14T18:11:13.777493+0000","last_active":"2023-07-14T18:12:16.783030+0000","last_peered":"2023-07-14T18:12:16.783030+0000","last_clean":"2023-07-14T18:12:16.783030+0000","last_became_active":"2023-07-14T18:11:13.777110+0000","last_became_peered":"2023-07-14T18:11:13.777110+0000","last_unstale":"2023-07-14T18:12:16.783030+0000","last_undegraded":"2023-07-14T18:12:16.783030+0000","last_fullsized":"2023-07-14T18:12:16.783030+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:12.753466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:12.753466+0000","last_clean_scrub_stamp":"2023-07-14T18:11:12.753466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T05:10:40.176326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"84'7","reported_seq":34,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T18:12:16.781941+0000","last_change":"2023-07-14T18:11:08.686832+0000","last_active":"2023-07-14T18:12:16.781941+0000","last_peered":"2023-07-14T18:12:16.781941+0000","last_clean":"2023-07-14T18:12:16.781941+0000","last_became_active":"2023-07-14T18:11:08.686461+0000","last_became_peered":"2023-07-14T18:11:08.686461+0000","last_unstale":"2023-07-14T18:12:16.781941+0000","last_undegraded":"2023-07-14T18:12:16.781941+0000","last_fullsized":"2023-07-14T18:12:16.781941+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:07.665746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:07.665746+0000","last_clean_scrub_stamp":"2023-07-14T18:11:07.665746+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:19:33.834375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"86'7","reported_seq":37,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T18:12:45.443847+0000","last_change":"2023-07-14T18:12:16.787772+0000","last_active":"2023-07-14T18:12:45.443847+0000","last_peered":"2023-07-14T18:12:45.443847+0000","last_clean":"2023-07-14T18:12:45.443847+0000","last_became_active":"2023-07-14T18:12:16.787380+0000","last_became_peered":"2023-07-14T18:12:16.787380+0000","last_unstale":"2023-07-14T18:12:45.443847+0000","last_undegraded":"2023-07-14T18:12:45.443847+0000","last_fullsized":"2023-07-14T18:12:45.443847+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_clean_scrub_stamp":"2023-07-14T18:11:08.667354+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:59:19.831682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,6],"acting":[0,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T18:12:16.781766+0000","last_change":"2023-07-14T18:11:13.905856+0000","last_active":"2023-07-14T18:12:16.781766+0000","last_peered":"2023-07-14T18:12:16.781766+0000","last_clean":"2023-07-14T18:12:16.781766+0000","last_became_active":"2023-07-14T18:11:13.905441+0000","last_became_peered":"2023-07-14T18:11:13.905441+0000","last_unstale":"2023-07-14T18:12:16.781766+0000","last_undegraded":"2023-07-14T18:12:16.781766+0000","last_fullsized":"2023-07-14T18:12:16.781766+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:12.753466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:12.753466+0000","last_clean_scrub_stamp":"2023-07-14T18:11:12.753466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:50:48.995276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,9],"acting":[4,5,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"84'2","reported_seq":38,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T18:12:16.791966+0000","last_change":"2023-07-14T18:12:16.791966+0000","last_active":"2023-07-14T18:12:16.791966+0000","last_peered":"2023-07-14T18:12:16.791966+0000","last_clean":"2023-07-14T18:12:16.791966+0000","last_became_active":"2023-07-14T18:12:16.788710+0000","last_became_peered":"2023-07-14T18:12:16.788710+0000","last_unstale":"2023-07-14T18:12:16.791966+0000","last_undegraded":"2023-07-14T18:12:16.791966+0000","last_fullsized":"2023-07-14T18:12:16.791966+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:07.665746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:07.665746+0000","last_clean_scrub_stamp":"2023-07-14T18:11:07.665746+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T01:02:37.127435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,11,0],"acting":[1,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"86'2","reported_seq":26,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T18:12:45.412509+0000","last_change":"2023-07-14T18:11:09.711219+0000","last_active":"2023-07-14T18:12:45.412509+0000","last_peered":"2023-07-14T18:12:45.412509+0000","last_clean":"2023-07-14T18:12:45.412509+0000","last_became_active":"2023-07-14T18:11:09.711019+0000","last_became_peered":"2023-07-14T18:11:09.711019+0000","last_unstale":"2023-07-14T18:12:45.412509+0000","last_undegraded":"2023-07-14T18:12:45.412509+0000","last_fullsized":"2023-07-14T18:12:45.412509+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_clean_scrub_stamp":"2023-07-14T18:11:08.667354+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:05:55.303542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T18:12:16.820136+0000","last_change":"2023-07-14T18:11:13.788530+0000","last_active":"2023-07-14T18:12:16.820136+0000","last_peered":"2023-07-14T18:12:16.820136+0000","last_clean":"2023-07-14T18:12:16.820136+0000","last_became_active":"2023-07-14T18:11:13.787952+0000","last_became_peered":"2023-07-14T18:11:13.787952+0000","last_unstale":"2023-07-14T18:12:16.820136+0000","last_undegraded":"2023-07-14T18:12:16.820136+0000","last_fullsized":"2023-07-14T18:12:16.820136+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:12.753466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:12.753466+0000","last_clean_scrub_stamp":"2023-07-14T18:11:12.753466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T04:35:56.383081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.9","version":"84'7","reported_seq":33,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T18:12:16.780010+0000","last_change":"2023-07-14T18:11:08.692719+0000","last_active":"2023-07-14T18:12:16.780010+0000","last_peered":"2023-07-14T18:12:16.780010+0000","last_clean":"2023-07-14T18:12:16.780010+0000","last_became_active":"2023-07-14T18:11:08.692390+0000","last_became_peered":"2023-07-14T18:11:08.692390+0000","last_unstale":"2023-07-14T18:12:16.780010+0000","last_undegraded":"2023-07-14T18:12:16.780010+0000","last_fullsized":"2023-07-14T18:12:16.780010+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:07.665746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:07.665746+0000","last_clean_scrub_stamp":"2023-07-14T18:11:07.665746+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T02:05:19.785021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"86'9","reported_seq":33,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T18:12:45.446489+0000","last_change":"2023-07-14T18:11:09.719176+0000","last_active":"2023-07-14T18:12:45.446489+0000","last_peered":"2023-07-14T18:12:45.446489+0000","last_clean":"2023-07-14T18:12:45.446489+0000","last_became_active":"2023-07-14T18:11:09.712667+0000","last_became_peered":"2023-07-14T18:11:09.712667+0000","last_unstale":"2023-07-14T18:12:45.446489+0000","last_undegraded":"2023-07-14T18:12:45.446489+0000","last_fullsized":"2023-07-14T18:12:45.446489+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_clean_scrub_stamp":"2023-07-14T18:11:08.667354+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T05:35:42.346860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.c","version":"84'1","reported_seq":18,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T18:12:16.782001+0000","last_change":"2023-07-14T18:11:13.791717+0000","last_active":"2023-07-14T18:12:16.782001+0000","last_peered":"2023-07-14T18:12:16.782001+0000","last_clean":"2023-07-14T18:12:16.782001+0000","last_became_active":"2023-07-14T18:11:13.791280+0000","last_became_peered":"2023-07-14T18:11:13.791280+0000","last_unstale":"2023-07-14T18:12:16.782001+0000","last_undegraded":"2023-07-14T18:12:16.782001+0000","last_fullsized":"2023-07-14T18:12:16.782001+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:12.753466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:12.753466+0000","last_clean_scrub_stamp":"2023-07-14T18:11:12.753466+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T03:27:09.430530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":123,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9,7,8],"acting":[4,9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"86'4","reported_seq":30,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T18:12:16.783186+0000","last_change":"2023-07-14T18:11:08.692842+0000","last_active":"2023-07-14T18:12:16.783186+0000","last_peered":"2023-07-14T18:12:16.783186+0000","last_clean":"2023-07-14T18:12:16.783186+0000","last_became_active":"2023-07-14T18:11:08.692534+0000","last_became_peered":"2023-07-14T18:11:08.692534+0000","last_unstale":"2023-07-14T18:12:16.783186+0000","last_undegraded":"2023-07-14T18:12:16.783186+0000","last_fullsized":"2023-07-14T18:12:16.783186+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:07.665746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:07.665746+0000","last_clean_scrub_stamp":"2023-07-14T18:11:07.665746+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:42:27.899061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"86'8","reported_seq":32,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T18:12:45.444887+0000","last_change":"2023-07-14T18:11:09.703665+0000","last_active":"2023-07-14T18:12:45.444887+0000","last_peered":"2023-07-14T18:12:45.444887+0000","last_clean":"2023-07-14T18:12:45.444887+0000","last_became_active":"2023-07-14T18:11:09.703288+0000","last_became_peered":"2023-07-14T18:11:09.703288+0000","last_unstale":"2023-07-14T18:12:45.444887+0000","last_undegraded":"2023-07-14T18:12:45.444887+0000","last_fullsized":"2023-07-14T18:12:45.444887+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_clean_scrub_stamp":"2023-07-14T18:11:08.667354+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T03:51:36.436982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T18:12:16.781732+0000","last_change":"2023-07-14T18:11:13.904604+0000","last_active":"2023-07-14T18:12:16.781732+0000","last_peered":"2023-07-14T18:12:16.781732+0000","last_clean":"2023-07-14T18:12:16.781732+0000","last_became_active":"2023-07-14T18:11:13.904245+0000","last_became_peered":"2023-07-14T18:11:13.904245+0000","last_unstale":"2023-07-14T18:12:16.781732+0000","last_undegraded":"2023-07-14T18:12:16.781732+0000","last_fullsized":"2023-07-14T18:12:16.781732+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:12.753466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:12.753466+0000","last_clean_scrub_stamp":"2023-07-14T18:11:12.753466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:25:41.179580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.b","version":"84'4","reported_seq":31,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T18:12:16.783387+0000","last_change":"2023-07-14T18:11:08.689876+0000","last_active":"2023-07-14T18:12:16.783387+0000","last_peered":"2023-07-14T18:12:16.783387+0000","last_clean":"2023-07-14T18:12:16.783387+0000","last_became_active":"2023-07-14T18:11:08.689582+0000","last_became_peered":"2023-07-14T18:11:08.689582+0000","last_unstale":"2023-07-14T18:12:16.783387+0000","last_undegraded":"2023-07-14T18:12:16.783387+0000","last_fullsized":"2023-07-14T18:12:16.783387+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:07.665746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:07.665746+0000","last_clean_scrub_stamp":"2023-07-14T18:11:07.665746+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:15:32.216414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"86'5","reported_seq":27,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T18:12:45.459728+0000","last_change":"2023-07-14T18:11:09.708228+0000","last_active":"2023-07-14T18:12:45.459728+0000","last_peered":"2023-07-14T18:12:45.459728+0000","last_clean":"2023-07-14T18:12:45.459728+0000","last_became_active":"2023-07-14T18:11:09.707985+0000","last_became_peered":"2023-07-14T18:11:09.707985+0000","last_unstale":"2023-07-14T18:12:45.459728+0000","last_undegraded":"2023-07-14T18:12:45.459728+0000","last_fullsized":"2023-07-14T18:12:45.459728+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_clean_scrub_stamp":"2023-07-14T18:11:08.667354+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T22:27:07.492845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":24,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T18:12:16.846372+0000","last_change":"2023-07-14T18:12:16.846372+0000","last_active":"2023-07-14T18:12:16.846372+0000","last_peered":"2023-07-14T18:12:16.846372+0000","last_clean":"2023-07-14T18:12:16.846372+0000","last_became_active":"2023-07-14T18:12:16.845694+0000","last_became_peered":"2023-07-14T18:12:16.845694+0000","last_unstale":"2023-07-14T18:12:16.846372+0000","last_undegraded":"2023-07-14T18:12:16.846372+0000","last_fullsized":"2023-07-14T18:12:16.846372+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:12.753466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:12.753466+0000","last_clean_scrub_stamp":"2023-07-14T18:11:12.753466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:47:51.174102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,6,7],"acting":[1,8,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.c","version":"86'6","reported_seq":115,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T18:12:48.885610+0000","last_change":"2023-07-14T18:11:08.689560+0000","last_active":"2023-07-14T18:12:48.885610+0000","last_peered":"2023-07-14T18:12:48.885610+0000","last_clean":"2023-07-14T18:12:48.885610+0000","last_became_active":"2023-07-14T18:11:08.689249+0000","last_became_peered":"2023-07-14T18:11:08.689249+0000","last_unstale":"2023-07-14T18:12:48.885610+0000","last_undegraded":"2023-07-14T18:12:48.885610+0000","last_fullsized":"2023-07-14T18:12:48.885610+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:07.665746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:07.665746+0000","last_clean_scrub_stamp":"2023-07-14T18:11:07.665746+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T02:27:36.887787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1621,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":83,"num_read_kb":3,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"86'7","reported_seq":29,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T18:12:45.459191+0000","last_change":"2023-07-14T18:11:09.720321+0000","last_active":"2023-07-14T18:12:45.459191+0000","last_peered":"2023-07-14T18:12:45.459191+0000","last_clean":"2023-07-14T18:12:45.459191+0000","last_became_active":"2023-07-14T18:11:09.720080+0000","last_became_peered":"2023-07-14T18:11:09.720080+0000","last_unstale":"2023-07-14T18:12:45.459191+0000","last_undegraded":"2023-07-14T18:12:45.459191+0000","last_fullsized":"2023-07-14T18:12:45.459191+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_clean_scrub_stamp":"2023-07-14T18:11:08.667354+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:26:11.524921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T18:12:16.782707+0000","last_change":"2023-07-14T18:11:13.779349+0000","last_active":"2023-07-14T18:12:16.782707+0000","last_peered":"2023-07-14T18:12:16.782707+0000","last_clean":"2023-07-14T18:12:16.782707+0000","last_became_active":"2023-07-14T18:11:13.778946+0000","last_became_peered":"2023-07-14T18:11:13.778946+0000","last_unstale":"2023-07-14T18:12:16.782707+0000","last_undegraded":"2023-07-14T18:12:16.782707+0000","last_fullsized":"2023-07-14T18:12:16.782707+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:12.753466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:12.753466+0000","last_clean_scrub_stamp":"2023-07-14T18:11:12.753466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T03:24:52.587800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9,1,4],"acting":[0,9,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"84'3","reported_seq":30,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T18:12:16.781388+0000","last_change":"2023-07-14T18:11:08.683760+0000","last_active":"2023-07-14T18:12:16.781388+0000","last_peered":"2023-07-14T18:12:16.781388+0000","last_clean":"2023-07-14T18:12:16.781388+0000","last_became_active":"2023-07-14T18:11:08.683461+0000","last_became_peered":"2023-07-14T18:11:08.683461+0000","last_unstale":"2023-07-14T18:12:16.781388+0000","last_undegraded":"2023-07-14T18:12:16.781388+0000","last_fullsized":"2023-07-14T18:12:16.781388+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:07.665746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:07.665746+0000","last_clean_scrub_stamp":"2023-07-14T18:11:07.665746+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T03:06:03.065563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"86'6","reported_seq":28,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T18:12:45.444674+0000","last_change":"2023-07-14T18:11:09.708701+0000","last_active":"2023-07-14T18:12:45.444674+0000","last_peered":"2023-07-14T18:12:45.444674+0000","last_clean":"2023-07-14T18:12:45.444674+0000","last_became_active":"2023-07-14T18:11:09.708410+0000","last_became_peered":"2023-07-14T18:11:09.708410+0000","last_unstale":"2023-07-14T18:12:45.444674+0000","last_undegraded":"2023-07-14T18:12:45.444674+0000","last_fullsized":"2023-07-14T18:12:45.444674+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_clean_scrub_stamp":"2023-07-14T18:11:08.667354+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T01:30:56.495611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T18:12:16.780683+0000","last_change":"2023-07-14T18:11:13.776584+0000","last_active":"2023-07-14T18:12:16.780683+0000","last_peered":"2023-07-14T18:12:16.780683+0000","last_clean":"2023-07-14T18:12:16.780683+0000","last_became_active":"2023-07-14T18:11:13.775288+0000","last_became_peered":"2023-07-14T18:11:13.775288+0000","last_unstale":"2023-07-14T18:12:16.780683+0000","last_undegraded":"2023-07-14T18:12:16.780683+0000","last_fullsized":"2023-07-14T18:12:16.780683+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:12.753466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:12.753466+0000","last_clean_scrub_stamp":"2023-07-14T18:11:12.753466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:11:20.760087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"84'5","reported_seq":31,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T18:12:16.785299+0000","last_change":"2023-07-14T18:11:08.687332+0000","last_active":"2023-07-14T18:12:16.785299+0000","last_peered":"2023-07-14T18:12:16.785299+0000","last_clean":"2023-07-14T18:12:16.785299+0000","last_became_active":"2023-07-14T18:11:08.686902+0000","last_became_peered":"2023-07-14T18:11:08.686902+0000","last_unstale":"2023-07-14T18:12:16.785299+0000","last_undegraded":"2023-07-14T18:12:16.785299+0000","last_fullsized":"2023-07-14T18:12:16.785299+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:07.665746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:07.665746+0000","last_clean_scrub_stamp":"2023-07-14T18:11:07.665746+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T01:01:07.005031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"86'9","reported_seq":31,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T18:12:45.444970+0000","last_change":"2023-07-14T18:11:09.719308+0000","last_active":"2023-07-14T18:12:45.444970+0000","last_peered":"2023-07-14T18:12:45.444970+0000","last_clean":"2023-07-14T18:12:45.444970+0000","last_became_active":"2023-07-14T18:11:09.719038+0000","last_became_peered":"2023-07-14T18:11:09.719038+0000","last_unstale":"2023-07-14T18:12:45.444970+0000","last_undegraded":"2023-07-14T18:12:45.444970+0000","last_fullsized":"2023-07-14T18:12:45.444970+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_clean_scrub_stamp":"2023-07-14T18:11:08.667354+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:07:46.868778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"86'9","reported_seq":33,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T18:12:45.446725+0000","last_change":"2023-07-14T18:11:09.710991+0000","last_active":"2023-07-14T18:12:45.446725+0000","last_peered":"2023-07-14T18:12:45.446725+0000","last_clean":"2023-07-14T18:12:45.446725+0000","last_became_active":"2023-07-14T18:11:09.710689+0000","last_became_peered":"2023-07-14T18:11:09.710689+0000","last_unstale":"2023-07-14T18:12:45.446725+0000","last_undegraded":"2023-07-14T18:12:45.446725+0000","last_fullsized":"2023-07-14T18:12:45.446725+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_clean_scrub_stamp":"2023-07-14T18:11:08.667354+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T02:50:07.310782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"86'12","reported_seq":36,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T18:12:45.455658+0000","last_change":"2023-07-14T18:11:09.711793+0000","last_active":"2023-07-14T18:12:45.455658+0000","last_peered":"2023-07-14T18:12:45.455658+0000","last_clean":"2023-07-14T18:12:45.455658+0000","last_became_active":"2023-07-14T18:11:09.711488+0000","last_became_peered":"2023-07-14T18:11:09.711488+0000","last_unstale":"2023-07-14T18:12:45.455658+0000","last_undegraded":"2023-07-14T18:12:45.455658+0000","last_fullsized":"2023-07-14T18:12:45.455658+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_clean_scrub_stamp":"2023-07-14T18:11:08.667354+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T23:55:49.699586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"86'8","reported_seq":32,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T18:12:45.447129+0000","last_change":"2023-07-14T18:11:09.707835+0000","last_active":"2023-07-14T18:12:45.447129+0000","last_peered":"2023-07-14T18:12:45.447129+0000","last_clean":"2023-07-14T18:12:45.447129+0000","last_became_active":"2023-07-14T18:11:09.706863+0000","last_became_peered":"2023-07-14T18:11:09.706863+0000","last_unstale":"2023-07-14T18:12:45.447129+0000","last_undegraded":"2023-07-14T18:12:45.447129+0000","last_fullsized":"2023-07-14T18:12:45.447129+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_clean_scrub_stamp":"2023-07-14T18:11:08.667354+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T03:37:49.528129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"86'7","reported_seq":31,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T18:12:45.447310+0000","last_change":"2023-07-14T18:11:09.714879+0000","last_active":"2023-07-14T18:12:45.447310+0000","last_peered":"2023-07-14T18:12:45.447310+0000","last_clean":"2023-07-14T18:12:45.447310+0000","last_became_active":"2023-07-14T18:11:09.714583+0000","last_became_peered":"2023-07-14T18:11:09.714583+0000","last_unstale":"2023-07-14T18:12:45.447310+0000","last_undegraded":"2023-07-14T18:12:45.447310+0000","last_fullsized":"2023-07-14T18:12:45.447310+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_clean_scrub_stamp":"2023-07-14T18:11:08.667354+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:17:18.081609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"86'4","reported_seq":28,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T18:12:45.451968+0000","last_change":"2023-07-14T18:11:09.710850+0000","last_active":"2023-07-14T18:12:45.451968+0000","last_peered":"2023-07-14T18:12:45.451968+0000","last_clean":"2023-07-14T18:12:45.451968+0000","last_became_active":"2023-07-14T18:11:09.710533+0000","last_became_peered":"2023-07-14T18:11:09.710533+0000","last_unstale":"2023-07-14T18:12:45.451968+0000","last_undegraded":"2023-07-14T18:12:45.451968+0000","last_fullsized":"2023-07-14T18:12:45.451968+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_clean_scrub_stamp":"2023-07-14T18:11:08.667354+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:14:51.244833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"86'6","reported_seq":36,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T18:12:45.440899+0000","last_change":"2023-07-14T18:12:16.821049+0000","last_active":"2023-07-14T18:12:45.440899+0000","last_peered":"2023-07-14T18:12:45.440899+0000","last_clean":"2023-07-14T18:12:45.440899+0000","last_became_active":"2023-07-14T18:12:16.820665+0000","last_became_peered":"2023-07-14T18:12:16.820665+0000","last_unstale":"2023-07-14T18:12:45.440899+0000","last_undegraded":"2023-07-14T18:12:45.440899+0000","last_fullsized":"2023-07-14T18:12:45.440899+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_clean_scrub_stamp":"2023-07-14T18:11:08.667354+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T21:30:07.485544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,9],"acting":[11,8,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"86'15","reported_seq":39,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T18:12:45.458860+0000","last_change":"2023-07-14T18:11:09.709062+0000","last_active":"2023-07-14T18:12:45.458860+0000","last_peered":"2023-07-14T18:12:45.458860+0000","last_clean":"2023-07-14T18:12:45.458860+0000","last_became_active":"2023-07-14T18:11:09.708767+0000","last_became_peered":"2023-07-14T18:11:09.708767+0000","last_unstale":"2023-07-14T18:12:45.458860+0000","last_undegraded":"2023-07-14T18:12:45.458860+0000","last_fullsized":"2023-07-14T18:12:45.458860+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_clean_scrub_stamp":"2023-07-14T18:11:08.667354+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T19:39:06.654097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"86'2","reported_seq":32,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T18:12:45.443758+0000","last_change":"2023-07-14T18:12:16.787468+0000","last_active":"2023-07-14T18:12:45.443758+0000","last_peered":"2023-07-14T18:12:45.443758+0000","last_clean":"2023-07-14T18:12:45.443758+0000","last_became_active":"2023-07-14T18:12:16.786920+0000","last_became_peered":"2023-07-14T18:12:16.786920+0000","last_unstale":"2023-07-14T18:12:45.443758+0000","last_undegraded":"2023-07-14T18:12:45.443758+0000","last_fullsized":"2023-07-14T18:12:45.443758+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_clean_scrub_stamp":"2023-07-14T18:11:08.667354+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:58:18.718547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,8,2],"acting":[3,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"86'6","reported_seq":30,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T18:12:45.442021+0000","last_change":"2023-07-14T18:11:09.709710+0000","last_active":"2023-07-14T18:12:45.442021+0000","last_peered":"2023-07-14T18:12:45.442021+0000","last_clean":"2023-07-14T18:12:45.442021+0000","last_became_active":"2023-07-14T18:11:09.709438+0000","last_became_peered":"2023-07-14T18:11:09.709438+0000","last_unstale":"2023-07-14T18:12:45.442021+0000","last_undegraded":"2023-07-14T18:12:45.442021+0000","last_fullsized":"2023-07-14T18:12:45.442021+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_clean_scrub_stamp":"2023-07-14T18:11:08.667354+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T01:54:00.369337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"86'8","reported_seq":32,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T18:12:45.443921+0000","last_change":"2023-07-14T18:11:09.720216+0000","last_active":"2023-07-14T18:12:45.443921+0000","last_peered":"2023-07-14T18:12:45.443921+0000","last_clean":"2023-07-14T18:12:45.443921+0000","last_became_active":"2023-07-14T18:11:09.719775+0000","last_became_peered":"2023-07-14T18:11:09.719775+0000","last_unstale":"2023-07-14T18:12:45.443921+0000","last_undegraded":"2023-07-14T18:12:45.443921+0000","last_fullsized":"2023-07-14T18:12:45.443921+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_clean_scrub_stamp":"2023-07-14T18:11:08.667354+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T20:43:40.113898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"86'10","reported_seq":34,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T18:12:45.458305+0000","last_change":"2023-07-14T18:11:09.708462+0000","last_active":"2023-07-14T18:12:45.458305+0000","last_peered":"2023-07-14T18:12:45.458305+0000","last_clean":"2023-07-14T18:12:45.458305+0000","last_became_active":"2023-07-14T18:11:09.705611+0000","last_became_peered":"2023-07-14T18:11:09.705611+0000","last_unstale":"2023-07-14T18:12:45.458305+0000","last_undegraded":"2023-07-14T18:12:45.458305+0000","last_fullsized":"2023-07-14T18:12:45.458305+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_clean_scrub_stamp":"2023-07-14T18:11:08.667354+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T02:02:51.560219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"86'11","reported_seq":35,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T18:12:45.447550+0000","last_change":"2023-07-14T18:11:09.707560+0000","last_active":"2023-07-14T18:12:45.447550+0000","last_peered":"2023-07-14T18:12:45.447550+0000","last_clean":"2023-07-14T18:12:45.447550+0000","last_became_active":"2023-07-14T18:11:09.707216+0000","last_became_peered":"2023-07-14T18:11:09.707216+0000","last_unstale":"2023-07-14T18:12:45.447550+0000","last_undegraded":"2023-07-14T18:12:45.447550+0000","last_fullsized":"2023-07-14T18:12:45.447550+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_clean_scrub_stamp":"2023-07-14T18:11:08.667354+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-16T00:03:49.501892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"86'8","reported_seq":32,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-07-14T18:12:45.455791+0000","last_change":"2023-07-14T18:11:09.712059+0000","last_active":"2023-07-14T18:12:45.455791+0000","last_peered":"2023-07-14T18:12:45.455791+0000","last_clean":"2023-07-14T18:12:45.455791+0000","last_became_active":"2023-07-14T18:11:09.711759+0000","last_became_peered":"2023-07-14T18:11:09.711759+0000","last_unstale":"2023-07-14T18:12:45.455791+0000","last_undegraded":"2023-07-14T18:12:45.455791+0000","last_fullsized":"2023-07-14T18:12:45.455791+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-14T18:11:08.667354+0000","last_clean_scrub_stamp":"2023-07-14T18:11:08.667354+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-15T18:13:46.454186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":246,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":32768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":500,"ondisk_log_size":500,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4157440,"data_stored":4132576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":70342,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":824,"num_read_kb":489,"num_write":250,"num_write_kb":148,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":573440,"data_stored":219666,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":220,"ondisk_log_size":220,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":75,"seq":322122547232,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27964,"kb_used_data":948,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717188,"statfs":{"total":95995035648,"available":95966400512,"internally_reserved":0,"allocated":970752,"data_stored":474379,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 18:12:34 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.55400000000000005,"15min":0.55800000000000005},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.42499999999999999},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.57999999999999996,"15min":0.58199999999999996},"min":{"1min":0.41999999999999998,"5min":0.315,"15min":0.315},"max":{"1min":0.75800000000000001,"5min":0.85099999999999998,"15min":0.85099999999999998},"last":0.46500000000000002}]},{"osd":1,"last update":"Fri Jul 14 18:12:34 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.64300000000000002,"15min":0.64100000000000001},"min":{"1min":0.46300000000000002,"5min":0.439,"15min":0.439},"max":{"1min":0.78600000000000003,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.67700000000000005,"5min":0.64800000000000002,"15min":0.64300000000000002},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.83899999999999997,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.67000000000000004}]},{"osd":2,"last update":"Fri Jul 14 18:12:34 2023","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.54100000000000004,"15min":0.54900000000000004},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.749,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.501,"5min":0.53500000000000003,"15min":0.54100000000000004},"min":{"1min":0.39200000000000002,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.63500000000000001,"5min":0.69899999999999995,"15min":0.69899999999999995},"last":0.39900000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35399999999999998}]},{"osd":4,"last update":"Fri Jul 14 18:12:34 2023","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.68600000000000005,"15min":0.68500000000000005},"min":{"1min":0.55800000000000005,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.88800000000000001,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.72199999999999998,"15min":0.72799999999999998},"min":{"1min":0.57999999999999996,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":0.89300000000000002,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.72999999999999998}]},{"osd":5,"last update":"Fri Jul 14 18:12:34 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.63300000000000001,"15min":0.63700000000000001},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.65000000000000002},{"interface":"front","average":{"1min":0.623,"5min":0.628,"15min":0.629},"min":{"1min":0.44700000000000001,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.85599999999999998,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.58699999999999997}]},{"osd":6,"last update":"Fri Jul 14 18:12:34 2023","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.70399999999999996,"15min":0.70599999999999996},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":1.048,"5min":1.048,"15min":1.048},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.746,"15min":0.748},"min":{"1min":0.54600000000000004,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.71199999999999997}]},{"osd":7,"last update":"Fri Jul 14 18:12:34 2023","interfaces":[{"interface":"back","average":{"1min":0.73799999999999999,"5min":0.75900000000000001,"15min":0.76300000000000001},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":0.92000000000000004,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.78000000000000003,"5min":0.79200000000000004,"15min":0.79400000000000004},"min":{"1min":0.56100000000000005,"5min":0.496,"15min":0.496},"max":{"1min":0.95599999999999996,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.76200000000000001}]},{"osd":8,"last update":"Fri Jul 14 18:12:14 2023","interfaces":[{"interface":"back","average":{"1min":0.747,"5min":0.747,"15min":0.747},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":1.038,"5min":1.038,"15min":1.038},"last":0.82199999999999995},{"interface":"front","average":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"min":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":0.98999999999999999,"5min":0.98999999999999999,"15min":0.98999999999999999},"last":0.77900000000000003}]},{"osd":9,"last update":"Fri Jul 14 18:12:34 2023","interfaces":[{"interface":"back","average":{"1min":0.81799999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"min":{"1min":0.61799999999999999,"5min":0.498,"15min":0.498},"max":{"1min":1.0089999999999999,"5min":1.1419999999999999,"15min":1.1419999999999999},"last":0.747},{"interface":"front","average":{"1min":0.77600000000000002,"5min":0.80200000000000005,"15min":0.80600000000000005},"min":{"1min":0.53100000000000003,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":0.96299999999999997,"5min":1.042,"15min":1.042},"last":0.69699999999999995}]},{"osd":10,"last update":"Fri Jul 14 18:12:34 2023","interfaces":[{"interface":"back","average":{"1min":0.84299999999999997,"5min":0.83499999999999996,"15min":0.83399999999999996},"min":{"1min":0.69499999999999995,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.0129999999999999,"5min":1.0800000000000001,"15min":1.0800000000000001},"last":0.79200000000000004},{"interface":"front","average":{"1min":0.83999999999999997,"5min":0.85199999999999998,"15min":0.85399999999999998},"min":{"1min":0.65700000000000003,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":0.99299999999999999,"5min":1.177,"15min":1.177},"last":0.80600000000000005}]}]},{"osd":10,"up_from":68,"seq":292057776163,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28636,"kb_used_data":1620,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716516,"statfs":{"total":95995035648,"available":95965712384,"internally_reserved":0,"allocated":1658880,"data_stored":1122980,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 18:12:09 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"last":0.40799999999999997}]},{"osd":1,"last update":"Fri Jul 14 18:12:14 2023","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.45600000000000002,"15min":0.44900000000000001},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.64600000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"last":0.502},{"interface":"front","average":{"1min":0.496,"5min":0.49199999999999999,"15min":0.49199999999999999},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.69299999999999995,"5min":0.71099999999999997,"15min":0.71099999999999997},"last":0.44400000000000001}]},{"osd":2,"last update":"Fri Jul 14 18:12:14 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.63200000000000001,"15min":0.63200000000000001},"min":{"1min":0.47999999999999998,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.89700000000000002,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.71799999999999997},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.61399999999999999,"15min":0.60499999999999998},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.83599999999999997,"5min":0.84799999999999998,"15min":0.84799999999999998},"last":0.54600000000000004}]},{"osd":3,"last update":"Fri Jul 14 18:12:14 2023","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.626,"15min":0.64600000000000002},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.622,"5min":0.96099999999999997,"15min":0.96099999999999997},"last":0.47499999999999998},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.65600000000000003,"15min":0.66400000000000003},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.78700000000000003,"5min":0.95099999999999996,"15min":0.95099999999999996},"last":0.60299999999999998}]},{"osd":4,"last update":"Fri Jul 14 18:12:14 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.86799999999999999,"5min":0.86799999999999999,"15min":0.86799999999999999},"last":0.68400000000000005},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.57699999999999996,"15min":0.58299999999999996},"min":{"1min":0.42899999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.745,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.627}]},{"osd":5,"last update":"Fri Jul 14 18:12:14 2023","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.71199999999999997,"15min":0.71599999999999997},"min":{"1min":0.52400000000000002,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.81599999999999995,"5min":1.0049999999999999,"15min":1.0049999999999999},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.69199999999999995,"15min":0.68400000000000005},"min":{"1min":0.58399999999999996,"5min":0.438,"15min":0.438},"max":{"1min":0.93100000000000005,"5min":0.93100000000000005,"15min":0.93100000000000005},"last":0.66300000000000003}]},{"osd":6,"last update":"Fri Jul 14 18:12:14 2023","interfaces":[{"interface":"back","average":{"1min":0.64900000000000002,"5min":0.69699999999999995,"15min":0.70499999999999996},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.878,"5min":1.004,"15min":1.004},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.748,"15min":0.75600000000000001},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":0.91200000000000003,"5min":1.1040000000000001,"15min":1.1040000000000001},"last":0.73699999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49399999999999999}]},{"osd":8,"last update":"Fri Jul 14 18:12:14 2023","interfaces":[{"interface":"back","average":{"1min":0.75900000000000001,"5min":0.754,"15min":0.753},"min":{"1min":0.51300000000000001,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.96599999999999997,"5min":1.038,"15min":1.038},"last":0.80100000000000005},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.78900000000000003,"15min":0.79900000000000004},"min":{"1min":0.57699999999999996,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":0.86399999999999999,"5min":1.0820000000000001,"15min":1.0820000000000001},"last":0.75900000000000001}]},{"osd":9,"last update":"Fri Jul 14 18:12:14 2023","interfaces":[{"interface":"back","average":{"1min":0.84199999999999997,"5min":0.80500000000000005,"15min":0.79900000000000004},"min":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"max":{"1min":2.5649999999999999,"5min":2.5649999999999999,"15min":2.5649999999999999},"last":0.76800000000000002},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.81399999999999995,"15min":0.83699999999999997},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":0.89600000000000002,"5min":1.228,"15min":1.228},"last":0.78300000000000003}]},{"osd":11,"last update":"Fri Jul 14 18:12:32 2023","interfaces":[{"interface":"back","average":{"1min":0.77500000000000002,"5min":0.78500000000000003,"15min":0.78700000000000003},"min":{"1min":0.66300000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":0.95799999999999996,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.70499999999999996},{"interface":"front","average":{"1min":0.80300000000000005,"5min":0.81100000000000005,"15min":0.81299999999999994},"min":{"1min":0.65100000000000002,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":0.98999999999999999,"5min":1.0309999999999999,"15min":1.0309999999999999},"last":0.82999999999999996}]}]},{"osd":9,"up_from":63,"seq":270582939688,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27992,"kb_used_data":976,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717160,"statfs":{"total":95995035648,"available":95966371840,"internally_reserved":0,"allocated":999424,"data_stored":477954,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 18:11:50 2023","interfaces":[{"interface":"back","average":{"1min":0.35299999999999998,"5min":0.41299999999999998,"15min":0.42299999999999999},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.622,"5min":0.63200000000000001,"15min":0.63200000000000001},"last":0.34399999999999997},{"interface":"front","average":{"1min":0.37,"5min":0.432,"15min":0.442},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.57499999999999996,"5min":0.68899999999999995,"15min":0.68899999999999995},"last":0.371}]},{"osd":1,"last update":"Fri Jul 14 18:11:50 2023","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.57599999999999996,"15min":0.58399999999999996},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.93100000000000005,"5min":0.94099999999999995,"15min":0.94099999999999995},"last":0.69399999999999995},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.59499999999999997,"15min":0.60499999999999998},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.73999999999999999,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.623}]},{"osd":2,"last update":"Fri Jul 14 18:11:50 2023","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.59799999999999998,"15min":0.60599999999999998},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.81200000000000006,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.61799999999999999,"15min":0.627},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.76100000000000001,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.65800000000000003}]},{"osd":3,"last update":"Fri Jul 14 18:11:50 2023","interfaces":[{"interface":"back","average":{"1min":0.40600000000000003,"5min":0.51300000000000001,"15min":0.53100000000000003},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.64200000000000002,"5min":0.75700000000000001,"15min":0.75700000000000001},"last":0.312},{"interface":"front","average":{"1min":0.40699999999999997,"5min":0.51300000000000001,"15min":0.53100000000000003},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":0.58499999999999996,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.39300000000000002}]},{"osd":4,"last update":"Fri Jul 14 18:11:50 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.65900000000000003,"15min":0.67800000000000005},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.84299999999999997,"5min":0.95499999999999996,"15min":0.95499999999999996},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.64900000000000002,"15min":0.65900000000000003},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.90300000000000002,"5min":1,"15min":1},"last":0.72999999999999998}]},{"osd":5,"last update":"Fri Jul 14 18:11:50 2023","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.68000000000000005,"15min":0.69499999999999995},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.80300000000000005,"5min":1.093,"15min":1.093},"last":0.63700000000000001},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.67800000000000005,"15min":0.69399999999999995},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.89100000000000001,"5min":1.1100000000000001,"15min":1.1100000000000001},"last":0.71999999999999997}]},{"osd":6,"last update":"Fri Jul 14 18:10:48 2023","interfaces":[{"interface":"back","average":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":1.069,"5min":1.069,"15min":1.069},"last":0.45800000000000002},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":1.0409999999999999,"5min":1.0409999999999999,"15min":1.0409999999999999},"last":0.57799999999999996}]},{"osd":7,"last update":"Fri Jul 14 18:11:50 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.71199999999999997,"15min":0.72899999999999998},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.92500000000000004,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.71699999999999997,"15min":0.73599999999999999},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.85399999999999998,"5min":1.1890000000000001,"15min":1.1890000000000001},"last":0.64700000000000002}]},{"osd":8,"last update":"Fri Jul 14 18:11:50 2023","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.74399999999999999,"15min":0.76200000000000001},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.79900000000000004,"5min":1.127,"15min":1.127},"last":0.70799999999999996},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.75700000000000001,"15min":0.77500000000000002},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":0.86699999999999999,"5min":1.167,"15min":1.167},"last":0.61399999999999999}]},{"osd":10,"last update":"Fri Jul 14 18:12:09 2023","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.68500000000000005,"15min":0.69099999999999995},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.88,"5min":0.99099999999999999,"15min":0.99099999999999999},"last":0.74099999999999999},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.69899999999999995,"15min":0.70499999999999996},"min":{"1min":0.54900000000000004,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":0.94199999999999995,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":0.55500000000000005}]},{"osd":11,"last update":"Fri Jul 14 18:12:13 2023","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"min":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"last":0.68600000000000005},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.0229999999999999,"5min":1.0229999999999999,"15min":1.0229999999999999},"last":0.754}]}]},{"osd":8,"up_from":56,"seq":240518168621,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27980,"kb_used_data":964,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717172,"statfs":{"total":95995035648,"available":95966384128,"internally_reserved":0,"allocated":987136,"data_stored":473955,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 18:12:33 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.54900000000000004,"15min":0.54500000000000004},"min":{"1min":0.441,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.73499999999999999,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.52800000000000002,"15min":0.52300000000000002},"min":{"1min":0.41199999999999998,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.72099999999999997,"5min":0.78200000000000003,"15min":0.78200000000000003},"last":0.50600000000000001}]},{"osd":1,"last update":"Fri Jul 14 18:12:33 2023","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.628,"15min":0.61499999999999999},"min":{"1min":0.50900000000000001,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.90200000000000002,"5min":1.036,"15min":1.036},"last":0.74099999999999999},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.64500000000000002,"15min":0.63500000000000001},"min":{"1min":0.55600000000000005,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.90800000000000003,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.69899999999999995}]},{"osd":2,"last update":"Fri Jul 14 18:12:33 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.48299999999999998,"15min":0.46000000000000002},"min":{"1min":0.39100000000000001,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.80300000000000005,"5min":1.032,"15min":1.032},"last":0.45600000000000002},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.49099999999999999,"15min":0.47799999999999998},"min":{"1min":0.38500000000000001,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.81999999999999995,"5min":1.0449999999999999,"15min":1.0449999999999999},"last":0.56799999999999995}]},{"osd":3,"last update":"Fri Jul 14 18:12:33 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.58099999999999996,"15min":0.58399999999999996},"min":{"1min":0.433,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.60299999999999998,"15min":0.59499999999999997},"min":{"1min":0.438,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.97599999999999998,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.53700000000000003}]},{"osd":4,"last update":"Fri Jul 14 18:12:33 2023","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.68400000000000005,"15min":0.65400000000000003},"min":{"1min":0.60899999999999999,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":1.0189999999999999,"5min":2.5030000000000001,"15min":2.5030000000000001},"last":0.65900000000000003},{"interface":"front","average":{"1min":0.746,"5min":0.66100000000000003,"15min":0.64300000000000002},"min":{"1min":0.52800000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":1.0069999999999999,"5min":1.0069999999999999,"15min":1.0069999999999999},"last":0.63900000000000001}]},{"osd":5,"last update":"Fri Jul 14 18:12:33 2023","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.60699999999999998,"15min":0.59199999999999997},"min":{"1min":0.41699999999999998,"5min":0.316,"15min":0.316},"max":{"1min":1.0189999999999999,"5min":1.0189999999999999,"15min":1.0189999999999999},"last":0.622},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.61399999999999999,"15min":0.60399999999999998},"min":{"1min":0.46899999999999997,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.72299999999999998}]},{"osd":6,"last update":"Fri Jul 14 18:12:33 2023","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.69199999999999995,"15min":0.68000000000000005},"min":{"1min":0.61299999999999999,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":1.006,"5min":1.006,"15min":1.006},"last":0.68300000000000005},{"interface":"front","average":{"1min":0.77200000000000002,"5min":0.71099999999999997,"15min":0.70699999999999996},"min":{"1min":0.53400000000000003,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.98999999999999999,"5min":1.008,"15min":1.008},"last":0.76700000000000002}]},{"osd":7,"last update":"Fri Jul 14 18:12:33 2023","interfaces":[{"interface":"back","average":{"1min":0.81699999999999995,"5min":0.75900000000000001,"15min":0.72799999999999998},"min":{"1min":0.64300000000000002,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":1.0349999999999999,"5min":2.5550000000000002,"15min":2.5550000000000002},"last":0.82199999999999995},{"interface":"front","average":{"1min":0.82699999999999996,"5min":0.74099999999999999,"15min":0.72299999999999998},"min":{"1min":0.71799999999999997,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.125,"5min":1.125,"15min":1.125},"last":0.83199999999999996}]},{"osd":9,"last update":"Fri Jul 14 18:11:50 2023","interfaces":[{"interface":"back","average":{"1min":0.80800000000000005,"5min":0.70499999999999996,"15min":0.68799999999999994},"min":{"1min":0.57099999999999995,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.0609999999999999,"5min":1.0609999999999999,"15min":1.0609999999999999},"last":0.78800000000000003},{"interface":"front","average":{"1min":0.94699999999999995,"5min":0.745,"15min":0.71099999999999997},"min":{"1min":0.56299999999999994,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":2.5339999999999998,"5min":2.5339999999999998,"15min":2.5339999999999998},"last":0.79600000000000004}]},{"osd":10,"last update":"Fri Jul 14 18:12:11 2023","interfaces":[{"interface":"back","average":{"1min":0.875,"5min":0.75900000000000001,"15min":0.73999999999999999},"min":{"1min":0.77600000000000002,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.0740000000000001,"5min":1.0740000000000001,"15min":1.0740000000000001},"last":0.85999999999999999},{"interface":"front","average":{"1min":0.91900000000000004,"5min":0.77900000000000003,"15min":0.75600000000000001},"min":{"1min":0.79200000000000004,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.115,"5min":1.115,"15min":1.115},"last":0.873}]},{"osd":11,"last update":"Fri Jul 14 18:12:11 2023","interfaces":[{"interface":"back","average":{"1min":0.86099999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"min":{"1min":0.623,"5min":0.623,"15min":0.623},"max":{"1min":1.101,"5min":1.101,"15min":1.101},"last":0.81100000000000005},{"interface":"front","average":{"1min":0.88600000000000001,"5min":0.88600000000000001,"15min":0.88600000000000001},"min":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":1.089,"5min":1.089,"15min":1.089},"last":0.84599999999999997}]}]},{"osd":7,"up_from":49,"seq":210453397552,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28568,"kb_used_data":1552,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716584,"statfs":{"total":95995035648,"available":95965782016,"internally_reserved":0,"allocated":1589248,"data_stored":1072226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 18:11:06 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.55300000000000005,"15min":0.54600000000000004},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"last":0.38400000000000001},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"min":{"1min":0.35599999999999998,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.77900000000000003,"5min":0.84299999999999997,"15min":0.84299999999999997},"last":0.35599999999999998}]},{"osd":1,"last update":"Fri Jul 14 18:12:06 2023","interfaces":[{"interface":"back","average":{"1min":0.42499999999999999,"5min":0.42199999999999999,"15min":0.41499999999999998},"min":{"1min":0.29599999999999999,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.56100000000000005,"5min":0.751,"15min":0.751},"last":0.39200000000000002},{"interface":"front","average":{"1min":0.46200000000000002,"5min":0.44600000000000001,"15min":0.442},"min":{"1min":0.28000000000000003,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.70599999999999996,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.432}]},{"osd":2,"last update":"Fri Jul 14 18:12:06 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.58999999999999997,"15min":0.58499999999999996},"min":{"1min":0.35299999999999998,"5min":0.313,"15min":0.313},"max":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"last":0.70899999999999996},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.61299999999999999,"15min":0.61499999999999999},"min":{"1min":0.436,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.75800000000000001,"5min":0.81499999999999995,"15min":0.81499999999999995},"last":0.69499999999999995}]},{"osd":3,"last update":"Fri Jul 14 18:12:06 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.56499999999999995,"15min":0.56200000000000006},"min":{"1min":0.41899999999999998,"5min":0.379,"15min":0.379},"max":{"1min":0.877,"5min":0.877,"15min":0.877},"last":0.51500000000000001},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.60499999999999998,"15min":0.59899999999999998},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.84799999999999998,"5min":0.88100000000000001,"15min":0.88100000000000001},"last":0.55600000000000005}]},{"osd":4,"last update":"Fri Jul 14 18:12:06 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.52700000000000002,"15min":0.52100000000000002},"min":{"1min":0.36099999999999999,"5min":0.316,"15min":0.316},"max":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.47999999999999998,"5min":0.49199999999999999,"15min":0.499},"min":{"1min":0.309,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.65800000000000003,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.46100000000000002}]},{"osd":5,"last update":"Fri Jul 14 18:12:06 2023","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.65700000000000003,"15min":0.66400000000000003},"min":{"1min":0.503,"5min":0.373,"15min":0.373},"max":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"last":0.65600000000000003},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.65500000000000003,"15min":0.65500000000000003},"min":{"1min":0.51700000000000002,"5min":0.38,"15min":0.38},"max":{"1min":0.89200000000000002,"5min":0.89200000000000002,"15min":0.89200000000000002},"last":0.745}]},{"osd":6,"last update":"Fri Jul 14 18:12:06 2023","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.67100000000000004,"15min":0.66700000000000004},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":0.90700000000000003,"5min":0.90700000000000003,"15min":0.90700000000000003},"last":0.67600000000000005},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.65200000000000002,"15min":0.66800000000000004},"min":{"1min":0.373,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.84499999999999997,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.57499999999999996}]},{"osd":8,"last update":"Fri Jul 14 18:12:28 2023","interfaces":[{"interface":"back","average":{"1min":0.77100000000000002,"5min":0.72199999999999998,"15min":0.71299999999999997},"min":{"1min":0.59199999999999997,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":0.997,"5min":0.997,"15min":0.997},"last":0.78600000000000003},{"interface":"front","average":{"1min":0.747,"5min":0.69099999999999995,"15min":0.68400000000000005},"min":{"1min":0.58499999999999996,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.88300000000000001,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.77200000000000002}]},{"osd":9,"last update":"Fri Jul 14 18:11:52 2023","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.66800000000000004,"15min":0.66900000000000004},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.90800000000000003,"5min":0.90800000000000003,"15min":0.90800000000000003},"last":0.79800000000000004},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.747,"15min":0.753},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":0.90800000000000003,"5min":1.0189999999999999,"15min":1.0189999999999999},"last":0.73299999999999998}]},{"osd":10,"last update":"Fri Jul 14 18:12:09 2023","interfaces":[{"interface":"back","average":{"1min":0.751,"5min":0.74199999999999999,"15min":0.73999999999999999},"min":{"1min":0.503,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.024,"5min":1.046,"15min":1.046},"last":0.75800000000000001},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.66100000000000003,"15min":0.65100000000000002},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.878,"5min":0.89500000000000002,"15min":0.89500000000000002},"last":0.63400000000000001}]},{"osd":11,"last update":"Fri Jul 14 18:12:09 2023","interfaces":[{"interface":"back","average":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"min":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"max":{"1min":0.95199999999999996,"5min":0.95199999999999996,"15min":0.95199999999999996},"last":0.82599999999999996},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":0.93400000000000005,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.81100000000000005}]}]},{"osd":6,"up_from":44,"seq":188978561077,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27964,"kb_used_data":948,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717188,"statfs":{"total":95995035648,"available":95966400512,"internally_reserved":0,"allocated":970752,"data_stored":469813,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 18:12:47 2023","interfaces":[{"interface":"back","average":{"1min":0.377,"5min":0.39500000000000002,"15min":0.39500000000000002},"min":{"1min":0.28100000000000003,"5min":0.217,"15min":0.217},"max":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.40300000000000002},{"interface":"front","average":{"1min":0.40899999999999997,"5min":0.41599999999999998,"15min":0.40999999999999998},"min":{"1min":0.27600000000000002,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.64800000000000002,"5min":0.71899999999999997,"15min":0.71899999999999997},"last":0.41999999999999998}]},{"osd":1,"last update":"Fri Jul 14 18:12:47 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.57399999999999995,"15min":0.54200000000000004},"min":{"1min":0.38,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.96899999999999997,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.51600000000000001,"5min":0.53600000000000003,"15min":0.51200000000000001},"min":{"1min":0.379,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.97699999999999998,"5min":1.048,"15min":1.048},"last":0.45900000000000002}]},{"osd":2,"last update":"Fri Jul 14 18:12:47 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.59399999999999997,"15min":0.57999999999999996},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.82799999999999996,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.64700000000000002},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.57799999999999996,"15min":0.57999999999999996},"min":{"1min":0.38,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"last":0.59599999999999997}]},{"osd":3,"last update":"Fri Jul 14 18:12:47 2023","interfaces":[{"interface":"back","average":{"1min":0.38300000000000001,"5min":0.434,"15min":0.439},"min":{"1min":0.30299999999999999,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.625,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.38500000000000001},{"interface":"front","average":{"1min":0.46800000000000003,"5min":0.496,"15min":0.48999999999999999},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.68999999999999995,"5min":0.83399999999999996,"15min":0.83399999999999996},"last":0.53400000000000003}]},{"osd":4,"last update":"Fri Jul 14 18:12:47 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.622,"15min":0.60999999999999999},"min":{"1min":0.42199999999999999,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.93100000000000005,"5min":1.087,"15min":1.087},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.58799999999999997,"15min":0.57199999999999995},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.93999999999999995,"5min":1.014,"15min":1.014},"last":0.51500000000000001}]},{"osd":5,"last update":"Fri Jul 14 18:12:47 2023","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.66900000000000004,"15min":0.67100000000000004},"min":{"1min":0.42099999999999999,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.92100000000000004,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.69399999999999995,"15min":0.69599999999999995},"min":{"1min":0.46200000000000002,"5min":0.443,"15min":0.443},"max":{"1min":0.98599999999999999,"5min":0.98599999999999999,"15min":0.98599999999999999},"last":0.67200000000000004}]},{"osd":7,"last update":"Fri Jul 14 18:12:13 2023","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.67000000000000004,"15min":0.66600000000000004},"min":{"1min":0.5,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.86099999999999999,"5min":1.03,"15min":1.03},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.70599999999999996,"15min":0.70399999999999996},"min":{"1min":0.50600000000000001,"5min":0.443,"15min":0.443},"max":{"1min":0.93100000000000005,"5min":1.0700000000000001,"15min":1.0700000000000001},"last":0.69999999999999996}]},{"osd":8,"last update":"Fri Jul 14 18:12:31 2023","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.74299999999999999,"15min":0.76900000000000002},"min":{"1min":0.46300000000000002,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.95599999999999996,"5min":0.99399999999999999,"15min":0.99399999999999999},"last":0.72699999999999998},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.66700000000000004,"15min":0.68899999999999995},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.94499999999999995,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.622}]},{"osd":9,"last update":"Fri Jul 14 18:11:52 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.72499999999999998,"15min":0.74299999999999999},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.88700000000000001,"5min":1.0449999999999999,"15min":1.0449999999999999},"last":0.73699999999999999},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.76100000000000001,"15min":0.78300000000000003},"min":{"1min":0.505,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.80800000000000005,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.747}]},{"osd":10,"last update":"Fri Jul 14 18:12:13 2023","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.69899999999999995,"15min":0.70499999999999996},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.879,"5min":1.026,"15min":1.026},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.746,"15min":0.752},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":0.97099999999999997,"5min":0.99399999999999999,"15min":0.99399999999999999},"last":0.68400000000000005}]},{"osd":11,"last update":"Fri Jul 14 18:12:13 2023","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.755,"15min":0.755},"min":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":1.002,"5min":1.002,"15min":1.002},"last":0.71699999999999997},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"min":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"max":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.77700000000000002}]}]},{"osd":1,"up_from":13,"seq":55834574921,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28028,"kb_used_data":1012,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717124,"statfs":{"total":95995035648,"available":95966334976,"internally_reserved":0,"allocated":1036288,"data_stored":536475,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 18:12:07 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.56399999999999995,"15min":0.53500000000000003},"min":{"1min":0.34000000000000002,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.76800000000000002,"5min":0.98899999999999999,"15min":0.98899999999999999},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.55400000000000005,"15min":0.53000000000000003},"min":{"1min":0.40699999999999997,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.91000000000000003,"5min":0.91000000000000003,"15min":0.91000000000000003},"last":0.51000000000000001}]},{"osd":2,"last update":"Fri Jul 14 18:12:32 2023","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.59499999999999997,"15min":0.52100000000000002},"min":{"1min":0.38800000000000001,"5min":0.314,"15min":0.314},"max":{"1min":1.056,"5min":1.056,"15min":1.056},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.57699999999999996,"15min":0.50800000000000001},"min":{"1min":0.44900000000000001,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.91000000000000003,"5min":0.91000000000000003,"15min":0.91000000000000003},"last":0.61099999999999999}]},{"osd":3,"last update":"Fri Jul 14 18:11:50 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.55900000000000005,"15min":0.52800000000000002},"min":{"1min":0.36199999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.86799999999999999,"5min":0.86799999999999999,"15min":0.86799999999999999},"last":0.44},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.61899999999999999,"15min":0.55300000000000005},"min":{"1min":0.439,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":1.0229999999999999,"5min":1.0229999999999999,"15min":1.0229999999999999},"last":0.63400000000000001}]},{"osd":4,"last update":"Fri Jul 14 18:12:07 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.46899999999999997,"15min":0.41799999999999998},"min":{"1min":0.36399999999999999,"5min":0.245,"15min":0.245},"max":{"1min":0.95299999999999996,"5min":0.95299999999999996,"15min":0.95299999999999996},"last":0.36699999999999999},{"interface":"front","average":{"1min":0.51300000000000001,"5min":0.46300000000000002,"15min":0.41199999999999998},"min":{"1min":0.32700000000000001,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.69199999999999995,"5min":0.77600000000000002,"15min":0.77600000000000002},"last":0.41099999999999998}]},{"osd":5,"last update":"Fri Jul 14 18:12:32 2023","interfaces":[{"interface":"back","average":{"1min":0.74099999999999999,"5min":0.65100000000000002,"15min":0.60899999999999999},"min":{"1min":0.46800000000000003,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.94299999999999995,"5min":0.96599999999999997,"15min":0.96599999999999997},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.77500000000000002,"5min":0.67900000000000005,"15min":0.629},"min":{"1min":0.53200000000000003,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":1.04,"5min":1.04,"15min":1.04},"last":0.65600000000000003}]},{"osd":6,"last update":"Fri Jul 14 18:12:47 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.63300000000000001,"15min":0.61799999999999999},"min":{"1min":0.503,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.81999999999999995,"5min":0.93700000000000006,"15min":0.93700000000000006},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.68200000000000005,"5min":0.67000000000000004,"15min":0.64800000000000002},"min":{"1min":0.42699999999999999,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.83299999999999996,"5min":0.97299999999999998,"15min":0.97299999999999998},"last":0.67200000000000004}]},{"osd":7,"last update":"Fri Jul 14 18:12:12 2023","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.63500000000000001,"15min":0.60899999999999999},"min":{"1min":0.41499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":1.109,"5min":1.109,"15min":1.109},"last":0.69199999999999995},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.65200000000000002,"15min":0.64200000000000002},"min":{"1min":0.36899999999999999,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":1.002,"5min":1.0489999999999999,"15min":1.0489999999999999},"last":0.77400000000000002}]},{"osd":8,"last update":"Fri Jul 14 18:12:32 2023","interfaces":[{"interface":"back","average":{"1min":0.82799999999999996,"5min":0.76800000000000002,"15min":0.754},"min":{"1min":0.54200000000000004,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":1.0700000000000001,"5min":1.0700000000000001,"15min":1.0700000000000001},"last":0.80700000000000005},{"interface":"front","average":{"1min":0.84599999999999997,"5min":0.78000000000000003,"15min":0.76400000000000001},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":1.155,"5min":1.155,"15min":1.155},"last":0.75800000000000001}]},{"osd":9,"last update":"Fri Jul 14 18:11:50 2023","interfaces":[{"interface":"back","average":{"1min":0.74199999999999999,"5min":0.75900000000000001,"15min":0.76200000000000001},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.98199999999999998,"5min":1.01,"15min":1.01},"last":0.72199999999999998},{"interface":"front","average":{"1min":0.78600000000000003,"5min":0.81599999999999995,"15min":0.82099999999999995},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.0149999999999999,"5min":1.0589999999999999,"15min":1.0589999999999999},"last":0.70899999999999996}]},{"osd":10,"last update":"Fri Jul 14 18:12:12 2023","interfaces":[{"interface":"back","average":{"1min":0.81799999999999995,"5min":0.81100000000000005,"15min":0.81000000000000005},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.0860000000000001,"5min":1.0860000000000001,"15min":1.0860000000000001},"last":0.82099999999999995},{"interface":"front","average":{"1min":0.79800000000000004,"5min":0.78800000000000003,"15min":0.78600000000000003},"min":{"1min":0.495,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.097,"5min":1.097,"15min":1.097},"last":0.79100000000000004}]},{"osd":11,"last update":"Fri Jul 14 18:12:12 2023","interfaces":[{"interface":"back","average":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"min":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.1339999999999999,"5min":1.1339999999999999,"15min":1.1339999999999999},"last":0.85899999999999999},{"interface":"front","average":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"min":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":1.125,"5min":1.125,"15min":1.125},"last":0.84499999999999997}]}]},{"osd":0,"up_from":8,"seq":34359738446,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27988,"kb_used_data":972,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717164,"statfs":{"total":95995035648,"available":95966375936,"internally_reserved":0,"allocated":995328,"data_stored":471269,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Jul 14 18:12:07 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.52600000000000002,"15min":0.51100000000000001},"min":{"1min":0.437,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.68300000000000005,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.53600000000000003,"15min":0.51000000000000001},"min":{"1min":0.35399999999999998,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.76400000000000001,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.69799999999999995}]},{"osd":2,"last update":"Fri Jul 14 18:12:38 2023","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.57599999999999996,"15min":0.56000000000000005},"min":{"1min":0.39800000000000002,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.69999999999999996,"5min":0.93799999999999994,"15min":0.93799999999999994},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.55800000000000005,"15min":0.52800000000000002},"min":{"1min":0.379,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.73499999999999999,"5min":0.82399999999999995,"15min":0.82399999999999995},"last":0.46999999999999997}]},{"osd":3,"last update":"Fri Jul 14 18:12:13 2023","interfaces":[{"interface":"back","average":{"1min":0.377,"5min":0.377,"15min":0.377},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"last":0.40600000000000003},{"interface":"front","average":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"last":0.38200000000000001}]},{"osd":4,"last update":"Fri Jul 14 18:12:07 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.53800000000000003,"15min":0.51400000000000001},"min":{"1min":0.42499999999999999,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.67300000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.54400000000000004},"min":{"1min":0.41199999999999998,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.80000000000000004,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.65100000000000002}]},{"osd":5,"last update":"Fri Jul 14 18:12:38 2023","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.55600000000000005,"15min":0.52600000000000002},"min":{"1min":0.439,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.70399999999999996,"5min":1.161,"15min":1.161},"last":0.51600000000000001},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.56999999999999995,"15min":0.54900000000000004},"min":{"1min":0.41699999999999998,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.69099999999999995,"5min":0.879,"15min":0.879},"last":0.503}]},{"osd":6,"last update":"Fri Jul 14 18:11:48 2023","interfaces":[{"interface":"back","average":{"1min":0.41999999999999998,"5min":0.50700000000000001,"15min":0.503},"min":{"1min":0.28999999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.58999999999999997,"5min":1.0649999999999999,"15min":1.0649999999999999},"last":0.436},{"interface":"front","average":{"1min":0.47999999999999998,"5min":0.52100000000000002,"15min":0.51100000000000001},"min":{"1min":0.34499999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.68700000000000006,"5min":1.3460000000000001,"15min":1.3460000000000001},"last":0.55200000000000005}]},{"osd":7,"last update":"Fri Jul 14 18:12:14 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"last":0.73299999999999998},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"last":0.61399999999999999}]},{"osd":8,"last update":"Fri Jul 14 18:12:38 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.69799999999999995,"15min":0.73399999999999999},"min":{"1min":0.434,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.73099999999999998,"5min":1.3819999999999999,"15min":1.3819999999999999},"last":0.68400000000000005},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.71399999999999997,"15min":0.73999999999999999},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.82399999999999995,"5min":1.0289999999999999,"15min":1.0289999999999999},"last":0.66900000000000004}]},{"osd":9,"last update":"Fri Jul 14 18:11:48 2023","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.69699999999999995,"15min":0.72399999999999998},"min":{"1min":0.36599999999999999,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.84399999999999997,"5min":1.133,"15min":1.133},"last":0.76600000000000001},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.69499999999999995,"15min":0.71699999999999997},"min":{"1min":0.435,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.72699999999999998,"5min":1.28,"15min":1.28},"last":0.63700000000000001}]},{"osd":10,"last update":"Fri Jul 14 18:12:13 2023","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":0.70499999999999996,"15min":0.71299999999999997},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.80300000000000005,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.70899999999999996},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.72499999999999998,"15min":0.73699999999999999},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":0.878,"5min":0.98299999999999998,"15min":0.98299999999999998},"last":0.79700000000000004}]},{"osd":11,"last update":"Fri Jul 14 18:12:38 2023","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.70499999999999996,"15min":0.70699999999999996},"min":{"1min":0.59999999999999998,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":0.84499999999999997,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.747},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.67900000000000005,"15min":0.68100000000000005},"min":{"1min":0.57799999999999996,"5min":0.499,"15min":0.499},"max":{"1min":0.75,"5min":0.90000000000000002,"15min":0.90000000000000002},"last":0.72299999999999998}]}]},{"osd":2,"up_from":18,"seq":77309411398,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28048,"kb_used_data":1032,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717104,"statfs":{"total":95995035648,"available":95966314496,"internally_reserved":0,"allocated":1056768,"data_stored":537146,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 18:12:28 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.51500000000000001,"15min":0.48699999999999999},"min":{"1min":0.376,"5min":0.255,"15min":0.255},"max":{"1min":1.0449999999999999,"5min":1.0449999999999999,"15min":1.0449999999999999},"last":0.46899999999999997},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.497,"15min":0.47899999999999998},"min":{"1min":0.39600000000000002,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":1.9990000000000001,"5min":1.9990000000000001,"15min":1.9990000000000001},"last":0.44}]},{"osd":1,"last update":"Fri Jul 14 18:12:28 2023","interfaces":[{"interface":"back","average":{"1min":0.64800000000000002,"5min":0.56599999999999995,"15min":0.51700000000000002},"min":{"1min":0.375,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.88700000000000001,"5min":0.97499999999999998,"15min":0.97499999999999998},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.59899999999999998,"15min":0.51900000000000002},"min":{"1min":0.46800000000000003,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.93600000000000005,"5min":1.1279999999999999,"15min":1.1279999999999999},"last":0.69999999999999996}]},{"osd":3,"last update":"Fri Jul 14 18:12:48 2023","interfaces":[{"interface":"back","average":{"1min":0.72099999999999997,"5min":0.61399999999999999,"15min":0.55600000000000005},"min":{"1min":0.41999999999999998,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":1.9390000000000001,"5min":1.9390000000000001,"15min":1.9390000000000001},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.71799999999999997,"5min":0.59199999999999997,"15min":0.55800000000000005},"min":{"1min":0.39900000000000002,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":1.9630000000000001,"5min":1.9630000000000001,"15min":1.9630000000000001},"last":0.56000000000000005}]},{"osd":4,"last update":"Fri Jul 14 18:12:12 2023","interfaces":[{"interface":"back","average":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":1.0209999999999999,"5min":1.0209999999999999,"15min":1.0209999999999999},"last":0.75800000000000001},{"interface":"front","average":{"1min":0.745,"5min":0.745,"15min":0.745},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":0.93700000000000006,"5min":0.93700000000000006,"15min":0.93700000000000006},"last":0.68500000000000005}]},{"osd":5,"last update":"Fri Jul 14 18:12:28 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.55100000000000005,"15min":0.51500000000000001},"min":{"1min":0.32900000000000001,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.92900000000000005,"5min":1.1719999999999999,"15min":1.1719999999999999},"last":0.82799999999999996},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.54400000000000004,"15min":0.53100000000000003},"min":{"1min":0.40400000000000003,"5min":0.316,"15min":0.316},"max":{"1min":0.878,"5min":1.1499999999999999,"15min":1.1499999999999999},"last":0.621}]},{"osd":6,"last update":"Fri Jul 14 18:11:52 2023","interfaces":[{"interface":"back","average":{"1min":0.78200000000000003,"5min":0.67000000000000004,"15min":0.65600000000000003},"min":{"1min":0.505,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":2.3170000000000002,"5min":2.3170000000000002,"15min":2.3170000000000002},"last":0.78300000000000003},{"interface":"front","average":{"1min":0.753,"5min":0.623,"15min":0.59899999999999998},"min":{"1min":0.52700000000000002,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":2.3050000000000002,"5min":2.3050000000000002,"15min":2.3050000000000002},"last":0.66900000000000004}]},{"osd":7,"last update":"Fri Jul 14 18:12:12 2023","interfaces":[{"interface":"back","average":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"min":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.008,"5min":1.008,"15min":1.008},"last":0.745},{"interface":"front","average":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"min":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":1.0720000000000001,"5min":1.0720000000000001,"15min":1.0720000000000001},"last":0.85799999999999998}]},{"osd":8,"last update":"Fri Jul 14 18:12:28 2023","interfaces":[{"interface":"back","average":{"1min":0.76500000000000001,"5min":0.68799999999999994,"15min":0.63900000000000001},"min":{"1min":0.434,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":1.093,"5min":1.4570000000000001,"15min":1.4570000000000001},"last":0.88},{"interface":"front","average":{"1min":0.71799999999999997,"5min":0.622,"15min":0.58799999999999997},"min":{"1min":0.47699999999999998,"5min":0.379,"15min":0.379},"max":{"1min":0.95199999999999996,"5min":1.2769999999999999,"15min":1.2769999999999999},"last":0.86899999999999999}]},{"osd":9,"last update":"Fri Jul 14 18:11:52 2023","interfaces":[{"interface":"back","average":{"1min":0.85699999999999998,"5min":0.72699999999999998,"15min":0.70499999999999996},"min":{"1min":0.59599999999999997,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.0960000000000001,"5min":1.0960000000000001,"15min":1.0960000000000001},"last":0.89900000000000002},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.65400000000000003,"15min":0.64200000000000002},"min":{"1min":0.55200000000000005,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":0.90600000000000003,"5min":0.90600000000000003,"15min":0.90600000000000003},"last":0.76900000000000002}]},{"osd":10,"last update":"Fri Jul 14 18:12:12 2023","interfaces":[{"interface":"back","average":{"1min":0.79600000000000004,"5min":0.69599999999999995,"15min":0.68000000000000005},"min":{"1min":0.60599999999999998,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.0229999999999999,"5min":1.0229999999999999,"15min":1.0229999999999999},"last":0.73299999999999998},{"interface":"front","average":{"1min":0.85799999999999998,"5min":0.73699999999999999,"15min":0.71699999999999997},"min":{"1min":0.67400000000000004,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.0629999999999999,"5min":1.0629999999999999,"15min":1.0629999999999999},"last":0.79300000000000004}]},{"osd":11,"last update":"Fri Jul 14 18:12:12 2023","interfaces":[{"interface":"back","average":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"min":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"max":{"1min":0.97999999999999998,"5min":0.97999999999999998,"15min":0.97999999999999998},"last":0.81299999999999994},{"interface":"front","average":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"min":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"max":{"1min":1.006,"5min":1.006,"15min":1.006},"last":0.84199999999999997}]}]},{"osd":3,"up_from":25,"seq":107374182465,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27972,"kb_used_data":956,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717180,"statfs":{"total":95995035648,"available":95966392320,"internally_reserved":0,"allocated":978944,"data_stored":468739,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 18:12:49 2023","interfaces":[{"interface":"back","average":{"1min":0.35399999999999998,"5min":0.36899999999999999,"15min":0.36699999999999999},"min":{"1min":0.26200000000000001,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":0.46000000000000002,"5min":0.65700000000000003,"15min":0.65700000000000003},"last":0.27100000000000002},{"interface":"front","average":{"1min":0.33500000000000002,"5min":0.40200000000000002,"15min":0.38900000000000001},"min":{"1min":0.27600000000000002,"5min":0.248,"15min":0.248},"max":{"1min":0.41499999999999998,"5min":1.786,"15min":1.786},"last":0.23599999999999999}]},{"osd":1,"last update":"Fri Jul 14 18:12:49 2023","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.58199999999999996,"15min":0.52100000000000002},"min":{"1min":0.436,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":1.246,"5min":3.4369999999999998,"15min":3.4369999999999998},"last":0.52400000000000002},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.58099999999999996,"15min":0.53500000000000003},"min":{"1min":0.42399999999999999,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":1.2969999999999999,"5min":1.2969999999999999,"15min":1.2969999999999999},"last":0.45600000000000002}]},{"osd":2,"last update":"Fri Jul 14 18:12:49 2023","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.57499999999999996,"15min":0.56899999999999995},"min":{"1min":0.34300000000000003,"5min":0.307,"15min":0.307},"max":{"1min":0.66300000000000003,"5min":3.4540000000000002,"15min":3.4540000000000002},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.51800000000000002,"5min":0.56200000000000006,"15min":0.56200000000000006},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.75800000000000001,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.64700000000000002}]},{"osd":4,"last update":"Fri Jul 14 18:12:06 2023","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.58299999999999996,"15min":0.54400000000000004},"min":{"1min":0.42999999999999999,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.73499999999999999,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.58099999999999996,"15min":0.56399999999999995},"min":{"1min":0.42499999999999999,"5min":0.38,"15min":0.38},"max":{"1min":0.72699999999999998,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.38200000000000001}]},{"osd":5,"last update":"Fri Jul 14 18:12:31 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.59999999999999998,"15min":0.59499999999999997},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.79400000000000004,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.57299999999999995,"15min":0.58699999999999997},"min":{"1min":0.38900000000000001,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.72299999999999998,"5min":0.875,"15min":0.875},"last":0.63600000000000001}]},{"osd":6,"last update":"Fri Jul 14 18:12:49 2023","interfaces":[{"interface":"back","average":{"1min":0.42399999999999999,"5min":0.51200000000000001,"15min":0.52200000000000002},"min":{"1min":0.34599999999999997,"5min":0.317,"15min":0.317},"max":{"1min":0.63200000000000001,"5min":1.028,"15min":1.028},"last":0.34100000000000003},{"interface":"front","average":{"1min":0.501,"5min":0.57599999999999996,"15min":0.58499999999999996},"min":{"1min":0.376,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.68300000000000005,"5min":1.0669999999999999,"15min":1.0669999999999999},"last":0.36799999999999999}]},{"osd":7,"last update":"Fri Jul 14 18:12:10 2023","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.71099999999999997,"15min":0.71499999999999997},"min":{"1min":0.53600000000000003,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.391,"5min":1.391,"15min":1.391},"last":0.40100000000000002},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.65300000000000002,"15min":0.67100000000000004},"min":{"1min":0.46300000000000002,"5min":0.376,"15min":0.376},"max":{"1min":1.0660000000000001,"5min":1.131,"15min":1.131},"last":0.53700000000000003}]},{"osd":8,"last update":"Fri Jul 14 18:10:26 2023","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.046,"5min":1.046,"15min":1.046},"last":0.61099999999999999}]},{"osd":9,"last update":"Fri Jul 14 18:11:50 2023","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":0.57699999999999996,"15min":0.58799999999999997},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.75900000000000001,"5min":0.98999999999999999,"15min":0.98999999999999999},"last":0.48099999999999998},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.70699999999999996,"15min":0.72299999999999998},"min":{"1min":0.38200000000000001,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.96299999999999997,"5min":0.997,"15min":0.997},"last":0.32200000000000001}]},{"osd":10,"last update":"Fri Jul 14 18:12:10 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.77200000000000002,"15min":0.77800000000000002},"min":{"1min":0.56799999999999995,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":1.272,"5min":1.272,"15min":1.272},"last":0.42799999999999999},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.71999999999999997,"15min":0.72899999999999998},"min":{"1min":0.52600000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.2629999999999999,"5min":1.2629999999999999,"15min":1.2629999999999999},"last":0.56899999999999995}]},{"osd":11,"last update":"Fri Jul 14 18:12:10 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":0.89700000000000002,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.625}]}]},{"osd":4,"up_from":32,"seq":137438953533,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27972,"kb_used_data":956,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717180,"statfs":{"total":95995035648,"available":95966392320,"internally_reserved":0,"allocated":978944,"data_stored":474418,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 18:10:07 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.49099999999999999,"15min":0.48099999999999998},"min":{"1min":0.32100000000000001,"5min":0.313,"15min":0.313},"max":{"1min":1.347,"5min":1.347,"15min":1.347},"last":0.44400000000000001},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.50900000000000001,"15min":0.501},"min":{"1min":0.312,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":1.417,"5min":1.417,"15min":1.417},"last":0.53500000000000003}]},{"osd":1,"last update":"Fri Jul 14 18:12:14 2023","interfaces":[{"interface":"back","average":{"1min":0.441,"5min":0.40600000000000003,"15min":0.379},"min":{"1min":0.309,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.56200000000000006,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.46400000000000002,"5min":0.40899999999999997,"15min":0.36899999999999999},"min":{"1min":0.28899999999999998,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.74199999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.54800000000000004}]},{"osd":2,"last update":"Fri Jul 14 18:12:14 2023","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.57099999999999995,"15min":0.53700000000000003},"min":{"1min":0.44800000000000001,"5min":0.374,"15min":0.374},"max":{"1min":0.753,"5min":1.4019999999999999,"15min":1.4019999999999999},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.58299999999999996,"15min":0.54200000000000004},"min":{"1min":0.52900000000000003,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.82699999999999996,"5min":1.4750000000000001,"15min":1.4750000000000001},"last":0.65100000000000002}]},{"osd":3,"last update":"Fri Jul 14 18:12:14 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.55000000000000004,"15min":0.501},"min":{"1min":0.39100000000000001,"5min":0.318,"15min":0.318},"max":{"1min":0.81399999999999995,"5min":1.054,"15min":1.054},"last":0.81399999999999995},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.54900000000000004,"15min":0.53000000000000003},"min":{"1min":0.40799999999999997,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.65600000000000003,"5min":0.95299999999999996,"15min":0.95299999999999996},"last":0.68899999999999995}]},{"osd":5,"last update":"Fri Jul 14 18:12:36 2023","interfaces":[{"interface":"back","average":{"1min":0.76900000000000002,"5min":0.63400000000000001,"15min":0.56200000000000006},"min":{"1min":0.59199999999999997,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.90400000000000003,"5min":1.177,"15min":1.177},"last":0.70899999999999996},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.65300000000000002,"15min":0.58499999999999996},"min":{"1min":0.48699999999999999,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":1.0109999999999999,"5min":1.1220000000000001,"15min":1.1220000000000001},"last":0.85799999999999998}]},{"osd":6,"last update":"Fri Jul 14 18:11:51 2023","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.64200000000000002,"15min":0.61099999999999999},"min":{"1min":0.47599999999999998,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.83499999999999996,"5min":1.101,"15min":1.101},"last":0.76600000000000001},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.63400000000000001,"15min":0.61199999999999999},"min":{"1min":0.52300000000000002,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.78300000000000003,"5min":1.446,"15min":1.446},"last":0.73099999999999998}]},{"osd":7,"last update":"Fri Jul 14 18:12:14 2023","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.60599999999999998,"15min":0.57999999999999996},"min":{"1min":0.439,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.92100000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.93700000000000006},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.63900000000000001,"15min":0.60799999999999998},"min":{"1min":0.50700000000000001,"5min":0.316,"15min":0.316},"max":{"1min":0.95099999999999996,"5min":1.0189999999999999,"15min":1.0189999999999999},"last":1.0449999999999999}]},{"osd":8,"last update":"Fri Jul 14 18:12:34 2023","interfaces":[{"interface":"back","average":{"1min":0.72199999999999998,"5min":0.69399999999999995,"15min":0.69299999999999995},"min":{"1min":0.56599999999999995,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.93200000000000005,"5min":1.3740000000000001,"15min":1.3740000000000001},"last":0.84399999999999997},{"interface":"front","average":{"1min":0.86799999999999999,"5min":0.80100000000000005,"15min":0.78700000000000003},"min":{"1min":0.66700000000000004,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.0880000000000001,"5min":1.147,"15min":1.147},"last":0.99099999999999999}]},{"osd":9,"last update":"Fri Jul 14 18:11:51 2023","interfaces":[{"interface":"back","average":{"1min":0.78500000000000003,"5min":0.81399999999999995,"15min":0.81899999999999995},"min":{"1min":0.63800000000000001,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":0.98499999999999999,"5min":1.171,"15min":1.171},"last":0.90300000000000002},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.70999999999999996,"15min":0.71699999999999997},"min":{"1min":0.51300000000000001,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":0.85199999999999998,"5min":1.304,"15min":1.304},"last":0.88700000000000001}]},{"osd":10,"last update":"Fri Jul 14 18:12:14 2023","interfaces":[{"interface":"back","average":{"1min":0.747,"5min":0.73999999999999999,"15min":0.73899999999999999},"min":{"1min":0.58299999999999996,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":0.90400000000000003,"5min":1.016,"15min":1.016},"last":0.79500000000000004},{"interface":"front","average":{"1min":0.83999999999999997,"5min":0.82599999999999996,"15min":0.82399999999999995},"min":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.038,"5min":1.196,"15min":1.196},"last":1.0169999999999999}]},{"osd":11,"last update":"Fri Jul 14 18:12:08 2023","interfaces":[{"interface":"back","average":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"min":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"max":{"1min":0.96799999999999997,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.83299999999999996},{"interface":"front","average":{"1min":0.90800000000000003,"5min":0.90800000000000003,"15min":0.90800000000000003},"min":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"max":{"1min":1.0620000000000001,"5min":1.0620000000000001,"15min":1.0620000000000001},"last":0.95699999999999996}]}]},{"osd":5,"up_from":37,"seq":158913790008,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28576,"kb_used_data":1560,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716576,"statfs":{"total":95995035648,"available":95965773824,"internally_reserved":0,"allocated":1597440,"data_stored":1066375,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 14 18:12:31 2023","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.52700000000000002,"15min":0.51500000000000001},"min":{"1min":0.37,"5min":0.318,"15min":0.318},"max":{"1min":0.79000000000000004,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.47699999999999998},{"interface":"front","average":{"1min":0.501,"5min":0.51500000000000001,"15min":0.5},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.77100000000000002,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.49399999999999999}]},{"osd":1,"last update":"Fri Jul 14 18:12:31 2023","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.58099999999999996,"15min":0.54300000000000004},"min":{"1min":0.442,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.81599999999999995,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.59299999999999997,"15min":0.55700000000000005},"min":{"1min":0.38300000000000001,"5min":0.374,"15min":0.374},"max":{"1min":0.79200000000000004,"5min":0.90400000000000003,"15min":0.90400000000000003},"last":0.53600000000000003}]},{"osd":2,"last update":"Fri Jul 14 18:12:31 2023","interfaces":[{"interface":"back","average":{"1min":0.46899999999999997,"5min":0.44,"15min":0.38800000000000001},"min":{"1min":0.308,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.61299999999999999,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.67600000000000005},{"interface":"front","average":{"1min":0.44500000000000001,"5min":0.44400000000000001,"15min":0.40699999999999997},"min":{"1min":0.31,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.64300000000000002,"5min":0.751,"15min":0.751},"last":0.374}]},{"osd":3,"last update":"Fri Jul 14 18:12:31 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.55000000000000004,"15min":0.52200000000000002},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.82399999999999995,"5min":0.90300000000000002,"15min":0.90300000000000002},"last":0.40100000000000002},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.54500000000000004,"15min":0.51100000000000001},"min":{"1min":0.40300000000000002,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.442}]},{"osd":4,"last update":"Fri Jul 14 18:12:31 2023","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.61699999999999999,"15min":0.58299999999999996},"min":{"1min":0.53300000000000003,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.84599999999999997,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.51500000000000001},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.628,"15min":0.58499999999999996},"min":{"1min":0.42399999999999999,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.87,"5min":1.1379999999999999,"15min":1.1379999999999999},"last":0.66100000000000003}]},{"osd":6,"last update":"Fri Jul 14 18:11:50 2023","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.59699999999999998,"15min":0.57799999999999996},"min":{"1min":0.40000000000000002,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.93400000000000005,"5min":1.0289999999999999,"15min":1.0289999999999999},"last":0.54800000000000004},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.60899999999999999,"15min":0.59299999999999997},"min":{"1min":0.38700000000000001,"5min":0.371,"15min":0.371},"max":{"1min":0.96599999999999997,"5min":0.96599999999999997,"15min":0.96599999999999997},"last":0.52400000000000002}]},{"osd":7,"last update":"Fri Jul 14 18:12:12 2023","interfaces":[{"interface":"back","average":{"1min":0.72099999999999997,"5min":0.67000000000000004,"15min":0.65000000000000002},"min":{"1min":0.58599999999999997,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.89400000000000002,"5min":1.0669999999999999,"15min":1.0669999999999999},"last":0.625},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.69999999999999996,"15min":0.68300000000000005},"min":{"1min":0.54500000000000004,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":1.0269999999999999,"5min":1.081,"15min":1.081},"last":0.72199999999999998}]},{"osd":8,"last update":"Fri Jul 14 18:12:31 2023","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":0.67500000000000004,"15min":0.66900000000000004},"min":{"1min":0.42799999999999999,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.84999999999999998,"5min":0.99399999999999999,"15min":0.99399999999999999},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.65500000000000003,"15min":0.64900000000000002},"min":{"1min":0.45100000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.82199999999999995,"5min":1.1859999999999999,"15min":1.1859999999999999},"last":0.59599999999999997}]},{"osd":9,"last update":"Fri Jul 14 18:11:50 2023","interfaces":[{"interface":"back","average":{"1min":0.73999999999999999,"5min":0.746,"15min":0.747},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":1.0429999999999999,"5min":1.2350000000000001,"15min":1.2350000000000001},"last":0.70799999999999996},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.73399999999999999,"15min":0.73399999999999999},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":1.0920000000000001,"5min":1.0920000000000001,"15min":1.0920000000000001},"last":0.64500000000000002}]},{"osd":10,"last update":"Fri Jul 14 18:12:12 2023","interfaces":[{"interface":"back","average":{"1min":0.80700000000000005,"5min":0.77900000000000003,"15min":0.77400000000000002},"min":{"1min":0.53100000000000003,"5min":0.495,"15min":0.495},"max":{"1min":1.0669999999999999,"5min":1.0669999999999999,"15min":1.0669999999999999},"last":0.69099999999999995},{"interface":"front","average":{"1min":0.81399999999999995,"5min":0.77500000000000002,"15min":0.76900000000000002},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.1399999999999999,"5min":1.1399999999999999,"15min":1.1399999999999999},"last":0.753}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2629,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":68108,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":106496,"data_stored":68779,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3271,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1173,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":5026,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":1500,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":64303,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1643,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-14T18:12:52.756 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-14T18:12:52.909 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:52.868+0000 7f4ca0c34700 1 -- 172.21.15.163:0/2965949129 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f4c9c0ff6f0 msgr2=0x7f4c9c106fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:12:52.910 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:52.868+0000 7f4ca0c34700 1 --2- 172.21.15.163:0/2965949129 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f4c9c0ff6f0 0x7f4c9c106fa0 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f4c9400b0a0 tx=0x7f4c9400b3b0 comp rx=0 tx=0).stop 2023-07-14T18:12:52.910 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:52.869+0000 7f4ca0c34700 1 -- 172.21.15.163:0/2965949129 shutdown_connections 2023-07-14T18:12:52.910 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:52.869+0000 7f4ca0c34700 1 --2- 172.21.15.163:0/2965949129 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4c9c100180 0x7f4c9c100590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:52.910 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:52.869+0000 7f4ca0c34700 1 --2- 172.21.15.163:0/2965949129 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f4c9c0ff6f0 0x7f4c9c106fa0 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:52.910 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:52.869+0000 7f4ca0c34700 1 --2- 172.21.15.163:0/2965949129 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4c9c0fed40 0x7f4c9c0ff1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:52.910 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:52.869+0000 7f4ca0c34700 1 -- 172.21.15.163:0/2965949129 >> 172.21.15.163:0/2965949129 conn(0x7f4c9c0f98a0 msgr2=0x7f4c9c0fbcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:12:52.910 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:52.869+0000 7f4ca0c34700 1 -- 172.21.15.163:0/2965949129 shutdown_connections 2023-07-14T18:12:52.911 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:52.869+0000 7f4ca0c34700 1 -- 172.21.15.163:0/2965949129 wait complete. 2023-07-14T18:12:52.912 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:52.869+0000 7f4ca0c34700 1 Processor -- start 2023-07-14T18:12:52.912 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:52.869+0000 7f4ca0c34700 1 -- start start 2023-07-14T18:12:52.913 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:52.870+0000 7f4ca0c34700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4c9c0fed40 0x7f4c9c194800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:12:52.913 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:52.870+0000 7f4ca0c34700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4c9c0ff6f0 0x7f4c9c194d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:12:52.913 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:52.870+0000 7f4ca0c34700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f4c9c100180 0x7f4c9c19bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:12:52.913 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:52.870+0000 7f4ca0c34700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c9c19c380 con 0x7f4c9c100180 2023-07-14T18:12:52.913 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:52.870+0000 7f4ca0c34700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c9c19c4c0 con 0x7f4c9c0fed40 2023-07-14T18:12:52.913 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:52.870+0000 7f4ca0c34700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c9c19c650 con 0x7f4c9c0ff6f0 2023-07-14T18:12:52.913 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:52.870+0000 7f4c9ad9d700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f4c9c100180 0x7f4c9c19bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:12:52.913 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:52.870+0000 7f4c9a59c700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4c9c0fed40 0x7f4c9c194800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:12:52.914 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:52.870+0000 7f4c9ad9d700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f4c9c100180 0x7f4c9c19bdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:57924/0 (socket says 172.21.15.163:57924) 2023-07-14T18:12:52.914 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:52.870+0000 7f4c9ad9d700 1 -- 172.21.15.163:0/1451849167 learned_addr learned my addr 172.21.15.163:0/1451849167 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:12:52.914 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:52.870+0000 7f4c99d9b700 1 --2- 172.21.15.163:0/1451849167 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4c9c0ff6f0 0x7f4c9c194d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:12:52.914 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:52.870+0000 7f4c9ad9d700 1 -- 172.21.15.163:0/1451849167 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4c9c0ff6f0 msgr2=0x7f4c9c194d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:12:52.914 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:52.870+0000 7f4c9ad9d700 1 --2- 172.21.15.163:0/1451849167 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4c9c0ff6f0 0x7f4c9c194d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:52.914 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:52.870+0000 7f4c9ad9d700 1 -- 172.21.15.163:0/1451849167 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4c9c0fed40 msgr2=0x7f4c9c194800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:12:52.914 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:52.870+0000 7f4c9ad9d700 1 --2- 172.21.15.163:0/1451849167 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4c9c0fed40 0x7f4c9c194800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:52.915 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:52.870+0000 7f4c9ad9d700 1 -- 172.21.15.163:0/1451849167 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c94009d00 con 0x7f4c9c100180 2023-07-14T18:12:52.915 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:52.870+0000 7f4c9ad9d700 1 --2- 172.21.15.163:0/1451849167 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f4c9c100180 0x7f4c9c19bdb0 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f4c940062a0 tx=0x7f4c94004d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:12:52.915 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:52.870+0000 7f4c8b7fe700 1 -- 172.21.15.163:0/1451849167 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c9400e040 con 0x7f4c9c100180 2023-07-14T18:12:52.915 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:52.870+0000 7f4c8b7fe700 1 -- 172.21.15.163:0/1451849167 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f4c9401ab60 con 0x7f4c9c100180 2023-07-14T18:12:52.915 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:52.870+0000 7f4ca0c34700 1 -- 172.21.15.163:0/1451849167 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4c9c0fdc30 con 0x7f4c9c100180 2023-07-14T18:12:52.915 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:52.870+0000 7f4c8b7fe700 1 -- 172.21.15.163:0/1451849167 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c940057a0 con 0x7f4c9c100180 2023-07-14T18:12:52.915 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:52.870+0000 7f4ca0c34700 1 -- 172.21.15.163:0/1451849167 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c9c0fe140 con 0x7f4c9c100180 2023-07-14T18:12:52.915 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:52.871+0000 7f4ca0c34700 1 -- 172.21.15.163:0/1451849167 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4c9c10a180 con 0x7f4c9c100180 2023-07-14T18:12:52.916 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:52.872+0000 7f4c8b7fe700 1 -- 172.21.15.163:0/1451849167 <== mon.0 v2:172.21.15.163:3300/0 4 ==== mgrmap(e 18) v1 ==== 135716+0+0 (secure 0 0 0) 0x7f4c9401acd0 con 0x7f4c9c100180 2023-07-14T18:12:52.916 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:52.873+0000 7f4c8b7fe700 1 --2- 172.21.15.163:0/1451849167 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f4c840a11a0 0x7f4c840a3650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:12:52.916 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:52.873+0000 7f4c8b7fe700 1 -- 172.21.15.163:0/1451849167 <== mon.0 v2:172.21.15.163:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 9020+0+0 (secure 0 0 0) 0x7f4c940d0240 con 0x7f4c9c100180 2023-07-14T18:12:52.917 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:52.873+0000 7f4c9a59c700 1 --2- 172.21.15.163:0/1451849167 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f4c840a11a0 0x7f4c840a3650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:12:52.917 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:52.873+0000 7f4c9a59c700 1 --2- 172.21.15.163:0/1451849167 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f4c840a11a0 0x7f4c840a3650 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f4c8c005950 tx=0x7f4c8c00a300 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:12:52.917 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:52.877+0000 7f4c8b7fe700 1 -- 172.21.15.163:0/1451849167 <== mon.0 v2:172.21.15.163:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178025 (secure 0 0 0) 0x7f4c940997a0 con 0x7f4c9c100180 2023-07-14T18:12:53.106 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:53.066+0000 7f4ca0c34700 1 -- 172.21.15.163:0/1451849167 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4c9c10a340 con 0x7f4c9c100180 2023-07-14T18:12:53.108 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:53.067+0000 7f4c8b7fe700 1 -- 172.21.15.163:0/1451849167 <== mon.0 v2:172.21.15.163:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v86) v1 ==== 74+0+24500 (secure 0 0 0) 0x7f4c9409cdc0 con 0x7f4c9c100180 2023-07-14T18:12:53.108 INFO:teuthology.orchestra.run.smithi163.stdout: 2023-07-14T18:12:53.109 INFO:teuthology.orchestra.run.smithi163.stdout:{"epoch":86,"fsid":"bf7326ec-2270-11ee-9b33-001a4aab830c","created":"2023-07-14T18:04:26.263517+0000","modified":"2023-07-14T18:12:16.776609+0000","last_up_change":"2023-07-14T18:10:27.514863+0000","last_in_change":"2023-07-14T18:10:10.726443+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-14T18:07:19.653852+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-07-14T18:11:07.314989+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-07-14T18:11:08.274627+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-07-14T18:11:11.991162+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"e6490568-046d-43ef-bb07-d79fb884b276","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6802","nonce":3124653025},{"type":"v1","addr":"172.21.15.163:6803","nonce":3124653025}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6804","nonce":3124653025},{"type":"v1","addr":"172.21.15.163:6805","nonce":3124653025}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6808","nonce":3124653025},{"type":"v1","addr":"172.21.15.163:6809","nonce":3124653025}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6806","nonce":3124653025},{"type":"v1","addr":"172.21.15.163:6807","nonce":3124653025}]},"public_addr":"172.21.15.163:6803/3124653025","cluster_addr":"172.21.15.163:6805/3124653025","heartbeat_back_addr":"172.21.15.163:6809/3124653025","heartbeat_front_addr":"172.21.15.163:6807/3124653025","state":["exists","up"]},{"osd":1,"uuid":"0af39bda-f096-4603-adcc-bf1988f36603","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":3774455900},{"type":"v1","addr":"172.21.15.172:6801","nonce":3774455900}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":3774455900},{"type":"v1","addr":"172.21.15.172:6803","nonce":3774455900}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":3774455900},{"type":"v1","addr":"172.21.15.172:6807","nonce":3774455900}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":3774455900},{"type":"v1","addr":"172.21.15.172:6805","nonce":3774455900}]},"public_addr":"172.21.15.172:6801/3774455900","cluster_addr":"172.21.15.172:6803/3774455900","heartbeat_back_addr":"172.21.15.172:6807/3774455900","heartbeat_front_addr":"172.21.15.172:6805/3774455900","state":["exists","up"]},{"osd":2,"uuid":"cc732c13-af0f-4199-98e6-fe960ed4e5dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":1976927678},{"type":"v1","addr":"172.21.15.184:6801","nonce":1976927678}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":1976927678},{"type":"v1","addr":"172.21.15.184:6803","nonce":1976927678}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":1976927678},{"type":"v1","addr":"172.21.15.184:6807","nonce":1976927678}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":1976927678},{"type":"v1","addr":"172.21.15.184:6805","nonce":1976927678}]},"public_addr":"172.21.15.184:6801/1976927678","cluster_addr":"172.21.15.184:6803/1976927678","heartbeat_back_addr":"172.21.15.184:6807/1976927678","heartbeat_front_addr":"172.21.15.184:6805/1976927678","state":["exists","up"]},{"osd":3,"uuid":"dcee9576-0bc6-4ab0-8f63-79eacd0eca5f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6810","nonce":2589130694},{"type":"v1","addr":"172.21.15.163:6811","nonce":2589130694}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6812","nonce":2589130694},{"type":"v1","addr":"172.21.15.163:6813","nonce":2589130694}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6816","nonce":2589130694},{"type":"v1","addr":"172.21.15.163:6817","nonce":2589130694}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6814","nonce":2589130694},{"type":"v1","addr":"172.21.15.163:6815","nonce":2589130694}]},"public_addr":"172.21.15.163:6811/2589130694","cluster_addr":"172.21.15.163:6813/2589130694","heartbeat_back_addr":"172.21.15.163:6817/2589130694","heartbeat_front_addr":"172.21.15.163:6815/2589130694","state":["exists","up"]},{"osd":4,"uuid":"055df823-b8b0-426a-83c2-f0d727932ad8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":3319632614},{"type":"v1","addr":"172.21.15.172:6809","nonce":3319632614}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6810","nonce":3319632614},{"type":"v1","addr":"172.21.15.172:6811","nonce":3319632614}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6814","nonce":3319632614},{"type":"v1","addr":"172.21.15.172:6815","nonce":3319632614}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":3319632614},{"type":"v1","addr":"172.21.15.172:6813","nonce":3319632614}]},"public_addr":"172.21.15.172:6809/3319632614","cluster_addr":"172.21.15.172:6811/3319632614","heartbeat_back_addr":"172.21.15.172:6815/3319632614","heartbeat_front_addr":"172.21.15.172:6813/3319632614","state":["exists","up"]},{"osd":5,"uuid":"ef5ef02a-b4e2-4790-9d27-f6d2247b25c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":2662084043},{"type":"v1","addr":"172.21.15.184:6809","nonce":2662084043}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6810","nonce":2662084043},{"type":"v1","addr":"172.21.15.184:6811","nonce":2662084043}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6814","nonce":2662084043},{"type":"v1","addr":"172.21.15.184:6815","nonce":2662084043}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6812","nonce":2662084043},{"type":"v1","addr":"172.21.15.184:6813","nonce":2662084043}]},"public_addr":"172.21.15.184:6809/2662084043","cluster_addr":"172.21.15.184:6811/2662084043","heartbeat_back_addr":"172.21.15.184:6815/2662084043","heartbeat_front_addr":"172.21.15.184:6813/2662084043","state":["exists","up"]},{"osd":6,"uuid":"dba754be-0fc5-4867-a6d5-cf97eb344f81","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":44,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6818","nonce":2530874117},{"type":"v1","addr":"172.21.15.163:6819","nonce":2530874117}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6820","nonce":2530874117},{"type":"v1","addr":"172.21.15.163:6821","nonce":2530874117}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6824","nonce":2530874117},{"type":"v1","addr":"172.21.15.163:6825","nonce":2530874117}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6822","nonce":2530874117},{"type":"v1","addr":"172.21.15.163:6823","nonce":2530874117}]},"public_addr":"172.21.15.163:6819/2530874117","cluster_addr":"172.21.15.163:6821/2530874117","heartbeat_back_addr":"172.21.15.163:6825/2530874117","heartbeat_front_addr":"172.21.15.163:6823/2530874117","state":["exists","up"]},{"osd":7,"uuid":"edd76e6b-6077-4619-b00d-1e906f70ddcc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":49,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":233511803},{"type":"v1","addr":"172.21.15.172:6817","nonce":233511803}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6818","nonce":233511803},{"type":"v1","addr":"172.21.15.172:6819","nonce":233511803}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":233511803},{"type":"v1","addr":"172.21.15.172:6823","nonce":233511803}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6820","nonce":233511803},{"type":"v1","addr":"172.21.15.172:6821","nonce":233511803}]},"public_addr":"172.21.15.172:6817/233511803","cluster_addr":"172.21.15.172:6819/233511803","heartbeat_back_addr":"172.21.15.172:6823/233511803","heartbeat_front_addr":"172.21.15.172:6821/233511803","state":["exists","up"]},{"osd":8,"uuid":"36559400-f33e-44e6-868a-316d34da457d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":56,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6816","nonce":290154343},{"type":"v1","addr":"172.21.15.184:6817","nonce":290154343}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6818","nonce":290154343},{"type":"v1","addr":"172.21.15.184:6819","nonce":290154343}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6822","nonce":290154343},{"type":"v1","addr":"172.21.15.184:6823","nonce":290154343}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6820","nonce":290154343},{"type":"v1","addr":"172.21.15.184:6821","nonce":290154343}]},"public_addr":"172.21.15.184:6817/290154343","cluster_addr":"172.21.15.184:6819/290154343","heartbeat_back_addr":"172.21.15.184:6823/290154343","heartbeat_front_addr":"172.21.15.184:6821/290154343","state":["exists","up"]},{"osd":9,"uuid":"d484f111-f36c-4c67-9a8a-ae03e7e0d137","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6826","nonce":3848110906},{"type":"v1","addr":"172.21.15.163:6827","nonce":3848110906}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6828","nonce":3848110906},{"type":"v1","addr":"172.21.15.163:6829","nonce":3848110906}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6832","nonce":3848110906},{"type":"v1","addr":"172.21.15.163:6833","nonce":3848110906}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6830","nonce":3848110906},{"type":"v1","addr":"172.21.15.163:6831","nonce":3848110906}]},"public_addr":"172.21.15.163:6827/3848110906","cluster_addr":"172.21.15.163:6829/3848110906","heartbeat_back_addr":"172.21.15.163:6833/3848110906","heartbeat_front_addr":"172.21.15.163:6831/3848110906","state":["exists","up"]},{"osd":10,"uuid":"d943f7c0-da3d-4605-9e23-0231e675c6be","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6824","nonce":3281085356},{"type":"v1","addr":"172.21.15.172:6825","nonce":3281085356}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":3281085356},{"type":"v1","addr":"172.21.15.172:6827","nonce":3281085356}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":3281085356},{"type":"v1","addr":"172.21.15.172:6831","nonce":3281085356}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6828","nonce":3281085356},{"type":"v1","addr":"172.21.15.172:6829","nonce":3281085356}]},"public_addr":"172.21.15.172:6825/3281085356","cluster_addr":"172.21.15.172:6827/3281085356","heartbeat_back_addr":"172.21.15.172:6831/3281085356","heartbeat_front_addr":"172.21.15.172:6829/3281085356","state":["exists","up"]},{"osd":11,"uuid":"09e610a8-408a-4119-a21b-c4de2810a538","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":75,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6824","nonce":3614578747},{"type":"v1","addr":"172.21.15.184:6825","nonce":3614578747}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6826","nonce":3614578747},{"type":"v1","addr":"172.21.15.184:6827","nonce":3614578747}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6830","nonce":3614578747},{"type":"v1","addr":"172.21.15.184:6831","nonce":3614578747}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6828","nonce":3614578747},{"type":"v1","addr":"172.21.15.184:6829","nonce":3614578747}]},"public_addr":"172.21.15.184:6825/3614578747","cluster_addr":"172.21.15.184:6827/3614578747","heartbeat_back_addr":"172.21.15.184:6831/3614578747","heartbeat_front_addr":"172.21.15.184:6829/3614578747","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T18:06:36.067578+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T18:06:57.095120+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T18:07:17.825363+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T18:07:38.977196+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T18:08:00.108709+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T18:08:20.700646+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T18:08:41.473899+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T18:09:02.856536+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T18:09:23.832722+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T18:09:44.860884+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T18:10:05.520678+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T18:10:26.426315+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.8","mappings":[{"from":2,"to":11}]},{"pgid":"3.1","mappings":[{"from":4,"to":9}]},{"pgid":"3.6","mappings":[{"from":4,"to":6}]},{"pgid":"3.25","mappings":[{"from":5,"to":9}]},{"pgid":"3.27","mappings":[{"from":4,"to":8}]},{"pgid":"3.2d","mappings":[{"from":3,"to":9}]},{"pgid":"4.a","mappings":[{"from":5,"to":8}]},{"pgid":"4.12","mappings":[{"from":9,"to":10}]},{"pgid":"4.14","mappings":[{"from":9,"to":8}]},{"pgid":"4.17","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.163:6801/1086512093":"2023-07-15T18:05:15.331458+0000","172.21.15.163:6800/1086512093":"2023-07-15T18:05:15.331458+0000","172.21.15.163:0/4235784810":"2023-07-15T18:05:15.331458+0000","172.21.15.163:6800/236891232":"2023-07-15T18:04:53.288443+0000","172.21.15.163:6801/236891232":"2023-07-15T18:04:53.288443+0000","172.21.15.163:0/3260193612":"2023-07-15T18:05:15.331458+0000","172.21.15.163:0/3513629472":"2023-07-15T18:04:53.288443+0000","172.21.15.163:0/1090329830":"2023-07-15T18:04:53.288443+0000","172.21.15.163:0/3868922045":"2023-07-15T18:05:15.331458+0000","172.21.15.163:0/2945662447":"2023-07-15T18:04:53.288443+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-14T18:12:53.110 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:53.070+0000 7f4ca0c34700 1 -- 172.21.15.163:0/1451849167 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f4c840a11a0 msgr2=0x7f4c840a3650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:12:53.110 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:53.070+0000 7f4ca0c34700 1 --2- 172.21.15.163:0/1451849167 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f4c840a11a0 0x7f4c840a3650 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f4c8c005950 tx=0x7f4c8c00a300 comp rx=0 tx=0).stop 2023-07-14T18:12:53.110 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:53.070+0000 7f4ca0c34700 1 -- 172.21.15.163:0/1451849167 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f4c9c100180 msgr2=0x7f4c9c19bdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:12:53.111 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:53.070+0000 7f4ca0c34700 1 --2- 172.21.15.163:0/1451849167 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f4c9c100180 0x7f4c9c19bdb0 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f4c940062a0 tx=0x7f4c94004d00 comp rx=0 tx=0).stop 2023-07-14T18:12:53.111 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:53.070+0000 7f4ca0c34700 1 -- 172.21.15.163:0/1451849167 shutdown_connections 2023-07-14T18:12:53.111 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:53.070+0000 7f4ca0c34700 1 --2- 172.21.15.163:0/1451849167 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f4c840a11a0 0x7f4c840a3650 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:53.111 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:53.070+0000 7f4ca0c34700 1 --2- 172.21.15.163:0/1451849167 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f4c9c100180 0x7f4c9c19bdb0 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:53.111 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:53.070+0000 7f4ca0c34700 1 --2- 172.21.15.163:0/1451849167 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4c9c0fed40 0x7f4c9c194800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:53.111 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:53.070+0000 7f4ca0c34700 1 --2- 172.21.15.163:0/1451849167 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4c9c0ff6f0 0x7f4c9c194d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:53.111 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:53.070+0000 7f4ca0c34700 1 -- 172.21.15.163:0/1451849167 >> 172.21.15.163:0/1451849167 conn(0x7f4c9c0f98a0 msgr2=0x7f4c9c0fbb20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:12:53.112 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:53.070+0000 7f4ca0c34700 1 -- 172.21.15.163:0/1451849167 shutdown_connections 2023-07-14T18:12:53.112 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:53.070+0000 7f4ca0c34700 1 -- 172.21.15.163:0/1451849167 wait complete. 2023-07-14T18:12:53.121 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:12:52 smithi163 ceph-mon[96576]: pgmap v304: 129 pgs: 129 active+clean; 645 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 1.2 KiB/s wr, 11 op/s 2023-07-14T18:12:53.123 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-14T18:07:19.653852+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-14T18:11:07.314989+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '79', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-07-14T18:11:08.274627+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '80', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-07-14T18:11:11.991162+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '84', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-07-14T18:12:53.123 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-14T18:12:53.175 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:12:52 smithi184 ceph-mon[98481]: pgmap v304: 129 pgs: 129 active+clean; 645 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 1.2 KiB/s wr, 11 op/s 2023-07-14T18:12:53.248 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:53.207+0000 7f0684150700 1 -- 172.21.15.163:0/438999884 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f067c1006c0 msgr2=0x7f067c106f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:12:53.248 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:53.207+0000 7f0684150700 1 --2- 172.21.15.163:0/438999884 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f067c1006c0 0x7f067c106f80 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f067400b0a0 tx=0x7f067400b3b0 comp rx=0 tx=0).stop 2023-07-14T18:12:53.248 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:53.207+0000 7f0684150700 1 -- 172.21.15.163:0/438999884 shutdown_connections 2023-07-14T18:12:53.248 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:53.207+0000 7f0684150700 1 --2- 172.21.15.163:0/438999884 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f067c1006c0 0x7f067c106f80 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:53.248 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:53.207+0000 7f0684150700 1 --2- 172.21.15.163:0/438999884 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f067c0feb40 0x7f067c0fef50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:53.249 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:53.207+0000 7f0684150700 1 --2- 172.21.15.163:0/438999884 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f067c0ffd30 0x7f067c100180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:53.249 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:53.207+0000 7f0684150700 1 -- 172.21.15.163:0/438999884 >> 172.21.15.163:0/438999884 conn(0x7f067c0fa160 msgr2=0x7f067c0fc590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:12:53.249 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:53.207+0000 7f0684150700 1 -- 172.21.15.163:0/438999884 shutdown_connections 2023-07-14T18:12:53.249 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:53.207+0000 7f0684150700 1 -- 172.21.15.163:0/438999884 wait complete. 2023-07-14T18:12:53.251 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:53.208+0000 7f0684150700 1 Processor -- start 2023-07-14T18:12:53.251 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:53.208+0000 7f0684150700 1 -- start start 2023-07-14T18:12:53.251 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:53.208+0000 7f0684150700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f067c0feb40 0x7f067c069300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:12:53.251 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:53.208+0000 7f0684150700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f067c0ffd30 0x7f067c19a6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:12:53.251 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:53.208+0000 7f0684150700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f067c1006c0 0x7f067c19cd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:12:53.251 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:53.208+0000 7f0684150700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f067c19d4f0 con 0x7f067c0ffd30 2023-07-14T18:12:53.252 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:53.208+0000 7f0684150700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f067c19d660 con 0x7f067c1006c0 2023-07-14T18:12:53.252 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:53.208+0000 7f0684150700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f067c19d820 con 0x7f067c0feb40 2023-07-14T18:12:53.252 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:53.208+0000 7f06816eb700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f067c0ffd30 0x7f067c19a6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:12:53.252 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:53.208+0000 7f06816eb700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f067c0ffd30 0x7f067c19a6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:57936/0 (socket says 172.21.15.163:57936) 2023-07-14T18:12:53.252 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:53.208+0000 7f06816eb700 1 -- 172.21.15.163:0/461553730 learned_addr learned my addr 172.21.15.163:0/461553730 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:12:53.252 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:53.208+0000 7f0681eec700 1 --2- 172.21.15.163:0/461553730 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f067c0feb40 0x7f067c069300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:12:53.252 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:53.208+0000 7f06826ed700 1 --2- 172.21.15.163:0/461553730 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f067c1006c0 0x7f067c19cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:12:53.252 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:53.209+0000 7f06816eb700 1 -- 172.21.15.163:0/461553730 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f067c0feb40 msgr2=0x7f067c069300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:12:53.253 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:53.209+0000 7f06816eb700 1 --2- 172.21.15.163:0/461553730 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f067c0feb40 0x7f067c069300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:53.253 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:53.209+0000 7f06816eb700 1 -- 172.21.15.163:0/461553730 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f067c1006c0 msgr2=0x7f067c19cd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:12:53.253 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:53.209+0000 7f06816eb700 1 --2- 172.21.15.163:0/461553730 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f067c1006c0 0x7f067c19cd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:53.253 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:53.209+0000 7f06816eb700 1 -- 172.21.15.163:0/461553730 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0674009d00 con 0x7f067c0ffd30 2023-07-14T18:12:53.253 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:53.209+0000 7f06826ed700 1 --2- 172.21.15.163:0/461553730 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f067c1006c0 0x7f067c19cd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T18:12:53.253 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:53.209+0000 7f06816eb700 1 --2- 172.21.15.163:0/461553730 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f067c0ffd30 0x7f067c19a6d0 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f067800d950 tx=0x7f067800dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:12:53.253 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:53.209+0000 7f066effd700 1 -- 172.21.15.163:0/461553730 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0678009940 con 0x7f067c0ffd30 2023-07-14T18:12:53.254 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:53.209+0000 7f066effd700 1 -- 172.21.15.163:0/461553730 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f0678010460 con 0x7f067c0ffd30 2023-07-14T18:12:53.254 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:53.209+0000 7f0684150700 1 -- 172.21.15.163:0/461553730 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f067c19db00 con 0x7f067c0ffd30 2023-07-14T18:12:53.254 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:53.209+0000 7f066effd700 1 -- 172.21.15.163:0/461553730 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f067800f620 con 0x7f067c0ffd30 2023-07-14T18:12:53.254 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:53.209+0000 7f0684150700 1 -- 172.21.15.163:0/461553730 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f067c19e060 con 0x7f067c0ffd30 2023-07-14T18:12:53.254 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:53.210+0000 7f0684150700 1 -- 172.21.15.163:0/461553730 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f067c10a1d0 con 0x7f067c0ffd30 2023-07-14T18:12:53.255 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:53.211+0000 7f066effd700 1 -- 172.21.15.163:0/461553730 <== mon.0 v2:172.21.15.163:3300/0 4 ==== mgrmap(e 18) v1 ==== 135716+0+0 (secure 0 0 0) 0x7f06780105d0 con 0x7f067c0ffd30 2023-07-14T18:12:53.255 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:53.211+0000 7f066effd700 1 --2- 172.21.15.163:0/461553730 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f06680a11d0 0x7f06680a3680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:12:53.255 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:53.212+0000 7f066effd700 1 -- 172.21.15.163:0/461553730 <== mon.0 v2:172.21.15.163:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 9020+0+0 (secure 0 0 0) 0x7f06780cca10 con 0x7f067c0ffd30 2023-07-14T18:12:53.255 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:53.212+0000 7f0681eec700 1 --2- 172.21.15.163:0/461553730 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f06680a11d0 0x7f06680a3680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:12:53.255 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:53.212+0000 7f0681eec700 1 --2- 172.21.15.163:0/461553730 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f06680a11d0 0x7f06680a3680 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f067c0ffb90 tx=0x7f067000b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:12:53.256 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:53.215+0000 7f066effd700 1 -- 172.21.15.163:0/461553730 <== mon.0 v2:172.21.15.163:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178025 (secure 0 0 0) 0x7f0678095e50 con 0x7f067c0ffd30 2023-07-14T18:12:53.276 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:12:52 smithi172 ceph-mon[97983]: pgmap v304: 129 pgs: 129 active+clean; 645 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 1.2 KiB/s wr, 11 op/s 2023-07-14T18:12:53.445 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:53.404+0000 7f0684150700 1 -- 172.21.15.163:0/461553730 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f067c105a20 con 0x7f067c0ffd30 2023-07-14T18:12:53.445 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:53.405+0000 7f066effd700 1 -- 172.21.15.163:0/461553730 <== mon.0 v2:172.21.15.163:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v86) v1 ==== 93+0+10 (secure 0 0 0) 0x7f0678020020 con 0x7f067c0ffd30 2023-07-14T18:12:53.446 INFO:teuthology.orchestra.run.smithi163.stdout:pg_num: 1 2023-07-14T18:12:53.448 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:53.407+0000 7f0684150700 1 -- 172.21.15.163:0/461553730 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f06680a11d0 msgr2=0x7f06680a3680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:12:53.448 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:53.407+0000 7f0684150700 1 --2- 172.21.15.163:0/461553730 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f06680a11d0 0x7f06680a3680 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f067c0ffb90 tx=0x7f067000b410 comp rx=0 tx=0).stop 2023-07-14T18:12:53.448 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:53.407+0000 7f0684150700 1 -- 172.21.15.163:0/461553730 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f067c0ffd30 msgr2=0x7f067c19a6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:12:53.449 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:53.407+0000 7f0684150700 1 --2- 172.21.15.163:0/461553730 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f067c0ffd30 0x7f067c19a6d0 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f067800d950 tx=0x7f067800dc60 comp rx=0 tx=0).stop 2023-07-14T18:12:53.449 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:53.408+0000 7f0684150700 1 -- 172.21.15.163:0/461553730 shutdown_connections 2023-07-14T18:12:53.449 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:53.408+0000 7f0684150700 1 --2- 172.21.15.163:0/461553730 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f06680a11d0 0x7f06680a3680 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:53.449 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:53.408+0000 7f0684150700 1 --2- 172.21.15.163:0/461553730 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f067c0feb40 0x7f067c069300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:53.449 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:53.408+0000 7f0684150700 1 --2- 172.21.15.163:0/461553730 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f067c1006c0 0x7f067c19cd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:53.449 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:53.408+0000 7f0684150700 1 --2- 172.21.15.163:0/461553730 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f067c0ffd30 0x7f067c19a6d0 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:53.449 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:53.408+0000 7f0684150700 1 -- 172.21.15.163:0/461553730 >> 172.21.15.163:0/461553730 conn(0x7f067c0fa160 msgr2=0x7f067c0fc380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:12:53.450 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:53.408+0000 7f0684150700 1 -- 172.21.15.163:0/461553730 shutdown_connections 2023-07-14T18:12:53.450 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:53.408+0000 7f0684150700 1 -- 172.21.15.163:0/461553730 wait complete. 2023-07-14T18:12:53.460 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-14T18:12:53.585 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:53.544+0000 7fb0d8474700 1 -- 172.21.15.163:0/33967574 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fb0d0100f50 msgr2=0x7fb0d01013a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:12:53.585 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:53.544+0000 7fb0d8474700 1 --2- 172.21.15.163:0/33967574 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fb0d0100f50 0x7fb0d01013a0 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7fb0cc009990 tx=0x7fb0cc009ca0 comp rx=0 tx=0).stop 2023-07-14T18:12:53.586 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:53.544+0000 7fb0d8474700 1 -- 172.21.15.163:0/33967574 shutdown_connections 2023-07-14T18:12:53.586 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:53.544+0000 7fb0d8474700 1 --2- 172.21.15.163:0/33967574 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb0d01018e0 0x7fb0d01081a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:53.586 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:53.544+0000 7fb0d8474700 1 --2- 172.21.15.163:0/33967574 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb0d00fdf80 0x7fb0d00fe390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:53.586 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:53.544+0000 7fb0d8474700 1 --2- 172.21.15.163:0/33967574 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fb0d0100f50 0x7fb0d01013a0 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:53.586 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:53.544+0000 7fb0d8474700 1 -- 172.21.15.163:0/33967574 >> 172.21.15.163:0/33967574 conn(0x7fb0d00f9980 msgr2=0x7fb0d00fbd90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:12:53.586 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:53.544+0000 7fb0d8474700 1 -- 172.21.15.163:0/33967574 shutdown_connections 2023-07-14T18:12:53.586 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:53.544+0000 7fb0d8474700 1 -- 172.21.15.163:0/33967574 wait complete. 2023-07-14T18:12:53.587 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:53.545+0000 7fb0d8474700 1 Processor -- start 2023-07-14T18:12:53.587 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:53.545+0000 7fb0d8474700 1 -- start start 2023-07-14T18:12:53.588 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:53.545+0000 7fb0d8474700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fb0d00fdf80 0x7fb0d0195860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:12:53.588 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:53.545+0000 7fb0d8474700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb0d0100f50 0x7fb0d0195da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:12:53.589 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:53.545+0000 7fb0d8474700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb0d01018e0 0x7fb0d019ce10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:12:53.589 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:53.545+0000 7fb0d8474700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0d019d3e0 con 0x7fb0d00fdf80 2023-07-14T18:12:53.589 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:53.545+0000 7fb0d8474700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0d019d520 con 0x7fb0d0100f50 2023-07-14T18:12:53.589 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:53.545+0000 7fb0d8474700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0d019d6b0 con 0x7fb0d01018e0 2023-07-14T18:12:53.589 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:53.545+0000 7fb0d6210700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fb0d00fdf80 0x7fb0d0195860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:12:53.589 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:53.545+0000 7fb0d6210700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fb0d00fdf80 0x7fb0d0195860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:57948/0 (socket says 172.21.15.163:57948) 2023-07-14T18:12:53.589 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:53.545+0000 7fb0d6210700 1 -- 172.21.15.163:0/783767121 learned_addr learned my addr 172.21.15.163:0/783767121 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:12:53.589 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:53.545+0000 7fb0d6a11700 1 --2- 172.21.15.163:0/783767121 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb0d01018e0 0x7fb0d019ce10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:12:53.590 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:53.545+0000 7fb0d5a0f700 1 --2- 172.21.15.163:0/783767121 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb0d0100f50 0x7fb0d0195da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:12:53.590 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:53.545+0000 7fb0d6210700 1 -- 172.21.15.163:0/783767121 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb0d01018e0 msgr2=0x7fb0d019ce10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:12:53.590 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:53.545+0000 7fb0d6210700 1 --2- 172.21.15.163:0/783767121 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb0d01018e0 0x7fb0d019ce10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:53.590 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:53.545+0000 7fb0d6210700 1 -- 172.21.15.163:0/783767121 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb0d0100f50 msgr2=0x7fb0d0195da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:12:53.590 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:53.545+0000 7fb0d6210700 1 --2- 172.21.15.163:0/783767121 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb0d0100f50 0x7fb0d0195da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:53.590 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:53.545+0000 7fb0d6210700 1 -- 172.21.15.163:0/783767121 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0cc0095f0 con 0x7fb0d00fdf80 2023-07-14T18:12:53.590 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:53.546+0000 7fb0d6210700 1 --2- 172.21.15.163:0/783767121 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fb0d00fdf80 0x7fb0d0195860 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7fb0c000d980 tx=0x7fb0c000dd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:12:53.591 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:53.546+0000 7fb0c77fe700 1 -- 172.21.15.163:0/783767121 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0c000bb60 con 0x7fb0d00fdf80 2023-07-14T18:12:53.591 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:53.546+0000 7fb0c77fe700 1 -- 172.21.15.163:0/783767121 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fb0c0007620 con 0x7fb0d00fdf80 2023-07-14T18:12:53.591 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:53.546+0000 7fb0d8474700 1 -- 172.21.15.163:0/783767121 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb0d019d990 con 0x7fb0d00fdf80 2023-07-14T18:12:53.591 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:53.546+0000 7fb0c77fe700 1 -- 172.21.15.163:0/783767121 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0c000f3c0 con 0x7fb0d00fdf80 2023-07-14T18:12:53.591 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:53.546+0000 7fb0d8474700 1 -- 172.21.15.163:0/783767121 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb0d019dea0 con 0x7fb0d00fdf80 2023-07-14T18:12:53.591 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:53.547+0000 7fb0d8474700 1 -- 172.21.15.163:0/783767121 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb0d0106d40 con 0x7fb0d00fdf80 2023-07-14T18:12:53.592 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:53.548+0000 7fb0c77fe700 1 -- 172.21.15.163:0/783767121 <== mon.0 v2:172.21.15.163:3300/0 4 ==== mgrmap(e 18) v1 ==== 135716+0+0 (secure 0 0 0) 0x7fb0c0010460 con 0x7fb0d00fdf80 2023-07-14T18:12:53.592 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:53.549+0000 7fb0c77fe700 1 --2- 172.21.15.163:0/783767121 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7fb0bc0a1150 0x7fb0bc0a3600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:12:53.592 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:53.549+0000 7fb0d5a0f700 1 --2- 172.21.15.163:0/783767121 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7fb0bc0a1150 0x7fb0bc0a3600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:12:53.592 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:53.549+0000 7fb0c77fe700 1 -- 172.21.15.163:0/783767121 <== mon.0 v2:172.21.15.163:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 9020+0+0 (secure 0 0 0) 0x7fb0c00cd4c0 con 0x7fb0d00fdf80 2023-07-14T18:12:53.592 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:53.549+0000 7fb0d5a0f700 1 --2- 172.21.15.163:0/783767121 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7fb0bc0a1150 0x7fb0bc0a3600 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fb0cc006010 tx=0x7fb0cc00b260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:12:53.593 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:53.552+0000 7fb0c77fe700 1 -- 172.21.15.163:0/783767121 <== mon.0 v2:172.21.15.163:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178025 (secure 0 0 0) 0x7fb0c00968a0 con 0x7fb0d00fdf80 2023-07-14T18:12:53.786 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:53.746+0000 7fb0d8474700 1 -- 172.21.15.163:0/783767121 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fb0d002cb90 con 0x7fb0d00fdf80 2023-07-14T18:12:53.787 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:53.746+0000 7fb0c77fe700 1 -- 172.21.15.163:0/783767121 <== mon.0 v2:172.21.15.163:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v86) v1 ==== 104+0+11 (secure 0 0 0) 0x7fb0c0096030 con 0x7fb0d00fdf80 2023-07-14T18:12:53.787 INFO:teuthology.orchestra.run.smithi163.stdout:pg_num: 32 2023-07-14T18:12:53.789 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:53.748+0000 7fb0d8474700 1 -- 172.21.15.163:0/783767121 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7fb0bc0a1150 msgr2=0x7fb0bc0a3600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:12:53.789 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:53.748+0000 7fb0d8474700 1 --2- 172.21.15.163:0/783767121 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7fb0bc0a1150 0x7fb0bc0a3600 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fb0cc006010 tx=0x7fb0cc00b260 comp rx=0 tx=0).stop 2023-07-14T18:12:53.789 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:53.748+0000 7fb0d8474700 1 -- 172.21.15.163:0/783767121 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fb0d00fdf80 msgr2=0x7fb0d0195860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:12:53.790 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:53.748+0000 7fb0d8474700 1 --2- 172.21.15.163:0/783767121 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fb0d00fdf80 0x7fb0d0195860 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7fb0c000d980 tx=0x7fb0c000dd40 comp rx=0 tx=0).stop 2023-07-14T18:12:53.790 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:53.748+0000 7fb0d8474700 1 -- 172.21.15.163:0/783767121 shutdown_connections 2023-07-14T18:12:53.790 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:53.748+0000 7fb0d8474700 1 --2- 172.21.15.163:0/783767121 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7fb0bc0a1150 0x7fb0bc0a3600 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:53.790 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:53.748+0000 7fb0d8474700 1 --2- 172.21.15.163:0/783767121 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb0d01018e0 0x7fb0d019ce10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:53.790 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:53.748+0000 7fb0d8474700 1 --2- 172.21.15.163:0/783767121 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fb0d00fdf80 0x7fb0d0195860 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:53.790 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:53.748+0000 7fb0d8474700 1 --2- 172.21.15.163:0/783767121 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb0d0100f50 0x7fb0d0195da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:53.790 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:53.748+0000 7fb0d8474700 1 -- 172.21.15.163:0/783767121 >> 172.21.15.163:0/783767121 conn(0x7fb0d00f9980 msgr2=0x7fb0d00fbc70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:12:53.791 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:53.748+0000 7fb0d8474700 1 -- 172.21.15.163:0/783767121 shutdown_connections 2023-07-14T18:12:53.791 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:53.748+0000 7fb0d8474700 1 -- 172.21.15.163:0/783767121 wait complete. 2023-07-14T18:12:53.801 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-14T18:12:53.928 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:53.887+0000 7ff22ad44700 1 -- 172.21.15.163:0/3009844259 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff224101800 msgr2=0x7ff2241080c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:12:53.928 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:53.887+0000 7ff22ad44700 1 --2- 172.21.15.163:0/3009844259 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff224101800 0x7ff2241080c0 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7ff21c00b0a0 tx=0x7ff21c00b3b0 comp rx=0 tx=0).stop 2023-07-14T18:12:53.928 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:53.887+0000 7ff22ad44700 1 -- 172.21.15.163:0/3009844259 shutdown_connections 2023-07-14T18:12:53.929 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:53.887+0000 7ff22ad44700 1 --2- 172.21.15.163:0/3009844259 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff2240ffc80 0x7ff224100090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:53.929 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:53.887+0000 7ff22ad44700 1 --2- 172.21.15.163:0/3009844259 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff224101800 0x7ff2241080c0 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:53.929 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:53.887+0000 7ff22ad44700 1 --2- 172.21.15.163:0/3009844259 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff224100e70 0x7ff2241012c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:53.929 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:53.887+0000 7ff22ad44700 1 -- 172.21.15.163:0/3009844259 >> 172.21.15.163:0/3009844259 conn(0x7ff2240fb2a0 msgr2=0x7ff2240fd6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:12:53.929 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:53.887+0000 7ff22ad44700 1 -- 172.21.15.163:0/3009844259 shutdown_connections 2023-07-14T18:12:53.929 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:53.887+0000 7ff22ad44700 1 -- 172.21.15.163:0/3009844259 wait complete. 2023-07-14T18:12:53.932 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:53.888+0000 7ff22ad44700 1 Processor -- start 2023-07-14T18:12:53.933 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:53.888+0000 7ff22ad44700 1 -- start start 2023-07-14T18:12:53.933 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:53.888+0000 7ff22ad44700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff2240ffc80 0x7ff224195980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:12:53.933 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:53.888+0000 7ff22ad44700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff224100e70 0x7ff224195ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:12:53.933 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:53.888+0000 7ff22ad44700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff224101800 0x7ff22419cf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:12:53.933 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:53.888+0000 7ff22ad44700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff22419d500 con 0x7ff224100e70 2023-07-14T18:12:53.933 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:53.888+0000 7ff22ad44700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff22419d640 con 0x7ff224101800 2023-07-14T18:12:53.934 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:53.888+0000 7ff22ad44700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff22419d7d0 con 0x7ff2240ffc80 2023-07-14T18:12:53.934 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:53.888+0000 7ff223fff700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff224100e70 0x7ff224195ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:12:53.934 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:53.888+0000 7ff223fff700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff224100e70 0x7ff224195ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:57964/0 (socket says 172.21.15.163:57964) 2023-07-14T18:12:53.934 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:53.888+0000 7ff223fff700 1 -- 172.21.15.163:0/3890703660 learned_addr learned my addr 172.21.15.163:0/3890703660 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:12:53.934 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:53.888+0000 7ff228ae0700 1 --2- 172.21.15.163:0/3890703660 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff2240ffc80 0x7ff224195980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:12:53.934 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:53.889+0000 7ff2292e1700 1 --2- 172.21.15.163:0/3890703660 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff224101800 0x7ff22419cf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:12:53.934 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:53.889+0000 7ff223fff700 1 -- 172.21.15.163:0/3890703660 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff2240ffc80 msgr2=0x7ff224195980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:12:53.935 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:53.889+0000 7ff223fff700 1 --2- 172.21.15.163:0/3890703660 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff2240ffc80 0x7ff224195980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:53.935 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:53.889+0000 7ff223fff700 1 -- 172.21.15.163:0/3890703660 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff224101800 msgr2=0x7ff22419cf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:12:53.935 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:53.889+0000 7ff223fff700 1 --2- 172.21.15.163:0/3890703660 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff224101800 0x7ff22419cf30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:53.935 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:53.889+0000 7ff223fff700 1 -- 172.21.15.163:0/3890703660 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff21c009d00 con 0x7ff224100e70 2023-07-14T18:12:53.935 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:53.889+0000 7ff223fff700 1 --2- 172.21.15.163:0/3890703660 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff224100e70 0x7ff224195ec0 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7ff21000d950 tx=0x7ff21000dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:12:53.935 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:53.889+0000 7ff221ffb700 1 -- 172.21.15.163:0/3890703660 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff210009940 con 0x7ff224100e70 2023-07-14T18:12:53.935 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:53.889+0000 7ff22ad44700 1 -- 172.21.15.163:0/3890703660 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff22419dab0 con 0x7ff224100e70 2023-07-14T18:12:53.935 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:53.889+0000 7ff221ffb700 1 -- 172.21.15.163:0/3890703660 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ff210010460 con 0x7ff224100e70 2023-07-14T18:12:53.936 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:53.889+0000 7ff221ffb700 1 -- 172.21.15.163:0/3890703660 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff21000f620 con 0x7ff224100e70 2023-07-14T18:12:53.936 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:53.889+0000 7ff22ad44700 1 -- 172.21.15.163:0/3890703660 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff22419e010 con 0x7ff224100e70 2023-07-14T18:12:53.936 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:53.890+0000 7ff22ad44700 1 -- 172.21.15.163:0/3890703660 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff224107220 con 0x7ff224100e70 2023-07-14T18:12:53.936 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:53.891+0000 7ff221ffb700 1 -- 172.21.15.163:0/3890703660 <== mon.0 v2:172.21.15.163:3300/0 4 ==== mgrmap(e 18) v1 ==== 135716+0+0 (secure 0 0 0) 0x7ff2100105d0 con 0x7ff224100e70 2023-07-14T18:12:53.936 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:53.892+0000 7ff221ffb700 1 --2- 172.21.15.163:0/3890703660 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7ff2140a1150 0x7ff2140a3600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:12:53.936 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:53.892+0000 7ff228ae0700 1 --2- 172.21.15.163:0/3890703660 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7ff2140a1150 0x7ff2140a3600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:12:53.936 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:53.892+0000 7ff221ffb700 1 -- 172.21.15.163:0/3890703660 <== mon.0 v2:172.21.15.163:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 9020+0+0 (secure 0 0 0) 0x7ff2100cca90 con 0x7ff224100e70 2023-07-14T18:12:53.937 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:53.892+0000 7ff228ae0700 1 --2- 172.21.15.163:0/3890703660 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7ff2140a1150 0x7ff2140a3600 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7ff224100cd0 tx=0x7ff218009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:12:53.937 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:53.896+0000 7ff221ffb700 1 -- 172.21.15.163:0/3890703660 <== mon.0 v2:172.21.15.163:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178025 (secure 0 0 0) 0x7ff210095ed0 con 0x7ff224100e70 2023-07-14T18:12:54.128 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:54.087+0000 7ff22ad44700 1 -- 172.21.15.163:0/3890703660 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7ff22402cd70 con 0x7ff224100e70 2023-07-14T18:12:54.129 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:54.088+0000 7ff221ffb700 1 -- 172.21.15.163:0/3890703660 <== mon.0 v2:172.21.15.163:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v86) v1 ==== 100+0+11 (secure 0 0 0) 0x7ff2100160a0 con 0x7ff224100e70 2023-07-14T18:12:54.129 INFO:teuthology.orchestra.run.smithi163.stdout:pg_num: 64 2023-07-14T18:12:54.131 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:54.090+0000 7ff22ad44700 1 -- 172.21.15.163:0/3890703660 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7ff2140a1150 msgr2=0x7ff2140a3600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:12:54.131 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:54.090+0000 7ff22ad44700 1 --2- 172.21.15.163:0/3890703660 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7ff2140a1150 0x7ff2140a3600 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7ff224100cd0 tx=0x7ff218009260 comp rx=0 tx=0).stop 2023-07-14T18:12:54.131 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:54.090+0000 7ff22ad44700 1 -- 172.21.15.163:0/3890703660 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff224100e70 msgr2=0x7ff224195ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:12:54.131 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:54.090+0000 7ff22ad44700 1 --2- 172.21.15.163:0/3890703660 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff224100e70 0x7ff224195ec0 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7ff21000d950 tx=0x7ff21000dc60 comp rx=0 tx=0).stop 2023-07-14T18:12:54.131 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:54.090+0000 7ff22ad44700 1 -- 172.21.15.163:0/3890703660 shutdown_connections 2023-07-14T18:12:54.132 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:54.090+0000 7ff22ad44700 1 --2- 172.21.15.163:0/3890703660 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7ff2140a1150 0x7ff2140a3600 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:54.132 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:54.090+0000 7ff22ad44700 1 --2- 172.21.15.163:0/3890703660 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff2240ffc80 0x7ff224195980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:54.132 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:54.090+0000 7ff22ad44700 1 --2- 172.21.15.163:0/3890703660 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff224101800 0x7ff22419cf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:54.132 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:54.090+0000 7ff22ad44700 1 --2- 172.21.15.163:0/3890703660 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff224100e70 0x7ff224195ec0 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:54.132 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:54.090+0000 7ff22ad44700 1 -- 172.21.15.163:0/3890703660 >> 172.21.15.163:0/3890703660 conn(0x7ff2240fb2a0 msgr2=0x7ff224104360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:12:54.132 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:54.090+0000 7ff22ad44700 1 -- 172.21.15.163:0/3890703660 shutdown_connections 2023-07-14T18:12:54.132 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:54.090+0000 7ff22ad44700 1 -- 172.21.15.163:0/3890703660 wait complete. 2023-07-14T18:12:54.142 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:12:53 smithi163 ceph-mon[96576]: from='client.15612 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-07-14T18:12:54.142 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:12:53 smithi163 ceph-mon[96576]: from='client.15618 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-07-14T18:12:54.142 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:12:53 smithi163 ceph-mon[96576]: from='client.15624 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-07-14T18:12:54.143 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:12:53 smithi163 ceph-mon[96576]: from='client.? 172.21.15.163:0/1451849167' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-07-14T18:12:54.143 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:12:53 smithi163 ceph-mon[96576]: from='client.? 172.21.15.163:0/461553730' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-07-14T18:12:54.143 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:12:53 smithi163 ceph-mon[96576]: from='client.? 172.21.15.163:0/783767121' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-07-14T18:12:54.144 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-07-14T18:12:54.175 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:12:53 smithi184 ceph-mon[98481]: from='client.15612 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-07-14T18:12:54.176 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:12:53 smithi184 ceph-mon[98481]: from='client.15618 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-07-14T18:12:54.176 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:12:53 smithi184 ceph-mon[98481]: from='client.15624 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-07-14T18:12:54.176 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:12:53 smithi184 ceph-mon[98481]: from='client.? 172.21.15.163:0/1451849167' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-07-14T18:12:54.176 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:12:53 smithi184 ceph-mon[98481]: from='client.? 172.21.15.163:0/461553730' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-07-14T18:12:54.176 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:12:53 smithi184 ceph-mon[98481]: from='client.? 172.21.15.163:0/783767121' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-07-14T18:12:54.269 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:54.228+0000 7f17c60e2700 1 -- 172.21.15.163:0/2340195607 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f17c0100690 msgr2=0x7f17c0106f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:12:54.269 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:54.228+0000 7f17c60e2700 1 --2- 172.21.15.163:0/2340195607 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f17c0100690 0x7f17c0106f50 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f17b800b0a0 tx=0x7f17b800b3b0 comp rx=0 tx=0).stop 2023-07-14T18:12:54.269 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:54.228+0000 7f17c60e2700 1 -- 172.21.15.163:0/2340195607 shutdown_connections 2023-07-14T18:12:54.269 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:54.228+0000 7f17c60e2700 1 --2- 172.21.15.163:0/2340195607 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f17c0100690 0x7f17c0106f50 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:54.269 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:54.228+0000 7f17c60e2700 1 --2- 172.21.15.163:0/2340195607 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f17c00feb10 0x7f17c00fef20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:54.270 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:54.228+0000 7f17c60e2700 1 --2- 172.21.15.163:0/2340195607 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f17c00ffd00 0x7f17c0100150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:54.270 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:54.228+0000 7f17c60e2700 1 -- 172.21.15.163:0/2340195607 >> 172.21.15.163:0/2340195607 conn(0x7f17c00fa130 msgr2=0x7f17c00fc560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:12:54.270 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:54.228+0000 7f17c60e2700 1 -- 172.21.15.163:0/2340195607 shutdown_connections 2023-07-14T18:12:54.270 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:54.228+0000 7f17c60e2700 1 -- 172.21.15.163:0/2340195607 wait complete. 2023-07-14T18:12:54.270 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:54.228+0000 7f17c60e2700 1 Processor -- start 2023-07-14T18:12:54.272 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:54.229+0000 7f17c60e2700 1 -- start start 2023-07-14T18:12:54.272 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:54.229+0000 7f17c60e2700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f17c00feb10 0x7f17c01948c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:12:54.272 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:54.229+0000 7f17c60e2700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f17c00ffd00 0x7f17c0194e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:12:54.272 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:54.229+0000 7f17c60e2700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f17c0100690 0x7f17c019be70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:12:54.272 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:54.229+0000 7f17c60e2700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17c019c440 con 0x7f17c00ffd00 2023-07-14T18:12:54.272 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:54.229+0000 7f17c60e2700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17c019c580 con 0x7f17c0100690 2023-07-14T18:12:54.273 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:54.229+0000 7f17c60e2700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17c019c710 con 0x7f17c00feb10 2023-07-14T18:12:54.273 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:54.229+0000 7f17beffd700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f17c00ffd00 0x7f17c0194e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:12:54.273 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:54.229+0000 7f17beffd700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f17c00ffd00 0x7f17c0194e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:57978/0 (socket says 172.21.15.163:57978) 2023-07-14T18:12:54.273 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:54.229+0000 7f17beffd700 1 -- 172.21.15.163:0/1201243280 learned_addr learned my addr 172.21.15.163:0/1201243280 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:12:54.273 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:54.229+0000 7f17bf7fe700 1 --2- 172.21.15.163:0/1201243280 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f17c00feb10 0x7f17c01948c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:12:54.273 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:54.229+0000 7f17bffff700 1 --2- 172.21.15.163:0/1201243280 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f17c0100690 0x7f17c019be70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:12:54.273 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:54.229+0000 7f17beffd700 1 -- 172.21.15.163:0/1201243280 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f17c00feb10 msgr2=0x7f17c01948c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:12:54.273 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:54.229+0000 7f17beffd700 1 --2- 172.21.15.163:0/1201243280 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f17c00feb10 0x7f17c01948c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:54.274 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:54.229+0000 7f17beffd700 1 -- 172.21.15.163:0/1201243280 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f17c0100690 msgr2=0x7f17c019be70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:12:54.274 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:54.229+0000 7f17beffd700 1 --2- 172.21.15.163:0/1201243280 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f17c0100690 0x7f17c019be70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:54.274 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:54.229+0000 7f17beffd700 1 -- 172.21.15.163:0/1201243280 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17b8009d00 con 0x7f17c00ffd00 2023-07-14T18:12:54.274 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:54.229+0000 7f17beffd700 1 --2- 172.21.15.163:0/1201243280 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f17c00ffd00 0x7f17c0194e00 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f17a800d950 tx=0x7f17a800dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:12:54.274 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:54.230+0000 7f17bcff9700 1 -- 172.21.15.163:0/1201243280 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17a8009940 con 0x7f17c00ffd00 2023-07-14T18:12:54.274 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:54.230+0000 7f17c60e2700 1 -- 172.21.15.163:0/1201243280 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f17c019c9f0 con 0x7f17c00ffd00 2023-07-14T18:12:54.274 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:54.230+0000 7f17bcff9700 1 -- 172.21.15.163:0/1201243280 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f17a8010460 con 0x7f17c00ffd00 2023-07-14T18:12:54.275 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:54.230+0000 7f17bcff9700 1 -- 172.21.15.163:0/1201243280 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17a800f620 con 0x7f17c00ffd00 2023-07-14T18:12:54.275 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:54.230+0000 7f17c60e2700 1 -- 172.21.15.163:0/1201243280 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f17c019cf00 con 0x7f17c00ffd00 2023-07-14T18:12:54.275 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:54.231+0000 7f17c60e2700 1 -- 172.21.15.163:0/1201243280 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f17c01060c0 con 0x7f17c00ffd00 2023-07-14T18:12:54.275 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:54.232+0000 7f17bcff9700 1 -- 172.21.15.163:0/1201243280 <== mon.0 v2:172.21.15.163:3300/0 4 ==== mgrmap(e 18) v1 ==== 135716+0+0 (secure 0 0 0) 0x7f17a80105d0 con 0x7f17c00ffd00 2023-07-14T18:12:54.276 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:54.232+0000 7f17bcff9700 1 --2- 172.21.15.163:0/1201243280 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f17ac0a1150 0x7f17ac0a3600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:12:54.276 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:54.232+0000 7f17bf7fe700 1 --2- 172.21.15.163:0/1201243280 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f17ac0a1150 0x7f17ac0a3600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:12:54.276 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:54.233+0000 7f17bcff9700 1 -- 172.21.15.163:0/1201243280 <== mon.0 v2:172.21.15.163:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 9020+0+0 (secure 0 0 0) 0x7f17a80cca10 con 0x7f17c00ffd00 2023-07-14T18:12:54.276 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:54.233+0000 7f17bf7fe700 1 --2- 172.21.15.163:0/1201243280 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f17ac0a1150 0x7f17ac0a3600 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f17c00ffb60 tx=0x7f17b000b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:12:54.277 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:12:53 smithi172 ceph-mon[97983]: from='client.15612 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-07-14T18:12:54.277 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:12:53 smithi172 ceph-mon[97983]: from='client.15618 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-07-14T18:12:54.277 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:12:53 smithi172 ceph-mon[97983]: from='client.15624 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-07-14T18:12:54.277 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:12:53 smithi172 ceph-mon[97983]: from='client.? 172.21.15.163:0/1451849167' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-07-14T18:12:54.278 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:12:53 smithi172 ceph-mon[97983]: from='client.? 172.21.15.163:0/461553730' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-07-14T18:12:54.278 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:12:53 smithi172 ceph-mon[97983]: from='client.? 172.21.15.163:0/783767121' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-07-14T18:12:54.278 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:54.236+0000 7f17bcff9700 1 -- 172.21.15.163:0/1201243280 <== mon.0 v2:172.21.15.163:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178025 (secure 0 0 0) 0x7f17a8095e50 con 0x7f17c00ffd00 2023-07-14T18:12:54.466 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:54.425+0000 7f17c60e2700 1 -- 172.21.15.163:0/1201243280 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f17c002cd30 con 0x7f17c00ffd00 2023-07-14T18:12:54.466 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:54.426+0000 7f17bcff9700 1 -- 172.21.15.163:0/1201243280 <== mon.0 v2:172.21.15.163:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v86) v1 ==== 103+0+11 (secure 0 0 0) 0x7f17a8020020 con 0x7f17c00ffd00 2023-07-14T18:12:54.467 INFO:teuthology.orchestra.run.smithi163.stdout:pg_num: 32 2023-07-14T18:12:54.468 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:54.428+0000 7f17c60e2700 1 -- 172.21.15.163:0/1201243280 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f17ac0a1150 msgr2=0x7f17ac0a3600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:12:54.468 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:54.428+0000 7f17c60e2700 1 --2- 172.21.15.163:0/1201243280 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f17ac0a1150 0x7f17ac0a3600 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f17c00ffb60 tx=0x7f17b000b410 comp rx=0 tx=0).stop 2023-07-14T18:12:54.469 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:54.428+0000 7f17c60e2700 1 -- 172.21.15.163:0/1201243280 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f17c00ffd00 msgr2=0x7f17c0194e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:12:54.469 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:54.428+0000 7f17c60e2700 1 --2- 172.21.15.163:0/1201243280 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f17c00ffd00 0x7f17c0194e00 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f17a800d950 tx=0x7f17a800dc60 comp rx=0 tx=0).stop 2023-07-14T18:12:54.469 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:54.428+0000 7f17c60e2700 1 -- 172.21.15.163:0/1201243280 shutdown_connections 2023-07-14T18:12:54.469 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:54.428+0000 7f17c60e2700 1 --2- 172.21.15.163:0/1201243280 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f17ac0a1150 0x7f17ac0a3600 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:54.469 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:54.428+0000 7f17c60e2700 1 --2- 172.21.15.163:0/1201243280 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f17c00feb10 0x7f17c01948c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:54.469 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:54.428+0000 7f17c60e2700 1 --2- 172.21.15.163:0/1201243280 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f17c0100690 0x7f17c019be70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:54.470 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:54.428+0000 7f17c60e2700 1 --2- 172.21.15.163:0/1201243280 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f17c00ffd00 0x7f17c0194e00 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:54.470 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:54.428+0000 7f17c60e2700 1 -- 172.21.15.163:0/1201243280 >> 172.21.15.163:0/1201243280 conn(0x7f17c00fa130 msgr2=0x7f17c0103200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:12:54.470 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:54.428+0000 7f17c60e2700 1 -- 172.21.15.163:0/1201243280 shutdown_connections 2023-07-14T18:12:54.470 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:54.428+0000 7f17c60e2700 1 -- 172.21.15.163:0/1201243280 wait complete. 2023-07-14T18:12:54.481 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-14T18:12:54.603 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:54.562+0000 7f17d39f2700 1 -- 172.21.15.163:0/432732391 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f17cc0ffcf0 msgr2=0x7f17cc100140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:12:54.603 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:54.562+0000 7f17d39f2700 1 --2- 172.21.15.163:0/432732391 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f17cc0ffcf0 0x7f17cc100140 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f17c8009990 tx=0x7f17c8009ca0 comp rx=0 tx=0).stop 2023-07-14T18:12:54.604 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:54.562+0000 7f17d39f2700 1 -- 172.21.15.163:0/432732391 shutdown_connections 2023-07-14T18:12:54.604 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:54.562+0000 7f17d39f2700 1 --2- 172.21.15.163:0/432732391 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f17cc100680 0x7f17cc106f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:54.604 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:54.562+0000 7f17d39f2700 1 --2- 172.21.15.163:0/432732391 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f17cc0feb00 0x7f17cc0fef10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:54.604 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:54.562+0000 7f17d39f2700 1 --2- 172.21.15.163:0/432732391 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f17cc0ffcf0 0x7f17cc100140 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:54.604 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:54.562+0000 7f17d39f2700 1 -- 172.21.15.163:0/432732391 >> 172.21.15.163:0/432732391 conn(0x7f17cc0fa100 msgr2=0x7f17cc0fc550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:12:54.604 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:54.562+0000 7f17d39f2700 1 -- 172.21.15.163:0/432732391 shutdown_connections 2023-07-14T18:12:54.605 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:54.562+0000 7f17d39f2700 1 -- 172.21.15.163:0/432732391 wait complete. 2023-07-14T18:12:54.607 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:54.563+0000 7f17d39f2700 1 Processor -- start 2023-07-14T18:12:54.607 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:54.563+0000 7f17d39f2700 1 -- start start 2023-07-14T18:12:54.607 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:54.563+0000 7f17d39f2700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f17cc0feb00 0x7f17cc194800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:12:54.607 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:54.563+0000 7f17d39f2700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f17cc0ffcf0 0x7f17cc194d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:12:54.607 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:54.563+0000 7f17d39f2700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f17cc100680 0x7f17cc19bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:12:54.607 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:54.563+0000 7f17d39f2700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17cc19c380 con 0x7f17cc100680 2023-07-14T18:12:54.608 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:54.563+0000 7f17d39f2700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17cc19c4c0 con 0x7f17cc0ffcf0 2023-07-14T18:12:54.608 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:54.563+0000 7f17d39f2700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17cc19c650 con 0x7f17cc0feb00 2023-07-14T18:12:54.608 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:54.563+0000 7f17d1f8f700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f17cc100680 0x7f17cc19bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:12:54.608 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:54.563+0000 7f17d1f8f700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f17cc100680 0x7f17cc19bdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:57992/0 (socket says 172.21.15.163:57992) 2023-07-14T18:12:54.608 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:54.563+0000 7f17d1f8f700 1 -- 172.21.15.163:0/2286061345 learned_addr learned my addr 172.21.15.163:0/2286061345 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:12:54.608 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:54.563+0000 7f17d178e700 1 --2- 172.21.15.163:0/2286061345 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f17cc0feb00 0x7f17cc194800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:12:54.608 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:54.563+0000 7f17d0f8d700 1 --2- 172.21.15.163:0/2286061345 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f17cc0ffcf0 0x7f17cc194d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:12:54.609 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:54.563+0000 7f17d1f8f700 1 -- 172.21.15.163:0/2286061345 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f17cc0feb00 msgr2=0x7f17cc194800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:12:54.609 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:54.563+0000 7f17d1f8f700 1 --2- 172.21.15.163:0/2286061345 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f17cc0feb00 0x7f17cc194800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:54.609 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:54.563+0000 7f17d1f8f700 1 -- 172.21.15.163:0/2286061345 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f17cc0ffcf0 msgr2=0x7f17cc194d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:12:54.609 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:54.563+0000 7f17d1f8f700 1 --2- 172.21.15.163:0/2286061345 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f17cc0ffcf0 0x7f17cc194d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:54.609 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:54.563+0000 7f17d1f8f700 1 -- 172.21.15.163:0/2286061345 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17c80095f0 con 0x7f17cc100680 2023-07-14T18:12:54.609 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:54.563+0000 7f17d0f8d700 1 --2- 172.21.15.163:0/2286061345 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f17cc0ffcf0 0x7f17cc194d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T18:12:54.609 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:54.564+0000 7f17d1f8f700 1 --2- 172.21.15.163:0/2286061345 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f17cc100680 0x7f17cc19bdb0 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f17c400ef30 tx=0x7f17c400c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:12:54.609 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:54.564+0000 7f17c27fc700 1 -- 172.21.15.163:0/2286061345 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17c4018070 con 0x7f17cc100680 2023-07-14T18:12:54.610 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:54.564+0000 7f17c27fc700 1 -- 172.21.15.163:0/2286061345 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f17c400f040 con 0x7f17cc100680 2023-07-14T18:12:54.610 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:54.564+0000 7f17d39f2700 1 -- 172.21.15.163:0/2286061345 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f17cc19c8d0 con 0x7f17cc100680 2023-07-14T18:12:54.610 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:54.564+0000 7f17c27fc700 1 -- 172.21.15.163:0/2286061345 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17c400cc70 con 0x7f17cc100680 2023-07-14T18:12:54.610 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:54.564+0000 7f17d39f2700 1 -- 172.21.15.163:0/2286061345 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f17cc19ce30 con 0x7f17cc100680 2023-07-14T18:12:54.610 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:54.565+0000 7f17d39f2700 1 -- 172.21.15.163:0/2286061345 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f17cc1060e0 con 0x7f17cc100680 2023-07-14T18:12:54.610 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:54.566+0000 7f17c27fc700 1 -- 172.21.15.163:0/2286061345 <== mon.0 v2:172.21.15.163:3300/0 4 ==== mgrmap(e 18) v1 ==== 135716+0+0 (secure 0 0 0) 0x7f17c4007500 con 0x7f17cc100680 2023-07-14T18:12:54.610 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:54.566+0000 7f17c27fc700 1 --2- 172.21.15.163:0/2286061345 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f17b80a1220 0x7f17b80a36d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:12:54.611 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:54.567+0000 7f17c27fc700 1 -- 172.21.15.163:0/2286061345 <== mon.0 v2:172.21.15.163:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 9020+0+0 (secure 0 0 0) 0x7f17c40cc6e0 con 0x7f17cc100680 2023-07-14T18:12:54.611 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:54.567+0000 7f17d178e700 1 --2- 172.21.15.163:0/2286061345 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f17b80a1220 0x7f17b80a36d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:12:54.611 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:54.567+0000 7f17d178e700 1 --2- 172.21.15.163:0/2286061345 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f17b80a1220 0x7f17b80a36d0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f17cc0ffb50 tx=0x7f17bc00b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:12:54.611 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:54.571+0000 7f17c27fc700 1 -- 172.21.15.163:0/2286061345 <== mon.0 v2:172.21.15.163:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178025 (secure 0 0 0) 0x7f17c4095b50 con 0x7f17cc100680 2023-07-14T18:12:54.841 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:54.800+0000 7f17d39f2700 1 -- 172.21.15.163:0/2286061345 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f17cc02cd70 con 0x7f17cc100680 2023-07-14T18:12:54.841 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:54.801+0000 7f17c27fc700 1 -- 172.21.15.163:0/2286061345 <== mon.0 v2:172.21.15.163:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) v1 ==== 94+0+10901 (secure 0 0 0) 0x7f17c4099170 con 0x7f17cc100680 2023-07-14T18:12:54.842 INFO:teuthology.orchestra.run.smithi163.stdout: 2023-07-14T18:12:54.842 INFO:teuthology.orchestra.run.smithi163.stdout:{"epoch":29,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14562,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.163:6835/1058662632","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6834","nonce":1058662632},{"type":"v1","addr":"172.21.15.163:6835","nonce":1058662632}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":14568,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.163:6837/1107244425","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6836","nonce":1107244425},{"type":"v1","addr":"172.21.15.163:6837","nonce":1107244425}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":29,"flags":178,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"balance_automate":true},"ever_allowed_features":160,"explicitly_allowed_features":160,"created":"2023-07-14T18:11:09.109693+0000","modified":"2023-07-14T18:12:47.779723+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24518,"mds_1":24493,"mds_2":24479,"mds_3":24478,"mds_4":14652},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14640":{"gid":14640,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.163:6839/1337572937","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6838","nonce":1337572937},{"type":"v1","addr":"172.21.15.163:6839","nonce":1337572937}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_14652":{"gid":14652,"name":"a","rank":4,"incarnation":26,"state":"up:active","state_seq":9,"addr":"172.21.15.163:6841/1032082642","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6840","nonce":1032082642},{"type":"v1","addr":"172.21.15.163:6841","nonce":1032082642}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24421":{"gid":24421,"name":"l","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.184:6833/797722972","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6832","nonce":797722972},{"type":"v1","addr":"172.21.15.184:6833","nonce":797722972}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24431":{"gid":24431,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6833/1075696311","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":1075696311},{"type":"v1","addr":"172.21.15.172:6833","nonce":1075696311}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24458":{"gid":24458,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6835/1158120127","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":1158120127},{"type":"v1","addr":"172.21.15.172:6835","nonce":1158120127}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24466":{"gid":24466,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.184:6835/460134263","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6834","nonce":460134263},{"type":"v1","addr":"172.21.15.184:6835","nonce":460134263}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24478":{"gid":24478,"name":"c","rank":3,"incarnation":24,"state":"up:active","state_seq":11,"addr":"172.21.15.184:6837/3389277679","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6836","nonce":3389277679},{"type":"v1","addr":"172.21.15.184:6837","nonce":3389277679}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24479":{"gid":24479,"name":"h","rank":2,"incarnation":22,"state":"up:active","state_seq":10,"addr":"172.21.15.172:6837/3783835012","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":3783835012},{"type":"v1","addr":"172.21.15.172:6837","nonce":3783835012}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24493":{"gid":24493,"name":"i","rank":1,"incarnation":20,"state":"up:active","state_seq":9,"addr":"172.21.15.184:6839/2819059257","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6838","nonce":2819059257},{"type":"v1","addr":"172.21.15.184:6839","nonce":2819059257}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24518":{"gid":24518,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.172:6839/3850440096","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6838","nonce":3850440096},{"type":"v1","addr":"172.21.15.172:6839","nonce":3850440096}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-07-14T18:12:54.844 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:54.804+0000 7f17d39f2700 1 -- 172.21.15.163:0/2286061345 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f17b80a1220 msgr2=0x7f17b80a36d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:12:54.845 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:54.804+0000 7f17d39f2700 1 --2- 172.21.15.163:0/2286061345 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f17b80a1220 0x7f17b80a36d0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f17cc0ffb50 tx=0x7f17bc00b410 comp rx=0 tx=0).stop 2023-07-14T18:12:54.845 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:54.804+0000 7f17d39f2700 1 -- 172.21.15.163:0/2286061345 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f17cc100680 msgr2=0x7f17cc19bdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:12:54.845 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:54.804+0000 7f17d39f2700 1 --2- 172.21.15.163:0/2286061345 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f17cc100680 0x7f17cc19bdb0 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f17c400ef30 tx=0x7f17c400c3a0 comp rx=0 tx=0).stop 2023-07-14T18:12:54.845 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:54.804+0000 7f17d39f2700 1 -- 172.21.15.163:0/2286061345 shutdown_connections 2023-07-14T18:12:54.845 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:54.804+0000 7f17d39f2700 1 --2- 172.21.15.163:0/2286061345 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f17b80a1220 0x7f17b80a36d0 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:54.845 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:54.804+0000 7f17d39f2700 1 --2- 172.21.15.163:0/2286061345 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f17cc0feb00 0x7f17cc194800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:54.846 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:54.804+0000 7f17d39f2700 1 --2- 172.21.15.163:0/2286061345 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f17cc100680 0x7f17cc19bdb0 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:54.846 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:54.804+0000 7f17d39f2700 1 --2- 172.21.15.163:0/2286061345 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f17cc0ffcf0 0x7f17cc194d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:54.846 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:54.804+0000 7f17d39f2700 1 -- 172.21.15.163:0/2286061345 >> 172.21.15.163:0/2286061345 conn(0x7f17cc0fa100 msgr2=0x7f17cc103220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:12:54.846 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:54.804+0000 7f17d39f2700 1 -- 172.21.15.163:0/2286061345 shutdown_connections 2023-07-14T18:12:54.846 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:54.804+0000 7f17d39f2700 1 -- 172.21.15.163:0/2286061345 wait complete. 2023-07-14T18:12:54.847 INFO:teuthology.orchestra.run.smithi163.stderr:dumped fsmap epoch 29 2023-07-14T18:12:54.857 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-14T18:12:54.982 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:54.938+0000 7f310f429700 1 -- 172.21.15.163:0/2858108159 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f31080ffcf0 msgr2=0x7f3108100140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:12:54.983 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:54.938+0000 7f310f429700 1 --2- 172.21.15.163:0/2858108159 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f31080ffcf0 0x7f3108100140 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f30f8009990 tx=0x7f30f8009ca0 comp rx=0 tx=0).stop 2023-07-14T18:12:54.983 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:54.938+0000 7f310f429700 1 -- 172.21.15.163:0/2858108159 shutdown_connections 2023-07-14T18:12:54.983 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:54.938+0000 7f310f429700 1 --2- 172.21.15.163:0/2858108159 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f31080feb00 0x7f31080fef10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:54.983 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:54.938+0000 7f310f429700 1 --2- 172.21.15.163:0/2858108159 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3108100680 0x7f3108106f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:54.983 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:54.938+0000 7f310f429700 1 --2- 172.21.15.163:0/2858108159 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f31080ffcf0 0x7f3108100140 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:54.984 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:54.938+0000 7f310f429700 1 -- 172.21.15.163:0/2858108159 >> 172.21.15.163:0/2858108159 conn(0x7f31080fa100 msgr2=0x7f31080fc550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:12:54.984 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:54.938+0000 7f310f429700 1 -- 172.21.15.163:0/2858108159 shutdown_connections 2023-07-14T18:12:54.984 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:54.938+0000 7f310f429700 1 -- 172.21.15.163:0/2858108159 wait complete. 2023-07-14T18:12:54.984 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:54.939+0000 7f310f429700 1 Processor -- start 2023-07-14T18:12:54.984 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:54.939+0000 7f310f429700 1 -- start start 2023-07-14T18:12:54.984 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:54.939+0000 7f310f429700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f31080feb00 0x7f31081946a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:12:54.984 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:54.939+0000 7f310f429700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f31080ffcf0 0x7f3108194be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:12:54.985 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:54.939+0000 7f310f429700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f3108100680 0x7f310819bc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:12:54.985 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:54.939+0000 7f310f429700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f310819c220 con 0x7f3108100680 2023-07-14T18:12:54.985 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:54.939+0000 7f310f429700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f310819c360 con 0x7f31080feb00 2023-07-14T18:12:54.985 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:54.939+0000 7f310f429700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f310819c4f0 con 0x7f31080ffcf0 2023-07-14T18:12:54.985 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:54.939+0000 7f310d9c6700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f3108100680 0x7f310819bc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:12:54.985 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:54.939+0000 7f310d9c6700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f3108100680 0x7f310819bc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:58006/0 (socket says 172.21.15.163:58006) 2023-07-14T18:12:54.986 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:54.939+0000 7f310d9c6700 1 -- 172.21.15.163:0/3803137168 learned_addr learned my addr 172.21.15.163:0/3803137168 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:12:54.986 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:54.939+0000 7f310d1c5700 1 --2- 172.21.15.163:0/3803137168 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f31080feb00 0x7f31081946a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:12:54.986 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:54.939+0000 7f310c9c4700 1 --2- 172.21.15.163:0/3803137168 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f31080ffcf0 0x7f3108194be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:12:54.986 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:54.939+0000 7f310d9c6700 1 -- 172.21.15.163:0/3803137168 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f31080ffcf0 msgr2=0x7f3108194be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:12:54.986 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:54.939+0000 7f310d9c6700 1 --2- 172.21.15.163:0/3803137168 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f31080ffcf0 0x7f3108194be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:54.986 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:54.939+0000 7f310d9c6700 1 -- 172.21.15.163:0/3803137168 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f31080feb00 msgr2=0x7f31081946a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:12:54.986 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:54.939+0000 7f310d9c6700 1 --2- 172.21.15.163:0/3803137168 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f31080feb00 0x7f31081946a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:54.987 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:54.939+0000 7f310d9c6700 1 -- 172.21.15.163:0/3803137168 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30f80095f0 con 0x7f3108100680 2023-07-14T18:12:54.987 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:54.940+0000 7f310d9c6700 1 --2- 172.21.15.163:0/3803137168 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f3108100680 0x7f310819bc50 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f310000efb0 tx=0x7f310000c550 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:12:54.987 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:54.940+0000 7f30fe7fc700 1 -- 172.21.15.163:0/3803137168 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3100011670 con 0x7f3108100680 2023-07-14T18:12:54.987 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:54.940+0000 7f30fe7fc700 1 -- 172.21.15.163:0/3803137168 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f310000ce20 con 0x7f3108100680 2023-07-14T18:12:54.987 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:54.940+0000 7f310f429700 1 -- 172.21.15.163:0/3803137168 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3108067800 con 0x7f3108100680 2023-07-14T18:12:54.988 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:54.940+0000 7f30fe7fc700 1 -- 172.21.15.163:0/3803137168 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f310001aaa0 con 0x7f3108100680 2023-07-14T18:12:54.988 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:54.940+0000 7f310f429700 1 -- 172.21.15.163:0/3803137168 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3108067cc0 con 0x7f3108100680 2023-07-14T18:12:54.988 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:54.941+0000 7f310f429700 1 -- 172.21.15.163:0/3803137168 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f310810a180 con 0x7f3108100680 2023-07-14T18:12:54.988 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:54.942+0000 7f30fe7fc700 1 -- 172.21.15.163:0/3803137168 <== mon.0 v2:172.21.15.163:3300/0 4 ==== mgrmap(e 18) v1 ==== 135716+0+0 (secure 0 0 0) 0x7f3100004ad0 con 0x7f3108100680 2023-07-14T18:12:54.990 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:54.942+0000 7f30fe7fc700 1 --2- 172.21.15.163:0/3803137168 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f30f40a11a0 0x7f30f40a3650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:12:54.991 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:54.942+0000 7f30fe7fc700 1 -- 172.21.15.163:0/3803137168 <== mon.0 v2:172.21.15.163:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 9020+0+0 (secure 0 0 0) 0x7f31000cf710 con 0x7f3108100680 2023-07-14T18:12:54.991 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:54.942+0000 7f310d1c5700 1 --2- 172.21.15.163:0/3803137168 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f30f40a11a0 0x7f30f40a3650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:12:54.991 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:54.943+0000 7f310d1c5700 1 --2- 172.21.15.163:0/3803137168 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f30f40a11a0 0x7f30f40a3650 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f31080ffb50 tx=0x7f310400b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:12:54.992 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:54.946+0000 7f30fe7fc700 1 -- 172.21.15.163:0/3803137168 <== mon.0 v2:172.21.15.163:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178025 (secure 0 0 0) 0x7f3100098be0 con 0x7f3108100680 2023-07-14T18:12:55.175 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:12:54 smithi184 ceph-mon[98481]: pgmap v305: 129 pgs: 129 active+clean; 650 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 1.7 KiB/s wr, 13 op/s 2023-07-14T18:12:55.176 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:12:54 smithi184 ceph-mon[98481]: from='client.? 172.21.15.163:0/3890703660' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-07-14T18:12:55.176 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:12:54 smithi184 ceph-mon[98481]: from='client.? 172.21.15.163:0/1201243280' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2023-07-14T18:12:55.176 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:55.135+0000 7f310f429700 1 -- 172.21.15.163:0/3803137168 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f310810a340 con 0x7f3108100680 2023-07-14T18:12:55.177 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:55.137+0000 7f30fe7fc700 1 -- 172.21.15.163:0/3803137168 <== mon.0 v2:172.21.15.163:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v86) v1 ==== 74+0+24500 (secure 0 0 0) 0x7f310009c200 con 0x7f3108100680 2023-07-14T18:12:55.178 INFO:teuthology.orchestra.run.smithi163.stdout: 2023-07-14T18:12:55.178 INFO:teuthology.orchestra.run.smithi163.stdout:{"epoch":86,"fsid":"bf7326ec-2270-11ee-9b33-001a4aab830c","created":"2023-07-14T18:04:26.263517+0000","modified":"2023-07-14T18:12:16.776609+0000","last_up_change":"2023-07-14T18:10:27.514863+0000","last_in_change":"2023-07-14T18:10:10.726443+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-14T18:07:19.653852+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-07-14T18:11:07.314989+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-07-14T18:11:08.274627+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-07-14T18:11:11.991162+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"e6490568-046d-43ef-bb07-d79fb884b276","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6802","nonce":3124653025},{"type":"v1","addr":"172.21.15.163:6803","nonce":3124653025}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6804","nonce":3124653025},{"type":"v1","addr":"172.21.15.163:6805","nonce":3124653025}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6808","nonce":3124653025},{"type":"v1","addr":"172.21.15.163:6809","nonce":3124653025}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6806","nonce":3124653025},{"type":"v1","addr":"172.21.15.163:6807","nonce":3124653025}]},"public_addr":"172.21.15.163:6803/3124653025","cluster_addr":"172.21.15.163:6805/3124653025","heartbeat_back_addr":"172.21.15.163:6809/3124653025","heartbeat_front_addr":"172.21.15.163:6807/3124653025","state":["exists","up"]},{"osd":1,"uuid":"0af39bda-f096-4603-adcc-bf1988f36603","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":3774455900},{"type":"v1","addr":"172.21.15.172:6801","nonce":3774455900}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":3774455900},{"type":"v1","addr":"172.21.15.172:6803","nonce":3774455900}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":3774455900},{"type":"v1","addr":"172.21.15.172:6807","nonce":3774455900}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":3774455900},{"type":"v1","addr":"172.21.15.172:6805","nonce":3774455900}]},"public_addr":"172.21.15.172:6801/3774455900","cluster_addr":"172.21.15.172:6803/3774455900","heartbeat_back_addr":"172.21.15.172:6807/3774455900","heartbeat_front_addr":"172.21.15.172:6805/3774455900","state":["exists","up"]},{"osd":2,"uuid":"cc732c13-af0f-4199-98e6-fe960ed4e5dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":1976927678},{"type":"v1","addr":"172.21.15.184:6801","nonce":1976927678}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":1976927678},{"type":"v1","addr":"172.21.15.184:6803","nonce":1976927678}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":1976927678},{"type":"v1","addr":"172.21.15.184:6807","nonce":1976927678}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":1976927678},{"type":"v1","addr":"172.21.15.184:6805","nonce":1976927678}]},"public_addr":"172.21.15.184:6801/1976927678","cluster_addr":"172.21.15.184:6803/1976927678","heartbeat_back_addr":"172.21.15.184:6807/1976927678","heartbeat_front_addr":"172.21.15.184:6805/1976927678","state":["exists","up"]},{"osd":3,"uuid":"dcee9576-0bc6-4ab0-8f63-79eacd0eca5f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6810","nonce":2589130694},{"type":"v1","addr":"172.21.15.163:6811","nonce":2589130694}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6812","nonce":2589130694},{"type":"v1","addr":"172.21.15.163:6813","nonce":2589130694}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6816","nonce":2589130694},{"type":"v1","addr":"172.21.15.163:6817","nonce":2589130694}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6814","nonce":2589130694},{"type":"v1","addr":"172.21.15.163:6815","nonce":2589130694}]},"public_addr":"172.21.15.163:6811/2589130694","cluster_addr":"172.21.15.163:6813/2589130694","heartbeat_back_addr":"172.21.15.163:6817/2589130694","heartbeat_front_addr":"172.21.15.163:6815/2589130694","state":["exists","up"]},{"osd":4,"uuid":"055df823-b8b0-426a-83c2-f0d727932ad8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":3319632614},{"type":"v1","addr":"172.21.15.172:6809","nonce":3319632614}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6810","nonce":3319632614},{"type":"v1","addr":"172.21.15.172:6811","nonce":3319632614}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6814","nonce":3319632614},{"type":"v1","addr":"172.21.15.172:6815","nonce":3319632614}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":3319632614},{"type":"v1","addr":"172.21.15.172:6813","nonce":3319632614}]},"public_addr":"172.21.15.172:6809/3319632614","cluster_addr":"172.21.15.172:6811/3319632614","heartbeat_back_addr":"172.21.15.172:6815/3319632614","heartbeat_front_addr":"172.21.15.172:6813/3319632614","state":["exists","up"]},{"osd":5,"uuid":"ef5ef02a-b4e2-4790-9d27-f6d2247b25c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":2662084043},{"type":"v1","addr":"172.21.15.184:6809","nonce":2662084043}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6810","nonce":2662084043},{"type":"v1","addr":"172.21.15.184:6811","nonce":2662084043}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6814","nonce":2662084043},{"type":"v1","addr":"172.21.15.184:6815","nonce":2662084043}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6812","nonce":2662084043},{"type":"v1","addr":"172.21.15.184:6813","nonce":2662084043}]},"public_addr":"172.21.15.184:6809/2662084043","cluster_addr":"172.21.15.184:6811/2662084043","heartbeat_back_addr":"172.21.15.184:6815/2662084043","heartbeat_front_addr":"172.21.15.184:6813/2662084043","state":["exists","up"]},{"osd":6,"uuid":"dba754be-0fc5-4867-a6d5-cf97eb344f81","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":44,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6818","nonce":2530874117},{"type":"v1","addr":"172.21.15.163:6819","nonce":2530874117}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6820","nonce":2530874117},{"type":"v1","addr":"172.21.15.163:6821","nonce":2530874117}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6824","nonce":2530874117},{"type":"v1","addr":"172.21.15.163:6825","nonce":2530874117}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6822","nonce":2530874117},{"type":"v1","addr":"172.21.15.163:6823","nonce":2530874117}]},"public_addr":"172.21.15.163:6819/2530874117","cluster_addr":"172.21.15.163:6821/2530874117","heartbeat_back_addr":"172.21.15.163:6825/2530874117","heartbeat_front_addr":"172.21.15.163:6823/2530874117","state":["exists","up"]},{"osd":7,"uuid":"edd76e6b-6077-4619-b00d-1e906f70ddcc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":49,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":233511803},{"type":"v1","addr":"172.21.15.172:6817","nonce":233511803}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6818","nonce":233511803},{"type":"v1","addr":"172.21.15.172:6819","nonce":233511803}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":233511803},{"type":"v1","addr":"172.21.15.172:6823","nonce":233511803}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6820","nonce":233511803},{"type":"v1","addr":"172.21.15.172:6821","nonce":233511803}]},"public_addr":"172.21.15.172:6817/233511803","cluster_addr":"172.21.15.172:6819/233511803","heartbeat_back_addr":"172.21.15.172:6823/233511803","heartbeat_front_addr":"172.21.15.172:6821/233511803","state":["exists","up"]},{"osd":8,"uuid":"36559400-f33e-44e6-868a-316d34da457d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":56,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6816","nonce":290154343},{"type":"v1","addr":"172.21.15.184:6817","nonce":290154343}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6818","nonce":290154343},{"type":"v1","addr":"172.21.15.184:6819","nonce":290154343}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6822","nonce":290154343},{"type":"v1","addr":"172.21.15.184:6823","nonce":290154343}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6820","nonce":290154343},{"type":"v1","addr":"172.21.15.184:6821","nonce":290154343}]},"public_addr":"172.21.15.184:6817/290154343","cluster_addr":"172.21.15.184:6819/290154343","heartbeat_back_addr":"172.21.15.184:6823/290154343","heartbeat_front_addr":"172.21.15.184:6821/290154343","state":["exists","up"]},{"osd":9,"uuid":"d484f111-f36c-4c67-9a8a-ae03e7e0d137","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6826","nonce":3848110906},{"type":"v1","addr":"172.21.15.163:6827","nonce":3848110906}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6828","nonce":3848110906},{"type":"v1","addr":"172.21.15.163:6829","nonce":3848110906}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6832","nonce":3848110906},{"type":"v1","addr":"172.21.15.163:6833","nonce":3848110906}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6830","nonce":3848110906},{"type":"v1","addr":"172.21.15.163:6831","nonce":3848110906}]},"public_addr":"172.21.15.163:6827/3848110906","cluster_addr":"172.21.15.163:6829/3848110906","heartbeat_back_addr":"172.21.15.163:6833/3848110906","heartbeat_front_addr":"172.21.15.163:6831/3848110906","state":["exists","up"]},{"osd":10,"uuid":"d943f7c0-da3d-4605-9e23-0231e675c6be","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6824","nonce":3281085356},{"type":"v1","addr":"172.21.15.172:6825","nonce":3281085356}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":3281085356},{"type":"v1","addr":"172.21.15.172:6827","nonce":3281085356}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":3281085356},{"type":"v1","addr":"172.21.15.172:6831","nonce":3281085356}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6828","nonce":3281085356},{"type":"v1","addr":"172.21.15.172:6829","nonce":3281085356}]},"public_addr":"172.21.15.172:6825/3281085356","cluster_addr":"172.21.15.172:6827/3281085356","heartbeat_back_addr":"172.21.15.172:6831/3281085356","heartbeat_front_addr":"172.21.15.172:6829/3281085356","state":["exists","up"]},{"osd":11,"uuid":"09e610a8-408a-4119-a21b-c4de2810a538","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":75,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6824","nonce":3614578747},{"type":"v1","addr":"172.21.15.184:6825","nonce":3614578747}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6826","nonce":3614578747},{"type":"v1","addr":"172.21.15.184:6827","nonce":3614578747}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6830","nonce":3614578747},{"type":"v1","addr":"172.21.15.184:6831","nonce":3614578747}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6828","nonce":3614578747},{"type":"v1","addr":"172.21.15.184:6829","nonce":3614578747}]},"public_addr":"172.21.15.184:6825/3614578747","cluster_addr":"172.21.15.184:6827/3614578747","heartbeat_back_addr":"172.21.15.184:6831/3614578747","heartbeat_front_addr":"172.21.15.184:6829/3614578747","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T18:06:36.067578+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T18:06:57.095120+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T18:07:17.825363+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T18:07:38.977196+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T18:08:00.108709+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T18:08:20.700646+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T18:08:41.473899+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T18:09:02.856536+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T18:09:23.832722+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T18:09:44.860884+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T18:10:05.520678+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T18:10:26.426315+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.8","mappings":[{"from":2,"to":11}]},{"pgid":"3.1","mappings":[{"from":4,"to":9}]},{"pgid":"3.6","mappings":[{"from":4,"to":6}]},{"pgid":"3.25","mappings":[{"from":5,"to":9}]},{"pgid":"3.27","mappings":[{"from":4,"to":8}]},{"pgid":"3.2d","mappings":[{"from":3,"to":9}]},{"pgid":"4.a","mappings":[{"from":5,"to":8}]},{"pgid":"4.12","mappings":[{"from":9,"to":10}]},{"pgid":"4.14","mappings":[{"from":9,"to":8}]},{"pgid":"4.17","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.163:6801/1086512093":"2023-07-15T18:05:15.331458+0000","172.21.15.163:6800/1086512093":"2023-07-15T18:05:15.331458+0000","172.21.15.163:0/4235784810":"2023-07-15T18:05:15.331458+0000","172.21.15.163:6800/236891232":"2023-07-15T18:04:53.288443+0000","172.21.15.163:6801/236891232":"2023-07-15T18:04:53.288443+0000","172.21.15.163:0/3260193612":"2023-07-15T18:05:15.331458+0000","172.21.15.163:0/3513629472":"2023-07-15T18:04:53.288443+0000","172.21.15.163:0/1090329830":"2023-07-15T18:04:53.288443+0000","172.21.15.163:0/3868922045":"2023-07-15T18:05:15.331458+0000","172.21.15.163:0/2945662447":"2023-07-15T18:04:53.288443+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-14T18:12:55.180 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:55.139+0000 7f310f429700 1 -- 172.21.15.163:0/3803137168 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f30f40a11a0 msgr2=0x7f30f40a3650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:12:55.180 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:55.139+0000 7f310f429700 1 --2- 172.21.15.163:0/3803137168 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f30f40a11a0 0x7f30f40a3650 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f31080ffb50 tx=0x7f310400b410 comp rx=0 tx=0).stop 2023-07-14T18:12:55.180 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:55.139+0000 7f310f429700 1 -- 172.21.15.163:0/3803137168 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f3108100680 msgr2=0x7f310819bc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:12:55.180 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:55.139+0000 7f310f429700 1 --2- 172.21.15.163:0/3803137168 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f3108100680 0x7f310819bc50 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f310000efb0 tx=0x7f310000c550 comp rx=0 tx=0).stop 2023-07-14T18:12:55.180 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:55.139+0000 7f310f429700 1 -- 172.21.15.163:0/3803137168 shutdown_connections 2023-07-14T18:12:55.180 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:55.139+0000 7f310f429700 1 --2- 172.21.15.163:0/3803137168 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f30f40a11a0 0x7f30f40a3650 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:55.181 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:55.139+0000 7f310f429700 1 --2- 172.21.15.163:0/3803137168 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f3108100680 0x7f310819bc50 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:55.181 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:55.139+0000 7f310f429700 1 --2- 172.21.15.163:0/3803137168 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f31080feb00 0x7f31081946a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:55.181 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:55.139+0000 7f310f429700 1 --2- 172.21.15.163:0/3803137168 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f31080ffcf0 0x7f3108194be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:55.181 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:55.139+0000 7f310f429700 1 -- 172.21.15.163:0/3803137168 >> 172.21.15.163:0/3803137168 conn(0x7f31080fa100 msgr2=0x7f31081031b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:12:55.181 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:55.139+0000 7f310f429700 1 -- 172.21.15.163:0/3803137168 shutdown_connections 2023-07-14T18:12:55.181 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:55.139+0000 7f310f429700 1 -- 172.21.15.163:0/3803137168 wait complete. 2023-07-14T18:12:55.191 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:12:54 smithi163 ceph-mon[96576]: pgmap v305: 129 pgs: 129 active+clean; 650 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 1.7 KiB/s wr, 13 op/s 2023-07-14T18:12:55.191 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:12:54 smithi163 ceph-mon[96576]: from='client.? 172.21.15.163:0/3890703660' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-07-14T18:12:55.191 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:12:54 smithi163 ceph-mon[96576]: from='client.? 172.21.15.163:0/1201243280' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2023-07-14T18:12:55.193 DEBUG:tasks.fwd_scrub:Yielding 2023-07-14T18:12:55.193 INFO:teuthology.run_tasks:Running task workunit... 2023-07-14T18:12:55.208 INFO:tasks.workunit:Pulling workunits from ref 81c9387d2e7576da065747ec9c16d1c7d69016ec 2023-07-14T18:12:55.209 INFO:tasks.workunit:Making a separate scratch dir for every client... 2023-07-14T18:12:55.209 INFO:tasks.workunit:timeout=3h 2023-07-14T18:12:55.210 INFO:tasks.workunit:cleanup=True 2023-07-14T18:12:55.211 DEBUG:teuthology.orchestra.run.smithi163:> stat -- /home/ubuntu/cephtest/mnt.0 2023-07-14T18:12:55.212 INFO:tasks.fwd_scrub.fs.[cephfs]:start scrubbing fs: cephfs 2023-07-14T18:12:55.212 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2023-07-14T18:12:55.213 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2023-07-14T18:12:55.230 INFO:teuthology.orchestra.run.smithi163.stdout: File: /home/ubuntu/cephtest/mnt.0 2023-07-14T18:12:55.230 INFO:teuthology.orchestra.run.smithi163.stdout: Size: 0 Blocks: 1 IO Block: 4194304 directory 2023-07-14T18:12:55.230 INFO:teuthology.orchestra.run.smithi163.stdout:Device: 7ch/124d Inode: 1 Links: 2 2023-07-14T18:12:55.231 INFO:teuthology.orchestra.run.smithi163.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2023-07-14T18:12:55.231 INFO:teuthology.orchestra.run.smithi163.stdout:Context: system_u:object_r:fusefs_t:s0 2023-07-14T18:12:55.231 INFO:teuthology.orchestra.run.smithi163.stdout:Access: 2023-07-14 18:11:30.769809147 +0000 2023-07-14T18:12:55.231 INFO:teuthology.orchestra.run.smithi163.stdout:Modify: 2023-07-14 18:11:30.769809147 +0000 2023-07-14T18:12:55.231 INFO:teuthology.orchestra.run.smithi163.stdout:Change: 2023-07-14 18:12:47.215062456 +0000 2023-07-14T18:12:55.231 INFO:teuthology.orchestra.run.smithi163.stdout: Birth: - 2023-07-14T18:12:55.231 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.0 2023-07-14T18:12:55.232 DEBUG:teuthology.orchestra.run.smithi163:> cd -- /home/ubuntu/cephtest/mnt.0 && sudo install -d -m 0755 --owner=ubuntu -- client.0 2023-07-14T18:12:55.276 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:12:54 smithi172 ceph-mon[97983]: pgmap v305: 129 pgs: 129 active+clean; 650 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 1.7 KiB/s wr, 13 op/s 2023-07-14T18:12:55.277 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:12:54 smithi172 ceph-mon[97983]: from='client.? 172.21.15.163:0/3890703660' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-07-14T18:12:55.277 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:12:54 smithi172 ceph-mon[97983]: from='client.? 172.21.15.163:0/1201243280' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2023-07-14T18:12:55.304 DEBUG:teuthology.orchestra.run.smithi163:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 81c9387d2e7576da065747ec9c16d1c7d69016ec 2023-07-14T18:12:55.343 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:55.302+0000 7ffaf291b700 1 -- 172.21.15.163:0/1598017883 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ffaec100690 msgr2=0x7ffaec106f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:12:55.344 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:55.302+0000 7ffaf291b700 1 --2- 172.21.15.163:0/1598017883 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ffaec100690 0x7ffaec106f50 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7ffae400b0a0 tx=0x7ffae400b3b0 comp rx=0 tx=0).stop 2023-07-14T18:12:55.344 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:55.302+0000 7ffaf291b700 1 -- 172.21.15.163:0/1598017883 shutdown_connections 2023-07-14T18:12:55.344 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:55.302+0000 7ffaf291b700 1 --2- 172.21.15.163:0/1598017883 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ffaec100690 0x7ffaec106f50 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:55.344 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:55.302+0000 7ffaf291b700 1 --2- 172.21.15.163:0/1598017883 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ffaec0feb10 0x7ffaec0fef20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:55.344 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:55.302+0000 7ffaf291b700 1 --2- 172.21.15.163:0/1598017883 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ffaec0ffd00 0x7ffaec100150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:55.344 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:55.302+0000 7ffaf291b700 1 -- 172.21.15.163:0/1598017883 >> 172.21.15.163:0/1598017883 conn(0x7ffaec0fa130 msgr2=0x7ffaec0fc560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:12:55.345 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:55.302+0000 7ffaf291b700 1 -- 172.21.15.163:0/1598017883 shutdown_connections 2023-07-14T18:12:55.345 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:55.302+0000 7ffaf291b700 1 -- 172.21.15.163:0/1598017883 wait complete. 2023-07-14T18:12:55.345 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:55.303+0000 7ffaf291b700 1 Processor -- start 2023-07-14T18:12:55.345 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:55.303+0000 7ffaf291b700 1 -- start start 2023-07-14T18:12:55.346 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:55.303+0000 7ffaf291b700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ffaec0feb10 0x7ffaec068330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:12:55.346 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:55.303+0000 7ffaf291b700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ffaec0ffd00 0x7ffaec19a6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:12:55.347 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:55.303+0000 7ffaf291b700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ffaec100690 0x7ffaec19cd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:12:55.347 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:55.303+0000 7ffaf291b700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffaec19d4f0 con 0x7ffaec0feb10 2023-07-14T18:12:55.347 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:55.303+0000 7ffaf291b700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffaec19d660 con 0x7ffaec0ffd00 2023-07-14T18:12:55.347 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:55.303+0000 7ffaf291b700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffaec19d820 con 0x7ffaec100690 2023-07-14T18:12:55.347 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:55.303+0000 7ffaebfff700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ffaec0feb10 0x7ffaec068330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:12:55.347 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:55.303+0000 7ffaebfff700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ffaec0feb10 0x7ffaec068330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:58016/0 (socket says 172.21.15.163:58016) 2023-07-14T18:12:55.348 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:55.303+0000 7ffaebfff700 1 -- 172.21.15.163:0/2294377245 learned_addr learned my addr 172.21.15.163:0/2294377245 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:12:55.348 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:55.303+0000 7ffaeb7fe700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ffaec0ffd00 0x7ffaec19a6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:12:55.348 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:55.303+0000 7ffaf0eb8700 1 --2- 172.21.15.163:0/2294377245 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ffaec100690 0x7ffaec19cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:12:55.348 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:55.303+0000 7ffaebfff700 1 -- 172.21.15.163:0/2294377245 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ffaec100690 msgr2=0x7ffaec19cd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:12:55.348 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:55.303+0000 7ffaebfff700 1 --2- 172.21.15.163:0/2294377245 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ffaec100690 0x7ffaec19cd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:55.348 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:55.303+0000 7ffaebfff700 1 -- 172.21.15.163:0/2294377245 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ffaec0ffd00 msgr2=0x7ffaec19a6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:12:55.349 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:55.303+0000 7ffaebfff700 1 --2- 172.21.15.163:0/2294377245 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ffaec0ffd00 0x7ffaec19a6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:55.349 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:55.303+0000 7ffaebfff700 1 -- 172.21.15.163:0/2294377245 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffae4009d00 con 0x7ffaec0feb10 2023-07-14T18:12:55.349 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:55.304+0000 7ffaebfff700 1 --2- 172.21.15.163:0/2294377245 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ffaec0feb10 0x7ffaec068330 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7ffadc00e970 tx=0x7ffadc00ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:12:55.349 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:55.304+0000 7ffae97fa700 1 -- 172.21.15.163:0/2294377245 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffadc009790 con 0x7ffaec0feb10 2023-07-14T18:12:55.349 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:55.304+0000 7ffae97fa700 1 -- 172.21.15.163:0/2294377245 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ffadc00c7e0 con 0x7ffaec0feb10 2023-07-14T18:12:55.349 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:55.304+0000 7ffae97fa700 1 -- 172.21.15.163:0/2294377245 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffadc003bd0 con 0x7ffaec0feb10 2023-07-14T18:12:55.350 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:55.304+0000 7ffaf291b700 1 -- 172.21.15.163:0/2294377245 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffaec19db00 con 0x7ffaec0feb10 2023-07-14T18:12:55.350 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:55.304+0000 7ffaf291b700 1 -- 172.21.15.163:0/2294377245 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffaec19e010 con 0x7ffaec0feb10 2023-07-14T18:12:55.354 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:55.308+0000 7ffafeab3b80 1 Processor -- start 2023-07-14T18:12:55.355 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:55.308+0000 7ffafeab3b80 1 -- start start 2023-07-14T18:12:55.355 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:55.308+0000 7ffafeab3b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e846668fe0 0x55e8466693f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:12:55.355 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:55.308+0000 7ffafeab3b80 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e846669930 0x55e846669f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:12:55.355 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:55.308+0000 7ffafeab3b80 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55e84666a530 0x55e84666a9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:12:55.355 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:55.308+0000 7ffafeab3b80 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e84656dd30 con 0x55e84666a530 2023-07-14T18:12:55.355 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:55.308+0000 7ffafeab3b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e8465c0ac0 con 0x55e846668fe0 2023-07-14T18:12:55.356 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:55.308+0000 7ffafeab3b80 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e8465b9f50 con 0x55e846669930 2023-07-14T18:12:55.356 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:55.308+0000 7ffaeb7fe700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55e84666a530 0x55e84666a9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:12:55.356 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:55.308+0000 7ffaeb7fe700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55e84666a530 0x55e84666a9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:58024/0 (socket says 172.21.15.163:58024) 2023-07-14T18:12:55.356 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:55.308+0000 7ffaeb7fe700 1 -- 172.21.15.163:0/3387668765 learned_addr learned my addr 172.21.15.163:0/3387668765 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:12:55.356 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:55.308+0000 7ffaf0eb8700 1 --2- 172.21.15.163:0/3387668765 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e846668fe0 0x55e8466693f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:12:55.356 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:55.308+0000 7ffaeb7fe700 1 -- 172.21.15.163:0/3387668765 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e846669930 msgr2=0x55e846669f50 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-07-14T18:12:55.356 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:55.308+0000 7ffaeb7fe700 1 --2- 172.21.15.163:0/3387668765 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e846669930 0x55e846669f50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:55.357 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:55.308+0000 7ffaeb7fe700 1 -- 172.21.15.163:0/3387668765 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e846668fe0 msgr2=0x55e8466693f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:12:55.357 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:55.308+0000 7ffaeb7fe700 1 --2- 172.21.15.163:0/3387668765 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e846668fe0 0x55e8466693f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:55.357 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:55.308+0000 7ffaeb7fe700 1 -- 172.21.15.163:0/3387668765 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e8463e7e60 con 0x55e84666a530 2023-07-14T18:12:55.357 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:55.308+0000 7ffaf0eb8700 1 --2- 172.21.15.163:0/3387668765 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e846668fe0 0x55e8466693f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T18:12:55.357 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:55.309+0000 7ffaeb7fe700 1 --2- 172.21.15.163:0/3387668765 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55e84666a530 0x55e84666a9a0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7ffae000bd30 tx=0x7ffae00106b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6bfcd36f1748a219 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:12:55.357 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:55.309+0000 7ffae97fa700 1 -- 172.21.15.163:0/2294377245 <== mon.0 v2:172.21.15.163:3300/0 4 ==== mgrmap(e 18) v1 ==== 135716+0+0 (secure 0 0 0) 0x7ffadc00c950 con 0x7ffaec0feb10 2023-07-14T18:12:55.358 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:55.309+0000 7ffad27fc700 1 -- 172.21.15.163:0/3387668765 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffae0010ec0 con 0x55e84666a530 2023-07-14T18:12:55.358 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:55.309+0000 7ffad27fc700 1 -- 172.21.15.163:0/3387668765 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ffae0015070 con 0x55e84666a530 2023-07-14T18:12:55.358 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:55.309+0000 7ffad27fc700 1 -- 172.21.15.163:0/3387668765 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffae0003e00 con 0x55e84666a530 2023-07-14T18:12:55.358 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:55.309+0000 7ffae97fa700 1 --2- 172.21.15.163:0/2294377245 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7ffad40a11d0 0x7ffad40a3680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:12:55.358 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:55.309+0000 7ffaf0eb8700 1 --2- 172.21.15.163:0/2294377245 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7ffad40a11d0 0x7ffad40a3680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:12:55.358 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:55.309+0000 7ffae97fa700 1 -- 172.21.15.163:0/2294377245 <== mon.0 v2:172.21.15.163:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 9020+0+0 (secure 0 0 0) 0x7ffadc014070 con 0x7ffaec0feb10 2023-07-14T18:12:55.358 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:55.309+0000 7ffafeab3b80 1 -- 172.21.15.163:0/3387668765 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55e84666a530 msgr2=0x55e84666a9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:12:55.359 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:55.309+0000 7ffafeab3b80 1 --2- 172.21.15.163:0/3387668765 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55e84666a530 0x55e84666a9a0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7ffae000bd30 tx=0x7ffae00106b0 comp rx=0 tx=0).stop 2023-07-14T18:12:55.359 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:55.310+0000 7ffafeab3b80 1 -- 172.21.15.163:0/3387668765 shutdown_connections 2023-07-14T18:12:55.359 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:55.310+0000 7ffafeab3b80 1 --2- 172.21.15.163:0/3387668765 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55e84666a530 0x55e84666a9a0 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:55.359 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:55.310+0000 7ffafeab3b80 1 --2- 172.21.15.163:0/3387668765 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e846668fe0 0x55e8466693f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:55.359 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:55.310+0000 7ffafeab3b80 1 --2- 172.21.15.163:0/3387668765 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e846669930 0x55e846669f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:55.359 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:55.310+0000 7ffafeab3b80 1 -- 172.21.15.163:0/3387668765 >> 172.21.15.163:0/3387668765 conn(0x55e84665e700 msgr2=0x55e846663a50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:12:55.359 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:55.310+0000 7ffafeab3b80 1 -- 172.21.15.163:0/3387668765 shutdown_connections 2023-07-14T18:12:55.360 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:55.310+0000 7ffafeab3b80 1 -- 172.21.15.163:0/3387668765 wait complete. 2023-07-14T18:12:55.360 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:55.310+0000 7ffaf0eb8700 1 --2- 172.21.15.163:0/2294377245 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7ffad40a11d0 0x7ffad40a3680 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7ffae4007950 tx=0x7ffae400b740 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:12:55.360 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:55.310+0000 7ffafeab3b80 1 -- start start 2023-07-14T18:12:55.360 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:55.310+0000 7ffafeab3b80 1 Processor -- start 2023-07-14T18:12:55.360 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:55.311+0000 7ffafeab3b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e846668fe0 0x55e846672a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:12:55.360 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:55.311+0000 7ffafeab3b80 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55e846669930 0x55e846672f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:12:55.360 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:55.311+0000 7ffafeab3b80 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e84666a530 0x55e846679fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:12:55.361 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:55.311+0000 7ffafeab3b80 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e846559b40 con 0x55e846669930 2023-07-14T18:12:55.361 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:55.311+0000 7ffafeab3b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e846559840 con 0x55e846668fe0 2023-07-14T18:12:55.361 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:55.311+0000 7ffafeab3b80 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e84643d9a0 con 0x55e84666a530 2023-07-14T18:12:55.361 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:55.311+0000 7ffafeab3b80 10 client.0 _ll_register_callbacks cb 0x55e8465577e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T18:12:55.361 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:55.311+0000 7ffaeb7fe700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55e846669930 0x55e846672f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:12:55.361 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:55.311+0000 7ffaeb7fe700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55e846669930 0x55e846672f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:58030/0 (socket says 172.21.15.163:58030) 2023-07-14T18:12:55.361 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:55.311+0000 7ffaeb7fe700 1 -- 172.21.15.163:0/1386101949 learned_addr learned my addr 172.21.15.163:0/1386101949 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:12:55.362 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:55.311+0000 7ffaebfff700 1 --2- 172.21.15.163:0/1386101949 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e846668fe0 0x55e846672a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:12:55.362 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:55.311+0000 7ffaf0eb8700 1 --2- 172.21.15.163:0/1386101949 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e84666a530 0x55e846679fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:12:55.362 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:55.311+0000 7ffaeb7fe700 1 -- 172.21.15.163:0/1386101949 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e84666a530 msgr2=0x55e846679fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:12:55.362 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:55.311+0000 7ffaeb7fe700 1 --2- 172.21.15.163:0/1386101949 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e84666a530 0x55e846679fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:55.362 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:55.311+0000 7ffaeb7fe700 1 -- 172.21.15.163:0/1386101949 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e846668fe0 msgr2=0x55e846672a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:12:55.362 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:55.311+0000 7ffaeb7fe700 1 --2- 172.21.15.163:0/1386101949 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e846668fe0 0x55e846672a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:55.362 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:55.311+0000 7ffaeb7fe700 1 -- 172.21.15.163:0/1386101949 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffae000b960 con 0x55e846669930 2023-07-14T18:12:55.363 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:55.311+0000 7ffaebfff700 1 --2- 172.21.15.163:0/1386101949 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e846668fe0 0x55e846672a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T18:12:55.363 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:55.311+0000 7ffaeb7fe700 1 --2- 172.21.15.163:0/1386101949 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55e846669930 0x55e846672f60 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7ffae0000c00 tx=0x7ffae0010ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dfe1ee53544714c6 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:12:55.363 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:55.311+0000 7ffacb7fe700 10 client.0 ms_handle_connect on v2:172.21.15.163:3300/0 2023-07-14T18:12:55.363 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:55.311+0000 7ffacb7fe700 1 -- 172.21.15.163:0/1386101949 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffae0020070 con 0x55e846669930 2023-07-14T18:12:55.363 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:55.312+0000 7ffacb7fe700 1 -- 172.21.15.163:0/1386101949 <== mon.0 v2:172.21.15.163:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 9020+0+0 (secure 0 0 0) 0x7ffae0017070 con 0x55e846669930 2023-07-14T18:12:55.363 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:55.312+0000 7ffafeab3b80 1 -- 172.21.15.163:0/1386101949 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55e846513570 con 0x55e846669930 2023-07-14T18:12:55.363 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:55.312+0000 7ffacb7fe700 1 -- 172.21.15.163:0/1386101949 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7ffae00052d0 con 0x55e846669930 2023-07-14T18:12:55.364 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:55.312+0000 7ffafeab3b80 10 client.15678 fetch_fsmap learned FSMap version 29 2023-07-14T18:12:55.364 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:55.312+0000 7ffafeab3b80 1 -- 172.21.15.163:0/1386101949 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) v3 -- 0x55e8463d0ce0 con 0x55e846669930 2023-07-14T18:12:55.364 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:55.312+0000 7ffacb7fe700 1 -- 172.21.15.163:0/1386101949 <== mon.0 v2:172.21.15.163:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55e846513570 con 0x55e846669930 2023-07-14T18:12:55.364 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:55.312+0000 7ffacb7fe700 1 -- 172.21.15.163:0/1386101949 <== mon.0 v2:172.21.15.163:3300/0 5 ==== fsmap(e 29) v1 ==== 7470+0+0 (secure 0 0 0) 0x7ffae0003c50 con 0x55e846669930 2023-07-14T18:12:55.364 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:55.312+0000 7ffafeab3b80 10 client.15678 fetch_fsmap finished waiting for FSMap version 29 2023-07-14T18:12:55.364 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:55.312+0000 7ffafeab3b80 10 client.15678 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-07-14T18:12:55.364 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:55.312+0000 7ffafeab3b80 20 client.15678 populate_metadata read hostname 'smithi163' 2023-07-14T18:12:55.365 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:55.312+0000 7ffafeab3b80 1 --2- 172.21.15.163:0/1386101949 >> [v2:172.21.15.172:6838/3850440096,v1:172.21.15.172:6839/3850440096] conn(0x55e84667e670 0x55e846680a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:12:55.365 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:55.312+0000 7ffafeab3b80 4 client.15678 mds_command: new command op to 24518 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-14T18:12:55.365 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:55.312+0000 7ffafeab3b80 1 -- 172.21.15.163:0/1386101949 --> [v2:172.21.15.172:6838/3850440096,v1:172.21.15.172:6839/3850440096] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55e846637e20 con 0x55e84667e670 2023-07-14T18:12:55.365 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:55.312+0000 7ffaebfff700 1 --2- 172.21.15.163:0/1386101949 >> [v2:172.21.15.172:6838/3850440096,v1:172.21.15.172:6839/3850440096] conn(0x55e84667e670 0x55e846680a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:12:55.365 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:55.313+0000 7ffaebfff700 1 --2- 172.21.15.163:0/1386101949 >> [v2:172.21.15.172:6838/3850440096,v1:172.21.15.172:6839/3850440096] conn(0x55e84667e670 0x55e846680a80 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4fa0c3824885a380 server_cookie=bfd2aca3414063b7 in_seq=0 out_seq=0 2023-07-14T18:12:55.365 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:55.313+0000 7ffacb7fe700 10 client.15678 ms_handle_connect on v2:172.21.15.172:6838/3850440096 2023-07-14T18:12:55.365 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:55.313+0000 7ffacb7fe700 1 -- 172.21.15.163:0/1386101949 <== mds.0 v2:172.21.15.172:6838/3850440096 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18017 (crc 0 0 0) 0x55e846637e20 con 0x55e84667e670 2023-07-14T18:12:55.366 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:55.313+0000 7ffacb7fe700 10 client.15678 handle_command_reply: tid=0 2023-07-14T18:12:55.366 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:55.313+0000 7ffafeab3b80 1 client.15678 shutdown 2023-07-14T18:12:55.366 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:55.314+0000 7ffafeab3b80 1 -- 172.21.15.163:0/1386101949 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55e846669930 msgr2=0x55e846672f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:12:55.366 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:55.314+0000 7ffafeab3b80 1 --2- 172.21.15.163:0/1386101949 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55e846669930 0x55e846672f60 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7ffae0000c00 tx=0x7ffae0010ef0 comp rx=0 tx=0).stop 2023-07-14T18:12:55.366 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:55.314+0000 7ffafeab3b80 1 -- 172.21.15.163:0/1386101949 shutdown_connections 2023-07-14T18:12:55.366 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:55.314+0000 7ffafeab3b80 1 --2- 172.21.15.163:0/1386101949 >> [v2:172.21.15.172:6838/3850440096,v1:172.21.15.172:6839/3850440096] conn(0x55e84667e670 0x55e846680a80 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:55.366 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:55.314+0000 7ffafeab3b80 1 --2- 172.21.15.163:0/1386101949 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e84666a530 0x55e846679fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:55.367 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:55.314+0000 7ffafeab3b80 1 --2- 172.21.15.163:0/1386101949 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e846668fe0 0x55e846672a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:55.367 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:55.314+0000 7ffacb7fe700 0 client.15678 ms_handle_reset on v2:172.21.15.172:6838/3850440096 2023-07-14T18:12:55.367 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:55.314+0000 7ffafeab3b80 1 --2- 172.21.15.163:0/1386101949 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55e846669930 0x55e846672f60 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:55.367 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:55.314+0000 7ffafeab3b80 1 -- 172.21.15.163:0/1386101949 >> 172.21.15.163:0/1386101949 conn(0x55e84665e700 msgr2=0x55e8466626d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:12:55.367 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:55.314+0000 7ffafeab3b80 1 -- 172.21.15.163:0/1386101949 shutdown_connections 2023-07-14T18:12:55.367 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:55.314+0000 7ffafeab3b80 1 -- 172.21.15.163:0/1386101949 wait complete. 2023-07-14T18:12:55.367 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:55.314+0000 7ffafeab3b80 20 client.15678 trim_cache size 0 max 16384 2023-07-14T18:12:55.368 INFO:tasks.workunit.client.0.smithi163.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2023-07-14T18:12:55.373 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:55.331+0000 7ffafeab3b80 1 Processor -- start 2023-07-14T18:12:55.373 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:55.332+0000 7ffafeab3b80 1 -- start start 2023-07-14T18:12:55.373 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:55.332+0000 7ffafeab3b80 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55e84665e700 0x55e846663170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:12:55.374 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:55.332+0000 7ffafeab3b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e846668fe0 0x55e846679f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:12:55.374 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:55.332+0000 7ffafeab3b80 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e846669930 0x55e8466636b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:12:55.374 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:55.332+0000 7ffafeab3b80 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e846672590 con 0x55e84665e700 2023-07-14T18:12:55.374 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:55.332+0000 7ffafeab3b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e84667e160 con 0x55e846668fe0 2023-07-14T18:12:55.374 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:55.332+0000 7ffafeab3b80 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e846669d70 con 0x55e846669930 2023-07-14T18:12:55.374 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:55.332+0000 7ffaebfff700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55e84665e700 0x55e846663170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:12:55.375 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:55.332+0000 7ffaebfff700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55e84665e700 0x55e846663170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:58036/0 (socket says 172.21.15.163:58036) 2023-07-14T18:12:55.375 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:55.332+0000 7ffaebfff700 1 -- 172.21.15.163:0/982795828 learned_addr learned my addr 172.21.15.163:0/982795828 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:12:55.375 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:55.332+0000 7ffaeb7fe700 1 --2- 172.21.15.163:0/982795828 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e846668fe0 0x55e846679f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:12:55.375 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:55.332+0000 7ffaf0eb8700 1 --2- 172.21.15.163:0/982795828 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e846669930 0x55e8466636b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:12:55.375 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:55.332+0000 7ffaebfff700 1 -- 172.21.15.163:0/982795828 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e846669930 msgr2=0x55e8466636b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:12:55.375 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:55.332+0000 7ffaebfff700 1 --2- 172.21.15.163:0/982795828 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e846669930 0x55e8466636b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:55.375 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:55.332+0000 7ffaebfff700 1 -- 172.21.15.163:0/982795828 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e846668fe0 msgr2=0x55e846679f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:12:55.376 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:55.332+0000 7ffaebfff700 1 --2- 172.21.15.163:0/982795828 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e846668fe0 0x55e846679f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:55.376 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:55.332+0000 7ffaebfff700 1 -- 172.21.15.163:0/982795828 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e84640e2d0 con 0x55e84665e700 2023-07-14T18:12:55.376 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:55.332+0000 7ffaeb7fe700 1 --2- 172.21.15.163:0/982795828 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e846668fe0 0x55e846679f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T18:12:55.376 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:55.332+0000 7ffaebfff700 1 --2- 172.21.15.163:0/982795828 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55e84665e700 0x55e846663170 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7ffadc099b80 tx=0x7ffadc003680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=80a202e81653de8d server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:12:55.376 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:55.333+0000 7ffad2ffd700 1 -- 172.21.15.163:0/982795828 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffadc099e80 con 0x55e84665e700 2023-07-14T18:12:55.376 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:55.333+0000 7ffad2ffd700 1 -- 172.21.15.163:0/982795828 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ffadc0b1070 con 0x55e84665e700 2023-07-14T18:12:55.377 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:55.333+0000 7ffad2ffd700 1 -- 172.21.15.163:0/982795828 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffadc09a340 con 0x55e84665e700 2023-07-14T18:12:55.380 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:55.333+0000 7ffafeab3b80 1 -- 172.21.15.163:0/982795828 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55e84665e700 msgr2=0x55e846663170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:12:55.380 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:55.333+0000 7ffafeab3b80 1 --2- 172.21.15.163:0/982795828 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55e84665e700 0x55e846663170 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7ffadc099b80 tx=0x7ffadc003680 comp rx=0 tx=0).stop 2023-07-14T18:12:55.380 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:55.333+0000 7ffafeab3b80 1 -- 172.21.15.163:0/982795828 shutdown_connections 2023-07-14T18:12:55.380 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:55.333+0000 7ffafeab3b80 1 --2- 172.21.15.163:0/982795828 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e846669930 0x55e8466636b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:55.380 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:55.333+0000 7ffafeab3b80 1 --2- 172.21.15.163:0/982795828 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55e84665e700 0x55e846663170 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:55.381 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:55.333+0000 7ffafeab3b80 1 --2- 172.21.15.163:0/982795828 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e846668fe0 0x55e846679f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:55.381 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:55.333+0000 7ffafeab3b80 1 -- 172.21.15.163:0/982795828 >> 172.21.15.163:0/982795828 conn(0x55e846662a30 msgr2=0x55e846672a00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:12:55.381 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:55.333+0000 7ffafeab3b80 1 -- 172.21.15.163:0/982795828 shutdown_connections 2023-07-14T18:12:55.381 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:55.333+0000 7ffafeab3b80 1 -- 172.21.15.163:0/982795828 wait complete. 2023-07-14T18:12:55.381 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:55.334+0000 7ffafeab3b80 1 -- start start 2023-07-14T18:12:55.381 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:55.334+0000 7ffafeab3b80 1 Processor -- start 2023-07-14T18:12:55.381 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:55.334+0000 7ffafeab3b80 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55e84665e700 0x55e846677640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:12:55.382 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:55.334+0000 7ffafeab3b80 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e846668fe0 0x55e846677b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:12:55.382 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:55.334+0000 7ffafeab3b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e846669930 0x55e846678b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:12:55.382 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:55.334+0000 7ffafeab3b80 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e8466790d0 con 0x55e84665e700 2023-07-14T18:12:55.382 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:55.334+0000 7ffafeab3b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e846679240 con 0x55e846669930 2023-07-14T18:12:55.382 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:55.334+0000 7ffafeab3b80 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e846679400 con 0x55e846668fe0 2023-07-14T18:12:55.382 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:55.334+0000 7ffafeab3b80 10 client.0 _ll_register_callbacks cb 0x7ffae000bb80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T18:12:55.382 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:55.334+0000 7ffaebfff700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55e84665e700 0x55e846677640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:12:55.383 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:55.334+0000 7ffaebfff700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55e84665e700 0x55e846677640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:58042/0 (socket says 172.21.15.163:58042) 2023-07-14T18:12:55.383 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:55.334+0000 7ffaebfff700 1 -- 172.21.15.163:0/1100089594 learned_addr learned my addr 172.21.15.163:0/1100089594 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:12:55.384 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:55.334+0000 7ffaeb7fe700 1 --2- 172.21.15.163:0/1100089594 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e846668fe0 0x55e846677b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:12:55.384 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:55.334+0000 7ffaf0eb8700 1 --2- 172.21.15.163:0/1100089594 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e846669930 0x55e846678b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:12:55.384 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:55.335+0000 7ffaebfff700 1 -- 172.21.15.163:0/1100089594 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e846668fe0 msgr2=0x55e846677b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:12:55.384 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:55.335+0000 7ffaebfff700 1 --2- 172.21.15.163:0/1100089594 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e846668fe0 0x55e846677b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:55.384 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:55.335+0000 7ffaebfff700 1 -- 172.21.15.163:0/1100089594 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e846669930 msgr2=0x55e846678b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:12:55.384 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:55.335+0000 7ffaebfff700 1 --2- 172.21.15.163:0/1100089594 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e846669930 0x55e846678b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:55.384 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:55.335+0000 7ffaebfff700 1 -- 172.21.15.163:0/1100089594 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffaec19e010 con 0x55e84665e700 2023-07-14T18:12:55.385 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:55.335+0000 7ffaf0eb8700 1 --2- 172.21.15.163:0/1100089594 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e846669930 0x55e846678b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T18:12:55.385 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:55.335+0000 7ffaebfff700 1 --2- 172.21.15.163:0/1100089594 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55e84665e700 0x55e846677640 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7ffadc0ca5c0 tx=0x7ffadc09deb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=24be2713ecf6ef1f server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:12:55.385 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:55.335+0000 7ffacb7fe700 10 client.0 ms_handle_connect on v2:172.21.15.163:3300/0 2023-07-14T18:12:55.385 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:55.335+0000 7ffacb7fe700 1 -- 172.21.15.163:0/1100089594 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffadc099e80 con 0x55e84665e700 2023-07-14T18:12:55.385 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:55.335+0000 7ffacb7fe700 1 -- 172.21.15.163:0/1100089594 <== mon.0 v2:172.21.15.163:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 9020+0+0 (secure 0 0 0) 0x7ffadc0a22d0 con 0x55e84665e700 2023-07-14T18:12:55.385 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:55.335+0000 7ffafeab3b80 1 -- 172.21.15.163:0/1100089594 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7ffae0015070 con 0x55e84665e700 2023-07-14T18:12:55.385 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:55.335+0000 7ffacb7fe700 1 -- 172.21.15.163:0/1100089594 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7ffadc09a0e0 con 0x55e84665e700 2023-07-14T18:12:55.386 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:55.335+0000 7ffafeab3b80 10 client.15684 fetch_fsmap learned FSMap version 29 2023-07-14T18:12:55.386 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:55.335+0000 7ffafeab3b80 1 -- 172.21.15.163:0/1100089594 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) v3 -- 0x55e8463e6330 con 0x55e84665e700 2023-07-14T18:12:55.386 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:55.335+0000 7ffacb7fe700 1 -- 172.21.15.163:0/1100089594 <== mon.0 v2:172.21.15.163:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ffae0015070 con 0x55e84665e700 2023-07-14T18:12:55.386 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:55.335+0000 7ffacb7fe700 1 -- 172.21.15.163:0/1100089594 <== mon.0 v2:172.21.15.163:3300/0 5 ==== fsmap(e 29) v1 ==== 7470+0+0 (secure 0 0 0) 0x7ffadc0adb80 con 0x55e84665e700 2023-07-14T18:12:55.386 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:55.335+0000 7ffafeab3b80 10 client.15684 fetch_fsmap finished waiting for FSMap version 29 2023-07-14T18:12:55.386 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:55.335+0000 7ffafeab3b80 10 client.15684 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-07-14T18:12:55.387 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:55.335+0000 7ffafeab3b80 20 client.15684 populate_metadata read hostname 'smithi163' 2023-07-14T18:12:55.387 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:55.335+0000 7ffafeab3b80 1 --2- 172.21.15.163:0/1100089594 >> [v2:172.21.15.172:6838/3850440096,v1:172.21.15.172:6839/3850440096] conn(0x55e84666a530 0x55e8466d67d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:12:55.387 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:55.335+0000 7ffafeab3b80 4 client.15684 mds_command: new command op to 24518 tid=0[{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2023-07-14T18:12:55.387 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:55.335+0000 7ffafeab3b80 1 -- 172.21.15.163:0/1100089594 --> [v2:172.21.15.172:6838/3850440096,v1:172.21.15.172:6839/3850440096] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) v1 -- 0x55e8465b2f30 con 0x55e84666a530 2023-07-14T18:12:55.387 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:55.336+0000 7ffaeb7fe700 1 --2- 172.21.15.163:0/1100089594 >> [v2:172.21.15.172:6838/3850440096,v1:172.21.15.172:6839/3850440096] conn(0x55e84666a530 0x55e8466d67d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:12:55.387 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:55.336+0000 7ffacb7fe700 10 client.15684 ms_handle_connect on v2:172.21.15.172:6838/3850440096 2023-07-14T18:12:55.387 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:55.336+0000 7ffaeb7fe700 1 --2- 172.21.15.163:0/1100089594 >> [v2:172.21.15.172:6838/3850440096,v1:172.21.15.172:6839/3850440096] conn(0x55e84666a530 0x55e8466d67d0 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=291fb8971ea14e3 server_cookie=ad24ab7bd05cc4b in_seq=0 out_seq=0 2023-07-14T18:12:55.388 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:55.337+0000 7ffacb7fe700 1 -- 172.21.15.163:0/1100089594 <== mds.0 v2:172.21.15.172:6838/3850440096 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x55e8465b2f30 con 0x55e84666a530 2023-07-14T18:12:55.388 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:55.337+0000 7ffacb7fe700 10 client.15684 handle_command_reply: tid=0 2023-07-14T18:12:55.388 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:55.337+0000 7ffafeab3b80 1 client.15684 shutdown 2023-07-14T18:12:55.388 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:55.338+0000 7ffafeab3b80 1 -- 172.21.15.163:0/1100089594 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55e84665e700 msgr2=0x55e846677640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:12:55.388 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:55.338+0000 7ffafeab3b80 1 --2- 172.21.15.163:0/1100089594 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55e84665e700 0x55e846677640 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7ffadc0ca5c0 tx=0x7ffadc09deb0 comp rx=0 tx=0).stop 2023-07-14T18:12:55.388 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:55.338+0000 7ffafeab3b80 1 -- 172.21.15.163:0/1100089594 shutdown_connections 2023-07-14T18:12:55.389 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:55.338+0000 7ffafeab3b80 1 --2- 172.21.15.163:0/1100089594 >> [v2:172.21.15.172:6838/3850440096,v1:172.21.15.172:6839/3850440096] conn(0x55e84666a530 0x55e8466d67d0 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:55.389 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:55.338+0000 7ffafeab3b80 1 --2- 172.21.15.163:0/1100089594 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e846669930 0x55e846678b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:55.389 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:55.338+0000 7ffafeab3b80 1 --2- 172.21.15.163:0/1100089594 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55e84665e700 0x55e846677640 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:55.389 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:55.338+0000 7ffacb7fe700 0 client.15684 ms_handle_reset on v2:172.21.15.172:6838/3850440096 2023-07-14T18:12:55.389 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:55.338+0000 7ffafeab3b80 1 --2- 172.21.15.163:0/1100089594 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e846668fe0 0x55e846677b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:55.389 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:55.338+0000 7ffafeab3b80 1 -- 172.21.15.163:0/1100089594 >> 172.21.15.163:0/1100089594 conn(0x55e846662a30 msgr2=0x55e846663170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:12:55.389 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:55.338+0000 7ffafeab3b80 1 -- 172.21.15.163:0/1100089594 shutdown_connections 2023-07-14T18:12:55.390 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:55.338+0000 7ffafeab3b80 1 -- 172.21.15.163:0/1100089594 wait complete. 2023-07-14T18:12:55.390 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:55.338+0000 7ffafeab3b80 20 client.15684 trim_cache size 0 max 16384 2023-07-14T18:12:55.390 INFO:teuthology.orchestra.run.smithi163.stdout:{ 2023-07-14T18:12:55.390 INFO:teuthology.orchestra.run.smithi163.stdout: "return_code": 0, 2023-07-14T18:12:55.391 INFO:teuthology.orchestra.run.smithi163.stdout: "scrub_tag": "7f0335eb-fdcf-4abb-b472-ce11bdd2a506", 2023-07-14T18:12:55.391 INFO:teuthology.orchestra.run.smithi163.stdout: "mode": "asynchronous" 2023-07-14T18:12:55.391 INFO:teuthology.orchestra.run.smithi163.stdout:} 2023-07-14T18:12:55.392 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:55.338+0000 7ffaf291b700 1 -- 172.21.15.163:0/2294377245 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7ffad40a11d0 msgr2=0x7ffad40a3680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:12:55.392 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:55.338+0000 7ffaf291b700 1 --2- 172.21.15.163:0/2294377245 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7ffad40a11d0 0x7ffad40a3680 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7ffae4007950 tx=0x7ffae400b740 comp rx=0 tx=0).stop 2023-07-14T18:12:55.392 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:55.338+0000 7ffaf291b700 1 -- 172.21.15.163:0/2294377245 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ffaec0feb10 msgr2=0x7ffaec068330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:12:55.393 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:55.338+0000 7ffaf291b700 1 --2- 172.21.15.163:0/2294377245 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ffaec0feb10 0x7ffaec068330 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7ffadc00e970 tx=0x7ffadc00ec80 comp rx=0 tx=0).stop 2023-07-14T18:12:55.393 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:55.338+0000 7ffaf291b700 1 -- 172.21.15.163:0/2294377245 shutdown_connections 2023-07-14T18:12:55.393 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:55.338+0000 7ffaf291b700 1 --2- 172.21.15.163:0/2294377245 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7ffad40a11d0 0x7ffad40a3680 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:55.393 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:55.338+0000 7ffaf291b700 1 --2- 172.21.15.163:0/2294377245 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ffaec100690 0x7ffaec19cd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:55.393 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:55.338+0000 7ffaf291b700 1 --2- 172.21.15.163:0/2294377245 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ffaec0feb10 0x7ffaec068330 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:55.393 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:55.338+0000 7ffaf291b700 1 --2- 172.21.15.163:0/2294377245 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ffaec0ffd00 0x7ffaec19a6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:55.393 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:55.338+0000 7ffaf291b700 1 -- 172.21.15.163:0/2294377245 >> 172.21.15.163:0/2294377245 conn(0x7ffaec0fa130 msgr2=0x7ffaec103240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:12:55.394 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:55.339+0000 7ffaf291b700 1 -- 172.21.15.163:0/2294377245 shutdown_connections 2023-07-14T18:12:55.394 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:55.339+0000 7ffaf291b700 1 -- 172.21.15.163:0/2294377245 wait complete. 2023-07-14T18:12:55.394 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-07-14T18:12:55.559 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:55.518+0000 7f38ad99d700 1 -- 172.21.15.163:0/1999261104 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f38a81058d0 msgr2=0x7f38a8107d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:12:55.560 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:55.518+0000 7f38ad99d700 1 --2- 172.21.15.163:0/1999261104 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f38a81058d0 0x7f38a8107d30 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f38a000b0a0 tx=0x7f38a000b3b0 comp rx=0 tx=0).stop 2023-07-14T18:12:55.560 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:55.519+0000 7f38ad99d700 1 -- 172.21.15.163:0/1999261104 shutdown_connections 2023-07-14T18:12:55.560 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:55.519+0000 7f38ad99d700 1 --2- 172.21.15.163:0/1999261104 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f38a81058d0 0x7f38a8107d30 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:55.560 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:55.519+0000 7f38ad99d700 1 --2- 172.21.15.163:0/1999261104 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f38a8100690 0x7f38a8102a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:55.560 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:55.519+0000 7f38ad99d700 1 --2- 172.21.15.163:0/1999261104 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f38a8102fb0 0x7f38a8105390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:55.560 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:55.519+0000 7f38ad99d700 1 -- 172.21.15.163:0/1999261104 >> 172.21.15.163:0/1999261104 conn(0x7f38a80fa130 msgr2=0x7f38a80fc560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:12:55.561 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:55.519+0000 7f38ad99d700 1 -- 172.21.15.163:0/1999261104 shutdown_connections 2023-07-14T18:12:55.561 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:55.519+0000 7f38ad99d700 1 -- 172.21.15.163:0/1999261104 wait complete. 2023-07-14T18:12:55.562 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:55.519+0000 7f38ad99d700 1 Processor -- start 2023-07-14T18:12:55.563 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:55.520+0000 7f38ad99d700 1 -- start start 2023-07-14T18:12:55.563 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:55.520+0000 7f38ad99d700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f38a8100690 0x7f38a8195980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:12:55.563 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:55.520+0000 7f38ad99d700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f38a8102fb0 0x7f38a8195ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:12:55.563 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:55.520+0000 7f38ad99d700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f38a81058d0 0x7f38a819cf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:12:55.563 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:55.520+0000 7f38ad99d700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38a819d500 con 0x7f38a81058d0 2023-07-14T18:12:55.563 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:55.520+0000 7f38ad99d700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38a819d640 con 0x7f38a8100690 2023-07-14T18:12:55.563 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:55.520+0000 7f38ad99d700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38a819d7d0 con 0x7f38a8102fb0 2023-07-14T18:12:55.564 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:55.520+0000 7f38a77fe700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f38a81058d0 0x7f38a819cf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:12:55.564 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:55.520+0000 7f38a77fe700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f38a81058d0 0x7f38a819cf30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:58062/0 (socket says 172.21.15.163:58062) 2023-07-14T18:12:55.564 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:55.520+0000 7f38a77fe700 1 -- 172.21.15.163:0/2948713812 learned_addr learned my addr 172.21.15.163:0/2948713812 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:12:55.564 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:55.520+0000 7f38a6ffd700 1 --2- 172.21.15.163:0/2948713812 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f38a8100690 0x7f38a8195980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:12:55.564 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:55.520+0000 7f38a67fc700 1 --2- 172.21.15.163:0/2948713812 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f38a8102fb0 0x7f38a8195ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:12:55.564 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:55.520+0000 7f38a77fe700 1 -- 172.21.15.163:0/2948713812 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f38a8102fb0 msgr2=0x7f38a8195ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:12:55.565 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:55.520+0000 7f38a77fe700 1 --2- 172.21.15.163:0/2948713812 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f38a8102fb0 0x7f38a8195ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:55.565 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:55.520+0000 7f38a77fe700 1 -- 172.21.15.163:0/2948713812 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f38a8100690 msgr2=0x7f38a8195980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:12:55.565 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:55.520+0000 7f38a77fe700 1 --2- 172.21.15.163:0/2948713812 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f38a8100690 0x7f38a8195980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:55.565 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:55.520+0000 7f38a77fe700 1 -- 172.21.15.163:0/2948713812 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3898009520 con 0x7f38a81058d0 2023-07-14T18:12:55.565 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:55.520+0000 7f38a77fe700 1 --2- 172.21.15.163:0/2948713812 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f38a81058d0 0x7f38a819cf30 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f38a000b780 tx=0x7f38a000bdf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:12:55.566 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:55.521+0000 7f38ac99b700 1 -- 172.21.15.163:0/2948713812 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38a000e040 con 0x7f38a81058d0 2023-07-14T18:12:55.566 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:55.521+0000 7f38ac99b700 1 -- 172.21.15.163:0/2948713812 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f38a0004e60 con 0x7f38a81058d0 2023-07-14T18:12:55.566 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:55.521+0000 7f38ad99d700 1 -- 172.21.15.163:0/2948713812 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f38a0009d00 con 0x7f38a81058d0 2023-07-14T18:12:55.566 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:55.521+0000 7f38ac99b700 1 -- 172.21.15.163:0/2948713812 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38a00052a0 con 0x7f38a81058d0 2023-07-14T18:12:55.566 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:55.521+0000 7f38ad99d700 1 -- 172.21.15.163:0/2948713812 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f38a819dd90 con 0x7f38a81058d0 2023-07-14T18:12:55.570 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:55.524+0000 7f38ac99b700 1 -- 172.21.15.163:0/2948713812 <== mon.0 v2:172.21.15.163:3300/0 4 ==== mgrmap(e 18) v1 ==== 135716+0+0 (secure 0 0 0) 0x7f38a001d990 con 0x7f38a81058d0 2023-07-14T18:12:55.570 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:55.524+0000 7f38ac99b700 1 --2- 172.21.15.163:0/2948713812 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f38900a11d0 0x7f38900a3680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:12:55.570 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:55.524+0000 7f38b9b35b80 1 Processor -- start 2023-07-14T18:12:55.570 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:55.524+0000 7f38b9b35b80 1 -- start start 2023-07-14T18:12:55.571 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:55.524+0000 7f38ac99b700 1 -- 172.21.15.163:0/2948713812 <== mon.0 v2:172.21.15.163:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 9020+0+0 (secure 0 0 0) 0x7f38a00ce2a0 con 0x7f38a81058d0 2023-07-14T18:12:55.571 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:55.524+0000 7f38a6ffd700 1 --2- 172.21.15.163:0/2948713812 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f38900a11d0 0x7f38900a3680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:12:55.571 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:55.524+0000 7f38b9b35b80 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x560a021c0320 0x560a021c0730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:12:55.571 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:55.524+0000 7f38b9b35b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560a021c0c70 0x560a021c1310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:12:55.571 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:55.524+0000 7f38b9b35b80 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x560a021c18a0 0x560a021c1d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:12:55.571 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:55.524+0000 7f38b9b35b80 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x560a020c0cb0 con 0x560a021c18a0 2023-07-14T18:12:55.571 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:55.524+0000 7f38b9b35b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x560a02113a40 con 0x560a021c0c70 2023-07-14T18:12:55.572 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:55.524+0000 7f38b9b35b80 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x560a0210ced0 con 0x560a021c0320 2023-07-14T18:12:55.572 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:55.525+0000 7f38a77fe700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x560a021c18a0 0x560a021c1d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:12:55.572 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:55.525+0000 7f38a77fe700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x560a021c18a0 0x560a021c1d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:58070/0 (socket says 172.21.15.163:58070) 2023-07-14T18:12:55.572 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:55.525+0000 7f38a77fe700 1 -- 172.21.15.163:0/855175358 learned_addr learned my addr 172.21.15.163:0/855175358 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:12:55.572 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:55.525+0000 7f38a67fc700 1 --2- 172.21.15.163:0/855175358 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560a021c0c70 0x560a021c1310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:12:55.572 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:55.525+0000 7f38a6ffd700 1 --2- 172.21.15.163:0/855175358 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x560a021c0320 0x560a021c0730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:12:55.572 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:55.525+0000 7f38a77fe700 1 -- 172.21.15.163:0/855175358 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x560a021c0320 msgr2=0x560a021c0730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:12:55.573 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:55.525+0000 7f38a77fe700 1 --2- 172.21.15.163:0/855175358 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x560a021c0320 0x560a021c0730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:55.573 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:55.525+0000 7f38a6ffd700 1 --2- 172.21.15.163:0/2948713812 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f38900a11d0 0x7f38900a3680 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f3898009d90 tx=0x7f38980116c0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:12:55.573 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:55.525+0000 7f38a77fe700 1 -- 172.21.15.163:0/855175358 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560a021c0c70 msgr2=0x560a021c1310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:12:55.573 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:55.525+0000 7f38a77fe700 1 --2- 172.21.15.163:0/855175358 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560a021c0c70 0x560a021c1310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:55.573 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:55.525+0000 7f38a77fe700 1 -- 172.21.15.163:0/855175358 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560a01f3ade0 con 0x560a021c18a0 2023-07-14T18:12:55.573 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:55.525+0000 7f38a77fe700 1 --2- 172.21.15.163:0/855175358 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x560a021c18a0 0x560a021c1d10 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f38a0097930 tx=0x7f38a0006100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=919a403605749281 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:12:55.573 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:55.525+0000 7f388dffb700 1 -- 172.21.15.163:0/855175358 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38a009b430 con 0x560a021c18a0 2023-07-14T18:12:55.573 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:55.525+0000 7f388dffb700 1 -- 172.21.15.163:0/855175358 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f38a009f460 con 0x560a021c18a0 2023-07-14T18:12:55.574 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:55.525+0000 7f388dffb700 1 -- 172.21.15.163:0/855175358 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38a0099640 con 0x560a021c18a0 2023-07-14T18:12:55.574 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:55.526+0000 7f38b9b35b80 1 -- 172.21.15.163:0/855175358 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x560a021c18a0 msgr2=0x560a021c1d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:12:55.574 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:55.526+0000 7f38b9b35b80 1 --2- 172.21.15.163:0/855175358 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x560a021c18a0 0x560a021c1d10 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f38a0097930 tx=0x7f38a0006100 comp rx=0 tx=0).stop 2023-07-14T18:12:55.574 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:55.526+0000 7f38b9b35b80 1 -- 172.21.15.163:0/855175358 shutdown_connections 2023-07-14T18:12:55.574 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:55.526+0000 7f38b9b35b80 1 --2- 172.21.15.163:0/855175358 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x560a021c0320 0x560a021c0730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:55.574 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:55.526+0000 7f38b9b35b80 1 --2- 172.21.15.163:0/855175358 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x560a021c18a0 0x560a021c1d10 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:55.574 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:55.526+0000 7f38b9b35b80 1 --2- 172.21.15.163:0/855175358 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560a021c0c70 0x560a021c1310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:55.574 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:55.526+0000 7f38b9b35b80 1 -- 172.21.15.163:0/855175358 >> 172.21.15.163:0/855175358 conn(0x560a021b1680 msgr2=0x560a021b69d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:12:55.575 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:55.526+0000 7f38b9b35b80 1 -- 172.21.15.163:0/855175358 shutdown_connections 2023-07-14T18:12:55.575 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:55.526+0000 7f38b9b35b80 1 -- 172.21.15.163:0/855175358 wait complete. 2023-07-14T18:12:55.575 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:55.526+0000 7f38b9b35b80 1 -- start start 2023-07-14T18:12:55.575 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:55.527+0000 7f38b9b35b80 1 Processor -- start 2023-07-14T18:12:55.575 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:55.527+0000 7f38b9b35b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560a021c0320 0x560a021c9af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:12:55.575 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:55.527+0000 7f38b9b35b80 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x560a021c0c70 0x560a021ca030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:12:55.575 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:55.527+0000 7f38b9b35b80 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x560a021c18a0 0x560a021d1070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:12:55.576 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:55.527+0000 7f38b9b35b80 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x560a020acac0 con 0x560a021c18a0 2023-07-14T18:12:55.576 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:55.527+0000 7f38b9b35b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x560a020ac7c0 con 0x560a021c0320 2023-07-14T18:12:55.576 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:55.527+0000 7f38b9b35b80 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x560a01f90920 con 0x560a021c0c70 2023-07-14T18:12:55.576 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:55.527+0000 7f38b9b35b80 10 client.0 _ll_register_callbacks cb 0x560a020aa760 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T18:12:55.576 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:55.527+0000 7f38a67fc700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x560a021c0c70 0x560a021ca030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:12:55.576 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:55.527+0000 7f38a6ffd700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560a021c0320 0x560a021c9af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:12:55.576 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:55.527+0000 7f38a67fc700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x560a021c0c70 0x560a021ca030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.163:39896/0 (socket says 172.21.15.163:39896) 2023-07-14T18:12:55.576 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:55.527+0000 7f38a67fc700 1 -- 172.21.15.163:0/722345592 learned_addr learned my addr 172.21.15.163:0/722345592 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:12:55.577 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:55.527+0000 7f38a77fe700 1 --2- 172.21.15.163:0/722345592 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x560a021c18a0 0x560a021d1070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:12:55.577 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:55.528+0000 7f38a67fc700 1 -- 172.21.15.163:0/722345592 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560a021c0320 msgr2=0x560a021c9af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:12:55.577 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:55.528+0000 7f38a67fc700 1 --2- 172.21.15.163:0/722345592 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560a021c0320 0x560a021c9af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:55.577 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:55.528+0000 7f38a67fc700 1 -- 172.21.15.163:0/722345592 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x560a021c18a0 msgr2=0x560a021d1070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:12:55.577 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:55.528+0000 7f38a67fc700 1 --2- 172.21.15.163:0/722345592 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x560a021c18a0 0x560a021d1070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:55.577 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:55.528+0000 7f38a67fc700 1 -- 172.21.15.163:0/722345592 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f38a819dd90 con 0x560a021c0c70 2023-07-14T18:12:55.577 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:55.528+0000 7f38a77fe700 1 --2- 172.21.15.163:0/722345592 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x560a021c18a0 0x560a021d1070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T18:12:55.577 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:55.528+0000 7f38a67fc700 1 --2- 172.21.15.163:0/722345592 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x560a021c0c70 0x560a021ca030 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f389c009ef0 tx=0x7f389c0116c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2c3145a17ce075d0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:12:55.578 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:55.528+0000 7f3886ffd700 10 client.0 ms_handle_connect on v2:172.21.15.184:3300/0 2023-07-14T18:12:55.578 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:55.528+0000 7f3886ffd700 1 -- 172.21.15.163:0/722345592 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f389c011ee0 con 0x560a021c0c70 2023-07-14T18:12:55.578 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:55.528+0000 7f38b9b35b80 1 -- 172.21.15.163:0/722345592 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x560a020664f0 con 0x560a021c0c70 2023-07-14T18:12:55.578 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:55.528+0000 7f3886ffd700 1 -- 172.21.15.163:0/722345592 <== mon.1 v2:172.21.15.184:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 9020+0+0 (secure 0 0 0) 0x7f389c012650 con 0x560a021c0c70 2023-07-14T18:12:55.578 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:55.528+0000 7f3886ffd700 1 -- 172.21.15.163:0/722345592 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7f389c012810 con 0x560a021c0c70 2023-07-14T18:12:55.578 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:55.528+0000 7f38b9b35b80 10 client.25303 fetch_fsmap learned FSMap version 29 2023-07-14T18:12:55.578 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:55.528+0000 7f38b9b35b80 1 -- 172.21.15.163:0/722345592 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) v3 -- 0x560a01f23c60 con 0x560a021c0c70 2023-07-14T18:12:55.578 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:55.529+0000 7f3886ffd700 1 -- 172.21.15.163:0/722345592 <== mon.1 v2:172.21.15.184:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x560a020664f0 con 0x560a021c0c70 2023-07-14T18:12:55.579 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:55.529+0000 7f3886ffd700 1 -- 172.21.15.163:0/722345592 <== mon.1 v2:172.21.15.184:3300/0 5 ==== fsmap(e 29) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f389c00c070 con 0x560a021c0c70 2023-07-14T18:12:55.579 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:55.529+0000 7f38b9b35b80 10 client.25303 fetch_fsmap finished waiting for FSMap version 29 2023-07-14T18:12:55.579 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:55.529+0000 7f38b9b35b80 10 client.25303 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-07-14T18:12:55.579 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:55.529+0000 7f38b9b35b80 20 client.25303 populate_metadata read hostname 'smithi163' 2023-07-14T18:12:55.579 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:55.529+0000 7f38b9b35b80 1 --2- 172.21.15.163:0/722345592 >> [v2:172.21.15.172:6838/3850440096,v1:172.21.15.172:6839/3850440096] conn(0x560a021d5970 0x560a021d7d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:12:55.579 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:55.529+0000 7f38b9b35b80 4 client.25303 mds_command: new command op to 24518 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-14T18:12:55.579 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:55.529+0000 7f38b9b35b80 1 -- 172.21.15.163:0/722345592 --> [v2:172.21.15.172:6838/3850440096,v1:172.21.15.172:6839/3850440096] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x560a0218ada0 con 0x560a021d5970 2023-07-14T18:12:55.580 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:55.529+0000 7f38a6ffd700 1 --2- 172.21.15.163:0/722345592 >> [v2:172.21.15.172:6838/3850440096,v1:172.21.15.172:6839/3850440096] conn(0x560a021d5970 0x560a021d7d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:12:55.580 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:55.530+0000 7f3886ffd700 10 client.25303 ms_handle_connect on v2:172.21.15.172:6838/3850440096 2023-07-14T18:12:55.580 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:55.530+0000 7f38a6ffd700 1 --2- 172.21.15.163:0/722345592 >> [v2:172.21.15.172:6838/3850440096,v1:172.21.15.172:6839/3850440096] conn(0x560a021d5970 0x560a021d7d80 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=22664bc74a59631b server_cookie=282a3544b5761fcc in_seq=0 out_seq=0 2023-07-14T18:12:55.581 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:55.530+0000 7f3886ffd700 1 -- 172.21.15.163:0/722345592 <== mds.0 v2:172.21.15.172:6838/3850440096 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18017 (crc 0 0 0) 0x560a0218ada0 con 0x560a021d5970 2023-07-14T18:12:55.581 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:55.530+0000 7f3886ffd700 10 client.25303 handle_command_reply: tid=0 2023-07-14T18:12:55.581 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:55.530+0000 7f38b9b35b80 1 client.25303 shutdown 2023-07-14T18:12:55.581 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:55.530+0000 7f38b9b35b80 1 -- 172.21.15.163:0/722345592 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x560a021c0c70 msgr2=0x560a021ca030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:12:55.581 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:55.530+0000 7f38b9b35b80 1 --2- 172.21.15.163:0/722345592 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x560a021c0c70 0x560a021ca030 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f389c009ef0 tx=0x7f389c0116c0 comp rx=0 tx=0).stop 2023-07-14T18:12:55.582 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:55.530+0000 7f38b9b35b80 1 -- 172.21.15.163:0/722345592 shutdown_connections 2023-07-14T18:12:55.582 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:55.530+0000 7f38b9b35b80 1 --2- 172.21.15.163:0/722345592 >> [v2:172.21.15.172:6838/3850440096,v1:172.21.15.172:6839/3850440096] conn(0x560a021d5970 0x560a021d7d80 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:55.582 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:55.530+0000 7f38b9b35b80 1 --2- 172.21.15.163:0/722345592 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x560a021c18a0 0x560a021d1070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:55.582 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:55.530+0000 7f3886ffd700 0 client.25303 ms_handle_reset on v2:172.21.15.172:6838/3850440096 2023-07-14T18:12:55.582 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:55.530+0000 7f38b9b35b80 1 --2- 172.21.15.163:0/722345592 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560a021c0320 0x560a021c9af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:55.582 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:55.530+0000 7f38b9b35b80 1 --2- 172.21.15.163:0/722345592 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x560a021c0c70 0x560a021ca030 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:55.582 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:55.530+0000 7f38b9b35b80 1 -- 172.21.15.163:0/722345592 >> 172.21.15.163:0/722345592 conn(0x560a021b1680 msgr2=0x560a021b5650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:12:55.583 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:55.530+0000 7f38b9b35b80 1 -- 172.21.15.163:0/722345592 shutdown_connections 2023-07-14T18:12:55.583 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:55.531+0000 7f38b9b35b80 1 -- 172.21.15.163:0/722345592 wait complete. 2023-07-14T18:12:55.583 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:55.531+0000 7f38b9b35b80 20 client.25303 trim_cache size 0 max 16384 2023-07-14T18:12:55.596 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:55.554+0000 7f38b9b35b80 1 Processor -- start 2023-07-14T18:12:55.596 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:55.554+0000 7f38b9b35b80 1 -- start start 2023-07-14T18:12:55.596 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:55.554+0000 7f38b9b35b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560a021c0320 0x560a021cef80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:12:55.596 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:55.554+0000 7f38b9b35b80 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x560a021c0c70 0x560a021c7c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:12:55.596 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:55.554+0000 7f38b9b35b80 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x560a021c18a0 0x560a021c4770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:12:55.596 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:55.554+0000 7f38b9b35b80 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x560a021b84a0 con 0x560a021c18a0 2023-07-14T18:12:55.597 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:55.554+0000 7f38b9b35b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x560a021ca770 con 0x560a021c0320 2023-07-14T18:12:55.597 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:55.554+0000 7f38b9b35b80 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x560a021c79e0 con 0x560a021c0c70 2023-07-14T18:12:55.597 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:55.555+0000 7f38a77fe700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x560a021c18a0 0x560a021c4770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:12:55.597 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:55.555+0000 7f38a77fe700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x560a021c18a0 0x560a021c4770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:58084/0 (socket says 172.21.15.163:58084) 2023-07-14T18:12:55.597 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:55.555+0000 7f38a77fe700 1 -- 172.21.15.163:0/1052449019 learned_addr learned my addr 172.21.15.163:0/1052449019 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:12:55.597 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:55.555+0000 7f38a67fc700 1 --2- 172.21.15.163:0/1052449019 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x560a021c0c70 0x560a021c7c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:12:55.597 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:55.555+0000 7f38a6ffd700 1 --2- 172.21.15.163:0/1052449019 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560a021c0320 0x560a021cef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:12:55.598 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:55.555+0000 7f38a77fe700 1 -- 172.21.15.163:0/1052449019 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x560a021c0c70 msgr2=0x560a021c7c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:12:55.598 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:55.555+0000 7f38a77fe700 1 --2- 172.21.15.163:0/1052449019 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x560a021c0c70 0x560a021c7c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:55.598 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:55.555+0000 7f38a77fe700 1 -- 172.21.15.163:0/1052449019 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560a021c0320 msgr2=0x560a021cef80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:12:55.598 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:55.555+0000 7f38a77fe700 1 --2- 172.21.15.163:0/1052449019 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560a021c0320 0x560a021cef80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:55.598 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:55.555+0000 7f38a77fe700 1 -- 172.21.15.163:0/1052449019 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560a01f61250 con 0x560a021c18a0 2023-07-14T18:12:55.598 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:55.555+0000 7f38a77fe700 1 --2- 172.21.15.163:0/1052449019 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x560a021c18a0 0x560a021c4770 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f38a00062a0 tx=0x7f38a009b090 comp rx=0 tx=0).ready entity=mon.0 client_cookie=17a6214bd90fdde1 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:12:55.598 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:55.555+0000 7f388e7fc700 1 -- 172.21.15.163:0/1052449019 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38a009b430 con 0x560a021c18a0 2023-07-14T18:12:55.598 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:55.555+0000 7f388e7fc700 1 -- 172.21.15.163:0/1052449019 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f38a00b1020 con 0x560a021c18a0 2023-07-14T18:12:55.599 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:55.555+0000 7f388e7fc700 1 -- 172.21.15.163:0/1052449019 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38a00997d0 con 0x560a021c18a0 2023-07-14T18:12:55.602 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:55.556+0000 7f38b9b35b80 1 -- 172.21.15.163:0/1052449019 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x560a021c18a0 msgr2=0x560a021c4770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:12:55.602 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:55.556+0000 7f38b9b35b80 1 --2- 172.21.15.163:0/1052449019 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x560a021c18a0 0x560a021c4770 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f38a00062a0 tx=0x7f38a009b090 comp rx=0 tx=0).stop 2023-07-14T18:12:55.602 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:55.556+0000 7f38b9b35b80 1 -- 172.21.15.163:0/1052449019 shutdown_connections 2023-07-14T18:12:55.602 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:55.556+0000 7f38b9b35b80 1 --2- 172.21.15.163:0/1052449019 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x560a021c18a0 0x560a021c4770 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:55.602 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:55.556+0000 7f38b9b35b80 1 --2- 172.21.15.163:0/1052449019 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560a021c0320 0x560a021cef80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:55.603 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:55.556+0000 7f38b9b35b80 1 --2- 172.21.15.163:0/1052449019 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x560a021c0c70 0x560a021c7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:55.603 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:55.556+0000 7f38b9b35b80 1 -- 172.21.15.163:0/1052449019 >> 172.21.15.163:0/1052449019 conn(0x560a021b1680 msgr2=0x560a021c8850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:12:55.603 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:55.556+0000 7f38b9b35b80 1 -- 172.21.15.163:0/1052449019 shutdown_connections 2023-07-14T18:12:55.603 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:55.556+0000 7f38b9b35b80 1 -- 172.21.15.163:0/1052449019 wait complete. 2023-07-14T18:12:55.603 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:55.557+0000 7f38b9b35b80 1 -- start start 2023-07-14T18:12:55.603 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:55.557+0000 7f38b9b35b80 1 Processor -- start 2023-07-14T18:12:55.603 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:55.557+0000 7f38b9b35b80 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x560a021c0320 0x560a021cce90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:12:55.603 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:55.557+0000 7f38b9b35b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560a021c0c70 0x560a021cd3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:12:55.604 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:55.557+0000 7f38b9b35b80 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x560a021c18a0 0x560a021ce3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:12:55.604 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:55.557+0000 7f38b9b35b80 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x560a021ce920 con 0x560a021c18a0 2023-07-14T18:12:55.604 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:55.557+0000 7f38b9b35b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x560a021cea90 con 0x560a021c0c70 2023-07-14T18:12:55.604 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:55.557+0000 7f38b9b35b80 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x560a021cec50 con 0x560a021c0320 2023-07-14T18:12:55.604 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:55.557+0000 7f38b9b35b80 10 client.0 _ll_register_callbacks cb 0x7f389c0099f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T18:12:55.604 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:55.557+0000 7f38a77fe700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x560a021c18a0 0x560a021ce3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:12:55.604 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:55.557+0000 7f38a6ffd700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x560a021c0320 0x560a021cce90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:12:55.605 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:55.557+0000 7f38a6ffd700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x560a021c0320 0x560a021cce90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.163:39908/0 (socket says 172.21.15.163:39908) 2023-07-14T18:12:55.605 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:55.557+0000 7f38a77fe700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x560a021c18a0 0x560a021ce3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:58090/0 (socket says 172.21.15.163:58090) 2023-07-14T18:12:55.605 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:55.557+0000 7f38a6ffd700 1 -- 172.21.15.163:0/1158113079 learned_addr learned my addr 172.21.15.163:0/1158113079 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:12:55.605 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:55.557+0000 7f38a67fc700 1 --2- 172.21.15.163:0/1158113079 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560a021c0c70 0x560a021cd3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:12:55.605 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:55.558+0000 7f38a77fe700 1 -- 172.21.15.163:0/1158113079 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x560a021c0320 msgr2=0x560a021cce90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:12:55.605 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:55.558+0000 7f38a77fe700 1 --2- 172.21.15.163:0/1158113079 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x560a021c0320 0x560a021cce90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:55.605 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:55.558+0000 7f38a77fe700 1 -- 172.21.15.163:0/1158113079 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560a021c0c70 msgr2=0x560a021cd3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:12:55.606 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:55.558+0000 7f38a77fe700 1 --2- 172.21.15.163:0/1158113079 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560a021c0c70 0x560a021cd3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:55.606 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:55.558+0000 7f38a77fe700 1 -- 172.21.15.163:0/1158113079 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x560a01f3ade0 con 0x560a021c18a0 2023-07-14T18:12:55.606 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:55.558+0000 7f38a6ffd700 1 --2- 172.21.15.163:0/1158113079 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x560a021c0320 0x560a021cce90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T18:12:55.606 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:55.558+0000 7f38a77fe700 1 --2- 172.21.15.163:0/1158113079 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x560a021c18a0 0x560a021ce3e0 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f38a009b130 tx=0x7f38a009ae50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d1dc44126089ef4 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:12:55.606 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:55.558+0000 7f3886ffd700 10 client.0 ms_handle_connect on v2:172.21.15.163:3300/0 2023-07-14T18:12:55.606 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:55.558+0000 7f3886ffd700 1 -- 172.21.15.163:0/1158113079 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38a009b430 con 0x560a021c18a0 2023-07-14T18:12:55.606 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:55.558+0000 7f3886ffd700 1 -- 172.21.15.163:0/1158113079 <== mon.0 v2:172.21.15.163:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 9020+0+0 (secure 0 0 0) 0x7f38a00b2070 con 0x560a021c18a0 2023-07-14T18:12:55.606 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:55.558+0000 7f38b9b35b80 1 -- 172.21.15.163:0/1158113079 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f38a009f460 con 0x560a021c18a0 2023-07-14T18:12:55.607 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:55.558+0000 7f3886ffd700 1 -- 172.21.15.163:0/1158113079 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7f38a009b690 con 0x560a021c18a0 2023-07-14T18:12:55.607 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:55.558+0000 7f38b9b35b80 10 client.15702 fetch_fsmap learned FSMap version 29 2023-07-14T18:12:55.607 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:55.558+0000 7f38b9b35b80 1 -- 172.21.15.163:0/1158113079 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) v3 -- 0x560a01f392b0 con 0x560a021c18a0 2023-07-14T18:12:55.607 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:55.558+0000 7f3886ffd700 1 -- 172.21.15.163:0/1158113079 <== mon.0 v2:172.21.15.163:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f38a009f460 con 0x560a021c18a0 2023-07-14T18:12:55.607 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:55.558+0000 7f3886ffd700 1 -- 172.21.15.163:0/1158113079 <== mon.0 v2:172.21.15.163:3300/0 5 ==== fsmap(e 29) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f38a00c5bd0 con 0x560a021c18a0 2023-07-14T18:12:55.607 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:55.559+0000 7f38b9b35b80 10 client.15702 fetch_fsmap finished waiting for FSMap version 29 2023-07-14T18:12:55.607 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:55.559+0000 7f38b9b35b80 10 client.15702 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-07-14T18:12:55.607 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:55.559+0000 7f38b9b35b80 20 client.15702 populate_metadata read hostname 'smithi163' 2023-07-14T18:12:55.608 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:55.559+0000 7f38b9b35b80 1 --2- 172.21.15.163:0/1158113079 >> [v2:172.21.15.172:6838/3850440096,v1:172.21.15.172:6839/3850440096] conn(0x560a0222a230 0x560a0222c610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:12:55.608 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:55.559+0000 7f38b9b35b80 4 client.15702 mds_command: new command op to 24518 tid=0[{"prefix": "scrub status"}] 2023-07-14T18:12:55.608 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:55.559+0000 7f38b9b35b80 1 -- 172.21.15.163:0/1158113079 --> [v2:172.21.15.172:6838/3850440096,v1:172.21.15.172:6839/3850440096] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x560a02105eb0 con 0x560a0222a230 2023-07-14T18:12:55.608 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:55.559+0000 7f38a6ffd700 1 --2- 172.21.15.163:0/1158113079 >> [v2:172.21.15.172:6838/3850440096,v1:172.21.15.172:6839/3850440096] conn(0x560a0222a230 0x560a0222c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:12:55.608 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:55.559+0000 7f3886ffd700 10 client.15702 ms_handle_connect on v2:172.21.15.172:6838/3850440096 2023-07-14T18:12:55.608 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:55.559+0000 7f38a6ffd700 1 --2- 172.21.15.163:0/1158113079 >> [v2:172.21.15.172:6838/3850440096,v1:172.21.15.172:6839/3850440096] conn(0x560a0222a230 0x560a0222c610 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2aabbc6a370f63b5 server_cookie=2a99a4716f904c4e in_seq=0 out_seq=0 2023-07-14T18:12:55.608 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:55.559+0000 7f3886ffd700 1 -- 172.21.15.163:0/1158113079 <== mds.0 v2:172.21.15.172:6838/3850440096 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x560a02105eb0 con 0x560a0222a230 2023-07-14T18:12:55.609 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:55.559+0000 7f3886ffd700 10 client.15702 handle_command_reply: tid=0 2023-07-14T18:12:55.609 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:55.559+0000 7f38b9b35b80 1 client.15702 shutdown 2023-07-14T18:12:55.609 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:55.559+0000 7f38b9b35b80 1 -- 172.21.15.163:0/1158113079 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x560a021c18a0 msgr2=0x560a021ce3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:12:55.609 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:55.559+0000 7f38b9b35b80 1 --2- 172.21.15.163:0/1158113079 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x560a021c18a0 0x560a021ce3e0 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f38a009b130 tx=0x7f38a009ae50 comp rx=0 tx=0).stop 2023-07-14T18:12:55.609 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:55.560+0000 7f38b9b35b80 1 -- 172.21.15.163:0/1158113079 shutdown_connections 2023-07-14T18:12:55.609 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:55.560+0000 7f38b9b35b80 1 --2- 172.21.15.163:0/1158113079 >> [v2:172.21.15.172:6838/3850440096,v1:172.21.15.172:6839/3850440096] conn(0x560a0222a230 0x560a0222c610 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:55.609 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:55.560+0000 7f38b9b35b80 1 --2- 172.21.15.163:0/1158113079 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x560a021c0320 0x560a021cce90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:55.610 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:55.560+0000 7f3886ffd700 0 client.15702 ms_handle_reset on v2:172.21.15.172:6838/3850440096 2023-07-14T18:12:55.610 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:55.560+0000 7f38b9b35b80 1 --2- 172.21.15.163:0/1158113079 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x560a021c18a0 0x560a021ce3e0 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:55.610 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:55.560+0000 7f38b9b35b80 1 --2- 172.21.15.163:0/1158113079 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560a021c0c70 0x560a021cd3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:55.610 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:55.560+0000 7f38b9b35b80 1 -- 172.21.15.163:0/1158113079 >> 172.21.15.163:0/1158113079 conn(0x560a021b1680 msgr2=0x560a021c7c30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:12:55.610 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:55.560+0000 7f38b9b35b80 1 -- 172.21.15.163:0/1158113079 shutdown_connections 2023-07-14T18:12:55.610 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:55.560+0000 7f38b9b35b80 1 -- 172.21.15.163:0/1158113079 wait complete. 2023-07-14T18:12:55.610 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:55.560+0000 7f38b9b35b80 20 client.15702 trim_cache size 0 max 16384 2023-07-14T18:12:55.611 INFO:teuthology.orchestra.run.smithi163.stdout:{ 2023-07-14T18:12:55.611 INFO:teuthology.orchestra.run.smithi163.stdout: "status": "IDLE (waiting for more scrubs)", 2023-07-14T18:12:55.611 INFO:teuthology.orchestra.run.smithi163.stdout: "scrubs": { 2023-07-14T18:12:55.611 INFO:teuthology.orchestra.run.smithi163.stdout: "7f0335eb-fdcf-4abb-b472-ce11bdd2a506": { 2023-07-14T18:12:55.611 INFO:teuthology.orchestra.run.smithi163.stdout: "path": "/", 2023-07-14T18:12:55.611 INFO:teuthology.orchestra.run.smithi163.stdout: "tag": "7f0335eb-fdcf-4abb-b472-ce11bdd2a506", 2023-07-14T18:12:55.612 INFO:teuthology.orchestra.run.smithi163.stdout: "options": "recursive,force" 2023-07-14T18:12:55.612 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-07-14T18:12:55.612 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-07-14T18:12:55.612 INFO:teuthology.orchestra.run.smithi163.stdout:} 2023-07-14T18:12:55.613 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:55.560+0000 7f38ad99d700 1 -- 172.21.15.163:0/2948713812 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f38900a11d0 msgr2=0x7f38900a3680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:12:55.613 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:55.560+0000 7f38ad99d700 1 --2- 172.21.15.163:0/2948713812 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f38900a11d0 0x7f38900a3680 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f3898009d90 tx=0x7f38980116c0 comp rx=0 tx=0).stop 2023-07-14T18:12:55.613 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:55.560+0000 7f38ad99d700 1 -- 172.21.15.163:0/2948713812 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f38a81058d0 msgr2=0x7f38a819cf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:12:55.614 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:55.560+0000 7f38ad99d700 1 --2- 172.21.15.163:0/2948713812 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f38a81058d0 0x7f38a819cf30 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f38a000b780 tx=0x7f38a000bdf0 comp rx=0 tx=0).stop 2023-07-14T18:12:55.614 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:55.560+0000 7f38ad99d700 1 -- 172.21.15.163:0/2948713812 shutdown_connections 2023-07-14T18:12:55.614 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:55.560+0000 7f38ad99d700 1 --2- 172.21.15.163:0/2948713812 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f38900a11d0 0x7f38900a3680 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:55.614 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:55.560+0000 7f38ad99d700 1 --2- 172.21.15.163:0/2948713812 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f38a81058d0 0x7f38a819cf30 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:55.614 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:55.560+0000 7f38ad99d700 1 --2- 172.21.15.163:0/2948713812 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f38a8100690 0x7f38a8195980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:55.614 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:55.560+0000 7f38ad99d700 1 --2- 172.21.15.163:0/2948713812 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f38a8102fb0 0x7f38a8195ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:12:55.614 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:55.560+0000 7f38ad99d700 1 -- 172.21.15.163:0/2948713812 >> 172.21.15.163:0/2948713812 conn(0x7f38a80fa130 msgr2=0x7f38a81012f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:12:55.615 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:55.560+0000 7f38ad99d700 1 -- 172.21.15.163:0/2948713812 shutdown_connections 2023-07-14T18:12:55.615 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:12:55.560+0000 7f38ad99d700 1 -- 172.21.15.163:0/2948713812 wait complete. 2023-07-14T18:12:55.615 INFO:tasks.cephfs.filesystem:scrub status for tag:7f0335eb-fdcf-4abb-b472-ce11bdd2a506 - {'path': '/', 'tag': '7f0335eb-fdcf-4abb-b472-ce11bdd2a506', 'options': 'recursive,force'} 2023-07-14T18:12:56.175 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:12:55 smithi184 ceph-mon[98481]: from='client.? 172.21.15.163:0/2286061345' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-07-14T18:12:56.176 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:12:55 smithi184 ceph-mon[98481]: from='client.? 172.21.15.163:0/3803137168' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-07-14T18:12:56.176 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:12:55 smithi184 ceph-mon[98481]: scrub queued for path: / 2023-07-14T18:12:56.176 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:12:55 smithi184 ceph-mon[98481]: scrub summary: idle+waiting paths [/] 2023-07-14T18:12:56.176 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:12:55 smithi184 ceph-mon[98481]: scrub summary: active paths [/] 2023-07-14T18:12:56.176 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:12:55 smithi184 ceph-mon[98481]: scrub summary: idle+waiting paths [/] 2023-07-14T18:12:56.218 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:12:55 smithi163 ceph-mon[96576]: from='client.? 172.21.15.163:0/2286061345' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-07-14T18:12:56.218 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:12:55 smithi163 ceph-mon[96576]: from='client.? 172.21.15.163:0/3803137168' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-07-14T18:12:56.218 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:12:55 smithi163 ceph-mon[96576]: scrub queued for path: / 2023-07-14T18:12:56.219 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:12:55 smithi163 ceph-mon[96576]: scrub summary: idle+waiting paths [/] 2023-07-14T18:12:56.219 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:12:55 smithi163 ceph-mon[96576]: scrub summary: active paths [/] 2023-07-14T18:12:56.219 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:12:55 smithi163 ceph-mon[96576]: scrub summary: idle+waiting paths [/] 2023-07-14T18:12:56.276 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:12:55 smithi172 ceph-mon[97983]: from='client.? 172.21.15.163:0/2286061345' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-07-14T18:12:56.277 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:12:55 smithi172 ceph-mon[97983]: from='client.? 172.21.15.163:0/3803137168' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-07-14T18:12:56.277 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:12:55 smithi172 ceph-mon[97983]: scrub queued for path: / 2023-07-14T18:12:56.277 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:12:55 smithi172 ceph-mon[97983]: scrub summary: idle+waiting paths [/] 2023-07-14T18:12:56.277 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:12:55 smithi172 ceph-mon[97983]: scrub summary: active paths [/] 2023-07-14T18:12:56.277 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:12:55 smithi172 ceph-mon[97983]: scrub summary: idle+waiting paths [/] 2023-07-14T18:12:57.175 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:12:56 smithi184 ceph-mon[98481]: pgmap v306: 129 pgs: 129 active+clean; 650 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 1.7 KiB/s wr, 11 op/s 2023-07-14T18:12:57.218 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:12:56 smithi163 ceph-mon[96576]: pgmap v306: 129 pgs: 129 active+clean; 650 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 1.7 KiB/s wr, 11 op/s 2023-07-14T18:12:57.276 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:12:56 smithi172 ceph-mon[97983]: pgmap v306: 129 pgs: 129 active+clean; 650 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 1.7 KiB/s wr, 11 op/s 2023-07-14T18:12:58.175 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:12:57 smithi184 ceph-mon[98481]: pgmap v307: 129 pgs: 129 active+clean; 650 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 1.7 KiB/s wr, 11 op/s 2023-07-14T18:12:58.218 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:12:57 smithi163 ceph-mon[96576]: pgmap v307: 129 pgs: 129 active+clean; 650 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 1.7 KiB/s wr, 11 op/s 2023-07-14T18:12:58.276 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:12:57 smithi172 ceph-mon[97983]: pgmap v307: 129 pgs: 129 active+clean; 650 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 1.7 KiB/s wr, 11 op/s 2023-07-14T18:13:00.926 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:13:00 smithi184 ceph-mon[98481]: pgmap v308: 129 pgs: 129 active+clean; 655 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 2.1 KiB/s wr, 13 op/s 2023-07-14T18:13:00.969 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:13:00 smithi163 ceph-mon[96576]: pgmap v308: 129 pgs: 129 active+clean; 655 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 2.1 KiB/s wr, 13 op/s 2023-07-14T18:13:01.026 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:13:00 smithi172 ceph-mon[97983]: pgmap v308: 129 pgs: 129 active+clean; 655 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 2.1 KiB/s wr, 13 op/s 2023-07-14T18:13:03.175 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:13:02 smithi184 ceph-mon[98481]: pgmap v309: 129 pgs: 129 active+clean; 655 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 1.3 KiB/s wr, 10 op/s 2023-07-14T18:13:03.218 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:13:02 smithi163 ceph-mon[96576]: pgmap v309: 129 pgs: 129 active+clean; 655 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 1.3 KiB/s wr, 10 op/s 2023-07-14T18:13:03.276 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:13:02 smithi172 ceph-mon[97983]: pgmap v309: 129 pgs: 129 active+clean; 655 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 1.3 KiB/s wr, 10 op/s 2023-07-14T18:13:05.176 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:13:04 smithi184 ceph-mon[98481]: pgmap v310: 129 pgs: 129 active+clean; 655 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 1.1 KiB/s wr, 12 op/s 2023-07-14T18:13:05.218 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:13:04 smithi163 ceph-mon[96576]: pgmap v310: 129 pgs: 129 active+clean; 655 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 1.1 KiB/s wr, 12 op/s 2023-07-14T18:13:05.276 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:13:04 smithi172 ceph-mon[97983]: pgmap v310: 129 pgs: 129 active+clean; 655 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 1.1 KiB/s wr, 12 op/s 2023-07-14T18:13:07.176 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:13:06 smithi184 ceph-mon[98481]: pgmap v311: 129 pgs: 129 active+clean; 655 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 597 B/s wr, 10 op/s 2023-07-14T18:13:07.218 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:13:06 smithi163 ceph-mon[96576]: pgmap v311: 129 pgs: 129 active+clean; 655 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 597 B/s wr, 10 op/s 2023-07-14T18:13:07.276 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:13:06 smithi172 ceph-mon[97983]: pgmap v311: 129 pgs: 129 active+clean; 655 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 597 B/s wr, 10 op/s 2023-07-14T18:13:09.175 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:13:08 smithi184 ceph-mon[98481]: pgmap v312: 129 pgs: 129 active+clean; 655 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 597 B/s wr, 9 op/s 2023-07-14T18:13:09.176 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:13:08 smithi184 ceph-mon[98481]: scrub summary: idle 2023-07-14T18:13:09.218 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:13:08 smithi163 ceph-mon[96576]: pgmap v312: 129 pgs: 129 active+clean; 655 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 597 B/s wr, 9 op/s 2023-07-14T18:13:09.218 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:13:08 smithi163 ceph-mon[96576]: scrub summary: idle 2023-07-14T18:13:09.276 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:13:08 smithi172 ceph-mon[97983]: pgmap v312: 129 pgs: 129 active+clean; 655 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 597 B/s wr, 9 op/s 2023-07-14T18:13:09.277 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:13:08 smithi172 ceph-mon[97983]: scrub summary: idle 2023-07-14T18:13:11.176 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:13:10 smithi184 ceph-mon[98481]: pgmap v313: 129 pgs: 129 active+clean; 660 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 1.2 KiB/s wr, 12 op/s 2023-07-14T18:13:11.218 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:13:10 smithi163 ceph-mon[96576]: pgmap v313: 129 pgs: 129 active+clean; 660 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 1.2 KiB/s wr, 12 op/s 2023-07-14T18:13:11.276 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:13:10 smithi172 ceph-mon[97983]: pgmap v313: 129 pgs: 129 active+clean; 660 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 1.2 KiB/s wr, 12 op/s 2023-07-14T18:13:13.176 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:13:12 smithi184 ceph-mon[98481]: pgmap v314: 129 pgs: 129 active+clean; 660 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 767 B/s wr, 9 op/s 2023-07-14T18:13:13.218 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:13:12 smithi163 ceph-mon[96576]: pgmap v314: 129 pgs: 129 active+clean; 660 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 767 B/s wr, 9 op/s 2023-07-14T18:13:13.276 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:13:12 smithi172 ceph-mon[97983]: pgmap v314: 129 pgs: 129 active+clean; 660 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 767 B/s wr, 9 op/s 2023-07-14T18:13:15.176 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:13:14 smithi184 ceph-mon[98481]: pgmap v315: 129 pgs: 129 active+clean; 660 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 767 B/s wr, 11 op/s 2023-07-14T18:13:15.176 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:13:14 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-14T18:13:15.218 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:13:14 smithi163 ceph-mon[96576]: pgmap v315: 129 pgs: 129 active+clean; 660 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 767 B/s wr, 11 op/s 2023-07-14T18:13:15.219 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:13:14 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-14T18:13:15.276 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:13:14 smithi172 ceph-mon[97983]: pgmap v315: 129 pgs: 129 active+clean; 660 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 767 B/s wr, 11 op/s 2023-07-14T18:13:15.277 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:13:14 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-14T18:13:17.176 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:13:16 smithi184 ceph-mon[98481]: pgmap v316: 129 pgs: 129 active+clean; 660 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 682 B/s wr, 9 op/s 2023-07-14T18:13:17.176 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:13:16 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [8, 11]}]: dispatch 2023-07-14T18:13:17.218 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:13:16 smithi163 ceph-mon[96576]: pgmap v316: 129 pgs: 129 active+clean; 660 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 682 B/s wr, 9 op/s 2023-07-14T18:13:17.218 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:13:16 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [8, 11]}]: dispatch 2023-07-14T18:13:17.276 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:13:16 smithi172 ceph-mon[97983]: pgmap v316: 129 pgs: 129 active+clean; 660 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 682 B/s wr, 9 op/s 2023-07-14T18:13:17.277 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:13:16 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [8, 11]}]: dispatch 2023-07-14T18:13:18.176 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:13:17 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [8, 11]}]': finished 2023-07-14T18:13:18.176 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:13:17 smithi184 ceph-mon[98481]: osdmap e87: 12 total, 12 up, 12 in 2023-07-14T18:13:18.177 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:13:17 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:13:18.177 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:13:17 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:13:18.177 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:13:17 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:13:18.178 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:13:17 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:13:18.178 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:13:17 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:13:18.178 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:13:17 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:13:18.178 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:13:17 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T18:13:18.179 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:13:17 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-14T18:13:18.179 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:13:17 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:13:18.218 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:13:17 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [8, 11]}]': finished 2023-07-14T18:13:18.219 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:13:17 smithi163 ceph-mon[96576]: osdmap e87: 12 total, 12 up, 12 in 2023-07-14T18:13:18.219 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:13:17 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:13:18.219 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:13:17 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:13:18.220 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:13:17 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:13:18.220 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:13:17 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:13:18.220 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:13:17 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:13:18.221 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:13:17 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:13:18.221 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:13:17 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T18:13:18.221 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:13:17 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-14T18:13:18.221 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:13:17 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:13:18.276 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:13:17 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [8, 11]}]': finished 2023-07-14T18:13:18.277 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:13:17 smithi172 ceph-mon[97983]: osdmap e87: 12 total, 12 up, 12 in 2023-07-14T18:13:18.277 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:13:17 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:13:18.277 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:13:17 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:13:18.277 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:13:17 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:13:18.277 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:13:17 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:13:18.278 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:13:17 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:13:18.278 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:13:17 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:13:18.278 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:13:17 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T18:13:18.278 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:13:17 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-14T18:13:18.278 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:13:17 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:13:19.176 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:13:18 smithi184 ceph-mon[98481]: pgmap v318: 129 pgs: 129 active+clean; 660 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 818 B/s wr, 10 op/s 2023-07-14T18:13:19.176 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:13:18 smithi184 ceph-mon[98481]: osdmap e88: 12 total, 12 up, 12 in 2023-07-14T18:13:19.218 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:13:18 smithi163 ceph-mon[96576]: pgmap v318: 129 pgs: 129 active+clean; 660 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 818 B/s wr, 10 op/s 2023-07-14T18:13:19.218 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:13:18 smithi163 ceph-mon[96576]: osdmap e88: 12 total, 12 up, 12 in 2023-07-14T18:13:19.277 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:13:18 smithi172 ceph-mon[97983]: pgmap v318: 129 pgs: 129 active+clean; 660 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 818 B/s wr, 10 op/s 2023-07-14T18:13:19.277 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:13:18 smithi172 ceph-mon[97983]: osdmap e88: 12 total, 12 up, 12 in 2023-07-14T18:13:21.176 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:13:20 smithi184 ceph-mon[98481]: pgmap v320: 129 pgs: 129 active+clean; 660 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 10 op/s; 0 B/s, 0 objects/s recovering 2023-07-14T18:13:21.218 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:13:20 smithi163 ceph-mon[96576]: pgmap v320: 129 pgs: 129 active+clean; 660 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 10 op/s; 0 B/s, 0 objects/s recovering 2023-07-14T18:13:21.277 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:13:20 smithi172 ceph-mon[97983]: pgmap v320: 129 pgs: 129 active+clean; 660 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 10 op/s; 0 B/s, 0 objects/s recovering 2023-07-14T18:13:23.176 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:13:22 smithi184 ceph-mon[98481]: pgmap v321: 129 pgs: 129 active+clean; 660 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 7 op/s; 0 B/s, 0 objects/s recovering 2023-07-14T18:13:23.218 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:13:22 smithi163 ceph-mon[96576]: pgmap v321: 129 pgs: 129 active+clean; 660 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 7 op/s; 0 B/s, 0 objects/s recovering 2023-07-14T18:13:23.276 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:13:22 smithi172 ceph-mon[97983]: pgmap v321: 129 pgs: 129 active+clean; 660 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 7 op/s; 0 B/s, 0 objects/s recovering 2023-07-14T18:13:25.176 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:13:24 smithi184 ceph-mon[98481]: pgmap v322: 129 pgs: 129 active+clean; 660 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s; 0 B/s, 0 objects/s recovering 2023-07-14T18:13:25.218 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:13:24 smithi163 ceph-mon[96576]: pgmap v322: 129 pgs: 129 active+clean; 660 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s; 0 B/s, 0 objects/s recovering 2023-07-14T18:13:25.277 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:13:24 smithi172 ceph-mon[97983]: pgmap v322: 129 pgs: 129 active+clean; 660 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s; 0 B/s, 0 objects/s recovering 2023-07-14T18:13:25.616 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-07-14T18:13:25.773 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:25.732+0000 7f37c484e700 1 -- 172.21.15.163:0/1044564125 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f37c00ff470 msgr2=0x7f37c00ff8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:13:25.774 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:25.732+0000 7f37c484e700 1 --2- 172.21.15.163:0/1044564125 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f37c00ff470 0x7f37c00ff8c0 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f37b4009990 tx=0x7f37b4009ca0 comp rx=0 tx=0).stop 2023-07-14T18:13:25.774 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:25.732+0000 7f37c484e700 1 -- 172.21.15.163:0/1044564125 shutdown_connections 2023-07-14T18:13:25.774 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:25.732+0000 7f37c484e700 1 --2- 172.21.15.163:0/1044564125 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f37c00ffe00 0x7f37c01066c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:13:25.774 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:25.732+0000 7f37c484e700 1 --2- 172.21.15.163:0/1044564125 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f37c00fe280 0x7f37c00fe690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:13:25.774 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:25.732+0000 7f37c484e700 1 --2- 172.21.15.163:0/1044564125 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f37c00ff470 0x7f37c00ff8c0 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:13:25.775 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:25.732+0000 7f37c484e700 1 -- 172.21.15.163:0/1044564125 >> 172.21.15.163:0/1044564125 conn(0x7f37c00f98a0 msgr2=0x7f37c00fbcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:13:25.775 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:25.732+0000 7f37c484e700 1 -- 172.21.15.163:0/1044564125 shutdown_connections 2023-07-14T18:13:25.775 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:25.732+0000 7f37c484e700 1 -- 172.21.15.163:0/1044564125 wait complete. 2023-07-14T18:13:25.776 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:25.733+0000 7f37c484e700 1 Processor -- start 2023-07-14T18:13:25.777 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:25.733+0000 7f37c484e700 1 -- start start 2023-07-14T18:13:25.777 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:25.733+0000 7f37c484e700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f37c00fe280 0x7f37c0195890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:13:25.777 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:25.733+0000 7f37c484e700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f37c00ff470 0x7f37c0195dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:13:25.777 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:25.733+0000 7f37c484e700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f37c00ffe00 0x7f37c019ce40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:13:25.777 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:25.733+0000 7f37c484e700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37c019d410 con 0x7f37c00fe280 2023-07-14T18:13:25.777 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:25.733+0000 7f37c484e700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37c019d550 con 0x7f37c00ff470 2023-07-14T18:13:25.777 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:25.733+0000 7f37c484e700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37c019d6e0 con 0x7f37c00ffe00 2023-07-14T18:13:25.777 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:25.734+0000 7f37be59c700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f37c00fe280 0x7f37c0195890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:13:25.778 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:25.734+0000 7f37be59c700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f37c00fe280 0x7f37c0195890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:58100/0 (socket says 172.21.15.163:58100) 2023-07-14T18:13:25.778 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:25.734+0000 7f37be59c700 1 -- 172.21.15.163:0/3688020735 learned_addr learned my addr 172.21.15.163:0/3688020735 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:13:25.778 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:25.734+0000 7f37bed9d700 1 --2- 172.21.15.163:0/3688020735 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f37c00ffe00 0x7f37c019ce40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:13:25.778 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:25.734+0000 7f37bdd9b700 1 --2- 172.21.15.163:0/3688020735 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f37c00ff470 0x7f37c0195dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:13:25.778 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:25.734+0000 7f37be59c700 1 -- 172.21.15.163:0/3688020735 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f37c00ffe00 msgr2=0x7f37c019ce40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:13:25.778 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:25.734+0000 7f37be59c700 1 --2- 172.21.15.163:0/3688020735 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f37c00ffe00 0x7f37c019ce40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:13:25.778 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:25.734+0000 7f37be59c700 1 -- 172.21.15.163:0/3688020735 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f37c00ff470 msgr2=0x7f37c0195dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:13:25.779 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:25.734+0000 7f37be59c700 1 --2- 172.21.15.163:0/3688020735 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f37c00ff470 0x7f37c0195dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:13:25.779 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:25.734+0000 7f37be59c700 1 -- 172.21.15.163:0/3688020735 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37b40095f0 con 0x7f37c00fe280 2023-07-14T18:13:25.779 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:25.734+0000 7f37bdd9b700 1 --2- 172.21.15.163:0/3688020735 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f37c00ff470 0x7f37c0195dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T18:13:25.779 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:25.734+0000 7f37be59c700 1 --2- 172.21.15.163:0/3688020735 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f37c00fe280 0x7f37c0195890 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f37b000d980 tx=0x7f37b000dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:13:25.780 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:25.734+0000 7f37af7fe700 1 -- 172.21.15.163:0/3688020735 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37b0004020 con 0x7f37c00fe280 2023-07-14T18:13:25.780 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:25.734+0000 7f37c484e700 1 -- 172.21.15.163:0/3688020735 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f37c019d9c0 con 0x7f37c00fe280 2023-07-14T18:13:25.780 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:25.734+0000 7f37af7fe700 1 -- 172.21.15.163:0/3688020735 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f37b0009730 con 0x7f37c00fe280 2023-07-14T18:13:25.780 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:25.734+0000 7f37af7fe700 1 -- 172.21.15.163:0/3688020735 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37b0003a00 con 0x7f37c00fe280 2023-07-14T18:13:25.780 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:25.734+0000 7f37c484e700 1 -- 172.21.15.163:0/3688020735 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f37c0107d10 con 0x7f37c00fe280 2023-07-14T18:13:25.782 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:25.737+0000 7f37af7fe700 1 -- 172.21.15.163:0/3688020735 <== mon.0 v2:172.21.15.163:3300/0 4 ==== mgrmap(e 18) v1 ==== 135716+0+0 (secure 0 0 0) 0x7f37b00098a0 con 0x7f37c00fe280 2023-07-14T18:13:25.782 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:25.738+0000 7f37af7fe700 1 --2- 172.21.15.163:0/3688020735 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f37a80a1150 0x7f37a80a3600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:13:25.783 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:25.738+0000 7f37af7fe700 1 -- 172.21.15.163:0/3688020735 <== mon.0 v2:172.21.15.163:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 9049+0+0 (secure 0 0 0) 0x7f37b00cc970 con 0x7f37c00fe280 2023-07-14T18:13:25.783 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:25.738+0000 7f37bdd9b700 1 --2- 172.21.15.163:0/3688020735 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f37a80a1150 0x7f37a80a3600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:13:25.783 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:25.739+0000 7f37bdd9b700 1 --2- 172.21.15.163:0/3688020735 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f37a80a1150 0x7f37a80a3600 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f37b400b5c0 tx=0x7f37b4005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:13:25.783 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:25.739+0000 7f37d09e6b80 1 Processor -- start 2023-07-14T18:13:25.783 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:25.739+0000 7f37d09e6b80 1 -- start start 2023-07-14T18:13:25.783 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:25.739+0000 7f37d09e6b80 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5571e49b5f60 0x5571e49b6370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:13:25.783 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:25.739+0000 7f37d09e6b80 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5571e49b68b0 0x5571e49b6ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:13:25.784 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:25.739+0000 7f37d09e6b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5571e49b74b0 0x5571e49b7920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:13:25.784 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:25.739+0000 7f37d09e6b80 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x5571e48bacb0 con 0x5571e49b5f60 2023-07-14T18:13:25.784 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:25.739+0000 7f37d09e6b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x5571e490da40 con 0x5571e49b74b0 2023-07-14T18:13:25.784 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:25.739+0000 7f37d09e6b80 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x5571e4906ed0 con 0x5571e49b68b0 2023-07-14T18:13:25.784 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:25.740+0000 7f37be59c700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5571e49b5f60 0x5571e49b6370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:13:25.784 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:25.740+0000 7f37be59c700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5571e49b5f60 0x5571e49b6370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:58108/0 (socket says 172.21.15.163:58108) 2023-07-14T18:13:25.784 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:25.740+0000 7f37be59c700 1 -- 172.21.15.163:0/3469740624 learned_addr learned my addr 172.21.15.163:0/3469740624 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:13:25.784 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:25.740+0000 7f37bed9d700 1 --2- 172.21.15.163:0/3469740624 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5571e49b74b0 0x5571e49b7920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:13:25.785 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:25.740+0000 7f37be59c700 1 -- 172.21.15.163:0/3469740624 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5571e49b68b0 msgr2=0x5571e49b6ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:13:25.785 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:25.740+0000 7f37bdd9b700 1 --2- 172.21.15.163:0/3469740624 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5571e49b68b0 0x5571e49b6ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:13:25.785 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:25.740+0000 7f37be59c700 1 --2- 172.21.15.163:0/3469740624 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5571e49b68b0 0x5571e49b6ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:13:25.785 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:25.740+0000 7f37be59c700 1 -- 172.21.15.163:0/3469740624 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5571e49b74b0 msgr2=0x5571e49b7920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:13:25.785 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:25.740+0000 7f37be59c700 1 --2- 172.21.15.163:0/3469740624 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5571e49b74b0 0x5571e49b7920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:13:25.785 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:25.740+0000 7f37be59c700 1 -- 172.21.15.163:0/3469740624 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5571e4734de0 con 0x5571e49b5f60 2023-07-14T18:13:25.785 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:25.740+0000 7f37bed9d700 1 --2- 172.21.15.163:0/3469740624 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5571e49b74b0 0x5571e49b7920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T18:13:25.786 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:25.740+0000 7f37be59c700 1 --2- 172.21.15.163:0/3469740624 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5571e49b5f60 0x5571e49b6370 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f37b0095f50 tx=0x7f37b0099660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=270660b78b5686df server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:13:25.786 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:25.740+0000 7f37acff9700 1 -- 172.21.15.163:0/3469740624 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37b00b2210 con 0x5571e49b5f60 2023-07-14T18:13:25.786 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:25.740+0000 7f37acff9700 1 -- 172.21.15.163:0/3469740624 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f37b0099a50 con 0x5571e49b5f60 2023-07-14T18:13:25.786 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:25.740+0000 7f37acff9700 1 -- 172.21.15.163:0/3469740624 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37b00a1a10 con 0x5571e49b5f60 2023-07-14T18:13:25.786 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:25.741+0000 7f37d09e6b80 1 -- 172.21.15.163:0/3469740624 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5571e49b5f60 msgr2=0x5571e49b6370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:13:25.786 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:25.741+0000 7f37d09e6b80 1 --2- 172.21.15.163:0/3469740624 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5571e49b5f60 0x5571e49b6370 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f37b0095f50 tx=0x7f37b0099660 comp rx=0 tx=0).stop 2023-07-14T18:13:25.786 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:25.741+0000 7f37d09e6b80 1 -- 172.21.15.163:0/3469740624 shutdown_connections 2023-07-14T18:13:25.786 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:25.741+0000 7f37d09e6b80 1 --2- 172.21.15.163:0/3469740624 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5571e49b74b0 0x5571e49b7920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:13:25.787 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:25.741+0000 7f37d09e6b80 1 --2- 172.21.15.163:0/3469740624 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5571e49b5f60 0x5571e49b6370 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:13:25.787 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:25.741+0000 7f37d09e6b80 1 --2- 172.21.15.163:0/3469740624 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5571e49b68b0 0x5571e49b6ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:13:25.787 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:25.741+0000 7f37d09e6b80 1 -- 172.21.15.163:0/3469740624 >> 172.21.15.163:0/3469740624 conn(0x5571e49ab680 msgr2=0x5571e49b09d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:13:25.787 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:25.741+0000 7f37d09e6b80 1 -- 172.21.15.163:0/3469740624 shutdown_connections 2023-07-14T18:13:25.787 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:25.741+0000 7f37d09e6b80 1 -- 172.21.15.163:0/3469740624 wait complete. 2023-07-14T18:13:25.790 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:25.742+0000 7f37d09e6b80 1 -- start start 2023-07-14T18:13:25.790 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:25.742+0000 7f37d09e6b80 1 Processor -- start 2023-07-14T18:13:25.790 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:25.742+0000 7f37d09e6b80 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5571e49b5f60 0x5571e49bf9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:13:25.790 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:25.742+0000 7f37d09e6b80 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5571e49b68b0 0x5571e49bff00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:13:25.791 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:25.742+0000 7f37d09e6b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5571e49b74b0 0x5571e49c6f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:13:25.791 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:25.742+0000 7f37d09e6b80 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x5571e48a6ac0 con 0x5571e49b5f60 2023-07-14T18:13:25.791 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:25.742+0000 7f37d09e6b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x5571e48a67c0 con 0x5571e49b74b0 2023-07-14T18:13:25.791 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:25.742+0000 7f37d09e6b80 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x5571e478a920 con 0x5571e49b68b0 2023-07-14T18:13:25.791 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:25.742+0000 7f37d09e6b80 10 client.0 _ll_register_callbacks cb 0x5571e48a4760 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T18:13:25.791 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:25.742+0000 7f37be59c700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5571e49b5f60 0x5571e49bf9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:13:25.791 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:25.742+0000 7f37be59c700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5571e49b5f60 0x5571e49bf9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:58114/0 (socket says 172.21.15.163:58114) 2023-07-14T18:13:25.792 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:25.742+0000 7f37be59c700 1 -- 172.21.15.163:0/3954544719 learned_addr learned my addr 172.21.15.163:0/3954544719 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:13:25.792 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:25.743+0000 7f37bed9d700 1 --2- 172.21.15.163:0/3954544719 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5571e49b74b0 0x5571e49c6f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:13:25.792 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:25.743+0000 7f37bdd9b700 1 --2- 172.21.15.163:0/3954544719 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5571e49b68b0 0x5571e49bff00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:13:25.792 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:25.743+0000 7f37be59c700 1 -- 172.21.15.163:0/3954544719 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5571e49b68b0 msgr2=0x5571e49bff00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:13:25.792 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:25.743+0000 7f37be59c700 1 --2- 172.21.15.163:0/3954544719 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5571e49b68b0 0x5571e49bff00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:13:25.792 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:25.743+0000 7f37be59c700 1 -- 172.21.15.163:0/3954544719 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5571e49b74b0 msgr2=0x5571e49c6f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:13:25.792 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:25.743+0000 7f37be59c700 1 --2- 172.21.15.163:0/3954544719 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5571e49b74b0 0x5571e49c6f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:13:25.792 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:25.743+0000 7f37be59c700 1 -- 172.21.15.163:0/3954544719 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f37c0107d10 con 0x5571e49b5f60 2023-07-14T18:13:25.793 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:25.743+0000 7f37bdd9b700 1 --2- 172.21.15.163:0/3954544719 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5571e49b68b0 0x5571e49bff00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T18:13:25.793 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:25.743+0000 7f37be59c700 1 --2- 172.21.15.163:0/3954544719 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5571e49b5f60 0x5571e49bf9c0 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f37b00a1970 tx=0x7f37b00b22c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc4310f95d15f6a2 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:13:25.793 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:25.743+0000 7f37a5ffb700 10 client.0 ms_handle_connect on v2:172.21.15.163:3300/0 2023-07-14T18:13:25.793 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:25.743+0000 7f37a5ffb700 1 -- 172.21.15.163:0/3954544719 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37b00a1c10 con 0x5571e49b5f60 2023-07-14T18:13:25.793 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:25.743+0000 7f37a5ffb700 1 -- 172.21.15.163:0/3954544719 <== mon.0 v2:172.21.15.163:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 9049+0+0 (secure 0 0 0) 0x7f37b0004180 con 0x5571e49b5f60 2023-07-14T18:13:25.793 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:25.743+0000 7f37d09e6b80 1 -- 172.21.15.163:0/3954544719 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5571e48604f0 con 0x5571e49b5f60 2023-07-14T18:13:25.793 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:25.743+0000 7f37a5ffb700 1 -- 172.21.15.163:0/3954544719 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7f37b0004340 con 0x5571e49b5f60 2023-07-14T18:13:25.793 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:25.743+0000 7f37d09e6b80 10 client.15714 fetch_fsmap learned FSMap version 29 2023-07-14T18:13:25.794 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:25.743+0000 7f37d09e6b80 1 -- 172.21.15.163:0/3954544719 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) v3 -- 0x5571e471dc60 con 0x5571e49b5f60 2023-07-14T18:13:25.794 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:25.743+0000 7f37a5ffb700 1 -- 172.21.15.163:0/3954544719 <== mon.0 v2:172.21.15.163:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x5571e48604f0 con 0x5571e49b5f60 2023-07-14T18:13:25.794 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:25.744+0000 7f37a5ffb700 1 -- 172.21.15.163:0/3954544719 <== mon.0 v2:172.21.15.163:3300/0 5 ==== fsmap(e 29) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f37b0095840 con 0x5571e49b5f60 2023-07-14T18:13:25.794 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:25.744+0000 7f37d09e6b80 10 client.15714 fetch_fsmap finished waiting for FSMap version 29 2023-07-14T18:13:25.794 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:25.744+0000 7f37d09e6b80 10 client.15714 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-07-14T18:13:25.794 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:25.744+0000 7f37d09e6b80 20 client.15714 populate_metadata read hostname 'smithi163' 2023-07-14T18:13:25.794 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:25.744+0000 7f37d09e6b80 1 --2- 172.21.15.163:0/3954544719 >> [v2:172.21.15.172:6838/3850440096,v1:172.21.15.172:6839/3850440096] conn(0x5571e49cb430 0x5571e49cd840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:13:25.794 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:25.744+0000 7f37d09e6b80 4 client.15714 mds_command: new command op to 24518 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-14T18:13:25.795 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:25.744+0000 7f37d09e6b80 1 -- 172.21.15.163:0/3954544719 --> [v2:172.21.15.172:6838/3850440096,v1:172.21.15.172:6839/3850440096] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5571e4984da0 con 0x5571e49cb430 2023-07-14T18:13:25.795 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:25.744+0000 7f37bdd9b700 1 --2- 172.21.15.163:0/3954544719 >> [v2:172.21.15.172:6838/3850440096,v1:172.21.15.172:6839/3850440096] conn(0x5571e49cb430 0x5571e49cd840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:13:25.795 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:25.745+0000 7f37a5ffb700 10 client.15714 ms_handle_connect on v2:172.21.15.172:6838/3850440096 2023-07-14T18:13:25.795 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:25.745+0000 7f37bdd9b700 1 --2- 172.21.15.163:0/3954544719 >> [v2:172.21.15.172:6838/3850440096,v1:172.21.15.172:6839/3850440096] conn(0x5571e49cb430 0x5571e49cd840 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=47308ab1eb027d13 server_cookie=74c32f9121c4b2ed in_seq=0 out_seq=0 2023-07-14T18:13:25.795 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:25.745+0000 7f37a5ffb700 1 -- 172.21.15.163:0/3954544719 <== mds.0 v2:172.21.15.172:6838/3850440096 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18017 (crc 0 0 0) 0x5571e4984da0 con 0x5571e49cb430 2023-07-14T18:13:25.795 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:25.745+0000 7f37a5ffb700 10 client.15714 handle_command_reply: tid=0 2023-07-14T18:13:25.795 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:25.745+0000 7f37d09e6b80 1 client.15714 shutdown 2023-07-14T18:13:25.796 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:25.745+0000 7f37d09e6b80 1 -- 172.21.15.163:0/3954544719 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5571e49b5f60 msgr2=0x5571e49bf9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:13:25.796 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:25.745+0000 7f37d09e6b80 1 --2- 172.21.15.163:0/3954544719 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5571e49b5f60 0x5571e49bf9c0 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f37b00a1970 tx=0x7f37b00b22c0 comp rx=0 tx=0).stop 2023-07-14T18:13:25.796 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:25.745+0000 7f37d09e6b80 1 -- 172.21.15.163:0/3954544719 shutdown_connections 2023-07-14T18:13:25.796 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:25.746+0000 7f37d09e6b80 1 --2- 172.21.15.163:0/3954544719 >> [v2:172.21.15.172:6838/3850440096,v1:172.21.15.172:6839/3850440096] conn(0x5571e49cb430 0x5571e49cd840 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:13:25.796 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:25.746+0000 7f37d09e6b80 1 --2- 172.21.15.163:0/3954544719 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5571e49b74b0 0x5571e49c6f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:13:25.796 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:25.746+0000 7f37d09e6b80 1 --2- 172.21.15.163:0/3954544719 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5571e49b5f60 0x5571e49bf9c0 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:13:25.796 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:25.746+0000 7f37d09e6b80 1 --2- 172.21.15.163:0/3954544719 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5571e49b68b0 0x5571e49bff00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:13:25.796 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:25.746+0000 7f37d09e6b80 1 -- 172.21.15.163:0/3954544719 >> 172.21.15.163:0/3954544719 conn(0x5571e49ab680 msgr2=0x5571e49af650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:13:25.797 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:25.746+0000 7f37a5ffb700 0 client.15714 ms_handle_reset on v2:172.21.15.172:6838/3850440096 2023-07-14T18:13:25.797 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:25.746+0000 7f37d09e6b80 1 -- 172.21.15.163:0/3954544719 shutdown_connections 2023-07-14T18:13:25.797 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:25.746+0000 7f37d09e6b80 1 -- 172.21.15.163:0/3954544719 wait complete. 2023-07-14T18:13:25.797 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:25.746+0000 7f37d09e6b80 20 client.15714 trim_cache size 0 max 16384 2023-07-14T18:13:25.804 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:25.762+0000 7f37d09e6b80 1 Processor -- start 2023-07-14T18:13:25.804 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:25.762+0000 7f37d09e6b80 1 -- start start 2023-07-14T18:13:25.804 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:25.762+0000 7f37d09e6b80 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5571e49b5f60 0x5571e49b00f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:13:25.804 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:25.762+0000 7f37d09e6b80 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5571e49b68b0 0x5571e49c6f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:13:25.804 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:25.762+0000 7f37d09e6b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5571e49b74b0 0x5571e49bd890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:13:25.804 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:25.762+0000 7f37d09e6b80 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x5571e49b7da0 con 0x5571e49b68b0 2023-07-14T18:13:25.805 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:25.762+0000 7f37d09e6b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x5571e49c0bb0 con 0x5571e49b74b0 2023-07-14T18:13:25.805 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:25.762+0000 7f37d09e6b80 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x5571e49bee70 con 0x5571e49b5f60 2023-07-14T18:13:25.805 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:25.762+0000 7f37bdd9b700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5571e49b68b0 0x5571e49c6f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:13:25.805 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:25.763+0000 7f37bdd9b700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5571e49b68b0 0x5571e49c6f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:58124/0 (socket says 172.21.15.163:58124) 2023-07-14T18:13:25.805 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:25.763+0000 7f37bdd9b700 1 -- 172.21.15.163:0/3363413181 learned_addr learned my addr 172.21.15.163:0/3363413181 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:13:25.805 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:25.763+0000 7f37be59c700 1 --2- 172.21.15.163:0/3363413181 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5571e49b5f60 0x5571e49b00f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:13:25.805 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:25.763+0000 7f37bed9d700 1 --2- 172.21.15.163:0/3363413181 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5571e49b74b0 0x5571e49bd890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:13:25.806 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:25.763+0000 7f37bdd9b700 1 -- 172.21.15.163:0/3363413181 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5571e49b5f60 msgr2=0x5571e49b00f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:13:25.806 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:25.763+0000 7f37bdd9b700 1 --2- 172.21.15.163:0/3363413181 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5571e49b5f60 0x5571e49b00f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:13:25.806 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:25.763+0000 7f37bdd9b700 1 -- 172.21.15.163:0/3363413181 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5571e49b74b0 msgr2=0x5571e49bd890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:13:25.806 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:25.763+0000 7f37bdd9b700 1 --2- 172.21.15.163:0/3363413181 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5571e49b74b0 0x5571e49bd890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:13:25.806 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:25.763+0000 7f37bdd9b700 1 -- 172.21.15.163:0/3363413181 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5571e475b250 con 0x5571e49b68b0 2023-07-14T18:13:25.809 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:25.763+0000 7f37bdd9b700 1 --2- 172.21.15.163:0/3363413181 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5571e49b68b0 0x5571e49c6f00 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f37b40059d0 tx=0x7f37b401f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d261f2296f3ea4c9 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:13:25.809 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:25.763+0000 7f37ad7fa700 1 -- 172.21.15.163:0/3363413181 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37b400baf0 con 0x5571e49b68b0 2023-07-14T18:13:25.810 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:25.763+0000 7f37ad7fa700 1 -- 172.21.15.163:0/3363413181 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f37b402a040 con 0x5571e49b68b0 2023-07-14T18:13:25.810 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:25.763+0000 7f37ad7fa700 1 -- 172.21.15.163:0/3363413181 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37b4031e00 con 0x5571e49b68b0 2023-07-14T18:13:25.810 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:25.764+0000 7f37d09e6b80 1 -- 172.21.15.163:0/3363413181 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5571e49b68b0 msgr2=0x5571e49c6f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:13:25.810 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:25.764+0000 7f37d09e6b80 1 --2- 172.21.15.163:0/3363413181 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5571e49b68b0 0x5571e49c6f00 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f37b40059d0 tx=0x7f37b401f000 comp rx=0 tx=0).stop 2023-07-14T18:13:25.810 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:25.764+0000 7f37d09e6b80 1 -- 172.21.15.163:0/3363413181 shutdown_connections 2023-07-14T18:13:25.810 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:25.764+0000 7f37d09e6b80 1 --2- 172.21.15.163:0/3363413181 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5571e49b5f60 0x5571e49b00f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:13:25.810 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:25.764+0000 7f37d09e6b80 1 --2- 172.21.15.163:0/3363413181 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5571e49b74b0 0x5571e49bd890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:13:25.811 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:25.764+0000 7f37d09e6b80 1 --2- 172.21.15.163:0/3363413181 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5571e49b68b0 0x5571e49c6f00 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:13:25.811 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:25.764+0000 7f37d09e6b80 1 -- 172.21.15.163:0/3363413181 >> 172.21.15.163:0/3363413181 conn(0x5571e49ab680 msgr2=0x5571e49c7830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:13:25.811 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:25.764+0000 7f37d09e6b80 1 -- 172.21.15.163:0/3363413181 shutdown_connections 2023-07-14T18:13:25.811 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:25.764+0000 7f37d09e6b80 1 -- 172.21.15.163:0/3363413181 wait complete. 2023-07-14T18:13:25.811 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:25.764+0000 7f37d09e6b80 1 -- start start 2023-07-14T18:13:25.811 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:25.765+0000 7f37d09e6b80 1 Processor -- start 2023-07-14T18:13:25.811 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:25.765+0000 7f37d09e6b80 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5571e49b5f60 0x5571e49c67e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:13:25.811 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:25.765+0000 7f37d09e6b80 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5571e49b68b0 0x5571e49c6d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:13:25.812 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:25.765+0000 7f37d09e6b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5571e49b74b0 0x5571e49c3280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:13:25.812 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:25.765+0000 7f37d09e6b80 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x5571e49c38d0 con 0x5571e49b5f60 2023-07-14T18:13:25.812 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:25.765+0000 7f37d09e6b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x5571e49c3a40 con 0x5571e49b74b0 2023-07-14T18:13:25.812 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:25.765+0000 7f37d09e6b80 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x5571e49c3c00 con 0x5571e49b68b0 2023-07-14T18:13:25.812 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:25.765+0000 7f37d09e6b80 10 client.0 _ll_register_callbacks cb 0x7f37b00998d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T18:13:25.812 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:25.765+0000 7f37be59c700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5571e49b5f60 0x5571e49c67e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:13:25.812 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:25.765+0000 7f37be59c700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5571e49b5f60 0x5571e49c67e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:58128/0 (socket says 172.21.15.163:58128) 2023-07-14T18:13:25.813 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:25.765+0000 7f37be59c700 1 -- 172.21.15.163:0/4231502240 learned_addr learned my addr 172.21.15.163:0/4231502240 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:13:25.813 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:25.765+0000 7f37bdd9b700 1 --2- 172.21.15.163:0/4231502240 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5571e49b68b0 0x5571e49c6d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:13:25.813 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:25.765+0000 7f37bed9d700 1 --2- 172.21.15.163:0/4231502240 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5571e49b74b0 0x5571e49c3280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:13:25.813 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:25.765+0000 7f37be59c700 1 -- 172.21.15.163:0/4231502240 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5571e49b68b0 msgr2=0x5571e49c6d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:13:25.813 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:25.765+0000 7f37be59c700 1 --2- 172.21.15.163:0/4231502240 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5571e49b68b0 0x5571e49c6d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:13:25.813 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:25.765+0000 7f37be59c700 1 -- 172.21.15.163:0/4231502240 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5571e49b74b0 msgr2=0x5571e49c3280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:13:25.813 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:25.765+0000 7f37be59c700 1 --2- 172.21.15.163:0/4231502240 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5571e49b74b0 0x5571e49c3280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:13:25.813 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:25.765+0000 7f37be59c700 1 -- 172.21.15.163:0/4231502240 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f37c0067400 con 0x5571e49b5f60 2023-07-14T18:13:25.814 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:25.765+0000 7f37bdd9b700 1 --2- 172.21.15.163:0/4231502240 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5571e49b68b0 0x5571e49c6d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T18:13:25.814 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:25.765+0000 7f37bed9d700 1 --2- 172.21.15.163:0/4231502240 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5571e49b74b0 0x5571e49c3280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T18:13:25.814 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:25.765+0000 7f37be59c700 1 --2- 172.21.15.163:0/4231502240 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5571e49b5f60 0x5571e49c67e0 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f37b00046a0 tx=0x7f37b000d910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d49deea046c6867a server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:13:25.814 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:25.765+0000 7f37a5ffb700 10 client.0 ms_handle_connect on v2:172.21.15.163:3300/0 2023-07-14T18:13:25.814 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:25.766+0000 7f37a5ffb700 1 -- 172.21.15.163:0/4231502240 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37b009da80 con 0x5571e49b5f60 2023-07-14T18:13:25.814 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:25.766+0000 7f37a5ffb700 1 -- 172.21.15.163:0/4231502240 <== mon.0 v2:172.21.15.163:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 9049+0+0 (secure 0 0 0) 0x7f37b0004180 con 0x5571e49b5f60 2023-07-14T18:13:25.814 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:25.766+0000 7f37d09e6b80 1 -- 172.21.15.163:0/4231502240 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f37b0099a50 con 0x5571e49b5f60 2023-07-14T18:13:25.814 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:25.766+0000 7f37a5ffb700 1 -- 172.21.15.163:0/4231502240 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7f37b0004340 con 0x5571e49b5f60 2023-07-14T18:13:25.815 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:25.766+0000 7f37d09e6b80 10 client.15720 fetch_fsmap learned FSMap version 29 2023-07-14T18:13:25.815 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:25.766+0000 7f37d09e6b80 1 -- 172.21.15.163:0/4231502240 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) v3 -- 0x5571e47332b0 con 0x5571e49b5f60 2023-07-14T18:13:25.815 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:25.766+0000 7f37a5ffb700 1 -- 172.21.15.163:0/4231502240 <== mon.0 v2:172.21.15.163:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f37b0099a50 con 0x5571e49b5f60 2023-07-14T18:13:25.815 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:25.766+0000 7f37a5ffb700 1 -- 172.21.15.163:0/4231502240 <== mon.0 v2:172.21.15.163:3300/0 5 ==== fsmap(e 29) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f37b0098b00 con 0x5571e49b5f60 2023-07-14T18:13:25.815 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:25.766+0000 7f37d09e6b80 10 client.15720 fetch_fsmap finished waiting for FSMap version 29 2023-07-14T18:13:25.815 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:25.766+0000 7f37d09e6b80 10 client.15720 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-07-14T18:13:25.815 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:25.766+0000 7f37d09e6b80 20 client.15720 populate_metadata read hostname 'smithi163' 2023-07-14T18:13:25.815 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:25.766+0000 7f37d09e6b80 1 --2- 172.21.15.163:0/4231502240 >> [v2:172.21.15.172:6838/3850440096,v1:172.21.15.172:6839/3850440096] conn(0x5571e4a20180 0x5571e4a22560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:13:25.816 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:25.766+0000 7f37d09e6b80 4 client.15720 mds_command: new command op to 24518 tid=0[{"prefix": "scrub status"}] 2023-07-14T18:13:25.816 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:25.766+0000 7f37d09e6b80 1 -- 172.21.15.163:0/4231502240 --> [v2:172.21.15.172:6838/3850440096,v1:172.21.15.172:6839/3850440096] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x5571e48ffeb0 con 0x5571e4a20180 2023-07-14T18:13:25.816 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:25.767+0000 7f37bdd9b700 1 --2- 172.21.15.163:0/4231502240 >> [v2:172.21.15.172:6838/3850440096,v1:172.21.15.172:6839/3850440096] conn(0x5571e4a20180 0x5571e4a22560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:13:25.816 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:25.767+0000 7f37a5ffb700 10 client.15720 ms_handle_connect on v2:172.21.15.172:6838/3850440096 2023-07-14T18:13:25.816 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:25.767+0000 7f37bdd9b700 1 --2- 172.21.15.163:0/4231502240 >> [v2:172.21.15.172:6838/3850440096,v1:172.21.15.172:6839/3850440096] conn(0x5571e4a20180 0x5571e4a22560 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1b25ee02c1c2b35e server_cookie=c814de6a83dc2802 in_seq=0 out_seq=0 2023-07-14T18:13:25.816 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:25.767+0000 7f37a5ffb700 1 -- 172.21.15.163:0/4231502240 <== mds.0 v2:172.21.15.172:6838/3850440096 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x5571e48ffeb0 con 0x5571e4a20180 2023-07-14T18:13:25.816 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:25.767+0000 7f37a5ffb700 10 client.15720 handle_command_reply: tid=0 2023-07-14T18:13:25.817 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:25.767+0000 7f37d09e6b80 1 client.15720 shutdown 2023-07-14T18:13:25.817 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:25.767+0000 7f37d09e6b80 1 -- 172.21.15.163:0/4231502240 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5571e49b5f60 msgr2=0x5571e49c67e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:13:25.817 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:25.767+0000 7f37d09e6b80 1 --2- 172.21.15.163:0/4231502240 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5571e49b5f60 0x5571e49c67e0 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f37b00046a0 tx=0x7f37b000d910 comp rx=0 tx=0).stop 2023-07-14T18:13:25.817 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:25.767+0000 7f37d09e6b80 1 -- 172.21.15.163:0/4231502240 shutdown_connections 2023-07-14T18:13:25.817 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:25.767+0000 7f37d09e6b80 1 --2- 172.21.15.163:0/4231502240 >> [v2:172.21.15.172:6838/3850440096,v1:172.21.15.172:6839/3850440096] conn(0x5571e4a20180 0x5571e4a22560 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:13:25.817 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:25.767+0000 7f37d09e6b80 1 --2- 172.21.15.163:0/4231502240 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5571e49b74b0 0x5571e49c3280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:13:25.817 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:25.767+0000 7f37d09e6b80 1 --2- 172.21.15.163:0/4231502240 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5571e49b5f60 0x5571e49c67e0 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:13:25.817 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:25.767+0000 7f37a5ffb700 0 client.15720 ms_handle_reset on v2:172.21.15.172:6838/3850440096 2023-07-14T18:13:25.818 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:25.767+0000 7f37d09e6b80 1 --2- 172.21.15.163:0/4231502240 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5571e49b68b0 0x5571e49c6d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:13:25.818 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:25.767+0000 7f37d09e6b80 1 -- 172.21.15.163:0/4231502240 >> 172.21.15.163:0/4231502240 conn(0x5571e49ab680 msgr2=0x5571e49b00f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:13:25.818 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:25.768+0000 7f37d09e6b80 1 -- 172.21.15.163:0/4231502240 shutdown_connections 2023-07-14T18:13:25.818 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:25.768+0000 7f37d09e6b80 1 -- 172.21.15.163:0/4231502240 wait complete. 2023-07-14T18:13:25.818 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:25.768+0000 7f37d09e6b80 20 client.15720 trim_cache size 0 max 16384 2023-07-14T18:13:25.818 INFO:teuthology.orchestra.run.smithi163.stdout:{ 2023-07-14T18:13:25.819 INFO:teuthology.orchestra.run.smithi163.stdout: "status": "no active scrubs running", 2023-07-14T18:13:25.819 INFO:teuthology.orchestra.run.smithi163.stdout: "scrubs": {} 2023-07-14T18:13:25.819 INFO:teuthology.orchestra.run.smithi163.stdout:} 2023-07-14T18:13:25.820 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:25.768+0000 7f37c484e700 1 -- 172.21.15.163:0/3688020735 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f37a80a1150 msgr2=0x7f37a80a3600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:13:25.820 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:25.768+0000 7f37c484e700 1 --2- 172.21.15.163:0/3688020735 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f37a80a1150 0x7f37a80a3600 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f37b400b5c0 tx=0x7f37b4005fb0 comp rx=0 tx=0).stop 2023-07-14T18:13:25.820 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:25.768+0000 7f37c484e700 1 -- 172.21.15.163:0/3688020735 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f37c00fe280 msgr2=0x7f37c0195890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:13:25.820 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:25.768+0000 7f37c484e700 1 --2- 172.21.15.163:0/3688020735 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f37c00fe280 0x7f37c0195890 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f37b000d980 tx=0x7f37b000dc90 comp rx=0 tx=0).stop 2023-07-14T18:13:25.820 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:25.768+0000 7f37c484e700 1 -- 172.21.15.163:0/3688020735 shutdown_connections 2023-07-14T18:13:25.820 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:25.768+0000 7f37c484e700 1 --2- 172.21.15.163:0/3688020735 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f37a80a1150 0x7f37a80a3600 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:13:25.821 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:25.768+0000 7f37c484e700 1 --2- 172.21.15.163:0/3688020735 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f37c00ffe00 0x7f37c019ce40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:13:25.821 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:25.768+0000 7f37c484e700 1 --2- 172.21.15.163:0/3688020735 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f37c00fe280 0x7f37c0195890 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:13:25.821 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:25.768+0000 7f37c484e700 1 --2- 172.21.15.163:0/3688020735 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f37c00ff470 0x7f37c0195dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:13:25.821 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:25.768+0000 7f37c484e700 1 -- 172.21.15.163:0/3688020735 >> 172.21.15.163:0/3688020735 conn(0x7f37c00f98a0 msgr2=0x7f37c00fbb80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:13:25.821 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:25.768+0000 7f37c484e700 1 -- 172.21.15.163:0/3688020735 shutdown_connections 2023-07-14T18:13:25.821 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:25.768+0000 7f37c484e700 1 -- 172.21.15.163:0/3688020735 wait complete. 2023-07-14T18:13:25.824 INFO:tasks.cephfs.filesystem:all active scrubs completed 2023-07-14T18:13:25.825 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-14T18:13:25.981 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:25.939+0000 7f99caaa8700 1 -- 172.21.15.163:0/2812230562 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f99c4101870 msgr2=0x7f99c4108130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:13:25.981 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:25.939+0000 7f99caaa8700 1 --2- 172.21.15.163:0/2812230562 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f99c4101870 0x7f99c4108130 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f99bc00b0a0 tx=0x7f99bc00b3b0 comp rx=0 tx=0).stop 2023-07-14T18:13:25.981 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:25.940+0000 7f99caaa8700 1 -- 172.21.15.163:0/2812230562 shutdown_connections 2023-07-14T18:13:25.981 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:25.940+0000 7f99caaa8700 1 --2- 172.21.15.163:0/2812230562 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f99c40fdf10 0x7f99c40fe320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:13:25.982 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:25.940+0000 7f99caaa8700 1 --2- 172.21.15.163:0/2812230562 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f99c4101870 0x7f99c4108130 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:13:25.982 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:25.940+0000 7f99caaa8700 1 --2- 172.21.15.163:0/2812230562 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f99c4100ee0 0x7f99c4101330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:13:25.982 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:25.940+0000 7f99caaa8700 1 -- 172.21.15.163:0/2812230562 >> 172.21.15.163:0/2812230562 conn(0x7f99c40f98d0 msgr2=0x7f99c40fbd20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:13:25.982 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:25.940+0000 7f99caaa8700 1 -- 172.21.15.163:0/2812230562 shutdown_connections 2023-07-14T18:13:25.982 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:25.940+0000 7f99caaa8700 1 -- 172.21.15.163:0/2812230562 wait complete. 2023-07-14T18:13:25.984 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:25.940+0000 7f99caaa8700 1 Processor -- start 2023-07-14T18:13:25.984 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:25.940+0000 7f99caaa8700 1 -- start start 2023-07-14T18:13:25.984 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:25.941+0000 7f99caaa8700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f99c40fdf10 0x7f99c4193770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:13:25.984 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:25.941+0000 7f99caaa8700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f99c4100ee0 0x7f99c4193cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:13:25.984 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:25.941+0000 7f99caaa8700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f99c4101870 0x7f99c419ad20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:13:25.985 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:25.941+0000 7f99caaa8700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99c419b2f0 con 0x7f99c4101870 2023-07-14T18:13:25.985 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:25.941+0000 7f99caaa8700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99c419b430 con 0x7f99c4100ee0 2023-07-14T18:13:25.985 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:25.941+0000 7f99caaa8700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99c419b5c0 con 0x7f99c40fdf10 2023-07-14T18:13:25.985 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:25.941+0000 7f99c8844700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f99c40fdf10 0x7f99c4193770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:13:25.985 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:25.941+0000 7f99c3fff700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f99c4100ee0 0x7f99c4193cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:13:25.985 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:25.941+0000 7f99c9045700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f99c4101870 0x7f99c419ad20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:13:25.985 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:25.941+0000 7f99c8844700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f99c40fdf10 0x7f99c4193770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.163:39964/0 (socket says 172.21.15.163:39964) 2023-07-14T18:13:25.986 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:25.941+0000 7f99c8844700 1 -- 172.21.15.163:0/710121617 learned_addr learned my addr 172.21.15.163:0/710121617 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:13:25.986 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:25.941+0000 7f99c9045700 1 -- 172.21.15.163:0/710121617 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f99c40fdf10 msgr2=0x7f99c4193770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:13:25.986 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:25.941+0000 7f99c9045700 1 --2- 172.21.15.163:0/710121617 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f99c40fdf10 0x7f99c4193770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:13:25.986 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:25.941+0000 7f99c9045700 1 -- 172.21.15.163:0/710121617 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f99c4100ee0 msgr2=0x7f99c4193cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:13:25.986 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:25.941+0000 7f99c9045700 1 --2- 172.21.15.163:0/710121617 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f99c4100ee0 0x7f99c4193cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:13:25.986 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:25.941+0000 7f99c9045700 1 -- 172.21.15.163:0/710121617 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99bc009d00 con 0x7f99c4101870 2023-07-14T18:13:25.986 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:25.941+0000 7f99c3fff700 1 --2- 172.21.15.163:0/710121617 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f99c4100ee0 0x7f99c4193cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T18:13:25.987 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:25.941+0000 7f99c9045700 1 --2- 172.21.15.163:0/710121617 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f99c4101870 0x7f99c419ad20 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f99bc00b070 tx=0x7f99bc0078e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:13:25.987 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:25.941+0000 7f99c1ffb700 1 -- 172.21.15.163:0/710121617 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99bc00e040 con 0x7f99c4101870 2023-07-14T18:13:25.987 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:25.942+0000 7f99caaa8700 1 -- 172.21.15.163:0/710121617 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f99c419b840 con 0x7f99c4101870 2023-07-14T18:13:25.987 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:25.942+0000 7f99c1ffb700 1 -- 172.21.15.163:0/710121617 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f99bc00be40 con 0x7f99c4101870 2023-07-14T18:13:25.987 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:25.942+0000 7f99c1ffb700 1 -- 172.21.15.163:0/710121617 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99bc005040 con 0x7f99c4101870 2023-07-14T18:13:25.987 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:25.942+0000 7f99caaa8700 1 -- 172.21.15.163:0/710121617 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99c419bd10 con 0x7f99c4101870 2023-07-14T18:13:25.987 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:25.943+0000 7f99af7fe700 1 -- 172.21.15.163:0/710121617 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f99a40052f0 con 0x7f99c4101870 2023-07-14T18:13:25.988 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:25.945+0000 7f99c1ffb700 1 -- 172.21.15.163:0/710121617 <== mon.0 v2:172.21.15.163:3300/0 4 ==== mgrmap(e 18) v1 ==== 135716+0+0 (secure 0 0 0) 0x7f99bc01d470 con 0x7f99c4101870 2023-07-14T18:13:25.988 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:25.945+0000 7f99c1ffb700 1 --2- 172.21.15.163:0/710121617 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f99b40a11a0 0x7f99b40a3650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:13:25.988 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:25.946+0000 7f99c1ffb700 1 -- 172.21.15.163:0/710121617 <== mon.0 v2:172.21.15.163:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 9049+0+0 (secure 0 0 0) 0x7f99bc0ce2e0 con 0x7f99c4101870 2023-07-14T18:13:25.988 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:25.946+0000 7f99c8844700 1 --2- 172.21.15.163:0/710121617 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f99b40a11a0 0x7f99b40a3650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:13:25.989 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:25.946+0000 7f99c8844700 1 --2- 172.21.15.163:0/710121617 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f99b40a11a0 0x7f99b40a3650 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f99b8005950 tx=0x7f99b8009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:13:25.990 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:25.949+0000 7f99c1ffb700 1 -- 172.21.15.163:0/710121617 <== mon.0 v2:172.21.15.163:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178025 (secure 0 0 0) 0x7f99bc097790 con 0x7f99c4101870 2023-07-14T18:13:26.341 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.300+0000 7f99af7fe700 1 -- 172.21.15.163:0/710121617 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f99a4005c90 con 0x7f99c4101870 2023-07-14T18:13:26.342 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.301+0000 7f99c1ffb700 1 -- 172.21.15.163:0/710121617 <== mon.0 v2:172.21.15.163:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) v1 ==== 94+0+10901 (secure 0 0 0) 0x7f99bc09adb0 con 0x7f99c4101870 2023-07-14T18:13:26.342 INFO:teuthology.orchestra.run.smithi163.stdout: 2023-07-14T18:13:26.342 INFO:teuthology.orchestra.run.smithi163.stdout:{"epoch":29,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14562,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.163:6835/1058662632","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6834","nonce":1058662632},{"type":"v1","addr":"172.21.15.163:6835","nonce":1058662632}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":14568,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.163:6837/1107244425","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6836","nonce":1107244425},{"type":"v1","addr":"172.21.15.163:6837","nonce":1107244425}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":29,"flags":178,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"balance_automate":true},"ever_allowed_features":160,"explicitly_allowed_features":160,"created":"2023-07-14T18:11:09.109693+0000","modified":"2023-07-14T18:12:47.779723+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24518,"mds_1":24493,"mds_2":24479,"mds_3":24478,"mds_4":14652},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14640":{"gid":14640,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.163:6839/1337572937","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6838","nonce":1337572937},{"type":"v1","addr":"172.21.15.163:6839","nonce":1337572937}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_14652":{"gid":14652,"name":"a","rank":4,"incarnation":26,"state":"up:active","state_seq":9,"addr":"172.21.15.163:6841/1032082642","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6840","nonce":1032082642},{"type":"v1","addr":"172.21.15.163:6841","nonce":1032082642}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24421":{"gid":24421,"name":"l","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.184:6833/797722972","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6832","nonce":797722972},{"type":"v1","addr":"172.21.15.184:6833","nonce":797722972}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24431":{"gid":24431,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6833/1075696311","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":1075696311},{"type":"v1","addr":"172.21.15.172:6833","nonce":1075696311}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24458":{"gid":24458,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6835/1158120127","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":1158120127},{"type":"v1","addr":"172.21.15.172:6835","nonce":1158120127}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24466":{"gid":24466,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.184:6835/460134263","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6834","nonce":460134263},{"type":"v1","addr":"172.21.15.184:6835","nonce":460134263}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24478":{"gid":24478,"name":"c","rank":3,"incarnation":24,"state":"up:active","state_seq":11,"addr":"172.21.15.184:6837/3389277679","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6836","nonce":3389277679},{"type":"v1","addr":"172.21.15.184:6837","nonce":3389277679}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24479":{"gid":24479,"name":"h","rank":2,"incarnation":22,"state":"up:active","state_seq":10,"addr":"172.21.15.172:6837/3783835012","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":3783835012},{"type":"v1","addr":"172.21.15.172:6837","nonce":3783835012}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24493":{"gid":24493,"name":"i","rank":1,"incarnation":20,"state":"up:active","state_seq":9,"addr":"172.21.15.184:6839/2819059257","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6838","nonce":2819059257},{"type":"v1","addr":"172.21.15.184:6839","nonce":2819059257}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24518":{"gid":24518,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.172:6839/3850440096","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6838","nonce":3850440096},{"type":"v1","addr":"172.21.15.172:6839","nonce":3850440096}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-07-14T18:13:26.345 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.304+0000 7f99af7fe700 1 -- 172.21.15.163:0/710121617 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f99b40a11a0 msgr2=0x7f99b40a3650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:13:26.345 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.304+0000 7f99af7fe700 1 --2- 172.21.15.163:0/710121617 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f99b40a11a0 0x7f99b40a3650 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f99b8005950 tx=0x7f99b8009260 comp rx=0 tx=0).stop 2023-07-14T18:13:26.345 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.304+0000 7f99af7fe700 1 -- 172.21.15.163:0/710121617 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f99c4101870 msgr2=0x7f99c419ad20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:13:26.345 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.304+0000 7f99af7fe700 1 --2- 172.21.15.163:0/710121617 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f99c4101870 0x7f99c419ad20 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f99bc00b070 tx=0x7f99bc0078e0 comp rx=0 tx=0).stop 2023-07-14T18:13:26.345 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.304+0000 7f99af7fe700 1 -- 172.21.15.163:0/710121617 shutdown_connections 2023-07-14T18:13:26.346 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.304+0000 7f99af7fe700 1 --2- 172.21.15.163:0/710121617 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f99b40a11a0 0x7f99b40a3650 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:13:26.346 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.304+0000 7f99af7fe700 1 --2- 172.21.15.163:0/710121617 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f99c40fdf10 0x7f99c4193770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:13:26.346 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.304+0000 7f99af7fe700 1 --2- 172.21.15.163:0/710121617 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f99c4101870 0x7f99c419ad20 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:13:26.346 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.304+0000 7f99af7fe700 1 --2- 172.21.15.163:0/710121617 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f99c4100ee0 0x7f99c4193cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:13:26.346 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.304+0000 7f99af7fe700 1 -- 172.21.15.163:0/710121617 >> 172.21.15.163:0/710121617 conn(0x7f99c40f98d0 msgr2=0x7f99c4104380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:13:26.346 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.304+0000 7f99af7fe700 1 -- 172.21.15.163:0/710121617 shutdown_connections 2023-07-14T18:13:26.346 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.304+0000 7f99af7fe700 1 -- 172.21.15.163:0/710121617 wait complete. 2023-07-14T18:13:26.347 INFO:teuthology.orchestra.run.smithi163.stderr:dumped fsmap epoch 29 2023-07-14T18:13:26.361 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:4 damage ls 2023-07-14T18:13:26.492 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.449+0000 7f249e7ea700 1 -- 172.21.15.163:0/815675603 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f2498100120 msgr2=0x7f2498100530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:13:26.493 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.449+0000 7f249e7ea700 1 --2- 172.21.15.163:0/815675603 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f2498100120 0x7f2498100530 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f2488009990 tx=0x7f2488009ca0 comp rx=0 tx=0).stop 2023-07-14T18:13:26.493 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.449+0000 7f249e7ea700 1 -- 172.21.15.163:0/815675603 shutdown_connections 2023-07-14T18:13:26.493 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.449+0000 7f249e7ea700 1 --2- 172.21.15.163:0/815675603 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f24980ff750 0x7f2498107020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:13:26.493 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.449+0000 7f249e7ea700 1 --2- 172.21.15.163:0/815675603 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f2498100120 0x7f2498100530 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:13:26.493 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.449+0000 7f249e7ea700 1 --2- 172.21.15.163:0/815675603 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f24980fedc0 0x7f24980ff210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:13:26.494 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.449+0000 7f249e7ea700 1 -- 172.21.15.163:0/815675603 >> 172.21.15.163:0/815675603 conn(0x7f24980f98e0 msgr2=0x7f24980fbd10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:13:26.494 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.449+0000 7f249e7ea700 1 -- 172.21.15.163:0/815675603 shutdown_connections 2023-07-14T18:13:26.494 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.449+0000 7f249e7ea700 1 -- 172.21.15.163:0/815675603 wait complete. 2023-07-14T18:13:26.494 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.450+0000 7f249e7ea700 1 Processor -- start 2023-07-14T18:13:26.494 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.450+0000 7f249e7ea700 1 -- start start 2023-07-14T18:13:26.494 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.450+0000 7f249e7ea700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f24980fedc0 0x7f24980fe820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:13:26.494 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.450+0000 7f249e7ea700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f24980ff750 0x7f249819a610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:13:26.495 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.450+0000 7f249e7ea700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f2498100120 0x7f249819cc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:13:26.495 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.450+0000 7f249e7ea700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f249819d3f0 con 0x7f2498100120 2023-07-14T18:13:26.495 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.450+0000 7f249e7ea700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f249819d560 con 0x7f24980ff750 2023-07-14T18:13:26.495 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.450+0000 7f249e7ea700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f249819d720 con 0x7f24980fedc0 2023-07-14T18:13:26.495 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.451+0000 7f249cd87700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f2498100120 0x7f249819cc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:13:26.495 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.451+0000 7f249cd87700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f2498100120 0x7f249819cc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:58158/0 (socket says 172.21.15.163:58158) 2023-07-14T18:13:26.495 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.451+0000 7f249cd87700 1 -- 172.21.15.163:0/2744078398 learned_addr learned my addr 172.21.15.163:0/2744078398 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:13:26.495 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.451+0000 7f2497fff700 1 --2- 172.21.15.163:0/2744078398 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f24980fedc0 0x7f24980fe820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:13:26.496 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.451+0000 7f24977fe700 1 --2- 172.21.15.163:0/2744078398 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f24980ff750 0x7f249819a610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:13:26.496 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.451+0000 7f249cd87700 1 -- 172.21.15.163:0/2744078398 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f24980fedc0 msgr2=0x7f24980fe820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:13:26.496 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.451+0000 7f249cd87700 1 --2- 172.21.15.163:0/2744078398 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f24980fedc0 0x7f24980fe820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:13:26.496 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.451+0000 7f249cd87700 1 -- 172.21.15.163:0/2744078398 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f24980ff750 msgr2=0x7f249819a610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:13:26.496 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.451+0000 7f249cd87700 1 --2- 172.21.15.163:0/2744078398 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f24980ff750 0x7f249819a610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:13:26.496 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.451+0000 7f249cd87700 1 -- 172.21.15.163:0/2744078398 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24880095f0 con 0x7f2498100120 2023-07-14T18:13:26.496 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.451+0000 7f24977fe700 1 --2- 172.21.15.163:0/2744078398 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f24980ff750 0x7f249819a610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T18:13:26.497 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.451+0000 7f249cd87700 1 --2- 172.21.15.163:0/2744078398 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f2498100120 0x7f249819cc50 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f249000ef30 tx=0x7f249000c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:13:26.497 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.451+0000 7f24957fa700 1 -- 172.21.15.163:0/2744078398 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2490018070 con 0x7f2498100120 2023-07-14T18:13:26.497 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.451+0000 7f24957fa700 1 -- 172.21.15.163:0/2744078398 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f249000f040 con 0x7f2498100120 2023-07-14T18:13:26.497 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.451+0000 7f249e7ea700 1 -- 172.21.15.163:0/2744078398 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f249819d9a0 con 0x7f2498100120 2023-07-14T18:13:26.497 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.451+0000 7f249e7ea700 1 -- 172.21.15.163:0/2744078398 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2498194600 con 0x7f2498100120 2023-07-14T18:13:26.497 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.451+0000 7f24957fa700 1 -- 172.21.15.163:0/2744078398 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f249000cc70 con 0x7f2498100120 2023-07-14T18:13:26.500 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.454+0000 7f24957fa700 1 -- 172.21.15.163:0/2744078398 <== mon.0 v2:172.21.15.163:3300/0 4 ==== mgrmap(e 18) v1 ==== 135716+0+0 (secure 0 0 0) 0x7f2490007500 con 0x7f2498100120 2023-07-14T18:13:26.500 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.455+0000 7f24957fa700 1 --2- 172.21.15.163:0/2744078398 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f24800a1150 0x7f24800a3600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:13:26.501 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.455+0000 7f2497fff700 1 --2- 172.21.15.163:0/2744078398 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f24800a1150 0x7f24800a3600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:13:26.501 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.455+0000 7f24957fa700 1 -- 172.21.15.163:0/2744078398 <== mon.0 v2:172.21.15.163:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 9049+0+0 (secure 0 0 0) 0x7f24900cc6e0 con 0x7f2498100120 2023-07-14T18:13:26.501 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.455+0000 7f2497fff700 1 --2- 172.21.15.163:0/2744078398 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f24800a1150 0x7f24800a3600 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f2488005910 tx=0x7f248800b260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:13:26.501 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.456+0000 7f24aa982b80 1 Processor -- start 2023-07-14T18:13:26.501 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.456+0000 7f24aa982b80 1 -- start start 2023-07-14T18:13:26.501 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.456+0000 7f24aa982b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5562d20c6f60 0x5562d20c7370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:13:26.501 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.456+0000 7f24aa982b80 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5562d20c78b0 0x5562d20c7ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:13:26.502 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.456+0000 7f24aa982b80 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5562d20c84b0 0x5562d20c8920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:13:26.502 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.456+0000 7f24aa982b80 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x5562d1fcbcb0 con 0x5562d20c84b0 2023-07-14T18:13:26.502 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.456+0000 7f24aa982b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x5562d201ea40 con 0x5562d20c6f60 2023-07-14T18:13:26.502 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.456+0000 7f24aa982b80 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x5562d2017ed0 con 0x5562d20c78b0 2023-07-14T18:13:26.502 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.456+0000 7f249cd87700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5562d20c84b0 0x5562d20c8920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:13:26.502 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.456+0000 7f249cd87700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5562d20c84b0 0x5562d20c8920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:58166/0 (socket says 172.21.15.163:58166) 2023-07-14T18:13:26.502 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.456+0000 7f249cd87700 1 -- 172.21.15.163:0/3420088323 learned_addr learned my addr 172.21.15.163:0/3420088323 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:13:26.503 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.456+0000 7f24977fe700 1 --2- 172.21.15.163:0/3420088323 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5562d20c78b0 0x5562d20c7ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:13:26.503 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.456+0000 7f2497fff700 1 --2- 172.21.15.163:0/3420088323 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5562d20c6f60 0x5562d20c7370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:13:26.503 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.457+0000 7f249cd87700 1 -- 172.21.15.163:0/3420088323 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5562d20c78b0 msgr2=0x5562d20c7ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:13:26.503 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.457+0000 7f249cd87700 1 --2- 172.21.15.163:0/3420088323 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5562d20c78b0 0x5562d20c7ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:13:26.503 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.457+0000 7f249cd87700 1 -- 172.21.15.163:0/3420088323 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5562d20c6f60 msgr2=0x5562d20c7370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:13:26.503 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.457+0000 7f249cd87700 1 --2- 172.21.15.163:0/3420088323 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5562d20c6f60 0x5562d20c7370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:13:26.503 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.457+0000 7f249cd87700 1 -- 172.21.15.163:0/3420088323 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5562d1e45de0 con 0x5562d20c84b0 2023-07-14T18:13:26.504 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.457+0000 7f24977fe700 1 --2- 172.21.15.163:0/3420088323 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5562d20c78b0 0x5562d20c7ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T18:13:26.504 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.457+0000 7f249cd87700 1 --2- 172.21.15.163:0/3420088323 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5562d20c84b0 0x5562d20c8920 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f24900962c0 tx=0x7f2490099620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=60924b92c6f77b26 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:13:26.504 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.457+0000 7f247e7fc700 1 -- 172.21.15.163:0/3420088323 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2490099850 con 0x5562d20c84b0 2023-07-14T18:13:26.504 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.457+0000 7f247e7fc700 1 -- 172.21.15.163:0/3420088323 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f249009d880 con 0x5562d20c84b0 2023-07-14T18:13:26.504 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.457+0000 7f247e7fc700 1 -- 172.21.15.163:0/3420088323 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2490097bf0 con 0x5562d20c84b0 2023-07-14T18:13:26.504 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.458+0000 7f24aa982b80 1 -- 172.21.15.163:0/3420088323 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5562d20c84b0 msgr2=0x5562d20c8920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:13:26.505 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.458+0000 7f24aa982b80 1 --2- 172.21.15.163:0/3420088323 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5562d20c84b0 0x5562d20c8920 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f24900962c0 tx=0x7f2490099620 comp rx=0 tx=0).stop 2023-07-14T18:13:26.505 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.458+0000 7f24aa982b80 1 -- 172.21.15.163:0/3420088323 shutdown_connections 2023-07-14T18:13:26.505 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.458+0000 7f24aa982b80 1 --2- 172.21.15.163:0/3420088323 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5562d20c84b0 0x5562d20c8920 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:13:26.505 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.458+0000 7f24aa982b80 1 --2- 172.21.15.163:0/3420088323 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5562d20c6f60 0x5562d20c7370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:13:26.505 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.458+0000 7f24aa982b80 1 --2- 172.21.15.163:0/3420088323 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5562d20c78b0 0x5562d20c7ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:13:26.505 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.458+0000 7f24aa982b80 1 -- 172.21.15.163:0/3420088323 >> 172.21.15.163:0/3420088323 conn(0x5562d20bc680 msgr2=0x5562d20c19d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:13:26.505 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.458+0000 7f24aa982b80 1 -- 172.21.15.163:0/3420088323 shutdown_connections 2023-07-14T18:13:26.505 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.458+0000 7f24aa982b80 1 -- 172.21.15.163:0/3420088323 wait complete. 2023-07-14T18:13:26.506 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.458+0000 7f24aa982b80 1 -- start start 2023-07-14T18:13:26.506 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.459+0000 7f24aa982b80 1 Processor -- start 2023-07-14T18:13:26.506 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.459+0000 7f24aa982b80 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5562d20c6f60 0x5562d20d0880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:13:26.506 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.459+0000 7f24aa982b80 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5562d20c78b0 0x5562d20d0dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:13:26.506 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.459+0000 7f24aa982b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5562d20c84b0 0x5562d20d7e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:13:26.507 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.459+0000 7f24aa982b80 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x5562d1fb7ac0 con 0x5562d20c6f60 2023-07-14T18:13:26.507 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.459+0000 7f24aa982b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x5562d1fb77c0 con 0x5562d20c84b0 2023-07-14T18:13:26.507 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.459+0000 7f24aa982b80 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x5562d1e9b920 con 0x5562d20c78b0 2023-07-14T18:13:26.507 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.459+0000 7f24aa982b80 10 client.0 _ll_register_callbacks cb 0x5562d1fb5760 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T18:13:26.507 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.459+0000 7f2497fff700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5562d20c6f60 0x5562d20d0880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:13:26.507 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.459+0000 7f2497fff700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5562d20c6f60 0x5562d20d0880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:58170/0 (socket says 172.21.15.163:58170) 2023-07-14T18:13:26.507 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.459+0000 7f2497fff700 1 -- 172.21.15.163:0/2203431811 learned_addr learned my addr 172.21.15.163:0/2203431811 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:13:26.507 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.459+0000 7f249cd87700 1 --2- 172.21.15.163:0/2203431811 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5562d20c84b0 0x5562d20d7e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:13:26.508 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.459+0000 7f2497fff700 1 -- 172.21.15.163:0/2203431811 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5562d20c78b0 msgr2=0x5562d20d0dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:13:26.508 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.459+0000 7f2497fff700 1 --2- 172.21.15.163:0/2203431811 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5562d20c78b0 0x5562d20d0dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:13:26.508 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.459+0000 7f2497fff700 1 -- 172.21.15.163:0/2203431811 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5562d20c84b0 msgr2=0x5562d20d7e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:13:26.508 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.459+0000 7f2497fff700 1 --2- 172.21.15.163:0/2203431811 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5562d20c84b0 0x5562d20d7e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:13:26.508 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.459+0000 7f2497fff700 1 -- 172.21.15.163:0/2203431811 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2498194600 con 0x5562d20c6f60 2023-07-14T18:13:26.508 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.459+0000 7f249cd87700 1 --2- 172.21.15.163:0/2203431811 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5562d20c84b0 0x5562d20d7e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T18:13:26.510 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.460+0000 7f2497fff700 1 --2- 172.21.15.163:0/2203431811 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5562d20c6f60 0x5562d20d0880 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f2498068750 tx=0x7f248801a050 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d13d6a9ee955a35 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:13:26.510 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.460+0000 7f24777fe700 10 client.0 ms_handle_connect on v2:172.21.15.163:3300/0 2023-07-14T18:13:26.510 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.460+0000 7f24777fe700 1 -- 172.21.15.163:0/2203431811 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2488003d40 con 0x5562d20c6f60 2023-07-14T18:13:26.511 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.460+0000 7f24aa982b80 1 -- 172.21.15.163:0/2203431811 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5562d1f714f0 con 0x5562d20c6f60 2023-07-14T18:13:26.511 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.460+0000 7f24777fe700 1 -- 172.21.15.163:0/2203431811 <== mon.0 v2:172.21.15.163:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 9049+0+0 (secure 0 0 0) 0x7f248800bd80 con 0x5562d20c6f60 2023-07-14T18:13:26.511 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.460+0000 7f24777fe700 1 -- 172.21.15.163:0/2203431811 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2488037570 con 0x5562d20c6f60 2023-07-14T18:13:26.511 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.460+0000 7f24aa982b80 10 client.15738 fetch_fsmap learned FSMap version 29 2023-07-14T18:13:26.511 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.460+0000 7f24aa982b80 1 -- 172.21.15.163:0/2203431811 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) v3 -- 0x5562d1e2ec60 con 0x5562d20c6f60 2023-07-14T18:13:26.511 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.460+0000 7f24777fe700 1 -- 172.21.15.163:0/2203431811 <== mon.0 v2:172.21.15.163:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x5562d1f714f0 con 0x5562d20c6f60 2023-07-14T18:13:26.512 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.460+0000 7f24777fe700 1 -- 172.21.15.163:0/2203431811 <== mon.0 v2:172.21.15.163:3300/0 5 ==== fsmap(e 29) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f2488004500 con 0x5562d20c6f60 2023-07-14T18:13:26.512 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.460+0000 7f24aa982b80 10 client.15738 fetch_fsmap finished waiting for FSMap version 29 2023-07-14T18:13:26.512 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.460+0000 7f24aa982b80 10 client.15738 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.a 2023-07-14T18:13:26.512 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.460+0000 7f24aa982b80 20 client.15738 populate_metadata read hostname 'smithi163' 2023-07-14T18:13:26.512 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.461+0000 7f24aa982b80 1 --2- 172.21.15.163:0/2203431811 >> [v2:172.21.15.163:6840/1032082642,v1:172.21.15.163:6841/1032082642] conn(0x5562d20dc6f0 0x5562d20deb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:13:26.512 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.461+0000 7f24aa982b80 4 client.15738 mds_command: new command op to 14652 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-14T18:13:26.512 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.461+0000 7f24aa982b80 1 -- 172.21.15.163:0/2203431811 --> [v2:172.21.15.163:6840/1032082642,v1:172.21.15.163:6841/1032082642] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5562d2095da0 con 0x5562d20dc6f0 2023-07-14T18:13:26.513 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.461+0000 7f24977fe700 1 --2- 172.21.15.163:0/2203431811 >> [v2:172.21.15.163:6840/1032082642,v1:172.21.15.163:6841/1032082642] conn(0x5562d20dc6f0 0x5562d20deb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:13:26.513 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.461+0000 7f24777fe700 10 client.15738 ms_handle_connect on v2:172.21.15.163:6840/1032082642 2023-07-14T18:13:26.513 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.461+0000 7f24977fe700 1 --2- 172.21.15.163:0/2203431811 >> [v2:172.21.15.163:6840/1032082642,v1:172.21.15.163:6841/1032082642] conn(0x5562d20dc6f0 0x5562d20deb00 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=aa5b0d8d5643cdb0 server_cookie=bda60ce24a9a70b2 in_seq=0 out_seq=0 2023-07-14T18:13:26.513 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.462+0000 7f24777fe700 1 -- 172.21.15.163:0/2203431811 <== mds.4 v2:172.21.15.163:6840/1032082642 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18017 (crc 0 0 0) 0x5562d2095da0 con 0x5562d20dc6f0 2023-07-14T18:13:26.513 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.462+0000 7f24777fe700 10 client.15738 handle_command_reply: tid=0 2023-07-14T18:13:26.513 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.462+0000 7f24aa982b80 1 client.15738 shutdown 2023-07-14T18:13:26.513 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.462+0000 7f24aa982b80 1 -- 172.21.15.163:0/2203431811 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5562d20c6f60 msgr2=0x5562d20d0880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:13:26.514 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.462+0000 7f24aa982b80 1 --2- 172.21.15.163:0/2203431811 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5562d20c6f60 0x5562d20d0880 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f2498068750 tx=0x7f248801a050 comp rx=0 tx=0).stop 2023-07-14T18:13:26.514 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.462+0000 7f24aa982b80 1 -- 172.21.15.163:0/2203431811 shutdown_connections 2023-07-14T18:13:26.514 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.462+0000 7f24aa982b80 1 --2- 172.21.15.163:0/2203431811 >> [v2:172.21.15.163:6840/1032082642,v1:172.21.15.163:6841/1032082642] conn(0x5562d20dc6f0 0x5562d20deb00 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:13:26.514 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.462+0000 7f24aa982b80 1 --2- 172.21.15.163:0/2203431811 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5562d20c84b0 0x5562d20d7e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:13:26.514 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.462+0000 7f24aa982b80 1 --2- 172.21.15.163:0/2203431811 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5562d20c6f60 0x5562d20d0880 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:13:26.514 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.462+0000 7f24777fe700 0 client.15738 ms_handle_reset on v2:172.21.15.163:6840/1032082642 2023-07-14T18:13:26.514 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.462+0000 7f24aa982b80 1 --2- 172.21.15.163:0/2203431811 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5562d20c78b0 0x5562d20d0dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:13:26.515 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.462+0000 7f24aa982b80 1 -- 172.21.15.163:0/2203431811 >> 172.21.15.163:0/2203431811 conn(0x5562d20bc680 msgr2=0x5562d20c0650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:13:26.515 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.462+0000 7f24aa982b80 1 -- 172.21.15.163:0/2203431811 shutdown_connections 2023-07-14T18:13:26.515 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.462+0000 7f24aa982b80 1 -- 172.21.15.163:0/2203431811 wait complete. 2023-07-14T18:13:26.515 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.463+0000 7f24aa982b80 20 client.15738 trim_cache size 0 max 16384 2023-07-14T18:13:26.534 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.486+0000 7f24aa982b80 1 Processor -- start 2023-07-14T18:13:26.535 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.486+0000 7f24aa982b80 1 -- start start 2023-07-14T18:13:26.535 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.486+0000 7f24aa982b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5562d20c6f60 0x5562d20cff30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:13:26.535 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.486+0000 7f24aa982b80 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5562d20c78b0 0x5562d20d7d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:13:26.536 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.486+0000 7f24aa982b80 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5562d20c84b0 0x5562d20c8880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:13:26.536 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.486+0000 7f24aa982b80 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x5562d20cf3a0 con 0x5562d20c84b0 2023-07-14T18:13:26.536 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.486+0000 7f24aa982b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x5562d20c8330 con 0x5562d20c6f60 2023-07-14T18:13:26.536 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.486+0000 7f24aa982b80 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x5562d20c2cc0 con 0x5562d20c78b0 2023-07-14T18:13:26.537 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.486+0000 7f249cd87700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5562d20c84b0 0x5562d20c8880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:13:26.537 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.486+0000 7f249cd87700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5562d20c84b0 0x5562d20c8880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:58182/0 (socket says 172.21.15.163:58182) 2023-07-14T18:13:26.537 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.486+0000 7f249cd87700 1 -- 172.21.15.163:0/421343396 learned_addr learned my addr 172.21.15.163:0/421343396 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:13:26.538 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.487+0000 7f24977fe700 1 --2- 172.21.15.163:0/421343396 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5562d20c78b0 0x5562d20d7d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:13:26.538 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.487+0000 7f2497fff700 1 --2- 172.21.15.163:0/421343396 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5562d20c6f60 0x5562d20cff30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:13:26.538 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.487+0000 7f249cd87700 1 -- 172.21.15.163:0/421343396 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5562d20c78b0 msgr2=0x5562d20d7d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:13:26.538 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.487+0000 7f249cd87700 1 --2- 172.21.15.163:0/421343396 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5562d20c78b0 0x5562d20d7d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:13:26.539 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.487+0000 7f249cd87700 1 -- 172.21.15.163:0/421343396 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5562d20c6f60 msgr2=0x5562d20cff30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:13:26.539 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.487+0000 7f249cd87700 1 --2- 172.21.15.163:0/421343396 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5562d20c6f60 0x5562d20cff30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:13:26.539 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.487+0000 7f249cd87700 1 -- 172.21.15.163:0/421343396 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5562d1e6c250 con 0x5562d20c84b0 2023-07-14T18:13:26.539 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.487+0000 7f24977fe700 1 --2- 172.21.15.163:0/421343396 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5562d20c78b0 0x5562d20d7d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T18:13:26.540 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.487+0000 7f2497fff700 1 --2- 172.21.15.163:0/421343396 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5562d20c6f60 0x5562d20cff30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T18:13:26.540 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.487+0000 7f249cd87700 1 --2- 172.21.15.163:0/421343396 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5562d20c84b0 0x5562d20c8880 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f249000ef00 tx=0x7f2490095ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad4b1ad706748618 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:13:26.540 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.487+0000 7f247effd700 1 -- 172.21.15.163:0/421343396 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24900998d0 con 0x5562d20c84b0 2023-07-14T18:13:26.540 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.487+0000 7f247effd700 1 -- 172.21.15.163:0/421343396 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f24900a1c10 con 0x5562d20c84b0 2023-07-14T18:13:26.541 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.487+0000 7f247effd700 1 -- 172.21.15.163:0/421343396 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2490099ab0 con 0x5562d20c84b0 2023-07-14T18:13:26.541 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.488+0000 7f24aa982b80 1 -- 172.21.15.163:0/421343396 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5562d20c84b0 msgr2=0x5562d20c8880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:13:26.541 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.488+0000 7f24aa982b80 1 --2- 172.21.15.163:0/421343396 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5562d20c84b0 0x5562d20c8880 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f249000ef00 tx=0x7f2490095ca0 comp rx=0 tx=0).stop 2023-07-14T18:13:26.541 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.488+0000 7f24aa982b80 1 -- 172.21.15.163:0/421343396 shutdown_connections 2023-07-14T18:13:26.542 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.488+0000 7f24aa982b80 1 --2- 172.21.15.163:0/421343396 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5562d20c84b0 0x5562d20c8880 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:13:26.542 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.488+0000 7f24aa982b80 1 --2- 172.21.15.163:0/421343396 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5562d20c6f60 0x5562d20cff30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:13:26.542 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.488+0000 7f24aa982b80 1 --2- 172.21.15.163:0/421343396 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5562d20c78b0 0x5562d20d7d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:13:26.542 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.488+0000 7f24aa982b80 1 -- 172.21.15.163:0/421343396 >> 172.21.15.163:0/421343396 conn(0x5562d20bc680 msgr2=0x5562d20c19a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:13:26.543 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.488+0000 7f24aa982b80 1 -- 172.21.15.163:0/421343396 shutdown_connections 2023-07-14T18:13:26.543 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.488+0000 7f24aa982b80 1 -- 172.21.15.163:0/421343396 wait complete. 2023-07-14T18:13:26.543 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.488+0000 7f24aa982b80 1 -- start start 2023-07-14T18:13:26.544 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.489+0000 7f24aa982b80 1 Processor -- start 2023-07-14T18:13:26.544 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.489+0000 7f24aa982b80 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5562d20c6f60 0x5562d20d3fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:13:26.544 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.489+0000 7f24aa982b80 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5562d20c78b0 0x5562d20d4500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:13:26.544 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.489+0000 7f24aa982b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5562d20c84b0 0x5562d20d6fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:13:26.545 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.489+0000 7f24aa982b80 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x5562d20d7520 con 0x5562d20c6f60 2023-07-14T18:13:26.545 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.489+0000 7f24aa982b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x5562d20d7690 con 0x5562d20c84b0 2023-07-14T18:13:26.545 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.489+0000 7f24aa982b80 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x5562d20d7850 con 0x5562d20c78b0 2023-07-14T18:13:26.546 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.489+0000 7f24aa982b80 10 client.0 _ll_register_callbacks cb 0x7f24880042e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T18:13:26.546 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.489+0000 7f2497fff700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5562d20c6f60 0x5562d20d3fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:13:26.546 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.489+0000 7f2497fff700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5562d20c6f60 0x5562d20d3fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:58184/0 (socket says 172.21.15.163:58184) 2023-07-14T18:13:26.546 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.489+0000 7f2497fff700 1 -- 172.21.15.163:0/2004195504 learned_addr learned my addr 172.21.15.163:0/2004195504 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:13:26.547 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.489+0000 7f249cd87700 1 --2- 172.21.15.163:0/2004195504 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5562d20c84b0 0x5562d20d6fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:13:26.547 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.489+0000 7f2497fff700 1 -- 172.21.15.163:0/2004195504 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5562d20c78b0 msgr2=0x5562d20d4500 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-07-14T18:13:26.547 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.489+0000 7f2497fff700 1 --2- 172.21.15.163:0/2004195504 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5562d20c78b0 0x5562d20d4500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:13:26.547 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.489+0000 7f2497fff700 1 -- 172.21.15.163:0/2004195504 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5562d20c84b0 msgr2=0x5562d20d6fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:13:26.548 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.489+0000 7f2497fff700 1 --2- 172.21.15.163:0/2004195504 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5562d20c84b0 0x5562d20d6fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:13:26.548 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.490+0000 7f2497fff700 1 -- 172.21.15.163:0/2004195504 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5562d1e45de0 con 0x5562d20c6f60 2023-07-14T18:13:26.548 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.490+0000 7f249cd87700 1 --2- 172.21.15.163:0/2004195504 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5562d20c84b0 0x5562d20d6fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T18:13:26.548 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.490+0000 7f2497fff700 1 --2- 172.21.15.163:0/2004195504 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5562d20c6f60 0x5562d20d3fc0 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f2488006010 tx=0x7f2488004230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=91456eb205b97602 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:13:26.548 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.490+0000 7f24777fe700 10 client.0 ms_handle_connect on v2:172.21.15.163:3300/0 2023-07-14T18:13:26.549 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.490+0000 7f24777fe700 1 -- 172.21.15.163:0/2004195504 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2488003d40 con 0x5562d20c6f60 2023-07-14T18:13:26.549 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.490+0000 7f24777fe700 1 -- 172.21.15.163:0/2004195504 <== mon.0 v2:172.21.15.163:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 9049+0+0 (secure 0 0 0) 0x7f2488004b80 con 0x5562d20c6f60 2023-07-14T18:13:26.549 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.490+0000 7f24aa982b80 1 -- 172.21.15.163:0/2004195504 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f249009d880 con 0x5562d20c6f60 2023-07-14T18:13:26.549 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.490+0000 7f24777fe700 1 -- 172.21.15.163:0/2004195504 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2488004500 con 0x5562d20c6f60 2023-07-14T18:13:26.549 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.490+0000 7f24aa982b80 10 client.15744 fetch_fsmap learned FSMap version 29 2023-07-14T18:13:26.549 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.490+0000 7f24aa982b80 1 -- 172.21.15.163:0/2004195504 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) v3 -- 0x5562d1e442b0 con 0x5562d20c6f60 2023-07-14T18:13:26.549 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.490+0000 7f24777fe700 1 -- 172.21.15.163:0/2004195504 <== mon.0 v2:172.21.15.163:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f249009d880 con 0x5562d20c6f60 2023-07-14T18:13:26.549 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.490+0000 7f24777fe700 1 -- 172.21.15.163:0/2004195504 <== mon.0 v2:172.21.15.163:3300/0 5 ==== fsmap(e 29) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f2488038040 con 0x5562d20c6f60 2023-07-14T18:13:26.550 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.490+0000 7f24aa982b80 10 client.15744 fetch_fsmap finished waiting for FSMap version 29 2023-07-14T18:13:26.550 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.490+0000 7f24aa982b80 10 client.15744 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.a 2023-07-14T18:13:26.550 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.490+0000 7f24aa982b80 20 client.15744 populate_metadata read hostname 'smithi163' 2023-07-14T18:13:26.550 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.491+0000 7f24aa982b80 1 --2- 172.21.15.163:0/2004195504 >> [v2:172.21.15.163:6840/1032082642,v1:172.21.15.163:6841/1032082642] conn(0x5562d2130f40 0x5562d2133350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:13:26.550 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.491+0000 7f24aa982b80 4 client.15744 mds_command: new command op to 14652 tid=0[{"prefix": "damage ls"}] 2023-07-14T18:13:26.550 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.491+0000 7f24aa982b80 1 -- 172.21.15.163:0/2004195504 --> [v2:172.21.15.163:6840/1032082642,v1:172.21.15.163:6841/1032082642] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x5562d2010eb0 con 0x5562d2130f40 2023-07-14T18:13:26.550 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.491+0000 7f24977fe700 1 --2- 172.21.15.163:0/2004195504 >> [v2:172.21.15.163:6840/1032082642,v1:172.21.15.163:6841/1032082642] conn(0x5562d2130f40 0x5562d2133350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:13:26.550 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.491+0000 7f24777fe700 10 client.15744 ms_handle_connect on v2:172.21.15.163:6840/1032082642 2023-07-14T18:13:26.551 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.491+0000 7f24977fe700 1 --2- 172.21.15.163:0/2004195504 >> [v2:172.21.15.163:6840/1032082642,v1:172.21.15.163:6841/1032082642] conn(0x5562d2130f40 0x5562d2133350 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=17ae00d2e2b88fef server_cookie=ca7dfa88ffa1e6cc in_seq=0 out_seq=0 2023-07-14T18:13:26.551 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.491+0000 7f24777fe700 1 -- 172.21.15.163:0/2004195504 <== mds.4 v2:172.21.15.163:6840/1032082642 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x5562d2010eb0 con 0x5562d2130f40 2023-07-14T18:13:26.551 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.491+0000 7f24777fe700 10 client.15744 handle_command_reply: tid=0 2023-07-14T18:13:26.551 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.491+0000 7f24aa982b80 1 client.15744 shutdown 2023-07-14T18:13:26.551 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.491+0000 7f24aa982b80 1 -- 172.21.15.163:0/2004195504 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5562d20c6f60 msgr2=0x5562d20d3fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:13:26.551 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.491+0000 7f24aa982b80 1 --2- 172.21.15.163:0/2004195504 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5562d20c6f60 0x5562d20d3fc0 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f2488006010 tx=0x7f2488004230 comp rx=0 tx=0).stop 2023-07-14T18:13:26.551 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.492+0000 7f24aa982b80 1 -- 172.21.15.163:0/2004195504 shutdown_connections 2023-07-14T18:13:26.552 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.492+0000 7f24aa982b80 1 --2- 172.21.15.163:0/2004195504 >> [v2:172.21.15.163:6840/1032082642,v1:172.21.15.163:6841/1032082642] conn(0x5562d2130f40 0x5562d2133350 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:13:26.552 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.492+0000 7f24aa982b80 1 --2- 172.21.15.163:0/2004195504 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5562d20c84b0 0x5562d20d6fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:13:26.552 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.492+0000 7f24aa982b80 1 --2- 172.21.15.163:0/2004195504 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5562d20c6f60 0x5562d20d3fc0 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:13:26.552 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.492+0000 7f24aa982b80 1 --2- 172.21.15.163:0/2004195504 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5562d20c78b0 0x5562d20d4500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:13:26.552 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.492+0000 7f24aa982b80 1 -- 172.21.15.163:0/2004195504 >> 172.21.15.163:0/2004195504 conn(0x5562d20bc680 msgr2=0x5562d20ce7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:13:26.552 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.492+0000 7f24777fe700 0 client.15744 ms_handle_reset on v2:172.21.15.163:6840/1032082642 2023-07-14T18:13:26.552 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.492+0000 7f24aa982b80 1 -- 172.21.15.163:0/2004195504 shutdown_connections 2023-07-14T18:13:26.552 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.492+0000 7f24aa982b80 1 -- 172.21.15.163:0/2004195504 wait complete. 2023-07-14T18:13:26.553 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.492+0000 7f24aa982b80 20 client.15744 trim_cache size 0 max 16384 2023-07-14T18:13:26.553 INFO:teuthology.orchestra.run.smithi163.stdout:[] 2023-07-14T18:13:26.554 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.492+0000 7f249e7ea700 1 -- 172.21.15.163:0/2744078398 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f24800a1150 msgr2=0x7f24800a3600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:13:26.554 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.492+0000 7f249e7ea700 1 --2- 172.21.15.163:0/2744078398 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f24800a1150 0x7f24800a3600 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f2488005910 tx=0x7f248800b260 comp rx=0 tx=0).stop 2023-07-14T18:13:26.554 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.492+0000 7f249e7ea700 1 -- 172.21.15.163:0/2744078398 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f2498100120 msgr2=0x7f249819cc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:13:26.555 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.492+0000 7f249e7ea700 1 --2- 172.21.15.163:0/2744078398 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f2498100120 0x7f249819cc50 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f249000ef30 tx=0x7f249000c3a0 comp rx=0 tx=0).stop 2023-07-14T18:13:26.555 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.492+0000 7f249e7ea700 1 -- 172.21.15.163:0/2744078398 shutdown_connections 2023-07-14T18:13:26.555 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.492+0000 7f249e7ea700 1 --2- 172.21.15.163:0/2744078398 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f24800a1150 0x7f24800a3600 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:13:26.555 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.492+0000 7f249e7ea700 1 --2- 172.21.15.163:0/2744078398 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f24980fedc0 0x7f24980fe820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:13:26.555 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.492+0000 7f249e7ea700 1 --2- 172.21.15.163:0/2744078398 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f2498100120 0x7f249819cc50 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:13:26.555 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.492+0000 7f249e7ea700 1 --2- 172.21.15.163:0/2744078398 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f24980ff750 0x7f249819a610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:13:26.555 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.492+0000 7f249e7ea700 1 -- 172.21.15.163:0/2744078398 >> 172.21.15.163:0/2744078398 conn(0x7f24980f98e0 msgr2=0x7f24980fbb70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:13:26.556 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.493+0000 7f249e7ea700 1 -- 172.21.15.163:0/2744078398 shutdown_connections 2023-07-14T18:13:26.556 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.493+0000 7f249e7ea700 1 -- 172.21.15.163:0/2744078398 wait complete. 2023-07-14T18:13:26.556 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:3 damage ls 2023-07-14T18:13:26.686 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.641+0000 7fc9f9690700 1 -- 172.21.15.163:0/1011216412 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc9f41058d0 msgr2=0x7fc9f4107d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:13:26.687 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.641+0000 7fc9f9690700 1 --2- 172.21.15.163:0/1011216412 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc9f41058d0 0x7fc9f4107d30 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7fc9ec00b0a0 tx=0x7fc9ec00b3b0 comp rx=0 tx=0).stop 2023-07-14T18:13:26.687 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.642+0000 7fc9f9690700 1 -- 172.21.15.163:0/1011216412 shutdown_connections 2023-07-14T18:13:26.687 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.642+0000 7fc9f9690700 1 --2- 172.21.15.163:0/1011216412 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc9f4100690 0x7fc9f4102a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:13:26.688 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.642+0000 7fc9f9690700 1 --2- 172.21.15.163:0/1011216412 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc9f41058d0 0x7fc9f4107d30 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:13:26.688 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.642+0000 7fc9f9690700 1 --2- 172.21.15.163:0/1011216412 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc9f4102fb0 0x7fc9f4105390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:13:26.688 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.642+0000 7fc9f9690700 1 -- 172.21.15.163:0/1011216412 >> 172.21.15.163:0/1011216412 conn(0x7fc9f40fa130 msgr2=0x7fc9f40fc560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:13:26.688 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.642+0000 7fc9f9690700 1 -- 172.21.15.163:0/1011216412 shutdown_connections 2023-07-14T18:13:26.688 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.642+0000 7fc9f9690700 1 -- 172.21.15.163:0/1011216412 wait complete. 2023-07-14T18:13:26.689 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.642+0000 7fc9f9690700 1 Processor -- start 2023-07-14T18:13:26.689 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.643+0000 7fc9f9690700 1 -- start start 2023-07-14T18:13:26.689 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.643+0000 7fc9f9690700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc9f4100690 0x7fc9f4195930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:13:26.689 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.643+0000 7fc9f9690700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc9f4102fb0 0x7fc9f4195e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:13:26.690 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.643+0000 7fc9f9690700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc9f41058d0 0x7fc9f419cee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:13:26.690 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.643+0000 7fc9f9690700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9f419d4b0 con 0x7fc9f4102fb0 2023-07-14T18:13:26.690 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.643+0000 7fc9f9690700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9f419d5f0 con 0x7fc9f4100690 2023-07-14T18:13:26.690 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.643+0000 7fc9f9690700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9f419d780 con 0x7fc9f41058d0 2023-07-14T18:13:26.691 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.643+0000 7fc9f27fc700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc9f4102fb0 0x7fc9f4195e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:13:26.691 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.643+0000 7fc9f27fc700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc9f4102fb0 0x7fc9f4195e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:58198/0 (socket says 172.21.15.163:58198) 2023-07-14T18:13:26.691 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.643+0000 7fc9f2ffd700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc9f4100690 0x7fc9f4195930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:13:26.691 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.643+0000 7fc9f27fc700 1 -- 172.21.15.163:0/830316647 learned_addr learned my addr 172.21.15.163:0/830316647 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:13:26.691 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.643+0000 7fc9f37fe700 1 --2- 172.21.15.163:0/830316647 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc9f41058d0 0x7fc9f419cee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:13:26.691 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.643+0000 7fc9f27fc700 1 -- 172.21.15.163:0/830316647 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc9f41058d0 msgr2=0x7fc9f419cee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:13:26.692 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.643+0000 7fc9f27fc700 1 --2- 172.21.15.163:0/830316647 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc9f41058d0 0x7fc9f419cee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:13:26.692 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.643+0000 7fc9f27fc700 1 -- 172.21.15.163:0/830316647 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc9f4100690 msgr2=0x7fc9f4195930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:13:26.692 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.643+0000 7fc9f27fc700 1 --2- 172.21.15.163:0/830316647 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc9f4100690 0x7fc9f4195930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:13:26.692 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.643+0000 7fc9f27fc700 1 -- 172.21.15.163:0/830316647 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9e4009520 con 0x7fc9f4102fb0 2023-07-14T18:13:26.692 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.643+0000 7fc9f37fe700 1 --2- 172.21.15.163:0/830316647 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc9f41058d0 0x7fc9f419cee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T18:13:26.692 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.643+0000 7fc9f27fc700 1 --2- 172.21.15.163:0/830316647 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc9f4102fb0 0x7fc9f4195e70 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7fc9e800eb30 tx=0x7fc9e800ee40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:13:26.692 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.644+0000 7fc9dbfff700 1 -- 172.21.15.163:0/830316647 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9e8009880 con 0x7fc9f4102fb0 2023-07-14T18:13:26.693 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.644+0000 7fc9f9690700 1 -- 172.21.15.163:0/830316647 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc9e8009520 con 0x7fc9f4102fb0 2023-07-14T18:13:26.693 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.644+0000 7fc9dbfff700 1 -- 172.21.15.163:0/830316647 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fc9e80044b0 con 0x7fc9f4102fb0 2023-07-14T18:13:26.693 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.644+0000 7fc9dbfff700 1 -- 172.21.15.163:0/830316647 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9e8003df0 con 0x7fc9f4102fb0 2023-07-14T18:13:26.693 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.644+0000 7fc9f9690700 1 -- 172.21.15.163:0/830316647 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9ec009d00 con 0x7fc9f4102fb0 2023-07-14T18:13:26.697 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.647+0000 7fc9dbfff700 1 -- 172.21.15.163:0/830316647 <== mon.0 v2:172.21.15.163:3300/0 4 ==== mgrmap(e 18) v1 ==== 135716+0+0 (secure 0 0 0) 0x7fc9e8003f50 con 0x7fc9f4102fb0 2023-07-14T18:13:26.698 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.647+0000 7fc9dbfff700 1 --2- 172.21.15.163:0/830316647 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7fc9dc0a1150 0x7fc9dc0a3600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:13:26.698 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.647+0000 7fc9f2ffd700 1 --2- 172.21.15.163:0/830316647 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7fc9dc0a1150 0x7fc9dc0a3600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:13:26.698 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.647+0000 7fc9dbfff700 1 -- 172.21.15.163:0/830316647 <== mon.0 v2:172.21.15.163:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 9049+0+0 (secure 0 0 0) 0x7fc9e8014070 con 0x7fc9f4102fb0 2023-07-14T18:13:26.698 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.648+0000 7fc9f2ffd700 1 --2- 172.21.15.163:0/830316647 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7fc9dc0a1150 0x7fc9dc0a3600 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fc9e4009df0 tx=0x7fc9e4009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:13:26.698 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.648+0000 7fca05828b80 1 Processor -- start 2023-07-14T18:13:26.698 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.648+0000 7fca05828b80 1 -- start start 2023-07-14T18:13:26.699 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.648+0000 7fca05828b80 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x562e62addf60 0x562e62ade370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:13:26.699 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.649+0000 7fca05828b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562e62ade8b0 0x562e62adeed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:13:26.699 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.649+0000 7fca05828b80 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x562e62adf4b0 0x562e62adf920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:13:26.699 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.649+0000 7fca05828b80 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x562e629e2cb0 con 0x562e62adf4b0 2023-07-14T18:13:26.699 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.649+0000 7fca05828b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x562e62a35a40 con 0x562e62ade8b0 2023-07-14T18:13:26.699 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.649+0000 7fca05828b80 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x562e62a2eed0 con 0x562e62addf60 2023-07-14T18:13:26.699 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.649+0000 7fc9f37fe700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x562e62adf4b0 0x562e62adf920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:13:26.700 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.649+0000 7fc9f37fe700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x562e62adf4b0 0x562e62adf920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:58208/0 (socket says 172.21.15.163:58208) 2023-07-14T18:13:26.700 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.649+0000 7fc9f37fe700 1 -- 172.21.15.163:0/3017753804 learned_addr learned my addr 172.21.15.163:0/3017753804 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:13:26.700 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.649+0000 7fc9f2ffd700 1 --2- 172.21.15.163:0/3017753804 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x562e62addf60 0x562e62ade370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:13:26.700 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.649+0000 7fc9f27fc700 1 --2- 172.21.15.163:0/3017753804 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562e62ade8b0 0x562e62adeed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:13:26.700 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.649+0000 7fc9f37fe700 1 -- 172.21.15.163:0/3017753804 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x562e62addf60 msgr2=0x562e62ade370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:13:26.700 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.649+0000 7fc9f37fe700 1 --2- 172.21.15.163:0/3017753804 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x562e62addf60 0x562e62ade370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:13:26.700 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.649+0000 7fc9f37fe700 1 -- 172.21.15.163:0/3017753804 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562e62ade8b0 msgr2=0x562e62adeed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:13:26.700 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.649+0000 7fc9f37fe700 1 --2- 172.21.15.163:0/3017753804 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562e62ade8b0 0x562e62adeed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:13:26.701 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.649+0000 7fc9f37fe700 1 -- 172.21.15.163:0/3017753804 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562e6285cde0 con 0x562e62adf4b0 2023-07-14T18:13:26.701 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.649+0000 7fc9f37fe700 1 --2- 172.21.15.163:0/3017753804 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x562e62adf4b0 0x562e62adf920 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7fc9ec006130 tx=0x7fc9ec009c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e24d3ef3f18e8726 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:13:26.701 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.649+0000 7fc9d97fa700 1 -- 172.21.15.163:0/3017753804 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9ec00e040 con 0x562e62adf4b0 2023-07-14T18:13:26.701 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.650+0000 7fc9d97fa700 1 -- 172.21.15.163:0/3017753804 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fc9ec007d90 con 0x562e62adf4b0 2023-07-14T18:13:26.701 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.650+0000 7fc9d97fa700 1 -- 172.21.15.163:0/3017753804 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9ec004dc0 con 0x562e62adf4b0 2023-07-14T18:13:26.701 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.650+0000 7fca05828b80 1 -- 172.21.15.163:0/3017753804 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x562e62adf4b0 msgr2=0x562e62adf920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:13:26.701 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.650+0000 7fca05828b80 1 --2- 172.21.15.163:0/3017753804 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x562e62adf4b0 0x562e62adf920 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7fc9ec006130 tx=0x7fc9ec009c80 comp rx=0 tx=0).stop 2023-07-14T18:13:26.702 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.650+0000 7fca05828b80 1 -- 172.21.15.163:0/3017753804 shutdown_connections 2023-07-14T18:13:26.702 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.650+0000 7fca05828b80 1 --2- 172.21.15.163:0/3017753804 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x562e62addf60 0x562e62ade370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:13:26.702 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.650+0000 7fca05828b80 1 --2- 172.21.15.163:0/3017753804 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x562e62adf4b0 0x562e62adf920 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:13:26.702 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.650+0000 7fca05828b80 1 --2- 172.21.15.163:0/3017753804 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562e62ade8b0 0x562e62adeed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:13:26.702 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.650+0000 7fca05828b80 1 -- 172.21.15.163:0/3017753804 >> 172.21.15.163:0/3017753804 conn(0x562e62ad3680 msgr2=0x562e62ad89d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:13:26.702 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.650+0000 7fca05828b80 1 -- 172.21.15.163:0/3017753804 shutdown_connections 2023-07-14T18:13:26.702 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.650+0000 7fca05828b80 1 -- 172.21.15.163:0/3017753804 wait complete. 2023-07-14T18:13:26.702 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.651+0000 7fca05828b80 1 -- start start 2023-07-14T18:13:26.703 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.651+0000 7fca05828b80 1 Processor -- start 2023-07-14T18:13:26.703 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.651+0000 7fca05828b80 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x562e62addf60 0x562e62ae7910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:13:26.703 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.651+0000 7fca05828b80 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x562e62ade8b0 0x562e62ae7e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:13:26.703 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.651+0000 7fca05828b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562e62adf4b0 0x562e62aeee90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:13:26.703 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.651+0000 7fca05828b80 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x562e629ceac0 con 0x562e62addf60 2023-07-14T18:13:26.703 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.651+0000 7fca05828b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x562e629ce7c0 con 0x562e62adf4b0 2023-07-14T18:13:26.703 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.651+0000 7fca05828b80 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x562e628b2920 con 0x562e62ade8b0 2023-07-14T18:13:26.703 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.651+0000 7fca05828b80 10 client.0 _ll_register_callbacks cb 0x562e629cc760 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T18:13:26.704 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.651+0000 7fc9f2ffd700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x562e62addf60 0x562e62ae7910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:13:26.704 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.651+0000 7fc9f2ffd700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x562e62addf60 0x562e62ae7910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:58210/0 (socket says 172.21.15.163:58210) 2023-07-14T18:13:26.704 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.651+0000 7fc9f2ffd700 1 -- 172.21.15.163:0/712673748 learned_addr learned my addr 172.21.15.163:0/712673748 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:13:26.704 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.651+0000 7fc9f37fe700 1 --2- 172.21.15.163:0/712673748 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562e62adf4b0 0x562e62aeee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:13:26.704 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.651+0000 7fc9f27fc700 1 --2- 172.21.15.163:0/712673748 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x562e62ade8b0 0x562e62ae7e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:13:26.704 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.651+0000 7fc9f2ffd700 1 -- 172.21.15.163:0/712673748 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x562e62ade8b0 msgr2=0x562e62ae7e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:13:26.704 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.651+0000 7fc9f2ffd700 1 --2- 172.21.15.163:0/712673748 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x562e62ade8b0 0x562e62ae7e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:13:26.705 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.651+0000 7fc9f2ffd700 1 -- 172.21.15.163:0/712673748 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562e62adf4b0 msgr2=0x562e62aeee90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:13:26.705 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.651+0000 7fc9f2ffd700 1 --2- 172.21.15.163:0/712673748 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562e62adf4b0 0x562e62aeee90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:13:26.705 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.651+0000 7fc9f2ffd700 1 -- 172.21.15.163:0/712673748 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9f4108920 con 0x562e62addf60 2023-07-14T18:13:26.705 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.652+0000 7fc9f37fe700 1 --2- 172.21.15.163:0/712673748 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562e62adf4b0 0x562e62aeee90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T18:13:26.705 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.652+0000 7fc9f2ffd700 1 --2- 172.21.15.163:0/712673748 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x562e62addf60 0x562e62ae7910 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7fc9e400ee00 tx=0x7fc9e40047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d077aaeb7f2699c server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:13:26.705 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.652+0000 7fc9d6ff5700 10 client.0 ms_handle_connect on v2:172.21.15.163:3300/0 2023-07-14T18:13:26.705 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.652+0000 7fc9d6ff5700 1 -- 172.21.15.163:0/712673748 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9e4022070 con 0x562e62addf60 2023-07-14T18:13:26.705 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.652+0000 7fc9d6ff5700 1 -- 172.21.15.163:0/712673748 <== mon.0 v2:172.21.15.163:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 9049+0+0 (secure 0 0 0) 0x7fc9e4004020 con 0x562e62addf60 2023-07-14T18:13:26.706 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.652+0000 7fca05828b80 1 -- 172.21.15.163:0/712673748 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x562e629884f0 con 0x562e62addf60 2023-07-14T18:13:26.706 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.652+0000 7fc9d6ff5700 1 -- 172.21.15.163:0/712673748 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc9e401de80 con 0x562e62addf60 2023-07-14T18:13:26.706 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.652+0000 7fca05828b80 10 client.15756 fetch_fsmap learned FSMap version 29 2023-07-14T18:13:26.706 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.652+0000 7fca05828b80 1 -- 172.21.15.163:0/712673748 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) v3 -- 0x562e62845c60 con 0x562e62addf60 2023-07-14T18:13:26.706 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.652+0000 7fc9d6ff5700 1 -- 172.21.15.163:0/712673748 <== mon.0 v2:172.21.15.163:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x562e629884f0 con 0x562e62addf60 2023-07-14T18:13:26.706 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.652+0000 7fc9d6ff5700 1 -- 172.21.15.163:0/712673748 <== mon.0 v2:172.21.15.163:3300/0 5 ==== fsmap(e 29) v1 ==== 7470+0+0 (secure 0 0 0) 0x7fc9e4026410 con 0x562e62addf60 2023-07-14T18:13:26.706 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.652+0000 7fca05828b80 10 client.15756 fetch_fsmap finished waiting for FSMap version 29 2023-07-14T18:13:26.706 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.653+0000 7fca05828b80 10 client.15756 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.c 2023-07-14T18:13:26.707 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.653+0000 7fca05828b80 20 client.15756 populate_metadata read hostname 'smithi163' 2023-07-14T18:13:26.707 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.653+0000 7fca05828b80 1 --2- 172.21.15.163:0/712673748 >> [v2:172.21.15.184:6836/3389277679,v1:172.21.15.184:6837/3389277679] conn(0x562e62af7b20 0x562e62af9f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:13:26.707 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.653+0000 7fca05828b80 4 client.15756 mds_command: new command op to 24478 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-14T18:13:26.707 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.653+0000 7fca05828b80 1 -- 172.21.15.163:0/712673748 --> [v2:172.21.15.184:6836/3389277679,v1:172.21.15.184:6837/3389277679] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x562e62aacda0 con 0x562e62af7b20 2023-07-14T18:13:26.707 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.653+0000 7fc9f27fc700 1 --2- 172.21.15.163:0/712673748 >> [v2:172.21.15.184:6836/3389277679,v1:172.21.15.184:6837/3389277679] conn(0x562e62af7b20 0x562e62af9f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:13:26.707 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.653+0000 7fc9d6ff5700 10 client.15756 ms_handle_connect on v2:172.21.15.184:6836/3389277679 2023-07-14T18:13:26.707 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.653+0000 7fc9f27fc700 1 --2- 172.21.15.163:0/712673748 >> [v2:172.21.15.184:6836/3389277679,v1:172.21.15.184:6837/3389277679] conn(0x562e62af7b20 0x562e62af9f30 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=e6be0bbef2f5e108 server_cookie=bbd246c86503dd4e in_seq=0 out_seq=0 2023-07-14T18:13:26.708 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.654+0000 7fc9d6ff5700 1 -- 172.21.15.163:0/712673748 <== mds.3 v2:172.21.15.184:6836/3389277679 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18017 (crc 0 0 0) 0x562e62aacda0 con 0x562e62af7b20 2023-07-14T18:13:26.708 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.654+0000 7fc9d6ff5700 10 client.15756 handle_command_reply: tid=0 2023-07-14T18:13:26.708 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.654+0000 7fca05828b80 1 client.15756 shutdown 2023-07-14T18:13:26.708 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.654+0000 7fca05828b80 1 -- 172.21.15.163:0/712673748 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x562e62addf60 msgr2=0x562e62ae7910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:13:26.708 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.654+0000 7fca05828b80 1 --2- 172.21.15.163:0/712673748 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x562e62addf60 0x562e62ae7910 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7fc9e400ee00 tx=0x7fc9e40047c0 comp rx=0 tx=0).stop 2023-07-14T18:13:26.708 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.654+0000 7fca05828b80 1 -- 172.21.15.163:0/712673748 shutdown_connections 2023-07-14T18:13:26.708 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.654+0000 7fca05828b80 1 --2- 172.21.15.163:0/712673748 >> [v2:172.21.15.184:6836/3389277679,v1:172.21.15.184:6837/3389277679] conn(0x562e62af7b20 0x562e62af9f30 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:13:26.709 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.654+0000 7fca05828b80 1 --2- 172.21.15.163:0/712673748 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562e62adf4b0 0x562e62aeee90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:13:26.709 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.654+0000 7fca05828b80 1 --2- 172.21.15.163:0/712673748 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x562e62addf60 0x562e62ae7910 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:13:26.709 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.654+0000 7fca05828b80 1 --2- 172.21.15.163:0/712673748 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x562e62ade8b0 0x562e62ae7e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:13:26.709 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.654+0000 7fca05828b80 1 -- 172.21.15.163:0/712673748 >> 172.21.15.163:0/712673748 conn(0x562e62ad3680 msgr2=0x562e62ad7650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:13:26.709 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.654+0000 7fc9d6ff5700 0 client.15756 ms_handle_reset on v2:172.21.15.184:6836/3389277679 2023-07-14T18:13:26.709 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.654+0000 7fca05828b80 1 -- 172.21.15.163:0/712673748 shutdown_connections 2023-07-14T18:13:26.709 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.654+0000 7fca05828b80 1 -- 172.21.15.163:0/712673748 wait complete. 2023-07-14T18:13:26.709 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.654+0000 7fca05828b80 20 client.15756 trim_cache size 0 max 16384 2023-07-14T18:13:26.712 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.667+0000 7fca05828b80 1 Processor -- start 2023-07-14T18:13:26.713 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.667+0000 7fca05828b80 1 -- start start 2023-07-14T18:13:26.713 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.667+0000 7fca05828b80 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x562e62addf60 0x562e62adf880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:13:26.713 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.667+0000 7fca05828b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562e62ade8b0 0x562e62aeee50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:13:26.713 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.667+0000 7fca05828b80 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x562e62adf4b0 0x562e62ae6fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:13:26.713 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.667+0000 7fca05828b80 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x562e62ae5610 con 0x562e62addf60 2023-07-14T18:13:26.713 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.667+0000 7fca05828b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x562e62af7820 con 0x562e62ade8b0 2023-07-14T18:13:26.713 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.667+0000 7fca05828b80 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x562e62ae6340 con 0x562e62adf4b0 2023-07-14T18:13:26.714 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.667+0000 7fc9f2ffd700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x562e62addf60 0x562e62adf880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:13:26.714 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.667+0000 7fc9f2ffd700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x562e62addf60 0x562e62adf880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:58218/0 (socket says 172.21.15.163:58218) 2023-07-14T18:13:26.714 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.667+0000 7fc9f2ffd700 1 -- 172.21.15.163:0/1526143521 learned_addr learned my addr 172.21.15.163:0/1526143521 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:13:26.714 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.668+0000 7fc9f37fe700 1 --2- 172.21.15.163:0/1526143521 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x562e62adf4b0 0x562e62ae6fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:13:26.714 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.668+0000 7fc9f27fc700 1 --2- 172.21.15.163:0/1526143521 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562e62ade8b0 0x562e62aeee50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:13:26.714 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.668+0000 7fc9f2ffd700 1 -- 172.21.15.163:0/1526143521 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x562e62adf4b0 msgr2=0x562e62ae6fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:13:26.714 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.668+0000 7fc9f2ffd700 1 --2- 172.21.15.163:0/1526143521 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x562e62adf4b0 0x562e62ae6fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:13:26.714 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.668+0000 7fc9f2ffd700 1 -- 172.21.15.163:0/1526143521 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562e62ade8b0 msgr2=0x562e62aeee50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:13:26.715 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.668+0000 7fc9f2ffd700 1 --2- 172.21.15.163:0/1526143521 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562e62ade8b0 0x562e62aeee50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:13:26.715 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.668+0000 7fc9f2ffd700 1 -- 172.21.15.163:0/1526143521 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562e62883250 con 0x562e62addf60 2023-07-14T18:13:26.715 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.668+0000 7fc9f37fe700 1 --2- 172.21.15.163:0/1526143521 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x562e62adf4b0 0x562e62ae6fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T18:13:26.715 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.668+0000 7fc9f2ffd700 1 --2- 172.21.15.163:0/1526143521 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x562e62addf60 0x562e62adf880 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7fc9e4009870 tx=0x7fc9e400e450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1cd73279f5096480 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:13:26.715 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.668+0000 7fc9d9ffb700 1 -- 172.21.15.163:0/1526143521 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9e4022050 con 0x562e62addf60 2023-07-14T18:13:26.715 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.668+0000 7fc9d9ffb700 1 -- 172.21.15.163:0/1526143521 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fc9e40044d0 con 0x562e62addf60 2023-07-14T18:13:26.715 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.668+0000 7fc9d9ffb700 1 -- 172.21.15.163:0/1526143521 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9e4003680 con 0x562e62addf60 2023-07-14T18:13:26.716 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.669+0000 7fca05828b80 1 -- 172.21.15.163:0/1526143521 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x562e62addf60 msgr2=0x562e62adf880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:13:26.716 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.669+0000 7fca05828b80 1 --2- 172.21.15.163:0/1526143521 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x562e62addf60 0x562e62adf880 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7fc9e4009870 tx=0x7fc9e400e450 comp rx=0 tx=0).stop 2023-07-14T18:13:26.716 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.669+0000 7fca05828b80 1 -- 172.21.15.163:0/1526143521 shutdown_connections 2023-07-14T18:13:26.716 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.669+0000 7fca05828b80 1 --2- 172.21.15.163:0/1526143521 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x562e62adf4b0 0x562e62ae6fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:13:26.716 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.669+0000 7fca05828b80 1 --2- 172.21.15.163:0/1526143521 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x562e62addf60 0x562e62adf880 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:13:26.716 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.669+0000 7fca05828b80 1 --2- 172.21.15.163:0/1526143521 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562e62ade8b0 0x562e62aeee50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:13:26.716 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.669+0000 7fca05828b80 1 -- 172.21.15.163:0/1526143521 >> 172.21.15.163:0/1526143521 conn(0x562e62ad3680 msgr2=0x562e62ae5860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:13:26.716 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.669+0000 7fca05828b80 1 -- 172.21.15.163:0/1526143521 shutdown_connections 2023-07-14T18:13:26.717 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.669+0000 7fca05828b80 1 -- 172.21.15.163:0/1526143521 wait complete. 2023-07-14T18:13:26.717 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.669+0000 7fca05828b80 1 -- start start 2023-07-14T18:13:26.717 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.669+0000 7fca05828b80 1 Processor -- start 2023-07-14T18:13:26.717 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.670+0000 7fca05828b80 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x562e62addf60 0x562e62aee690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:13:26.717 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.670+0000 7fca05828b80 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x562e62ade8b0 0x562e62aeebd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:13:26.717 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.670+0000 7fca05828b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562e62adf4b0 0x562e62aeb130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:13:26.717 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.670+0000 7fca05828b80 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x562e62aeb670 con 0x562e62addf60 2023-07-14T18:13:26.717 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.670+0000 7fca05828b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x562e62aeb7b0 con 0x562e62adf4b0 2023-07-14T18:13:26.718 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.670+0000 7fca05828b80 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x562e62aeb970 con 0x562e62ade8b0 2023-07-14T18:13:26.718 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.670+0000 7fca05828b80 10 client.0 _ll_register_callbacks cb 0x7fc9e400e9b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T18:13:26.718 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.670+0000 7fc9f2ffd700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x562e62addf60 0x562e62aee690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:13:26.718 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.670+0000 7fc9f2ffd700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x562e62addf60 0x562e62aee690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:58224/0 (socket says 172.21.15.163:58224) 2023-07-14T18:13:26.718 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.670+0000 7fc9f27fc700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x562e62ade8b0 0x562e62aeebd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:13:26.718 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.670+0000 7fc9f2ffd700 1 -- 172.21.15.163:0/692763084 learned_addr learned my addr 172.21.15.163:0/692763084 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:13:26.718 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.670+0000 7fc9f37fe700 1 --2- 172.21.15.163:0/692763084 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562e62adf4b0 0x562e62aeb130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:13:26.719 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.670+0000 7fc9f2ffd700 1 -- 172.21.15.163:0/692763084 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x562e62ade8b0 msgr2=0x562e62aeebd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:13:26.719 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.670+0000 7fc9f2ffd700 1 --2- 172.21.15.163:0/692763084 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x562e62ade8b0 0x562e62aeebd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:13:26.719 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.670+0000 7fc9f2ffd700 1 -- 172.21.15.163:0/692763084 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562e62adf4b0 msgr2=0x562e62aeb130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:13:26.719 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.670+0000 7fc9f2ffd700 1 --2- 172.21.15.163:0/692763084 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562e62adf4b0 0x562e62aeb130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:13:26.719 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.670+0000 7fc9f2ffd700 1 -- 172.21.15.163:0/692763084 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x562e62845c60 con 0x562e62addf60 2023-07-14T18:13:26.719 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.670+0000 7fc9f27fc700 1 --2- 172.21.15.163:0/692763084 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x562e62ade8b0 0x562e62aeebd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T18:13:26.719 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.670+0000 7fc9f2ffd700 1 --2- 172.21.15.163:0/692763084 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x562e62addf60 0x562e62aee690 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7fc9e40268c0 tx=0x7fc9e40042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=50731533a51ed481 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:13:26.719 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.670+0000 7fc9d6ff5700 10 client.0 ms_handle_connect on v2:172.21.15.163:3300/0 2023-07-14T18:13:26.720 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.671+0000 7fc9d6ff5700 1 -- 172.21.15.163:0/692763084 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9e4022040 con 0x562e62addf60 2023-07-14T18:13:26.720 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.671+0000 7fc9d6ff5700 1 -- 172.21.15.163:0/692763084 <== mon.0 v2:172.21.15.163:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 9049+0+0 (secure 0 0 0) 0x7fc9e4026e10 con 0x562e62addf60 2023-07-14T18:13:26.720 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.671+0000 7fca05828b80 1 -- 172.21.15.163:0/692763084 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fc9ec007d90 con 0x562e62addf60 2023-07-14T18:13:26.720 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.671+0000 7fc9d6ff5700 1 -- 172.21.15.163:0/692763084 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc9e4005040 con 0x562e62addf60 2023-07-14T18:13:26.720 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.671+0000 7fca05828b80 10 client.15762 fetch_fsmap learned FSMap version 29 2023-07-14T18:13:26.720 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.671+0000 7fca05828b80 1 -- 172.21.15.163:0/692763084 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) v3 -- 0x562e6285b2b0 con 0x562e62addf60 2023-07-14T18:13:26.720 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.671+0000 7fc9d6ff5700 1 -- 172.21.15.163:0/692763084 <== mon.0 v2:172.21.15.163:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fc9ec007d90 con 0x562e62addf60 2023-07-14T18:13:26.720 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.671+0000 7fc9d6ff5700 1 -- 172.21.15.163:0/692763084 <== mon.0 v2:172.21.15.163:3300/0 5 ==== fsmap(e 29) v1 ==== 7470+0+0 (secure 0 0 0) 0x7fc9e4003c60 con 0x562e62addf60 2023-07-14T18:13:26.721 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.671+0000 7fca05828b80 10 client.15762 fetch_fsmap finished waiting for FSMap version 29 2023-07-14T18:13:26.721 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.671+0000 7fca05828b80 10 client.15762 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.c 2023-07-14T18:13:26.721 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.671+0000 7fca05828b80 20 client.15762 populate_metadata read hostname 'smithi163' 2023-07-14T18:13:26.721 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.671+0000 7fca05828b80 1 --2- 172.21.15.163:0/692763084 >> [v2:172.21.15.184:6836/3389277679,v1:172.21.15.184:6837/3389277679] conn(0x562e62b4c8c0 0x562e62b4ecd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:13:26.721 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.671+0000 7fca05828b80 4 client.15762 mds_command: new command op to 24478 tid=0[{"prefix": "damage ls"}] 2023-07-14T18:13:26.721 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.671+0000 7fca05828b80 1 -- 172.21.15.163:0/692763084 --> [v2:172.21.15.184:6836/3389277679,v1:172.21.15.184:6837/3389277679] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x562e62a27eb0 con 0x562e62b4c8c0 2023-07-14T18:13:26.721 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.671+0000 7fc9f27fc700 1 --2- 172.21.15.163:0/692763084 >> [v2:172.21.15.184:6836/3389277679,v1:172.21.15.184:6837/3389277679] conn(0x562e62b4c8c0 0x562e62b4ecd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:13:26.722 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.672+0000 7fc9d6ff5700 10 client.15762 ms_handle_connect on v2:172.21.15.184:6836/3389277679 2023-07-14T18:13:26.723 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.672+0000 7fc9f27fc700 1 --2- 172.21.15.163:0/692763084 >> [v2:172.21.15.184:6836/3389277679,v1:172.21.15.184:6837/3389277679] conn(0x562e62b4c8c0 0x562e62b4ecd0 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=5866f649bdcc70ab server_cookie=16ea22b46f70bed5 in_seq=0 out_seq=0 2023-07-14T18:13:26.723 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.672+0000 7fc9d6ff5700 1 -- 172.21.15.163:0/692763084 <== mds.3 v2:172.21.15.184:6836/3389277679 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x562e62a27eb0 con 0x562e62b4c8c0 2023-07-14T18:13:26.723 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.672+0000 7fc9d6ff5700 10 client.15762 handle_command_reply: tid=0 2023-07-14T18:13:26.723 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.672+0000 7fca05828b80 1 client.15762 shutdown 2023-07-14T18:13:26.723 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.672+0000 7fca05828b80 1 -- 172.21.15.163:0/692763084 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x562e62addf60 msgr2=0x562e62aee690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:13:26.723 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.672+0000 7fca05828b80 1 --2- 172.21.15.163:0/692763084 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x562e62addf60 0x562e62aee690 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7fc9e40268c0 tx=0x7fc9e40042f0 comp rx=0 tx=0).stop 2023-07-14T18:13:26.723 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.672+0000 7fca05828b80 1 -- 172.21.15.163:0/692763084 shutdown_connections 2023-07-14T18:13:26.724 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.672+0000 7fca05828b80 1 --2- 172.21.15.163:0/692763084 >> [v2:172.21.15.184:6836/3389277679,v1:172.21.15.184:6837/3389277679] conn(0x562e62b4c8c0 0x562e62b4ecd0 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:13:26.724 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.672+0000 7fca05828b80 1 --2- 172.21.15.163:0/692763084 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562e62adf4b0 0x562e62aeb130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:13:26.724 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.672+0000 7fca05828b80 1 --2- 172.21.15.163:0/692763084 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x562e62addf60 0x562e62aee690 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:13:26.724 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.672+0000 7fca05828b80 1 --2- 172.21.15.163:0/692763084 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x562e62ade8b0 0x562e62aeebd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:13:26.724 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.672+0000 7fca05828b80 1 -- 172.21.15.163:0/692763084 >> 172.21.15.163:0/692763084 conn(0x562e62ad3680 msgr2=0x562e62ae2370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:13:26.724 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.672+0000 7fc9d6ff5700 0 client.15762 ms_handle_reset on v2:172.21.15.184:6836/3389277679 2023-07-14T18:13:26.724 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.672+0000 7fca05828b80 1 -- 172.21.15.163:0/692763084 shutdown_connections 2023-07-14T18:13:26.724 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.672+0000 7fca05828b80 1 -- 172.21.15.163:0/692763084 wait complete. 2023-07-14T18:13:26.725 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.672+0000 7fca05828b80 20 client.15762 trim_cache size 0 max 16384 2023-07-14T18:13:26.725 INFO:teuthology.orchestra.run.smithi163.stdout:[] 2023-07-14T18:13:26.726 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.673+0000 7fc9f9690700 1 -- 172.21.15.163:0/830316647 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7fc9dc0a1150 msgr2=0x7fc9dc0a3600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:13:26.726 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.673+0000 7fc9f9690700 1 --2- 172.21.15.163:0/830316647 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7fc9dc0a1150 0x7fc9dc0a3600 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fc9e4009df0 tx=0x7fc9e4009260 comp rx=0 tx=0).stop 2023-07-14T18:13:26.726 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.673+0000 7fc9f9690700 1 -- 172.21.15.163:0/830316647 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc9f4102fb0 msgr2=0x7fc9f4195e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:13:26.726 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.673+0000 7fc9f9690700 1 --2- 172.21.15.163:0/830316647 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc9f4102fb0 0x7fc9f4195e70 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7fc9e800eb30 tx=0x7fc9e800ee40 comp rx=0 tx=0).stop 2023-07-14T18:13:26.726 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.673+0000 7fc9f9690700 1 -- 172.21.15.163:0/830316647 shutdown_connections 2023-07-14T18:13:26.726 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.673+0000 7fc9f9690700 1 --2- 172.21.15.163:0/830316647 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7fc9dc0a1150 0x7fc9dc0a3600 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:13:26.726 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.673+0000 7fc9f9690700 1 --2- 172.21.15.163:0/830316647 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc9f41058d0 0x7fc9f419cee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:13:26.727 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.673+0000 7fc9f9690700 1 --2- 172.21.15.163:0/830316647 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc9f4100690 0x7fc9f4195930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:13:26.727 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.673+0000 7fc9f9690700 1 --2- 172.21.15.163:0/830316647 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc9f4102fb0 0x7fc9f4195e70 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:13:26.727 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.673+0000 7fc9f9690700 1 -- 172.21.15.163:0/830316647 >> 172.21.15.163:0/830316647 conn(0x7fc9f40fa130 msgr2=0x7fc9f41012f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:13:26.727 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.673+0000 7fc9f9690700 1 -- 172.21.15.163:0/830316647 shutdown_connections 2023-07-14T18:13:26.727 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.673+0000 7fc9f9690700 1 -- 172.21.15.163:0/830316647 wait complete. 2023-07-14T18:13:26.729 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:2 damage ls 2023-07-14T18:13:26.861 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.820+0000 7f3d56904700 1 -- 172.21.15.163:0/2148872799 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f3d500fe280 msgr2=0x7f3d500fe690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:13:26.862 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.820+0000 7f3d56904700 1 --2- 172.21.15.163:0/2148872799 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f3d500fe280 0x7f3d500fe690 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f3d38009990 tx=0x7f3d38009ca0 comp rx=0 tx=0).stop 2023-07-14T18:13:26.862 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.820+0000 7f3d56904700 1 -- 172.21.15.163:0/2148872799 shutdown_connections 2023-07-14T18:13:26.862 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.820+0000 7f3d56904700 1 --2- 172.21.15.163:0/2148872799 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3d500ffe00 0x7f3d501066c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:13:26.862 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.820+0000 7f3d56904700 1 --2- 172.21.15.163:0/2148872799 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f3d500fe280 0x7f3d500fe690 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:13:26.862 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.820+0000 7f3d56904700 1 --2- 172.21.15.163:0/2148872799 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3d500ff470 0x7f3d500ff8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:13:26.862 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.820+0000 7f3d56904700 1 -- 172.21.15.163:0/2148872799 >> 172.21.15.163:0/2148872799 conn(0x7f3d500f98a0 msgr2=0x7f3d500fbcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:13:26.863 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.820+0000 7f3d56904700 1 -- 172.21.15.163:0/2148872799 shutdown_connections 2023-07-14T18:13:26.863 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.820+0000 7f3d56904700 1 -- 172.21.15.163:0/2148872799 wait complete. 2023-07-14T18:13:26.866 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.821+0000 7f3d56904700 1 Processor -- start 2023-07-14T18:13:26.867 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.821+0000 7f3d56904700 1 -- start start 2023-07-14T18:13:26.867 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.821+0000 7f3d56904700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3d500fe280 0x7f3d50107b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:13:26.867 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.821+0000 7f3d56904700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f3d500ff470 0x7f3d5019a5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:13:26.867 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.821+0000 7f3d56904700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3d500ffe00 0x7f3d5019cc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:13:26.868 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.821+0000 7f3d56904700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d5019d3d0 con 0x7f3d500ff470 2023-07-14T18:13:26.868 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.821+0000 7f3d56904700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d5019d540 con 0x7f3d500ffe00 2023-07-14T18:13:26.868 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.821+0000 7f3d56904700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d5019d700 con 0x7f3d500fe280 2023-07-14T18:13:26.868 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.822+0000 7f3d54ea1700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3d500ffe00 0x7f3d5019cc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:13:26.868 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.822+0000 7f3d47fff700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f3d500ff470 0x7f3d5019a5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:13:26.868 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.822+0000 7f3d54ea1700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3d500ffe00 0x7f3d5019cc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.163:58924/0 (socket says 172.21.15.163:58924) 2023-07-14T18:13:26.868 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.822+0000 7f3d54ea1700 1 -- 172.21.15.163:0/141870003 learned_addr learned my addr 172.21.15.163:0/141870003 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:13:26.869 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.822+0000 7f3d4ffff700 1 --2- 172.21.15.163:0/141870003 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3d500fe280 0x7f3d50107b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:13:26.869 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.822+0000 7f3d54ea1700 1 -- 172.21.15.163:0/141870003 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3d500fe280 msgr2=0x7f3d50107b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:13:26.869 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.822+0000 7f3d54ea1700 1 --2- 172.21.15.163:0/141870003 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3d500fe280 0x7f3d50107b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:13:26.869 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.822+0000 7f3d54ea1700 1 -- 172.21.15.163:0/141870003 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f3d500ff470 msgr2=0x7f3d5019a5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:13:26.869 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.822+0000 7f3d54ea1700 1 --2- 172.21.15.163:0/141870003 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f3d500ff470 0x7f3d5019a5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:13:26.869 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.822+0000 7f3d54ea1700 1 -- 172.21.15.163:0/141870003 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d380095f0 con 0x7f3d500ffe00 2023-07-14T18:13:26.869 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.822+0000 7f3d47fff700 1 --2- 172.21.15.163:0/141870003 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f3d500ff470 0x7f3d5019a5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T18:13:26.870 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.822+0000 7f3d54ea1700 1 --2- 172.21.15.163:0/141870003 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3d500ffe00 0x7f3d5019cc00 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f3d48007ee0 tx=0x7f3d4800d3b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:13:26.870 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.822+0000 7f3d4dffb700 1 -- 172.21.15.163:0/141870003 <== mon.2 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d48017070 con 0x7f3d500ffe00 2023-07-14T18:13:26.870 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.822+0000 7f3d56904700 1 -- 172.21.15.163:0/141870003 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3d5019d9e0 con 0x7f3d500ffe00 2023-07-14T18:13:26.870 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.822+0000 7f3d4dffb700 1 -- 172.21.15.163:0/141870003 <== mon.2 v2:172.21.15.172:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f3d4800f040 con 0x7f3d500ffe00 2023-07-14T18:13:26.870 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.822+0000 7f3d4dffb700 1 -- 172.21.15.163:0/141870003 <== mon.2 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d48005570 con 0x7f3d500ffe00 2023-07-14T18:13:26.870 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.822+0000 7f3d56904700 1 -- 172.21.15.163:0/141870003 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d5019dea0 con 0x7f3d500ffe00 2023-07-14T18:13:26.870 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.825+0000 7f3d4dffb700 1 -- 172.21.15.163:0/141870003 <== mon.2 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 18) v1 ==== 135716+0+0 (secure 0 0 0) 0x7f3d4800db20 con 0x7f3d500ffe00 2023-07-14T18:13:26.875 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.826+0000 7f3d4dffb700 1 --2- 172.21.15.163:0/141870003 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f3d3c0a1150 0x7f3d3c0a3600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:13:26.875 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.826+0000 7f3d62a9cb80 1 Processor -- start 2023-07-14T18:13:26.875 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.826+0000 7f3d62a9cb80 1 -- start start 2023-07-14T18:13:26.875 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.826+0000 7f3d4dffb700 1 -- 172.21.15.163:0/141870003 <== mon.2 v2:172.21.15.172:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 9049+0+0 (secure 0 0 0) 0x7f3d480cc2f0 con 0x7f3d500ffe00 2023-07-14T18:13:26.876 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.826+0000 7f3d4ffff700 1 --2- 172.21.15.163:0/141870003 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f3d3c0a1150 0x7f3d3c0a3600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:13:26.876 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.826+0000 7f3d62a9cb80 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x557c001d2f60 0x557c001d3370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:13:26.876 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.826+0000 7f3d62a9cb80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557c001d38b0 0x557c001d3ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:13:26.876 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.826+0000 7f3d62a9cb80 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x557c001d44b0 0x557c001d4920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:13:26.876 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.826+0000 7f3d62a9cb80 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x557c000d7cb0 con 0x557c001d2f60 2023-07-14T18:13:26.876 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.826+0000 7f3d62a9cb80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x557c0012aa40 con 0x557c001d38b0 2023-07-14T18:13:26.877 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.826+0000 7f3d62a9cb80 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x557c00123ed0 con 0x557c001d44b0 2023-07-14T18:13:26.877 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.827+0000 7f3d4ffff700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x557c001d2f60 0x557c001d3370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:13:26.877 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.827+0000 7f3d4ffff700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x557c001d2f60 0x557c001d3370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:58246/0 (socket says 172.21.15.163:58246) 2023-07-14T18:13:26.877 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.827+0000 7f3d4ffff700 1 -- 172.21.15.163:0/1631941646 learned_addr learned my addr 172.21.15.163:0/1631941646 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:13:26.877 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.827+0000 7f3d54ea1700 1 --2- 172.21.15.163:0/1631941646 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x557c001d44b0 0x557c001d4920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:13:26.877 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.827+0000 7f3d47fff700 1 --2- 172.21.15.163:0/1631941646 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557c001d38b0 0x557c001d3ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:13:26.878 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.827+0000 7f3d4ffff700 1 -- 172.21.15.163:0/1631941646 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x557c001d44b0 msgr2=0x557c001d4920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:13:26.878 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.827+0000 7f3d4ffff700 1 --2- 172.21.15.163:0/1631941646 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x557c001d44b0 0x557c001d4920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:13:26.878 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.827+0000 7f3d4ffff700 1 -- 172.21.15.163:0/1631941646 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557c001d38b0 msgr2=0x557c001d3ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:13:26.878 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.827+0000 7f3d4ffff700 1 --2- 172.21.15.163:0/1631941646 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557c001d38b0 0x557c001d3ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:13:26.878 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.827+0000 7f3d4ffff700 1 -- 172.21.15.163:0/1631941646 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557bfff51de0 con 0x557c001d2f60 2023-07-14T18:13:26.878 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.827+0000 7f3d4ffff700 1 --2- 172.21.15.163:0/141870003 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f3d3c0a1150 0x7f3d3c0a3600 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f3d3800b5c0 tx=0x7f3d3800b770 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:13:26.879 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.827+0000 7f3d54ea1700 1 --2- 172.21.15.163:0/1631941646 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x557c001d44b0 0x557c001d4920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T18:13:26.879 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.827+0000 7f3d4ffff700 1 --2- 172.21.15.163:0/1631941646 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x557c001d2f60 0x557c001d3370 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f3d38005c70 tx=0x7f3d3802a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1858c68877419795 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:13:26.879 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.827+0000 7f3d467fc700 1 -- 172.21.15.163:0/1631941646 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d38005420 con 0x557c001d2f60 2023-07-14T18:13:26.879 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.827+0000 7f3d467fc700 1 -- 172.21.15.163:0/1631941646 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f3d3801e040 con 0x557c001d2f60 2023-07-14T18:13:26.879 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.827+0000 7f3d467fc700 1 -- 172.21.15.163:0/1631941646 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d38003820 con 0x557c001d2f60 2023-07-14T18:13:26.879 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.828+0000 7f3d62a9cb80 1 -- 172.21.15.163:0/1631941646 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x557c001d2f60 msgr2=0x557c001d3370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:13:26.880 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.828+0000 7f3d62a9cb80 1 --2- 172.21.15.163:0/1631941646 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x557c001d2f60 0x557c001d3370 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f3d38005c70 tx=0x7f3d3802a000 comp rx=0 tx=0).stop 2023-07-14T18:13:26.880 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.828+0000 7f3d62a9cb80 1 -- 172.21.15.163:0/1631941646 shutdown_connections 2023-07-14T18:13:26.880 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.828+0000 7f3d62a9cb80 1 --2- 172.21.15.163:0/1631941646 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x557c001d44b0 0x557c001d4920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:13:26.880 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.828+0000 7f3d62a9cb80 1 --2- 172.21.15.163:0/1631941646 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x557c001d2f60 0x557c001d3370 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:13:26.880 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.828+0000 7f3d62a9cb80 1 --2- 172.21.15.163:0/1631941646 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557c001d38b0 0x557c001d3ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:13:26.880 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.828+0000 7f3d62a9cb80 1 -- 172.21.15.163:0/1631941646 >> 172.21.15.163:0/1631941646 conn(0x557c001c8680 msgr2=0x557c001cd9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:13:26.880 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.828+0000 7f3d62a9cb80 1 -- 172.21.15.163:0/1631941646 shutdown_connections 2023-07-14T18:13:26.881 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.828+0000 7f3d62a9cb80 1 -- 172.21.15.163:0/1631941646 wait complete. 2023-07-14T18:13:26.881 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.829+0000 7f3d62a9cb80 1 -- start start 2023-07-14T18:13:26.881 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.829+0000 7f3d62a9cb80 1 Processor -- start 2023-07-14T18:13:26.881 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.829+0000 7f3d62a9cb80 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x557c001d2f60 0x557c001e0cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:13:26.882 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.829+0000 7f3d62a9cb80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557c001d38b0 0x557c001e1210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:13:26.882 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.829+0000 7f3d62a9cb80 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x557c001d44b0 0x557c001e8250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:13:26.882 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.829+0000 7f3d62a9cb80 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x557c000c3ac0 con 0x557c001d2f60 2023-07-14T18:13:26.882 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.829+0000 7f3d62a9cb80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x557c000c37c0 con 0x557c001d38b0 2023-07-14T18:13:26.882 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.829+0000 7f3d62a9cb80 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x557bfffa7920 con 0x557c001d44b0 2023-07-14T18:13:26.882 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.829+0000 7f3d62a9cb80 10 client.0 _ll_register_callbacks cb 0x557c000c1760 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T18:13:26.882 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.830+0000 7f3d47fff700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557c001d38b0 0x557c001e1210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:13:26.883 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.830+0000 7f3d54ea1700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x557c001d44b0 0x557c001e8250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:13:26.883 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.830+0000 7f3d54ea1700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x557c001d44b0 0x557c001e8250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.163:40078/0 (socket says 172.21.15.163:40078) 2023-07-14T18:13:26.883 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.830+0000 7f3d54ea1700 1 -- 172.21.15.163:0/4166302112 learned_addr learned my addr 172.21.15.163:0/4166302112 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:13:26.883 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.830+0000 7f3d54ea1700 1 -- 172.21.15.163:0/4166302112 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557c001d38b0 msgr2=0x557c001e1210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:13:26.883 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.830+0000 7f3d54ea1700 1 --2- 172.21.15.163:0/4166302112 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557c001d38b0 0x557c001e1210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:13:26.883 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.830+0000 7f3d54ea1700 1 -- 172.21.15.163:0/4166302112 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x557c001d2f60 msgr2=0x557c001e0cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:13:26.883 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.830+0000 7f3d54ea1700 1 --2- 172.21.15.163:0/4166302112 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x557c001d2f60 0x557c001e0cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:13:26.884 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.830+0000 7f3d54ea1700 1 -- 172.21.15.163:0/4166302112 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d5019dea0 con 0x557c001d44b0 2023-07-14T18:13:26.884 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.830+0000 7f3d54ea1700 1 --2- 172.21.15.163:0/4166302112 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x557c001d44b0 0x557c001e8250 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f3d480b90d0 tx=0x7f3d48007f90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3ca77a963c253485 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:13:26.884 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.830+0000 7f3d2f7fe700 10 client.0 ms_handle_connect on v2:172.21.15.184:3300/0 2023-07-14T18:13:26.884 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.830+0000 7f3d2f7fe700 1 -- 172.21.15.163:0/4166302112 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d480cc150 con 0x557c001d44b0 2023-07-14T18:13:26.884 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.830+0000 7f3d2f7fe700 1 -- 172.21.15.163:0/4166302112 <== mon.1 v2:172.21.15.184:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 9049+0+0 (secure 0 0 0) 0x7f3d48004c40 con 0x557c001d44b0 2023-07-14T18:13:26.884 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.830+0000 7f3d62a9cb80 1 -- 172.21.15.163:0/4166302112 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x557c0007d4f0 con 0x557c001d44b0 2023-07-14T18:13:26.885 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.831+0000 7f3d2f7fe700 1 -- 172.21.15.163:0/4166302112 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3d4800ddd0 con 0x557c001d44b0 2023-07-14T18:13:26.885 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.831+0000 7f3d62a9cb80 10 client.25363 fetch_fsmap learned FSMap version 29 2023-07-14T18:13:26.885 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.831+0000 7f3d62a9cb80 1 -- 172.21.15.163:0/4166302112 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) v3 -- 0x7f3d50066f10 con 0x557c001d44b0 2023-07-14T18:13:26.885 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.831+0000 7f3d2f7fe700 1 -- 172.21.15.163:0/4166302112 <== mon.1 v2:172.21.15.184:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x557c0007d4f0 con 0x557c001d44b0 2023-07-14T18:13:26.885 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.831+0000 7f3d2f7fe700 1 -- 172.21.15.163:0/4166302112 <== mon.1 v2:172.21.15.184:3300/0 5 ==== fsmap(e 29) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f3d480996d0 con 0x557c001d44b0 2023-07-14T18:13:26.885 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.831+0000 7f3d62a9cb80 10 client.25363 fetch_fsmap finished waiting for FSMap version 29 2023-07-14T18:13:26.885 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.831+0000 7f3d62a9cb80 10 client.25363 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2023-07-14T18:13:26.885 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.831+0000 7f3d62a9cb80 20 client.25363 populate_metadata read hostname 'smithi163' 2023-07-14T18:13:26.886 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.831+0000 7f3d62a9cb80 1 --2- 172.21.15.163:0/4166302112 >> [v2:172.21.15.172:6836/3783835012,v1:172.21.15.172:6837/3783835012] conn(0x557c001eca80 0x557c001eee60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:13:26.886 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.831+0000 7f3d62a9cb80 4 client.25363 mds_command: new command op to 24479 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-14T18:13:26.886 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.831+0000 7f3d62a9cb80 1 -- 172.21.15.163:0/4166302112 --> [v2:172.21.15.172:6836/3783835012,v1:172.21.15.172:6837/3783835012] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x557c001a1da0 con 0x557c001eca80 2023-07-14T18:13:26.886 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.831+0000 7f3d4ffff700 1 --2- 172.21.15.163:0/4166302112 >> [v2:172.21.15.172:6836/3783835012,v1:172.21.15.172:6837/3783835012] conn(0x557c001eca80 0x557c001eee60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:13:26.886 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.832+0000 7f3d2f7fe700 10 client.25363 ms_handle_connect on v2:172.21.15.172:6836/3783835012 2023-07-14T18:13:26.886 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.832+0000 7f3d4ffff700 1 --2- 172.21.15.163:0/4166302112 >> [v2:172.21.15.172:6836/3783835012,v1:172.21.15.172:6837/3783835012] conn(0x557c001eca80 0x557c001eee60 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=66f8dad11be9e548 server_cookie=7bd2dc6431bce9cf in_seq=0 out_seq=0 2023-07-14T18:13:26.886 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.832+0000 7f3d2f7fe700 1 -- 172.21.15.163:0/4166302112 <== mds.2 v2:172.21.15.172:6836/3783835012 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18017 (crc 0 0 0) 0x557c001a1da0 con 0x557c001eca80 2023-07-14T18:13:26.886 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.832+0000 7f3d2f7fe700 10 client.25363 handle_command_reply: tid=0 2023-07-14T18:13:26.887 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.832+0000 7f3d62a9cb80 1 client.25363 shutdown 2023-07-14T18:13:26.887 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.833+0000 7f3d62a9cb80 1 -- 172.21.15.163:0/4166302112 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x557c001d44b0 msgr2=0x557c001e8250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:13:26.887 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.833+0000 7f3d62a9cb80 1 --2- 172.21.15.163:0/4166302112 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x557c001d44b0 0x557c001e8250 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f3d480b90d0 tx=0x7f3d48007f90 comp rx=0 tx=0).stop 2023-07-14T18:13:26.887 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.833+0000 7f3d62a9cb80 1 -- 172.21.15.163:0/4166302112 shutdown_connections 2023-07-14T18:13:26.887 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.833+0000 7f3d62a9cb80 1 --2- 172.21.15.163:0/4166302112 >> [v2:172.21.15.172:6836/3783835012,v1:172.21.15.172:6837/3783835012] conn(0x557c001eca80 0x557c001eee60 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:13:26.887 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.833+0000 7f3d62a9cb80 1 --2- 172.21.15.163:0/4166302112 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x557c001d44b0 0x557c001e8250 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:13:26.888 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.833+0000 7f3d62a9cb80 1 --2- 172.21.15.163:0/4166302112 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x557c001d2f60 0x557c001e0cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:13:26.888 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.833+0000 7f3d62a9cb80 1 --2- 172.21.15.163:0/4166302112 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557c001d38b0 0x557c001e1210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:13:26.888 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.833+0000 7f3d62a9cb80 1 -- 172.21.15.163:0/4166302112 >> 172.21.15.163:0/4166302112 conn(0x557c001c8680 msgr2=0x557c001cc650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:13:26.888 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.833+0000 7f3d2f7fe700 0 client.25363 ms_handle_reset on v2:172.21.15.172:6836/3783835012 2023-07-14T18:13:26.889 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.833+0000 7f3d62a9cb80 1 -- 172.21.15.163:0/4166302112 shutdown_connections 2023-07-14T18:13:26.889 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.833+0000 7f3d62a9cb80 1 -- 172.21.15.163:0/4166302112 wait complete. 2023-07-14T18:13:26.889 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.833+0000 7f3d62a9cb80 20 client.25363 trim_cache size 0 max 16384 2023-07-14T18:13:26.893 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.846+0000 7f3d62a9cb80 1 Processor -- start 2023-07-14T18:13:26.893 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.846+0000 7f3d62a9cb80 1 -- start start 2023-07-14T18:13:26.894 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.846+0000 7f3d62a9cb80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557c001d2f60 0x557c001d4880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:13:26.894 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.846+0000 7f3d62a9cb80 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x557c001d38b0 0x557c001e8210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:13:26.894 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.846+0000 7f3d62a9cb80 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x557c001d44b0 0x557c001df9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:13:26.894 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.846+0000 7f3d62a9cb80 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x557c001ce4c0 con 0x557c001d38b0 2023-07-14T18:13:26.894 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.846+0000 7f3d62a9cb80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x557c001ec860 con 0x557c001d2f60 2023-07-14T18:13:26.894 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.846+0000 7f3d62a9cb80 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x557c001e1e50 con 0x557c001d44b0 2023-07-14T18:13:26.895 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.846+0000 7f3d47fff700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x557c001d38b0 0x557c001e8210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:13:26.895 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.846+0000 7f3d47fff700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x557c001d38b0 0x557c001e8210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:58264/0 (socket says 172.21.15.163:58264) 2023-07-14T18:13:26.895 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.846+0000 7f3d47fff700 1 -- 172.21.15.163:0/3028746848 learned_addr learned my addr 172.21.15.163:0/3028746848 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:13:26.895 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.846+0000 7f3d54ea1700 1 --2- 172.21.15.163:0/3028746848 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x557c001d44b0 0x557c001df9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:13:26.895 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.846+0000 7f3d4ffff700 1 --2- 172.21.15.163:0/3028746848 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557c001d2f60 0x557c001d4880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:13:26.895 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.846+0000 7f3d47fff700 1 -- 172.21.15.163:0/3028746848 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x557c001d44b0 msgr2=0x557c001df9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:13:26.895 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.846+0000 7f3d47fff700 1 --2- 172.21.15.163:0/3028746848 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x557c001d44b0 0x557c001df9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:13:26.896 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.846+0000 7f3d47fff700 1 -- 172.21.15.163:0/3028746848 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557c001d2f60 msgr2=0x557c001d4880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:13:26.896 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.846+0000 7f3d47fff700 1 --2- 172.21.15.163:0/3028746848 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557c001d2f60 0x557c001d4880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:13:26.896 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.846+0000 7f3d47fff700 1 -- 172.21.15.163:0/3028746848 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557bfff3ac60 con 0x557c001d38b0 2023-07-14T18:13:26.896 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.846+0000 7f3d4ffff700 1 --2- 172.21.15.163:0/3028746848 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557c001d2f60 0x557c001d4880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T18:13:26.896 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.847+0000 7f3d47fff700 1 --2- 172.21.15.163:0/3028746848 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x557c001d38b0 0x557c001e8210 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f3d40012610 tx=0x7f3d40012920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce82924e029f98dd server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:13:26.896 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.847+0000 7f3d46ffd700 1 -- 172.21.15.163:0/3028746848 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d40012ea0 con 0x557c001d38b0 2023-07-14T18:13:26.897 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.847+0000 7f3d46ffd700 1 -- 172.21.15.163:0/3028746848 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f3d400044b0 con 0x557c001d38b0 2023-07-14T18:13:26.897 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.847+0000 7f3d46ffd700 1 -- 172.21.15.163:0/3028746848 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d40017070 con 0x557c001d38b0 2023-07-14T18:13:26.897 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.847+0000 7f3d62a9cb80 1 -- 172.21.15.163:0/3028746848 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x557c001d38b0 msgr2=0x557c001e8210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:13:26.897 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.847+0000 7f3d62a9cb80 1 --2- 172.21.15.163:0/3028746848 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x557c001d38b0 0x557c001e8210 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f3d40012610 tx=0x7f3d40012920 comp rx=0 tx=0).stop 2023-07-14T18:13:26.897 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.847+0000 7f3d62a9cb80 1 -- 172.21.15.163:0/3028746848 shutdown_connections 2023-07-14T18:13:26.897 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.847+0000 7f3d62a9cb80 1 --2- 172.21.15.163:0/3028746848 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x557c001d44b0 0x557c001df9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:13:26.897 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.847+0000 7f3d62a9cb80 1 --2- 172.21.15.163:0/3028746848 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557c001d2f60 0x557c001d4880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:13:26.898 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.847+0000 7f3d62a9cb80 1 --2- 172.21.15.163:0/3028746848 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x557c001d38b0 0x557c001e8210 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:13:26.898 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.848+0000 7f3d62a9cb80 1 -- 172.21.15.163:0/3028746848 >> 172.21.15.163:0/3028746848 conn(0x557c001c8680 msgr2=0x557c001cd9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:13:26.898 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.848+0000 7f3d62a9cb80 1 -- 172.21.15.163:0/3028746848 shutdown_connections 2023-07-14T18:13:26.898 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.848+0000 7f3d62a9cb80 1 -- 172.21.15.163:0/3028746848 wait complete. 2023-07-14T18:13:26.898 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.848+0000 7f3d62a9cb80 1 -- start start 2023-07-14T18:13:26.898 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.848+0000 7f3d62a9cb80 1 Processor -- start 2023-07-14T18:13:26.898 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.848+0000 7f3d62a9cb80 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x557c001d2f60 0x557c001e5f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:13:26.899 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.848+0000 7f3d62a9cb80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557c001d38b0 0x557c001e6470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:13:26.899 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.848+0000 7f3d62a9cb80 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x557c001d44b0 0x557c001e7480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:13:26.899 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.848+0000 7f3d62a9cb80 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x557c001e79c0 con 0x557c001d2f60 2023-07-14T18:13:26.899 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.848+0000 7f3d62a9cb80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x557c001e7b30 con 0x557c001d38b0 2023-07-14T18:13:26.899 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.848+0000 7f3d62a9cb80 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x557c001e7cf0 con 0x557c001d44b0 2023-07-14T18:13:26.899 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.848+0000 7f3d62a9cb80 10 client.0 _ll_register_callbacks cb 0x557c000c1760 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T18:13:26.899 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.849+0000 7f3d4ffff700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x557c001d2f60 0x557c001e5f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:13:26.900 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.849+0000 7f3d4ffff700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x557c001d2f60 0x557c001e5f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:58266/0 (socket says 172.21.15.163:58266) 2023-07-14T18:13:26.900 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.849+0000 7f3d4ffff700 1 -- 172.21.15.163:0/4051906690 learned_addr learned my addr 172.21.15.163:0/4051906690 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:13:26.900 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.849+0000 7f3d54ea1700 1 --2- 172.21.15.163:0/4051906690 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x557c001d44b0 0x557c001e7480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:13:26.900 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.849+0000 7f3d47fff700 1 --2- 172.21.15.163:0/4051906690 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557c001d38b0 0x557c001e6470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:13:26.900 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.849+0000 7f3d4ffff700 1 -- 172.21.15.163:0/4051906690 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x557c001d44b0 msgr2=0x557c001e7480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:13:26.900 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.849+0000 7f3d4ffff700 1 --2- 172.21.15.163:0/4051906690 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x557c001d44b0 0x557c001e7480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:13:26.901 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.849+0000 7f3d4ffff700 1 -- 172.21.15.163:0/4051906690 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557c001d38b0 msgr2=0x557c001e6470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:13:26.901 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.849+0000 7f3d4ffff700 1 --2- 172.21.15.163:0/4051906690 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557c001d38b0 0x557c001e6470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:13:26.901 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.849+0000 7f3d4ffff700 1 -- 172.21.15.163:0/4051906690 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d4000be40 con 0x557c001d2f60 2023-07-14T18:13:26.901 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.849+0000 7f3d54ea1700 1 --2- 172.21.15.163:0/4051906690 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x557c001d44b0 0x557c001e7480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T18:13:26.901 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.849+0000 7f3d47fff700 1 --2- 172.21.15.163:0/4051906690 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557c001d38b0 0x557c001e6470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T18:13:26.901 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.849+0000 7f3d4ffff700 1 --2- 172.21.15.163:0/4051906690 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x557c001d2f60 0x557c001e5f30 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f3d38032040 tx=0x7f3d3800b6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fcb381996738d837 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:13:26.901 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.849+0000 7f3d2f7fe700 10 client.0 ms_handle_connect on v2:172.21.15.163:3300/0 2023-07-14T18:13:26.902 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.849+0000 7f3d2f7fe700 1 -- 172.21.15.163:0/4051906690 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d380056b0 con 0x557c001d2f60 2023-07-14T18:13:26.902 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.849+0000 7f3d2f7fe700 1 -- 172.21.15.163:0/4051906690 <== mon.0 v2:172.21.15.163:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 9049+0+0 (secure 0 0 0) 0x7f3d3803e150 con 0x557c001d2f60 2023-07-14T18:13:26.902 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.849+0000 7f3d62a9cb80 1 -- 172.21.15.163:0/4051906690 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f3d3801e040 con 0x557c001d2f60 2023-07-14T18:13:26.902 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.850+0000 7f3d2f7fe700 1 -- 172.21.15.163:0/4051906690 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3d3803e310 con 0x557c001d2f60 2023-07-14T18:13:26.902 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.850+0000 7f3d62a9cb80 10 client.15777 fetch_fsmap learned FSMap version 29 2023-07-14T18:13:26.902 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.850+0000 7f3d62a9cb80 1 -- 172.21.15.163:0/4051906690 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) v3 -- 0x557bfff78250 con 0x557c001d2f60 2023-07-14T18:13:26.902 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.850+0000 7f3d2f7fe700 1 -- 172.21.15.163:0/4051906690 <== mon.0 v2:172.21.15.163:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f3d3801e040 con 0x557c001d2f60 2023-07-14T18:13:26.902 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.850+0000 7f3d2f7fe700 1 -- 172.21.15.163:0/4051906690 <== mon.0 v2:172.21.15.163:3300/0 5 ==== fsmap(e 29) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f3d38005040 con 0x557c001d2f60 2023-07-14T18:13:26.903 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.850+0000 7f3d62a9cb80 10 client.15777 fetch_fsmap finished waiting for FSMap version 29 2023-07-14T18:13:26.903 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.850+0000 7f3d62a9cb80 10 client.15777 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2023-07-14T18:13:26.903 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.850+0000 7f3d62a9cb80 20 client.15777 populate_metadata read hostname 'smithi163' 2023-07-14T18:13:26.903 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.850+0000 7f3d62a9cb80 1 --2- 172.21.15.163:0/4051906690 >> [v2:172.21.15.172:6836/3783835012,v1:172.21.15.172:6837/3783835012] conn(0x557c002411d0 0x557c002435e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:13:26.903 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.850+0000 7f3d62a9cb80 4 client.15777 mds_command: new command op to 24479 tid=0[{"prefix": "damage ls"}] 2023-07-14T18:13:26.903 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.850+0000 7f3d62a9cb80 1 -- 172.21.15.163:0/4051906690 --> [v2:172.21.15.172:6836/3783835012,v1:172.21.15.172:6837/3783835012] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x557c0011ceb0 con 0x557c002411d0 2023-07-14T18:13:26.903 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.850+0000 7f3d47fff700 1 --2- 172.21.15.163:0/4051906690 >> [v2:172.21.15.172:6836/3783835012,v1:172.21.15.172:6837/3783835012] conn(0x557c002411d0 0x557c002435e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:13:26.903 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.851+0000 7f3d2f7fe700 10 client.15777 ms_handle_connect on v2:172.21.15.172:6836/3783835012 2023-07-14T18:13:26.904 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.851+0000 7f3d47fff700 1 --2- 172.21.15.163:0/4051906690 >> [v2:172.21.15.172:6836/3783835012,v1:172.21.15.172:6837/3783835012] conn(0x557c002411d0 0x557c002435e0 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=f5c69deaae3cb52c server_cookie=6d02db45f909ec4c in_seq=0 out_seq=0 2023-07-14T18:13:26.904 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.851+0000 7f3d2f7fe700 1 -- 172.21.15.163:0/4051906690 <== mds.2 v2:172.21.15.172:6836/3783835012 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x557c0011ceb0 con 0x557c002411d0 2023-07-14T18:13:26.904 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.851+0000 7f3d2f7fe700 10 client.15777 handle_command_reply: tid=0 2023-07-14T18:13:26.904 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.851+0000 7f3d62a9cb80 1 client.15777 shutdown 2023-07-14T18:13:26.904 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.851+0000 7f3d62a9cb80 1 -- 172.21.15.163:0/4051906690 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x557c001d2f60 msgr2=0x557c001e5f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:13:26.905 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.851+0000 7f3d62a9cb80 1 --2- 172.21.15.163:0/4051906690 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x557c001d2f60 0x557c001e5f30 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f3d38032040 tx=0x7f3d3800b6c0 comp rx=0 tx=0).stop 2023-07-14T18:13:26.905 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.851+0000 7f3d62a9cb80 1 -- 172.21.15.163:0/4051906690 shutdown_connections 2023-07-14T18:13:26.905 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.851+0000 7f3d62a9cb80 1 --2- 172.21.15.163:0/4051906690 >> [v2:172.21.15.172:6836/3783835012,v1:172.21.15.172:6837/3783835012] conn(0x557c002411d0 0x557c002435e0 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:13:26.905 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.851+0000 7f3d62a9cb80 1 --2- 172.21.15.163:0/4051906690 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x557c001d44b0 0x557c001e7480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:13:26.905 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.851+0000 7f3d62a9cb80 1 --2- 172.21.15.163:0/4051906690 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x557c001d2f60 0x557c001e5f30 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:13:26.906 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.851+0000 7f3d62a9cb80 1 --2- 172.21.15.163:0/4051906690 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557c001d38b0 0x557c001e6470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:13:26.906 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.851+0000 7f3d62a9cb80 1 -- 172.21.15.163:0/4051906690 >> 172.21.15.163:0/4051906690 conn(0x557c001c8680 msgr2=0x557c001e8b40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:13:26.906 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.851+0000 7f3d2f7fe700 0 client.15777 ms_handle_reset on v2:172.21.15.172:6836/3783835012 2023-07-14T18:13:26.906 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.851+0000 7f3d62a9cb80 1 -- 172.21.15.163:0/4051906690 shutdown_connections 2023-07-14T18:13:26.906 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.851+0000 7f3d62a9cb80 1 -- 172.21.15.163:0/4051906690 wait complete. 2023-07-14T18:13:26.906 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.851+0000 7f3d62a9cb80 20 client.15777 trim_cache size 0 max 16384 2023-07-14T18:13:26.907 INFO:teuthology.orchestra.run.smithi163.stdout:[] 2023-07-14T18:13:26.908 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.852+0000 7f3d56904700 1 -- 172.21.15.163:0/141870003 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f3d3c0a1150 msgr2=0x7f3d3c0a3600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:13:26.908 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.852+0000 7f3d56904700 1 --2- 172.21.15.163:0/141870003 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f3d3c0a1150 0x7f3d3c0a3600 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f3d3800b5c0 tx=0x7f3d3800b770 comp rx=0 tx=0).stop 2023-07-14T18:13:26.908 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.852+0000 7f3d56904700 1 -- 172.21.15.163:0/141870003 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3d500ffe00 msgr2=0x7f3d5019cc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:13:26.908 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.852+0000 7f3d56904700 1 --2- 172.21.15.163:0/141870003 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3d500ffe00 0x7f3d5019cc00 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f3d48007ee0 tx=0x7f3d4800d3b0 comp rx=0 tx=0).stop 2023-07-14T18:13:26.909 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.852+0000 7f3d56904700 1 -- 172.21.15.163:0/141870003 shutdown_connections 2023-07-14T18:13:26.909 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.852+0000 7f3d56904700 1 --2- 172.21.15.163:0/141870003 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f3d3c0a1150 0x7f3d3c0a3600 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:13:26.909 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.852+0000 7f3d56904700 1 --2- 172.21.15.163:0/141870003 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3d500fe280 0x7f3d50107b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:13:26.909 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.852+0000 7f3d56904700 1 --2- 172.21.15.163:0/141870003 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3d500ffe00 0x7f3d5019cc00 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:13:26.909 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.852+0000 7f3d56904700 1 --2- 172.21.15.163:0/141870003 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f3d500ff470 0x7f3d5019a5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:13:26.909 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.852+0000 7f3d56904700 1 -- 172.21.15.163:0/141870003 >> 172.21.15.163:0/141870003 conn(0x7f3d500f98a0 msgr2=0x7f3d500fbbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:13:26.909 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.852+0000 7f3d56904700 1 -- 172.21.15.163:0/141870003 shutdown_connections 2023-07-14T18:13:26.910 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:26.852+0000 7f3d56904700 1 -- 172.21.15.163:0/141870003 wait complete. 2023-07-14T18:13:26.910 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:1 damage ls 2023-07-14T18:13:27.072 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:27.030+0000 7f3f9a9ad700 1 -- 172.21.15.163:0/1454913120 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f3f940fe280 msgr2=0x7f3f940fe690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:13:27.072 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:27.030+0000 7f3f9a9ad700 1 --2- 172.21.15.163:0/1454913120 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f3f940fe280 0x7f3f940fe690 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f3f84009990 tx=0x7f3f84009ca0 comp rx=0 tx=0).stop 2023-07-14T18:13:27.073 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:27.030+0000 7f3f9a9ad700 1 -- 172.21.15.163:0/1454913120 shutdown_connections 2023-07-14T18:13:27.073 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:27.030+0000 7f3f9a9ad700 1 --2- 172.21.15.163:0/1454913120 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3f940ffe00 0x7f3f941066c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:13:27.073 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:27.030+0000 7f3f9a9ad700 1 --2- 172.21.15.163:0/1454913120 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f3f940fe280 0x7f3f940fe690 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:13:27.073 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:27.030+0000 7f3f9a9ad700 1 --2- 172.21.15.163:0/1454913120 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3f940ff470 0x7f3f940ff8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:13:27.073 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:27.030+0000 7f3f9a9ad700 1 -- 172.21.15.163:0/1454913120 >> 172.21.15.163:0/1454913120 conn(0x7f3f940f98a0 msgr2=0x7f3f940fbcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:13:27.073 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:27.030+0000 7f3f9a9ad700 1 -- 172.21.15.163:0/1454913120 shutdown_connections 2023-07-14T18:13:27.074 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:27.031+0000 7f3f9a9ad700 1 -- 172.21.15.163:0/1454913120 wait complete. 2023-07-14T18:13:27.075 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:27.031+0000 7f3f9a9ad700 1 Processor -- start 2023-07-14T18:13:27.075 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:27.031+0000 7f3f9a9ad700 1 -- start start 2023-07-14T18:13:27.075 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:27.032+0000 7f3f9a9ad700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3f940fe280 0x7f3f94197af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:13:27.076 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:27.032+0000 7f3f9a9ad700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3f940ff470 0x7f3f94198030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:13:27.076 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:27.032+0000 7f3f9a9ad700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f3f940ffe00 0x7f3f9419f0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:13:27.076 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:27.032+0000 7f3f9a9ad700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f9419f670 con 0x7f3f940ffe00 2023-07-14T18:13:27.076 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:27.032+0000 7f3f9a9ad700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f9419f7b0 con 0x7f3f940fe280 2023-07-14T18:13:27.076 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:27.032+0000 7f3f9a9ad700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f9419f940 con 0x7f3f940ff470 2023-07-14T18:13:27.076 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:27.032+0000 7f3f98f4a700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f3f940ffe00 0x7f3f9419f0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:13:27.076 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:27.032+0000 7f3f98f4a700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f3f940ffe00 0x7f3f9419f0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:58282/0 (socket says 172.21.15.163:58282) 2023-07-14T18:13:27.077 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:27.032+0000 7f3f98f4a700 1 -- 172.21.15.163:0/2250081237 learned_addr learned my addr 172.21.15.163:0/2250081237 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:13:27.077 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:27.032+0000 7f3f93fff700 1 --2- 172.21.15.163:0/2250081237 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3f940fe280 0x7f3f94197af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:13:27.077 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:27.032+0000 7f3f98f4a700 1 -- 172.21.15.163:0/2250081237 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3f940ff470 msgr2=0x7f3f94198030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:13:27.077 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:27.032+0000 7f3f98f4a700 1 --2- 172.21.15.163:0/2250081237 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3f940ff470 0x7f3f94198030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:13:27.077 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:27.032+0000 7f3f98f4a700 1 -- 172.21.15.163:0/2250081237 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3f940fe280 msgr2=0x7f3f94197af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:13:27.077 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:27.032+0000 7f3f98f4a700 1 --2- 172.21.15.163:0/2250081237 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3f940fe280 0x7f3f94197af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:13:27.078 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:27.032+0000 7f3f98f4a700 1 -- 172.21.15.163:0/2250081237 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f840095f0 con 0x7f3f940ffe00 2023-07-14T18:13:27.078 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:27.032+0000 7f3f98f4a700 1 --2- 172.21.15.163:0/2250081237 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f3f940ffe00 0x7f3f9419f0a0 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f3f8c007ee0 tx=0x7f3f8c00d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:13:27.078 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:27.033+0000 7f3f917fa700 1 -- 172.21.15.163:0/2250081237 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f8c017070 con 0x7f3f940ffe00 2023-07-14T18:13:27.078 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:27.033+0000 7f3f9a9ad700 1 -- 172.21.15.163:0/2250081237 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3f9419fc20 con 0x7f3f940ffe00 2023-07-14T18:13:27.078 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:27.033+0000 7f3f917fa700 1 -- 172.21.15.163:0/2250081237 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f3f8c00f040 con 0x7f3f940ffe00 2023-07-14T18:13:27.078 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:27.033+0000 7f3f917fa700 1 -- 172.21.15.163:0/2250081237 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f8c005710 con 0x7f3f940ffe00 2023-07-14T18:13:27.078 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:27.033+0000 7f3f9a9ad700 1 -- 172.21.15.163:0/2250081237 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f941a0180 con 0x7f3f940ffe00 2023-07-14T18:13:27.080 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:27.035+0000 7f3f917fa700 1 -- 172.21.15.163:0/2250081237 <== mon.0 v2:172.21.15.163:3300/0 4 ==== mgrmap(e 18) v1 ==== 135716+0+0 (secure 0 0 0) 0x7f3f8c005870 con 0x7f3f940ffe00 2023-07-14T18:13:27.080 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:27.036+0000 7f3f917fa700 1 --2- 172.21.15.163:0/2250081237 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f3f7c0a1150 0x7f3f7c0a3600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:13:27.081 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:27.036+0000 7f3f93fff700 1 --2- 172.21.15.163:0/2250081237 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f3f7c0a1150 0x7f3f7c0a3600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:13:27.081 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:27.036+0000 7f3f917fa700 1 -- 172.21.15.163:0/2250081237 <== mon.0 v2:172.21.15.163:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 9049+0+0 (secure 0 0 0) 0x7f3f8c0cc450 con 0x7f3f940ffe00 2023-07-14T18:13:27.081 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:27.036+0000 7f3f93fff700 1 --2- 172.21.15.163:0/2250081237 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f3f7c0a1150 0x7f3f7c0a3600 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f3f8400c010 tx=0x7f3f84005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:13:27.081 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:27.037+0000 7f3fa6b45b80 1 Processor -- start 2023-07-14T18:13:27.081 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:27.037+0000 7f3fa6b45b80 1 -- start start 2023-07-14T18:13:27.081 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:27.038+0000 7f3fa6b45b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564f3f4cdf60 0x564f3f4ce370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:13:27.082 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:27.038+0000 7f3fa6b45b80 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x564f3f4ce8b0 0x564f3f4ceed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:13:27.082 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:27.038+0000 7f3fa6b45b80 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x564f3f4cf4b0 0x564f3f4cf920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:13:27.082 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:27.038+0000 7f3fa6b45b80 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x564f3f3d2cb0 con 0x564f3f4cf4b0 2023-07-14T18:13:27.082 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:27.038+0000 7f3fa6b45b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x564f3f425a40 con 0x564f3f4cdf60 2023-07-14T18:13:27.082 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:27.038+0000 7f3fa6b45b80 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x564f3f41eed0 con 0x564f3f4ce8b0 2023-07-14T18:13:27.082 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:27.038+0000 7f3f93fff700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564f3f4cdf60 0x564f3f4ce370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:13:27.082 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:27.038+0000 7f3f93fff700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564f3f4cdf60 0x564f3f4ce370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.163:58972/0 (socket says 172.21.15.163:58972) 2023-07-14T18:13:27.083 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:27.038+0000 7f3f93fff700 1 -- 172.21.15.163:0/843766222 learned_addr learned my addr 172.21.15.163:0/843766222 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:13:27.083 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:27.038+0000 7f3f98f4a700 1 --2- 172.21.15.163:0/843766222 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x564f3f4cf4b0 0x564f3f4cf920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:13:27.083 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:27.038+0000 7f3f937fe700 1 --2- 172.21.15.163:0/843766222 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x564f3f4ce8b0 0x564f3f4ceed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:13:27.083 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:27.038+0000 7f3f93fff700 1 -- 172.21.15.163:0/843766222 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x564f3f4ce8b0 msgr2=0x564f3f4ceed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:13:27.083 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:27.038+0000 7f3f93fff700 1 --2- 172.21.15.163:0/843766222 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x564f3f4ce8b0 0x564f3f4ceed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:13:27.083 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:27.038+0000 7f3f93fff700 1 -- 172.21.15.163:0/843766222 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x564f3f4cf4b0 msgr2=0x564f3f4cf920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:13:27.083 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:27.038+0000 7f3f93fff700 1 --2- 172.21.15.163:0/843766222 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x564f3f4cf4b0 0x564f3f4cf920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:13:27.083 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:27.038+0000 7f3f93fff700 1 -- 172.21.15.163:0/843766222 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564f3f24cde0 con 0x564f3f4cdf60 2023-07-14T18:13:27.084 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:27.038+0000 7f3f937fe700 1 --2- 172.21.15.163:0/843766222 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x564f3f4ce8b0 0x564f3f4ceed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T18:13:27.084 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:27.038+0000 7f3f93fff700 1 --2- 172.21.15.163:0/843766222 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564f3f4cdf60 0x564f3f4ce370 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f3f940ff2d0 tx=0x7f3f84020000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5e966b62506fd998 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:13:27.084 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:27.039+0000 7f3f7a7fc700 1 -- 172.21.15.163:0/843766222 <== mon.2 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f8402b070 con 0x564f3f4cdf60 2023-07-14T18:13:27.084 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:27.039+0000 7f3f7a7fc700 1 -- 172.21.15.163:0/843766222 <== mon.2 v2:172.21.15.172:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f3f8401e040 con 0x564f3f4cdf60 2023-07-14T18:13:27.084 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:27.039+0000 7f3f7a7fc700 1 -- 172.21.15.163:0/843766222 <== mon.2 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f84004e20 con 0x564f3f4cdf60 2023-07-14T18:13:27.087 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:27.040+0000 7f3fa6b45b80 1 -- 172.21.15.163:0/843766222 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564f3f4cdf60 msgr2=0x564f3f4ce370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:13:27.087 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:27.040+0000 7f3fa6b45b80 1 --2- 172.21.15.163:0/843766222 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564f3f4cdf60 0x564f3f4ce370 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f3f940ff2d0 tx=0x7f3f84020000 comp rx=0 tx=0).stop 2023-07-14T18:13:27.088 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:27.040+0000 7f3fa6b45b80 1 -- 172.21.15.163:0/843766222 shutdown_connections 2023-07-14T18:13:27.088 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:27.040+0000 7f3fa6b45b80 1 --2- 172.21.15.163:0/843766222 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x564f3f4cf4b0 0x564f3f4cf920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:13:27.088 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:27.040+0000 7f3fa6b45b80 1 --2- 172.21.15.163:0/843766222 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564f3f4cdf60 0x564f3f4ce370 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:13:27.088 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:27.040+0000 7f3fa6b45b80 1 --2- 172.21.15.163:0/843766222 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x564f3f4ce8b0 0x564f3f4ceed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:13:27.088 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:27.040+0000 7f3fa6b45b80 1 -- 172.21.15.163:0/843766222 >> 172.21.15.163:0/843766222 conn(0x564f3f4c3680 msgr2=0x564f3f4c89d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:13:27.088 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:27.040+0000 7f3fa6b45b80 1 -- 172.21.15.163:0/843766222 shutdown_connections 2023-07-14T18:13:27.088 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:27.040+0000 7f3fa6b45b80 1 -- 172.21.15.163:0/843766222 wait complete. 2023-07-14T18:13:27.088 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:27.040+0000 7f3fa6b45b80 1 -- start start 2023-07-14T18:13:27.089 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:27.040+0000 7f3fa6b45b80 1 Processor -- start 2023-07-14T18:13:27.089 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:27.041+0000 7f3fa6b45b80 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x564f3f4cdf60 0x564f3f4d78a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:13:27.089 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:27.041+0000 7f3fa6b45b80 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x564f3f4ce8b0 0x564f3f4d7de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:13:27.089 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:27.041+0000 7f3fa6b45b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564f3f4cf4b0 0x564f3f4dee20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:13:27.089 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:27.041+0000 7f3fa6b45b80 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x564f3f3beac0 con 0x564f3f4ce8b0 2023-07-14T18:13:27.089 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:27.041+0000 7f3fa6b45b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x564f3f3be7c0 con 0x564f3f4cf4b0 2023-07-14T18:13:27.089 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:27.041+0000 7f3fa6b45b80 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x564f3f2a2920 con 0x564f3f4cdf60 2023-07-14T18:13:27.090 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:27.041+0000 7f3fa6b45b80 10 client.0 _ll_register_callbacks cb 0x564f3f3bc760 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T18:13:27.090 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:27.041+0000 7f3f93fff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x564f3f4cdf60 0x564f3f4d78a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:13:27.090 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:27.041+0000 7f3f93fff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x564f3f4cdf60 0x564f3f4d78a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.163:40116/0 (socket says 172.21.15.163:40116) 2023-07-14T18:13:27.090 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:27.041+0000 7f3f93fff700 1 -- 172.21.15.163:0/3216853209 learned_addr learned my addr 172.21.15.163:0/3216853209 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:13:27.090 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:27.041+0000 7f3f98f4a700 1 --2- 172.21.15.163:0/3216853209 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564f3f4cf4b0 0x564f3f4dee20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:13:27.090 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:27.041+0000 7f3f93fff700 1 -- 172.21.15.163:0/3216853209 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564f3f4cf4b0 msgr2=0x564f3f4dee20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:13:27.090 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:27.041+0000 7f3f93fff700 1 --2- 172.21.15.163:0/3216853209 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564f3f4cf4b0 0x564f3f4dee20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:13:27.090 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:27.041+0000 7f3f93fff700 1 -- 172.21.15.163:0/3216853209 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x564f3f4ce8b0 msgr2=0x564f3f4d7de0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-07-14T18:13:27.091 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:27.041+0000 7f3f93fff700 1 --2- 172.21.15.163:0/3216853209 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x564f3f4ce8b0 0x564f3f4d7de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:13:27.091 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:27.041+0000 7f3f93fff700 1 -- 172.21.15.163:0/3216853209 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f94106ff0 con 0x564f3f4cdf60 2023-07-14T18:13:27.091 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:27.042+0000 7f3f93fff700 1 --2- 172.21.15.163:0/3216853209 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x564f3f4cdf60 0x564f3f4d78a0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f3f84005920 tx=0x7f3f840047b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6936eaf6841dc2ec server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:13:27.091 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:27.042+0000 7f3f737fe700 10 client.0 ms_handle_connect on v2:172.21.15.184:3300/0 2023-07-14T18:13:27.091 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:27.042+0000 7f3f737fe700 1 -- 172.21.15.163:0/3216853209 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f8402b040 con 0x564f3f4cdf60 2023-07-14T18:13:27.091 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:27.042+0000 7f3f737fe700 1 -- 172.21.15.163:0/3216853209 <== mon.1 v2:172.21.15.184:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 9049+0+0 (secure 0 0 0) 0x7f3f840038c0 con 0x564f3f4cdf60 2023-07-14T18:13:27.091 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:27.042+0000 7f3fa6b45b80 1 -- 172.21.15.163:0/3216853209 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x564f3f3784f0 con 0x564f3f4cdf60 2023-07-14T18:13:27.091 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:27.042+0000 7f3f737fe700 1 -- 172.21.15.163:0/3216853209 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3f84003a80 con 0x564f3f4cdf60 2023-07-14T18:13:27.092 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:27.042+0000 7f3fa6b45b80 10 client.25378 fetch_fsmap learned FSMap version 29 2023-07-14T18:13:27.092 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:27.042+0000 7f3fa6b45b80 1 -- 172.21.15.163:0/3216853209 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) v3 -- 0x564f3f235c60 con 0x564f3f4cdf60 2023-07-14T18:13:27.092 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:27.042+0000 7f3f737fe700 1 -- 172.21.15.163:0/3216853209 <== mon.1 v2:172.21.15.184:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x564f3f3784f0 con 0x564f3f4cdf60 2023-07-14T18:13:27.092 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:27.043+0000 7f3f737fe700 1 -- 172.21.15.163:0/3216853209 <== mon.1 v2:172.21.15.184:3300/0 5 ==== fsmap(e 29) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f3f8400f960 con 0x564f3f4cdf60 2023-07-14T18:13:27.092 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:27.043+0000 7f3fa6b45b80 10 client.25378 fetch_fsmap finished waiting for FSMap version 29 2023-07-14T18:13:27.092 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:27.043+0000 7f3fa6b45b80 10 client.25378 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2023-07-14T18:13:27.092 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:27.043+0000 7f3fa6b45b80 20 client.25378 populate_metadata read hostname 'smithi163' 2023-07-14T18:13:27.093 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:27.043+0000 7f3fa6b45b80 1 --2- 172.21.15.163:0/3216853209 >> [v2:172.21.15.184:6838/2819059257,v1:172.21.15.184:6839/2819059257] conn(0x564f3f4e3170 0x564f3f4e5550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:13:27.093 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:27.043+0000 7f3fa6b45b80 4 client.25378 mds_command: new command op to 24493 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-14T18:13:27.093 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:27.043+0000 7f3fa6b45b80 1 -- 172.21.15.163:0/3216853209 --> [v2:172.21.15.184:6838/2819059257,v1:172.21.15.184:6839/2819059257] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x564f3f49cda0 con 0x564f3f4e3170 2023-07-14T18:13:27.093 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:27.043+0000 7f3f937fe700 1 --2- 172.21.15.163:0/3216853209 >> [v2:172.21.15.184:6838/2819059257,v1:172.21.15.184:6839/2819059257] conn(0x564f3f4e3170 0x564f3f4e5550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:13:27.093 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:27.043+0000 7f3f937fe700 1 --2- 172.21.15.163:0/3216853209 >> [v2:172.21.15.184:6838/2819059257,v1:172.21.15.184:6839/2819059257] conn(0x564f3f4e3170 0x564f3f4e5550 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=db21508963db1582 server_cookie=fb2e97897307816 in_seq=0 out_seq=0 2023-07-14T18:13:27.093 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:27.043+0000 7f3f737fe700 10 client.25378 ms_handle_connect on v2:172.21.15.184:6838/2819059257 2023-07-14T18:13:27.093 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:27.044+0000 7f3f737fe700 1 -- 172.21.15.163:0/3216853209 <== mds.1 v2:172.21.15.184:6838/2819059257 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18017 (crc 0 0 0) 0x564f3f49cda0 con 0x564f3f4e3170 2023-07-14T18:13:27.093 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:27.044+0000 7f3f737fe700 10 client.25378 handle_command_reply: tid=0 2023-07-14T18:13:27.094 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:27.044+0000 7f3fa6b45b80 1 client.25378 shutdown 2023-07-14T18:13:27.094 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:27.044+0000 7f3fa6b45b80 1 -- 172.21.15.163:0/3216853209 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x564f3f4cdf60 msgr2=0x564f3f4d78a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:13:27.094 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:27.044+0000 7f3fa6b45b80 1 --2- 172.21.15.163:0/3216853209 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x564f3f4cdf60 0x564f3f4d78a0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f3f84005920 tx=0x7f3f840047b0 comp rx=0 tx=0).stop 2023-07-14T18:13:27.094 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:27.044+0000 7f3fa6b45b80 1 -- 172.21.15.163:0/3216853209 shutdown_connections 2023-07-14T18:13:27.094 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:27.044+0000 7f3fa6b45b80 1 --2- 172.21.15.163:0/3216853209 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x564f3f4cdf60 0x564f3f4d78a0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:13:27.094 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:27.044+0000 7f3fa6b45b80 1 --2- 172.21.15.163:0/3216853209 >> [v2:172.21.15.184:6838/2819059257,v1:172.21.15.184:6839/2819059257] conn(0x564f3f4e3170 0x564f3f4e5550 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:13:27.094 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:27.044+0000 7f3fa6b45b80 1 --2- 172.21.15.163:0/3216853209 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564f3f4cf4b0 0x564f3f4dee20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:13:27.095 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:27.044+0000 7f3f737fe700 0 client.25378 ms_handle_reset on v2:172.21.15.184:6838/2819059257 2023-07-14T18:13:27.095 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:27.044+0000 7f3fa6b45b80 1 --2- 172.21.15.163:0/3216853209 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x564f3f4ce8b0 0x564f3f4d7de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:13:27.095 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:27.044+0000 7f3fa6b45b80 1 -- 172.21.15.163:0/3216853209 >> 172.21.15.163:0/3216853209 conn(0x564f3f4c3680 msgr2=0x564f3f4c7650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:13:27.095 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:27.044+0000 7f3fa6b45b80 1 -- 172.21.15.163:0/3216853209 shutdown_connections 2023-07-14T18:13:27.095 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:27.044+0000 7f3fa6b45b80 1 -- 172.21.15.163:0/3216853209 wait complete. 2023-07-14T18:13:27.095 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:27.045+0000 7f3fa6b45b80 20 client.25378 trim_cache size 0 max 16384 2023-07-14T18:13:27.099 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:27.057+0000 7f3fa6b45b80 1 Processor -- start 2023-07-14T18:13:27.099 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:27.057+0000 7f3fa6b45b80 1 -- start start 2023-07-14T18:13:27.099 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:27.057+0000 7f3fa6b45b80 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x564f3f4cdf60 0x564f3f4d6f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:13:27.099 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:27.057+0000 7f3fa6b45b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564f3f4ce8b0 0x564f3f4dede0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:13:27.099 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:27.057+0000 7f3fa6b45b80 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x564f3f4cf4b0 0x564f3f4df710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:13:27.099 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:27.057+0000 7f3fa6b45b80 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x564f3f4cf330 con 0x564f3f4cf4b0 2023-07-14T18:13:27.100 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:27.057+0000 7f3fa6b45b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x564f3f4d6d50 con 0x564f3f4ce8b0 2023-07-14T18:13:27.100 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:27.057+0000 7f3fa6b45b80 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x564f3f4ca500 con 0x564f3f4cdf60 2023-07-14T18:13:27.100 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:27.058+0000 7f3f98f4a700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x564f3f4cf4b0 0x564f3f4df710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:13:27.100 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:27.058+0000 7f3f98f4a700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x564f3f4cf4b0 0x564f3f4df710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:58304/0 (socket says 172.21.15.163:58304) 2023-07-14T18:13:27.100 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:27.058+0000 7f3f98f4a700 1 -- 172.21.15.163:0/228689254 learned_addr learned my addr 172.21.15.163:0/228689254 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:13:27.100 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:27.058+0000 7f3f93fff700 1 --2- 172.21.15.163:0/228689254 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x564f3f4cdf60 0x564f3f4d6f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:13:27.104 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:27.058+0000 7f3f937fe700 1 --2- 172.21.15.163:0/228689254 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564f3f4ce8b0 0x564f3f4dede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:13:27.104 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:27.058+0000 7f3f98f4a700 1 -- 172.21.15.163:0/228689254 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x564f3f4cdf60 msgr2=0x564f3f4d6f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:13:27.104 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:27.058+0000 7f3f98f4a700 1 --2- 172.21.15.163:0/228689254 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x564f3f4cdf60 0x564f3f4d6f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:13:27.104 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:27.058+0000 7f3f98f4a700 1 -- 172.21.15.163:0/228689254 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564f3f4ce8b0 msgr2=0x564f3f4dede0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:13:27.105 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:27.058+0000 7f3f98f4a700 1 --2- 172.21.15.163:0/228689254 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564f3f4ce8b0 0x564f3f4dede0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:13:27.105 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:27.058+0000 7f3f98f4a700 1 -- 172.21.15.163:0/228689254 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564f3f273250 con 0x564f3f4cf4b0 2023-07-14T18:13:27.105 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:27.058+0000 7f3f98f4a700 1 --2- 172.21.15.163:0/228689254 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x564f3f4cf4b0 0x564f3f4df710 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f3f8c095a30 tx=0x7f3f8c084040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e0c70384505748db server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:13:27.105 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:27.058+0000 7f3f7affd700 1 -- 172.21.15.163:0/228689254 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f8c099530 con 0x564f3f4cf4b0 2023-07-14T18:13:27.105 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:27.058+0000 7f3f7affd700 1 -- 172.21.15.163:0/228689254 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f3f8c095040 con 0x564f3f4cf4b0 2023-07-14T18:13:27.105 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:27.058+0000 7f3f7affd700 1 -- 172.21.15.163:0/228689254 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f8c0840b0 con 0x564f3f4cf4b0 2023-07-14T18:13:27.105 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:27.059+0000 7f3fa6b45b80 1 -- 172.21.15.163:0/228689254 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x564f3f4cf4b0 msgr2=0x564f3f4df710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:13:27.105 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:27.059+0000 7f3fa6b45b80 1 --2- 172.21.15.163:0/228689254 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x564f3f4cf4b0 0x564f3f4df710 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f3f8c095a30 tx=0x7f3f8c084040 comp rx=0 tx=0).stop 2023-07-14T18:13:27.106 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:27.059+0000 7f3fa6b45b80 1 -- 172.21.15.163:0/228689254 shutdown_connections 2023-07-14T18:13:27.106 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:27.059+0000 7f3fa6b45b80 1 --2- 172.21.15.163:0/228689254 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x564f3f4cdf60 0x564f3f4d6f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:13:27.106 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:27.059+0000 7f3fa6b45b80 1 --2- 172.21.15.163:0/228689254 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x564f3f4cf4b0 0x564f3f4df710 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:13:27.106 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:27.059+0000 7f3fa6b45b80 1 --2- 172.21.15.163:0/228689254 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564f3f4ce8b0 0x564f3f4dede0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:13:27.106 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:27.059+0000 7f3fa6b45b80 1 -- 172.21.15.163:0/228689254 >> 172.21.15.163:0/228689254 conn(0x564f3f4c3680 msgr2=0x564f3f4d65e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:13:27.106 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:27.059+0000 7f3fa6b45b80 1 -- 172.21.15.163:0/228689254 shutdown_connections 2023-07-14T18:13:27.106 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:27.059+0000 7f3fa6b45b80 1 -- 172.21.15.163:0/228689254 wait complete. 2023-07-14T18:13:27.107 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:27.059+0000 7f3fa6b45b80 1 -- start start 2023-07-14T18:13:27.107 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:27.060+0000 7f3fa6b45b80 1 Processor -- start 2023-07-14T18:13:27.107 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:27.060+0000 7f3fa6b45b80 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x564f3f4cdf60 0x564f3f4de6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:13:27.107 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:27.060+0000 7f3fa6b45b80 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x564f3f4ce8b0 0x564f3f4dec20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:13:27.107 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:27.060+0000 7f3fa6b45b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564f3f4cf4b0 0x564f3f4db180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:13:27.107 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:27.060+0000 7f3fa6b45b80 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x564f3f4db860 con 0x564f3f4cdf60 2023-07-14T18:13:27.107 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:27.060+0000 7f3fa6b45b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x564f3f4db9d0 con 0x564f3f4cf4b0 2023-07-14T18:13:27.107 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:27.060+0000 7f3fa6b45b80 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x564f3f4dbb90 con 0x564f3f4ce8b0 2023-07-14T18:13:27.108 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:27.060+0000 7f3fa6b45b80 10 client.0 _ll_register_callbacks cb 0x7f3f8c0951b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T18:13:27.108 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:27.060+0000 7f3f93fff700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x564f3f4cdf60 0x564f3f4de6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:13:27.108 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:27.060+0000 7f3f93fff700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x564f3f4cdf60 0x564f3f4de6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:58308/0 (socket says 172.21.15.163:58308) 2023-07-14T18:13:27.108 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:27.060+0000 7f3f93fff700 1 -- 172.21.15.163:0/1922338396 learned_addr learned my addr 172.21.15.163:0/1922338396 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:13:27.108 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:27.060+0000 7f3f937fe700 1 --2- 172.21.15.163:0/1922338396 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x564f3f4ce8b0 0x564f3f4dec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:13:27.108 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:27.060+0000 7f3f98f4a700 1 --2- 172.21.15.163:0/1922338396 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564f3f4cf4b0 0x564f3f4db180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:13:27.108 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:27.060+0000 7f3f93fff700 1 -- 172.21.15.163:0/1922338396 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x564f3f4ce8b0 msgr2=0x564f3f4dec20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:13:27.109 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:27.060+0000 7f3f93fff700 1 --2- 172.21.15.163:0/1922338396 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x564f3f4ce8b0 0x564f3f4dec20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:13:27.109 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:27.060+0000 7f3f93fff700 1 -- 172.21.15.163:0/1922338396 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564f3f4cf4b0 msgr2=0x564f3f4db180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:13:27.109 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:27.060+0000 7f3f93fff700 1 --2- 172.21.15.163:0/1922338396 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564f3f4cf4b0 0x564f3f4db180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:13:27.109 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:27.060+0000 7f3f93fff700 1 -- 172.21.15.163:0/1922338396 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f941a0180 con 0x564f3f4cdf60 2023-07-14T18:13:27.109 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:27.061+0000 7f3f93fff700 1 --2- 172.21.15.163:0/1922338396 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x564f3f4cdf60 0x564f3f4de6e0 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f3f8400fcc0 tx=0x7f3f84009530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d657011f7abcddf4 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:13:27.109 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:27.061+0000 7f3f737fe700 10 client.0 ms_handle_connect on v2:172.21.15.163:3300/0 2023-07-14T18:13:27.109 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:27.061+0000 7f3f737fe700 1 -- 172.21.15.163:0/1922338396 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f8402b040 con 0x564f3f4cdf60 2023-07-14T18:13:27.109 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:27.061+0000 7f3f737fe700 1 -- 172.21.15.163:0/1922338396 <== mon.0 v2:172.21.15.163:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 9049+0+0 (secure 0 0 0) 0x7f3f8400f660 con 0x564f3f4cdf60 2023-07-14T18:13:27.110 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:27.061+0000 7f3fa6b45b80 1 -- 172.21.15.163:0/1922338396 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f3f8401e040 con 0x564f3f4cdf60 2023-07-14T18:13:27.110 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:27.061+0000 7f3f737fe700 1 -- 172.21.15.163:0/1922338396 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3f8400f820 con 0x564f3f4cdf60 2023-07-14T18:13:27.110 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:27.061+0000 7f3fa6b45b80 10 client.15792 fetch_fsmap learned FSMap version 29 2023-07-14T18:13:27.110 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:27.061+0000 7f3fa6b45b80 1 -- 172.21.15.163:0/1922338396 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) v3 -- 0x564f3f24b2b0 con 0x564f3f4cdf60 2023-07-14T18:13:27.110 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:27.061+0000 7f3f737fe700 1 -- 172.21.15.163:0/1922338396 <== mon.0 v2:172.21.15.163:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f3f8401e040 con 0x564f3f4cdf60 2023-07-14T18:13:27.110 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:27.061+0000 7f3f737fe700 1 -- 172.21.15.163:0/1922338396 <== mon.0 v2:172.21.15.163:3300/0 5 ==== fsmap(e 29) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f3f84005040 con 0x564f3f4cdf60 2023-07-14T18:13:27.110 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:27.061+0000 7f3fa6b45b80 10 client.15792 fetch_fsmap finished waiting for FSMap version 29 2023-07-14T18:13:27.111 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:27.061+0000 7f3fa6b45b80 10 client.15792 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2023-07-14T18:13:27.111 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:27.061+0000 7f3fa6b45b80 20 client.15792 populate_metadata read hostname 'smithi163' 2023-07-14T18:13:27.111 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:27.061+0000 7f3fa6b45b80 1 --2- 172.21.15.163:0/1922338396 >> [v2:172.21.15.184:6838/2819059257,v1:172.21.15.184:6839/2819059257] conn(0x564f3f537f90 0x564f3f53a3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:13:27.111 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:27.062+0000 7f3fa6b45b80 4 client.15792 mds_command: new command op to 24493 tid=0[{"prefix": "damage ls"}] 2023-07-14T18:13:27.111 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:27.062+0000 7f3fa6b45b80 1 -- 172.21.15.163:0/1922338396 --> [v2:172.21.15.184:6838/2819059257,v1:172.21.15.184:6839/2819059257] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x564f3f417eb0 con 0x564f3f537f90 2023-07-14T18:13:27.111 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:27.062+0000 7f3f937fe700 1 --2- 172.21.15.163:0/1922338396 >> [v2:172.21.15.184:6838/2819059257,v1:172.21.15.184:6839/2819059257] conn(0x564f3f537f90 0x564f3f53a3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:13:27.111 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:27.062+0000 7f3f737fe700 10 client.15792 ms_handle_connect on v2:172.21.15.184:6838/2819059257 2023-07-14T18:13:27.111 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:27.062+0000 7f3f937fe700 1 --2- 172.21.15.163:0/1922338396 >> [v2:172.21.15.184:6838/2819059257,v1:172.21.15.184:6839/2819059257] conn(0x564f3f537f90 0x564f3f53a3a0 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=a2a0730f1d44a357 server_cookie=54e0e9a62094d9a5 in_seq=0 out_seq=0 2023-07-14T18:13:27.112 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:27.062+0000 7f3f737fe700 1 -- 172.21.15.163:0/1922338396 <== mds.1 v2:172.21.15.184:6838/2819059257 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x564f3f417eb0 con 0x564f3f537f90 2023-07-14T18:13:27.112 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:27.062+0000 7f3f737fe700 10 client.15792 handle_command_reply: tid=0 2023-07-14T18:13:27.112 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:27.062+0000 7f3fa6b45b80 1 client.15792 shutdown 2023-07-14T18:13:27.112 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:27.063+0000 7f3fa6b45b80 1 -- 172.21.15.163:0/1922338396 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x564f3f4cdf60 msgr2=0x564f3f4de6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:13:27.112 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:27.063+0000 7f3fa6b45b80 1 --2- 172.21.15.163:0/1922338396 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x564f3f4cdf60 0x564f3f4de6e0 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f3f8400fcc0 tx=0x7f3f84009530 comp rx=0 tx=0).stop 2023-07-14T18:13:27.112 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:27.063+0000 7f3fa6b45b80 1 -- 172.21.15.163:0/1922338396 shutdown_connections 2023-07-14T18:13:27.112 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:27.063+0000 7f3fa6b45b80 1 --2- 172.21.15.163:0/1922338396 >> [v2:172.21.15.184:6838/2819059257,v1:172.21.15.184:6839/2819059257] conn(0x564f3f537f90 0x564f3f53a3a0 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:13:27.113 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:27.063+0000 7f3fa6b45b80 1 --2- 172.21.15.163:0/1922338396 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564f3f4cf4b0 0x564f3f4db180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:13:27.113 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:27.063+0000 7f3fa6b45b80 1 --2- 172.21.15.163:0/1922338396 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x564f3f4cdf60 0x564f3f4de6e0 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:13:27.113 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:27.063+0000 7f3fa6b45b80 1 --2- 172.21.15.163:0/1922338396 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x564f3f4ce8b0 0x564f3f4dec20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:13:27.113 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:27.063+0000 7f3fa6b45b80 1 -- 172.21.15.163:0/1922338396 >> 172.21.15.163:0/1922338396 conn(0x564f3f4c3680 msgr2=0x564f3f4df710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:13:27.113 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:27.063+0000 7f3f737fe700 0 client.15792 ms_handle_reset on v2:172.21.15.184:6838/2819059257 2023-07-14T18:13:27.113 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:27.063+0000 7f3fa6b45b80 1 -- 172.21.15.163:0/1922338396 shutdown_connections 2023-07-14T18:13:27.113 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:27.063+0000 7f3fa6b45b80 1 -- 172.21.15.163:0/1922338396 wait complete. 2023-07-14T18:13:27.113 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:27.063+0000 7f3fa6b45b80 20 client.15792 trim_cache size 0 max 16384 2023-07-14T18:13:27.114 INFO:teuthology.orchestra.run.smithi163.stdout:[] 2023-07-14T18:13:27.115 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:27.063+0000 7f3f9a9ad700 1 -- 172.21.15.163:0/2250081237 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f3f7c0a1150 msgr2=0x7f3f7c0a3600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:13:27.115 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:27.063+0000 7f3f9a9ad700 1 --2- 172.21.15.163:0/2250081237 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f3f7c0a1150 0x7f3f7c0a3600 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f3f8400c010 tx=0x7f3f84005fb0 comp rx=0 tx=0).stop 2023-07-14T18:13:27.115 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:27.063+0000 7f3f9a9ad700 1 -- 172.21.15.163:0/2250081237 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f3f940ffe00 msgr2=0x7f3f9419f0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:13:27.115 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:27.063+0000 7f3f9a9ad700 1 --2- 172.21.15.163:0/2250081237 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f3f940ffe00 0x7f3f9419f0a0 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f3f8c007ee0 tx=0x7f3f8c00d3b0 comp rx=0 tx=0).stop 2023-07-14T18:13:27.116 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:27.064+0000 7f3f9a9ad700 1 -- 172.21.15.163:0/2250081237 shutdown_connections 2023-07-14T18:13:27.116 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:27.064+0000 7f3f9a9ad700 1 --2- 172.21.15.163:0/2250081237 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f3f7c0a1150 0x7f3f7c0a3600 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:13:27.116 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:27.064+0000 7f3f9a9ad700 1 --2- 172.21.15.163:0/2250081237 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f3f940ffe00 0x7f3f9419f0a0 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:13:27.116 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:27.064+0000 7f3f9a9ad700 1 --2- 172.21.15.163:0/2250081237 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3f940fe280 0x7f3f94197af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:13:27.116 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:27.064+0000 7f3f9a9ad700 1 --2- 172.21.15.163:0/2250081237 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3f940ff470 0x7f3f94198030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:13:27.116 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:27.064+0000 7f3f9a9ad700 1 -- 172.21.15.163:0/2250081237 >> 172.21.15.163:0/2250081237 conn(0x7f3f940f98a0 msgr2=0x7f3f9410ac70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:13:27.116 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:27.064+0000 7f3f9a9ad700 1 -- 172.21.15.163:0/2250081237 shutdown_connections 2023-07-14T18:13:27.116 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:27.064+0000 7f3f9a9ad700 1 -- 172.21.15.163:0/2250081237 wait complete. 2023-07-14T18:13:27.118 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:13:26 smithi163 ceph-mon[96576]: pgmap v323: 129 pgs: 129 active+clean; 660 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 11 op/s; 0 B/s, 0 objects/s recovering 2023-07-14T18:13:27.118 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:13:26 smithi163 ceph-mon[96576]: from='client.? 172.21.15.163:0/710121617' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-07-14T18:13:27.119 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 damage ls 2023-07-14T18:13:27.176 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:13:26 smithi184 ceph-mon[98481]: pgmap v323: 129 pgs: 129 active+clean; 660 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 11 op/s; 0 B/s, 0 objects/s recovering 2023-07-14T18:13:27.176 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:13:26 smithi184 ceph-mon[98481]: from='client.? 172.21.15.163:0/710121617' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-07-14T18:13:27.277 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:13:26 smithi172 ceph-mon[97983]: pgmap v323: 129 pgs: 129 active+clean; 660 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 11 op/s; 0 B/s, 0 objects/s recovering 2023-07-14T18:13:27.277 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:13:26 smithi172 ceph-mon[97983]: from='client.? 172.21.15.163:0/710121617' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-07-14T18:13:27.278 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:27.236+0000 7fd4924f4700 1 -- 172.21.15.163:0/1891148933 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd48c1000f0 msgr2=0x7fd48c100500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:13:27.278 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:27.236+0000 7fd4924f4700 1 --2- 172.21.15.163:0/1891148933 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd48c1000f0 0x7fd48c100500 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fd47c0098f0 tx=0x7fd47c009c00 comp rx=0 tx=0).stop 2023-07-14T18:13:27.278 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:27.236+0000 7fd4924f4700 1 -- 172.21.15.163:0/1891148933 shutdown_connections 2023-07-14T18:13:27.278 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:27.236+0000 7fd4924f4700 1 --2- 172.21.15.163:0/1891148933 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd48c1000f0 0x7fd48c100500 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:13:27.278 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:27.236+0000 7fd4924f4700 1 --2- 172.21.15.163:0/1891148933 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fd48c0ff790 0x7fd48c107040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:13:27.279 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:27.236+0000 7fd4924f4700 1 --2- 172.21.15.163:0/1891148933 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd48c0fede0 0x7fd48c0ff250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:13:27.279 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:27.236+0000 7fd4924f4700 1 -- 172.21.15.163:0/1891148933 >> 172.21.15.163:0/1891148933 conn(0x7fd48c0f98a0 msgr2=0x7fd48c0fbcf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:13:27.279 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:27.236+0000 7fd4924f4700 1 -- 172.21.15.163:0/1891148933 shutdown_connections 2023-07-14T18:13:27.279 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:27.236+0000 7fd4924f4700 1 -- 172.21.15.163:0/1891148933 wait complete. 2023-07-14T18:13:27.279 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:27.237+0000 7fd4924f4700 1 Processor -- start 2023-07-14T18:13:27.280 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:27.237+0000 7fd4924f4700 1 -- start start 2023-07-14T18:13:27.281 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:27.238+0000 7fd4924f4700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fd48c0fede0 0x7fd48c194800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:13:27.281 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:27.238+0000 7fd4924f4700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd48c0ff790 0x7fd48c194d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:13:27.281 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:27.238+0000 7fd4924f4700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd48c1000f0 0x7fd48c19bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:13:27.281 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:27.238+0000 7fd4924f4700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd48c19c380 con 0x7fd48c0fede0 2023-07-14T18:13:27.281 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:27.238+0000 7fd4924f4700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd48c19c4c0 con 0x7fd48c1000f0 2023-07-14T18:13:27.281 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:27.238+0000 7fd4924f4700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd48c19c650 con 0x7fd48c0ff790 2023-07-14T18:13:27.282 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:27.238+0000 7fd48bfff700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fd48c0fede0 0x7fd48c194800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:13:27.282 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:27.238+0000 7fd48bfff700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fd48c0fede0 0x7fd48c194800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:58322/0 (socket says 172.21.15.163:58322) 2023-07-14T18:13:27.282 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:27.238+0000 7fd48bfff700 1 -- 172.21.15.163:0/654180159 learned_addr learned my addr 172.21.15.163:0/654180159 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:13:27.282 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:27.238+0000 7fd48b7fe700 1 --2- 172.21.15.163:0/654180159 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd48c0ff790 0x7fd48c194d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:13:27.282 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:27.238+0000 7fd490a91700 1 --2- 172.21.15.163:0/654180159 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd48c1000f0 0x7fd48c19bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:13:27.282 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:27.238+0000 7fd48bfff700 1 -- 172.21.15.163:0/654180159 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd48c0ff790 msgr2=0x7fd48c194d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:13:27.282 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:27.238+0000 7fd48bfff700 1 --2- 172.21.15.163:0/654180159 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd48c0ff790 0x7fd48c194d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:13:27.283 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:27.238+0000 7fd48bfff700 1 -- 172.21.15.163:0/654180159 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd48c1000f0 msgr2=0x7fd48c19bdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:13:27.283 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:27.238+0000 7fd48bfff700 1 --2- 172.21.15.163:0/654180159 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd48c1000f0 0x7fd48c19bdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:13:27.283 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:27.238+0000 7fd48bfff700 1 -- 172.21.15.163:0/654180159 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd484009d00 con 0x7fd48c0fede0 2023-07-14T18:13:27.283 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:27.238+0000 7fd48bfff700 1 --2- 172.21.15.163:0/654180159 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fd48c0fede0 0x7fd48c194800 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7fd47c000c00 tx=0x7fd47c00bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:13:27.283 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:27.238+0000 7fd4897fa700 1 -- 172.21.15.163:0/654180159 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd47c01e070 con 0x7fd48c0fede0 2023-07-14T18:13:27.283 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:27.239+0000 7fd4924f4700 1 -- 172.21.15.163:0/654180159 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd47c009520 con 0x7fd48c0fede0 2023-07-14T18:13:27.283 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:27.239+0000 7fd4897fa700 1 -- 172.21.15.163:0/654180159 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fd47c00ba90 con 0x7fd48c0fede0 2023-07-14T18:13:27.284 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:27.239+0000 7fd4897fa700 1 -- 172.21.15.163:0/654180159 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd47c0038e0 con 0x7fd48c0fede0 2023-07-14T18:13:27.284 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:27.239+0000 7fd4924f4700 1 -- 172.21.15.163:0/654180159 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd48c0fdfc0 con 0x7fd48c0fede0 2023-07-14T18:13:27.286 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:27.241+0000 7fd4897fa700 1 -- 172.21.15.163:0/654180159 <== mon.0 v2:172.21.15.163:3300/0 4 ==== mgrmap(e 18) v1 ==== 135716+0+0 (secure 0 0 0) 0x7fd47c022030 con 0x7fd48c0fede0 2023-07-14T18:13:27.286 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:27.242+0000 7fd49e68cb80 1 Processor -- start 2023-07-14T18:13:27.286 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:27.242+0000 7fd4897fa700 1 --2- 172.21.15.163:0/654180159 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7fd4740a1150 0x7fd4740a3600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:13:27.286 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:27.242+0000 7fd49e68cb80 1 -- start start 2023-07-14T18:13:27.286 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:27.242+0000 7fd48b7fe700 1 --2- 172.21.15.163:0/654180159 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7fd4740a1150 0x7fd4740a3600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:13:27.287 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:27.242+0000 7fd4897fa700 1 -- 172.21.15.163:0/654180159 <== mon.0 v2:172.21.15.163:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 9049+0+0 (secure 0 0 0) 0x7fd47c0cfe00 con 0x7fd48c0fede0 2023-07-14T18:13:27.287 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:27.243+0000 7fd49e68cb80 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x56066ade4f60 0x56066ade5370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:13:27.287 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:27.243+0000 7fd49e68cb80 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56066ade58b0 0x56066ade5ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:13:27.287 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:27.243+0000 7fd49e68cb80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56066ade64b0 0x56066ade6920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:13:27.287 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:27.243+0000 7fd49e68cb80 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x56066ace9cb0 con 0x56066ade4f60 2023-07-14T18:13:27.287 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:27.243+0000 7fd49e68cb80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x56066ad3ca40 con 0x56066ade64b0 2023-07-14T18:13:27.287 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:27.243+0000 7fd49e68cb80 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x56066ad35ed0 con 0x56066ade58b0 2023-07-14T18:13:27.288 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:27.243+0000 7fd48bfff700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x56066ade4f60 0x56066ade5370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:13:27.288 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:27.243+0000 7fd48bfff700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x56066ade4f60 0x56066ade5370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:58330/0 (socket says 172.21.15.163:58330) 2023-07-14T18:13:27.288 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:27.243+0000 7fd48bfff700 1 -- 172.21.15.163:0/3653070071 learned_addr learned my addr 172.21.15.163:0/3653070071 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:13:27.288 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:27.243+0000 7fd48b7fe700 1 --2- 172.21.15.163:0/654180159 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7fd4740a1150 0x7fd4740a3600 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fd480009c60 tx=0x7fd480009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:13:27.288 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:27.243+0000 7fd490a91700 1 --2- 172.21.15.163:0/3653070071 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56066ade64b0 0x56066ade6920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:13:27.288 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:27.243+0000 7fd48b7fe700 1 --2- 172.21.15.163:0/3653070071 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56066ade58b0 0x56066ade5ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:13:27.289 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:27.243+0000 7fd48bfff700 1 -- 172.21.15.163:0/3653070071 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56066ade58b0 msgr2=0x56066ade5ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:13:27.289 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:27.243+0000 7fd48bfff700 1 --2- 172.21.15.163:0/3653070071 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56066ade58b0 0x56066ade5ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:13:27.289 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:27.243+0000 7fd48bfff700 1 -- 172.21.15.163:0/3653070071 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56066ade64b0 msgr2=0x56066ade6920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:13:27.289 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:27.243+0000 7fd48bfff700 1 --2- 172.21.15.163:0/3653070071 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56066ade64b0 0x56066ade6920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:13:27.289 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:27.243+0000 7fd48bfff700 1 -- 172.21.15.163:0/3653070071 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56066ab63de0 con 0x56066ade4f60 2023-07-14T18:13:27.289 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:27.243+0000 7fd48b7fe700 1 --2- 172.21.15.163:0/3653070071 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56066ade58b0 0x56066ade5ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T18:13:27.289 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:27.243+0000 7fd48bfff700 1 --2- 172.21.15.163:0/3653070071 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x56066ade4f60 0x56066ade5370 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7fd47c09cf00 tx=0x7fd47c009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c97cae240b2a2192 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:13:27.289 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:27.244+0000 7fd4727fc700 1 -- 172.21.15.163:0/3653070071 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd47c0a0fa0 con 0x56066ade4f60 2023-07-14T18:13:27.290 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:27.244+0000 7fd4727fc700 1 -- 172.21.15.163:0/3653070071 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fd47c0a5330 con 0x56066ade4f60 2023-07-14T18:13:27.290 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:27.244+0000 7fd4727fc700 1 -- 172.21.15.163:0/3653070071 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd47c09d1d0 con 0x56066ade4f60 2023-07-14T18:13:27.290 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:27.244+0000 7fd49e68cb80 1 -- 172.21.15.163:0/3653070071 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x56066ade4f60 msgr2=0x56066ade5370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:13:27.290 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:27.244+0000 7fd49e68cb80 1 --2- 172.21.15.163:0/3653070071 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x56066ade4f60 0x56066ade5370 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7fd47c09cf00 tx=0x7fd47c009c00 comp rx=0 tx=0).stop 2023-07-14T18:13:27.290 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:27.244+0000 7fd49e68cb80 1 -- 172.21.15.163:0/3653070071 shutdown_connections 2023-07-14T18:13:27.290 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:27.244+0000 7fd49e68cb80 1 --2- 172.21.15.163:0/3653070071 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56066ade64b0 0x56066ade6920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:13:27.290 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:27.244+0000 7fd49e68cb80 1 --2- 172.21.15.163:0/3653070071 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x56066ade4f60 0x56066ade5370 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:13:27.291 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:27.244+0000 7fd49e68cb80 1 --2- 172.21.15.163:0/3653070071 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56066ade58b0 0x56066ade5ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:13:27.291 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:27.244+0000 7fd49e68cb80 1 -- 172.21.15.163:0/3653070071 >> 172.21.15.163:0/3653070071 conn(0x56066adda680 msgr2=0x56066addf9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:13:27.291 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:27.244+0000 7fd49e68cb80 1 -- 172.21.15.163:0/3653070071 shutdown_connections 2023-07-14T18:13:27.291 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:27.244+0000 7fd49e68cb80 1 -- 172.21.15.163:0/3653070071 wait complete. 2023-07-14T18:13:27.291 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:27.245+0000 7fd49e68cb80 1 -- start start 2023-07-14T18:13:27.291 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:27.245+0000 7fd49e68cb80 1 Processor -- start 2023-07-14T18:13:27.294 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:27.245+0000 7fd49e68cb80 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56066ade4f60 0x56066adee670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:13:27.294 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:27.245+0000 7fd49e68cb80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56066ade58b0 0x56066adeebb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:13:27.294 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:27.245+0000 7fd49e68cb80 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x56066ade64b0 0x56066adf5bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:13:27.294 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:27.245+0000 7fd49e68cb80 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x56066acd5ac0 con 0x56066ade64b0 2023-07-14T18:13:27.294 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:27.245+0000 7fd49e68cb80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x56066acd57c0 con 0x56066ade58b0 2023-07-14T18:13:27.295 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:27.245+0000 7fd49e68cb80 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x56066abb9920 con 0x56066ade4f60 2023-07-14T18:13:27.295 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:27.245+0000 7fd49e68cb80 10 client.0 _ll_register_callbacks cb 0x56066acd3760 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T18:13:27.295 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:27.246+0000 7fd490a91700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x56066ade64b0 0x56066adf5bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:13:27.295 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:27.246+0000 7fd490a91700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x56066ade64b0 0x56066adf5bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:58340/0 (socket says 172.21.15.163:58340) 2023-07-14T18:13:27.295 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:27.246+0000 7fd490a91700 1 -- 172.21.15.163:0/4244644502 learned_addr learned my addr 172.21.15.163:0/4244644502 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:13:27.295 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:27.246+0000 7fd48b7fe700 1 --2- 172.21.15.163:0/4244644502 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56066ade58b0 0x56066adeebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:13:27.295 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:27.246+0000 7fd48bfff700 1 --2- 172.21.15.163:0/4244644502 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56066ade4f60 0x56066adee670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:13:27.295 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:27.246+0000 7fd490a91700 1 -- 172.21.15.163:0/4244644502 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56066ade4f60 msgr2=0x56066adee670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:13:27.296 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:27.246+0000 7fd490a91700 1 --2- 172.21.15.163:0/4244644502 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56066ade4f60 0x56066adee670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:13:27.296 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:27.246+0000 7fd490a91700 1 -- 172.21.15.163:0/4244644502 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56066ade58b0 msgr2=0x56066adeebb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:13:27.296 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:27.246+0000 7fd490a91700 1 --2- 172.21.15.163:0/4244644502 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56066ade58b0 0x56066adeebb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:13:27.296 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:27.246+0000 7fd490a91700 1 -- 172.21.15.163:0/4244644502 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd48c0fdfc0 con 0x56066ade64b0 2023-07-14T18:13:27.296 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:27.246+0000 7fd490a91700 1 --2- 172.21.15.163:0/4244644502 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x56066ade64b0 0x56066adf5bf0 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7fd484007d70 tx=0x7fd484007da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3942a888a98390a3 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:13:27.296 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:27.246+0000 7fd46b7fe700 10 client.0 ms_handle_connect on v2:172.21.15.163:3300/0 2023-07-14T18:13:27.296 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:27.246+0000 7fd46b7fe700 1 -- 172.21.15.163:0/4244644502 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd48400e040 con 0x56066ade64b0 2023-07-14T18:13:27.297 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:27.246+0000 7fd46b7fe700 1 -- 172.21.15.163:0/4244644502 <== mon.0 v2:172.21.15.163:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 9049+0+0 (secure 0 0 0) 0x7fd484003c00 con 0x56066ade64b0 2023-07-14T18:13:27.297 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:27.246+0000 7fd49e68cb80 1 -- 172.21.15.163:0/4244644502 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56066ac8f4f0 con 0x56066ade64b0 2023-07-14T18:13:27.297 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:27.247+0000 7fd46b7fe700 1 -- 172.21.15.163:0/4244644502 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd484003dc0 con 0x56066ade64b0 2023-07-14T18:13:27.297 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:27.247+0000 7fd49e68cb80 10 client.15804 fetch_fsmap learned FSMap version 29 2023-07-14T18:13:27.297 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:27.247+0000 7fd49e68cb80 1 -- 172.21.15.163:0/4244644502 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) v3 -- 0x56066ab4cc60 con 0x56066ade64b0 2023-07-14T18:13:27.297 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:27.247+0000 7fd46b7fe700 1 -- 172.21.15.163:0/4244644502 <== mon.0 v2:172.21.15.163:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x56066ac8f4f0 con 0x56066ade64b0 2023-07-14T18:13:27.297 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:27.247+0000 7fd46b7fe700 1 -- 172.21.15.163:0/4244644502 <== mon.0 v2:172.21.15.163:3300/0 5 ==== fsmap(e 29) v1 ==== 7470+0+0 (secure 0 0 0) 0x7fd484004390 con 0x56066ade64b0 2023-07-14T18:13:27.297 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:27.247+0000 7fd49e68cb80 10 client.15804 fetch_fsmap finished waiting for FSMap version 29 2023-07-14T18:13:27.298 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:27.247+0000 7fd49e68cb80 10 client.15804 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-07-14T18:13:27.298 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:27.247+0000 7fd49e68cb80 20 client.15804 populate_metadata read hostname 'smithi163' 2023-07-14T18:13:27.298 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:27.247+0000 7fd49e68cb80 1 --2- 172.21.15.163:0/4244644502 >> [v2:172.21.15.172:6838/3850440096,v1:172.21.15.172:6839/3850440096] conn(0x56066adfa4c0 0x56066adfc8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:13:27.298 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:27.247+0000 7fd49e68cb80 4 client.15804 mds_command: new command op to 24518 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-14T18:13:27.298 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:27.247+0000 7fd49e68cb80 1 -- 172.21.15.163:0/4244644502 --> [v2:172.21.15.172:6838/3850440096,v1:172.21.15.172:6839/3850440096] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x56066adb3da0 con 0x56066adfa4c0 2023-07-14T18:13:27.298 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:27.247+0000 7fd48bfff700 1 --2- 172.21.15.163:0/4244644502 >> [v2:172.21.15.172:6838/3850440096,v1:172.21.15.172:6839/3850440096] conn(0x56066adfa4c0 0x56066adfc8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:13:27.298 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:27.248+0000 7fd46b7fe700 10 client.15804 ms_handle_connect on v2:172.21.15.172:6838/3850440096 2023-07-14T18:13:27.299 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:27.248+0000 7fd48bfff700 1 --2- 172.21.15.163:0/4244644502 >> [v2:172.21.15.172:6838/3850440096,v1:172.21.15.172:6839/3850440096] conn(0x56066adfa4c0 0x56066adfc8d0 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=52cb0a59d4fe678a server_cookie=4806b95b42cc75c8 in_seq=0 out_seq=0 2023-07-14T18:13:27.299 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:27.248+0000 7fd46b7fe700 1 -- 172.21.15.163:0/4244644502 <== mds.0 v2:172.21.15.172:6838/3850440096 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18017 (crc 0 0 0) 0x56066adb3da0 con 0x56066adfa4c0 2023-07-14T18:13:27.299 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:27.248+0000 7fd46b7fe700 10 client.15804 handle_command_reply: tid=0 2023-07-14T18:13:27.299 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:27.248+0000 7fd49e68cb80 1 client.15804 shutdown 2023-07-14T18:13:27.299 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:27.249+0000 7fd49e68cb80 1 -- 172.21.15.163:0/4244644502 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x56066ade64b0 msgr2=0x56066adf5bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:13:27.299 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:27.249+0000 7fd49e68cb80 1 --2- 172.21.15.163:0/4244644502 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x56066ade64b0 0x56066adf5bf0 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7fd484007d70 tx=0x7fd484007da0 comp rx=0 tx=0).stop 2023-07-14T18:13:27.299 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:27.249+0000 7fd49e68cb80 1 -- 172.21.15.163:0/4244644502 shutdown_connections 2023-07-14T18:13:27.299 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:27.249+0000 7fd49e68cb80 1 --2- 172.21.15.163:0/4244644502 >> [v2:172.21.15.172:6838/3850440096,v1:172.21.15.172:6839/3850440096] conn(0x56066adfa4c0 0x56066adfc8d0 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:13:27.300 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:27.249+0000 7fd49e68cb80 1 --2- 172.21.15.163:0/4244644502 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56066ade4f60 0x56066adee670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:13:27.300 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:27.249+0000 7fd46b7fe700 0 client.15804 ms_handle_reset on v2:172.21.15.172:6838/3850440096 2023-07-14T18:13:27.300 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:27.249+0000 7fd49e68cb80 1 --2- 172.21.15.163:0/4244644502 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x56066ade64b0 0x56066adf5bf0 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:13:27.300 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:27.249+0000 7fd49e68cb80 1 --2- 172.21.15.163:0/4244644502 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56066ade58b0 0x56066adeebb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:13:27.300 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:27.249+0000 7fd49e68cb80 1 -- 172.21.15.163:0/4244644502 >> 172.21.15.163:0/4244644502 conn(0x56066adda680 msgr2=0x56066adde650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:13:27.300 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:27.249+0000 7fd49e68cb80 1 -- 172.21.15.163:0/4244644502 shutdown_connections 2023-07-14T18:13:27.300 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:27.249+0000 7fd49e68cb80 1 -- 172.21.15.163:0/4244644502 wait complete. 2023-07-14T18:13:27.301 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:27.249+0000 7fd49e68cb80 20 client.15804 trim_cache size 0 max 16384 2023-07-14T18:13:27.307 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:27.265+0000 7fd49e68cb80 1 Processor -- start 2023-07-14T18:13:27.307 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:27.266+0000 7fd49e68cb80 1 -- start start 2023-07-14T18:13:27.308 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:27.266+0000 7fd49e68cb80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56066ade4f60 0x56066ade6880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:13:27.308 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:27.266+0000 7fd49e68cb80 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x56066ade58b0 0x56066adf5b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:13:27.308 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:27.266+0000 7fd49e68cb80 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56066ade64b0 0x56066adf6420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:13:27.308 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:27.266+0000 7fd49e68cb80 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x56066adedb20 con 0x56066ade58b0 2023-07-14T18:13:27.308 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:27.266+0000 7fd49e68cb80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x56066ade1500 con 0x56066ade4f60 2023-07-14T18:13:27.308 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:27.266+0000 7fd49e68cb80 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x56066adee1e0 con 0x56066ade64b0 2023-07-14T18:13:27.309 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:27.266+0000 7fd48b7fe700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x56066ade58b0 0x56066adf5b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:13:27.309 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:27.266+0000 7fd48b7fe700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x56066ade58b0 0x56066adf5b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:58348/0 (socket says 172.21.15.163:58348) 2023-07-14T18:13:27.309 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:27.266+0000 7fd48b7fe700 1 -- 172.21.15.163:0/3156419784 learned_addr learned my addr 172.21.15.163:0/3156419784 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:13:27.309 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:27.266+0000 7fd48bfff700 1 --2- 172.21.15.163:0/3156419784 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56066ade4f60 0x56066ade6880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:13:27.309 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:27.266+0000 7fd490a91700 1 --2- 172.21.15.163:0/3156419784 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56066ade64b0 0x56066adf6420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:13:27.309 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:27.266+0000 7fd48b7fe700 1 -- 172.21.15.163:0/3156419784 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56066ade64b0 msgr2=0x56066adf6420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:13:27.309 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:27.266+0000 7fd48b7fe700 1 --2- 172.21.15.163:0/3156419784 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56066ade64b0 0x56066adf6420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:13:27.309 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:27.266+0000 7fd48b7fe700 1 -- 172.21.15.163:0/3156419784 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56066ade4f60 msgr2=0x56066ade6880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:13:27.310 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:27.266+0000 7fd48b7fe700 1 --2- 172.21.15.163:0/3156419784 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56066ade4f60 0x56066ade6880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:13:27.310 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:27.266+0000 7fd48b7fe700 1 -- 172.21.15.163:0/3156419784 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56066ab8a250 con 0x56066ade58b0 2023-07-14T18:13:27.313 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:27.267+0000 7fd48b7fe700 1 --2- 172.21.15.163:0/3156419784 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x56066ade58b0 0x56066adf5b10 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7fd48001d4f0 tx=0x7fd480014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a925b1b82ed941e1 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:13:27.313 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:27.267+0000 7fd472ffd700 1 -- 172.21.15.163:0/3156419784 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd480022070 con 0x56066ade58b0 2023-07-14T18:13:27.313 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:27.267+0000 7fd472ffd700 1 -- 172.21.15.163:0/3156419784 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fd48001b950 con 0x56066ade58b0 2023-07-14T18:13:27.313 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:27.267+0000 7fd472ffd700 1 -- 172.21.15.163:0/3156419784 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4800266f0 con 0x56066ade58b0 2023-07-14T18:13:27.313 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:27.268+0000 7fd49e68cb80 1 -- 172.21.15.163:0/3156419784 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x56066ade58b0 msgr2=0x56066adf5b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:13:27.314 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:27.268+0000 7fd49e68cb80 1 --2- 172.21.15.163:0/3156419784 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x56066ade58b0 0x56066adf5b10 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7fd48001d4f0 tx=0x7fd480014000 comp rx=0 tx=0).stop 2023-07-14T18:13:27.314 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:27.268+0000 7fd49e68cb80 1 -- 172.21.15.163:0/3156419784 shutdown_connections 2023-07-14T18:13:27.314 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:27.268+0000 7fd49e68cb80 1 --2- 172.21.15.163:0/3156419784 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56066ade64b0 0x56066adf6420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:13:27.314 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:27.268+0000 7fd49e68cb80 1 --2- 172.21.15.163:0/3156419784 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56066ade4f60 0x56066ade6880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:13:27.314 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:27.268+0000 7fd49e68cb80 1 --2- 172.21.15.163:0/3156419784 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x56066ade58b0 0x56066adf5b10 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:13:27.314 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:27.268+0000 7fd49e68cb80 1 -- 172.21.15.163:0/3156419784 >> 172.21.15.163:0/3156419784 conn(0x56066adda680 msgr2=0x56066addbb50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:13:27.314 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:27.268+0000 7fd49e68cb80 1 -- 172.21.15.163:0/3156419784 shutdown_connections 2023-07-14T18:13:27.315 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:27.268+0000 7fd49e68cb80 1 -- 172.21.15.163:0/3156419784 wait complete. 2023-07-14T18:13:27.315 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:27.268+0000 7fd49e68cb80 1 -- start start 2023-07-14T18:13:27.315 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:27.268+0000 7fd49e68cb80 1 Processor -- start 2023-07-14T18:13:27.315 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:27.269+0000 7fd49e68cb80 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56066ade4f60 0x56066adf5500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:13:27.315 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:27.269+0000 7fd49e68cb80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56066ade58b0 0x56066adf5a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:13:27.315 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:27.269+0000 7fd49e68cb80 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x56066ade64b0 0x56066adf1fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:13:27.315 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:27.269+0000 7fd49e68cb80 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x56066adf26b0 con 0x56066ade64b0 2023-07-14T18:13:27.315 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:27.269+0000 7fd49e68cb80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x56066adf2820 con 0x56066ade58b0 2023-07-14T18:13:27.316 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:27.269+0000 7fd49e68cb80 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x56066adf29e0 con 0x56066ade4f60 2023-07-14T18:13:27.316 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:27.269+0000 7fd49e68cb80 10 client.0 _ll_register_callbacks cb 0x7fd4840076a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T18:13:27.316 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:27.269+0000 7fd490a91700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x56066ade64b0 0x56066adf1fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:13:27.316 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:27.269+0000 7fd490a91700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x56066ade64b0 0x56066adf1fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:58354/0 (socket says 172.21.15.163:58354) 2023-07-14T18:13:27.316 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:27.269+0000 7fd490a91700 1 -- 172.21.15.163:0/1680217040 learned_addr learned my addr 172.21.15.163:0/1680217040 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:13:27.316 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:27.269+0000 7fd48bfff700 1 --2- 172.21.15.163:0/1680217040 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56066ade4f60 0x56066adf5500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:13:27.316 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:27.269+0000 7fd490a91700 1 -- 172.21.15.163:0/1680217040 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56066ade4f60 msgr2=0x56066adf5500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:13:27.317 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:27.269+0000 7fd490a91700 1 --2- 172.21.15.163:0/1680217040 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56066ade4f60 0x56066adf5500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:13:27.317 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:27.269+0000 7fd490a91700 1 -- 172.21.15.163:0/1680217040 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56066ade58b0 msgr2=0x56066adf5a40 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-07-14T18:13:27.317 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:27.269+0000 7fd490a91700 1 --2- 172.21.15.163:0/1680217040 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56066ade58b0 0x56066adf5a40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:13:27.317 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:27.269+0000 7fd490a91700 1 -- 172.21.15.163:0/1680217040 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd480017070 con 0x56066ade64b0 2023-07-14T18:13:27.317 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:27.269+0000 7fd490a91700 1 --2- 172.21.15.163:0/1680217040 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x56066ade64b0 0x56066adf1fa0 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7fd484009fd0 tx=0x7fd484006000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f7470503d21c4ef0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:13:27.317 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:27.269+0000 7fd46b7fe700 10 client.0 ms_handle_connect on v2:172.21.15.163:3300/0 2023-07-14T18:13:27.317 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:27.269+0000 7fd46b7fe700 1 -- 172.21.15.163:0/1680217040 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd48400e040 con 0x56066ade64b0 2023-07-14T18:13:27.317 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:27.269+0000 7fd46b7fe700 1 -- 172.21.15.163:0/1680217040 <== mon.0 v2:172.21.15.163:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 9049+0+0 (secure 0 0 0) 0x7fd484013ce0 con 0x56066ade64b0 2023-07-14T18:13:27.318 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:27.269+0000 7fd49e68cb80 1 -- 172.21.15.163:0/1680217040 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fd47c0a5330 con 0x56066ade64b0 2023-07-14T18:13:27.318 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:27.270+0000 7fd46b7fe700 1 -- 172.21.15.163:0/1680217040 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd484013ea0 con 0x56066ade64b0 2023-07-14T18:13:27.318 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:27.270+0000 7fd49e68cb80 10 client.15810 fetch_fsmap learned FSMap version 29 2023-07-14T18:13:27.318 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:27.270+0000 7fd49e68cb80 1 -- 172.21.15.163:0/1680217040 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) v3 -- 0x56066ab622b0 con 0x56066ade64b0 2023-07-14T18:13:27.318 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:27.270+0000 7fd46b7fe700 1 -- 172.21.15.163:0/1680217040 <== mon.0 v2:172.21.15.163:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fd47c0a5330 con 0x56066ade64b0 2023-07-14T18:13:27.318 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:27.270+0000 7fd46b7fe700 1 -- 172.21.15.163:0/1680217040 <== mon.0 v2:172.21.15.163:3300/0 5 ==== fsmap(e 29) v1 ==== 7470+0+0 (secure 0 0 0) 0x7fd48402a550 con 0x56066ade64b0 2023-07-14T18:13:27.318 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:27.270+0000 7fd49e68cb80 10 client.15810 fetch_fsmap finished waiting for FSMap version 29 2023-07-14T18:13:27.319 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:27.270+0000 7fd49e68cb80 10 client.15810 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-07-14T18:13:27.319 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:27.270+0000 7fd49e68cb80 20 client.15810 populate_metadata read hostname 'smithi163' 2023-07-14T18:13:27.319 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:27.270+0000 7fd49e68cb80 1 --2- 172.21.15.163:0/1680217040 >> [v2:172.21.15.172:6838/3850440096,v1:172.21.15.172:6839/3850440096] conn(0x56066ae4f780 0x56066ae51b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:13:27.319 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:27.270+0000 7fd49e68cb80 4 client.15810 mds_command: new command op to 24518 tid=0[{"prefix": "damage ls"}] 2023-07-14T18:13:27.319 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:27.270+0000 7fd49e68cb80 1 -- 172.21.15.163:0/1680217040 --> [v2:172.21.15.172:6838/3850440096,v1:172.21.15.172:6839/3850440096] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x56066ad2eeb0 con 0x56066ae4f780 2023-07-14T18:13:27.319 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:27.270+0000 7fd48bfff700 1 --2- 172.21.15.163:0/1680217040 >> [v2:172.21.15.172:6838/3850440096,v1:172.21.15.172:6839/3850440096] conn(0x56066ae4f780 0x56066ae51b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:13:27.319 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:27.271+0000 7fd46b7fe700 10 client.15810 ms_handle_connect on v2:172.21.15.172:6838/3850440096 2023-07-14T18:13:27.319 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:27.271+0000 7fd48bfff700 1 --2- 172.21.15.163:0/1680217040 >> [v2:172.21.15.172:6838/3850440096,v1:172.21.15.172:6839/3850440096] conn(0x56066ae4f780 0x56066ae51b90 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e79c510a70ab8c3f server_cookie=aa2501b61e955c53 in_seq=0 out_seq=0 2023-07-14T18:13:27.320 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:27.271+0000 7fd46b7fe700 1 -- 172.21.15.163:0/1680217040 <== mds.0 v2:172.21.15.172:6838/3850440096 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x56066ad2eeb0 con 0x56066ae4f780 2023-07-14T18:13:27.320 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:27.271+0000 7fd46b7fe700 10 client.15810 handle_command_reply: tid=0 2023-07-14T18:13:27.320 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:27.271+0000 7fd49e68cb80 1 client.15810 shutdown 2023-07-14T18:13:27.320 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:27.271+0000 7fd49e68cb80 1 -- 172.21.15.163:0/1680217040 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x56066ade64b0 msgr2=0x56066adf1fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:13:27.320 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:27.271+0000 7fd49e68cb80 1 --2- 172.21.15.163:0/1680217040 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x56066ade64b0 0x56066adf1fa0 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7fd484009fd0 tx=0x7fd484006000 comp rx=0 tx=0).stop 2023-07-14T18:13:27.320 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:27.271+0000 7fd49e68cb80 1 -- 172.21.15.163:0/1680217040 shutdown_connections 2023-07-14T18:13:27.320 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:27.271+0000 7fd49e68cb80 1 --2- 172.21.15.163:0/1680217040 >> [v2:172.21.15.172:6838/3850440096,v1:172.21.15.172:6839/3850440096] conn(0x56066ae4f780 0x56066ae51b90 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:13:27.321 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:27.271+0000 7fd49e68cb80 1 --2- 172.21.15.163:0/1680217040 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56066ade4f60 0x56066adf5500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:13:27.321 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:27.271+0000 7fd49e68cb80 1 --2- 172.21.15.163:0/1680217040 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x56066ade64b0 0x56066adf1fa0 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:13:27.321 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:27.271+0000 7fd46b7fe700 0 client.15810 ms_handle_reset on v2:172.21.15.172:6838/3850440096 2023-07-14T18:13:27.321 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:27.271+0000 7fd49e68cb80 1 --2- 172.21.15.163:0/1680217040 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56066ade58b0 0x56066adf5a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:13:27.321 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:27.271+0000 7fd49e68cb80 1 -- 172.21.15.163:0/1680217040 >> 172.21.15.163:0/1680217040 conn(0x56066adda680 msgr2=0x56066adf6420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:13:27.321 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:27.271+0000 7fd49e68cb80 1 -- 172.21.15.163:0/1680217040 shutdown_connections 2023-07-14T18:13:27.321 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:27.271+0000 7fd49e68cb80 1 -- 172.21.15.163:0/1680217040 wait complete. 2023-07-14T18:13:27.321 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:27.272+0000 7fd49e68cb80 20 client.15810 trim_cache size 0 max 16384 2023-07-14T18:13:27.322 INFO:teuthology.orchestra.run.smithi163.stdout:[] 2023-07-14T18:13:27.323 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:27.272+0000 7fd4924f4700 1 -- 172.21.15.163:0/654180159 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7fd4740a1150 msgr2=0x7fd4740a3600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:13:27.323 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:27.272+0000 7fd4924f4700 1 --2- 172.21.15.163:0/654180159 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7fd4740a1150 0x7fd4740a3600 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fd480009c60 tx=0x7fd480009260 comp rx=0 tx=0).stop 2023-07-14T18:13:27.323 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:27.272+0000 7fd4924f4700 1 -- 172.21.15.163:0/654180159 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fd48c0fede0 msgr2=0x7fd48c194800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:13:27.323 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:27.272+0000 7fd4924f4700 1 --2- 172.21.15.163:0/654180159 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fd48c0fede0 0x7fd48c194800 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7fd47c000c00 tx=0x7fd47c00bf60 comp rx=0 tx=0).stop 2023-07-14T18:13:27.323 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:27.272+0000 7fd4924f4700 1 -- 172.21.15.163:0/654180159 shutdown_connections 2023-07-14T18:13:27.323 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:27.272+0000 7fd4924f4700 1 --2- 172.21.15.163:0/654180159 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7fd4740a1150 0x7fd4740a3600 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:13:27.323 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:27.272+0000 7fd4924f4700 1 --2- 172.21.15.163:0/654180159 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd48c1000f0 0x7fd48c19bdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:13:27.324 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:27.272+0000 7fd4924f4700 1 --2- 172.21.15.163:0/654180159 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fd48c0fede0 0x7fd48c194800 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:13:27.324 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:27.272+0000 7fd4924f4700 1 --2- 172.21.15.163:0/654180159 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd48c0ff790 0x7fd48c194d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:13:27.324 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:27.272+0000 7fd4924f4700 1 -- 172.21.15.163:0/654180159 >> 172.21.15.163:0/654180159 conn(0x7fd48c0f98a0 msgr2=0x7fd48c0fbbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:13:27.324 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:27.272+0000 7fd4924f4700 1 -- 172.21.15.163:0/654180159 shutdown_connections 2023-07-14T18:13:27.324 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:27.272+0000 7fd4924f4700 1 -- 172.21.15.163:0/654180159 wait complete. 2023-07-14T18:13:28.176 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:13:27 smithi184 ceph-mon[98481]: pgmap v324: 129 pgs: 129 active+clean; 660 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 9 op/s; 0 B/s, 0 objects/s recovering 2023-07-14T18:13:28.218 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:13:27 smithi163 ceph-mon[96576]: pgmap v324: 129 pgs: 129 active+clean; 660 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 9 op/s; 0 B/s, 0 objects/s recovering 2023-07-14T18:13:28.277 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:13:27 smithi172 ceph-mon[97983]: pgmap v324: 129 pgs: 129 active+clean; 660 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 9 op/s; 0 B/s, 0 objects/s recovering 2023-07-14T18:13:28.326 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2023-07-14T18:13:28.326 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2023-07-14T18:13:28.481 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:28.439+0000 7f27f00ee700 1 -- 172.21.15.163:0/1600800254 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f27e81018c0 msgr2=0x7f27e8108180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:13:28.481 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:28.439+0000 7f27f00ee700 1 --2- 172.21.15.163:0/1600800254 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f27e81018c0 0x7f27e8108180 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f27e000b0a0 tx=0x7f27e000b3b0 comp rx=0 tx=0).stop 2023-07-14T18:13:28.481 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:28.440+0000 7f27f00ee700 1 -- 172.21.15.163:0/1600800254 shutdown_connections 2023-07-14T18:13:28.482 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:28.440+0000 7f27f00ee700 1 --2- 172.21.15.163:0/1600800254 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f27e81018c0 0x7f27e8108180 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:13:28.482 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:28.440+0000 7f27f00ee700 1 --2- 172.21.15.163:0/1600800254 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f27e80fdec0 0x7f27e80fe2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:13:28.482 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:28.440+0000 7f27f00ee700 1 --2- 172.21.15.163:0/1600800254 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f27e8100f30 0x7f27e8101380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:13:28.482 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:28.440+0000 7f27f00ee700 1 -- 172.21.15.163:0/1600800254 >> 172.21.15.163:0/1600800254 conn(0x7f27e80f98a0 msgr2=0x7f27e80fbcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:13:28.482 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:28.440+0000 7f27f00ee700 1 -- 172.21.15.163:0/1600800254 shutdown_connections 2023-07-14T18:13:28.482 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:28.440+0000 7f27f00ee700 1 -- 172.21.15.163:0/1600800254 wait complete. 2023-07-14T18:13:28.484 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:28.440+0000 7f27f00ee700 1 Processor -- start 2023-07-14T18:13:28.485 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:28.440+0000 7f27f00ee700 1 -- start start 2023-07-14T18:13:28.485 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:28.440+0000 7f27f00ee700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f27e80fdec0 0x7f27e81008a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:13:28.485 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:28.440+0000 7f27f00ee700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f27e8100f30 0x7f27e80feee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:13:28.486 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:28.440+0000 7f27f00ee700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f27e81018c0 0x7f27e80ff420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:13:28.486 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:28.441+0000 7f27f00ee700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27e80ffbc0 con 0x7f27e81018c0 2023-07-14T18:13:28.486 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:28.441+0000 7f27f00ee700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27e80ffd30 con 0x7f27e8100f30 2023-07-14T18:13:28.487 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:28.441+0000 7f27f00ee700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27e819fa40 con 0x7f27e80fdec0 2023-07-14T18:13:28.487 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:28.441+0000 7f27ee68b700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f27e81018c0 0x7f27e80ff420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:13:28.487 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:28.441+0000 7f27ee68b700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f27e81018c0 0x7f27e80ff420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:58368/0 (socket says 172.21.15.163:58368) 2023-07-14T18:13:28.487 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:28.441+0000 7f27ee68b700 1 -- 172.21.15.163:0/295295778 learned_addr learned my addr 172.21.15.163:0/295295778 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:13:28.488 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:28.441+0000 7f27ede8a700 1 --2- 172.21.15.163:0/295295778 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f27e80fdec0 0x7f27e81008a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:13:28.488 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:28.441+0000 7f27ed689700 1 --2- 172.21.15.163:0/295295778 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f27e8100f30 0x7f27e80feee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:13:28.488 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:28.441+0000 7f27ee68b700 1 -- 172.21.15.163:0/295295778 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f27e80fdec0 msgr2=0x7f27e81008a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:13:28.489 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:28.441+0000 7f27ee68b700 1 --2- 172.21.15.163:0/295295778 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f27e80fdec0 0x7f27e81008a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:13:28.489 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:28.441+0000 7f27ee68b700 1 -- 172.21.15.163:0/295295778 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f27e8100f30 msgr2=0x7f27e80feee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:13:28.489 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:28.441+0000 7f27ee68b700 1 --2- 172.21.15.163:0/295295778 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f27e8100f30 0x7f27e80feee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:13:28.490 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:28.441+0000 7f27ee68b700 1 -- 172.21.15.163:0/295295778 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27e0009d00 con 0x7f27e81018c0 2023-07-14T18:13:28.490 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:28.441+0000 7f27ee68b700 1 --2- 172.21.15.163:0/295295778 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f27e81018c0 0x7f27e80ff420 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f27e0009fd0 tx=0x7f27e000ba50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:13:28.490 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:28.441+0000 7f27deffd700 1 -- 172.21.15.163:0/295295778 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27e000e040 con 0x7f27e81018c0 2023-07-14T18:13:28.490 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:28.442+0000 7f27deffd700 1 -- 172.21.15.163:0/295295778 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f27e000be90 con 0x7f27e81018c0 2023-07-14T18:13:28.491 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:28.442+0000 7f27deffd700 1 -- 172.21.15.163:0/295295778 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27e001b460 con 0x7f27e81018c0 2023-07-14T18:13:28.491 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:28.442+0000 7f27f00ee700 1 -- 172.21.15.163:0/295295778 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f27e819fcc0 con 0x7f27e81018c0 2023-07-14T18:13:28.491 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:28.442+0000 7f27f00ee700 1 -- 172.21.15.163:0/295295778 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27e81a00e0 con 0x7f27e81018c0 2023-07-14T18:13:28.496 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:28.444+0000 7f27deffd700 1 -- 172.21.15.163:0/295295778 <== mon.0 v2:172.21.15.163:3300/0 4 ==== mgrmap(e 18) v1 ==== 135716+0+0 (secure 0 0 0) 0x7f27e001d470 con 0x7f27e81018c0 2023-07-14T18:13:28.496 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:28.445+0000 7f27deffd700 1 --2- 172.21.15.163:0/295295778 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f27d40a11d0 0x7f27d40a3680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:13:28.496 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:28.445+0000 7f27ede8a700 1 --2- 172.21.15.163:0/295295778 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f27d40a11d0 0x7f27d40a3680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:13:28.496 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:28.445+0000 7f27deffd700 1 -- 172.21.15.163:0/295295778 <== mon.0 v2:172.21.15.163:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 9049+0+0 (secure 0 0 0) 0x7f27e00cdac0 con 0x7f27e81018c0 2023-07-14T18:13:28.497 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:28.446+0000 7f27ede8a700 1 --2- 172.21.15.163:0/295295778 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f27d40a11d0 0x7f27d40a3680 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f27e8067500 tx=0x7f27e4009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:13:28.497 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:28.446+0000 7f27fc286b80 1 Processor -- start 2023-07-14T18:13:28.497 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:28.446+0000 7f27fc286b80 1 -- start start 2023-07-14T18:13:28.497 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:28.446+0000 7f27fc286b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x555dd2b6afe0 0x555dd2b6b3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:13:28.497 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:28.446+0000 7f27fc286b80 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x555dd2b6b930 0x555dd2b6bf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:13:28.497 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:28.446+0000 7f27fc286b80 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x555dd2b6c530 0x555dd2b6c9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:13:28.497 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:28.446+0000 7f27fc286b80 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x555dd2a6fd30 con 0x555dd2b6c530 2023-07-14T18:13:28.498 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:28.446+0000 7f27fc286b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x555dd2ac2ac0 con 0x555dd2b6afe0 2023-07-14T18:13:28.498 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:28.446+0000 7f27fc286b80 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x555dd2abbf50 con 0x555dd2b6b930 2023-07-14T18:13:28.498 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:28.446+0000 7f27ee68b700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x555dd2b6c530 0x555dd2b6c9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:13:28.498 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:28.446+0000 7f27ed689700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x555dd2b6b930 0x555dd2b6bf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:13:28.498 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:28.446+0000 7f27ee68b700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x555dd2b6c530 0x555dd2b6c9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:58376/0 (socket says 172.21.15.163:58376) 2023-07-14T18:13:28.498 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:28.446+0000 7f27ee68b700 1 -- 172.21.15.163:0/3682219198 learned_addr learned my addr 172.21.15.163:0/3682219198 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:13:28.498 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:28.446+0000 7f27ede8a700 1 --2- 172.21.15.163:0/3682219198 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x555dd2b6afe0 0x555dd2b6b3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:13:28.499 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:28.447+0000 7f27ed689700 1 -- 172.21.15.163:0/3682219198 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x555dd2b6afe0 msgr2=0x555dd2b6b3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:13:28.499 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:28.447+0000 7f27ed689700 1 --2- 172.21.15.163:0/3682219198 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x555dd2b6afe0 0x555dd2b6b3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:13:28.499 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:28.447+0000 7f27ed689700 1 -- 172.21.15.163:0/3682219198 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x555dd2b6c530 msgr2=0x555dd2b6c9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:13:28.499 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:28.447+0000 7f27ed689700 1 --2- 172.21.15.163:0/3682219198 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x555dd2b6c530 0x555dd2b6c9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:13:28.499 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:28.447+0000 7f27ed689700 1 -- 172.21.15.163:0/3682219198 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555dd28e9e60 con 0x555dd2b6b930 2023-07-14T18:13:28.499 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:28.447+0000 7f27ed689700 1 --2- 172.21.15.163:0/3682219198 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x555dd2b6b930 0x555dd2b6bf50 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f27d8009cb0 tx=0x7f27d8011440 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7a6fce749af952a8 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:13:28.499 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:28.447+0000 7f27d3fff700 1 -- 172.21.15.163:0/3682219198 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27d8011d20 con 0x555dd2b6b930 2023-07-14T18:13:28.500 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:28.447+0000 7f27d3fff700 1 -- 172.21.15.163:0/3682219198 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f27d8011e80 con 0x555dd2b6b930 2023-07-14T18:13:28.500 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:28.447+0000 7f27d3fff700 1 -- 172.21.15.163:0/3682219198 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27d8005280 con 0x555dd2b6b930 2023-07-14T18:13:28.500 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:28.448+0000 7f27fc286b80 1 -- 172.21.15.163:0/3682219198 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x555dd2b6b930 msgr2=0x555dd2b6bf50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:13:28.500 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:28.448+0000 7f27fc286b80 1 --2- 172.21.15.163:0/3682219198 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x555dd2b6b930 0x555dd2b6bf50 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f27d8009cb0 tx=0x7f27d8011440 comp rx=0 tx=0).stop 2023-07-14T18:13:28.500 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:28.448+0000 7f27fc286b80 1 -- 172.21.15.163:0/3682219198 shutdown_connections 2023-07-14T18:13:28.500 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:28.448+0000 7f27fc286b80 1 --2- 172.21.15.163:0/3682219198 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x555dd2b6c530 0x555dd2b6c9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:13:28.500 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:28.448+0000 7f27fc286b80 1 --2- 172.21.15.163:0/3682219198 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x555dd2b6afe0 0x555dd2b6b3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:13:28.501 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:28.448+0000 7f27fc286b80 1 --2- 172.21.15.163:0/3682219198 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x555dd2b6b930 0x555dd2b6bf50 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:13:28.501 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:28.448+0000 7f27fc286b80 1 -- 172.21.15.163:0/3682219198 >> 172.21.15.163:0/3682219198 conn(0x555dd2b60700 msgr2=0x555dd2b65a50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:13:28.501 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:28.448+0000 7f27fc286b80 1 -- 172.21.15.163:0/3682219198 shutdown_connections 2023-07-14T18:13:28.501 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:28.448+0000 7f27fc286b80 1 -- 172.21.15.163:0/3682219198 wait complete. 2023-07-14T18:13:28.501 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:28.448+0000 7f27fc286b80 1 -- start start 2023-07-14T18:13:28.501 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:28.448+0000 7f27fc286b80 1 Processor -- start 2023-07-14T18:13:28.501 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:28.449+0000 7f27fc286b80 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x555dd2b6afe0 0x555dd2b74950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:13:28.502 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:28.449+0000 7f27fc286b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x555dd2b6b930 0x555dd2b74e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:13:28.502 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:28.449+0000 7f27fc286b80 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x555dd2b6c530 0x555dd2b7bed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:13:28.502 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:28.449+0000 7f27fc286b80 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x555dd2a5bb40 con 0x555dd2b6afe0 2023-07-14T18:13:28.502 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:28.449+0000 7f27fc286b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x555dd2a5b840 con 0x555dd2b6b930 2023-07-14T18:13:28.502 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:28.449+0000 7f27fc286b80 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x555dd293f9a0 con 0x555dd2b6c530 2023-07-14T18:13:28.502 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:28.449+0000 7f27fc286b80 10 client.0 _ll_register_callbacks cb 0x555dd2a597e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T18:13:28.502 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:28.449+0000 7f27ed689700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x555dd2b6b930 0x555dd2b74e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:13:28.503 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:28.449+0000 7f27ed689700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x555dd2b6b930 0x555dd2b74e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.163:59064/0 (socket says 172.21.15.163:59064) 2023-07-14T18:13:28.503 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:28.449+0000 7f27ed689700 1 -- 172.21.15.163:0/3023317020 learned_addr learned my addr 172.21.15.163:0/3023317020 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:13:28.503 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:28.449+0000 7f27ee68b700 1 --2- 172.21.15.163:0/3023317020 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x555dd2b6c530 0x555dd2b7bed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:13:28.503 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:28.450+0000 7f27ed689700 1 -- 172.21.15.163:0/3023317020 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x555dd2b6c530 msgr2=0x555dd2b7bed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:13:28.503 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:28.450+0000 7f27ed689700 1 --2- 172.21.15.163:0/3023317020 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x555dd2b6c530 0x555dd2b7bed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:13:28.503 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:28.450+0000 7f27ede8a700 1 --2- 172.21.15.163:0/3023317020 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x555dd2b6afe0 0x555dd2b74950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:13:28.503 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:28.450+0000 7f27ed689700 1 -- 172.21.15.163:0/3023317020 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x555dd2b6afe0 msgr2=0x555dd2b74950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:13:28.504 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:28.450+0000 7f27ed689700 1 --2- 172.21.15.163:0/3023317020 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x555dd2b6afe0 0x555dd2b74950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:13:28.504 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:28.450+0000 7f27ed689700 1 -- 172.21.15.163:0/3023317020 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27d80098e0 con 0x555dd2b6b930 2023-07-14T18:13:28.504 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:28.450+0000 7f27ede8a700 1 --2- 172.21.15.163:0/3023317020 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x555dd2b6afe0 0x555dd2b74950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T18:13:28.504 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:28.450+0000 7f27ed689700 1 --2- 172.21.15.163:0/3023317020 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x555dd2b6b930 0x555dd2b74e90 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f27d8005e90 tx=0x7f27d8011ce0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d234c25942b7627b server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:13:28.504 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:28.450+0000 7f27d17fa700 10 client.0 ms_handle_connect on v2:172.21.15.172:3300/0 2023-07-14T18:13:28.504 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:28.450+0000 7f27d17fa700 1 -- 172.21.15.163:0/3023317020 <== mon.2 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27d8004260 con 0x555dd2b6b930 2023-07-14T18:13:28.505 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:28.450+0000 7f27fc286b80 1 -- 172.21.15.163:0/3023317020 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x555dd2b39e20 con 0x555dd2b6b930 2023-07-14T18:13:28.505 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:28.450+0000 7f27d17fa700 1 -- 172.21.15.163:0/3023317020 <== mon.2 v2:172.21.15.172:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 9049+0+0 (secure 0 0 0) 0x7f27d80043c0 con 0x555dd2b6b930 2023-07-14T18:13:28.505 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:28.450+0000 7f27d17fa700 1 -- 172.21.15.163:0/3023317020 <== mon.2 v2:172.21.15.172:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7f27d8004580 con 0x555dd2b6b930 2023-07-14T18:13:28.505 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:28.450+0000 7f27fc286b80 10 client.25469 fetch_fsmap learned FSMap version 29 2023-07-14T18:13:28.505 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:28.450+0000 7f27fc286b80 1 -- 172.21.15.163:0/3023317020 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) v3 -- 0x555dd28d2ce0 con 0x555dd2b6b930 2023-07-14T18:13:28.505 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:28.451+0000 7f27d17fa700 1 -- 172.21.15.163:0/3023317020 <== mon.2 v2:172.21.15.172:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x555dd2b39e20 con 0x555dd2b6b930 2023-07-14T18:13:28.505 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:28.451+0000 7f27d17fa700 1 -- 172.21.15.163:0/3023317020 <== mon.2 v2:172.21.15.172:3300/0 5 ==== fsmap(e 29) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f27d8003a50 con 0x555dd2b6b930 2023-07-14T18:13:28.505 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:28.451+0000 7f27fc286b80 10 client.25469 fetch_fsmap finished waiting for FSMap version 29 2023-07-14T18:13:28.506 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:28.451+0000 7f27fc286b80 10 client.25469 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-07-14T18:13:28.506 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:28.451+0000 7f27fc286b80 20 client.25469 populate_metadata read hostname 'smithi163' 2023-07-14T18:13:28.506 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:28.451+0000 7f27fc286b80 1 --2- 172.21.15.163:0/3023317020 >> [v2:172.21.15.172:6838/3850440096,v1:172.21.15.172:6839/3850440096] conn(0x555dd2b88e30 0x555dd2b8b240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:13:28.506 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:28.451+0000 7f27fc286b80 4 client.25469 mds_command: new command op to 24518 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-14T18:13:28.506 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:28.451+0000 7f27fc286b80 1 -- 172.21.15.163:0/3023317020 --> [v2:172.21.15.172:6838/3850440096,v1:172.21.15.172:6839/3850440096] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x555dd2ab4f30 con 0x555dd2b88e30 2023-07-14T18:13:28.506 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:28.451+0000 7f27ede8a700 1 --2- 172.21.15.163:0/3023317020 >> [v2:172.21.15.172:6838/3850440096,v1:172.21.15.172:6839/3850440096] conn(0x555dd2b88e30 0x555dd2b8b240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:13:28.506 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:28.452+0000 7f27d17fa700 10 client.25469 ms_handle_connect on v2:172.21.15.172:6838/3850440096 2023-07-14T18:13:28.507 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:28.452+0000 7f27ede8a700 1 --2- 172.21.15.163:0/3023317020 >> [v2:172.21.15.172:6838/3850440096,v1:172.21.15.172:6839/3850440096] conn(0x555dd2b88e30 0x555dd2b8b240 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8c8a2cb054d19839 server_cookie=72469574a6e38ea3 in_seq=0 out_seq=0 2023-07-14T18:13:28.507 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:28.452+0000 7f27d17fa700 1 -- 172.21.15.163:0/3023317020 <== mds.0 v2:172.21.15.172:6838/3850440096 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18017 (crc 0 0 0) 0x555dd2ab4f30 con 0x555dd2b88e30 2023-07-14T18:13:28.507 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:28.452+0000 7f27d17fa700 10 client.25469 handle_command_reply: tid=0 2023-07-14T18:13:28.507 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:28.452+0000 7f27fc286b80 1 client.25469 shutdown 2023-07-14T18:13:28.507 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:28.452+0000 7f27fc286b80 1 -- 172.21.15.163:0/3023317020 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x555dd2b6b930 msgr2=0x555dd2b74e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:13:28.507 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:28.452+0000 7f27fc286b80 1 --2- 172.21.15.163:0/3023317020 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x555dd2b6b930 0x555dd2b74e90 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f27d8005e90 tx=0x7f27d8011ce0 comp rx=0 tx=0).stop 2023-07-14T18:13:28.507 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:28.453+0000 7f27fc286b80 1 -- 172.21.15.163:0/3023317020 shutdown_connections 2023-07-14T18:13:28.508 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:28.453+0000 7f27fc286b80 1 --2- 172.21.15.163:0/3023317020 >> [v2:172.21.15.172:6838/3850440096,v1:172.21.15.172:6839/3850440096] conn(0x555dd2b88e30 0x555dd2b8b240 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:13:28.508 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:28.453+0000 7f27fc286b80 1 --2- 172.21.15.163:0/3023317020 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x555dd2b6c530 0x555dd2b7bed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:13:28.508 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:28.453+0000 7f27fc286b80 1 --2- 172.21.15.163:0/3023317020 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x555dd2b6afe0 0x555dd2b74950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:13:28.508 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:28.453+0000 7f27d17fa700 0 client.25469 ms_handle_reset on v2:172.21.15.172:6838/3850440096 2023-07-14T18:13:28.508 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:28.453+0000 7f27fc286b80 1 --2- 172.21.15.163:0/3023317020 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x555dd2b6b930 0x555dd2b74e90 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:13:28.508 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:28.453+0000 7f27fc286b80 1 -- 172.21.15.163:0/3023317020 >> 172.21.15.163:0/3023317020 conn(0x555dd2b60700 msgr2=0x555dd2b646d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:13:28.509 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:28.453+0000 7f27fc286b80 1 -- 172.21.15.163:0/3023317020 shutdown_connections 2023-07-14T18:13:28.509 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:28.453+0000 7f27fc286b80 1 -- 172.21.15.163:0/3023317020 wait complete. 2023-07-14T18:13:28.509 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:28.453+0000 7f27fc286b80 20 client.25469 trim_cache size 0 max 16384 2023-07-14T18:13:28.518 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:28.475+0000 7f27fc286b80 1 Processor -- start 2023-07-14T18:13:28.518 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:28.476+0000 7f27fc286b80 1 -- start start 2023-07-14T18:13:28.518 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:28.476+0000 7f27fc286b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x555dd2b6afe0 0x555dd2b728c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:13:28.518 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:28.476+0000 7f27fc286b80 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x555dd2b6b930 0x555dd2b7be90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:13:28.518 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:28.476+0000 7f27fc286b80 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x555dd2b6c530 0x555dd2b72e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:13:28.518 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:28.476+0000 7f27fc286b80 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x555dd2b8b8a0 con 0x555dd2b6c530 2023-07-14T18:13:28.519 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:28.476+0000 7f27fc286b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x555dd2b72670 con 0x555dd2b6afe0 2023-07-14T18:13:28.519 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:28.476+0000 7f27fc286b80 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x555dd2b64d50 con 0x555dd2b6b930 2023-07-14T18:13:28.519 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:28.476+0000 7f27ee68b700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x555dd2b6c530 0x555dd2b72e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:13:28.519 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:28.476+0000 7f27ede8a700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x555dd2b6afe0 0x555dd2b728c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:13:28.519 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:28.476+0000 7f27ee68b700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x555dd2b6c530 0x555dd2b72e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:58390/0 (socket says 172.21.15.163:58390) 2023-07-14T18:13:28.519 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:28.476+0000 7f27ee68b700 1 -- 172.21.15.163:0/2088226906 learned_addr learned my addr 172.21.15.163:0/2088226906 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:13:28.520 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:28.476+0000 7f27ed689700 1 --2- 172.21.15.163:0/2088226906 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x555dd2b6b930 0x555dd2b7be90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:13:28.520 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:28.476+0000 7f27ede8a700 1 -- 172.21.15.163:0/2088226906 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x555dd2b6b930 msgr2=0x555dd2b7be90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:13:28.520 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:28.476+0000 7f27ede8a700 1 --2- 172.21.15.163:0/2088226906 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x555dd2b6b930 0x555dd2b7be90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:13:28.520 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:28.476+0000 7f27ede8a700 1 -- 172.21.15.163:0/2088226906 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x555dd2b6c530 msgr2=0x555dd2b72e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:13:28.520 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:28.476+0000 7f27ede8a700 1 --2- 172.21.15.163:0/2088226906 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x555dd2b6c530 0x555dd2b72e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:13:28.521 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:28.476+0000 7f27ede8a700 1 -- 172.21.15.163:0/2088226906 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555dd2b73a20 con 0x555dd2b6afe0 2023-07-14T18:13:28.521 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:28.476+0000 7f27ee68b700 1 --2- 172.21.15.163:0/2088226906 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x555dd2b6c530 0x555dd2b72e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T18:13:28.521 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:28.476+0000 7f27ed689700 1 --2- 172.21.15.163:0/2088226906 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x555dd2b6b930 0x555dd2b7be90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T18:13:28.521 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:28.477+0000 7f27ede8a700 1 --2- 172.21.15.163:0/2088226906 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x555dd2b6afe0 0x555dd2b728c0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x555dd2b8b820 tx=0x7f27e4014000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5101f515eafc740d server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:13:28.525 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:28.477+0000 7f27dcff9700 1 -- 172.21.15.163:0/2088226906 <== mon.2 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27e4023040 con 0x555dd2b6afe0 2023-07-14T18:13:28.525 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:28.477+0000 7f27dcff9700 1 -- 172.21.15.163:0/2088226906 <== mon.2 v2:172.21.15.172:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f27e4028840 con 0x555dd2b6afe0 2023-07-14T18:13:28.525 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:28.477+0000 7f27dcff9700 1 -- 172.21.15.163:0/2088226906 <== mon.2 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27e401c660 con 0x555dd2b6afe0 2023-07-14T18:13:28.525 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:28.478+0000 7f27fc286b80 1 -- 172.21.15.163:0/2088226906 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x555dd2b6afe0 msgr2=0x555dd2b728c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:13:28.526 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:28.478+0000 7f27fc286b80 1 --2- 172.21.15.163:0/2088226906 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x555dd2b6afe0 0x555dd2b728c0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x555dd2b8b820 tx=0x7f27e4014000 comp rx=0 tx=0).stop 2023-07-14T18:13:28.526 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:28.478+0000 7f27fc286b80 1 -- 172.21.15.163:0/2088226906 shutdown_connections 2023-07-14T18:13:28.526 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:28.478+0000 7f27fc286b80 1 --2- 172.21.15.163:0/2088226906 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x555dd2b6c530 0x555dd2b72e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:13:28.526 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:28.478+0000 7f27fc286b80 1 --2- 172.21.15.163:0/2088226906 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x555dd2b6afe0 0x555dd2b728c0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:13:28.526 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:28.478+0000 7f27fc286b80 1 --2- 172.21.15.163:0/2088226906 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x555dd2b6b930 0x555dd2b7be90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:13:28.526 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:28.478+0000 7f27fc286b80 1 -- 172.21.15.163:0/2088226906 >> 172.21.15.163:0/2088226906 conn(0x555dd2b60700 msgr2=0x555dd2b74910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:13:28.526 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:28.478+0000 7f27fc286b80 1 -- 172.21.15.163:0/2088226906 shutdown_connections 2023-07-14T18:13:28.527 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:28.478+0000 7f27fc286b80 1 -- 172.21.15.163:0/2088226906 wait complete. 2023-07-14T18:13:28.527 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:28.478+0000 7f27fc286b80 1 -- start start 2023-07-14T18:13:28.527 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:28.478+0000 7f27fc286b80 1 Processor -- start 2023-07-14T18:13:28.527 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:28.478+0000 7f27fc286b80 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x555dd2b6afe0 0x555dd2b792f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:13:28.527 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:28.478+0000 7f27fc286b80 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x555dd2b6b930 0x555dd2b79830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:13:28.527 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:28.478+0000 7f27fc286b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x555dd2b6c530 0x555dd2b7a840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:13:28.528 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:28.478+0000 7f27fc286b80 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x555dd2b7ad80 con 0x555dd2b6afe0 2023-07-14T18:13:28.528 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:28.478+0000 7f27fc286b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x555dd2b7aef0 con 0x555dd2b6c530 2023-07-14T18:13:28.528 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:28.478+0000 7f27fc286b80 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x555dd2b7b0b0 con 0x555dd2b6b930 2023-07-14T18:13:28.528 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:28.478+0000 7f27fc286b80 10 client.0 _ll_register_callbacks cb 0x7f27e0009b80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T18:13:28.528 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:28.479+0000 7f27ede8a700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x555dd2b6afe0 0x555dd2b792f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:13:28.528 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:28.479+0000 7f27ee68b700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x555dd2b6c530 0x555dd2b7a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:13:28.528 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:28.479+0000 7f27ede8a700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x555dd2b6afe0 0x555dd2b792f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:58392/0 (socket says 172.21.15.163:58392) 2023-07-14T18:13:28.529 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:28.479+0000 7f27ee68b700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x555dd2b6c530 0x555dd2b7a840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.163:59078/0 (socket says 172.21.15.163:59078) 2023-07-14T18:13:28.529 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:28.479+0000 7f27ede8a700 1 -- 172.21.15.163:0/2297830952 learned_addr learned my addr 172.21.15.163:0/2297830952 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:13:28.529 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:28.479+0000 7f27ed689700 1 --2- 172.21.15.163:0/2297830952 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x555dd2b6b930 0x555dd2b79830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:13:28.529 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:28.479+0000 7f27ede8a700 1 -- 172.21.15.163:0/2297830952 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x555dd2b6b930 msgr2=0x555dd2b79830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:13:28.529 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:28.479+0000 7f27ede8a700 1 --2- 172.21.15.163:0/2297830952 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x555dd2b6b930 0x555dd2b79830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:13:28.529 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:28.479+0000 7f27ede8a700 1 -- 172.21.15.163:0/2297830952 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x555dd2b6c530 msgr2=0x555dd2b7a840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:13:28.529 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:28.479+0000 7f27ede8a700 1 --2- 172.21.15.163:0/2297830952 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x555dd2b6c530 0x555dd2b7a840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:13:28.530 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:28.479+0000 7f27ede8a700 1 -- 172.21.15.163:0/2297830952 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27e81a00e0 con 0x555dd2b6afe0 2023-07-14T18:13:28.530 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:28.479+0000 7f27ede8a700 1 --2- 172.21.15.163:0/2297830952 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x555dd2b6afe0 0x555dd2b792f0 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f27e4005820 tx=0x7f27e401da50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=77054a4c9c8e61f1 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:13:28.530 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:28.479+0000 7f27d17fa700 10 client.0 ms_handle_connect on v2:172.21.15.163:3300/0 2023-07-14T18:13:28.530 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:28.479+0000 7f27d17fa700 1 -- 172.21.15.163:0/2297830952 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27e4023040 con 0x555dd2b6afe0 2023-07-14T18:13:28.530 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:28.479+0000 7f27d17fa700 1 -- 172.21.15.163:0/2297830952 <== mon.0 v2:172.21.15.163:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 9049+0+0 (secure 0 0 0) 0x7f27e4028bc0 con 0x555dd2b6afe0 2023-07-14T18:13:28.531 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:28.479+0000 7f27fc286b80 1 -- 172.21.15.163:0/2297830952 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x555dd2a15570 con 0x555dd2b6afe0 2023-07-14T18:13:28.531 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:28.480+0000 7f27d17fa700 1 -- 172.21.15.163:0/2297830952 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7f27e401dd30 con 0x555dd2b6afe0 2023-07-14T18:13:28.531 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:28.480+0000 7f27fc286b80 10 client.15825 fetch_fsmap learned FSMap version 29 2023-07-14T18:13:28.531 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:28.480+0000 7f27fc286b80 1 -- 172.21.15.163:0/2297830952 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) v3 -- 0x7f27e4017070 con 0x555dd2b6afe0 2023-07-14T18:13:28.531 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:28.480+0000 7f27d17fa700 1 -- 172.21.15.163:0/2297830952 <== mon.0 v2:172.21.15.163:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x555dd2a15570 con 0x555dd2b6afe0 2023-07-14T18:13:28.531 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:28.480+0000 7f27d17fa700 1 -- 172.21.15.163:0/2297830952 <== mon.0 v2:172.21.15.163:3300/0 5 ==== fsmap(e 29) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f27e4004cb0 con 0x555dd2b6afe0 2023-07-14T18:13:28.532 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:28.480+0000 7f27fc286b80 10 client.15825 fetch_fsmap finished waiting for FSMap version 29 2023-07-14T18:13:28.532 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:28.480+0000 7f27fc286b80 10 client.15825 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-07-14T18:13:28.532 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:28.480+0000 7f27fc286b80 20 client.15825 populate_metadata read hostname 'smithi163' 2023-07-14T18:13:28.532 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:28.480+0000 7f27fc286b80 1 --2- 172.21.15.163:0/2297830952 >> [v2:172.21.15.172:6838/3850440096,v1:172.21.15.172:6839/3850440096] conn(0x555dd2bdf0b0 0x555dd2be14c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:13:28.532 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:28.480+0000 7f27fc286b80 4 client.15825 mds_command: new command op to 24518 tid=0[{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2023-07-14T18:13:28.532 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:28.480+0000 7f27fc286b80 1 -- 172.21.15.163:0/2297830952 --> [v2:172.21.15.172:6838/3850440096,v1:172.21.15.172:6839/3850440096] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) v1 -- 0x555dd2a770d0 con 0x555dd2bdf0b0 2023-07-14T18:13:28.532 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:28.480+0000 7f27ed689700 1 --2- 172.21.15.163:0/2297830952 >> [v2:172.21.15.172:6838/3850440096,v1:172.21.15.172:6839/3850440096] conn(0x555dd2bdf0b0 0x555dd2be14c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:13:28.533 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:28.481+0000 7f27d17fa700 10 client.15825 ms_handle_connect on v2:172.21.15.172:6838/3850440096 2023-07-14T18:13:28.533 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:28.481+0000 7f27ed689700 1 --2- 172.21.15.163:0/2297830952 >> [v2:172.21.15.172:6838/3850440096,v1:172.21.15.172:6839/3850440096] conn(0x555dd2bdf0b0 0x555dd2be14c0 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d76a41a124500aa3 server_cookie=18aa9132699b2b0d in_seq=0 out_seq=0 2023-07-14T18:13:28.533 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:28.482+0000 7f27d17fa700 1 -- 172.21.15.163:0/2297830952 <== mds.0 v2:172.21.15.172:6838/3850440096 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x555dd2a770d0 con 0x555dd2bdf0b0 2023-07-14T18:13:28.533 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:28.482+0000 7f27d17fa700 10 client.15825 handle_command_reply: tid=0 2023-07-14T18:13:28.533 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:28.482+0000 7f27fc286b80 1 client.15825 shutdown 2023-07-14T18:13:28.533 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:28.482+0000 7f27fc286b80 1 -- 172.21.15.163:0/2297830952 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x555dd2b6afe0 msgr2=0x555dd2b792f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:13:28.534 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:28.482+0000 7f27fc286b80 1 --2- 172.21.15.163:0/2297830952 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x555dd2b6afe0 0x555dd2b792f0 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f27e4005820 tx=0x7f27e401da50 comp rx=0 tx=0).stop 2023-07-14T18:13:28.534 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:28.482+0000 7f27fc286b80 1 -- 172.21.15.163:0/2297830952 shutdown_connections 2023-07-14T18:13:28.534 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:28.482+0000 7f27fc286b80 1 --2- 172.21.15.163:0/2297830952 >> [v2:172.21.15.172:6838/3850440096,v1:172.21.15.172:6839/3850440096] conn(0x555dd2bdf0b0 0x555dd2be14c0 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:13:28.534 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:28.482+0000 7f27fc286b80 1 --2- 172.21.15.163:0/2297830952 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x555dd2b6c530 0x555dd2b7a840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:13:28.534 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:28.482+0000 7f27fc286b80 1 --2- 172.21.15.163:0/2297830952 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x555dd2b6afe0 0x555dd2b792f0 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:13:28.534 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:28.482+0000 7f27fc286b80 1 --2- 172.21.15.163:0/2297830952 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x555dd2b6b930 0x555dd2b79830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:13:28.534 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:28.482+0000 7f27fc286b80 1 -- 172.21.15.163:0/2297830952 >> 172.21.15.163:0/2297830952 conn(0x555dd2b60700 msgr2=0x555dd2b728c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:13:28.535 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:28.482+0000 7f27d17fa700 0 client.15825 ms_handle_reset on v2:172.21.15.172:6838/3850440096 2023-07-14T18:13:28.535 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:28.483+0000 7f27fc286b80 1 -- 172.21.15.163:0/2297830952 shutdown_connections 2023-07-14T18:13:28.535 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:28.483+0000 7f27fc286b80 1 -- 172.21.15.163:0/2297830952 wait complete. 2023-07-14T18:13:28.535 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:28.483+0000 7f27fc286b80 20 client.15825 trim_cache size 0 max 16384 2023-07-14T18:13:28.535 INFO:teuthology.orchestra.run.smithi163.stdout:{ 2023-07-14T18:13:28.536 INFO:teuthology.orchestra.run.smithi163.stdout: "return_code": 0, 2023-07-14T18:13:28.536 INFO:teuthology.orchestra.run.smithi163.stdout: "scrub_tag": "8cc23d4c-3a8f-404f-957e-66500ca5f23e", 2023-07-14T18:13:28.536 INFO:teuthology.orchestra.run.smithi163.stdout: "mode": "asynchronous" 2023-07-14T18:13:28.536 INFO:teuthology.orchestra.run.smithi163.stdout:} 2023-07-14T18:13:28.537 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:28.483+0000 7f27f00ee700 1 -- 172.21.15.163:0/295295778 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f27d40a11d0 msgr2=0x7f27d40a3680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:13:28.538 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:28.483+0000 7f27f00ee700 1 --2- 172.21.15.163:0/295295778 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f27d40a11d0 0x7f27d40a3680 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f27e8067500 tx=0x7f27e4009260 comp rx=0 tx=0).stop 2023-07-14T18:13:28.538 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:28.483+0000 7f27f00ee700 1 -- 172.21.15.163:0/295295778 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f27e81018c0 msgr2=0x7f27e80ff420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:13:28.538 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:28.483+0000 7f27f00ee700 1 --2- 172.21.15.163:0/295295778 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f27e81018c0 0x7f27e80ff420 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f27e0009fd0 tx=0x7f27e000ba50 comp rx=0 tx=0).stop 2023-07-14T18:13:28.539 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:28.483+0000 7f27f00ee700 1 -- 172.21.15.163:0/295295778 shutdown_connections 2023-07-14T18:13:28.539 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:28.483+0000 7f27f00ee700 1 --2- 172.21.15.163:0/295295778 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f27d40a11d0 0x7f27d40a3680 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:13:28.539 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:28.483+0000 7f27f00ee700 1 --2- 172.21.15.163:0/295295778 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f27e80fdec0 0x7f27e81008a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:13:28.540 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:28.483+0000 7f27f00ee700 1 --2- 172.21.15.163:0/295295778 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f27e81018c0 0x7f27e80ff420 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:13:28.540 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:28.483+0000 7f27f00ee700 1 --2- 172.21.15.163:0/295295778 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f27e8100f30 0x7f27e80feee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:13:28.540 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:28.483+0000 7f27f00ee700 1 -- 172.21.15.163:0/295295778 >> 172.21.15.163:0/295295778 conn(0x7f27e80f98a0 msgr2=0x7f27e80fbbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:13:28.541 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:28.483+0000 7f27f00ee700 1 -- 172.21.15.163:0/295295778 shutdown_connections 2023-07-14T18:13:28.541 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:28.483+0000 7f27f00ee700 1 -- 172.21.15.163:0/295295778 wait complete. 2023-07-14T18:13:28.543 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-07-14T18:13:28.697 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:28.655+0000 7fbe9701c700 1 -- 172.21.15.163:0/4016641311 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbe90102fb0 msgr2=0x7fbe90105390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:13:28.697 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:28.655+0000 7fbe9701c700 1 --2- 172.21.15.163:0/4016641311 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbe90102fb0 0x7fbe90105390 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fbe7c0098f0 tx=0x7fbe7c009c00 comp rx=0 tx=0).stop 2023-07-14T18:13:28.697 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:28.655+0000 7fbe9701c700 1 -- 172.21.15.163:0/4016641311 shutdown_connections 2023-07-14T18:13:28.697 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:28.655+0000 7fbe9701c700 1 --2- 172.21.15.163:0/4016641311 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fbe901058d0 0x7fbe90107d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:13:28.697 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:28.655+0000 7fbe9701c700 1 --2- 172.21.15.163:0/4016641311 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbe90100690 0x7fbe90102a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:13:28.698 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:28.655+0000 7fbe9701c700 1 --2- 172.21.15.163:0/4016641311 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbe90102fb0 0x7fbe90105390 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:13:28.698 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:28.655+0000 7fbe9701c700 1 -- 172.21.15.163:0/4016641311 >> 172.21.15.163:0/4016641311 conn(0x7fbe900fa130 msgr2=0x7fbe900fc560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:13:28.698 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:28.655+0000 7fbe9701c700 1 -- 172.21.15.163:0/4016641311 shutdown_connections 2023-07-14T18:13:28.698 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:28.655+0000 7fbe9701c700 1 -- 172.21.15.163:0/4016641311 wait complete. 2023-07-14T18:13:28.700 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:28.656+0000 7fbe9701c700 1 Processor -- start 2023-07-14T18:13:28.700 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:28.656+0000 7fbe9701c700 1 -- start start 2023-07-14T18:13:28.700 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:28.656+0000 7fbe9701c700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbe90100690 0x7fbe901958c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:13:28.701 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:28.656+0000 7fbe9701c700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbe90102fb0 0x7fbe90195e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:13:28.701 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:28.656+0000 7fbe9701c700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fbe901058d0 0x7fbe9019ce70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:13:28.701 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:28.656+0000 7fbe9701c700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe9019d440 con 0x7fbe901058d0 2023-07-14T18:13:28.701 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:28.656+0000 7fbe9701c700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe9019d580 con 0x7fbe90102fb0 2023-07-14T18:13:28.701 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:28.656+0000 7fbe9701c700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe9019d710 con 0x7fbe90100690 2023-07-14T18:13:28.701 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:28.657+0000 7fbe94db8700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbe90100690 0x7fbe901958c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:13:28.702 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:28.657+0000 7fbe955b9700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fbe901058d0 0x7fbe9019ce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:13:28.702 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:28.657+0000 7fbe94db8700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbe90100690 0x7fbe901958c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.163:40228/0 (socket says 172.21.15.163:40228) 2023-07-14T18:13:28.702 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:28.657+0000 7fbe94db8700 1 -- 172.21.15.163:0/3033938757 learned_addr learned my addr 172.21.15.163:0/3033938757 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:13:28.702 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:28.657+0000 7fbe8ffff700 1 --2- 172.21.15.163:0/3033938757 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbe90102fb0 0x7fbe90195e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:13:28.702 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:28.657+0000 7fbe94db8700 1 -- 172.21.15.163:0/3033938757 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbe90102fb0 msgr2=0x7fbe90195e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:13:28.702 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:28.657+0000 7fbe94db8700 1 --2- 172.21.15.163:0/3033938757 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbe90102fb0 0x7fbe90195e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:13:28.702 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:28.657+0000 7fbe94db8700 1 -- 172.21.15.163:0/3033938757 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fbe901058d0 msgr2=0x7fbe9019ce70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:13:28.703 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:28.657+0000 7fbe94db8700 1 --2- 172.21.15.163:0/3033938757 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fbe901058d0 0x7fbe9019ce70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:13:28.703 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:28.657+0000 7fbe94db8700 1 -- 172.21.15.163:0/3033938757 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe7c009520 con 0x7fbe90100690 2023-07-14T18:13:28.703 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:28.657+0000 7fbe955b9700 1 --2- 172.21.15.163:0/3033938757 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fbe901058d0 0x7fbe9019ce70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T18:13:28.703 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:28.657+0000 7fbe94db8700 1 --2- 172.21.15.163:0/3033938757 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbe90100690 0x7fbe901958c0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fbe8400e9a0 tx=0x7fbe8400ecb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:13:28.703 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:28.657+0000 7fbe8dffb700 1 -- 172.21.15.163:0/3033938757 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe84009790 con 0x7fbe90100690 2023-07-14T18:13:28.703 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:28.658+0000 7fbe9701c700 1 -- 172.21.15.163:0/3033938757 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbe900fe4e0 con 0x7fbe90100690 2023-07-14T18:13:28.703 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:28.658+0000 7fbe8dffb700 1 -- 172.21.15.163:0/3033938757 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fbe8400cc50 con 0x7fbe90100690 2023-07-14T18:13:28.704 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:28.658+0000 7fbe8dffb700 1 -- 172.21.15.163:0/3033938757 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe8401b920 con 0x7fbe90100690 2023-07-14T18:13:28.704 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:28.658+0000 7fbe9701c700 1 -- 172.21.15.163:0/3033938757 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe900fea40 con 0x7fbe90100690 2023-07-14T18:13:28.706 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:28.661+0000 7fbe8dffb700 1 -- 172.21.15.163:0/3033938757 <== mon.1 v2:172.21.15.184:3300/0 4 ==== mgrmap(e 18) v1 ==== 135716+0+0 (secure 0 0 0) 0x7fbe8400c7c0 con 0x7fbe90100690 2023-07-14T18:13:28.706 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:28.662+0000 7fbea31b4b80 1 Processor -- start 2023-07-14T18:13:28.706 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:28.662+0000 7fbe8dffb700 1 --2- 172.21.15.163:0/3033938757 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7fbe800a11d0 0x7fbe800a3680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:13:28.706 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:28.662+0000 7fbea31b4b80 1 -- start start 2023-07-14T18:13:28.706 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:28.662+0000 7fbea31b4b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5634c6c1f770 0x5634c6c1fb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:13:28.706 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:28.662+0000 7fbe8dffb700 1 -- 172.21.15.163:0/3033938757 <== mon.1 v2:172.21.15.184:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 9049+0+0 (secure 0 0 0) 0x7fbe840d0ef0 con 0x7fbe90100690 2023-07-14T18:13:28.707 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:28.662+0000 7fbea31b4b80 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5634c6c200c0 0x5634c6c206e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:13:28.707 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:28.662+0000 7fbe955b9700 1 --2- 172.21.15.163:0/3033938757 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7fbe800a11d0 0x7fbe800a3680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:13:28.707 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:28.662+0000 7fbea31b4b80 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5634c6c20cc0 0x5634c6c21130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:13:28.707 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:28.662+0000 7fbea31b4b80 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x5634c6b1bcb0 con 0x5634c6c200c0 2023-07-14T18:13:28.707 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:28.662+0000 7fbea31b4b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x5634c6b6ea40 con 0x5634c6c1f770 2023-07-14T18:13:28.707 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:28.662+0000 7fbea31b4b80 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x5634c6b67ed0 con 0x5634c6c20cc0 2023-07-14T18:13:28.707 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:28.662+0000 7fbe8ffff700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5634c6c200c0 0x5634c6c206e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:13:28.708 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:28.662+0000 7fbe8ffff700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5634c6c200c0 0x5634c6c206e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:58414/0 (socket says 172.21.15.163:58414) 2023-07-14T18:13:28.708 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:28.662+0000 7fbe8ffff700 1 -- 172.21.15.163:0/2810787353 learned_addr learned my addr 172.21.15.163:0/2810787353 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:13:28.708 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:28.662+0000 7fbe94db8700 1 --2- 172.21.15.163:0/2810787353 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5634c6c1f770 0x5634c6c1fb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:13:28.708 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:28.663+0000 7fbe955b9700 1 --2- 172.21.15.163:0/2810787353 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5634c6c20cc0 0x5634c6c21130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:13:28.708 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:28.663+0000 7fbe94db8700 1 -- 172.21.15.163:0/2810787353 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5634c6c20cc0 msgr2=0x5634c6c21130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:13:28.708 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:28.663+0000 7fbe94db8700 1 --2- 172.21.15.163:0/2810787353 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5634c6c20cc0 0x5634c6c21130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:13:28.709 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:28.663+0000 7fbe94db8700 1 -- 172.21.15.163:0/2810787353 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5634c6c200c0 msgr2=0x5634c6c206e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:13:28.709 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:28.663+0000 7fbe94db8700 1 --2- 172.21.15.163:0/2810787353 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5634c6c200c0 0x5634c6c206e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:13:28.709 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:28.663+0000 7fbe94db8700 1 -- 172.21.15.163:0/2810787353 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5634c6995de0 con 0x5634c6c1f770 2023-07-14T18:13:28.709 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:28.663+0000 7fbe955b9700 1 --2- 172.21.15.163:0/2810787353 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5634c6c20cc0 0x5634c6c21130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T18:13:28.709 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:28.663+0000 7fbe94db8700 1 --2- 172.21.15.163:0/2810787353 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5634c6c1f770 0x5634c6c1fb80 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fbe8400e970 tx=0x7fbe8409d8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d45e8bd9c4e8e8b server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:13:28.709 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:28.663+0000 7fbe955b9700 1 --2- 172.21.15.163:0/3033938757 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7fbe800a11d0 0x7fbe800a3680 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fbe88003fa0 tx=0x7fbe880099e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:13:28.710 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:28.663+0000 7fbe7affd700 1 -- 172.21.15.163:0/2810787353 <== mon.2 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe8400ca70 con 0x5634c6c1f770 2023-07-14T18:13:28.710 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:28.663+0000 7fbe7affd700 1 -- 172.21.15.163:0/2810787353 <== mon.2 v2:172.21.15.172:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fbe8409df70 con 0x5634c6c1f770 2023-07-14T18:13:28.710 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:28.663+0000 7fbe7affd700 1 -- 172.21.15.163:0/2810787353 <== mon.2 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe8409d6c0 con 0x5634c6c1f770 2023-07-14T18:13:28.710 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:28.664+0000 7fbea31b4b80 1 -- 172.21.15.163:0/2810787353 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5634c6c1f770 msgr2=0x5634c6c1fb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:13:28.710 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:28.664+0000 7fbea31b4b80 1 --2- 172.21.15.163:0/2810787353 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5634c6c1f770 0x5634c6c1fb80 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fbe8400e970 tx=0x7fbe8409d8d0 comp rx=0 tx=0).stop 2023-07-14T18:13:28.711 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:28.664+0000 7fbea31b4b80 1 -- 172.21.15.163:0/2810787353 shutdown_connections 2023-07-14T18:13:28.711 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:28.664+0000 7fbea31b4b80 1 --2- 172.21.15.163:0/2810787353 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5634c6c20cc0 0x5634c6c21130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:13:28.711 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:28.664+0000 7fbea31b4b80 1 --2- 172.21.15.163:0/2810787353 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5634c6c1f770 0x5634c6c1fb80 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:13:28.711 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:28.664+0000 7fbea31b4b80 1 --2- 172.21.15.163:0/2810787353 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5634c6c200c0 0x5634c6c206e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:13:28.711 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:28.664+0000 7fbea31b4b80 1 -- 172.21.15.163:0/2810787353 >> 172.21.15.163:0/2810787353 conn(0x5634c6c0c680 msgr2=0x5634c6c119d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:13:28.711 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:28.664+0000 7fbea31b4b80 1 -- 172.21.15.163:0/2810787353 shutdown_connections 2023-07-14T18:13:28.711 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:28.664+0000 7fbea31b4b80 1 -- 172.21.15.163:0/2810787353 wait complete. 2023-07-14T18:13:28.712 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:28.664+0000 7fbea31b4b80 1 -- start start 2023-07-14T18:13:28.712 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:28.665+0000 7fbea31b4b80 1 Processor -- start 2023-07-14T18:13:28.715 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:28.665+0000 7fbea31b4b80 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5634c6c1f770 0x5634c6c1e510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:13:28.715 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:28.665+0000 7fbea31b4b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5634c6c200c0 0x5634c6c1ea50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:13:28.715 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:28.665+0000 7fbea31b4b80 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5634c6c20cc0 0x5634c6c27e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:13:28.715 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:28.665+0000 7fbea31b4b80 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x5634c6b07ac0 con 0x5634c6c1f770 2023-07-14T18:13:28.715 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:28.665+0000 7fbea31b4b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x5634c6b077c0 con 0x5634c6c200c0 2023-07-14T18:13:28.715 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:28.665+0000 7fbea31b4b80 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x5634c69eb920 con 0x5634c6c20cc0 2023-07-14T18:13:28.716 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:28.665+0000 7fbea31b4b80 10 client.0 _ll_register_callbacks cb 0x5634c6b05760 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T18:13:28.716 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:28.665+0000 7fbe94db8700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5634c6c1f770 0x5634c6c1e510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:13:28.716 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:28.665+0000 7fbe94db8700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5634c6c1f770 0x5634c6c1e510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:58420/0 (socket says 172.21.15.163:58420) 2023-07-14T18:13:28.716 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:28.665+0000 7fbe94db8700 1 -- 172.21.15.163:0/2091818631 learned_addr learned my addr 172.21.15.163:0/2091818631 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:13:28.716 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:28.665+0000 7fbe8ffff700 1 --2- 172.21.15.163:0/2091818631 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5634c6c200c0 0x5634c6c1ea50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:13:28.716 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:28.666+0000 7fbe955b9700 1 --2- 172.21.15.163:0/2091818631 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5634c6c20cc0 0x5634c6c27e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:13:28.717 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:28.666+0000 7fbe94db8700 1 -- 172.21.15.163:0/2091818631 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5634c6c20cc0 msgr2=0x5634c6c27e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:13:28.717 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:28.666+0000 7fbe94db8700 1 --2- 172.21.15.163:0/2091818631 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5634c6c20cc0 0x5634c6c27e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:13:28.717 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:28.666+0000 7fbe94db8700 1 -- 172.21.15.163:0/2091818631 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5634c6c200c0 msgr2=0x5634c6c1ea50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:13:28.717 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:28.666+0000 7fbe94db8700 1 --2- 172.21.15.163:0/2091818631 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5634c6c200c0 0x5634c6c1ea50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:13:28.717 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:28.666+0000 7fbe94db8700 1 -- 172.21.15.163:0/2091818631 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe900fea40 con 0x5634c6c1f770 2023-07-14T18:13:28.717 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:28.666+0000 7fbe955b9700 1 --2- 172.21.15.163:0/2091818631 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5634c6c20cc0 0x5634c6c27e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T18:13:28.717 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:28.666+0000 7fbe94db8700 1 --2- 172.21.15.163:0/2091818631 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5634c6c1f770 0x5634c6c1e510 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7fbe8409a9e0 tx=0x7fbe84013dd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=262ba14f5c28b849 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:13:28.718 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:28.666+0000 7fbe6ffff700 10 client.0 ms_handle_connect on v2:172.21.15.163:3300/0 2023-07-14T18:13:28.718 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:28.666+0000 7fbe6ffff700 1 -- 172.21.15.163:0/2091818631 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe840a6130 con 0x5634c6c1f770 2023-07-14T18:13:28.718 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:28.666+0000 7fbe6ffff700 1 -- 172.21.15.163:0/2091818631 <== mon.0 v2:172.21.15.163:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 9049+0+0 (secure 0 0 0) 0x7fbe840a63c0 con 0x5634c6c1f770 2023-07-14T18:13:28.718 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:28.666+0000 7fbea31b4b80 1 -- 172.21.15.163:0/2091818631 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5634c6ac14f0 con 0x5634c6c1f770 2023-07-14T18:13:28.718 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:28.666+0000 7fbe6ffff700 1 -- 172.21.15.163:0/2091818631 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7fbe840ceb20 con 0x5634c6c1f770 2023-07-14T18:13:28.718 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:28.666+0000 7fbea31b4b80 10 client.15837 fetch_fsmap learned FSMap version 29 2023-07-14T18:13:28.718 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:28.666+0000 7fbea31b4b80 1 -- 172.21.15.163:0/2091818631 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) v3 -- 0x5634c697ec60 con 0x5634c6c1f770 2023-07-14T18:13:28.718 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:28.667+0000 7fbe6ffff700 1 -- 172.21.15.163:0/2091818631 <== mon.0 v2:172.21.15.163:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fbe840cc080 con 0x5634c6c1f770 2023-07-14T18:13:28.719 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:28.667+0000 7fbe6ffff700 1 -- 172.21.15.163:0/2091818631 <== mon.0 v2:172.21.15.163:3300/0 5 ==== fsmap(e 29) v1 ==== 7470+0+0 (secure 0 0 0) 0x7fbe8409d100 con 0x5634c6c1f770 2023-07-14T18:13:28.719 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:28.667+0000 7fbea31b4b80 10 client.15837 fetch_fsmap finished waiting for FSMap version 29 2023-07-14T18:13:28.719 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:28.667+0000 7fbea31b4b80 10 client.15837 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-07-14T18:13:28.719 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:28.667+0000 7fbea31b4b80 20 client.15837 populate_metadata read hostname 'smithi163' 2023-07-14T18:13:28.719 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:28.667+0000 7fbea31b4b80 1 --2- 172.21.15.163:0/2091818631 >> [v2:172.21.15.172:6838/3850440096,v1:172.21.15.172:6839/3850440096] conn(0x5634c6c2c450 0x5634c6c2e860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:13:28.719 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:28.667+0000 7fbea31b4b80 4 client.15837 mds_command: new command op to 24518 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-14T18:13:28.719 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:28.667+0000 7fbea31b4b80 1 -- 172.21.15.163:0/2091818631 --> [v2:172.21.15.172:6838/3850440096,v1:172.21.15.172:6839/3850440096] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5634c6be5da0 con 0x5634c6c2c450 2023-07-14T18:13:28.720 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:28.667+0000 7fbe8ffff700 1 --2- 172.21.15.163:0/2091818631 >> [v2:172.21.15.172:6838/3850440096,v1:172.21.15.172:6839/3850440096] conn(0x5634c6c2c450 0x5634c6c2e860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:13:28.720 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:28.668+0000 7fbe6ffff700 10 client.15837 ms_handle_connect on v2:172.21.15.172:6838/3850440096 2023-07-14T18:13:28.720 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:28.668+0000 7fbe8ffff700 1 --2- 172.21.15.163:0/2091818631 >> [v2:172.21.15.172:6838/3850440096,v1:172.21.15.172:6839/3850440096] conn(0x5634c6c2c450 0x5634c6c2e860 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6b8d8831839c6960 server_cookie=c03baa4599641e43 in_seq=0 out_seq=0 2023-07-14T18:13:28.720 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:28.668+0000 7fbe6ffff700 1 -- 172.21.15.163:0/2091818631 <== mds.0 v2:172.21.15.172:6838/3850440096 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18017 (crc 0 0 0) 0x5634c6be5da0 con 0x5634c6c2c450 2023-07-14T18:13:28.720 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:28.668+0000 7fbe6ffff700 10 client.15837 handle_command_reply: tid=0 2023-07-14T18:13:28.720 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:28.668+0000 7fbea31b4b80 1 client.15837 shutdown 2023-07-14T18:13:28.721 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:28.668+0000 7fbea31b4b80 1 -- 172.21.15.163:0/2091818631 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5634c6c1f770 msgr2=0x5634c6c1e510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:13:28.721 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:28.668+0000 7fbea31b4b80 1 --2- 172.21.15.163:0/2091818631 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5634c6c1f770 0x5634c6c1e510 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7fbe8409a9e0 tx=0x7fbe84013dd0 comp rx=0 tx=0).stop 2023-07-14T18:13:28.721 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:28.669+0000 7fbea31b4b80 1 -- 172.21.15.163:0/2091818631 shutdown_connections 2023-07-14T18:13:28.721 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:28.669+0000 7fbea31b4b80 1 --2- 172.21.15.163:0/2091818631 >> [v2:172.21.15.172:6838/3850440096,v1:172.21.15.172:6839/3850440096] conn(0x5634c6c2c450 0x5634c6c2e860 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:13:28.722 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:28.669+0000 7fbea31b4b80 1 --2- 172.21.15.163:0/2091818631 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5634c6c20cc0 0x5634c6c27e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:13:28.722 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:28.669+0000 7fbea31b4b80 1 --2- 172.21.15.163:0/2091818631 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5634c6c1f770 0x5634c6c1e510 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:13:28.722 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:28.669+0000 7fbea31b4b80 1 --2- 172.21.15.163:0/2091818631 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5634c6c200c0 0x5634c6c1ea50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:13:28.722 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:28.669+0000 7fbea31b4b80 1 -- 172.21.15.163:0/2091818631 >> 172.21.15.163:0/2091818631 conn(0x5634c6c0c680 msgr2=0x5634c6c10650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:13:28.722 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:28.669+0000 7fbe6ffff700 0 client.15837 ms_handle_reset on v2:172.21.15.172:6838/3850440096 2023-07-14T18:13:28.722 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:28.669+0000 7fbea31b4b80 1 -- 172.21.15.163:0/2091818631 shutdown_connections 2023-07-14T18:13:28.723 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:28.669+0000 7fbea31b4b80 1 -- 172.21.15.163:0/2091818631 wait complete. 2023-07-14T18:13:28.723 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:28.669+0000 7fbea31b4b80 20 client.15837 trim_cache size 0 max 16384 2023-07-14T18:13:28.738 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:28.690+0000 7fbea31b4b80 1 Processor -- start 2023-07-14T18:13:28.738 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:28.690+0000 7fbea31b4b80 1 -- start start 2023-07-14T18:13:28.739 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:28.690+0000 7fbea31b4b80 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5634c6c1f770 0x5634c6c193e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:13:28.739 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:28.690+0000 7fbea31b4b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5634c6c200c0 0x5634c6c27e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:13:28.739 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:28.690+0000 7fbea31b4b80 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5634c6c20cc0 0x5634c6c19920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:13:28.739 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:28.690+0000 7fbea31b4b80 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x5634c6c12900 con 0x5634c6c1f770 2023-07-14T18:13:28.739 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:28.690+0000 7fbea31b4b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x5634c6c33620 con 0x5634c6c200c0 2023-07-14T18:13:28.739 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:28.690+0000 7fbea31b4b80 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x5634c6c1c680 con 0x5634c6c20cc0 2023-07-14T18:13:28.740 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:28.690+0000 7fbe94db8700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5634c6c1f770 0x5634c6c193e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:13:28.740 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:28.690+0000 7fbe94db8700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5634c6c1f770 0x5634c6c193e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:58428/0 (socket says 172.21.15.163:58428) 2023-07-14T18:13:28.740 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:28.691+0000 7fbe94db8700 1 -- 172.21.15.163:0/2826622117 learned_addr learned my addr 172.21.15.163:0/2826622117 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:13:28.740 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:28.691+0000 7fbe8ffff700 1 --2- 172.21.15.163:0/2826622117 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5634c6c200c0 0x5634c6c27e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:13:28.740 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:28.691+0000 7fbe955b9700 1 --2- 172.21.15.163:0/2826622117 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5634c6c20cc0 0x5634c6c19920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:13:28.740 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:28.691+0000 7fbe94db8700 1 -- 172.21.15.163:0/2826622117 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5634c6c20cc0 msgr2=0x5634c6c19920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:13:28.740 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:28.691+0000 7fbe94db8700 1 --2- 172.21.15.163:0/2826622117 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5634c6c20cc0 0x5634c6c19920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:13:28.741 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:28.691+0000 7fbe94db8700 1 -- 172.21.15.163:0/2826622117 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5634c6c200c0 msgr2=0x5634c6c27e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:13:28.741 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:28.691+0000 7fbe94db8700 1 --2- 172.21.15.163:0/2826622117 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5634c6c200c0 0x5634c6c27e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:13:28.741 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:28.691+0000 7fbe94db8700 1 -- 172.21.15.163:0/2826622117 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5634c69bc250 con 0x5634c6c1f770 2023-07-14T18:13:28.741 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:28.691+0000 7fbe955b9700 1 --2- 172.21.15.163:0/2826622117 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5634c6c20cc0 0x5634c6c19920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T18:13:28.741 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:28.691+0000 7fbe94db8700 1 --2- 172.21.15.163:0/2826622117 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5634c6c1f770 0x5634c6c193e0 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7fbe8400c5b0 tx=0x7fbe84013e40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9afbd12ba8d6a6f server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:13:28.741 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:28.691+0000 7fbe7b7fe700 1 -- 172.21.15.163:0/2826622117 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe8400ca70 con 0x5634c6c1f770 2023-07-14T18:13:28.741 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:28.691+0000 7fbe7b7fe700 1 -- 172.21.15.163:0/2826622117 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x5634c6ac14f0 con 0x5634c6c1f770 2023-07-14T18:13:28.742 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:28.691+0000 7fbe7b7fe700 1 -- 172.21.15.163:0/2826622117 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe840a6170 con 0x5634c6c1f770 2023-07-14T18:13:28.742 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:28.692+0000 7fbea31b4b80 1 -- 172.21.15.163:0/2826622117 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5634c6c1f770 msgr2=0x5634c6c193e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:13:28.742 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:28.692+0000 7fbea31b4b80 1 --2- 172.21.15.163:0/2826622117 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5634c6c1f770 0x5634c6c193e0 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7fbe8400c5b0 tx=0x7fbe84013e40 comp rx=0 tx=0).stop 2023-07-14T18:13:28.742 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:28.692+0000 7fbea31b4b80 1 -- 172.21.15.163:0/2826622117 shutdown_connections 2023-07-14T18:13:28.742 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:28.692+0000 7fbea31b4b80 1 --2- 172.21.15.163:0/2826622117 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5634c6c20cc0 0x5634c6c19920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:13:28.743 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:28.692+0000 7fbea31b4b80 1 --2- 172.21.15.163:0/2826622117 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5634c6c1f770 0x5634c6c193e0 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:13:28.743 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:28.692+0000 7fbea31b4b80 1 --2- 172.21.15.163:0/2826622117 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5634c6c200c0 0x5634c6c27e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:13:28.743 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:28.692+0000 7fbea31b4b80 1 -- 172.21.15.163:0/2826622117 >> 172.21.15.163:0/2826622117 conn(0x5634c6c0c680 msgr2=0x5634c6c110f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:13:28.743 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:28.692+0000 7fbea31b4b80 1 -- 172.21.15.163:0/2826622117 shutdown_connections 2023-07-14T18:13:28.743 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:28.692+0000 7fbea31b4b80 1 -- 172.21.15.163:0/2826622117 wait complete. 2023-07-14T18:13:28.743 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:28.693+0000 7fbea31b4b80 1 -- start start 2023-07-14T18:13:28.744 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:28.693+0000 7fbea31b4b80 1 Processor -- start 2023-07-14T18:13:28.744 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:28.693+0000 7fbea31b4b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5634c6c1f770 0x5634c6c27b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:13:28.744 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:28.693+0000 7fbea31b4b80 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5634c6c200c0 0x5634c6c24630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:13:28.744 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:28.693+0000 7fbea31b4b80 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5634c6c20cc0 0x5634c6c24b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:13:28.744 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:28.693+0000 7fbea31b4b80 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x5634c6c250f0 con 0x5634c6c200c0 2023-07-14T18:13:28.744 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:28.693+0000 7fbea31b4b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x5634c6c25260 con 0x5634c6c1f770 2023-07-14T18:13:28.745 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:28.693+0000 7fbea31b4b80 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x5634c6c800d0 con 0x5634c6c20cc0 2023-07-14T18:13:28.745 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:28.693+0000 7fbea31b4b80 10 client.0 _ll_register_callbacks cb 0x7fbe84005ec0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T18:13:28.745 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:28.693+0000 7fbe8ffff700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5634c6c200c0 0x5634c6c24630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:13:28.745 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:28.693+0000 7fbe8ffff700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5634c6c200c0 0x5634c6c24630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:58438/0 (socket says 172.21.15.163:58438) 2023-07-14T18:13:28.745 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:28.693+0000 7fbe8ffff700 1 -- 172.21.15.163:0/226155972 learned_addr learned my addr 172.21.15.163:0/226155972 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:13:28.745 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:28.693+0000 7fbe94db8700 1 --2- 172.21.15.163:0/226155972 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5634c6c1f770 0x5634c6c27b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:13:28.745 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:28.693+0000 7fbe955b9700 1 --2- 172.21.15.163:0/226155972 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5634c6c20cc0 0x5634c6c24b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:13:28.746 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:28.694+0000 7fbe8ffff700 1 -- 172.21.15.163:0/226155972 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5634c6c20cc0 msgr2=0x5634c6c24b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:13:28.746 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:28.694+0000 7fbe8ffff700 1 --2- 172.21.15.163:0/226155972 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5634c6c20cc0 0x5634c6c24b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:13:28.746 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:28.694+0000 7fbe8ffff700 1 -- 172.21.15.163:0/226155972 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5634c6c1f770 msgr2=0x5634c6c27b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:13:28.746 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:28.694+0000 7fbe8ffff700 1 --2- 172.21.15.163:0/226155972 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5634c6c1f770 0x5634c6c27b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:13:28.746 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:28.694+0000 7fbe8ffff700 1 -- 172.21.15.163:0/226155972 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5634c697ec60 con 0x5634c6c200c0 2023-07-14T18:13:28.746 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:28.694+0000 7fbe8ffff700 1 --2- 172.21.15.163:0/226155972 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5634c6c200c0 0x5634c6c24630 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7fbe7c0098c0 tx=0x7fbe7c009490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c7be82b039f53440 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:13:28.746 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:28.694+0000 7fbe6ffff700 10 client.0 ms_handle_connect on v2:172.21.15.163:3300/0 2023-07-14T18:13:28.747 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:28.694+0000 7fbe6ffff700 1 -- 172.21.15.163:0/226155972 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe7c01c040 con 0x5634c6c200c0 2023-07-14T18:13:28.747 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:28.694+0000 7fbe6ffff700 1 -- 172.21.15.163:0/226155972 <== mon.0 v2:172.21.15.163:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 9049+0+0 (secure 0 0 0) 0x7fbe7c0262d0 con 0x5634c6c200c0 2023-07-14T18:13:28.747 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:28.694+0000 7fbea31b4b80 1 -- 172.21.15.163:0/226155972 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fbe8409df70 con 0x5634c6c200c0 2023-07-14T18:13:28.747 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:28.694+0000 7fbe6ffff700 1 -- 172.21.15.163:0/226155972 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7fbe7c026490 con 0x5634c6c200c0 2023-07-14T18:13:28.747 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:28.694+0000 7fbea31b4b80 10 client.15843 fetch_fsmap learned FSMap version 29 2023-07-14T18:13:28.748 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:28.694+0000 7fbea31b4b80 1 -- 172.21.15.163:0/226155972 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) v3 -- 0x5634c69942b0 con 0x5634c6c200c0 2023-07-14T18:13:28.748 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:28.694+0000 7fbe6ffff700 1 -- 172.21.15.163:0/226155972 <== mon.0 v2:172.21.15.163:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fbe8409df70 con 0x5634c6c200c0 2023-07-14T18:13:28.748 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:28.695+0000 7fbe6ffff700 1 -- 172.21.15.163:0/226155972 <== mon.0 v2:172.21.15.163:3300/0 5 ==== fsmap(e 29) v1 ==== 7470+0+0 (secure 0 0 0) 0x7fbe7c015020 con 0x5634c6c200c0 2023-07-14T18:13:28.749 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:28.695+0000 7fbea31b4b80 10 client.15843 fetch_fsmap finished waiting for FSMap version 29 2023-07-14T18:13:28.749 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:28.695+0000 7fbea31b4b80 10 client.15843 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-07-14T18:13:28.749 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:28.695+0000 7fbea31b4b80 20 client.15843 populate_metadata read hostname 'smithi163' 2023-07-14T18:13:28.750 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:28.695+0000 7fbea31b4b80 1 --2- 172.21.15.163:0/226155972 >> [v2:172.21.15.172:6838/3850440096,v1:172.21.15.172:6839/3850440096] conn(0x5634c6c81a30 0x5634c6c83e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:13:28.750 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:28.695+0000 7fbea31b4b80 4 client.15843 mds_command: new command op to 24518 tid=0[{"prefix": "scrub status"}] 2023-07-14T18:13:28.750 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:28.695+0000 7fbea31b4b80 1 -- 172.21.15.163:0/226155972 --> [v2:172.21.15.172:6838/3850440096,v1:172.21.15.172:6839/3850440096] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x5634c6b60eb0 con 0x5634c6c81a30 2023-07-14T18:13:28.750 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:28.695+0000 7fbe94db8700 1 --2- 172.21.15.163:0/226155972 >> [v2:172.21.15.172:6838/3850440096,v1:172.21.15.172:6839/3850440096] conn(0x5634c6c81a30 0x5634c6c83e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:13:28.751 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:28.696+0000 7fbe6ffff700 10 client.15843 ms_handle_connect on v2:172.21.15.172:6838/3850440096 2023-07-14T18:13:28.751 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:28.696+0000 7fbe94db8700 1 --2- 172.21.15.163:0/226155972 >> [v2:172.21.15.172:6838/3850440096,v1:172.21.15.172:6839/3850440096] conn(0x5634c6c81a30 0x5634c6c83e40 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7cdedafba27c092d server_cookie=457f7fc0d53bbd07 in_seq=0 out_seq=0 2023-07-14T18:13:28.751 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:28.696+0000 7fbe6ffff700 1 -- 172.21.15.163:0/226155972 <== mds.0 v2:172.21.15.172:6838/3850440096 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x5634c6b60eb0 con 0x5634c6c81a30 2023-07-14T18:13:28.751 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:28.696+0000 7fbe6ffff700 10 client.15843 handle_command_reply: tid=0 2023-07-14T18:13:28.751 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:28.696+0000 7fbea31b4b80 1 client.15843 shutdown 2023-07-14T18:13:28.751 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:28.696+0000 7fbea31b4b80 1 -- 172.21.15.163:0/226155972 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5634c6c200c0 msgr2=0x5634c6c24630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:13:28.751 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:28.696+0000 7fbea31b4b80 1 --2- 172.21.15.163:0/226155972 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5634c6c200c0 0x5634c6c24630 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7fbe7c0098c0 tx=0x7fbe7c009490 comp rx=0 tx=0).stop 2023-07-14T18:13:28.752 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:28.696+0000 7fbea31b4b80 1 -- 172.21.15.163:0/226155972 shutdown_connections 2023-07-14T18:13:28.752 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:28.696+0000 7fbea31b4b80 1 --2- 172.21.15.163:0/226155972 >> [v2:172.21.15.172:6838/3850440096,v1:172.21.15.172:6839/3850440096] conn(0x5634c6c81a30 0x5634c6c83e40 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:13:28.752 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:28.696+0000 7fbea31b4b80 1 --2- 172.21.15.163:0/226155972 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5634c6c20cc0 0x5634c6c24b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:13:28.752 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:28.696+0000 7fbe6ffff700 0 client.15843 ms_handle_reset on v2:172.21.15.172:6838/3850440096 2023-07-14T18:13:28.752 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:28.696+0000 7fbea31b4b80 1 --2- 172.21.15.163:0/226155972 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5634c6c1f770 0x5634c6c27b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:13:28.753 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:28.696+0000 7fbea31b4b80 1 --2- 172.21.15.163:0/226155972 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5634c6c200c0 0x5634c6c24630 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:13:28.753 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:28.696+0000 7fbea31b4b80 1 -- 172.21.15.163:0/226155972 >> 172.21.15.163:0/226155972 conn(0x5634c6c0c680 msgr2=0x5634c6c193e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:13:28.753 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:28.696+0000 7fbea31b4b80 1 -- 172.21.15.163:0/226155972 shutdown_connections 2023-07-14T18:13:28.753 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:28.696+0000 7fbea31b4b80 1 -- 172.21.15.163:0/226155972 wait complete. 2023-07-14T18:13:28.754 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:28.696+0000 7fbea31b4b80 20 client.15843 trim_cache size 0 max 16384 2023-07-14T18:13:28.754 INFO:teuthology.orchestra.run.smithi163.stdout:{ 2023-07-14T18:13:28.754 INFO:teuthology.orchestra.run.smithi163.stdout: "status": "no active scrubs running", 2023-07-14T18:13:28.754 INFO:teuthology.orchestra.run.smithi163.stdout: "scrubs": {} 2023-07-14T18:13:28.755 INFO:teuthology.orchestra.run.smithi163.stdout:} 2023-07-14T18:13:28.756 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:28.697+0000 7fbe9701c700 1 -- 172.21.15.163:0/3033938757 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7fbe800a11d0 msgr2=0x7fbe800a3680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:13:28.756 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:28.697+0000 7fbe9701c700 1 --2- 172.21.15.163:0/3033938757 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7fbe800a11d0 0x7fbe800a3680 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fbe88003fa0 tx=0x7fbe880099e0 comp rx=0 tx=0).stop 2023-07-14T18:13:28.756 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:28.697+0000 7fbe9701c700 1 -- 172.21.15.163:0/3033938757 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbe90100690 msgr2=0x7fbe901958c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:13:28.756 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:28.697+0000 7fbe9701c700 1 --2- 172.21.15.163:0/3033938757 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbe90100690 0x7fbe901958c0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fbe8400e9a0 tx=0x7fbe8400ecb0 comp rx=0 tx=0).stop 2023-07-14T18:13:28.756 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:28.697+0000 7fbe9701c700 1 -- 172.21.15.163:0/3033938757 shutdown_connections 2023-07-14T18:13:28.757 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:28.697+0000 7fbe9701c700 1 --2- 172.21.15.163:0/3033938757 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7fbe800a11d0 0x7fbe800a3680 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:13:28.757 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:28.697+0000 7fbe9701c700 1 --2- 172.21.15.163:0/3033938757 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbe90100690 0x7fbe901958c0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:13:28.757 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:28.697+0000 7fbe9701c700 1 --2- 172.21.15.163:0/3033938757 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fbe901058d0 0x7fbe9019ce70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:13:28.757 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:28.697+0000 7fbe9701c700 1 --2- 172.21.15.163:0/3033938757 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbe90102fb0 0x7fbe90195e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:13:28.757 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:28.697+0000 7fbe9701c700 1 -- 172.21.15.163:0/3033938757 >> 172.21.15.163:0/3033938757 conn(0x7fbe900fa130 msgr2=0x7fbe901012f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:13:28.757 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:28.697+0000 7fbe9701c700 1 -- 172.21.15.163:0/3033938757 shutdown_connections 2023-07-14T18:13:28.757 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:28.697+0000 7fbe9701c700 1 -- 172.21.15.163:0/3033938757 wait complete. 2023-07-14T18:13:28.758 INFO:tasks.cephfs.filesystem:all active scrubs completed 2023-07-14T18:13:28.758 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-14T18:13:28.909 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:28.868+0000 7f11ee27f700 1 -- 172.21.15.163:0/3626480647 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f11e80ff020 msgr2=0x7f11e80ff430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:13:28.909 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:28.868+0000 7f11ee27f700 1 --2- 172.21.15.163:0/3626480647 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f11e80ff020 0x7f11e80ff430 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f11d8009990 tx=0x7f11d8009ca0 comp rx=0 tx=0).stop 2023-07-14T18:13:28.910 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:28.868+0000 7f11ee27f700 1 -- 172.21.15.163:0/3626480647 shutdown_connections 2023-07-14T18:13:28.910 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:28.868+0000 7f11ee27f700 1 --2- 172.21.15.163:0/3626480647 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f11e81006e0 0x7f11e8106f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:13:28.910 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:28.868+0000 7f11ee27f700 1 --2- 172.21.15.163:0/3626480647 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f11e80ff020 0x7f11e80ff430 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:13:28.910 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:28.868+0000 7f11ee27f700 1 --2- 172.21.15.163:0/3626480647 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f11e80ffd30 0x7f11e81001a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:13:28.910 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:28.868+0000 7f11ee27f700 1 -- 172.21.15.163:0/3626480647 >> 172.21.15.163:0/3626480647 conn(0x7f11e80f98a0 msgr2=0x7f11e80fbcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:13:28.910 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:28.868+0000 7f11ee27f700 1 -- 172.21.15.163:0/3626480647 shutdown_connections 2023-07-14T18:13:28.910 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:28.868+0000 7f11ee27f700 1 -- 172.21.15.163:0/3626480647 wait complete. 2023-07-14T18:13:28.912 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:28.868+0000 7f11ee27f700 1 Processor -- start 2023-07-14T18:13:28.912 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:28.868+0000 7f11ee27f700 1 -- start start 2023-07-14T18:13:28.912 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:28.869+0000 7f11ee27f700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f11e80ff020 0x7f11e80fe700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:13:28.912 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:28.869+0000 7f11ee27f700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f11e80ffd30 0x7f11e819a580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:13:28.913 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:28.869+0000 7f11ee27f700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f11e81006e0 0x7f11e819cbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:13:28.913 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:28.869+0000 7f11ee27f700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11e819d3a0 con 0x7f11e80ffd30 2023-07-14T18:13:28.913 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:28.869+0000 7f11ee27f700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11e819d510 con 0x7f11e80ff020 2023-07-14T18:13:28.913 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:28.869+0000 7f11ee27f700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11e819d6d0 con 0x7f11e81006e0 2023-07-14T18:13:28.913 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:28.869+0000 7f11e77fe700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f11e80ffd30 0x7f11e819a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:13:28.913 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:28.869+0000 7f11e77fe700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f11e80ffd30 0x7f11e819a580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:58448/0 (socket says 172.21.15.163:58448) 2023-07-14T18:13:28.913 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:28.869+0000 7f11e77fe700 1 -- 172.21.15.163:0/3368860996 learned_addr learned my addr 172.21.15.163:0/3368860996 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:13:28.914 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:28.869+0000 7f11e7fff700 1 --2- 172.21.15.163:0/3368860996 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f11e80ff020 0x7f11e80fe700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:13:28.914 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:28.869+0000 7f11ec81c700 1 --2- 172.21.15.163:0/3368860996 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f11e81006e0 0x7f11e819cbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:13:28.914 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:28.869+0000 7f11e77fe700 1 -- 172.21.15.163:0/3368860996 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f11e81006e0 msgr2=0x7f11e819cbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:13:28.914 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:28.869+0000 7f11e77fe700 1 --2- 172.21.15.163:0/3368860996 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f11e81006e0 0x7f11e819cbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:13:28.914 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:28.869+0000 7f11e77fe700 1 -- 172.21.15.163:0/3368860996 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f11e80ff020 msgr2=0x7f11e80fe700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:13:28.914 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:28.869+0000 7f11e77fe700 1 --2- 172.21.15.163:0/3368860996 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f11e80ff020 0x7f11e80fe700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:13:28.914 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:28.869+0000 7f11e77fe700 1 -- 172.21.15.163:0/3368860996 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11dc009520 con 0x7f11e80ffd30 2023-07-14T18:13:28.914 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:28.869+0000 7f11e7fff700 1 --2- 172.21.15.163:0/3368860996 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f11e80ff020 0x7f11e80fe700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T18:13:28.915 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:28.870+0000 7f11e77fe700 1 --2- 172.21.15.163:0/3368860996 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f11e80ffd30 0x7f11e819a580 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f11dc00ea50 tx=0x7f11dc00ee10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:13:28.915 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:28.870+0000 7f11e57fa700 1 -- 172.21.15.163:0/3368860996 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11dc00cc90 con 0x7f11e80ffd30 2023-07-14T18:13:28.915 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:28.870+0000 7f11e57fa700 1 -- 172.21.15.163:0/3368860996 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f11dc00cdf0 con 0x7f11e80ffd30 2023-07-14T18:13:28.915 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:28.870+0000 7f11e57fa700 1 -- 172.21.15.163:0/3368860996 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11dc018680 con 0x7f11e80ffd30 2023-07-14T18:13:28.915 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:28.870+0000 7f11ee27f700 1 -- 172.21.15.163:0/3368860996 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f11d80095f0 con 0x7f11e80ffd30 2023-07-14T18:13:28.915 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:28.870+0000 7f11ee27f700 1 -- 172.21.15.163:0/3368860996 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11e8194730 con 0x7f11e80ffd30 2023-07-14T18:13:28.915 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:28.871+0000 7f11ee27f700 1 -- 172.21.15.163:0/3368860996 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f11e810a190 con 0x7f11e80ffd30 2023-07-14T18:13:28.916 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:28.873+0000 7f11e57fa700 1 -- 172.21.15.163:0/3368860996 <== mon.0 v2:172.21.15.163:3300/0 4 ==== mgrmap(e 18) v1 ==== 135716+0+0 (secure 0 0 0) 0x7f11dc010430 con 0x7f11e80ffd30 2023-07-14T18:13:28.916 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:28.874+0000 7f11e57fa700 1 --2- 172.21.15.163:0/3368860996 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f11d00a1220 0x7f11d00a36d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:13:28.916 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:28.874+0000 7f11e7fff700 1 --2- 172.21.15.163:0/3368860996 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f11d00a1220 0x7f11d00a36d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:13:28.917 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:28.874+0000 7f11e57fa700 1 -- 172.21.15.163:0/3368860996 <== mon.0 v2:172.21.15.163:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 9049+0+0 (secure 0 0 0) 0x7f11dc014070 con 0x7f11e80ffd30 2023-07-14T18:13:28.917 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:28.874+0000 7f11e7fff700 1 --2- 172.21.15.163:0/3368860996 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f11d00a1220 0x7f11d00a36d0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f11d8005910 tx=0x7f11d800b280 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:13:28.918 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:28.877+0000 7f11e57fa700 1 -- 172.21.15.163:0/3368860996 <== mon.0 v2:172.21.15.163:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178025 (secure 0 0 0) 0x7f11dc096b50 con 0x7f11e80ffd30 2023-07-14T18:13:29.176 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:13:28 smithi184 ceph-mon[98481]: scrub queued for path: / 2023-07-14T18:13:29.176 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:13:28 smithi184 ceph-mon[98481]: scrub summary: idle+waiting paths [/] 2023-07-14T18:13:29.176 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:13:28 smithi184 ceph-mon[98481]: scrub summary: active paths [/] 2023-07-14T18:13:29.177 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:13:28 smithi184 ceph-mon[98481]: scrub summary: idle+waiting paths [/] 2023-07-14T18:13:29.177 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:13:28 smithi184 ceph-mon[98481]: scrub summary: idle 2023-07-14T18:13:29.215 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.174+0000 7f11ee27f700 1 -- 172.21.15.163:0/3368860996 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f11e8194350 con 0x7f11e80ffd30 2023-07-14T18:13:29.215 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.175+0000 7f11e57fa700 1 -- 172.21.15.163:0/3368860996 <== mon.0 v2:172.21.15.163:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) v1 ==== 94+0+10901 (secure 0 0 0) 0x7f11dc09a170 con 0x7f11e80ffd30 2023-07-14T18:13:29.216 INFO:teuthology.orchestra.run.smithi163.stdout: 2023-07-14T18:13:29.216 INFO:teuthology.orchestra.run.smithi163.stdout:{"epoch":29,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14562,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.163:6835/1058662632","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6834","nonce":1058662632},{"type":"v1","addr":"172.21.15.163:6835","nonce":1058662632}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":14568,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.163:6837/1107244425","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6836","nonce":1107244425},{"type":"v1","addr":"172.21.15.163:6837","nonce":1107244425}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":29,"flags":178,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"balance_automate":true},"ever_allowed_features":160,"explicitly_allowed_features":160,"created":"2023-07-14T18:11:09.109693+0000","modified":"2023-07-14T18:12:47.779723+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24518,"mds_1":24493,"mds_2":24479,"mds_3":24478,"mds_4":14652},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14640":{"gid":14640,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.163:6839/1337572937","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6838","nonce":1337572937},{"type":"v1","addr":"172.21.15.163:6839","nonce":1337572937}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_14652":{"gid":14652,"name":"a","rank":4,"incarnation":26,"state":"up:active","state_seq":9,"addr":"172.21.15.163:6841/1032082642","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6840","nonce":1032082642},{"type":"v1","addr":"172.21.15.163:6841","nonce":1032082642}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24421":{"gid":24421,"name":"l","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.184:6833/797722972","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6832","nonce":797722972},{"type":"v1","addr":"172.21.15.184:6833","nonce":797722972}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24431":{"gid":24431,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6833/1075696311","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":1075696311},{"type":"v1","addr":"172.21.15.172:6833","nonce":1075696311}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24458":{"gid":24458,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6835/1158120127","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":1158120127},{"type":"v1","addr":"172.21.15.172:6835","nonce":1158120127}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24466":{"gid":24466,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.184:6835/460134263","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6834","nonce":460134263},{"type":"v1","addr":"172.21.15.184:6835","nonce":460134263}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24478":{"gid":24478,"name":"c","rank":3,"incarnation":24,"state":"up:active","state_seq":11,"addr":"172.21.15.184:6837/3389277679","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6836","nonce":3389277679},{"type":"v1","addr":"172.21.15.184:6837","nonce":3389277679}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24479":{"gid":24479,"name":"h","rank":2,"incarnation":22,"state":"up:active","state_seq":10,"addr":"172.21.15.172:6837/3783835012","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":3783835012},{"type":"v1","addr":"172.21.15.172:6837","nonce":3783835012}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24493":{"gid":24493,"name":"i","rank":1,"incarnation":20,"state":"up:active","state_seq":9,"addr":"172.21.15.184:6839/2819059257","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6838","nonce":2819059257},{"type":"v1","addr":"172.21.15.184:6839","nonce":2819059257}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24518":{"gid":24518,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.172:6839/3850440096","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6838","nonce":3850440096},{"type":"v1","addr":"172.21.15.172:6839","nonce":3850440096}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-07-14T18:13:29.218 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:13:28 smithi163 ceph-mon[96576]: scrub queued for path: / 2023-07-14T18:13:29.218 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:13:28 smithi163 ceph-mon[96576]: scrub summary: idle+waiting paths [/] 2023-07-14T18:13:29.219 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:13:28 smithi163 ceph-mon[96576]: scrub summary: active paths [/] 2023-07-14T18:13:29.219 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:13:28 smithi163 ceph-mon[96576]: scrub summary: idle+waiting paths [/] 2023-07-14T18:13:29.219 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:13:28 smithi163 ceph-mon[96576]: scrub summary: idle 2023-07-14T18:13:29.220 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.178+0000 7f11ee27f700 1 -- 172.21.15.163:0/3368860996 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f11d00a1220 msgr2=0x7f11d00a36d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:13:29.220 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.178+0000 7f11ee27f700 1 --2- 172.21.15.163:0/3368860996 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f11d00a1220 0x7f11d00a36d0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f11d8005910 tx=0x7f11d800b280 comp rx=0 tx=0).stop 2023-07-14T18:13:29.220 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.178+0000 7f11ee27f700 1 -- 172.21.15.163:0/3368860996 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f11e80ffd30 msgr2=0x7f11e819a580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:13:29.220 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.178+0000 7f11ee27f700 1 --2- 172.21.15.163:0/3368860996 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f11e80ffd30 0x7f11e819a580 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f11dc00ea50 tx=0x7f11dc00ee10 comp rx=0 tx=0).stop 2023-07-14T18:13:29.220 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.178+0000 7f11ee27f700 1 -- 172.21.15.163:0/3368860996 shutdown_connections 2023-07-14T18:13:29.221 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.178+0000 7f11ee27f700 1 --2- 172.21.15.163:0/3368860996 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f11d00a1220 0x7f11d00a36d0 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:13:29.221 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.178+0000 7f11ee27f700 1 --2- 172.21.15.163:0/3368860996 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f11e81006e0 0x7f11e819cbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:13:29.221 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.178+0000 7f11ee27f700 1 --2- 172.21.15.163:0/3368860996 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f11e80ff020 0x7f11e80fe700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:13:29.221 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.178+0000 7f11ee27f700 1 --2- 172.21.15.163:0/3368860996 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f11e80ffd30 0x7f11e819a580 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:13:29.221 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.178+0000 7f11ee27f700 1 -- 172.21.15.163:0/3368860996 >> 172.21.15.163:0/3368860996 conn(0x7f11e80f98a0 msgr2=0x7f11e80fbba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:13:29.221 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.178+0000 7f11ee27f700 1 -- 172.21.15.163:0/3368860996 shutdown_connections 2023-07-14T18:13:29.221 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.178+0000 7f11ee27f700 1 -- 172.21.15.163:0/3368860996 wait complete. 2023-07-14T18:13:29.222 INFO:teuthology.orchestra.run.smithi163.stderr:dumped fsmap epoch 29 2023-07-14T18:13:29.235 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:4 damage ls 2023-07-14T18:13:29.277 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:13:28 smithi172 ceph-mon[97983]: scrub queued for path: / 2023-07-14T18:13:29.277 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:13:28 smithi172 ceph-mon[97983]: scrub summary: idle+waiting paths [/] 2023-07-14T18:13:29.277 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:13:28 smithi172 ceph-mon[97983]: scrub summary: active paths [/] 2023-07-14T18:13:29.278 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:13:28 smithi172 ceph-mon[97983]: scrub summary: idle+waiting paths [/] 2023-07-14T18:13:29.278 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:13:28 smithi172 ceph-mon[97983]: scrub summary: idle 2023-07-14T18:13:29.369 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.328+0000 7fe32b785700 1 -- 172.21.15.163:0/1333855629 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fe3240feb10 msgr2=0x7fe3240fef20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:13:29.370 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.328+0000 7fe32b785700 1 --2- 172.21.15.163:0/1333855629 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fe3240feb10 0x7fe3240fef20 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7fe320009990 tx=0x7fe320009ca0 comp rx=0 tx=0).stop 2023-07-14T18:13:29.370 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.328+0000 7fe32b785700 1 -- 172.21.15.163:0/1333855629 shutdown_connections 2023-07-14T18:13:29.370 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.328+0000 7fe32b785700 1 --2- 172.21.15.163:0/1333855629 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe324100690 0x7fe324106f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:13:29.370 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.328+0000 7fe32b785700 1 --2- 172.21.15.163:0/1333855629 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fe3240feb10 0x7fe3240fef20 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:13:29.370 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.328+0000 7fe32b785700 1 --2- 172.21.15.163:0/1333855629 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe3240ffd00 0x7fe324100150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:13:29.371 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.328+0000 7fe32b785700 1 -- 172.21.15.163:0/1333855629 >> 172.21.15.163:0/1333855629 conn(0x7fe3240fa130 msgr2=0x7fe3240fc560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:13:29.371 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.328+0000 7fe32b785700 1 -- 172.21.15.163:0/1333855629 shutdown_connections 2023-07-14T18:13:29.371 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.328+0000 7fe32b785700 1 -- 172.21.15.163:0/1333855629 wait complete. 2023-07-14T18:13:29.373 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.329+0000 7fe32b785700 1 Processor -- start 2023-07-14T18:13:29.373 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.329+0000 7fe32b785700 1 -- start start 2023-07-14T18:13:29.373 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.329+0000 7fe32b785700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe3240feb10 0x7fe324068310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:13:29.373 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.329+0000 7fe32b785700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fe3240ffd00 0x7fe32419a660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:13:29.374 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.329+0000 7fe32b785700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe324100690 0x7fe32419cca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:13:29.374 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.329+0000 7fe32b785700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe32419d440 con 0x7fe3240ffd00 2023-07-14T18:13:29.374 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.329+0000 7fe32b785700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe32419d5b0 con 0x7fe3240feb10 2023-07-14T18:13:29.374 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.329+0000 7fe32b785700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe32419d770 con 0x7fe324100690 2023-07-14T18:13:29.374 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.329+0000 7fe328d20700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fe3240ffd00 0x7fe32419a660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:13:29.374 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.329+0000 7fe328d20700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fe3240ffd00 0x7fe32419a660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:58462/0 (socket says 172.21.15.163:58462) 2023-07-14T18:13:29.374 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.329+0000 7fe328d20700 1 -- 172.21.15.163:0/3228670445 learned_addr learned my addr 172.21.15.163:0/3228670445 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:13:29.375 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.329+0000 7fe329521700 1 --2- 172.21.15.163:0/3228670445 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe3240feb10 0x7fe324068310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:13:29.375 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.329+0000 7fe329d22700 1 --2- 172.21.15.163:0/3228670445 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe324100690 0x7fe32419cca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:13:29.375 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.330+0000 7fe329521700 1 -- 172.21.15.163:0/3228670445 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe324100690 msgr2=0x7fe32419cca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:13:29.375 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.330+0000 7fe329521700 1 --2- 172.21.15.163:0/3228670445 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe324100690 0x7fe32419cca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:13:29.375 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.330+0000 7fe329521700 1 -- 172.21.15.163:0/3228670445 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fe3240ffd00 msgr2=0x7fe32419a660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:13:29.375 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.330+0000 7fe329521700 1 --2- 172.21.15.163:0/3228670445 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fe3240ffd00 0x7fe32419a660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:13:29.375 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.330+0000 7fe329521700 1 -- 172.21.15.163:0/3228670445 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3200095f0 con 0x7fe3240feb10 2023-07-14T18:13:29.376 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.330+0000 7fe329d22700 1 --2- 172.21.15.163:0/3228670445 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe324100690 0x7fe32419cca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T18:13:29.376 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.330+0000 7fe329521700 1 --2- 172.21.15.163:0/3228670445 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe3240feb10 0x7fe324068310 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fe3200098e0 tx=0x7fe320009580 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:13:29.376 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.330+0000 7fe31a7fc700 1 -- 172.21.15.163:0/3228670445 <== mon.2 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe32001d070 con 0x7fe3240feb10 2023-07-14T18:13:29.376 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.330+0000 7fe32b785700 1 -- 172.21.15.163:0/3228670445 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe32419d9f0 con 0x7fe3240feb10 2023-07-14T18:13:29.376 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.330+0000 7fe31a7fc700 1 -- 172.21.15.163:0/3228670445 <== mon.2 v2:172.21.15.172:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fe320003f80 con 0x7fe3240feb10 2023-07-14T18:13:29.376 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.330+0000 7fe31a7fc700 1 -- 172.21.15.163:0/3228670445 <== mon.2 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe320022ba0 con 0x7fe3240feb10 2023-07-14T18:13:29.376 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.330+0000 7fe32b785700 1 -- 172.21.15.163:0/3228670445 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe32419de70 con 0x7fe3240feb10 2023-07-14T18:13:29.378 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.332+0000 7fe31a7fc700 1 -- 172.21.15.163:0/3228670445 <== mon.2 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 18) v1 ==== 135716+0+0 (secure 0 0 0) 0x7fe320003af0 con 0x7fe3240feb10 2023-07-14T18:13:29.379 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.333+0000 7fe31a7fc700 1 --2- 172.21.15.163:0/3228670445 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7fe3100a1150 0x7fe3100a3600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:13:29.379 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.333+0000 7fe31a7fc700 1 -- 172.21.15.163:0/3228670445 <== mon.2 v2:172.21.15.172:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 9049+0+0 (secure 0 0 0) 0x7fe3200ce0b0 con 0x7fe3240feb10 2023-07-14T18:13:29.379 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.335+0000 7fe328d20700 1 --2- 172.21.15.163:0/3228670445 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7fe3100a1150 0x7fe3100a3600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:13:29.379 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.335+0000 7fe33791db80 1 Processor -- start 2023-07-14T18:13:29.379 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.335+0000 7fe33791db80 1 -- start start 2023-07-14T18:13:29.379 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.335+0000 7fe328d20700 1 --2- 172.21.15.163:0/3228670445 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7fe3100a1150 0x7fe3100a3600 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fe314007d10 tx=0x7fe314007480 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:13:29.380 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.335+0000 7fe33791db80 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5567b9089a80 0x5567b9089e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:13:29.380 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.335+0000 7fe33791db80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5567b908a3d0 0x5567b907fc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:13:29.380 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.335+0000 7fe33791db80 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5567b90801d0 0x5567b9080640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:13:29.380 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.335+0000 7fe33791db80 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x5567b8f84cb0 con 0x5567b9089a80 2023-07-14T18:13:29.380 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.335+0000 7fe33791db80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x5567b8fd7a40 con 0x5567b908a3d0 2023-07-14T18:13:29.380 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.335+0000 7fe33791db80 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x5567b8fd0ed0 con 0x5567b90801d0 2023-07-14T18:13:29.380 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.335+0000 7fe329521700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5567b9089a80 0x5567b9089e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:13:29.381 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.335+0000 7fe329521700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5567b9089a80 0x5567b9089e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:58468/0 (socket says 172.21.15.163:58468) 2023-07-14T18:13:29.381 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.335+0000 7fe329521700 1 -- 172.21.15.163:0/3620917239 learned_addr learned my addr 172.21.15.163:0/3620917239 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:13:29.381 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.336+0000 7fe328d20700 1 --2- 172.21.15.163:0/3620917239 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5567b908a3d0 0x5567b907fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:13:29.381 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.336+0000 7fe329521700 1 -- 172.21.15.163:0/3620917239 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5567b90801d0 msgr2=0x5567b9080640 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-07-14T18:13:29.381 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.336+0000 7fe329521700 1 --2- 172.21.15.163:0/3620917239 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5567b90801d0 0x5567b9080640 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:13:29.381 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.336+0000 7fe329521700 1 -- 172.21.15.163:0/3620917239 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5567b908a3d0 msgr2=0x5567b907fc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:13:29.381 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.336+0000 7fe329521700 1 --2- 172.21.15.163:0/3620917239 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5567b908a3d0 0x5567b907fc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:13:29.382 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.336+0000 7fe329521700 1 -- 172.21.15.163:0/3620917239 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5567b8dfede0 con 0x5567b9089a80 2023-07-14T18:13:29.382 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.336+0000 7fe329521700 1 --2- 172.21.15.163:0/3620917239 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5567b9089a80 0x5567b9089e90 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7fe320009990 tx=0x7fe32000bf70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fbfa3740e09e1064 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:13:29.382 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.336+0000 7fe30f7fe700 1 -- 172.21.15.163:0/3620917239 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3200040f0 con 0x5567b9089a80 2023-07-14T18:13:29.382 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.336+0000 7fe30f7fe700 1 -- 172.21.15.163:0/3620917239 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fe32009b220 con 0x5567b9089a80 2023-07-14T18:13:29.382 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.336+0000 7fe30f7fe700 1 -- 172.21.15.163:0/3620917239 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe32009a710 con 0x5567b9089a80 2023-07-14T18:13:29.382 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.337+0000 7fe33791db80 1 -- 172.21.15.163:0/3620917239 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5567b9089a80 msgr2=0x5567b9089e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:13:29.383 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.337+0000 7fe33791db80 1 --2- 172.21.15.163:0/3620917239 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5567b9089a80 0x5567b9089e90 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7fe320009990 tx=0x7fe32000bf70 comp rx=0 tx=0).stop 2023-07-14T18:13:29.383 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.337+0000 7fe33791db80 1 -- 172.21.15.163:0/3620917239 shutdown_connections 2023-07-14T18:13:29.383 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.337+0000 7fe33791db80 1 --2- 172.21.15.163:0/3620917239 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5567b90801d0 0x5567b9080640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:13:29.383 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.337+0000 7fe33791db80 1 --2- 172.21.15.163:0/3620917239 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5567b9089a80 0x5567b9089e90 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:13:29.383 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.337+0000 7fe33791db80 1 --2- 172.21.15.163:0/3620917239 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5567b908a3d0 0x5567b907fc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:13:29.384 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.337+0000 7fe33791db80 1 -- 172.21.15.163:0/3620917239 >> 172.21.15.163:0/3620917239 conn(0x5567b9075680 msgr2=0x5567b907a9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:13:29.384 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.337+0000 7fe33791db80 1 -- 172.21.15.163:0/3620917239 shutdown_connections 2023-07-14T18:13:29.384 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.337+0000 7fe33791db80 1 -- 172.21.15.163:0/3620917239 wait complete. 2023-07-14T18:13:29.384 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.337+0000 7fe33791db80 1 -- start start 2023-07-14T18:13:29.384 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.337+0000 7fe33791db80 1 Processor -- start 2023-07-14T18:13:29.387 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.338+0000 7fe33791db80 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5567b90801d0 0x5567b90a2e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:13:29.388 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.338+0000 7fe33791db80 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5567b9089a80 0x5567b90a3370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:13:29.388 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.338+0000 7fe33791db80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5567b908a3d0 0x5567b90aa3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:13:29.388 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.338+0000 7fe33791db80 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x5567b8f70ac0 con 0x5567b90801d0 2023-07-14T18:13:29.388 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.338+0000 7fe33791db80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x5567b8f707c0 con 0x5567b908a3d0 2023-07-14T18:13:29.388 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.338+0000 7fe33791db80 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x5567b8e54920 con 0x5567b9089a80 2023-07-14T18:13:29.389 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.338+0000 7fe33791db80 10 client.0 _ll_register_callbacks cb 0x5567b8f6e760 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T18:13:29.389 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.338+0000 7fe329521700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5567b90801d0 0x5567b90a2e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:13:29.389 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.338+0000 7fe329521700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5567b90801d0 0x5567b90a2e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:58474/0 (socket says 172.21.15.163:58474) 2023-07-14T18:13:29.389 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.338+0000 7fe329521700 1 -- 172.21.15.163:0/3612207731 learned_addr learned my addr 172.21.15.163:0/3612207731 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:13:29.389 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.338+0000 7fe328d20700 1 --2- 172.21.15.163:0/3612207731 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5567b9089a80 0x5567b90a3370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:13:29.389 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.338+0000 7fe329521700 1 -- 172.21.15.163:0/3612207731 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5567b9089a80 msgr2=0x5567b90a3370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:13:29.390 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.338+0000 7fe329521700 1 --2- 172.21.15.163:0/3612207731 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5567b9089a80 0x5567b90a3370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:13:29.390 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.338+0000 7fe329521700 1 -- 172.21.15.163:0/3612207731 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5567b908a3d0 msgr2=0x5567b90aa3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:13:29.390 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.338+0000 7fe329d22700 1 --2- 172.21.15.163:0/3612207731 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5567b908a3d0 0x5567b90aa3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:13:29.390 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.338+0000 7fe329521700 1 --2- 172.21.15.163:0/3612207731 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5567b908a3d0 0x5567b90aa3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:13:29.390 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.338+0000 7fe329521700 1 -- 172.21.15.163:0/3612207731 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe32419de70 con 0x5567b90801d0 2023-07-14T18:13:29.390 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.339+0000 7fe329d22700 1 --2- 172.21.15.163:0/3612207731 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5567b908a3d0 0x5567b90aa3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T18:13:29.391 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.339+0000 7fe329521700 1 --2- 172.21.15.163:0/3612207731 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5567b90801d0 0x5567b90a2e30 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7fe320097c90 tx=0x7fe32009b090 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e760728f3c8409ce server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:13:29.391 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.339+0000 7fe30cff9700 10 client.0 ms_handle_connect on v2:172.21.15.163:3300/0 2023-07-14T18:13:29.391 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.339+0000 7fe30cff9700 1 -- 172.21.15.163:0/3612207731 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3200b0ea0 con 0x5567b90801d0 2023-07-14T18:13:29.391 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.339+0000 7fe30cff9700 1 -- 172.21.15.163:0/3612207731 <== mon.0 v2:172.21.15.163:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 9049+0+0 (secure 0 0 0) 0x7fe3200a35e0 con 0x5567b90801d0 2023-07-14T18:13:29.391 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.339+0000 7fe33791db80 1 -- 172.21.15.163:0/3612207731 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5567b8f2a4f0 con 0x5567b90801d0 2023-07-14T18:13:29.391 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.339+0000 7fe30cff9700 1 -- 172.21.15.163:0/3612207731 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe3200a3360 con 0x5567b90801d0 2023-07-14T18:13:29.391 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.339+0000 7fe33791db80 10 client.15861 fetch_fsmap learned FSMap version 29 2023-07-14T18:13:29.392 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.339+0000 7fe33791db80 1 -- 172.21.15.163:0/3612207731 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) v3 -- 0x5567b8de7c60 con 0x5567b90801d0 2023-07-14T18:13:29.392 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.339+0000 7fe30cff9700 1 -- 172.21.15.163:0/3612207731 <== mon.0 v2:172.21.15.163:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x5567b8f2a4f0 con 0x5567b90801d0 2023-07-14T18:13:29.392 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.340+0000 7fe30cff9700 1 -- 172.21.15.163:0/3612207731 <== mon.0 v2:172.21.15.163:3300/0 5 ==== fsmap(e 29) v1 ==== 7470+0+0 (secure 0 0 0) 0x7fe3200971a0 con 0x5567b90801d0 2023-07-14T18:13:29.392 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.340+0000 7fe33791db80 10 client.15861 fetch_fsmap finished waiting for FSMap version 29 2023-07-14T18:13:29.392 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.340+0000 7fe33791db80 10 client.15861 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.a 2023-07-14T18:13:29.392 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.340+0000 7fe33791db80 20 client.15861 populate_metadata read hostname 'smithi163' 2023-07-14T18:13:29.392 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.340+0000 7fe33791db80 1 --2- 172.21.15.163:0/3612207731 >> [v2:172.21.15.163:6840/1032082642,v1:172.21.15.163:6841/1032082642] conn(0x5567b90ae7e0 0x5567b90b0bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:13:29.393 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.340+0000 7fe33791db80 4 client.15861 mds_command: new command op to 14652 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-14T18:13:29.393 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.340+0000 7fe33791db80 1 -- 172.21.15.163:0/3612207731 --> [v2:172.21.15.163:6840/1032082642,v1:172.21.15.163:6841/1032082642] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5567b904eda0 con 0x5567b90ae7e0 2023-07-14T18:13:29.393 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.340+0000 7fe328d20700 1 --2- 172.21.15.163:0/3612207731 >> [v2:172.21.15.163:6840/1032082642,v1:172.21.15.163:6841/1032082642] conn(0x5567b90ae7e0 0x5567b90b0bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:13:29.393 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.340+0000 7fe30cff9700 10 client.15861 ms_handle_connect on v2:172.21.15.163:6840/1032082642 2023-07-14T18:13:29.393 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.340+0000 7fe328d20700 1 --2- 172.21.15.163:0/3612207731 >> [v2:172.21.15.163:6840/1032082642,v1:172.21.15.163:6841/1032082642] conn(0x5567b90ae7e0 0x5567b90b0bf0 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=d47175abf806721f server_cookie=7da3d7d2a8cf251d in_seq=0 out_seq=0 2023-07-14T18:13:29.394 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.341+0000 7fe30cff9700 1 -- 172.21.15.163:0/3612207731 <== mds.4 v2:172.21.15.163:6840/1032082642 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18017 (crc 0 0 0) 0x5567b904eda0 con 0x5567b90ae7e0 2023-07-14T18:13:29.394 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.341+0000 7fe30cff9700 10 client.15861 handle_command_reply: tid=0 2023-07-14T18:13:29.394 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.341+0000 7fe33791db80 1 client.15861 shutdown 2023-07-14T18:13:29.394 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.341+0000 7fe33791db80 1 -- 172.21.15.163:0/3612207731 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5567b90801d0 msgr2=0x5567b90a2e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:13:29.394 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.341+0000 7fe33791db80 1 --2- 172.21.15.163:0/3612207731 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5567b90801d0 0x5567b90a2e30 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7fe320097c90 tx=0x7fe32009b090 comp rx=0 tx=0).stop 2023-07-14T18:13:29.394 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.341+0000 7fe33791db80 1 -- 172.21.15.163:0/3612207731 shutdown_connections 2023-07-14T18:13:29.395 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.341+0000 7fe33791db80 1 --2- 172.21.15.163:0/3612207731 >> [v2:172.21.15.163:6840/1032082642,v1:172.21.15.163:6841/1032082642] conn(0x5567b90ae7e0 0x5567b90b0bf0 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:13:29.395 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.341+0000 7fe33791db80 1 --2- 172.21.15.163:0/3612207731 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5567b908a3d0 0x5567b90aa3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:13:29.395 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.341+0000 7fe33791db80 1 --2- 172.21.15.163:0/3612207731 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5567b90801d0 0x5567b90a2e30 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:13:29.395 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.341+0000 7fe33791db80 1 --2- 172.21.15.163:0/3612207731 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5567b9089a80 0x5567b90a3370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:13:29.395 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.341+0000 7fe33791db80 1 -- 172.21.15.163:0/3612207731 >> 172.21.15.163:0/3612207731 conn(0x5567b9075680 msgr2=0x5567b9079650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:13:29.395 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.341+0000 7fe30cff9700 0 client.15861 ms_handle_reset on v2:172.21.15.163:6840/1032082642 2023-07-14T18:13:29.395 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.341+0000 7fe33791db80 1 -- 172.21.15.163:0/3612207731 shutdown_connections 2023-07-14T18:13:29.396 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.341+0000 7fe33791db80 1 -- 172.21.15.163:0/3612207731 wait complete. 2023-07-14T18:13:29.396 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.341+0000 7fe33791db80 20 client.15861 trim_cache size 0 max 16384 2023-07-14T18:13:29.397 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.354+0000 7fe33791db80 1 Processor -- start 2023-07-14T18:13:29.397 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.354+0000 7fe33791db80 1 -- start start 2023-07-14T18:13:29.397 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.355+0000 7fe33791db80 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5567b90801d0 0x5567b907fc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:13:29.398 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.355+0000 7fe33791db80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5567b9089a80 0x5567b90aa370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:13:29.398 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.355+0000 7fe33791db80 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5567b908a3d0 0x5567b90805a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:13:29.398 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.355+0000 7fe33791db80 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x5567b90a2a00 con 0x5567b908a3d0 2023-07-14T18:13:29.398 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.355+0000 7fe33791db80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x5567b90a22e0 con 0x5567b9089a80 2023-07-14T18:13:29.398 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.355+0000 7fe33791db80 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x5567b907c200 con 0x5567b90801d0 2023-07-14T18:13:29.398 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.355+0000 7fe329d22700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5567b908a3d0 0x5567b90805a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:13:29.399 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.355+0000 7fe329d22700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5567b908a3d0 0x5567b90805a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:58486/0 (socket says 172.21.15.163:58486) 2023-07-14T18:13:29.399 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.355+0000 7fe329d22700 1 -- 172.21.15.163:0/275753350 learned_addr learned my addr 172.21.15.163:0/275753350 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:13:29.399 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.355+0000 7fe329521700 1 --2- 172.21.15.163:0/275753350 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5567b90801d0 0x5567b907fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:13:29.399 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.355+0000 7fe328d20700 1 --2- 172.21.15.163:0/275753350 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5567b9089a80 0x5567b90aa370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:13:29.400 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.355+0000 7fe329d22700 1 -- 172.21.15.163:0/275753350 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5567b90801d0 msgr2=0x5567b907fc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:13:29.400 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.355+0000 7fe329d22700 1 --2- 172.21.15.163:0/275753350 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5567b90801d0 0x5567b907fc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:13:29.400 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.355+0000 7fe329d22700 1 -- 172.21.15.163:0/275753350 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5567b9089a80 msgr2=0x5567b90aa370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:13:29.401 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.355+0000 7fe329d22700 1 --2- 172.21.15.163:0/275753350 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5567b9089a80 0x5567b90aa370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:13:29.401 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.355+0000 7fe329d22700 1 -- 172.21.15.163:0/275753350 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5567b8e25250 con 0x5567b908a3d0 2023-07-14T18:13:29.401 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.355+0000 7fe329d22700 1 --2- 172.21.15.163:0/275753350 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5567b908a3d0 0x5567b90805a0 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7fe31c0083f0 tx=0x7fe31c008700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec448cf85ff7add2 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:13:29.402 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.356+0000 7fe30ffff700 1 -- 172.21.15.163:0/275753350 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe31c004db0 con 0x5567b908a3d0 2023-07-14T18:13:29.402 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.356+0000 7fe30ffff700 1 -- 172.21.15.163:0/275753350 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fe31c007a70 con 0x5567b908a3d0 2023-07-14T18:13:29.402 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.356+0000 7fe30ffff700 1 -- 172.21.15.163:0/275753350 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe31c015800 con 0x5567b908a3d0 2023-07-14T18:13:29.402 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.356+0000 7fe33791db80 1 -- 172.21.15.163:0/275753350 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5567b908a3d0 msgr2=0x5567b90805a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:13:29.403 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.356+0000 7fe33791db80 1 --2- 172.21.15.163:0/275753350 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5567b908a3d0 0x5567b90805a0 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7fe31c0083f0 tx=0x7fe31c008700 comp rx=0 tx=0).stop 2023-07-14T18:13:29.407 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.356+0000 7fe33791db80 1 -- 172.21.15.163:0/275753350 shutdown_connections 2023-07-14T18:13:29.407 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.356+0000 7fe33791db80 1 --2- 172.21.15.163:0/275753350 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5567b90801d0 0x5567b907fc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:13:29.408 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.356+0000 7fe33791db80 1 --2- 172.21.15.163:0/275753350 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5567b908a3d0 0x5567b90805a0 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:13:29.408 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.356+0000 7fe33791db80 1 --2- 172.21.15.163:0/275753350 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5567b9089a80 0x5567b90aa370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:13:29.408 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.356+0000 7fe33791db80 1 -- 172.21.15.163:0/275753350 >> 172.21.15.163:0/275753350 conn(0x5567b9075680 msgr2=0x5567b90b07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:13:29.408 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.356+0000 7fe33791db80 1 -- 172.21.15.163:0/275753350 shutdown_connections 2023-07-14T18:13:29.408 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.356+0000 7fe33791db80 1 -- 172.21.15.163:0/275753350 wait complete. 2023-07-14T18:13:29.408 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.357+0000 7fe33791db80 1 -- start start 2023-07-14T18:13:29.408 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.357+0000 7fe33791db80 1 Processor -- start 2023-07-14T18:13:29.409 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.357+0000 7fe33791db80 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5567b90801d0 0x5567b90a60d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:13:29.409 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.357+0000 7fe33791db80 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5567b9089a80 0x5567b90a6610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:13:29.409 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.357+0000 7fe33791db80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5567b908a3d0 0x5567b90a9630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:13:29.409 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.357+0000 7fe33791db80 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x5567b90a9b70 con 0x5567b9089a80 2023-07-14T18:13:29.409 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.357+0000 7fe33791db80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x5567b90a9ce0 con 0x5567b908a3d0 2023-07-14T18:13:29.409 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.357+0000 7fe33791db80 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x5567b90a9ea0 con 0x5567b90801d0 2023-07-14T18:13:29.410 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.357+0000 7fe33791db80 10 client.0 _ll_register_callbacks cb 0x7fe32009ab80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T18:13:29.410 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.358+0000 7fe328d20700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5567b9089a80 0x5567b90a6610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:13:29.410 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.358+0000 7fe328d20700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5567b9089a80 0x5567b90a6610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:58490/0 (socket says 172.21.15.163:58490) 2023-07-14T18:13:29.410 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.358+0000 7fe328d20700 1 -- 172.21.15.163:0/2351673182 learned_addr learned my addr 172.21.15.163:0/2351673182 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:13:29.410 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.358+0000 7fe329521700 1 --2- 172.21.15.163:0/2351673182 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5567b90801d0 0x5567b90a60d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:13:29.410 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.358+0000 7fe329d22700 1 --2- 172.21.15.163:0/2351673182 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5567b908a3d0 0x5567b90a9630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:13:29.410 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.358+0000 7fe328d20700 1 -- 172.21.15.163:0/2351673182 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5567b90801d0 msgr2=0x5567b90a60d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:13:29.411 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.358+0000 7fe328d20700 1 --2- 172.21.15.163:0/2351673182 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5567b90801d0 0x5567b90a60d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:13:29.411 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.358+0000 7fe328d20700 1 -- 172.21.15.163:0/2351673182 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5567b908a3d0 msgr2=0x5567b90a9630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:13:29.411 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.358+0000 7fe328d20700 1 --2- 172.21.15.163:0/2351673182 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5567b908a3d0 0x5567b90a9630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:13:29.411 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.358+0000 7fe328d20700 1 -- 172.21.15.163:0/2351673182 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe31c007c30 con 0x5567b9089a80 2023-07-14T18:13:29.411 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.358+0000 7fe329d22700 1 --2- 172.21.15.163:0/2351673182 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5567b908a3d0 0x5567b90a9630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T18:13:29.411 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.358+0000 7fe329521700 1 --2- 172.21.15.163:0/2351673182 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5567b90801d0 0x5567b90a60d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T18:13:29.411 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.358+0000 7fe328d20700 1 --2- 172.21.15.163:0/2351673182 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5567b9089a80 0x5567b90a6610 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7fe314010d80 tx=0x7fe3140047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d3435d3d8a32d578 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:13:29.412 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.358+0000 7fe30cff9700 10 client.0 ms_handle_connect on v2:172.21.15.163:3300/0 2023-07-14T18:13:29.412 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.358+0000 7fe30cff9700 1 -- 172.21.15.163:0/2351673182 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe314025070 con 0x5567b9089a80 2023-07-14T18:13:29.412 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.358+0000 7fe30cff9700 1 -- 172.21.15.163:0/2351673182 <== mon.0 v2:172.21.15.163:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 9049+0+0 (secure 0 0 0) 0x7fe314017070 con 0x5567b9089a80 2023-07-14T18:13:29.412 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.359+0000 7fe33791db80 1 -- 172.21.15.163:0/2351673182 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fe32009b220 con 0x5567b9089a80 2023-07-14T18:13:29.412 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.359+0000 7fe30cff9700 1 -- 172.21.15.163:0/2351673182 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe314026250 con 0x5567b9089a80 2023-07-14T18:13:29.412 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.359+0000 7fe33791db80 10 client.15867 fetch_fsmap learned FSMap version 29 2023-07-14T18:13:29.413 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.359+0000 7fe33791db80 1 -- 172.21.15.163:0/2351673182 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) v3 -- 0x5567b8dfd2b0 con 0x5567b9089a80 2023-07-14T18:13:29.413 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.359+0000 7fe30cff9700 1 -- 172.21.15.163:0/2351673182 <== mon.0 v2:172.21.15.163:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fe32009b220 con 0x5567b9089a80 2023-07-14T18:13:29.413 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.359+0000 7fe30cff9700 1 -- 172.21.15.163:0/2351673182 <== mon.0 v2:172.21.15.163:3300/0 5 ==== fsmap(e 29) v1 ==== 7470+0+0 (secure 0 0 0) 0x7fe31401e420 con 0x5567b9089a80 2023-07-14T18:13:29.413 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.359+0000 7fe33791db80 10 client.15867 fetch_fsmap finished waiting for FSMap version 29 2023-07-14T18:13:29.413 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.359+0000 7fe33791db80 10 client.15867 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.a 2023-07-14T18:13:29.413 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.359+0000 7fe33791db80 20 client.15867 populate_metadata read hostname 'smithi163' 2023-07-14T18:13:29.413 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.359+0000 7fe33791db80 1 --2- 172.21.15.163:0/2351673182 >> [v2:172.21.15.163:6840/1032082642,v1:172.21.15.163:6841/1032082642] conn(0x5567b91034e0 0x5567b91058f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:13:29.414 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.359+0000 7fe33791db80 4 client.15867 mds_command: new command op to 14652 tid=0[{"prefix": "damage ls"}] 2023-07-14T18:13:29.414 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.359+0000 7fe33791db80 1 -- 172.21.15.163:0/2351673182 --> [v2:172.21.15.163:6840/1032082642,v1:172.21.15.163:6841/1032082642] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x5567b8fc9eb0 con 0x5567b91034e0 2023-07-14T18:13:29.414 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.360+0000 7fe329521700 1 --2- 172.21.15.163:0/2351673182 >> [v2:172.21.15.163:6840/1032082642,v1:172.21.15.163:6841/1032082642] conn(0x5567b91034e0 0x5567b91058f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:13:29.414 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.360+0000 7fe30cff9700 10 client.15867 ms_handle_connect on v2:172.21.15.163:6840/1032082642 2023-07-14T18:13:29.414 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.360+0000 7fe329521700 1 --2- 172.21.15.163:0/2351673182 >> [v2:172.21.15.163:6840/1032082642,v1:172.21.15.163:6841/1032082642] conn(0x5567b91034e0 0x5567b91058f0 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=834af86e50ce6c03 server_cookie=e20b2bd70ead6b26 in_seq=0 out_seq=0 2023-07-14T18:13:29.414 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.360+0000 7fe30cff9700 1 -- 172.21.15.163:0/2351673182 <== mds.4 v2:172.21.15.163:6840/1032082642 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x5567b8fc9eb0 con 0x5567b91034e0 2023-07-14T18:13:29.414 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.360+0000 7fe30cff9700 10 client.15867 handle_command_reply: tid=0 2023-07-14T18:13:29.415 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.360+0000 7fe33791db80 1 client.15867 shutdown 2023-07-14T18:13:29.415 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.361+0000 7fe33791db80 1 -- 172.21.15.163:0/2351673182 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5567b9089a80 msgr2=0x5567b90a6610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:13:29.415 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.361+0000 7fe33791db80 1 --2- 172.21.15.163:0/2351673182 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5567b9089a80 0x5567b90a6610 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7fe314010d80 tx=0x7fe3140047c0 comp rx=0 tx=0).stop 2023-07-14T18:13:29.415 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.361+0000 7fe33791db80 1 -- 172.21.15.163:0/2351673182 shutdown_connections 2023-07-14T18:13:29.415 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.361+0000 7fe33791db80 1 --2- 172.21.15.163:0/2351673182 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5567b90801d0 0x5567b90a60d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:13:29.415 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.361+0000 7fe33791db80 1 --2- 172.21.15.163:0/2351673182 >> [v2:172.21.15.163:6840/1032082642,v1:172.21.15.163:6841/1032082642] conn(0x5567b91034e0 0x5567b91058f0 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:13:29.415 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.361+0000 7fe33791db80 1 --2- 172.21.15.163:0/2351673182 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5567b908a3d0 0x5567b90a9630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:13:29.416 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.361+0000 7fe33791db80 1 --2- 172.21.15.163:0/2351673182 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5567b9089a80 0x5567b90a6610 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:13:29.416 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.361+0000 7fe33791db80 1 -- 172.21.15.163:0/2351673182 >> 172.21.15.163:0/2351673182 conn(0x5567b9075680 msgr2=0x5567b90805a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:13:29.416 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.361+0000 7fe30cff9700 0 client.15867 ms_handle_reset on v2:172.21.15.163:6840/1032082642 2023-07-14T18:13:29.416 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.361+0000 7fe33791db80 1 -- 172.21.15.163:0/2351673182 shutdown_connections 2023-07-14T18:13:29.416 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.361+0000 7fe33791db80 1 -- 172.21.15.163:0/2351673182 wait complete. 2023-07-14T18:13:29.416 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.361+0000 7fe33791db80 20 client.15867 trim_cache size 0 max 16384 2023-07-14T18:13:29.417 INFO:teuthology.orchestra.run.smithi163.stdout:[] 2023-07-14T18:13:29.417 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.362+0000 7fe32b785700 1 -- 172.21.15.163:0/3228670445 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7fe3100a1150 msgr2=0x7fe3100a3600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:13:29.418 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.362+0000 7fe32b785700 1 --2- 172.21.15.163:0/3228670445 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7fe3100a1150 0x7fe3100a3600 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fe314007d10 tx=0x7fe314007480 comp rx=0 tx=0).stop 2023-07-14T18:13:29.418 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.362+0000 7fe32b785700 1 -- 172.21.15.163:0/3228670445 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe3240feb10 msgr2=0x7fe324068310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:13:29.418 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.362+0000 7fe32b785700 1 --2- 172.21.15.163:0/3228670445 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe3240feb10 0x7fe324068310 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fe3200098e0 tx=0x7fe320009580 comp rx=0 tx=0).stop 2023-07-14T18:13:29.418 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.362+0000 7fe32b785700 1 -- 172.21.15.163:0/3228670445 shutdown_connections 2023-07-14T18:13:29.418 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.362+0000 7fe32b785700 1 --2- 172.21.15.163:0/3228670445 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7fe3100a1150 0x7fe3100a3600 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:13:29.418 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.362+0000 7fe32b785700 1 --2- 172.21.15.163:0/3228670445 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe324100690 0x7fe32419cca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:13:29.419 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.362+0000 7fe32b785700 1 --2- 172.21.15.163:0/3228670445 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe3240feb10 0x7fe324068310 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:13:29.419 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.362+0000 7fe32b785700 1 --2- 172.21.15.163:0/3228670445 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fe3240ffd00 0x7fe32419a660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:13:29.419 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.362+0000 7fe32b785700 1 -- 172.21.15.163:0/3228670445 >> 172.21.15.163:0/3228670445 conn(0x7fe3240fa130 msgr2=0x7fe3240fc4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:13:29.419 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.362+0000 7fe32b785700 1 -- 172.21.15.163:0/3228670445 shutdown_connections 2023-07-14T18:13:29.419 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.362+0000 7fe32b785700 1 -- 172.21.15.163:0/3228670445 wait complete. 2023-07-14T18:13:29.420 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:3 damage ls 2023-07-14T18:13:29.554 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.512+0000 7f6c30648700 1 -- 172.21.15.163:0/1034705752 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f6c280ffd70 msgr2=0x7f6c281001c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:13:29.554 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.512+0000 7f6c30648700 1 --2- 172.21.15.163:0/1034705752 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f6c280ffd70 0x7f6c281001c0 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f6c18009990 tx=0x7f6c18009ca0 comp rx=0 tx=0).stop 2023-07-14T18:13:29.554 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.512+0000 7f6c30648700 1 -- 172.21.15.163:0/1034705752 shutdown_connections 2023-07-14T18:13:29.554 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.512+0000 7f6c30648700 1 --2- 172.21.15.163:0/1034705752 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6c28100700 0x7f6c28106fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:13:29.555 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.512+0000 7f6c30648700 1 --2- 172.21.15.163:0/1034705752 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6c280feb80 0x7f6c280fef90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:13:29.555 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.512+0000 7f6c30648700 1 --2- 172.21.15.163:0/1034705752 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f6c280ffd70 0x7f6c281001c0 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:13:29.555 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.512+0000 7f6c30648700 1 -- 172.21.15.163:0/1034705752 >> 172.21.15.163:0/1034705752 conn(0x7f6c280fa1a0 msgr2=0x7f6c280fc5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:13:29.555 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.512+0000 7f6c30648700 1 -- 172.21.15.163:0/1034705752 shutdown_connections 2023-07-14T18:13:29.555 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.513+0000 7f6c30648700 1 -- 172.21.15.163:0/1034705752 wait complete. 2023-07-14T18:13:29.557 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.513+0000 7f6c30648700 1 Processor -- start 2023-07-14T18:13:29.557 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.513+0000 7f6c30648700 1 -- start start 2023-07-14T18:13:29.557 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.513+0000 7f6c30648700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f6c280feb80 0x7f6c281958e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:13:29.557 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.513+0000 7f6c30648700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6c280ffd70 0x7f6c28195e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:13:29.557 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.513+0000 7f6c30648700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6c28100700 0x7f6c2819ce90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:13:29.557 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.513+0000 7f6c30648700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c2819d460 con 0x7f6c280feb80 2023-07-14T18:13:29.558 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.513+0000 7f6c30648700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c2819d5a0 con 0x7f6c28100700 2023-07-14T18:13:29.558 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.513+0000 7f6c30648700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c28107780 con 0x7f6c280ffd70 2023-07-14T18:13:29.558 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.513+0000 7f6c2e3e4700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f6c280feb80 0x7f6c281958e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:13:29.558 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.514+0000 7f6c2e3e4700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f6c280feb80 0x7f6c281958e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:58502/0 (socket says 172.21.15.163:58502) 2023-07-14T18:13:29.558 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.514+0000 7f6c2e3e4700 1 -- 172.21.15.163:0/3828822288 learned_addr learned my addr 172.21.15.163:0/3828822288 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:13:29.558 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.514+0000 7f6c2ebe5700 1 --2- 172.21.15.163:0/3828822288 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6c28100700 0x7f6c2819ce90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:13:29.558 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.514+0000 7f6c2dbe3700 1 --2- 172.21.15.163:0/3828822288 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6c280ffd70 0x7f6c28195e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:13:29.559 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.514+0000 7f6c2e3e4700 1 -- 172.21.15.163:0/3828822288 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6c280ffd70 msgr2=0x7f6c28195e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:13:29.559 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.514+0000 7f6c2e3e4700 1 --2- 172.21.15.163:0/3828822288 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6c280ffd70 0x7f6c28195e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:13:29.559 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.514+0000 7f6c2e3e4700 1 -- 172.21.15.163:0/3828822288 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6c28100700 msgr2=0x7f6c2819ce90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:13:29.559 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.514+0000 7f6c2e3e4700 1 --2- 172.21.15.163:0/3828822288 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6c28100700 0x7f6c2819ce90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:13:29.559 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.514+0000 7f6c2e3e4700 1 -- 172.21.15.163:0/3828822288 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c180095f0 con 0x7f6c280feb80 2023-07-14T18:13:29.559 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.514+0000 7f6c2e3e4700 1 --2- 172.21.15.163:0/3828822288 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f6c280feb80 0x7f6c281958e0 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f6c2400e970 tx=0x7f6c2400ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:13:29.559 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.514+0000 7f6c1f7fe700 1 -- 172.21.15.163:0/3828822288 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c24009790 con 0x7f6c280feb80 2023-07-14T18:13:29.559 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.514+0000 7f6c30648700 1 -- 172.21.15.163:0/3828822288 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c28107a60 con 0x7f6c280feb80 2023-07-14T18:13:29.560 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.514+0000 7f6c1f7fe700 1 -- 172.21.15.163:0/3828822288 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f6c2400eec0 con 0x7f6c280feb80 2023-07-14T18:13:29.560 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.514+0000 7f6c1f7fe700 1 -- 172.21.15.163:0/3828822288 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c24003c10 con 0x7f6c280feb80 2023-07-14T18:13:29.560 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.514+0000 7f6c30648700 1 -- 172.21.15.163:0/3828822288 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c28107f70 con 0x7f6c280feb80 2023-07-14T18:13:29.562 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.517+0000 7f6c1f7fe700 1 -- 172.21.15.163:0/3828822288 <== mon.0 v2:172.21.15.163:3300/0 4 ==== mgrmap(e 18) v1 ==== 135716+0+0 (secure 0 0 0) 0x7f6c24003db0 con 0x7f6c280feb80 2023-07-14T18:13:29.562 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.518+0000 7f6c1f7fe700 1 --2- 172.21.15.163:0/3828822288 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f6c140a1150 0x7f6c140a3600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:13:29.563 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.518+0000 7f6c1f7fe700 1 -- 172.21.15.163:0/3828822288 <== mon.0 v2:172.21.15.163:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 9049+0+0 (secure 0 0 0) 0x7f6c24014070 con 0x7f6c280feb80 2023-07-14T18:13:29.563 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.518+0000 7f6c2dbe3700 1 --2- 172.21.15.163:0/3828822288 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f6c140a1150 0x7f6c140a3600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:13:29.563 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.519+0000 7f6c3c7e0b80 1 Processor -- start 2023-07-14T18:13:29.563 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.519+0000 7f6c2dbe3700 1 --2- 172.21.15.163:0/3828822288 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f6c140a1150 0x7f6c140a3600 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f6c18006010 tx=0x7f6c1800b260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:13:29.563 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.519+0000 7f6c3c7e0b80 1 -- start start 2023-07-14T18:13:29.563 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.519+0000 7f6c3c7e0b80 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x556463607f60 0x556463608370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:13:29.563 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.519+0000 7f6c3c7e0b80 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5564636088b0 0x556463608ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:13:29.564 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.519+0000 7f6c3c7e0b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5564636094b0 0x556463609920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:13:29.564 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.519+0000 7f6c3c7e0b80 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x55646350ccb0 con 0x556463607f60 2023-07-14T18:13:29.564 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.519+0000 7f6c3c7e0b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x55646355fa40 con 0x5564636094b0 2023-07-14T18:13:29.564 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.519+0000 7f6c3c7e0b80 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x556463558ed0 con 0x5564636088b0 2023-07-14T18:13:29.564 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.520+0000 7f6c2ebe5700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5564636094b0 0x556463609920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:13:29.564 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.520+0000 7f6c2ebe5700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5564636094b0 0x556463609920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.163:59196/0 (socket says 172.21.15.163:59196) 2023-07-14T18:13:29.565 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.520+0000 7f6c2ebe5700 1 -- 172.21.15.163:0/425992425 learned_addr learned my addr 172.21.15.163:0/425992425 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:13:29.565 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.520+0000 7f6c2dbe3700 1 --2- 172.21.15.163:0/425992425 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5564636088b0 0x556463608ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:13:29.565 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.520+0000 7f6c2ebe5700 1 -- 172.21.15.163:0/425992425 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5564636088b0 msgr2=0x556463608ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:13:29.565 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.520+0000 7f6c2ebe5700 1 --2- 172.21.15.163:0/425992425 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5564636088b0 0x556463608ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:13:29.565 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.520+0000 7f6c2ebe5700 1 -- 172.21.15.163:0/425992425 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x556463607f60 msgr2=0x556463608370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:13:29.565 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.520+0000 7f6c2ebe5700 1 --2- 172.21.15.163:0/425992425 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x556463607f60 0x556463608370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:13:29.565 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.520+0000 7f6c2ebe5700 1 -- 172.21.15.163:0/425992425 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556463386de0 con 0x5564636094b0 2023-07-14T18:13:29.566 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.520+0000 7f6c2ebe5700 1 --2- 172.21.15.163:0/425992425 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5564636094b0 0x556463609920 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f6c20011680 tx=0x7f6c20009920 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9ad0e0ffa3867459 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:13:29.566 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.521+0000 7f6c1cff9700 1 -- 172.21.15.163:0/425992425 <== mon.2 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c2000e040 con 0x5564636094b0 2023-07-14T18:13:29.566 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.521+0000 7f6c1cff9700 1 -- 172.21.15.163:0/425992425 <== mon.2 v2:172.21.15.172:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f6c2000f040 con 0x5564636094b0 2023-07-14T18:13:29.566 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.521+0000 7f6c1cff9700 1 -- 172.21.15.163:0/425992425 <== mon.2 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c20004790 con 0x5564636094b0 2023-07-14T18:13:29.569 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.522+0000 7f6c3c7e0b80 1 -- 172.21.15.163:0/425992425 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5564636094b0 msgr2=0x556463609920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:13:29.569 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.522+0000 7f6c3c7e0b80 1 --2- 172.21.15.163:0/425992425 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5564636094b0 0x556463609920 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f6c20011680 tx=0x7f6c20009920 comp rx=0 tx=0).stop 2023-07-14T18:13:29.569 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.522+0000 7f6c3c7e0b80 1 -- 172.21.15.163:0/425992425 shutdown_connections 2023-07-14T18:13:29.569 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.522+0000 7f6c3c7e0b80 1 --2- 172.21.15.163:0/425992425 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5564636094b0 0x556463609920 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:13:29.569 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.522+0000 7f6c3c7e0b80 1 --2- 172.21.15.163:0/425992425 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x556463607f60 0x556463608370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:13:29.570 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.522+0000 7f6c3c7e0b80 1 --2- 172.21.15.163:0/425992425 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5564636088b0 0x556463608ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:13:29.570 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.522+0000 7f6c3c7e0b80 1 -- 172.21.15.163:0/425992425 >> 172.21.15.163:0/425992425 conn(0x5564635fd680 msgr2=0x5564636029d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:13:29.570 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.522+0000 7f6c3c7e0b80 1 -- 172.21.15.163:0/425992425 shutdown_connections 2023-07-14T18:13:29.570 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.522+0000 7f6c3c7e0b80 1 -- 172.21.15.163:0/425992425 wait complete. 2023-07-14T18:13:29.570 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.522+0000 7f6c3c7e0b80 1 -- start start 2023-07-14T18:13:29.570 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.522+0000 7f6c3c7e0b80 1 Processor -- start 2023-07-14T18:13:29.570 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.523+0000 7f6c3c7e0b80 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x556463607f60 0x556463611970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:13:29.570 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.523+0000 7f6c3c7e0b80 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5564636088b0 0x556463611eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:13:29.571 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.523+0000 7f6c3c7e0b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5564636094b0 0x556463618ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:13:29.571 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.523+0000 7f6c3c7e0b80 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x5564634f8ac0 con 0x556463607f60 2023-07-14T18:13:29.571 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.523+0000 7f6c3c7e0b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x5564634f87c0 con 0x5564636094b0 2023-07-14T18:13:29.571 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.523+0000 7f6c3c7e0b80 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x5564633dc920 con 0x5564636088b0 2023-07-14T18:13:29.571 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.523+0000 7f6c3c7e0b80 10 client.0 _ll_register_callbacks cb 0x5564634f6760 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T18:13:29.571 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.523+0000 7f6c2e3e4700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x556463607f60 0x556463611970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:13:29.572 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.523+0000 7f6c2e3e4700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x556463607f60 0x556463611970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:58516/0 (socket says 172.21.15.163:58516) 2023-07-14T18:13:29.572 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.523+0000 7f6c2e3e4700 1 -- 172.21.15.163:0/23915668 learned_addr learned my addr 172.21.15.163:0/23915668 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:13:29.572 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.523+0000 7f6c2dbe3700 1 --2- 172.21.15.163:0/23915668 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5564636088b0 0x556463611eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:13:29.572 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.523+0000 7f6c2e3e4700 1 -- 172.21.15.163:0/23915668 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5564636088b0 msgr2=0x556463611eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:13:29.572 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.523+0000 7f6c2e3e4700 1 --2- 172.21.15.163:0/23915668 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5564636088b0 0x556463611eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:13:29.572 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.523+0000 7f6c2e3e4700 1 -- 172.21.15.163:0/23915668 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5564636094b0 msgr2=0x556463618ef0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-07-14T18:13:29.572 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.523+0000 7f6c2e3e4700 1 --2- 172.21.15.163:0/23915668 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5564636094b0 0x556463618ef0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:13:29.573 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.523+0000 7f6c2e3e4700 1 -- 172.21.15.163:0/23915668 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c20011330 con 0x556463607f60 2023-07-14T18:13:29.573 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.524+0000 7f6c2e3e4700 1 --2- 172.21.15.163:0/23915668 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x556463607f60 0x556463611970 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f6c2400c5b0 tx=0x7f6c24099940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4fa336ce8a3adb7a server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:13:29.573 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.524+0000 7f6c11ffb700 10 client.0 ms_handle_connect on v2:172.21.15.163:3300/0 2023-07-14T18:13:29.573 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.524+0000 7f6c11ffb700 1 -- 172.21.15.163:0/23915668 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c24099650 con 0x556463607f60 2023-07-14T18:13:29.573 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.524+0000 7f6c3c7e0b80 1 -- 172.21.15.163:0/23915668 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5564634b24f0 con 0x556463607f60 2023-07-14T18:13:29.573 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.524+0000 7f6c11ffb700 1 -- 172.21.15.163:0/23915668 <== mon.0 v2:172.21.15.163:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 9049+0+0 (secure 0 0 0) 0x7f6c2409df90 con 0x556463607f60 2023-07-14T18:13:29.573 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.524+0000 7f6c11ffb700 1 -- 172.21.15.163:0/23915668 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6c240a23b0 con 0x556463607f60 2023-07-14T18:13:29.573 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.524+0000 7f6c3c7e0b80 10 client.15876 fetch_fsmap learned FSMap version 29 2023-07-14T18:13:29.574 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.524+0000 7f6c3c7e0b80 1 -- 172.21.15.163:0/23915668 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) v3 -- 0x55646336fc60 con 0x556463607f60 2023-07-14T18:13:29.574 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.524+0000 7f6c11ffb700 1 -- 172.21.15.163:0/23915668 <== mon.0 v2:172.21.15.163:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f6c240c8080 con 0x556463607f60 2023-07-14T18:13:29.574 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.524+0000 7f6c11ffb700 1 -- 172.21.15.163:0/23915668 <== mon.0 v2:172.21.15.163:3300/0 5 ==== fsmap(e 29) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f6c24095f50 con 0x556463607f60 2023-07-14T18:13:29.574 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.524+0000 7f6c3c7e0b80 10 client.15876 fetch_fsmap finished waiting for FSMap version 29 2023-07-14T18:13:29.574 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.524+0000 7f6c3c7e0b80 10 client.15876 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.c 2023-07-14T18:13:29.574 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.525+0000 7f6c3c7e0b80 20 client.15876 populate_metadata read hostname 'smithi163' 2023-07-14T18:13:29.574 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.525+0000 7f6c3c7e0b80 1 --2- 172.21.15.163:0/23915668 >> [v2:172.21.15.184:6836/3389277679,v1:172.21.15.184:6837/3389277679] conn(0x55646361d6d0 0x55646361fae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:13:29.575 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.525+0000 7f6c3c7e0b80 4 client.15876 mds_command: new command op to 24478 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-14T18:13:29.575 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.525+0000 7f6c3c7e0b80 1 -- 172.21.15.163:0/23915668 --> [v2:172.21.15.184:6836/3389277679,v1:172.21.15.184:6837/3389277679] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5564635d6da0 con 0x55646361d6d0 2023-07-14T18:13:29.575 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.525+0000 7f6c2dbe3700 1 --2- 172.21.15.163:0/23915668 >> [v2:172.21.15.184:6836/3389277679,v1:172.21.15.184:6837/3389277679] conn(0x55646361d6d0 0x55646361fae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:13:29.575 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.525+0000 7f6c11ffb700 10 client.15876 ms_handle_connect on v2:172.21.15.184:6836/3389277679 2023-07-14T18:13:29.575 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.525+0000 7f6c2dbe3700 1 --2- 172.21.15.163:0/23915668 >> [v2:172.21.15.184:6836/3389277679,v1:172.21.15.184:6837/3389277679] conn(0x55646361d6d0 0x55646361fae0 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=47a840eecfde208a server_cookie=468f4bd3393a32f7 in_seq=0 out_seq=0 2023-07-14T18:13:29.575 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.526+0000 7f6c11ffb700 1 -- 172.21.15.163:0/23915668 <== mds.3 v2:172.21.15.184:6836/3389277679 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18017 (crc 0 0 0) 0x5564635d6da0 con 0x55646361d6d0 2023-07-14T18:13:29.575 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.526+0000 7f6c11ffb700 10 client.15876 handle_command_reply: tid=0 2023-07-14T18:13:29.575 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.526+0000 7f6c3c7e0b80 1 client.15876 shutdown 2023-07-14T18:13:29.576 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.526+0000 7f6c3c7e0b80 1 -- 172.21.15.163:0/23915668 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x556463607f60 msgr2=0x556463611970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:13:29.576 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.526+0000 7f6c3c7e0b80 1 --2- 172.21.15.163:0/23915668 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x556463607f60 0x556463611970 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f6c2400c5b0 tx=0x7f6c24099940 comp rx=0 tx=0).stop 2023-07-14T18:13:29.576 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.526+0000 7f6c3c7e0b80 1 -- 172.21.15.163:0/23915668 shutdown_connections 2023-07-14T18:13:29.576 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.526+0000 7f6c3c7e0b80 1 --2- 172.21.15.163:0/23915668 >> [v2:172.21.15.184:6836/3389277679,v1:172.21.15.184:6837/3389277679] conn(0x55646361d6d0 0x55646361fae0 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:13:29.576 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.526+0000 7f6c3c7e0b80 1 --2- 172.21.15.163:0/23915668 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5564636094b0 0x556463618ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:13:29.576 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.526+0000 7f6c3c7e0b80 1 --2- 172.21.15.163:0/23915668 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x556463607f60 0x556463611970 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:13:29.576 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.526+0000 7f6c3c7e0b80 1 --2- 172.21.15.163:0/23915668 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5564636088b0 0x556463611eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:13:29.577 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.526+0000 7f6c3c7e0b80 1 -- 172.21.15.163:0/23915668 >> 172.21.15.163:0/23915668 conn(0x5564635fd680 msgr2=0x556463601650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:13:29.577 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.526+0000 7f6c11ffb700 0 client.15876 ms_handle_reset on v2:172.21.15.184:6836/3389277679 2023-07-14T18:13:29.577 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.526+0000 7f6c3c7e0b80 1 -- 172.21.15.163:0/23915668 shutdown_connections 2023-07-14T18:13:29.577 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.526+0000 7f6c3c7e0b80 1 -- 172.21.15.163:0/23915668 wait complete. 2023-07-14T18:13:29.577 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.527+0000 7f6c3c7e0b80 20 client.15876 trim_cache size 0 max 16384 2023-07-14T18:13:29.581 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.539+0000 7f6c3c7e0b80 1 Processor -- start 2023-07-14T18:13:29.581 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.539+0000 7f6c3c7e0b80 1 -- start start 2023-07-14T18:13:29.581 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.540+0000 7f6c3c7e0b80 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x556463607f60 0x55646360f8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:13:29.581 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.540+0000 7f6c3c7e0b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5564636088b0 0x556463618eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:13:29.581 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.540+0000 7f6c3c7e0b80 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5564636094b0 0x55646360c400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:13:29.581 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.540+0000 7f6c3c7e0b80 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x556463609da0 con 0x5564636094b0 2023-07-14T18:13:29.581 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.540+0000 7f6c3c7e0b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x5564635d6da0 con 0x5564636088b0 2023-07-14T18:13:29.582 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.540+0000 7f6c3c7e0b80 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x556463604500 con 0x556463607f60 2023-07-14T18:13:29.583 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.540+0000 7f6c2ebe5700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5564636094b0 0x55646360c400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:13:29.583 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.540+0000 7f6c2ebe5700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5564636094b0 0x55646360c400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:58526/0 (socket says 172.21.15.163:58526) 2023-07-14T18:13:29.584 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.540+0000 7f6c2ebe5700 1 -- 172.21.15.163:0/1959547250 learned_addr learned my addr 172.21.15.163:0/1959547250 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:13:29.584 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.540+0000 7f6c2e3e4700 1 --2- 172.21.15.163:0/1959547250 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x556463607f60 0x55646360f8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:13:29.584 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.540+0000 7f6c2e3e4700 1 -- 172.21.15.163:0/1959547250 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5564636088b0 msgr2=0x556463618eb0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-07-14T18:13:29.584 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.540+0000 7f6c2e3e4700 1 --2- 172.21.15.163:0/1959547250 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5564636088b0 0x556463618eb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:13:29.584 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.540+0000 7f6c2e3e4700 1 -- 172.21.15.163:0/1959547250 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5564636094b0 msgr2=0x55646360c400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:13:29.584 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.540+0000 7f6c2e3e4700 1 --2- 172.21.15.163:0/1959547250 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5564636094b0 0x55646360c400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:13:29.584 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.540+0000 7f6c2e3e4700 1 -- 172.21.15.163:0/1959547250 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5564633ad250 con 0x556463607f60 2023-07-14T18:13:29.585 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.541+0000 7f6c2e3e4700 1 --2- 172.21.15.163:0/1959547250 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x556463607f60 0x55646360f8f0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f6c24096460 tx=0x7f6c24098510 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dc83579ff3d1a6ee server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:13:29.585 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.541+0000 7f6c1d7fa700 1 -- 172.21.15.163:0/1959547250 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c2409df90 con 0x556463607f60 2023-07-14T18:13:29.585 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.541+0000 7f6c1d7fa700 1 -- 172.21.15.163:0/1959547250 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x5564634b24f0 con 0x556463607f60 2023-07-14T18:13:29.585 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.541+0000 7f6c1d7fa700 1 -- 172.21.15.163:0/1959547250 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c240996b0 con 0x556463607f60 2023-07-14T18:13:29.585 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.541+0000 7f6c3c7e0b80 1 -- 172.21.15.163:0/1959547250 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x556463607f60 msgr2=0x55646360f8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:13:29.585 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.541+0000 7f6c3c7e0b80 1 --2- 172.21.15.163:0/1959547250 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x556463607f60 0x55646360f8f0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f6c24096460 tx=0x7f6c24098510 comp rx=0 tx=0).stop 2023-07-14T18:13:29.585 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.541+0000 7f6c3c7e0b80 1 -- 172.21.15.163:0/1959547250 shutdown_connections 2023-07-14T18:13:29.585 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.542+0000 7f6c3c7e0b80 1 --2- 172.21.15.163:0/1959547250 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x556463607f60 0x55646360f8f0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:13:29.586 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.542+0000 7f6c3c7e0b80 1 --2- 172.21.15.163:0/1959547250 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5564636094b0 0x55646360c400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:13:29.586 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.542+0000 7f6c3c7e0b80 1 --2- 172.21.15.163:0/1959547250 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5564636088b0 0x556463618eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:13:29.586 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.542+0000 7f6c3c7e0b80 1 -- 172.21.15.163:0/1959547250 >> 172.21.15.163:0/1959547250 conn(0x5564635fd680 msgr2=0x55646361f6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:13:29.586 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.542+0000 7f6c3c7e0b80 1 -- 172.21.15.163:0/1959547250 shutdown_connections 2023-07-14T18:13:29.586 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.542+0000 7f6c3c7e0b80 1 -- 172.21.15.163:0/1959547250 wait complete. 2023-07-14T18:13:29.586 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.542+0000 7f6c3c7e0b80 1 -- start start 2023-07-14T18:13:29.586 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.542+0000 7f6c3c7e0b80 1 Processor -- start 2023-07-14T18:13:29.587 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.542+0000 7f6c3c7e0b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556463607f60 0x556463616e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:13:29.589 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.542+0000 7f6c3c7e0b80 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5564636088b0 0x5564636173c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:13:29.589 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.542+0000 7f6c3c7e0b80 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5564636094b0 0x5564636183d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:13:29.589 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.542+0000 7f6c3c7e0b80 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x556463618910 con 0x5564636088b0 2023-07-14T18:13:29.590 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.542+0000 7f6c3c7e0b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x556463618a80 con 0x556463607f60 2023-07-14T18:13:29.590 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.542+0000 7f6c3c7e0b80 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x556463618c40 con 0x5564636094b0 2023-07-14T18:13:29.590 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.542+0000 7f6c3c7e0b80 10 client.0 _ll_register_callbacks cb 0x7f6c24099d30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T18:13:29.590 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.543+0000 7f6c2dbe3700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5564636088b0 0x5564636173c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:13:29.590 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.543+0000 7f6c2dbe3700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5564636088b0 0x5564636173c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:58532/0 (socket says 172.21.15.163:58532) 2023-07-14T18:13:29.590 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.543+0000 7f6c2dbe3700 1 -- 172.21.15.163:0/3610844895 learned_addr learned my addr 172.21.15.163:0/3610844895 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:13:29.590 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.543+0000 7f6c2ebe5700 1 --2- 172.21.15.163:0/3610844895 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5564636094b0 0x5564636183d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:13:29.591 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.543+0000 7f6c2e3e4700 1 --2- 172.21.15.163:0/3610844895 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556463607f60 0x556463616e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:13:29.591 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.543+0000 7f6c2dbe3700 1 -- 172.21.15.163:0/3610844895 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5564636094b0 msgr2=0x5564636183d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:13:29.591 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.543+0000 7f6c2dbe3700 1 --2- 172.21.15.163:0/3610844895 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5564636094b0 0x5564636183d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:13:29.591 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.543+0000 7f6c2dbe3700 1 -- 172.21.15.163:0/3610844895 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556463607f60 msgr2=0x556463616e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:13:29.591 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.543+0000 7f6c2dbe3700 1 --2- 172.21.15.163:0/3610844895 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556463607f60 0x556463616e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:13:29.591 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.543+0000 7f6c2dbe3700 1 -- 172.21.15.163:0/3610844895 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55646336fc60 con 0x5564636088b0 2023-07-14T18:13:29.591 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.543+0000 7f6c2dbe3700 1 --2- 172.21.15.163:0/3610844895 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5564636088b0 0x5564636173c0 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f6c18003f60 tx=0x7f6c18009ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a6132d7151cead34 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:13:29.592 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.543+0000 7f6c11ffb700 10 client.0 ms_handle_connect on v2:172.21.15.163:3300/0 2023-07-14T18:13:29.592 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.543+0000 7f6c11ffb700 1 -- 172.21.15.163:0/3610844895 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c1802b040 con 0x5564636088b0 2023-07-14T18:13:29.592 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.543+0000 7f6c11ffb700 1 -- 172.21.15.163:0/3610844895 <== mon.0 v2:172.21.15.163:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 9049+0+0 (secure 0 0 0) 0x7f6c180350e0 con 0x5564636088b0 2023-07-14T18:13:29.592 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.543+0000 7f6c3c7e0b80 1 -- 172.21.15.163:0/3610844895 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f6c2000f040 con 0x5564636088b0 2023-07-14T18:13:29.592 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.544+0000 7f6c11ffb700 1 -- 172.21.15.163:0/3610844895 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6c18005530 con 0x5564636088b0 2023-07-14T18:13:29.593 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.544+0000 7f6c3c7e0b80 10 client.15882 fetch_fsmap learned FSMap version 29 2023-07-14T18:13:29.593 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.544+0000 7f6c3c7e0b80 1 -- 172.21.15.163:0/3610844895 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) v3 -- 0x5564633852b0 con 0x5564636088b0 2023-07-14T18:13:29.593 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.544+0000 7f6c11ffb700 1 -- 172.21.15.163:0/3610844895 <== mon.0 v2:172.21.15.163:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f6c2000f040 con 0x5564636088b0 2023-07-14T18:13:29.593 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.544+0000 7f6c11ffb700 1 -- 172.21.15.163:0/3610844895 <== mon.0 v2:172.21.15.163:3300/0 5 ==== fsmap(e 29) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f6c1800b910 con 0x5564636088b0 2023-07-14T18:13:29.593 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.544+0000 7f6c3c7e0b80 10 client.15882 fetch_fsmap finished waiting for FSMap version 29 2023-07-14T18:13:29.593 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.544+0000 7f6c3c7e0b80 10 client.15882 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.c 2023-07-14T18:13:29.593 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.544+0000 7f6c3c7e0b80 20 client.15882 populate_metadata read hostname 'smithi163' 2023-07-14T18:13:29.594 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.544+0000 7f6c3c7e0b80 1 --2- 172.21.15.163:0/3610844895 >> [v2:172.21.15.184:6836/3389277679,v1:172.21.15.184:6837/3389277679] conn(0x55646367ac80 0x55646367d090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:13:29.594 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.544+0000 7f6c3c7e0b80 4 client.15882 mds_command: new command op to 24478 tid=0[{"prefix": "damage ls"}] 2023-07-14T18:13:29.594 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.544+0000 7f6c3c7e0b80 1 -- 172.21.15.163:0/3610844895 --> [v2:172.21.15.184:6836/3389277679,v1:172.21.15.184:6837/3389277679] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x556463551eb0 con 0x55646367ac80 2023-07-14T18:13:29.594 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.544+0000 7f6c2e3e4700 1 --2- 172.21.15.163:0/3610844895 >> [v2:172.21.15.184:6836/3389277679,v1:172.21.15.184:6837/3389277679] conn(0x55646367ac80 0x55646367d090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:13:29.594 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.545+0000 7f6c2e3e4700 1 --2- 172.21.15.163:0/3610844895 >> [v2:172.21.15.184:6836/3389277679,v1:172.21.15.184:6837/3389277679] conn(0x55646367ac80 0x55646367d090 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=e965851d6a7a5492 server_cookie=a0fe1c8e9213df05 in_seq=0 out_seq=0 2023-07-14T18:13:29.594 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.545+0000 7f6c11ffb700 10 client.15882 ms_handle_connect on v2:172.21.15.184:6836/3389277679 2023-07-14T18:13:29.594 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.545+0000 7f6c11ffb700 1 -- 172.21.15.163:0/3610844895 <== mds.3 v2:172.21.15.184:6836/3389277679 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x556463551eb0 con 0x55646367ac80 2023-07-14T18:13:29.594 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.545+0000 7f6c11ffb700 10 client.15882 handle_command_reply: tid=0 2023-07-14T18:13:29.595 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.545+0000 7f6c3c7e0b80 1 client.15882 shutdown 2023-07-14T18:13:29.595 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.545+0000 7f6c3c7e0b80 1 -- 172.21.15.163:0/3610844895 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5564636088b0 msgr2=0x5564636173c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:13:29.595 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.545+0000 7f6c3c7e0b80 1 --2- 172.21.15.163:0/3610844895 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5564636088b0 0x5564636173c0 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f6c18003f60 tx=0x7f6c18009ca0 comp rx=0 tx=0).stop 2023-07-14T18:13:29.595 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.545+0000 7f6c3c7e0b80 1 -- 172.21.15.163:0/3610844895 shutdown_connections 2023-07-14T18:13:29.595 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.545+0000 7f6c3c7e0b80 1 --2- 172.21.15.163:0/3610844895 >> [v2:172.21.15.184:6836/3389277679,v1:172.21.15.184:6837/3389277679] conn(0x55646367ac80 0x55646367d090 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:13:29.595 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.545+0000 7f6c3c7e0b80 1 --2- 172.21.15.163:0/3610844895 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5564636094b0 0x5564636183d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:13:29.595 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.545+0000 7f6c3c7e0b80 1 --2- 172.21.15.163:0/3610844895 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556463607f60 0x556463616e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:13:29.595 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.545+0000 7f6c3c7e0b80 1 --2- 172.21.15.163:0/3610844895 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5564636088b0 0x5564636173c0 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:13:29.596 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.545+0000 7f6c3c7e0b80 1 -- 172.21.15.163:0/3610844895 >> 172.21.15.163:0/3610844895 conn(0x5564635fd680 msgr2=0x55646360f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:13:29.596 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.546+0000 7f6c11ffb700 0 client.15882 ms_handle_reset on v2:172.21.15.184:6836/3389277679 2023-07-14T18:13:29.596 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.546+0000 7f6c3c7e0b80 1 -- 172.21.15.163:0/3610844895 shutdown_connections 2023-07-14T18:13:29.596 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.546+0000 7f6c3c7e0b80 1 -- 172.21.15.163:0/3610844895 wait complete. 2023-07-14T18:13:29.596 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.546+0000 7f6c3c7e0b80 20 client.15882 trim_cache size 0 max 16384 2023-07-14T18:13:29.596 INFO:teuthology.orchestra.run.smithi163.stdout:[] 2023-07-14T18:13:29.597 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.546+0000 7f6c30648700 1 -- 172.21.15.163:0/3828822288 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f6c140a1150 msgr2=0x7f6c140a3600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:13:29.597 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.546+0000 7f6c30648700 1 --2- 172.21.15.163:0/3828822288 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f6c140a1150 0x7f6c140a3600 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f6c18006010 tx=0x7f6c1800b260 comp rx=0 tx=0).stop 2023-07-14T18:13:29.597 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.546+0000 7f6c30648700 1 -- 172.21.15.163:0/3828822288 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f6c280feb80 msgr2=0x7f6c281958e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:13:29.598 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.546+0000 7f6c30648700 1 --2- 172.21.15.163:0/3828822288 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f6c280feb80 0x7f6c281958e0 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f6c2400e970 tx=0x7f6c2400ec80 comp rx=0 tx=0).stop 2023-07-14T18:13:29.598 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.546+0000 7f6c30648700 1 -- 172.21.15.163:0/3828822288 shutdown_connections 2023-07-14T18:13:29.598 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.546+0000 7f6c30648700 1 --2- 172.21.15.163:0/3828822288 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f6c140a1150 0x7f6c140a3600 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:13:29.598 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.546+0000 7f6c30648700 1 --2- 172.21.15.163:0/3828822288 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6c28100700 0x7f6c2819ce90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:13:29.598 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.546+0000 7f6c30648700 1 --2- 172.21.15.163:0/3828822288 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f6c280feb80 0x7f6c281958e0 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:13:29.598 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.546+0000 7f6c30648700 1 --2- 172.21.15.163:0/3828822288 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6c280ffd70 0x7f6c28195e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:13:29.598 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.547+0000 7f6c30648700 1 -- 172.21.15.163:0/3828822288 >> 172.21.15.163:0/3828822288 conn(0x7f6c280fa1a0 msgr2=0x7f6c281032f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:13:29.599 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.547+0000 7f6c30648700 1 -- 172.21.15.163:0/3828822288 shutdown_connections 2023-07-14T18:13:29.599 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.547+0000 7f6c30648700 1 -- 172.21.15.163:0/3828822288 wait complete. 2023-07-14T18:13:29.601 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:2 damage ls 2023-07-14T18:13:29.735 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.693+0000 7f4f603e4700 1 -- 172.21.15.163:0/78756348 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f4f581018f0 msgr2=0x7f4f581081b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:13:29.735 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.693+0000 7f4f603e4700 1 --2- 172.21.15.163:0/78756348 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f4f581018f0 0x7f4f581081b0 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f4f5000b0a0 tx=0x7f4f5000b3b0 comp rx=0 tx=0).stop 2023-07-14T18:13:29.736 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.694+0000 7f4f603e4700 1 -- 172.21.15.163:0/78756348 shutdown_connections 2023-07-14T18:13:29.736 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.694+0000 7f4f603e4700 1 --2- 172.21.15.163:0/78756348 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f4f581018f0 0x7f4f581081b0 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:13:29.736 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.694+0000 7f4f603e4700 1 --2- 172.21.15.163:0/78756348 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4f580fdf90 0x7f4f580fe3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:13:29.736 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.694+0000 7f4f603e4700 1 --2- 172.21.15.163:0/78756348 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4f58100f60 0x7f4f581013b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:13:29.736 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.694+0000 7f4f603e4700 1 -- 172.21.15.163:0/78756348 >> 172.21.15.163:0/78756348 conn(0x7f4f580f9950 msgr2=0x7f4f580fbda0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:13:29.736 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.694+0000 7f4f603e4700 1 -- 172.21.15.163:0/78756348 shutdown_connections 2023-07-14T18:13:29.737 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.694+0000 7f4f603e4700 1 -- 172.21.15.163:0/78756348 wait complete. 2023-07-14T18:13:29.738 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.694+0000 7f4f603e4700 1 Processor -- start 2023-07-14T18:13:29.738 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.695+0000 7f4f603e4700 1 -- start start 2023-07-14T18:13:29.738 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.695+0000 7f4f603e4700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4f580fdf90 0x7f4f58195980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:13:29.738 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.695+0000 7f4f603e4700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4f58100f60 0x7f4f58195ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:13:29.739 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.695+0000 7f4f603e4700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f4f581018f0 0x7f4f5819cf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:13:29.739 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.695+0000 7f4f603e4700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f5819d500 con 0x7f4f581018f0 2023-07-14T18:13:29.739 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.695+0000 7f4f603e4700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f5819d640 con 0x7f4f58100f60 2023-07-14T18:13:29.739 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.695+0000 7f4f603e4700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f5819d7d0 con 0x7f4f580fdf90 2023-07-14T18:13:29.740 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.695+0000 7f4f5e981700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f4f581018f0 0x7f4f5819cf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:13:29.740 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.695+0000 7f4f5e981700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f4f581018f0 0x7f4f5819cf30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:58548/0 (socket says 172.21.15.163:58548) 2023-07-14T18:13:29.740 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.695+0000 7f4f5e981700 1 -- 172.21.15.163:0/2516447610 learned_addr learned my addr 172.21.15.163:0/2516447610 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:13:29.740 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.695+0000 7f4f5e180700 1 --2- 172.21.15.163:0/2516447610 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4f580fdf90 0x7f4f58195980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:13:29.740 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.695+0000 7f4f5d97f700 1 --2- 172.21.15.163:0/2516447610 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4f58100f60 0x7f4f58195ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:13:29.740 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.695+0000 7f4f5e981700 1 -- 172.21.15.163:0/2516447610 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4f580fdf90 msgr2=0x7f4f58195980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:13:29.740 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.695+0000 7f4f5e981700 1 --2- 172.21.15.163:0/2516447610 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4f580fdf90 0x7f4f58195980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:13:29.741 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.695+0000 7f4f5e981700 1 -- 172.21.15.163:0/2516447610 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4f58100f60 msgr2=0x7f4f58195ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:13:29.741 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.695+0000 7f4f5e981700 1 --2- 172.21.15.163:0/2516447610 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4f58100f60 0x7f4f58195ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:13:29.741 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.695+0000 7f4f5e981700 1 -- 172.21.15.163:0/2516447610 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f50009d00 con 0x7f4f581018f0 2023-07-14T18:13:29.741 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.696+0000 7f4f5e981700 1 --2- 172.21.15.163:0/2516447610 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f4f581018f0 0x7f4f5819cf30 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f4f5000b780 tx=0x7f4f5000bd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:13:29.741 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.696+0000 7f4f4f7fe700 1 -- 172.21.15.163:0/2516447610 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f5000e040 con 0x7f4f581018f0 2023-07-14T18:13:29.741 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.696+0000 7f4f4f7fe700 1 -- 172.21.15.163:0/2516447610 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f4f50020070 con 0x7f4f581018f0 2023-07-14T18:13:29.742 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.696+0000 7f4f4f7fe700 1 -- 172.21.15.163:0/2516447610 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f500276a0 con 0x7f4f581018f0 2023-07-14T18:13:29.742 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.696+0000 7f4f603e4700 1 -- 172.21.15.163:0/2516447610 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f580fed50 con 0x7f4f581018f0 2023-07-14T18:13:29.742 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.696+0000 7f4f603e4700 1 -- 172.21.15.163:0/2516447610 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f580ff210 con 0x7f4f581018f0 2023-07-14T18:13:29.743 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.699+0000 7f4f4f7fe700 1 -- 172.21.15.163:0/2516447610 <== mon.0 v2:172.21.15.163:3300/0 4 ==== mgrmap(e 18) v1 ==== 135716+0+0 (secure 0 0 0) 0x7f4f5001c6c0 con 0x7f4f581018f0 2023-07-14T18:13:29.743 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.700+0000 7f4f4f7fe700 1 --2- 172.21.15.163:0/2516447610 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f4f440a1150 0x7f4f440a3600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:13:29.743 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.700+0000 7f4f4f7fe700 1 -- 172.21.15.163:0/2516447610 <== mon.0 v2:172.21.15.163:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 9049+0+0 (secure 0 0 0) 0x7f4f50022070 con 0x7f4f581018f0 2023-07-14T18:13:29.744 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.700+0000 7f4f5e180700 1 --2- 172.21.15.163:0/2516447610 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f4f440a1150 0x7f4f440a3600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:13:29.744 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.700+0000 7f4f5e180700 1 --2- 172.21.15.163:0/2516447610 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f4f440a1150 0x7f4f440a3600 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f4f580687b0 tx=0x7f4f54009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:13:29.744 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.701+0000 7f4f6c57cb80 1 Processor -- start 2023-07-14T18:13:29.744 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.701+0000 7f4f6c57cb80 1 -- start start 2023-07-14T18:13:29.744 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.701+0000 7f4f6c57cb80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560c7e7b7f60 0x560c7e7b8370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:13:29.744 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.701+0000 7f4f6c57cb80 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x560c7e7b88b0 0x560c7e7b8ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:13:29.744 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.701+0000 7f4f6c57cb80 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x560c7e7b94b0 0x560c7e7b9920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:13:29.745 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.701+0000 7f4f6c57cb80 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x560c7e6bccb0 con 0x560c7e7b94b0 2023-07-14T18:13:29.745 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.701+0000 7f4f6c57cb80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x560c7e70fa40 con 0x560c7e7b7f60 2023-07-14T18:13:29.745 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.701+0000 7f4f6c57cb80 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x560c7e708ed0 con 0x560c7e7b88b0 2023-07-14T18:13:29.745 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.702+0000 7f4f5e180700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560c7e7b7f60 0x560c7e7b8370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:13:29.745 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.702+0000 7f4f5d97f700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x560c7e7b88b0 0x560c7e7b8ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:13:29.745 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.702+0000 7f4f5e180700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560c7e7b7f60 0x560c7e7b8370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.163:59236/0 (socket says 172.21.15.163:59236) 2023-07-14T18:13:29.745 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.702+0000 7f4f5e180700 1 -- 172.21.15.163:0/2195955307 learned_addr learned my addr 172.21.15.163:0/2195955307 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:13:29.746 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.702+0000 7f4f5e981700 1 --2- 172.21.15.163:0/2195955307 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x560c7e7b94b0 0x560c7e7b9920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:13:29.746 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.702+0000 7f4f5d97f700 1 -- 172.21.15.163:0/2195955307 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560c7e7b7f60 msgr2=0x560c7e7b8370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:13:29.746 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.702+0000 7f4f5d97f700 1 --2- 172.21.15.163:0/2195955307 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560c7e7b7f60 0x560c7e7b8370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:13:29.746 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.702+0000 7f4f5d97f700 1 -- 172.21.15.163:0/2195955307 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x560c7e7b94b0 msgr2=0x560c7e7b9920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:13:29.746 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.702+0000 7f4f5d97f700 1 --2- 172.21.15.163:0/2195955307 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x560c7e7b94b0 0x560c7e7b9920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:13:29.746 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.702+0000 7f4f5d97f700 1 -- 172.21.15.163:0/2195955307 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560c7e536de0 con 0x560c7e7b88b0 2023-07-14T18:13:29.746 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.702+0000 7f4f5d97f700 1 --2- 172.21.15.163:0/2195955307 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x560c7e7b88b0 0x560c7e7b8ed0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f4f48007bf0 tx=0x7f4f48007f00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e45a7700cd0f6403 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:13:29.750 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.702+0000 7f4f4cdaa700 1 -- 172.21.15.163:0/2195955307 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f48010c40 con 0x560c7e7b88b0 2023-07-14T18:13:29.750 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.702+0000 7f4f4cdaa700 1 -- 172.21.15.163:0/2195955307 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f4f480044c0 con 0x560c7e7b88b0 2023-07-14T18:13:29.750 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.702+0000 7f4f4cdaa700 1 -- 172.21.15.163:0/2195955307 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f48005020 con 0x560c7e7b88b0 2023-07-14T18:13:29.750 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.703+0000 7f4f6c57cb80 1 -- 172.21.15.163:0/2195955307 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x560c7e7b88b0 msgr2=0x560c7e7b8ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:13:29.750 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.703+0000 7f4f6c57cb80 1 --2- 172.21.15.163:0/2195955307 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x560c7e7b88b0 0x560c7e7b8ed0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f4f48007bf0 tx=0x7f4f48007f00 comp rx=0 tx=0).stop 2023-07-14T18:13:29.751 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.703+0000 7f4f6c57cb80 1 -- 172.21.15.163:0/2195955307 shutdown_connections 2023-07-14T18:13:29.751 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.703+0000 7f4f6c57cb80 1 --2- 172.21.15.163:0/2195955307 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x560c7e7b94b0 0x560c7e7b9920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:13:29.751 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.703+0000 7f4f6c57cb80 1 --2- 172.21.15.163:0/2195955307 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560c7e7b7f60 0x560c7e7b8370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:13:29.751 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.703+0000 7f4f6c57cb80 1 --2- 172.21.15.163:0/2195955307 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x560c7e7b88b0 0x560c7e7b8ed0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:13:29.751 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.703+0000 7f4f6c57cb80 1 -- 172.21.15.163:0/2195955307 >> 172.21.15.163:0/2195955307 conn(0x560c7e7ad680 msgr2=0x560c7e7b29d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:13:29.751 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.704+0000 7f4f6c57cb80 1 -- 172.21.15.163:0/2195955307 shutdown_connections 2023-07-14T18:13:29.751 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.704+0000 7f4f6c57cb80 1 -- 172.21.15.163:0/2195955307 wait complete. 2023-07-14T18:13:29.751 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.704+0000 7f4f6c57cb80 1 -- start start 2023-07-14T18:13:29.752 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.704+0000 7f4f6c57cb80 1 Processor -- start 2023-07-14T18:13:29.752 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.704+0000 7f4f6c57cb80 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x560c7e7b7f60 0x560c7e7c1990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:13:29.752 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.704+0000 7f4f6c57cb80 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x560c7e7b88b0 0x560c7e7c1ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:13:29.752 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.704+0000 7f4f6c57cb80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560c7e7b94b0 0x560c7e7c8f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:13:29.752 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.704+0000 7f4f6c57cb80 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x560c7e6a8ac0 con 0x560c7e7b88b0 2023-07-14T18:13:29.752 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.704+0000 7f4f6c57cb80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x560c7e6a87c0 con 0x560c7e7b94b0 2023-07-14T18:13:29.752 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.704+0000 7f4f6c57cb80 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x560c7e58c920 con 0x560c7e7b7f60 2023-07-14T18:13:29.753 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.705+0000 7f4f6c57cb80 10 client.0 _ll_register_callbacks cb 0x560c7e6a6760 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T18:13:29.753 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.705+0000 7f4f5e180700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x560c7e7b7f60 0x560c7e7c1990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:13:29.753 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.705+0000 7f4f5e180700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x560c7e7b7f60 0x560c7e7c1990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.163:40380/0 (socket says 172.21.15.163:40380) 2023-07-14T18:13:29.753 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.705+0000 7f4f5e180700 1 -- 172.21.15.163:0/4160853243 learned_addr learned my addr 172.21.15.163:0/4160853243 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:13:29.753 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.705+0000 7f4f5d97f700 1 --2- 172.21.15.163:0/4160853243 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x560c7e7b88b0 0x560c7e7c1ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:13:29.753 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.705+0000 7f4f5e981700 1 --2- 172.21.15.163:0/4160853243 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560c7e7b94b0 0x560c7e7c8f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:13:29.753 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.705+0000 7f4f5e180700 1 -- 172.21.15.163:0/4160853243 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560c7e7b94b0 msgr2=0x560c7e7c8f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:13:29.753 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.705+0000 7f4f5e180700 1 --2- 172.21.15.163:0/4160853243 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560c7e7b94b0 0x560c7e7c8f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:13:29.754 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.705+0000 7f4f5e180700 1 -- 172.21.15.163:0/4160853243 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x560c7e7b88b0 msgr2=0x560c7e7c1ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:13:29.754 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.705+0000 7f4f5e180700 1 --2- 172.21.15.163:0/4160853243 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x560c7e7b88b0 0x560c7e7c1ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:13:29.754 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.705+0000 7f4f5e180700 1 -- 172.21.15.163:0/4160853243 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f480078a0 con 0x560c7e7b7f60 2023-07-14T18:13:29.754 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.705+0000 7f4f5e981700 1 --2- 172.21.15.163:0/4160853243 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560c7e7b94b0 0x560c7e7c8f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T18:13:29.754 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.705+0000 7f4f5e180700 1 --2- 172.21.15.163:0/4160853243 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x560c7e7b7f60 0x560c7e7c1990 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f4f54009b20 tx=0x7f4f540047c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2b023c85139e3cdc server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:13:29.754 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.705+0000 7f4f41ffb700 10 client.0 ms_handle_connect on v2:172.21.15.184:3300/0 2023-07-14T18:13:29.754 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.705+0000 7f4f41ffb700 1 -- 172.21.15.163:0/4160853243 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f54022070 con 0x560c7e7b7f60 2023-07-14T18:13:29.754 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.706+0000 7f4f6c57cb80 1 -- 172.21.15.163:0/4160853243 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x560c7e6624f0 con 0x560c7e7b7f60 2023-07-14T18:13:29.755 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.706+0000 7f4f41ffb700 1 -- 172.21.15.163:0/4160853243 <== mon.1 v2:172.21.15.184:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 9049+0+0 (secure 0 0 0) 0x7f4f5401c810 con 0x560c7e7b7f60 2023-07-14T18:13:29.755 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.706+0000 7f4f41ffb700 1 -- 172.21.15.163:0/4160853243 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4f5401c9d0 con 0x560c7e7b7f60 2023-07-14T18:13:29.755 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.706+0000 7f4f6c57cb80 10 client.25480 fetch_fsmap learned FSMap version 29 2023-07-14T18:13:29.755 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.706+0000 7f4f6c57cb80 1 -- 172.21.15.163:0/4160853243 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) v3 -- 0x560c7e51fc60 con 0x560c7e7b7f60 2023-07-14T18:13:29.755 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.706+0000 7f4f41ffb700 1 -- 172.21.15.163:0/4160853243 <== mon.1 v2:172.21.15.184:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x560c7e6624f0 con 0x560c7e7b7f60 2023-07-14T18:13:29.755 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.706+0000 7f4f41ffb700 1 -- 172.21.15.163:0/4160853243 <== mon.1 v2:172.21.15.184:3300/0 5 ==== fsmap(e 29) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f4f54026c30 con 0x560c7e7b7f60 2023-07-14T18:13:29.755 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.706+0000 7f4f6c57cb80 10 client.25480 fetch_fsmap finished waiting for FSMap version 29 2023-07-14T18:13:29.756 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.706+0000 7f4f6c57cb80 10 client.25480 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2023-07-14T18:13:29.756 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.706+0000 7f4f6c57cb80 20 client.25480 populate_metadata read hostname 'smithi163' 2023-07-14T18:13:29.756 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.706+0000 7f4f6c57cb80 1 --2- 172.21.15.163:0/4160853243 >> [v2:172.21.15.172:6836/3783835012,v1:172.21.15.172:6837/3783835012] conn(0x560c7e7cd740 0x560c7e7cfb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:13:29.756 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.706+0000 7f4f6c57cb80 4 client.25480 mds_command: new command op to 24479 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-14T18:13:29.756 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.706+0000 7f4f6c57cb80 1 -- 172.21.15.163:0/4160853243 --> [v2:172.21.15.172:6836/3783835012,v1:172.21.15.172:6837/3783835012] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x560c7e786da0 con 0x560c7e7cd740 2023-07-14T18:13:29.756 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.707+0000 7f4f5d97f700 1 --2- 172.21.15.163:0/4160853243 >> [v2:172.21.15.172:6836/3783835012,v1:172.21.15.172:6837/3783835012] conn(0x560c7e7cd740 0x560c7e7cfb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:13:29.756 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.707+0000 7f4f5d97f700 1 --2- 172.21.15.163:0/4160853243 >> [v2:172.21.15.172:6836/3783835012,v1:172.21.15.172:6837/3783835012] conn(0x560c7e7cd740 0x560c7e7cfb50 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=9754b195155cfad7 server_cookie=d5f2a82f04381688 in_seq=0 out_seq=0 2023-07-14T18:13:29.756 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.707+0000 7f4f41ffb700 10 client.25480 ms_handle_connect on v2:172.21.15.172:6836/3783835012 2023-07-14T18:13:29.757 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.708+0000 7f4f41ffb700 1 -- 172.21.15.163:0/4160853243 <== mds.2 v2:172.21.15.172:6836/3783835012 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18017 (crc 0 0 0) 0x560c7e786da0 con 0x560c7e7cd740 2023-07-14T18:13:29.757 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.708+0000 7f4f41ffb700 10 client.25480 handle_command_reply: tid=0 2023-07-14T18:13:29.757 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.708+0000 7f4f6c57cb80 1 client.25480 shutdown 2023-07-14T18:13:29.757 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.708+0000 7f4f6c57cb80 1 -- 172.21.15.163:0/4160853243 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x560c7e7b7f60 msgr2=0x560c7e7c1990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:13:29.757 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.708+0000 7f4f6c57cb80 1 --2- 172.21.15.163:0/4160853243 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x560c7e7b7f60 0x560c7e7c1990 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f4f54009b20 tx=0x7f4f540047c0 comp rx=0 tx=0).stop 2023-07-14T18:13:29.757 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.708+0000 7f4f6c57cb80 1 -- 172.21.15.163:0/4160853243 shutdown_connections 2023-07-14T18:13:29.757 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.708+0000 7f4f6c57cb80 1 --2- 172.21.15.163:0/4160853243 >> [v2:172.21.15.172:6836/3783835012,v1:172.21.15.172:6837/3783835012] conn(0x560c7e7cd740 0x560c7e7cfb50 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:13:29.757 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.708+0000 7f4f6c57cb80 1 --2- 172.21.15.163:0/4160853243 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x560c7e7b7f60 0x560c7e7c1990 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:13:29.758 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.708+0000 7f4f41ffb700 0 client.25480 ms_handle_reset on v2:172.21.15.172:6836/3783835012 2023-07-14T18:13:29.758 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.708+0000 7f4f6c57cb80 1 --2- 172.21.15.163:0/4160853243 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560c7e7b94b0 0x560c7e7c8f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:13:29.758 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.708+0000 7f4f6c57cb80 1 --2- 172.21.15.163:0/4160853243 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x560c7e7b88b0 0x560c7e7c1ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:13:29.758 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.708+0000 7f4f6c57cb80 1 -- 172.21.15.163:0/4160853243 >> 172.21.15.163:0/4160853243 conn(0x560c7e7ad680 msgr2=0x560c7e7b1650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:13:29.758 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.708+0000 7f4f6c57cb80 1 -- 172.21.15.163:0/4160853243 shutdown_connections 2023-07-14T18:13:29.758 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.708+0000 7f4f6c57cb80 1 -- 172.21.15.163:0/4160853243 wait complete. 2023-07-14T18:13:29.758 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.708+0000 7f4f6c57cb80 20 client.25480 trim_cache size 0 max 16384 2023-07-14T18:13:29.774 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.733+0000 7f4f6c57cb80 1 Processor -- start 2023-07-14T18:13:29.775 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.733+0000 7f4f6c57cb80 1 -- start start 2023-07-14T18:13:29.775 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.733+0000 7f4f6c57cb80 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x560c7e7b7f60 0x560c7e7b9880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:13:29.775 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.733+0000 7f4f6c57cb80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560c7e7b88b0 0x560c7e7c8ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:13:29.775 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.733+0000 7f4f6c57cb80 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x560c7e7b94b0 0x560c7e7c0670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:13:29.775 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.733+0000 7f4f6c57cb80 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x560c7e7b3cf0 con 0x560c7e7b94b0 2023-07-14T18:13:29.775 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.733+0000 7f4f6c57cb80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x560c7e7b8cf0 con 0x560c7e7b88b0 2023-07-14T18:13:29.776 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.733+0000 7f4f6c57cb80 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x560c7e7cd440 con 0x560c7e7b7f60 2023-07-14T18:13:29.776 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.733+0000 7f4f5e981700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x560c7e7b94b0 0x560c7e7c0670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:13:29.776 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.733+0000 7f4f5e981700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x560c7e7b94b0 0x560c7e7c0670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:58568/0 (socket says 172.21.15.163:58568) 2023-07-14T18:13:29.776 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.733+0000 7f4f5e981700 1 -- 172.21.15.163:0/4185840878 learned_addr learned my addr 172.21.15.163:0/4185840878 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:13:29.778 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.734+0000 7f4f5e180700 1 --2- 172.21.15.163:0/4185840878 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x560c7e7b7f60 0x560c7e7b9880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:13:29.779 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.734+0000 7f4f5e981700 1 -- 172.21.15.163:0/4185840878 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x560c7e7b7f60 msgr2=0x560c7e7b9880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:13:29.779 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.734+0000 7f4f5e981700 1 --2- 172.21.15.163:0/4185840878 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x560c7e7b7f60 0x560c7e7b9880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:13:29.779 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.734+0000 7f4f5e981700 1 -- 172.21.15.163:0/4185840878 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560c7e7b88b0 msgr2=0x560c7e7c8ed0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-07-14T18:13:29.779 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.734+0000 7f4f5e981700 1 --2- 172.21.15.163:0/4185840878 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560c7e7b88b0 0x560c7e7c8ed0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:13:29.779 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.734+0000 7f4f5e981700 1 -- 172.21.15.163:0/4185840878 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560c7e55d250 con 0x560c7e7b94b0 2023-07-14T18:13:29.780 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.734+0000 7f4f5e981700 1 --2- 172.21.15.163:0/4185840878 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x560c7e7b94b0 0x560c7e7c0670 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f4f5009b560 tx=0x7f4f5000b3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=936c87b126d12eed server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:13:29.780 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.734+0000 7f4f4d5ab700 1 -- 172.21.15.163:0/4185840878 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f5009e9c0 con 0x560c7e7b94b0 2023-07-14T18:13:29.780 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.734+0000 7f4f4d5ab700 1 -- 172.21.15.163:0/4185840878 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f4f5001c970 con 0x560c7e7b94b0 2023-07-14T18:13:29.780 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.734+0000 7f4f4d5ab700 1 -- 172.21.15.163:0/4185840878 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f5009e550 con 0x560c7e7b94b0 2023-07-14T18:13:29.780 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.735+0000 7f4f6c57cb80 1 -- 172.21.15.163:0/4185840878 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x560c7e7b94b0 msgr2=0x560c7e7c0670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:13:29.780 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.735+0000 7f4f6c57cb80 1 --2- 172.21.15.163:0/4185840878 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x560c7e7b94b0 0x560c7e7c0670 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f4f5009b560 tx=0x7f4f5000b3b0 comp rx=0 tx=0).stop 2023-07-14T18:13:29.781 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.735+0000 7f4f6c57cb80 1 -- 172.21.15.163:0/4185840878 shutdown_connections 2023-07-14T18:13:29.781 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.735+0000 7f4f6c57cb80 1 --2- 172.21.15.163:0/4185840878 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x560c7e7b7f60 0x560c7e7b9880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:13:29.781 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.735+0000 7f4f6c57cb80 1 --2- 172.21.15.163:0/4185840878 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x560c7e7b94b0 0x560c7e7c0670 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:13:29.781 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.735+0000 7f4f6c57cb80 1 --2- 172.21.15.163:0/4185840878 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560c7e7b88b0 0x560c7e7c8ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:13:29.782 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.735+0000 7f4f6c57cb80 1 -- 172.21.15.163:0/4185840878 >> 172.21.15.163:0/4185840878 conn(0x560c7e7ad680 msgr2=0x560c7e7b29a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:13:29.782 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.735+0000 7f4f6c57cb80 1 -- 172.21.15.163:0/4185840878 shutdown_connections 2023-07-14T18:13:29.782 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.735+0000 7f4f6c57cb80 1 -- 172.21.15.163:0/4185840878 wait complete. 2023-07-14T18:13:29.782 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.736+0000 7f4f6c57cb80 1 -- start start 2023-07-14T18:13:29.782 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.736+0000 7f4f6c57cb80 1 Processor -- start 2023-07-14T18:13:29.782 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.736+0000 7f4f6c57cb80 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x560c7e7b7f60 0x560c7e7c8c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:13:29.783 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.736+0000 7f4f6c57cb80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560c7e7b88b0 0x560c7e7c7280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:13:29.783 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.736+0000 7f4f6c57cb80 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x560c7e7b94b0 0x560c7e7c77c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:13:29.784 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.736+0000 7f4f6c57cb80 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x560c7e7c7d90 con 0x560c7e7b94b0 2023-07-14T18:13:29.784 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.736+0000 7f4f6c57cb80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x560c7e7c7f00 con 0x560c7e7b88b0 2023-07-14T18:13:29.784 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.736+0000 7f4f6c57cb80 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x560c7e7c80c0 con 0x560c7e7b7f60 2023-07-14T18:13:29.784 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.736+0000 7f4f6c57cb80 10 client.0 _ll_register_callbacks cb 0x560c7e6a6760 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T18:13:29.784 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.736+0000 7f4f5e981700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x560c7e7b94b0 0x560c7e7c77c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:13:29.784 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.736+0000 7f4f5e981700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x560c7e7b94b0 0x560c7e7c77c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:58574/0 (socket says 172.21.15.163:58574) 2023-07-14T18:13:29.784 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.736+0000 7f4f5e981700 1 -- 172.21.15.163:0/2648895727 learned_addr learned my addr 172.21.15.163:0/2648895727 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:13:29.784 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.737+0000 7f4f5e180700 1 --2- 172.21.15.163:0/2648895727 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x560c7e7b7f60 0x560c7e7c8c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:13:29.785 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.737+0000 7f4f5d97f700 1 --2- 172.21.15.163:0/2648895727 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560c7e7b88b0 0x560c7e7c7280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:13:29.785 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.737+0000 7f4f5e981700 1 -- 172.21.15.163:0/2648895727 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x560c7e7b7f60 msgr2=0x560c7e7c8c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:13:29.785 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.737+0000 7f4f5e981700 1 --2- 172.21.15.163:0/2648895727 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x560c7e7b7f60 0x560c7e7c8c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:13:29.785 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.737+0000 7f4f5e981700 1 -- 172.21.15.163:0/2648895727 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560c7e7b88b0 msgr2=0x560c7e7c7280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:13:29.785 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.737+0000 7f4f5e981700 1 --2- 172.21.15.163:0/2648895727 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560c7e7b88b0 0x560c7e7c7280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:13:29.785 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.737+0000 7f4f5e981700 1 -- 172.21.15.163:0/2648895727 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f580ff210 con 0x560c7e7b94b0 2023-07-14T18:13:29.785 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.737+0000 7f4f5d97f700 1 --2- 172.21.15.163:0/2648895727 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560c7e7b88b0 0x560c7e7c7280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T18:13:29.786 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.737+0000 7f4f5e981700 1 --2- 172.21.15.163:0/2648895727 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x560c7e7b94b0 0x560c7e7c77c0 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f4f50009fd0 tx=0x7f4f50007500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e4dc5cbe6b2bc5cf server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:13:29.786 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.737+0000 7f4f41ffb700 10 client.0 ms_handle_connect on v2:172.21.15.163:3300/0 2023-07-14T18:13:29.786 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.737+0000 7f4f41ffb700 1 -- 172.21.15.163:0/2648895727 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f5009e9c0 con 0x560c7e7b94b0 2023-07-14T18:13:29.786 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.737+0000 7f4f41ffb700 1 -- 172.21.15.163:0/2648895727 <== mon.0 v2:172.21.15.163:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 9049+0+0 (secure 0 0 0) 0x7f4f5009f060 con 0x560c7e7b94b0 2023-07-14T18:13:29.786 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.737+0000 7f4f6c57cb80 1 -- 172.21.15.163:0/2648895727 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f4f480044c0 con 0x560c7e7b94b0 2023-07-14T18:13:29.786 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.737+0000 7f4f41ffb700 1 -- 172.21.15.163:0/2648895727 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4f500a3090 con 0x560c7e7b94b0 2023-07-14T18:13:29.786 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.737+0000 7f4f6c57cb80 10 client.15900 fetch_fsmap learned FSMap version 29 2023-07-14T18:13:29.786 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.737+0000 7f4f6c57cb80 1 -- 172.21.15.163:0/2648895727 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) v3 -- 0x560c7e5352b0 con 0x560c7e7b94b0 2023-07-14T18:13:29.788 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.738+0000 7f4f41ffb700 1 -- 172.21.15.163:0/2648895727 <== mon.0 v2:172.21.15.163:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f4f480044c0 con 0x560c7e7b94b0 2023-07-14T18:13:29.788 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.738+0000 7f4f41ffb700 1 -- 172.21.15.163:0/2648895727 <== mon.0 v2:172.21.15.163:3300/0 5 ==== fsmap(e 29) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f4f500cfb80 con 0x560c7e7b94b0 2023-07-14T18:13:29.788 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.738+0000 7f4f6c57cb80 10 client.15900 fetch_fsmap finished waiting for FSMap version 29 2023-07-14T18:13:29.788 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.738+0000 7f4f6c57cb80 10 client.15900 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2023-07-14T18:13:29.788 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.738+0000 7f4f6c57cb80 20 client.15900 populate_metadata read hostname 'smithi163' 2023-07-14T18:13:29.789 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.738+0000 7f4f6c57cb80 1 --2- 172.21.15.163:0/2648895727 >> [v2:172.21.15.172:6836/3783835012,v1:172.21.15.172:6837/3783835012] conn(0x560c7e822870 0x560c7e824c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:13:29.789 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.738+0000 7f4f6c57cb80 4 client.15900 mds_command: new command op to 24479 tid=0[{"prefix": "damage ls"}] 2023-07-14T18:13:29.789 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.738+0000 7f4f6c57cb80 1 -- 172.21.15.163:0/2648895727 --> [v2:172.21.15.172:6836/3783835012,v1:172.21.15.172:6837/3783835012] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x560c7e701eb0 con 0x560c7e822870 2023-07-14T18:13:29.789 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.738+0000 7f4f5e180700 1 --2- 172.21.15.163:0/2648895727 >> [v2:172.21.15.172:6836/3783835012,v1:172.21.15.172:6837/3783835012] conn(0x560c7e822870 0x560c7e824c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:13:29.789 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.739+0000 7f4f41ffb700 10 client.15900 ms_handle_connect on v2:172.21.15.172:6836/3783835012 2023-07-14T18:13:29.789 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.739+0000 7f4f5e180700 1 --2- 172.21.15.163:0/2648895727 >> [v2:172.21.15.172:6836/3783835012,v1:172.21.15.172:6837/3783835012] conn(0x560c7e822870 0x560c7e824c80 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=856938f5e8926bda server_cookie=8288840d170b2432 in_seq=0 out_seq=0 2023-07-14T18:13:29.789 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.739+0000 7f4f41ffb700 1 -- 172.21.15.163:0/2648895727 <== mds.2 v2:172.21.15.172:6836/3783835012 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x560c7e701eb0 con 0x560c7e822870 2023-07-14T18:13:29.790 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.739+0000 7f4f41ffb700 10 client.15900 handle_command_reply: tid=0 2023-07-14T18:13:29.790 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.739+0000 7f4f6c57cb80 1 client.15900 shutdown 2023-07-14T18:13:29.790 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.739+0000 7f4f6c57cb80 1 -- 172.21.15.163:0/2648895727 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x560c7e7b94b0 msgr2=0x560c7e7c77c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:13:29.790 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.739+0000 7f4f6c57cb80 1 --2- 172.21.15.163:0/2648895727 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x560c7e7b94b0 0x560c7e7c77c0 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f4f50009fd0 tx=0x7f4f50007500 comp rx=0 tx=0).stop 2023-07-14T18:13:29.790 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.739+0000 7f4f6c57cb80 1 -- 172.21.15.163:0/2648895727 shutdown_connections 2023-07-14T18:13:29.790 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.739+0000 7f4f6c57cb80 1 --2- 172.21.15.163:0/2648895727 >> [v2:172.21.15.172:6836/3783835012,v1:172.21.15.172:6837/3783835012] conn(0x560c7e822870 0x560c7e824c80 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:13:29.790 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.739+0000 7f4f6c57cb80 1 --2- 172.21.15.163:0/2648895727 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x560c7e7b7f60 0x560c7e7c8c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:13:29.790 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.739+0000 7f4f6c57cb80 1 --2- 172.21.15.163:0/2648895727 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x560c7e7b94b0 0x560c7e7c77c0 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:13:29.791 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.739+0000 7f4f6c57cb80 1 --2- 172.21.15.163:0/2648895727 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560c7e7b88b0 0x560c7e7c7280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:13:29.791 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.739+0000 7f4f41ffb700 0 client.15900 ms_handle_reset on v2:172.21.15.172:6836/3783835012 2023-07-14T18:13:29.791 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.739+0000 7f4f6c57cb80 1 -- 172.21.15.163:0/2648895727 >> 172.21.15.163:0/2648895727 conn(0x560c7e7ad680 msgr2=0x560c7e7c0670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:13:29.791 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.739+0000 7f4f6c57cb80 1 -- 172.21.15.163:0/2648895727 shutdown_connections 2023-07-14T18:13:29.791 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.739+0000 7f4f6c57cb80 1 -- 172.21.15.163:0/2648895727 wait complete. 2023-07-14T18:13:29.791 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.740+0000 7f4f6c57cb80 20 client.15900 trim_cache size 0 max 16384 2023-07-14T18:13:29.792 INFO:teuthology.orchestra.run.smithi163.stdout:[] 2023-07-14T18:13:29.792 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.740+0000 7f4f603e4700 1 -- 172.21.15.163:0/2516447610 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f4f440a1150 msgr2=0x7f4f440a3600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:13:29.792 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.740+0000 7f4f603e4700 1 --2- 172.21.15.163:0/2516447610 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f4f440a1150 0x7f4f440a3600 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f4f580687b0 tx=0x7f4f54009260 comp rx=0 tx=0).stop 2023-07-14T18:13:29.793 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.740+0000 7f4f603e4700 1 -- 172.21.15.163:0/2516447610 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f4f581018f0 msgr2=0x7f4f5819cf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:13:29.793 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.740+0000 7f4f603e4700 1 --2- 172.21.15.163:0/2516447610 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f4f581018f0 0x7f4f5819cf30 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f4f5000b780 tx=0x7f4f5000bd40 comp rx=0 tx=0).stop 2023-07-14T18:13:29.793 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.740+0000 7f4f603e4700 1 -- 172.21.15.163:0/2516447610 shutdown_connections 2023-07-14T18:13:29.793 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.740+0000 7f4f603e4700 1 --2- 172.21.15.163:0/2516447610 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f4f440a1150 0x7f4f440a3600 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:13:29.793 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.740+0000 7f4f603e4700 1 --2- 172.21.15.163:0/2516447610 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4f580fdf90 0x7f4f58195980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:13:29.793 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.740+0000 7f4f603e4700 1 --2- 172.21.15.163:0/2516447610 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f4f581018f0 0x7f4f5819cf30 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:13:29.794 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.740+0000 7f4f603e4700 1 --2- 172.21.15.163:0/2516447610 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4f58100f60 0x7f4f58195ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:13:29.794 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.740+0000 7f4f603e4700 1 -- 172.21.15.163:0/2516447610 >> 172.21.15.163:0/2516447610 conn(0x7f4f580f9950 msgr2=0x7f4f580fbc10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:13:29.794 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.740+0000 7f4f603e4700 1 -- 172.21.15.163:0/2516447610 shutdown_connections 2023-07-14T18:13:29.794 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.740+0000 7f4f603e4700 1 -- 172.21.15.163:0/2516447610 wait complete. 2023-07-14T18:13:29.799 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:1 damage ls 2023-07-14T18:13:29.866 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:13:29 smithi163 ceph-mon[96576]: from='client.? 172.21.15.163:0/3368860996' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-07-14T18:13:29.867 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:13:29 smithi163 ceph-mon[96576]: pgmap v325: 129 pgs: 129 active+clean; 660 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 10 op/s; 0 B/s, 0 objects/s recovering 2023-07-14T18:13:29.991 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.950+0000 7f952bf8b700 1 -- 172.21.15.163:0/972813691 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f95240feb10 msgr2=0x7f95240fef20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:13:29.992 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.950+0000 7f952bf8b700 1 --2- 172.21.15.163:0/972813691 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f95240feb10 0x7f95240fef20 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f9520009990 tx=0x7f9520009ca0 comp rx=0 tx=0).stop 2023-07-14T18:13:29.992 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.950+0000 7f952bf8b700 1 -- 172.21.15.163:0/972813691 shutdown_connections 2023-07-14T18:13:29.992 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.950+0000 7f952bf8b700 1 --2- 172.21.15.163:0/972813691 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9524100690 0x7f9524106f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:13:29.992 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.950+0000 7f952bf8b700 1 --2- 172.21.15.163:0/972813691 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f95240feb10 0x7f95240fef20 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:13:29.993 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.950+0000 7f952bf8b700 1 --2- 172.21.15.163:0/972813691 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f95240ffd00 0x7f9524100150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:13:29.993 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.950+0000 7f952bf8b700 1 -- 172.21.15.163:0/972813691 >> 172.21.15.163:0/972813691 conn(0x7f95240fa130 msgr2=0x7f95240fc560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:13:29.993 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.950+0000 7f952bf8b700 1 -- 172.21.15.163:0/972813691 shutdown_connections 2023-07-14T18:13:29.993 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.950+0000 7f952bf8b700 1 -- 172.21.15.163:0/972813691 wait complete. 2023-07-14T18:13:29.995 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.951+0000 7f952bf8b700 1 Processor -- start 2023-07-14T18:13:29.995 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.951+0000 7f952bf8b700 1 -- start start 2023-07-14T18:13:29.995 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.951+0000 7f952bf8b700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f95240feb10 0x7f9524193720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:13:29.995 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.951+0000 7f952bf8b700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f95240ffd00 0x7f9524193c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:13:29.996 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.951+0000 7f952bf8b700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9524100690 0x7f952419acd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:13:29.996 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.951+0000 7f952bf8b700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f952419b2a0 con 0x7f95240ffd00 2023-07-14T18:13:29.996 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.951+0000 7f952bf8b700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f952419b3e0 con 0x7f95240feb10 2023-07-14T18:13:29.996 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.951+0000 7f952bf8b700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f952419b570 con 0x7f9524100690 2023-07-14T18:13:29.996 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.951+0000 7f9529526700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f95240ffd00 0x7f9524193c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:13:29.996 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.951+0000 7f9529526700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f95240ffd00 0x7f9524193c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:58590/0 (socket says 172.21.15.163:58590) 2023-07-14T18:13:29.997 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.951+0000 7f9529526700 1 -- 172.21.15.163:0/1338626623 learned_addr learned my addr 172.21.15.163:0/1338626623 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:13:29.997 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.951+0000 7f9529d27700 1 --2- 172.21.15.163:0/1338626623 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f95240feb10 0x7f9524193720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:13:29.997 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.951+0000 7f952a528700 1 --2- 172.21.15.163:0/1338626623 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9524100690 0x7f952419acd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:13:29.997 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.952+0000 7f9529526700 1 -- 172.21.15.163:0/1338626623 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9524100690 msgr2=0x7f952419acd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:13:29.997 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.952+0000 7f9529526700 1 --2- 172.21.15.163:0/1338626623 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9524100690 0x7f952419acd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:13:29.998 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.952+0000 7f9529526700 1 -- 172.21.15.163:0/1338626623 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f95240feb10 msgr2=0x7f9524193720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:13:29.998 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.952+0000 7f9529526700 1 --2- 172.21.15.163:0/1338626623 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f95240feb10 0x7f9524193720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:13:29.998 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.952+0000 7f9529526700 1 -- 172.21.15.163:0/1338626623 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95200095f0 con 0x7f95240ffd00 2023-07-14T18:13:29.998 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.952+0000 7f9529526700 1 --2- 172.21.15.163:0/1338626623 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f95240ffd00 0x7f9524193c60 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f951400e9a0 tx=0x7f951400ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:13:29.998 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.952+0000 7f951affd700 1 -- 172.21.15.163:0/1338626623 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9514009790 con 0x7f95240ffd00 2023-07-14T18:13:29.998 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.952+0000 7f952bf8b700 1 -- 172.21.15.163:0/1338626623 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f952419b850 con 0x7f95240ffd00 2023-07-14T18:13:29.998 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.952+0000 7f952bf8b700 1 -- 172.21.15.163:0/1338626623 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f952419bdb0 con 0x7f95240ffd00 2023-07-14T18:13:29.999 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.953+0000 7f951affd700 1 -- 172.21.15.163:0/1338626623 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f9514010430 con 0x7f95240ffd00 2023-07-14T18:13:29.999 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.953+0000 7f951affd700 1 -- 172.21.15.163:0/1338626623 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f951400cea0 con 0x7f95240ffd00 2023-07-14T18:13:30.001 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.955+0000 7f951affd700 1 -- 172.21.15.163:0/1338626623 <== mon.0 v2:172.21.15.163:3300/0 4 ==== mgrmap(e 18) v1 ==== 135716+0+0 (secure 0 0 0) 0x7f9514018680 con 0x7f95240ffd00 2023-07-14T18:13:30.001 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.956+0000 7f951affd700 1 --2- 172.21.15.163:0/1338626623 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f95100a11d0 0x7f95100a3680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:13:30.001 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.956+0000 7f9529d27700 1 --2- 172.21.15.163:0/1338626623 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f95100a11d0 0x7f95100a3680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:13:30.002 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.956+0000 7f951affd700 1 -- 172.21.15.163:0/1338626623 <== mon.0 v2:172.21.15.163:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 9049+0+0 (secure 0 0 0) 0x7f9514014070 con 0x7f95240ffd00 2023-07-14T18:13:30.002 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.957+0000 7f9529d27700 1 --2- 172.21.15.163:0/1338626623 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f95100a11d0 0x7f95100a3680 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f95200036e0 tx=0x7f9520005fd0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:13:30.002 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.957+0000 7f9538123b80 1 Processor -- start 2023-07-14T18:13:30.002 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.957+0000 7f9538123b80 1 -- start start 2023-07-14T18:13:30.002 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.957+0000 7f9538123b80 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x562cd436def0 0x562cd436e300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:13:30.003 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.957+0000 7f9538123b80 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x562cd436e840 0x562cd436eee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:13:30.003 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.957+0000 7f9538123b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562cd436f420 0x562cd436f8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:13:30.003 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.957+0000 7f9538123b80 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x562cd4275cb0 con 0x562cd436e840 2023-07-14T18:13:30.003 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.957+0000 7f9538123b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x562cd42c8a40 con 0x562cd436f420 2023-07-14T18:13:30.003 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.957+0000 7f9538123b80 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x562cd42c1ed0 con 0x562cd436def0 2023-07-14T18:13:30.003 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.957+0000 7f9529526700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x562cd436e840 0x562cd436eee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:13:30.004 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.957+0000 7f9529526700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x562cd436e840 0x562cd436eee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:58596/0 (socket says 172.21.15.163:58596) 2023-07-14T18:13:30.004 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.957+0000 7f9529526700 1 -- 172.21.15.163:0/3500938167 learned_addr learned my addr 172.21.15.163:0/3500938167 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:13:30.004 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.958+0000 7f9529d27700 1 --2- 172.21.15.163:0/3500938167 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x562cd436def0 0x562cd436e300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:13:30.004 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.958+0000 7f952a528700 1 --2- 172.21.15.163:0/3500938167 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562cd436f420 0x562cd436f8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:13:30.004 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.958+0000 7f9529526700 1 -- 172.21.15.163:0/3500938167 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x562cd436def0 msgr2=0x562cd436e300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:13:30.004 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.958+0000 7f9529526700 1 --2- 172.21.15.163:0/3500938167 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x562cd436def0 0x562cd436e300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:13:30.005 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.958+0000 7f9529526700 1 -- 172.21.15.163:0/3500938167 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562cd436f420 msgr2=0x562cd436f8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:13:30.005 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.958+0000 7f9529526700 1 --2- 172.21.15.163:0/3500938167 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562cd436f420 0x562cd436f8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:13:30.005 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.958+0000 7f9529526700 1 -- 172.21.15.163:0/3500938167 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562cd40efde0 con 0x562cd436e840 2023-07-14T18:13:30.005 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.958+0000 7f9529526700 1 --2- 172.21.15.163:0/3500938167 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x562cd436e840 0x562cd436eee0 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f9514099d20 tx=0x7f9514099e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a8167fa119d30125 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:13:30.005 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.958+0000 7f950ffff700 1 -- 172.21.15.163:0/3500938167 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95140a21e0 con 0x562cd436e840 2023-07-14T18:13:30.005 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.958+0000 7f950ffff700 1 -- 172.21.15.163:0/3500938167 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f9514098130 con 0x562cd436e840 2023-07-14T18:13:30.006 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.958+0000 7f950ffff700 1 -- 172.21.15.163:0/3500938167 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95140b2210 con 0x562cd436e840 2023-07-14T18:13:30.006 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.959+0000 7f9538123b80 1 -- 172.21.15.163:0/3500938167 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x562cd436e840 msgr2=0x562cd436eee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:13:30.006 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.959+0000 7f9538123b80 1 --2- 172.21.15.163:0/3500938167 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x562cd436e840 0x562cd436eee0 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f9514099d20 tx=0x7f9514099e10 comp rx=0 tx=0).stop 2023-07-14T18:13:30.006 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.959+0000 7f9538123b80 1 -- 172.21.15.163:0/3500938167 shutdown_connections 2023-07-14T18:13:30.007 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.959+0000 7f9538123b80 1 --2- 172.21.15.163:0/3500938167 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x562cd436def0 0x562cd436e300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:13:30.007 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.959+0000 7f9538123b80 1 --2- 172.21.15.163:0/3500938167 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562cd436f420 0x562cd436f8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:13:30.007 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.959+0000 7f9538123b80 1 --2- 172.21.15.163:0/3500938167 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x562cd436e840 0x562cd436eee0 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:13:30.007 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.959+0000 7f9538123b80 1 -- 172.21.15.163:0/3500938167 >> 172.21.15.163:0/3500938167 conn(0x562cd4366680 msgr2=0x562cd436b9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:13:30.007 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.960+0000 7f9538123b80 1 -- 172.21.15.163:0/3500938167 shutdown_connections 2023-07-14T18:13:30.008 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.960+0000 7f9538123b80 1 -- 172.21.15.163:0/3500938167 wait complete. 2023-07-14T18:13:30.008 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.960+0000 7f9538123b80 1 -- start start 2023-07-14T18:13:30.008 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.960+0000 7f9538123b80 1 Processor -- start 2023-07-14T18:13:30.011 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.961+0000 7f9538123b80 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x562cd436def0 0x562cd437a970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:13:30.011 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.961+0000 7f9538123b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562cd436e840 0x562cd437aeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:13:30.011 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.961+0000 7f9538123b80 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x562cd436f420 0x562cd4381ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:13:30.012 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.961+0000 7f9538123b80 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x562cd4261ac0 con 0x562cd436def0 2023-07-14T18:13:30.012 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.961+0000 7f9538123b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x562cd42617c0 con 0x562cd436e840 2023-07-14T18:13:30.012 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.961+0000 7f9538123b80 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x562cd4145920 con 0x562cd436f420 2023-07-14T18:13:30.012 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.961+0000 7f9538123b80 10 client.0 _ll_register_callbacks cb 0x562cd425f760 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T18:13:30.012 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.961+0000 7f9529d27700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x562cd436def0 0x562cd437a970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:13:30.013 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.961+0000 7f9529d27700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x562cd436def0 0x562cd437a970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:58600/0 (socket says 172.21.15.163:58600) 2023-07-14T18:13:30.013 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.961+0000 7f9529d27700 1 -- 172.21.15.163:0/750041950 learned_addr learned my addr 172.21.15.163:0/750041950 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:13:30.013 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.961+0000 7f9529526700 1 --2- 172.21.15.163:0/750041950 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562cd436e840 0x562cd437aeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:13:30.013 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.961+0000 7f952a528700 1 --2- 172.21.15.163:0/750041950 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x562cd436f420 0x562cd4381ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:13:30.013 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.961+0000 7f9529d27700 1 -- 172.21.15.163:0/750041950 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x562cd436f420 msgr2=0x562cd4381ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:13:30.013 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.961+0000 7f9529d27700 1 --2- 172.21.15.163:0/750041950 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x562cd436f420 0x562cd4381ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:13:30.014 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.961+0000 7f9529d27700 1 -- 172.21.15.163:0/750041950 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562cd436e840 msgr2=0x562cd437aeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:13:30.014 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.961+0000 7f9529d27700 1 --2- 172.21.15.163:0/750041950 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562cd436e840 0x562cd437aeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:13:30.014 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.961+0000 7f9529d27700 1 -- 172.21.15.163:0/750041950 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f952419bdb0 con 0x562cd436def0 2023-07-14T18:13:30.014 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.961+0000 7f952a528700 1 --2- 172.21.15.163:0/750041950 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x562cd436f420 0x562cd4381ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T18:13:30.014 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.961+0000 7f9529d27700 1 --2- 172.21.15.163:0/750041950 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x562cd436def0 0x562cd437a970 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f95240ffb60 tx=0x7f9520009310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=50aa101957670d36 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:13:30.014 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.961+0000 7f950d7fa700 10 client.0 ms_handle_connect on v2:172.21.15.163:3300/0 2023-07-14T18:13:30.014 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.962+0000 7f950d7fa700 1 -- 172.21.15.163:0/750041950 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f952000b690 con 0x562cd436def0 2023-07-14T18:13:30.015 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.962+0000 7f950d7fa700 1 -- 172.21.15.163:0/750041950 <== mon.0 v2:172.21.15.163:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 9049+0+0 (secure 0 0 0) 0x7f952000b7f0 con 0x562cd436def0 2023-07-14T18:13:30.015 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.962+0000 7f9538123b80 1 -- 172.21.15.163:0/750041950 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x562cd421b4f0 con 0x562cd436def0 2023-07-14T18:13:30.015 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.962+0000 7f950d7fa700 1 -- 172.21.15.163:0/750041950 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7f952000b9b0 con 0x562cd436def0 2023-07-14T18:13:30.015 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.962+0000 7f9538123b80 10 client.15912 fetch_fsmap learned FSMap version 29 2023-07-14T18:13:30.016 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.962+0000 7f9538123b80 1 -- 172.21.15.163:0/750041950 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) v3 -- 0x562cd40d8c60 con 0x562cd436def0 2023-07-14T18:13:30.016 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.962+0000 7f950d7fa700 1 -- 172.21.15.163:0/750041950 <== mon.0 v2:172.21.15.163:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x562cd421b4f0 con 0x562cd436def0 2023-07-14T18:13:30.016 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.963+0000 7f950d7fa700 1 -- 172.21.15.163:0/750041950 <== mon.0 v2:172.21.15.163:3300/0 5 ==== fsmap(e 29) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f9520033020 con 0x562cd436def0 2023-07-14T18:13:30.017 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.963+0000 7f9538123b80 10 client.15912 fetch_fsmap finished waiting for FSMap version 29 2023-07-14T18:13:30.017 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.963+0000 7f9538123b80 10 client.15912 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2023-07-14T18:13:30.017 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.963+0000 7f9538123b80 20 client.15912 populate_metadata read hostname 'smithi163' 2023-07-14T18:13:30.017 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.963+0000 7f9538123b80 1 --2- 172.21.15.163:0/750041950 >> [v2:172.21.15.184:6838/2819059257,v1:172.21.15.184:6839/2819059257] conn(0x562cd4386590 0x562cd43889a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:13:30.018 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.963+0000 7f9538123b80 4 client.15912 mds_command: new command op to 24493 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-14T18:13:30.018 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.963+0000 7f9538123b80 1 -- 172.21.15.163:0/750041950 --> [v2:172.21.15.184:6838/2819059257,v1:172.21.15.184:6839/2819059257] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x562cd433fda0 con 0x562cd4386590 2023-07-14T18:13:30.018 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.964+0000 7f9529526700 1 --2- 172.21.15.163:0/750041950 >> [v2:172.21.15.184:6838/2819059257,v1:172.21.15.184:6839/2819059257] conn(0x562cd4386590 0x562cd43889a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:13:30.019 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.964+0000 7f950d7fa700 10 client.15912 ms_handle_connect on v2:172.21.15.184:6838/2819059257 2023-07-14T18:13:30.019 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.964+0000 7f9529526700 1 --2- 172.21.15.163:0/750041950 >> [v2:172.21.15.184:6838/2819059257,v1:172.21.15.184:6839/2819059257] conn(0x562cd4386590 0x562cd43889a0 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=68f2272c400c8a9c server_cookie=a79e333567f1e717 in_seq=0 out_seq=0 2023-07-14T18:13:30.019 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.965+0000 7f950d7fa700 1 -- 172.21.15.163:0/750041950 <== mds.1 v2:172.21.15.184:6838/2819059257 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18017 (crc 0 0 0) 0x562cd433fda0 con 0x562cd4386590 2023-07-14T18:13:30.020 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.965+0000 7f950d7fa700 10 client.15912 handle_command_reply: tid=0 2023-07-14T18:13:30.020 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.965+0000 7f9538123b80 1 client.15912 shutdown 2023-07-14T18:13:30.020 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.965+0000 7f9538123b80 1 -- 172.21.15.163:0/750041950 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x562cd436def0 msgr2=0x562cd437a970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:13:30.021 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.965+0000 7f9538123b80 1 --2- 172.21.15.163:0/750041950 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x562cd436def0 0x562cd437a970 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f95240ffb60 tx=0x7f9520009310 comp rx=0 tx=0).stop 2023-07-14T18:13:30.021 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.965+0000 7f9538123b80 1 -- 172.21.15.163:0/750041950 shutdown_connections 2023-07-14T18:13:30.021 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.965+0000 7f9538123b80 1 --2- 172.21.15.163:0/750041950 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x562cd436f420 0x562cd4381ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:13:30.022 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.965+0000 7f9538123b80 1 --2- 172.21.15.163:0/750041950 >> [v2:172.21.15.184:6838/2819059257,v1:172.21.15.184:6839/2819059257] conn(0x562cd4386590 0x562cd43889a0 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:13:30.022 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.965+0000 7f9538123b80 1 --2- 172.21.15.163:0/750041950 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x562cd436def0 0x562cd437a970 unknown :-1 s=CLOSED pgs=587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:13:30.022 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.965+0000 7f950d7fa700 0 client.15912 ms_handle_reset on v2:172.21.15.184:6838/2819059257 2023-07-14T18:13:30.023 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.965+0000 7f9538123b80 1 --2- 172.21.15.163:0/750041950 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562cd436e840 0x562cd437aeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:13:30.023 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.965+0000 7f9538123b80 1 -- 172.21.15.163:0/750041950 >> 172.21.15.163:0/750041950 conn(0x562cd4366680 msgr2=0x562cd436a650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:13:30.023 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.965+0000 7f9538123b80 1 -- 172.21.15.163:0/750041950 shutdown_connections 2023-07-14T18:13:30.023 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.965+0000 7f9538123b80 1 -- 172.21.15.163:0/750041950 wait complete. 2023-07-14T18:13:30.023 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.965+0000 7f9538123b80 20 client.15912 trim_cache size 0 max 16384 2023-07-14T18:13:30.032 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.990+0000 7f9538123b80 1 Processor -- start 2023-07-14T18:13:30.032 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.990+0000 7f9538123b80 1 -- start start 2023-07-14T18:13:30.032 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.990+0000 7f9538123b80 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x562cd436def0 0x562cd437fe70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:13:30.033 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.990+0000 7f9538123b80 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x562cd436e840 0x562cd43723a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:13:30.033 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.990+0000 7f9538123b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562cd436f420 0x562cd43728e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:13:30.033 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.990+0000 7f9538123b80 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x562cd437a540 con 0x562cd436def0 2023-07-14T18:13:30.033 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.990+0000 7f9538123b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x562cd436ed70 con 0x562cd436f420 2023-07-14T18:13:30.033 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.990+0000 7f9538123b80 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x562cd4379e20 con 0x562cd436e840 2023-07-14T18:13:30.034 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.990+0000 7f9529d27700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x562cd436def0 0x562cd437fe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:13:30.034 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.990+0000 7f9529d27700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x562cd436def0 0x562cd437fe70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:58608/0 (socket says 172.21.15.163:58608) 2023-07-14T18:13:30.034 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.990+0000 7f9529d27700 1 -- 172.21.15.163:0/2196285295 learned_addr learned my addr 172.21.15.163:0/2196285295 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:13:30.034 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.990+0000 7f952a528700 1 --2- 172.21.15.163:0/2196285295 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562cd436f420 0x562cd43728e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:13:30.034 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.990+0000 7f9529526700 1 --2- 172.21.15.163:0/2196285295 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x562cd436e840 0x562cd43723a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:13:30.034 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.991+0000 7f9529d27700 1 -- 172.21.15.163:0/2196285295 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x562cd436e840 msgr2=0x562cd43723a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:13:30.035 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.991+0000 7f9529d27700 1 --2- 172.21.15.163:0/2196285295 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x562cd436e840 0x562cd43723a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:13:30.035 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.991+0000 7f9529d27700 1 -- 172.21.15.163:0/2196285295 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562cd436f420 msgr2=0x562cd43728e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:13:30.035 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.991+0000 7f9529d27700 1 --2- 172.21.15.163:0/2196285295 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562cd436f420 0x562cd43728e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:13:30.035 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.991+0000 7f9529d27700 1 -- 172.21.15.163:0/2196285295 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562cd4116250 con 0x562cd436def0 2023-07-14T18:13:30.036 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.991+0000 7f9529d27700 1 --2- 172.21.15.163:0/2196285295 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x562cd436def0 0x562cd437fe70 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f9520010710 tx=0x7f9520005a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ae285d80ff98bd9 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:13:30.036 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.991+0000 7f9518ff9700 1 -- 172.21.15.163:0/2196285295 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f952000b690 con 0x562cd436def0 2023-07-14T18:13:30.036 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.991+0000 7f9518ff9700 1 -- 172.21.15.163:0/2196285295 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f9520003e90 con 0x562cd436def0 2023-07-14T18:13:30.036 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.991+0000 7f9518ff9700 1 -- 172.21.15.163:0/2196285295 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f952000d730 con 0x562cd436def0 2023-07-14T18:13:30.040 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.992+0000 7f9538123b80 1 -- 172.21.15.163:0/2196285295 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x562cd436def0 msgr2=0x562cd437fe70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:13:30.040 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.992+0000 7f9538123b80 1 --2- 172.21.15.163:0/2196285295 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x562cd436def0 0x562cd437fe70 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f9520010710 tx=0x7f9520005a40 comp rx=0 tx=0).stop 2023-07-14T18:13:30.040 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.992+0000 7f9538123b80 1 -- 172.21.15.163:0/2196285295 shutdown_connections 2023-07-14T18:13:30.041 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.992+0000 7f9538123b80 1 --2- 172.21.15.163:0/2196285295 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562cd436f420 0x562cd43728e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:13:30.041 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.992+0000 7f9538123b80 1 --2- 172.21.15.163:0/2196285295 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x562cd436def0 0x562cd437fe70 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:13:30.041 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.992+0000 7f9538123b80 1 --2- 172.21.15.163:0/2196285295 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x562cd436e840 0x562cd43723a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:13:30.041 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.992+0000 7f9538123b80 1 -- 172.21.15.163:0/2196285295 >> 172.21.15.163:0/2196285295 conn(0x562cd4366680 msgr2=0x562cd4375840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:13:30.041 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.992+0000 7f9538123b80 1 -- 172.21.15.163:0/2196285295 shutdown_connections 2023-07-14T18:13:30.041 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.992+0000 7f9538123b80 1 -- 172.21.15.163:0/2196285295 wait complete. 2023-07-14T18:13:30.041 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.993+0000 7f9538123b80 1 -- start start 2023-07-14T18:13:30.042 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.993+0000 7f9538123b80 1 Processor -- start 2023-07-14T18:13:30.042 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.993+0000 7f9538123b80 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x562cd436def0 0x562cd437dbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:13:30.042 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.993+0000 7f9538123b80 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x562cd436e840 0x562cd437e100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:13:30.042 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.993+0000 7f9538123b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562cd436f420 0x562cd437f110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:13:30.042 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.993+0000 7f9538123b80 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x562cd437f650 con 0x562cd436e840 2023-07-14T18:13:30.042 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.993+0000 7f9538123b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x562cd437f7c0 con 0x562cd436f420 2023-07-14T18:13:30.042 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.993+0000 7f9538123b80 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x562cd437f980 con 0x562cd436def0 2023-07-14T18:13:30.042 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.993+0000 7f9538123b80 10 client.0 _ll_register_callbacks cb 0x7f9520010900 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T18:13:30.043 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.993+0000 7f9529d27700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x562cd436def0 0x562cd437dbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:13:30.043 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.993+0000 7f9529d27700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x562cd436def0 0x562cd437dbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.163:40436/0 (socket says 172.21.15.163:40436) 2023-07-14T18:13:30.043 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.993+0000 7f9529d27700 1 -- 172.21.15.163:0/2124973061 learned_addr learned my addr 172.21.15.163:0/2124973061 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:13:30.043 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.994+0000 7f952a528700 1 --2- 172.21.15.163:0/2124973061 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562cd436f420 0x562cd437f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:13:30.044 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.994+0000 7f9529d27700 1 -- 172.21.15.163:0/2124973061 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562cd436f420 msgr2=0x562cd437f110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:13:30.044 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.994+0000 7f9529d27700 1 --2- 172.21.15.163:0/2124973061 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562cd436f420 0x562cd437f110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:13:30.044 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.994+0000 7f9529d27700 1 -- 172.21.15.163:0/2124973061 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x562cd436e840 msgr2=0x562cd437e100 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-07-14T18:13:30.044 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.994+0000 7f9529d27700 1 --2- 172.21.15.163:0/2124973061 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x562cd436e840 0x562cd437e100 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:13:30.044 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.994+0000 7f9529d27700 1 -- 172.21.15.163:0/2124973061 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x562cd40d8c60 con 0x562cd436def0 2023-07-14T18:13:30.044 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.994+0000 7f952a528700 1 --2- 172.21.15.163:0/2124973061 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562cd436f420 0x562cd437f110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T18:13:30.045 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.994+0000 7f9529d27700 1 --2- 172.21.15.163:0/2124973061 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x562cd436def0 0x562cd437dbc0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f9520009990 tx=0x7f9520018790 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b275c62f5a785c7a server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:13:30.045 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.994+0000 7f950d7fa700 10 client.0 ms_handle_connect on v2:172.21.15.184:3300/0 2023-07-14T18:13:30.045 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.994+0000 7f950d7fa700 1 -- 172.21.15.163:0/2124973061 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f952000d900 con 0x562cd436def0 2023-07-14T18:13:30.045 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.994+0000 7f950d7fa700 1 -- 172.21.15.163:0/2124973061 <== mon.1 v2:172.21.15.184:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 9049+0+0 (secure 0 0 0) 0x7f9520005740 con 0x562cd436def0 2023-07-14T18:13:30.045 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.994+0000 7f9538123b80 1 -- 172.21.15.163:0/2124973061 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f9514098130 con 0x562cd436def0 2023-07-14T18:13:30.045 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.994+0000 7f950d7fa700 1 -- 172.21.15.163:0/2124973061 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9520018b50 con 0x562cd436def0 2023-07-14T18:13:30.045 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.994+0000 7f9538123b80 10 client.25501 fetch_fsmap learned FSMap version 29 2023-07-14T18:13:30.046 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.994+0000 7f9538123b80 1 -- 172.21.15.163:0/2124973061 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) v3 -- 0x562cd40ee2b0 con 0x562cd436def0 2023-07-14T18:13:30.046 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.995+0000 7f950d7fa700 1 -- 172.21.15.163:0/2124973061 <== mon.1 v2:172.21.15.184:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f9514098130 con 0x562cd436def0 2023-07-14T18:13:30.046 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.995+0000 7f950d7fa700 1 -- 172.21.15.163:0/2124973061 <== mon.1 v2:172.21.15.184:3300/0 5 ==== fsmap(e 29) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f9520033070 con 0x562cd436def0 2023-07-14T18:13:30.046 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.995+0000 7f9538123b80 10 client.25501 fetch_fsmap finished waiting for FSMap version 29 2023-07-14T18:13:30.046 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.995+0000 7f9538123b80 10 client.25501 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2023-07-14T18:13:30.046 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.995+0000 7f9538123b80 20 client.25501 populate_metadata read hostname 'smithi163' 2023-07-14T18:13:30.046 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.995+0000 7f9538123b80 1 --2- 172.21.15.163:0/2124973061 >> [v2:172.21.15.184:6838/2819059257,v1:172.21.15.184:6839/2819059257] conn(0x562cd43dad00 0x562cd43dd110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:13:30.047 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.995+0000 7f9538123b80 4 client.25501 mds_command: new command op to 24493 tid=0[{"prefix": "damage ls"}] 2023-07-14T18:13:30.047 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.995+0000 7f9538123b80 1 -- 172.21.15.163:0/2124973061 --> [v2:172.21.15.184:6838/2819059257,v1:172.21.15.184:6839/2819059257] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x562cd42baeb0 con 0x562cd43dad00 2023-07-14T18:13:30.047 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.995+0000 7f9529526700 1 --2- 172.21.15.163:0/2124973061 >> [v2:172.21.15.184:6838/2819059257,v1:172.21.15.184:6839/2819059257] conn(0x562cd43dad00 0x562cd43dd110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:13:30.047 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.996+0000 7f950d7fa700 10 client.25501 ms_handle_connect on v2:172.21.15.184:6838/2819059257 2023-07-14T18:13:30.047 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.996+0000 7f9529526700 1 --2- 172.21.15.163:0/2124973061 >> [v2:172.21.15.184:6838/2819059257,v1:172.21.15.184:6839/2819059257] conn(0x562cd43dad00 0x562cd43dd110 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=a92029b458a5e4b3 server_cookie=8c45baab3aafd1db in_seq=0 out_seq=0 2023-07-14T18:13:30.047 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.996+0000 7f950d7fa700 1 -- 172.21.15.163:0/2124973061 <== mds.1 v2:172.21.15.184:6838/2819059257 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x562cd42baeb0 con 0x562cd43dad00 2023-07-14T18:13:30.047 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.996+0000 7f950d7fa700 10 client.25501 handle_command_reply: tid=0 2023-07-14T18:13:30.048 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.996+0000 7f9538123b80 1 client.25501 shutdown 2023-07-14T18:13:30.048 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.996+0000 7f9538123b80 1 -- 172.21.15.163:0/2124973061 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x562cd436def0 msgr2=0x562cd437dbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:13:30.048 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.996+0000 7f9538123b80 1 --2- 172.21.15.163:0/2124973061 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x562cd436def0 0x562cd437dbc0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f9520009990 tx=0x7f9520018790 comp rx=0 tx=0).stop 2023-07-14T18:13:30.048 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.996+0000 7f9538123b80 1 -- 172.21.15.163:0/2124973061 shutdown_connections 2023-07-14T18:13:30.048 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.996+0000 7f9538123b80 1 --2- 172.21.15.163:0/2124973061 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x562cd436def0 0x562cd437dbc0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:13:30.048 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.996+0000 7f9538123b80 1 --2- 172.21.15.163:0/2124973061 >> [v2:172.21.15.184:6838/2819059257,v1:172.21.15.184:6839/2819059257] conn(0x562cd43dad00 0x562cd43dd110 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:13:30.049 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.996+0000 7f9538123b80 1 --2- 172.21.15.163:0/2124973061 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562cd436f420 0x562cd437f110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:13:30.049 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.996+0000 7f950d7fa700 0 client.25501 ms_handle_reset on v2:172.21.15.184:6838/2819059257 2023-07-14T18:13:30.049 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.996+0000 7f9538123b80 1 --2- 172.21.15.163:0/2124973061 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x562cd436e840 0x562cd437e100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:13:30.049 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.996+0000 7f9538123b80 1 -- 172.21.15.163:0/2124973061 >> 172.21.15.163:0/2124973061 conn(0x562cd4366680 msgr2=0x562cd43723a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:13:30.049 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.996+0000 7f9538123b80 1 -- 172.21.15.163:0/2124973061 shutdown_connections 2023-07-14T18:13:30.049 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.996+0000 7f9538123b80 1 -- 172.21.15.163:0/2124973061 wait complete. 2023-07-14T18:13:30.050 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.996+0000 7f9538123b80 20 client.25501 trim_cache size 0 max 16384 2023-07-14T18:13:30.050 INFO:teuthology.orchestra.run.smithi163.stdout:[] 2023-07-14T18:13:30.051 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.997+0000 7f952bf8b700 1 -- 172.21.15.163:0/1338626623 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f95100a11d0 msgr2=0x7f95100a3680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:13:30.051 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.997+0000 7f952bf8b700 1 --2- 172.21.15.163:0/1338626623 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f95100a11d0 0x7f95100a3680 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f95200036e0 tx=0x7f9520005fd0 comp rx=0 tx=0).stop 2023-07-14T18:13:30.051 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.997+0000 7f952bf8b700 1 -- 172.21.15.163:0/1338626623 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f95240ffd00 msgr2=0x7f9524193c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:13:30.051 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.997+0000 7f952bf8b700 1 --2- 172.21.15.163:0/1338626623 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f95240ffd00 0x7f9524193c60 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f951400e9a0 tx=0x7f951400ecb0 comp rx=0 tx=0).stop 2023-07-14T18:13:30.051 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.997+0000 7f952bf8b700 1 -- 172.21.15.163:0/1338626623 shutdown_connections 2023-07-14T18:13:30.052 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.997+0000 7f952bf8b700 1 --2- 172.21.15.163:0/1338626623 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f95100a11d0 0x7f95100a3680 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:13:30.052 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.997+0000 7f952bf8b700 1 --2- 172.21.15.163:0/1338626623 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9524100690 0x7f952419acd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:13:30.052 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.997+0000 7f952bf8b700 1 --2- 172.21.15.163:0/1338626623 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f95240feb10 0x7f9524193720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:13:30.052 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.997+0000 7f952bf8b700 1 --2- 172.21.15.163:0/1338626623 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f95240ffd00 0x7f9524193c60 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:13:30.053 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.997+0000 7f952bf8b700 1 -- 172.21.15.163:0/1338626623 >> 172.21.15.163:0/1338626623 conn(0x7f95240fa130 msgr2=0x7f9524103310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:13:30.053 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.997+0000 7f952bf8b700 1 -- 172.21.15.163:0/1338626623 shutdown_connections 2023-07-14T18:13:30.053 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:29.997+0000 7f952bf8b700 1 -- 172.21.15.163:0/1338626623 wait complete. 2023-07-14T18:13:30.055 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 damage ls 2023-07-14T18:13:30.176 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:13:29 smithi184 ceph-mon[98481]: from='client.? 172.21.15.163:0/3368860996' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-07-14T18:13:30.176 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:13:29 smithi184 ceph-mon[98481]: pgmap v325: 129 pgs: 129 active+clean; 660 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 10 op/s; 0 B/s, 0 objects/s recovering 2023-07-14T18:13:30.246 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:30.204+0000 7f04beb69700 1 -- 172.21.15.163:0/972300154 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f04b80ffd00 msgr2=0x7f04b8100150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:13:30.246 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:30.204+0000 7f04beb69700 1 --2- 172.21.15.163:0/972300154 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f04b80ffd00 0x7f04b8100150 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f04a4009990 tx=0x7f04a4009ca0 comp rx=0 tx=0).stop 2023-07-14T18:13:30.246 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:30.204+0000 7f04beb69700 1 -- 172.21.15.163:0/972300154 shutdown_connections 2023-07-14T18:13:30.247 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:30.204+0000 7f04beb69700 1 --2- 172.21.15.163:0/972300154 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f04b80feb10 0x7f04b80fef20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:13:30.247 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:30.204+0000 7f04beb69700 1 --2- 172.21.15.163:0/972300154 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f04b8100690 0x7f04b8106f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:13:30.247 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:30.204+0000 7f04beb69700 1 --2- 172.21.15.163:0/972300154 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f04b80ffd00 0x7f04b8100150 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:13:30.247 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:30.204+0000 7f04beb69700 1 -- 172.21.15.163:0/972300154 >> 172.21.15.163:0/972300154 conn(0x7f04b80fa130 msgr2=0x7f04b80fc560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:13:30.248 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:30.204+0000 7f04beb69700 1 -- 172.21.15.163:0/972300154 shutdown_connections 2023-07-14T18:13:30.248 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:30.205+0000 7f04beb69700 1 -- 172.21.15.163:0/972300154 wait complete. 2023-07-14T18:13:30.250 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:30.205+0000 7f04beb69700 1 Processor -- start 2023-07-14T18:13:30.250 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:30.205+0000 7f04beb69700 1 -- start start 2023-07-14T18:13:30.250 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:30.205+0000 7f04beb69700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f04b80feb10 0x7f04b81958b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:13:30.250 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:30.205+0000 7f04beb69700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f04b80ffd00 0x7f04b8195df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:13:30.250 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:30.206+0000 7f04beb69700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f04b8100690 0x7f04b819ce60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:13:30.251 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:30.206+0000 7f04beb69700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04b819d430 con 0x7f04b8100690 2023-07-14T18:13:30.251 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:30.206+0000 7f04beb69700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04b819d570 con 0x7f04b80feb10 2023-07-14T18:13:30.251 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:30.206+0000 7f04beb69700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04b8107710 con 0x7f04b80ffd00 2023-07-14T18:13:30.251 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:30.206+0000 7f04bd106700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f04b8100690 0x7f04b819ce60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:13:30.251 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:30.206+0000 7f04bd106700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f04b8100690 0x7f04b819ce60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:58630/0 (socket says 172.21.15.163:58630) 2023-07-14T18:13:30.251 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:30.206+0000 7f04bd106700 1 -- 172.21.15.163:0/666968127 learned_addr learned my addr 172.21.15.163:0/666968127 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:13:30.252 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:30.206+0000 7f04bc905700 1 --2- 172.21.15.163:0/666968127 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f04b80feb10 0x7f04b81958b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:13:30.252 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:30.206+0000 7f04b7fff700 1 --2- 172.21.15.163:0/666968127 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f04b80ffd00 0x7f04b8195df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:13:30.252 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:30.206+0000 7f04bd106700 1 -- 172.21.15.163:0/666968127 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f04b80ffd00 msgr2=0x7f04b8195df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:13:30.252 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:30.206+0000 7f04bd106700 1 --2- 172.21.15.163:0/666968127 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f04b80ffd00 0x7f04b8195df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:13:30.253 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:30.206+0000 7f04bd106700 1 -- 172.21.15.163:0/666968127 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f04b80feb10 msgr2=0x7f04b81958b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:13:30.253 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:30.206+0000 7f04bd106700 1 --2- 172.21.15.163:0/666968127 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f04b80feb10 0x7f04b81958b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:13:30.253 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:30.206+0000 7f04bd106700 1 -- 172.21.15.163:0/666968127 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04a40095f0 con 0x7f04b8100690 2023-07-14T18:13:30.253 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:30.206+0000 7f04bc905700 1 --2- 172.21.15.163:0/666968127 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f04b80feb10 0x7f04b81958b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T18:13:30.253 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:30.206+0000 7f04bd106700 1 --2- 172.21.15.163:0/666968127 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f04b8100690 0x7f04b819ce60 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f04b0007ee0 tx=0x7f04b000d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:13:30.253 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:30.207+0000 7f04b5ffb700 1 -- 172.21.15.163:0/666968127 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04b000dd20 con 0x7f04b8100690 2023-07-14T18:13:30.253 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:30.207+0000 7f04beb69700 1 -- 172.21.15.163:0/666968127 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f04b81079f0 con 0x7f04b8100690 2023-07-14T18:13:30.254 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:30.207+0000 7f04b5ffb700 1 -- 172.21.15.163:0/666968127 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f04b000f040 con 0x7f04b8100690 2023-07-14T18:13:30.254 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:30.207+0000 7f04b5ffb700 1 -- 172.21.15.163:0/666968127 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04b00046e0 con 0x7f04b8100690 2023-07-14T18:13:30.254 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:30.207+0000 7f04beb69700 1 -- 172.21.15.163:0/666968127 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f04b8107f00 con 0x7f04b8100690 2023-07-14T18:13:30.257 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:30.210+0000 7f04b5ffb700 1 -- 172.21.15.163:0/666968127 <== mon.0 v2:172.21.15.163:3300/0 4 ==== mgrmap(e 18) v1 ==== 135716+0+0 (secure 0 0 0) 0x7f04b0003a00 con 0x7f04b8100690 2023-07-14T18:13:30.258 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:30.211+0000 7f04b5ffb700 1 --2- 172.21.15.163:0/666968127 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f04a80a1150 0x7f04a80a3600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:13:30.258 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:30.211+0000 7f04b5ffb700 1 -- 172.21.15.163:0/666968127 <== mon.0 v2:172.21.15.163:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 9049+0+0 (secure 0 0 0) 0x7f04b00cc5c0 con 0x7f04b8100690 2023-07-14T18:13:30.258 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:30.211+0000 7f04bc905700 1 --2- 172.21.15.163:0/666968127 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f04a80a1150 0x7f04a80a3600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:13:30.258 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:30.211+0000 7f04cad01b80 1 Processor -- start 2023-07-14T18:13:30.259 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:30.212+0000 7f04cad01b80 1 -- start start 2023-07-14T18:13:30.259 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:30.212+0000 7f04bc905700 1 --2- 172.21.15.163:0/666968127 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f04a80a1150 0x7f04a80a3600 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f04b80ffb60 tx=0x7f04ac009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:13:30.259 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:30.212+0000 7f04cad01b80 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5609f9202f60 0x5609f9203370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:13:30.259 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:30.212+0000 7f04cad01b80 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5609f92038b0 0x5609f9203ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:13:30.260 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:30.212+0000 7f04cad01b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5609f92044b0 0x5609f9204920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:13:30.260 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:30.212+0000 7f04cad01b80 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x5609f9107cb0 con 0x5609f9202f60 2023-07-14T18:13:30.260 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:30.212+0000 7f04cad01b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x5609f915aa40 con 0x5609f92044b0 2023-07-14T18:13:30.260 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:30.212+0000 7f04cad01b80 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x5609f9153ed0 con 0x5609f92038b0 2023-07-14T18:13:30.260 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:30.212+0000 7f04bc905700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5609f9202f60 0x5609f9203370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:13:30.261 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:30.212+0000 7f04bd106700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5609f92044b0 0x5609f9204920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:13:30.261 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:30.212+0000 7f04bc905700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5609f9202f60 0x5609f9203370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:58634/0 (socket says 172.21.15.163:58634) 2023-07-14T18:13:30.261 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:30.212+0000 7f04bc905700 1 -- 172.21.15.163:0/3795264522 learned_addr learned my addr 172.21.15.163:0/3795264522 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:13:30.261 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:30.212+0000 7f04b7fff700 1 --2- 172.21.15.163:0/3795264522 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5609f92038b0 0x5609f9203ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:13:30.261 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:30.213+0000 7f04bc905700 1 -- 172.21.15.163:0/3795264522 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5609f92038b0 msgr2=0x5609f9203ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:13:30.261 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:30.213+0000 7f04bc905700 1 --2- 172.21.15.163:0/3795264522 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5609f92038b0 0x5609f9203ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:13:30.261 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:30.213+0000 7f04bc905700 1 -- 172.21.15.163:0/3795264522 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5609f92044b0 msgr2=0x5609f9204920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:13:30.262 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:30.213+0000 7f04bc905700 1 --2- 172.21.15.163:0/3795264522 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5609f92044b0 0x5609f9204920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:13:30.262 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:30.213+0000 7f04bc905700 1 -- 172.21.15.163:0/3795264522 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5609f8f81de0 con 0x5609f9202f60 2023-07-14T18:13:30.262 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:30.213+0000 7f04bd106700 1 --2- 172.21.15.163:0/3795264522 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5609f92044b0 0x5609f9204920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T18:13:30.263 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:30.213+0000 7f04bc905700 1 --2- 172.21.15.163:0/3795264522 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5609f9202f60 0x5609f9203370 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f04ac0043d0 tx=0x7f04ac014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d08511d45eb0177 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:13:30.263 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:30.213+0000 7f04a2ffd700 1 -- 172.21.15.163:0/3795264522 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04ac003ce0 con 0x5609f9202f60 2023-07-14T18:13:30.263 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:30.213+0000 7f04a2ffd700 1 -- 172.21.15.163:0/3795264522 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f04ac003e40 con 0x5609f9202f60 2023-07-14T18:13:30.263 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:30.213+0000 7f04a2ffd700 1 -- 172.21.15.163:0/3795264522 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04ac026780 con 0x5609f9202f60 2023-07-14T18:13:30.263 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:30.214+0000 7f04cad01b80 1 -- 172.21.15.163:0/3795264522 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5609f9202f60 msgr2=0x5609f9203370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:13:30.263 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:30.214+0000 7f04cad01b80 1 --2- 172.21.15.163:0/3795264522 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5609f9202f60 0x5609f9203370 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f04ac0043d0 tx=0x7f04ac014000 comp rx=0 tx=0).stop 2023-07-14T18:13:30.264 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:30.214+0000 7f04cad01b80 1 -- 172.21.15.163:0/3795264522 shutdown_connections 2023-07-14T18:13:30.264 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:30.214+0000 7f04cad01b80 1 --2- 172.21.15.163:0/3795264522 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5609f92044b0 0x5609f9204920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:13:30.264 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:30.214+0000 7f04cad01b80 1 --2- 172.21.15.163:0/3795264522 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5609f9202f60 0x5609f9203370 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:13:30.264 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:30.214+0000 7f04cad01b80 1 --2- 172.21.15.163:0/3795264522 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5609f92038b0 0x5609f9203ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:13:30.264 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:30.214+0000 7f04cad01b80 1 -- 172.21.15.163:0/3795264522 >> 172.21.15.163:0/3795264522 conn(0x5609f91f8680 msgr2=0x5609f91fd9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:13:30.264 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:30.214+0000 7f04cad01b80 1 -- 172.21.15.163:0/3795264522 shutdown_connections 2023-07-14T18:13:30.265 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:30.214+0000 7f04cad01b80 1 -- 172.21.15.163:0/3795264522 wait complete. 2023-07-14T18:13:30.265 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:30.215+0000 7f04cad01b80 1 -- start start 2023-07-14T18:13:30.265 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:30.215+0000 7f04cad01b80 1 Processor -- start 2023-07-14T18:13:30.265 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:30.215+0000 7f04cad01b80 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5609f9202f60 0x5609f920c990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:13:30.265 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:30.215+0000 7f04cad01b80 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5609f92038b0 0x5609f920ced0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:13:30.265 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:30.215+0000 7f04cad01b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5609f92044b0 0x5609f9213f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:13:30.265 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:30.215+0000 7f04cad01b80 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x5609f90f3ac0 con 0x5609f9202f60 2023-07-14T18:13:30.266 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:30.215+0000 7f04cad01b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x5609f90f37c0 con 0x5609f92044b0 2023-07-14T18:13:30.266 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:30.215+0000 7f04cad01b80 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x5609f8fd7920 con 0x5609f92038b0 2023-07-14T18:13:30.266 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:30.215+0000 7f04cad01b80 10 client.0 _ll_register_callbacks cb 0x5609f90f1760 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T18:13:30.266 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:30.215+0000 7f04bc905700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5609f9202f60 0x5609f920c990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:13:30.266 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:30.216+0000 7f04bc905700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5609f9202f60 0x5609f920c990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:58640/0 (socket says 172.21.15.163:58640) 2023-07-14T18:13:30.266 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:30.216+0000 7f04bc905700 1 -- 172.21.15.163:0/3638637894 learned_addr learned my addr 172.21.15.163:0/3638637894 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:13:30.266 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:30.216+0000 7f04bd106700 1 --2- 172.21.15.163:0/3638637894 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5609f92044b0 0x5609f9213f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:13:30.267 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:30.216+0000 7f04bc905700 1 -- 172.21.15.163:0/3638637894 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5609f92038b0 msgr2=0x5609f920ced0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-07-14T18:13:30.267 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:30.216+0000 7f04bc905700 1 --2- 172.21.15.163:0/3638637894 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5609f92038b0 0x5609f920ced0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:13:30.267 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:30.216+0000 7f04bc905700 1 -- 172.21.15.163:0/3638637894 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5609f92044b0 msgr2=0x5609f9213f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:13:30.267 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:30.216+0000 7f04bc905700 1 --2- 172.21.15.163:0/3638637894 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5609f92044b0 0x5609f9213f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:13:30.267 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:30.216+0000 7f04bc905700 1 -- 172.21.15.163:0/3638637894 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f04b8107f00 con 0x5609f9202f60 2023-07-14T18:13:30.267 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:30.216+0000 7f04bd106700 1 --2- 172.21.15.163:0/3638637894 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5609f92044b0 0x5609f9213f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T18:13:30.268 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:30.216+0000 7f04bc905700 1 --2- 172.21.15.163:0/3638637894 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5609f9202f60 0x5609f920c990 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f04ac0052e0 tx=0x7f04ac005310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f430dc1416c1a665 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:13:30.268 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:30.216+0000 7f0497fff700 10 client.0 ms_handle_connect on v2:172.21.15.163:3300/0 2023-07-14T18:13:30.268 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:30.216+0000 7f0497fff700 1 -- 172.21.15.163:0/3638637894 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04ac02c070 con 0x5609f9202f60 2023-07-14T18:13:30.268 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:30.216+0000 7f04cad01b80 1 -- 172.21.15.163:0/3638637894 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5609f90ad4f0 con 0x5609f9202f60 2023-07-14T18:13:30.268 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:30.216+0000 7f0497fff700 1 -- 172.21.15.163:0/3638637894 <== mon.0 v2:172.21.15.163:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 9049+0+0 (secure 0 0 0) 0x7f04ac004710 con 0x5609f9202f60 2023-07-14T18:13:30.270 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:30.217+0000 7f0497fff700 1 -- 172.21.15.163:0/3638637894 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7f04ac0048d0 con 0x5609f9202f60 2023-07-14T18:13:30.271 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:30.217+0000 7f04cad01b80 10 client.15927 fetch_fsmap learned FSMap version 29 2023-07-14T18:13:30.271 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:30.217+0000 7f04cad01b80 1 -- 172.21.15.163:0/3638637894 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) v3 -- 0x7f04ac017070 con 0x5609f9202f60 2023-07-14T18:13:30.271 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:30.217+0000 7f0497fff700 1 -- 172.21.15.163:0/3638637894 <== mon.0 v2:172.21.15.163:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x5609f90ad4f0 con 0x5609f9202f60 2023-07-14T18:13:30.272 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:30.217+0000 7f0497fff700 1 -- 172.21.15.163:0/3638637894 <== mon.0 v2:172.21.15.163:3300/0 5 ==== fsmap(e 29) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f04ac024020 con 0x5609f9202f60 2023-07-14T18:13:30.272 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:30.217+0000 7f04cad01b80 10 client.15927 fetch_fsmap finished waiting for FSMap version 29 2023-07-14T18:13:30.272 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:30.217+0000 7f04cad01b80 10 client.15927 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-07-14T18:13:30.273 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:30.217+0000 7f04cad01b80 20 client.15927 populate_metadata read hostname 'smithi163' 2023-07-14T18:13:30.273 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:30.217+0000 7f04cad01b80 1 --2- 172.21.15.163:0/3638637894 >> [v2:172.21.15.172:6838/3850440096,v1:172.21.15.172:6839/3850440096] conn(0x5609f9218630 0x5609f921aa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:13:30.273 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:30.217+0000 7f04cad01b80 4 client.15927 mds_command: new command op to 24518 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-14T18:13:30.273 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:30.217+0000 7f04cad01b80 1 -- 172.21.15.163:0/3638637894 --> [v2:172.21.15.172:6838/3850440096,v1:172.21.15.172:6839/3850440096] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5609f91d1da0 con 0x5609f9218630 2023-07-14T18:13:30.274 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:30.218+0000 7f04b7fff700 1 --2- 172.21.15.163:0/3638637894 >> [v2:172.21.15.172:6838/3850440096,v1:172.21.15.172:6839/3850440096] conn(0x5609f9218630 0x5609f921aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:13:30.274 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:30.218+0000 7f0497fff700 10 client.15927 ms_handle_connect on v2:172.21.15.172:6838/3850440096 2023-07-14T18:13:30.274 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:30.218+0000 7f04b7fff700 1 --2- 172.21.15.163:0/3638637894 >> [v2:172.21.15.172:6838/3850440096,v1:172.21.15.172:6839/3850440096] conn(0x5609f9218630 0x5609f921aa40 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bce2792bfd7b59a8 server_cookie=4b76d3d01ebdfe21 in_seq=0 out_seq=0 2023-07-14T18:13:30.275 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:30.219+0000 7f0497fff700 1 -- 172.21.15.163:0/3638637894 <== mds.0 v2:172.21.15.172:6838/3850440096 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18017 (crc 0 0 0) 0x5609f91d1da0 con 0x5609f9218630 2023-07-14T18:13:30.275 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:30.219+0000 7f0497fff700 10 client.15927 handle_command_reply: tid=0 2023-07-14T18:13:30.275 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:30.219+0000 7f04cad01b80 1 client.15927 shutdown 2023-07-14T18:13:30.275 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:30.219+0000 7f04cad01b80 1 -- 172.21.15.163:0/3638637894 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5609f9202f60 msgr2=0x5609f920c990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:13:30.276 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:30.219+0000 7f04cad01b80 1 --2- 172.21.15.163:0/3638637894 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5609f9202f60 0x5609f920c990 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f04ac0052e0 tx=0x7f04ac005310 comp rx=0 tx=0).stop 2023-07-14T18:13:30.276 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:30.219+0000 7f04cad01b80 1 -- 172.21.15.163:0/3638637894 shutdown_connections 2023-07-14T18:13:30.276 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:30.219+0000 7f04cad01b80 1 --2- 172.21.15.163:0/3638637894 >> [v2:172.21.15.172:6838/3850440096,v1:172.21.15.172:6839/3850440096] conn(0x5609f9218630 0x5609f921aa40 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:13:30.277 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:30.219+0000 7f04cad01b80 1 --2- 172.21.15.163:0/3638637894 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5609f92044b0 0x5609f9213f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:13:30.277 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:30.219+0000 7f04cad01b80 1 --2- 172.21.15.163:0/3638637894 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5609f9202f60 0x5609f920c990 unknown :-1 s=CLOSED pgs=592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:13:30.277 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:30.219+0000 7f04cad01b80 1 --2- 172.21.15.163:0/3638637894 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5609f92038b0 0x5609f920ced0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:13:30.277 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:30.219+0000 7f04cad01b80 1 -- 172.21.15.163:0/3638637894 >> 172.21.15.163:0/3638637894 conn(0x5609f91f8680 msgr2=0x5609f91fc650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:13:30.277 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:30.219+0000 7f0497fff700 0 client.15927 ms_handle_reset on v2:172.21.15.172:6838/3850440096 2023-07-14T18:13:30.277 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:30.219+0000 7f04cad01b80 1 -- 172.21.15.163:0/3638637894 shutdown_connections 2023-07-14T18:13:30.278 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:30.219+0000 7f04cad01b80 1 -- 172.21.15.163:0/3638637894 wait complete. 2023-07-14T18:13:30.278 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:30.219+0000 7f04cad01b80 20 client.15927 trim_cache size 0 max 16384 2023-07-14T18:13:30.278 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:13:29 smithi172 ceph-mon[97983]: from='client.? 172.21.15.163:0/3368860996' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-07-14T18:13:30.278 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:13:29 smithi172 ceph-mon[97983]: pgmap v325: 129 pgs: 129 active+clean; 660 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 10 op/s; 0 B/s, 0 objects/s recovering 2023-07-14T18:13:30.285 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:30.243+0000 7f04cad01b80 1 Processor -- start 2023-07-14T18:13:30.285 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:30.243+0000 7f04cad01b80 1 -- start start 2023-07-14T18:13:30.285 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:30.244+0000 7f04cad01b80 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5609f9202f60 0x5609f9204880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:13:30.285 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:30.244+0000 7f04cad01b80 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5609f92038b0 0x5609f9213ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:13:30.286 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:30.244+0000 7f04cad01b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5609f92044b0 0x5609f921a640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:13:30.286 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:30.244+0000 7f04cad01b80 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x5609f920be40 con 0x5609f92038b0 2023-07-14T18:13:30.286 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:30.244+0000 7f04cad01b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x5609f91fec10 con 0x5609f92044b0 2023-07-14T18:13:30.286 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:30.244+0000 7f04cad01b80 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x5609f920b3a0 con 0x5609f9202f60 2023-07-14T18:13:30.288 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:30.244+0000 7f04bd106700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5609f92044b0 0x5609f921a640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:13:30.289 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:30.244+0000 7f04b7fff700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5609f92038b0 0x5609f9213ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:13:30.289 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:30.244+0000 7f04bd106700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5609f92044b0 0x5609f921a640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.163:59334/0 (socket says 172.21.15.163:59334) 2023-07-14T18:13:30.289 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:30.244+0000 7f04bd106700 1 -- 172.21.15.163:0/1067751672 learned_addr learned my addr 172.21.15.163:0/1067751672 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:13:30.289 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:30.244+0000 7f04bc905700 1 --2- 172.21.15.163:0/1067751672 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5609f9202f60 0x5609f9204880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:13:30.289 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:30.244+0000 7f04bd106700 1 -- 172.21.15.163:0/1067751672 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5609f9202f60 msgr2=0x5609f9204880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:13:30.290 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:30.244+0000 7f04bd106700 1 --2- 172.21.15.163:0/1067751672 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5609f9202f60 0x5609f9204880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:13:30.290 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:30.244+0000 7f04bd106700 1 -- 172.21.15.163:0/1067751672 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5609f92038b0 msgr2=0x5609f9213ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:13:30.290 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:30.244+0000 7f04bd106700 1 --2- 172.21.15.163:0/1067751672 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5609f92038b0 0x5609f9213ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:13:30.290 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:30.244+0000 7f04bd106700 1 -- 172.21.15.163:0/1067751672 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5609f8f6ac60 con 0x5609f92044b0 2023-07-14T18:13:30.290 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:30.244+0000 7f04b7fff700 1 --2- 172.21.15.163:0/1067751672 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5609f92038b0 0x5609f9213ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T18:13:30.291 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:30.244+0000 7f04bd106700 1 --2- 172.21.15.163:0/1067751672 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5609f92044b0 0x5609f921a640 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f04b00993a0 tx=0x7f04b00b9040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b04d97ca2b1d006c server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:13:30.291 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:30.245+0000 7f04a37fe700 1 -- 172.21.15.163:0/1067751672 <== mon.2 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04b0013e80 con 0x5609f92044b0 2023-07-14T18:13:30.291 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:30.245+0000 7f04a37fe700 1 -- 172.21.15.163:0/1067751672 <== mon.2 v2:172.21.15.172:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f04b00996a0 con 0x5609f92044b0 2023-07-14T18:13:30.291 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:30.245+0000 7f04a37fe700 1 -- 172.21.15.163:0/1067751672 <== mon.2 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04b0095db0 con 0x5609f92044b0 2023-07-14T18:13:30.291 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:30.246+0000 7f04cad01b80 1 -- 172.21.15.163:0/1067751672 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5609f92044b0 msgr2=0x5609f921a640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:13:30.292 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:30.246+0000 7f04cad01b80 1 --2- 172.21.15.163:0/1067751672 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5609f92044b0 0x5609f921a640 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f04b00993a0 tx=0x7f04b00b9040 comp rx=0 tx=0).stop 2023-07-14T18:13:30.292 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:30.246+0000 7f04cad01b80 1 -- 172.21.15.163:0/1067751672 shutdown_connections 2023-07-14T18:13:30.292 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:30.246+0000 7f04cad01b80 1 --2- 172.21.15.163:0/1067751672 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5609f9202f60 0x5609f9204880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:13:30.292 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:30.246+0000 7f04cad01b80 1 --2- 172.21.15.163:0/1067751672 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5609f92044b0 0x5609f921a640 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:13:30.292 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:30.246+0000 7f04cad01b80 1 --2- 172.21.15.163:0/1067751672 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5609f92038b0 0x5609f9213ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:13:30.292 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:30.246+0000 7f04cad01b80 1 -- 172.21.15.163:0/1067751672 >> 172.21.15.163:0/1067751672 conn(0x5609f91f8680 msgr2=0x5609f920b670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:13:30.293 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:30.246+0000 7f04cad01b80 1 -- 172.21.15.163:0/1067751672 shutdown_connections 2023-07-14T18:13:30.293 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:30.246+0000 7f04cad01b80 1 -- 172.21.15.163:0/1067751672 wait complete. 2023-07-14T18:13:30.293 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:30.246+0000 7f04cad01b80 1 -- start start 2023-07-14T18:13:30.293 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:30.246+0000 7f04cad01b80 1 Processor -- start 2023-07-14T18:13:30.293 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:30.247+0000 7f04cad01b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5609f9202f60 0x5609f920fc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:13:30.293 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:30.247+0000 7f04cad01b80 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5609f92038b0 0x5609f92101d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:13:30.294 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:30.247+0000 7f04cad01b80 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5609f92044b0 0x5609f92131f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:13:30.294 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:30.247+0000 7f04cad01b80 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x5609f9213730 con 0x5609f92044b0 2023-07-14T18:13:30.294 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:30.247+0000 7f04cad01b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x5609f92138a0 con 0x5609f9202f60 2023-07-14T18:13:30.294 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:30.247+0000 7f04cad01b80 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x5609f9213a10 con 0x5609f92038b0 2023-07-14T18:13:30.294 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:30.247+0000 7f04cad01b80 10 client.0 _ll_register_callbacks cb 0x7f04b0095340 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T18:13:30.294 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:30.247+0000 7f04bc905700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5609f9202f60 0x5609f920fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:13:30.295 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:30.247+0000 7f04bc905700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5609f9202f60 0x5609f920fc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.163:59338/0 (socket says 172.21.15.163:59338) 2023-07-14T18:13:30.295 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:30.247+0000 7f04bc905700 1 -- 172.21.15.163:0/3462202152 learned_addr learned my addr 172.21.15.163:0/3462202152 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:13:30.295 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:30.247+0000 7f04b7fff700 1 --2- 172.21.15.163:0/3462202152 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5609f92038b0 0x5609f92101d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:13:30.295 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:30.247+0000 7f04bd106700 1 --2- 172.21.15.163:0/3462202152 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5609f92044b0 0x5609f92131f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:13:30.295 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:30.247+0000 7f04bc905700 1 -- 172.21.15.163:0/3462202152 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5609f92038b0 msgr2=0x5609f92101d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:13:30.295 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:30.247+0000 7f04bc905700 1 --2- 172.21.15.163:0/3462202152 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5609f92038b0 0x5609f92101d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:13:30.296 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:30.247+0000 7f04bc905700 1 -- 172.21.15.163:0/3462202152 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5609f92044b0 msgr2=0x5609f92131f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:13:30.296 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:30.247+0000 7f04bc905700 1 --2- 172.21.15.163:0/3462202152 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5609f92044b0 0x5609f92131f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:13:30.296 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:30.247+0000 7f04bc905700 1 -- 172.21.15.163:0/3462202152 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f04b8067960 con 0x5609f9202f60 2023-07-14T18:13:30.296 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:30.247+0000 7f04bd106700 1 --2- 172.21.15.163:0/3462202152 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5609f92044b0 0x5609f92131f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T18:13:30.296 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:30.247+0000 7f04bc905700 1 --2- 172.21.15.163:0/3462202152 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5609f9202f60 0x5609f920fc90 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f04ac0052e0 tx=0x7f04ac026630 comp rx=0 tx=0).ready entity=mon.2 client_cookie=84478bf6594faa56 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:13:30.296 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:30.247+0000 7f0497fff700 10 client.0 ms_handle_connect on v2:172.21.15.172:3300/0 2023-07-14T18:13:30.298 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:30.248+0000 7f0497fff700 1 -- 172.21.15.163:0/3462202152 <== mon.2 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04ac02c030 con 0x5609f9202f60 2023-07-14T18:13:30.298 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:30.248+0000 7f0497fff700 1 -- 172.21.15.163:0/3462202152 <== mon.2 v2:172.21.15.172:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 9049+0+0 (secure 0 0 0) 0x7f04ac02d070 con 0x5609f9202f60 2023-07-14T18:13:30.299 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:30.248+0000 7f04cad01b80 1 -- 172.21.15.163:0/3462202152 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f04ac003e40 con 0x5609f9202f60 2023-07-14T18:13:30.299 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:30.248+0000 7f0497fff700 1 -- 172.21.15.163:0/3462202152 <== mon.2 v2:172.21.15.172:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7f04ac01e830 con 0x5609f9202f60 2023-07-14T18:13:30.299 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:30.248+0000 7f04cad01b80 10 client.25568 fetch_fsmap learned FSMap version 29 2023-07-14T18:13:30.299 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:30.248+0000 7f04cad01b80 1 -- 172.21.15.163:0/3462202152 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) v3 -- 0x7f04b81079f0 con 0x5609f9202f60 2023-07-14T18:13:30.299 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:30.248+0000 7f0497fff700 1 -- 172.21.15.163:0/3462202152 <== mon.2 v2:172.21.15.172:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f04ac048020 con 0x5609f9202f60 2023-07-14T18:13:30.299 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:30.248+0000 7f0497fff700 1 -- 172.21.15.163:0/3462202152 <== mon.2 v2:172.21.15.172:3300/0 5 ==== fsmap(e 29) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f04ac003680 con 0x5609f9202f60 2023-07-14T18:13:30.299 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:30.248+0000 7f04cad01b80 10 client.25568 fetch_fsmap finished waiting for FSMap version 29 2023-07-14T18:13:30.300 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:30.248+0000 7f04cad01b80 10 client.25568 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-07-14T18:13:30.300 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:30.248+0000 7f04cad01b80 20 client.25568 populate_metadata read hostname 'smithi163' 2023-07-14T18:13:30.300 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:30.248+0000 7f04cad01b80 1 --2- 172.21.15.163:0/3462202152 >> [v2:172.21.15.172:6838/3850440096,v1:172.21.15.172:6839/3850440096] conn(0x5609f9268df0 0x5609f926b200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:13:30.300 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:30.248+0000 7f04cad01b80 4 client.25568 mds_command: new command op to 24518 tid=0[{"prefix": "damage ls"}] 2023-07-14T18:13:30.300 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:30.248+0000 7f04cad01b80 1 -- 172.21.15.163:0/3462202152 --> [v2:172.21.15.172:6838/3850440096,v1:172.21.15.172:6839/3850440096] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x5609f914ceb0 con 0x5609f9268df0 2023-07-14T18:13:30.301 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:30.249+0000 7f04b7fff700 1 --2- 172.21.15.163:0/3462202152 >> [v2:172.21.15.172:6838/3850440096,v1:172.21.15.172:6839/3850440096] conn(0x5609f9268df0 0x5609f926b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:13:30.301 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:30.249+0000 7f0497fff700 10 client.25568 ms_handle_connect on v2:172.21.15.172:6838/3850440096 2023-07-14T18:13:30.301 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:30.249+0000 7f04b7fff700 1 --2- 172.21.15.163:0/3462202152 >> [v2:172.21.15.172:6838/3850440096,v1:172.21.15.172:6839/3850440096] conn(0x5609f9268df0 0x5609f926b200 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ec9d3571d7ce8dcc server_cookie=f22e0da3124e24ab in_seq=0 out_seq=0 2023-07-14T18:13:30.301 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:30.249+0000 7f0497fff700 1 -- 172.21.15.163:0/3462202152 <== mds.0 v2:172.21.15.172:6838/3850440096 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x5609f914ceb0 con 0x5609f9268df0 2023-07-14T18:13:30.301 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:30.249+0000 7f0497fff700 10 client.25568 handle_command_reply: tid=0 2023-07-14T18:13:30.301 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:30.249+0000 7f04cad01b80 1 client.25568 shutdown 2023-07-14T18:13:30.301 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:30.250+0000 7f04cad01b80 1 -- 172.21.15.163:0/3462202152 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5609f9202f60 msgr2=0x5609f920fc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:13:30.302 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:30.250+0000 7f04cad01b80 1 --2- 172.21.15.163:0/3462202152 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5609f9202f60 0x5609f920fc90 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f04ac0052e0 tx=0x7f04ac026630 comp rx=0 tx=0).stop 2023-07-14T18:13:30.302 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:30.250+0000 7f04cad01b80 1 -- 172.21.15.163:0/3462202152 shutdown_connections 2023-07-14T18:13:30.302 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:30.250+0000 7f04cad01b80 1 --2- 172.21.15.163:0/3462202152 >> [v2:172.21.15.172:6838/3850440096,v1:172.21.15.172:6839/3850440096] conn(0x5609f9268df0 0x5609f926b200 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:13:30.302 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:30.250+0000 7f04cad01b80 1 --2- 172.21.15.163:0/3462202152 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5609f92044b0 0x5609f92131f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:13:30.302 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:30.250+0000 7f0497fff700 0 client.25568 ms_handle_reset on v2:172.21.15.172:6838/3850440096 2023-07-14T18:13:30.302 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:30.250+0000 7f04cad01b80 1 --2- 172.21.15.163:0/3462202152 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5609f9202f60 0x5609f920fc90 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:13:30.303 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:30.250+0000 7f04cad01b80 1 --2- 172.21.15.163:0/3462202152 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5609f92038b0 0x5609f92101d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:13:30.303 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:30.250+0000 7f04cad01b80 1 -- 172.21.15.163:0/3462202152 >> 172.21.15.163:0/3462202152 conn(0x5609f91f8680 msgr2=0x5609f921a640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:13:30.303 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:30.250+0000 7f04cad01b80 1 -- 172.21.15.163:0/3462202152 shutdown_connections 2023-07-14T18:13:30.303 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:30.250+0000 7f04cad01b80 1 -- 172.21.15.163:0/3462202152 wait complete. 2023-07-14T18:13:30.303 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:30.250+0000 7f04cad01b80 20 client.25568 trim_cache size 0 max 16384 2023-07-14T18:13:30.304 INFO:teuthology.orchestra.run.smithi163.stdout:[] 2023-07-14T18:13:30.306 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:30.251+0000 7f04beb69700 1 -- 172.21.15.163:0/666968127 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f04a80a1150 msgr2=0x7f04a80a3600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:13:30.306 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:30.251+0000 7f04beb69700 1 --2- 172.21.15.163:0/666968127 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f04a80a1150 0x7f04a80a3600 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f04b80ffb60 tx=0x7f04ac009260 comp rx=0 tx=0).stop 2023-07-14T18:13:30.306 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:30.251+0000 7f04beb69700 1 -- 172.21.15.163:0/666968127 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f04b8100690 msgr2=0x7f04b819ce60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:13:30.306 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:30.251+0000 7f04beb69700 1 --2- 172.21.15.163:0/666968127 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f04b8100690 0x7f04b819ce60 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f04b0007ee0 tx=0x7f04b000d3b0 comp rx=0 tx=0).stop 2023-07-14T18:13:30.307 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:30.251+0000 7f04beb69700 1 -- 172.21.15.163:0/666968127 shutdown_connections 2023-07-14T18:13:30.307 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:30.251+0000 7f04beb69700 1 --2- 172.21.15.163:0/666968127 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f04a80a1150 0x7f04a80a3600 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:13:30.307 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:30.251+0000 7f04beb69700 1 --2- 172.21.15.163:0/666968127 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f04b8100690 0x7f04b819ce60 unknown :-1 s=CLOSED pgs=590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:13:30.308 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:30.251+0000 7f04beb69700 1 --2- 172.21.15.163:0/666968127 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f04b80feb10 0x7f04b81958b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:13:30.308 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:30.251+0000 7f04beb69700 1 --2- 172.21.15.163:0/666968127 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f04b80ffd00 0x7f04b8195df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:13:30.308 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:30.251+0000 7f04beb69700 1 -- 172.21.15.163:0/666968127 >> 172.21.15.163:0/666968127 conn(0x7f04b80fa130 msgr2=0x7f04b80fc410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:13:30.308 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:30.251+0000 7f04beb69700 1 -- 172.21.15.163:0/666968127 shutdown_connections 2023-07-14T18:13:30.309 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:30.251+0000 7f04beb69700 1 -- 172.21.15.163:0/666968127 wait complete. 2023-07-14T18:13:31.311 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2023-07-14T18:13:31.312 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2023-07-14T18:13:31.506 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:31.464+0000 7f9d9a559700 1 -- 172.21.15.163:0/342868631 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9d941000f0 msgr2=0x7f9d94100500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:13:31.506 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:31.464+0000 7f9d9a559700 1 --2- 172.21.15.163:0/342868631 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9d941000f0 0x7f9d94100500 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f9d840098f0 tx=0x7f9d84009c00 comp rx=0 tx=0).stop 2023-07-14T18:13:31.506 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:31.464+0000 7f9d9a559700 1 -- 172.21.15.163:0/342868631 shutdown_connections 2023-07-14T18:13:31.506 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:31.464+0000 7f9d9a559700 1 --2- 172.21.15.163:0/342868631 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9d941000f0 0x7f9d94100500 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:13:31.506 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:31.464+0000 7f9d9a559700 1 --2- 172.21.15.163:0/342868631 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f9d940ff6f0 0x7f9d94106fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:13:31.507 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:31.464+0000 7f9d9a559700 1 --2- 172.21.15.163:0/342868631 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9d940fed40 0x7f9d940ff1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:13:31.507 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:31.464+0000 7f9d9a559700 1 -- 172.21.15.163:0/342868631 >> 172.21.15.163:0/342868631 conn(0x7f9d940f98e0 msgr2=0x7f9d940fbd10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:13:31.507 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:31.464+0000 7f9d9a559700 1 -- 172.21.15.163:0/342868631 shutdown_connections 2023-07-14T18:13:31.507 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:31.464+0000 7f9d9a559700 1 -- 172.21.15.163:0/342868631 wait complete. 2023-07-14T18:13:31.508 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:31.465+0000 7f9d9a559700 1 Processor -- start 2023-07-14T18:13:31.509 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:31.465+0000 7f9d9a559700 1 -- start start 2023-07-14T18:13:31.509 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:31.465+0000 7f9d9a559700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f9d940fed40 0x7f9d940fe7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:13:31.509 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:31.466+0000 7f9d9a559700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9d940ff6f0 0x7f9d9419a620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:13:31.509 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:31.466+0000 7f9d9a559700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9d941000f0 0x7f9d9419cc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:13:31.509 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:31.466+0000 7f9d9a559700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d9419d400 con 0x7f9d940fed40 2023-07-14T18:13:31.509 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:31.466+0000 7f9d9a559700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d9419d570 con 0x7f9d940ff6f0 2023-07-14T18:13:31.510 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:31.466+0000 7f9d9a559700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d9419d730 con 0x7f9d941000f0 2023-07-14T18:13:31.510 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:31.466+0000 7f9d93fff700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f9d940fed40 0x7f9d940fe7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:13:31.510 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:31.466+0000 7f9d93fff700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f9d940fed40 0x7f9d940fe7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:58668/0 (socket says 172.21.15.163:58668) 2023-07-14T18:13:31.510 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:31.466+0000 7f9d93fff700 1 -- 172.21.15.163:0/874430339 learned_addr learned my addr 172.21.15.163:0/874430339 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:13:31.510 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:31.466+0000 7f9d98af6700 1 --2- 172.21.15.163:0/874430339 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9d941000f0 0x7f9d9419cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:13:31.510 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:31.466+0000 7f9d937fe700 1 --2- 172.21.15.163:0/874430339 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9d940ff6f0 0x7f9d9419a620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:13:31.510 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:31.466+0000 7f9d93fff700 1 -- 172.21.15.163:0/874430339 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9d941000f0 msgr2=0x7f9d9419cc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:13:31.511 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:31.466+0000 7f9d93fff700 1 --2- 172.21.15.163:0/874430339 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9d941000f0 0x7f9d9419cc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:13:31.511 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:31.466+0000 7f9d93fff700 1 -- 172.21.15.163:0/874430339 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9d940ff6f0 msgr2=0x7f9d9419a620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:13:31.511 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:31.466+0000 7f9d93fff700 1 --2- 172.21.15.163:0/874430339 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9d940ff6f0 0x7f9d9419a620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:13:31.511 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:31.466+0000 7f9d93fff700 1 -- 172.21.15.163:0/874430339 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d84009520 con 0x7f9d940fed40 2023-07-14T18:13:31.511 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:31.466+0000 7f9d93fff700 1 --2- 172.21.15.163:0/874430339 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f9d940fed40 0x7f9d940fe7a0 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f9d84009fd0 tx=0x7f9d8400b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:13:31.511 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:31.466+0000 7f9d917fa700 1 -- 172.21.15.163:0/874430339 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d8401c070 con 0x7f9d940fed40 2023-07-14T18:13:31.511 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:31.467+0000 7f9d9a559700 1 -- 172.21.15.163:0/874430339 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9d9419d9b0 con 0x7f9d940fed40 2023-07-14T18:13:31.512 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:31.467+0000 7f9d9a559700 1 -- 172.21.15.163:0/874430339 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d9419de30 con 0x7f9d940fed40 2023-07-14T18:13:31.512 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:31.467+0000 7f9d917fa700 1 -- 172.21.15.163:0/874430339 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f9d8400f7b0 con 0x7f9d940fed40 2023-07-14T18:13:31.512 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:31.467+0000 7f9d917fa700 1 -- 172.21.15.163:0/874430339 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d840049c0 con 0x7f9d940fed40 2023-07-14T18:13:31.513 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:31.470+0000 7f9d917fa700 1 -- 172.21.15.163:0/874430339 <== mon.0 v2:172.21.15.163:3300/0 4 ==== mgrmap(e 18) v1 ==== 135716+0+0 (secure 0 0 0) 0x7f9d84020070 con 0x7f9d940fed40 2023-07-14T18:13:31.513 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:31.471+0000 7f9d917fa700 1 --2- 172.21.15.163:0/874430339 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f9d7c0a11d0 0x7f9d7c0a3680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:13:31.513 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:31.471+0000 7f9d917fa700 1 -- 172.21.15.163:0/874430339 <== mon.0 v2:172.21.15.163:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 9049+0+0 (secure 0 0 0) 0x7f9d840cd860 con 0x7f9d940fed40 2023-07-14T18:13:31.513 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:31.471+0000 7f9d937fe700 1 --2- 172.21.15.163:0/874430339 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f9d7c0a11d0 0x7f9d7c0a3680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:13:31.515 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:31.471+0000 7f9da66f1b80 1 Processor -- start 2023-07-14T18:13:31.515 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:31.471+0000 7f9da66f1b80 1 -- start start 2023-07-14T18:13:31.515 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:31.472+0000 7f9d937fe700 1 --2- 172.21.15.163:0/874430339 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f9d7c0a11d0 0x7f9d7c0a3680 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f9d88009bf0 tx=0x7f9d88009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:13:31.515 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:31.472+0000 7f9da66f1b80 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5573ab14efe0 0x5573ab14f3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:13:31.516 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:31.472+0000 7f9da66f1b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5573ab14f930 0x5573ab14ff50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:13:31.516 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:31.472+0000 7f9da66f1b80 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5573ab150530 0x5573ab1509a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:13:31.516 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:31.472+0000 7f9da66f1b80 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x5573ab053d30 con 0x5573ab14efe0 2023-07-14T18:13:31.516 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:31.472+0000 7f9da66f1b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x5573ab0a6ac0 con 0x5573ab14f930 2023-07-14T18:13:31.516 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:31.472+0000 7f9da66f1b80 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x5573ab09ff50 con 0x5573ab150530 2023-07-14T18:13:31.516 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:31.472+0000 7f9d93fff700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5573ab14efe0 0x5573ab14f3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:13:31.517 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:31.472+0000 7f9d93fff700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5573ab14efe0 0x5573ab14f3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:58676/0 (socket says 172.21.15.163:58676) 2023-07-14T18:13:31.517 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:31.472+0000 7f9d93fff700 1 -- 172.21.15.163:0/1671021858 learned_addr learned my addr 172.21.15.163:0/1671021858 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:13:31.517 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:31.472+0000 7f9d98af6700 1 --2- 172.21.15.163:0/1671021858 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5573ab150530 0x5573ab1509a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:13:31.517 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:31.472+0000 7f9d937fe700 1 --2- 172.21.15.163:0/1671021858 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5573ab14f930 0x5573ab14ff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:13:31.517 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:31.472+0000 7f9d93fff700 1 -- 172.21.15.163:0/1671021858 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5573ab150530 msgr2=0x5573ab1509a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:13:31.517 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:31.472+0000 7f9d93fff700 1 --2- 172.21.15.163:0/1671021858 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5573ab150530 0x5573ab1509a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:13:31.517 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:31.472+0000 7f9d93fff700 1 -- 172.21.15.163:0/1671021858 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5573ab14f930 msgr2=0x5573ab14ff50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:13:31.518 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:31.472+0000 7f9d93fff700 1 --2- 172.21.15.163:0/1671021858 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5573ab14f930 0x5573ab14ff50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:13:31.518 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:31.472+0000 7f9d93fff700 1 -- 172.21.15.163:0/1671021858 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5573aaecde60 con 0x5573ab14efe0 2023-07-14T18:13:31.518 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:31.472+0000 7f9d937fe700 1 --2- 172.21.15.163:0/1671021858 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5573ab14f930 0x5573ab14ff50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T18:13:31.518 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:31.472+0000 7f9d98af6700 1 --2- 172.21.15.163:0/1671021858 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5573ab150530 0x5573ab1509a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T18:13:31.518 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:31.473+0000 7f9d93fff700 1 --2- 172.21.15.163:0/1671021858 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5573ab14efe0 0x5573ab14f3f0 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f9d840a3770 tx=0x7f9d8409b510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=757978bc9de71cbb server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:13:31.518 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:31.473+0000 7f9d7a7fc700 1 -- 172.21.15.163:0/1671021858 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d84086050 con 0x5573ab14efe0 2023-07-14T18:13:31.518 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:31.473+0000 7f9d7a7fc700 1 -- 172.21.15.163:0/1671021858 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f9d840a3ca0 con 0x5573ab14efe0 2023-07-14T18:13:31.518 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:31.473+0000 7f9d7a7fc700 1 -- 172.21.15.163:0/1671021858 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d8409add0 con 0x5573ab14efe0 2023-07-14T18:13:31.519 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:31.474+0000 7f9da66f1b80 1 -- 172.21.15.163:0/1671021858 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5573ab14efe0 msgr2=0x5573ab14f3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:13:31.519 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:31.474+0000 7f9da66f1b80 1 --2- 172.21.15.163:0/1671021858 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5573ab14efe0 0x5573ab14f3f0 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f9d840a3770 tx=0x7f9d8409b510 comp rx=0 tx=0).stop 2023-07-14T18:13:31.519 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:31.474+0000 7f9da66f1b80 1 -- 172.21.15.163:0/1671021858 shutdown_connections 2023-07-14T18:13:31.519 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:31.474+0000 7f9da66f1b80 1 --2- 172.21.15.163:0/1671021858 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5573ab150530 0x5573ab1509a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:13:31.519 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:31.474+0000 7f9da66f1b80 1 --2- 172.21.15.163:0/1671021858 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5573ab14efe0 0x5573ab14f3f0 unknown :-1 s=CLOSED pgs=594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:13:31.519 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:31.474+0000 7f9da66f1b80 1 --2- 172.21.15.163:0/1671021858 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5573ab14f930 0x5573ab14ff50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:13:31.519 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:31.474+0000 7f9da66f1b80 1 -- 172.21.15.163:0/1671021858 >> 172.21.15.163:0/1671021858 conn(0x5573ab144700 msgr2=0x5573ab149a50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:13:31.520 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:31.474+0000 7f9da66f1b80 1 -- 172.21.15.163:0/1671021858 shutdown_connections 2023-07-14T18:13:31.520 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:31.474+0000 7f9da66f1b80 1 -- 172.21.15.163:0/1671021858 wait complete. 2023-07-14T18:13:31.522 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:31.474+0000 7f9da66f1b80 1 -- start start 2023-07-14T18:13:31.523 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:31.475+0000 7f9da66f1b80 1 Processor -- start 2023-07-14T18:13:31.523 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:31.475+0000 7f9da66f1b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5573ab14efe0 0x5573ab158600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:13:31.523 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:31.475+0000 7f9da66f1b80 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5573ab14f930 0x5573ab158b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:13:31.523 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:31.475+0000 7f9da66f1b80 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5573ab150530 0x5573ab15fb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:13:31.523 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:31.475+0000 7f9da66f1b80 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x5573ab03fb40 con 0x5573ab150530 2023-07-14T18:13:31.523 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:31.475+0000 7f9da66f1b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x5573ab03f840 con 0x5573ab14efe0 2023-07-14T18:13:31.523 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:31.475+0000 7f9da66f1b80 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x5573aaf239a0 con 0x5573ab14f930 2023-07-14T18:13:31.524 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:31.475+0000 7f9da66f1b80 10 client.0 _ll_register_callbacks cb 0x5573ab03d7e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T18:13:31.524 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:31.475+0000 7f9d93fff700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5573ab14efe0 0x5573ab158600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:13:31.524 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:31.475+0000 7f9d93fff700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5573ab14efe0 0x5573ab158600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.163:59366/0 (socket says 172.21.15.163:59366) 2023-07-14T18:13:31.524 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:31.475+0000 7f9d93fff700 1 -- 172.21.15.163:0/3550709043 learned_addr learned my addr 172.21.15.163:0/3550709043 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:13:31.524 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:31.475+0000 7f9d937fe700 1 --2- 172.21.15.163:0/3550709043 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5573ab14f930 0x5573ab158b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:13:31.524 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:31.476+0000 7f9d93fff700 1 -- 172.21.15.163:0/3550709043 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5573ab14f930 msgr2=0x5573ab158b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:13:31.524 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:31.476+0000 7f9d93fff700 1 --2- 172.21.15.163:0/3550709043 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5573ab14f930 0x5573ab158b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:13:31.525 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:31.476+0000 7f9d93fff700 1 -- 172.21.15.163:0/3550709043 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5573ab150530 msgr2=0x5573ab15fb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:13:31.525 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:31.476+0000 7f9d93fff700 1 --2- 172.21.15.163:0/3550709043 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5573ab150530 0x5573ab15fb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:13:31.525 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:31.476+0000 7f9d93fff700 1 -- 172.21.15.163:0/3550709043 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d8c009050 con 0x5573ab14efe0 2023-07-14T18:13:31.525 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:31.476+0000 7f9d93fff700 1 --2- 172.21.15.163:0/3550709043 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5573ab14efe0 0x5573ab158600 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f9d8409b870 tx=0x7f9d8409fa90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=49ebd81b8dc3dcdf server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:13:31.525 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:31.476+0000 7f9d737fe700 10 client.0 ms_handle_connect on v2:172.21.15.172:3300/0 2023-07-14T18:13:31.525 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:31.476+0000 7f9d737fe700 1 -- 172.21.15.163:0/3550709043 <== mon.2 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d840a3810 con 0x5573ab14efe0 2023-07-14T18:13:31.525 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:31.476+0000 7f9d737fe700 1 -- 172.21.15.163:0/3550709043 <== mon.2 v2:172.21.15.172:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 9049+0+0 (secure 0 0 0) 0x7f9d840a3970 con 0x5573ab14efe0 2023-07-14T18:13:31.526 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:31.476+0000 7f9da66f1b80 1 -- 172.21.15.163:0/3550709043 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5573aaff9570 con 0x5573ab14efe0 2023-07-14T18:13:31.526 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:31.476+0000 7f9d737fe700 1 -- 172.21.15.163:0/3550709043 <== mon.2 v2:172.21.15.172:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9d84086020 con 0x5573ab14efe0 2023-07-14T18:13:31.526 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:31.476+0000 7f9da66f1b80 10 client.25580 fetch_fsmap learned FSMap version 29 2023-07-14T18:13:31.526 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:31.476+0000 7f9da66f1b80 1 -- 172.21.15.163:0/3550709043 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) v3 -- 0x7f9d9419de30 con 0x5573ab14efe0 2023-07-14T18:13:31.526 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:31.477+0000 7f9d737fe700 1 -- 172.21.15.163:0/3550709043 <== mon.2 v2:172.21.15.172:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x5573aaff9570 con 0x5573ab14efe0 2023-07-14T18:13:31.526 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:31.477+0000 7f9d737fe700 1 -- 172.21.15.163:0/3550709043 <== mon.2 v2:172.21.15.172:3300/0 5 ==== fsmap(e 29) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f9d84097760 con 0x5573ab14efe0 2023-07-14T18:13:31.526 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:31.477+0000 7f9da66f1b80 10 client.25580 fetch_fsmap finished waiting for FSMap version 29 2023-07-14T18:13:31.527 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:31.477+0000 7f9da66f1b80 10 client.25580 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-07-14T18:13:31.527 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:31.477+0000 7f9da66f1b80 20 client.25580 populate_metadata read hostname 'smithi163' 2023-07-14T18:13:31.527 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:31.477+0000 7f9da66f1b80 1 --2- 172.21.15.163:0/3550709043 >> [v2:172.21.15.172:6838/3850440096,v1:172.21.15.172:6839/3850440096] conn(0x5573ab164020 0x5573ab166430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:13:31.527 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:31.477+0000 7f9da66f1b80 4 client.25580 mds_command: new command op to 24518 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-14T18:13:31.527 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:31.477+0000 7f9da66f1b80 1 -- 172.21.15.163:0/3550709043 --> [v2:172.21.15.172:6838/3850440096,v1:172.21.15.172:6839/3850440096] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5573ab11de20 con 0x5573ab164020 2023-07-14T18:13:31.527 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:31.477+0000 7f9d937fe700 1 --2- 172.21.15.163:0/3550709043 >> [v2:172.21.15.172:6838/3850440096,v1:172.21.15.172:6839/3850440096] conn(0x5573ab164020 0x5573ab166430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:13:31.527 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:31.478+0000 7f9d737fe700 10 client.25580 ms_handle_connect on v2:172.21.15.172:6838/3850440096 2023-07-14T18:13:31.528 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:31.478+0000 7f9d937fe700 1 --2- 172.21.15.163:0/3550709043 >> [v2:172.21.15.172:6838/3850440096,v1:172.21.15.172:6839/3850440096] conn(0x5573ab164020 0x5573ab166430 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2543076d122d9607 server_cookie=c76d6b222376bae1 in_seq=0 out_seq=0 2023-07-14T18:13:31.528 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:31.478+0000 7f9d737fe700 1 -- 172.21.15.163:0/3550709043 <== mds.0 v2:172.21.15.172:6838/3850440096 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18017 (crc 0 0 0) 0x5573ab11de20 con 0x5573ab164020 2023-07-14T18:13:31.528 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:31.478+0000 7f9d737fe700 10 client.25580 handle_command_reply: tid=0 2023-07-14T18:13:31.528 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:31.478+0000 7f9da66f1b80 1 client.25580 shutdown 2023-07-14T18:13:31.528 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:31.478+0000 7f9da66f1b80 1 -- 172.21.15.163:0/3550709043 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5573ab14efe0 msgr2=0x5573ab158600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:13:31.528 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:31.478+0000 7f9da66f1b80 1 --2- 172.21.15.163:0/3550709043 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5573ab14efe0 0x5573ab158600 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f9d8409b870 tx=0x7f9d8409fa90 comp rx=0 tx=0).stop 2023-07-14T18:13:31.528 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:31.479+0000 7f9da66f1b80 1 -- 172.21.15.163:0/3550709043 shutdown_connections 2023-07-14T18:13:31.529 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:31.479+0000 7f9da66f1b80 1 --2- 172.21.15.163:0/3550709043 >> [v2:172.21.15.172:6838/3850440096,v1:172.21.15.172:6839/3850440096] conn(0x5573ab164020 0x5573ab166430 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:13:31.529 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:31.479+0000 7f9da66f1b80 1 --2- 172.21.15.163:0/3550709043 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5573ab150530 0x5573ab15fb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:13:31.529 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:31.479+0000 7f9da66f1b80 1 --2- 172.21.15.163:0/3550709043 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5573ab14efe0 0x5573ab158600 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:13:31.529 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:31.479+0000 7f9da66f1b80 1 --2- 172.21.15.163:0/3550709043 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5573ab14f930 0x5573ab158b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:13:31.529 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:31.479+0000 7f9da66f1b80 1 -- 172.21.15.163:0/3550709043 >> 172.21.15.163:0/3550709043 conn(0x5573ab144700 msgr2=0x5573ab1486d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:13:31.529 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:31.479+0000 7f9d737fe700 0 client.25580 ms_handle_reset on v2:172.21.15.172:6838/3850440096 2023-07-14T18:13:31.529 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:31.479+0000 7f9da66f1b80 1 -- 172.21.15.163:0/3550709043 shutdown_connections 2023-07-14T18:13:31.530 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:31.479+0000 7f9da66f1b80 1 -- 172.21.15.163:0/3550709043 wait complete. 2023-07-14T18:13:31.530 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:31.479+0000 7f9da66f1b80 20 client.25580 trim_cache size 0 max 16384 2023-07-14T18:13:31.553 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:31.511+0000 7f9da66f1b80 1 Processor -- start 2023-07-14T18:13:31.553 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:31.511+0000 7f9da66f1b80 1 -- start start 2023-07-14T18:13:31.554 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:31.511+0000 7f9da66f1b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5573ab14efe0 0x5573ab158ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:13:31.554 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:31.511+0000 7f9da66f1b80 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5573ab14f930 0x5573ab15fb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:13:31.554 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:31.511+0000 7f9da66f1b80 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5573ab150530 0x5573ab1567c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:13:31.554 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:31.511+0000 7f9da66f1b80 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x5573ab11de20 con 0x5573ab14f930 2023-07-14T18:13:31.554 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:31.511+0000 7f9da66f1b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x5573aaff9570 con 0x5573ab14efe0 2023-07-14T18:13:31.554 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:31.511+0000 7f9da66f1b80 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x5573ab1503b0 con 0x5573ab150530 2023-07-14T18:13:31.555 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:31.511+0000 7f9d93fff700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5573ab14efe0 0x5573ab158ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:13:31.555 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:31.512+0000 7f9d93fff700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5573ab14efe0 0x5573ab158ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.163:59374/0 (socket says 172.21.15.163:59374) 2023-07-14T18:13:31.555 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:31.512+0000 7f9d93fff700 1 -- 172.21.15.163:0/2459243617 learned_addr learned my addr 172.21.15.163:0/2459243617 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:13:31.555 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:31.512+0000 7f9d98af6700 1 --2- 172.21.15.163:0/2459243617 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5573ab150530 0x5573ab1567c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:13:31.555 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:31.512+0000 7f9d937fe700 1 --2- 172.21.15.163:0/2459243617 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5573ab14f930 0x5573ab15fb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:13:31.555 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:31.512+0000 7f9d93fff700 1 -- 172.21.15.163:0/2459243617 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5573ab150530 msgr2=0x5573ab1567c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:13:31.555 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:31.512+0000 7f9d93fff700 1 --2- 172.21.15.163:0/2459243617 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5573ab150530 0x5573ab1567c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:13:31.556 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:31.512+0000 7f9d93fff700 1 -- 172.21.15.163:0/2459243617 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5573ab14f930 msgr2=0x5573ab15fb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:13:31.556 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:31.512+0000 7f9d93fff700 1 --2- 172.21.15.163:0/2459243617 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5573ab14f930 0x5573ab15fb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:13:31.556 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:31.512+0000 7f9d93fff700 1 -- 172.21.15.163:0/2459243617 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5573aaeb6ce0 con 0x5573ab14efe0 2023-07-14T18:13:31.556 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:31.512+0000 7f9d937fe700 1 --2- 172.21.15.163:0/2459243617 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5573ab14f930 0x5573ab15fb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T18:13:31.556 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:31.512+0000 7f9d93fff700 1 --2- 172.21.15.163:0/2459243617 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5573ab14efe0 0x5573ab158ac0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f9d840098c0 tx=0x7f9d84005b40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=902bb1aa888dfa36 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:13:31.556 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:31.512+0000 7f9d7affd700 1 -- 172.21.15.163:0/2459243617 <== mon.2 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d84086050 con 0x5573ab14efe0 2023-07-14T18:13:31.556 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:31.512+0000 7f9d7affd700 1 -- 172.21.15.163:0/2459243617 <== mon.2 v2:172.21.15.172:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f9d84099c80 con 0x5573ab14efe0 2023-07-14T18:13:31.557 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:31.512+0000 7f9d7affd700 1 -- 172.21.15.163:0/2459243617 <== mon.2 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d840a3810 con 0x5573ab14efe0 2023-07-14T18:13:31.559 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:31.513+0000 7f9da66f1b80 1 -- 172.21.15.163:0/2459243617 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5573ab14efe0 msgr2=0x5573ab158ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:13:31.559 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:31.513+0000 7f9da66f1b80 1 --2- 172.21.15.163:0/2459243617 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5573ab14efe0 0x5573ab158ac0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f9d840098c0 tx=0x7f9d84005b40 comp rx=0 tx=0).stop 2023-07-14T18:13:31.559 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:31.513+0000 7f9da66f1b80 1 -- 172.21.15.163:0/2459243617 shutdown_connections 2023-07-14T18:13:31.559 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:31.513+0000 7f9da66f1b80 1 --2- 172.21.15.163:0/2459243617 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5573ab150530 0x5573ab1567c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:13:31.559 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:31.513+0000 7f9da66f1b80 1 --2- 172.21.15.163:0/2459243617 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5573ab14efe0 0x5573ab158ac0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:13:31.559 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:31.513+0000 7f9da66f1b80 1 --2- 172.21.15.163:0/2459243617 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5573ab14f930 0x5573ab15fb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:13:31.560 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:31.513+0000 7f9da66f1b80 1 -- 172.21.15.163:0/2459243617 >> 172.21.15.163:0/2459243617 conn(0x5573ab144700 msgr2=0x5573ab1583b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:13:31.560 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:31.513+0000 7f9da66f1b80 1 -- 172.21.15.163:0/2459243617 shutdown_connections 2023-07-14T18:13:31.560 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:31.513+0000 7f9da66f1b80 1 -- 172.21.15.163:0/2459243617 wait complete. 2023-07-14T18:13:31.560 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:31.514+0000 7f9da66f1b80 1 -- start start 2023-07-14T18:13:31.560 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:31.514+0000 7f9da66f1b80 1 Processor -- start 2023-07-14T18:13:31.560 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:31.514+0000 7f9da66f1b80 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5573ab14efe0 0x5573ab15d2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:13:31.560 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:31.514+0000 7f9da66f1b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5573ab14f930 0x5573ab15d810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:13:31.561 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:31.514+0000 7f9da66f1b80 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5573ab150530 0x5573ab15e820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:13:31.561 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:31.514+0000 7f9da66f1b80 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x5573ab15ed60 con 0x5573ab14efe0 2023-07-14T18:13:31.561 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:31.514+0000 7f9da66f1b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x5573ab15eed0 con 0x5573ab14f930 2023-07-14T18:13:31.561 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:31.514+0000 7f9da66f1b80 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x5573ab15f090 con 0x5573ab150530 2023-07-14T18:13:31.561 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:31.514+0000 7f9da66f1b80 10 client.0 _ll_register_callbacks cb 0x7f9d8c009da0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T18:13:31.561 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:31.515+0000 7f9d93fff700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5573ab14efe0 0x5573ab15d2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:13:31.561 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:31.515+0000 7f9d93fff700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5573ab14efe0 0x5573ab15d2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:58696/0 (socket says 172.21.15.163:58696) 2023-07-14T18:13:31.562 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:31.515+0000 7f9d93fff700 1 -- 172.21.15.163:0/1147875787 learned_addr learned my addr 172.21.15.163:0/1147875787 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:13:31.562 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:31.515+0000 7f9d937fe700 1 --2- 172.21.15.163:0/1147875787 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5573ab14f930 0x5573ab15d810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:13:31.562 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:31.515+0000 7f9d98af6700 1 --2- 172.21.15.163:0/1147875787 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5573ab150530 0x5573ab15e820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:13:31.562 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:31.515+0000 7f9d93fff700 1 -- 172.21.15.163:0/1147875787 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5573ab150530 msgr2=0x5573ab15e820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:13:31.562 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:31.515+0000 7f9d93fff700 1 --2- 172.21.15.163:0/1147875787 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5573ab150530 0x5573ab15e820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:13:31.562 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:31.515+0000 7f9d93fff700 1 -- 172.21.15.163:0/1147875787 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5573ab14f930 msgr2=0x5573ab15d810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:13:31.562 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:31.515+0000 7f9d93fff700 1 --2- 172.21.15.163:0/1147875787 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5573ab14f930 0x5573ab15d810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:13:31.563 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:31.515+0000 7f9d93fff700 1 -- 172.21.15.163:0/1147875787 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d9419de30 con 0x5573ab14efe0 2023-07-14T18:13:31.563 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:31.515+0000 7f9d93fff700 1 --2- 172.21.15.163:0/1147875787 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5573ab14efe0 0x5573ab15d2d0 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f9d8402e040 tx=0x7f9d8409fa90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=53513caa2787e333 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:13:31.563 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:31.515+0000 7f9d737fe700 10 client.0 ms_handle_connect on v2:172.21.15.163:3300/0 2023-07-14T18:13:31.563 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:31.515+0000 7f9d737fe700 1 -- 172.21.15.163:0/1147875787 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d84086040 con 0x5573ab14efe0 2023-07-14T18:13:31.563 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:31.515+0000 7f9d737fe700 1 -- 172.21.15.163:0/1147875787 <== mon.0 v2:172.21.15.163:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 9049+0+0 (secure 0 0 0) 0x7f9d84004b20 con 0x5573ab14efe0 2023-07-14T18:13:31.563 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:31.515+0000 7f9da66f1b80 1 -- 172.21.15.163:0/1147875787 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f9d840a3ca0 con 0x5573ab14efe0 2023-07-14T18:13:31.563 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:31.516+0000 7f9d737fe700 1 -- 172.21.15.163:0/1147875787 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9d8400bbd0 con 0x5573ab14efe0 2023-07-14T18:13:31.564 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:31.516+0000 7f9da66f1b80 10 client.15942 fetch_fsmap learned FSMap version 29 2023-07-14T18:13:31.564 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:31.516+0000 7f9da66f1b80 1 -- 172.21.15.163:0/1147875787 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) v3 -- 0x5573aaef42d0 con 0x5573ab14efe0 2023-07-14T18:13:31.564 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:31.516+0000 7f9d737fe700 1 -- 172.21.15.163:0/1147875787 <== mon.0 v2:172.21.15.163:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f9d840a3ca0 con 0x5573ab14efe0 2023-07-14T18:13:31.564 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:31.516+0000 7f9d737fe700 1 -- 172.21.15.163:0/1147875787 <== mon.0 v2:172.21.15.163:3300/0 5 ==== fsmap(e 29) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f9d840861a0 con 0x5573ab14efe0 2023-07-14T18:13:31.564 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:31.516+0000 7f9da66f1b80 10 client.15942 fetch_fsmap finished waiting for FSMap version 29 2023-07-14T18:13:31.564 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:31.516+0000 7f9da66f1b80 10 client.15942 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-07-14T18:13:31.565 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:31.516+0000 7f9da66f1b80 20 client.15942 populate_metadata read hostname 'smithi163' 2023-07-14T18:13:31.565 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:31.516+0000 7f9da66f1b80 1 --2- 172.21.15.163:0/1147875787 >> [v2:172.21.15.172:6838/3850440096,v1:172.21.15.172:6839/3850440096] conn(0x5573ab1b9ed0 0x5573ab1bc2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:13:31.565 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:31.516+0000 7f9da66f1b80 4 client.15942 mds_command: new command op to 24518 tid=0[{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2023-07-14T18:13:31.565 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:31.516+0000 7f9da66f1b80 1 -- 172.21.15.163:0/1147875787 --> [v2:172.21.15.172:6838/3850440096,v1:172.21.15.172:6839/3850440096] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) v1 -- 0x5573ab098f30 con 0x5573ab1b9ed0 2023-07-14T18:13:31.565 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:31.516+0000 7f9d937fe700 1 --2- 172.21.15.163:0/1147875787 >> [v2:172.21.15.172:6838/3850440096,v1:172.21.15.172:6839/3850440096] conn(0x5573ab1b9ed0 0x5573ab1bc2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:13:31.565 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:31.517+0000 7f9d737fe700 10 client.15942 ms_handle_connect on v2:172.21.15.172:6838/3850440096 2023-07-14T18:13:31.565 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:31.517+0000 7f9d937fe700 1 --2- 172.21.15.163:0/1147875787 >> [v2:172.21.15.172:6838/3850440096,v1:172.21.15.172:6839/3850440096] conn(0x5573ab1b9ed0 0x5573ab1bc2b0 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6d6e22617d6f8d2d server_cookie=9f4f44249ccb10a7 in_seq=0 out_seq=0 2023-07-14T18:13:31.566 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:31.518+0000 7f9d737fe700 1 -- 172.21.15.163:0/1147875787 <== mds.0 v2:172.21.15.172:6838/3850440096 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x5573ab098f30 con 0x5573ab1b9ed0 2023-07-14T18:13:31.567 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:31.518+0000 7f9d737fe700 10 client.15942 handle_command_reply: tid=0 2023-07-14T18:13:31.567 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:31.518+0000 7f9da66f1b80 1 client.15942 shutdown 2023-07-14T18:13:31.567 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:31.518+0000 7f9da66f1b80 1 -- 172.21.15.163:0/1147875787 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5573ab14efe0 msgr2=0x5573ab15d2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:13:31.567 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:31.518+0000 7f9da66f1b80 1 --2- 172.21.15.163:0/1147875787 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5573ab14efe0 0x5573ab15d2d0 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f9d8402e040 tx=0x7f9d8409fa90 comp rx=0 tx=0).stop 2023-07-14T18:13:31.567 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:31.518+0000 7f9da66f1b80 1 -- 172.21.15.163:0/1147875787 shutdown_connections 2023-07-14T18:13:31.567 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:31.518+0000 7f9da66f1b80 1 --2- 172.21.15.163:0/1147875787 >> [v2:172.21.15.172:6838/3850440096,v1:172.21.15.172:6839/3850440096] conn(0x5573ab1b9ed0 0x5573ab1bc2b0 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:13:31.568 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:31.518+0000 7f9da66f1b80 1 --2- 172.21.15.163:0/1147875787 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5573ab150530 0x5573ab15e820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:13:31.568 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:31.518+0000 7f9da66f1b80 1 --2- 172.21.15.163:0/1147875787 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5573ab14efe0 0x5573ab15d2d0 unknown :-1 s=CLOSED pgs=595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:13:31.568 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:31.518+0000 7f9da66f1b80 1 --2- 172.21.15.163:0/1147875787 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5573ab14f930 0x5573ab15d810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:13:31.568 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:31.518+0000 7f9d737fe700 0 client.15942 ms_handle_reset on v2:172.21.15.172:6838/3850440096 2023-07-14T18:13:31.568 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:31.518+0000 7f9da66f1b80 1 -- 172.21.15.163:0/1147875787 >> 172.21.15.163:0/1147875787 conn(0x5573ab144700 msgr2=0x5573ab14dd00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:13:31.568 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:31.519+0000 7f9da66f1b80 1 -- 172.21.15.163:0/1147875787 shutdown_connections 2023-07-14T18:13:31.568 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:31.519+0000 7f9da66f1b80 1 -- 172.21.15.163:0/1147875787 wait complete. 2023-07-14T18:13:31.569 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:31.519+0000 7f9da66f1b80 20 client.15942 trim_cache size 0 max 16384 2023-07-14T18:13:31.569 INFO:teuthology.orchestra.run.smithi163.stdout:{ 2023-07-14T18:13:31.570 INFO:teuthology.orchestra.run.smithi163.stdout: "return_code": 0, 2023-07-14T18:13:31.570 INFO:teuthology.orchestra.run.smithi163.stdout: "scrub_tag": "c7caf340-fd32-4ac5-a758-e498a7ec3cfa", 2023-07-14T18:13:31.570 INFO:teuthology.orchestra.run.smithi163.stdout: "mode": "asynchronous" 2023-07-14T18:13:31.570 INFO:teuthology.orchestra.run.smithi163.stdout:} 2023-07-14T18:13:31.571 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:31.519+0000 7f9d9a559700 1 -- 172.21.15.163:0/874430339 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f9d7c0a11d0 msgr2=0x7f9d7c0a3680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:13:31.571 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:31.519+0000 7f9d9a559700 1 --2- 172.21.15.163:0/874430339 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f9d7c0a11d0 0x7f9d7c0a3680 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f9d88009bf0 tx=0x7f9d88009260 comp rx=0 tx=0).stop 2023-07-14T18:13:31.571 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:31.519+0000 7f9d9a559700 1 -- 172.21.15.163:0/874430339 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f9d940fed40 msgr2=0x7f9d940fe7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:13:31.572 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:31.519+0000 7f9d9a559700 1 --2- 172.21.15.163:0/874430339 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f9d940fed40 0x7f9d940fe7a0 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f9d84009fd0 tx=0x7f9d8400b840 comp rx=0 tx=0).stop 2023-07-14T18:13:31.572 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:31.520+0000 7f9d9a559700 1 -- 172.21.15.163:0/874430339 shutdown_connections 2023-07-14T18:13:31.572 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:31.520+0000 7f9d9a559700 1 --2- 172.21.15.163:0/874430339 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f9d7c0a11d0 0x7f9d7c0a3680 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:13:31.572 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:31.520+0000 7f9d9a559700 1 --2- 172.21.15.163:0/874430339 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9d941000f0 0x7f9d9419cc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:13:31.572 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:31.520+0000 7f9d9a559700 1 --2- 172.21.15.163:0/874430339 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f9d940fed40 0x7f9d940fe7a0 unknown :-1 s=CLOSED pgs=593 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:13:31.572 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:31.520+0000 7f9d9a559700 1 --2- 172.21.15.163:0/874430339 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9d940ff6f0 0x7f9d9419a620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:13:31.573 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:31.520+0000 7f9d9a559700 1 -- 172.21.15.163:0/874430339 >> 172.21.15.163:0/874430339 conn(0x7f9d940f98e0 msgr2=0x7f9d940fbc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:13:31.573 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:31.520+0000 7f9d9a559700 1 -- 172.21.15.163:0/874430339 shutdown_connections 2023-07-14T18:13:31.573 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:31.520+0000 7f9d9a559700 1 -- 172.21.15.163:0/874430339 wait complete. 2023-07-14T18:13:31.578 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-07-14T18:13:31.770 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:31.728+0000 7f4db5af3700 1 -- 172.21.15.163:0/3429229305 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f4db00ffd00 msgr2=0x7f4db0100150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:13:31.771 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:31.728+0000 7f4db5af3700 1 --2- 172.21.15.163:0/3429229305 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f4db00ffd00 0x7f4db0100150 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f4da4009990 tx=0x7f4da4009ca0 comp rx=0 tx=0).stop 2023-07-14T18:13:31.771 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:31.729+0000 7f4db5af3700 1 -- 172.21.15.163:0/3429229305 shutdown_connections 2023-07-14T18:13:31.771 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:31.729+0000 7f4db5af3700 1 --2- 172.21.15.163:0/3429229305 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4db0100690 0x7f4db0106f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:13:31.771 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:31.729+0000 7f4db5af3700 1 --2- 172.21.15.163:0/3429229305 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4db00feb10 0x7f4db00fef20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:13:31.771 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:31.729+0000 7f4db5af3700 1 --2- 172.21.15.163:0/3429229305 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f4db00ffd00 0x7f4db0100150 unknown :-1 s=CLOSED pgs=596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:13:31.771 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:31.729+0000 7f4db5af3700 1 -- 172.21.15.163:0/3429229305 >> 172.21.15.163:0/3429229305 conn(0x7f4db00fa130 msgr2=0x7f4db00fc560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:13:31.771 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:31.729+0000 7f4db5af3700 1 -- 172.21.15.163:0/3429229305 shutdown_connections 2023-07-14T18:13:31.772 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:31.729+0000 7f4db5af3700 1 -- 172.21.15.163:0/3429229305 wait complete. 2023-07-14T18:13:31.773 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:31.729+0000 7f4db5af3700 1 Processor -- start 2023-07-14T18:13:31.773 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:31.730+0000 7f4db5af3700 1 -- start start 2023-07-14T18:13:31.773 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:31.730+0000 7f4db5af3700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4db00feb10 0x7f4db0195910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:13:31.774 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:31.730+0000 7f4db5af3700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4db00ffd00 0x7f4db0195e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:13:31.774 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:31.730+0000 7f4db5af3700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f4db0100690 0x7f4db019cec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:13:31.774 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:31.730+0000 7f4db5af3700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4db019d490 con 0x7f4db0100690 2023-07-14T18:13:31.774 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:31.730+0000 7f4db5af3700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4db019d5d0 con 0x7f4db00ffd00 2023-07-14T18:13:31.774 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:31.730+0000 7f4db5af3700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4db019d760 con 0x7f4db00feb10 2023-07-14T18:13:31.774 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:31.730+0000 7f4daffff700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f4db0100690 0x7f4db019cec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:13:31.774 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:31.730+0000 7f4daffff700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f4db0100690 0x7f4db019cec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:58712/0 (socket says 172.21.15.163:58712) 2023-07-14T18:13:31.775 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:31.730+0000 7f4daffff700 1 -- 172.21.15.163:0/1231616929 learned_addr learned my addr 172.21.15.163:0/1231616929 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:13:31.775 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:31.730+0000 7f4daf7fe700 1 --2- 172.21.15.163:0/1231616929 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4db00feb10 0x7f4db0195910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:13:31.775 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:31.731+0000 7f4daeffd700 1 --2- 172.21.15.163:0/1231616929 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4db00ffd00 0x7f4db0195e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:13:31.775 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:31.731+0000 7f4daffff700 1 -- 172.21.15.163:0/1231616929 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4db00feb10 msgr2=0x7f4db0195910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:13:31.775 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:31.731+0000 7f4daffff700 1 --2- 172.21.15.163:0/1231616929 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4db00feb10 0x7f4db0195910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:13:31.775 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:31.731+0000 7f4daffff700 1 -- 172.21.15.163:0/1231616929 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4db00ffd00 msgr2=0x7f4db0195e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:13:31.775 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:31.731+0000 7f4daffff700 1 --2- 172.21.15.163:0/1231616929 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4db00ffd00 0x7f4db0195e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:13:31.776 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:31.731+0000 7f4daffff700 1 -- 172.21.15.163:0/1231616929 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4da40095f0 con 0x7f4db0100690 2023-07-14T18:13:31.776 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:31.731+0000 7f4daeffd700 1 --2- 172.21.15.163:0/1231616929 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4db00ffd00 0x7f4db0195e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T18:13:31.776 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:31.731+0000 7f4daffff700 1 --2- 172.21.15.163:0/1231616929 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f4db0100690 0x7f4db019cec0 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f4da800ef30 tx=0x7f4da800c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:13:31.776 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:31.731+0000 7f4dacff9700 1 -- 172.21.15.163:0/1231616929 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4da8004bb0 con 0x7f4db0100690 2023-07-14T18:13:31.776 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:31.731+0000 7f4db5af3700 1 -- 172.21.15.163:0/1231616929 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4db0107770 con 0x7f4db0100690 2023-07-14T18:13:31.776 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:31.731+0000 7f4db5af3700 1 -- 172.21.15.163:0/1231616929 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4db0107c80 con 0x7f4db0100690 2023-07-14T18:13:31.776 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:31.732+0000 7f4dacff9700 1 -- 172.21.15.163:0/1231616929 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f4da800f040 con 0x7f4db0100690 2023-07-14T18:13:31.776 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:31.732+0000 7f4dacff9700 1 -- 172.21.15.163:0/1231616929 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4da8004020 con 0x7f4db0100690 2023-07-14T18:13:31.777 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:31.734+0000 7f4dacff9700 1 -- 172.21.15.163:0/1231616929 <== mon.0 v2:172.21.15.163:3300/0 4 ==== mgrmap(e 18) v1 ==== 135716+0+0 (secure 0 0 0) 0x7f4da8004180 con 0x7f4db0100690 2023-07-14T18:13:31.777 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:31.735+0000 7f4dacff9700 1 --2- 172.21.15.163:0/1231616929 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f4d980a11d0 0x7f4d980a3680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:13:31.778 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:31.735+0000 7f4dacff9700 1 -- 172.21.15.163:0/1231616929 <== mon.0 v2:172.21.15.163:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 9049+0+0 (secure 0 0 0) 0x7f4da80d0450 con 0x7f4db0100690 2023-07-14T18:13:31.778 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:31.736+0000 7f4daf7fe700 1 --2- 172.21.15.163:0/1231616929 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f4d980a11d0 0x7f4d980a3680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:13:31.778 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:31.736+0000 7f4dc1c8bb80 1 Processor -- start 2023-07-14T18:13:31.778 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:31.736+0000 7f4daf7fe700 1 --2- 172.21.15.163:0/1231616929 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f4d980a11d0 0x7f4d980a3680 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f4db00ffb60 tx=0x7f4da0009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:13:31.778 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:31.736+0000 7f4dc1c8bb80 1 -- start start 2023-07-14T18:13:31.778 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:31.736+0000 7f4dc1c8bb80 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55bcd6a21f60 0x55bcd6a22370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:13:31.780 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:31.736+0000 7f4dc1c8bb80 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55bcd6a228b0 0x55bcd6a22ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:13:31.780 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:31.736+0000 7f4dc1c8bb80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bcd6a234b0 0x55bcd6a23920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:13:31.780 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:31.736+0000 7f4dc1c8bb80 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bcd6926cb0 con 0x55bcd6a21f60 2023-07-14T18:13:31.780 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:31.736+0000 7f4dc1c8bb80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bcd6979a40 con 0x55bcd6a234b0 2023-07-14T18:13:31.781 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:31.736+0000 7f4dc1c8bb80 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bcd6972ed0 con 0x55bcd6a228b0 2023-07-14T18:13:31.781 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:31.737+0000 7f4daeffd700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55bcd6a228b0 0x55bcd6a22ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:13:31.781 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:31.737+0000 7f4daeffd700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55bcd6a228b0 0x55bcd6a22ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.163:40542/0 (socket says 172.21.15.163:40542) 2023-07-14T18:13:31.781 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:31.737+0000 7f4daeffd700 1 -- 172.21.15.163:0/859501934 learned_addr learned my addr 172.21.15.163:0/859501934 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:13:31.781 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:31.737+0000 7f4daffff700 1 --2- 172.21.15.163:0/859501934 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bcd6a234b0 0x55bcd6a23920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:13:31.782 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:31.737+0000 7f4daeffd700 1 -- 172.21.15.163:0/859501934 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bcd6a234b0 msgr2=0x55bcd6a23920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:13:31.782 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:31.737+0000 7f4daeffd700 1 --2- 172.21.15.163:0/859501934 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bcd6a234b0 0x55bcd6a23920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:13:31.783 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:31.737+0000 7f4daeffd700 1 -- 172.21.15.163:0/859501934 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55bcd6a21f60 msgr2=0x55bcd6a22370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:13:31.783 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:31.737+0000 7f4daeffd700 1 --2- 172.21.15.163:0/859501934 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55bcd6a21f60 0x55bcd6a22370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:13:31.783 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:31.737+0000 7f4daeffd700 1 -- 172.21.15.163:0/859501934 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55bcd67a0de0 con 0x55bcd6a228b0 2023-07-14T18:13:31.783 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:31.737+0000 7f4daeffd700 1 --2- 172.21.15.163:0/859501934 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55bcd6a228b0 0x55bcd6a22ed0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f4da40098e0 tx=0x7f4da4005ee0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e5a4cde0b7012216 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:13:31.783 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:31.737+0000 7f4d95ffb700 1 -- 172.21.15.163:0/859501934 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4da401e070 con 0x55bcd6a228b0 2023-07-14T18:13:31.784 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:31.738+0000 7f4d95ffb700 1 -- 172.21.15.163:0/859501934 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f4da4004140 con 0x55bcd6a228b0 2023-07-14T18:13:31.784 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:31.738+0000 7f4d95ffb700 1 -- 172.21.15.163:0/859501934 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4da4005700 con 0x55bcd6a228b0 2023-07-14T18:13:31.784 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:31.739+0000 7f4dc1c8bb80 1 -- 172.21.15.163:0/859501934 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55bcd6a228b0 msgr2=0x55bcd6a22ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:13:31.784 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:31.739+0000 7f4dc1c8bb80 1 --2- 172.21.15.163:0/859501934 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55bcd6a228b0 0x55bcd6a22ed0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f4da40098e0 tx=0x7f4da4005ee0 comp rx=0 tx=0).stop 2023-07-14T18:13:31.784 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:31.739+0000 7f4dc1c8bb80 1 -- 172.21.15.163:0/859501934 shutdown_connections 2023-07-14T18:13:31.784 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:31.739+0000 7f4dc1c8bb80 1 --2- 172.21.15.163:0/859501934 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bcd6a234b0 0x55bcd6a23920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:13:31.785 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:31.739+0000 7f4dc1c8bb80 1 --2- 172.21.15.163:0/859501934 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55bcd6a21f60 0x55bcd6a22370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:13:31.785 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:31.739+0000 7f4dc1c8bb80 1 --2- 172.21.15.163:0/859501934 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55bcd6a228b0 0x55bcd6a22ed0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:13:31.785 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:31.739+0000 7f4dc1c8bb80 1 -- 172.21.15.163:0/859501934 >> 172.21.15.163:0/859501934 conn(0x55bcd6a17680 msgr2=0x55bcd6a1c9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:13:31.785 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:31.739+0000 7f4dc1c8bb80 1 -- 172.21.15.163:0/859501934 shutdown_connections 2023-07-14T18:13:31.785 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:31.739+0000 7f4dc1c8bb80 1 -- 172.21.15.163:0/859501934 wait complete. 2023-07-14T18:13:31.787 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:31.739+0000 7f4dc1c8bb80 1 -- start start 2023-07-14T18:13:31.787 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:31.739+0000 7f4dc1c8bb80 1 Processor -- start 2023-07-14T18:13:31.787 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:31.740+0000 7f4dc1c8bb80 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55bcd6a21f60 0x55bcd6a2b8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:13:31.788 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:31.740+0000 7f4dc1c8bb80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bcd6a228b0 0x55bcd6a2bde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:13:31.788 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:31.740+0000 7f4dc1c8bb80 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55bcd6a234b0 0x55bcd6a32e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:13:31.788 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:31.740+0000 7f4dc1c8bb80 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bcd6912ac0 con 0x55bcd6a234b0 2023-07-14T18:13:31.788 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:31.740+0000 7f4dc1c8bb80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bcd69127c0 con 0x55bcd6a228b0 2023-07-14T18:13:31.788 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:31.740+0000 7f4dc1c8bb80 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bcd67f6920 con 0x55bcd6a21f60 2023-07-14T18:13:31.788 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:31.740+0000 7f4dc1c8bb80 10 client.0 _ll_register_callbacks cb 0x55bcd6910760 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T18:13:31.788 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:31.740+0000 7f4daffff700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55bcd6a234b0 0x55bcd6a32e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:13:31.788 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:31.740+0000 7f4daffff700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55bcd6a234b0 0x55bcd6a32e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:58726/0 (socket says 172.21.15.163:58726) 2023-07-14T18:13:31.789 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:31.740+0000 7f4daffff700 1 -- 172.21.15.163:0/3174167514 learned_addr learned my addr 172.21.15.163:0/3174167514 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:13:31.789 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:31.740+0000 7f4daf7fe700 1 --2- 172.21.15.163:0/3174167514 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55bcd6a21f60 0x55bcd6a2b8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:13:31.789 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:31.741+0000 7f4daffff700 1 -- 172.21.15.163:0/3174167514 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55bcd6a21f60 msgr2=0x55bcd6a2b8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:13:31.789 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:31.741+0000 7f4daffff700 1 --2- 172.21.15.163:0/3174167514 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55bcd6a21f60 0x55bcd6a2b8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:13:31.789 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:31.741+0000 7f4daffff700 1 -- 172.21.15.163:0/3174167514 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bcd6a228b0 msgr2=0x55bcd6a2bde0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-07-14T18:13:31.789 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:31.741+0000 7f4daffff700 1 --2- 172.21.15.163:0/3174167514 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bcd6a228b0 0x55bcd6a2bde0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:13:31.789 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:31.741+0000 7f4daffff700 1 -- 172.21.15.163:0/3174167514 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4db0067960 con 0x55bcd6a234b0 2023-07-14T18:13:31.790 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:31.741+0000 7f4daffff700 1 --2- 172.21.15.163:0/3174167514 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55bcd6a234b0 0x55bcd6a32e20 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f4da8099fa0 tx=0x7f4da809cee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7effd9c8226857f9 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:13:31.790 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:31.741+0000 7f4d8effd700 10 client.0 ms_handle_connect on v2:172.21.15.163:3300/0 2023-07-14T18:13:31.790 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:31.741+0000 7f4d8effd700 1 -- 172.21.15.163:0/3174167514 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4da80a1560 con 0x55bcd6a234b0 2023-07-14T18:13:31.790 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:31.741+0000 7f4d8effd700 1 -- 172.21.15.163:0/3174167514 <== mon.0 v2:172.21.15.163:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 9049+0+0 (secure 0 0 0) 0x7f4da80a5980 con 0x55bcd6a234b0 2023-07-14T18:13:31.790 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:31.741+0000 7f4dc1c8bb80 1 -- 172.21.15.163:0/3174167514 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55bcd68cc4f0 con 0x55bcd6a234b0 2023-07-14T18:13:31.790 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:31.741+0000 7f4d8effd700 1 -- 172.21.15.163:0/3174167514 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4da80a1170 con 0x55bcd6a234b0 2023-07-14T18:13:31.790 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:31.741+0000 7f4dc1c8bb80 10 client.15951 fetch_fsmap learned FSMap version 29 2023-07-14T18:13:31.790 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:31.741+0000 7f4dc1c8bb80 1 -- 172.21.15.163:0/3174167514 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) v3 -- 0x55bcd6789c60 con 0x55bcd6a234b0 2023-07-14T18:13:31.791 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:31.741+0000 7f4d8effd700 1 -- 172.21.15.163:0/3174167514 <== mon.0 v2:172.21.15.163:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55bcd68cc4f0 con 0x55bcd6a234b0 2023-07-14T18:13:31.791 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:31.742+0000 7f4d8effd700 1 -- 172.21.15.163:0/3174167514 <== mon.0 v2:172.21.15.163:3300/0 5 ==== fsmap(e 29) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f4da809ca20 con 0x55bcd6a234b0 2023-07-14T18:13:31.791 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:31.742+0000 7f4dc1c8bb80 10 client.15951 fetch_fsmap finished waiting for FSMap version 29 2023-07-14T18:13:31.791 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:31.742+0000 7f4dc1c8bb80 10 client.15951 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-07-14T18:13:31.791 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:31.742+0000 7f4dc1c8bb80 20 client.15951 populate_metadata read hostname 'smithi163' 2023-07-14T18:13:31.791 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:31.742+0000 7f4dc1c8bb80 1 --2- 172.21.15.163:0/3174167514 >> [v2:172.21.15.172:6838/3850440096,v1:172.21.15.172:6839/3850440096] conn(0x55bcd6a376a0 0x55bcd6a39ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:13:31.791 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:31.742+0000 7f4dc1c8bb80 4 client.15951 mds_command: new command op to 24518 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-14T18:13:31.792 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:31.742+0000 7f4dc1c8bb80 1 -- 172.21.15.163:0/3174167514 --> [v2:172.21.15.172:6838/3850440096,v1:172.21.15.172:6839/3850440096] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55bcd69f0da0 con 0x55bcd6a376a0 2023-07-14T18:13:31.792 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:31.742+0000 7f4daf7fe700 1 --2- 172.21.15.163:0/3174167514 >> [v2:172.21.15.172:6838/3850440096,v1:172.21.15.172:6839/3850440096] conn(0x55bcd6a376a0 0x55bcd6a39ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:13:31.792 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:31.743+0000 7f4d8effd700 10 client.15951 ms_handle_connect on v2:172.21.15.172:6838/3850440096 2023-07-14T18:13:31.792 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:31.743+0000 7f4daf7fe700 1 --2- 172.21.15.163:0/3174167514 >> [v2:172.21.15.172:6838/3850440096,v1:172.21.15.172:6839/3850440096] conn(0x55bcd6a376a0 0x55bcd6a39ab0 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=48c3102059a45a7b server_cookie=2d4f89e64c8f81e8 in_seq=0 out_seq=0 2023-07-14T18:13:31.792 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:31.743+0000 7f4d8effd700 1 -- 172.21.15.163:0/3174167514 <== mds.0 v2:172.21.15.172:6838/3850440096 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18017 (crc 0 0 0) 0x55bcd69f0da0 con 0x55bcd6a376a0 2023-07-14T18:13:31.792 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:31.743+0000 7f4d8effd700 10 client.15951 handle_command_reply: tid=0 2023-07-14T18:13:31.792 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:31.743+0000 7f4dc1c8bb80 1 client.15951 shutdown 2023-07-14T18:13:31.793 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:31.743+0000 7f4dc1c8bb80 1 -- 172.21.15.163:0/3174167514 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55bcd6a234b0 msgr2=0x55bcd6a32e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:13:31.793 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:31.743+0000 7f4dc1c8bb80 1 --2- 172.21.15.163:0/3174167514 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55bcd6a234b0 0x55bcd6a32e20 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f4da8099fa0 tx=0x7f4da809cee0 comp rx=0 tx=0).stop 2023-07-14T18:13:31.793 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:31.744+0000 7f4dc1c8bb80 1 -- 172.21.15.163:0/3174167514 shutdown_connections 2023-07-14T18:13:31.793 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:31.744+0000 7f4dc1c8bb80 1 --2- 172.21.15.163:0/3174167514 >> [v2:172.21.15.172:6838/3850440096,v1:172.21.15.172:6839/3850440096] conn(0x55bcd6a376a0 0x55bcd6a39ab0 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:13:31.793 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:31.744+0000 7f4dc1c8bb80 1 --2- 172.21.15.163:0/3174167514 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55bcd6a21f60 0x55bcd6a2b8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:13:31.793 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:31.744+0000 7f4dc1c8bb80 1 --2- 172.21.15.163:0/3174167514 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55bcd6a234b0 0x55bcd6a32e20 unknown :-1 s=CLOSED pgs=598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:13:31.793 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:31.744+0000 7f4d8effd700 0 client.15951 ms_handle_reset on v2:172.21.15.172:6838/3850440096 2023-07-14T18:13:31.793 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:31.744+0000 7f4dc1c8bb80 1 --2- 172.21.15.163:0/3174167514 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bcd6a228b0 0x55bcd6a2bde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:13:31.794 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:31.744+0000 7f4dc1c8bb80 1 -- 172.21.15.163:0/3174167514 >> 172.21.15.163:0/3174167514 conn(0x55bcd6a17680 msgr2=0x55bcd6a1b650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:13:31.794 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:31.744+0000 7f4dc1c8bb80 1 -- 172.21.15.163:0/3174167514 shutdown_connections 2023-07-14T18:13:31.794 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:31.744+0000 7f4dc1c8bb80 1 -- 172.21.15.163:0/3174167514 wait complete. 2023-07-14T18:13:31.794 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:31.744+0000 7f4dc1c8bb80 20 client.15951 trim_cache size 0 max 16384 2023-07-14T18:13:31.818 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:31.776+0000 7f4dc1c8bb80 1 Processor -- start 2023-07-14T18:13:31.818 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:31.776+0000 7f4dc1c8bb80 1 -- start start 2023-07-14T18:13:31.818 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:31.776+0000 7f4dc1c8bb80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bcd6a21f60 0x55bcd6a23880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:13:31.818 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:31.776+0000 7f4dc1c8bb80 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55bcd6a228b0 0x55bcd6a32de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:13:31.818 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:31.776+0000 7f4dc1c8bb80 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55bcd6a234b0 0x55bcd6a29860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:13:31.819 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:31.776+0000 7f4dc1c8bb80 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bcd6a23330 con 0x55bcd6a234b0 2023-07-14T18:13:31.819 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:31.776+0000 7f4dc1c8bb80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bcd6a2a430 con 0x55bcd6a21f60 2023-07-14T18:13:31.819 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:31.776+0000 7f4dc1c8bb80 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bcd6a1e500 con 0x55bcd6a228b0 2023-07-14T18:13:31.819 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:31.776+0000 7f4daf7fe700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bcd6a21f60 0x55bcd6a23880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:13:31.819 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:31.776+0000 7f4daf7fe700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bcd6a21f60 0x55bcd6a23880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.163:59416/0 (socket says 172.21.15.163:59416) 2023-07-14T18:13:31.819 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:31.776+0000 7f4daf7fe700 1 -- 172.21.15.163:0/688546711 learned_addr learned my addr 172.21.15.163:0/688546711 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:13:31.819 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:31.776+0000 7f4daeffd700 1 --2- 172.21.15.163:0/688546711 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55bcd6a228b0 0x55bcd6a32de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:13:31.820 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:31.776+0000 7f4daffff700 1 --2- 172.21.15.163:0/688546711 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55bcd6a234b0 0x55bcd6a29860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:13:31.820 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:31.777+0000 7f4daf7fe700 1 -- 172.21.15.163:0/688546711 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55bcd6a228b0 msgr2=0x55bcd6a32de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:13:31.820 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:31.777+0000 7f4daf7fe700 1 --2- 172.21.15.163:0/688546711 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55bcd6a228b0 0x55bcd6a32de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:13:31.820 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:31.777+0000 7f4daf7fe700 1 -- 172.21.15.163:0/688546711 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55bcd6a234b0 msgr2=0x55bcd6a29860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:13:31.820 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:31.777+0000 7f4daf7fe700 1 --2- 172.21.15.163:0/688546711 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55bcd6a234b0 0x55bcd6a29860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:13:31.820 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:31.777+0000 7f4daf7fe700 1 -- 172.21.15.163:0/688546711 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55bcd67c7250 con 0x55bcd6a21f60 2023-07-14T18:13:31.823 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:31.777+0000 7f4daf7fe700 1 --2- 172.21.15.163:0/688546711 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bcd6a21f60 0x55bcd6a23880 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f4da0011ce0 tx=0x7f4da0014000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dcdc1f937bcd0e2c server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:13:31.823 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:31.777+0000 7f4d967fc700 1 -- 172.21.15.163:0/688546711 <== mon.2 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4da0023040 con 0x55bcd6a21f60 2023-07-14T18:13:31.823 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:31.777+0000 7f4d967fc700 1 -- 172.21.15.163:0/688546711 <== mon.2 v2:172.21.15.172:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f4da001d8e0 con 0x55bcd6a21f60 2023-07-14T18:13:31.823 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:31.777+0000 7f4d967fc700 1 -- 172.21.15.163:0/688546711 <== mon.2 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4da0003a40 con 0x55bcd6a21f60 2023-07-14T18:13:31.823 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:31.778+0000 7f4dc1c8bb80 1 -- 172.21.15.163:0/688546711 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bcd6a21f60 msgr2=0x55bcd6a23880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:13:31.823 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:31.778+0000 7f4dc1c8bb80 1 --2- 172.21.15.163:0/688546711 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bcd6a21f60 0x55bcd6a23880 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f4da0011ce0 tx=0x7f4da0014000 comp rx=0 tx=0).stop 2023-07-14T18:13:31.823 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:31.778+0000 7f4dc1c8bb80 1 -- 172.21.15.163:0/688546711 shutdown_connections 2023-07-14T18:13:31.824 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:31.778+0000 7f4dc1c8bb80 1 --2- 172.21.15.163:0/688546711 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55bcd6a234b0 0x55bcd6a29860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:13:31.824 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:31.778+0000 7f4dc1c8bb80 1 --2- 172.21.15.163:0/688546711 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bcd6a21f60 0x55bcd6a23880 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:13:31.824 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:31.778+0000 7f4dc1c8bb80 1 --2- 172.21.15.163:0/688546711 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55bcd6a228b0 0x55bcd6a32de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:13:31.824 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:31.778+0000 7f4dc1c8bb80 1 -- 172.21.15.163:0/688546711 >> 172.21.15.163:0/688546711 conn(0x55bcd6a17680 msgr2=0x55bcd6a2a640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:13:31.824 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:31.778+0000 7f4dc1c8bb80 1 -- 172.21.15.163:0/688546711 shutdown_connections 2023-07-14T18:13:31.824 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:31.778+0000 7f4dc1c8bb80 1 -- 172.21.15.163:0/688546711 wait complete. 2023-07-14T18:13:31.824 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:31.779+0000 7f4dc1c8bb80 1 -- start start 2023-07-14T18:13:31.825 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:31.779+0000 7f4dc1c8bb80 1 Processor -- start 2023-07-14T18:13:31.825 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:31.779+0000 7f4dc1c8bb80 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55bcd6a21f60 0x55bcd6a327e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:13:31.825 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:31.779+0000 7f4dc1c8bb80 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55bcd6a228b0 0x55bcd6a32d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:13:31.825 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:31.779+0000 7f4dc1c8bb80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bcd6a234b0 0x55bcd6a2f2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:13:31.825 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:31.779+0000 7f4dc1c8bb80 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bcd6a2f9f0 con 0x55bcd6a21f60 2023-07-14T18:13:31.825 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:31.779+0000 7f4dc1c8bb80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bcd6a2fb60 con 0x55bcd6a234b0 2023-07-14T18:13:31.825 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:31.779+0000 7f4dc1c8bb80 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bcd6a2fd20 con 0x55bcd6a228b0 2023-07-14T18:13:31.825 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:31.779+0000 7f4dc1c8bb80 10 client.0 _ll_register_callbacks cb 0x55bcd6910760 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T18:13:31.826 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:31.779+0000 7f4daf7fe700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55bcd6a21f60 0x55bcd6a327e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:13:31.826 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:31.779+0000 7f4daf7fe700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55bcd6a21f60 0x55bcd6a327e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:58738/0 (socket says 172.21.15.163:58738) 2023-07-14T18:13:31.826 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:31.779+0000 7f4daf7fe700 1 -- 172.21.15.163:0/1312193117 learned_addr learned my addr 172.21.15.163:0/1312193117 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:13:31.826 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:31.780+0000 7f4daffff700 1 --2- 172.21.15.163:0/1312193117 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bcd6a234b0 0x55bcd6a2f2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:13:31.826 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:31.780+0000 7f4daf7fe700 1 -- 172.21.15.163:0/1312193117 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55bcd6a228b0 msgr2=0x55bcd6a32d20 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-07-14T18:13:31.826 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:31.780+0000 7f4daf7fe700 1 --2- 172.21.15.163:0/1312193117 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55bcd6a228b0 0x55bcd6a32d20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:13:31.826 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:31.780+0000 7f4daf7fe700 1 -- 172.21.15.163:0/1312193117 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bcd6a234b0 msgr2=0x55bcd6a2f2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:13:31.826 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:31.780+0000 7f4daf7fe700 1 --2- 172.21.15.163:0/1312193117 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bcd6a234b0 0x55bcd6a2f2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:13:31.827 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:31.780+0000 7f4daf7fe700 1 -- 172.21.15.163:0/1312193117 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4da0017070 con 0x55bcd6a21f60 2023-07-14T18:13:31.827 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:31.780+0000 7f4daf7fe700 1 --2- 172.21.15.163:0/1312193117 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55bcd6a21f60 0x55bcd6a327e0 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f4da0000c00 tx=0x7f4da001dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1acf86de720134f8 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:13:31.827 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:31.780+0000 7f4d8effd700 10 client.0 ms_handle_connect on v2:172.21.15.163:3300/0 2023-07-14T18:13:31.827 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:31.780+0000 7f4d8effd700 1 -- 172.21.15.163:0/1312193117 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4da001c9d0 con 0x55bcd6a21f60 2023-07-14T18:13:31.827 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:31.780+0000 7f4d8effd700 1 -- 172.21.15.163:0/1312193117 <== mon.0 v2:172.21.15.163:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 9049+0+0 (secure 0 0 0) 0x7f4da0032070 con 0x55bcd6a21f60 2023-07-14T18:13:31.827 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:31.780+0000 7f4dc1c8bb80 1 -- 172.21.15.163:0/1312193117 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f4da4004140 con 0x55bcd6a21f60 2023-07-14T18:13:31.827 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:31.780+0000 7f4d8effd700 1 -- 172.21.15.163:0/1312193117 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4da001cb30 con 0x55bcd6a21f60 2023-07-14T18:13:31.827 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:31.780+0000 7f4dc1c8bb80 10 client.15957 fetch_fsmap learned FSMap version 29 2023-07-14T18:13:31.828 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:31.780+0000 7f4dc1c8bb80 1 -- 172.21.15.163:0/1312193117 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) v3 -- 0x55bcd679f2b0 con 0x55bcd6a21f60 2023-07-14T18:13:31.828 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:31.781+0000 7f4d8effd700 1 -- 172.21.15.163:0/1312193117 <== mon.0 v2:172.21.15.163:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f4da4004140 con 0x55bcd6a21f60 2023-07-14T18:13:31.828 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:31.781+0000 7f4d8effd700 1 -- 172.21.15.163:0/1312193117 <== mon.0 v2:172.21.15.163:3300/0 5 ==== fsmap(e 29) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f4da0037cc0 con 0x55bcd6a21f60 2023-07-14T18:13:31.828 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:31.781+0000 7f4dc1c8bb80 10 client.15957 fetch_fsmap finished waiting for FSMap version 29 2023-07-14T18:13:31.828 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:31.781+0000 7f4dc1c8bb80 10 client.15957 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-07-14T18:13:31.828 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:31.781+0000 7f4dc1c8bb80 20 client.15957 populate_metadata read hostname 'smithi163' 2023-07-14T18:13:31.828 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:31.781+0000 7f4dc1c8bb80 1 --2- 172.21.15.163:0/1312193117 >> [v2:172.21.15.172:6838/3850440096,v1:172.21.15.172:6839/3850440096] conn(0x55bcd6a8c9b0 0x55bcd6a8edc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:13:31.829 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:31.781+0000 7f4dc1c8bb80 4 client.15957 mds_command: new command op to 24518 tid=0[{"prefix": "scrub status"}] 2023-07-14T18:13:31.829 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:31.781+0000 7f4dc1c8bb80 1 -- 172.21.15.163:0/1312193117 --> [v2:172.21.15.172:6838/3850440096,v1:172.21.15.172:6839/3850440096] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55bcd696beb0 con 0x55bcd6a8c9b0 2023-07-14T18:13:31.829 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:31.781+0000 7f4daeffd700 1 --2- 172.21.15.163:0/1312193117 >> [v2:172.21.15.172:6838/3850440096,v1:172.21.15.172:6839/3850440096] conn(0x55bcd6a8c9b0 0x55bcd6a8edc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:13:31.830 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:31.782+0000 7f4daeffd700 1 --2- 172.21.15.163:0/1312193117 >> [v2:172.21.15.172:6838/3850440096,v1:172.21.15.172:6839/3850440096] conn(0x55bcd6a8c9b0 0x55bcd6a8edc0 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=edc310f08c11bd0a server_cookie=dfcc9b8964bfc84c in_seq=0 out_seq=0 2023-07-14T18:13:31.830 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:31.782+0000 7f4d8effd700 10 client.15957 ms_handle_connect on v2:172.21.15.172:6838/3850440096 2023-07-14T18:13:31.830 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:31.782+0000 7f4d8effd700 1 -- 172.21.15.163:0/1312193117 <== mds.0 v2:172.21.15.172:6838/3850440096 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x55bcd696beb0 con 0x55bcd6a8c9b0 2023-07-14T18:13:31.830 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:31.782+0000 7f4d8effd700 10 client.15957 handle_command_reply: tid=0 2023-07-14T18:13:31.830 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:31.782+0000 7f4dc1c8bb80 1 client.15957 shutdown 2023-07-14T18:13:31.831 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:31.782+0000 7f4dc1c8bb80 1 -- 172.21.15.163:0/1312193117 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55bcd6a21f60 msgr2=0x55bcd6a327e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:13:31.831 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:31.782+0000 7f4dc1c8bb80 1 --2- 172.21.15.163:0/1312193117 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55bcd6a21f60 0x55bcd6a327e0 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f4da0000c00 tx=0x7f4da001dc60 comp rx=0 tx=0).stop 2023-07-14T18:13:31.831 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:31.782+0000 7f4dc1c8bb80 1 -- 172.21.15.163:0/1312193117 shutdown_connections 2023-07-14T18:13:31.831 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:31.782+0000 7f4dc1c8bb80 1 --2- 172.21.15.163:0/1312193117 >> [v2:172.21.15.172:6838/3850440096,v1:172.21.15.172:6839/3850440096] conn(0x55bcd6a8c9b0 0x55bcd6a8edc0 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:13:31.831 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:31.782+0000 7f4dc1c8bb80 1 --2- 172.21.15.163:0/1312193117 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bcd6a234b0 0x55bcd6a2f2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:13:31.831 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:31.782+0000 7f4dc1c8bb80 1 --2- 172.21.15.163:0/1312193117 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55bcd6a21f60 0x55bcd6a327e0 unknown :-1 s=CLOSED pgs=599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:13:31.831 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:31.782+0000 7f4dc1c8bb80 1 --2- 172.21.15.163:0/1312193117 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55bcd6a228b0 0x55bcd6a32d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:13:31.831 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:31.782+0000 7f4d8effd700 0 client.15957 ms_handle_reset on v2:172.21.15.172:6838/3850440096 2023-07-14T18:13:31.832 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:31.782+0000 7f4dc1c8bb80 1 -- 172.21.15.163:0/1312193117 >> 172.21.15.163:0/1312193117 conn(0x55bcd6a17680 msgr2=0x55bcd6a29860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:13:31.832 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:31.783+0000 7f4dc1c8bb80 1 -- 172.21.15.163:0/1312193117 shutdown_connections 2023-07-14T18:13:31.832 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:31.783+0000 7f4dc1c8bb80 1 -- 172.21.15.163:0/1312193117 wait complete. 2023-07-14T18:13:31.832 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:31.783+0000 7f4dc1c8bb80 20 client.15957 trim_cache size 0 max 16384 2023-07-14T18:13:31.832 INFO:teuthology.orchestra.run.smithi163.stdout:{ 2023-07-14T18:13:31.833 INFO:teuthology.orchestra.run.smithi163.stdout: "status": "IDLE (waiting for more scrubs)", 2023-07-14T18:13:31.833 INFO:teuthology.orchestra.run.smithi163.stdout: "scrubs": { 2023-07-14T18:13:31.833 INFO:teuthology.orchestra.run.smithi163.stdout: "c7caf340-fd32-4ac5-a758-e498a7ec3cfa": { 2023-07-14T18:13:31.833 INFO:teuthology.orchestra.run.smithi163.stdout: "path": "/", 2023-07-14T18:13:31.833 INFO:teuthology.orchestra.run.smithi163.stdout: "tag": "c7caf340-fd32-4ac5-a758-e498a7ec3cfa", 2023-07-14T18:13:31.833 INFO:teuthology.orchestra.run.smithi163.stdout: "options": "recursive,force" 2023-07-14T18:13:31.833 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-07-14T18:13:31.833 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-07-14T18:13:31.834 INFO:teuthology.orchestra.run.smithi163.stdout:} 2023-07-14T18:13:31.834 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:31.783+0000 7f4db5af3700 1 -- 172.21.15.163:0/1231616929 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f4d980a11d0 msgr2=0x7f4d980a3680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:13:31.834 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:31.783+0000 7f4db5af3700 1 --2- 172.21.15.163:0/1231616929 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f4d980a11d0 0x7f4d980a3680 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f4db00ffb60 tx=0x7f4da0009260 comp rx=0 tx=0).stop 2023-07-14T18:13:31.835 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:31.783+0000 7f4db5af3700 1 -- 172.21.15.163:0/1231616929 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f4db0100690 msgr2=0x7f4db019cec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:13:31.835 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:31.783+0000 7f4db5af3700 1 --2- 172.21.15.163:0/1231616929 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f4db0100690 0x7f4db019cec0 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f4da800ef30 tx=0x7f4da800c3a0 comp rx=0 tx=0).stop 2023-07-14T18:13:31.835 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:31.783+0000 7f4db5af3700 1 -- 172.21.15.163:0/1231616929 shutdown_connections 2023-07-14T18:13:31.835 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:31.783+0000 7f4db5af3700 1 --2- 172.21.15.163:0/1231616929 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f4d980a11d0 0x7f4d980a3680 secure :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f4db00ffb60 tx=0x7f4da0009260 comp rx=0 tx=0).stop 2023-07-14T18:13:31.835 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:31.783+0000 7f4db5af3700 1 --2- 172.21.15.163:0/1231616929 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4db00feb10 0x7f4db0195910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:13:31.835 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:31.783+0000 7f4db5af3700 1 --2- 172.21.15.163:0/1231616929 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f4db0100690 0x7f4db019cec0 unknown :-1 s=CLOSED pgs=597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:13:31.835 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:31.783+0000 7f4db5af3700 1 --2- 172.21.15.163:0/1231616929 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4db00ffd00 0x7f4db0195e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:13:31.836 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:31.783+0000 7f4db5af3700 1 -- 172.21.15.163:0/1231616929 >> 172.21.15.163:0/1231616929 conn(0x7f4db00fa130 msgr2=0x7f4db0103310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:13:31.836 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:31.784+0000 7f4db5af3700 1 -- 172.21.15.163:0/1231616929 shutdown_connections 2023-07-14T18:13:31.836 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:13:31.784+0000 7f4db5af3700 1 -- 172.21.15.163:0/1231616929 wait complete. 2023-07-14T18:13:31.843 INFO:tasks.cephfs.filesystem:scrub status for tag:c7caf340-fd32-4ac5-a758-e498a7ec3cfa - {'path': '/', 'tag': 'c7caf340-fd32-4ac5-a758-e498a7ec3cfa', 'options': 'recursive,force'} 2023-07-14T18:13:31.968 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:13:31 smithi163 ceph-mon[96576]: scrub queued for path: / 2023-07-14T18:13:31.969 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:13:31 smithi163 ceph-mon[96576]: scrub summary: idle+waiting paths [/] 2023-07-14T18:13:31.969 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:13:31 smithi163 ceph-mon[96576]: scrub summary: active paths [/] 2023-07-14T18:13:31.969 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:13:31 smithi163 ceph-mon[96576]: scrub summary: idle+waiting paths [/] 2023-07-14T18:13:32.176 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:13:31 smithi184 ceph-mon[98481]: scrub queued for path: / 2023-07-14T18:13:32.176 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:13:31 smithi184 ceph-mon[98481]: scrub summary: idle+waiting paths [/] 2023-07-14T18:13:32.176 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:13:31 smithi184 ceph-mon[98481]: scrub summary: active paths [/] 2023-07-14T18:13:32.177 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:13:31 smithi184 ceph-mon[98481]: scrub summary: idle+waiting paths [/] 2023-07-14T18:13:32.277 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:13:31 smithi172 ceph-mon[97983]: scrub queued for path: / 2023-07-14T18:13:32.277 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:13:31 smithi172 ceph-mon[97983]: scrub summary: idle+waiting paths [/] 2023-07-14T18:13:32.277 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:13:31 smithi172 ceph-mon[97983]: scrub summary: active paths [/] 2023-07-14T18:13:32.278 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:13:31 smithi172 ceph-mon[97983]: scrub summary: idle+waiting paths [/] 2023-07-14T18:13:33.176 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:13:32 smithi184 ceph-mon[98481]: pgmap v326: 129 pgs: 129 active+clean; 660 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 9 op/s 2023-07-14T18:13:33.219 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:13:32 smithi163 ceph-mon[96576]: pgmap v326: 129 pgs: 129 active+clean; 660 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 9 op/s 2023-07-14T18:13:33.277 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:13:32 smithi172 ceph-mon[97983]: pgmap v326: 129 pgs: 129 active+clean; 660 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 9 op/s 2023-07-14T18:13:34.176 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:13:33 smithi184 ceph-mon[98481]: scrub summary: idle 2023-07-14T18:13:34.218 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:13:33 smithi163 ceph-mon[96576]: scrub summary: idle 2023-07-14T18:13:34.277 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:13:33 smithi172 ceph-mon[97983]: scrub summary: idle 2023-07-14T18:13:35.176 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:13:34 smithi184 ceph-mon[98481]: pgmap v327: 129 pgs: 129 active+clean; 660 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 11 op/s 2023-07-14T18:13:35.218 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:13:34 smithi163 ceph-mon[96576]: pgmap v327: 129 pgs: 129 active+clean; 660 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 11 op/s 2023-07-14T18:13:35.277 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:13:34 smithi172 ceph-mon[97983]: pgmap v327: 129 pgs: 129 active+clean; 660 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 11 op/s 2023-07-14T18:13:37.176 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:13:36 smithi184 ceph-mon[98481]: pgmap v328: 129 pgs: 129 active+clean; 660 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 9 op/s 2023-07-14T18:13:37.219 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:13:36 smithi163 ceph-mon[96576]: pgmap v328: 129 pgs: 129 active+clean; 660 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 9 op/s 2023-07-14T18:13:37.277 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:13:36 smithi172 ceph-mon[97983]: pgmap v328: 129 pgs: 129 active+clean; 660 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 9 op/s 2023-07-14T18:13:39.176 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:13:38 smithi184 ceph-mon[98481]: pgmap v329: 129 pgs: 129 active+clean; 660 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 9 op/s 2023-07-14T18:13:39.218 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:13:38 smithi163 ceph-mon[96576]: pgmap v329: 129 pgs: 129 active+clean; 660 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 9 op/s 2023-07-14T18:13:39.277 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:13:38 smithi172 ceph-mon[97983]: pgmap v329: 129 pgs: 129 active+clean; 660 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 9 op/s 2023-07-14T18:13:41.176 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:13:40 smithi184 ceph-mon[98481]: pgmap v330: 129 pgs: 129 active+clean; 660 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 11 op/s 2023-07-14T18:13:41.218 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:13:40 smithi163 ceph-mon[96576]: pgmap v330: 129 pgs: 129 active+clean; 660 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 11 op/s 2023-07-14T18:13:41.277 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:13:40 smithi172 ceph-mon[97983]: pgmap v330: 129 pgs: 129 active+clean; 660 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 11 op/s 2023-07-14T18:13:43.176 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:13:42 smithi184 ceph-mon[98481]: pgmap v331: 129 pgs: 129 active+clean; 660 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 9 op/s 2023-07-14T18:13:43.219 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:13:42 smithi163 ceph-mon[96576]: pgmap v331: 129 pgs: 129 active+clean; 660 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 9 op/s 2023-07-14T18:13:43.277 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:13:42 smithi172 ceph-mon[97983]: pgmap v331: 129 pgs: 129 active+clean; 660 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 9 op/s 2023-07-14T18:13:45.176 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:13:44 smithi184 ceph-mon[98481]: pgmap v332: 129 pgs: 129 active+clean; 660 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-07-14T18:13:45.219 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:13:44 smithi163 ceph-mon[96576]: pgmap v332: 129 pgs: 129 active+clean; 660 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-07-14T18:13:45.277 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:13:44 smithi172 ceph-mon[97983]: pgmap v332: 129 pgs: 129 active+clean; 660 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-07-14T18:13:47.176 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:13:46 smithi184 ceph-mon[98481]: pgmap v333: 129 pgs: 129 active+clean; 660 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-07-14T18:13:47.219 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:13:46 smithi163 ceph-mon[96576]: pgmap v333: 129 pgs: 129 active+clean; 660 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-07-14T18:13:47.277 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:13:46 smithi172 ceph-mon[97983]: pgmap v333: 129 pgs: 129 active+clean; 660 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-07-14T18:13:49.176 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:13:48 smithi184 ceph-mon[98481]: pgmap v334: 129 pgs: 129 active+clean; 660 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-07-14T18:13:49.219 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:13:48 smithi163 ceph-mon[96576]: pgmap v334: 129 pgs: 129 active+clean; 660 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-07-14T18:13:49.277 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:13:48 smithi172 ceph-mon[97983]: pgmap v334: 129 pgs: 129 active+clean; 660 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-07-14T18:13:51.176 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:13:50 smithi184 ceph-mon[98481]: pgmap v335: 129 pgs: 129 active+clean; 660 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-07-14T18:13:51.219 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:13:50 smithi163 ceph-mon[96576]: pgmap v335: 129 pgs: 129 active+clean; 660 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-07-14T18:13:51.277 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:13:50 smithi172 ceph-mon[97983]: pgmap v335: 129 pgs: 129 active+clean; 660 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-07-14T18:13:52.127 INFO:tasks.workunit.client.0.smithi163.stderr:Note: switching to '81c9387d2e7576da065747ec9c16d1c7d69016ec'. 2023-07-14T18:13:52.128 INFO:tasks.workunit.client.0.smithi163.stderr: 2023-07-14T18:13:52.128 INFO:tasks.workunit.client.0.smithi163.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2023-07-14T18:13:52.128 INFO:tasks.workunit.client.0.smithi163.stderr:changes and commit them, and you can discard any commits you make in this 2023-07-14T18:13:52.128 INFO:tasks.workunit.client.0.smithi163.stderr:state without impacting any branches by switching back to a branch. 2023-07-14T18:13:52.128 INFO:tasks.workunit.client.0.smithi163.stderr: 2023-07-14T18:13:52.128 INFO:tasks.workunit.client.0.smithi163.stderr:If you want to create a new branch to retain commits you create, you may 2023-07-14T18:13:52.129 INFO:tasks.workunit.client.0.smithi163.stderr:do so (now or later) by using -c with the switch command. Example: 2023-07-14T18:13:52.129 INFO:tasks.workunit.client.0.smithi163.stderr: 2023-07-14T18:13:52.129 INFO:tasks.workunit.client.0.smithi163.stderr: git switch -c 2023-07-14T18:13:52.129 INFO:tasks.workunit.client.0.smithi163.stderr: 2023-07-14T18:13:52.129 INFO:tasks.workunit.client.0.smithi163.stderr:Or undo this operation with: 2023-07-14T18:13:52.129 INFO:tasks.workunit.client.0.smithi163.stderr: 2023-07-14T18:13:52.129 INFO:tasks.workunit.client.0.smithi163.stderr: git switch - 2023-07-14T18:13:52.129 INFO:tasks.workunit.client.0.smithi163.stderr: 2023-07-14T18:13:52.130 INFO:tasks.workunit.client.0.smithi163.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2023-07-14T18:13:52.130 INFO:tasks.workunit.client.0.smithi163.stderr: 2023-07-14T18:13:52.130 INFO:tasks.workunit.client.0.smithi163.stderr:HEAD is now at 81c9387d2e7 Merge PR #52196 into wip-pdonnell-testing-20230714.134335 2023-07-14T18:13:52.133 DEBUG:teuthology.orchestra.run.smithi163:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2023-07-14T18:13:52.163 INFO:tasks.workunit.client.0.smithi163.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2023-07-14T18:13:52.166 INFO:tasks.workunit.client.0.smithi163.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2023-07-14T18:13:52.166 INFO:tasks.workunit.client.0.smithi163.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2023-07-14T18:13:52.713 INFO:tasks.workunit.client.0.smithi163.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2023-07-14T18:13:52.766 INFO:tasks.workunit.client.0.smithi163.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2023-07-14T18:13:52.804 INFO:tasks.workunit.client.0.smithi163.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2023-07-14T18:13:52.806 INFO:tasks.workunit.client.0.smithi163.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2023-07-14T18:13:52.806 INFO:tasks.workunit.client.0.smithi163.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2023-07-14T18:13:52.843 INFO:tasks.workunit.client.0.smithi163.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2023-07-14T18:13:52.846 DEBUG:teuthology.orchestra.run.smithi163:> set -ex 2023-07-14T18:13:52.846 DEBUG:teuthology.orchestra.run.smithi163:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2023-07-14T18:13:52.903 INFO:tasks.workunit:Running workunits matching suites/fsx.sh on client.0... 2023-07-14T18:13:52.904 INFO:tasks.workunit:Running workunit suites/fsx.sh... 2023-07-14T18:13:52.905 DEBUG:teuthology.orchestra.run.smithi163:workunit test suites/fsx.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=81c9387d2e7576da065747ec9c16d1c7d69016ec TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/fsx.sh 2023-07-14T18:13:52.970 INFO:tasks.workunit.client.0.smithi163.stderr:+ set -e 2023-07-14T18:13:52.970 INFO:tasks.workunit.client.0.smithi163.stderr:+ git clone https://git.ceph.com/xfstests-dev.git 2023-07-14T18:13:52.973 INFO:tasks.workunit.client.0.smithi163.stderr:Cloning into 'xfstests-dev'... 2023-07-14T18:13:53.176 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:13:52 smithi184 ceph-mon[98481]: pgmap v336: 129 pgs: 129 active+clean; 660 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-07-14T18:13:53.219 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:13:52 smithi163 ceph-mon[96576]: pgmap v336: 129 pgs: 129 active+clean; 660 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-07-14T18:13:53.277 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:13:52 smithi172 ceph-mon[97983]: pgmap v336: 129 pgs: 129 active+clean; 660 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-07-14T18:13:54.176 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:13:53 smithi184 ceph-mon[98481]: pgmap v337: 129 pgs: 129 active+clean; 783 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 KiB/s wr, 11 op/s 2023-07-14T18:13:54.219 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:13:53 smithi163 ceph-mon[96576]: pgmap v337: 129 pgs: 129 active+clean; 783 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 KiB/s wr, 11 op/s 2023-07-14T18:13:54.277 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:13:53 smithi172 ceph-mon[97983]: pgmap v337: 129 pgs: 129 active+clean; 783 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 KiB/s wr, 11 op/s 2023-07-14T18:13:57.176 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:13:56 smithi184 ceph-mon[98481]: pgmap v338: 129 pgs: 129 active+clean; 804 KiB data, 331 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 13 KiB/s wr, 11 op/s 2023-07-14T18:13:57.219 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:13:56 smithi163 ceph-mon[96576]: pgmap v338: 129 pgs: 129 active+clean; 804 KiB data, 331 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 13 KiB/s wr, 11 op/s 2023-07-14T18:13:57.277 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:13:56 smithi172 ceph-mon[97983]: pgmap v338: 129 pgs: 129 active+clean; 804 KiB data, 331 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 13 KiB/s wr, 11 op/s 2023-07-14T18:13:59.176 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:13:58 smithi184 ceph-mon[98481]: pgmap v339: 129 pgs: 129 active+clean; 5.6 MiB data, 338 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 428 KiB/s wr, 19 op/s 2023-07-14T18:13:59.219 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:13:58 smithi163 ceph-mon[96576]: pgmap v339: 129 pgs: 129 active+clean; 5.6 MiB data, 338 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 428 KiB/s wr, 19 op/s 2023-07-14T18:13:59.277 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:13:58 smithi172 ceph-mon[97983]: pgmap v339: 129 pgs: 129 active+clean; 5.6 MiB data, 338 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 428 KiB/s wr, 19 op/s 2023-07-14T18:14:01.176 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:14:00 smithi184 ceph-mon[98481]: pgmap v340: 129 pgs: 129 active+clean; 12 MiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 980 KiB/s wr, 38 op/s 2023-07-14T18:14:01.219 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:14:00 smithi163 ceph-mon[96576]: pgmap v340: 129 pgs: 129 active+clean; 12 MiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 980 KiB/s wr, 38 op/s 2023-07-14T18:14:01.277 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:14:00 smithi172 ceph-mon[97983]: pgmap v340: 129 pgs: 129 active+clean; 12 MiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 980 KiB/s wr, 38 op/s 2023-07-14T18:14:01.845 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-07-14T18:14:01.994 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:01.949+0000 7f8d2cd1d700 1 -- 172.21.15.163:0/2699614915 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f8d281018e0 msgr2=0x7f8d281081a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:14:01.995 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:01.949+0000 7f8d2cd1d700 1 --2- 172.21.15.163:0/2699614915 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f8d281018e0 0x7f8d281081a0 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f8d2000b0a0 tx=0x7f8d2000b3b0 comp rx=0 tx=0).stop 2023-07-14T18:14:01.995 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:01.949+0000 7f8d2cd1d700 1 -- 172.21.15.163:0/2699614915 shutdown_connections 2023-07-14T18:14:01.995 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:01.949+0000 7f8d2cd1d700 1 --2- 172.21.15.163:0/2699614915 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8d280fdee0 0x7f8d280fe2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:01.996 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:01.949+0000 7f8d2cd1d700 1 --2- 172.21.15.163:0/2699614915 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f8d281018e0 0x7f8d281081a0 unknown :-1 s=CLOSED pgs=600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:01.996 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:01.949+0000 7f8d2cd1d700 1 --2- 172.21.15.163:0/2699614915 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8d28100f50 0x7f8d281013a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:01.996 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:01.949+0000 7f8d2cd1d700 1 -- 172.21.15.163:0/2699614915 >> 172.21.15.163:0/2699614915 conn(0x7f8d280f98a0 msgr2=0x7f8d280fbcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:14:01.996 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:01.949+0000 7f8d2cd1d700 1 -- 172.21.15.163:0/2699614915 shutdown_connections 2023-07-14T18:14:01.997 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:01.949+0000 7f8d2cd1d700 1 -- 172.21.15.163:0/2699614915 wait complete. 2023-07-14T18:14:01.997 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:01.950+0000 7f8d2cd1d700 1 Processor -- start 2023-07-14T18:14:01.997 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:01.950+0000 7f8d2cd1d700 1 -- start start 2023-07-14T18:14:01.997 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:01.950+0000 7f8d2cd1d700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f8d280fdee0 0x7f8d28195980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:14:01.997 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:01.950+0000 7f8d2cd1d700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8d28100f50 0x7f8d28195ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:14:01.998 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:01.950+0000 7f8d2cd1d700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8d281018e0 0x7f8d2819cf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:14:01.998 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:01.950+0000 7f8d2cd1d700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d2819d500 con 0x7f8d280fdee0 2023-07-14T18:14:01.998 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:01.950+0000 7f8d2cd1d700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d2819d640 con 0x7f8d281018e0 2023-07-14T18:14:01.998 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:01.950+0000 7f8d2cd1d700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d2819d7d0 con 0x7f8d28100f50 2023-07-14T18:14:01.999 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:01.950+0000 7f8d2659c700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f8d280fdee0 0x7f8d28195980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:14:01.999 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:01.950+0000 7f8d2659c700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f8d280fdee0 0x7f8d28195980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:58776/0 (socket says 172.21.15.163:58776) 2023-07-14T18:14:01.999 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:01.950+0000 7f8d2659c700 1 -- 172.21.15.163:0/204094737 learned_addr learned my addr 172.21.15.163:0/204094737 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:14:01.999 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:01.950+0000 7f8d26d9d700 1 --2- 172.21.15.163:0/204094737 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8d281018e0 0x7f8d2819cf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:14:02.000 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:01.950+0000 7f8d2659c700 1 -- 172.21.15.163:0/204094737 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8d28100f50 msgr2=0x7f8d28195ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:14:02.000 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:01.950+0000 7f8d2659c700 1 --2- 172.21.15.163:0/204094737 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8d28100f50 0x7f8d28195ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:02.000 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:01.950+0000 7f8d2659c700 1 -- 172.21.15.163:0/204094737 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8d281018e0 msgr2=0x7f8d2819cf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:14:02.000 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:01.950+0000 7f8d2659c700 1 --2- 172.21.15.163:0/204094737 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8d281018e0 0x7f8d2819cf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:02.001 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:01.950+0000 7f8d2659c700 1 -- 172.21.15.163:0/204094737 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d20009d00 con 0x7f8d280fdee0 2023-07-14T18:14:02.001 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:01.951+0000 7f8d2659c700 1 --2- 172.21.15.163:0/204094737 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f8d280fdee0 0x7f8d28195980 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f8d1c00e970 tx=0x7f8d1c00ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:14:02.001 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:01.951+0000 7f8d177fe700 1 -- 172.21.15.163:0/204094737 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d1c009790 con 0x7f8d280fdee0 2023-07-14T18:14:02.002 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:01.951+0000 7f8d177fe700 1 -- 172.21.15.163:0/204094737 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f8d1c00eec0 con 0x7f8d280fdee0 2023-07-14T18:14:02.002 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:01.951+0000 7f8d177fe700 1 -- 172.21.15.163:0/204094737 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d1c003c10 con 0x7f8d280fdee0 2023-07-14T18:14:02.002 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:01.951+0000 7f8d2cd1d700 1 -- 172.21.15.163:0/204094737 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8d2819dab0 con 0x7f8d280fdee0 2023-07-14T18:14:02.002 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:01.951+0000 7f8d2cd1d700 1 -- 172.21.15.163:0/204094737 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d2819df70 con 0x7f8d280fdee0 2023-07-14T18:14:02.013 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:01.953+0000 7f8d177fe700 1 -- 172.21.15.163:0/204094737 <== mon.0 v2:172.21.15.163:3300/0 4 ==== mgrmap(e 18) v1 ==== 135716+0+0 (secure 0 0 0) 0x7f8d1c003db0 con 0x7f8d280fdee0 2023-07-14T18:14:02.013 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:01.953+0000 7f8d177fe700 1 --2- 172.21.15.163:0/204094737 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f8d100a11d0 0x7f8d100a3680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:14:02.013 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:01.953+0000 7f8d177fe700 1 -- 172.21.15.163:0/204094737 <== mon.0 v2:172.21.15.163:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 9049+0+0 (secure 0 0 0) 0x7f8d1c014070 con 0x7f8d280fdee0 2023-07-14T18:14:02.013 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:01.953+0000 7f8d25d9b700 1 --2- 172.21.15.163:0/204094737 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f8d100a11d0 0x7f8d100a3680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:14:02.014 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:01.954+0000 7f8d25d9b700 1 --2- 172.21.15.163:0/204094737 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f8d100a11d0 0x7f8d100a3680 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f8d18005950 tx=0x7f8d180058e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:14:02.014 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:01.954+0000 7f8d38eb5b80 1 Processor -- start 2023-07-14T18:14:02.014 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:01.954+0000 7f8d38eb5b80 1 -- start start 2023-07-14T18:14:02.014 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:01.955+0000 7f8d38eb5b80 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55952b2da320 0x55952b2da730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:14:02.014 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:01.955+0000 7f8d38eb5b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55952b2dac70 0x55952b2db310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:14:02.014 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:01.955+0000 7f8d38eb5b80 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55952b2db8a0 0x55952b2dbd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:14:02.014 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:01.955+0000 7f8d38eb5b80 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x55952b1dacb0 con 0x55952b2da320 2023-07-14T18:14:02.015 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:01.955+0000 7f8d38eb5b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x55952b22da40 con 0x55952b2dac70 2023-07-14T18:14:02.015 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:01.955+0000 7f8d38eb5b80 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x55952b226ed0 con 0x55952b2db8a0 2023-07-14T18:14:02.015 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:01.955+0000 7f8d2659c700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55952b2da320 0x55952b2da730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:14:02.015 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:01.955+0000 7f8d2659c700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55952b2da320 0x55952b2da730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:58784/0 (socket says 172.21.15.163:58784) 2023-07-14T18:14:02.015 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:01.955+0000 7f8d2659c700 1 -- 172.21.15.163:0/1466035024 learned_addr learned my addr 172.21.15.163:0/1466035024 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:14:02.015 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:01.955+0000 7f8d25d9b700 1 --2- 172.21.15.163:0/1466035024 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55952b2dac70 0x55952b2db310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:14:02.015 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:01.955+0000 7f8d26d9d700 1 --2- 172.21.15.163:0/1466035024 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55952b2db8a0 0x55952b2dbd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:14:02.015 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:01.955+0000 7f8d2659c700 1 -- 172.21.15.163:0/1466035024 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55952b2db8a0 msgr2=0x55952b2dbd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:14:02.016 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:01.955+0000 7f8d2659c700 1 --2- 172.21.15.163:0/1466035024 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55952b2db8a0 0x55952b2dbd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:02.016 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:01.955+0000 7f8d2659c700 1 -- 172.21.15.163:0/1466035024 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55952b2dac70 msgr2=0x55952b2db310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:14:02.016 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:01.955+0000 7f8d2659c700 1 --2- 172.21.15.163:0/1466035024 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55952b2dac70 0x55952b2db310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:02.016 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:01.955+0000 7f8d2659c700 1 -- 172.21.15.163:0/1466035024 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55952b054de0 con 0x55952b2da320 2023-07-14T18:14:02.016 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:01.955+0000 7f8d25d9b700 1 --2- 172.21.15.163:0/1466035024 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55952b2dac70 0x55952b2db310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T18:14:02.016 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:01.955+0000 7f8d2659c700 1 --2- 172.21.15.163:0/1466035024 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55952b2da320 0x55952b2da730 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f8d1c0a1e40 tx=0x7f8d1c099b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=912419efedb7afcc server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:14:02.016 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:01.955+0000 7f8d14ff9700 1 -- 172.21.15.163:0/1466035024 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d1c099f20 con 0x55952b2da320 2023-07-14T18:14:02.017 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:01.955+0000 7f8d14ff9700 1 -- 172.21.15.163:0/1466035024 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f8d1c09df50 con 0x55952b2da320 2023-07-14T18:14:02.017 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:01.955+0000 7f8d14ff9700 1 -- 172.21.15.163:0/1466035024 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d1c099410 con 0x55952b2da320 2023-07-14T18:14:02.017 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:01.956+0000 7f8d38eb5b80 1 -- 172.21.15.163:0/1466035024 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55952b2da320 msgr2=0x55952b2da730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:14:02.017 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:01.956+0000 7f8d38eb5b80 1 --2- 172.21.15.163:0/1466035024 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55952b2da320 0x55952b2da730 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f8d1c0a1e40 tx=0x7f8d1c099b30 comp rx=0 tx=0).stop 2023-07-14T18:14:02.017 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:01.956+0000 7f8d38eb5b80 1 -- 172.21.15.163:0/1466035024 shutdown_connections 2023-07-14T18:14:02.017 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:01.956+0000 7f8d38eb5b80 1 --2- 172.21.15.163:0/1466035024 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55952b2db8a0 0x55952b2dbd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:02.017 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:01.956+0000 7f8d38eb5b80 1 --2- 172.21.15.163:0/1466035024 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55952b2da320 0x55952b2da730 unknown :-1 s=CLOSED pgs=602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:02.017 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:01.956+0000 7f8d38eb5b80 1 --2- 172.21.15.163:0/1466035024 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55952b2dac70 0x55952b2db310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:02.018 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:01.956+0000 7f8d38eb5b80 1 -- 172.21.15.163:0/1466035024 >> 172.21.15.163:0/1466035024 conn(0x55952b2cb680 msgr2=0x55952b2d09d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:14:02.018 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:01.956+0000 7f8d38eb5b80 1 -- 172.21.15.163:0/1466035024 shutdown_connections 2023-07-14T18:14:02.018 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:01.956+0000 7f8d38eb5b80 1 -- 172.21.15.163:0/1466035024 wait complete. 2023-07-14T18:14:02.018 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:01.957+0000 7f8d38eb5b80 1 -- start start 2023-07-14T18:14:02.018 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:01.957+0000 7f8d38eb5b80 1 Processor -- start 2023-07-14T18:14:02.018 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:01.957+0000 7f8d38eb5b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55952b2da320 0x55952b2e3db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:14:02.019 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:01.957+0000 7f8d38eb5b80 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55952b2dac70 0x55952b2e42f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:14:02.019 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:01.957+0000 7f8d38eb5b80 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55952b2db8a0 0x55952b2eb330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:14:02.019 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:01.957+0000 7f8d38eb5b80 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x55952b1c6ac0 con 0x55952b2db8a0 2023-07-14T18:14:02.019 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:01.957+0000 7f8d38eb5b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x55952b1c67c0 con 0x55952b2da320 2023-07-14T18:14:02.019 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:01.957+0000 7f8d38eb5b80 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x55952b0aa920 con 0x55952b2dac70 2023-07-14T18:14:02.019 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:01.957+0000 7f8d38eb5b80 10 client.0 _ll_register_callbacks cb 0x55952b1c4760 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T18:14:02.019 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:01.957+0000 7f8d26d9d700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55952b2db8a0 0x55952b2eb330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:14:02.019 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:01.957+0000 7f8d26d9d700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55952b2db8a0 0x55952b2eb330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:58794/0 (socket says 172.21.15.163:58794) 2023-07-14T18:14:02.020 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:01.957+0000 7f8d26d9d700 1 -- 172.21.15.163:0/316780960 learned_addr learned my addr 172.21.15.163:0/316780960 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:14:02.020 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:01.957+0000 7f8d2659c700 1 --2- 172.21.15.163:0/316780960 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55952b2da320 0x55952b2e3db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:14:02.020 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:01.957+0000 7f8d26d9d700 1 -- 172.21.15.163:0/316780960 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55952b2dac70 msgr2=0x55952b2e42f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:14:02.020 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:01.957+0000 7f8d25d9b700 1 --2- 172.21.15.163:0/316780960 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55952b2dac70 0x55952b2e42f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:14:02.020 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:01.957+0000 7f8d26d9d700 1 --2- 172.21.15.163:0/316780960 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55952b2dac70 0x55952b2e42f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:02.020 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:01.957+0000 7f8d26d9d700 1 -- 172.21.15.163:0/316780960 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55952b2da320 msgr2=0x55952b2e3db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:14:02.020 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:01.957+0000 7f8d26d9d700 1 --2- 172.21.15.163:0/316780960 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55952b2da320 0x55952b2e3db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:02.021 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:01.957+0000 7f8d26d9d700 1 -- 172.21.15.163:0/316780960 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d1800d8b0 con 0x55952b2db8a0 2023-07-14T18:14:02.021 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:01.958+0000 7f8d26d9d700 1 --2- 172.21.15.163:0/316780960 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55952b2db8a0 0x55952b2eb330 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f8d20015000 tx=0x7f8d20007ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3aefa91b2cd0b434 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:14:02.021 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:01.958+0000 7f8d0dffb700 10 client.0 ms_handle_connect on v2:172.21.15.163:3300/0 2023-07-14T18:14:02.021 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:01.958+0000 7f8d0dffb700 1 -- 172.21.15.163:0/316780960 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d2000e040 con 0x55952b2db8a0 2023-07-14T18:14:02.021 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:01.958+0000 7f8d0dffb700 1 -- 172.21.15.163:0/316780960 <== mon.0 v2:172.21.15.163:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 9049+0+0 (secure 0 0 0) 0x7f8d2000bab0 con 0x55952b2db8a0 2023-07-14T18:14:02.021 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:01.958+0000 7f8d38eb5b80 1 -- 172.21.15.163:0/316780960 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55952b1804f0 con 0x55952b2db8a0 2023-07-14T18:14:02.021 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:01.958+0000 7f8d0dffb700 1 -- 172.21.15.163:0/316780960 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8d2000bcb0 con 0x55952b2db8a0 2023-07-14T18:14:02.021 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:01.958+0000 7f8d38eb5b80 10 client.15969 fetch_fsmap learned FSMap version 29 2023-07-14T18:14:02.022 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:01.958+0000 7f8d38eb5b80 1 -- 172.21.15.163:0/316780960 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) v3 -- 0x7f8d2819df70 con 0x55952b2db8a0 2023-07-14T18:14:02.022 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:01.958+0000 7f8d0dffb700 1 -- 172.21.15.163:0/316780960 <== mon.0 v2:172.21.15.163:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55952b1804f0 con 0x55952b2db8a0 2023-07-14T18:14:02.022 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:01.958+0000 7f8d0dffb700 1 -- 172.21.15.163:0/316780960 <== mon.0 v2:172.21.15.163:3300/0 5 ==== fsmap(e 29) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f8d20019030 con 0x55952b2db8a0 2023-07-14T18:14:02.022 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:01.958+0000 7f8d38eb5b80 10 client.15969 fetch_fsmap finished waiting for FSMap version 29 2023-07-14T18:14:02.022 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:01.958+0000 7f8d38eb5b80 10 client.15969 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-07-14T18:14:02.022 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:01.958+0000 7f8d38eb5b80 20 client.15969 populate_metadata read hostname 'smithi163' 2023-07-14T18:14:02.022 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:01.958+0000 7f8d38eb5b80 1 --2- 172.21.15.163:0/316780960 >> [v2:172.21.15.172:6838/3850440096,v1:172.21.15.172:6839/3850440096] conn(0x55952b2efbe0 0x55952b2f1ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:14:02.022 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:01.958+0000 7f8d38eb5b80 4 client.15969 mds_command: new command op to 24518 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-14T18:14:02.023 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:01.958+0000 7f8d38eb5b80 1 -- 172.21.15.163:0/316780960 --> [v2:172.21.15.172:6838/3850440096,v1:172.21.15.172:6839/3850440096] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55952b2a4da0 con 0x55952b2efbe0 2023-07-14T18:14:02.023 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:01.958+0000 7f8d2659c700 1 --2- 172.21.15.163:0/316780960 >> [v2:172.21.15.172:6838/3850440096,v1:172.21.15.172:6839/3850440096] conn(0x55952b2efbe0 0x55952b2f1ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:14:02.023 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:01.959+0000 7f8d2659c700 1 --2- 172.21.15.163:0/316780960 >> [v2:172.21.15.172:6838/3850440096,v1:172.21.15.172:6839/3850440096] conn(0x55952b2efbe0 0x55952b2f1ff0 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d06b277a14303d8a server_cookie=78ebb33010d52027 in_seq=0 out_seq=0 2023-07-14T18:14:02.023 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:01.959+0000 7f8d0dffb700 10 client.15969 ms_handle_connect on v2:172.21.15.172:6838/3850440096 2023-07-14T18:14:02.023 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:01.959+0000 7f8d0dffb700 1 -- 172.21.15.163:0/316780960 <== mds.0 v2:172.21.15.172:6838/3850440096 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18017 (crc 0 0 0) 0x55952b2a4da0 con 0x55952b2efbe0 2023-07-14T18:14:02.023 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:01.959+0000 7f8d0dffb700 10 client.15969 handle_command_reply: tid=0 2023-07-14T18:14:02.024 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:01.959+0000 7f8d38eb5b80 1 client.15969 shutdown 2023-07-14T18:14:02.024 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:01.959+0000 7f8d38eb5b80 1 -- 172.21.15.163:0/316780960 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55952b2db8a0 msgr2=0x55952b2eb330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:14:02.024 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:01.959+0000 7f8d38eb5b80 1 --2- 172.21.15.163:0/316780960 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55952b2db8a0 0x55952b2eb330 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f8d20015000 tx=0x7f8d20007ee0 comp rx=0 tx=0).stop 2023-07-14T18:14:02.024 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:01.960+0000 7f8d38eb5b80 1 -- 172.21.15.163:0/316780960 shutdown_connections 2023-07-14T18:14:02.024 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:01.960+0000 7f8d38eb5b80 1 --2- 172.21.15.163:0/316780960 >> [v2:172.21.15.172:6838/3850440096,v1:172.21.15.172:6839/3850440096] conn(0x55952b2efbe0 0x55952b2f1ff0 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:02.024 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:01.960+0000 7f8d38eb5b80 1 --2- 172.21.15.163:0/316780960 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55952b2db8a0 0x55952b2eb330 unknown :-1 s=CLOSED pgs=603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:02.024 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:01.960+0000 7f8d0dffb700 0 client.15969 ms_handle_reset on v2:172.21.15.172:6838/3850440096 2023-07-14T18:14:02.025 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:01.960+0000 7f8d38eb5b80 1 --2- 172.21.15.163:0/316780960 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55952b2da320 0x55952b2e3db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:02.025 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:01.960+0000 7f8d38eb5b80 1 --2- 172.21.15.163:0/316780960 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55952b2dac70 0x55952b2e42f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:02.025 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:01.960+0000 7f8d38eb5b80 1 -- 172.21.15.163:0/316780960 >> 172.21.15.163:0/316780960 conn(0x55952b2cb680 msgr2=0x55952b2cf650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:14:02.025 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:01.960+0000 7f8d38eb5b80 1 -- 172.21.15.163:0/316780960 shutdown_connections 2023-07-14T18:14:02.025 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:01.960+0000 7f8d38eb5b80 1 -- 172.21.15.163:0/316780960 wait complete. 2023-07-14T18:14:02.025 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:01.960+0000 7f8d38eb5b80 20 client.15969 trim_cache size 0 max 16384 2023-07-14T18:14:02.029 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:01.976+0000 7f8d38eb5b80 1 Processor -- start 2023-07-14T18:14:02.029 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:01.976+0000 7f8d38eb5b80 1 -- start start 2023-07-14T18:14:02.029 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:01.976+0000 7f8d38eb5b80 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55952b2da320 0x55952b2dbc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:14:02.029 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:01.976+0000 7f8d38eb5b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55952b2dac70 0x55952b2eb250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:14:02.030 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:01.976+0000 7f8d38eb5b80 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55952b2db8a0 0x55952b2e1c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:14:02.030 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:01.976+0000 7f8d38eb5b80 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x55952b2d1780 con 0x55952b2da320 2023-07-14T18:14:02.030 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:01.976+0000 7f8d38eb5b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x55952b2e3920 con 0x55952b2dac70 2023-07-14T18:14:02.030 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:01.976+0000 7f8d38eb5b80 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x55952b2cb250 con 0x55952b2db8a0 2023-07-14T18:14:02.030 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:01.976+0000 7f8d2659c700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55952b2da320 0x55952b2dbc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:14:02.030 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:01.976+0000 7f8d2659c700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55952b2da320 0x55952b2dbc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:58798/0 (socket says 172.21.15.163:58798) 2023-07-14T18:14:02.030 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:01.976+0000 7f8d2659c700 1 -- 172.21.15.163:0/1171675754 learned_addr learned my addr 172.21.15.163:0/1171675754 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:14:02.030 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:01.976+0000 7f8d25d9b700 1 --2- 172.21.15.163:0/1171675754 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55952b2dac70 0x55952b2eb250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:14:02.031 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:01.976+0000 7f8d2659c700 1 -- 172.21.15.163:0/1171675754 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55952b2db8a0 msgr2=0x55952b2e1c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:14:02.031 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:01.976+0000 7f8d2659c700 1 --2- 172.21.15.163:0/1171675754 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55952b2db8a0 0x55952b2e1c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:02.031 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:01.976+0000 7f8d2659c700 1 -- 172.21.15.163:0/1171675754 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55952b2dac70 msgr2=0x55952b2eb250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:14:02.031 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:01.976+0000 7f8d2659c700 1 --2- 172.21.15.163:0/1171675754 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55952b2dac70 0x55952b2eb250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:02.031 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:01.976+0000 7f8d2659c700 1 -- 172.21.15.163:0/1171675754 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55952b03dc60 con 0x55952b2da320 2023-07-14T18:14:02.031 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:01.976+0000 7f8d2659c700 1 --2- 172.21.15.163:0/1171675754 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55952b2da320 0x55952b2dbc70 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f8d1c0ca660 tx=0x7f8d1c095c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d1f59b175f5f4326 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:14:02.031 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:01.976+0000 7f8d157fa700 1 -- 172.21.15.163:0/1171675754 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d1c0b82b0 con 0x55952b2da320 2023-07-14T18:14:02.031 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:01.976+0000 7f8d157fa700 1 -- 172.21.15.163:0/1171675754 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f8d1c098060 con 0x55952b2da320 2023-07-14T18:14:02.032 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:01.977+0000 7f8d157fa700 1 -- 172.21.15.163:0/1171675754 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d1c0994e0 con 0x55952b2da320 2023-07-14T18:14:02.032 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:01.977+0000 7f8d38eb5b80 1 -- 172.21.15.163:0/1171675754 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55952b2da320 msgr2=0x55952b2dbc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:14:02.032 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:01.977+0000 7f8d38eb5b80 1 --2- 172.21.15.163:0/1171675754 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55952b2da320 0x55952b2dbc70 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f8d1c0ca660 tx=0x7f8d1c095c30 comp rx=0 tx=0).stop 2023-07-14T18:14:02.032 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:01.977+0000 7f8d38eb5b80 1 -- 172.21.15.163:0/1171675754 shutdown_connections 2023-07-14T18:14:02.032 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:01.977+0000 7f8d38eb5b80 1 --2- 172.21.15.163:0/1171675754 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55952b2db8a0 0x55952b2e1c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:02.032 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:01.977+0000 7f8d38eb5b80 1 --2- 172.21.15.163:0/1171675754 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55952b2da320 0x55952b2dbc70 unknown :-1 s=CLOSED pgs=604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:02.032 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:01.977+0000 7f8d38eb5b80 1 --2- 172.21.15.163:0/1171675754 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55952b2dac70 0x55952b2eb250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:02.033 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:01.977+0000 7f8d38eb5b80 1 -- 172.21.15.163:0/1171675754 >> 172.21.15.163:0/1171675754 conn(0x55952b2cb680 msgr2=0x55952b2e2ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:14:02.033 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:01.977+0000 7f8d38eb5b80 1 -- 172.21.15.163:0/1171675754 shutdown_connections 2023-07-14T18:14:02.033 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:01.977+0000 7f8d38eb5b80 1 -- 172.21.15.163:0/1171675754 wait complete. 2023-07-14T18:14:02.033 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:01.977+0000 7f8d38eb5b80 1 -- start start 2023-07-14T18:14:02.033 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:01.977+0000 7f8d38eb5b80 1 Processor -- start 2023-07-14T18:14:02.033 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:01.978+0000 7f8d38eb5b80 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55952b2da320 0x55952b2eab20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:14:02.033 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:01.978+0000 7f8d38eb5b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55952b2dac70 0x55952b2eb060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:14:02.033 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:01.978+0000 7f8d38eb5b80 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55952b2db8a0 0x55952b2e75c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:14:02.034 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:01.978+0000 7f8d38eb5b80 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x55952b2e7c10 con 0x55952b2da320 2023-07-14T18:14:02.034 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:01.978+0000 7f8d38eb5b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x55952b2e7d80 con 0x55952b2dac70 2023-07-14T18:14:02.034 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:01.978+0000 7f8d38eb5b80 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x55952b2e7f40 con 0x55952b2db8a0 2023-07-14T18:14:02.034 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:01.978+0000 7f8d38eb5b80 10 client.0 _ll_register_callbacks cb 0x7f8d20009ba0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T18:14:02.034 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:01.978+0000 7f8d2659c700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55952b2da320 0x55952b2eab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:14:02.034 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:01.978+0000 7f8d2659c700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55952b2da320 0x55952b2eab20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:58804/0 (socket says 172.21.15.163:58804) 2023-07-14T18:14:02.034 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:01.978+0000 7f8d2659c700 1 -- 172.21.15.163:0/590984628 learned_addr learned my addr 172.21.15.163:0/590984628 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:14:02.035 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:01.978+0000 7f8d26d9d700 1 --2- 172.21.15.163:0/590984628 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55952b2db8a0 0x55952b2e75c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:14:02.035 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:01.978+0000 7f8d25d9b700 1 --2- 172.21.15.163:0/590984628 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55952b2dac70 0x55952b2eb060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:14:02.035 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:01.978+0000 7f8d2659c700 1 -- 172.21.15.163:0/590984628 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55952b2db8a0 msgr2=0x55952b2e75c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:14:02.035 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:01.978+0000 7f8d2659c700 1 --2- 172.21.15.163:0/590984628 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55952b2db8a0 0x55952b2e75c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:02.035 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:01.978+0000 7f8d2659c700 1 -- 172.21.15.163:0/590984628 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55952b2dac70 msgr2=0x55952b2eb060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:14:02.035 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:01.978+0000 7f8d2659c700 1 --2- 172.21.15.163:0/590984628 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55952b2dac70 0x55952b2eb060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:02.035 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:01.978+0000 7f8d2659c700 1 -- 172.21.15.163:0/590984628 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d1c0b6040 con 0x55952b2da320 2023-07-14T18:14:02.035 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:01.978+0000 7f8d2659c700 1 --2- 172.21.15.163:0/590984628 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55952b2da320 0x55952b2eab20 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f8d1c0ca980 tx=0x7f8d1c00cec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c9b6b8f4cf9f22a server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:14:02.036 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:01.978+0000 7f8d0dffb700 10 client.0 ms_handle_connect on v2:172.21.15.163:3300/0 2023-07-14T18:14:02.036 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:01.978+0000 7f8d0dffb700 1 -- 172.21.15.163:0/590984628 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d1c099480 con 0x55952b2da320 2023-07-14T18:14:02.036 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:01.978+0000 7f8d0dffb700 1 -- 172.21.15.163:0/590984628 <== mon.0 v2:172.21.15.163:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 9049+0+0 (secure 0 0 0) 0x7f8d1c078e40 con 0x55952b2da320 2023-07-14T18:14:02.036 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:01.978+0000 7f8d38eb5b80 1 -- 172.21.15.163:0/590984628 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f8d1c09df50 con 0x55952b2da320 2023-07-14T18:14:02.036 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:01.978+0000 7f8d0dffb700 1 -- 172.21.15.163:0/590984628 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8d1c0995e0 con 0x55952b2da320 2023-07-14T18:14:02.036 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:01.978+0000 7f8d38eb5b80 10 client.15975 fetch_fsmap learned FSMap version 29 2023-07-14T18:14:02.036 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:01.978+0000 7f8d38eb5b80 1 -- 172.21.15.163:0/590984628 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) v3 -- 0x55952b07b250 con 0x55952b2da320 2023-07-14T18:14:02.037 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:01.979+0000 7f8d0dffb700 1 -- 172.21.15.163:0/590984628 <== mon.0 v2:172.21.15.163:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f8d1c09df50 con 0x55952b2da320 2023-07-14T18:14:02.037 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:01.979+0000 7f8d0dffb700 1 -- 172.21.15.163:0/590984628 <== mon.0 v2:172.21.15.163:3300/0 5 ==== fsmap(e 29) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f8d1c0caad0 con 0x55952b2da320 2023-07-14T18:14:02.037 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:01.979+0000 7f8d38eb5b80 10 client.15975 fetch_fsmap finished waiting for FSMap version 29 2023-07-14T18:14:02.037 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:01.979+0000 7f8d38eb5b80 10 client.15975 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-07-14T18:14:02.037 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:01.979+0000 7f8d38eb5b80 20 client.15975 populate_metadata read hostname 'smithi163' 2023-07-14T18:14:02.037 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:01.979+0000 7f8d38eb5b80 1 --2- 172.21.15.163:0/590984628 >> [v2:172.21.15.172:6838/3850440096,v1:172.21.15.172:6839/3850440096] conn(0x55952b2efbe0 0x55952b346990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:14:02.037 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:01.979+0000 7f8d38eb5b80 4 client.15975 mds_command: new command op to 24518 tid=0[{"prefix": "scrub status"}] 2023-07-14T18:14:02.038 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:01.979+0000 7f8d38eb5b80 1 -- 172.21.15.163:0/590984628 --> [v2:172.21.15.172:6838/3850440096,v1:172.21.15.172:6839/3850440096] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55952b21feb0 con 0x55952b2efbe0 2023-07-14T18:14:02.038 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:01.979+0000 7f8d25d9b700 1 --2- 172.21.15.163:0/590984628 >> [v2:172.21.15.172:6838/3850440096,v1:172.21.15.172:6839/3850440096] conn(0x55952b2efbe0 0x55952b346990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:14:02.038 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:01.979+0000 7f8d0dffb700 10 client.15975 ms_handle_connect on v2:172.21.15.172:6838/3850440096 2023-07-14T18:14:02.038 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:01.979+0000 7f8d25d9b700 1 --2- 172.21.15.163:0/590984628 >> [v2:172.21.15.172:6838/3850440096,v1:172.21.15.172:6839/3850440096] conn(0x55952b2efbe0 0x55952b346990 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a10ead4190e94bd4 server_cookie=a89e78f9d5baa8 in_seq=0 out_seq=0 2023-07-14T18:14:02.038 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:01.979+0000 7f8d0dffb700 1 -- 172.21.15.163:0/590984628 <== mds.0 v2:172.21.15.172:6838/3850440096 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x55952b21feb0 con 0x55952b2efbe0 2023-07-14T18:14:02.038 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:01.979+0000 7f8d0dffb700 10 client.15975 handle_command_reply: tid=0 2023-07-14T18:14:02.038 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:01.979+0000 7f8d38eb5b80 1 client.15975 shutdown 2023-07-14T18:14:02.039 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:01.979+0000 7f8d38eb5b80 1 -- 172.21.15.163:0/590984628 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55952b2da320 msgr2=0x55952b2eab20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:14:02.039 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:01.979+0000 7f8d38eb5b80 1 --2- 172.21.15.163:0/590984628 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55952b2da320 0x55952b2eab20 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f8d1c0ca980 tx=0x7f8d1c00cec0 comp rx=0 tx=0).stop 2023-07-14T18:14:02.039 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:01.980+0000 7f8d38eb5b80 1 -- 172.21.15.163:0/590984628 shutdown_connections 2023-07-14T18:14:02.039 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:01.980+0000 7f8d38eb5b80 1 --2- 172.21.15.163:0/590984628 >> [v2:172.21.15.172:6838/3850440096,v1:172.21.15.172:6839/3850440096] conn(0x55952b2efbe0 0x55952b346990 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:02.039 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:01.980+0000 7f8d38eb5b80 1 --2- 172.21.15.163:0/590984628 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55952b2db8a0 0x55952b2e75c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:02.039 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:01.980+0000 7f8d0dffb700 0 client.15975 ms_handle_reset on v2:172.21.15.172:6838/3850440096 2023-07-14T18:14:02.039 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:01.980+0000 7f8d38eb5b80 1 --2- 172.21.15.163:0/590984628 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55952b2da320 0x55952b2eab20 unknown :-1 s=CLOSED pgs=605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:02.039 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:01.980+0000 7f8d38eb5b80 1 --2- 172.21.15.163:0/590984628 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55952b2dac70 0x55952b2eb060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:02.040 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:01.980+0000 7f8d38eb5b80 1 -- 172.21.15.163:0/590984628 >> 172.21.15.163:0/590984628 conn(0x55952b2cb680 msgr2=0x55952b2e1c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:14:02.040 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:01.980+0000 7f8d38eb5b80 1 -- 172.21.15.163:0/590984628 shutdown_connections 2023-07-14T18:14:02.040 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:01.980+0000 7f8d38eb5b80 1 -- 172.21.15.163:0/590984628 wait complete. 2023-07-14T18:14:02.040 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:01.980+0000 7f8d38eb5b80 20 client.15975 trim_cache size 0 max 16384 2023-07-14T18:14:02.040 INFO:teuthology.orchestra.run.smithi163.stdout:{ 2023-07-14T18:14:02.041 INFO:teuthology.orchestra.run.smithi163.stdout: "status": "no active scrubs running", 2023-07-14T18:14:02.041 INFO:teuthology.orchestra.run.smithi163.stdout: "scrubs": {} 2023-07-14T18:14:02.041 INFO:teuthology.orchestra.run.smithi163.stdout:} 2023-07-14T18:14:02.042 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:01.980+0000 7f8d2cd1d700 1 -- 172.21.15.163:0/204094737 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f8d100a11d0 msgr2=0x7f8d100a3680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:14:02.042 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:01.980+0000 7f8d2cd1d700 1 --2- 172.21.15.163:0/204094737 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f8d100a11d0 0x7f8d100a3680 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f8d18005950 tx=0x7f8d180058e0 comp rx=0 tx=0).stop 2023-07-14T18:14:02.042 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:01.980+0000 7f8d2cd1d700 1 -- 172.21.15.163:0/204094737 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f8d280fdee0 msgr2=0x7f8d28195980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:14:02.042 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:01.980+0000 7f8d2cd1d700 1 --2- 172.21.15.163:0/204094737 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f8d280fdee0 0x7f8d28195980 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f8d1c00e970 tx=0x7f8d1c00ec80 comp rx=0 tx=0).stop 2023-07-14T18:14:02.043 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:01.980+0000 7f8d2cd1d700 1 -- 172.21.15.163:0/204094737 shutdown_connections 2023-07-14T18:14:02.043 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:01.980+0000 7f8d2cd1d700 1 --2- 172.21.15.163:0/204094737 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f8d100a11d0 0x7f8d100a3680 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:02.043 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:01.980+0000 7f8d2cd1d700 1 --2- 172.21.15.163:0/204094737 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8d281018e0 0x7f8d2819cf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:02.043 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:01.980+0000 7f8d2cd1d700 1 --2- 172.21.15.163:0/204094737 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f8d280fdee0 0x7f8d28195980 unknown :-1 s=CLOSED pgs=601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:02.043 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:01.980+0000 7f8d2cd1d700 1 --2- 172.21.15.163:0/204094737 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8d28100f50 0x7f8d28195ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:02.043 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:01.980+0000 7f8d2cd1d700 1 -- 172.21.15.163:0/204094737 >> 172.21.15.163:0/204094737 conn(0x7f8d280f98a0 msgr2=0x7f8d280fbb90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:14:02.043 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:01.980+0000 7f8d2cd1d700 1 -- 172.21.15.163:0/204094737 shutdown_connections 2023-07-14T18:14:02.043 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:01.980+0000 7f8d2cd1d700 1 -- 172.21.15.163:0/204094737 wait complete. 2023-07-14T18:14:02.044 INFO:tasks.cephfs.filesystem:all active scrubs completed 2023-07-14T18:14:02.044 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-14T18:14:02.168 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.122+0000 7ff23d317700 1 -- 172.21.15.163:0/2833259794 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff2380fedd0 msgr2=0x7ff2380ff220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:14:02.169 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.122+0000 7ff23d317700 1 --2- 172.21.15.163:0/2833259794 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff2380fedd0 0x7ff2380ff220 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7ff22c009990 tx=0x7ff22c009ca0 comp rx=0 tx=0).stop 2023-07-14T18:14:02.169 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.122+0000 7ff23d317700 1 -- 172.21.15.163:0/2833259794 shutdown_connections 2023-07-14T18:14:02.169 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.122+0000 7ff23d317700 1 --2- 172.21.15.163:0/2833259794 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff238100130 0x7ff238100540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:02.169 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.122+0000 7ff23d317700 1 --2- 172.21.15.163:0/2833259794 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff2380ff760 0x7ff238107030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:02.170 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.122+0000 7ff23d317700 1 --2- 172.21.15.163:0/2833259794 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff2380fedd0 0x7ff2380ff220 unknown :-1 s=CLOSED pgs=606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:02.170 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.122+0000 7ff23d317700 1 -- 172.21.15.163:0/2833259794 >> 172.21.15.163:0/2833259794 conn(0x7ff2380f98d0 msgr2=0x7ff2380fbd20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:14:02.170 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.122+0000 7ff23d317700 1 -- 172.21.15.163:0/2833259794 shutdown_connections 2023-07-14T18:14:02.171 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.122+0000 7ff23d317700 1 -- 172.21.15.163:0/2833259794 wait complete. 2023-07-14T18:14:02.171 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.123+0000 7ff23d317700 1 Processor -- start 2023-07-14T18:14:02.171 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.123+0000 7ff23d317700 1 -- start start 2023-07-14T18:14:02.171 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.123+0000 7ff23d317700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff2380fedd0 0x7ff238102e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:14:02.172 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.123+0000 7ff23d317700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff2380ff760 0x7ff238101480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:14:02.172 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.123+0000 7ff23d317700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff238100130 0x7ff2381019c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:14:02.172 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.123+0000 7ff23d317700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff238102160 con 0x7ff2380fedd0 2023-07-14T18:14:02.173 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.123+0000 7ff23d317700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2381022d0 con 0x7ff238100130 2023-07-14T18:14:02.173 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.123+0000 7ff23d317700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff23819f880 con 0x7ff2380ff760 2023-07-14T18:14:02.173 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.123+0000 7ff236ffd700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff2380fedd0 0x7ff238102e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:14:02.173 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.124+0000 7ff236ffd700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff2380fedd0 0x7ff238102e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:58818/0 (socket says 172.21.15.163:58818) 2023-07-14T18:14:02.173 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.124+0000 7ff236ffd700 1 -- 172.21.15.163:0/3135137251 learned_addr learned my addr 172.21.15.163:0/3135137251 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:14:02.174 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.124+0000 7ff2367fc700 1 --2- 172.21.15.163:0/3135137251 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff2380ff760 0x7ff238101480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:14:02.174 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.124+0000 7ff2377fe700 1 --2- 172.21.15.163:0/3135137251 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff238100130 0x7ff2381019c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:14:02.174 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.124+0000 7ff236ffd700 1 -- 172.21.15.163:0/3135137251 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff2380ff760 msgr2=0x7ff238101480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:14:02.174 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.124+0000 7ff236ffd700 1 --2- 172.21.15.163:0/3135137251 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff2380ff760 0x7ff238101480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:02.175 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.124+0000 7ff236ffd700 1 -- 172.21.15.163:0/3135137251 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff238100130 msgr2=0x7ff2381019c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:14:02.175 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.124+0000 7ff236ffd700 1 --2- 172.21.15.163:0/3135137251 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff238100130 0x7ff2381019c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:02.175 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.124+0000 7ff236ffd700 1 -- 172.21.15.163:0/3135137251 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff22c0095f0 con 0x7ff2380fedd0 2023-07-14T18:14:02.175 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.124+0000 7ff236ffd700 1 --2- 172.21.15.163:0/3135137251 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff2380fedd0 0x7ff238102e40 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7ff22800d980 tx=0x7ff22800dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:14:02.176 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.124+0000 7ff21ffff700 1 -- 172.21.15.163:0/3135137251 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff22800b950 con 0x7ff2380fedd0 2023-07-14T18:14:02.176 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.124+0000 7ff23d317700 1 -- 172.21.15.163:0/3135137251 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff23819fb60 con 0x7ff2380fedd0 2023-07-14T18:14:02.176 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.124+0000 7ff21ffff700 1 -- 172.21.15.163:0/3135137251 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ff228007620 con 0x7ff2380fedd0 2023-07-14T18:14:02.177 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.124+0000 7ff21ffff700 1 -- 172.21.15.163:0/3135137251 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff22800f3c0 con 0x7ff2380fedd0 2023-07-14T18:14:02.177 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.124+0000 7ff23d317700 1 -- 172.21.15.163:0/3135137251 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2381a0070 con 0x7ff2380fedd0 2023-07-14T18:14:02.177 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.125+0000 7ff23d317700 1 -- 172.21.15.163:0/3135137251 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff238106c80 con 0x7ff2380fedd0 2023-07-14T18:14:02.179 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.126+0000 7ff21ffff700 1 -- 172.21.15.163:0/3135137251 <== mon.0 v2:172.21.15.163:3300/0 4 ==== mgrmap(e 18) v1 ==== 135716+0+0 (secure 0 0 0) 0x7ff22800bab0 con 0x7ff2380fedd0 2023-07-14T18:14:02.179 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.127+0000 7ff21ffff700 1 --2- 172.21.15.163:0/3135137251 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7ff2200a11a0 0x7ff2200a3650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:14:02.179 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.127+0000 7ff21ffff700 1 -- 172.21.15.163:0/3135137251 <== mon.0 v2:172.21.15.163:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 9049+0+0 (secure 0 0 0) 0x7ff2280cd300 con 0x7ff2380fedd0 2023-07-14T18:14:02.179 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.127+0000 7ff2367fc700 1 --2- 172.21.15.163:0/3135137251 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7ff2200a11a0 0x7ff2200a3650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:14:02.179 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.127+0000 7ff2367fc700 1 --2- 172.21.15.163:0/3135137251 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7ff2200a11a0 0x7ff2200a3650 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7ff22c006010 tx=0x7ff22c005960 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:14:02.180 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.130+0000 7ff21ffff700 1 -- 172.21.15.163:0/3135137251 <== mon.0 v2:172.21.15.163:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178025 (secure 0 0 0) 0x7ff228096720 con 0x7ff2380fedd0 2023-07-14T18:14:02.407 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.364+0000 7ff23d317700 1 -- 172.21.15.163:0/3135137251 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff23802c8e0 con 0x7ff2380fedd0 2023-07-14T18:14:02.408 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.365+0000 7ff21ffff700 1 -- 172.21.15.163:0/3135137251 <== mon.0 v2:172.21.15.163:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) v1 ==== 94+0+10901 (secure 0 0 0) 0x7ff22800bd60 con 0x7ff2380fedd0 2023-07-14T18:14:02.408 INFO:teuthology.orchestra.run.smithi163.stdout: 2023-07-14T18:14:02.408 INFO:teuthology.orchestra.run.smithi163.stdout:{"epoch":29,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14562,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.163:6835/1058662632","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6834","nonce":1058662632},{"type":"v1","addr":"172.21.15.163:6835","nonce":1058662632}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":14568,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.163:6837/1107244425","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6836","nonce":1107244425},{"type":"v1","addr":"172.21.15.163:6837","nonce":1107244425}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":29,"flags":178,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"balance_automate":true},"ever_allowed_features":160,"explicitly_allowed_features":160,"created":"2023-07-14T18:11:09.109693+0000","modified":"2023-07-14T18:12:47.779723+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24518,"mds_1":24493,"mds_2":24479,"mds_3":24478,"mds_4":14652},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14640":{"gid":14640,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.163:6839/1337572937","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6838","nonce":1337572937},{"type":"v1","addr":"172.21.15.163:6839","nonce":1337572937}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_14652":{"gid":14652,"name":"a","rank":4,"incarnation":26,"state":"up:active","state_seq":9,"addr":"172.21.15.163:6841/1032082642","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6840","nonce":1032082642},{"type":"v1","addr":"172.21.15.163:6841","nonce":1032082642}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24421":{"gid":24421,"name":"l","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.184:6833/797722972","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6832","nonce":797722972},{"type":"v1","addr":"172.21.15.184:6833","nonce":797722972}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24431":{"gid":24431,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6833/1075696311","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":1075696311},{"type":"v1","addr":"172.21.15.172:6833","nonce":1075696311}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24458":{"gid":24458,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6835/1158120127","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":1158120127},{"type":"v1","addr":"172.21.15.172:6835","nonce":1158120127}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24466":{"gid":24466,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.184:6835/460134263","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6834","nonce":460134263},{"type":"v1","addr":"172.21.15.184:6835","nonce":460134263}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24478":{"gid":24478,"name":"c","rank":3,"incarnation":24,"state":"up:active","state_seq":11,"addr":"172.21.15.184:6837/3389277679","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6836","nonce":3389277679},{"type":"v1","addr":"172.21.15.184:6837","nonce":3389277679}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24479":{"gid":24479,"name":"h","rank":2,"incarnation":22,"state":"up:active","state_seq":10,"addr":"172.21.15.172:6837/3783835012","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":3783835012},{"type":"v1","addr":"172.21.15.172:6837","nonce":3783835012}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24493":{"gid":24493,"name":"i","rank":1,"incarnation":20,"state":"up:active","state_seq":9,"addr":"172.21.15.184:6839/2819059257","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6838","nonce":2819059257},{"type":"v1","addr":"172.21.15.184:6839","nonce":2819059257}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24518":{"gid":24518,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.172:6839/3850440096","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6838","nonce":3850440096},{"type":"v1","addr":"172.21.15.172:6839","nonce":3850440096}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-07-14T18:14:02.410 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.367+0000 7ff23d317700 1 -- 172.21.15.163:0/3135137251 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7ff2200a11a0 msgr2=0x7ff2200a3650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:14:02.410 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.367+0000 7ff23d317700 1 --2- 172.21.15.163:0/3135137251 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7ff2200a11a0 0x7ff2200a3650 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7ff22c006010 tx=0x7ff22c005960 comp rx=0 tx=0).stop 2023-07-14T18:14:02.410 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.367+0000 7ff23d317700 1 -- 172.21.15.163:0/3135137251 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff2380fedd0 msgr2=0x7ff238102e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:14:02.410 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.367+0000 7ff23d317700 1 --2- 172.21.15.163:0/3135137251 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff2380fedd0 0x7ff238102e40 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7ff22800d980 tx=0x7ff22800dc90 comp rx=0 tx=0).stop 2023-07-14T18:14:02.410 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.367+0000 7ff23d317700 1 -- 172.21.15.163:0/3135137251 shutdown_connections 2023-07-14T18:14:02.411 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.367+0000 7ff23d317700 1 --2- 172.21.15.163:0/3135137251 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7ff2200a11a0 0x7ff2200a3650 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:02.411 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.367+0000 7ff23d317700 1 --2- 172.21.15.163:0/3135137251 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff238100130 0x7ff2381019c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:02.411 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.367+0000 7ff23d317700 1 --2- 172.21.15.163:0/3135137251 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff2380fedd0 0x7ff238102e40 unknown :-1 s=CLOSED pgs=607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:02.411 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.367+0000 7ff23d317700 1 --2- 172.21.15.163:0/3135137251 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff2380ff760 0x7ff238101480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:02.411 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.367+0000 7ff23d317700 1 -- 172.21.15.163:0/3135137251 >> 172.21.15.163:0/3135137251 conn(0x7ff2380f98d0 msgr2=0x7ff2380fbad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:14:02.411 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.367+0000 7ff23d317700 1 -- 172.21.15.163:0/3135137251 shutdown_connections 2023-07-14T18:14:02.411 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.367+0000 7ff23d317700 1 -- 172.21.15.163:0/3135137251 wait complete. 2023-07-14T18:14:02.412 INFO:teuthology.orchestra.run.smithi163.stderr:dumped fsmap epoch 29 2023-07-14T18:14:02.422 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:4 damage ls 2023-07-14T18:14:02.545 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.502+0000 7f3effabd700 1 -- 172.21.15.163:0/2067310031 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f3ef80ffd30 msgr2=0x7f3ef81001a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:14:02.545 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.502+0000 7f3effabd700 1 --2- 172.21.15.163:0/2067310031 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f3ef80ffd30 0x7f3ef81001a0 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f3ef4009990 tx=0x7f3ef4009ca0 comp rx=0 tx=0).stop 2023-07-14T18:14:02.546 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.502+0000 7f3effabd700 1 -- 172.21.15.163:0/2067310031 shutdown_connections 2023-07-14T18:14:02.546 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.502+0000 7f3effabd700 1 --2- 172.21.15.163:0/2067310031 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3ef81006e0 0x7f3ef8106f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:02.546 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.502+0000 7f3effabd700 1 --2- 172.21.15.163:0/2067310031 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3ef80ff020 0x7f3ef80ff430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:02.546 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.502+0000 7f3effabd700 1 --2- 172.21.15.163:0/2067310031 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f3ef80ffd30 0x7f3ef81001a0 unknown :-1 s=CLOSED pgs=608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:02.546 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.502+0000 7f3effabd700 1 -- 172.21.15.163:0/2067310031 >> 172.21.15.163:0/2067310031 conn(0x7f3ef80f98a0 msgr2=0x7f3ef80fbcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:14:02.546 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.502+0000 7f3effabd700 1 -- 172.21.15.163:0/2067310031 shutdown_connections 2023-07-14T18:14:02.546 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.502+0000 7f3effabd700 1 -- 172.21.15.163:0/2067310031 wait complete. 2023-07-14T18:14:02.548 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.503+0000 7f3effabd700 1 Processor -- start 2023-07-14T18:14:02.548 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.503+0000 7f3effabd700 1 -- start start 2023-07-14T18:14:02.548 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.503+0000 7f3effabd700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3ef80ff020 0x7f3ef8194780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:14:02.549 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.503+0000 7f3effabd700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f3ef80ffd30 0x7f3ef8194cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:14:02.549 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.503+0000 7f3effabd700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3ef81006e0 0x7f3ef819bd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:14:02.549 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.503+0000 7f3effabd700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ef819c300 con 0x7f3ef80ffd30 2023-07-14T18:14:02.549 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.503+0000 7f3effabd700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ef819c440 con 0x7f3ef81006e0 2023-07-14T18:14:02.549 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.503+0000 7f3effabd700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ef819c5d0 con 0x7f3ef80ff020 2023-07-14T18:14:02.549 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.503+0000 7f3efd058700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f3ef80ffd30 0x7f3ef8194cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:14:02.549 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.503+0000 7f3efd058700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f3ef80ffd30 0x7f3ef8194cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:58834/0 (socket says 172.21.15.163:58834) 2023-07-14T18:14:02.549 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.503+0000 7f3efd058700 1 -- 172.21.15.163:0/3209899446 learned_addr learned my addr 172.21.15.163:0/3209899446 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:14:02.550 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.503+0000 7f3efd859700 1 --2- 172.21.15.163:0/3209899446 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3ef80ff020 0x7f3ef8194780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:14:02.550 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.503+0000 7f3efe05a700 1 --2- 172.21.15.163:0/3209899446 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3ef81006e0 0x7f3ef819bd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:14:02.550 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.503+0000 7f3efd058700 1 -- 172.21.15.163:0/3209899446 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3ef80ff020 msgr2=0x7f3ef8194780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:14:02.550 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.503+0000 7f3efd058700 1 --2- 172.21.15.163:0/3209899446 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3ef80ff020 0x7f3ef8194780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:02.550 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.503+0000 7f3efd058700 1 -- 172.21.15.163:0/3209899446 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3ef81006e0 msgr2=0x7f3ef819bd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:14:02.550 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.503+0000 7f3efd058700 1 --2- 172.21.15.163:0/3209899446 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3ef81006e0 0x7f3ef819bd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:02.550 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.503+0000 7f3efd058700 1 -- 172.21.15.163:0/3209899446 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ef40095f0 con 0x7f3ef80ffd30 2023-07-14T18:14:02.551 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.503+0000 7f3efe05a700 1 --2- 172.21.15.163:0/3209899446 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3ef81006e0 0x7f3ef819bd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T18:14:02.551 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.503+0000 7f3efd058700 1 --2- 172.21.15.163:0/3209899446 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f3ef80ffd30 0x7f3ef8194cc0 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f3ef40059d0 tx=0x7f3ef4004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:14:02.551 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.503+0000 7f3eeeffd700 1 -- 172.21.15.163:0/3209899446 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ef401d070 con 0x7f3ef80ffd30 2023-07-14T18:14:02.551 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.503+0000 7f3eeeffd700 1 -- 172.21.15.163:0/3209899446 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f3ef400beb0 con 0x7f3ef80ffd30 2023-07-14T18:14:02.551 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.503+0000 7f3effabd700 1 -- 172.21.15.163:0/3209899446 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ef819c850 con 0x7f3ef80ffd30 2023-07-14T18:14:02.551 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.504+0000 7f3eeeffd700 1 -- 172.21.15.163:0/3209899446 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ef4022e40 con 0x7f3ef80ffd30 2023-07-14T18:14:02.551 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.504+0000 7f3effabd700 1 -- 172.21.15.163:0/3209899446 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ef819ccd0 con 0x7f3ef80ffd30 2023-07-14T18:14:02.556 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.506+0000 7f3eeeffd700 1 -- 172.21.15.163:0/3209899446 <== mon.0 v2:172.21.15.163:3300/0 4 ==== mgrmap(e 18) v1 ==== 135716+0+0 (secure 0 0 0) 0x7f3ef4022600 con 0x7f3ef80ffd30 2023-07-14T18:14:02.556 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.506+0000 7f3eeeffd700 1 --2- 172.21.15.163:0/3209899446 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f3ee40a11d0 0x7f3ee40a3680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:14:02.556 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.506+0000 7f3efd859700 1 --2- 172.21.15.163:0/3209899446 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f3ee40a11d0 0x7f3ee40a3680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:14:02.556 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.506+0000 7f3eeeffd700 1 -- 172.21.15.163:0/3209899446 <== mon.0 v2:172.21.15.163:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 9049+0+0 (secure 0 0 0) 0x7f3ef40ce140 con 0x7f3ef80ffd30 2023-07-14T18:14:02.556 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.507+0000 7f3efd859700 1 --2- 172.21.15.163:0/3209899446 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f3ee40a11d0 0x7f3ee40a3680 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f3ef8067310 tx=0x7f3ee8009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:14:02.556 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.507+0000 7f3f0bc55b80 1 Processor -- start 2023-07-14T18:14:02.557 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.507+0000 7f3f0bc55b80 1 -- start start 2023-07-14T18:14:02.557 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.507+0000 7f3f0bc55b80 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x56134fd8cf60 0x56134fd8d370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:14:02.557 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.507+0000 7f3f0bc55b80 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56134fd8d8b0 0x56134fd8ded0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:14:02.557 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.507+0000 7f3f0bc55b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56134fd8e4b0 0x56134fd8e920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:14:02.557 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.507+0000 7f3f0bc55b80 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x56134fc91cb0 con 0x56134fd8cf60 2023-07-14T18:14:02.557 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.507+0000 7f3f0bc55b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x56134fce4a40 con 0x56134fd8e4b0 2023-07-14T18:14:02.557 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.507+0000 7f3f0bc55b80 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x56134fcdded0 con 0x56134fd8d8b0 2023-07-14T18:14:02.558 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.508+0000 7f3efd859700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x56134fd8cf60 0x56134fd8d370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:14:02.558 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.508+0000 7f3efd859700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x56134fd8cf60 0x56134fd8d370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:58840/0 (socket says 172.21.15.163:58840) 2023-07-14T18:14:02.558 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.508+0000 7f3efd859700 1 -- 172.21.15.163:0/3444195706 learned_addr learned my addr 172.21.15.163:0/3444195706 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:14:02.558 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.508+0000 7f3efd058700 1 --2- 172.21.15.163:0/3444195706 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56134fd8d8b0 0x56134fd8ded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:14:02.558 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.508+0000 7f3efe05a700 1 --2- 172.21.15.163:0/3444195706 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56134fd8e4b0 0x56134fd8e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:14:02.558 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.508+0000 7f3efd859700 1 -- 172.21.15.163:0/3444195706 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56134fd8d8b0 msgr2=0x56134fd8ded0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:14:02.558 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.508+0000 7f3efd859700 1 --2- 172.21.15.163:0/3444195706 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56134fd8d8b0 0x56134fd8ded0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:02.558 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.508+0000 7f3efd859700 1 -- 172.21.15.163:0/3444195706 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56134fd8e4b0 msgr2=0x56134fd8e920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:14:02.559 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.508+0000 7f3efd859700 1 --2- 172.21.15.163:0/3444195706 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56134fd8e4b0 0x56134fd8e920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:02.559 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.508+0000 7f3efd859700 1 -- 172.21.15.163:0/3444195706 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56134fb0bde0 con 0x56134fd8cf60 2023-07-14T18:14:02.559 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.508+0000 7f3efd859700 1 --2- 172.21.15.163:0/3444195706 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x56134fd8cf60 0x56134fd8d370 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f3ee8011d50 tx=0x7f3ee8014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe2a92eac1808fc7 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:14:02.559 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.508+0000 7f3ee3fff700 1 -- 172.21.15.163:0/3444195706 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ee800ed20 con 0x56134fd8cf60 2023-07-14T18:14:02.559 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.508+0000 7f3ee3fff700 1 -- 172.21.15.163:0/3444195706 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f3ee8021070 con 0x56134fd8cf60 2023-07-14T18:14:02.559 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.508+0000 7f3ee3fff700 1 -- 172.21.15.163:0/3444195706 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ee801d410 con 0x56134fd8cf60 2023-07-14T18:14:02.559 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.509+0000 7f3f0bc55b80 1 -- 172.21.15.163:0/3444195706 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x56134fd8cf60 msgr2=0x56134fd8d370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:14:02.559 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.509+0000 7f3f0bc55b80 1 --2- 172.21.15.163:0/3444195706 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x56134fd8cf60 0x56134fd8d370 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f3ee8011d50 tx=0x7f3ee8014000 comp rx=0 tx=0).stop 2023-07-14T18:14:02.560 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.509+0000 7f3f0bc55b80 1 -- 172.21.15.163:0/3444195706 shutdown_connections 2023-07-14T18:14:02.560 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.509+0000 7f3f0bc55b80 1 --2- 172.21.15.163:0/3444195706 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56134fd8e4b0 0x56134fd8e920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:02.560 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.509+0000 7f3f0bc55b80 1 --2- 172.21.15.163:0/3444195706 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x56134fd8cf60 0x56134fd8d370 unknown :-1 s=CLOSED pgs=610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:02.560 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.509+0000 7f3f0bc55b80 1 --2- 172.21.15.163:0/3444195706 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56134fd8d8b0 0x56134fd8ded0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:02.560 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.509+0000 7f3f0bc55b80 1 -- 172.21.15.163:0/3444195706 >> 172.21.15.163:0/3444195706 conn(0x56134fd82680 msgr2=0x56134fd879d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:14:02.560 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.509+0000 7f3f0bc55b80 1 -- 172.21.15.163:0/3444195706 shutdown_connections 2023-07-14T18:14:02.560 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.509+0000 7f3f0bc55b80 1 -- 172.21.15.163:0/3444195706 wait complete. 2023-07-14T18:14:02.560 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.509+0000 7f3f0bc55b80 1 -- start start 2023-07-14T18:14:02.561 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.509+0000 7f3f0bc55b80 1 Processor -- start 2023-07-14T18:14:02.561 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.510+0000 7f3f0bc55b80 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x56134fd8cf60 0x56134fd96970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:14:02.561 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.510+0000 7f3f0bc55b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56134fd8d8b0 0x56134fd96eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:14:02.561 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.510+0000 7f3f0bc55b80 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56134fd8e4b0 0x56134fd9def0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:14:02.561 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.510+0000 7f3f0bc55b80 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x56134fc7dac0 con 0x56134fd8cf60 2023-07-14T18:14:02.561 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.510+0000 7f3f0bc55b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x56134fc7d7c0 con 0x56134fd8d8b0 2023-07-14T18:14:02.561 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.510+0000 7f3f0bc55b80 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x56134fb61920 con 0x56134fd8e4b0 2023-07-14T18:14:02.562 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.510+0000 7f3f0bc55b80 10 client.0 _ll_register_callbacks cb 0x56134fc7b760 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T18:14:02.562 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.510+0000 7f3efd859700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x56134fd8cf60 0x56134fd96970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:14:02.562 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.510+0000 7f3efd859700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x56134fd8cf60 0x56134fd96970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:58846/0 (socket says 172.21.15.163:58846) 2023-07-14T18:14:02.562 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.510+0000 7f3efd859700 1 -- 172.21.15.163:0/3342355201 learned_addr learned my addr 172.21.15.163:0/3342355201 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:14:02.562 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.510+0000 7f3efe05a700 1 --2- 172.21.15.163:0/3342355201 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56134fd8e4b0 0x56134fd9def0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:14:02.562 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.510+0000 7f3efd058700 1 --2- 172.21.15.163:0/3342355201 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56134fd8d8b0 0x56134fd96eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:14:02.562 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.510+0000 7f3efd859700 1 -- 172.21.15.163:0/3342355201 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56134fd8e4b0 msgr2=0x56134fd9def0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:14:02.562 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.510+0000 7f3efd859700 1 --2- 172.21.15.163:0/3342355201 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56134fd8e4b0 0x56134fd9def0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:02.563 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.510+0000 7f3efd859700 1 -- 172.21.15.163:0/3342355201 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56134fd8d8b0 msgr2=0x56134fd96eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:14:02.563 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.510+0000 7f3efd859700 1 --2- 172.21.15.163:0/3342355201 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56134fd8d8b0 0x56134fd96eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:02.563 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.510+0000 7f3efd859700 1 -- 172.21.15.163:0/3342355201 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ee8017070 con 0x56134fd8cf60 2023-07-14T18:14:02.563 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.510+0000 7f3efe05a700 1 --2- 172.21.15.163:0/3342355201 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56134fd8e4b0 0x56134fd9def0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T18:14:02.563 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.510+0000 7f3efd859700 1 --2- 172.21.15.163:0/3342355201 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x56134fd8cf60 0x56134fd96970 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f3ee801ce60 tx=0x7f3ee801ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ad85751773be66 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:14:02.563 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.510+0000 7f3ee17fa700 10 client.0 ms_handle_connect on v2:172.21.15.163:3300/0 2023-07-14T18:14:02.563 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.511+0000 7f3ee17fa700 1 -- 172.21.15.163:0/3342355201 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ee801c410 con 0x56134fd8cf60 2023-07-14T18:14:02.563 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.511+0000 7f3ee17fa700 1 -- 172.21.15.163:0/3342355201 <== mon.0 v2:172.21.15.163:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 9049+0+0 (secure 0 0 0) 0x7f3ee801c570 con 0x56134fd8cf60 2023-07-14T18:14:02.564 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.511+0000 7f3f0bc55b80 1 -- 172.21.15.163:0/3342355201 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56134fc374f0 con 0x56134fd8cf60 2023-07-14T18:14:02.564 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.511+0000 7f3ee17fa700 1 -- 172.21.15.163:0/3342355201 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3ee801c730 con 0x56134fd8cf60 2023-07-14T18:14:02.564 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.511+0000 7f3f0bc55b80 10 client.15993 fetch_fsmap learned FSMap version 29 2023-07-14T18:14:02.564 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.511+0000 7f3f0bc55b80 1 -- 172.21.15.163:0/3342355201 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) v3 -- 0x56134faf4c60 con 0x56134fd8cf60 2023-07-14T18:14:02.564 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.511+0000 7f3ee17fa700 1 -- 172.21.15.163:0/3342355201 <== mon.0 v2:172.21.15.163:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x56134fc374f0 con 0x56134fd8cf60 2023-07-14T18:14:02.564 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.511+0000 7f3ee17fa700 1 -- 172.21.15.163:0/3342355201 <== mon.0 v2:172.21.15.163:3300/0 5 ==== fsmap(e 29) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f3ee8004950 con 0x56134fd8cf60 2023-07-14T18:14:02.564 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.511+0000 7f3f0bc55b80 10 client.15993 fetch_fsmap finished waiting for FSMap version 29 2023-07-14T18:14:02.565 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.511+0000 7f3f0bc55b80 10 client.15993 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.a 2023-07-14T18:14:02.565 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.511+0000 7f3f0bc55b80 20 client.15993 populate_metadata read hostname 'smithi163' 2023-07-14T18:14:02.565 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.511+0000 7f3f0bc55b80 1 --2- 172.21.15.163:0/3342355201 >> [v2:172.21.15.163:6840/1032082642,v1:172.21.15.163:6841/1032082642] conn(0x56134fda2630 0x56134fda4a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:14:02.565 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.511+0000 7f3f0bc55b80 4 client.15993 mds_command: new command op to 14652 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-14T18:14:02.565 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.511+0000 7f3f0bc55b80 1 -- 172.21.15.163:0/3342355201 --> [v2:172.21.15.163:6840/1032082642,v1:172.21.15.163:6841/1032082642] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x56134fd5bda0 con 0x56134fda2630 2023-07-14T18:14:02.565 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.511+0000 7f3efd058700 1 --2- 172.21.15.163:0/3342355201 >> [v2:172.21.15.163:6840/1032082642,v1:172.21.15.163:6841/1032082642] conn(0x56134fda2630 0x56134fda4a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:14:02.565 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.511+0000 7f3ee17fa700 10 client.15993 ms_handle_connect on v2:172.21.15.163:6840/1032082642 2023-07-14T18:14:02.565 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.511+0000 7f3efd058700 1 --2- 172.21.15.163:0/3342355201 >> [v2:172.21.15.163:6840/1032082642,v1:172.21.15.163:6841/1032082642] conn(0x56134fda2630 0x56134fda4a40 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=3be0b29c4a5a7775 server_cookie=925c9201ad7b5a9b in_seq=0 out_seq=0 2023-07-14T18:14:02.566 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.512+0000 7f3ee17fa700 1 -- 172.21.15.163:0/3342355201 <== mds.4 v2:172.21.15.163:6840/1032082642 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18017 (crc 0 0 0) 0x56134fd5bda0 con 0x56134fda2630 2023-07-14T18:14:02.566 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.512+0000 7f3ee17fa700 10 client.15993 handle_command_reply: tid=0 2023-07-14T18:14:02.566 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.512+0000 7f3f0bc55b80 1 client.15993 shutdown 2023-07-14T18:14:02.566 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.512+0000 7f3f0bc55b80 1 -- 172.21.15.163:0/3342355201 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x56134fd8cf60 msgr2=0x56134fd96970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:14:02.566 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.512+0000 7f3f0bc55b80 1 --2- 172.21.15.163:0/3342355201 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x56134fd8cf60 0x56134fd96970 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f3ee801ce60 tx=0x7f3ee801ce90 comp rx=0 tx=0).stop 2023-07-14T18:14:02.566 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.512+0000 7f3f0bc55b80 1 -- 172.21.15.163:0/3342355201 shutdown_connections 2023-07-14T18:14:02.566 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.512+0000 7f3f0bc55b80 1 --2- 172.21.15.163:0/3342355201 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56134fd8e4b0 0x56134fd9def0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:02.566 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.512+0000 7f3f0bc55b80 1 --2- 172.21.15.163:0/3342355201 >> [v2:172.21.15.163:6840/1032082642,v1:172.21.15.163:6841/1032082642] conn(0x56134fda2630 0x56134fda4a40 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:02.567 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.512+0000 7f3f0bc55b80 1 --2- 172.21.15.163:0/3342355201 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x56134fd8cf60 0x56134fd96970 unknown :-1 s=CLOSED pgs=611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:02.567 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.512+0000 7f3ee17fa700 0 client.15993 ms_handle_reset on v2:172.21.15.163:6840/1032082642 2023-07-14T18:14:02.567 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.512+0000 7f3f0bc55b80 1 --2- 172.21.15.163:0/3342355201 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56134fd8d8b0 0x56134fd96eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:02.567 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.512+0000 7f3f0bc55b80 1 -- 172.21.15.163:0/3342355201 >> 172.21.15.163:0/3342355201 conn(0x56134fd82680 msgr2=0x56134fd86650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:14:02.567 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.512+0000 7f3f0bc55b80 1 -- 172.21.15.163:0/3342355201 shutdown_connections 2023-07-14T18:14:02.567 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.512+0000 7f3f0bc55b80 1 -- 172.21.15.163:0/3342355201 wait complete. 2023-07-14T18:14:02.567 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.512+0000 7f3f0bc55b80 20 client.15993 trim_cache size 0 max 16384 2023-07-14T18:14:02.569 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.525+0000 7f3f0bc55b80 1 Processor -- start 2023-07-14T18:14:02.569 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.525+0000 7f3f0bc55b80 1 -- start start 2023-07-14T18:14:02.569 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.525+0000 7f3f0bc55b80 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56134fd8cf60 0x56134fd96020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:14:02.569 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.525+0000 7f3f0bc55b80 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x56134fd8d8b0 0x56134fd9deb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:14:02.569 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.525+0000 7f3f0bc55b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56134fd8e4b0 0x56134fd8e880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:14:02.569 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.525+0000 7f3f0bc55b80 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x56134fd88e10 con 0x56134fd8d8b0 2023-07-14T18:14:02.570 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.525+0000 7f3f0bc55b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x56134fda2330 con 0x56134fd8e4b0 2023-07-14T18:14:02.570 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.525+0000 7f3f0bc55b80 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x56134fd89450 con 0x56134fd8cf60 2023-07-14T18:14:02.570 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.525+0000 7f3efd058700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x56134fd8d8b0 0x56134fd9deb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:14:02.570 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.525+0000 7f3efd058700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x56134fd8d8b0 0x56134fd9deb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:58856/0 (socket says 172.21.15.163:58856) 2023-07-14T18:14:02.570 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.525+0000 7f3efd058700 1 -- 172.21.15.163:0/2767384587 learned_addr learned my addr 172.21.15.163:0/2767384587 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:14:02.570 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.526+0000 7f3efe05a700 1 --2- 172.21.15.163:0/2767384587 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56134fd8e4b0 0x56134fd8e880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:14:02.570 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.526+0000 7f3efd859700 1 --2- 172.21.15.163:0/2767384587 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56134fd8cf60 0x56134fd96020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:14:02.571 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.526+0000 7f3efd058700 1 -- 172.21.15.163:0/2767384587 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56134fd8cf60 msgr2=0x56134fd96020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:14:02.571 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.526+0000 7f3efd058700 1 --2- 172.21.15.163:0/2767384587 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56134fd8cf60 0x56134fd96020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:02.571 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.526+0000 7f3efd058700 1 -- 172.21.15.163:0/2767384587 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56134fd8e4b0 msgr2=0x56134fd8e880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:14:02.571 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.526+0000 7f3efd058700 1 --2- 172.21.15.163:0/2767384587 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56134fd8e4b0 0x56134fd8e880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:02.571 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.526+0000 7f3efd058700 1 -- 172.21.15.163:0/2767384587 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56134fb32250 con 0x56134fd8d8b0 2023-07-14T18:14:02.571 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.526+0000 7f3efd058700 1 --2- 172.21.15.163:0/2767384587 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x56134fd8d8b0 0x56134fd9deb0 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f3ef4005910 tx=0x7f3ef401a040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=67c25e6ff4844f0d server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:14:02.571 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.526+0000 7f3eecdaa700 1 -- 172.21.15.163:0/2767384587 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ef409f0b0 con 0x56134fd8d8b0 2023-07-14T18:14:02.571 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.526+0000 7f3eecdaa700 1 -- 172.21.15.163:0/2767384587 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f3ef409b2b0 con 0x56134fd8d8b0 2023-07-14T18:14:02.572 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.526+0000 7f3eecdaa700 1 -- 172.21.15.163:0/2767384587 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ef40a10b0 con 0x56134fd8d8b0 2023-07-14T18:14:02.575 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.527+0000 7f3f0bc55b80 1 -- 172.21.15.163:0/2767384587 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x56134fd8d8b0 msgr2=0x56134fd9deb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:14:02.575 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.527+0000 7f3f0bc55b80 1 --2- 172.21.15.163:0/2767384587 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x56134fd8d8b0 0x56134fd9deb0 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f3ef4005910 tx=0x7f3ef401a040 comp rx=0 tx=0).stop 2023-07-14T18:14:02.575 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.527+0000 7f3f0bc55b80 1 -- 172.21.15.163:0/2767384587 shutdown_connections 2023-07-14T18:14:02.575 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.527+0000 7f3f0bc55b80 1 --2- 172.21.15.163:0/2767384587 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56134fd8cf60 0x56134fd96020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:02.575 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.527+0000 7f3f0bc55b80 1 --2- 172.21.15.163:0/2767384587 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56134fd8e4b0 0x56134fd8e880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:02.576 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.527+0000 7f3f0bc55b80 1 --2- 172.21.15.163:0/2767384587 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x56134fd8d8b0 0x56134fd9deb0 unknown :-1 s=CLOSED pgs=612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:02.576 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.527+0000 7f3f0bc55b80 1 -- 172.21.15.163:0/2767384587 >> 172.21.15.163:0/2767384587 conn(0x56134fd82680 msgr2=0x56134fd95670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:14:02.576 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.527+0000 7f3f0bc55b80 1 -- 172.21.15.163:0/2767384587 shutdown_connections 2023-07-14T18:14:02.576 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.527+0000 7f3f0bc55b80 1 -- 172.21.15.163:0/2767384587 wait complete. 2023-07-14T18:14:02.576 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.527+0000 7f3f0bc55b80 1 -- start start 2023-07-14T18:14:02.576 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.527+0000 7f3f0bc55b80 1 Processor -- start 2023-07-14T18:14:02.576 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.527+0000 7f3f0bc55b80 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56134fd8cf60 0x56134fd999d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:14:02.576 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.527+0000 7f3f0bc55b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56134fd8d8b0 0x56134fd99f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:14:02.577 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.527+0000 7f3f0bc55b80 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x56134fd8e4b0 0x56134fd9cf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:14:02.577 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.527+0000 7f3f0bc55b80 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x56134fd9d470 con 0x56134fd8e4b0 2023-07-14T18:14:02.577 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.527+0000 7f3f0bc55b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x56134fd9d5e0 con 0x56134fd8d8b0 2023-07-14T18:14:02.577 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.527+0000 7f3f0bc55b80 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x56134fd9d7a0 con 0x56134fd8cf60 2023-07-14T18:14:02.577 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.527+0000 7f3f0bc55b80 10 client.0 _ll_register_callbacks cb 0x7f3ef0009270 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T18:14:02.577 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.528+0000 7f3efe05a700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x56134fd8e4b0 0x56134fd9cf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:14:02.577 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.528+0000 7f3efe05a700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x56134fd8e4b0 0x56134fd9cf30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:58864/0 (socket says 172.21.15.163:58864) 2023-07-14T18:14:02.578 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.528+0000 7f3efd058700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56134fd8d8b0 0x56134fd99f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:14:02.578 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.528+0000 7f3efe05a700 1 -- 172.21.15.163:0/2498863789 learned_addr learned my addr 172.21.15.163:0/2498863789 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:14:02.578 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.528+0000 7f3efd859700 1 --2- 172.21.15.163:0/2498863789 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56134fd8cf60 0x56134fd999d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:14:02.578 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.528+0000 7f3efd058700 1 -- 172.21.15.163:0/2498863789 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56134fd8cf60 msgr2=0x56134fd999d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:14:02.578 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.528+0000 7f3efd058700 1 --2- 172.21.15.163:0/2498863789 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56134fd8cf60 0x56134fd999d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:02.578 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.528+0000 7f3efd058700 1 -- 172.21.15.163:0/2498863789 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x56134fd8e4b0 msgr2=0x56134fd9cf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:14:02.578 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.528+0000 7f3efd058700 1 --2- 172.21.15.163:0/2498863789 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x56134fd8e4b0 0x56134fd9cf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:02.578 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.528+0000 7f3efd058700 1 -- 172.21.15.163:0/2498863789 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ef819ccd0 con 0x56134fd8d8b0 2023-07-14T18:14:02.579 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.528+0000 7f3efe05a700 1 --2- 172.21.15.163:0/2498863789 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x56134fd8e4b0 0x56134fd9cf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T18:14:02.579 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.528+0000 7f3efd058700 1 --2- 172.21.15.163:0/2498863789 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56134fd8d8b0 0x56134fd99f10 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f3ef4005910 tx=0x7f3ef409b7f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=67ae5d8fb2492c93 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:14:02.579 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.528+0000 7f3ee17fa700 10 client.0 ms_handle_connect on v2:172.21.15.172:3300/0 2023-07-14T18:14:02.579 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.528+0000 7f3ee17fa700 1 -- 172.21.15.163:0/2498863789 <== mon.2 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ef409f2e0 con 0x56134fd8d8b0 2023-07-14T18:14:02.579 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.528+0000 7f3f0bc55b80 1 -- 172.21.15.163:0/2498863789 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f3ee8021070 con 0x56134fd8d8b0 2023-07-14T18:14:02.579 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.528+0000 7f3ee17fa700 1 -- 172.21.15.163:0/2498863789 <== mon.2 v2:172.21.15.172:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 9049+0+0 (secure 0 0 0) 0x7f3ef409a7a0 con 0x56134fd8d8b0 2023-07-14T18:14:02.579 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.528+0000 7f3ee17fa700 1 -- 172.21.15.163:0/2498863789 <== mon.2 v2:172.21.15.172:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3ef409a960 con 0x56134fd8d8b0 2023-07-14T18:14:02.579 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.528+0000 7f3f0bc55b80 10 client.25637 fetch_fsmap learned FSMap version 29 2023-07-14T18:14:02.580 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.528+0000 7f3f0bc55b80 1 -- 172.21.15.163:0/2498863789 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) v3 -- 0x56134fb0a2b0 con 0x56134fd8d8b0 2023-07-14T18:14:02.580 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.529+0000 7f3ee17fa700 1 -- 172.21.15.163:0/2498863789 <== mon.2 v2:172.21.15.172:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f3ee8021070 con 0x56134fd8d8b0 2023-07-14T18:14:02.580 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.529+0000 7f3ee17fa700 1 -- 172.21.15.163:0/2498863789 <== mon.2 v2:172.21.15.172:3300/0 5 ==== fsmap(e 29) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f3ef4097130 con 0x56134fd8d8b0 2023-07-14T18:14:02.580 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.529+0000 7f3f0bc55b80 10 client.25637 fetch_fsmap finished waiting for FSMap version 29 2023-07-14T18:14:02.580 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.529+0000 7f3f0bc55b80 10 client.25637 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.a 2023-07-14T18:14:02.580 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.529+0000 7f3f0bc55b80 20 client.25637 populate_metadata read hostname 'smithi163' 2023-07-14T18:14:02.580 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.529+0000 7f3f0bc55b80 1 --2- 172.21.15.163:0/2498863789 >> [v2:172.21.15.163:6840/1032082642,v1:172.21.15.163:6841/1032082642] conn(0x56134fdf6bf0 0x56134fdf8fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:14:02.580 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.529+0000 7f3f0bc55b80 4 client.25637 mds_command: new command op to 14652 tid=0[{"prefix": "damage ls"}] 2023-07-14T18:14:02.581 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.529+0000 7f3f0bc55b80 1 -- 172.21.15.163:0/2498863789 --> [v2:172.21.15.163:6840/1032082642,v1:172.21.15.163:6841/1032082642] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x56134fcd6eb0 con 0x56134fdf6bf0 2023-07-14T18:14:02.581 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.529+0000 7f3efd859700 1 --2- 172.21.15.163:0/2498863789 >> [v2:172.21.15.163:6840/1032082642,v1:172.21.15.163:6841/1032082642] conn(0x56134fdf6bf0 0x56134fdf8fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:14:02.581 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.529+0000 7f3efd859700 1 --2- 172.21.15.163:0/2498863789 >> [v2:172.21.15.163:6840/1032082642,v1:172.21.15.163:6841/1032082642] conn(0x56134fdf6bf0 0x56134fdf8fd0 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=3f942435af5ade20 server_cookie=1615ac02f9499a2c in_seq=0 out_seq=0 2023-07-14T18:14:02.581 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.529+0000 7f3ee17fa700 10 client.25637 ms_handle_connect on v2:172.21.15.163:6840/1032082642 2023-07-14T18:14:02.581 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.529+0000 7f3ee17fa700 1 -- 172.21.15.163:0/2498863789 <== mds.4 v2:172.21.15.163:6840/1032082642 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x56134fcd6eb0 con 0x56134fdf6bf0 2023-07-14T18:14:02.581 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.529+0000 7f3ee17fa700 10 client.25637 handle_command_reply: tid=0 2023-07-14T18:14:02.581 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.529+0000 7f3f0bc55b80 1 client.25637 shutdown 2023-07-14T18:14:02.582 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.529+0000 7f3f0bc55b80 1 -- 172.21.15.163:0/2498863789 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56134fd8d8b0 msgr2=0x56134fd99f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:14:02.582 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.529+0000 7f3f0bc55b80 1 --2- 172.21.15.163:0/2498863789 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56134fd8d8b0 0x56134fd99f10 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f3ef4005910 tx=0x7f3ef409b7f0 comp rx=0 tx=0).stop 2023-07-14T18:14:02.582 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.530+0000 7f3f0bc55b80 1 -- 172.21.15.163:0/2498863789 shutdown_connections 2023-07-14T18:14:02.582 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.530+0000 7f3f0bc55b80 1 --2- 172.21.15.163:0/2498863789 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56134fd8cf60 0x56134fd999d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:02.582 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.530+0000 7f3f0bc55b80 1 --2- 172.21.15.163:0/2498863789 >> [v2:172.21.15.163:6840/1032082642,v1:172.21.15.163:6841/1032082642] conn(0x56134fdf6bf0 0x56134fdf8fd0 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:02.582 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.530+0000 7f3f0bc55b80 1 --2- 172.21.15.163:0/2498863789 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x56134fd8e4b0 0x56134fd9cf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:02.582 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.530+0000 7f3ee17fa700 0 client.25637 ms_handle_reset on v2:172.21.15.163:6840/1032082642 2023-07-14T18:14:02.582 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.530+0000 7f3f0bc55b80 1 --2- 172.21.15.163:0/2498863789 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56134fd8d8b0 0x56134fd99f10 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:02.583 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.530+0000 7f3f0bc55b80 1 -- 172.21.15.163:0/2498863789 >> 172.21.15.163:0/2498863789 conn(0x56134fd82680 msgr2=0x56134fd94890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:14:02.583 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.530+0000 7f3f0bc55b80 1 -- 172.21.15.163:0/2498863789 shutdown_connections 2023-07-14T18:14:02.583 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.530+0000 7f3f0bc55b80 1 -- 172.21.15.163:0/2498863789 wait complete. 2023-07-14T18:14:02.583 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.530+0000 7f3f0bc55b80 20 client.25637 trim_cache size 0 max 16384 2023-07-14T18:14:02.583 INFO:teuthology.orchestra.run.smithi163.stdout:[] 2023-07-14T18:14:02.584 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.530+0000 7f3effabd700 1 -- 172.21.15.163:0/3209899446 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f3ee40a11d0 msgr2=0x7f3ee40a3680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:14:02.585 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.530+0000 7f3effabd700 1 --2- 172.21.15.163:0/3209899446 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f3ee40a11d0 0x7f3ee40a3680 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f3ef8067310 tx=0x7f3ee8009260 comp rx=0 tx=0).stop 2023-07-14T18:14:02.585 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.530+0000 7f3effabd700 1 -- 172.21.15.163:0/3209899446 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f3ef80ffd30 msgr2=0x7f3ef8194cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:14:02.585 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.530+0000 7f3effabd700 1 --2- 172.21.15.163:0/3209899446 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f3ef80ffd30 0x7f3ef8194cc0 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f3ef40059d0 tx=0x7f3ef4004730 comp rx=0 tx=0).stop 2023-07-14T18:14:02.585 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.530+0000 7f3effabd700 1 -- 172.21.15.163:0/3209899446 shutdown_connections 2023-07-14T18:14:02.585 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.530+0000 7f3effabd700 1 --2- 172.21.15.163:0/3209899446 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f3ee40a11d0 0x7f3ee40a3680 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:02.585 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.530+0000 7f3effabd700 1 --2- 172.21.15.163:0/3209899446 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3ef80ff020 0x7f3ef8194780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:02.585 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.530+0000 7f3effabd700 1 --2- 172.21.15.163:0/3209899446 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3ef81006e0 0x7f3ef819bd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:02.586 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.530+0000 7f3effabd700 1 --2- 172.21.15.163:0/3209899446 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f3ef80ffd30 0x7f3ef8194cc0 unknown :-1 s=CLOSED pgs=609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:02.586 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.530+0000 7f3effabd700 1 -- 172.21.15.163:0/3209899446 >> 172.21.15.163:0/3209899446 conn(0x7f3ef80f98a0 msgr2=0x7f3ef80fbbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:14:02.586 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.530+0000 7f3effabd700 1 -- 172.21.15.163:0/3209899446 shutdown_connections 2023-07-14T18:14:02.586 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.530+0000 7f3effabd700 1 -- 172.21.15.163:0/3209899446 wait complete. 2023-07-14T18:14:02.586 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:3 damage ls 2023-07-14T18:14:02.710 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.667+0000 7f2e4b620700 1 -- 172.21.15.163:0/3514914750 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f2e44100f50 msgr2=0x7f2e441013a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:14:02.710 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.667+0000 7f2e4b620700 1 --2- 172.21.15.163:0/3514914750 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f2e44100f50 0x7f2e441013a0 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f2e40009990 tx=0x7f2e40009ca0 comp rx=0 tx=0).stop 2023-07-14T18:14:02.711 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.667+0000 7f2e4b620700 1 -- 172.21.15.163:0/3514914750 shutdown_connections 2023-07-14T18:14:02.711 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.667+0000 7f2e4b620700 1 --2- 172.21.15.163:0/3514914750 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2e440fdee0 0x7f2e440fe2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:02.711 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.667+0000 7f2e4b620700 1 --2- 172.21.15.163:0/3514914750 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2e441018e0 0x7f2e441081a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:02.711 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.667+0000 7f2e4b620700 1 --2- 172.21.15.163:0/3514914750 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f2e44100f50 0x7f2e441013a0 unknown :-1 s=CLOSED pgs=613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:02.711 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.667+0000 7f2e4b620700 1 -- 172.21.15.163:0/3514914750 >> 172.21.15.163:0/3514914750 conn(0x7f2e440f98a0 msgr2=0x7f2e440fbcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:14:02.711 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.667+0000 7f2e4b620700 1 -- 172.21.15.163:0/3514914750 shutdown_connections 2023-07-14T18:14:02.711 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.667+0000 7f2e4b620700 1 -- 172.21.15.163:0/3514914750 wait complete. 2023-07-14T18:14:02.712 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.667+0000 7f2e4b620700 1 Processor -- start 2023-07-14T18:14:02.712 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.668+0000 7f2e4b620700 1 -- start start 2023-07-14T18:14:02.713 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.668+0000 7f2e4b620700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2e440fdee0 0x7f2e44195910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:14:02.714 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.668+0000 7f2e4b620700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f2e44100f50 0x7f2e44195e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:14:02.714 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.668+0000 7f2e4b620700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2e441018e0 0x7f2e4419cec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:14:02.714 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.668+0000 7f2e4b620700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e4419d490 con 0x7f2e44100f50 2023-07-14T18:14:02.714 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.668+0000 7f2e4b620700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e4419d5d0 con 0x7f2e441018e0 2023-07-14T18:14:02.714 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.668+0000 7f2e4b620700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e4419d760 con 0x7f2e440fdee0 2023-07-14T18:14:02.715 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.668+0000 7f2e48bbb700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f2e44100f50 0x7f2e44195e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:14:02.715 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.668+0000 7f2e48bbb700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f2e44100f50 0x7f2e44195e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:58876/0 (socket says 172.21.15.163:58876) 2023-07-14T18:14:02.715 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.668+0000 7f2e48bbb700 1 -- 172.21.15.163:0/1825717849 learned_addr learned my addr 172.21.15.163:0/1825717849 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:14:02.715 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.668+0000 7f2e493bc700 1 --2- 172.21.15.163:0/1825717849 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2e440fdee0 0x7f2e44195910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:14:02.715 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.668+0000 7f2e49bbd700 1 --2- 172.21.15.163:0/1825717849 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2e441018e0 0x7f2e4419cec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:14:02.715 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.668+0000 7f2e48bbb700 1 -- 172.21.15.163:0/1825717849 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2e440fdee0 msgr2=0x7f2e44195910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:14:02.715 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.668+0000 7f2e48bbb700 1 --2- 172.21.15.163:0/1825717849 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2e440fdee0 0x7f2e44195910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:02.715 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.668+0000 7f2e48bbb700 1 -- 172.21.15.163:0/1825717849 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2e441018e0 msgr2=0x7f2e4419cec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:14:02.716 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.668+0000 7f2e48bbb700 1 --2- 172.21.15.163:0/1825717849 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2e441018e0 0x7f2e4419cec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:02.716 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.668+0000 7f2e48bbb700 1 -- 172.21.15.163:0/1825717849 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e400095f0 con 0x7f2e44100f50 2023-07-14T18:14:02.716 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.668+0000 7f2e49bbd700 1 --2- 172.21.15.163:0/1825717849 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2e441018e0 0x7f2e4419cec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T18:14:02.716 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.668+0000 7f2e48bbb700 1 --2- 172.21.15.163:0/1825717849 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f2e44100f50 0x7f2e44195e50 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f2e40006010 tx=0x7f2e40004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:14:02.716 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.668+0000 7f2e367fc700 1 -- 172.21.15.163:0/1825717849 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e4001d070 con 0x7f2e44100f50 2023-07-14T18:14:02.716 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.668+0000 7f2e4b620700 1 -- 172.21.15.163:0/1825717849 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e4419d9e0 con 0x7f2e44100f50 2023-07-14T18:14:02.716 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.668+0000 7f2e367fc700 1 -- 172.21.15.163:0/1825717849 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f2e40004080 con 0x7f2e44100f50 2023-07-14T18:14:02.717 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.668+0000 7f2e367fc700 1 -- 172.21.15.163:0/1825717849 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e40022c90 con 0x7f2e44100f50 2023-07-14T18:14:02.717 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.669+0000 7f2e4b620700 1 -- 172.21.15.163:0/1825717849 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e4419de00 con 0x7f2e44100f50 2023-07-14T18:14:02.717 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.671+0000 7f2e367fc700 1 -- 172.21.15.163:0/1825717849 <== mon.0 v2:172.21.15.163:3300/0 4 ==== mgrmap(e 18) v1 ==== 135716+0+0 (secure 0 0 0) 0x7f2e40022470 con 0x7f2e44100f50 2023-07-14T18:14:02.721 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.671+0000 7f2e367fc700 1 --2- 172.21.15.163:0/1825717849 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f2e300a1150 0x7f2e300a3600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:14:02.721 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.671+0000 7f2e493bc700 1 --2- 172.21.15.163:0/1825717849 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f2e300a1150 0x7f2e300a3600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:14:02.722 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.671+0000 7f2e367fc700 1 -- 172.21.15.163:0/1825717849 <== mon.0 v2:172.21.15.163:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 9049+0+0 (secure 0 0 0) 0x7f2e400cdeb0 con 0x7f2e44100f50 2023-07-14T18:14:02.722 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.672+0000 7f2e493bc700 1 --2- 172.21.15.163:0/1825717849 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f2e300a1150 0x7f2e300a3600 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f2e440674e0 tx=0x7f2e3800b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:14:02.722 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.672+0000 7f2e577b8b80 1 Processor -- start 2023-07-14T18:14:02.722 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.672+0000 7f2e577b8b80 1 -- start start 2023-07-14T18:14:02.722 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.672+0000 7f2e577b8b80 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55c3fa6aa320 0x55c3fa6aa730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:14:02.722 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.672+0000 7f2e577b8b80 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55c3fa6aac70 0x55c3fa6ab310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:14:02.722 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.672+0000 7f2e577b8b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c3fa6ab8a0 0x55c3fa6abd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:14:02.723 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.672+0000 7f2e577b8b80 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c3fa5aacb0 con 0x55c3fa6aa320 2023-07-14T18:14:02.723 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.672+0000 7f2e577b8b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c3fa5fda40 con 0x55c3fa6ab8a0 2023-07-14T18:14:02.723 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.672+0000 7f2e577b8b80 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c3fa5f6ed0 con 0x55c3fa6aac70 2023-07-14T18:14:02.723 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.672+0000 7f2e493bc700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55c3fa6aa320 0x55c3fa6aa730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:14:02.723 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.672+0000 7f2e493bc700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55c3fa6aa320 0x55c3fa6aa730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:58882/0 (socket says 172.21.15.163:58882) 2023-07-14T18:14:02.723 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.672+0000 7f2e493bc700 1 -- 172.21.15.163:0/4035217932 learned_addr learned my addr 172.21.15.163:0/4035217932 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:14:02.723 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.672+0000 7f2e49bbd700 1 --2- 172.21.15.163:0/4035217932 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c3fa6ab8a0 0x55c3fa6abd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:14:02.723 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.673+0000 7f2e493bc700 1 -- 172.21.15.163:0/4035217932 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55c3fa6aac70 msgr2=0x55c3fa6ab310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:14:02.724 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.673+0000 7f2e493bc700 1 --2- 172.21.15.163:0/4035217932 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55c3fa6aac70 0x55c3fa6ab310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:02.724 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.673+0000 7f2e493bc700 1 -- 172.21.15.163:0/4035217932 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c3fa6ab8a0 msgr2=0x55c3fa6abd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:14:02.724 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.673+0000 7f2e493bc700 1 --2- 172.21.15.163:0/4035217932 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c3fa6ab8a0 0x55c3fa6abd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:02.724 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.673+0000 7f2e493bc700 1 -- 172.21.15.163:0/4035217932 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c3fa424de0 con 0x55c3fa6aa320 2023-07-14T18:14:02.724 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.673+0000 7f2e493bc700 1 --2- 172.21.15.163:0/4035217932 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55c3fa6aa320 0x55c3fa6aa730 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7f2e38010f70 tx=0x7f2e38013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=56dcca831774f290 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:14:02.724 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.673+0000 7f2e2f7fe700 1 -- 172.21.15.163:0/4035217932 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e38011db0 con 0x55c3fa6aa320 2023-07-14T18:14:02.725 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.673+0000 7f2e2f7fe700 1 -- 172.21.15.163:0/4035217932 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f2e38015070 con 0x55c3fa6aa320 2023-07-14T18:14:02.725 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.673+0000 7f2e2f7fe700 1 -- 172.21.15.163:0/4035217932 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e3801c610 con 0x55c3fa6aa320 2023-07-14T18:14:02.725 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.674+0000 7f2e577b8b80 1 -- 172.21.15.163:0/4035217932 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55c3fa6aa320 msgr2=0x55c3fa6aa730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:14:02.725 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.674+0000 7f2e577b8b80 1 --2- 172.21.15.163:0/4035217932 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55c3fa6aa320 0x55c3fa6aa730 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7f2e38010f70 tx=0x7f2e38013000 comp rx=0 tx=0).stop 2023-07-14T18:14:02.725 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.674+0000 7f2e577b8b80 1 -- 172.21.15.163:0/4035217932 shutdown_connections 2023-07-14T18:14:02.725 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.674+0000 7f2e577b8b80 1 --2- 172.21.15.163:0/4035217932 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c3fa6ab8a0 0x55c3fa6abd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:02.725 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.674+0000 7f2e577b8b80 1 --2- 172.21.15.163:0/4035217932 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55c3fa6aa320 0x55c3fa6aa730 unknown :-1 s=CLOSED pgs=615 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:02.725 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.674+0000 7f2e577b8b80 1 --2- 172.21.15.163:0/4035217932 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55c3fa6aac70 0x55c3fa6ab310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:02.726 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.674+0000 7f2e577b8b80 1 -- 172.21.15.163:0/4035217932 >> 172.21.15.163:0/4035217932 conn(0x55c3fa69b680 msgr2=0x55c3fa6a09d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:14:02.726 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.674+0000 7f2e577b8b80 1 -- 172.21.15.163:0/4035217932 shutdown_connections 2023-07-14T18:14:02.726 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.674+0000 7f2e577b8b80 1 -- 172.21.15.163:0/4035217932 wait complete. 2023-07-14T18:14:02.726 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.674+0000 7f2e577b8b80 1 -- start start 2023-07-14T18:14:02.726 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.674+0000 7f2e577b8b80 1 Processor -- start 2023-07-14T18:14:02.726 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.674+0000 7f2e577b8b80 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55c3fa6aa320 0x55c3fa6b3e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:14:02.726 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.675+0000 7f2e577b8b80 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55c3fa6aac70 0x55c3fa6b4360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:14:02.727 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.675+0000 7f2e577b8b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c3fa6ab8a0 0x55c3fa6bb3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:14:02.727 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.675+0000 7f2e577b8b80 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c3fa596ac0 con 0x55c3fa6aac70 2023-07-14T18:14:02.727 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.675+0000 7f2e577b8b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c3fa5967c0 con 0x55c3fa6ab8a0 2023-07-14T18:14:02.727 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.675+0000 7f2e577b8b80 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c3fa47a920 con 0x55c3fa6aa320 2023-07-14T18:14:02.727 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.675+0000 7f2e577b8b80 10 client.0 _ll_register_callbacks cb 0x55c3fa594760 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T18:14:02.727 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.675+0000 7f2e48bbb700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55c3fa6aac70 0x55c3fa6b4360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:14:02.727 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.675+0000 7f2e493bc700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55c3fa6aa320 0x55c3fa6b3e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:14:02.727 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.675+0000 7f2e49bbd700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c3fa6ab8a0 0x55c3fa6bb3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:14:02.728 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.675+0000 7f2e48bbb700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55c3fa6aac70 0x55c3fa6b4360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:58890/0 (socket says 172.21.15.163:58890) 2023-07-14T18:14:02.728 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.675+0000 7f2e493bc700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55c3fa6aa320 0x55c3fa6b3e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.163:40710/0 (socket says 172.21.15.163:40710) 2023-07-14T18:14:02.728 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.675+0000 7f2e48bbb700 1 -- 172.21.15.163:0/2983681147 learned_addr learned my addr 172.21.15.163:0/2983681147 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:14:02.728 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.675+0000 7f2e48bbb700 1 -- 172.21.15.163:0/2983681147 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55c3fa6aa320 msgr2=0x55c3fa6b3e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:14:02.728 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.675+0000 7f2e48bbb700 1 --2- 172.21.15.163:0/2983681147 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55c3fa6aa320 0x55c3fa6b3e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:02.728 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.675+0000 7f2e48bbb700 1 -- 172.21.15.163:0/2983681147 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c3fa6ab8a0 msgr2=0x55c3fa6bb3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:14:02.728 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.675+0000 7f2e48bbb700 1 --2- 172.21.15.163:0/2983681147 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c3fa6ab8a0 0x55c3fa6bb3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:02.728 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.675+0000 7f2e48bbb700 1 -- 172.21.15.163:0/2983681147 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e38010c50 con 0x55c3fa6aac70 2023-07-14T18:14:02.729 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.675+0000 7f2e49bbd700 1 --2- 172.21.15.163:0/2983681147 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c3fa6ab8a0 0x55c3fa6bb3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T18:14:02.729 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.675+0000 7f2e48bbb700 1 --2- 172.21.15.163:0/2983681147 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55c3fa6aac70 0x55c3fa6b4360 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f2e40000c00 tx=0x7f2e4009b680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=89e46dc7c039bbb server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:14:02.729 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.675+0000 7f2e2cff9700 10 client.0 ms_handle_connect on v2:172.21.15.163:3300/0 2023-07-14T18:14:02.729 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.675+0000 7f2e2cff9700 1 -- 172.21.15.163:0/2983681147 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e400b2070 con 0x55c3fa6aac70 2023-07-14T18:14:02.729 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.675+0000 7f2e2cff9700 1 -- 172.21.15.163:0/2983681147 <== mon.0 v2:172.21.15.163:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 9049+0+0 (secure 0 0 0) 0x7f2e4009b140 con 0x55c3fa6aac70 2023-07-14T18:14:02.729 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.675+0000 7f2e577b8b80 1 -- 172.21.15.163:0/2983681147 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55c3fa5504f0 con 0x55c3fa6aac70 2023-07-14T18:14:02.729 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.675+0000 7f2e2cff9700 1 -- 172.21.15.163:0/2983681147 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2e4009f170 con 0x55c3fa6aac70 2023-07-14T18:14:02.730 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.675+0000 7f2e577b8b80 10 client.16011 fetch_fsmap learned FSMap version 29 2023-07-14T18:14:02.730 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.675+0000 7f2e577b8b80 1 -- 172.21.15.163:0/2983681147 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) v3 -- 0x55c3fa40dc60 con 0x55c3fa6aac70 2023-07-14T18:14:02.730 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.676+0000 7f2e2cff9700 1 -- 172.21.15.163:0/2983681147 <== mon.0 v2:172.21.15.163:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f2e400c9080 con 0x55c3fa6aac70 2023-07-14T18:14:02.730 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.676+0000 7f2e2cff9700 1 -- 172.21.15.163:0/2983681147 <== mon.0 v2:172.21.15.163:3300/0 5 ==== fsmap(e 29) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f2e400cbb40 con 0x55c3fa6aac70 2023-07-14T18:14:02.730 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.676+0000 7f2e577b8b80 10 client.16011 fetch_fsmap finished waiting for FSMap version 29 2023-07-14T18:14:02.730 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.676+0000 7f2e577b8b80 10 client.16011 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.c 2023-07-14T18:14:02.730 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.676+0000 7f2e577b8b80 20 client.16011 populate_metadata read hostname 'smithi163' 2023-07-14T18:14:02.730 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.676+0000 7f2e577b8b80 1 --2- 172.21.15.163:0/2983681147 >> [v2:172.21.15.184:6836/3389277679,v1:172.21.15.184:6837/3389277679] conn(0x55c3fa6bf830 0x55c3fa6c1c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:14:02.731 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.676+0000 7f2e577b8b80 4 client.16011 mds_command: new command op to 24478 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-14T18:14:02.731 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.676+0000 7f2e577b8b80 1 -- 172.21.15.163:0/2983681147 --> [v2:172.21.15.184:6836/3389277679,v1:172.21.15.184:6837/3389277679] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55c3fa674da0 con 0x55c3fa6bf830 2023-07-14T18:14:02.731 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.676+0000 7f2e493bc700 1 --2- 172.21.15.163:0/2983681147 >> [v2:172.21.15.184:6836/3389277679,v1:172.21.15.184:6837/3389277679] conn(0x55c3fa6bf830 0x55c3fa6c1c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:14:02.731 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.677+0000 7f2e2cff9700 10 client.16011 ms_handle_connect on v2:172.21.15.184:6836/3389277679 2023-07-14T18:14:02.731 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.677+0000 7f2e493bc700 1 --2- 172.21.15.163:0/2983681147 >> [v2:172.21.15.184:6836/3389277679,v1:172.21.15.184:6837/3389277679] conn(0x55c3fa6bf830 0x55c3fa6c1c10 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=442062cfc3ee0af5 server_cookie=8f7c04fdf06d1fa in_seq=0 out_seq=0 2023-07-14T18:14:02.731 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.677+0000 7f2e2cff9700 1 -- 172.21.15.163:0/2983681147 <== mds.3 v2:172.21.15.184:6836/3389277679 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18017 (crc 0 0 0) 0x55c3fa674da0 con 0x55c3fa6bf830 2023-07-14T18:14:02.731 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.677+0000 7f2e2cff9700 10 client.16011 handle_command_reply: tid=0 2023-07-14T18:14:02.731 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.677+0000 7f2e577b8b80 1 client.16011 shutdown 2023-07-14T18:14:02.732 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.677+0000 7f2e577b8b80 1 -- 172.21.15.163:0/2983681147 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55c3fa6aac70 msgr2=0x55c3fa6b4360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:14:02.732 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.677+0000 7f2e577b8b80 1 --2- 172.21.15.163:0/2983681147 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55c3fa6aac70 0x55c3fa6b4360 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f2e40000c00 tx=0x7f2e4009b680 comp rx=0 tx=0).stop 2023-07-14T18:14:02.732 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.677+0000 7f2e577b8b80 1 -- 172.21.15.163:0/2983681147 shutdown_connections 2023-07-14T18:14:02.732 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.677+0000 7f2e577b8b80 1 --2- 172.21.15.163:0/2983681147 >> [v2:172.21.15.184:6836/3389277679,v1:172.21.15.184:6837/3389277679] conn(0x55c3fa6bf830 0x55c3fa6c1c10 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:02.732 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.677+0000 7f2e577b8b80 1 --2- 172.21.15.163:0/2983681147 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55c3fa6aa320 0x55c3fa6b3e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:02.732 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.677+0000 7f2e577b8b80 1 --2- 172.21.15.163:0/2983681147 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c3fa6ab8a0 0x55c3fa6bb3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:02.732 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.677+0000 7f2e577b8b80 1 --2- 172.21.15.163:0/2983681147 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55c3fa6aac70 0x55c3fa6b4360 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:02.732 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.677+0000 7f2e2cff9700 0 client.16011 ms_handle_reset on v2:172.21.15.184:6836/3389277679 2023-07-14T18:14:02.733 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.677+0000 7f2e577b8b80 1 -- 172.21.15.163:0/2983681147 >> 172.21.15.163:0/2983681147 conn(0x55c3fa69b680 msgr2=0x55c3fa69f650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:14:02.733 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.678+0000 7f2e577b8b80 1 -- 172.21.15.163:0/2983681147 shutdown_connections 2023-07-14T18:14:02.733 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.678+0000 7f2e577b8b80 1 -- 172.21.15.163:0/2983681147 wait complete. 2023-07-14T18:14:02.733 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.678+0000 7f2e577b8b80 20 client.16011 trim_cache size 0 max 16384 2023-07-14T18:14:02.735 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.690+0000 7f2e577b8b80 1 Processor -- start 2023-07-14T18:14:02.735 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.690+0000 7f2e577b8b80 1 -- start start 2023-07-14T18:14:02.735 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.691+0000 7f2e577b8b80 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55c3fa6aa320 0x55c3fa6b1ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:14:02.735 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.691+0000 7f2e577b8b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c3fa6aac70 0x55c3fa6bb360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:14:02.735 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.691+0000 7f2e577b8b80 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55c3fa6ab8a0 0x55c3fa6b3e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:14:02.736 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.691+0000 7f2e577b8b80 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c3fa6b4d20 con 0x55c3fa6ab8a0 2023-07-14T18:14:02.736 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.691+0000 7f2e577b8b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c3fa6b32d0 con 0x55c3fa6aac70 2023-07-14T18:14:02.736 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.691+0000 7f2e577b8b80 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c3fa6b3990 con 0x55c3fa6aa320 2023-07-14T18:14:02.736 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.691+0000 7f2e49bbd700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55c3fa6ab8a0 0x55c3fa6b3e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:14:02.736 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.691+0000 7f2e493bc700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55c3fa6aa320 0x55c3fa6b1ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:14:02.736 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.691+0000 7f2e49bbd700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55c3fa6ab8a0 0x55c3fa6b3e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:58900/0 (socket says 172.21.15.163:58900) 2023-07-14T18:14:02.736 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.691+0000 7f2e493bc700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55c3fa6aa320 0x55c3fa6b1ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.163:40718/0 (socket says 172.21.15.163:40718) 2023-07-14T18:14:02.737 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.691+0000 7f2e49bbd700 1 -- 172.21.15.163:0/4021269144 learned_addr learned my addr 172.21.15.163:0/4021269144 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:14:02.737 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.691+0000 7f2e48bbb700 1 --2- 172.21.15.163:0/4021269144 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c3fa6aac70 0x55c3fa6bb360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:14:02.737 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.691+0000 7f2e49bbd700 1 -- 172.21.15.163:0/4021269144 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55c3fa6aa320 msgr2=0x55c3fa6b1ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:14:02.737 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.691+0000 7f2e49bbd700 1 --2- 172.21.15.163:0/4021269144 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55c3fa6aa320 0x55c3fa6b1ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:02.737 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.691+0000 7f2e49bbd700 1 -- 172.21.15.163:0/4021269144 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c3fa6aac70 msgr2=0x55c3fa6bb360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:14:02.737 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.691+0000 7f2e49bbd700 1 --2- 172.21.15.163:0/4021269144 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c3fa6aac70 0x55c3fa6bb360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:02.737 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.691+0000 7f2e49bbd700 1 -- 172.21.15.163:0/4021269144 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c3fa44b250 con 0x55c3fa6ab8a0 2023-07-14T18:14:02.737 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.691+0000 7f2e49bbd700 1 --2- 172.21.15.163:0/4021269144 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55c3fa6ab8a0 0x55c3fa6b3e20 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f2e3c0077c0 tx=0x7f2e3c0077f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d87861662cbac8a server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:14:02.738 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.691+0000 7f2e2ffff700 1 -- 172.21.15.163:0/4021269144 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e3c004db0 con 0x55c3fa6ab8a0 2023-07-14T18:14:02.738 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.691+0000 7f2e2ffff700 1 -- 172.21.15.163:0/4021269144 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f2e3c00f040 con 0x55c3fa6ab8a0 2023-07-14T18:14:02.738 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.691+0000 7f2e2ffff700 1 -- 172.21.15.163:0/4021269144 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e3c017670 con 0x55c3fa6ab8a0 2023-07-14T18:14:02.738 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.692+0000 7f2e577b8b80 1 -- 172.21.15.163:0/4021269144 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55c3fa6ab8a0 msgr2=0x55c3fa6b3e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:14:02.738 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.692+0000 7f2e577b8b80 1 --2- 172.21.15.163:0/4021269144 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55c3fa6ab8a0 0x55c3fa6b3e20 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f2e3c0077c0 tx=0x7f2e3c0077f0 comp rx=0 tx=0).stop 2023-07-14T18:14:02.738 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.692+0000 7f2e577b8b80 1 -- 172.21.15.163:0/4021269144 shutdown_connections 2023-07-14T18:14:02.738 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.692+0000 7f2e577b8b80 1 --2- 172.21.15.163:0/4021269144 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55c3fa6aa320 0x55c3fa6b1ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:02.738 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.692+0000 7f2e577b8b80 1 --2- 172.21.15.163:0/4021269144 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55c3fa6ab8a0 0x55c3fa6b3e20 unknown :-1 s=CLOSED pgs=617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:02.739 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.692+0000 7f2e577b8b80 1 --2- 172.21.15.163:0/4021269144 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c3fa6aac70 0x55c3fa6bb360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:02.739 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.692+0000 7f2e577b8b80 1 -- 172.21.15.163:0/4021269144 >> 172.21.15.163:0/4021269144 conn(0x55c3fa69b680 msgr2=0x55c3fa6b2a90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:14:02.739 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.692+0000 7f2e577b8b80 1 -- 172.21.15.163:0/4021269144 shutdown_connections 2023-07-14T18:14:02.739 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.692+0000 7f2e577b8b80 1 -- 172.21.15.163:0/4021269144 wait complete. 2023-07-14T18:14:02.739 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.692+0000 7f2e577b8b80 1 -- start start 2023-07-14T18:14:02.739 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.692+0000 7f2e577b8b80 1 Processor -- start 2023-07-14T18:14:02.742 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.693+0000 7f2e577b8b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c3fa6aa320 0x55c3fa6b73f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:14:02.742 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.693+0000 7f2e577b8b80 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55c3fa6aac70 0x55c3fa6b7930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:14:02.742 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.693+0000 7f2e577b8b80 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55c3fa6ab8a0 0x55c3fa6ba950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:14:02.742 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.693+0000 7f2e577b8b80 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c3fa6bae90 con 0x55c3fa6aac70 2023-07-14T18:14:02.742 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.693+0000 7f2e577b8b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c3fa6bb000 con 0x55c3fa6aa320 2023-07-14T18:14:02.743 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.693+0000 7f2e577b8b80 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c3fa6bb1c0 con 0x55c3fa6ab8a0 2023-07-14T18:14:02.743 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.693+0000 7f2e577b8b80 10 client.0 _ll_register_callbacks cb 0x7f2e4009af10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T18:14:02.743 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.693+0000 7f2e48bbb700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55c3fa6aac70 0x55c3fa6b7930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:14:02.743 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.693+0000 7f2e48bbb700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55c3fa6aac70 0x55c3fa6b7930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:58904/0 (socket says 172.21.15.163:58904) 2023-07-14T18:14:02.743 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.693+0000 7f2e48bbb700 1 -- 172.21.15.163:0/4071260088 learned_addr learned my addr 172.21.15.163:0/4071260088 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:14:02.743 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.693+0000 7f2e493bc700 1 --2- 172.21.15.163:0/4071260088 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c3fa6aa320 0x55c3fa6b73f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:14:02.743 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.693+0000 7f2e49bbd700 1 --2- 172.21.15.163:0/4071260088 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55c3fa6ab8a0 0x55c3fa6ba950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:14:02.744 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.693+0000 7f2e48bbb700 1 -- 172.21.15.163:0/4071260088 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55c3fa6ab8a0 msgr2=0x55c3fa6ba950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:14:02.744 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.693+0000 7f2e48bbb700 1 --2- 172.21.15.163:0/4071260088 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55c3fa6ab8a0 0x55c3fa6ba950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:02.744 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.693+0000 7f2e48bbb700 1 -- 172.21.15.163:0/4071260088 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c3fa6aa320 msgr2=0x55c3fa6b73f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:14:02.744 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.693+0000 7f2e48bbb700 1 --2- 172.21.15.163:0/4071260088 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c3fa6aa320 0x55c3fa6b73f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:02.744 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.693+0000 7f2e48bbb700 1 -- 172.21.15.163:0/4071260088 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e3c007500 con 0x55c3fa6aac70 2023-07-14T18:14:02.744 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.693+0000 7f2e48bbb700 1 --2- 172.21.15.163:0/4071260088 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55c3fa6aac70 0x55c3fa6b7930 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f2e400c5f80 tx=0x7f2e400042b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b10a44bd6e3c5fa server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:14:02.744 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.693+0000 7f2e2cff9700 10 client.0 ms_handle_connect on v2:172.21.15.163:3300/0 2023-07-14T18:14:02.744 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.693+0000 7f2e2cff9700 1 -- 172.21.15.163:0/4071260088 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e400b2040 con 0x55c3fa6aac70 2023-07-14T18:14:02.745 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.693+0000 7f2e2cff9700 1 -- 172.21.15.163:0/4071260088 <== mon.0 v2:172.21.15.163:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 9049+0+0 (secure 0 0 0) 0x7f2e4009f170 con 0x55c3fa6aac70 2023-07-14T18:14:02.745 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.693+0000 7f2e577b8b80 1 -- 172.21.15.163:0/4071260088 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f2e38015070 con 0x55c3fa6aac70 2023-07-14T18:14:02.745 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.693+0000 7f2e2cff9700 1 -- 172.21.15.163:0/4071260088 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2e400a3500 con 0x55c3fa6aac70 2023-07-14T18:14:02.745 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.694+0000 7f2e577b8b80 10 client.16017 fetch_fsmap learned FSMap version 29 2023-07-14T18:14:02.745 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.694+0000 7f2e577b8b80 1 -- 172.21.15.163:0/4071260088 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) v3 -- 0x55c3fa4232b0 con 0x55c3fa6aac70 2023-07-14T18:14:02.745 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.694+0000 7f2e2cff9700 1 -- 172.21.15.163:0/4071260088 <== mon.0 v2:172.21.15.163:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f2e38015070 con 0x55c3fa6aac70 2023-07-14T18:14:02.745 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.694+0000 7f2e2cff9700 1 -- 172.21.15.163:0/4071260088 <== mon.0 v2:172.21.15.163:3300/0 5 ==== fsmap(e 29) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f2e40096f30 con 0x55c3fa6aac70 2023-07-14T18:14:02.745 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.694+0000 7f2e577b8b80 10 client.16017 fetch_fsmap finished waiting for FSMap version 29 2023-07-14T18:14:02.746 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.694+0000 7f2e577b8b80 10 client.16017 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.c 2023-07-14T18:14:02.746 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.694+0000 7f2e577b8b80 20 client.16017 populate_metadata read hostname 'smithi163' 2023-07-14T18:14:02.746 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.694+0000 7f2e577b8b80 1 --2- 172.21.15.163:0/4071260088 >> [v2:172.21.15.184:6836/3389277679,v1:172.21.15.184:6837/3389277679] conn(0x55c3fa7141d0 0x55c3fa7165b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:14:02.746 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.694+0000 7f2e577b8b80 4 client.16017 mds_command: new command op to 24478 tid=0[{"prefix": "damage ls"}] 2023-07-14T18:14:02.746 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.694+0000 7f2e577b8b80 1 -- 172.21.15.163:0/4071260088 --> [v2:172.21.15.184:6836/3389277679,v1:172.21.15.184:6837/3389277679] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55c3fa5efeb0 con 0x55c3fa7141d0 2023-07-14T18:14:02.746 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.694+0000 7f2e493bc700 1 --2- 172.21.15.163:0/4071260088 >> [v2:172.21.15.184:6836/3389277679,v1:172.21.15.184:6837/3389277679] conn(0x55c3fa7141d0 0x55c3fa7165b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:14:02.746 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.694+0000 7f2e2cff9700 10 client.16017 ms_handle_connect on v2:172.21.15.184:6836/3389277679 2023-07-14T18:14:02.747 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.694+0000 7f2e493bc700 1 --2- 172.21.15.163:0/4071260088 >> [v2:172.21.15.184:6836/3389277679,v1:172.21.15.184:6837/3389277679] conn(0x55c3fa7141d0 0x55c3fa7165b0 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=df887cf9f56b840b server_cookie=bf8a48c4213867f7 in_seq=0 out_seq=0 2023-07-14T18:14:02.747 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.695+0000 7f2e2cff9700 1 -- 172.21.15.163:0/4071260088 <== mds.3 v2:172.21.15.184:6836/3389277679 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55c3fa5efeb0 con 0x55c3fa7141d0 2023-07-14T18:14:02.747 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.695+0000 7f2e2cff9700 10 client.16017 handle_command_reply: tid=0 2023-07-14T18:14:02.747 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.695+0000 7f2e577b8b80 1 client.16017 shutdown 2023-07-14T18:14:02.747 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.695+0000 7f2e577b8b80 1 -- 172.21.15.163:0/4071260088 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55c3fa6aac70 msgr2=0x55c3fa6b7930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:14:02.747 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.695+0000 7f2e577b8b80 1 --2- 172.21.15.163:0/4071260088 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55c3fa6aac70 0x55c3fa6b7930 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f2e400c5f80 tx=0x7f2e400042b0 comp rx=0 tx=0).stop 2023-07-14T18:14:02.747 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.695+0000 7f2e577b8b80 1 -- 172.21.15.163:0/4071260088 shutdown_connections 2023-07-14T18:14:02.747 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.695+0000 7f2e577b8b80 1 --2- 172.21.15.163:0/4071260088 >> [v2:172.21.15.184:6836/3389277679,v1:172.21.15.184:6837/3389277679] conn(0x55c3fa7141d0 0x55c3fa7165b0 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:02.748 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.695+0000 7f2e577b8b80 1 --2- 172.21.15.163:0/4071260088 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55c3fa6ab8a0 0x55c3fa6ba950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:02.748 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.695+0000 7f2e2cff9700 0 client.16017 ms_handle_reset on v2:172.21.15.184:6836/3389277679 2023-07-14T18:14:02.748 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.695+0000 7f2e577b8b80 1 --2- 172.21.15.163:0/4071260088 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c3fa6aa320 0x55c3fa6b73f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:02.748 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.695+0000 7f2e577b8b80 1 --2- 172.21.15.163:0/4071260088 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55c3fa6aac70 0x55c3fa6b7930 unknown :-1 s=CLOSED pgs=618 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:02.748 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.695+0000 7f2e577b8b80 1 -- 172.21.15.163:0/4071260088 >> 172.21.15.163:0/4071260088 conn(0x55c3fa69b680 msgr2=0x55c3fa6b1ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:14:02.748 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.695+0000 7f2e577b8b80 1 -- 172.21.15.163:0/4071260088 shutdown_connections 2023-07-14T18:14:02.748 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.695+0000 7f2e577b8b80 1 -- 172.21.15.163:0/4071260088 wait complete. 2023-07-14T18:14:02.748 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.695+0000 7f2e577b8b80 20 client.16017 trim_cache size 0 max 16384 2023-07-14T18:14:02.749 INFO:teuthology.orchestra.run.smithi163.stdout:[] 2023-07-14T18:14:02.750 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.695+0000 7f2e4b620700 1 -- 172.21.15.163:0/1825717849 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f2e300a1150 msgr2=0x7f2e300a3600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:14:02.750 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.695+0000 7f2e4b620700 1 --2- 172.21.15.163:0/1825717849 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f2e300a1150 0x7f2e300a3600 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f2e440674e0 tx=0x7f2e3800b410 comp rx=0 tx=0).stop 2023-07-14T18:14:02.750 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.695+0000 7f2e4b620700 1 -- 172.21.15.163:0/1825717849 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f2e44100f50 msgr2=0x7f2e44195e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:14:02.750 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.695+0000 7f2e4b620700 1 --2- 172.21.15.163:0/1825717849 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f2e44100f50 0x7f2e44195e50 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f2e40006010 tx=0x7f2e40004730 comp rx=0 tx=0).stop 2023-07-14T18:14:02.751 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.696+0000 7f2e4b620700 1 -- 172.21.15.163:0/1825717849 shutdown_connections 2023-07-14T18:14:02.751 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.696+0000 7f2e4b620700 1 --2- 172.21.15.163:0/1825717849 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f2e300a1150 0x7f2e300a3600 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:02.751 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.696+0000 7f2e4b620700 1 --2- 172.21.15.163:0/1825717849 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2e440fdee0 0x7f2e44195910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:02.751 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.696+0000 7f2e4b620700 1 --2- 172.21.15.163:0/1825717849 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2e441018e0 0x7f2e4419cec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:02.751 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.696+0000 7f2e4b620700 1 --2- 172.21.15.163:0/1825717849 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f2e44100f50 0x7f2e44195e50 unknown :-1 s=CLOSED pgs=614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:02.751 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.696+0000 7f2e4b620700 1 -- 172.21.15.163:0/1825717849 >> 172.21.15.163:0/1825717849 conn(0x7f2e440f98a0 msgr2=0x7f2e44104530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:14:02.751 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.696+0000 7f2e4b620700 1 -- 172.21.15.163:0/1825717849 shutdown_connections 2023-07-14T18:14:02.752 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.696+0000 7f2e4b620700 1 -- 172.21.15.163:0/1825717849 wait complete. 2023-07-14T18:14:02.752 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:2 damage ls 2023-07-14T18:14:02.876 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.833+0000 7f6d4da39700 1 -- 172.21.15.163:0/4277298070 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f6d48100e60 msgr2=0x7f6d481012b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:14:02.876 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.833+0000 7f6d4da39700 1 --2- 172.21.15.163:0/4277298070 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f6d48100e60 0x7f6d481012b0 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f6d3c009990 tx=0x7f6d3c009ca0 comp rx=0 tx=0).stop 2023-07-14T18:14:02.876 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.833+0000 7f6d4da39700 1 -- 172.21.15.163:0/4277298070 shutdown_connections 2023-07-14T18:14:02.877 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.833+0000 7f6d4da39700 1 --2- 172.21.15.163:0/4277298070 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6d480ffc70 0x7f6d48100080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:02.877 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.833+0000 7f6d4da39700 1 --2- 172.21.15.163:0/4277298070 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6d481017f0 0x7f6d481080b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:02.877 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.833+0000 7f6d4da39700 1 --2- 172.21.15.163:0/4277298070 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f6d48100e60 0x7f6d481012b0 unknown :-1 s=CLOSED pgs=619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:02.877 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.833+0000 7f6d4da39700 1 -- 172.21.15.163:0/4277298070 >> 172.21.15.163:0/4277298070 conn(0x7f6d480fb290 msgr2=0x7f6d480fd6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:14:02.877 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.833+0000 7f6d4da39700 1 -- 172.21.15.163:0/4277298070 shutdown_connections 2023-07-14T18:14:02.877 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.833+0000 7f6d4da39700 1 -- 172.21.15.163:0/4277298070 wait complete. 2023-07-14T18:14:02.877 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.833+0000 7f6d4da39700 1 Processor -- start 2023-07-14T18:14:02.879 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.834+0000 7f6d4da39700 1 -- start start 2023-07-14T18:14:02.879 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.834+0000 7f6d4da39700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f6d480ffc70 0x7f6d48195870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:14:02.879 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.834+0000 7f6d4da39700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6d48100e60 0x7f6d48195db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:14:02.879 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.834+0000 7f6d4da39700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6d481017f0 0x7f6d4819ce20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:14:02.879 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.834+0000 7f6d4da39700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d4819d3f0 con 0x7f6d480ffc70 2023-07-14T18:14:02.880 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.834+0000 7f6d4da39700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d4819d530 con 0x7f6d48100e60 2023-07-14T18:14:02.880 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.834+0000 7f6d4da39700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d4819d6c0 con 0x7f6d481017f0 2023-07-14T18:14:02.880 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.834+0000 7f6d46ffd700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f6d480ffc70 0x7f6d48195870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:14:02.880 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.834+0000 7f6d46ffd700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f6d480ffc70 0x7f6d48195870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:58916/0 (socket says 172.21.15.163:58916) 2023-07-14T18:14:02.880 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.834+0000 7f6d46ffd700 1 -- 172.21.15.163:0/2900809404 learned_addr learned my addr 172.21.15.163:0/2900809404 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:14:02.880 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.834+0000 7f6d467fc700 1 --2- 172.21.15.163:0/2900809404 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6d48100e60 0x7f6d48195db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:14:02.880 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.834+0000 7f6d477fe700 1 --2- 172.21.15.163:0/2900809404 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6d481017f0 0x7f6d4819ce20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:14:02.881 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.834+0000 7f6d46ffd700 1 -- 172.21.15.163:0/2900809404 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6d481017f0 msgr2=0x7f6d4819ce20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:14:02.881 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.834+0000 7f6d46ffd700 1 --2- 172.21.15.163:0/2900809404 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6d481017f0 0x7f6d4819ce20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:02.881 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.834+0000 7f6d46ffd700 1 -- 172.21.15.163:0/2900809404 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6d48100e60 msgr2=0x7f6d48195db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:14:02.881 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.834+0000 7f6d46ffd700 1 --2- 172.21.15.163:0/2900809404 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6d48100e60 0x7f6d48195db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:02.881 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.834+0000 7f6d46ffd700 1 -- 172.21.15.163:0/2900809404 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d3c0095f0 con 0x7f6d480ffc70 2023-07-14T18:14:02.881 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.834+0000 7f6d46ffd700 1 --2- 172.21.15.163:0/2900809404 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f6d480ffc70 0x7f6d48195870 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f6d3800e970 tx=0x7f6d3800ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:14:02.881 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.834+0000 7f6d4ca37700 1 -- 172.21.15.163:0/2900809404 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d38009790 con 0x7f6d480ffc70 2023-07-14T18:14:02.881 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.835+0000 7f6d4da39700 1 -- 172.21.15.163:0/2900809404 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6d4819d9a0 con 0x7f6d480ffc70 2023-07-14T18:14:02.882 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.835+0000 7f6d4ca37700 1 -- 172.21.15.163:0/2900809404 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f6d3800eec0 con 0x7f6d480ffc70 2023-07-14T18:14:02.882 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.835+0000 7f6d4ca37700 1 -- 172.21.15.163:0/2900809404 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d38003c10 con 0x7f6d480ffc70 2023-07-14T18:14:02.882 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.835+0000 7f6d4da39700 1 -- 172.21.15.163:0/2900809404 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d4819deb0 con 0x7f6d480ffc70 2023-07-14T18:14:02.885 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.837+0000 7f6d4ca37700 1 -- 172.21.15.163:0/2900809404 <== mon.0 v2:172.21.15.163:3300/0 4 ==== mgrmap(e 18) v1 ==== 135716+0+0 (secure 0 0 0) 0x7f6d38003db0 con 0x7f6d480ffc70 2023-07-14T18:14:02.886 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.837+0000 7f6d4ca37700 1 --2- 172.21.15.163:0/2900809404 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f6d300a1150 0x7f6d300a3600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:14:02.886 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.837+0000 7f6d4ca37700 1 -- 172.21.15.163:0/2900809404 <== mon.0 v2:172.21.15.163:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 9049+0+0 (secure 0 0 0) 0x7f6d38014070 con 0x7f6d480ffc70 2023-07-14T18:14:02.886 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.837+0000 7f6d467fc700 1 --2- 172.21.15.163:0/2900809404 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f6d300a1150 0x7f6d300a3600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:14:02.886 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.838+0000 7f6d467fc700 1 --2- 172.21.15.163:0/2900809404 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f6d300a1150 0x7f6d300a3600 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f6d3c00b2e0 tx=0x7f6d3c004000 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:14:02.886 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.838+0000 7f6d59bd1b80 1 Processor -- start 2023-07-14T18:14:02.886 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.838+0000 7f6d59bd1b80 1 -- start start 2023-07-14T18:14:02.886 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.838+0000 7f6d59bd1b80 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5566cfb01f60 0x5566cfb02370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:14:02.887 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.838+0000 7f6d59bd1b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5566cfb028b0 0x5566cfb02ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:14:02.887 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.838+0000 7f6d59bd1b80 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5566cfb034b0 0x5566cfb03920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:14:02.887 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.838+0000 7f6d59bd1b80 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x5566cfa06cb0 con 0x5566cfb034b0 2023-07-14T18:14:02.887 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.838+0000 7f6d59bd1b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x5566cfa59a40 con 0x5566cfb028b0 2023-07-14T18:14:02.887 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.838+0000 7f6d59bd1b80 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x5566cfa52ed0 con 0x5566cfb01f60 2023-07-14T18:14:02.887 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.838+0000 7f6d477fe700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5566cfb034b0 0x5566cfb03920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:14:02.887 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.839+0000 7f6d477fe700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5566cfb034b0 0x5566cfb03920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:58926/0 (socket says 172.21.15.163:58926) 2023-07-14T18:14:02.888 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.839+0000 7f6d477fe700 1 -- 172.21.15.163:0/29463863 learned_addr learned my addr 172.21.15.163:0/29463863 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:14:02.888 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.839+0000 7f6d46ffd700 1 --2- 172.21.15.163:0/29463863 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5566cfb01f60 0x5566cfb02370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:14:02.888 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.839+0000 7f6d467fc700 1 --2- 172.21.15.163:0/29463863 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5566cfb028b0 0x5566cfb02ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:14:02.888 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.839+0000 7f6d477fe700 1 -- 172.21.15.163:0/29463863 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5566cfb01f60 msgr2=0x5566cfb02370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:14:02.888 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.839+0000 7f6d477fe700 1 --2- 172.21.15.163:0/29463863 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5566cfb01f60 0x5566cfb02370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:02.888 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.839+0000 7f6d477fe700 1 -- 172.21.15.163:0/29463863 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5566cfb028b0 msgr2=0x5566cfb02ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:14:02.888 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.839+0000 7f6d477fe700 1 --2- 172.21.15.163:0/29463863 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5566cfb028b0 0x5566cfb02ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:02.888 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.839+0000 7f6d477fe700 1 -- 172.21.15.163:0/29463863 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5566cf880de0 con 0x5566cfb034b0 2023-07-14T18:14:02.889 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.839+0000 7f6d467fc700 1 --2- 172.21.15.163:0/29463863 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5566cfb028b0 0x5566cfb02ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T18:14:02.889 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.839+0000 7f6d477fe700 1 --2- 172.21.15.163:0/29463863 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5566cfb034b0 0x5566cfb03920 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f6d40009440 tx=0x7f6d40009920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe6ecdbebf540d55 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:14:02.889 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.839+0000 7f6d2dffb700 1 -- 172.21.15.163:0/29463863 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d4000e070 con 0x5566cfb034b0 2023-07-14T18:14:02.889 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.839+0000 7f6d2dffb700 1 -- 172.21.15.163:0/29463863 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f6d4000f040 con 0x5566cfb034b0 2023-07-14T18:14:02.889 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.839+0000 7f6d2dffb700 1 -- 172.21.15.163:0/29463863 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d40015ad0 con 0x5566cfb034b0 2023-07-14T18:14:02.889 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.840+0000 7f6d59bd1b80 1 -- 172.21.15.163:0/29463863 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5566cfb034b0 msgr2=0x5566cfb03920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:14:02.889 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.840+0000 7f6d59bd1b80 1 --2- 172.21.15.163:0/29463863 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5566cfb034b0 0x5566cfb03920 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f6d40009440 tx=0x7f6d40009920 comp rx=0 tx=0).stop 2023-07-14T18:14:02.889 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.840+0000 7f6d59bd1b80 1 -- 172.21.15.163:0/29463863 shutdown_connections 2023-07-14T18:14:02.890 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.840+0000 7f6d59bd1b80 1 --2- 172.21.15.163:0/29463863 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5566cfb01f60 0x5566cfb02370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:02.890 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.840+0000 7f6d59bd1b80 1 --2- 172.21.15.163:0/29463863 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5566cfb034b0 0x5566cfb03920 unknown :-1 s=CLOSED pgs=621 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:02.890 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.840+0000 7f6d59bd1b80 1 --2- 172.21.15.163:0/29463863 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5566cfb028b0 0x5566cfb02ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:02.890 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.840+0000 7f6d59bd1b80 1 -- 172.21.15.163:0/29463863 >> 172.21.15.163:0/29463863 conn(0x5566cfaf7680 msgr2=0x5566cfafc9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:14:02.890 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.840+0000 7f6d59bd1b80 1 -- 172.21.15.163:0/29463863 shutdown_connections 2023-07-14T18:14:02.890 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.840+0000 7f6d59bd1b80 1 -- 172.21.15.163:0/29463863 wait complete. 2023-07-14T18:14:02.890 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.840+0000 7f6d59bd1b80 1 -- start start 2023-07-14T18:14:02.891 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.840+0000 7f6d59bd1b80 1 Processor -- start 2023-07-14T18:14:02.891 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.841+0000 7f6d59bd1b80 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5566cfb01f60 0x5566cfb0b900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:14:02.891 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.841+0000 7f6d59bd1b80 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5566cfb028b0 0x5566cfb0be40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:14:02.891 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.841+0000 7f6d59bd1b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5566cfb034b0 0x5566cfb12e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:14:02.891 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.841+0000 7f6d59bd1b80 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x5566cf9f2ac0 con 0x5566cfb028b0 2023-07-14T18:14:02.891 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.841+0000 7f6d59bd1b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x5566cf9f27c0 con 0x5566cfb034b0 2023-07-14T18:14:02.891 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.841+0000 7f6d59bd1b80 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x5566cf8d6920 con 0x5566cfb01f60 2023-07-14T18:14:02.891 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.841+0000 7f6d59bd1b80 10 client.0 _ll_register_callbacks cb 0x5566cf9f0760 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T18:14:02.892 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.841+0000 7f6d467fc700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5566cfb028b0 0x5566cfb0be40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:14:02.892 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.841+0000 7f6d467fc700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5566cfb028b0 0x5566cfb0be40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:58932/0 (socket says 172.21.15.163:58932) 2023-07-14T18:14:02.892 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.841+0000 7f6d467fc700 1 -- 172.21.15.163:0/3082195897 learned_addr learned my addr 172.21.15.163:0/3082195897 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:14:02.892 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.841+0000 7f6d477fe700 1 --2- 172.21.15.163:0/3082195897 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5566cfb034b0 0x5566cfb12e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:14:02.892 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.841+0000 7f6d46ffd700 1 --2- 172.21.15.163:0/3082195897 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5566cfb01f60 0x5566cfb0b900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:14:02.892 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.841+0000 7f6d467fc700 1 -- 172.21.15.163:0/3082195897 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5566cfb01f60 msgr2=0x5566cfb0b900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:14:02.892 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.841+0000 7f6d467fc700 1 --2- 172.21.15.163:0/3082195897 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5566cfb01f60 0x5566cfb0b900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:02.892 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.841+0000 7f6d467fc700 1 -- 172.21.15.163:0/3082195897 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5566cfb034b0 msgr2=0x5566cfb12e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:14:02.893 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.841+0000 7f6d467fc700 1 --2- 172.21.15.163:0/3082195897 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5566cfb034b0 0x5566cfb12e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:02.893 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.841+0000 7f6d467fc700 1 -- 172.21.15.163:0/3082195897 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d400090f0 con 0x5566cfb028b0 2023-07-14T18:14:02.893 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.841+0000 7f6d467fc700 1 --2- 172.21.15.163:0/3082195897 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5566cfb028b0 0x5566cfb0be40 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7f6d3c000c00 tx=0x7f6d3c01a050 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a3864a9afd1dcc1 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:14:02.893 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.841+0000 7f6d26ffd700 10 client.0 ms_handle_connect on v2:172.21.15.163:3300/0 2023-07-14T18:14:02.893 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.841+0000 7f6d26ffd700 1 -- 172.21.15.163:0/3082195897 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d3c00bc40 con 0x5566cfb028b0 2023-07-14T18:14:02.893 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.841+0000 7f6d26ffd700 1 -- 172.21.15.163:0/3082195897 <== mon.0 v2:172.21.15.163:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 9049+0+0 (secure 0 0 0) 0x7f6d3c00bda0 con 0x5566cfb028b0 2023-07-14T18:14:02.893 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.841+0000 7f6d59bd1b80 1 -- 172.21.15.163:0/3082195897 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5566cf9ac4f0 con 0x5566cfb028b0 2023-07-14T18:14:02.894 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.842+0000 7f6d26ffd700 1 -- 172.21.15.163:0/3082195897 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6d3c004500 con 0x5566cfb028b0 2023-07-14T18:14:02.894 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.842+0000 7f6d59bd1b80 10 client.16029 fetch_fsmap learned FSMap version 29 2023-07-14T18:14:02.894 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.842+0000 7f6d59bd1b80 1 -- 172.21.15.163:0/3082195897 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) v3 -- 0x5566cf869c60 con 0x5566cfb028b0 2023-07-14T18:14:02.894 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.842+0000 7f6d26ffd700 1 -- 172.21.15.163:0/3082195897 <== mon.0 v2:172.21.15.163:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x5566cf9ac4f0 con 0x5566cfb028b0 2023-07-14T18:14:02.894 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.842+0000 7f6d26ffd700 1 -- 172.21.15.163:0/3082195897 <== mon.0 v2:172.21.15.163:3300/0 5 ==== fsmap(e 29) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f6d3c00f7d0 con 0x5566cfb028b0 2023-07-14T18:14:02.894 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.842+0000 7f6d59bd1b80 10 client.16029 fetch_fsmap finished waiting for FSMap version 29 2023-07-14T18:14:02.894 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.842+0000 7f6d59bd1b80 10 client.16029 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2023-07-14T18:14:02.894 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.842+0000 7f6d59bd1b80 20 client.16029 populate_metadata read hostname 'smithi163' 2023-07-14T18:14:02.895 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.842+0000 7f6d59bd1b80 1 --2- 172.21.15.163:0/3082195897 >> [v2:172.21.15.172:6836/3783835012,v1:172.21.15.172:6837/3783835012] conn(0x5566cfb17550 0x5566cfb19960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:14:02.895 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.842+0000 7f6d59bd1b80 4 client.16029 mds_command: new command op to 24479 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-14T18:14:02.895 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.842+0000 7f6d59bd1b80 1 -- 172.21.15.163:0/3082195897 --> [v2:172.21.15.172:6836/3783835012,v1:172.21.15.172:6837/3783835012] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5566cfad0da0 con 0x5566cfb17550 2023-07-14T18:14:02.895 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.842+0000 7f6d46ffd700 1 --2- 172.21.15.163:0/3082195897 >> [v2:172.21.15.172:6836/3783835012,v1:172.21.15.172:6837/3783835012] conn(0x5566cfb17550 0x5566cfb19960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:14:02.895 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.843+0000 7f6d26ffd700 10 client.16029 ms_handle_connect on v2:172.21.15.172:6836/3783835012 2023-07-14T18:14:02.895 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.843+0000 7f6d46ffd700 1 --2- 172.21.15.163:0/3082195897 >> [v2:172.21.15.172:6836/3783835012,v1:172.21.15.172:6837/3783835012] conn(0x5566cfb17550 0x5566cfb19960 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=dfd5a1bd05882f5e server_cookie=58e03a786ebdf218 in_seq=0 out_seq=0 2023-07-14T18:14:02.896 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.843+0000 7f6d26ffd700 1 -- 172.21.15.163:0/3082195897 <== mds.2 v2:172.21.15.172:6836/3783835012 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18017 (crc 0 0 0) 0x5566cfad0da0 con 0x5566cfb17550 2023-07-14T18:14:02.896 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.843+0000 7f6d26ffd700 10 client.16029 handle_command_reply: tid=0 2023-07-14T18:14:02.897 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.843+0000 7f6d59bd1b80 1 client.16029 shutdown 2023-07-14T18:14:02.897 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.843+0000 7f6d59bd1b80 1 -- 172.21.15.163:0/3082195897 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5566cfb028b0 msgr2=0x5566cfb0be40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:14:02.897 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.843+0000 7f6d59bd1b80 1 --2- 172.21.15.163:0/3082195897 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5566cfb028b0 0x5566cfb0be40 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7f6d3c000c00 tx=0x7f6d3c01a050 comp rx=0 tx=0).stop 2023-07-14T18:14:02.897 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.843+0000 7f6d59bd1b80 1 -- 172.21.15.163:0/3082195897 shutdown_connections 2023-07-14T18:14:02.897 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.843+0000 7f6d59bd1b80 1 --2- 172.21.15.163:0/3082195897 >> [v2:172.21.15.172:6836/3783835012,v1:172.21.15.172:6837/3783835012] conn(0x5566cfb17550 0x5566cfb19960 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:02.897 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.843+0000 7f6d59bd1b80 1 --2- 172.21.15.163:0/3082195897 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5566cfb01f60 0x5566cfb0b900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:02.897 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.843+0000 7f6d26ffd700 0 client.16029 ms_handle_reset on v2:172.21.15.172:6836/3783835012 2023-07-14T18:14:02.897 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.843+0000 7f6d59bd1b80 1 --2- 172.21.15.163:0/3082195897 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5566cfb034b0 0x5566cfb12e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:02.898 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.843+0000 7f6d59bd1b80 1 --2- 172.21.15.163:0/3082195897 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5566cfb028b0 0x5566cfb0be40 unknown :-1 s=CLOSED pgs=622 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:02.898 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.844+0000 7f6d59bd1b80 1 -- 172.21.15.163:0/3082195897 >> 172.21.15.163:0/3082195897 conn(0x5566cfaf7680 msgr2=0x5566cfafb650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:14:02.898 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.844+0000 7f6d59bd1b80 1 -- 172.21.15.163:0/3082195897 shutdown_connections 2023-07-14T18:14:02.898 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.844+0000 7f6d59bd1b80 1 -- 172.21.15.163:0/3082195897 wait complete. 2023-07-14T18:14:02.898 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.844+0000 7f6d59bd1b80 20 client.16029 trim_cache size 0 max 16384 2023-07-14T18:14:02.900 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.856+0000 7f6d59bd1b80 1 Processor -- start 2023-07-14T18:14:02.900 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.856+0000 7f6d59bd1b80 1 -- start start 2023-07-14T18:14:02.900 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.856+0000 7f6d59bd1b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5566cfb01f60 0x5566cfb03880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:14:02.900 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.856+0000 7f6d59bd1b80 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5566cfb028b0 0x5566cfb097a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:14:02.901 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.856+0000 7f6d59bd1b80 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5566cfb034b0 0x5566cfb09ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:14:02.901 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.856+0000 7f6d59bd1b80 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x5566cfb0b4a0 con 0x5566cfb028b0 2023-07-14T18:14:02.901 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.856+0000 7f6d59bd1b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x5566cfb0ca80 con 0x5566cfb01f60 2023-07-14T18:14:02.901 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.856+0000 7f6d59bd1b80 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x5566cfb13230 con 0x5566cfb034b0 2023-07-14T18:14:02.901 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.857+0000 7f6d467fc700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5566cfb028b0 0x5566cfb097a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:14:02.901 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.857+0000 7f6d467fc700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5566cfb028b0 0x5566cfb097a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:58940/0 (socket says 172.21.15.163:58940) 2023-07-14T18:14:02.901 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.857+0000 7f6d467fc700 1 -- 172.21.15.163:0/1093575783 learned_addr learned my addr 172.21.15.163:0/1093575783 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:14:02.901 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.857+0000 7f6d46ffd700 1 --2- 172.21.15.163:0/1093575783 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5566cfb01f60 0x5566cfb03880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:14:02.902 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.857+0000 7f6d477fe700 1 --2- 172.21.15.163:0/1093575783 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5566cfb034b0 0x5566cfb09ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:14:02.902 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.857+0000 7f6d467fc700 1 -- 172.21.15.163:0/1093575783 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5566cfb034b0 msgr2=0x5566cfb09ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:14:02.902 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.857+0000 7f6d467fc700 1 --2- 172.21.15.163:0/1093575783 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5566cfb034b0 0x5566cfb09ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:02.902 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.857+0000 7f6d467fc700 1 -- 172.21.15.163:0/1093575783 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5566cfb01f60 msgr2=0x5566cfb03880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:14:02.902 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.857+0000 7f6d467fc700 1 --2- 172.21.15.163:0/1093575783 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5566cfb01f60 0x5566cfb03880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:02.902 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.857+0000 7f6d467fc700 1 -- 172.21.15.163:0/1093575783 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5566cf8a7250 con 0x5566cfb028b0 2023-07-14T18:14:02.902 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.857+0000 7f6d477fe700 1 --2- 172.21.15.163:0/1093575783 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5566cfb034b0 0x5566cfb09ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T18:14:02.902 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.857+0000 7f6d467fc700 1 --2- 172.21.15.163:0/1093575783 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5566cfb028b0 0x5566cfb097a0 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f6d3c004360 tx=0x7f6d3c00fe70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d3c509b38aef1219 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:14:02.903 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.857+0000 7f6d2e7fc700 1 -- 172.21.15.163:0/1093575783 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d3c00bc40 con 0x5566cfb028b0 2023-07-14T18:14:02.903 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.857+0000 7f6d2e7fc700 1 -- 172.21.15.163:0/1093575783 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f6d3c02a050 con 0x5566cfb028b0 2023-07-14T18:14:02.903 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.857+0000 7f6d2e7fc700 1 -- 172.21.15.163:0/1093575783 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d3c0048a0 con 0x5566cfb028b0 2023-07-14T18:14:02.906 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.858+0000 7f6d59bd1b80 1 -- 172.21.15.163:0/1093575783 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5566cfb028b0 msgr2=0x5566cfb097a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:14:02.906 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.858+0000 7f6d59bd1b80 1 --2- 172.21.15.163:0/1093575783 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5566cfb028b0 0x5566cfb097a0 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f6d3c004360 tx=0x7f6d3c00fe70 comp rx=0 tx=0).stop 2023-07-14T18:14:02.906 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.858+0000 7f6d59bd1b80 1 -- 172.21.15.163:0/1093575783 shutdown_connections 2023-07-14T18:14:02.906 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.858+0000 7f6d59bd1b80 1 --2- 172.21.15.163:0/1093575783 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5566cfb034b0 0x5566cfb09ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:02.907 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.858+0000 7f6d59bd1b80 1 --2- 172.21.15.163:0/1093575783 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5566cfb01f60 0x5566cfb03880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:02.907 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.858+0000 7f6d59bd1b80 1 --2- 172.21.15.163:0/1093575783 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5566cfb028b0 0x5566cfb097a0 unknown :-1 s=CLOSED pgs=623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:02.907 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.858+0000 7f6d59bd1b80 1 -- 172.21.15.163:0/1093575783 >> 172.21.15.163:0/1093575783 conn(0x5566cfaf7680 msgr2=0x5566cfaf8b50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:14:02.907 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.858+0000 7f6d59bd1b80 1 -- 172.21.15.163:0/1093575783 shutdown_connections 2023-07-14T18:14:02.907 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.858+0000 7f6d59bd1b80 1 -- 172.21.15.163:0/1093575783 wait complete. 2023-07-14T18:14:02.907 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.858+0000 7f6d59bd1b80 1 -- start start 2023-07-14T18:14:02.907 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.858+0000 7f6d59bd1b80 1 Processor -- start 2023-07-14T18:14:02.907 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.858+0000 7f6d59bd1b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5566cfb01f60 0x5566cfb67410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:14:02.908 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.858+0000 7f6d59bd1b80 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5566cfb028b0 0x5566cfb679f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:14:02.908 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.858+0000 7f6d59bd1b80 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5566cfb034b0 0x5566cfb6e750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:14:02.908 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.858+0000 7f6d59bd1b80 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x5566cfb6ec90 con 0x5566cfb028b0 2023-07-14T18:14:02.908 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.858+0000 7f6d59bd1b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x5566cfb6edd0 con 0x5566cfb01f60 2023-07-14T18:14:02.908 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.858+0000 7f6d59bd1b80 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x5566cfb6ef60 con 0x5566cfb034b0 2023-07-14T18:14:02.908 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.859+0000 7f6d59bd1b80 10 client.0 _ll_register_callbacks cb 0x7f6d3c0056d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T18:14:02.908 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.859+0000 7f6d467fc700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5566cfb028b0 0x5566cfb679f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:14:02.909 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.859+0000 7f6d467fc700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5566cfb028b0 0x5566cfb679f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:58946/0 (socket says 172.21.15.163:58946) 2023-07-14T18:14:02.909 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.859+0000 7f6d467fc700 1 -- 172.21.15.163:0/2796770005 learned_addr learned my addr 172.21.15.163:0/2796770005 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:14:02.909 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.859+0000 7f6d477fe700 1 --2- 172.21.15.163:0/2796770005 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5566cfb034b0 0x5566cfb6e750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:14:02.909 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.859+0000 7f6d46ffd700 1 --2- 172.21.15.163:0/2796770005 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5566cfb01f60 0x5566cfb67410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:14:02.909 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.859+0000 7f6d467fc700 1 -- 172.21.15.163:0/2796770005 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5566cfb034b0 msgr2=0x5566cfb6e750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:14:02.909 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.859+0000 7f6d467fc700 1 --2- 172.21.15.163:0/2796770005 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5566cfb034b0 0x5566cfb6e750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:02.909 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.859+0000 7f6d467fc700 1 -- 172.21.15.163:0/2796770005 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5566cfb01f60 msgr2=0x5566cfb67410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:14:02.909 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.859+0000 7f6d467fc700 1 --2- 172.21.15.163:0/2796770005 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5566cfb01f60 0x5566cfb67410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:02.910 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.859+0000 7f6d467fc700 1 -- 172.21.15.163:0/2796770005 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5566cf869c60 con 0x5566cfb028b0 2023-07-14T18:14:02.910 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.859+0000 7f6d467fc700 1 --2- 172.21.15.163:0/2796770005 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5566cfb028b0 0x5566cfb679f0 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f6d3c009ce0 tx=0x7f6d3c005b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d2e82670c2ca587e server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:14:02.910 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.859+0000 7f6d26ffd700 10 client.0 ms_handle_connect on v2:172.21.15.163:3300/0 2023-07-14T18:14:02.910 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.859+0000 7f6d26ffd700 1 -- 172.21.15.163:0/2796770005 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d3c00f870 con 0x5566cfb028b0 2023-07-14T18:14:02.910 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.859+0000 7f6d26ffd700 1 -- 172.21.15.163:0/2796770005 <== mon.0 v2:172.21.15.163:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 9049+0+0 (secure 0 0 0) 0x7f6d3c00bd90 con 0x5566cfb028b0 2023-07-14T18:14:02.910 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.859+0000 7f6d59bd1b80 1 -- 172.21.15.163:0/2796770005 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f6d4000f040 con 0x5566cfb028b0 2023-07-14T18:14:02.910 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.859+0000 7f6d26ffd700 1 -- 172.21.15.163:0/2796770005 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6d3c0045e0 con 0x5566cfb028b0 2023-07-14T18:14:02.910 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.859+0000 7f6d59bd1b80 10 client.16035 fetch_fsmap learned FSMap version 29 2023-07-14T18:14:02.911 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.859+0000 7f6d59bd1b80 1 -- 172.21.15.163:0/2796770005 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) v3 -- 0x5566cf87f2b0 con 0x5566cfb028b0 2023-07-14T18:14:02.911 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.859+0000 7f6d26ffd700 1 -- 172.21.15.163:0/2796770005 <== mon.0 v2:172.21.15.163:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f6d4000f040 con 0x5566cfb028b0 2023-07-14T18:14:02.911 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.860+0000 7f6d26ffd700 1 -- 172.21.15.163:0/2796770005 <== mon.0 v2:172.21.15.163:3300/0 5 ==== fsmap(e 29) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f6d3c037040 con 0x5566cfb028b0 2023-07-14T18:14:02.911 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.860+0000 7f6d59bd1b80 10 client.16035 fetch_fsmap finished waiting for FSMap version 29 2023-07-14T18:14:02.911 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.860+0000 7f6d59bd1b80 10 client.16035 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2023-07-14T18:14:02.911 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.860+0000 7f6d59bd1b80 20 client.16035 populate_metadata read hostname 'smithi163' 2023-07-14T18:14:02.911 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.860+0000 7f6d59bd1b80 1 --2- 172.21.15.163:0/2796770005 >> [v2:172.21.15.172:6836/3783835012,v1:172.21.15.172:6837/3783835012] conn(0x5566cfb704a0 0x5566cfb72880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:14:02.912 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.860+0000 7f6d59bd1b80 4 client.16035 mds_command: new command op to 24479 tid=0[{"prefix": "damage ls"}] 2023-07-14T18:14:02.912 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.860+0000 7f6d59bd1b80 1 -- 172.21.15.163:0/2796770005 --> [v2:172.21.15.172:6836/3783835012,v1:172.21.15.172:6837/3783835012] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x5566cfa4beb0 con 0x5566cfb704a0 2023-07-14T18:14:02.912 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.860+0000 7f6d46ffd700 1 --2- 172.21.15.163:0/2796770005 >> [v2:172.21.15.172:6836/3783835012,v1:172.21.15.172:6837/3783835012] conn(0x5566cfb704a0 0x5566cfb72880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:14:02.912 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.860+0000 7f6d26ffd700 10 client.16035 ms_handle_connect on v2:172.21.15.172:6836/3783835012 2023-07-14T18:14:02.912 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.860+0000 7f6d46ffd700 1 --2- 172.21.15.163:0/2796770005 >> [v2:172.21.15.172:6836/3783835012,v1:172.21.15.172:6837/3783835012] conn(0x5566cfb704a0 0x5566cfb72880 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=35f1d2f6d6dc1b08 server_cookie=7e151446bb79fb19 in_seq=0 out_seq=0 2023-07-14T18:14:02.912 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.860+0000 7f6d26ffd700 1 -- 172.21.15.163:0/2796770005 <== mds.2 v2:172.21.15.172:6836/3783835012 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x5566cfa4beb0 con 0x5566cfb704a0 2023-07-14T18:14:02.912 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.860+0000 7f6d26ffd700 10 client.16035 handle_command_reply: tid=0 2023-07-14T18:14:02.912 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.860+0000 7f6d59bd1b80 1 client.16035 shutdown 2023-07-14T18:14:02.913 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.861+0000 7f6d59bd1b80 1 -- 172.21.15.163:0/2796770005 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5566cfb028b0 msgr2=0x5566cfb679f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:14:02.913 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.861+0000 7f6d59bd1b80 1 --2- 172.21.15.163:0/2796770005 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5566cfb028b0 0x5566cfb679f0 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f6d3c009ce0 tx=0x7f6d3c005b00 comp rx=0 tx=0).stop 2023-07-14T18:14:02.913 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.861+0000 7f6d59bd1b80 1 -- 172.21.15.163:0/2796770005 shutdown_connections 2023-07-14T18:14:02.913 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.861+0000 7f6d59bd1b80 1 --2- 172.21.15.163:0/2796770005 >> [v2:172.21.15.172:6836/3783835012,v1:172.21.15.172:6837/3783835012] conn(0x5566cfb704a0 0x5566cfb72880 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:02.913 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.861+0000 7f6d59bd1b80 1 --2- 172.21.15.163:0/2796770005 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5566cfb034b0 0x5566cfb6e750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:02.913 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.861+0000 7f6d26ffd700 0 client.16035 ms_handle_reset on v2:172.21.15.172:6836/3783835012 2023-07-14T18:14:02.913 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.861+0000 7f6d59bd1b80 1 --2- 172.21.15.163:0/2796770005 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5566cfb01f60 0x5566cfb67410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:02.913 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.861+0000 7f6d59bd1b80 1 --2- 172.21.15.163:0/2796770005 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5566cfb028b0 0x5566cfb679f0 unknown :-1 s=CLOSED pgs=624 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:02.914 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.861+0000 7f6d59bd1b80 1 -- 172.21.15.163:0/2796770005 >> 172.21.15.163:0/2796770005 conn(0x5566cfaf7680 msgr2=0x5566cfb097a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:14:02.914 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.861+0000 7f6d59bd1b80 1 -- 172.21.15.163:0/2796770005 shutdown_connections 2023-07-14T18:14:02.914 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.861+0000 7f6d59bd1b80 1 -- 172.21.15.163:0/2796770005 wait complete. 2023-07-14T18:14:02.914 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.861+0000 7f6d59bd1b80 20 client.16035 trim_cache size 0 max 16384 2023-07-14T18:14:02.914 INFO:teuthology.orchestra.run.smithi163.stdout:[] 2023-07-14T18:14:02.915 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.861+0000 7f6d4da39700 1 -- 172.21.15.163:0/2900809404 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f6d300a1150 msgr2=0x7f6d300a3600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:14:02.915 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.861+0000 7f6d4da39700 1 --2- 172.21.15.163:0/2900809404 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f6d300a1150 0x7f6d300a3600 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f6d3c00b2e0 tx=0x7f6d3c004000 comp rx=0 tx=0).stop 2023-07-14T18:14:02.915 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.861+0000 7f6d4da39700 1 -- 172.21.15.163:0/2900809404 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f6d480ffc70 msgr2=0x7f6d48195870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:14:02.915 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.861+0000 7f6d4da39700 1 --2- 172.21.15.163:0/2900809404 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f6d480ffc70 0x7f6d48195870 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f6d3800e970 tx=0x7f6d3800ec80 comp rx=0 tx=0).stop 2023-07-14T18:14:02.916 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.861+0000 7f6d4da39700 1 -- 172.21.15.163:0/2900809404 shutdown_connections 2023-07-14T18:14:02.916 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.861+0000 7f6d4da39700 1 --2- 172.21.15.163:0/2900809404 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f6d300a1150 0x7f6d300a3600 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:02.916 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.861+0000 7f6d4da39700 1 --2- 172.21.15.163:0/2900809404 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6d481017f0 0x7f6d4819ce20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:02.916 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.861+0000 7f6d4da39700 1 --2- 172.21.15.163:0/2900809404 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f6d480ffc70 0x7f6d48195870 unknown :-1 s=CLOSED pgs=620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:02.916 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.861+0000 7f6d4da39700 1 --2- 172.21.15.163:0/2900809404 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6d48100e60 0x7f6d48195db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:02.916 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.861+0000 7f6d4da39700 1 -- 172.21.15.163:0/2900809404 >> 172.21.15.163:0/2900809404 conn(0x7f6d480fb290 msgr2=0x7f6d480fd5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:14:02.916 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.861+0000 7f6d4da39700 1 -- 172.21.15.163:0/2900809404 shutdown_connections 2023-07-14T18:14:02.917 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.861+0000 7f6d4da39700 1 -- 172.21.15.163:0/2900809404 wait complete. 2023-07-14T18:14:02.917 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:1 damage ls 2023-07-14T18:14:03.042 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.999+0000 7f53637cc700 1 -- 172.21.15.163:0/1033750585 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f535c103010 msgr2=0x7f535c1053f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:14:03.043 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.999+0000 7f53637cc700 1 --2- 172.21.15.163:0/1033750585 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f535c103010 0x7f535c1053f0 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f5358009990 tx=0x7f5358009ca0 comp rx=0 tx=0).stop 2023-07-14T18:14:03.043 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.999+0000 7f53637cc700 1 -- 172.21.15.163:0/1033750585 shutdown_connections 2023-07-14T18:14:03.043 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.999+0000 7f53637cc700 1 --2- 172.21.15.163:0/1033750585 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f535c1006f0 0x7f535c102ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:03.043 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.999+0000 7f53637cc700 1 --2- 172.21.15.163:0/1033750585 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f535c105930 0x7f535c107d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:03.043 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.999+0000 7f53637cc700 1 --2- 172.21.15.163:0/1033750585 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f535c103010 0x7f535c1053f0 unknown :-1 s=CLOSED pgs=625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:03.043 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.999+0000 7f53637cc700 1 -- 172.21.15.163:0/1033750585 >> 172.21.15.163:0/1033750585 conn(0x7f535c0fa130 msgr2=0x7f535c0fc560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:14:03.044 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.999+0000 7f53637cc700 1 -- 172.21.15.163:0/1033750585 shutdown_connections 2023-07-14T18:14:03.044 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:02.999+0000 7f53637cc700 1 -- 172.21.15.163:0/1033750585 wait complete. 2023-07-14T18:14:03.044 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:03.000+0000 7f53637cc700 1 Processor -- start 2023-07-14T18:14:03.044 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:03.000+0000 7f53637cc700 1 -- start start 2023-07-14T18:14:03.046 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:03.000+0000 7f53637cc700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f535c1006f0 0x7f535c1958a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:14:03.046 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:03.000+0000 7f53637cc700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f535c103010 0x7f535c195de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:14:03.046 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:03.000+0000 7f53637cc700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f535c105930 0x7f535c19ce50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:14:03.047 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:03.000+0000 7f53637cc700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f535c19d420 con 0x7f535c103010 2023-07-14T18:14:03.047 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:03.000+0000 7f53637cc700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f535c19d560 con 0x7f535c105930 2023-07-14T18:14:03.047 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:03.000+0000 7f53637cc700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f535c19d6f0 con 0x7f535c1006f0 2023-07-14T18:14:03.047 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:03.000+0000 7f5360d67700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f535c103010 0x7f535c195de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:14:03.047 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:03.000+0000 7f5360d67700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f535c103010 0x7f535c195de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:58960/0 (socket says 172.21.15.163:58960) 2023-07-14T18:14:03.047 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:03.000+0000 7f5360d67700 1 -- 172.21.15.163:0/1459918733 learned_addr learned my addr 172.21.15.163:0/1459918733 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:14:03.047 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:03.000+0000 7f5361568700 1 --2- 172.21.15.163:0/1459918733 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f535c1006f0 0x7f535c1958a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:14:03.048 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:03.000+0000 7f5361d69700 1 --2- 172.21.15.163:0/1459918733 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f535c105930 0x7f535c19ce50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:14:03.048 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:03.000+0000 7f5360d67700 1 -- 172.21.15.163:0/1459918733 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f535c1006f0 msgr2=0x7f535c1958a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:14:03.048 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:03.000+0000 7f5360d67700 1 --2- 172.21.15.163:0/1459918733 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f535c1006f0 0x7f535c1958a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:03.048 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:03.000+0000 7f5360d67700 1 -- 172.21.15.163:0/1459918733 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f535c105930 msgr2=0x7f535c19ce50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:14:03.048 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:03.000+0000 7f5360d67700 1 --2- 172.21.15.163:0/1459918733 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f535c105930 0x7f535c19ce50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:03.048 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:03.000+0000 7f5360d67700 1 -- 172.21.15.163:0/1459918733 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53580095f0 con 0x7f535c103010 2023-07-14T18:14:03.048 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:03.000+0000 7f5361568700 1 --2- 172.21.15.163:0/1459918733 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f535c1006f0 0x7f535c1958a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T18:14:03.048 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:03.001+0000 7f5360d67700 1 --2- 172.21.15.163:0/1459918733 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f535c103010 0x7f535c195de0 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7f53580059d0 tx=0x7f53580040b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:14:03.049 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:03.001+0000 7f53527fc700 1 -- 172.21.15.163:0/1459918733 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f535801d070 con 0x7f535c103010 2023-07-14T18:14:03.049 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:03.001+0000 7f53527fc700 1 -- 172.21.15.163:0/1459918733 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f53580041d0 con 0x7f535c103010 2023-07-14T18:14:03.049 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:03.001+0000 7f53637cc700 1 -- 172.21.15.163:0/1459918733 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f535c19d970 con 0x7f535c103010 2023-07-14T18:14:03.049 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:03.001+0000 7f53527fc700 1 -- 172.21.15.163:0/1459918733 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5358021410 con 0x7f535c103010 2023-07-14T18:14:03.049 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:03.001+0000 7f53637cc700 1 -- 172.21.15.163:0/1459918733 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f535c19de20 con 0x7f535c103010 2023-07-14T18:14:03.049 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:03.003+0000 7f53527fc700 1 -- 172.21.15.163:0/1459918733 <== mon.0 v2:172.21.15.163:3300/0 4 ==== mgrmap(e 18) v1 ==== 135716+0+0 (secure 0 0 0) 0x7f535800f460 con 0x7f535c103010 2023-07-14T18:14:03.049 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:03.004+0000 7f53527fc700 1 --2- 172.21.15.163:0/1459918733 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f53480a1150 0x7f53480a3600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:14:03.054 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:03.004+0000 7f5361568700 1 --2- 172.21.15.163:0/1459918733 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f53480a1150 0x7f53480a3600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:14:03.054 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:03.004+0000 7f53527fc700 1 -- 172.21.15.163:0/1459918733 <== mon.0 v2:172.21.15.163:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 9049+0+0 (secure 0 0 0) 0x7f53580ce1d0 con 0x7f535c103010 2023-07-14T18:14:03.054 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:03.004+0000 7f5361568700 1 --2- 172.21.15.163:0/1459918733 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f53480a1150 0x7f53480a3600 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f534c005950 tx=0x7f534c0058e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:14:03.054 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:03.005+0000 7f536f964b80 1 Processor -- start 2023-07-14T18:14:03.054 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:03.005+0000 7f536f964b80 1 -- start start 2023-07-14T18:14:03.055 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:03.005+0000 7f536f964b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c395074320 0x55c395074730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:14:03.055 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:03.005+0000 7f536f964b80 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55c395074c70 0x55c395075310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:14:03.055 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:03.005+0000 7f536f964b80 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55c3950758a0 0x55c395075d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:14:03.055 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:03.005+0000 7f536f964b80 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c394f74cb0 con 0x55c3950758a0 2023-07-14T18:14:03.055 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:03.005+0000 7f536f964b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c394fc7a40 con 0x55c395074320 2023-07-14T18:14:03.055 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:03.005+0000 7f536f964b80 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c394fc0ed0 con 0x55c395074c70 2023-07-14T18:14:03.055 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:03.005+0000 7f5361d69700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55c3950758a0 0x55c395075d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:14:03.056 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:03.005+0000 7f5361d69700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55c3950758a0 0x55c395075d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:58970/0 (socket says 172.21.15.163:58970) 2023-07-14T18:14:03.056 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:03.005+0000 7f5361d69700 1 -- 172.21.15.163:0/2185058497 learned_addr learned my addr 172.21.15.163:0/2185058497 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:14:03.056 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:03.005+0000 7f5361568700 1 --2- 172.21.15.163:0/2185058497 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c395074320 0x55c395074730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:14:03.056 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:03.005+0000 7f5360d67700 1 --2- 172.21.15.163:0/2185058497 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55c395074c70 0x55c395075310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:14:03.056 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:03.005+0000 7f5361d69700 1 -- 172.21.15.163:0/2185058497 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55c395074c70 msgr2=0x55c395075310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:14:03.056 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:03.005+0000 7f5361d69700 1 --2- 172.21.15.163:0/2185058497 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55c395074c70 0x55c395075310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:03.056 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:03.005+0000 7f5361d69700 1 -- 172.21.15.163:0/2185058497 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c395074320 msgr2=0x55c395074730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:14:03.056 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:03.005+0000 7f5361d69700 1 --2- 172.21.15.163:0/2185058497 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c395074320 0x55c395074730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:03.057 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:03.006+0000 7f5361d69700 1 -- 172.21.15.163:0/2185058497 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c394deede0 con 0x55c3950758a0 2023-07-14T18:14:03.057 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:03.006+0000 7f5361d69700 1 --2- 172.21.15.163:0/2185058497 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55c3950758a0 0x55c395075d10 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f5354009440 tx=0x7f5354009920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=55c5e0a38d27f857 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:14:03.057 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:03.006+0000 7f53477fe700 1 -- 172.21.15.163:0/2185058497 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f535400e070 con 0x55c3950758a0 2023-07-14T18:14:03.057 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:03.006+0000 7f53477fe700 1 -- 172.21.15.163:0/2185058497 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f535400f040 con 0x55c3950758a0 2023-07-14T18:14:03.057 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:03.006+0000 7f53477fe700 1 -- 172.21.15.163:0/2185058497 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5354015a40 con 0x55c3950758a0 2023-07-14T18:14:03.057 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:03.006+0000 7f536f964b80 1 -- 172.21.15.163:0/2185058497 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55c3950758a0 msgr2=0x55c395075d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:14:03.057 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:03.007+0000 7f536f964b80 1 --2- 172.21.15.163:0/2185058497 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55c3950758a0 0x55c395075d10 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f5354009440 tx=0x7f5354009920 comp rx=0 tx=0).stop 2023-07-14T18:14:03.058 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:03.007+0000 7f536f964b80 1 -- 172.21.15.163:0/2185058497 shutdown_connections 2023-07-14T18:14:03.058 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:03.007+0000 7f536f964b80 1 --2- 172.21.15.163:0/2185058497 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55c3950758a0 0x55c395075d10 unknown :-1 s=CLOSED pgs=627 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:03.058 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:03.007+0000 7f536f964b80 1 --2- 172.21.15.163:0/2185058497 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c395074320 0x55c395074730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:03.058 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:03.007+0000 7f536f964b80 1 --2- 172.21.15.163:0/2185058497 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55c395074c70 0x55c395075310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:03.058 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:03.007+0000 7f536f964b80 1 -- 172.21.15.163:0/2185058497 >> 172.21.15.163:0/2185058497 conn(0x55c395065680 msgr2=0x55c39506a9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:14:03.058 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:03.007+0000 7f536f964b80 1 -- 172.21.15.163:0/2185058497 shutdown_connections 2023-07-14T18:14:03.058 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:03.007+0000 7f536f964b80 1 -- 172.21.15.163:0/2185058497 wait complete. 2023-07-14T18:14:03.058 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:03.007+0000 7f536f964b80 1 -- start start 2023-07-14T18:14:03.059 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:03.007+0000 7f536f964b80 1 Processor -- start 2023-07-14T18:14:03.059 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:03.007+0000 7f536f964b80 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55c395074320 0x55c39507dd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:14:03.059 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:03.007+0000 7f536f964b80 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55c395074c70 0x55c39507e280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:14:03.059 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:03.007+0000 7f536f964b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c3950758a0 0x55c3950852c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:14:03.059 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:03.007+0000 7f536f964b80 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c394f60ac0 con 0x55c395074c70 2023-07-14T18:14:03.059 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:03.007+0000 7f536f964b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c394f607c0 con 0x55c3950758a0 2023-07-14T18:14:03.059 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:03.007+0000 7f536f964b80 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c394e44920 con 0x55c395074320 2023-07-14T18:14:03.059 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:03.007+0000 7f536f964b80 10 client.0 _ll_register_callbacks cb 0x55c394f5e760 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T18:14:03.060 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:03.008+0000 7f5360d67700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55c395074c70 0x55c39507e280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:14:03.060 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:03.008+0000 7f5360d67700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55c395074c70 0x55c39507e280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:58974/0 (socket says 172.21.15.163:58974) 2023-07-14T18:14:03.060 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:03.008+0000 7f5360d67700 1 -- 172.21.15.163:0/133585367 learned_addr learned my addr 172.21.15.163:0/133585367 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:14:03.060 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:03.008+0000 7f5361d69700 1 --2- 172.21.15.163:0/133585367 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c3950758a0 0x55c3950852c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:14:03.060 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:03.008+0000 7f5361568700 1 --2- 172.21.15.163:0/133585367 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55c395074320 0x55c39507dd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:14:03.060 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:03.008+0000 7f5360d67700 1 -- 172.21.15.163:0/133585367 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55c395074320 msgr2=0x55c39507dd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:14:03.060 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:03.008+0000 7f5360d67700 1 --2- 172.21.15.163:0/133585367 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55c395074320 0x55c39507dd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:03.060 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:03.008+0000 7f5360d67700 1 -- 172.21.15.163:0/133585367 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c3950758a0 msgr2=0x55c3950852c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:14:03.061 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:03.008+0000 7f5360d67700 1 --2- 172.21.15.163:0/133585367 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c3950758a0 0x55c3950852c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:03.061 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:03.008+0000 7f5360d67700 1 -- 172.21.15.163:0/133585367 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53540090f0 con 0x55c395074c70 2023-07-14T18:14:03.061 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:03.008+0000 7f5360d67700 1 --2- 172.21.15.163:0/133585367 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55c395074c70 0x55c39507e280 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f535809b2d0 tx=0x7f535800f9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=88b5f596a14758c7 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:14:03.061 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:03.008+0000 7f5344ff9700 10 client.0 ms_handle_connect on v2:172.21.15.163:3300/0 2023-07-14T18:14:03.061 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:03.008+0000 7f5344ff9700 1 -- 172.21.15.163:0/133585367 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f535809aca0 con 0x55c395074c70 2023-07-14T18:14:03.061 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:03.008+0000 7f5344ff9700 1 -- 172.21.15.163:0/133585367 <== mon.0 v2:172.21.15.163:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 9049+0+0 (secure 0 0 0) 0x7f535809b340 con 0x55c395074c70 2023-07-14T18:14:03.061 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:03.008+0000 7f536f964b80 1 -- 172.21.15.163:0/133585367 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55c394f1a4f0 con 0x55c395074c70 2023-07-14T18:14:03.062 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:03.008+0000 7f5344ff9700 1 -- 172.21.15.163:0/133585367 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7f535809f160 con 0x55c395074c70 2023-07-14T18:14:03.062 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:03.008+0000 7f536f964b80 10 client.16047 fetch_fsmap learned FSMap version 29 2023-07-14T18:14:03.062 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:03.008+0000 7f536f964b80 1 -- 172.21.15.163:0/133585367 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) v3 -- 0x55c394dd7c60 con 0x55c395074c70 2023-07-14T18:14:03.062 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:03.008+0000 7f5344ff9700 1 -- 172.21.15.163:0/133585367 <== mon.0 v2:172.21.15.163:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f53580b2080 con 0x55c395074c70 2023-07-14T18:14:03.062 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:03.009+0000 7f5344ff9700 1 -- 172.21.15.163:0/133585367 <== mon.0 v2:172.21.15.163:3300/0 5 ==== fsmap(e 29) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f53580a3270 con 0x55c395074c70 2023-07-14T18:14:03.062 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:03.009+0000 7f536f964b80 10 client.16047 fetch_fsmap finished waiting for FSMap version 29 2023-07-14T18:14:03.062 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:03.009+0000 7f536f964b80 10 client.16047 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2023-07-14T18:14:03.062 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:03.009+0000 7f536f964b80 20 client.16047 populate_metadata read hostname 'smithi163' 2023-07-14T18:14:03.063 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:03.009+0000 7f536f964b80 1 --2- 172.21.15.163:0/133585367 >> [v2:172.21.15.184:6838/2819059257,v1:172.21.15.184:6839/2819059257] conn(0x55c395089700 0x55c39508bb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:14:03.063 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:03.009+0000 7f536f964b80 4 client.16047 mds_command: new command op to 24493 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-14T18:14:03.063 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:03.009+0000 7f536f964b80 1 -- 172.21.15.163:0/133585367 --> [v2:172.21.15.184:6838/2819059257,v1:172.21.15.184:6839/2819059257] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55c39503eda0 con 0x55c395089700 2023-07-14T18:14:03.063 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:03.009+0000 7f5361568700 1 --2- 172.21.15.163:0/133585367 >> [v2:172.21.15.184:6838/2819059257,v1:172.21.15.184:6839/2819059257] conn(0x55c395089700 0x55c39508bb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:14:03.063 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:03.009+0000 7f5344ff9700 10 client.16047 ms_handle_connect on v2:172.21.15.184:6838/2819059257 2023-07-14T18:14:03.063 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:03.009+0000 7f5361568700 1 --2- 172.21.15.163:0/133585367 >> [v2:172.21.15.184:6838/2819059257,v1:172.21.15.184:6839/2819059257] conn(0x55c395089700 0x55c39508bb10 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=eabab91966b5d42 server_cookie=8d439105e8c05a2e in_seq=0 out_seq=0 2023-07-14T18:14:03.063 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:03.010+0000 7f5344ff9700 1 -- 172.21.15.163:0/133585367 <== mds.1 v2:172.21.15.184:6838/2819059257 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18017 (crc 0 0 0) 0x55c39503eda0 con 0x55c395089700 2023-07-14T18:14:03.063 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:03.010+0000 7f5344ff9700 10 client.16047 handle_command_reply: tid=0 2023-07-14T18:14:03.064 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:03.010+0000 7f536f964b80 1 client.16047 shutdown 2023-07-14T18:14:03.064 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:03.010+0000 7f536f964b80 1 -- 172.21.15.163:0/133585367 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55c395074c70 msgr2=0x55c39507e280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:14:03.064 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:03.010+0000 7f536f964b80 1 --2- 172.21.15.163:0/133585367 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55c395074c70 0x55c39507e280 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f535809b2d0 tx=0x7f535800f9f0 comp rx=0 tx=0).stop 2023-07-14T18:14:03.064 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:03.010+0000 7f536f964b80 1 -- 172.21.15.163:0/133585367 shutdown_connections 2023-07-14T18:14:03.064 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:03.010+0000 7f536f964b80 1 --2- 172.21.15.163:0/133585367 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55c395074320 0x55c39507dd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:03.064 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:03.010+0000 7f536f964b80 1 --2- 172.21.15.163:0/133585367 >> [v2:172.21.15.184:6838/2819059257,v1:172.21.15.184:6839/2819059257] conn(0x55c395089700 0x55c39508bb10 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:03.064 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:03.010+0000 7f536f964b80 1 --2- 172.21.15.163:0/133585367 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c3950758a0 0x55c3950852c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:03.064 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:03.010+0000 7f5344ff9700 0 client.16047 ms_handle_reset on v2:172.21.15.184:6838/2819059257 2023-07-14T18:14:03.065 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:03.010+0000 7f536f964b80 1 --2- 172.21.15.163:0/133585367 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55c395074c70 0x55c39507e280 unknown :-1 s=CLOSED pgs=628 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:03.065 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:03.010+0000 7f536f964b80 1 -- 172.21.15.163:0/133585367 >> 172.21.15.163:0/133585367 conn(0x55c395065680 msgr2=0x55c395069650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:14:03.065 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:03.010+0000 7f536f964b80 1 -- 172.21.15.163:0/133585367 shutdown_connections 2023-07-14T18:14:03.065 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:03.010+0000 7f536f964b80 1 -- 172.21.15.163:0/133585367 wait complete. 2023-07-14T18:14:03.065 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:03.011+0000 7f536f964b80 20 client.16047 trim_cache size 0 max 16384 2023-07-14T18:14:03.067 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:03.024+0000 7f536f964b80 1 Processor -- start 2023-07-14T18:14:03.067 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:03.024+0000 7f536f964b80 1 -- start start 2023-07-14T18:14:03.067 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:03.024+0000 7f536f964b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c395074320 0x55c395075c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:14:03.067 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:03.024+0000 7f536f964b80 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55c395074c70 0x55c395085280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:14:03.067 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:03.024+0000 7f536f964b80 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55c3950758a0 0x55c39507cac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:14:03.068 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:03.024+0000 7f536f964b80 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c39507eef0 con 0x55c395074c70 2023-07-14T18:14:03.068 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:03.024+0000 7f536f964b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c39507d220 con 0x55c395074320 2023-07-14T18:14:03.068 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:03.024+0000 7f536f964b80 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c39507ec10 con 0x55c3950758a0 2023-07-14T18:14:03.068 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:03.024+0000 7f5360d67700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55c395074c70 0x55c395085280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:14:03.068 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:03.024+0000 7f5360d67700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55c395074c70 0x55c395085280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:58982/0 (socket says 172.21.15.163:58982) 2023-07-14T18:14:03.068 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:03.024+0000 7f5360d67700 1 -- 172.21.15.163:0/3011874861 learned_addr learned my addr 172.21.15.163:0/3011874861 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:14:03.068 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:03.024+0000 7f5361568700 1 --2- 172.21.15.163:0/3011874861 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c395074320 0x55c395075c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:14:03.069 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:03.024+0000 7f5361d69700 1 --2- 172.21.15.163:0/3011874861 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55c3950758a0 0x55c39507cac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:14:03.069 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:03.024+0000 7f5360d67700 1 -- 172.21.15.163:0/3011874861 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55c3950758a0 msgr2=0x55c39507cac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:14:03.069 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:03.024+0000 7f5360d67700 1 --2- 172.21.15.163:0/3011874861 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55c3950758a0 0x55c39507cac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:03.069 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:03.024+0000 7f5360d67700 1 -- 172.21.15.163:0/3011874861 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c395074320 msgr2=0x55c395075c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:14:03.069 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:03.024+0000 7f5360d67700 1 --2- 172.21.15.163:0/3011874861 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c395074320 0x55c395075c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:03.069 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:03.024+0000 7f5360d67700 1 -- 172.21.15.163:0/3011874861 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c394e15250 con 0x55c395074c70 2023-07-14T18:14:03.069 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:03.024+0000 7f5361568700 1 --2- 172.21.15.163:0/3011874861 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c395074320 0x55c395075c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T18:14:03.069 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:03.024+0000 7f5360d67700 1 --2- 172.21.15.163:0/3011874861 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55c395074c70 0x55c395085280 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f5358009350 tx=0x7f53580998f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f8d824358905a95a server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:14:03.070 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:03.024+0000 7f5347fff700 1 -- 172.21.15.163:0/3011874861 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f535809f160 con 0x55c395074c70 2023-07-14T18:14:03.070 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:03.024+0000 7f5347fff700 1 -- 172.21.15.163:0/3011874861 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55c394f1a4f0 con 0x55c395074c70 2023-07-14T18:14:03.070 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:03.024+0000 7f5347fff700 1 -- 172.21.15.163:0/3011874861 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53580a3700 con 0x55c395074c70 2023-07-14T18:14:03.073 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:03.025+0000 7f536f964b80 1 -- 172.21.15.163:0/3011874861 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55c395074c70 msgr2=0x55c395085280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:14:03.073 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:03.025+0000 7f536f964b80 1 --2- 172.21.15.163:0/3011874861 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55c395074c70 0x55c395085280 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f5358009350 tx=0x7f53580998f0 comp rx=0 tx=0).stop 2023-07-14T18:14:03.073 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:03.025+0000 7f536f964b80 1 -- 172.21.15.163:0/3011874861 shutdown_connections 2023-07-14T18:14:03.073 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:03.025+0000 7f536f964b80 1 --2- 172.21.15.163:0/3011874861 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55c3950758a0 0x55c39507cac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:03.073 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:03.025+0000 7f536f964b80 1 --2- 172.21.15.163:0/3011874861 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c395074320 0x55c395075c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:03.074 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:03.025+0000 7f536f964b80 1 --2- 172.21.15.163:0/3011874861 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55c395074c70 0x55c395085280 unknown :-1 s=CLOSED pgs=629 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:03.074 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:03.025+0000 7f536f964b80 1 -- 172.21.15.163:0/3011874861 >> 172.21.15.163:0/3011874861 conn(0x55c395065680 msgr2=0x55c39506a9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:14:03.074 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:03.025+0000 7f536f964b80 1 -- 172.21.15.163:0/3011874861 shutdown_connections 2023-07-14T18:14:03.074 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:03.025+0000 7f536f964b80 1 -- 172.21.15.163:0/3011874861 wait complete. 2023-07-14T18:14:03.074 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:03.025+0000 7f536f964b80 1 -- start start 2023-07-14T18:14:03.074 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:03.025+0000 7f536f964b80 1 Processor -- start 2023-07-14T18:14:03.074 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:03.025+0000 7f536f964b80 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55c395074320 0x55c395084c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:14:03.074 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:03.025+0000 7f536f964b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c395074c70 0x55c3950851c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:14:03.075 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:03.025+0000 7f536f964b80 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55c3950758a0 0x55c395081780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:14:03.075 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:03.025+0000 7f536f964b80 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c395081e90 con 0x55c3950758a0 2023-07-14T18:14:03.075 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:03.025+0000 7f536f964b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c395082000 con 0x55c395074c70 2023-07-14T18:14:03.075 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:03.025+0000 7f536f964b80 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c3950821c0 con 0x55c395074320 2023-07-14T18:14:03.075 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:03.025+0000 7f536f964b80 10 client.0 _ll_register_callbacks cb 0x7f5358097680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T18:14:03.075 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:03.025+0000 7f5361d69700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55c3950758a0 0x55c395081780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:14:03.075 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:03.025+0000 7f5361d69700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55c3950758a0 0x55c395081780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:58990/0 (socket says 172.21.15.163:58990) 2023-07-14T18:14:03.076 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:03.025+0000 7f5361d69700 1 -- 172.21.15.163:0/1433103386 learned_addr learned my addr 172.21.15.163:0/1433103386 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:14:03.076 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:03.026+0000 7f5360d67700 1 --2- 172.21.15.163:0/1433103386 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c395074c70 0x55c3950851c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:14:03.076 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:03.026+0000 7f5361568700 1 --2- 172.21.15.163:0/1433103386 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55c395074320 0x55c395084c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:14:03.076 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:03.026+0000 7f5361d69700 1 -- 172.21.15.163:0/1433103386 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55c395074320 msgr2=0x55c395084c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:14:03.076 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:03.026+0000 7f5361d69700 1 --2- 172.21.15.163:0/1433103386 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55c395074320 0x55c395084c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:03.076 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:03.026+0000 7f5361d69700 1 -- 172.21.15.163:0/1433103386 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c395074c70 msgr2=0x55c3950851c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:14:03.076 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:03.026+0000 7f5361d69700 1 --2- 172.21.15.163:0/1433103386 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c395074c70 0x55c3950851c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:03.076 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:03.026+0000 7f5361d69700 1 -- 172.21.15.163:0/1433103386 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55c394dd7c60 con 0x55c3950758a0 2023-07-14T18:14:03.077 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:03.026+0000 7f5361d69700 1 --2- 172.21.15.163:0/1433103386 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55c3950758a0 0x55c395081780 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f53540090c0 tx=0x7f5354013780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=576496113bdfb5cd server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:14:03.077 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:03.026+0000 7f5344ff9700 10 client.0 ms_handle_connect on v2:172.21.15.163:3300/0 2023-07-14T18:14:03.077 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:03.026+0000 7f5344ff9700 1 -- 172.21.15.163:0/1433103386 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f535400e040 con 0x55c3950758a0 2023-07-14T18:14:03.077 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:03.026+0000 7f5344ff9700 1 -- 172.21.15.163:0/1433103386 <== mon.0 v2:172.21.15.163:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 9049+0+0 (secure 0 0 0) 0x7f5354013db0 con 0x55c3950758a0 2023-07-14T18:14:03.077 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:03.026+0000 7f536f964b80 1 -- 172.21.15.163:0/1433103386 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f535400f040 con 0x55c3950758a0 2023-07-14T18:14:03.077 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:03.026+0000 7f5344ff9700 1 -- 172.21.15.163:0/1433103386 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5354015440 con 0x55c3950758a0 2023-07-14T18:14:03.077 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:03.026+0000 7f536f964b80 10 client.16053 fetch_fsmap learned FSMap version 29 2023-07-14T18:14:03.077 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:03.026+0000 7f536f964b80 1 -- 172.21.15.163:0/1433103386 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) v3 -- 0x55c394ded2b0 con 0x55c3950758a0 2023-07-14T18:14:03.078 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:03.026+0000 7f5344ff9700 1 -- 172.21.15.163:0/1433103386 <== mon.0 v2:172.21.15.163:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f535400f040 con 0x55c3950758a0 2023-07-14T18:14:03.078 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:03.026+0000 7f5344ff9700 1 -- 172.21.15.163:0/1433103386 <== mon.0 v2:172.21.15.163:3300/0 5 ==== fsmap(e 29) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f5354007500 con 0x55c3950758a0 2023-07-14T18:14:03.078 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:03.027+0000 7f536f964b80 10 client.16053 fetch_fsmap finished waiting for FSMap version 29 2023-07-14T18:14:03.078 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:03.027+0000 7f536f964b80 10 client.16053 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2023-07-14T18:14:03.078 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:03.027+0000 7f536f964b80 20 client.16053 populate_metadata read hostname 'smithi163' 2023-07-14T18:14:03.078 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:03.027+0000 7f536f964b80 1 --2- 172.21.15.163:0/1433103386 >> [v2:172.21.15.184:6838/2819059257,v1:172.21.15.184:6839/2819059257] conn(0x55c3950deac0 0x55c3950e0ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:14:03.078 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:03.027+0000 7f536f964b80 4 client.16053 mds_command: new command op to 24493 tid=0[{"prefix": "damage ls"}] 2023-07-14T18:14:03.079 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:03.027+0000 7f536f964b80 1 -- 172.21.15.163:0/1433103386 --> [v2:172.21.15.184:6838/2819059257,v1:172.21.15.184:6839/2819059257] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55c394fb9eb0 con 0x55c3950deac0 2023-07-14T18:14:03.079 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:03.027+0000 7f5361568700 1 --2- 172.21.15.163:0/1433103386 >> [v2:172.21.15.184:6838/2819059257,v1:172.21.15.184:6839/2819059257] conn(0x55c3950deac0 0x55c3950e0ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:14:03.079 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:03.027+0000 7f5344ff9700 10 client.16053 ms_handle_connect on v2:172.21.15.184:6838/2819059257 2023-07-14T18:14:03.079 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:03.027+0000 7f5361568700 1 --2- 172.21.15.163:0/1433103386 >> [v2:172.21.15.184:6838/2819059257,v1:172.21.15.184:6839/2819059257] conn(0x55c3950deac0 0x55c3950e0ed0 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=373e54acdd59bcf9 server_cookie=1d11b4c3769eaa7b in_seq=0 out_seq=0 2023-07-14T18:14:03.079 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:03.027+0000 7f5344ff9700 1 -- 172.21.15.163:0/1433103386 <== mds.1 v2:172.21.15.184:6838/2819059257 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55c394fb9eb0 con 0x55c3950deac0 2023-07-14T18:14:03.079 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:03.027+0000 7f5344ff9700 10 client.16053 handle_command_reply: tid=0 2023-07-14T18:14:03.079 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:03.027+0000 7f536f964b80 1 client.16053 shutdown 2023-07-14T18:14:03.079 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:03.027+0000 7f536f964b80 1 -- 172.21.15.163:0/1433103386 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55c3950758a0 msgr2=0x55c395081780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:14:03.080 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:03.027+0000 7f536f964b80 1 --2- 172.21.15.163:0/1433103386 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55c3950758a0 0x55c395081780 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f53540090c0 tx=0x7f5354013780 comp rx=0 tx=0).stop 2023-07-14T18:14:03.080 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:03.028+0000 7f536f964b80 1 -- 172.21.15.163:0/1433103386 shutdown_connections 2023-07-14T18:14:03.080 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:03.028+0000 7f536f964b80 1 --2- 172.21.15.163:0/1433103386 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55c395074320 0x55c395084c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:03.080 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:03.028+0000 7f536f964b80 1 --2- 172.21.15.163:0/1433103386 >> [v2:172.21.15.184:6838/2819059257,v1:172.21.15.184:6839/2819059257] conn(0x55c3950deac0 0x55c3950e0ed0 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:03.080 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:03.028+0000 7f536f964b80 1 --2- 172.21.15.163:0/1433103386 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55c3950758a0 0x55c395081780 unknown :-1 s=CLOSED pgs=630 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:03.080 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:03.028+0000 7f536f964b80 1 --2- 172.21.15.163:0/1433103386 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c395074c70 0x55c3950851c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:03.080 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:03.028+0000 7f5344ff9700 0 client.16053 ms_handle_reset on v2:172.21.15.184:6838/2819059257 2023-07-14T18:14:03.080 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:03.028+0000 7f536f964b80 1 -- 172.21.15.163:0/1433103386 >> 172.21.15.163:0/1433103386 conn(0x55c395065680 msgr2=0x55c395078770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:14:03.081 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:03.028+0000 7f536f964b80 1 -- 172.21.15.163:0/1433103386 shutdown_connections 2023-07-14T18:14:03.081 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:03.028+0000 7f536f964b80 1 -- 172.21.15.163:0/1433103386 wait complete. 2023-07-14T18:14:03.081 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:03.028+0000 7f536f964b80 20 client.16053 trim_cache size 0 max 16384 2023-07-14T18:14:03.081 INFO:teuthology.orchestra.run.smithi163.stdout:[] 2023-07-14T18:14:03.082 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:03.028+0000 7f53637cc700 1 -- 172.21.15.163:0/1459918733 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f53480a1150 msgr2=0x7f53480a3600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:14:03.082 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:03.028+0000 7f53637cc700 1 --2- 172.21.15.163:0/1459918733 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f53480a1150 0x7f53480a3600 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f534c005950 tx=0x7f534c0058e0 comp rx=0 tx=0).stop 2023-07-14T18:14:03.082 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:03.028+0000 7f53637cc700 1 -- 172.21.15.163:0/1459918733 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f535c103010 msgr2=0x7f535c195de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:14:03.082 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:03.028+0000 7f53637cc700 1 --2- 172.21.15.163:0/1459918733 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f535c103010 0x7f535c195de0 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7f53580059d0 tx=0x7f53580040b0 comp rx=0 tx=0).stop 2023-07-14T18:14:03.082 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:03.028+0000 7f53637cc700 1 -- 172.21.15.163:0/1459918733 shutdown_connections 2023-07-14T18:14:03.083 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:03.028+0000 7f53637cc700 1 --2- 172.21.15.163:0/1459918733 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f53480a1150 0x7f53480a3600 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:03.083 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:03.028+0000 7f53637cc700 1 --2- 172.21.15.163:0/1459918733 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f535c1006f0 0x7f535c1958a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:03.083 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:03.028+0000 7f53637cc700 1 --2- 172.21.15.163:0/1459918733 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f535c105930 0x7f535c19ce50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:03.083 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:03.028+0000 7f53637cc700 1 --2- 172.21.15.163:0/1459918733 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f535c103010 0x7f535c195de0 unknown :-1 s=CLOSED pgs=626 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:03.083 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:03.028+0000 7f53637cc700 1 -- 172.21.15.163:0/1459918733 >> 172.21.15.163:0/1459918733 conn(0x7f535c0fa130 msgr2=0x7f535c101350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:14:03.083 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:03.028+0000 7f53637cc700 1 -- 172.21.15.163:0/1459918733 shutdown_connections 2023-07-14T18:14:03.083 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:03.028+0000 7f53637cc700 1 -- 172.21.15.163:0/1459918733 wait complete. 2023-07-14T18:14:03.084 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:14:02 smithi163 ceph-mon[96576]: pgmap v341: 129 pgs: 129 active+clean; 16 MiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 1.3 MiB/s wr, 49 op/s 2023-07-14T18:14:03.084 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:14:02 smithi163 ceph-mon[96576]: from='client.? 172.21.15.163:0/3135137251' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-07-14T18:14:03.085 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 damage ls 2023-07-14T18:14:03.177 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:14:02 smithi184 ceph-mon[98481]: pgmap v341: 129 pgs: 129 active+clean; 16 MiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 1.3 MiB/s wr, 49 op/s 2023-07-14T18:14:03.177 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:14:02 smithi184 ceph-mon[98481]: from='client.? 172.21.15.163:0/3135137251' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-07-14T18:14:03.212 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:03.166+0000 7f0d0abc6700 1 -- 172.21.15.163:0/317181250 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f0d040feb30 msgr2=0x7f0d040fef40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:14:03.212 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:03.166+0000 7f0d0abc6700 1 --2- 172.21.15.163:0/317181250 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f0d040feb30 0x7f0d040fef40 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f0cf8009990 tx=0x7f0cf8009ca0 comp rx=0 tx=0).stop 2023-07-14T18:14:03.212 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:03.166+0000 7f0d0abc6700 1 -- 172.21.15.163:0/317181250 shutdown_connections 2023-07-14T18:14:03.212 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:03.166+0000 7f0d0abc6700 1 --2- 172.21.15.163:0/317181250 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0d04100770 0x7f0d04107010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:03.212 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:03.166+0000 7f0d0abc6700 1 --2- 172.21.15.163:0/317181250 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f0d040feb30 0x7f0d040fef40 unknown :-1 s=CLOSED pgs=631 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:03.213 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:03.166+0000 7f0d0abc6700 1 --2- 172.21.15.163:0/317181250 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0d040ffdc0 0x7f0d04100230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:03.213 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:03.166+0000 7f0d0abc6700 1 -- 172.21.15.163:0/317181250 >> 172.21.15.163:0/317181250 conn(0x7f0d040fa150 msgr2=0x7f0d040fc580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:14:03.213 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:03.166+0000 7f0d0abc6700 1 -- 172.21.15.163:0/317181250 shutdown_connections 2023-07-14T18:14:03.213 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:03.166+0000 7f0d0abc6700 1 -- 172.21.15.163:0/317181250 wait complete. 2023-07-14T18:14:03.213 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:03.167+0000 7f0d0abc6700 1 Processor -- start 2023-07-14T18:14:03.213 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:03.167+0000 7f0d0abc6700 1 -- start start 2023-07-14T18:14:03.213 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:03.167+0000 7f0d0abc6700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0d040feb30 0x7f0d040694e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:14:03.214 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:03.167+0000 7f0d0abc6700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0d040ffdc0 0x7f0d0419a680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:14:03.214 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:03.167+0000 7f0d0abc6700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f0d04100770 0x7f0d0419ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:14:03.214 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:03.167+0000 7f0d0abc6700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d0419d4a0 con 0x7f0d04100770 2023-07-14T18:14:03.214 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:03.167+0000 7f0d0abc6700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d0419d610 con 0x7f0d040feb30 2023-07-14T18:14:03.214 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:03.167+0000 7f0d0abc6700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d0419d7d0 con 0x7f0d040ffdc0 2023-07-14T18:14:03.214 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:03.167+0000 7f0d09163700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f0d04100770 0x7f0d0419ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:14:03.214 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:03.167+0000 7f0d09163700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f0d04100770 0x7f0d0419ccd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:59004/0 (socket says 172.21.15.163:59004) 2023-07-14T18:14:03.214 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:03.167+0000 7f0d09163700 1 -- 172.21.15.163:0/95391584 learned_addr learned my addr 172.21.15.163:0/95391584 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:14:03.215 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:03.167+0000 7f0d03fff700 1 --2- 172.21.15.163:0/95391584 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0d040ffdc0 0x7f0d0419a680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:14:03.215 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:03.167+0000 7f0d08962700 1 --2- 172.21.15.163:0/95391584 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0d040feb30 0x7f0d040694e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:14:03.215 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:03.167+0000 7f0d09163700 1 -- 172.21.15.163:0/95391584 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0d040ffdc0 msgr2=0x7f0d0419a680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:14:03.215 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:03.167+0000 7f0d09163700 1 --2- 172.21.15.163:0/95391584 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0d040ffdc0 0x7f0d0419a680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:03.215 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:03.167+0000 7f0d09163700 1 -- 172.21.15.163:0/95391584 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0d040feb30 msgr2=0x7f0d040694e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:14:03.215 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:03.167+0000 7f0d09163700 1 --2- 172.21.15.163:0/95391584 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0d040feb30 0x7f0d040694e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:03.215 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:03.167+0000 7f0d09163700 1 -- 172.21.15.163:0/95391584 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0cfc009c40 con 0x7f0d04100770 2023-07-14T18:14:03.215 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:03.167+0000 7f0d08962700 1 --2- 172.21.15.163:0/95391584 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0d040feb30 0x7f0d040694e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T18:14:03.216 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:03.167+0000 7f0d03fff700 1 --2- 172.21.15.163:0/95391584 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0d040ffdc0 0x7f0d0419a680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T18:14:03.216 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:03.167+0000 7f0d09163700 1 --2- 172.21.15.163:0/95391584 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f0d04100770 0x7f0d0419ccd0 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f0cfc00c370 tx=0x7f0cfc00c730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:14:03.216 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:03.168+0000 7f0d01ffb700 1 -- 172.21.15.163:0/95391584 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cfc017070 con 0x7f0d04100770 2023-07-14T18:14:03.216 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:03.168+0000 7f0d01ffb700 1 -- 172.21.15.163:0/95391584 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f0cfc00f040 con 0x7f0d04100770 2023-07-14T18:14:03.216 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:03.168+0000 7f0d0abc6700 1 -- 172.21.15.163:0/95391584 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0cf80095f0 con 0x7f0d04100770 2023-07-14T18:14:03.216 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:03.168+0000 7f0d01ffb700 1 -- 172.21.15.163:0/95391584 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cfc00e050 con 0x7f0d04100770 2023-07-14T18:14:03.216 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:03.168+0000 7f0d0abc6700 1 -- 172.21.15.163:0/95391584 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d0419dd80 con 0x7f0d04100770 2023-07-14T18:14:03.221 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:03.171+0000 7f0d01ffb700 1 -- 172.21.15.163:0/95391584 <== mon.0 v2:172.21.15.163:3300/0 4 ==== mgrmap(e 18) v1 ==== 135716+0+0 (secure 0 0 0) 0x7f0cfc003a00 con 0x7f0d04100770 2023-07-14T18:14:03.221 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:03.171+0000 7f0d01ffb700 1 --2- 172.21.15.163:0/95391584 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f0cf40a1150 0x7f0cf40a3600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:14:03.221 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:03.171+0000 7f0d01ffb700 1 -- 172.21.15.163:0/95391584 <== mon.0 v2:172.21.15.163:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 9049+0+0 (secure 0 0 0) 0x7f0cfc0cc5e0 con 0x7f0d04100770 2023-07-14T18:14:03.221 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:03.171+0000 7f0d08962700 1 --2- 172.21.15.163:0/95391584 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f0cf40a1150 0x7f0cf40a3600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:14:03.221 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:03.171+0000 7f0d08962700 1 --2- 172.21.15.163:0/95391584 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f0cf40a1150 0x7f0cf40a3600 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f0cf8000c00 tx=0x7f0cf8005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:14:03.222 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:03.171+0000 7f0d16d5eb80 1 Processor -- start 2023-07-14T18:14:03.222 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:03.171+0000 7f0d16d5eb80 1 -- start start 2023-07-14T18:14:03.222 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:03.171+0000 7f0d16d5eb80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56025408af60 0x56025408b370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:14:03.222 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:03.171+0000 7f0d16d5eb80 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x56025408b8b0 0x56025408bed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:14:03.222 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:03.171+0000 7f0d16d5eb80 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56025408c4b0 0x56025408c920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:14:03.222 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:03.171+0000 7f0d16d5eb80 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x560253f8fcb0 con 0x56025408b8b0 2023-07-14T18:14:03.222 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:03.171+0000 7f0d16d5eb80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x560253fe2a40 con 0x56025408af60 2023-07-14T18:14:03.222 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:03.171+0000 7f0d16d5eb80 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x560253fdbed0 con 0x56025408c4b0 2023-07-14T18:14:03.223 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:03.171+0000 7f0d03fff700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x56025408b8b0 0x56025408bed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:14:03.223 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:03.172+0000 7f0d03fff700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x56025408b8b0 0x56025408bed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:59010/0 (socket says 172.21.15.163:59010) 2023-07-14T18:14:03.223 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:03.172+0000 7f0d03fff700 1 -- 172.21.15.163:0/2546336091 learned_addr learned my addr 172.21.15.163:0/2546336091 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:14:03.223 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:03.172+0000 7f0d08962700 1 --2- 172.21.15.163:0/2546336091 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56025408af60 0x56025408b370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:14:03.223 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:03.172+0000 7f0d09163700 1 --2- 172.21.15.163:0/2546336091 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56025408c4b0 0x56025408c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:14:03.223 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:03.172+0000 7f0d03fff700 1 -- 172.21.15.163:0/2546336091 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56025408c4b0 msgr2=0x56025408c920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:14:03.223 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:03.172+0000 7f0d03fff700 1 --2- 172.21.15.163:0/2546336091 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56025408c4b0 0x56025408c920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:03.223 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:03.172+0000 7f0d03fff700 1 -- 172.21.15.163:0/2546336091 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56025408af60 msgr2=0x56025408b370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:14:03.224 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:03.172+0000 7f0d03fff700 1 --2- 172.21.15.163:0/2546336091 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56025408af60 0x56025408b370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:03.224 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:03.172+0000 7f0d03fff700 1 -- 172.21.15.163:0/2546336091 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560253e09de0 con 0x56025408b8b0 2023-07-14T18:14:03.224 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:03.172+0000 7f0d03fff700 1 --2- 172.21.15.163:0/2546336091 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x56025408b8b0 0x56025408bed0 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7f0cf000bce0 tx=0x7f0cf000f360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c38323939f201c2c server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:14:03.224 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:03.172+0000 7f0ceeffd700 1 -- 172.21.15.163:0/2546336091 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cf000fbe0 con 0x56025408b8b0 2023-07-14T18:14:03.224 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:03.172+0000 7f0ceeffd700 1 -- 172.21.15.163:0/2546336091 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f0cf000fd40 con 0x56025408b8b0 2023-07-14T18:14:03.224 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:03.172+0000 7f0ceeffd700 1 -- 172.21.15.163:0/2546336091 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cf0011730 con 0x56025408b8b0 2023-07-14T18:14:03.224 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:03.173+0000 7f0d16d5eb80 1 -- 172.21.15.163:0/2546336091 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x56025408b8b0 msgr2=0x56025408bed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:14:03.225 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:03.173+0000 7f0d16d5eb80 1 --2- 172.21.15.163:0/2546336091 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x56025408b8b0 0x56025408bed0 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7f0cf000bce0 tx=0x7f0cf000f360 comp rx=0 tx=0).stop 2023-07-14T18:14:03.225 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:03.173+0000 7f0d16d5eb80 1 -- 172.21.15.163:0/2546336091 shutdown_connections 2023-07-14T18:14:03.225 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:03.173+0000 7f0d16d5eb80 1 --2- 172.21.15.163:0/2546336091 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56025408c4b0 0x56025408c920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:03.225 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:03.173+0000 7f0d16d5eb80 1 --2- 172.21.15.163:0/2546336091 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56025408af60 0x56025408b370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:03.225 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:03.173+0000 7f0d16d5eb80 1 --2- 172.21.15.163:0/2546336091 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x56025408b8b0 0x56025408bed0 unknown :-1 s=CLOSED pgs=633 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:03.225 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:03.173+0000 7f0d16d5eb80 1 -- 172.21.15.163:0/2546336091 >> 172.21.15.163:0/2546336091 conn(0x560254080680 msgr2=0x5602540859d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:14:03.225 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:03.173+0000 7f0d16d5eb80 1 -- 172.21.15.163:0/2546336091 shutdown_connections 2023-07-14T18:14:03.225 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:03.173+0000 7f0d16d5eb80 1 -- 172.21.15.163:0/2546336091 wait complete. 2023-07-14T18:14:03.226 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:03.173+0000 7f0d16d5eb80 1 -- start start 2023-07-14T18:14:03.226 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:03.173+0000 7f0d16d5eb80 1 Processor -- start 2023-07-14T18:14:03.226 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:03.174+0000 7f0d16d5eb80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56025408af60 0x560254094990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:14:03.226 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:03.174+0000 7f0d16d5eb80 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x56025408b8b0 0x560254094ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:14:03.226 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:03.174+0000 7f0d16d5eb80 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56025408c4b0 0x56025409bf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:14:03.226 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:03.174+0000 7f0d16d5eb80 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x560253f7bac0 con 0x56025408b8b0 2023-07-14T18:14:03.226 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:03.174+0000 7f0d16d5eb80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x560253f7b7c0 con 0x56025408af60 2023-07-14T18:14:03.226 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:03.174+0000 7f0d16d5eb80 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x560253e5f920 con 0x56025408c4b0 2023-07-14T18:14:03.227 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:03.174+0000 7f0d16d5eb80 10 client.0 _ll_register_callbacks cb 0x560253f79760 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T18:14:03.227 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:03.174+0000 7f0d03fff700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x56025408b8b0 0x560254094ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:14:03.227 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:03.174+0000 7f0d03fff700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x56025408b8b0 0x560254094ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:59016/0 (socket says 172.21.15.163:59016) 2023-07-14T18:14:03.227 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:03.174+0000 7f0d03fff700 1 -- 172.21.15.163:0/1575100598 learned_addr learned my addr 172.21.15.163:0/1575100598 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:14:03.227 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:03.174+0000 7f0d08962700 1 --2- 172.21.15.163:0/1575100598 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56025408af60 0x560254094990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:14:03.227 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:03.174+0000 7f0d09163700 1 --2- 172.21.15.163:0/1575100598 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56025408c4b0 0x56025409bf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:14:03.227 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:03.174+0000 7f0d03fff700 1 -- 172.21.15.163:0/1575100598 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56025408c4b0 msgr2=0x56025409bf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:14:03.227 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:03.174+0000 7f0d03fff700 1 --2- 172.21.15.163:0/1575100598 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56025408c4b0 0x56025409bf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:03.228 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:03.174+0000 7f0d03fff700 1 -- 172.21.15.163:0/1575100598 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56025408af60 msgr2=0x560254094990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:14:03.228 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:03.174+0000 7f0d03fff700 1 --2- 172.21.15.163:0/1575100598 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56025408af60 0x560254094990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:03.228 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:03.174+0000 7f0d03fff700 1 -- 172.21.15.163:0/1575100598 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0cf000b940 con 0x56025408b8b0 2023-07-14T18:14:03.228 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:03.174+0000 7f0d03fff700 1 --2- 172.21.15.163:0/1575100598 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x56025408b8b0 0x560254094ed0 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f0cf000fc40 tx=0x7f0cf000ffd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1925d43f208c344e server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:14:03.228 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:03.174+0000 7f0ce3fff700 10 client.0 ms_handle_connect on v2:172.21.15.163:3300/0 2023-07-14T18:14:03.228 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:03.174+0000 7f0ce3fff700 1 -- 172.21.15.163:0/1575100598 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cf0020070 con 0x56025408b8b0 2023-07-14T18:14:03.228 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:03.174+0000 7f0ce3fff700 1 -- 172.21.15.163:0/1575100598 <== mon.0 v2:172.21.15.163:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 9049+0+0 (secure 0 0 0) 0x7f0cf0004020 con 0x56025408b8b0 2023-07-14T18:14:03.229 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:03.174+0000 7f0d16d5eb80 1 -- 172.21.15.163:0/1575100598 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x560253f354f0 con 0x56025408b8b0 2023-07-14T18:14:03.229 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:03.175+0000 7f0ce3fff700 1 -- 172.21.15.163:0/1575100598 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0cf00041e0 con 0x56025408b8b0 2023-07-14T18:14:03.229 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:03.175+0000 7f0d16d5eb80 10 client.16065 fetch_fsmap learned FSMap version 29 2023-07-14T18:14:03.229 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:03.175+0000 7f0d16d5eb80 1 -- 172.21.15.163:0/1575100598 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) v3 -- 0x560253df2c60 con 0x56025408b8b0 2023-07-14T18:14:03.229 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:03.175+0000 7f0ce3fff700 1 -- 172.21.15.163:0/1575100598 <== mon.0 v2:172.21.15.163:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x560253f354f0 con 0x56025408b8b0 2023-07-14T18:14:03.229 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:03.175+0000 7f0ce3fff700 1 -- 172.21.15.163:0/1575100598 <== mon.0 v2:172.21.15.163:3300/0 5 ==== fsmap(e 29) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f0cf0004750 con 0x56025408b8b0 2023-07-14T18:14:03.229 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:03.175+0000 7f0d16d5eb80 10 client.16065 fetch_fsmap finished waiting for FSMap version 29 2023-07-14T18:14:03.229 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:03.175+0000 7f0d16d5eb80 10 client.16065 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-07-14T18:14:03.230 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:03.175+0000 7f0d16d5eb80 20 client.16065 populate_metadata read hostname 'smithi163' 2023-07-14T18:14:03.230 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:03.175+0000 7f0d16d5eb80 1 --2- 172.21.15.163:0/1575100598 >> [v2:172.21.15.172:6838/3850440096,v1:172.21.15.172:6839/3850440096] conn(0x5602540a0570 0x5602540a2980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:14:03.230 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:03.175+0000 7f0d16d5eb80 4 client.16065 mds_command: new command op to 24518 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-14T18:14:03.230 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:03.175+0000 7f0d16d5eb80 1 -- 172.21.15.163:0/1575100598 --> [v2:172.21.15.172:6838/3850440096,v1:172.21.15.172:6839/3850440096] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x560254059da0 con 0x5602540a0570 2023-07-14T18:14:03.230 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:03.175+0000 7f0d08962700 1 --2- 172.21.15.163:0/1575100598 >> [v2:172.21.15.172:6838/3850440096,v1:172.21.15.172:6839/3850440096] conn(0x5602540a0570 0x5602540a2980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:14:03.230 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:03.176+0000 7f0d08962700 1 --2- 172.21.15.163:0/1575100598 >> [v2:172.21.15.172:6838/3850440096,v1:172.21.15.172:6839/3850440096] conn(0x5602540a0570 0x5602540a2980 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=48eec25b427a10b6 server_cookie=8266095de84bded3 in_seq=0 out_seq=0 2023-07-14T18:14:03.230 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:03.176+0000 7f0ce3fff700 10 client.16065 ms_handle_connect on v2:172.21.15.172:6838/3850440096 2023-07-14T18:14:03.230 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:03.176+0000 7f0ce3fff700 1 -- 172.21.15.163:0/1575100598 <== mds.0 v2:172.21.15.172:6838/3850440096 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18017 (crc 0 0 0) 0x560254059da0 con 0x5602540a0570 2023-07-14T18:14:03.231 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:03.176+0000 7f0ce3fff700 10 client.16065 handle_command_reply: tid=0 2023-07-14T18:14:03.231 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:03.176+0000 7f0d16d5eb80 1 client.16065 shutdown 2023-07-14T18:14:03.231 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:03.176+0000 7f0d16d5eb80 1 -- 172.21.15.163:0/1575100598 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x56025408b8b0 msgr2=0x560254094ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:14:03.231 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:03.176+0000 7f0d16d5eb80 1 --2- 172.21.15.163:0/1575100598 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x56025408b8b0 0x560254094ed0 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f0cf000fc40 tx=0x7f0cf000ffd0 comp rx=0 tx=0).stop 2023-07-14T18:14:03.231 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:03.177+0000 7f0d16d5eb80 1 -- 172.21.15.163:0/1575100598 shutdown_connections 2023-07-14T18:14:03.231 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:03.177+0000 7f0d16d5eb80 1 --2- 172.21.15.163:0/1575100598 >> [v2:172.21.15.172:6838/3850440096,v1:172.21.15.172:6839/3850440096] conn(0x5602540a0570 0x5602540a2980 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:03.231 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:03.177+0000 7f0d16d5eb80 1 --2- 172.21.15.163:0/1575100598 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56025408c4b0 0x56025409bf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:03.231 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:03.177+0000 7f0ce3fff700 0 client.16065 ms_handle_reset on v2:172.21.15.172:6838/3850440096 2023-07-14T18:14:03.232 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:03.177+0000 7f0d16d5eb80 1 --2- 172.21.15.163:0/1575100598 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56025408af60 0x560254094990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:03.232 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:03.177+0000 7f0d16d5eb80 1 --2- 172.21.15.163:0/1575100598 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x56025408b8b0 0x560254094ed0 unknown :-1 s=CLOSED pgs=634 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:03.232 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:03.177+0000 7f0d16d5eb80 1 -- 172.21.15.163:0/1575100598 >> 172.21.15.163:0/1575100598 conn(0x560254080680 msgr2=0x560254084650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:14:03.232 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:03.177+0000 7f0d16d5eb80 1 -- 172.21.15.163:0/1575100598 shutdown_connections 2023-07-14T18:14:03.232 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:03.177+0000 7f0d16d5eb80 1 -- 172.21.15.163:0/1575100598 wait complete. 2023-07-14T18:14:03.232 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:03.177+0000 7f0d16d5eb80 20 client.16065 trim_cache size 0 max 16384 2023-07-14T18:14:03.234 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:03.190+0000 7f0d16d5eb80 1 Processor -- start 2023-07-14T18:14:03.234 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:03.190+0000 7f0d16d5eb80 1 -- start start 2023-07-14T18:14:03.235 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:03.190+0000 7f0d16d5eb80 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x56025408af60 0x560254092880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:14:03.235 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:03.190+0000 7f0d16d5eb80 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56025408b8b0 0x56025409bed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:14:03.235 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:03.190+0000 7f0d16d5eb80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56025408c4b0 0x56025408f390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:14:03.235 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:03.190+0000 7f0d16d5eb80 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x560254094500 con 0x56025408af60 2023-07-14T18:14:03.235 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:03.190+0000 7f0d16d5eb80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x560254095b30 con 0x56025408c4b0 2023-07-14T18:14:03.235 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:03.190+0000 7f0d16d5eb80 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x560254095610 con 0x56025408b8b0 2023-07-14T18:14:03.235 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:03.190+0000 7f0d08962700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x56025408af60 0x560254092880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:14:03.235 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:03.190+0000 7f0d08962700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x56025408af60 0x560254092880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:59022/0 (socket says 172.21.15.163:59022) 2023-07-14T18:14:03.236 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:03.190+0000 7f0d08962700 1 -- 172.21.15.163:0/612733542 learned_addr learned my addr 172.21.15.163:0/612733542 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:14:03.236 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:03.190+0000 7f0d03fff700 1 --2- 172.21.15.163:0/612733542 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56025408b8b0 0x56025409bed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:14:03.236 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:03.190+0000 7f0d09163700 1 --2- 172.21.15.163:0/612733542 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56025408c4b0 0x56025408f390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:14:03.236 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:03.190+0000 7f0d08962700 1 -- 172.21.15.163:0/612733542 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56025408b8b0 msgr2=0x56025409bed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:14:03.236 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:03.190+0000 7f0d08962700 1 --2- 172.21.15.163:0/612733542 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56025408b8b0 0x56025409bed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:03.236 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:03.190+0000 7f0d08962700 1 -- 172.21.15.163:0/612733542 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56025408c4b0 msgr2=0x56025408f390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:14:03.236 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:03.190+0000 7f0d08962700 1 --2- 172.21.15.163:0/612733542 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56025408c4b0 0x56025408f390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:03.237 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:03.190+0000 7f0d08962700 1 -- 172.21.15.163:0/612733542 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560253e30250 con 0x56025408af60 2023-07-14T18:14:03.237 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:03.190+0000 7f0d03fff700 1 --2- 172.21.15.163:0/612733542 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56025408b8b0 0x56025409bed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T18:14:03.237 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:03.190+0000 7f0d08962700 1 --2- 172.21.15.163:0/612733542 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x56025408af60 0x560254092880 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7f0cf8005910 tx=0x7f0cf8021000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=16312d0594412c81 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:14:03.237 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:03.190+0000 7f0cef7fe700 1 -- 172.21.15.163:0/612733542 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cf802c070 con 0x56025408af60 2023-07-14T18:14:03.237 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:03.190+0000 7f0cef7fe700 1 -- 172.21.15.163:0/612733542 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f0cf802d040 con 0x56025408af60 2023-07-14T18:14:03.237 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:03.190+0000 7f0cef7fe700 1 -- 172.21.15.163:0/612733542 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cf801e070 con 0x56025408af60 2023-07-14T18:14:03.237 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:03.191+0000 7f0d16d5eb80 1 -- 172.21.15.163:0/612733542 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x56025408af60 msgr2=0x560254092880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:14:03.237 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:03.191+0000 7f0d16d5eb80 1 --2- 172.21.15.163:0/612733542 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x56025408af60 0x560254092880 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7f0cf8005910 tx=0x7f0cf8021000 comp rx=0 tx=0).stop 2023-07-14T18:14:03.238 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:03.191+0000 7f0d16d5eb80 1 -- 172.21.15.163:0/612733542 shutdown_connections 2023-07-14T18:14:03.238 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:03.191+0000 7f0d16d5eb80 1 --2- 172.21.15.163:0/612733542 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56025408c4b0 0x56025408f390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:03.238 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:03.191+0000 7f0d16d5eb80 1 --2- 172.21.15.163:0/612733542 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x56025408af60 0x560254092880 unknown :-1 s=CLOSED pgs=635 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:03.238 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:03.191+0000 7f0d16d5eb80 1 --2- 172.21.15.163:0/612733542 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56025408b8b0 0x56025409bed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:03.238 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:03.191+0000 7f0d16d5eb80 1 -- 172.21.15.163:0/612733542 >> 172.21.15.163:0/612733542 conn(0x560254080680 msgr2=0x560254093670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:14:03.238 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:03.191+0000 7f0d16d5eb80 1 -- 172.21.15.163:0/612733542 shutdown_connections 2023-07-14T18:14:03.238 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:03.191+0000 7f0d16d5eb80 1 -- 172.21.15.163:0/612733542 wait complete. 2023-07-14T18:14:03.238 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:03.191+0000 7f0d16d5eb80 1 -- start start 2023-07-14T18:14:03.239 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:03.191+0000 7f0d16d5eb80 1 Processor -- start 2023-07-14T18:14:03.241 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:03.192+0000 7f0d16d5eb80 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x56025408af60 0x56025409b780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:14:03.241 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:03.192+0000 7f0d16d5eb80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56025408b8b0 0x56025409bcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:14:03.242 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:03.192+0000 7f0d16d5eb80 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56025408c4b0 0x560254098220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:14:03.242 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:03.192+0000 7f0d16d5eb80 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x560254098840 con 0x56025408af60 2023-07-14T18:14:03.242 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:03.192+0000 7f0d16d5eb80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x5602540989b0 con 0x56025408b8b0 2023-07-14T18:14:03.242 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:03.192+0000 7f0d16d5eb80 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x560254098b70 con 0x56025408c4b0 2023-07-14T18:14:03.242 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:03.192+0000 7f0d16d5eb80 10 client.0 _ll_register_callbacks cb 0x7f0cf8004120 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T18:14:03.242 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:03.192+0000 7f0d08962700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x56025408af60 0x56025409b780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:14:03.242 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:03.192+0000 7f0d08962700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x56025408af60 0x56025409b780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:59028/0 (socket says 172.21.15.163:59028) 2023-07-14T18:14:03.243 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:03.192+0000 7f0d08962700 1 -- 172.21.15.163:0/286424216 learned_addr learned my addr 172.21.15.163:0/286424216 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:14:03.243 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:03.192+0000 7f0d03fff700 1 --2- 172.21.15.163:0/286424216 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56025408b8b0 0x56025409bcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:14:03.243 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:03.192+0000 7f0d09163700 1 --2- 172.21.15.163:0/286424216 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56025408c4b0 0x560254098220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:14:03.243 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:03.192+0000 7f0d08962700 1 -- 172.21.15.163:0/286424216 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56025408c4b0 msgr2=0x560254098220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:14:03.243 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:03.192+0000 7f0d08962700 1 --2- 172.21.15.163:0/286424216 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56025408c4b0 0x560254098220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:03.243 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:03.192+0000 7f0d08962700 1 -- 172.21.15.163:0/286424216 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56025408b8b0 msgr2=0x56025409bcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:14:03.243 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:03.192+0000 7f0d08962700 1 --2- 172.21.15.163:0/286424216 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56025408b8b0 0x56025409bcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:03.243 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:03.192+0000 7f0d08962700 1 -- 172.21.15.163:0/286424216 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d04107880 con 0x56025408af60 2023-07-14T18:14:03.244 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:03.192+0000 7f0d08962700 1 --2- 172.21.15.163:0/286424216 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x56025408af60 0x56025409b780 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7f0cf8020040 tx=0x7f0cf8035d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f1c23abe463840b0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:14:03.244 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:03.192+0000 7f0ce3fff700 10 client.0 ms_handle_connect on v2:172.21.15.163:3300/0 2023-07-14T18:14:03.244 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:03.193+0000 7f0ce3fff700 1 -- 172.21.15.163:0/286424216 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cf801e050 con 0x56025408af60 2023-07-14T18:14:03.244 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:03.193+0000 7f0d16d5eb80 1 -- 172.21.15.163:0/286424216 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f0cf000fd40 con 0x56025408af60 2023-07-14T18:14:03.244 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:03.193+0000 7f0ce3fff700 1 -- 172.21.15.163:0/286424216 <== mon.0 v2:172.21.15.163:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 9049+0+0 (secure 0 0 0) 0x7f0cf8003a60 con 0x56025408af60 2023-07-14T18:14:03.244 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:03.193+0000 7f0ce3fff700 1 -- 172.21.15.163:0/286424216 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0cf802c040 con 0x56025408af60 2023-07-14T18:14:03.244 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:03.193+0000 7f0d16d5eb80 10 client.16071 fetch_fsmap learned FSMap version 29 2023-07-14T18:14:03.244 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:03.193+0000 7f0d16d5eb80 1 -- 172.21.15.163:0/286424216 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) v3 -- 0x560253e082b0 con 0x56025408af60 2023-07-14T18:14:03.245 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:03.193+0000 7f0ce3fff700 1 -- 172.21.15.163:0/286424216 <== mon.0 v2:172.21.15.163:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f0cf000fd40 con 0x56025408af60 2023-07-14T18:14:03.245 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:03.193+0000 7f0ce3fff700 1 -- 172.21.15.163:0/286424216 <== mon.0 v2:172.21.15.163:3300/0 5 ==== fsmap(e 29) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f0cf8004520 con 0x56025408af60 2023-07-14T18:14:03.245 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:03.193+0000 7f0d16d5eb80 10 client.16071 fetch_fsmap finished waiting for FSMap version 29 2023-07-14T18:14:03.245 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:03.193+0000 7f0d16d5eb80 10 client.16071 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-07-14T18:14:03.245 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:03.193+0000 7f0d16d5eb80 20 client.16071 populate_metadata read hostname 'smithi163' 2023-07-14T18:14:03.245 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:03.193+0000 7f0d16d5eb80 1 --2- 172.21.15.163:0/286424216 >> [v2:172.21.15.172:6838/3850440096,v1:172.21.15.172:6839/3850440096] conn(0x5602540f5420 0x5602540f7830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:14:03.245 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:03.193+0000 7f0d16d5eb80 4 client.16071 mds_command: new command op to 24518 tid=0[{"prefix": "damage ls"}] 2023-07-14T18:14:03.245 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:03.193+0000 7f0d16d5eb80 1 -- 172.21.15.163:0/286424216 --> [v2:172.21.15.172:6838/3850440096,v1:172.21.15.172:6839/3850440096] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x560253fd4eb0 con 0x5602540f5420 2023-07-14T18:14:03.246 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:03.193+0000 7f0d03fff700 1 --2- 172.21.15.163:0/286424216 >> [v2:172.21.15.172:6838/3850440096,v1:172.21.15.172:6839/3850440096] conn(0x5602540f5420 0x5602540f7830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:14:03.246 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:03.194+0000 7f0ce3fff700 10 client.16071 ms_handle_connect on v2:172.21.15.172:6838/3850440096 2023-07-14T18:14:03.246 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:03.194+0000 7f0d03fff700 1 --2- 172.21.15.163:0/286424216 >> [v2:172.21.15.172:6838/3850440096,v1:172.21.15.172:6839/3850440096] conn(0x5602540f5420 0x5602540f7830 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b65141b9c821f5f8 server_cookie=4da9c437527c74ce in_seq=0 out_seq=0 2023-07-14T18:14:03.246 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:03.194+0000 7f0ce3fff700 1 -- 172.21.15.163:0/286424216 <== mds.0 v2:172.21.15.172:6838/3850440096 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x560253fd4eb0 con 0x5602540f5420 2023-07-14T18:14:03.246 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:03.194+0000 7f0ce3fff700 10 client.16071 handle_command_reply: tid=0 2023-07-14T18:14:03.246 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:03.194+0000 7f0d16d5eb80 1 client.16071 shutdown 2023-07-14T18:14:03.246 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:03.194+0000 7f0d16d5eb80 1 -- 172.21.15.163:0/286424216 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x56025408af60 msgr2=0x56025409b780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:14:03.247 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:03.194+0000 7f0d16d5eb80 1 --2- 172.21.15.163:0/286424216 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x56025408af60 0x56025409b780 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7f0cf8020040 tx=0x7f0cf8035d30 comp rx=0 tx=0).stop 2023-07-14T18:14:03.247 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:03.194+0000 7f0d16d5eb80 1 -- 172.21.15.163:0/286424216 shutdown_connections 2023-07-14T18:14:03.247 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:03.194+0000 7f0d16d5eb80 1 --2- 172.21.15.163:0/286424216 >> [v2:172.21.15.172:6838/3850440096,v1:172.21.15.172:6839/3850440096] conn(0x5602540f5420 0x5602540f7830 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:03.247 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:03.194+0000 7f0d16d5eb80 1 --2- 172.21.15.163:0/286424216 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56025408c4b0 0x560254098220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:03.247 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:03.194+0000 7f0d16d5eb80 1 --2- 172.21.15.163:0/286424216 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x56025408af60 0x56025409b780 unknown :-1 s=CLOSED pgs=636 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:03.247 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:03.194+0000 7f0d16d5eb80 1 --2- 172.21.15.163:0/286424216 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56025408b8b0 0x56025409bcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:03.247 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:03.194+0000 7f0ce3fff700 0 client.16071 ms_handle_reset on v2:172.21.15.172:6838/3850440096 2023-07-14T18:14:03.247 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:03.194+0000 7f0d16d5eb80 1 -- 172.21.15.163:0/286424216 >> 172.21.15.163:0/286424216 conn(0x560254080680 msgr2=0x560254092880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:14:03.248 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:03.194+0000 7f0d16d5eb80 1 -- 172.21.15.163:0/286424216 shutdown_connections 2023-07-14T18:14:03.248 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:03.194+0000 7f0d16d5eb80 1 -- 172.21.15.163:0/286424216 wait complete. 2023-07-14T18:14:03.248 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:03.194+0000 7f0d16d5eb80 20 client.16071 trim_cache size 0 max 16384 2023-07-14T18:14:03.248 INFO:teuthology.orchestra.run.smithi163.stdout:[] 2023-07-14T18:14:03.249 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:03.195+0000 7f0d0abc6700 1 -- 172.21.15.163:0/95391584 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f0cf40a1150 msgr2=0x7f0cf40a3600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:14:03.249 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:03.195+0000 7f0d0abc6700 1 --2- 172.21.15.163:0/95391584 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f0cf40a1150 0x7f0cf40a3600 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f0cf8000c00 tx=0x7f0cf8005fb0 comp rx=0 tx=0).stop 2023-07-14T18:14:03.250 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:03.195+0000 7f0d0abc6700 1 -- 172.21.15.163:0/95391584 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f0d04100770 msgr2=0x7f0d0419ccd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:14:03.250 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:03.195+0000 7f0d0abc6700 1 --2- 172.21.15.163:0/95391584 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f0d04100770 0x7f0d0419ccd0 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f0cfc00c370 tx=0x7f0cfc00c730 comp rx=0 tx=0).stop 2023-07-14T18:14:03.250 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:03.195+0000 7f0d0abc6700 1 -- 172.21.15.163:0/95391584 shutdown_connections 2023-07-14T18:14:03.250 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:03.195+0000 7f0d0abc6700 1 --2- 172.21.15.163:0/95391584 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f0cf40a1150 0x7f0cf40a3600 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:03.250 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:03.195+0000 7f0d0abc6700 1 --2- 172.21.15.163:0/95391584 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f0d04100770 0x7f0d0419ccd0 unknown :-1 s=CLOSED pgs=632 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:03.250 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:03.195+0000 7f0d0abc6700 1 --2- 172.21.15.163:0/95391584 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0d040feb30 0x7f0d040694e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:03.250 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:03.195+0000 7f0d0abc6700 1 --2- 172.21.15.163:0/95391584 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0d040ffdc0 0x7f0d0419a680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:03.251 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:03.195+0000 7f0d0abc6700 1 -- 172.21.15.163:0/95391584 >> 172.21.15.163:0/95391584 conn(0x7f0d040fa150 msgr2=0x7f0d04103400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:14:03.251 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:03.195+0000 7f0d0abc6700 1 -- 172.21.15.163:0/95391584 shutdown_connections 2023-07-14T18:14:03.251 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:03.195+0000 7f0d0abc6700 1 -- 172.21.15.163:0/95391584 wait complete. 2023-07-14T18:14:03.277 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:14:02 smithi172 ceph-mon[97983]: pgmap v341: 129 pgs: 129 active+clean; 16 MiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 1.3 MiB/s wr, 49 op/s 2023-07-14T18:14:03.278 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:14:02 smithi172 ceph-mon[97983]: from='client.? 172.21.15.163:0/3135137251' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-07-14T18:14:04.252 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2023-07-14T18:14:04.252 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2023-07-14T18:14:04.411 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:04.369+0000 7fce5e7f0700 1 -- 172.21.15.163:0/3463756451 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fce580fed00 msgr2=0x7fce580ff170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:14:04.412 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:04.369+0000 7fce5e7f0700 1 --2- 172.21.15.163:0/3463756451 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fce580fed00 0x7fce580ff170 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fce4c009990 tx=0x7fce4c009ca0 comp rx=0 tx=0).stop 2023-07-14T18:14:04.412 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:04.369+0000 7fce5e7f0700 1 -- 172.21.15.163:0/3463756451 shutdown_connections 2023-07-14T18:14:04.412 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:04.369+0000 7fce5e7f0700 1 --2- 172.21.15.163:0/3463756451 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fce580ff6b0 0x7fce58106f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:04.412 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:04.369+0000 7fce5e7f0700 1 --2- 172.21.15.163:0/3463756451 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fce581000b0 0x7fce581004c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:04.412 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:04.369+0000 7fce5e7f0700 1 --2- 172.21.15.163:0/3463756451 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fce580fed00 0x7fce580ff170 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:04.412 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:04.369+0000 7fce5e7f0700 1 -- 172.21.15.163:0/3463756451 >> 172.21.15.163:0/3463756451 conn(0x7fce580f98a0 msgr2=0x7fce580fbcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:14:04.413 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:04.370+0000 7fce5e7f0700 1 -- 172.21.15.163:0/3463756451 shutdown_connections 2023-07-14T18:14:04.413 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:04.370+0000 7fce5e7f0700 1 -- 172.21.15.163:0/3463756451 wait complete. 2023-07-14T18:14:04.414 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:04.370+0000 7fce5e7f0700 1 Processor -- start 2023-07-14T18:14:04.415 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:04.370+0000 7fce5e7f0700 1 -- start start 2023-07-14T18:14:04.415 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:04.371+0000 7fce5e7f0700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fce580fed00 0x7fce580fe760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:14:04.415 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:04.371+0000 7fce5e7f0700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fce580ff6b0 0x7fce5819ca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:14:04.415 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:04.371+0000 7fce5e7f0700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fce581000b0 0x7fce5819ef50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:14:04.415 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:04.371+0000 7fce5e7f0700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce5819f600 con 0x7fce580ff6b0 2023-07-14T18:14:04.415 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:04.371+0000 7fce5e7f0700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce5819f770 con 0x7fce581000b0 2023-07-14T18:14:04.415 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:04.371+0000 7fce5e7f0700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce5819f930 con 0x7fce580fed00 2023-07-14T18:14:04.415 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:04.371+0000 7fce577fe700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fce580ff6b0 0x7fce5819ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:14:04.416 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:04.371+0000 7fce577fe700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fce580ff6b0 0x7fce5819ca00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:59044/0 (socket says 172.21.15.163:59044) 2023-07-14T18:14:04.416 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:04.371+0000 7fce577fe700 1 -- 172.21.15.163:0/3450848595 learned_addr learned my addr 172.21.15.163:0/3450848595 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:14:04.416 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:04.371+0000 7fce57fff700 1 --2- 172.21.15.163:0/3450848595 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fce580fed00 0x7fce580fe760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:14:04.416 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:04.371+0000 7fce5cd8d700 1 --2- 172.21.15.163:0/3450848595 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fce581000b0 0x7fce5819ef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:14:04.416 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:04.371+0000 7fce5cd8d700 1 -- 172.21.15.163:0/3450848595 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fce580fed00 msgr2=0x7fce580fe760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:14:04.416 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:04.371+0000 7fce5cd8d700 1 --2- 172.21.15.163:0/3450848595 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fce580fed00 0x7fce580fe760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:04.416 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:04.371+0000 7fce5cd8d700 1 -- 172.21.15.163:0/3450848595 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fce580ff6b0 msgr2=0x7fce5819ca00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:14:04.417 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:04.371+0000 7fce5cd8d700 1 --2- 172.21.15.163:0/3450848595 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fce580ff6b0 0x7fce5819ca00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:04.417 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:04.371+0000 7fce5cd8d700 1 -- 172.21.15.163:0/3450848595 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce4c0095f0 con 0x7fce581000b0 2023-07-14T18:14:04.417 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:04.371+0000 7fce57fff700 1 --2- 172.21.15.163:0/3450848595 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fce580fed00 0x7fce580fe760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T18:14:04.417 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:04.371+0000 7fce577fe700 1 --2- 172.21.15.163:0/3450848595 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fce580ff6b0 0x7fce5819ca00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T18:14:04.417 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:04.372+0000 7fce5cd8d700 1 --2- 172.21.15.163:0/3450848595 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fce581000b0 0x7fce5819ef50 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fce5000efc0 tx=0x7fce5000c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:14:04.417 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:04.372+0000 7fce557fa700 1 -- 172.21.15.163:0/3450848595 <== mon.2 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce50018070 con 0x7fce581000b0 2023-07-14T18:14:04.417 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:04.372+0000 7fce557fa700 1 -- 172.21.15.163:0/3450848595 <== mon.2 v2:172.21.15.172:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fce5000f040 con 0x7fce581000b0 2023-07-14T18:14:04.417 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:04.372+0000 7fce557fa700 1 -- 172.21.15.163:0/3450848595 <== mon.2 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce5000cba0 con 0x7fce581000b0 2023-07-14T18:14:04.418 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:04.372+0000 7fce5e7f0700 1 -- 172.21.15.163:0/3450848595 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fce5819fbb0 con 0x7fce581000b0 2023-07-14T18:14:04.418 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:04.372+0000 7fce5e7f0700 1 -- 172.21.15.163:0/3450848595 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fce581a0070 con 0x7fce581000b0 2023-07-14T18:14:04.419 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:04.375+0000 7fce557fa700 1 -- 172.21.15.163:0/3450848595 <== mon.2 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 18) v1 ==== 135716+0+0 (secure 0 0 0) 0x7fce50003a00 con 0x7fce581000b0 2023-07-14T18:14:04.419 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:04.375+0000 7fce557fa700 1 --2- 172.21.15.163:0/3450848595 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7fce400a11d0 0x7fce400a3680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:14:04.420 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:04.376+0000 7fce57fff700 1 --2- 172.21.15.163:0/3450848595 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7fce400a11d0 0x7fce400a3680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:14:04.420 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:04.376+0000 7fce557fa700 1 -- 172.21.15.163:0/3450848595 <== mon.2 v2:172.21.15.172:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 9049+0+0 (secure 0 0 0) 0x7fce500cc6b0 con 0x7fce581000b0 2023-07-14T18:14:04.420 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:04.376+0000 7fce57fff700 1 --2- 172.21.15.163:0/3450848595 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7fce400a11d0 0x7fce400a3680 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fce48011490 tx=0x7fce48009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:14:04.420 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:04.377+0000 7fce6a988b80 1 Processor -- start 2023-07-14T18:14:04.420 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:04.377+0000 7fce6a988b80 1 -- start start 2023-07-14T18:14:04.420 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:04.377+0000 7fce6a988b80 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x557f19cb3fe0 0x557f19cb43f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:14:04.420 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:04.377+0000 7fce6a988b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557f19cb4930 0x557f19cb4f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:14:04.421 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:04.377+0000 7fce6a988b80 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x557f19cb5530 0x557f19cb59a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:14:04.421 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:04.377+0000 7fce6a988b80 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x557f19bb8d30 con 0x557f19cb3fe0 2023-07-14T18:14:04.421 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:04.377+0000 7fce6a988b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x557f19c0bac0 con 0x557f19cb4930 2023-07-14T18:14:04.421 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:04.377+0000 7fce6a988b80 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x557f19c04f50 con 0x557f19cb5530 2023-07-14T18:14:04.421 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:04.377+0000 7fce57fff700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x557f19cb3fe0 0x557f19cb43f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:14:04.421 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:04.377+0000 7fce57fff700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x557f19cb3fe0 0x557f19cb43f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:59050/0 (socket says 172.21.15.163:59050) 2023-07-14T18:14:04.421 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:04.377+0000 7fce57fff700 1 -- 172.21.15.163:0/1796316416 learned_addr learned my addr 172.21.15.163:0/1796316416 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:14:04.421 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:04.377+0000 7fce577fe700 1 --2- 172.21.15.163:0/1796316416 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557f19cb4930 0x557f19cb4f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:14:04.422 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:04.377+0000 7fce5cd8d700 1 --2- 172.21.15.163:0/1796316416 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x557f19cb5530 0x557f19cb59a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:14:04.422 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:04.378+0000 7fce577fe700 1 -- 172.21.15.163:0/1796316416 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x557f19cb5530 msgr2=0x557f19cb59a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:14:04.422 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:04.378+0000 7fce577fe700 1 --2- 172.21.15.163:0/1796316416 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x557f19cb5530 0x557f19cb59a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:04.422 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:04.378+0000 7fce577fe700 1 -- 172.21.15.163:0/1796316416 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x557f19cb3fe0 msgr2=0x557f19cb43f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:14:04.422 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:04.378+0000 7fce577fe700 1 --2- 172.21.15.163:0/1796316416 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x557f19cb3fe0 0x557f19cb43f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:04.422 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:04.378+0000 7fce577fe700 1 -- 172.21.15.163:0/1796316416 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557f19a32e60 con 0x557f19cb4930 2023-07-14T18:14:04.422 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:04.378+0000 7fce5cd8d700 1 --2- 172.21.15.163:0/1796316416 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x557f19cb5530 0x557f19cb59a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T18:14:04.425 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:04.378+0000 7fce577fe700 1 --2- 172.21.15.163:0/1796316416 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557f19cb4930 0x557f19cb4f50 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fce4c0098e0 tx=0x7fce4c005ec0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e497523682d363de server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:14:04.426 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:04.378+0000 7fce3e7fc700 1 -- 172.21.15.163:0/1796316416 <== mon.2 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce4c01d050 con 0x557f19cb4930 2023-07-14T18:14:04.426 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:04.378+0000 7fce3e7fc700 1 -- 172.21.15.163:0/1796316416 <== mon.2 v2:172.21.15.172:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fce4c01e040 con 0x557f19cb4930 2023-07-14T18:14:04.426 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:04.378+0000 7fce3e7fc700 1 -- 172.21.15.163:0/1796316416 <== mon.2 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce4c005030 con 0x557f19cb4930 2023-07-14T18:14:04.426 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:04.379+0000 7fce6a988b80 1 -- 172.21.15.163:0/1796316416 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557f19cb4930 msgr2=0x557f19cb4f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:14:04.426 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:04.379+0000 7fce6a988b80 1 --2- 172.21.15.163:0/1796316416 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557f19cb4930 0x557f19cb4f50 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fce4c0098e0 tx=0x7fce4c005ec0 comp rx=0 tx=0).stop 2023-07-14T18:14:04.426 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:04.379+0000 7fce6a988b80 1 -- 172.21.15.163:0/1796316416 shutdown_connections 2023-07-14T18:14:04.426 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:04.379+0000 7fce6a988b80 1 --2- 172.21.15.163:0/1796316416 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x557f19cb5530 0x557f19cb59a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:04.426 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:04.379+0000 7fce6a988b80 1 --2- 172.21.15.163:0/1796316416 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x557f19cb3fe0 0x557f19cb43f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:04.427 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:04.379+0000 7fce6a988b80 1 --2- 172.21.15.163:0/1796316416 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557f19cb4930 0x557f19cb4f50 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:04.427 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:04.379+0000 7fce6a988b80 1 -- 172.21.15.163:0/1796316416 >> 172.21.15.163:0/1796316416 conn(0x557f19ca9700 msgr2=0x557f19caea50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:14:04.427 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:04.379+0000 7fce6a988b80 1 -- 172.21.15.163:0/1796316416 shutdown_connections 2023-07-14T18:14:04.427 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:04.379+0000 7fce6a988b80 1 -- 172.21.15.163:0/1796316416 wait complete. 2023-07-14T18:14:04.427 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:04.379+0000 7fce6a988b80 1 -- start start 2023-07-14T18:14:04.427 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:04.380+0000 7fce6a988b80 1 Processor -- start 2023-07-14T18:14:04.427 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:04.380+0000 7fce6a988b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557f19cb3fe0 0x557f19cbd980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:14:04.428 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:04.380+0000 7fce6a988b80 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x557f19cb4930 0x557f19cbdec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:14:04.428 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:04.380+0000 7fce6a988b80 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x557f19cb5530 0x557f19cc4f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:14:04.428 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:04.380+0000 7fce6a988b80 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x557f19ba4b40 con 0x557f19cb4930 2023-07-14T18:14:04.428 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:04.380+0000 7fce6a988b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x557f19ba4840 con 0x557f19cb3fe0 2023-07-14T18:14:04.428 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:04.380+0000 7fce6a988b80 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x557f19a889a0 con 0x557f19cb5530 2023-07-14T18:14:04.428 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:04.380+0000 7fce6a988b80 10 client.0 _ll_register_callbacks cb 0x557f19ba27e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T18:14:04.428 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:04.380+0000 7fce577fe700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x557f19cb4930 0x557f19cbdec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:14:04.428 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:04.380+0000 7fce57fff700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557f19cb3fe0 0x557f19cbd980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:14:04.429 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:04.380+0000 7fce577fe700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x557f19cb4930 0x557f19cbdec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:59058/0 (socket says 172.21.15.163:59058) 2023-07-14T18:14:04.429 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:04.380+0000 7fce57fff700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557f19cb3fe0 0x557f19cbd980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.163:59740/0 (socket says 172.21.15.163:59740) 2023-07-14T18:14:04.429 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:04.380+0000 7fce577fe700 1 -- 172.21.15.163:0/1594024304 learned_addr learned my addr 172.21.15.163:0/1594024304 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:14:04.429 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:04.380+0000 7fce5cd8d700 1 --2- 172.21.15.163:0/1594024304 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x557f19cb5530 0x557f19cc4f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:14:04.429 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:04.381+0000 7fce57fff700 1 -- 172.21.15.163:0/1594024304 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x557f19cb5530 msgr2=0x557f19cc4f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:14:04.429 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:04.381+0000 7fce57fff700 1 --2- 172.21.15.163:0/1594024304 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x557f19cb5530 0x557f19cc4f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:04.429 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:04.381+0000 7fce57fff700 1 -- 172.21.15.163:0/1594024304 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x557f19cb4930 msgr2=0x557f19cbdec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:14:04.429 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:04.381+0000 7fce57fff700 1 --2- 172.21.15.163:0/1594024304 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x557f19cb4930 0x557f19cbdec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:04.430 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:04.381+0000 7fce57fff700 1 -- 172.21.15.163:0/1594024304 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fce58107850 con 0x557f19cb3fe0 2023-07-14T18:14:04.430 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:04.381+0000 7fce577fe700 1 --2- 172.21.15.163:0/1594024304 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x557f19cb4930 0x557f19cbdec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T18:14:04.430 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:04.381+0000 7fce57fff700 1 --2- 172.21.15.163:0/1594024304 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557f19cb3fe0 0x557f19cbd980 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fce48011be0 tx=0x7fce480047c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=978ad63859c33cd2 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:14:04.430 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:04.381+0000 7fce377fe700 10 client.0 ms_handle_connect on v2:172.21.15.172:3300/0 2023-07-14T18:14:04.430 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:04.381+0000 7fce377fe700 1 -- 172.21.15.163:0/1594024304 <== mon.2 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce4801fca0 con 0x557f19cb3fe0 2023-07-14T18:14:04.430 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:04.381+0000 7fce377fe700 1 -- 172.21.15.163:0/1594024304 <== mon.2 v2:172.21.15.172:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 9049+0+0 (secure 0 0 0) 0x7fce48003e40 con 0x557f19cb3fe0 2023-07-14T18:14:04.430 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:04.381+0000 7fce6a988b80 1 -- 172.21.15.163:0/1594024304 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x557f19b5e570 con 0x557f19cb3fe0 2023-07-14T18:14:04.430 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:04.381+0000 7fce377fe700 1 -- 172.21.15.163:0/1594024304 <== mon.2 v2:172.21.15.172:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7fce4801fe00 con 0x557f19cb3fe0 2023-07-14T18:14:04.431 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:04.381+0000 7fce6a988b80 10 client.25715 fetch_fsmap learned FSMap version 29 2023-07-14T18:14:04.431 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:04.381+0000 7fce6a988b80 1 -- 172.21.15.163:0/1594024304 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) v3 -- 0x557f19a1bce0 con 0x557f19cb3fe0 2023-07-14T18:14:04.431 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:04.381+0000 7fce377fe700 1 -- 172.21.15.163:0/1594024304 <== mon.2 v2:172.21.15.172:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x557f19b5e570 con 0x557f19cb3fe0 2023-07-14T18:14:04.431 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:04.382+0000 7fce377fe700 1 -- 172.21.15.163:0/1594024304 <== mon.2 v2:172.21.15.172:3300/0 5 ==== fsmap(e 29) v1 ==== 7470+0+0 (secure 0 0 0) 0x7fce480273e0 con 0x557f19cb3fe0 2023-07-14T18:14:04.431 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:04.382+0000 7fce6a988b80 10 client.25715 fetch_fsmap finished waiting for FSMap version 29 2023-07-14T18:14:04.431 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:04.382+0000 7fce6a988b80 10 client.25715 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-07-14T18:14:04.431 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:04.382+0000 7fce6a988b80 20 client.25715 populate_metadata read hostname 'smithi163' 2023-07-14T18:14:04.432 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:04.382+0000 7fce6a988b80 1 --2- 172.21.15.163:0/1594024304 >> [v2:172.21.15.172:6838/3850440096,v1:172.21.15.172:6839/3850440096] conn(0x557f19cc9810 0x557f19ccbc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:14:04.432 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:04.382+0000 7fce6a988b80 4 client.25715 mds_command: new command op to 24518 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-14T18:14:04.432 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:04.382+0000 7fce6a988b80 1 -- 172.21.15.163:0/1594024304 --> [v2:172.21.15.172:6838/3850440096,v1:172.21.15.172:6839/3850440096] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x557f19c82e20 con 0x557f19cc9810 2023-07-14T18:14:04.432 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:04.382+0000 7fce577fe700 1 --2- 172.21.15.163:0/1594024304 >> [v2:172.21.15.172:6838/3850440096,v1:172.21.15.172:6839/3850440096] conn(0x557f19cc9810 0x557f19ccbc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:14:04.432 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:04.382+0000 7fce377fe700 10 client.25715 ms_handle_connect on v2:172.21.15.172:6838/3850440096 2023-07-14T18:14:04.432 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:04.382+0000 7fce577fe700 1 --2- 172.21.15.163:0/1594024304 >> [v2:172.21.15.172:6838/3850440096,v1:172.21.15.172:6839/3850440096] conn(0x557f19cc9810 0x557f19ccbc20 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e1b4aea5339ca459 server_cookie=89dc9a423cb6b608 in_seq=0 out_seq=0 2023-07-14T18:14:04.432 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:04.383+0000 7fce377fe700 1 -- 172.21.15.163:0/1594024304 <== mds.0 v2:172.21.15.172:6838/3850440096 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18017 (crc 0 0 0) 0x557f19c82e20 con 0x557f19cc9810 2023-07-14T18:14:04.432 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:04.383+0000 7fce377fe700 10 client.25715 handle_command_reply: tid=0 2023-07-14T18:14:04.433 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:04.383+0000 7fce6a988b80 1 client.25715 shutdown 2023-07-14T18:14:04.433 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:04.383+0000 7fce6a988b80 1 -- 172.21.15.163:0/1594024304 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557f19cb3fe0 msgr2=0x557f19cbd980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:14:04.433 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:04.383+0000 7fce6a988b80 1 --2- 172.21.15.163:0/1594024304 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557f19cb3fe0 0x557f19cbd980 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fce48011be0 tx=0x7fce480047c0 comp rx=0 tx=0).stop 2023-07-14T18:14:04.433 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:04.383+0000 7fce6a988b80 1 -- 172.21.15.163:0/1594024304 shutdown_connections 2023-07-14T18:14:04.433 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:04.383+0000 7fce6a988b80 1 --2- 172.21.15.163:0/1594024304 >> [v2:172.21.15.172:6838/3850440096,v1:172.21.15.172:6839/3850440096] conn(0x557f19cc9810 0x557f19ccbc20 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:04.433 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:04.383+0000 7fce6a988b80 1 --2- 172.21.15.163:0/1594024304 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x557f19cb5530 0x557f19cc4f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:04.433 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:04.383+0000 7fce6a988b80 1 --2- 172.21.15.163:0/1594024304 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557f19cb3fe0 0x557f19cbd980 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:04.433 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:04.383+0000 7fce377fe700 0 client.25715 ms_handle_reset on v2:172.21.15.172:6838/3850440096 2023-07-14T18:14:04.434 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:04.383+0000 7fce6a988b80 1 --2- 172.21.15.163:0/1594024304 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x557f19cb4930 0x557f19cbdec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:04.434 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:04.383+0000 7fce6a988b80 1 -- 172.21.15.163:0/1594024304 >> 172.21.15.163:0/1594024304 conn(0x557f19ca9700 msgr2=0x557f19cad6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:14:04.434 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:04.383+0000 7fce6a988b80 1 -- 172.21.15.163:0/1594024304 shutdown_connections 2023-07-14T18:14:04.434 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:04.383+0000 7fce6a988b80 1 -- 172.21.15.163:0/1594024304 wait complete. 2023-07-14T18:14:04.434 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:04.384+0000 7fce6a988b80 20 client.25715 trim_cache size 0 max 16384 2023-07-14T18:14:04.449 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:04.406+0000 7fce6a988b80 1 Processor -- start 2023-07-14T18:14:04.449 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:04.406+0000 7fce6a988b80 1 -- start start 2023-07-14T18:14:04.449 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:04.407+0000 7fce6a988b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557f19cb3fe0 0x557f19cbb900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:14:04.449 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:04.407+0000 7fce6a988b80 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x557f19cb4930 0x557f19cc4ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:14:04.449 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:04.407+0000 7fce6a988b80 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x557f19cb5530 0x557f19cb8410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:14:04.449 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:04.407+0000 7fce6a988b80 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x557f19caf540 con 0x557f19cb5530 2023-07-14T18:14:04.449 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:04.407+0000 7fce6a988b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x557f19ca9320 con 0x557f19cb3fe0 2023-07-14T18:14:04.450 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:04.407+0000 7fce6a988b80 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x557f19cafd40 con 0x557f19cb4930 2023-07-14T18:14:04.450 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:04.407+0000 7fce57fff700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557f19cb3fe0 0x557f19cbb900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:14:04.450 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:04.407+0000 7fce577fe700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x557f19cb4930 0x557f19cc4ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:14:04.450 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:04.407+0000 7fce5cd8d700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x557f19cb5530 0x557f19cb8410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:14:04.450 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:04.407+0000 7fce57fff700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557f19cb3fe0 0x557f19cbb900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.163:59748/0 (socket says 172.21.15.163:59748) 2023-07-14T18:14:04.450 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:04.407+0000 7fce577fe700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x557f19cb4930 0x557f19cc4ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.163:40888/0 (socket says 172.21.15.163:40888) 2023-07-14T18:14:04.450 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:04.407+0000 7fce5cd8d700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x557f19cb5530 0x557f19cb8410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:59068/0 (socket says 172.21.15.163:59068) 2023-07-14T18:14:04.451 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:04.407+0000 7fce57fff700 1 -- 172.21.15.163:0/1119690114 learned_addr learned my addr 172.21.15.163:0/1119690114 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:14:04.453 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:04.407+0000 7fce57fff700 1 -- 172.21.15.163:0/1119690114 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x557f19cb4930 msgr2=0x557f19cc4ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:14:04.453 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:04.407+0000 7fce57fff700 1 --2- 172.21.15.163:0/1119690114 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x557f19cb4930 0x557f19cc4ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:04.453 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:04.407+0000 7fce57fff700 1 -- 172.21.15.163:0/1119690114 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x557f19cb5530 msgr2=0x557f19cb8410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:14:04.453 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:04.407+0000 7fce57fff700 1 --2- 172.21.15.163:0/1119690114 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x557f19cb5530 0x557f19cb8410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:04.454 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:04.407+0000 7fce57fff700 1 -- 172.21.15.163:0/1119690114 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557f19a592d0 con 0x557f19cb3fe0 2023-07-14T18:14:04.454 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:04.407+0000 7fce577fe700 1 --2- 172.21.15.163:0/1119690114 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x557f19cb4930 0x557f19cc4ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T18:14:04.454 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:04.407+0000 7fce5cd8d700 1 --2- 172.21.15.163:0/1119690114 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x557f19cb5530 0x557f19cb8410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T18:14:04.454 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:04.407+0000 7fce57fff700 1 --2- 172.21.15.163:0/1119690114 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557f19cb3fe0 0x557f19cbb900 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fce48013010 tx=0x7fce48004680 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7030a22f510eeb8e server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:14:04.454 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:04.408+0000 7fce3effd700 1 -- 172.21.15.163:0/1119690114 <== mon.2 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce4801f6e0 con 0x557f19cb3fe0 2023-07-14T18:14:04.454 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:04.408+0000 7fce3effd700 1 -- 172.21.15.163:0/1119690114 <== mon.2 v2:172.21.15.172:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fce48003e40 con 0x557f19cb3fe0 2023-07-14T18:14:04.454 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:04.408+0000 7fce3effd700 1 -- 172.21.15.163:0/1119690114 <== mon.2 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce48036730 con 0x557f19cb3fe0 2023-07-14T18:14:04.455 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:04.408+0000 7fce6a988b80 1 -- 172.21.15.163:0/1119690114 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557f19cb3fe0 msgr2=0x557f19cbb900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:14:04.455 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:04.408+0000 7fce6a988b80 1 --2- 172.21.15.163:0/1119690114 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557f19cb3fe0 0x557f19cbb900 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fce48013010 tx=0x7fce48004680 comp rx=0 tx=0).stop 2023-07-14T18:14:04.455 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:04.408+0000 7fce6a988b80 1 -- 172.21.15.163:0/1119690114 shutdown_connections 2023-07-14T18:14:04.455 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:04.408+0000 7fce6a988b80 1 --2- 172.21.15.163:0/1119690114 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x557f19cb5530 0x557f19cb8410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:04.455 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:04.408+0000 7fce6a988b80 1 --2- 172.21.15.163:0/1119690114 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557f19cb3fe0 0x557f19cbb900 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:04.455 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:04.408+0000 7fce6a988b80 1 --2- 172.21.15.163:0/1119690114 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x557f19cb4930 0x557f19cc4ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:04.455 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:04.409+0000 7fce6a988b80 1 -- 172.21.15.163:0/1119690114 >> 172.21.15.163:0/1119690114 conn(0x557f19ca9700 msgr2=0x557f19cae170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:14:04.455 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:04.409+0000 7fce6a988b80 1 -- 172.21.15.163:0/1119690114 shutdown_connections 2023-07-14T18:14:04.456 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:04.409+0000 7fce6a988b80 1 -- 172.21.15.163:0/1119690114 wait complete. 2023-07-14T18:14:04.456 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:04.409+0000 7fce6a988b80 1 -- start start 2023-07-14T18:14:04.456 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:04.409+0000 7fce6a988b80 1 Processor -- start 2023-07-14T18:14:04.456 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:04.409+0000 7fce6a988b80 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x557f19cb3fe0 0x557f19cc24b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:14:04.456 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:04.409+0000 7fce6a988b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557f19cb4930 0x557f19cc29f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:14:04.456 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:04.409+0000 7fce6a988b80 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x557f19cb5530 0x557f19cc3a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:14:04.456 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:04.409+0000 7fce6a988b80 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x557f19cc3f40 con 0x557f19cb5530 2023-07-14T18:14:04.456 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:04.409+0000 7fce6a988b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x557f19cc40b0 con 0x557f19cb4930 2023-07-14T18:14:04.457 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:04.409+0000 7fce6a988b80 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x557f19cc4270 con 0x557f19cb3fe0 2023-07-14T18:14:04.457 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:04.410+0000 7fce6a988b80 10 client.0 _ll_register_callbacks cb 0x7fce48003680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T18:14:04.457 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:04.410+0000 7fce577fe700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557f19cb4930 0x557f19cc29f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:14:04.457 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:04.410+0000 7fce577fe700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557f19cb4930 0x557f19cc29f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.163:59756/0 (socket says 172.21.15.163:59756) 2023-07-14T18:14:04.457 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:04.410+0000 7fce577fe700 1 -- 172.21.15.163:0/2272738280 learned_addr learned my addr 172.21.15.163:0/2272738280 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:14:04.457 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:04.410+0000 7fce57fff700 1 --2- 172.21.15.163:0/2272738280 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x557f19cb3fe0 0x557f19cc24b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:14:04.457 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:04.410+0000 7fce5cd8d700 1 --2- 172.21.15.163:0/2272738280 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x557f19cb5530 0x557f19cc3a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:14:04.458 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:04.410+0000 7fce57fff700 1 -- 172.21.15.163:0/2272738280 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557f19cb4930 msgr2=0x557f19cc29f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:14:04.458 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:04.410+0000 7fce57fff700 1 --2- 172.21.15.163:0/2272738280 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557f19cb4930 0x557f19cc29f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:04.458 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:04.410+0000 7fce57fff700 1 -- 172.21.15.163:0/2272738280 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x557f19cb5530 msgr2=0x557f19cc3a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:14:04.458 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:04.410+0000 7fce57fff700 1 --2- 172.21.15.163:0/2272738280 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x557f19cb5530 0x557f19cc3a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:04.458 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:04.410+0000 7fce57fff700 1 -- 172.21.15.163:0/2272738280 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x557f19a32e60 con 0x557f19cb3fe0 2023-07-14T18:14:04.458 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:04.410+0000 7fce57fff700 1 --2- 172.21.15.163:0/2272738280 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x557f19cb3fe0 0x557f19cc24b0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fce48027760 tx=0x7fce48027610 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2dd9f093c71bb777 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:14:04.458 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:04.410+0000 7fce377fe700 10 client.0 ms_handle_connect on v2:172.21.15.184:3300/0 2023-07-14T18:14:04.458 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:04.411+0000 7fce377fe700 1 -- 172.21.15.163:0/2272738280 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce48005240 con 0x557f19cb3fe0 2023-07-14T18:14:04.459 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:04.411+0000 7fce377fe700 1 -- 172.21.15.163:0/2272738280 <== mon.1 v2:172.21.15.184:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 9049+0+0 (secure 0 0 0) 0x7fce480053a0 con 0x557f19cb3fe0 2023-07-14T18:14:04.459 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:04.411+0000 7fce6a988b80 1 -- 172.21.15.163:0/2272738280 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fce4c01e040 con 0x557f19cb3fe0 2023-07-14T18:14:04.459 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:04.411+0000 7fce377fe700 1 -- 172.21.15.163:0/2272738280 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7fce48005560 con 0x557f19cb3fe0 2023-07-14T18:14:04.459 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:04.411+0000 7fce6a988b80 10 client.25660 fetch_fsmap learned FSMap version 29 2023-07-14T18:14:04.459 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:04.411+0000 7fce6a988b80 1 -- 172.21.15.163:0/2272738280 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) v3 -- 0x7fce581a0070 con 0x557f19cb3fe0 2023-07-14T18:14:04.459 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:04.411+0000 7fce377fe700 1 -- 172.21.15.163:0/2272738280 <== mon.1 v2:172.21.15.184:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fce4c01e040 con 0x557f19cb3fe0 2023-07-14T18:14:04.459 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:04.411+0000 7fce377fe700 1 -- 172.21.15.163:0/2272738280 <== mon.1 v2:172.21.15.184:3300/0 5 ==== fsmap(e 29) v1 ==== 7470+0+0 (secure 0 0 0) 0x7fce480367b0 con 0x557f19cb3fe0 2023-07-14T18:14:04.459 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:04.411+0000 7fce6a988b80 10 client.25660 fetch_fsmap finished waiting for FSMap version 29 2023-07-14T18:14:04.460 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:04.411+0000 7fce6a988b80 10 client.25660 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-07-14T18:14:04.460 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:04.411+0000 7fce6a988b80 20 client.25660 populate_metadata read hostname 'smithi163' 2023-07-14T18:14:04.460 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:04.411+0000 7fce6a988b80 1 --2- 172.21.15.163:0/2272738280 >> [v2:172.21.15.172:6838/3850440096,v1:172.21.15.172:6839/3850440096] conn(0x557f19d280a0 0x557f19d2a480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:14:04.460 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:04.411+0000 7fce6a988b80 4 client.25660 mds_command: new command op to 24518 tid=0[{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2023-07-14T18:14:04.460 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:04.411+0000 7fce6a988b80 1 -- 172.21.15.163:0/2272738280 --> [v2:172.21.15.172:6838/3850440096,v1:172.21.15.172:6839/3850440096] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) v1 -- 0x557f19bfdf30 con 0x557f19d280a0 2023-07-14T18:14:04.460 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:04.411+0000 7fce577fe700 1 --2- 172.21.15.163:0/2272738280 >> [v2:172.21.15.172:6838/3850440096,v1:172.21.15.172:6839/3850440096] conn(0x557f19d280a0 0x557f19d2a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:14:04.461 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:04.412+0000 7fce377fe700 10 client.25660 ms_handle_connect on v2:172.21.15.172:6838/3850440096 2023-07-14T18:14:04.461 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:04.412+0000 7fce577fe700 1 --2- 172.21.15.163:0/2272738280 >> [v2:172.21.15.172:6838/3850440096,v1:172.21.15.172:6839/3850440096] conn(0x557f19d280a0 0x557f19d2a480 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c6b2f43402b48f56 server_cookie=937f3e283f99140c in_seq=0 out_seq=0 2023-07-14T18:14:04.461 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:04.413+0000 7fce377fe700 1 -- 172.21.15.163:0/2272738280 <== mds.0 v2:172.21.15.172:6838/3850440096 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x557f19bfdf30 con 0x557f19d280a0 2023-07-14T18:14:04.462 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:04.413+0000 7fce377fe700 10 client.25660 handle_command_reply: tid=0 2023-07-14T18:14:04.462 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:04.413+0000 7fce6a988b80 1 client.25660 shutdown 2023-07-14T18:14:04.462 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:04.413+0000 7fce6a988b80 1 -- 172.21.15.163:0/2272738280 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x557f19cb3fe0 msgr2=0x557f19cc24b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:14:04.462 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:04.413+0000 7fce6a988b80 1 --2- 172.21.15.163:0/2272738280 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x557f19cb3fe0 0x557f19cc24b0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fce48027760 tx=0x7fce48027610 comp rx=0 tx=0).stop 2023-07-14T18:14:04.462 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:04.413+0000 7fce6a988b80 1 -- 172.21.15.163:0/2272738280 shutdown_connections 2023-07-14T18:14:04.462 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:04.413+0000 7fce6a988b80 1 --2- 172.21.15.163:0/2272738280 >> [v2:172.21.15.172:6838/3850440096,v1:172.21.15.172:6839/3850440096] conn(0x557f19d280a0 0x557f19d2a480 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:04.462 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:04.413+0000 7fce6a988b80 1 --2- 172.21.15.163:0/2272738280 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x557f19cb3fe0 0x557f19cc24b0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:04.462 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:04.413+0000 7fce6a988b80 1 --2- 172.21.15.163:0/2272738280 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x557f19cb5530 0x557f19cc3a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:04.463 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:04.413+0000 7fce6a988b80 1 --2- 172.21.15.163:0/2272738280 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557f19cb4930 0x557f19cc29f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:04.463 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:04.413+0000 7fce6a988b80 1 -- 172.21.15.163:0/2272738280 >> 172.21.15.163:0/2272738280 conn(0x557f19ca9700 msgr2=0x557f19cbb900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:14:04.463 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:04.413+0000 7fce377fe700 0 client.25660 ms_handle_reset on v2:172.21.15.172:6838/3850440096 2023-07-14T18:14:04.463 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:04.413+0000 7fce6a988b80 1 -- 172.21.15.163:0/2272738280 shutdown_connections 2023-07-14T18:14:04.463 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:04.414+0000 7fce6a988b80 1 -- 172.21.15.163:0/2272738280 wait complete. 2023-07-14T18:14:04.463 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:04.414+0000 7fce6a988b80 20 client.25660 trim_cache size 0 max 16384 2023-07-14T18:14:04.464 INFO:teuthology.orchestra.run.smithi163.stdout:{ 2023-07-14T18:14:04.464 INFO:teuthology.orchestra.run.smithi163.stdout: "return_code": 0, 2023-07-14T18:14:04.464 INFO:teuthology.orchestra.run.smithi163.stdout: "scrub_tag": "1429dbfe-b5a1-44ca-a91e-065efeaaa32c", 2023-07-14T18:14:04.464 INFO:teuthology.orchestra.run.smithi163.stdout: "mode": "asynchronous" 2023-07-14T18:14:04.464 INFO:teuthology.orchestra.run.smithi163.stdout:} 2023-07-14T18:14:04.465 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:04.414+0000 7fce5e7f0700 1 -- 172.21.15.163:0/3450848595 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7fce400a11d0 msgr2=0x7fce400a3680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:14:04.465 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:04.414+0000 7fce5e7f0700 1 --2- 172.21.15.163:0/3450848595 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7fce400a11d0 0x7fce400a3680 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fce48011490 tx=0x7fce48009260 comp rx=0 tx=0).stop 2023-07-14T18:14:04.465 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:04.414+0000 7fce5e7f0700 1 -- 172.21.15.163:0/3450848595 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fce581000b0 msgr2=0x7fce5819ef50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:14:04.465 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:04.414+0000 7fce5e7f0700 1 --2- 172.21.15.163:0/3450848595 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fce581000b0 0x7fce5819ef50 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fce5000efc0 tx=0x7fce5000c3a0 comp rx=0 tx=0).stop 2023-07-14T18:14:04.465 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:04.414+0000 7fce5e7f0700 1 -- 172.21.15.163:0/3450848595 shutdown_connections 2023-07-14T18:14:04.466 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:04.414+0000 7fce5e7f0700 1 --2- 172.21.15.163:0/3450848595 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7fce400a11d0 0x7fce400a3680 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:04.466 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:04.414+0000 7fce5e7f0700 1 --2- 172.21.15.163:0/3450848595 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fce580fed00 0x7fce580fe760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:04.466 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:04.414+0000 7fce5e7f0700 1 --2- 172.21.15.163:0/3450848595 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fce581000b0 0x7fce5819ef50 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:04.466 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:04.414+0000 7fce5e7f0700 1 --2- 172.21.15.163:0/3450848595 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fce580ff6b0 0x7fce5819ca00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:04.466 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:04.414+0000 7fce5e7f0700 1 -- 172.21.15.163:0/3450848595 >> 172.21.15.163:0/3450848595 conn(0x7fce580f98a0 msgr2=0x7fce580fbc40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:14:04.466 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:04.415+0000 7fce5e7f0700 1 -- 172.21.15.163:0/3450848595 shutdown_connections 2023-07-14T18:14:04.466 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:04.415+0000 7fce5e7f0700 1 -- 172.21.15.163:0/3450848595 wait complete. 2023-07-14T18:14:04.470 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-07-14T18:14:04.632 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:04.590+0000 7f8da57b7700 1 -- 172.21.15.163:0/4016761665 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8da00feb50 msgr2=0x7f8da00fef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:14:04.632 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:04.590+0000 7f8da57b7700 1 --2- 172.21.15.163:0/4016761665 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8da00feb50 0x7f8da00fef60 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f8d900098f0 tx=0x7f8d90009c00 comp rx=0 tx=0).stop 2023-07-14T18:14:04.632 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:04.590+0000 7f8da57b7700 1 -- 172.21.15.163:0/4016761665 shutdown_connections 2023-07-14T18:14:04.632 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:04.590+0000 7f8da57b7700 1 --2- 172.21.15.163:0/4016761665 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8da01006d0 0x7f8da0106f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:04.633 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:04.590+0000 7f8da57b7700 1 --2- 172.21.15.163:0/4016761665 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8da00feb50 0x7f8da00fef60 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:04.633 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:04.590+0000 7f8da57b7700 1 --2- 172.21.15.163:0/4016761665 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f8da00ffd40 0x7f8da0100190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:04.633 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:04.590+0000 7f8da57b7700 1 -- 172.21.15.163:0/4016761665 >> 172.21.15.163:0/4016761665 conn(0x7f8da00fa150 msgr2=0x7f8da00fc5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:14:04.633 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:04.590+0000 7f8da57b7700 1 -- 172.21.15.163:0/4016761665 shutdown_connections 2023-07-14T18:14:04.633 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:04.590+0000 7f8da57b7700 1 -- 172.21.15.163:0/4016761665 wait complete. 2023-07-14T18:14:04.635 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:04.591+0000 7f8da57b7700 1 Processor -- start 2023-07-14T18:14:04.635 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:04.591+0000 7f8da57b7700 1 -- start start 2023-07-14T18:14:04.635 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:04.591+0000 7f8da57b7700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8da00feb50 0x7f8da01947c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:14:04.635 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:04.591+0000 7f8da57b7700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f8da00ffd40 0x7f8da0194d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:14:04.635 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:04.591+0000 7f8da57b7700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8da01006d0 0x7f8da019bd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:14:04.635 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:04.591+0000 7f8da57b7700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8da019c340 con 0x7f8da00ffd40 2023-07-14T18:14:04.635 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:04.591+0000 7f8da57b7700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8da019c480 con 0x7f8da00feb50 2023-07-14T18:14:04.636 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:04.591+0000 7f8da57b7700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8da019c610 con 0x7f8da01006d0 2023-07-14T18:14:04.636 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:04.591+0000 7f8d97fff700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f8da00ffd40 0x7f8da0194d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:14:04.636 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:04.591+0000 7f8d9effd700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8da00feb50 0x7f8da01947c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:14:04.636 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:04.591+0000 7f8d97fff700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f8da00ffd40 0x7f8da0194d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:59086/0 (socket says 172.21.15.163:59086) 2023-07-14T18:14:04.636 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:04.591+0000 7f8d97fff700 1 -- 172.21.15.163:0/3712791544 learned_addr learned my addr 172.21.15.163:0/3712791544 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:14:04.636 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:04.591+0000 7f8d9f7fe700 1 --2- 172.21.15.163:0/3712791544 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8da01006d0 0x7f8da019bd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:14:04.636 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:04.592+0000 7f8d9effd700 1 -- 172.21.15.163:0/3712791544 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8da01006d0 msgr2=0x7f8da019bd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:14:04.637 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:04.592+0000 7f8d9effd700 1 --2- 172.21.15.163:0/3712791544 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8da01006d0 0x7f8da019bd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:04.637 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:04.592+0000 7f8d9effd700 1 -- 172.21.15.163:0/3712791544 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f8da00ffd40 msgr2=0x7f8da0194d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:14:04.637 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:04.592+0000 7f8d9effd700 1 --2- 172.21.15.163:0/3712791544 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f8da00ffd40 0x7f8da0194d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:04.637 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:04.592+0000 7f8d9effd700 1 -- 172.21.15.163:0/3712791544 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d90009520 con 0x7f8da00feb50 2023-07-14T18:14:04.637 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:04.592+0000 7f8d9f7fe700 1 --2- 172.21.15.163:0/3712791544 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8da01006d0 0x7f8da019bd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T18:14:04.637 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:04.592+0000 7f8d97fff700 1 --2- 172.21.15.163:0/3712791544 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f8da00ffd40 0x7f8da0194d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T18:14:04.637 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:04.592+0000 7f8d9effd700 1 --2- 172.21.15.163:0/3712791544 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8da00feb50 0x7f8da01947c0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f8d90000c00 tx=0x7f8d9000bf60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:14:04.637 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:04.592+0000 7f8d9cff9700 1 -- 172.21.15.163:0/3712791544 <== mon.2 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d9000ba10 con 0x7f8da00feb50 2023-07-14T18:14:04.638 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:04.592+0000 7f8da57b7700 1 -- 172.21.15.163:0/3712791544 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8da0068990 con 0x7f8da00feb50 2023-07-14T18:14:04.638 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:04.592+0000 7f8da57b7700 1 -- 172.21.15.163:0/3712791544 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8da0068e30 con 0x7f8da00feb50 2023-07-14T18:14:04.638 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:04.592+0000 7f8d9cff9700 1 -- 172.21.15.163:0/3712791544 <== mon.2 v2:172.21.15.172:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f8d9000bb70 con 0x7f8da00feb50 2023-07-14T18:14:04.639 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:04.592+0000 7f8d9cff9700 1 -- 172.21.15.163:0/3712791544 <== mon.2 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d90003dd0 con 0x7f8da00feb50 2023-07-14T18:14:04.639 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:04.595+0000 7f8d9cff9700 1 -- 172.21.15.163:0/3712791544 <== mon.2 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 18) v1 ==== 135716+0+0 (secure 0 0 0) 0x7f8d90005040 con 0x7f8da00feb50 2023-07-14T18:14:04.639 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:04.596+0000 7f8d9cff9700 1 --2- 172.21.15.163:0/3712791544 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f8d8c0a11d0 0x7f8d8c0a3680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:14:04.639 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:04.596+0000 7f8d9cff9700 1 -- 172.21.15.163:0/3712791544 <== mon.2 v2:172.21.15.172:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 9049+0+0 (secure 0 0 0) 0x7f8d900cf860 con 0x7f8da00feb50 2023-07-14T18:14:04.639 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:04.596+0000 7f8d97fff700 1 --2- 172.21.15.163:0/3712791544 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f8d8c0a11d0 0x7f8d8c0a3680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:14:04.639 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:04.597+0000 7f8d97fff700 1 --2- 172.21.15.163:0/3712791544 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f8d8c0a11d0 0x7f8d8c0a3680 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f8d88005950 tx=0x7f8d88009310 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:14:04.640 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:04.597+0000 7f8db194fb80 1 Processor -- start 2023-07-14T18:14:04.640 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:04.598+0000 7f8db194fb80 1 -- start start 2023-07-14T18:14:04.640 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:04.598+0000 7f8db194fb80 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e1c3db1320 0x55e1c3db1730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:14:04.641 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:04.598+0000 7f8db194fb80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e1c3db1c70 0x55e1c3db2310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:14:04.641 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:04.598+0000 7f8db194fb80 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55e1c3db28a0 0x55e1c3db2d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:14:04.641 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:04.598+0000 7f8db194fb80 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e1c3cb1cb0 con 0x55e1c3db28a0 2023-07-14T18:14:04.641 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:04.598+0000 7f8db194fb80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e1c3d04a40 con 0x55e1c3db1c70 2023-07-14T18:14:04.641 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:04.598+0000 7f8db194fb80 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e1c3cfded0 con 0x55e1c3db1320 2023-07-14T18:14:04.641 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:04.598+0000 7f8d97fff700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e1c3db1c70 0x55e1c3db2310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:14:04.641 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:04.598+0000 7f8d97fff700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e1c3db1c70 0x55e1c3db2310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.163:59776/0 (socket says 172.21.15.163:59776) 2023-07-14T18:14:04.641 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:04.598+0000 7f8d97fff700 1 -- 172.21.15.163:0/1517218923 learned_addr learned my addr 172.21.15.163:0/1517218923 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:14:04.642 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:04.598+0000 7f8d9f7fe700 1 --2- 172.21.15.163:0/1517218923 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55e1c3db28a0 0x55e1c3db2d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:14:04.642 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:04.598+0000 7f8d9effd700 1 --2- 172.21.15.163:0/1517218923 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e1c3db1320 0x55e1c3db1730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:14:04.644 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:04.599+0000 7f8d97fff700 1 -- 172.21.15.163:0/1517218923 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e1c3db1320 msgr2=0x55e1c3db1730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:14:04.645 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:04.599+0000 7f8d97fff700 1 --2- 172.21.15.163:0/1517218923 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e1c3db1320 0x55e1c3db1730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:04.645 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:04.599+0000 7f8d97fff700 1 -- 172.21.15.163:0/1517218923 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55e1c3db28a0 msgr2=0x55e1c3db2d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:14:04.645 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:04.599+0000 7f8d97fff700 1 --2- 172.21.15.163:0/1517218923 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55e1c3db28a0 0x55e1c3db2d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:04.645 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:04.599+0000 7f8d97fff700 1 -- 172.21.15.163:0/1517218923 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e1c3b2bde0 con 0x55e1c3db1c70 2023-07-14T18:14:04.645 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:04.599+0000 7f8d9f7fe700 1 --2- 172.21.15.163:0/1517218923 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55e1c3db28a0 0x55e1c3db2d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T18:14:04.645 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:04.599+0000 7f8d9effd700 1 --2- 172.21.15.163:0/1517218923 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e1c3db1320 0x55e1c3db1730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T18:14:04.645 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:04.599+0000 7f8d97fff700 1 --2- 172.21.15.163:0/1517218923 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e1c3db1c70 0x55e1c3db2310 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f8d8800e6e0 tx=0x7f8d88014000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c7ef67f44d69461a server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:14:04.645 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:04.599+0000 7f8d957fa700 1 -- 172.21.15.163:0/1517218923 <== mon.2 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d88026630 con 0x55e1c3db1c70 2023-07-14T18:14:04.646 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:04.599+0000 7f8d957fa700 1 -- 172.21.15.163:0/1517218923 <== mon.2 v2:172.21.15.172:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f8d88021070 con 0x55e1c3db1c70 2023-07-14T18:14:04.646 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:04.599+0000 7f8d957fa700 1 -- 172.21.15.163:0/1517218923 <== mon.2 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d8801d650 con 0x55e1c3db1c70 2023-07-14T18:14:04.646 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:04.600+0000 7f8db194fb80 1 -- 172.21.15.163:0/1517218923 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e1c3db1c70 msgr2=0x55e1c3db2310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:14:04.646 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:04.600+0000 7f8db194fb80 1 --2- 172.21.15.163:0/1517218923 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e1c3db1c70 0x55e1c3db2310 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f8d8800e6e0 tx=0x7f8d88014000 comp rx=0 tx=0).stop 2023-07-14T18:14:04.646 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:04.600+0000 7f8db194fb80 1 -- 172.21.15.163:0/1517218923 shutdown_connections 2023-07-14T18:14:04.646 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:04.600+0000 7f8db194fb80 1 --2- 172.21.15.163:0/1517218923 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e1c3db1320 0x55e1c3db1730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:04.646 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:04.600+0000 7f8db194fb80 1 --2- 172.21.15.163:0/1517218923 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55e1c3db28a0 0x55e1c3db2d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:04.647 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:04.600+0000 7f8db194fb80 1 --2- 172.21.15.163:0/1517218923 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e1c3db1c70 0x55e1c3db2310 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:04.647 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:04.600+0000 7f8db194fb80 1 -- 172.21.15.163:0/1517218923 >> 172.21.15.163:0/1517218923 conn(0x55e1c3da2680 msgr2=0x55e1c3da79d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:14:04.647 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:04.600+0000 7f8db194fb80 1 -- 172.21.15.163:0/1517218923 shutdown_connections 2023-07-14T18:14:04.647 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:04.600+0000 7f8db194fb80 1 -- 172.21.15.163:0/1517218923 wait complete. 2023-07-14T18:14:04.647 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:04.600+0000 7f8db194fb80 1 -- start start 2023-07-14T18:14:04.647 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:04.600+0000 7f8db194fb80 1 Processor -- start 2023-07-14T18:14:04.647 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:04.601+0000 7f8db194fb80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e1c3db1320 0x55e1c3dbad40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:14:04.647 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:04.601+0000 7f8db194fb80 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55e1c3db1c70 0x55e1c3dbb280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:14:04.648 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:04.601+0000 7f8db194fb80 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e1c3db28a0 0x55e1c3dc22c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:14:04.648 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:04.601+0000 7f8db194fb80 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e1c3c9dac0 con 0x55e1c3db1c70 2023-07-14T18:14:04.648 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:04.601+0000 7f8db194fb80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e1c3c9d7c0 con 0x55e1c3db1320 2023-07-14T18:14:04.648 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:04.601+0000 7f8db194fb80 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e1c3b81920 con 0x55e1c3db28a0 2023-07-14T18:14:04.648 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:04.601+0000 7f8db194fb80 10 client.0 _ll_register_callbacks cb 0x55e1c3c9b760 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T18:14:04.648 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:04.601+0000 7f8d9effd700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e1c3db1320 0x55e1c3dbad40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:14:04.648 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:04.601+0000 7f8d97fff700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55e1c3db1c70 0x55e1c3dbb280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:14:04.648 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:04.601+0000 7f8d9effd700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e1c3db1320 0x55e1c3dbad40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.163:59782/0 (socket says 172.21.15.163:59782) 2023-07-14T18:14:04.649 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:04.601+0000 7f8d97fff700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55e1c3db1c70 0x55e1c3dbb280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:59100/0 (socket says 172.21.15.163:59100) 2023-07-14T18:14:04.649 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:04.601+0000 7f8d9effd700 1 -- 172.21.15.163:0/1235537118 learned_addr learned my addr 172.21.15.163:0/1235537118 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:14:04.649 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:04.601+0000 7f8d9f7fe700 1 --2- 172.21.15.163:0/1235537118 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e1c3db28a0 0x55e1c3dc22c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:14:04.649 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:04.601+0000 7f8d9effd700 1 -- 172.21.15.163:0/1235537118 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e1c3db28a0 msgr2=0x55e1c3dc22c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:14:04.649 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:04.601+0000 7f8d9effd700 1 --2- 172.21.15.163:0/1235537118 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e1c3db28a0 0x55e1c3dc22c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:04.649 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:04.601+0000 7f8d9effd700 1 -- 172.21.15.163:0/1235537118 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55e1c3db1c70 msgr2=0x55e1c3dbb280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:14:04.649 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:04.601+0000 7f8d9effd700 1 --2- 172.21.15.163:0/1235537118 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55e1c3db1c70 0x55e1c3dbb280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:04.649 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:04.601+0000 7f8d9effd700 1 -- 172.21.15.163:0/1235537118 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8da0068e30 con 0x55e1c3db1320 2023-07-14T18:14:04.650 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:04.601+0000 7f8d9f7fe700 1 --2- 172.21.15.163:0/1235537118 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e1c3db28a0 0x55e1c3dc22c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T18:14:04.650 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:04.601+0000 7f8d9effd700 1 --2- 172.21.15.163:0/1235537118 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e1c3db1320 0x55e1c3dbad40 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f8d900cd030 tx=0x7f8d9009caa0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a58e05a507f3c7b4 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:14:04.650 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:04.601+0000 7f8d867fc700 10 client.0 ms_handle_connect on v2:172.21.15.172:3300/0 2023-07-14T18:14:04.650 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:04.602+0000 7f8d867fc700 1 -- 172.21.15.163:0/1235537118 <== mon.2 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d9009cc30 con 0x55e1c3db1320 2023-07-14T18:14:04.650 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:04.602+0000 7f8d867fc700 1 -- 172.21.15.163:0/1235537118 <== mon.2 v2:172.21.15.172:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 9049+0+0 (secure 0 0 0) 0x7f8d9009cd90 con 0x55e1c3db1320 2023-07-14T18:14:04.650 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:04.602+0000 7f8db194fb80 1 -- 172.21.15.163:0/1235537118 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55e1c3c574f0 con 0x55e1c3db1320 2023-07-14T18:14:04.650 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:04.602+0000 7f8d867fc700 1 -- 172.21.15.163:0/1235537118 <== mon.2 v2:172.21.15.172:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8d900b5140 con 0x55e1c3db1320 2023-07-14T18:14:04.650 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:04.602+0000 7f8db194fb80 10 client.25733 fetch_fsmap learned FSMap version 29 2023-07-14T18:14:04.651 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:04.602+0000 7f8db194fb80 1 -- 172.21.15.163:0/1235537118 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) v3 -- 0x7f8d88017070 con 0x55e1c3db1320 2023-07-14T18:14:04.651 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:04.602+0000 7f8d867fc700 1 -- 172.21.15.163:0/1235537118 <== mon.2 v2:172.21.15.172:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55e1c3c574f0 con 0x55e1c3db1320 2023-07-14T18:14:04.651 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:04.602+0000 7f8d867fc700 1 -- 172.21.15.163:0/1235537118 <== mon.2 v2:172.21.15.172:3300/0 5 ==== fsmap(e 29) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f8d900a4990 con 0x55e1c3db1320 2023-07-14T18:14:04.651 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:04.602+0000 7f8db194fb80 10 client.25733 fetch_fsmap finished waiting for FSMap version 29 2023-07-14T18:14:04.651 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:04.602+0000 7f8db194fb80 10 client.25733 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-07-14T18:14:04.651 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:04.602+0000 7f8db194fb80 20 client.25733 populate_metadata read hostname 'smithi163' 2023-07-14T18:14:04.651 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:04.602+0000 7f8db194fb80 1 --2- 172.21.15.163:0/1235537118 >> [v2:172.21.15.172:6838/3850440096,v1:172.21.15.172:6839/3850440096] conn(0x55e1c3dc6760 0x55e1c3dc8b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:14:04.651 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:04.602+0000 7f8db194fb80 4 client.25733 mds_command: new command op to 24518 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-14T18:14:04.652 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:04.602+0000 7f8db194fb80 1 -- 172.21.15.163:0/1235537118 --> [v2:172.21.15.172:6838/3850440096,v1:172.21.15.172:6839/3850440096] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55e1c3d7bda0 con 0x55e1c3dc6760 2023-07-14T18:14:04.652 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:04.602+0000 7f8d97fff700 1 --2- 172.21.15.163:0/1235537118 >> [v2:172.21.15.172:6838/3850440096,v1:172.21.15.172:6839/3850440096] conn(0x55e1c3dc6760 0x55e1c3dc8b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:14:04.653 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:04.603+0000 7f8d867fc700 10 client.25733 ms_handle_connect on v2:172.21.15.172:6838/3850440096 2023-07-14T18:14:04.653 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:04.603+0000 7f8d97fff700 1 --2- 172.21.15.163:0/1235537118 >> [v2:172.21.15.172:6838/3850440096,v1:172.21.15.172:6839/3850440096] conn(0x55e1c3dc6760 0x55e1c3dc8b70 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a9305836a5201dfd server_cookie=810fe987731be5f3 in_seq=0 out_seq=0 2023-07-14T18:14:04.653 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:04.604+0000 7f8d867fc700 1 -- 172.21.15.163:0/1235537118 <== mds.0 v2:172.21.15.172:6838/3850440096 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18017 (crc 0 0 0) 0x55e1c3d7bda0 con 0x55e1c3dc6760 2023-07-14T18:14:04.653 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:04.604+0000 7f8d867fc700 10 client.25733 handle_command_reply: tid=0 2023-07-14T18:14:04.653 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:04.604+0000 7f8db194fb80 1 client.25733 shutdown 2023-07-14T18:14:04.653 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:04.604+0000 7f8db194fb80 1 -- 172.21.15.163:0/1235537118 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e1c3db1320 msgr2=0x55e1c3dbad40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:14:04.654 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:04.604+0000 7f8db194fb80 1 --2- 172.21.15.163:0/1235537118 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e1c3db1320 0x55e1c3dbad40 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f8d900cd030 tx=0x7f8d9009caa0 comp rx=0 tx=0).stop 2023-07-14T18:14:04.654 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:04.604+0000 7f8db194fb80 1 -- 172.21.15.163:0/1235537118 shutdown_connections 2023-07-14T18:14:04.654 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:04.604+0000 7f8db194fb80 1 --2- 172.21.15.163:0/1235537118 >> [v2:172.21.15.172:6838/3850440096,v1:172.21.15.172:6839/3850440096] conn(0x55e1c3dc6760 0x55e1c3dc8b70 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:04.654 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:04.604+0000 7f8db194fb80 1 --2- 172.21.15.163:0/1235537118 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e1c3db28a0 0x55e1c3dc22c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:04.654 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:04.604+0000 7f8d867fc700 0 client.25733 ms_handle_reset on v2:172.21.15.172:6838/3850440096 2023-07-14T18:14:04.654 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:04.604+0000 7f8db194fb80 1 --2- 172.21.15.163:0/1235537118 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e1c3db1320 0x55e1c3dbad40 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:04.654 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:04.604+0000 7f8db194fb80 1 --2- 172.21.15.163:0/1235537118 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55e1c3db1c70 0x55e1c3dbb280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:04.654 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:04.604+0000 7f8db194fb80 1 -- 172.21.15.163:0/1235537118 >> 172.21.15.163:0/1235537118 conn(0x55e1c3da2680 msgr2=0x55e1c3da6650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:14:04.655 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:04.604+0000 7f8db194fb80 1 -- 172.21.15.163:0/1235537118 shutdown_connections 2023-07-14T18:14:04.655 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:04.604+0000 7f8db194fb80 1 -- 172.21.15.163:0/1235537118 wait complete. 2023-07-14T18:14:04.655 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:04.604+0000 7f8db194fb80 20 client.25733 trim_cache size 0 max 16384 2023-07-14T18:14:04.667 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:04.626+0000 7f8db194fb80 1 Processor -- start 2023-07-14T18:14:04.668 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:04.626+0000 7f8db194fb80 1 -- start start 2023-07-14T18:14:04.669 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:04.626+0000 7f8db194fb80 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e1c3db1320 0x55e1c3db5770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:14:04.669 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:04.626+0000 7f8db194fb80 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55e1c3db1c70 0x55e1c3db5cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:14:04.669 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:04.626+0000 7f8db194fb80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e1c3db28a0 0x55e1c3dbaaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:14:04.669 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:04.626+0000 7f8db194fb80 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e1c3da4700 con 0x55e1c3db1c70 2023-07-14T18:14:04.670 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:04.626+0000 7f8db194fb80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e1c3dbbf30 con 0x55e1c3db28a0 2023-07-14T18:14:04.670 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:04.626+0000 7f8db194fb80 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e1c3dba8b0 con 0x55e1c3db1320 2023-07-14T18:14:04.670 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:04.626+0000 7f8d97fff700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55e1c3db1c70 0x55e1c3db5cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:14:04.670 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:04.626+0000 7f8d9effd700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e1c3db1320 0x55e1c3db5770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:14:04.670 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:04.626+0000 7f8d97fff700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55e1c3db1c70 0x55e1c3db5cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:59108/0 (socket says 172.21.15.163:59108) 2023-07-14T18:14:04.670 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:04.626+0000 7f8d9f7fe700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e1c3db28a0 0x55e1c3dbaaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:14:04.670 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:04.626+0000 7f8d97fff700 1 -- 172.21.15.163:0/2331189664 learned_addr learned my addr 172.21.15.163:0/2331189664 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:14:04.670 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:04.627+0000 7f8d9effd700 1 -- 172.21.15.163:0/2331189664 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e1c3db28a0 msgr2=0x55e1c3dbaaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:14:04.671 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:04.627+0000 7f8d9effd700 1 --2- 172.21.15.163:0/2331189664 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e1c3db28a0 0x55e1c3dbaaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:04.671 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:04.627+0000 7f8d9effd700 1 -- 172.21.15.163:0/2331189664 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55e1c3db1c70 msgr2=0x55e1c3db5cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:14:04.671 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:04.627+0000 7f8d9effd700 1 --2- 172.21.15.163:0/2331189664 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55e1c3db1c70 0x55e1c3db5cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:04.671 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:04.627+0000 7f8d9effd700 1 -- 172.21.15.163:0/2331189664 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e1c3b14c60 con 0x55e1c3db1320 2023-07-14T18:14:04.671 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:04.627+0000 7f8d97fff700 1 --2- 172.21.15.163:0/2331189664 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55e1c3db1c70 0x55e1c3db5cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T18:14:04.671 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:04.627+0000 7f8d9effd700 1 --2- 172.21.15.163:0/2331189664 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e1c3db1320 0x55e1c3db5770 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f8d9009c6d0 tx=0x7f8d90009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c9fc44df7a2da6c8 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:14:04.671 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:04.627+0000 7f8d95ffb700 1 -- 172.21.15.163:0/2331189664 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d900b5140 con 0x55e1c3db1320 2023-07-14T18:14:04.672 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:04.627+0000 7f8d95ffb700 1 -- 172.21.15.163:0/2331189664 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f8d900a06e0 con 0x55e1c3db1320 2023-07-14T18:14:04.672 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:04.627+0000 7f8d95ffb700 1 -- 172.21.15.163:0/2331189664 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d90098b50 con 0x55e1c3db1320 2023-07-14T18:14:04.674 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:04.628+0000 7f8db194fb80 1 -- 172.21.15.163:0/2331189664 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e1c3db1320 msgr2=0x55e1c3db5770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:14:04.674 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:04.628+0000 7f8db194fb80 1 --2- 172.21.15.163:0/2331189664 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e1c3db1320 0x55e1c3db5770 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f8d9009c6d0 tx=0x7f8d90009c00 comp rx=0 tx=0).stop 2023-07-14T18:14:04.675 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:04.628+0000 7f8db194fb80 1 -- 172.21.15.163:0/2331189664 shutdown_connections 2023-07-14T18:14:04.675 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:04.628+0000 7f8db194fb80 1 --2- 172.21.15.163:0/2331189664 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e1c3db1320 0x55e1c3db5770 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:04.675 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:04.628+0000 7f8db194fb80 1 --2- 172.21.15.163:0/2331189664 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e1c3db28a0 0x55e1c3dbaaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:04.675 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:04.628+0000 7f8db194fb80 1 --2- 172.21.15.163:0/2331189664 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55e1c3db1c70 0x55e1c3db5cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:04.675 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:04.628+0000 7f8db194fb80 1 -- 172.21.15.163:0/2331189664 >> 172.21.15.163:0/2331189664 conn(0x55e1c3da2680 msgr2=0x55e1c3db8c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:14:04.675 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:04.629+0000 7f8db194fb80 1 -- 172.21.15.163:0/2331189664 shutdown_connections 2023-07-14T18:14:04.675 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:04.629+0000 7f8db194fb80 1 -- 172.21.15.163:0/2331189664 wait complete. 2023-07-14T18:14:04.676 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:04.629+0000 7f8db194fb80 1 -- start start 2023-07-14T18:14:04.676 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:04.629+0000 7f8db194fb80 1 Processor -- start 2023-07-14T18:14:04.676 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:04.629+0000 7f8db194fb80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e1c3db1320 0x55e1c3db0a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:14:04.676 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:04.629+0000 7f8db194fb80 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55e1c3db1c70 0x55e1c3daf050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:14:04.676 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:04.629+0000 7f8db194fb80 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e1c3db28a0 0x55e1c3dc21e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:14:04.676 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:04.629+0000 7f8db194fb80 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e1c3daf590 con 0x55e1c3db1c70 2023-07-14T18:14:04.676 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:04.629+0000 7f8db194fb80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e1c3daf700 con 0x55e1c3db1320 2023-07-14T18:14:04.676 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:04.629+0000 7f8db194fb80 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e1c3daf8c0 con 0x55e1c3db28a0 2023-07-14T18:14:04.677 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:04.629+0000 7f8db194fb80 10 client.0 _ll_register_callbacks cb 0x7f8d9009c600 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T18:14:04.677 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:04.630+0000 7f8d9f7fe700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e1c3db28a0 0x55e1c3dc21e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:14:04.677 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:04.630+0000 7f8d9f7fe700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e1c3db28a0 0x55e1c3dc21e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.163:40934/0 (socket says 172.21.15.163:40934) 2023-07-14T18:14:04.677 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:04.630+0000 7f8d9f7fe700 1 -- 172.21.15.163:0/1306524820 learned_addr learned my addr 172.21.15.163:0/1306524820 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:14:04.677 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:04.630+0000 7f8d9effd700 1 --2- 172.21.15.163:0/1306524820 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e1c3db1320 0x55e1c3db0a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:14:04.677 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:04.630+0000 7f8d97fff700 1 --2- 172.21.15.163:0/1306524820 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55e1c3db1c70 0x55e1c3daf050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:14:04.677 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:04.630+0000 7f8d97fff700 1 -- 172.21.15.163:0/1306524820 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e1c3db28a0 msgr2=0x55e1c3dc21e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:14:04.677 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:04.630+0000 7f8d97fff700 1 --2- 172.21.15.163:0/1306524820 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e1c3db28a0 0x55e1c3dc21e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:04.678 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:04.630+0000 7f8d97fff700 1 -- 172.21.15.163:0/1306524820 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e1c3db1320 msgr2=0x55e1c3db0a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:14:04.678 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:04.630+0000 7f8d97fff700 1 --2- 172.21.15.163:0/1306524820 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e1c3db1320 0x55e1c3db0a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:04.678 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:04.630+0000 7f8d97fff700 1 -- 172.21.15.163:0/1306524820 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d8802a040 con 0x55e1c3db1c70 2023-07-14T18:14:04.678 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:04.630+0000 7f8d9f7fe700 1 --2- 172.21.15.163:0/1306524820 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e1c3db28a0 0x55e1c3dc21e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T18:14:04.678 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:04.630+0000 7f8d97fff700 1 --2- 172.21.15.163:0/1306524820 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55e1c3db1c70 0x55e1c3daf050 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7f8d8800efd0 tx=0x7f8d8801cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=970b2f5e627b734b server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:14:04.678 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:04.630+0000 7f8d867fc700 10 client.0 ms_handle_connect on v2:172.21.15.163:3300/0 2023-07-14T18:14:04.678 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:04.630+0000 7f8d867fc700 1 -- 172.21.15.163:0/1306524820 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d8801ce80 con 0x55e1c3db1c70 2023-07-14T18:14:04.679 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:04.631+0000 7f8d867fc700 1 -- 172.21.15.163:0/1306524820 <== mon.0 v2:172.21.15.163:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 9049+0+0 (secure 0 0 0) 0x7f8d880331b0 con 0x55e1c3db1c70 2023-07-14T18:14:04.679 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:04.631+0000 7f8db194fb80 1 -- 172.21.15.163:0/1306524820 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f8d88021070 con 0x55e1c3db1c70 2023-07-14T18:14:04.679 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:04.631+0000 7f8d867fc700 1 -- 172.21.15.163:0/1306524820 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8d88033370 con 0x55e1c3db1c70 2023-07-14T18:14:04.679 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:04.631+0000 7f8db194fb80 10 client.16107 fetch_fsmap learned FSMap version 29 2023-07-14T18:14:04.679 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:04.631+0000 7f8db194fb80 1 -- 172.21.15.163:0/1306524820 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) v3 -- 0x7f8d88017070 con 0x55e1c3db1c70 2023-07-14T18:14:04.679 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:04.631+0000 7f8d867fc700 1 -- 172.21.15.163:0/1306524820 <== mon.0 v2:172.21.15.163:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f8d88021070 con 0x55e1c3db1c70 2023-07-14T18:14:04.679 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:04.631+0000 7f8d867fc700 1 -- 172.21.15.163:0/1306524820 <== mon.0 v2:172.21.15.163:3300/0 5 ==== fsmap(e 29) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f8d88005040 con 0x55e1c3db1c70 2023-07-14T18:14:04.679 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:04.631+0000 7f8db194fb80 10 client.16107 fetch_fsmap finished waiting for FSMap version 29 2023-07-14T18:14:04.680 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:04.631+0000 7f8db194fb80 10 client.16107 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-07-14T18:14:04.680 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:04.631+0000 7f8db194fb80 20 client.16107 populate_metadata read hostname 'smithi163' 2023-07-14T18:14:04.680 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:04.631+0000 7f8db194fb80 1 --2- 172.21.15.163:0/1306524820 >> [v2:172.21.15.172:6838/3850440096,v1:172.21.15.172:6839/3850440096] conn(0x55e1c3e1fdd0 0x55e1c3e221e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:14:04.680 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:04.631+0000 7f8db194fb80 4 client.16107 mds_command: new command op to 24518 tid=0[{"prefix": "scrub status"}] 2023-07-14T18:14:04.680 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:04.631+0000 7f8db194fb80 1 -- 172.21.15.163:0/1306524820 --> [v2:172.21.15.172:6838/3850440096,v1:172.21.15.172:6839/3850440096] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55e1c3cf6eb0 con 0x55e1c3e1fdd0 2023-07-14T18:14:04.680 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:04.631+0000 7f8d9effd700 1 --2- 172.21.15.163:0/1306524820 >> [v2:172.21.15.172:6838/3850440096,v1:172.21.15.172:6839/3850440096] conn(0x55e1c3e1fdd0 0x55e1c3e221e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:14:04.680 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:04.632+0000 7f8d867fc700 10 client.16107 ms_handle_connect on v2:172.21.15.172:6838/3850440096 2023-07-14T18:14:04.680 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:04.632+0000 7f8d9effd700 1 --2- 172.21.15.163:0/1306524820 >> [v2:172.21.15.172:6838/3850440096,v1:172.21.15.172:6839/3850440096] conn(0x55e1c3e1fdd0 0x55e1c3e221e0 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3d1676c727472e21 server_cookie=5aeca69461a7884a in_seq=0 out_seq=0 2023-07-14T18:14:04.681 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:04.632+0000 7f8d867fc700 1 -- 172.21.15.163:0/1306524820 <== mds.0 v2:172.21.15.172:6838/3850440096 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x55e1c3cf6eb0 con 0x55e1c3e1fdd0 2023-07-14T18:14:04.681 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:04.632+0000 7f8d867fc700 10 client.16107 handle_command_reply: tid=0 2023-07-14T18:14:04.681 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:04.632+0000 7f8db194fb80 1 client.16107 shutdown 2023-07-14T18:14:04.681 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:04.632+0000 7f8db194fb80 1 -- 172.21.15.163:0/1306524820 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55e1c3db1c70 msgr2=0x55e1c3daf050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:14:04.681 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:04.632+0000 7f8db194fb80 1 --2- 172.21.15.163:0/1306524820 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55e1c3db1c70 0x55e1c3daf050 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7f8d8800efd0 tx=0x7f8d8801cc60 comp rx=0 tx=0).stop 2023-07-14T18:14:04.681 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:04.633+0000 7f8db194fb80 1 -- 172.21.15.163:0/1306524820 shutdown_connections 2023-07-14T18:14:04.681 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:04.633+0000 7f8db194fb80 1 --2- 172.21.15.163:0/1306524820 >> [v2:172.21.15.172:6838/3850440096,v1:172.21.15.172:6839/3850440096] conn(0x55e1c3e1fdd0 0x55e1c3e221e0 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:04.681 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:04.633+0000 7f8db194fb80 1 --2- 172.21.15.163:0/1306524820 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e1c3db28a0 0x55e1c3dc21e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:04.682 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:04.633+0000 7f8db194fb80 1 --2- 172.21.15.163:0/1306524820 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e1c3db1320 0x55e1c3db0a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:04.682 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:04.633+0000 7f8d867fc700 0 client.16107 ms_handle_reset on v2:172.21.15.172:6838/3850440096 2023-07-14T18:14:04.682 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:04.633+0000 7f8db194fb80 1 --2- 172.21.15.163:0/1306524820 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55e1c3db1c70 0x55e1c3daf050 unknown :-1 s=CLOSED pgs=637 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:04.682 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:04.633+0000 7f8db194fb80 1 -- 172.21.15.163:0/1306524820 >> 172.21.15.163:0/1306524820 conn(0x55e1c3da2680 msgr2=0x55e1c3db5770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:14:04.682 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:04.633+0000 7f8db194fb80 1 -- 172.21.15.163:0/1306524820 shutdown_connections 2023-07-14T18:14:04.682 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:04.633+0000 7f8db194fb80 1 -- 172.21.15.163:0/1306524820 wait complete. 2023-07-14T18:14:04.683 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:04.633+0000 7f8db194fb80 20 client.16107 trim_cache size 0 max 16384 2023-07-14T18:14:04.683 INFO:teuthology.orchestra.run.smithi163.stdout:{ 2023-07-14T18:14:04.683 INFO:teuthology.orchestra.run.smithi163.stdout: "status": "IDLE (waiting for more scrubs)", 2023-07-14T18:14:04.683 INFO:teuthology.orchestra.run.smithi163.stdout: "scrubs": { 2023-07-14T18:14:04.683 INFO:teuthology.orchestra.run.smithi163.stdout: "1429dbfe-b5a1-44ca-a91e-065efeaaa32c": { 2023-07-14T18:14:04.684 INFO:teuthology.orchestra.run.smithi163.stdout: "path": "/", 2023-07-14T18:14:04.684 INFO:teuthology.orchestra.run.smithi163.stdout: "tag": "1429dbfe-b5a1-44ca-a91e-065efeaaa32c", 2023-07-14T18:14:04.684 INFO:teuthology.orchestra.run.smithi163.stdout: "options": "recursive,force" 2023-07-14T18:14:04.684 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-07-14T18:14:04.684 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-07-14T18:14:04.684 INFO:teuthology.orchestra.run.smithi163.stdout:} 2023-07-14T18:14:04.685 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:04.633+0000 7f8da57b7700 1 -- 172.21.15.163:0/3712791544 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f8d8c0a11d0 msgr2=0x7f8d8c0a3680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:14:04.685 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:04.633+0000 7f8da57b7700 1 --2- 172.21.15.163:0/3712791544 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f8d8c0a11d0 0x7f8d8c0a3680 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f8d88005950 tx=0x7f8d88009310 comp rx=0 tx=0).stop 2023-07-14T18:14:04.685 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:04.633+0000 7f8da57b7700 1 -- 172.21.15.163:0/3712791544 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8da00feb50 msgr2=0x7f8da01947c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:14:04.685 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:04.633+0000 7f8da57b7700 1 --2- 172.21.15.163:0/3712791544 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8da00feb50 0x7f8da01947c0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f8d90000c00 tx=0x7f8d9000bf60 comp rx=0 tx=0).stop 2023-07-14T18:14:04.685 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:04.633+0000 7f8da57b7700 1 -- 172.21.15.163:0/3712791544 shutdown_connections 2023-07-14T18:14:04.686 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:04.633+0000 7f8da57b7700 1 --2- 172.21.15.163:0/3712791544 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f8d8c0a11d0 0x7f8d8c0a3680 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:04.686 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:04.633+0000 7f8da57b7700 1 --2- 172.21.15.163:0/3712791544 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8da01006d0 0x7f8da019bd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:04.686 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:04.633+0000 7f8da57b7700 1 --2- 172.21.15.163:0/3712791544 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8da00feb50 0x7f8da01947c0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:04.686 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:04.633+0000 7f8da57b7700 1 --2- 172.21.15.163:0/3712791544 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f8da00ffd40 0x7f8da0194d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:04.686 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:04.633+0000 7f8da57b7700 1 -- 172.21.15.163:0/3712791544 >> 172.21.15.163:0/3712791544 conn(0x7f8da00fa150 msgr2=0x7f8da01032d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:14:04.686 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:04.634+0000 7f8da57b7700 1 -- 172.21.15.163:0/3712791544 shutdown_connections 2023-07-14T18:14:04.686 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:04.634+0000 7f8da57b7700 1 -- 172.21.15.163:0/3712791544 wait complete. 2023-07-14T18:14:04.690 INFO:tasks.cephfs.filesystem:scrub status for tag:1429dbfe-b5a1-44ca-a91e-065efeaaa32c - {'path': '/', 'tag': '1429dbfe-b5a1-44ca-a91e-065efeaaa32c', 'options': 'recursive,force'} 2023-07-14T18:14:04.969 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:14:04 smithi163 ceph-mon[96576]: pgmap v342: 129 pgs: 129 active+clean; 17 MiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 93 KiB/s rd, 1.4 MiB/s wr, 59 op/s 2023-07-14T18:14:04.969 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:14:04 smithi163 ceph-mon[96576]: scrub queued for path: / 2023-07-14T18:14:04.970 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:14:04 smithi163 ceph-mon[96576]: scrub summary: idle+waiting paths [/] 2023-07-14T18:14:04.970 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:14:04 smithi163 ceph-mon[96576]: scrub summary: active paths [/] 2023-07-14T18:14:04.970 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:14:04 smithi163 ceph-mon[96576]: scrub summary: idle+waiting paths [/] 2023-07-14T18:14:05.176 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:14:04 smithi184 ceph-mon[98481]: pgmap v342: 129 pgs: 129 active+clean; 17 MiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 93 KiB/s rd, 1.4 MiB/s wr, 59 op/s 2023-07-14T18:14:05.177 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:14:04 smithi184 ceph-mon[98481]: scrub queued for path: / 2023-07-14T18:14:05.177 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:14:04 smithi184 ceph-mon[98481]: scrub summary: idle+waiting paths [/] 2023-07-14T18:14:05.177 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:14:04 smithi184 ceph-mon[98481]: scrub summary: active paths [/] 2023-07-14T18:14:05.177 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:14:04 smithi184 ceph-mon[98481]: scrub summary: idle+waiting paths [/] 2023-07-14T18:14:05.277 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:14:04 smithi172 ceph-mon[97983]: pgmap v342: 129 pgs: 129 active+clean; 17 MiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 93 KiB/s rd, 1.4 MiB/s wr, 59 op/s 2023-07-14T18:14:05.277 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:14:04 smithi172 ceph-mon[97983]: scrub queued for path: / 2023-07-14T18:14:05.278 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:14:04 smithi172 ceph-mon[97983]: scrub summary: idle+waiting paths [/] 2023-07-14T18:14:05.278 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:14:04 smithi172 ceph-mon[97983]: scrub summary: active paths [/] 2023-07-14T18:14:05.278 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:14:04 smithi172 ceph-mon[97983]: scrub summary: idle+waiting paths [/] 2023-07-14T18:14:07.177 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:14:06 smithi184 ceph-mon[98481]: pgmap v343: 129 pgs: 129 active+clean; 17 MiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 92 KiB/s rd, 1.4 MiB/s wr, 67 op/s 2023-07-14T18:14:07.219 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:14:06 smithi163 ceph-mon[96576]: pgmap v343: 129 pgs: 129 active+clean; 17 MiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 92 KiB/s rd, 1.4 MiB/s wr, 67 op/s 2023-07-14T18:14:07.277 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:14:06 smithi172 ceph-mon[97983]: pgmap v343: 129 pgs: 129 active+clean; 17 MiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 92 KiB/s rd, 1.4 MiB/s wr, 67 op/s 2023-07-14T18:14:09.177 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:14:08 smithi184 ceph-mon[98481]: pgmap v344: 129 pgs: 129 active+clean; 17 MiB data, 395 MiB used, 1.0 TiB / 1.0 TiB avail; 92 KiB/s rd, 1.4 MiB/s wr, 86 op/s 2023-07-14T18:14:09.177 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:14:08 smithi184 ceph-mon[98481]: scrub summary: idle 2023-07-14T18:14:09.219 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:14:08 smithi163 ceph-mon[96576]: pgmap v344: 129 pgs: 129 active+clean; 17 MiB data, 395 MiB used, 1.0 TiB / 1.0 TiB avail; 92 KiB/s rd, 1.4 MiB/s wr, 86 op/s 2023-07-14T18:14:09.219 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:14:08 smithi163 ceph-mon[96576]: scrub summary: idle 2023-07-14T18:14:09.277 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:14:08 smithi172 ceph-mon[97983]: pgmap v344: 129 pgs: 129 active+clean; 17 MiB data, 395 MiB used, 1.0 TiB / 1.0 TiB avail; 92 KiB/s rd, 1.4 MiB/s wr, 86 op/s 2023-07-14T18:14:09.278 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:14:08 smithi172 ceph-mon[97983]: scrub summary: idle 2023-07-14T18:14:11.176 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:14:10 smithi184 ceph-mon[98481]: pgmap v345: 129 pgs: 129 active+clean; 19 MiB data, 422 MiB used, 1.0 TiB / 1.0 TiB avail; 177 KiB/s rd, 1.2 MiB/s wr, 112 op/s 2023-07-14T18:14:11.219 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:14:10 smithi163 ceph-mon[96576]: pgmap v345: 129 pgs: 129 active+clean; 19 MiB data, 422 MiB used, 1.0 TiB / 1.0 TiB avail; 177 KiB/s rd, 1.2 MiB/s wr, 112 op/s 2023-07-14T18:14:11.278 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:14:10 smithi172 ceph-mon[97983]: pgmap v345: 129 pgs: 129 active+clean; 19 MiB data, 422 MiB used, 1.0 TiB / 1.0 TiB avail; 177 KiB/s rd, 1.2 MiB/s wr, 112 op/s 2023-07-14T18:14:12.177 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:14:11 smithi184 ceph-mon[98481]: pgmap v346: 129 pgs: 129 active+clean; 19 MiB data, 435 MiB used, 1.0 TiB / 1.0 TiB avail; 149 KiB/s rd, 711 KiB/s wr, 114 op/s 2023-07-14T18:14:12.219 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:14:11 smithi163 ceph-mon[96576]: pgmap v346: 129 pgs: 129 active+clean; 19 MiB data, 435 MiB used, 1.0 TiB / 1.0 TiB avail; 149 KiB/s rd, 711 KiB/s wr, 114 op/s 2023-07-14T18:14:12.277 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:14:11 smithi172 ceph-mon[97983]: pgmap v346: 129 pgs: 129 active+clean; 19 MiB data, 435 MiB used, 1.0 TiB / 1.0 TiB avail; 149 KiB/s rd, 711 KiB/s wr, 114 op/s 2023-07-14T18:14:14.927 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:14:14 smithi184 ceph-mon[98481]: pgmap v347: 129 pgs: 129 active+clean; 26 MiB data, 459 MiB used, 1.0 TiB / 1.0 TiB avail; 606 KiB/s rd, 984 KiB/s wr, 158 op/s 2023-07-14T18:14:14.969 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:14:14 smithi163 ceph-mon[96576]: pgmap v347: 129 pgs: 129 active+clean; 26 MiB data, 459 MiB used, 1.0 TiB / 1.0 TiB avail; 606 KiB/s rd, 984 KiB/s wr, 158 op/s 2023-07-14T18:14:15.028 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:14:14 smithi172 ceph-mon[97983]: pgmap v347: 129 pgs: 129 active+clean; 26 MiB data, 459 MiB used, 1.0 TiB / 1.0 TiB avail; 606 KiB/s rd, 984 KiB/s wr, 158 op/s 2023-07-14T18:14:15.927 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:14:15 smithi184 ceph-mon[98481]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-07-14T18:14:15.969 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:14:15 smithi163 ceph-mon[96576]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-07-14T18:14:16.027 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:14:15 smithi172 ceph-mon[97983]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-07-14T18:14:17.177 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:14:16 smithi184 ceph-mon[98481]: pgmap v348: 129 pgs: 129 active+clean; 27 MiB data, 505 MiB used, 1.0 TiB / 1.0 TiB avail; 564 KiB/s rd, 1.1 MiB/s wr, 220 op/s 2023-07-14T18:14:17.219 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:14:16 smithi163 ceph-mon[96576]: pgmap v348: 129 pgs: 129 active+clean; 27 MiB data, 505 MiB used, 1.0 TiB / 1.0 TiB avail; 564 KiB/s rd, 1.1 MiB/s wr, 220 op/s 2023-07-14T18:14:17.277 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:14:16 smithi172 ceph-mon[97983]: pgmap v348: 129 pgs: 129 active+clean; 27 MiB data, 505 MiB used, 1.0 TiB / 1.0 TiB avail; 564 KiB/s rd, 1.1 MiB/s wr, 220 op/s 2023-07-14T18:14:17.581 INFO:tasks.workunit.client.0.smithi163.stderr:Updating files: 8% (336/4167) Updating files: 9% (376/4167) Updating files: 9% (399/4167) Updating files: 10% (417/4167) Updating files: 11% (459/4167) Updating files: 11% (488/4167) Updating files: 12% (501/4167) Updating files: 13% (542/4167) Updating files: 13% (550/4167) Updating files: 14% (584/4167) Updating files: 15% (626/4167) Updating files: 16% (667/4167) Updating files: 17% (709/4167) Updating files: 18% (751/4167) Updating files: 19% (792/4167) Updating files: 20% (834/4167) Updating files: 21% (876/4167) Updating files: 22% (917/4167) Updating files: 22% (942/4167) Updating files: 23% (959/4167) Updating files: 24% (1001/4167) Updating files: 25% (1042/4167) Updating files: 26% (1084/4167) Updating files: 27% (1126/4167) Updating files: 28% (1167/4167) Updating files: 29% (1209/4167) Updating files: 29% (1232/4167) Updating files: 30% (1251/4167) Updating files: 30% (1254/4167) Updating files: 31% (1292/4167) Updating files: 32% (1334/4167) Updating files: 33% (1376/4167) Updating files: 34% (1417/4167) Updating files: 35% (1459/4167) Updating files: 36% (1501/4167) Updating files: 37% (1542/4167) Updating files: 38% (1584/4167) Updating files: 38% (1621/4167) Updating files: 39% (1626/4167) Updating files: 40% (1667/4167) Updating files: 41% (1709/4167) Updating files: 42% (1751/4167) Updating files: 43% (1792/4167) Updating files: 44% (1834/4167) Updating files: 45% (1876/4167) Updating files: 46% (1917/4167) Updating files: 47% (1959/4167) Updating files: 47% (1962/4167) Updating files: 48% (2001/4167) Updating files: 49% (2042/4167) Updating files: 50% (2084/4167) Updating files: 51% (2126/4167) Updating files: 52% (2167/4167) Updating files: 53% (2209/4167) Updating files: 54% (2251/4167) Updating files: 54% (2280/4167) Updating files: 55% (2292/4167) Updating files: 56% (2334/4167) Updating files: 57% (2376/4167) Updating files: 58% (2417/4167) Updating files: 59% (2459/4167) Updating files: 60% (2501/4167) Updating files: 61% (2542/4167) Updating files: 62% (2584/4167) Updating files: 63% (2626/4167) Updating files: 63% (2666/4167) Updating files: 64% (2667/4167) Updating files: 65% (2709/4167) Updating files: 66% (2751/4167) Updating files: 67% (2792/4167) Updating files: 68% (2834/4167) Updating files: 69% (2876/4167) Updating files: 70% (2917/4167) Updating files: 71% (2959/4167) Updating files: 72% (3001/4167) Updating files: 73% (3042/4167) Updating files: 73% (3048/4167) Updating files: 74% (3084/4167) Updating files: 75% (3126/4167) Updating files: 76% (3167/4167) Updating files: 77% (3209/4167) Updating files: 78% (3251/4167) Updating files: 79% (3292/4167) Updating files: 80% (3334/4167) Updating files: 80% (3374/4167) Updating files: 81% (3376/4167) Updating files: 82% (3417/4167) Updating files: 83% (3459/4167) Updating files: 84% (3501/4167) Updating files: 85% (3542/4167) Updating files: 86% (3584/4167) Updating files: 87% (3626/4167) Updating files: 88% (3667/4167) Updating files: 89% (3709/4167) Updating files: 89% (3749/4167) Updating files: 90% (3751/4167) Updating files: 91% (3792/4167) Updating files: 92% (3834/4167) Updating files: 93% (3876/4167) Updating files: 94% (3917/4167) Updating files: 95% (3959/4167) Updating files: 95% (3974/4167) Updating files: 96% (4001/4167) Updating files: 97% (4042/4167) Updating files: 98% (4084/4167) Updating files: 99% (4126/4167) Updating files: 100% (4167/4167) Updating files: 100% (4167/4167), done. 2023-07-14T18:14:17.623 INFO:tasks.workunit.client.0.smithi163.stderr:+ cd xfstests-dev 2023-07-14T18:14:17.624 INFO:tasks.workunit.client.0.smithi163.stderr:+ git checkout 12973fc04fd10d4af086901e10ffa8e48866b735 2023-07-14T18:14:18.177 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:14:17 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-14T18:14:18.219 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:14:17 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-14T18:14:18.278 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:14:17 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-14T18:14:19.177 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:14:18 smithi184 ceph-mon[98481]: pgmap v349: 129 pgs: 129 active+clean; 28 MiB data, 528 MiB used, 1.0 TiB / 1.0 TiB avail; 569 KiB/s rd, 1.2 MiB/s wr, 261 op/s 2023-07-14T18:14:19.177 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:14:18 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T18:14:19.177 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:14:18 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-14T18:14:19.177 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:14:18 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:14:19.219 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:14:18 smithi163 ceph-mon[96576]: pgmap v349: 129 pgs: 129 active+clean; 28 MiB data, 528 MiB used, 1.0 TiB / 1.0 TiB avail; 569 KiB/s rd, 1.2 MiB/s wr, 261 op/s 2023-07-14T18:14:19.220 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:14:18 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T18:14:19.220 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:14:18 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-14T18:14:19.220 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:14:18 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:14:19.278 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:14:18 smithi172 ceph-mon[97983]: pgmap v349: 129 pgs: 129 active+clean; 28 MiB data, 528 MiB used, 1.0 TiB / 1.0 TiB avail; 569 KiB/s rd, 1.2 MiB/s wr, 261 op/s 2023-07-14T18:14:19.278 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:14:18 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T18:14:19.278 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:14:18 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-14T18:14:19.278 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:14:18 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:14:20.719 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:14:20 smithi163 ceph-mon[96576]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-07-14T18:14:20.719 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:14:20 smithi163 ceph-mon[96576]: pgmap v350: 129 pgs: 129 active+clean; 34 MiB data, 547 MiB used, 1.0 TiB / 1.0 TiB avail; 1015 KiB/s rd, 1.7 MiB/s wr, 307 op/s 2023-07-14T18:14:20.778 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:14:20 smithi172 ceph-mon[97983]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-07-14T18:14:20.778 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:14:20 smithi172 ceph-mon[97983]: pgmap v350: 129 pgs: 129 active+clean; 34 MiB data, 547 MiB used, 1.0 TiB / 1.0 TiB avail; 1015 KiB/s rd, 1.7 MiB/s wr, 307 op/s 2023-07-14T18:14:20.927 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:14:20 smithi184 ceph-mon[98481]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-07-14T18:14:20.927 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:14:20 smithi184 ceph-mon[98481]: pgmap v350: 129 pgs: 129 active+clean; 34 MiB data, 547 MiB used, 1.0 TiB / 1.0 TiB avail; 1015 KiB/s rd, 1.7 MiB/s wr, 307 op/s 2023-07-14T18:14:23.177 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:14:22 smithi184 ceph-mon[98481]: pgmap v351: 129 pgs: 129 active+clean; 34 MiB data, 579 MiB used, 1.0 TiB / 1.0 TiB avail; 929 KiB/s rd, 1.6 MiB/s wr, 296 op/s 2023-07-14T18:14:23.219 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:14:22 smithi163 ceph-mon[96576]: pgmap v351: 129 pgs: 129 active+clean; 34 MiB data, 579 MiB used, 1.0 TiB / 1.0 TiB avail; 929 KiB/s rd, 1.6 MiB/s wr, 296 op/s 2023-07-14T18:14:23.278 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:14:22 smithi172 ceph-mon[97983]: pgmap v351: 129 pgs: 129 active+clean; 34 MiB data, 579 MiB used, 1.0 TiB / 1.0 TiB avail; 929 KiB/s rd, 1.6 MiB/s wr, 296 op/s 2023-07-14T18:14:25.177 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:14:24 smithi184 ceph-mon[98481]: pgmap v352: 129 pgs: 129 active+clean; 42 MiB data, 585 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 2.2 MiB/s wr, 299 op/s 2023-07-14T18:14:25.219 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:14:24 smithi163 ceph-mon[96576]: pgmap v352: 129 pgs: 129 active+clean; 42 MiB data, 585 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 2.2 MiB/s wr, 299 op/s 2023-07-14T18:14:25.278 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:14:24 smithi172 ceph-mon[97983]: pgmap v352: 129 pgs: 129 active+clean; 42 MiB data, 585 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 2.2 MiB/s wr, 299 op/s 2023-07-14T18:14:27.177 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:14:26 smithi184 ceph-mon[98481]: pgmap v353: 129 pgs: 129 active+clean; 43 MiB data, 565 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.8 MiB/s wr, 289 op/s 2023-07-14T18:14:27.219 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:14:26 smithi163 ceph-mon[96576]: pgmap v353: 129 pgs: 129 active+clean; 43 MiB data, 565 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.8 MiB/s wr, 289 op/s 2023-07-14T18:14:27.278 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:14:26 smithi172 ceph-mon[97983]: pgmap v353: 129 pgs: 129 active+clean; 43 MiB data, 565 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.8 MiB/s wr, 289 op/s 2023-07-14T18:14:29.177 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:14:28 smithi184 ceph-mon[98481]: pgmap v354: 129 pgs: 129 active+clean; 45 MiB data, 552 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.9 MiB/s wr, 295 op/s 2023-07-14T18:14:29.219 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:14:28 smithi163 ceph-mon[96576]: pgmap v354: 129 pgs: 129 active+clean; 45 MiB data, 552 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.9 MiB/s wr, 295 op/s 2023-07-14T18:14:29.278 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:14:28 smithi172 ceph-mon[97983]: pgmap v354: 129 pgs: 129 active+clean; 45 MiB data, 552 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.9 MiB/s wr, 295 op/s 2023-07-14T18:14:31.177 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:14:30 smithi184 ceph-mon[98481]: pgmap v355: 129 pgs: 129 active+clean; 47 MiB data, 570 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 2.0 MiB/s wr, 303 op/s 2023-07-14T18:14:31.219 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:14:30 smithi163 ceph-mon[96576]: pgmap v355: 129 pgs: 129 active+clean; 47 MiB data, 570 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 2.0 MiB/s wr, 303 op/s 2023-07-14T18:14:31.278 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:14:30 smithi172 ceph-mon[97983]: pgmap v355: 129 pgs: 129 active+clean; 47 MiB data, 570 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 2.0 MiB/s wr, 303 op/s 2023-07-14T18:14:33.177 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:14:32 smithi184 ceph-mon[98481]: pgmap v356: 129 pgs: 129 active+clean; 49 MiB data, 557 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.7 MiB/s wr, 309 op/s 2023-07-14T18:14:33.219 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:14:32 smithi163 ceph-mon[96576]: pgmap v356: 129 pgs: 129 active+clean; 49 MiB data, 557 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.7 MiB/s wr, 309 op/s 2023-07-14T18:14:33.278 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:14:32 smithi172 ceph-mon[97983]: pgmap v356: 129 pgs: 129 active+clean; 49 MiB data, 557 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.7 MiB/s wr, 309 op/s 2023-07-14T18:14:34.691 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-07-14T18:14:34.831 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:34.786+0000 7ff3feb43700 1 -- 172.21.15.163:0/2180097358 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff3f80feb10 msgr2=0x7ff3f80fef20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:14:34.831 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:34.786+0000 7ff3feb43700 1 --2- 172.21.15.163:0/2180097358 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff3f80feb10 0x7ff3f80fef20 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7ff3ec009990 tx=0x7ff3ec009ca0 comp rx=0 tx=0).stop 2023-07-14T18:14:34.831 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:34.787+0000 7ff3feb43700 1 -- 172.21.15.163:0/2180097358 shutdown_connections 2023-07-14T18:14:34.831 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:34.787+0000 7ff3feb43700 1 --2- 172.21.15.163:0/2180097358 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff3f8100690 0x7ff3f8106f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:34.832 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:34.787+0000 7ff3feb43700 1 --2- 172.21.15.163:0/2180097358 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff3f80feb10 0x7ff3f80fef20 unknown :-1 s=CLOSED pgs=638 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:34.832 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:34.787+0000 7ff3feb43700 1 --2- 172.21.15.163:0/2180097358 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff3f80ffd00 0x7ff3f8100150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:34.832 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:34.787+0000 7ff3feb43700 1 -- 172.21.15.163:0/2180097358 >> 172.21.15.163:0/2180097358 conn(0x7ff3f80fa130 msgr2=0x7ff3f80fc560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:14:34.832 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:34.787+0000 7ff3feb43700 1 -- 172.21.15.163:0/2180097358 shutdown_connections 2023-07-14T18:14:34.832 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:34.787+0000 7ff3feb43700 1 -- 172.21.15.163:0/2180097358 wait complete. 2023-07-14T18:14:34.832 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:34.787+0000 7ff3feb43700 1 Processor -- start 2023-07-14T18:14:34.832 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:34.787+0000 7ff3feb43700 1 -- start start 2023-07-14T18:14:34.833 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:34.787+0000 7ff3feb43700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff3f80feb10 0x7ff3f8197b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:14:34.833 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:34.787+0000 7ff3feb43700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff3f80ffd00 0x7ff3f8198050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:14:34.833 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:34.787+0000 7ff3feb43700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff3f8100690 0x7ff3f819f0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:14:34.833 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:34.787+0000 7ff3feb43700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3f819f690 con 0x7ff3f8100690 2023-07-14T18:14:34.833 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:34.787+0000 7ff3feb43700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3f819f7d0 con 0x7ff3f80ffd00 2023-07-14T18:14:34.833 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:34.787+0000 7ff3feb43700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3f819f960 con 0x7ff3f80feb10 2023-07-14T18:14:34.833 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:34.787+0000 7ff3fd0e0700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff3f8100690 0x7ff3f819f0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:14:34.833 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:34.787+0000 7ff3fd0e0700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff3f8100690 0x7ff3f819f0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:59136/0 (socket says 172.21.15.163:59136) 2023-07-14T18:14:34.834 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:34.787+0000 7ff3fd0e0700 1 -- 172.21.15.163:0/159984895 learned_addr learned my addr 172.21.15.163:0/159984895 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:14:34.834 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:34.788+0000 7ff3fc8df700 1 --2- 172.21.15.163:0/159984895 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff3f80feb10 0x7ff3f8197b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:14:34.834 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:34.788+0000 7ff3f7fff700 1 --2- 172.21.15.163:0/159984895 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff3f80ffd00 0x7ff3f8198050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:14:34.835 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:34.788+0000 7ff3fc8df700 1 -- 172.21.15.163:0/159984895 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff3f80ffd00 msgr2=0x7ff3f8198050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:14:34.835 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:34.788+0000 7ff3fc8df700 1 --2- 172.21.15.163:0/159984895 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff3f80ffd00 0x7ff3f8198050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:34.835 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:34.788+0000 7ff3fc8df700 1 -- 172.21.15.163:0/159984895 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff3f8100690 msgr2=0x7ff3f819f0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:14:34.836 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:34.788+0000 7ff3fc8df700 1 --2- 172.21.15.163:0/159984895 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff3f8100690 0x7ff3f819f0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:34.836 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:34.788+0000 7ff3fc8df700 1 -- 172.21.15.163:0/159984895 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3ec0095f0 con 0x7ff3f80feb10 2023-07-14T18:14:34.836 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:34.788+0000 7ff3fd0e0700 1 --2- 172.21.15.163:0/159984895 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff3f8100690 0x7ff3f819f0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T18:14:34.836 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:34.788+0000 7ff3fc8df700 1 --2- 172.21.15.163:0/159984895 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff3f80feb10 0x7ff3f8197b10 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7ff3ec000c00 tx=0x7ff3ec004730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:14:34.836 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:34.788+0000 7ff3f5ffb700 1 -- 172.21.15.163:0/159984895 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3ec01d070 con 0x7ff3f80feb10 2023-07-14T18:14:34.836 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:34.788+0000 7ff3feb43700 1 -- 172.21.15.163:0/159984895 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff3f819fbe0 con 0x7ff3f80feb10 2023-07-14T18:14:34.836 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:34.788+0000 7ff3f5ffb700 1 -- 172.21.15.163:0/159984895 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ff3ec00bd50 con 0x7ff3f80feb10 2023-07-14T18:14:34.837 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:34.788+0000 7ff3f5ffb700 1 -- 172.21.15.163:0/159984895 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3ec022d10 con 0x7ff3f80feb10 2023-07-14T18:14:34.837 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:34.788+0000 7ff3feb43700 1 -- 172.21.15.163:0/159984895 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff3f81a0060 con 0x7ff3f80feb10 2023-07-14T18:14:34.837 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:34.791+0000 7ff3f5ffb700 1 -- 172.21.15.163:0/159984895 <== mon.1 v2:172.21.15.184:3300/0 4 ==== mgrmap(e 18) v1 ==== 135716+0+0 (secure 0 0 0) 0x7ff3ec022470 con 0x7ff3f80feb10 2023-07-14T18:14:34.837 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:34.791+0000 7ff3f5ffb700 1 --2- 172.21.15.163:0/159984895 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7ff3e80a1150 0x7ff3e80a3600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:14:34.837 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:34.791+0000 7ff3f5ffb700 1 -- 172.21.15.163:0/159984895 <== mon.1 v2:172.21.15.184:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 9049+0+0 (secure 0 0 0) 0x7ff3ec0ce0d0 con 0x7ff3f80feb10 2023-07-14T18:14:34.837 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:34.792+0000 7ff3f7fff700 1 --2- 172.21.15.163:0/159984895 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7ff3e80a1150 0x7ff3e80a3600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:14:34.837 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:34.792+0000 7ff3f7fff700 1 --2- 172.21.15.163:0/159984895 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7ff3e80a1150 0x7ff3e80a3600 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7ff3e4009c60 tx=0x7ff3e4009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:14:34.841 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:34.792+0000 7ff40acdbb80 1 Processor -- start 2023-07-14T18:14:34.841 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:34.793+0000 7ff40acdbb80 1 -- start start 2023-07-14T18:14:34.842 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:34.793+0000 7ff40acdbb80 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55c2f3d54f60 0x55c2f3d55370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:14:34.842 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:34.793+0000 7ff40acdbb80 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55c2f3d558b0 0x55c2f3d55ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:14:34.842 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:34.793+0000 7ff40acdbb80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c2f3d564b0 0x55c2f3d56920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:14:34.842 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:34.793+0000 7ff40acdbb80 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c2f3c59cb0 con 0x55c2f3d54f60 2023-07-14T18:14:34.842 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:34.793+0000 7ff40acdbb80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c2f3caca40 con 0x55c2f3d564b0 2023-07-14T18:14:34.842 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:34.793+0000 7ff40acdbb80 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c2f3ca5ed0 con 0x55c2f3d558b0 2023-07-14T18:14:34.842 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:34.793+0000 7ff3fc8df700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55c2f3d54f60 0x55c2f3d55370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:14:34.842 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:34.793+0000 7ff3f7fff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55c2f3d558b0 0x55c2f3d55ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:14:34.843 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:34.793+0000 7ff3fc8df700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55c2f3d54f60 0x55c2f3d55370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:59140/0 (socket says 172.21.15.163:59140) 2023-07-14T18:14:34.843 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:34.793+0000 7ff3fc8df700 1 -- 172.21.15.163:0/58931872 learned_addr learned my addr 172.21.15.163:0/58931872 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:14:34.843 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:34.793+0000 7ff3f7fff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55c2f3d558b0 0x55c2f3d55ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.163:40964/0 (socket says 172.21.15.163:40964) 2023-07-14T18:14:34.843 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:34.793+0000 7ff3fd0e0700 1 --2- 172.21.15.163:0/58931872 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c2f3d564b0 0x55c2f3d56920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:14:34.843 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:34.793+0000 7ff3f7fff700 1 -- 172.21.15.163:0/58931872 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c2f3d564b0 msgr2=0x55c2f3d56920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:14:34.843 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:34.793+0000 7ff3f7fff700 1 --2- 172.21.15.163:0/58931872 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c2f3d564b0 0x55c2f3d56920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:34.843 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:34.793+0000 7ff3f7fff700 1 -- 172.21.15.163:0/58931872 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55c2f3d54f60 msgr2=0x55c2f3d55370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:14:34.844 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:34.793+0000 7ff3f7fff700 1 --2- 172.21.15.163:0/58931872 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55c2f3d54f60 0x55c2f3d55370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:34.844 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:34.793+0000 7ff3f7fff700 1 -- 172.21.15.163:0/58931872 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c2f3ad3de0 con 0x55c2f3d558b0 2023-07-14T18:14:34.844 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:34.793+0000 7ff3f7fff700 1 --2- 172.21.15.163:0/58931872 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55c2f3d558b0 0x55c2f3d55ed0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7ff3e400e3b0 tx=0x7ff3e4014000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e0c0c4979c5612f8 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:14:34.844 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:34.794+0000 7ff3e2ffd700 1 -- 172.21.15.163:0/58931872 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3e400ed50 con 0x55c2f3d558b0 2023-07-14T18:14:34.844 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:34.794+0000 7ff3e2ffd700 1 -- 172.21.15.163:0/58931872 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ff3e4021070 con 0x55c2f3d558b0 2023-07-14T18:14:34.844 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:34.794+0000 7ff3e2ffd700 1 -- 172.21.15.163:0/58931872 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3e4003df0 con 0x55c2f3d558b0 2023-07-14T18:14:34.844 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:34.794+0000 7ff40acdbb80 1 -- 172.21.15.163:0/58931872 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55c2f3d558b0 msgr2=0x55c2f3d55ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:14:34.844 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:34.794+0000 7ff40acdbb80 1 --2- 172.21.15.163:0/58931872 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55c2f3d558b0 0x55c2f3d55ed0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7ff3e400e3b0 tx=0x7ff3e4014000 comp rx=0 tx=0).stop 2023-07-14T18:14:34.845 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:34.794+0000 7ff40acdbb80 1 -- 172.21.15.163:0/58931872 shutdown_connections 2023-07-14T18:14:34.845 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:34.794+0000 7ff40acdbb80 1 --2- 172.21.15.163:0/58931872 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c2f3d564b0 0x55c2f3d56920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:34.845 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:34.794+0000 7ff40acdbb80 1 --2- 172.21.15.163:0/58931872 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55c2f3d54f60 0x55c2f3d55370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:34.845 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:34.794+0000 7ff40acdbb80 1 --2- 172.21.15.163:0/58931872 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55c2f3d558b0 0x55c2f3d55ed0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:34.845 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:34.794+0000 7ff40acdbb80 1 -- 172.21.15.163:0/58931872 >> 172.21.15.163:0/58931872 conn(0x55c2f3d4a680 msgr2=0x55c2f3d4f9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:14:34.845 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:34.794+0000 7ff40acdbb80 1 -- 172.21.15.163:0/58931872 shutdown_connections 2023-07-14T18:14:34.845 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:34.795+0000 7ff40acdbb80 1 -- 172.21.15.163:0/58931872 wait complete. 2023-07-14T18:14:34.845 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:34.795+0000 7ff40acdbb80 1 -- start start 2023-07-14T18:14:34.846 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:34.795+0000 7ff40acdbb80 1 Processor -- start 2023-07-14T18:14:34.846 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:34.795+0000 7ff40acdbb80 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55c2f3d54f60 0x55c2f3d5e940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:14:34.846 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:34.795+0000 7ff40acdbb80 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55c2f3d558b0 0x55c2f3d5ee80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:14:34.846 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:34.795+0000 7ff40acdbb80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c2f3d564b0 0x55c2f3d65ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:14:34.846 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:34.795+0000 7ff40acdbb80 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c2f3c45ac0 con 0x55c2f3d54f60 2023-07-14T18:14:34.846 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:34.795+0000 7ff40acdbb80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c2f3c457c0 con 0x55c2f3d564b0 2023-07-14T18:14:34.846 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:34.795+0000 7ff40acdbb80 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c2f3b29920 con 0x55c2f3d558b0 2023-07-14T18:14:34.846 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:34.795+0000 7ff40acdbb80 10 client.0 _ll_register_callbacks cb 0x55c2f3c43760 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T18:14:34.847 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:34.795+0000 7ff3fc8df700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55c2f3d54f60 0x55c2f3d5e940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:14:34.847 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:34.796+0000 7ff3fc8df700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55c2f3d54f60 0x55c2f3d5e940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:59146/0 (socket says 172.21.15.163:59146) 2023-07-14T18:14:34.847 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:34.796+0000 7ff3fc8df700 1 -- 172.21.15.163:0/1232791411 learned_addr learned my addr 172.21.15.163:0/1232791411 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:14:34.847 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:34.796+0000 7ff3f7fff700 1 --2- 172.21.15.163:0/1232791411 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55c2f3d558b0 0x55c2f3d5ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:14:34.847 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:34.796+0000 7ff3fd0e0700 1 --2- 172.21.15.163:0/1232791411 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c2f3d564b0 0x55c2f3d65ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:14:34.847 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:34.796+0000 7ff3fc8df700 1 -- 172.21.15.163:0/1232791411 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55c2f3d558b0 msgr2=0x55c2f3d5ee80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:14:34.847 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:34.796+0000 7ff3fc8df700 1 --2- 172.21.15.163:0/1232791411 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55c2f3d558b0 0x55c2f3d5ee80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:34.848 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:34.796+0000 7ff3fc8df700 1 -- 172.21.15.163:0/1232791411 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c2f3d564b0 msgr2=0x55c2f3d65ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:14:34.848 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:34.796+0000 7ff3fc8df700 1 --2- 172.21.15.163:0/1232791411 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c2f3d564b0 0x55c2f3d65ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:34.848 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:34.796+0000 7ff3fc8df700 1 -- 172.21.15.163:0/1232791411 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff3e4017070 con 0x55c2f3d54f60 2023-07-14T18:14:34.848 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:34.796+0000 7ff3f7fff700 1 --2- 172.21.15.163:0/1232791411 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55c2f3d558b0 0x55c2f3d5ee80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T18:14:34.848 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:34.796+0000 7ff3fc8df700 1 --2- 172.21.15.163:0/1232791411 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55c2f3d54f60 0x55c2f3d5e940 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7ff3ec003f60 tx=0x7ff3ec009310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c08620d849975c68 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:14:34.848 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:34.796+0000 7ff3d7fff700 10 client.0 ms_handle_connect on v2:172.21.15.163:3300/0 2023-07-14T18:14:34.848 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:34.796+0000 7ff3d7fff700 1 -- 172.21.15.163:0/1232791411 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3ec09f030 con 0x55c2f3d54f60 2023-07-14T18:14:34.848 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:34.796+0000 7ff3d7fff700 1 -- 172.21.15.163:0/1232791411 <== mon.0 v2:172.21.15.163:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 9049+0+0 (secure 0 0 0) 0x7ff3ec09f270 con 0x55c2f3d54f60 2023-07-14T18:14:34.849 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:34.796+0000 7ff40acdbb80 1 -- 172.21.15.163:0/1232791411 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55c2f3bff4f0 con 0x55c2f3d54f60 2023-07-14T18:14:34.849 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:34.796+0000 7ff3d7fff700 1 -- 172.21.15.163:0/1232791411 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff3ec0a3600 con 0x55c2f3d54f60 2023-07-14T18:14:34.849 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:34.796+0000 7ff40acdbb80 10 client.16119 fetch_fsmap learned FSMap version 31 2023-07-14T18:14:34.849 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:34.796+0000 7ff40acdbb80 1 -- 172.21.15.163:0/1232791411 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) v3 -- 0x55c2f3abcc60 con 0x55c2f3d54f60 2023-07-14T18:14:34.849 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:34.796+0000 7ff3d7fff700 1 -- 172.21.15.163:0/1232791411 <== mon.0 v2:172.21.15.163:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ff3ec0c9080 con 0x55c2f3d54f60 2023-07-14T18:14:34.849 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:34.797+0000 7ff3d7fff700 1 -- 172.21.15.163:0/1232791411 <== mon.0 v2:172.21.15.163:3300/0 5 ==== fsmap(e 31) v1 ==== 7486+0+0 (secure 0 0 0) 0x7ff3ec0b3b90 con 0x55c2f3d54f60 2023-07-14T18:14:34.849 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:34.797+0000 7ff40acdbb80 10 client.16119 fetch_fsmap finished waiting for FSMap version 31 2023-07-14T18:14:34.849 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:34.797+0000 7ff40acdbb80 10 client.16119 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-07-14T18:14:34.850 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:34.797+0000 7ff40acdbb80 20 client.16119 populate_metadata read hostname 'smithi163' 2023-07-14T18:14:34.850 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:34.797+0000 7ff40acdbb80 1 --2- 172.21.15.163:0/1232791411 >> [v2:172.21.15.172:6838/3850440096,v1:172.21.15.172:6839/3850440096] conn(0x55c2f3d6a340 0x55c2f3d6c750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:14:34.850 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:34.797+0000 7ff40acdbb80 4 client.16119 mds_command: new command op to 24518 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-14T18:14:34.850 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:34.797+0000 7ff40acdbb80 1 -- 172.21.15.163:0/1232791411 --> [v2:172.21.15.172:6838/3850440096,v1:172.21.15.172:6839/3850440096] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55c2f3d23da0 con 0x55c2f3d6a340 2023-07-14T18:14:34.850 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:34.797+0000 7ff3f7fff700 1 --2- 172.21.15.163:0/1232791411 >> [v2:172.21.15.172:6838/3850440096,v1:172.21.15.172:6839/3850440096] conn(0x55c2f3d6a340 0x55c2f3d6c750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:14:34.850 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:34.797+0000 7ff3d7fff700 10 client.16119 ms_handle_connect on v2:172.21.15.172:6838/3850440096 2023-07-14T18:14:34.850 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:34.797+0000 7ff3f7fff700 1 --2- 172.21.15.163:0/1232791411 >> [v2:172.21.15.172:6838/3850440096,v1:172.21.15.172:6839/3850440096] conn(0x55c2f3d6a340 0x55c2f3d6c750 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bd31474667ba7d22 server_cookie=dccfc99b283e4c70 in_seq=0 out_seq=0 2023-07-14T18:14:34.851 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:34.800+0000 7ff3d7fff700 1 -- 172.21.15.163:0/1232791411 <== mds.0 v2:172.21.15.172:6838/3850440096 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18017 (crc 0 0 0) 0x55c2f3d23da0 con 0x55c2f3d6a340 2023-07-14T18:14:34.851 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:34.800+0000 7ff3d7fff700 10 client.16119 handle_command_reply: tid=0 2023-07-14T18:14:34.852 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:34.800+0000 7ff40acdbb80 1 client.16119 shutdown 2023-07-14T18:14:34.852 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:34.800+0000 7ff40acdbb80 1 -- 172.21.15.163:0/1232791411 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55c2f3d54f60 msgr2=0x55c2f3d5e940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:14:34.852 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:34.800+0000 7ff40acdbb80 1 --2- 172.21.15.163:0/1232791411 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55c2f3d54f60 0x55c2f3d5e940 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7ff3ec003f60 tx=0x7ff3ec009310 comp rx=0 tx=0).stop 2023-07-14T18:14:34.852 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:34.800+0000 7ff40acdbb80 1 -- 172.21.15.163:0/1232791411 shutdown_connections 2023-07-14T18:14:34.852 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:34.800+0000 7ff40acdbb80 1 --2- 172.21.15.163:0/1232791411 >> [v2:172.21.15.172:6838/3850440096,v1:172.21.15.172:6839/3850440096] conn(0x55c2f3d6a340 0x55c2f3d6c750 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:34.852 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:34.800+0000 7ff40acdbb80 1 --2- 172.21.15.163:0/1232791411 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c2f3d564b0 0x55c2f3d65ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:34.852 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:34.800+0000 7ff40acdbb80 1 --2- 172.21.15.163:0/1232791411 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55c2f3d54f60 0x55c2f3d5e940 unknown :-1 s=CLOSED pgs=639 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:34.853 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:34.800+0000 7ff3d7fff700 0 client.16119 ms_handle_reset on v2:172.21.15.172:6838/3850440096 2023-07-14T18:14:34.853 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:34.800+0000 7ff40acdbb80 1 --2- 172.21.15.163:0/1232791411 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55c2f3d558b0 0x55c2f3d5ee80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:34.853 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:34.800+0000 7ff40acdbb80 1 -- 172.21.15.163:0/1232791411 >> 172.21.15.163:0/1232791411 conn(0x55c2f3d4a680 msgr2=0x55c2f3d4e650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:14:34.853 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:34.800+0000 7ff40acdbb80 1 -- 172.21.15.163:0/1232791411 shutdown_connections 2023-07-14T18:14:34.853 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:34.800+0000 7ff40acdbb80 1 -- 172.21.15.163:0/1232791411 wait complete. 2023-07-14T18:14:34.853 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:34.800+0000 7ff40acdbb80 20 client.16119 trim_cache size 0 max 16384 2023-07-14T18:14:34.862 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:34.818+0000 7ff40acdbb80 1 Processor -- start 2023-07-14T18:14:34.863 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:34.818+0000 7ff40acdbb80 1 -- start start 2023-07-14T18:14:34.863 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:34.819+0000 7ff40acdbb80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c2f3d54f60 0x55c2f3d667b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:14:34.863 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:34.819+0000 7ff40acdbb80 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55c2f3d558b0 0x55c2f3d65e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:14:34.863 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:34.819+0000 7ff40acdbb80 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55c2f3d564b0 0x55c2f3d4f0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:14:34.863 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:34.819+0000 7ff40acdbb80 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c2f3d4a2e0 con 0x55c2f3d564b0 2023-07-14T18:14:34.863 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:34.819+0000 7ff40acdbb80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c2f3d56360 con 0x55c2f3d54f60 2023-07-14T18:14:34.863 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:34.819+0000 7ff40acdbb80 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c2f3d508b0 con 0x55c2f3d558b0 2023-07-14T18:14:34.864 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:34.819+0000 7ff3fd0e0700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55c2f3d564b0 0x55c2f3d4f0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:14:34.864 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:34.819+0000 7ff3fd0e0700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55c2f3d564b0 0x55c2f3d4f0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:59158/0 (socket says 172.21.15.163:59158) 2023-07-14T18:14:34.864 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:34.819+0000 7ff3fd0e0700 1 -- 172.21.15.163:0/1186096694 learned_addr learned my addr 172.21.15.163:0/1186096694 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:14:34.864 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:34.819+0000 7ff3fc8df700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c2f3d54f60 0x55c2f3d667b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:14:34.864 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:34.819+0000 7ff3f7fff700 1 --2- 172.21.15.163:0/1186096694 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55c2f3d558b0 0x55c2f3d65e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:14:34.864 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:34.819+0000 7ff3fd0e0700 1 -- 172.21.15.163:0/1186096694 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55c2f3d558b0 msgr2=0x55c2f3d65e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:14:34.864 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:34.819+0000 7ff3fd0e0700 1 --2- 172.21.15.163:0/1186096694 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55c2f3d558b0 0x55c2f3d65e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:34.865 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:34.819+0000 7ff3fd0e0700 1 -- 172.21.15.163:0/1186096694 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c2f3d54f60 msgr2=0x55c2f3d667b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:14:34.865 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:34.819+0000 7ff3fd0e0700 1 --2- 172.21.15.163:0/1186096694 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c2f3d54f60 0x55c2f3d667b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:34.865 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:34.819+0000 7ff3fd0e0700 1 -- 172.21.15.163:0/1186096694 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c2f3afa250 con 0x55c2f3d564b0 2023-07-14T18:14:34.865 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:34.819+0000 7ff3fc8df700 1 --2- 172.21.15.163:0/1186096694 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c2f3d54f60 0x55c2f3d667b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T18:14:34.865 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:34.819+0000 7ff3fd0e0700 1 --2- 172.21.15.163:0/1186096694 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55c2f3d564b0 0x55c2f3d4f0f0 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7ff3f0007c10 tx=0x7ff3f0009920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e80208d01b1cbc3e server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:14:34.867 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:34.819+0000 7ff3e37fe700 1 -- 172.21.15.163:0/1186096694 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3f0018070 con 0x55c2f3d564b0 2023-07-14T18:14:34.867 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:34.820+0000 7ff3e37fe700 1 -- 172.21.15.163:0/1186096694 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ff3f0013bc0 con 0x55c2f3d564b0 2023-07-14T18:14:34.867 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:34.820+0000 7ff3e37fe700 1 -- 172.21.15.163:0/1186096694 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3f001cc30 con 0x55c2f3d564b0 2023-07-14T18:14:34.868 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:34.820+0000 7ff40acdbb80 1 -- 172.21.15.163:0/1186096694 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55c2f3d564b0 msgr2=0x55c2f3d4f0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:14:34.868 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:34.820+0000 7ff40acdbb80 1 --2- 172.21.15.163:0/1186096694 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55c2f3d564b0 0x55c2f3d4f0f0 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7ff3f0007c10 tx=0x7ff3f0009920 comp rx=0 tx=0).stop 2023-07-14T18:14:34.868 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:34.820+0000 7ff40acdbb80 1 -- 172.21.15.163:0/1186096694 shutdown_connections 2023-07-14T18:14:34.868 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:34.820+0000 7ff40acdbb80 1 --2- 172.21.15.163:0/1186096694 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55c2f3d564b0 0x55c2f3d4f0f0 unknown :-1 s=CLOSED pgs=640 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:34.868 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:34.820+0000 7ff40acdbb80 1 --2- 172.21.15.163:0/1186096694 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c2f3d54f60 0x55c2f3d667b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:34.868 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:34.820+0000 7ff40acdbb80 1 --2- 172.21.15.163:0/1186096694 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55c2f3d558b0 0x55c2f3d65e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:34.868 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:34.820+0000 7ff40acdbb80 1 -- 172.21.15.163:0/1186096694 >> 172.21.15.163:0/1186096694 conn(0x55c2f3d4a680 msgr2=0x55c2f3d4bb50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:14:34.869 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:34.820+0000 7ff40acdbb80 1 -- 172.21.15.163:0/1186096694 shutdown_connections 2023-07-14T18:14:34.869 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:34.820+0000 7ff40acdbb80 1 -- 172.21.15.163:0/1186096694 wait complete. 2023-07-14T18:14:34.869 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:34.821+0000 7ff40acdbb80 1 -- start start 2023-07-14T18:14:34.869 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:34.821+0000 7ff40acdbb80 1 Processor -- start 2023-07-14T18:14:34.869 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:34.821+0000 7ff40acdbb80 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55c2f3d54f60 0x55c2f3d65ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:14:34.869 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:34.821+0000 7ff40acdbb80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c2f3d558b0 0x55c2f3d62550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:14:34.869 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:34.821+0000 7ff40acdbb80 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55c2f3d564b0 0x55c2f3d62a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:14:34.869 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:34.821+0000 7ff40acdbb80 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c2f3d662d0 con 0x55c2f3d54f60 2023-07-14T18:14:34.870 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:34.821+0000 7ff40acdbb80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c2f3d63000 con 0x55c2f3d558b0 2023-07-14T18:14:34.870 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:34.821+0000 7ff40acdbb80 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c2f3d631c0 con 0x55c2f3d564b0 2023-07-14T18:14:34.870 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:34.821+0000 7ff40acdbb80 10 client.0 _ll_register_callbacks cb 0x7ff3ec09ad80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T18:14:34.870 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:34.821+0000 7ff3fc8df700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55c2f3d54f60 0x55c2f3d65ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:14:34.870 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:34.822+0000 7ff3f7fff700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c2f3d558b0 0x55c2f3d62550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:14:34.870 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:34.822+0000 7ff3fc8df700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55c2f3d54f60 0x55c2f3d65ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:59160/0 (socket says 172.21.15.163:59160) 2023-07-14T18:14:34.870 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:34.822+0000 7ff3fc8df700 1 -- 172.21.15.163:0/2245965585 learned_addr learned my addr 172.21.15.163:0/2245965585 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:14:34.871 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:34.822+0000 7ff3fd0e0700 1 --2- 172.21.15.163:0/2245965585 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55c2f3d564b0 0x55c2f3d62a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:14:34.871 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:34.822+0000 7ff3fd0e0700 1 -- 172.21.15.163:0/2245965585 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c2f3d558b0 msgr2=0x55c2f3d62550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:14:34.871 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:34.822+0000 7ff3fd0e0700 1 --2- 172.21.15.163:0/2245965585 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c2f3d558b0 0x55c2f3d62550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:34.871 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:34.822+0000 7ff3fd0e0700 1 -- 172.21.15.163:0/2245965585 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55c2f3d54f60 msgr2=0x55c2f3d65ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:14:34.871 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:34.822+0000 7ff3fd0e0700 1 --2- 172.21.15.163:0/2245965585 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55c2f3d54f60 0x55c2f3d65ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:34.871 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:34.822+0000 7ff3fd0e0700 1 -- 172.21.15.163:0/2245965585 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55c2f3abcc60 con 0x55c2f3d564b0 2023-07-14T18:14:34.871 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:34.822+0000 7ff3fc8df700 1 --2- 172.21.15.163:0/2245965585 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55c2f3d54f60 0x55c2f3d65ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T18:14:34.871 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:34.822+0000 7ff3fd0e0700 1 --2- 172.21.15.163:0/2245965585 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55c2f3d564b0 0x55c2f3d62a90 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7ff3f0009b30 tx=0x7ff3f0004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=81d049019b932fa2 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:14:34.872 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:34.822+0000 7ff3d7fff700 10 client.0 ms_handle_connect on v2:172.21.15.184:3300/0 2023-07-14T18:14:34.872 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:34.823+0000 7ff3d7fff700 1 -- 172.21.15.163:0/2245965585 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3f0018040 con 0x55c2f3d564b0 2023-07-14T18:14:34.872 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:34.824+0000 7ff3d7fff700 1 -- 172.21.15.163:0/2245965585 <== mon.1 v2:172.21.15.184:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 9049+0+0 (secure 0 0 0) 0x7ff3f0004cd0 con 0x55c2f3d564b0 2023-07-14T18:14:34.872 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:34.824+0000 7ff40acdbb80 1 -- 172.21.15.163:0/2245965585 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7ff3e4021070 con 0x55c2f3d564b0 2023-07-14T18:14:34.872 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:34.824+0000 7ff3d7fff700 1 -- 172.21.15.163:0/2245965585 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff3f001cb40 con 0x55c2f3d564b0 2023-07-14T18:14:34.872 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:34.824+0000 7ff40acdbb80 10 client.25696 fetch_fsmap learned FSMap version 31 2023-07-14T18:14:34.872 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:34.824+0000 7ff40acdbb80 1 -- 172.21.15.163:0/2245965585 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) v3 -- 0x7ff3f00078c0 con 0x55c2f3d564b0 2023-07-14T18:14:34.872 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:34.824+0000 7ff3d7fff700 1 -- 172.21.15.163:0/2245965585 <== mon.1 v2:172.21.15.184:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ff3e4021070 con 0x55c2f3d564b0 2023-07-14T18:14:34.873 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:34.824+0000 7ff3d7fff700 1 -- 172.21.15.163:0/2245965585 <== mon.1 v2:172.21.15.184:3300/0 5 ==== fsmap(e 31) v1 ==== 7486+0+0 (secure 0 0 0) 0x7ff3f002d070 con 0x55c2f3d564b0 2023-07-14T18:14:34.874 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:34.824+0000 7ff40acdbb80 10 client.25696 fetch_fsmap finished waiting for FSMap version 31 2023-07-14T18:14:34.874 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:34.824+0000 7ff40acdbb80 10 client.25696 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-07-14T18:14:34.874 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:34.824+0000 7ff40acdbb80 20 client.25696 populate_metadata read hostname 'smithi163' 2023-07-14T18:14:34.874 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:34.824+0000 7ff40acdbb80 1 --2- 172.21.15.163:0/2245965585 >> [v2:172.21.15.172:6838/3850440096,v1:172.21.15.172:6839/3850440096] conn(0x55c2f3dbf880 0x55c2f3dc1c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:14:34.874 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:34.824+0000 7ff40acdbb80 4 client.25696 mds_command: new command op to 24518 tid=0[{"prefix": "scrub status"}] 2023-07-14T18:14:34.875 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:34.824+0000 7ff40acdbb80 1 -- 172.21.15.163:0/2245965585 --> [v2:172.21.15.172:6838/3850440096,v1:172.21.15.172:6839/3850440096] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55c2f3c9eeb0 con 0x55c2f3dbf880 2023-07-14T18:14:34.875 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:34.824+0000 7ff3fc8df700 1 --2- 172.21.15.163:0/2245965585 >> [v2:172.21.15.172:6838/3850440096,v1:172.21.15.172:6839/3850440096] conn(0x55c2f3dbf880 0x55c2f3dc1c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:14:34.875 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:34.825+0000 7ff3d7fff700 10 client.25696 ms_handle_connect on v2:172.21.15.172:6838/3850440096 2023-07-14T18:14:34.875 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:34.825+0000 7ff3fc8df700 1 --2- 172.21.15.163:0/2245965585 >> [v2:172.21.15.172:6838/3850440096,v1:172.21.15.172:6839/3850440096] conn(0x55c2f3dbf880 0x55c2f3dc1c90 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b5b2109fa3fd342b server_cookie=802df1818fdf62f5 in_seq=0 out_seq=0 2023-07-14T18:14:34.875 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:34.825+0000 7ff3d7fff700 1 -- 172.21.15.163:0/2245965585 <== mds.0 v2:172.21.15.172:6838/3850440096 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x55c2f3c9eeb0 con 0x55c2f3dbf880 2023-07-14T18:14:34.875 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:34.825+0000 7ff3d7fff700 10 client.25696 handle_command_reply: tid=0 2023-07-14T18:14:34.875 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:34.825+0000 7ff40acdbb80 1 client.25696 shutdown 2023-07-14T18:14:34.875 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:34.825+0000 7ff40acdbb80 1 -- 172.21.15.163:0/2245965585 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55c2f3d564b0 msgr2=0x55c2f3d62a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:14:34.876 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:34.825+0000 7ff40acdbb80 1 --2- 172.21.15.163:0/2245965585 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55c2f3d564b0 0x55c2f3d62a90 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7ff3f0009b30 tx=0x7ff3f0004ad0 comp rx=0 tx=0).stop 2023-07-14T18:14:34.876 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:34.825+0000 7ff40acdbb80 1 -- 172.21.15.163:0/2245965585 shutdown_connections 2023-07-14T18:14:34.876 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:34.825+0000 7ff40acdbb80 1 --2- 172.21.15.163:0/2245965585 >> [v2:172.21.15.172:6838/3850440096,v1:172.21.15.172:6839/3850440096] conn(0x55c2f3dbf880 0x55c2f3dc1c90 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:34.876 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:34.825+0000 7ff40acdbb80 1 --2- 172.21.15.163:0/2245965585 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55c2f3d564b0 0x55c2f3d62a90 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:34.876 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:34.825+0000 7ff3d7fff700 0 client.25696 ms_handle_reset on v2:172.21.15.172:6838/3850440096 2023-07-14T18:14:34.876 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:34.825+0000 7ff40acdbb80 1 --2- 172.21.15.163:0/2245965585 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55c2f3d54f60 0x55c2f3d65ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:34.876 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:34.825+0000 7ff40acdbb80 1 --2- 172.21.15.163:0/2245965585 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c2f3d558b0 0x55c2f3d62550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:34.877 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:34.825+0000 7ff40acdbb80 1 -- 172.21.15.163:0/2245965585 >> 172.21.15.163:0/2245965585 conn(0x55c2f3d4a680 msgr2=0x55c2f3d4f0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:14:34.877 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:34.825+0000 7ff40acdbb80 1 -- 172.21.15.163:0/2245965585 shutdown_connections 2023-07-14T18:14:34.877 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:34.825+0000 7ff40acdbb80 1 -- 172.21.15.163:0/2245965585 wait complete. 2023-07-14T18:14:34.877 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:34.826+0000 7ff40acdbb80 20 client.25696 trim_cache size 0 max 16384 2023-07-14T18:14:34.877 INFO:teuthology.orchestra.run.smithi163.stdout:{ 2023-07-14T18:14:34.877 INFO:teuthology.orchestra.run.smithi163.stdout: "status": "no active scrubs running", 2023-07-14T18:14:34.878 INFO:teuthology.orchestra.run.smithi163.stdout: "scrubs": {} 2023-07-14T18:14:34.878 INFO:teuthology.orchestra.run.smithi163.stdout:} 2023-07-14T18:14:34.878 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:34.826+0000 7ff3feb43700 1 -- 172.21.15.163:0/159984895 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7ff3e80a1150 msgr2=0x7ff3e80a3600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:14:34.879 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:34.826+0000 7ff3feb43700 1 --2- 172.21.15.163:0/159984895 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7ff3e80a1150 0x7ff3e80a3600 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7ff3e4009c60 tx=0x7ff3e4009260 comp rx=0 tx=0).stop 2023-07-14T18:14:34.879 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:34.826+0000 7ff3feb43700 1 -- 172.21.15.163:0/159984895 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff3f80feb10 msgr2=0x7ff3f8197b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:14:34.879 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:34.826+0000 7ff3feb43700 1 --2- 172.21.15.163:0/159984895 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff3f80feb10 0x7ff3f8197b10 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7ff3ec000c00 tx=0x7ff3ec004730 comp rx=0 tx=0).stop 2023-07-14T18:14:34.879 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:34.826+0000 7ff3feb43700 1 -- 172.21.15.163:0/159984895 shutdown_connections 2023-07-14T18:14:34.879 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:34.826+0000 7ff3feb43700 1 --2- 172.21.15.163:0/159984895 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7ff3e80a1150 0x7ff3e80a3600 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:34.879 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:34.826+0000 7ff3feb43700 1 --2- 172.21.15.163:0/159984895 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff3f80feb10 0x7ff3f8197b10 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:34.879 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:34.826+0000 7ff3feb43700 1 --2- 172.21.15.163:0/159984895 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff3f8100690 0x7ff3f819f0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:34.879 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:34.826+0000 7ff3feb43700 1 --2- 172.21.15.163:0/159984895 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff3f80ffd00 0x7ff3f8198050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:34.880 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:34.826+0000 7ff3feb43700 1 -- 172.21.15.163:0/159984895 >> 172.21.15.163:0/159984895 conn(0x7ff3f80fa130 msgr2=0x7ff3f80fc420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:14:34.880 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:34.826+0000 7ff3feb43700 1 -- 172.21.15.163:0/159984895 shutdown_connections 2023-07-14T18:14:34.880 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:34.826+0000 7ff3feb43700 1 -- 172.21.15.163:0/159984895 wait complete. 2023-07-14T18:14:34.883 INFO:tasks.cephfs.filesystem:all active scrubs completed 2023-07-14T18:14:34.883 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-14T18:14:34.969 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:14:34 smithi163 ceph-mon[96576]: pgmap v357: 129 pgs: 129 active+clean; 50 MiB data, 572 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.7 MiB/s wr, 321 op/s 2023-07-14T18:14:35.035 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:34.992+0000 7f384f70f700 1 -- 172.21.15.163:0/4178204538 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f3848100680 msgr2=0x7f3848106f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:14:35.036 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:34.992+0000 7f384f70f700 1 --2- 172.21.15.163:0/4178204538 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f3848100680 0x7f3848106f40 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7f3840009990 tx=0x7f3840009ca0 comp rx=0 tx=0).stop 2023-07-14T18:14:35.036 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:34.992+0000 7f384f70f700 1 -- 172.21.15.163:0/4178204538 shutdown_connections 2023-07-14T18:14:35.036 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:34.992+0000 7f384f70f700 1 --2- 172.21.15.163:0/4178204538 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f3848100680 0x7f3848106f40 unknown :-1 s=CLOSED pgs=641 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:35.036 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:34.992+0000 7f384f70f700 1 --2- 172.21.15.163:0/4178204538 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f38480feb00 0x7f38480fef10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:35.036 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:34.992+0000 7f384f70f700 1 --2- 172.21.15.163:0/4178204538 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f38480ffcf0 0x7f3848100140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:35.036 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:34.992+0000 7f384f70f700 1 -- 172.21.15.163:0/4178204538 >> 172.21.15.163:0/4178204538 conn(0x7f38480fa100 msgr2=0x7f38480fc550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:14:35.037 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:34.992+0000 7f384f70f700 1 -- 172.21.15.163:0/4178204538 shutdown_connections 2023-07-14T18:14:35.037 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:34.992+0000 7f384f70f700 1 -- 172.21.15.163:0/4178204538 wait complete. 2023-07-14T18:14:35.038 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:34.993+0000 7f384f70f700 1 Processor -- start 2023-07-14T18:14:35.038 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:34.993+0000 7f384f70f700 1 -- start start 2023-07-14T18:14:35.039 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:34.993+0000 7f384f70f700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f38480feb00 0x7f38481946b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:14:35.039 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:34.993+0000 7f384f70f700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f38480ffcf0 0x7f3848194bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:14:35.039 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:34.993+0000 7f384f70f700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f3848100680 0x7f384819bc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:14:35.039 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:34.993+0000 7f384f70f700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f384819c230 con 0x7f3848100680 2023-07-14T18:14:35.039 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:34.993+0000 7f384f70f700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f384819c370 con 0x7f38480ffcf0 2023-07-14T18:14:35.039 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:34.993+0000 7f384f70f700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f384819c500 con 0x7f38480feb00 2023-07-14T18:14:35.039 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:34.993+0000 7f384ccaa700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f38480ffcf0 0x7f3848194bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:14:35.040 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:34.993+0000 7f384d4ab700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f38480feb00 0x7f38481946b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:14:35.040 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:34.993+0000 7f384ccaa700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f38480ffcf0 0x7f3848194bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.163:59858/0 (socket says 172.21.15.163:59858) 2023-07-14T18:14:35.040 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:34.993+0000 7f384dcac700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f3848100680 0x7f384819bc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:14:35.040 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:34.993+0000 7f384ccaa700 1 -- 172.21.15.163:0/2335168079 learned_addr learned my addr 172.21.15.163:0/2335168079 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:14:35.040 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:34.993+0000 7f384ccaa700 1 -- 172.21.15.163:0/2335168079 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f38480feb00 msgr2=0x7f38481946b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:14:35.040 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:34.993+0000 7f384ccaa700 1 --2- 172.21.15.163:0/2335168079 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f38480feb00 0x7f38481946b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:35.040 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:34.993+0000 7f384ccaa700 1 -- 172.21.15.163:0/2335168079 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f3848100680 msgr2=0x7f384819bc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:14:35.041 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:34.993+0000 7f384ccaa700 1 --2- 172.21.15.163:0/2335168079 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f3848100680 0x7f384819bc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:35.041 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:34.993+0000 7f384ccaa700 1 -- 172.21.15.163:0/2335168079 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38400095f0 con 0x7f38480ffcf0 2023-07-14T18:14:35.041 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:34.993+0000 7f384dcac700 1 --2- 172.21.15.163:0/2335168079 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f3848100680 0x7f384819bc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T18:14:35.041 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:34.994+0000 7f384ccaa700 1 --2- 172.21.15.163:0/2335168079 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f38480ffcf0 0x7f3848194bf0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f383c00eab0 tx=0x7f383c00edc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:14:35.041 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:34.994+0000 7f38467fc700 1 -- 172.21.15.163:0/2335168079 <== mon.2 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f383c013070 con 0x7f38480ffcf0 2023-07-14T18:14:35.041 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:34.994+0000 7f38467fc700 1 -- 172.21.15.163:0/2335168079 <== mon.2 v2:172.21.15.172:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f383c00be50 con 0x7f38480ffcf0 2023-07-14T18:14:35.041 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:34.994+0000 7f38467fc700 1 -- 172.21.15.163:0/2335168079 <== mon.2 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f383c017e60 con 0x7f38480ffcf0 2023-07-14T18:14:35.041 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:34.994+0000 7f384f70f700 1 -- 172.21.15.163:0/2335168079 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3848067800 con 0x7f38480ffcf0 2023-07-14T18:14:35.042 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:34.994+0000 7f384f70f700 1 -- 172.21.15.163:0/2335168079 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3848067d10 con 0x7f38480ffcf0 2023-07-14T18:14:35.042 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:34.995+0000 7f384f70f700 1 -- 172.21.15.163:0/2335168079 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f384810a190 con 0x7f38480ffcf0 2023-07-14T18:14:35.042 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:34.996+0000 7f38467fc700 1 -- 172.21.15.163:0/2335168079 <== mon.2 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 18) v1 ==== 135716+0+0 (secure 0 0 0) 0x7f383c00b9c0 con 0x7f38480ffcf0 2023-07-14T18:14:35.042 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:34.997+0000 7f38467fc700 1 --2- 172.21.15.163:0/2335168079 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f38300a1220 0x7f38300a36d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:14:35.043 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:34.997+0000 7f384d4ab700 1 --2- 172.21.15.163:0/2335168079 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f38300a1220 0x7f38300a36d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:14:35.043 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:34.997+0000 7f38467fc700 1 -- 172.21.15.163:0/2335168079 <== mon.2 v2:172.21.15.172:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 9049+0+0 (secure 0 0 0) 0x7f383c0ce610 con 0x7f38480ffcf0 2023-07-14T18:14:35.043 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:34.997+0000 7f384d4ab700 1 --2- 172.21.15.163:0/2335168079 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f38300a1220 0x7f38300a36d0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f38480ffb50 tx=0x7f383800b040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:14:35.046 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.003+0000 7f38467fc700 1 -- 172.21.15.163:0/2335168079 <== mon.2 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178025 (secure 0 0 0) 0x7f383c0979d0 con 0x7f38480ffcf0 2023-07-14T18:14:35.177 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:14:34 smithi184 ceph-mon[98481]: pgmap v357: 129 pgs: 129 active+clean; 50 MiB data, 572 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.7 MiB/s wr, 321 op/s 2023-07-14T18:14:35.278 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:14:34 smithi172 ceph-mon[97983]: pgmap v357: 129 pgs: 129 active+clean; 50 MiB data, 572 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.7 MiB/s wr, 321 op/s 2023-07-14T18:14:35.313 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.270+0000 7f384f70f700 1 -- 172.21.15.163:0/2335168079 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3848068630 con 0x7f38480ffcf0 2023-07-14T18:14:35.314 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.270+0000 7f38467fc700 1 -- 172.21.15.163:0/2335168079 <== mon.2 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 31 v31) v1 ==== 94+0+10908 (secure 0 0 0) 0x7f383c09aff0 con 0x7f38480ffcf0 2023-07-14T18:14:35.314 INFO:teuthology.orchestra.run.smithi163.stdout: 2023-07-14T18:14:35.314 INFO:teuthology.orchestra.run.smithi163.stdout:{"epoch":31,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14562,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.163:6835/1058662632","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6834","nonce":1058662632},{"type":"v1","addr":"172.21.15.163:6835","nonce":1058662632}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":14568,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.163:6837/1107244425","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6836","nonce":1107244425},{"type":"v1","addr":"172.21.15.163:6837","nonce":1107244425}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":31,"flags":178,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"balance_automate":true},"ever_allowed_features":160,"explicitly_allowed_features":160,"created":"2023-07-14T18:11:09.109693+0000","modified":"2023-07-14T18:14:19.421059+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24518,"mds_1":24493,"mds_2":24479,"mds_3":24478,"mds_4":14652},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14640":{"gid":14640,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.163:6839/1337572937","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6838","nonce":1337572937},{"type":"v1","addr":"172.21.15.163:6839","nonce":1337572937}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_14652":{"gid":14652,"name":"a","rank":4,"incarnation":26,"state":"up:active","state_seq":9,"addr":"172.21.15.163:6841/1032082642","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6840","nonce":1032082642},{"type":"v1","addr":"172.21.15.163:6841","nonce":1032082642}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24421":{"gid":24421,"name":"l","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.184:6833/797722972","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6832","nonce":797722972},{"type":"v1","addr":"172.21.15.184:6833","nonce":797722972}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24431":{"gid":24431,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6833/1075696311","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":1075696311},{"type":"v1","addr":"172.21.15.172:6833","nonce":1075696311}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24458":{"gid":24458,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6835/1158120127","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":1158120127},{"type":"v1","addr":"172.21.15.172:6835","nonce":1158120127}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24466":{"gid":24466,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.184:6835/460134263","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6834","nonce":460134263},{"type":"v1","addr":"172.21.15.184:6835","nonce":460134263}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24478":{"gid":24478,"name":"c","rank":3,"incarnation":24,"state":"up:active","state_seq":11,"addr":"172.21.15.184:6837/3389277679","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6836","nonce":3389277679},{"type":"v1","addr":"172.21.15.184:6837","nonce":3389277679}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24479":{"gid":24479,"name":"h","rank":2,"incarnation":22,"state":"up:active","state_seq":10,"addr":"172.21.15.172:6837/3783835012","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":3783835012},{"type":"v1","addr":"172.21.15.172:6837","nonce":3783835012}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24493":{"gid":24493,"name":"i","rank":1,"incarnation":20,"state":"up:active","state_seq":9,"addr":"172.21.15.184:6839/2819059257","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6838","nonce":2819059257},{"type":"v1","addr":"172.21.15.184:6839","nonce":2819059257}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24518":{"gid":24518,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.172:6839/3850440096","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6838","nonce":3850440096},{"type":"v1","addr":"172.21.15.172:6839","nonce":3850440096}]},"join_fscid":-1,"export_targets":[1,2,3,4],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-07-14T18:14:35.316 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.273+0000 7f384f70f700 1 -- 172.21.15.163:0/2335168079 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f38300a1220 msgr2=0x7f38300a36d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:14:35.317 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.273+0000 7f384f70f700 1 --2- 172.21.15.163:0/2335168079 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f38300a1220 0x7f38300a36d0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f38480ffb50 tx=0x7f383800b040 comp rx=0 tx=0).stop 2023-07-14T18:14:35.317 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.273+0000 7f384f70f700 1 -- 172.21.15.163:0/2335168079 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f38480ffcf0 msgr2=0x7f3848194bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:14:35.317 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.273+0000 7f384f70f700 1 --2- 172.21.15.163:0/2335168079 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f38480ffcf0 0x7f3848194bf0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f383c00eab0 tx=0x7f383c00edc0 comp rx=0 tx=0).stop 2023-07-14T18:14:35.317 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.273+0000 7f384f70f700 1 -- 172.21.15.163:0/2335168079 shutdown_connections 2023-07-14T18:14:35.317 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.273+0000 7f384f70f700 1 --2- 172.21.15.163:0/2335168079 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f38300a1220 0x7f38300a36d0 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:35.317 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.273+0000 7f384f70f700 1 --2- 172.21.15.163:0/2335168079 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f38480feb00 0x7f38481946b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:35.318 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.273+0000 7f384f70f700 1 --2- 172.21.15.163:0/2335168079 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f3848100680 0x7f384819bc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:35.318 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.273+0000 7f384f70f700 1 --2- 172.21.15.163:0/2335168079 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f38480ffcf0 0x7f3848194bf0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:35.318 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.273+0000 7f384f70f700 1 -- 172.21.15.163:0/2335168079 >> 172.21.15.163:0/2335168079 conn(0x7f38480fa100 msgr2=0x7f38480fc380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:14:35.318 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.273+0000 7f384f70f700 1 -- 172.21.15.163:0/2335168079 shutdown_connections 2023-07-14T18:14:35.318 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.273+0000 7f384f70f700 1 -- 172.21.15.163:0/2335168079 wait complete. 2023-07-14T18:14:35.318 INFO:teuthology.orchestra.run.smithi163.stderr:dumped fsmap epoch 31 2023-07-14T18:14:35.329 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:4 damage ls 2023-07-14T18:14:35.457 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.413+0000 7f50a7012700 1 -- 172.21.15.163:0/3743650227 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f50a0107dc0 msgr2=0x7f50a010e680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:14:35.457 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.413+0000 7f50a7012700 1 --2- 172.21.15.163:0/3743650227 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f50a0107dc0 0x7f50a010e680 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7f5094009990 tx=0x7f5094009ca0 comp rx=0 tx=0).stop 2023-07-14T18:14:35.457 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.413+0000 7f50a7012700 1 -- 172.21.15.163:0/3743650227 shutdown_connections 2023-07-14T18:14:35.457 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.413+0000 7f50a7012700 1 --2- 172.21.15.163:0/3743650227 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f50a0106240 0x7f50a0106650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:35.457 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.413+0000 7f50a7012700 1 --2- 172.21.15.163:0/3743650227 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f50a0107dc0 0x7f50a010e680 unknown :-1 s=CLOSED pgs=642 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:35.458 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.413+0000 7f50a7012700 1 --2- 172.21.15.163:0/3743650227 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f50a0107430 0x7f50a0107880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:35.458 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.413+0000 7f50a7012700 1 -- 172.21.15.163:0/3743650227 >> 172.21.15.163:0/3743650227 conn(0x7f50a0075270 msgr2=0x7f50a00776c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:14:35.458 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.413+0000 7f50a7012700 1 -- 172.21.15.163:0/3743650227 shutdown_connections 2023-07-14T18:14:35.458 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.413+0000 7f50a7012700 1 -- 172.21.15.163:0/3743650227 wait complete. 2023-07-14T18:14:35.460 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.414+0000 7f50a7012700 1 Processor -- start 2023-07-14T18:14:35.460 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.414+0000 7f50a7012700 1 -- start start 2023-07-14T18:14:35.460 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.414+0000 7f50a7012700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f50a0106240 0x7f50a019be50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:14:35.460 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.414+0000 7f50a7012700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f50a0107430 0x7f50a019c390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:14:35.460 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.414+0000 7f50a7012700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f50a0107dc0 0x7f50a01a3400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:14:35.460 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.414+0000 7f50a7012700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50a01a39d0 con 0x7f50a0107430 2023-07-14T18:14:35.461 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.414+0000 7f50a7012700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50a01a3b10 con 0x7f50a0107dc0 2023-07-14T18:14:35.461 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.414+0000 7f50a7012700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50a01a3ca0 con 0x7f50a0106240 2023-07-14T18:14:35.461 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.414+0000 7f509ffff700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f50a0107430 0x7f50a019c390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:14:35.461 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.414+0000 7f509ffff700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f50a0107430 0x7f50a019c390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:59186/0 (socket says 172.21.15.163:59186) 2023-07-14T18:14:35.461 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.414+0000 7f509ffff700 1 -- 172.21.15.163:0/1174371912 learned_addr learned my addr 172.21.15.163:0/1174371912 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:14:35.461 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.414+0000 7f50a4dae700 1 --2- 172.21.15.163:0/1174371912 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f50a0106240 0x7f50a019be50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:14:35.461 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.414+0000 7f50a55af700 1 --2- 172.21.15.163:0/1174371912 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f50a0107dc0 0x7f50a01a3400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:14:35.461 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.414+0000 7f509ffff700 1 -- 172.21.15.163:0/1174371912 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f50a0106240 msgr2=0x7f50a019be50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:14:35.462 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.414+0000 7f509ffff700 1 --2- 172.21.15.163:0/1174371912 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f50a0106240 0x7f50a019be50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:35.462 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.414+0000 7f509ffff700 1 -- 172.21.15.163:0/1174371912 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f50a0107dc0 msgr2=0x7f50a01a3400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:14:35.462 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.414+0000 7f509ffff700 1 --2- 172.21.15.163:0/1174371912 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f50a0107dc0 0x7f50a01a3400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:35.462 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.414+0000 7f509ffff700 1 -- 172.21.15.163:0/1174371912 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50940095f0 con 0x7f50a0107430 2023-07-14T18:14:35.462 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.414+0000 7f50a55af700 1 --2- 172.21.15.163:0/1174371912 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f50a0107dc0 0x7f50a01a3400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T18:14:35.462 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.414+0000 7f50a4dae700 1 --2- 172.21.15.163:0/1174371912 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f50a0106240 0x7f50a019be50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T18:14:35.462 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.415+0000 7f509ffff700 1 --2- 172.21.15.163:0/1174371912 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f50a0107430 0x7f50a019c390 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7f509000e9a0 tx=0x7f509000ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:14:35.463 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.415+0000 7f509dffb700 1 -- 172.21.15.163:0/1174371912 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5090009790 con 0x7f50a0107430 2023-07-14T18:14:35.463 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.415+0000 7f509dffb700 1 -- 172.21.15.163:0/1174371912 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f5090010430 con 0x7f50a0107430 2023-07-14T18:14:35.463 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.415+0000 7f50a7012700 1 -- 172.21.15.163:0/1174371912 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f50a01a3f80 con 0x7f50a0107430 2023-07-14T18:14:35.463 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.415+0000 7f509dffb700 1 -- 172.21.15.163:0/1174371912 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f509000cea0 con 0x7f50a0107430 2023-07-14T18:14:35.463 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.415+0000 7f50a7012700 1 -- 172.21.15.163:0/1174371912 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f50a01a4400 con 0x7f50a0107430 2023-07-14T18:14:35.467 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.417+0000 7f509dffb700 1 -- 172.21.15.163:0/1174371912 <== mon.0 v2:172.21.15.163:3300/0 4 ==== mgrmap(e 18) v1 ==== 135716+0+0 (secure 0 0 0) 0x7f50900105a0 con 0x7f50a0107430 2023-07-14T18:14:35.467 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.417+0000 7f509dffb700 1 --2- 172.21.15.163:0/1174371912 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f50880a1150 0x7f50880a3600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:14:35.467 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.418+0000 7f50a4dae700 1 --2- 172.21.15.163:0/1174371912 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f50880a1150 0x7f50880a3600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:14:35.467 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.418+0000 7f509dffb700 1 -- 172.21.15.163:0/1174371912 <== mon.0 v2:172.21.15.163:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 9049+0+0 (secure 0 0 0) 0x7f5090014070 con 0x7f50a0107430 2023-07-14T18:14:35.468 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.418+0000 7f50a4dae700 1 --2- 172.21.15.163:0/1174371912 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f50880a1150 0x7f50880a3600 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f50a0107290 tx=0x7f509800b040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:14:35.468 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.419+0000 7f50b31aab80 1 Processor -- start 2023-07-14T18:14:35.468 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.419+0000 7f50b31aab80 1 -- start start 2023-07-14T18:14:35.468 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.419+0000 7f50b31aab80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55fa7545af60 0x55fa7545b370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:14:35.468 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.419+0000 7f50b31aab80 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55fa7545b8b0 0x55fa7545bed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:14:35.468 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.419+0000 7f50b31aab80 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55fa7545c4b0 0x55fa7545c920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:14:35.468 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.419+0000 7f50b31aab80 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fa7535fcb0 con 0x55fa7545b8b0 2023-07-14T18:14:35.469 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.419+0000 7f50b31aab80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fa753b2a40 con 0x55fa7545af60 2023-07-14T18:14:35.469 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.419+0000 7f50b31aab80 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fa753abed0 con 0x55fa7545c4b0 2023-07-14T18:14:35.469 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.419+0000 7f509ffff700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55fa7545b8b0 0x55fa7545bed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:14:35.469 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.419+0000 7f50a4dae700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55fa7545af60 0x55fa7545b370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:14:35.469 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.419+0000 7f50a4dae700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55fa7545af60 0x55fa7545b370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.163:59876/0 (socket says 172.21.15.163:59876) 2023-07-14T18:14:35.469 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.419+0000 7f509ffff700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55fa7545b8b0 0x55fa7545bed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:59194/0 (socket says 172.21.15.163:59194) 2023-07-14T18:14:35.469 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.419+0000 7f50a4dae700 1 -- 172.21.15.163:0/1685569633 learned_addr learned my addr 172.21.15.163:0/1685569633 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:14:35.470 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.419+0000 7f50a55af700 1 --2- 172.21.15.163:0/1685569633 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55fa7545c4b0 0x55fa7545c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:14:35.470 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.420+0000 7f50a4dae700 1 -- 172.21.15.163:0/1685569633 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55fa7545c4b0 msgr2=0x55fa7545c920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:14:35.470 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.420+0000 7f50a4dae700 1 --2- 172.21.15.163:0/1685569633 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55fa7545c4b0 0x55fa7545c920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:35.470 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.420+0000 7f50a4dae700 1 -- 172.21.15.163:0/1685569633 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55fa7545b8b0 msgr2=0x55fa7545bed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:14:35.470 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.420+0000 7f50a4dae700 1 --2- 172.21.15.163:0/1685569633 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55fa7545b8b0 0x55fa7545bed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:35.470 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.420+0000 7f50a4dae700 1 -- 172.21.15.163:0/1685569633 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55fa751d9de0 con 0x55fa7545af60 2023-07-14T18:14:35.470 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.420+0000 7f509ffff700 1 --2- 172.21.15.163:0/1685569633 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55fa7545b8b0 0x55fa7545bed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T18:14:35.470 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.420+0000 7f50a4dae700 1 --2- 172.21.15.163:0/1685569633 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55fa7545af60 0x55fa7545b370 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f509800e910 tx=0x7f5098014000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=185f24e8bb644101 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:14:35.471 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.420+0000 7f5086ffd700 1 -- 172.21.15.163:0/1685569633 <== mon.2 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5098017950 con 0x55fa7545af60 2023-07-14T18:14:35.471 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.420+0000 7f5086ffd700 1 -- 172.21.15.163:0/1685569633 <== mon.2 v2:172.21.15.172:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f509800f040 con 0x55fa7545af60 2023-07-14T18:14:35.471 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.420+0000 7f5086ffd700 1 -- 172.21.15.163:0/1685569633 <== mon.2 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5098021df0 con 0x55fa7545af60 2023-07-14T18:14:35.471 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.421+0000 7f50b31aab80 1 -- 172.21.15.163:0/1685569633 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55fa7545af60 msgr2=0x55fa7545b370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:14:35.471 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.421+0000 7f50b31aab80 1 --2- 172.21.15.163:0/1685569633 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55fa7545af60 0x55fa7545b370 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f509800e910 tx=0x7f5098014000 comp rx=0 tx=0).stop 2023-07-14T18:14:35.471 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.421+0000 7f50b31aab80 1 -- 172.21.15.163:0/1685569633 shutdown_connections 2023-07-14T18:14:35.471 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.421+0000 7f50b31aab80 1 --2- 172.21.15.163:0/1685569633 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55fa7545c4b0 0x55fa7545c920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:35.472 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.421+0000 7f50b31aab80 1 --2- 172.21.15.163:0/1685569633 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55fa7545af60 0x55fa7545b370 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:35.472 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.421+0000 7f50b31aab80 1 --2- 172.21.15.163:0/1685569633 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55fa7545b8b0 0x55fa7545bed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:35.472 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.421+0000 7f50b31aab80 1 -- 172.21.15.163:0/1685569633 >> 172.21.15.163:0/1685569633 conn(0x55fa75450680 msgr2=0x55fa754559d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:14:35.472 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.421+0000 7f50b31aab80 1 -- 172.21.15.163:0/1685569633 shutdown_connections 2023-07-14T18:14:35.472 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.421+0000 7f50b31aab80 1 -- 172.21.15.163:0/1685569633 wait complete. 2023-07-14T18:14:35.472 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.421+0000 7f50b31aab80 1 -- start start 2023-07-14T18:14:35.472 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.421+0000 7f50b31aab80 1 Processor -- start 2023-07-14T18:14:35.472 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.422+0000 7f50b31aab80 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55fa7545af60 0x55fa754648f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:14:35.473 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.422+0000 7f50b31aab80 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55fa7545b8b0 0x55fa75464e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:14:35.473 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.422+0000 7f50b31aab80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55fa7545c4b0 0x55fa7546be70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:14:35.473 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.422+0000 7f50b31aab80 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fa7534bac0 con 0x55fa7545b8b0 2023-07-14T18:14:35.473 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.422+0000 7f50b31aab80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fa7534b7c0 con 0x55fa7545c4b0 2023-07-14T18:14:35.473 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.422+0000 7f50b31aab80 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fa7522f920 con 0x55fa7545af60 2023-07-14T18:14:35.473 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.422+0000 7f50b31aab80 10 client.0 _ll_register_callbacks cb 0x55fa75349760 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T18:14:35.473 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.422+0000 7f50a4dae700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55fa7545af60 0x55fa754648f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:14:35.474 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.422+0000 7f50a4dae700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55fa7545af60 0x55fa754648f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.163:41020/0 (socket says 172.21.15.163:41020) 2023-07-14T18:14:35.474 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.422+0000 7f50a4dae700 1 -- 172.21.15.163:0/2343971917 learned_addr learned my addr 172.21.15.163:0/2343971917 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:14:35.474 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.422+0000 7f50a55af700 1 --2- 172.21.15.163:0/2343971917 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55fa7545c4b0 0x55fa7546be70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:14:35.474 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.422+0000 7f509ffff700 1 --2- 172.21.15.163:0/2343971917 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55fa7545b8b0 0x55fa75464e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:14:35.474 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.422+0000 7f50a4dae700 1 -- 172.21.15.163:0/2343971917 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55fa7545c4b0 msgr2=0x55fa7546be70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:14:35.474 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.422+0000 7f50a4dae700 1 --2- 172.21.15.163:0/2343971917 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55fa7545c4b0 0x55fa7546be70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:35.474 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.422+0000 7f50a4dae700 1 -- 172.21.15.163:0/2343971917 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55fa7545b8b0 msgr2=0x55fa75464e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:14:35.474 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.422+0000 7f50a4dae700 1 --2- 172.21.15.163:0/2343971917 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55fa7545b8b0 0x55fa75464e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:35.475 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.422+0000 7f50a4dae700 1 -- 172.21.15.163:0/2343971917 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f50a01a4400 con 0x55fa7545af60 2023-07-14T18:14:35.475 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.422+0000 7f50a55af700 1 --2- 172.21.15.163:0/2343971917 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55fa7545c4b0 0x55fa7546be70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T18:14:35.475 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.422+0000 7f50a4dae700 1 --2- 172.21.15.163:0/2343971917 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55fa7545af60 0x55fa754648f0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f5098009fd0 tx=0x7f5098022e00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d1dde1893490bb0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:14:35.475 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.422+0000 7f507ffff700 10 client.0 ms_handle_connect on v2:172.21.15.184:3300/0 2023-07-14T18:14:35.475 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.422+0000 7f507ffff700 1 -- 172.21.15.163:0/2343971917 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5098004c30 con 0x55fa7545af60 2023-07-14T18:14:35.475 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.423+0000 7f50b31aab80 1 -- 172.21.15.163:0/2343971917 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55fa753054f0 con 0x55fa7545af60 2023-07-14T18:14:35.475 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.423+0000 7f507ffff700 1 -- 172.21.15.163:0/2343971917 <== mon.1 v2:172.21.15.184:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 9049+0+0 (secure 0 0 0) 0x7f509801c050 con 0x55fa7545af60 2023-07-14T18:14:35.475 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.423+0000 7f507ffff700 1 -- 172.21.15.163:0/2343971917 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5098004d90 con 0x55fa7545af60 2023-07-14T18:14:35.476 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.423+0000 7f50b31aab80 10 client.25714 fetch_fsmap learned FSMap version 31 2023-07-14T18:14:35.476 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.423+0000 7f50b31aab80 1 -- 172.21.15.163:0/2343971917 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) v3 -- 0x7f509800e5f0 con 0x55fa7545af60 2023-07-14T18:14:35.476 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.423+0000 7f507ffff700 1 -- 172.21.15.163:0/2343971917 <== mon.1 v2:172.21.15.184:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55fa753054f0 con 0x55fa7545af60 2023-07-14T18:14:35.476 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.423+0000 7f507ffff700 1 -- 172.21.15.163:0/2343971917 <== mon.1 v2:172.21.15.184:3300/0 5 ==== fsmap(e 31) v1 ==== 7486+0+0 (secure 0 0 0) 0x7f50980052a0 con 0x55fa7545af60 2023-07-14T18:14:35.476 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.423+0000 7f50b31aab80 10 client.25714 fetch_fsmap finished waiting for FSMap version 31 2023-07-14T18:14:35.476 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.423+0000 7f50b31aab80 10 client.25714 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.a 2023-07-14T18:14:35.476 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.423+0000 7f50b31aab80 20 client.25714 populate_metadata read hostname 'smithi163' 2023-07-14T18:14:35.477 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.423+0000 7f50b31aab80 1 --2- 172.21.15.163:0/2343971917 >> [v2:172.21.15.163:6840/1032082642,v1:172.21.15.163:6841/1032082642] conn(0x55fa754706d0 0x55fa75472ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:14:35.477 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.423+0000 7f50b31aab80 4 client.25714 mds_command: new command op to 14652 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-14T18:14:35.477 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.423+0000 7f50b31aab80 1 -- 172.21.15.163:0/2343971917 --> [v2:172.21.15.163:6840/1032082642,v1:172.21.15.163:6841/1032082642] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55fa75429da0 con 0x55fa754706d0 2023-07-14T18:14:35.477 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.423+0000 7f509ffff700 1 --2- 172.21.15.163:0/2343971917 >> [v2:172.21.15.163:6840/1032082642,v1:172.21.15.163:6841/1032082642] conn(0x55fa754706d0 0x55fa75472ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:14:35.477 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.424+0000 7f507ffff700 10 client.25714 ms_handle_connect on v2:172.21.15.163:6840/1032082642 2023-07-14T18:14:35.477 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.424+0000 7f509ffff700 1 --2- 172.21.15.163:0/2343971917 >> [v2:172.21.15.163:6840/1032082642,v1:172.21.15.163:6841/1032082642] conn(0x55fa754706d0 0x55fa75472ae0 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=6242a3ea81260e52 server_cookie=5b67719b5b0acdce in_seq=0 out_seq=0 2023-07-14T18:14:35.478 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.424+0000 7f507ffff700 1 -- 172.21.15.163:0/2343971917 <== mds.4 v2:172.21.15.163:6840/1032082642 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18017 (crc 0 0 0) 0x55fa75429da0 con 0x55fa754706d0 2023-07-14T18:14:35.478 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.424+0000 7f507ffff700 10 client.25714 handle_command_reply: tid=0 2023-07-14T18:14:35.478 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.424+0000 7f50b31aab80 1 client.25714 shutdown 2023-07-14T18:14:35.478 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.425+0000 7f50b31aab80 1 -- 172.21.15.163:0/2343971917 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55fa7545af60 msgr2=0x55fa754648f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:14:35.479 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.425+0000 7f50b31aab80 1 --2- 172.21.15.163:0/2343971917 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55fa7545af60 0x55fa754648f0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f5098009fd0 tx=0x7f5098022e00 comp rx=0 tx=0).stop 2023-07-14T18:14:35.479 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.425+0000 7f50b31aab80 1 -- 172.21.15.163:0/2343971917 shutdown_connections 2023-07-14T18:14:35.479 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.425+0000 7f50b31aab80 1 --2- 172.21.15.163:0/2343971917 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55fa7545af60 0x55fa754648f0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:35.479 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.425+0000 7f50b31aab80 1 --2- 172.21.15.163:0/2343971917 >> [v2:172.21.15.163:6840/1032082642,v1:172.21.15.163:6841/1032082642] conn(0x55fa754706d0 0x55fa75472ae0 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:35.479 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.425+0000 7f50b31aab80 1 --2- 172.21.15.163:0/2343971917 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55fa7545c4b0 0x55fa7546be70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:35.479 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.425+0000 7f507ffff700 0 client.25714 ms_handle_reset on v2:172.21.15.163:6840/1032082642 2023-07-14T18:14:35.479 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.425+0000 7f50b31aab80 1 --2- 172.21.15.163:0/2343971917 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55fa7545b8b0 0x55fa75464e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:35.480 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.425+0000 7f50b31aab80 1 -- 172.21.15.163:0/2343971917 >> 172.21.15.163:0/2343971917 conn(0x55fa75450680 msgr2=0x55fa75454650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:14:35.480 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.425+0000 7f50b31aab80 1 -- 172.21.15.163:0/2343971917 shutdown_connections 2023-07-14T18:14:35.480 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.425+0000 7f50b31aab80 1 -- 172.21.15.163:0/2343971917 wait complete. 2023-07-14T18:14:35.480 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.425+0000 7f50b31aab80 20 client.25714 trim_cache size 0 max 16384 2023-07-14T18:14:35.483 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.439+0000 7f50b31aab80 1 Processor -- start 2023-07-14T18:14:35.483 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.439+0000 7f50b31aab80 1 -- start start 2023-07-14T18:14:35.483 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.439+0000 7f50b31aab80 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55fa7545af60 0x55fa75463fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:14:35.484 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.439+0000 7f50b31aab80 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55fa7545b8b0 0x55fa7546be30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:14:35.484 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.439+0000 7f50b31aab80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55fa7545c4b0 0x55fa75463670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:14:35.484 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.439+0000 7f50b31aab80 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fa75463bb0 con 0x55fa7545b8b0 2023-07-14T18:14:35.485 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.439+0000 7f50b31aab80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fa75465a70 con 0x55fa7545c4b0 2023-07-14T18:14:35.485 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.439+0000 7f50b31aab80 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fa75462610 con 0x55fa7545af60 2023-07-14T18:14:35.485 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.439+0000 7f509ffff700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55fa7545b8b0 0x55fa7546be30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:14:35.485 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.439+0000 7f50a55af700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55fa7545c4b0 0x55fa75463670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:14:35.486 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.439+0000 7f509ffff700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55fa7545b8b0 0x55fa7546be30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:59208/0 (socket says 172.21.15.163:59208) 2023-07-14T18:14:35.486 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.439+0000 7f509ffff700 1 -- 172.21.15.163:0/2206029956 learned_addr learned my addr 172.21.15.163:0/2206029956 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:14:35.486 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.439+0000 7f50a4dae700 1 --2- 172.21.15.163:0/2206029956 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55fa7545af60 0x55fa75463fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:14:35.487 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.440+0000 7f50a55af700 1 -- 172.21.15.163:0/2206029956 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55fa7545af60 msgr2=0x55fa75463fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:14:35.487 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.440+0000 7f50a55af700 1 --2- 172.21.15.163:0/2206029956 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55fa7545af60 0x55fa75463fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:35.487 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.440+0000 7f50a55af700 1 -- 172.21.15.163:0/2206029956 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55fa7545b8b0 msgr2=0x55fa7546be30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:14:35.487 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.440+0000 7f50a55af700 1 --2- 172.21.15.163:0/2206029956 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55fa7545b8b0 0x55fa7546be30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:35.488 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.440+0000 7f50a55af700 1 -- 172.21.15.163:0/2206029956 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55fa751c2c60 con 0x55fa7545c4b0 2023-07-14T18:14:35.488 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.440+0000 7f50a4dae700 1 --2- 172.21.15.163:0/2206029956 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55fa7545af60 0x55fa75463fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T18:14:35.488 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.440+0000 7f50a55af700 1 --2- 172.21.15.163:0/2206029956 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55fa7545c4b0 0x55fa75463670 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f5094006010 tx=0x7f509400b260 comp rx=0 tx=0).ready entity=mon.2 client_cookie=79e5ad9dc43dcef4 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:14:35.494 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.440+0000 7f50877fe700 1 -- 172.21.15.163:0/2206029956 <== mon.2 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f509401d030 con 0x55fa7545c4b0 2023-07-14T18:14:35.494 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.440+0000 7f50877fe700 1 -- 172.21.15.163:0/2206029956 <== mon.2 v2:172.21.15.172:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f509401e040 con 0x55fa7545c4b0 2023-07-14T18:14:35.495 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.440+0000 7f50877fe700 1 -- 172.21.15.163:0/2206029956 <== mon.2 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f509400bc60 con 0x55fa7545c4b0 2023-07-14T18:14:35.495 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.441+0000 7f50b31aab80 1 -- 172.21.15.163:0/2206029956 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55fa7545c4b0 msgr2=0x55fa75463670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:14:35.495 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.441+0000 7f50b31aab80 1 --2- 172.21.15.163:0/2206029956 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55fa7545c4b0 0x55fa75463670 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f5094006010 tx=0x7f509400b260 comp rx=0 tx=0).stop 2023-07-14T18:14:35.495 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.441+0000 7f50b31aab80 1 -- 172.21.15.163:0/2206029956 shutdown_connections 2023-07-14T18:14:35.495 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.441+0000 7f50b31aab80 1 --2- 172.21.15.163:0/2206029956 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55fa7545af60 0x55fa75463fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:35.495 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.441+0000 7f50b31aab80 1 --2- 172.21.15.163:0/2206029956 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55fa7545c4b0 0x55fa75463670 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:35.495 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.441+0000 7f50b31aab80 1 --2- 172.21.15.163:0/2206029956 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55fa7545b8b0 0x55fa7546be30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:35.495 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.441+0000 7f50b31aab80 1 -- 172.21.15.163:0/2206029956 >> 172.21.15.163:0/2206029956 conn(0x55fa75450680 msgr2=0x55fa75462860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:14:35.496 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.441+0000 7f50b31aab80 1 -- 172.21.15.163:0/2206029956 shutdown_connections 2023-07-14T18:14:35.496 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.441+0000 7f50b31aab80 1 -- 172.21.15.163:0/2206029956 wait complete. 2023-07-14T18:14:35.496 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.441+0000 7f50b31aab80 1 -- start start 2023-07-14T18:14:35.496 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.441+0000 7f50b31aab80 1 Processor -- start 2023-07-14T18:14:35.496 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.442+0000 7f50b31aab80 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55fa7545af60 0x55fa75467f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:14:35.496 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.442+0000 7f50b31aab80 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55fa7545b8b0 0x55fa75468470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:14:35.496 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.442+0000 7f50b31aab80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55fa7545c4b0 0x55fa7546b490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:14:35.497 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.442+0000 7f50b31aab80 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fa7546b9d0 con 0x55fa7545af60 2023-07-14T18:14:35.497 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.442+0000 7f50b31aab80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fa7546bb40 con 0x55fa7545c4b0 2023-07-14T18:14:35.497 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.442+0000 7f50b31aab80 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fa7546bd00 con 0x55fa7545b8b0 2023-07-14T18:14:35.497 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.442+0000 7f50b31aab80 10 client.0 _ll_register_callbacks cb 0x7f5090011ef0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T18:14:35.497 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.442+0000 7f50a4dae700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55fa7545af60 0x55fa75467f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:14:35.497 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.442+0000 7f50a4dae700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55fa7545af60 0x55fa75467f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:59212/0 (socket says 172.21.15.163:59212) 2023-07-14T18:14:35.497 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.442+0000 7f50a4dae700 1 -- 172.21.15.163:0/1521078800 learned_addr learned my addr 172.21.15.163:0/1521078800 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:14:35.497 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.442+0000 7f509ffff700 1 --2- 172.21.15.163:0/1521078800 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55fa7545b8b0 0x55fa75468470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:14:35.498 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.442+0000 7f50a4dae700 1 -- 172.21.15.163:0/1521078800 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55fa7545b8b0 msgr2=0x55fa75468470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:14:35.498 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.442+0000 7f50a4dae700 1 --2- 172.21.15.163:0/1521078800 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55fa7545b8b0 0x55fa75468470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:35.498 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.442+0000 7f50a4dae700 1 -- 172.21.15.163:0/1521078800 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55fa7545c4b0 msgr2=0x55fa7546b490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:14:35.498 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.442+0000 7f50a4dae700 1 --2- 172.21.15.163:0/1521078800 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55fa7545c4b0 0x55fa7546b490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:35.498 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.442+0000 7f50a4dae700 1 -- 172.21.15.163:0/1521078800 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f509800e5f0 con 0x55fa7545af60 2023-07-14T18:14:35.498 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.442+0000 7f509ffff700 1 --2- 172.21.15.163:0/1521078800 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55fa7545b8b0 0x55fa75468470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T18:14:35.498 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.443+0000 7f50a4dae700 1 --2- 172.21.15.163:0/1521078800 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55fa7545af60 0x55fa75467f30 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f5098009340 tx=0x7f5098005af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb3bb4480c86b83d server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:14:35.499 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.443+0000 7f507ffff700 10 client.0 ms_handle_connect on v2:172.21.15.163:3300/0 2023-07-14T18:14:35.499 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.443+0000 7f507ffff700 1 -- 172.21.15.163:0/1521078800 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5098017950 con 0x55fa7545af60 2023-07-14T18:14:35.499 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.443+0000 7f507ffff700 1 -- 172.21.15.163:0/1521078800 <== mon.0 v2:172.21.15.163:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 9049+0+0 (secure 0 0 0) 0x7f509801c040 con 0x55fa7545af60 2023-07-14T18:14:35.499 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.443+0000 7f50b31aab80 1 -- 172.21.15.163:0/1521078800 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f509800f040 con 0x55fa7545af60 2023-07-14T18:14:35.499 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.443+0000 7f507ffff700 1 -- 172.21.15.163:0/1521078800 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5098017ab0 con 0x55fa7545af60 2023-07-14T18:14:35.499 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.443+0000 7f50b31aab80 10 client.16149 fetch_fsmap learned FSMap version 31 2023-07-14T18:14:35.499 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.443+0000 7f50b31aab80 1 -- 172.21.15.163:0/1521078800 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) v3 -- 0x7f50a010efb0 con 0x55fa7545af60 2023-07-14T18:14:35.499 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.443+0000 7f507ffff700 1 -- 172.21.15.163:0/1521078800 <== mon.0 v2:172.21.15.163:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f509800f040 con 0x55fa7545af60 2023-07-14T18:14:35.500 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.443+0000 7f507ffff700 1 -- 172.21.15.163:0/1521078800 <== mon.0 v2:172.21.15.163:3300/0 5 ==== fsmap(e 31) v1 ==== 7486+0+0 (secure 0 0 0) 0x7f5098022700 con 0x55fa7545af60 2023-07-14T18:14:35.500 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.443+0000 7f50b31aab80 10 client.16149 fetch_fsmap finished waiting for FSMap version 31 2023-07-14T18:14:35.500 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.443+0000 7f50b31aab80 10 client.16149 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.a 2023-07-14T18:14:35.500 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.443+0000 7f50b31aab80 20 client.16149 populate_metadata read hostname 'smithi163' 2023-07-14T18:14:35.500 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.443+0000 7f50b31aab80 1 --2- 172.21.15.163:0/1521078800 >> [v2:172.21.15.163:6840/1032082642,v1:172.21.15.163:6841/1032082642] conn(0x55fa754c51b0 0x55fa754c75c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:14:35.500 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.443+0000 7f50b31aab80 4 client.16149 mds_command: new command op to 14652 tid=0[{"prefix": "damage ls"}] 2023-07-14T18:14:35.500 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.443+0000 7f50b31aab80 1 -- 172.21.15.163:0/1521078800 --> [v2:172.21.15.163:6840/1032082642,v1:172.21.15.163:6841/1032082642] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55fa753a4eb0 con 0x55fa754c51b0 2023-07-14T18:14:35.501 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.443+0000 7f509ffff700 1 --2- 172.21.15.163:0/1521078800 >> [v2:172.21.15.163:6840/1032082642,v1:172.21.15.163:6841/1032082642] conn(0x55fa754c51b0 0x55fa754c75c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:14:35.501 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.444+0000 7f507ffff700 10 client.16149 ms_handle_connect on v2:172.21.15.163:6840/1032082642 2023-07-14T18:14:35.501 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.444+0000 7f509ffff700 1 --2- 172.21.15.163:0/1521078800 >> [v2:172.21.15.163:6840/1032082642,v1:172.21.15.163:6841/1032082642] conn(0x55fa754c51b0 0x55fa754c75c0 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=81f2e80cdcf7c9f3 server_cookie=87ac5f05ec75e072 in_seq=0 out_seq=0 2023-07-14T18:14:35.501 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.444+0000 7f507ffff700 1 -- 172.21.15.163:0/1521078800 <== mds.4 v2:172.21.15.163:6840/1032082642 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55fa753a4eb0 con 0x55fa754c51b0 2023-07-14T18:14:35.501 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.444+0000 7f507ffff700 10 client.16149 handle_command_reply: tid=0 2023-07-14T18:14:35.501 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.444+0000 7f50b31aab80 1 client.16149 shutdown 2023-07-14T18:14:35.501 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.444+0000 7f50b31aab80 1 -- 172.21.15.163:0/1521078800 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55fa7545af60 msgr2=0x55fa75467f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:14:35.501 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.444+0000 7f50b31aab80 1 --2- 172.21.15.163:0/1521078800 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55fa7545af60 0x55fa75467f30 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f5098009340 tx=0x7f5098005af0 comp rx=0 tx=0).stop 2023-07-14T18:14:35.502 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.444+0000 7f50b31aab80 1 -- 172.21.15.163:0/1521078800 shutdown_connections 2023-07-14T18:14:35.502 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.444+0000 7f50b31aab80 1 --2- 172.21.15.163:0/1521078800 >> [v2:172.21.15.163:6840/1032082642,v1:172.21.15.163:6841/1032082642] conn(0x55fa754c51b0 0x55fa754c75c0 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:35.502 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.444+0000 7f50b31aab80 1 --2- 172.21.15.163:0/1521078800 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55fa7545c4b0 0x55fa7546b490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:35.502 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.444+0000 7f50b31aab80 1 --2- 172.21.15.163:0/1521078800 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55fa7545af60 0x55fa75467f30 unknown :-1 s=CLOSED pgs=644 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:35.502 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.444+0000 7f507ffff700 0 client.16149 ms_handle_reset on v2:172.21.15.163:6840/1032082642 2023-07-14T18:14:35.502 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.444+0000 7f50b31aab80 1 --2- 172.21.15.163:0/1521078800 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55fa7545b8b0 0x55fa75468470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:35.502 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.444+0000 7f50b31aab80 1 -- 172.21.15.163:0/1521078800 >> 172.21.15.163:0/1521078800 conn(0x55fa75450680 msgr2=0x55fa7545f370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:14:35.502 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.445+0000 7f50b31aab80 1 -- 172.21.15.163:0/1521078800 shutdown_connections 2023-07-14T18:14:35.503 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.445+0000 7f50b31aab80 1 -- 172.21.15.163:0/1521078800 wait complete. 2023-07-14T18:14:35.503 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.445+0000 7f50b31aab80 20 client.16149 trim_cache size 0 max 16384 2023-07-14T18:14:35.503 INFO:teuthology.orchestra.run.smithi163.stdout:[] 2023-07-14T18:14:35.504 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.445+0000 7f50a7012700 1 -- 172.21.15.163:0/1174371912 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f50880a1150 msgr2=0x7f50880a3600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:14:35.504 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.445+0000 7f50a7012700 1 --2- 172.21.15.163:0/1174371912 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f50880a1150 0x7f50880a3600 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f50a0107290 tx=0x7f509800b040 comp rx=0 tx=0).stop 2023-07-14T18:14:35.505 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.445+0000 7f50a7012700 1 -- 172.21.15.163:0/1174371912 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f50a0107430 msgr2=0x7f50a019c390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:14:35.505 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.445+0000 7f50a7012700 1 --2- 172.21.15.163:0/1174371912 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f50a0107430 0x7f50a019c390 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7f509000e9a0 tx=0x7f509000ecb0 comp rx=0 tx=0).stop 2023-07-14T18:14:35.505 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.445+0000 7f50a7012700 1 -- 172.21.15.163:0/1174371912 shutdown_connections 2023-07-14T18:14:35.505 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.445+0000 7f50a7012700 1 --2- 172.21.15.163:0/1174371912 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f50880a1150 0x7f50880a3600 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:35.505 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.445+0000 7f50a7012700 1 --2- 172.21.15.163:0/1174371912 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f50a0106240 0x7f50a019be50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:35.505 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.445+0000 7f50a7012700 1 --2- 172.21.15.163:0/1174371912 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f50a0107dc0 0x7f50a01a3400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:35.505 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.445+0000 7f50a7012700 1 --2- 172.21.15.163:0/1174371912 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f50a0107430 0x7f50a019c390 unknown :-1 s=CLOSED pgs=643 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:35.506 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.445+0000 7f50a7012700 1 -- 172.21.15.163:0/1174371912 >> 172.21.15.163:0/1174371912 conn(0x7f50a0075270 msgr2=0x7f50a010a920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:14:35.506 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.445+0000 7f50a7012700 1 -- 172.21.15.163:0/1174371912 shutdown_connections 2023-07-14T18:14:35.506 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.446+0000 7f50a7012700 1 -- 172.21.15.163:0/1174371912 wait complete. 2023-07-14T18:14:35.506 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:3 damage ls 2023-07-14T18:14:35.638 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.595+0000 7ff588c1a700 1 -- 172.21.15.163:0/2852678099 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff584100730 msgr2=0x7ff584102b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:14:35.639 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.595+0000 7ff588c1a700 1 --2- 172.21.15.163:0/2852678099 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff584100730 0x7ff584102b10 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7ff574009990 tx=0x7ff574009ca0 comp rx=0 tx=0).stop 2023-07-14T18:14:35.639 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.595+0000 7ff588c1a700 1 -- 172.21.15.163:0/2852678099 shutdown_connections 2023-07-14T18:14:35.639 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.595+0000 7ff588c1a700 1 --2- 172.21.15.163:0/2852678099 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff584105970 0x7ff584107d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:35.639 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.595+0000 7ff588c1a700 1 --2- 172.21.15.163:0/2852678099 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff584100730 0x7ff584102b10 unknown :-1 s=CLOSED pgs=645 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:35.639 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.595+0000 7ff588c1a700 1 --2- 172.21.15.163:0/2852678099 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff584103050 0x7ff584105430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:35.640 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.595+0000 7ff588c1a700 1 -- 172.21.15.163:0/2852678099 >> 172.21.15.163:0/2852678099 conn(0x7ff5840fa130 msgr2=0x7ff5840fc560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:14:35.640 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.595+0000 7ff588c1a700 1 -- 172.21.15.163:0/2852678099 shutdown_connections 2023-07-14T18:14:35.640 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.595+0000 7ff588c1a700 1 -- 172.21.15.163:0/2852678099 wait complete. 2023-07-14T18:14:35.641 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.596+0000 7ff588c1a700 1 Processor -- start 2023-07-14T18:14:35.642 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.596+0000 7ff588c1a700 1 -- start start 2023-07-14T18:14:35.642 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.596+0000 7ff588c1a700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff584100730 0x7ff584195870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:14:35.642 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.596+0000 7ff588c1a700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff584103050 0x7ff584195db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:14:35.642 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.596+0000 7ff588c1a700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff584105970 0x7ff58419ce20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:14:35.642 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.596+0000 7ff588c1a700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff58419d3f0 con 0x7ff584105970 2023-07-14T18:14:35.642 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.596+0000 7ff588c1a700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff58419d530 con 0x7ff584100730 2023-07-14T18:14:35.642 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.596+0000 7ff588c1a700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff58419d6c0 con 0x7ff584103050 2023-07-14T18:14:35.643 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.596+0000 7ff58259c700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff584100730 0x7ff584195870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:14:35.643 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.596+0000 7ff582d9d700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff584105970 0x7ff58419ce20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:14:35.643 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.596+0000 7ff58259c700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff584100730 0x7ff584195870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.163:59910/0 (socket says 172.21.15.163:59910) 2023-07-14T18:14:35.643 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.596+0000 7ff581d9b700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff584103050 0x7ff584195db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:14:35.643 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.596+0000 7ff58259c700 1 -- 172.21.15.163:0/3869661058 learned_addr learned my addr 172.21.15.163:0/3869661058 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:14:35.644 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.597+0000 7ff58259c700 1 -- 172.21.15.163:0/3869661058 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff584103050 msgr2=0x7ff584195db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:14:35.644 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.597+0000 7ff58259c700 1 --2- 172.21.15.163:0/3869661058 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff584103050 0x7ff584195db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:35.644 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.597+0000 7ff58259c700 1 -- 172.21.15.163:0/3869661058 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff584105970 msgr2=0x7ff58419ce20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:14:35.644 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.597+0000 7ff58259c700 1 --2- 172.21.15.163:0/3869661058 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff584105970 0x7ff58419ce20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:35.644 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.597+0000 7ff58259c700 1 -- 172.21.15.163:0/3869661058 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5740095f0 con 0x7ff584100730 2023-07-14T18:14:35.645 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.597+0000 7ff581d9b700 1 --2- 172.21.15.163:0/3869661058 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff584103050 0x7ff584195db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T18:14:35.645 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.597+0000 7ff58259c700 1 --2- 172.21.15.163:0/3869661058 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff584100730 0x7ff584195870 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7ff5740059d0 tx=0x7ff5740047b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:14:35.645 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.597+0000 7ff57b7fe700 1 -- 172.21.15.163:0/3869661058 <== mon.2 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff57401d070 con 0x7ff584100730 2023-07-14T18:14:35.645 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.597+0000 7ff588c1a700 1 -- 172.21.15.163:0/3869661058 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff5840fe520 con 0x7ff584100730 2023-07-14T18:14:35.645 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.597+0000 7ff57b7fe700 1 -- 172.21.15.163:0/3869661058 <== mon.2 v2:172.21.15.172:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ff57400bdb0 con 0x7ff584100730 2023-07-14T18:14:35.645 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.597+0000 7ff57b7fe700 1 -- 172.21.15.163:0/3869661058 <== mon.2 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff57400fd90 con 0x7ff584100730 2023-07-14T18:14:35.645 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.597+0000 7ff588c1a700 1 -- 172.21.15.163:0/3869661058 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5840fea20 con 0x7ff584100730 2023-07-14T18:14:35.650 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.599+0000 7ff57b7fe700 1 -- 172.21.15.163:0/3869661058 <== mon.2 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 18) v1 ==== 135716+0+0 (secure 0 0 0) 0x7ff57400f560 con 0x7ff584100730 2023-07-14T18:14:35.650 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.600+0000 7ff57b7fe700 1 --2- 172.21.15.163:0/3869661058 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7ff5700a1150 0x7ff5700a3600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:14:35.650 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.600+0000 7ff581d9b700 1 --2- 172.21.15.163:0/3869661058 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7ff5700a1150 0x7ff5700a3600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:14:35.650 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.600+0000 7ff57b7fe700 1 -- 172.21.15.163:0/3869661058 <== mon.2 v2:172.21.15.172:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 9049+0+0 (secure 0 0 0) 0x7ff5740ce020 con 0x7ff584100730 2023-07-14T18:14:35.650 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.600+0000 7ff581d9b700 1 --2- 172.21.15.163:0/3869661058 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7ff5700a1150 0x7ff5700a3600 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7ff56c009730 tx=0x7ff56c012040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:14:35.650 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.600+0000 7ff594db2b80 1 Processor -- start 2023-07-14T18:14:35.651 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.601+0000 7ff594db2b80 1 -- start start 2023-07-14T18:14:35.651 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.601+0000 7ff594db2b80 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x560906c61f60 0x560906c62370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:14:35.651 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.601+0000 7ff594db2b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560906c628b0 0x560906c62ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:14:35.651 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.601+0000 7ff594db2b80 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x560906c634b0 0x560906c63920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:14:35.651 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.601+0000 7ff594db2b80 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x560906b66cb0 con 0x560906c634b0 2023-07-14T18:14:35.651 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.601+0000 7ff594db2b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x560906bb9a40 con 0x560906c628b0 2023-07-14T18:14:35.652 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.601+0000 7ff594db2b80 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x560906bb2ed0 con 0x560906c61f60 2023-07-14T18:14:35.652 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.601+0000 7ff58259c700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x560906c61f60 0x560906c62370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:14:35.652 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.601+0000 7ff581d9b700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560906c628b0 0x560906c62ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:14:35.652 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.601+0000 7ff582d9d700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x560906c634b0 0x560906c63920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:14:35.652 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.601+0000 7ff58259c700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x560906c61f60 0x560906c62370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.163:41056/0 (socket says 172.21.15.163:41056) 2023-07-14T18:14:35.653 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.601+0000 7ff58259c700 1 -- 172.21.15.163:0/1626683495 learned_addr learned my addr 172.21.15.163:0/1626683495 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:14:35.653 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.601+0000 7ff581d9b700 1 -- 172.21.15.163:0/1626683495 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x560906c61f60 msgr2=0x560906c62370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:14:35.653 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.601+0000 7ff581d9b700 1 --2- 172.21.15.163:0/1626683495 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x560906c61f60 0x560906c62370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:35.653 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.601+0000 7ff581d9b700 1 -- 172.21.15.163:0/1626683495 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x560906c634b0 msgr2=0x560906c63920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:14:35.653 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.601+0000 7ff581d9b700 1 --2- 172.21.15.163:0/1626683495 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x560906c634b0 0x560906c63920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:35.653 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.601+0000 7ff581d9b700 1 -- 172.21.15.163:0/1626683495 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5609069e0de0 con 0x560906c628b0 2023-07-14T18:14:35.653 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.601+0000 7ff582d9d700 1 --2- 172.21.15.163:0/1626683495 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x560906c634b0 0x560906c63920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T18:14:35.653 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.602+0000 7ff581d9b700 1 --2- 172.21.15.163:0/1626683495 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560906c628b0 0x560906c62ed0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7ff56c004430 tx=0x7ff56c018000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=592dd81c3cd934d server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:14:35.654 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.602+0000 7ff578ff9700 1 -- 172.21.15.163:0/1626683495 <== mon.2 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff56c023070 con 0x560906c628b0 2023-07-14T18:14:35.654 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.602+0000 7ff578ff9700 1 -- 172.21.15.163:0/1626683495 <== mon.2 v2:172.21.15.172:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ff56c016040 con 0x560906c628b0 2023-07-14T18:14:35.654 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.602+0000 7ff578ff9700 1 -- 172.21.15.163:0/1626683495 <== mon.2 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff56c027e70 con 0x560906c628b0 2023-07-14T18:14:35.654 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.602+0000 7ff594db2b80 1 -- 172.21.15.163:0/1626683495 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560906c628b0 msgr2=0x560906c62ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:14:35.654 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.602+0000 7ff594db2b80 1 --2- 172.21.15.163:0/1626683495 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560906c628b0 0x560906c62ed0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7ff56c004430 tx=0x7ff56c018000 comp rx=0 tx=0).stop 2023-07-14T18:14:35.654 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.602+0000 7ff594db2b80 1 -- 172.21.15.163:0/1626683495 shutdown_connections 2023-07-14T18:14:35.655 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.602+0000 7ff594db2b80 1 --2- 172.21.15.163:0/1626683495 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x560906c61f60 0x560906c62370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:35.655 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.602+0000 7ff594db2b80 1 --2- 172.21.15.163:0/1626683495 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x560906c634b0 0x560906c63920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:35.655 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.602+0000 7ff594db2b80 1 --2- 172.21.15.163:0/1626683495 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560906c628b0 0x560906c62ed0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:35.655 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.602+0000 7ff594db2b80 1 -- 172.21.15.163:0/1626683495 >> 172.21.15.163:0/1626683495 conn(0x560906c57680 msgr2=0x560906c5c9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:14:35.655 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.603+0000 7ff594db2b80 1 -- 172.21.15.163:0/1626683495 shutdown_connections 2023-07-14T18:14:35.655 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.603+0000 7ff594db2b80 1 -- 172.21.15.163:0/1626683495 wait complete. 2023-07-14T18:14:35.655 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.603+0000 7ff594db2b80 1 -- start start 2023-07-14T18:14:35.656 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.603+0000 7ff594db2b80 1 Processor -- start 2023-07-14T18:14:35.656 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.603+0000 7ff594db2b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560906c61f60 0x560906c6b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:14:35.656 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.603+0000 7ff594db2b80 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x560906c628b0 0x560906c6bed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:14:35.656 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.603+0000 7ff594db2b80 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x560906c634b0 0x560906c72f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:14:35.656 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.603+0000 7ff594db2b80 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x560906b52ac0 con 0x560906c634b0 2023-07-14T18:14:35.656 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.603+0000 7ff594db2b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x560906b527c0 con 0x560906c61f60 2023-07-14T18:14:35.656 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.603+0000 7ff594db2b80 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x560906a36920 con 0x560906c628b0 2023-07-14T18:14:35.657 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.603+0000 7ff594db2b80 10 client.0 _ll_register_callbacks cb 0x560906b50760 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T18:14:35.657 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.603+0000 7ff582d9d700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x560906c634b0 0x560906c72f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:14:35.657 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.603+0000 7ff582d9d700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x560906c634b0 0x560906c72f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:59244/0 (socket says 172.21.15.163:59244) 2023-07-14T18:14:35.657 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.603+0000 7ff582d9d700 1 -- 172.21.15.163:0/3849932460 learned_addr learned my addr 172.21.15.163:0/3849932460 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:14:35.657 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.603+0000 7ff581d9b700 1 --2- 172.21.15.163:0/3849932460 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x560906c628b0 0x560906c6bed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:14:35.657 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.603+0000 7ff58259c700 1 --2- 172.21.15.163:0/3849932460 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560906c61f60 0x560906c6b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:14:35.658 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.604+0000 7ff582d9d700 1 -- 172.21.15.163:0/3849932460 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x560906c628b0 msgr2=0x560906c6bed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:14:35.658 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.604+0000 7ff582d9d700 1 --2- 172.21.15.163:0/3849932460 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x560906c628b0 0x560906c6bed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:35.658 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.604+0000 7ff582d9d700 1 -- 172.21.15.163:0/3849932460 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560906c61f60 msgr2=0x560906c6b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:14:35.658 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.604+0000 7ff582d9d700 1 --2- 172.21.15.163:0/3849932460 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560906c61f60 0x560906c6b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:35.658 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.604+0000 7ff582d9d700 1 -- 172.21.15.163:0/3849932460 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff57c011230 con 0x560906c634b0 2023-07-14T18:14:35.658 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.604+0000 7ff581d9b700 1 --2- 172.21.15.163:0/3849932460 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x560906c628b0 0x560906c6bed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T18:14:35.658 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.604+0000 7ff58259c700 1 --2- 172.21.15.163:0/3849932460 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560906c61f60 0x560906c6b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T18:14:35.658 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.604+0000 7ff582d9d700 1 --2- 172.21.15.163:0/3849932460 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x560906c634b0 0x560906c72f10 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7ff57c007d10 tx=0x7ff57c0116a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a8800e1cbc3f63c4 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:14:35.659 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.604+0000 7ff569ffb700 10 client.0 ms_handle_connect on v2:172.21.15.163:3300/0 2023-07-14T18:14:35.659 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.604+0000 7ff569ffb700 1 -- 172.21.15.163:0/3849932460 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff57c00e040 con 0x560906c634b0 2023-07-14T18:14:35.659 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.604+0000 7ff569ffb700 1 -- 172.21.15.163:0/3849932460 <== mon.0 v2:172.21.15.163:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 9049+0+0 (secure 0 0 0) 0x7ff57c01f460 con 0x560906c634b0 2023-07-14T18:14:35.659 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.604+0000 7ff594db2b80 1 -- 172.21.15.163:0/3849932460 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x560906b0c4f0 con 0x560906c634b0 2023-07-14T18:14:35.659 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.604+0000 7ff569ffb700 1 -- 172.21.15.163:0/3849932460 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff57c01f620 con 0x560906c634b0 2023-07-14T18:14:35.659 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.604+0000 7ff594db2b80 10 client.16161 fetch_fsmap learned FSMap version 31 2023-07-14T18:14:35.660 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.604+0000 7ff594db2b80 1 -- 172.21.15.163:0/3849932460 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) v3 -- 0x7ff56c004160 con 0x560906c634b0 2023-07-14T18:14:35.660 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.604+0000 7ff569ffb700 1 -- 172.21.15.163:0/3849932460 <== mon.0 v2:172.21.15.163:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x560906b0c4f0 con 0x560906c634b0 2023-07-14T18:14:35.660 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.605+0000 7ff569ffb700 1 -- 172.21.15.163:0/3849932460 <== mon.0 v2:172.21.15.163:3300/0 5 ==== fsmap(e 31) v1 ==== 7486+0+0 (secure 0 0 0) 0x7ff57c0168f0 con 0x560906c634b0 2023-07-14T18:14:35.660 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.605+0000 7ff594db2b80 10 client.16161 fetch_fsmap finished waiting for FSMap version 31 2023-07-14T18:14:35.660 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.605+0000 7ff594db2b80 10 client.16161 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.c 2023-07-14T18:14:35.660 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.605+0000 7ff594db2b80 20 client.16161 populate_metadata read hostname 'smithi163' 2023-07-14T18:14:35.660 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.605+0000 7ff594db2b80 1 --2- 172.21.15.163:0/3849932460 >> [v2:172.21.15.184:6836/3389277679,v1:172.21.15.184:6837/3389277679] conn(0x560906c77780 0x560906c79b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:14:35.660 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.605+0000 7ff594db2b80 4 client.16161 mds_command: new command op to 24478 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-14T18:14:35.661 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.605+0000 7ff594db2b80 1 -- 172.21.15.163:0/3849932460 --> [v2:172.21.15.184:6836/3389277679,v1:172.21.15.184:6837/3389277679] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x560906c30da0 con 0x560906c77780 2023-07-14T18:14:35.661 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.605+0000 7ff58259c700 1 --2- 172.21.15.163:0/3849932460 >> [v2:172.21.15.184:6836/3389277679,v1:172.21.15.184:6837/3389277679] conn(0x560906c77780 0x560906c79b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:14:35.661 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.605+0000 7ff569ffb700 10 client.16161 ms_handle_connect on v2:172.21.15.184:6836/3389277679 2023-07-14T18:14:35.661 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.605+0000 7ff58259c700 1 --2- 172.21.15.163:0/3849932460 >> [v2:172.21.15.184:6836/3389277679,v1:172.21.15.184:6837/3389277679] conn(0x560906c77780 0x560906c79b90 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=73cb898920389b9f server_cookie=ce4d315c2295bcb2 in_seq=0 out_seq=0 2023-07-14T18:14:35.661 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.606+0000 7ff569ffb700 1 -- 172.21.15.163:0/3849932460 <== mds.3 v2:172.21.15.184:6836/3389277679 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18017 (crc 0 0 0) 0x560906c30da0 con 0x560906c77780 2023-07-14T18:14:35.661 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.606+0000 7ff569ffb700 10 client.16161 handle_command_reply: tid=0 2023-07-14T18:14:35.661 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.606+0000 7ff594db2b80 1 client.16161 shutdown 2023-07-14T18:14:35.662 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.606+0000 7ff594db2b80 1 -- 172.21.15.163:0/3849932460 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x560906c634b0 msgr2=0x560906c72f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:14:35.662 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.606+0000 7ff594db2b80 1 --2- 172.21.15.163:0/3849932460 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x560906c634b0 0x560906c72f10 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7ff57c007d10 tx=0x7ff57c0116a0 comp rx=0 tx=0).stop 2023-07-14T18:14:35.662 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.606+0000 7ff594db2b80 1 -- 172.21.15.163:0/3849932460 shutdown_connections 2023-07-14T18:14:35.662 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.606+0000 7ff594db2b80 1 --2- 172.21.15.163:0/3849932460 >> [v2:172.21.15.184:6836/3389277679,v1:172.21.15.184:6837/3389277679] conn(0x560906c77780 0x560906c79b90 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:35.662 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.606+0000 7ff594db2b80 1 --2- 172.21.15.163:0/3849932460 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x560906c634b0 0x560906c72f10 unknown :-1 s=CLOSED pgs=646 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:35.662 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.606+0000 7ff594db2b80 1 --2- 172.21.15.163:0/3849932460 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560906c61f60 0x560906c6b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:35.662 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.606+0000 7ff594db2b80 1 --2- 172.21.15.163:0/3849932460 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x560906c628b0 0x560906c6bed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:35.662 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.606+0000 7ff594db2b80 1 -- 172.21.15.163:0/3849932460 >> 172.21.15.163:0/3849932460 conn(0x560906c57680 msgr2=0x560906c5b650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:14:35.663 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.606+0000 7ff569ffb700 0 client.16161 ms_handle_reset on v2:172.21.15.184:6836/3389277679 2023-07-14T18:14:35.663 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.606+0000 7ff594db2b80 1 -- 172.21.15.163:0/3849932460 shutdown_connections 2023-07-14T18:14:35.663 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.606+0000 7ff594db2b80 1 -- 172.21.15.163:0/3849932460 wait complete. 2023-07-14T18:14:35.663 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.606+0000 7ff594db2b80 20 client.16161 trim_cache size 0 max 16384 2023-07-14T18:14:35.664 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.620+0000 7ff594db2b80 1 Processor -- start 2023-07-14T18:14:35.665 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.620+0000 7ff594db2b80 1 -- start start 2023-07-14T18:14:35.665 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.620+0000 7ff594db2b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560906c61f60 0x560906c79790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:14:35.665 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.620+0000 7ff594db2b80 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x560906c628b0 0x560906c72e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:14:35.665 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.620+0000 7ff594db2b80 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x560906c634b0 0x560906c69800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:14:35.665 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.620+0000 7ff594db2b80 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x560906c74c00 con 0x560906c628b0 2023-07-14T18:14:35.665 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.620+0000 7ff594db2b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x560906c6ae40 con 0x560906c61f60 2023-07-14T18:14:35.666 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.620+0000 7ff594db2b80 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x560906c6b500 con 0x560906c634b0 2023-07-14T18:14:35.666 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.620+0000 7ff581d9b700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x560906c628b0 0x560906c72e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:14:35.666 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.620+0000 7ff581d9b700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x560906c628b0 0x560906c72e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:59250/0 (socket says 172.21.15.163:59250) 2023-07-14T18:14:35.666 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.620+0000 7ff581d9b700 1 -- 172.21.15.163:0/1028419954 learned_addr learned my addr 172.21.15.163:0/1028419954 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:14:35.666 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.620+0000 7ff58259c700 1 --2- 172.21.15.163:0/1028419954 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560906c61f60 0x560906c79790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:14:35.666 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.620+0000 7ff582d9d700 1 --2- 172.21.15.163:0/1028419954 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x560906c634b0 0x560906c69800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:14:35.666 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.621+0000 7ff581d9b700 1 -- 172.21.15.163:0/1028419954 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x560906c634b0 msgr2=0x560906c69800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:14:35.667 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.621+0000 7ff581d9b700 1 --2- 172.21.15.163:0/1028419954 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x560906c634b0 0x560906c69800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:35.667 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.621+0000 7ff581d9b700 1 -- 172.21.15.163:0/1028419954 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560906c61f60 msgr2=0x560906c79790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:14:35.667 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.621+0000 7ff581d9b700 1 --2- 172.21.15.163:0/1028419954 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560906c61f60 0x560906c79790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:35.667 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.621+0000 7ff581d9b700 1 -- 172.21.15.163:0/1028419954 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5609069c9c60 con 0x560906c628b0 2023-07-14T18:14:35.667 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.621+0000 7ff58259c700 1 --2- 172.21.15.163:0/1028419954 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560906c61f60 0x560906c79790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T18:14:35.667 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.621+0000 7ff581d9b700 1 --2- 172.21.15.163:0/1028419954 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x560906c628b0 0x560906c72e30 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7ff56c0108e0 tx=0x7ff56c028f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e4a1ab7ad1841e9 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:14:35.667 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.621+0000 7ff5797fa700 1 -- 172.21.15.163:0/1028419954 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff56c023040 con 0x560906c628b0 2023-07-14T18:14:35.667 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.621+0000 7ff5797fa700 1 -- 172.21.15.163:0/1028419954 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ff56c024040 con 0x560906c628b0 2023-07-14T18:14:35.668 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.621+0000 7ff5797fa700 1 -- 172.21.15.163:0/1028419954 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff56c0054d0 con 0x560906c628b0 2023-07-14T18:14:35.672 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.622+0000 7ff594db2b80 1 -- 172.21.15.163:0/1028419954 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x560906c628b0 msgr2=0x560906c72e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:14:35.672 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.622+0000 7ff594db2b80 1 --2- 172.21.15.163:0/1028419954 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x560906c628b0 0x560906c72e30 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7ff56c0108e0 tx=0x7ff56c028f40 comp rx=0 tx=0).stop 2023-07-14T18:14:35.672 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.622+0000 7ff594db2b80 1 -- 172.21.15.163:0/1028419954 shutdown_connections 2023-07-14T18:14:35.673 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.622+0000 7ff594db2b80 1 --2- 172.21.15.163:0/1028419954 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x560906c634b0 0x560906c69800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:35.673 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.622+0000 7ff594db2b80 1 --2- 172.21.15.163:0/1028419954 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560906c61f60 0x560906c79790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:35.673 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.622+0000 7ff594db2b80 1 --2- 172.21.15.163:0/1028419954 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x560906c628b0 0x560906c72e30 unknown :-1 s=CLOSED pgs=647 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:35.673 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.622+0000 7ff594db2b80 1 -- 172.21.15.163:0/1028419954 >> 172.21.15.163:0/1028419954 conn(0x560906c57680 msgr2=0x560906c6a6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:14:35.673 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.622+0000 7ff594db2b80 1 -- 172.21.15.163:0/1028419954 shutdown_connections 2023-07-14T18:14:35.674 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.622+0000 7ff594db2b80 1 -- 172.21.15.163:0/1028419954 wait complete. 2023-07-14T18:14:35.674 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.622+0000 7ff594db2b80 1 -- start start 2023-07-14T18:14:35.674 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.622+0000 7ff594db2b80 1 Processor -- start 2023-07-14T18:14:35.674 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.622+0000 7ff594db2b80 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x560906c61f60 0x560906c6ecf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:14:35.674 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.622+0000 7ff594db2b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560906c628b0 0x560906c6f230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:14:35.675 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.622+0000 7ff594db2b80 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x560906c634b0 0x560906c72250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:14:35.675 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.622+0000 7ff594db2b80 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x560906c72790 con 0x560906c61f60 2023-07-14T18:14:35.675 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.622+0000 7ff594db2b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x560906c72900 con 0x560906c628b0 2023-07-14T18:14:35.675 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.622+0000 7ff594db2b80 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x560906c72ac0 con 0x560906c634b0 2023-07-14T18:14:35.675 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.622+0000 7ff594db2b80 10 client.0 _ll_register_callbacks cb 0x7ff57c007670 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T18:14:35.676 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.622+0000 7ff58259c700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x560906c61f60 0x560906c6ecf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:14:35.676 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.623+0000 7ff58259c700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x560906c61f60 0x560906c6ecf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:59254/0 (socket says 172.21.15.163:59254) 2023-07-14T18:14:35.676 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.623+0000 7ff58259c700 1 -- 172.21.15.163:0/2422992842 learned_addr learned my addr 172.21.15.163:0/2422992842 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:14:35.676 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.623+0000 7ff582d9d700 1 --2- 172.21.15.163:0/2422992842 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x560906c634b0 0x560906c72250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:14:35.677 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.623+0000 7ff581d9b700 1 --2- 172.21.15.163:0/2422992842 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560906c628b0 0x560906c6f230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:14:35.677 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.623+0000 7ff58259c700 1 -- 172.21.15.163:0/2422992842 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x560906c634b0 msgr2=0x560906c72250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:14:35.677 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.623+0000 7ff58259c700 1 --2- 172.21.15.163:0/2422992842 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x560906c634b0 0x560906c72250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:35.677 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.623+0000 7ff58259c700 1 -- 172.21.15.163:0/2422992842 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560906c628b0 msgr2=0x560906c6f230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:14:35.677 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.623+0000 7ff58259c700 1 --2- 172.21.15.163:0/2422992842 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560906c628b0 0x560906c6f230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:35.678 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.623+0000 7ff58259c700 1 -- 172.21.15.163:0/2422992842 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5609069e0de0 con 0x560906c61f60 2023-07-14T18:14:35.678 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.623+0000 7ff58259c700 1 --2- 172.21.15.163:0/2422992842 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x560906c61f60 0x560906c6ecf0 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7ff5740cbb60 tx=0x7ff574009310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dec3f981ad571a92 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:14:35.678 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.623+0000 7ff569ffb700 10 client.0 ms_handle_connect on v2:172.21.15.163:3300/0 2023-07-14T18:14:35.678 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.623+0000 7ff569ffb700 1 -- 172.21.15.163:0/2422992842 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5740974d0 con 0x560906c61f60 2023-07-14T18:14:35.679 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.623+0000 7ff569ffb700 1 -- 172.21.15.163:0/2422992842 <== mon.0 v2:172.21.15.163:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 9049+0+0 (secure 0 0 0) 0x7ff57409b190 con 0x560906c61f60 2023-07-14T18:14:35.679 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.623+0000 7ff594db2b80 1 -- 172.21.15.163:0/2422992842 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7ff56c016040 con 0x560906c61f60 2023-07-14T18:14:35.679 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.623+0000 7ff569ffb700 1 -- 172.21.15.163:0/2422992842 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff57409f1c0 con 0x560906c61f60 2023-07-14T18:14:35.679 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.623+0000 7ff594db2b80 10 client.16167 fetch_fsmap learned FSMap version 31 2023-07-14T18:14:35.679 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.623+0000 7ff594db2b80 1 -- 172.21.15.163:0/2422992842 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) v3 -- 0x560906a07250 con 0x560906c61f60 2023-07-14T18:14:35.680 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.623+0000 7ff569ffb700 1 -- 172.21.15.163:0/2422992842 <== mon.0 v2:172.21.15.163:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ff56c016040 con 0x560906c61f60 2023-07-14T18:14:35.680 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.624+0000 7ff569ffb700 1 -- 172.21.15.163:0/2422992842 <== mon.0 v2:172.21.15.163:3300/0 5 ==== fsmap(e 31) v1 ==== 7486+0+0 (secure 0 0 0) 0x7ff5740a30c0 con 0x560906c61f60 2023-07-14T18:14:35.680 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.624+0000 7ff594db2b80 10 client.16167 fetch_fsmap finished waiting for FSMap version 31 2023-07-14T18:14:35.680 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.624+0000 7ff594db2b80 10 client.16167 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.c 2023-07-14T18:14:35.680 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.624+0000 7ff594db2b80 20 client.16167 populate_metadata read hostname 'smithi163' 2023-07-14T18:14:35.681 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.624+0000 7ff594db2b80 1 --2- 172.21.15.163:0/2422992842 >> [v2:172.21.15.184:6836/3389277679,v1:172.21.15.184:6837/3389277679] conn(0x560906ccc160 0x560906cce570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:14:35.681 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.624+0000 7ff594db2b80 4 client.16167 mds_command: new command op to 24478 tid=0[{"prefix": "damage ls"}] 2023-07-14T18:14:35.681 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.624+0000 7ff594db2b80 1 -- 172.21.15.163:0/2422992842 --> [v2:172.21.15.184:6836/3389277679,v1:172.21.15.184:6837/3389277679] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x560906babeb0 con 0x560906ccc160 2023-07-14T18:14:35.681 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.624+0000 7ff581d9b700 1 --2- 172.21.15.163:0/2422992842 >> [v2:172.21.15.184:6836/3389277679,v1:172.21.15.184:6837/3389277679] conn(0x560906ccc160 0x560906cce570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:14:35.682 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.624+0000 7ff569ffb700 10 client.16167 ms_handle_connect on v2:172.21.15.184:6836/3389277679 2023-07-14T18:14:35.682 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.624+0000 7ff581d9b700 1 --2- 172.21.15.163:0/2422992842 >> [v2:172.21.15.184:6836/3389277679,v1:172.21.15.184:6837/3389277679] conn(0x560906ccc160 0x560906cce570 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=199ad23a20551054 server_cookie=84d4f530df090550 in_seq=0 out_seq=0 2023-07-14T18:14:35.682 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.624+0000 7ff569ffb700 1 -- 172.21.15.163:0/2422992842 <== mds.3 v2:172.21.15.184:6836/3389277679 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x560906babeb0 con 0x560906ccc160 2023-07-14T18:14:35.682 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.624+0000 7ff569ffb700 10 client.16167 handle_command_reply: tid=0 2023-07-14T18:14:35.682 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.624+0000 7ff594db2b80 1 client.16167 shutdown 2023-07-14T18:14:35.683 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.624+0000 7ff594db2b80 1 -- 172.21.15.163:0/2422992842 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x560906c61f60 msgr2=0x560906c6ecf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:14:35.683 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.624+0000 7ff594db2b80 1 --2- 172.21.15.163:0/2422992842 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x560906c61f60 0x560906c6ecf0 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7ff5740cbb60 tx=0x7ff574009310 comp rx=0 tx=0).stop 2023-07-14T18:14:35.683 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.624+0000 7ff594db2b80 1 -- 172.21.15.163:0/2422992842 shutdown_connections 2023-07-14T18:14:35.683 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.624+0000 7ff594db2b80 1 --2- 172.21.15.163:0/2422992842 >> [v2:172.21.15.184:6836/3389277679,v1:172.21.15.184:6837/3389277679] conn(0x560906ccc160 0x560906cce570 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:35.683 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.624+0000 7ff594db2b80 1 --2- 172.21.15.163:0/2422992842 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x560906c634b0 0x560906c72250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:35.684 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.624+0000 7ff594db2b80 1 --2- 172.21.15.163:0/2422992842 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x560906c61f60 0x560906c6ecf0 unknown :-1 s=CLOSED pgs=648 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:35.684 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.624+0000 7ff569ffb700 0 client.16167 ms_handle_reset on v2:172.21.15.184:6836/3389277679 2023-07-14T18:14:35.684 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.624+0000 7ff594db2b80 1 --2- 172.21.15.163:0/2422992842 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560906c628b0 0x560906c6f230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:35.684 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.624+0000 7ff594db2b80 1 -- 172.21.15.163:0/2422992842 >> 172.21.15.163:0/2422992842 conn(0x560906c57680 msgr2=0x560906c79790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:14:35.684 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.625+0000 7ff594db2b80 1 -- 172.21.15.163:0/2422992842 shutdown_connections 2023-07-14T18:14:35.685 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.625+0000 7ff594db2b80 1 -- 172.21.15.163:0/2422992842 wait complete. 2023-07-14T18:14:35.685 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.625+0000 7ff594db2b80 20 client.16167 trim_cache size 0 max 16384 2023-07-14T18:14:35.685 INFO:teuthology.orchestra.run.smithi163.stdout:[] 2023-07-14T18:14:35.686 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.625+0000 7ff588c1a700 1 -- 172.21.15.163:0/3869661058 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7ff5700a1150 msgr2=0x7ff5700a3600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:14:35.686 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.625+0000 7ff588c1a700 1 --2- 172.21.15.163:0/3869661058 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7ff5700a1150 0x7ff5700a3600 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7ff56c009730 tx=0x7ff56c012040 comp rx=0 tx=0).stop 2023-07-14T18:14:35.687 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.625+0000 7ff588c1a700 1 -- 172.21.15.163:0/3869661058 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff584100730 msgr2=0x7ff584195870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:14:35.687 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.625+0000 7ff588c1a700 1 --2- 172.21.15.163:0/3869661058 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff584100730 0x7ff584195870 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7ff5740059d0 tx=0x7ff5740047b0 comp rx=0 tx=0).stop 2023-07-14T18:14:35.687 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.625+0000 7ff588c1a700 1 -- 172.21.15.163:0/3869661058 shutdown_connections 2023-07-14T18:14:35.687 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.625+0000 7ff588c1a700 1 --2- 172.21.15.163:0/3869661058 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7ff5700a1150 0x7ff5700a3600 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:35.687 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.625+0000 7ff588c1a700 1 --2- 172.21.15.163:0/3869661058 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff584105970 0x7ff58419ce20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:35.687 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.625+0000 7ff588c1a700 1 --2- 172.21.15.163:0/3869661058 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff584100730 0x7ff584195870 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:35.687 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.625+0000 7ff588c1a700 1 --2- 172.21.15.163:0/3869661058 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff584103050 0x7ff584195db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:35.688 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.625+0000 7ff588c1a700 1 -- 172.21.15.163:0/3869661058 >> 172.21.15.163:0/3869661058 conn(0x7ff5840fa130 msgr2=0x7ff584101390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:14:35.688 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.625+0000 7ff588c1a700 1 -- 172.21.15.163:0/3869661058 shutdown_connections 2023-07-14T18:14:35.688 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.625+0000 7ff588c1a700 1 -- 172.21.15.163:0/3869661058 wait complete. 2023-07-14T18:14:35.688 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:2 damage ls 2023-07-14T18:14:35.827 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.782+0000 7f1ca6e4d700 1 -- 172.21.15.163:0/205066825 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f1ca00fe280 msgr2=0x7f1ca00fe690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:14:35.828 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.782+0000 7f1ca6e4d700 1 --2- 172.21.15.163:0/205066825 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f1ca00fe280 0x7f1ca00fe690 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f1c94009990 tx=0x7f1c94009ca0 comp rx=0 tx=0).stop 2023-07-14T18:14:35.828 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.782+0000 7f1ca6e4d700 1 -- 172.21.15.163:0/205066825 shutdown_connections 2023-07-14T18:14:35.828 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.782+0000 7f1ca6e4d700 1 --2- 172.21.15.163:0/205066825 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1ca00ffe00 0x7f1ca01066c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:35.829 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.782+0000 7f1ca6e4d700 1 --2- 172.21.15.163:0/205066825 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f1ca00fe280 0x7f1ca00fe690 unknown :-1 s=CLOSED pgs=649 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:35.829 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.782+0000 7f1ca6e4d700 1 --2- 172.21.15.163:0/205066825 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1ca00ff470 0x7f1ca00ff8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:35.829 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.782+0000 7f1ca6e4d700 1 -- 172.21.15.163:0/205066825 >> 172.21.15.163:0/205066825 conn(0x7f1ca00f98a0 msgr2=0x7f1ca00fbcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:14:35.829 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.782+0000 7f1ca6e4d700 1 -- 172.21.15.163:0/205066825 shutdown_connections 2023-07-14T18:14:35.830 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.782+0000 7f1ca6e4d700 1 -- 172.21.15.163:0/205066825 wait complete. 2023-07-14T18:14:35.830 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.783+0000 7f1ca6e4d700 1 Processor -- start 2023-07-14T18:14:35.830 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.783+0000 7f1ca6e4d700 1 -- start start 2023-07-14T18:14:35.830 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.783+0000 7f1ca6e4d700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1ca00fe280 0x7f1ca0193650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:14:35.831 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.783+0000 7f1ca6e4d700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1ca00ff470 0x7f1ca0193b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:14:35.831 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.783+0000 7f1ca6e4d700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f1ca00ffe00 0x7f1ca019ac00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:14:35.831 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.783+0000 7f1ca6e4d700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ca019b1d0 con 0x7f1ca00ffe00 2023-07-14T18:14:35.832 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.783+0000 7f1ca6e4d700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ca019b310 con 0x7f1ca00ff470 2023-07-14T18:14:35.832 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.783+0000 7f1ca6e4d700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ca019b4a0 con 0x7f1ca00fe280 2023-07-14T18:14:35.832 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.783+0000 7f1ca4be9700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1ca00fe280 0x7f1ca0193650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:14:35.832 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.783+0000 7f1ca53ea700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f1ca00ffe00 0x7f1ca019ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:14:35.833 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.783+0000 7f1c9ffff700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1ca00ff470 0x7f1ca0193b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:14:35.833 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.783+0000 7f1ca4be9700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1ca00fe280 0x7f1ca0193650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.163:41090/0 (socket says 172.21.15.163:41090) 2023-07-14T18:14:35.833 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.783+0000 7f1ca4be9700 1 -- 172.21.15.163:0/3955676828 learned_addr learned my addr 172.21.15.163:0/3955676828 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:14:35.833 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.783+0000 7f1c9ffff700 1 -- 172.21.15.163:0/3955676828 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1ca00fe280 msgr2=0x7f1ca0193650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:14:35.834 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.783+0000 7f1c9ffff700 1 --2- 172.21.15.163:0/3955676828 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1ca00fe280 0x7f1ca0193650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:35.834 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.783+0000 7f1c9ffff700 1 -- 172.21.15.163:0/3955676828 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f1ca00ffe00 msgr2=0x7f1ca019ac00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:14:35.834 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.783+0000 7f1c9ffff700 1 --2- 172.21.15.163:0/3955676828 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f1ca00ffe00 0x7f1ca019ac00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:35.834 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.783+0000 7f1c9ffff700 1 -- 172.21.15.163:0/3955676828 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c940095f0 con 0x7f1ca00ff470 2023-07-14T18:14:35.835 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.784+0000 7f1ca53ea700 1 --2- 172.21.15.163:0/3955676828 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f1ca00ffe00 0x7f1ca019ac00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T18:14:35.835 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.784+0000 7f1c9ffff700 1 --2- 172.21.15.163:0/3955676828 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1ca00ff470 0x7f1ca0193b90 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f1c8c00c970 tx=0x7f1c8c00cc80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:14:35.835 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.784+0000 7f1c9dffb700 1 -- 172.21.15.163:0/3955676828 <== mon.2 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c8c004440 con 0x7f1ca00ff470 2023-07-14T18:14:35.835 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.784+0000 7f1ca6e4d700 1 -- 172.21.15.163:0/3955676828 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ca019b780 con 0x7f1ca00ff470 2023-07-14T18:14:35.836 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.784+0000 7f1c9dffb700 1 -- 172.21.15.163:0/3955676828 <== mon.2 v2:172.21.15.172:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f1c8c003b10 con 0x7f1ca00ff470 2023-07-14T18:14:35.836 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.784+0000 7f1c9dffb700 1 -- 172.21.15.163:0/3955676828 <== mon.2 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c8c007aa0 con 0x7f1ca00ff470 2023-07-14T18:14:35.836 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.784+0000 7f1ca6e4d700 1 -- 172.21.15.163:0/3955676828 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ca019bc90 con 0x7f1ca00ff470 2023-07-14T18:14:35.844 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.786+0000 7f1c9dffb700 1 -- 172.21.15.163:0/3955676828 <== mon.2 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 18) v1 ==== 135716+0+0 (secure 0 0 0) 0x7f1c8c003c80 con 0x7f1ca00ff470 2023-07-14T18:14:35.844 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.786+0000 7f1c9dffb700 1 --2- 172.21.15.163:0/3955676828 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f1c900a1150 0x7f1c900a3600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:14:35.844 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.787+0000 7f1ca4be9700 1 --2- 172.21.15.163:0/3955676828 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f1c900a1150 0x7f1c900a3600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:14:35.845 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.787+0000 7f1c9dffb700 1 -- 172.21.15.163:0/3955676828 <== mon.2 v2:172.21.15.172:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 9049+0+0 (secure 0 0 0) 0x7f1c8c0cc7e0 con 0x7f1ca00ff470 2023-07-14T18:14:35.845 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.787+0000 7f1ca4be9700 1 --2- 172.21.15.163:0/3955676828 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f1c900a1150 0x7f1c900a3600 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f1c94006010 tx=0x7f1c9400b260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:14:35.845 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.788+0000 7f1cb2fe5b80 1 Processor -- start 2023-07-14T18:14:35.846 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.788+0000 7f1cb2fe5b80 1 -- start start 2023-07-14T18:14:35.846 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.788+0000 7f1cb2fe5b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559f4866ef60 0x559f4866f370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:14:35.846 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.788+0000 7f1cb2fe5b80 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x559f4866f8b0 0x559f4866fed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:14:35.846 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.788+0000 7f1cb2fe5b80 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x559f486704b0 0x559f48670920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:14:35.847 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.788+0000 7f1cb2fe5b80 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x559f48573cb0 con 0x559f486704b0 2023-07-14T18:14:35.847 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.788+0000 7f1cb2fe5b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x559f485c6a40 con 0x559f4866ef60 2023-07-14T18:14:35.847 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.788+0000 7f1cb2fe5b80 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x559f485bfed0 con 0x559f4866f8b0 2023-07-14T18:14:35.847 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.788+0000 7f1ca4be9700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559f4866ef60 0x559f4866f370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:14:35.848 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.788+0000 7f1ca53ea700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x559f486704b0 0x559f48670920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:14:35.848 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.788+0000 7f1ca4be9700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559f4866ef60 0x559f4866f370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.163:59960/0 (socket says 172.21.15.163:59960) 2023-07-14T18:14:35.848 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.788+0000 7f1ca4be9700 1 -- 172.21.15.163:0/1779287918 learned_addr learned my addr 172.21.15.163:0/1779287918 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:14:35.849 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.788+0000 7f1ca53ea700 1 -- 172.21.15.163:0/1779287918 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x559f4866f8b0 msgr2=0x559f4866fed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:14:35.849 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.789+0000 7f1ca53ea700 1 --2- 172.21.15.163:0/1779287918 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x559f4866f8b0 0x559f4866fed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:35.849 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.789+0000 7f1ca53ea700 1 -- 172.21.15.163:0/1779287918 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559f4866ef60 msgr2=0x559f4866f370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:14:35.849 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.789+0000 7f1ca53ea700 1 --2- 172.21.15.163:0/1779287918 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559f4866ef60 0x559f4866f370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:35.850 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.789+0000 7f1ca53ea700 1 -- 172.21.15.163:0/1779287918 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559f483edde0 con 0x559f486704b0 2023-07-14T18:14:35.850 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.789+0000 7f1ca4be9700 1 --2- 172.21.15.163:0/1779287918 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559f4866ef60 0x559f4866f370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T18:14:35.850 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.789+0000 7f1ca53ea700 1 --2- 172.21.15.163:0/1779287918 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x559f486704b0 0x559f48670920 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7f1c9800b450 tx=0x7f1c9800bb30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a19eb954f0cfcbc server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:14:35.850 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.789+0000 7f1c8affd700 1 -- 172.21.15.163:0/1779287918 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c9801c070 con 0x559f486704b0 2023-07-14T18:14:35.851 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.789+0000 7f1c8affd700 1 -- 172.21.15.163:0/1779287918 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f1c98011040 con 0x559f486704b0 2023-07-14T18:14:35.851 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.789+0000 7f1c8affd700 1 -- 172.21.15.163:0/1779287918 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c98018480 con 0x559f486704b0 2023-07-14T18:14:35.851 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.790+0000 7f1cb2fe5b80 1 -- 172.21.15.163:0/1779287918 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x559f486704b0 msgr2=0x559f48670920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:14:35.851 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.790+0000 7f1cb2fe5b80 1 --2- 172.21.15.163:0/1779287918 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x559f486704b0 0x559f48670920 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7f1c9800b450 tx=0x7f1c9800bb30 comp rx=0 tx=0).stop 2023-07-14T18:14:35.852 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.790+0000 7f1cb2fe5b80 1 -- 172.21.15.163:0/1779287918 shutdown_connections 2023-07-14T18:14:35.852 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.790+0000 7f1cb2fe5b80 1 --2- 172.21.15.163:0/1779287918 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x559f486704b0 0x559f48670920 unknown :-1 s=CLOSED pgs=650 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:35.852 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.790+0000 7f1cb2fe5b80 1 --2- 172.21.15.163:0/1779287918 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559f4866ef60 0x559f4866f370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:35.852 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.790+0000 7f1cb2fe5b80 1 --2- 172.21.15.163:0/1779287918 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x559f4866f8b0 0x559f4866fed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:35.852 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.790+0000 7f1cb2fe5b80 1 -- 172.21.15.163:0/1779287918 >> 172.21.15.163:0/1779287918 conn(0x559f48664680 msgr2=0x559f486699d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:14:35.852 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.790+0000 7f1cb2fe5b80 1 -- 172.21.15.163:0/1779287918 shutdown_connections 2023-07-14T18:14:35.852 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.790+0000 7f1cb2fe5b80 1 -- 172.21.15.163:0/1779287918 wait complete. 2023-07-14T18:14:35.853 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.790+0000 7f1cb2fe5b80 1 -- start start 2023-07-14T18:14:35.853 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.790+0000 7f1cb2fe5b80 1 Processor -- start 2023-07-14T18:14:35.853 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.790+0000 7f1cb2fe5b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559f4866ef60 0x559f48678990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:14:35.853 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.790+0000 7f1cb2fe5b80 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x559f4866f8b0 0x559f48678ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:14:35.853 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.790+0000 7f1cb2fe5b80 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x559f486704b0 0x559f4867ff10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:14:35.853 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.790+0000 7f1cb2fe5b80 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x559f4855fac0 con 0x559f4866f8b0 2023-07-14T18:14:35.854 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.790+0000 7f1cb2fe5b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x559f4855f7c0 con 0x559f4866ef60 2023-07-14T18:14:35.854 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.790+0000 7f1cb2fe5b80 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x559f48443920 con 0x559f486704b0 2023-07-14T18:14:35.854 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.790+0000 7f1cb2fe5b80 10 client.0 _ll_register_callbacks cb 0x559f4855d760 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T18:14:35.854 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.791+0000 7f1c9ffff700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x559f4866f8b0 0x559f48678ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:14:35.854 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.791+0000 7f1c9ffff700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x559f4866f8b0 0x559f48678ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:59284/0 (socket says 172.21.15.163:59284) 2023-07-14T18:14:35.854 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.791+0000 7f1ca53ea700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x559f486704b0 0x559f4867ff10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:14:35.854 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.791+0000 7f1c9ffff700 1 -- 172.21.15.163:0/625570355 learned_addr learned my addr 172.21.15.163:0/625570355 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:14:35.855 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.791+0000 7f1ca4be9700 1 --2- 172.21.15.163:0/625570355 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559f4866ef60 0x559f48678990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:14:35.855 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.791+0000 7f1c9ffff700 1 -- 172.21.15.163:0/625570355 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x559f486704b0 msgr2=0x559f4867ff10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:14:35.855 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.791+0000 7f1c9ffff700 1 --2- 172.21.15.163:0/625570355 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x559f486704b0 0x559f4867ff10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:35.855 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.791+0000 7f1c9ffff700 1 -- 172.21.15.163:0/625570355 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559f4866ef60 msgr2=0x559f48678990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:14:35.855 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.791+0000 7f1c9ffff700 1 --2- 172.21.15.163:0/625570355 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559f4866ef60 0x559f48678990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:35.855 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.791+0000 7f1c9ffff700 1 -- 172.21.15.163:0/625570355 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ca0066f10 con 0x559f4866f8b0 2023-07-14T18:14:35.855 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.791+0000 7f1ca53ea700 1 --2- 172.21.15.163:0/625570355 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x559f486704b0 0x559f4867ff10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T18:14:35.856 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.791+0000 7f1c9ffff700 1 --2- 172.21.15.163:0/625570355 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x559f4866f8b0 0x559f48678ed0 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f1c8c0995c0 tx=0x7f1c8c0992a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=182be9eb75657b05 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:14:35.856 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.791+0000 7f1c7ffff700 10 client.0 ms_handle_connect on v2:172.21.15.163:3300/0 2023-07-14T18:14:35.856 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.791+0000 7f1c7ffff700 1 -- 172.21.15.163:0/625570355 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c8c00de10 con 0x559f4866f8b0 2023-07-14T18:14:35.856 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.791+0000 7f1c7ffff700 1 -- 172.21.15.163:0/625570355 <== mon.0 v2:172.21.15.163:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 9049+0+0 (secure 0 0 0) 0x7f1c8c09d8f0 con 0x559f4866f8b0 2023-07-14T18:14:35.856 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.791+0000 7f1cb2fe5b80 1 -- 172.21.15.163:0/625570355 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x559f485194f0 con 0x559f4866f8b0 2023-07-14T18:14:35.856 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.791+0000 7f1c7ffff700 1 -- 172.21.15.163:0/625570355 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1c8c0a1d10 con 0x559f4866f8b0 2023-07-14T18:14:35.856 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.791+0000 7f1cb2fe5b80 10 client.16179 fetch_fsmap learned FSMap version 31 2023-07-14T18:14:35.857 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.791+0000 7f1cb2fe5b80 1 -- 172.21.15.163:0/625570355 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) v3 -- 0x7f1c9800b100 con 0x559f4866f8b0 2023-07-14T18:14:35.857 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.791+0000 7f1c7ffff700 1 -- 172.21.15.163:0/625570355 <== mon.0 v2:172.21.15.163:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x559f485194f0 con 0x559f4866f8b0 2023-07-14T18:14:35.857 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.792+0000 7f1c7ffff700 1 -- 172.21.15.163:0/625570355 <== mon.0 v2:172.21.15.163:3300/0 5 ==== fsmap(e 31) v1 ==== 7486+0+0 (secure 0 0 0) 0x7f1c8c09ad20 con 0x559f4866f8b0 2023-07-14T18:14:35.857 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.792+0000 7f1cb2fe5b80 10 client.16179 fetch_fsmap finished waiting for FSMap version 31 2023-07-14T18:14:35.857 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.792+0000 7f1cb2fe5b80 10 client.16179 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2023-07-14T18:14:35.857 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.792+0000 7f1cb2fe5b80 20 client.16179 populate_metadata read hostname 'smithi163' 2023-07-14T18:14:35.857 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.792+0000 7f1cb2fe5b80 1 --2- 172.21.15.163:0/625570355 >> [v2:172.21.15.172:6836/3783835012,v1:172.21.15.172:6837/3783835012] conn(0x559f48684610 0x559f48686a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:14:35.858 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.792+0000 7f1cb2fe5b80 4 client.16179 mds_command: new command op to 24479 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-14T18:14:35.858 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.792+0000 7f1cb2fe5b80 1 -- 172.21.15.163:0/625570355 --> [v2:172.21.15.172:6836/3783835012,v1:172.21.15.172:6837/3783835012] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x559f4863dda0 con 0x559f48684610 2023-07-14T18:14:35.858 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.792+0000 7f1ca4be9700 1 --2- 172.21.15.163:0/625570355 >> [v2:172.21.15.172:6836/3783835012,v1:172.21.15.172:6837/3783835012] conn(0x559f48684610 0x559f48686a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:14:35.858 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.792+0000 7f1c7ffff700 10 client.16179 ms_handle_connect on v2:172.21.15.172:6836/3783835012 2023-07-14T18:14:35.858 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.792+0000 7f1ca4be9700 1 --2- 172.21.15.163:0/625570355 >> [v2:172.21.15.172:6836/3783835012,v1:172.21.15.172:6837/3783835012] conn(0x559f48684610 0x559f48686a20 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=4208144fb8bbd7cf server_cookie=15b84b7e95e7e5ff in_seq=0 out_seq=0 2023-07-14T18:14:35.858 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.793+0000 7f1c7ffff700 1 -- 172.21.15.163:0/625570355 <== mds.2 v2:172.21.15.172:6836/3783835012 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18017 (crc 0 0 0) 0x559f4863dda0 con 0x559f48684610 2023-07-14T18:14:35.858 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.793+0000 7f1c7ffff700 10 client.16179 handle_command_reply: tid=0 2023-07-14T18:14:35.858 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.793+0000 7f1cb2fe5b80 1 client.16179 shutdown 2023-07-14T18:14:35.859 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.793+0000 7f1cb2fe5b80 1 -- 172.21.15.163:0/625570355 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x559f4866f8b0 msgr2=0x559f48678ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:14:35.859 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.793+0000 7f1cb2fe5b80 1 --2- 172.21.15.163:0/625570355 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x559f4866f8b0 0x559f48678ed0 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f1c8c0995c0 tx=0x7f1c8c0992a0 comp rx=0 tx=0).stop 2023-07-14T18:14:35.859 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.793+0000 7f1cb2fe5b80 1 -- 172.21.15.163:0/625570355 shutdown_connections 2023-07-14T18:14:35.859 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.793+0000 7f1cb2fe5b80 1 --2- 172.21.15.163:0/625570355 >> [v2:172.21.15.172:6836/3783835012,v1:172.21.15.172:6837/3783835012] conn(0x559f48684610 0x559f48686a20 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:35.859 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.793+0000 7f1cb2fe5b80 1 --2- 172.21.15.163:0/625570355 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x559f486704b0 0x559f4867ff10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:35.859 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.793+0000 7f1cb2fe5b80 1 --2- 172.21.15.163:0/625570355 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559f4866ef60 0x559f48678990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:35.859 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.793+0000 7f1c7ffff700 0 client.16179 ms_handle_reset on v2:172.21.15.172:6836/3783835012 2023-07-14T18:14:35.859 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.793+0000 7f1cb2fe5b80 1 --2- 172.21.15.163:0/625570355 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x559f4866f8b0 0x559f48678ed0 unknown :-1 s=CLOSED pgs=651 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:35.860 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.793+0000 7f1cb2fe5b80 1 -- 172.21.15.163:0/625570355 >> 172.21.15.163:0/625570355 conn(0x559f48664680 msgr2=0x559f48668650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:14:35.860 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.793+0000 7f1cb2fe5b80 1 -- 172.21.15.163:0/625570355 shutdown_connections 2023-07-14T18:14:35.860 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.793+0000 7f1cb2fe5b80 1 -- 172.21.15.163:0/625570355 wait complete. 2023-07-14T18:14:35.860 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.793+0000 7f1cb2fe5b80 20 client.16179 trim_cache size 0 max 16384 2023-07-14T18:14:35.864 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.808+0000 7f1cb2fe5b80 1 Processor -- start 2023-07-14T18:14:35.864 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.808+0000 7f1cb2fe5b80 1 -- start start 2023-07-14T18:14:35.865 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.808+0000 7f1cb2fe5b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559f4866ef60 0x559f4868b380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:14:35.865 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.808+0000 7f1cb2fe5b80 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x559f4866f8b0 0x559f4867fed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:14:35.865 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.808+0000 7f1cb2fe5b80 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x559f486704b0 0x559f48670880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:14:35.865 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.808+0000 7f1cb2fe5b80 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x559f4866a660 con 0x559f486704b0 2023-07-14T18:14:35.865 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.808+0000 7f1cb2fe5b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x559f4866acc0 con 0x559f4866ef60 2023-07-14T18:14:35.865 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.808+0000 7f1cb2fe5b80 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x559f48679610 con 0x559f4866f8b0 2023-07-14T18:14:35.865 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.809+0000 7f1ca53ea700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x559f486704b0 0x559f48670880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:14:35.865 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.809+0000 7f1c9ffff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x559f4866f8b0 0x559f4867fed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:14:35.866 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.809+0000 7f1ca4be9700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559f4866ef60 0x559f4868b380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:14:35.866 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.809+0000 7f1c9ffff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x559f4866f8b0 0x559f4867fed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.163:41112/0 (socket says 172.21.15.163:41112) 2023-07-14T18:14:35.866 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.809+0000 7f1ca53ea700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x559f486704b0 0x559f48670880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:59294/0 (socket says 172.21.15.163:59294) 2023-07-14T18:14:35.866 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.809+0000 7f1c9ffff700 1 -- 172.21.15.163:0/2387581739 learned_addr learned my addr 172.21.15.163:0/2387581739 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:14:35.866 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.809+0000 7f1c9ffff700 1 -- 172.21.15.163:0/2387581739 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559f4866ef60 msgr2=0x559f4868b380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:14:35.867 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.809+0000 7f1c9ffff700 1 --2- 172.21.15.163:0/2387581739 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559f4866ef60 0x559f4868b380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:35.867 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.809+0000 7f1c9ffff700 1 -- 172.21.15.163:0/2387581739 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x559f486704b0 msgr2=0x559f48670880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:14:35.867 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.809+0000 7f1c9ffff700 1 --2- 172.21.15.163:0/2387581739 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x559f486704b0 0x559f48670880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:35.867 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.809+0000 7f1c9ffff700 1 -- 172.21.15.163:0/2387581739 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559f483d6c60 con 0x559f4866f8b0 2023-07-14T18:14:35.867 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.809+0000 7f1ca53ea700 1 --2- 172.21.15.163:0/2387581739 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x559f486704b0 0x559f48670880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T18:14:35.867 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.809+0000 7f1c9ffff700 1 --2- 172.21.15.163:0/2387581739 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x559f4866f8b0 0x559f4867fed0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f1c8c099850 tx=0x7f1c8c007340 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d8549ee455c849f1 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:14:35.867 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.809+0000 7f1c8b7fe700 1 -- 172.21.15.163:0/2387581739 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c8c09d8f0 con 0x559f4866f8b0 2023-07-14T18:14:35.867 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.809+0000 7f1c8b7fe700 1 -- 172.21.15.163:0/2387581739 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f1c8c0a1d10 con 0x559f4866f8b0 2023-07-14T18:14:35.868 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.809+0000 7f1c8b7fe700 1 -- 172.21.15.163:0/2387581739 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c8c099d60 con 0x559f4866f8b0 2023-07-14T18:14:35.868 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.810+0000 7f1cb2fe5b80 1 -- 172.21.15.163:0/2387581739 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x559f4866f8b0 msgr2=0x559f4867fed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:14:35.868 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.810+0000 7f1cb2fe5b80 1 --2- 172.21.15.163:0/2387581739 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x559f4866f8b0 0x559f4867fed0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f1c8c099850 tx=0x7f1c8c007340 comp rx=0 tx=0).stop 2023-07-14T18:14:35.868 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.810+0000 7f1cb2fe5b80 1 -- 172.21.15.163:0/2387581739 shutdown_connections 2023-07-14T18:14:35.868 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.810+0000 7f1cb2fe5b80 1 --2- 172.21.15.163:0/2387581739 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x559f486704b0 0x559f48670880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:35.868 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.810+0000 7f1cb2fe5b80 1 --2- 172.21.15.163:0/2387581739 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559f4866ef60 0x559f4868b380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:35.868 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.810+0000 7f1cb2fe5b80 1 --2- 172.21.15.163:0/2387581739 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x559f4866f8b0 0x559f4867fed0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:35.869 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.810+0000 7f1cb2fe5b80 1 -- 172.21.15.163:0/2387581739 >> 172.21.15.163:0/2387581739 conn(0x559f48664680 msgr2=0x559f486699a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:14:35.869 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.810+0000 7f1cb2fe5b80 1 -- 172.21.15.163:0/2387581739 shutdown_connections 2023-07-14T18:14:35.869 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.810+0000 7f1cb2fe5b80 1 -- 172.21.15.163:0/2387581739 wait complete. 2023-07-14T18:14:35.869 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.810+0000 7f1cb2fe5b80 1 -- start start 2023-07-14T18:14:35.869 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.810+0000 7f1cb2fe5b80 1 Processor -- start 2023-07-14T18:14:35.869 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.811+0000 7f1cb2fe5b80 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x559f4866ef60 0x559f4867b810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:14:35.869 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.811+0000 7f1cb2fe5b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559f4866f8b0 0x559f4867bd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:14:35.869 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.811+0000 7f1cb2fe5b80 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x559f486704b0 0x559f4867ed70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:14:35.870 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.811+0000 7f1cb2fe5b80 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x559f4867f2b0 con 0x559f486704b0 2023-07-14T18:14:35.870 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.811+0000 7f1cb2fe5b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x559f4867f420 con 0x559f4866f8b0 2023-07-14T18:14:35.870 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.811+0000 7f1cb2fe5b80 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x559f4867f5e0 con 0x559f4866ef60 2023-07-14T18:14:35.870 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.811+0000 7f1cb2fe5b80 10 client.0 _ll_register_callbacks cb 0x7f1c8c0996d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T18:14:35.870 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.811+0000 7f1ca4be9700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x559f4866ef60 0x559f4867b810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:14:35.870 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.811+0000 7f1ca53ea700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x559f486704b0 0x559f4867ed70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:14:35.870 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.811+0000 7f1ca4be9700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x559f4866ef60 0x559f4867b810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.163:41118/0 (socket says 172.21.15.163:41118) 2023-07-14T18:14:35.870 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.811+0000 7f1c9ffff700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559f4866f8b0 0x559f4867bd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:14:35.871 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.811+0000 7f1ca4be9700 1 -- 172.21.15.163:0/3453195601 learned_addr learned my addr 172.21.15.163:0/3453195601 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:14:35.871 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.811+0000 7f1ca4be9700 1 -- 172.21.15.163:0/3453195601 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559f4866f8b0 msgr2=0x559f4867bd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:14:35.871 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.811+0000 7f1ca4be9700 1 --2- 172.21.15.163:0/3453195601 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559f4866f8b0 0x559f4867bd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:35.871 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.811+0000 7f1ca4be9700 1 -- 172.21.15.163:0/3453195601 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x559f486704b0 msgr2=0x559f4867ed70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:14:35.871 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.811+0000 7f1ca4be9700 1 --2- 172.21.15.163:0/3453195601 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x559f486704b0 0x559f4867ed70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:35.871 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.811+0000 7f1ca4be9700 1 -- 172.21.15.163:0/3453195601 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x559f483edde0 con 0x559f4866ef60 2023-07-14T18:14:35.871 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.811+0000 7f1ca4be9700 1 --2- 172.21.15.163:0/3453195601 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x559f4866ef60 0x559f4867b810 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x559f48687330 tx=0x7f1c94009ca0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7761b9f9846e3e9 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:14:35.872 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.811+0000 7f1c7ffff700 10 client.0 ms_handle_connect on v2:172.21.15.184:3300/0 2023-07-14T18:14:35.872 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.812+0000 7f1c7ffff700 1 -- 172.21.15.163:0/3453195601 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c94030040 con 0x559f4866ef60 2023-07-14T18:14:35.872 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.812+0000 7f1c7ffff700 1 -- 172.21.15.163:0/3453195601 <== mon.1 v2:172.21.15.184:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 9049+0+0 (secure 0 0 0) 0x7f1c9403a9b0 con 0x559f4866ef60 2023-07-14T18:14:35.872 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.812+0000 7f1cb2fe5b80 1 -- 172.21.15.163:0/3453195601 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f1c98011040 con 0x559f4866ef60 2023-07-14T18:14:35.872 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.812+0000 7f1c7ffff700 1 -- 172.21.15.163:0/3453195601 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1c9403ab70 con 0x559f4866ef60 2023-07-14T18:14:35.872 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.812+0000 7f1cb2fe5b80 10 client.25750 fetch_fsmap learned FSMap version 31 2023-07-14T18:14:35.872 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.812+0000 7f1cb2fe5b80 1 -- 172.21.15.163:0/3453195601 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) v3 -- 0x7f1c9800b100 con 0x559f4866ef60 2023-07-14T18:14:35.872 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.812+0000 7f1c7ffff700 1 -- 172.21.15.163:0/3453195601 <== mon.1 v2:172.21.15.184:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f1c98011040 con 0x559f4866ef60 2023-07-14T18:14:35.873 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.812+0000 7f1c7ffff700 1 -- 172.21.15.163:0/3453195601 <== mon.1 v2:172.21.15.184:3300/0 5 ==== fsmap(e 31) v1 ==== 7486+0+0 (secure 0 0 0) 0x7f1c94040020 con 0x559f4866ef60 2023-07-14T18:14:35.873 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.812+0000 7f1cb2fe5b80 10 client.25750 fetch_fsmap finished waiting for FSMap version 31 2023-07-14T18:14:35.873 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.812+0000 7f1cb2fe5b80 10 client.25750 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2023-07-14T18:14:35.873 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.812+0000 7f1cb2fe5b80 20 client.25750 populate_metadata read hostname 'smithi163' 2023-07-14T18:14:35.873 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.812+0000 7f1cb2fe5b80 1 --2- 172.21.15.163:0/3453195601 >> [v2:172.21.15.172:6836/3783835012,v1:172.21.15.172:6837/3783835012] conn(0x559f486d8cf0 0x559f486db100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:14:35.873 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.812+0000 7f1cb2fe5b80 4 client.25750 mds_command: new command op to 24479 tid=0[{"prefix": "damage ls"}] 2023-07-14T18:14:35.873 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.812+0000 7f1cb2fe5b80 1 -- 172.21.15.163:0/3453195601 --> [v2:172.21.15.172:6836/3783835012,v1:172.21.15.172:6837/3783835012] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x559f485b8eb0 con 0x559f486d8cf0 2023-07-14T18:14:35.873 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.812+0000 7f1c9ffff700 1 --2- 172.21.15.163:0/3453195601 >> [v2:172.21.15.172:6836/3783835012,v1:172.21.15.172:6837/3783835012] conn(0x559f486d8cf0 0x559f486db100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:14:35.874 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.813+0000 7f1c7ffff700 10 client.25750 ms_handle_connect on v2:172.21.15.172:6836/3783835012 2023-07-14T18:14:35.874 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.813+0000 7f1c9ffff700 1 --2- 172.21.15.163:0/3453195601 >> [v2:172.21.15.172:6836/3783835012,v1:172.21.15.172:6837/3783835012] conn(0x559f486d8cf0 0x559f486db100 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=48475437e4b850ed server_cookie=2423b615b8804b15 in_seq=0 out_seq=0 2023-07-14T18:14:35.874 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.813+0000 7f1c7ffff700 1 -- 172.21.15.163:0/3453195601 <== mds.2 v2:172.21.15.172:6836/3783835012 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x559f485b8eb0 con 0x559f486d8cf0 2023-07-14T18:14:35.874 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.813+0000 7f1c7ffff700 10 client.25750 handle_command_reply: tid=0 2023-07-14T18:14:35.874 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.813+0000 7f1cb2fe5b80 1 client.25750 shutdown 2023-07-14T18:14:35.874 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.813+0000 7f1cb2fe5b80 1 -- 172.21.15.163:0/3453195601 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x559f4866ef60 msgr2=0x559f4867b810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:14:35.874 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.813+0000 7f1cb2fe5b80 1 --2- 172.21.15.163:0/3453195601 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x559f4866ef60 0x559f4867b810 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x559f48687330 tx=0x7f1c94009ca0 comp rx=0 tx=0).stop 2023-07-14T18:14:35.875 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.813+0000 7f1cb2fe5b80 1 -- 172.21.15.163:0/3453195601 shutdown_connections 2023-07-14T18:14:35.875 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.813+0000 7f1cb2fe5b80 1 --2- 172.21.15.163:0/3453195601 >> [v2:172.21.15.172:6836/3783835012,v1:172.21.15.172:6837/3783835012] conn(0x559f486d8cf0 0x559f486db100 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:35.875 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.813+0000 7f1cb2fe5b80 1 --2- 172.21.15.163:0/3453195601 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x559f4866ef60 0x559f4867b810 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:35.875 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.813+0000 7f1cb2fe5b80 1 --2- 172.21.15.163:0/3453195601 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x559f486704b0 0x559f4867ed70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:35.875 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.813+0000 7f1cb2fe5b80 1 --2- 172.21.15.163:0/3453195601 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559f4866f8b0 0x559f4867bd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:35.875 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.813+0000 7f1cb2fe5b80 1 -- 172.21.15.163:0/3453195601 >> 172.21.15.163:0/3453195601 conn(0x559f48664680 msgr2=0x559f48676890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:14:35.876 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.813+0000 7f1c7ffff700 0 client.25750 ms_handle_reset on v2:172.21.15.172:6836/3783835012 2023-07-14T18:14:35.876 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.814+0000 7f1cb2fe5b80 1 -- 172.21.15.163:0/3453195601 shutdown_connections 2023-07-14T18:14:35.876 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.814+0000 7f1cb2fe5b80 1 -- 172.21.15.163:0/3453195601 wait complete. 2023-07-14T18:14:35.876 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.814+0000 7f1cb2fe5b80 20 client.25750 trim_cache size 0 max 16384 2023-07-14T18:14:35.876 INFO:teuthology.orchestra.run.smithi163.stdout:[] 2023-07-14T18:14:35.877 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.815+0000 7f1ca6e4d700 1 -- 172.21.15.163:0/3955676828 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f1c900a1150 msgr2=0x7f1c900a3600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:14:35.878 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.815+0000 7f1ca6e4d700 1 --2- 172.21.15.163:0/3955676828 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f1c900a1150 0x7f1c900a3600 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f1c94006010 tx=0x7f1c9400b260 comp rx=0 tx=0).stop 2023-07-14T18:14:35.878 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.815+0000 7f1ca6e4d700 1 -- 172.21.15.163:0/3955676828 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1ca00ff470 msgr2=0x7f1ca0193b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:14:35.878 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.815+0000 7f1ca6e4d700 1 --2- 172.21.15.163:0/3955676828 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1ca00ff470 0x7f1ca0193b90 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f1c8c00c970 tx=0x7f1c8c00cc80 comp rx=0 tx=0).stop 2023-07-14T18:14:35.878 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.815+0000 7f1ca6e4d700 1 -- 172.21.15.163:0/3955676828 shutdown_connections 2023-07-14T18:14:35.878 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.815+0000 7f1ca6e4d700 1 --2- 172.21.15.163:0/3955676828 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f1c900a1150 0x7f1c900a3600 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:35.878 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.815+0000 7f1ca6e4d700 1 --2- 172.21.15.163:0/3955676828 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1ca00fe280 0x7f1ca0193650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:35.878 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.815+0000 7f1ca6e4d700 1 --2- 172.21.15.163:0/3955676828 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f1ca00ffe00 0x7f1ca019ac00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:35.879 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.815+0000 7f1ca6e4d700 1 --2- 172.21.15.163:0/3955676828 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1ca00ff470 0x7f1ca0193b90 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:35.879 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.815+0000 7f1ca6e4d700 1 -- 172.21.15.163:0/3955676828 >> 172.21.15.163:0/3955676828 conn(0x7f1ca00f98a0 msgr2=0x7f1ca00fbb50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:14:35.879 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.815+0000 7f1ca6e4d700 1 -- 172.21.15.163:0/3955676828 shutdown_connections 2023-07-14T18:14:35.879 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.815+0000 7f1ca6e4d700 1 -- 172.21.15.163:0/3955676828 wait complete. 2023-07-14T18:14:35.880 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:1 damage ls 2023-07-14T18:14:35.969 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:14:35 smithi163 ceph-mon[96576]: from='client.? 172.21.15.163:0/2335168079' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-07-14T18:14:35.970 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:14:35 smithi163 ceph-mon[96576]: pgmap v358: 129 pgs: 129 active+clean; 50 MiB data, 590 MiB used, 1.0 TiB / 1.0 TiB avail; 806 KiB/s rd, 1.1 MiB/s wr, 330 op/s 2023-07-14T18:14:36.038 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.992+0000 7f8e0d0ee700 1 -- 172.21.15.163:0/2268955858 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f8e080ffd00 msgr2=0x7f8e08100150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:14:36.039 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.992+0000 7f8e0d0ee700 1 --2- 172.21.15.163:0/2268955858 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f8e080ffd00 0x7f8e08100150 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7f8df80098f0 tx=0x7f8df8009c00 comp rx=0 tx=0).stop 2023-07-14T18:14:36.039 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.992+0000 7f8e0d0ee700 1 -- 172.21.15.163:0/2268955858 shutdown_connections 2023-07-14T18:14:36.039 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.992+0000 7f8e0d0ee700 1 --2- 172.21.15.163:0/2268955858 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8e08100690 0x7f8e08106f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:36.039 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.992+0000 7f8e0d0ee700 1 --2- 172.21.15.163:0/2268955858 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8e080feb10 0x7f8e080fef20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:36.040 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.992+0000 7f8e0d0ee700 1 --2- 172.21.15.163:0/2268955858 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f8e080ffd00 0x7f8e08100150 unknown :-1 s=CLOSED pgs=652 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:36.040 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.992+0000 7f8e0d0ee700 1 -- 172.21.15.163:0/2268955858 >> 172.21.15.163:0/2268955858 conn(0x7f8e080fa130 msgr2=0x7f8e080fc560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:14:36.040 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.992+0000 7f8e0d0ee700 1 -- 172.21.15.163:0/2268955858 shutdown_connections 2023-07-14T18:14:36.041 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.992+0000 7f8e0d0ee700 1 -- 172.21.15.163:0/2268955858 wait complete. 2023-07-14T18:14:36.041 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.993+0000 7f8e0d0ee700 1 Processor -- start 2023-07-14T18:14:36.041 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.993+0000 7f8e0d0ee700 1 -- start start 2023-07-14T18:14:36.041 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.993+0000 7f8e0d0ee700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8e080feb10 0x7f8e08102aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:14:36.042 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.993+0000 7f8e0d0ee700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8e080ffd00 0x7f8e081010e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:14:36.042 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.993+0000 7f8e0d0ee700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f8e08100690 0x7f8e08101620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:14:36.042 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.993+0000 7f8e0d0ee700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e08101dc0 con 0x7f8e08100690 2023-07-14T18:14:36.042 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.993+0000 7f8e0d0ee700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e08101f30 con 0x7f8e080feb10 2023-07-14T18:14:36.043 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.993+0000 7f8e0d0ee700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e0819f940 con 0x7f8e080ffd00 2023-07-14T18:14:36.043 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.994+0000 7f8e06d9d700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8e080feb10 0x7f8e08102aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:14:36.043 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.994+0000 7f8e0659c700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8e080ffd00 0x7f8e081010e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:14:36.043 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.994+0000 7f8e06d9d700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8e080feb10 0x7f8e08102aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.163:59994/0 (socket says 172.21.15.163:59994) 2023-07-14T18:14:36.044 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.994+0000 7f8e06d9d700 1 -- 172.21.15.163:0/2379362011 learned_addr learned my addr 172.21.15.163:0/2379362011 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:14:36.044 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.994+0000 7f8e0759e700 1 --2- 172.21.15.163:0/2379362011 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f8e08100690 0x7f8e08101620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:14:36.044 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.994+0000 7f8e06d9d700 1 -- 172.21.15.163:0/2379362011 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8e080ffd00 msgr2=0x7f8e081010e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:14:36.044 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.994+0000 7f8e06d9d700 1 --2- 172.21.15.163:0/2379362011 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8e080ffd00 0x7f8e081010e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:36.045 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.994+0000 7f8e06d9d700 1 -- 172.21.15.163:0/2379362011 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f8e08100690 msgr2=0x7f8e08101620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:14:36.045 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.994+0000 7f8e06d9d700 1 --2- 172.21.15.163:0/2379362011 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f8e08100690 0x7f8e08101620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:36.045 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.994+0000 7f8e06d9d700 1 -- 172.21.15.163:0/2379362011 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8dfc0095f0 con 0x7f8e080feb10 2023-07-14T18:14:36.045 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.994+0000 7f8e0659c700 1 --2- 172.21.15.163:0/2379362011 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8e080ffd00 0x7f8e081010e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T18:14:36.046 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.994+0000 7f8e06d9d700 1 --2- 172.21.15.163:0/2379362011 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8e080feb10 0x7f8e08102aa0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f8dfc00ebf0 tx=0x7f8dfc00ef00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:14:36.046 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.994+0000 7f8deffff700 1 -- 172.21.15.163:0/2379362011 <== mon.2 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8dfc009a10 con 0x7f8e080feb10 2023-07-14T18:14:36.046 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.994+0000 7f8e0d0ee700 1 -- 172.21.15.163:0/2379362011 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8df8009520 con 0x7f8e080feb10 2023-07-14T18:14:36.046 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.994+0000 7f8deffff700 1 -- 172.21.15.163:0/2379362011 <== mon.2 v2:172.21.15.172:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f8dfc00cc90 con 0x7f8e080feb10 2023-07-14T18:14:36.047 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.994+0000 7f8e0d0ee700 1 -- 172.21.15.163:0/2379362011 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e0819fff0 con 0x7f8e080feb10 2023-07-14T18:14:36.047 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.994+0000 7f8deffff700 1 -- 172.21.15.163:0/2379362011 <== mon.2 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8dfc018680 con 0x7f8e080feb10 2023-07-14T18:14:36.054 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.997+0000 7f8deffff700 1 -- 172.21.15.163:0/2379362011 <== mon.2 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 18) v1 ==== 135716+0+0 (secure 0 0 0) 0x7f8dfc010430 con 0x7f8e080feb10 2023-07-14T18:14:36.055 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.998+0000 7f8deffff700 1 --2- 172.21.15.163:0/2379362011 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f8df00a1150 0x7f8df00a3600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:14:36.055 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.998+0000 7f8deffff700 1 -- 172.21.15.163:0/2379362011 <== mon.2 v2:172.21.15.172:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 9049+0+0 (secure 0 0 0) 0x7f8dfc014070 con 0x7f8e080feb10 2023-07-14T18:14:36.055 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.998+0000 7f8e0659c700 1 --2- 172.21.15.163:0/2379362011 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f8df00a1150 0x7f8df00a3600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:14:36.056 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.998+0000 7f8e19286b80 1 Processor -- start 2023-07-14T18:14:36.056 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.998+0000 7f8e19286b80 1 -- start start 2023-07-14T18:14:36.056 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.998+0000 7f8e19286b80 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5603c725bf60 0x5603c725c370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:14:36.057 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.999+0000 7f8e19286b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5603c725c8b0 0x5603c725ced0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:14:36.057 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.999+0000 7f8e19286b80 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5603c725d4b0 0x5603c725d920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:14:36.057 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.999+0000 7f8e19286b80 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x5603c7160cb0 con 0x5603c725bf60 2023-07-14T18:14:36.057 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.999+0000 7f8e19286b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x5603c71b3a40 con 0x5603c725c8b0 2023-07-14T18:14:36.058 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.999+0000 7f8e19286b80 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x5603c71aced0 con 0x5603c725d4b0 2023-07-14T18:14:36.058 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.999+0000 7f8e06d9d700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5603c725bf60 0x5603c725c370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:14:36.058 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.999+0000 7f8e06d9d700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5603c725bf60 0x5603c725c370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:59318/0 (socket says 172.21.15.163:59318) 2023-07-14T18:14:36.058 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.999+0000 7f8e06d9d700 1 -- 172.21.15.163:0/3860001127 learned_addr learned my addr 172.21.15.163:0/3860001127 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:14:36.058 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.999+0000 7f8e0659c700 1 --2- 172.21.15.163:0/3860001127 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5603c725c8b0 0x5603c725ced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:14:36.059 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.999+0000 7f8e0759e700 1 --2- 172.21.15.163:0/3860001127 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5603c725d4b0 0x5603c725d920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:14:36.059 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.999+0000 7f8e0659c700 1 --2- 172.21.15.163:0/2379362011 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f8df00a1150 0x7f8df00a3600 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f8df800f910 tx=0x7f8df8019040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:14:36.059 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.999+0000 7f8e06d9d700 1 -- 172.21.15.163:0/3860001127 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5603c725d4b0 msgr2=0x5603c725d920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:14:36.059 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.999+0000 7f8e06d9d700 1 --2- 172.21.15.163:0/3860001127 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5603c725d4b0 0x5603c725d920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:36.059 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.999+0000 7f8e06d9d700 1 -- 172.21.15.163:0/3860001127 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5603c725c8b0 msgr2=0x5603c725ced0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:14:36.059 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.999+0000 7f8e06d9d700 1 --2- 172.21.15.163:0/3860001127 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5603c725c8b0 0x5603c725ced0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:36.059 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.999+0000 7f8e06d9d700 1 -- 172.21.15.163:0/3860001127 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5603c6fdade0 con 0x5603c725bf60 2023-07-14T18:14:36.059 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.999+0000 7f8e06d9d700 1 --2- 172.21.15.163:0/3860001127 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5603c725bf60 0x5603c725c370 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7f8dfc096c60 tx=0x7f8dfc00b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d08d0ce67672ba server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:14:36.060 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.999+0000 7f8ded7fa700 1 -- 172.21.15.163:0/3860001127 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8dfc09a1f0 con 0x5603c725bf60 2023-07-14T18:14:36.060 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.999+0000 7f8ded7fa700 1 -- 172.21.15.163:0/3860001127 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f8dfc09e220 con 0x5603c725bf60 2023-07-14T18:14:36.060 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:35.999+0000 7f8ded7fa700 1 -- 172.21.15.163:0/3860001127 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8dfc099940 con 0x5603c725bf60 2023-07-14T18:14:36.060 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:36.000+0000 7f8e19286b80 1 -- 172.21.15.163:0/3860001127 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5603c725bf60 msgr2=0x5603c725c370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:14:36.060 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:36.000+0000 7f8e19286b80 1 --2- 172.21.15.163:0/3860001127 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5603c725bf60 0x5603c725c370 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7f8dfc096c60 tx=0x7f8dfc00b340 comp rx=0 tx=0).stop 2023-07-14T18:14:36.060 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:36.000+0000 7f8e19286b80 1 -- 172.21.15.163:0/3860001127 shutdown_connections 2023-07-14T18:14:36.060 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:36.000+0000 7f8e19286b80 1 --2- 172.21.15.163:0/3860001127 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5603c725d4b0 0x5603c725d920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:36.061 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:36.000+0000 7f8e19286b80 1 --2- 172.21.15.163:0/3860001127 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5603c725bf60 0x5603c725c370 unknown :-1 s=CLOSED pgs=653 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:36.061 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:36.000+0000 7f8e19286b80 1 --2- 172.21.15.163:0/3860001127 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5603c725c8b0 0x5603c725ced0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:36.061 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:36.000+0000 7f8e19286b80 1 -- 172.21.15.163:0/3860001127 >> 172.21.15.163:0/3860001127 conn(0x5603c7251680 msgr2=0x5603c72569d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:14:36.061 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:36.000+0000 7f8e19286b80 1 -- 172.21.15.163:0/3860001127 shutdown_connections 2023-07-14T18:14:36.061 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:36.000+0000 7f8e19286b80 1 -- 172.21.15.163:0/3860001127 wait complete. 2023-07-14T18:14:36.061 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:36.001+0000 7f8e19286b80 1 -- start start 2023-07-14T18:14:36.061 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:36.001+0000 7f8e19286b80 1 Processor -- start 2023-07-14T18:14:36.061 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:36.001+0000 7f8e19286b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5603c725bf60 0x5603c7265970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:14:36.062 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:36.001+0000 7f8e19286b80 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5603c725c8b0 0x5603c7265eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:14:36.062 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:36.001+0000 7f8e19286b80 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5603c725d4b0 0x5603c726cef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:14:36.062 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:36.001+0000 7f8e19286b80 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x5603c714cac0 con 0x5603c725c8b0 2023-07-14T18:14:36.062 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:36.001+0000 7f8e19286b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x5603c714c7c0 con 0x5603c725bf60 2023-07-14T18:14:36.062 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:36.001+0000 7f8e19286b80 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x5603c7030920 con 0x5603c725d4b0 2023-07-14T18:14:36.062 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:36.001+0000 7f8e19286b80 10 client.0 _ll_register_callbacks cb 0x5603c714a760 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T18:14:36.062 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:36.001+0000 7f8e0659c700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5603c725c8b0 0x5603c7265eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:14:36.062 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:36.001+0000 7f8e0759e700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5603c725d4b0 0x5603c726cef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:14:36.063 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:36.001+0000 7f8e06d9d700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5603c725bf60 0x5603c7265970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:14:36.063 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:36.001+0000 7f8e0659c700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5603c725c8b0 0x5603c7265eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:59326/0 (socket says 172.21.15.163:59326) 2023-07-14T18:14:36.063 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:36.001+0000 7f8e0659c700 1 -- 172.21.15.163:0/2824744075 learned_addr learned my addr 172.21.15.163:0/2824744075 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:14:36.063 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:36.002+0000 7f8e0759e700 1 -- 172.21.15.163:0/2824744075 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5603c725bf60 msgr2=0x5603c7265970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:14:36.063 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:36.002+0000 7f8e0759e700 1 --2- 172.21.15.163:0/2824744075 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5603c725bf60 0x5603c7265970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:36.063 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:36.002+0000 7f8e0759e700 1 -- 172.21.15.163:0/2824744075 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5603c725c8b0 msgr2=0x5603c7265eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:14:36.063 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:36.002+0000 7f8e0759e700 1 --2- 172.21.15.163:0/2824744075 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5603c725c8b0 0x5603c7265eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:36.064 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:36.002+0000 7f8e0759e700 1 -- 172.21.15.163:0/2824744075 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e0819fff0 con 0x5603c725d4b0 2023-07-14T18:14:36.064 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:36.002+0000 7f8e0759e700 1 --2- 172.21.15.163:0/2824744075 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5603c725d4b0 0x5603c726cef0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f8e00011e60 tx=0x7f8e00014600 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9c16df8dd304b4b3 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:14:36.064 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:36.002+0000 7f8deaff5700 10 client.0 ms_handle_connect on v2:172.21.15.184:3300/0 2023-07-14T18:14:36.064 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:36.002+0000 7f8deaff5700 1 -- 172.21.15.163:0/2824744075 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e0000e040 con 0x5603c725d4b0 2023-07-14T18:14:36.064 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:36.002+0000 7f8deaff5700 1 -- 172.21.15.163:0/2824744075 <== mon.1 v2:172.21.15.184:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 9049+0+0 (secure 0 0 0) 0x7f8e00004bb0 con 0x5603c725d4b0 2023-07-14T18:14:36.064 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:36.002+0000 7f8e19286b80 1 -- 172.21.15.163:0/2824744075 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5603c71064f0 con 0x5603c725d4b0 2023-07-14T18:14:36.064 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:36.002+0000 7f8deaff5700 1 -- 172.21.15.163:0/2824744075 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8e00004d70 con 0x5603c725d4b0 2023-07-14T18:14:36.064 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:36.002+0000 7f8e19286b80 10 client.25762 fetch_fsmap learned FSMap version 31 2023-07-14T18:14:36.065 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:36.002+0000 7f8e19286b80 1 -- 172.21.15.163:0/2824744075 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) v3 -- 0x5603c6fc3c60 con 0x5603c725d4b0 2023-07-14T18:14:36.065 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:36.002+0000 7f8deaff5700 1 -- 172.21.15.163:0/2824744075 <== mon.1 v2:172.21.15.184:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x5603c71064f0 con 0x5603c725d4b0 2023-07-14T18:14:36.065 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:36.003+0000 7f8deaff5700 1 -- 172.21.15.163:0/2824744075 <== mon.1 v2:172.21.15.184:3300/0 5 ==== fsmap(e 31) v1 ==== 7486+0+0 (secure 0 0 0) 0x7f8e0001c030 con 0x5603c725d4b0 2023-07-14T18:14:36.065 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:36.003+0000 7f8e19286b80 10 client.25762 fetch_fsmap finished waiting for FSMap version 31 2023-07-14T18:14:36.065 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:36.003+0000 7f8e19286b80 10 client.25762 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2023-07-14T18:14:36.065 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:36.003+0000 7f8e19286b80 20 client.25762 populate_metadata read hostname 'smithi163' 2023-07-14T18:14:36.065 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:36.003+0000 7f8e19286b80 1 --2- 172.21.15.163:0/2824744075 >> [v2:172.21.15.184:6838/2819059257,v1:172.21.15.184:6839/2819059257] conn(0x5603c7271820 0x5603c7273c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:14:36.065 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:36.003+0000 7f8e19286b80 4 client.25762 mds_command: new command op to 24493 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-14T18:14:36.066 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:36.003+0000 7f8e19286b80 1 -- 172.21.15.163:0/2824744075 --> [v2:172.21.15.184:6838/2819059257,v1:172.21.15.184:6839/2819059257] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5603c722ada0 con 0x5603c7271820 2023-07-14T18:14:36.066 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:36.003+0000 7f8e06d9d700 1 --2- 172.21.15.163:0/2824744075 >> [v2:172.21.15.184:6838/2819059257,v1:172.21.15.184:6839/2819059257] conn(0x5603c7271820 0x5603c7273c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:14:36.066 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:36.003+0000 7f8deaff5700 10 client.25762 ms_handle_connect on v2:172.21.15.184:6838/2819059257 2023-07-14T18:14:36.066 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:36.003+0000 7f8e06d9d700 1 --2- 172.21.15.163:0/2824744075 >> [v2:172.21.15.184:6838/2819059257,v1:172.21.15.184:6839/2819059257] conn(0x5603c7271820 0x5603c7273c30 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=a874ee3607b53798 server_cookie=1788e847dc70569b in_seq=0 out_seq=0 2023-07-14T18:14:36.066 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:36.004+0000 7f8deaff5700 1 -- 172.21.15.163:0/2824744075 <== mds.1 v2:172.21.15.184:6838/2819059257 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18017 (crc 0 0 0) 0x5603c722ada0 con 0x5603c7271820 2023-07-14T18:14:36.066 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:36.004+0000 7f8deaff5700 10 client.25762 handle_command_reply: tid=0 2023-07-14T18:14:36.066 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:36.004+0000 7f8e19286b80 1 client.25762 shutdown 2023-07-14T18:14:36.067 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:36.004+0000 7f8e19286b80 1 -- 172.21.15.163:0/2824744075 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5603c725d4b0 msgr2=0x5603c726cef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:14:36.067 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:36.004+0000 7f8e19286b80 1 --2- 172.21.15.163:0/2824744075 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5603c725d4b0 0x5603c726cef0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f8e00011e60 tx=0x7f8e00014600 comp rx=0 tx=0).stop 2023-07-14T18:14:36.067 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:36.004+0000 7f8e19286b80 1 -- 172.21.15.163:0/2824744075 shutdown_connections 2023-07-14T18:14:36.067 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:36.004+0000 7f8e19286b80 1 --2- 172.21.15.163:0/2824744075 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5603c725d4b0 0x5603c726cef0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:36.067 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:36.004+0000 7f8e19286b80 1 --2- 172.21.15.163:0/2824744075 >> [v2:172.21.15.184:6838/2819059257,v1:172.21.15.184:6839/2819059257] conn(0x5603c7271820 0x5603c7273c30 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:36.067 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:36.004+0000 7f8e19286b80 1 --2- 172.21.15.163:0/2824744075 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5603c725bf60 0x5603c7265970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:36.067 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:36.004+0000 7f8deaff5700 0 client.25762 ms_handle_reset on v2:172.21.15.184:6838/2819059257 2023-07-14T18:14:36.067 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:36.004+0000 7f8e19286b80 1 --2- 172.21.15.163:0/2824744075 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5603c725c8b0 0x5603c7265eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:36.068 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:36.004+0000 7f8e19286b80 1 -- 172.21.15.163:0/2824744075 >> 172.21.15.163:0/2824744075 conn(0x5603c7251680 msgr2=0x5603c7255650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:14:36.068 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:36.004+0000 7f8e19286b80 1 -- 172.21.15.163:0/2824744075 shutdown_connections 2023-07-14T18:14:36.068 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:36.004+0000 7f8e19286b80 1 -- 172.21.15.163:0/2824744075 wait complete. 2023-07-14T18:14:36.068 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:36.004+0000 7f8e19286b80 20 client.25762 trim_cache size 0 max 16384 2023-07-14T18:14:36.076 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:36.018+0000 7f8e19286b80 1 Processor -- start 2023-07-14T18:14:36.076 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:36.018+0000 7f8e19286b80 1 -- start start 2023-07-14T18:14:36.077 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:36.018+0000 7f8e19286b80 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5603c725bf60 0x5603c725d880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:14:36.077 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:36.018+0000 7f8e19286b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5603c725c8b0 0x5603c726ceb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:14:36.077 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:36.018+0000 7f8e19286b80 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5603c725d4b0 0x5603c7263860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:14:36.077 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:36.018+0000 7f8e19286b80 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x5603c72584e0 con 0x5603c725bf60 2023-07-14T18:14:36.078 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:36.018+0000 7f8e19286b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x5603c726ebe0 con 0x5603c725c8b0 2023-07-14T18:14:36.078 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:36.018+0000 7f8e19286b80 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x5603c7264e20 con 0x5603c725d4b0 2023-07-14T18:14:36.078 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:36.018+0000 7f8e06d9d700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5603c725bf60 0x5603c725d880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:14:36.078 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:36.018+0000 7f8e0659c700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5603c725c8b0 0x5603c726ceb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:14:36.079 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:36.018+0000 7f8e0759e700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5603c725d4b0 0x5603c7263860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:14:36.079 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:36.018+0000 7f8e06d9d700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5603c725bf60 0x5603c725d880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:59332/0 (socket says 172.21.15.163:59332) 2023-07-14T18:14:36.079 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:36.018+0000 7f8e06d9d700 1 -- 172.21.15.163:0/2857037149 learned_addr learned my addr 172.21.15.163:0/2857037149 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:14:36.079 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:36.018+0000 7f8e06d9d700 1 -- 172.21.15.163:0/2857037149 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5603c725d4b0 msgr2=0x5603c7263860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:14:36.079 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:36.018+0000 7f8e06d9d700 1 --2- 172.21.15.163:0/2857037149 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5603c725d4b0 0x5603c7263860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:36.079 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:36.018+0000 7f8e06d9d700 1 -- 172.21.15.163:0/2857037149 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5603c725c8b0 msgr2=0x5603c726ceb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:14:36.079 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:36.018+0000 7f8e06d9d700 1 --2- 172.21.15.163:0/2857037149 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5603c725c8b0 0x5603c726ceb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:36.079 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:36.018+0000 7f8e06d9d700 1 -- 172.21.15.163:0/2857037149 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5603c7001250 con 0x5603c725bf60 2023-07-14T18:14:36.080 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:36.019+0000 7f8e0759e700 1 --2- 172.21.15.163:0/2857037149 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5603c725d4b0 0x5603c7263860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T18:14:36.080 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:36.019+0000 7f8e06d9d700 1 --2- 172.21.15.163:0/2857037149 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5603c725bf60 0x5603c725d880 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7f8dfc005950 tx=0x7f8dfc00ef70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a265f4191d9f0a server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:14:36.080 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:36.019+0000 7f8dedffb700 1 -- 172.21.15.163:0/2857037149 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8dfc098590 con 0x5603c725bf60 2023-07-14T18:14:36.080 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:36.019+0000 7f8dedffb700 1 -- 172.21.15.163:0/2857037149 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f8dfc098330 con 0x5603c725bf60 2023-07-14T18:14:36.080 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:36.019+0000 7f8dedffb700 1 -- 172.21.15.163:0/2857037149 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8dfc0b2e30 con 0x5603c725bf60 2023-07-14T18:14:36.080 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:36.020+0000 7f8e19286b80 1 -- 172.21.15.163:0/2857037149 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5603c725bf60 msgr2=0x5603c725d880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:14:36.080 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:36.020+0000 7f8e19286b80 1 --2- 172.21.15.163:0/2857037149 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5603c725bf60 0x5603c725d880 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7f8dfc005950 tx=0x7f8dfc00ef70 comp rx=0 tx=0).stop 2023-07-14T18:14:36.081 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:36.020+0000 7f8e19286b80 1 -- 172.21.15.163:0/2857037149 shutdown_connections 2023-07-14T18:14:36.081 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:36.020+0000 7f8e19286b80 1 --2- 172.21.15.163:0/2857037149 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5603c725d4b0 0x5603c7263860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:36.081 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:36.020+0000 7f8e19286b80 1 --2- 172.21.15.163:0/2857037149 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5603c725bf60 0x5603c725d880 unknown :-1 s=CLOSED pgs=654 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:36.081 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:36.020+0000 7f8e19286b80 1 --2- 172.21.15.163:0/2857037149 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5603c725c8b0 0x5603c726ceb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:36.081 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:36.020+0000 7f8e19286b80 1 -- 172.21.15.163:0/2857037149 >> 172.21.15.163:0/2857037149 conn(0x5603c7251680 msgr2=0x5603c7264670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:14:36.081 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:36.020+0000 7f8e19286b80 1 -- 172.21.15.163:0/2857037149 shutdown_connections 2023-07-14T18:14:36.081 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:36.020+0000 7f8e19286b80 1 -- 172.21.15.163:0/2857037149 wait complete. 2023-07-14T18:14:36.082 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:36.020+0000 7f8e19286b80 1 -- start start 2023-07-14T18:14:36.082 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:36.020+0000 7f8e19286b80 1 Processor -- start 2023-07-14T18:14:36.082 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:36.020+0000 7f8e19286b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5603c725bf60 0x5603c7268d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:14:36.082 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:36.020+0000 7f8e19286b80 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5603c725c8b0 0x5603c7269240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:14:36.082 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:36.020+0000 7f8e19286b80 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5603c725d4b0 0x5603c726c260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:14:36.082 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:36.020+0000 7f8e19286b80 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x5603c726c7a0 con 0x5603c725d4b0 2023-07-14T18:14:36.082 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:36.020+0000 7f8e19286b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x5603c726c910 con 0x5603c725bf60 2023-07-14T18:14:36.083 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:36.020+0000 7f8e19286b80 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x5603c726cad0 con 0x5603c725c8b0 2023-07-14T18:14:36.083 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:36.020+0000 7f8e19286b80 10 client.0 _ll_register_callbacks cb 0x7f8e000117c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T18:14:36.083 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:36.021+0000 7f8e06d9d700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5603c725bf60 0x5603c7268d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:14:36.083 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:36.021+0000 7f8e0759e700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5603c725d4b0 0x5603c726c260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:14:36.083 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:36.021+0000 7f8e06d9d700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5603c725bf60 0x5603c7268d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.163:60020/0 (socket says 172.21.15.163:60020) 2023-07-14T18:14:36.083 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:36.021+0000 7f8e06d9d700 1 -- 172.21.15.163:0/2537607588 learned_addr learned my addr 172.21.15.163:0/2537607588 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:14:36.083 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:36.021+0000 7f8e0759e700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5603c725d4b0 0x5603c726c260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:59340/0 (socket says 172.21.15.163:59340) 2023-07-14T18:14:36.083 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:36.021+0000 7f8e0659c700 1 --2- 172.21.15.163:0/2537607588 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5603c725c8b0 0x5603c7269240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:14:36.084 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:36.021+0000 7f8e06d9d700 1 -- 172.21.15.163:0/2537607588 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5603c725c8b0 msgr2=0x5603c7269240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:14:36.084 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:36.021+0000 7f8e06d9d700 1 --2- 172.21.15.163:0/2537607588 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5603c725c8b0 0x5603c7269240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:36.084 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:36.021+0000 7f8e06d9d700 1 -- 172.21.15.163:0/2537607588 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5603c725d4b0 msgr2=0x5603c726c260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:14:36.084 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:36.021+0000 7f8e06d9d700 1 --2- 172.21.15.163:0/2537607588 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5603c725d4b0 0x5603c726c260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:36.084 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:36.021+0000 7f8e06d9d700 1 -- 172.21.15.163:0/2537607588 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5603c6fc3c60 con 0x5603c725bf60 2023-07-14T18:14:36.084 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:36.021+0000 7f8e06d9d700 1 --2- 172.21.15.163:0/2537607588 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5603c725bf60 0x5603c7268d00 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f8dfc0a2110 tx=0x7f8dfc00cf40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6349d0caf92fe9c5 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:14:36.084 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:36.021+0000 7f8deaff5700 10 client.0 ms_handle_connect on v2:172.21.15.172:3300/0 2023-07-14T18:14:36.085 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:36.021+0000 7f8deaff5700 1 -- 172.21.15.163:0/2537607588 <== mon.2 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8dfc098590 con 0x5603c725bf60 2023-07-14T18:14:36.085 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:36.021+0000 7f8e19286b80 1 -- 172.21.15.163:0/2537607588 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f8dfc09e220 con 0x5603c725bf60 2023-07-14T18:14:36.085 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:36.021+0000 7f8deaff5700 1 -- 172.21.15.163:0/2537607588 <== mon.2 v2:172.21.15.172:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 9049+0+0 (secure 0 0 0) 0x7f8dfc0996e0 con 0x5603c725bf60 2023-07-14T18:14:36.085 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:36.021+0000 7f8deaff5700 1 -- 172.21.15.163:0/2537607588 <== mon.2 v2:172.21.15.172:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8dfc0a21b0 con 0x5603c725bf60 2023-07-14T18:14:36.085 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:36.021+0000 7f8e19286b80 10 client.25832 fetch_fsmap learned FSMap version 31 2023-07-14T18:14:36.085 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:36.021+0000 7f8e19286b80 1 -- 172.21.15.163:0/2537607588 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) v3 -- 0x5603c6fdade0 con 0x5603c725bf60 2023-07-14T18:14:36.085 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:36.022+0000 7f8deaff5700 1 -- 172.21.15.163:0/2537607588 <== mon.2 v2:172.21.15.172:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f8dfc09e220 con 0x5603c725bf60 2023-07-14T18:14:36.085 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:36.022+0000 7f8deaff5700 1 -- 172.21.15.163:0/2537607588 <== mon.2 v2:172.21.15.172:3300/0 5 ==== fsmap(e 31) v1 ==== 7486+0+0 (secure 0 0 0) 0x7f8dfc099380 con 0x5603c725bf60 2023-07-14T18:14:36.086 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:36.022+0000 7f8e19286b80 10 client.25832 fetch_fsmap finished waiting for FSMap version 31 2023-07-14T18:14:36.086 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:36.022+0000 7f8e19286b80 10 client.25832 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2023-07-14T18:14:36.086 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:36.022+0000 7f8e19286b80 20 client.25832 populate_metadata read hostname 'smithi163' 2023-07-14T18:14:36.086 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:36.022+0000 7f8e19286b80 1 --2- 172.21.15.163:0/2537607588 >> [v2:172.21.15.184:6838/2819059257,v1:172.21.15.184:6839/2819059257] conn(0x5603c72c6070 0x5603c72c8480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:14:36.086 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:36.022+0000 7f8e19286b80 4 client.25832 mds_command: new command op to 24493 tid=0[{"prefix": "damage ls"}] 2023-07-14T18:14:36.086 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:36.022+0000 7f8e19286b80 1 -- 172.21.15.163:0/2537607588 --> [v2:172.21.15.184:6838/2819059257,v1:172.21.15.184:6839/2819059257] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x5603c71a5eb0 con 0x5603c72c6070 2023-07-14T18:14:36.086 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:36.022+0000 7f8e0659c700 1 --2- 172.21.15.163:0/2537607588 >> [v2:172.21.15.184:6838/2819059257,v1:172.21.15.184:6839/2819059257] conn(0x5603c72c6070 0x5603c72c8480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:14:36.086 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:36.022+0000 7f8deaff5700 10 client.25832 ms_handle_connect on v2:172.21.15.184:6838/2819059257 2023-07-14T18:14:36.087 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:36.022+0000 7f8e0659c700 1 --2- 172.21.15.163:0/2537607588 >> [v2:172.21.15.184:6838/2819059257,v1:172.21.15.184:6839/2819059257] conn(0x5603c72c6070 0x5603c72c8480 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=452185ada319ba29 server_cookie=bcb98f2981e86d45 in_seq=0 out_seq=0 2023-07-14T18:14:36.087 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:36.022+0000 7f8deaff5700 1 -- 172.21.15.163:0/2537607588 <== mds.1 v2:172.21.15.184:6838/2819059257 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x5603c71a5eb0 con 0x5603c72c6070 2023-07-14T18:14:36.087 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:36.022+0000 7f8deaff5700 10 client.25832 handle_command_reply: tid=0 2023-07-14T18:14:36.087 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:36.023+0000 7f8e19286b80 1 client.25832 shutdown 2023-07-14T18:14:36.087 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:36.023+0000 7f8e19286b80 1 -- 172.21.15.163:0/2537607588 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5603c725bf60 msgr2=0x5603c7268d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:14:36.087 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:36.023+0000 7f8e19286b80 1 --2- 172.21.15.163:0/2537607588 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5603c725bf60 0x5603c7268d00 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f8dfc0a2110 tx=0x7f8dfc00cf40 comp rx=0 tx=0).stop 2023-07-14T18:14:36.087 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:36.023+0000 7f8e19286b80 1 -- 172.21.15.163:0/2537607588 shutdown_connections 2023-07-14T18:14:36.087 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:36.023+0000 7f8e19286b80 1 --2- 172.21.15.163:0/2537607588 >> [v2:172.21.15.184:6838/2819059257,v1:172.21.15.184:6839/2819059257] conn(0x5603c72c6070 0x5603c72c8480 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:36.088 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:36.023+0000 7f8e19286b80 1 --2- 172.21.15.163:0/2537607588 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5603c725d4b0 0x5603c726c260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:36.088 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:36.023+0000 7f8e19286b80 1 --2- 172.21.15.163:0/2537607588 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5603c725bf60 0x5603c7268d00 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:36.088 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:36.023+0000 7f8deaff5700 0 client.25832 ms_handle_reset on v2:172.21.15.184:6838/2819059257 2023-07-14T18:14:36.088 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:36.023+0000 7f8e19286b80 1 --2- 172.21.15.163:0/2537607588 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5603c725c8b0 0x5603c7269240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:36.088 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:36.023+0000 7f8e19286b80 1 -- 172.21.15.163:0/2537607588 >> 172.21.15.163:0/2537607588 conn(0x5603c7251680 msgr2=0x5603c7263860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:14:36.088 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:36.023+0000 7f8e19286b80 1 -- 172.21.15.163:0/2537607588 shutdown_connections 2023-07-14T18:14:36.088 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:36.023+0000 7f8e19286b80 1 -- 172.21.15.163:0/2537607588 wait complete. 2023-07-14T18:14:36.089 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:36.023+0000 7f8e19286b80 20 client.25832 trim_cache size 0 max 16384 2023-07-14T18:14:36.089 INFO:teuthology.orchestra.run.smithi163.stdout:[] 2023-07-14T18:14:36.090 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:36.023+0000 7f8e0d0ee700 1 -- 172.21.15.163:0/2379362011 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f8df00a1150 msgr2=0x7f8df00a3600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:14:36.090 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:36.023+0000 7f8e0d0ee700 1 --2- 172.21.15.163:0/2379362011 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f8df00a1150 0x7f8df00a3600 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f8df800f910 tx=0x7f8df8019040 comp rx=0 tx=0).stop 2023-07-14T18:14:36.090 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:36.023+0000 7f8e0d0ee700 1 -- 172.21.15.163:0/2379362011 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8e080feb10 msgr2=0x7f8e08102aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:14:36.091 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:36.023+0000 7f8e0d0ee700 1 --2- 172.21.15.163:0/2379362011 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8e080feb10 0x7f8e08102aa0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f8dfc00ebf0 tx=0x7f8dfc00ef00 comp rx=0 tx=0).stop 2023-07-14T18:14:36.091 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:36.024+0000 7f8e0d0ee700 1 -- 172.21.15.163:0/2379362011 shutdown_connections 2023-07-14T18:14:36.091 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:36.024+0000 7f8e0d0ee700 1 --2- 172.21.15.163:0/2379362011 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f8df00a1150 0x7f8df00a3600 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:36.091 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:36.024+0000 7f8e0d0ee700 1 --2- 172.21.15.163:0/2379362011 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f8e08100690 0x7f8e08101620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:36.091 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:36.024+0000 7f8e0d0ee700 1 --2- 172.21.15.163:0/2379362011 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8e080feb10 0x7f8e08102aa0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:36.091 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:36.024+0000 7f8e0d0ee700 1 --2- 172.21.15.163:0/2379362011 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8e080ffd00 0x7f8e081010e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:36.091 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:36.024+0000 7f8e0d0ee700 1 -- 172.21.15.163:0/2379362011 >> 172.21.15.163:0/2379362011 conn(0x7f8e080fa130 msgr2=0x7f8e08068850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:14:36.091 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:36.024+0000 7f8e0d0ee700 1 -- 172.21.15.163:0/2379362011 shutdown_connections 2023-07-14T18:14:36.092 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:36.024+0000 7f8e0d0ee700 1 -- 172.21.15.163:0/2379362011 wait complete. 2023-07-14T18:14:36.092 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 damage ls 2023-07-14T18:14:36.177 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:14:35 smithi184 ceph-mon[98481]: from='client.? 172.21.15.163:0/2335168079' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-07-14T18:14:36.177 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:14:35 smithi184 ceph-mon[98481]: pgmap v358: 129 pgs: 129 active+clean; 50 MiB data, 590 MiB used, 1.0 TiB / 1.0 TiB avail; 806 KiB/s rd, 1.1 MiB/s wr, 330 op/s 2023-07-14T18:14:36.229 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:36.185+0000 7fbb0d3ff700 1 -- 172.21.15.163:0/63573035 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fbb080fedc0 msgr2=0x7fbb080ff210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:14:36.229 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:36.185+0000 7fbb0d3ff700 1 --2- 172.21.15.163:0/63573035 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fbb080fedc0 0x7fbb080ff210 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7fbafc009990 tx=0x7fbafc009ca0 comp rx=0 tx=0).stop 2023-07-14T18:14:36.229 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:36.185+0000 7fbb0d3ff700 1 -- 172.21.15.163:0/63573035 shutdown_connections 2023-07-14T18:14:36.230 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:36.185+0000 7fbb0d3ff700 1 --2- 172.21.15.163:0/63573035 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbb08100090 0x7fbb081004a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:36.230 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:36.185+0000 7fbb0d3ff700 1 --2- 172.21.15.163:0/63573035 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbb080ff750 0x7fbb08107020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:36.230 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:36.185+0000 7fbb0d3ff700 1 --2- 172.21.15.163:0/63573035 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fbb080fedc0 0x7fbb080ff210 unknown :-1 s=CLOSED pgs=655 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:36.230 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:36.185+0000 7fbb0d3ff700 1 -- 172.21.15.163:0/63573035 >> 172.21.15.163:0/63573035 conn(0x7fbb080f98a0 msgr2=0x7fbb080fbcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:14:36.230 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:36.185+0000 7fbb0d3ff700 1 -- 172.21.15.163:0/63573035 shutdown_connections 2023-07-14T18:14:36.230 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:36.185+0000 7fbb0d3ff700 1 -- 172.21.15.163:0/63573035 wait complete. 2023-07-14T18:14:36.230 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:36.186+0000 7fbb0d3ff700 1 Processor -- start 2023-07-14T18:14:36.232 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:36.186+0000 7fbb0d3ff700 1 -- start start 2023-07-14T18:14:36.232 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:36.186+0000 7fbb0d3ff700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbb080fedc0 0x7fbb080fe840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:14:36.233 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:36.186+0000 7fbb0d3ff700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fbb080ff750 0x7fbb0819c9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:14:36.233 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:36.186+0000 7fbb0d3ff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbb08100090 0x7fbb0819eef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:14:36.233 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:36.186+0000 7fbb0d3ff700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb0819f5d0 con 0x7fbb080ff750 2023-07-14T18:14:36.233 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:36.186+0000 7fbb0d3ff700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb0819f740 con 0x7fbb080fedc0 2023-07-14T18:14:36.233 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:36.186+0000 7fbb0d3ff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb0819f900 con 0x7fbb08100090 2023-07-14T18:14:36.233 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:36.186+0000 7fbb067fc700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fbb080ff750 0x7fbb0819c9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:14:36.233 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:36.186+0000 7fbb067fc700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fbb080ff750 0x7fbb0819c9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:59352/0 (socket says 172.21.15.163:59352) 2023-07-14T18:14:36.234 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:36.186+0000 7fbb067fc700 1 -- 172.21.15.163:0/1752485200 learned_addr learned my addr 172.21.15.163:0/1752485200 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:14:36.234 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:36.186+0000 7fbb06ffd700 1 --2- 172.21.15.163:0/1752485200 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbb080fedc0 0x7fbb080fe840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:14:36.234 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:36.186+0000 7fbb077fe700 1 --2- 172.21.15.163:0/1752485200 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbb08100090 0x7fbb0819eef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:14:36.234 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:36.187+0000 7fbb067fc700 1 -- 172.21.15.163:0/1752485200 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbb08100090 msgr2=0x7fbb0819eef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:14:36.234 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:36.187+0000 7fbb067fc700 1 --2- 172.21.15.163:0/1752485200 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbb08100090 0x7fbb0819eef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:36.234 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:36.187+0000 7fbb067fc700 1 -- 172.21.15.163:0/1752485200 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbb080fedc0 msgr2=0x7fbb080fe840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:14:36.234 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:36.187+0000 7fbb067fc700 1 --2- 172.21.15.163:0/1752485200 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbb080fedc0 0x7fbb080fe840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:36.234 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:36.187+0000 7fbb067fc700 1 -- 172.21.15.163:0/1752485200 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbafc0095f0 con 0x7fbb080ff750 2023-07-14T18:14:36.235 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:36.187+0000 7fbb067fc700 1 --2- 172.21.15.163:0/1752485200 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fbb080ff750 0x7fbb0819c9a0 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7fbafc006010 tx=0x7fbafc003a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:14:36.235 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:36.187+0000 7fbaeffff700 1 -- 172.21.15.163:0/1752485200 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbafc01d070 con 0x7fbb080ff750 2023-07-14T18:14:36.235 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:36.187+0000 7fbaeffff700 1 -- 172.21.15.163:0/1752485200 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fbafc00bd70 con 0x7fbb080ff750 2023-07-14T18:14:36.235 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:36.187+0000 7fbb0d3ff700 1 -- 172.21.15.163:0/1752485200 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbb0819fb80 con 0x7fbb080ff750 2023-07-14T18:14:36.235 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:36.187+0000 7fbaeffff700 1 -- 172.21.15.163:0/1752485200 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbafc022c40 con 0x7fbb080ff750 2023-07-14T18:14:36.235 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:36.187+0000 7fbb0d3ff700 1 -- 172.21.15.163:0/1752485200 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbb081a0000 con 0x7fbb080ff750 2023-07-14T18:14:36.238 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:36.190+0000 7fbaeffff700 1 -- 172.21.15.163:0/1752485200 <== mon.0 v2:172.21.15.163:3300/0 4 ==== mgrmap(e 18) v1 ==== 135716+0+0 (secure 0 0 0) 0x7fbafc022470 con 0x7fbb080ff750 2023-07-14T18:14:36.238 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:36.191+0000 7fbaeffff700 1 --2- 172.21.15.163:0/1752485200 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7fbaf00a11d0 0x7fbaf00a3680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:14:36.238 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:36.191+0000 7fbb19597b80 1 Processor -- start 2023-07-14T18:14:36.239 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:36.191+0000 7fbb06ffd700 1 --2- 172.21.15.163:0/1752485200 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7fbaf00a11d0 0x7fbaf00a3680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:14:36.239 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:36.191+0000 7fbb19597b80 1 -- start start 2023-07-14T18:14:36.239 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:36.191+0000 7fbaeffff700 1 -- 172.21.15.163:0/1752485200 <== mon.0 v2:172.21.15.163:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 9049+0+0 (secure 0 0 0) 0x7fbafc0ce1c0 con 0x7fbb080ff750 2023-07-14T18:14:36.239 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:36.191+0000 7fbb19597b80 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x561e3c83df60 0x561e3c83e370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:14:36.239 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:36.191+0000 7fbb19597b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561e3c83e8b0 0x561e3c83eed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:14:36.239 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:36.191+0000 7fbb19597b80 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x561e3c83f4b0 0x561e3c83f920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:14:36.239 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:36.191+0000 7fbb19597b80 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x561e3c742cb0 con 0x561e3c83df60 2023-07-14T18:14:36.239 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:36.191+0000 7fbb19597b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x561e3c795a40 con 0x561e3c83e8b0 2023-07-14T18:14:36.240 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:36.191+0000 7fbb19597b80 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x561e3c78eed0 con 0x561e3c83f4b0 2023-07-14T18:14:36.240 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:36.191+0000 7fbb06ffd700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x561e3c83df60 0x561e3c83e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:14:36.240 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:36.191+0000 7fbb06ffd700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x561e3c83df60 0x561e3c83e370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:59358/0 (socket says 172.21.15.163:59358) 2023-07-14T18:14:36.240 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:36.191+0000 7fbb06ffd700 1 -- 172.21.15.163:0/2694612922 learned_addr learned my addr 172.21.15.163:0/2694612922 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:14:36.240 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:36.192+0000 7fbb077fe700 1 --2- 172.21.15.163:0/2694612922 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x561e3c83f4b0 0x561e3c83f920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:14:36.241 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:36.192+0000 7fbb067fc700 1 --2- 172.21.15.163:0/2694612922 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561e3c83e8b0 0x561e3c83eed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:14:36.241 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:36.192+0000 7fbb06ffd700 1 --2- 172.21.15.163:0/1752485200 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7fbaf00a11d0 0x7fbaf00a3680 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fbb08067520 tx=0x7fbaf800f6a0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:14:36.241 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:36.192+0000 7fbb06ffd700 1 -- 172.21.15.163:0/2694612922 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x561e3c83f4b0 msgr2=0x561e3c83f920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:14:36.241 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:36.192+0000 7fbb06ffd700 1 --2- 172.21.15.163:0/2694612922 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x561e3c83f4b0 0x561e3c83f920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:36.241 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:36.192+0000 7fbb06ffd700 1 -- 172.21.15.163:0/2694612922 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561e3c83e8b0 msgr2=0x561e3c83eed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:14:36.241 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:36.192+0000 7fbb06ffd700 1 --2- 172.21.15.163:0/2694612922 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561e3c83e8b0 0x561e3c83eed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:36.242 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:36.192+0000 7fbb06ffd700 1 -- 172.21.15.163:0/2694612922 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561e3c5bcde0 con 0x561e3c83df60 2023-07-14T18:14:36.242 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:36.192+0000 7fbb077fe700 1 --2- 172.21.15.163:0/2694612922 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x561e3c83f4b0 0x561e3c83f920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T18:14:36.242 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:36.192+0000 7fbb06ffd700 1 --2- 172.21.15.163:0/2694612922 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x561e3c83df60 0x561e3c83e370 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7fbaf800ff70 tx=0x7fbaf801a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9cdf0ba9fb73c998 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:14:36.242 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:36.192+0000 7fbaed7fa700 1 -- 172.21.15.163:0/2694612922 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbaf8012dc0 con 0x561e3c83df60 2023-07-14T18:14:36.242 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:36.192+0000 7fbaed7fa700 1 -- 172.21.15.163:0/2694612922 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fbaf80122e0 con 0x561e3c83df60 2023-07-14T18:14:36.242 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:36.192+0000 7fbaed7fa700 1 -- 172.21.15.163:0/2694612922 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbaf801c420 con 0x561e3c83df60 2023-07-14T18:14:36.242 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:36.193+0000 7fbb19597b80 1 -- 172.21.15.163:0/2694612922 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x561e3c83df60 msgr2=0x561e3c83e370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:14:36.243 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:36.193+0000 7fbb19597b80 1 --2- 172.21.15.163:0/2694612922 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x561e3c83df60 0x561e3c83e370 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7fbaf800ff70 tx=0x7fbaf801a000 comp rx=0 tx=0).stop 2023-07-14T18:14:36.243 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:36.193+0000 7fbb19597b80 1 -- 172.21.15.163:0/2694612922 shutdown_connections 2023-07-14T18:14:36.243 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:36.193+0000 7fbb19597b80 1 --2- 172.21.15.163:0/2694612922 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x561e3c83f4b0 0x561e3c83f920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:36.243 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:36.193+0000 7fbb19597b80 1 --2- 172.21.15.163:0/2694612922 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x561e3c83df60 0x561e3c83e370 unknown :-1 s=CLOSED pgs=657 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:36.243 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:36.193+0000 7fbb19597b80 1 --2- 172.21.15.163:0/2694612922 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561e3c83e8b0 0x561e3c83eed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:36.243 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:36.193+0000 7fbb19597b80 1 -- 172.21.15.163:0/2694612922 >> 172.21.15.163:0/2694612922 conn(0x561e3c833680 msgr2=0x561e3c8389d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:14:36.243 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:36.193+0000 7fbb19597b80 1 -- 172.21.15.163:0/2694612922 shutdown_connections 2023-07-14T18:14:36.243 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:36.193+0000 7fbb19597b80 1 -- 172.21.15.163:0/2694612922 wait complete. 2023-07-14T18:14:36.244 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:36.194+0000 7fbb19597b80 1 -- start start 2023-07-14T18:14:36.244 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:36.194+0000 7fbb19597b80 1 Processor -- start 2023-07-14T18:14:36.244 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:36.194+0000 7fbb19597b80 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x561e3c83df60 0x561e3c8478b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:14:36.244 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:36.194+0000 7fbb19597b80 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x561e3c83e8b0 0x561e3c847df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:14:36.244 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:36.194+0000 7fbb19597b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561e3c83f4b0 0x561e3c84ee30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:14:36.244 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:36.194+0000 7fbb19597b80 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x561e3c72eac0 con 0x561e3c83e8b0 2023-07-14T18:14:36.244 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:36.194+0000 7fbb19597b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x561e3c72e7c0 con 0x561e3c83f4b0 2023-07-14T18:14:36.245 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:36.194+0000 7fbb19597b80 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x561e3c612920 con 0x561e3c83df60 2023-07-14T18:14:36.245 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:36.194+0000 7fbb19597b80 10 client.0 _ll_register_callbacks cb 0x561e3c72c760 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T18:14:36.245 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:36.194+0000 7fbb067fc700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x561e3c83e8b0 0x561e3c847df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:14:36.245 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:36.194+0000 7fbb06ffd700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x561e3c83df60 0x561e3c8478b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:14:36.245 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:36.194+0000 7fbb067fc700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x561e3c83e8b0 0x561e3c847df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:59366/0 (socket says 172.21.15.163:59366) 2023-07-14T18:14:36.245 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:36.194+0000 7fbb067fc700 1 -- 172.21.15.163:0/62330257 learned_addr learned my addr 172.21.15.163:0/62330257 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:14:36.245 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:36.194+0000 7fbb077fe700 1 --2- 172.21.15.163:0/62330257 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561e3c83f4b0 0x561e3c84ee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:14:36.245 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:36.195+0000 7fbb06ffd700 1 -- 172.21.15.163:0/62330257 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561e3c83f4b0 msgr2=0x561e3c84ee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:14:36.246 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:36.195+0000 7fbb06ffd700 1 --2- 172.21.15.163:0/62330257 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561e3c83f4b0 0x561e3c84ee30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:36.246 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:36.195+0000 7fbb06ffd700 1 -- 172.21.15.163:0/62330257 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x561e3c83e8b0 msgr2=0x561e3c847df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:14:36.246 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:36.195+0000 7fbb06ffd700 1 --2- 172.21.15.163:0/62330257 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x561e3c83e8b0 0x561e3c847df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:36.246 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:36.195+0000 7fbb06ffd700 1 -- 172.21.15.163:0/62330257 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbaf800fcb0 con 0x561e3c83df60 2023-07-14T18:14:36.246 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:36.195+0000 7fbb067fc700 1 --2- 172.21.15.163:0/62330257 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x561e3c83e8b0 0x561e3c847df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T18:14:36.246 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:36.195+0000 7fbb06ffd700 1 --2- 172.21.15.163:0/62330257 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x561e3c83df60 0x561e3c8478b0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fbaf800ffe0 tx=0x7fbaf80104d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=209d0faecc6d78b1 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:14:36.246 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:36.195+0000 7fbaeaff5700 10 client.0 ms_handle_connect on v2:172.21.15.184:3300/0 2023-07-14T18:14:36.248 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:36.195+0000 7fbaeaff5700 1 -- 172.21.15.163:0/62330257 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbaf8005040 con 0x561e3c83df60 2023-07-14T18:14:36.248 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:36.195+0000 7fbaeaff5700 1 -- 172.21.15.163:0/62330257 <== mon.1 v2:172.21.15.184:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 9049+0+0 (secure 0 0 0) 0x7fbaf80051a0 con 0x561e3c83df60 2023-07-14T18:14:36.248 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:36.195+0000 7fbb19597b80 1 -- 172.21.15.163:0/62330257 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x561e3c6e84f0 con 0x561e3c83df60 2023-07-14T18:14:36.248 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:36.195+0000 7fbaeaff5700 1 -- 172.21.15.163:0/62330257 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) v2 ==== 24+0+0 (secure 0 0 0) 0x7fbaf8005360 con 0x561e3c83df60 2023-07-14T18:14:36.249 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:36.195+0000 7fbb19597b80 10 client.25777 fetch_fsmap learned FSMap version 31 2023-07-14T18:14:36.249 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:36.195+0000 7fbb19597b80 1 -- 172.21.15.163:0/62330257 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) v3 -- 0x561e3c5a5c60 con 0x561e3c83df60 2023-07-14T18:14:36.249 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:36.195+0000 7fbaeaff5700 1 -- 172.21.15.163:0/62330257 <== mon.1 v2:172.21.15.184:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x561e3c6e84f0 con 0x561e3c83df60 2023-07-14T18:14:36.249 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:36.195+0000 7fbaeaff5700 1 -- 172.21.15.163:0/62330257 <== mon.1 v2:172.21.15.184:3300/0 5 ==== fsmap(e 31) v1 ==== 7486+0+0 (secure 0 0 0) 0x7fbaf801c420 con 0x561e3c83df60 2023-07-14T18:14:36.249 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:36.196+0000 7fbb19597b80 10 client.25777 fetch_fsmap finished waiting for FSMap version 31 2023-07-14T18:14:36.249 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:36.196+0000 7fbb19597b80 10 client.25777 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-07-14T18:14:36.249 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:36.196+0000 7fbb19597b80 20 client.25777 populate_metadata read hostname 'smithi163' 2023-07-14T18:14:36.249 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:36.196+0000 7fbb19597b80 1 --2- 172.21.15.163:0/62330257 >> [v2:172.21.15.172:6838/3850440096,v1:172.21.15.172:6839/3850440096] conn(0x561e3c853630 0x561e3c855a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:14:36.250 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:36.196+0000 7fbb19597b80 4 client.25777 mds_command: new command op to 24518 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-14T18:14:36.250 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:36.196+0000 7fbb19597b80 1 -- 172.21.15.163:0/62330257 --> [v2:172.21.15.172:6838/3850440096,v1:172.21.15.172:6839/3850440096] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x561e3c80cda0 con 0x561e3c853630 2023-07-14T18:14:36.250 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:36.196+0000 7fbb067fc700 1 --2- 172.21.15.163:0/62330257 >> [v2:172.21.15.172:6838/3850440096,v1:172.21.15.172:6839/3850440096] conn(0x561e3c853630 0x561e3c855a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:14:36.250 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:36.196+0000 7fbaeaff5700 10 client.25777 ms_handle_connect on v2:172.21.15.172:6838/3850440096 2023-07-14T18:14:36.250 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:36.196+0000 7fbb067fc700 1 --2- 172.21.15.163:0/62330257 >> [v2:172.21.15.172:6838/3850440096,v1:172.21.15.172:6839/3850440096] conn(0x561e3c853630 0x561e3c855a40 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=11dc3565d8faf575 server_cookie=ac2479a26ccc0e3d in_seq=0 out_seq=0 2023-07-14T18:14:36.250 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:36.197+0000 7fbaeaff5700 1 -- 172.21.15.163:0/62330257 <== mds.0 v2:172.21.15.172:6838/3850440096 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18017 (crc 0 0 0) 0x561e3c80cda0 con 0x561e3c853630 2023-07-14T18:14:36.250 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:36.197+0000 7fbaeaff5700 10 client.25777 handle_command_reply: tid=0 2023-07-14T18:14:36.250 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:36.197+0000 7fbb19597b80 1 client.25777 shutdown 2023-07-14T18:14:36.251 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:36.197+0000 7fbb19597b80 1 -- 172.21.15.163:0/62330257 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x561e3c83df60 msgr2=0x561e3c8478b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:14:36.251 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:36.197+0000 7fbb19597b80 1 --2- 172.21.15.163:0/62330257 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x561e3c83df60 0x561e3c8478b0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fbaf800ffe0 tx=0x7fbaf80104d0 comp rx=0 tx=0).stop 2023-07-14T18:14:36.251 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:36.197+0000 7fbb19597b80 1 -- 172.21.15.163:0/62330257 shutdown_connections 2023-07-14T18:14:36.251 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:36.197+0000 7fbb19597b80 1 --2- 172.21.15.163:0/62330257 >> [v2:172.21.15.172:6838/3850440096,v1:172.21.15.172:6839/3850440096] conn(0x561e3c853630 0x561e3c855a40 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:36.251 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:36.197+0000 7fbb19597b80 1 --2- 172.21.15.163:0/62330257 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x561e3c83df60 0x561e3c8478b0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:36.251 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:36.197+0000 7fbb19597b80 1 --2- 172.21.15.163:0/62330257 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561e3c83f4b0 0x561e3c84ee30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:36.251 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:36.197+0000 7fbb19597b80 1 --2- 172.21.15.163:0/62330257 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x561e3c83e8b0 0x561e3c847df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:36.251 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:36.197+0000 7fbaeaff5700 0 client.25777 ms_handle_reset on v2:172.21.15.172:6838/3850440096 2023-07-14T18:14:36.252 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:36.197+0000 7fbb19597b80 1 -- 172.21.15.163:0/62330257 >> 172.21.15.163:0/62330257 conn(0x561e3c833680 msgr2=0x561e3c837650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:14:36.252 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:36.197+0000 7fbb19597b80 1 -- 172.21.15.163:0/62330257 shutdown_connections 2023-07-14T18:14:36.252 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:36.197+0000 7fbb19597b80 1 -- 172.21.15.163:0/62330257 wait complete. 2023-07-14T18:14:36.252 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:36.197+0000 7fbb19597b80 20 client.25777 trim_cache size 0 max 16384 2023-07-14T18:14:36.254 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:36.211+0000 7fbb19597b80 1 Processor -- start 2023-07-14T18:14:36.255 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:36.211+0000 7fbb19597b80 1 -- start start 2023-07-14T18:14:36.255 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:36.211+0000 7fbb19597b80 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x561e3c83df60 0x561e3c846f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:14:36.255 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:36.211+0000 7fbb19597b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561e3c83e8b0 0x561e3c84edf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:14:36.255 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:36.211+0000 7fbb19597b80 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x561e3c83f4b0 0x561e3c834b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:14:36.255 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:36.211+0000 7fbb19597b80 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x561e3c848ad0 con 0x561e3c83df60 2023-07-14T18:14:36.255 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:36.211+0000 7fbb19597b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x561e3c80cdd0 con 0x561e3c83e8b0 2023-07-14T18:14:36.256 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:36.211+0000 7fbb19597b80 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x561e3c83f330 con 0x561e3c83f4b0 2023-07-14T18:14:36.256 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:36.211+0000 7fbb077fe700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x561e3c83f4b0 0x561e3c834b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:14:36.256 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:36.211+0000 7fbb067fc700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561e3c83e8b0 0x561e3c84edf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:14:36.256 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:36.211+0000 7fbb06ffd700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x561e3c83df60 0x561e3c846f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:14:36.256 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:36.211+0000 7fbb067fc700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561e3c83e8b0 0x561e3c84edf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.163:60058/0 (socket says 172.21.15.163:60058) 2023-07-14T18:14:36.256 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:36.211+0000 7fbb067fc700 1 -- 172.21.15.163:0/787978335 learned_addr learned my addr 172.21.15.163:0/787978335 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:14:36.256 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:36.211+0000 7fbb077fe700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x561e3c83f4b0 0x561e3c834b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.163:41198/0 (socket says 172.21.15.163:41198) 2023-07-14T18:14:36.263 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:36.212+0000 7fbb067fc700 1 -- 172.21.15.163:0/787978335 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x561e3c83f4b0 msgr2=0x561e3c834b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:14:36.264 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:36.212+0000 7fbb067fc700 1 --2- 172.21.15.163:0/787978335 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x561e3c83f4b0 0x561e3c834b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:36.264 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:36.212+0000 7fbb067fc700 1 -- 172.21.15.163:0/787978335 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x561e3c83df60 msgr2=0x561e3c846f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:14:36.264 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:36.212+0000 7fbb067fc700 1 --2- 172.21.15.163:0/787978335 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x561e3c83df60 0x561e3c846f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:36.265 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:36.212+0000 7fbb067fc700 1 -- 172.21.15.163:0/787978335 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561e3c5e3250 con 0x561e3c83e8b0 2023-07-14T18:14:36.265 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:36.212+0000 7fbb067fc700 1 --2- 172.21.15.163:0/787978335 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561e3c83e8b0 0x561e3c84edf0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fbafc097e70 tx=0x7fbafc01a040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f62dff68b3025e02 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:14:36.265 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:36.212+0000 7fbaedffb700 1 -- 172.21.15.163:0/787978335 <== mon.2 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbafc0b7070 con 0x561e3c83e8b0 2023-07-14T18:14:36.265 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:36.212+0000 7fbaedffb700 1 -- 172.21.15.163:0/787978335 <== mon.2 v2:172.21.15.172:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fbafc09b4d0 con 0x561e3c83e8b0 2023-07-14T18:14:36.266 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:36.212+0000 7fbaedffb700 1 -- 172.21.15.163:0/787978335 <== mon.2 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbafc09b6b0 con 0x561e3c83e8b0 2023-07-14T18:14:36.266 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:36.213+0000 7fbb19597b80 1 -- 172.21.15.163:0/787978335 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561e3c83e8b0 msgr2=0x561e3c84edf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:14:36.266 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:36.213+0000 7fbb19597b80 1 --2- 172.21.15.163:0/787978335 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561e3c83e8b0 0x561e3c84edf0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fbafc097e70 tx=0x7fbafc01a040 comp rx=0 tx=0).stop 2023-07-14T18:14:36.266 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:36.213+0000 7fbb19597b80 1 -- 172.21.15.163:0/787978335 shutdown_connections 2023-07-14T18:14:36.266 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:36.213+0000 7fbb19597b80 1 --2- 172.21.15.163:0/787978335 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x561e3c83f4b0 0x561e3c834b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:36.267 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:36.213+0000 7fbb19597b80 1 --2- 172.21.15.163:0/787978335 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x561e3c83df60 0x561e3c846f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:36.267 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:36.213+0000 7fbb19597b80 1 --2- 172.21.15.163:0/787978335 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561e3c83e8b0 0x561e3c84edf0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:36.267 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:36.213+0000 7fbb19597b80 1 -- 172.21.15.163:0/787978335 >> 172.21.15.163:0/787978335 conn(0x561e3c833680 msgr2=0x561e3c8389a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:14:36.267 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:36.213+0000 7fbb19597b80 1 -- 172.21.15.163:0/787978335 shutdown_connections 2023-07-14T18:14:36.268 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:36.213+0000 7fbb19597b80 1 -- 172.21.15.163:0/787978335 wait complete. 2023-07-14T18:14:36.268 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:36.213+0000 7fbb19597b80 1 -- start start 2023-07-14T18:14:36.268 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:36.213+0000 7fbb19597b80 1 Processor -- start 2023-07-14T18:14:36.268 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:36.213+0000 7fbb19597b80 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x561e3c83df60 0x561e3c84aff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:14:36.269 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:36.213+0000 7fbb19597b80 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x561e3c83e8b0 0x561e3c84b530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:14:36.269 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:36.213+0000 7fbb19597b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561e3c83f4b0 0x561e3c84de50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:14:36.269 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:36.213+0000 7fbb19597b80 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x561e3c84e390 con 0x561e3c83e8b0 2023-07-14T18:14:36.269 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:36.213+0000 7fbb19597b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x561e3c84e4d0 con 0x561e3c83f4b0 2023-07-14T18:14:36.269 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:36.213+0000 7fbb19597b80 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x561e3c84e690 con 0x561e3c83df60 2023-07-14T18:14:36.269 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:36.213+0000 7fbb19597b80 10 client.0 _ll_register_callbacks cb 0x7fbafc0970d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T18:14:36.269 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:36.213+0000 7fbb067fc700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x561e3c83e8b0 0x561e3c84b530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:14:36.270 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:36.214+0000 7fbb077fe700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561e3c83f4b0 0x561e3c84de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:14:36.270 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:36.214+0000 7fbb067fc700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x561e3c83e8b0 0x561e3c84b530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:59380/0 (socket says 172.21.15.163:59380) 2023-07-14T18:14:36.270 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:36.214+0000 7fbb06ffd700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x561e3c83df60 0x561e3c84aff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:14:36.270 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:36.214+0000 7fbb067fc700 1 -- 172.21.15.163:0/2505574177 learned_addr learned my addr 172.21.15.163:0/2505574177 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:14:36.270 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:36.214+0000 7fbb067fc700 1 -- 172.21.15.163:0/2505574177 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x561e3c83df60 msgr2=0x561e3c84aff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:14:36.270 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:36.214+0000 7fbb067fc700 1 --2- 172.21.15.163:0/2505574177 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x561e3c83df60 0x561e3c84aff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:36.270 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:36.214+0000 7fbb067fc700 1 -- 172.21.15.163:0/2505574177 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561e3c83f4b0 msgr2=0x561e3c84de50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:14:36.270 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:36.214+0000 7fbb067fc700 1 --2- 172.21.15.163:0/2505574177 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561e3c83f4b0 0x561e3c84de50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:36.271 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:36.214+0000 7fbb067fc700 1 -- 172.21.15.163:0/2505574177 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbb081a0000 con 0x561e3c83e8b0 2023-07-14T18:14:36.271 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:36.214+0000 7fbb077fe700 1 --2- 172.21.15.163:0/2505574177 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561e3c83f4b0 0x561e3c84de50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T18:14:36.271 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:36.214+0000 7fbb06ffd700 1 --2- 172.21.15.163:0/2505574177 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x561e3c83df60 0x561e3c84aff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T18:14:36.271 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:36.214+0000 7fbb067fc700 1 --2- 172.21.15.163:0/2505574177 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x561e3c83e8b0 0x561e3c84b530 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7fbafc0cbd00 tx=0x7fbafc009380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a3963b4029c1957d server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:14:36.271 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:36.214+0000 7fbaeaff5700 10 client.0 ms_handle_connect on v2:172.21.15.163:3300/0 2023-07-14T18:14:36.271 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:36.214+0000 7fbaeaff5700 1 -- 172.21.15.163:0/2505574177 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbafc0b7070 con 0x561e3c83e8b0 2023-07-14T18:14:36.271 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:36.214+0000 7fbaeaff5700 1 -- 172.21.15.163:0/2505574177 <== mon.0 v2:172.21.15.163:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 9049+0+0 (secure 0 0 0) 0x7fbafc0a3810 con 0x561e3c83e8b0 2023-07-14T18:14:36.272 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:36.214+0000 7fbb19597b80 1 -- 172.21.15.163:0/2505574177 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fbaf80122e0 con 0x561e3c83e8b0 2023-07-14T18:14:36.272 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:36.214+0000 7fbaeaff5700 1 -- 172.21.15.163:0/2505574177 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) v2 ==== 24+0+0 (secure 0 0 0) 0x7fbafc09ab50 con 0x561e3c83e8b0 2023-07-14T18:14:36.272 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:36.214+0000 7fbb19597b80 10 client.16221 fetch_fsmap learned FSMap version 31 2023-07-14T18:14:36.272 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:36.214+0000 7fbb19597b80 1 -- 172.21.15.163:0/2505574177 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) v3 -- 0x561e3c5bb2b0 con 0x561e3c83e8b0 2023-07-14T18:14:36.272 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:36.215+0000 7fbaeaff5700 1 -- 172.21.15.163:0/2505574177 <== mon.0 v2:172.21.15.163:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fbafc080080 con 0x561e3c83e8b0 2023-07-14T18:14:36.272 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:36.215+0000 7fbaeaff5700 1 -- 172.21.15.163:0/2505574177 <== mon.0 v2:172.21.15.163:3300/0 5 ==== fsmap(e 31) v1 ==== 7486+0+0 (secure 0 0 0) 0x7fbafc097240 con 0x561e3c83e8b0 2023-07-14T18:14:36.272 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:36.215+0000 7fbb19597b80 10 client.16221 fetch_fsmap finished waiting for FSMap version 31 2023-07-14T18:14:36.272 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:36.215+0000 7fbb19597b80 10 client.16221 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-07-14T18:14:36.273 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:36.215+0000 7fbb19597b80 20 client.16221 populate_metadata read hostname 'smithi163' 2023-07-14T18:14:36.273 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:36.215+0000 7fbb19597b80 1 --2- 172.21.15.163:0/2505574177 >> [v2:172.21.15.172:6838/3850440096,v1:172.21.15.172:6839/3850440096] conn(0x561e3c8a7c20 0x561e3c8aa030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:14:36.273 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:36.215+0000 7fbb19597b80 4 client.16221 mds_command: new command op to 24518 tid=0[{"prefix": "damage ls"}] 2023-07-14T18:14:36.273 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:36.215+0000 7fbb19597b80 1 -- 172.21.15.163:0/2505574177 --> [v2:172.21.15.172:6838/3850440096,v1:172.21.15.172:6839/3850440096] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x561e3c787eb0 con 0x561e3c8a7c20 2023-07-14T18:14:36.273 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:36.215+0000 7fbb06ffd700 1 --2- 172.21.15.163:0/2505574177 >> [v2:172.21.15.172:6838/3850440096,v1:172.21.15.172:6839/3850440096] conn(0x561e3c8a7c20 0x561e3c8aa030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:14:36.273 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:36.215+0000 7fbaeaff5700 10 client.16221 ms_handle_connect on v2:172.21.15.172:6838/3850440096 2023-07-14T18:14:36.273 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:36.215+0000 7fbb06ffd700 1 --2- 172.21.15.163:0/2505574177 >> [v2:172.21.15.172:6838/3850440096,v1:172.21.15.172:6839/3850440096] conn(0x561e3c8a7c20 0x561e3c8aa030 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1150cea4db1a7e1c server_cookie=14bedbfaa9bd1cd7 in_seq=0 out_seq=0 2023-07-14T18:14:36.274 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:36.216+0000 7fbaeaff5700 1 -- 172.21.15.163:0/2505574177 <== mds.0 v2:172.21.15.172:6838/3850440096 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x561e3c787eb0 con 0x561e3c8a7c20 2023-07-14T18:14:36.274 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:36.216+0000 7fbaeaff5700 10 client.16221 handle_command_reply: tid=0 2023-07-14T18:14:36.274 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:36.216+0000 7fbb19597b80 1 client.16221 shutdown 2023-07-14T18:14:36.274 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:36.216+0000 7fbb19597b80 1 -- 172.21.15.163:0/2505574177 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x561e3c83e8b0 msgr2=0x561e3c84b530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:14:36.274 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:36.216+0000 7fbb19597b80 1 --2- 172.21.15.163:0/2505574177 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x561e3c83e8b0 0x561e3c84b530 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7fbafc0cbd00 tx=0x7fbafc009380 comp rx=0 tx=0).stop 2023-07-14T18:14:36.274 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:36.216+0000 7fbb19597b80 1 -- 172.21.15.163:0/2505574177 shutdown_connections 2023-07-14T18:14:36.274 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:36.216+0000 7fbb19597b80 1 --2- 172.21.15.163:0/2505574177 >> [v2:172.21.15.172:6838/3850440096,v1:172.21.15.172:6839/3850440096] conn(0x561e3c8a7c20 0x561e3c8aa030 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:36.274 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:36.216+0000 7fbb19597b80 1 --2- 172.21.15.163:0/2505574177 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x561e3c83df60 0x561e3c84aff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:36.275 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:36.216+0000 7fbaeaff5700 0 client.16221 ms_handle_reset on v2:172.21.15.172:6838/3850440096 2023-07-14T18:14:36.275 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:36.216+0000 7fbb19597b80 1 --2- 172.21.15.163:0/2505574177 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561e3c83f4b0 0x561e3c84de50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:36.275 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:36.216+0000 7fbb19597b80 1 --2- 172.21.15.163:0/2505574177 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x561e3c83e8b0 0x561e3c84b530 unknown :-1 s=CLOSED pgs=658 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:36.275 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:36.216+0000 7fbb19597b80 1 -- 172.21.15.163:0/2505574177 >> 172.21.15.163:0/2505574177 conn(0x561e3c833680 msgr2=0x561e3c846d60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:14:36.275 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:36.216+0000 7fbb19597b80 1 -- 172.21.15.163:0/2505574177 shutdown_connections 2023-07-14T18:14:36.275 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:36.216+0000 7fbb19597b80 1 -- 172.21.15.163:0/2505574177 wait complete. 2023-07-14T18:14:36.275 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:36.216+0000 7fbb19597b80 20 client.16221 trim_cache size 0 max 16384 2023-07-14T18:14:36.276 INFO:teuthology.orchestra.run.smithi163.stdout:[] 2023-07-14T18:14:36.277 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:36.217+0000 7fbb0d3ff700 1 -- 172.21.15.163:0/1752485200 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7fbaf00a11d0 msgr2=0x7fbaf00a3680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:14:36.277 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:36.217+0000 7fbb0d3ff700 1 --2- 172.21.15.163:0/1752485200 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7fbaf00a11d0 0x7fbaf00a3680 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fbb08067520 tx=0x7fbaf800f6a0 comp rx=0 tx=0).stop 2023-07-14T18:14:36.277 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:36.217+0000 7fbb0d3ff700 1 -- 172.21.15.163:0/1752485200 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fbb080ff750 msgr2=0x7fbb0819c9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:14:36.277 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:36.217+0000 7fbb0d3ff700 1 --2- 172.21.15.163:0/1752485200 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fbb080ff750 0x7fbb0819c9a0 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7fbafc006010 tx=0x7fbafc003a50 comp rx=0 tx=0).stop 2023-07-14T18:14:36.277 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:36.217+0000 7fbb0d3ff700 1 -- 172.21.15.163:0/1752485200 shutdown_connections 2023-07-14T18:14:36.278 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:36.217+0000 7fbb0d3ff700 1 --2- 172.21.15.163:0/1752485200 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7fbaf00a11d0 0x7fbaf00a3680 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:36.278 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:36.217+0000 7fbb0d3ff700 1 --2- 172.21.15.163:0/1752485200 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbb08100090 0x7fbb0819eef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:36.278 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:36.217+0000 7fbb0d3ff700 1 --2- 172.21.15.163:0/1752485200 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbb080fedc0 0x7fbb080fe840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:36.278 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:36.217+0000 7fbb0d3ff700 1 --2- 172.21.15.163:0/1752485200 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fbb080ff750 0x7fbb0819c9a0 unknown :-1 s=CLOSED pgs=656 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:36.278 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:36.217+0000 7fbb0d3ff700 1 -- 172.21.15.163:0/1752485200 >> 172.21.15.163:0/1752485200 conn(0x7fbb080f98a0 msgr2=0x7fbb08103360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:14:36.278 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:36.217+0000 7fbb0d3ff700 1 -- 172.21.15.163:0/1752485200 shutdown_connections 2023-07-14T18:14:36.278 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:36.217+0000 7fbb0d3ff700 1 -- 172.21.15.163:0/1752485200 wait complete. 2023-07-14T18:14:36.279 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:14:35 smithi172 ceph-mon[97983]: from='client.? 172.21.15.163:0/2335168079' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-07-14T18:14:36.279 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:14:35 smithi172 ceph-mon[97983]: pgmap v358: 129 pgs: 129 active+clean; 50 MiB data, 590 MiB used, 1.0 TiB / 1.0 TiB avail; 806 KiB/s rd, 1.1 MiB/s wr, 330 op/s 2023-07-14T18:14:37.280 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2023-07-14T18:14:37.280 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2023-07-14T18:14:37.418 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:37.375+0000 7f20ca38e700 1 -- 172.21.15.163:0/2751311272 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f20c40fed80 msgr2=0x7f20c40ff1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:14:37.419 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:37.375+0000 7f20ca38e700 1 --2- 172.21.15.163:0/2751311272 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f20c40fed80 0x7f20c40ff1d0 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f20b8009990 tx=0x7f20b8009ca0 comp rx=0 tx=0).stop 2023-07-14T18:14:37.419 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:37.375+0000 7f20ca38e700 1 -- 172.21.15.163:0/2751311272 shutdown_connections 2023-07-14T18:14:37.419 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:37.375+0000 7f20ca38e700 1 --2- 172.21.15.163:0/2751311272 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f20c41000e0 0x7f20c41004f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:37.419 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:37.375+0000 7f20ca38e700 1 --2- 172.21.15.163:0/2751311272 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f20c40ff710 0x7f20c4106fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:37.419 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:37.375+0000 7f20ca38e700 1 --2- 172.21.15.163:0/2751311272 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f20c40fed80 0x7f20c40ff1d0 unknown :-1 s=CLOSED pgs=659 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:37.420 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:37.375+0000 7f20ca38e700 1 -- 172.21.15.163:0/2751311272 >> 172.21.15.163:0/2751311272 conn(0x7f20c40f98a0 msgr2=0x7f20c40fbcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:14:37.420 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:37.375+0000 7f20ca38e700 1 -- 172.21.15.163:0/2751311272 shutdown_connections 2023-07-14T18:14:37.420 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:37.375+0000 7f20ca38e700 1 -- 172.21.15.163:0/2751311272 wait complete. 2023-07-14T18:14:37.421 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:37.375+0000 7f20ca38e700 1 Processor -- start 2023-07-14T18:14:37.422 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:37.375+0000 7f20ca38e700 1 -- start start 2023-07-14T18:14:37.422 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:37.376+0000 7f20ca38e700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f20c40fed80 0x7f20c41947c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:14:37.422 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:37.376+0000 7f20ca38e700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f20c40ff710 0x7f20c4194d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:14:37.422 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:37.376+0000 7f20ca38e700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f20c41000e0 0x7f20c419bd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:14:37.422 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:37.376+0000 7f20ca38e700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20c419c340 con 0x7f20c41000e0 2023-07-14T18:14:37.422 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:37.376+0000 7f20ca38e700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20c419c480 con 0x7f20c40fed80 2023-07-14T18:14:37.423 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:37.376+0000 7f20ca38e700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20c419c610 con 0x7f20c40ff710 2023-07-14T18:14:37.423 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:37.376+0000 7f20c892b700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f20c41000e0 0x7f20c419bd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:14:37.423 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:37.376+0000 7f20c3fff700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f20c40fed80 0x7f20c41947c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:14:37.423 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:37.376+0000 7f20c892b700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f20c41000e0 0x7f20c419bd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:59396/0 (socket says 172.21.15.163:59396) 2023-07-14T18:14:37.423 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:37.376+0000 7f20c892b700 1 -- 172.21.15.163:0/3249856461 learned_addr learned my addr 172.21.15.163:0/3249856461 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:14:37.423 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:37.376+0000 7f20c37fe700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f20c40ff710 0x7f20c4194d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:14:37.423 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:37.376+0000 7f20c892b700 1 -- 172.21.15.163:0/3249856461 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f20c40ff710 msgr2=0x7f20c4194d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:14:37.423 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:37.376+0000 7f20c892b700 1 --2- 172.21.15.163:0/3249856461 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f20c40ff710 0x7f20c4194d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:37.424 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:37.376+0000 7f20c892b700 1 -- 172.21.15.163:0/3249856461 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f20c40fed80 msgr2=0x7f20c41947c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:14:37.424 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:37.376+0000 7f20c892b700 1 --2- 172.21.15.163:0/3249856461 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f20c40fed80 0x7f20c41947c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:37.424 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:37.376+0000 7f20c892b700 1 -- 172.21.15.163:0/3249856461 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20b80095f0 con 0x7f20c41000e0 2023-07-14T18:14:37.424 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:37.376+0000 7f20c3fff700 1 --2- 172.21.15.163:0/3249856461 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f20c40fed80 0x7f20c41947c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T18:14:37.424 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:37.376+0000 7f20c892b700 1 --2- 172.21.15.163:0/3249856461 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f20c41000e0 0x7f20c419bd70 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7f20bc00ef30 tx=0x7f20bc00c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:14:37.424 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:37.377+0000 7f20c17fa700 1 -- 172.21.15.163:0/3249856461 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20bc018070 con 0x7f20c41000e0 2023-07-14T18:14:37.424 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:37.377+0000 7f20ca38e700 1 -- 172.21.15.163:0/3249856461 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f20c419c890 con 0x7f20c41000e0 2023-07-14T18:14:37.424 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:37.377+0000 7f20c17fa700 1 -- 172.21.15.163:0/3249856461 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f20bc00f040 con 0x7f20c41000e0 2023-07-14T18:14:37.425 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:37.377+0000 7f20c17fa700 1 -- 172.21.15.163:0/3249856461 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20bc00cb80 con 0x7f20c41000e0 2023-07-14T18:14:37.425 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:37.377+0000 7f20ca38e700 1 -- 172.21.15.163:0/3249856461 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f20c419cda0 con 0x7f20c41000e0 2023-07-14T18:14:37.428 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:37.379+0000 7f20c17fa700 1 -- 172.21.15.163:0/3249856461 <== mon.0 v2:172.21.15.163:3300/0 4 ==== mgrmap(e 18) v1 ==== 135716+0+0 (secure 0 0 0) 0x7f20bc00cd60 con 0x7f20c41000e0 2023-07-14T18:14:37.428 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:37.380+0000 7f20c17fa700 1 --2- 172.21.15.163:0/3249856461 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f20ac0a1150 0x7f20ac0a3600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:14:37.428 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:37.380+0000 7f20c17fa700 1 -- 172.21.15.163:0/3249856461 <== mon.0 v2:172.21.15.163:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 9049+0+0 (secure 0 0 0) 0x7f20bc0cc6d0 con 0x7f20c41000e0 2023-07-14T18:14:37.428 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:37.380+0000 7f20c3fff700 1 --2- 172.21.15.163:0/3249856461 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f20ac0a1150 0x7f20ac0a3600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:14:37.429 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:37.380+0000 7f20c3fff700 1 --2- 172.21.15.163:0/3249856461 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f20ac0a1150 0x7f20ac0a3600 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f20c4067560 tx=0x7f20b4009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:14:37.429 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:37.381+0000 7f20d6526b80 1 Processor -- start 2023-07-14T18:14:37.429 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:37.381+0000 7f20d6526b80 1 -- start start 2023-07-14T18:14:37.429 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:37.381+0000 7f20d6526b80 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x560b87f05fe0 0x560b87f063f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:14:37.429 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:37.381+0000 7f20d6526b80 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x560b87f06930 0x560b87f06f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:14:37.429 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:37.381+0000 7f20d6526b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560b87f07530 0x560b87f079a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:14:37.429 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:37.381+0000 7f20d6526b80 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x560b87e0ad30 con 0x560b87f05fe0 2023-07-14T18:14:37.430 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:37.381+0000 7f20d6526b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x560b87e5dac0 con 0x560b87f07530 2023-07-14T18:14:37.430 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:37.381+0000 7f20d6526b80 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x560b87e56f50 con 0x560b87f06930 2023-07-14T18:14:37.430 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:37.381+0000 7f20c3fff700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x560b87f05fe0 0x560b87f063f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:14:37.430 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:37.381+0000 7f20c3fff700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x560b87f05fe0 0x560b87f063f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:59400/0 (socket says 172.21.15.163:59400) 2023-07-14T18:14:37.430 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:37.381+0000 7f20c3fff700 1 -- 172.21.15.163:0/2327573588 learned_addr learned my addr 172.21.15.163:0/2327573588 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:14:37.430 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:37.381+0000 7f20c892b700 1 --2- 172.21.15.163:0/2327573588 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560b87f07530 0x560b87f079a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:14:37.430 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:37.381+0000 7f20c37fe700 1 --2- 172.21.15.163:0/2327573588 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x560b87f06930 0x560b87f06f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:14:37.430 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:37.381+0000 7f20c3fff700 1 -- 172.21.15.163:0/2327573588 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x560b87f06930 msgr2=0x560b87f06f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:14:37.431 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:37.381+0000 7f20c3fff700 1 --2- 172.21.15.163:0/2327573588 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x560b87f06930 0x560b87f06f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:37.431 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:37.381+0000 7f20c3fff700 1 -- 172.21.15.163:0/2327573588 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560b87f07530 msgr2=0x560b87f079a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:14:37.431 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:37.381+0000 7f20c3fff700 1 --2- 172.21.15.163:0/2327573588 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560b87f07530 0x560b87f079a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:37.431 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:37.381+0000 7f20c3fff700 1 -- 172.21.15.163:0/2327573588 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560b87c84e60 con 0x560b87f05fe0 2023-07-14T18:14:37.431 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:37.381+0000 7f20c892b700 1 --2- 172.21.15.163:0/2327573588 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560b87f07530 0x560b87f079a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T18:14:37.431 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:37.382+0000 7f20c3fff700 1 --2- 172.21.15.163:0/2327573588 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x560b87f05fe0 0x560b87f063f0 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7f20b40043d0 tx=0x7f20b4014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=49499015d4003a3 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:14:37.431 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:37.382+0000 7f20aa7fc700 1 -- 172.21.15.163:0/2327573588 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20b4003ce0 con 0x560b87f05fe0 2023-07-14T18:14:37.432 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:37.382+0000 7f20aa7fc700 1 -- 172.21.15.163:0/2327573588 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f20b4003e40 con 0x560b87f05fe0 2023-07-14T18:14:37.432 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:37.382+0000 7f20aa7fc700 1 -- 172.21.15.163:0/2327573588 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20b4026780 con 0x560b87f05fe0 2023-07-14T18:14:37.432 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:37.382+0000 7f20d6526b80 1 -- 172.21.15.163:0/2327573588 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x560b87f05fe0 msgr2=0x560b87f063f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:14:37.432 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:37.382+0000 7f20d6526b80 1 --2- 172.21.15.163:0/2327573588 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x560b87f05fe0 0x560b87f063f0 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7f20b40043d0 tx=0x7f20b4014000 comp rx=0 tx=0).stop 2023-07-14T18:14:37.432 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:37.383+0000 7f20d6526b80 1 -- 172.21.15.163:0/2327573588 shutdown_connections 2023-07-14T18:14:37.432 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:37.383+0000 7f20d6526b80 1 --2- 172.21.15.163:0/2327573588 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560b87f07530 0x560b87f079a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:37.432 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:37.383+0000 7f20d6526b80 1 --2- 172.21.15.163:0/2327573588 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x560b87f05fe0 0x560b87f063f0 unknown :-1 s=CLOSED pgs=661 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:37.433 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:37.383+0000 7f20d6526b80 1 --2- 172.21.15.163:0/2327573588 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x560b87f06930 0x560b87f06f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:37.433 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:37.383+0000 7f20d6526b80 1 -- 172.21.15.163:0/2327573588 >> 172.21.15.163:0/2327573588 conn(0x560b87efb700 msgr2=0x560b87f00a50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:14:37.433 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:37.383+0000 7f20d6526b80 1 -- 172.21.15.163:0/2327573588 shutdown_connections 2023-07-14T18:14:37.433 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:37.383+0000 7f20d6526b80 1 -- 172.21.15.163:0/2327573588 wait complete. 2023-07-14T18:14:37.433 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:37.383+0000 7f20d6526b80 1 -- start start 2023-07-14T18:14:37.433 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:37.383+0000 7f20d6526b80 1 Processor -- start 2023-07-14T18:14:37.433 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:37.384+0000 7f20d6526b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560b87f05fe0 0x560b87f0fed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:14:37.434 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:37.384+0000 7f20d6526b80 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x560b87f06930 0x560b87f0e4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:14:37.434 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:37.384+0000 7f20d6526b80 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x560b87f07530 0x560b87f0ea20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:14:37.434 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:37.384+0000 7f20d6526b80 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x560b87df6b40 con 0x560b87f06930 2023-07-14T18:14:37.434 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:37.384+0000 7f20d6526b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x560b87df6840 con 0x560b87f05fe0 2023-07-14T18:14:37.434 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:37.384+0000 7f20d6526b80 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x560b87cda9a0 con 0x560b87f07530 2023-07-14T18:14:37.434 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:37.384+0000 7f20d6526b80 10 client.0 _ll_register_callbacks cb 0x560b87df47e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T18:14:37.434 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:37.384+0000 7f20c37fe700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x560b87f06930 0x560b87f0e4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:14:37.434 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:37.384+0000 7f20c3fff700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560b87f05fe0 0x560b87f0fed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:14:37.435 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:37.384+0000 7f20c892b700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x560b87f07530 0x560b87f0ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:14:37.435 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:37.384+0000 7f20c3fff700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560b87f05fe0 0x560b87f0fed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.163:60092/0 (socket says 172.21.15.163:60092) 2023-07-14T18:14:37.435 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:37.384+0000 7f20c3fff700 1 -- 172.21.15.163:0/3493040131 learned_addr learned my addr 172.21.15.163:0/3493040131 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:14:37.435 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:37.384+0000 7f20c37fe700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x560b87f06930 0x560b87f0e4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:59406/0 (socket says 172.21.15.163:59406) 2023-07-14T18:14:37.435 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:37.384+0000 7f20c37fe700 1 -- 172.21.15.163:0/3493040131 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x560b87f07530 msgr2=0x560b87f0ea20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:14:37.435 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:37.384+0000 7f20c37fe700 1 --2- 172.21.15.163:0/3493040131 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x560b87f07530 0x560b87f0ea20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:37.435 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:37.384+0000 7f20c37fe700 1 -- 172.21.15.163:0/3493040131 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560b87f05fe0 msgr2=0x560b87f0fed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:14:37.435 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:37.384+0000 7f20c37fe700 1 --2- 172.21.15.163:0/3493040131 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560b87f05fe0 0x560b87f0fed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:37.436 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:37.384+0000 7f20c37fe700 1 -- 172.21.15.163:0/3493040131 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f20c419cda0 con 0x560b87f06930 2023-07-14T18:14:37.436 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:37.384+0000 7f20c3fff700 1 --2- 172.21.15.163:0/3493040131 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560b87f05fe0 0x560b87f0fed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T18:14:37.436 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:37.384+0000 7f20c37fe700 1 --2- 172.21.15.163:0/3493040131 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x560b87f06930 0x560b87f0e4e0 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f20b8000c00 tx=0x7f20b8005270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2defb89d72c4a872 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:14:37.436 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:37.384+0000 7f20a37fe700 10 client.0 ms_handle_connect on v2:172.21.15.163:3300/0 2023-07-14T18:14:37.436 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:37.384+0000 7f20a37fe700 1 -- 172.21.15.163:0/3493040131 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20b801d070 con 0x560b87f06930 2023-07-14T18:14:37.436 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:37.385+0000 7f20a37fe700 1 -- 172.21.15.163:0/3493040131 <== mon.0 v2:172.21.15.163:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 9049+0+0 (secure 0 0 0) 0x7f20b80056c0 con 0x560b87f06930 2023-07-14T18:14:37.436 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:37.385+0000 7f20d6526b80 1 -- 172.21.15.163:0/3493040131 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x560b87db0570 con 0x560b87f06930 2023-07-14T18:14:37.436 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:37.385+0000 7f20a37fe700 1 -- 172.21.15.163:0/3493040131 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) v2 ==== 24+0+0 (secure 0 0 0) 0x7f20b8003a90 con 0x560b87f06930 2023-07-14T18:14:37.437 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:37.385+0000 7f20d6526b80 10 client.16233 fetch_fsmap learned FSMap version 31 2023-07-14T18:14:37.437 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:37.385+0000 7f20d6526b80 1 -- 172.21.15.163:0/3493040131 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) v3 -- 0x7f20b4017070 con 0x560b87f06930 2023-07-14T18:14:37.437 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:37.385+0000 7f20a37fe700 1 -- 172.21.15.163:0/3493040131 <== mon.0 v2:172.21.15.163:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x560b87db0570 con 0x560b87f06930 2023-07-14T18:14:37.438 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:37.385+0000 7f20a37fe700 1 -- 172.21.15.163:0/3493040131 <== mon.0 v2:172.21.15.163:3300/0 5 ==== fsmap(e 31) v1 ==== 7486+0+0 (secure 0 0 0) 0x7f20b8004500 con 0x560b87f06930 2023-07-14T18:14:37.438 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:37.385+0000 7f20d6526b80 10 client.16233 fetch_fsmap finished waiting for FSMap version 31 2023-07-14T18:14:37.439 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:37.385+0000 7f20d6526b80 10 client.16233 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-07-14T18:14:37.439 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:37.385+0000 7f20d6526b80 20 client.16233 populate_metadata read hostname 'smithi163' 2023-07-14T18:14:37.439 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:37.385+0000 7f20d6526b80 1 --2- 172.21.15.163:0/3493040131 >> [v2:172.21.15.172:6838/3850440096,v1:172.21.15.172:6839/3850440096] conn(0x560b87f240f0 0x560b87f26500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:14:37.439 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:37.385+0000 7f20d6526b80 4 client.16233 mds_command: new command op to 24518 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-14T18:14:37.439 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:37.385+0000 7f20d6526b80 1 -- 172.21.15.163:0/3493040131 --> [v2:172.21.15.172:6838/3850440096,v1:172.21.15.172:6839/3850440096] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x560b87ed4e20 con 0x560b87f240f0 2023-07-14T18:14:37.439 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:37.385+0000 7f20c3fff700 1 --2- 172.21.15.163:0/3493040131 >> [v2:172.21.15.172:6838/3850440096,v1:172.21.15.172:6839/3850440096] conn(0x560b87f240f0 0x560b87f26500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:14:37.439 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:37.386+0000 7f20a37fe700 10 client.16233 ms_handle_connect on v2:172.21.15.172:6838/3850440096 2023-07-14T18:14:37.440 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:37.386+0000 7f20c3fff700 1 --2- 172.21.15.163:0/3493040131 >> [v2:172.21.15.172:6838/3850440096,v1:172.21.15.172:6839/3850440096] conn(0x560b87f240f0 0x560b87f26500 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9b4e387c6b867456 server_cookie=81af059d0c7946f3 in_seq=0 out_seq=0 2023-07-14T18:14:37.440 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:37.387+0000 7f20a37fe700 1 -- 172.21.15.163:0/3493040131 <== mds.0 v2:172.21.15.172:6838/3850440096 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18017 (crc 0 0 0) 0x560b87ed4e20 con 0x560b87f240f0 2023-07-14T18:14:37.440 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:37.387+0000 7f20a37fe700 10 client.16233 handle_command_reply: tid=0 2023-07-14T18:14:37.440 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:37.387+0000 7f20d6526b80 1 client.16233 shutdown 2023-07-14T18:14:37.440 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:37.387+0000 7f20d6526b80 1 -- 172.21.15.163:0/3493040131 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x560b87f06930 msgr2=0x560b87f0e4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:14:37.440 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:37.387+0000 7f20d6526b80 1 --2- 172.21.15.163:0/3493040131 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x560b87f06930 0x560b87f0e4e0 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f20b8000c00 tx=0x7f20b8005270 comp rx=0 tx=0).stop 2023-07-14T18:14:37.440 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:37.387+0000 7f20d6526b80 1 -- 172.21.15.163:0/3493040131 shutdown_connections 2023-07-14T18:14:37.440 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:37.387+0000 7f20d6526b80 1 --2- 172.21.15.163:0/3493040131 >> [v2:172.21.15.172:6838/3850440096,v1:172.21.15.172:6839/3850440096] conn(0x560b87f240f0 0x560b87f26500 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:37.441 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:37.387+0000 7f20d6526b80 1 --2- 172.21.15.163:0/3493040131 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x560b87f07530 0x560b87f0ea20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:37.441 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:37.387+0000 7f20a37fe700 0 client.16233 ms_handle_reset on v2:172.21.15.172:6838/3850440096 2023-07-14T18:14:37.441 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:37.387+0000 7f20d6526b80 1 --2- 172.21.15.163:0/3493040131 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560b87f05fe0 0x560b87f0fed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:37.441 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:37.387+0000 7f20d6526b80 1 --2- 172.21.15.163:0/3493040131 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x560b87f06930 0x560b87f0e4e0 unknown :-1 s=CLOSED pgs=662 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:37.441 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:37.387+0000 7f20d6526b80 1 -- 172.21.15.163:0/3493040131 >> 172.21.15.163:0/3493040131 conn(0x560b87efb700 msgr2=0x560b87eff6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:14:37.441 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:37.387+0000 7f20d6526b80 1 -- 172.21.15.163:0/3493040131 shutdown_connections 2023-07-14T18:14:37.441 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:37.387+0000 7f20d6526b80 1 -- 172.21.15.163:0/3493040131 wait complete. 2023-07-14T18:14:37.441 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:37.387+0000 7f20d6526b80 20 client.16233 trim_cache size 0 max 16384 2023-07-14T18:14:37.449 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:37.405+0000 7f20d6526b80 1 Processor -- start 2023-07-14T18:14:37.449 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:37.405+0000 7f20d6526b80 1 -- start start 2023-07-14T18:14:37.450 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:37.405+0000 7f20d6526b80 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x560b87f05fe0 0x560b87f33b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:14:37.450 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:37.405+0000 7f20d6526b80 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x560b87f06930 0x560b87f0a3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:14:37.450 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:37.405+0000 7f20d6526b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560b87f07530 0x560b87f0a930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:14:37.450 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:37.405+0000 7f20d6526b80 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x560b87efb320 con 0x560b87f06930 2023-07-14T18:14:37.450 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:37.405+0000 7f20d6526b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x560b87f01540 con 0x560b87f07530 2023-07-14T18:14:37.450 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:37.405+0000 7f20d6526b80 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x560b87f23c00 con 0x560b87f05fe0 2023-07-14T18:14:37.450 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:37.405+0000 7f20c37fe700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x560b87f06930 0x560b87f0a3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:14:37.450 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:37.406+0000 7f20c37fe700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x560b87f06930 0x560b87f0a3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:59416/0 (socket says 172.21.15.163:59416) 2023-07-14T18:14:37.451 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:37.406+0000 7f20c37fe700 1 -- 172.21.15.163:0/3803629738 learned_addr learned my addr 172.21.15.163:0/3803629738 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:14:37.451 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:37.406+0000 7f20c3fff700 1 --2- 172.21.15.163:0/3803629738 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x560b87f05fe0 0x560b87f33b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:14:37.451 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:37.406+0000 7f20c892b700 1 --2- 172.21.15.163:0/3803629738 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560b87f07530 0x560b87f0a930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:14:37.451 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:37.406+0000 7f20c3fff700 1 -- 172.21.15.163:0/3803629738 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560b87f07530 msgr2=0x560b87f0a930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:14:37.451 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:37.406+0000 7f20c3fff700 1 --2- 172.21.15.163:0/3803629738 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560b87f07530 0x560b87f0a930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:37.451 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:37.406+0000 7f20c3fff700 1 -- 172.21.15.163:0/3803629738 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x560b87f06930 msgr2=0x560b87f0a3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:14:37.451 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:37.406+0000 7f20c3fff700 1 --2- 172.21.15.163:0/3803629738 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x560b87f06930 0x560b87f0a3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:37.451 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:37.406+0000 7f20c3fff700 1 -- 172.21.15.163:0/3803629738 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560b87c6dce0 con 0x560b87f05fe0 2023-07-14T18:14:37.452 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:37.406+0000 7f20c37fe700 1 --2- 172.21.15.163:0/3803629738 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x560b87f06930 0x560b87f0a3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T18:14:37.452 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:37.406+0000 7f20c3fff700 1 --2- 172.21.15.163:0/3803629738 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x560b87f05fe0 0x560b87f33b20 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f20b4011bb0 tx=0x7f20b40058e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4b870304eb93c284 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:14:37.455 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:37.406+0000 7f20aaffd700 1 -- 172.21.15.163:0/3803629738 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20b402c050 con 0x560b87f05fe0 2023-07-14T18:14:37.455 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:37.406+0000 7f20aaffd700 1 -- 172.21.15.163:0/3803629738 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f20b402d040 con 0x560b87f05fe0 2023-07-14T18:14:37.455 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:37.406+0000 7f20aaffd700 1 -- 172.21.15.163:0/3803629738 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20b4034e90 con 0x560b87f05fe0 2023-07-14T18:14:37.455 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:37.407+0000 7f20d6526b80 1 -- 172.21.15.163:0/3803629738 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x560b87f05fe0 msgr2=0x560b87f33b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:14:37.455 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:37.407+0000 7f20d6526b80 1 --2- 172.21.15.163:0/3803629738 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x560b87f05fe0 0x560b87f33b20 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f20b4011bb0 tx=0x7f20b40058e0 comp rx=0 tx=0).stop 2023-07-14T18:14:37.456 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:37.407+0000 7f20d6526b80 1 -- 172.21.15.163:0/3803629738 shutdown_connections 2023-07-14T18:14:37.456 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:37.407+0000 7f20d6526b80 1 --2- 172.21.15.163:0/3803629738 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x560b87f05fe0 0x560b87f33b20 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:37.456 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:37.407+0000 7f20d6526b80 1 --2- 172.21.15.163:0/3803629738 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560b87f07530 0x560b87f0a930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:37.456 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:37.407+0000 7f20d6526b80 1 --2- 172.21.15.163:0/3803629738 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x560b87f06930 0x560b87f0a3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:37.456 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:37.407+0000 7f20d6526b80 1 -- 172.21.15.163:0/3803629738 >> 172.21.15.163:0/3803629738 conn(0x560b87efb700 msgr2=0x560b87f0e4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:14:37.456 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:37.407+0000 7f20d6526b80 1 -- 172.21.15.163:0/3803629738 shutdown_connections 2023-07-14T18:14:37.456 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:37.407+0000 7f20d6526b80 1 -- 172.21.15.163:0/3803629738 wait complete. 2023-07-14T18:14:37.457 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:37.407+0000 7f20d6526b80 1 -- start start 2023-07-14T18:14:37.457 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:37.408+0000 7f20d6526b80 1 Processor -- start 2023-07-14T18:14:37.457 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:37.408+0000 7f20d6526b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560b87f05fe0 0x560b87f33800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:14:37.457 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:37.408+0000 7f20d6526b80 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x560b87f06930 0x560b87f31e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:14:37.457 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:37.408+0000 7f20d6526b80 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x560b87f07530 0x560b87f32350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:14:37.457 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:37.408+0000 7f20d6526b80 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x560b87f32890 con 0x560b87f06930 2023-07-14T18:14:37.457 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:37.408+0000 7f20d6526b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x560b87f32a00 con 0x560b87f05fe0 2023-07-14T18:14:37.457 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:37.408+0000 7f20d6526b80 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x560b87f32bc0 con 0x560b87f07530 2023-07-14T18:14:37.458 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:37.408+0000 7f20d6526b80 10 client.0 _ll_register_callbacks cb 0x7f20b8005bc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T18:14:37.458 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:37.408+0000 7f20c37fe700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x560b87f06930 0x560b87f31e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:14:37.458 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:37.408+0000 7f20c3fff700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560b87f05fe0 0x560b87f33800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:14:37.458 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:37.408+0000 7f20c37fe700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x560b87f06930 0x560b87f31e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:59422/0 (socket says 172.21.15.163:59422) 2023-07-14T18:14:37.458 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:37.408+0000 7f20c37fe700 1 -- 172.21.15.163:0/768842078 learned_addr learned my addr 172.21.15.163:0/768842078 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:14:37.458 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:37.408+0000 7f20c892b700 1 --2- 172.21.15.163:0/768842078 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x560b87f07530 0x560b87f32350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:14:37.458 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:37.408+0000 7f20c37fe700 1 -- 172.21.15.163:0/768842078 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x560b87f07530 msgr2=0x560b87f32350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:14:37.458 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:37.408+0000 7f20c37fe700 1 --2- 172.21.15.163:0/768842078 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x560b87f07530 0x560b87f32350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:37.459 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:37.408+0000 7f20c37fe700 1 -- 172.21.15.163:0/768842078 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560b87f05fe0 msgr2=0x560b87f33800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:14:37.459 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:37.408+0000 7f20c37fe700 1 --2- 172.21.15.163:0/768842078 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560b87f05fe0 0x560b87f33800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:37.459 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:37.408+0000 7f20c37fe700 1 -- 172.21.15.163:0/768842078 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f20b4017070 con 0x560b87f06930 2023-07-14T18:14:37.459 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:37.409+0000 7f20c37fe700 1 --2- 172.21.15.163:0/768842078 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x560b87f06930 0x560b87f31e10 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f20b8004910 tx=0x7f20b8004b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e1b09ab89c3cdc78 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:14:37.459 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:37.409+0000 7f20a37fe700 10 client.0 ms_handle_connect on v2:172.21.15.163:3300/0 2023-07-14T18:14:37.459 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:37.409+0000 7f20a37fe700 1 -- 172.21.15.163:0/768842078 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20b801d040 con 0x560b87f06930 2023-07-14T18:14:37.459 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:37.409+0000 7f20a37fe700 1 -- 172.21.15.163:0/768842078 <== mon.0 v2:172.21.15.163:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 9049+0+0 (secure 0 0 0) 0x7f20b8000e40 con 0x560b87f06930 2023-07-14T18:14:37.460 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:37.409+0000 7f20d6526b80 1 -- 172.21.15.163:0/768842078 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f20b4003e40 con 0x560b87f06930 2023-07-14T18:14:37.460 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:37.409+0000 7f20a37fe700 1 -- 172.21.15.163:0/768842078 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) v2 ==== 24+0+0 (secure 0 0 0) 0x7f20b80059d0 con 0x560b87f06930 2023-07-14T18:14:37.460 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:37.409+0000 7f20d6526b80 10 client.16239 fetch_fsmap learned FSMap version 31 2023-07-14T18:14:37.460 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:37.409+0000 7f20d6526b80 1 -- 172.21.15.163:0/768842078 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) v3 -- 0x560b87c84e60 con 0x560b87f06930 2023-07-14T18:14:37.460 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:37.409+0000 7f20a37fe700 1 -- 172.21.15.163:0/768842078 <== mon.0 v2:172.21.15.163:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f20b4003e40 con 0x560b87f06930 2023-07-14T18:14:37.460 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:37.409+0000 7f20a37fe700 1 -- 172.21.15.163:0/768842078 <== mon.0 v2:172.21.15.163:3300/0 5 ==== fsmap(e 31) v1 ==== 7486+0+0 (secure 0 0 0) 0x7f20b800b9a0 con 0x560b87f06930 2023-07-14T18:14:37.460 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:37.409+0000 7f20d6526b80 10 client.16239 fetch_fsmap finished waiting for FSMap version 31 2023-07-14T18:14:37.460 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:37.409+0000 7f20d6526b80 10 client.16239 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-07-14T18:14:37.461 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:37.409+0000 7f20d6526b80 20 client.16239 populate_metadata read hostname 'smithi163' 2023-07-14T18:14:37.461 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:37.409+0000 7f20d6526b80 1 --2- 172.21.15.163:0/768842078 >> [v2:172.21.15.172:6838/3850440096,v1:172.21.15.172:6839/3850440096] conn(0x560b87f240f0 0x560b87f7b870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:14:37.461 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:37.409+0000 7f20d6526b80 4 client.16239 mds_command: new command op to 24518 tid=0[{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2023-07-14T18:14:37.461 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:37.409+0000 7f20d6526b80 1 -- 172.21.15.163:0/768842078 --> [v2:172.21.15.172:6838/3850440096,v1:172.21.15.172:6839/3850440096] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) v1 -- 0x560b87e4ff30 con 0x560b87f240f0 2023-07-14T18:14:37.461 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:37.410+0000 7f20c3fff700 1 --2- 172.21.15.163:0/768842078 >> [v2:172.21.15.172:6838/3850440096,v1:172.21.15.172:6839/3850440096] conn(0x560b87f240f0 0x560b87f7b870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:14:37.461 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:37.410+0000 7f20a37fe700 10 client.16239 ms_handle_connect on v2:172.21.15.172:6838/3850440096 2023-07-14T18:14:37.461 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:37.410+0000 7f20c3fff700 1 --2- 172.21.15.163:0/768842078 >> [v2:172.21.15.172:6838/3850440096,v1:172.21.15.172:6839/3850440096] conn(0x560b87f240f0 0x560b87f7b870 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b1991b66af4a227d server_cookie=1cdc769da86d82ee in_seq=0 out_seq=0 2023-07-14T18:14:37.461 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:37.411+0000 7f20a37fe700 1 -- 172.21.15.163:0/768842078 <== mds.0 v2:172.21.15.172:6838/3850440096 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x560b87e4ff30 con 0x560b87f240f0 2023-07-14T18:14:37.462 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:37.411+0000 7f20a37fe700 10 client.16239 handle_command_reply: tid=0 2023-07-14T18:14:37.462 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:37.411+0000 7f20d6526b80 1 client.16239 shutdown 2023-07-14T18:14:37.462 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:37.411+0000 7f20d6526b80 1 -- 172.21.15.163:0/768842078 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x560b87f06930 msgr2=0x560b87f31e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:14:37.462 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:37.411+0000 7f20d6526b80 1 --2- 172.21.15.163:0/768842078 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x560b87f06930 0x560b87f31e10 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f20b8004910 tx=0x7f20b8004b80 comp rx=0 tx=0).stop 2023-07-14T18:14:37.462 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:37.411+0000 7f20d6526b80 1 -- 172.21.15.163:0/768842078 shutdown_connections 2023-07-14T18:14:37.462 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:37.411+0000 7f20d6526b80 1 --2- 172.21.15.163:0/768842078 >> [v2:172.21.15.172:6838/3850440096,v1:172.21.15.172:6839/3850440096] conn(0x560b87f240f0 0x560b87f7b870 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:37.462 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:37.411+0000 7f20d6526b80 1 --2- 172.21.15.163:0/768842078 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x560b87f07530 0x560b87f32350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:37.463 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:37.411+0000 7f20d6526b80 1 --2- 172.21.15.163:0/768842078 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560b87f05fe0 0x560b87f33800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:37.463 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:37.411+0000 7f20d6526b80 1 --2- 172.21.15.163:0/768842078 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x560b87f06930 0x560b87f31e10 unknown :-1 s=CLOSED pgs=663 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:37.463 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:37.411+0000 7f20d6526b80 1 -- 172.21.15.163:0/768842078 >> 172.21.15.163:0/768842078 conn(0x560b87efb700 msgr2=0x560b87f0d8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:14:37.463 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:37.411+0000 7f20a37fe700 0 client.16239 ms_handle_reset on v2:172.21.15.172:6838/3850440096 2023-07-14T18:14:37.463 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:37.412+0000 7f20d6526b80 1 -- 172.21.15.163:0/768842078 shutdown_connections 2023-07-14T18:14:37.463 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:37.412+0000 7f20d6526b80 1 -- 172.21.15.163:0/768842078 wait complete. 2023-07-14T18:14:37.463 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:37.412+0000 7f20d6526b80 20 client.16239 trim_cache size 0 max 16384 2023-07-14T18:14:37.464 INFO:teuthology.orchestra.run.smithi163.stdout:{ 2023-07-14T18:14:37.464 INFO:teuthology.orchestra.run.smithi163.stdout: "return_code": 0, 2023-07-14T18:14:37.464 INFO:teuthology.orchestra.run.smithi163.stdout: "scrub_tag": "2c53b7ef-6f30-49f0-a60d-f1f114c19d42", 2023-07-14T18:14:37.464 INFO:teuthology.orchestra.run.smithi163.stdout: "mode": "asynchronous" 2023-07-14T18:14:37.464 INFO:teuthology.orchestra.run.smithi163.stdout:} 2023-07-14T18:14:37.465 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:37.412+0000 7f20ca38e700 1 -- 172.21.15.163:0/3249856461 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f20ac0a1150 msgr2=0x7f20ac0a3600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:14:37.465 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:37.412+0000 7f20ca38e700 1 --2- 172.21.15.163:0/3249856461 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f20ac0a1150 0x7f20ac0a3600 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f20c4067560 tx=0x7f20b4009260 comp rx=0 tx=0).stop 2023-07-14T18:14:37.465 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:37.412+0000 7f20ca38e700 1 -- 172.21.15.163:0/3249856461 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f20c41000e0 msgr2=0x7f20c419bd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:14:37.465 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:37.412+0000 7f20ca38e700 1 --2- 172.21.15.163:0/3249856461 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f20c41000e0 0x7f20c419bd70 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7f20bc00ef30 tx=0x7f20bc00c3a0 comp rx=0 tx=0).stop 2023-07-14T18:14:37.465 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:37.412+0000 7f20ca38e700 1 -- 172.21.15.163:0/3249856461 shutdown_connections 2023-07-14T18:14:37.466 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:37.412+0000 7f20ca38e700 1 --2- 172.21.15.163:0/3249856461 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f20ac0a1150 0x7f20ac0a3600 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:37.466 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:37.412+0000 7f20ca38e700 1 --2- 172.21.15.163:0/3249856461 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f20c41000e0 0x7f20c419bd70 unknown :-1 s=CLOSED pgs=660 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:37.466 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:37.412+0000 7f20ca38e700 1 --2- 172.21.15.163:0/3249856461 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f20c40fed80 0x7f20c41947c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:37.466 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:37.412+0000 7f20ca38e700 1 --2- 172.21.15.163:0/3249856461 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f20c40ff710 0x7f20c4194d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:37.466 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:37.412+0000 7f20ca38e700 1 -- 172.21.15.163:0/3249856461 >> 172.21.15.163:0/3249856461 conn(0x7f20c40f98a0 msgr2=0x7f20c40fbba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:14:37.466 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:37.412+0000 7f20ca38e700 1 -- 172.21.15.163:0/3249856461 shutdown_connections 2023-07-14T18:14:37.466 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:37.412+0000 7f20ca38e700 1 -- 172.21.15.163:0/3249856461 wait complete. 2023-07-14T18:14:37.468 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-07-14T18:14:37.629 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:37.585+0000 7f8548159700 1 -- 172.21.15.163:0/1068284523 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f85401006d0 msgr2=0x7f8540106f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:14:37.629 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:37.585+0000 7f8548159700 1 --2- 172.21.15.163:0/1068284523 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f85401006d0 0x7f8540106f90 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7f853800b0a0 tx=0x7f853800b3b0 comp rx=0 tx=0).stop 2023-07-14T18:14:37.629 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:37.585+0000 7f8548159700 1 -- 172.21.15.163:0/1068284523 shutdown_connections 2023-07-14T18:14:37.629 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:37.585+0000 7f8548159700 1 --2- 172.21.15.163:0/1068284523 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f85401006d0 0x7f8540106f90 unknown :-1 s=CLOSED pgs=664 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:37.629 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:37.585+0000 7f8548159700 1 --2- 172.21.15.163:0/1068284523 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f85400feb50 0x7f85400fef60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:37.630 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:37.585+0000 7f8548159700 1 --2- 172.21.15.163:0/1068284523 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f85400ffd40 0x7f8540100190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:37.630 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:37.585+0000 7f8548159700 1 -- 172.21.15.163:0/1068284523 >> 172.21.15.163:0/1068284523 conn(0x7f85400fa150 msgr2=0x7f85400fc5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:14:37.630 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:37.585+0000 7f8548159700 1 -- 172.21.15.163:0/1068284523 shutdown_connections 2023-07-14T18:14:37.630 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:37.585+0000 7f8548159700 1 -- 172.21.15.163:0/1068284523 wait complete. 2023-07-14T18:14:37.631 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:37.586+0000 7f8548159700 1 Processor -- start 2023-07-14T18:14:37.632 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:37.586+0000 7f8548159700 1 -- start start 2023-07-14T18:14:37.632 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:37.586+0000 7f8548159700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f85400feb50 0x7f85400692e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:14:37.632 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:37.586+0000 7f8548159700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f85400ffd40 0x7f854019cb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:14:37.632 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:37.586+0000 7f8548159700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f85401006d0 0x7f854019f050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:14:37.632 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:37.586+0000 7f8548159700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f854019f730 con 0x7f85400ffd40 2023-07-14T18:14:37.632 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:37.586+0000 7f8548159700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f854019f8a0 con 0x7f85401006d0 2023-07-14T18:14:37.633 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:37.586+0000 7f8548159700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f854019fa60 con 0x7f85400feb50 2023-07-14T18:14:37.633 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:37.586+0000 7f85456f4700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f85400ffd40 0x7f854019cb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:14:37.633 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:37.586+0000 7f8545ef5700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f85400feb50 0x7f85400692e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:14:37.633 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:37.586+0000 7f85456f4700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f85400ffd40 0x7f854019cb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:59436/0 (socket says 172.21.15.163:59436) 2023-07-14T18:14:37.633 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:37.586+0000 7f85456f4700 1 -- 172.21.15.163:0/3048043316 learned_addr learned my addr 172.21.15.163:0/3048043316 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:14:37.633 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:37.586+0000 7f85466f6700 1 --2- 172.21.15.163:0/3048043316 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f85401006d0 0x7f854019f050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:14:37.633 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:37.586+0000 7f85456f4700 1 -- 172.21.15.163:0/3048043316 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f85400feb50 msgr2=0x7f85400692e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:14:37.633 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:37.586+0000 7f85456f4700 1 --2- 172.21.15.163:0/3048043316 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f85400feb50 0x7f85400692e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:37.634 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:37.586+0000 7f85456f4700 1 -- 172.21.15.163:0/3048043316 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f85401006d0 msgr2=0x7f854019f050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:14:37.634 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:37.586+0000 7f85456f4700 1 --2- 172.21.15.163:0/3048043316 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f85401006d0 0x7f854019f050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:37.634 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:37.586+0000 7f85456f4700 1 -- 172.21.15.163:0/3048043316 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8538009d00 con 0x7f85400ffd40 2023-07-14T18:14:37.634 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:37.586+0000 7f8545ef5700 1 --2- 172.21.15.163:0/3048043316 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f85400feb50 0x7f85400692e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T18:14:37.634 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:37.587+0000 7f85456f4700 1 --2- 172.21.15.163:0/3048043316 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f85400ffd40 0x7f854019cb00 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f853000e9a0 tx=0x7f853000ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:14:37.634 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:37.587+0000 7f8536ffd700 1 -- 172.21.15.163:0/3048043316 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8530009790 con 0x7f85400ffd40 2023-07-14T18:14:37.634 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:37.587+0000 7f8536ffd700 1 -- 172.21.15.163:0/3048043316 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f8530010430 con 0x7f85400ffd40 2023-07-14T18:14:37.635 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:37.587+0000 7f8536ffd700 1 -- 172.21.15.163:0/3048043316 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f853000cea0 con 0x7f85400ffd40 2023-07-14T18:14:37.635 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:37.587+0000 7f8548159700 1 -- 172.21.15.163:0/3048043316 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f854019fd40 con 0x7f85400ffd40 2023-07-14T18:14:37.635 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:37.587+0000 7f8548159700 1 -- 172.21.15.163:0/3048043316 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f85401a01a0 con 0x7f85400ffd40 2023-07-14T18:14:37.637 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:37.590+0000 7f8536ffd700 1 -- 172.21.15.163:0/3048043316 <== mon.0 v2:172.21.15.163:3300/0 4 ==== mgrmap(e 18) v1 ==== 135716+0+0 (secure 0 0 0) 0x7f85300105a0 con 0x7f85400ffd40 2023-07-14T18:14:37.637 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:37.590+0000 7f8536ffd700 1 --2- 172.21.15.163:0/3048043316 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f852c0a1150 0x7f852c0a3600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:14:37.637 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:37.591+0000 7f8536ffd700 1 -- 172.21.15.163:0/3048043316 <== mon.0 v2:172.21.15.163:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 9049+0+0 (secure 0 0 0) 0x7f8530014070 con 0x7f85400ffd40 2023-07-14T18:14:37.637 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:37.591+0000 7f8545ef5700 1 --2- 172.21.15.163:0/3048043316 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f852c0a1150 0x7f852c0a3600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:14:37.637 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:37.591+0000 7f8545ef5700 1 --2- 172.21.15.163:0/3048043316 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f852c0a1150 0x7f852c0a3600 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f85400ffba0 tx=0x7f853c009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:14:37.638 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:37.591+0000 7f85542f1b80 1 Processor -- start 2023-07-14T18:14:37.638 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:37.592+0000 7f85542f1b80 1 -- start start 2023-07-14T18:14:37.638 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:37.592+0000 7f85542f1b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559320388f60 0x559320389370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:14:37.638 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:37.592+0000 7f85542f1b80 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5593203898b0 0x559320389ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:14:37.638 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:37.592+0000 7f85542f1b80 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55932038a4b0 0x55932038a920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:14:37.638 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:37.592+0000 7f85542f1b80 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x55932028dcb0 con 0x55932038a4b0 2023-07-14T18:14:37.638 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:37.592+0000 7f85542f1b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x5593202e0a40 con 0x559320388f60 2023-07-14T18:14:37.639 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:37.592+0000 7f85542f1b80 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x5593202d9ed0 con 0x5593203898b0 2023-07-14T18:14:37.639 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:37.592+0000 7f8545ef5700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559320388f60 0x559320389370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:14:37.639 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:37.592+0000 7f85466f6700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55932038a4b0 0x55932038a920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:14:37.639 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:37.592+0000 7f8545ef5700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559320388f60 0x559320389370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.163:60126/0 (socket says 172.21.15.163:60126) 2023-07-14T18:14:37.639 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:37.592+0000 7f8545ef5700 1 -- 172.21.15.163:0/1868251538 learned_addr learned my addr 172.21.15.163:0/1868251538 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:14:37.639 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:37.592+0000 7f85456f4700 1 --2- 172.21.15.163:0/1868251538 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5593203898b0 0x559320389ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:14:37.639 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:37.592+0000 7f8545ef5700 1 -- 172.21.15.163:0/1868251538 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5593203898b0 msgr2=0x559320389ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:14:37.639 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:37.592+0000 7f8545ef5700 1 --2- 172.21.15.163:0/1868251538 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5593203898b0 0x559320389ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:37.640 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:37.592+0000 7f8545ef5700 1 -- 172.21.15.163:0/1868251538 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55932038a4b0 msgr2=0x55932038a920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:14:37.640 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:37.592+0000 7f8545ef5700 1 --2- 172.21.15.163:0/1868251538 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55932038a4b0 0x55932038a920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:37.640 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:37.592+0000 7f8545ef5700 1 -- 172.21.15.163:0/1868251538 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559320107de0 con 0x559320388f60 2023-07-14T18:14:37.640 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:37.592+0000 7f85466f6700 1 --2- 172.21.15.163:0/1868251538 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55932038a4b0 0x55932038a920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T18:14:37.640 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:37.592+0000 7f8545ef5700 1 --2- 172.21.15.163:0/1868251538 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559320388f60 0x559320389370 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f853c0043d0 tx=0x7f853c014000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d22eba0d2ab9d6d7 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:14:37.640 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:37.593+0000 7f852bfff700 1 -- 172.21.15.163:0/1868251538 <== mon.2 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f853c003ce0 con 0x559320388f60 2023-07-14T18:14:37.640 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:37.593+0000 7f852bfff700 1 -- 172.21.15.163:0/1868251538 <== mon.2 v2:172.21.15.172:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f853c003e40 con 0x559320388f60 2023-07-14T18:14:37.641 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:37.593+0000 7f852bfff700 1 -- 172.21.15.163:0/1868251538 <== mon.2 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f853c0267a0 con 0x559320388f60 2023-07-14T18:14:37.641 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:37.593+0000 7f85542f1b80 1 -- 172.21.15.163:0/1868251538 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559320388f60 msgr2=0x559320389370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:14:37.641 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:37.593+0000 7f85542f1b80 1 --2- 172.21.15.163:0/1868251538 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559320388f60 0x559320389370 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f853c0043d0 tx=0x7f853c014000 comp rx=0 tx=0).stop 2023-07-14T18:14:37.641 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:37.593+0000 7f85542f1b80 1 -- 172.21.15.163:0/1868251538 shutdown_connections 2023-07-14T18:14:37.641 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:37.593+0000 7f85542f1b80 1 --2- 172.21.15.163:0/1868251538 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55932038a4b0 0x55932038a920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:37.641 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:37.593+0000 7f85542f1b80 1 --2- 172.21.15.163:0/1868251538 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559320388f60 0x559320389370 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:37.641 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:37.593+0000 7f85542f1b80 1 --2- 172.21.15.163:0/1868251538 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5593203898b0 0x559320389ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:37.641 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:37.593+0000 7f85542f1b80 1 -- 172.21.15.163:0/1868251538 >> 172.21.15.163:0/1868251538 conn(0x55932037e680 msgr2=0x5593203839d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:14:37.642 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:37.594+0000 7f85542f1b80 1 -- 172.21.15.163:0/1868251538 shutdown_connections 2023-07-14T18:14:37.642 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:37.594+0000 7f85542f1b80 1 -- 172.21.15.163:0/1868251538 wait complete. 2023-07-14T18:14:37.644 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:37.594+0000 7f85542f1b80 1 -- start start 2023-07-14T18:14:37.645 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:37.594+0000 7f85542f1b80 1 Processor -- start 2023-07-14T18:14:37.645 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:37.594+0000 7f85542f1b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559320388f60 0x559320392960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:14:37.645 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:37.594+0000 7f85542f1b80 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5593203898b0 0x559320392ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:14:37.645 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:37.594+0000 7f85542f1b80 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55932038a4b0 0x559320399ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:14:37.645 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:37.594+0000 7f85542f1b80 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x559320279ac0 con 0x5593203898b0 2023-07-14T18:14:37.645 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:37.594+0000 7f85542f1b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x5593202797c0 con 0x559320388f60 2023-07-14T18:14:37.645 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:37.594+0000 7f85542f1b80 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x55932015d920 con 0x55932038a4b0 2023-07-14T18:14:37.645 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:37.594+0000 7f85542f1b80 10 client.0 _ll_register_callbacks cb 0x559320277760 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T18:14:37.646 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:37.594+0000 7f85456f4700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5593203898b0 0x559320392ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:14:37.646 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:37.594+0000 7f8545ef5700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559320388f60 0x559320392960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:14:37.646 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:37.594+0000 7f85456f4700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5593203898b0 0x559320392ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:59450/0 (socket says 172.21.15.163:59450) 2023-07-14T18:14:37.646 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:37.594+0000 7f85456f4700 1 -- 172.21.15.163:0/1671224238 learned_addr learned my addr 172.21.15.163:0/1671224238 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:14:37.646 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:37.595+0000 7f85466f6700 1 --2- 172.21.15.163:0/1671224238 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55932038a4b0 0x559320399ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:14:37.646 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:37.595+0000 7f85456f4700 1 -- 172.21.15.163:0/1671224238 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55932038a4b0 msgr2=0x559320399ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:14:37.646 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:37.595+0000 7f85456f4700 1 --2- 172.21.15.163:0/1671224238 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55932038a4b0 0x559320399ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:37.647 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:37.595+0000 7f85456f4700 1 -- 172.21.15.163:0/1671224238 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559320388f60 msgr2=0x559320392960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:14:37.647 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:37.595+0000 7f85456f4700 1 --2- 172.21.15.163:0/1671224238 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559320388f60 0x559320392960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:37.647 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:37.595+0000 7f85456f4700 1 -- 172.21.15.163:0/1671224238 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f85401078c0 con 0x5593203898b0 2023-07-14T18:14:37.647 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:37.595+0000 7f8545ef5700 1 --2- 172.21.15.163:0/1671224238 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559320388f60 0x559320392960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T18:14:37.647 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:37.595+0000 7f85456f4700 1 --2- 172.21.15.163:0/1671224238 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5593203898b0 0x559320392ea0 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7f853000c2d0 tx=0x7f853009a3d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f6329f5a1230ecb0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:14:37.647 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:37.595+0000 7f85297fa700 10 client.0 ms_handle_connect on v2:172.21.15.163:3300/0 2023-07-14T18:14:37.647 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:37.595+0000 7f85297fa700 1 -- 172.21.15.163:0/1671224238 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85300a2050 con 0x5593203898b0 2023-07-14T18:14:37.647 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:37.595+0000 7f85297fa700 1 -- 172.21.15.163:0/1671224238 <== mon.0 v2:172.21.15.163:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 9049+0+0 (secure 0 0 0) 0x7f853009dec0 con 0x5593203898b0 2023-07-14T18:14:37.648 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:37.595+0000 7f85542f1b80 1 -- 172.21.15.163:0/1671224238 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5593202334f0 con 0x5593203898b0 2023-07-14T18:14:37.648 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:37.595+0000 7f85297fa700 1 -- 172.21.15.163:0/1671224238 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) v2 ==== 24+0+0 (secure 0 0 0) 0x7f85300a22e0 con 0x5593203898b0 2023-07-14T18:14:37.648 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:37.595+0000 7f85542f1b80 10 client.16251 fetch_fsmap learned FSMap version 31 2023-07-14T18:14:37.648 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:37.595+0000 7f85542f1b80 1 -- 172.21.15.163:0/1671224238 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) v3 -- 0x7f853c017070 con 0x5593203898b0 2023-07-14T18:14:37.648 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:37.595+0000 7f85297fa700 1 -- 172.21.15.163:0/1671224238 <== mon.0 v2:172.21.15.163:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x5593202334f0 con 0x5593203898b0 2023-07-14T18:14:37.648 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:37.595+0000 7f85297fa700 1 -- 172.21.15.163:0/1671224238 <== mon.0 v2:172.21.15.163:3300/0 5 ==== fsmap(e 31) v1 ==== 7486+0+0 (secure 0 0 0) 0x7f85300b7fa0 con 0x5593203898b0 2023-07-14T18:14:37.648 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:37.596+0000 7f85542f1b80 10 client.16251 fetch_fsmap finished waiting for FSMap version 31 2023-07-14T18:14:37.648 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:37.596+0000 7f85542f1b80 10 client.16251 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-07-14T18:14:37.649 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:37.596+0000 7f85542f1b80 20 client.16251 populate_metadata read hostname 'smithi163' 2023-07-14T18:14:37.649 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:37.596+0000 7f85542f1b80 1 --2- 172.21.15.163:0/1671224238 >> [v2:172.21.15.172:6838/3850440096,v1:172.21.15.172:6839/3850440096] conn(0x55932039e7e0 0x5593203a0bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:14:37.649 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:37.596+0000 7f85542f1b80 4 client.16251 mds_command: new command op to 24518 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-14T18:14:37.649 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:37.596+0000 7f85542f1b80 1 -- 172.21.15.163:0/1671224238 --> [v2:172.21.15.172:6838/3850440096,v1:172.21.15.172:6839/3850440096] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x559320357da0 con 0x55932039e7e0 2023-07-14T18:14:37.649 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:37.596+0000 7f8545ef5700 1 --2- 172.21.15.163:0/1671224238 >> [v2:172.21.15.172:6838/3850440096,v1:172.21.15.172:6839/3850440096] conn(0x55932039e7e0 0x5593203a0bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:14:37.649 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:37.596+0000 7f8545ef5700 1 --2- 172.21.15.163:0/1671224238 >> [v2:172.21.15.172:6838/3850440096,v1:172.21.15.172:6839/3850440096] conn(0x55932039e7e0 0x5593203a0bf0 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bbb0bcdcb1be7c99 server_cookie=e7af4d752d53029b in_seq=0 out_seq=0 2023-07-14T18:14:37.649 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:37.596+0000 7f85297fa700 10 client.16251 ms_handle_connect on v2:172.21.15.172:6838/3850440096 2023-07-14T18:14:37.650 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:37.597+0000 7f85297fa700 1 -- 172.21.15.163:0/1671224238 <== mds.0 v2:172.21.15.172:6838/3850440096 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18017 (crc 0 0 0) 0x559320357da0 con 0x55932039e7e0 2023-07-14T18:14:37.650 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:37.597+0000 7f85297fa700 10 client.16251 handle_command_reply: tid=0 2023-07-14T18:14:37.650 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:37.597+0000 7f85542f1b80 1 client.16251 shutdown 2023-07-14T18:14:37.650 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:37.597+0000 7f85542f1b80 1 -- 172.21.15.163:0/1671224238 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5593203898b0 msgr2=0x559320392ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:14:37.650 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:37.597+0000 7f85542f1b80 1 --2- 172.21.15.163:0/1671224238 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5593203898b0 0x559320392ea0 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7f853000c2d0 tx=0x7f853009a3d0 comp rx=0 tx=0).stop 2023-07-14T18:14:37.650 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:37.597+0000 7f85542f1b80 1 -- 172.21.15.163:0/1671224238 shutdown_connections 2023-07-14T18:14:37.650 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:37.597+0000 7f85542f1b80 1 --2- 172.21.15.163:0/1671224238 >> [v2:172.21.15.172:6838/3850440096,v1:172.21.15.172:6839/3850440096] conn(0x55932039e7e0 0x5593203a0bf0 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:37.650 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:37.597+0000 7f85542f1b80 1 --2- 172.21.15.163:0/1671224238 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55932038a4b0 0x559320399ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:37.651 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:37.597+0000 7f85542f1b80 1 --2- 172.21.15.163:0/1671224238 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559320388f60 0x559320392960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:37.651 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:37.597+0000 7f85542f1b80 1 --2- 172.21.15.163:0/1671224238 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5593203898b0 0x559320392ea0 unknown :-1 s=CLOSED pgs=666 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:37.651 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:37.597+0000 7f85297fa700 0 client.16251 ms_handle_reset on v2:172.21.15.172:6838/3850440096 2023-07-14T18:14:37.651 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:37.597+0000 7f85542f1b80 1 -- 172.21.15.163:0/1671224238 >> 172.21.15.163:0/1671224238 conn(0x55932037e680 msgr2=0x559320382650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:14:37.651 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:37.597+0000 7f85542f1b80 1 -- 172.21.15.163:0/1671224238 shutdown_connections 2023-07-14T18:14:37.651 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:37.598+0000 7f85542f1b80 1 -- 172.21.15.163:0/1671224238 wait complete. 2023-07-14T18:14:37.651 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:37.598+0000 7f85542f1b80 20 client.16251 trim_cache size 0 max 16384 2023-07-14T18:14:37.661 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:37.617+0000 7f85542f1b80 1 Processor -- start 2023-07-14T18:14:37.661 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:37.617+0000 7f85542f1b80 1 -- start start 2023-07-14T18:14:37.661 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:37.617+0000 7f85542f1b80 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x559320388f60 0x55932037fb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:14:37.662 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:37.617+0000 7f85542f1b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5593203898b0 0x559320399ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:14:37.662 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:37.617+0000 7f85542f1b80 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55932038a4b0 0x5593203830f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:14:37.662 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:37.617+0000 7f85542f1b80 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x559320384e90 con 0x55932038a4b0 2023-07-14T18:14:37.662 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:37.617+0000 7f85542f1b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x559320392500 con 0x5593203898b0 2023-07-14T18:14:37.662 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:37.617+0000 7f85542f1b80 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x55932039bba0 con 0x559320388f60 2023-07-14T18:14:37.662 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:37.617+0000 7f85466f6700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55932038a4b0 0x5593203830f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:14:37.662 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:37.617+0000 7f85466f6700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55932038a4b0 0x5593203830f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:59460/0 (socket says 172.21.15.163:59460) 2023-07-14T18:14:37.663 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:37.617+0000 7f85466f6700 1 -- 172.21.15.163:0/650533469 learned_addr learned my addr 172.21.15.163:0/650533469 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:14:37.663 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:37.617+0000 7f85456f4700 1 --2- 172.21.15.163:0/650533469 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5593203898b0 0x559320399ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:14:37.663 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:37.617+0000 7f8545ef5700 1 --2- 172.21.15.163:0/650533469 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x559320388f60 0x55932037fb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:14:37.663 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:37.618+0000 7f85466f6700 1 -- 172.21.15.163:0/650533469 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x559320388f60 msgr2=0x55932037fb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:14:37.663 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:37.618+0000 7f85466f6700 1 --2- 172.21.15.163:0/650533469 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x559320388f60 0x55932037fb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:37.663 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:37.618+0000 7f85466f6700 1 -- 172.21.15.163:0/650533469 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5593203898b0 msgr2=0x559320399ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:14:37.663 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:37.618+0000 7f85466f6700 1 --2- 172.21.15.163:0/650533469 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5593203898b0 0x559320399ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:37.663 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:37.618+0000 7f85466f6700 1 -- 172.21.15.163:0/650533469 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5593200f0c60 con 0x55932038a4b0 2023-07-14T18:14:37.664 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:37.618+0000 7f85456f4700 1 --2- 172.21.15.163:0/650533469 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5593203898b0 0x559320399ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T18:14:37.664 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:37.618+0000 7f8545ef5700 1 --2- 172.21.15.163:0/650533469 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x559320388f60 0x55932037fb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T18:14:37.664 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:37.618+0000 7f85466f6700 1 --2- 172.21.15.163:0/650533469 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55932038a4b0 0x5593203830f0 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7f8538009600 tx=0x7f85380074e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3dbe4d65ba9e541e server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:14:37.664 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:37.618+0000 7f8534ff9700 1 -- 172.21.15.163:0/650533469 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f853800e040 con 0x55932038a4b0 2023-07-14T18:14:37.664 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:37.618+0000 7f8534ff9700 1 -- 172.21.15.163:0/650533469 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f853800ba50 con 0x55932038a4b0 2023-07-14T18:14:37.664 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:37.618+0000 7f8534ff9700 1 -- 172.21.15.163:0/650533469 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85380052a0 con 0x55932038a4b0 2023-07-14T18:14:37.667 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:37.619+0000 7f85542f1b80 1 -- 172.21.15.163:0/650533469 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55932038a4b0 msgr2=0x5593203830f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:14:37.668 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:37.619+0000 7f85542f1b80 1 --2- 172.21.15.163:0/650533469 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55932038a4b0 0x5593203830f0 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7f8538009600 tx=0x7f85380074e0 comp rx=0 tx=0).stop 2023-07-14T18:14:37.668 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:37.619+0000 7f85542f1b80 1 -- 172.21.15.163:0/650533469 shutdown_connections 2023-07-14T18:14:37.668 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:37.619+0000 7f85542f1b80 1 --2- 172.21.15.163:0/650533469 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x559320388f60 0x55932037fb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:37.668 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:37.619+0000 7f85542f1b80 1 --2- 172.21.15.163:0/650533469 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55932038a4b0 0x5593203830f0 unknown :-1 s=CLOSED pgs=667 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:37.668 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:37.619+0000 7f85542f1b80 1 --2- 172.21.15.163:0/650533469 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5593203898b0 0x559320399ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:37.668 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:37.619+0000 7f85542f1b80 1 -- 172.21.15.163:0/650533469 >> 172.21.15.163:0/650533469 conn(0x55932037e680 msgr2=0x5593203839a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:14:37.669 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:37.619+0000 7f85542f1b80 1 -- 172.21.15.163:0/650533469 shutdown_connections 2023-07-14T18:14:37.669 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:37.619+0000 7f85542f1b80 1 -- 172.21.15.163:0/650533469 wait complete. 2023-07-14T18:14:37.669 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:37.619+0000 7f85542f1b80 1 -- start start 2023-07-14T18:14:37.669 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:37.619+0000 7f85542f1b80 1 Processor -- start 2023-07-14T18:14:37.669 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:37.619+0000 7f85542f1b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559320388f60 0x559320399c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:14:37.669 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:37.620+0000 7f85542f1b80 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5593203898b0 0x5593203966b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:14:37.669 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:37.620+0000 7f85542f1b80 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55932038a4b0 0x559320396bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:14:37.669 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:37.620+0000 7f85542f1b80 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x559320397130 con 0x5593203898b0 2023-07-14T18:14:37.670 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:37.620+0000 7f85542f1b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x5593203972a0 con 0x559320388f60 2023-07-14T18:14:37.670 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:37.620+0000 7f85542f1b80 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x5593203f2470 con 0x55932038a4b0 2023-07-14T18:14:37.670 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:37.620+0000 7f85542f1b80 10 client.0 _ll_register_callbacks cb 0x7f85300999f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T18:14:37.670 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:37.620+0000 7f85456f4700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5593203898b0 0x5593203966b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:14:37.670 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:37.620+0000 7f8545ef5700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559320388f60 0x559320399c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:14:37.670 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:37.620+0000 7f85456f4700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5593203898b0 0x5593203966b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:59464/0 (socket says 172.21.15.163:59464) 2023-07-14T18:14:37.670 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:37.620+0000 7f85456f4700 1 -- 172.21.15.163:0/4050893836 learned_addr learned my addr 172.21.15.163:0/4050893836 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:14:37.670 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:37.620+0000 7f85466f6700 1 --2- 172.21.15.163:0/4050893836 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55932038a4b0 0x559320396bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:14:37.671 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:37.620+0000 7f85456f4700 1 -- 172.21.15.163:0/4050893836 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55932038a4b0 msgr2=0x559320396bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:14:37.671 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:37.620+0000 7f85456f4700 1 --2- 172.21.15.163:0/4050893836 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55932038a4b0 0x559320396bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:37.671 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:37.620+0000 7f85456f4700 1 -- 172.21.15.163:0/4050893836 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559320388f60 msgr2=0x559320399c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:14:37.671 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:37.620+0000 7f85456f4700 1 --2- 172.21.15.163:0/4050893836 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559320388f60 0x559320399c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:37.671 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:37.620+0000 7f85456f4700 1 -- 172.21.15.163:0/4050893836 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x559320107de0 con 0x5593203898b0 2023-07-14T18:14:37.671 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:37.620+0000 7f85456f4700 1 --2- 172.21.15.163:0/4050893836 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5593203898b0 0x5593203966b0 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f85300968b0 tx=0x7f8530096050 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be6680907d6debc3 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:14:37.671 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:37.620+0000 7f85297fa700 10 client.0 ms_handle_connect on v2:172.21.15.163:3300/0 2023-07-14T18:14:37.672 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:37.620+0000 7f85297fa700 1 -- 172.21.15.163:0/4050893836 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f853009dec0 con 0x5593203898b0 2023-07-14T18:14:37.672 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:37.620+0000 7f85297fa700 1 -- 172.21.15.163:0/4050893836 <== mon.0 v2:172.21.15.163:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 9049+0+0 (secure 0 0 0) 0x7f85300a22e0 con 0x5593203898b0 2023-07-14T18:14:37.672 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:37.620+0000 7f85542f1b80 1 -- 172.21.15.163:0/4050893836 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f853c003e40 con 0x5593203898b0 2023-07-14T18:14:37.672 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:37.620+0000 7f85297fa700 1 -- 172.21.15.163:0/4050893836 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) v2 ==== 24+0+0 (secure 0 0 0) 0x7f85300adb90 con 0x5593203898b0 2023-07-14T18:14:37.672 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:37.621+0000 7f85542f1b80 10 client.16257 fetch_fsmap learned FSMap version 31 2023-07-14T18:14:37.672 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:37.621+0000 7f85542f1b80 1 -- 172.21.15.163:0/4050893836 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) v3 -- 0x7f853c017070 con 0x5593203898b0 2023-07-14T18:14:37.672 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:37.621+0000 7f85297fa700 1 -- 172.21.15.163:0/4050893836 <== mon.0 v2:172.21.15.163:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f853c003e40 con 0x5593203898b0 2023-07-14T18:14:37.672 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:37.621+0000 7f85297fa700 1 -- 172.21.15.163:0/4050893836 <== mon.0 v2:172.21.15.163:3300/0 5 ==== fsmap(e 31) v1 ==== 7486+0+0 (secure 0 0 0) 0x7f8530094aa0 con 0x5593203898b0 2023-07-14T18:14:37.673 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:37.621+0000 7f85542f1b80 10 client.16257 fetch_fsmap finished waiting for FSMap version 31 2023-07-14T18:14:37.673 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:37.621+0000 7f85542f1b80 10 client.16257 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-07-14T18:14:37.673 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:37.621+0000 7f85542f1b80 20 client.16257 populate_metadata read hostname 'smithi163' 2023-07-14T18:14:37.673 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:37.621+0000 7f85542f1b80 1 --2- 172.21.15.163:0/4050893836 >> [v2:172.21.15.172:6838/3850440096,v1:172.21.15.172:6839/3850440096] conn(0x5593203f3cd0 0x5593203f60e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:14:37.673 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:37.621+0000 7f85542f1b80 4 client.16257 mds_command: new command op to 24518 tid=0[{"prefix": "scrub status"}] 2023-07-14T18:14:37.673 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:37.621+0000 7f85542f1b80 1 -- 172.21.15.163:0/4050893836 --> [v2:172.21.15.172:6838/3850440096,v1:172.21.15.172:6839/3850440096] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x5593202d2eb0 con 0x5593203f3cd0 2023-07-14T18:14:37.673 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:37.621+0000 7f8545ef5700 1 --2- 172.21.15.163:0/4050893836 >> [v2:172.21.15.172:6838/3850440096,v1:172.21.15.172:6839/3850440096] conn(0x5593203f3cd0 0x5593203f60e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:14:37.673 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:37.622+0000 7f85297fa700 10 client.16257 ms_handle_connect on v2:172.21.15.172:6838/3850440096 2023-07-14T18:14:37.674 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:37.622+0000 7f8545ef5700 1 --2- 172.21.15.163:0/4050893836 >> [v2:172.21.15.172:6838/3850440096,v1:172.21.15.172:6839/3850440096] conn(0x5593203f3cd0 0x5593203f60e0 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b5a2f30d637cf1e8 server_cookie=ad486a6ba5668482 in_seq=0 out_seq=0 2023-07-14T18:14:37.674 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:37.622+0000 7f85297fa700 1 -- 172.21.15.163:0/4050893836 <== mds.0 v2:172.21.15.172:6838/3850440096 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+268 (crc 0 0 0) 0x5593202d2eb0 con 0x5593203f3cd0 2023-07-14T18:14:37.674 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:37.622+0000 7f85297fa700 10 client.16257 handle_command_reply: tid=0 2023-07-14T18:14:37.674 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:37.622+0000 7f85542f1b80 1 client.16257 shutdown 2023-07-14T18:14:37.674 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:37.622+0000 7f85542f1b80 1 -- 172.21.15.163:0/4050893836 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5593203898b0 msgr2=0x5593203966b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:14:37.674 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:37.622+0000 7f85542f1b80 1 --2- 172.21.15.163:0/4050893836 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5593203898b0 0x5593203966b0 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f85300968b0 tx=0x7f8530096050 comp rx=0 tx=0).stop 2023-07-14T18:14:37.674 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:37.622+0000 7f85542f1b80 1 -- 172.21.15.163:0/4050893836 shutdown_connections 2023-07-14T18:14:37.675 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:37.622+0000 7f85542f1b80 1 --2- 172.21.15.163:0/4050893836 >> [v2:172.21.15.172:6838/3850440096,v1:172.21.15.172:6839/3850440096] conn(0x5593203f3cd0 0x5593203f60e0 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:37.675 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:37.622+0000 7f85542f1b80 1 --2- 172.21.15.163:0/4050893836 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55932038a4b0 0x559320396bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:37.675 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:37.622+0000 7f85297fa700 0 client.16257 ms_handle_reset on v2:172.21.15.172:6838/3850440096 2023-07-14T18:14:37.675 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:37.622+0000 7f85542f1b80 1 --2- 172.21.15.163:0/4050893836 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559320388f60 0x559320399c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:37.675 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:37.622+0000 7f85542f1b80 1 --2- 172.21.15.163:0/4050893836 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5593203898b0 0x5593203966b0 unknown :-1 s=CLOSED pgs=668 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:37.675 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:37.622+0000 7f85542f1b80 1 -- 172.21.15.163:0/4050893836 >> 172.21.15.163:0/4050893836 conn(0x55932037e680 msgr2=0x55932038d330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:14:37.675 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:37.623+0000 7f85542f1b80 1 -- 172.21.15.163:0/4050893836 shutdown_connections 2023-07-14T18:14:37.675 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:37.623+0000 7f85542f1b80 1 -- 172.21.15.163:0/4050893836 wait complete. 2023-07-14T18:14:37.676 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:37.623+0000 7f85542f1b80 20 client.16257 trim_cache size 0 max 16384 2023-07-14T18:14:37.676 INFO:teuthology.orchestra.run.smithi163.stdout:{ 2023-07-14T18:14:37.676 INFO:teuthology.orchestra.run.smithi163.stdout: "status": "scrub active (1311 inodes in the stack)", 2023-07-14T18:14:37.676 INFO:teuthology.orchestra.run.smithi163.stdout: "scrubs": { 2023-07-14T18:14:37.676 INFO:teuthology.orchestra.run.smithi163.stdout: "2c53b7ef-6f30-49f0-a60d-f1f114c19d42": { 2023-07-14T18:14:37.676 INFO:teuthology.orchestra.run.smithi163.stdout: "path": "/", 2023-07-14T18:14:37.677 INFO:teuthology.orchestra.run.smithi163.stdout: "tag": "2c53b7ef-6f30-49f0-a60d-f1f114c19d42", 2023-07-14T18:14:37.677 INFO:teuthology.orchestra.run.smithi163.stdout: "options": "recursive,force" 2023-07-14T18:14:37.677 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-07-14T18:14:37.677 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-07-14T18:14:37.677 INFO:teuthology.orchestra.run.smithi163.stdout:} 2023-07-14T18:14:37.678 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:37.623+0000 7f8548159700 1 -- 172.21.15.163:0/3048043316 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f852c0a1150 msgr2=0x7f852c0a3600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:14:37.678 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:37.623+0000 7f8548159700 1 --2- 172.21.15.163:0/3048043316 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f852c0a1150 0x7f852c0a3600 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f85400ffba0 tx=0x7f853c009260 comp rx=0 tx=0).stop 2023-07-14T18:14:37.678 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:37.623+0000 7f8548159700 1 -- 172.21.15.163:0/3048043316 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f85400ffd40 msgr2=0x7f854019cb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:14:37.678 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:37.623+0000 7f8548159700 1 --2- 172.21.15.163:0/3048043316 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f85400ffd40 0x7f854019cb00 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f853000e9a0 tx=0x7f853000ecb0 comp rx=0 tx=0).stop 2023-07-14T18:14:37.678 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:37.623+0000 7f8548159700 1 -- 172.21.15.163:0/3048043316 shutdown_connections 2023-07-14T18:14:37.679 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:37.623+0000 7f8548159700 1 --2- 172.21.15.163:0/3048043316 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f852c0a1150 0x7f852c0a3600 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:37.679 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:37.623+0000 7f8548159700 1 --2- 172.21.15.163:0/3048043316 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f85400feb50 0x7f85400692e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:37.679 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:37.623+0000 7f8548159700 1 --2- 172.21.15.163:0/3048043316 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f85401006d0 0x7f854019f050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:37.679 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:37.623+0000 7f8548159700 1 --2- 172.21.15.163:0/3048043316 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f85400ffd40 0x7f854019cb00 unknown :-1 s=CLOSED pgs=665 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:14:37.679 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:37.623+0000 7f8548159700 1 -- 172.21.15.163:0/3048043316 >> 172.21.15.163:0/3048043316 conn(0x7f85400fa150 msgr2=0x7f8540103230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:14:37.679 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:37.623+0000 7f8548159700 1 -- 172.21.15.163:0/3048043316 shutdown_connections 2023-07-14T18:14:37.679 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:14:37.623+0000 7f8548159700 1 -- 172.21.15.163:0/3048043316 wait complete. 2023-07-14T18:14:37.680 INFO:tasks.cephfs.filesystem:scrub status for tag:2c53b7ef-6f30-49f0-a60d-f1f114c19d42 - {'path': '/', 'tag': '2c53b7ef-6f30-49f0-a60d-f1f114c19d42', 'options': 'recursive,force'} 2023-07-14T18:14:38.927 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:14:38 smithi184 ceph-mon[98481]: scrub queued for path: / 2023-07-14T18:14:38.928 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:14:38 smithi184 ceph-mon[98481]: scrub summary: idle+waiting paths [/] 2023-07-14T18:14:38.928 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:14:38 smithi184 ceph-mon[98481]: scrub summary: active paths [/] 2023-07-14T18:14:38.928 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:14:38 smithi184 ceph-mon[98481]: scrub summary: active paths [/] 2023-07-14T18:14:38.928 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:14:38 smithi184 ceph-mon[98481]: scrub summary: active paths [/] 2023-07-14T18:14:38.928 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:14:38 smithi184 ceph-mon[98481]: scrub summary: idle+waiting paths [/] 2023-07-14T18:14:38.928 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:14:38 smithi184 ceph-mon[98481]: scrub summary: active paths [/] 2023-07-14T18:14:38.928 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:14:38 smithi184 ceph-mon[98481]: scrub summary: idle+waiting paths [/] 2023-07-14T18:14:38.929 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:14:38 smithi184 ceph-mon[98481]: scrub summary: active paths [/] 2023-07-14T18:14:38.929 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:14:38 smithi184 ceph-mon[98481]: scrub summary: idle+waiting paths [/] 2023-07-14T18:14:38.929 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:14:38 smithi184 ceph-mon[98481]: scrub summary: active paths [/] 2023-07-14T18:14:38.929 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:14:38 smithi184 ceph-mon[98481]: scrub summary: idle+waiting paths [/] 2023-07-14T18:14:38.929 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:14:38 smithi184 ceph-mon[98481]: scrub summary: active paths [/] 2023-07-14T18:14:38.929 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:14:38 smithi184 ceph-mon[98481]: scrub summary: idle+waiting paths [/] 2023-07-14T18:14:38.929 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:14:38 smithi184 ceph-mon[98481]: pgmap v359: 129 pgs: 129 active+clean; 53 MiB data, 585 MiB used, 1.0 TiB / 1.0 TiB avail; 1011 KiB/s rd, 1.2 MiB/s wr, 350 op/s 2023-07-14T18:14:38.930 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:14:38 smithi184 ceph-mon[98481]: scrub summary: idle+waiting paths [/] 2023-07-14T18:14:38.930 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:14:38 smithi184 ceph-mon[98481]: scrub summary: active paths [/] 2023-07-14T18:14:38.930 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:14:38 smithi184 ceph-mon[98481]: scrub summary: active paths [/] 2023-07-14T18:14:38.930 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:14:38 smithi184 ceph-mon[98481]: scrub summary: active paths [/] 2023-07-14T18:14:38.930 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:14:38 smithi184 ceph-mon[98481]: scrub summary: active paths [/] 2023-07-14T18:14:38.930 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:14:38 smithi184 ceph-mon[98481]: scrub summary: idle+waiting paths [/] 2023-07-14T18:14:38.930 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:14:38 smithi184 ceph-mon[98481]: scrub summary: active paths [/] 2023-07-14T18:14:38.930 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:14:38 smithi184 ceph-mon[98481]: scrub summary: idle+waiting paths [/] 2023-07-14T18:14:38.931 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:14:38 smithi184 ceph-mon[98481]: scrub summary: idle+waiting paths [/] 2023-07-14T18:14:38.931 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:14:38 smithi184 ceph-mon[98481]: scrub summary: idle+waiting paths [/] 2023-07-14T18:14:38.931 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:14:38 smithi184 ceph-mon[98481]: scrub summary: idle+waiting paths [/] 2023-07-14T18:14:38.970 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:14:38 smithi163 ceph-mon[96576]: scrub queued for path: / 2023-07-14T18:14:38.970 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:14:38 smithi163 ceph-mon[96576]: scrub summary: idle+waiting paths [/] 2023-07-14T18:14:38.970 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:14:38 smithi163 ceph-mon[96576]: scrub summary: active paths [/] 2023-07-14T18:14:38.970 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:14:38 smithi163 ceph-mon[96576]: scrub summary: active paths [/] 2023-07-14T18:14:38.971 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:14:38 smithi163 ceph-mon[96576]: scrub summary: active paths [/] 2023-07-14T18:14:38.971 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:14:38 smithi163 ceph-mon[96576]: scrub summary: idle+waiting paths [/] 2023-07-14T18:14:38.971 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:14:38 smithi163 ceph-mon[96576]: scrub summary: active paths [/] 2023-07-14T18:14:38.971 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:14:38 smithi163 ceph-mon[96576]: scrub summary: idle+waiting paths [/] 2023-07-14T18:14:38.971 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:14:38 smithi163 ceph-mon[96576]: scrub summary: active paths [/] 2023-07-14T18:14:38.971 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:14:38 smithi163 ceph-mon[96576]: scrub summary: idle+waiting paths [/] 2023-07-14T18:14:38.971 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:14:38 smithi163 ceph-mon[96576]: scrub summary: active paths [/] 2023-07-14T18:14:38.971 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:14:38 smithi163 ceph-mon[96576]: scrub summary: idle+waiting paths [/] 2023-07-14T18:14:38.972 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:14:38 smithi163 ceph-mon[96576]: scrub summary: active paths [/] 2023-07-14T18:14:38.972 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:14:38 smithi163 ceph-mon[96576]: scrub summary: idle+waiting paths [/] 2023-07-14T18:14:38.972 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:14:38 smithi163 ceph-mon[96576]: pgmap v359: 129 pgs: 129 active+clean; 53 MiB data, 585 MiB used, 1.0 TiB / 1.0 TiB avail; 1011 KiB/s rd, 1.2 MiB/s wr, 350 op/s 2023-07-14T18:14:38.972 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:14:38 smithi163 ceph-mon[96576]: scrub summary: idle+waiting paths [/] 2023-07-14T18:14:38.972 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:14:38 smithi163 ceph-mon[96576]: scrub summary: active paths [/] 2023-07-14T18:14:38.973 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:14:38 smithi163 ceph-mon[96576]: scrub summary: active paths [/] 2023-07-14T18:14:38.973 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:14:38 smithi163 ceph-mon[96576]: scrub summary: active paths [/] 2023-07-14T18:14:38.973 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:14:38 smithi163 ceph-mon[96576]: scrub summary: active paths [/] 2023-07-14T18:14:38.973 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:14:38 smithi163 ceph-mon[96576]: scrub summary: idle+waiting paths [/] 2023-07-14T18:14:38.974 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:14:38 smithi163 ceph-mon[96576]: scrub summary: active paths [/] 2023-07-14T18:14:38.974 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:14:38 smithi163 ceph-mon[96576]: scrub summary: idle+waiting paths [/] 2023-07-14T18:14:38.974 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:14:38 smithi163 ceph-mon[96576]: scrub summary: idle+waiting paths [/] 2023-07-14T18:14:38.974 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:14:38 smithi163 ceph-mon[96576]: scrub summary: idle+waiting paths [/] 2023-07-14T18:14:38.974 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:14:38 smithi163 ceph-mon[96576]: scrub summary: idle+waiting paths [/] 2023-07-14T18:14:39.028 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:14:38 smithi172 ceph-mon[97983]: scrub queued for path: / 2023-07-14T18:14:39.028 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:14:38 smithi172 ceph-mon[97983]: scrub summary: idle+waiting paths [/] 2023-07-14T18:14:39.029 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:14:38 smithi172 ceph-mon[97983]: scrub summary: active paths [/] 2023-07-14T18:14:39.029 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:14:38 smithi172 ceph-mon[97983]: scrub summary: active paths [/] 2023-07-14T18:14:39.029 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:14:38 smithi172 ceph-mon[97983]: scrub summary: active paths [/] 2023-07-14T18:14:39.029 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:14:38 smithi172 ceph-mon[97983]: scrub summary: idle+waiting paths [/] 2023-07-14T18:14:39.029 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:14:38 smithi172 ceph-mon[97983]: scrub summary: active paths [/] 2023-07-14T18:14:39.029 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:14:38 smithi172 ceph-mon[97983]: scrub summary: idle+waiting paths [/] 2023-07-14T18:14:39.029 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:14:38 smithi172 ceph-mon[97983]: scrub summary: active paths [/] 2023-07-14T18:14:39.029 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:14:38 smithi172 ceph-mon[97983]: scrub summary: idle+waiting paths [/] 2023-07-14T18:14:39.030 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:14:38 smithi172 ceph-mon[97983]: scrub summary: active paths [/] 2023-07-14T18:14:39.030 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:14:38 smithi172 ceph-mon[97983]: scrub summary: idle+waiting paths [/] 2023-07-14T18:14:39.030 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:14:38 smithi172 ceph-mon[97983]: scrub summary: active paths [/] 2023-07-14T18:14:39.030 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:14:38 smithi172 ceph-mon[97983]: scrub summary: idle+waiting paths [/] 2023-07-14T18:14:39.030 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:14:38 smithi172 ceph-mon[97983]: pgmap v359: 129 pgs: 129 active+clean; 53 MiB data, 585 MiB used, 1.0 TiB / 1.0 TiB avail; 1011 KiB/s rd, 1.2 MiB/s wr, 350 op/s 2023-07-14T18:14:39.030 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:14:38 smithi172 ceph-mon[97983]: scrub summary: idle+waiting paths [/] 2023-07-14T18:14:39.030 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:14:38 smithi172 ceph-mon[97983]: scrub summary: active paths [/] 2023-07-14T18:14:39.031 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:14:38 smithi172 ceph-mon[97983]: scrub summary: active paths [/] 2023-07-14T18:14:39.031 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:14:38 smithi172 ceph-mon[97983]: scrub summary: active paths [/] 2023-07-14T18:14:39.031 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:14:38 smithi172 ceph-mon[97983]: scrub summary: active paths [/] 2023-07-14T18:14:39.031 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:14:38 smithi172 ceph-mon[97983]: scrub summary: idle+waiting paths [/] 2023-07-14T18:14:39.031 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:14:38 smithi172 ceph-mon[97983]: scrub summary: active paths [/] 2023-07-14T18:14:39.031 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:14:38 smithi172 ceph-mon[97983]: scrub summary: idle+waiting paths [/] 2023-07-14T18:14:39.031 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:14:38 smithi172 ceph-mon[97983]: scrub summary: idle+waiting paths [/] 2023-07-14T18:14:39.031 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:14:38 smithi172 ceph-mon[97983]: scrub summary: idle+waiting paths [/] 2023-07-14T18:14:39.032 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:14:38 smithi172 ceph-mon[97983]: scrub summary: idle+waiting paths [/] 2023-07-14T18:14:40.927 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:14:40 smithi184 ceph-mon[98481]: pgmap v360: 129 pgs: 129 active+clean; 53 MiB data, 602 MiB used, 1.0 TiB / 1.0 TiB avail; 775 KiB/s rd, 954 KiB/s wr, 297 op/s 2023-07-14T18:14:40.970 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:14:40 smithi163 ceph-mon[96576]: pgmap v360: 129 pgs: 129 active+clean; 53 MiB data, 602 MiB used, 1.0 TiB / 1.0 TiB avail; 775 KiB/s rd, 954 KiB/s wr, 297 op/s 2023-07-14T18:14:41.028 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:14:40 smithi172 ceph-mon[97983]: pgmap v360: 129 pgs: 129 active+clean; 53 MiB data, 602 MiB used, 1.0 TiB / 1.0 TiB avail; 775 KiB/s rd, 954 KiB/s wr, 297 op/s 2023-07-14T18:14:43.177 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:14:42 smithi184 ceph-mon[98481]: pgmap v361: 129 pgs: 129 active+clean; 57 MiB data, 627 MiB used, 1.0 TiB / 1.0 TiB avail; 976 KiB/s rd, 1.1 MiB/s wr, 299 op/s 2023-07-14T18:14:43.220 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:14:42 smithi163 ceph-mon[96576]: pgmap v361: 129 pgs: 129 active+clean; 57 MiB data, 627 MiB used, 1.0 TiB / 1.0 TiB avail; 976 KiB/s rd, 1.1 MiB/s wr, 299 op/s 2023-07-14T18:14:43.278 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:14:42 smithi172 ceph-mon[97983]: pgmap v361: 129 pgs: 129 active+clean; 57 MiB data, 627 MiB used, 1.0 TiB / 1.0 TiB avail; 976 KiB/s rd, 1.1 MiB/s wr, 299 op/s 2023-07-14T18:14:45.177 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:14:44 smithi184 ceph-mon[98481]: pgmap v362: 129 pgs: 129 active+clean; 58 MiB data, 601 MiB used, 1.0 TiB / 1.0 TiB avail; 799 KiB/s rd, 988 KiB/s wr, 248 op/s 2023-07-14T18:14:45.220 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:14:44 smithi163 ceph-mon[96576]: pgmap v362: 129 pgs: 129 active+clean; 58 MiB data, 601 MiB used, 1.0 TiB / 1.0 TiB avail; 799 KiB/s rd, 988 KiB/s wr, 248 op/s 2023-07-14T18:14:45.278 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:14:44 smithi172 ceph-mon[97983]: pgmap v362: 129 pgs: 129 active+clean; 58 MiB data, 601 MiB used, 1.0 TiB / 1.0 TiB avail; 799 KiB/s rd, 988 KiB/s wr, 248 op/s 2023-07-14T18:14:47.177 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:14:46 smithi184 ceph-mon[98481]: pgmap v363: 129 pgs: 129 active+clean; 62 MiB data, 626 MiB used, 1.0 TiB / 1.0 TiB avail; 910 KiB/s rd, 1.2 MiB/s wr, 248 op/s 2023-07-14T18:14:47.220 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:14:46 smithi163 ceph-mon[96576]: pgmap v363: 129 pgs: 129 active+clean; 62 MiB data, 626 MiB used, 1.0 TiB / 1.0 TiB avail; 910 KiB/s rd, 1.2 MiB/s wr, 248 op/s 2023-07-14T18:14:47.278 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:14:46 smithi172 ceph-mon[97983]: pgmap v363: 129 pgs: 129 active+clean; 62 MiB data, 626 MiB used, 1.0 TiB / 1.0 TiB avail; 910 KiB/s rd, 1.2 MiB/s wr, 248 op/s 2023-07-14T18:14:49.177 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:14:48 smithi184 ceph-mon[98481]: pgmap v364: 129 pgs: 129 active+clean; 65 MiB data, 638 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.5 MiB/s wr, 264 op/s 2023-07-14T18:14:49.220 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:14:48 smithi163 ceph-mon[96576]: pgmap v364: 129 pgs: 129 active+clean; 65 MiB data, 638 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.5 MiB/s wr, 264 op/s 2023-07-14T18:14:49.278 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:14:48 smithi172 ceph-mon[97983]: pgmap v364: 129 pgs: 129 active+clean; 65 MiB data, 638 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.5 MiB/s wr, 264 op/s 2023-07-14T18:14:51.177 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:14:50 smithi184 ceph-mon[98481]: pgmap v365: 129 pgs: 129 active+clean; 67 MiB data, 650 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.3 MiB/s wr, 222 op/s 2023-07-14T18:14:51.220 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:14:50 smithi163 ceph-mon[96576]: pgmap v365: 129 pgs: 129 active+clean; 67 MiB data, 650 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.3 MiB/s wr, 222 op/s 2023-07-14T18:14:51.278 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:14:50 smithi172 ceph-mon[97983]: pgmap v365: 129 pgs: 129 active+clean; 67 MiB data, 650 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.3 MiB/s wr, 222 op/s 2023-07-14T18:14:53.177 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:14:52 smithi184 ceph-mon[98481]: pgmap v366: 129 pgs: 129 active+clean; 75 MiB data, 682 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 2.0 MiB/s wr, 253 op/s 2023-07-14T18:14:53.220 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:14:52 smithi163 ceph-mon[96576]: pgmap v366: 129 pgs: 129 active+clean; 75 MiB data, 682 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 2.0 MiB/s wr, 253 op/s 2023-07-14T18:14:53.278 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:14:52 smithi172 ceph-mon[97983]: pgmap v366: 129 pgs: 129 active+clean; 75 MiB data, 682 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 2.0 MiB/s wr, 253 op/s 2023-07-14T18:14:55.177 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:14:54 smithi184 ceph-mon[98481]: pgmap v367: 129 pgs: 129 active+clean; 79 MiB data, 714 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 2.0 MiB/s wr, 217 op/s 2023-07-14T18:14:55.220 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:14:54 smithi163 ceph-mon[96576]: pgmap v367: 129 pgs: 129 active+clean; 79 MiB data, 714 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 2.0 MiB/s wr, 217 op/s 2023-07-14T18:14:55.278 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:14:54 smithi172 ceph-mon[97983]: pgmap v367: 129 pgs: 129 active+clean; 79 MiB data, 714 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 2.0 MiB/s wr, 217 op/s 2023-07-14T18:14:57.177 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:14:56 smithi184 ceph-mon[98481]: pgmap v368: 129 pgs: 129 active+clean; 80 MiB data, 732 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 2.0 MiB/s wr, 237 op/s 2023-07-14T18:14:57.220 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:14:56 smithi163 ceph-mon[96576]: pgmap v368: 129 pgs: 129 active+clean; 80 MiB data, 732 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 2.0 MiB/s wr, 237 op/s 2023-07-14T18:14:57.278 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:14:56 smithi172 ceph-mon[97983]: pgmap v368: 129 pgs: 129 active+clean; 80 MiB data, 732 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 2.0 MiB/s wr, 237 op/s 2023-07-14T18:14:59.177 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:14:58 smithi184 ceph-mon[98481]: pgmap v369: 129 pgs: 129 active+clean; 84 MiB data, 760 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 2.1 MiB/s wr, 223 op/s 2023-07-14T18:14:59.220 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:14:58 smithi163 ceph-mon[96576]: pgmap v369: 129 pgs: 129 active+clean; 84 MiB data, 760 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 2.1 MiB/s wr, 223 op/s 2023-07-14T18:14:59.278 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:14:58 smithi172 ceph-mon[97983]: pgmap v369: 129 pgs: 129 active+clean; 84 MiB data, 760 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 2.1 MiB/s wr, 223 op/s 2023-07-14T18:15:01.178 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:15:00 smithi184 ceph-mon[98481]: pgmap v370: 129 pgs: 129 active+clean; 90 MiB data, 795 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.2 MiB/s wr, 212 op/s 2023-07-14T18:15:01.220 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:15:00 smithi163 ceph-mon[96576]: pgmap v370: 129 pgs: 129 active+clean; 90 MiB data, 795 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.2 MiB/s wr, 212 op/s 2023-07-14T18:15:01.278 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:15:00 smithi172 ceph-mon[97983]: pgmap v370: 129 pgs: 129 active+clean; 90 MiB data, 795 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.2 MiB/s wr, 212 op/s 2023-07-14T18:15:03.178 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:15:02 smithi184 ceph-mon[98481]: pgmap v371: 129 pgs: 129 active+clean; 94 MiB data, 809 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 2.4 MiB/s wr, 233 op/s 2023-07-14T18:15:03.213 INFO:tasks.workunit.client.0.smithi163.stderr:Note: switching to '12973fc04fd10d4af086901e10ffa8e48866b735'. 2023-07-14T18:15:03.213 INFO:tasks.workunit.client.0.smithi163.stderr: 2023-07-14T18:15:03.213 INFO:tasks.workunit.client.0.smithi163.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2023-07-14T18:15:03.213 INFO:tasks.workunit.client.0.smithi163.stderr:changes and commit them, and you can discard any commits you make in this 2023-07-14T18:15:03.213 INFO:tasks.workunit.client.0.smithi163.stderr:state without impacting any branches by switching back to a branch. 2023-07-14T18:15:03.214 INFO:tasks.workunit.client.0.smithi163.stderr: 2023-07-14T18:15:03.214 INFO:tasks.workunit.client.0.smithi163.stderr:If you want to create a new branch to retain commits you create, you may 2023-07-14T18:15:03.214 INFO:tasks.workunit.client.0.smithi163.stderr:do so (now or later) by using -c with the switch command. Example: 2023-07-14T18:15:03.214 INFO:tasks.workunit.client.0.smithi163.stderr: 2023-07-14T18:15:03.214 INFO:tasks.workunit.client.0.smithi163.stderr: git switch -c 2023-07-14T18:15:03.214 INFO:tasks.workunit.client.0.smithi163.stderr: 2023-07-14T18:15:03.214 INFO:tasks.workunit.client.0.smithi163.stderr:Or undo this operation with: 2023-07-14T18:15:03.215 INFO:tasks.workunit.client.0.smithi163.stderr: 2023-07-14T18:15:03.215 INFO:tasks.workunit.client.0.smithi163.stderr: git switch - 2023-07-14T18:15:03.215 INFO:tasks.workunit.client.0.smithi163.stderr: 2023-07-14T18:15:03.215 INFO:tasks.workunit.client.0.smithi163.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2023-07-14T18:15:03.215 INFO:tasks.workunit.client.0.smithi163.stderr: 2023-07-14T18:15:03.215 INFO:tasks.workunit.client.0.smithi163.stderr:HEAD is now at 12973fc0 btrfs/022: Correct seq number in golden output 2023-07-14T18:15:03.220 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:15:02 smithi163 ceph-mon[96576]: pgmap v371: 129 pgs: 129 active+clean; 94 MiB data, 809 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 2.4 MiB/s wr, 233 op/s 2023-07-14T18:15:03.224 INFO:tasks.workunit.client.0.smithi163.stderr:+ make -j4 2023-07-14T18:15:03.251 INFO:tasks.workunit.client.0.smithi163.stdout:libtoolize -cfi 2023-07-14T18:15:03.278 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:15:02 smithi172 ceph-mon[97983]: pgmap v371: 129 pgs: 129 active+clean; 94 MiB data, 809 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 2.4 MiB/s wr, 233 op/s 2023-07-14T18:15:03.665 INFO:tasks.workunit.client.0.smithi163.stdout:libtoolize: putting auxiliary files in '.'. 2023-07-14T18:15:03.665 INFO:tasks.workunit.client.0.smithi163.stdout:libtoolize: copying file './config.guess' 2023-07-14T18:15:03.677 INFO:tasks.workunit.client.0.smithi163.stdout:libtoolize: copying file './config.sub' 2023-07-14T18:15:03.691 INFO:tasks.workunit.client.0.smithi163.stdout:libtoolize: copying file './install-sh' 2023-07-14T18:15:03.703 INFO:tasks.workunit.client.0.smithi163.stdout:libtoolize: copying file './ltmain.sh' 2023-07-14T18:15:03.762 INFO:tasks.workunit.client.0.smithi163.stdout:libtoolize: putting macros in AC_CONFIG_MACRO_DIRS, 'm4'. 2023-07-14T18:15:03.763 INFO:tasks.workunit.client.0.smithi163.stdout:libtoolize: copying file 'm4/libtool.m4' 2023-07-14T18:15:03.786 INFO:tasks.workunit.client.0.smithi163.stdout:libtoolize: copying file 'm4/ltoptions.m4' 2023-07-14T18:15:03.808 INFO:tasks.workunit.client.0.smithi163.stdout:libtoolize: copying file 'm4/ltsugar.m4' 2023-07-14T18:15:03.831 INFO:tasks.workunit.client.0.smithi163.stdout:libtoolize: copying file 'm4/ltversion.m4' 2023-07-14T18:15:03.852 INFO:tasks.workunit.client.0.smithi163.stdout:libtoolize: copying file 'm4/lt~obsolete.m4' 2023-07-14T18:15:03.860 INFO:tasks.workunit.client.0.smithi163.stdout:libtoolize: Consider adding '-I m4' to ACLOCAL_AMFLAGS in Makefile.am. 2023-07-14T18:15:03.862 INFO:tasks.workunit.client.0.smithi163.stdout:cp include/install-sh . 2023-07-14T18:15:03.873 INFO:tasks.workunit.client.0.smithi163.stdout:aclocal -I m4 2023-07-14T18:15:05.178 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:15:04 smithi184 ceph-mon[98481]: pgmap v372: 129 pgs: 129 active+clean; 102 MiB data, 804 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.4 MiB/s wr, 213 op/s 2023-07-14T18:15:05.220 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:15:04 smithi163 ceph-mon[96576]: pgmap v372: 129 pgs: 129 active+clean; 102 MiB data, 804 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.4 MiB/s wr, 213 op/s 2023-07-14T18:15:05.278 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:15:04 smithi172 ceph-mon[97983]: pgmap v372: 129 pgs: 129 active+clean; 102 MiB data, 804 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.4 MiB/s wr, 213 op/s 2023-07-14T18:15:05.376 INFO:tasks.workunit.client.0.smithi163.stdout:autoheader 2023-07-14T18:15:05.800 INFO:tasks.workunit.client.0.smithi163.stdout:autoconf 2023-07-14T18:15:06.039 INFO:tasks.workunit.client.0.smithi163.stdout:./configure \ 2023-07-14T18:15:06.040 INFO:tasks.workunit.client.0.smithi163.stdout: --libexecdir=/usr/lib \ 2023-07-14T18:15:06.040 INFO:tasks.workunit.client.0.smithi163.stdout: --exec_prefix=/var/lib 2023-07-14T18:15:06.288 INFO:tasks.workunit.client.0.smithi163.stdout:checking build system type... x86_64-pc-linux-gnu 2023-07-14T18:15:06.288 INFO:tasks.workunit.client.0.smithi163.stdout:checking host system type... x86_64-pc-linux-gnu 2023-07-14T18:15:06.290 INFO:tasks.workunit.client.0.smithi163.stdout:checking how to print strings... printf 2023-07-14T18:15:06.291 INFO:tasks.workunit.client.0.smithi163.stdout:checking for gcc... gcc 2023-07-14T18:15:06.424 INFO:tasks.workunit.client.0.smithi163.stdout:checking whether the C compiler works... yes 2023-07-14T18:15:06.425 INFO:tasks.workunit.client.0.smithi163.stdout:checking for C compiler default output file name... a.out 2023-07-14T18:15:06.497 INFO:tasks.workunit.client.0.smithi163.stdout:checking for suffix of executables... 2023-07-14T18:15:06.560 INFO:tasks.workunit.client.0.smithi163.stdout:checking whether we are cross compiling... no 2023-07-14T18:15:06.620 INFO:tasks.workunit.client.0.smithi163.stdout:checking for suffix of object files... o 2023-07-14T18:15:06.662 INFO:tasks.workunit.client.0.smithi163.stdout:checking whether we are using the GNU C compiler... yes 2023-07-14T18:15:06.698 INFO:tasks.workunit.client.0.smithi163.stdout:checking whether gcc accepts -g... yes 2023-07-14T18:15:06.759 INFO:tasks.workunit.client.0.smithi163.stdout:checking for gcc option to accept ISO C89... none needed 2023-07-14T18:15:06.766 INFO:tasks.workunit.client.0.smithi163.stdout:checking for a sed that does not truncate output... /usr/bin/sed 2023-07-14T18:15:06.770 INFO:tasks.workunit.client.0.smithi163.stdout:checking for grep that handles long lines and -e... /usr/bin/grep 2023-07-14T18:15:06.772 INFO:tasks.workunit.client.0.smithi163.stdout:checking for egrep... /usr/bin/grep -E 2023-07-14T18:15:06.773 INFO:tasks.workunit.client.0.smithi163.stdout:checking for fgrep... /usr/bin/grep -F 2023-07-14T18:15:06.777 INFO:tasks.workunit.client.0.smithi163.stdout:checking for ld used by gcc... /usr/bin/ld 2023-07-14T18:15:06.779 INFO:tasks.workunit.client.0.smithi163.stdout:checking if the linker (/usr/bin/ld) is GNU ld... yes 2023-07-14T18:15:06.787 INFO:tasks.workunit.client.0.smithi163.stdout:checking for BSD- or MS-compatible name lister (nm)... /usr/bin/nm -B 2023-07-14T18:15:06.862 INFO:tasks.workunit.client.0.smithi163.stdout:checking the name lister (/usr/bin/nm -B) interface... BSD nm 2023-07-14T18:15:06.862 INFO:tasks.workunit.client.0.smithi163.stdout:checking whether ln -s works... yes 2023-07-14T18:15:06.876 INFO:tasks.workunit.client.0.smithi163.stdout:checking the maximum length of command line arguments... 1572864 2023-07-14T18:15:06.879 INFO:tasks.workunit.client.0.smithi163.stdout:checking how to convert x86_64-pc-linux-gnu file names to x86_64-pc-linux-gnu format... func_convert_file_noop 2023-07-14T18:15:06.879 INFO:tasks.workunit.client.0.smithi163.stdout:checking how to convert x86_64-pc-linux-gnu file names to toolchain format... func_convert_file_noop 2023-07-14T18:15:06.880 INFO:tasks.workunit.client.0.smithi163.stdout:checking for /usr/bin/ld option to reload object files... -r 2023-07-14T18:15:06.881 INFO:tasks.workunit.client.0.smithi163.stdout:checking for objdump... objdump 2023-07-14T18:15:06.882 INFO:tasks.workunit.client.0.smithi163.stdout:checking how to recognize dependent libraries... pass_all 2023-07-14T18:15:06.883 INFO:tasks.workunit.client.0.smithi163.stdout:checking for dlltool... no 2023-07-14T18:15:06.883 INFO:tasks.workunit.client.0.smithi163.stdout:checking how to associate runtime and link libraries... printf %s\n 2023-07-14T18:15:06.884 INFO:tasks.workunit.client.0.smithi163.stdout:checking for ar... ar 2023-07-14T18:15:06.986 INFO:tasks.workunit.client.0.smithi163.stdout:checking for archiver @FILE support... @ 2023-07-14T18:15:06.987 INFO:tasks.workunit.client.0.smithi163.stdout:checking for strip... strip 2023-07-14T18:15:06.988 INFO:tasks.workunit.client.0.smithi163.stdout:checking for ranlib... ranlib 2023-07-14T18:15:06.989 INFO:tasks.workunit.client.0.smithi163.stdout:checking for gawk... gawk 2023-07-14T18:15:07.172 INFO:tasks.workunit.client.0.smithi163.stdout:checking command to parse /usr/bin/nm -B output from gcc object... ok 2023-07-14T18:15:07.173 INFO:tasks.workunit.client.0.smithi163.stdout:checking for sysroot... no 2023-07-14T18:15:07.177 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:15:06 smithi184 ceph-mon[98481]: pgmap v373: 129 pgs: 129 active+clean; 104 MiB data, 825 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.3 MiB/s wr, 227 op/s 2023-07-14T18:15:07.200 INFO:tasks.workunit.client.0.smithi163.stdout:checking for a working dd... /usr/bin/dd 2023-07-14T18:15:07.220 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:15:06 smithi163 ceph-mon[96576]: pgmap v373: 129 pgs: 129 active+clean; 104 MiB data, 825 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.3 MiB/s wr, 227 op/s 2023-07-14T18:15:07.221 INFO:tasks.workunit.client.0.smithi163.stdout:checking how to truncate binary pipes... /usr/bin/dd bs=4096 count=1 2023-07-14T18:15:07.269 INFO:tasks.workunit.client.0.smithi163.stdout:checking for mt... no 2023-07-14T18:15:07.278 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:15:06 smithi172 ceph-mon[97983]: pgmap v373: 129 pgs: 129 active+clean; 104 MiB data, 825 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.3 MiB/s wr, 227 op/s 2023-07-14T18:15:07.292 INFO:tasks.workunit.client.0.smithi163.stdout:checking if : is a manifest tool... no 2023-07-14T18:15:07.651 INFO:tasks.workunit.client.0.smithi163.stdout:checking how to run the C preprocessor... gcc -E 2023-07-14T18:15:07.681 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-07-14T18:15:07.820 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:15:07.775+0000 7fa678123700 1 -- 172.21.15.163:0/3937299774 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fa6700ffd00 msgr2=0x7fa670100150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:15:07.820 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:15:07.775+0000 7fa678123700 1 --2- 172.21.15.163:0/3937299774 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fa6700ffd00 0x7fa670100150 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7fa660009990 tx=0x7fa660009ca0 comp rx=0 tx=0).stop 2023-07-14T18:15:07.820 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:15:07.775+0000 7fa678123700 1 -- 172.21.15.163:0/3937299774 shutdown_connections 2023-07-14T18:15:07.820 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:15:07.775+0000 7fa678123700 1 --2- 172.21.15.163:0/3937299774 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa670100690 0x7fa670106f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:15:07.820 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:15:07.775+0000 7fa678123700 1 --2- 172.21.15.163:0/3937299774 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa6700feb10 0x7fa6700fef20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:15:07.821 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:15:07.775+0000 7fa678123700 1 --2- 172.21.15.163:0/3937299774 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fa6700ffd00 0x7fa670100150 unknown :-1 s=CLOSED pgs=669 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:15:07.821 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:15:07.775+0000 7fa678123700 1 -- 172.21.15.163:0/3937299774 >> 172.21.15.163:0/3937299774 conn(0x7fa6700fa130 msgr2=0x7fa6700fc560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:15:07.821 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:15:07.776+0000 7fa678123700 1 -- 172.21.15.163:0/3937299774 shutdown_connections 2023-07-14T18:15:07.821 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:15:07.776+0000 7fa678123700 1 -- 172.21.15.163:0/3937299774 wait complete. 2023-07-14T18:15:07.822 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:15:07.776+0000 7fa678123700 1 Processor -- start 2023-07-14T18:15:07.823 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:15:07.776+0000 7fa678123700 1 -- start start 2023-07-14T18:15:07.823 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:15:07.776+0000 7fa678123700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa6700feb10 0x7fa670068310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:15:07.823 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:15:07.776+0000 7fa678123700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa6700ffd00 0x7fa67019ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:15:07.823 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:15:07.776+0000 7fa678123700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fa670100690 0x7fa67019ef90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:15:07.823 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:15:07.776+0000 7fa678123700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa67019f640 con 0x7fa670100690 2023-07-14T18:15:07.823 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:15:07.776+0000 7fa678123700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa67019f7b0 con 0x7fa6700ffd00 2023-07-14T18:15:07.823 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:15:07.776+0000 7fa678123700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa67019f970 con 0x7fa6700feb10 2023-07-14T18:15:07.824 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:15:07.777+0000 7fa675ebf700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa6700feb10 0x7fa670068310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:15:07.824 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:15:07.777+0000 7fa6766c0700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fa670100690 0x7fa67019ef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:15:07.824 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:15:07.777+0000 7fa675ebf700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa6700feb10 0x7fa670068310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.163:41298/0 (socket says 172.21.15.163:41298) 2023-07-14T18:15:07.824 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:15:07.777+0000 7fa675ebf700 1 -- 172.21.15.163:0/2099426578 learned_addr learned my addr 172.21.15.163:0/2099426578 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:15:07.824 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:15:07.777+0000 7fa6756be700 1 --2- 172.21.15.163:0/2099426578 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa6700ffd00 0x7fa67019ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:15:07.824 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:15:07.777+0000 7fa6766c0700 1 -- 172.21.15.163:0/2099426578 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa6700feb10 msgr2=0x7fa670068310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:15:07.825 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:15:07.777+0000 7fa6766c0700 1 --2- 172.21.15.163:0/2099426578 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa6700feb10 0x7fa670068310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:15:07.825 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:15:07.777+0000 7fa6766c0700 1 -- 172.21.15.163:0/2099426578 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa6700ffd00 msgr2=0x7fa67019ca40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:15:07.825 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:15:07.777+0000 7fa6766c0700 1 --2- 172.21.15.163:0/2099426578 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa6700ffd00 0x7fa67019ca40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:15:07.825 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:15:07.777+0000 7fa6766c0700 1 -- 172.21.15.163:0/2099426578 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6600095f0 con 0x7fa670100690 2023-07-14T18:15:07.825 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:15:07.777+0000 7fa6766c0700 1 --2- 172.21.15.163:0/2099426578 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fa670100690 0x7fa67019ef90 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7fa66800efc0 tx=0x7fa66800c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:15:07.825 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:15:07.777+0000 7fa666ffd700 1 -- 172.21.15.163:0/2099426578 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa668018070 con 0x7fa670100690 2023-07-14T18:15:07.825 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:15:07.777+0000 7fa678123700 1 -- 172.21.15.163:0/2099426578 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa67019fbf0 con 0x7fa670100690 2023-07-14T18:15:07.826 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:15:07.777+0000 7fa666ffd700 1 -- 172.21.15.163:0/2099426578 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fa66800f040 con 0x7fa670100690 2023-07-14T18:15:07.826 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:15:07.777+0000 7fa666ffd700 1 -- 172.21.15.163:0/2099426578 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa66800cba0 con 0x7fa670100690 2023-07-14T18:15:07.826 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:15:07.777+0000 7fa678123700 1 -- 172.21.15.163:0/2099426578 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa6701a0100 con 0x7fa670100690 2023-07-14T18:15:07.829 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:15:07.780+0000 7fa666ffd700 1 -- 172.21.15.163:0/2099426578 <== mon.0 v2:172.21.15.163:3300/0 4 ==== mgrmap(e 18) v1 ==== 135716+0+0 (secure 0 0 0) 0x7fa668003a00 con 0x7fa670100690 2023-07-14T18:15:07.829 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:15:07.780+0000 7fa666ffd700 1 --2- 172.21.15.163:0/2099426578 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7fa65c0a1150 0x7fa65c0a3600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:15:07.829 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:15:07.781+0000 7fa6842bbb80 1 Processor -- start 2023-07-14T18:15:07.829 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:15:07.781+0000 7fa666ffd700 1 -- 172.21.15.163:0/2099426578 <== mon.0 v2:172.21.15.163:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 9049+0+0 (secure 0 0 0) 0x7fa6680cc700 con 0x7fa670100690 2023-07-14T18:15:07.830 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:15:07.781+0000 7fa675ebf700 1 --2- 172.21.15.163:0/2099426578 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7fa65c0a1150 0x7fa65c0a3600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:15:07.830 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:15:07.781+0000 7fa6842bbb80 1 -- start start 2023-07-14T18:15:07.830 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:15:07.781+0000 7fa6842bbb80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ab95a90f60 0x55ab95a91370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:15:07.830 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:15:07.781+0000 7fa6842bbb80 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55ab95a918b0 0x55ab95a91ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:15:07.830 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:15:07.781+0000 7fa6842bbb80 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55ab95a924b0 0x55ab95a92920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:15:07.830 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:15:07.781+0000 7fa6842bbb80 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ab95995cb0 con 0x55ab95a924b0 2023-07-14T18:15:07.830 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:15:07.781+0000 7fa6842bbb80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ab959e8a40 con 0x55ab95a90f60 2023-07-14T18:15:07.831 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:15:07.781+0000 7fa6842bbb80 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ab959e1ed0 con 0x55ab95a918b0 2023-07-14T18:15:07.831 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:15:07.782+0000 7fa6756be700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55ab95a918b0 0x55ab95a91ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:15:07.831 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:15:07.782+0000 7fa6756be700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55ab95a918b0 0x55ab95a91ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.163:41308/0 (socket says 172.21.15.163:41308) 2023-07-14T18:15:07.831 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:15:07.782+0000 7fa6756be700 1 -- 172.21.15.163:0/685390751 learned_addr learned my addr 172.21.15.163:0/685390751 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:15:07.831 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:15:07.782+0000 7fa6766c0700 1 --2- 172.21.15.163:0/685390751 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55ab95a924b0 0x55ab95a92920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:15:07.831 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:15:07.782+0000 7fa675ebf700 1 --2- 172.21.15.163:0/685390751 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ab95a90f60 0x55ab95a91370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:15:07.831 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:15:07.782+0000 7fa675ebf700 1 --2- 172.21.15.163:0/2099426578 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7fa65c0a1150 0x7fa65c0a3600 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fa66c005950 tx=0x7fa66c009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:15:07.831 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:15:07.782+0000 7fa6766c0700 1 -- 172.21.15.163:0/685390751 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55ab95a918b0 msgr2=0x55ab95a91ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:15:07.832 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:15:07.782+0000 7fa6766c0700 1 --2- 172.21.15.163:0/685390751 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55ab95a918b0 0x55ab95a91ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:15:07.832 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:15:07.782+0000 7fa6766c0700 1 -- 172.21.15.163:0/685390751 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ab95a90f60 msgr2=0x55ab95a91370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:15:07.832 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:15:07.782+0000 7fa6766c0700 1 --2- 172.21.15.163:0/685390751 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ab95a90f60 0x55ab95a91370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:15:07.832 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:15:07.782+0000 7fa6766c0700 1 -- 172.21.15.163:0/685390751 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ab9580fde0 con 0x55ab95a924b0 2023-07-14T18:15:07.832 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:15:07.782+0000 7fa675ebf700 1 --2- 172.21.15.163:0/685390751 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ab95a90f60 0x55ab95a91370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T18:15:07.832 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:15:07.782+0000 7fa6766c0700 1 --2- 172.21.15.163:0/685390751 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55ab95a924b0 0x55ab95a92920 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7fa66800c6f0 tx=0x7fa668099430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=61d72f11e54b3c29 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:15:07.832 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:15:07.782+0000 7fa65bfff700 1 -- 172.21.15.163:0/685390751 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa66801b320 con 0x55ab95a924b0 2023-07-14T18:15:07.833 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:15:07.782+0000 7fa65bfff700 1 -- 172.21.15.163:0/685390751 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fa668099870 con 0x55ab95a924b0 2023-07-14T18:15:07.833 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:15:07.782+0000 7fa65bfff700 1 -- 172.21.15.163:0/685390751 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6680b9070 con 0x55ab95a924b0 2023-07-14T18:15:07.833 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:15:07.783+0000 7fa6842bbb80 1 -- 172.21.15.163:0/685390751 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55ab95a924b0 msgr2=0x55ab95a92920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:15:07.833 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:15:07.783+0000 7fa6842bbb80 1 --2- 172.21.15.163:0/685390751 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55ab95a924b0 0x55ab95a92920 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7fa66800c6f0 tx=0x7fa668099430 comp rx=0 tx=0).stop 2023-07-14T18:15:07.833 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:15:07.783+0000 7fa6842bbb80 1 -- 172.21.15.163:0/685390751 shutdown_connections 2023-07-14T18:15:07.833 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:15:07.783+0000 7fa6842bbb80 1 --2- 172.21.15.163:0/685390751 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55ab95a924b0 0x55ab95a92920 unknown :-1 s=CLOSED pgs=671 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:15:07.833 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:15:07.783+0000 7fa6842bbb80 1 --2- 172.21.15.163:0/685390751 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ab95a90f60 0x55ab95a91370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:15:07.833 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:15:07.783+0000 7fa6842bbb80 1 --2- 172.21.15.163:0/685390751 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55ab95a918b0 0x55ab95a91ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:15:07.834 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:15:07.783+0000 7fa6842bbb80 1 -- 172.21.15.163:0/685390751 >> 172.21.15.163:0/685390751 conn(0x55ab95a86680 msgr2=0x55ab95a8b9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:15:07.834 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:15:07.783+0000 7fa6842bbb80 1 -- 172.21.15.163:0/685390751 shutdown_connections 2023-07-14T18:15:07.834 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:15:07.783+0000 7fa6842bbb80 1 -- 172.21.15.163:0/685390751 wait complete. 2023-07-14T18:15:07.834 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:15:07.784+0000 7fa6842bbb80 1 -- start start 2023-07-14T18:15:07.834 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:15:07.784+0000 7fa6842bbb80 1 Processor -- start 2023-07-14T18:15:07.834 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:15:07.784+0000 7fa6842bbb80 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55ab95a90f60 0x55ab95a9a870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:15:07.834 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:15:07.784+0000 7fa6842bbb80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ab95a918b0 0x55ab95a9adb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:15:07.835 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:15:07.784+0000 7fa6842bbb80 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55ab95a924b0 0x55ab95aa1df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:15:07.835 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:15:07.784+0000 7fa6842bbb80 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ab95981ac0 con 0x55ab95a924b0 2023-07-14T18:15:07.835 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:15:07.784+0000 7fa6842bbb80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ab959817c0 con 0x55ab95a918b0 2023-07-14T18:15:07.835 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:15:07.784+0000 7fa6842bbb80 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ab95865920 con 0x55ab95a90f60 2023-07-14T18:15:07.835 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:15:07.784+0000 7fa6842bbb80 10 client.0 _ll_register_callbacks cb 0x55ab9597f760 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T18:15:07.835 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:15:07.784+0000 7fa6766c0700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55ab95a924b0 0x55ab95aa1df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:15:07.836 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:15:07.784+0000 7fa675ebf700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55ab95a90f60 0x55ab95a9a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:15:07.836 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:15:07.784+0000 7fa6756be700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ab95a918b0 0x55ab95a9adb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:15:07.836 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:15:07.784+0000 7fa675ebf700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55ab95a90f60 0x55ab95a9a870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.163:41312/0 (socket says 172.21.15.163:41312) 2023-07-14T18:15:07.836 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:15:07.784+0000 7fa6756be700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ab95a918b0 0x55ab95a9adb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.163:60176/0 (socket says 172.21.15.163:60176) 2023-07-14T18:15:07.836 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:15:07.784+0000 7fa675ebf700 1 -- 172.21.15.163:0/3565630916 learned_addr learned my addr 172.21.15.163:0/3565630916 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:15:07.836 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:15:07.785+0000 7fa675ebf700 1 -- 172.21.15.163:0/3565630916 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ab95a918b0 msgr2=0x55ab95a9adb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:15:07.836 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:15:07.785+0000 7fa675ebf700 1 --2- 172.21.15.163:0/3565630916 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ab95a918b0 0x55ab95a9adb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:15:07.836 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:15:07.785+0000 7fa675ebf700 1 -- 172.21.15.163:0/3565630916 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55ab95a924b0 msgr2=0x55ab95aa1df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:15:07.837 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:15:07.785+0000 7fa675ebf700 1 --2- 172.21.15.163:0/3565630916 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55ab95a924b0 0x55ab95aa1df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:15:07.837 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:15:07.785+0000 7fa675ebf700 1 -- 172.21.15.163:0/3565630916 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa6701a0100 con 0x55ab95a90f60 2023-07-14T18:15:07.837 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:15:07.785+0000 7fa6766c0700 1 --2- 172.21.15.163:0/3565630916 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55ab95a924b0 0x55ab95aa1df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T18:15:07.837 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:15:07.785+0000 7fa675ebf700 1 --2- 172.21.15.163:0/3565630916 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55ab95a90f60 0x55ab95a9a870 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fa66c003900 tx=0x7fa66c0047c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=335b5cc018dfc77a server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:15:07.837 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:15:07.785+0000 7fa6597fa700 10 client.0 ms_handle_connect on v2:172.21.15.184:3300/0 2023-07-14T18:15:07.837 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:15:07.785+0000 7fa6597fa700 1 -- 172.21.15.163:0/3565630916 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa66c01d820 con 0x55ab95a90f60 2023-07-14T18:15:07.837 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:15:07.785+0000 7fa6597fa700 1 -- 172.21.15.163:0/3565630916 <== mon.1 v2:172.21.15.184:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 9049+0+0 (secure 0 0 0) 0x7fa66c01d980 con 0x55ab95a90f60 2023-07-14T18:15:07.838 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:15:07.785+0000 7fa6842bbb80 1 -- 172.21.15.163:0/3565630916 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55ab9593b4f0 con 0x55ab95a90f60 2023-07-14T18:15:07.838 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:15:07.785+0000 7fa6597fa700 1 -- 172.21.15.163:0/3565630916 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa66c01db40 con 0x55ab95a90f60 2023-07-14T18:15:07.838 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:15:07.785+0000 7fa6842bbb80 10 client.25831 fetch_fsmap learned FSMap version 31 2023-07-14T18:15:07.838 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:15:07.785+0000 7fa6842bbb80 1 -- 172.21.15.163:0/3565630916 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) v3 -- 0x55ab957f8c60 con 0x55ab95a90f60 2023-07-14T18:15:07.839 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:15:07.785+0000 7fa6597fa700 1 -- 172.21.15.163:0/3565630916 <== mon.1 v2:172.21.15.184:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55ab9593b4f0 con 0x55ab95a90f60 2023-07-14T18:15:07.839 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:15:07.786+0000 7fa6597fa700 1 -- 172.21.15.163:0/3565630916 <== mon.1 v2:172.21.15.184:3300/0 5 ==== fsmap(e 31) v1 ==== 7486+0+0 (secure 0 0 0) 0x7fa66c01c410 con 0x55ab95a90f60 2023-07-14T18:15:07.840 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:15:07.786+0000 7fa6842bbb80 10 client.25831 fetch_fsmap finished waiting for FSMap version 31 2023-07-14T18:15:07.840 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:15:07.786+0000 7fa6842bbb80 10 client.25831 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-07-14T18:15:07.840 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:15:07.786+0000 7fa6842bbb80 20 client.25831 populate_metadata read hostname 'smithi163' 2023-07-14T18:15:07.840 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:15:07.786+0000 7fa6842bbb80 1 --2- 172.21.15.163:0/3565630916 >> [v2:172.21.15.172:6838/3850440096,v1:172.21.15.172:6839/3850440096] conn(0x55ab95aa66b0 0x55ab95aa8ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:15:07.840 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:15:07.786+0000 7fa6842bbb80 4 client.25831 mds_command: new command op to 24518 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-14T18:15:07.840 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:15:07.786+0000 7fa6842bbb80 1 -- 172.21.15.163:0/3565630916 --> [v2:172.21.15.172:6838/3850440096,v1:172.21.15.172:6839/3850440096] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55ab95a5fda0 con 0x55ab95aa66b0 2023-07-14T18:15:07.840 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:15:07.786+0000 7fa6756be700 1 --2- 172.21.15.163:0/3565630916 >> [v2:172.21.15.172:6838/3850440096,v1:172.21.15.172:6839/3850440096] conn(0x55ab95aa66b0 0x55ab95aa8ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:15:07.841 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:15:07.786+0000 7fa6597fa700 10 client.25831 ms_handle_connect on v2:172.21.15.172:6838/3850440096 2023-07-14T18:15:07.841 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:15:07.786+0000 7fa6756be700 1 --2- 172.21.15.163:0/3565630916 >> [v2:172.21.15.172:6838/3850440096,v1:172.21.15.172:6839/3850440096] conn(0x55ab95aa66b0 0x55ab95aa8ac0 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e9977fbe0c2ce8aa server_cookie=728899dc0239cb52 in_seq=0 out_seq=0 2023-07-14T18:15:07.841 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:15:07.787+0000 7fa6597fa700 1 -- 172.21.15.163:0/3565630916 <== mds.0 v2:172.21.15.172:6838/3850440096 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18017 (crc 0 0 0) 0x55ab95a5fda0 con 0x55ab95aa66b0 2023-07-14T18:15:07.841 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:15:07.787+0000 7fa6597fa700 10 client.25831 handle_command_reply: tid=0 2023-07-14T18:15:07.841 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:15:07.787+0000 7fa6842bbb80 1 client.25831 shutdown 2023-07-14T18:15:07.841 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:15:07.787+0000 7fa6842bbb80 1 -- 172.21.15.163:0/3565630916 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55ab95a90f60 msgr2=0x55ab95a9a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:15:07.841 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:15:07.787+0000 7fa6842bbb80 1 --2- 172.21.15.163:0/3565630916 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55ab95a90f60 0x55ab95a9a870 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fa66c003900 tx=0x7fa66c0047c0 comp rx=0 tx=0).stop 2023-07-14T18:15:07.841 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:15:07.787+0000 7fa6842bbb80 1 -- 172.21.15.163:0/3565630916 shutdown_connections 2023-07-14T18:15:07.842 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:15:07.787+0000 7fa6842bbb80 1 --2- 172.21.15.163:0/3565630916 >> [v2:172.21.15.172:6838/3850440096,v1:172.21.15.172:6839/3850440096] conn(0x55ab95aa66b0 0x55ab95aa8ac0 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:15:07.842 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:15:07.787+0000 7fa6842bbb80 1 --2- 172.21.15.163:0/3565630916 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55ab95a90f60 0x55ab95a9a870 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:15:07.842 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:15:07.787+0000 7fa6842bbb80 1 --2- 172.21.15.163:0/3565630916 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55ab95a924b0 0x55ab95aa1df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:15:07.842 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:15:07.787+0000 7fa6842bbb80 1 --2- 172.21.15.163:0/3565630916 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ab95a918b0 0x55ab95a9adb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:15:07.842 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:15:07.787+0000 7fa6597fa700 0 client.25831 ms_handle_reset on v2:172.21.15.172:6838/3850440096 2023-07-14T18:15:07.842 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:15:07.787+0000 7fa6842bbb80 1 -- 172.21.15.163:0/3565630916 >> 172.21.15.163:0/3565630916 conn(0x55ab95a86680 msgr2=0x55ab95a8a650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:15:07.842 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:15:07.787+0000 7fa6842bbb80 1 -- 172.21.15.163:0/3565630916 shutdown_connections 2023-07-14T18:15:07.842 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:15:07.788+0000 7fa6842bbb80 1 -- 172.21.15.163:0/3565630916 wait complete. 2023-07-14T18:15:07.843 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:15:07.788+0000 7fa6842bbb80 20 client.25831 trim_cache size 0 max 16384 2023-07-14T18:15:07.849 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:15:07.804+0000 7fa6842bbb80 1 Processor -- start 2023-07-14T18:15:07.849 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:15:07.804+0000 7fa6842bbb80 1 -- start start 2023-07-14T18:15:07.849 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:15:07.804+0000 7fa6842bbb80 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55ab95a90f60 0x55ab95aad420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:15:07.850 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:15:07.804+0000 7fa6842bbb80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ab95a918b0 0x55ab95aa1d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:15:07.850 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:15:07.804+0000 7fa6842bbb80 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55ab95a924b0 0x55ab95a99f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:15:07.850 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:15:07.804+0000 7fa6842bbb80 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ab95aa6280 con 0x55ab95a90f60 2023-07-14T18:15:07.850 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:15:07.804+0000 7fa6842bbb80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ab95a99d20 con 0x55ab95a918b0 2023-07-14T18:15:07.850 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:15:07.804+0000 7fa6842bbb80 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ab95aa3a60 con 0x55ab95a924b0 2023-07-14T18:15:07.850 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:15:07.804+0000 7fa675ebf700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55ab95a90f60 0x55ab95aad420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:15:07.850 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:15:07.804+0000 7fa675ebf700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55ab95a90f60 0x55ab95aad420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:59498/0 (socket says 172.21.15.163:59498) 2023-07-14T18:15:07.851 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:15:07.804+0000 7fa675ebf700 1 -- 172.21.15.163:0/132116625 learned_addr learned my addr 172.21.15.163:0/132116625 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:15:07.851 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:15:07.804+0000 7fa6756be700 1 --2- 172.21.15.163:0/132116625 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ab95a918b0 0x55ab95aa1d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:15:07.851 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:15:07.805+0000 7fa6766c0700 1 --2- 172.21.15.163:0/132116625 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55ab95a924b0 0x55ab95a99f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:15:07.851 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:15:07.805+0000 7fa675ebf700 1 -- 172.21.15.163:0/132116625 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55ab95a924b0 msgr2=0x55ab95a99f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:15:07.851 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:15:07.805+0000 7fa675ebf700 1 --2- 172.21.15.163:0/132116625 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55ab95a924b0 0x55ab95a99f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:15:07.851 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:15:07.805+0000 7fa675ebf700 1 -- 172.21.15.163:0/132116625 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ab95a918b0 msgr2=0x55ab95aa1d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:15:07.851 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:15:07.805+0000 7fa675ebf700 1 --2- 172.21.15.163:0/132116625 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ab95a918b0 0x55ab95aa1d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:15:07.851 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:15:07.805+0000 7fa675ebf700 1 -- 172.21.15.163:0/132116625 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ab95836250 con 0x55ab95a90f60 2023-07-14T18:15:07.852 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:15:07.805+0000 7fa6756be700 1 --2- 172.21.15.163:0/132116625 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ab95a918b0 0x55ab95aa1d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T18:15:07.852 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:15:07.805+0000 7fa6766c0700 1 --2- 172.21.15.163:0/132116625 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55ab95a924b0 0x55ab95a99f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T18:15:07.852 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:15:07.805+0000 7fa675ebf700 1 --2- 172.21.15.163:0/132116625 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55ab95a90f60 0x55ab95aad420 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7fa66c011c90 tx=0x7fa66c003f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=218d2234eb739d server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:15:07.852 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:15:07.805+0000 7fa664ff9700 1 -- 172.21.15.163:0/132116625 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa66c009a50 con 0x55ab95a90f60 2023-07-14T18:15:07.852 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:15:07.805+0000 7fa664ff9700 1 -- 172.21.15.163:0/132116625 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fa66c01c960 con 0x55ab95a90f60 2023-07-14T18:15:07.852 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:15:07.805+0000 7fa664ff9700 1 -- 172.21.15.163:0/132116625 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa66c034440 con 0x55ab95a90f60 2023-07-14T18:15:07.856 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:15:07.806+0000 7fa6842bbb80 1 -- 172.21.15.163:0/132116625 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55ab95a90f60 msgr2=0x55ab95aad420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:15:07.856 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:15:07.806+0000 7fa6842bbb80 1 --2- 172.21.15.163:0/132116625 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55ab95a90f60 0x55ab95aad420 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7fa66c011c90 tx=0x7fa66c003f70 comp rx=0 tx=0).stop 2023-07-14T18:15:07.856 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:15:07.806+0000 7fa6842bbb80 1 -- 172.21.15.163:0/132116625 shutdown_connections 2023-07-14T18:15:07.857 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:15:07.806+0000 7fa6842bbb80 1 --2- 172.21.15.163:0/132116625 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55ab95a924b0 0x55ab95a99f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:15:07.857 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:15:07.806+0000 7fa6842bbb80 1 --2- 172.21.15.163:0/132116625 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55ab95a90f60 0x55ab95aad420 unknown :-1 s=CLOSED pgs=672 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:15:07.857 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:15:07.806+0000 7fa6842bbb80 1 --2- 172.21.15.163:0/132116625 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ab95a918b0 0x55ab95aa1d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:15:07.857 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:15:07.806+0000 7fa6842bbb80 1 -- 172.21.15.163:0/132116625 >> 172.21.15.163:0/132116625 conn(0x55ab95a86680 msgr2=0x55ab95a99510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:15:07.857 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:15:07.806+0000 7fa6842bbb80 1 -- 172.21.15.163:0/132116625 shutdown_connections 2023-07-14T18:15:07.857 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:15:07.806+0000 7fa6842bbb80 1 -- 172.21.15.163:0/132116625 wait complete. 2023-07-14T18:15:07.857 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:15:07.806+0000 7fa6842bbb80 1 -- start start 2023-07-14T18:15:07.858 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:15:07.806+0000 7fa6842bbb80 1 Processor -- start 2023-07-14T18:15:07.858 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:15:07.807+0000 7fa6842bbb80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ab95a90f60 0x55ab95a9f900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:15:07.858 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:15:07.807+0000 7fa6842bbb80 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55ab95a918b0 0x55ab95a9fe40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:15:07.858 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:15:07.807+0000 7fa6842bbb80 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55ab95a924b0 0x55ab95aa0e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:15:07.858 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:15:07.807+0000 7fa6842bbb80 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ab95aa1390 con 0x55ab95a918b0 2023-07-14T18:15:07.858 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:15:07.807+0000 7fa6842bbb80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ab95aa1500 con 0x55ab95a90f60 2023-07-14T18:15:07.858 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:15:07.807+0000 7fa6842bbb80 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ab95aa16c0 con 0x55ab95a924b0 2023-07-14T18:15:07.859 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:15:07.807+0000 7fa6842bbb80 10 client.0 _ll_register_callbacks cb 0x7fa66c0043e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T18:15:07.859 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:15:07.807+0000 7fa6756be700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55ab95a918b0 0x55ab95a9fe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:15:07.859 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:15:07.807+0000 7fa675ebf700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ab95a90f60 0x55ab95a9f900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:15:07.859 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:15:07.807+0000 7fa6756be700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55ab95a918b0 0x55ab95a9fe40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:59506/0 (socket says 172.21.15.163:59506) 2023-07-14T18:15:07.859 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:15:07.807+0000 7fa675ebf700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ab95a90f60 0x55ab95a9f900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.163:60188/0 (socket says 172.21.15.163:60188) 2023-07-14T18:15:07.859 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:15:07.807+0000 7fa6756be700 1 -- 172.21.15.163:0/954324911 learned_addr learned my addr 172.21.15.163:0/954324911 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:15:07.859 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:15:07.807+0000 7fa6766c0700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55ab95a924b0 0x55ab95aa0e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:15:07.859 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:15:07.807+0000 7fa6756be700 1 -- 172.21.15.163:0/954324911 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55ab95a924b0 msgr2=0x55ab95aa0e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:15:07.860 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:15:07.807+0000 7fa6756be700 1 --2- 172.21.15.163:0/954324911 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55ab95a924b0 0x55ab95aa0e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:15:07.860 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:15:07.807+0000 7fa6756be700 1 -- 172.21.15.163:0/954324911 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ab95a90f60 msgr2=0x55ab95a9f900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:15:07.860 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:15:07.807+0000 7fa6756be700 1 --2- 172.21.15.163:0/954324911 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ab95a90f60 0x55ab95a9f900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:15:07.860 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:15:07.807+0000 7fa6756be700 1 -- 172.21.15.163:0/954324911 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa670107880 con 0x55ab95a918b0 2023-07-14T18:15:07.860 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:15:07.807+0000 7fa6756be700 1 --2- 172.21.15.163:0/954324911 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55ab95a918b0 0x55ab95a9fe40 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7fa660003f60 tx=0x7fa660000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c55b6a5953dba3a7 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:15:07.860 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:15:07.807+0000 7fa6597fa700 10 client.0 ms_handle_connect on v2:172.21.15.163:3300/0 2023-07-14T18:15:07.860 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:15:07.807+0000 7fa6597fa700 1 -- 172.21.15.163:0/954324911 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa66002c070 con 0x55ab95a918b0 2023-07-14T18:15:07.861 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:15:07.808+0000 7fa6842bbb80 1 -- 172.21.15.163:0/954324911 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fa668099870 con 0x55ab95a918b0 2023-07-14T18:15:07.861 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:15:07.808+0000 7fa6597fa700 1 -- 172.21.15.163:0/954324911 <== mon.0 v2:172.21.15.163:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 9049+0+0 (secure 0 0 0) 0x7fa660003680 con 0x55ab95a918b0 2023-07-14T18:15:07.861 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:15:07.808+0000 7fa6597fa700 1 -- 172.21.15.163:0/954324911 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa66001d040 con 0x55ab95a918b0 2023-07-14T18:15:07.861 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:15:07.808+0000 7fa6842bbb80 10 client.16275 fetch_fsmap learned FSMap version 31 2023-07-14T18:15:07.861 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:15:07.808+0000 7fa6842bbb80 1 -- 172.21.15.163:0/954324911 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) v3 -- 0x55ab9580fde0 con 0x55ab95a918b0 2023-07-14T18:15:07.861 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:15:07.808+0000 7fa6597fa700 1 -- 172.21.15.163:0/954324911 <== mon.0 v2:172.21.15.163:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fa668099870 con 0x55ab95a918b0 2023-07-14T18:15:07.861 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:15:07.808+0000 7fa6597fa700 1 -- 172.21.15.163:0/954324911 <== mon.0 v2:172.21.15.163:3300/0 5 ==== fsmap(e 31) v1 ==== 7486+0+0 (secure 0 0 0) 0x7fa66000ba50 con 0x55ab95a918b0 2023-07-14T18:15:07.862 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:15:07.808+0000 7fa6842bbb80 10 client.16275 fetch_fsmap finished waiting for FSMap version 31 2023-07-14T18:15:07.862 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:15:07.808+0000 7fa6842bbb80 10 client.16275 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-07-14T18:15:07.862 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:15:07.808+0000 7fa6842bbb80 20 client.16275 populate_metadata read hostname 'smithi163' 2023-07-14T18:15:07.862 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:15:07.808+0000 7fa6842bbb80 1 --2- 172.21.15.163:0/954324911 >> [v2:172.21.15.172:6838/3850440096,v1:172.21.15.172:6839/3850440096] conn(0x55ab95afb200 0x55ab95afd610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:15:07.862 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:15:07.808+0000 7fa6842bbb80 4 client.16275 mds_command: new command op to 24518 tid=0[{"prefix": "scrub status"}] 2023-07-14T18:15:07.862 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:15:07.808+0000 7fa6842bbb80 1 -- 172.21.15.163:0/954324911 --> [v2:172.21.15.172:6838/3850440096,v1:172.21.15.172:6839/3850440096] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55ab959daeb0 con 0x55ab95afb200 2023-07-14T18:15:07.862 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:15:07.808+0000 7fa675ebf700 1 --2- 172.21.15.163:0/954324911 >> [v2:172.21.15.172:6838/3850440096,v1:172.21.15.172:6839/3850440096] conn(0x55ab95afb200 0x55ab95afd610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:15:07.862 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:15:07.809+0000 7fa6597fa700 10 client.16275 ms_handle_connect on v2:172.21.15.172:6838/3850440096 2023-07-14T18:15:07.863 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:15:07.809+0000 7fa675ebf700 1 --2- 172.21.15.163:0/954324911 >> [v2:172.21.15.172:6838/3850440096,v1:172.21.15.172:6839/3850440096] conn(0x55ab95afb200 0x55ab95afd610 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=26338595e84109d8 server_cookie=a1c438f2abdf40b8 in_seq=0 out_seq=0 2023-07-14T18:15:07.863 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:15:07.809+0000 7fa6597fa700 1 -- 172.21.15.163:0/954324911 <== mds.0 v2:172.21.15.172:6838/3850440096 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+265 (crc 0 0 0) 0x55ab959daeb0 con 0x55ab95afb200 2023-07-14T18:15:07.863 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:15:07.809+0000 7fa6597fa700 10 client.16275 handle_command_reply: tid=0 2023-07-14T18:15:07.863 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:15:07.809+0000 7fa6842bbb80 1 client.16275 shutdown 2023-07-14T18:15:07.863 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:15:07.809+0000 7fa6842bbb80 1 -- 172.21.15.163:0/954324911 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55ab95a918b0 msgr2=0x55ab95a9fe40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:15:07.863 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:15:07.809+0000 7fa6842bbb80 1 --2- 172.21.15.163:0/954324911 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55ab95a918b0 0x55ab95a9fe40 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7fa660003f60 tx=0x7fa660000bc0 comp rx=0 tx=0).stop 2023-07-14T18:15:07.863 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:15:07.809+0000 7fa6842bbb80 1 -- 172.21.15.163:0/954324911 shutdown_connections 2023-07-14T18:15:07.863 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:15:07.809+0000 7fa6842bbb80 1 --2- 172.21.15.163:0/954324911 >> [v2:172.21.15.172:6838/3850440096,v1:172.21.15.172:6839/3850440096] conn(0x55ab95afb200 0x55ab95afd610 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:15:07.864 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:15:07.809+0000 7fa6842bbb80 1 --2- 172.21.15.163:0/954324911 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55ab95a924b0 0x55ab95aa0e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:15:07.864 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:15:07.809+0000 7fa6842bbb80 1 --2- 172.21.15.163:0/954324911 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ab95a90f60 0x55ab95a9f900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:15:07.864 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:15:07.809+0000 7fa6842bbb80 1 --2- 172.21.15.163:0/954324911 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55ab95a918b0 0x55ab95a9fe40 unknown :-1 s=CLOSED pgs=673 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:15:07.864 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:15:07.809+0000 7fa6842bbb80 1 -- 172.21.15.163:0/954324911 >> 172.21.15.163:0/954324911 conn(0x55ab95a86680 msgr2=0x55ab95a99510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:15:07.864 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:15:07.809+0000 7fa6597fa700 0 client.16275 ms_handle_reset on v2:172.21.15.172:6838/3850440096 2023-07-14T18:15:07.864 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:15:07.809+0000 7fa6842bbb80 1 -- 172.21.15.163:0/954324911 shutdown_connections 2023-07-14T18:15:07.864 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:15:07.809+0000 7fa6842bbb80 1 -- 172.21.15.163:0/954324911 wait complete. 2023-07-14T18:15:07.865 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:15:07.809+0000 7fa6842bbb80 20 client.16275 trim_cache size 0 max 16384 2023-07-14T18:15:07.865 INFO:teuthology.orchestra.run.smithi163.stdout:{ 2023-07-14T18:15:07.865 INFO:teuthology.orchestra.run.smithi163.stdout: "status": "scrub active (4 inodes in the stack)", 2023-07-14T18:15:07.865 INFO:teuthology.orchestra.run.smithi163.stdout: "scrubs": { 2023-07-14T18:15:07.865 INFO:teuthology.orchestra.run.smithi163.stdout: "2c53b7ef-6f30-49f0-a60d-f1f114c19d42": { 2023-07-14T18:15:07.865 INFO:teuthology.orchestra.run.smithi163.stdout: "path": "/", 2023-07-14T18:15:07.866 INFO:teuthology.orchestra.run.smithi163.stdout: "tag": "2c53b7ef-6f30-49f0-a60d-f1f114c19d42", 2023-07-14T18:15:07.866 INFO:teuthology.orchestra.run.smithi163.stdout: "options": "recursive,force" 2023-07-14T18:15:07.866 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-07-14T18:15:07.866 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-07-14T18:15:07.866 INFO:teuthology.orchestra.run.smithi163.stdout:} 2023-07-14T18:15:07.867 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:15:07.810+0000 7fa678123700 1 -- 172.21.15.163:0/2099426578 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7fa65c0a1150 msgr2=0x7fa65c0a3600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:15:07.868 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:15:07.810+0000 7fa678123700 1 --2- 172.21.15.163:0/2099426578 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7fa65c0a1150 0x7fa65c0a3600 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fa66c005950 tx=0x7fa66c009260 comp rx=0 tx=0).stop 2023-07-14T18:15:07.868 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:15:07.810+0000 7fa678123700 1 -- 172.21.15.163:0/2099426578 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fa670100690 msgr2=0x7fa67019ef90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:15:07.868 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:15:07.810+0000 7fa678123700 1 --2- 172.21.15.163:0/2099426578 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fa670100690 0x7fa67019ef90 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7fa66800efc0 tx=0x7fa66800c3a0 comp rx=0 tx=0).stop 2023-07-14T18:15:07.868 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:15:07.810+0000 7fa678123700 1 -- 172.21.15.163:0/2099426578 shutdown_connections 2023-07-14T18:15:07.868 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:15:07.810+0000 7fa678123700 1 --2- 172.21.15.163:0/2099426578 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7fa65c0a1150 0x7fa65c0a3600 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:15:07.868 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:15:07.810+0000 7fa678123700 1 --2- 172.21.15.163:0/2099426578 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa6700feb10 0x7fa670068310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:15:07.868 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:15:07.810+0000 7fa678123700 1 --2- 172.21.15.163:0/2099426578 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fa670100690 0x7fa67019ef90 unknown :-1 s=CLOSED pgs=670 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:15:07.869 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:15:07.810+0000 7fa678123700 1 --2- 172.21.15.163:0/2099426578 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa6700ffd00 0x7fa67019ca40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:15:07.869 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:15:07.810+0000 7fa678123700 1 -- 172.21.15.163:0/2099426578 >> 172.21.15.163:0/2099426578 conn(0x7fa6700fa130 msgr2=0x7fa6700fc420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:15:07.869 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:15:07.810+0000 7fa678123700 1 -- 172.21.15.163:0/2099426578 shutdown_connections 2023-07-14T18:15:07.869 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:15:07.810+0000 7fa678123700 1 -- 172.21.15.163:0/2099426578 wait complete. 2023-07-14T18:15:07.869 INFO:tasks.cephfs.filesystem:scrub status for tag:2c53b7ef-6f30-49f0-a60d-f1f114c19d42 - {'path': '/', 'tag': '2c53b7ef-6f30-49f0-a60d-f1f114c19d42', 'options': 'recursive,force'} 2023-07-14T18:15:08.916 INFO:tasks.workunit.client.0.smithi163.stdout:checking for ANSI C header files... yes 2023-07-14T18:15:08.976 INFO:tasks.workunit.client.0.smithi163.stdout:checking for sys/types.h... yes 2023-07-14T18:15:09.062 INFO:tasks.workunit.client.0.smithi163.stdout:checking for sys/stat.h... yes 2023-07-14T18:15:09.138 INFO:tasks.workunit.client.0.smithi163.stdout:checking for stdlib.h... yes 2023-07-14T18:15:09.178 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:15:08 smithi184 ceph-mon[98481]: pgmap v374: 129 pgs: 129 active+clean; 106 MiB data, 848 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.3 MiB/s wr, 193 op/s 2023-07-14T18:15:09.213 INFO:tasks.workunit.client.0.smithi163.stdout:checking for string.h... yes 2023-07-14T18:15:09.220 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:15:08 smithi163 ceph-mon[96576]: pgmap v374: 129 pgs: 129 active+clean; 106 MiB data, 848 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.3 MiB/s wr, 193 op/s 2023-07-14T18:15:09.278 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:15:08 smithi172 ceph-mon[97983]: pgmap v374: 129 pgs: 129 active+clean; 106 MiB data, 848 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.3 MiB/s wr, 193 op/s 2023-07-14T18:15:09.286 INFO:tasks.workunit.client.0.smithi163.stdout:checking for memory.h... yes 2023-07-14T18:15:09.364 INFO:tasks.workunit.client.0.smithi163.stdout:checking for strings.h... yes 2023-07-14T18:15:09.440 INFO:tasks.workunit.client.0.smithi163.stdout:checking for inttypes.h... yes 2023-07-14T18:15:09.511 INFO:tasks.workunit.client.0.smithi163.stdout:checking for stdint.h... yes 2023-07-14T18:15:09.613 INFO:tasks.workunit.client.0.smithi163.stdout:checking for unistd.h... yes 2023-07-14T18:15:09.684 INFO:tasks.workunit.client.0.smithi163.stdout:checking for dlfcn.h... yes 2023-07-14T18:15:09.701 INFO:tasks.workunit.client.0.smithi163.stdout:checking for objdir... .libs 2023-07-14T18:15:09.897 INFO:tasks.workunit.client.0.smithi163.stdout:checking if gcc supports -fno-rtti -fno-exceptions... no 2023-07-14T18:15:09.897 INFO:tasks.workunit.client.0.smithi163.stdout:checking for gcc option to produce PIC... -fPIC -DPIC 2023-07-14T18:15:09.956 INFO:tasks.workunit.client.0.smithi163.stdout:checking if gcc PIC flag -fPIC -DPIC works... yes 2023-07-14T18:15:10.031 INFO:tasks.workunit.client.0.smithi163.stdout:checking if gcc static flag -static works... no 2023-07-14T18:15:10.142 INFO:tasks.workunit.client.0.smithi163.stdout:checking if gcc supports -c -o file.o... yes 2023-07-14T18:15:10.142 INFO:tasks.workunit.client.0.smithi163.stdout:checking if gcc supports -c -o file.o... (cached) yes 2023-07-14T18:15:10.150 INFO:tasks.workunit.client.0.smithi163.stdout:checking whether the gcc linker (/usr/bin/ld -m elf_x86_64) supports shared libraries... yes 2023-07-14T18:15:10.178 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:15:09 smithi184 ceph-mon[98481]: pgmap v375: 129 pgs: 129 active+clean; 108 MiB data, 853 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 2.1 MiB/s wr, 191 op/s 2023-07-14T18:15:10.220 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:15:09 smithi163 ceph-mon[96576]: pgmap v375: 129 pgs: 129 active+clean; 108 MiB data, 853 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 2.1 MiB/s wr, 191 op/s 2023-07-14T18:15:10.245 INFO:tasks.workunit.client.0.smithi163.stdout:checking whether -lc should be explicitly linked in... no 2023-07-14T18:15:10.278 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:15:09 smithi172 ceph-mon[97983]: pgmap v375: 129 pgs: 129 active+clean; 108 MiB data, 853 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 2.1 MiB/s wr, 191 op/s 2023-07-14T18:15:10.336 INFO:tasks.workunit.client.0.smithi163.stdout:checking dynamic linker characteristics... GNU/Linux ld.so 2023-07-14T18:15:10.337 INFO:tasks.workunit.client.0.smithi163.stdout:checking how to hardcode library paths into programs... immediate 2023-07-14T18:15:10.343 INFO:tasks.workunit.client.0.smithi163.stdout:checking whether stripping libraries is possible... yes 2023-07-14T18:15:10.344 INFO:tasks.workunit.client.0.smithi163.stdout:checking if libtool supports shared libraries... yes 2023-07-14T18:15:10.344 INFO:tasks.workunit.client.0.smithi163.stdout:checking whether to build shared libraries... yes 2023-07-14T18:15:10.345 INFO:tasks.workunit.client.0.smithi163.stdout:checking whether to build static libraries... yes 2023-07-14T18:15:10.352 INFO:tasks.workunit.client.0.smithi163.stdout:checking for gcc... (cached) gcc 2023-07-14T18:15:10.411 INFO:tasks.workunit.client.0.smithi163.stdout:checking whether we are using the GNU C compiler... (cached) yes 2023-07-14T18:15:10.411 INFO:tasks.workunit.client.0.smithi163.stdout:checking whether gcc accepts -g... (cached) yes 2023-07-14T18:15:10.412 INFO:tasks.workunit.client.0.smithi163.stdout:checking for gcc option to accept ISO C89... (cached) none needed 2023-07-14T18:15:10.412 INFO:tasks.workunit.client.0.smithi163.stdout:checking for gmake... /usr/bin/gmake 2023-07-14T18:15:10.413 INFO:tasks.workunit.client.0.smithi163.stderr:./configure: line 11956: test: $(SHELL): binary operator expected 2023-07-14T18:15:10.414 INFO:tasks.workunit.client.0.smithi163.stdout:checking for tar... /bin/tar 2023-07-14T18:15:10.415 INFO:tasks.workunit.client.0.smithi163.stdout:checking for gzip... /bin/gzip 2023-07-14T18:15:10.429 INFO:tasks.workunit.client.0.smithi163.stdout:checking whether gcc -MM is supported... yes 2023-07-14T18:15:10.431 INFO:tasks.workunit.client.0.smithi163.stdout:checking for sort... /bin/sort 2023-07-14T18:15:10.431 INFO:tasks.workunit.client.0.smithi163.stdout:checking whether ln -s works... yes 2023-07-14T18:15:10.432 INFO:tasks.workunit.client.0.smithi163.stdout:checking for rpm... /bin/rpm 2023-07-14T18:15:10.437 INFO:tasks.workunit.client.0.smithi163.stdout:checking for rpmbuild... no 2023-07-14T18:15:10.438 INFO:tasks.workunit.client.0.smithi163.stdout:checking for ANSI C header files... (cached) yes 2023-07-14T18:15:10.527 INFO:tasks.workunit.client.0.smithi163.stdout:checking assert.h usability... yes 2023-07-14T18:15:10.553 INFO:tasks.workunit.client.0.smithi163.stdout:checking assert.h presence... yes 2023-07-14T18:15:10.553 INFO:tasks.workunit.client.0.smithi163.stdout:checking for assert.h... yes 2023-07-14T18:15:10.640 INFO:tasks.workunit.client.0.smithi163.stdout:checking bstring.h usability... no 2023-07-14T18:15:12.151 INFO:tasks.workunit.client.0.smithi163.stdout:checking bstring.h presence... no 2023-07-14T18:15:12.151 INFO:tasks.workunit.client.0.smithi163.stdout:checking for bstring.h... no 2023-07-14T18:15:12.210 INFO:tasks.workunit.client.0.smithi163.stdout:checking libgen.h usability... yes 2023-07-14T18:15:12.232 INFO:tasks.workunit.client.0.smithi163.stdout:checking libgen.h presence... yes 2023-07-14T18:15:12.233 INFO:tasks.workunit.client.0.smithi163.stdout:checking for libgen.h... yes 2023-07-14T18:15:12.313 INFO:tasks.workunit.client.0.smithi163.stdout:checking dirent.h usability... yes 2023-07-14T18:15:12.337 INFO:tasks.workunit.client.0.smithi163.stdout:checking dirent.h presence... yes 2023-07-14T18:15:12.337 INFO:tasks.workunit.client.0.smithi163.stdout:checking for dirent.h... yes 2023-07-14T18:15:12.421 INFO:tasks.workunit.client.0.smithi163.stdout:checking errno.h usability... yes 2023-07-14T18:15:12.445 INFO:tasks.workunit.client.0.smithi163.stdout:checking errno.h presence... yes 2023-07-14T18:15:12.446 INFO:tasks.workunit.client.0.smithi163.stdout:checking for errno.h... yes 2023-07-14T18:15:12.531 INFO:tasks.workunit.client.0.smithi163.stdout:checking malloc.h usability... yes 2023-07-14T18:15:12.555 INFO:tasks.workunit.client.0.smithi163.stdout:checking malloc.h presence... yes 2023-07-14T18:15:12.555 INFO:tasks.workunit.client.0.smithi163.stdout:checking for malloc.h... yes 2023-07-14T18:15:12.644 INFO:tasks.workunit.client.0.smithi163.stdout:checking uuid.h usability... no 2023-07-14T18:15:13.178 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:15:12 smithi184 ceph-mon[98481]: pgmap v376: 129 pgs: 129 active+clean; 109 MiB data, 860 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.7 MiB/s wr, 168 op/s 2023-07-14T18:15:13.220 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:15:12 smithi163 ceph-mon[96576]: pgmap v376: 129 pgs: 129 active+clean; 109 MiB data, 860 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.7 MiB/s wr, 168 op/s 2023-07-14T18:15:13.279 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:15:12 smithi172 ceph-mon[97983]: pgmap v376: 129 pgs: 129 active+clean; 109 MiB data, 860 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.7 MiB/s wr, 168 op/s 2023-07-14T18:15:13.675 INFO:tasks.workunit.client.0.smithi163.stdout:checking uuid.h presence... no 2023-07-14T18:15:13.675 INFO:tasks.workunit.client.0.smithi163.stdout:checking for uuid.h... no 2023-07-14T18:15:13.764 INFO:tasks.workunit.client.0.smithi163.stdout:checking uuid/uuid.h usability... yes 2023-07-14T18:15:13.788 INFO:tasks.workunit.client.0.smithi163.stdout:checking uuid/uuid.h presence... yes 2023-07-14T18:15:13.789 INFO:tasks.workunit.client.0.smithi163.stdout:checking for uuid/uuid.h... yes 2023-07-14T18:15:13.881 INFO:tasks.workunit.client.0.smithi163.stdout:checking sys/uuid.h usability... no 2023-07-14T18:15:15.178 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:15:14 smithi184 ceph-mon[98481]: pgmap v377: 129 pgs: 129 active+clean; 109 MiB data, 869 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.4 MiB/s wr, 137 op/s 2023-07-14T18:15:15.178 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:15:14 smithi184 ceph-mon[98481]: scrub summary: active paths [/] 2023-07-14T18:15:15.220 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:15:14 smithi163 ceph-mon[96576]: pgmap v377: 129 pgs: 129 active+clean; 109 MiB data, 869 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.4 MiB/s wr, 137 op/s 2023-07-14T18:15:15.221 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:15:14 smithi163 ceph-mon[96576]: scrub summary: active paths [/] 2023-07-14T18:15:15.279 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:15:14 smithi172 ceph-mon[97983]: pgmap v377: 129 pgs: 129 active+clean; 109 MiB data, 869 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.4 MiB/s wr, 137 op/s 2023-07-14T18:15:15.279 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:15:14 smithi172 ceph-mon[97983]: scrub summary: active paths [/] 2023-07-14T18:15:17.178 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:15:16 smithi184 ceph-mon[98481]: pgmap v378: 129 pgs: 129 active+clean; 110 MiB data, 874 MiB used, 1.0 TiB / 1.0 TiB avail; 578 KiB/s rd, 824 KiB/s wr, 117 op/s 2023-07-14T18:15:17.220 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:15:16 smithi163 ceph-mon[96576]: pgmap v378: 129 pgs: 129 active+clean; 110 MiB data, 874 MiB used, 1.0 TiB / 1.0 TiB avail; 578 KiB/s rd, 824 KiB/s wr, 117 op/s 2023-07-14T18:15:17.279 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:15:16 smithi172 ceph-mon[97983]: pgmap v378: 129 pgs: 129 active+clean; 110 MiB data, 874 MiB used, 1.0 TiB / 1.0 TiB avail; 578 KiB/s rd, 824 KiB/s wr, 117 op/s 2023-07-14T18:15:18.675 INFO:tasks.workunit.client.0.smithi163.stdout:checking sys/uuid.h presence... no 2023-07-14T18:15:18.676 INFO:tasks.workunit.client.0.smithi163.stdout:checking for sys/uuid.h... no 2023-07-14T18:15:18.742 INFO:tasks.workunit.client.0.smithi163.stdout:checking sys/file.h usability... yes 2023-07-14T18:15:18.767 INFO:tasks.workunit.client.0.smithi163.stdout:checking sys/file.h presence... yes 2023-07-14T18:15:18.767 INFO:tasks.workunit.client.0.smithi163.stdout:checking for sys/file.h... yes 2023-07-14T18:15:18.940 INFO:tasks.workunit.client.0.smithi163.stdout:checking sys/fcntl.h usability... yes 2023-07-14T18:15:18.965 INFO:tasks.workunit.client.0.smithi163.stdout:checking sys/fcntl.h presence... yes 2023-07-14T18:15:18.965 INFO:tasks.workunit.client.0.smithi163.stdout:checking for sys/fcntl.h... yes 2023-07-14T18:15:19.129 INFO:tasks.workunit.client.0.smithi163.stdout:checking sys/syssgi.h usability... no 2023-07-14T18:15:19.178 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:15:18 smithi184 ceph-mon[98481]: pgmap v379: 129 pgs: 129 active+clean; 110 MiB data, 875 MiB used, 1.0 TiB / 1.0 TiB avail; 365 KiB/s rd, 585 KiB/s wr, 81 op/s 2023-07-14T18:15:19.178 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:15:18 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-14T18:15:19.221 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:15:18 smithi163 ceph-mon[96576]: pgmap v379: 129 pgs: 129 active+clean; 110 MiB data, 875 MiB used, 1.0 TiB / 1.0 TiB avail; 365 KiB/s rd, 585 KiB/s wr, 81 op/s 2023-07-14T18:15:19.221 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:15:18 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-14T18:15:19.279 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:15:18 smithi172 ceph-mon[97983]: pgmap v379: 129 pgs: 129 active+clean; 110 MiB data, 875 MiB used, 1.0 TiB / 1.0 TiB avail; 365 KiB/s rd, 585 KiB/s wr, 81 op/s 2023-07-14T18:15:19.279 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:15:18 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-14T18:15:20.428 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:15:20 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:15:20.428 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:15:20 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:15:20.428 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:15:20 smithi184 ceph-mon[98481]: pgmap v380: 129 pgs: 129 active+clean; 110 MiB data, 863 MiB used, 1.0 TiB / 1.0 TiB avail; 380 KiB/s rd, 423 KiB/s wr, 78 op/s 2023-07-14T18:15:20.428 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:15:20 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T18:15:20.429 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:15:20 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-14T18:15:20.429 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:15:20 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:15:20.471 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:15:20 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:15:20.471 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:15:20 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:15:20.471 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:15:20 smithi163 ceph-mon[96576]: pgmap v380: 129 pgs: 129 active+clean; 110 MiB data, 863 MiB used, 1.0 TiB / 1.0 TiB avail; 380 KiB/s rd, 423 KiB/s wr, 78 op/s 2023-07-14T18:15:20.472 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:15:20 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T18:15:20.472 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:15:20 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-14T18:15:20.472 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:15:20 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:15:20.529 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:15:20 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:15:20.529 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:15:20 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:15:20.530 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:15:20 smithi172 ceph-mon[97983]: pgmap v380: 129 pgs: 129 active+clean; 110 MiB data, 863 MiB used, 1.0 TiB / 1.0 TiB avail; 380 KiB/s rd, 423 KiB/s wr, 78 op/s 2023-07-14T18:15:20.530 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:15:20 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T18:15:20.530 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:15:20 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-14T18:15:20.530 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:15:20 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:15:22.142 INFO:tasks.workunit.client.0.smithi163.stdout:checking sys/syssgi.h presence... no 2023-07-14T18:15:22.142 INFO:tasks.workunit.client.0.smithi163.stdout:checking for sys/syssgi.h... no 2023-07-14T18:15:22.378 INFO:tasks.workunit.client.0.smithi163.stdout:checking sys/param.h usability... yes 2023-07-14T18:15:22.404 INFO:tasks.workunit.client.0.smithi163.stdout:checking sys/param.h presence... yes 2023-07-14T18:15:22.405 INFO:tasks.workunit.client.0.smithi163.stdout:checking for sys/param.h... yes 2023-07-14T18:15:22.434 INFO:tasks.workunit.client.0.smithi163.stdout:checking for sys/stat.h... (cached) yes 2023-07-14T18:15:22.529 INFO:tasks.workunit.client.0.smithi163.stdout:checking sys/statvfs.h usability... yes 2023-07-14T18:15:22.555 INFO:tasks.workunit.client.0.smithi163.stdout:checking sys/statvfs.h presence... yes 2023-07-14T18:15:22.555 INFO:tasks.workunit.client.0.smithi163.stdout:checking for sys/statvfs.h... yes 2023-07-14T18:15:22.637 INFO:tasks.workunit.client.0.smithi163.stdout:checking sys/time.h usability... yes 2023-07-14T18:15:22.660 INFO:tasks.workunit.client.0.smithi163.stdout:checking sys/time.h presence... yes 2023-07-14T18:15:22.661 INFO:tasks.workunit.client.0.smithi163.stdout:checking for sys/time.h... yes 2023-07-14T18:15:22.743 INFO:tasks.workunit.client.0.smithi163.stdout:checking sys/ioctl.h usability... yes 2023-07-14T18:15:22.767 INFO:tasks.workunit.client.0.smithi163.stdout:checking sys/ioctl.h presence... yes 2023-07-14T18:15:22.768 INFO:tasks.workunit.client.0.smithi163.stdout:checking for sys/ioctl.h... yes 2023-07-14T18:15:22.851 INFO:tasks.workunit.client.0.smithi163.stdout:checking sys/wait.h usability... yes 2023-07-14T18:15:22.877 INFO:tasks.workunit.client.0.smithi163.stdout:checking sys/wait.h presence... yes 2023-07-14T18:15:22.878 INFO:tasks.workunit.client.0.smithi163.stdout:checking for sys/wait.h... yes 2023-07-14T18:15:22.905 INFO:tasks.workunit.client.0.smithi163.stdout:checking for sys/types.h... (cached) yes 2023-07-14T18:15:22.930 INFO:tasks.workunit.client.0.smithi163.stdout:checking for strings.h... (cached) yes 2023-07-14T18:15:23.012 INFO:tasks.workunit.client.0.smithi163.stdout:checking err.h usability... yes 2023-07-14T18:15:23.055 INFO:tasks.workunit.client.0.smithi163.stdout:checking err.h presence... yes 2023-07-14T18:15:23.056 INFO:tasks.workunit.client.0.smithi163.stdout:checking for err.h... yes 2023-07-14T18:15:23.138 INFO:tasks.workunit.client.0.smithi163.stdout:checking linux/falloc.h usability... yes 2023-07-14T18:15:23.161 INFO:tasks.workunit.client.0.smithi163.stdout:checking linux/falloc.h presence... yes 2023-07-14T18:15:23.162 INFO:tasks.workunit.client.0.smithi163.stdout:checking for linux/falloc.h... yes 2023-07-14T18:15:23.178 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:15:22 smithi184 ceph-mon[98481]: pgmap v381: 129 pgs: 129 active+clean; 110 MiB data, 864 MiB used, 1.0 TiB / 1.0 TiB avail; 242 KiB/s rd, 275 KiB/s wr, 62 op/s 2023-07-14T18:15:23.220 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:15:22 smithi163 ceph-mon[96576]: pgmap v381: 129 pgs: 129 active+clean; 110 MiB data, 864 MiB used, 1.0 TiB / 1.0 TiB avail; 242 KiB/s rd, 275 KiB/s wr, 62 op/s 2023-07-14T18:15:23.254 INFO:tasks.workunit.client.0.smithi163.stdout:checking sys/fs/xfs_fsops.h usability... no 2023-07-14T18:15:23.279 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:15:22 smithi172 ceph-mon[97983]: pgmap v381: 129 pgs: 129 active+clean; 110 MiB data, 864 MiB used, 1.0 TiB / 1.0 TiB avail; 242 KiB/s rd, 275 KiB/s wr, 62 op/s 2023-07-14T18:15:23.666 INFO:tasks.workunit.client.0.smithi163.stdout:checking sys/fs/xfs_fsops.h presence... no 2023-07-14T18:15:23.666 INFO:tasks.workunit.client.0.smithi163.stdout:checking for sys/fs/xfs_fsops.h... no 2023-07-14T18:15:23.736 INFO:tasks.workunit.client.0.smithi163.stdout:checking sys/fs/xfs_itable.h usability... no 2023-07-14T18:15:24.940 INFO:tasks.workunit.client.0.smithi163.stdout:checking sys/fs/xfs_itable.h presence... no 2023-07-14T18:15:24.941 INFO:tasks.workunit.client.0.smithi163.stdout:checking for sys/fs/xfs_itable.h... no 2023-07-14T18:15:25.014 INFO:tasks.workunit.client.0.smithi163.stdout:checking xfs/platform_defs.h usability... no 2023-07-14T18:15:25.178 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:15:24 smithi184 ceph-mon[98481]: pgmap v382: 129 pgs: 129 active+clean; 110 MiB data, 868 MiB used, 1.0 TiB / 1.0 TiB avail; 161 KiB/s rd, 158 KiB/s wr, 51 op/s 2023-07-14T18:15:25.220 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:15:24 smithi163 ceph-mon[96576]: pgmap v382: 129 pgs: 129 active+clean; 110 MiB data, 868 MiB used, 1.0 TiB / 1.0 TiB avail; 161 KiB/s rd, 158 KiB/s wr, 51 op/s 2023-07-14T18:15:25.279 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:15:24 smithi172 ceph-mon[97983]: pgmap v382: 129 pgs: 129 active+clean; 110 MiB data, 868 MiB used, 1.0 TiB / 1.0 TiB avail; 161 KiB/s rd, 158 KiB/s wr, 51 op/s 2023-07-14T18:15:27.178 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:15:26 smithi184 ceph-mon[98481]: pgmap v383: 129 pgs: 129 active+clean; 111 MiB data, 877 MiB used, 1.0 TiB / 1.0 TiB avail; 195 KiB/s rd, 196 KiB/s wr, 43 op/s 2023-07-14T18:15:27.220 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:15:26 smithi163 ceph-mon[96576]: pgmap v383: 129 pgs: 129 active+clean; 111 MiB data, 877 MiB used, 1.0 TiB / 1.0 TiB avail; 195 KiB/s rd, 196 KiB/s wr, 43 op/s 2023-07-14T18:15:27.279 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:15:26 smithi172 ceph-mon[97983]: pgmap v383: 129 pgs: 129 active+clean; 111 MiB data, 877 MiB used, 1.0 TiB / 1.0 TiB avail; 195 KiB/s rd, 196 KiB/s wr, 43 op/s 2023-07-14T18:15:28.673 INFO:tasks.workunit.client.0.smithi163.stdout:checking xfs/platform_defs.h presence... no 2023-07-14T18:15:28.674 INFO:tasks.workunit.client.0.smithi163.stdout:checking for xfs/platform_defs.h... no 2023-07-14T18:15:28.748 INFO:tasks.workunit.client.0.smithi163.stdout:checking btrfs/ioctl.h usability... no 2023-07-14T18:15:29.178 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:15:28 smithi184 ceph-mon[98481]: pgmap v384: 129 pgs: 129 active+clean; 111 MiB data, 878 MiB used, 1.0 TiB / 1.0 TiB avail; 81 KiB/s rd, 99 KiB/s wr, 29 op/s 2023-07-14T18:15:29.220 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:15:28 smithi163 ceph-mon[96576]: pgmap v384: 129 pgs: 129 active+clean; 111 MiB data, 878 MiB used, 1.0 TiB / 1.0 TiB avail; 81 KiB/s rd, 99 KiB/s wr, 29 op/s 2023-07-14T18:15:29.279 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:15:28 smithi172 ceph-mon[97983]: pgmap v384: 129 pgs: 129 active+clean; 111 MiB data, 878 MiB used, 1.0 TiB / 1.0 TiB avail; 81 KiB/s rd, 99 KiB/s wr, 29 op/s 2023-07-14T18:15:30.178 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:15:29 smithi184 ceph-mon[98481]: pgmap v385: 129 pgs: 129 active+clean; 111 MiB data, 878 MiB used, 1.0 TiB / 1.0 TiB avail; 84 KiB/s rd, 99 KiB/s wr, 34 op/s 2023-07-14T18:15:30.220 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:15:29 smithi163 ceph-mon[96576]: pgmap v385: 129 pgs: 129 active+clean; 111 MiB data, 878 MiB used, 1.0 TiB / 1.0 TiB avail; 84 KiB/s rd, 99 KiB/s wr, 34 op/s 2023-07-14T18:15:30.279 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:15:29 smithi172 ceph-mon[97983]: pgmap v385: 129 pgs: 129 active+clean; 111 MiB data, 878 MiB used, 1.0 TiB / 1.0 TiB avail; 84 KiB/s rd, 99 KiB/s wr, 34 op/s 2023-07-14T18:15:33.178 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:15:32 smithi184 ceph-mon[98481]: pgmap v386: 129 pgs: 129 active+clean; 111 MiB data, 878 MiB used, 1.0 TiB / 1.0 TiB avail; 84 KiB/s rd, 98 KiB/s wr, 30 op/s 2023-07-14T18:15:33.220 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:15:32 smithi163 ceph-mon[96576]: pgmap v386: 129 pgs: 129 active+clean; 111 MiB data, 878 MiB used, 1.0 TiB / 1.0 TiB avail; 84 KiB/s rd, 98 KiB/s wr, 30 op/s 2023-07-14T18:15:33.279 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:15:32 smithi172 ceph-mon[97983]: pgmap v386: 129 pgs: 129 active+clean; 111 MiB data, 878 MiB used, 1.0 TiB / 1.0 TiB avail; 84 KiB/s rd, 98 KiB/s wr, 30 op/s 2023-07-14T18:15:33.666 INFO:tasks.workunit.client.0.smithi163.stdout:checking btrfs/ioctl.h presence... no 2023-07-14T18:15:33.666 INFO:tasks.workunit.client.0.smithi163.stdout:checking for btrfs/ioctl.h... no 2023-07-14T18:15:33.737 INFO:tasks.workunit.client.0.smithi163.stdout:checking cifs/ioctl.h usability... no 2023-07-14T18:15:35.178 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:15:34 smithi184 ceph-mon[98481]: pgmap v387: 129 pgs: 129 active+clean; 111 MiB data, 878 MiB used, 1.0 TiB / 1.0 TiB avail; 69 KiB/s rd, 81 KiB/s wr, 31 op/s 2023-07-14T18:15:35.221 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:15:34 smithi163 ceph-mon[96576]: pgmap v387: 129 pgs: 129 active+clean; 111 MiB data, 878 MiB used, 1.0 TiB / 1.0 TiB avail; 69 KiB/s rd, 81 KiB/s wr, 31 op/s 2023-07-14T18:15:35.279 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:15:34 smithi172 ceph-mon[97983]: pgmap v387: 129 pgs: 129 active+clean; 111 MiB data, 878 MiB used, 1.0 TiB / 1.0 TiB avail; 69 KiB/s rd, 81 KiB/s wr, 31 op/s 2023-07-14T18:15:37.178 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:15:36 smithi184 ceph-mon[98481]: pgmap v388: 129 pgs: 129 active+clean; 111 MiB data, 878 MiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 83 KiB/s wr, 28 op/s 2023-07-14T18:15:37.221 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:15:36 smithi163 ceph-mon[96576]: pgmap v388: 129 pgs: 129 active+clean; 111 MiB data, 878 MiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 83 KiB/s wr, 28 op/s 2023-07-14T18:15:37.279 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:15:36 smithi172 ceph-mon[97983]: pgmap v388: 129 pgs: 129 active+clean; 111 MiB data, 878 MiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 83 KiB/s wr, 28 op/s 2023-07-14T18:15:37.870 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-07-14T18:15:38.007 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:15:37.963+0000 7fd807b1c700 1 -- 172.21.15.163:0/1888379554 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fd8000feb10 msgr2=0x7fd8000fef20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:15:38.007 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:15:37.963+0000 7fd807b1c700 1 --2- 172.21.15.163:0/1888379554 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fd8000feb10 0x7fd8000fef20 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7fd7fc009990 tx=0x7fd7fc009ca0 comp rx=0 tx=0).stop 2023-07-14T18:15:38.007 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:15:37.963+0000 7fd807b1c700 1 -- 172.21.15.163:0/1888379554 shutdown_connections 2023-07-14T18:15:38.007 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:15:37.963+0000 7fd807b1c700 1 --2- 172.21.15.163:0/1888379554 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd800100690 0x7fd800106f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:15:38.007 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:15:37.963+0000 7fd807b1c700 1 --2- 172.21.15.163:0/1888379554 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fd8000feb10 0x7fd8000fef20 unknown :-1 s=CLOSED pgs=674 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:15:38.008 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:15:37.963+0000 7fd807b1c700 1 --2- 172.21.15.163:0/1888379554 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd8000ffd00 0x7fd800100150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:15:38.008 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:15:37.963+0000 7fd807b1c700 1 -- 172.21.15.163:0/1888379554 >> 172.21.15.163:0/1888379554 conn(0x7fd8000fa130 msgr2=0x7fd8000fc560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:15:38.008 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:15:37.963+0000 7fd807b1c700 1 -- 172.21.15.163:0/1888379554 shutdown_connections 2023-07-14T18:15:38.008 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:15:37.963+0000 7fd807b1c700 1 -- 172.21.15.163:0/1888379554 wait complete. 2023-07-14T18:15:38.010 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:15:37.964+0000 7fd807b1c700 1 Processor -- start 2023-07-14T18:15:38.010 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:15:37.964+0000 7fd807b1c700 1 -- start start 2023-07-14T18:15:38.010 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:15:37.964+0000 7fd807b1c700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd8000feb10 0x7fd800068370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:15:38.010 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:15:37.964+0000 7fd807b1c700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fd8000ffd00 0x7fd80019a620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:15:38.011 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:15:37.964+0000 7fd807b1c700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd800100690 0x7fd80019ccb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:15:38.011 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:15:37.964+0000 7fd807b1c700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd80019d450 con 0x7fd8000ffd00 2023-07-14T18:15:38.011 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:15:37.964+0000 7fd807b1c700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd80019d5c0 con 0x7fd8000feb10 2023-07-14T18:15:38.011 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:15:37.964+0000 7fd807b1c700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd80019d780 con 0x7fd800100690 2023-07-14T18:15:38.011 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:15:37.964+0000 7fd8058b8700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd8000feb10 0x7fd800068370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:15:38.011 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:15:37.964+0000 7fd8050b7700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fd8000ffd00 0x7fd80019a620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:15:38.012 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:15:37.964+0000 7fd8050b7700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fd8000ffd00 0x7fd80019a620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:59520/0 (socket says 172.21.15.163:59520) 2023-07-14T18:15:38.012 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:15:37.964+0000 7fd8050b7700 1 -- 172.21.15.163:0/32265102 learned_addr learned my addr 172.21.15.163:0/32265102 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:15:38.012 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:15:37.964+0000 7fd8058b8700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd8000feb10 0x7fd800068370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.163:60202/0 (socket says 172.21.15.163:60202) 2023-07-14T18:15:38.012 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:15:37.964+0000 7fd8060b9700 1 --2- 172.21.15.163:0/32265102 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd800100690 0x7fd80019ccb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:15:38.012 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:15:37.965+0000 7fd8050b7700 1 -- 172.21.15.163:0/32265102 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd800100690 msgr2=0x7fd80019ccb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:15:38.012 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:15:37.965+0000 7fd8050b7700 1 --2- 172.21.15.163:0/32265102 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd800100690 0x7fd80019ccb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:15:38.012 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:15:37.965+0000 7fd8050b7700 1 -- 172.21.15.163:0/32265102 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd8000feb10 msgr2=0x7fd800068370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:15:38.013 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:15:37.965+0000 7fd8050b7700 1 --2- 172.21.15.163:0/32265102 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd8000feb10 0x7fd800068370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:15:38.013 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:15:37.965+0000 7fd8050b7700 1 -- 172.21.15.163:0/32265102 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7fc0095f0 con 0x7fd8000ffd00 2023-07-14T18:15:38.013 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:15:37.965+0000 7fd8058b8700 1 --2- 172.21.15.163:0/32265102 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd8000feb10 0x7fd800068370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T18:15:38.013 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:15:37.965+0000 7fd8060b9700 1 --2- 172.21.15.163:0/32265102 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd800100690 0x7fd80019ccb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T18:15:38.013 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:15:37.965+0000 7fd8050b7700 1 --2- 172.21.15.163:0/32265102 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fd8000ffd00 0x7fd80019a620 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7fd7f000e9a0 tx=0x7fd7f000ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:15:38.013 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:15:37.965+0000 7fd7f6ffd700 1 -- 172.21.15.163:0/32265102 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7f0009790 con 0x7fd8000ffd00 2023-07-14T18:15:38.014 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:15:37.965+0000 7fd807b1c700 1 -- 172.21.15.163:0/32265102 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd80019da60 con 0x7fd8000ffd00 2023-07-14T18:15:38.014 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:15:37.965+0000 7fd7f6ffd700 1 -- 172.21.15.163:0/32265102 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fd7f0010430 con 0x7fd8000ffd00 2023-07-14T18:15:38.014 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:15:37.965+0000 7fd7f6ffd700 1 -- 172.21.15.163:0/32265102 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7f000cea0 con 0x7fd8000ffd00 2023-07-14T18:15:38.014 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:15:37.965+0000 7fd807b1c700 1 -- 172.21.15.163:0/32265102 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd80019dfc0 con 0x7fd8000ffd00 2023-07-14T18:15:38.018 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:15:37.968+0000 7fd7f6ffd700 1 -- 172.21.15.163:0/32265102 <== mon.0 v2:172.21.15.163:3300/0 4 ==== mgrmap(e 18) v1 ==== 135716+0+0 (secure 0 0 0) 0x7fd7f00105a0 con 0x7fd8000ffd00 2023-07-14T18:15:38.019 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:15:37.968+0000 7fd7f6ffd700 1 --2- 172.21.15.163:0/32265102 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7fd7ec0a1150 0x7fd7ec0a3600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:15:38.019 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:15:37.969+0000 7fd7f6ffd700 1 -- 172.21.15.163:0/32265102 <== mon.0 v2:172.21.15.163:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 9049+0+0 (secure 0 0 0) 0x7fd7f0014070 con 0x7fd8000ffd00 2023-07-14T18:15:38.019 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:15:37.969+0000 7fd8058b8700 1 --2- 172.21.15.163:0/32265102 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7fd7ec0a1150 0x7fd7ec0a3600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:15:38.019 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:15:37.969+0000 7fd8058b8700 1 --2- 172.21.15.163:0/32265102 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7fd7ec0a1150 0x7fd7ec0a3600 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fd7fc0098e0 tx=0x7fd7fc00b260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:15:38.019 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:15:37.969+0000 7fd813cb4b80 1 Processor -- start 2023-07-14T18:15:38.019 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:15:37.970+0000 7fd813cb4b80 1 -- start start 2023-07-14T18:15:38.020 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:15:37.970+0000 7fd813cb4b80 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55b11cf59f60 0x55b11cf5a370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:15:38.020 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:15:37.970+0000 7fd813cb4b80 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55b11cf5a8b0 0x55b11cf5aed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:15:38.020 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:15:37.970+0000 7fd813cb4b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b11cf5b4b0 0x55b11cf5b920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:15:38.020 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:15:37.970+0000 7fd813cb4b80 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b11ce5ecb0 con 0x55b11cf5a8b0 2023-07-14T18:15:38.020 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:15:37.970+0000 7fd813cb4b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b11ceb1a40 con 0x55b11cf5b4b0 2023-07-14T18:15:38.020 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:15:37.970+0000 7fd813cb4b80 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b11ceaaed0 con 0x55b11cf59f60 2023-07-14T18:15:38.020 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:15:37.970+0000 7fd8050b7700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55b11cf5a8b0 0x55b11cf5aed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:15:38.021 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:15:37.970+0000 7fd8058b8700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55b11cf59f60 0x55b11cf5a370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:15:38.021 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:15:37.970+0000 7fd8060b9700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b11cf5b4b0 0x55b11cf5b920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:15:38.021 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:15:37.970+0000 7fd8058b8700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55b11cf59f60 0x55b11cf5a370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.163:41348/0 (socket says 172.21.15.163:41348) 2023-07-14T18:15:38.021 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:15:37.970+0000 7fd8058b8700 1 -- 172.21.15.163:0/666450805 learned_addr learned my addr 172.21.15.163:0/666450805 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:15:38.021 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:15:37.970+0000 7fd8060b9700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b11cf5b4b0 0x55b11cf5b920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.163:60214/0 (socket says 172.21.15.163:60214) 2023-07-14T18:15:38.021 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:15:37.970+0000 7fd8050b7700 1 -- 172.21.15.163:0/666450805 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55b11cf59f60 msgr2=0x55b11cf5a370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:15:38.021 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:15:37.970+0000 7fd8050b7700 1 --2- 172.21.15.163:0/666450805 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55b11cf59f60 0x55b11cf5a370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:15:38.022 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:15:37.970+0000 7fd8050b7700 1 -- 172.21.15.163:0/666450805 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b11cf5b4b0 msgr2=0x55b11cf5b920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:15:38.022 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:15:37.970+0000 7fd8050b7700 1 --2- 172.21.15.163:0/666450805 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b11cf5b4b0 0x55b11cf5b920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:15:38.022 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:15:37.970+0000 7fd8050b7700 1 -- 172.21.15.163:0/666450805 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b11ccd8de0 con 0x55b11cf5a8b0 2023-07-14T18:15:38.022 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:15:37.970+0000 7fd8060b9700 1 --2- 172.21.15.163:0/666450805 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b11cf5b4b0 0x55b11cf5b920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T18:15:38.022 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:15:37.970+0000 7fd8050b7700 1 --2- 172.21.15.163:0/666450805 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55b11cf5a8b0 0x55b11cf5aed0 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7fd7f00ca650 tx=0x7fd7f0099970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=abb9cb77b6d5b461 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:15:38.022 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:15:37.971+0000 7fd7ebfff700 1 -- 172.21.15.163:0/666450805 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7f009df40 con 0x55b11cf5a8b0 2023-07-14T18:15:38.022 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:15:37.971+0000 7fd7ebfff700 1 -- 172.21.15.163:0/666450805 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fd7f00a2360 con 0x55b11cf5a8b0 2023-07-14T18:15:38.023 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:15:37.971+0000 7fd7ebfff700 1 -- 172.21.15.163:0/666450805 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7f00a2130 con 0x55b11cf5a8b0 2023-07-14T18:15:38.023 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:15:37.971+0000 7fd813cb4b80 1 -- 172.21.15.163:0/666450805 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55b11cf5a8b0 msgr2=0x55b11cf5aed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:15:38.023 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:15:37.971+0000 7fd813cb4b80 1 --2- 172.21.15.163:0/666450805 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55b11cf5a8b0 0x55b11cf5aed0 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7fd7f00ca650 tx=0x7fd7f0099970 comp rx=0 tx=0).stop 2023-07-14T18:15:38.023 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:15:37.972+0000 7fd813cb4b80 1 -- 172.21.15.163:0/666450805 shutdown_connections 2023-07-14T18:15:38.023 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:15:37.972+0000 7fd813cb4b80 1 --2- 172.21.15.163:0/666450805 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55b11cf59f60 0x55b11cf5a370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:15:38.023 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:15:37.972+0000 7fd813cb4b80 1 --2- 172.21.15.163:0/666450805 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b11cf5b4b0 0x55b11cf5b920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:15:38.023 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:15:37.972+0000 7fd813cb4b80 1 --2- 172.21.15.163:0/666450805 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55b11cf5a8b0 0x55b11cf5aed0 unknown :-1 s=CLOSED pgs=676 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:15:38.024 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:15:37.972+0000 7fd813cb4b80 1 -- 172.21.15.163:0/666450805 >> 172.21.15.163:0/666450805 conn(0x55b11cf4f680 msgr2=0x55b11cf549d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:15:38.024 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:15:37.972+0000 7fd813cb4b80 1 -- 172.21.15.163:0/666450805 shutdown_connections 2023-07-14T18:15:38.024 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:15:37.972+0000 7fd813cb4b80 1 -- 172.21.15.163:0/666450805 wait complete. 2023-07-14T18:15:38.024 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:15:37.972+0000 7fd813cb4b80 1 -- start start 2023-07-14T18:15:38.024 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:15:37.972+0000 7fd813cb4b80 1 Processor -- start 2023-07-14T18:15:38.024 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:15:37.972+0000 7fd813cb4b80 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55b11cf59f60 0x55b11cf63960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:15:38.024 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:15:37.972+0000 7fd813cb4b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b11cf5a8b0 0x55b11cf63ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:15:38.025 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:15:37.973+0000 7fd813cb4b80 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55b11cf5b4b0 0x55b11cf6aee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:15:38.025 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:15:37.973+0000 7fd813cb4b80 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b11ce4aac0 con 0x55b11cf5b4b0 2023-07-14T18:15:38.025 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:15:37.973+0000 7fd813cb4b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b11ce4a7c0 con 0x55b11cf5a8b0 2023-07-14T18:15:38.025 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:15:37.973+0000 7fd813cb4b80 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b11cd2e920 con 0x55b11cf59f60 2023-07-14T18:15:38.025 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:15:37.973+0000 7fd813cb4b80 10 client.0 _ll_register_callbacks cb 0x55b11ce48760 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T18:15:38.025 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:15:37.973+0000 7fd8058b8700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55b11cf59f60 0x55b11cf63960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:15:38.025 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:15:37.973+0000 7fd8058b8700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55b11cf59f60 0x55b11cf63960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.163:41354/0 (socket says 172.21.15.163:41354) 2023-07-14T18:15:38.026 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:15:37.973+0000 7fd8058b8700 1 -- 172.21.15.163:0/3566304094 learned_addr learned my addr 172.21.15.163:0/3566304094 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:15:38.026 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:15:37.973+0000 7fd8060b9700 1 --2- 172.21.15.163:0/3566304094 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55b11cf5b4b0 0x55b11cf6aee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:15:38.026 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:15:37.973+0000 7fd8050b7700 1 --2- 172.21.15.163:0/3566304094 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b11cf5a8b0 0x55b11cf63ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:15:38.026 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:15:37.973+0000 7fd8058b8700 1 -- 172.21.15.163:0/3566304094 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b11cf5a8b0 msgr2=0x55b11cf63ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:15:38.026 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:15:37.973+0000 7fd8058b8700 1 --2- 172.21.15.163:0/3566304094 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b11cf5a8b0 0x55b11cf63ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:15:38.026 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:15:37.973+0000 7fd8058b8700 1 -- 172.21.15.163:0/3566304094 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55b11cf5b4b0 msgr2=0x55b11cf6aee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:15:38.026 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:15:37.973+0000 7fd8058b8700 1 --2- 172.21.15.163:0/3566304094 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55b11cf5b4b0 0x55b11cf6aee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:15:38.027 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:15:37.973+0000 7fd8058b8700 1 -- 172.21.15.163:0/3566304094 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd7f8003a60 con 0x55b11cf59f60 2023-07-14T18:15:38.027 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:15:37.973+0000 7fd8058b8700 1 --2- 172.21.15.163:0/3566304094 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55b11cf59f60 0x55b11cf63960 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fd7fc000c00 tx=0x7fd7fc020000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1bc631dc72ce9d61 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:15:38.027 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:15:37.973+0000 7fd7e97fa700 10 client.0 ms_handle_connect on v2:172.21.15.184:3300/0 2023-07-14T18:15:38.027 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:15:37.973+0000 7fd7e97fa700 1 -- 172.21.15.163:0/3566304094 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7fc02d040 con 0x55b11cf59f60 2023-07-14T18:15:38.027 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:15:37.974+0000 7fd7e97fa700 1 -- 172.21.15.163:0/3566304094 <== mon.1 v2:172.21.15.184:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 9049+0+0 (secure 0 0 0) 0x7fd7fc003d20 con 0x55b11cf59f60 2023-07-14T18:15:38.027 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:15:37.974+0000 7fd813cb4b80 1 -- 172.21.15.163:0/3566304094 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55b11ce044f0 con 0x55b11cf59f60 2023-07-14T18:15:38.027 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:15:37.974+0000 7fd7e97fa700 1 -- 172.21.15.163:0/3566304094 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd7fc00bea0 con 0x55b11cf59f60 2023-07-14T18:15:38.028 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:15:37.974+0000 7fd813cb4b80 10 client.25849 fetch_fsmap learned FSMap version 31 2023-07-14T18:15:38.028 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:15:37.974+0000 7fd813cb4b80 1 -- 172.21.15.163:0/3566304094 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) v3 -- 0x7fd80019dfc0 con 0x55b11cf59f60 2023-07-14T18:15:38.028 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:15:37.974+0000 7fd7e97fa700 1 -- 172.21.15.163:0/3566304094 <== mon.1 v2:172.21.15.184:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55b11ce044f0 con 0x55b11cf59f60 2023-07-14T18:15:38.028 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:15:37.974+0000 7fd7e97fa700 1 -- 172.21.15.163:0/3566304094 <== mon.1 v2:172.21.15.184:3300/0 5 ==== fsmap(e 31) v1 ==== 7486+0+0 (secure 0 0 0) 0x7fd7fc024410 con 0x55b11cf59f60 2023-07-14T18:15:38.028 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:15:37.974+0000 7fd813cb4b80 10 client.25849 fetch_fsmap finished waiting for FSMap version 31 2023-07-14T18:15:38.028 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:15:37.974+0000 7fd813cb4b80 10 client.25849 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-07-14T18:15:38.028 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:15:37.974+0000 7fd813cb4b80 20 client.25849 populate_metadata read hostname 'smithi163' 2023-07-14T18:15:38.029 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:15:37.974+0000 7fd813cb4b80 1 --2- 172.21.15.163:0/3566304094 >> [v2:172.21.15.172:6838/3850440096,v1:172.21.15.172:6839/3850440096] conn(0x55b11cf6f790 0x55b11cf71ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:15:38.029 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:15:37.974+0000 7fd813cb4b80 4 client.25849 mds_command: new command op to 24518 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-14T18:15:38.029 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:15:37.974+0000 7fd813cb4b80 1 -- 172.21.15.163:0/3566304094 --> [v2:172.21.15.172:6838/3850440096,v1:172.21.15.172:6839/3850440096] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55b11cf28da0 con 0x55b11cf6f790 2023-07-14T18:15:38.029 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:15:37.974+0000 7fd8050b7700 1 --2- 172.21.15.163:0/3566304094 >> [v2:172.21.15.172:6838/3850440096,v1:172.21.15.172:6839/3850440096] conn(0x55b11cf6f790 0x55b11cf71ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:15:38.029 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:15:37.975+0000 7fd8050b7700 1 --2- 172.21.15.163:0/3566304094 >> [v2:172.21.15.172:6838/3850440096,v1:172.21.15.172:6839/3850440096] conn(0x55b11cf6f790 0x55b11cf71ba0 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8cecfa35008bce6b server_cookie=980ab2a2ec83739e in_seq=0 out_seq=0 2023-07-14T18:15:38.029 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:15:37.975+0000 7fd7e97fa700 10 client.25849 ms_handle_connect on v2:172.21.15.172:6838/3850440096 2023-07-14T18:15:38.030 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:15:37.975+0000 7fd7e97fa700 1 -- 172.21.15.163:0/3566304094 <== mds.0 v2:172.21.15.172:6838/3850440096 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18017 (crc 0 0 0) 0x55b11cf28da0 con 0x55b11cf6f790 2023-07-14T18:15:38.031 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:15:37.975+0000 7fd7e97fa700 10 client.25849 handle_command_reply: tid=0 2023-07-14T18:15:38.031 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:15:37.976+0000 7fd813cb4b80 1 client.25849 shutdown 2023-07-14T18:15:38.031 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:15:37.976+0000 7fd813cb4b80 1 -- 172.21.15.163:0/3566304094 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55b11cf59f60 msgr2=0x55b11cf63960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:15:38.031 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:15:37.976+0000 7fd813cb4b80 1 --2- 172.21.15.163:0/3566304094 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55b11cf59f60 0x55b11cf63960 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fd7fc000c00 tx=0x7fd7fc020000 comp rx=0 tx=0).stop 2023-07-14T18:15:38.031 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:15:37.976+0000 7fd813cb4b80 1 -- 172.21.15.163:0/3566304094 shutdown_connections 2023-07-14T18:15:38.031 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:15:37.976+0000 7fd813cb4b80 1 --2- 172.21.15.163:0/3566304094 >> [v2:172.21.15.172:6838/3850440096,v1:172.21.15.172:6839/3850440096] conn(0x55b11cf6f790 0x55b11cf71ba0 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:15:38.031 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:15:37.976+0000 7fd813cb4b80 1 --2- 172.21.15.163:0/3566304094 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55b11cf59f60 0x55b11cf63960 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:15:38.032 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:15:37.976+0000 7fd813cb4b80 1 --2- 172.21.15.163:0/3566304094 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55b11cf5b4b0 0x55b11cf6aee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:15:38.032 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:15:37.976+0000 7fd813cb4b80 1 --2- 172.21.15.163:0/3566304094 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b11cf5a8b0 0x55b11cf63ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:15:38.032 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:15:37.976+0000 7fd7e97fa700 0 client.25849 ms_handle_reset on v2:172.21.15.172:6838/3850440096 2023-07-14T18:15:38.032 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:15:37.976+0000 7fd813cb4b80 1 -- 172.21.15.163:0/3566304094 >> 172.21.15.163:0/3566304094 conn(0x55b11cf4f680 msgr2=0x55b11cf53650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:15:38.032 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:15:37.976+0000 7fd813cb4b80 1 -- 172.21.15.163:0/3566304094 shutdown_connections 2023-07-14T18:15:38.032 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:15:37.976+0000 7fd813cb4b80 1 -- 172.21.15.163:0/3566304094 wait complete. 2023-07-14T18:15:38.033 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:15:37.976+0000 7fd813cb4b80 20 client.25849 trim_cache size 0 max 16384 2023-07-14T18:15:38.038 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:15:37.994+0000 7fd813cb4b80 1 Processor -- start 2023-07-14T18:15:38.039 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:15:37.994+0000 7fd813cb4b80 1 -- start start 2023-07-14T18:15:38.039 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:15:37.994+0000 7fd813cb4b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b11cf59f60 0x55b11cf5e330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:15:38.039 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:15:37.994+0000 7fd813cb4b80 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55b11cf5a8b0 0x55b11cf5e870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:15:38.039 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:15:37.994+0000 7fd813cb4b80 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55b11cf5b4b0 0x55b11cf6aea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:15:38.039 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:15:37.995+0000 7fd813cb4b80 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b11cf5b300 con 0x55b11cf5a8b0 2023-07-14T18:15:38.039 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:15:37.995+0000 7fd813cb4b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b11cf56450 con 0x55b11cf59f60 2023-07-14T18:15:38.040 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:15:37.995+0000 7fd813cb4b80 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b11cf64ae0 con 0x55b11cf5b4b0 2023-07-14T18:15:38.040 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:15:37.995+0000 7fd8050b7700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55b11cf5a8b0 0x55b11cf5e870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:15:38.040 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:15:37.995+0000 7fd8058b8700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b11cf59f60 0x55b11cf5e330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:15:38.040 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:15:37.995+0000 7fd8050b7700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55b11cf5a8b0 0x55b11cf5e870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:59542/0 (socket says 172.21.15.163:59542) 2023-07-14T18:15:38.040 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:15:37.995+0000 7fd8060b9700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55b11cf5b4b0 0x55b11cf6aea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:15:38.040 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:15:37.995+0000 7fd8050b7700 1 -- 172.21.15.163:0/1986577432 learned_addr learned my addr 172.21.15.163:0/1986577432 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:15:38.041 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:15:37.995+0000 7fd8058b8700 1 -- 172.21.15.163:0/1986577432 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55b11cf5b4b0 msgr2=0x55b11cf6aea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:15:38.041 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:15:37.995+0000 7fd8058b8700 1 --2- 172.21.15.163:0/1986577432 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55b11cf5b4b0 0x55b11cf6aea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:15:38.041 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:15:37.995+0000 7fd8058b8700 1 -- 172.21.15.163:0/1986577432 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55b11cf5a8b0 msgr2=0x55b11cf5e870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:15:38.041 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:15:37.995+0000 7fd8058b8700 1 --2- 172.21.15.163:0/1986577432 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55b11cf5a8b0 0x55b11cf5e870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:15:38.041 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:15:37.995+0000 7fd8058b8700 1 -- 172.21.15.163:0/1986577432 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b11ccc1c60 con 0x55b11cf59f60 2023-07-14T18:15:38.042 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:15:37.995+0000 7fd8050b7700 1 --2- 172.21.15.163:0/1986577432 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55b11cf5a8b0 0x55b11cf5e870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T18:15:38.042 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:15:37.995+0000 7fd8058b8700 1 --2- 172.21.15.163:0/1986577432 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b11cf59f60 0x55b11cf5e330 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fd7fc0247c0 tx=0x7fd7fc00bea0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=568ffe50b4c455ce server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:15:38.049 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:15:37.995+0000 7fd7f4daa700 1 -- 172.21.15.163:0/1986577432 <== mon.2 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7fc02d040 con 0x55b11cf59f60 2023-07-14T18:15:38.049 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:15:37.995+0000 7fd7f4daa700 1 -- 172.21.15.163:0/1986577432 <== mon.2 v2:172.21.15.172:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fd7fc01e040 con 0x55b11cf59f60 2023-07-14T18:15:38.049 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:15:37.995+0000 7fd7f4daa700 1 -- 172.21.15.163:0/1986577432 <== mon.2 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7fc024e00 con 0x55b11cf59f60 2023-07-14T18:15:38.050 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:15:37.996+0000 7fd813cb4b80 1 -- 172.21.15.163:0/1986577432 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b11cf59f60 msgr2=0x55b11cf5e330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:15:38.050 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:15:37.996+0000 7fd813cb4b80 1 --2- 172.21.15.163:0/1986577432 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b11cf59f60 0x55b11cf5e330 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fd7fc0247c0 tx=0x7fd7fc00bea0 comp rx=0 tx=0).stop 2023-07-14T18:15:38.050 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:15:37.996+0000 7fd813cb4b80 1 -- 172.21.15.163:0/1986577432 shutdown_connections 2023-07-14T18:15:38.051 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:15:37.996+0000 7fd813cb4b80 1 --2- 172.21.15.163:0/1986577432 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55b11cf5b4b0 0x55b11cf6aea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:15:38.051 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:15:37.996+0000 7fd813cb4b80 1 --2- 172.21.15.163:0/1986577432 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b11cf59f60 0x55b11cf5e330 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:15:38.051 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:15:37.996+0000 7fd813cb4b80 1 --2- 172.21.15.163:0/1986577432 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55b11cf5a8b0 0x55b11cf5e870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:15:38.051 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:15:37.996+0000 7fd813cb4b80 1 -- 172.21.15.163:0/1986577432 >> 172.21.15.163:0/1986577432 conn(0x55b11cf4f680 msgr2=0x55b11cf617e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:15:38.051 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:15:37.996+0000 7fd813cb4b80 1 -- 172.21.15.163:0/1986577432 shutdown_connections 2023-07-14T18:15:38.051 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:15:37.996+0000 7fd813cb4b80 1 -- 172.21.15.163:0/1986577432 wait complete. 2023-07-14T18:15:38.052 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:15:37.996+0000 7fd813cb4b80 1 -- start start 2023-07-14T18:15:38.052 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:15:37.996+0000 7fd813cb4b80 1 Processor -- start 2023-07-14T18:15:38.052 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:15:37.997+0000 7fd813cb4b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b11cf59f60 0x55b11cf6adb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:15:38.052 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:15:37.997+0000 7fd813cb4b80 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55b11cf5a8b0 0x55b11cf67850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:15:38.052 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:15:37.997+0000 7fd813cb4b80 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55b11cf5b4b0 0x55b11cf67dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:15:38.052 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:15:37.997+0000 7fd813cb4b80 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b11cfc3420 con 0x55b11cf5a8b0 2023-07-14T18:15:38.052 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:15:37.997+0000 7fd813cb4b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b11cfc3560 con 0x55b11cf59f60 2023-07-14T18:15:38.053 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:15:37.997+0000 7fd813cb4b80 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b11cfc36a0 con 0x55b11cf5b4b0 2023-07-14T18:15:38.053 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:15:37.997+0000 7fd813cb4b80 10 client.0 _ll_register_callbacks cb 0x55b11ce48760 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T18:15:38.053 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:15:37.997+0000 7fd8058b8700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b11cf59f60 0x55b11cf6adb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:15:38.053 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:15:37.997+0000 7fd8058b8700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b11cf59f60 0x55b11cf6adb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.163:60230/0 (socket says 172.21.15.163:60230) 2023-07-14T18:15:38.053 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:15:37.997+0000 7fd8058b8700 1 -- 172.21.15.163:0/1918261540 learned_addr learned my addr 172.21.15.163:0/1918261540 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:15:38.053 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:15:37.997+0000 7fd8050b7700 1 --2- 172.21.15.163:0/1918261540 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55b11cf5a8b0 0x55b11cf67850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:15:38.053 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:15:37.997+0000 7fd8060b9700 1 --2- 172.21.15.163:0/1918261540 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55b11cf5b4b0 0x55b11cf67dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:15:38.054 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:15:37.997+0000 7fd8058b8700 1 -- 172.21.15.163:0/1918261540 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55b11cf5b4b0 msgr2=0x55b11cf67dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:15:38.054 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:15:37.997+0000 7fd8058b8700 1 --2- 172.21.15.163:0/1918261540 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55b11cf5b4b0 0x55b11cf67dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:15:38.054 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:15:37.997+0000 7fd8058b8700 1 -- 172.21.15.163:0/1918261540 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55b11cf5a8b0 msgr2=0x55b11cf67850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:15:38.054 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:15:37.997+0000 7fd8058b8700 1 --2- 172.21.15.163:0/1918261540 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55b11cf5a8b0 0x55b11cf67850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:15:38.054 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:15:37.997+0000 7fd8058b8700 1 -- 172.21.15.163:0/1918261540 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55b11ccd8de0 con 0x55b11cf59f60 2023-07-14T18:15:38.054 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:15:37.997+0000 7fd8050b7700 1 --2- 172.21.15.163:0/1918261540 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55b11cf5a8b0 0x55b11cf67850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T18:15:38.054 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:15:37.998+0000 7fd8058b8700 1 --2- 172.21.15.163:0/1918261540 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b11cf59f60 0x55b11cf6adb0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fd7fc0249b0 tx=0x7fd7fc024640 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1bf7812dbca63fa3 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:15:38.055 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:15:37.998+0000 7fd7e97fa700 10 client.0 ms_handle_connect on v2:172.21.15.172:3300/0 2023-07-14T18:15:38.055 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:15:37.998+0000 7fd7e97fa700 1 -- 172.21.15.163:0/1918261540 <== mon.2 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7fc02d070 con 0x55b11cf59f60 2023-07-14T18:15:38.055 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:15:37.998+0000 7fd7e97fa700 1 -- 172.21.15.163:0/1918261540 <== mon.2 v2:172.21.15.172:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 9049+0+0 (secure 0 0 0) 0x7fd7fc003d20 con 0x55b11cf59f60 2023-07-14T18:15:38.055 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:15:37.998+0000 7fd813cb4b80 1 -- 172.21.15.163:0/1918261540 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fd7f00a2360 con 0x55b11cf59f60 2023-07-14T18:15:38.055 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:15:37.998+0000 7fd7e97fa700 1 -- 172.21.15.163:0/1918261540 <== mon.2 v2:172.21.15.172:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd7fc00fa20 con 0x55b11cf59f60 2023-07-14T18:15:38.055 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:15:37.998+0000 7fd813cb4b80 10 client.25922 fetch_fsmap learned FSMap version 31 2023-07-14T18:15:38.055 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:15:37.998+0000 7fd813cb4b80 1 -- 172.21.15.163:0/1918261540 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) v3 -- 0x7fd80019dfc0 con 0x55b11cf59f60 2023-07-14T18:15:38.056 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:15:37.998+0000 7fd7e97fa700 1 -- 172.21.15.163:0/1918261540 <== mon.2 v2:172.21.15.172:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fd7fc051020 con 0x55b11cf59f60 2023-07-14T18:15:38.056 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:15:37.998+0000 7fd7e97fa700 1 -- 172.21.15.163:0/1918261540 <== mon.2 v2:172.21.15.172:3300/0 5 ==== fsmap(e 31) v1 ==== 7486+0+0 (secure 0 0 0) 0x7fd7fc047030 con 0x55b11cf59f60 2023-07-14T18:15:38.056 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:15:37.998+0000 7fd813cb4b80 10 client.25922 fetch_fsmap finished waiting for FSMap version 31 2023-07-14T18:15:38.056 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:15:37.998+0000 7fd813cb4b80 10 client.25922 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-07-14T18:15:38.056 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:15:37.998+0000 7fd813cb4b80 20 client.25922 populate_metadata read hostname 'smithi163' 2023-07-14T18:15:38.056 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:15:37.998+0000 7fd813cb4b80 1 --2- 172.21.15.163:0/1918261540 >> [v2:172.21.15.172:6838/3850440096,v1:172.21.15.172:6839/3850440096] conn(0x55b11cfc4c60 0x55b11cfc7070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:15:38.056 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:15:37.998+0000 7fd813cb4b80 4 client.25922 mds_command: new command op to 24518 tid=0[{"prefix": "scrub status"}] 2023-07-14T18:15:38.057 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:15:37.998+0000 7fd813cb4b80 1 -- 172.21.15.163:0/1918261540 --> [v2:172.21.15.172:6838/3850440096,v1:172.21.15.172:6839/3850440096] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55b11cea3eb0 con 0x55b11cfc4c60 2023-07-14T18:15:38.057 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:15:37.999+0000 7fd8050b7700 1 --2- 172.21.15.163:0/1918261540 >> [v2:172.21.15.172:6838/3850440096,v1:172.21.15.172:6839/3850440096] conn(0x55b11cfc4c60 0x55b11cfc7070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:15:38.057 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:15:37.999+0000 7fd8050b7700 1 --2- 172.21.15.163:0/1918261540 >> [v2:172.21.15.172:6838/3850440096,v1:172.21.15.172:6839/3850440096] conn(0x55b11cfc4c60 0x55b11cfc7070 crc :-1 s=READY pgs=70 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=42525251cbeccaaf server_cookie=a900ffb65d2708cd in_seq=0 out_seq=0 2023-07-14T18:15:38.057 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:15:37.999+0000 7fd7e97fa700 10 client.25922 ms_handle_connect on v2:172.21.15.172:6838/3850440096 2023-07-14T18:15:38.057 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:15:37.999+0000 7fd7e97fa700 1 -- 172.21.15.163:0/1918261540 <== mds.0 v2:172.21.15.172:6838/3850440096 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+265 (crc 0 0 0) 0x55b11cea3eb0 con 0x55b11cfc4c60 2023-07-14T18:15:38.057 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:15:37.999+0000 7fd7e97fa700 10 client.25922 handle_command_reply: tid=0 2023-07-14T18:15:38.057 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:15:37.999+0000 7fd813cb4b80 1 client.25922 shutdown 2023-07-14T18:15:38.058 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:15:37.999+0000 7fd813cb4b80 1 -- 172.21.15.163:0/1918261540 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b11cf59f60 msgr2=0x55b11cf6adb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:15:38.058 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:15:37.999+0000 7fd813cb4b80 1 --2- 172.21.15.163:0/1918261540 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b11cf59f60 0x55b11cf6adb0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fd7fc0249b0 tx=0x7fd7fc024640 comp rx=0 tx=0).stop 2023-07-14T18:15:38.058 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:15:37.999+0000 7fd813cb4b80 1 -- 172.21.15.163:0/1918261540 shutdown_connections 2023-07-14T18:15:38.058 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:15:37.999+0000 7fd813cb4b80 1 --2- 172.21.15.163:0/1918261540 >> [v2:172.21.15.172:6838/3850440096,v1:172.21.15.172:6839/3850440096] conn(0x55b11cfc4c60 0x55b11cfc7070 crc :-1 s=READY pgs=70 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:15:38.058 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:15:37.999+0000 7fd813cb4b80 1 --2- 172.21.15.163:0/1918261540 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55b11cf5b4b0 0x55b11cf67dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:15:38.058 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:15:37.999+0000 7fd813cb4b80 1 --2- 172.21.15.163:0/1918261540 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b11cf59f60 0x55b11cf6adb0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:15:38.058 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:15:37.999+0000 7fd813cb4b80 1 --2- 172.21.15.163:0/1918261540 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55b11cf5a8b0 0x55b11cf67850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:15:38.058 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:15:37.999+0000 7fd7e97fa700 0 client.25922 ms_handle_reset on v2:172.21.15.172:6838/3850440096 2023-07-14T18:15:38.059 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:15:37.999+0000 7fd813cb4b80 1 -- 172.21.15.163:0/1918261540 >> 172.21.15.163:0/1918261540 conn(0x55b11cf4f680 msgr2=0x55b11cf5e330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:15:38.059 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:15:37.999+0000 7fd813cb4b80 1 -- 172.21.15.163:0/1918261540 shutdown_connections 2023-07-14T18:15:38.059 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:15:37.999+0000 7fd813cb4b80 1 -- 172.21.15.163:0/1918261540 wait complete. 2023-07-14T18:15:38.059 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:15:38.000+0000 7fd813cb4b80 20 client.25922 trim_cache size 0 max 16384 2023-07-14T18:15:38.059 INFO:teuthology.orchestra.run.smithi163.stdout:{ 2023-07-14T18:15:38.060 INFO:teuthology.orchestra.run.smithi163.stdout: "status": "scrub active (1 inodes in the stack)", 2023-07-14T18:15:38.060 INFO:teuthology.orchestra.run.smithi163.stdout: "scrubs": { 2023-07-14T18:15:38.060 INFO:teuthology.orchestra.run.smithi163.stdout: "2c53b7ef-6f30-49f0-a60d-f1f114c19d42": { 2023-07-14T18:15:38.060 INFO:teuthology.orchestra.run.smithi163.stdout: "path": "/", 2023-07-14T18:15:38.060 INFO:teuthology.orchestra.run.smithi163.stdout: "tag": "2c53b7ef-6f30-49f0-a60d-f1f114c19d42", 2023-07-14T18:15:38.060 INFO:teuthology.orchestra.run.smithi163.stdout: "options": "recursive,force" 2023-07-14T18:15:38.061 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-07-14T18:15:38.061 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-07-14T18:15:38.061 INFO:teuthology.orchestra.run.smithi163.stdout:} 2023-07-14T18:15:38.062 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:15:38.000+0000 7fd807b1c700 1 -- 172.21.15.163:0/32265102 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7fd7ec0a1150 msgr2=0x7fd7ec0a3600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:15:38.062 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:15:38.000+0000 7fd807b1c700 1 --2- 172.21.15.163:0/32265102 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7fd7ec0a1150 0x7fd7ec0a3600 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fd7fc0098e0 tx=0x7fd7fc00b260 comp rx=0 tx=0).stop 2023-07-14T18:15:38.062 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:15:38.000+0000 7fd807b1c700 1 -- 172.21.15.163:0/32265102 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fd8000ffd00 msgr2=0x7fd80019a620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:15:38.063 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:15:38.000+0000 7fd807b1c700 1 --2- 172.21.15.163:0/32265102 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fd8000ffd00 0x7fd80019a620 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7fd7f000e9a0 tx=0x7fd7f000ecb0 comp rx=0 tx=0).stop 2023-07-14T18:15:38.063 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:15:38.000+0000 7fd807b1c700 1 -- 172.21.15.163:0/32265102 shutdown_connections 2023-07-14T18:15:38.063 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:15:38.000+0000 7fd807b1c700 1 --2- 172.21.15.163:0/32265102 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7fd7ec0a1150 0x7fd7ec0a3600 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:15:38.063 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:15:38.000+0000 7fd807b1c700 1 --2- 172.21.15.163:0/32265102 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd800100690 0x7fd80019ccb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:15:38.063 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:15:38.000+0000 7fd807b1c700 1 --2- 172.21.15.163:0/32265102 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd8000feb10 0x7fd800068370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:15:38.063 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:15:38.000+0000 7fd807b1c700 1 --2- 172.21.15.163:0/32265102 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fd8000ffd00 0x7fd80019a620 unknown :-1 s=CLOSED pgs=675 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:15:38.063 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:15:38.000+0000 7fd807b1c700 1 -- 172.21.15.163:0/32265102 >> 172.21.15.163:0/32265102 conn(0x7fd8000fa130 msgr2=0x7fd8000fc4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:15:38.064 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:15:38.000+0000 7fd807b1c700 1 -- 172.21.15.163:0/32265102 shutdown_connections 2023-07-14T18:15:38.064 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:15:38.000+0000 7fd807b1c700 1 -- 172.21.15.163:0/32265102 wait complete. 2023-07-14T18:15:38.064 INFO:tasks.cephfs.filesystem:scrub status for tag:2c53b7ef-6f30-49f0-a60d-f1f114c19d42 - {'path': '/', 'tag': '2c53b7ef-6f30-49f0-a60d-f1f114c19d42', 'options': 'recursive,force'} 2023-07-14T18:15:38.178 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:15:37 smithi184 ceph-mon[98481]: pgmap v389: 129 pgs: 129 active+clean; 111 MiB data, 878 MiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 29 KiB/s wr, 21 op/s 2023-07-14T18:15:38.221 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:15:37 smithi163 ceph-mon[96576]: pgmap v389: 129 pgs: 129 active+clean; 111 MiB data, 878 MiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 29 KiB/s wr, 21 op/s 2023-07-14T18:15:38.279 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:15:37 smithi172 ceph-mon[97983]: pgmap v389: 129 pgs: 129 active+clean; 111 MiB data, 878 MiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 29 KiB/s wr, 21 op/s 2023-07-14T18:15:38.669 INFO:tasks.workunit.client.0.smithi163.stdout:checking cifs/ioctl.h presence... no 2023-07-14T18:15:38.669 INFO:tasks.workunit.client.0.smithi163.stdout:checking for cifs/ioctl.h... no 2023-07-14T18:15:38.735 INFO:tasks.workunit.client.0.smithi163.stdout:checking sys/mman.h usability... yes 2023-07-14T18:15:38.758 INFO:tasks.workunit.client.0.smithi163.stdout:checking sys/mman.h presence... yes 2023-07-14T18:15:38.759 INFO:tasks.workunit.client.0.smithi163.stdout:checking for sys/mman.h... yes 2023-07-14T18:15:38.827 INFO:tasks.workunit.client.0.smithi163.stdout:checking for xfs/xfs_log_format.h... no 2023-07-14T18:15:40.928 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:15:40 smithi184 ceph-mon[98481]: pgmap v390: 129 pgs: 129 active+clean; 111 MiB data, 882 MiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 25 KiB/s wr, 23 op/s 2023-07-14T18:15:40.971 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:15:40 smithi163 ceph-mon[96576]: pgmap v390: 129 pgs: 129 active+clean; 111 MiB data, 882 MiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 25 KiB/s wr, 23 op/s 2023-07-14T18:15:41.029 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:15:40 smithi172 ceph-mon[97983]: pgmap v390: 129 pgs: 129 active+clean; 111 MiB data, 882 MiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 25 KiB/s wr, 23 op/s 2023-07-14T18:15:43.178 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:15:42 smithi184 ceph-mon[98481]: pgmap v391: 129 pgs: 129 active+clean; 111 MiB data, 883 MiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 34 KiB/s wr, 17 op/s 2023-07-14T18:15:43.221 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:15:42 smithi163 ceph-mon[96576]: pgmap v391: 129 pgs: 129 active+clean; 111 MiB data, 883 MiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 34 KiB/s wr, 17 op/s 2023-07-14T18:15:43.279 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:15:42 smithi172 ceph-mon[97983]: pgmap v391: 129 pgs: 129 active+clean; 111 MiB data, 883 MiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 34 KiB/s wr, 17 op/s 2023-07-14T18:15:43.675 INFO:tasks.workunit.client.0.smithi163.stdout:checking for uuid_compare... no 2023-07-14T18:15:43.743 INFO:tasks.workunit.client.0.smithi163.stdout:checking for uuid_compare in -luuid... yes 2023-07-14T18:15:43.826 INFO:tasks.workunit.client.0.smithi163.stdout:checking for xfs/xfs.h... yes 2023-07-14T18:15:43.875 INFO:tasks.workunit.client.0.smithi163.stdout:checking for xfs/libxfs.h... no 2023-07-14T18:15:45.178 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:15:44 smithi184 ceph-mon[98481]: pgmap v392: 129 pgs: 129 active+clean; 111 MiB data, 883 MiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 24 KiB/s wr, 18 op/s 2023-07-14T18:15:45.221 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:15:44 smithi163 ceph-mon[96576]: pgmap v392: 129 pgs: 129 active+clean; 111 MiB data, 883 MiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 24 KiB/s wr, 18 op/s 2023-07-14T18:15:45.279 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:15:44 smithi172 ceph-mon[97983]: pgmap v392: 129 pgs: 129 active+clean; 111 MiB data, 883 MiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 24 KiB/s wr, 18 op/s 2023-07-14T18:15:47.178 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:15:46 smithi184 ceph-mon[98481]: pgmap v393: 129 pgs: 129 active+clean; 111 MiB data, 883 MiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 35 KiB/s wr, 17 op/s 2023-07-14T18:15:47.221 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:15:46 smithi163 ceph-mon[96576]: pgmap v393: 129 pgs: 129 active+clean; 111 MiB data, 883 MiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 35 KiB/s wr, 17 op/s 2023-07-14T18:15:47.279 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:15:46 smithi172 ceph-mon[97983]: pgmap v393: 129 pgs: 129 active+clean; 111 MiB data, 883 MiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 35 KiB/s wr, 17 op/s 2023-07-14T18:15:48.178 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:15:47 smithi184 ceph-mon[98481]: pgmap v394: 129 pgs: 129 active+clean; 111 MiB data, 883 MiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 30 KiB/s wr, 16 op/s 2023-07-14T18:15:48.221 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:15:47 smithi163 ceph-mon[96576]: pgmap v394: 129 pgs: 129 active+clean; 111 MiB data, 883 MiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 30 KiB/s wr, 16 op/s 2023-07-14T18:15:48.280 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:15:47 smithi172 ceph-mon[97983]: pgmap v394: 129 pgs: 129 active+clean; 111 MiB data, 883 MiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 30 KiB/s wr, 16 op/s 2023-07-14T18:15:48.666 INFO:tasks.workunit.client.0.smithi163.stdout:checking whether xlog_assign_lsn is declared... no 2023-07-14T18:15:48.718 INFO:tasks.workunit.client.0.smithi163.stdout:checking for xfs/xqm.h... yes 2023-07-14T18:15:48.799 INFO:tasks.workunit.client.0.smithi163.stdout:checking xfsctl from xfs/xfs.h... ok 2023-07-14T18:15:48.858 INFO:tasks.workunit.client.0.smithi163.stdout:checking xfs/handle.h usability... yes 2023-07-14T18:15:48.882 INFO:tasks.workunit.client.0.smithi163.stdout:checking xfs/handle.h presence... yes 2023-07-14T18:15:48.883 INFO:tasks.workunit.client.0.smithi163.stdout:checking for xfs/handle.h... yes 2023-07-14T18:15:48.964 INFO:tasks.workunit.client.0.smithi163.stdout:checking for attr_list_by_handle in -lhandle... yes 2023-07-14T18:15:49.039 INFO:tasks.workunit.client.0.smithi163.stdout:checking attr/attributes.h usability... yes 2023-07-14T18:15:49.064 INFO:tasks.workunit.client.0.smithi163.stdout:checking attr/attributes.h presence... yes 2023-07-14T18:15:49.065 INFO:tasks.workunit.client.0.smithi163.stdout:checking for attr/attributes.h... yes 2023-07-14T18:15:49.160 INFO:tasks.workunit.client.0.smithi163.stdout:checking sys/attributes.h usability... no 2023-07-14T18:15:50.928 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:15:50 smithi184 ceph-mon[98481]: pgmap v395: 129 pgs: 129 active+clean; 111 MiB data, 883 MiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 33 KiB/s wr, 22 op/s 2023-07-14T18:15:50.971 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:15:50 smithi163 ceph-mon[96576]: pgmap v395: 129 pgs: 129 active+clean; 111 MiB data, 883 MiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 33 KiB/s wr, 22 op/s 2023-07-14T18:15:51.029 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:15:50 smithi172 ceph-mon[97983]: pgmap v395: 129 pgs: 129 active+clean; 111 MiB data, 883 MiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 33 KiB/s wr, 22 op/s 2023-07-14T18:15:53.178 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:15:52 smithi184 ceph-mon[98481]: pgmap v396: 129 pgs: 129 active+clean; 111 MiB data, 884 MiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 58 KiB/s wr, 21 op/s 2023-07-14T18:15:53.221 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:15:52 smithi163 ceph-mon[96576]: pgmap v396: 129 pgs: 129 active+clean; 111 MiB data, 884 MiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 58 KiB/s wr, 21 op/s 2023-07-14T18:15:53.279 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:15:52 smithi172 ceph-mon[97983]: pgmap v396: 129 pgs: 129 active+clean; 111 MiB data, 884 MiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 58 KiB/s wr, 21 op/s 2023-07-14T18:15:53.668 INFO:tasks.workunit.client.0.smithi163.stdout:checking sys/attributes.h presence... no 2023-07-14T18:15:53.668 INFO:tasks.workunit.client.0.smithi163.stdout:checking for sys/attributes.h... no 2023-07-14T18:15:53.883 INFO:tasks.workunit.client.0.smithi163.stdout:checking for attr_list in -lattr... yes 2023-07-14T18:15:54.059 INFO:tasks.workunit.client.0.smithi163.stdout:checking for attr_set in -lattr... yes 2023-07-14T18:15:54.685 INFO:tasks.workunit.client.0.smithi163.stdout:checking sys/acl.h usability... yes 2023-07-14T18:15:54.708 INFO:tasks.workunit.client.0.smithi163.stdout:checking sys/acl.h presence... yes 2023-07-14T18:15:54.708 INFO:tasks.workunit.client.0.smithi163.stdout:checking for sys/acl.h... yes 2023-07-14T18:15:55.178 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:15:54 smithi184 ceph-mon[98481]: pgmap v397: 129 pgs: 129 active+clean; 111 MiB data, 884 MiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 48 KiB/s wr, 23 op/s 2023-07-14T18:15:55.221 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:15:54 smithi163 ceph-mon[96576]: pgmap v397: 129 pgs: 129 active+clean; 111 MiB data, 884 MiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 48 KiB/s wr, 23 op/s 2023-07-14T18:15:55.279 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:15:54 smithi172 ceph-mon[97983]: pgmap v397: 129 pgs: 129 active+clean; 111 MiB data, 884 MiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 48 KiB/s wr, 23 op/s 2023-07-14T18:15:55.552 INFO:tasks.workunit.client.0.smithi163.stdout:checking acl/libacl.h usability... yes 2023-07-14T18:15:55.577 INFO:tasks.workunit.client.0.smithi163.stdout:checking acl/libacl.h presence... yes 2023-07-14T18:15:55.577 INFO:tasks.workunit.client.0.smithi163.stdout:checking for acl/libacl.h... yes 2023-07-14T18:15:55.684 INFO:tasks.workunit.client.0.smithi163.stdout:checking for acl_init in -lacl... yes 2023-07-14T18:15:55.801 INFO:tasks.workunit.client.0.smithi163.stdout:checking gdbm-ndbm.h usability... no 2023-07-14T18:15:57.178 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:15:56 smithi184 ceph-mon[98481]: pgmap v398: 129 pgs: 129 active+clean; 111 MiB data, 884 MiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 60 KiB/s wr, 24 op/s 2023-07-14T18:15:57.221 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:15:56 smithi163 ceph-mon[96576]: pgmap v398: 129 pgs: 129 active+clean; 111 MiB data, 884 MiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 60 KiB/s wr, 24 op/s 2023-07-14T18:15:57.279 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:15:56 smithi172 ceph-mon[97983]: pgmap v398: 129 pgs: 129 active+clean; 111 MiB data, 884 MiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 60 KiB/s wr, 24 op/s 2023-07-14T18:15:58.670 INFO:tasks.workunit.client.0.smithi163.stdout:checking gdbm-ndbm.h presence... no 2023-07-14T18:15:58.671 INFO:tasks.workunit.client.0.smithi163.stdout:checking for gdbm-ndbm.h... no 2023-07-14T18:15:59.179 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:15:58 smithi184 ceph-mon[98481]: pgmap v399: 129 pgs: 129 active+clean; 111 MiB data, 884 MiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 51 KiB/s wr, 23 op/s 2023-07-14T18:15:59.221 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:15:58 smithi163 ceph-mon[96576]: pgmap v399: 129 pgs: 129 active+clean; 111 MiB data, 884 MiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 51 KiB/s wr, 23 op/s 2023-07-14T18:15:59.280 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:15:58 smithi172 ceph-mon[97983]: pgmap v399: 129 pgs: 129 active+clean; 111 MiB data, 884 MiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 51 KiB/s wr, 23 op/s 2023-07-14T18:16:01.179 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:16:00 smithi184 ceph-mon[98481]: pgmap v400: 129 pgs: 129 active+clean; 111 MiB data, 884 MiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 56 KiB/s wr, 28 op/s 2023-07-14T18:16:01.221 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:16:00 smithi163 ceph-mon[96576]: pgmap v400: 129 pgs: 129 active+clean; 111 MiB data, 884 MiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 56 KiB/s wr, 28 op/s 2023-07-14T18:16:01.279 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:16:00 smithi172 ceph-mon[97983]: pgmap v400: 129 pgs: 129 active+clean; 111 MiB data, 884 MiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 56 KiB/s wr, 28 op/s 2023-07-14T18:16:02.179 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:16:01 smithi184 ceph-mon[98481]: pgmap v401: 129 pgs: 129 active+clean; 112 MiB data, 885 MiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 72 KiB/s wr, 25 op/s 2023-07-14T18:16:02.221 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:16:01 smithi163 ceph-mon[96576]: pgmap v401: 129 pgs: 129 active+clean; 112 MiB data, 885 MiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 72 KiB/s wr, 25 op/s 2023-07-14T18:16:02.279 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:16:01 smithi172 ceph-mon[97983]: pgmap v401: 129 pgs: 129 active+clean; 112 MiB data, 885 MiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 72 KiB/s wr, 25 op/s 2023-07-14T18:16:03.669 INFO:tasks.workunit.client.0.smithi163.stdout:checking gdbm/ndbm.h usability... no 2023-07-14T18:16:04.929 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:16:04 smithi184 ceph-mon[98481]: pgmap v402: 129 pgs: 129 active+clean; 112 MiB data, 885 MiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 47 KiB/s wr, 25 op/s 2023-07-14T18:16:04.971 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:16:04 smithi163 ceph-mon[96576]: pgmap v402: 129 pgs: 129 active+clean; 112 MiB data, 885 MiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 47 KiB/s wr, 25 op/s 2023-07-14T18:16:05.029 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:16:04 smithi172 ceph-mon[97983]: pgmap v402: 129 pgs: 129 active+clean; 112 MiB data, 885 MiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 47 KiB/s wr, 25 op/s 2023-07-14T18:16:07.179 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:16:06 smithi184 ceph-mon[98481]: pgmap v403: 129 pgs: 129 active+clean; 112 MiB data, 885 MiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 47 KiB/s wr, 22 op/s 2023-07-14T18:16:07.221 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:16:06 smithi163 ceph-mon[96576]: pgmap v403: 129 pgs: 129 active+clean; 112 MiB data, 885 MiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 47 KiB/s wr, 22 op/s 2023-07-14T18:16:07.280 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:16:06 smithi172 ceph-mon[97983]: pgmap v403: 129 pgs: 129 active+clean; 112 MiB data, 885 MiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 47 KiB/s wr, 22 op/s 2023-07-14T18:16:08.065 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-07-14T18:16:08.179 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:16:07 smithi184 ceph-mon[98481]: pgmap v404: 129 pgs: 129 active+clean; 112 MiB data, 885 MiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 33 KiB/s wr, 17 op/s 2023-07-14T18:16:08.211 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:16:08.163+0000 7f3caea27700 1 -- 172.21.15.163:0/1818263114 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f3ca81018f0 msgr2=0x7f3ca81081b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:16:08.211 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:16:08.163+0000 7f3caea27700 1 --2- 172.21.15.163:0/1818263114 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f3ca81018f0 0x7f3ca81081b0 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7f3ca000b0a0 tx=0x7f3ca000b3b0 comp rx=0 tx=0).stop 2023-07-14T18:16:08.211 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:16:08.163+0000 7f3caea27700 1 -- 172.21.15.163:0/1818263114 shutdown_connections 2023-07-14T18:16:08.211 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:16:08.163+0000 7f3caea27700 1 --2- 172.21.15.163:0/1818263114 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f3ca81018f0 0x7f3ca81081b0 unknown :-1 s=CLOSED pgs=677 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:16:08.212 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:16:08.163+0000 7f3caea27700 1 --2- 172.21.15.163:0/1818263114 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3ca80fdf90 0x7f3ca80fe3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:16:08.212 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:16:08.163+0000 7f3caea27700 1 --2- 172.21.15.163:0/1818263114 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3ca8100f60 0x7f3ca81013b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:16:08.212 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:16:08.163+0000 7f3caea27700 1 -- 172.21.15.163:0/1818263114 >> 172.21.15.163:0/1818263114 conn(0x7f3ca80f9950 msgr2=0x7f3ca80fbda0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:16:08.212 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:16:08.163+0000 7f3caea27700 1 -- 172.21.15.163:0/1818263114 shutdown_connections 2023-07-14T18:16:08.213 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:16:08.163+0000 7f3caea27700 1 -- 172.21.15.163:0/1818263114 wait complete. 2023-07-14T18:16:08.213 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:16:08.164+0000 7f3caea27700 1 Processor -- start 2023-07-14T18:16:08.213 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:16:08.164+0000 7f3caea27700 1 -- start start 2023-07-14T18:16:08.213 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:16:08.164+0000 7f3caea27700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f3ca80fdf90 0x7f3ca81959b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:16:08.213 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:16:08.164+0000 7f3caea27700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3ca8100f60 0x7f3ca8195ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:16:08.214 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:16:08.164+0000 7f3caea27700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3ca81018f0 0x7f3ca819cf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:16:08.214 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:16:08.164+0000 7f3caea27700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ca819d530 con 0x7f3ca80fdf90 2023-07-14T18:16:08.214 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:16:08.164+0000 7f3caea27700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ca819d670 con 0x7f3ca81018f0 2023-07-14T18:16:08.214 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:16:08.164+0000 7f3caea27700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ca819d800 con 0x7f3ca8100f60 2023-07-14T18:16:08.215 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:16:08.164+0000 7f3ca7fff700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f3ca80fdf90 0x7f3ca81959b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:16:08.215 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:16:08.164+0000 7f3cacfc4700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3ca81018f0 0x7f3ca819cf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:16:08.215 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:16:08.164+0000 7f3ca7fff700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f3ca80fdf90 0x7f3ca81959b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:59560/0 (socket says 172.21.15.163:59560) 2023-07-14T18:16:08.215 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:16:08.164+0000 7f3ca77fe700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3ca8100f60 0x7f3ca8195ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:16:08.215 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:16:08.164+0000 7f3ca7fff700 1 -- 172.21.15.163:0/2295002104 learned_addr learned my addr 172.21.15.163:0/2295002104 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:16:08.216 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:16:08.165+0000 7f3ca7fff700 1 -- 172.21.15.163:0/2295002104 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3ca8100f60 msgr2=0x7f3ca8195ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:16:08.216 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:16:08.165+0000 7f3ca7fff700 1 --2- 172.21.15.163:0/2295002104 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3ca8100f60 0x7f3ca8195ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:16:08.216 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:16:08.165+0000 7f3ca7fff700 1 -- 172.21.15.163:0/2295002104 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3ca81018f0 msgr2=0x7f3ca819cf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:16:08.216 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:16:08.165+0000 7f3ca7fff700 1 --2- 172.21.15.163:0/2295002104 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3ca81018f0 0x7f3ca819cf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:16:08.217 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:16:08.165+0000 7f3ca7fff700 1 -- 172.21.15.163:0/2295002104 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ca0009d00 con 0x7f3ca80fdf90 2023-07-14T18:16:08.217 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:16:08.165+0000 7f3cacfc4700 1 --2- 172.21.15.163:0/2295002104 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3ca81018f0 0x7f3ca819cf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T18:16:08.217 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:16:08.165+0000 7f3ca7fff700 1 --2- 172.21.15.163:0/2295002104 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f3ca80fdf90 0x7f3ca81959b0 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7f3c98009c80 tx=0x7f3c98009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:16:08.217 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:16:08.165+0000 7f3ca57fa700 1 -- 172.21.15.163:0/2295002104 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c98015070 con 0x7f3ca80fdf90 2023-07-14T18:16:08.217 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:16:08.165+0000 7f3caea27700 1 -- 172.21.15.163:0/2295002104 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ca80fedb0 con 0x7f3ca80fdf90 2023-07-14T18:16:08.218 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:16:08.165+0000 7f3ca57fa700 1 -- 172.21.15.163:0/2295002104 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f3c98004020 con 0x7f3ca80fdf90 2023-07-14T18:16:08.218 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:16:08.165+0000 7f3ca57fa700 1 -- 172.21.15.163:0/2295002104 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c98003b80 con 0x7f3ca80fdf90 2023-07-14T18:16:08.218 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:16:08.165+0000 7f3caea27700 1 -- 172.21.15.163:0/2295002104 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ca80ff2c0 con 0x7f3ca80fdf90 2023-07-14T18:16:08.226 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:16:08.167+0000 7f3ca57fa700 1 -- 172.21.15.163:0/2295002104 <== mon.0 v2:172.21.15.163:3300/0 4 ==== mgrmap(e 18) v1 ==== 135716+0+0 (secure 0 0 0) 0x7f3c98004190 con 0x7f3ca80fdf90 2023-07-14T18:16:08.226 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:16:08.168+0000 7f3ca57fa700 1 --2- 172.21.15.163:0/2295002104 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f3c900a1150 0x7f3c900a3600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:16:08.226 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:16:08.168+0000 7f3ca77fe700 1 --2- 172.21.15.163:0/2295002104 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f3c900a1150 0x7f3c900a3600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:16:08.227 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:16:08.168+0000 7f3ca57fa700 1 -- 172.21.15.163:0/2295002104 <== mon.0 v2:172.21.15.163:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 9049+0+0 (secure 0 0 0) 0x7f3c980d0590 con 0x7f3ca80fdf90 2023-07-14T18:16:08.227 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:16:08.168+0000 7f3ca77fe700 1 --2- 172.21.15.163:0/2295002104 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f3c900a1150 0x7f3c900a3600 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f3c9c009c60 tx=0x7f3c9c009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:16:08.227 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:16:08.169+0000 7f3cbabbfb80 1 Processor -- start 2023-07-14T18:16:08.228 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:16:08.169+0000 7f3cbabbfb80 1 -- start start 2023-07-14T18:16:08.228 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:16:08.169+0000 7f3cbabbfb80 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x564e6acbaf60 0x564e6acbb370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:16:08.228 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:16:08.169+0000 7f3cbabbfb80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564e6acbb8b0 0x564e6acbbed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:16:08.228 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:16:08.169+0000 7f3cbabbfb80 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x564e6acbc4b0 0x564e6acbc920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:16:08.229 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:16:08.169+0000 7f3cbabbfb80 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x564e6abbfcb0 con 0x564e6acbaf60 2023-07-14T18:16:08.229 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:16:08.169+0000 7f3cbabbfb80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x564e6ac12a40 con 0x564e6acbb8b0 2023-07-14T18:16:08.229 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:16:08.169+0000 7f3cbabbfb80 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x564e6ac0bed0 con 0x564e6acbc4b0 2023-07-14T18:16:08.229 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:16:08.169+0000 7f3ca7fff700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x564e6acbaf60 0x564e6acbb370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:16:08.229 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:16:08.169+0000 7f3ca77fe700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564e6acbb8b0 0x564e6acbbed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:16:08.230 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:16:08.169+0000 7f3ca77fe700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564e6acbb8b0 0x564e6acbbed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.163:60254/0 (socket says 172.21.15.163:60254) 2023-07-14T18:16:08.230 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:16:08.169+0000 7f3ca77fe700 1 -- 172.21.15.163:0/3507903462 learned_addr learned my addr 172.21.15.163:0/3507903462 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:16:08.230 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:16:08.169+0000 7f3cacfc4700 1 --2- 172.21.15.163:0/3507903462 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x564e6acbc4b0 0x564e6acbc920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:16:08.230 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:16:08.169+0000 7f3ca77fe700 1 -- 172.21.15.163:0/3507903462 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x564e6acbc4b0 msgr2=0x564e6acbc920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:16:08.230 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:16:08.169+0000 7f3ca77fe700 1 --2- 172.21.15.163:0/3507903462 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x564e6acbc4b0 0x564e6acbc920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:16:08.230 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:16:08.169+0000 7f3ca77fe700 1 -- 172.21.15.163:0/3507903462 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x564e6acbaf60 msgr2=0x564e6acbb370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:16:08.230 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:16:08.169+0000 7f3ca77fe700 1 --2- 172.21.15.163:0/3507903462 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x564e6acbaf60 0x564e6acbb370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:16:08.231 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:16:08.169+0000 7f3ca77fe700 1 -- 172.21.15.163:0/3507903462 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564e6aa39de0 con 0x564e6acbb8b0 2023-07-14T18:16:08.231 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:16:08.169+0000 7f3ca7fff700 1 --2- 172.21.15.163:0/3507903462 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x564e6acbaf60 0x564e6acbb370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T18:16:08.231 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:16:08.170+0000 7f3ca77fe700 1 --2- 172.21.15.163:0/3507903462 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564e6acbb8b0 0x564e6acbbed0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f3c9c00e4e0 tx=0x7f3c9c014000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dd5859a7b16e5619 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:16:08.231 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:16:08.170+0000 7f3c8e7fc700 1 -- 172.21.15.163:0/3507903462 <== mon.2 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c9c00ee00 con 0x564e6acbb8b0 2023-07-14T18:16:08.231 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:16:08.170+0000 7f3c8e7fc700 1 -- 172.21.15.163:0/3507903462 <== mon.2 v2:172.21.15.172:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f3c9c021070 con 0x564e6acbb8b0 2023-07-14T18:16:08.231 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:16:08.170+0000 7f3c8e7fc700 1 -- 172.21.15.163:0/3507903462 <== mon.2 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c9c01d780 con 0x564e6acbb8b0 2023-07-14T18:16:08.231 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:16:08.171+0000 7f3cbabbfb80 1 -- 172.21.15.163:0/3507903462 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564e6acbb8b0 msgr2=0x564e6acbbed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:16:08.232 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:16:08.171+0000 7f3cbabbfb80 1 --2- 172.21.15.163:0/3507903462 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564e6acbb8b0 0x564e6acbbed0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f3c9c00e4e0 tx=0x7f3c9c014000 comp rx=0 tx=0).stop 2023-07-14T18:16:08.232 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:16:08.171+0000 7f3cbabbfb80 1 -- 172.21.15.163:0/3507903462 shutdown_connections 2023-07-14T18:16:08.232 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:16:08.171+0000 7f3cbabbfb80 1 --2- 172.21.15.163:0/3507903462 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x564e6acbc4b0 0x564e6acbc920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:16:08.232 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:16:08.171+0000 7f3cbabbfb80 1 --2- 172.21.15.163:0/3507903462 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x564e6acbaf60 0x564e6acbb370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:16:08.232 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:16:08.171+0000 7f3cbabbfb80 1 --2- 172.21.15.163:0/3507903462 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564e6acbb8b0 0x564e6acbbed0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:16:08.232 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:16:08.171+0000 7f3cbabbfb80 1 -- 172.21.15.163:0/3507903462 >> 172.21.15.163:0/3507903462 conn(0x564e6acb0680 msgr2=0x564e6acb59d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:16:08.232 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:16:08.171+0000 7f3cbabbfb80 1 -- 172.21.15.163:0/3507903462 shutdown_connections 2023-07-14T18:16:08.233 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:16:08.171+0000 7f3cbabbfb80 1 -- 172.21.15.163:0/3507903462 wait complete. 2023-07-14T18:16:08.233 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:16:08.171+0000 7f3cbabbfb80 1 -- start start 2023-07-14T18:16:08.233 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:16:08.171+0000 7f3cbabbfb80 1 Processor -- start 2023-07-14T18:16:08.233 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:16:08.172+0000 7f3cbabbfb80 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x564e6acbaf60 0x564e6acc4960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:16:08.233 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:16:08.172+0000 7f3cbabbfb80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564e6acbb8b0 0x564e6acc4ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:16:08.233 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:16:08.172+0000 7f3cbabbfb80 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x564e6acbc4b0 0x564e6accbee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:16:08.233 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:16:08.172+0000 7f3cbabbfb80 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x564e6ababac0 con 0x564e6acbaf60 2023-07-14T18:16:08.234 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:16:08.172+0000 7f3cbabbfb80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x564e6abab7c0 con 0x564e6acbb8b0 2023-07-14T18:16:08.234 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:16:08.172+0000 7f3cbabbfb80 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x564e6aa8f920 con 0x564e6acbc4b0 2023-07-14T18:16:08.234 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:16:08.172+0000 7f3cbabbfb80 10 client.0 _ll_register_callbacks cb 0x564e6aba9760 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T18:16:08.234 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:16:08.172+0000 7f3ca7fff700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x564e6acbaf60 0x564e6acc4960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:16:08.234 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:16:08.172+0000 7f3ca77fe700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564e6acbb8b0 0x564e6acc4ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:16:08.234 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:16:08.172+0000 7f3cacfc4700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x564e6acbc4b0 0x564e6accbee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:16:08.234 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:16:08.172+0000 7f3ca7fff700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x564e6acbaf60 0x564e6acc4960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:59574/0 (socket says 172.21.15.163:59574) 2023-07-14T18:16:08.234 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:16:08.172+0000 7f3ca7fff700 1 -- 172.21.15.163:0/3363643656 learned_addr learned my addr 172.21.15.163:0/3363643656 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:16:08.235 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:16:08.172+0000 7f3ca77fe700 1 -- 172.21.15.163:0/3363643656 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x564e6acbc4b0 msgr2=0x564e6accbee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:16:08.235 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:16:08.172+0000 7f3ca77fe700 1 --2- 172.21.15.163:0/3363643656 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x564e6acbc4b0 0x564e6accbee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:16:08.235 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:16:08.172+0000 7f3ca77fe700 1 -- 172.21.15.163:0/3363643656 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x564e6acbaf60 msgr2=0x564e6acc4960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:16:08.235 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:16:08.172+0000 7f3ca77fe700 1 --2- 172.21.15.163:0/3363643656 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x564e6acbaf60 0x564e6acc4960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:16:08.235 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:16:08.172+0000 7f3ca77fe700 1 -- 172.21.15.163:0/3363643656 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ca80ff2c0 con 0x564e6acbb8b0 2023-07-14T18:16:08.235 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:16:08.172+0000 7f3cacfc4700 1 --2- 172.21.15.163:0/3363643656 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x564e6acbc4b0 0x564e6accbee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T18:16:08.236 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:16:08.172+0000 7f3ca7fff700 1 --2- 172.21.15.163:0/3363643656 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x564e6acbaf60 0x564e6acc4960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T18:16:08.236 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:16:08.172+0000 7f3ca77fe700 1 --2- 172.21.15.163:0/3363643656 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564e6acbb8b0 0x564e6acc4ea0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f3c9c00ead0 tx=0x7f3c9c00ee90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9fe88f39ba868456 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:16:08.236 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:16:08.172+0000 7f3c877fe700 10 client.0 ms_handle_connect on v2:172.21.15.172:3300/0 2023-07-14T18:16:08.236 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:16:08.172+0000 7f3c877fe700 1 -- 172.21.15.163:0/3363643656 <== mon.2 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c9c005350 con 0x564e6acbb8b0 2023-07-14T18:16:08.236 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:16:08.172+0000 7f3c877fe700 1 -- 172.21.15.163:0/3363643656 <== mon.2 v2:172.21.15.172:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 9049+0+0 (secure 0 0 0) 0x7f3c9c0054b0 con 0x564e6acbb8b0 2023-07-14T18:16:08.236 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:16:08.173+0000 7f3cbabbfb80 1 -- 172.21.15.163:0/3363643656 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x564e6ab654f0 con 0x564e6acbb8b0 2023-07-14T18:16:08.237 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:16:08.173+0000 7f3c877fe700 1 -- 172.21.15.163:0/3363643656 <== mon.2 v2:172.21.15.172:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3c9c005670 con 0x564e6acbb8b0 2023-07-14T18:16:08.237 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:16:08.173+0000 7f3cbabbfb80 10 client.25934 fetch_fsmap learned FSMap version 31 2023-07-14T18:16:08.237 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:16:08.173+0000 7f3cbabbfb80 1 -- 172.21.15.163:0/3363643656 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) v3 -- 0x7f3c9c017070 con 0x564e6acbb8b0 2023-07-14T18:16:08.237 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:16:08.173+0000 7f3c877fe700 1 -- 172.21.15.163:0/3363643656 <== mon.2 v2:172.21.15.172:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x564e6ab654f0 con 0x564e6acbb8b0 2023-07-14T18:16:08.237 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:16:08.173+0000 7f3c877fe700 1 -- 172.21.15.163:0/3363643656 <== mon.2 v2:172.21.15.172:3300/0 5 ==== fsmap(e 31) v1 ==== 7486+0+0 (secure 0 0 0) 0x7f3c9c01c780 con 0x564e6acbb8b0 2023-07-14T18:16:08.237 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:16:08.173+0000 7f3cbabbfb80 10 client.25934 fetch_fsmap finished waiting for FSMap version 31 2023-07-14T18:16:08.237 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:16:08.173+0000 7f3cbabbfb80 10 client.25934 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-07-14T18:16:08.238 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:16:08.173+0000 7f3cbabbfb80 20 client.25934 populate_metadata read hostname 'smithi163' 2023-07-14T18:16:08.238 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:16:08.173+0000 7f3cbabbfb80 1 --2- 172.21.15.163:0/3363643656 >> [v2:172.21.15.172:6838/3850440096,v1:172.21.15.172:6839/3850440096] conn(0x564e6acd0760 0x564e6acd2b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:16:08.238 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:16:08.173+0000 7f3cbabbfb80 4 client.25934 mds_command: new command op to 24518 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-14T18:16:08.238 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:16:08.173+0000 7f3cbabbfb80 1 -- 172.21.15.163:0/3363643656 --> [v2:172.21.15.172:6838/3850440096,v1:172.21.15.172:6839/3850440096] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x564e6ac89da0 con 0x564e6acd0760 2023-07-14T18:16:08.238 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:16:08.173+0000 7f3ca7fff700 1 --2- 172.21.15.163:0/3363643656 >> [v2:172.21.15.172:6838/3850440096,v1:172.21.15.172:6839/3850440096] conn(0x564e6acd0760 0x564e6acd2b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:16:08.238 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:16:08.174+0000 7f3ca7fff700 1 --2- 172.21.15.163:0/3363643656 >> [v2:172.21.15.172:6838/3850440096,v1:172.21.15.172:6839/3850440096] conn(0x564e6acd0760 0x564e6acd2b70 crc :-1 s=READY pgs=71 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c8e032a3cabbac4c server_cookie=6baed685985209ca in_seq=0 out_seq=0 2023-07-14T18:16:08.238 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:16:08.174+0000 7f3c877fe700 10 client.25934 ms_handle_connect on v2:172.21.15.172:6838/3850440096 2023-07-14T18:16:08.239 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:16:08.174+0000 7f3c877fe700 1 -- 172.21.15.163:0/3363643656 <== mds.0 v2:172.21.15.172:6838/3850440096 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18017 (crc 0 0 0) 0x564e6ac89da0 con 0x564e6acd0760 2023-07-14T18:16:08.239 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:16:08.174+0000 7f3c877fe700 10 client.25934 handle_command_reply: tid=0 2023-07-14T18:16:08.239 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:16:08.174+0000 7f3cbabbfb80 1 client.25934 shutdown 2023-07-14T18:16:08.239 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:16:08.175+0000 7f3cbabbfb80 1 -- 172.21.15.163:0/3363643656 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564e6acbb8b0 msgr2=0x564e6acc4ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:16:08.239 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:16:08.175+0000 7f3cbabbfb80 1 --2- 172.21.15.163:0/3363643656 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564e6acbb8b0 0x564e6acc4ea0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f3c9c00ead0 tx=0x7f3c9c00ee90 comp rx=0 tx=0).stop 2023-07-14T18:16:08.239 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:16:08.175+0000 7f3cbabbfb80 1 -- 172.21.15.163:0/3363643656 shutdown_connections 2023-07-14T18:16:08.239 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:16:08.175+0000 7f3cbabbfb80 1 --2- 172.21.15.163:0/3363643656 >> [v2:172.21.15.172:6838/3850440096,v1:172.21.15.172:6839/3850440096] conn(0x564e6acd0760 0x564e6acd2b70 crc :-1 s=READY pgs=71 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:16:08.239 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:16:08.175+0000 7f3cbabbfb80 1 --2- 172.21.15.163:0/3363643656 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x564e6acbc4b0 0x564e6accbee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:16:08.240 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:16:08.175+0000 7f3cbabbfb80 1 --2- 172.21.15.163:0/3363643656 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x564e6acbaf60 0x564e6acc4960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:16:08.240 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:16:08.175+0000 7f3c877fe700 0 client.25934 ms_handle_reset on v2:172.21.15.172:6838/3850440096 2023-07-14T18:16:08.240 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:16:08.175+0000 7f3cbabbfb80 1 --2- 172.21.15.163:0/3363643656 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564e6acbb8b0 0x564e6acc4ea0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:16:08.240 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:16:08.175+0000 7f3cbabbfb80 1 -- 172.21.15.163:0/3363643656 >> 172.21.15.163:0/3363643656 conn(0x564e6acb0680 msgr2=0x564e6acb4650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:16:08.240 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:16:08.175+0000 7f3cbabbfb80 1 -- 172.21.15.163:0/3363643656 shutdown_connections 2023-07-14T18:16:08.240 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:16:08.175+0000 7f3cbabbfb80 1 -- 172.21.15.163:0/3363643656 wait complete. 2023-07-14T18:16:08.241 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:16:08.175+0000 7f3cbabbfb80 20 client.25934 trim_cache size 0 max 16384 2023-07-14T18:16:08.241 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:16:07 smithi163 ceph-mon[96576]: pgmap v404: 129 pgs: 129 active+clean; 112 MiB data, 885 MiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 33 KiB/s wr, 17 op/s 2023-07-14T18:16:08.243 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:16:08.198+0000 7f3cbabbfb80 1 Processor -- start 2023-07-14T18:16:08.244 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:16:08.198+0000 7f3cbabbfb80 1 -- start start 2023-07-14T18:16:08.244 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:16:08.198+0000 7f3cbabbfb80 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x564e6acbaf60 0x564e6acc2920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:16:08.244 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:16:08.198+0000 7f3cbabbfb80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564e6acbb8b0 0x564e6accbe00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:16:08.244 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:16:08.198+0000 7f3cbabbfb80 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x564e6acbc4b0 0x564e6acbf470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:16:08.244 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:16:08.198+0000 7f3cbabbfb80 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x564e6acbc330 con 0x564e6acbc4b0 2023-07-14T18:16:08.245 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:16:08.198+0000 7f3cbabbfb80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x564e6acb6cc0 con 0x564e6acbb8b0 2023-07-14T18:16:08.245 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:16:08.198+0000 7f3cbabbfb80 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x564e6acc5860 con 0x564e6acbaf60 2023-07-14T18:16:08.245 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:16:08.199+0000 7f3ca7fff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x564e6acbaf60 0x564e6acc2920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:16:08.245 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:16:08.199+0000 7f3cacfc4700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x564e6acbc4b0 0x564e6acbf470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:16:08.245 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:16:08.199+0000 7f3ca7fff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x564e6acbaf60 0x564e6acc2920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.163:41404/0 (socket says 172.21.15.163:41404) 2023-07-14T18:16:08.245 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:16:08.199+0000 7f3ca7fff700 1 -- 172.21.15.163:0/828175449 learned_addr learned my addr 172.21.15.163:0/828175449 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:16:08.245 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:16:08.199+0000 7f3ca77fe700 1 --2- 172.21.15.163:0/828175449 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564e6acbb8b0 0x564e6accbe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:16:08.249 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:16:08.199+0000 7f3ca7fff700 1 -- 172.21.15.163:0/828175449 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564e6acbb8b0 msgr2=0x564e6accbe00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:16:08.249 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:16:08.199+0000 7f3ca7fff700 1 --2- 172.21.15.163:0/828175449 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564e6acbb8b0 0x564e6accbe00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:16:08.249 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:16:08.199+0000 7f3ca7fff700 1 -- 172.21.15.163:0/828175449 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x564e6acbc4b0 msgr2=0x564e6acbf470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:16:08.249 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:16:08.199+0000 7f3ca7fff700 1 --2- 172.21.15.163:0/828175449 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x564e6acbc4b0 0x564e6acbf470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:16:08.249 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:16:08.199+0000 7f3ca7fff700 1 -- 172.21.15.163:0/828175449 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564e6aa22c60 con 0x564e6acbaf60 2023-07-14T18:16:08.250 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:16:08.199+0000 7f3cacfc4700 1 --2- 172.21.15.163:0/828175449 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x564e6acbc4b0 0x564e6acbf470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T18:16:08.250 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:16:08.199+0000 7f3ca7fff700 1 --2- 172.21.15.163:0/828175449 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x564e6acbaf60 0x564e6acc2920 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f3c9809a080 tx=0x7f3c9801b040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a439dd8e151c6ab1 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:16:08.250 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:16:08.199+0000 7f3c8effd700 1 -- 172.21.15.163:0/828175449 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c980a1640 con 0x564e6acbaf60 2023-07-14T18:16:08.250 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:16:08.199+0000 7f3c8effd700 1 -- 172.21.15.163:0/828175449 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f3c980a5a60 con 0x564e6acbaf60 2023-07-14T18:16:08.250 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:16:08.199+0000 7f3c8effd700 1 -- 172.21.15.163:0/828175449 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c9809cd60 con 0x564e6acbaf60 2023-07-14T18:16:08.250 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:16:08.200+0000 7f3cbabbfb80 1 -- 172.21.15.163:0/828175449 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x564e6acbaf60 msgr2=0x564e6acc2920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:16:08.250 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:16:08.200+0000 7f3cbabbfb80 1 --2- 172.21.15.163:0/828175449 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x564e6acbaf60 0x564e6acc2920 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f3c9809a080 tx=0x7f3c9801b040 comp rx=0 tx=0).stop 2023-07-14T18:16:08.251 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:16:08.200+0000 7f3cbabbfb80 1 -- 172.21.15.163:0/828175449 shutdown_connections 2023-07-14T18:16:08.251 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:16:08.200+0000 7f3cbabbfb80 1 --2- 172.21.15.163:0/828175449 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x564e6acbaf60 0x564e6acc2920 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:16:08.251 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:16:08.200+0000 7f3cbabbfb80 1 --2- 172.21.15.163:0/828175449 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x564e6acbc4b0 0x564e6acbf470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:16:08.251 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:16:08.200+0000 7f3cbabbfb80 1 --2- 172.21.15.163:0/828175449 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564e6acbb8b0 0x564e6accbe00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:16:08.251 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:16:08.200+0000 7f3cbabbfb80 1 -- 172.21.15.163:0/828175449 >> 172.21.15.163:0/828175449 conn(0x564e6acb0680 msgr2=0x564e6accc710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:16:08.251 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:16:08.200+0000 7f3cbabbfb80 1 -- 172.21.15.163:0/828175449 shutdown_connections 2023-07-14T18:16:08.251 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:16:08.200+0000 7f3cbabbfb80 1 -- 172.21.15.163:0/828175449 wait complete. 2023-07-14T18:16:08.251 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:16:08.200+0000 7f3cbabbfb80 1 -- start start 2023-07-14T18:16:08.252 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:16:08.201+0000 7f3cbabbfb80 1 Processor -- start 2023-07-14T18:16:08.252 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:16:08.201+0000 7f3cbabbfb80 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x564e6acbaf60 0x564e6accb8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:16:08.252 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:16:08.201+0000 7f3cbabbfb80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564e6acbb8b0 0x564e6accbe00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:16:08.252 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:16:08.201+0000 7f3cbabbfb80 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x564e6acbc4b0 0x564e6acc9fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:16:08.252 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:16:08.201+0000 7f3cbabbfb80 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x564e6acca6a0 con 0x564e6acbaf60 2023-07-14T18:16:08.252 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:16:08.201+0000 7f3cbabbfb80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x564e6acca810 con 0x564e6acbb8b0 2023-07-14T18:16:08.252 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:16:08.201+0000 7f3cbabbfb80 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x564e6acca9d0 con 0x564e6acbc4b0 2023-07-14T18:16:08.253 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:16:08.201+0000 7f3cbabbfb80 10 client.0 _ll_register_callbacks cb 0x7f3c98010920 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T18:16:08.253 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:16:08.201+0000 7f3ca7fff700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x564e6acbaf60 0x564e6accb8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:16:08.253 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:16:08.201+0000 7f3ca77fe700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564e6acbb8b0 0x564e6accbe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:16:08.253 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:16:08.201+0000 7f3ca7fff700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x564e6acbaf60 0x564e6accb8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:59588/0 (socket says 172.21.15.163:59588) 2023-07-14T18:16:08.253 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:16:08.201+0000 7f3ca7fff700 1 -- 172.21.15.163:0/983571422 learned_addr learned my addr 172.21.15.163:0/983571422 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:16:08.254 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:16:08.201+0000 7f3cacfc4700 1 --2- 172.21.15.163:0/983571422 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x564e6acbc4b0 0x564e6acc9fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:16:08.254 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:16:08.201+0000 7f3ca7fff700 1 -- 172.21.15.163:0/983571422 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x564e6acbc4b0 msgr2=0x564e6acc9fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:16:08.254 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:16:08.201+0000 7f3ca7fff700 1 --2- 172.21.15.163:0/983571422 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x564e6acbc4b0 0x564e6acc9fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:16:08.254 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:16:08.201+0000 7f3ca7fff700 1 -- 172.21.15.163:0/983571422 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564e6acbb8b0 msgr2=0x564e6accbe00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:16:08.254 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:16:08.201+0000 7f3ca7fff700 1 --2- 172.21.15.163:0/983571422 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564e6acbb8b0 0x564e6accbe00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:16:08.254 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:16:08.201+0000 7f3ca7fff700 1 -- 172.21.15.163:0/983571422 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ca8108a20 con 0x564e6acbaf60 2023-07-14T18:16:08.254 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:16:08.201+0000 7f3ca77fe700 1 --2- 172.21.15.163:0/983571422 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564e6acbb8b0 0x564e6accbe00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T18:16:08.255 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:16:08.202+0000 7f3ca7fff700 1 --2- 172.21.15.163:0/983571422 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x564e6acbaf60 0x564e6accb8c0 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7f3c98004440 tx=0x7f3c9809d690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2144e1f0dd880671 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:16:08.255 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:16:08.202+0000 7f3c877fe700 10 client.0 ms_handle_connect on v2:172.21.15.163:3300/0 2023-07-14T18:16:08.255 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:16:08.202+0000 7f3c877fe700 1 -- 172.21.15.163:0/983571422 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c980882c0 con 0x564e6acbaf60 2023-07-14T18:16:08.255 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:16:08.202+0000 7f3c877fe700 1 -- 172.21.15.163:0/983571422 <== mon.0 v2:172.21.15.163:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 9049+0+0 (secure 0 0 0) 0x7f3c980c7e40 con 0x564e6acbaf60 2023-07-14T18:16:08.255 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:16:08.202+0000 7f3cbabbfb80 1 -- 172.21.15.163:0/983571422 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f3c9c021070 con 0x564e6acbaf60 2023-07-14T18:16:08.255 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:16:08.202+0000 7f3c877fe700 1 -- 172.21.15.163:0/983571422 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3c9809b9b0 con 0x564e6acbaf60 2023-07-14T18:16:08.255 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:16:08.202+0000 7f3cbabbfb80 10 client.16311 fetch_fsmap learned FSMap version 31 2023-07-14T18:16:08.256 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:16:08.202+0000 7f3cbabbfb80 1 -- 172.21.15.163:0/983571422 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) v3 -- 0x7f3ca80fedb0 con 0x564e6acbaf60 2023-07-14T18:16:08.256 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:16:08.202+0000 7f3c877fe700 1 -- 172.21.15.163:0/983571422 <== mon.0 v2:172.21.15.163:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f3c9c021070 con 0x564e6acbaf60 2023-07-14T18:16:08.256 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:16:08.202+0000 7f3c877fe700 1 -- 172.21.15.163:0/983571422 <== mon.0 v2:172.21.15.163:3300/0 5 ==== fsmap(e 31) v1 ==== 7486+0+0 (secure 0 0 0) 0x7f3c9809cb90 con 0x564e6acbaf60 2023-07-14T18:16:08.256 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:16:08.202+0000 7f3cbabbfb80 10 client.16311 fetch_fsmap finished waiting for FSMap version 31 2023-07-14T18:16:08.256 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:16:08.202+0000 7f3cbabbfb80 10 client.16311 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-07-14T18:16:08.256 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:16:08.202+0000 7f3cbabbfb80 20 client.16311 populate_metadata read hostname 'smithi163' 2023-07-14T18:16:08.256 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:16:08.202+0000 7f3cbabbfb80 1 --2- 172.21.15.163:0/983571422 >> [v2:172.21.15.172:6838/3850440096,v1:172.21.15.172:6839/3850440096] conn(0x564e6acd0760 0x564e6ad27700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:16:08.257 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:16:08.202+0000 7f3cbabbfb80 4 client.16311 mds_command: new command op to 24518 tid=0[{"prefix": "scrub status"}] 2023-07-14T18:16:08.257 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:16:08.202+0000 7f3cbabbfb80 1 -- 172.21.15.163:0/983571422 --> [v2:172.21.15.172:6838/3850440096,v1:172.21.15.172:6839/3850440096] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x564e6ac04eb0 con 0x564e6acd0760 2023-07-14T18:16:08.257 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:16:08.203+0000 7f3ca77fe700 1 --2- 172.21.15.163:0/983571422 >> [v2:172.21.15.172:6838/3850440096,v1:172.21.15.172:6839/3850440096] conn(0x564e6acd0760 0x564e6ad27700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:16:08.257 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:16:08.203+0000 7f3ca77fe700 1 --2- 172.21.15.163:0/983571422 >> [v2:172.21.15.172:6838/3850440096,v1:172.21.15.172:6839/3850440096] conn(0x564e6acd0760 0x564e6ad27700 crc :-1 s=READY pgs=72 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=592a565ef070f685 server_cookie=abecdf8968deb7ca in_seq=0 out_seq=0 2023-07-14T18:16:08.257 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:16:08.203+0000 7f3c877fe700 10 client.16311 ms_handle_connect on v2:172.21.15.172:6838/3850440096 2023-07-14T18:16:08.257 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:16:08.203+0000 7f3c877fe700 1 -- 172.21.15.163:0/983571422 <== mds.0 v2:172.21.15.172:6838/3850440096 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+265 (crc 0 0 0) 0x564e6ac04eb0 con 0x564e6acd0760 2023-07-14T18:16:08.257 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:16:08.203+0000 7f3c877fe700 10 client.16311 handle_command_reply: tid=0 2023-07-14T18:16:08.258 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:16:08.203+0000 7f3cbabbfb80 1 client.16311 shutdown 2023-07-14T18:16:08.258 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:16:08.203+0000 7f3cbabbfb80 1 -- 172.21.15.163:0/983571422 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x564e6acbaf60 msgr2=0x564e6accb8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:16:08.258 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:16:08.203+0000 7f3cbabbfb80 1 --2- 172.21.15.163:0/983571422 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x564e6acbaf60 0x564e6accb8c0 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7f3c98004440 tx=0x7f3c9809d690 comp rx=0 tx=0).stop 2023-07-14T18:16:08.258 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:16:08.203+0000 7f3cbabbfb80 1 -- 172.21.15.163:0/983571422 shutdown_connections 2023-07-14T18:16:08.258 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:16:08.203+0000 7f3cbabbfb80 1 --2- 172.21.15.163:0/983571422 >> [v2:172.21.15.172:6838/3850440096,v1:172.21.15.172:6839/3850440096] conn(0x564e6acd0760 0x564e6ad27700 crc :-1 s=READY pgs=72 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:16:08.258 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:16:08.203+0000 7f3cbabbfb80 1 --2- 172.21.15.163:0/983571422 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x564e6acbc4b0 0x564e6acc9fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:16:08.258 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:16:08.203+0000 7f3cbabbfb80 1 --2- 172.21.15.163:0/983571422 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x564e6acbaf60 0x564e6accb8c0 unknown :-1 s=CLOSED pgs=679 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:16:08.258 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:16:08.203+0000 7f3cbabbfb80 1 --2- 172.21.15.163:0/983571422 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564e6acbb8b0 0x564e6accbe00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:16:08.259 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:16:08.203+0000 7f3c877fe700 0 client.16311 ms_handle_reset on v2:172.21.15.172:6838/3850440096 2023-07-14T18:16:08.259 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:16:08.203+0000 7f3cbabbfb80 1 -- 172.21.15.163:0/983571422 >> 172.21.15.163:0/983571422 conn(0x564e6acb0680 msgr2=0x564e6accc710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:16:08.259 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:16:08.203+0000 7f3cbabbfb80 1 -- 172.21.15.163:0/983571422 shutdown_connections 2023-07-14T18:16:08.259 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:16:08.204+0000 7f3cbabbfb80 1 -- 172.21.15.163:0/983571422 wait complete. 2023-07-14T18:16:08.259 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:16:08.204+0000 7f3cbabbfb80 20 client.16311 trim_cache size 0 max 16384 2023-07-14T18:16:08.259 INFO:teuthology.orchestra.run.smithi163.stdout:{ 2023-07-14T18:16:08.260 INFO:teuthology.orchestra.run.smithi163.stdout: "status": "scrub active (1 inodes in the stack)", 2023-07-14T18:16:08.260 INFO:teuthology.orchestra.run.smithi163.stdout: "scrubs": { 2023-07-14T18:16:08.260 INFO:teuthology.orchestra.run.smithi163.stdout: "2c53b7ef-6f30-49f0-a60d-f1f114c19d42": { 2023-07-14T18:16:08.260 INFO:teuthology.orchestra.run.smithi163.stdout: "path": "/", 2023-07-14T18:16:08.260 INFO:teuthology.orchestra.run.smithi163.stdout: "tag": "2c53b7ef-6f30-49f0-a60d-f1f114c19d42", 2023-07-14T18:16:08.260 INFO:teuthology.orchestra.run.smithi163.stdout: "options": "recursive,force" 2023-07-14T18:16:08.261 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-07-14T18:16:08.261 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-07-14T18:16:08.261 INFO:teuthology.orchestra.run.smithi163.stdout:} 2023-07-14T18:16:08.262 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:16:08.204+0000 7f3caea27700 1 -- 172.21.15.163:0/2295002104 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f3c900a1150 msgr2=0x7f3c900a3600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:16:08.262 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:16:08.204+0000 7f3caea27700 1 --2- 172.21.15.163:0/2295002104 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f3c900a1150 0x7f3c900a3600 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f3c9c009c60 tx=0x7f3c9c009260 comp rx=0 tx=0).stop 2023-07-14T18:16:08.262 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:16:08.204+0000 7f3caea27700 1 -- 172.21.15.163:0/2295002104 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f3ca80fdf90 msgr2=0x7f3ca81959b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:16:08.262 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:16:08.204+0000 7f3caea27700 1 --2- 172.21.15.163:0/2295002104 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f3ca80fdf90 0x7f3ca81959b0 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7f3c98009c80 tx=0x7f3c98009f90 comp rx=0 tx=0).stop 2023-07-14T18:16:08.262 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:16:08.204+0000 7f3caea27700 1 -- 172.21.15.163:0/2295002104 shutdown_connections 2023-07-14T18:16:08.262 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:16:08.204+0000 7f3caea27700 1 --2- 172.21.15.163:0/2295002104 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f3c900a1150 0x7f3c900a3600 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:16:08.262 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:16:08.204+0000 7f3caea27700 1 --2- 172.21.15.163:0/2295002104 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3ca81018f0 0x7f3ca819cf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:16:08.263 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:16:08.204+0000 7f3caea27700 1 --2- 172.21.15.163:0/2295002104 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f3ca80fdf90 0x7f3ca81959b0 unknown :-1 s=CLOSED pgs=678 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:16:08.263 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:16:08.204+0000 7f3caea27700 1 --2- 172.21.15.163:0/2295002104 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3ca8100f60 0x7f3ca8195ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:16:08.263 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:16:08.204+0000 7f3caea27700 1 -- 172.21.15.163:0/2295002104 >> 172.21.15.163:0/2295002104 conn(0x7f3ca80f9950 msgr2=0x7f3ca80fbc80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:16:08.263 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:16:08.204+0000 7f3caea27700 1 -- 172.21.15.163:0/2295002104 shutdown_connections 2023-07-14T18:16:08.263 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:16:08.204+0000 7f3caea27700 1 -- 172.21.15.163:0/2295002104 wait complete. 2023-07-14T18:16:08.264 INFO:tasks.cephfs.filesystem:scrub status for tag:2c53b7ef-6f30-49f0-a60d-f1f114c19d42 - {'path': '/', 'tag': '2c53b7ef-6f30-49f0-a60d-f1f114c19d42', 'options': 'recursive,force'} 2023-07-14T18:16:08.280 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:16:07 smithi172 ceph-mon[97983]: pgmap v404: 129 pgs: 129 active+clean; 112 MiB data, 885 MiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 33 KiB/s wr, 17 op/s 2023-07-14T18:16:08.669 INFO:tasks.workunit.client.0.smithi163.stdout:checking gdbm/ndbm.h presence... no 2023-07-14T18:16:08.670 INFO:tasks.workunit.client.0.smithi163.stdout:checking for gdbm/ndbm.h... no 2023-07-14T18:16:10.929 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:16:10 smithi184 ceph-mon[98481]: pgmap v405: 129 pgs: 129 active+clean; 112 MiB data, 885 MiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 31 KiB/s wr, 20 op/s 2023-07-14T18:16:10.971 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:16:10 smithi163 ceph-mon[96576]: pgmap v405: 129 pgs: 129 active+clean; 112 MiB data, 885 MiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 31 KiB/s wr, 20 op/s 2023-07-14T18:16:11.029 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:16:10 smithi172 ceph-mon[97983]: pgmap v405: 129 pgs: 129 active+clean; 112 MiB data, 885 MiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 31 KiB/s wr, 20 op/s 2023-07-14T18:16:13.179 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:16:12 smithi184 ceph-mon[98481]: pgmap v406: 129 pgs: 129 active+clean; 112 MiB data, 885 MiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 29 KiB/s wr, 15 op/s 2023-07-14T18:16:13.221 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:16:12 smithi163 ceph-mon[96576]: pgmap v406: 129 pgs: 129 active+clean; 112 MiB data, 885 MiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 29 KiB/s wr, 15 op/s 2023-07-14T18:16:13.280 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:16:12 smithi172 ceph-mon[97983]: pgmap v406: 129 pgs: 129 active+clean; 112 MiB data, 885 MiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 29 KiB/s wr, 15 op/s 2023-07-14T18:16:13.667 INFO:tasks.workunit.client.0.smithi163.stdout:checking ndbm.h usability... no 2023-07-14T18:16:14.179 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:16:13 smithi184 ceph-mon[98481]: pgmap v407: 129 pgs: 129 active+clean; 112 MiB data, 885 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 9.6 KiB/s wr, 16 op/s 2023-07-14T18:16:14.221 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:16:13 smithi163 ceph-mon[96576]: pgmap v407: 129 pgs: 129 active+clean; 112 MiB data, 885 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 9.6 KiB/s wr, 16 op/s 2023-07-14T18:16:14.280 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:16:13 smithi172 ceph-mon[97983]: pgmap v407: 129 pgs: 129 active+clean; 112 MiB data, 885 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 9.6 KiB/s wr, 16 op/s 2023-07-14T18:16:17.179 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:16:16 smithi184 ceph-mon[98481]: pgmap v408: 129 pgs: 129 active+clean; 112 MiB data, 889 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 13 KiB/s wr, 13 op/s 2023-07-14T18:16:17.221 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:16:16 smithi163 ceph-mon[96576]: pgmap v408: 129 pgs: 129 active+clean; 112 MiB data, 889 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 13 KiB/s wr, 13 op/s 2023-07-14T18:16:17.280 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:16:16 smithi172 ceph-mon[97983]: pgmap v408: 129 pgs: 129 active+clean; 112 MiB data, 889 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 13 KiB/s wr, 13 op/s 2023-07-14T18:16:18.179 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:16:17 smithi184 ceph-mon[98481]: pgmap v409: 129 pgs: 129 active+clean; 112 MiB data, 889 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 9.2 KiB/s wr, 12 op/s 2023-07-14T18:16:18.221 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:16:17 smithi163 ceph-mon[96576]: pgmap v409: 129 pgs: 129 active+clean; 112 MiB data, 889 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 9.2 KiB/s wr, 12 op/s 2023-07-14T18:16:18.280 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:16:17 smithi172 ceph-mon[97983]: pgmap v409: 129 pgs: 129 active+clean; 112 MiB data, 889 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 9.2 KiB/s wr, 12 op/s 2023-07-14T18:16:18.669 INFO:tasks.workunit.client.0.smithi163.stdout:checking ndbm.h presence... no 2023-07-14T18:16:18.669 INFO:tasks.workunit.client.0.smithi163.stdout:checking for ndbm.h... no 2023-07-14T18:16:18.720 INFO:tasks.workunit.client.0.smithi163.stdout:checking libaio.h usability... yes 2023-07-14T18:16:18.746 INFO:tasks.workunit.client.0.smithi163.stdout:checking libaio.h presence... yes 2023-07-14T18:16:18.746 INFO:tasks.workunit.client.0.smithi163.stdout:checking for libaio.h... yes 2023-07-14T18:16:18.833 INFO:tasks.workunit.client.0.smithi163.stdout:checking for dm_make_handle in -ldm... no 2023-07-14T18:16:18.834 INFO:tasks.workunit.client.0.smithi163.stdout: 2023-07-14T18:16:18.834 INFO:tasks.workunit.client.0.smithi163.stdout:WARNING: could not find a valid DMAPI base library. 2023-07-14T18:16:18.834 INFO:tasks.workunit.client.0.smithi163.stdout:If you want DMAPI support please install the data migration 2023-07-14T18:16:18.834 INFO:tasks.workunit.client.0.smithi163.stdout:API (dmapi) library package. Alternatively, run "make install" 2023-07-14T18:16:18.835 INFO:tasks.workunit.client.0.smithi163.stdout:from the dmapi source. 2023-07-14T18:16:18.835 INFO:tasks.workunit.client.0.smithi163.stdout: 2023-07-14T18:16:18.886 INFO:tasks.workunit.client.0.smithi163.stdout:checking linux/fiemap.h usability... yes 2023-07-14T18:16:18.908 INFO:tasks.workunit.client.0.smithi163.stdout:checking linux/fiemap.h presence... yes 2023-07-14T18:16:18.909 INFO:tasks.workunit.client.0.smithi163.stdout:checking for linux/fiemap.h... yes 2023-07-14T18:16:18.986 INFO:tasks.workunit.client.0.smithi163.stdout:checking for fallocate... yes 2023-07-14T18:16:19.056 INFO:tasks.workunit.client.0.smithi163.stdout:checking for open_by_handle_at... yes 2023-07-14T18:16:19.116 INFO:tasks.workunit.client.0.smithi163.stdout:checking sys/prctl.h usability... yes 2023-07-14T18:16:19.139 INFO:tasks.workunit.client.0.smithi163.stdout:checking sys/prctl.h presence... yes 2023-07-14T18:16:19.139 INFO:tasks.workunit.client.0.smithi163.stdout:checking for sys/prctl.h... yes 2023-07-14T18:16:19.188 INFO:tasks.workunit.client.0.smithi163.stdout:checking linux/fs.h usability... yes 2023-07-14T18:16:19.210 INFO:tasks.workunit.client.0.smithi163.stdout:checking linux/fs.h presence... yes 2023-07-14T18:16:19.211 INFO:tasks.workunit.client.0.smithi163.stdout:checking for linux/fs.h... yes 2023-07-14T18:16:20.929 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:16:20 smithi184 ceph-mon[98481]: pgmap v410: 129 pgs: 129 active+clean; 112 MiB data, 889 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 9.7 KiB/s wr, 16 op/s 2023-07-14T18:16:20.929 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:16:20 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-14T18:16:20.930 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:16:20 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:16:20.930 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:16:20 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:16:20.930 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:16:20 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:16:20.931 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:16:20 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:16:20.971 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:16:20 smithi163 ceph-mon[96576]: pgmap v410: 129 pgs: 129 active+clean; 112 MiB data, 889 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 9.7 KiB/s wr, 16 op/s 2023-07-14T18:16:20.972 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:16:20 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-14T18:16:20.972 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:16:20 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:16:20.972 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:16:20 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:16:20.972 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:16:20 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:16:20.972 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:16:20 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:16:21.030 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:16:20 smithi172 ceph-mon[97983]: pgmap v410: 129 pgs: 129 active+clean; 112 MiB data, 889 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 9.7 KiB/s wr, 16 op/s 2023-07-14T18:16:21.030 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:16:20 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-14T18:16:21.030 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:16:20 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:16:21.031 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:16:20 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:16:21.031 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:16:20 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:16:21.031 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:16:20 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:16:22.179 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:16:21 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T18:16:22.179 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:16:21 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-14T18:16:22.179 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:16:21 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:16:22.221 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:16:21 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T18:16:22.222 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:16:21 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-14T18:16:22.222 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:16:21 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:16:22.280 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:16:21 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T18:16:22.280 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:16:21 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-14T18:16:22.280 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:16:21 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:16:23.179 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:16:22 smithi184 ceph-mon[98481]: pgmap v411: 129 pgs: 129 active+clean; 112 MiB data, 890 MiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 33 KiB/s wr, 15 op/s 2023-07-14T18:16:23.221 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:16:22 smithi163 ceph-mon[96576]: pgmap v411: 129 pgs: 129 active+clean; 112 MiB data, 890 MiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 33 KiB/s wr, 15 op/s 2023-07-14T18:16:23.280 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:16:22 smithi172 ceph-mon[97983]: pgmap v411: 129 pgs: 129 active+clean; 112 MiB data, 890 MiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 33 KiB/s wr, 15 op/s 2023-07-14T18:16:23.680 INFO:tasks.workunit.client.0.smithi163.stdout:checking btrfsutil.h usability... no 2023-07-14T18:16:24.179 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:16:23 smithi184 ceph-mon[98481]: pgmap v412: 129 pgs: 129 active+clean; 112 MiB data, 890 MiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 37 KiB/s wr, 20 op/s 2023-07-14T18:16:24.221 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:16:23 smithi163 ceph-mon[96576]: pgmap v412: 129 pgs: 129 active+clean; 112 MiB data, 890 MiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 37 KiB/s wr, 20 op/s 2023-07-14T18:16:24.280 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:16:23 smithi172 ceph-mon[97983]: pgmap v412: 129 pgs: 129 active+clean; 112 MiB data, 890 MiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 37 KiB/s wr, 20 op/s 2023-07-14T18:16:27.179 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:16:26 smithi184 ceph-mon[98481]: pgmap v413: 129 pgs: 129 active+clean; 112 MiB data, 874 MiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 50 KiB/s wr, 19 op/s 2023-07-14T18:16:27.221 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:16:26 smithi163 ceph-mon[96576]: pgmap v413: 129 pgs: 129 active+clean; 112 MiB data, 874 MiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 50 KiB/s wr, 19 op/s 2023-07-14T18:16:27.280 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:16:26 smithi172 ceph-mon[97983]: pgmap v413: 129 pgs: 129 active+clean; 112 MiB data, 874 MiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 50 KiB/s wr, 19 op/s 2023-07-14T18:16:28.179 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:16:27 smithi184 ceph-mon[98481]: pgmap v414: 129 pgs: 129 active+clean; 112 MiB data, 878 MiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 47 KiB/s wr, 18 op/s 2023-07-14T18:16:28.221 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:16:27 smithi163 ceph-mon[96576]: pgmap v414: 129 pgs: 129 active+clean; 112 MiB data, 878 MiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 47 KiB/s wr, 18 op/s 2023-07-14T18:16:28.280 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:16:27 smithi172 ceph-mon[97983]: pgmap v414: 129 pgs: 129 active+clean; 112 MiB data, 878 MiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 47 KiB/s wr, 18 op/s 2023-07-14T18:16:28.671 INFO:tasks.workunit.client.0.smithi163.stdout:checking btrfsutil.h presence... no 2023-07-14T18:16:28.672 INFO:tasks.workunit.client.0.smithi163.stdout:checking for btrfsutil.h... no 2023-07-14T18:16:29.603 INFO:tasks.workunit.client.0.smithi163.stdout:checking for copy_file_range... yes 2023-07-14T18:16:29.691 INFO:tasks.workunit.client.0.smithi163.stdout:checking for renameat2... yes 2023-07-14T18:16:29.724 INFO:tasks.workunit.client.0.smithi163.stdout:configure: creating ./config.status 2023-07-14T18:16:30.211 INFO:tasks.workunit.client.0.smithi163.stdout:config.status: creating include/builddefs 2023-07-14T18:16:30.261 INFO:tasks.workunit.client.0.smithi163.stdout:config.status: creating include/config.h 2023-07-14T18:16:30.929 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:16:30 smithi184 ceph-mon[98481]: pgmap v415: 129 pgs: 129 active+clean; 112 MiB data, 878 MiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 47 KiB/s wr, 22 op/s 2023-07-14T18:16:30.971 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:16:30 smithi163 ceph-mon[96576]: pgmap v415: 129 pgs: 129 active+clean; 112 MiB data, 878 MiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 47 KiB/s wr, 22 op/s 2023-07-14T18:16:31.030 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:16:30 smithi172 ceph-mon[97983]: pgmap v415: 129 pgs: 129 active+clean; 112 MiB data, 878 MiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 47 KiB/s wr, 22 op/s 2023-07-14T18:16:32.179 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:16:31 smithi184 ceph-mon[98481]: pgmap v416: 129 pgs: 129 active+clean; 112 MiB data, 879 MiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 58 KiB/s wr, 21 op/s 2023-07-14T18:16:32.221 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:16:31 smithi163 ceph-mon[96576]: pgmap v416: 129 pgs: 129 active+clean; 112 MiB data, 879 MiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 58 KiB/s wr, 21 op/s 2023-07-14T18:16:32.280 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:16:31 smithi172 ceph-mon[97983]: pgmap v416: 129 pgs: 129 active+clean; 112 MiB data, 879 MiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 58 KiB/s wr, 21 op/s 2023-07-14T18:16:34.929 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:16:34 smithi184 ceph-mon[98481]: pgmap v417: 129 pgs: 129 active+clean; 112 MiB data, 879 MiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 38 KiB/s wr, 22 op/s 2023-07-14T18:16:34.972 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:16:34 smithi163 ceph-mon[96576]: pgmap v417: 129 pgs: 129 active+clean; 112 MiB data, 879 MiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 38 KiB/s wr, 22 op/s 2023-07-14T18:16:35.030 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:16:34 smithi172 ceph-mon[97983]: pgmap v417: 129 pgs: 129 active+clean; 112 MiB data, 879 MiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 38 KiB/s wr, 22 op/s 2023-07-14T18:16:36.929 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:16:36 smithi184 ceph-mon[98481]: pgmap v418: 129 pgs: 129 active+clean; 113 MiB data, 879 MiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 61 KiB/s wr, 22 op/s 2023-07-14T18:16:36.972 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:16:36 smithi163 ceph-mon[96576]: pgmap v418: 129 pgs: 129 active+clean; 113 MiB data, 879 MiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 61 KiB/s wr, 22 op/s 2023-07-14T18:16:37.030 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:16:36 smithi172 ceph-mon[97983]: pgmap v418: 129 pgs: 129 active+clean; 113 MiB data, 879 MiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 61 KiB/s wr, 22 op/s 2023-07-14T18:16:37.137 INFO:tasks.workunit.client.0.smithi163.stdout:config.status: executing libtool commands 2023-07-14T18:16:37.345 INFO:tasks.workunit.client.0.smithi163.stdout:Building include 2023-07-14T18:16:37.345 INFO:tasks.workunit.client.0.smithi163.stdout:Building lib 2023-07-14T18:16:37.345 INFO:tasks.workunit.client.0.smithi163.stdout:Building tests 2023-07-14T18:16:37.371 INFO:tasks.workunit.client.0.smithi163.stdout: [LTDEP] 2023-07-14T18:16:37.759 INFO:tasks.workunit.client.0.smithi163.stdout: [CC] dataascii.lo 2023-07-14T18:16:37.760 INFO:tasks.workunit.client.0.smithi163.stdout: [CC] databin.lo 2023-07-14T18:16:37.761 INFO:tasks.workunit.client.0.smithi163.stdout: [CC] datapid.lo 2023-07-14T18:16:37.763 INFO:tasks.workunit.client.0.smithi163.stdout: [CC] file_lock.lo 2023-07-14T18:16:38.025 INFO:tasks.workunit.client.0.smithi163.stdout: [CC] forker.lo 2023-07-14T18:16:38.051 INFO:tasks.workunit.client.0.smithi163.stdout: [CC] pattern.lo 2023-07-14T18:16:38.125 INFO:tasks.workunit.client.0.smithi163.stdout: [CC] open_flags.lo 2023-07-14T18:16:38.164 INFO:tasks.workunit.client.0.smithi163.stdout: [CC] random_range.lo 2023-07-14T18:16:38.265 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-07-14T18:16:38.333 INFO:tasks.workunit.client.0.smithi163.stdout: [CC] string_to_tokens.lo 2023-07-14T18:16:38.369 INFO:tasks.workunit.client.0.smithi163.stdout: [CC] str_to_bytes.lo 2023-07-14T18:16:38.450 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:16:38.404+0000 7fb7962b6700 1 -- 172.21.15.163:0/3445052241 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fb7900ffc40 msgr2=0x7fb790100050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:16:38.451 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:16:38.404+0000 7fb7962b6700 1 --2- 172.21.15.163:0/3445052241 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fb7900ffc40 0x7fb790100050 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7fb780009990 tx=0x7fb780009ca0 comp rx=0 tx=0).stop 2023-07-14T18:16:38.451 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:16:38.404+0000 7fb7962b6700 1 -- 172.21.15.163:0/3445052241 shutdown_connections 2023-07-14T18:16:38.451 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:16:38.404+0000 7fb7962b6700 1 --2- 172.21.15.163:0/3445052241 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb7901017c0 0x7fb790108080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:16:38.451 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:16:38.404+0000 7fb7962b6700 1 --2- 172.21.15.163:0/3445052241 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fb7900ffc40 0x7fb790100050 unknown :-1 s=CLOSED pgs=680 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:16:38.451 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:16:38.404+0000 7fb7962b6700 1 --2- 172.21.15.163:0/3445052241 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb790100e30 0x7fb790101280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:16:38.451 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:16:38.404+0000 7fb7962b6700 1 -- 172.21.15.163:0/3445052241 >> 172.21.15.163:0/3445052241 conn(0x7fb7900fb260 msgr2=0x7fb7900fd690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:16:38.452 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:16:38.405+0000 7fb7962b6700 1 -- 172.21.15.163:0/3445052241 shutdown_connections 2023-07-14T18:16:38.453 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:16:38.405+0000 7fb7962b6700 1 -- 172.21.15.163:0/3445052241 wait complete. 2023-07-14T18:16:38.453 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:16:38.406+0000 7fb7962b6700 1 Processor -- start 2023-07-14T18:16:38.453 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:16:38.406+0000 7fb7962b6700 1 -- start start 2023-07-14T18:16:38.453 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:16:38.407+0000 7fb7962b6700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb7900ffc40 0x7fb7901a4660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:16:38.454 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:16:38.407+0000 7fb7962b6700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fb790100e30 0x7fb7901a4ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:16:38.454 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:16:38.407+0000 7fb7962b6700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb7901017c0 0x7fb7901abc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:16:38.454 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:16:38.407+0000 7fb7962b6700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7901ac1e0 con 0x7fb790100e30 2023-07-14T18:16:38.454 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:16:38.407+0000 7fb7962b6700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7901ac320 con 0x7fb7900ffc40 2023-07-14T18:16:38.454 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:16:38.407+0000 7fb7962b6700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7901ac4b0 con 0x7fb7901017c0 2023-07-14T18:16:38.454 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:16:38.407+0000 7fb78f7fe700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fb790100e30 0x7fb7901a4ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:16:38.454 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:16:38.407+0000 7fb78f7fe700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fb790100e30 0x7fb7901a4ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:59604/0 (socket says 172.21.15.163:59604) 2023-07-14T18:16:38.455 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:16:38.407+0000 7fb78f7fe700 1 -- 172.21.15.163:0/2684975202 learned_addr learned my addr 172.21.15.163:0/2684975202 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:16:38.455 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:16:38.407+0000 7fb78ffff700 1 --2- 172.21.15.163:0/2684975202 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb7900ffc40 0x7fb7901a4660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:16:38.455 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:16:38.407+0000 7fb794853700 1 --2- 172.21.15.163:0/2684975202 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb7901017c0 0x7fb7901abc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:16:38.455 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:16:38.407+0000 7fb78f7fe700 1 -- 172.21.15.163:0/2684975202 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb7901017c0 msgr2=0x7fb7901abc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:16:38.455 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:16:38.407+0000 7fb78f7fe700 1 --2- 172.21.15.163:0/2684975202 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb7901017c0 0x7fb7901abc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:16:38.455 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:16:38.407+0000 7fb78f7fe700 1 -- 172.21.15.163:0/2684975202 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb7900ffc40 msgr2=0x7fb7901a4660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:16:38.455 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:16:38.407+0000 7fb78f7fe700 1 --2- 172.21.15.163:0/2684975202 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb7900ffc40 0x7fb7901a4660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:16:38.456 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:16:38.407+0000 7fb78f7fe700 1 -- 172.21.15.163:0/2684975202 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7800095f0 con 0x7fb790100e30 2023-07-14T18:16:38.456 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:16:38.407+0000 7fb78ffff700 1 --2- 172.21.15.163:0/2684975202 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb7900ffc40 0x7fb7901a4660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T18:16:38.456 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:16:38.407+0000 7fb794853700 1 --2- 172.21.15.163:0/2684975202 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb7901017c0 0x7fb7901abc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T18:16:38.456 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:16:38.407+0000 7fb78f7fe700 1 --2- 172.21.15.163:0/2684975202 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fb790100e30 0x7fb7901a4ba0 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7fb78400e9a0 tx=0x7fb78400ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:16:38.457 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:16:38.408+0000 7fb78d7fa700 1 -- 172.21.15.163:0/2684975202 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb784009790 con 0x7fb790100e30 2023-07-14T18:16:38.457 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:16:38.408+0000 7fb78d7fa700 1 -- 172.21.15.163:0/2684975202 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fb78400cbd0 con 0x7fb790100e30 2023-07-14T18:16:38.457 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:16:38.408+0000 7fb78d7fa700 1 -- 172.21.15.163:0/2684975202 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb784018680 con 0x7fb790100e30 2023-07-14T18:16:38.457 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:16:38.409+0000 7fb7962b6700 1 -- 172.21.15.163:0/2684975202 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb7901ac790 con 0x7fb790100e30 2023-07-14T18:16:38.457 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:16:38.409+0000 7fb7962b6700 1 -- 172.21.15.163:0/2684975202 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb7901acc20 con 0x7fb790100e30 2023-07-14T18:16:38.458 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:16:38.412+0000 7fb78d7fa700 1 -- 172.21.15.163:0/2684975202 <== mon.0 v2:172.21.15.163:3300/0 4 ==== mgrmap(e 18) v1 ==== 135716+0+0 (secure 0 0 0) 0x7fb78400cd40 con 0x7fb790100e30 2023-07-14T18:16:38.458 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:16:38.413+0000 7fb78d7fa700 1 --2- 172.21.15.163:0/2684975202 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7fb7780a1320 0x7fb7780a37d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:16:38.459 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:16:38.413+0000 7fb78ffff700 1 --2- 172.21.15.163:0/2684975202 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7fb7780a1320 0x7fb7780a37d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:16:38.459 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:16:38.413+0000 7fb78d7fa700 1 -- 172.21.15.163:0/2684975202 <== mon.0 v2:172.21.15.163:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 9049+0+0 (secure 0 0 0) 0x7fb784014070 con 0x7fb790100e30 2023-07-14T18:16:38.461 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:16:38.414+0000 7fb7a244eb80 1 Processor -- start 2023-07-14T18:16:38.461 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:16:38.414+0000 7fb7a244eb80 1 -- start start 2023-07-14T18:16:38.461 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:16:38.414+0000 7fb78ffff700 1 --2- 172.21.15.163:0/2684975202 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7fb7780a1320 0x7fb7780a37d0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fb780005b40 tx=0x7fb780005a90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:16:38.461 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:16:38.414+0000 7fb7a244eb80 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x558b53d0ff60 0x558b53d10370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:16:38.462 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:16:38.414+0000 7fb7a244eb80 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x558b53d108b0 0x558b53d10ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:16:38.462 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:16:38.414+0000 7fb7a244eb80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558b53d114b0 0x558b53d11920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:16:38.462 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:16:38.414+0000 7fb7a244eb80 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x558b53c14cb0 con 0x558b53d108b0 2023-07-14T18:16:38.462 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:16:38.414+0000 7fb7a244eb80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x558b53c67a40 con 0x558b53d114b0 2023-07-14T18:16:38.462 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:16:38.414+0000 7fb7a244eb80 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x558b53c60ed0 con 0x558b53d0ff60 2023-07-14T18:16:38.462 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:16:38.414+0000 7fb78ffff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x558b53d0ff60 0x558b53d10370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:16:38.462 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:16:38.414+0000 7fb794853700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558b53d114b0 0x558b53d11920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:16:38.463 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:16:38.414+0000 7fb794853700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558b53d114b0 0x558b53d11920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.163:60298/0 (socket says 172.21.15.163:60298) 2023-07-14T18:16:38.463 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:16:38.414+0000 7fb78f7fe700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x558b53d108b0 0x558b53d10ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:16:38.463 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:16:38.414+0000 7fb794853700 1 -- 172.21.15.163:0/256659832 learned_addr learned my addr 172.21.15.163:0/256659832 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:16:38.463 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:16:38.414+0000 7fb78ffff700 1 --2- 172.21.15.163:0/256659832 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x558b53d0ff60 0x558b53d10370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.163:41432/0 (socket says 172.21.15.163:41432) 2023-07-14T18:16:38.463 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:16:38.415+0000 7fb794853700 1 -- 172.21.15.163:0/256659832 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x558b53d0ff60 msgr2=0x558b53d10370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:16:38.463 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:16:38.415+0000 7fb794853700 1 --2- 172.21.15.163:0/256659832 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x558b53d0ff60 0x558b53d10370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:16:38.463 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:16:38.415+0000 7fb794853700 1 -- 172.21.15.163:0/256659832 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x558b53d108b0 msgr2=0x558b53d10ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:16:38.464 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:16:38.415+0000 7fb794853700 1 --2- 172.21.15.163:0/256659832 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x558b53d108b0 0x558b53d10ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:16:38.464 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:16:38.415+0000 7fb794853700 1 -- 172.21.15.163:0/256659832 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558b53a8ede0 con 0x558b53d114b0 2023-07-14T18:16:38.464 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:16:38.415+0000 7fb794853700 1 --2- 172.21.15.163:0/256659832 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558b53d114b0 0x558b53d11920 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fb788009e60 tx=0x7fb7880077e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b5fb4661afa94630 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:16:38.464 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:16:38.415+0000 7fb7767fc700 1 -- 172.21.15.163:0/256659832 <== mon.2 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb788014610 con 0x558b53d114b0 2023-07-14T18:16:38.464 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:16:38.415+0000 7fb7767fc700 1 -- 172.21.15.163:0/256659832 <== mon.2 v2:172.21.15.172:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fb78800f050 con 0x558b53d114b0 2023-07-14T18:16:38.464 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:16:38.415+0000 7fb7767fc700 1 -- 172.21.15.163:0/256659832 <== mon.2 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb788013910 con 0x558b53d114b0 2023-07-14T18:16:38.467 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:16:38.416+0000 7fb7a244eb80 1 -- 172.21.15.163:0/256659832 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558b53d114b0 msgr2=0x558b53d11920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:16:38.467 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:16:38.416+0000 7fb7a244eb80 1 --2- 172.21.15.163:0/256659832 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558b53d114b0 0x558b53d11920 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fb788009e60 tx=0x7fb7880077e0 comp rx=0 tx=0).stop 2023-07-14T18:16:38.468 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:16:38.416+0000 7fb7a244eb80 1 -- 172.21.15.163:0/256659832 shutdown_connections 2023-07-14T18:16:38.468 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:16:38.416+0000 7fb7a244eb80 1 --2- 172.21.15.163:0/256659832 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x558b53d0ff60 0x558b53d10370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:16:38.468 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:16:38.416+0000 7fb7a244eb80 1 --2- 172.21.15.163:0/256659832 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558b53d114b0 0x558b53d11920 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:16:38.468 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:16:38.416+0000 7fb7a244eb80 1 --2- 172.21.15.163:0/256659832 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x558b53d108b0 0x558b53d10ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:16:38.468 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:16:38.416+0000 7fb7a244eb80 1 -- 172.21.15.163:0/256659832 >> 172.21.15.163:0/256659832 conn(0x558b53d05680 msgr2=0x558b53d0a9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:16:38.468 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:16:38.416+0000 7fb7a244eb80 1 -- 172.21.15.163:0/256659832 shutdown_connections 2023-07-14T18:16:38.468 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:16:38.416+0000 7fb7a244eb80 1 -- 172.21.15.163:0/256659832 wait complete. 2023-07-14T18:16:38.469 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:16:38.417+0000 7fb7a244eb80 1 -- start start 2023-07-14T18:16:38.469 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:16:38.417+0000 7fb7a244eb80 1 Processor -- start 2023-07-14T18:16:38.469 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:16:38.417+0000 7fb7a244eb80 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x558b53d0ff60 0x558b53d19930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:16:38.469 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:16:38.417+0000 7fb7a244eb80 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x558b53d108b0 0x558b53d19e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:16:38.469 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:16:38.417+0000 7fb7a244eb80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558b53d114b0 0x558b53d20eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:16:38.469 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:16:38.417+0000 7fb7a244eb80 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x558b53c00ac0 con 0x558b53d0ff60 2023-07-14T18:16:38.469 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:16:38.417+0000 7fb7a244eb80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x558b53c007c0 con 0x558b53d114b0 2023-07-14T18:16:38.469 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:16:38.417+0000 7fb7a244eb80 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x558b53ae4920 con 0x558b53d108b0 2023-07-14T18:16:38.470 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:16:38.417+0000 7fb7a244eb80 10 client.0 _ll_register_callbacks cb 0x558b53bfe760 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T18:16:38.470 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:16:38.418+0000 7fb78f7fe700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x558b53d108b0 0x558b53d19e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:16:38.470 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:16:38.418+0000 7fb78f7fe700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x558b53d108b0 0x558b53d19e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.163:41438/0 (socket says 172.21.15.163:41438) 2023-07-14T18:16:38.470 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:16:38.418+0000 7fb78f7fe700 1 -- 172.21.15.163:0/638399175 learned_addr learned my addr 172.21.15.163:0/638399175 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:16:38.470 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:16:38.418+0000 7fb794853700 1 --2- 172.21.15.163:0/638399175 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558b53d114b0 0x558b53d20eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:16:38.470 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:16:38.418+0000 7fb78ffff700 1 --2- 172.21.15.163:0/638399175 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x558b53d0ff60 0x558b53d19930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:16:38.470 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:16:38.418+0000 7fb78f7fe700 1 -- 172.21.15.163:0/638399175 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558b53d114b0 msgr2=0x558b53d20eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:16:38.471 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:16:38.418+0000 7fb78f7fe700 1 --2- 172.21.15.163:0/638399175 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558b53d114b0 0x558b53d20eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:16:38.471 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:16:38.418+0000 7fb78f7fe700 1 -- 172.21.15.163:0/638399175 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x558b53d0ff60 msgr2=0x558b53d19930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:16:38.471 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:16:38.418+0000 7fb78f7fe700 1 --2- 172.21.15.163:0/638399175 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x558b53d0ff60 0x558b53d19930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:16:38.471 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:16:38.418+0000 7fb78f7fe700 1 -- 172.21.15.163:0/638399175 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb788009a90 con 0x558b53d108b0 2023-07-14T18:16:38.471 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:16:38.418+0000 7fb794853700 1 --2- 172.21.15.163:0/638399175 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558b53d114b0 0x558b53d20eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T18:16:38.471 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:16:38.418+0000 7fb78ffff700 1 --2- 172.21.15.163:0/638399175 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x558b53d0ff60 0x558b53d19930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T18:16:38.472 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:16:38.418+0000 7fb78f7fe700 1 --2- 172.21.15.163:0/638399175 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x558b53d108b0 0x558b53d19e70 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fb78400e970 tx=0x7fb78409a230 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a4dba4970cb98ef1 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:16:38.472 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:16:38.418+0000 7fb76f7fe700 10 client.0 ms_handle_connect on v2:172.21.15.184:3300/0 2023-07-14T18:16:38.472 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:16:38.418+0000 7fb76f7fe700 1 -- 172.21.15.163:0/638399175 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb784099870 con 0x558b53d108b0 2023-07-14T18:16:38.472 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:16:38.419+0000 7fb76f7fe700 1 -- 172.21.15.163:0/638399175 <== mon.1 v2:172.21.15.184:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 9049+0+0 (secure 0 0 0) 0x7fb7840a2140 con 0x558b53d108b0 2023-07-14T18:16:38.472 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:16:38.419+0000 7fb7a244eb80 1 -- 172.21.15.163:0/638399175 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x558b53bba4f0 con 0x558b53d108b0 2023-07-14T18:16:38.472 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:16:38.419+0000 7fb76f7fe700 1 -- 172.21.15.163:0/638399175 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb7840a2300 con 0x558b53d108b0 2023-07-14T18:16:38.472 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:16:38.419+0000 7fb7a244eb80 10 client.25885 fetch_fsmap learned FSMap version 31 2023-07-14T18:16:38.472 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:16:38.419+0000 7fb7a244eb80 1 -- 172.21.15.163:0/638399175 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) v3 -- 0x558b53a77c60 con 0x558b53d108b0 2023-07-14T18:16:38.473 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:16:38.419+0000 7fb76f7fe700 1 -- 172.21.15.163:0/638399175 <== mon.1 v2:172.21.15.184:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x558b53bba4f0 con 0x558b53d108b0 2023-07-14T18:16:38.473 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:16:38.419+0000 7fb76f7fe700 1 -- 172.21.15.163:0/638399175 <== mon.1 v2:172.21.15.184:3300/0 5 ==== fsmap(e 31) v1 ==== 7486+0+0 (secure 0 0 0) 0x7fb7840b8250 con 0x558b53d108b0 2023-07-14T18:16:38.473 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:16:38.419+0000 7fb7a244eb80 10 client.25885 fetch_fsmap finished waiting for FSMap version 31 2023-07-14T18:16:38.473 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:16:38.419+0000 7fb7a244eb80 10 client.25885 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-07-14T18:16:38.473 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:16:38.419+0000 7fb7a244eb80 20 client.25885 populate_metadata read hostname 'smithi163' 2023-07-14T18:16:38.473 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:16:38.419+0000 7fb7a244eb80 1 --2- 172.21.15.163:0/638399175 >> [v2:172.21.15.172:6838/3850440096,v1:172.21.15.172:6839/3850440096] conn(0x558b53d36670 0x558b53d38a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:16:38.473 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:16:38.419+0000 7fb7a244eb80 4 client.25885 mds_command: new command op to 24518 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-14T18:16:38.474 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:16:38.419+0000 7fb7a244eb80 1 -- 172.21.15.163:0/638399175 --> [v2:172.21.15.172:6838/3850440096,v1:172.21.15.172:6839/3850440096] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x558b53cdeda0 con 0x558b53d36670 2023-07-14T18:16:38.474 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:16:38.420+0000 7fb78ffff700 1 --2- 172.21.15.163:0/638399175 >> [v2:172.21.15.172:6838/3850440096,v1:172.21.15.172:6839/3850440096] conn(0x558b53d36670 0x558b53d38a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:16:38.474 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:16:38.420+0000 7fb76f7fe700 10 client.25885 ms_handle_connect on v2:172.21.15.172:6838/3850440096 2023-07-14T18:16:38.474 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:16:38.420+0000 7fb78ffff700 1 --2- 172.21.15.163:0/638399175 >> [v2:172.21.15.172:6838/3850440096,v1:172.21.15.172:6839/3850440096] conn(0x558b53d36670 0x558b53d38a80 crc :-1 s=READY pgs=73 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=69f56110b19b3533 server_cookie=420b6d6bf04cedea in_seq=0 out_seq=0 2023-07-14T18:16:38.474 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:16:38.421+0000 7fb76f7fe700 1 -- 172.21.15.163:0/638399175 <== mds.0 v2:172.21.15.172:6838/3850440096 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18017 (crc 0 0 0) 0x558b53cdeda0 con 0x558b53d36670 2023-07-14T18:16:38.474 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:16:38.421+0000 7fb76f7fe700 10 client.25885 handle_command_reply: tid=0 2023-07-14T18:16:38.474 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:16:38.421+0000 7fb7a244eb80 1 client.25885 shutdown 2023-07-14T18:16:38.474 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:16:38.421+0000 7fb7a244eb80 1 -- 172.21.15.163:0/638399175 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x558b53d108b0 msgr2=0x558b53d19e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:16:38.475 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:16:38.421+0000 7fb7a244eb80 1 --2- 172.21.15.163:0/638399175 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x558b53d108b0 0x558b53d19e70 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fb78400e970 tx=0x7fb78409a230 comp rx=0 tx=0).stop 2023-07-14T18:16:38.475 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:16:38.421+0000 7fb7a244eb80 1 -- 172.21.15.163:0/638399175 shutdown_connections 2023-07-14T18:16:38.475 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:16:38.421+0000 7fb7a244eb80 1 --2- 172.21.15.163:0/638399175 >> [v2:172.21.15.172:6838/3850440096,v1:172.21.15.172:6839/3850440096] conn(0x558b53d36670 0x558b53d38a80 crc :-1 s=READY pgs=73 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:16:38.475 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:16:38.421+0000 7fb7a244eb80 1 --2- 172.21.15.163:0/638399175 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558b53d114b0 0x558b53d20eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:16:38.475 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:16:38.421+0000 7fb7a244eb80 1 --2- 172.21.15.163:0/638399175 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x558b53d0ff60 0x558b53d19930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:16:38.475 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:16:38.421+0000 7fb7a244eb80 1 --2- 172.21.15.163:0/638399175 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x558b53d108b0 0x558b53d19e70 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:16:38.475 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:16:38.421+0000 7fb76f7fe700 0 client.25885 ms_handle_reset on v2:172.21.15.172:6838/3850440096 2023-07-14T18:16:38.475 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:16:38.421+0000 7fb7a244eb80 1 -- 172.21.15.163:0/638399175 >> 172.21.15.163:0/638399175 conn(0x558b53d05680 msgr2=0x558b53d09650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:16:38.476 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:16:38.421+0000 7fb7a244eb80 1 -- 172.21.15.163:0/638399175 shutdown_connections 2023-07-14T18:16:38.476 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:16:38.421+0000 7fb7a244eb80 1 -- 172.21.15.163:0/638399175 wait complete. 2023-07-14T18:16:38.476 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:16:38.422+0000 7fb7a244eb80 20 client.25885 trim_cache size 0 max 16384 2023-07-14T18:16:38.491 INFO:tasks.workunit.client.0.smithi163.stdout: [CC] tlibio.lo 2023-07-14T18:16:38.493 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:16:38.447+0000 7fb7a244eb80 1 Processor -- start 2023-07-14T18:16:38.493 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:16:38.447+0000 7fb7a244eb80 1 -- start start 2023-07-14T18:16:38.493 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:16:38.447+0000 7fb7a244eb80 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x558b53d0ff60 0x558b53d17860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:16:38.494 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:16:38.447+0000 7fb7a244eb80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558b53d108b0 0x558b53d20dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:16:38.494 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:16:38.447+0000 7fb7a244eb80 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x558b53d114b0 0x558b53d14390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:16:38.494 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:16:38.447+0000 7fb7a244eb80 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x558b53d0bcc0 con 0x558b53d114b0 2023-07-14T18:16:38.494 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:16:38.447+0000 7fb7a244eb80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x558b53d0a800 con 0x558b53d108b0 2023-07-14T18:16:38.495 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:16:38.447+0000 7fb7a244eb80 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x558b53d0c500 con 0x558b53d0ff60 2023-07-14T18:16:38.495 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:16:38.448+0000 7fb78ffff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x558b53d0ff60 0x558b53d17860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:16:38.495 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:16:38.448+0000 7fb78ffff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x558b53d0ff60 0x558b53d17860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.163:41446/0 (socket says 172.21.15.163:41446) 2023-07-14T18:16:38.495 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:16:38.448+0000 7fb78ffff700 1 -- 172.21.15.163:0/1629650577 learned_addr learned my addr 172.21.15.163:0/1629650577 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:16:38.495 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:16:38.448+0000 7fb794853700 1 --2- 172.21.15.163:0/1629650577 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x558b53d114b0 0x558b53d14390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:16:38.495 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:16:38.448+0000 7fb78f7fe700 1 --2- 172.21.15.163:0/1629650577 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558b53d108b0 0x558b53d20dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:16:38.495 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:16:38.448+0000 7fb78ffff700 1 -- 172.21.15.163:0/1629650577 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558b53d108b0 msgr2=0x558b53d20dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:16:38.496 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:16:38.448+0000 7fb78ffff700 1 --2- 172.21.15.163:0/1629650577 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558b53d108b0 0x558b53d20dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:16:38.496 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:16:38.448+0000 7fb78ffff700 1 -- 172.21.15.163:0/1629650577 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x558b53d114b0 msgr2=0x558b53d14390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:16:38.496 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:16:38.448+0000 7fb78ffff700 1 --2- 172.21.15.163:0/1629650577 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x558b53d114b0 0x558b53d14390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:16:38.496 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:16:38.448+0000 7fb78ffff700 1 -- 172.21.15.163:0/1629650577 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558b53ab5250 con 0x558b53d0ff60 2023-07-14T18:16:38.496 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:16:38.448+0000 7fb78ffff700 1 --2- 172.21.15.163:0/1629650577 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x558b53d0ff60 0x558b53d17860 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fb780015000 tx=0x7fb780020000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=81cd725426e658f8 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:16:38.496 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:16:38.448+0000 7fb776ffd700 1 -- 172.21.15.163:0/1629650577 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7800350f0 con 0x558b53d0ff60 2023-07-14T18:16:38.497 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:16:38.448+0000 7fb776ffd700 1 -- 172.21.15.163:0/1629650577 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fb78001e040 con 0x558b53d0ff60 2023-07-14T18:16:38.497 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:16:38.448+0000 7fb776ffd700 1 -- 172.21.15.163:0/1629650577 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb780004c30 con 0x558b53d0ff60 2023-07-14T18:16:38.499 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:16:38.449+0000 7fb7a244eb80 1 -- 172.21.15.163:0/1629650577 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x558b53d0ff60 msgr2=0x558b53d17860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:16:38.499 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:16:38.449+0000 7fb7a244eb80 1 --2- 172.21.15.163:0/1629650577 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x558b53d0ff60 0x558b53d17860 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fb780015000 tx=0x7fb780020000 comp rx=0 tx=0).stop 2023-07-14T18:16:38.499 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:16:38.449+0000 7fb7a244eb80 1 -- 172.21.15.163:0/1629650577 shutdown_connections 2023-07-14T18:16:38.499 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:16:38.449+0000 7fb7a244eb80 1 --2- 172.21.15.163:0/1629650577 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x558b53d0ff60 0x558b53d17860 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:16:38.499 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:16:38.449+0000 7fb7a244eb80 1 --2- 172.21.15.163:0/1629650577 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x558b53d114b0 0x558b53d14390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:16:38.500 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:16:38.449+0000 7fb7a244eb80 1 --2- 172.21.15.163:0/1629650577 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558b53d108b0 0x558b53d20dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:16:38.500 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:16:38.449+0000 7fb7a244eb80 1 -- 172.21.15.163:0/1629650577 >> 172.21.15.163:0/1629650577 conn(0x558b53d05680 msgr2=0x558b53d0a0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:16:38.500 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:16:38.450+0000 7fb7a244eb80 1 -- 172.21.15.163:0/1629650577 shutdown_connections 2023-07-14T18:16:38.500 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:16:38.450+0000 7fb7a244eb80 1 -- 172.21.15.163:0/1629650577 wait complete. 2023-07-14T18:16:38.500 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:16:38.450+0000 7fb7a244eb80 1 -- start start 2023-07-14T18:16:38.500 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:16:38.450+0000 7fb7a244eb80 1 Processor -- start 2023-07-14T18:16:38.500 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:16:38.450+0000 7fb7a244eb80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558b53d0ff60 0x558b53d20bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:16:38.501 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:16:38.451+0000 7fb7a244eb80 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x558b53d108b0 0x558b53d1d670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:16:38.501 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:16:38.451+0000 7fb7a244eb80 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x558b53d114b0 0x558b53d1dbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:16:38.501 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:16:38.451+0000 7fb7a244eb80 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x558b53d1e180 con 0x558b53d114b0 2023-07-14T18:16:38.501 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:16:38.451+0000 7fb7a244eb80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x558b53d1e2f0 con 0x558b53d0ff60 2023-07-14T18:16:38.501 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:16:38.451+0000 7fb7a244eb80 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x558b53d8a380 con 0x558b53d108b0 2023-07-14T18:16:38.501 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:16:38.451+0000 7fb7a244eb80 10 client.0 _ll_register_callbacks cb 0x7fb784099d00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T18:16:38.502 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:16:38.451+0000 7fb78f7fe700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x558b53d108b0 0x558b53d1d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:16:38.502 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:16:38.451+0000 7fb78f7fe700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x558b53d108b0 0x558b53d1d670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.163:41454/0 (socket says 172.21.15.163:41454) 2023-07-14T18:16:38.502 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:16:38.451+0000 7fb78f7fe700 1 -- 172.21.15.163:0/3695673976 learned_addr learned my addr 172.21.15.163:0/3695673976 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:16:38.502 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:16:38.451+0000 7fb78f7fe700 1 -- 172.21.15.163:0/3695673976 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558b53d0ff60 msgr2=0x558b53d20bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:16:38.502 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:16:38.451+0000 7fb78f7fe700 1 --2- 172.21.15.163:0/3695673976 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558b53d0ff60 0x558b53d20bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:16:38.502 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:16:38.451+0000 7fb78f7fe700 1 -- 172.21.15.163:0/3695673976 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x558b53d114b0 msgr2=0x558b53d1dbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:16:38.502 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:16:38.451+0000 7fb78f7fe700 1 --2- 172.21.15.163:0/3695673976 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x558b53d114b0 0x558b53d1dbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:16:38.502 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:16:38.451+0000 7fb78f7fe700 1 -- 172.21.15.163:0/3695673976 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb7901089b0 con 0x558b53d108b0 2023-07-14T18:16:38.503 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:16:38.451+0000 7fb78f7fe700 1 --2- 172.21.15.163:0/3695673976 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x558b53d108b0 0x558b53d1d670 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fb784010b20 tx=0x7fb7840a2700 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9bb0f3500daab05e server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:16:38.503 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:16:38.451+0000 7fb76f7fe700 10 client.0 ms_handle_connect on v2:172.21.15.184:3300/0 2023-07-14T18:16:38.503 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:16:38.452+0000 7fb76f7fe700 1 -- 172.21.15.163:0/3695673976 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7840a2340 con 0x558b53d108b0 2023-07-14T18:16:38.503 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:16:38.452+0000 7fb7a244eb80 1 -- 172.21.15.163:0/3695673976 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fb78800f050 con 0x558b53d108b0 2023-07-14T18:16:38.503 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:16:38.452+0000 7fb76f7fe700 1 -- 172.21.15.163:0/3695673976 <== mon.1 v2:172.21.15.184:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 9049+0+0 (secure 0 0 0) 0x7fb7840b2d70 con 0x558b53d108b0 2023-07-14T18:16:38.503 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:16:38.452+0000 7fb76f7fe700 1 -- 172.21.15.163:0/3695673976 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb784099670 con 0x558b53d108b0 2023-07-14T18:16:38.503 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:16:38.452+0000 7fb7a244eb80 10 client.25891 fetch_fsmap learned FSMap version 31 2023-07-14T18:16:38.503 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:16:38.452+0000 7fb7a244eb80 1 -- 172.21.15.163:0/3695673976 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) v3 -- 0x558b53a8d2b0 con 0x558b53d108b0 2023-07-14T18:16:38.504 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:16:38.452+0000 7fb76f7fe700 1 -- 172.21.15.163:0/3695673976 <== mon.1 v2:172.21.15.184:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fb78800f050 con 0x558b53d108b0 2023-07-14T18:16:38.504 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:16:38.452+0000 7fb76f7fe700 1 -- 172.21.15.163:0/3695673976 <== mon.1 v2:172.21.15.184:3300/0 5 ==== fsmap(e 31) v1 ==== 7486+0+0 (secure 0 0 0) 0x7fb784099200 con 0x558b53d108b0 2023-07-14T18:16:38.504 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:16:38.452+0000 7fb7a244eb80 10 client.25891 fetch_fsmap finished waiting for FSMap version 31 2023-07-14T18:16:38.504 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:16:38.452+0000 7fb7a244eb80 10 client.25891 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-07-14T18:16:38.504 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:16:38.452+0000 7fb7a244eb80 20 client.25891 populate_metadata read hostname 'smithi163' 2023-07-14T18:16:38.504 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:16:38.452+0000 7fb7a244eb80 1 --2- 172.21.15.163:0/3695673976 >> [v2:172.21.15.172:6838/3850440096,v1:172.21.15.172:6839/3850440096] conn(0x558b53d8ba70 0x558b53d8dec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:16:38.504 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:16:38.452+0000 7fb7a244eb80 4 client.25891 mds_command: new command op to 24518 tid=0[{"prefix": "scrub status"}] 2023-07-14T18:16:38.505 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:16:38.452+0000 7fb7a244eb80 1 -- 172.21.15.163:0/3695673976 --> [v2:172.21.15.172:6838/3850440096,v1:172.21.15.172:6839/3850440096] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x558b53c59eb0 con 0x558b53d8ba70 2023-07-14T18:16:38.505 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:16:38.453+0000 7fb78ffff700 1 --2- 172.21.15.163:0/3695673976 >> [v2:172.21.15.172:6838/3850440096,v1:172.21.15.172:6839/3850440096] conn(0x558b53d8ba70 0x558b53d8dec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:16:38.505 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:16:38.453+0000 7fb76f7fe700 10 client.25891 ms_handle_connect on v2:172.21.15.172:6838/3850440096 2023-07-14T18:16:38.505 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:16:38.453+0000 7fb78ffff700 1 --2- 172.21.15.163:0/3695673976 >> [v2:172.21.15.172:6838/3850440096,v1:172.21.15.172:6839/3850440096] conn(0x558b53d8ba70 0x558b53d8dec0 crc :-1 s=READY pgs=74 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=be998ee9ac87de57 server_cookie=a4632b64c3e1ae5c in_seq=0 out_seq=0 2023-07-14T18:16:38.505 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:16:38.453+0000 7fb76f7fe700 1 -- 172.21.15.163:0/3695673976 <== mds.0 v2:172.21.15.172:6838/3850440096 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+265 (crc 0 0 0) 0x558b53c59eb0 con 0x558b53d8ba70 2023-07-14T18:16:38.505 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:16:38.453+0000 7fb76f7fe700 10 client.25891 handle_command_reply: tid=0 2023-07-14T18:16:38.506 INFO:teuthology.orchestra.run.smithi163.stdout:{ 2023-07-14T18:16:38.506 INFO:teuthology.orchestra.run.smithi163.stdout: "status": "scrub active (1 inodes in the stack)", 2023-07-14T18:16:38.506 INFO:teuthology.orchestra.run.smithi163.stdout: "scrubs": { 2023-07-14T18:16:38.506 INFO:teuthology.orchestra.run.smithi163.stdout: "2c53b7ef-6f30-49f0-a60d-f1f114c19d42": { 2023-07-14T18:16:38.506 INFO:teuthology.orchestra.run.smithi163.stdout: "path": "/", 2023-07-14T18:16:38.506 INFO:teuthology.orchestra.run.smithi163.stdout: "tag": "2c53b7ef-6f30-49f0-a60d-f1f114c19d42", 2023-07-14T18:16:38.507 INFO:teuthology.orchestra.run.smithi163.stdout: "options": "recursive,force" 2023-07-14T18:16:38.507 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-07-14T18:16:38.507 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-07-14T18:16:38.507 INFO:teuthology.orchestra.run.smithi163.stdout:} 2023-07-14T18:16:38.508 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:16:38.453+0000 7fb7a244eb80 1 client.25891 shutdown 2023-07-14T18:16:38.508 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:16:38.454+0000 7fb7a244eb80 1 -- 172.21.15.163:0/3695673976 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x558b53d108b0 msgr2=0x558b53d1d670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:16:38.508 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:16:38.454+0000 7fb7a244eb80 1 --2- 172.21.15.163:0/3695673976 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x558b53d108b0 0x558b53d1d670 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fb784010b20 tx=0x7fb7840a2700 comp rx=0 tx=0).stop 2023-07-14T18:16:38.508 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:16:38.454+0000 7fb7a244eb80 1 -- 172.21.15.163:0/3695673976 shutdown_connections 2023-07-14T18:16:38.508 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:16:38.454+0000 7fb7a244eb80 1 --2- 172.21.15.163:0/3695673976 >> [v2:172.21.15.172:6838/3850440096,v1:172.21.15.172:6839/3850440096] conn(0x558b53d8ba70 0x558b53d8dec0 crc :-1 s=READY pgs=74 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:16:38.508 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:16:38.454+0000 7fb7a244eb80 1 --2- 172.21.15.163:0/3695673976 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x558b53d114b0 0x558b53d1dbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:16:38.509 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:16:38.454+0000 7fb7a244eb80 1 --2- 172.21.15.163:0/3695673976 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558b53d0ff60 0x558b53d20bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:16:38.509 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:16:38.454+0000 7fb7a244eb80 1 --2- 172.21.15.163:0/3695673976 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x558b53d108b0 0x558b53d1d670 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:16:38.509 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:16:38.454+0000 7fb7a244eb80 1 -- 172.21.15.163:0/3695673976 >> 172.21.15.163:0/3695673976 conn(0x558b53d05680 msgr2=0x558b53d17860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:16:38.509 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:16:38.454+0000 7fb76f7fe700 0 client.25891 ms_handle_reset on v2:172.21.15.172:6838/3850440096 2023-07-14T18:16:38.509 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:16:38.454+0000 7fb7a244eb80 1 -- 172.21.15.163:0/3695673976 shutdown_connections 2023-07-14T18:16:38.509 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:16:38.454+0000 7fb7a244eb80 1 -- 172.21.15.163:0/3695673976 wait complete. 2023-07-14T18:16:38.509 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:16:38.454+0000 7fb7a244eb80 20 client.25891 trim_cache size 0 max 16384 2023-07-14T18:16:38.510 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:16:38.455+0000 7fb7962b6700 1 -- 172.21.15.163:0/2684975202 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7fb7780a1320 msgr2=0x7fb7780a37d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:16:38.510 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:16:38.455+0000 7fb7962b6700 1 --2- 172.21.15.163:0/2684975202 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7fb7780a1320 0x7fb7780a37d0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fb780005b40 tx=0x7fb780005a90 comp rx=0 tx=0).stop 2023-07-14T18:16:38.510 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:16:38.455+0000 7fb7962b6700 1 -- 172.21.15.163:0/2684975202 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fb790100e30 msgr2=0x7fb7901a4ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:16:38.510 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:16:38.455+0000 7fb7962b6700 1 --2- 172.21.15.163:0/2684975202 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fb790100e30 0x7fb7901a4ba0 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7fb78400e9a0 tx=0x7fb78400ecb0 comp rx=0 tx=0).stop 2023-07-14T18:16:38.510 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:16:38.455+0000 7fb7962b6700 1 -- 172.21.15.163:0/2684975202 shutdown_connections 2023-07-14T18:16:38.510 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:16:38.455+0000 7fb7962b6700 1 --2- 172.21.15.163:0/2684975202 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7fb7780a1320 0x7fb7780a37d0 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:16:38.510 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:16:38.455+0000 7fb7962b6700 1 --2- 172.21.15.163:0/2684975202 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb7901017c0 0x7fb7901abc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:16:38.510 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:16:38.455+0000 7fb7962b6700 1 --2- 172.21.15.163:0/2684975202 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb7900ffc40 0x7fb7901a4660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:16:38.511 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:16:38.455+0000 7fb7962b6700 1 --2- 172.21.15.163:0/2684975202 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fb790100e30 0x7fb7901a4ba0 unknown :-1 s=CLOSED pgs=681 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:16:38.511 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:16:38.455+0000 7fb7962b6700 1 -- 172.21.15.163:0/2684975202 >> 172.21.15.163:0/2684975202 conn(0x7fb7900fb260 msgr2=0x7fb7900fcb40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:16:38.511 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:16:38.456+0000 7fb7962b6700 1 -- 172.21.15.163:0/2684975202 shutdown_connections 2023-07-14T18:16:38.511 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:16:38.456+0000 7fb7962b6700 1 -- 172.21.15.163:0/2684975202 wait complete. 2023-07-14T18:16:38.521 INFO:tasks.cephfs.filesystem:scrub status for tag:2c53b7ef-6f30-49f0-a60d-f1f114c19d42 - {'path': '/', 'tag': '2c53b7ef-6f30-49f0-a60d-f1f114c19d42', 'options': 'recursive,force'} 2023-07-14T18:16:38.617 INFO:tasks.workunit.client.0.smithi163.stdout: [CC] write_log.lo 2023-07-14T18:16:38.625 INFO:tasks.workunit.client.0.smithi163.stdout: [CC] random.lo 2023-07-14T18:16:38.929 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:16:38 smithi184 ceph-mon[98481]: pgmap v419: 129 pgs: 129 active+clean; 113 MiB data, 879 MiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 47 KiB/s wr, 19 op/s 2023-07-14T18:16:38.972 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:16:38 smithi163 ceph-mon[96576]: pgmap v419: 129 pgs: 129 active+clean; 113 MiB data, 879 MiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 47 KiB/s wr, 19 op/s 2023-07-14T18:16:39.030 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:16:38 smithi172 ceph-mon[97983]: pgmap v419: 129 pgs: 129 active+clean; 113 MiB data, 879 MiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 47 KiB/s wr, 19 op/s 2023-07-14T18:16:39.090 INFO:tasks.workunit.client.0.smithi163.stdout: [LD] 2023-07-14T18:16:39.323 INFO:tasks.workunit.client.0.smithi163.stdout:Building ltp 2023-07-14T18:16:39.323 INFO:tasks.workunit.client.0.smithi163.stdout:Building common 2023-07-14T18:16:39.323 INFO:tasks.workunit.client.0.smithi163.stdout:Building m4 2023-07-14T18:16:39.323 INFO:tasks.workunit.client.0.smithi163.stdout:Building src 2023-07-14T18:16:39.357 INFO:tasks.workunit.client.0.smithi163.stdout: [DEP] 2023-07-14T18:16:39.392 INFO:tasks.workunit.client.0.smithi163.stdout: [DEP] 2023-07-14T18:16:40.866 INFO:tasks.workunit.client.0.smithi163.stdout: [CC] fsstress 2023-07-14T18:16:40.867 INFO:tasks.workunit.client.0.smithi163.stdout: [CC] doio 2023-07-14T18:16:40.867 INFO:tasks.workunit.client.0.smithi163.stdout: [CC] fsx 2023-07-14T18:16:40.929 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:16:40 smithi184 ceph-mon[98481]: pgmap v420: 129 pgs: 129 active+clean; 113 MiB data, 880 MiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 86 KiB/s wr, 25 op/s 2023-07-14T18:16:40.972 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:16:40 smithi163 ceph-mon[96576]: pgmap v420: 129 pgs: 129 active+clean; 113 MiB data, 880 MiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 86 KiB/s wr, 25 op/s 2023-07-14T18:16:41.030 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:16:40 smithi172 ceph-mon[97983]: pgmap v420: 129 pgs: 129 active+clean; 113 MiB data, 880 MiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 86 KiB/s wr, 25 op/s 2023-07-14T18:16:41.356 INFO:tasks.workunit.client.0.smithi163.stderr:fsstress.c: In function 'attr_list_path': 2023-07-14T18:16:41.357 INFO:tasks.workunit.client.0.smithi163.stderr:fsstress.c:859:2: warning: 'attr_list' is deprecated: Use listxattr or llistxattr instead [-Wdeprecated-declarations] 2023-07-14T18:16:41.357 INFO:tasks.workunit.client.0.smithi163.stderr: rval = attr_list(name->path, buffer, buffersize, flags, cursor); 2023-07-14T18:16:41.357 INFO:tasks.workunit.client.0.smithi163.stderr: ^~~~ 2023-07-14T18:16:41.357 INFO:tasks.workunit.client.0.smithi163.stderr:In file included from ../src/global.h:25, 2023-07-14T18:16:41.357 INFO:tasks.workunit.client.0.smithi163.stderr: from fsstress.c:12: 2023-07-14T18:16:41.357 INFO:tasks.workunit.client.0.smithi163.stderr:/usr/include/attr/attributes.h:165:12: note: declared here 2023-07-14T18:16:41.357 INFO:tasks.workunit.client.0.smithi163.stderr: extern int attr_list(const char *__path, char *__buffer, const int __buffersize, 2023-07-14T18:16:41.358 INFO:tasks.workunit.client.0.smithi163.stderr: ^~~~~~~~~ 2023-07-14T18:16:41.358 INFO:tasks.workunit.client.0.smithi163.stderr:fsstress.c: In function 'attr_remove_path': 2023-07-14T18:16:41.358 INFO:tasks.workunit.client.0.smithi163.stderr:fsstress.c:878:2: warning: 'attr_remove' is deprecated: Use removexattr or lremovexattr instead [-Wdeprecated-declarations] 2023-07-14T18:16:41.358 INFO:tasks.workunit.client.0.smithi163.stderr: rval = attr_remove(name->path, attrname, flags); 2023-07-14T18:16:41.358 INFO:tasks.workunit.client.0.smithi163.stderr: ^~~~ 2023-07-14T18:16:41.358 INFO:tasks.workunit.client.0.smithi163.stderr:In file included from ../src/global.h:25, 2023-07-14T18:16:41.358 INFO:tasks.workunit.client.0.smithi163.stderr: from fsstress.c:12: 2023-07-14T18:16:41.359 INFO:tasks.workunit.client.0.smithi163.stderr:/usr/include/attr/attributes.h:152:12: note: declared here 2023-07-14T18:16:41.359 INFO:tasks.workunit.client.0.smithi163.stderr: extern int attr_remove (const char *__path, const char *__attrname, 2023-07-14T18:16:41.359 INFO:tasks.workunit.client.0.smithi163.stderr: ^~~~~~~~~~~ 2023-07-14T18:16:41.359 INFO:tasks.workunit.client.0.smithi163.stderr:fsstress.c: In function 'attr_set_path': 2023-07-14T18:16:41.359 INFO:tasks.workunit.client.0.smithi163.stderr:fsstress.c:898:2: warning: 'attr_set' is deprecated: Use setxattr or lsetxattr instead [-Wdeprecated-declarations] 2023-07-14T18:16:41.359 INFO:tasks.workunit.client.0.smithi163.stderr: rval = attr_set(name->path, attrname, attrvalue, valuelength, flags); 2023-07-14T18:16:41.359 INFO:tasks.workunit.client.0.smithi163.stderr: ^~~~ 2023-07-14T18:16:41.359 INFO:tasks.workunit.client.0.smithi163.stderr:In file included from ../src/global.h:25, 2023-07-14T18:16:41.360 INFO:tasks.workunit.client.0.smithi163.stderr: from fsstress.c:12: 2023-07-14T18:16:41.360 INFO:tasks.workunit.client.0.smithi163.stderr:/usr/include/attr/attributes.h:139:12: note: declared here 2023-07-14T18:16:41.360 INFO:tasks.workunit.client.0.smithi163.stderr: extern int attr_set (const char *__path, const char *__attrname, 2023-07-14T18:16:41.360 INFO:tasks.workunit.client.0.smithi163.stderr: ^~~~~~~~ 2023-07-14T18:16:42.078 INFO:tasks.workunit.client.0.smithi163.stdout: [CC] growfiles 2023-07-14T18:16:42.117 INFO:tasks.workunit.client.0.smithi163.stderr:fsx.c: In function 'main': 2023-07-14T18:16:42.117 INFO:tasks.workunit.client.0.smithi163.stderr:fsx.c:2662:5: warning: 'strncpy' specified bound 4096 equals destination size [-Wstringop-truncation] 2023-07-14T18:16:42.117 INFO:tasks.workunit.client.0.smithi163.stderr: strncpy(opsfile, optarg, sizeof(opsfile)); 2023-07-14T18:16:42.117 INFO:tasks.workunit.client.0.smithi163.stderr: ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-07-14T18:16:42.117 INFO:tasks.workunit.client.0.smithi163.stderr:fsx.c:2632:4: warning: 'strncpy' specified bound 1024 equals destination size [-Wstringop-truncation] 2023-07-14T18:16:42.118 INFO:tasks.workunit.client.0.smithi163.stderr: strncpy(dname, optarg, sizeof(dname)); 2023-07-14T18:16:42.118 INFO:tasks.workunit.client.0.smithi163.stderr: ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-07-14T18:16:42.179 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:16:41 smithi184 ceph-mon[98481]: pgmap v421: 129 pgs: 129 active+clean; 114 MiB data, 899 MiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 150 KiB/s wr, 31 op/s 2023-07-14T18:16:42.222 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:16:41 smithi163 ceph-mon[96576]: pgmap v421: 129 pgs: 129 active+clean; 114 MiB data, 899 MiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 150 KiB/s wr, 31 op/s 2023-07-14T18:16:42.280 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:16:41 smithi172 ceph-mon[97983]: pgmap v421: 129 pgs: 129 active+clean; 114 MiB data, 899 MiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 150 KiB/s wr, 31 op/s 2023-07-14T18:16:42.304 INFO:tasks.workunit.client.0.smithi163.stdout: [CC] iogen 2023-07-14T18:16:42.954 INFO:tasks.workunit.client.0.smithi163.stdout: [CC] aio-stress 2023-07-14T18:16:44.622 INFO:tasks.workunit.client.0.smithi163.stdout: [DEP] 2023-07-14T18:16:44.622 INFO:tasks.workunit.client.0.smithi163.stdout: [DEP] 2023-07-14T18:16:44.629 INFO:tasks.workunit.client.0.smithi163.stdout: [DEP] 2023-07-14T18:16:44.929 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:16:44 smithi184 ceph-mon[98481]: pgmap v422: 129 pgs: 129 active+clean; 114 MiB data, 900 MiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 238 KiB/s wr, 44 op/s 2023-07-14T18:16:44.972 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:16:44 smithi163 ceph-mon[96576]: pgmap v422: 129 pgs: 129 active+clean; 114 MiB data, 900 MiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 238 KiB/s wr, 44 op/s 2023-07-14T18:16:45.030 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:16:44 smithi172 ceph-mon[97983]: pgmap v422: 129 pgs: 129 active+clean; 114 MiB data, 900 MiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 238 KiB/s wr, 44 op/s 2023-07-14T18:16:45.331 INFO:tasks.workunit.client.0.smithi163.stdout: [CC] dirstress 2023-07-14T18:16:45.350 INFO:tasks.workunit.client.0.smithi163.stdout: [CC] fill 2023-07-14T18:16:45.350 INFO:tasks.workunit.client.0.smithi163.stdout: [CC] fill2 2023-07-14T18:16:45.354 INFO:tasks.workunit.client.0.smithi163.stdout: [CC] getpagesize 2023-07-14T18:16:45.772 INFO:tasks.workunit.client.0.smithi163.stdout: [CC] holes 2023-07-14T18:16:45.816 INFO:tasks.workunit.client.0.smithi163.stdout: [CC] lstat64 2023-07-14T18:16:45.928 INFO:tasks.workunit.client.0.smithi163.stdout: [CC] nametest 2023-07-14T18:16:45.965 INFO:tasks.workunit.client.0.smithi163.stdout: [CC] permname 2023-07-14T18:16:46.279 INFO:tasks.workunit.client.0.smithi163.stdout: [CC] randholes 2023-07-14T18:16:46.296 INFO:tasks.workunit.client.0.smithi163.stdout: [CC] runas 2023-07-14T18:16:46.473 INFO:tasks.workunit.client.0.smithi163.stdout: [CC] truncfile 2023-07-14T18:16:46.506 INFO:tasks.workunit.client.0.smithi163.stdout: [CC] usemem 2023-07-14T18:16:46.806 INFO:tasks.workunit.client.0.smithi163.stdout: [CC] mmapcat 2023-07-14T18:16:46.889 INFO:tasks.workunit.client.0.smithi163.stdout: [CC] append_reader 2023-07-14T18:16:46.922 INFO:tasks.workunit.client.0.smithi163.stdout: [CC] append_writer 2023-07-14T18:16:46.929 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:16:46 smithi184 ceph-mon[98481]: pgmap v423: 129 pgs: 129 active+clean; 115 MiB data, 902 MiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 274 KiB/s wr, 44 op/s 2023-07-14T18:16:46.948 INFO:tasks.workunit.client.0.smithi163.stdout: [CC] dirperf 2023-07-14T18:16:46.972 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:16:46 smithi163 ceph-mon[96576]: pgmap v423: 129 pgs: 129 active+clean; 115 MiB data, 902 MiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 274 KiB/s wr, 44 op/s 2023-07-14T18:16:47.030 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:16:46 smithi172 ceph-mon[97983]: pgmap v423: 129 pgs: 129 active+clean; 115 MiB data, 902 MiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 274 KiB/s wr, 44 op/s 2023-07-14T18:16:47.214 INFO:tasks.workunit.client.0.smithi163.stdout: [CC] metaperf 2023-07-14T18:16:47.336 INFO:tasks.workunit.client.0.smithi163.stdout: [CC] devzero 2023-07-14T18:16:47.363 INFO:tasks.workunit.client.0.smithi163.stdout: [CC] feature 2023-07-14T18:16:47.489 INFO:tasks.workunit.client.0.smithi163.stdout: [CC] alloc 2023-07-14T18:16:47.806 INFO:tasks.workunit.client.0.smithi163.stdout: [CC] fault 2023-07-14T18:16:48.218 INFO:tasks.workunit.client.0.smithi163.stdout: [CC] fstest 2023-07-14T18:16:48.321 INFO:tasks.workunit.client.0.smithi163.stdout: [CC] t_access_root 2023-07-14T18:16:48.382 INFO:tasks.workunit.client.0.smithi163.stdout: [CC] godown 2023-07-14T18:16:48.431 INFO:tasks.workunit.client.0.smithi163.stdout: [CC] resvtest 2023-07-14T18:16:48.854 INFO:tasks.workunit.client.0.smithi163.stderr:fstest.c: In function 'run_child': 2023-07-14T18:16:48.854 INFO:tasks.workunit.client.0.smithi163.stderr:fstest.c:95:20: warning: '/file' directive writing 5 bytes into a region of size between 1 and 1024 [-Wformat-overflow=] 2023-07-14T18:16:48.854 INFO:tasks.workunit.client.0.smithi163.stderr: sprintf(fname, "%s/file%d", dir, fnum); 2023-07-14T18:16:48.855 INFO:tasks.workunit.client.0.smithi163.stderr: ^~~~~ 2023-07-14T18:16:48.855 INFO:tasks.workunit.client.0.smithi163.stderr:fstest.c:95:17: note: directive argument in the range [0, 2147483647] 2023-07-14T18:16:48.855 INFO:tasks.workunit.client.0.smithi163.stderr: sprintf(fname, "%s/file%d", dir, fnum); 2023-07-14T18:16:48.855 INFO:tasks.workunit.client.0.smithi163.stderr: ^~~~~~~~~~~ 2023-07-14T18:16:48.855 INFO:tasks.workunit.client.0.smithi163.stderr:fstest.c:95:2: note: 'sprintf' output between 7 and 1039 bytes into a destination of size 1024 2023-07-14T18:16:48.855 INFO:tasks.workunit.client.0.smithi163.stderr: sprintf(fname, "%s/file%d", dir, fnum); 2023-07-14T18:16:48.855 INFO:tasks.workunit.client.0.smithi163.stderr: ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-07-14T18:16:48.856 INFO:tasks.workunit.client.0.smithi163.stderr:fstest.c:166:20: warning: '/file' directive writing 5 bytes into a region of size between 1 and 1024 [-Wformat-overflow=] 2023-07-14T18:16:48.856 INFO:tasks.workunit.client.0.smithi163.stderr: sprintf(fname, "%s/file%d", dir, fnum); 2023-07-14T18:16:48.856 INFO:tasks.workunit.client.0.smithi163.stderr: ^~~~~ 2023-07-14T18:16:48.856 INFO:tasks.workunit.client.0.smithi163.stderr:fstest.c:166:17: note: directive argument in the range [0, 2147483647] 2023-07-14T18:16:48.856 INFO:tasks.workunit.client.0.smithi163.stderr: sprintf(fname, "%s/file%d", dir, fnum); 2023-07-14T18:16:48.856 INFO:tasks.workunit.client.0.smithi163.stderr: ^~~~~~~~~~~ 2023-07-14T18:16:48.856 INFO:tasks.workunit.client.0.smithi163.stderr:fstest.c:166:2: note: 'sprintf' output between 7 and 1039 bytes into a destination of size 1024 2023-07-14T18:16:48.856 INFO:tasks.workunit.client.0.smithi163.stderr: sprintf(fname, "%s/file%d", dir, fnum); 2023-07-14T18:16:48.857 INFO:tasks.workunit.client.0.smithi163.stderr: ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-07-14T18:16:48.929 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:16:48 smithi184 ceph-mon[98481]: pgmap v424: 129 pgs: 129 active+clean; 115 MiB data, 902 MiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 288 KiB/s wr, 45 op/s 2023-07-14T18:16:48.930 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:16:48 smithi184 ceph-mon[98481]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-07-14T18:16:48.930 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:16:48 smithi184 ceph-mon[98481]: scrub summary: active paths [/] 2023-07-14T18:16:48.930 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:16:48 smithi184 ceph-mon[98481]: scrub summary: idle+waiting paths [/] 2023-07-14T18:16:48.934 INFO:tasks.workunit.client.0.smithi163.stdout: [CC] writemod 2023-07-14T18:16:48.972 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:16:48 smithi163 ceph-mon[96576]: pgmap v424: 129 pgs: 129 active+clean; 115 MiB data, 902 MiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 288 KiB/s wr, 45 op/s 2023-07-14T18:16:48.972 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:16:48 smithi163 ceph-mon[96576]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-07-14T18:16:48.972 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:16:48 smithi163 ceph-mon[96576]: scrub summary: active paths [/] 2023-07-14T18:16:48.972 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:16:48 smithi163 ceph-mon[96576]: scrub summary: idle+waiting paths [/] 2023-07-14T18:16:48.982 INFO:tasks.workunit.client.0.smithi163.stdout: [CC] writev_on_pagefault 2023-07-14T18:16:49.030 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:16:48 smithi172 ceph-mon[97983]: pgmap v424: 129 pgs: 129 active+clean; 115 MiB data, 902 MiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 288 KiB/s wr, 45 op/s 2023-07-14T18:16:49.031 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:16:48 smithi172 ceph-mon[97983]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-07-14T18:16:49.031 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:16:48 smithi172 ceph-mon[97983]: scrub summary: active paths [/] 2023-07-14T18:16:49.031 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:16:48 smithi172 ceph-mon[97983]: scrub summary: idle+waiting paths [/] 2023-07-14T18:16:49.122 INFO:tasks.workunit.client.0.smithi163.stdout: [CC] makeextents 2023-07-14T18:16:49.156 INFO:tasks.workunit.client.0.smithi163.stdout: [CC] itrash 2023-07-14T18:16:49.437 INFO:tasks.workunit.client.0.smithi163.stdout: [CC] rename 2023-07-14T18:16:49.503 INFO:tasks.workunit.client.0.smithi163.stdout: [CC] multi_open_unlink 2023-07-14T18:16:49.646 INFO:tasks.workunit.client.0.smithi163.stdout: [CC] dmiperf 2023-07-14T18:16:49.771 INFO:tasks.workunit.client.0.smithi163.stdout: [CC] unwritten_sync 2023-07-14T18:16:49.853 INFO:tasks.workunit.client.0.smithi163.stdout: [CC] genhashnames 2023-07-14T18:16:49.938 INFO:tasks.workunit.client.0.smithi163.stderr:multi_open_unlink.c: In function 'main': 2023-07-14T18:16:49.942 INFO:tasks.workunit.client.0.smithi163.stderr:multi_open_unlink.c:101:4: warning: 'attr_set' is deprecated: Use setxattr or lsetxattr instead [-Wdeprecated-declarations] 2023-07-14T18:16:49.942 INFO:tasks.workunit.client.0.smithi163.stderr: sts = attr_set(path, attrname, attrvalue, value_size, flags); 2023-07-14T18:16:49.942 INFO:tasks.workunit.client.0.smithi163.stderr: ^~~ 2023-07-14T18:16:49.943 INFO:tasks.workunit.client.0.smithi163.stderr:In file included from multi_open_unlink.c:15: 2023-07-14T18:16:49.943 INFO:tasks.workunit.client.0.smithi163.stderr:/usr/include/attr/attributes.h:139:12: note: declared here 2023-07-14T18:16:49.943 INFO:tasks.workunit.client.0.smithi163.stderr: extern int attr_set (const char *__path, const char *__attrname, 2023-07-14T18:16:49.943 INFO:tasks.workunit.client.0.smithi163.stderr: ^~~~~~~~ 2023-07-14T18:16:50.036 INFO:tasks.workunit.client.0.smithi163.stdout: [CC] t_holes 2023-07-14T18:16:50.169 INFO:tasks.workunit.client.0.smithi163.stderr:dmiperf.c: In function 'mkfile': 2023-07-14T18:16:50.169 INFO:tasks.workunit.client.0.smithi163.stderr:dmiperf.c:192:2: warning: 'attr_setf' is deprecated: Use fsetxattr instead [-Wdeprecated-declarations] 2023-07-14T18:16:50.170 INFO:tasks.workunit.client.0.smithi163.stderr: if (attr_setf(fd, DMFATTRNAME, attr, DMFATTRLEN, ATTR_ROOT) < 0) { 2023-07-14T18:16:50.170 INFO:tasks.workunit.client.0.smithi163.stderr: ^~ 2023-07-14T18:16:50.170 INFO:tasks.workunit.client.0.smithi163.stderr:In file included from dmiperf.c:20: 2023-07-14T18:16:50.170 INFO:tasks.workunit.client.0.smithi163.stderr:/usr/include/attr/attributes.h:143:12: note: declared here 2023-07-14T18:16:50.170 INFO:tasks.workunit.client.0.smithi163.stderr: extern int attr_setf (int __fd, const char *__attrname, 2023-07-14T18:16:50.170 INFO:tasks.workunit.client.0.smithi163.stderr: ^~~~~~~~~ 2023-07-14T18:16:50.297 INFO:tasks.workunit.client.0.smithi163.stdout: [CC] t_mmap_writev 2023-07-14T18:16:50.423 INFO:tasks.workunit.client.0.smithi163.stdout: [CC] t_truncate_cmtime 2023-07-14T18:16:50.440 INFO:tasks.workunit.client.0.smithi163.stdout: [CC] dirhash_collide 2023-07-14T18:16:50.468 INFO:tasks.workunit.client.0.smithi163.stdout: [CC] t_rename_overwrite 2023-07-14T18:16:50.766 INFO:tasks.workunit.client.0.smithi163.stdout: [CC] holetest 2023-07-14T18:16:50.930 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:16:50 smithi184 ceph-mon[98481]: pgmap v425: 129 pgs: 129 active+clean; 116 MiB data, 904 MiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 336 KiB/s wr, 59 op/s 2023-07-14T18:16:50.959 INFO:tasks.workunit.client.0.smithi163.stdout: [CC] t_truncate_self 2023-07-14T18:16:50.972 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:16:50 smithi163 ceph-mon[96576]: pgmap v425: 129 pgs: 129 active+clean; 116 MiB data, 904 MiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 336 KiB/s wr, 59 op/s 2023-07-14T18:16:50.992 INFO:tasks.workunit.client.0.smithi163.stdout: [CC] t_mmap_dio 2023-07-14T18:16:51.030 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:16:50 smithi172 ceph-mon[97983]: pgmap v425: 129 pgs: 129 active+clean; 116 MiB data, 904 MiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 336 KiB/s wr, 59 op/s 2023-07-14T18:16:51.056 INFO:tasks.workunit.client.0.smithi163.stdout: [CC] af_unix 2023-07-14T18:16:51.362 INFO:tasks.workunit.client.0.smithi163.stdout: [CC] t_mmap_stale_pmd 2023-07-14T18:16:51.370 INFO:tasks.workunit.client.0.smithi163.stdout: [CC] t_mmap_cow_race 2023-07-14T18:16:51.539 INFO:tasks.workunit.client.0.smithi163.stdout: [CC] t_mmap_fallocate 2023-07-14T18:16:51.580 INFO:tasks.workunit.client.0.smithi163.stdout: [CC] fsync-err 2023-07-14T18:16:51.911 INFO:tasks.workunit.client.0.smithi163.stdout: [CC] t_mmap_write_ro 2023-07-14T18:16:51.963 INFO:tasks.workunit.client.0.smithi163.stdout: [CC] t_ext4_dax_journal_corruption 2023-07-14T18:16:52.040 INFO:tasks.workunit.client.0.smithi163.stdout: [CC] t_ext4_dax_inline_corruption 2023-07-14T18:16:52.124 INFO:tasks.workunit.client.0.smithi163.stdout: [CC] t_ofd_locks 2023-07-14T18:16:52.179 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:16:51 smithi184 ceph-mon[98481]: pgmap v426: 129 pgs: 129 active+clean; 117 MiB data, 907 MiB used, 1.0 TiB / 1.0 TiB avail; 114 KiB/s rd, 396 KiB/s wr, 71 op/s 2023-07-14T18:16:52.222 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:16:51 smithi163 ceph-mon[96576]: pgmap v426: 129 pgs: 129 active+clean; 117 MiB data, 907 MiB used, 1.0 TiB / 1.0 TiB avail; 114 KiB/s rd, 396 KiB/s wr, 71 op/s 2023-07-14T18:16:52.280 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:16:51 smithi172 ceph-mon[97983]: pgmap v426: 129 pgs: 129 active+clean; 117 MiB data, 907 MiB used, 1.0 TiB / 1.0 TiB avail; 114 KiB/s rd, 396 KiB/s wr, 71 op/s 2023-07-14T18:16:52.449 INFO:tasks.workunit.client.0.smithi163.stdout: [CC] t_locks_execve 2023-07-14T18:16:52.559 INFO:tasks.workunit.client.0.smithi163.stdout: [CC] t_mmap_collision 2023-07-14T18:16:52.630 INFO:tasks.workunit.client.0.smithi163.stdout: [CC] mmap-write-concurrent 2023-07-14T18:16:52.738 INFO:tasks.workunit.client.0.smithi163.stdout: [CC] xfsctl 2023-07-14T18:16:52.980 INFO:tasks.workunit.client.0.smithi163.stdout: [CC] bstat 2023-07-14T18:16:53.188 INFO:tasks.workunit.client.0.smithi163.stdout: [CC] t_mtab 2023-07-14T18:16:53.190 INFO:tasks.workunit.client.0.smithi163.stdout: [CC] getdevicesize 2023-07-14T18:16:53.361 INFO:tasks.workunit.client.0.smithi163.stdout: [CC] preallo_rw_pattern_reader 2023-07-14T18:16:53.657 INFO:tasks.workunit.client.0.smithi163.stdout: [CC] preallo_rw_pattern_writer 2023-07-14T18:16:53.663 INFO:tasks.workunit.client.0.smithi163.stdout: [CC] ftrunc 2023-07-14T18:16:53.806 INFO:tasks.workunit.client.0.smithi163.stdout: [CC] trunc 2023-07-14T18:16:53.937 INFO:tasks.workunit.client.0.smithi163.stdout: [CC] fs_perms 2023-07-14T18:16:54.179 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:16:53 smithi184 ceph-mon[98481]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-07-14T18:16:54.180 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:16:53 smithi184 ceph-mon[98481]: pgmap v427: 129 pgs: 129 active+clean; 117 MiB data, 908 MiB used, 1.0 TiB / 1.0 TiB avail; 125 KiB/s rd, 388 KiB/s wr, 79 op/s 2023-07-14T18:16:54.205 INFO:tasks.workunit.client.0.smithi163.stdout: [CC] testx 2023-07-14T18:16:54.222 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:16:53 smithi163 ceph-mon[96576]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-07-14T18:16:54.222 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:16:53 smithi163 ceph-mon[96576]: pgmap v427: 129 pgs: 129 active+clean; 117 MiB data, 908 MiB used, 1.0 TiB / 1.0 TiB avail; 125 KiB/s rd, 388 KiB/s wr, 79 op/s 2023-07-14T18:16:54.280 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:16:53 smithi172 ceph-mon[97983]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-07-14T18:16:54.281 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:16:53 smithi172 ceph-mon[97983]: pgmap v427: 129 pgs: 129 active+clean; 117 MiB data, 908 MiB used, 1.0 TiB / 1.0 TiB avail; 125 KiB/s rd, 388 KiB/s wr, 79 op/s 2023-07-14T18:16:54.362 INFO:tasks.workunit.client.0.smithi163.stdout: [CC] looptest 2023-07-14T18:16:54.397 INFO:tasks.workunit.client.0.smithi163.stdout: [CC] locktest 2023-07-14T18:16:54.477 INFO:tasks.workunit.client.0.smithi163.stdout: [CC] unwritten_mmap 2023-07-14T18:16:54.586 INFO:tasks.workunit.client.0.smithi163.stdout: [CC] bulkstat_unlink_test 2023-07-14T18:16:54.968 INFO:tasks.workunit.client.0.smithi163.stdout: [CC] bulkstat_unlink_test_modified 2023-07-14T18:16:55.181 INFO:tasks.workunit.client.0.smithi163.stdout: [CC] t_dir_offset 2023-07-14T18:16:55.278 INFO:tasks.workunit.client.0.smithi163.stdout: [CC] t_futimens 2023-07-14T18:16:55.279 INFO:tasks.workunit.client.0.smithi163.stdout: [CC] t_immutable 2023-07-14T18:16:55.586 INFO:tasks.workunit.client.0.smithi163.stdout: [CC] stale_handle 2023-07-14T18:16:55.643 INFO:tasks.workunit.client.0.smithi163.stdout: [CC] pwrite_mmap_blocked 2023-07-14T18:16:55.739 INFO:tasks.workunit.client.0.smithi163.stdout: [CC] t_dir_offset2 2023-07-14T18:16:56.233 INFO:tasks.workunit.client.0.smithi163.stdout: [CC] seek_sanity_test 2023-07-14T18:16:56.263 INFO:tasks.workunit.client.0.smithi163.stdout: [CC] seek_copy_test 2023-07-14T18:16:56.288 INFO:tasks.workunit.client.0.smithi163.stdout: [CC] t_readdir_1 2023-07-14T18:16:56.508 INFO:tasks.workunit.client.0.smithi163.stdout: [CC] t_readdir_2 2023-07-14T18:16:56.900 INFO:tasks.workunit.client.0.smithi163.stdout: [CC] fsync-tester 2023-07-14T18:16:56.930 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:16:56 smithi184 ceph-mon[98481]: pgmap v428: 129 pgs: 129 active+clean; 118 MiB data, 910 MiB used, 1.0 TiB / 1.0 TiB avail; 111 KiB/s rd, 330 KiB/s wr, 80 op/s 2023-07-14T18:16:56.932 INFO:tasks.workunit.client.0.smithi163.stdout: [CC] nsexec 2023-07-14T18:16:56.972 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:16:56 smithi163 ceph-mon[96576]: pgmap v428: 129 pgs: 129 active+clean; 118 MiB data, 910 MiB used, 1.0 TiB / 1.0 TiB avail; 111 KiB/s rd, 330 KiB/s wr, 80 op/s 2023-07-14T18:16:57.010 INFO:tasks.workunit.client.0.smithi163.stdout: [CC] cloner 2023-07-14T18:16:57.030 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:16:56 smithi172 ceph-mon[97983]: pgmap v428: 129 pgs: 129 active+clean; 118 MiB data, 910 MiB used, 1.0 TiB / 1.0 TiB avail; 111 KiB/s rd, 330 KiB/s wr, 80 op/s 2023-07-14T18:16:57.334 INFO:tasks.workunit.client.0.smithi163.stdout: [CC] renameat2 2023-07-14T18:16:57.513 INFO:tasks.workunit.client.0.smithi163.stdout: [CC] t_getcwd 2023-07-14T18:16:57.584 INFO:tasks.workunit.client.0.smithi163.stdout: [CC] e4compact 2023-07-14T18:16:57.610 INFO:tasks.workunit.client.0.smithi163.stdout: [CC] test-nextquota 2023-07-14T18:16:57.970 INFO:tasks.workunit.client.0.smithi163.stdout: [CC] punch-alternating 2023-07-14T18:16:58.010 INFO:tasks.workunit.client.0.smithi163.stderr:t_getcwd.c: In function 'do_rename': 2023-07-14T18:16:58.011 INFO:tasks.workunit.client.0.smithi163.stderr:t_getcwd.c:40:2: warning: 'strncpy' specified bound 256 equals destination size [-Wstringop-truncation] 2023-07-14T18:16:58.011 INFO:tasks.workunit.client.0.smithi163.stderr: strncpy(c_name, prefix, BUF_SIZE); 2023-07-14T18:16:58.011 INFO:tasks.workunit.client.0.smithi163.stderr: ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-07-14T18:16:58.077 INFO:tasks.workunit.client.0.smithi163.stdout: [CC] attr-list-by-handle-cursor-test 2023-07-14T18:16:58.284 INFO:tasks.workunit.client.0.smithi163.stdout: [CC] listxattr 2023-07-14T18:16:58.287 INFO:tasks.workunit.client.0.smithi163.stdout: [CC] dio-interleaved 2023-07-14T18:16:58.605 INFO:tasks.workunit.client.0.smithi163.stdout: [CC] t_dir_type 2023-07-14T18:16:58.733 INFO:tasks.workunit.client.0.smithi163.stdout: [CC] dio-invalidate-cache 2023-07-14T18:16:58.767 INFO:tasks.workunit.client.0.smithi163.stdout: [CC] stat_test 2023-07-14T18:16:58.826 INFO:tasks.workunit.client.0.smithi163.stdout: [CC] t_encrypted_d_revalidate 2023-07-14T18:16:58.929 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:16:58 smithi184 ceph-mon[98481]: pgmap v429: 129 pgs: 129 active+clean; 118 MiB data, 910 MiB used, 1.0 TiB / 1.0 TiB avail; 107 KiB/s rd, 312 KiB/s wr, 81 op/s 2023-07-14T18:16:58.972 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:16:58 smithi163 ceph-mon[96576]: pgmap v429: 129 pgs: 129 active+clean; 118 MiB data, 910 MiB used, 1.0 TiB / 1.0 TiB avail; 107 KiB/s rd, 312 KiB/s wr, 81 op/s 2023-07-14T18:16:59.030 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:16:58 smithi172 ceph-mon[97983]: pgmap v429: 129 pgs: 129 active+clean; 118 MiB data, 910 MiB used, 1.0 TiB / 1.0 TiB avail; 107 KiB/s rd, 312 KiB/s wr, 81 op/s 2023-07-14T18:16:59.097 INFO:tasks.workunit.client.0.smithi163.stdout: [CC] attr_replace_test 2023-07-14T18:16:59.334 INFO:tasks.workunit.client.0.smithi163.stdout: [CC] swapon 2023-07-14T18:16:59.422 INFO:tasks.workunit.client.0.smithi163.stdout: [CC] mkswap 2023-07-14T18:16:59.554 INFO:tasks.workunit.client.0.smithi163.stdout: [CC] t_attr_corruption 2023-07-14T18:16:59.594 INFO:tasks.workunit.client.0.smithi163.stdout: [CC] t_open_tmpfiles 2023-07-14T18:16:59.810 INFO:tasks.workunit.client.0.smithi163.stderr:swapon.c: In function 'main': 2023-07-14T18:16:59.810 INFO:tasks.workunit.client.0.smithi163.stderr:swapon.c:135:3: warning: 'p' may be used uninitialized in this function [-Wmaybe-uninitialized] 2023-07-14T18:16:59.810 INFO:tasks.workunit.client.0.smithi163.stderr: memcpy(p, buf, BUF_SIZE); 2023-07-14T18:16:59.810 INFO:tasks.workunit.client.0.smithi163.stderr: ^~~~~~~~~~~~~~~~~~~~~~~~ 2023-07-14T18:16:59.892 INFO:tasks.workunit.client.0.smithi163.stdout: [CC] fscrypt-crypt-util 2023-07-14T18:16:59.920 INFO:tasks.workunit.client.0.smithi163.stdout: [CC] bulkstat_null_ocount 2023-07-14T18:17:00.050 INFO:tasks.workunit.client.0.smithi163.stdout: [CC] splice-test 2023-07-14T18:17:00.236 INFO:tasks.workunit.client.0.smithi163.stdout: [CC] fiemap-tester 2023-07-14T18:17:00.555 INFO:tasks.workunit.client.0.smithi163.stdout: [CC] t_stripealign 2023-07-14T18:17:00.638 INFO:tasks.workunit.client.0.smithi163.stdout: [CC] open_by_handle 2023-07-14T18:17:00.867 INFO:tasks.workunit.client.0.smithi163.stdout: [CC] fssum 2023-07-14T18:17:00.929 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:17:00 smithi184 ceph-mon[98481]: pgmap v430: 129 pgs: 129 active+clean; 119 MiB data, 916 MiB used, 1.0 TiB / 1.0 TiB avail; 128 KiB/s rd, 338 KiB/s wr, 98 op/s 2023-07-14T18:17:00.964 INFO:tasks.workunit.client.0.smithi163.stdout:Building log-writes 2023-07-14T18:17:00.972 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:17:00 smithi163 ceph-mon[96576]: pgmap v430: 129 pgs: 129 active+clean; 119 MiB data, 916 MiB used, 1.0 TiB / 1.0 TiB avail; 128 KiB/s rd, 338 KiB/s wr, 98 op/s 2023-07-14T18:17:01.023 INFO:tasks.workunit.client.0.smithi163.stdout: [CC] replay-log 2023-07-14T18:17:01.030 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:17:00 smithi172 ceph-mon[97983]: pgmap v430: 129 pgs: 129 active+clean; 119 MiB data, 916 MiB used, 1.0 TiB / 1.0 TiB avail; 128 KiB/s rd, 338 KiB/s wr, 98 op/s 2023-07-14T18:17:01.055 INFO:tasks.workunit.client.0.smithi163.stdout:Building perf 2023-07-14T18:17:01.081 INFO:tasks.workunit.client.0.smithi163.stdout:Building aio-dio-regress 2023-07-14T18:17:01.134 INFO:tasks.workunit.client.0.smithi163.stdout: [CC] aio-dio-append-write-fallocate-race 2023-07-14T18:17:01.248 INFO:tasks.workunit.client.0.smithi163.stdout: [CC] aio-dio-fcntl-race 2023-07-14T18:17:01.564 INFO:tasks.workunit.client.0.smithi163.stdout: [CC] aio-dio-subblock-eof-read 2023-07-14T18:17:01.696 INFO:tasks.workunit.client.0.smithi163.stdout: [CC] aio-dio-append-write-read-race 2023-07-14T18:17:01.781 INFO:tasks.workunit.client.0.smithi163.stdout: [CC] aio-dio-invalidate-readahead 2023-07-14T18:17:01.844 INFO:tasks.workunit.client.0.smithi163.stdout: [CC] aio-dio-hole-filling-race 2023-07-14T18:17:01.955 INFO:tasks.workunit.client.0.smithi163.stdout: [CC] aio-free-ring-with-bogus-nr-pages 2023-07-14T18:17:02.177 INFO:tasks.workunit.client.0.smithi163.stdout: [CC] aio-last-ref-held-by-io 2023-07-14T18:17:02.179 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:17:01 smithi184 ceph-mon[98481]: pgmap v431: 129 pgs: 129 active+clean; 119 MiB data, 918 MiB used, 1.0 TiB / 1.0 TiB avail; 112 KiB/s rd, 350 KiB/s wr, 99 op/s 2023-07-14T18:17:02.222 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:17:01 smithi163 ceph-mon[96576]: pgmap v431: 129 pgs: 129 active+clean; 119 MiB data, 918 MiB used, 1.0 TiB / 1.0 TiB avail; 112 KiB/s rd, 350 KiB/s wr, 99 op/s 2023-07-14T18:17:02.243 INFO:tasks.workunit.client.0.smithi163.stdout: [CC] aio-dio-cycle-write 2023-07-14T18:17:02.279 INFO:tasks.workunit.client.0.smithi163.stdout: [CC] aio-dio-extend-stat 2023-07-14T18:17:02.280 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:17:01 smithi172 ceph-mon[97983]: pgmap v431: 129 pgs: 129 active+clean; 119 MiB data, 918 MiB used, 1.0 TiB / 1.0 TiB avail; 112 KiB/s rd, 350 KiB/s wr, 99 op/s 2023-07-14T18:17:02.328 INFO:tasks.workunit.client.0.smithi163.stdout: [CC] aio-io-setup-with-nonwritable-context-pointer 2023-07-14T18:17:02.594 INFO:tasks.workunit.client.0.smithi163.stdout: [CC] aiocp 2023-07-14T18:17:02.708 INFO:tasks.workunit.client.0.smithi163.stdout: [CC] aio-dio-invalidate-failure 2023-07-14T18:17:02.711 INFO:tasks.workunit.client.0.smithi163.stdout: [CC] aiodio_sparse2 2023-07-14T18:17:02.712 INFO:tasks.workunit.client.0.smithi163.stdout: [CC] aio-dio-cow-race 2023-07-14T18:17:03.094 INFO:tasks.workunit.client.0.smithi163.stderr:aiodio_sparse2.c: In function 'main': 2023-07-14T18:17:03.095 INFO:tasks.workunit.client.0.smithi163.stderr:aiodio_sparse2.c:404:2: warning: 'strncpy' specified bound 4096 equals destination size [-Wstringop-truncation] 2023-07-14T18:17:03.095 INFO:tasks.workunit.client.0.smithi163.stderr: strncpy(filename, argv[argc-1], PATH_MAX); 2023-07-14T18:17:03.095 INFO:tasks.workunit.client.0.smithi163.stderr: ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-07-14T18:17:03.110 INFO:tasks.workunit.client.0.smithi163.stdout: [CC] aio-dio-write-verify 2023-07-14T18:17:03.129 INFO:tasks.workunit.client.0.smithi163.stdout: [CC] aio-dio-eof-race 2023-07-14T18:17:03.525 INFO:tasks.workunit.client.0.smithi163.stderr:+ cd .. 2023-07-14T18:17:03.527 INFO:tasks.workunit.client.0.smithi163.stderr:+ cp xfstests-dev/ltp/fsx . 2023-07-14T18:17:03.535 INFO:tasks.workunit.client.0.smithi163.stderr:+ OPTIONS=-z 2023-07-14T18:17:03.535 INFO:tasks.workunit.client.0.smithi163.stderr:+ ./fsx -z 1MB -N 50000 -p 10000 -l 1048576 2023-07-14T18:17:03.535 INFO:tasks.workunit.client.0.smithi163.stdout:Seed set to 1 2023-07-14T18:17:03.572 INFO:tasks.workunit.client.0.smithi163.stderr:main: filesystem does not support fallocate mode FALLOC_FL_COLLAPSE_RANGE, disabling! 2023-07-14T18:17:03.573 INFO:tasks.workunit.client.0.smithi163.stderr:main: filesystem does not support fallocate mode FALLOC_FL_INSERT_RANGE, disabling! 2023-07-14T18:17:03.573 INFO:tasks.workunit.client.0.smithi163.stderr:main: filesystem does not support clone range, disabling! 2023-07-14T18:17:03.573 INFO:tasks.workunit.client.0.smithi163.stderr:main: filesystem does not support dedupe range, disabling! 2023-07-14T18:17:03.590 INFO:tasks.workunit.client.0.smithi163.stdout:truncating to largest ever: 0x366e7 2023-07-14T18:17:03.631 INFO:tasks.workunit.client.0.smithi163.stdout:copying to largest ever: 0xead53 2023-07-14T18:17:03.717 INFO:tasks.workunit.client.0.smithi163.stdout:truncating to largest ever: 0xfc5c3 2023-07-14T18:17:03.845 INFO:tasks.workunit.client.0.smithi163.stdout:truncating to largest ever: 0xfca47 2023-07-14T18:17:04.240 INFO:tasks.workunit.client.0.smithi163.stdout:copying to largest ever: 0xff398 2023-07-14T18:17:04.624 INFO:tasks.workunit.client.0.smithi163.stdout:fallocating to largest ever: 0x100000 2023-07-14T18:17:04.929 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:17:04 smithi184 ceph-mon[98481]: pgmap v432: 129 pgs: 129 active+clean; 120 MiB data, 919 MiB used, 1.0 TiB / 1.0 TiB avail; 81 KiB/s rd, 319 KiB/s wr, 101 op/s 2023-07-14T18:17:04.972 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:17:04 smithi163 ceph-mon[96576]: pgmap v432: 129 pgs: 129 active+clean; 120 MiB data, 919 MiB used, 1.0 TiB / 1.0 TiB avail; 81 KiB/s rd, 319 KiB/s wr, 101 op/s 2023-07-14T18:17:05.030 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:17:04 smithi172 ceph-mon[97983]: pgmap v432: 129 pgs: 129 active+clean; 120 MiB data, 919 MiB used, 1.0 TiB / 1.0 TiB avail; 81 KiB/s rd, 319 KiB/s wr, 101 op/s 2023-07-14T18:17:06.930 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:17:06 smithi184 ceph-mon[98481]: pgmap v433: 129 pgs: 129 active+clean; 121 MiB data, 925 MiB used, 1.0 TiB / 1.0 TiB avail; 87 KiB/s rd, 361 KiB/s wr, 109 op/s 2023-07-14T18:17:06.972 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:17:06 smithi163 ceph-mon[96576]: pgmap v433: 129 pgs: 129 active+clean; 121 MiB data, 925 MiB used, 1.0 TiB / 1.0 TiB avail; 87 KiB/s rd, 361 KiB/s wr, 109 op/s 2023-07-14T18:17:07.031 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:17:06 smithi172 ceph-mon[97983]: pgmap v433: 129 pgs: 129 active+clean; 121 MiB data, 925 MiB used, 1.0 TiB / 1.0 TiB avail; 87 KiB/s rd, 361 KiB/s wr, 109 op/s 2023-07-14T18:17:08.522 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-07-14T18:17:08.675 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:17:08.630+0000 7fe7bc7eb700 1 -- 172.21.15.163:0/1817869660 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fe7b4100690 msgr2=0x7fe7b4106f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:17:08.676 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:17:08.630+0000 7fe7bc7eb700 1 --2- 172.21.15.163:0/1817869660 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fe7b4100690 0x7fe7b4106f50 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7fe7ac00b0a0 tx=0x7fe7ac00b3b0 comp rx=0 tx=0).stop 2023-07-14T18:17:08.676 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:17:08.630+0000 7fe7bc7eb700 1 -- 172.21.15.163:0/1817869660 shutdown_connections 2023-07-14T18:17:08.676 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:17:08.630+0000 7fe7bc7eb700 1 --2- 172.21.15.163:0/1817869660 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fe7b4100690 0x7fe7b4106f50 unknown :-1 s=CLOSED pgs=682 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:17:08.676 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:17:08.630+0000 7fe7bc7eb700 1 --2- 172.21.15.163:0/1817869660 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe7b40feb10 0x7fe7b40fef20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:17:08.676 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:17:08.630+0000 7fe7bc7eb700 1 --2- 172.21.15.163:0/1817869660 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe7b40ffd00 0x7fe7b4100150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:17:08.676 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:17:08.630+0000 7fe7bc7eb700 1 -- 172.21.15.163:0/1817869660 >> 172.21.15.163:0/1817869660 conn(0x7fe7b40fa130 msgr2=0x7fe7b40fc560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:17:08.676 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:17:08.630+0000 7fe7bc7eb700 1 -- 172.21.15.163:0/1817869660 shutdown_connections 2023-07-14T18:17:08.677 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:17:08.630+0000 7fe7bc7eb700 1 -- 172.21.15.163:0/1817869660 wait complete. 2023-07-14T18:17:08.678 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:17:08.631+0000 7fe7bc7eb700 1 Processor -- start 2023-07-14T18:17:08.678 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:17:08.631+0000 7fe7bc7eb700 1 -- start start 2023-07-14T18:17:08.678 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:17:08.631+0000 7fe7bc7eb700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe7b40feb10 0x7fe7b4194910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:17:08.678 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:17:08.631+0000 7fe7bc7eb700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe7b40ffd00 0x7fe7b4194e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:17:08.679 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:17:08.631+0000 7fe7bc7eb700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fe7b4100690 0x7fe7b419bec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:17:08.679 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:17:08.631+0000 7fe7bc7eb700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7b419c490 con 0x7fe7b4100690 2023-07-14T18:17:08.679 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:17:08.631+0000 7fe7bc7eb700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7b419c5d0 con 0x7fe7b40ffd00 2023-07-14T18:17:08.679 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:17:08.631+0000 7fe7bc7eb700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7b419c760 con 0x7fe7b40feb10 2023-07-14T18:17:08.679 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:17:08.631+0000 7fe7bad88700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fe7b4100690 0x7fe7b419bec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:17:08.679 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:17:08.631+0000 7fe7b9d86700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe7b40ffd00 0x7fe7b4194e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:17:08.679 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:17:08.631+0000 7fe7bad88700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fe7b4100690 0x7fe7b419bec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:59648/0 (socket says 172.21.15.163:59648) 2023-07-14T18:17:08.680 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:17:08.631+0000 7fe7ba587700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe7b40feb10 0x7fe7b4194910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:17:08.680 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:17:08.631+0000 7fe7bad88700 1 -- 172.21.15.163:0/3953983329 learned_addr learned my addr 172.21.15.163:0/3953983329 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:17:08.680 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:17:08.631+0000 7fe7bad88700 1 -- 172.21.15.163:0/3953983329 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe7b40feb10 msgr2=0x7fe7b4194910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:17:08.680 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:17:08.631+0000 7fe7bad88700 1 --2- 172.21.15.163:0/3953983329 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe7b40feb10 0x7fe7b4194910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:17:08.680 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:17:08.631+0000 7fe7bad88700 1 -- 172.21.15.163:0/3953983329 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe7b40ffd00 msgr2=0x7fe7b4194e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:17:08.680 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:17:08.631+0000 7fe7bad88700 1 --2- 172.21.15.163:0/3953983329 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe7b40ffd00 0x7fe7b4194e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:17:08.680 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:17:08.631+0000 7fe7bad88700 1 -- 172.21.15.163:0/3953983329 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7a4009520 con 0x7fe7b4100690 2023-07-14T18:17:08.681 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:17:08.631+0000 7fe7b9d86700 1 --2- 172.21.15.163:0/3953983329 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe7b40ffd00 0x7fe7b4194e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T18:17:08.681 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:17:08.632+0000 7fe7bad88700 1 --2- 172.21.15.163:0/3953983329 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fe7b4100690 0x7fe7b419bec0 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7fe7ac0095e0 tx=0x7fe7ac00ba50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:17:08.681 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:17:08.632+0000 7fe7ab7fe700 1 -- 172.21.15.163:0/3953983329 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7ac00e040 con 0x7fe7b4100690 2023-07-14T18:17:08.681 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:17:08.632+0000 7fe7bc7eb700 1 -- 172.21.15.163:0/3953983329 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe7ac009d00 con 0x7fe7b4100690 2023-07-14T18:17:08.681 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:17:08.632+0000 7fe7ab7fe700 1 -- 172.21.15.163:0/3953983329 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fe7ac00be90 con 0x7fe7b4100690 2023-07-14T18:17:08.681 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:17:08.632+0000 7fe7ab7fe700 1 -- 172.21.15.163:0/3953983329 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7ac005040 con 0x7fe7b4100690 2023-07-14T18:17:08.681 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:17:08.632+0000 7fe7bc7eb700 1 -- 172.21.15.163:0/3953983329 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe7b419cd20 con 0x7fe7b4100690 2023-07-14T18:17:08.683 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:17:08.635+0000 7fe7ab7fe700 1 -- 172.21.15.163:0/3953983329 <== mon.0 v2:172.21.15.163:3300/0 4 ==== mgrmap(e 18) v1 ==== 135716+0+0 (secure 0 0 0) 0x7fe7ac003c00 con 0x7fe7b4100690 2023-07-14T18:17:08.683 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:17:08.635+0000 7fe7ab7fe700 1 --2- 172.21.15.163:0/3953983329 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7fe7a00a1150 0x7fe7a00a3600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:17:08.683 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:17:08.635+0000 7fe7ab7fe700 1 -- 172.21.15.163:0/3953983329 <== mon.0 v2:172.21.15.163:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 9049+0+0 (secure 0 0 0) 0x7fe7ac0cdf30 con 0x7fe7b4100690 2023-07-14T18:17:08.684 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:17:08.635+0000 7fe7ba587700 1 --2- 172.21.15.163:0/3953983329 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7fe7a00a1150 0x7fe7a00a3600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:17:08.684 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:17:08.636+0000 7fe7c8983b80 1 Processor -- start 2023-07-14T18:17:08.684 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:17:08.636+0000 7fe7ba587700 1 --2- 172.21.15.163:0/3953983329 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7fe7a00a1150 0x7fe7a00a3600 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fe7b40ffb60 tx=0x7fe7b0009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:17:08.684 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:17:08.636+0000 7fe7c8983b80 1 -- start start 2023-07-14T18:17:08.684 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:17:08.636+0000 7fe7c8983b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558bdbf0ef60 0x558bdbf0f370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:17:08.684 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:17:08.636+0000 7fe7c8983b80 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x558bdbf0f8b0 0x558bdbf0fed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:17:08.684 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:17:08.636+0000 7fe7c8983b80 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x558bdbf104b0 0x558bdbf10920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:17:08.685 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:17:08.636+0000 7fe7c8983b80 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x558bdbe13cb0 con 0x558bdbf104b0 2023-07-14T18:17:08.685 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:17:08.636+0000 7fe7c8983b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x558bdbe66a40 con 0x558bdbf0ef60 2023-07-14T18:17:08.685 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:17:08.636+0000 7fe7c8983b80 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x558bdbe5fed0 con 0x558bdbf0f8b0 2023-07-14T18:17:08.685 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:17:08.636+0000 7fe7ba587700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558bdbf0ef60 0x558bdbf0f370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:17:08.685 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:17:08.636+0000 7fe7bad88700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x558bdbf104b0 0x558bdbf10920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:17:08.685 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:17:08.637+0000 7fe7ba587700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558bdbf0ef60 0x558bdbf0f370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.163:60336/0 (socket says 172.21.15.163:60336) 2023-07-14T18:17:08.685 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:17:08.637+0000 7fe7ba587700 1 -- 172.21.15.163:0/943163317 learned_addr learned my addr 172.21.15.163:0/943163317 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:17:08.685 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:17:08.637+0000 7fe7b9d86700 1 --2- 172.21.15.163:0/943163317 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x558bdbf0f8b0 0x558bdbf0fed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:17:08.686 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:17:08.637+0000 7fe7b9d86700 1 -- 172.21.15.163:0/943163317 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558bdbf0ef60 msgr2=0x558bdbf0f370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:17:08.686 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:17:08.637+0000 7fe7b9d86700 1 --2- 172.21.15.163:0/943163317 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558bdbf0ef60 0x558bdbf0f370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:17:08.686 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:17:08.637+0000 7fe7b9d86700 1 -- 172.21.15.163:0/943163317 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x558bdbf104b0 msgr2=0x558bdbf10920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:17:08.686 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:17:08.637+0000 7fe7b9d86700 1 --2- 172.21.15.163:0/943163317 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x558bdbf104b0 0x558bdbf10920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:17:08.686 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:17:08.637+0000 7fe7b9d86700 1 -- 172.21.15.163:0/943163317 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558bdbc8dde0 con 0x558bdbf0f8b0 2023-07-14T18:17:08.686 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:17:08.637+0000 7fe7b9d86700 1 --2- 172.21.15.163:0/943163317 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x558bdbf0f8b0 0x558bdbf0fed0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fe7a4011700 tx=0x7fe7a4011a10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8a823adaadc52c47 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:17:08.686 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:17:08.637+0000 7fe7a8ff9700 1 -- 172.21.15.163:0/943163317 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7a4004020 con 0x558bdbf0f8b0 2023-07-14T18:17:08.687 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:17:08.637+0000 7fe7a8ff9700 1 -- 172.21.15.163:0/943163317 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fe7a4003680 con 0x558bdbf0f8b0 2023-07-14T18:17:08.687 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:17:08.637+0000 7fe7a8ff9700 1 -- 172.21.15.163:0/943163317 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7a4019650 con 0x558bdbf0f8b0 2023-07-14T18:17:08.687 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:17:08.638+0000 7fe7c8983b80 1 -- 172.21.15.163:0/943163317 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x558bdbf0f8b0 msgr2=0x558bdbf0fed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:17:08.687 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:17:08.638+0000 7fe7c8983b80 1 --2- 172.21.15.163:0/943163317 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x558bdbf0f8b0 0x558bdbf0fed0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fe7a4011700 tx=0x7fe7a4011a10 comp rx=0 tx=0).stop 2023-07-14T18:17:08.688 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:17:08.638+0000 7fe7c8983b80 1 -- 172.21.15.163:0/943163317 shutdown_connections 2023-07-14T18:17:08.688 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:17:08.638+0000 7fe7c8983b80 1 --2- 172.21.15.163:0/943163317 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x558bdbf104b0 0x558bdbf10920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:17:08.688 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:17:08.638+0000 7fe7c8983b80 1 --2- 172.21.15.163:0/943163317 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558bdbf0ef60 0x558bdbf0f370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:17:08.688 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:17:08.638+0000 7fe7c8983b80 1 --2- 172.21.15.163:0/943163317 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x558bdbf0f8b0 0x558bdbf0fed0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:17:08.689 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:17:08.638+0000 7fe7c8983b80 1 -- 172.21.15.163:0/943163317 >> 172.21.15.163:0/943163317 conn(0x558bdbf04680 msgr2=0x558bdbf099d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:17:08.689 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:17:08.638+0000 7fe7c8983b80 1 -- 172.21.15.163:0/943163317 shutdown_connections 2023-07-14T18:17:08.689 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:17:08.638+0000 7fe7c8983b80 1 -- 172.21.15.163:0/943163317 wait complete. 2023-07-14T18:17:08.692 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:17:08.639+0000 7fe7c8983b80 1 -- start start 2023-07-14T18:17:08.692 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:17:08.639+0000 7fe7c8983b80 1 Processor -- start 2023-07-14T18:17:08.692 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:17:08.639+0000 7fe7c8983b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558bdbf0ef60 0x558bdbf18950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:17:08.692 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:17:08.639+0000 7fe7c8983b80 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x558bdbf0f8b0 0x558bdbf18e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:17:08.692 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:17:08.639+0000 7fe7c8983b80 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x558bdbf104b0 0x558bdbf1fed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:17:08.692 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:17:08.639+0000 7fe7c8983b80 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x558bdbdffac0 con 0x558bdbf0f8b0 2023-07-14T18:17:08.693 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:17:08.639+0000 7fe7c8983b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x558bdbdff7c0 con 0x558bdbf0ef60 2023-07-14T18:17:08.693 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:17:08.639+0000 7fe7c8983b80 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x558bdbce3920 con 0x558bdbf104b0 2023-07-14T18:17:08.693 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:17:08.639+0000 7fe7c8983b80 10 client.0 _ll_register_callbacks cb 0x558bdbdfd760 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T18:17:08.693 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:17:08.639+0000 7fe7ba587700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558bdbf0ef60 0x558bdbf18950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:17:08.693 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:17:08.639+0000 7fe7b9d86700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x558bdbf0f8b0 0x558bdbf18e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:17:08.693 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:17:08.639+0000 7fe7ba587700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558bdbf0ef60 0x558bdbf18950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.163:60342/0 (socket says 172.21.15.163:60342) 2023-07-14T18:17:08.693 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:17:08.639+0000 7fe7ba587700 1 -- 172.21.15.163:0/1101896662 learned_addr learned my addr 172.21.15.163:0/1101896662 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:17:08.693 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:17:08.639+0000 7fe7bad88700 1 --2- 172.21.15.163:0/1101896662 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x558bdbf104b0 0x558bdbf1fed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:17:08.694 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:17:08.640+0000 7fe7ba587700 1 -- 172.21.15.163:0/1101896662 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x558bdbf104b0 msgr2=0x558bdbf1fed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:17:08.694 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:17:08.640+0000 7fe7ba587700 1 --2- 172.21.15.163:0/1101896662 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x558bdbf104b0 0x558bdbf1fed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:17:08.694 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:17:08.640+0000 7fe7ba587700 1 -- 172.21.15.163:0/1101896662 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x558bdbf0f8b0 msgr2=0x558bdbf18e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:17:08.694 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:17:08.640+0000 7fe7ba587700 1 --2- 172.21.15.163:0/1101896662 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x558bdbf0f8b0 0x558bdbf18e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:17:08.694 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:17:08.640+0000 7fe7ba587700 1 -- 172.21.15.163:0/1101896662 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe7a4011440 con 0x558bdbf0ef60 2023-07-14T18:17:08.694 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:17:08.640+0000 7fe7ba587700 1 --2- 172.21.15.163:0/1101896662 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558bdbf0ef60 0x558bdbf18950 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fe7b0009b20 tx=0x7fe7b00047c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2b60e0381cbe27fb server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:17:08.694 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:17:08.640+0000 7fe79dffb700 10 client.0 ms_handle_connect on v2:172.21.15.172:3300/0 2023-07-14T18:17:08.695 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:17:08.640+0000 7fe79dffb700 1 -- 172.21.15.163:0/1101896662 <== mon.2 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7b0022070 con 0x558bdbf0ef60 2023-07-14T18:17:08.695 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:17:08.640+0000 7fe7c8983b80 1 -- 172.21.15.163:0/1101896662 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x558bdbdb94f0 con 0x558bdbf0ef60 2023-07-14T18:17:08.695 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:17:08.640+0000 7fe79dffb700 1 -- 172.21.15.163:0/1101896662 <== mon.2 v2:172.21.15.172:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 9049+0+0 (secure 0 0 0) 0x7fe7b001c810 con 0x558bdbf0ef60 2023-07-14T18:17:08.695 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:17:08.640+0000 7fe79dffb700 1 -- 172.21.15.163:0/1101896662 <== mon.2 v2:172.21.15.172:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe7b001c9d0 con 0x558bdbf0ef60 2023-07-14T18:17:08.695 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:17:08.640+0000 7fe7c8983b80 10 client.25964 fetch_fsmap learned FSMap version 33 2023-07-14T18:17:08.695 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:17:08.640+0000 7fe7c8983b80 1 -- 172.21.15.163:0/1101896662 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) v3 -- 0x558bdbc76c60 con 0x558bdbf0ef60 2023-07-14T18:17:08.695 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:17:08.641+0000 7fe79dffb700 1 -- 172.21.15.163:0/1101896662 <== mon.2 v2:172.21.15.172:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x558bdbdb94f0 con 0x558bdbf0ef60 2023-07-14T18:17:08.695 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:17:08.641+0000 7fe79dffb700 1 -- 172.21.15.163:0/1101896662 <== mon.2 v2:172.21.15.172:3300/0 5 ==== fsmap(e 33) v1 ==== 7502+0+0 (secure 0 0 0) 0x7fe7b0026b90 con 0x558bdbf0ef60 2023-07-14T18:17:08.696 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:17:08.641+0000 7fe7c8983b80 10 client.25964 fetch_fsmap finished waiting for FSMap version 33 2023-07-14T18:17:08.696 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:17:08.641+0000 7fe7c8983b80 10 client.25964 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-07-14T18:17:08.696 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:17:08.641+0000 7fe7c8983b80 20 client.25964 populate_metadata read hostname 'smithi163' 2023-07-14T18:17:08.696 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:17:08.641+0000 7fe7c8983b80 1 --2- 172.21.15.163:0/1101896662 >> [v2:172.21.15.172:6838/3850440096,v1:172.21.15.172:6839/3850440096] conn(0x558bdbf24830 0x558bdbf26c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:17:08.696 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:17:08.641+0000 7fe7c8983b80 4 client.25964 mds_command: new command op to 24518 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-14T18:17:08.696 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:17:08.641+0000 7fe7c8983b80 1 -- 172.21.15.163:0/1101896662 --> [v2:172.21.15.172:6838/3850440096,v1:172.21.15.172:6839/3850440096] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x558bdbeddda0 con 0x558bdbf24830 2023-07-14T18:17:08.696 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:17:08.641+0000 7fe7b9d86700 1 --2- 172.21.15.163:0/1101896662 >> [v2:172.21.15.172:6838/3850440096,v1:172.21.15.172:6839/3850440096] conn(0x558bdbf24830 0x558bdbf26c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:17:08.697 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:17:08.641+0000 7fe79dffb700 10 client.25964 ms_handle_connect on v2:172.21.15.172:6838/3850440096 2023-07-14T18:17:08.697 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:17:08.641+0000 7fe7b9d86700 1 --2- 172.21.15.163:0/1101896662 >> [v2:172.21.15.172:6838/3850440096,v1:172.21.15.172:6839/3850440096] conn(0x558bdbf24830 0x558bdbf26c40 crc :-1 s=READY pgs=75 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4a832980a82813ac server_cookie=ad23c5e25a9cd9c3 in_seq=0 out_seq=0 2023-07-14T18:17:08.697 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:17:08.642+0000 7fe79dffb700 1 -- 172.21.15.163:0/1101896662 <== mds.0 v2:172.21.15.172:6838/3850440096 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18017 (crc 0 0 0) 0x558bdbeddda0 con 0x558bdbf24830 2023-07-14T18:17:08.697 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:17:08.642+0000 7fe79dffb700 10 client.25964 handle_command_reply: tid=0 2023-07-14T18:17:08.697 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:17:08.642+0000 7fe7c8983b80 1 client.25964 shutdown 2023-07-14T18:17:08.697 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:17:08.643+0000 7fe7c8983b80 1 -- 172.21.15.163:0/1101896662 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558bdbf0ef60 msgr2=0x558bdbf18950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:17:08.697 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:17:08.643+0000 7fe7c8983b80 1 --2- 172.21.15.163:0/1101896662 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558bdbf0ef60 0x558bdbf18950 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fe7b0009b20 tx=0x7fe7b00047c0 comp rx=0 tx=0).stop 2023-07-14T18:17:08.698 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:17:08.643+0000 7fe7c8983b80 1 -- 172.21.15.163:0/1101896662 shutdown_connections 2023-07-14T18:17:08.698 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:17:08.643+0000 7fe7c8983b80 1 --2- 172.21.15.163:0/1101896662 >> [v2:172.21.15.172:6838/3850440096,v1:172.21.15.172:6839/3850440096] conn(0x558bdbf24830 0x558bdbf26c40 crc :-1 s=READY pgs=75 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:17:08.698 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:17:08.643+0000 7fe7c8983b80 1 --2- 172.21.15.163:0/1101896662 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x558bdbf104b0 0x558bdbf1fed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:17:08.698 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:17:08.643+0000 7fe7c8983b80 1 --2- 172.21.15.163:0/1101896662 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558bdbf0ef60 0x558bdbf18950 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:17:08.698 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:17:08.643+0000 7fe7c8983b80 1 --2- 172.21.15.163:0/1101896662 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x558bdbf0f8b0 0x558bdbf18e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:17:08.698 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:17:08.643+0000 7fe79dffb700 0 client.25964 ms_handle_reset on v2:172.21.15.172:6838/3850440096 2023-07-14T18:17:08.698 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:17:08.643+0000 7fe7c8983b80 1 -- 172.21.15.163:0/1101896662 >> 172.21.15.163:0/1101896662 conn(0x558bdbf04680 msgr2=0x558bdbf08650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:17:08.699 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:17:08.643+0000 7fe7c8983b80 1 -- 172.21.15.163:0/1101896662 shutdown_connections 2023-07-14T18:17:08.699 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:17:08.643+0000 7fe7c8983b80 1 -- 172.21.15.163:0/1101896662 wait complete. 2023-07-14T18:17:08.699 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:17:08.643+0000 7fe7c8983b80 20 client.25964 trim_cache size 0 max 16384 2023-07-14T18:17:08.708 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:17:08.663+0000 7fe7c8983b80 1 Processor -- start 2023-07-14T18:17:08.709 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:17:08.663+0000 7fe7c8983b80 1 -- start start 2023-07-14T18:17:08.709 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:17:08.663+0000 7fe7c8983b80 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x558bdbf0ef60 0x558bdbf10880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:17:08.709 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:17:08.664+0000 7fe7c8983b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558bdbf0f8b0 0x558bdbf1fe90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:17:08.709 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:17:08.664+0000 7fe7c8983b80 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x558bdbf104b0 0x558bdbf207c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:17:08.709 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:17:08.664+0000 7fe7c8983b80 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x558bdbf21b70 con 0x558bdbf0ef60 2023-07-14T18:17:08.709 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:17:08.664+0000 7fe7c8983b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x558bdbf0fcf0 con 0x558bdbf0f8b0 2023-07-14T18:17:08.709 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:17:08.664+0000 7fe7c8983b80 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x558bdbf165e0 con 0x558bdbf104b0 2023-07-14T18:17:08.711 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:17:08.664+0000 7fe7ba587700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x558bdbf0ef60 0x558bdbf10880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:17:08.711 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:17:08.664+0000 7fe7ba587700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x558bdbf0ef60 0x558bdbf10880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:59666/0 (socket says 172.21.15.163:59666) 2023-07-14T18:17:08.711 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:17:08.664+0000 7fe7ba587700 1 -- 172.21.15.163:0/2205260349 learned_addr learned my addr 172.21.15.163:0/2205260349 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:17:08.711 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:17:08.664+0000 7fe7b9d86700 1 --2- 172.21.15.163:0/2205260349 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558bdbf0f8b0 0x558bdbf1fe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:17:08.711 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:17:08.664+0000 7fe7bad88700 1 --2- 172.21.15.163:0/2205260349 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x558bdbf104b0 0x558bdbf207c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:17:08.712 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:17:08.664+0000 7fe7b9d86700 1 -- 172.21.15.163:0/2205260349 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x558bdbf104b0 msgr2=0x558bdbf207c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:17:08.712 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:17:08.664+0000 7fe7b9d86700 1 --2- 172.21.15.163:0/2205260349 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x558bdbf104b0 0x558bdbf207c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:17:08.712 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:17:08.664+0000 7fe7b9d86700 1 -- 172.21.15.163:0/2205260349 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x558bdbf0ef60 msgr2=0x558bdbf10880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:17:08.712 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:17:08.664+0000 7fe7b9d86700 1 --2- 172.21.15.163:0/2205260349 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x558bdbf0ef60 0x558bdbf10880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:17:08.712 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:17:08.664+0000 7fe7b9d86700 1 -- 172.21.15.163:0/2205260349 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558bdbcb4250 con 0x558bdbf0f8b0 2023-07-14T18:17:08.712 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:17:08.664+0000 7fe7b9d86700 1 --2- 172.21.15.163:0/2205260349 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558bdbf0f8b0 0x558bdbf1fe90 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fe7a401b040 tx=0x7fe7a4005040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b7313d84a6b9a08c server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:17:08.712 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:17:08.665+0000 7fe7a97fa700 1 -- 172.21.15.163:0/2205260349 <== mon.2 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7a4025040 con 0x558bdbf0f8b0 2023-07-14T18:17:08.713 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:17:08.665+0000 7fe7a97fa700 1 -- 172.21.15.163:0/2205260349 <== mon.2 v2:172.21.15.172:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fe7a4003c30 con 0x558bdbf0f8b0 2023-07-14T18:17:08.713 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:17:08.665+0000 7fe7a97fa700 1 -- 172.21.15.163:0/2205260349 <== mon.2 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7a4005310 con 0x558bdbf0f8b0 2023-07-14T18:17:08.713 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:17:08.665+0000 7fe7c8983b80 1 -- 172.21.15.163:0/2205260349 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558bdbf0f8b0 msgr2=0x558bdbf1fe90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:17:08.713 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:17:08.665+0000 7fe7c8983b80 1 --2- 172.21.15.163:0/2205260349 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558bdbf0f8b0 0x558bdbf1fe90 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fe7a401b040 tx=0x7fe7a4005040 comp rx=0 tx=0).stop 2023-07-14T18:17:08.713 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:17:08.666+0000 7fe7c8983b80 1 -- 172.21.15.163:0/2205260349 shutdown_connections 2023-07-14T18:17:08.713 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:17:08.666+0000 7fe7c8983b80 1 --2- 172.21.15.163:0/2205260349 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x558bdbf104b0 0x558bdbf207c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:17:08.713 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:17:08.666+0000 7fe7c8983b80 1 --2- 172.21.15.163:0/2205260349 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x558bdbf0ef60 0x558bdbf10880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:17:08.714 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:17:08.666+0000 7fe7c8983b80 1 --2- 172.21.15.163:0/2205260349 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558bdbf0f8b0 0x558bdbf1fe90 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:17:08.714 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:17:08.666+0000 7fe7c8983b80 1 -- 172.21.15.163:0/2205260349 >> 172.21.15.163:0/2205260349 conn(0x558bdbf04680 msgr2=0x558bdbf17670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:17:08.714 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:17:08.666+0000 7fe7c8983b80 1 -- 172.21.15.163:0/2205260349 shutdown_connections 2023-07-14T18:17:08.714 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:17:08.666+0000 7fe7c8983b80 1 -- 172.21.15.163:0/2205260349 wait complete. 2023-07-14T18:17:08.714 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:17:08.666+0000 7fe7c8983b80 1 -- start start 2023-07-14T18:17:08.714 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:17:08.666+0000 7fe7c8983b80 1 Processor -- start 2023-07-14T18:17:08.716 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:17:08.666+0000 7fe7c8983b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558bdbf0ef60 0x558bdbf1f750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:17:08.717 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:17:08.666+0000 7fe7c8983b80 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x558bdbf0f8b0 0x558bdbf1fc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:17:08.717 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:17:08.666+0000 7fe7c8983b80 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x558bdbf104b0 0x558bdbf1c1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:17:08.717 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:17:08.666+0000 7fe7c8983b80 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x558bdbf1c810 con 0x558bdbf0f8b0 2023-07-14T18:17:08.717 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:17:08.666+0000 7fe7c8983b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x558bdbf1c980 con 0x558bdbf0ef60 2023-07-14T18:17:08.717 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:17:08.666+0000 7fe7c8983b80 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x558bdbf1cb40 con 0x558bdbf104b0 2023-07-14T18:17:08.717 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:17:08.666+0000 7fe7c8983b80 10 client.0 _ll_register_callbacks cb 0x558bdbdfd760 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T18:17:08.717 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:17:08.667+0000 7fe7ba587700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558bdbf0ef60 0x558bdbf1f750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:17:08.718 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:17:08.667+0000 7fe7b9d86700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x558bdbf0f8b0 0x558bdbf1fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:17:08.718 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:17:08.667+0000 7fe7ba587700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558bdbf0ef60 0x558bdbf1f750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.163:60354/0 (socket says 172.21.15.163:60354) 2023-07-14T18:17:08.718 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:17:08.667+0000 7fe7ba587700 1 -- 172.21.15.163:0/1534855377 learned_addr learned my addr 172.21.15.163:0/1534855377 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:17:08.718 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:17:08.667+0000 7fe7bad88700 1 --2- 172.21.15.163:0/1534855377 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x558bdbf104b0 0x558bdbf1c1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:17:08.718 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:17:08.667+0000 7fe7ba587700 1 -- 172.21.15.163:0/1534855377 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x558bdbf104b0 msgr2=0x558bdbf1c1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:17:08.718 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:17:08.667+0000 7fe7ba587700 1 --2- 172.21.15.163:0/1534855377 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x558bdbf104b0 0x558bdbf1c1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:17:08.718 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:17:08.667+0000 7fe7ba587700 1 -- 172.21.15.163:0/1534855377 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x558bdbf0f8b0 msgr2=0x558bdbf1fc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:17:08.719 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:17:08.667+0000 7fe7ba587700 1 --2- 172.21.15.163:0/1534855377 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x558bdbf0f8b0 0x558bdbf1fc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:17:08.719 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:17:08.667+0000 7fe7ba587700 1 -- 172.21.15.163:0/1534855377 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x558bdbc8dde0 con 0x558bdbf0ef60 2023-07-14T18:17:08.719 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:17:08.667+0000 7fe7ba587700 1 --2- 172.21.15.163:0/1534855377 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558bdbf0ef60 0x558bdbf1f750 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fe7b0026ef0 tx=0x7fe7b0000bc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3d17a67dc3095c63 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:17:08.719 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:17:08.667+0000 7fe79dffb700 10 client.0 ms_handle_connect on v2:172.21.15.172:3300/0 2023-07-14T18:17:08.719 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:17:08.667+0000 7fe79dffb700 1 -- 172.21.15.163:0/1534855377 <== mon.2 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7b0022040 con 0x558bdbf0ef60 2023-07-14T18:17:08.719 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:17:08.667+0000 7fe79dffb700 1 -- 172.21.15.163:0/1534855377 <== mon.2 v2:172.21.15.172:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 9049+0+0 (secure 0 0 0) 0x7fe7b000e550 con 0x558bdbf0ef60 2023-07-14T18:17:08.719 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:17:08.667+0000 7fe7c8983b80 1 -- 172.21.15.163:0/1534855377 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x558bdbe58eb0 con 0x558bdbf0ef60 2023-07-14T18:17:08.719 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:17:08.668+0000 7fe79dffb700 1 -- 172.21.15.163:0/1534855377 <== mon.2 v2:172.21.15.172:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe7b000ec50 con 0x558bdbf0ef60 2023-07-14T18:17:08.720 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:17:08.668+0000 7fe7c8983b80 10 client.25970 fetch_fsmap learned FSMap version 33 2023-07-14T18:17:08.720 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:17:08.668+0000 7fe7c8983b80 1 -- 172.21.15.163:0/1534855377 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) v3 -- 0x558bdbc8c2b0 con 0x558bdbf0ef60 2023-07-14T18:17:08.720 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:17:08.668+0000 7fe79dffb700 1 -- 172.21.15.163:0/1534855377 <== mon.2 v2:172.21.15.172:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x558bdbe58eb0 con 0x558bdbf0ef60 2023-07-14T18:17:08.720 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:17:08.668+0000 7fe79dffb700 1 -- 172.21.15.163:0/1534855377 <== mon.2 v2:172.21.15.172:3300/0 5 ==== fsmap(e 33) v1 ==== 7502+0+0 (secure 0 0 0) 0x7fe7b001dbd0 con 0x558bdbf0ef60 2023-07-14T18:17:08.720 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:17:08.668+0000 7fe7c8983b80 10 client.25970 fetch_fsmap finished waiting for FSMap version 33 2023-07-14T18:17:08.720 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:17:08.668+0000 7fe7c8983b80 10 client.25970 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-07-14T18:17:08.721 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:17:08.668+0000 7fe7c8983b80 20 client.25970 populate_metadata read hostname 'smithi163' 2023-07-14T18:17:08.721 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:17:08.668+0000 7fe7c8983b80 1 --2- 172.21.15.163:0/1534855377 >> [v2:172.21.15.172:6838/3850440096,v1:172.21.15.172:6839/3850440096] conn(0x558bdbf79b00 0x558bdbf7bf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:17:08.721 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:17:08.668+0000 7fe7c8983b80 4 client.25970 mds_command: new command op to 24518 tid=0[{"prefix": "scrub status"}] 2023-07-14T18:17:08.721 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:17:08.668+0000 7fe7c8983b80 1 -- 172.21.15.163:0/1534855377 --> [v2:172.21.15.172:6838/3850440096,v1:172.21.15.172:6839/3850440096] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x558bdbe1b050 con 0x558bdbf79b00 2023-07-14T18:17:08.721 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:17:08.668+0000 7fe7b9d86700 1 --2- 172.21.15.163:0/1534855377 >> [v2:172.21.15.172:6838/3850440096,v1:172.21.15.172:6839/3850440096] conn(0x558bdbf79b00 0x558bdbf7bf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:17:08.721 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:17:08.669+0000 7fe79dffb700 10 client.25970 ms_handle_connect on v2:172.21.15.172:6838/3850440096 2023-07-14T18:17:08.721 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:17:08.669+0000 7fe7b9d86700 1 --2- 172.21.15.163:0/1534855377 >> [v2:172.21.15.172:6838/3850440096,v1:172.21.15.172:6839/3850440096] conn(0x558bdbf79b00 0x558bdbf7bf10 crc :-1 s=READY pgs=76 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e4c42aa3028978e9 server_cookie=36e265c137842a08 in_seq=0 out_seq=0 2023-07-14T18:17:08.721 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:17:08.670+0000 7fe79dffb700 1 -- 172.21.15.163:0/1534855377 <== mds.0 v2:172.21.15.172:6838/3850440096 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+265 (crc 0 0 0) 0x558bdbe1b050 con 0x558bdbf79b00 2023-07-14T18:17:08.722 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:17:08.670+0000 7fe79dffb700 10 client.25970 handle_command_reply: tid=0 2023-07-14T18:17:08.722 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:17:08.670+0000 7fe7c8983b80 1 client.25970 shutdown 2023-07-14T18:17:08.722 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:17:08.670+0000 7fe7c8983b80 1 -- 172.21.15.163:0/1534855377 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558bdbf0ef60 msgr2=0x558bdbf1f750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:17:08.722 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:17:08.670+0000 7fe7c8983b80 1 --2- 172.21.15.163:0/1534855377 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558bdbf0ef60 0x558bdbf1f750 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fe7b0026ef0 tx=0x7fe7b0000bc0 comp rx=0 tx=0).stop 2023-07-14T18:17:08.722 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:17:08.670+0000 7fe7c8983b80 1 -- 172.21.15.163:0/1534855377 shutdown_connections 2023-07-14T18:17:08.722 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:17:08.670+0000 7fe7c8983b80 1 --2- 172.21.15.163:0/1534855377 >> [v2:172.21.15.172:6838/3850440096,v1:172.21.15.172:6839/3850440096] conn(0x558bdbf79b00 0x558bdbf7bf10 crc :-1 s=READY pgs=76 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:17:08.722 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:17:08.670+0000 7fe7c8983b80 1 --2- 172.21.15.163:0/1534855377 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x558bdbf104b0 0x558bdbf1c1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:17:08.723 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:17:08.670+0000 7fe7c8983b80 1 --2- 172.21.15.163:0/1534855377 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558bdbf0ef60 0x558bdbf1f750 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:17:08.723 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:17:08.670+0000 7fe7c8983b80 1 --2- 172.21.15.163:0/1534855377 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x558bdbf0f8b0 0x558bdbf1fc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:17:08.723 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:17:08.670+0000 7fe79dffb700 0 client.25970 ms_handle_reset on v2:172.21.15.172:6838/3850440096 2023-07-14T18:17:08.723 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:17:08.670+0000 7fe7c8983b80 1 -- 172.21.15.163:0/1534855377 >> 172.21.15.163:0/1534855377 conn(0x558bdbf04680 msgr2=0x558bdbf207c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:17:08.723 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:17:08.670+0000 7fe7c8983b80 1 -- 172.21.15.163:0/1534855377 shutdown_connections 2023-07-14T18:17:08.723 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:17:08.670+0000 7fe7c8983b80 1 -- 172.21.15.163:0/1534855377 wait complete. 2023-07-14T18:17:08.723 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:17:08.670+0000 7fe7c8983b80 20 client.25970 trim_cache size 0 max 16384 2023-07-14T18:17:08.724 INFO:teuthology.orchestra.run.smithi163.stdout:{ 2023-07-14T18:17:08.724 INFO:teuthology.orchestra.run.smithi163.stdout: "status": "scrub active (1 inodes in the stack)", 2023-07-14T18:17:08.724 INFO:teuthology.orchestra.run.smithi163.stdout: "scrubs": { 2023-07-14T18:17:08.724 INFO:teuthology.orchestra.run.smithi163.stdout: "2c53b7ef-6f30-49f0-a60d-f1f114c19d42": { 2023-07-14T18:17:08.724 INFO:teuthology.orchestra.run.smithi163.stdout: "path": "/", 2023-07-14T18:17:08.724 INFO:teuthology.orchestra.run.smithi163.stdout: "tag": "2c53b7ef-6f30-49f0-a60d-f1f114c19d42", 2023-07-14T18:17:08.725 INFO:teuthology.orchestra.run.smithi163.stdout: "options": "recursive,force" 2023-07-14T18:17:08.725 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-07-14T18:17:08.725 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-07-14T18:17:08.725 INFO:teuthology.orchestra.run.smithi163.stdout:} 2023-07-14T18:17:08.725 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:17:08.670+0000 7fe7bc7eb700 1 -- 172.21.15.163:0/3953983329 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7fe7a00a1150 msgr2=0x7fe7a00a3600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:17:08.726 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:17:08.670+0000 7fe7bc7eb700 1 --2- 172.21.15.163:0/3953983329 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7fe7a00a1150 0x7fe7a00a3600 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fe7b40ffb60 tx=0x7fe7b0009260 comp rx=0 tx=0).stop 2023-07-14T18:17:08.726 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:17:08.670+0000 7fe7bc7eb700 1 -- 172.21.15.163:0/3953983329 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fe7b4100690 msgr2=0x7fe7b419bec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:17:08.726 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:17:08.670+0000 7fe7bc7eb700 1 --2- 172.21.15.163:0/3953983329 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fe7b4100690 0x7fe7b419bec0 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7fe7ac0095e0 tx=0x7fe7ac00ba50 comp rx=0 tx=0).stop 2023-07-14T18:17:08.726 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:17:08.670+0000 7fe7bc7eb700 1 -- 172.21.15.163:0/3953983329 shutdown_connections 2023-07-14T18:17:08.726 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:17:08.671+0000 7fe7bc7eb700 1 --2- 172.21.15.163:0/3953983329 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7fe7a00a1150 0x7fe7a00a3600 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:17:08.726 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:17:08.671+0000 7fe7bc7eb700 1 --2- 172.21.15.163:0/3953983329 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe7b40feb10 0x7fe7b4194910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:17:08.726 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:17:08.671+0000 7fe7bc7eb700 1 --2- 172.21.15.163:0/3953983329 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fe7b4100690 0x7fe7b419bec0 unknown :-1 s=CLOSED pgs=683 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:17:08.727 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:17:08.671+0000 7fe7bc7eb700 1 --2- 172.21.15.163:0/3953983329 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe7b40ffd00 0x7fe7b4194e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:17:08.727 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:17:08.671+0000 7fe7bc7eb700 1 -- 172.21.15.163:0/3953983329 >> 172.21.15.163:0/3953983329 conn(0x7fe7b40fa130 msgr2=0x7fe7b4103240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:17:08.727 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:17:08.671+0000 7fe7bc7eb700 1 -- 172.21.15.163:0/3953983329 shutdown_connections 2023-07-14T18:17:08.727 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:17:08.671+0000 7fe7bc7eb700 1 -- 172.21.15.163:0/3953983329 wait complete. 2023-07-14T18:17:08.729 INFO:tasks.cephfs.filesystem:scrub status for tag:2c53b7ef-6f30-49f0-a60d-f1f114c19d42 - {'path': '/', 'tag': '2c53b7ef-6f30-49f0-a60d-f1f114c19d42', 'options': 'recursive,force'} 2023-07-14T18:17:08.930 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:17:08 smithi184 ceph-mon[98481]: pgmap v434: 129 pgs: 129 active+clean; 122 MiB data, 910 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.2 MiB/s wr, 190 op/s 2023-07-14T18:17:08.972 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:17:08 smithi163 ceph-mon[96576]: pgmap v434: 129 pgs: 129 active+clean; 122 MiB data, 910 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.2 MiB/s wr, 190 op/s 2023-07-14T18:17:09.030 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:17:08 smithi172 ceph-mon[97983]: pgmap v434: 129 pgs: 129 active+clean; 122 MiB data, 910 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.2 MiB/s wr, 190 op/s 2023-07-14T18:17:10.930 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:17:10 smithi184 ceph-mon[98481]: pgmap v435: 129 pgs: 129 active+clean; 122 MiB data, 951 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.2 MiB/s wr, 188 op/s 2023-07-14T18:17:10.972 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:17:10 smithi163 ceph-mon[96576]: pgmap v435: 129 pgs: 129 active+clean; 122 MiB data, 951 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.2 MiB/s wr, 188 op/s 2023-07-14T18:17:11.031 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:17:10 smithi172 ceph-mon[97983]: pgmap v435: 129 pgs: 129 active+clean; 122 MiB data, 951 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.2 MiB/s wr, 188 op/s 2023-07-14T18:17:12.180 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:17:11 smithi184 ceph-mon[98481]: pgmap v436: 129 pgs: 129 active+clean; 123 MiB data, 967 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 2.9 MiB/s wr, 381 op/s 2023-07-14T18:17:12.222 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:17:11 smithi163 ceph-mon[96576]: pgmap v436: 129 pgs: 129 active+clean; 123 MiB data, 967 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 2.9 MiB/s wr, 381 op/s 2023-07-14T18:17:12.280 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:17:11 smithi172 ceph-mon[97983]: pgmap v436: 129 pgs: 129 active+clean; 123 MiB data, 967 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 2.9 MiB/s wr, 381 op/s 2023-07-14T18:17:14.930 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:17:14 smithi184 ceph-mon[98481]: pgmap v437: 129 pgs: 129 active+clean; 123 MiB data, 983 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 2.8 MiB/s wr, 370 op/s 2023-07-14T18:17:14.972 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:17:14 smithi163 ceph-mon[96576]: pgmap v437: 129 pgs: 129 active+clean; 123 MiB data, 983 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 2.8 MiB/s wr, 370 op/s 2023-07-14T18:17:15.031 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:17:14 smithi172 ceph-mon[97983]: pgmap v437: 129 pgs: 129 active+clean; 123 MiB data, 983 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 2.8 MiB/s wr, 370 op/s 2023-07-14T18:17:16.930 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:17:16 smithi184 ceph-mon[98481]: pgmap v438: 129 pgs: 129 active+clean; 124 MiB data, 976 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 2.8 MiB/s wr, 400 op/s 2023-07-14T18:17:16.972 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:17:16 smithi163 ceph-mon[96576]: pgmap v438: 129 pgs: 129 active+clean; 124 MiB data, 976 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 2.8 MiB/s wr, 400 op/s 2023-07-14T18:17:17.031 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:17:16 smithi172 ceph-mon[97983]: pgmap v438: 129 pgs: 129 active+clean; 124 MiB data, 976 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 2.8 MiB/s wr, 400 op/s 2023-07-14T18:17:17.638 INFO:tasks.workunit.client.0.smithi163.stdout:READ BAD DATA: offset = 0x30ac9, size = 0x772c, fname = 1MB 2023-07-14T18:17:17.638 INFO:tasks.workunit.client.0.smithi163.stdout:OFFSET GOOD BAD RANGE 2023-07-14T18:17:17.639 INFO:tasks.workunit.client.0.smithi163.stdout:0x30ac9 0x0000 0x3fda 0x00000 2023-07-14T18:17:17.639 INFO:tasks.workunit.client.0.smithi163.stdout:operation# (mod 256) for the bad data may be 218 2023-07-14T18:17:17.639 INFO:tasks.workunit.client.0.smithi163.stdout:0x30aca 0x0000 0xda16 0x00001 2023-07-14T18:17:17.639 INFO:tasks.workunit.client.0.smithi163.stdout:operation# (mod 256) for the bad data may be 218 2023-07-14T18:17:17.639 INFO:tasks.workunit.client.0.smithi163.stdout:0x30acb 0x0000 0x16da 0x00002 2023-07-14T18:17:17.639 INFO:tasks.workunit.client.0.smithi163.stdout:operation# (mod 256) for the bad data may be 218 2023-07-14T18:17:17.639 INFO:tasks.workunit.client.0.smithi163.stdout:0x30acc 0x0000 0xdaf1 0x00003 2023-07-14T18:17:17.640 INFO:tasks.workunit.client.0.smithi163.stdout:operation# (mod 256) for the bad data may be 218 2023-07-14T18:17:17.640 INFO:tasks.workunit.client.0.smithi163.stdout:0x30acd 0x0000 0xf1da 0x00004 2023-07-14T18:17:17.640 INFO:tasks.workunit.client.0.smithi163.stdout:operation# (mod 256) for the bad data may be 218 2023-07-14T18:17:17.640 INFO:tasks.workunit.client.0.smithi163.stdout:0x30ace 0x0000 0xda24 0x00005 2023-07-14T18:17:17.640 INFO:tasks.workunit.client.0.smithi163.stdout:operation# (mod 256) for the bad data may be 218 2023-07-14T18:17:17.640 INFO:tasks.workunit.client.0.smithi163.stdout:0x30acf 0x0000 0x24da 0x00006 2023-07-14T18:17:17.640 INFO:tasks.workunit.client.0.smithi163.stdout:operation# (mod 256) for the bad data may be 218 2023-07-14T18:17:17.640 INFO:tasks.workunit.client.0.smithi163.stdout:0x30ad0 0x0000 0xda5f 0x00007 2023-07-14T18:17:17.641 INFO:tasks.workunit.client.0.smithi163.stdout:operation# (mod 256) for the bad data may be 218 2023-07-14T18:17:17.641 INFO:tasks.workunit.client.0.smithi163.stdout:0x30ad1 0x0000 0x5fda 0x00008 2023-07-14T18:17:17.641 INFO:tasks.workunit.client.0.smithi163.stdout:operation# (mod 256) for the bad data may be 218 2023-07-14T18:17:17.641 INFO:tasks.workunit.client.0.smithi163.stdout:0x30ad2 0x0000 0xda8c 0x00009 2023-07-14T18:17:17.641 INFO:tasks.workunit.client.0.smithi163.stdout:operation# (mod 256) for the bad data may be 218 2023-07-14T18:17:17.641 INFO:tasks.workunit.client.0.smithi163.stdout:0x30ad3 0x0000 0x8cda 0x0000a 2023-07-14T18:17:17.641 INFO:tasks.workunit.client.0.smithi163.stdout:operation# (mod 256) for the bad data may be 218 2023-07-14T18:17:17.642 INFO:tasks.workunit.client.0.smithi163.stdout:0x30ad4 0x0000 0xda6a 0x0000b 2023-07-14T18:17:17.642 INFO:tasks.workunit.client.0.smithi163.stdout:operation# (mod 256) for the bad data may be 218 2023-07-14T18:17:17.642 INFO:tasks.workunit.client.0.smithi163.stdout:0x30ad5 0x0000 0x6ada 0x0000c 2023-07-14T18:17:17.642 INFO:tasks.workunit.client.0.smithi163.stdout:operation# (mod 256) for the bad data may be 218 2023-07-14T18:17:17.642 INFO:tasks.workunit.client.0.smithi163.stdout:0x30ad6 0x0000 0xdac4 0x0000d 2023-07-14T18:17:17.642 INFO:tasks.workunit.client.0.smithi163.stdout:operation# (mod 256) for the bad data may be 218 2023-07-14T18:17:17.642 INFO:tasks.workunit.client.0.smithi163.stdout:0x30ad7 0x0000 0xc4da 0x0000e 2023-07-14T18:17:17.642 INFO:tasks.workunit.client.0.smithi163.stdout:operation# (mod 256) for the bad data may be 218 2023-07-14T18:17:17.643 INFO:tasks.workunit.client.0.smithi163.stdout:0x30ad8 0x0000 0xda30 0x0000f 2023-07-14T18:17:17.643 INFO:tasks.workunit.client.0.smithi163.stdout:operation# (mod 256) for the bad data may be 218 2023-07-14T18:17:17.643 INFO:tasks.workunit.client.0.smithi163.stdout:LOG DUMP (9476 total operations): 2023-07-14T18:17:17.749 DEBUG:teuthology.orchestra.run:got remote process result: 110 2023-07-14T18:17:17.749 INFO:tasks.workunit.client.0.smithi163.stdout:1( 1 mod 256): WRITE 0x70521 thru 0x72de5 (0x28c5 bytes) HOLE ***WWWW 2023-07-14T18:17:17.749 INFO:tasks.workunit.client.0.smithi163.stdout:2( 2 mod 256): PUNCH 0xd3d thru 0xd8ad (0xcb71 bytes) 2023-07-14T18:17:17.749 INFO:tasks.workunit.client.0.smithi163.stdout:3( 3 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.750 INFO:tasks.workunit.client.0.smithi163.stdout:4( 4 mod 256): PUNCH 0x4d2eb thru 0x4eb16 (0x182c bytes) 2023-07-14T18:17:17.750 INFO:tasks.workunit.client.0.smithi163.stdout:5( 5 mod 256): WRITE 0x83104 thru 0x924d8 (0xf3d5 bytes) HOLE 2023-07-14T18:17:17.750 INFO:tasks.workunit.client.0.smithi163.stdout:6( 6 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.750 INFO:tasks.workunit.client.0.smithi163.stdout:7( 7 mod 256): FALLOC 0x53a87 thru 0x5a435 (0x69ae bytes) INTERIOR 2023-07-14T18:17:17.750 INFO:tasks.workunit.client.0.smithi163.stdout:8( 8 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.750 INFO:tasks.workunit.client.0.smithi163.stdout:9( 9 mod 256): WRITE 0xb7bef thru 0xbbb34 (0x3f46 bytes) HOLE 2023-07-14T18:17:17.750 INFO:tasks.workunit.client.0.smithi163.stdout:10( 10 mod 256): MAPWRITE 0x1233f thru 0x15be8 (0x38aa bytes) 2023-07-14T18:17:17.751 INFO:tasks.workunit.client.0.smithi163.stdout:11( 11 mod 256): MAPREAD 0x1fb31 thru 0x2a540 (0xaa10 bytes) 2023-07-14T18:17:17.751 INFO:tasks.workunit.client.0.smithi163.stdout:12( 12 mod 256): TRUNCATE DOWN from 0xbbb35 to 0x366e7 ******WWWW 2023-07-14T18:17:17.751 INFO:tasks.workunit.client.0.smithi163.stdout:13( 13 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.751 INFO:tasks.workunit.client.0.smithi163.stdout:14( 14 mod 256): READ 0x6741 thru 0xa44c (0x3d0c bytes) 2023-07-14T18:17:17.751 INFO:tasks.workunit.client.0.smithi163.stdout:15( 15 mod 256): WRITE 0x56f4c thru 0x65718 (0xe7cd bytes) HOLE ***WWWW 2023-07-14T18:17:17.751 INFO:tasks.workunit.client.0.smithi163.stdout:16( 16 mod 256): TRUNCATE DOWN from 0x65719 to 0x2cdc1 ******WWWW 2023-07-14T18:17:17.751 INFO:tasks.workunit.client.0.smithi163.stdout:17( 17 mod 256): READ 0x18ed2 thru 0x26a9c (0xdbcb bytes) 2023-07-14T18:17:17.751 INFO:tasks.workunit.client.0.smithi163.stdout:18( 18 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.752 INFO:tasks.workunit.client.0.smithi163.stdout:19( 19 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.752 INFO:tasks.workunit.client.0.smithi163.stdout:20( 20 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.752 INFO:tasks.workunit.client.0.smithi163.stdout:21( 21 mod 256): PUNCH 0x2238a thru 0x2cdc0 (0xaa37 bytes) 2023-07-14T18:17:17.752 INFO:tasks.workunit.client.0.smithi163.stdout:22( 22 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.752 INFO:tasks.workunit.client.0.smithi163.stdout:23( 23 mod 256): FALLOC 0xa11c4 thru 0xa620f (0x504b bytes) PAST_EOF 2023-07-14T18:17:17.752 INFO:tasks.workunit.client.0.smithi163.stdout:24( 24 mod 256): FALLOC 0x576cf thru 0x592d7 (0x1c08 bytes) PAST_EOF 2023-07-14T18:17:17.752 INFO:tasks.workunit.client.0.smithi163.stdout:25( 25 mod 256): FALLOC 0x7dc2f thru 0x83a33 (0x5e04 bytes) PAST_EOF 2023-07-14T18:17:17.752 INFO:tasks.workunit.client.0.smithi163.stdout:26( 26 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.753 INFO:tasks.workunit.client.0.smithi163.stdout:27( 27 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.753 INFO:tasks.workunit.client.0.smithi163.stdout:28( 28 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.753 INFO:tasks.workunit.client.0.smithi163.stdout:29( 29 mod 256): WRITE 0x2ca41 thru 0x3058b (0x3b4b bytes) EXTEND 2023-07-14T18:17:17.753 INFO:tasks.workunit.client.0.smithi163.stdout:30( 30 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.753 INFO:tasks.workunit.client.0.smithi163.stdout:31( 31 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.753 INFO:tasks.workunit.client.0.smithi163.stdout:32( 32 mod 256): PUNCH 0xb83e thru 0x197dc (0xdf9f bytes) 2023-07-14T18:17:17.753 INFO:tasks.workunit.client.0.smithi163.stdout:33( 33 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.753 INFO:tasks.workunit.client.0.smithi163.stdout:34( 34 mod 256): MAPWRITE 0x7ce3e thru 0x8a6df (0xd8a2 bytes) 2023-07-14T18:17:17.754 INFO:tasks.workunit.client.0.smithi163.stdout:35( 35 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.754 INFO:tasks.workunit.client.0.smithi163.stdout:36( 36 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.754 INFO:tasks.workunit.client.0.smithi163.stdout:37( 37 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.754 INFO:tasks.workunit.client.0.smithi163.stdout:38( 38 mod 256): PUNCH 0x64c56 thru 0x686e9 (0x3a94 bytes) 2023-07-14T18:17:17.754 INFO:tasks.workunit.client.0.smithi163.stdout:39( 39 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.754 INFO:tasks.workunit.client.0.smithi163.stdout:40( 40 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.754 INFO:tasks.workunit.client.0.smithi163.stdout:41( 41 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.755 INFO:tasks.workunit.client.0.smithi163.stdout:42( 42 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.755 INFO:tasks.workunit.client.0.smithi163.stdout:43( 43 mod 256): MAPWRITE 0xa1ecd thru 0xaeff8 (0xd12c bytes) 2023-07-14T18:17:17.755 INFO:tasks.workunit.client.0.smithi163.stdout:44( 44 mod 256): COPY 0xacc1f thru 0xaeff8 (0x23da bytes) to 0xe8979 thru 0xead52 2023-07-14T18:17:17.755 INFO:tasks.workunit.client.0.smithi163.stdout:45( 45 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.755 INFO:tasks.workunit.client.0.smithi163.stdout:46( 46 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.755 INFO:tasks.workunit.client.0.smithi163.stdout:47( 47 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.755 INFO:tasks.workunit.client.0.smithi163.stdout:48( 48 mod 256): PUNCH 0xc8c41 thru 0xca297 (0x1657 bytes) 2023-07-14T18:17:17.755 INFO:tasks.workunit.client.0.smithi163.stdout:49( 49 mod 256): MAPREAD 0x9034e thru 0x956c3 (0x5376 bytes) 2023-07-14T18:17:17.756 INFO:tasks.workunit.client.0.smithi163.stdout:50( 50 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.756 INFO:tasks.workunit.client.0.smithi163.stdout:51( 51 mod 256): COPY 0x77a37 thru 0x7cdad (0x5377 bytes) to 0xb084d thru 0xb5bc3 2023-07-14T18:17:17.756 INFO:tasks.workunit.client.0.smithi163.stdout:52( 52 mod 256): FALLOC 0xcb0db thru 0xd2fbd (0x7ee2 bytes) INTERIOR 2023-07-14T18:17:17.756 INFO:tasks.workunit.client.0.smithi163.stdout:53( 53 mod 256): PUNCH 0x33188 thru 0x3f5a6 (0xc41f bytes) ******PPPP 2023-07-14T18:17:17.756 INFO:tasks.workunit.client.0.smithi163.stdout:54( 54 mod 256): MAPWRITE 0x826f3 thru 0x8d8e8 (0xb1f6 bytes) 2023-07-14T18:17:17.756 INFO:tasks.workunit.client.0.smithi163.stdout:55( 55 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.756 INFO:tasks.workunit.client.0.smithi163.stdout:56( 56 mod 256): MAPREAD 0x64243 thru 0x68021 (0x3ddf bytes) 2023-07-14T18:17:17.756 INFO:tasks.workunit.client.0.smithi163.stdout:57( 57 mod 256): FALLOC 0x92bcc thru 0x9ba5d (0x8e91 bytes) INTERIOR 2023-07-14T18:17:17.757 INFO:tasks.workunit.client.0.smithi163.stdout:58( 58 mod 256): WRITE 0x1fdfb thru 0x2774d (0x7953 bytes) 2023-07-14T18:17:17.757 INFO:tasks.workunit.client.0.smithi163.stdout:59( 59 mod 256): COPY 0x92ec7 thru 0x9bc29 (0x8d63 bytes) to 0x759dc thru 0x7e73e 2023-07-14T18:17:17.757 INFO:tasks.workunit.client.0.smithi163.stdout:60( 60 mod 256): PUNCH 0x7380 thru 0x16806 (0xf487 bytes) 2023-07-14T18:17:17.757 INFO:tasks.workunit.client.0.smithi163.stdout:61( 61 mod 256): FALLOC 0x4ca96 thru 0x517f2 (0x4d5c bytes) INTERIOR 2023-07-14T18:17:17.757 INFO:tasks.workunit.client.0.smithi163.stdout:62( 62 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.757 INFO:tasks.workunit.client.0.smithi163.stdout:63( 63 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.757 INFO:tasks.workunit.client.0.smithi163.stdout:64( 64 mod 256): WRITE 0x74890 thru 0x7ad1c (0x648d bytes) 2023-07-14T18:17:17.757 INFO:tasks.workunit.client.0.smithi163.stdout:65( 65 mod 256): COPY 0xa1b66 thru 0xad07b (0xb516 bytes) to 0x20b75 thru 0x2c08a 2023-07-14T18:17:17.758 INFO:tasks.workunit.client.0.smithi163.stdout:66( 66 mod 256): MAPREAD 0x73928 thru 0x75d72 (0x244b bytes) 2023-07-14T18:17:17.758 INFO:tasks.workunit.client.0.smithi163.stdout:67( 67 mod 256): COPY 0x3c59d thru 0x3f6d8 (0x313c bytes) to 0xb63b2 thru 0xb94ed 2023-07-14T18:17:17.758 INFO:tasks.workunit.client.0.smithi163.stdout:68( 68 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.758 INFO:tasks.workunit.client.0.smithi163.stdout:69( 69 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.758 INFO:tasks.workunit.client.0.smithi163.stdout:70( 70 mod 256): READ 0xd11ef thru 0xd887c (0x768e bytes) 2023-07-14T18:17:17.758 INFO:tasks.workunit.client.0.smithi163.stdout:71( 71 mod 256): TRUNCATE DOWN from 0xead53 to 0x48305 2023-07-14T18:17:17.758 INFO:tasks.workunit.client.0.smithi163.stdout:72( 72 mod 256): FALLOC 0x720fc thru 0x750f4 (0x2ff8 bytes) PAST_EOF 2023-07-14T18:17:17.758 INFO:tasks.workunit.client.0.smithi163.stdout:73( 73 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.759 INFO:tasks.workunit.client.0.smithi163.stdout:74( 74 mod 256): MAPWRITE 0xaaf61 thru 0xb9aa4 (0xeb44 bytes) 2023-07-14T18:17:17.759 INFO:tasks.workunit.client.0.smithi163.stdout:75( 75 mod 256): WRITE 0xf4759 thru 0xfffff (0xb8a7 bytes) HOLE 2023-07-14T18:17:17.759 INFO:tasks.workunit.client.0.smithi163.stdout:76( 76 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.759 INFO:tasks.workunit.client.0.smithi163.stdout:77( 77 mod 256): MAPWRITE 0xf3194 thru 0xff44b (0xc2b8 bytes) 2023-07-14T18:17:17.759 INFO:tasks.workunit.client.0.smithi163.stdout:78( 78 mod 256): WRITE 0xfd095 thru 0xfffff (0x2f6b bytes) 2023-07-14T18:17:17.759 INFO:tasks.workunit.client.0.smithi163.stdout:79( 79 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.759 INFO:tasks.workunit.client.0.smithi163.stdout:80( 80 mod 256): MAPREAD 0x5e95c thru 0x6d933 (0xefd8 bytes) 2023-07-14T18:17:17.759 INFO:tasks.workunit.client.0.smithi163.stdout:81( 81 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.760 INFO:tasks.workunit.client.0.smithi163.stdout:82( 82 mod 256): WRITE 0xde559 thru 0xe15d9 (0x3081 bytes) 2023-07-14T18:17:17.760 INFO:tasks.workunit.client.0.smithi163.stdout:83( 83 mod 256): FALLOC 0x7db51 thru 0x8b0ee (0xd59d bytes) INTERIOR 2023-07-14T18:17:17.760 INFO:tasks.workunit.client.0.smithi163.stdout:84( 84 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.760 INFO:tasks.workunit.client.0.smithi163.stdout:85( 85 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.760 INFO:tasks.workunit.client.0.smithi163.stdout:86( 86 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.760 INFO:tasks.workunit.client.0.smithi163.stdout:87( 87 mod 256): TRUNCATE DOWN from 0x100000 to 0xfc5c3 2023-07-14T18:17:17.760 INFO:tasks.workunit.client.0.smithi163.stdout:88( 88 mod 256): MAPWRITE 0x91355 thru 0x99418 (0x80c4 bytes) 2023-07-14T18:17:17.760 INFO:tasks.workunit.client.0.smithi163.stdout:89( 89 mod 256): PUNCH 0xe7392 thru 0xe8216 (0xe85 bytes) 2023-07-14T18:17:17.761 INFO:tasks.workunit.client.0.smithi163.stdout:90( 90 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.761 INFO:tasks.workunit.client.0.smithi163.stdout:91( 91 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.761 INFO:tasks.workunit.client.0.smithi163.stdout:92( 92 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.761 INFO:tasks.workunit.client.0.smithi163.stdout:93( 93 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.761 INFO:tasks.workunit.client.0.smithi163.stdout:94( 94 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.761 INFO:tasks.workunit.client.0.smithi163.stdout:95( 95 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.761 INFO:tasks.workunit.client.0.smithi163.stdout:96( 96 mod 256): PUNCH 0xf0b7c thru 0xfc5c2 (0xba47 bytes) 2023-07-14T18:17:17.761 INFO:tasks.workunit.client.0.smithi163.stdout:97( 97 mod 256): READ 0xb35a3 thru 0xbb7ac (0x820a bytes) 2023-07-14T18:17:17.762 INFO:tasks.workunit.client.0.smithi163.stdout:98( 98 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.762 INFO:tasks.workunit.client.0.smithi163.stdout:99( 99 mod 256): READ 0xb5ec5 thru 0xbedac (0x8ee8 bytes) 2023-07-14T18:17:17.762 INFO:tasks.workunit.client.0.smithi163.stdout:100(100 mod 256): PUNCH 0xd1674 thru 0xdf00a (0xd997 bytes) 2023-07-14T18:17:17.762 INFO:tasks.workunit.client.0.smithi163.stdout:101(101 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.762 INFO:tasks.workunit.client.0.smithi163.stdout:102(102 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.762 INFO:tasks.workunit.client.0.smithi163.stdout:103(103 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.762 INFO:tasks.workunit.client.0.smithi163.stdout:104(104 mod 256): READ 0x46eee thru 0x4fc43 (0x8d56 bytes) 2023-07-14T18:17:17.762 INFO:tasks.workunit.client.0.smithi163.stdout:105(105 mod 256): FALLOC 0x4b70e thru 0x52927 (0x7219 bytes) INTERIOR 2023-07-14T18:17:17.763 INFO:tasks.workunit.client.0.smithi163.stdout:106(106 mod 256): FALLOC 0xe408c thru 0xe63d2 (0x2346 bytes) INTERIOR 2023-07-14T18:17:17.763 INFO:tasks.workunit.client.0.smithi163.stdout:107(107 mod 256): FALLOC 0xb7102 thru 0xc4046 (0xcf44 bytes) INTERIOR 2023-07-14T18:17:17.763 INFO:tasks.workunit.client.0.smithi163.stdout:108(108 mod 256): READ 0xd0630 thru 0xdffa6 (0xf977 bytes) 2023-07-14T18:17:17.763 INFO:tasks.workunit.client.0.smithi163.stdout:109(109 mod 256): COPY 0xb014c thru 0xb1b7c (0x1a31 bytes) to 0x174f1 thru 0x18f21 2023-07-14T18:17:17.763 INFO:tasks.workunit.client.0.smithi163.stdout:110(110 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.763 INFO:tasks.workunit.client.0.smithi163.stdout:111(111 mod 256): MAPREAD 0x83e62 thru 0x901ed (0xc38c bytes) 2023-07-14T18:17:17.763 INFO:tasks.workunit.client.0.smithi163.stdout:112(112 mod 256): COPY 0x54363 thru 0x5ea99 (0xa737 bytes) to 0x36478 thru 0x40bae ******EEEE 2023-07-14T18:17:17.763 INFO:tasks.workunit.client.0.smithi163.stdout:113(113 mod 256): READ 0xa630a thru 0xb5fc3 (0xfcba bytes) 2023-07-14T18:17:17.764 INFO:tasks.workunit.client.0.smithi163.stdout:114(114 mod 256): TRUNCATE DOWN from 0xfc5c3 to 0x5ba8c 2023-07-14T18:17:17.764 INFO:tasks.workunit.client.0.smithi163.stdout:115(115 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.764 INFO:tasks.workunit.client.0.smithi163.stdout:116(116 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.764 INFO:tasks.workunit.client.0.smithi163.stdout:117(117 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.764 INFO:tasks.workunit.client.0.smithi163.stdout:118(118 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.764 INFO:tasks.workunit.client.0.smithi163.stdout:119(119 mod 256): MAPREAD 0x32c60 thru 0x3f8f4 (0xcc95 bytes) ***RRRR*** 2023-07-14T18:17:17.764 INFO:tasks.workunit.client.0.smithi163.stdout:120(120 mod 256): PUNCH 0x2c4d thru 0x6da3 (0x4157 bytes) 2023-07-14T18:17:17.764 INFO:tasks.workunit.client.0.smithi163.stdout:121(121 mod 256): COPY 0x51bb5 thru 0x57e14 (0x6260 bytes) to 0xbe353 thru 0xc45b2 2023-07-14T18:17:17.765 INFO:tasks.workunit.client.0.smithi163.stdout:122(122 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.765 INFO:tasks.workunit.client.0.smithi163.stdout:123(123 mod 256): TRUNCATE DOWN from 0xc45b3 to 0xabff4 2023-07-14T18:17:17.765 INFO:tasks.workunit.client.0.smithi163.stdout:124(124 mod 256): WRITE 0xcde7e thru 0xcfcf9 (0x1e7c bytes) HOLE 2023-07-14T18:17:17.765 INFO:tasks.workunit.client.0.smithi163.stdout:125(125 mod 256): FALLOC 0x6b29a thru 0x7a834 (0xf59a bytes) INTERIOR 2023-07-14T18:17:17.765 INFO:tasks.workunit.client.0.smithi163.stdout:126(126 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.765 INFO:tasks.workunit.client.0.smithi163.stdout:127(127 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.765 INFO:tasks.workunit.client.0.smithi163.stdout:128(128 mod 256): COPY 0xc552a thru 0xccc67 (0x773e bytes) to 0x24d6c thru 0x2c4a9 2023-07-14T18:17:17.765 INFO:tasks.workunit.client.0.smithi163.stdout:129(129 mod 256): COPY 0xa76b6 thru 0xb5e37 (0xe782 bytes) to 0x89744 thru 0x97ec5 2023-07-14T18:17:17.766 INFO:tasks.workunit.client.0.smithi163.stdout:130(130 mod 256): READ 0x138ca thru 0x1e16a (0xa8a1 bytes) 2023-07-14T18:17:17.766 INFO:tasks.workunit.client.0.smithi163.stdout:131(131 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.766 INFO:tasks.workunit.client.0.smithi163.stdout:132(132 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.766 INFO:tasks.workunit.client.0.smithi163.stdout:133(133 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.766 INFO:tasks.workunit.client.0.smithi163.stdout:134(134 mod 256): FALLOC 0xf47e4 thru 0xf82ba (0x3ad6 bytes) PAST_EOF 2023-07-14T18:17:17.766 INFO:tasks.workunit.client.0.smithi163.stdout:135(135 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.766 INFO:tasks.workunit.client.0.smithi163.stdout:136(136 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.767 INFO:tasks.workunit.client.0.smithi163.stdout:137(137 mod 256): MAPWRITE 0xf0063 thru 0xfa5a8 (0xa546 bytes) 2023-07-14T18:17:17.767 INFO:tasks.workunit.client.0.smithi163.stdout:138(138 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.767 INFO:tasks.workunit.client.0.smithi163.stdout:139(139 mod 256): FALLOC 0xf1570 thru 0xf70c5 (0x5b55 bytes) INTERIOR 2023-07-14T18:17:17.767 INFO:tasks.workunit.client.0.smithi163.stdout:140(140 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.767 INFO:tasks.workunit.client.0.smithi163.stdout:141(141 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.767 INFO:tasks.workunit.client.0.smithi163.stdout:142(142 mod 256): TRUNCATE DOWN from 0xfa5a9 to 0x25f6a ******WWWW 2023-07-14T18:17:17.767 INFO:tasks.workunit.client.0.smithi163.stdout:143(143 mod 256): TRUNCATE UP from 0x25f6a to 0xbbad1 ******WWWW 2023-07-14T18:17:17.767 INFO:tasks.workunit.client.0.smithi163.stdout:144(144 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.768 INFO:tasks.workunit.client.0.smithi163.stdout:145(145 mod 256): MAPWRITE 0x35b7a thru 0x40c21 (0xb0a8 bytes) ******WWWW 2023-07-14T18:17:17.768 INFO:tasks.workunit.client.0.smithi163.stdout:146(146 mod 256): TRUNCATE UP from 0xbbad1 to 0xbec26 2023-07-14T18:17:17.768 INFO:tasks.workunit.client.0.smithi163.stdout:147(147 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.768 INFO:tasks.workunit.client.0.smithi163.stdout:148(148 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.768 INFO:tasks.workunit.client.0.smithi163.stdout:149(149 mod 256): WRITE 0xb074b thru 0xc01ff (0xfab5 bytes) EXTEND 2023-07-14T18:17:17.768 INFO:tasks.workunit.client.0.smithi163.stdout:150(150 mod 256): WRITE 0xa5569 thru 0xb1d87 (0xc81f bytes) 2023-07-14T18:17:17.768 INFO:tasks.workunit.client.0.smithi163.stdout:151(151 mod 256): FALLOC 0x2b6d3 thru 0x387b9 (0xd0e6 bytes) INTERIOR ******FFFF 2023-07-14T18:17:17.769 INFO:tasks.workunit.client.0.smithi163.stdout:152(152 mod 256): COPY 0x1c921 thru 0x217cc (0x4eac bytes) to 0xed096 thru 0xf1f41 2023-07-14T18:17:17.769 INFO:tasks.workunit.client.0.smithi163.stdout:153(153 mod 256): PUNCH 0xdbc38 thru 0xdf506 (0x38cf bytes) 2023-07-14T18:17:17.769 INFO:tasks.workunit.client.0.smithi163.stdout:154(154 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.769 INFO:tasks.workunit.client.0.smithi163.stdout:155(155 mod 256): MAPREAD 0x4d1fd thru 0x552a3 (0x80a7 bytes) 2023-07-14T18:17:17.769 INFO:tasks.workunit.client.0.smithi163.stdout:156(156 mod 256): FALLOC 0xb7e9a thru 0xc3835 (0xb99b bytes) INTERIOR 2023-07-14T18:17:17.769 INFO:tasks.workunit.client.0.smithi163.stdout:157(157 mod 256): TRUNCATE DOWN from 0xf1f42 to 0x3cf20 2023-07-14T18:17:17.769 INFO:tasks.workunit.client.0.smithi163.stdout:158(158 mod 256): PUNCH 0x1ac03 thru 0x2a8da (0xfcd8 bytes) 2023-07-14T18:17:17.769 INFO:tasks.workunit.client.0.smithi163.stdout:159(159 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.770 INFO:tasks.workunit.client.0.smithi163.stdout:160(160 mod 256): WRITE 0xf357c thru 0xfffff (0xca84 bytes) HOLE 2023-07-14T18:17:17.770 INFO:tasks.workunit.client.0.smithi163.stdout:161(161 mod 256): TRUNCATE DOWN from 0x100000 to 0xf2cdd 2023-07-14T18:17:17.770 INFO:tasks.workunit.client.0.smithi163.stdout:162(162 mod 256): READ 0xd184b thru 0xde880 (0xd036 bytes) 2023-07-14T18:17:17.770 INFO:tasks.workunit.client.0.smithi163.stdout:163(163 mod 256): TRUNCATE UP from 0xf2cdd to 0xfca47 2023-07-14T18:17:17.770 INFO:tasks.workunit.client.0.smithi163.stdout:164(164 mod 256): MAPWRITE 0xe3edb thru 0xec24a (0x8370 bytes) 2023-07-14T18:17:17.770 INFO:tasks.workunit.client.0.smithi163.stdout:165(165 mod 256): WRITE 0x34e85 thru 0x38227 (0x33a3 bytes) ***WWWW 2023-07-14T18:17:17.770 INFO:tasks.workunit.client.0.smithi163.stdout:166(166 mod 256): MAPREAD 0x4b0f0 thru 0x5996f (0xe880 bytes) 2023-07-14T18:17:17.770 INFO:tasks.workunit.client.0.smithi163.stdout:167(167 mod 256): TRUNCATE DOWN from 0xfca47 to 0xc1b8f 2023-07-14T18:17:17.771 INFO:tasks.workunit.client.0.smithi163.stdout:168(168 mod 256): READ 0xb631c thru 0xb6fa5 (0xc8a bytes) 2023-07-14T18:17:17.771 INFO:tasks.workunit.client.0.smithi163.stdout:169(169 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.771 INFO:tasks.workunit.client.0.smithi163.stdout:170(170 mod 256): MAPWRITE 0xf1073 thru 0xfdf83 (0xcf11 bytes) 2023-07-14T18:17:17.771 INFO:tasks.workunit.client.0.smithi163.stdout:171(171 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.771 INFO:tasks.workunit.client.0.smithi163.stdout:172(172 mod 256): WRITE 0xfef1f thru 0xfffff (0x10e1 bytes) HOLE 2023-07-14T18:17:17.771 INFO:tasks.workunit.client.0.smithi163.stdout:173(173 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.771 INFO:tasks.workunit.client.0.smithi163.stdout:174(174 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.771 INFO:tasks.workunit.client.0.smithi163.stdout:175(175 mod 256): COPY 0x22e15 thru 0x2472e (0x191a bytes) to 0xadbb2 thru 0xaf4cb 2023-07-14T18:17:17.772 INFO:tasks.workunit.client.0.smithi163.stdout:176(176 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.772 INFO:tasks.workunit.client.0.smithi163.stdout:177(177 mod 256): TRUNCATE DOWN from 0x100000 to 0x2ccd5 ******WWWW 2023-07-14T18:17:17.772 INFO:tasks.workunit.client.0.smithi163.stdout:178(178 mod 256): TRUNCATE UP from 0x2ccd5 to 0xf4e7f ******WWWW 2023-07-14T18:17:17.772 INFO:tasks.workunit.client.0.smithi163.stdout:179(179 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.772 INFO:tasks.workunit.client.0.smithi163.stdout:180(180 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.772 INFO:tasks.workunit.client.0.smithi163.stdout:181(181 mod 256): MAPREAD 0xa657 thru 0x19bbf (0xf569 bytes) 2023-07-14T18:17:17.772 INFO:tasks.workunit.client.0.smithi163.stdout:182(182 mod 256): READ 0x7dd7d thru 0x8a45f (0xc6e3 bytes) 2023-07-14T18:17:17.772 INFO:tasks.workunit.client.0.smithi163.stdout:183(183 mod 256): COPY 0x4ca19 thru 0x57f6e (0xb556 bytes) to 0x4d9c thru 0x102f1 2023-07-14T18:17:17.773 INFO:tasks.workunit.client.0.smithi163.stdout:184(184 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.773 INFO:tasks.workunit.client.0.smithi163.stdout:185(185 mod 256): MAPREAD 0x99ce0 thru 0x9f567 (0x5888 bytes) 2023-07-14T18:17:17.773 INFO:tasks.workunit.client.0.smithi163.stdout:186(186 mod 256): PUNCH 0x3e9d6 thru 0x40609 (0x1c34 bytes) 2023-07-14T18:17:17.773 INFO:tasks.workunit.client.0.smithi163.stdout:187(187 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.773 INFO:tasks.workunit.client.0.smithi163.stdout:188(188 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.773 INFO:tasks.workunit.client.0.smithi163.stdout:189(189 mod 256): READ 0x93cfa thru 0x9f9ab (0xbcb2 bytes) 2023-07-14T18:17:17.773 INFO:tasks.workunit.client.0.smithi163.stdout:190(190 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.773 INFO:tasks.workunit.client.0.smithi163.stdout:191(191 mod 256): MAPREAD 0x674ce thru 0x73646 (0xc179 bytes) 2023-07-14T18:17:17.774 INFO:tasks.workunit.client.0.smithi163.stdout:192(192 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.774 INFO:tasks.workunit.client.0.smithi163.stdout:193(193 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.774 INFO:tasks.workunit.client.0.smithi163.stdout:194(194 mod 256): COPY 0x3da41 thru 0x40433 (0x29f3 bytes) to 0xb935 thru 0xe327 2023-07-14T18:17:17.774 INFO:tasks.workunit.client.0.smithi163.stdout:195(195 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.774 INFO:tasks.workunit.client.0.smithi163.stdout:196(196 mod 256): READ 0x4ced5 thru 0x56c51 (0x9d7d bytes) 2023-07-14T18:17:17.774 INFO:tasks.workunit.client.0.smithi163.stdout:197(197 mod 256): PUNCH 0xaf242 thru 0xb8e73 (0x9c32 bytes) 2023-07-14T18:17:17.774 INFO:tasks.workunit.client.0.smithi163.stdout:198(198 mod 256): TRUNCATE DOWN from 0xf4e7f to 0x85313 2023-07-14T18:17:17.774 INFO:tasks.workunit.client.0.smithi163.stdout:199(199 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.775 INFO:tasks.workunit.client.0.smithi163.stdout:200(200 mod 256): WRITE 0x77b2a thru 0x8281b (0xacf2 bytes) 2023-07-14T18:17:17.775 INFO:tasks.workunit.client.0.smithi163.stdout:201(201 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.775 INFO:tasks.workunit.client.0.smithi163.stdout:202(202 mod 256): FALLOC 0x24edb thru 0x2c53e (0x7663 bytes) INTERIOR 2023-07-14T18:17:17.775 INFO:tasks.workunit.client.0.smithi163.stdout:203(203 mod 256): MAPWRITE 0x619bd thru 0x65191 (0x37d5 bytes) 2023-07-14T18:17:17.775 INFO:tasks.workunit.client.0.smithi163.stdout:204(204 mod 256): WRITE 0xb2eb1 thru 0xba1c9 (0x7319 bytes) HOLE 2023-07-14T18:17:17.775 INFO:tasks.workunit.client.0.smithi163.stdout:205(205 mod 256): MAPREAD 0x8a201 thru 0x91ffc (0x7dfc bytes) 2023-07-14T18:17:17.775 INFO:tasks.workunit.client.0.smithi163.stdout:206(206 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.775 INFO:tasks.workunit.client.0.smithi163.stdout:207(207 mod 256): WRITE 0xd294e thru 0xda9d6 (0x8089 bytes) HOLE 2023-07-14T18:17:17.776 INFO:tasks.workunit.client.0.smithi163.stdout:208(208 mod 256): MAPWRITE 0xc606d thru 0xd2ad6 (0xca6a bytes) 2023-07-14T18:17:17.776 INFO:tasks.workunit.client.0.smithi163.stdout:209(209 mod 256): FALLOC 0xce7e1 thru 0xd0a09 (0x2228 bytes) INTERIOR 2023-07-14T18:17:17.776 INFO:tasks.workunit.client.0.smithi163.stdout:210(210 mod 256): WRITE 0x65d76 thru 0x71273 (0xb4fe bytes) 2023-07-14T18:17:17.776 INFO:tasks.workunit.client.0.smithi163.stdout:211(211 mod 256): READ 0x7d8be thru 0x85262 (0x79a5 bytes) 2023-07-14T18:17:17.776 INFO:tasks.workunit.client.0.smithi163.stdout:212(212 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.776 INFO:tasks.workunit.client.0.smithi163.stdout:213(213 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.776 INFO:tasks.workunit.client.0.smithi163.stdout:214(214 mod 256): COPY 0x6dc7e thru 0x6e59a (0x91d bytes) to 0x471ed thru 0x47b09 2023-07-14T18:17:17.776 INFO:tasks.workunit.client.0.smithi163.stdout:215(215 mod 256): READ 0x8c072 thru 0x91a69 (0x59f8 bytes) 2023-07-14T18:17:17.777 INFO:tasks.workunit.client.0.smithi163.stdout:216(216 mod 256): MAPWRITE 0x93b6a thru 0x97c23 (0x40ba bytes) 2023-07-14T18:17:17.777 INFO:tasks.workunit.client.0.smithi163.stdout:217(217 mod 256): TRUNCATE DOWN from 0xda9d7 to 0x1f2fd ******WWWW 2023-07-14T18:17:17.777 INFO:tasks.workunit.client.0.smithi163.stdout:218(218 mod 256): MAPREAD 0x8cdd thru 0x13c1a (0xaf3e bytes) 2023-07-14T18:17:17.777 INFO:tasks.workunit.client.0.smithi163.stdout:219(219 mod 256): COPY 0x76b6 thru 0x1303e (0xb989 bytes) to 0x79efd thru 0x85885 2023-07-14T18:17:17.777 INFO:tasks.workunit.client.0.smithi163.stdout:220(220 mod 256): MAPWRITE 0x1734a thru 0x21478 (0xa12f bytes) 2023-07-14T18:17:17.777 INFO:tasks.workunit.client.0.smithi163.stdout:221(221 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.777 INFO:tasks.workunit.client.0.smithi163.stdout:222(222 mod 256): FALLOC 0xd9bc6 thru 0xe2be2 (0x901c bytes) PAST_EOF 2023-07-14T18:17:17.777 INFO:tasks.workunit.client.0.smithi163.stdout:223(223 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.778 INFO:tasks.workunit.client.0.smithi163.stdout:224(224 mod 256): MAPREAD 0xefc1 thru 0x116b6 (0x26f6 bytes) 2023-07-14T18:17:17.778 INFO:tasks.workunit.client.0.smithi163.stdout:225(225 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.778 INFO:tasks.workunit.client.0.smithi163.stdout:226(226 mod 256): READ 0x7352 thru 0x13d59 (0xca08 bytes) 2023-07-14T18:17:17.778 INFO:tasks.workunit.client.0.smithi163.stdout:227(227 mod 256): PUNCH 0x5e523 thru 0x5eb5e (0x63c bytes) 2023-07-14T18:17:17.778 INFO:tasks.workunit.client.0.smithi163.stdout:228(228 mod 256): FALLOC 0xf9375 thru 0xfa330 (0xfbb bytes) EXTENDING 2023-07-14T18:17:17.778 INFO:tasks.workunit.client.0.smithi163.stdout:229(229 mod 256): READ 0x6bf84 thru 0x700b7 (0x4134 bytes) 2023-07-14T18:17:17.778 INFO:tasks.workunit.client.0.smithi163.stdout:230(230 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.778 INFO:tasks.workunit.client.0.smithi163.stdout:231(231 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.779 INFO:tasks.workunit.client.0.smithi163.stdout:232(232 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.779 INFO:tasks.workunit.client.0.smithi163.stdout:233(233 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.779 INFO:tasks.workunit.client.0.smithi163.stdout:234(234 mod 256): WRITE 0x116c thru 0x7cac (0x6b41 bytes) 2023-07-14T18:17:17.779 INFO:tasks.workunit.client.0.smithi163.stdout:235(235 mod 256): TRUNCATE DOWN from 0xfa330 to 0x1161a ******WWWW 2023-07-14T18:17:17.779 INFO:tasks.workunit.client.0.smithi163.stdout:236(236 mod 256): TRUNCATE UP from 0x1161a to 0x66f58 ******WWWW 2023-07-14T18:17:17.779 INFO:tasks.workunit.client.0.smithi163.stdout:237(237 mod 256): TRUNCATE UP from 0x66f58 to 0xed6b4 2023-07-14T18:17:17.779 INFO:tasks.workunit.client.0.smithi163.stdout:238(238 mod 256): MAPREAD 0x5b824 thru 0x643ca (0x8ba7 bytes) 2023-07-14T18:17:17.779 INFO:tasks.workunit.client.0.smithi163.stdout:239(239 mod 256): READ 0x6fefa thru 0x7ec6e (0xed75 bytes) 2023-07-14T18:17:17.780 INFO:tasks.workunit.client.0.smithi163.stdout:240(240 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.780 INFO:tasks.workunit.client.0.smithi163.stdout:241(241 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.780 INFO:tasks.workunit.client.0.smithi163.stdout:242(242 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.780 INFO:tasks.workunit.client.0.smithi163.stdout:243(243 mod 256): READ 0xf017 thru 0x140ac (0x5096 bytes) 2023-07-14T18:17:17.780 INFO:tasks.workunit.client.0.smithi163.stdout:244(244 mod 256): COPY 0x29489 thru 0x317fc (0x8374 bytes) to 0xe0338 thru 0xe86ab 2023-07-14T18:17:17.780 INFO:tasks.workunit.client.0.smithi163.stdout:245(245 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.780 INFO:tasks.workunit.client.0.smithi163.stdout:246(246 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.780 INFO:tasks.workunit.client.0.smithi163.stdout:247(247 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.781 INFO:tasks.workunit.client.0.smithi163.stdout:248(248 mod 256): WRITE 0x65810 thru 0x6f7b7 (0x9fa8 bytes) 2023-07-14T18:17:17.781 INFO:tasks.workunit.client.0.smithi163.stdout:249(249 mod 256): MAPREAD 0xa6387 thru 0xb0e69 (0xaae3 bytes) 2023-07-14T18:17:17.781 INFO:tasks.workunit.client.0.smithi163.stdout:250(250 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.781 INFO:tasks.workunit.client.0.smithi163.stdout:251(251 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.781 INFO:tasks.workunit.client.0.smithi163.stdout:252(252 mod 256): MAPWRITE 0xfa627 thru 0xfffff (0x59d9 bytes) 2023-07-14T18:17:17.781 INFO:tasks.workunit.client.0.smithi163.stdout:253(253 mod 256): WRITE 0xcc3a0 thru 0xd3742 (0x73a3 bytes) 2023-07-14T18:17:17.781 INFO:tasks.workunit.client.0.smithi163.stdout:254(254 mod 256): MAPWRITE 0x2b398 thru 0x32084 (0x6ced bytes) 2023-07-14T18:17:17.782 INFO:tasks.workunit.client.0.smithi163.stdout:255(255 mod 256): MAPWRITE 0xccc53 thru 0xd3e65 (0x7213 bytes) 2023-07-14T18:17:17.782 INFO:tasks.workunit.client.0.smithi163.stdout:256( 0 mod 256): WRITE 0xd2f40 thru 0xe21e3 (0xf2a4 bytes) 2023-07-14T18:17:17.782 INFO:tasks.workunit.client.0.smithi163.stdout:257( 1 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.782 INFO:tasks.workunit.client.0.smithi163.stdout:258( 2 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.782 INFO:tasks.workunit.client.0.smithi163.stdout:259( 3 mod 256): WRITE 0xe636b thru 0xf2252 (0xbee8 bytes) 2023-07-14T18:17:17.782 INFO:tasks.workunit.client.0.smithi163.stdout:260( 4 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.782 INFO:tasks.workunit.client.0.smithi163.stdout:261( 5 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.782 INFO:tasks.workunit.client.0.smithi163.stdout:262( 6 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.782 INFO:tasks.workunit.client.0.smithi163.stdout:263( 7 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.783 INFO:tasks.workunit.client.0.smithi163.stdout:264( 8 mod 256): COPY 0xa78a6 thru 0xb6644 (0xed9f bytes) to 0x342e8 thru 0x43086 ******EEEE 2023-07-14T18:17:17.783 INFO:tasks.workunit.client.0.smithi163.stdout:265( 9 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.783 INFO:tasks.workunit.client.0.smithi163.stdout:266( 10 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.783 INFO:tasks.workunit.client.0.smithi163.stdout:267( 11 mod 256): WRITE 0x96789 thru 0xa31a6 (0xca1e bytes) 2023-07-14T18:17:17.783 INFO:tasks.workunit.client.0.smithi163.stdout:268( 12 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.783 INFO:tasks.workunit.client.0.smithi163.stdout:269( 13 mod 256): TRUNCATE DOWN from 0x100000 to 0x1917d ******WWWW 2023-07-14T18:17:17.783 INFO:tasks.workunit.client.0.smithi163.stdout:270( 14 mod 256): FALLOC 0xf40a4 thru 0xf68d3 (0x282f bytes) EXTENDING 2023-07-14T18:17:17.783 INFO:tasks.workunit.client.0.smithi163.stdout:271( 15 mod 256): MAPWRITE 0x7e943 thru 0x885a5 (0x9c63 bytes) 2023-07-14T18:17:17.784 INFO:tasks.workunit.client.0.smithi163.stdout:272( 16 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.784 INFO:tasks.workunit.client.0.smithi163.stdout:273( 17 mod 256): READ 0xb0bcc thru 0xb9a50 (0x8e85 bytes) 2023-07-14T18:17:17.784 INFO:tasks.workunit.client.0.smithi163.stdout:274( 18 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.784 INFO:tasks.workunit.client.0.smithi163.stdout:275( 19 mod 256): READ 0xbc792 thru 0xcba0b (0xf27a bytes) 2023-07-14T18:17:17.784 INFO:tasks.workunit.client.0.smithi163.stdout:276( 20 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.784 INFO:tasks.workunit.client.0.smithi163.stdout:277( 21 mod 256): MAPREAD 0x9052b thru 0x9ab51 (0xa627 bytes) 2023-07-14T18:17:17.784 INFO:tasks.workunit.client.0.smithi163.stdout:278( 22 mod 256): COPY 0x5633e thru 0x5eddb (0x8a9e bytes) to 0x96640 thru 0x9f0dd 2023-07-14T18:17:17.785 INFO:tasks.workunit.client.0.smithi163.stdout:279( 23 mod 256): PUNCH 0x16117 thru 0x208ff (0xa7e9 bytes) 2023-07-14T18:17:17.785 INFO:tasks.workunit.client.0.smithi163.stdout:280( 24 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.785 INFO:tasks.workunit.client.0.smithi163.stdout:281( 25 mod 256): READ 0x87d57 thru 0x8e66b (0x6915 bytes) 2023-07-14T18:17:17.785 INFO:tasks.workunit.client.0.smithi163.stdout:282( 26 mod 256): TRUNCATE DOWN from 0xf68d3 to 0x9e7ba 2023-07-14T18:17:17.785 INFO:tasks.workunit.client.0.smithi163.stdout:283( 27 mod 256): TRUNCATE DOWN from 0x9e7ba to 0x89b1c 2023-07-14T18:17:17.785 INFO:tasks.workunit.client.0.smithi163.stdout:284( 28 mod 256): READ 0x4f2a0 thru 0x5c496 (0xd1f7 bytes) 2023-07-14T18:17:17.785 INFO:tasks.workunit.client.0.smithi163.stdout:285( 29 mod 256): MAPWRITE 0xe91b3 thru 0xed519 (0x4367 bytes) 2023-07-14T18:17:17.785 INFO:tasks.workunit.client.0.smithi163.stdout:286( 30 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.786 INFO:tasks.workunit.client.0.smithi163.stdout:287( 31 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.786 INFO:tasks.workunit.client.0.smithi163.stdout:288( 32 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.786 INFO:tasks.workunit.client.0.smithi163.stdout:289( 33 mod 256): COPY 0xac3c2 thru 0xb2b0f (0x674e bytes) to 0x34727 thru 0x3ae74 ******EEEE 2023-07-14T18:17:17.786 INFO:tasks.workunit.client.0.smithi163.stdout:290( 34 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.786 INFO:tasks.workunit.client.0.smithi163.stdout:291( 35 mod 256): MAPWRITE 0xb0e3a thru 0xb7127 (0x62ee bytes) 2023-07-14T18:17:17.786 INFO:tasks.workunit.client.0.smithi163.stdout:292( 36 mod 256): READ 0x6cbc9 thru 0x70ca8 (0x40e0 bytes) 2023-07-14T18:17:17.786 INFO:tasks.workunit.client.0.smithi163.stdout:293( 37 mod 256): MAPWRITE 0xbbf57 thru 0xbecf7 (0x2da1 bytes) 2023-07-14T18:17:17.786 INFO:tasks.workunit.client.0.smithi163.stdout:294( 38 mod 256): MAPWRITE 0xa860f thru 0xb402d (0xba1f bytes) 2023-07-14T18:17:17.787 INFO:tasks.workunit.client.0.smithi163.stdout:295( 39 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.787 INFO:tasks.workunit.client.0.smithi163.stdout:296( 40 mod 256): MAPWRITE 0xa1576 thru 0xaa6d4 (0x915f bytes) 2023-07-14T18:17:17.787 INFO:tasks.workunit.client.0.smithi163.stdout:297( 41 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.787 INFO:tasks.workunit.client.0.smithi163.stdout:298( 42 mod 256): MAPWRITE 0x76294 thru 0x84930 (0xe69d bytes) 2023-07-14T18:17:17.787 INFO:tasks.workunit.client.0.smithi163.stdout:299( 43 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.787 INFO:tasks.workunit.client.0.smithi163.stdout:300( 44 mod 256): COPY 0x1241 thru 0x59c6 (0x4786 bytes) to 0x7d8b thru 0xc510 2023-07-14T18:17:17.787 INFO:tasks.workunit.client.0.smithi163.stdout:301( 45 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.787 INFO:tasks.workunit.client.0.smithi163.stdout:302( 46 mod 256): WRITE 0xed4d0 thru 0xf7446 (0x9f77 bytes) EXTEND 2023-07-14T18:17:17.788 INFO:tasks.workunit.client.0.smithi163.stdout:303( 47 mod 256): WRITE 0xa85ca thru 0xb6f09 (0xe940 bytes) 2023-07-14T18:17:17.788 INFO:tasks.workunit.client.0.smithi163.stdout:304( 48 mod 256): WRITE 0x18fd9 thru 0x1e090 (0x50b8 bytes) 2023-07-14T18:17:17.788 INFO:tasks.workunit.client.0.smithi163.stdout:305( 49 mod 256): WRITE 0xe93c6 thru 0xe9757 (0x392 bytes) 2023-07-14T18:17:17.788 INFO:tasks.workunit.client.0.smithi163.stdout:306( 50 mod 256): MAPREAD 0x87960 thru 0x8ac49 (0x32ea bytes) 2023-07-14T18:17:17.788 INFO:tasks.workunit.client.0.smithi163.stdout:307( 51 mod 256): TRUNCATE DOWN from 0xf7447 to 0x21509 ******WWWW 2023-07-14T18:17:17.788 INFO:tasks.workunit.client.0.smithi163.stdout:308( 52 mod 256): FALLOC 0xcc999 thru 0xd2597 (0x5bfe bytes) PAST_EOF 2023-07-14T18:17:17.788 INFO:tasks.workunit.client.0.smithi163.stdout:309( 53 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.789 INFO:tasks.workunit.client.0.smithi163.stdout:310( 54 mod 256): READ 0x171f3 thru 0x21508 (0xa316 bytes) 2023-07-14T18:17:17.789 INFO:tasks.workunit.client.0.smithi163.stdout:311( 55 mod 256): FALLOC 0xc573a thru 0xce225 (0x8aeb bytes) PAST_EOF 2023-07-14T18:17:17.789 INFO:tasks.workunit.client.0.smithi163.stdout:312( 56 mod 256): MAPWRITE 0xf9da9 thru 0xfffff (0x6257 bytes) 2023-07-14T18:17:17.789 INFO:tasks.workunit.client.0.smithi163.stdout:313( 57 mod 256): COPY 0xfd950 thru 0xfffff (0x26b0 bytes) to 0xe86a5 thru 0xead54 2023-07-14T18:17:17.789 INFO:tasks.workunit.client.0.smithi163.stdout:314( 58 mod 256): WRITE 0xbbb8e thru 0xc95b4 (0xda27 bytes) 2023-07-14T18:17:17.789 INFO:tasks.workunit.client.0.smithi163.stdout:315( 59 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.789 INFO:tasks.workunit.client.0.smithi163.stdout:316( 60 mod 256): PUNCH 0x6dc23 thru 0x79839 (0xbc17 bytes) 2023-07-14T18:17:17.789 INFO:tasks.workunit.client.0.smithi163.stdout:317( 61 mod 256): FALLOC 0x8601b thru 0x8e166 (0x814b bytes) INTERIOR 2023-07-14T18:17:17.790 INFO:tasks.workunit.client.0.smithi163.stdout:318( 62 mod 256): COPY 0x69333 thru 0x74e89 (0xbb57 bytes) to 0x86333 thru 0x91e89 2023-07-14T18:17:17.790 INFO:tasks.workunit.client.0.smithi163.stdout:319( 63 mod 256): MAPWRITE 0x68eca thru 0x6c23d (0x3374 bytes) 2023-07-14T18:17:17.790 INFO:tasks.workunit.client.0.smithi163.stdout:320( 64 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.790 INFO:tasks.workunit.client.0.smithi163.stdout:321( 65 mod 256): PUNCH 0xd888c thru 0xe6a92 (0xe207 bytes) 2023-07-14T18:17:17.790 INFO:tasks.workunit.client.0.smithi163.stdout:322( 66 mod 256): TRUNCATE DOWN from 0x100000 to 0x13b5e ******WWWW 2023-07-14T18:17:17.790 INFO:tasks.workunit.client.0.smithi163.stdout:323( 67 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.790 INFO:tasks.workunit.client.0.smithi163.stdout:324( 68 mod 256): FALLOC 0xd525c thru 0xe20e0 (0xce84 bytes) EXTENDING 2023-07-14T18:17:17.790 INFO:tasks.workunit.client.0.smithi163.stdout:325( 69 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.791 INFO:tasks.workunit.client.0.smithi163.stdout:326( 70 mod 256): PUNCH 0x7b5de thru 0x8176e (0x6191 bytes) 2023-07-14T18:17:17.791 INFO:tasks.workunit.client.0.smithi163.stdout:327( 71 mod 256): TRUNCATE DOWN from 0xe20e0 to 0x4704f 2023-07-14T18:17:17.791 INFO:tasks.workunit.client.0.smithi163.stdout:328( 72 mod 256): COPY 0x6fb2 thru 0xc3a1 (0x53f0 bytes) to 0x35551 thru 0x3a940 ******EEEE 2023-07-14T18:17:17.791 INFO:tasks.workunit.client.0.smithi163.stdout:329( 73 mod 256): MAPREAD 0xddc4 thru 0xf813 (0x1a50 bytes) 2023-07-14T18:17:17.791 INFO:tasks.workunit.client.0.smithi163.stdout:330( 74 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.791 INFO:tasks.workunit.client.0.smithi163.stdout:331( 75 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.791 INFO:tasks.workunit.client.0.smithi163.stdout:332( 76 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.791 INFO:tasks.workunit.client.0.smithi163.stdout:333( 77 mod 256): MAPREAD 0x439a3 thru 0x4704e (0x36ac bytes) 2023-07-14T18:17:17.792 INFO:tasks.workunit.client.0.smithi163.stdout:334( 78 mod 256): MAPREAD 0x4532a thru 0x4704e (0x1d25 bytes) 2023-07-14T18:17:17.792 INFO:tasks.workunit.client.0.smithi163.stdout:335( 79 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.792 INFO:tasks.workunit.client.0.smithi163.stdout:336( 80 mod 256): FALLOC 0xd53b9 thru 0xdbe33 (0x6a7a bytes) EXTENDING 2023-07-14T18:17:17.792 INFO:tasks.workunit.client.0.smithi163.stdout:337( 81 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.792 INFO:tasks.workunit.client.0.smithi163.stdout:338( 82 mod 256): READ 0xa3a34 thru 0xa3fa7 (0x574 bytes) 2023-07-14T18:17:17.792 INFO:tasks.workunit.client.0.smithi163.stdout:339( 83 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.792 INFO:tasks.workunit.client.0.smithi163.stdout:340( 84 mod 256): TRUNCATE DOWN from 0xdbe33 to 0x99853 2023-07-14T18:17:17.792 INFO:tasks.workunit.client.0.smithi163.stdout:341( 85 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.793 INFO:tasks.workunit.client.0.smithi163.stdout:342( 86 mod 256): MAPWRITE 0x33c2d thru 0x36f53 (0x3327 bytes) 2023-07-14T18:17:17.793 INFO:tasks.workunit.client.0.smithi163.stdout:343( 87 mod 256): WRITE 0x2727c thru 0x27a0f (0x794 bytes) 2023-07-14T18:17:17.793 INFO:tasks.workunit.client.0.smithi163.stdout:344( 88 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.793 INFO:tasks.workunit.client.0.smithi163.stdout:345( 89 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.793 INFO:tasks.workunit.client.0.smithi163.stdout:346( 90 mod 256): READ 0x2f855 thru 0x36e89 (0x7635 bytes) 2023-07-14T18:17:17.793 INFO:tasks.workunit.client.0.smithi163.stdout:347( 91 mod 256): FALLOC 0xddf6 thru 0xf28b (0x1495 bytes) INTERIOR 2023-07-14T18:17:17.793 INFO:tasks.workunit.client.0.smithi163.stdout:348( 92 mod 256): COPY 0x15b88 thru 0x1a472 (0x48eb bytes) to 0x8ab8f thru 0x8f479 2023-07-14T18:17:17.793 INFO:tasks.workunit.client.0.smithi163.stdout:349( 93 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.794 INFO:tasks.workunit.client.0.smithi163.stdout:350( 94 mod 256): PUNCH 0x5a887 thru 0x63fb1 (0x972b bytes) 2023-07-14T18:17:17.794 INFO:tasks.workunit.client.0.smithi163.stdout:351( 95 mod 256): COPY 0x996bc thru 0x99852 (0x197 bytes) to 0xf7d2d thru 0xf7ec3 2023-07-14T18:17:17.794 INFO:tasks.workunit.client.0.smithi163.stdout:352( 96 mod 256): WRITE 0x6f3ba thru 0x7794a (0x8591 bytes) 2023-07-14T18:17:17.794 INFO:tasks.workunit.client.0.smithi163.stdout:353( 97 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.794 INFO:tasks.workunit.client.0.smithi163.stdout:354( 98 mod 256): FALLOC 0xd6ef3 thru 0xe0883 (0x9990 bytes) INTERIOR 2023-07-14T18:17:17.794 INFO:tasks.workunit.client.0.smithi163.stdout:355( 99 mod 256): MAPWRITE 0x94814 thru 0x9f0e6 (0xa8d3 bytes) 2023-07-14T18:17:17.794 INFO:tasks.workunit.client.0.smithi163.stdout:356(100 mod 256): MAPREAD 0x336a8 thru 0x3f08f (0xb9e8 bytes) ***RRRR*** 2023-07-14T18:17:17.794 INFO:tasks.workunit.client.0.smithi163.stdout:357(101 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.795 INFO:tasks.workunit.client.0.smithi163.stdout:358(102 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.795 INFO:tasks.workunit.client.0.smithi163.stdout:359(103 mod 256): MAPREAD 0x7f6f thru 0xbc4d (0x3cdf bytes) 2023-07-14T18:17:17.795 INFO:tasks.workunit.client.0.smithi163.stdout:360(104 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.795 INFO:tasks.workunit.client.0.smithi163.stdout:361(105 mod 256): READ 0xf6bdd thru 0xf7ec3 (0x12e7 bytes) 2023-07-14T18:17:17.795 INFO:tasks.workunit.client.0.smithi163.stdout:362(106 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.795 INFO:tasks.workunit.client.0.smithi163.stdout:363(107 mod 256): COPY 0x8766e thru 0x8a5b8 (0x2f4b bytes) to 0xc5a12 thru 0xc895c 2023-07-14T18:17:17.795 INFO:tasks.workunit.client.0.smithi163.stdout:364(108 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.795 INFO:tasks.workunit.client.0.smithi163.stdout:365(109 mod 256): READ 0x51adb thru 0x5ecca (0xd1f0 bytes) 2023-07-14T18:17:17.796 INFO:tasks.workunit.client.0.smithi163.stdout:366(110 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.796 INFO:tasks.workunit.client.0.smithi163.stdout:367(111 mod 256): FALLOC 0x26f7e thru 0x2dc5f (0x6ce1 bytes) INTERIOR 2023-07-14T18:17:17.796 INFO:tasks.workunit.client.0.smithi163.stdout:368(112 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.796 INFO:tasks.workunit.client.0.smithi163.stdout:369(113 mod 256): MAPREAD 0xf4521 thru 0xf5a0d (0x14ed bytes) 2023-07-14T18:17:17.796 INFO:tasks.workunit.client.0.smithi163.stdout:370(114 mod 256): TRUNCATE DOWN from 0xf7ec4 to 0x68cc8 2023-07-14T18:17:17.796 INFO:tasks.workunit.client.0.smithi163.stdout:371(115 mod 256): COPY 0x4cfbd thru 0x55f22 (0x8f66 bytes) to 0xda29 thru 0x1698e 2023-07-14T18:17:17.796 INFO:tasks.workunit.client.0.smithi163.stdout:372(116 mod 256): TRUNCATE UP from 0x68cc8 to 0xf3050 2023-07-14T18:17:17.796 INFO:tasks.workunit.client.0.smithi163.stdout:373(117 mod 256): WRITE 0xb6ae8 thru 0xc0454 (0x996d bytes) 2023-07-14T18:17:17.797 INFO:tasks.workunit.client.0.smithi163.stdout:374(118 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.797 INFO:tasks.workunit.client.0.smithi163.stdout:375(119 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.797 INFO:tasks.workunit.client.0.smithi163.stdout:376(120 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.797 INFO:tasks.workunit.client.0.smithi163.stdout:377(121 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.797 INFO:tasks.workunit.client.0.smithi163.stdout:378(122 mod 256): COPY 0x386db thru 0x409ec (0x8312 bytes) to 0x9d596 thru 0xa58a7 2023-07-14T18:17:17.797 INFO:tasks.workunit.client.0.smithi163.stdout:379(123 mod 256): COPY 0xa8b26 thru 0xb2e8d (0xa368 bytes) to 0x1c7c1 thru 0x26b28 2023-07-14T18:17:17.797 INFO:tasks.workunit.client.0.smithi163.stdout:380(124 mod 256): MAPREAD 0x4cf2c thru 0x528b0 (0x5985 bytes) 2023-07-14T18:17:17.797 INFO:tasks.workunit.client.0.smithi163.stdout:381(125 mod 256): MAPWRITE 0x472ba thru 0x4e50e (0x7255 bytes) 2023-07-14T18:17:17.798 INFO:tasks.workunit.client.0.smithi163.stdout:382(126 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.798 INFO:tasks.workunit.client.0.smithi163.stdout:383(127 mod 256): PUNCH 0x7ced4 thru 0x83439 (0x6566 bytes) 2023-07-14T18:17:17.798 INFO:tasks.workunit.client.0.smithi163.stdout:384(128 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.798 INFO:tasks.workunit.client.0.smithi163.stdout:385(129 mod 256): WRITE 0x9767f thru 0xa60c3 (0xea45 bytes) 2023-07-14T18:17:17.798 INFO:tasks.workunit.client.0.smithi163.stdout:386(130 mod 256): READ 0x19f8b thru 0x2322d (0x92a3 bytes) 2023-07-14T18:17:17.798 INFO:tasks.workunit.client.0.smithi163.stdout:387(131 mod 256): PUNCH 0xded69 thru 0xea860 (0xbaf8 bytes) 2023-07-14T18:17:17.798 INFO:tasks.workunit.client.0.smithi163.stdout:388(132 mod 256): MAPWRITE 0x9a9f2 thru 0x9f505 (0x4b14 bytes) 2023-07-14T18:17:17.798 INFO:tasks.workunit.client.0.smithi163.stdout:389(133 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.799 INFO:tasks.workunit.client.0.smithi163.stdout:390(134 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.799 INFO:tasks.workunit.client.0.smithi163.stdout:391(135 mod 256): TRUNCATE DOWN from 0xf3050 to 0x406a0 2023-07-14T18:17:17.799 INFO:tasks.workunit.client.0.smithi163.stdout:392(136 mod 256): COPY 0x17240 thru 0x18cad (0x1a6e bytes) to 0xde6c8 thru 0xe0135 2023-07-14T18:17:17.799 INFO:tasks.workunit.client.0.smithi163.stdout:393(137 mod 256): TRUNCATE DOWN from 0xe0136 to 0x5af68 2023-07-14T18:17:17.799 INFO:tasks.workunit.client.0.smithi163.stdout:394(138 mod 256): READ 0x2d96b thru 0x3c0c1 (0xe757 bytes) ***RRRR*** 2023-07-14T18:17:17.799 INFO:tasks.workunit.client.0.smithi163.stdout:395(139 mod 256): TRUNCATE DOWN from 0x5af68 to 0x26c17 ******WWWW 2023-07-14T18:17:17.799 INFO:tasks.workunit.client.0.smithi163.stdout:396(140 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.799 INFO:tasks.workunit.client.0.smithi163.stdout:397(141 mod 256): MAPWRITE 0x65bcc thru 0x6937c (0x37b1 bytes) 2023-07-14T18:17:17.800 INFO:tasks.workunit.client.0.smithi163.stdout:398(142 mod 256): WRITE 0xcd40f thru 0xdc502 (0xf0f4 bytes) HOLE 2023-07-14T18:17:17.800 INFO:tasks.workunit.client.0.smithi163.stdout:399(143 mod 256): WRITE 0xdae48 thru 0xe11ef (0x63a8 bytes) EXTEND 2023-07-14T18:17:17.800 INFO:tasks.workunit.client.0.smithi163.stdout:400(144 mod 256): COPY 0x79ec7 thru 0x7e98f (0x4ac9 bytes) to 0xeecd2 thru 0xf379a 2023-07-14T18:17:17.800 INFO:tasks.workunit.client.0.smithi163.stdout:401(145 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.800 INFO:tasks.workunit.client.0.smithi163.stdout:402(146 mod 256): COPY 0x3df6c thru 0x46bb4 (0x8c49 bytes) to 0xbc906 thru 0xc554e 2023-07-14T18:17:17.800 INFO:tasks.workunit.client.0.smithi163.stdout:403(147 mod 256): MAPREAD 0x359ea thru 0x3f400 (0x9a17 bytes) ***RRRR*** 2023-07-14T18:17:17.800 INFO:tasks.workunit.client.0.smithi163.stdout:404(148 mod 256): FALLOC 0xb9819 thru 0xbe956 (0x513d bytes) INTERIOR 2023-07-14T18:17:17.800 INFO:tasks.workunit.client.0.smithi163.stdout:405(149 mod 256): READ 0x3e0c9 thru 0x48fef (0xaf27 bytes) 2023-07-14T18:17:17.801 INFO:tasks.workunit.client.0.smithi163.stdout:406(150 mod 256): WRITE 0xde67d thru 0xe2cf2 (0x4676 bytes) 2023-07-14T18:17:17.801 INFO:tasks.workunit.client.0.smithi163.stdout:407(151 mod 256): COPY 0xb46da thru 0xc28a8 (0xe1cf bytes) to 0x9d9b thru 0x17f69 2023-07-14T18:17:17.801 INFO:tasks.workunit.client.0.smithi163.stdout:408(152 mod 256): COPY 0x67a8f thru 0x75ed9 (0xe44b bytes) to 0xf0f4d thru 0xff397 2023-07-14T18:17:17.801 INFO:tasks.workunit.client.0.smithi163.stdout:409(153 mod 256): FALLOC 0x10759 thru 0x1ea6f (0xe316 bytes) INTERIOR 2023-07-14T18:17:17.801 INFO:tasks.workunit.client.0.smithi163.stdout:410(154 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.801 INFO:tasks.workunit.client.0.smithi163.stdout:411(155 mod 256): READ 0x4dc33 thru 0x5d5b9 (0xf987 bytes) 2023-07-14T18:17:17.801 INFO:tasks.workunit.client.0.smithi163.stdout:412(156 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.801 INFO:tasks.workunit.client.0.smithi163.stdout:413(157 mod 256): COPY 0xbeddb thru 0xbf462 (0x688 bytes) to 0xefae2 thru 0xf0169 2023-07-14T18:17:17.802 INFO:tasks.workunit.client.0.smithi163.stdout:414(158 mod 256): MAPREAD 0x6faee thru 0x7de97 (0xe3aa bytes) 2023-07-14T18:17:17.802 INFO:tasks.workunit.client.0.smithi163.stdout:415(159 mod 256): WRITE 0xe941 thru 0x1c82d (0xdeed bytes) 2023-07-14T18:17:17.802 INFO:tasks.workunit.client.0.smithi163.stdout:416(160 mod 256): TRUNCATE DOWN from 0xff398 to 0x6636b 2023-07-14T18:17:17.802 INFO:tasks.workunit.client.0.smithi163.stdout:417(161 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.802 INFO:tasks.workunit.client.0.smithi163.stdout:418(162 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.802 INFO:tasks.workunit.client.0.smithi163.stdout:419(163 mod 256): MAPWRITE 0x52d16 thru 0x57642 (0x492d bytes) 2023-07-14T18:17:17.802 INFO:tasks.workunit.client.0.smithi163.stdout:420(164 mod 256): PUNCH 0x62f9 thru 0xe56f (0x8277 bytes) 2023-07-14T18:17:17.802 INFO:tasks.workunit.client.0.smithi163.stdout:421(165 mod 256): FALLOC 0x22c34 thru 0x3029d (0xd669 bytes) INTERIOR 2023-07-14T18:17:17.803 INFO:tasks.workunit.client.0.smithi163.stdout:422(166 mod 256): COPY 0x55975 thru 0x63ac0 (0xe14c bytes) to 0x77d3f thru 0x85e8a 2023-07-14T18:17:17.803 INFO:tasks.workunit.client.0.smithi163.stdout:423(167 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.803 INFO:tasks.workunit.client.0.smithi163.stdout:424(168 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.803 INFO:tasks.workunit.client.0.smithi163.stdout:425(169 mod 256): TRUNCATE DOWN from 0x85e8b to 0x2054f ******WWWW 2023-07-14T18:17:17.803 INFO:tasks.workunit.client.0.smithi163.stdout:426(170 mod 256): WRITE 0x27dbf thru 0x2b411 (0x3653 bytes) HOLE 2023-07-14T18:17:17.803 INFO:tasks.workunit.client.0.smithi163.stdout:427(171 mod 256): FALLOC 0x801fc thru 0x83b43 (0x3947 bytes) EXTENDING 2023-07-14T18:17:17.803 INFO:tasks.workunit.client.0.smithi163.stdout:428(172 mod 256): PUNCH 0x5a7b5 thru 0x5f0e1 (0x492d bytes) 2023-07-14T18:17:17.803 INFO:tasks.workunit.client.0.smithi163.stdout:429(173 mod 256): MAPREAD 0x20f11 thru 0x280f3 (0x71e3 bytes) 2023-07-14T18:17:17.804 INFO:tasks.workunit.client.0.smithi163.stdout:430(174 mod 256): READ 0x2e432 thru 0x39e80 (0xba4f bytes) ***RRRR*** 2023-07-14T18:17:17.804 INFO:tasks.workunit.client.0.smithi163.stdout:431(175 mod 256): READ 0x6f4bd thru 0x790ed (0x9c31 bytes) 2023-07-14T18:17:17.804 INFO:tasks.workunit.client.0.smithi163.stdout:432(176 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.804 INFO:tasks.workunit.client.0.smithi163.stdout:433(177 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.804 INFO:tasks.workunit.client.0.smithi163.stdout:434(178 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.804 INFO:tasks.workunit.client.0.smithi163.stdout:435(179 mod 256): PUNCH 0x4a183 thru 0x57b7a (0xd9f8 bytes) 2023-07-14T18:17:17.804 INFO:tasks.workunit.client.0.smithi163.stdout:436(180 mod 256): MAPWRITE 0xcec26 thru 0xd208c (0x3467 bytes) 2023-07-14T18:17:17.805 INFO:tasks.workunit.client.0.smithi163.stdout:437(181 mod 256): PUNCH 0x746c8 thru 0x78d1c (0x4655 bytes) 2023-07-14T18:17:17.805 INFO:tasks.workunit.client.0.smithi163.stdout:438(182 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.805 INFO:tasks.workunit.client.0.smithi163.stdout:439(183 mod 256): MAPREAD 0x1781 thru 0xbe75 (0xa6f5 bytes) 2023-07-14T18:17:17.805 INFO:tasks.workunit.client.0.smithi163.stdout:440(184 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.805 INFO:tasks.workunit.client.0.smithi163.stdout:441(185 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.805 INFO:tasks.workunit.client.0.smithi163.stdout:442(186 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.805 INFO:tasks.workunit.client.0.smithi163.stdout:443(187 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.805 INFO:tasks.workunit.client.0.smithi163.stdout:444(188 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.806 INFO:tasks.workunit.client.0.smithi163.stdout:445(189 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.806 INFO:tasks.workunit.client.0.smithi163.stdout:446(190 mod 256): COPY 0x8c739 thru 0x9781d (0xb0e5 bytes) to 0x5ed2f thru 0x69e13 2023-07-14T18:17:17.806 INFO:tasks.workunit.client.0.smithi163.stdout:447(191 mod 256): FALLOC 0x43b49 thru 0x5205e (0xe515 bytes) INTERIOR 2023-07-14T18:17:17.806 INFO:tasks.workunit.client.0.smithi163.stdout:448(192 mod 256): COPY 0x14830 thru 0x1be6b (0x763c bytes) to 0xb4832 thru 0xbbe6d 2023-07-14T18:17:17.806 INFO:tasks.workunit.client.0.smithi163.stdout:449(193 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.806 INFO:tasks.workunit.client.0.smithi163.stdout:450(194 mod 256): MAPWRITE 0xed48d thru 0xf9e5f (0xc9d3 bytes) 2023-07-14T18:17:17.806 INFO:tasks.workunit.client.0.smithi163.stdout:451(195 mod 256): FALLOC 0xf95e1 thru 0x100000 (0x6a1f bytes) PAST_EOF 2023-07-14T18:17:17.806 INFO:tasks.workunit.client.0.smithi163.stdout:452(196 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.807 INFO:tasks.workunit.client.0.smithi163.stdout:453(197 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.807 INFO:tasks.workunit.client.0.smithi163.stdout:454(198 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.807 INFO:tasks.workunit.client.0.smithi163.stdout:455(199 mod 256): COPY 0xdc76b thru 0xe0749 (0x3fdf bytes) to 0xbee06 thru 0xc2de4 2023-07-14T18:17:17.807 INFO:tasks.workunit.client.0.smithi163.stdout:456(200 mod 256): MAPREAD 0xf7379 thru 0xf9e5f (0x2ae7 bytes) 2023-07-14T18:17:17.807 INFO:tasks.workunit.client.0.smithi163.stdout:457(201 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.807 INFO:tasks.workunit.client.0.smithi163.stdout:458(202 mod 256): TRUNCATE DOWN from 0xf9e60 to 0xaaffc 2023-07-14T18:17:17.807 INFO:tasks.workunit.client.0.smithi163.stdout:459(203 mod 256): COPY 0x71e88 thru 0x7add0 (0x8f49 bytes) to 0xc8b4c thru 0xd1a94 2023-07-14T18:17:17.807 INFO:tasks.workunit.client.0.smithi163.stdout:460(204 mod 256): MAPWRITE 0x2fe6a thru 0x31d95 (0x1f2c bytes) 2023-07-14T18:17:17.808 INFO:tasks.workunit.client.0.smithi163.stdout:461(205 mod 256): MAPREAD 0x8d1e1 thru 0x9139e (0x41be bytes) 2023-07-14T18:17:17.808 INFO:tasks.workunit.client.0.smithi163.stdout:462(206 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.808 INFO:tasks.workunit.client.0.smithi163.stdout:463(207 mod 256): MAPWRITE 0xee88c thru 0xf442c (0x5ba1 bytes) 2023-07-14T18:17:17.808 INFO:tasks.workunit.client.0.smithi163.stdout:464(208 mod 256): COPY 0xafcf7 thru 0xbd959 (0xdc63 bytes) to 0x3d78d thru 0x4b3ef 2023-07-14T18:17:17.808 INFO:tasks.workunit.client.0.smithi163.stdout:465(209 mod 256): READ 0x66efa thru 0x6d20b (0x6312 bytes) 2023-07-14T18:17:17.808 INFO:tasks.workunit.client.0.smithi163.stdout:466(210 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.808 INFO:tasks.workunit.client.0.smithi163.stdout:467(211 mod 256): READ 0xe204d thru 0xef9b3 (0xd967 bytes) 2023-07-14T18:17:17.808 INFO:tasks.workunit.client.0.smithi163.stdout:468(212 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.809 INFO:tasks.workunit.client.0.smithi163.stdout:469(213 mod 256): PUNCH 0x873ae thru 0x875ac (0x1ff bytes) 2023-07-14T18:17:17.809 INFO:tasks.workunit.client.0.smithi163.stdout:470(214 mod 256): COPY 0x2a41f thru 0x2ed88 (0x496a bytes) to 0x70583 thru 0x74eec 2023-07-14T18:17:17.809 INFO:tasks.workunit.client.0.smithi163.stdout:471(215 mod 256): FALLOC 0x37bf7 thru 0x3b750 (0x3b59 bytes) INTERIOR ******FFFF 2023-07-14T18:17:17.809 INFO:tasks.workunit.client.0.smithi163.stdout:472(216 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.809 INFO:tasks.workunit.client.0.smithi163.stdout:473(217 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.809 INFO:tasks.workunit.client.0.smithi163.stdout:474(218 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.809 INFO:tasks.workunit.client.0.smithi163.stdout:475(219 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.809 INFO:tasks.workunit.client.0.smithi163.stdout:476(220 mod 256): MAPWRITE 0xf33eb thru 0xf4e79 (0x1a8f bytes) 2023-07-14T18:17:17.810 INFO:tasks.workunit.client.0.smithi163.stdout:477(221 mod 256): MAPREAD 0x92aba thru 0x96727 (0x3c6e bytes) 2023-07-14T18:17:17.810 INFO:tasks.workunit.client.0.smithi163.stdout:478(222 mod 256): READ 0xf2193 thru 0xf4e79 (0x2ce7 bytes) 2023-07-14T18:17:17.810 INFO:tasks.workunit.client.0.smithi163.stdout:479(223 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.810 INFO:tasks.workunit.client.0.smithi163.stdout:480(224 mod 256): PUNCH 0xed378 thru 0xf3580 (0x6209 bytes) 2023-07-14T18:17:17.810 INFO:tasks.workunit.client.0.smithi163.stdout:481(225 mod 256): MAPWRITE 0xaf211 thru 0xb628e (0x707e bytes) 2023-07-14T18:17:17.810 INFO:tasks.workunit.client.0.smithi163.stdout:482(226 mod 256): MAPWRITE 0xc348b thru 0xce22d (0xada3 bytes) 2023-07-14T18:17:17.810 INFO:tasks.workunit.client.0.smithi163.stdout:483(227 mod 256): WRITE 0xd4c7f thru 0xdb9d2 (0x6d54 bytes) 2023-07-14T18:17:17.810 INFO:tasks.workunit.client.0.smithi163.stdout:484(228 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.811 INFO:tasks.workunit.client.0.smithi163.stdout:485(229 mod 256): WRITE 0xdaec4 thru 0xe4aa9 (0x9be6 bytes) 2023-07-14T18:17:17.811 INFO:tasks.workunit.client.0.smithi163.stdout:486(230 mod 256): PUNCH 0x11347 thru 0x1503a (0x3cf4 bytes) 2023-07-14T18:17:17.811 INFO:tasks.workunit.client.0.smithi163.stdout:487(231 mod 256): FALLOC 0x189f3 thru 0x23a38 (0xb045 bytes) INTERIOR 2023-07-14T18:17:17.811 INFO:tasks.workunit.client.0.smithi163.stdout:488(232 mod 256): COPY 0xface thru 0x1b7c0 (0xbcf3 bytes) to 0xb205f thru 0xbdd51 2023-07-14T18:17:17.811 INFO:tasks.workunit.client.0.smithi163.stdout:489(233 mod 256): MAPWRITE 0xc9d1b thru 0xcb14a (0x1430 bytes) 2023-07-14T18:17:17.811 INFO:tasks.workunit.client.0.smithi163.stdout:490(234 mod 256): MAPWRITE 0x2695f thru 0x280af (0x1751 bytes) 2023-07-14T18:17:17.811 INFO:tasks.workunit.client.0.smithi163.stdout:491(235 mod 256): FALLOC 0x9eb31 thru 0xa031e (0x17ed bytes) INTERIOR 2023-07-14T18:17:17.811 INFO:tasks.workunit.client.0.smithi163.stdout:492(236 mod 256): FALLOC 0x7bb9a thru 0x88705 (0xcb6b bytes) INTERIOR 2023-07-14T18:17:17.812 INFO:tasks.workunit.client.0.smithi163.stdout:493(237 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.812 INFO:tasks.workunit.client.0.smithi163.stdout:494(238 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.812 INFO:tasks.workunit.client.0.smithi163.stdout:495(239 mod 256): PUNCH 0xecb5e thru 0xf2aa1 (0x5f44 bytes) 2023-07-14T18:17:17.812 INFO:tasks.workunit.client.0.smithi163.stdout:496(240 mod 256): COPY 0x2ce4f thru 0x37824 (0xa9d6 bytes) to 0x3a811 thru 0x451e6 2023-07-14T18:17:17.812 INFO:tasks.workunit.client.0.smithi163.stdout:497(241 mod 256): FALLOC 0xcf219 thru 0xd8108 (0x8eef bytes) INTERIOR 2023-07-14T18:17:17.812 INFO:tasks.workunit.client.0.smithi163.stdout:498(242 mod 256): READ 0x34822 thru 0x3f62e (0xae0d bytes) ***RRRR*** 2023-07-14T18:17:17.812 INFO:tasks.workunit.client.0.smithi163.stdout:499(243 mod 256): MAPREAD 0xd300d thru 0xe045e (0xd452 bytes) 2023-07-14T18:17:17.812 INFO:tasks.workunit.client.0.smithi163.stdout:500(244 mod 256): PUNCH 0x9d7dd thru 0xa7cdc (0xa500 bytes) 2023-07-14T18:17:17.813 INFO:tasks.workunit.client.0.smithi163.stdout:501(245 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.813 INFO:tasks.workunit.client.0.smithi163.stdout:502(246 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.813 INFO:tasks.workunit.client.0.smithi163.stdout:503(247 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.813 INFO:tasks.workunit.client.0.smithi163.stdout:504(248 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.813 INFO:tasks.workunit.client.0.smithi163.stdout:505(249 mod 256): MAPWRITE 0xf242d thru 0xf5b6b (0x373f bytes) 2023-07-14T18:17:17.813 INFO:tasks.workunit.client.0.smithi163.stdout:506(250 mod 256): PUNCH 0x186bb thru 0x19c14 (0x155a bytes) 2023-07-14T18:17:17.813 INFO:tasks.workunit.client.0.smithi163.stdout:507(251 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.813 INFO:tasks.workunit.client.0.smithi163.stdout:508(252 mod 256): MAPREAD 0x6063 thru 0xe111 (0x80af bytes) 2023-07-14T18:17:17.814 INFO:tasks.workunit.client.0.smithi163.stdout:509(253 mod 256): TRUNCATE DOWN from 0xf5b6c to 0x42189 2023-07-14T18:17:17.814 INFO:tasks.workunit.client.0.smithi163.stdout:510(254 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.814 INFO:tasks.workunit.client.0.smithi163.stdout:511(255 mod 256): TRUNCATE UP from 0x42189 to 0xc81aa 2023-07-14T18:17:17.814 INFO:tasks.workunit.client.0.smithi163.stdout:512( 0 mod 256): WRITE 0xb5390 thru 0xbef3e (0x9baf bytes) 2023-07-14T18:17:17.814 INFO:tasks.workunit.client.0.smithi163.stdout:513( 1 mod 256): WRITE 0x15b4d thru 0x239bf (0xde73 bytes) 2023-07-14T18:17:17.814 INFO:tasks.workunit.client.0.smithi163.stdout:514( 2 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.814 INFO:tasks.workunit.client.0.smithi163.stdout:515( 3 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.814 INFO:tasks.workunit.client.0.smithi163.stdout:516( 4 mod 256): MAPREAD 0x3abc7 thru 0x3e641 (0x3a7b bytes) 2023-07-14T18:17:17.815 INFO:tasks.workunit.client.0.smithi163.stdout:517( 5 mod 256): FALLOC 0x862b5 thru 0x8e050 (0x7d9b bytes) INTERIOR 2023-07-14T18:17:17.815 INFO:tasks.workunit.client.0.smithi163.stdout:518( 6 mod 256): READ 0xaad3d thru 0xb87b1 (0xda75 bytes) 2023-07-14T18:17:17.815 INFO:tasks.workunit.client.0.smithi163.stdout:519( 7 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.815 INFO:tasks.workunit.client.0.smithi163.stdout:520( 8 mod 256): MAPREAD 0x5adc6 thru 0x5c9d9 (0x1c14 bytes) 2023-07-14T18:17:17.815 INFO:tasks.workunit.client.0.smithi163.stdout:521( 9 mod 256): READ 0xb3e0 thru 0xf33a (0x3f5b bytes) 2023-07-14T18:17:17.815 INFO:tasks.workunit.client.0.smithi163.stdout:522( 10 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.815 INFO:tasks.workunit.client.0.smithi163.stdout:523( 11 mod 256): PUNCH 0x87bf3 thru 0x8868e (0xa9c bytes) 2023-07-14T18:17:17.815 INFO:tasks.workunit.client.0.smithi163.stdout:524( 12 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.816 INFO:tasks.workunit.client.0.smithi163.stdout:525( 13 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.816 INFO:tasks.workunit.client.0.smithi163.stdout:526( 14 mod 256): TRUNCATE DOWN from 0xc81aa to 0x5874e 2023-07-14T18:17:17.816 INFO:tasks.workunit.client.0.smithi163.stdout:527( 15 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.816 INFO:tasks.workunit.client.0.smithi163.stdout:528( 16 mod 256): WRITE 0xbc78c thru 0xc81ad (0xba22 bytes) HOLE 2023-07-14T18:17:17.816 INFO:tasks.workunit.client.0.smithi163.stdout:529( 17 mod 256): COPY 0xc2a41 thru 0xc81ad (0x576d bytes) to 0x7fe9b thru 0x85607 2023-07-14T18:17:17.816 INFO:tasks.workunit.client.0.smithi163.stdout:530( 18 mod 256): MAPREAD 0x204e0 thru 0x2678f (0x62b0 bytes) 2023-07-14T18:17:17.816 INFO:tasks.workunit.client.0.smithi163.stdout:531( 19 mod 256): READ 0xb6343 thru 0xc2bc4 (0xc882 bytes) 2023-07-14T18:17:17.816 INFO:tasks.workunit.client.0.smithi163.stdout:532( 20 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.817 INFO:tasks.workunit.client.0.smithi163.stdout:533( 21 mod 256): FALLOC 0x280c7 thru 0x359e8 (0xd921 bytes) INTERIOR 2023-07-14T18:17:17.817 INFO:tasks.workunit.client.0.smithi163.stdout:534( 22 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.817 INFO:tasks.workunit.client.0.smithi163.stdout:535( 23 mod 256): FALLOC 0xefb1a thru 0xfd6b3 (0xdb99 bytes) PAST_EOF 2023-07-14T18:17:17.817 INFO:tasks.workunit.client.0.smithi163.stdout:536( 24 mod 256): MAPREAD 0x23e19 thru 0x2f403 (0xb5eb bytes) 2023-07-14T18:17:17.817 INFO:tasks.workunit.client.0.smithi163.stdout:537( 25 mod 256): FALLOC 0x36c5d thru 0x3d590 (0x6933 bytes) INTERIOR ******FFFF 2023-07-14T18:17:17.817 INFO:tasks.workunit.client.0.smithi163.stdout:538( 26 mod 256): MAPREAD 0x660c7 thru 0x6b0cd (0x5007 bytes) 2023-07-14T18:17:17.817 INFO:tasks.workunit.client.0.smithi163.stdout:539( 27 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.817 INFO:tasks.workunit.client.0.smithi163.stdout:540( 28 mod 256): COPY 0x6719d thru 0x70fa4 (0x9e08 bytes) to 0x15402 thru 0x1f209 2023-07-14T18:17:17.818 INFO:tasks.workunit.client.0.smithi163.stdout:541( 29 mod 256): MAPWRITE 0x40ee5 thru 0x4d2af (0xc3cb bytes) 2023-07-14T18:17:17.818 INFO:tasks.workunit.client.0.smithi163.stdout:542( 30 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.818 INFO:tasks.workunit.client.0.smithi163.stdout:543( 31 mod 256): COPY 0x2f846 thru 0x315ed (0x1da8 bytes) to 0xde729 thru 0xe04d0 2023-07-14T18:17:17.818 INFO:tasks.workunit.client.0.smithi163.stdout:544( 32 mod 256): MAPWRITE 0x6f08c thru 0x6fba5 (0xb1a bytes) 2023-07-14T18:17:17.818 INFO:tasks.workunit.client.0.smithi163.stdout:545( 33 mod 256): COPY 0xcca27 thru 0xda05b (0xd635 bytes) to 0x672f7 thru 0x7492b 2023-07-14T18:17:17.818 INFO:tasks.workunit.client.0.smithi163.stdout:546( 34 mod 256): FALLOC 0x117eb thru 0x13bcf (0x23e4 bytes) INTERIOR 2023-07-14T18:17:17.818 INFO:tasks.workunit.client.0.smithi163.stdout:547( 35 mod 256): MAPREAD 0x80d75 thru 0x826b6 (0x1942 bytes) 2023-07-14T18:17:17.818 INFO:tasks.workunit.client.0.smithi163.stdout:548( 36 mod 256): WRITE 0x22d2c thru 0x2893e (0x5c13 bytes) 2023-07-14T18:17:17.819 INFO:tasks.workunit.client.0.smithi163.stdout:549( 37 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.819 INFO:tasks.workunit.client.0.smithi163.stdout:550( 38 mod 256): COPY 0x9089a thru 0x9d7aa (0xcf11 bytes) to 0xed75 thru 0x1bc85 2023-07-14T18:17:17.819 INFO:tasks.workunit.client.0.smithi163.stdout:551( 39 mod 256): TRUNCATE DOWN from 0xe04d1 to 0x5d198 2023-07-14T18:17:17.819 INFO:tasks.workunit.client.0.smithi163.stdout:552( 40 mod 256): WRITE 0x7a306 thru 0x7eaa1 (0x479c bytes) HOLE 2023-07-14T18:17:17.819 INFO:tasks.workunit.client.0.smithi163.stdout:553( 41 mod 256): READ 0x52ada thru 0x61736 (0xec5d bytes) 2023-07-14T18:17:17.819 INFO:tasks.workunit.client.0.smithi163.stdout:554( 42 mod 256): WRITE 0x2bae5 thru 0x36463 (0xa97f bytes) 2023-07-14T18:17:17.819 INFO:tasks.workunit.client.0.smithi163.stdout:555( 43 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.819 INFO:tasks.workunit.client.0.smithi163.stdout:556( 44 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.820 INFO:tasks.workunit.client.0.smithi163.stdout:557( 45 mod 256): TRUNCATE DOWN from 0x7eaa2 to 0x236e5 ******WWWW 2023-07-14T18:17:17.820 INFO:tasks.workunit.client.0.smithi163.stdout:558( 46 mod 256): TRUNCATE DOWN from 0x236e5 to 0x6528 2023-07-14T18:17:17.820 INFO:tasks.workunit.client.0.smithi163.stdout:559( 47 mod 256): TRUNCATE UP from 0x6528 to 0x813c9 ******WWWW 2023-07-14T18:17:17.820 INFO:tasks.workunit.client.0.smithi163.stdout:560( 48 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.820 INFO:tasks.workunit.client.0.smithi163.stdout:561( 49 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.820 INFO:tasks.workunit.client.0.smithi163.stdout:562( 50 mod 256): MAPREAD 0x5f157 thru 0x610e7 (0x1f91 bytes) 2023-07-14T18:17:17.820 INFO:tasks.workunit.client.0.smithi163.stdout:563( 51 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.820 INFO:tasks.workunit.client.0.smithi163.stdout:564( 52 mod 256): TRUNCATE UP from 0x813c9 to 0x98497 2023-07-14T18:17:17.821 INFO:tasks.workunit.client.0.smithi163.stdout:565( 53 mod 256): WRITE 0x5c0f6 thru 0x5cba1 (0xaac bytes) 2023-07-14T18:17:17.821 INFO:tasks.workunit.client.0.smithi163.stdout:566( 54 mod 256): WRITE 0xffa64 thru 0xfffff (0x59c bytes) HOLE 2023-07-14T18:17:17.821 INFO:tasks.workunit.client.0.smithi163.stdout:567( 55 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.821 INFO:tasks.workunit.client.0.smithi163.stdout:568( 56 mod 256): MAPREAD 0x3ccf2 thru 0x48566 (0xb875 bytes) 2023-07-14T18:17:17.821 INFO:tasks.workunit.client.0.smithi163.stdout:569( 57 mod 256): COPY 0x33a29 thru 0x42b2d (0xf105 bytes) to 0xebdf0 thru 0xfaef4 EEEE****** 2023-07-14T18:17:17.821 INFO:tasks.workunit.client.0.smithi163.stdout:570( 58 mod 256): COPY 0xd5b4a thru 0xdfd1d (0xa1d4 bytes) to 0xa250d thru 0xac6e0 2023-07-14T18:17:17.821 INFO:tasks.workunit.client.0.smithi163.stdout:571( 59 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.822 INFO:tasks.workunit.client.0.smithi163.stdout:572( 60 mod 256): MAPWRITE 0x55fc9 thru 0x575d8 (0x1610 bytes) 2023-07-14T18:17:17.822 INFO:tasks.workunit.client.0.smithi163.stdout:573( 61 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.822 INFO:tasks.workunit.client.0.smithi163.stdout:574( 62 mod 256): MAPWRITE 0x565b4 thru 0x58f94 (0x29e1 bytes) 2023-07-14T18:17:17.822 INFO:tasks.workunit.client.0.smithi163.stdout:575( 63 mod 256): PUNCH 0x99fef thru 0xa93cf (0xf3e1 bytes) 2023-07-14T18:17:17.822 INFO:tasks.workunit.client.0.smithi163.stdout:576( 64 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.822 INFO:tasks.workunit.client.0.smithi163.stdout:577( 65 mod 256): COPY 0x6c0c6 thru 0x75cb2 (0x9bed bytes) to 0x1a6c2 thru 0x242ae 2023-07-14T18:17:17.822 INFO:tasks.workunit.client.0.smithi163.stdout:578( 66 mod 256): MAPREAD 0x50cfa thru 0x53f2c (0x3233 bytes) 2023-07-14T18:17:17.822 INFO:tasks.workunit.client.0.smithi163.stdout:579( 67 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.823 INFO:tasks.workunit.client.0.smithi163.stdout:580( 68 mod 256): TRUNCATE DOWN from 0x100000 to 0xd0b2c 2023-07-14T18:17:17.823 INFO:tasks.workunit.client.0.smithi163.stdout:581( 69 mod 256): TRUNCATE DOWN from 0xd0b2c to 0x25afd ******WWWW 2023-07-14T18:17:17.823 INFO:tasks.workunit.client.0.smithi163.stdout:582( 70 mod 256): MAPREAD 0x1497f thru 0x20941 (0xbfc3 bytes) 2023-07-14T18:17:17.823 INFO:tasks.workunit.client.0.smithi163.stdout:583( 71 mod 256): READ 0x1f45e thru 0x25afc (0x669f bytes) 2023-07-14T18:17:17.823 INFO:tasks.workunit.client.0.smithi163.stdout:584( 72 mod 256): PUNCH 0xca1a thru 0x148b6 (0x7e9d bytes) 2023-07-14T18:17:17.823 INFO:tasks.workunit.client.0.smithi163.stdout:585( 73 mod 256): MAPWRITE 0xcba05 thru 0xd1b1b (0x6117 bytes) 2023-07-14T18:17:17.823 INFO:tasks.workunit.client.0.smithi163.stdout:586( 74 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.823 INFO:tasks.workunit.client.0.smithi163.stdout:587( 75 mod 256): PUNCH 0xa3347 thru 0xaa6e0 (0x739a bytes) 2023-07-14T18:17:17.824 INFO:tasks.workunit.client.0.smithi163.stdout:588( 76 mod 256): MAPREAD 0x51c9d thru 0x5d9bc (0xbd20 bytes) 2023-07-14T18:17:17.824 INFO:tasks.workunit.client.0.smithi163.stdout:589( 77 mod 256): READ 0x2216b thru 0x2da90 (0xb926 bytes) 2023-07-14T18:17:17.824 INFO:tasks.workunit.client.0.smithi163.stdout:590( 78 mod 256): WRITE 0x8cfbc thru 0x964a6 (0x94eb bytes) 2023-07-14T18:17:17.824 INFO:tasks.workunit.client.0.smithi163.stdout:591( 79 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.824 INFO:tasks.workunit.client.0.smithi163.stdout:592( 80 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.824 INFO:tasks.workunit.client.0.smithi163.stdout:593( 81 mod 256): READ 0xb5b52 thru 0xc3452 (0xd901 bytes) 2023-07-14T18:17:17.824 INFO:tasks.workunit.client.0.smithi163.stdout:594( 82 mod 256): TRUNCATE DOWN from 0xd1b1c to 0x4b3f7 2023-07-14T18:17:17.825 INFO:tasks.workunit.client.0.smithi163.stdout:595( 83 mod 256): TRUNCATE DOWN from 0x4b3f7 to 0x147ee ******WWWW 2023-07-14T18:17:17.825 INFO:tasks.workunit.client.0.smithi163.stdout:596( 84 mod 256): MAPREAD 0xe491 thru 0x147ed (0x635d bytes) 2023-07-14T18:17:17.825 INFO:tasks.workunit.client.0.smithi163.stdout:597( 85 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.825 INFO:tasks.workunit.client.0.smithi163.stdout:598( 86 mod 256): MAPREAD 0x5cc3 thru 0xf310 (0x964e bytes) 2023-07-14T18:17:17.825 INFO:tasks.workunit.client.0.smithi163.stdout:599( 87 mod 256): COPY 0x14074 thru 0x147ed (0x77a bytes) to 0x24636 thru 0x24daf 2023-07-14T18:17:17.825 INFO:tasks.workunit.client.0.smithi163.stdout:600( 88 mod 256): PUNCH 0xbad0 thru 0x11ba1 (0x60d2 bytes) 2023-07-14T18:17:17.825 INFO:tasks.workunit.client.0.smithi163.stdout:601( 89 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.825 INFO:tasks.workunit.client.0.smithi163.stdout:602( 90 mod 256): MAPWRITE 0x29c77 thru 0x37ea8 (0xe232 bytes) 2023-07-14T18:17:17.826 INFO:tasks.workunit.client.0.smithi163.stdout:603( 91 mod 256): MAPWRITE 0x4bf82 thru 0x54366 (0x83e5 bytes) 2023-07-14T18:17:17.826 INFO:tasks.workunit.client.0.smithi163.stdout:604( 92 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.826 INFO:tasks.workunit.client.0.smithi163.stdout:605( 93 mod 256): READ 0x20a20 thru 0x2c4f7 (0xbad8 bytes) 2023-07-14T18:17:17.826 INFO:tasks.workunit.client.0.smithi163.stdout:606( 94 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.826 INFO:tasks.workunit.client.0.smithi163.stdout:607( 95 mod 256): FALLOC 0xdd764 thru 0xe48cf (0x716b bytes) PAST_EOF 2023-07-14T18:17:17.826 INFO:tasks.workunit.client.0.smithi163.stdout:608( 96 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.826 INFO:tasks.workunit.client.0.smithi163.stdout:609( 97 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.826 INFO:tasks.workunit.client.0.smithi163.stdout:610( 98 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.827 INFO:tasks.workunit.client.0.smithi163.stdout:611( 99 mod 256): MAPREAD 0x3dfc0 thru 0x472b0 (0x92f1 bytes) 2023-07-14T18:17:17.827 INFO:tasks.workunit.client.0.smithi163.stdout:612(100 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.827 INFO:tasks.workunit.client.0.smithi163.stdout:613(101 mod 256): FALLOC 0xa64f1 thru 0xa7ae7 (0x15f6 bytes) PAST_EOF 2023-07-14T18:17:17.827 INFO:tasks.workunit.client.0.smithi163.stdout:614(102 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.827 INFO:tasks.workunit.client.0.smithi163.stdout:615(103 mod 256): MAPREAD 0x26705 thru 0x2ffdd (0x98d9 bytes) 2023-07-14T18:17:17.827 INFO:tasks.workunit.client.0.smithi163.stdout:616(104 mod 256): TRUNCATE UP from 0x54367 to 0xcba65 2023-07-14T18:17:17.827 INFO:tasks.workunit.client.0.smithi163.stdout:617(105 mod 256): FALLOC 0xd6b7e thru 0xe0f5c (0xa3de bytes) EXTENDING 2023-07-14T18:17:17.827 INFO:tasks.workunit.client.0.smithi163.stdout:618(106 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.828 INFO:tasks.workunit.client.0.smithi163.stdout:619(107 mod 256): FALLOC 0x33cbf thru 0x41c95 (0xdfd6 bytes) INTERIOR ******FFFF 2023-07-14T18:17:17.828 INFO:tasks.workunit.client.0.smithi163.stdout:620(108 mod 256): FALLOC 0x368d thru 0xe101 (0xaa74 bytes) INTERIOR 2023-07-14T18:17:17.828 INFO:tasks.workunit.client.0.smithi163.stdout:621(109 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.828 INFO:tasks.workunit.client.0.smithi163.stdout:622(110 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.828 INFO:tasks.workunit.client.0.smithi163.stdout:623(111 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.828 INFO:tasks.workunit.client.0.smithi163.stdout:624(112 mod 256): FALLOC 0xf9984 thru 0xfe934 (0x4fb0 bytes) EXTENDING 2023-07-14T18:17:17.828 INFO:tasks.workunit.client.0.smithi163.stdout:625(113 mod 256): READ 0xce08 thru 0x135a7 (0x67a0 bytes) 2023-07-14T18:17:17.828 INFO:tasks.workunit.client.0.smithi163.stdout:626(114 mod 256): COPY 0x995d6 thru 0x9bccf (0x26fa bytes) to 0x68c85 thru 0x6b37e 2023-07-14T18:17:17.829 INFO:tasks.workunit.client.0.smithi163.stdout:627(115 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.829 INFO:tasks.workunit.client.0.smithi163.stdout:628(116 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.829 INFO:tasks.workunit.client.0.smithi163.stdout:629(117 mod 256): COPY 0x5d41d thru 0x6c436 (0xf01a bytes) to 0x17c67 thru 0x26c80 2023-07-14T18:17:17.829 INFO:tasks.workunit.client.0.smithi163.stdout:630(118 mod 256): MAPREAD 0xacf50 thru 0xb2cee (0x5d9f bytes) 2023-07-14T18:17:17.829 INFO:tasks.workunit.client.0.smithi163.stdout:631(119 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.829 INFO:tasks.workunit.client.0.smithi163.stdout:632(120 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.829 INFO:tasks.workunit.client.0.smithi163.stdout:633(121 mod 256): MAPREAD 0xb6c7f thru 0xbb4de (0x4860 bytes) 2023-07-14T18:17:17.829 INFO:tasks.workunit.client.0.smithi163.stdout:634(122 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.830 INFO:tasks.workunit.client.0.smithi163.stdout:635(123 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.830 INFO:tasks.workunit.client.0.smithi163.stdout:636(124 mod 256): WRITE 0x38249 thru 0x412d3 (0x908b bytes) 2023-07-14T18:17:17.830 INFO:tasks.workunit.client.0.smithi163.stdout:637(125 mod 256): MAPWRITE 0xd761c thru 0xdb0bb (0x3aa0 bytes) 2023-07-14T18:17:17.830 INFO:tasks.workunit.client.0.smithi163.stdout:638(126 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.830 INFO:tasks.workunit.client.0.smithi163.stdout:639(127 mod 256): MAPREAD 0xbc5d thru 0x1b28a (0xf62e bytes) 2023-07-14T18:17:17.830 INFO:tasks.workunit.client.0.smithi163.stdout:640(128 mod 256): MAPWRITE 0x226f3 thru 0x22bff (0x50d bytes) 2023-07-14T18:17:17.830 INFO:tasks.workunit.client.0.smithi163.stdout:641(129 mod 256): MAPWRITE 0xa4a1a thru 0xae4a4 (0x9a8b bytes) 2023-07-14T18:17:17.830 INFO:tasks.workunit.client.0.smithi163.stdout:642(130 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.831 INFO:tasks.workunit.client.0.smithi163.stdout:643(131 mod 256): WRITE 0x18be3 thru 0x1f6d0 (0x6aee bytes) 2023-07-14T18:17:17.831 INFO:tasks.workunit.client.0.smithi163.stdout:644(132 mod 256): MAPREAD 0x6452f thru 0x735ec (0xf0be bytes) 2023-07-14T18:17:17.831 INFO:tasks.workunit.client.0.smithi163.stdout:645(133 mod 256): MAPREAD 0x76235 thru 0x76e63 (0xc2f bytes) 2023-07-14T18:17:17.831 INFO:tasks.workunit.client.0.smithi163.stdout:646(134 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.831 INFO:tasks.workunit.client.0.smithi163.stdout:647(135 mod 256): FALLOC 0xed8e6 thru 0xf4263 (0x697d bytes) INTERIOR 2023-07-14T18:17:17.831 INFO:tasks.workunit.client.0.smithi163.stdout:648(136 mod 256): PUNCH 0xb68c8 thru 0xc4c9a (0xe3d3 bytes) 2023-07-14T18:17:17.831 INFO:tasks.workunit.client.0.smithi163.stdout:649(137 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.831 INFO:tasks.workunit.client.0.smithi163.stdout:650(138 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.832 INFO:tasks.workunit.client.0.smithi163.stdout:651(139 mod 256): COPY 0xf7a6a thru 0xfe933 (0x6eca bytes) to 0x312c4 thru 0x3818d 2023-07-14T18:17:17.832 INFO:tasks.workunit.client.0.smithi163.stdout:652(140 mod 256): MAPREAD 0x2bb45 thru 0x34143 (0x85ff bytes) 2023-07-14T18:17:17.832 INFO:tasks.workunit.client.0.smithi163.stdout:653(141 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.832 INFO:tasks.workunit.client.0.smithi163.stdout:654(142 mod 256): COPY 0x274bd thru 0x334ec (0xc030 bytes) to 0xce56 thru 0x18e85 2023-07-14T18:17:17.832 INFO:tasks.workunit.client.0.smithi163.stdout:655(143 mod 256): TRUNCATE DOWN from 0xfe934 to 0x2c52f ******WWWW 2023-07-14T18:17:17.832 INFO:tasks.workunit.client.0.smithi163.stdout:656(144 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.832 INFO:tasks.workunit.client.0.smithi163.stdout:657(145 mod 256): TRUNCATE UP from 0x2c52f to 0x9bb97 ******WWWW 2023-07-14T18:17:17.832 INFO:tasks.workunit.client.0.smithi163.stdout:658(146 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.833 INFO:tasks.workunit.client.0.smithi163.stdout:659(147 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.833 INFO:tasks.workunit.client.0.smithi163.stdout:660(148 mod 256): READ 0x270d4 thru 0x370bb (0xffe8 bytes) 2023-07-14T18:17:17.833 INFO:tasks.workunit.client.0.smithi163.stdout:661(149 mod 256): READ 0x804ca thru 0x8dee2 (0xda19 bytes) 2023-07-14T18:17:17.833 INFO:tasks.workunit.client.0.smithi163.stdout:662(150 mod 256): FALLOC 0x851f2 thru 0x91837 (0xc645 bytes) INTERIOR 2023-07-14T18:17:17.833 INFO:tasks.workunit.client.0.smithi163.stdout:663(151 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.833 INFO:tasks.workunit.client.0.smithi163.stdout:664(152 mod 256): MAPREAD 0x3455e thru 0x35e25 (0x18c8 bytes) 2023-07-14T18:17:17.833 INFO:tasks.workunit.client.0.smithi163.stdout:665(153 mod 256): FALLOC 0xec093 thru 0xf0dbc (0x4d29 bytes) PAST_EOF 2023-07-14T18:17:17.833 INFO:tasks.workunit.client.0.smithi163.stdout:666(154 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.834 INFO:tasks.workunit.client.0.smithi163.stdout:667(155 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.834 INFO:tasks.workunit.client.0.smithi163.stdout:668(156 mod 256): MAPREAD 0x7e3de thru 0x80aef (0x2712 bytes) 2023-07-14T18:17:17.834 INFO:tasks.workunit.client.0.smithi163.stdout:669(157 mod 256): MAPREAD 0x855d7 thru 0x90856 (0xb280 bytes) 2023-07-14T18:17:17.834 INFO:tasks.workunit.client.0.smithi163.stdout:670(158 mod 256): TRUNCATE DOWN from 0x9bb97 to 0x700af 2023-07-14T18:17:17.834 INFO:tasks.workunit.client.0.smithi163.stdout:671(159 mod 256): COPY 0x1f86d thru 0x2f582 (0xfd16 bytes) to 0x94bc1 thru 0xa48d6 2023-07-14T18:17:17.834 INFO:tasks.workunit.client.0.smithi163.stdout:672(160 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.834 INFO:tasks.workunit.client.0.smithi163.stdout:673(161 mod 256): READ 0x72139 thru 0x7493f (0x2807 bytes) 2023-07-14T18:17:17.834 INFO:tasks.workunit.client.0.smithi163.stdout:674(162 mod 256): FALLOC 0x9c737 thru 0x9cb9a (0x463 bytes) INTERIOR 2023-07-14T18:17:17.835 INFO:tasks.workunit.client.0.smithi163.stdout:675(163 mod 256): PUNCH 0x2c26e thru 0x36df4 (0xab87 bytes) 2023-07-14T18:17:17.835 INFO:tasks.workunit.client.0.smithi163.stdout:676(164 mod 256): COPY 0x5c273 thru 0x664c4 (0xa252 bytes) to 0x955a6 thru 0x9f7f7 2023-07-14T18:17:17.835 INFO:tasks.workunit.client.0.smithi163.stdout:677(165 mod 256): MAPREAD 0x8a730 thru 0x94362 (0x9c33 bytes) 2023-07-14T18:17:17.835 INFO:tasks.workunit.client.0.smithi163.stdout:678(166 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.835 INFO:tasks.workunit.client.0.smithi163.stdout:679(167 mod 256): FALLOC 0xad73c thru 0xaf265 (0x1b29 bytes) PAST_EOF 2023-07-14T18:17:17.835 INFO:tasks.workunit.client.0.smithi163.stdout:680(168 mod 256): TRUNCATE DOWN from 0xa48d7 to 0x584a ******WWWW 2023-07-14T18:17:17.835 INFO:tasks.workunit.client.0.smithi163.stdout:681(169 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.835 INFO:tasks.workunit.client.0.smithi163.stdout:682(170 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.836 INFO:tasks.workunit.client.0.smithi163.stdout:683(171 mod 256): COPY 0x472b thru 0x5849 (0x111f bytes) to 0xa04b8 thru 0xa15d6 2023-07-14T18:17:17.836 INFO:tasks.workunit.client.0.smithi163.stdout:684(172 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.836 INFO:tasks.workunit.client.0.smithi163.stdout:685(173 mod 256): WRITE 0x9579e thru 0x9f0de (0x9941 bytes) 2023-07-14T18:17:17.836 INFO:tasks.workunit.client.0.smithi163.stdout:686(174 mod 256): TRUNCATE UP from 0xa15d7 to 0xb49bf 2023-07-14T18:17:17.836 INFO:tasks.workunit.client.0.smithi163.stdout:687(175 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.836 INFO:tasks.workunit.client.0.smithi163.stdout:688(176 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.836 INFO:tasks.workunit.client.0.smithi163.stdout:689(177 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.836 INFO:tasks.workunit.client.0.smithi163.stdout:690(178 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.837 INFO:tasks.workunit.client.0.smithi163.stdout:691(179 mod 256): PUNCH 0x6a2bc thru 0x74d36 (0xaa7b bytes) 2023-07-14T18:17:17.837 INFO:tasks.workunit.client.0.smithi163.stdout:692(180 mod 256): FALLOC 0x65278 thru 0x70d27 (0xbaaf bytes) INTERIOR 2023-07-14T18:17:17.837 INFO:tasks.workunit.client.0.smithi163.stdout:693(181 mod 256): FALLOC 0x1f17b thru 0x20c70 (0x1af5 bytes) INTERIOR 2023-07-14T18:17:17.837 INFO:tasks.workunit.client.0.smithi163.stdout:694(182 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.837 INFO:tasks.workunit.client.0.smithi163.stdout:695(183 mod 256): MAPWRITE 0x6ebd5 thru 0x72ad6 (0x3f02 bytes) 2023-07-14T18:17:17.837 INFO:tasks.workunit.client.0.smithi163.stdout:696(184 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.837 INFO:tasks.workunit.client.0.smithi163.stdout:697(185 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.837 INFO:tasks.workunit.client.0.smithi163.stdout:698(186 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.838 INFO:tasks.workunit.client.0.smithi163.stdout:699(187 mod 256): FALLOC 0x6b6e7 thru 0x712c7 (0x5be0 bytes) INTERIOR 2023-07-14T18:17:17.838 INFO:tasks.workunit.client.0.smithi163.stdout:700(188 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.838 INFO:tasks.workunit.client.0.smithi163.stdout:701(189 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.838 INFO:tasks.workunit.client.0.smithi163.stdout:702(190 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.838 INFO:tasks.workunit.client.0.smithi163.stdout:703(191 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.838 INFO:tasks.workunit.client.0.smithi163.stdout:704(192 mod 256): FALLOC 0xfc132 thru 0x100000 (0x3ece bytes) EXTENDING 2023-07-14T18:17:17.838 INFO:tasks.workunit.client.0.smithi163.stdout:705(193 mod 256): TRUNCATE DOWN from 0x100000 to 0xb97ba 2023-07-14T18:17:17.838 INFO:tasks.workunit.client.0.smithi163.stdout:706(194 mod 256): FALLOC 0x723ff thru 0x7e939 (0xc53a bytes) INTERIOR 2023-07-14T18:17:17.839 INFO:tasks.workunit.client.0.smithi163.stdout:707(195 mod 256): WRITE 0xda2a2 thru 0xddfc8 (0x3d27 bytes) HOLE 2023-07-14T18:17:17.839 INFO:tasks.workunit.client.0.smithi163.stdout:708(196 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.839 INFO:tasks.workunit.client.0.smithi163.stdout:709(197 mod 256): WRITE 0xc2128 thru 0xcc1d9 (0xa0b2 bytes) 2023-07-14T18:17:17.839 INFO:tasks.workunit.client.0.smithi163.stdout:710(198 mod 256): MAPREAD 0x9626b thru 0xa5f13 (0xfca9 bytes) 2023-07-14T18:17:17.839 INFO:tasks.workunit.client.0.smithi163.stdout:711(199 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.839 INFO:tasks.workunit.client.0.smithi163.stdout:712(200 mod 256): PUNCH 0x65cc9 thru 0x70de5 (0xb11d bytes) 2023-07-14T18:17:17.839 INFO:tasks.workunit.client.0.smithi163.stdout:713(201 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.839 INFO:tasks.workunit.client.0.smithi163.stdout:714(202 mod 256): MAPWRITE 0xdaaf3 thru 0xe3a78 (0x8f86 bytes) 2023-07-14T18:17:17.840 INFO:tasks.workunit.client.0.smithi163.stdout:715(203 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.840 INFO:tasks.workunit.client.0.smithi163.stdout:716(204 mod 256): MAPREAD 0xb51ef thru 0xbb018 (0x5e2a bytes) 2023-07-14T18:17:17.840 INFO:tasks.workunit.client.0.smithi163.stdout:717(205 mod 256): COPY 0xcfb53 thru 0xd00b5 (0x563 bytes) to 0xd9642 thru 0xd9ba4 2023-07-14T18:17:17.840 INFO:tasks.workunit.client.0.smithi163.stdout:718(206 mod 256): MAPREAD 0x3146d thru 0x38f51 (0x7ae5 bytes) ***RRRR*** 2023-07-14T18:17:17.840 INFO:tasks.workunit.client.0.smithi163.stdout:719(207 mod 256): PUNCH 0x84e5a thru 0x92441 (0xd5e8 bytes) 2023-07-14T18:17:17.840 INFO:tasks.workunit.client.0.smithi163.stdout:720(208 mod 256): TRUNCATE DOWN from 0xe3a79 to 0xdce19 2023-07-14T18:17:17.840 INFO:tasks.workunit.client.0.smithi163.stdout:721(209 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.841 INFO:tasks.workunit.client.0.smithi163.stdout:722(210 mod 256): MAPWRITE 0x4dcbb thru 0x58b7d (0xaec3 bytes) 2023-07-14T18:17:17.841 INFO:tasks.workunit.client.0.smithi163.stdout:723(211 mod 256): MAPREAD 0x4dd9c thru 0x509b5 (0x2c1a bytes) 2023-07-14T18:17:17.841 INFO:tasks.workunit.client.0.smithi163.stdout:724(212 mod 256): PUNCH 0x3a73 thru 0x102dc (0xc86a bytes) 2023-07-14T18:17:17.841 INFO:tasks.workunit.client.0.smithi163.stdout:725(213 mod 256): MAPWRITE 0xe44da thru 0xeb04a (0x6b71 bytes) 2023-07-14T18:17:17.841 INFO:tasks.workunit.client.0.smithi163.stdout:726(214 mod 256): WRITE 0x1e9ef thru 0x21198 (0x27aa bytes) 2023-07-14T18:17:17.841 INFO:tasks.workunit.client.0.smithi163.stdout:727(215 mod 256): COPY 0xd827d thru 0xdbd45 (0x3ac9 bytes) to 0x5057 thru 0x8b1f 2023-07-14T18:17:17.841 INFO:tasks.workunit.client.0.smithi163.stdout:728(216 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.841 INFO:tasks.workunit.client.0.smithi163.stdout:729(217 mod 256): PUNCH 0x9f3b7 thru 0x9ff6d (0xbb7 bytes) 2023-07-14T18:17:17.842 INFO:tasks.workunit.client.0.smithi163.stdout:730(218 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.842 INFO:tasks.workunit.client.0.smithi163.stdout:731(219 mod 256): COPY 0x938d2 thru 0xa0ead (0xd5dc bytes) to 0xee89e thru 0xfbe79 2023-07-14T18:17:17.842 INFO:tasks.workunit.client.0.smithi163.stdout:732(220 mod 256): FALLOC 0x4e678 thru 0x5c33c (0xdcc4 bytes) INTERIOR 2023-07-14T18:17:17.842 INFO:tasks.workunit.client.0.smithi163.stdout:733(221 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.842 INFO:tasks.workunit.client.0.smithi163.stdout:734(222 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.842 INFO:tasks.workunit.client.0.smithi163.stdout:735(223 mod 256): READ 0x12fed thru 0x2012b (0xd13f bytes) 2023-07-14T18:17:17.842 INFO:tasks.workunit.client.0.smithi163.stdout:736(224 mod 256): MAPWRITE 0xd10eb thru 0xd7198 (0x60ae bytes) 2023-07-14T18:17:17.842 INFO:tasks.workunit.client.0.smithi163.stdout:737(225 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.843 INFO:tasks.workunit.client.0.smithi163.stdout:738(226 mod 256): PUNCH 0xe727a thru 0xec4b0 (0x5237 bytes) 2023-07-14T18:17:17.843 INFO:tasks.workunit.client.0.smithi163.stdout:739(227 mod 256): READ 0x38e8c thru 0x3c987 (0x3afc bytes) 2023-07-14T18:17:17.843 INFO:tasks.workunit.client.0.smithi163.stdout:740(228 mod 256): MAPWRITE 0x46f85 thru 0x48f0a (0x1f86 bytes) 2023-07-14T18:17:17.843 INFO:tasks.workunit.client.0.smithi163.stdout:741(229 mod 256): MAPREAD 0xfa47 thru 0x1bf0a (0xc4c4 bytes) 2023-07-14T18:17:17.843 INFO:tasks.workunit.client.0.smithi163.stdout:742(230 mod 256): FALLOC 0xbe3d4 thru 0xc2304 (0x3f30 bytes) INTERIOR 2023-07-14T18:17:17.843 INFO:tasks.workunit.client.0.smithi163.stdout:743(231 mod 256): TRUNCATE DOWN from 0xfbe7a to 0xce32e 2023-07-14T18:17:17.843 INFO:tasks.workunit.client.0.smithi163.stdout:744(232 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.843 INFO:tasks.workunit.client.0.smithi163.stdout:745(233 mod 256): MAPWRITE 0xa96b0 thru 0xb615c (0xcaad bytes) 2023-07-14T18:17:17.844 INFO:tasks.workunit.client.0.smithi163.stdout:746(234 mod 256): MAPWRITE 0xb891b thru 0xbec1c (0x6302 bytes) 2023-07-14T18:17:17.844 INFO:tasks.workunit.client.0.smithi163.stdout:747(235 mod 256): WRITE 0xa1035 thru 0xae6e8 (0xd6b4 bytes) 2023-07-14T18:17:17.844 INFO:tasks.workunit.client.0.smithi163.stdout:748(236 mod 256): PUNCH 0x4d541 thru 0x5259a (0x505a bytes) 2023-07-14T18:17:17.844 INFO:tasks.workunit.client.0.smithi163.stdout:749(237 mod 256): PUNCH 0x5c91d thru 0x6b8b2 (0xef96 bytes) 2023-07-14T18:17:17.844 INFO:tasks.workunit.client.0.smithi163.stdout:750(238 mod 256): PUNCH 0x7a37c thru 0x7c05c (0x1ce1 bytes) 2023-07-14T18:17:17.844 INFO:tasks.workunit.client.0.smithi163.stdout:751(239 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.844 INFO:tasks.workunit.client.0.smithi163.stdout:752(240 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.844 INFO:tasks.workunit.client.0.smithi163.stdout:753(241 mod 256): PUNCH 0x6cf9e thru 0x72d7e (0x5de1 bytes) 2023-07-14T18:17:17.845 INFO:tasks.workunit.client.0.smithi163.stdout:754(242 mod 256): READ 0x3e2a6 thru 0x4037f (0x20da bytes) 2023-07-14T18:17:17.845 INFO:tasks.workunit.client.0.smithi163.stdout:755(243 mod 256): COPY 0xb180e thru 0xc12aa (0xfa9d bytes) to 0x568d9 thru 0x66375 2023-07-14T18:17:17.845 INFO:tasks.workunit.client.0.smithi163.stdout:756(244 mod 256): PUNCH 0x89c82 thru 0x98442 (0xe7c1 bytes) 2023-07-14T18:17:17.845 INFO:tasks.workunit.client.0.smithi163.stdout:757(245 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.845 INFO:tasks.workunit.client.0.smithi163.stdout:758(246 mod 256): MAPWRITE 0x21599 thru 0x2afa4 (0x9a0c bytes) 2023-07-14T18:17:17.845 INFO:tasks.workunit.client.0.smithi163.stdout:759(247 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.845 INFO:tasks.workunit.client.0.smithi163.stdout:760(248 mod 256): WRITE 0x894d thru 0x162d4 (0xd988 bytes) 2023-07-14T18:17:17.845 INFO:tasks.workunit.client.0.smithi163.stdout:761(249 mod 256): READ 0x402fc thru 0x4dfda (0xdcdf bytes) 2023-07-14T18:17:17.846 INFO:tasks.workunit.client.0.smithi163.stdout:762(250 mod 256): READ 0x854f7 thru 0x8b1af (0x5cb9 bytes) 2023-07-14T18:17:17.846 INFO:tasks.workunit.client.0.smithi163.stdout:763(251 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.846 INFO:tasks.workunit.client.0.smithi163.stdout:764(252 mod 256): COPY 0xad470 thru 0xb8800 (0xb391 bytes) to 0x44dd3 thru 0x50163 2023-07-14T18:17:17.846 INFO:tasks.workunit.client.0.smithi163.stdout:765(253 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.846 INFO:tasks.workunit.client.0.smithi163.stdout:766(254 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.846 INFO:tasks.workunit.client.0.smithi163.stdout:767(255 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.846 INFO:tasks.workunit.client.0.smithi163.stdout:768( 0 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.846 INFO:tasks.workunit.client.0.smithi163.stdout:769( 1 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.847 INFO:tasks.workunit.client.0.smithi163.stdout:770( 2 mod 256): COPY 0x81e65 thru 0x8d821 (0xb9bd bytes) to 0xda574 thru 0xe5f30 2023-07-14T18:17:17.847 INFO:tasks.workunit.client.0.smithi163.stdout:771( 3 mod 256): READ 0x96a76 thru 0xa505e (0xe5e9 bytes) 2023-07-14T18:17:17.847 INFO:tasks.workunit.client.0.smithi163.stdout:772( 4 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.847 INFO:tasks.workunit.client.0.smithi163.stdout:773( 5 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.847 INFO:tasks.workunit.client.0.smithi163.stdout:774( 6 mod 256): READ 0x4f4a0 thru 0x52b25 (0x3686 bytes) 2023-07-14T18:17:17.847 INFO:tasks.workunit.client.0.smithi163.stdout:775( 7 mod 256): WRITE 0x1972d thru 0x22023 (0x88f7 bytes) 2023-07-14T18:17:17.847 INFO:tasks.workunit.client.0.smithi163.stdout:776( 8 mod 256): MAPWRITE 0x2b21 thru 0xba44 (0x8f24 bytes) 2023-07-14T18:17:17.847 INFO:tasks.workunit.client.0.smithi163.stdout:777( 9 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.848 INFO:tasks.workunit.client.0.smithi163.stdout:778( 10 mod 256): READ 0x38558 thru 0x47657 (0xf100 bytes) 2023-07-14T18:17:17.848 INFO:tasks.workunit.client.0.smithi163.stdout:779( 11 mod 256): MAPWRITE 0x5f18c thru 0x65ada (0x694f bytes) 2023-07-14T18:17:17.848 INFO:tasks.workunit.client.0.smithi163.stdout:780( 12 mod 256): READ 0xb0d26 thru 0xb3069 (0x2344 bytes) 2023-07-14T18:17:17.848 INFO:tasks.workunit.client.0.smithi163.stdout:781( 13 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.848 INFO:tasks.workunit.client.0.smithi163.stdout:782( 14 mod 256): FALLOC 0x7e829 thru 0x8de73 (0xf64a bytes) INTERIOR 2023-07-14T18:17:17.848 INFO:tasks.workunit.client.0.smithi163.stdout:783( 15 mod 256): PUNCH 0xb5c25 thru 0xbfe54 (0xa230 bytes) 2023-07-14T18:17:17.848 INFO:tasks.workunit.client.0.smithi163.stdout:784( 16 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.848 INFO:tasks.workunit.client.0.smithi163.stdout:785( 17 mod 256): TRUNCATE DOWN from 0xe5f31 to 0x74425 2023-07-14T18:17:17.849 INFO:tasks.workunit.client.0.smithi163.stdout:786( 18 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.849 INFO:tasks.workunit.client.0.smithi163.stdout:787( 19 mod 256): READ 0x1de5 thru 0xc563 (0xa77f bytes) 2023-07-14T18:17:17.849 INFO:tasks.workunit.client.0.smithi163.stdout:788( 20 mod 256): PUNCH 0x2282d thru 0x298ae (0x7082 bytes) 2023-07-14T18:17:17.849 INFO:tasks.workunit.client.0.smithi163.stdout:789( 21 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.849 INFO:tasks.workunit.client.0.smithi163.stdout:790( 22 mod 256): MAPREAD 0x24f3e thru 0x2d768 (0x882b bytes) 2023-07-14T18:17:17.849 INFO:tasks.workunit.client.0.smithi163.stdout:791( 23 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.849 INFO:tasks.workunit.client.0.smithi163.stdout:792( 24 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.849 INFO:tasks.workunit.client.0.smithi163.stdout:793( 25 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.850 INFO:tasks.workunit.client.0.smithi163.stdout:794( 26 mod 256): MAPREAD 0x47f47 thru 0x50886 (0x8940 bytes) 2023-07-14T18:17:17.850 INFO:tasks.workunit.client.0.smithi163.stdout:795( 27 mod 256): FALLOC 0xa1c35 thru 0xa549e (0x3869 bytes) EXTENDING 2023-07-14T18:17:17.850 INFO:tasks.workunit.client.0.smithi163.stdout:796( 28 mod 256): MAPREAD 0x9c57c thru 0x9ece0 (0x2765 bytes) 2023-07-14T18:17:17.850 INFO:tasks.workunit.client.0.smithi163.stdout:797( 29 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.850 INFO:tasks.workunit.client.0.smithi163.stdout:798( 30 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.850 INFO:tasks.workunit.client.0.smithi163.stdout:799( 31 mod 256): MAPWRITE 0x9f2bb thru 0xac70c (0xd452 bytes) 2023-07-14T18:17:17.850 INFO:tasks.workunit.client.0.smithi163.stdout:800( 32 mod 256): TRUNCATE UP from 0xac70d to 0xd656d 2023-07-14T18:17:17.850 INFO:tasks.workunit.client.0.smithi163.stdout:801( 33 mod 256): PUNCH 0x976b5 thru 0xa1de5 (0xa731 bytes) 2023-07-14T18:17:17.851 INFO:tasks.workunit.client.0.smithi163.stdout:802( 34 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.851 INFO:tasks.workunit.client.0.smithi163.stdout:803( 35 mod 256): READ 0xa7c7d thru 0xb3960 (0xbce4 bytes) 2023-07-14T18:17:17.851 INFO:tasks.workunit.client.0.smithi163.stdout:804( 36 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.851 INFO:tasks.workunit.client.0.smithi163.stdout:805( 37 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.851 INFO:tasks.workunit.client.0.smithi163.stdout:806( 38 mod 256): MAPWRITE 0x3a394 thru 0x44bb4 (0xa821 bytes) 2023-07-14T18:17:17.851 INFO:tasks.workunit.client.0.smithi163.stdout:807( 39 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.851 INFO:tasks.workunit.client.0.smithi163.stdout:808( 40 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.851 INFO:tasks.workunit.client.0.smithi163.stdout:809( 41 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.852 INFO:tasks.workunit.client.0.smithi163.stdout:810( 42 mod 256): MAPREAD 0xc102 thru 0x10d3e (0x4c3d bytes) 2023-07-14T18:17:17.852 INFO:tasks.workunit.client.0.smithi163.stdout:811( 43 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.852 INFO:tasks.workunit.client.0.smithi163.stdout:812( 44 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.852 INFO:tasks.workunit.client.0.smithi163.stdout:813( 45 mod 256): MAPWRITE 0x4b676 thru 0x5741d (0xbda8 bytes) 2023-07-14T18:17:17.852 INFO:tasks.workunit.client.0.smithi163.stdout:814( 46 mod 256): READ 0x9481a thru 0xa1d46 (0xd52d bytes) 2023-07-14T18:17:17.852 INFO:tasks.workunit.client.0.smithi163.stdout:815( 47 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.852 INFO:tasks.workunit.client.0.smithi163.stdout:816( 48 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.852 INFO:tasks.workunit.client.0.smithi163.stdout:817( 49 mod 256): WRITE 0x843b4 thru 0x8abdc (0x6829 bytes) 2023-07-14T18:17:17.853 INFO:tasks.workunit.client.0.smithi163.stdout:818( 50 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.853 INFO:tasks.workunit.client.0.smithi163.stdout:819( 51 mod 256): MAPWRITE 0x82f90 thru 0x881f8 (0x5269 bytes) 2023-07-14T18:17:17.853 INFO:tasks.workunit.client.0.smithi163.stdout:820( 52 mod 256): MAPWRITE 0x61875 thru 0x70ae1 (0xf26d bytes) 2023-07-14T18:17:17.853 INFO:tasks.workunit.client.0.smithi163.stdout:821( 53 mod 256): MAPWRITE 0xf91c thru 0x113eb (0x1ad0 bytes) 2023-07-14T18:17:17.853 INFO:tasks.workunit.client.0.smithi163.stdout:822( 54 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.853 INFO:tasks.workunit.client.0.smithi163.stdout:823( 55 mod 256): READ 0x19f0b thru 0x23453 (0x9549 bytes) 2023-07-14T18:17:17.853 INFO:tasks.workunit.client.0.smithi163.stdout:824( 56 mod 256): MAPWRITE 0x7538b thru 0x7c4ac (0x7122 bytes) 2023-07-14T18:17:17.853 INFO:tasks.workunit.client.0.smithi163.stdout:825( 57 mod 256): TRUNCATE DOWN from 0xd656d to 0x783e2 2023-07-14T18:17:17.854 INFO:tasks.workunit.client.0.smithi163.stdout:826( 58 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.854 INFO:tasks.workunit.client.0.smithi163.stdout:827( 59 mod 256): MAPWRITE 0xb53c8 thru 0xb73b5 (0x1fee bytes) 2023-07-14T18:17:17.854 INFO:tasks.workunit.client.0.smithi163.stdout:828( 60 mod 256): PUNCH 0xa0b64 thru 0xa30cc (0x2569 bytes) 2023-07-14T18:17:17.854 INFO:tasks.workunit.client.0.smithi163.stdout:829( 61 mod 256): WRITE 0x4e31d thru 0x53b08 (0x57ec bytes) 2023-07-14T18:17:17.854 INFO:tasks.workunit.client.0.smithi163.stdout:830( 62 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.854 INFO:tasks.workunit.client.0.smithi163.stdout:831( 63 mod 256): WRITE 0xf5635 thru 0xfffff (0xa9cb bytes) HOLE 2023-07-14T18:17:17.854 INFO:tasks.workunit.client.0.smithi163.stdout:832( 64 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.854 INFO:tasks.workunit.client.0.smithi163.stdout:833( 65 mod 256): COPY 0xb1512 thru 0xbef7e (0xda6d bytes) to 0xd6b9f thru 0xe460b 2023-07-14T18:17:17.855 INFO:tasks.workunit.client.0.smithi163.stdout:834( 66 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.855 INFO:tasks.workunit.client.0.smithi163.stdout:835( 67 mod 256): READ 0x5e873 thru 0x639bd (0x514b bytes) 2023-07-14T18:17:17.855 INFO:tasks.workunit.client.0.smithi163.stdout:836( 68 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.855 INFO:tasks.workunit.client.0.smithi163.stdout:837( 69 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.855 INFO:tasks.workunit.client.0.smithi163.stdout:838( 70 mod 256): COPY 0x24102 thru 0x2bb9f (0x7a9e bytes) to 0xba63e thru 0xc20db 2023-07-14T18:17:17.855 INFO:tasks.workunit.client.0.smithi163.stdout:839( 71 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.855 INFO:tasks.workunit.client.0.smithi163.stdout:840( 72 mod 256): WRITE 0x26e04 thru 0x2e602 (0x77ff bytes) 2023-07-14T18:17:17.855 INFO:tasks.workunit.client.0.smithi163.stdout:841( 73 mod 256): COPY 0x3888e thru 0x476eb (0xee5e bytes) to 0xba1bd thru 0xc901a 2023-07-14T18:17:17.856 INFO:tasks.workunit.client.0.smithi163.stdout:842( 74 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.856 INFO:tasks.workunit.client.0.smithi163.stdout:843( 75 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.856 INFO:tasks.workunit.client.0.smithi163.stdout:844( 76 mod 256): MAPWRITE 0xc2fe2 thru 0xc7538 (0x4557 bytes) 2023-07-14T18:17:17.856 INFO:tasks.workunit.client.0.smithi163.stdout:845( 77 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.856 INFO:tasks.workunit.client.0.smithi163.stdout:846( 78 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.856 INFO:tasks.workunit.client.0.smithi163.stdout:847( 79 mod 256): TRUNCATE DOWN from 0x100000 to 0xed9be 2023-07-14T18:17:17.856 INFO:tasks.workunit.client.0.smithi163.stdout:848( 80 mod 256): COPY 0x8dff1 thru 0x9824b (0xa25b bytes) to 0x4dd55 thru 0x57faf 2023-07-14T18:17:17.856 INFO:tasks.workunit.client.0.smithi163.stdout:849( 81 mod 256): COPY 0xa68f3 thru 0xac221 (0x592f bytes) to 0x646fc thru 0x6a02a 2023-07-14T18:17:17.857 INFO:tasks.workunit.client.0.smithi163.stdout:850( 82 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.857 INFO:tasks.workunit.client.0.smithi163.stdout:851( 83 mod 256): COPY 0x55b2d thru 0x61b6b (0xc03f bytes) to 0x1676c thru 0x227aa 2023-07-14T18:17:17.857 INFO:tasks.workunit.client.0.smithi163.stdout:852( 84 mod 256): PUNCH 0x9d63a thru 0xaad93 (0xd75a bytes) 2023-07-14T18:17:17.857 INFO:tasks.workunit.client.0.smithi163.stdout:853( 85 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.857 INFO:tasks.workunit.client.0.smithi163.stdout:854( 86 mod 256): WRITE 0x11e8e thru 0x166e2 (0x4855 bytes) 2023-07-14T18:17:17.857 INFO:tasks.workunit.client.0.smithi163.stdout:855( 87 mod 256): TRUNCATE DOWN from 0xed9be to 0xa31b4 2023-07-14T18:17:17.857 INFO:tasks.workunit.client.0.smithi163.stdout:856( 88 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.857 INFO:tasks.workunit.client.0.smithi163.stdout:857( 89 mod 256): MAPREAD 0x92b68 thru 0x94547 (0x19e0 bytes) 2023-07-14T18:17:17.858 INFO:tasks.workunit.client.0.smithi163.stdout:858( 90 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.858 INFO:tasks.workunit.client.0.smithi163.stdout:859( 91 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.858 INFO:tasks.workunit.client.0.smithi163.stdout:860( 92 mod 256): FALLOC 0xfd1fa thru 0x100000 (0x2e06 bytes) PAST_EOF 2023-07-14T18:17:17.858 INFO:tasks.workunit.client.0.smithi163.stdout:861( 93 mod 256): FALLOC 0x857db thru 0x9515d (0xf982 bytes) INTERIOR 2023-07-14T18:17:17.858 INFO:tasks.workunit.client.0.smithi163.stdout:862( 94 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.858 INFO:tasks.workunit.client.0.smithi163.stdout:863( 95 mod 256): PUNCH 0x746e6 thru 0x7fe1c (0xb737 bytes) 2023-07-14T18:17:17.858 INFO:tasks.workunit.client.0.smithi163.stdout:864( 96 mod 256): FALLOC 0xf62d thru 0x1eb21 (0xf4f4 bytes) INTERIOR 2023-07-14T18:17:17.859 INFO:tasks.workunit.client.0.smithi163.stdout:865( 97 mod 256): TRUNCATE UP from 0xa31b4 to 0xb7a7f 2023-07-14T18:17:17.859 INFO:tasks.workunit.client.0.smithi163.stdout:866( 98 mod 256): FALLOC 0x1a551 thru 0x1c10f (0x1bbe bytes) INTERIOR 2023-07-14T18:17:17.859 INFO:tasks.workunit.client.0.smithi163.stdout:867( 99 mod 256): COPY 0x926d8 thru 0x9cd9b (0xa6c4 bytes) to 0x3e39a thru 0x48a5d 2023-07-14T18:17:17.859 INFO:tasks.workunit.client.0.smithi163.stdout:868(100 mod 256): TRUNCATE UP from 0xb7a7f to 0xf1fcd 2023-07-14T18:17:17.859 INFO:tasks.workunit.client.0.smithi163.stdout:869(101 mod 256): PUNCH 0xe7ea3 thru 0xf1fcc (0xa12a bytes) 2023-07-14T18:17:17.859 INFO:tasks.workunit.client.0.smithi163.stdout:870(102 mod 256): READ 0x27af4 thru 0x281d7 (0x6e4 bytes) 2023-07-14T18:17:17.859 INFO:tasks.workunit.client.0.smithi163.stdout:871(103 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.859 INFO:tasks.workunit.client.0.smithi163.stdout:872(104 mod 256): WRITE 0xa67f4 thru 0xaa42d (0x3c3a bytes) 2023-07-14T18:17:17.860 INFO:tasks.workunit.client.0.smithi163.stdout:873(105 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.860 INFO:tasks.workunit.client.0.smithi163.stdout:874(106 mod 256): COPY 0x3e347 thru 0x41001 (0x2cbb bytes) to 0x72bed thru 0x758a7 2023-07-14T18:17:17.860 INFO:tasks.workunit.client.0.smithi163.stdout:875(107 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.860 INFO:tasks.workunit.client.0.smithi163.stdout:876(108 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.860 INFO:tasks.workunit.client.0.smithi163.stdout:877(109 mod 256): PUNCH 0x9f7ae thru 0xa54a8 (0x5cfb bytes) 2023-07-14T18:17:17.860 INFO:tasks.workunit.client.0.smithi163.stdout:878(110 mod 256): PUNCH 0x6770b thru 0x6ef2f (0x7825 bytes) 2023-07-14T18:17:17.860 INFO:tasks.workunit.client.0.smithi163.stdout:879(111 mod 256): TRUNCATE DOWN from 0xf1fcd to 0xa1b78 2023-07-14T18:17:17.860 INFO:tasks.workunit.client.0.smithi163.stdout:880(112 mod 256): TRUNCATE UP from 0xa1b78 to 0xf18b9 2023-07-14T18:17:17.861 INFO:tasks.workunit.client.0.smithi163.stdout:881(113 mod 256): TRUNCATE DOWN from 0xf18b9 to 0x48f67 2023-07-14T18:17:17.861 INFO:tasks.workunit.client.0.smithi163.stdout:882(114 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.861 INFO:tasks.workunit.client.0.smithi163.stdout:883(115 mod 256): READ 0x28471 thru 0x2e07a (0x5c0a bytes) 2023-07-14T18:17:17.861 INFO:tasks.workunit.client.0.smithi163.stdout:884(116 mod 256): PUNCH 0x2283e thru 0x2a37a (0x7b3d bytes) 2023-07-14T18:17:17.861 INFO:tasks.workunit.client.0.smithi163.stdout:885(117 mod 256): TRUNCATE UP from 0x48f67 to 0xc03aa 2023-07-14T18:17:17.861 INFO:tasks.workunit.client.0.smithi163.stdout:886(118 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.861 INFO:tasks.workunit.client.0.smithi163.stdout:887(119 mod 256): FALLOC 0x1a16d thru 0x1cc65 (0x2af8 bytes) INTERIOR 2023-07-14T18:17:17.861 INFO:tasks.workunit.client.0.smithi163.stdout:888(120 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.862 INFO:tasks.workunit.client.0.smithi163.stdout:889(121 mod 256): WRITE 0x26417 thru 0x2e50b (0x80f5 bytes) 2023-07-14T18:17:17.862 INFO:tasks.workunit.client.0.smithi163.stdout:890(122 mod 256): FALLOC 0xf7aa8 thru 0xfb39a (0x38f2 bytes) PAST_EOF 2023-07-14T18:17:17.862 INFO:tasks.workunit.client.0.smithi163.stdout:891(123 mod 256): READ 0xac5e6 thru 0xb4ca9 (0x86c4 bytes) 2023-07-14T18:17:17.862 INFO:tasks.workunit.client.0.smithi163.stdout:892(124 mod 256): READ 0xb4974 thru 0xc03a9 (0xba36 bytes) 2023-07-14T18:17:17.862 INFO:tasks.workunit.client.0.smithi163.stdout:893(125 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.862 INFO:tasks.workunit.client.0.smithi163.stdout:894(126 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.862 INFO:tasks.workunit.client.0.smithi163.stdout:895(127 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.862 INFO:tasks.workunit.client.0.smithi163.stdout:896(128 mod 256): READ 0xa9182 thru 0xb24b8 (0x9337 bytes) 2023-07-14T18:17:17.863 INFO:tasks.workunit.client.0.smithi163.stdout:897(129 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.863 INFO:tasks.workunit.client.0.smithi163.stdout:898(130 mod 256): COPY 0x38eb6 thru 0x46a84 (0xdbcf bytes) to 0xab546 thru 0xb9114 2023-07-14T18:17:17.863 INFO:tasks.workunit.client.0.smithi163.stdout:899(131 mod 256): MAPWRITE 0xbfc3f thru 0xc0348 (0x70a bytes) 2023-07-14T18:17:17.863 INFO:tasks.workunit.client.0.smithi163.stdout:900(132 mod 256): TRUNCATE DOWN from 0xc03aa to 0x4b3c6 2023-07-14T18:17:17.863 INFO:tasks.workunit.client.0.smithi163.stdout:901(133 mod 256): PUNCH 0x2af56 thru 0x31938 (0x69e3 bytes) 2023-07-14T18:17:17.863 INFO:tasks.workunit.client.0.smithi163.stdout:902(134 mod 256): COPY 0x430ce thru 0x49dc4 (0x6cf7 bytes) to 0x9423f thru 0x9af35 2023-07-14T18:17:17.863 INFO:tasks.workunit.client.0.smithi163.stdout:903(135 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.863 INFO:tasks.workunit.client.0.smithi163.stdout:904(136 mod 256): COPY 0x4e6bd thru 0x58030 (0x9974 bytes) to 0x9cfbc thru 0xa692f 2023-07-14T18:17:17.864 INFO:tasks.workunit.client.0.smithi163.stdout:905(137 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.864 INFO:tasks.workunit.client.0.smithi163.stdout:906(138 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.864 INFO:tasks.workunit.client.0.smithi163.stdout:907(139 mod 256): READ 0x7afc7 thru 0x893a6 (0xe3e0 bytes) 2023-07-14T18:17:17.864 INFO:tasks.workunit.client.0.smithi163.stdout:908(140 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.864 INFO:tasks.workunit.client.0.smithi163.stdout:909(141 mod 256): TRUNCATE UP from 0xa6930 to 0xf843a 2023-07-14T18:17:17.864 INFO:tasks.workunit.client.0.smithi163.stdout:910(142 mod 256): MAPREAD 0xdf7a9 thru 0xe4cda (0x5532 bytes) 2023-07-14T18:17:17.864 INFO:tasks.workunit.client.0.smithi163.stdout:911(143 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.864 INFO:tasks.workunit.client.0.smithi163.stdout:912(144 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.865 INFO:tasks.workunit.client.0.smithi163.stdout:913(145 mod 256): WRITE 0x8c421 thru 0x9b9c2 (0xf5a2 bytes) 2023-07-14T18:17:17.865 INFO:tasks.workunit.client.0.smithi163.stdout:914(146 mod 256): MAPWRITE 0x33dc0 thru 0x3b2fd (0x753e bytes) ******WWWW 2023-07-14T18:17:17.865 INFO:tasks.workunit.client.0.smithi163.stdout:915(147 mod 256): TRUNCATE DOWN from 0xf843a to 0x2c47 ******WWWW 2023-07-14T18:17:17.865 INFO:tasks.workunit.client.0.smithi163.stdout:916(148 mod 256): MAPWRITE 0x1e7bf thru 0x25ae6 (0x7328 bytes) 2023-07-14T18:17:17.865 INFO:tasks.workunit.client.0.smithi163.stdout:917(149 mod 256): READ 0xd2e0 thru 0xd4b9 (0x1da bytes) 2023-07-14T18:17:17.865 INFO:tasks.workunit.client.0.smithi163.stdout:918(150 mod 256): FALLOC 0xd1f3c thru 0xd42a4 (0x2368 bytes) EXTENDING 2023-07-14T18:17:17.865 INFO:tasks.workunit.client.0.smithi163.stdout:919(151 mod 256): MAPWRITE 0x4d4ed thru 0x52ac2 (0x55d6 bytes) 2023-07-14T18:17:17.865 INFO:tasks.workunit.client.0.smithi163.stdout:920(152 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.866 INFO:tasks.workunit.client.0.smithi163.stdout:921(153 mod 256): READ 0xc82a7 thru 0xcda3a (0x5794 bytes) 2023-07-14T18:17:17.866 INFO:tasks.workunit.client.0.smithi163.stdout:922(154 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.866 INFO:tasks.workunit.client.0.smithi163.stdout:923(155 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.866 INFO:tasks.workunit.client.0.smithi163.stdout:924(156 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.866 INFO:tasks.workunit.client.0.smithi163.stdout:925(157 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.866 INFO:tasks.workunit.client.0.smithi163.stdout:926(158 mod 256): MAPWRITE 0x2102d thru 0x2390e (0x28e2 bytes) 2023-07-14T18:17:17.866 INFO:tasks.workunit.client.0.smithi163.stdout:927(159 mod 256): PUNCH 0x10673 thru 0x140e7 (0x3a75 bytes) 2023-07-14T18:17:17.866 INFO:tasks.workunit.client.0.smithi163.stdout:928(160 mod 256): MAPREAD 0x170a6 thru 0x203c8 (0x9323 bytes) 2023-07-14T18:17:17.867 INFO:tasks.workunit.client.0.smithi163.stdout:929(161 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.867 INFO:tasks.workunit.client.0.smithi163.stdout:930(162 mod 256): COPY 0xb9125 thru 0xc7c0e (0xeaea bytes) to 0x468ee thru 0x553d7 2023-07-14T18:17:17.867 INFO:tasks.workunit.client.0.smithi163.stdout:931(163 mod 256): WRITE 0xf13fb thru 0xffe1b (0xea21 bytes) HOLE 2023-07-14T18:17:17.867 INFO:tasks.workunit.client.0.smithi163.stdout:932(164 mod 256): READ 0x8c2a9 thru 0x984b5 (0xc20d bytes) 2023-07-14T18:17:17.867 INFO:tasks.workunit.client.0.smithi163.stdout:933(165 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.867 INFO:tasks.workunit.client.0.smithi163.stdout:934(166 mod 256): READ 0xbbf5c thru 0xc676e (0xa813 bytes) 2023-07-14T18:17:17.867 INFO:tasks.workunit.client.0.smithi163.stdout:935(167 mod 256): MAPREAD 0x552f4 thru 0x5fab4 (0xa7c1 bytes) 2023-07-14T18:17:17.867 INFO:tasks.workunit.client.0.smithi163.stdout:936(168 mod 256): MAPWRITE 0x8b8cc thru 0x8d6a3 (0x1dd8 bytes) 2023-07-14T18:17:17.868 INFO:tasks.workunit.client.0.smithi163.stdout:937(169 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.868 INFO:tasks.workunit.client.0.smithi163.stdout:938(170 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.868 INFO:tasks.workunit.client.0.smithi163.stdout:939(171 mod 256): WRITE 0xab267 thru 0xb4742 (0x94dc bytes) 2023-07-14T18:17:17.868 INFO:tasks.workunit.client.0.smithi163.stdout:940(172 mod 256): COPY 0x356d9 thru 0x4514d (0xfa75 bytes) to 0x74ba thru 0x16f2e EEEE****** 2023-07-14T18:17:17.868 INFO:tasks.workunit.client.0.smithi163.stdout:941(173 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.868 INFO:tasks.workunit.client.0.smithi163.stdout:942(174 mod 256): WRITE 0x19c73 thru 0x2399c (0x9d2a bytes) 2023-07-14T18:17:17.868 INFO:tasks.workunit.client.0.smithi163.stdout:943(175 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.868 INFO:tasks.workunit.client.0.smithi163.stdout:944(176 mod 256): COPY 0x454fb thru 0x4635e (0xe64 bytes) to 0x75332 thru 0x76195 2023-07-14T18:17:17.869 INFO:tasks.workunit.client.0.smithi163.stdout:945(177 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.869 INFO:tasks.workunit.client.0.smithi163.stdout:946(178 mod 256): TRUNCATE DOWN from 0xffe1c to 0x5bee2 2023-07-14T18:17:17.869 INFO:tasks.workunit.client.0.smithi163.stdout:947(179 mod 256): WRITE 0x32bfa thru 0x3d702 (0xab09 bytes) ***WWWW 2023-07-14T18:17:17.869 INFO:tasks.workunit.client.0.smithi163.stdout:948(180 mod 256): WRITE 0x9dfc3 thru 0x9e674 (0x6b2 bytes) HOLE 2023-07-14T18:17:17.869 INFO:tasks.workunit.client.0.smithi163.stdout:949(181 mod 256): READ 0x1146c thru 0x14b07 (0x369c bytes) 2023-07-14T18:17:17.869 INFO:tasks.workunit.client.0.smithi163.stdout:950(182 mod 256): FALLOC 0x8508e thru 0x8a61d (0x558f bytes) INTERIOR 2023-07-14T18:17:17.869 INFO:tasks.workunit.client.0.smithi163.stdout:951(183 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.869 INFO:tasks.workunit.client.0.smithi163.stdout:952(184 mod 256): READ 0x4dda5 thru 0x5ad99 (0xcff5 bytes) 2023-07-14T18:17:17.870 INFO:tasks.workunit.client.0.smithi163.stdout:953(185 mod 256): WRITE 0xbcf37 thru 0xbea05 (0x1acf bytes) HOLE 2023-07-14T18:17:17.870 INFO:tasks.workunit.client.0.smithi163.stdout:954(186 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.870 INFO:tasks.workunit.client.0.smithi163.stdout:955(187 mod 256): FALLOC 0xf8daa thru 0x100000 (0x7256 bytes) PAST_EOF 2023-07-14T18:17:17.870 INFO:tasks.workunit.client.0.smithi163.stdout:956(188 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.870 INFO:tasks.workunit.client.0.smithi163.stdout:957(189 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.870 INFO:tasks.workunit.client.0.smithi163.stdout:958(190 mod 256): FALLOC 0x9557c thru 0x973fd (0x1e81 bytes) INTERIOR 2023-07-14T18:17:17.870 INFO:tasks.workunit.client.0.smithi163.stdout:959(191 mod 256): WRITE 0x2e942 thru 0x2fc12 (0x12d1 bytes) 2023-07-14T18:17:17.870 INFO:tasks.workunit.client.0.smithi163.stdout:960(192 mod 256): COPY 0x23fec thru 0x24abb (0xad0 bytes) to 0xb7e3c thru 0xb890b 2023-07-14T18:17:17.871 INFO:tasks.workunit.client.0.smithi163.stdout:961(193 mod 256): TRUNCATE DOWN from 0xbea06 to 0xa8ea5 2023-07-14T18:17:17.871 INFO:tasks.workunit.client.0.smithi163.stdout:962(194 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.871 INFO:tasks.workunit.client.0.smithi163.stdout:963(195 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.871 INFO:tasks.workunit.client.0.smithi163.stdout:964(196 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.871 INFO:tasks.workunit.client.0.smithi163.stdout:965(197 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.871 INFO:tasks.workunit.client.0.smithi163.stdout:966(198 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.871 INFO:tasks.workunit.client.0.smithi163.stdout:967(199 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.871 INFO:tasks.workunit.client.0.smithi163.stdout:968(200 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.872 INFO:tasks.workunit.client.0.smithi163.stdout:969(201 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.872 INFO:tasks.workunit.client.0.smithi163.stdout:970(202 mod 256): READ 0xa3867 thru 0xa8ea4 (0x563e bytes) 2023-07-14T18:17:17.872 INFO:tasks.workunit.client.0.smithi163.stdout:971(203 mod 256): PUNCH 0x45672 thru 0x45bf3 (0x582 bytes) 2023-07-14T18:17:17.872 INFO:tasks.workunit.client.0.smithi163.stdout:972(204 mod 256): COPY 0x67c78 thru 0x6af44 (0x32cd bytes) to 0xef962 thru 0xf2c2e 2023-07-14T18:17:17.872 INFO:tasks.workunit.client.0.smithi163.stdout:973(205 mod 256): READ 0x58b56 thru 0x62473 (0x991e bytes) 2023-07-14T18:17:17.872 INFO:tasks.workunit.client.0.smithi163.stdout:974(206 mod 256): MAPWRITE 0xf7d76 thru 0xf9da7 (0x2032 bytes) 2023-07-14T18:17:17.872 INFO:tasks.workunit.client.0.smithi163.stdout:975(207 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.872 INFO:tasks.workunit.client.0.smithi163.stdout:976(208 mod 256): TRUNCATE DOWN from 0xf9da8 to 0x7bd0b 2023-07-14T18:17:17.873 INFO:tasks.workunit.client.0.smithi163.stdout:977(209 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.873 INFO:tasks.workunit.client.0.smithi163.stdout:978(210 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.873 INFO:tasks.workunit.client.0.smithi163.stdout:979(211 mod 256): PUNCH 0x572ef thru 0x5e306 (0x7018 bytes) 2023-07-14T18:17:17.873 INFO:tasks.workunit.client.0.smithi163.stdout:980(212 mod 256): WRITE 0x8c89c thru 0x90f68 (0x46cd bytes) HOLE 2023-07-14T18:17:17.873 INFO:tasks.workunit.client.0.smithi163.stdout:981(213 mod 256): PUNCH 0x8b992 thru 0x8fcee (0x435d bytes) 2023-07-14T18:17:17.873 INFO:tasks.workunit.client.0.smithi163.stdout:982(214 mod 256): MAPREAD 0x38597 thru 0x47044 (0xeaae bytes) 2023-07-14T18:17:17.873 INFO:tasks.workunit.client.0.smithi163.stdout:983(215 mod 256): FALLOC 0xfb13 thru 0x1e250 (0xe73d bytes) INTERIOR 2023-07-14T18:17:17.873 INFO:tasks.workunit.client.0.smithi163.stdout:984(216 mod 256): PUNCH 0x61e89 thru 0x62e72 (0xfea bytes) 2023-07-14T18:17:17.874 INFO:tasks.workunit.client.0.smithi163.stdout:985(217 mod 256): MAPREAD 0x385b4 thru 0x46d0a (0xe757 bytes) 2023-07-14T18:17:17.874 INFO:tasks.workunit.client.0.smithi163.stdout:986(218 mod 256): PUNCH 0xc0eb thru 0x1affc (0xef12 bytes) 2023-07-14T18:17:17.874 INFO:tasks.workunit.client.0.smithi163.stdout:987(219 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.874 INFO:tasks.workunit.client.0.smithi163.stdout:988(220 mod 256): WRITE 0xb15a3 thru 0xb33df (0x1e3d bytes) HOLE 2023-07-14T18:17:17.874 INFO:tasks.workunit.client.0.smithi163.stdout:989(221 mod 256): MAPREAD 0x97628 thru 0x9b173 (0x3b4c bytes) 2023-07-14T18:17:17.874 INFO:tasks.workunit.client.0.smithi163.stdout:990(222 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.874 INFO:tasks.workunit.client.0.smithi163.stdout:991(223 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.874 INFO:tasks.workunit.client.0.smithi163.stdout:992(224 mod 256): MAPREAD 0x31ccd thru 0x3ddaa (0xc0de bytes) ***RRRR*** 2023-07-14T18:17:17.875 INFO:tasks.workunit.client.0.smithi163.stdout:993(225 mod 256): FALLOC 0xcf425 thru 0xda069 (0xac44 bytes) PAST_EOF 2023-07-14T18:17:17.875 INFO:tasks.workunit.client.0.smithi163.stdout:994(226 mod 256): FALLOC 0x99dc2 thru 0xa5d9b (0xbfd9 bytes) INTERIOR 2023-07-14T18:17:17.875 INFO:tasks.workunit.client.0.smithi163.stdout:995(227 mod 256): COPY 0x4a83c thru 0x4fe3e (0x5603 bytes) to 0xf4cc thru 0x14ace 2023-07-14T18:17:17.875 INFO:tasks.workunit.client.0.smithi163.stdout:996(228 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.875 INFO:tasks.workunit.client.0.smithi163.stdout:997(229 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.875 INFO:tasks.workunit.client.0.smithi163.stdout:998(230 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.875 INFO:tasks.workunit.client.0.smithi163.stdout:999(231 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.875 INFO:tasks.workunit.client.0.smithi163.stdout:1000(232 mod 256): READ 0x4c625 thru 0x55f7b (0x9957 bytes) 2023-07-14T18:17:17.876 INFO:tasks.workunit.client.0.smithi163.stdout:1001(233 mod 256): MAPREAD 0x78b6a thru 0x7a54f (0x19e6 bytes) 2023-07-14T18:17:17.876 INFO:tasks.workunit.client.0.smithi163.stdout:1002(234 mod 256): FALLOC 0xa5b71 thru 0xa956a (0x39f9 bytes) INTERIOR 2023-07-14T18:17:17.876 INFO:tasks.workunit.client.0.smithi163.stdout:1003(235 mod 256): FALLOC 0x7113f thru 0x74420 (0x32e1 bytes) INTERIOR 2023-07-14T18:17:17.876 INFO:tasks.workunit.client.0.smithi163.stdout:1004(236 mod 256): MAPREAD 0x526f8 thru 0x5a6ae (0x7fb7 bytes) 2023-07-14T18:17:17.876 INFO:tasks.workunit.client.0.smithi163.stdout:1005(237 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.876 INFO:tasks.workunit.client.0.smithi163.stdout:1006(238 mod 256): PUNCH 0x24815 thru 0x2e069 (0x9855 bytes) 2023-07-14T18:17:17.876 INFO:tasks.workunit.client.0.smithi163.stdout:1007(239 mod 256): WRITE 0x4dca2 thru 0x5a425 (0xc784 bytes) 2023-07-14T18:17:17.877 INFO:tasks.workunit.client.0.smithi163.stdout:1008(240 mod 256): COPY 0xa34a0 thru 0xadb80 (0xa6e1 bytes) to 0x3fb9 thru 0xe699 2023-07-14T18:17:17.877 INFO:tasks.workunit.client.0.smithi163.stdout:1009(241 mod 256): PUNCH 0x94e16 thru 0x9965f (0x484a bytes) 2023-07-14T18:17:17.877 INFO:tasks.workunit.client.0.smithi163.stdout:1010(242 mod 256): MAPREAD 0x5284c thru 0x5ddaa (0xb55f bytes) 2023-07-14T18:17:17.877 INFO:tasks.workunit.client.0.smithi163.stdout:1011(243 mod 256): MAPWRITE 0xb93da thru 0xc91c4 (0xfdeb bytes) 2023-07-14T18:17:17.877 INFO:tasks.workunit.client.0.smithi163.stdout:1012(244 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.877 INFO:tasks.workunit.client.0.smithi163.stdout:1013(245 mod 256): PUNCH 0x41a44 thru 0x4c668 (0xac25 bytes) 2023-07-14T18:17:17.877 INFO:tasks.workunit.client.0.smithi163.stdout:1014(246 mod 256): TRUNCATE DOWN from 0xc91c5 to 0x33123 ******WWWW 2023-07-14T18:17:17.877 INFO:tasks.workunit.client.0.smithi163.stdout:1015(247 mod 256): COPY 0xe4ac thru 0x109d5 (0x252a bytes) to 0x5cd26 thru 0x5f24f 2023-07-14T18:17:17.878 INFO:tasks.workunit.client.0.smithi163.stdout:1016(248 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.878 INFO:tasks.workunit.client.0.smithi163.stdout:1017(249 mod 256): READ 0x26eb1 thru 0x36c97 (0xfde7 bytes) 2023-07-14T18:17:17.878 INFO:tasks.workunit.client.0.smithi163.stdout:1018(250 mod 256): TRUNCATE UP from 0x5f250 to 0xa1c5d 2023-07-14T18:17:17.878 INFO:tasks.workunit.client.0.smithi163.stdout:1019(251 mod 256): COPY 0x2040b thru 0x2565f (0x5255 bytes) to 0xf7b81 thru 0xfcdd5 2023-07-14T18:17:17.878 INFO:tasks.workunit.client.0.smithi163.stdout:1020(252 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.878 INFO:tasks.workunit.client.0.smithi163.stdout:1021(253 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.878 INFO:tasks.workunit.client.0.smithi163.stdout:1022(254 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.878 INFO:tasks.workunit.client.0.smithi163.stdout:1023(255 mod 256): MAPREAD 0x4462 thru 0x13128 (0xecc7 bytes) 2023-07-14T18:17:17.879 INFO:tasks.workunit.client.0.smithi163.stdout:1024( 0 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.879 INFO:tasks.workunit.client.0.smithi163.stdout:1025( 1 mod 256): FALLOC 0xb3231 thru 0xb43a1 (0x1170 bytes) INTERIOR 2023-07-14T18:17:17.879 INFO:tasks.workunit.client.0.smithi163.stdout:1026( 2 mod 256): FALLOC 0x61cbc thru 0x6ecd2 (0xd016 bytes) INTERIOR 2023-07-14T18:17:17.879 INFO:tasks.workunit.client.0.smithi163.stdout:1027( 3 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.879 INFO:tasks.workunit.client.0.smithi163.stdout:1028( 4 mod 256): MAPWRITE 0xbb356 thru 0xbcf86 (0x1c31 bytes) 2023-07-14T18:17:17.879 INFO:tasks.workunit.client.0.smithi163.stdout:1029( 5 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.879 INFO:tasks.workunit.client.0.smithi163.stdout:1030( 6 mod 256): FALLOC 0x475da thru 0x50170 (0x8b96 bytes) INTERIOR 2023-07-14T18:17:17.879 INFO:tasks.workunit.client.0.smithi163.stdout:1031( 7 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.880 INFO:tasks.workunit.client.0.smithi163.stdout:1032( 8 mod 256): COPY 0x8d23b thru 0x91beb (0x49b1 bytes) to 0x2f7db thru 0x3418b 2023-07-14T18:17:17.880 INFO:tasks.workunit.client.0.smithi163.stdout:1033( 9 mod 256): COPY 0x1d1c3 thru 0x2423e (0x707c bytes) to 0x11d37 thru 0x18db2 2023-07-14T18:17:17.880 INFO:tasks.workunit.client.0.smithi163.stdout:1034( 10 mod 256): PUNCH 0x3bbe8 thru 0x47c06 (0xc01f bytes) 2023-07-14T18:17:17.880 INFO:tasks.workunit.client.0.smithi163.stdout:1035( 11 mod 256): COPY 0xd6b6 thru 0x13a1b (0x6366 bytes) to 0x634ae thru 0x69813 2023-07-14T18:17:17.880 INFO:tasks.workunit.client.0.smithi163.stdout:1036( 12 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.880 INFO:tasks.workunit.client.0.smithi163.stdout:1037( 13 mod 256): FALLOC 0xfc886 thru 0x100000 (0x377a bytes) PAST_EOF 2023-07-14T18:17:17.880 INFO:tasks.workunit.client.0.smithi163.stdout:1038( 14 mod 256): WRITE 0x44dd7 thru 0x4bf81 (0x71ab bytes) 2023-07-14T18:17:17.880 INFO:tasks.workunit.client.0.smithi163.stdout:1039( 15 mod 256): READ 0x6c03a thru 0x768d8 (0xa89f bytes) 2023-07-14T18:17:17.881 INFO:tasks.workunit.client.0.smithi163.stdout:1040( 16 mod 256): MAPWRITE 0x39e25 thru 0x3e20a (0x43e6 bytes) 2023-07-14T18:17:17.881 INFO:tasks.workunit.client.0.smithi163.stdout:1041( 17 mod 256): WRITE 0xb8421 thru 0xc087d (0x845d bytes) 2023-07-14T18:17:17.881 INFO:tasks.workunit.client.0.smithi163.stdout:1042( 18 mod 256): TRUNCATE DOWN from 0xfcdd6 to 0x5254d 2023-07-14T18:17:17.881 INFO:tasks.workunit.client.0.smithi163.stdout:1043( 19 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.881 INFO:tasks.workunit.client.0.smithi163.stdout:1044( 20 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.881 INFO:tasks.workunit.client.0.smithi163.stdout:1045( 21 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.881 INFO:tasks.workunit.client.0.smithi163.stdout:1046( 22 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.881 INFO:tasks.workunit.client.0.smithi163.stdout:1047( 23 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.882 INFO:tasks.workunit.client.0.smithi163.stdout:1048( 24 mod 256): WRITE 0x2ba03 thru 0x2e0f6 (0x26f4 bytes) 2023-07-14T18:17:17.882 INFO:tasks.workunit.client.0.smithi163.stdout:1049( 25 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.882 INFO:tasks.workunit.client.0.smithi163.stdout:1050( 26 mod 256): WRITE 0x4820a thru 0x56ac2 (0xe8b9 bytes) EXTEND 2023-07-14T18:17:17.882 INFO:tasks.workunit.client.0.smithi163.stdout:1051( 27 mod 256): COPY 0x526a3 thru 0x54b2c (0x248a bytes) to 0x9cedc thru 0x9f365 2023-07-14T18:17:17.882 INFO:tasks.workunit.client.0.smithi163.stdout:1052( 28 mod 256): COPY 0x3d518 thru 0x433c5 (0x5eae bytes) to 0xf89a6 thru 0xfe853 2023-07-14T18:17:17.882 INFO:tasks.workunit.client.0.smithi163.stdout:1053( 29 mod 256): PUNCH 0xf852b thru 0xfe853 (0x6329 bytes) 2023-07-14T18:17:17.882 INFO:tasks.workunit.client.0.smithi163.stdout:1054( 30 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.882 INFO:tasks.workunit.client.0.smithi163.stdout:1055( 31 mod 256): COPY 0x886bd thru 0x8b5fb (0x2f3f bytes) to 0xb784 thru 0xe6c2 2023-07-14T18:17:17.883 INFO:tasks.workunit.client.0.smithi163.stdout:1056( 32 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.883 INFO:tasks.workunit.client.0.smithi163.stdout:1057( 33 mod 256): TRUNCATE DOWN from 0xfe854 to 0xdfb63 2023-07-14T18:17:17.883 INFO:tasks.workunit.client.0.smithi163.stdout:1058( 34 mod 256): MAPWRITE 0x801b9 thru 0x82d8d (0x2bd5 bytes) 2023-07-14T18:17:17.883 INFO:tasks.workunit.client.0.smithi163.stdout:1059( 35 mod 256): TRUNCATE DOWN from 0xdfb63 to 0xa393d 2023-07-14T18:17:17.883 INFO:tasks.workunit.client.0.smithi163.stdout:1060( 36 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.883 INFO:tasks.workunit.client.0.smithi163.stdout:1061( 37 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.883 INFO:tasks.workunit.client.0.smithi163.stdout:1062( 38 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.883 INFO:tasks.workunit.client.0.smithi163.stdout:1063( 39 mod 256): COPY 0x4335d thru 0x4934d (0x5ff1 bytes) to 0xd8129 thru 0xde119 2023-07-14T18:17:17.884 INFO:tasks.workunit.client.0.smithi163.stdout:1064( 40 mod 256): TRUNCATE DOWN from 0xde11a to 0xbdc38 2023-07-14T18:17:17.884 INFO:tasks.workunit.client.0.smithi163.stdout:1065( 41 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.884 INFO:tasks.workunit.client.0.smithi163.stdout:1066( 42 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.884 INFO:tasks.workunit.client.0.smithi163.stdout:1067( 43 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.884 INFO:tasks.workunit.client.0.smithi163.stdout:1068( 44 mod 256): READ 0xb851 thru 0x1abe3 (0xf393 bytes) 2023-07-14T18:17:17.884 INFO:tasks.workunit.client.0.smithi163.stdout:1069( 45 mod 256): COPY 0x2169c thru 0x2f3d5 (0xdd3a bytes) to 0xbdb4c thru 0xcb885 2023-07-14T18:17:17.884 INFO:tasks.workunit.client.0.smithi163.stdout:1070( 46 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.884 INFO:tasks.workunit.client.0.smithi163.stdout:1071( 47 mod 256): PUNCH 0x8ea70 thru 0x940fa (0x568b bytes) 2023-07-14T18:17:17.885 INFO:tasks.workunit.client.0.smithi163.stdout:1072( 48 mod 256): READ 0x306d thru 0xd670 (0xa604 bytes) 2023-07-14T18:17:17.885 INFO:tasks.workunit.client.0.smithi163.stdout:1073( 49 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.885 INFO:tasks.workunit.client.0.smithi163.stdout:1074( 50 mod 256): MAPWRITE 0x58254 thru 0x62e77 (0xac24 bytes) 2023-07-14T18:17:17.885 INFO:tasks.workunit.client.0.smithi163.stdout:1075( 51 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.885 INFO:tasks.workunit.client.0.smithi163.stdout:1076( 52 mod 256): COPY 0x5dddb thru 0x603c9 (0x25ef bytes) to 0x70272 thru 0x72860 2023-07-14T18:17:17.885 INFO:tasks.workunit.client.0.smithi163.stdout:1077( 53 mod 256): MAPREAD 0x21639 thru 0x2bbcd (0xa595 bytes) 2023-07-14T18:17:17.885 INFO:tasks.workunit.client.0.smithi163.stdout:1078( 54 mod 256): WRITE 0xca737 thru 0xd7777 (0xd041 bytes) EXTEND 2023-07-14T18:17:17.885 INFO:tasks.workunit.client.0.smithi163.stdout:1079( 55 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.886 INFO:tasks.workunit.client.0.smithi163.stdout:1080( 56 mod 256): WRITE 0x4844a thru 0x4e385 (0x5f3c bytes) 2023-07-14T18:17:17.886 INFO:tasks.workunit.client.0.smithi163.stdout:1081( 57 mod 256): MAPREAD 0x25822 thru 0x25bc1 (0x3a0 bytes) 2023-07-14T18:17:17.886 INFO:tasks.workunit.client.0.smithi163.stdout:1082( 58 mod 256): WRITE 0xcdc61 thru 0xd1db1 (0x4151 bytes) 2023-07-14T18:17:17.886 INFO:tasks.workunit.client.0.smithi163.stdout:1083( 59 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.886 INFO:tasks.workunit.client.0.smithi163.stdout:1084( 60 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.886 INFO:tasks.workunit.client.0.smithi163.stdout:1085( 61 mod 256): PUNCH 0xd5d90 thru 0xd7777 (0x19e8 bytes) 2023-07-14T18:17:17.886 INFO:tasks.workunit.client.0.smithi163.stdout:1086( 62 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.886 INFO:tasks.workunit.client.0.smithi163.stdout:1087( 63 mod 256): MAPREAD 0x7a1fb thru 0x83147 (0x8f4d bytes) 2023-07-14T18:17:17.887 INFO:tasks.workunit.client.0.smithi163.stdout:1088( 64 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.887 INFO:tasks.workunit.client.0.smithi163.stdout:1089( 65 mod 256): TRUNCATE DOWN from 0xd7778 to 0x7d6de 2023-07-14T18:17:17.887 INFO:tasks.workunit.client.0.smithi163.stdout:1090( 66 mod 256): WRITE 0x2c5e3 thru 0x3af9d (0xe9bb bytes) ***WWWW 2023-07-14T18:17:17.887 INFO:tasks.workunit.client.0.smithi163.stdout:1091( 67 mod 256): FALLOC 0x5ee05 thru 0x68355 (0x9550 bytes) INTERIOR 2023-07-14T18:17:17.887 INFO:tasks.workunit.client.0.smithi163.stdout:1092( 68 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.887 INFO:tasks.workunit.client.0.smithi163.stdout:1093( 69 mod 256): COPY 0x75cd0 thru 0x7a48a (0x47bb bytes) to 0xb53c0 thru 0xb9b7a 2023-07-14T18:17:17.887 INFO:tasks.workunit.client.0.smithi163.stdout:1094( 70 mod 256): WRITE 0xde3e0 thru 0xed5d2 (0xf1f3 bytes) HOLE 2023-07-14T18:17:17.887 INFO:tasks.workunit.client.0.smithi163.stdout:1095( 71 mod 256): COPY 0x6105c thru 0x6c8a9 (0xb84e bytes) to 0xe65c4 thru 0xf1e11 2023-07-14T18:17:17.888 INFO:tasks.workunit.client.0.smithi163.stdout:1096( 72 mod 256): WRITE 0x43c73 thru 0x48379 (0x4707 bytes) 2023-07-14T18:17:17.888 INFO:tasks.workunit.client.0.smithi163.stdout:1097( 73 mod 256): TRUNCATE DOWN from 0xf1e12 to 0x9993b 2023-07-14T18:17:17.888 INFO:tasks.workunit.client.0.smithi163.stdout:1098( 74 mod 256): READ 0x4e1ac thru 0x4f59a (0x13ef bytes) 2023-07-14T18:17:17.888 INFO:tasks.workunit.client.0.smithi163.stdout:1099( 75 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.888 INFO:tasks.workunit.client.0.smithi163.stdout:1100( 76 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.888 INFO:tasks.workunit.client.0.smithi163.stdout:1101( 77 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.888 INFO:tasks.workunit.client.0.smithi163.stdout:1102( 78 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.888 INFO:tasks.workunit.client.0.smithi163.stdout:1103( 79 mod 256): PUNCH 0x262cd thru 0x34c52 (0xe986 bytes) 2023-07-14T18:17:17.889 INFO:tasks.workunit.client.0.smithi163.stdout:1104( 80 mod 256): READ 0x8b33 thru 0x8d41 (0x20f bytes) 2023-07-14T18:17:17.889 INFO:tasks.workunit.client.0.smithi163.stdout:1105( 81 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.889 INFO:tasks.workunit.client.0.smithi163.stdout:1106( 82 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.889 INFO:tasks.workunit.client.0.smithi163.stdout:1107( 83 mod 256): READ 0x9f9a thru 0x13de8 (0x9e4f bytes) 2023-07-14T18:17:17.889 INFO:tasks.workunit.client.0.smithi163.stdout:1108( 84 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.889 INFO:tasks.workunit.client.0.smithi163.stdout:1109( 85 mod 256): WRITE 0x7ac7e thru 0x7d0a3 (0x2426 bytes) 2023-07-14T18:17:17.889 INFO:tasks.workunit.client.0.smithi163.stdout:1110( 86 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.889 INFO:tasks.workunit.client.0.smithi163.stdout:1111( 87 mod 256): MAPWRITE 0x3885e thru 0x42173 (0x9916 bytes) 2023-07-14T18:17:17.890 INFO:tasks.workunit.client.0.smithi163.stdout:1112( 88 mod 256): COPY 0x7e3a4 thru 0x7faff (0x175c bytes) to 0x429b0 thru 0x4410b 2023-07-14T18:17:17.890 INFO:tasks.workunit.client.0.smithi163.stdout:1113( 89 mod 256): FALLOC 0x80248 thru 0x8234a (0x2102 bytes) INTERIOR 2023-07-14T18:17:17.890 INFO:tasks.workunit.client.0.smithi163.stdout:1114( 90 mod 256): PUNCH 0x8c97 thru 0xe0cd (0x5437 bytes) 2023-07-14T18:17:17.890 INFO:tasks.workunit.client.0.smithi163.stdout:1115( 91 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.890 INFO:tasks.workunit.client.0.smithi163.stdout:1116( 92 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.890 INFO:tasks.workunit.client.0.smithi163.stdout:1117( 93 mod 256): COPY 0x4afb9 thru 0x4b3d3 (0x41b bytes) to 0x5bc5f thru 0x5c079 2023-07-14T18:17:17.890 INFO:tasks.workunit.client.0.smithi163.stdout:1118( 94 mod 256): WRITE 0x2ec07 thru 0x33233 (0x462d bytes) 2023-07-14T18:17:17.890 INFO:tasks.workunit.client.0.smithi163.stdout:1119( 95 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.891 INFO:tasks.workunit.client.0.smithi163.stdout:1120( 96 mod 256): WRITE 0x7f2b5 thru 0x87cd1 (0x8a1d bytes) 2023-07-14T18:17:17.891 INFO:tasks.workunit.client.0.smithi163.stdout:1121( 97 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.891 INFO:tasks.workunit.client.0.smithi163.stdout:1122( 98 mod 256): COPY 0x83a66 thru 0x8cc73 (0x920e bytes) to 0x27ba9 thru 0x30db6 2023-07-14T18:17:17.891 INFO:tasks.workunit.client.0.smithi163.stdout:1123( 99 mod 256): MAPREAD 0x864f8 thru 0x8b709 (0x5212 bytes) 2023-07-14T18:17:17.891 INFO:tasks.workunit.client.0.smithi163.stdout:1124(100 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.891 INFO:tasks.workunit.client.0.smithi163.stdout:1125(101 mod 256): PUNCH 0x868b1 thru 0x907ff (0x9f4f bytes) 2023-07-14T18:17:17.891 INFO:tasks.workunit.client.0.smithi163.stdout:1126(102 mod 256): MAPREAD 0x923e thru 0xcfd7 (0x3d9a bytes) 2023-07-14T18:17:17.891 INFO:tasks.workunit.client.0.smithi163.stdout:1127(103 mod 256): MAPREAD 0x18096 thru 0x270f0 (0xf05b bytes) 2023-07-14T18:17:17.892 INFO:tasks.workunit.client.0.smithi163.stdout:1128(104 mod 256): MAPWRITE 0x6e258 thru 0x7c956 (0xe6ff bytes) 2023-07-14T18:17:17.892 INFO:tasks.workunit.client.0.smithi163.stdout:1129(105 mod 256): COPY 0x8cf8e thru 0x8d0bb (0x12e bytes) to 0x7dd89 thru 0x7deb6 2023-07-14T18:17:17.892 INFO:tasks.workunit.client.0.smithi163.stdout:1130(106 mod 256): PUNCH 0x8243f thru 0x8e0c3 (0xbc85 bytes) 2023-07-14T18:17:17.892 INFO:tasks.workunit.client.0.smithi163.stdout:1131(107 mod 256): COPY 0x55499 thru 0x5f5f5 (0xa15d bytes) to 0xba69d thru 0xc47f9 2023-07-14T18:17:17.892 INFO:tasks.workunit.client.0.smithi163.stdout:1132(108 mod 256): MAPWRITE 0xdcb02 thru 0xe4dc4 (0x82c3 bytes) 2023-07-14T18:17:17.892 INFO:tasks.workunit.client.0.smithi163.stdout:1133(109 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.892 INFO:tasks.workunit.client.0.smithi163.stdout:1134(110 mod 256): WRITE 0x4ecfa thru 0x54e59 (0x6160 bytes) 2023-07-14T18:17:17.892 INFO:tasks.workunit.client.0.smithi163.stdout:1135(111 mod 256): TRUNCATE DOWN from 0xe4dc5 to 0x98969 2023-07-14T18:17:17.893 INFO:tasks.workunit.client.0.smithi163.stdout:1136(112 mod 256): FALLOC 0xd3dc3 thru 0xdb98f (0x7bcc bytes) PAST_EOF 2023-07-14T18:17:17.893 INFO:tasks.workunit.client.0.smithi163.stdout:1137(113 mod 256): COPY 0x67228 thru 0x6746a (0x243 bytes) to 0x6c370 thru 0x6c5b2 2023-07-14T18:17:17.893 INFO:tasks.workunit.client.0.smithi163.stdout:1138(114 mod 256): READ 0x24dc thru 0x8ded (0x6912 bytes) 2023-07-14T18:17:17.893 INFO:tasks.workunit.client.0.smithi163.stdout:1139(115 mod 256): TRUNCATE UP from 0x98969 to 0xd6cce 2023-07-14T18:17:17.893 INFO:tasks.workunit.client.0.smithi163.stdout:1140(116 mod 256): READ 0x565d6 thru 0x5d4f1 (0x6f1c bytes) 2023-07-14T18:17:17.893 INFO:tasks.workunit.client.0.smithi163.stdout:1141(117 mod 256): MAPWRITE 0x33bbb thru 0x3e713 (0xab59 bytes) ******WWWW 2023-07-14T18:17:17.893 INFO:tasks.workunit.client.0.smithi163.stdout:1142(118 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.893 INFO:tasks.workunit.client.0.smithi163.stdout:1143(119 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.894 INFO:tasks.workunit.client.0.smithi163.stdout:1144(120 mod 256): COPY 0x44763 thru 0x4dd6d (0x960b bytes) to 0x90e19 thru 0x9a423 2023-07-14T18:17:17.894 INFO:tasks.workunit.client.0.smithi163.stdout:1145(121 mod 256): PUNCH 0x434bb thru 0x4f251 (0xbd97 bytes) 2023-07-14T18:17:17.894 INFO:tasks.workunit.client.0.smithi163.stdout:1146(122 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.894 INFO:tasks.workunit.client.0.smithi163.stdout:1147(123 mod 256): MAPREAD 0x2cacb thru 0x3bdfc (0xf332 bytes) ***RRRR*** 2023-07-14T18:17:17.894 INFO:tasks.workunit.client.0.smithi163.stdout:1148(124 mod 256): TRUNCATE DOWN from 0xd6cce to 0x45228 2023-07-14T18:17:17.894 INFO:tasks.workunit.client.0.smithi163.stdout:1149(125 mod 256): MAPWRITE 0xb3cf6 thru 0xbd973 (0x9c7e bytes) 2023-07-14T18:17:17.894 INFO:tasks.workunit.client.0.smithi163.stdout:1150(126 mod 256): TRUNCATE DOWN from 0xbd974 to 0x9fe38 2023-07-14T18:17:17.895 INFO:tasks.workunit.client.0.smithi163.stdout:1151(127 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.895 INFO:tasks.workunit.client.0.smithi163.stdout:1152(128 mod 256): TRUNCATE DOWN from 0x9fe38 to 0x779b2 2023-07-14T18:17:17.895 INFO:tasks.workunit.client.0.smithi163.stdout:1153(129 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.895 INFO:tasks.workunit.client.0.smithi163.stdout:1154(130 mod 256): WRITE 0x7a176 thru 0x7a3a5 (0x230 bytes) HOLE 2023-07-14T18:17:17.895 INFO:tasks.workunit.client.0.smithi163.stdout:1155(131 mod 256): COPY 0xc853 thru 0x1536e (0x8b1c bytes) to 0x3f1c7 thru 0x47ce2 2023-07-14T18:17:17.895 INFO:tasks.workunit.client.0.smithi163.stdout:1156(132 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.895 INFO:tasks.workunit.client.0.smithi163.stdout:1157(133 mod 256): MAPREAD 0x3d186 thru 0x44eb2 (0x7d2d bytes) 2023-07-14T18:17:17.895 INFO:tasks.workunit.client.0.smithi163.stdout:1158(134 mod 256): COPY 0x501de thru 0x5cc7c (0xca9f bytes) to 0xe3a6e thru 0xf050c 2023-07-14T18:17:17.896 INFO:tasks.workunit.client.0.smithi163.stdout:1159(135 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.896 INFO:tasks.workunit.client.0.smithi163.stdout:1160(136 mod 256): PUNCH 0x2479a thru 0x331e3 (0xea4a bytes) 2023-07-14T18:17:17.896 INFO:tasks.workunit.client.0.smithi163.stdout:1161(137 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.896 INFO:tasks.workunit.client.0.smithi163.stdout:1162(138 mod 256): FALLOC 0xea96f thru 0xf33b7 (0x8a48 bytes) PAST_EOF 2023-07-14T18:17:17.896 INFO:tasks.workunit.client.0.smithi163.stdout:1163(139 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.896 INFO:tasks.workunit.client.0.smithi163.stdout:1164(140 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.896 INFO:tasks.workunit.client.0.smithi163.stdout:1165(141 mod 256): READ 0xe3d51 thru 0xf050c (0xc7bc bytes) 2023-07-14T18:17:17.896 INFO:tasks.workunit.client.0.smithi163.stdout:1166(142 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.897 INFO:tasks.workunit.client.0.smithi163.stdout:1167(143 mod 256): PUNCH 0xc4e0c thru 0xc79ab (0x2ba0 bytes) 2023-07-14T18:17:17.897 INFO:tasks.workunit.client.0.smithi163.stdout:1168(144 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.897 INFO:tasks.workunit.client.0.smithi163.stdout:1169(145 mod 256): TRUNCATE DOWN from 0xf050d to 0x7b7df 2023-07-14T18:17:17.897 INFO:tasks.workunit.client.0.smithi163.stdout:1170(146 mod 256): WRITE 0xffb3d thru 0xfffff (0x4c3 bytes) HOLE 2023-07-14T18:17:17.897 INFO:tasks.workunit.client.0.smithi163.stdout:1171(147 mod 256): MAPWRITE 0x63b1d thru 0x7290a (0xedee bytes) 2023-07-14T18:17:17.897 INFO:tasks.workunit.client.0.smithi163.stdout:1172(148 mod 256): MAPREAD 0x724b7 thru 0x7e6b2 (0xc1fc bytes) 2023-07-14T18:17:17.897 INFO:tasks.workunit.client.0.smithi163.stdout:1173(149 mod 256): FALLOC 0x8433a thru 0x8d76f (0x9435 bytes) INTERIOR 2023-07-14T18:17:17.897 INFO:tasks.workunit.client.0.smithi163.stdout:1174(150 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.898 INFO:tasks.workunit.client.0.smithi163.stdout:1175(151 mod 256): PUNCH 0x74b47 thru 0x836de (0xeb98 bytes) 2023-07-14T18:17:17.898 INFO:tasks.workunit.client.0.smithi163.stdout:1176(152 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.898 INFO:tasks.workunit.client.0.smithi163.stdout:1177(153 mod 256): READ 0x456e8 thru 0x489d3 (0x32ec bytes) 2023-07-14T18:17:17.898 INFO:tasks.workunit.client.0.smithi163.stdout:1178(154 mod 256): MAPREAD 0x3cbf3 thru 0x413cf (0x47dd bytes) 2023-07-14T18:17:17.898 INFO:tasks.workunit.client.0.smithi163.stdout:1179(155 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.898 INFO:tasks.workunit.client.0.smithi163.stdout:1180(156 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.898 INFO:tasks.workunit.client.0.smithi163.stdout:1181(157 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.898 INFO:tasks.workunit.client.0.smithi163.stdout:1182(158 mod 256): COPY 0x99e93 thru 0xa1a64 (0x7bd2 bytes) to 0x6ea55 thru 0x76626 2023-07-14T18:17:17.899 INFO:tasks.workunit.client.0.smithi163.stdout:1183(159 mod 256): PUNCH 0x6f239 thru 0x7addf (0xbba7 bytes) 2023-07-14T18:17:17.899 INFO:tasks.workunit.client.0.smithi163.stdout:1184(160 mod 256): MAPREAD 0x7016f thru 0x721e2 (0x2074 bytes) 2023-07-14T18:17:17.899 INFO:tasks.workunit.client.0.smithi163.stdout:1185(161 mod 256): WRITE 0xfae5f thru 0xfffff (0x51a1 bytes) 2023-07-14T18:17:17.899 INFO:tasks.workunit.client.0.smithi163.stdout:1186(162 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.899 INFO:tasks.workunit.client.0.smithi163.stdout:1187(163 mod 256): TRUNCATE DOWN from 0x100000 to 0x7690f 2023-07-14T18:17:17.899 INFO:tasks.workunit.client.0.smithi163.stdout:1188(164 mod 256): MAPREAD 0x541b1 thru 0x56e2d (0x2c7d bytes) 2023-07-14T18:17:17.899 INFO:tasks.workunit.client.0.smithi163.stdout:1189(165 mod 256): TRUNCATE DOWN from 0x7690f to 0xd2f3 ******WWWW 2023-07-14T18:17:17.899 INFO:tasks.workunit.client.0.smithi163.stdout:1190(166 mod 256): MAPWRITE 0x3cb5a thru 0x43450 (0x68f7 bytes) 2023-07-14T18:17:17.900 INFO:tasks.workunit.client.0.smithi163.stdout:1191(167 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.900 INFO:tasks.workunit.client.0.smithi163.stdout:1192(168 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.900 INFO:tasks.workunit.client.0.smithi163.stdout:1193(169 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.900 INFO:tasks.workunit.client.0.smithi163.stdout:1194(170 mod 256): MAPREAD 0x9389 thru 0xaa55 (0x16cd bytes) 2023-07-14T18:17:17.900 INFO:tasks.workunit.client.0.smithi163.stdout:1195(171 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.900 INFO:tasks.workunit.client.0.smithi163.stdout:1196(172 mod 256): READ 0x26d20 thru 0x2a601 (0x38e2 bytes) 2023-07-14T18:17:17.900 INFO:tasks.workunit.client.0.smithi163.stdout:1197(173 mod 256): READ 0x3e7a thru 0x8cca (0x4e51 bytes) 2023-07-14T18:17:17.900 INFO:tasks.workunit.client.0.smithi163.stdout:1198(174 mod 256): WRITE 0xe0a95 thru 0xead53 (0xa2bf bytes) HOLE 2023-07-14T18:17:17.901 INFO:tasks.workunit.client.0.smithi163.stdout:1199(175 mod 256): COPY 0xb70b thru 0x17b42 (0xc438 bytes) to 0x67875 thru 0x73cac 2023-07-14T18:17:17.901 INFO:tasks.workunit.client.0.smithi163.stdout:1200(176 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.901 INFO:tasks.workunit.client.0.smithi163.stdout:1201(177 mod 256): FALLOC 0xf2924 thru 0xfbb0f (0x91eb bytes) EXTENDING 2023-07-14T18:17:17.901 INFO:tasks.workunit.client.0.smithi163.stdout:1202(178 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.901 INFO:tasks.workunit.client.0.smithi163.stdout:1203(179 mod 256): READ 0x3f04d thru 0x42e82 (0x3e36 bytes) 2023-07-14T18:17:17.901 INFO:tasks.workunit.client.0.smithi163.stdout:1204(180 mod 256): MAPWRITE 0x7a660 thru 0x7d151 (0x2af2 bytes) 2023-07-14T18:17:17.901 INFO:tasks.workunit.client.0.smithi163.stdout:1205(181 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.901 INFO:tasks.workunit.client.0.smithi163.stdout:1206(182 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.902 INFO:tasks.workunit.client.0.smithi163.stdout:1207(183 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.902 INFO:tasks.workunit.client.0.smithi163.stdout:1208(184 mod 256): READ 0xb97b0 thru 0xc05f5 (0x6e46 bytes) 2023-07-14T18:17:17.902 INFO:tasks.workunit.client.0.smithi163.stdout:1209(185 mod 256): MAPWRITE 0x99b34 thru 0x9be84 (0x2351 bytes) 2023-07-14T18:17:17.902 INFO:tasks.workunit.client.0.smithi163.stdout:1210(186 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.902 INFO:tasks.workunit.client.0.smithi163.stdout:1211(187 mod 256): WRITE 0x695b4 thru 0x755f4 (0xc041 bytes) 2023-07-14T18:17:17.902 INFO:tasks.workunit.client.0.smithi163.stdout:1212(188 mod 256): MAPREAD 0x67018 thru 0x6734c (0x335 bytes) 2023-07-14T18:17:17.902 INFO:tasks.workunit.client.0.smithi163.stdout:1213(189 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.902 INFO:tasks.workunit.client.0.smithi163.stdout:1214(190 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.903 INFO:tasks.workunit.client.0.smithi163.stdout:1215(191 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.903 INFO:tasks.workunit.client.0.smithi163.stdout:1216(192 mod 256): COPY 0x2659d thru 0x2dd6b (0x77cf bytes) to 0x40d46 thru 0x48514 2023-07-14T18:17:17.903 INFO:tasks.workunit.client.0.smithi163.stdout:1217(193 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.903 INFO:tasks.workunit.client.0.smithi163.stdout:1218(194 mod 256): READ 0x1dfc thru 0x5cef (0x3ef4 bytes) 2023-07-14T18:17:17.903 INFO:tasks.workunit.client.0.smithi163.stdout:1219(195 mod 256): FALLOC 0x62d8a thru 0x724b5 (0xf72b bytes) INTERIOR 2023-07-14T18:17:17.903 INFO:tasks.workunit.client.0.smithi163.stdout:1220(196 mod 256): MAPREAD 0xb220e thru 0xba210 (0x8003 bytes) 2023-07-14T18:17:17.903 INFO:tasks.workunit.client.0.smithi163.stdout:1221(197 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.903 INFO:tasks.workunit.client.0.smithi163.stdout:1222(198 mod 256): READ 0x94829 thru 0xa306f (0xe847 bytes) 2023-07-14T18:17:17.904 INFO:tasks.workunit.client.0.smithi163.stdout:1223(199 mod 256): COPY 0x1a077 thru 0x21569 (0x74f3 bytes) to 0x84415 thru 0x8b907 2023-07-14T18:17:17.904 INFO:tasks.workunit.client.0.smithi163.stdout:1224(200 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.904 INFO:tasks.workunit.client.0.smithi163.stdout:1225(201 mod 256): TRUNCATE DOWN from 0xfbb0f to 0xba849 2023-07-14T18:17:17.904 INFO:tasks.workunit.client.0.smithi163.stdout:1226(202 mod 256): TRUNCATE DOWN from 0xba849 to 0x13ad4 ******WWWW 2023-07-14T18:17:17.904 INFO:tasks.workunit.client.0.smithi163.stdout:1227(203 mod 256): COPY 0xa8b7 thru 0x1295d (0x80a7 bytes) to 0x17a16 thru 0x1fabc 2023-07-14T18:17:17.904 INFO:tasks.workunit.client.0.smithi163.stdout:1228(204 mod 256): WRITE 0x68cbf thru 0x74db0 (0xc0f2 bytes) HOLE ***WWWW 2023-07-14T18:17:17.904 INFO:tasks.workunit.client.0.smithi163.stdout:1229(205 mod 256): PUNCH 0x48907 thru 0x50bd6 (0x82d0 bytes) 2023-07-14T18:17:17.904 INFO:tasks.workunit.client.0.smithi163.stdout:1230(206 mod 256): PUNCH 0x729b0 thru 0x74599 (0x1bea bytes) 2023-07-14T18:17:17.905 INFO:tasks.workunit.client.0.smithi163.stdout:1231(207 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.905 INFO:tasks.workunit.client.0.smithi163.stdout:1232(208 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.905 INFO:tasks.workunit.client.0.smithi163.stdout:1233(209 mod 256): MAPREAD 0x48df2 thru 0x54e08 (0xc017 bytes) 2023-07-14T18:17:17.905 INFO:tasks.workunit.client.0.smithi163.stdout:1234(210 mod 256): FALLOC 0xaf5c4 thru 0xb28b1 (0x32ed bytes) EXTENDING 2023-07-14T18:17:17.905 INFO:tasks.workunit.client.0.smithi163.stdout:1235(211 mod 256): READ 0xa63e3 thru 0xb28b0 (0xc4ce bytes) 2023-07-14T18:17:17.905 INFO:tasks.workunit.client.0.smithi163.stdout:1236(212 mod 256): TRUNCATE DOWN from 0xb28b1 to 0xa247a 2023-07-14T18:17:17.905 INFO:tasks.workunit.client.0.smithi163.stdout:1237(213 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.905 INFO:tasks.workunit.client.0.smithi163.stdout:1238(214 mod 256): COPY 0x693aa thru 0x7686d (0xd4c4 bytes) to 0x84791 thru 0x91c54 2023-07-14T18:17:17.906 INFO:tasks.workunit.client.0.smithi163.stdout:1239(215 mod 256): WRITE 0x96175 thru 0x9e7d7 (0x8663 bytes) 2023-07-14T18:17:17.906 INFO:tasks.workunit.client.0.smithi163.stdout:1240(216 mod 256): FALLOC 0x7376e thru 0x81153 (0xd9e5 bytes) INTERIOR 2023-07-14T18:17:17.906 INFO:tasks.workunit.client.0.smithi163.stdout:1241(217 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.906 INFO:tasks.workunit.client.0.smithi163.stdout:1242(218 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.906 INFO:tasks.workunit.client.0.smithi163.stdout:1243(219 mod 256): READ 0x94a02 thru 0xa0f13 (0xc512 bytes) 2023-07-14T18:17:17.906 INFO:tasks.workunit.client.0.smithi163.stdout:1244(220 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.906 INFO:tasks.workunit.client.0.smithi163.stdout:1245(221 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.906 INFO:tasks.workunit.client.0.smithi163.stdout:1246(222 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.907 INFO:tasks.workunit.client.0.smithi163.stdout:1247(223 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.907 INFO:tasks.workunit.client.0.smithi163.stdout:1248(224 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.907 INFO:tasks.workunit.client.0.smithi163.stdout:1249(225 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.907 INFO:tasks.workunit.client.0.smithi163.stdout:1250(226 mod 256): WRITE 0xbdd31 thru 0xc6b8c (0x8e5c bytes) HOLE 2023-07-14T18:17:17.907 INFO:tasks.workunit.client.0.smithi163.stdout:1251(227 mod 256): FALLOC 0x98bac thru 0xa6ed9 (0xe32d bytes) INTERIOR 2023-07-14T18:17:17.907 INFO:tasks.workunit.client.0.smithi163.stdout:1252(228 mod 256): MAPWRITE 0x1fc79 thru 0x2dd14 (0xe09c bytes) 2023-07-14T18:17:17.907 INFO:tasks.workunit.client.0.smithi163.stdout:1253(229 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.907 INFO:tasks.workunit.client.0.smithi163.stdout:1254(230 mod 256): WRITE 0x19fa0 thru 0x20c55 (0x6cb6 bytes) 2023-07-14T18:17:17.908 INFO:tasks.workunit.client.0.smithi163.stdout:1255(231 mod 256): PUNCH 0xc67f3 thru 0xc6b8c (0x39a bytes) 2023-07-14T18:17:17.908 INFO:tasks.workunit.client.0.smithi163.stdout:1256(232 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.908 INFO:tasks.workunit.client.0.smithi163.stdout:1257(233 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.908 INFO:tasks.workunit.client.0.smithi163.stdout:1258(234 mod 256): TRUNCATE DOWN from 0xc6b8d to 0xa9d7a 2023-07-14T18:17:17.908 INFO:tasks.workunit.client.0.smithi163.stdout:1259(235 mod 256): MAPWRITE 0x81ea3 thru 0x8bd7c (0x9eda bytes) 2023-07-14T18:17:17.908 INFO:tasks.workunit.client.0.smithi163.stdout:1260(236 mod 256): WRITE 0x5ba56 thru 0x5d414 (0x19bf bytes) 2023-07-14T18:17:17.908 INFO:tasks.workunit.client.0.smithi163.stdout:1261(237 mod 256): FALLOC 0xd9822 thru 0xde7d7 (0x4fb5 bytes) EXTENDING 2023-07-14T18:17:17.908 INFO:tasks.workunit.client.0.smithi163.stdout:1262(238 mod 256): READ 0xcf62d thru 0xd7345 (0x7d19 bytes) 2023-07-14T18:17:17.909 INFO:tasks.workunit.client.0.smithi163.stdout:1263(239 mod 256): TRUNCATE UP from 0xde7d7 to 0xe5ddc 2023-07-14T18:17:17.909 INFO:tasks.workunit.client.0.smithi163.stdout:1264(240 mod 256): READ 0x6bb56 thru 0x6e8c5 (0x2d70 bytes) 2023-07-14T18:17:17.909 INFO:tasks.workunit.client.0.smithi163.stdout:1265(241 mod 256): COPY 0x3482 thru 0x8e09 (0x5988 bytes) to 0x9c64c thru 0xa1fd3 2023-07-14T18:17:17.909 INFO:tasks.workunit.client.0.smithi163.stdout:1266(242 mod 256): COPY 0xc074a thru 0xc65e9 (0x5ea0 bytes) to 0x2dd5 thru 0x8c74 2023-07-14T18:17:17.909 INFO:tasks.workunit.client.0.smithi163.stdout:1267(243 mod 256): MAPWRITE 0xe83c0 thru 0xedae8 (0x5729 bytes) 2023-07-14T18:17:17.909 INFO:tasks.workunit.client.0.smithi163.stdout:1268(244 mod 256): PUNCH 0xd7dcf thru 0xe0745 (0x8977 bytes) 2023-07-14T18:17:17.909 INFO:tasks.workunit.client.0.smithi163.stdout:1269(245 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.909 INFO:tasks.workunit.client.0.smithi163.stdout:1270(246 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.910 INFO:tasks.workunit.client.0.smithi163.stdout:1271(247 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.910 INFO:tasks.workunit.client.0.smithi163.stdout:1272(248 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.910 INFO:tasks.workunit.client.0.smithi163.stdout:1273(249 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.910 INFO:tasks.workunit.client.0.smithi163.stdout:1274(250 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.910 INFO:tasks.workunit.client.0.smithi163.stdout:1275(251 mod 256): PUNCH 0x52e82 thru 0x54238 (0x13b7 bytes) 2023-07-14T18:17:17.910 INFO:tasks.workunit.client.0.smithi163.stdout:1276(252 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.910 INFO:tasks.workunit.client.0.smithi163.stdout:1277(253 mod 256): FALLOC 0x2781e thru 0x30c08 (0x93ea bytes) INTERIOR 2023-07-14T18:17:17.910 INFO:tasks.workunit.client.0.smithi163.stdout:1278(254 mod 256): TRUNCATE DOWN from 0xedae9 to 0xf571 ******WWWW 2023-07-14T18:17:17.911 INFO:tasks.workunit.client.0.smithi163.stdout:1279(255 mod 256): TRUNCATE UP from 0xf571 to 0x49304 ******WWWW 2023-07-14T18:17:17.911 INFO:tasks.workunit.client.0.smithi163.stdout:1280( 0 mod 256): MAPREAD 0x2fccf thru 0x3ea71 (0xeda3 bytes) ***RRRR*** 2023-07-14T18:17:17.911 INFO:tasks.workunit.client.0.smithi163.stdout:1281( 1 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.911 INFO:tasks.workunit.client.0.smithi163.stdout:1282( 2 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.911 INFO:tasks.workunit.client.0.smithi163.stdout:1283( 3 mod 256): PUNCH 0x2af7 thru 0x119b8 (0xeec2 bytes) 2023-07-14T18:17:17.911 INFO:tasks.workunit.client.0.smithi163.stdout:1284( 4 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.911 INFO:tasks.workunit.client.0.smithi163.stdout:1285( 5 mod 256): TRUNCATE UP from 0x49304 to 0x8e328 2023-07-14T18:17:17.911 INFO:tasks.workunit.client.0.smithi163.stdout:1286( 6 mod 256): MAPREAD 0xb898 thru 0x1ac1d (0xf386 bytes) 2023-07-14T18:17:17.912 INFO:tasks.workunit.client.0.smithi163.stdout:1287( 7 mod 256): FALLOC 0xf4fed thru 0xf9682 (0x4695 bytes) EXTENDING 2023-07-14T18:17:17.912 INFO:tasks.workunit.client.0.smithi163.stdout:1288( 8 mod 256): READ 0xc0fcd thru 0xcf643 (0xe677 bytes) 2023-07-14T18:17:17.912 INFO:tasks.workunit.client.0.smithi163.stdout:1289( 9 mod 256): READ 0xbacf thru 0x12a23 (0x6f55 bytes) 2023-07-14T18:17:17.912 INFO:tasks.workunit.client.0.smithi163.stdout:1290( 10 mod 256): FALLOC 0x93c93 thru 0x9a594 (0x6901 bytes) INTERIOR 2023-07-14T18:17:17.912 INFO:tasks.workunit.client.0.smithi163.stdout:1291( 11 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.912 INFO:tasks.workunit.client.0.smithi163.stdout:1292( 12 mod 256): READ 0x9592e thru 0x9c29c (0x696f bytes) 2023-07-14T18:17:17.912 INFO:tasks.workunit.client.0.smithi163.stdout:1293( 13 mod 256): READ 0xcb011 thru 0xcfaa4 (0x4a94 bytes) 2023-07-14T18:17:17.913 INFO:tasks.workunit.client.0.smithi163.stdout:1294( 14 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.913 INFO:tasks.workunit.client.0.smithi163.stdout:1295( 15 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.913 INFO:tasks.workunit.client.0.smithi163.stdout:1296( 16 mod 256): FALLOC 0xe3d6e thru 0xec60b (0x889d bytes) INTERIOR 2023-07-14T18:17:17.913 INFO:tasks.workunit.client.0.smithi163.stdout:1297( 17 mod 256): WRITE 0x96a24 thru 0x9fdc2 (0x939f bytes) 2023-07-14T18:17:17.913 INFO:tasks.workunit.client.0.smithi163.stdout:1298( 18 mod 256): WRITE 0x4886c thru 0x5731f (0xeab4 bytes) 2023-07-14T18:17:17.913 INFO:tasks.workunit.client.0.smithi163.stdout:1299( 19 mod 256): WRITE 0x86bd0 thru 0x9022e (0x965f bytes) 2023-07-14T18:17:17.913 INFO:tasks.workunit.client.0.smithi163.stdout:1300( 20 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.913 INFO:tasks.workunit.client.0.smithi163.stdout:1301( 21 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.914 INFO:tasks.workunit.client.0.smithi163.stdout:1302( 22 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.914 INFO:tasks.workunit.client.0.smithi163.stdout:1303( 23 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.914 INFO:tasks.workunit.client.0.smithi163.stdout:1304( 24 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.914 INFO:tasks.workunit.client.0.smithi163.stdout:1305( 25 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.914 INFO:tasks.workunit.client.0.smithi163.stdout:1306( 26 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.914 INFO:tasks.workunit.client.0.smithi163.stdout:1307( 27 mod 256): MAPWRITE 0x2375e thru 0x24195 (0xa38 bytes) 2023-07-14T18:17:17.914 INFO:tasks.workunit.client.0.smithi163.stdout:1308( 28 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.914 INFO:tasks.workunit.client.0.smithi163.stdout:1309( 29 mod 256): PUNCH 0x5321f thru 0x5a7a8 (0x758a bytes) 2023-07-14T18:17:17.915 INFO:tasks.workunit.client.0.smithi163.stdout:1310( 30 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.915 INFO:tasks.workunit.client.0.smithi163.stdout:1311( 31 mod 256): MAPWRITE 0x3ba7a thru 0x42a32 (0x6fb9 bytes) 2023-07-14T18:17:17.915 INFO:tasks.workunit.client.0.smithi163.stdout:1312( 32 mod 256): MAPREAD 0x9da3a thru 0xaad10 (0xd2d7 bytes) 2023-07-14T18:17:17.915 INFO:tasks.workunit.client.0.smithi163.stdout:1313( 33 mod 256): MAPREAD 0x784de thru 0x7a7f5 (0x2318 bytes) 2023-07-14T18:17:17.915 INFO:tasks.workunit.client.0.smithi163.stdout:1314( 34 mod 256): MAPREAD 0xcac27 thru 0xce2fe (0x36d8 bytes) 2023-07-14T18:17:17.915 INFO:tasks.workunit.client.0.smithi163.stdout:1315( 35 mod 256): READ 0x39b09 thru 0x3d70d (0x3c05 bytes) 2023-07-14T18:17:17.915 INFO:tasks.workunit.client.0.smithi163.stdout:1316( 36 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.915 INFO:tasks.workunit.client.0.smithi163.stdout:1317( 37 mod 256): MAPWRITE 0x6300a thru 0x65d83 (0x2d7a bytes) 2023-07-14T18:17:17.916 INFO:tasks.workunit.client.0.smithi163.stdout:1318( 38 mod 256): COPY 0xe2b6 thru 0x19fc6 (0xbd11 bytes) to 0x2d3da thru 0x390ea ******EEEE 2023-07-14T18:17:17.916 INFO:tasks.workunit.client.0.smithi163.stdout:1319( 39 mod 256): READ 0xa2aa5 thru 0xa41d4 (0x1730 bytes) 2023-07-14T18:17:17.916 INFO:tasks.workunit.client.0.smithi163.stdout:1320( 40 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.916 INFO:tasks.workunit.client.0.smithi163.stdout:1321( 41 mod 256): COPY 0x50d30 thru 0x5ca3c (0xbd0d bytes) to 0xcd788 thru 0xd9494 2023-07-14T18:17:17.916 INFO:tasks.workunit.client.0.smithi163.stdout:1322( 42 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.916 INFO:tasks.workunit.client.0.smithi163.stdout:1323( 43 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.916 INFO:tasks.workunit.client.0.smithi163.stdout:1324( 44 mod 256): WRITE 0x93f34 thru 0x9d612 (0x96df bytes) 2023-07-14T18:17:17.916 INFO:tasks.workunit.client.0.smithi163.stdout:1325( 45 mod 256): COPY 0x1e243 thru 0x20886 (0x2644 bytes) to 0x30e71 thru 0x334b4 2023-07-14T18:17:17.917 INFO:tasks.workunit.client.0.smithi163.stdout:1326( 46 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.917 INFO:tasks.workunit.client.0.smithi163.stdout:1327( 47 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.917 INFO:tasks.workunit.client.0.smithi163.stdout:1328( 48 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.917 INFO:tasks.workunit.client.0.smithi163.stdout:1329( 49 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.917 INFO:tasks.workunit.client.0.smithi163.stdout:1330( 50 mod 256): COPY 0x7e38c thru 0x841da (0x5e4f bytes) to 0x2cd58 thru 0x32ba6 2023-07-14T18:17:17.917 INFO:tasks.workunit.client.0.smithi163.stdout:1331( 51 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.917 INFO:tasks.workunit.client.0.smithi163.stdout:1332( 52 mod 256): MAPWRITE 0xfa54b thru 0xfb51a (0xfd0 bytes) 2023-07-14T18:17:17.917 INFO:tasks.workunit.client.0.smithi163.stdout:1333( 53 mod 256): READ 0x7f6e5 thru 0x822b3 (0x2bcf bytes) 2023-07-14T18:17:17.918 INFO:tasks.workunit.client.0.smithi163.stdout:1334( 54 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.918 INFO:tasks.workunit.client.0.smithi163.stdout:1335( 55 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.918 INFO:tasks.workunit.client.0.smithi163.stdout:1336( 56 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.918 INFO:tasks.workunit.client.0.smithi163.stdout:1337( 57 mod 256): READ 0x402a7 thru 0x48546 (0x82a0 bytes) 2023-07-14T18:17:17.918 INFO:tasks.workunit.client.0.smithi163.stdout:1338( 58 mod 256): FALLOC 0xa1fee thru 0xa99a5 (0x79b7 bytes) INTERIOR 2023-07-14T18:17:17.918 INFO:tasks.workunit.client.0.smithi163.stdout:1339( 59 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.918 INFO:tasks.workunit.client.0.smithi163.stdout:1340( 60 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.918 INFO:tasks.workunit.client.0.smithi163.stdout:1341( 61 mod 256): MAPREAD 0x77521 thru 0x7923a (0x1d1a bytes) 2023-07-14T18:17:17.919 INFO:tasks.workunit.client.0.smithi163.stdout:1342( 62 mod 256): WRITE 0x4cc64 thru 0x53a73 (0x6e10 bytes) 2023-07-14T18:17:17.919 INFO:tasks.workunit.client.0.smithi163.stdout:1343( 63 mod 256): READ 0x20656 thru 0x20c90 (0x63b bytes) 2023-07-14T18:17:17.919 INFO:tasks.workunit.client.0.smithi163.stdout:1344( 64 mod 256): FALLOC 0x86e7a thru 0x95d49 (0xeecf bytes) INTERIOR 2023-07-14T18:17:17.919 INFO:tasks.workunit.client.0.smithi163.stdout:1345( 65 mod 256): MAPREAD 0x3815e thru 0x44c1b (0xcabe bytes) ***RRRR*** 2023-07-14T18:17:17.919 INFO:tasks.workunit.client.0.smithi163.stdout:1346( 66 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.919 INFO:tasks.workunit.client.0.smithi163.stdout:1347( 67 mod 256): TRUNCATE DOWN from 0xfb51b to 0x157ce ******WWWW 2023-07-14T18:17:17.919 INFO:tasks.workunit.client.0.smithi163.stdout:1348( 68 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.919 INFO:tasks.workunit.client.0.smithi163.stdout:1349( 69 mod 256): MAPWRITE 0xc9a3a thru 0xc9f62 (0x529 bytes) 2023-07-14T18:17:17.920 INFO:tasks.workunit.client.0.smithi163.stdout:1350( 70 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.920 INFO:tasks.workunit.client.0.smithi163.stdout:1351( 71 mod 256): COPY 0x924b4 thru 0x9d8b0 (0xb3fd bytes) to 0xf1f45 thru 0xfd341 2023-07-14T18:17:17.920 INFO:tasks.workunit.client.0.smithi163.stdout:1352( 72 mod 256): FALLOC 0xe124f thru 0xf0fa2 (0xfd53 bytes) INTERIOR 2023-07-14T18:17:17.920 INFO:tasks.workunit.client.0.smithi163.stdout:1353( 73 mod 256): TRUNCATE DOWN from 0xfd342 to 0x52eb4 2023-07-14T18:17:17.920 INFO:tasks.workunit.client.0.smithi163.stdout:1354( 74 mod 256): MAPREAD 0x4a76a thru 0x4c5f4 (0x1e8b bytes) 2023-07-14T18:17:17.920 INFO:tasks.workunit.client.0.smithi163.stdout:1355( 75 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.920 INFO:tasks.workunit.client.0.smithi163.stdout:1356( 76 mod 256): WRITE 0xf17bd thru 0xf70fb (0x593f bytes) HOLE 2023-07-14T18:17:17.920 INFO:tasks.workunit.client.0.smithi163.stdout:1357( 77 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.921 INFO:tasks.workunit.client.0.smithi163.stdout:1358( 78 mod 256): READ 0xaa33e thru 0xb45b4 (0xa277 bytes) 2023-07-14T18:17:17.921 INFO:tasks.workunit.client.0.smithi163.stdout:1359( 79 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.921 INFO:tasks.workunit.client.0.smithi163.stdout:1360( 80 mod 256): MAPREAD 0xada37 thru 0xbb767 (0xdd31 bytes) 2023-07-14T18:17:17.921 INFO:tasks.workunit.client.0.smithi163.stdout:1361( 81 mod 256): PUNCH 0xf1208 thru 0xf54b3 (0x42ac bytes) 2023-07-14T18:17:17.921 INFO:tasks.workunit.client.0.smithi163.stdout:1362( 82 mod 256): READ 0xee893 thru 0xf1e45 (0x35b3 bytes) 2023-07-14T18:17:17.921 INFO:tasks.workunit.client.0.smithi163.stdout:1363( 83 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.921 INFO:tasks.workunit.client.0.smithi163.stdout:1364( 84 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.921 INFO:tasks.workunit.client.0.smithi163.stdout:1365( 85 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.922 INFO:tasks.workunit.client.0.smithi163.stdout:1366( 86 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.922 INFO:tasks.workunit.client.0.smithi163.stdout:1367( 87 mod 256): MAPREAD 0x6cc29 thru 0x706e6 (0x3abe bytes) 2023-07-14T18:17:17.922 INFO:tasks.workunit.client.0.smithi163.stdout:1368( 88 mod 256): MAPWRITE 0x527c4 thru 0x583a5 (0x5be2 bytes) 2023-07-14T18:17:17.922 INFO:tasks.workunit.client.0.smithi163.stdout:1369( 89 mod 256): READ 0xae026 thru 0xb67b2 (0x878d bytes) 2023-07-14T18:17:17.922 INFO:tasks.workunit.client.0.smithi163.stdout:1370( 90 mod 256): TRUNCATE DOWN from 0xf70fc to 0x2d4f9 ******WWWW 2023-07-14T18:17:17.922 INFO:tasks.workunit.client.0.smithi163.stdout:1371( 91 mod 256): PUNCH 0x2bbc7 thru 0x2c56b (0x9a5 bytes) 2023-07-14T18:17:17.922 INFO:tasks.workunit.client.0.smithi163.stdout:1372( 92 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.922 INFO:tasks.workunit.client.0.smithi163.stdout:1373( 93 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.923 INFO:tasks.workunit.client.0.smithi163.stdout:1374( 94 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.923 INFO:tasks.workunit.client.0.smithi163.stdout:1375( 95 mod 256): READ 0x1d40b thru 0x1f875 (0x246b bytes) 2023-07-14T18:17:17.923 INFO:tasks.workunit.client.0.smithi163.stdout:1376( 96 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.923 INFO:tasks.workunit.client.0.smithi163.stdout:1377( 97 mod 256): PUNCH 0x28bb7 thru 0x2d4f8 (0x4942 bytes) 2023-07-14T18:17:17.923 INFO:tasks.workunit.client.0.smithi163.stdout:1378( 98 mod 256): MAPWRITE 0x41f1 thru 0x6b4c (0x295c bytes) 2023-07-14T18:17:17.923 INFO:tasks.workunit.client.0.smithi163.stdout:1379( 99 mod 256): MAPREAD 0x1180a thru 0x20cf9 (0xf4f0 bytes) 2023-07-14T18:17:17.923 INFO:tasks.workunit.client.0.smithi163.stdout:1380(100 mod 256): WRITE 0x918ea thru 0x9aa99 (0x91b0 bytes) HOLE ***WWWW 2023-07-14T18:17:17.923 INFO:tasks.workunit.client.0.smithi163.stdout:1381(101 mod 256): READ 0x7ece5 thru 0x84403 (0x571f bytes) 2023-07-14T18:17:17.924 INFO:tasks.workunit.client.0.smithi163.stdout:1382(102 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.924 INFO:tasks.workunit.client.0.smithi163.stdout:1383(103 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.924 INFO:tasks.workunit.client.0.smithi163.stdout:1384(104 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.924 INFO:tasks.workunit.client.0.smithi163.stdout:1385(105 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.924 INFO:tasks.workunit.client.0.smithi163.stdout:1386(106 mod 256): COPY 0x4eb90 thru 0x4f806 (0xc77 bytes) to 0xc6f25 thru 0xc7b9b 2023-07-14T18:17:17.924 INFO:tasks.workunit.client.0.smithi163.stdout:1387(107 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.924 INFO:tasks.workunit.client.0.smithi163.stdout:1388(108 mod 256): PUNCH 0x3ec4f thru 0x3feac (0x125e bytes) 2023-07-14T18:17:17.924 INFO:tasks.workunit.client.0.smithi163.stdout:1389(109 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.925 INFO:tasks.workunit.client.0.smithi163.stdout:1390(110 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.925 INFO:tasks.workunit.client.0.smithi163.stdout:1391(111 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.925 INFO:tasks.workunit.client.0.smithi163.stdout:1392(112 mod 256): WRITE 0x53458 thru 0x53e33 (0x9dc bytes) 2023-07-14T18:17:17.925 INFO:tasks.workunit.client.0.smithi163.stdout:1393(113 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.925 INFO:tasks.workunit.client.0.smithi163.stdout:1394(114 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.925 INFO:tasks.workunit.client.0.smithi163.stdout:1395(115 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.925 INFO:tasks.workunit.client.0.smithi163.stdout:1396(116 mod 256): TRUNCATE DOWN from 0xc7b9c to 0x41319 2023-07-14T18:17:17.925 INFO:tasks.workunit.client.0.smithi163.stdout:1397(117 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.926 INFO:tasks.workunit.client.0.smithi163.stdout:1398(118 mod 256): MAPREAD 0x389ce thru 0x3efd7 (0x660a bytes) 2023-07-14T18:17:17.926 INFO:tasks.workunit.client.0.smithi163.stdout:1399(119 mod 256): MAPWRITE 0xf1ec1 thru 0xf6bd8 (0x4d18 bytes) 2023-07-14T18:17:17.926 INFO:tasks.workunit.client.0.smithi163.stdout:1400(120 mod 256): MAPWRITE 0xaa27 thru 0xeaf8 (0x40d2 bytes) 2023-07-14T18:17:17.926 INFO:tasks.workunit.client.0.smithi163.stdout:1401(121 mod 256): READ 0x8ed63 thru 0x91458 (0x26f6 bytes) 2023-07-14T18:17:17.926 INFO:tasks.workunit.client.0.smithi163.stdout:1402(122 mod 256): TRUNCATE DOWN from 0xf6bd9 to 0x34717 ******WWWW 2023-07-14T18:17:17.926 INFO:tasks.workunit.client.0.smithi163.stdout:1403(123 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.926 INFO:tasks.workunit.client.0.smithi163.stdout:1404(124 mod 256): WRITE 0x80299 thru 0x8fa6e (0xf7d6 bytes) HOLE ***WWWW 2023-07-14T18:17:17.926 INFO:tasks.workunit.client.0.smithi163.stdout:1405(125 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.927 INFO:tasks.workunit.client.0.smithi163.stdout:1406(126 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.927 INFO:tasks.workunit.client.0.smithi163.stdout:1407(127 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.927 INFO:tasks.workunit.client.0.smithi163.stdout:1408(128 mod 256): READ 0x2389 thru 0x7702 (0x537a bytes) 2023-07-14T18:17:17.927 INFO:tasks.workunit.client.0.smithi163.stdout:1409(129 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.927 INFO:tasks.workunit.client.0.smithi163.stdout:1410(130 mod 256): TRUNCATE UP from 0x8fa6f to 0xe0233 2023-07-14T18:17:17.927 INFO:tasks.workunit.client.0.smithi163.stdout:1411(131 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.927 INFO:tasks.workunit.client.0.smithi163.stdout:1412(132 mod 256): PUNCH 0xac9fd thru 0xb7f15 (0xb519 bytes) 2023-07-14T18:17:17.927 INFO:tasks.workunit.client.0.smithi163.stdout:1413(133 mod 256): WRITE 0xdc24d thru 0xeb285 (0xf039 bytes) EXTEND 2023-07-14T18:17:17.928 INFO:tasks.workunit.client.0.smithi163.stdout:1414(134 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.928 INFO:tasks.workunit.client.0.smithi163.stdout:1415(135 mod 256): COPY 0xae779 thru 0xbc18b (0xda13 bytes) to 0x3e6a4 thru 0x4c0b6 2023-07-14T18:17:17.928 INFO:tasks.workunit.client.0.smithi163.stdout:1416(136 mod 256): FALLOC 0x770ee thru 0x7fbdb (0x8aed bytes) INTERIOR 2023-07-14T18:17:17.928 INFO:tasks.workunit.client.0.smithi163.stdout:1417(137 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.928 INFO:tasks.workunit.client.0.smithi163.stdout:1418(138 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.928 INFO:tasks.workunit.client.0.smithi163.stdout:1419(139 mod 256): READ 0xdba29 thru 0xe3ef8 (0x84d0 bytes) 2023-07-14T18:17:17.928 INFO:tasks.workunit.client.0.smithi163.stdout:1420(140 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.928 INFO:tasks.workunit.client.0.smithi163.stdout:1421(141 mod 256): FALLOC 0x4f0bc thru 0x53567 (0x44ab bytes) INTERIOR 2023-07-14T18:17:17.929 INFO:tasks.workunit.client.0.smithi163.stdout:1422(142 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.929 INFO:tasks.workunit.client.0.smithi163.stdout:1423(143 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.929 INFO:tasks.workunit.client.0.smithi163.stdout:1424(144 mod 256): PUNCH 0xd1e8 thru 0x18fdd (0xbdf6 bytes) 2023-07-14T18:17:17.929 INFO:tasks.workunit.client.0.smithi163.stdout:1425(145 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.929 INFO:tasks.workunit.client.0.smithi163.stdout:1426(146 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.929 INFO:tasks.workunit.client.0.smithi163.stdout:1427(147 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.929 INFO:tasks.workunit.client.0.smithi163.stdout:1428(148 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.929 INFO:tasks.workunit.client.0.smithi163.stdout:1429(149 mod 256): COPY 0x31b5b thru 0x360c9 (0x456f bytes) to 0x5a199 thru 0x5e707 2023-07-14T18:17:17.930 INFO:tasks.workunit.client.0.smithi163.stdout:1430(150 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.930 INFO:tasks.workunit.client.0.smithi163.stdout:1431(151 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.930 INFO:tasks.workunit.client.0.smithi163.stdout:1432(152 mod 256): MAPWRITE 0x1ea70 thru 0x2c1b4 (0xd745 bytes) 2023-07-14T18:17:17.930 INFO:tasks.workunit.client.0.smithi163.stdout:1433(153 mod 256): TRUNCATE DOWN from 0xeb286 to 0x12948 ******WWWW 2023-07-14T18:17:17.930 INFO:tasks.workunit.client.0.smithi163.stdout:1434(154 mod 256): MAPWRITE 0xdee4d thru 0xeecff (0xfeb3 bytes) 2023-07-14T18:17:17.930 INFO:tasks.workunit.client.0.smithi163.stdout:1435(155 mod 256): WRITE 0x2c5ed thru 0x3250a (0x5f1e bytes) 2023-07-14T18:17:17.930 INFO:tasks.workunit.client.0.smithi163.stdout:1436(156 mod 256): PUNCH 0xd239b thru 0xdbc8f (0x98f5 bytes) 2023-07-14T18:17:17.931 INFO:tasks.workunit.client.0.smithi163.stdout:1437(157 mod 256): FALLOC 0x92c17 thru 0x97647 (0x4a30 bytes) INTERIOR 2023-07-14T18:17:17.931 INFO:tasks.workunit.client.0.smithi163.stdout:1438(158 mod 256): PUNCH 0x96b94 thru 0x9776a (0xbd7 bytes) 2023-07-14T18:17:17.931 INFO:tasks.workunit.client.0.smithi163.stdout:1439(159 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.931 INFO:tasks.workunit.client.0.smithi163.stdout:1440(160 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.931 INFO:tasks.workunit.client.0.smithi163.stdout:1441(161 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.931 INFO:tasks.workunit.client.0.smithi163.stdout:1442(162 mod 256): READ 0x5365d thru 0x5a4dc (0x6e80 bytes) 2023-07-14T18:17:17.931 INFO:tasks.workunit.client.0.smithi163.stdout:1443(163 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.931 INFO:tasks.workunit.client.0.smithi163.stdout:1444(164 mod 256): MAPWRITE 0x2448c thru 0x29a58 (0x55cd bytes) 2023-07-14T18:17:17.932 INFO:tasks.workunit.client.0.smithi163.stdout:1445(165 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.932 INFO:tasks.workunit.client.0.smithi163.stdout:1446(166 mod 256): FALLOC 0x53702 thru 0x5fb03 (0xc401 bytes) INTERIOR 2023-07-14T18:17:17.932 INFO:tasks.workunit.client.0.smithi163.stdout:1447(167 mod 256): FALLOC 0x2870d thru 0x331c7 (0xaaba bytes) INTERIOR 2023-07-14T18:17:17.932 INFO:tasks.workunit.client.0.smithi163.stdout:1448(168 mod 256): WRITE 0xa29ee thru 0xabbad (0x91c0 bytes) 2023-07-14T18:17:17.932 INFO:tasks.workunit.client.0.smithi163.stdout:1449(169 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.932 INFO:tasks.workunit.client.0.smithi163.stdout:1450(170 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.932 INFO:tasks.workunit.client.0.smithi163.stdout:1451(171 mod 256): MAPWRITE 0x39de2 thru 0x4789e (0xdabd bytes) 2023-07-14T18:17:17.932 INFO:tasks.workunit.client.0.smithi163.stdout:1452(172 mod 256): MAPREAD 0x7846e thru 0x879da (0xf56d bytes) 2023-07-14T18:17:17.933 INFO:tasks.workunit.client.0.smithi163.stdout:1453(173 mod 256): COPY 0xc1727 thru 0xc76a6 (0x5f80 bytes) to 0xac631 thru 0xb25b0 2023-07-14T18:17:17.933 INFO:tasks.workunit.client.0.smithi163.stdout:1454(174 mod 256): READ 0x1162e thru 0x1cd23 (0xb6f6 bytes) 2023-07-14T18:17:17.933 INFO:tasks.workunit.client.0.smithi163.stdout:1455(175 mod 256): PUNCH 0x2dc15 thru 0x39a77 (0xbe63 bytes) ******PPPP 2023-07-14T18:17:17.933 INFO:tasks.workunit.client.0.smithi163.stdout:1456(176 mod 256): READ 0x42fe thru 0x9529 (0x522c bytes) 2023-07-14T18:17:17.933 INFO:tasks.workunit.client.0.smithi163.stdout:1457(177 mod 256): MAPREAD 0x25ad6 thru 0x35507 (0xfa32 bytes) 2023-07-14T18:17:17.933 INFO:tasks.workunit.client.0.smithi163.stdout:1458(178 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.933 INFO:tasks.workunit.client.0.smithi163.stdout:1459(179 mod 256): COPY 0x3e3c0 thru 0x491cd (0xae0e bytes) to 0xa3ead thru 0xaecba 2023-07-14T18:17:17.933 INFO:tasks.workunit.client.0.smithi163.stdout:1460(180 mod 256): READ 0x33ec thru 0x8057 (0x4c6c bytes) 2023-07-14T18:17:17.934 INFO:tasks.workunit.client.0.smithi163.stdout:1461(181 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.934 INFO:tasks.workunit.client.0.smithi163.stdout:1462(182 mod 256): READ 0x8394 thru 0x16b26 (0xe793 bytes) 2023-07-14T18:17:17.934 INFO:tasks.workunit.client.0.smithi163.stdout:1463(183 mod 256): READ 0x7d77e thru 0x80ecf (0x3752 bytes) 2023-07-14T18:17:17.934 INFO:tasks.workunit.client.0.smithi163.stdout:1464(184 mod 256): WRITE 0x6938c thru 0x6a52a (0x119f bytes) 2023-07-14T18:17:17.934 INFO:tasks.workunit.client.0.smithi163.stdout:1465(185 mod 256): WRITE 0x17abb thru 0x20d29 (0x926f bytes) 2023-07-14T18:17:17.934 INFO:tasks.workunit.client.0.smithi163.stdout:1466(186 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.934 INFO:tasks.workunit.client.0.smithi163.stdout:1467(187 mod 256): READ 0x927b4 thru 0x9463a (0x1e87 bytes) 2023-07-14T18:17:17.934 INFO:tasks.workunit.client.0.smithi163.stdout:1468(188 mod 256): READ 0x33ac5 thru 0x3d93a (0x9e76 bytes) ***RRRR*** 2023-07-14T18:17:17.935 INFO:tasks.workunit.client.0.smithi163.stdout:1469(189 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.935 INFO:tasks.workunit.client.0.smithi163.stdout:1470(190 mod 256): PUNCH 0x60e88 thru 0x6eed2 (0xe04b bytes) 2023-07-14T18:17:17.935 INFO:tasks.workunit.client.0.smithi163.stdout:1471(191 mod 256): FALLOC 0x893a thru 0xe30a (0x59d0 bytes) INTERIOR 2023-07-14T18:17:17.935 INFO:tasks.workunit.client.0.smithi163.stdout:1472(192 mod 256): COPY 0x5900a thru 0x5ad7b (0x1d72 bytes) to 0x69331 thru 0x6b0a2 2023-07-14T18:17:17.935 INFO:tasks.workunit.client.0.smithi163.stdout:1473(193 mod 256): MAPWRITE 0xb40c9 thru 0xc12a5 (0xd1dd bytes) 2023-07-14T18:17:17.935 INFO:tasks.workunit.client.0.smithi163.stdout:1474(194 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.935 INFO:tasks.workunit.client.0.smithi163.stdout:1475(195 mod 256): READ 0x6b131 thru 0x74115 (0x8fe5 bytes) 2023-07-14T18:17:17.935 INFO:tasks.workunit.client.0.smithi163.stdout:1476(196 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.936 INFO:tasks.workunit.client.0.smithi163.stdout:1477(197 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.936 INFO:tasks.workunit.client.0.smithi163.stdout:1478(198 mod 256): PUNCH 0x84ac2 thru 0x90b8b (0xc0ca bytes) 2023-07-14T18:17:17.936 INFO:tasks.workunit.client.0.smithi163.stdout:1479(199 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.936 INFO:tasks.workunit.client.0.smithi163.stdout:1480(200 mod 256): READ 0x99359 thru 0xa1700 (0x83a8 bytes) 2023-07-14T18:17:17.936 INFO:tasks.workunit.client.0.smithi163.stdout:1481(201 mod 256): WRITE 0x6fd9d thru 0x7a314 (0xa578 bytes) 2023-07-14T18:17:17.936 INFO:tasks.workunit.client.0.smithi163.stdout:1482(202 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.936 INFO:tasks.workunit.client.0.smithi163.stdout:1483(203 mod 256): MAPWRITE 0x8b409 thru 0x992ad (0xdea5 bytes) 2023-07-14T18:17:17.936 INFO:tasks.workunit.client.0.smithi163.stdout:1484(204 mod 256): TRUNCATE DOWN from 0xeed00 to 0x6a79d 2023-07-14T18:17:17.937 INFO:tasks.workunit.client.0.smithi163.stdout:1485(205 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.937 INFO:tasks.workunit.client.0.smithi163.stdout:1486(206 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.937 INFO:tasks.workunit.client.0.smithi163.stdout:1487(207 mod 256): READ 0x41dea thru 0x4971d (0x7934 bytes) 2023-07-14T18:17:17.937 INFO:tasks.workunit.client.0.smithi163.stdout:1488(208 mod 256): PUNCH 0x153d0 thru 0x167f0 (0x1421 bytes) 2023-07-14T18:17:17.937 INFO:tasks.workunit.client.0.smithi163.stdout:1489(209 mod 256): TRUNCATE UP from 0x6a79d to 0xfbc42 2023-07-14T18:17:17.937 INFO:tasks.workunit.client.0.smithi163.stdout:1490(210 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.937 INFO:tasks.workunit.client.0.smithi163.stdout:1491(211 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.937 INFO:tasks.workunit.client.0.smithi163.stdout:1492(212 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.938 INFO:tasks.workunit.client.0.smithi163.stdout:1493(213 mod 256): COPY 0xb724e thru 0xc2709 (0xb4bc bytes) to 0x489a8 thru 0x53e63 2023-07-14T18:17:17.938 INFO:tasks.workunit.client.0.smithi163.stdout:1494(214 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.938 INFO:tasks.workunit.client.0.smithi163.stdout:1495(215 mod 256): FALLOC 0xd76f4 thru 0xda8ac (0x31b8 bytes) INTERIOR 2023-07-14T18:17:17.938 INFO:tasks.workunit.client.0.smithi163.stdout:1496(216 mod 256): READ 0xb17c8 thru 0xbd44a (0xbc83 bytes) 2023-07-14T18:17:17.938 INFO:tasks.workunit.client.0.smithi163.stdout:1497(217 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.938 INFO:tasks.workunit.client.0.smithi163.stdout:1498(218 mod 256): FALLOC 0x74a8d thru 0x7fb59 (0xb0cc bytes) INTERIOR 2023-07-14T18:17:17.938 INFO:tasks.workunit.client.0.smithi163.stdout:1499(219 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.938 INFO:tasks.workunit.client.0.smithi163.stdout:1500(220 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.939 INFO:tasks.workunit.client.0.smithi163.stdout:1501(221 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.939 INFO:tasks.workunit.client.0.smithi163.stdout:1502(222 mod 256): MAPWRITE 0x82ef1 thru 0x89c61 (0x6d71 bytes) 2023-07-14T18:17:17.939 INFO:tasks.workunit.client.0.smithi163.stdout:1503(223 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.939 INFO:tasks.workunit.client.0.smithi163.stdout:1504(224 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.939 INFO:tasks.workunit.client.0.smithi163.stdout:1505(225 mod 256): MAPWRITE 0xc0476 thru 0xca844 (0xa3cf bytes) 2023-07-14T18:17:17.939 INFO:tasks.workunit.client.0.smithi163.stdout:1506(226 mod 256): READ 0x6639d thru 0x6a70b (0x436f bytes) 2023-07-14T18:17:17.939 INFO:tasks.workunit.client.0.smithi163.stdout:1507(227 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.939 INFO:tasks.workunit.client.0.smithi163.stdout:1508(228 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.940 INFO:tasks.workunit.client.0.smithi163.stdout:1509(229 mod 256): MAPWRITE 0x217b2 thru 0x2df19 (0xc768 bytes) 2023-07-14T18:17:17.940 INFO:tasks.workunit.client.0.smithi163.stdout:1510(230 mod 256): MAPWRITE 0x13c30 thru 0x1d6b6 (0x9a87 bytes) 2023-07-14T18:17:17.940 INFO:tasks.workunit.client.0.smithi163.stdout:1511(231 mod 256): TRUNCATE DOWN from 0xfbc42 to 0x936e6 2023-07-14T18:17:17.940 INFO:tasks.workunit.client.0.smithi163.stdout:1512(232 mod 256): FALLOC 0xce26a thru 0xd22f0 (0x4086 bytes) PAST_EOF 2023-07-14T18:17:17.940 INFO:tasks.workunit.client.0.smithi163.stdout:1513(233 mod 256): READ 0x801a9 thru 0x85f3c (0x5d94 bytes) 2023-07-14T18:17:17.940 INFO:tasks.workunit.client.0.smithi163.stdout:1514(234 mod 256): WRITE 0x33f0a thru 0x3959c (0x5693 bytes) ***WWWW 2023-07-14T18:17:17.940 INFO:tasks.workunit.client.0.smithi163.stdout:1515(235 mod 256): TRUNCATE DOWN from 0x936e6 to 0x8839 ******WWWW 2023-07-14T18:17:17.940 INFO:tasks.workunit.client.0.smithi163.stdout:1516(236 mod 256): TRUNCATE UP from 0x8839 to 0xfab31 ******WWWW 2023-07-14T18:17:17.941 INFO:tasks.workunit.client.0.smithi163.stdout:1517(237 mod 256): READ 0x2c3ed thru 0x31071 (0x4c85 bytes) 2023-07-14T18:17:17.941 INFO:tasks.workunit.client.0.smithi163.stdout:1518(238 mod 256): COPY 0xbaa8a thru 0xbf050 (0x45c7 bytes) to 0x13c49 thru 0x1820f 2023-07-14T18:17:17.941 INFO:tasks.workunit.client.0.smithi163.stdout:1519(239 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.941 INFO:tasks.workunit.client.0.smithi163.stdout:1520(240 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.941 INFO:tasks.workunit.client.0.smithi163.stdout:1521(241 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.941 INFO:tasks.workunit.client.0.smithi163.stdout:1522(242 mod 256): MAPWRITE 0xf6a61 thru 0xfafc4 (0x4564 bytes) 2023-07-14T18:17:17.941 INFO:tasks.workunit.client.0.smithi163.stdout:1523(243 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.941 INFO:tasks.workunit.client.0.smithi163.stdout:1524(244 mod 256): MAPREAD 0xef872 thru 0xf9c41 (0xa3d0 bytes) 2023-07-14T18:17:17.942 INFO:tasks.workunit.client.0.smithi163.stdout:1525(245 mod 256): MAPWRITE 0xbf7d7 thru 0xcd8d6 (0xe100 bytes) 2023-07-14T18:17:17.942 INFO:tasks.workunit.client.0.smithi163.stdout:1526(246 mod 256): READ 0x9ba7f thru 0x9f925 (0x3ea7 bytes) 2023-07-14T18:17:17.942 INFO:tasks.workunit.client.0.smithi163.stdout:1527(247 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.942 INFO:tasks.workunit.client.0.smithi163.stdout:1528(248 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.942 INFO:tasks.workunit.client.0.smithi163.stdout:1529(249 mod 256): READ 0xc9be0 thru 0xd4c48 (0xb069 bytes) 2023-07-14T18:17:17.942 INFO:tasks.workunit.client.0.smithi163.stdout:1530(250 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.942 INFO:tasks.workunit.client.0.smithi163.stdout:1531(251 mod 256): WRITE 0xdfc9b thru 0xed04d (0xd3b3 bytes) 2023-07-14T18:17:17.942 INFO:tasks.workunit.client.0.smithi163.stdout:1532(252 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.943 INFO:tasks.workunit.client.0.smithi163.stdout:1533(253 mod 256): TRUNCATE DOWN from 0xfafc5 to 0x3304a ******WWWW 2023-07-14T18:17:17.943 INFO:tasks.workunit.client.0.smithi163.stdout:1534(254 mod 256): PUNCH 0x221 thru 0x7edf (0x7cbf bytes) 2023-07-14T18:17:17.943 INFO:tasks.workunit.client.0.smithi163.stdout:1535(255 mod 256): WRITE 0x20688 thru 0x2352b (0x2ea4 bytes) 2023-07-14T18:17:17.943 INFO:tasks.workunit.client.0.smithi163.stdout:1536( 0 mod 256): FALLOC 0xf4e22 thru 0x100000 (0xb1de bytes) PAST_EOF 2023-07-14T18:17:17.943 INFO:tasks.workunit.client.0.smithi163.stdout:1537( 1 mod 256): FALLOC 0x41fd7 thru 0x42e9a (0xec3 bytes) PAST_EOF 2023-07-14T18:17:17.943 INFO:tasks.workunit.client.0.smithi163.stdout:1538( 2 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.943 INFO:tasks.workunit.client.0.smithi163.stdout:1539( 3 mod 256): FALLOC 0x9ce44 thru 0x9e174 (0x1330 bytes) EXTENDING 2023-07-14T18:17:17.943 INFO:tasks.workunit.client.0.smithi163.stdout:1540( 4 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.944 INFO:tasks.workunit.client.0.smithi163.stdout:1541( 5 mod 256): MAPWRITE 0x7eb5a thru 0x8a0e3 (0xb58a bytes) 2023-07-14T18:17:17.944 INFO:tasks.workunit.client.0.smithi163.stdout:1542( 6 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.944 INFO:tasks.workunit.client.0.smithi163.stdout:1543( 7 mod 256): MAPWRITE 0x271bd thru 0x2fb1e (0x8962 bytes) 2023-07-14T18:17:17.944 INFO:tasks.workunit.client.0.smithi163.stdout:1544( 8 mod 256): MAPWRITE 0xe6af7 thru 0xf4107 (0xd611 bytes) 2023-07-14T18:17:17.944 INFO:tasks.workunit.client.0.smithi163.stdout:1545( 9 mod 256): COPY 0x70046 thru 0x7d015 (0xcfd0 bytes) to 0x4b71e thru 0x586ed 2023-07-14T18:17:17.944 INFO:tasks.workunit.client.0.smithi163.stdout:1546( 10 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.944 INFO:tasks.workunit.client.0.smithi163.stdout:1547( 11 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.944 INFO:tasks.workunit.client.0.smithi163.stdout:1548( 12 mod 256): WRITE 0xe899b thru 0xf86de (0xfd44 bytes) EXTEND 2023-07-14T18:17:17.945 INFO:tasks.workunit.client.0.smithi163.stdout:1549( 13 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.945 INFO:tasks.workunit.client.0.smithi163.stdout:1550( 14 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.945 INFO:tasks.workunit.client.0.smithi163.stdout:1551( 15 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.945 INFO:tasks.workunit.client.0.smithi163.stdout:1552( 16 mod 256): TRUNCATE DOWN from 0xf86df to 0x636d1 2023-07-14T18:17:17.945 INFO:tasks.workunit.client.0.smithi163.stdout:1553( 17 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.945 INFO:tasks.workunit.client.0.smithi163.stdout:1554( 18 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.945 INFO:tasks.workunit.client.0.smithi163.stdout:1555( 19 mod 256): COPY 0xece2 thru 0xf2d3 (0x5f2 bytes) to 0xbb638 thru 0xbbc29 2023-07-14T18:17:17.945 INFO:tasks.workunit.client.0.smithi163.stdout:1556( 20 mod 256): READ 0x3e46c thru 0x46c92 (0x8827 bytes) 2023-07-14T18:17:17.946 INFO:tasks.workunit.client.0.smithi163.stdout:1557( 21 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.946 INFO:tasks.workunit.client.0.smithi163.stdout:1558( 22 mod 256): TRUNCATE DOWN from 0xbbc2a to 0x2d603 ******WWWW 2023-07-14T18:17:17.946 INFO:tasks.workunit.client.0.smithi163.stdout:1559( 23 mod 256): MAPWRITE 0xa469e thru 0xb44cb (0xfe2e bytes) 2023-07-14T18:17:17.946 INFO:tasks.workunit.client.0.smithi163.stdout:1560( 24 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.946 INFO:tasks.workunit.client.0.smithi163.stdout:1561( 25 mod 256): WRITE 0xa060c thru 0xadb75 (0xd56a bytes) 2023-07-14T18:17:17.946 INFO:tasks.workunit.client.0.smithi163.stdout:1562( 26 mod 256): FALLOC 0xccc11 thru 0xcd56a (0x959 bytes) EXTENDING 2023-07-14T18:17:17.946 INFO:tasks.workunit.client.0.smithi163.stdout:1563( 27 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.946 INFO:tasks.workunit.client.0.smithi163.stdout:1564( 28 mod 256): WRITE 0x6305a thru 0x6312d (0xd4 bytes) 2023-07-14T18:17:17.947 INFO:tasks.workunit.client.0.smithi163.stdout:1565( 29 mod 256): WRITE 0xf2d15 thru 0xf6061 (0x334d bytes) HOLE 2023-07-14T18:17:17.947 INFO:tasks.workunit.client.0.smithi163.stdout:1566( 30 mod 256): COPY 0x4f95a thru 0x588b2 (0x8f59 bytes) to 0xddcf3 thru 0xe6c4b 2023-07-14T18:17:17.947 INFO:tasks.workunit.client.0.smithi163.stdout:1567( 31 mod 256): MAPWRITE 0x2b1fb thru 0x324b8 (0x72be bytes) 2023-07-14T18:17:17.947 INFO:tasks.workunit.client.0.smithi163.stdout:1568( 32 mod 256): MAPREAD 0xea022 thru 0xf6061 (0xc040 bytes) 2023-07-14T18:17:17.947 INFO:tasks.workunit.client.0.smithi163.stdout:1569( 33 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.947 INFO:tasks.workunit.client.0.smithi163.stdout:1570( 34 mod 256): PUNCH 0x8c5ff thru 0x9876f (0xc171 bytes) 2023-07-14T18:17:17.947 INFO:tasks.workunit.client.0.smithi163.stdout:1571( 35 mod 256): FALLOC 0xd1059 thru 0xd4b78 (0x3b1f bytes) INTERIOR 2023-07-14T18:17:17.947 INFO:tasks.workunit.client.0.smithi163.stdout:1572( 36 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.948 INFO:tasks.workunit.client.0.smithi163.stdout:1573( 37 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.948 INFO:tasks.workunit.client.0.smithi163.stdout:1574( 38 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.948 INFO:tasks.workunit.client.0.smithi163.stdout:1575( 39 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.948 INFO:tasks.workunit.client.0.smithi163.stdout:1576( 40 mod 256): PUNCH 0x50ad2 thru 0x57486 (0x69b5 bytes) 2023-07-14T18:17:17.948 INFO:tasks.workunit.client.0.smithi163.stdout:1577( 41 mod 256): PUNCH 0x5b687 thru 0x62f07 (0x7881 bytes) 2023-07-14T18:17:17.948 INFO:tasks.workunit.client.0.smithi163.stdout:1578( 42 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.948 INFO:tasks.workunit.client.0.smithi163.stdout:1579( 43 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.949 INFO:tasks.workunit.client.0.smithi163.stdout:1580( 44 mod 256): MAPWRITE 0x8528b thru 0x935a3 (0xe319 bytes) 2023-07-14T18:17:17.949 INFO:tasks.workunit.client.0.smithi163.stdout:1581( 45 mod 256): FALLOC 0x381e4 thru 0x401fe (0x801a bytes) INTERIOR ******FFFF 2023-07-14T18:17:17.949 INFO:tasks.workunit.client.0.smithi163.stdout:1582( 46 mod 256): TRUNCATE DOWN from 0xf6062 to 0x91605 2023-07-14T18:17:17.949 INFO:tasks.workunit.client.0.smithi163.stdout:1583( 47 mod 256): TRUNCATE UP from 0x91605 to 0x946a9 2023-07-14T18:17:17.949 INFO:tasks.workunit.client.0.smithi163.stdout:1584( 48 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.949 INFO:tasks.workunit.client.0.smithi163.stdout:1585( 49 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.949 INFO:tasks.workunit.client.0.smithi163.stdout:1586( 50 mod 256): WRITE 0x8ec86 thru 0x9a5b3 (0xb92e bytes) EXTEND 2023-07-14T18:17:17.949 INFO:tasks.workunit.client.0.smithi163.stdout:1587( 51 mod 256): MAPREAD 0x523c5 thru 0x5fb2d (0xd769 bytes) 2023-07-14T18:17:17.950 INFO:tasks.workunit.client.0.smithi163.stdout:1588( 52 mod 256): MAPREAD 0x8b175 thru 0x9a5b3 (0xf43f bytes) 2023-07-14T18:17:17.950 INFO:tasks.workunit.client.0.smithi163.stdout:1589( 53 mod 256): COPY 0x61a43 thru 0x68f0c (0x74ca bytes) to 0x7c834 thru 0x83cfd 2023-07-14T18:17:17.950 INFO:tasks.workunit.client.0.smithi163.stdout:1590( 54 mod 256): TRUNCATE DOWN from 0x9a5b4 to 0x3d297 2023-07-14T18:17:17.950 INFO:tasks.workunit.client.0.smithi163.stdout:1591( 55 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.950 INFO:tasks.workunit.client.0.smithi163.stdout:1592( 56 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.950 INFO:tasks.workunit.client.0.smithi163.stdout:1593( 57 mod 256): MAPWRITE 0x9a06f thru 0xa0767 (0x66f9 bytes) 2023-07-14T18:17:17.950 INFO:tasks.workunit.client.0.smithi163.stdout:1594( 58 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.950 INFO:tasks.workunit.client.0.smithi163.stdout:1595( 59 mod 256): MAPWRITE 0x4e033 thru 0x56dcd (0x8d9b bytes) 2023-07-14T18:17:17.951 INFO:tasks.workunit.client.0.smithi163.stdout:1596( 60 mod 256): WRITE 0x44c3d thru 0x4a4bf (0x5883 bytes) 2023-07-14T18:17:17.951 INFO:tasks.workunit.client.0.smithi163.stdout:1597( 61 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.951 INFO:tasks.workunit.client.0.smithi163.stdout:1598( 62 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.951 INFO:tasks.workunit.client.0.smithi163.stdout:1599( 63 mod 256): TRUNCATE UP from 0xa0768 to 0xf330a 2023-07-14T18:17:17.951 INFO:tasks.workunit.client.0.smithi163.stdout:1600( 64 mod 256): WRITE 0xe5bf thru 0x10ec4 (0x2906 bytes) 2023-07-14T18:17:17.951 INFO:tasks.workunit.client.0.smithi163.stdout:1601( 65 mod 256): MAPWRITE 0x2cd1c thru 0x39292 (0xc577 bytes) ******WWWW 2023-07-14T18:17:17.951 INFO:tasks.workunit.client.0.smithi163.stdout:1602( 66 mod 256): WRITE 0x4116c thru 0x477c6 (0x665b bytes) 2023-07-14T18:17:17.951 INFO:tasks.workunit.client.0.smithi163.stdout:1603( 67 mod 256): MAPREAD 0xa6df thru 0x185f2 (0xdf14 bytes) 2023-07-14T18:17:17.952 INFO:tasks.workunit.client.0.smithi163.stdout:1604( 68 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.952 INFO:tasks.workunit.client.0.smithi163.stdout:1605( 69 mod 256): COPY 0xded9 thru 0x1d550 (0xf678 bytes) to 0x69bb8 thru 0x7922f 2023-07-14T18:17:17.952 INFO:tasks.workunit.client.0.smithi163.stdout:1606( 70 mod 256): COPY 0xbc971 thru 0xbd51a (0xbaa bytes) to 0xa6fc3 thru 0xa7b6c 2023-07-14T18:17:17.952 INFO:tasks.workunit.client.0.smithi163.stdout:1607( 71 mod 256): TRUNCATE DOWN from 0xf330a to 0x5f125 2023-07-14T18:17:17.952 INFO:tasks.workunit.client.0.smithi163.stdout:1608( 72 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.952 INFO:tasks.workunit.client.0.smithi163.stdout:1609( 73 mod 256): TRUNCATE UP from 0x5f125 to 0x996d1 2023-07-14T18:17:17.952 INFO:tasks.workunit.client.0.smithi163.stdout:1610( 74 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.953 INFO:tasks.workunit.client.0.smithi163.stdout:1611( 75 mod 256): MAPWRITE 0x4398d thru 0x44187 (0x7fb bytes) 2023-07-14T18:17:17.953 INFO:tasks.workunit.client.0.smithi163.stdout:1612( 76 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.953 INFO:tasks.workunit.client.0.smithi163.stdout:1613( 77 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.953 INFO:tasks.workunit.client.0.smithi163.stdout:1614( 78 mod 256): WRITE 0x1ab3 thru 0xef1a (0xd468 bytes) 2023-07-14T18:17:17.953 INFO:tasks.workunit.client.0.smithi163.stdout:1615( 79 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.953 INFO:tasks.workunit.client.0.smithi163.stdout:1616( 80 mod 256): PUNCH 0x3c6b1 thru 0x45ade (0x942e bytes) 2023-07-14T18:17:17.953 INFO:tasks.workunit.client.0.smithi163.stdout:1617( 81 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.953 INFO:tasks.workunit.client.0.smithi163.stdout:1618( 82 mod 256): WRITE 0xde369 thru 0xe364f (0x52e7 bytes) HOLE 2023-07-14T18:17:17.954 INFO:tasks.workunit.client.0.smithi163.stdout:1619( 83 mod 256): MAPWRITE 0x68f0 thru 0xea4c (0x815d bytes) 2023-07-14T18:17:17.954 INFO:tasks.workunit.client.0.smithi163.stdout:1620( 84 mod 256): READ 0xd6549 thru 0xddbfc (0x76b4 bytes) 2023-07-14T18:17:17.954 INFO:tasks.workunit.client.0.smithi163.stdout:1621( 85 mod 256): TRUNCATE DOWN from 0xe3650 to 0x11d09 ******WWWW 2023-07-14T18:17:17.954 INFO:tasks.workunit.client.0.smithi163.stdout:1622( 86 mod 256): READ 0x2628 thru 0xcbe7 (0xa5c0 bytes) 2023-07-14T18:17:17.954 INFO:tasks.workunit.client.0.smithi163.stdout:1623( 87 mod 256): COPY 0x16bd thru 0xe8a0 (0xd1e4 bytes) to 0x89edf thru 0x970c2 2023-07-14T18:17:17.954 INFO:tasks.workunit.client.0.smithi163.stdout:1624( 88 mod 256): FALLOC 0xe8347 thru 0xeb940 (0x35f9 bytes) EXTENDING 2023-07-14T18:17:17.954 INFO:tasks.workunit.client.0.smithi163.stdout:1625( 89 mod 256): MAPWRITE 0x7c269 thru 0x84e75 (0x8c0d bytes) 2023-07-14T18:17:17.954 INFO:tasks.workunit.client.0.smithi163.stdout:1626( 90 mod 256): COPY 0xbb195 thru 0xc81fb (0xd067 bytes) to 0x5fc33 thru 0x6cc99 2023-07-14T18:17:17.955 INFO:tasks.workunit.client.0.smithi163.stdout:1627( 91 mod 256): WRITE 0x76455 thru 0x8117d (0xad29 bytes) 2023-07-14T18:17:17.955 INFO:tasks.workunit.client.0.smithi163.stdout:1628( 92 mod 256): PUNCH 0xe9279 thru 0xeb93f (0x26c7 bytes) 2023-07-14T18:17:17.955 INFO:tasks.workunit.client.0.smithi163.stdout:1629( 93 mod 256): MAPREAD 0x894ac thru 0x8a897 (0x13ec bytes) 2023-07-14T18:17:17.955 INFO:tasks.workunit.client.0.smithi163.stdout:1630( 94 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.955 INFO:tasks.workunit.client.0.smithi163.stdout:1631( 95 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.955 INFO:tasks.workunit.client.0.smithi163.stdout:1632( 96 mod 256): MAPREAD 0x84af6 thru 0x93f2a (0xf435 bytes) 2023-07-14T18:17:17.955 INFO:tasks.workunit.client.0.smithi163.stdout:1633( 97 mod 256): MAPREAD 0xb9cbf thru 0xbc1ea (0x252c bytes) 2023-07-14T18:17:17.955 INFO:tasks.workunit.client.0.smithi163.stdout:1634( 98 mod 256): TRUNCATE DOWN from 0xeb940 to 0xbea85 2023-07-14T18:17:17.956 INFO:tasks.workunit.client.0.smithi163.stdout:1635( 99 mod 256): TRUNCATE DOWN from 0xbea85 to 0x74e6d 2023-07-14T18:17:17.956 INFO:tasks.workunit.client.0.smithi163.stdout:1636(100 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.956 INFO:tasks.workunit.client.0.smithi163.stdout:1637(101 mod 256): WRITE 0xfdc67 thru 0xfffff (0x2399 bytes) HOLE 2023-07-14T18:17:17.956 INFO:tasks.workunit.client.0.smithi163.stdout:1638(102 mod 256): FALLOC 0xce52 thru 0x113c8 (0x4576 bytes) INTERIOR 2023-07-14T18:17:17.956 INFO:tasks.workunit.client.0.smithi163.stdout:1639(103 mod 256): READ 0x25a0e thru 0x3211d (0xc710 bytes) 2023-07-14T18:17:17.956 INFO:tasks.workunit.client.0.smithi163.stdout:1640(104 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.956 INFO:tasks.workunit.client.0.smithi163.stdout:1641(105 mod 256): MAPWRITE 0x6b843 thru 0x72e7c (0x763a bytes) 2023-07-14T18:17:17.956 INFO:tasks.workunit.client.0.smithi163.stdout:1642(106 mod 256): PUNCH 0x67098 thru 0x6ce5a (0x5dc3 bytes) 2023-07-14T18:17:17.957 INFO:tasks.workunit.client.0.smithi163.stdout:1643(107 mod 256): MAPWRITE 0xa9a9b thru 0xb69a1 (0xcf07 bytes) 2023-07-14T18:17:17.957 INFO:tasks.workunit.client.0.smithi163.stdout:1644(108 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.957 INFO:tasks.workunit.client.0.smithi163.stdout:1645(109 mod 256): MAPWRITE 0xbdb7c thru 0xc7451 (0x98d6 bytes) 2023-07-14T18:17:17.957 INFO:tasks.workunit.client.0.smithi163.stdout:1646(110 mod 256): MAPREAD 0x22d90 thru 0x2335c (0x5cd bytes) 2023-07-14T18:17:17.957 INFO:tasks.workunit.client.0.smithi163.stdout:1647(111 mod 256): FALLOC 0x1f513 thru 0x255ab (0x6098 bytes) INTERIOR 2023-07-14T18:17:17.957 INFO:tasks.workunit.client.0.smithi163.stdout:1648(112 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.957 INFO:tasks.workunit.client.0.smithi163.stdout:1649(113 mod 256): PUNCH 0x3339e thru 0x3f7d4 (0xc437 bytes) ******PPPP 2023-07-14T18:17:17.957 INFO:tasks.workunit.client.0.smithi163.stdout:1650(114 mod 256): WRITE 0xbe460 thru 0xc69f9 (0x859a bytes) 2023-07-14T18:17:17.958 INFO:tasks.workunit.client.0.smithi163.stdout:1651(115 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.958 INFO:tasks.workunit.client.0.smithi163.stdout:1652(116 mod 256): PUNCH 0x89f29 thru 0x94743 (0xa81b bytes) 2023-07-14T18:17:17.958 INFO:tasks.workunit.client.0.smithi163.stdout:1653(117 mod 256): READ 0x2538b thru 0x2d9e8 (0x865e bytes) 2023-07-14T18:17:17.958 INFO:tasks.workunit.client.0.smithi163.stdout:1654(118 mod 256): TRUNCATE DOWN from 0x100000 to 0x32ca9 ******WWWW 2023-07-14T18:17:17.958 INFO:tasks.workunit.client.0.smithi163.stdout:1655(119 mod 256): COPY 0x1d728 thru 0x23047 (0x5920 bytes) to 0xf0bc thru 0x149db 2023-07-14T18:17:17.958 INFO:tasks.workunit.client.0.smithi163.stdout:1656(120 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.958 INFO:tasks.workunit.client.0.smithi163.stdout:1657(121 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.958 INFO:tasks.workunit.client.0.smithi163.stdout:1658(122 mod 256): WRITE 0xcc2f1 thru 0xd34a7 (0x71b7 bytes) HOLE ***WWWW 2023-07-14T18:17:17.959 INFO:tasks.workunit.client.0.smithi163.stdout:1659(123 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.959 INFO:tasks.workunit.client.0.smithi163.stdout:1660(124 mod 256): MAPREAD 0xa6b7d thru 0xa9c94 (0x3118 bytes) 2023-07-14T18:17:17.959 INFO:tasks.workunit.client.0.smithi163.stdout:1661(125 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.959 INFO:tasks.workunit.client.0.smithi163.stdout:1662(126 mod 256): READ 0x708d3 thru 0x74510 (0x3c3e bytes) 2023-07-14T18:17:17.959 INFO:tasks.workunit.client.0.smithi163.stdout:1663(127 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.959 INFO:tasks.workunit.client.0.smithi163.stdout:1664(128 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.959 INFO:tasks.workunit.client.0.smithi163.stdout:1665(129 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.959 INFO:tasks.workunit.client.0.smithi163.stdout:1666(130 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.960 INFO:tasks.workunit.client.0.smithi163.stdout:1667(131 mod 256): FALLOC 0x4df2d thru 0x5b940 (0xda13 bytes) INTERIOR 2023-07-14T18:17:17.960 INFO:tasks.workunit.client.0.smithi163.stdout:1668(132 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.960 INFO:tasks.workunit.client.0.smithi163.stdout:1669(133 mod 256): MAPREAD 0xaff6d thru 0xbe263 (0xe2f7 bytes) 2023-07-14T18:17:17.960 INFO:tasks.workunit.client.0.smithi163.stdout:1670(134 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.960 INFO:tasks.workunit.client.0.smithi163.stdout:1671(135 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.960 INFO:tasks.workunit.client.0.smithi163.stdout:1672(136 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.960 INFO:tasks.workunit.client.0.smithi163.stdout:1673(137 mod 256): FALLOC 0x1e25d thru 0x1ebd8 (0x97b bytes) INTERIOR 2023-07-14T18:17:17.960 INFO:tasks.workunit.client.0.smithi163.stdout:1674(138 mod 256): COPY 0x113a6 thru 0x12032 (0xc8d bytes) to 0xc984e thru 0xca4da 2023-07-14T18:17:17.961 INFO:tasks.workunit.client.0.smithi163.stdout:1675(139 mod 256): FALLOC 0xfe308 thru 0x100000 (0x1cf8 bytes) EXTENDING 2023-07-14T18:17:17.961 INFO:tasks.workunit.client.0.smithi163.stdout:1676(140 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.961 INFO:tasks.workunit.client.0.smithi163.stdout:1677(141 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.961 INFO:tasks.workunit.client.0.smithi163.stdout:1678(142 mod 256): MAPWRITE 0xdbf49 thru 0xe5a79 (0x9b31 bytes) 2023-07-14T18:17:17.961 INFO:tasks.workunit.client.0.smithi163.stdout:1679(143 mod 256): MAPREAD 0x13f2b thru 0x1e7aa (0xa880 bytes) 2023-07-14T18:17:17.961 INFO:tasks.workunit.client.0.smithi163.stdout:1680(144 mod 256): MAPWRITE 0x83fa thru 0xc454 (0x405b bytes) 2023-07-14T18:17:17.961 INFO:tasks.workunit.client.0.smithi163.stdout:1681(145 mod 256): MAPWRITE 0x6d903 thru 0x769b2 (0x90b0 bytes) 2023-07-14T18:17:17.961 INFO:tasks.workunit.client.0.smithi163.stdout:1682(146 mod 256): MAPREAD 0xae580 thru 0xb189e (0x331f bytes) 2023-07-14T18:17:17.962 INFO:tasks.workunit.client.0.smithi163.stdout:1683(147 mod 256): WRITE 0x8fee2 thru 0x96a23 (0x6b42 bytes) 2023-07-14T18:17:17.962 INFO:tasks.workunit.client.0.smithi163.stdout:1684(148 mod 256): MAPWRITE 0x1fca3 thru 0x26b9d (0x6efb bytes) 2023-07-14T18:17:17.962 INFO:tasks.workunit.client.0.smithi163.stdout:1685(149 mod 256): WRITE 0x548e6 thru 0x5e6b8 (0x9dd3 bytes) 2023-07-14T18:17:17.962 INFO:tasks.workunit.client.0.smithi163.stdout:1686(150 mod 256): FALLOC 0x154b0 thru 0x17b28 (0x2678 bytes) INTERIOR 2023-07-14T18:17:17.962 INFO:tasks.workunit.client.0.smithi163.stdout:1687(151 mod 256): COPY 0x89e88 thru 0x96140 (0xc2b9 bytes) to 0x2573f thru 0x319f7 2023-07-14T18:17:17.962 INFO:tasks.workunit.client.0.smithi163.stdout:1688(152 mod 256): PUNCH 0x8df83 thru 0x99a12 (0xba90 bytes) 2023-07-14T18:17:17.962 INFO:tasks.workunit.client.0.smithi163.stdout:1689(153 mod 256): TRUNCATE DOWN from 0x100000 to 0x88ea9 2023-07-14T18:17:17.962 INFO:tasks.workunit.client.0.smithi163.stdout:1690(154 mod 256): WRITE 0xb9ad5 thru 0xc1d32 (0x825e bytes) HOLE 2023-07-14T18:17:17.963 INFO:tasks.workunit.client.0.smithi163.stdout:1691(155 mod 256): FALLOC 0x637f1 thru 0x71a9f (0xe2ae bytes) INTERIOR 2023-07-14T18:17:17.963 INFO:tasks.workunit.client.0.smithi163.stdout:1692(156 mod 256): WRITE 0x2e63c thru 0x32cb8 (0x467d bytes) 2023-07-14T18:17:17.963 INFO:tasks.workunit.client.0.smithi163.stdout:1693(157 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.963 INFO:tasks.workunit.client.0.smithi163.stdout:1694(158 mod 256): COPY 0x7d13c thru 0x80772 (0x3637 bytes) to 0xa879f thru 0xabdd5 2023-07-14T18:17:17.963 INFO:tasks.workunit.client.0.smithi163.stdout:1695(159 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.963 INFO:tasks.workunit.client.0.smithi163.stdout:1696(160 mod 256): PUNCH 0x64dad thru 0x727a3 (0xd9f7 bytes) 2023-07-14T18:17:17.963 INFO:tasks.workunit.client.0.smithi163.stdout:1697(161 mod 256): FALLOC 0x46ea3 thru 0x563b5 (0xf512 bytes) INTERIOR 2023-07-14T18:17:17.963 INFO:tasks.workunit.client.0.smithi163.stdout:1698(162 mod 256): PUNCH 0x617d5 thru 0x696a5 (0x7ed1 bytes) 2023-07-14T18:17:17.964 INFO:tasks.workunit.client.0.smithi163.stdout:1699(163 mod 256): FALLOC 0x99d8d thru 0xa80c6 (0xe339 bytes) INTERIOR 2023-07-14T18:17:17.964 INFO:tasks.workunit.client.0.smithi163.stdout:1700(164 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.964 INFO:tasks.workunit.client.0.smithi163.stdout:1701(165 mod 256): FALLOC 0x8b5c5 thru 0x8c248 (0xc83 bytes) INTERIOR 2023-07-14T18:17:17.964 INFO:tasks.workunit.client.0.smithi163.stdout:1702(166 mod 256): COPY 0x5567d thru 0x63aa3 (0xe427 bytes) to 0x3be4d thru 0x4a273 2023-07-14T18:17:17.964 INFO:tasks.workunit.client.0.smithi163.stdout:1703(167 mod 256): PUNCH 0x66aaa thru 0x6d5a2 (0x6af9 bytes) 2023-07-14T18:17:17.964 INFO:tasks.workunit.client.0.smithi163.stdout:1704(168 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.964 INFO:tasks.workunit.client.0.smithi163.stdout:1705(169 mod 256): MAPREAD 0xc0887 thru 0xc1d32 (0x14ac bytes) 2023-07-14T18:17:17.964 INFO:tasks.workunit.client.0.smithi163.stdout:1706(170 mod 256): FALLOC 0x635b0 thru 0x6b594 (0x7fe4 bytes) INTERIOR 2023-07-14T18:17:17.965 INFO:tasks.workunit.client.0.smithi163.stdout:1707(171 mod 256): COPY 0x11688 thru 0x15d27 (0x46a0 bytes) to 0x4d42c thru 0x51acb 2023-07-14T18:17:17.965 INFO:tasks.workunit.client.0.smithi163.stdout:1708(172 mod 256): WRITE 0x55cff thru 0x65217 (0xf519 bytes) 2023-07-14T18:17:17.965 INFO:tasks.workunit.client.0.smithi163.stdout:1709(173 mod 256): PUNCH 0x5d6a9 thru 0x6c172 (0xeaca bytes) 2023-07-14T18:17:17.965 INFO:tasks.workunit.client.0.smithi163.stdout:1710(174 mod 256): FALLOC 0x8bd09 thru 0x9529b (0x9592 bytes) INTERIOR 2023-07-14T18:17:17.965 INFO:tasks.workunit.client.0.smithi163.stdout:1711(175 mod 256): FALLOC 0x8aece thru 0x95e03 (0xaf35 bytes) INTERIOR 2023-07-14T18:17:17.965 INFO:tasks.workunit.client.0.smithi163.stdout:1712(176 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.965 INFO:tasks.workunit.client.0.smithi163.stdout:1713(177 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.965 INFO:tasks.workunit.client.0.smithi163.stdout:1714(178 mod 256): TRUNCATE DOWN from 0xc1d33 to 0x4c1bc 2023-07-14T18:17:17.966 INFO:tasks.workunit.client.0.smithi163.stdout:1715(179 mod 256): READ 0x16ba3 thru 0x22e92 (0xc2f0 bytes) 2023-07-14T18:17:17.966 INFO:tasks.workunit.client.0.smithi163.stdout:1716(180 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.966 INFO:tasks.workunit.client.0.smithi163.stdout:1717(181 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.966 INFO:tasks.workunit.client.0.smithi163.stdout:1718(182 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.966 INFO:tasks.workunit.client.0.smithi163.stdout:1719(183 mod 256): WRITE 0x1c05f thru 0x1f40a (0x33ac bytes) 2023-07-14T18:17:17.966 INFO:tasks.workunit.client.0.smithi163.stdout:1720(184 mod 256): COPY 0x1c470 thru 0x2aac1 (0xe652 bytes) to 0x5cfd2 thru 0x6b623 2023-07-14T18:17:17.966 INFO:tasks.workunit.client.0.smithi163.stdout:1721(185 mod 256): PUNCH 0x6b458 thru 0x6b623 (0x1cc bytes) 2023-07-14T18:17:17.967 INFO:tasks.workunit.client.0.smithi163.stdout:1722(186 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.967 INFO:tasks.workunit.client.0.smithi163.stdout:1723(187 mod 256): WRITE 0xa53b4 thru 0xa6a15 (0x1662 bytes) HOLE 2023-07-14T18:17:17.967 INFO:tasks.workunit.client.0.smithi163.stdout:1724(188 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.967 INFO:tasks.workunit.client.0.smithi163.stdout:1725(189 mod 256): PUNCH 0x47a45 thru 0x54f09 (0xd4c5 bytes) 2023-07-14T18:17:17.967 INFO:tasks.workunit.client.0.smithi163.stdout:1726(190 mod 256): FALLOC 0x1a4ed thru 0x238e7 (0x93fa bytes) INTERIOR 2023-07-14T18:17:17.967 INFO:tasks.workunit.client.0.smithi163.stdout:1727(191 mod 256): TRUNCATE DOWN from 0xa6a16 to 0x927fb 2023-07-14T18:17:17.967 INFO:tasks.workunit.client.0.smithi163.stdout:1728(192 mod 256): WRITE 0x57ef thru 0x7139 (0x194b bytes) 2023-07-14T18:17:17.967 INFO:tasks.workunit.client.0.smithi163.stdout:1729(193 mod 256): MAPWRITE 0x8181d thru 0x899da (0x81be bytes) 2023-07-14T18:17:17.968 INFO:tasks.workunit.client.0.smithi163.stdout:1730(194 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.968 INFO:tasks.workunit.client.0.smithi163.stdout:1731(195 mod 256): COPY 0x1d171 thru 0x21d69 (0x4bf9 bytes) to 0x4957c thru 0x4e174 2023-07-14T18:17:17.968 INFO:tasks.workunit.client.0.smithi163.stdout:1732(196 mod 256): PUNCH 0x6c5ef thru 0x73c4b (0x765d bytes) 2023-07-14T18:17:17.968 INFO:tasks.workunit.client.0.smithi163.stdout:1733(197 mod 256): MAPREAD 0x89f01 thru 0x8d213 (0x3313 bytes) 2023-07-14T18:17:17.968 INFO:tasks.workunit.client.0.smithi163.stdout:1734(198 mod 256): READ 0x49117 thru 0x4f9ef (0x68d9 bytes) 2023-07-14T18:17:17.968 INFO:tasks.workunit.client.0.smithi163.stdout:1735(199 mod 256): PUNCH 0x70b82 thru 0x7369b (0x2b1a bytes) 2023-07-14T18:17:17.968 INFO:tasks.workunit.client.0.smithi163.stdout:1736(200 mod 256): READ 0x77806 thru 0x82805 (0xb000 bytes) 2023-07-14T18:17:17.968 INFO:tasks.workunit.client.0.smithi163.stdout:1737(201 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.969 INFO:tasks.workunit.client.0.smithi163.stdout:1738(202 mod 256): FALLOC 0x59389 thru 0x6528a (0xbf01 bytes) INTERIOR 2023-07-14T18:17:17.969 INFO:tasks.workunit.client.0.smithi163.stdout:1739(203 mod 256): MAPWRITE 0xda116 thru 0xe43dc (0xa2c7 bytes) 2023-07-14T18:17:17.969 INFO:tasks.workunit.client.0.smithi163.stdout:1740(204 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.969 INFO:tasks.workunit.client.0.smithi163.stdout:1741(205 mod 256): PUNCH 0x10ef thru 0xb3ba (0xa2cc bytes) 2023-07-14T18:17:17.969 INFO:tasks.workunit.client.0.smithi163.stdout:1742(206 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.969 INFO:tasks.workunit.client.0.smithi163.stdout:1743(207 mod 256): COPY 0xcf527 thru 0xd0a86 (0x1560 bytes) to 0xa881 thru 0xbde0 2023-07-14T18:17:17.969 INFO:tasks.workunit.client.0.smithi163.stdout:1744(208 mod 256): MAPREAD 0x20d26 thru 0x28d8b (0x8066 bytes) 2023-07-14T18:17:17.969 INFO:tasks.workunit.client.0.smithi163.stdout:1745(209 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.970 INFO:tasks.workunit.client.0.smithi163.stdout:1746(210 mod 256): PUNCH 0xa0d85 thru 0xa7444 (0x66c0 bytes) 2023-07-14T18:17:17.970 INFO:tasks.workunit.client.0.smithi163.stdout:1747(211 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.970 INFO:tasks.workunit.client.0.smithi163.stdout:1748(212 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.970 INFO:tasks.workunit.client.0.smithi163.stdout:1749(213 mod 256): WRITE 0xc2f1d thru 0xc4812 (0x18f6 bytes) 2023-07-14T18:17:17.970 INFO:tasks.workunit.client.0.smithi163.stdout:1750(214 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.970 INFO:tasks.workunit.client.0.smithi163.stdout:1751(215 mod 256): FALLOC 0xb3123 thru 0xba32e (0x720b bytes) INTERIOR 2023-07-14T18:17:17.970 INFO:tasks.workunit.client.0.smithi163.stdout:1752(216 mod 256): MAPWRITE 0x2abfb thru 0x36948 (0xbd4e bytes) 2023-07-14T18:17:17.970 INFO:tasks.workunit.client.0.smithi163.stdout:1753(217 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.971 INFO:tasks.workunit.client.0.smithi163.stdout:1754(218 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.971 INFO:tasks.workunit.client.0.smithi163.stdout:1755(219 mod 256): WRITE 0x3761c thru 0x3cd97 (0x577c bytes) ***WWWW 2023-07-14T18:17:17.971 INFO:tasks.workunit.client.0.smithi163.stdout:1756(220 mod 256): MAPREAD 0x9676d thru 0xa0950 (0xa1e4 bytes) 2023-07-14T18:17:17.971 INFO:tasks.workunit.client.0.smithi163.stdout:1757(221 mod 256): TRUNCATE DOWN from 0xe43dd to 0xd93b6 2023-07-14T18:17:17.971 INFO:tasks.workunit.client.0.smithi163.stdout:1758(222 mod 256): PUNCH 0x24cd0 thru 0x278f0 (0x2c21 bytes) 2023-07-14T18:17:17.971 INFO:tasks.workunit.client.0.smithi163.stdout:1759(223 mod 256): PUNCH 0xcc0ba thru 0xd055d (0x44a4 bytes) 2023-07-14T18:17:17.971 INFO:tasks.workunit.client.0.smithi163.stdout:1760(224 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.971 INFO:tasks.workunit.client.0.smithi163.stdout:1761(225 mod 256): WRITE 0x958b1 thru 0xa0ea8 (0xb5f8 bytes) 2023-07-14T18:17:17.972 INFO:tasks.workunit.client.0.smithi163.stdout:1762(226 mod 256): WRITE 0x584bf thru 0x5c185 (0x3cc7 bytes) 2023-07-14T18:17:17.972 INFO:tasks.workunit.client.0.smithi163.stdout:1763(227 mod 256): COPY 0xd621a thru 0xd93b5 (0x319c bytes) to 0xf6039 thru 0xf91d4 2023-07-14T18:17:17.972 INFO:tasks.workunit.client.0.smithi163.stdout:1764(228 mod 256): MAPWRITE 0x68f26 thru 0x76083 (0xd15e bytes) 2023-07-14T18:17:17.972 INFO:tasks.workunit.client.0.smithi163.stdout:1765(229 mod 256): READ 0x2dabd thru 0x31508 (0x3a4c bytes) 2023-07-14T18:17:17.972 INFO:tasks.workunit.client.0.smithi163.stdout:1766(230 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.972 INFO:tasks.workunit.client.0.smithi163.stdout:1767(231 mod 256): MAPREAD 0x20f11 thru 0x27b47 (0x6c37 bytes) 2023-07-14T18:17:17.972 INFO:tasks.workunit.client.0.smithi163.stdout:1768(232 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.972 INFO:tasks.workunit.client.0.smithi163.stdout:1769(233 mod 256): FALLOC 0xab2f thru 0x18c20 (0xe0f1 bytes) INTERIOR 2023-07-14T18:17:17.973 INFO:tasks.workunit.client.0.smithi163.stdout:1770(234 mod 256): READ 0x72fc2 thru 0x7ea53 (0xba92 bytes) 2023-07-14T18:17:17.973 INFO:tasks.workunit.client.0.smithi163.stdout:1771(235 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.973 INFO:tasks.workunit.client.0.smithi163.stdout:1772(236 mod 256): FALLOC 0xfdafd thru 0xff030 (0x1533 bytes) EXTENDING 2023-07-14T18:17:17.973 INFO:tasks.workunit.client.0.smithi163.stdout:1773(237 mod 256): PUNCH 0x8e9e thru 0x9a27 (0xb8a bytes) 2023-07-14T18:17:17.973 INFO:tasks.workunit.client.0.smithi163.stdout:1774(238 mod 256): MAPREAD 0x9fb50 thru 0xa5a7e (0x5f2f bytes) 2023-07-14T18:17:17.973 INFO:tasks.workunit.client.0.smithi163.stdout:1775(239 mod 256): PUNCH 0x149f7 thru 0x22ab2 (0xe0bc bytes) 2023-07-14T18:17:17.973 INFO:tasks.workunit.client.0.smithi163.stdout:1776(240 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.973 INFO:tasks.workunit.client.0.smithi163.stdout:1777(241 mod 256): FALLOC 0xec622 thru 0xeebdd (0x25bb bytes) INTERIOR 2023-07-14T18:17:17.974 INFO:tasks.workunit.client.0.smithi163.stdout:1778(242 mod 256): COPY 0xfbd8a thru 0xff02f (0x32a6 bytes) to 0x20f95 thru 0x2423a 2023-07-14T18:17:17.974 INFO:tasks.workunit.client.0.smithi163.stdout:1779(243 mod 256): PUNCH 0xd9598 thru 0xdc51e (0x2f87 bytes) 2023-07-14T18:17:17.974 INFO:tasks.workunit.client.0.smithi163.stdout:1780(244 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.974 INFO:tasks.workunit.client.0.smithi163.stdout:1781(245 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.974 INFO:tasks.workunit.client.0.smithi163.stdout:1782(246 mod 256): READ 0xcda79 thru 0xd7fa4 (0xa52c bytes) 2023-07-14T18:17:17.974 INFO:tasks.workunit.client.0.smithi163.stdout:1783(247 mod 256): FALLOC 0x755ab thru 0x7e53c (0x8f91 bytes) INTERIOR 2023-07-14T18:17:17.974 INFO:tasks.workunit.client.0.smithi163.stdout:1784(248 mod 256): MAPREAD 0x82e61 thru 0x905a5 (0xd745 bytes) 2023-07-14T18:17:17.974 INFO:tasks.workunit.client.0.smithi163.stdout:1785(249 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.975 INFO:tasks.workunit.client.0.smithi163.stdout:1786(250 mod 256): MAPREAD 0x5a29 thru 0xf248 (0x9820 bytes) 2023-07-14T18:17:17.975 INFO:tasks.workunit.client.0.smithi163.stdout:1787(251 mod 256): FALLOC 0x41007 thru 0x4bf00 (0xaef9 bytes) INTERIOR 2023-07-14T18:17:17.975 INFO:tasks.workunit.client.0.smithi163.stdout:1788(252 mod 256): TRUNCATE DOWN from 0xff030 to 0xaadba 2023-07-14T18:17:17.975 INFO:tasks.workunit.client.0.smithi163.stdout:1789(253 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.975 INFO:tasks.workunit.client.0.smithi163.stdout:1790(254 mod 256): TRUNCATE UP from 0xaadba to 0xfe369 2023-07-14T18:17:17.975 INFO:tasks.workunit.client.0.smithi163.stdout:1791(255 mod 256): MAPREAD 0x8ba8f thru 0x8bc44 (0x1b6 bytes) 2023-07-14T18:17:17.975 INFO:tasks.workunit.client.0.smithi163.stdout:1792( 0 mod 256): TRUNCATE DOWN from 0xfe369 to 0xb3c22 2023-07-14T18:17:17.976 INFO:tasks.workunit.client.0.smithi163.stdout:1793( 1 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.976 INFO:tasks.workunit.client.0.smithi163.stdout:1794( 2 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.976 INFO:tasks.workunit.client.0.smithi163.stdout:1795( 3 mod 256): MAPREAD 0x200c9 thru 0x20130 (0x68 bytes) 2023-07-14T18:17:17.976 INFO:tasks.workunit.client.0.smithi163.stdout:1796( 4 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.976 INFO:tasks.workunit.client.0.smithi163.stdout:1797( 5 mod 256): WRITE 0xde959 thru 0xe1e28 (0x34d0 bytes) HOLE 2023-07-14T18:17:17.976 INFO:tasks.workunit.client.0.smithi163.stdout:1798( 6 mod 256): PUNCH 0x6bfa1 thru 0x78d23 (0xcd83 bytes) 2023-07-14T18:17:17.976 INFO:tasks.workunit.client.0.smithi163.stdout:1799( 7 mod 256): COPY 0x54059 thru 0x5a7c8 (0x6770 bytes) to 0x32d53 thru 0x394c2 ******EEEE 2023-07-14T18:17:17.976 INFO:tasks.workunit.client.0.smithi163.stdout:1800( 8 mod 256): COPY 0x28625 thru 0x302e5 (0x7cc1 bytes) to 0xe45e7 thru 0xec2a7 2023-07-14T18:17:17.977 INFO:tasks.workunit.client.0.smithi163.stdout:1801( 9 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.977 INFO:tasks.workunit.client.0.smithi163.stdout:1802( 10 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.977 INFO:tasks.workunit.client.0.smithi163.stdout:1803( 11 mod 256): READ 0x481e0 thru 0x4beb2 (0x3cd3 bytes) 2023-07-14T18:17:17.977 INFO:tasks.workunit.client.0.smithi163.stdout:1804( 12 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.977 INFO:tasks.workunit.client.0.smithi163.stdout:1805( 13 mod 256): MAPWRITE 0x16fb6 thru 0x21687 (0xa6d2 bytes) 2023-07-14T18:17:17.977 INFO:tasks.workunit.client.0.smithi163.stdout:1806( 14 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.977 INFO:tasks.workunit.client.0.smithi163.stdout:1807( 15 mod 256): MAPWRITE 0xaf7ef thru 0xb945c (0x9c6e bytes) 2023-07-14T18:17:17.977 INFO:tasks.workunit.client.0.smithi163.stdout:1808( 16 mod 256): FALLOC 0x5fbd5 thru 0x61dac (0x21d7 bytes) INTERIOR 2023-07-14T18:17:17.978 INFO:tasks.workunit.client.0.smithi163.stdout:1809( 17 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.978 INFO:tasks.workunit.client.0.smithi163.stdout:1810( 18 mod 256): TRUNCATE DOWN from 0xec2a8 to 0x3b8fe 2023-07-14T18:17:17.978 INFO:tasks.workunit.client.0.smithi163.stdout:1811( 19 mod 256): FALLOC 0xc0bb8 thru 0xc97a4 (0x8bec bytes) EXTENDING 2023-07-14T18:17:17.978 INFO:tasks.workunit.client.0.smithi163.stdout:1812( 20 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.978 INFO:tasks.workunit.client.0.smithi163.stdout:1813( 21 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.978 INFO:tasks.workunit.client.0.smithi163.stdout:1814( 22 mod 256): MAPWRITE 0x14610 thru 0x1f157 (0xab48 bytes) 2023-07-14T18:17:17.978 INFO:tasks.workunit.client.0.smithi163.stdout:1815( 23 mod 256): PUNCH 0x6466c thru 0x6f880 (0xb215 bytes) 2023-07-14T18:17:17.978 INFO:tasks.workunit.client.0.smithi163.stdout:1816( 24 mod 256): COPY 0x57422 thru 0x575c6 (0x1a5 bytes) to 0x52cf2 thru 0x52e96 2023-07-14T18:17:17.979 INFO:tasks.workunit.client.0.smithi163.stdout:1817( 25 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.979 INFO:tasks.workunit.client.0.smithi163.stdout:1818( 26 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.979 INFO:tasks.workunit.client.0.smithi163.stdout:1819( 27 mod 256): MAPWRITE 0x25b69 thru 0x27970 (0x1e08 bytes) 2023-07-14T18:17:17.979 INFO:tasks.workunit.client.0.smithi163.stdout:1820( 28 mod 256): MAPREAD 0xa9b1a thru 0xb47cd (0xacb4 bytes) 2023-07-14T18:17:17.979 INFO:tasks.workunit.client.0.smithi163.stdout:1821( 29 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.979 INFO:tasks.workunit.client.0.smithi163.stdout:1822( 30 mod 256): TRUNCATE DOWN from 0xc97a4 to 0xbad36 2023-07-14T18:17:17.979 INFO:tasks.workunit.client.0.smithi163.stdout:1823( 31 mod 256): COPY 0xc275 thru 0x1242b (0x61b7 bytes) to 0xa4f88 thru 0xab13e 2023-07-14T18:17:17.979 INFO:tasks.workunit.client.0.smithi163.stdout:1824( 32 mod 256): MAPWRITE 0x7820a thru 0x834f7 (0xb2ee bytes) 2023-07-14T18:17:17.980 INFO:tasks.workunit.client.0.smithi163.stdout:1825( 33 mod 256): PUNCH 0x7e12 thru 0x164cb (0xe6ba bytes) 2023-07-14T18:17:17.980 INFO:tasks.workunit.client.0.smithi163.stdout:1826( 34 mod 256): MAPWRITE 0x1d3a thru 0x5b2d (0x3df4 bytes) 2023-07-14T18:17:17.980 INFO:tasks.workunit.client.0.smithi163.stdout:1827( 35 mod 256): READ 0x8bfc4 thru 0x95a2b (0x9a68 bytes) 2023-07-14T18:17:17.980 INFO:tasks.workunit.client.0.smithi163.stdout:1828( 36 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.980 INFO:tasks.workunit.client.0.smithi163.stdout:1829( 37 mod 256): MAPREAD 0x66ff3 thru 0x72a76 (0xba84 bytes) 2023-07-14T18:17:17.980 INFO:tasks.workunit.client.0.smithi163.stdout:1830( 38 mod 256): MAPWRITE 0xb5f17 thru 0xbcc5d (0x6d47 bytes) 2023-07-14T18:17:17.980 INFO:tasks.workunit.client.0.smithi163.stdout:1831( 39 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.980 INFO:tasks.workunit.client.0.smithi163.stdout:1832( 40 mod 256): FALLOC 0x803ac thru 0x84b39 (0x478d bytes) INTERIOR 2023-07-14T18:17:17.981 INFO:tasks.workunit.client.0.smithi163.stdout:1833( 41 mod 256): MAPWRITE 0x1b138 thru 0x1d405 (0x22ce bytes) 2023-07-14T18:17:17.981 INFO:tasks.workunit.client.0.smithi163.stdout:1834( 42 mod 256): MAPREAD 0xa0ca8 thru 0xa84e1 (0x783a bytes) 2023-07-14T18:17:17.981 INFO:tasks.workunit.client.0.smithi163.stdout:1835( 43 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.981 INFO:tasks.workunit.client.0.smithi163.stdout:1836( 44 mod 256): MAPWRITE 0xa6e71 thru 0xa9ec9 (0x3059 bytes) 2023-07-14T18:17:17.981 INFO:tasks.workunit.client.0.smithi163.stdout:1837( 45 mod 256): PUNCH 0x95631 thru 0x9b557 (0x5f27 bytes) 2023-07-14T18:17:17.981 INFO:tasks.workunit.client.0.smithi163.stdout:1838( 46 mod 256): FALLOC 0xf0fb6 thru 0xfec1c (0xdc66 bytes) PAST_EOF 2023-07-14T18:17:17.981 INFO:tasks.workunit.client.0.smithi163.stdout:1839( 47 mod 256): MAPWRITE 0x2dc4a thru 0x3b897 (0xdc4e bytes) ******WWWW 2023-07-14T18:17:17.981 INFO:tasks.workunit.client.0.smithi163.stdout:1840( 48 mod 256): COPY 0x33420 thru 0x3c8cc (0x94ad bytes) to 0xaee60 thru 0xb830c EEEE****** 2023-07-14T18:17:17.982 INFO:tasks.workunit.client.0.smithi163.stdout:1841( 49 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.982 INFO:tasks.workunit.client.0.smithi163.stdout:1842( 50 mod 256): COPY 0xb160a thru 0xbcc5d (0xb654 bytes) to 0xa0cc thru 0x1571f 2023-07-14T18:17:17.982 INFO:tasks.workunit.client.0.smithi163.stdout:1843( 51 mod 256): COPY 0x5bcb1 thru 0x65d25 (0xa075 bytes) to 0xb6f59 thru 0xc0fcd 2023-07-14T18:17:17.982 INFO:tasks.workunit.client.0.smithi163.stdout:1844( 52 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.982 INFO:tasks.workunit.client.0.smithi163.stdout:1845( 53 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.982 INFO:tasks.workunit.client.0.smithi163.stdout:1846( 54 mod 256): MAPWRITE 0x636ad thru 0x6a5b5 (0x6f09 bytes) 2023-07-14T18:17:17.982 INFO:tasks.workunit.client.0.smithi163.stdout:1847( 55 mod 256): FALLOC 0xacdc5 thru 0xb97f2 (0xca2d bytes) INTERIOR 2023-07-14T18:17:17.982 INFO:tasks.workunit.client.0.smithi163.stdout:1848( 56 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.983 INFO:tasks.workunit.client.0.smithi163.stdout:1849( 57 mod 256): MAPREAD 0x1567c thru 0x17efa (0x287f bytes) 2023-07-14T18:17:17.983 INFO:tasks.workunit.client.0.smithi163.stdout:1850( 58 mod 256): TRUNCATE DOWN from 0xc0fce to 0xa2ba ******WWWW 2023-07-14T18:17:17.983 INFO:tasks.workunit.client.0.smithi163.stdout:1851( 59 mod 256): TRUNCATE UP from 0xa2ba to 0x62c45 ******WWWW 2023-07-14T18:17:17.983 INFO:tasks.workunit.client.0.smithi163.stdout:1852( 60 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.983 INFO:tasks.workunit.client.0.smithi163.stdout:1853( 61 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.983 INFO:tasks.workunit.client.0.smithi163.stdout:1854( 62 mod 256): MAPWRITE 0x37737 thru 0x476ec (0xffb6 bytes) ******WWWW 2023-07-14T18:17:17.983 INFO:tasks.workunit.client.0.smithi163.stdout:1855( 63 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.984 INFO:tasks.workunit.client.0.smithi163.stdout:1856( 64 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.984 INFO:tasks.workunit.client.0.smithi163.stdout:1857( 65 mod 256): COPY 0x56c94 thru 0x5ec86 (0x7ff3 bytes) to 0xb9f82 thru 0xc1f74 2023-07-14T18:17:17.984 INFO:tasks.workunit.client.0.smithi163.stdout:1858( 66 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.984 INFO:tasks.workunit.client.0.smithi163.stdout:1859( 67 mod 256): TRUNCATE UP from 0xc1f75 to 0xe93a6 2023-07-14T18:17:17.984 INFO:tasks.workunit.client.0.smithi163.stdout:1860( 68 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.984 INFO:tasks.workunit.client.0.smithi163.stdout:1861( 69 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.984 INFO:tasks.workunit.client.0.smithi163.stdout:1862( 70 mod 256): FALLOC 0x55471 thru 0x55cdc (0x86b bytes) INTERIOR 2023-07-14T18:17:17.984 INFO:tasks.workunit.client.0.smithi163.stdout:1863( 71 mod 256): TRUNCATE UP from 0xe93a6 to 0xee761 2023-07-14T18:17:17.985 INFO:tasks.workunit.client.0.smithi163.stdout:1864( 72 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.985 INFO:tasks.workunit.client.0.smithi163.stdout:1865( 73 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.985 INFO:tasks.workunit.client.0.smithi163.stdout:1866( 74 mod 256): PUNCH 0x85f9 thru 0x10742 (0x814a bytes) 2023-07-14T18:17:17.985 INFO:tasks.workunit.client.0.smithi163.stdout:1867( 75 mod 256): WRITE 0xa3757 thru 0xa64ec (0x2d96 bytes) 2023-07-14T18:17:17.985 INFO:tasks.workunit.client.0.smithi163.stdout:1868( 76 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.985 INFO:tasks.workunit.client.0.smithi163.stdout:1869( 77 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.985 INFO:tasks.workunit.client.0.smithi163.stdout:1870( 78 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.985 INFO:tasks.workunit.client.0.smithi163.stdout:1871( 79 mod 256): WRITE 0x62bc7 thru 0x6f11e (0xc558 bytes) 2023-07-14T18:17:17.986 INFO:tasks.workunit.client.0.smithi163.stdout:1872( 80 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.986 INFO:tasks.workunit.client.0.smithi163.stdout:1873( 81 mod 256): MAPWRITE 0x4bbce thru 0x52dd1 (0x7204 bytes) 2023-07-14T18:17:17.986 INFO:tasks.workunit.client.0.smithi163.stdout:1874( 82 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.986 INFO:tasks.workunit.client.0.smithi163.stdout:1875( 83 mod 256): COPY 0x6592b thru 0x70a76 (0xb14c bytes) to 0xe064b thru 0xeb796 2023-07-14T18:17:17.986 INFO:tasks.workunit.client.0.smithi163.stdout:1876( 84 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.986 INFO:tasks.workunit.client.0.smithi163.stdout:1877( 85 mod 256): READ 0xea39e thru 0xee760 (0x43c3 bytes) 2023-07-14T18:17:17.986 INFO:tasks.workunit.client.0.smithi163.stdout:1878( 86 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.986 INFO:tasks.workunit.client.0.smithi163.stdout:1879( 87 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.987 INFO:tasks.workunit.client.0.smithi163.stdout:1880( 88 mod 256): TRUNCATE DOWN from 0xee761 to 0x668ce 2023-07-14T18:17:17.987 INFO:tasks.workunit.client.0.smithi163.stdout:1881( 89 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.987 INFO:tasks.workunit.client.0.smithi163.stdout:1882( 90 mod 256): TRUNCATE UP from 0x668ce to 0x99e4c 2023-07-14T18:17:17.987 INFO:tasks.workunit.client.0.smithi163.stdout:1883( 91 mod 256): WRITE 0x12a6f thru 0x13c31 (0x11c3 bytes) 2023-07-14T18:17:17.987 INFO:tasks.workunit.client.0.smithi163.stdout:1884( 92 mod 256): WRITE 0xc2e29 thru 0xcd883 (0xaa5b bytes) HOLE 2023-07-14T18:17:17.987 INFO:tasks.workunit.client.0.smithi163.stdout:1885( 93 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.987 INFO:tasks.workunit.client.0.smithi163.stdout:1886( 94 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.987 INFO:tasks.workunit.client.0.smithi163.stdout:1887( 95 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.988 INFO:tasks.workunit.client.0.smithi163.stdout:1888( 96 mod 256): COPY 0x41af7 thru 0x4ebfd (0xd107 bytes) to 0x6e28a thru 0x7b390 2023-07-14T18:17:17.988 INFO:tasks.workunit.client.0.smithi163.stdout:1889( 97 mod 256): PUNCH 0xba7b9 thru 0xbb08c (0x8d4 bytes) 2023-07-14T18:17:17.988 INFO:tasks.workunit.client.0.smithi163.stdout:1890( 98 mod 256): TRUNCATE DOWN from 0xcd884 to 0x59354 2023-07-14T18:17:17.988 INFO:tasks.workunit.client.0.smithi163.stdout:1891( 99 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.988 INFO:tasks.workunit.client.0.smithi163.stdout:1892(100 mod 256): TRUNCATE DOWN from 0x59354 to 0xcb31 ******WWWW 2023-07-14T18:17:17.988 INFO:tasks.workunit.client.0.smithi163.stdout:1893(101 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.988 INFO:tasks.workunit.client.0.smithi163.stdout:1894(102 mod 256): PUNCH 0x8669 thru 0xcb30 (0x44c8 bytes) 2023-07-14T18:17:17.988 INFO:tasks.workunit.client.0.smithi163.stdout:1895(103 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.989 INFO:tasks.workunit.client.0.smithi163.stdout:1896(104 mod 256): MAPWRITE 0xee09e thru 0xfdede (0xfe41 bytes) 2023-07-14T18:17:17.989 INFO:tasks.workunit.client.0.smithi163.stdout:1897(105 mod 256): WRITE 0x5626 thru 0xb6c4 (0x609f bytes) 2023-07-14T18:17:17.989 INFO:tasks.workunit.client.0.smithi163.stdout:1898(106 mod 256): READ 0xbc83b thru 0xc83e2 (0xbba8 bytes) 2023-07-14T18:17:17.989 INFO:tasks.workunit.client.0.smithi163.stdout:1899(107 mod 256): COPY 0xe6dbd thru 0xec1a5 (0x53e9 bytes) to 0xbc277 thru 0xc165f 2023-07-14T18:17:17.989 INFO:tasks.workunit.client.0.smithi163.stdout:1900(108 mod 256): MAPREAD 0x81acc thru 0x8ab8e (0x90c3 bytes) 2023-07-14T18:17:17.989 INFO:tasks.workunit.client.0.smithi163.stdout:1901(109 mod 256): COPY 0x7cf36 thru 0x83780 (0x684b bytes) to 0xcaf07 thru 0xd1751 2023-07-14T18:17:17.989 INFO:tasks.workunit.client.0.smithi163.stdout:1902(110 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.989 INFO:tasks.workunit.client.0.smithi163.stdout:1903(111 mod 256): READ 0x81981 thru 0x8a03b (0x86bb bytes) 2023-07-14T18:17:17.990 INFO:tasks.workunit.client.0.smithi163.stdout:1904(112 mod 256): FALLOC 0x27036 thru 0x31559 (0xa523 bytes) INTERIOR 2023-07-14T18:17:17.990 INFO:tasks.workunit.client.0.smithi163.stdout:1905(113 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.990 INFO:tasks.workunit.client.0.smithi163.stdout:1906(114 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.990 INFO:tasks.workunit.client.0.smithi163.stdout:1907(115 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.990 INFO:tasks.workunit.client.0.smithi163.stdout:1908(116 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.990 INFO:tasks.workunit.client.0.smithi163.stdout:1909(117 mod 256): READ 0xcb30b thru 0xd32ca (0x7fc0 bytes) 2023-07-14T18:17:17.990 INFO:tasks.workunit.client.0.smithi163.stdout:1910(118 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.990 INFO:tasks.workunit.client.0.smithi163.stdout:1911(119 mod 256): WRITE 0x37b72 thru 0x3fd48 (0x81d7 bytes) ***WWWW 2023-07-14T18:17:17.991 INFO:tasks.workunit.client.0.smithi163.stdout:1912(120 mod 256): COPY 0x71428 thru 0x77967 (0x6540 bytes) to 0x3bc2b thru 0x4216a 2023-07-14T18:17:17.991 INFO:tasks.workunit.client.0.smithi163.stdout:1913(121 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.991 INFO:tasks.workunit.client.0.smithi163.stdout:1914(122 mod 256): TRUNCATE DOWN from 0xfdedf to 0x6b233 2023-07-14T18:17:17.991 INFO:tasks.workunit.client.0.smithi163.stdout:1915(123 mod 256): PUNCH 0x5291b thru 0x5445a (0x1b40 bytes) 2023-07-14T18:17:17.991 INFO:tasks.workunit.client.0.smithi163.stdout:1916(124 mod 256): WRITE 0x34d9f thru 0x3ac54 (0x5eb6 bytes) ***WWWW 2023-07-14T18:17:17.991 INFO:tasks.workunit.client.0.smithi163.stdout:1917(125 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.991 INFO:tasks.workunit.client.0.smithi163.stdout:1918(126 mod 256): MAPWRITE 0x4a97 thru 0x106c8 (0xbc32 bytes) 2023-07-14T18:17:17.991 INFO:tasks.workunit.client.0.smithi163.stdout:1919(127 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.992 INFO:tasks.workunit.client.0.smithi163.stdout:1920(128 mod 256): COPY 0x3bc31 thru 0x3de6f (0x223f bytes) to 0xf61bf thru 0xf83fd 2023-07-14T18:17:17.992 INFO:tasks.workunit.client.0.smithi163.stdout:1921(129 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.992 INFO:tasks.workunit.client.0.smithi163.stdout:1922(130 mod 256): COPY 0x99102 thru 0x9fc65 (0x6b64 bytes) to 0x67350 thru 0x6deb3 2023-07-14T18:17:17.992 INFO:tasks.workunit.client.0.smithi163.stdout:1923(131 mod 256): PUNCH 0xf15dd thru 0xf83fd (0x6e21 bytes) 2023-07-14T18:17:17.992 INFO:tasks.workunit.client.0.smithi163.stdout:1924(132 mod 256): PUNCH 0x97785 thru 0xa20dc (0xa958 bytes) 2023-07-14T18:17:17.992 INFO:tasks.workunit.client.0.smithi163.stdout:1925(133 mod 256): TRUNCATE DOWN from 0xf83fe to 0x4ef7a 2023-07-14T18:17:17.992 INFO:tasks.workunit.client.0.smithi163.stdout:1926(134 mod 256): READ 0x131fb thru 0x21a02 (0xe808 bytes) 2023-07-14T18:17:17.992 INFO:tasks.workunit.client.0.smithi163.stdout:1927(135 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.993 INFO:tasks.workunit.client.0.smithi163.stdout:1928(136 mod 256): TRUNCATE DOWN from 0x4ef7a to 0x10df6 ******WWWW 2023-07-14T18:17:17.993 INFO:tasks.workunit.client.0.smithi163.stdout:1929(137 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.993 INFO:tasks.workunit.client.0.smithi163.stdout:1930(138 mod 256): MAPWRITE 0xe1c30 thru 0xeeb4f (0xcf20 bytes) 2023-07-14T18:17:17.993 INFO:tasks.workunit.client.0.smithi163.stdout:1931(139 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.993 INFO:tasks.workunit.client.0.smithi163.stdout:1932(140 mod 256): MAPWRITE 0xc9c65 thru 0xd874b (0xeae7 bytes) 2023-07-14T18:17:17.993 INFO:tasks.workunit.client.0.smithi163.stdout:1933(141 mod 256): FALLOC 0x3f664 thru 0x483b6 (0x8d52 bytes) INTERIOR 2023-07-14T18:17:17.993 INFO:tasks.workunit.client.0.smithi163.stdout:1934(142 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.993 INFO:tasks.workunit.client.0.smithi163.stdout:1935(143 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.994 INFO:tasks.workunit.client.0.smithi163.stdout:1936(144 mod 256): TRUNCATE DOWN from 0xeeb50 to 0x9d243 2023-07-14T18:17:17.994 INFO:tasks.workunit.client.0.smithi163.stdout:1937(145 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.994 INFO:tasks.workunit.client.0.smithi163.stdout:1938(146 mod 256): WRITE 0x99399 thru 0xa2c62 (0x98ca bytes) EXTEND 2023-07-14T18:17:17.994 INFO:tasks.workunit.client.0.smithi163.stdout:1939(147 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.994 INFO:tasks.workunit.client.0.smithi163.stdout:1940(148 mod 256): PUNCH 0x89f59 thru 0x8aa82 (0xb2a bytes) 2023-07-14T18:17:17.994 INFO:tasks.workunit.client.0.smithi163.stdout:1941(149 mod 256): MAPWRITE 0x7995b thru 0x819e4 (0x808a bytes) 2023-07-14T18:17:17.994 INFO:tasks.workunit.client.0.smithi163.stdout:1942(150 mod 256): MAPREAD 0x9c483 thru 0x9e7b3 (0x2331 bytes) 2023-07-14T18:17:17.994 INFO:tasks.workunit.client.0.smithi163.stdout:1943(151 mod 256): FALLOC 0xbd477 thru 0xcc43e (0xefc7 bytes) EXTENDING 2023-07-14T18:17:17.995 INFO:tasks.workunit.client.0.smithi163.stdout:1944(152 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.995 INFO:tasks.workunit.client.0.smithi163.stdout:1945(153 mod 256): READ 0xb7312 thru 0xbe66a (0x7359 bytes) 2023-07-14T18:17:17.995 INFO:tasks.workunit.client.0.smithi163.stdout:1946(154 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.995 INFO:tasks.workunit.client.0.smithi163.stdout:1947(155 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.995 INFO:tasks.workunit.client.0.smithi163.stdout:1948(156 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.995 INFO:tasks.workunit.client.0.smithi163.stdout:1949(157 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.995 INFO:tasks.workunit.client.0.smithi163.stdout:1950(158 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.995 INFO:tasks.workunit.client.0.smithi163.stdout:1951(159 mod 256): MAPWRITE 0x4f1e6 thru 0x5a89e (0xb6b9 bytes) 2023-07-14T18:17:17.996 INFO:tasks.workunit.client.0.smithi163.stdout:1952(160 mod 256): TRUNCATE DOWN from 0xcc43e to 0x288 ******WWWW 2023-07-14T18:17:17.996 INFO:tasks.workunit.client.0.smithi163.stdout:1953(161 mod 256): FALLOC 0x6fe16 thru 0x75251 (0x543b bytes) EXTENDING 2023-07-14T18:17:17.996 INFO:tasks.workunit.client.0.smithi163.stdout:1954(162 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.996 INFO:tasks.workunit.client.0.smithi163.stdout:1955(163 mod 256): READ 0x392c9 thru 0x49131 (0xfe69 bytes) 2023-07-14T18:17:17.996 INFO:tasks.workunit.client.0.smithi163.stdout:1956(164 mod 256): MAPREAD 0x36df9 thru 0x461d6 (0xf3de bytes) ***RRRR*** 2023-07-14T18:17:17.996 INFO:tasks.workunit.client.0.smithi163.stdout:1957(165 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.996 INFO:tasks.workunit.client.0.smithi163.stdout:1958(166 mod 256): READ 0x5fad0 thru 0x6c738 (0xcc69 bytes) 2023-07-14T18:17:17.996 INFO:tasks.workunit.client.0.smithi163.stdout:1959(167 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.997 INFO:tasks.workunit.client.0.smithi163.stdout:1960(168 mod 256): READ 0x318ed thru 0x33045 (0x1759 bytes) 2023-07-14T18:17:17.997 INFO:tasks.workunit.client.0.smithi163.stdout:1961(169 mod 256): READ 0x116d8 thru 0x13022 (0x194b bytes) 2023-07-14T18:17:17.997 INFO:tasks.workunit.client.0.smithi163.stdout:1962(170 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.997 INFO:tasks.workunit.client.0.smithi163.stdout:1963(171 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.997 INFO:tasks.workunit.client.0.smithi163.stdout:1964(172 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.997 INFO:tasks.workunit.client.0.smithi163.stdout:1965(173 mod 256): READ 0x467cf thru 0x51c10 (0xb442 bytes) 2023-07-14T18:17:17.997 INFO:tasks.workunit.client.0.smithi163.stdout:1966(174 mod 256): COPY 0x2a21d thru 0x33137 (0x8f1b bytes) to 0x164f6 thru 0x1f410 2023-07-14T18:17:17.997 INFO:tasks.workunit.client.0.smithi163.stdout:1967(175 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.998 INFO:tasks.workunit.client.0.smithi163.stdout:1968(176 mod 256): TRUNCATE UP from 0x75251 to 0xdca69 2023-07-14T18:17:17.998 INFO:tasks.workunit.client.0.smithi163.stdout:1969(177 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.998 INFO:tasks.workunit.client.0.smithi163.stdout:1970(178 mod 256): MAPREAD 0x82856 thru 0x8a2ab (0x7a56 bytes) 2023-07-14T18:17:17.998 INFO:tasks.workunit.client.0.smithi163.stdout:1971(179 mod 256): PUNCH 0xb2834 thru 0xc0018 (0xd7e5 bytes) 2023-07-14T18:17:17.998 INFO:tasks.workunit.client.0.smithi163.stdout:1972(180 mod 256): COPY 0x12cea thru 0x1a523 (0x783a bytes) to 0x745db thru 0x7be14 2023-07-14T18:17:17.998 INFO:tasks.workunit.client.0.smithi163.stdout:1973(181 mod 256): MAPWRITE 0x50ae0 thru 0x54a61 (0x3f82 bytes) 2023-07-14T18:17:17.998 INFO:tasks.workunit.client.0.smithi163.stdout:1974(182 mod 256): COPY 0xa14a thru 0x10abf (0x6976 bytes) to 0x6b81c thru 0x72191 2023-07-14T18:17:17.998 INFO:tasks.workunit.client.0.smithi163.stdout:1975(183 mod 256): PUNCH 0xdc1c7 thru 0xdca68 (0x8a2 bytes) 2023-07-14T18:17:17.999 INFO:tasks.workunit.client.0.smithi163.stdout:1976(184 mod 256): COPY 0xc169b thru 0xc53bd (0x3d23 bytes) to 0xa0a09 thru 0xa472b 2023-07-14T18:17:17.999 INFO:tasks.workunit.client.0.smithi163.stdout:1977(185 mod 256): COPY 0x28e2c thru 0x34e86 (0xc05b bytes) to 0x8477 thru 0x144d1 2023-07-14T18:17:17.999 INFO:tasks.workunit.client.0.smithi163.stdout:1978(186 mod 256): COPY 0x70542 thru 0x7a379 (0x9e38 bytes) to 0xc5079 thru 0xceeb0 2023-07-14T18:17:17.999 INFO:tasks.workunit.client.0.smithi163.stdout:1979(187 mod 256): READ 0x7ece thru 0x1596c (0xda9f bytes) 2023-07-14T18:17:17.999 INFO:tasks.workunit.client.0.smithi163.stdout:1980(188 mod 256): PUNCH 0x76085 thru 0x7ac5e (0x4bda bytes) 2023-07-14T18:17:17.999 INFO:tasks.workunit.client.0.smithi163.stdout:1981(189 mod 256): FALLOC 0x93aa5 thru 0xa05b8 (0xcb13 bytes) INTERIOR 2023-07-14T18:17:17.999 INFO:tasks.workunit.client.0.smithi163.stdout:1982(190 mod 256): SKIPPED (no operation) 2023-07-14T18:17:17.999 INFO:tasks.workunit.client.0.smithi163.stdout:1983(191 mod 256): FALLOC 0xfbe83 thru 0x100000 (0x417d bytes) EXTENDING 2023-07-14T18:17:18.000 INFO:tasks.workunit.client.0.smithi163.stdout:1984(192 mod 256): FALLOC 0xe15bc thru 0xef2ff (0xdd43 bytes) INTERIOR 2023-07-14T18:17:18.000 INFO:tasks.workunit.client.0.smithi163.stdout:1985(193 mod 256): READ 0xae9eb thru 0xb1489 (0x2a9f bytes) 2023-07-14T18:17:18.000 INFO:tasks.workunit.client.0.smithi163.stdout:1986(194 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.000 INFO:tasks.workunit.client.0.smithi163.stdout:1987(195 mod 256): WRITE 0xe46e2 thru 0xeaaeb (0x640a bytes) 2023-07-14T18:17:18.000 INFO:tasks.workunit.client.0.smithi163.stdout:1988(196 mod 256): READ 0x2643a thru 0x342d9 (0xdea0 bytes) 2023-07-14T18:17:18.000 INFO:tasks.workunit.client.0.smithi163.stdout:1989(197 mod 256): MAPREAD 0xf97e3 thru 0xfffff (0x681d bytes) 2023-07-14T18:17:18.000 INFO:tasks.workunit.client.0.smithi163.stdout:1990(198 mod 256): READ 0xfa0b2 thru 0xfffff (0x5f4e bytes) 2023-07-14T18:17:18.001 INFO:tasks.workunit.client.0.smithi163.stdout:1991(199 mod 256): COPY 0x32210 thru 0x34d01 (0x2af2 bytes) to 0x7f3af thru 0x81ea0 2023-07-14T18:17:18.001 INFO:tasks.workunit.client.0.smithi163.stdout:1992(200 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.001 INFO:tasks.workunit.client.0.smithi163.stdout:1993(201 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.001 INFO:tasks.workunit.client.0.smithi163.stdout:1994(202 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.001 INFO:tasks.workunit.client.0.smithi163.stdout:1995(203 mod 256): PUNCH 0x5cb62 thru 0x64cac (0x814b bytes) 2023-07-14T18:17:18.001 INFO:tasks.workunit.client.0.smithi163.stdout:1996(204 mod 256): TRUNCATE DOWN from 0x100000 to 0xe16cd 2023-07-14T18:17:18.001 INFO:tasks.workunit.client.0.smithi163.stdout:1997(205 mod 256): FALLOC 0xe4a2e thru 0xf1400 (0xc9d2 bytes) PAST_EOF 2023-07-14T18:17:18.001 INFO:tasks.workunit.client.0.smithi163.stdout:1998(206 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.002 INFO:tasks.workunit.client.0.smithi163.stdout:1999(207 mod 256): FALLOC 0x4c10a thru 0x549b9 (0x88af bytes) INTERIOR 2023-07-14T18:17:18.002 INFO:tasks.workunit.client.0.smithi163.stdout:2000(208 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.002 INFO:tasks.workunit.client.0.smithi163.stdout:2001(209 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.002 INFO:tasks.workunit.client.0.smithi163.stdout:2002(210 mod 256): TRUNCATE UP from 0xe16cd to 0xe4f4e 2023-07-14T18:17:18.002 INFO:tasks.workunit.client.0.smithi163.stdout:2003(211 mod 256): TRUNCATE DOWN from 0xe4f4e to 0x397b8 2023-07-14T18:17:18.002 INFO:tasks.workunit.client.0.smithi163.stdout:2004(212 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.002 INFO:tasks.workunit.client.0.smithi163.stdout:2005(213 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.002 INFO:tasks.workunit.client.0.smithi163.stdout:2006(214 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.003 INFO:tasks.workunit.client.0.smithi163.stdout:2007(215 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.003 INFO:tasks.workunit.client.0.smithi163.stdout:2008(216 mod 256): COPY 0x248e thru 0xfa43 (0xd5b6 bytes) to 0x4d7e3 thru 0x5ad98 2023-07-14T18:17:18.003 INFO:tasks.workunit.client.0.smithi163.stdout:2009(217 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.003 INFO:tasks.workunit.client.0.smithi163.stdout:2010(218 mod 256): MAPREAD 0x45aad thru 0x51dbc (0xc310 bytes) 2023-07-14T18:17:18.003 INFO:tasks.workunit.client.0.smithi163.stdout:2011(219 mod 256): READ 0x450d1 thru 0x4588c (0x7bc bytes) 2023-07-14T18:17:18.003 INFO:tasks.workunit.client.0.smithi163.stdout:2012(220 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.003 INFO:tasks.workunit.client.0.smithi163.stdout:2013(221 mod 256): FALLOC 0x49005 thru 0x56997 (0xd992 bytes) INTERIOR 2023-07-14T18:17:18.003 INFO:tasks.workunit.client.0.smithi163.stdout:2014(222 mod 256): COPY 0x327ef thru 0x3dd4f (0xb561 bytes) to 0x54382 thru 0x5f8e2 EEEE****** 2023-07-14T18:17:18.004 INFO:tasks.workunit.client.0.smithi163.stdout:2015(223 mod 256): COPY 0x3cff2 thru 0x456d0 (0x86df bytes) to 0x9f973 thru 0xa8051 2023-07-14T18:17:18.004 INFO:tasks.workunit.client.0.smithi163.stdout:2016(224 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.004 INFO:tasks.workunit.client.0.smithi163.stdout:2017(225 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.004 INFO:tasks.workunit.client.0.smithi163.stdout:2018(226 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.004 INFO:tasks.workunit.client.0.smithi163.stdout:2019(227 mod 256): MAPWRITE 0xd3850 thru 0xdbd28 (0x84d9 bytes) 2023-07-14T18:17:18.004 INFO:tasks.workunit.client.0.smithi163.stdout:2020(228 mod 256): READ 0xc49ca thru 0xd391f (0xef56 bytes) 2023-07-14T18:17:18.004 INFO:tasks.workunit.client.0.smithi163.stdout:2021(229 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.004 INFO:tasks.workunit.client.0.smithi163.stdout:2022(230 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.005 INFO:tasks.workunit.client.0.smithi163.stdout:2023(231 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.005 INFO:tasks.workunit.client.0.smithi163.stdout:2024(232 mod 256): TRUNCATE UP from 0xdbd29 to 0xe3364 2023-07-14T18:17:18.005 INFO:tasks.workunit.client.0.smithi163.stdout:2025(233 mod 256): MAPWRITE 0x9f33e thru 0xaa053 (0xad16 bytes) 2023-07-14T18:17:18.005 INFO:tasks.workunit.client.0.smithi163.stdout:2026(234 mod 256): READ 0x63a83 thru 0x72abf (0xf03d bytes) 2023-07-14T18:17:18.005 INFO:tasks.workunit.client.0.smithi163.stdout:2027(235 mod 256): WRITE 0x70e43 thru 0x7b413 (0xa5d1 bytes) 2023-07-14T18:17:18.005 INFO:tasks.workunit.client.0.smithi163.stdout:2028(236 mod 256): PUNCH 0xa3d4e thru 0xb2a5d (0xed10 bytes) 2023-07-14T18:17:18.005 INFO:tasks.workunit.client.0.smithi163.stdout:2029(237 mod 256): READ 0x63ae0 thru 0x654f0 (0x1a11 bytes) 2023-07-14T18:17:18.005 INFO:tasks.workunit.client.0.smithi163.stdout:2030(238 mod 256): COPY 0x95a6 thru 0xcc1c (0x3677 bytes) to 0x25c19 thru 0x2928f 2023-07-14T18:17:18.006 INFO:tasks.workunit.client.0.smithi163.stdout:2031(239 mod 256): MAPWRITE 0x1f381 thru 0x272c5 (0x7f45 bytes) 2023-07-14T18:17:18.006 INFO:tasks.workunit.client.0.smithi163.stdout:2032(240 mod 256): WRITE 0x24509 thru 0x25243 (0xd3b bytes) 2023-07-14T18:17:18.006 INFO:tasks.workunit.client.0.smithi163.stdout:2033(241 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.006 INFO:tasks.workunit.client.0.smithi163.stdout:2034(242 mod 256): MAPWRITE 0x88f6 thru 0x11944 (0x904f bytes) 2023-07-14T18:17:18.006 INFO:tasks.workunit.client.0.smithi163.stdout:2035(243 mod 256): TRUNCATE DOWN from 0xe3364 to 0xa1206 2023-07-14T18:17:18.006 INFO:tasks.workunit.client.0.smithi163.stdout:2036(244 mod 256): PUNCH 0x75335 thru 0x75924 (0x5f0 bytes) 2023-07-14T18:17:18.006 INFO:tasks.workunit.client.0.smithi163.stdout:2037(245 mod 256): FALLOC 0x8bda5 thru 0x991df (0xd43a bytes) INTERIOR 2023-07-14T18:17:18.006 INFO:tasks.workunit.client.0.smithi163.stdout:2038(246 mod 256): TRUNCATE UP from 0xa1206 to 0xd330c 2023-07-14T18:17:18.007 INFO:tasks.workunit.client.0.smithi163.stdout:2039(247 mod 256): MAPWRITE 0x2e4e3 thru 0x3abb0 (0xc6ce bytes) ******WWWW 2023-07-14T18:17:18.007 INFO:tasks.workunit.client.0.smithi163.stdout:2040(248 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.007 INFO:tasks.workunit.client.0.smithi163.stdout:2041(249 mod 256): COPY 0xca3aa thru 0xd330b (0x8f62 bytes) to 0x6fbd8 thru 0x78b39 2023-07-14T18:17:18.007 INFO:tasks.workunit.client.0.smithi163.stdout:2042(250 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.007 INFO:tasks.workunit.client.0.smithi163.stdout:2043(251 mod 256): COPY 0x2835a thru 0x3175e (0x9405 bytes) to 0x6b5e6 thru 0x749ea 2023-07-14T18:17:18.007 INFO:tasks.workunit.client.0.smithi163.stdout:2044(252 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.007 INFO:tasks.workunit.client.0.smithi163.stdout:2045(253 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.007 INFO:tasks.workunit.client.0.smithi163.stdout:2046(254 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.008 INFO:tasks.workunit.client.0.smithi163.stdout:2047(255 mod 256): WRITE 0x3b6ff thru 0x459a8 (0xa2aa bytes) 2023-07-14T18:17:18.008 INFO:tasks.workunit.client.0.smithi163.stdout:2048( 0 mod 256): READ 0x7711a thru 0x8346d (0xc354 bytes) 2023-07-14T18:17:18.008 INFO:tasks.workunit.client.0.smithi163.stdout:2049( 1 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.008 INFO:tasks.workunit.client.0.smithi163.stdout:2050( 2 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.008 INFO:tasks.workunit.client.0.smithi163.stdout:2051( 3 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.008 INFO:tasks.workunit.client.0.smithi163.stdout:2052( 4 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.008 INFO:tasks.workunit.client.0.smithi163.stdout:2053( 5 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.008 INFO:tasks.workunit.client.0.smithi163.stdout:2054( 6 mod 256): MAPWRITE 0xc9cd6 thru 0xcd83a (0x3b65 bytes) 2023-07-14T18:17:18.009 INFO:tasks.workunit.client.0.smithi163.stdout:2055( 7 mod 256): MAPWRITE 0x9c2f thru 0x141b6 (0xa588 bytes) 2023-07-14T18:17:18.009 INFO:tasks.workunit.client.0.smithi163.stdout:2056( 8 mod 256): WRITE 0x8bcdb thru 0x96dac (0xb0d2 bytes) 2023-07-14T18:17:18.009 INFO:tasks.workunit.client.0.smithi163.stdout:2057( 9 mod 256): READ 0x7ec9a thru 0x82e15 (0x417c bytes) 2023-07-14T18:17:18.009 INFO:tasks.workunit.client.0.smithi163.stdout:2058( 10 mod 256): TRUNCATE UP from 0xd330c to 0xebd1e 2023-07-14T18:17:18.009 INFO:tasks.workunit.client.0.smithi163.stdout:2059( 11 mod 256): COPY 0xea97e thru 0xebd1d (0x13a0 bytes) to 0xe2f18 thru 0xe42b7 2023-07-14T18:17:18.009 INFO:tasks.workunit.client.0.smithi163.stdout:2060( 12 mod 256): PUNCH 0xe1e6c thru 0xe1e97 (0x2c bytes) 2023-07-14T18:17:18.009 INFO:tasks.workunit.client.0.smithi163.stdout:2061( 13 mod 256): FALLOC 0x2f187 thru 0x3535f (0x61d8 bytes) INTERIOR 2023-07-14T18:17:18.009 INFO:tasks.workunit.client.0.smithi163.stdout:2062( 14 mod 256): MAPWRITE 0x17b1b thru 0x1acaf (0x3195 bytes) 2023-07-14T18:17:18.010 INFO:tasks.workunit.client.0.smithi163.stdout:2063( 15 mod 256): READ 0xb59fe thru 0xc4bb2 (0xf1b5 bytes) 2023-07-14T18:17:18.010 INFO:tasks.workunit.client.0.smithi163.stdout:2064( 16 mod 256): PUNCH 0x1d17 thru 0x4454 (0x273e bytes) 2023-07-14T18:17:18.010 INFO:tasks.workunit.client.0.smithi163.stdout:2065( 17 mod 256): MAPREAD 0x65fbe thru 0x6f5a6 (0x95e9 bytes) 2023-07-14T18:17:18.010 INFO:tasks.workunit.client.0.smithi163.stdout:2066( 18 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.010 INFO:tasks.workunit.client.0.smithi163.stdout:2067( 19 mod 256): MAPREAD 0x690c5 thru 0x77f01 (0xee3d bytes) 2023-07-14T18:17:18.010 INFO:tasks.workunit.client.0.smithi163.stdout:2068( 20 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.010 INFO:tasks.workunit.client.0.smithi163.stdout:2069( 21 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.010 INFO:tasks.workunit.client.0.smithi163.stdout:2070( 22 mod 256): WRITE 0x39435 thru 0x447ee (0xb3ba bytes) 2023-07-14T18:17:18.011 INFO:tasks.workunit.client.0.smithi163.stdout:2071( 23 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.011 INFO:tasks.workunit.client.0.smithi163.stdout:2072( 24 mod 256): TRUNCATE DOWN from 0xebd1e to 0xd39b4 2023-07-14T18:17:18.011 INFO:tasks.workunit.client.0.smithi163.stdout:2073( 25 mod 256): MAPREAD 0x2a9fb thru 0x3708f (0xc695 bytes) 2023-07-14T18:17:18.011 INFO:tasks.workunit.client.0.smithi163.stdout:2074( 26 mod 256): PUNCH 0xce633 thru 0xd0d2b (0x26f9 bytes) 2023-07-14T18:17:18.011 INFO:tasks.workunit.client.0.smithi163.stdout:2075( 27 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.011 INFO:tasks.workunit.client.0.smithi163.stdout:2076( 28 mod 256): COPY 0x86dc8 thru 0x90784 (0x99bd bytes) to 0x35783 thru 0x3f13f ******EEEE 2023-07-14T18:17:18.011 INFO:tasks.workunit.client.0.smithi163.stdout:2077( 29 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.011 INFO:tasks.workunit.client.0.smithi163.stdout:2078( 30 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.012 INFO:tasks.workunit.client.0.smithi163.stdout:2079( 31 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.012 INFO:tasks.workunit.client.0.smithi163.stdout:2080( 32 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.012 INFO:tasks.workunit.client.0.smithi163.stdout:2081( 33 mod 256): PUNCH 0x8057c thru 0x8fbef (0xf674 bytes) 2023-07-14T18:17:18.012 INFO:tasks.workunit.client.0.smithi163.stdout:2082( 34 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.012 INFO:tasks.workunit.client.0.smithi163.stdout:2083( 35 mod 256): COPY 0x519d3 thru 0x55860 (0x3e8e bytes) to 0xf6a2a thru 0xfa8b7 2023-07-14T18:17:18.012 INFO:tasks.workunit.client.0.smithi163.stdout:2084( 36 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.012 INFO:tasks.workunit.client.0.smithi163.stdout:2085( 37 mod 256): PUNCH 0xed1de thru 0xfa377 (0xd19a bytes) 2023-07-14T18:17:18.012 INFO:tasks.workunit.client.0.smithi163.stdout:2086( 38 mod 256): TRUNCATE DOWN from 0xfa8b8 to 0x93949 2023-07-14T18:17:18.013 INFO:tasks.workunit.client.0.smithi163.stdout:2087( 39 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.013 INFO:tasks.workunit.client.0.smithi163.stdout:2088( 40 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.013 INFO:tasks.workunit.client.0.smithi163.stdout:2089( 41 mod 256): TRUNCATE UP from 0x93949 to 0xfe53d 2023-07-14T18:17:18.013 INFO:tasks.workunit.client.0.smithi163.stdout:2090( 42 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.013 INFO:tasks.workunit.client.0.smithi163.stdout:2091( 43 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.013 INFO:tasks.workunit.client.0.smithi163.stdout:2092( 44 mod 256): TRUNCATE DOWN from 0xfe53d to 0xc44b7 2023-07-14T18:17:18.013 INFO:tasks.workunit.client.0.smithi163.stdout:2093( 45 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.013 INFO:tasks.workunit.client.0.smithi163.stdout:2094( 46 mod 256): READ 0x4148e thru 0x492fb (0x7e6e bytes) 2023-07-14T18:17:18.014 INFO:tasks.workunit.client.0.smithi163.stdout:2095( 47 mod 256): MAPWRITE 0xbb7b thru 0x157e7 (0x9c6d bytes) 2023-07-14T18:17:18.014 INFO:tasks.workunit.client.0.smithi163.stdout:2096( 48 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.014 INFO:tasks.workunit.client.0.smithi163.stdout:2097( 49 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.014 INFO:tasks.workunit.client.0.smithi163.stdout:2098( 50 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.014 INFO:tasks.workunit.client.0.smithi163.stdout:2099( 51 mod 256): MAPWRITE 0x8f117 thru 0x99861 (0xa74b bytes) 2023-07-14T18:17:18.014 INFO:tasks.workunit.client.0.smithi163.stdout:2100( 52 mod 256): READ 0xb79da thru 0xbbe27 (0x444e bytes) 2023-07-14T18:17:18.014 INFO:tasks.workunit.client.0.smithi163.stdout:2101( 53 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.014 INFO:tasks.workunit.client.0.smithi163.stdout:2102( 54 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.015 INFO:tasks.workunit.client.0.smithi163.stdout:2103( 55 mod 256): MAPWRITE 0x4b9f9 thru 0x4c682 (0xc8a bytes) 2023-07-14T18:17:18.015 INFO:tasks.workunit.client.0.smithi163.stdout:2104( 56 mod 256): PUNCH 0x7d095 thru 0x8aef0 (0xde5c bytes) 2023-07-14T18:17:18.015 INFO:tasks.workunit.client.0.smithi163.stdout:2105( 57 mod 256): WRITE 0xd626f thru 0xe14b8 (0xb24a bytes) HOLE 2023-07-14T18:17:18.015 INFO:tasks.workunit.client.0.smithi163.stdout:2106( 58 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.015 INFO:tasks.workunit.client.0.smithi163.stdout:2107( 59 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.015 INFO:tasks.workunit.client.0.smithi163.stdout:2108( 60 mod 256): MAPWRITE 0xa2ae6 thru 0xa95d3 (0x6aee bytes) 2023-07-14T18:17:18.015 INFO:tasks.workunit.client.0.smithi163.stdout:2109( 61 mod 256): TRUNCATE DOWN from 0xe14b9 to 0x87241 2023-07-14T18:17:18.015 INFO:tasks.workunit.client.0.smithi163.stdout:2110( 62 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.016 INFO:tasks.workunit.client.0.smithi163.stdout:2111( 63 mod 256): TRUNCATE DOWN from 0x87241 to 0x2e755 ******WWWW 2023-07-14T18:17:18.016 INFO:tasks.workunit.client.0.smithi163.stdout:2112( 64 mod 256): READ 0x29533 thru 0x2e754 (0x5222 bytes) 2023-07-14T18:17:18.016 INFO:tasks.workunit.client.0.smithi163.stdout:2113( 65 mod 256): FALLOC 0x1b5ff thru 0x2910e (0xdb0f bytes) INTERIOR 2023-07-14T18:17:18.016 INFO:tasks.workunit.client.0.smithi163.stdout:2114( 66 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.016 INFO:tasks.workunit.client.0.smithi163.stdout:2115( 67 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.016 INFO:tasks.workunit.client.0.smithi163.stdout:2116( 68 mod 256): PUNCH 0x680f thru 0x721a (0xa0c bytes) 2023-07-14T18:17:18.016 INFO:tasks.workunit.client.0.smithi163.stdout:2117( 69 mod 256): READ 0x24713 thru 0x2877b (0x4069 bytes) 2023-07-14T18:17:18.016 INFO:tasks.workunit.client.0.smithi163.stdout:2118( 70 mod 256): READ 0x1fd5 thru 0xd7fe (0xb82a bytes) 2023-07-14T18:17:18.017 INFO:tasks.workunit.client.0.smithi163.stdout:2119( 71 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.017 INFO:tasks.workunit.client.0.smithi163.stdout:2120( 72 mod 256): WRITE 0x35c2a thru 0x369bb (0xd92 bytes) HOLE 2023-07-14T18:17:18.017 INFO:tasks.workunit.client.0.smithi163.stdout:2121( 73 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.017 INFO:tasks.workunit.client.0.smithi163.stdout:2122( 74 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.017 INFO:tasks.workunit.client.0.smithi163.stdout:2123( 75 mod 256): PUNCH 0x128f9 thru 0x1bc4f (0x9357 bytes) 2023-07-14T18:17:18.017 INFO:tasks.workunit.client.0.smithi163.stdout:2124( 76 mod 256): READ 0x2f086 thru 0x369bb (0x7936 bytes) 2023-07-14T18:17:18.017 INFO:tasks.workunit.client.0.smithi163.stdout:2125( 77 mod 256): WRITE 0x69bb2 thru 0x6cbb4 (0x3003 bytes) HOLE ***WWWW 2023-07-14T18:17:18.017 INFO:tasks.workunit.client.0.smithi163.stdout:2126( 78 mod 256): TRUNCATE DOWN from 0x6cbb5 to 0x4f7a9 2023-07-14T18:17:18.018 INFO:tasks.workunit.client.0.smithi163.stdout:2127( 79 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.018 INFO:tasks.workunit.client.0.smithi163.stdout:2128( 80 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.018 INFO:tasks.workunit.client.0.smithi163.stdout:2129( 81 mod 256): MAPWRITE 0xaff61 thru 0xb6c9d (0x6d3d bytes) 2023-07-14T18:17:18.018 INFO:tasks.workunit.client.0.smithi163.stdout:2130( 82 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.018 INFO:tasks.workunit.client.0.smithi163.stdout:2131( 83 mod 256): TRUNCATE DOWN from 0xb6c9e to 0x2e471 ******WWWW 2023-07-14T18:17:18.018 INFO:tasks.workunit.client.0.smithi163.stdout:2132( 84 mod 256): TRUNCATE DOWN from 0x2e471 to 0x3c29 2023-07-14T18:17:18.018 INFO:tasks.workunit.client.0.smithi163.stdout:2133( 85 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.018 INFO:tasks.workunit.client.0.smithi163.stdout:2134( 86 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.019 INFO:tasks.workunit.client.0.smithi163.stdout:2135( 87 mod 256): TRUNCATE UP from 0x3c29 to 0x6b37a ******WWWW 2023-07-14T18:17:18.019 INFO:tasks.workunit.client.0.smithi163.stdout:2136( 88 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.019 INFO:tasks.workunit.client.0.smithi163.stdout:2137( 89 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.019 INFO:tasks.workunit.client.0.smithi163.stdout:2138( 90 mod 256): MAPREAD 0x59154 thru 0x633c0 (0xa26d bytes) 2023-07-14T18:17:18.019 INFO:tasks.workunit.client.0.smithi163.stdout:2139( 91 mod 256): MAPWRITE 0x1d4fd thru 0x22855 (0x5359 bytes) 2023-07-14T18:17:18.019 INFO:tasks.workunit.client.0.smithi163.stdout:2140( 92 mod 256): MAPREAD 0x3faf4 thru 0x40199 (0x6a6 bytes) 2023-07-14T18:17:18.019 INFO:tasks.workunit.client.0.smithi163.stdout:2141( 93 mod 256): WRITE 0x80448 thru 0x85a7e (0x5637 bytes) HOLE 2023-07-14T18:17:18.019 INFO:tasks.workunit.client.0.smithi163.stdout:2142( 94 mod 256): MAPREAD 0x2d172 thru 0x2d48e (0x31d bytes) 2023-07-14T18:17:18.020 INFO:tasks.workunit.client.0.smithi163.stdout:2143( 95 mod 256): COPY 0x2deb3 thru 0x39e77 (0xbfc5 bytes) to 0x8baa1 thru 0x97a65 EEEE****** 2023-07-14T18:17:18.020 INFO:tasks.workunit.client.0.smithi163.stdout:2144( 96 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.020 INFO:tasks.workunit.client.0.smithi163.stdout:2145( 97 mod 256): FALLOC 0xdfe57 thru 0xe0720 (0x8c9 bytes) PAST_EOF 2023-07-14T18:17:18.020 INFO:tasks.workunit.client.0.smithi163.stdout:2146( 98 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.020 INFO:tasks.workunit.client.0.smithi163.stdout:2147( 99 mod 256): MAPREAD 0x2d73a thru 0x3a1c3 (0xca8a bytes) ***RRRR*** 2023-07-14T18:17:18.020 INFO:tasks.workunit.client.0.smithi163.stdout:2148(100 mod 256): READ 0x90b44 thru 0x94975 (0x3e32 bytes) 2023-07-14T18:17:18.020 INFO:tasks.workunit.client.0.smithi163.stdout:2149(101 mod 256): COPY 0x972c1 thru 0x97a65 (0x7a5 bytes) to 0xc858c thru 0xc8d30 2023-07-14T18:17:18.021 INFO:tasks.workunit.client.0.smithi163.stdout:2150(102 mod 256): MAPREAD 0xc5956 thru 0xc79a6 (0x2051 bytes) 2023-07-14T18:17:18.021 INFO:tasks.workunit.client.0.smithi163.stdout:2151(103 mod 256): FALLOC 0xb8ec5 thru 0xbbb9c (0x2cd7 bytes) INTERIOR 2023-07-14T18:17:18.021 INFO:tasks.workunit.client.0.smithi163.stdout:2152(104 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.021 INFO:tasks.workunit.client.0.smithi163.stdout:2153(105 mod 256): MAPWRITE 0xb4c16 thru 0xba82e (0x5c19 bytes) 2023-07-14T18:17:18.021 INFO:tasks.workunit.client.0.smithi163.stdout:2154(106 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.021 INFO:tasks.workunit.client.0.smithi163.stdout:2155(107 mod 256): COPY 0x921e7 thru 0x927a4 (0x5be bytes) to 0xdf4ae thru 0xdfa6b 2023-07-14T18:17:18.021 INFO:tasks.workunit.client.0.smithi163.stdout:2156(108 mod 256): PUNCH 0x85b7 thru 0x9e5b (0x18a5 bytes) 2023-07-14T18:17:18.021 INFO:tasks.workunit.client.0.smithi163.stdout:2157(109 mod 256): WRITE 0x89bc7 thru 0x92353 (0x878d bytes) 2023-07-14T18:17:18.022 INFO:tasks.workunit.client.0.smithi163.stdout:2158(110 mod 256): WRITE 0x4e070 thru 0x57467 (0x93f8 bytes) 2023-07-14T18:17:18.022 INFO:tasks.workunit.client.0.smithi163.stdout:2159(111 mod 256): FALLOC 0x1366f thru 0x19b23 (0x64b4 bytes) INTERIOR 2023-07-14T18:17:18.022 INFO:tasks.workunit.client.0.smithi163.stdout:2160(112 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.022 INFO:tasks.workunit.client.0.smithi163.stdout:2161(113 mod 256): COPY 0x7550c thru 0x84a0b (0xf500 bytes) to 0x9a540 thru 0xa9a3f 2023-07-14T18:17:18.022 INFO:tasks.workunit.client.0.smithi163.stdout:2162(114 mod 256): WRITE 0xe26d7 thru 0xe6905 (0x422f bytes) HOLE 2023-07-14T18:17:18.022 INFO:tasks.workunit.client.0.smithi163.stdout:2163(115 mod 256): MAPREAD 0x5148c thru 0x5d9b1 (0xc526 bytes) 2023-07-14T18:17:18.022 INFO:tasks.workunit.client.0.smithi163.stdout:2164(116 mod 256): WRITE 0x9f0c5 thru 0xabf9c (0xced8 bytes) 2023-07-14T18:17:18.022 INFO:tasks.workunit.client.0.smithi163.stdout:2165(117 mod 256): FALLOC 0x755e thru 0x15794 (0xe236 bytes) INTERIOR 2023-07-14T18:17:18.023 INFO:tasks.workunit.client.0.smithi163.stdout:2166(118 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.023 INFO:tasks.workunit.client.0.smithi163.stdout:2167(119 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.023 INFO:tasks.workunit.client.0.smithi163.stdout:2168(120 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.023 INFO:tasks.workunit.client.0.smithi163.stdout:2169(121 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.023 INFO:tasks.workunit.client.0.smithi163.stdout:2170(122 mod 256): PUNCH 0x59695 thru 0x597f5 (0x161 bytes) 2023-07-14T18:17:18.023 INFO:tasks.workunit.client.0.smithi163.stdout:2171(123 mod 256): MAPWRITE 0xd02e7 thru 0xd988f (0x95a9 bytes) 2023-07-14T18:17:18.023 INFO:tasks.workunit.client.0.smithi163.stdout:2172(124 mod 256): MAPREAD 0x3a017 thru 0x403d0 (0x63ba bytes) 2023-07-14T18:17:18.023 INFO:tasks.workunit.client.0.smithi163.stdout:2173(125 mod 256): COPY 0xcf752 thru 0xde4fc (0xedab bytes) to 0xb71e3 thru 0xc5f8d 2023-07-14T18:17:18.024 INFO:tasks.workunit.client.0.smithi163.stdout:2174(126 mod 256): READ 0x165a2 thru 0x1dd09 (0x7768 bytes) 2023-07-14T18:17:18.024 INFO:tasks.workunit.client.0.smithi163.stdout:2175(127 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.024 INFO:tasks.workunit.client.0.smithi163.stdout:2176(128 mod 256): PUNCH 0xb16a0 thru 0xb8f73 (0x78d4 bytes) 2023-07-14T18:17:18.024 INFO:tasks.workunit.client.0.smithi163.stdout:2177(129 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.024 INFO:tasks.workunit.client.0.smithi163.stdout:2178(130 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.024 INFO:tasks.workunit.client.0.smithi163.stdout:2179(131 mod 256): TRUNCATE DOWN from 0xe6906 to 0x369e ******WWWW 2023-07-14T18:17:18.024 INFO:tasks.workunit.client.0.smithi163.stdout:2180(132 mod 256): MAPREAD 0x1552 thru 0x369d (0x214c bytes) 2023-07-14T18:17:18.025 INFO:tasks.workunit.client.0.smithi163.stdout:2181(133 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.025 INFO:tasks.workunit.client.0.smithi163.stdout:2182(134 mod 256): PUNCH 0x1ba5 thru 0x369d (0x1af9 bytes) 2023-07-14T18:17:18.025 INFO:tasks.workunit.client.0.smithi163.stdout:2183(135 mod 256): COPY 0x27ac thru 0x369d (0xef2 bytes) to 0x4bb5f thru 0x4ca50 2023-07-14T18:17:18.025 INFO:tasks.workunit.client.0.smithi163.stdout:2184(136 mod 256): READ 0x8530 thru 0x12910 (0xa3e1 bytes) 2023-07-14T18:17:18.025 INFO:tasks.workunit.client.0.smithi163.stdout:2185(137 mod 256): WRITE 0xd35b thru 0x15e0e (0x8ab4 bytes) 2023-07-14T18:17:18.025 INFO:tasks.workunit.client.0.smithi163.stdout:2186(138 mod 256): MAPWRITE 0x9c2e7 thru 0xa3b5a (0x7874 bytes) 2023-07-14T18:17:18.025 INFO:tasks.workunit.client.0.smithi163.stdout:2187(139 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.025 INFO:tasks.workunit.client.0.smithi163.stdout:2188(140 mod 256): FALLOC 0x79dc8 thru 0x89cd3 (0xff0b bytes) INTERIOR 2023-07-14T18:17:18.026 INFO:tasks.workunit.client.0.smithi163.stdout:2189(141 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.026 INFO:tasks.workunit.client.0.smithi163.stdout:2190(142 mod 256): TRUNCATE DOWN from 0xa3b5b to 0x4f974 2023-07-14T18:17:18.026 INFO:tasks.workunit.client.0.smithi163.stdout:2191(143 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.026 INFO:tasks.workunit.client.0.smithi163.stdout:2192(144 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.026 INFO:tasks.workunit.client.0.smithi163.stdout:2193(145 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.026 INFO:tasks.workunit.client.0.smithi163.stdout:2194(146 mod 256): MAPWRITE 0x5b51e thru 0x62949 (0x742c bytes) 2023-07-14T18:17:18.026 INFO:tasks.workunit.client.0.smithi163.stdout:2195(147 mod 256): FALLOC 0xefccd thru 0xf1bb8 (0x1eeb bytes) PAST_EOF 2023-07-14T18:17:18.026 INFO:tasks.workunit.client.0.smithi163.stdout:2196(148 mod 256): READ 0x44c3a thru 0x46078 (0x143f bytes) 2023-07-14T18:17:18.027 INFO:tasks.workunit.client.0.smithi163.stdout:2197(149 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.027 INFO:tasks.workunit.client.0.smithi163.stdout:2198(150 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.027 INFO:tasks.workunit.client.0.smithi163.stdout:2199(151 mod 256): TRUNCATE DOWN from 0x6294a to 0x17a73 ******WWWW 2023-07-14T18:17:18.027 INFO:tasks.workunit.client.0.smithi163.stdout:2200(152 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.027 INFO:tasks.workunit.client.0.smithi163.stdout:2201(153 mod 256): COPY 0xe8af thru 0x17a72 (0x91c4 bytes) to 0x8db49 thru 0x96d0c 2023-07-14T18:17:18.027 INFO:tasks.workunit.client.0.smithi163.stdout:2202(154 mod 256): FALLOC 0x4bf85 thru 0x4eec0 (0x2f3b bytes) INTERIOR 2023-07-14T18:17:18.027 INFO:tasks.workunit.client.0.smithi163.stdout:2203(155 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.027 INFO:tasks.workunit.client.0.smithi163.stdout:2204(156 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.028 INFO:tasks.workunit.client.0.smithi163.stdout:2205(157 mod 256): MAPWRITE 0xf69ef thru 0xfa580 (0x3b92 bytes) 2023-07-14T18:17:18.028 INFO:tasks.workunit.client.0.smithi163.stdout:2206(158 mod 256): WRITE 0xf7ba3 thru 0xfffff (0x845d bytes) EXTEND 2023-07-14T18:17:18.028 INFO:tasks.workunit.client.0.smithi163.stdout:2207(159 mod 256): FALLOC 0x355da thru 0x44da7 (0xf7cd bytes) INTERIOR ******FFFF 2023-07-14T18:17:18.028 INFO:tasks.workunit.client.0.smithi163.stdout:2208(160 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.028 INFO:tasks.workunit.client.0.smithi163.stdout:2209(161 mod 256): COPY 0xa924f thru 0xad3e6 (0x4198 bytes) to 0xe20c8 thru 0xe625f 2023-07-14T18:17:18.028 INFO:tasks.workunit.client.0.smithi163.stdout:2210(162 mod 256): MAPREAD 0x693e4 thru 0x762f5 (0xcf12 bytes) 2023-07-14T18:17:18.028 INFO:tasks.workunit.client.0.smithi163.stdout:2211(163 mod 256): COPY 0xb6173 thru 0xbdfc3 (0x7e51 bytes) to 0x311b1 thru 0x39001 ******EEEE 2023-07-14T18:17:18.028 INFO:tasks.workunit.client.0.smithi163.stdout:2212(164 mod 256): WRITE 0xc75a7 thru 0xcc01b (0x4a75 bytes) 2023-07-14T18:17:18.029 INFO:tasks.workunit.client.0.smithi163.stdout:2213(165 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.029 INFO:tasks.workunit.client.0.smithi163.stdout:2214(166 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.029 INFO:tasks.workunit.client.0.smithi163.stdout:2215(167 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.029 INFO:tasks.workunit.client.0.smithi163.stdout:2216(168 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.029 INFO:tasks.workunit.client.0.smithi163.stdout:2217(169 mod 256): MAPWRITE 0x52706 thru 0x6140e (0xed09 bytes) 2023-07-14T18:17:18.029 INFO:tasks.workunit.client.0.smithi163.stdout:2218(170 mod 256): WRITE 0x5ec49 thru 0x62717 (0x3acf bytes) 2023-07-14T18:17:18.029 INFO:tasks.workunit.client.0.smithi163.stdout:2219(171 mod 256): MAPWRITE 0xaabf9 thru 0xad207 (0x260f bytes) 2023-07-14T18:17:18.029 INFO:tasks.workunit.client.0.smithi163.stdout:2220(172 mod 256): FALLOC 0x2a9de thru 0x37f0d (0xd52f bytes) INTERIOR 2023-07-14T18:17:18.030 INFO:tasks.workunit.client.0.smithi163.stdout:2221(173 mod 256): FALLOC 0xc2871 thru 0xd19d4 (0xf163 bytes) INTERIOR 2023-07-14T18:17:18.030 INFO:tasks.workunit.client.0.smithi163.stdout:2222(174 mod 256): READ 0x49354 thru 0x562f8 (0xcfa5 bytes) 2023-07-14T18:17:18.030 INFO:tasks.workunit.client.0.smithi163.stdout:2223(175 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.030 INFO:tasks.workunit.client.0.smithi163.stdout:2224(176 mod 256): FALLOC 0x265a7 thru 0x2c727 (0x6180 bytes) INTERIOR 2023-07-14T18:17:18.030 INFO:tasks.workunit.client.0.smithi163.stdout:2225(177 mod 256): FALLOC 0xa98c6 thru 0xaf0f5 (0x582f bytes) INTERIOR 2023-07-14T18:17:18.030 INFO:tasks.workunit.client.0.smithi163.stdout:2226(178 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.030 INFO:tasks.workunit.client.0.smithi163.stdout:2227(179 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.030 INFO:tasks.workunit.client.0.smithi163.stdout:2228(180 mod 256): READ 0xe58b2 thru 0xeac86 (0x53d5 bytes) 2023-07-14T18:17:18.031 INFO:tasks.workunit.client.0.smithi163.stdout:2229(181 mod 256): READ 0xa34bc thru 0xa47fc (0x1341 bytes) 2023-07-14T18:17:18.031 INFO:tasks.workunit.client.0.smithi163.stdout:2230(182 mod 256): READ 0x22cec thru 0x29f3f (0x7254 bytes) 2023-07-14T18:17:18.031 INFO:tasks.workunit.client.0.smithi163.stdout:2231(183 mod 256): READ 0x1b3af thru 0x1ceca (0x1b1c bytes) 2023-07-14T18:17:18.031 INFO:tasks.workunit.client.0.smithi163.stdout:2232(184 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.031 INFO:tasks.workunit.client.0.smithi163.stdout:2233(185 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.031 INFO:tasks.workunit.client.0.smithi163.stdout:2234(186 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.031 INFO:tasks.workunit.client.0.smithi163.stdout:2235(187 mod 256): READ 0xd7c9d thru 0xd86a6 (0xa0a bytes) 2023-07-14T18:17:18.031 INFO:tasks.workunit.client.0.smithi163.stdout:2236(188 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.032 INFO:tasks.workunit.client.0.smithi163.stdout:2237(189 mod 256): MAPREAD 0x70b6f thru 0x75106 (0x4598 bytes) 2023-07-14T18:17:18.032 INFO:tasks.workunit.client.0.smithi163.stdout:2238(190 mod 256): MAPREAD 0xe93b7 thru 0xf0f7f (0x7bc9 bytes) 2023-07-14T18:17:18.032 INFO:tasks.workunit.client.0.smithi163.stdout:2239(191 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.032 INFO:tasks.workunit.client.0.smithi163.stdout:2240(192 mod 256): MAPREAD 0x6170f thru 0x65801 (0x40f3 bytes) 2023-07-14T18:17:18.032 INFO:tasks.workunit.client.0.smithi163.stdout:2241(193 mod 256): COPY 0xd1973 thru 0xe0082 (0xe710 bytes) to 0x9a78b thru 0xa8e9a 2023-07-14T18:17:18.032 INFO:tasks.workunit.client.0.smithi163.stdout:2242(194 mod 256): FALLOC 0x954ac thru 0x962cd (0xe21 bytes) INTERIOR 2023-07-14T18:17:18.032 INFO:tasks.workunit.client.0.smithi163.stdout:2243(195 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.032 INFO:tasks.workunit.client.0.smithi163.stdout:2244(196 mod 256): READ 0xdad5f thru 0xe9335 (0xe5d7 bytes) 2023-07-14T18:17:18.033 INFO:tasks.workunit.client.0.smithi163.stdout:2245(197 mod 256): FALLOC 0xf887d thru 0xfba0d (0x3190 bytes) INTERIOR 2023-07-14T18:17:18.033 INFO:tasks.workunit.client.0.smithi163.stdout:2246(198 mod 256): WRITE 0x99582 thru 0xa51c6 (0xbc45 bytes) 2023-07-14T18:17:18.033 INFO:tasks.workunit.client.0.smithi163.stdout:2247(199 mod 256): PUNCH 0xe9522 thru 0xeda9e (0x457d bytes) 2023-07-14T18:17:18.033 INFO:tasks.workunit.client.0.smithi163.stdout:2248(200 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.033 INFO:tasks.workunit.client.0.smithi163.stdout:2249(201 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.033 INFO:tasks.workunit.client.0.smithi163.stdout:2250(202 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.033 INFO:tasks.workunit.client.0.smithi163.stdout:2251(203 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.033 INFO:tasks.workunit.client.0.smithi163.stdout:2252(204 mod 256): TRUNCATE DOWN from 0x100000 to 0x65164 2023-07-14T18:17:18.034 INFO:tasks.workunit.client.0.smithi163.stdout:2253(205 mod 256): COPY 0x19ff6 thru 0x1b759 (0x1764 bytes) to 0xa7728 thru 0xa8e8b 2023-07-14T18:17:18.034 INFO:tasks.workunit.client.0.smithi163.stdout:2254(206 mod 256): MAPWRITE 0x2ca9a thru 0x3ca86 (0xffed bytes) ******WWWW 2023-07-14T18:17:18.034 INFO:tasks.workunit.client.0.smithi163.stdout:2255(207 mod 256): COPY 0x1151a thru 0x19103 (0x7bea bytes) to 0xb4051 thru 0xbbc3a 2023-07-14T18:17:18.034 INFO:tasks.workunit.client.0.smithi163.stdout:2256(208 mod 256): MAPREAD 0xbb048 thru 0xbbc3a (0xbf3 bytes) 2023-07-14T18:17:18.034 INFO:tasks.workunit.client.0.smithi163.stdout:2257(209 mod 256): PUNCH 0x2545b thru 0x25cc0 (0x866 bytes) 2023-07-14T18:17:18.034 INFO:tasks.workunit.client.0.smithi163.stdout:2258(210 mod 256): PUNCH 0x3fae thru 0x1236d (0xe3c0 bytes) 2023-07-14T18:17:18.034 INFO:tasks.workunit.client.0.smithi163.stdout:2259(211 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.034 INFO:tasks.workunit.client.0.smithi163.stdout:2260(212 mod 256): TRUNCATE DOWN from 0xbbc3b to 0x53b95 2023-07-14T18:17:18.035 INFO:tasks.workunit.client.0.smithi163.stdout:2261(213 mod 256): MAPREAD 0x35002 thru 0x3aaa7 (0x5aa6 bytes) ***RRRR*** 2023-07-14T18:17:18.035 INFO:tasks.workunit.client.0.smithi163.stdout:2262(214 mod 256): PUNCH 0x1633b thru 0x21387 (0xb04d bytes) 2023-07-14T18:17:18.035 INFO:tasks.workunit.client.0.smithi163.stdout:2263(215 mod 256): PUNCH 0x2a945 thru 0x397fb (0xeeb7 bytes) ******PPPP 2023-07-14T18:17:18.035 INFO:tasks.workunit.client.0.smithi163.stdout:2264(216 mod 256): MAPREAD 0x2da67 thru 0x398f3 (0xbe8d bytes) ***RRRR*** 2023-07-14T18:17:18.035 INFO:tasks.workunit.client.0.smithi163.stdout:2265(217 mod 256): WRITE 0x91b8d thru 0x9b408 (0x987c bytes) HOLE 2023-07-14T18:17:18.035 INFO:tasks.workunit.client.0.smithi163.stdout:2266(218 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.035 INFO:tasks.workunit.client.0.smithi163.stdout:2267(219 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.035 INFO:tasks.workunit.client.0.smithi163.stdout:2268(220 mod 256): PUNCH 0x64e00 thru 0x6e4cb (0x96cc bytes) 2023-07-14T18:17:18.036 INFO:tasks.workunit.client.0.smithi163.stdout:2269(221 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.036 INFO:tasks.workunit.client.0.smithi163.stdout:2270(222 mod 256): FALLOC 0x38a43 thru 0x3a29f (0x185c bytes) INTERIOR 2023-07-14T18:17:18.036 INFO:tasks.workunit.client.0.smithi163.stdout:2271(223 mod 256): MAPWRITE 0xe3826 thru 0xee8e5 (0xb0c0 bytes) 2023-07-14T18:17:18.036 INFO:tasks.workunit.client.0.smithi163.stdout:2272(224 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.036 INFO:tasks.workunit.client.0.smithi163.stdout:2273(225 mod 256): COPY 0xdac3a thru 0xe15a2 (0x6969 bytes) to 0x32f21 thru 0x39889 ******EEEE 2023-07-14T18:17:18.036 INFO:tasks.workunit.client.0.smithi163.stdout:2274(226 mod 256): PUNCH 0x9a338 thru 0xa396b (0x9634 bytes) 2023-07-14T18:17:18.036 INFO:tasks.workunit.client.0.smithi163.stdout:2275(227 mod 256): TRUNCATE UP from 0xee8e6 to 0xfe35c 2023-07-14T18:17:18.036 INFO:tasks.workunit.client.0.smithi163.stdout:2276(228 mod 256): PUNCH 0xb2146 thru 0xbf32c (0xd1e7 bytes) 2023-07-14T18:17:18.037 INFO:tasks.workunit.client.0.smithi163.stdout:2277(229 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.037 INFO:tasks.workunit.client.0.smithi163.stdout:2278(230 mod 256): COPY 0xcde5 thru 0x1a39f (0xd5bb bytes) to 0x45bee thru 0x531a8 2023-07-14T18:17:18.037 INFO:tasks.workunit.client.0.smithi163.stdout:2279(231 mod 256): PUNCH 0x20327 thru 0x2765a (0x7334 bytes) 2023-07-14T18:17:18.037 INFO:tasks.workunit.client.0.smithi163.stdout:2280(232 mod 256): WRITE 0x3c4c5 thru 0x3de6c (0x19a8 bytes) 2023-07-14T18:17:18.037 INFO:tasks.workunit.client.0.smithi163.stdout:2281(233 mod 256): PUNCH 0x2f87f thru 0x392f2 (0x9a74 bytes) ******PPPP 2023-07-14T18:17:18.037 INFO:tasks.workunit.client.0.smithi163.stdout:2282(234 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.037 INFO:tasks.workunit.client.0.smithi163.stdout:2283(235 mod 256): MAPREAD 0x36234 thru 0x36c6d (0xa3a bytes) 2023-07-14T18:17:18.038 INFO:tasks.workunit.client.0.smithi163.stdout:2284(236 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.038 INFO:tasks.workunit.client.0.smithi163.stdout:2285(237 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.038 INFO:tasks.workunit.client.0.smithi163.stdout:2286(238 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.038 INFO:tasks.workunit.client.0.smithi163.stdout:2287(239 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.038 INFO:tasks.workunit.client.0.smithi163.stdout:2288(240 mod 256): FALLOC 0xd5038 thru 0xde99f (0x9967 bytes) INTERIOR 2023-07-14T18:17:18.038 INFO:tasks.workunit.client.0.smithi163.stdout:2289(241 mod 256): WRITE 0xddbd4 thru 0xe16ac (0x3ad9 bytes) 2023-07-14T18:17:18.038 INFO:tasks.workunit.client.0.smithi163.stdout:2290(242 mod 256): WRITE 0xc12ba thru 0xc6e4d (0x5b94 bytes) 2023-07-14T18:17:18.038 INFO:tasks.workunit.client.0.smithi163.stdout:2291(243 mod 256): COPY 0xa7dfa thru 0xb0978 (0x8b7f bytes) to 0x41129 thru 0x49ca7 2023-07-14T18:17:18.039 INFO:tasks.workunit.client.0.smithi163.stdout:2292(244 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.039 INFO:tasks.workunit.client.0.smithi163.stdout:2293(245 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.039 INFO:tasks.workunit.client.0.smithi163.stdout:2294(246 mod 256): TRUNCATE DOWN from 0xfe35c to 0x42728 2023-07-14T18:17:18.039 INFO:tasks.workunit.client.0.smithi163.stdout:2295(247 mod 256): READ 0x865a thru 0x161e3 (0xdb8a bytes) 2023-07-14T18:17:18.039 INFO:tasks.workunit.client.0.smithi163.stdout:2296(248 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.039 INFO:tasks.workunit.client.0.smithi163.stdout:2297(249 mod 256): WRITE 0x9ac83 thru 0xa61ad (0xb52b bytes) HOLE 2023-07-14T18:17:18.039 INFO:tasks.workunit.client.0.smithi163.stdout:2298(250 mod 256): MAPWRITE 0x77106 thru 0x7bb5b (0x4a56 bytes) 2023-07-14T18:17:18.039 INFO:tasks.workunit.client.0.smithi163.stdout:2299(251 mod 256): MAPWRITE 0xb6e5 thru 0x1a822 (0xf13e bytes) 2023-07-14T18:17:18.040 INFO:tasks.workunit.client.0.smithi163.stdout:2300(252 mod 256): TRUNCATE DOWN from 0xa61ae to 0x31975 ******WWWW 2023-07-14T18:17:18.040 INFO:tasks.workunit.client.0.smithi163.stdout:2301(253 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.040 INFO:tasks.workunit.client.0.smithi163.stdout:2302(254 mod 256): WRITE 0xa688d thru 0xb01b1 (0x9925 bytes) HOLE ***WWWW 2023-07-14T18:17:18.040 INFO:tasks.workunit.client.0.smithi163.stdout:2303(255 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.040 INFO:tasks.workunit.client.0.smithi163.stdout:2304( 0 mod 256): FALLOC 0x4ceaa thru 0x5aafa (0xdc50 bytes) INTERIOR 2023-07-14T18:17:18.040 INFO:tasks.workunit.client.0.smithi163.stdout:2305( 1 mod 256): FALLOC 0x32a0d thru 0x40883 (0xde76 bytes) INTERIOR ******FFFF 2023-07-14T18:17:18.040 INFO:tasks.workunit.client.0.smithi163.stdout:2306( 2 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.040 INFO:tasks.workunit.client.0.smithi163.stdout:2307( 3 mod 256): MAPREAD 0xaee08 thru 0xb01b1 (0x13aa bytes) 2023-07-14T18:17:18.041 INFO:tasks.workunit.client.0.smithi163.stdout:2308( 4 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.041 INFO:tasks.workunit.client.0.smithi163.stdout:2309( 5 mod 256): FALLOC 0x9f758 thru 0xa532c (0x5bd4 bytes) INTERIOR 2023-07-14T18:17:18.041 INFO:tasks.workunit.client.0.smithi163.stdout:2310( 6 mod 256): MAPREAD 0x4a312 thru 0x580bc (0xddab bytes) 2023-07-14T18:17:18.041 INFO:tasks.workunit.client.0.smithi163.stdout:2311( 7 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.041 INFO:tasks.workunit.client.0.smithi163.stdout:2312( 8 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.041 INFO:tasks.workunit.client.0.smithi163.stdout:2313( 9 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.041 INFO:tasks.workunit.client.0.smithi163.stdout:2314( 10 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.041 INFO:tasks.workunit.client.0.smithi163.stdout:2315( 11 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.042 INFO:tasks.workunit.client.0.smithi163.stdout:2316( 12 mod 256): TRUNCATE UP from 0xb01b2 to 0xdf1f4 2023-07-14T18:17:18.042 INFO:tasks.workunit.client.0.smithi163.stdout:2317( 13 mod 256): COPY 0xa0769 thru 0xa2e85 (0x271d bytes) to 0xe2dc6 thru 0xe54e2 2023-07-14T18:17:18.042 INFO:tasks.workunit.client.0.smithi163.stdout:2318( 14 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.042 INFO:tasks.workunit.client.0.smithi163.stdout:2319( 15 mod 256): TRUNCATE DOWN from 0xe54e3 to 0x38701 2023-07-14T18:17:18.042 INFO:tasks.workunit.client.0.smithi163.stdout:2320( 16 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.042 INFO:tasks.workunit.client.0.smithi163.stdout:2321( 17 mod 256): FALLOC 0x2e99f thru 0x33b03 (0x5164 bytes) INTERIOR 2023-07-14T18:17:18.042 INFO:tasks.workunit.client.0.smithi163.stdout:2322( 18 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.042 INFO:tasks.workunit.client.0.smithi163.stdout:2323( 19 mod 256): MAPWRITE 0x75a3b thru 0x7c070 (0x6636 bytes) 2023-07-14T18:17:18.043 INFO:tasks.workunit.client.0.smithi163.stdout:2324( 20 mod 256): WRITE 0x865ff thru 0x90482 (0x9e84 bytes) HOLE 2023-07-14T18:17:18.043 INFO:tasks.workunit.client.0.smithi163.stdout:2325( 21 mod 256): READ 0x730c2 thru 0x7328a (0x1c9 bytes) 2023-07-14T18:17:18.043 INFO:tasks.workunit.client.0.smithi163.stdout:2326( 22 mod 256): READ 0x4bcad thru 0x564aa (0xa7fe bytes) 2023-07-14T18:17:18.043 INFO:tasks.workunit.client.0.smithi163.stdout:2327( 23 mod 256): MAPWRITE 0x797ab thru 0x79f61 (0x7b7 bytes) 2023-07-14T18:17:18.043 INFO:tasks.workunit.client.0.smithi163.stdout:2328( 24 mod 256): TRUNCATE UP from 0x90483 to 0xf0078 2023-07-14T18:17:18.043 INFO:tasks.workunit.client.0.smithi163.stdout:2329( 25 mod 256): MAPREAD 0x3f3b thru 0x891b (0x49e1 bytes) 2023-07-14T18:17:18.043 INFO:tasks.workunit.client.0.smithi163.stdout:2330( 26 mod 256): READ 0xd2074 thru 0xd9596 (0x7523 bytes) 2023-07-14T18:17:18.043 INFO:tasks.workunit.client.0.smithi163.stdout:2331( 27 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.044 INFO:tasks.workunit.client.0.smithi163.stdout:2332( 28 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.044 INFO:tasks.workunit.client.0.smithi163.stdout:2333( 29 mod 256): COPY 0x35880 thru 0x3721c (0x199d bytes) to 0xb9427 thru 0xbadc3 2023-07-14T18:17:18.044 INFO:tasks.workunit.client.0.smithi163.stdout:2334( 30 mod 256): READ 0x1e28f thru 0x2dc99 (0xfa0b bytes) 2023-07-14T18:17:18.044 INFO:tasks.workunit.client.0.smithi163.stdout:2335( 31 mod 256): COPY 0x289bf thru 0x33b3d (0xb17f bytes) to 0xdcda6 thru 0xe7f24 2023-07-14T18:17:18.044 INFO:tasks.workunit.client.0.smithi163.stdout:2336( 32 mod 256): MAPWRITE 0x719d0 thru 0x75f85 (0x45b6 bytes) 2023-07-14T18:17:18.044 INFO:tasks.workunit.client.0.smithi163.stdout:2337( 33 mod 256): FALLOC 0xde396 thru 0xea571 (0xc1db bytes) INTERIOR 2023-07-14T18:17:18.044 INFO:tasks.workunit.client.0.smithi163.stdout:2338( 34 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.044 INFO:tasks.workunit.client.0.smithi163.stdout:2339( 35 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.045 INFO:tasks.workunit.client.0.smithi163.stdout:2340( 36 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.045 INFO:tasks.workunit.client.0.smithi163.stdout:2341( 37 mod 256): COPY 0xde0a2 thru 0xe185d (0x37bc bytes) to 0x87925 thru 0x8b0e0 2023-07-14T18:17:18.045 INFO:tasks.workunit.client.0.smithi163.stdout:2342( 38 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.045 INFO:tasks.workunit.client.0.smithi163.stdout:2343( 39 mod 256): MAPREAD 0x3ce66 thru 0x4cc18 (0xfdb3 bytes) 2023-07-14T18:17:18.045 INFO:tasks.workunit.client.0.smithi163.stdout:2344( 40 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.045 INFO:tasks.workunit.client.0.smithi163.stdout:2345( 41 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.045 INFO:tasks.workunit.client.0.smithi163.stdout:2346( 42 mod 256): MAPREAD 0x9b6ad thru 0xa2e96 (0x77ea bytes) 2023-07-14T18:17:18.045 INFO:tasks.workunit.client.0.smithi163.stdout:2347( 43 mod 256): MAPREAD 0xede41 thru 0xf0077 (0x2237 bytes) 2023-07-14T18:17:18.046 INFO:tasks.workunit.client.0.smithi163.stdout:2348( 44 mod 256): MAPREAD 0x4cef6 thru 0x5a36f (0xd47a bytes) 2023-07-14T18:17:18.046 INFO:tasks.workunit.client.0.smithi163.stdout:2349( 45 mod 256): TRUNCATE DOWN from 0xf0078 to 0xc371c 2023-07-14T18:17:18.046 INFO:tasks.workunit.client.0.smithi163.stdout:2350( 46 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.046 INFO:tasks.workunit.client.0.smithi163.stdout:2351( 47 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.046 INFO:tasks.workunit.client.0.smithi163.stdout:2352( 48 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.046 INFO:tasks.workunit.client.0.smithi163.stdout:2353( 49 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.046 INFO:tasks.workunit.client.0.smithi163.stdout:2354( 50 mod 256): COPY 0xb0425 thru 0xbb21f (0xadfb bytes) to 0xdad8f thru 0xe5b89 2023-07-14T18:17:18.046 INFO:tasks.workunit.client.0.smithi163.stdout:2355( 51 mod 256): COPY 0x9873a thru 0x9f8b5 (0x717c bytes) to 0x6c75 thru 0xddf0 2023-07-14T18:17:18.047 INFO:tasks.workunit.client.0.smithi163.stdout:2356( 52 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.047 INFO:tasks.workunit.client.0.smithi163.stdout:2357( 53 mod 256): READ 0x48f6b thru 0x4b8a9 (0x293f bytes) 2023-07-14T18:17:18.047 INFO:tasks.workunit.client.0.smithi163.stdout:2358( 54 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.047 INFO:tasks.workunit.client.0.smithi163.stdout:2359( 55 mod 256): TRUNCATE DOWN from 0xe5b8a to 0x77561 2023-07-14T18:17:18.047 INFO:tasks.workunit.client.0.smithi163.stdout:2360( 56 mod 256): COPY 0x6ca5f thru 0x6dbe4 (0x1186 bytes) to 0xc3cb2 thru 0xc4e37 2023-07-14T18:17:18.047 INFO:tasks.workunit.client.0.smithi163.stdout:2361( 57 mod 256): WRITE 0x5df21 thru 0x6afbb (0xd09b bytes) 2023-07-14T18:17:18.047 INFO:tasks.workunit.client.0.smithi163.stdout:2362( 58 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.047 INFO:tasks.workunit.client.0.smithi163.stdout:2363( 59 mod 256): TRUNCATE DOWN from 0xc4e38 to 0x64aa3 2023-07-14T18:17:18.048 INFO:tasks.workunit.client.0.smithi163.stdout:2364( 60 mod 256): COPY 0x38c1f thru 0x3e09d (0x547f bytes) to 0x658c thru 0xba0a 2023-07-14T18:17:18.048 INFO:tasks.workunit.client.0.smithi163.stdout:2365( 61 mod 256): MAPREAD 0x575ff thru 0x64aa2 (0xd4a4 bytes) 2023-07-14T18:17:18.048 INFO:tasks.workunit.client.0.smithi163.stdout:2366( 62 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.048 INFO:tasks.workunit.client.0.smithi163.stdout:2367( 63 mod 256): TRUNCATE DOWN from 0x64aa3 to 0x28765 ******WWWW 2023-07-14T18:17:18.048 INFO:tasks.workunit.client.0.smithi163.stdout:2368( 64 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.048 INFO:tasks.workunit.client.0.smithi163.stdout:2369( 65 mod 256): READ 0x55e3 thru 0xa0ce (0x4aec bytes) 2023-07-14T18:17:18.048 INFO:tasks.workunit.client.0.smithi163.stdout:2370( 66 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.048 INFO:tasks.workunit.client.0.smithi163.stdout:2371( 67 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.049 INFO:tasks.workunit.client.0.smithi163.stdout:2372( 68 mod 256): READ 0xb5a6 thru 0x176ef (0xc14a bytes) 2023-07-14T18:17:18.049 INFO:tasks.workunit.client.0.smithi163.stdout:2373( 69 mod 256): TRUNCATE UP from 0x28765 to 0x4978b ******WWWW 2023-07-14T18:17:18.049 INFO:tasks.workunit.client.0.smithi163.stdout:2374( 70 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.049 INFO:tasks.workunit.client.0.smithi163.stdout:2375( 71 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.049 INFO:tasks.workunit.client.0.smithi163.stdout:2376( 72 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.049 INFO:tasks.workunit.client.0.smithi163.stdout:2377( 73 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.049 INFO:tasks.workunit.client.0.smithi163.stdout:2378( 74 mod 256): COPY 0x4e53 thru 0xa4a1 (0x564f bytes) to 0x6a1f2 thru 0x6f840 2023-07-14T18:17:18.049 INFO:tasks.workunit.client.0.smithi163.stdout:2379( 75 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.050 INFO:tasks.workunit.client.0.smithi163.stdout:2380( 76 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.050 INFO:tasks.workunit.client.0.smithi163.stdout:2381( 77 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.050 INFO:tasks.workunit.client.0.smithi163.stdout:2382( 78 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.050 INFO:tasks.workunit.client.0.smithi163.stdout:2383( 79 mod 256): COPY 0x3470e thru 0x430c1 (0xe9b4 bytes) to 0xc807f thru 0xd6a32 EEEE****** 2023-07-14T18:17:18.050 INFO:tasks.workunit.client.0.smithi163.stdout:2384( 80 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.050 INFO:tasks.workunit.client.0.smithi163.stdout:2385( 81 mod 256): MAPWRITE 0x22954 thru 0x2bd05 (0x93b2 bytes) 2023-07-14T18:17:18.050 INFO:tasks.workunit.client.0.smithi163.stdout:2386( 82 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.050 INFO:tasks.workunit.client.0.smithi163.stdout:2387( 83 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.051 INFO:tasks.workunit.client.0.smithi163.stdout:2388( 84 mod 256): MAPWRITE 0x572ff thru 0x672cd (0xffcf bytes) 2023-07-14T18:17:18.051 INFO:tasks.workunit.client.0.smithi163.stdout:2389( 85 mod 256): MAPWRITE 0x1f79f thru 0x290e1 (0x9943 bytes) 2023-07-14T18:17:18.051 INFO:tasks.workunit.client.0.smithi163.stdout:2390( 86 mod 256): MAPWRITE 0x5c2a0 thru 0x61891 (0x55f2 bytes) 2023-07-14T18:17:18.051 INFO:tasks.workunit.client.0.smithi163.stdout:2391( 87 mod 256): READ 0xd4bb7 thru 0xd6a32 (0x1e7c bytes) 2023-07-14T18:17:18.051 INFO:tasks.workunit.client.0.smithi163.stdout:2392( 88 mod 256): MAPREAD 0x8ad62 thru 0x99cd5 (0xef74 bytes) 2023-07-14T18:17:18.051 INFO:tasks.workunit.client.0.smithi163.stdout:2393( 89 mod 256): FALLOC 0x5e952 thru 0x66475 (0x7b23 bytes) INTERIOR 2023-07-14T18:17:18.051 INFO:tasks.workunit.client.0.smithi163.stdout:2394( 90 mod 256): MAPREAD 0x3ee2e thru 0x4a6ac (0xb87f bytes) 2023-07-14T18:17:18.051 INFO:tasks.workunit.client.0.smithi163.stdout:2395( 91 mod 256): TRUNCATE DOWN from 0xd6a33 to 0xc31f2 2023-07-14T18:17:18.052 INFO:tasks.workunit.client.0.smithi163.stdout:2396( 92 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.052 INFO:tasks.workunit.client.0.smithi163.stdout:2397( 93 mod 256): TRUNCATE DOWN from 0xc31f2 to 0xe2d6 ******WWWW 2023-07-14T18:17:18.052 INFO:tasks.workunit.client.0.smithi163.stdout:2398( 94 mod 256): WRITE 0xd184a thru 0xdbcdb (0xa492 bytes) HOLE ***WWWW 2023-07-14T18:17:18.052 INFO:tasks.workunit.client.0.smithi163.stdout:2399( 95 mod 256): WRITE 0x3e2f3 thru 0x406dd (0x23eb bytes) 2023-07-14T18:17:18.052 INFO:tasks.workunit.client.0.smithi163.stdout:2400( 96 mod 256): FALLOC 0x809a9 thru 0x83d83 (0x33da bytes) INTERIOR 2023-07-14T18:17:18.052 INFO:tasks.workunit.client.0.smithi163.stdout:2401( 97 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.052 INFO:tasks.workunit.client.0.smithi163.stdout:2402( 98 mod 256): TRUNCATE DOWN from 0xdbcdc to 0x8dcb1 2023-07-14T18:17:18.052 INFO:tasks.workunit.client.0.smithi163.stdout:2403( 99 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.053 INFO:tasks.workunit.client.0.smithi163.stdout:2404(100 mod 256): TRUNCATE UP from 0x8dcb1 to 0xfcf4d 2023-07-14T18:17:18.053 INFO:tasks.workunit.client.0.smithi163.stdout:2405(101 mod 256): WRITE 0x71160 thru 0x7d20b (0xc0ac bytes) 2023-07-14T18:17:18.053 INFO:tasks.workunit.client.0.smithi163.stdout:2406(102 mod 256): MAPWRITE 0xcb697 thru 0xd5f50 (0xa8ba bytes) 2023-07-14T18:17:18.053 INFO:tasks.workunit.client.0.smithi163.stdout:2407(103 mod 256): TRUNCATE DOWN from 0xfcf4d to 0x126b2 ******WWWW 2023-07-14T18:17:18.053 INFO:tasks.workunit.client.0.smithi163.stdout:2408(104 mod 256): COPY 0x11267 thru 0x126b1 (0x144b bytes) to 0x53d1e thru 0x55168 2023-07-14T18:17:18.053 INFO:tasks.workunit.client.0.smithi163.stdout:2409(105 mod 256): MAPWRITE 0xb7e98 thru 0xb99f3 (0x1b5c bytes) 2023-07-14T18:17:18.053 INFO:tasks.workunit.client.0.smithi163.stdout:2410(106 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.053 INFO:tasks.workunit.client.0.smithi163.stdout:2411(107 mod 256): PUNCH 0x7544c thru 0x7d8f7 (0x84ac bytes) 2023-07-14T18:17:18.054 INFO:tasks.workunit.client.0.smithi163.stdout:2412(108 mod 256): PUNCH 0x7aedb thru 0x8a2be (0xf3e4 bytes) 2023-07-14T18:17:18.054 INFO:tasks.workunit.client.0.smithi163.stdout:2413(109 mod 256): MAPWRITE 0x9f5e7 thru 0xa4e2d (0x5847 bytes) 2023-07-14T18:17:18.054 INFO:tasks.workunit.client.0.smithi163.stdout:2414(110 mod 256): MAPREAD 0x476a9 thru 0x4e52b (0x6e83 bytes) 2023-07-14T18:17:18.054 INFO:tasks.workunit.client.0.smithi163.stdout:2415(111 mod 256): PUNCH 0x802ab thru 0x89380 (0x90d6 bytes) 2023-07-14T18:17:18.054 INFO:tasks.workunit.client.0.smithi163.stdout:2416(112 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.054 INFO:tasks.workunit.client.0.smithi163.stdout:2417(113 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.054 INFO:tasks.workunit.client.0.smithi163.stdout:2418(114 mod 256): COPY 0x9f58e thru 0xa3d60 (0x47d3 bytes) to 0x8204a thru 0x8681c 2023-07-14T18:17:18.054 INFO:tasks.workunit.client.0.smithi163.stdout:2419(115 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.055 INFO:tasks.workunit.client.0.smithi163.stdout:2420(116 mod 256): WRITE 0x163cc thru 0x16ae6 (0x71b bytes) 2023-07-14T18:17:18.055 INFO:tasks.workunit.client.0.smithi163.stdout:2421(117 mod 256): COPY 0x7517d thru 0x7c9c2 (0x7846 bytes) to 0xcc3e9 thru 0xd3c2e 2023-07-14T18:17:18.055 INFO:tasks.workunit.client.0.smithi163.stdout:2422(118 mod 256): FALLOC 0x387e5 thru 0x48754 (0xff6f bytes) INTERIOR 2023-07-14T18:17:18.055 INFO:tasks.workunit.client.0.smithi163.stdout:2423(119 mod 256): WRITE 0x1781f thru 0x257ce (0xdfb0 bytes) 2023-07-14T18:17:18.055 INFO:tasks.workunit.client.0.smithi163.stdout:2424(120 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.055 INFO:tasks.workunit.client.0.smithi163.stdout:2425(121 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.055 INFO:tasks.workunit.client.0.smithi163.stdout:2426(122 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.056 INFO:tasks.workunit.client.0.smithi163.stdout:2427(123 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.056 INFO:tasks.workunit.client.0.smithi163.stdout:2428(124 mod 256): READ 0x597a8 thru 0x603b4 (0x6c0d bytes) 2023-07-14T18:17:18.056 INFO:tasks.workunit.client.0.smithi163.stdout:2429(125 mod 256): READ 0xbf175 thru 0xc618c (0x7018 bytes) 2023-07-14T18:17:18.056 INFO:tasks.workunit.client.0.smithi163.stdout:2430(126 mod 256): MAPWRITE 0xeee57 thru 0xfa87b (0xba25 bytes) 2023-07-14T18:17:18.056 INFO:tasks.workunit.client.0.smithi163.stdout:2431(127 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.056 INFO:tasks.workunit.client.0.smithi163.stdout:2432(128 mod 256): READ 0x6b23c thru 0x71bcc (0x6991 bytes) 2023-07-14T18:17:18.056 INFO:tasks.workunit.client.0.smithi163.stdout:2433(129 mod 256): FALLOC 0xc4a9d thru 0xc8773 (0x3cd6 bytes) INTERIOR 2023-07-14T18:17:18.056 INFO:tasks.workunit.client.0.smithi163.stdout:2434(130 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.057 INFO:tasks.workunit.client.0.smithi163.stdout:2435(131 mod 256): READ 0x1ef0 thru 0x5e61 (0x3f72 bytes) 2023-07-14T18:17:18.057 INFO:tasks.workunit.client.0.smithi163.stdout:2436(132 mod 256): TRUNCATE DOWN from 0xfa87c to 0xc60c7 2023-07-14T18:17:18.057 INFO:tasks.workunit.client.0.smithi163.stdout:2437(133 mod 256): WRITE 0x5f2f3 thru 0x6474e (0x545c bytes) 2023-07-14T18:17:18.057 INFO:tasks.workunit.client.0.smithi163.stdout:2438(134 mod 256): READ 0x8da8f thru 0x927e5 (0x4d57 bytes) 2023-07-14T18:17:18.057 INFO:tasks.workunit.client.0.smithi163.stdout:2439(135 mod 256): PUNCH 0x5325a thru 0x62594 (0xf33b bytes) 2023-07-14T18:17:18.057 INFO:tasks.workunit.client.0.smithi163.stdout:2440(136 mod 256): FALLOC 0xff59f thru 0x100000 (0xa61 bytes) EXTENDING 2023-07-14T18:17:18.057 INFO:tasks.workunit.client.0.smithi163.stdout:2441(137 mod 256): PUNCH 0x30673 thru 0x3693d (0x62cb bytes) 2023-07-14T18:17:18.057 INFO:tasks.workunit.client.0.smithi163.stdout:2442(138 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.058 INFO:tasks.workunit.client.0.smithi163.stdout:2443(139 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.058 INFO:tasks.workunit.client.0.smithi163.stdout:2444(140 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.058 INFO:tasks.workunit.client.0.smithi163.stdout:2445(141 mod 256): PUNCH 0x6e971 thru 0x6fa69 (0x10f9 bytes) 2023-07-14T18:17:18.058 INFO:tasks.workunit.client.0.smithi163.stdout:2446(142 mod 256): READ 0x75276 thru 0x7e7ff (0x958a bytes) 2023-07-14T18:17:18.058 INFO:tasks.workunit.client.0.smithi163.stdout:2447(143 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.058 INFO:tasks.workunit.client.0.smithi163.stdout:2448(144 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.058 INFO:tasks.workunit.client.0.smithi163.stdout:2449(145 mod 256): COPY 0x5371c thru 0x606a0 (0xcf85 bytes) to 0xced98 thru 0xdbd1c 2023-07-14T18:17:18.058 INFO:tasks.workunit.client.0.smithi163.stdout:2450(146 mod 256): MAPREAD 0x81088 thru 0x8385e (0x27d7 bytes) 2023-07-14T18:17:18.059 INFO:tasks.workunit.client.0.smithi163.stdout:2451(147 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.059 INFO:tasks.workunit.client.0.smithi163.stdout:2452(148 mod 256): FALLOC 0x4e869 thru 0x5ad72 (0xc509 bytes) INTERIOR 2023-07-14T18:17:18.059 INFO:tasks.workunit.client.0.smithi163.stdout:2453(149 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.059 INFO:tasks.workunit.client.0.smithi163.stdout:2454(150 mod 256): WRITE 0x7c8f6 thru 0x8a10d (0xd818 bytes) 2023-07-14T18:17:18.059 INFO:tasks.workunit.client.0.smithi163.stdout:2455(151 mod 256): WRITE 0x13716 thru 0x1930d (0x5bf8 bytes) 2023-07-14T18:17:18.059 INFO:tasks.workunit.client.0.smithi163.stdout:2456(152 mod 256): READ 0xaa271 thru 0xb0ce5 (0x6a75 bytes) 2023-07-14T18:17:18.059 INFO:tasks.workunit.client.0.smithi163.stdout:2457(153 mod 256): WRITE 0xef39d thru 0xef8bc (0x520 bytes) 2023-07-14T18:17:18.059 INFO:tasks.workunit.client.0.smithi163.stdout:2458(154 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.060 INFO:tasks.workunit.client.0.smithi163.stdout:2459(155 mod 256): READ 0x3d13e thru 0x46d28 (0x9beb bytes) 2023-07-14T18:17:18.060 INFO:tasks.workunit.client.0.smithi163.stdout:2460(156 mod 256): PUNCH 0x406ad thru 0x47b11 (0x7465 bytes) 2023-07-14T18:17:18.060 INFO:tasks.workunit.client.0.smithi163.stdout:2461(157 mod 256): MAPWRITE 0x81ab4 thru 0x8823d (0x678a bytes) 2023-07-14T18:17:18.060 INFO:tasks.workunit.client.0.smithi163.stdout:2462(158 mod 256): READ 0xdf62d thru 0xe012c (0xb00 bytes) 2023-07-14T18:17:18.060 INFO:tasks.workunit.client.0.smithi163.stdout:2463(159 mod 256): MAPWRITE 0xfbb0e thru 0xfffff (0x44f2 bytes) 2023-07-14T18:17:18.060 INFO:tasks.workunit.client.0.smithi163.stdout:2464(160 mod 256): COPY 0xe2806 thru 0xe592f (0x312a bytes) to 0x92d56 thru 0x95e7f 2023-07-14T18:17:18.060 INFO:tasks.workunit.client.0.smithi163.stdout:2465(161 mod 256): TRUNCATE DOWN from 0x100000 to 0xd6eb9 2023-07-14T18:17:18.060 INFO:tasks.workunit.client.0.smithi163.stdout:2466(162 mod 256): WRITE 0x1f152 thru 0x2a5d5 (0xb484 bytes) 2023-07-14T18:17:18.061 INFO:tasks.workunit.client.0.smithi163.stdout:2467(163 mod 256): COPY 0x4840a thru 0x4cacd (0x46c4 bytes) to 0x7b5fc thru 0x7fcbf 2023-07-14T18:17:18.061 INFO:tasks.workunit.client.0.smithi163.stdout:2468(164 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.061 INFO:tasks.workunit.client.0.smithi163.stdout:2469(165 mod 256): FALLOC 0x7ee7e thru 0x81acc (0x2c4e bytes) INTERIOR 2023-07-14T18:17:18.061 INFO:tasks.workunit.client.0.smithi163.stdout:2470(166 mod 256): WRITE 0xa02c3 thru 0xaf096 (0xedd4 bytes) 2023-07-14T18:17:18.061 INFO:tasks.workunit.client.0.smithi163.stdout:2471(167 mod 256): MAPREAD 0xd88f thru 0x1ada4 (0xd516 bytes) 2023-07-14T18:17:18.061 INFO:tasks.workunit.client.0.smithi163.stdout:2472(168 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.061 INFO:tasks.workunit.client.0.smithi163.stdout:2473(169 mod 256): TRUNCATE DOWN from 0xd6eb9 to 0x179ec ******WWWW 2023-07-14T18:17:18.061 INFO:tasks.workunit.client.0.smithi163.stdout:2474(170 mod 256): MAPREAD 0x2b5f thru 0x4b24 (0x1fc6 bytes) 2023-07-14T18:17:18.062 INFO:tasks.workunit.client.0.smithi163.stdout:2475(171 mod 256): PUNCH 0xac08 thru 0x165e9 (0xb9e2 bytes) 2023-07-14T18:17:18.062 INFO:tasks.workunit.client.0.smithi163.stdout:2476(172 mod 256): READ 0xb04c thru 0x10dff (0x5db4 bytes) 2023-07-14T18:17:18.062 INFO:tasks.workunit.client.0.smithi163.stdout:2477(173 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.062 INFO:tasks.workunit.client.0.smithi163.stdout:2478(174 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.062 INFO:tasks.workunit.client.0.smithi163.stdout:2479(175 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.062 INFO:tasks.workunit.client.0.smithi163.stdout:2480(176 mod 256): READ 0xf43 thru 0x10a6f (0xfb2d bytes) 2023-07-14T18:17:18.062 INFO:tasks.workunit.client.0.smithi163.stdout:2481(177 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.062 INFO:tasks.workunit.client.0.smithi163.stdout:2482(178 mod 256): MAPWRITE 0x670c9 thru 0x71875 (0xa7ad bytes) 2023-07-14T18:17:18.063 INFO:tasks.workunit.client.0.smithi163.stdout:2483(179 mod 256): MAPREAD 0x384bb thru 0x3890e (0x454 bytes) 2023-07-14T18:17:18.063 INFO:tasks.workunit.client.0.smithi163.stdout:2484(180 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.063 INFO:tasks.workunit.client.0.smithi163.stdout:2485(181 mod 256): FALLOC 0xadc7b thru 0xbc099 (0xe41e bytes) EXTENDING 2023-07-14T18:17:18.063 INFO:tasks.workunit.client.0.smithi163.stdout:2486(182 mod 256): PUNCH 0xc5e2 thru 0xe172 (0x1b91 bytes) 2023-07-14T18:17:18.063 INFO:tasks.workunit.client.0.smithi163.stdout:2487(183 mod 256): WRITE 0x8e899 thru 0x9506b (0x67d3 bytes) 2023-07-14T18:17:18.063 INFO:tasks.workunit.client.0.smithi163.stdout:2488(184 mod 256): FALLOC 0xa16b thru 0x12ff1 (0x8e86 bytes) INTERIOR 2023-07-14T18:17:18.063 INFO:tasks.workunit.client.0.smithi163.stdout:2489(185 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.063 INFO:tasks.workunit.client.0.smithi163.stdout:2490(186 mod 256): MAPREAD 0x35370 thru 0x42d4e (0xd9df bytes) ***RRRR*** 2023-07-14T18:17:18.064 INFO:tasks.workunit.client.0.smithi163.stdout:2491(187 mod 256): MAPREAD 0x4cd82 thru 0x5a978 (0xdbf7 bytes) 2023-07-14T18:17:18.064 INFO:tasks.workunit.client.0.smithi163.stdout:2492(188 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.064 INFO:tasks.workunit.client.0.smithi163.stdout:2493(189 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.064 INFO:tasks.workunit.client.0.smithi163.stdout:2494(190 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.064 INFO:tasks.workunit.client.0.smithi163.stdout:2495(191 mod 256): WRITE 0xc1b16 thru 0xcc5d4 (0xaabf bytes) HOLE 2023-07-14T18:17:18.064 INFO:tasks.workunit.client.0.smithi163.stdout:2496(192 mod 256): READ 0x61d37 thru 0x6a700 (0x89ca bytes) 2023-07-14T18:17:18.064 INFO:tasks.workunit.client.0.smithi163.stdout:2497(193 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.064 INFO:tasks.workunit.client.0.smithi163.stdout:2498(194 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.065 INFO:tasks.workunit.client.0.smithi163.stdout:2499(195 mod 256): READ 0xc7de4 thru 0xcc5d4 (0x47f1 bytes) 2023-07-14T18:17:18.065 INFO:tasks.workunit.client.0.smithi163.stdout:2500(196 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.065 INFO:tasks.workunit.client.0.smithi163.stdout:2501(197 mod 256): TRUNCATE DOWN from 0xcc5d5 to 0xaf52d 2023-07-14T18:17:18.065 INFO:tasks.workunit.client.0.smithi163.stdout:2502(198 mod 256): PUNCH 0x30e20 thru 0x358ce (0x4aaf bytes) 2023-07-14T18:17:18.065 INFO:tasks.workunit.client.0.smithi163.stdout:2503(199 mod 256): FALLOC 0x9fb65 thru 0xa6bff (0x709a bytes) INTERIOR 2023-07-14T18:17:18.065 INFO:tasks.workunit.client.0.smithi163.stdout:2504(200 mod 256): WRITE 0x72b63 thru 0x7fa2a (0xcec8 bytes) 2023-07-14T18:17:18.065 INFO:tasks.workunit.client.0.smithi163.stdout:2505(201 mod 256): READ 0x4421d thru 0x4bde6 (0x7bca bytes) 2023-07-14T18:17:18.065 INFO:tasks.workunit.client.0.smithi163.stdout:2506(202 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.066 INFO:tasks.workunit.client.0.smithi163.stdout:2507(203 mod 256): COPY 0x3c970 thru 0x46549 (0x9bda bytes) to 0x68b66 thru 0x7273f 2023-07-14T18:17:18.066 INFO:tasks.workunit.client.0.smithi163.stdout:2508(204 mod 256): READ 0x9fd56 thru 0xa7ac7 (0x7d72 bytes) 2023-07-14T18:17:18.066 INFO:tasks.workunit.client.0.smithi163.stdout:2509(205 mod 256): COPY 0x14b92 thru 0x1a19f (0x560e bytes) to 0x2b1c9 thru 0x307d6 2023-07-14T18:17:18.066 INFO:tasks.workunit.client.0.smithi163.stdout:2510(206 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.066 INFO:tasks.workunit.client.0.smithi163.stdout:2511(207 mod 256): PUNCH 0x5d3a1 thru 0x67d92 (0xa9f2 bytes) 2023-07-14T18:17:18.066 INFO:tasks.workunit.client.0.smithi163.stdout:2512(208 mod 256): WRITE 0xf796e thru 0xfffff (0x8692 bytes) HOLE 2023-07-14T18:17:18.066 INFO:tasks.workunit.client.0.smithi163.stdout:2513(209 mod 256): READ 0xcb7b1 thru 0xd7d11 (0xc561 bytes) 2023-07-14T18:17:18.066 INFO:tasks.workunit.client.0.smithi163.stdout:2514(210 mod 256): TRUNCATE DOWN from 0x100000 to 0xfb36b 2023-07-14T18:17:18.067 INFO:tasks.workunit.client.0.smithi163.stdout:2515(211 mod 256): WRITE 0x88cfe thru 0x9725a (0xe55d bytes) 2023-07-14T18:17:18.067 INFO:tasks.workunit.client.0.smithi163.stdout:2516(212 mod 256): MAPWRITE 0xa7882 thru 0xab986 (0x4105 bytes) 2023-07-14T18:17:18.067 INFO:tasks.workunit.client.0.smithi163.stdout:2517(213 mod 256): MAPWRITE 0x4d5d5 thru 0x5a621 (0xd04d bytes) 2023-07-14T18:17:18.067 INFO:tasks.workunit.client.0.smithi163.stdout:2518(214 mod 256): FALLOC 0x3b0d4 thru 0x3b496 (0x3c2 bytes) INTERIOR 2023-07-14T18:17:18.067 INFO:tasks.workunit.client.0.smithi163.stdout:2519(215 mod 256): TRUNCATE DOWN from 0xfb36b to 0x14faa ******WWWW 2023-07-14T18:17:18.067 INFO:tasks.workunit.client.0.smithi163.stdout:2520(216 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.067 INFO:tasks.workunit.client.0.smithi163.stdout:2521(217 mod 256): COPY 0x71f9 thru 0xc71d (0x5525 bytes) to 0x7222b thru 0x7774f 2023-07-14T18:17:18.067 INFO:tasks.workunit.client.0.smithi163.stdout:2522(218 mod 256): MAPWRITE 0xa5570 thru 0xb03b6 (0xae47 bytes) 2023-07-14T18:17:18.068 INFO:tasks.workunit.client.0.smithi163.stdout:2523(219 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.068 INFO:tasks.workunit.client.0.smithi163.stdout:2524(220 mod 256): PUNCH 0x9a69 thru 0x1013f (0x66d7 bytes) 2023-07-14T18:17:18.068 INFO:tasks.workunit.client.0.smithi163.stdout:2525(221 mod 256): MAPREAD 0x949a7 thru 0xa0107 (0xb761 bytes) 2023-07-14T18:17:18.068 INFO:tasks.workunit.client.0.smithi163.stdout:2526(222 mod 256): READ 0xb6e0 thru 0x144f2 (0x8e13 bytes) 2023-07-14T18:17:18.068 INFO:tasks.workunit.client.0.smithi163.stdout:2527(223 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.068 INFO:tasks.workunit.client.0.smithi163.stdout:2528(224 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.068 INFO:tasks.workunit.client.0.smithi163.stdout:2529(225 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.068 INFO:tasks.workunit.client.0.smithi163.stdout:2530(226 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.069 INFO:tasks.workunit.client.0.smithi163.stdout:2531(227 mod 256): TRUNCATE DOWN from 0xb03b7 to 0x76a6a 2023-07-14T18:17:18.069 INFO:tasks.workunit.client.0.smithi163.stdout:2532(228 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.069 INFO:tasks.workunit.client.0.smithi163.stdout:2533(229 mod 256): MAPREAD 0x33a7b thru 0x3c840 (0x8dc6 bytes) ***RRRR*** 2023-07-14T18:17:18.069 INFO:tasks.workunit.client.0.smithi163.stdout:2534(230 mod 256): MAPWRITE 0x19428 thru 0x22a56 (0x962f bytes) 2023-07-14T18:17:18.069 INFO:tasks.workunit.client.0.smithi163.stdout:2535(231 mod 256): MAPWRITE 0x4b237 thru 0x565e6 (0xb3b0 bytes) 2023-07-14T18:17:18.069 INFO:tasks.workunit.client.0.smithi163.stdout:2536(232 mod 256): MAPWRITE 0x6a4d9 thru 0x7859c (0xe0c4 bytes) 2023-07-14T18:17:18.069 INFO:tasks.workunit.client.0.smithi163.stdout:2537(233 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.069 INFO:tasks.workunit.client.0.smithi163.stdout:2538(234 mod 256): COPY 0x65ca0 thru 0x65d7b (0xdc bytes) to 0x78bf0 thru 0x78ccb 2023-07-14T18:17:18.070 INFO:tasks.workunit.client.0.smithi163.stdout:2539(235 mod 256): WRITE 0x77bca thru 0x7d7b3 (0x5bea bytes) EXTEND 2023-07-14T18:17:18.070 INFO:tasks.workunit.client.0.smithi163.stdout:2540(236 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.070 INFO:tasks.workunit.client.0.smithi163.stdout:2541(237 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.070 INFO:tasks.workunit.client.0.smithi163.stdout:2542(238 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.070 INFO:tasks.workunit.client.0.smithi163.stdout:2543(239 mod 256): READ 0x474d7 thru 0x4d9fc (0x6526 bytes) 2023-07-14T18:17:18.070 INFO:tasks.workunit.client.0.smithi163.stdout:2544(240 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.070 INFO:tasks.workunit.client.0.smithi163.stdout:2545(241 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.070 INFO:tasks.workunit.client.0.smithi163.stdout:2546(242 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.071 INFO:tasks.workunit.client.0.smithi163.stdout:2547(243 mod 256): MAPREAD 0x5c7e0 thru 0x6b56a (0xed8b bytes) 2023-07-14T18:17:18.071 INFO:tasks.workunit.client.0.smithi163.stdout:2548(244 mod 256): TRUNCATE DOWN from 0x7d7b4 to 0x7084a 2023-07-14T18:17:18.071 INFO:tasks.workunit.client.0.smithi163.stdout:2549(245 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.071 INFO:tasks.workunit.client.0.smithi163.stdout:2550(246 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.071 INFO:tasks.workunit.client.0.smithi163.stdout:2551(247 mod 256): WRITE 0xd260e thru 0xd94ec (0x6edf bytes) HOLE 2023-07-14T18:17:18.071 INFO:tasks.workunit.client.0.smithi163.stdout:2552(248 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.071 INFO:tasks.workunit.client.0.smithi163.stdout:2553(249 mod 256): WRITE 0x29e05 thru 0x2f6a1 (0x589d bytes) 2023-07-14T18:17:18.071 INFO:tasks.workunit.client.0.smithi163.stdout:2554(250 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.072 INFO:tasks.workunit.client.0.smithi163.stdout:2555(251 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.072 INFO:tasks.workunit.client.0.smithi163.stdout:2556(252 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.072 INFO:tasks.workunit.client.0.smithi163.stdout:2557(253 mod 256): FALLOC 0x7b40e thru 0x86b3a (0xb72c bytes) INTERIOR 2023-07-14T18:17:18.072 INFO:tasks.workunit.client.0.smithi163.stdout:2558(254 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.072 INFO:tasks.workunit.client.0.smithi163.stdout:2559(255 mod 256): READ 0x20585 thru 0x24852 (0x42ce bytes) 2023-07-14T18:17:18.072 INFO:tasks.workunit.client.0.smithi163.stdout:2560( 0 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.072 INFO:tasks.workunit.client.0.smithi163.stdout:2561( 1 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.072 INFO:tasks.workunit.client.0.smithi163.stdout:2562( 2 mod 256): WRITE 0x66064 thru 0x668b1 (0x84e bytes) 2023-07-14T18:17:18.073 INFO:tasks.workunit.client.0.smithi163.stdout:2563( 3 mod 256): MAPREAD 0x868db thru 0x89140 (0x2866 bytes) 2023-07-14T18:17:18.073 INFO:tasks.workunit.client.0.smithi163.stdout:2564( 4 mod 256): MAPREAD 0x18413 thru 0x243f1 (0xbfdf bytes) 2023-07-14T18:17:18.073 INFO:tasks.workunit.client.0.smithi163.stdout:2565( 5 mod 256): COPY 0x7c3c0 thru 0x81765 (0x53a6 bytes) to 0xb0cbe thru 0xb6063 2023-07-14T18:17:18.073 INFO:tasks.workunit.client.0.smithi163.stdout:2566( 6 mod 256): WRITE 0xb74f2 thru 0xba3be (0x2ecd bytes) 2023-07-14T18:17:18.073 INFO:tasks.workunit.client.0.smithi163.stdout:2567( 7 mod 256): FALLOC 0x66fae thru 0x727a2 (0xb7f4 bytes) INTERIOR 2023-07-14T18:17:18.073 INFO:tasks.workunit.client.0.smithi163.stdout:2568( 8 mod 256): TRUNCATE DOWN from 0xd94ed to 0x820d3 2023-07-14T18:17:18.073 INFO:tasks.workunit.client.0.smithi163.stdout:2569( 9 mod 256): PUNCH 0x67a9a thru 0x6d832 (0x5d99 bytes) 2023-07-14T18:17:18.073 INFO:tasks.workunit.client.0.smithi163.stdout:2570( 10 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.074 INFO:tasks.workunit.client.0.smithi163.stdout:2571( 11 mod 256): FALLOC 0x98af2 thru 0xa0129 (0x7637 bytes) PAST_EOF 2023-07-14T18:17:18.074 INFO:tasks.workunit.client.0.smithi163.stdout:2572( 12 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.074 INFO:tasks.workunit.client.0.smithi163.stdout:2573( 13 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.074 INFO:tasks.workunit.client.0.smithi163.stdout:2574( 14 mod 256): MAPREAD 0x504d3 thru 0x5146d (0xf9b bytes) 2023-07-14T18:17:18.074 INFO:tasks.workunit.client.0.smithi163.stdout:2575( 15 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.074 INFO:tasks.workunit.client.0.smithi163.stdout:2576( 16 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.074 INFO:tasks.workunit.client.0.smithi163.stdout:2577( 17 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.074 INFO:tasks.workunit.client.0.smithi163.stdout:2578( 18 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.075 INFO:tasks.workunit.client.0.smithi163.stdout:2579( 19 mod 256): FALLOC 0x18b51 thru 0x22e90 (0xa33f bytes) INTERIOR 2023-07-14T18:17:18.075 INFO:tasks.workunit.client.0.smithi163.stdout:2580( 20 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.075 INFO:tasks.workunit.client.0.smithi163.stdout:2581( 21 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.075 INFO:tasks.workunit.client.0.smithi163.stdout:2582( 22 mod 256): PUNCH 0x15b42 thru 0x1ec8e (0x914d bytes) 2023-07-14T18:17:18.075 INFO:tasks.workunit.client.0.smithi163.stdout:2583( 23 mod 256): WRITE 0x1268b thru 0x19086 (0x69fc bytes) 2023-07-14T18:17:18.075 INFO:tasks.workunit.client.0.smithi163.stdout:2584( 24 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.075 INFO:tasks.workunit.client.0.smithi163.stdout:2585( 25 mod 256): READ 0x7d109 thru 0x820d2 (0x4fca bytes) 2023-07-14T18:17:18.075 INFO:tasks.workunit.client.0.smithi163.stdout:2586( 26 mod 256): PUNCH 0x1b0fa thru 0x29cae (0xebb5 bytes) 2023-07-14T18:17:18.076 INFO:tasks.workunit.client.0.smithi163.stdout:2587( 27 mod 256): WRITE 0xebcf5 thru 0xf449c (0x87a8 bytes) HOLE 2023-07-14T18:17:18.076 INFO:tasks.workunit.client.0.smithi163.stdout:2588( 28 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.076 INFO:tasks.workunit.client.0.smithi163.stdout:2589( 29 mod 256): READ 0x14c4a thru 0x1a150 (0x5507 bytes) 2023-07-14T18:17:18.076 INFO:tasks.workunit.client.0.smithi163.stdout:2590( 30 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.076 INFO:tasks.workunit.client.0.smithi163.stdout:2591( 31 mod 256): MAPWRITE 0x1a103 thru 0x23cf2 (0x9bf0 bytes) 2023-07-14T18:17:18.076 INFO:tasks.workunit.client.0.smithi163.stdout:2592( 32 mod 256): MAPREAD 0x75f9f thru 0x7c776 (0x67d8 bytes) 2023-07-14T18:17:18.076 INFO:tasks.workunit.client.0.smithi163.stdout:2593( 33 mod 256): PUNCH 0x81561 thru 0x859ed (0x448d bytes) 2023-07-14T18:17:18.077 INFO:tasks.workunit.client.0.smithi163.stdout:2594( 34 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.077 INFO:tasks.workunit.client.0.smithi163.stdout:2595( 35 mod 256): TRUNCATE DOWN from 0xf449d to 0xf1fea 2023-07-14T18:17:18.077 INFO:tasks.workunit.client.0.smithi163.stdout:2596( 36 mod 256): COPY 0x8a109 thru 0x8be13 (0x1d0b bytes) to 0xd6e5f thru 0xd8b69 2023-07-14T18:17:18.077 INFO:tasks.workunit.client.0.smithi163.stdout:2597( 37 mod 256): COPY 0xcd6f3 thru 0xd6386 (0x8c94 bytes) to 0x1e59b thru 0x2722e 2023-07-14T18:17:18.077 INFO:tasks.workunit.client.0.smithi163.stdout:2598( 38 mod 256): MAPREAD 0xe1280 thru 0xef21d (0xdf9e bytes) 2023-07-14T18:17:18.077 INFO:tasks.workunit.client.0.smithi163.stdout:2599( 39 mod 256): READ 0xb8977 thru 0xb93a9 (0xa33 bytes) 2023-07-14T18:17:18.077 INFO:tasks.workunit.client.0.smithi163.stdout:2600( 40 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.077 INFO:tasks.workunit.client.0.smithi163.stdout:2601( 41 mod 256): FALLOC 0x2c270 thru 0x2de03 (0x1b93 bytes) INTERIOR 2023-07-14T18:17:18.078 INFO:tasks.workunit.client.0.smithi163.stdout:2602( 42 mod 256): READ 0xbe496 thru 0xc9ce9 (0xb854 bytes) 2023-07-14T18:17:18.078 INFO:tasks.workunit.client.0.smithi163.stdout:2603( 43 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.078 INFO:tasks.workunit.client.0.smithi163.stdout:2604( 44 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.078 INFO:tasks.workunit.client.0.smithi163.stdout:2605( 45 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.078 INFO:tasks.workunit.client.0.smithi163.stdout:2606( 46 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.078 INFO:tasks.workunit.client.0.smithi163.stdout:2607( 47 mod 256): PUNCH 0x38b2c thru 0x47f38 (0xf40d bytes) 2023-07-14T18:17:18.078 INFO:tasks.workunit.client.0.smithi163.stdout:2608( 48 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.078 INFO:tasks.workunit.client.0.smithi163.stdout:2609( 49 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.079 INFO:tasks.workunit.client.0.smithi163.stdout:2610( 50 mod 256): FALLOC 0x78d95 thru 0x7f4a5 (0x6710 bytes) INTERIOR 2023-07-14T18:17:18.079 INFO:tasks.workunit.client.0.smithi163.stdout:2611( 51 mod 256): MAPREAD 0xff2a thru 0x1dda5 (0xde7c bytes) 2023-07-14T18:17:18.079 INFO:tasks.workunit.client.0.smithi163.stdout:2612( 52 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.079 INFO:tasks.workunit.client.0.smithi163.stdout:2613( 53 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.079 INFO:tasks.workunit.client.0.smithi163.stdout:2614( 54 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.079 INFO:tasks.workunit.client.0.smithi163.stdout:2615( 55 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.079 INFO:tasks.workunit.client.0.smithi163.stdout:2616( 56 mod 256): COPY 0x6a553 thru 0x72a5e (0x850c bytes) to 0xc96e5 thru 0xd1bf0 2023-07-14T18:17:18.079 INFO:tasks.workunit.client.0.smithi163.stdout:2617( 57 mod 256): MAPWRITE 0x4882f thru 0x52930 (0xa102 bytes) 2023-07-14T18:17:18.080 INFO:tasks.workunit.client.0.smithi163.stdout:2618( 58 mod 256): TRUNCATE DOWN from 0xf1fea to 0x24c45 ******WWWW 2023-07-14T18:17:18.080 INFO:tasks.workunit.client.0.smithi163.stdout:2619( 59 mod 256): MAPREAD 0x20c8a thru 0x228b3 (0x1c2a bytes) 2023-07-14T18:17:18.080 INFO:tasks.workunit.client.0.smithi163.stdout:2620( 60 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.080 INFO:tasks.workunit.client.0.smithi163.stdout:2621( 61 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.080 INFO:tasks.workunit.client.0.smithi163.stdout:2622( 62 mod 256): TRUNCATE UP from 0x24c45 to 0x6604d ******WWWW 2023-07-14T18:17:18.080 INFO:tasks.workunit.client.0.smithi163.stdout:2623( 63 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.080 INFO:tasks.workunit.client.0.smithi163.stdout:2624( 64 mod 256): PUNCH 0x654da thru 0x6604c (0xb73 bytes) 2023-07-14T18:17:18.080 INFO:tasks.workunit.client.0.smithi163.stdout:2625( 65 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.081 INFO:tasks.workunit.client.0.smithi163.stdout:2626( 66 mod 256): TRUNCATE DOWN from 0x6604d to 0x63e0c 2023-07-14T18:17:18.081 INFO:tasks.workunit.client.0.smithi163.stdout:2627( 67 mod 256): FALLOC 0x27d26 thru 0x373f2 (0xf6cc bytes) INTERIOR 2023-07-14T18:17:18.081 INFO:tasks.workunit.client.0.smithi163.stdout:2628( 68 mod 256): MAPREAD 0x31fe2 thru 0x418f5 (0xf914 bytes) ***RRRR*** 2023-07-14T18:17:18.081 INFO:tasks.workunit.client.0.smithi163.stdout:2629( 69 mod 256): PUNCH 0x4d024 thru 0x59e8c (0xce69 bytes) 2023-07-14T18:17:18.081 INFO:tasks.workunit.client.0.smithi163.stdout:2630( 70 mod 256): TRUNCATE DOWN from 0x63e0c to 0x3b50e 2023-07-14T18:17:18.081 INFO:tasks.workunit.client.0.smithi163.stdout:2631( 71 mod 256): MAPWRITE 0xcb5a5 thru 0xcde41 (0x289d bytes) 2023-07-14T18:17:18.081 INFO:tasks.workunit.client.0.smithi163.stdout:2632( 72 mod 256): READ 0x4ed55 thru 0x5ad0b (0xbfb7 bytes) 2023-07-14T18:17:18.081 INFO:tasks.workunit.client.0.smithi163.stdout:2633( 73 mod 256): READ 0xac8dc thru 0xac946 (0x6b bytes) 2023-07-14T18:17:18.082 INFO:tasks.workunit.client.0.smithi163.stdout:2634( 74 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.082 INFO:tasks.workunit.client.0.smithi163.stdout:2635( 75 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.082 INFO:tasks.workunit.client.0.smithi163.stdout:2636( 76 mod 256): TRUNCATE DOWN from 0xcde42 to 0x6b128 2023-07-14T18:17:18.082 INFO:tasks.workunit.client.0.smithi163.stdout:2637( 77 mod 256): TRUNCATE DOWN from 0x6b128 to 0x1c770 ******WWWW 2023-07-14T18:17:18.082 INFO:tasks.workunit.client.0.smithi163.stdout:2638( 78 mod 256): PUNCH 0x76db thru 0xcfe3 (0x5909 bytes) 2023-07-14T18:17:18.082 INFO:tasks.workunit.client.0.smithi163.stdout:2639( 79 mod 256): FALLOC 0xd89bb thru 0xe2822 (0x9e67 bytes) EXTENDING 2023-07-14T18:17:18.082 INFO:tasks.workunit.client.0.smithi163.stdout:2640( 80 mod 256): MAPREAD 0xdf139 thru 0xe2821 (0x36e9 bytes) 2023-07-14T18:17:18.082 INFO:tasks.workunit.client.0.smithi163.stdout:2641( 81 mod 256): READ 0x832a4 thru 0x8702c (0x3d89 bytes) 2023-07-14T18:17:18.083 INFO:tasks.workunit.client.0.smithi163.stdout:2642( 82 mod 256): READ 0x40025 thru 0x4ec9b (0xec77 bytes) 2023-07-14T18:17:18.083 INFO:tasks.workunit.client.0.smithi163.stdout:2643( 83 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.083 INFO:tasks.workunit.client.0.smithi163.stdout:2644( 84 mod 256): MAPREAD 0x1444f thru 0x22036 (0xdbe8 bytes) 2023-07-14T18:17:18.083 INFO:tasks.workunit.client.0.smithi163.stdout:2645( 85 mod 256): PUNCH 0x46ca6 thru 0x54b6a (0xdec5 bytes) 2023-07-14T18:17:18.083 INFO:tasks.workunit.client.0.smithi163.stdout:2646( 86 mod 256): MAPREAD 0xc8dba thru 0xc985a (0xaa1 bytes) 2023-07-14T18:17:18.083 INFO:tasks.workunit.client.0.smithi163.stdout:2647( 87 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.083 INFO:tasks.workunit.client.0.smithi163.stdout:2648( 88 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.083 INFO:tasks.workunit.client.0.smithi163.stdout:2649( 89 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.084 INFO:tasks.workunit.client.0.smithi163.stdout:2650( 90 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.084 INFO:tasks.workunit.client.0.smithi163.stdout:2651( 91 mod 256): COPY 0x987a9 thru 0xa45cd (0xbe25 bytes) to 0x68ed2 thru 0x74cf6 2023-07-14T18:17:18.084 INFO:tasks.workunit.client.0.smithi163.stdout:2652( 92 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.084 INFO:tasks.workunit.client.0.smithi163.stdout:2653( 93 mod 256): READ 0x3d00e thru 0x47ec2 (0xaeb5 bytes) 2023-07-14T18:17:18.084 INFO:tasks.workunit.client.0.smithi163.stdout:2654( 94 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.084 INFO:tasks.workunit.client.0.smithi163.stdout:2655( 95 mod 256): READ 0x3fce6 thru 0x47566 (0x7881 bytes) 2023-07-14T18:17:18.084 INFO:tasks.workunit.client.0.smithi163.stdout:2656( 96 mod 256): TRUNCATE UP from 0xe2822 to 0xe6b58 2023-07-14T18:17:18.084 INFO:tasks.workunit.client.0.smithi163.stdout:2657( 97 mod 256): READ 0xcbf40 thru 0xd2454 (0x6515 bytes) 2023-07-14T18:17:18.085 INFO:tasks.workunit.client.0.smithi163.stdout:2658( 98 mod 256): COPY 0xc7fb1 thru 0xd6565 (0xe5b5 bytes) to 0x7a077 thru 0x8862b 2023-07-14T18:17:18.085 INFO:tasks.workunit.client.0.smithi163.stdout:2659( 99 mod 256): MAPWRITE 0x9fd9b thru 0xa9594 (0x97fa bytes) 2023-07-14T18:17:18.085 INFO:tasks.workunit.client.0.smithi163.stdout:2660(100 mod 256): MAPREAD 0x91bde thru 0x9b70a (0x9b2d bytes) 2023-07-14T18:17:18.085 INFO:tasks.workunit.client.0.smithi163.stdout:2661(101 mod 256): FALLOC 0xdbbc2 thru 0xe59c0 (0x9dfe bytes) INTERIOR 2023-07-14T18:17:18.085 INFO:tasks.workunit.client.0.smithi163.stdout:2662(102 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.085 INFO:tasks.workunit.client.0.smithi163.stdout:2663(103 mod 256): MAPREAD 0xac83b thru 0xb2c6a (0x6430 bytes) 2023-07-14T18:17:18.085 INFO:tasks.workunit.client.0.smithi163.stdout:2664(104 mod 256): MAPWRITE 0x86919 thru 0x8ad04 (0x43ec bytes) 2023-07-14T18:17:18.085 INFO:tasks.workunit.client.0.smithi163.stdout:2665(105 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.086 INFO:tasks.workunit.client.0.smithi163.stdout:2666(106 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.086 INFO:tasks.workunit.client.0.smithi163.stdout:2667(107 mod 256): MAPREAD 0x13205 thru 0x19eea (0x6ce6 bytes) 2023-07-14T18:17:18.086 INFO:tasks.workunit.client.0.smithi163.stdout:2668(108 mod 256): WRITE 0xc9407 thru 0xcd263 (0x3e5d bytes) 2023-07-14T18:17:18.086 INFO:tasks.workunit.client.0.smithi163.stdout:2669(109 mod 256): PUNCH 0xc4052 thru 0xcdab2 (0x9a61 bytes) 2023-07-14T18:17:18.086 INFO:tasks.workunit.client.0.smithi163.stdout:2670(110 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.086 INFO:tasks.workunit.client.0.smithi163.stdout:2671(111 mod 256): TRUNCATE UP from 0xe6b58 to 0xf0e2b 2023-07-14T18:17:18.086 INFO:tasks.workunit.client.0.smithi163.stdout:2672(112 mod 256): READ 0x73a75 thru 0x79a29 (0x5fb5 bytes) 2023-07-14T18:17:18.086 INFO:tasks.workunit.client.0.smithi163.stdout:2673(113 mod 256): FALLOC 0x58d5 thru 0x141a6 (0xe8d1 bytes) INTERIOR 2023-07-14T18:17:18.087 INFO:tasks.workunit.client.0.smithi163.stdout:2674(114 mod 256): MAPWRITE 0x96403 thru 0x9aa92 (0x4690 bytes) 2023-07-14T18:17:18.087 INFO:tasks.workunit.client.0.smithi163.stdout:2675(115 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.087 INFO:tasks.workunit.client.0.smithi163.stdout:2676(116 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.087 INFO:tasks.workunit.client.0.smithi163.stdout:2677(117 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.087 INFO:tasks.workunit.client.0.smithi163.stdout:2678(118 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.087 INFO:tasks.workunit.client.0.smithi163.stdout:2679(119 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.087 INFO:tasks.workunit.client.0.smithi163.stdout:2680(120 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.087 INFO:tasks.workunit.client.0.smithi163.stdout:2681(121 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.088 INFO:tasks.workunit.client.0.smithi163.stdout:2682(122 mod 256): READ 0x1226b thru 0x17ae3 (0x5879 bytes) 2023-07-14T18:17:18.088 INFO:tasks.workunit.client.0.smithi163.stdout:2683(123 mod 256): TRUNCATE UP from 0xf0e2b to 0xf56d4 2023-07-14T18:17:18.088 INFO:tasks.workunit.client.0.smithi163.stdout:2684(124 mod 256): MAPWRITE 0xec4c6 thru 0xf8106 (0xbc41 bytes) 2023-07-14T18:17:18.088 INFO:tasks.workunit.client.0.smithi163.stdout:2685(125 mod 256): MAPWRITE 0xa9eb8 thru 0xb8050 (0xe199 bytes) 2023-07-14T18:17:18.088 INFO:tasks.workunit.client.0.smithi163.stdout:2686(126 mod 256): READ 0xc5851 thru 0xc64bd (0xc6d bytes) 2023-07-14T18:17:18.088 INFO:tasks.workunit.client.0.smithi163.stdout:2687(127 mod 256): READ 0x90dfe thru 0x94f9c (0x419f bytes) 2023-07-14T18:17:18.088 INFO:tasks.workunit.client.0.smithi163.stdout:2688(128 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.088 INFO:tasks.workunit.client.0.smithi163.stdout:2689(129 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.089 INFO:tasks.workunit.client.0.smithi163.stdout:2690(130 mod 256): COPY 0x304e thru 0x42e2 (0x1295 bytes) to 0x58b5a thru 0x59dee 2023-07-14T18:17:18.089 INFO:tasks.workunit.client.0.smithi163.stdout:2691(131 mod 256): FALLOC 0x30445 thru 0x3aaf7 (0xa6b2 bytes) INTERIOR ******FFFF 2023-07-14T18:17:18.089 INFO:tasks.workunit.client.0.smithi163.stdout:2692(132 mod 256): COPY 0xea4e7 thru 0xf0fb6 (0x6ad0 bytes) to 0x2eb91 thru 0x35660 2023-07-14T18:17:18.089 INFO:tasks.workunit.client.0.smithi163.stdout:2693(133 mod 256): TRUNCATE DOWN from 0xf8107 to 0xbc0ac 2023-07-14T18:17:18.089 INFO:tasks.workunit.client.0.smithi163.stdout:2694(134 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.089 INFO:tasks.workunit.client.0.smithi163.stdout:2695(135 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.089 INFO:tasks.workunit.client.0.smithi163.stdout:2696(136 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.089 INFO:tasks.workunit.client.0.smithi163.stdout:2697(137 mod 256): TRUNCATE DOWN from 0xbc0ac to 0x8f6a7 2023-07-14T18:17:18.090 INFO:tasks.workunit.client.0.smithi163.stdout:2698(138 mod 256): TRUNCATE DOWN from 0x8f6a7 to 0x42157 2023-07-14T18:17:18.090 INFO:tasks.workunit.client.0.smithi163.stdout:2699(139 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.090 INFO:tasks.workunit.client.0.smithi163.stdout:2700(140 mod 256): COPY 0x8b9b thru 0x1403b (0xb4a1 bytes) to 0x50587 thru 0x5ba27 2023-07-14T18:17:18.090 INFO:tasks.workunit.client.0.smithi163.stdout:2701(141 mod 256): MAPWRITE 0x7f6a thru 0xb68f (0x3726 bytes) 2023-07-14T18:17:18.090 INFO:tasks.workunit.client.0.smithi163.stdout:2702(142 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.090 INFO:tasks.workunit.client.0.smithi163.stdout:2703(143 mod 256): PUNCH 0x33ba8 thru 0x42a08 (0xee61 bytes) ******PPPP 2023-07-14T18:17:18.090 INFO:tasks.workunit.client.0.smithi163.stdout:2704(144 mod 256): MAPWRITE 0xc7930 thru 0xcffc3 (0x8694 bytes) 2023-07-14T18:17:18.090 INFO:tasks.workunit.client.0.smithi163.stdout:2705(145 mod 256): WRITE 0x1041a thru 0x16e51 (0x6a38 bytes) 2023-07-14T18:17:18.091 INFO:tasks.workunit.client.0.smithi163.stdout:2706(146 mod 256): WRITE 0x3a759 thru 0x3e64a (0x3ef2 bytes) 2023-07-14T18:17:18.091 INFO:tasks.workunit.client.0.smithi163.stdout:2707(147 mod 256): MAPWRITE 0x6343 thru 0x126b4 (0xc372 bytes) 2023-07-14T18:17:18.091 INFO:tasks.workunit.client.0.smithi163.stdout:2708(148 mod 256): PUNCH 0x48653 thru 0x53eb7 (0xb865 bytes) 2023-07-14T18:17:18.091 INFO:tasks.workunit.client.0.smithi163.stdout:2709(149 mod 256): PUNCH 0x92eb7 thru 0x9ae34 (0x7f7e bytes) 2023-07-14T18:17:18.091 INFO:tasks.workunit.client.0.smithi163.stdout:2710(150 mod 256): MAPREAD 0x7ee0b thru 0x8a8df (0xbad5 bytes) 2023-07-14T18:17:18.091 INFO:tasks.workunit.client.0.smithi163.stdout:2711(151 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.091 INFO:tasks.workunit.client.0.smithi163.stdout:2712(152 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.091 INFO:tasks.workunit.client.0.smithi163.stdout:2713(153 mod 256): FALLOC 0x204e thru 0x2058 (0xa bytes) INTERIOR 2023-07-14T18:17:18.092 INFO:tasks.workunit.client.0.smithi163.stdout:2714(154 mod 256): MAPREAD 0x3f51b thru 0x47f4f (0x8a35 bytes) 2023-07-14T18:17:18.092 INFO:tasks.workunit.client.0.smithi163.stdout:2715(155 mod 256): WRITE 0x216db thru 0x287c4 (0x70ea bytes) 2023-07-14T18:17:18.092 INFO:tasks.workunit.client.0.smithi163.stdout:2716(156 mod 256): PUNCH 0x18032 thru 0x19177 (0x1146 bytes) 2023-07-14T18:17:18.092 INFO:tasks.workunit.client.0.smithi163.stdout:2717(157 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.092 INFO:tasks.workunit.client.0.smithi163.stdout:2718(158 mod 256): PUNCH 0xc8abf thru 0xcffc3 (0x7505 bytes) 2023-07-14T18:17:18.092 INFO:tasks.workunit.client.0.smithi163.stdout:2719(159 mod 256): PUNCH 0x18c14 thru 0x26f53 (0xe340 bytes) 2023-07-14T18:17:18.092 INFO:tasks.workunit.client.0.smithi163.stdout:2720(160 mod 256): READ 0x5fd8f thru 0x68993 (0x8c05 bytes) 2023-07-14T18:17:18.092 INFO:tasks.workunit.client.0.smithi163.stdout:2721(161 mod 256): PUNCH 0xa3617 thru 0xa7219 (0x3c03 bytes) 2023-07-14T18:17:18.093 INFO:tasks.workunit.client.0.smithi163.stdout:2722(162 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.093 INFO:tasks.workunit.client.0.smithi163.stdout:2723(163 mod 256): READ 0x96dce thru 0x9f25b (0x848e bytes) 2023-07-14T18:17:18.093 INFO:tasks.workunit.client.0.smithi163.stdout:2724(164 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.093 INFO:tasks.workunit.client.0.smithi163.stdout:2725(165 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.093 INFO:tasks.workunit.client.0.smithi163.stdout:2726(166 mod 256): WRITE 0x636fd thru 0x72883 (0xf187 bytes) 2023-07-14T18:17:18.093 INFO:tasks.workunit.client.0.smithi163.stdout:2727(167 mod 256): MAPREAD 0x14118 thru 0x1c4ed (0x83d6 bytes) 2023-07-14T18:17:18.093 INFO:tasks.workunit.client.0.smithi163.stdout:2728(168 mod 256): MAPREAD 0x3e1e6 thru 0x43503 (0x531e bytes) 2023-07-14T18:17:18.093 INFO:tasks.workunit.client.0.smithi163.stdout:2729(169 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.094 INFO:tasks.workunit.client.0.smithi163.stdout:2730(170 mod 256): COPY 0x2e4cd thru 0x32764 (0x4298 bytes) to 0x6eaf5 thru 0x72d8c 2023-07-14T18:17:18.094 INFO:tasks.workunit.client.0.smithi163.stdout:2731(171 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.094 INFO:tasks.workunit.client.0.smithi163.stdout:2732(172 mod 256): COPY 0xf8f0 thru 0x161fb (0x690c bytes) to 0x44d05 thru 0x4b610 2023-07-14T18:17:18.094 INFO:tasks.workunit.client.0.smithi163.stdout:2733(173 mod 256): TRUNCATE UP from 0xcffc4 to 0xe3ae5 2023-07-14T18:17:18.094 INFO:tasks.workunit.client.0.smithi163.stdout:2734(174 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.094 INFO:tasks.workunit.client.0.smithi163.stdout:2735(175 mod 256): PUNCH 0x1bf18 thru 0x21c79 (0x5d62 bytes) 2023-07-14T18:17:18.094 INFO:tasks.workunit.client.0.smithi163.stdout:2736(176 mod 256): TRUNCATE DOWN from 0xe3ae5 to 0x6943b 2023-07-14T18:17:18.094 INFO:tasks.workunit.client.0.smithi163.stdout:2737(177 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.095 INFO:tasks.workunit.client.0.smithi163.stdout:2738(178 mod 256): READ 0x65db2 thru 0x6943a (0x3689 bytes) 2023-07-14T18:17:18.095 INFO:tasks.workunit.client.0.smithi163.stdout:2739(179 mod 256): FALLOC 0xcd4b thru 0x1025f (0x3514 bytes) INTERIOR 2023-07-14T18:17:18.095 INFO:tasks.workunit.client.0.smithi163.stdout:2740(180 mod 256): READ 0x3f59c thru 0x4b339 (0xbd9e bytes) 2023-07-14T18:17:18.095 INFO:tasks.workunit.client.0.smithi163.stdout:2741(181 mod 256): COPY 0x434d1 thru 0x4c7df (0x930f bytes) to 0xe1f78 thru 0xeb286 2023-07-14T18:17:18.095 INFO:tasks.workunit.client.0.smithi163.stdout:2742(182 mod 256): TRUNCATE DOWN from 0xeb287 to 0x8627f 2023-07-14T18:17:18.095 INFO:tasks.workunit.client.0.smithi163.stdout:2743(183 mod 256): FALLOC 0x51f2a thru 0x5d9a0 (0xba76 bytes) INTERIOR 2023-07-14T18:17:18.095 INFO:tasks.workunit.client.0.smithi163.stdout:2744(184 mod 256): PUNCH 0x7862b thru 0x7c4fc (0x3ed2 bytes) 2023-07-14T18:17:18.095 INFO:tasks.workunit.client.0.smithi163.stdout:2745(185 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.096 INFO:tasks.workunit.client.0.smithi163.stdout:2746(186 mod 256): FALLOC 0xce60d thru 0xd5d17 (0x770a bytes) PAST_EOF 2023-07-14T18:17:18.096 INFO:tasks.workunit.client.0.smithi163.stdout:2747(187 mod 256): MAPREAD 0xa7ad thru 0xe557 (0x3dab bytes) 2023-07-14T18:17:18.096 INFO:tasks.workunit.client.0.smithi163.stdout:2748(188 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.096 INFO:tasks.workunit.client.0.smithi163.stdout:2749(189 mod 256): FALLOC 0x1307c thru 0x19300 (0x6284 bytes) INTERIOR 2023-07-14T18:17:18.096 INFO:tasks.workunit.client.0.smithi163.stdout:2750(190 mod 256): MAPWRITE 0xb0f40 thru 0xb60e6 (0x51a7 bytes) 2023-07-14T18:17:18.096 INFO:tasks.workunit.client.0.smithi163.stdout:2751(191 mod 256): MAPWRITE 0xd3e03 thru 0xd8ba2 (0x4da0 bytes) 2023-07-14T18:17:18.096 INFO:tasks.workunit.client.0.smithi163.stdout:2752(192 mod 256): PUNCH 0x409ae thru 0x4c141 (0xb794 bytes) 2023-07-14T18:17:18.096 INFO:tasks.workunit.client.0.smithi163.stdout:2753(193 mod 256): MAPREAD 0xcff20 thru 0xd8ba2 (0x8c83 bytes) 2023-07-14T18:17:18.097 INFO:tasks.workunit.client.0.smithi163.stdout:2754(194 mod 256): FALLOC 0xa013b thru 0xadb0d (0xd9d2 bytes) INTERIOR 2023-07-14T18:17:18.097 INFO:tasks.workunit.client.0.smithi163.stdout:2755(195 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.097 INFO:tasks.workunit.client.0.smithi163.stdout:2756(196 mod 256): COPY 0x332d6 thru 0x3d029 (0x9d54 bytes) to 0x12b4c thru 0x1c89f EEEE****** 2023-07-14T18:17:18.097 INFO:tasks.workunit.client.0.smithi163.stdout:2757(197 mod 256): TRUNCATE DOWN from 0xd8ba3 to 0x8aa0d 2023-07-14T18:17:18.097 INFO:tasks.workunit.client.0.smithi163.stdout:2758(198 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.097 INFO:tasks.workunit.client.0.smithi163.stdout:2759(199 mod 256): MAPWRITE 0xc9b49 thru 0xd0534 (0x69ec bytes) 2023-07-14T18:17:18.097 INFO:tasks.workunit.client.0.smithi163.stdout:2760(200 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.097 INFO:tasks.workunit.client.0.smithi163.stdout:2761(201 mod 256): PUNCH 0x196f4 thru 0x24e83 (0xb790 bytes) 2023-07-14T18:17:18.098 INFO:tasks.workunit.client.0.smithi163.stdout:2762(202 mod 256): READ 0xafbd9 thru 0xbefc8 (0xf3f0 bytes) 2023-07-14T18:17:18.098 INFO:tasks.workunit.client.0.smithi163.stdout:2763(203 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.098 INFO:tasks.workunit.client.0.smithi163.stdout:2764(204 mod 256): READ 0x4946 thru 0x12d30 (0xe3eb bytes) 2023-07-14T18:17:18.098 INFO:tasks.workunit.client.0.smithi163.stdout:2765(205 mod 256): READ 0x64291 thru 0x6912b (0x4e9b bytes) 2023-07-14T18:17:18.098 INFO:tasks.workunit.client.0.smithi163.stdout:2766(206 mod 256): WRITE 0x3481d thru 0x3f775 (0xaf59 bytes) ***WWWW 2023-07-14T18:17:18.098 INFO:tasks.workunit.client.0.smithi163.stdout:2767(207 mod 256): READ 0x527f thru 0x107f1 (0xb573 bytes) 2023-07-14T18:17:18.098 INFO:tasks.workunit.client.0.smithi163.stdout:2768(208 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.098 INFO:tasks.workunit.client.0.smithi163.stdout:2769(209 mod 256): MAPREAD 0xc086f thru 0xcf13d (0xe8cf bytes) 2023-07-14T18:17:18.099 INFO:tasks.workunit.client.0.smithi163.stdout:2770(210 mod 256): FALLOC 0x9b229 thru 0x9c7d6 (0x15ad bytes) INTERIOR 2023-07-14T18:17:18.099 INFO:tasks.workunit.client.0.smithi163.stdout:2771(211 mod 256): MAPREAD 0x9db7c thru 0xa1e4e (0x42d3 bytes) 2023-07-14T18:17:18.099 INFO:tasks.workunit.client.0.smithi163.stdout:2772(212 mod 256): WRITE 0x54253 thru 0x5b50e (0x72bc bytes) 2023-07-14T18:17:18.099 INFO:tasks.workunit.client.0.smithi163.stdout:2773(213 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.099 INFO:tasks.workunit.client.0.smithi163.stdout:2774(214 mod 256): READ 0x5a8d0 thru 0x67f05 (0xd636 bytes) 2023-07-14T18:17:18.099 INFO:tasks.workunit.client.0.smithi163.stdout:2775(215 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.099 INFO:tasks.workunit.client.0.smithi163.stdout:2776(216 mod 256): FALLOC 0x15e46 thru 0x16941 (0xafb bytes) INTERIOR 2023-07-14T18:17:18.099 INFO:tasks.workunit.client.0.smithi163.stdout:2777(217 mod 256): COPY 0xc3a32 thru 0xd0534 (0xcb03 bytes) to 0x7fdd9 thru 0x8c8db 2023-07-14T18:17:18.100 INFO:tasks.workunit.client.0.smithi163.stdout:2778(218 mod 256): MAPWRITE 0x2536d thru 0x31b2a (0xc7be bytes) 2023-07-14T18:17:18.100 INFO:tasks.workunit.client.0.smithi163.stdout:2779(219 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.100 INFO:tasks.workunit.client.0.smithi163.stdout:2780(220 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.100 INFO:tasks.workunit.client.0.smithi163.stdout:2781(221 mod 256): MAPWRITE 0x7c4cc thru 0x83199 (0x6cce bytes) 2023-07-14T18:17:18.100 INFO:tasks.workunit.client.0.smithi163.stdout:2782(222 mod 256): WRITE 0x39649 thru 0x41be3 (0x859b bytes) 2023-07-14T18:17:18.100 INFO:tasks.workunit.client.0.smithi163.stdout:2783(223 mod 256): TRUNCATE DOWN from 0xd0535 to 0x817ee 2023-07-14T18:17:18.100 INFO:tasks.workunit.client.0.smithi163.stdout:2784(224 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.101 INFO:tasks.workunit.client.0.smithi163.stdout:2785(225 mod 256): MAPWRITE 0x96cf0 thru 0x99522 (0x2833 bytes) 2023-07-14T18:17:18.101 INFO:tasks.workunit.client.0.smithi163.stdout:2786(226 mod 256): FALLOC 0xc08ab thru 0xc7177 (0x68cc bytes) EXTENDING 2023-07-14T18:17:18.101 INFO:tasks.workunit.client.0.smithi163.stdout:2787(227 mod 256): MAPWRITE 0xc20cd thru 0xd02e2 (0xe216 bytes) 2023-07-14T18:17:18.101 INFO:tasks.workunit.client.0.smithi163.stdout:2788(228 mod 256): TRUNCATE UP from 0xd02e3 to 0xf4c9f 2023-07-14T18:17:18.101 INFO:tasks.workunit.client.0.smithi163.stdout:2789(229 mod 256): PUNCH 0xe8baa thru 0xe8e5a (0x2b1 bytes) 2023-07-14T18:17:18.101 INFO:tasks.workunit.client.0.smithi163.stdout:2790(230 mod 256): FALLOC 0x59868 thru 0x65298 (0xba30 bytes) INTERIOR 2023-07-14T18:17:18.101 INFO:tasks.workunit.client.0.smithi163.stdout:2791(231 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.101 INFO:tasks.workunit.client.0.smithi163.stdout:2792(232 mod 256): WRITE 0xfeb4 thru 0x13847 (0x3994 bytes) 2023-07-14T18:17:18.102 INFO:tasks.workunit.client.0.smithi163.stdout:2793(233 mod 256): WRITE 0x99ab2 thru 0xa3c45 (0xa194 bytes) 2023-07-14T18:17:18.102 INFO:tasks.workunit.client.0.smithi163.stdout:2794(234 mod 256): FALLOC 0x81d7e thru 0x83bc6 (0x1e48 bytes) INTERIOR 2023-07-14T18:17:18.102 INFO:tasks.workunit.client.0.smithi163.stdout:2795(235 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.102 INFO:tasks.workunit.client.0.smithi163.stdout:2796(236 mod 256): FALLOC 0xe15f6 thru 0xe5789 (0x4193 bytes) INTERIOR 2023-07-14T18:17:18.102 INFO:tasks.workunit.client.0.smithi163.stdout:2797(237 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.102 INFO:tasks.workunit.client.0.smithi163.stdout:2798(238 mod 256): FALLOC 0x49a94 thru 0x4b1dc (0x1748 bytes) INTERIOR 2023-07-14T18:17:18.102 INFO:tasks.workunit.client.0.smithi163.stdout:2799(239 mod 256): PUNCH 0xa2c9 thru 0xad06 (0xa3e bytes) 2023-07-14T18:17:18.102 INFO:tasks.workunit.client.0.smithi163.stdout:2800(240 mod 256): COPY 0xc7654 thru 0xc76bc (0x69 bytes) to 0xfe64f thru 0xfe6b7 2023-07-14T18:17:18.103 INFO:tasks.workunit.client.0.smithi163.stdout:2801(241 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.103 INFO:tasks.workunit.client.0.smithi163.stdout:2802(242 mod 256): TRUNCATE DOWN from 0xfe6b8 to 0x3d4a7 2023-07-14T18:17:18.103 INFO:tasks.workunit.client.0.smithi163.stdout:2803(243 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.103 INFO:tasks.workunit.client.0.smithi163.stdout:2804(244 mod 256): MAPREAD 0x217eb thru 0x2e6f5 (0xcf0b bytes) 2023-07-14T18:17:18.103 INFO:tasks.workunit.client.0.smithi163.stdout:2805(245 mod 256): READ 0x38bd thru 0x12085 (0xe7c9 bytes) 2023-07-14T18:17:18.103 INFO:tasks.workunit.client.0.smithi163.stdout:2806(246 mod 256): MAPWRITE 0xe2e29 thru 0xe5958 (0x2b30 bytes) 2023-07-14T18:17:18.103 INFO:tasks.workunit.client.0.smithi163.stdout:2807(247 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.103 INFO:tasks.workunit.client.0.smithi163.stdout:2808(248 mod 256): PUNCH 0x43153 thru 0x49584 (0x6432 bytes) 2023-07-14T18:17:18.104 INFO:tasks.workunit.client.0.smithi163.stdout:2809(249 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.104 INFO:tasks.workunit.client.0.smithi163.stdout:2810(250 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.104 INFO:tasks.workunit.client.0.smithi163.stdout:2811(251 mod 256): READ 0x8ea85 thru 0x946c4 (0x5c40 bytes) 2023-07-14T18:17:18.104 INFO:tasks.workunit.client.0.smithi163.stdout:2812(252 mod 256): MAPREAD 0x482ca thru 0x4f847 (0x757e bytes) 2023-07-14T18:17:18.104 INFO:tasks.workunit.client.0.smithi163.stdout:2813(253 mod 256): MAPREAD 0x857a5 thru 0x8dbb1 (0x840d bytes) 2023-07-14T18:17:18.104 INFO:tasks.workunit.client.0.smithi163.stdout:2814(254 mod 256): COPY 0x71249 thru 0x7287e (0x1636 bytes) to 0xbec11 thru 0xc0246 2023-07-14T18:17:18.104 INFO:tasks.workunit.client.0.smithi163.stdout:2815(255 mod 256): MAPREAD 0x64b70 thru 0x6b32b (0x67bc bytes) 2023-07-14T18:17:18.104 INFO:tasks.workunit.client.0.smithi163.stdout:2816( 0 mod 256): PUNCH 0x3b824 thru 0x41b6d (0x634a bytes) 2023-07-14T18:17:18.105 INFO:tasks.workunit.client.0.smithi163.stdout:2817( 1 mod 256): MAPWRITE 0xf1aeb thru 0xfbf2e (0xa444 bytes) 2023-07-14T18:17:18.105 INFO:tasks.workunit.client.0.smithi163.stdout:2818( 2 mod 256): FALLOC 0xaa0f0 thru 0xb610d (0xc01d bytes) INTERIOR 2023-07-14T18:17:18.105 INFO:tasks.workunit.client.0.smithi163.stdout:2819( 3 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.105 INFO:tasks.workunit.client.0.smithi163.stdout:2820( 4 mod 256): WRITE 0xbb52f thru 0xc4d68 (0x983a bytes) 2023-07-14T18:17:18.105 INFO:tasks.workunit.client.0.smithi163.stdout:2821( 5 mod 256): FALLOC 0x894ed thru 0x92188 (0x8c9b bytes) INTERIOR 2023-07-14T18:17:18.105 INFO:tasks.workunit.client.0.smithi163.stdout:2822( 6 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.105 INFO:tasks.workunit.client.0.smithi163.stdout:2823( 7 mod 256): COPY 0x6dd7 thru 0xd1fb (0x6425 bytes) to 0x90c34 thru 0x97058 2023-07-14T18:17:18.105 INFO:tasks.workunit.client.0.smithi163.stdout:2824( 8 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.106 INFO:tasks.workunit.client.0.smithi163.stdout:2825( 9 mod 256): MAPWRITE 0x9c2cc thru 0xa7e30 (0xbb65 bytes) 2023-07-14T18:17:18.106 INFO:tasks.workunit.client.0.smithi163.stdout:2826( 10 mod 256): WRITE 0x9a1ad thru 0xa6f5c (0xcdb0 bytes) 2023-07-14T18:17:18.106 INFO:tasks.workunit.client.0.smithi163.stdout:2827( 11 mod 256): FALLOC 0x2de70 thru 0x304a6 (0x2636 bytes) INTERIOR 2023-07-14T18:17:18.106 INFO:tasks.workunit.client.0.smithi163.stdout:2828( 12 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.106 INFO:tasks.workunit.client.0.smithi163.stdout:2829( 13 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.106 INFO:tasks.workunit.client.0.smithi163.stdout:2830( 14 mod 256): MAPREAD 0x1a3cb thru 0x21554 (0x718a bytes) 2023-07-14T18:17:18.106 INFO:tasks.workunit.client.0.smithi163.stdout:2831( 15 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.106 INFO:tasks.workunit.client.0.smithi163.stdout:2832( 16 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.107 INFO:tasks.workunit.client.0.smithi163.stdout:2833( 17 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.107 INFO:tasks.workunit.client.0.smithi163.stdout:2834( 18 mod 256): PUNCH 0xe6c5 thru 0x11442 (0x2d7e bytes) 2023-07-14T18:17:18.107 INFO:tasks.workunit.client.0.smithi163.stdout:2835( 19 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.107 INFO:tasks.workunit.client.0.smithi163.stdout:2836( 20 mod 256): FALLOC 0x9dee2 thru 0xadbbd (0xfcdb bytes) INTERIOR 2023-07-14T18:17:18.107 INFO:tasks.workunit.client.0.smithi163.stdout:2837( 21 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.107 INFO:tasks.workunit.client.0.smithi163.stdout:2838( 22 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.107 INFO:tasks.workunit.client.0.smithi163.stdout:2839( 23 mod 256): MAPREAD 0x89fe5 thru 0x901a6 (0x61c2 bytes) 2023-07-14T18:17:18.107 INFO:tasks.workunit.client.0.smithi163.stdout:2840( 24 mod 256): MAPWRITE 0x92e11 thru 0x9f332 (0xc522 bytes) 2023-07-14T18:17:18.108 INFO:tasks.workunit.client.0.smithi163.stdout:2841( 25 mod 256): PUNCH 0xc02b9 thru 0xcb451 (0xb199 bytes) 2023-07-14T18:17:18.108 INFO:tasks.workunit.client.0.smithi163.stdout:2842( 26 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.108 INFO:tasks.workunit.client.0.smithi163.stdout:2843( 27 mod 256): TRUNCATE DOWN from 0xfbf2f to 0xce23 ******WWWW 2023-07-14T18:17:18.108 INFO:tasks.workunit.client.0.smithi163.stdout:2844( 28 mod 256): COPY 0x6728 thru 0xce22 (0x66fb bytes) to 0x6a331 thru 0x70a2b 2023-07-14T18:17:18.108 INFO:tasks.workunit.client.0.smithi163.stdout:2845( 29 mod 256): READ 0x5cbfe thru 0x6971c (0xcb1f bytes) 2023-07-14T18:17:18.108 INFO:tasks.workunit.client.0.smithi163.stdout:2846( 30 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.108 INFO:tasks.workunit.client.0.smithi163.stdout:2847( 31 mod 256): COPY 0x63a2 thru 0x8757 (0x23b6 bytes) to 0x33ff4 thru 0x363a9 2023-07-14T18:17:18.108 INFO:tasks.workunit.client.0.smithi163.stdout:2848( 32 mod 256): PUNCH 0x45f98 thru 0x4967c (0x36e5 bytes) 2023-07-14T18:17:18.109 INFO:tasks.workunit.client.0.smithi163.stdout:2849( 33 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.109 INFO:tasks.workunit.client.0.smithi163.stdout:2850( 34 mod 256): TRUNCATE DOWN from 0x70a2c to 0x32e6c ******WWWW 2023-07-14T18:17:18.109 INFO:tasks.workunit.client.0.smithi163.stdout:2851( 35 mod 256): COPY 0x2adba thru 0x31503 (0x674a bytes) to 0xa06a4 thru 0xa6ded 2023-07-14T18:17:18.109 INFO:tasks.workunit.client.0.smithi163.stdout:2852( 36 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.109 INFO:tasks.workunit.client.0.smithi163.stdout:2853( 37 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.109 INFO:tasks.workunit.client.0.smithi163.stdout:2854( 38 mod 256): TRUNCATE DOWN from 0xa6dee to 0x403ae 2023-07-14T18:17:18.109 INFO:tasks.workunit.client.0.smithi163.stdout:2855( 39 mod 256): MAPREAD 0xfdb4 thru 0x1c1c4 (0xc411 bytes) 2023-07-14T18:17:18.109 INFO:tasks.workunit.client.0.smithi163.stdout:2856( 40 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.110 INFO:tasks.workunit.client.0.smithi163.stdout:2857( 41 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.110 INFO:tasks.workunit.client.0.smithi163.stdout:2858( 42 mod 256): MAPREAD 0x35c3c thru 0x3f896 (0x9c5b bytes) ***RRRR*** 2023-07-14T18:17:18.110 INFO:tasks.workunit.client.0.smithi163.stdout:2859( 43 mod 256): READ 0x231fa thru 0x31d75 (0xeb7c bytes) 2023-07-14T18:17:18.110 INFO:tasks.workunit.client.0.smithi163.stdout:2860( 44 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.110 INFO:tasks.workunit.client.0.smithi163.stdout:2861( 45 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.110 INFO:tasks.workunit.client.0.smithi163.stdout:2862( 46 mod 256): FALLOC 0x43214 thru 0x48677 (0x5463 bytes) EXTENDING 2023-07-14T18:17:18.110 INFO:tasks.workunit.client.0.smithi163.stdout:2863( 47 mod 256): MAPWRITE 0x4c9ab thru 0x59edb (0xd531 bytes) 2023-07-14T18:17:18.110 INFO:tasks.workunit.client.0.smithi163.stdout:2864( 48 mod 256): COPY 0x342f2 thru 0x42eaf (0xebbe bytes) to 0x91a06 thru 0xa05c3 EEEE****** 2023-07-14T18:17:18.111 INFO:tasks.workunit.client.0.smithi163.stdout:2865( 49 mod 256): MAPREAD 0x6f84f thru 0x78e90 (0x9642 bytes) 2023-07-14T18:17:18.111 INFO:tasks.workunit.client.0.smithi163.stdout:2866( 50 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.111 INFO:tasks.workunit.client.0.smithi163.stdout:2867( 51 mod 256): MAPREAD 0x86b1c thru 0x86ce0 (0x1c5 bytes) 2023-07-14T18:17:18.111 INFO:tasks.workunit.client.0.smithi163.stdout:2868( 52 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.111 INFO:tasks.workunit.client.0.smithi163.stdout:2869( 53 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.111 INFO:tasks.workunit.client.0.smithi163.stdout:2870( 54 mod 256): FALLOC 0x5daad thru 0x664f1 (0x8a44 bytes) INTERIOR 2023-07-14T18:17:18.111 INFO:tasks.workunit.client.0.smithi163.stdout:2871( 55 mod 256): WRITE 0x63821 thru 0x699d5 (0x61b5 bytes) 2023-07-14T18:17:18.111 INFO:tasks.workunit.client.0.smithi163.stdout:2872( 56 mod 256): TRUNCATE UP from 0xa05c4 to 0xad1ac 2023-07-14T18:17:18.112 INFO:tasks.workunit.client.0.smithi163.stdout:2873( 57 mod 256): FALLOC 0x85434 thru 0x9311e (0xdcea bytes) INTERIOR 2023-07-14T18:17:18.112 INFO:tasks.workunit.client.0.smithi163.stdout:2874( 58 mod 256): FALLOC 0x83a1f thru 0x86199 (0x277a bytes) INTERIOR 2023-07-14T18:17:18.112 INFO:tasks.workunit.client.0.smithi163.stdout:2875( 59 mod 256): WRITE 0x90cf2 thru 0x95feb (0x52fa bytes) 2023-07-14T18:17:18.112 INFO:tasks.workunit.client.0.smithi163.stdout:2876( 60 mod 256): MAPWRITE 0x7a44c thru 0x7b1b4 (0xd69 bytes) 2023-07-14T18:17:18.112 INFO:tasks.workunit.client.0.smithi163.stdout:2877( 61 mod 256): TRUNCATE UP from 0xad1ac to 0xd9e47 2023-07-14T18:17:18.112 INFO:tasks.workunit.client.0.smithi163.stdout:2878( 62 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.112 INFO:tasks.workunit.client.0.smithi163.stdout:2879( 63 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.112 INFO:tasks.workunit.client.0.smithi163.stdout:2880( 64 mod 256): MAPWRITE 0x3c220 thru 0x3ccfc (0xadd bytes) 2023-07-14T18:17:18.113 INFO:tasks.workunit.client.0.smithi163.stdout:2881( 65 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.113 INFO:tasks.workunit.client.0.smithi163.stdout:2882( 66 mod 256): FALLOC 0xe627b thru 0xee065 (0x7dea bytes) EXTENDING 2023-07-14T18:17:18.113 INFO:tasks.workunit.client.0.smithi163.stdout:2883( 67 mod 256): MAPREAD 0x1a108 thru 0x27dc6 (0xdcbf bytes) 2023-07-14T18:17:18.113 INFO:tasks.workunit.client.0.smithi163.stdout:2884( 68 mod 256): FALLOC 0xa8c0e thru 0xb4a49 (0xbe3b bytes) INTERIOR 2023-07-14T18:17:18.113 INFO:tasks.workunit.client.0.smithi163.stdout:2885( 69 mod 256): WRITE 0xd72f1 thru 0xd82fa (0x100a bytes) 2023-07-14T18:17:18.113 INFO:tasks.workunit.client.0.smithi163.stdout:2886( 70 mod 256): MAPWRITE 0x53a4 thru 0x584b (0x4a8 bytes) 2023-07-14T18:17:18.113 INFO:tasks.workunit.client.0.smithi163.stdout:2887( 71 mod 256): PUNCH 0x8f055 thru 0x97384 (0x8330 bytes) 2023-07-14T18:17:18.113 INFO:tasks.workunit.client.0.smithi163.stdout:2888( 72 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.114 INFO:tasks.workunit.client.0.smithi163.stdout:2889( 73 mod 256): TRUNCATE DOWN from 0xee065 to 0xd301d 2023-07-14T18:17:18.114 INFO:tasks.workunit.client.0.smithi163.stdout:2890( 74 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.114 INFO:tasks.workunit.client.0.smithi163.stdout:2891( 75 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.114 INFO:tasks.workunit.client.0.smithi163.stdout:2892( 76 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.114 INFO:tasks.workunit.client.0.smithi163.stdout:2893( 77 mod 256): PUNCH 0x53d1a thru 0x58c30 (0x4f17 bytes) 2023-07-14T18:17:18.114 INFO:tasks.workunit.client.0.smithi163.stdout:2894( 78 mod 256): READ 0x1549b thru 0x1c41f (0x6f85 bytes) 2023-07-14T18:17:18.114 INFO:tasks.workunit.client.0.smithi163.stdout:2895( 79 mod 256): WRITE 0x9318a thru 0x9bfdc (0x8e53 bytes) 2023-07-14T18:17:18.114 INFO:tasks.workunit.client.0.smithi163.stdout:2896( 80 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.115 INFO:tasks.workunit.client.0.smithi163.stdout:2897( 81 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.115 INFO:tasks.workunit.client.0.smithi163.stdout:2898( 82 mod 256): READ 0x53abc thru 0x6282b (0xed70 bytes) 2023-07-14T18:17:18.115 INFO:tasks.workunit.client.0.smithi163.stdout:2899( 83 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.115 INFO:tasks.workunit.client.0.smithi163.stdout:2900( 84 mod 256): READ 0x5089e thru 0x5dc55 (0xd3b8 bytes) 2023-07-14T18:17:18.115 INFO:tasks.workunit.client.0.smithi163.stdout:2901( 85 mod 256): PUNCH 0x255ba thru 0x273f1 (0x1e38 bytes) 2023-07-14T18:17:18.115 INFO:tasks.workunit.client.0.smithi163.stdout:2902( 86 mod 256): FALLOC 0x19609 thru 0x1ba00 (0x23f7 bytes) INTERIOR 2023-07-14T18:17:18.115 INFO:tasks.workunit.client.0.smithi163.stdout:2903( 87 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.115 INFO:tasks.workunit.client.0.smithi163.stdout:2904( 88 mod 256): COPY 0x5cdff thru 0x66502 (0x9704 bytes) to 0x9601c thru 0x9f71f 2023-07-14T18:17:18.116 INFO:tasks.workunit.client.0.smithi163.stdout:2905( 89 mod 256): COPY 0xcfe5e thru 0xd301c (0x31bf bytes) to 0x5ed3e thru 0x61efc 2023-07-14T18:17:18.116 INFO:tasks.workunit.client.0.smithi163.stdout:2906( 90 mod 256): MAPREAD 0x823be thru 0x8e4b6 (0xc0f9 bytes) 2023-07-14T18:17:18.116 INFO:tasks.workunit.client.0.smithi163.stdout:2907( 91 mod 256): WRITE 0x8650a thru 0x89993 (0x348a bytes) 2023-07-14T18:17:18.116 INFO:tasks.workunit.client.0.smithi163.stdout:2908( 92 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.116 INFO:tasks.workunit.client.0.smithi163.stdout:2909( 93 mod 256): MAPWRITE 0x818ba thru 0x89130 (0x7877 bytes) 2023-07-14T18:17:18.116 INFO:tasks.workunit.client.0.smithi163.stdout:2910( 94 mod 256): PUNCH 0x62af3 thru 0x6d96c (0xae7a bytes) 2023-07-14T18:17:18.116 INFO:tasks.workunit.client.0.smithi163.stdout:2911( 95 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.116 INFO:tasks.workunit.client.0.smithi163.stdout:2912( 96 mod 256): MAPREAD 0xb6584 thru 0xbfe9e (0x991b bytes) 2023-07-14T18:17:18.117 INFO:tasks.workunit.client.0.smithi163.stdout:2913( 97 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.117 INFO:tasks.workunit.client.0.smithi163.stdout:2914( 98 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.117 INFO:tasks.workunit.client.0.smithi163.stdout:2915( 99 mod 256): FALLOC 0x79bc0 thru 0x7cd99 (0x31d9 bytes) INTERIOR 2023-07-14T18:17:18.117 INFO:tasks.workunit.client.0.smithi163.stdout:2916(100 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.117 INFO:tasks.workunit.client.0.smithi163.stdout:2917(101 mod 256): WRITE 0xd50bc thru 0xdc8f9 (0x783e bytes) HOLE 2023-07-14T18:17:18.117 INFO:tasks.workunit.client.0.smithi163.stdout:2918(102 mod 256): MAPREAD 0xdb84b thru 0xdc8f9 (0x10af bytes) 2023-07-14T18:17:18.117 INFO:tasks.workunit.client.0.smithi163.stdout:2919(103 mod 256): WRITE 0xf3acf thru 0xf3d06 (0x238 bytes) HOLE 2023-07-14T18:17:18.117 INFO:tasks.workunit.client.0.smithi163.stdout:2920(104 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.118 INFO:tasks.workunit.client.0.smithi163.stdout:2921(105 mod 256): COPY 0xa1c2c thru 0xac99d (0xad72 bytes) to 0x375b0 thru 0x42321 ******EEEE 2023-07-14T18:17:18.118 INFO:tasks.workunit.client.0.smithi163.stdout:2922(106 mod 256): MAPWRITE 0xb595d thru 0xc3e10 (0xe4b4 bytes) 2023-07-14T18:17:18.118 INFO:tasks.workunit.client.0.smithi163.stdout:2923(107 mod 256): MAPREAD 0x8745f thru 0x8f798 (0x833a bytes) 2023-07-14T18:17:18.118 INFO:tasks.workunit.client.0.smithi163.stdout:2924(108 mod 256): TRUNCATE DOWN from 0xf3d07 to 0x677d4 2023-07-14T18:17:18.118 INFO:tasks.workunit.client.0.smithi163.stdout:2925(109 mod 256): WRITE 0xc38b2 thru 0xd1092 (0xd7e1 bytes) HOLE 2023-07-14T18:17:18.118 INFO:tasks.workunit.client.0.smithi163.stdout:2926(110 mod 256): READ 0x6fd73 thru 0x78b17 (0x8da5 bytes) 2023-07-14T18:17:18.118 INFO:tasks.workunit.client.0.smithi163.stdout:2927(111 mod 256): MAPWRITE 0x3f28b thru 0x45622 (0x6398 bytes) 2023-07-14T18:17:18.118 INFO:tasks.workunit.client.0.smithi163.stdout:2928(112 mod 256): PUNCH 0x485dc thru 0x48629 (0x4e bytes) 2023-07-14T18:17:18.119 INFO:tasks.workunit.client.0.smithi163.stdout:2929(113 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.119 INFO:tasks.workunit.client.0.smithi163.stdout:2930(114 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.119 INFO:tasks.workunit.client.0.smithi163.stdout:2931(115 mod 256): FALLOC 0x1431 thru 0x5691 (0x4260 bytes) INTERIOR 2023-07-14T18:17:18.119 INFO:tasks.workunit.client.0.smithi163.stdout:2932(116 mod 256): MAPREAD 0x301a4 thru 0x345bd (0x441a bytes) 2023-07-14T18:17:18.119 INFO:tasks.workunit.client.0.smithi163.stdout:2933(117 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.119 INFO:tasks.workunit.client.0.smithi163.stdout:2934(118 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.119 INFO:tasks.workunit.client.0.smithi163.stdout:2935(119 mod 256): FALLOC 0x6671c thru 0x7658b (0xfe6f bytes) INTERIOR 2023-07-14T18:17:18.119 INFO:tasks.workunit.client.0.smithi163.stdout:2936(120 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.120 INFO:tasks.workunit.client.0.smithi163.stdout:2937(121 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.120 INFO:tasks.workunit.client.0.smithi163.stdout:2938(122 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.120 INFO:tasks.workunit.client.0.smithi163.stdout:2939(123 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.120 INFO:tasks.workunit.client.0.smithi163.stdout:2940(124 mod 256): COPY 0xcbb92 thru 0xd1092 (0x5501 bytes) to 0x25849 thru 0x2ad49 2023-07-14T18:17:18.120 INFO:tasks.workunit.client.0.smithi163.stdout:2941(125 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.120 INFO:tasks.workunit.client.0.smithi163.stdout:2942(126 mod 256): FALLOC 0x34e63 thru 0x3af59 (0x60f6 bytes) INTERIOR ******FFFF 2023-07-14T18:17:18.120 INFO:tasks.workunit.client.0.smithi163.stdout:2943(127 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.120 INFO:tasks.workunit.client.0.smithi163.stdout:2944(128 mod 256): READ 0x51ecd thru 0x5d3f3 (0xb527 bytes) 2023-07-14T18:17:18.121 INFO:tasks.workunit.client.0.smithi163.stdout:2945(129 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.121 INFO:tasks.workunit.client.0.smithi163.stdout:2946(130 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.121 INFO:tasks.workunit.client.0.smithi163.stdout:2947(131 mod 256): READ 0x4cd85 thru 0x56090 (0x930c bytes) 2023-07-14T18:17:18.121 INFO:tasks.workunit.client.0.smithi163.stdout:2948(132 mod 256): PUNCH 0x4690d thru 0x544bf (0xdbb3 bytes) 2023-07-14T18:17:18.121 INFO:tasks.workunit.client.0.smithi163.stdout:2949(133 mod 256): WRITE 0x6497d thru 0x70385 (0xba09 bytes) 2023-07-14T18:17:18.121 INFO:tasks.workunit.client.0.smithi163.stdout:2950(134 mod 256): WRITE 0x7d73c thru 0x81d8d (0x4652 bytes) 2023-07-14T18:17:18.121 INFO:tasks.workunit.client.0.smithi163.stdout:2951(135 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.121 INFO:tasks.workunit.client.0.smithi163.stdout:2952(136 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.122 INFO:tasks.workunit.client.0.smithi163.stdout:2953(137 mod 256): FALLOC 0xc83c7 thru 0xd23ee (0xa027 bytes) PAST_EOF 2023-07-14T18:17:18.122 INFO:tasks.workunit.client.0.smithi163.stdout:2954(138 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.122 INFO:tasks.workunit.client.0.smithi163.stdout:2955(139 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.122 INFO:tasks.workunit.client.0.smithi163.stdout:2956(140 mod 256): MAPWRITE 0x381ee thru 0x402ea (0x80fd bytes) ******WWWW 2023-07-14T18:17:18.122 INFO:tasks.workunit.client.0.smithi163.stdout:2957(141 mod 256): FALLOC 0xacfe9 thru 0xb09d5 (0x39ec bytes) INTERIOR 2023-07-14T18:17:18.122 INFO:tasks.workunit.client.0.smithi163.stdout:2958(142 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.122 INFO:tasks.workunit.client.0.smithi163.stdout:2959(143 mod 256): MAPWRITE 0x5d380 thru 0x60abe (0x373f bytes) 2023-07-14T18:17:18.122 INFO:tasks.workunit.client.0.smithi163.stdout:2960(144 mod 256): PUNCH 0x9c2d2 thru 0xac1e0 (0xff0f bytes) 2023-07-14T18:17:18.123 INFO:tasks.workunit.client.0.smithi163.stdout:2961(145 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.123 INFO:tasks.workunit.client.0.smithi163.stdout:2962(146 mod 256): WRITE 0xb86bc thru 0xbfd35 (0x767a bytes) 2023-07-14T18:17:18.123 INFO:tasks.workunit.client.0.smithi163.stdout:2963(147 mod 256): COPY 0xc36fb thru 0xcdd50 (0xa656 bytes) to 0x211b thru 0xc770 2023-07-14T18:17:18.123 INFO:tasks.workunit.client.0.smithi163.stdout:2964(148 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.123 INFO:tasks.workunit.client.0.smithi163.stdout:2965(149 mod 256): TRUNCATE UP from 0xd1093 to 0xf047c 2023-07-14T18:17:18.123 INFO:tasks.workunit.client.0.smithi163.stdout:2966(150 mod 256): PUNCH 0x1fad thru 0xca08 (0xaa5c bytes) 2023-07-14T18:17:18.123 INFO:tasks.workunit.client.0.smithi163.stdout:2967(151 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.123 INFO:tasks.workunit.client.0.smithi163.stdout:2968(152 mod 256): READ 0xc7058 thru 0xd2b78 (0xbb21 bytes) 2023-07-14T18:17:18.124 INFO:tasks.workunit.client.0.smithi163.stdout:2969(153 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.124 INFO:tasks.workunit.client.0.smithi163.stdout:2970(154 mod 256): COPY 0x72726 thru 0x73d07 (0x15e2 bytes) to 0x5403e thru 0x5561f 2023-07-14T18:17:18.124 INFO:tasks.workunit.client.0.smithi163.stdout:2971(155 mod 256): FALLOC 0x496a5 thru 0x55209 (0xbb64 bytes) INTERIOR 2023-07-14T18:17:18.124 INFO:tasks.workunit.client.0.smithi163.stdout:2972(156 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.124 INFO:tasks.workunit.client.0.smithi163.stdout:2973(157 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.124 INFO:tasks.workunit.client.0.smithi163.stdout:2974(158 mod 256): TRUNCATE DOWN from 0xf047c to 0x95e86 2023-07-14T18:17:18.124 INFO:tasks.workunit.client.0.smithi163.stdout:2975(159 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.124 INFO:tasks.workunit.client.0.smithi163.stdout:2976(160 mod 256): READ 0x1e4b thru 0xbce4 (0x9e9a bytes) 2023-07-14T18:17:18.125 INFO:tasks.workunit.client.0.smithi163.stdout:2977(161 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.125 INFO:tasks.workunit.client.0.smithi163.stdout:2978(162 mod 256): PUNCH 0x27ee5 thru 0x2f853 (0x796f bytes) 2023-07-14T18:17:18.125 INFO:tasks.workunit.client.0.smithi163.stdout:2979(163 mod 256): MAPWRITE 0x61ca5 thru 0x627d3 (0xb2f bytes) 2023-07-14T18:17:18.125 INFO:tasks.workunit.client.0.smithi163.stdout:2980(164 mod 256): FALLOC 0x6721d thru 0x6e774 (0x7557 bytes) INTERIOR 2023-07-14T18:17:18.125 INFO:tasks.workunit.client.0.smithi163.stdout:2981(165 mod 256): PUNCH 0x17b27 thru 0x1eb8c (0x7066 bytes) 2023-07-14T18:17:18.125 INFO:tasks.workunit.client.0.smithi163.stdout:2982(166 mod 256): MAPREAD 0x5f405 thru 0x6a6de (0xb2da bytes) 2023-07-14T18:17:18.125 INFO:tasks.workunit.client.0.smithi163.stdout:2983(167 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.125 INFO:tasks.workunit.client.0.smithi163.stdout:2984(168 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.126 INFO:tasks.workunit.client.0.smithi163.stdout:2985(169 mod 256): MAPWRITE 0x2b802 thru 0x30e38 (0x5637 bytes) 2023-07-14T18:17:18.126 INFO:tasks.workunit.client.0.smithi163.stdout:2986(170 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.126 INFO:tasks.workunit.client.0.smithi163.stdout:2987(171 mod 256): PUNCH 0x77550 thru 0x84cb6 (0xd767 bytes) 2023-07-14T18:17:18.126 INFO:tasks.workunit.client.0.smithi163.stdout:2988(172 mod 256): PUNCH 0x4e5cb thru 0x4f196 (0xbcc bytes) 2023-07-14T18:17:18.126 INFO:tasks.workunit.client.0.smithi163.stdout:2989(173 mod 256): FALLOC 0xb5a6 thru 0xfa2e (0x4488 bytes) INTERIOR 2023-07-14T18:17:18.126 INFO:tasks.workunit.client.0.smithi163.stdout:2990(174 mod 256): WRITE 0x411e thru 0x85aa (0x448d bytes) 2023-07-14T18:17:18.126 INFO:tasks.workunit.client.0.smithi163.stdout:2991(175 mod 256): FALLOC 0x1afaa thru 0x2018e (0x51e4 bytes) INTERIOR 2023-07-14T18:17:18.127 INFO:tasks.workunit.client.0.smithi163.stdout:2992(176 mod 256): PUNCH 0x902e3 thru 0x95e85 (0x5ba3 bytes) 2023-07-14T18:17:18.127 INFO:tasks.workunit.client.0.smithi163.stdout:2993(177 mod 256): MAPWRITE 0x6d0e3 thru 0x7850b (0xb429 bytes) 2023-07-14T18:17:18.127 INFO:tasks.workunit.client.0.smithi163.stdout:2994(178 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.127 INFO:tasks.workunit.client.0.smithi163.stdout:2995(179 mod 256): MAPWRITE 0xc7e76 thru 0xd6e58 (0xefe3 bytes) 2023-07-14T18:17:18.127 INFO:tasks.workunit.client.0.smithi163.stdout:2996(180 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.127 INFO:tasks.workunit.client.0.smithi163.stdout:2997(181 mod 256): READ 0x547d9 thru 0x5e4c9 (0x9cf1 bytes) 2023-07-14T18:17:18.127 INFO:tasks.workunit.client.0.smithi163.stdout:2998(182 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.127 INFO:tasks.workunit.client.0.smithi163.stdout:2999(183 mod 256): TRUNCATE DOWN from 0xd6e59 to 0x5121e 2023-07-14T18:17:18.127 INFO:tasks.workunit.client.0.smithi163.stdout:3000(184 mod 256): FALLOC 0xa10fa thru 0xac8ab (0xb7b1 bytes) EXTENDING 2023-07-14T18:17:18.128 INFO:tasks.workunit.client.0.smithi163.stdout:3001(185 mod 256): WRITE 0xc90b0 thru 0xd441f (0xb370 bytes) HOLE 2023-07-14T18:17:18.128 INFO:tasks.workunit.client.0.smithi163.stdout:3002(186 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.128 INFO:tasks.workunit.client.0.smithi163.stdout:3003(187 mod 256): MAPREAD 0x8f2ce thru 0x94df9 (0x5b2c bytes) 2023-07-14T18:17:18.128 INFO:tasks.workunit.client.0.smithi163.stdout:3004(188 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.128 INFO:tasks.workunit.client.0.smithi163.stdout:3005(189 mod 256): FALLOC 0xe78e5 thru 0xeb088 (0x37a3 bytes) PAST_EOF 2023-07-14T18:17:18.128 INFO:tasks.workunit.client.0.smithi163.stdout:3006(190 mod 256): PUNCH 0x535c9 thru 0x5c10d (0x8b45 bytes) 2023-07-14T18:17:18.128 INFO:tasks.workunit.client.0.smithi163.stdout:3007(191 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.129 INFO:tasks.workunit.client.0.smithi163.stdout:3008(192 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.129 INFO:tasks.workunit.client.0.smithi163.stdout:3009(193 mod 256): READ 0x95434 thru 0x9c25c (0x6e29 bytes) 2023-07-14T18:17:18.129 INFO:tasks.workunit.client.0.smithi163.stdout:3010(194 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.129 INFO:tasks.workunit.client.0.smithi163.stdout:3011(195 mod 256): COPY 0x75720 thru 0x7d927 (0x8208 bytes) to 0x364be thru 0x3e6c5 ******EEEE 2023-07-14T18:17:18.129 INFO:tasks.workunit.client.0.smithi163.stdout:3012(196 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.129 INFO:tasks.workunit.client.0.smithi163.stdout:3013(197 mod 256): COPY 0x5c892 thru 0x5ff09 (0x3678 bytes) to 0x80074 thru 0x836eb 2023-07-14T18:17:18.129 INFO:tasks.workunit.client.0.smithi163.stdout:3014(198 mod 256): READ 0x6a44 thru 0xa001 (0x35be bytes) 2023-07-14T18:17:18.129 INFO:tasks.workunit.client.0.smithi163.stdout:3015(199 mod 256): TRUNCATE DOWN from 0xd4420 to 0xd12af 2023-07-14T18:17:18.130 INFO:tasks.workunit.client.0.smithi163.stdout:3016(200 mod 256): MAPREAD 0x24b68 thru 0x29fe9 (0x5482 bytes) 2023-07-14T18:17:18.130 INFO:tasks.workunit.client.0.smithi163.stdout:3017(201 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.130 INFO:tasks.workunit.client.0.smithi163.stdout:3018(202 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.130 INFO:tasks.workunit.client.0.smithi163.stdout:3019(203 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.130 INFO:tasks.workunit.client.0.smithi163.stdout:3020(204 mod 256): READ 0x46542 thru 0x4a21c (0x3cdb bytes) 2023-07-14T18:17:18.130 INFO:tasks.workunit.client.0.smithi163.stdout:3021(205 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.130 INFO:tasks.workunit.client.0.smithi163.stdout:3022(206 mod 256): FALLOC 0xba998 thru 0xc113f (0x67a7 bytes) INTERIOR 2023-07-14T18:17:18.130 INFO:tasks.workunit.client.0.smithi163.stdout:3023(207 mod 256): MAPWRITE 0x99ad9 thru 0x9e30a (0x4832 bytes) 2023-07-14T18:17:18.131 INFO:tasks.workunit.client.0.smithi163.stdout:3024(208 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.131 INFO:tasks.workunit.client.0.smithi163.stdout:3025(209 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.131 INFO:tasks.workunit.client.0.smithi163.stdout:3026(210 mod 256): FALLOC 0x9b781 thru 0x9cd72 (0x15f1 bytes) INTERIOR 2023-07-14T18:17:18.131 INFO:tasks.workunit.client.0.smithi163.stdout:3027(211 mod 256): MAPWRITE 0xc85f9 thru 0xd3ae0 (0xb4e8 bytes) 2023-07-14T18:17:18.131 INFO:tasks.workunit.client.0.smithi163.stdout:3028(212 mod 256): TRUNCATE DOWN from 0xd3ae1 to 0x9f1fe 2023-07-14T18:17:18.131 INFO:tasks.workunit.client.0.smithi163.stdout:3029(213 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.131 INFO:tasks.workunit.client.0.smithi163.stdout:3030(214 mod 256): FALLOC 0x228cc thru 0x26ca3 (0x43d7 bytes) INTERIOR 2023-07-14T18:17:18.131 INFO:tasks.workunit.client.0.smithi163.stdout:3031(215 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.131 INFO:tasks.workunit.client.0.smithi163.stdout:3032(216 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.132 INFO:tasks.workunit.client.0.smithi163.stdout:3033(217 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.132 INFO:tasks.workunit.client.0.smithi163.stdout:3034(218 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.132 INFO:tasks.workunit.client.0.smithi163.stdout:3035(219 mod 256): FALLOC 0xba486 thru 0xc9fcd (0xfb47 bytes) EXTENDING 2023-07-14T18:17:18.132 INFO:tasks.workunit.client.0.smithi163.stdout:3036(220 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.132 INFO:tasks.workunit.client.0.smithi163.stdout:3037(221 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.132 INFO:tasks.workunit.client.0.smithi163.stdout:3038(222 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.132 INFO:tasks.workunit.client.0.smithi163.stdout:3039(223 mod 256): FALLOC 0xc0c55 thru 0xc3cb5 (0x3060 bytes) INTERIOR 2023-07-14T18:17:18.133 INFO:tasks.workunit.client.0.smithi163.stdout:3040(224 mod 256): MAPWRITE 0xe2cf3 thru 0xeae0f (0x811d bytes) 2023-07-14T18:17:18.133 INFO:tasks.workunit.client.0.smithi163.stdout:3041(225 mod 256): READ 0x7e4d7 thru 0x89a8b (0xb5b5 bytes) 2023-07-14T18:17:18.133 INFO:tasks.workunit.client.0.smithi163.stdout:3042(226 mod 256): COPY 0x4028e thru 0x48322 (0x8095 bytes) to 0x8043e thru 0x884d2 2023-07-14T18:17:18.133 INFO:tasks.workunit.client.0.smithi163.stdout:3043(227 mod 256): MAPWRITE 0x7463d thru 0x8154d (0xcf11 bytes) 2023-07-14T18:17:18.133 INFO:tasks.workunit.client.0.smithi163.stdout:3044(228 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.133 INFO:tasks.workunit.client.0.smithi163.stdout:3045(229 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.133 INFO:tasks.workunit.client.0.smithi163.stdout:3046(230 mod 256): MAPWRITE 0xdcac2 thru 0xea630 (0xdb6f bytes) 2023-07-14T18:17:18.133 INFO:tasks.workunit.client.0.smithi163.stdout:3047(231 mod 256): MAPREAD 0x1cc86 thru 0x2142e (0x47a9 bytes) 2023-07-14T18:17:18.134 INFO:tasks.workunit.client.0.smithi163.stdout:3048(232 mod 256): PUNCH 0xa9ef7 thru 0xb175c (0x7866 bytes) 2023-07-14T18:17:18.134 INFO:tasks.workunit.client.0.smithi163.stdout:3049(233 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.134 INFO:tasks.workunit.client.0.smithi163.stdout:3050(234 mod 256): COPY 0x29777 thru 0x2dba8 (0x4432 bytes) to 0x4b425 thru 0x4f856 2023-07-14T18:17:18.134 INFO:tasks.workunit.client.0.smithi163.stdout:3051(235 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.134 INFO:tasks.workunit.client.0.smithi163.stdout:3052(236 mod 256): COPY 0xa8a8a thru 0xb3808 (0xad7f bytes) to 0x45cd3 thru 0x50a51 2023-07-14T18:17:18.134 INFO:tasks.workunit.client.0.smithi163.stdout:3053(237 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.134 INFO:tasks.workunit.client.0.smithi163.stdout:3054(238 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.134 INFO:tasks.workunit.client.0.smithi163.stdout:3055(239 mod 256): FALLOC 0x8e114 thru 0x9bdc4 (0xdcb0 bytes) INTERIOR 2023-07-14T18:17:18.135 INFO:tasks.workunit.client.0.smithi163.stdout:3056(240 mod 256): TRUNCATE DOWN from 0xeae10 to 0x66185 2023-07-14T18:17:18.135 INFO:tasks.workunit.client.0.smithi163.stdout:3057(241 mod 256): MAPWRITE 0xe6e8e thru 0xecb24 (0x5c97 bytes) 2023-07-14T18:17:18.135 INFO:tasks.workunit.client.0.smithi163.stdout:3058(242 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.135 INFO:tasks.workunit.client.0.smithi163.stdout:3059(243 mod 256): MAPWRITE 0x21742 thru 0x23eb2 (0x2771 bytes) 2023-07-14T18:17:18.135 INFO:tasks.workunit.client.0.smithi163.stdout:3060(244 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.135 INFO:tasks.workunit.client.0.smithi163.stdout:3061(245 mod 256): READ 0x7c9a3 thru 0x8aa22 (0xe080 bytes) 2023-07-14T18:17:18.135 INFO:tasks.workunit.client.0.smithi163.stdout:3062(246 mod 256): COPY 0x8b57c thru 0x8db08 (0x258d bytes) to 0xa5b57 thru 0xa80e3 2023-07-14T18:17:18.135 INFO:tasks.workunit.client.0.smithi163.stdout:3063(247 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.135 INFO:tasks.workunit.client.0.smithi163.stdout:3064(248 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.136 INFO:tasks.workunit.client.0.smithi163.stdout:3065(249 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.136 INFO:tasks.workunit.client.0.smithi163.stdout:3066(250 mod 256): COPY 0x85581 thru 0x8db50 (0x85d0 bytes) to 0x2a3f5 thru 0x329c4 2023-07-14T18:17:18.136 INFO:tasks.workunit.client.0.smithi163.stdout:3067(251 mod 256): MAPREAD 0xe227c thru 0xeb298 (0x901d bytes) 2023-07-14T18:17:18.136 INFO:tasks.workunit.client.0.smithi163.stdout:3068(252 mod 256): MAPWRITE 0xab9e8 thru 0xb1b92 (0x61ab bytes) 2023-07-14T18:17:18.136 INFO:tasks.workunit.client.0.smithi163.stdout:3069(253 mod 256): PUNCH 0x222c8 thru 0x31d32 (0xfa6b bytes) 2023-07-14T18:17:18.136 INFO:tasks.workunit.client.0.smithi163.stdout:3070(254 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.136 INFO:tasks.workunit.client.0.smithi163.stdout:3071(255 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.137 INFO:tasks.workunit.client.0.smithi163.stdout:3072( 0 mod 256): READ 0x7a0aa thru 0x83f9e (0x9ef5 bytes) 2023-07-14T18:17:18.137 INFO:tasks.workunit.client.0.smithi163.stdout:3073( 1 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.137 INFO:tasks.workunit.client.0.smithi163.stdout:3074( 2 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.137 INFO:tasks.workunit.client.0.smithi163.stdout:3075( 3 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.137 INFO:tasks.workunit.client.0.smithi163.stdout:3076( 4 mod 256): READ 0x53e6 thru 0xdfd5 (0x8bf0 bytes) 2023-07-14T18:17:18.137 INFO:tasks.workunit.client.0.smithi163.stdout:3077( 5 mod 256): PUNCH 0x4dba6 thru 0x5636f (0x87ca bytes) 2023-07-14T18:17:18.137 INFO:tasks.workunit.client.0.smithi163.stdout:3078( 6 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.137 INFO:tasks.workunit.client.0.smithi163.stdout:3079( 7 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.138 INFO:tasks.workunit.client.0.smithi163.stdout:3080( 8 mod 256): FALLOC 0x7eb25 thru 0x8dd93 (0xf26e bytes) INTERIOR 2023-07-14T18:17:18.138 INFO:tasks.workunit.client.0.smithi163.stdout:3081( 9 mod 256): READ 0x1e7ee thru 0x2046c (0x1c7f bytes) 2023-07-14T18:17:18.138 INFO:tasks.workunit.client.0.smithi163.stdout:3082( 10 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.138 INFO:tasks.workunit.client.0.smithi163.stdout:3083( 11 mod 256): READ 0xc9e1b thru 0xcd6cf (0x38b5 bytes) 2023-07-14T18:17:18.138 INFO:tasks.workunit.client.0.smithi163.stdout:3084( 12 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.138 INFO:tasks.workunit.client.0.smithi163.stdout:3085( 13 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.138 INFO:tasks.workunit.client.0.smithi163.stdout:3086( 14 mod 256): PUNCH 0x6dda8 thru 0x77772 (0x99cb bytes) 2023-07-14T18:17:18.138 INFO:tasks.workunit.client.0.smithi163.stdout:3087( 15 mod 256): COPY 0x1c5ce thru 0x2a846 (0xe279 bytes) to 0x58b94 thru 0x66e0c 2023-07-14T18:17:18.139 INFO:tasks.workunit.client.0.smithi163.stdout:3088( 16 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.139 INFO:tasks.workunit.client.0.smithi163.stdout:3089( 17 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.139 INFO:tasks.workunit.client.0.smithi163.stdout:3090( 18 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.139 INFO:tasks.workunit.client.0.smithi163.stdout:3091( 19 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.139 INFO:tasks.workunit.client.0.smithi163.stdout:3092( 20 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.139 INFO:tasks.workunit.client.0.smithi163.stdout:3093( 21 mod 256): MAPWRITE 0x67a8 thru 0xc995 (0x61ee bytes) 2023-07-14T18:17:18.139 INFO:tasks.workunit.client.0.smithi163.stdout:3094( 22 mod 256): WRITE 0x7878c thru 0x8533e (0xcbb3 bytes) 2023-07-14T18:17:18.139 INFO:tasks.workunit.client.0.smithi163.stdout:3095( 23 mod 256): PUNCH 0x74383 thru 0x830f4 (0xed72 bytes) 2023-07-14T18:17:18.140 INFO:tasks.workunit.client.0.smithi163.stdout:3096( 24 mod 256): FALLOC 0x33e58 thru 0x41a33 (0xdbdb bytes) INTERIOR ******FFFF 2023-07-14T18:17:18.140 INFO:tasks.workunit.client.0.smithi163.stdout:3097( 25 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.140 INFO:tasks.workunit.client.0.smithi163.stdout:3098( 26 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.140 INFO:tasks.workunit.client.0.smithi163.stdout:3099( 27 mod 256): COPY 0x4aa95 thru 0x4b34c (0x8b8 bytes) to 0x62f11 thru 0x637c8 2023-07-14T18:17:18.140 INFO:tasks.workunit.client.0.smithi163.stdout:3100( 28 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.140 INFO:tasks.workunit.client.0.smithi163.stdout:3101( 29 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.140 INFO:tasks.workunit.client.0.smithi163.stdout:3102( 30 mod 256): PUNCH 0xdd8da thru 0xde8c2 (0xfe9 bytes) 2023-07-14T18:17:18.140 INFO:tasks.workunit.client.0.smithi163.stdout:3103( 31 mod 256): MAPWRITE 0xe6d87 thru 0xef99d (0x8c17 bytes) 2023-07-14T18:17:18.141 INFO:tasks.workunit.client.0.smithi163.stdout:3104( 32 mod 256): READ 0x5ebef thru 0x6d979 (0xed8b bytes) 2023-07-14T18:17:18.141 INFO:tasks.workunit.client.0.smithi163.stdout:3105( 33 mod 256): READ 0x6176d thru 0x680e6 (0x697a bytes) 2023-07-14T18:17:18.141 INFO:tasks.workunit.client.0.smithi163.stdout:3106( 34 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.141 INFO:tasks.workunit.client.0.smithi163.stdout:3107( 35 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.141 INFO:tasks.workunit.client.0.smithi163.stdout:3108( 36 mod 256): MAPWRITE 0xb23c9 thru 0xbb02e (0x8c66 bytes) 2023-07-14T18:17:18.141 INFO:tasks.workunit.client.0.smithi163.stdout:3109( 37 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.141 INFO:tasks.workunit.client.0.smithi163.stdout:3110( 38 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.141 INFO:tasks.workunit.client.0.smithi163.stdout:3111( 39 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.142 INFO:tasks.workunit.client.0.smithi163.stdout:3112( 40 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.142 INFO:tasks.workunit.client.0.smithi163.stdout:3113( 41 mod 256): COPY 0x4a252 thru 0x58ac4 (0xe873 bytes) to 0x6a96f thru 0x791e1 2023-07-14T18:17:18.142 INFO:tasks.workunit.client.0.smithi163.stdout:3114( 42 mod 256): COPY 0xc2264 thru 0xcc7a1 (0xa53e bytes) to 0x172fe thru 0x2183b 2023-07-14T18:17:18.142 INFO:tasks.workunit.client.0.smithi163.stdout:3115( 43 mod 256): COPY 0xc9e77 thru 0xd0b22 (0x6cac bytes) to 0x598d7 thru 0x60582 2023-07-14T18:17:18.142 INFO:tasks.workunit.client.0.smithi163.stdout:3116( 44 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.142 INFO:tasks.workunit.client.0.smithi163.stdout:3117( 45 mod 256): READ 0x39b05 thru 0x4694e (0xce4a bytes) 2023-07-14T18:17:18.142 INFO:tasks.workunit.client.0.smithi163.stdout:3118( 46 mod 256): READ 0x200a9 thru 0x25878 (0x57d0 bytes) 2023-07-14T18:17:18.142 INFO:tasks.workunit.client.0.smithi163.stdout:3119( 47 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.143 INFO:tasks.workunit.client.0.smithi163.stdout:3120( 48 mod 256): READ 0x7922d thru 0x7b4b1 (0x2285 bytes) 2023-07-14T18:17:18.143 INFO:tasks.workunit.client.0.smithi163.stdout:3121( 49 mod 256): PUNCH 0xe0fd1 thru 0xe24f4 (0x1524 bytes) 2023-07-14T18:17:18.143 INFO:tasks.workunit.client.0.smithi163.stdout:3122( 50 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.143 INFO:tasks.workunit.client.0.smithi163.stdout:3123( 51 mod 256): WRITE 0x49066 thru 0x575e7 (0xe582 bytes) 2023-07-14T18:17:18.143 INFO:tasks.workunit.client.0.smithi163.stdout:3124( 52 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.143 INFO:tasks.workunit.client.0.smithi163.stdout:3125( 53 mod 256): WRITE 0x4f641 thru 0x55f22 (0x68e2 bytes) 2023-07-14T18:17:18.143 INFO:tasks.workunit.client.0.smithi163.stdout:3126( 54 mod 256): READ 0x38d47 thru 0x3ad98 (0x2052 bytes) 2023-07-14T18:17:18.143 INFO:tasks.workunit.client.0.smithi163.stdout:3127( 55 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.144 INFO:tasks.workunit.client.0.smithi163.stdout:3128( 56 mod 256): WRITE 0xb5813 thru 0xb99e3 (0x41d1 bytes) 2023-07-14T18:17:18.144 INFO:tasks.workunit.client.0.smithi163.stdout:3129( 57 mod 256): MAPWRITE 0xf5701 thru 0xfb6e9 (0x5fe9 bytes) 2023-07-14T18:17:18.144 INFO:tasks.workunit.client.0.smithi163.stdout:3130( 58 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.144 INFO:tasks.workunit.client.0.smithi163.stdout:3131( 59 mod 256): WRITE 0x34c55 thru 0x40117 (0xb4c3 bytes) ***WWWW 2023-07-14T18:17:18.144 INFO:tasks.workunit.client.0.smithi163.stdout:3132( 60 mod 256): READ 0x789a0 thru 0x798af (0xf10 bytes) 2023-07-14T18:17:18.144 INFO:tasks.workunit.client.0.smithi163.stdout:3133( 61 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.144 INFO:tasks.workunit.client.0.smithi163.stdout:3134( 62 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.144 INFO:tasks.workunit.client.0.smithi163.stdout:3135( 63 mod 256): TRUNCATE DOWN from 0xfb6ea to 0x5a6ca 2023-07-14T18:17:18.145 INFO:tasks.workunit.client.0.smithi163.stdout:3136( 64 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.145 INFO:tasks.workunit.client.0.smithi163.stdout:3137( 65 mod 256): COPY 0x2024e thru 0x24d3d (0x4af0 bytes) to 0xbbd91 thru 0xc0880 2023-07-14T18:17:18.145 INFO:tasks.workunit.client.0.smithi163.stdout:3138( 66 mod 256): MAPWRITE 0x8f739 thru 0x9c6fe (0xcfc6 bytes) 2023-07-14T18:17:18.145 INFO:tasks.workunit.client.0.smithi163.stdout:3139( 67 mod 256): WRITE 0x2468e thru 0x253fa (0xd6d bytes) 2023-07-14T18:17:18.145 INFO:tasks.workunit.client.0.smithi163.stdout:3140( 68 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.145 INFO:tasks.workunit.client.0.smithi163.stdout:3141( 69 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.145 INFO:tasks.workunit.client.0.smithi163.stdout:3142( 70 mod 256): TRUNCATE DOWN from 0xc0881 to 0x1b091 ******WWWW 2023-07-14T18:17:18.145 INFO:tasks.workunit.client.0.smithi163.stdout:3143( 71 mod 256): TRUNCATE UP from 0x1b091 to 0xbd3ff ******WWWW 2023-07-14T18:17:18.146 INFO:tasks.workunit.client.0.smithi163.stdout:3144( 72 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.146 INFO:tasks.workunit.client.0.smithi163.stdout:3145( 73 mod 256): PUNCH 0x16f8e thru 0x1f62d (0x86a0 bytes) 2023-07-14T18:17:18.146 INFO:tasks.workunit.client.0.smithi163.stdout:3146( 74 mod 256): READ 0x7e95b thru 0x86fbb (0x8661 bytes) 2023-07-14T18:17:18.146 INFO:tasks.workunit.client.0.smithi163.stdout:3147( 75 mod 256): COPY 0x27d1c thru 0x330d4 (0xb3b9 bytes) to 0xb516b thru 0xc0523 2023-07-14T18:17:18.146 INFO:tasks.workunit.client.0.smithi163.stdout:3148( 76 mod 256): MAPREAD 0xbc2d0 thru 0xbee5b (0x2b8c bytes) 2023-07-14T18:17:18.146 INFO:tasks.workunit.client.0.smithi163.stdout:3149( 77 mod 256): WRITE 0x6f707 thru 0x7e2cd (0xebc7 bytes) 2023-07-14T18:17:18.146 INFO:tasks.workunit.client.0.smithi163.stdout:3150( 78 mod 256): READ 0xbeec2 thru 0xc0523 (0x1662 bytes) 2023-07-14T18:17:18.146 INFO:tasks.workunit.client.0.smithi163.stdout:3151( 79 mod 256): PUNCH 0xb2b1b thru 0xb8085 (0x556b bytes) 2023-07-14T18:17:18.147 INFO:tasks.workunit.client.0.smithi163.stdout:3152( 80 mod 256): PUNCH 0x950ee thru 0x9c025 (0x6f38 bytes) 2023-07-14T18:17:18.147 INFO:tasks.workunit.client.0.smithi163.stdout:3153( 81 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.147 INFO:tasks.workunit.client.0.smithi163.stdout:3154( 82 mod 256): WRITE 0xe1f21 thru 0xe8655 (0x6735 bytes) HOLE 2023-07-14T18:17:18.147 INFO:tasks.workunit.client.0.smithi163.stdout:3155( 83 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.147 INFO:tasks.workunit.client.0.smithi163.stdout:3156( 84 mod 256): MAPREAD 0xe7ae0 thru 0xe8655 (0xb76 bytes) 2023-07-14T18:17:18.147 INFO:tasks.workunit.client.0.smithi163.stdout:3157( 85 mod 256): MAPWRITE 0x1e9a9 thru 0x2dfdf (0xf637 bytes) 2023-07-14T18:17:18.147 INFO:tasks.workunit.client.0.smithi163.stdout:3158( 86 mod 256): READ 0x7f51e thru 0x8b5d8 (0xc0bb bytes) 2023-07-14T18:17:18.147 INFO:tasks.workunit.client.0.smithi163.stdout:3159( 87 mod 256): TRUNCATE DOWN from 0xe8656 to 0x16c57 ******WWWW 2023-07-14T18:17:18.148 INFO:tasks.workunit.client.0.smithi163.stdout:3160( 88 mod 256): WRITE 0xc86b6 thru 0xd3a1d (0xb368 bytes) HOLE ***WWWW 2023-07-14T18:17:18.148 INFO:tasks.workunit.client.0.smithi163.stdout:3161( 89 mod 256): MAPREAD 0x716a2 thru 0x75e5a (0x47b9 bytes) 2023-07-14T18:17:18.148 INFO:tasks.workunit.client.0.smithi163.stdout:3162( 90 mod 256): TRUNCATE DOWN from 0xd3a1e to 0xc77b ******WWWW 2023-07-14T18:17:18.148 INFO:tasks.workunit.client.0.smithi163.stdout:3163( 91 mod 256): COPY 0x413 thru 0x852 (0x440 bytes) to 0x7840 thru 0x7c7f 2023-07-14T18:17:18.148 INFO:tasks.workunit.client.0.smithi163.stdout:3164( 92 mod 256): READ 0x8863 thru 0xc77a (0x3f18 bytes) 2023-07-14T18:17:18.148 INFO:tasks.workunit.client.0.smithi163.stdout:3165( 93 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.148 INFO:tasks.workunit.client.0.smithi163.stdout:3166( 94 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.148 INFO:tasks.workunit.client.0.smithi163.stdout:3167( 95 mod 256): PUNCH 0xa487 thru 0xc77a (0x22f4 bytes) 2023-07-14T18:17:18.149 INFO:tasks.workunit.client.0.smithi163.stdout:3168( 96 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.149 INFO:tasks.workunit.client.0.smithi163.stdout:3169( 97 mod 256): READ 0x5283 thru 0xc77a (0x74f8 bytes) 2023-07-14T18:17:18.149 INFO:tasks.workunit.client.0.smithi163.stdout:3170( 98 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.149 INFO:tasks.workunit.client.0.smithi163.stdout:3171( 99 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.149 INFO:tasks.workunit.client.0.smithi163.stdout:3172(100 mod 256): PUNCH 0x5ef4 thru 0x9da6 (0x3eb3 bytes) 2023-07-14T18:17:18.149 INFO:tasks.workunit.client.0.smithi163.stdout:3173(101 mod 256): TRUNCATE UP from 0xc77b to 0xa193e ******WWWW 2023-07-14T18:17:18.149 INFO:tasks.workunit.client.0.smithi163.stdout:3174(102 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.149 INFO:tasks.workunit.client.0.smithi163.stdout:3175(103 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.150 INFO:tasks.workunit.client.0.smithi163.stdout:3176(104 mod 256): COPY 0x69ce3 thru 0x79019 (0xf337 bytes) to 0xe4aa0 thru 0xf3dd6 2023-07-14T18:17:18.150 INFO:tasks.workunit.client.0.smithi163.stdout:3177(105 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.150 INFO:tasks.workunit.client.0.smithi163.stdout:3178(106 mod 256): FALLOC 0x86057 thru 0x8decb (0x7e74 bytes) INTERIOR 2023-07-14T18:17:18.150 INFO:tasks.workunit.client.0.smithi163.stdout:3179(107 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.150 INFO:tasks.workunit.client.0.smithi163.stdout:3180(108 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.150 INFO:tasks.workunit.client.0.smithi163.stdout:3181(109 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.150 INFO:tasks.workunit.client.0.smithi163.stdout:3182(110 mod 256): WRITE 0xfbad5 thru 0xfffff (0x452b bytes) HOLE 2023-07-14T18:17:18.150 INFO:tasks.workunit.client.0.smithi163.stdout:3183(111 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.151 INFO:tasks.workunit.client.0.smithi163.stdout:3184(112 mod 256): PUNCH 0x14240 thru 0x1db42 (0x9903 bytes) 2023-07-14T18:17:18.151 INFO:tasks.workunit.client.0.smithi163.stdout:3185(113 mod 256): READ 0xa7327 thru 0xb21a0 (0xae7a bytes) 2023-07-14T18:17:18.151 INFO:tasks.workunit.client.0.smithi163.stdout:3186(114 mod 256): TRUNCATE DOWN from 0x100000 to 0xb6f6f 2023-07-14T18:17:18.151 INFO:tasks.workunit.client.0.smithi163.stdout:3187(115 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.151 INFO:tasks.workunit.client.0.smithi163.stdout:3188(116 mod 256): WRITE 0xb0b72 thru 0xc0994 (0xfe23 bytes) EXTEND 2023-07-14T18:17:18.151 INFO:tasks.workunit.client.0.smithi163.stdout:3189(117 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.151 INFO:tasks.workunit.client.0.smithi163.stdout:3190(118 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.151 INFO:tasks.workunit.client.0.smithi163.stdout:3191(119 mod 256): READ 0x25697 thru 0x315fc (0xbf66 bytes) 2023-07-14T18:17:18.152 INFO:tasks.workunit.client.0.smithi163.stdout:3192(120 mod 256): READ 0x6fc3 thru 0x9778 (0x27b6 bytes) 2023-07-14T18:17:18.152 INFO:tasks.workunit.client.0.smithi163.stdout:3193(121 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.152 INFO:tasks.workunit.client.0.smithi163.stdout:3194(122 mod 256): TRUNCATE DOWN from 0xc0995 to 0x8b5dc 2023-07-14T18:17:18.152 INFO:tasks.workunit.client.0.smithi163.stdout:3195(123 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.152 INFO:tasks.workunit.client.0.smithi163.stdout:3196(124 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.152 INFO:tasks.workunit.client.0.smithi163.stdout:3197(125 mod 256): PUNCH 0x6d227 thru 0x6d44d (0x227 bytes) 2023-07-14T18:17:18.152 INFO:tasks.workunit.client.0.smithi163.stdout:3198(126 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.152 INFO:tasks.workunit.client.0.smithi163.stdout:3199(127 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.153 INFO:tasks.workunit.client.0.smithi163.stdout:3200(128 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.153 INFO:tasks.workunit.client.0.smithi163.stdout:3201(129 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.153 INFO:tasks.workunit.client.0.smithi163.stdout:3202(130 mod 256): MAPREAD 0x14207 thru 0x175db (0x33d5 bytes) 2023-07-14T18:17:18.153 INFO:tasks.workunit.client.0.smithi163.stdout:3203(131 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.153 INFO:tasks.workunit.client.0.smithi163.stdout:3204(132 mod 256): WRITE 0xcb1ef thru 0xd9eec (0xecfe bytes) HOLE 2023-07-14T18:17:18.153 INFO:tasks.workunit.client.0.smithi163.stdout:3205(133 mod 256): COPY 0xa2db1 thru 0xb2868 (0xfab8 bytes) to 0x40bf4 thru 0x506ab 2023-07-14T18:17:18.153 INFO:tasks.workunit.client.0.smithi163.stdout:3206(134 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.153 INFO:tasks.workunit.client.0.smithi163.stdout:3207(135 mod 256): PUNCH 0x89f70 thru 0x8e61e (0x46af bytes) 2023-07-14T18:17:18.154 INFO:tasks.workunit.client.0.smithi163.stdout:3208(136 mod 256): MAPWRITE 0x528c8 thru 0x56b6f (0x42a8 bytes) 2023-07-14T18:17:18.154 INFO:tasks.workunit.client.0.smithi163.stdout:3209(137 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.154 INFO:tasks.workunit.client.0.smithi163.stdout:3210(138 mod 256): WRITE 0x8103b thru 0x8306b (0x2031 bytes) 2023-07-14T18:17:18.154 INFO:tasks.workunit.client.0.smithi163.stdout:3211(139 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.154 INFO:tasks.workunit.client.0.smithi163.stdout:3212(140 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.154 INFO:tasks.workunit.client.0.smithi163.stdout:3213(141 mod 256): TRUNCATE UP from 0xd9eed to 0xe7fe2 2023-07-14T18:17:18.154 INFO:tasks.workunit.client.0.smithi163.stdout:3214(142 mod 256): FALLOC 0x9e3a8 thru 0xa8c83 (0xa8db bytes) INTERIOR 2023-07-14T18:17:18.154 INFO:tasks.workunit.client.0.smithi163.stdout:3215(143 mod 256): READ 0x29230 thru 0x2fd08 (0x6ad9 bytes) 2023-07-14T18:17:18.155 INFO:tasks.workunit.client.0.smithi163.stdout:3216(144 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.155 INFO:tasks.workunit.client.0.smithi163.stdout:3217(145 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.155 INFO:tasks.workunit.client.0.smithi163.stdout:3218(146 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.155 INFO:tasks.workunit.client.0.smithi163.stdout:3219(147 mod 256): PUNCH 0x716ff thru 0x759d4 (0x42d6 bytes) 2023-07-14T18:17:18.155 INFO:tasks.workunit.client.0.smithi163.stdout:3220(148 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.155 INFO:tasks.workunit.client.0.smithi163.stdout:3221(149 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.155 INFO:tasks.workunit.client.0.smithi163.stdout:3222(150 mod 256): PUNCH 0xd5bcf thru 0xdfa66 (0x9e98 bytes) 2023-07-14T18:17:18.155 INFO:tasks.workunit.client.0.smithi163.stdout:3223(151 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.156 INFO:tasks.workunit.client.0.smithi163.stdout:3224(152 mod 256): COPY 0xa9047 thru 0xaac12 (0x1bcc bytes) to 0xed01d thru 0xeebe8 2023-07-14T18:17:18.156 INFO:tasks.workunit.client.0.smithi163.stdout:3225(153 mod 256): WRITE 0x54048 thru 0x5ec83 (0xac3c bytes) 2023-07-14T18:17:18.156 INFO:tasks.workunit.client.0.smithi163.stdout:3226(154 mod 256): READ 0x2dca5 thru 0x3377c (0x5ad8 bytes) 2023-07-14T18:17:18.156 INFO:tasks.workunit.client.0.smithi163.stdout:3227(155 mod 256): COPY 0xb884 thru 0xd096 (0x1813 bytes) to 0x9a0c6 thru 0x9b8d8 2023-07-14T18:17:18.156 INFO:tasks.workunit.client.0.smithi163.stdout:3228(156 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.156 INFO:tasks.workunit.client.0.smithi163.stdout:3229(157 mod 256): MAPREAD 0x39a8e thru 0x40bfc (0x716f bytes) 2023-07-14T18:17:18.156 INFO:tasks.workunit.client.0.smithi163.stdout:3230(158 mod 256): READ 0xc5f45 thru 0xc9d23 (0x3ddf bytes) 2023-07-14T18:17:18.156 INFO:tasks.workunit.client.0.smithi163.stdout:3231(159 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.157 INFO:tasks.workunit.client.0.smithi163.stdout:3232(160 mod 256): MAPREAD 0x5badb thru 0x68a02 (0xcf28 bytes) 2023-07-14T18:17:18.157 INFO:tasks.workunit.client.0.smithi163.stdout:3233(161 mod 256): MAPREAD 0xd3811 thru 0xdd4db (0x9ccb bytes) 2023-07-14T18:17:18.157 INFO:tasks.workunit.client.0.smithi163.stdout:3234(162 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.157 INFO:tasks.workunit.client.0.smithi163.stdout:3235(163 mod 256): WRITE 0xb498f thru 0xbba94 (0x7106 bytes) 2023-07-14T18:17:18.157 INFO:tasks.workunit.client.0.smithi163.stdout:3236(164 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.157 INFO:tasks.workunit.client.0.smithi163.stdout:3237(165 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.157 INFO:tasks.workunit.client.0.smithi163.stdout:3238(166 mod 256): WRITE 0xa6521 thru 0xa81eb (0x1ccb bytes) 2023-07-14T18:17:18.157 INFO:tasks.workunit.client.0.smithi163.stdout:3239(167 mod 256): PUNCH 0xe55ab thru 0xeebe8 (0x963e bytes) 2023-07-14T18:17:18.158 INFO:tasks.workunit.client.0.smithi163.stdout:3240(168 mod 256): MAPWRITE 0x627c5 thru 0x65085 (0x28c1 bytes) 2023-07-14T18:17:18.158 INFO:tasks.workunit.client.0.smithi163.stdout:3241(169 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.158 INFO:tasks.workunit.client.0.smithi163.stdout:3242(170 mod 256): FALLOC 0xc3be1 thru 0xc7fd4 (0x43f3 bytes) INTERIOR 2023-07-14T18:17:18.158 INFO:tasks.workunit.client.0.smithi163.stdout:3243(171 mod 256): TRUNCATE DOWN from 0xeebe9 to 0x66d75 2023-07-14T18:17:18.158 INFO:tasks.workunit.client.0.smithi163.stdout:3244(172 mod 256): COPY 0x2fcc8 thru 0x36bcc (0x6f05 bytes) to 0xaea4 thru 0x11da8 2023-07-14T18:17:18.158 INFO:tasks.workunit.client.0.smithi163.stdout:3245(173 mod 256): MAPREAD 0x5c494 thru 0x5d55e (0x10cb bytes) 2023-07-14T18:17:18.158 INFO:tasks.workunit.client.0.smithi163.stdout:3246(174 mod 256): MAPWRITE 0xe630a thru 0xe8bcd (0x28c4 bytes) 2023-07-14T18:17:18.158 INFO:tasks.workunit.client.0.smithi163.stdout:3247(175 mod 256): PUNCH 0x5a359 thru 0x60f94 (0x6c3c bytes) 2023-07-14T18:17:18.159 INFO:tasks.workunit.client.0.smithi163.stdout:3248(176 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.159 INFO:tasks.workunit.client.0.smithi163.stdout:3249(177 mod 256): TRUNCATE DOWN from 0xe8bce to 0xcedcc 2023-07-14T18:17:18.159 INFO:tasks.workunit.client.0.smithi163.stdout:3250(178 mod 256): COPY 0x5968 thru 0xa8ae (0x4f47 bytes) to 0x2cb5b thru 0x31aa1 2023-07-14T18:17:18.159 INFO:tasks.workunit.client.0.smithi163.stdout:3251(179 mod 256): COPY 0xb3927 thru 0xb9ad2 (0x61ac bytes) to 0xde07e thru 0xe4229 2023-07-14T18:17:18.159 INFO:tasks.workunit.client.0.smithi163.stdout:3252(180 mod 256): MAPWRITE 0xd0eee thru 0xdb4de (0xa5f1 bytes) 2023-07-14T18:17:18.159 INFO:tasks.workunit.client.0.smithi163.stdout:3253(181 mod 256): MAPREAD 0x736d3 thru 0x7ac69 (0x7597 bytes) 2023-07-14T18:17:18.159 INFO:tasks.workunit.client.0.smithi163.stdout:3254(182 mod 256): READ 0x965f7 thru 0xa1b72 (0xb57c bytes) 2023-07-14T18:17:18.159 INFO:tasks.workunit.client.0.smithi163.stdout:3255(183 mod 256): FALLOC 0x30c8a thru 0x3e100 (0xd476 bytes) INTERIOR ******FFFF 2023-07-14T18:17:18.160 INFO:tasks.workunit.client.0.smithi163.stdout:3256(184 mod 256): MAPWRITE 0xc51c4 thru 0xc7c91 (0x2ace bytes) 2023-07-14T18:17:18.160 INFO:tasks.workunit.client.0.smithi163.stdout:3257(185 mod 256): WRITE 0x76a21 thru 0x7ec2f (0x820f bytes) 2023-07-14T18:17:18.160 INFO:tasks.workunit.client.0.smithi163.stdout:3258(186 mod 256): TRUNCATE DOWN from 0xe422a to 0xbc0d8 2023-07-14T18:17:18.160 INFO:tasks.workunit.client.0.smithi163.stdout:3259(187 mod 256): COPY 0x88642 thru 0x90993 (0x8352 bytes) to 0x70795 thru 0x78ae6 2023-07-14T18:17:18.160 INFO:tasks.workunit.client.0.smithi163.stdout:3260(188 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.160 INFO:tasks.workunit.client.0.smithi163.stdout:3261(189 mod 256): MAPWRITE 0x24f16 thru 0x24ff7 (0xe2 bytes) 2023-07-14T18:17:18.160 INFO:tasks.workunit.client.0.smithi163.stdout:3262(190 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.160 INFO:tasks.workunit.client.0.smithi163.stdout:3263(191 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.161 INFO:tasks.workunit.client.0.smithi163.stdout:3264(192 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.161 INFO:tasks.workunit.client.0.smithi163.stdout:3265(193 mod 256): COPY 0x5bff7 thru 0x61e10 (0x5e1a bytes) to 0x3d5e2 thru 0x433fb 2023-07-14T18:17:18.161 INFO:tasks.workunit.client.0.smithi163.stdout:3266(194 mod 256): WRITE 0x5c4e4 thru 0x5f576 (0x3093 bytes) 2023-07-14T18:17:18.161 INFO:tasks.workunit.client.0.smithi163.stdout:3267(195 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.161 INFO:tasks.workunit.client.0.smithi163.stdout:3268(196 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.161 INFO:tasks.workunit.client.0.smithi163.stdout:3269(197 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.161 INFO:tasks.workunit.client.0.smithi163.stdout:3270(198 mod 256): TRUNCATE DOWN from 0xbc0d8 to 0x6b84a 2023-07-14T18:17:18.161 INFO:tasks.workunit.client.0.smithi163.stdout:3271(199 mod 256): TRUNCATE DOWN from 0x6b84a to 0x38cbb 2023-07-14T18:17:18.162 INFO:tasks.workunit.client.0.smithi163.stdout:3272(200 mod 256): PUNCH 0x34125 thru 0x38cba (0x4b96 bytes) ******PPPP 2023-07-14T18:17:18.162 INFO:tasks.workunit.client.0.smithi163.stdout:3273(201 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.162 INFO:tasks.workunit.client.0.smithi163.stdout:3274(202 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.162 INFO:tasks.workunit.client.0.smithi163.stdout:3275(203 mod 256): COPY 0x1f778 thru 0x214e0 (0x1d69 bytes) to 0x80b82 thru 0x828ea 2023-07-14T18:17:18.162 INFO:tasks.workunit.client.0.smithi163.stdout:3276(204 mod 256): MAPWRITE 0xa92a7 thru 0xae2c4 (0x501e bytes) 2023-07-14T18:17:18.162 INFO:tasks.workunit.client.0.smithi163.stdout:3277(205 mod 256): MAPWRITE 0x16569 thru 0x17dba (0x1852 bytes) 2023-07-14T18:17:18.162 INFO:tasks.workunit.client.0.smithi163.stdout:3278(206 mod 256): MAPREAD 0x9ce36 thru 0xa9d10 (0xcedb bytes) 2023-07-14T18:17:18.162 INFO:tasks.workunit.client.0.smithi163.stdout:3279(207 mod 256): MAPWRITE 0x54ba1 thru 0x5e029 (0x9489 bytes) 2023-07-14T18:17:18.163 INFO:tasks.workunit.client.0.smithi163.stdout:3280(208 mod 256): READ 0x5a6b8 thru 0x60e0f (0x6758 bytes) 2023-07-14T18:17:18.163 INFO:tasks.workunit.client.0.smithi163.stdout:3281(209 mod 256): TRUNCATE UP from 0xae2c5 to 0xc6a9b 2023-07-14T18:17:18.163 INFO:tasks.workunit.client.0.smithi163.stdout:3282(210 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.163 INFO:tasks.workunit.client.0.smithi163.stdout:3283(211 mod 256): WRITE 0xf7b0e thru 0xfde6d (0x6360 bytes) HOLE 2023-07-14T18:17:18.163 INFO:tasks.workunit.client.0.smithi163.stdout:3284(212 mod 256): COPY 0x23505 thru 0x307fe (0xd2fa bytes) to 0xd6d2c thru 0xe4025 2023-07-14T18:17:18.163 INFO:tasks.workunit.client.0.smithi163.stdout:3285(213 mod 256): MAPWRITE 0xbff22 thru 0xcd174 (0xd253 bytes) 2023-07-14T18:17:18.163 INFO:tasks.workunit.client.0.smithi163.stdout:3286(214 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.163 INFO:tasks.workunit.client.0.smithi163.stdout:3287(215 mod 256): MAPWRITE 0x3f78c thru 0x40ac7 (0x133c bytes) 2023-07-14T18:17:18.164 INFO:tasks.workunit.client.0.smithi163.stdout:3288(216 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.164 INFO:tasks.workunit.client.0.smithi163.stdout:3289(217 mod 256): MAPWRITE 0x7ba71 thru 0x81619 (0x5ba9 bytes) 2023-07-14T18:17:18.164 INFO:tasks.workunit.client.0.smithi163.stdout:3290(218 mod 256): TRUNCATE DOWN from 0xfde6e to 0x1836e ******WWWW 2023-07-14T18:17:18.164 INFO:tasks.workunit.client.0.smithi163.stdout:3291(219 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.164 INFO:tasks.workunit.client.0.smithi163.stdout:3292(220 mod 256): WRITE 0xa04e7 thru 0xae4bb (0xdfd5 bytes) HOLE ***WWWW 2023-07-14T18:17:18.164 INFO:tasks.workunit.client.0.smithi163.stdout:3293(221 mod 256): PUNCH 0x721cc thru 0x81a28 (0xf85d bytes) 2023-07-14T18:17:18.164 INFO:tasks.workunit.client.0.smithi163.stdout:3294(222 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.165 INFO:tasks.workunit.client.0.smithi163.stdout:3295(223 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.165 INFO:tasks.workunit.client.0.smithi163.stdout:3296(224 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.165 INFO:tasks.workunit.client.0.smithi163.stdout:3297(225 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.165 INFO:tasks.workunit.client.0.smithi163.stdout:3298(226 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.165 INFO:tasks.workunit.client.0.smithi163.stdout:3299(227 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.165 INFO:tasks.workunit.client.0.smithi163.stdout:3300(228 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.165 INFO:tasks.workunit.client.0.smithi163.stdout:3301(229 mod 256): COPY 0xad541 thru 0xae4bb (0xf7b bytes) to 0xaf8c6 thru 0xb0840 2023-07-14T18:17:18.165 INFO:tasks.workunit.client.0.smithi163.stdout:3302(230 mod 256): MAPREAD 0x886a4 thru 0x8fc09 (0x7566 bytes) 2023-07-14T18:17:18.166 INFO:tasks.workunit.client.0.smithi163.stdout:3303(231 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.166 INFO:tasks.workunit.client.0.smithi163.stdout:3304(232 mod 256): MAPWRITE 0xcfcd thru 0x174f8 (0xa52c bytes) 2023-07-14T18:17:18.166 INFO:tasks.workunit.client.0.smithi163.stdout:3305(233 mod 256): WRITE 0xf21eb thru 0xfddfa (0xbc10 bytes) HOLE 2023-07-14T18:17:18.166 INFO:tasks.workunit.client.0.smithi163.stdout:3306(234 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.166 INFO:tasks.workunit.client.0.smithi163.stdout:3307(235 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.166 INFO:tasks.workunit.client.0.smithi163.stdout:3308(236 mod 256): TRUNCATE DOWN from 0xfddfb to 0x4649c 2023-07-14T18:17:18.166 INFO:tasks.workunit.client.0.smithi163.stdout:3309(237 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.166 INFO:tasks.workunit.client.0.smithi163.stdout:3310(238 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.167 INFO:tasks.workunit.client.0.smithi163.stdout:3311(239 mod 256): PUNCH 0x11b42 thru 0x17451 (0x5910 bytes) 2023-07-14T18:17:18.167 INFO:tasks.workunit.client.0.smithi163.stdout:3312(240 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.167 INFO:tasks.workunit.client.0.smithi163.stdout:3313(241 mod 256): FALLOC 0x7837 thru 0xc710 (0x4ed9 bytes) INTERIOR 2023-07-14T18:17:18.167 INFO:tasks.workunit.client.0.smithi163.stdout:3314(242 mod 256): FALLOC 0x7362b thru 0x7e21f (0xabf4 bytes) PAST_EOF 2023-07-14T18:17:18.167 INFO:tasks.workunit.client.0.smithi163.stdout:3315(243 mod 256): MAPWRITE 0x297e3 thru 0x34cba (0xb4d8 bytes) 2023-07-14T18:17:18.167 INFO:tasks.workunit.client.0.smithi163.stdout:3316(244 mod 256): MAPREAD 0x3b83f thru 0x4649b (0xac5d bytes) 2023-07-14T18:17:18.167 INFO:tasks.workunit.client.0.smithi163.stdout:3317(245 mod 256): COPY 0x3bcf0 thru 0x42eaa (0x71bb bytes) to 0x94582 thru 0x9b73c 2023-07-14T18:17:18.167 INFO:tasks.workunit.client.0.smithi163.stdout:3318(246 mod 256): READ 0x6989b thru 0x769e1 (0xd147 bytes) 2023-07-14T18:17:18.167 INFO:tasks.workunit.client.0.smithi163.stdout:3319(247 mod 256): TRUNCATE DOWN from 0x9b73d to 0x69dc3 2023-07-14T18:17:18.168 INFO:tasks.workunit.client.0.smithi163.stdout:3320(248 mod 256): WRITE 0x121b7 thru 0x12dbe (0xc08 bytes) 2023-07-14T18:17:18.168 INFO:tasks.workunit.client.0.smithi163.stdout:3321(249 mod 256): MAPWRITE 0xdd5de thru 0xebaa1 (0xe4c4 bytes) 2023-07-14T18:17:18.168 INFO:tasks.workunit.client.0.smithi163.stdout:3322(250 mod 256): TRUNCATE DOWN from 0xebaa2 to 0xa8499 2023-07-14T18:17:18.168 INFO:tasks.workunit.client.0.smithi163.stdout:3323(251 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.168 INFO:tasks.workunit.client.0.smithi163.stdout:3324(252 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.168 INFO:tasks.workunit.client.0.smithi163.stdout:3325(253 mod 256): FALLOC 0xa3f95 thru 0xa5601 (0x166c bytes) INTERIOR 2023-07-14T18:17:18.168 INFO:tasks.workunit.client.0.smithi163.stdout:3326(254 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.169 INFO:tasks.workunit.client.0.smithi163.stdout:3327(255 mod 256): WRITE 0x5f477 thru 0x6cbef (0xd779 bytes) 2023-07-14T18:17:18.169 INFO:tasks.workunit.client.0.smithi163.stdout:3328( 0 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.169 INFO:tasks.workunit.client.0.smithi163.stdout:3329( 1 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.169 INFO:tasks.workunit.client.0.smithi163.stdout:3330( 2 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.169 INFO:tasks.workunit.client.0.smithi163.stdout:3331( 3 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.169 INFO:tasks.workunit.client.0.smithi163.stdout:3332( 4 mod 256): READ 0x78c9b thru 0x7f58c (0x68f2 bytes) 2023-07-14T18:17:18.169 INFO:tasks.workunit.client.0.smithi163.stdout:3333( 5 mod 256): MAPWRITE 0x78ee thru 0xd3ff (0x5b12 bytes) 2023-07-14T18:17:18.169 INFO:tasks.workunit.client.0.smithi163.stdout:3334( 6 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.170 INFO:tasks.workunit.client.0.smithi163.stdout:3335( 7 mod 256): MAPREAD 0x4f4d4 thru 0x501c0 (0xced bytes) 2023-07-14T18:17:18.170 INFO:tasks.workunit.client.0.smithi163.stdout:3336( 8 mod 256): COPY 0x57452 thru 0x6415e (0xcd0d bytes) to 0xf130e thru 0xfe01a 2023-07-14T18:17:18.170 INFO:tasks.workunit.client.0.smithi163.stdout:3337( 9 mod 256): PUNCH 0x4f67c thru 0x5e947 (0xf2cc bytes) 2023-07-14T18:17:18.170 INFO:tasks.workunit.client.0.smithi163.stdout:3338( 10 mod 256): TRUNCATE DOWN from 0xfe01b to 0x95e1 ******WWWW 2023-07-14T18:17:18.170 INFO:tasks.workunit.client.0.smithi163.stdout:3339( 11 mod 256): MAPREAD 0x2ab9 thru 0x4f87 (0x24cf bytes) 2023-07-14T18:17:18.170 INFO:tasks.workunit.client.0.smithi163.stdout:3340( 12 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.170 INFO:tasks.workunit.client.0.smithi163.stdout:3341( 13 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.170 INFO:tasks.workunit.client.0.smithi163.stdout:3342( 14 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.170 INFO:tasks.workunit.client.0.smithi163.stdout:3343( 15 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.171 INFO:tasks.workunit.client.0.smithi163.stdout:3344( 16 mod 256): WRITE 0xaeb03 thru 0xb9809 (0xad07 bytes) HOLE ***WWWW 2023-07-14T18:17:18.171 INFO:tasks.workunit.client.0.smithi163.stdout:3345( 17 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.171 INFO:tasks.workunit.client.0.smithi163.stdout:3346( 18 mod 256): MAPWRITE 0x6a490 thru 0x75b22 (0xb693 bytes) 2023-07-14T18:17:18.171 INFO:tasks.workunit.client.0.smithi163.stdout:3347( 19 mod 256): PUNCH 0x14e47 thru 0x17261 (0x241b bytes) 2023-07-14T18:17:18.171 INFO:tasks.workunit.client.0.smithi163.stdout:3348( 20 mod 256): PUNCH 0xafce thru 0x16ddd (0xbe10 bytes) 2023-07-14T18:17:18.171 INFO:tasks.workunit.client.0.smithi163.stdout:3349( 21 mod 256): MAPWRITE 0x4f2a3 thru 0x54ebf (0x5c1d bytes) 2023-07-14T18:17:18.171 INFO:tasks.workunit.client.0.smithi163.stdout:3350( 22 mod 256): MAPWRITE 0x6801d thru 0x6cc04 (0x4be8 bytes) 2023-07-14T18:17:18.171 INFO:tasks.workunit.client.0.smithi163.stdout:3351( 23 mod 256): FALLOC 0x4ac3 thru 0xfe36 (0xb373 bytes) INTERIOR 2023-07-14T18:17:18.172 INFO:tasks.workunit.client.0.smithi163.stdout:3352( 24 mod 256): FALLOC 0x46f96 thru 0x49508 (0x2572 bytes) INTERIOR 2023-07-14T18:17:18.172 INFO:tasks.workunit.client.0.smithi163.stdout:3353( 25 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.172 INFO:tasks.workunit.client.0.smithi163.stdout:3354( 26 mod 256): PUNCH 0xa4d88 thru 0xac890 (0x7b09 bytes) 2023-07-14T18:17:18.172 INFO:tasks.workunit.client.0.smithi163.stdout:3355( 27 mod 256): MAPWRITE 0x40ad8 thru 0x4d0d7 (0xc600 bytes) 2023-07-14T18:17:18.172 INFO:tasks.workunit.client.0.smithi163.stdout:3356( 28 mod 256): COPY 0x50c9f thru 0x59949 (0x8cab bytes) to 0x83e3a thru 0x8cae4 2023-07-14T18:17:18.172 INFO:tasks.workunit.client.0.smithi163.stdout:3357( 29 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.172 INFO:tasks.workunit.client.0.smithi163.stdout:3358( 30 mod 256): COPY 0x4b767 thru 0x51549 (0x5de3 bytes) to 0x6bead thru 0x71c8f 2023-07-14T18:17:18.172 INFO:tasks.workunit.client.0.smithi163.stdout:3359( 31 mod 256): MAPWRITE 0x40ef3 thru 0x4b3af (0xa4bd bytes) 2023-07-14T18:17:18.173 INFO:tasks.workunit.client.0.smithi163.stdout:3360( 32 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.173 INFO:tasks.workunit.client.0.smithi163.stdout:3361( 33 mod 256): FALLOC 0xd34da thru 0xdba64 (0x858a bytes) PAST_EOF 2023-07-14T18:17:18.173 INFO:tasks.workunit.client.0.smithi163.stdout:3362( 34 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.173 INFO:tasks.workunit.client.0.smithi163.stdout:3363( 35 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.173 INFO:tasks.workunit.client.0.smithi163.stdout:3364( 36 mod 256): MAPREAD 0x89e4c thru 0x8bf45 (0x20fa bytes) 2023-07-14T18:17:18.173 INFO:tasks.workunit.client.0.smithi163.stdout:3365( 37 mod 256): PUNCH 0x7fdf6 thru 0x8ac86 (0xae91 bytes) 2023-07-14T18:17:18.173 INFO:tasks.workunit.client.0.smithi163.stdout:3366( 38 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.173 INFO:tasks.workunit.client.0.smithi163.stdout:3367( 39 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.174 INFO:tasks.workunit.client.0.smithi163.stdout:3368( 40 mod 256): COPY 0xa7a63 thru 0xae6b3 (0x6c51 bytes) to 0xecb9e thru 0xf37ee 2023-07-14T18:17:18.174 INFO:tasks.workunit.client.0.smithi163.stdout:3369( 41 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.174 INFO:tasks.workunit.client.0.smithi163.stdout:3370( 42 mod 256): READ 0x668f8 thru 0x74b2d (0xe236 bytes) 2023-07-14T18:17:18.174 INFO:tasks.workunit.client.0.smithi163.stdout:3371( 43 mod 256): MAPWRITE 0x62cad thru 0x64101 (0x1455 bytes) 2023-07-14T18:17:18.174 INFO:tasks.workunit.client.0.smithi163.stdout:3372( 44 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.174 INFO:tasks.workunit.client.0.smithi163.stdout:3373( 45 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.174 INFO:tasks.workunit.client.0.smithi163.stdout:3374( 46 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.174 INFO:tasks.workunit.client.0.smithi163.stdout:3375( 47 mod 256): TRUNCATE DOWN from 0xf37ef to 0x96b6d 2023-07-14T18:17:18.175 INFO:tasks.workunit.client.0.smithi163.stdout:3376( 48 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.175 INFO:tasks.workunit.client.0.smithi163.stdout:3377( 49 mod 256): MAPWRITE 0x3edeb thru 0x4c6cc (0xd8e2 bytes) 2023-07-14T18:17:18.175 INFO:tasks.workunit.client.0.smithi163.stdout:3378( 50 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.175 INFO:tasks.workunit.client.0.smithi163.stdout:3379( 51 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.175 INFO:tasks.workunit.client.0.smithi163.stdout:3380( 52 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.175 INFO:tasks.workunit.client.0.smithi163.stdout:3381( 53 mod 256): MAPREAD 0x8f448 thru 0x96b6c (0x7725 bytes) 2023-07-14T18:17:18.175 INFO:tasks.workunit.client.0.smithi163.stdout:3382( 54 mod 256): FALLOC 0x75a4b thru 0x81c93 (0xc248 bytes) INTERIOR 2023-07-14T18:17:18.175 INFO:tasks.workunit.client.0.smithi163.stdout:3383( 55 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.176 INFO:tasks.workunit.client.0.smithi163.stdout:3384( 56 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.176 INFO:tasks.workunit.client.0.smithi163.stdout:3385( 57 mod 256): TRUNCATE UP from 0x96b6d to 0x9dd45 2023-07-14T18:17:18.176 INFO:tasks.workunit.client.0.smithi163.stdout:3386( 58 mod 256): WRITE 0xfbb7a thru 0xfffff (0x4486 bytes) HOLE 2023-07-14T18:17:18.176 INFO:tasks.workunit.client.0.smithi163.stdout:3387( 59 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.176 INFO:tasks.workunit.client.0.smithi163.stdout:3388( 60 mod 256): READ 0x8968a thru 0x97cd8 (0xe64f bytes) 2023-07-14T18:17:18.176 INFO:tasks.workunit.client.0.smithi163.stdout:3389( 61 mod 256): TRUNCATE DOWN from 0x100000 to 0xdaf08 2023-07-14T18:17:18.176 INFO:tasks.workunit.client.0.smithi163.stdout:3390( 62 mod 256): MAPREAD 0x707cb thru 0x7ed17 (0xe54d bytes) 2023-07-14T18:17:18.176 INFO:tasks.workunit.client.0.smithi163.stdout:3391( 63 mod 256): PUNCH 0xd18a4 thru 0xdaf07 (0x9664 bytes) 2023-07-14T18:17:18.177 INFO:tasks.workunit.client.0.smithi163.stdout:3392( 64 mod 256): PUNCH 0x82cdf thru 0x86d27 (0x4049 bytes) 2023-07-14T18:17:18.177 INFO:tasks.workunit.client.0.smithi163.stdout:3393( 65 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.177 INFO:tasks.workunit.client.0.smithi163.stdout:3394( 66 mod 256): READ 0x9f023 thru 0xa121e (0x21fc bytes) 2023-07-14T18:17:18.177 INFO:tasks.workunit.client.0.smithi163.stdout:3395( 67 mod 256): FALLOC 0xa1d44 thru 0xa3257 (0x1513 bytes) INTERIOR 2023-07-14T18:17:18.177 INFO:tasks.workunit.client.0.smithi163.stdout:3396( 68 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.177 INFO:tasks.workunit.client.0.smithi163.stdout:3397( 69 mod 256): READ 0x7a3fa thru 0x7d256 (0x2e5d bytes) 2023-07-14T18:17:18.177 INFO:tasks.workunit.client.0.smithi163.stdout:3398( 70 mod 256): MAPREAD 0x47154 thru 0x48cb8 (0x1b65 bytes) 2023-07-14T18:17:18.177 INFO:tasks.workunit.client.0.smithi163.stdout:3399( 71 mod 256): PUNCH 0x74c7e thru 0x82e16 (0xe199 bytes) 2023-07-14T18:17:18.178 INFO:tasks.workunit.client.0.smithi163.stdout:3400( 72 mod 256): MAPWRITE 0x5c69f thru 0x6ae6a (0xe7cc bytes) 2023-07-14T18:17:18.178 INFO:tasks.workunit.client.0.smithi163.stdout:3401( 73 mod 256): COPY 0x247e8 thru 0x291e3 (0x49fc bytes) to 0x4c90a thru 0x51305 2023-07-14T18:17:18.178 INFO:tasks.workunit.client.0.smithi163.stdout:3402( 74 mod 256): TRUNCATE UP from 0xdaf08 to 0xdf406 2023-07-14T18:17:18.178 INFO:tasks.workunit.client.0.smithi163.stdout:3403( 75 mod 256): WRITE 0x4ad6 thru 0x145d8 (0xfb03 bytes) 2023-07-14T18:17:18.178 INFO:tasks.workunit.client.0.smithi163.stdout:3404( 76 mod 256): FALLOC 0xb3b58 thru 0xbecff (0xb1a7 bytes) INTERIOR 2023-07-14T18:17:18.178 INFO:tasks.workunit.client.0.smithi163.stdout:3405( 77 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.178 INFO:tasks.workunit.client.0.smithi163.stdout:3406( 78 mod 256): MAPWRITE 0x3fc8f thru 0x40db7 (0x1129 bytes) 2023-07-14T18:17:18.178 INFO:tasks.workunit.client.0.smithi163.stdout:3407( 79 mod 256): PUNCH 0x83a7d thru 0x89164 (0x56e8 bytes) 2023-07-14T18:17:18.179 INFO:tasks.workunit.client.0.smithi163.stdout:3408( 80 mod 256): MAPWRITE 0xc38de thru 0xc6757 (0x2e7a bytes) 2023-07-14T18:17:18.179 INFO:tasks.workunit.client.0.smithi163.stdout:3409( 81 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.179 INFO:tasks.workunit.client.0.smithi163.stdout:3410( 82 mod 256): TRUNCATE DOWN from 0xdf406 to 0xa1877 2023-07-14T18:17:18.179 INFO:tasks.workunit.client.0.smithi163.stdout:3411( 83 mod 256): READ 0x2965a thru 0x386d6 (0xf07d bytes) ***RRRR*** 2023-07-14T18:17:18.179 INFO:tasks.workunit.client.0.smithi163.stdout:3412( 84 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.179 INFO:tasks.workunit.client.0.smithi163.stdout:3413( 85 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.179 INFO:tasks.workunit.client.0.smithi163.stdout:3414( 86 mod 256): PUNCH 0x47615 thru 0x51f65 (0xa951 bytes) 2023-07-14T18:17:18.179 INFO:tasks.workunit.client.0.smithi163.stdout:3415( 87 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.180 INFO:tasks.workunit.client.0.smithi163.stdout:3416( 88 mod 256): FALLOC 0x3d894 thru 0x4c970 (0xf0dc bytes) INTERIOR 2023-07-14T18:17:18.180 INFO:tasks.workunit.client.0.smithi163.stdout:3417( 89 mod 256): COPY 0x5d6c1 thru 0x69bc4 (0xc504 bytes) to 0x28628 thru 0x34b2b 2023-07-14T18:17:18.180 INFO:tasks.workunit.client.0.smithi163.stdout:3418( 90 mod 256): WRITE 0xca485 thru 0xd7665 (0xd1e1 bytes) HOLE 2023-07-14T18:17:18.180 INFO:tasks.workunit.client.0.smithi163.stdout:3419( 91 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.180 INFO:tasks.workunit.client.0.smithi163.stdout:3420( 92 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.180 INFO:tasks.workunit.client.0.smithi163.stdout:3421( 93 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.180 INFO:tasks.workunit.client.0.smithi163.stdout:3422( 94 mod 256): MAPREAD 0x44e10 thru 0x45e82 (0x1073 bytes) 2023-07-14T18:17:18.181 INFO:tasks.workunit.client.0.smithi163.stdout:3423( 95 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.181 INFO:tasks.workunit.client.0.smithi163.stdout:3424( 96 mod 256): FALLOC 0x9bb8c thru 0xa0d01 (0x5175 bytes) INTERIOR 2023-07-14T18:17:18.181 INFO:tasks.workunit.client.0.smithi163.stdout:3425( 97 mod 256): FALLOC 0xfa243 thru 0x100000 (0x5dbd bytes) PAST_EOF 2023-07-14T18:17:18.181 INFO:tasks.workunit.client.0.smithi163.stdout:3426( 98 mod 256): FALLOC 0x8dfb9 thru 0x94f91 (0x6fd8 bytes) INTERIOR 2023-07-14T18:17:18.181 INFO:tasks.workunit.client.0.smithi163.stdout:3427( 99 mod 256): MAPWRITE 0xa9ea7 thru 0xaa713 (0x86d bytes) 2023-07-14T18:17:18.181 INFO:tasks.workunit.client.0.smithi163.stdout:3428(100 mod 256): MAPREAD 0xcaad thru 0x14426 (0x797a bytes) 2023-07-14T18:17:18.181 INFO:tasks.workunit.client.0.smithi163.stdout:3429(101 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.181 INFO:tasks.workunit.client.0.smithi163.stdout:3430(102 mod 256): COPY 0x658a6 thru 0x682a3 (0x29fe bytes) to 0x2176b thru 0x24168 2023-07-14T18:17:18.182 INFO:tasks.workunit.client.0.smithi163.stdout:3431(103 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.182 INFO:tasks.workunit.client.0.smithi163.stdout:3432(104 mod 256): COPY 0x92dab thru 0x9b4a8 (0x86fe bytes) to 0x5cb0a thru 0x65207 2023-07-14T18:17:18.182 INFO:tasks.workunit.client.0.smithi163.stdout:3433(105 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.182 INFO:tasks.workunit.client.0.smithi163.stdout:3434(106 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.182 INFO:tasks.workunit.client.0.smithi163.stdout:3435(107 mod 256): TRUNCATE DOWN from 0xd7666 to 0x46c5e 2023-07-14T18:17:18.182 INFO:tasks.workunit.client.0.smithi163.stdout:3436(108 mod 256): TRUNCATE UP from 0x46c5e to 0xe2a61 2023-07-14T18:17:18.182 INFO:tasks.workunit.client.0.smithi163.stdout:3437(109 mod 256): WRITE 0xbe6da thru 0xc9153 (0xaa7a bytes) 2023-07-14T18:17:18.182 INFO:tasks.workunit.client.0.smithi163.stdout:3438(110 mod 256): MAPWRITE 0x8b493 thru 0x9ac8e (0xf7fc bytes) 2023-07-14T18:17:18.183 INFO:tasks.workunit.client.0.smithi163.stdout:3439(111 mod 256): TRUNCATE DOWN from 0xe2a61 to 0x6306 ******WWWW 2023-07-14T18:17:18.183 INFO:tasks.workunit.client.0.smithi163.stdout:3440(112 mod 256): PUNCH 0x359a thru 0x6305 (0x2d6c bytes) 2023-07-14T18:17:18.183 INFO:tasks.workunit.client.0.smithi163.stdout:3441(113 mod 256): TRUNCATE UP from 0x6306 to 0x78cd6 ******WWWW 2023-07-14T18:17:18.183 INFO:tasks.workunit.client.0.smithi163.stdout:3442(114 mod 256): READ 0x2c009 thru 0x30783 (0x477b bytes) 2023-07-14T18:17:18.183 INFO:tasks.workunit.client.0.smithi163.stdout:3443(115 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.183 INFO:tasks.workunit.client.0.smithi163.stdout:3444(116 mod 256): FALLOC 0x962bb thru 0x9b6bc (0x5401 bytes) EXTENDING 2023-07-14T18:17:18.183 INFO:tasks.workunit.client.0.smithi163.stdout:3445(117 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.183 INFO:tasks.workunit.client.0.smithi163.stdout:3446(118 mod 256): MAPREAD 0x5baa9 thru 0x66927 (0xae7f bytes) 2023-07-14T18:17:18.184 INFO:tasks.workunit.client.0.smithi163.stdout:3447(119 mod 256): MAPREAD 0x7f679 thru 0x8cec9 (0xd851 bytes) 2023-07-14T18:17:18.184 INFO:tasks.workunit.client.0.smithi163.stdout:3448(120 mod 256): MAPREAD 0x14700 thru 0x22b7f (0xe480 bytes) 2023-07-14T18:17:18.184 INFO:tasks.workunit.client.0.smithi163.stdout:3449(121 mod 256): WRITE 0x2f49c thru 0x36dfe (0x7963 bytes) 2023-07-14T18:17:18.184 INFO:tasks.workunit.client.0.smithi163.stdout:3450(122 mod 256): COPY 0x28d81 thru 0x2bdc4 (0x3044 bytes) to 0x24c46 thru 0x27c89 2023-07-14T18:17:18.184 INFO:tasks.workunit.client.0.smithi163.stdout:3451(123 mod 256): MAPREAD 0x3c83e thru 0x467d4 (0x9f97 bytes) 2023-07-14T18:17:18.184 INFO:tasks.workunit.client.0.smithi163.stdout:3452(124 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.184 INFO:tasks.workunit.client.0.smithi163.stdout:3453(125 mod 256): COPY 0xc87d thru 0x193f5 (0xcb79 bytes) to 0x7ff67 thru 0x8cadf 2023-07-14T18:17:18.184 INFO:tasks.workunit.client.0.smithi163.stdout:3454(126 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.185 INFO:tasks.workunit.client.0.smithi163.stdout:3455(127 mod 256): FALLOC 0xfbd9e thru 0x100000 (0x4262 bytes) PAST_EOF 2023-07-14T18:17:18.185 INFO:tasks.workunit.client.0.smithi163.stdout:3456(128 mod 256): FALLOC 0x9be50 thru 0xa2571 (0x6721 bytes) EXTENDING 2023-07-14T18:17:18.185 INFO:tasks.workunit.client.0.smithi163.stdout:3457(129 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.185 INFO:tasks.workunit.client.0.smithi163.stdout:3458(130 mod 256): MAPREAD 0x6318d thru 0x6c730 (0x95a4 bytes) 2023-07-14T18:17:18.185 INFO:tasks.workunit.client.0.smithi163.stdout:3459(131 mod 256): READ 0x1054a thru 0x18ed4 (0x898b bytes) 2023-07-14T18:17:18.185 INFO:tasks.workunit.client.0.smithi163.stdout:3460(132 mod 256): READ 0x34b6f thru 0x388cf (0x3d61 bytes) ***RRRR*** 2023-07-14T18:17:18.185 INFO:tasks.workunit.client.0.smithi163.stdout:3461(133 mod 256): PUNCH 0x2f291 thru 0x397b9 (0xa529 bytes) ******PPPP 2023-07-14T18:17:18.185 INFO:tasks.workunit.client.0.smithi163.stdout:3462(134 mod 256): MAPWRITE 0xf9f0 thru 0x13be2 (0x41f3 bytes) 2023-07-14T18:17:18.186 INFO:tasks.workunit.client.0.smithi163.stdout:3463(135 mod 256): READ 0x60fd5 thru 0x6546e (0x449a bytes) 2023-07-14T18:17:18.186 INFO:tasks.workunit.client.0.smithi163.stdout:3464(136 mod 256): PUNCH 0x21797 thru 0x2f895 (0xe0ff bytes) 2023-07-14T18:17:18.186 INFO:tasks.workunit.client.0.smithi163.stdout:3465(137 mod 256): FALLOC 0xef81d thru 0xf2d6d (0x3550 bytes) PAST_EOF 2023-07-14T18:17:18.186 INFO:tasks.workunit.client.0.smithi163.stdout:3466(138 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.186 INFO:tasks.workunit.client.0.smithi163.stdout:3467(139 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.186 INFO:tasks.workunit.client.0.smithi163.stdout:3468(140 mod 256): WRITE 0x12509 thru 0x22207 (0xfcff bytes) 2023-07-14T18:17:18.186 INFO:tasks.workunit.client.0.smithi163.stdout:3469(141 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.186 INFO:tasks.workunit.client.0.smithi163.stdout:3470(142 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.187 INFO:tasks.workunit.client.0.smithi163.stdout:3471(143 mod 256): FALLOC 0x78c60 thru 0x7e5b2 (0x5952 bytes) INTERIOR 2023-07-14T18:17:18.187 INFO:tasks.workunit.client.0.smithi163.stdout:3472(144 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.187 INFO:tasks.workunit.client.0.smithi163.stdout:3473(145 mod 256): FALLOC 0xc4898 thru 0xd0aa5 (0xc20d bytes) EXTENDING 2023-07-14T18:17:18.187 INFO:tasks.workunit.client.0.smithi163.stdout:3474(146 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.187 INFO:tasks.workunit.client.0.smithi163.stdout:3475(147 mod 256): WRITE 0xf0c9d thru 0xfffff (0xf363 bytes) HOLE 2023-07-14T18:17:18.187 INFO:tasks.workunit.client.0.smithi163.stdout:3476(148 mod 256): WRITE 0x914c1 thru 0x96a95 (0x55d5 bytes) 2023-07-14T18:17:18.187 INFO:tasks.workunit.client.0.smithi163.stdout:3477(149 mod 256): PUNCH 0x791c1 thru 0x82642 (0x9482 bytes) 2023-07-14T18:17:18.187 INFO:tasks.workunit.client.0.smithi163.stdout:3478(150 mod 256): WRITE 0x68002 thru 0x6fc21 (0x7c20 bytes) 2023-07-14T18:17:18.188 INFO:tasks.workunit.client.0.smithi163.stdout:3479(151 mod 256): READ 0x36d3a thru 0x38a7c (0x1d43 bytes) ***RRRR*** 2023-07-14T18:17:18.188 INFO:tasks.workunit.client.0.smithi163.stdout:3480(152 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.188 INFO:tasks.workunit.client.0.smithi163.stdout:3481(153 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.188 INFO:tasks.workunit.client.0.smithi163.stdout:3482(154 mod 256): MAPREAD 0x5bb4d thru 0x645ea (0x8a9e bytes) 2023-07-14T18:17:18.188 INFO:tasks.workunit.client.0.smithi163.stdout:3483(155 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.188 INFO:tasks.workunit.client.0.smithi163.stdout:3484(156 mod 256): WRITE 0xb5633 thru 0xb5702 (0xd0 bytes) 2023-07-14T18:17:18.188 INFO:tasks.workunit.client.0.smithi163.stdout:3485(157 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.188 INFO:tasks.workunit.client.0.smithi163.stdout:3486(158 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.189 INFO:tasks.workunit.client.0.smithi163.stdout:3487(159 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.189 INFO:tasks.workunit.client.0.smithi163.stdout:3488(160 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.189 INFO:tasks.workunit.client.0.smithi163.stdout:3489(161 mod 256): PUNCH 0x4e555 thru 0x58f4c (0xa9f8 bytes) 2023-07-14T18:17:18.189 INFO:tasks.workunit.client.0.smithi163.stdout:3490(162 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.189 INFO:tasks.workunit.client.0.smithi163.stdout:3491(163 mod 256): MAPWRITE 0x34068 thru 0x37e34 (0x3dcd bytes) 2023-07-14T18:17:18.189 INFO:tasks.workunit.client.0.smithi163.stdout:3492(164 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.189 INFO:tasks.workunit.client.0.smithi163.stdout:3493(165 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.189 INFO:tasks.workunit.client.0.smithi163.stdout:3494(166 mod 256): READ 0xb66ff thru 0xbad75 (0x4677 bytes) 2023-07-14T18:17:18.190 INFO:tasks.workunit.client.0.smithi163.stdout:3495(167 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.190 INFO:tasks.workunit.client.0.smithi163.stdout:3496(168 mod 256): FALLOC 0xb6210 thru 0xbd666 (0x7456 bytes) INTERIOR 2023-07-14T18:17:18.190 INFO:tasks.workunit.client.0.smithi163.stdout:3497(169 mod 256): WRITE 0x579b9 thru 0x63482 (0xbaca bytes) 2023-07-14T18:17:18.190 INFO:tasks.workunit.client.0.smithi163.stdout:3498(170 mod 256): MAPWRITE 0x33618 thru 0x39d7d (0x6766 bytes) ******WWWW 2023-07-14T18:17:18.190 INFO:tasks.workunit.client.0.smithi163.stdout:3499(171 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.190 INFO:tasks.workunit.client.0.smithi163.stdout:3500(172 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.190 INFO:tasks.workunit.client.0.smithi163.stdout:3501(173 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.190 INFO:tasks.workunit.client.0.smithi163.stdout:3502(174 mod 256): MAPREAD 0x4bd7b thru 0x4d220 (0x14a6 bytes) 2023-07-14T18:17:18.191 INFO:tasks.workunit.client.0.smithi163.stdout:3503(175 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.191 INFO:tasks.workunit.client.0.smithi163.stdout:3504(176 mod 256): PUNCH 0xed43a thru 0xf5386 (0x7f4d bytes) 2023-07-14T18:17:18.191 INFO:tasks.workunit.client.0.smithi163.stdout:3505(177 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.191 INFO:tasks.workunit.client.0.smithi163.stdout:3506(178 mod 256): TRUNCATE DOWN from 0x100000 to 0xb077a 2023-07-14T18:17:18.191 INFO:tasks.workunit.client.0.smithi163.stdout:3507(179 mod 256): TRUNCATE DOWN from 0xb077a to 0x4f1ec 2023-07-14T18:17:18.191 INFO:tasks.workunit.client.0.smithi163.stdout:3508(180 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.191 INFO:tasks.workunit.client.0.smithi163.stdout:3509(181 mod 256): TRUNCATE UP from 0x4f1ec to 0xd60fa 2023-07-14T18:17:18.191 INFO:tasks.workunit.client.0.smithi163.stdout:3510(182 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.192 INFO:tasks.workunit.client.0.smithi163.stdout:3511(183 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.192 INFO:tasks.workunit.client.0.smithi163.stdout:3512(184 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.192 INFO:tasks.workunit.client.0.smithi163.stdout:3513(185 mod 256): FALLOC 0x91d9c thru 0x9cf3e (0xb1a2 bytes) INTERIOR 2023-07-14T18:17:18.192 INFO:tasks.workunit.client.0.smithi163.stdout:3514(186 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.192 INFO:tasks.workunit.client.0.smithi163.stdout:3515(187 mod 256): READ 0x6cbc0 thru 0x71860 (0x4ca1 bytes) 2023-07-14T18:17:18.192 INFO:tasks.workunit.client.0.smithi163.stdout:3516(188 mod 256): MAPREAD 0x993f6 thru 0x9cab9 (0x36c4 bytes) 2023-07-14T18:17:18.192 INFO:tasks.workunit.client.0.smithi163.stdout:3517(189 mod 256): READ 0x615ea thru 0x62776 (0x118d bytes) 2023-07-14T18:17:18.192 INFO:tasks.workunit.client.0.smithi163.stdout:3518(190 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.193 INFO:tasks.workunit.client.0.smithi163.stdout:3519(191 mod 256): PUNCH 0x92f87 thru 0x9ff22 (0xcf9c bytes) 2023-07-14T18:17:18.193 INFO:tasks.workunit.client.0.smithi163.stdout:3520(192 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.193 INFO:tasks.workunit.client.0.smithi163.stdout:3521(193 mod 256): PUNCH 0x1ecfa thru 0x2b203 (0xc50a bytes) 2023-07-14T18:17:18.193 INFO:tasks.workunit.client.0.smithi163.stdout:3522(194 mod 256): READ 0xd0b63 thru 0xd2f50 (0x23ee bytes) 2023-07-14T18:17:18.193 INFO:tasks.workunit.client.0.smithi163.stdout:3523(195 mod 256): FALLOC 0x30594 thru 0x32deb (0x2857 bytes) INTERIOR 2023-07-14T18:17:18.193 INFO:tasks.workunit.client.0.smithi163.stdout:3524(196 mod 256): READ 0x8b838 thru 0x96443 (0xac0c bytes) 2023-07-14T18:17:18.193 INFO:tasks.workunit.client.0.smithi163.stdout:3525(197 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.193 INFO:tasks.workunit.client.0.smithi163.stdout:3526(198 mod 256): READ 0x3c253 thru 0x3ed96 (0x2b44 bytes) 2023-07-14T18:17:18.194 INFO:tasks.workunit.client.0.smithi163.stdout:3527(199 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.194 INFO:tasks.workunit.client.0.smithi163.stdout:3528(200 mod 256): MAPREAD 0xa6c7 thru 0x15971 (0xb2ab bytes) 2023-07-14T18:17:18.194 INFO:tasks.workunit.client.0.smithi163.stdout:3529(201 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.194 INFO:tasks.workunit.client.0.smithi163.stdout:3530(202 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.194 INFO:tasks.workunit.client.0.smithi163.stdout:3531(203 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.194 INFO:tasks.workunit.client.0.smithi163.stdout:3532(204 mod 256): MAPREAD 0x12af1 thru 0x16cbe (0x41ce bytes) 2023-07-14T18:17:18.194 INFO:tasks.workunit.client.0.smithi163.stdout:3533(205 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.194 INFO:tasks.workunit.client.0.smithi163.stdout:3534(206 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.195 INFO:tasks.workunit.client.0.smithi163.stdout:3535(207 mod 256): MAPWRITE 0x59d59 thru 0x61db9 (0x8061 bytes) 2023-07-14T18:17:18.195 INFO:tasks.workunit.client.0.smithi163.stdout:3536(208 mod 256): MAPREAD 0x569eb thru 0x65a98 (0xf0ae bytes) 2023-07-14T18:17:18.195 INFO:tasks.workunit.client.0.smithi163.stdout:3537(209 mod 256): TRUNCATE DOWN from 0xd60fa to 0x88301 2023-07-14T18:17:18.195 INFO:tasks.workunit.client.0.smithi163.stdout:3538(210 mod 256): FALLOC 0xa93cd thru 0xabb1b (0x274e bytes) PAST_EOF 2023-07-14T18:17:18.195 INFO:tasks.workunit.client.0.smithi163.stdout:3539(211 mod 256): PUNCH 0x73130 thru 0x7f20b (0xc0dc bytes) 2023-07-14T18:17:18.195 INFO:tasks.workunit.client.0.smithi163.stdout:3540(212 mod 256): COPY 0x4e1a8 thru 0x540bd (0x5f16 bytes) to 0x6fcb thru 0xcee0 2023-07-14T18:17:18.195 INFO:tasks.workunit.client.0.smithi163.stdout:3541(213 mod 256): TRUNCATE DOWN from 0x88301 to 0x9cf9 ******WWWW 2023-07-14T18:17:18.195 INFO:tasks.workunit.client.0.smithi163.stdout:3542(214 mod 256): READ 0x2694 thru 0x9cf8 (0x7665 bytes) 2023-07-14T18:17:18.196 INFO:tasks.workunit.client.0.smithi163.stdout:3543(215 mod 256): TRUNCATE DOWN from 0x9cf9 to 0x4d85 2023-07-14T18:17:18.196 INFO:tasks.workunit.client.0.smithi163.stdout:3544(216 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.196 INFO:tasks.workunit.client.0.smithi163.stdout:3545(217 mod 256): FALLOC 0x43a8c thru 0x4bd47 (0x82bb bytes) EXTENDING 2023-07-14T18:17:18.196 INFO:tasks.workunit.client.0.smithi163.stdout:3546(218 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.196 INFO:tasks.workunit.client.0.smithi163.stdout:3547(219 mod 256): MAPWRITE 0x4ef93 thru 0x5156b (0x25d9 bytes) 2023-07-14T18:17:18.196 INFO:tasks.workunit.client.0.smithi163.stdout:3548(220 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.196 INFO:tasks.workunit.client.0.smithi163.stdout:3549(221 mod 256): TRUNCATE UP from 0x5156c to 0x92df2 2023-07-14T18:17:18.196 INFO:tasks.workunit.client.0.smithi163.stdout:3550(222 mod 256): PUNCH 0x424d6 thru 0x448e6 (0x2411 bytes) 2023-07-14T18:17:18.197 INFO:tasks.workunit.client.0.smithi163.stdout:3551(223 mod 256): COPY 0x18145 thru 0x1feeb (0x7da7 bytes) to 0x93bcb thru 0x9b971 2023-07-14T18:17:18.197 INFO:tasks.workunit.client.0.smithi163.stdout:3552(224 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.197 INFO:tasks.workunit.client.0.smithi163.stdout:3553(225 mod 256): MAPREAD 0x418ca thru 0x4959c (0x7cd3 bytes) 2023-07-14T18:17:18.197 INFO:tasks.workunit.client.0.smithi163.stdout:3554(226 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.197 INFO:tasks.workunit.client.0.smithi163.stdout:3555(227 mod 256): MAPWRITE 0x94354 thru 0x99abd (0x576a bytes) 2023-07-14T18:17:18.197 INFO:tasks.workunit.client.0.smithi163.stdout:3556(228 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.197 INFO:tasks.workunit.client.0.smithi163.stdout:3557(229 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.197 INFO:tasks.workunit.client.0.smithi163.stdout:3558(230 mod 256): TRUNCATE DOWN from 0x9b972 to 0x500c1 2023-07-14T18:17:18.198 INFO:tasks.workunit.client.0.smithi163.stdout:3559(231 mod 256): WRITE 0xe73da thru 0xe8ed5 (0x1afc bytes) HOLE 2023-07-14T18:17:18.198 INFO:tasks.workunit.client.0.smithi163.stdout:3560(232 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.198 INFO:tasks.workunit.client.0.smithi163.stdout:3561(233 mod 256): MAPREAD 0x983e7 thru 0xa7535 (0xf14f bytes) 2023-07-14T18:17:18.198 INFO:tasks.workunit.client.0.smithi163.stdout:3562(234 mod 256): WRITE 0x375e3 thru 0x3796d (0x38b bytes) 2023-07-14T18:17:18.198 INFO:tasks.workunit.client.0.smithi163.stdout:3563(235 mod 256): MAPWRITE 0xdb745 thru 0xdc84a (0x1106 bytes) 2023-07-14T18:17:18.198 INFO:tasks.workunit.client.0.smithi163.stdout:3564(236 mod 256): MAPREAD 0x7d0cf thru 0x85956 (0x8888 bytes) 2023-07-14T18:17:18.198 INFO:tasks.workunit.client.0.smithi163.stdout:3565(237 mod 256): MAPREAD 0xccaac thru 0xd7847 (0xad9c bytes) 2023-07-14T18:17:18.198 INFO:tasks.workunit.client.0.smithi163.stdout:3566(238 mod 256): MAPREAD 0x13738 thru 0x18c3e (0x5507 bytes) 2023-07-14T18:17:18.199 INFO:tasks.workunit.client.0.smithi163.stdout:3567(239 mod 256): FALLOC 0x85e65 thru 0x921b8 (0xc353 bytes) INTERIOR 2023-07-14T18:17:18.199 INFO:tasks.workunit.client.0.smithi163.stdout:3568(240 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.199 INFO:tasks.workunit.client.0.smithi163.stdout:3569(241 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.199 INFO:tasks.workunit.client.0.smithi163.stdout:3570(242 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.199 INFO:tasks.workunit.client.0.smithi163.stdout:3571(243 mod 256): FALLOC 0x334a9 thru 0x42aa3 (0xf5fa bytes) INTERIOR ******FFFF 2023-07-14T18:17:18.199 INFO:tasks.workunit.client.0.smithi163.stdout:3572(244 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.199 INFO:tasks.workunit.client.0.smithi163.stdout:3573(245 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.199 INFO:tasks.workunit.client.0.smithi163.stdout:3574(246 mod 256): COPY 0x7fd30 thru 0x8cc22 (0xcef3 bytes) to 0xa78e4 thru 0xb47d6 2023-07-14T18:17:18.200 INFO:tasks.workunit.client.0.smithi163.stdout:3575(247 mod 256): PUNCH 0xc698f thru 0xcccab (0x631d bytes) 2023-07-14T18:17:18.200 INFO:tasks.workunit.client.0.smithi163.stdout:3576(248 mod 256): FALLOC 0xfae96 thru 0x100000 (0x516a bytes) PAST_EOF 2023-07-14T18:17:18.200 INFO:tasks.workunit.client.0.smithi163.stdout:3577(249 mod 256): FALLOC 0x7b7ba thru 0x8360e (0x7e54 bytes) INTERIOR 2023-07-14T18:17:18.200 INFO:tasks.workunit.client.0.smithi163.stdout:3578(250 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.200 INFO:tasks.workunit.client.0.smithi163.stdout:3579(251 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.200 INFO:tasks.workunit.client.0.smithi163.stdout:3580(252 mod 256): COPY 0x7be60 thru 0x89e9a (0xe03b bytes) to 0xb8b54 thru 0xc6b8e 2023-07-14T18:17:18.200 INFO:tasks.workunit.client.0.smithi163.stdout:3581(253 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.201 INFO:tasks.workunit.client.0.smithi163.stdout:3582(254 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.201 INFO:tasks.workunit.client.0.smithi163.stdout:3583(255 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.201 INFO:tasks.workunit.client.0.smithi163.stdout:3584( 0 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.201 INFO:tasks.workunit.client.0.smithi163.stdout:3585( 1 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.201 INFO:tasks.workunit.client.0.smithi163.stdout:3586( 2 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.201 INFO:tasks.workunit.client.0.smithi163.stdout:3587( 3 mod 256): COPY 0x61226 thru 0x6c5db (0xb3b6 bytes) to 0x87326 thru 0x926db 2023-07-14T18:17:18.201 INFO:tasks.workunit.client.0.smithi163.stdout:3588( 4 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.201 INFO:tasks.workunit.client.0.smithi163.stdout:3589( 5 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.202 INFO:tasks.workunit.client.0.smithi163.stdout:3590( 6 mod 256): READ 0xb3033 thru 0xbe39c (0xb36a bytes) 2023-07-14T18:17:18.202 INFO:tasks.workunit.client.0.smithi163.stdout:3591( 7 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.202 INFO:tasks.workunit.client.0.smithi163.stdout:3592( 8 mod 256): MAPWRITE 0xa1cac thru 0xadab5 (0xbe0a bytes) 2023-07-14T18:17:18.202 INFO:tasks.workunit.client.0.smithi163.stdout:3593( 9 mod 256): FALLOC 0xb20b0 thru 0xc0acb (0xea1b bytes) INTERIOR 2023-07-14T18:17:18.202 INFO:tasks.workunit.client.0.smithi163.stdout:3594( 10 mod 256): MAPWRITE 0xa06f thru 0x11385 (0x7317 bytes) 2023-07-14T18:17:18.202 INFO:tasks.workunit.client.0.smithi163.stdout:3595( 11 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.202 INFO:tasks.workunit.client.0.smithi163.stdout:3596( 12 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.202 INFO:tasks.workunit.client.0.smithi163.stdout:3597( 13 mod 256): TRUNCATE UP from 0xe8ed6 to 0xedb00 2023-07-14T18:17:18.202 INFO:tasks.workunit.client.0.smithi163.stdout:3598( 14 mod 256): TRUNCATE DOWN from 0xedb00 to 0x63fae 2023-07-14T18:17:18.203 INFO:tasks.workunit.client.0.smithi163.stdout:3599( 15 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.203 INFO:tasks.workunit.client.0.smithi163.stdout:3600( 16 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.203 INFO:tasks.workunit.client.0.smithi163.stdout:3601( 17 mod 256): READ 0x127d4 thru 0x1ca8e (0xa2bb bytes) 2023-07-14T18:17:18.203 INFO:tasks.workunit.client.0.smithi163.stdout:3602( 18 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.203 INFO:tasks.workunit.client.0.smithi163.stdout:3603( 19 mod 256): MAPREAD 0x5aed2 thru 0x5b84c (0x97b bytes) 2023-07-14T18:17:18.203 INFO:tasks.workunit.client.0.smithi163.stdout:3604( 20 mod 256): PUNCH 0x45f49 thru 0x4b8d7 (0x598f bytes) 2023-07-14T18:17:18.203 INFO:tasks.workunit.client.0.smithi163.stdout:3605( 21 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.203 INFO:tasks.workunit.client.0.smithi163.stdout:3606( 22 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.204 INFO:tasks.workunit.client.0.smithi163.stdout:3607( 23 mod 256): FALLOC 0xe1a13 thru 0xe76c3 (0x5cb0 bytes) PAST_EOF 2023-07-14T18:17:18.204 INFO:tasks.workunit.client.0.smithi163.stdout:3608( 24 mod 256): MAPREAD 0x62510 thru 0x63fad (0x1a9e bytes) 2023-07-14T18:17:18.204 INFO:tasks.workunit.client.0.smithi163.stdout:3609( 25 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.204 INFO:tasks.workunit.client.0.smithi163.stdout:3610( 26 mod 256): PUNCH 0x2ad2a thru 0x36164 (0xb43b bytes) 2023-07-14T18:17:18.204 INFO:tasks.workunit.client.0.smithi163.stdout:3611( 27 mod 256): TRUNCATE DOWN from 0x63fae to 0x4c65 ******WWWW 2023-07-14T18:17:18.204 INFO:tasks.workunit.client.0.smithi163.stdout:3612( 28 mod 256): WRITE 0xb9d01 thru 0xbea21 (0x4d21 bytes) HOLE ***WWWW 2023-07-14T18:17:18.204 INFO:tasks.workunit.client.0.smithi163.stdout:3613( 29 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.204 INFO:tasks.workunit.client.0.smithi163.stdout:3614( 30 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.205 INFO:tasks.workunit.client.0.smithi163.stdout:3615( 31 mod 256): FALLOC 0xbd0f6 thru 0xc6599 (0x94a3 bytes) EXTENDING 2023-07-14T18:17:18.205 INFO:tasks.workunit.client.0.smithi163.stdout:3616( 32 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.205 INFO:tasks.workunit.client.0.smithi163.stdout:3617( 33 mod 256): WRITE 0xf8a7b thru 0xfffff (0x7585 bytes) HOLE 2023-07-14T18:17:18.205 INFO:tasks.workunit.client.0.smithi163.stdout:3618( 34 mod 256): READ 0x728b4 thru 0x81928 (0xf075 bytes) 2023-07-14T18:17:18.205 INFO:tasks.workunit.client.0.smithi163.stdout:3619( 35 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.205 INFO:tasks.workunit.client.0.smithi163.stdout:3620( 36 mod 256): MAPREAD 0x59b02 thru 0x66169 (0xc668 bytes) 2023-07-14T18:17:18.205 INFO:tasks.workunit.client.0.smithi163.stdout:3621( 37 mod 256): WRITE 0xa6d9 thru 0x1a59f (0xfec7 bytes) 2023-07-14T18:17:18.205 INFO:tasks.workunit.client.0.smithi163.stdout:3622( 38 mod 256): FALLOC 0x51202 thru 0x5fd4a (0xeb48 bytes) INTERIOR 2023-07-14T18:17:18.206 INFO:tasks.workunit.client.0.smithi163.stdout:3623( 39 mod 256): TRUNCATE DOWN from 0x100000 to 0xf6afb 2023-07-14T18:17:18.206 INFO:tasks.workunit.client.0.smithi163.stdout:3624( 40 mod 256): FALLOC 0x177c2 thru 0x189ea (0x1228 bytes) INTERIOR 2023-07-14T18:17:18.206 INFO:tasks.workunit.client.0.smithi163.stdout:3625( 41 mod 256): WRITE 0x39d33 thru 0x41cea (0x7fb8 bytes) 2023-07-14T18:17:18.206 INFO:tasks.workunit.client.0.smithi163.stdout:3626( 42 mod 256): COPY 0xa11c1 thru 0xa6b10 (0x5950 bytes) to 0x6462f thru 0x69f7e 2023-07-14T18:17:18.206 INFO:tasks.workunit.client.0.smithi163.stdout:3627( 43 mod 256): PUNCH 0x9917e thru 0xa3314 (0xa197 bytes) 2023-07-14T18:17:18.206 INFO:tasks.workunit.client.0.smithi163.stdout:3628( 44 mod 256): PUNCH 0x3c680 thru 0x3fe8c (0x380d bytes) 2023-07-14T18:17:18.206 INFO:tasks.workunit.client.0.smithi163.stdout:3629( 45 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.207 INFO:tasks.workunit.client.0.smithi163.stdout:3630( 46 mod 256): FALLOC 0x7ecc9 thru 0x8694a (0x7c81 bytes) INTERIOR 2023-07-14T18:17:18.207 INFO:tasks.workunit.client.0.smithi163.stdout:3631( 47 mod 256): COPY 0x92f5e thru 0x9a14a (0x71ed bytes) to 0x3b6b3 thru 0x4289f 2023-07-14T18:17:18.207 INFO:tasks.workunit.client.0.smithi163.stdout:3632( 48 mod 256): READ 0xd8a64 thru 0xdcec5 (0x4462 bytes) 2023-07-14T18:17:18.207 INFO:tasks.workunit.client.0.smithi163.stdout:3633( 49 mod 256): READ 0x2fa8c thru 0x3622a (0x679f bytes) 2023-07-14T18:17:18.207 INFO:tasks.workunit.client.0.smithi163.stdout:3634( 50 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.207 INFO:tasks.workunit.client.0.smithi163.stdout:3635( 51 mod 256): WRITE 0x786d9 thru 0x7d789 (0x50b1 bytes) 2023-07-14T18:17:18.207 INFO:tasks.workunit.client.0.smithi163.stdout:3636( 52 mod 256): PUNCH 0x1dc4 thru 0xb14c (0x9389 bytes) 2023-07-14T18:17:18.207 INFO:tasks.workunit.client.0.smithi163.stdout:3637( 53 mod 256): FALLOC 0x31f0 thru 0xec32 (0xba42 bytes) INTERIOR 2023-07-14T18:17:18.207 INFO:tasks.workunit.client.0.smithi163.stdout:3638( 54 mod 256): MAPWRITE 0x4472e thru 0x500c7 (0xb99a bytes) 2023-07-14T18:17:18.208 INFO:tasks.workunit.client.0.smithi163.stdout:3639( 55 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.208 INFO:tasks.workunit.client.0.smithi163.stdout:3640( 56 mod 256): MAPWRITE 0x27781 thru 0x31875 (0xa0f5 bytes) 2023-07-14T18:17:18.208 INFO:tasks.workunit.client.0.smithi163.stdout:3641( 57 mod 256): READ 0x89031 thru 0x89437 (0x407 bytes) 2023-07-14T18:17:18.208 INFO:tasks.workunit.client.0.smithi163.stdout:3642( 58 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.208 INFO:tasks.workunit.client.0.smithi163.stdout:3643( 59 mod 256): FALLOC 0x98d05 thru 0xa3dbc (0xb0b7 bytes) INTERIOR 2023-07-14T18:17:18.208 INFO:tasks.workunit.client.0.smithi163.stdout:3644( 60 mod 256): WRITE 0xfe99c thru 0xfffff (0x1664 bytes) HOLE 2023-07-14T18:17:18.208 INFO:tasks.workunit.client.0.smithi163.stdout:3645( 61 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.209 INFO:tasks.workunit.client.0.smithi163.stdout:3646( 62 mod 256): FALLOC 0xa130b thru 0xaff1a (0xec0f bytes) INTERIOR 2023-07-14T18:17:18.209 INFO:tasks.workunit.client.0.smithi163.stdout:3647( 63 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.209 INFO:tasks.workunit.client.0.smithi163.stdout:3648( 64 mod 256): MAPREAD 0xdedb6 thru 0xe47cb (0x5a16 bytes) 2023-07-14T18:17:18.209 INFO:tasks.workunit.client.0.smithi163.stdout:3649( 65 mod 256): MAPREAD 0x690e9 thru 0x6bf6d (0x2e85 bytes) 2023-07-14T18:17:18.209 INFO:tasks.workunit.client.0.smithi163.stdout:3650( 66 mod 256): TRUNCATE DOWN from 0x100000 to 0x13aac ******WWWW 2023-07-14T18:17:18.209 INFO:tasks.workunit.client.0.smithi163.stdout:3651( 67 mod 256): COPY 0x1164b thru 0x13aab (0x2461 bytes) to 0x332f0 thru 0x35750 2023-07-14T18:17:18.209 INFO:tasks.workunit.client.0.smithi163.stdout:3652( 68 mod 256): COPY 0x10711 thru 0x18f68 (0x8858 bytes) to 0x84e2e thru 0x8d685 2023-07-14T18:17:18.209 INFO:tasks.workunit.client.0.smithi163.stdout:3653( 69 mod 256): WRITE 0x49af3 thru 0x50dfc (0x730a bytes) 2023-07-14T18:17:18.210 INFO:tasks.workunit.client.0.smithi163.stdout:3654( 70 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.210 INFO:tasks.workunit.client.0.smithi163.stdout:3655( 71 mod 256): FALLOC 0x257ce thru 0x323ed (0xcc1f bytes) INTERIOR 2023-07-14T18:17:18.210 INFO:tasks.workunit.client.0.smithi163.stdout:3656( 72 mod 256): MAPWRITE 0xb931d thru 0xc4dcc (0xbab0 bytes) 2023-07-14T18:17:18.210 INFO:tasks.workunit.client.0.smithi163.stdout:3657( 73 mod 256): FALLOC 0xec809 thru 0xf5f19 (0x9710 bytes) PAST_EOF 2023-07-14T18:17:18.210 INFO:tasks.workunit.client.0.smithi163.stdout:3658( 74 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.210 INFO:tasks.workunit.client.0.smithi163.stdout:3659( 75 mod 256): MAPWRITE 0x1b64b thru 0x26d06 (0xb6bc bytes) 2023-07-14T18:17:18.210 INFO:tasks.workunit.client.0.smithi163.stdout:3660( 76 mod 256): TRUNCATE DOWN from 0xc4dcd to 0x19473 ******WWWW 2023-07-14T18:17:18.210 INFO:tasks.workunit.client.0.smithi163.stdout:3661( 77 mod 256): MAPWRITE 0x1952e thru 0x2137e (0x7e51 bytes) 2023-07-14T18:17:18.211 INFO:tasks.workunit.client.0.smithi163.stdout:3662( 78 mod 256): FALLOC 0xe69e4 thru 0xeb16b (0x4787 bytes) PAST_EOF 2023-07-14T18:17:18.211 INFO:tasks.workunit.client.0.smithi163.stdout:3663( 79 mod 256): MAPWRITE 0x65801 thru 0x6cc7e (0x747e bytes) 2023-07-14T18:17:18.211 INFO:tasks.workunit.client.0.smithi163.stdout:3664( 80 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.211 INFO:tasks.workunit.client.0.smithi163.stdout:3665( 81 mod 256): READ 0x1119a thru 0x11e7e (0xce5 bytes) 2023-07-14T18:17:18.211 INFO:tasks.workunit.client.0.smithi163.stdout:3666( 82 mod 256): MAPWRITE 0x162b thru 0x5302 (0x3cd8 bytes) 2023-07-14T18:17:18.211 INFO:tasks.workunit.client.0.smithi163.stdout:3667( 83 mod 256): WRITE 0xcd1e1 thru 0xd183c (0x465c bytes) HOLE 2023-07-14T18:17:18.211 INFO:tasks.workunit.client.0.smithi163.stdout:3668( 84 mod 256): PUNCH 0x18cd thru 0x1089a (0xefce bytes) 2023-07-14T18:17:18.211 INFO:tasks.workunit.client.0.smithi163.stdout:3669( 85 mod 256): MAPWRITE 0xf9ec6 thru 0xfffff (0x613a bytes) 2023-07-14T18:17:18.212 INFO:tasks.workunit.client.0.smithi163.stdout:3670( 86 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.212 INFO:tasks.workunit.client.0.smithi163.stdout:3671( 87 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.212 INFO:tasks.workunit.client.0.smithi163.stdout:3672( 88 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.212 INFO:tasks.workunit.client.0.smithi163.stdout:3673( 89 mod 256): MAPWRITE 0x281bb thru 0x2a282 (0x20c8 bytes) 2023-07-14T18:17:18.212 INFO:tasks.workunit.client.0.smithi163.stdout:3674( 90 mod 256): MAPWRITE 0x8d0a5 thru 0x950fc (0x8058 bytes) 2023-07-14T18:17:18.212 INFO:tasks.workunit.client.0.smithi163.stdout:3675( 91 mod 256): WRITE 0x3a50b thru 0x4391d (0x9413 bytes) 2023-07-14T18:17:18.212 INFO:tasks.workunit.client.0.smithi163.stdout:3676( 92 mod 256): COPY 0xf650 thru 0x10e84 (0x1835 bytes) to 0x4d166 thru 0x4e99a 2023-07-14T18:17:18.212 INFO:tasks.workunit.client.0.smithi163.stdout:3677( 93 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.213 INFO:tasks.workunit.client.0.smithi163.stdout:3678( 94 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.213 INFO:tasks.workunit.client.0.smithi163.stdout:3679( 95 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.213 INFO:tasks.workunit.client.0.smithi163.stdout:3680( 96 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.213 INFO:tasks.workunit.client.0.smithi163.stdout:3681( 97 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.213 INFO:tasks.workunit.client.0.smithi163.stdout:3682( 98 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.213 INFO:tasks.workunit.client.0.smithi163.stdout:3683( 99 mod 256): READ 0x431da thru 0x4e65a (0xb481 bytes) 2023-07-14T18:17:18.213 INFO:tasks.workunit.client.0.smithi163.stdout:3684(100 mod 256): TRUNCATE DOWN from 0x100000 to 0x56e01 2023-07-14T18:17:18.213 INFO:tasks.workunit.client.0.smithi163.stdout:3685(101 mod 256): FALLOC 0xdc8e4 thru 0xe479f (0x7ebb bytes) EXTENDING 2023-07-14T18:17:18.214 INFO:tasks.workunit.client.0.smithi163.stdout:3686(102 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.214 INFO:tasks.workunit.client.0.smithi163.stdout:3687(103 mod 256): PUNCH 0x90a45 thru 0x970ca (0x6686 bytes) 2023-07-14T18:17:18.214 INFO:tasks.workunit.client.0.smithi163.stdout:3688(104 mod 256): COPY 0x7fc6e thru 0x8e8fe (0xec91 bytes) to 0xe799e thru 0xf662e 2023-07-14T18:17:18.214 INFO:tasks.workunit.client.0.smithi163.stdout:3689(105 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.214 INFO:tasks.workunit.client.0.smithi163.stdout:3690(106 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.214 INFO:tasks.workunit.client.0.smithi163.stdout:3691(107 mod 256): MAPWRITE 0xebc1d thru 0xfb924 (0xfd08 bytes) 2023-07-14T18:17:18.214 INFO:tasks.workunit.client.0.smithi163.stdout:3692(108 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.214 INFO:tasks.workunit.client.0.smithi163.stdout:3693(109 mod 256): FALLOC 0x6ea6c thru 0x7981a (0xadae bytes) INTERIOR 2023-07-14T18:17:18.215 INFO:tasks.workunit.client.0.smithi163.stdout:3694(110 mod 256): MAPWRITE 0x24f6f thru 0x302e6 (0xb378 bytes) 2023-07-14T18:17:18.215 INFO:tasks.workunit.client.0.smithi163.stdout:3695(111 mod 256): MAPWRITE 0xe807d thru 0xf793a (0xf8be bytes) 2023-07-14T18:17:18.215 INFO:tasks.workunit.client.0.smithi163.stdout:3696(112 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.215 INFO:tasks.workunit.client.0.smithi163.stdout:3697(113 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.215 INFO:tasks.workunit.client.0.smithi163.stdout:3698(114 mod 256): TRUNCATE DOWN from 0xfb925 to 0x34cd2 ******WWWW 2023-07-14T18:17:18.215 INFO:tasks.workunit.client.0.smithi163.stdout:3699(115 mod 256): COPY 0x22434 thru 0x29e60 (0x7a2d bytes) to 0x892c thru 0x10358 2023-07-14T18:17:18.215 INFO:tasks.workunit.client.0.smithi163.stdout:3700(116 mod 256): TRUNCATE UP from 0x34cd2 to 0x61778 ******WWWW 2023-07-14T18:17:18.215 INFO:tasks.workunit.client.0.smithi163.stdout:3701(117 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.215 INFO:tasks.workunit.client.0.smithi163.stdout:3702(118 mod 256): READ 0x494c6 thru 0x52df9 (0x9934 bytes) 2023-07-14T18:17:18.216 INFO:tasks.workunit.client.0.smithi163.stdout:3703(119 mod 256): PUNCH 0x34d7d thru 0x3b774 (0x69f8 bytes) ******PPPP 2023-07-14T18:17:18.216 INFO:tasks.workunit.client.0.smithi163.stdout:3704(120 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.216 INFO:tasks.workunit.client.0.smithi163.stdout:3705(121 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.216 INFO:tasks.workunit.client.0.smithi163.stdout:3706(122 mod 256): COPY 0x5a8c6 thru 0x61777 (0x6eb2 bytes) to 0xdc564 thru 0xe3415 2023-07-14T18:17:18.216 INFO:tasks.workunit.client.0.smithi163.stdout:3707(123 mod 256): PUNCH 0x657c6 thru 0x665cd (0xe08 bytes) 2023-07-14T18:17:18.216 INFO:tasks.workunit.client.0.smithi163.stdout:3708(124 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.216 INFO:tasks.workunit.client.0.smithi163.stdout:3709(125 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.217 INFO:tasks.workunit.client.0.smithi163.stdout:3710(126 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.217 INFO:tasks.workunit.client.0.smithi163.stdout:3711(127 mod 256): READ 0xab8c5 thru 0xabc99 (0x3d5 bytes) 2023-07-14T18:17:18.217 INFO:tasks.workunit.client.0.smithi163.stdout:3712(128 mod 256): COPY 0xae47c thru 0xbb448 (0xcfcd bytes) to 0x2d1af thru 0x3a17b ******EEEE 2023-07-14T18:17:18.217 INFO:tasks.workunit.client.0.smithi163.stdout:3713(129 mod 256): FALLOC 0x7ecf9 thru 0x88ab1 (0x9db8 bytes) INTERIOR 2023-07-14T18:17:18.217 INFO:tasks.workunit.client.0.smithi163.stdout:3714(130 mod 256): READ 0x1ce75 thru 0x2c931 (0xfabd bytes) 2023-07-14T18:17:18.217 INFO:tasks.workunit.client.0.smithi163.stdout:3715(131 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.217 INFO:tasks.workunit.client.0.smithi163.stdout:3716(132 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.217 INFO:tasks.workunit.client.0.smithi163.stdout:3717(133 mod 256): TRUNCATE DOWN from 0xe3416 to 0x5bc89 2023-07-14T18:17:18.218 INFO:tasks.workunit.client.0.smithi163.stdout:3718(134 mod 256): MAPREAD 0x20199 thru 0x2541a (0x5282 bytes) 2023-07-14T18:17:18.218 INFO:tasks.workunit.client.0.smithi163.stdout:3719(135 mod 256): WRITE 0xb53c8 thru 0xbffb9 (0xabf2 bytes) HOLE 2023-07-14T18:17:18.218 INFO:tasks.workunit.client.0.smithi163.stdout:3720(136 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.218 INFO:tasks.workunit.client.0.smithi163.stdout:3721(137 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.218 INFO:tasks.workunit.client.0.smithi163.stdout:3722(138 mod 256): MAPREAD 0x2abc3 thru 0x2ff34 (0x5372 bytes) 2023-07-14T18:17:18.218 INFO:tasks.workunit.client.0.smithi163.stdout:3723(139 mod 256): MAPREAD 0x6198f thru 0x67604 (0x5c76 bytes) 2023-07-14T18:17:18.218 INFO:tasks.workunit.client.0.smithi163.stdout:3724(140 mod 256): TRUNCATE DOWN from 0xbffba to 0x2aaef ******WWWW 2023-07-14T18:17:18.218 INFO:tasks.workunit.client.0.smithi163.stdout:3725(141 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.219 INFO:tasks.workunit.client.0.smithi163.stdout:3726(142 mod 256): MAPREAD 0x174f0 thru 0x24168 (0xcc79 bytes) 2023-07-14T18:17:18.219 INFO:tasks.workunit.client.0.smithi163.stdout:3727(143 mod 256): PUNCH 0x1e04d thru 0x25ce4 (0x7c98 bytes) 2023-07-14T18:17:18.219 INFO:tasks.workunit.client.0.smithi163.stdout:3728(144 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.219 INFO:tasks.workunit.client.0.smithi163.stdout:3729(145 mod 256): MAPREAD 0x12377 thru 0x1284a (0x4d4 bytes) 2023-07-14T18:17:18.219 INFO:tasks.workunit.client.0.smithi163.stdout:3730(146 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.219 INFO:tasks.workunit.client.0.smithi163.stdout:3731(147 mod 256): FALLOC 0x66599 thru 0x757ba (0xf221 bytes) EXTENDING 2023-07-14T18:17:18.219 INFO:tasks.workunit.client.0.smithi163.stdout:3732(148 mod 256): READ 0x37e71 thru 0x43714 (0xb8a4 bytes) ***RRRR*** 2023-07-14T18:17:18.219 INFO:tasks.workunit.client.0.smithi163.stdout:3733(149 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.220 INFO:tasks.workunit.client.0.smithi163.stdout:3734(150 mod 256): FALLOC 0xaae67 thru 0xb1f60 (0x70f9 bytes) PAST_EOF 2023-07-14T18:17:18.220 INFO:tasks.workunit.client.0.smithi163.stdout:3735(151 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.220 INFO:tasks.workunit.client.0.smithi163.stdout:3736(152 mod 256): WRITE 0xcd638 thru 0xd4f41 (0x790a bytes) HOLE 2023-07-14T18:17:18.220 INFO:tasks.workunit.client.0.smithi163.stdout:3737(153 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.220 INFO:tasks.workunit.client.0.smithi163.stdout:3738(154 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.220 INFO:tasks.workunit.client.0.smithi163.stdout:3739(155 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.220 INFO:tasks.workunit.client.0.smithi163.stdout:3740(156 mod 256): COPY 0x4e78d thru 0x561d8 (0x7a4c bytes) to 0x17181 thru 0x1ebcc 2023-07-14T18:17:18.220 INFO:tasks.workunit.client.0.smithi163.stdout:3741(157 mod 256): FALLOC 0x59405 thru 0x692ca (0xfec5 bytes) INTERIOR 2023-07-14T18:17:18.221 INFO:tasks.workunit.client.0.smithi163.stdout:3742(158 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.221 INFO:tasks.workunit.client.0.smithi163.stdout:3743(159 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.221 INFO:tasks.workunit.client.0.smithi163.stdout:3744(160 mod 256): WRITE 0xa9bf5 thru 0xaaaf9 (0xf05 bytes) 2023-07-14T18:17:18.221 INFO:tasks.workunit.client.0.smithi163.stdout:3745(161 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.221 INFO:tasks.workunit.client.0.smithi163.stdout:3746(162 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.221 INFO:tasks.workunit.client.0.smithi163.stdout:3747(163 mod 256): TRUNCATE DOWN from 0xd4f42 to 0x61efc 2023-07-14T18:17:18.221 INFO:tasks.workunit.client.0.smithi163.stdout:3748(164 mod 256): TRUNCATE DOWN from 0x61efc to 0x56c20 2023-07-14T18:17:18.221 INFO:tasks.workunit.client.0.smithi163.stdout:3749(165 mod 256): TRUNCATE UP from 0x56c20 to 0xd6597 2023-07-14T18:17:18.222 INFO:tasks.workunit.client.0.smithi163.stdout:3750(166 mod 256): PUNCH 0x6584e thru 0x6f868 (0xa01b bytes) 2023-07-14T18:17:18.222 INFO:tasks.workunit.client.0.smithi163.stdout:3751(167 mod 256): MAPWRITE 0x4f4ed thru 0x5e819 (0xf32d bytes) 2023-07-14T18:17:18.222 INFO:tasks.workunit.client.0.smithi163.stdout:3752(168 mod 256): WRITE 0x3c466 thru 0x3e3f4 (0x1f8f bytes) 2023-07-14T18:17:18.222 INFO:tasks.workunit.client.0.smithi163.stdout:3753(169 mod 256): TRUNCATE DOWN from 0xd6597 to 0x2ee02 ******WWWW 2023-07-14T18:17:18.222 INFO:tasks.workunit.client.0.smithi163.stdout:3754(170 mod 256): WRITE 0x24574 thru 0x29bdb (0x5668 bytes) 2023-07-14T18:17:18.222 INFO:tasks.workunit.client.0.smithi163.stdout:3755(171 mod 256): MAPWRITE 0x31b6b thru 0x39189 (0x761f bytes) ******WWWW 2023-07-14T18:17:18.222 INFO:tasks.workunit.client.0.smithi163.stdout:3756(172 mod 256): READ 0x39145 thru 0x39189 (0x45 bytes) 2023-07-14T18:17:18.222 INFO:tasks.workunit.client.0.smithi163.stdout:3757(173 mod 256): FALLOC 0x70c98 thru 0x736c7 (0x2a2f bytes) PAST_EOF 2023-07-14T18:17:18.223 INFO:tasks.workunit.client.0.smithi163.stdout:3758(174 mod 256): TRUNCATE UP from 0x3918a to 0x5405f 2023-07-14T18:17:18.223 INFO:tasks.workunit.client.0.smithi163.stdout:3759(175 mod 256): WRITE 0xf5c03 thru 0xff0d0 (0x94ce bytes) HOLE 2023-07-14T18:17:18.223 INFO:tasks.workunit.client.0.smithi163.stdout:3760(176 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.223 INFO:tasks.workunit.client.0.smithi163.stdout:3761(177 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.223 INFO:tasks.workunit.client.0.smithi163.stdout:3762(178 mod 256): WRITE 0xa4567 thru 0xb1a8f (0xd529 bytes) 2023-07-14T18:17:18.223 INFO:tasks.workunit.client.0.smithi163.stdout:3763(179 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.223 INFO:tasks.workunit.client.0.smithi163.stdout:3764(180 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.223 INFO:tasks.workunit.client.0.smithi163.stdout:3765(181 mod 256): PUNCH 0x1a1c6 thru 0x231dc (0x9017 bytes) 2023-07-14T18:17:18.224 INFO:tasks.workunit.client.0.smithi163.stdout:3766(182 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.224 INFO:tasks.workunit.client.0.smithi163.stdout:3767(183 mod 256): MAPREAD 0x69ebb thru 0x71b03 (0x7c49 bytes) 2023-07-14T18:17:18.224 INFO:tasks.workunit.client.0.smithi163.stdout:3768(184 mod 256): WRITE 0xb8072 thru 0xbeb18 (0x6aa7 bytes) 2023-07-14T18:17:18.224 INFO:tasks.workunit.client.0.smithi163.stdout:3769(185 mod 256): READ 0x4b811 thru 0x5a18e (0xe97e bytes) 2023-07-14T18:17:18.224 INFO:tasks.workunit.client.0.smithi163.stdout:3770(186 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.224 INFO:tasks.workunit.client.0.smithi163.stdout:3771(187 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.224 INFO:tasks.workunit.client.0.smithi163.stdout:3772(188 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.224 INFO:tasks.workunit.client.0.smithi163.stdout:3773(189 mod 256): READ 0x53b6d thru 0x5a8f0 (0x6d84 bytes) 2023-07-14T18:17:18.225 INFO:tasks.workunit.client.0.smithi163.stdout:3774(190 mod 256): MAPREAD 0x84e45 thru 0x8dc53 (0x8e0f bytes) 2023-07-14T18:17:18.225 INFO:tasks.workunit.client.0.smithi163.stdout:3775(191 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.225 INFO:tasks.workunit.client.0.smithi163.stdout:3776(192 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.225 INFO:tasks.workunit.client.0.smithi163.stdout:3777(193 mod 256): PUNCH 0x869e5 thru 0x8e73c (0x7d58 bytes) 2023-07-14T18:17:18.225 INFO:tasks.workunit.client.0.smithi163.stdout:3778(194 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.225 INFO:tasks.workunit.client.0.smithi163.stdout:3779(195 mod 256): TRUNCATE DOWN from 0xff0d1 to 0x46ebb 2023-07-14T18:17:18.225 INFO:tasks.workunit.client.0.smithi163.stdout:3780(196 mod 256): COPY 0x1bfc6 thru 0x238a4 (0x78df bytes) to 0xc4c5e thru 0xcc53c 2023-07-14T18:17:18.225 INFO:tasks.workunit.client.0.smithi163.stdout:3781(197 mod 256): COPY 0x19bf0 thru 0x22eb6 (0x92c7 bytes) to 0x72984 thru 0x7bc4a 2023-07-14T18:17:18.226 INFO:tasks.workunit.client.0.smithi163.stdout:3782(198 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.226 INFO:tasks.workunit.client.0.smithi163.stdout:3783(199 mod 256): PUNCH 0xbd6a3 thru 0xc3aaf (0x640d bytes) 2023-07-14T18:17:18.226 INFO:tasks.workunit.client.0.smithi163.stdout:3784(200 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.226 INFO:tasks.workunit.client.0.smithi163.stdout:3785(201 mod 256): TRUNCATE DOWN from 0xcc53d to 0x89cd3 2023-07-14T18:17:18.226 INFO:tasks.workunit.client.0.smithi163.stdout:3786(202 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.226 INFO:tasks.workunit.client.0.smithi163.stdout:3787(203 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.226 INFO:tasks.workunit.client.0.smithi163.stdout:3788(204 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.226 INFO:tasks.workunit.client.0.smithi163.stdout:3789(205 mod 256): PUNCH 0x5f15a thru 0x63507 (0x43ae bytes) 2023-07-14T18:17:18.227 INFO:tasks.workunit.client.0.smithi163.stdout:3790(206 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.227 INFO:tasks.workunit.client.0.smithi163.stdout:3791(207 mod 256): READ 0x4d0ff thru 0x53eed (0x6def bytes) 2023-07-14T18:17:18.227 INFO:tasks.workunit.client.0.smithi163.stdout:3792(208 mod 256): MAPREAD 0x83a3e thru 0x89cd2 (0x6295 bytes) 2023-07-14T18:17:18.227 INFO:tasks.workunit.client.0.smithi163.stdout:3793(209 mod 256): WRITE 0x1a469 thru 0x23510 (0x90a8 bytes) 2023-07-14T18:17:18.227 INFO:tasks.workunit.client.0.smithi163.stdout:3794(210 mod 256): MAPWRITE 0xe119 thru 0x1a012 (0xbefa bytes) 2023-07-14T18:17:18.227 INFO:tasks.workunit.client.0.smithi163.stdout:3795(211 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.227 INFO:tasks.workunit.client.0.smithi163.stdout:3796(212 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.227 INFO:tasks.workunit.client.0.smithi163.stdout:3797(213 mod 256): COPY 0x64ab7 thru 0x6d080 (0x85ca bytes) to 0xed1b8 thru 0xf5781 2023-07-14T18:17:18.228 INFO:tasks.workunit.client.0.smithi163.stdout:3798(214 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.228 INFO:tasks.workunit.client.0.smithi163.stdout:3799(215 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.228 INFO:tasks.workunit.client.0.smithi163.stdout:3800(216 mod 256): MAPWRITE 0xf4319 thru 0xfed00 (0xa9e8 bytes) 2023-07-14T18:17:18.228 INFO:tasks.workunit.client.0.smithi163.stdout:3801(217 mod 256): PUNCH 0x2374d thru 0x29ceb (0x659f bytes) 2023-07-14T18:17:18.228 INFO:tasks.workunit.client.0.smithi163.stdout:3802(218 mod 256): READ 0xd441f thru 0xd85a4 (0x4186 bytes) 2023-07-14T18:17:18.228 INFO:tasks.workunit.client.0.smithi163.stdout:3803(219 mod 256): WRITE 0x23ddc thru 0x29e38 (0x605d bytes) 2023-07-14T18:17:18.228 INFO:tasks.workunit.client.0.smithi163.stdout:3804(220 mod 256): COPY 0x6c50 thru 0xf61d (0x89ce bytes) to 0x17b66 thru 0x20533 2023-07-14T18:17:18.228 INFO:tasks.workunit.client.0.smithi163.stdout:3805(221 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.229 INFO:tasks.workunit.client.0.smithi163.stdout:3806(222 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.229 INFO:tasks.workunit.client.0.smithi163.stdout:3807(223 mod 256): COPY 0x38759 thru 0x40dc6 (0x866e bytes) to 0xf2f2e thru 0xfb59b 2023-07-14T18:17:18.229 INFO:tasks.workunit.client.0.smithi163.stdout:3808(224 mod 256): MAPREAD 0x9b358 thru 0xa2030 (0x6cd9 bytes) 2023-07-14T18:17:18.229 INFO:tasks.workunit.client.0.smithi163.stdout:3809(225 mod 256): READ 0x9a3e2 thru 0x9d5a5 (0x31c4 bytes) 2023-07-14T18:17:18.229 INFO:tasks.workunit.client.0.smithi163.stdout:3810(226 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.229 INFO:tasks.workunit.client.0.smithi163.stdout:3811(227 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.229 INFO:tasks.workunit.client.0.smithi163.stdout:3812(228 mod 256): READ 0xa52ec thru 0xb0ac3 (0xb7d8 bytes) 2023-07-14T18:17:18.229 INFO:tasks.workunit.client.0.smithi163.stdout:3813(229 mod 256): FALLOC 0xd9778 thru 0xe30e2 (0x996a bytes) INTERIOR 2023-07-14T18:17:18.230 INFO:tasks.workunit.client.0.smithi163.stdout:3814(230 mod 256): TRUNCATE DOWN from 0xfed01 to 0xe1767 2023-07-14T18:17:18.230 INFO:tasks.workunit.client.0.smithi163.stdout:3815(231 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.230 INFO:tasks.workunit.client.0.smithi163.stdout:3816(232 mod 256): TRUNCATE DOWN from 0xe1767 to 0x54842 2023-07-14T18:17:18.230 INFO:tasks.workunit.client.0.smithi163.stdout:3817(233 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.230 INFO:tasks.workunit.client.0.smithi163.stdout:3818(234 mod 256): PUNCH 0x2b7bf thru 0x3acd6 (0xf518 bytes) ******PPPP 2023-07-14T18:17:18.230 INFO:tasks.workunit.client.0.smithi163.stdout:3819(235 mod 256): COPY 0x2c5a9 thru 0x308ed (0x4345 bytes) to 0xce19b thru 0xd24df 2023-07-14T18:17:18.230 INFO:tasks.workunit.client.0.smithi163.stdout:3820(236 mod 256): READ 0xbe2c4 thru 0xca073 (0xbdb0 bytes) 2023-07-14T18:17:18.230 INFO:tasks.workunit.client.0.smithi163.stdout:3821(237 mod 256): READ 0x5e94d thru 0x5faef (0x11a3 bytes) 2023-07-14T18:17:18.231 INFO:tasks.workunit.client.0.smithi163.stdout:3822(238 mod 256): WRITE 0x1c525 thru 0x26916 (0xa3f2 bytes) 2023-07-14T18:17:18.231 INFO:tasks.workunit.client.0.smithi163.stdout:3823(239 mod 256): READ 0x1f32d thru 0x29c71 (0xa945 bytes) 2023-07-14T18:17:18.231 INFO:tasks.workunit.client.0.smithi163.stdout:3824(240 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.231 INFO:tasks.workunit.client.0.smithi163.stdout:3825(241 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.231 INFO:tasks.workunit.client.0.smithi163.stdout:3826(242 mod 256): TRUNCATE DOWN from 0xd24e0 to 0x819db 2023-07-14T18:17:18.231 INFO:tasks.workunit.client.0.smithi163.stdout:3827(243 mod 256): MAPREAD 0x6ca45 thru 0x7705d (0xa619 bytes) 2023-07-14T18:17:18.231 INFO:tasks.workunit.client.0.smithi163.stdout:3828(244 mod 256): MAPREAD 0x4bd82 thru 0x510a4 (0x5323 bytes) 2023-07-14T18:17:18.231 INFO:tasks.workunit.client.0.smithi163.stdout:3829(245 mod 256): COPY 0x41759 thru 0x4f3a6 (0xdc4e bytes) to 0x1460a thru 0x22257 2023-07-14T18:17:18.232 INFO:tasks.workunit.client.0.smithi163.stdout:3830(246 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.232 INFO:tasks.workunit.client.0.smithi163.stdout:3831(247 mod 256): TRUNCATE DOWN from 0x819db to 0x6837c 2023-07-14T18:17:18.232 INFO:tasks.workunit.client.0.smithi163.stdout:3832(248 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.232 INFO:tasks.workunit.client.0.smithi163.stdout:3833(249 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.232 INFO:tasks.workunit.client.0.smithi163.stdout:3834(250 mod 256): COPY 0x661fe thru 0x6837b (0x217e bytes) to 0x9598c thru 0x97b09 2023-07-14T18:17:18.232 INFO:tasks.workunit.client.0.smithi163.stdout:3835(251 mod 256): FALLOC 0x9ff39 thru 0xa6f53 (0x701a bytes) EXTENDING 2023-07-14T18:17:18.232 INFO:tasks.workunit.client.0.smithi163.stdout:3836(252 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.232 INFO:tasks.workunit.client.0.smithi163.stdout:3837(253 mod 256): FALLOC 0x15521 thru 0x20fef (0xbace bytes) INTERIOR 2023-07-14T18:17:18.233 INFO:tasks.workunit.client.0.smithi163.stdout:3838(254 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.233 INFO:tasks.workunit.client.0.smithi163.stdout:3839(255 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.233 INFO:tasks.workunit.client.0.smithi163.stdout:3840( 0 mod 256): FALLOC 0x4af89 thru 0x5418f (0x9206 bytes) INTERIOR 2023-07-14T18:17:18.233 INFO:tasks.workunit.client.0.smithi163.stdout:3841( 1 mod 256): TRUNCATE DOWN from 0xa6f53 to 0x4a1f6 2023-07-14T18:17:18.233 INFO:tasks.workunit.client.0.smithi163.stdout:3842( 2 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.233 INFO:tasks.workunit.client.0.smithi163.stdout:3843( 3 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.233 INFO:tasks.workunit.client.0.smithi163.stdout:3844( 4 mod 256): MAPREAD 0xa6db thru 0xd0ae (0x29d4 bytes) 2023-07-14T18:17:18.233 INFO:tasks.workunit.client.0.smithi163.stdout:3845( 5 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.234 INFO:tasks.workunit.client.0.smithi163.stdout:3846( 6 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.234 INFO:tasks.workunit.client.0.smithi163.stdout:3847( 7 mod 256): TRUNCATE DOWN from 0x4a1f6 to 0x40cae 2023-07-14T18:17:18.234 INFO:tasks.workunit.client.0.smithi163.stdout:3848( 8 mod 256): FALLOC 0xe1d89 thru 0xe1eb7 (0x12e bytes) PAST_EOF 2023-07-14T18:17:18.234 INFO:tasks.workunit.client.0.smithi163.stdout:3849( 9 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.234 INFO:tasks.workunit.client.0.smithi163.stdout:3850( 10 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.234 INFO:tasks.workunit.client.0.smithi163.stdout:3851( 11 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.234 INFO:tasks.workunit.client.0.smithi163.stdout:3852( 12 mod 256): WRITE 0xf5361 thru 0xf6729 (0x13c9 bytes) HOLE 2023-07-14T18:17:18.234 INFO:tasks.workunit.client.0.smithi163.stdout:3853( 13 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.235 INFO:tasks.workunit.client.0.smithi163.stdout:3854( 14 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.235 INFO:tasks.workunit.client.0.smithi163.stdout:3855( 15 mod 256): MAPWRITE 0xde5c4 thru 0xeb111 (0xcb4e bytes) 2023-07-14T18:17:18.235 INFO:tasks.workunit.client.0.smithi163.stdout:3856( 16 mod 256): FALLOC 0x16e6a thru 0x1d133 (0x62c9 bytes) INTERIOR 2023-07-14T18:17:18.235 INFO:tasks.workunit.client.0.smithi163.stdout:3857( 17 mod 256): COPY 0x4acd thru 0x13c5d (0xf191 bytes) to 0x4fa57 thru 0x5ebe7 2023-07-14T18:17:18.235 INFO:tasks.workunit.client.0.smithi163.stdout:3858( 18 mod 256): PUNCH 0x4355b thru 0x4d7b0 (0xa256 bytes) 2023-07-14T18:17:18.235 INFO:tasks.workunit.client.0.smithi163.stdout:3859( 19 mod 256): COPY 0xc9c33 thru 0xd4ddf (0xb1ad bytes) to 0x1830a thru 0x234b6 2023-07-14T18:17:18.235 INFO:tasks.workunit.client.0.smithi163.stdout:3860( 20 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.235 INFO:tasks.workunit.client.0.smithi163.stdout:3861( 21 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.236 INFO:tasks.workunit.client.0.smithi163.stdout:3862( 22 mod 256): READ 0x32b0a thru 0x3385f (0xd56 bytes) 2023-07-14T18:17:18.236 INFO:tasks.workunit.client.0.smithi163.stdout:3863( 23 mod 256): TRUNCATE DOWN from 0xf672a to 0xf1417 2023-07-14T18:17:18.236 INFO:tasks.workunit.client.0.smithi163.stdout:3864( 24 mod 256): MAPREAD 0x46fed thru 0x54774 (0xd788 bytes) 2023-07-14T18:17:18.236 INFO:tasks.workunit.client.0.smithi163.stdout:3865( 25 mod 256): FALLOC 0xf541a thru 0xfa500 (0x50e6 bytes) EXTENDING 2023-07-14T18:17:18.236 INFO:tasks.workunit.client.0.smithi163.stdout:3866( 26 mod 256): READ 0x1454c thru 0x23c62 (0xf717 bytes) 2023-07-14T18:17:18.236 INFO:tasks.workunit.client.0.smithi163.stdout:3867( 27 mod 256): COPY 0xdab5c thru 0xdf92c (0x4dd1 bytes) to 0x56ff6 thru 0x5bdc6 2023-07-14T18:17:18.236 INFO:tasks.workunit.client.0.smithi163.stdout:3868( 28 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.236 INFO:tasks.workunit.client.0.smithi163.stdout:3869( 29 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.237 INFO:tasks.workunit.client.0.smithi163.stdout:3870( 30 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.237 INFO:tasks.workunit.client.0.smithi163.stdout:3871( 31 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.237 INFO:tasks.workunit.client.0.smithi163.stdout:3872( 32 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.237 INFO:tasks.workunit.client.0.smithi163.stdout:3873( 33 mod 256): TRUNCATE DOWN from 0xfa500 to 0xd9665 2023-07-14T18:17:18.237 INFO:tasks.workunit.client.0.smithi163.stdout:3874( 34 mod 256): PUNCH 0x2d3df thru 0x320d5 (0x4cf7 bytes) 2023-07-14T18:17:18.237 INFO:tasks.workunit.client.0.smithi163.stdout:3875( 35 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.237 INFO:tasks.workunit.client.0.smithi163.stdout:3876( 36 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.237 INFO:tasks.workunit.client.0.smithi163.stdout:3877( 37 mod 256): PUNCH 0x8140e thru 0x9073c (0xf32f bytes) 2023-07-14T18:17:18.238 INFO:tasks.workunit.client.0.smithi163.stdout:3878( 38 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.238 INFO:tasks.workunit.client.0.smithi163.stdout:3879( 39 mod 256): MAPREAD 0x184f7 thru 0x25b4a (0xd654 bytes) 2023-07-14T18:17:18.238 INFO:tasks.workunit.client.0.smithi163.stdout:3880( 40 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.238 INFO:tasks.workunit.client.0.smithi163.stdout:3881( 41 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.238 INFO:tasks.workunit.client.0.smithi163.stdout:3882( 42 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.238 INFO:tasks.workunit.client.0.smithi163.stdout:3883( 43 mod 256): PUNCH 0x611c2 thru 0x67eaa (0x6ce9 bytes) 2023-07-14T18:17:18.238 INFO:tasks.workunit.client.0.smithi163.stdout:3884( 44 mod 256): READ 0x76038 thru 0x77732 (0x16fb bytes) 2023-07-14T18:17:18.238 INFO:tasks.workunit.client.0.smithi163.stdout:3885( 45 mod 256): COPY 0x99005 thru 0xa7a1c (0xea18 bytes) to 0x1fc1f thru 0x2e636 2023-07-14T18:17:18.239 INFO:tasks.workunit.client.0.smithi163.stdout:3886( 46 mod 256): READ 0xb53e4 thru 0xbd05b (0x7c78 bytes) 2023-07-14T18:17:18.239 INFO:tasks.workunit.client.0.smithi163.stdout:3887( 47 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.239 INFO:tasks.workunit.client.0.smithi163.stdout:3888( 48 mod 256): PUNCH 0x4073b thru 0x46e58 (0x671e bytes) 2023-07-14T18:17:18.239 INFO:tasks.workunit.client.0.smithi163.stdout:3889( 49 mod 256): MAPWRITE 0x51e13 thru 0x5844f (0x663d bytes) 2023-07-14T18:17:18.239 INFO:tasks.workunit.client.0.smithi163.stdout:3890( 50 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.239 INFO:tasks.workunit.client.0.smithi163.stdout:3891( 51 mod 256): TRUNCATE DOWN from 0xd9665 to 0x6b15e 2023-07-14T18:17:18.239 INFO:tasks.workunit.client.0.smithi163.stdout:3892( 52 mod 256): MAPWRITE 0x28045 thru 0x2f986 (0x7942 bytes) 2023-07-14T18:17:18.239 INFO:tasks.workunit.client.0.smithi163.stdout:3893( 53 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.240 INFO:tasks.workunit.client.0.smithi163.stdout:3894( 54 mod 256): COPY 0x3fd9f thru 0x43250 (0x34b2 bytes) to 0x91e87 thru 0x95338 2023-07-14T18:17:18.240 INFO:tasks.workunit.client.0.smithi163.stdout:3895( 55 mod 256): COPY 0x35d5d thru 0x3e0e6 (0x838a bytes) to 0xb9d67 thru 0xc20f0 EEEE****** 2023-07-14T18:17:18.240 INFO:tasks.workunit.client.0.smithi163.stdout:3896( 56 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.240 INFO:tasks.workunit.client.0.smithi163.stdout:3897( 57 mod 256): PUNCH 0x6727e thru 0x73d88 (0xcb0b bytes) 2023-07-14T18:17:18.240 INFO:tasks.workunit.client.0.smithi163.stdout:3898( 58 mod 256): MAPWRITE 0x812f3 thru 0x8c452 (0xb160 bytes) 2023-07-14T18:17:18.240 INFO:tasks.workunit.client.0.smithi163.stdout:3899( 59 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.240 INFO:tasks.workunit.client.0.smithi163.stdout:3900( 60 mod 256): MAPWRITE 0xe2028 thru 0xe5afd (0x3ad6 bytes) 2023-07-14T18:17:18.240 INFO:tasks.workunit.client.0.smithi163.stdout:3901( 61 mod 256): MAPWRITE 0x42a4 thru 0xcb78 (0x88d5 bytes) 2023-07-14T18:17:18.241 INFO:tasks.workunit.client.0.smithi163.stdout:3902( 62 mod 256): READ 0x30337 thru 0x3ed42 (0xea0c bytes) ***RRRR*** 2023-07-14T18:17:18.241 INFO:tasks.workunit.client.0.smithi163.stdout:3903( 63 mod 256): TRUNCATE UP from 0xe5afe to 0xf75a6 2023-07-14T18:17:18.241 INFO:tasks.workunit.client.0.smithi163.stdout:3904( 64 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.241 INFO:tasks.workunit.client.0.smithi163.stdout:3905( 65 mod 256): READ 0xebaaa thru 0xeed8d (0x32e4 bytes) 2023-07-14T18:17:18.241 INFO:tasks.workunit.client.0.smithi163.stdout:3906( 66 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.241 INFO:tasks.workunit.client.0.smithi163.stdout:3907( 67 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.241 INFO:tasks.workunit.client.0.smithi163.stdout:3908( 68 mod 256): FALLOC 0x486cb thru 0x4f6b5 (0x6fea bytes) INTERIOR 2023-07-14T18:17:18.241 INFO:tasks.workunit.client.0.smithi163.stdout:3909( 69 mod 256): MAPWRITE 0xd50ff thru 0xd893a (0x383c bytes) 2023-07-14T18:17:18.242 INFO:tasks.workunit.client.0.smithi163.stdout:3910( 70 mod 256): MAPWRITE 0x45fab thru 0x4e6a0 (0x86f6 bytes) 2023-07-14T18:17:18.242 INFO:tasks.workunit.client.0.smithi163.stdout:3911( 71 mod 256): WRITE 0xcbded thru 0xceb7e (0x2d92 bytes) 2023-07-14T18:17:18.242 INFO:tasks.workunit.client.0.smithi163.stdout:3912( 72 mod 256): MAPREAD 0x6ca69 thru 0x740f2 (0x768a bytes) 2023-07-14T18:17:18.242 INFO:tasks.workunit.client.0.smithi163.stdout:3913( 73 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.242 INFO:tasks.workunit.client.0.smithi163.stdout:3914( 74 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.242 INFO:tasks.workunit.client.0.smithi163.stdout:3915( 75 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.242 INFO:tasks.workunit.client.0.smithi163.stdout:3916( 76 mod 256): WRITE 0xa22c4 thru 0xaff66 (0xdca3 bytes) 2023-07-14T18:17:18.242 INFO:tasks.workunit.client.0.smithi163.stdout:3917( 77 mod 256): READ 0x73fd6 thru 0x74085 (0xb0 bytes) 2023-07-14T18:17:18.243 INFO:tasks.workunit.client.0.smithi163.stdout:3918( 78 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.243 INFO:tasks.workunit.client.0.smithi163.stdout:3919( 79 mod 256): COPY 0xf6521 thru 0xf75a5 (0x1085 bytes) to 0x60615 thru 0x61699 2023-07-14T18:17:18.243 INFO:tasks.workunit.client.0.smithi163.stdout:3920( 80 mod 256): MAPWRITE 0x4af57 thru 0x505f7 (0x56a1 bytes) 2023-07-14T18:17:18.243 INFO:tasks.workunit.client.0.smithi163.stdout:3921( 81 mod 256): MAPWRITE 0x210d0 thru 0x2312a (0x205b bytes) 2023-07-14T18:17:18.243 INFO:tasks.workunit.client.0.smithi163.stdout:3922( 82 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.243 INFO:tasks.workunit.client.0.smithi163.stdout:3923( 83 mod 256): READ 0xae6c thru 0xc592 (0x1727 bytes) 2023-07-14T18:17:18.243 INFO:tasks.workunit.client.0.smithi163.stdout:3924( 84 mod 256): WRITE 0x9b8cb thru 0x9f3ac (0x3ae2 bytes) 2023-07-14T18:17:18.243 INFO:tasks.workunit.client.0.smithi163.stdout:3925( 85 mod 256): READ 0x39a4c thru 0x401f5 (0x67aa bytes) 2023-07-14T18:17:18.244 INFO:tasks.workunit.client.0.smithi163.stdout:3926( 86 mod 256): MAPREAD 0x49e89 thru 0x4b319 (0x1491 bytes) 2023-07-14T18:17:18.244 INFO:tasks.workunit.client.0.smithi163.stdout:3927( 87 mod 256): MAPWRITE 0xda281 thru 0xe8671 (0xe3f1 bytes) 2023-07-14T18:17:18.244 INFO:tasks.workunit.client.0.smithi163.stdout:3928( 88 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.244 INFO:tasks.workunit.client.0.smithi163.stdout:3929( 89 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.244 INFO:tasks.workunit.client.0.smithi163.stdout:3930( 90 mod 256): PUNCH 0x65e28 thru 0x730cd (0xd2a6 bytes) 2023-07-14T18:17:18.244 INFO:tasks.workunit.client.0.smithi163.stdout:3931( 91 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.244 INFO:tasks.workunit.client.0.smithi163.stdout:3932( 92 mod 256): FALLOC 0x38393 thru 0x43bec (0xb859 bytes) INTERIOR 2023-07-14T18:17:18.244 INFO:tasks.workunit.client.0.smithi163.stdout:3933( 93 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.245 INFO:tasks.workunit.client.0.smithi163.stdout:3934( 94 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.245 INFO:tasks.workunit.client.0.smithi163.stdout:3935( 95 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.245 INFO:tasks.workunit.client.0.smithi163.stdout:3936( 96 mod 256): READ 0x3c033 thru 0x3db5a (0x1b28 bytes) 2023-07-14T18:17:18.245 INFO:tasks.workunit.client.0.smithi163.stdout:3937( 97 mod 256): MAPREAD 0xcfbf3 thru 0xd3602 (0x3a10 bytes) 2023-07-14T18:17:18.245 INFO:tasks.workunit.client.0.smithi163.stdout:3938( 98 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.245 INFO:tasks.workunit.client.0.smithi163.stdout:3939( 99 mod 256): TRUNCATE DOWN from 0xf75a6 to 0x5142a 2023-07-14T18:17:18.245 INFO:tasks.workunit.client.0.smithi163.stdout:3940(100 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.245 INFO:tasks.workunit.client.0.smithi163.stdout:3941(101 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.246 INFO:tasks.workunit.client.0.smithi163.stdout:3942(102 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.246 INFO:tasks.workunit.client.0.smithi163.stdout:3943(103 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.246 INFO:tasks.workunit.client.0.smithi163.stdout:3944(104 mod 256): FALLOC 0xf2280 thru 0x100000 (0xdd80 bytes) PAST_EOF 2023-07-14T18:17:18.246 INFO:tasks.workunit.client.0.smithi163.stdout:3945(105 mod 256): WRITE 0x883e2 thru 0x90a99 (0x86b8 bytes) HOLE 2023-07-14T18:17:18.246 INFO:tasks.workunit.client.0.smithi163.stdout:3946(106 mod 256): TRUNCATE UP from 0x90a9a to 0xd280b 2023-07-14T18:17:18.246 INFO:tasks.workunit.client.0.smithi163.stdout:3947(107 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.246 INFO:tasks.workunit.client.0.smithi163.stdout:3948(108 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.246 INFO:tasks.workunit.client.0.smithi163.stdout:3949(109 mod 256): MAPREAD 0x8e795 thru 0x93bde (0x544a bytes) 2023-07-14T18:17:18.247 INFO:tasks.workunit.client.0.smithi163.stdout:3950(110 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.247 INFO:tasks.workunit.client.0.smithi163.stdout:3951(111 mod 256): COPY 0xaf03a thru 0xaf2b5 (0x27c bytes) to 0xd04a3 thru 0xd071e 2023-07-14T18:17:18.247 INFO:tasks.workunit.client.0.smithi163.stdout:3952(112 mod 256): FALLOC 0x8bcb8 thru 0x9a91d (0xec65 bytes) INTERIOR 2023-07-14T18:17:18.247 INFO:tasks.workunit.client.0.smithi163.stdout:3953(113 mod 256): MAPREAD 0xb06a3 thru 0xb886e (0x81cc bytes) 2023-07-14T18:17:18.247 INFO:tasks.workunit.client.0.smithi163.stdout:3954(114 mod 256): FALLOC 0x486ca thru 0x49dcd (0x1703 bytes) INTERIOR 2023-07-14T18:17:18.247 INFO:tasks.workunit.client.0.smithi163.stdout:3955(115 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.247 INFO:tasks.workunit.client.0.smithi163.stdout:3956(116 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.247 INFO:tasks.workunit.client.0.smithi163.stdout:3957(117 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.248 INFO:tasks.workunit.client.0.smithi163.stdout:3958(118 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.248 INFO:tasks.workunit.client.0.smithi163.stdout:3959(119 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.248 INFO:tasks.workunit.client.0.smithi163.stdout:3960(120 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.248 INFO:tasks.workunit.client.0.smithi163.stdout:3961(121 mod 256): WRITE 0x2986 thru 0x11bc6 (0xf241 bytes) 2023-07-14T18:17:18.248 INFO:tasks.workunit.client.0.smithi163.stdout:3962(122 mod 256): READ 0x17df1 thru 0x18078 (0x288 bytes) 2023-07-14T18:17:18.248 INFO:tasks.workunit.client.0.smithi163.stdout:3963(123 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.248 INFO:tasks.workunit.client.0.smithi163.stdout:3964(124 mod 256): MAPREAD 0x349de thru 0x3a096 (0x56b9 bytes) ***RRRR*** 2023-07-14T18:17:18.248 INFO:tasks.workunit.client.0.smithi163.stdout:3965(125 mod 256): READ 0x1a76b thru 0x21053 (0x68e9 bytes) 2023-07-14T18:17:18.249 INFO:tasks.workunit.client.0.smithi163.stdout:3966(126 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.249 INFO:tasks.workunit.client.0.smithi163.stdout:3967(127 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.249 INFO:tasks.workunit.client.0.smithi163.stdout:3968(128 mod 256): MAPREAD 0x88225 thru 0x919db (0x97b7 bytes) 2023-07-14T18:17:18.249 INFO:tasks.workunit.client.0.smithi163.stdout:3969(129 mod 256): MAPREAD 0x7abd thru 0x11d56 (0xa29a bytes) 2023-07-14T18:17:18.249 INFO:tasks.workunit.client.0.smithi163.stdout:3970(130 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.249 INFO:tasks.workunit.client.0.smithi163.stdout:3971(131 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.249 INFO:tasks.workunit.client.0.smithi163.stdout:3972(132 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.249 INFO:tasks.workunit.client.0.smithi163.stdout:3973(133 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.250 INFO:tasks.workunit.client.0.smithi163.stdout:3974(134 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.250 INFO:tasks.workunit.client.0.smithi163.stdout:3975(135 mod 256): READ 0xb514c thru 0xc3c02 (0xeab7 bytes) 2023-07-14T18:17:18.250 INFO:tasks.workunit.client.0.smithi163.stdout:3976(136 mod 256): WRITE 0x68228 thru 0x76e9c (0xec75 bytes) 2023-07-14T18:17:18.250 INFO:tasks.workunit.client.0.smithi163.stdout:3977(137 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.250 INFO:tasks.workunit.client.0.smithi163.stdout:3978(138 mod 256): READ 0x1d827 thru 0x259e4 (0x81be bytes) 2023-07-14T18:17:18.250 INFO:tasks.workunit.client.0.smithi163.stdout:3979(139 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.250 INFO:tasks.workunit.client.0.smithi163.stdout:3980(140 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.250 INFO:tasks.workunit.client.0.smithi163.stdout:3981(141 mod 256): READ 0xb4e0e thru 0xc011b (0xb30e bytes) 2023-07-14T18:17:18.251 INFO:tasks.workunit.client.0.smithi163.stdout:3982(142 mod 256): FALLOC 0xb69f5 thru 0xbf3f7 (0x8a02 bytes) INTERIOR 2023-07-14T18:17:18.251 INFO:tasks.workunit.client.0.smithi163.stdout:3983(143 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.251 INFO:tasks.workunit.client.0.smithi163.stdout:3984(144 mod 256): MAPWRITE 0xde05d thru 0xea9a6 (0xc94a bytes) 2023-07-14T18:17:18.251 INFO:tasks.workunit.client.0.smithi163.stdout:3985(145 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.251 INFO:tasks.workunit.client.0.smithi163.stdout:3986(146 mod 256): MAPWRITE 0x9383d thru 0x9bd21 (0x84e5 bytes) 2023-07-14T18:17:18.251 INFO:tasks.workunit.client.0.smithi163.stdout:3987(147 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.251 INFO:tasks.workunit.client.0.smithi163.stdout:3988(148 mod 256): PUNCH 0x2f6f9 thru 0x38c6e (0x9576 bytes) ******PPPP 2023-07-14T18:17:18.251 INFO:tasks.workunit.client.0.smithi163.stdout:3989(149 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.252 INFO:tasks.workunit.client.0.smithi163.stdout:3990(150 mod 256): TRUNCATE DOWN from 0xea9a7 to 0xb5cdb 2023-07-14T18:17:18.252 INFO:tasks.workunit.client.0.smithi163.stdout:3991(151 mod 256): WRITE 0xaf6e2 thru 0xb849e (0x8dbd bytes) EXTEND 2023-07-14T18:17:18.252 INFO:tasks.workunit.client.0.smithi163.stdout:3992(152 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.252 INFO:tasks.workunit.client.0.smithi163.stdout:3993(153 mod 256): READ 0x2ae02 thru 0x2c789 (0x1988 bytes) 2023-07-14T18:17:18.252 INFO:tasks.workunit.client.0.smithi163.stdout:3994(154 mod 256): MAPWRITE 0x96f24 thru 0xa38db (0xc9b8 bytes) 2023-07-14T18:17:18.252 INFO:tasks.workunit.client.0.smithi163.stdout:3995(155 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.252 INFO:tasks.workunit.client.0.smithi163.stdout:3996(156 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.253 INFO:tasks.workunit.client.0.smithi163.stdout:3997(157 mod 256): READ 0xcf1f thru 0x1894f (0xba31 bytes) 2023-07-14T18:17:18.253 INFO:tasks.workunit.client.0.smithi163.stdout:3998(158 mod 256): WRITE 0xfca93 thru 0xfffff (0x356d bytes) HOLE 2023-07-14T18:17:18.253 INFO:tasks.workunit.client.0.smithi163.stdout:3999(159 mod 256): MAPWRITE 0xc24cc thru 0xc7ad7 (0x560c bytes) 2023-07-14T18:17:18.253 INFO:tasks.workunit.client.0.smithi163.stdout:4000(160 mod 256): FALLOC 0xf2c9f thru 0xff47c (0xc7dd bytes) INTERIOR 2023-07-14T18:17:18.253 INFO:tasks.workunit.client.0.smithi163.stdout:4001(161 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.253 INFO:tasks.workunit.client.0.smithi163.stdout:4002(162 mod 256): MAPREAD 0x41acd thru 0x4d38b (0xb8bf bytes) 2023-07-14T18:17:18.253 INFO:tasks.workunit.client.0.smithi163.stdout:4003(163 mod 256): PUNCH 0x39144 thru 0x41983 (0x8840 bytes) 2023-07-14T18:17:18.253 INFO:tasks.workunit.client.0.smithi163.stdout:4004(164 mod 256): MAPWRITE 0x4e961 thru 0x59585 (0xac25 bytes) 2023-07-14T18:17:18.254 INFO:tasks.workunit.client.0.smithi163.stdout:4005(165 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.254 INFO:tasks.workunit.client.0.smithi163.stdout:4006(166 mod 256): WRITE 0x5acd0 thru 0x5fcdd (0x500e bytes) 2023-07-14T18:17:18.254 INFO:tasks.workunit.client.0.smithi163.stdout:4007(167 mod 256): READ 0xb55c2 thru 0xb7277 (0x1cb6 bytes) 2023-07-14T18:17:18.254 INFO:tasks.workunit.client.0.smithi163.stdout:4008(168 mod 256): PUNCH 0x5d242 thru 0x5e7cd (0x158c bytes) 2023-07-14T18:17:18.254 INFO:tasks.workunit.client.0.smithi163.stdout:4009(169 mod 256): FALLOC 0x28b63 thru 0x35c0a (0xd0a7 bytes) INTERIOR 2023-07-14T18:17:18.254 INFO:tasks.workunit.client.0.smithi163.stdout:4010(170 mod 256): MAPWRITE 0xe81ab thru 0xf08dd (0x8733 bytes) 2023-07-14T18:17:18.254 INFO:tasks.workunit.client.0.smithi163.stdout:4011(171 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.254 INFO:tasks.workunit.client.0.smithi163.stdout:4012(172 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.255 INFO:tasks.workunit.client.0.smithi163.stdout:4013(173 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.255 INFO:tasks.workunit.client.0.smithi163.stdout:4014(174 mod 256): MAPWRITE 0x18b79 thru 0x1d0c1 (0x4549 bytes) 2023-07-14T18:17:18.255 INFO:tasks.workunit.client.0.smithi163.stdout:4015(175 mod 256): MAPREAD 0xfd270 thru 0xfffff (0x2d90 bytes) 2023-07-14T18:17:18.255 INFO:tasks.workunit.client.0.smithi163.stdout:4016(176 mod 256): TRUNCATE DOWN from 0x100000 to 0xcf4af 2023-07-14T18:17:18.255 INFO:tasks.workunit.client.0.smithi163.stdout:4017(177 mod 256): FALLOC 0x194c7 thru 0x1bb01 (0x263a bytes) INTERIOR 2023-07-14T18:17:18.255 INFO:tasks.workunit.client.0.smithi163.stdout:4018(178 mod 256): MAPREAD 0x77ad1 thru 0x7806f (0x59f bytes) 2023-07-14T18:17:18.255 INFO:tasks.workunit.client.0.smithi163.stdout:4019(179 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.255 INFO:tasks.workunit.client.0.smithi163.stdout:4020(180 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.256 INFO:tasks.workunit.client.0.smithi163.stdout:4021(181 mod 256): TRUNCATE DOWN from 0xcf4af to 0xaaa1d 2023-07-14T18:17:18.256 INFO:tasks.workunit.client.0.smithi163.stdout:4022(182 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.256 INFO:tasks.workunit.client.0.smithi163.stdout:4023(183 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.256 INFO:tasks.workunit.client.0.smithi163.stdout:4024(184 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.256 INFO:tasks.workunit.client.0.smithi163.stdout:4025(185 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.256 INFO:tasks.workunit.client.0.smithi163.stdout:4026(186 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.256 INFO:tasks.workunit.client.0.smithi163.stdout:4027(187 mod 256): FALLOC 0x39a81 thru 0x49994 (0xff13 bytes) INTERIOR 2023-07-14T18:17:18.256 INFO:tasks.workunit.client.0.smithi163.stdout:4028(188 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.257 INFO:tasks.workunit.client.0.smithi163.stdout:4029(189 mod 256): TRUNCATE DOWN from 0xaaa1d to 0x3255 ******WWWW 2023-07-14T18:17:18.257 INFO:tasks.workunit.client.0.smithi163.stdout:4030(190 mod 256): FALLOC 0x28049 thru 0x36b06 (0xeabd bytes) EXTENDING 2023-07-14T18:17:18.257 INFO:tasks.workunit.client.0.smithi163.stdout:4031(191 mod 256): PUNCH 0x35f29 thru 0x36b05 (0xbdd bytes) 2023-07-14T18:17:18.257 INFO:tasks.workunit.client.0.smithi163.stdout:4032(192 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.257 INFO:tasks.workunit.client.0.smithi163.stdout:4033(193 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.257 INFO:tasks.workunit.client.0.smithi163.stdout:4034(194 mod 256): TRUNCATE UP from 0x36b06 to 0xceecf ******WWWW 2023-07-14T18:17:18.257 INFO:tasks.workunit.client.0.smithi163.stdout:4035(195 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.257 INFO:tasks.workunit.client.0.smithi163.stdout:4036(196 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.258 INFO:tasks.workunit.client.0.smithi163.stdout:4037(197 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.258 INFO:tasks.workunit.client.0.smithi163.stdout:4038(198 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.258 INFO:tasks.workunit.client.0.smithi163.stdout:4039(199 mod 256): TRUNCATE DOWN from 0xceecf to 0xa7a19 2023-07-14T18:17:18.258 INFO:tasks.workunit.client.0.smithi163.stdout:4040(200 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.258 INFO:tasks.workunit.client.0.smithi163.stdout:4041(201 mod 256): COPY 0x21598 thru 0x2cf16 (0xb97f bytes) to 0xcee5c thru 0xda7da 2023-07-14T18:17:18.258 INFO:tasks.workunit.client.0.smithi163.stdout:4042(202 mod 256): WRITE 0xee92 thru 0x195c6 (0xa735 bytes) 2023-07-14T18:17:18.258 INFO:tasks.workunit.client.0.smithi163.stdout:4043(203 mod 256): MAPREAD 0x59222 thru 0x5f710 (0x64ef bytes) 2023-07-14T18:17:18.258 INFO:tasks.workunit.client.0.smithi163.stdout:4044(204 mod 256): MAPREAD 0xcbd39 thru 0xcdeca (0x2192 bytes) 2023-07-14T18:17:18.259 INFO:tasks.workunit.client.0.smithi163.stdout:4045(205 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.259 INFO:tasks.workunit.client.0.smithi163.stdout:4046(206 mod 256): READ 0x53d1b thru 0x5ed54 (0xb03a bytes) 2023-07-14T18:17:18.259 INFO:tasks.workunit.client.0.smithi163.stdout:4047(207 mod 256): FALLOC 0x6c3b6 thru 0x74148 (0x7d92 bytes) INTERIOR 2023-07-14T18:17:18.259 INFO:tasks.workunit.client.0.smithi163.stdout:4048(208 mod 256): READ 0x928c1 thru 0xa24ab (0xfbeb bytes) 2023-07-14T18:17:18.259 INFO:tasks.workunit.client.0.smithi163.stdout:4049(209 mod 256): MAPWRITE 0xf5778 thru 0xfffff (0xa888 bytes) 2023-07-14T18:17:18.259 INFO:tasks.workunit.client.0.smithi163.stdout:4050(210 mod 256): MAPWRITE 0xe2a4 thru 0x12387 (0x40e4 bytes) 2023-07-14T18:17:18.259 INFO:tasks.workunit.client.0.smithi163.stdout:4051(211 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.259 INFO:tasks.workunit.client.0.smithi163.stdout:4052(212 mod 256): FALLOC 0x36b2e thru 0x3bbdd (0x50af bytes) INTERIOR ******FFFF 2023-07-14T18:17:18.260 INFO:tasks.workunit.client.0.smithi163.stdout:4053(213 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.260 INFO:tasks.workunit.client.0.smithi163.stdout:4054(214 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.260 INFO:tasks.workunit.client.0.smithi163.stdout:4055(215 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.260 INFO:tasks.workunit.client.0.smithi163.stdout:4056(216 mod 256): WRITE 0xf9aad thru 0xfffff (0x6553 bytes) 2023-07-14T18:17:18.260 INFO:tasks.workunit.client.0.smithi163.stdout:4057(217 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.260 INFO:tasks.workunit.client.0.smithi163.stdout:4058(218 mod 256): COPY 0x536fa thru 0x552fd (0x1c04 bytes) to 0xde94e thru 0xe0551 2023-07-14T18:17:18.260 INFO:tasks.workunit.client.0.smithi163.stdout:4059(219 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.260 INFO:tasks.workunit.client.0.smithi163.stdout:4060(220 mod 256): TRUNCATE DOWN from 0x100000 to 0x47e5f 2023-07-14T18:17:18.261 INFO:tasks.workunit.client.0.smithi163.stdout:4061(221 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.261 INFO:tasks.workunit.client.0.smithi163.stdout:4062(222 mod 256): FALLOC 0x82826 thru 0x8de13 (0xb5ed bytes) PAST_EOF 2023-07-14T18:17:18.261 INFO:tasks.workunit.client.0.smithi163.stdout:4063(223 mod 256): PUNCH 0x23634 thru 0x2dce6 (0xa6b3 bytes) 2023-07-14T18:17:18.261 INFO:tasks.workunit.client.0.smithi163.stdout:4064(224 mod 256): MAPREAD 0x39670 thru 0x414ca (0x7e5b bytes) 2023-07-14T18:17:18.261 INFO:tasks.workunit.client.0.smithi163.stdout:4065(225 mod 256): PUNCH 0x422d3 thru 0x42986 (0x6b4 bytes) 2023-07-14T18:17:18.261 INFO:tasks.workunit.client.0.smithi163.stdout:4066(226 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.261 INFO:tasks.workunit.client.0.smithi163.stdout:4067(227 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.261 INFO:tasks.workunit.client.0.smithi163.stdout:4068(228 mod 256): MAPREAD 0x14a5c thru 0x2074f (0xbcf4 bytes) 2023-07-14T18:17:18.262 INFO:tasks.workunit.client.0.smithi163.stdout:4069(229 mod 256): PUNCH 0x2ac4e thru 0x3a0dc (0xf48f bytes) ******PPPP 2023-07-14T18:17:18.262 INFO:tasks.workunit.client.0.smithi163.stdout:4070(230 mod 256): READ 0x2a28c thru 0x36f6d (0xcce2 bytes) 2023-07-14T18:17:18.262 INFO:tasks.workunit.client.0.smithi163.stdout:4071(231 mod 256): COPY 0xba52 thru 0x1addb (0xf38a bytes) to 0xaa076 thru 0xb93ff 2023-07-14T18:17:18.262 INFO:tasks.workunit.client.0.smithi163.stdout:4072(232 mod 256): PUNCH 0x5b70d thru 0x6082d (0x5121 bytes) 2023-07-14T18:17:18.262 INFO:tasks.workunit.client.0.smithi163.stdout:4073(233 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.262 INFO:tasks.workunit.client.0.smithi163.stdout:4074(234 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.262 INFO:tasks.workunit.client.0.smithi163.stdout:4075(235 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.262 INFO:tasks.workunit.client.0.smithi163.stdout:4076(236 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.263 INFO:tasks.workunit.client.0.smithi163.stdout:4077(237 mod 256): WRITE 0xc43a7 thru 0xd169b (0xd2f5 bytes) HOLE 2023-07-14T18:17:18.263 INFO:tasks.workunit.client.0.smithi163.stdout:4078(238 mod 256): FALLOC 0xf7e87 thru 0xfb7d3 (0x394c bytes) PAST_EOF 2023-07-14T18:17:18.263 INFO:tasks.workunit.client.0.smithi163.stdout:4079(239 mod 256): WRITE 0x8e9c9 thru 0x99597 (0xabcf bytes) 2023-07-14T18:17:18.263 INFO:tasks.workunit.client.0.smithi163.stdout:4080(240 mod 256): MAPWRITE 0x15aa9 thru 0x24f10 (0xf468 bytes) 2023-07-14T18:17:18.263 INFO:tasks.workunit.client.0.smithi163.stdout:4081(241 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.263 INFO:tasks.workunit.client.0.smithi163.stdout:4082(242 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.263 INFO:tasks.workunit.client.0.smithi163.stdout:4083(243 mod 256): FALLOC 0x3d563 thru 0x41c92 (0x472f bytes) INTERIOR 2023-07-14T18:17:18.263 INFO:tasks.workunit.client.0.smithi163.stdout:4084(244 mod 256): READ 0x9066c thru 0x94b62 (0x44f7 bytes) 2023-07-14T18:17:18.264 INFO:tasks.workunit.client.0.smithi163.stdout:4085(245 mod 256): FALLOC 0x444e6 thru 0x46fa1 (0x2abb bytes) INTERIOR 2023-07-14T18:17:18.264 INFO:tasks.workunit.client.0.smithi163.stdout:4086(246 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.264 INFO:tasks.workunit.client.0.smithi163.stdout:4087(247 mod 256): READ 0x95f7d thru 0xa0f71 (0xaff5 bytes) 2023-07-14T18:17:18.264 INFO:tasks.workunit.client.0.smithi163.stdout:4088(248 mod 256): MAPWRITE 0xb9073 thru 0xbb804 (0x2792 bytes) 2023-07-14T18:17:18.264 INFO:tasks.workunit.client.0.smithi163.stdout:4089(249 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.264 INFO:tasks.workunit.client.0.smithi163.stdout:4090(250 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.264 INFO:tasks.workunit.client.0.smithi163.stdout:4091(251 mod 256): PUNCH 0x551c4 thru 0x6452c (0xf369 bytes) 2023-07-14T18:17:18.264 INFO:tasks.workunit.client.0.smithi163.stdout:4092(252 mod 256): PUNCH 0x6890e thru 0x6d32a (0x4a1d bytes) 2023-07-14T18:17:18.265 INFO:tasks.workunit.client.0.smithi163.stdout:4093(253 mod 256): MAPWRITE 0x6f79b thru 0x71e75 (0x26db bytes) 2023-07-14T18:17:18.265 INFO:tasks.workunit.client.0.smithi163.stdout:4094(254 mod 256): TRUNCATE DOWN from 0xd169c to 0xb0570 2023-07-14T18:17:18.265 INFO:tasks.workunit.client.0.smithi163.stdout:4095(255 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.265 INFO:tasks.workunit.client.0.smithi163.stdout:4096( 0 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.265 INFO:tasks.workunit.client.0.smithi163.stdout:4097( 1 mod 256): PUNCH 0x5e27e thru 0x6cd2f (0xeab2 bytes) 2023-07-14T18:17:18.265 INFO:tasks.workunit.client.0.smithi163.stdout:4098( 2 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.265 INFO:tasks.workunit.client.0.smithi163.stdout:4099( 3 mod 256): MAPWRITE 0x4fc45 thru 0x557cd (0x5b89 bytes) 2023-07-14T18:17:18.265 INFO:tasks.workunit.client.0.smithi163.stdout:4100( 4 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.266 INFO:tasks.workunit.client.0.smithi163.stdout:4101( 5 mod 256): READ 0x1cf75 thru 0x2ce66 (0xfef2 bytes) 2023-07-14T18:17:18.266 INFO:tasks.workunit.client.0.smithi163.stdout:4102( 6 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.266 INFO:tasks.workunit.client.0.smithi163.stdout:4103( 7 mod 256): TRUNCATE UP from 0xb0570 to 0xb5085 2023-07-14T18:17:18.266 INFO:tasks.workunit.client.0.smithi163.stdout:4104( 8 mod 256): TRUNCATE DOWN from 0xb5085 to 0x76f4a 2023-07-14T18:17:18.266 INFO:tasks.workunit.client.0.smithi163.stdout:4105( 9 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.266 INFO:tasks.workunit.client.0.smithi163.stdout:4106( 10 mod 256): TRUNCATE UP from 0x76f4a to 0x957bb 2023-07-14T18:17:18.266 INFO:tasks.workunit.client.0.smithi163.stdout:4107( 11 mod 256): FALLOC 0x24432 thru 0x294ee (0x50bc bytes) INTERIOR 2023-07-14T18:17:18.266 INFO:tasks.workunit.client.0.smithi163.stdout:4108( 12 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.267 INFO:tasks.workunit.client.0.smithi163.stdout:4109( 13 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.267 INFO:tasks.workunit.client.0.smithi163.stdout:4110( 14 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.267 INFO:tasks.workunit.client.0.smithi163.stdout:4111( 15 mod 256): COPY 0x3c25e thru 0x42a3d (0x67e0 bytes) to 0x556ca thru 0x5bea9 2023-07-14T18:17:18.267 INFO:tasks.workunit.client.0.smithi163.stdout:4112( 16 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.267 INFO:tasks.workunit.client.0.smithi163.stdout:4113( 17 mod 256): PUNCH 0x44557 thru 0x4fa6b (0xb515 bytes) 2023-07-14T18:17:18.267 INFO:tasks.workunit.client.0.smithi163.stdout:4114( 18 mod 256): MAPREAD 0x5b3c thru 0x8d8b (0x3250 bytes) 2023-07-14T18:17:18.267 INFO:tasks.workunit.client.0.smithi163.stdout:4115( 19 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.267 INFO:tasks.workunit.client.0.smithi163.stdout:4116( 20 mod 256): MAPWRITE 0x6d435 thru 0x74589 (0x7155 bytes) 2023-07-14T18:17:18.268 INFO:tasks.workunit.client.0.smithi163.stdout:4117( 21 mod 256): TRUNCATE DOWN from 0x957bb to 0x30ee6 ******WWWW 2023-07-14T18:17:18.268 INFO:tasks.workunit.client.0.smithi163.stdout:4118( 22 mod 256): COPY 0xf5d9 thru 0x101aa (0xbd2 bytes) to 0xafa2d thru 0xb05fe 2023-07-14T18:17:18.268 INFO:tasks.workunit.client.0.smithi163.stdout:4119( 23 mod 256): COPY 0x7fea4 thru 0x8123b (0x1398 bytes) to 0xd9946 thru 0xdacdd 2023-07-14T18:17:18.268 INFO:tasks.workunit.client.0.smithi163.stdout:4120( 24 mod 256): MAPWRITE 0xc7f74 thru 0xcc884 (0x4911 bytes) 2023-07-14T18:17:18.268 INFO:tasks.workunit.client.0.smithi163.stdout:4121( 25 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.268 INFO:tasks.workunit.client.0.smithi163.stdout:4122( 26 mod 256): MAPREAD 0x913a7 thru 0x96979 (0x55d3 bytes) 2023-07-14T18:17:18.268 INFO:tasks.workunit.client.0.smithi163.stdout:4123( 27 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.268 INFO:tasks.workunit.client.0.smithi163.stdout:4124( 28 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.269 INFO:tasks.workunit.client.0.smithi163.stdout:4125( 29 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.269 INFO:tasks.workunit.client.0.smithi163.stdout:4126( 30 mod 256): WRITE 0xd2586 thru 0xd2983 (0x3fe bytes) 2023-07-14T18:17:18.269 INFO:tasks.workunit.client.0.smithi163.stdout:4127( 31 mod 256): COPY 0xa899 thru 0xeb55 (0x42bd bytes) to 0xe8ec8 thru 0xed184 2023-07-14T18:17:18.269 INFO:tasks.workunit.client.0.smithi163.stdout:4128( 32 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.269 INFO:tasks.workunit.client.0.smithi163.stdout:4129( 33 mod 256): PUNCH 0xcef13 thru 0xd5bdc (0x6cca bytes) 2023-07-14T18:17:18.269 INFO:tasks.workunit.client.0.smithi163.stdout:4130( 34 mod 256): WRITE 0x5321b thru 0x56b61 (0x3947 bytes) 2023-07-14T18:17:18.269 INFO:tasks.workunit.client.0.smithi163.stdout:4131( 35 mod 256): MAPREAD 0xa1a69 thru 0xa754a (0x5ae2 bytes) 2023-07-14T18:17:18.269 INFO:tasks.workunit.client.0.smithi163.stdout:4132( 36 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.270 INFO:tasks.workunit.client.0.smithi163.stdout:4133( 37 mod 256): MAPREAD 0x21e80 thru 0x2cec9 (0xb04a bytes) 2023-07-14T18:17:18.270 INFO:tasks.workunit.client.0.smithi163.stdout:4134( 38 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.270 INFO:tasks.workunit.client.0.smithi163.stdout:4135( 39 mod 256): COPY 0x1e1ef thru 0x27b3e (0x9950 bytes) to 0xe1156 thru 0xeaaa5 2023-07-14T18:17:18.270 INFO:tasks.workunit.client.0.smithi163.stdout:4136( 40 mod 256): FALLOC 0xa76ec thru 0xa88d8 (0x11ec bytes) INTERIOR 2023-07-14T18:17:18.270 INFO:tasks.workunit.client.0.smithi163.stdout:4137( 41 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.270 INFO:tasks.workunit.client.0.smithi163.stdout:4138( 42 mod 256): COPY 0x32ec3 thru 0x42ce0 (0xfe1e bytes) to 0xb2c2d thru 0xc2a4a EEEE****** 2023-07-14T18:17:18.270 INFO:tasks.workunit.client.0.smithi163.stdout:4139( 43 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.270 INFO:tasks.workunit.client.0.smithi163.stdout:4140( 44 mod 256): FALLOC 0xf0ccf thru 0xf87c4 (0x7af5 bytes) EXTENDING 2023-07-14T18:17:18.271 INFO:tasks.workunit.client.0.smithi163.stdout:4141( 45 mod 256): PUNCH 0x7709a thru 0x86e40 (0xfda7 bytes) 2023-07-14T18:17:18.271 INFO:tasks.workunit.client.0.smithi163.stdout:4142( 46 mod 256): FALLOC 0xe8cd8 thru 0xf1767 (0x8a8f bytes) INTERIOR 2023-07-14T18:17:18.271 INFO:tasks.workunit.client.0.smithi163.stdout:4143( 47 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.271 INFO:tasks.workunit.client.0.smithi163.stdout:4144( 48 mod 256): READ 0xdbb07 thru 0xe2085 (0x657f bytes) 2023-07-14T18:17:18.271 INFO:tasks.workunit.client.0.smithi163.stdout:4145( 49 mod 256): MAPREAD 0xd1060 thru 0xe02cc (0xf26d bytes) 2023-07-14T18:17:18.271 INFO:tasks.workunit.client.0.smithi163.stdout:4146( 50 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.271 INFO:tasks.workunit.client.0.smithi163.stdout:4147( 51 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.272 INFO:tasks.workunit.client.0.smithi163.stdout:4148( 52 mod 256): FALLOC 0x3041f thru 0x3ef80 (0xeb61 bytes) INTERIOR ******FFFF 2023-07-14T18:17:18.272 INFO:tasks.workunit.client.0.smithi163.stdout:4149( 53 mod 256): COPY 0x520f8 thru 0x59dd7 (0x7ce0 bytes) to 0xd67b1 thru 0xde490 2023-07-14T18:17:18.272 INFO:tasks.workunit.client.0.smithi163.stdout:4150( 54 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.272 INFO:tasks.workunit.client.0.smithi163.stdout:4151( 55 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.272 INFO:tasks.workunit.client.0.smithi163.stdout:4152( 56 mod 256): WRITE 0x651a9 thru 0x6d794 (0x85ec bytes) 2023-07-14T18:17:18.272 INFO:tasks.workunit.client.0.smithi163.stdout:4153( 57 mod 256): PUNCH 0x1b241 thru 0x29997 (0xe757 bytes) 2023-07-14T18:17:18.272 INFO:tasks.workunit.client.0.smithi163.stdout:4154( 58 mod 256): FALLOC 0xa701e thru 0xac487 (0x5469 bytes) INTERIOR 2023-07-14T18:17:18.272 INFO:tasks.workunit.client.0.smithi163.stdout:4155( 59 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.273 INFO:tasks.workunit.client.0.smithi163.stdout:4156( 60 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.273 INFO:tasks.workunit.client.0.smithi163.stdout:4157( 61 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.273 INFO:tasks.workunit.client.0.smithi163.stdout:4158( 62 mod 256): FALLOC 0x37cf5 thru 0x37e20 (0x12b bytes) INTERIOR 2023-07-14T18:17:18.273 INFO:tasks.workunit.client.0.smithi163.stdout:4159( 63 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.273 INFO:tasks.workunit.client.0.smithi163.stdout:4160( 64 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.273 INFO:tasks.workunit.client.0.smithi163.stdout:4161( 65 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.273 INFO:tasks.workunit.client.0.smithi163.stdout:4162( 66 mod 256): MAPWRITE 0x59a85 thru 0x648e4 (0xae60 bytes) 2023-07-14T18:17:18.273 INFO:tasks.workunit.client.0.smithi163.stdout:4163( 67 mod 256): FALLOC 0xcf240 thru 0xd997d (0xa73d bytes) INTERIOR 2023-07-14T18:17:18.274 INFO:tasks.workunit.client.0.smithi163.stdout:4164( 68 mod 256): TRUNCATE DOWN from 0xf87c4 to 0xe5ac4 2023-07-14T18:17:18.274 INFO:tasks.workunit.client.0.smithi163.stdout:4165( 69 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.274 INFO:tasks.workunit.client.0.smithi163.stdout:4166( 70 mod 256): COPY 0x6eb7e thru 0x7a339 (0xb7bc bytes) to 0xca40d thru 0xd5bc8 2023-07-14T18:17:18.274 INFO:tasks.workunit.client.0.smithi163.stdout:4167( 71 mod 256): READ 0x7ce37 thru 0x8c10c (0xf2d6 bytes) 2023-07-14T18:17:18.274 INFO:tasks.workunit.client.0.smithi163.stdout:4168( 72 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.274 INFO:tasks.workunit.client.0.smithi163.stdout:4169( 73 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.274 INFO:tasks.workunit.client.0.smithi163.stdout:4170( 74 mod 256): MAPREAD 0x5c9bc thru 0x5ce13 (0x458 bytes) 2023-07-14T18:17:18.274 INFO:tasks.workunit.client.0.smithi163.stdout:4171( 75 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.275 INFO:tasks.workunit.client.0.smithi163.stdout:4172( 76 mod 256): COPY 0xb5d07 thru 0xb91fa (0x34f4 bytes) to 0x31a66 thru 0x34f59 2023-07-14T18:17:18.275 INFO:tasks.workunit.client.0.smithi163.stdout:4173( 77 mod 256): WRITE 0xb990f thru 0xc1e9e (0x8590 bytes) 2023-07-14T18:17:18.275 INFO:tasks.workunit.client.0.smithi163.stdout:4174( 78 mod 256): WRITE 0xf766e thru 0xfdb72 (0x6505 bytes) HOLE 2023-07-14T18:17:18.275 INFO:tasks.workunit.client.0.smithi163.stdout:4175( 79 mod 256): TRUNCATE DOWN from 0xfdb73 to 0x743ff 2023-07-14T18:17:18.275 INFO:tasks.workunit.client.0.smithi163.stdout:4176( 80 mod 256): READ 0x5385a thru 0x574b6 (0x3c5d bytes) 2023-07-14T18:17:18.275 INFO:tasks.workunit.client.0.smithi163.stdout:4177( 81 mod 256): READ 0x62b6f thru 0x67768 (0x4bfa bytes) 2023-07-14T18:17:18.275 INFO:tasks.workunit.client.0.smithi163.stdout:4178( 82 mod 256): WRITE 0x66220 thru 0x7349c (0xd27d bytes) 2023-07-14T18:17:18.275 INFO:tasks.workunit.client.0.smithi163.stdout:4179( 83 mod 256): FALLOC 0x1af08 thru 0x282e9 (0xd3e1 bytes) INTERIOR 2023-07-14T18:17:18.276 INFO:tasks.workunit.client.0.smithi163.stdout:4180( 84 mod 256): TRUNCATE UP from 0x743ff to 0xf1b13 2023-07-14T18:17:18.276 INFO:tasks.workunit.client.0.smithi163.stdout:4181( 85 mod 256): READ 0x883a9 thru 0x8b02a (0x2c82 bytes) 2023-07-14T18:17:18.276 INFO:tasks.workunit.client.0.smithi163.stdout:4182( 86 mod 256): PUNCH 0x90cd thru 0x163e1 (0xd315 bytes) 2023-07-14T18:17:18.276 INFO:tasks.workunit.client.0.smithi163.stdout:4183( 87 mod 256): COPY 0x820b5 thru 0x8f549 (0xd495 bytes) to 0x3a199 thru 0x4762d 2023-07-14T18:17:18.276 INFO:tasks.workunit.client.0.smithi163.stdout:4184( 88 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.276 INFO:tasks.workunit.client.0.smithi163.stdout:4185( 89 mod 256): TRUNCATE DOWN from 0xf1b13 to 0x947c7 2023-07-14T18:17:18.276 INFO:tasks.workunit.client.0.smithi163.stdout:4186( 90 mod 256): MAPREAD 0x6743c thru 0x67792 (0x357 bytes) 2023-07-14T18:17:18.276 INFO:tasks.workunit.client.0.smithi163.stdout:4187( 91 mod 256): COPY 0x7e267 thru 0x82081 (0x3e1b bytes) to 0xc3de1 thru 0xc7bfb 2023-07-14T18:17:18.277 INFO:tasks.workunit.client.0.smithi163.stdout:4188( 92 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.277 INFO:tasks.workunit.client.0.smithi163.stdout:4189( 93 mod 256): PUNCH 0x305fe thru 0x3b86e (0xb271 bytes) ******PPPP 2023-07-14T18:17:18.277 INFO:tasks.workunit.client.0.smithi163.stdout:4190( 94 mod 256): PUNCH 0x27cf thru 0x3baf (0x13e1 bytes) 2023-07-14T18:17:18.277 INFO:tasks.workunit.client.0.smithi163.stdout:4191( 95 mod 256): WRITE 0xe7ea7 thru 0xf2d1a (0xae74 bytes) HOLE 2023-07-14T18:17:18.277 INFO:tasks.workunit.client.0.smithi163.stdout:4192( 96 mod 256): MAPWRITE 0x393 thru 0x8717 (0x8385 bytes) 2023-07-14T18:17:18.277 INFO:tasks.workunit.client.0.smithi163.stdout:4193( 97 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.277 INFO:tasks.workunit.client.0.smithi163.stdout:4194( 98 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.277 INFO:tasks.workunit.client.0.smithi163.stdout:4195( 99 mod 256): WRITE 0x3a570 thru 0x3fb68 (0x55f9 bytes) 2023-07-14T18:17:18.278 INFO:tasks.workunit.client.0.smithi163.stdout:4196(100 mod 256): TRUNCATE DOWN from 0xf2d1b to 0x3bf9c 2023-07-14T18:17:18.278 INFO:tasks.workunit.client.0.smithi163.stdout:4197(101 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.278 INFO:tasks.workunit.client.0.smithi163.stdout:4198(102 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.278 INFO:tasks.workunit.client.0.smithi163.stdout:4199(103 mod 256): MAPREAD 0xd1bb thru 0x11e4e (0x4c94 bytes) 2023-07-14T18:17:18.278 INFO:tasks.workunit.client.0.smithi163.stdout:4200(104 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.278 INFO:tasks.workunit.client.0.smithi163.stdout:4201(105 mod 256): MAPWRITE 0xc6201 thru 0xceae1 (0x88e1 bytes) 2023-07-14T18:17:18.278 INFO:tasks.workunit.client.0.smithi163.stdout:4202(106 mod 256): WRITE 0x243ae thru 0x2ea56 (0xa6a9 bytes) 2023-07-14T18:17:18.278 INFO:tasks.workunit.client.0.smithi163.stdout:4203(107 mod 256): WRITE 0x437d5 thru 0x4937a (0x5ba6 bytes) 2023-07-14T18:17:18.279 INFO:tasks.workunit.client.0.smithi163.stdout:4204(108 mod 256): READ 0x4748a thru 0x514e4 (0xa05b bytes) 2023-07-14T18:17:18.279 INFO:tasks.workunit.client.0.smithi163.stdout:4205(109 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.279 INFO:tasks.workunit.client.0.smithi163.stdout:4206(110 mod 256): PUNCH 0x87089 thru 0x8a634 (0x35ac bytes) 2023-07-14T18:17:18.279 INFO:tasks.workunit.client.0.smithi163.stdout:4207(111 mod 256): PUNCH 0x634b5 thru 0x6cce4 (0x9830 bytes) 2023-07-14T18:17:18.279 INFO:tasks.workunit.client.0.smithi163.stdout:4208(112 mod 256): MAPREAD 0x6895e thru 0x72e75 (0xa518 bytes) 2023-07-14T18:17:18.279 INFO:tasks.workunit.client.0.smithi163.stdout:4209(113 mod 256): PUNCH 0x75659 thru 0x7b7e3 (0x618b bytes) 2023-07-14T18:17:18.279 INFO:tasks.workunit.client.0.smithi163.stdout:4210(114 mod 256): TRUNCATE DOWN from 0xceae2 to 0xed72 ******WWWW 2023-07-14T18:17:18.279 INFO:tasks.workunit.client.0.smithi163.stdout:4211(115 mod 256): READ 0xe296 thru 0xed71 (0xadc bytes) 2023-07-14T18:17:18.280 INFO:tasks.workunit.client.0.smithi163.stdout:4212(116 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.280 INFO:tasks.workunit.client.0.smithi163.stdout:4213(117 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.280 INFO:tasks.workunit.client.0.smithi163.stdout:4214(118 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.280 INFO:tasks.workunit.client.0.smithi163.stdout:4215(119 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.280 INFO:tasks.workunit.client.0.smithi163.stdout:4216(120 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.280 INFO:tasks.workunit.client.0.smithi163.stdout:4217(121 mod 256): READ 0x6066 thru 0xed71 (0x8d0c bytes) 2023-07-14T18:17:18.280 INFO:tasks.workunit.client.0.smithi163.stdout:4218(122 mod 256): PUNCH 0x1c66 thru 0xcf91 (0xb32c bytes) 2023-07-14T18:17:18.280 INFO:tasks.workunit.client.0.smithi163.stdout:4219(123 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.281 INFO:tasks.workunit.client.0.smithi163.stdout:4220(124 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.281 INFO:tasks.workunit.client.0.smithi163.stdout:4221(125 mod 256): COPY 0x7fd1 thru 0x8d0b (0xd3b bytes) to 0x2182d thru 0x22567 2023-07-14T18:17:18.281 INFO:tasks.workunit.client.0.smithi163.stdout:4222(126 mod 256): FALLOC 0x8b9d7 thru 0x98cef (0xd318 bytes) EXTENDING 2023-07-14T18:17:18.281 INFO:tasks.workunit.client.0.smithi163.stdout:4223(127 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.281 INFO:tasks.workunit.client.0.smithi163.stdout:4224(128 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.281 INFO:tasks.workunit.client.0.smithi163.stdout:4225(129 mod 256): PUNCH 0x7dd6d thru 0x817ff (0x3a93 bytes) 2023-07-14T18:17:18.281 INFO:tasks.workunit.client.0.smithi163.stdout:4226(130 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.281 INFO:tasks.workunit.client.0.smithi163.stdout:4227(131 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.282 INFO:tasks.workunit.client.0.smithi163.stdout:4228(132 mod 256): READ 0x54eee thru 0x5d73e (0x8851 bytes) 2023-07-14T18:17:18.282 INFO:tasks.workunit.client.0.smithi163.stdout:4229(133 mod 256): TRUNCATE UP from 0x98cef to 0xb84ae 2023-07-14T18:17:18.282 INFO:tasks.workunit.client.0.smithi163.stdout:4230(134 mod 256): READ 0x43c43 thru 0x45302 (0x16c0 bytes) 2023-07-14T18:17:18.282 INFO:tasks.workunit.client.0.smithi163.stdout:4231(135 mod 256): COPY 0x1d847 thru 0x295a6 (0xbd60 bytes) to 0xcad2 thru 0x18831 2023-07-14T18:17:18.282 INFO:tasks.workunit.client.0.smithi163.stdout:4232(136 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.282 INFO:tasks.workunit.client.0.smithi163.stdout:4233(137 mod 256): WRITE 0xc27de thru 0xcebef (0xc412 bytes) HOLE 2023-07-14T18:17:18.282 INFO:tasks.workunit.client.0.smithi163.stdout:4234(138 mod 256): TRUNCATE DOWN from 0xcebf0 to 0x92a34 2023-07-14T18:17:18.282 INFO:tasks.workunit.client.0.smithi163.stdout:4235(139 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.283 INFO:tasks.workunit.client.0.smithi163.stdout:4236(140 mod 256): FALLOC 0xd952e thru 0xda6cf (0x11a1 bytes) PAST_EOF 2023-07-14T18:17:18.283 INFO:tasks.workunit.client.0.smithi163.stdout:4237(141 mod 256): READ 0x1798 thru 0x111b1 (0xfa1a bytes) 2023-07-14T18:17:18.283 INFO:tasks.workunit.client.0.smithi163.stdout:4238(142 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.283 INFO:tasks.workunit.client.0.smithi163.stdout:4239(143 mod 256): COPY 0x53418 thru 0x53424 (0xd bytes) to 0x1391b thru 0x13927 2023-07-14T18:17:18.283 INFO:tasks.workunit.client.0.smithi163.stdout:4240(144 mod 256): MAPREAD 0x7ab03 thru 0x8810c (0xd60a bytes) 2023-07-14T18:17:18.283 INFO:tasks.workunit.client.0.smithi163.stdout:4241(145 mod 256): MAPREAD 0x55a10 thru 0x5fd8c (0xa37d bytes) 2023-07-14T18:17:18.283 INFO:tasks.workunit.client.0.smithi163.stdout:4242(146 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.283 INFO:tasks.workunit.client.0.smithi163.stdout:4243(147 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.284 INFO:tasks.workunit.client.0.smithi163.stdout:4244(148 mod 256): PUNCH 0x5574b thru 0x5fc7e (0xa534 bytes) 2023-07-14T18:17:18.284 INFO:tasks.workunit.client.0.smithi163.stdout:4245(149 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.284 INFO:tasks.workunit.client.0.smithi163.stdout:4246(150 mod 256): COPY 0x3e2f4 thru 0x454f1 (0x71fe bytes) to 0x19c94 thru 0x20e91 2023-07-14T18:17:18.284 INFO:tasks.workunit.client.0.smithi163.stdout:4247(151 mod 256): MAPWRITE 0x821b7 thru 0x87cbc (0x5b06 bytes) 2023-07-14T18:17:18.284 INFO:tasks.workunit.client.0.smithi163.stdout:4248(152 mod 256): TRUNCATE DOWN from 0x92a34 to 0x1fb19 ******WWWW 2023-07-14T18:17:18.284 INFO:tasks.workunit.client.0.smithi163.stdout:4249(153 mod 256): PUNCH 0x18a6a thru 0x1fb18 (0x70af bytes) 2023-07-14T18:17:18.284 INFO:tasks.workunit.client.0.smithi163.stdout:4250(154 mod 256): COPY 0x13361 thru 0x17958 (0x45f8 bytes) to 0x7b7cd thru 0x7fdc4 2023-07-14T18:17:18.284 INFO:tasks.workunit.client.0.smithi163.stdout:4251(155 mod 256): MAPWRITE 0x68fdf thru 0x73bac (0xabce bytes) 2023-07-14T18:17:18.285 INFO:tasks.workunit.client.0.smithi163.stdout:4252(156 mod 256): FALLOC 0xade9a thru 0xb244d (0x45b3 bytes) EXTENDING 2023-07-14T18:17:18.285 INFO:tasks.workunit.client.0.smithi163.stdout:4253(157 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.285 INFO:tasks.workunit.client.0.smithi163.stdout:4254(158 mod 256): TRUNCATE DOWN from 0xb244d to 0x942d ******WWWW 2023-07-14T18:17:18.285 INFO:tasks.workunit.client.0.smithi163.stdout:4255(159 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.285 INFO:tasks.workunit.client.0.smithi163.stdout:4256(160 mod 256): FALLOC 0xb6d11 thru 0xbe40e (0x76fd bytes) EXTENDING 2023-07-14T18:17:18.285 INFO:tasks.workunit.client.0.smithi163.stdout:4257(161 mod 256): COPY 0xb15e thru 0x19689 (0xe52c bytes) to 0xc3529 thru 0xd1a54 2023-07-14T18:17:18.285 INFO:tasks.workunit.client.0.smithi163.stdout:4258(162 mod 256): PUNCH 0xc170b thru 0xc9af8 (0x83ee bytes) 2023-07-14T18:17:18.285 INFO:tasks.workunit.client.0.smithi163.stdout:4259(163 mod 256): FALLOC 0x6e22f thru 0x747ac (0x657d bytes) INTERIOR 2023-07-14T18:17:18.286 INFO:tasks.workunit.client.0.smithi163.stdout:4260(164 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.286 INFO:tasks.workunit.client.0.smithi163.stdout:4261(165 mod 256): COPY 0x42c72 thru 0x4cb08 (0x9e97 bytes) to 0x65c16 thru 0x6faac 2023-07-14T18:17:18.286 INFO:tasks.workunit.client.0.smithi163.stdout:4262(166 mod 256): MAPWRITE 0x17de1 thru 0x1e1b5 (0x63d5 bytes) 2023-07-14T18:17:18.286 INFO:tasks.workunit.client.0.smithi163.stdout:4263(167 mod 256): FALLOC 0xf341a thru 0xf5f35 (0x2b1b bytes) PAST_EOF 2023-07-14T18:17:18.286 INFO:tasks.workunit.client.0.smithi163.stdout:4264(168 mod 256): READ 0x1d8ed thru 0x2bf81 (0xe695 bytes) 2023-07-14T18:17:18.286 INFO:tasks.workunit.client.0.smithi163.stdout:4265(169 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.286 INFO:tasks.workunit.client.0.smithi163.stdout:4266(170 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.286 INFO:tasks.workunit.client.0.smithi163.stdout:4267(171 mod 256): TRUNCATE DOWN from 0xd1a55 to 0x93b0 ******WWWW 2023-07-14T18:17:18.287 INFO:tasks.workunit.client.0.smithi163.stdout:4268(172 mod 256): MAPREAD 0xeb3 thru 0x21a5 (0x12f3 bytes) 2023-07-14T18:17:18.287 INFO:tasks.workunit.client.0.smithi163.stdout:4269(173 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.287 INFO:tasks.workunit.client.0.smithi163.stdout:4270(174 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.287 INFO:tasks.workunit.client.0.smithi163.stdout:4271(175 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.287 INFO:tasks.workunit.client.0.smithi163.stdout:4272(176 mod 256): TRUNCATE UP from 0x93b0 to 0xef0a2 ******WWWW 2023-07-14T18:17:18.287 INFO:tasks.workunit.client.0.smithi163.stdout:4273(177 mod 256): PUNCH 0xa6361 thru 0xb51e4 (0xee84 bytes) 2023-07-14T18:17:18.287 INFO:tasks.workunit.client.0.smithi163.stdout:4274(178 mod 256): COPY 0x51dc1 thru 0x5e150 (0xc390 bytes) to 0x3e960 thru 0x4acef 2023-07-14T18:17:18.287 INFO:tasks.workunit.client.0.smithi163.stdout:4275(179 mod 256): MAPWRITE 0x42249 thru 0x4ec53 (0xca0b bytes) 2023-07-14T18:17:18.288 INFO:tasks.workunit.client.0.smithi163.stdout:4276(180 mod 256): FALLOC 0x7c0ee thru 0x872db (0xb1ed bytes) INTERIOR 2023-07-14T18:17:18.288 INFO:tasks.workunit.client.0.smithi163.stdout:4277(181 mod 256): MAPWRITE 0xf6b1f thru 0xfffff (0x94e1 bytes) 2023-07-14T18:17:18.288 INFO:tasks.workunit.client.0.smithi163.stdout:4278(182 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.288 INFO:tasks.workunit.client.0.smithi163.stdout:4279(183 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.288 INFO:tasks.workunit.client.0.smithi163.stdout:4280(184 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.288 INFO:tasks.workunit.client.0.smithi163.stdout:4281(185 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.288 INFO:tasks.workunit.client.0.smithi163.stdout:4282(186 mod 256): MAPREAD 0x1979e thru 0x21d04 (0x8567 bytes) 2023-07-14T18:17:18.289 INFO:tasks.workunit.client.0.smithi163.stdout:4283(187 mod 256): MAPREAD 0x58f33 thru 0x5f2f8 (0x63c6 bytes) 2023-07-14T18:17:18.289 INFO:tasks.workunit.client.0.smithi163.stdout:4284(188 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.289 INFO:tasks.workunit.client.0.smithi163.stdout:4285(189 mod 256): READ 0xa2aa8 thru 0xab44f (0x89a8 bytes) 2023-07-14T18:17:18.289 INFO:tasks.workunit.client.0.smithi163.stdout:4286(190 mod 256): MAPWRITE 0x346a4 thru 0x3512e (0xa8b bytes) 2023-07-14T18:17:18.289 INFO:tasks.workunit.client.0.smithi163.stdout:4287(191 mod 256): TRUNCATE DOWN from 0x100000 to 0x9b4ab 2023-07-14T18:17:18.289 INFO:tasks.workunit.client.0.smithi163.stdout:4288(192 mod 256): MAPREAD 0xbff9 thru 0x15f30 (0x9f38 bytes) 2023-07-14T18:17:18.289 INFO:tasks.workunit.client.0.smithi163.stdout:4289(193 mod 256): MAPWRITE 0xe475e thru 0xe98e3 (0x5186 bytes) 2023-07-14T18:17:18.289 INFO:tasks.workunit.client.0.smithi163.stdout:4290(194 mod 256): MAPREAD 0xc6cc1 thru 0xd1700 (0xaa40 bytes) 2023-07-14T18:17:18.290 INFO:tasks.workunit.client.0.smithi163.stdout:4291(195 mod 256): READ 0xb1cd9 thru 0xbe6b9 (0xc9e1 bytes) 2023-07-14T18:17:18.290 INFO:tasks.workunit.client.0.smithi163.stdout:4292(196 mod 256): WRITE 0x6d501 thru 0x76aed (0x95ed bytes) 2023-07-14T18:17:18.290 INFO:tasks.workunit.client.0.smithi163.stdout:4293(197 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.290 INFO:tasks.workunit.client.0.smithi163.stdout:4294(198 mod 256): FALLOC 0xd6c6c thru 0xe5786 (0xeb1a bytes) INTERIOR 2023-07-14T18:17:18.290 INFO:tasks.workunit.client.0.smithi163.stdout:4295(199 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.290 INFO:tasks.workunit.client.0.smithi163.stdout:4296(200 mod 256): WRITE 0x42183 thru 0x4c5e8 (0xa466 bytes) 2023-07-14T18:17:18.290 INFO:tasks.workunit.client.0.smithi163.stdout:4297(201 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.290 INFO:tasks.workunit.client.0.smithi163.stdout:4298(202 mod 256): WRITE 0x77c1b thru 0x81f8e (0xa374 bytes) 2023-07-14T18:17:18.291 INFO:tasks.workunit.client.0.smithi163.stdout:4299(203 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.291 INFO:tasks.workunit.client.0.smithi163.stdout:4300(204 mod 256): READ 0x6f6fe thru 0x776f2 (0x7ff5 bytes) 2023-07-14T18:17:18.291 INFO:tasks.workunit.client.0.smithi163.stdout:4301(205 mod 256): READ 0xb0994 thru 0xbc049 (0xb6b6 bytes) 2023-07-14T18:17:18.291 INFO:tasks.workunit.client.0.smithi163.stdout:4302(206 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.291 INFO:tasks.workunit.client.0.smithi163.stdout:4303(207 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.291 INFO:tasks.workunit.client.0.smithi163.stdout:4304(208 mod 256): MAPWRITE 0x839e1 thru 0x93200 (0xf820 bytes) 2023-07-14T18:17:18.291 INFO:tasks.workunit.client.0.smithi163.stdout:4305(209 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.291 INFO:tasks.workunit.client.0.smithi163.stdout:4306(210 mod 256): TRUNCATE DOWN from 0xe98e4 to 0xc58c5 2023-07-14T18:17:18.292 INFO:tasks.workunit.client.0.smithi163.stdout:4307(211 mod 256): COPY 0x5d7c4 thru 0x675e2 (0x9e1f bytes) to 0x42e13 thru 0x4cc31 2023-07-14T18:17:18.292 INFO:tasks.workunit.client.0.smithi163.stdout:4308(212 mod 256): MAPWRITE 0xbcc1d thru 0xc0f36 (0x431a bytes) 2023-07-14T18:17:18.292 INFO:tasks.workunit.client.0.smithi163.stdout:4309(213 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.292 INFO:tasks.workunit.client.0.smithi163.stdout:4310(214 mod 256): WRITE 0xaad8b thru 0xae86c (0x3ae2 bytes) 2023-07-14T18:17:18.292 INFO:tasks.workunit.client.0.smithi163.stdout:4311(215 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.292 INFO:tasks.workunit.client.0.smithi163.stdout:4312(216 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.292 INFO:tasks.workunit.client.0.smithi163.stdout:4313(217 mod 256): COPY 0xaa29 thru 0xc8b0 (0x1e88 bytes) to 0xfd2d thru 0x11bb4 2023-07-14T18:17:18.292 INFO:tasks.workunit.client.0.smithi163.stdout:4314(218 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.293 INFO:tasks.workunit.client.0.smithi163.stdout:4315(219 mod 256): TRUNCATE DOWN from 0xc58c5 to 0x68e38 2023-07-14T18:17:18.293 INFO:tasks.workunit.client.0.smithi163.stdout:4316(220 mod 256): COPY 0x42aa0 thru 0x42ea7 (0x408 bytes) to 0x70e64 thru 0x7126b 2023-07-14T18:17:18.293 INFO:tasks.workunit.client.0.smithi163.stdout:4317(221 mod 256): FALLOC 0xbfa36 thru 0xcaf04 (0xb4ce bytes) PAST_EOF 2023-07-14T18:17:18.293 INFO:tasks.workunit.client.0.smithi163.stdout:4318(222 mod 256): READ 0x55c4c thru 0x57a6b (0x1e20 bytes) 2023-07-14T18:17:18.293 INFO:tasks.workunit.client.0.smithi163.stdout:4319(223 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.293 INFO:tasks.workunit.client.0.smithi163.stdout:4320(224 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.293 INFO:tasks.workunit.client.0.smithi163.stdout:4321(225 mod 256): READ 0x64d1e thru 0x6bbd6 (0x6eb9 bytes) 2023-07-14T18:17:18.293 INFO:tasks.workunit.client.0.smithi163.stdout:4322(226 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.294 INFO:tasks.workunit.client.0.smithi163.stdout:4323(227 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.294 INFO:tasks.workunit.client.0.smithi163.stdout:4324(228 mod 256): FALLOC 0xd464c thru 0xd4aff (0x4b3 bytes) PAST_EOF 2023-07-14T18:17:18.294 INFO:tasks.workunit.client.0.smithi163.stdout:4325(229 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.294 INFO:tasks.workunit.client.0.smithi163.stdout:4326(230 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.294 INFO:tasks.workunit.client.0.smithi163.stdout:4327(231 mod 256): WRITE 0x5365e thru 0x55543 (0x1ee6 bytes) 2023-07-14T18:17:18.294 INFO:tasks.workunit.client.0.smithi163.stdout:4328(232 mod 256): PUNCH 0x45da thru 0x564d (0x1074 bytes) 2023-07-14T18:17:18.294 INFO:tasks.workunit.client.0.smithi163.stdout:4329(233 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.294 INFO:tasks.workunit.client.0.smithi163.stdout:4330(234 mod 256): PUNCH 0x2025a thru 0x28312 (0x80b9 bytes) 2023-07-14T18:17:18.295 INFO:tasks.workunit.client.0.smithi163.stdout:4331(235 mod 256): READ 0x2894d thru 0x321ed (0x98a1 bytes) 2023-07-14T18:17:18.295 INFO:tasks.workunit.client.0.smithi163.stdout:4332(236 mod 256): READ 0x28852 thru 0x38201 (0xf9b0 bytes) ***RRRR*** 2023-07-14T18:17:18.295 INFO:tasks.workunit.client.0.smithi163.stdout:4333(237 mod 256): READ 0x61bba thru 0x6e093 (0xc4da bytes) 2023-07-14T18:17:18.295 INFO:tasks.workunit.client.0.smithi163.stdout:4334(238 mod 256): MAPREAD 0x66783 thru 0x6d1b3 (0x6a31 bytes) 2023-07-14T18:17:18.295 INFO:tasks.workunit.client.0.smithi163.stdout:4335(239 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.295 INFO:tasks.workunit.client.0.smithi163.stdout:4336(240 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.295 INFO:tasks.workunit.client.0.smithi163.stdout:4337(241 mod 256): PUNCH 0x559d2 thru 0x5a034 (0x4663 bytes) 2023-07-14T18:17:18.295 INFO:tasks.workunit.client.0.smithi163.stdout:4338(242 mod 256): READ 0x44a10 thru 0x495a1 (0x4b92 bytes) 2023-07-14T18:17:18.296 INFO:tasks.workunit.client.0.smithi163.stdout:4339(243 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.296 INFO:tasks.workunit.client.0.smithi163.stdout:4340(244 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.296 INFO:tasks.workunit.client.0.smithi163.stdout:4341(245 mod 256): MAPWRITE 0xf0196 thru 0xf6b0d (0x6978 bytes) 2023-07-14T18:17:18.296 INFO:tasks.workunit.client.0.smithi163.stdout:4342(246 mod 256): MAPWRITE 0x603a8 thru 0x66a99 (0x66f2 bytes) 2023-07-14T18:17:18.296 INFO:tasks.workunit.client.0.smithi163.stdout:4343(247 mod 256): MAPWRITE 0x90a4b thru 0x95da4 (0x535a bytes) 2023-07-14T18:17:18.296 INFO:tasks.workunit.client.0.smithi163.stdout:4344(248 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.296 INFO:tasks.workunit.client.0.smithi163.stdout:4345(249 mod 256): TRUNCATE DOWN from 0xf6b0e to 0xecb65 2023-07-14T18:17:18.296 INFO:tasks.workunit.client.0.smithi163.stdout:4346(250 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.297 INFO:tasks.workunit.client.0.smithi163.stdout:4347(251 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.297 INFO:tasks.workunit.client.0.smithi163.stdout:4348(252 mod 256): MAPREAD 0x2c2f3 thru 0x2fd72 (0x3a80 bytes) 2023-07-14T18:17:18.297 INFO:tasks.workunit.client.0.smithi163.stdout:4349(253 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.297 INFO:tasks.workunit.client.0.smithi163.stdout:4350(254 mod 256): READ 0x3fbb0 thru 0x422fb (0x274c bytes) 2023-07-14T18:17:18.297 INFO:tasks.workunit.client.0.smithi163.stdout:4351(255 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.297 INFO:tasks.workunit.client.0.smithi163.stdout:4352( 0 mod 256): MAPWRITE 0xf25cc thru 0xf6fc0 (0x49f5 bytes) 2023-07-14T18:17:18.297 INFO:tasks.workunit.client.0.smithi163.stdout:4353( 1 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.297 INFO:tasks.workunit.client.0.smithi163.stdout:4354( 2 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.298 INFO:tasks.workunit.client.0.smithi163.stdout:4355( 3 mod 256): PUNCH 0x20d3d thru 0x30645 (0xf909 bytes) 2023-07-14T18:17:18.298 INFO:tasks.workunit.client.0.smithi163.stdout:4356( 4 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.298 INFO:tasks.workunit.client.0.smithi163.stdout:4357( 5 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.298 INFO:tasks.workunit.client.0.smithi163.stdout:4358( 6 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.298 INFO:tasks.workunit.client.0.smithi163.stdout:4359( 7 mod 256): COPY 0xb1c6e thru 0xb80ad (0x6440 bytes) to 0x7550b thru 0x7b94a 2023-07-14T18:17:18.298 INFO:tasks.workunit.client.0.smithi163.stdout:4360( 8 mod 256): MAPWRITE 0xb05c5 thru 0xb124a (0xc86 bytes) 2023-07-14T18:17:18.298 INFO:tasks.workunit.client.0.smithi163.stdout:4361( 9 mod 256): PUNCH 0x9a062 thru 0x9ec6d (0x4c0c bytes) 2023-07-14T18:17:18.298 INFO:tasks.workunit.client.0.smithi163.stdout:4362( 10 mod 256): FALLOC 0xbf9a6 thru 0xc07fe (0xe58 bytes) INTERIOR 2023-07-14T18:17:18.299 INFO:tasks.workunit.client.0.smithi163.stdout:4363( 11 mod 256): FALLOC 0x931a7 thru 0xa293e (0xf797 bytes) INTERIOR 2023-07-14T18:17:18.299 INFO:tasks.workunit.client.0.smithi163.stdout:4364( 12 mod 256): MAPREAD 0x39fcb thru 0x49821 (0xf857 bytes) 2023-07-14T18:17:18.299 INFO:tasks.workunit.client.0.smithi163.stdout:4365( 13 mod 256): MAPREAD 0x38350 thru 0x41a75 (0x9726 bytes) 2023-07-14T18:17:18.299 INFO:tasks.workunit.client.0.smithi163.stdout:4366( 14 mod 256): MAPREAD 0xdc9d0 thru 0xe16ca (0x4cfb bytes) 2023-07-14T18:17:18.299 INFO:tasks.workunit.client.0.smithi163.stdout:4367( 15 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.299 INFO:tasks.workunit.client.0.smithi163.stdout:4368( 16 mod 256): MAPREAD 0xadd8a thru 0xb6161 (0x83d8 bytes) 2023-07-14T18:17:18.299 INFO:tasks.workunit.client.0.smithi163.stdout:4369( 17 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.299 INFO:tasks.workunit.client.0.smithi163.stdout:4370( 18 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.300 INFO:tasks.workunit.client.0.smithi163.stdout:4371( 19 mod 256): MAPWRITE 0xc1a3b thru 0xc3d26 (0x22ec bytes) 2023-07-14T18:17:18.300 INFO:tasks.workunit.client.0.smithi163.stdout:4372( 20 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.300 INFO:tasks.workunit.client.0.smithi163.stdout:4373( 21 mod 256): TRUNCATE DOWN from 0xf6fc1 to 0x5f05d 2023-07-14T18:17:18.300 INFO:tasks.workunit.client.0.smithi163.stdout:4374( 22 mod 256): READ 0x3f7c7 thru 0x46eb4 (0x76ee bytes) 2023-07-14T18:17:18.300 INFO:tasks.workunit.client.0.smithi163.stdout:4375( 23 mod 256): MAPREAD 0x1f374 thru 0x2844a (0x90d7 bytes) 2023-07-14T18:17:18.300 INFO:tasks.workunit.client.0.smithi163.stdout:4376( 24 mod 256): READ 0x1a266 thru 0x27d21 (0xdabc bytes) 2023-07-14T18:17:18.300 INFO:tasks.workunit.client.0.smithi163.stdout:4377( 25 mod 256): MAPWRITE 0xa35d thru 0x159c5 (0xb669 bytes) 2023-07-14T18:17:18.300 INFO:tasks.workunit.client.0.smithi163.stdout:4378( 26 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.301 INFO:tasks.workunit.client.0.smithi163.stdout:4379( 27 mod 256): COPY 0xd0f7 thru 0x1b4f8 (0xe402 bytes) to 0xa94f4 thru 0xb78f5 2023-07-14T18:17:18.301 INFO:tasks.workunit.client.0.smithi163.stdout:4380( 28 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.301 INFO:tasks.workunit.client.0.smithi163.stdout:4381( 29 mod 256): MAPWRITE 0xfd73c thru 0xfffff (0x28c4 bytes) 2023-07-14T18:17:18.301 INFO:tasks.workunit.client.0.smithi163.stdout:4382( 30 mod 256): PUNCH 0x30ca9 thru 0x3a149 (0x94a1 bytes) ******PPPP 2023-07-14T18:17:18.301 INFO:tasks.workunit.client.0.smithi163.stdout:4383( 31 mod 256): COPY 0x4a509 thru 0x50487 (0x5f7f bytes) to 0x2a24d thru 0x301cb 2023-07-14T18:17:18.301 INFO:tasks.workunit.client.0.smithi163.stdout:4384( 32 mod 256): WRITE 0x4dbbd thru 0x4ef82 (0x13c6 bytes) 2023-07-14T18:17:18.301 INFO:tasks.workunit.client.0.smithi163.stdout:4385( 33 mod 256): FALLOC 0x9621a thru 0x9be35 (0x5c1b bytes) INTERIOR 2023-07-14T18:17:18.301 INFO:tasks.workunit.client.0.smithi163.stdout:4386( 34 mod 256): TRUNCATE DOWN from 0x100000 to 0x6b536 2023-07-14T18:17:18.302 INFO:tasks.workunit.client.0.smithi163.stdout:4387( 35 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.302 INFO:tasks.workunit.client.0.smithi163.stdout:4388( 36 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.302 INFO:tasks.workunit.client.0.smithi163.stdout:4389( 37 mod 256): MAPREAD 0x26c0f thru 0x2cfd3 (0x63c5 bytes) 2023-07-14T18:17:18.302 INFO:tasks.workunit.client.0.smithi163.stdout:4390( 38 mod 256): TRUNCATE UP from 0x6b536 to 0xacae5 2023-07-14T18:17:18.302 INFO:tasks.workunit.client.0.smithi163.stdout:4391( 39 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.302 INFO:tasks.workunit.client.0.smithi163.stdout:4392( 40 mod 256): PUNCH 0x93c1e thru 0x9ac67 (0x704a bytes) 2023-07-14T18:17:18.302 INFO:tasks.workunit.client.0.smithi163.stdout:4393( 41 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.302 INFO:tasks.workunit.client.0.smithi163.stdout:4394( 42 mod 256): COPY 0x6b180 thru 0x770aa (0xbf2b bytes) to 0x8f685 thru 0x9b5af 2023-07-14T18:17:18.303 INFO:tasks.workunit.client.0.smithi163.stdout:4395( 43 mod 256): WRITE 0xd3e93 thru 0xdf6c5 (0xb833 bytes) HOLE 2023-07-14T18:17:18.303 INFO:tasks.workunit.client.0.smithi163.stdout:4396( 44 mod 256): COPY 0x3112c thru 0x39cd4 (0x8ba9 bytes) to 0x6da3b thru 0x765e3 EEEE****** 2023-07-14T18:17:18.303 INFO:tasks.workunit.client.0.smithi163.stdout:4397( 45 mod 256): WRITE 0xbd529 thru 0xc09c4 (0x349c bytes) 2023-07-14T18:17:18.303 INFO:tasks.workunit.client.0.smithi163.stdout:4398( 46 mod 256): COPY 0x683c thru 0x12cd7 (0xc49c bytes) to 0x4c25f thru 0x586fa 2023-07-14T18:17:18.303 INFO:tasks.workunit.client.0.smithi163.stdout:4399( 47 mod 256): READ 0xb9421 thru 0xc8b3e (0xf71e bytes) 2023-07-14T18:17:18.303 INFO:tasks.workunit.client.0.smithi163.stdout:4400( 48 mod 256): MAPREAD 0x79086 thru 0x79793 (0x70e bytes) 2023-07-14T18:17:18.303 INFO:tasks.workunit.client.0.smithi163.stdout:4401( 49 mod 256): TRUNCATE DOWN from 0xdf6c6 to 0x868b5 2023-07-14T18:17:18.303 INFO:tasks.workunit.client.0.smithi163.stdout:4402( 50 mod 256): MAPREAD 0x30f6b thru 0x37993 (0x6a29 bytes) 2023-07-14T18:17:18.304 INFO:tasks.workunit.client.0.smithi163.stdout:4403( 51 mod 256): TRUNCATE UP from 0x868b5 to 0xae35a 2023-07-14T18:17:18.304 INFO:tasks.workunit.client.0.smithi163.stdout:4404( 52 mod 256): COPY 0x44f8 thru 0x8571 (0x407a bytes) to 0x4503c thru 0x490b5 2023-07-14T18:17:18.304 INFO:tasks.workunit.client.0.smithi163.stdout:4405( 53 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.304 INFO:tasks.workunit.client.0.smithi163.stdout:4406( 54 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.304 INFO:tasks.workunit.client.0.smithi163.stdout:4407( 55 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.304 INFO:tasks.workunit.client.0.smithi163.stdout:4408( 56 mod 256): TRUNCATE DOWN from 0xae35a to 0xa8309 2023-07-14T18:17:18.304 INFO:tasks.workunit.client.0.smithi163.stdout:4409( 57 mod 256): FALLOC 0xd2ab7 thru 0xd2d15 (0x25e bytes) EXTENDING 2023-07-14T18:17:18.304 INFO:tasks.workunit.client.0.smithi163.stdout:4410( 58 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.305 INFO:tasks.workunit.client.0.smithi163.stdout:4411( 59 mod 256): FALLOC 0x20db4 thru 0x2105b (0x2a7 bytes) INTERIOR 2023-07-14T18:17:18.305 INFO:tasks.workunit.client.0.smithi163.stdout:4412( 60 mod 256): WRITE 0x349dd thru 0x3ba1c (0x7040 bytes) ***WWWW 2023-07-14T18:17:18.305 INFO:tasks.workunit.client.0.smithi163.stdout:4413( 61 mod 256): COPY 0x9ae47 thru 0xa3cd8 (0x8e92 bytes) to 0x77bc5 thru 0x80a56 2023-07-14T18:17:18.305 INFO:tasks.workunit.client.0.smithi163.stdout:4414( 62 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.305 INFO:tasks.workunit.client.0.smithi163.stdout:4415( 63 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.305 INFO:tasks.workunit.client.0.smithi163.stdout:4416( 64 mod 256): TRUNCATE DOWN from 0xd2d15 to 0x9ada2 2023-07-14T18:17:18.305 INFO:tasks.workunit.client.0.smithi163.stdout:4417( 65 mod 256): PUNCH 0x7d9c0 thru 0x813d4 (0x3a15 bytes) 2023-07-14T18:17:18.305 INFO:tasks.workunit.client.0.smithi163.stdout:4418( 66 mod 256): FALLOC 0x83681 thru 0x8ff76 (0xc8f5 bytes) INTERIOR 2023-07-14T18:17:18.306 INFO:tasks.workunit.client.0.smithi163.stdout:4419( 67 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.306 INFO:tasks.workunit.client.0.smithi163.stdout:4420( 68 mod 256): WRITE 0xccf9d thru 0xcfe18 (0x2e7c bytes) HOLE 2023-07-14T18:17:18.306 INFO:tasks.workunit.client.0.smithi163.stdout:4421( 69 mod 256): FALLOC 0x27633 thru 0x371d2 (0xfb9f bytes) INTERIOR 2023-07-14T18:17:18.306 INFO:tasks.workunit.client.0.smithi163.stdout:4422( 70 mod 256): PUNCH 0xc29fd thru 0xcdc45 (0xb249 bytes) 2023-07-14T18:17:18.306 INFO:tasks.workunit.client.0.smithi163.stdout:4423( 71 mod 256): MAPWRITE 0x488f5 thru 0x52484 (0x9b90 bytes) 2023-07-14T18:17:18.306 INFO:tasks.workunit.client.0.smithi163.stdout:4424( 72 mod 256): READ 0xa34bc thru 0xa58fd (0x2442 bytes) 2023-07-14T18:17:18.306 INFO:tasks.workunit.client.0.smithi163.stdout:4425( 73 mod 256): TRUNCATE DOWN from 0xcfe19 to 0x59db5 2023-07-14T18:17:18.306 INFO:tasks.workunit.client.0.smithi163.stdout:4426( 74 mod 256): FALLOC 0x260ac thru 0x28cf2 (0x2c46 bytes) INTERIOR 2023-07-14T18:17:18.307 INFO:tasks.workunit.client.0.smithi163.stdout:4427( 75 mod 256): WRITE 0xe76ff thru 0xf2bef (0xb4f1 bytes) HOLE 2023-07-14T18:17:18.307 INFO:tasks.workunit.client.0.smithi163.stdout:4428( 76 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.307 INFO:tasks.workunit.client.0.smithi163.stdout:4429( 77 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.307 INFO:tasks.workunit.client.0.smithi163.stdout:4430( 78 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.307 INFO:tasks.workunit.client.0.smithi163.stdout:4431( 79 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.307 INFO:tasks.workunit.client.0.smithi163.stdout:4432( 80 mod 256): MAPWRITE 0x5e7ff thru 0x6ce3a (0xe63c bytes) 2023-07-14T18:17:18.307 INFO:tasks.workunit.client.0.smithi163.stdout:4433( 81 mod 256): TRUNCATE DOWN from 0xf2bf0 to 0x5e226 2023-07-14T18:17:18.307 INFO:tasks.workunit.client.0.smithi163.stdout:4434( 82 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.308 INFO:tasks.workunit.client.0.smithi163.stdout:4435( 83 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.308 INFO:tasks.workunit.client.0.smithi163.stdout:4436( 84 mod 256): FALLOC 0xb45c3 thru 0xbf4b2 (0xaeef bytes) PAST_EOF 2023-07-14T18:17:18.308 INFO:tasks.workunit.client.0.smithi163.stdout:4437( 85 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.308 INFO:tasks.workunit.client.0.smithi163.stdout:4438( 86 mod 256): MAPWRITE 0x83029 thru 0x83dff (0xdd7 bytes) 2023-07-14T18:17:18.308 INFO:tasks.workunit.client.0.smithi163.stdout:4439( 87 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.308 INFO:tasks.workunit.client.0.smithi163.stdout:4440( 88 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.308 INFO:tasks.workunit.client.0.smithi163.stdout:4441( 89 mod 256): WRITE 0x62c3b thru 0x6a228 (0x75ee bytes) 2023-07-14T18:17:18.308 INFO:tasks.workunit.client.0.smithi163.stdout:4442( 90 mod 256): WRITE 0x2e5c5 thru 0x32d8e (0x47ca bytes) 2023-07-14T18:17:18.309 INFO:tasks.workunit.client.0.smithi163.stdout:4443( 91 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.309 INFO:tasks.workunit.client.0.smithi163.stdout:4444( 92 mod 256): WRITE 0x163fa thru 0x24bd2 (0xe7d9 bytes) 2023-07-14T18:17:18.309 INFO:tasks.workunit.client.0.smithi163.stdout:4445( 93 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.309 INFO:tasks.workunit.client.0.smithi163.stdout:4446( 94 mod 256): WRITE 0xcd7d6 thru 0xcdd01 (0x52c bytes) HOLE 2023-07-14T18:17:18.309 INFO:tasks.workunit.client.0.smithi163.stdout:4447( 95 mod 256): MAPWRITE 0x7ad4f thru 0x82626 (0x78d8 bytes) 2023-07-14T18:17:18.309 INFO:tasks.workunit.client.0.smithi163.stdout:4448( 96 mod 256): MAPWRITE 0x847ed thru 0x8f599 (0xadad bytes) 2023-07-14T18:17:18.309 INFO:tasks.workunit.client.0.smithi163.stdout:4449( 97 mod 256): READ 0xb6cde thru 0xc2fa7 (0xc2ca bytes) 2023-07-14T18:17:18.309 INFO:tasks.workunit.client.0.smithi163.stdout:4450( 98 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.310 INFO:tasks.workunit.client.0.smithi163.stdout:4451( 99 mod 256): TRUNCATE DOWN from 0xcdd02 to 0x6dce6 2023-07-14T18:17:18.310 INFO:tasks.workunit.client.0.smithi163.stdout:4452(100 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.310 INFO:tasks.workunit.client.0.smithi163.stdout:4453(101 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.310 INFO:tasks.workunit.client.0.smithi163.stdout:4454(102 mod 256): TRUNCATE UP from 0x6dce6 to 0xf8758 2023-07-14T18:17:18.310 INFO:tasks.workunit.client.0.smithi163.stdout:4455(103 mod 256): TRUNCATE DOWN from 0xf8758 to 0x718e7 2023-07-14T18:17:18.310 INFO:tasks.workunit.client.0.smithi163.stdout:4456(104 mod 256): FALLOC 0x75db5 thru 0x78cfc (0x2f47 bytes) EXTENDING 2023-07-14T18:17:18.310 INFO:tasks.workunit.client.0.smithi163.stdout:4457(105 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.310 INFO:tasks.workunit.client.0.smithi163.stdout:4458(106 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.311 INFO:tasks.workunit.client.0.smithi163.stdout:4459(107 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.311 INFO:tasks.workunit.client.0.smithi163.stdout:4460(108 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.311 INFO:tasks.workunit.client.0.smithi163.stdout:4461(109 mod 256): WRITE 0x89737 thru 0x956c8 (0xbf92 bytes) HOLE 2023-07-14T18:17:18.311 INFO:tasks.workunit.client.0.smithi163.stdout:4462(110 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.311 INFO:tasks.workunit.client.0.smithi163.stdout:4463(111 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.311 INFO:tasks.workunit.client.0.smithi163.stdout:4464(112 mod 256): FALLOC 0x1694c thru 0x1b3df (0x4a93 bytes) INTERIOR 2023-07-14T18:17:18.311 INFO:tasks.workunit.client.0.smithi163.stdout:4465(113 mod 256): FALLOC 0xaf0aa thru 0xb4d69 (0x5cbf bytes) EXTENDING 2023-07-14T18:17:18.311 INFO:tasks.workunit.client.0.smithi163.stdout:4466(114 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.312 INFO:tasks.workunit.client.0.smithi163.stdout:4467(115 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.312 INFO:tasks.workunit.client.0.smithi163.stdout:4468(116 mod 256): FALLOC 0x62c3f thru 0x6e3cf (0xb790 bytes) INTERIOR 2023-07-14T18:17:18.312 INFO:tasks.workunit.client.0.smithi163.stdout:4469(117 mod 256): FALLOC 0x5e4ab thru 0x68f31 (0xaa86 bytes) INTERIOR 2023-07-14T18:17:18.312 INFO:tasks.workunit.client.0.smithi163.stdout:4470(118 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.312 INFO:tasks.workunit.client.0.smithi163.stdout:4471(119 mod 256): MAPWRITE 0x5ad56 thru 0x5babd (0xd68 bytes) 2023-07-14T18:17:18.312 INFO:tasks.workunit.client.0.smithi163.stdout:4472(120 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.312 INFO:tasks.workunit.client.0.smithi163.stdout:4473(121 mod 256): MAPREAD 0xb2927 thru 0xb4d68 (0x2442 bytes) 2023-07-14T18:17:18.312 INFO:tasks.workunit.client.0.smithi163.stdout:4474(122 mod 256): WRITE 0xd059d thru 0xe049c (0xff00 bytes) HOLE 2023-07-14T18:17:18.313 INFO:tasks.workunit.client.0.smithi163.stdout:4475(123 mod 256): WRITE 0x73dcd thru 0x81d98 (0xdfcc bytes) 2023-07-14T18:17:18.313 INFO:tasks.workunit.client.0.smithi163.stdout:4476(124 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.313 INFO:tasks.workunit.client.0.smithi163.stdout:4477(125 mod 256): PUNCH 0xd288e thru 0xe049c (0xdc0f bytes) 2023-07-14T18:17:18.313 INFO:tasks.workunit.client.0.smithi163.stdout:4478(126 mod 256): PUNCH 0x1de47 thru 0x2afbc (0xd176 bytes) 2023-07-14T18:17:18.313 INFO:tasks.workunit.client.0.smithi163.stdout:4479(127 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.313 INFO:tasks.workunit.client.0.smithi163.stdout:4480(128 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.313 INFO:tasks.workunit.client.0.smithi163.stdout:4481(129 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.313 INFO:tasks.workunit.client.0.smithi163.stdout:4482(130 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.314 INFO:tasks.workunit.client.0.smithi163.stdout:4483(131 mod 256): READ 0x8c67d thru 0x909f2 (0x4376 bytes) 2023-07-14T18:17:18.314 INFO:tasks.workunit.client.0.smithi163.stdout:4484(132 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.314 INFO:tasks.workunit.client.0.smithi163.stdout:4485(133 mod 256): MAPWRITE 0xf0442 thru 0xf48ef (0x44ae bytes) 2023-07-14T18:17:18.314 INFO:tasks.workunit.client.0.smithi163.stdout:4486(134 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.314 INFO:tasks.workunit.client.0.smithi163.stdout:4487(135 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.314 INFO:tasks.workunit.client.0.smithi163.stdout:4488(136 mod 256): MAPREAD 0xbeb95 thru 0xbf452 (0x8be bytes) 2023-07-14T18:17:18.314 INFO:tasks.workunit.client.0.smithi163.stdout:4489(137 mod 256): COPY 0x5ff7 thru 0x7b2f (0x1b39 bytes) to 0xcd342 thru 0xcee7a 2023-07-14T18:17:18.314 INFO:tasks.workunit.client.0.smithi163.stdout:4490(138 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.315 INFO:tasks.workunit.client.0.smithi163.stdout:4491(139 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.315 INFO:tasks.workunit.client.0.smithi163.stdout:4492(140 mod 256): COPY 0xddf8b thru 0xe6f4b (0x8fc1 bytes) to 0x50cfa thru 0x59cba 2023-07-14T18:17:18.315 INFO:tasks.workunit.client.0.smithi163.stdout:4493(141 mod 256): MAPWRITE 0x4617f thru 0x467b1 (0x633 bytes) 2023-07-14T18:17:18.315 INFO:tasks.workunit.client.0.smithi163.stdout:4494(142 mod 256): FALLOC 0xf5395 thru 0x100000 (0xac6b bytes) PAST_EOF 2023-07-14T18:17:18.315 INFO:tasks.workunit.client.0.smithi163.stdout:4495(143 mod 256): TRUNCATE DOWN from 0xf48f0 to 0xe051b 2023-07-14T18:17:18.315 INFO:tasks.workunit.client.0.smithi163.stdout:4496(144 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.315 INFO:tasks.workunit.client.0.smithi163.stdout:4497(145 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.315 INFO:tasks.workunit.client.0.smithi163.stdout:4498(146 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.316 INFO:tasks.workunit.client.0.smithi163.stdout:4499(147 mod 256): COPY 0xc9c53 thru 0xd9462 (0xf810 bytes) to 0x7d91f thru 0x8d12e 2023-07-14T18:17:18.316 INFO:tasks.workunit.client.0.smithi163.stdout:4500(148 mod 256): FALLOC 0xe9e4a thru 0xf6bfb (0xcdb1 bytes) EXTENDING 2023-07-14T18:17:18.316 INFO:tasks.workunit.client.0.smithi163.stdout:4501(149 mod 256): TRUNCATE DOWN from 0xf6bfb to 0xf5d7b 2023-07-14T18:17:18.316 INFO:tasks.workunit.client.0.smithi163.stdout:4502(150 mod 256): MAPWRITE 0xb70b1 thru 0xbc7d0 (0x5720 bytes) 2023-07-14T18:17:18.316 INFO:tasks.workunit.client.0.smithi163.stdout:4503(151 mod 256): WRITE 0x4b7e5 thru 0x56fc5 (0xb7e1 bytes) 2023-07-14T18:17:18.316 INFO:tasks.workunit.client.0.smithi163.stdout:4504(152 mod 256): READ 0x784eb thru 0x78e42 (0x958 bytes) 2023-07-14T18:17:18.316 INFO:tasks.workunit.client.0.smithi163.stdout:4505(153 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.316 INFO:tasks.workunit.client.0.smithi163.stdout:4506(154 mod 256): READ 0xe3774 thru 0xe4e34 (0x16c1 bytes) 2023-07-14T18:17:18.317 INFO:tasks.workunit.client.0.smithi163.stdout:4507(155 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.317 INFO:tasks.workunit.client.0.smithi163.stdout:4508(156 mod 256): TRUNCATE DOWN from 0xf5d7b to 0x3e215 2023-07-14T18:17:18.317 INFO:tasks.workunit.client.0.smithi163.stdout:4509(157 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.317 INFO:tasks.workunit.client.0.smithi163.stdout:4510(158 mod 256): READ 0x434a thru 0x80d5 (0x3d8c bytes) 2023-07-14T18:17:18.317 INFO:tasks.workunit.client.0.smithi163.stdout:4511(159 mod 256): TRUNCATE UP from 0x3e215 to 0xaa2aa 2023-07-14T18:17:18.317 INFO:tasks.workunit.client.0.smithi163.stdout:4512(160 mod 256): PUNCH 0x2dd5d thru 0x2f64c (0x18f0 bytes) 2023-07-14T18:17:18.317 INFO:tasks.workunit.client.0.smithi163.stdout:4513(161 mod 256): PUNCH 0x5078c thru 0x5b12b (0xa9a0 bytes) 2023-07-14T18:17:18.317 INFO:tasks.workunit.client.0.smithi163.stdout:4514(162 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.318 INFO:tasks.workunit.client.0.smithi163.stdout:4515(163 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.318 INFO:tasks.workunit.client.0.smithi163.stdout:4516(164 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.318 INFO:tasks.workunit.client.0.smithi163.stdout:4517(165 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.318 INFO:tasks.workunit.client.0.smithi163.stdout:4518(166 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.318 INFO:tasks.workunit.client.0.smithi163.stdout:4519(167 mod 256): MAPWRITE 0xe04dd thru 0xe0e06 (0x92a bytes) 2023-07-14T18:17:18.318 INFO:tasks.workunit.client.0.smithi163.stdout:4520(168 mod 256): READ 0xc5997 thru 0xd1676 (0xbce0 bytes) 2023-07-14T18:17:18.318 INFO:tasks.workunit.client.0.smithi163.stdout:4521(169 mod 256): TRUNCATE DOWN from 0xe0e07 to 0x81b59 2023-07-14T18:17:18.318 INFO:tasks.workunit.client.0.smithi163.stdout:4522(170 mod 256): TRUNCATE DOWN from 0x81b59 to 0x13b55 ******WWWW 2023-07-14T18:17:18.319 INFO:tasks.workunit.client.0.smithi163.stdout:4523(171 mod 256): MAPREAD 0x7188 thru 0x108d1 (0x974a bytes) 2023-07-14T18:17:18.319 INFO:tasks.workunit.client.0.smithi163.stdout:4524(172 mod 256): MAPREAD 0x5ce5 thru 0xbd62 (0x607e bytes) 2023-07-14T18:17:18.319 INFO:tasks.workunit.client.0.smithi163.stdout:4525(173 mod 256): FALLOC 0x183a3 thru 0x26dae (0xea0b bytes) PAST_EOF 2023-07-14T18:17:18.319 INFO:tasks.workunit.client.0.smithi163.stdout:4526(174 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.319 INFO:tasks.workunit.client.0.smithi163.stdout:4527(175 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.319 INFO:tasks.workunit.client.0.smithi163.stdout:4528(176 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.319 INFO:tasks.workunit.client.0.smithi163.stdout:4529(177 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.319 INFO:tasks.workunit.client.0.smithi163.stdout:4530(178 mod 256): PUNCH 0x81da thru 0x12546 (0xa36d bytes) 2023-07-14T18:17:18.320 INFO:tasks.workunit.client.0.smithi163.stdout:4531(179 mod 256): READ 0x56c4 thru 0x9b24 (0x4461 bytes) 2023-07-14T18:17:18.320 INFO:tasks.workunit.client.0.smithi163.stdout:4532(180 mod 256): MAPWRITE 0x94735 thru 0xa2b18 (0xe3e4 bytes) 2023-07-14T18:17:18.320 INFO:tasks.workunit.client.0.smithi163.stdout:4533(181 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.320 INFO:tasks.workunit.client.0.smithi163.stdout:4534(182 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.320 INFO:tasks.workunit.client.0.smithi163.stdout:4535(183 mod 256): FALLOC 0x730a7 thru 0x7d9e7 (0xa940 bytes) INTERIOR 2023-07-14T18:17:18.320 INFO:tasks.workunit.client.0.smithi163.stdout:4536(184 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.320 INFO:tasks.workunit.client.0.smithi163.stdout:4537(185 mod 256): MAPWRITE 0xd5873 thru 0xda6b5 (0x4e43 bytes) 2023-07-14T18:17:18.320 INFO:tasks.workunit.client.0.smithi163.stdout:4538(186 mod 256): COPY 0xd5f8 thru 0xfd16 (0x271f bytes) to 0x4692a thru 0x49048 2023-07-14T18:17:18.321 INFO:tasks.workunit.client.0.smithi163.stdout:4539(187 mod 256): TRUNCATE DOWN from 0xda6b6 to 0x20fad ******WWWW 2023-07-14T18:17:18.321 INFO:tasks.workunit.client.0.smithi163.stdout:4540(188 mod 256): READ 0x11622 thru 0x1665e (0x503d bytes) 2023-07-14T18:17:18.321 INFO:tasks.workunit.client.0.smithi163.stdout:4541(189 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.321 INFO:tasks.workunit.client.0.smithi163.stdout:4542(190 mod 256): MAPWRITE 0x4ed8e thru 0x56f60 (0x81d3 bytes) 2023-07-14T18:17:18.321 INFO:tasks.workunit.client.0.smithi163.stdout:4543(191 mod 256): COPY 0x342af thru 0x42c81 (0xe9d3 bytes) to 0xc9e18 thru 0xd87ea EEEE****** 2023-07-14T18:17:18.321 INFO:tasks.workunit.client.0.smithi163.stdout:4544(192 mod 256): COPY 0xa23b6 thru 0xa6acc (0x4717 bytes) to 0x73751 thru 0x77e67 2023-07-14T18:17:18.321 INFO:tasks.workunit.client.0.smithi163.stdout:4545(193 mod 256): MAPREAD 0xb9def thru 0xbe501 (0x4713 bytes) 2023-07-14T18:17:18.321 INFO:tasks.workunit.client.0.smithi163.stdout:4546(194 mod 256): FALLOC 0xdcf7b thru 0xe9ea7 (0xcf2c bytes) EXTENDING 2023-07-14T18:17:18.322 INFO:tasks.workunit.client.0.smithi163.stdout:4547(195 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.322 INFO:tasks.workunit.client.0.smithi163.stdout:4548(196 mod 256): MAPREAD 0x463a6 thru 0x514e7 (0xb142 bytes) 2023-07-14T18:17:18.322 INFO:tasks.workunit.client.0.smithi163.stdout:4549(197 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.322 INFO:tasks.workunit.client.0.smithi163.stdout:4550(198 mod 256): MAPWRITE 0x622b8 thru 0x66d16 (0x4a5f bytes) 2023-07-14T18:17:18.322 INFO:tasks.workunit.client.0.smithi163.stdout:4551(199 mod 256): MAPWRITE 0xcc0ff thru 0xcdfc0 (0x1ec2 bytes) 2023-07-14T18:17:18.322 INFO:tasks.workunit.client.0.smithi163.stdout:4552(200 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.322 INFO:tasks.workunit.client.0.smithi163.stdout:4553(201 mod 256): COPY 0x3ee2b thru 0x46dcd (0x7fa3 bytes) to 0xad818 thru 0xb57ba 2023-07-14T18:17:18.322 INFO:tasks.workunit.client.0.smithi163.stdout:4554(202 mod 256): WRITE 0xe791c thru 0xf1af5 (0xa1da bytes) EXTEND 2023-07-14T18:17:18.323 INFO:tasks.workunit.client.0.smithi163.stdout:4555(203 mod 256): PUNCH 0xd3308 thru 0xde30a (0xb003 bytes) 2023-07-14T18:17:18.323 INFO:tasks.workunit.client.0.smithi163.stdout:4556(204 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.323 INFO:tasks.workunit.client.0.smithi163.stdout:4557(205 mod 256): TRUNCATE DOWN from 0xf1af6 to 0x5dfe2 2023-07-14T18:17:18.323 INFO:tasks.workunit.client.0.smithi163.stdout:4558(206 mod 256): COPY 0x4fa thru 0xfed0 (0xf9d7 bytes) to 0x8d344 thru 0x9cd1a 2023-07-14T18:17:18.323 INFO:tasks.workunit.client.0.smithi163.stdout:4559(207 mod 256): PUNCH 0x6fb1a thru 0x78ec5 (0x93ac bytes) 2023-07-14T18:17:18.323 INFO:tasks.workunit.client.0.smithi163.stdout:4560(208 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.323 INFO:tasks.workunit.client.0.smithi163.stdout:4561(209 mod 256): PUNCH 0x99823 thru 0x9cd1a (0x34f8 bytes) 2023-07-14T18:17:18.323 INFO:tasks.workunit.client.0.smithi163.stdout:4562(210 mod 256): COPY 0x967fc thru 0x9a096 (0x389b bytes) to 0x7cde3 thru 0x8067d 2023-07-14T18:17:18.324 INFO:tasks.workunit.client.0.smithi163.stdout:4563(211 mod 256): COPY 0x14777 thru 0x1d2af (0x8b39 bytes) to 0x2984 thru 0xb4bc 2023-07-14T18:17:18.324 INFO:tasks.workunit.client.0.smithi163.stdout:4564(212 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.324 INFO:tasks.workunit.client.0.smithi163.stdout:4565(213 mod 256): PUNCH 0x542f0 thru 0x60539 (0xc24a bytes) 2023-07-14T18:17:18.324 INFO:tasks.workunit.client.0.smithi163.stdout:4566(214 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.324 INFO:tasks.workunit.client.0.smithi163.stdout:4567(215 mod 256): READ 0x774ca thru 0x8359f (0xc0d6 bytes) 2023-07-14T18:17:18.324 INFO:tasks.workunit.client.0.smithi163.stdout:4568(216 mod 256): PUNCH 0x5fae2 thru 0x6b173 (0xb692 bytes) 2023-07-14T18:17:18.324 INFO:tasks.workunit.client.0.smithi163.stdout:4569(217 mod 256): READ 0x62b8f thru 0x70e12 (0xe284 bytes) 2023-07-14T18:17:18.325 INFO:tasks.workunit.client.0.smithi163.stdout:4570(218 mod 256): PUNCH 0x3ab5d thru 0x45236 (0xa6da bytes) 2023-07-14T18:17:18.325 INFO:tasks.workunit.client.0.smithi163.stdout:4571(219 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.325 INFO:tasks.workunit.client.0.smithi163.stdout:4572(220 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.325 INFO:tasks.workunit.client.0.smithi163.stdout:4573(221 mod 256): WRITE 0x5e237 thru 0x620b1 (0x3e7b bytes) 2023-07-14T18:17:18.325 INFO:tasks.workunit.client.0.smithi163.stdout:4574(222 mod 256): FALLOC 0x6cc4b thru 0x75dc7 (0x917c bytes) INTERIOR 2023-07-14T18:17:18.325 INFO:tasks.workunit.client.0.smithi163.stdout:4575(223 mod 256): PUNCH 0x8704c thru 0x9406f (0xd024 bytes) 2023-07-14T18:17:18.325 INFO:tasks.workunit.client.0.smithi163.stdout:4576(224 mod 256): READ 0x20b91 thru 0x2a50d (0x997d bytes) 2023-07-14T18:17:18.325 INFO:tasks.workunit.client.0.smithi163.stdout:4577(225 mod 256): PUNCH 0x8e175 thru 0x91ba4 (0x3a30 bytes) 2023-07-14T18:17:18.326 INFO:tasks.workunit.client.0.smithi163.stdout:4578(226 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.326 INFO:tasks.workunit.client.0.smithi163.stdout:4579(227 mod 256): PUNCH 0x26002 thru 0x35479 (0xf478 bytes) 2023-07-14T18:17:18.326 INFO:tasks.workunit.client.0.smithi163.stdout:4580(228 mod 256): PUNCH 0x2253 thru 0x46e4 (0x2492 bytes) 2023-07-14T18:17:18.326 INFO:tasks.workunit.client.0.smithi163.stdout:4581(229 mod 256): WRITE 0x797af thru 0x841bf (0xaa11 bytes) 2023-07-14T18:17:18.326 INFO:tasks.workunit.client.0.smithi163.stdout:4582(230 mod 256): TRUNCATE UP from 0x9cd1b to 0xe3d7f 2023-07-14T18:17:18.326 INFO:tasks.workunit.client.0.smithi163.stdout:4583(231 mod 256): TRUNCATE DOWN from 0xe3d7f to 0x6c657 2023-07-14T18:17:18.326 INFO:tasks.workunit.client.0.smithi163.stdout:4584(232 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.326 INFO:tasks.workunit.client.0.smithi163.stdout:4585(233 mod 256): TRUNCATE UP from 0x6c657 to 0xf496f 2023-07-14T18:17:18.327 INFO:tasks.workunit.client.0.smithi163.stdout:4586(234 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.327 INFO:tasks.workunit.client.0.smithi163.stdout:4587(235 mod 256): MAPWRITE 0x696e9 thru 0x72fdc (0x98f4 bytes) 2023-07-14T18:17:18.327 INFO:tasks.workunit.client.0.smithi163.stdout:4588(236 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.327 INFO:tasks.workunit.client.0.smithi163.stdout:4589(237 mod 256): READ 0xda4bd thru 0xe686f (0xc3b3 bytes) 2023-07-14T18:17:18.327 INFO:tasks.workunit.client.0.smithi163.stdout:4590(238 mod 256): READ 0xd05f0 thru 0xdc638 (0xc049 bytes) 2023-07-14T18:17:18.327 INFO:tasks.workunit.client.0.smithi163.stdout:4591(239 mod 256): READ 0x5b40f thru 0x65eb2 (0xaaa4 bytes) 2023-07-14T18:17:18.327 INFO:tasks.workunit.client.0.smithi163.stdout:4592(240 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.327 INFO:tasks.workunit.client.0.smithi163.stdout:4593(241 mod 256): WRITE 0x3271e thru 0x3c3c9 (0x9cac bytes) ***WWWW 2023-07-14T18:17:18.328 INFO:tasks.workunit.client.0.smithi163.stdout:4594(242 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.328 INFO:tasks.workunit.client.0.smithi163.stdout:4595(243 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.328 INFO:tasks.workunit.client.0.smithi163.stdout:4596(244 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.328 INFO:tasks.workunit.client.0.smithi163.stdout:4597(245 mod 256): MAPREAD 0x25102 thru 0x2dcbc (0x8bbb bytes) 2023-07-14T18:17:18.328 INFO:tasks.workunit.client.0.smithi163.stdout:4598(246 mod 256): WRITE 0x9db10 thru 0xaa682 (0xcb73 bytes) 2023-07-14T18:17:18.328 INFO:tasks.workunit.client.0.smithi163.stdout:4599(247 mod 256): PUNCH 0xc397a thru 0xd1654 (0xdcdb bytes) 2023-07-14T18:17:18.328 INFO:tasks.workunit.client.0.smithi163.stdout:4600(248 mod 256): MAPWRITE 0x7aa9f thru 0x85a7b (0xafdd bytes) 2023-07-14T18:17:18.328 INFO:tasks.workunit.client.0.smithi163.stdout:4601(249 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.329 INFO:tasks.workunit.client.0.smithi163.stdout:4602(250 mod 256): READ 0xd14d0 thru 0xdf201 (0xdd32 bytes) 2023-07-14T18:17:18.329 INFO:tasks.workunit.client.0.smithi163.stdout:4603(251 mod 256): TRUNCATE DOWN from 0xf496f to 0xc9884 2023-07-14T18:17:18.329 INFO:tasks.workunit.client.0.smithi163.stdout:4604(252 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.329 INFO:tasks.workunit.client.0.smithi163.stdout:4605(253 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.329 INFO:tasks.workunit.client.0.smithi163.stdout:4606(254 mod 256): READ 0xe88c thru 0x1016a (0x18df bytes) 2023-07-14T18:17:18.329 INFO:tasks.workunit.client.0.smithi163.stdout:4607(255 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.329 INFO:tasks.workunit.client.0.smithi163.stdout:4608( 0 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.329 INFO:tasks.workunit.client.0.smithi163.stdout:4609( 1 mod 256): COPY 0x8f574 thru 0x96b8a (0x7617 bytes) to 0x97601 thru 0x9ec17 2023-07-14T18:17:18.330 INFO:tasks.workunit.client.0.smithi163.stdout:4610( 2 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.330 INFO:tasks.workunit.client.0.smithi163.stdout:4611( 3 mod 256): MAPWRITE 0xdd1fc thru 0xde799 (0x159e bytes) 2023-07-14T18:17:18.330 INFO:tasks.workunit.client.0.smithi163.stdout:4612( 4 mod 256): TRUNCATE DOWN from 0xde79a to 0xa9795 2023-07-14T18:17:18.330 INFO:tasks.workunit.client.0.smithi163.stdout:4613( 5 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.330 INFO:tasks.workunit.client.0.smithi163.stdout:4614( 6 mod 256): FALLOC 0xfa294 thru 0x100000 (0x5d6c bytes) PAST_EOF 2023-07-14T18:17:18.330 INFO:tasks.workunit.client.0.smithi163.stdout:4615( 7 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.330 INFO:tasks.workunit.client.0.smithi163.stdout:4616( 8 mod 256): READ 0x7fd50 thru 0x8eb6d (0xee1e bytes) 2023-07-14T18:17:18.330 INFO:tasks.workunit.client.0.smithi163.stdout:4617( 9 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.331 INFO:tasks.workunit.client.0.smithi163.stdout:4618( 10 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.331 INFO:tasks.workunit.client.0.smithi163.stdout:4619( 11 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.331 INFO:tasks.workunit.client.0.smithi163.stdout:4620( 12 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.331 INFO:tasks.workunit.client.0.smithi163.stdout:4621( 13 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.331 INFO:tasks.workunit.client.0.smithi163.stdout:4622( 14 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.331 INFO:tasks.workunit.client.0.smithi163.stdout:4623( 15 mod 256): FALLOC 0x34cb2 thru 0x4011f (0xb46d bytes) INTERIOR ******FFFF 2023-07-14T18:17:18.331 INFO:tasks.workunit.client.0.smithi163.stdout:4624( 16 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.331 INFO:tasks.workunit.client.0.smithi163.stdout:4625( 17 mod 256): MAPWRITE 0x68657 thru 0x69503 (0xead bytes) 2023-07-14T18:17:18.332 INFO:tasks.workunit.client.0.smithi163.stdout:4626( 18 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.332 INFO:tasks.workunit.client.0.smithi163.stdout:4627( 19 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.332 INFO:tasks.workunit.client.0.smithi163.stdout:4628( 20 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.332 INFO:tasks.workunit.client.0.smithi163.stdout:4629( 21 mod 256): WRITE 0x622c5 thru 0x6708d (0x4dc9 bytes) 2023-07-14T18:17:18.332 INFO:tasks.workunit.client.0.smithi163.stdout:4630( 22 mod 256): MAPWRITE 0xd757a thru 0xe3437 (0xbebe bytes) 2023-07-14T18:17:18.332 INFO:tasks.workunit.client.0.smithi163.stdout:4631( 23 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.332 INFO:tasks.workunit.client.0.smithi163.stdout:4632( 24 mod 256): COPY 0x9b6cb thru 0x9b9c9 (0x2ff bytes) to 0xac413 thru 0xac711 2023-07-14T18:17:18.332 INFO:tasks.workunit.client.0.smithi163.stdout:4633( 25 mod 256): READ 0x91944 thru 0x93fdd (0x269a bytes) 2023-07-14T18:17:18.333 INFO:tasks.workunit.client.0.smithi163.stdout:4634( 26 mod 256): READ 0x52e4 thru 0x1482b (0xf548 bytes) 2023-07-14T18:17:18.333 INFO:tasks.workunit.client.0.smithi163.stdout:4635( 27 mod 256): TRUNCATE DOWN from 0xe3438 to 0x7efc9 2023-07-14T18:17:18.333 INFO:tasks.workunit.client.0.smithi163.stdout:4636( 28 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.333 INFO:tasks.workunit.client.0.smithi163.stdout:4637( 29 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.333 INFO:tasks.workunit.client.0.smithi163.stdout:4638( 30 mod 256): PUNCH 0x3f95c thru 0x4568e (0x5d33 bytes) 2023-07-14T18:17:18.333 INFO:tasks.workunit.client.0.smithi163.stdout:4639( 31 mod 256): FALLOC 0x76426 thru 0x77eb5 (0x1a8f bytes) INTERIOR 2023-07-14T18:17:18.333 INFO:tasks.workunit.client.0.smithi163.stdout:4640( 32 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.333 INFO:tasks.workunit.client.0.smithi163.stdout:4641( 33 mod 256): READ 0x1439e thru 0x1a242 (0x5ea5 bytes) 2023-07-14T18:17:18.334 INFO:tasks.workunit.client.0.smithi163.stdout:4642( 34 mod 256): MAPREAD 0x232d8 thru 0x2e782 (0xb4ab bytes) 2023-07-14T18:17:18.334 INFO:tasks.workunit.client.0.smithi163.stdout:4643( 35 mod 256): MAPWRITE 0x83db8 thru 0x8a0fc (0x6345 bytes) 2023-07-14T18:17:18.334 INFO:tasks.workunit.client.0.smithi163.stdout:4644( 36 mod 256): TRUNCATE DOWN from 0x8a0fd to 0x2694a ******WWWW 2023-07-14T18:17:18.334 INFO:tasks.workunit.client.0.smithi163.stdout:4645( 37 mod 256): WRITE 0xed238 thru 0xfa0c1 (0xce8a bytes) HOLE ***WWWW 2023-07-14T18:17:18.334 INFO:tasks.workunit.client.0.smithi163.stdout:4646( 38 mod 256): COPY 0x362f3 thru 0x38260 (0x1f6e bytes) to 0x50a7d thru 0x529ea EEEE****** 2023-07-14T18:17:18.334 INFO:tasks.workunit.client.0.smithi163.stdout:4647( 39 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.334 INFO:tasks.workunit.client.0.smithi163.stdout:4648( 40 mod 256): TRUNCATE DOWN from 0xfa0c2 to 0xf8554 2023-07-14T18:17:18.334 INFO:tasks.workunit.client.0.smithi163.stdout:4649( 41 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.335 INFO:tasks.workunit.client.0.smithi163.stdout:4650( 42 mod 256): WRITE 0xedfbd thru 0xf903a (0xb07e bytes) EXTEND 2023-07-14T18:17:18.335 INFO:tasks.workunit.client.0.smithi163.stdout:4651( 43 mod 256): WRITE 0xa6bf1 thru 0xac0b3 (0x54c3 bytes) 2023-07-14T18:17:18.335 INFO:tasks.workunit.client.0.smithi163.stdout:4652( 44 mod 256): FALLOC 0x8b151 thru 0x8fe30 (0x4cdf bytes) INTERIOR 2023-07-14T18:17:18.335 INFO:tasks.workunit.client.0.smithi163.stdout:4653( 45 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.335 INFO:tasks.workunit.client.0.smithi163.stdout:4654( 46 mod 256): TRUNCATE DOWN from 0xf903b to 0xdb152 2023-07-14T18:17:18.335 INFO:tasks.workunit.client.0.smithi163.stdout:4655( 47 mod 256): WRITE 0xac86a thru 0xad40d (0xba4 bytes) 2023-07-14T18:17:18.335 INFO:tasks.workunit.client.0.smithi163.stdout:4656( 48 mod 256): FALLOC 0x9ee08 thru 0xa7383 (0x857b bytes) INTERIOR 2023-07-14T18:17:18.335 INFO:tasks.workunit.client.0.smithi163.stdout:4657( 49 mod 256): FALLOC 0xfb475 thru 0x100000 (0x4b8b bytes) PAST_EOF 2023-07-14T18:17:18.336 INFO:tasks.workunit.client.0.smithi163.stdout:4658( 50 mod 256): READ 0x19e33 thru 0x1ef15 (0x50e3 bytes) 2023-07-14T18:17:18.336 INFO:tasks.workunit.client.0.smithi163.stdout:4659( 51 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.336 INFO:tasks.workunit.client.0.smithi163.stdout:4660( 52 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.336 INFO:tasks.workunit.client.0.smithi163.stdout:4661( 53 mod 256): TRUNCATE DOWN from 0xdb152 to 0x553c ******WWWW 2023-07-14T18:17:18.336 INFO:tasks.workunit.client.0.smithi163.stdout:4662( 54 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.336 INFO:tasks.workunit.client.0.smithi163.stdout:4663( 55 mod 256): PUNCH 0x3907 thru 0x553b (0x1c35 bytes) 2023-07-14T18:17:18.336 INFO:tasks.workunit.client.0.smithi163.stdout:4664( 56 mod 256): FALLOC 0x18c26 thru 0x2037a (0x7754 bytes) EXTENDING 2023-07-14T18:17:18.336 INFO:tasks.workunit.client.0.smithi163.stdout:4665( 57 mod 256): TRUNCATE DOWN from 0x2037a to 0x8237 2023-07-14T18:17:18.337 INFO:tasks.workunit.client.0.smithi163.stdout:4666( 58 mod 256): TRUNCATE UP from 0x8237 to 0xf6f5d ******WWWW 2023-07-14T18:17:18.337 INFO:tasks.workunit.client.0.smithi163.stdout:4667( 59 mod 256): COPY 0xf6a85 thru 0xf6f5c (0x4d8 bytes) to 0x25705 thru 0x25bdc 2023-07-14T18:17:18.337 INFO:tasks.workunit.client.0.smithi163.stdout:4668( 60 mod 256): PUNCH 0xb0e40 thru 0xb37fa (0x29bb bytes) 2023-07-14T18:17:18.337 INFO:tasks.workunit.client.0.smithi163.stdout:4669( 61 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.337 INFO:tasks.workunit.client.0.smithi163.stdout:4670( 62 mod 256): FALLOC 0x7754b thru 0x831b5 (0xbc6a bytes) INTERIOR 2023-07-14T18:17:18.337 INFO:tasks.workunit.client.0.smithi163.stdout:4671( 63 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.337 INFO:tasks.workunit.client.0.smithi163.stdout:4672( 64 mod 256): PUNCH 0x5c175 thru 0x5d1dd (0x1069 bytes) 2023-07-14T18:17:18.337 INFO:tasks.workunit.client.0.smithi163.stdout:4673( 65 mod 256): WRITE 0xe7139 thru 0xf25e4 (0xb4ac bytes) 2023-07-14T18:17:18.338 INFO:tasks.workunit.client.0.smithi163.stdout:4674( 66 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.338 INFO:tasks.workunit.client.0.smithi163.stdout:4675( 67 mod 256): MAPWRITE 0x67c18 thru 0x6a6e3 (0x2acc bytes) 2023-07-14T18:17:18.338 INFO:tasks.workunit.client.0.smithi163.stdout:4676( 68 mod 256): MAPWRITE 0x74059 thru 0x7d7a7 (0x974f bytes) 2023-07-14T18:17:18.338 INFO:tasks.workunit.client.0.smithi163.stdout:4677( 69 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.338 INFO:tasks.workunit.client.0.smithi163.stdout:4678( 70 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.338 INFO:tasks.workunit.client.0.smithi163.stdout:4679( 71 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.338 INFO:tasks.workunit.client.0.smithi163.stdout:4680( 72 mod 256): MAPREAD 0xce3bd thru 0xd4acf (0x6713 bytes) 2023-07-14T18:17:18.338 INFO:tasks.workunit.client.0.smithi163.stdout:4681( 73 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.339 INFO:tasks.workunit.client.0.smithi163.stdout:4682( 74 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.339 INFO:tasks.workunit.client.0.smithi163.stdout:4683( 75 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.339 INFO:tasks.workunit.client.0.smithi163.stdout:4684( 76 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.339 INFO:tasks.workunit.client.0.smithi163.stdout:4685( 77 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.339 INFO:tasks.workunit.client.0.smithi163.stdout:4686( 78 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.339 INFO:tasks.workunit.client.0.smithi163.stdout:4687( 79 mod 256): MAPREAD 0x6b936 thru 0x7773e (0xbe09 bytes) 2023-07-14T18:17:18.339 INFO:tasks.workunit.client.0.smithi163.stdout:4688( 80 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.339 INFO:tasks.workunit.client.0.smithi163.stdout:4689( 81 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.340 INFO:tasks.workunit.client.0.smithi163.stdout:4690( 82 mod 256): COPY 0xe2520 thru 0xf1450 (0xef31 bytes) to 0x58880 thru 0x677b0 2023-07-14T18:17:18.340 INFO:tasks.workunit.client.0.smithi163.stdout:4691( 83 mod 256): FALLOC 0xd7a5a thru 0xe3e24 (0xc3ca bytes) INTERIOR 2023-07-14T18:17:18.340 INFO:tasks.workunit.client.0.smithi163.stdout:4692( 84 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.340 INFO:tasks.workunit.client.0.smithi163.stdout:4693( 85 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.340 INFO:tasks.workunit.client.0.smithi163.stdout:4694( 86 mod 256): PUNCH 0x8f293 thru 0x924b6 (0x3224 bytes) 2023-07-14T18:17:18.340 INFO:tasks.workunit.client.0.smithi163.stdout:4695( 87 mod 256): MAPREAD 0x5f28d thru 0x66910 (0x7684 bytes) 2023-07-14T18:17:18.340 INFO:tasks.workunit.client.0.smithi163.stdout:4696( 88 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.340 INFO:tasks.workunit.client.0.smithi163.stdout:4697( 89 mod 256): MAPREAD 0x926a3 thru 0x96d1c (0x467a bytes) 2023-07-14T18:17:18.341 INFO:tasks.workunit.client.0.smithi163.stdout:4698( 90 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.341 INFO:tasks.workunit.client.0.smithi163.stdout:4699( 91 mod 256): MAPWRITE 0xe4e19 thru 0xf48c0 (0xfaa8 bytes) 2023-07-14T18:17:18.341 INFO:tasks.workunit.client.0.smithi163.stdout:4700( 92 mod 256): READ 0x64883 thru 0x71f02 (0xd680 bytes) 2023-07-14T18:17:18.341 INFO:tasks.workunit.client.0.smithi163.stdout:4701( 93 mod 256): MAPWRITE 0xe2f27 thru 0xe4036 (0x1110 bytes) 2023-07-14T18:17:18.341 INFO:tasks.workunit.client.0.smithi163.stdout:4702( 94 mod 256): MAPREAD 0x1172d thru 0x1f64e (0xdf22 bytes) 2023-07-14T18:17:18.341 INFO:tasks.workunit.client.0.smithi163.stdout:4703( 95 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.341 INFO:tasks.workunit.client.0.smithi163.stdout:4704( 96 mod 256): TRUNCATE DOWN from 0xf6f5d to 0x9e318 2023-07-14T18:17:18.341 INFO:tasks.workunit.client.0.smithi163.stdout:4705( 97 mod 256): MAPREAD 0x19550 thru 0x1ff9c (0x6a4d bytes) 2023-07-14T18:17:18.342 INFO:tasks.workunit.client.0.smithi163.stdout:4706( 98 mod 256): TRUNCATE DOWN from 0x9e318 to 0x6b8df 2023-07-14T18:17:18.342 INFO:tasks.workunit.client.0.smithi163.stdout:4707( 99 mod 256): COPY 0x199ad thru 0x26988 (0xcfdc bytes) to 0x400a7 thru 0x4d082 2023-07-14T18:17:18.342 INFO:tasks.workunit.client.0.smithi163.stdout:4708(100 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.342 INFO:tasks.workunit.client.0.smithi163.stdout:4709(101 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.342 INFO:tasks.workunit.client.0.smithi163.stdout:4710(102 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.342 INFO:tasks.workunit.client.0.smithi163.stdout:4711(103 mod 256): FALLOC 0x88c3 thru 0xf9ca (0x7107 bytes) INTERIOR 2023-07-14T18:17:18.342 INFO:tasks.workunit.client.0.smithi163.stdout:4712(104 mod 256): COPY 0x62fa7 thru 0x6b8de (0x8938 bytes) to 0x26c98 thru 0x2f5cf 2023-07-14T18:17:18.342 INFO:tasks.workunit.client.0.smithi163.stdout:4713(105 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.343 INFO:tasks.workunit.client.0.smithi163.stdout:4714(106 mod 256): MAPWRITE 0x20788 thru 0x2998c (0x9205 bytes) 2023-07-14T18:17:18.343 INFO:tasks.workunit.client.0.smithi163.stdout:4715(107 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.343 INFO:tasks.workunit.client.0.smithi163.stdout:4716(108 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.343 INFO:tasks.workunit.client.0.smithi163.stdout:4717(109 mod 256): MAPREAD 0x3d800 thru 0x44cb9 (0x74ba bytes) 2023-07-14T18:17:18.343 INFO:tasks.workunit.client.0.smithi163.stdout:4718(110 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.343 INFO:tasks.workunit.client.0.smithi163.stdout:4719(111 mod 256): READ 0x3e83c thru 0x42d0b (0x44d0 bytes) 2023-07-14T18:17:18.343 INFO:tasks.workunit.client.0.smithi163.stdout:4720(112 mod 256): READ 0x4f9e7 thru 0x5cea8 (0xd4c2 bytes) 2023-07-14T18:17:18.344 INFO:tasks.workunit.client.0.smithi163.stdout:4721(113 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.344 INFO:tasks.workunit.client.0.smithi163.stdout:4722(114 mod 256): MAPREAD 0x12e1a thru 0x2245b (0xf642 bytes) 2023-07-14T18:17:18.344 INFO:tasks.workunit.client.0.smithi163.stdout:4723(115 mod 256): MAPREAD 0x22293 thru 0x29c28 (0x7996 bytes) 2023-07-14T18:17:18.344 INFO:tasks.workunit.client.0.smithi163.stdout:4724(116 mod 256): PUNCH 0x3f036 thru 0x413f0 (0x23bb bytes) 2023-07-14T18:17:18.344 INFO:tasks.workunit.client.0.smithi163.stdout:4725(117 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.344 INFO:tasks.workunit.client.0.smithi163.stdout:4726(118 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.344 INFO:tasks.workunit.client.0.smithi163.stdout:4727(119 mod 256): READ 0x470fc thru 0x4756e (0x473 bytes) 2023-07-14T18:17:18.344 INFO:tasks.workunit.client.0.smithi163.stdout:4728(120 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.345 INFO:tasks.workunit.client.0.smithi163.stdout:4729(121 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.345 INFO:tasks.workunit.client.0.smithi163.stdout:4730(122 mod 256): COPY 0x38906 thru 0x42a18 (0xa113 bytes) to 0x439c7 thru 0x4dad9 2023-07-14T18:17:18.345 INFO:tasks.workunit.client.0.smithi163.stdout:4731(123 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.345 INFO:tasks.workunit.client.0.smithi163.stdout:4732(124 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.345 INFO:tasks.workunit.client.0.smithi163.stdout:4733(125 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.345 INFO:tasks.workunit.client.0.smithi163.stdout:4734(126 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.345 INFO:tasks.workunit.client.0.smithi163.stdout:4735(127 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.345 INFO:tasks.workunit.client.0.smithi163.stdout:4736(128 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.346 INFO:tasks.workunit.client.0.smithi163.stdout:4737(129 mod 256): TRUNCATE DOWN from 0x6b8df to 0x27728 ******WWWW 2023-07-14T18:17:18.346 INFO:tasks.workunit.client.0.smithi163.stdout:4738(130 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.346 INFO:tasks.workunit.client.0.smithi163.stdout:4739(131 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.346 INFO:tasks.workunit.client.0.smithi163.stdout:4740(132 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.346 INFO:tasks.workunit.client.0.smithi163.stdout:4741(133 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.346 INFO:tasks.workunit.client.0.smithi163.stdout:4742(134 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.346 INFO:tasks.workunit.client.0.smithi163.stdout:4743(135 mod 256): WRITE 0xf7441 thru 0xfffff (0x8bbf bytes) HOLE ***WWWW 2023-07-14T18:17:18.346 INFO:tasks.workunit.client.0.smithi163.stdout:4744(136 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.347 INFO:tasks.workunit.client.0.smithi163.stdout:4745(137 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.347 INFO:tasks.workunit.client.0.smithi163.stdout:4746(138 mod 256): READ 0xc1830 thru 0xcb62a (0x9dfb bytes) 2023-07-14T18:17:18.347 INFO:tasks.workunit.client.0.smithi163.stdout:4747(139 mod 256): READ 0x635c8 thru 0x63a4f (0x488 bytes) 2023-07-14T18:17:18.347 INFO:tasks.workunit.client.0.smithi163.stdout:4748(140 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.347 INFO:tasks.workunit.client.0.smithi163.stdout:4749(141 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.347 INFO:tasks.workunit.client.0.smithi163.stdout:4750(142 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.347 INFO:tasks.workunit.client.0.smithi163.stdout:4751(143 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.347 INFO:tasks.workunit.client.0.smithi163.stdout:4752(144 mod 256): MAPWRITE 0xf0ffb thru 0xf2e48 (0x1e4e bytes) 2023-07-14T18:17:18.348 INFO:tasks.workunit.client.0.smithi163.stdout:4753(145 mod 256): WRITE 0x6b7c8 thru 0x761a5 (0xa9de bytes) 2023-07-14T18:17:18.348 INFO:tasks.workunit.client.0.smithi163.stdout:4754(146 mod 256): MAPREAD 0x43fc3 thru 0x46b02 (0x2b40 bytes) 2023-07-14T18:17:18.348 INFO:tasks.workunit.client.0.smithi163.stdout:4755(147 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.348 INFO:tasks.workunit.client.0.smithi163.stdout:4756(148 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.348 INFO:tasks.workunit.client.0.smithi163.stdout:4757(149 mod 256): READ 0xf274f thru 0xffdbc (0xd66e bytes) 2023-07-14T18:17:18.348 INFO:tasks.workunit.client.0.smithi163.stdout:4758(150 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.348 INFO:tasks.workunit.client.0.smithi163.stdout:4759(151 mod 256): MAPWRITE 0x3073d thru 0x33b04 (0x33c8 bytes) 2023-07-14T18:17:18.348 INFO:tasks.workunit.client.0.smithi163.stdout:4760(152 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.349 INFO:tasks.workunit.client.0.smithi163.stdout:4761(153 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.349 INFO:tasks.workunit.client.0.smithi163.stdout:4762(154 mod 256): COPY 0xf837 thru 0x198e5 (0xa0af bytes) to 0x892ac thru 0x9335a 2023-07-14T18:17:18.349 INFO:tasks.workunit.client.0.smithi163.stdout:4763(155 mod 256): WRITE 0x956ef thru 0x9721b (0x1b2d bytes) 2023-07-14T18:17:18.349 INFO:tasks.workunit.client.0.smithi163.stdout:4764(156 mod 256): READ 0x18b95 thru 0x27f1f (0xf38b bytes) 2023-07-14T18:17:18.349 INFO:tasks.workunit.client.0.smithi163.stdout:4765(157 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.349 INFO:tasks.workunit.client.0.smithi163.stdout:4766(158 mod 256): MAPREAD 0x4e9c5 thru 0x5157b (0x2bb7 bytes) 2023-07-14T18:17:18.349 INFO:tasks.workunit.client.0.smithi163.stdout:4767(159 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.349 INFO:tasks.workunit.client.0.smithi163.stdout:4768(160 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.349 INFO:tasks.workunit.client.0.smithi163.stdout:4769(161 mod 256): FALLOC 0x24c60 thru 0x2e3ad (0x974d bytes) INTERIOR 2023-07-14T18:17:18.350 INFO:tasks.workunit.client.0.smithi163.stdout:4770(162 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.350 INFO:tasks.workunit.client.0.smithi163.stdout:4771(163 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.350 INFO:tasks.workunit.client.0.smithi163.stdout:4772(164 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.350 INFO:tasks.workunit.client.0.smithi163.stdout:4773(165 mod 256): MAPWRITE 0x9cc3f thru 0xa7a40 (0xae02 bytes) 2023-07-14T18:17:18.350 INFO:tasks.workunit.client.0.smithi163.stdout:4774(166 mod 256): MAPREAD 0x33193 thru 0x3561c (0x248a bytes) 2023-07-14T18:17:18.350 INFO:tasks.workunit.client.0.smithi163.stdout:4775(167 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.350 INFO:tasks.workunit.client.0.smithi163.stdout:4776(168 mod 256): MAPWRITE 0x3098f thru 0x30ddb (0x44d bytes) 2023-07-14T18:17:18.350 INFO:tasks.workunit.client.0.smithi163.stdout:4777(169 mod 256): WRITE 0xab37d thru 0xb246b (0x70ef bytes) 2023-07-14T18:17:18.351 INFO:tasks.workunit.client.0.smithi163.stdout:4778(170 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.351 INFO:tasks.workunit.client.0.smithi163.stdout:4779(171 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.351 INFO:tasks.workunit.client.0.smithi163.stdout:4780(172 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.351 INFO:tasks.workunit.client.0.smithi163.stdout:4781(173 mod 256): MAPREAD 0x987e9 thru 0x9e08d (0x58a5 bytes) 2023-07-14T18:17:18.351 INFO:tasks.workunit.client.0.smithi163.stdout:4782(174 mod 256): FALLOC 0x31f97 thru 0x396aa (0x7713 bytes) INTERIOR ******FFFF 2023-07-14T18:17:18.351 INFO:tasks.workunit.client.0.smithi163.stdout:4783(175 mod 256): PUNCH 0xe153b thru 0xec439 (0xaeff bytes) 2023-07-14T18:17:18.351 INFO:tasks.workunit.client.0.smithi163.stdout:4784(176 mod 256): MAPWRITE 0xaa98d thru 0xb9e2c (0xf4a0 bytes) 2023-07-14T18:17:18.351 INFO:tasks.workunit.client.0.smithi163.stdout:4785(177 mod 256): TRUNCATE DOWN from 0x100000 to 0x8f2a8 2023-07-14T18:17:18.352 INFO:tasks.workunit.client.0.smithi163.stdout:4786(178 mod 256): TRUNCATE UP from 0x8f2a8 to 0xa4bf8 2023-07-14T18:17:18.352 INFO:tasks.workunit.client.0.smithi163.stdout:4787(179 mod 256): PUNCH 0x8baf4 thru 0x8f3b8 (0x38c5 bytes) 2023-07-14T18:17:18.352 INFO:tasks.workunit.client.0.smithi163.stdout:4788(180 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.352 INFO:tasks.workunit.client.0.smithi163.stdout:4789(181 mod 256): TRUNCATE DOWN from 0xa4bf8 to 0x49202 2023-07-14T18:17:18.352 INFO:tasks.workunit.client.0.smithi163.stdout:4790(182 mod 256): PUNCH 0x3f79e thru 0x49201 (0x9a64 bytes) 2023-07-14T18:17:18.352 INFO:tasks.workunit.client.0.smithi163.stdout:4791(183 mod 256): WRITE 0xf41ed thru 0xfb09f (0x6eb3 bytes) HOLE 2023-07-14T18:17:18.352 INFO:tasks.workunit.client.0.smithi163.stdout:4792(184 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.352 INFO:tasks.workunit.client.0.smithi163.stdout:4793(185 mod 256): READ 0xc8902 thru 0xc9e48 (0x1547 bytes) 2023-07-14T18:17:18.353 INFO:tasks.workunit.client.0.smithi163.stdout:4794(186 mod 256): MAPREAD 0x8a0b0 thru 0x8fba3 (0x5af4 bytes) 2023-07-14T18:17:18.353 INFO:tasks.workunit.client.0.smithi163.stdout:4795(187 mod 256): MAPREAD 0xc86ef thru 0xd6020 (0xd932 bytes) 2023-07-14T18:17:18.353 INFO:tasks.workunit.client.0.smithi163.stdout:4796(188 mod 256): COPY 0x88ee0 thru 0x8cf2a (0x404b bytes) to 0xda407 thru 0xde451 2023-07-14T18:17:18.353 INFO:tasks.workunit.client.0.smithi163.stdout:4797(189 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.353 INFO:tasks.workunit.client.0.smithi163.stdout:4798(190 mod 256): PUNCH 0x6e3af thru 0x711ae (0x2e00 bytes) 2023-07-14T18:17:18.353 INFO:tasks.workunit.client.0.smithi163.stdout:4799(191 mod 256): COPY 0x53805 thru 0x580fd (0x48f9 bytes) to 0xcea72 thru 0xd336a 2023-07-14T18:17:18.353 INFO:tasks.workunit.client.0.smithi163.stdout:4800(192 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.353 INFO:tasks.workunit.client.0.smithi163.stdout:4801(193 mod 256): TRUNCATE DOWN from 0xfb0a0 to 0xd5c78 2023-07-14T18:17:18.354 INFO:tasks.workunit.client.0.smithi163.stdout:4802(194 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.354 INFO:tasks.workunit.client.0.smithi163.stdout:4803(195 mod 256): MAPREAD 0x2ea28 thru 0x3c667 (0xdc40 bytes) ***RRRR*** 2023-07-14T18:17:18.354 INFO:tasks.workunit.client.0.smithi163.stdout:4804(196 mod 256): WRITE 0x7578b thru 0x77199 (0x1a0f bytes) 2023-07-14T18:17:18.354 INFO:tasks.workunit.client.0.smithi163.stdout:4805(197 mod 256): WRITE 0x28823 thru 0x3783a (0xf018 bytes) 2023-07-14T18:17:18.354 INFO:tasks.workunit.client.0.smithi163.stdout:4806(198 mod 256): MAPWRITE 0xeb588 thru 0xf4bdb (0x9654 bytes) 2023-07-14T18:17:18.354 INFO:tasks.workunit.client.0.smithi163.stdout:4807(199 mod 256): WRITE 0xa89ae thru 0xac37e (0x39d1 bytes) 2023-07-14T18:17:18.354 INFO:tasks.workunit.client.0.smithi163.stdout:4808(200 mod 256): MAPWRITE 0xa8355 thru 0xad19a (0x4e46 bytes) 2023-07-14T18:17:18.354 INFO:tasks.workunit.client.0.smithi163.stdout:4809(201 mod 256): WRITE 0x9b0e8 thru 0xa402c (0x8f45 bytes) 2023-07-14T18:17:18.355 INFO:tasks.workunit.client.0.smithi163.stdout:4810(202 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.355 INFO:tasks.workunit.client.0.smithi163.stdout:4811(203 mod 256): MAPREAD 0x786ae thru 0x7ad30 (0x2683 bytes) 2023-07-14T18:17:18.355 INFO:tasks.workunit.client.0.smithi163.stdout:4812(204 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.355 INFO:tasks.workunit.client.0.smithi163.stdout:4813(205 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.355 INFO:tasks.workunit.client.0.smithi163.stdout:4814(206 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.355 INFO:tasks.workunit.client.0.smithi163.stdout:4815(207 mod 256): PUNCH 0x93ee7 thru 0xa2f70 (0xf08a bytes) 2023-07-14T18:17:18.355 INFO:tasks.workunit.client.0.smithi163.stdout:4816(208 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.355 INFO:tasks.workunit.client.0.smithi163.stdout:4817(209 mod 256): PUNCH 0x9c97e thru 0xa110b (0x478e bytes) 2023-07-14T18:17:18.356 INFO:tasks.workunit.client.0.smithi163.stdout:4818(210 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.356 INFO:tasks.workunit.client.0.smithi163.stdout:4819(211 mod 256): MAPREAD 0x899b8 thru 0x8c8a8 (0x2ef1 bytes) 2023-07-14T18:17:18.356 INFO:tasks.workunit.client.0.smithi163.stdout:4820(212 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.356 INFO:tasks.workunit.client.0.smithi163.stdout:4821(213 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.356 INFO:tasks.workunit.client.0.smithi163.stdout:4822(214 mod 256): WRITE 0x956af thru 0x9a2a5 (0x4bf7 bytes) 2023-07-14T18:17:18.356 INFO:tasks.workunit.client.0.smithi163.stdout:4823(215 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.356 INFO:tasks.workunit.client.0.smithi163.stdout:4824(216 mod 256): MAPREAD 0x3cc1e thru 0x3ff77 (0x335a bytes) 2023-07-14T18:17:18.356 INFO:tasks.workunit.client.0.smithi163.stdout:4825(217 mod 256): COPY 0xbd971 thru 0xc2ad4 (0x5164 bytes) to 0x6134d thru 0x664b0 2023-07-14T18:17:18.357 INFO:tasks.workunit.client.0.smithi163.stdout:4826(218 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.357 INFO:tasks.workunit.client.0.smithi163.stdout:4827(219 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.357 INFO:tasks.workunit.client.0.smithi163.stdout:4828(220 mod 256): COPY 0x6a0fa thru 0x717f1 (0x76f8 bytes) to 0xe0b7f thru 0xe8276 2023-07-14T18:17:18.357 INFO:tasks.workunit.client.0.smithi163.stdout:4829(221 mod 256): PUNCH 0xec6a5 thru 0xf4a3d (0x8399 bytes) 2023-07-14T18:17:18.357 INFO:tasks.workunit.client.0.smithi163.stdout:4830(222 mod 256): TRUNCATE DOWN from 0xf4bdc to 0x7a745 2023-07-14T18:17:18.357 INFO:tasks.workunit.client.0.smithi163.stdout:4831(223 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.357 INFO:tasks.workunit.client.0.smithi163.stdout:4832(224 mod 256): TRUNCATE UP from 0x7a745 to 0x9fff3 2023-07-14T18:17:18.357 INFO:tasks.workunit.client.0.smithi163.stdout:4833(225 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.358 INFO:tasks.workunit.client.0.smithi163.stdout:4834(226 mod 256): FALLOC 0xba29f thru 0xc3bfb (0x995c bytes) EXTENDING 2023-07-14T18:17:18.358 INFO:tasks.workunit.client.0.smithi163.stdout:4835(227 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.358 INFO:tasks.workunit.client.0.smithi163.stdout:4836(228 mod 256): COPY 0x60c41 thru 0x6a393 (0x9753 bytes) to 0xd14a3 thru 0xdabf5 2023-07-14T18:17:18.358 INFO:tasks.workunit.client.0.smithi163.stdout:4837(229 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.358 INFO:tasks.workunit.client.0.smithi163.stdout:4838(230 mod 256): TRUNCATE DOWN from 0xdabf6 to 0xa4d2b 2023-07-14T18:17:18.358 INFO:tasks.workunit.client.0.smithi163.stdout:4839(231 mod 256): MAPREAD 0x79c6b thru 0x7c3f2 (0x2788 bytes) 2023-07-14T18:17:18.358 INFO:tasks.workunit.client.0.smithi163.stdout:4840(232 mod 256): MAPREAD 0x18898 thru 0x2032e (0x7a97 bytes) 2023-07-14T18:17:18.358 INFO:tasks.workunit.client.0.smithi163.stdout:4841(233 mod 256): MAPREAD 0x8b134 thru 0x8bbfa (0xac7 bytes) 2023-07-14T18:17:18.359 INFO:tasks.workunit.client.0.smithi163.stdout:4842(234 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.359 INFO:tasks.workunit.client.0.smithi163.stdout:4843(235 mod 256): WRITE 0x904b1 thru 0x97bb6 (0x7706 bytes) 2023-07-14T18:17:18.359 INFO:tasks.workunit.client.0.smithi163.stdout:4844(236 mod 256): READ 0x7a8d9 thru 0x8742f (0xcb57 bytes) 2023-07-14T18:17:18.359 INFO:tasks.workunit.client.0.smithi163.stdout:4845(237 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.359 INFO:tasks.workunit.client.0.smithi163.stdout:4846(238 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.359 INFO:tasks.workunit.client.0.smithi163.stdout:4847(239 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.359 INFO:tasks.workunit.client.0.smithi163.stdout:4848(240 mod 256): READ 0x8b1fd thru 0x8ccf6 (0x1afa bytes) 2023-07-14T18:17:18.359 INFO:tasks.workunit.client.0.smithi163.stdout:4849(241 mod 256): TRUNCATE UP from 0xa4d2b to 0xf7f93 2023-07-14T18:17:18.360 INFO:tasks.workunit.client.0.smithi163.stdout:4850(242 mod 256): WRITE 0xcb05b thru 0xcd753 (0x26f9 bytes) 2023-07-14T18:17:18.360 INFO:tasks.workunit.client.0.smithi163.stdout:4851(243 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.360 INFO:tasks.workunit.client.0.smithi163.stdout:4852(244 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.360 INFO:tasks.workunit.client.0.smithi163.stdout:4853(245 mod 256): WRITE 0x6b1e9 thru 0x78890 (0xd6a8 bytes) 2023-07-14T18:17:18.360 INFO:tasks.workunit.client.0.smithi163.stdout:4854(246 mod 256): MAPWRITE 0x3d201 thru 0x4966d (0xc46d bytes) 2023-07-14T18:17:18.360 INFO:tasks.workunit.client.0.smithi163.stdout:4855(247 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.360 INFO:tasks.workunit.client.0.smithi163.stdout:4856(248 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.360 INFO:tasks.workunit.client.0.smithi163.stdout:4857(249 mod 256): MAPREAD 0x645b5 thru 0x6ad4b (0x6797 bytes) 2023-07-14T18:17:18.361 INFO:tasks.workunit.client.0.smithi163.stdout:4858(250 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.361 INFO:tasks.workunit.client.0.smithi163.stdout:4859(251 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.361 INFO:tasks.workunit.client.0.smithi163.stdout:4860(252 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.361 INFO:tasks.workunit.client.0.smithi163.stdout:4861(253 mod 256): FALLOC 0x40787 thru 0x43284 (0x2afd bytes) INTERIOR 2023-07-14T18:17:18.361 INFO:tasks.workunit.client.0.smithi163.stdout:4862(254 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.361 INFO:tasks.workunit.client.0.smithi163.stdout:4863(255 mod 256): PUNCH 0x984d4 thru 0xa5269 (0xcd96 bytes) 2023-07-14T18:17:18.361 INFO:tasks.workunit.client.0.smithi163.stdout:4864( 0 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.362 INFO:tasks.workunit.client.0.smithi163.stdout:4865( 1 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.362 INFO:tasks.workunit.client.0.smithi163.stdout:4866( 2 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.362 INFO:tasks.workunit.client.0.smithi163.stdout:4867( 3 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.362 INFO:tasks.workunit.client.0.smithi163.stdout:4868( 4 mod 256): TRUNCATE DOWN from 0xf7f93 to 0xe5bcd 2023-07-14T18:17:18.362 INFO:tasks.workunit.client.0.smithi163.stdout:4869( 5 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.362 INFO:tasks.workunit.client.0.smithi163.stdout:4870( 6 mod 256): READ 0xbc0bb thru 0xc3c83 (0x7bc9 bytes) 2023-07-14T18:17:18.362 INFO:tasks.workunit.client.0.smithi163.stdout:4871( 7 mod 256): MAPREAD 0x330eb thru 0x3c378 (0x928e bytes) ***RRRR*** 2023-07-14T18:17:18.362 INFO:tasks.workunit.client.0.smithi163.stdout:4872( 8 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.363 INFO:tasks.workunit.client.0.smithi163.stdout:4873( 9 mod 256): MAPWRITE 0xf4208 thru 0xfd77b (0x9574 bytes) 2023-07-14T18:17:18.363 INFO:tasks.workunit.client.0.smithi163.stdout:4874( 10 mod 256): MAPREAD 0x364e7 thru 0x42569 (0xc083 bytes) ***RRRR*** 2023-07-14T18:17:18.363 INFO:tasks.workunit.client.0.smithi163.stdout:4875( 11 mod 256): FALLOC 0x2c5c0 thru 0x2e217 (0x1c57 bytes) INTERIOR 2023-07-14T18:17:18.363 INFO:tasks.workunit.client.0.smithi163.stdout:4876( 12 mod 256): READ 0x38a00 thru 0x3b007 (0x2608 bytes) 2023-07-14T18:17:18.363 INFO:tasks.workunit.client.0.smithi163.stdout:4877( 13 mod 256): COPY 0xb6e9 thru 0x15e4f (0xa767 bytes) to 0xb61cb thru 0xc0931 2023-07-14T18:17:18.363 INFO:tasks.workunit.client.0.smithi163.stdout:4878( 14 mod 256): READ 0xe0131 thru 0xecd6e (0xcc3e bytes) 2023-07-14T18:17:18.363 INFO:tasks.workunit.client.0.smithi163.stdout:4879( 15 mod 256): TRUNCATE DOWN from 0xfd77c to 0x29135 ******WWWW 2023-07-14T18:17:18.363 INFO:tasks.workunit.client.0.smithi163.stdout:4880( 16 mod 256): WRITE 0xd67d0 thru 0xdd846 (0x7077 bytes) HOLE ***WWWW 2023-07-14T18:17:18.364 INFO:tasks.workunit.client.0.smithi163.stdout:4881( 17 mod 256): PUNCH 0x13259 thru 0x1c5d6 (0x937e bytes) 2023-07-14T18:17:18.364 INFO:tasks.workunit.client.0.smithi163.stdout:4882( 18 mod 256): PUNCH 0x5ab59 thru 0x5c6e5 (0x1b8d bytes) 2023-07-14T18:17:18.364 INFO:tasks.workunit.client.0.smithi163.stdout:4883( 19 mod 256): PUNCH 0xd180d thru 0xdbcdd (0xa4d1 bytes) 2023-07-14T18:17:18.364 INFO:tasks.workunit.client.0.smithi163.stdout:4884( 20 mod 256): READ 0x5a7c3 thru 0x6907f (0xe8bd bytes) 2023-07-14T18:17:18.364 INFO:tasks.workunit.client.0.smithi163.stdout:4885( 21 mod 256): MAPWRITE 0x66ecc thru 0x678f1 (0xa26 bytes) 2023-07-14T18:17:18.364 INFO:tasks.workunit.client.0.smithi163.stdout:4886( 22 mod 256): WRITE 0x2eea9 thru 0x3783b (0x8993 bytes) 2023-07-14T18:17:18.364 INFO:tasks.workunit.client.0.smithi163.stdout:4887( 23 mod 256): FALLOC 0x111af thru 0x20c57 (0xfaa8 bytes) INTERIOR 2023-07-14T18:17:18.364 INFO:tasks.workunit.client.0.smithi163.stdout:4888( 24 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.365 INFO:tasks.workunit.client.0.smithi163.stdout:4889( 25 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.365 INFO:tasks.workunit.client.0.smithi163.stdout:4890( 26 mod 256): PUNCH 0x32edb thru 0x365e9 (0x370f bytes) 2023-07-14T18:17:18.365 INFO:tasks.workunit.client.0.smithi163.stdout:4891( 27 mod 256): MAPREAD 0xc9c4c thru 0xd8f31 (0xf2e6 bytes) 2023-07-14T18:17:18.365 INFO:tasks.workunit.client.0.smithi163.stdout:4892( 28 mod 256): COPY 0xf681 thru 0x1cae4 (0xd464 bytes) to 0x302d1 thru 0x3d734 ******EEEE 2023-07-14T18:17:18.365 INFO:tasks.workunit.client.0.smithi163.stdout:4893( 29 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.365 INFO:tasks.workunit.client.0.smithi163.stdout:4894( 30 mod 256): TRUNCATE DOWN from 0xdd847 to 0x45d11 2023-07-14T18:17:18.365 INFO:tasks.workunit.client.0.smithi163.stdout:4895( 31 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.365 INFO:tasks.workunit.client.0.smithi163.stdout:4896( 32 mod 256): MAPREAD 0x3be8f thru 0x45d10 (0x9e82 bytes) 2023-07-14T18:17:18.366 INFO:tasks.workunit.client.0.smithi163.stdout:4897( 33 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.366 INFO:tasks.workunit.client.0.smithi163.stdout:4898( 34 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.366 INFO:tasks.workunit.client.0.smithi163.stdout:4899( 35 mod 256): MAPWRITE 0x612c4 thru 0x70cdb (0xfa18 bytes) 2023-07-14T18:17:18.366 INFO:tasks.workunit.client.0.smithi163.stdout:4900( 36 mod 256): READ 0x28fc4 thru 0x2f7de (0x681b bytes) 2023-07-14T18:17:18.366 INFO:tasks.workunit.client.0.smithi163.stdout:4901( 37 mod 256): COPY 0x6b339 thru 0x70cdb (0x59a3 bytes) to 0x1ba81 thru 0x21423 2023-07-14T18:17:18.366 INFO:tasks.workunit.client.0.smithi163.stdout:4902( 38 mod 256): READ 0x6c37f thru 0x70cdb (0x495d bytes) 2023-07-14T18:17:18.366 INFO:tasks.workunit.client.0.smithi163.stdout:4903( 39 mod 256): MAPWRITE 0xa946c thru 0xabaad (0x2642 bytes) 2023-07-14T18:17:18.366 INFO:tasks.workunit.client.0.smithi163.stdout:4904( 40 mod 256): MAPWRITE 0x4ef21 thru 0x528d6 (0x39b6 bytes) 2023-07-14T18:17:18.367 INFO:tasks.workunit.client.0.smithi163.stdout:4905( 41 mod 256): WRITE 0x2b77 thru 0x4eef (0x2379 bytes) 2023-07-14T18:17:18.367 INFO:tasks.workunit.client.0.smithi163.stdout:4906( 42 mod 256): PUNCH 0x4cd56 thru 0x5c0ed (0xf398 bytes) 2023-07-14T18:17:18.367 INFO:tasks.workunit.client.0.smithi163.stdout:4907( 43 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.367 INFO:tasks.workunit.client.0.smithi163.stdout:4908( 44 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.367 INFO:tasks.workunit.client.0.smithi163.stdout:4909( 45 mod 256): FALLOC 0x1c1c0 thru 0x26713 (0xa553 bytes) INTERIOR 2023-07-14T18:17:18.367 INFO:tasks.workunit.client.0.smithi163.stdout:4910( 46 mod 256): MAPWRITE 0x433d8 thru 0x4efb3 (0xbbdc bytes) 2023-07-14T18:17:18.367 INFO:tasks.workunit.client.0.smithi163.stdout:4911( 47 mod 256): TRUNCATE DOWN from 0xabaae to 0x7c378 2023-07-14T18:17:18.367 INFO:tasks.workunit.client.0.smithi163.stdout:4912( 48 mod 256): MAPWRITE 0xeb549 thru 0xf0970 (0x5428 bytes) 2023-07-14T18:17:18.368 INFO:tasks.workunit.client.0.smithi163.stdout:4913( 49 mod 256): MAPREAD 0x1c557 thru 0x2a1a9 (0xdc53 bytes) 2023-07-14T18:17:18.368 INFO:tasks.workunit.client.0.smithi163.stdout:4914( 50 mod 256): MAPWRITE 0x2f902 thru 0x3da24 (0xe123 bytes) ******WWWW 2023-07-14T18:17:18.368 INFO:tasks.workunit.client.0.smithi163.stdout:4915( 51 mod 256): MAPREAD 0xa05b4 thru 0xae338 (0xdd85 bytes) 2023-07-14T18:17:18.368 INFO:tasks.workunit.client.0.smithi163.stdout:4916( 52 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.368 INFO:tasks.workunit.client.0.smithi163.stdout:4917( 53 mod 256): PUNCH 0xbb31b thru 0xc3d6c (0x8a52 bytes) 2023-07-14T18:17:18.368 INFO:tasks.workunit.client.0.smithi163.stdout:4918( 54 mod 256): COPY 0x1d7c9 thru 0x2cfd5 (0xf80d bytes) to 0xaefc5 thru 0xbe7d1 2023-07-14T18:17:18.368 INFO:tasks.workunit.client.0.smithi163.stdout:4919( 55 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.368 INFO:tasks.workunit.client.0.smithi163.stdout:4920( 56 mod 256): MAPREAD 0xeffb1 thru 0xf0726 (0x776 bytes) 2023-07-14T18:17:18.369 INFO:tasks.workunit.client.0.smithi163.stdout:4921( 57 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.369 INFO:tasks.workunit.client.0.smithi163.stdout:4922( 58 mod 256): MAPWRITE 0xaa7e9 thru 0xb2476 (0x7c8e bytes) 2023-07-14T18:17:18.369 INFO:tasks.workunit.client.0.smithi163.stdout:4923( 59 mod 256): WRITE 0x30f43 thru 0x3d576 (0xc634 bytes) ***WWWW 2023-07-14T18:17:18.369 INFO:tasks.workunit.client.0.smithi163.stdout:4924( 60 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.369 INFO:tasks.workunit.client.0.smithi163.stdout:4925( 61 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.369 INFO:tasks.workunit.client.0.smithi163.stdout:4926( 62 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.369 INFO:tasks.workunit.client.0.smithi163.stdout:4927( 63 mod 256): READ 0x71a3d thru 0x74a1f (0x2fe3 bytes) 2023-07-14T18:17:18.369 INFO:tasks.workunit.client.0.smithi163.stdout:4928( 64 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.370 INFO:tasks.workunit.client.0.smithi163.stdout:4929( 65 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.370 INFO:tasks.workunit.client.0.smithi163.stdout:4930( 66 mod 256): WRITE 0x54bf4 thru 0x55fe1 (0x13ee bytes) 2023-07-14T18:17:18.370 INFO:tasks.workunit.client.0.smithi163.stdout:4931( 67 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.370 INFO:tasks.workunit.client.0.smithi163.stdout:4932( 68 mod 256): MAPWRITE 0x15ca9 thru 0x1fa2b (0x9d83 bytes) 2023-07-14T18:17:18.370 INFO:tasks.workunit.client.0.smithi163.stdout:4933( 69 mod 256): MAPWRITE 0xc7df3 thru 0xd0b56 (0x8d64 bytes) 2023-07-14T18:17:18.370 INFO:tasks.workunit.client.0.smithi163.stdout:4934( 70 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.370 INFO:tasks.workunit.client.0.smithi163.stdout:4935( 71 mod 256): TRUNCATE DOWN from 0xf0971 to 0x98a5b 2023-07-14T18:17:18.370 INFO:tasks.workunit.client.0.smithi163.stdout:4936( 72 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.371 INFO:tasks.workunit.client.0.smithi163.stdout:4937( 73 mod 256): FALLOC 0xffdc4 thru 0x100000 (0x23c bytes) EXTENDING 2023-07-14T18:17:18.371 INFO:tasks.workunit.client.0.smithi163.stdout:4938( 74 mod 256): PUNCH 0xc28a3 thru 0xc800b (0x5769 bytes) 2023-07-14T18:17:18.371 INFO:tasks.workunit.client.0.smithi163.stdout:4939( 75 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.371 INFO:tasks.workunit.client.0.smithi163.stdout:4940( 76 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.371 INFO:tasks.workunit.client.0.smithi163.stdout:4941( 77 mod 256): READ 0x363ed thru 0x3e624 (0x8238 bytes) ***RRRR*** 2023-07-14T18:17:18.371 INFO:tasks.workunit.client.0.smithi163.stdout:4942( 78 mod 256): PUNCH 0x4dd95 thru 0x518a9 (0x3b15 bytes) 2023-07-14T18:17:18.371 INFO:tasks.workunit.client.0.smithi163.stdout:4943( 79 mod 256): TRUNCATE DOWN from 0x100000 to 0x31c94 ******WWWW 2023-07-14T18:17:18.371 INFO:tasks.workunit.client.0.smithi163.stdout:4944( 80 mod 256): PUNCH 0x2660f thru 0x29243 (0x2c35 bytes) 2023-07-14T18:17:18.372 INFO:tasks.workunit.client.0.smithi163.stdout:4945( 81 mod 256): WRITE 0x5e13f thru 0x604db (0x239d bytes) HOLE ***WWWW 2023-07-14T18:17:18.372 INFO:tasks.workunit.client.0.smithi163.stdout:4946( 82 mod 256): FALLOC 0x1f40d thru 0x2c3f5 (0xcfe8 bytes) INTERIOR 2023-07-14T18:17:18.372 INFO:tasks.workunit.client.0.smithi163.stdout:4947( 83 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.372 INFO:tasks.workunit.client.0.smithi163.stdout:4948( 84 mod 256): MAPREAD 0x11784 thru 0x19cb8 (0x8535 bytes) 2023-07-14T18:17:18.372 INFO:tasks.workunit.client.0.smithi163.stdout:4949( 85 mod 256): MAPREAD 0x7eb1 thru 0xcf6d (0x50bd bytes) 2023-07-14T18:17:18.372 INFO:tasks.workunit.client.0.smithi163.stdout:4950( 86 mod 256): COPY 0x16cdb thru 0x206fd (0x9a23 bytes) to 0x37f6c thru 0x4198e ******EEEE 2023-07-14T18:17:18.372 INFO:tasks.workunit.client.0.smithi163.stdout:4951( 87 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.372 INFO:tasks.workunit.client.0.smithi163.stdout:4952( 88 mod 256): MAPWRITE 0xcc975 thru 0xd340a (0x6a96 bytes) 2023-07-14T18:17:18.373 INFO:tasks.workunit.client.0.smithi163.stdout:4953( 89 mod 256): TRUNCATE UP from 0xd340b to 0xddf91 2023-07-14T18:17:18.373 INFO:tasks.workunit.client.0.smithi163.stdout:4954( 90 mod 256): MAPREAD 0xd00dd thru 0xd5742 (0x5666 bytes) 2023-07-14T18:17:18.373 INFO:tasks.workunit.client.0.smithi163.stdout:4955( 91 mod 256): COPY 0x7fd2b thru 0x854ca (0x57a0 bytes) to 0x9967b thru 0x9ee1a 2023-07-14T18:17:18.373 INFO:tasks.workunit.client.0.smithi163.stdout:4956( 92 mod 256): MAPWRITE 0xe90 thru 0xf7a9 (0xe91a bytes) 2023-07-14T18:17:18.373 INFO:tasks.workunit.client.0.smithi163.stdout:4957( 93 mod 256): MAPWRITE 0x9151 thru 0xecaa (0x5b5a bytes) 2023-07-14T18:17:18.373 INFO:tasks.workunit.client.0.smithi163.stdout:4958( 94 mod 256): MAPWRITE 0x1f2d8 thru 0x28975 (0x969e bytes) 2023-07-14T18:17:18.373 INFO:tasks.workunit.client.0.smithi163.stdout:4959( 95 mod 256): READ 0x93cdd thru 0x95067 (0x138b bytes) 2023-07-14T18:17:18.373 INFO:tasks.workunit.client.0.smithi163.stdout:4960( 96 mod 256): WRITE 0x919bc thru 0x93a8c (0x20d1 bytes) 2023-07-14T18:17:18.374 INFO:tasks.workunit.client.0.smithi163.stdout:4961( 97 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.374 INFO:tasks.workunit.client.0.smithi163.stdout:4962( 98 mod 256): MAPREAD 0x9f4e8 thru 0xadaff (0xe618 bytes) 2023-07-14T18:17:18.374 INFO:tasks.workunit.client.0.smithi163.stdout:4963( 99 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.374 INFO:tasks.workunit.client.0.smithi163.stdout:4964(100 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.374 INFO:tasks.workunit.client.0.smithi163.stdout:4965(101 mod 256): MAPWRITE 0x9a3a4 thru 0x9e17b (0x3dd8 bytes) 2023-07-14T18:17:18.374 INFO:tasks.workunit.client.0.smithi163.stdout:4966(102 mod 256): TRUNCATE DOWN from 0xddf91 to 0x3c62f 2023-07-14T18:17:18.374 INFO:tasks.workunit.client.0.smithi163.stdout:4967(103 mod 256): PUNCH 0x384cd thru 0x3c30a (0x3e3e bytes) 2023-07-14T18:17:18.374 INFO:tasks.workunit.client.0.smithi163.stdout:4968(104 mod 256): READ 0x23a1f thru 0x2f34a (0xb92c bytes) 2023-07-14T18:17:18.375 INFO:tasks.workunit.client.0.smithi163.stdout:4969(105 mod 256): FALLOC 0xc921 thru 0x1b1e5 (0xe8c4 bytes) INTERIOR 2023-07-14T18:17:18.375 INFO:tasks.workunit.client.0.smithi163.stdout:4970(106 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.375 INFO:tasks.workunit.client.0.smithi163.stdout:4971(107 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.375 INFO:tasks.workunit.client.0.smithi163.stdout:4972(108 mod 256): PUNCH 0x2f07f thru 0x37170 (0x80f2 bytes) 2023-07-14T18:17:18.375 INFO:tasks.workunit.client.0.smithi163.stdout:4973(109 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.375 INFO:tasks.workunit.client.0.smithi163.stdout:4974(110 mod 256): READ 0x3060 thru 0x38ba (0x85b bytes) 2023-07-14T18:17:18.375 INFO:tasks.workunit.client.0.smithi163.stdout:4975(111 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.375 INFO:tasks.workunit.client.0.smithi163.stdout:4976(112 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.376 INFO:tasks.workunit.client.0.smithi163.stdout:4977(113 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.376 INFO:tasks.workunit.client.0.smithi163.stdout:4978(114 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.376 INFO:tasks.workunit.client.0.smithi163.stdout:4979(115 mod 256): COPY 0x2cde6 thru 0x36fa0 (0xa1bb bytes) to 0xa8884 thru 0xb2a3e 2023-07-14T18:17:18.376 INFO:tasks.workunit.client.0.smithi163.stdout:4980(116 mod 256): MAPREAD 0x9dc64 thru 0xa0db7 (0x3154 bytes) 2023-07-14T18:17:18.376 INFO:tasks.workunit.client.0.smithi163.stdout:4981(117 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.376 INFO:tasks.workunit.client.0.smithi163.stdout:4982(118 mod 256): MAPREAD 0x6f6c6 thru 0x7be15 (0xc750 bytes) 2023-07-14T18:17:18.376 INFO:tasks.workunit.client.0.smithi163.stdout:4983(119 mod 256): PUNCH 0x2fa82 thru 0x34acf (0x504e bytes) 2023-07-14T18:17:18.376 INFO:tasks.workunit.client.0.smithi163.stdout:4984(120 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.377 INFO:tasks.workunit.client.0.smithi163.stdout:4985(121 mod 256): MAPREAD 0x5b131 thru 0x66056 (0xaf26 bytes) 2023-07-14T18:17:18.377 INFO:tasks.workunit.client.0.smithi163.stdout:4986(122 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.377 INFO:tasks.workunit.client.0.smithi163.stdout:4987(123 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.377 INFO:tasks.workunit.client.0.smithi163.stdout:4988(124 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.377 INFO:tasks.workunit.client.0.smithi163.stdout:4989(125 mod 256): READ 0x5f212 thru 0x68900 (0x96ef bytes) 2023-07-14T18:17:18.377 INFO:tasks.workunit.client.0.smithi163.stdout:4990(126 mod 256): COPY 0x40df5 thru 0x4acdd (0x9ee9 bytes) to 0x99c51 thru 0xa3b39 2023-07-14T18:17:18.377 INFO:tasks.workunit.client.0.smithi163.stdout:4991(127 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.377 INFO:tasks.workunit.client.0.smithi163.stdout:4992(128 mod 256): MAPWRITE 0x8d860 thru 0x9aa89 (0xd22a bytes) 2023-07-14T18:17:18.378 INFO:tasks.workunit.client.0.smithi163.stdout:4993(129 mod 256): FALLOC 0xdfca0 thru 0xec90f (0xcc6f bytes) PAST_EOF 2023-07-14T18:17:18.378 INFO:tasks.workunit.client.0.smithi163.stdout:4994(130 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.378 INFO:tasks.workunit.client.0.smithi163.stdout:4995(131 mod 256): FALLOC 0xda479 thru 0xdd20e (0x2d95 bytes) PAST_EOF 2023-07-14T18:17:18.378 INFO:tasks.workunit.client.0.smithi163.stdout:4996(132 mod 256): READ 0x3b4bb thru 0x47d16 (0xc85c bytes) 2023-07-14T18:17:18.378 INFO:tasks.workunit.client.0.smithi163.stdout:4997(133 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.378 INFO:tasks.workunit.client.0.smithi163.stdout:4998(134 mod 256): WRITE 0xbdaa5 thru 0xc919f (0xb6fb bytes) HOLE 2023-07-14T18:17:18.378 INFO:tasks.workunit.client.0.smithi163.stdout:4999(135 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.378 INFO:tasks.workunit.client.0.smithi163.stdout:5000(136 mod 256): READ 0x246f5 thru 0x2b68d (0x6f99 bytes) 2023-07-14T18:17:18.379 INFO:tasks.workunit.client.0.smithi163.stdout:5001(137 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.379 INFO:tasks.workunit.client.0.smithi163.stdout:5002(138 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.379 INFO:tasks.workunit.client.0.smithi163.stdout:5003(139 mod 256): PUNCH 0x8e040 thru 0x92156 (0x4117 bytes) 2023-07-14T18:17:18.379 INFO:tasks.workunit.client.0.smithi163.stdout:5004(140 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.379 INFO:tasks.workunit.client.0.smithi163.stdout:5005(141 mod 256): MAPREAD 0x7bd0b thru 0x8bb25 (0xfe1b bytes) 2023-07-14T18:17:18.379 INFO:tasks.workunit.client.0.smithi163.stdout:5006(142 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.379 INFO:tasks.workunit.client.0.smithi163.stdout:5007(143 mod 256): MAPWRITE 0x5dfb6 thru 0x619ee (0x3a39 bytes) 2023-07-14T18:17:18.379 INFO:tasks.workunit.client.0.smithi163.stdout:5008(144 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.380 INFO:tasks.workunit.client.0.smithi163.stdout:5009(145 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.380 INFO:tasks.workunit.client.0.smithi163.stdout:5010(146 mod 256): MAPWRITE 0x91cca thru 0x9c73d (0xaa74 bytes) 2023-07-14T18:17:18.380 INFO:tasks.workunit.client.0.smithi163.stdout:5011(147 mod 256): PUNCH 0x45834 thru 0x50aed (0xb2ba bytes) 2023-07-14T18:17:18.380 INFO:tasks.workunit.client.0.smithi163.stdout:5012(148 mod 256): MAPWRITE 0x373d1 thru 0x3f24d (0x7e7d bytes) ******WWWW 2023-07-14T18:17:18.380 INFO:tasks.workunit.client.0.smithi163.stdout:5013(149 mod 256): MAPWRITE 0xcf5ea thru 0xdcd9d (0xd7b4 bytes) 2023-07-14T18:17:18.380 INFO:tasks.workunit.client.0.smithi163.stdout:5014(150 mod 256): WRITE 0x23477 thru 0x28258 (0x4de2 bytes) 2023-07-14T18:17:18.380 INFO:tasks.workunit.client.0.smithi163.stdout:5015(151 mod 256): MAPREAD 0xbef70 thru 0xc94ce (0xa55f bytes) 2023-07-14T18:17:18.380 INFO:tasks.workunit.client.0.smithi163.stdout:5016(152 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.381 INFO:tasks.workunit.client.0.smithi163.stdout:5017(153 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.381 INFO:tasks.workunit.client.0.smithi163.stdout:5018(154 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.381 INFO:tasks.workunit.client.0.smithi163.stdout:5019(155 mod 256): READ 0x34f67 thru 0x36d45 (0x1ddf bytes) 2023-07-14T18:17:18.381 INFO:tasks.workunit.client.0.smithi163.stdout:5020(156 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.381 INFO:tasks.workunit.client.0.smithi163.stdout:5021(157 mod 256): READ 0xb0adc thru 0xb55e9 (0x4b0e bytes) 2023-07-14T18:17:18.381 INFO:tasks.workunit.client.0.smithi163.stdout:5022(158 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.381 INFO:tasks.workunit.client.0.smithi163.stdout:5023(159 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.381 INFO:tasks.workunit.client.0.smithi163.stdout:5024(160 mod 256): FALLOC 0xb88c2 thru 0xbb6f4 (0x2e32 bytes) INTERIOR 2023-07-14T18:17:18.382 INFO:tasks.workunit.client.0.smithi163.stdout:5025(161 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.382 INFO:tasks.workunit.client.0.smithi163.stdout:5026(162 mod 256): READ 0xa370b thru 0xa6f0b (0x3801 bytes) 2023-07-14T18:17:18.382 INFO:tasks.workunit.client.0.smithi163.stdout:5027(163 mod 256): MAPREAD 0x5fc6b thru 0x6b29e (0xb634 bytes) 2023-07-14T18:17:18.382 INFO:tasks.workunit.client.0.smithi163.stdout:5028(164 mod 256): MAPREAD 0x53c97 thru 0x55c37 (0x1fa1 bytes) 2023-07-14T18:17:18.382 INFO:tasks.workunit.client.0.smithi163.stdout:5029(165 mod 256): WRITE 0xbe7bf thru 0xc83c3 (0x9c05 bytes) 2023-07-14T18:17:18.382 INFO:tasks.workunit.client.0.smithi163.stdout:5030(166 mod 256): READ 0x45de5 thru 0x52fb6 (0xd1d2 bytes) 2023-07-14T18:17:18.382 INFO:tasks.workunit.client.0.smithi163.stdout:5031(167 mod 256): MAPREAD 0xd3497 thru 0xdcd9d (0x9907 bytes) 2023-07-14T18:17:18.382 INFO:tasks.workunit.client.0.smithi163.stdout:5032(168 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.383 INFO:tasks.workunit.client.0.smithi163.stdout:5033(169 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.383 INFO:tasks.workunit.client.0.smithi163.stdout:5034(170 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.383 INFO:tasks.workunit.client.0.smithi163.stdout:5035(171 mod 256): FALLOC 0xd31d5 thru 0xdbb83 (0x89ae bytes) INTERIOR 2023-07-14T18:17:18.383 INFO:tasks.workunit.client.0.smithi163.stdout:5036(172 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.383 INFO:tasks.workunit.client.0.smithi163.stdout:5037(173 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.383 INFO:tasks.workunit.client.0.smithi163.stdout:5038(174 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.383 INFO:tasks.workunit.client.0.smithi163.stdout:5039(175 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.383 INFO:tasks.workunit.client.0.smithi163.stdout:5040(176 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.384 INFO:tasks.workunit.client.0.smithi163.stdout:5041(177 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.384 INFO:tasks.workunit.client.0.smithi163.stdout:5042(178 mod 256): MAPWRITE 0xb745d thru 0xc0dcb (0x996f bytes) 2023-07-14T18:17:18.384 INFO:tasks.workunit.client.0.smithi163.stdout:5043(179 mod 256): MAPWRITE 0x81316 thru 0x8ed8f (0xda7a bytes) 2023-07-14T18:17:18.384 INFO:tasks.workunit.client.0.smithi163.stdout:5044(180 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.384 INFO:tasks.workunit.client.0.smithi163.stdout:5045(181 mod 256): MAPWRITE 0x48582 thru 0x4c4f5 (0x3f74 bytes) 2023-07-14T18:17:18.384 INFO:tasks.workunit.client.0.smithi163.stdout:5046(182 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.384 INFO:tasks.workunit.client.0.smithi163.stdout:5047(183 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.384 INFO:tasks.workunit.client.0.smithi163.stdout:5048(184 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.385 INFO:tasks.workunit.client.0.smithi163.stdout:5049(185 mod 256): MAPWRITE 0x23aab thru 0x24283 (0x7d9 bytes) 2023-07-14T18:17:18.385 INFO:tasks.workunit.client.0.smithi163.stdout:5050(186 mod 256): FALLOC 0x9e71c thru 0x9f933 (0x1217 bytes) INTERIOR 2023-07-14T18:17:18.385 INFO:tasks.workunit.client.0.smithi163.stdout:5051(187 mod 256): FALLOC 0xd5825 thru 0xe51c0 (0xf99b bytes) PAST_EOF 2023-07-14T18:17:18.385 INFO:tasks.workunit.client.0.smithi163.stdout:5052(188 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.385 INFO:tasks.workunit.client.0.smithi163.stdout:5053(189 mod 256): FALLOC 0x57c2a thru 0x59ba0 (0x1f76 bytes) INTERIOR 2023-07-14T18:17:18.385 INFO:tasks.workunit.client.0.smithi163.stdout:5054(190 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.385 INFO:tasks.workunit.client.0.smithi163.stdout:5055(191 mod 256): COPY 0x77e34 thru 0x8499f (0xcb6c bytes) to 0x49300 thru 0x55e6b 2023-07-14T18:17:18.385 INFO:tasks.workunit.client.0.smithi163.stdout:5056(192 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.386 INFO:tasks.workunit.client.0.smithi163.stdout:5057(193 mod 256): MAPREAD 0x1b3fd thru 0x1b7fc (0x400 bytes) 2023-07-14T18:17:18.386 INFO:tasks.workunit.client.0.smithi163.stdout:5058(194 mod 256): MAPREAD 0x1014 thru 0x66cd (0x56ba bytes) 2023-07-14T18:17:18.386 INFO:tasks.workunit.client.0.smithi163.stdout:5059(195 mod 256): WRITE 0x12c07 thru 0x1e2c7 (0xb6c1 bytes) 2023-07-14T18:17:18.386 INFO:tasks.workunit.client.0.smithi163.stdout:5060(196 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.386 INFO:tasks.workunit.client.0.smithi163.stdout:5061(197 mod 256): TRUNCATE UP from 0xdcd9e to 0xe8784 2023-07-14T18:17:18.386 INFO:tasks.workunit.client.0.smithi163.stdout:5062(198 mod 256): MAPWRITE 0x91249 thru 0x96664 (0x541c bytes) 2023-07-14T18:17:18.386 INFO:tasks.workunit.client.0.smithi163.stdout:5063(199 mod 256): READ 0x6a738 thru 0x78db9 (0xe682 bytes) 2023-07-14T18:17:18.386 INFO:tasks.workunit.client.0.smithi163.stdout:5064(200 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.387 INFO:tasks.workunit.client.0.smithi163.stdout:5065(201 mod 256): MAPREAD 0x80b55 thru 0x8e472 (0xd91e bytes) 2023-07-14T18:17:18.387 INFO:tasks.workunit.client.0.smithi163.stdout:5066(202 mod 256): TRUNCATE DOWN from 0xe8784 to 0x2e2fd ******WWWW 2023-07-14T18:17:18.387 INFO:tasks.workunit.client.0.smithi163.stdout:5067(203 mod 256): WRITE 0x391b0 thru 0x428dd (0x972e bytes) HOLE ***WWWW 2023-07-14T18:17:18.387 INFO:tasks.workunit.client.0.smithi163.stdout:5068(204 mod 256): TRUNCATE DOWN from 0x428de to 0xf8bc ******WWWW 2023-07-14T18:17:18.387 INFO:tasks.workunit.client.0.smithi163.stdout:5069(205 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.387 INFO:tasks.workunit.client.0.smithi163.stdout:5070(206 mod 256): PUNCH 0x31cc thru 0xa3dd (0x7212 bytes) 2023-07-14T18:17:18.387 INFO:tasks.workunit.client.0.smithi163.stdout:5071(207 mod 256): TRUNCATE UP from 0xf8bc to 0x8abc6 ******WWWW 2023-07-14T18:17:18.387 INFO:tasks.workunit.client.0.smithi163.stdout:5072(208 mod 256): PUNCH 0x89d1d thru 0x8abc5 (0xea9 bytes) 2023-07-14T18:17:18.388 INFO:tasks.workunit.client.0.smithi163.stdout:5073(209 mod 256): COPY 0x84f95 thru 0x8abc5 (0x5c31 bytes) to 0x452c5 thru 0x4aef5 2023-07-14T18:17:18.388 INFO:tasks.workunit.client.0.smithi163.stdout:5074(210 mod 256): FALLOC 0x8fae3 thru 0x8fd3e (0x25b bytes) EXTENDING 2023-07-14T18:17:18.388 INFO:tasks.workunit.client.0.smithi163.stdout:5075(211 mod 256): COPY 0x6dec8 thru 0x72a20 (0x4b59 bytes) to 0x12c5e thru 0x177b6 2023-07-14T18:17:18.388 INFO:tasks.workunit.client.0.smithi163.stdout:5076(212 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.388 INFO:tasks.workunit.client.0.smithi163.stdout:5077(213 mod 256): WRITE 0x64ab4 thru 0x6724f (0x279c bytes) 2023-07-14T18:17:18.388 INFO:tasks.workunit.client.0.smithi163.stdout:5078(214 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.388 INFO:tasks.workunit.client.0.smithi163.stdout:5079(215 mod 256): MAPWRITE 0x96ba2 thru 0x9b2b2 (0x4711 bytes) 2023-07-14T18:17:18.388 INFO:tasks.workunit.client.0.smithi163.stdout:5080(216 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.389 INFO:tasks.workunit.client.0.smithi163.stdout:5081(217 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.389 INFO:tasks.workunit.client.0.smithi163.stdout:5082(218 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.389 INFO:tasks.workunit.client.0.smithi163.stdout:5083(219 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.389 INFO:tasks.workunit.client.0.smithi163.stdout:5084(220 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.389 INFO:tasks.workunit.client.0.smithi163.stdout:5085(221 mod 256): COPY 0x576ec thru 0x584eb (0xe00 bytes) to 0xa6dd0 thru 0xa7bcf 2023-07-14T18:17:18.389 INFO:tasks.workunit.client.0.smithi163.stdout:5086(222 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.389 INFO:tasks.workunit.client.0.smithi163.stdout:5087(223 mod 256): FALLOC 0x6bb6c thru 0x6ebb5 (0x3049 bytes) INTERIOR 2023-07-14T18:17:18.389 INFO:tasks.workunit.client.0.smithi163.stdout:5088(224 mod 256): MAPREAD 0x64017 thru 0x659c9 (0x19b3 bytes) 2023-07-14T18:17:18.390 INFO:tasks.workunit.client.0.smithi163.stdout:5089(225 mod 256): MAPREAD 0x4cefe thru 0x5b31e (0xe421 bytes) 2023-07-14T18:17:18.390 INFO:tasks.workunit.client.0.smithi163.stdout:5090(226 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.390 INFO:tasks.workunit.client.0.smithi163.stdout:5091(227 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.390 INFO:tasks.workunit.client.0.smithi163.stdout:5092(228 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.390 INFO:tasks.workunit.client.0.smithi163.stdout:5093(229 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.390 INFO:tasks.workunit.client.0.smithi163.stdout:5094(230 mod 256): MAPWRITE 0xb94c6 thru 0xba7ed (0x1328 bytes) 2023-07-14T18:17:18.390 INFO:tasks.workunit.client.0.smithi163.stdout:5095(231 mod 256): MAPREAD 0xb97eb thru 0xba7ed (0x1003 bytes) 2023-07-14T18:17:18.390 INFO:tasks.workunit.client.0.smithi163.stdout:5096(232 mod 256): COPY 0xadc9 thru 0x13095 (0x82cd bytes) to 0x57f08 thru 0x601d4 2023-07-14T18:17:18.391 INFO:tasks.workunit.client.0.smithi163.stdout:5097(233 mod 256): MAPWRITE 0x1f36b thru 0x20a69 (0x16ff bytes) 2023-07-14T18:17:18.391 INFO:tasks.workunit.client.0.smithi163.stdout:5098(234 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.391 INFO:tasks.workunit.client.0.smithi163.stdout:5099(235 mod 256): MAPREAD 0x1360f thru 0x17783 (0x4175 bytes) 2023-07-14T18:17:18.391 INFO:tasks.workunit.client.0.smithi163.stdout:5100(236 mod 256): TRUNCATE DOWN from 0xba7ee to 0x389d1 2023-07-14T18:17:18.391 INFO:tasks.workunit.client.0.smithi163.stdout:5101(237 mod 256): FALLOC 0x620e thru 0x11d6b (0xbb5d bytes) INTERIOR 2023-07-14T18:17:18.391 INFO:tasks.workunit.client.0.smithi163.stdout:5102(238 mod 256): READ 0x381e1 thru 0x389d0 (0x7f0 bytes) ***RRRR*** 2023-07-14T18:17:18.391 INFO:tasks.workunit.client.0.smithi163.stdout:5103(239 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.391 INFO:tasks.workunit.client.0.smithi163.stdout:5104(240 mod 256): WRITE 0x50bf4 thru 0x57227 (0x6634 bytes) HOLE 2023-07-14T18:17:18.392 INFO:tasks.workunit.client.0.smithi163.stdout:5105(241 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.392 INFO:tasks.workunit.client.0.smithi163.stdout:5106(242 mod 256): FALLOC 0x421e7 thru 0x50ea5 (0xecbe bytes) INTERIOR 2023-07-14T18:17:18.392 INFO:tasks.workunit.client.0.smithi163.stdout:5107(243 mod 256): MAPWRITE 0xeed4f thru 0xf402b (0x52dd bytes) 2023-07-14T18:17:18.392 INFO:tasks.workunit.client.0.smithi163.stdout:5108(244 mod 256): MAPWRITE 0xa46f0 thru 0xaaf39 (0x684a bytes) 2023-07-14T18:17:18.392 INFO:tasks.workunit.client.0.smithi163.stdout:5109(245 mod 256): TRUNCATE DOWN from 0xf402c to 0x4bc50 2023-07-14T18:17:18.392 INFO:tasks.workunit.client.0.smithi163.stdout:5110(246 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.392 INFO:tasks.workunit.client.0.smithi163.stdout:5111(247 mod 256): WRITE 0xd18e5 thru 0xd306f (0x178b bytes) HOLE 2023-07-14T18:17:18.393 INFO:tasks.workunit.client.0.smithi163.stdout:5112(248 mod 256): READ 0x89dfa thru 0x8b1f0 (0x13f7 bytes) 2023-07-14T18:17:18.393 INFO:tasks.workunit.client.0.smithi163.stdout:5113(249 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.393 INFO:tasks.workunit.client.0.smithi163.stdout:5114(250 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.393 INFO:tasks.workunit.client.0.smithi163.stdout:5115(251 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.393 INFO:tasks.workunit.client.0.smithi163.stdout:5116(252 mod 256): TRUNCATE DOWN from 0xd3070 to 0x8bac9 2023-07-14T18:17:18.393 INFO:tasks.workunit.client.0.smithi163.stdout:5117(253 mod 256): PUNCH 0x136f6 thru 0x17808 (0x4113 bytes) 2023-07-14T18:17:18.393 INFO:tasks.workunit.client.0.smithi163.stdout:5118(254 mod 256): MAPWRITE 0x26dd7 thru 0x319ab (0xabd5 bytes) 2023-07-14T18:17:18.393 INFO:tasks.workunit.client.0.smithi163.stdout:5119(255 mod 256): PUNCH 0x1a27b thru 0x217fe (0x7584 bytes) 2023-07-14T18:17:18.393 INFO:tasks.workunit.client.0.smithi163.stdout:5120( 0 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.394 INFO:tasks.workunit.client.0.smithi163.stdout:5121( 1 mod 256): WRITE 0x4414b thru 0x495ae (0x5464 bytes) 2023-07-14T18:17:18.394 INFO:tasks.workunit.client.0.smithi163.stdout:5122( 2 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.394 INFO:tasks.workunit.client.0.smithi163.stdout:5123( 3 mod 256): COPY 0x39ba3 thru 0x3cbd8 (0x3036 bytes) to 0xce57a thru 0xd15af 2023-07-14T18:17:18.394 INFO:tasks.workunit.client.0.smithi163.stdout:5124( 4 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.394 INFO:tasks.workunit.client.0.smithi163.stdout:5125( 5 mod 256): COPY 0x80a2f thru 0x84c7c (0x424e bytes) to 0x7c71e thru 0x8096b 2023-07-14T18:17:18.394 INFO:tasks.workunit.client.0.smithi163.stdout:5126( 6 mod 256): FALLOC 0xc259d thru 0xd0cee (0xe751 bytes) INTERIOR 2023-07-14T18:17:18.394 INFO:tasks.workunit.client.0.smithi163.stdout:5127( 7 mod 256): WRITE 0x86829 thru 0x96549 (0xfd21 bytes) 2023-07-14T18:17:18.394 INFO:tasks.workunit.client.0.smithi163.stdout:5128( 8 mod 256): WRITE 0x1d11e thru 0x23fd3 (0x6eb6 bytes) 2023-07-14T18:17:18.395 INFO:tasks.workunit.client.0.smithi163.stdout:5129( 9 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.395 INFO:tasks.workunit.client.0.smithi163.stdout:5130( 10 mod 256): READ 0x798c0 thru 0x86f91 (0xd6d2 bytes) 2023-07-14T18:17:18.395 INFO:tasks.workunit.client.0.smithi163.stdout:5131( 11 mod 256): PUNCH 0xa3bf8 thru 0xac824 (0x8c2d bytes) 2023-07-14T18:17:18.395 INFO:tasks.workunit.client.0.smithi163.stdout:5132( 12 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.395 INFO:tasks.workunit.client.0.smithi163.stdout:5133( 13 mod 256): COPY 0x9bb81 thru 0xa4489 (0x8909 bytes) to 0x497f4 thru 0x520fc 2023-07-14T18:17:18.395 INFO:tasks.workunit.client.0.smithi163.stdout:5134( 14 mod 256): PUNCH 0x75611 thru 0x7f260 (0x9c50 bytes) 2023-07-14T18:17:18.395 INFO:tasks.workunit.client.0.smithi163.stdout:5135( 15 mod 256): WRITE 0x999d8 thru 0x9d65b (0x3c84 bytes) 2023-07-14T18:17:18.395 INFO:tasks.workunit.client.0.smithi163.stdout:5136( 16 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.396 INFO:tasks.workunit.client.0.smithi163.stdout:5137( 17 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.396 INFO:tasks.workunit.client.0.smithi163.stdout:5138( 18 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.396 INFO:tasks.workunit.client.0.smithi163.stdout:5139( 19 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.396 INFO:tasks.workunit.client.0.smithi163.stdout:5140( 20 mod 256): MAPWRITE 0x19a9e thru 0x1d377 (0x38da bytes) 2023-07-14T18:17:18.396 INFO:tasks.workunit.client.0.smithi163.stdout:5141( 21 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.396 INFO:tasks.workunit.client.0.smithi163.stdout:5142( 22 mod 256): MAPWRITE 0x3095b thru 0x3f600 (0xeca6 bytes) ******WWWW 2023-07-14T18:17:18.396 INFO:tasks.workunit.client.0.smithi163.stdout:5143( 23 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.397 INFO:tasks.workunit.client.0.smithi163.stdout:5144( 24 mod 256): READ 0x25ee6 thru 0x30b7f (0xac9a bytes) 2023-07-14T18:17:18.397 INFO:tasks.workunit.client.0.smithi163.stdout:5145( 25 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.397 INFO:tasks.workunit.client.0.smithi163.stdout:5146( 26 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.397 INFO:tasks.workunit.client.0.smithi163.stdout:5147( 27 mod 256): READ 0x81396 thru 0x89887 (0x84f2 bytes) 2023-07-14T18:17:18.397 INFO:tasks.workunit.client.0.smithi163.stdout:5148( 28 mod 256): PUNCH 0x487a6 thru 0x51834 (0x908f bytes) 2023-07-14T18:17:18.397 INFO:tasks.workunit.client.0.smithi163.stdout:5149( 29 mod 256): WRITE 0xfaabc thru 0xfffff (0x5544 bytes) HOLE 2023-07-14T18:17:18.397 INFO:tasks.workunit.client.0.smithi163.stdout:5150( 30 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.397 INFO:tasks.workunit.client.0.smithi163.stdout:5151( 31 mod 256): TRUNCATE DOWN from 0x100000 to 0x1bb5e ******WWWW 2023-07-14T18:17:18.398 INFO:tasks.workunit.client.0.smithi163.stdout:5152( 32 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.398 INFO:tasks.workunit.client.0.smithi163.stdout:5153( 33 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.398 INFO:tasks.workunit.client.0.smithi163.stdout:5154( 34 mod 256): MAPWRITE 0xbbdac thru 0xbc936 (0xb8b bytes) 2023-07-14T18:17:18.398 INFO:tasks.workunit.client.0.smithi163.stdout:5155( 35 mod 256): READ 0x56b4c thru 0x619da (0xae8f bytes) 2023-07-14T18:17:18.398 INFO:tasks.workunit.client.0.smithi163.stdout:5156( 36 mod 256): FALLOC 0x6079e thru 0x6e3f1 (0xdc53 bytes) INTERIOR 2023-07-14T18:17:18.398 INFO:tasks.workunit.client.0.smithi163.stdout:5157( 37 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.398 INFO:tasks.workunit.client.0.smithi163.stdout:5158( 38 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.398 INFO:tasks.workunit.client.0.smithi163.stdout:5159( 39 mod 256): MAPREAD 0x5fd7a thru 0x67958 (0x7bdf bytes) 2023-07-14T18:17:18.399 INFO:tasks.workunit.client.0.smithi163.stdout:5160( 40 mod 256): TRUNCATE DOWN from 0xbc937 to 0x9e3ba 2023-07-14T18:17:18.399 INFO:tasks.workunit.client.0.smithi163.stdout:5161( 41 mod 256): WRITE 0x41532 thru 0x4a561 (0x9030 bytes) 2023-07-14T18:17:18.399 INFO:tasks.workunit.client.0.smithi163.stdout:5162( 42 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.399 INFO:tasks.workunit.client.0.smithi163.stdout:5163( 43 mod 256): FALLOC 0xc3548 thru 0xd2e3e (0xf8f6 bytes) EXTENDING 2023-07-14T18:17:18.399 INFO:tasks.workunit.client.0.smithi163.stdout:5164( 44 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.399 INFO:tasks.workunit.client.0.smithi163.stdout:5165( 45 mod 256): COPY 0x7bb2f thru 0x88daa (0xd27c bytes) to 0x30316 thru 0x3d591 ******EEEE 2023-07-14T18:17:18.399 INFO:tasks.workunit.client.0.smithi163.stdout:5166( 46 mod 256): COPY 0x7ed35 thru 0x86f30 (0x81fc bytes) to 0xd629a thru 0xde495 2023-07-14T18:17:18.399 INFO:tasks.workunit.client.0.smithi163.stdout:5167( 47 mod 256): COPY 0xaf6d2 thru 0xb17da (0x2109 bytes) to 0xe60fc thru 0xe8204 2023-07-14T18:17:18.400 INFO:tasks.workunit.client.0.smithi163.stdout:5168( 48 mod 256): MAPWRITE 0x15a0a thru 0x24019 (0xe610 bytes) 2023-07-14T18:17:18.400 INFO:tasks.workunit.client.0.smithi163.stdout:5169( 49 mod 256): COPY 0xd353c thru 0xe2744 (0xf209 bytes) to 0x91625 thru 0xa082d 2023-07-14T18:17:18.400 INFO:tasks.workunit.client.0.smithi163.stdout:5170( 50 mod 256): TRUNCATE UP from 0xe8205 to 0xf76c1 2023-07-14T18:17:18.400 INFO:tasks.workunit.client.0.smithi163.stdout:5171( 51 mod 256): READ 0x76c65 thru 0x83553 (0xc8ef bytes) 2023-07-14T18:17:18.400 INFO:tasks.workunit.client.0.smithi163.stdout:5172( 52 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.400 INFO:tasks.workunit.client.0.smithi163.stdout:5173( 53 mod 256): MAPWRITE 0x654c7 thru 0x70e9a (0xb9d4 bytes) 2023-07-14T18:17:18.400 INFO:tasks.workunit.client.0.smithi163.stdout:5174( 54 mod 256): READ 0xd167d thru 0xe003a (0xe9be bytes) 2023-07-14T18:17:18.400 INFO:tasks.workunit.client.0.smithi163.stdout:5175( 55 mod 256): WRITE 0x68b3a thru 0x75929 (0xcdf0 bytes) 2023-07-14T18:17:18.401 INFO:tasks.workunit.client.0.smithi163.stdout:5176( 56 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.401 INFO:tasks.workunit.client.0.smithi163.stdout:5177( 57 mod 256): TRUNCATE DOWN from 0xf76c1 to 0xbbb69 2023-07-14T18:17:18.401 INFO:tasks.workunit.client.0.smithi163.stdout:5178( 58 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.401 INFO:tasks.workunit.client.0.smithi163.stdout:5179( 59 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.401 INFO:tasks.workunit.client.0.smithi163.stdout:5180( 60 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.401 INFO:tasks.workunit.client.0.smithi163.stdout:5181( 61 mod 256): FALLOC 0xef3d2 thru 0xfe083 (0xecb1 bytes) EXTENDING 2023-07-14T18:17:18.401 INFO:tasks.workunit.client.0.smithi163.stdout:5182( 62 mod 256): PUNCH 0x3741f thru 0x45e74 (0xea56 bytes) ******PPPP 2023-07-14T18:17:18.401 INFO:tasks.workunit.client.0.smithi163.stdout:5183( 63 mod 256): PUNCH 0x24de4 thru 0x275e8 (0x2805 bytes) 2023-07-14T18:17:18.402 INFO:tasks.workunit.client.0.smithi163.stdout:5184( 64 mod 256): COPY 0x9cc70 thru 0x9e6b9 (0x1a4a bytes) to 0xc00f1 thru 0xc1b3a 2023-07-14T18:17:18.402 INFO:tasks.workunit.client.0.smithi163.stdout:5185( 65 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.402 INFO:tasks.workunit.client.0.smithi163.stdout:5186( 66 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.402 INFO:tasks.workunit.client.0.smithi163.stdout:5187( 67 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.402 INFO:tasks.workunit.client.0.smithi163.stdout:5188( 68 mod 256): PUNCH 0xfdb51 thru 0xfe082 (0x532 bytes) 2023-07-14T18:17:18.402 INFO:tasks.workunit.client.0.smithi163.stdout:5189( 69 mod 256): COPY 0x14ba1 thru 0x21f34 (0xd394 bytes) to 0xbfb38 thru 0xccecb 2023-07-14T18:17:18.402 INFO:tasks.workunit.client.0.smithi163.stdout:5190( 70 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.402 INFO:tasks.workunit.client.0.smithi163.stdout:5191( 71 mod 256): WRITE 0xd2705 thru 0xd3959 (0x1255 bytes) 2023-07-14T18:17:18.403 INFO:tasks.workunit.client.0.smithi163.stdout:5192( 72 mod 256): COPY 0x9f846 thru 0xa9c7c (0xa437 bytes) to 0xbdf46 thru 0xc837c 2023-07-14T18:17:18.403 INFO:tasks.workunit.client.0.smithi163.stdout:5193( 73 mod 256): WRITE 0xbe954 thru 0xc7a86 (0x9133 bytes) 2023-07-14T18:17:18.403 INFO:tasks.workunit.client.0.smithi163.stdout:5194( 74 mod 256): TRUNCATE DOWN from 0xfe083 to 0x192f9 ******WWWW 2023-07-14T18:17:18.403 INFO:tasks.workunit.client.0.smithi163.stdout:5195( 75 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.403 INFO:tasks.workunit.client.0.smithi163.stdout:5196( 76 mod 256): COPY 0x11727 thru 0x192f8 (0x7bd2 bytes) to 0x344a5 thru 0x3c076 ******EEEE 2023-07-14T18:17:18.403 INFO:tasks.workunit.client.0.smithi163.stdout:5197( 77 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.403 INFO:tasks.workunit.client.0.smithi163.stdout:5198( 78 mod 256): MAPREAD 0x1ae16 thru 0x2542d (0xa618 bytes) 2023-07-14T18:17:18.403 INFO:tasks.workunit.client.0.smithi163.stdout:5199( 79 mod 256): PUNCH 0xf518 thru 0x19026 (0x9b0f bytes) 2023-07-14T18:17:18.404 INFO:tasks.workunit.client.0.smithi163.stdout:5200( 80 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.404 INFO:tasks.workunit.client.0.smithi163.stdout:5201( 81 mod 256): MAPREAD 0x2a131 thru 0x2b732 (0x1602 bytes) 2023-07-14T18:17:18.404 INFO:tasks.workunit.client.0.smithi163.stdout:5202( 82 mod 256): READ 0x1273a thru 0x19dfb (0x76c2 bytes) 2023-07-14T18:17:18.404 INFO:tasks.workunit.client.0.smithi163.stdout:5203( 83 mod 256): COPY 0x12482 thru 0x1f146 (0xccc5 bytes) to 0xbb27a thru 0xc7f3e 2023-07-14T18:17:18.404 INFO:tasks.workunit.client.0.smithi163.stdout:5204( 84 mod 256): COPY 0x25b05 thru 0x25d0f (0x20b bytes) to 0xb93e0 thru 0xb95ea 2023-07-14T18:17:18.404 INFO:tasks.workunit.client.0.smithi163.stdout:5205( 85 mod 256): MAPREAD 0x1aea7 thru 0x2a8bf (0xfa19 bytes) 2023-07-14T18:17:18.404 INFO:tasks.workunit.client.0.smithi163.stdout:5206( 86 mod 256): MAPREAD 0xbbf3b thru 0xbed3a (0x2e00 bytes) 2023-07-14T18:17:18.404 INFO:tasks.workunit.client.0.smithi163.stdout:5207( 87 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.405 INFO:tasks.workunit.client.0.smithi163.stdout:5208( 88 mod 256): MAPWRITE 0x58e75 thru 0x663f1 (0xd57d bytes) 2023-07-14T18:17:18.405 INFO:tasks.workunit.client.0.smithi163.stdout:5209( 89 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.405 INFO:tasks.workunit.client.0.smithi163.stdout:5210( 90 mod 256): WRITE 0x2d6e0 thru 0x34fad (0x78ce bytes) 2023-07-14T18:17:18.405 INFO:tasks.workunit.client.0.smithi163.stdout:5211( 91 mod 256): FALLOC 0xa1e9a thru 0xaf4b8 (0xd61e bytes) INTERIOR 2023-07-14T18:17:18.405 INFO:tasks.workunit.client.0.smithi163.stdout:5212( 92 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.405 INFO:tasks.workunit.client.0.smithi163.stdout:5213( 93 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.405 INFO:tasks.workunit.client.0.smithi163.stdout:5214( 94 mod 256): PUNCH 0x616fc thru 0x618fe (0x203 bytes) 2023-07-14T18:17:18.405 INFO:tasks.workunit.client.0.smithi163.stdout:5215( 95 mod 256): MAPWRITE 0xf3d56 thru 0xfad6e (0x7019 bytes) 2023-07-14T18:17:18.406 INFO:tasks.workunit.client.0.smithi163.stdout:5216( 96 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.406 INFO:tasks.workunit.client.0.smithi163.stdout:5217( 97 mod 256): PUNCH 0xb5a6e thru 0xbc356 (0x68e9 bytes) 2023-07-14T18:17:18.406 INFO:tasks.workunit.client.0.smithi163.stdout:5218( 98 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.406 INFO:tasks.workunit.client.0.smithi163.stdout:5219( 99 mod 256): TRUNCATE DOWN from 0xfad6f to 0x62cf2 2023-07-14T18:17:18.406 INFO:tasks.workunit.client.0.smithi163.stdout:5220(100 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.406 INFO:tasks.workunit.client.0.smithi163.stdout:5221(101 mod 256): READ 0x6285d thru 0x62cf1 (0x495 bytes) 2023-07-14T18:17:18.406 INFO:tasks.workunit.client.0.smithi163.stdout:5222(102 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.406 INFO:tasks.workunit.client.0.smithi163.stdout:5223(103 mod 256): COPY 0x5a992 thru 0x602b3 (0x5922 bytes) to 0x949db thru 0x9a2fc 2023-07-14T18:17:18.407 INFO:tasks.workunit.client.0.smithi163.stdout:5224(104 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.407 INFO:tasks.workunit.client.0.smithi163.stdout:5225(105 mod 256): MAPWRITE 0xbe540 thru 0xcb178 (0xcc39 bytes) 2023-07-14T18:17:18.407 INFO:tasks.workunit.client.0.smithi163.stdout:5226(106 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.407 INFO:tasks.workunit.client.0.smithi163.stdout:5227(107 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.407 INFO:tasks.workunit.client.0.smithi163.stdout:5228(108 mod 256): READ 0x5266b thru 0x61b1b (0xf4b1 bytes) 2023-07-14T18:17:18.407 INFO:tasks.workunit.client.0.smithi163.stdout:5229(109 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.407 INFO:tasks.workunit.client.0.smithi163.stdout:5230(110 mod 256): FALLOC 0x3521c thru 0x4432b (0xf10f bytes) INTERIOR ******FFFF 2023-07-14T18:17:18.407 INFO:tasks.workunit.client.0.smithi163.stdout:5231(111 mod 256): TRUNCATE UP from 0xcb179 to 0xdaadc 2023-07-14T18:17:18.408 INFO:tasks.workunit.client.0.smithi163.stdout:5232(112 mod 256): PUNCH 0x567ad thru 0x5fd3d (0x9591 bytes) 2023-07-14T18:17:18.408 INFO:tasks.workunit.client.0.smithi163.stdout:5233(113 mod 256): FALLOC 0x4a20a thru 0x55e91 (0xbc87 bytes) INTERIOR 2023-07-14T18:17:18.408 INFO:tasks.workunit.client.0.smithi163.stdout:5234(114 mod 256): READ 0x638e3 thru 0x718d1 (0xdfef bytes) 2023-07-14T18:17:18.408 INFO:tasks.workunit.client.0.smithi163.stdout:5235(115 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.408 INFO:tasks.workunit.client.0.smithi163.stdout:5236(116 mod 256): TRUNCATE DOWN from 0xdaadc to 0x22b56 ******WWWW 2023-07-14T18:17:18.408 INFO:tasks.workunit.client.0.smithi163.stdout:5237(117 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.408 INFO:tasks.workunit.client.0.smithi163.stdout:5238(118 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.408 INFO:tasks.workunit.client.0.smithi163.stdout:5239(119 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.409 INFO:tasks.workunit.client.0.smithi163.stdout:5240(120 mod 256): TRUNCATE UP from 0x22b56 to 0x672a7 ******WWWW 2023-07-14T18:17:18.409 INFO:tasks.workunit.client.0.smithi163.stdout:5241(121 mod 256): WRITE 0x8f04d thru 0x903f1 (0x13a5 bytes) HOLE 2023-07-14T18:17:18.409 INFO:tasks.workunit.client.0.smithi163.stdout:5242(122 mod 256): MAPREAD 0x5a708 thru 0x61029 (0x6922 bytes) 2023-07-14T18:17:18.409 INFO:tasks.workunit.client.0.smithi163.stdout:5243(123 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.409 INFO:tasks.workunit.client.0.smithi163.stdout:5244(124 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.409 INFO:tasks.workunit.client.0.smithi163.stdout:5245(125 mod 256): TRUNCATE DOWN from 0x903f2 to 0x52274 2023-07-14T18:17:18.409 INFO:tasks.workunit.client.0.smithi163.stdout:5246(126 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.409 INFO:tasks.workunit.client.0.smithi163.stdout:5247(127 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.410 INFO:tasks.workunit.client.0.smithi163.stdout:5248(128 mod 256): PUNCH 0x40214 thru 0x42769 (0x2556 bytes) 2023-07-14T18:17:18.410 INFO:tasks.workunit.client.0.smithi163.stdout:5249(129 mod 256): READ 0x1afdd thru 0x20524 (0x5548 bytes) 2023-07-14T18:17:18.410 INFO:tasks.workunit.client.0.smithi163.stdout:5250(130 mod 256): MAPWRITE 0xdc78d thru 0xe759b (0xae0f bytes) 2023-07-14T18:17:18.410 INFO:tasks.workunit.client.0.smithi163.stdout:5251(131 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.410 INFO:tasks.workunit.client.0.smithi163.stdout:5252(132 mod 256): COPY 0x30f96 thru 0x35732 (0x479d bytes) to 0xbd770 thru 0xc1f0c 2023-07-14T18:17:18.410 INFO:tasks.workunit.client.0.smithi163.stdout:5253(133 mod 256): TRUNCATE DOWN from 0xe759c to 0x34e98 ******WWWW 2023-07-14T18:17:18.410 INFO:tasks.workunit.client.0.smithi163.stdout:5254(134 mod 256): COPY 0x20de4 thru 0x2cb93 (0xbdb0 bytes) to 0x98f39 thru 0xa4ce8 2023-07-14T18:17:18.410 INFO:tasks.workunit.client.0.smithi163.stdout:5255(135 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.411 INFO:tasks.workunit.client.0.smithi163.stdout:5256(136 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.411 INFO:tasks.workunit.client.0.smithi163.stdout:5257(137 mod 256): READ 0x3ba74 thru 0x49345 (0xd8d2 bytes) 2023-07-14T18:17:18.411 INFO:tasks.workunit.client.0.smithi163.stdout:5258(138 mod 256): MAPREAD 0x4b4e3 thru 0x5877e (0xd29c bytes) 2023-07-14T18:17:18.411 INFO:tasks.workunit.client.0.smithi163.stdout:5259(139 mod 256): MAPWRITE 0xf0151 thru 0xf28ba (0x276a bytes) 2023-07-14T18:17:18.411 INFO:tasks.workunit.client.0.smithi163.stdout:5260(140 mod 256): PUNCH 0x68ecb thru 0x6ccba (0x3df0 bytes) 2023-07-14T18:17:18.411 INFO:tasks.workunit.client.0.smithi163.stdout:5261(141 mod 256): MAPWRITE 0x4ace5 thru 0x540a1 (0x93bd bytes) 2023-07-14T18:17:18.411 INFO:tasks.workunit.client.0.smithi163.stdout:5262(142 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.411 INFO:tasks.workunit.client.0.smithi163.stdout:5263(143 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.412 INFO:tasks.workunit.client.0.smithi163.stdout:5264(144 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.412 INFO:tasks.workunit.client.0.smithi163.stdout:5265(145 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.412 INFO:tasks.workunit.client.0.smithi163.stdout:5266(146 mod 256): MAPREAD 0x9c7d1 thru 0xa0462 (0x3c92 bytes) 2023-07-14T18:17:18.412 INFO:tasks.workunit.client.0.smithi163.stdout:5267(147 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.412 INFO:tasks.workunit.client.0.smithi163.stdout:5268(148 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.412 INFO:tasks.workunit.client.0.smithi163.stdout:5269(149 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.412 INFO:tasks.workunit.client.0.smithi163.stdout:5270(150 mod 256): TRUNCATE DOWN from 0xf28bb to 0xb8c02 2023-07-14T18:17:18.412 INFO:tasks.workunit.client.0.smithi163.stdout:5271(151 mod 256): READ 0x69bae thru 0x75594 (0xb9e7 bytes) 2023-07-14T18:17:18.413 INFO:tasks.workunit.client.0.smithi163.stdout:5272(152 mod 256): WRITE 0xfc4c4 thru 0xfffff (0x3b3c bytes) HOLE 2023-07-14T18:17:18.413 INFO:tasks.workunit.client.0.smithi163.stdout:5273(153 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.413 INFO:tasks.workunit.client.0.smithi163.stdout:5274(154 mod 256): COPY 0x91140 thru 0x9de38 (0xccf9 bytes) to 0x5dfec thru 0x6ace4 2023-07-14T18:17:18.413 INFO:tasks.workunit.client.0.smithi163.stdout:5275(155 mod 256): MAPWRITE 0x63262 thru 0x68fab (0x5d4a bytes) 2023-07-14T18:17:18.413 INFO:tasks.workunit.client.0.smithi163.stdout:5276(156 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.413 INFO:tasks.workunit.client.0.smithi163.stdout:5277(157 mod 256): TRUNCATE DOWN from 0x100000 to 0x8c657 2023-07-14T18:17:18.413 INFO:tasks.workunit.client.0.smithi163.stdout:5278(158 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.413 INFO:tasks.workunit.client.0.smithi163.stdout:5279(159 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.414 INFO:tasks.workunit.client.0.smithi163.stdout:5280(160 mod 256): PUNCH 0x5f8a1 thru 0x65626 (0x5d86 bytes) 2023-07-14T18:17:18.414 INFO:tasks.workunit.client.0.smithi163.stdout:5281(161 mod 256): PUNCH 0x35991 thru 0x44aff (0xf16f bytes) ******PPPP 2023-07-14T18:17:18.414 INFO:tasks.workunit.client.0.smithi163.stdout:5282(162 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.414 INFO:tasks.workunit.client.0.smithi163.stdout:5283(163 mod 256): FALLOC 0x1590b thru 0x1b227 (0x591c bytes) INTERIOR 2023-07-14T18:17:18.414 INFO:tasks.workunit.client.0.smithi163.stdout:5284(164 mod 256): TRUNCATE DOWN from 0x8c657 to 0x53254 2023-07-14T18:17:18.414 INFO:tasks.workunit.client.0.smithi163.stdout:5285(165 mod 256): READ 0x42a66 thru 0x4cbd4 (0xa16f bytes) 2023-07-14T18:17:18.414 INFO:tasks.workunit.client.0.smithi163.stdout:5286(166 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.414 INFO:tasks.workunit.client.0.smithi163.stdout:5287(167 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.415 INFO:tasks.workunit.client.0.smithi163.stdout:5288(168 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.415 INFO:tasks.workunit.client.0.smithi163.stdout:5289(169 mod 256): FALLOC 0x2e4ac thru 0x3bb19 (0xd66d bytes) INTERIOR ******FFFF 2023-07-14T18:17:18.415 INFO:tasks.workunit.client.0.smithi163.stdout:5290(170 mod 256): TRUNCATE UP from 0x53254 to 0xe624e 2023-07-14T18:17:18.415 INFO:tasks.workunit.client.0.smithi163.stdout:5291(171 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.415 INFO:tasks.workunit.client.0.smithi163.stdout:5292(172 mod 256): READ 0xc69f thru 0x16918 (0xa27a bytes) 2023-07-14T18:17:18.415 INFO:tasks.workunit.client.0.smithi163.stdout:5293(173 mod 256): COPY 0xc4f9d thru 0xc5e15 (0xe79 bytes) to 0x8cf4b thru 0x8ddc3 2023-07-14T18:17:18.415 INFO:tasks.workunit.client.0.smithi163.stdout:5294(174 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.415 INFO:tasks.workunit.client.0.smithi163.stdout:5295(175 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.416 INFO:tasks.workunit.client.0.smithi163.stdout:5296(176 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.416 INFO:tasks.workunit.client.0.smithi163.stdout:5297(177 mod 256): WRITE 0xaed60 thru 0xb6375 (0x7616 bytes) 2023-07-14T18:17:18.416 INFO:tasks.workunit.client.0.smithi163.stdout:5298(178 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.416 INFO:tasks.workunit.client.0.smithi163.stdout:5299(179 mod 256): WRITE 0x1f1fc thru 0x2624a (0x704f bytes) 2023-07-14T18:17:18.416 INFO:tasks.workunit.client.0.smithi163.stdout:5300(180 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.416 INFO:tasks.workunit.client.0.smithi163.stdout:5301(181 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.416 INFO:tasks.workunit.client.0.smithi163.stdout:5302(182 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.416 INFO:tasks.workunit.client.0.smithi163.stdout:5303(183 mod 256): WRITE 0xc9c98 thru 0xd94df (0xf848 bytes) 2023-07-14T18:17:18.417 INFO:tasks.workunit.client.0.smithi163.stdout:5304(184 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.417 INFO:tasks.workunit.client.0.smithi163.stdout:5305(185 mod 256): MAPREAD 0x32bda thru 0x3bd0f (0x9136 bytes) ***RRRR*** 2023-07-14T18:17:18.417 INFO:tasks.workunit.client.0.smithi163.stdout:5306(186 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.417 INFO:tasks.workunit.client.0.smithi163.stdout:5307(187 mod 256): MAPREAD 0xce4b6 thru 0xd8888 (0xa3d3 bytes) 2023-07-14T18:17:18.417 INFO:tasks.workunit.client.0.smithi163.stdout:5308(188 mod 256): PUNCH 0x73d21 thru 0x77d37 (0x4017 bytes) 2023-07-14T18:17:18.417 INFO:tasks.workunit.client.0.smithi163.stdout:5309(189 mod 256): MAPWRITE 0x7025 thru 0xf3e0 (0x83bc bytes) 2023-07-14T18:17:18.417 INFO:tasks.workunit.client.0.smithi163.stdout:5310(190 mod 256): READ 0xcf139 thru 0xd6c5f (0x7b27 bytes) 2023-07-14T18:17:18.417 INFO:tasks.workunit.client.0.smithi163.stdout:5311(191 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.418 INFO:tasks.workunit.client.0.smithi163.stdout:5312(192 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.418 INFO:tasks.workunit.client.0.smithi163.stdout:5313(193 mod 256): WRITE 0x2ee06 thru 0x32a77 (0x3c72 bytes) 2023-07-14T18:17:18.418 INFO:tasks.workunit.client.0.smithi163.stdout:5314(194 mod 256): TRUNCATE DOWN from 0xe624e to 0xd67b ******WWWW 2023-07-14T18:17:18.418 INFO:tasks.workunit.client.0.smithi163.stdout:5315(195 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.418 INFO:tasks.workunit.client.0.smithi163.stdout:5316(196 mod 256): MAPREAD 0x4f50 thru 0xd67a (0x872b bytes) 2023-07-14T18:17:18.418 INFO:tasks.workunit.client.0.smithi163.stdout:5317(197 mod 256): PUNCH 0xabb3 thru 0xb6af (0xafd bytes) 2023-07-14T18:17:18.418 INFO:tasks.workunit.client.0.smithi163.stdout:5318(198 mod 256): TRUNCATE UP from 0xd67b to 0x94434 ******WWWW 2023-07-14T18:17:18.418 INFO:tasks.workunit.client.0.smithi163.stdout:5319(199 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.419 INFO:tasks.workunit.client.0.smithi163.stdout:5320(200 mod 256): FALLOC 0xb12d5 thru 0xbfab3 (0xe7de bytes) PAST_EOF 2023-07-14T18:17:18.419 INFO:tasks.workunit.client.0.smithi163.stdout:5321(201 mod 256): TRUNCATE DOWN from 0x94434 to 0x46605 2023-07-14T18:17:18.419 INFO:tasks.workunit.client.0.smithi163.stdout:5322(202 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.419 INFO:tasks.workunit.client.0.smithi163.stdout:5323(203 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.419 INFO:tasks.workunit.client.0.smithi163.stdout:5324(204 mod 256): COPY 0x220ff thru 0x236c2 (0x15c4 bytes) to 0x6dd01 thru 0x6f2c4 2023-07-14T18:17:18.419 INFO:tasks.workunit.client.0.smithi163.stdout:5325(205 mod 256): TRUNCATE DOWN from 0x6f2c5 to 0x42e2e 2023-07-14T18:17:18.419 INFO:tasks.workunit.client.0.smithi163.stdout:5326(206 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.419 INFO:tasks.workunit.client.0.smithi163.stdout:5327(207 mod 256): WRITE 0xd6224 thru 0xdfcc3 (0x9aa0 bytes) HOLE 2023-07-14T18:17:18.420 INFO:tasks.workunit.client.0.smithi163.stdout:5328(208 mod 256): COPY 0xcdff thru 0x17aad (0xacaf bytes) to 0xa86a0 thru 0xb334e 2023-07-14T18:17:18.420 INFO:tasks.workunit.client.0.smithi163.stdout:5329(209 mod 256): MAPWRITE 0xcc273 thru 0xd2517 (0x62a5 bytes) 2023-07-14T18:17:18.420 INFO:tasks.workunit.client.0.smithi163.stdout:5330(210 mod 256): MAPREAD 0xcf3d3 thru 0xd563d (0x626b bytes) 2023-07-14T18:17:18.420 INFO:tasks.workunit.client.0.smithi163.stdout:5331(211 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.420 INFO:tasks.workunit.client.0.smithi163.stdout:5332(212 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.420 INFO:tasks.workunit.client.0.smithi163.stdout:5333(213 mod 256): READ 0x470e1 thru 0x52f4a (0xbe6a bytes) 2023-07-14T18:17:18.420 INFO:tasks.workunit.client.0.smithi163.stdout:5334(214 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.420 INFO:tasks.workunit.client.0.smithi163.stdout:5335(215 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.421 INFO:tasks.workunit.client.0.smithi163.stdout:5336(216 mod 256): READ 0xd9a02 thru 0xdfcc3 (0x62c2 bytes) 2023-07-14T18:17:18.421 INFO:tasks.workunit.client.0.smithi163.stdout:5337(217 mod 256): MAPREAD 0xbb80e thru 0xc2395 (0x6b88 bytes) 2023-07-14T18:17:18.421 INFO:tasks.workunit.client.0.smithi163.stdout:5338(218 mod 256): MAPWRITE 0xfad91 thru 0xfffff (0x526f bytes) 2023-07-14T18:17:18.421 INFO:tasks.workunit.client.0.smithi163.stdout:5339(219 mod 256): PUNCH 0x2b068 thru 0x36aef (0xba88 bytes) 2023-07-14T18:17:18.421 INFO:tasks.workunit.client.0.smithi163.stdout:5340(220 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.421 INFO:tasks.workunit.client.0.smithi163.stdout:5341(221 mod 256): MAPREAD 0xed38a thru 0xf652e (0x91a5 bytes) 2023-07-14T18:17:18.421 INFO:tasks.workunit.client.0.smithi163.stdout:5342(222 mod 256): MAPWRITE 0x6c423 thru 0x6fb68 (0x3746 bytes) 2023-07-14T18:17:18.421 INFO:tasks.workunit.client.0.smithi163.stdout:5343(223 mod 256): TRUNCATE DOWN from 0x100000 to 0xee5df 2023-07-14T18:17:18.422 INFO:tasks.workunit.client.0.smithi163.stdout:5344(224 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.422 INFO:tasks.workunit.client.0.smithi163.stdout:5345(225 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.422 INFO:tasks.workunit.client.0.smithi163.stdout:5346(226 mod 256): READ 0x45ebf thru 0x480e2 (0x2224 bytes) 2023-07-14T18:17:18.422 INFO:tasks.workunit.client.0.smithi163.stdout:5347(227 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.422 INFO:tasks.workunit.client.0.smithi163.stdout:5348(228 mod 256): TRUNCATE DOWN from 0xee5df to 0x275f4 ******WWWW 2023-07-14T18:17:18.422 INFO:tasks.workunit.client.0.smithi163.stdout:5349(229 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.422 INFO:tasks.workunit.client.0.smithi163.stdout:5350(230 mod 256): WRITE 0x7cac3 thru 0x81c61 (0x519f bytes) HOLE ***WWWW 2023-07-14T18:17:18.422 INFO:tasks.workunit.client.0.smithi163.stdout:5351(231 mod 256): WRITE 0xfa1fe thru 0xfffff (0x5e02 bytes) HOLE 2023-07-14T18:17:18.423 INFO:tasks.workunit.client.0.smithi163.stdout:5352(232 mod 256): PUNCH 0x8204f thru 0x83b29 (0x1adb bytes) 2023-07-14T18:17:18.423 INFO:tasks.workunit.client.0.smithi163.stdout:5353(233 mod 256): TRUNCATE DOWN from 0x100000 to 0xcf6ac 2023-07-14T18:17:18.423 INFO:tasks.workunit.client.0.smithi163.stdout:5354(234 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.423 INFO:tasks.workunit.client.0.smithi163.stdout:5355(235 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.423 INFO:tasks.workunit.client.0.smithi163.stdout:5356(236 mod 256): COPY 0x21f96 thru 0x22876 (0x8e1 bytes) to 0xd89b5 thru 0xd9295 2023-07-14T18:17:18.423 INFO:tasks.workunit.client.0.smithi163.stdout:5357(237 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.423 INFO:tasks.workunit.client.0.smithi163.stdout:5358(238 mod 256): TRUNCATE DOWN from 0xd9296 to 0x43661 2023-07-14T18:17:18.423 INFO:tasks.workunit.client.0.smithi163.stdout:5359(239 mod 256): COPY 0x3131f thru 0x412ca (0xffac bytes) to 0xe253e thru 0xf24e9 EEEE****** 2023-07-14T18:17:18.424 INFO:tasks.workunit.client.0.smithi163.stdout:5360(240 mod 256): FALLOC 0x1f7fd thru 0x2d129 (0xd92c bytes) INTERIOR 2023-07-14T18:17:18.424 INFO:tasks.workunit.client.0.smithi163.stdout:5361(241 mod 256): COPY 0x23536 thru 0x2f6aa (0xc175 bytes) to 0x94446 thru 0xa05ba 2023-07-14T18:17:18.424 INFO:tasks.workunit.client.0.smithi163.stdout:5362(242 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.424 INFO:tasks.workunit.client.0.smithi163.stdout:5363(243 mod 256): COPY 0xd8139 thru 0xdd886 (0x574e bytes) to 0xf1244 thru 0xf6991 2023-07-14T18:17:18.424 INFO:tasks.workunit.client.0.smithi163.stdout:5364(244 mod 256): PUNCH 0xda734 thru 0xe593b (0xb208 bytes) 2023-07-14T18:17:18.424 INFO:tasks.workunit.client.0.smithi163.stdout:5365(245 mod 256): FALLOC 0xa18c9 thru 0xaff83 (0xe6ba bytes) INTERIOR 2023-07-14T18:17:18.424 INFO:tasks.workunit.client.0.smithi163.stdout:5366(246 mod 256): PUNCH 0xdc0be thru 0xdc912 (0x855 bytes) 2023-07-14T18:17:18.424 INFO:tasks.workunit.client.0.smithi163.stdout:5367(247 mod 256): FALLOC 0xb3a0c thru 0xbe129 (0xa71d bytes) INTERIOR 2023-07-14T18:17:18.425 INFO:tasks.workunit.client.0.smithi163.stdout:5368(248 mod 256): FALLOC 0x89bec thru 0x99592 (0xf9a6 bytes) INTERIOR 2023-07-14T18:17:18.425 INFO:tasks.workunit.client.0.smithi163.stdout:5369(249 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.425 INFO:tasks.workunit.client.0.smithi163.stdout:5370(250 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.425 INFO:tasks.workunit.client.0.smithi163.stdout:5371(251 mod 256): MAPWRITE 0x2fa6b thru 0x3e740 (0xecd6 bytes) ******WWWW 2023-07-14T18:17:18.425 INFO:tasks.workunit.client.0.smithi163.stdout:5372(252 mod 256): COPY 0xd5cb3 thru 0xe02d0 (0xa61e bytes) to 0x93fd0 thru 0x9e5ed 2023-07-14T18:17:18.425 INFO:tasks.workunit.client.0.smithi163.stdout:5373(253 mod 256): MAPREAD 0x95124 thru 0x9559e (0x47b bytes) 2023-07-14T18:17:18.425 INFO:tasks.workunit.client.0.smithi163.stdout:5374(254 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.425 INFO:tasks.workunit.client.0.smithi163.stdout:5375(255 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.426 INFO:tasks.workunit.client.0.smithi163.stdout:5376( 0 mod 256): MAPREAD 0xd92a0 thru 0xe60ab (0xce0c bytes) 2023-07-14T18:17:18.426 INFO:tasks.workunit.client.0.smithi163.stdout:5377( 1 mod 256): WRITE 0xe9714 thru 0xf793d (0xe22a bytes) EXTEND 2023-07-14T18:17:18.426 INFO:tasks.workunit.client.0.smithi163.stdout:5378( 2 mod 256): FALLOC 0x66146 thru 0x725d9 (0xc493 bytes) INTERIOR 2023-07-14T18:17:18.426 INFO:tasks.workunit.client.0.smithi163.stdout:5379( 3 mod 256): COPY 0x84d78 thru 0x8ea84 (0x9d0d bytes) to 0xd0feb thru 0xdacf7 2023-07-14T18:17:18.426 INFO:tasks.workunit.client.0.smithi163.stdout:5380( 4 mod 256): PUNCH 0x73ff thru 0x11d26 (0xa928 bytes) 2023-07-14T18:17:18.426 INFO:tasks.workunit.client.0.smithi163.stdout:5381( 5 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.426 INFO:tasks.workunit.client.0.smithi163.stdout:5382( 6 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.426 INFO:tasks.workunit.client.0.smithi163.stdout:5383( 7 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.427 INFO:tasks.workunit.client.0.smithi163.stdout:5384( 8 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.427 INFO:tasks.workunit.client.0.smithi163.stdout:5385( 9 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.427 INFO:tasks.workunit.client.0.smithi163.stdout:5386( 10 mod 256): READ 0x5ba07 thru 0x5cd89 (0x1383 bytes) 2023-07-14T18:17:18.427 INFO:tasks.workunit.client.0.smithi163.stdout:5387( 11 mod 256): TRUNCATE DOWN from 0xf793e to 0x4cc13 2023-07-14T18:17:18.427 INFO:tasks.workunit.client.0.smithi163.stdout:5388( 12 mod 256): FALLOC 0x9a14b thru 0x9c738 (0x25ed bytes) PAST_EOF 2023-07-14T18:17:18.427 INFO:tasks.workunit.client.0.smithi163.stdout:5389( 13 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.427 INFO:tasks.workunit.client.0.smithi163.stdout:5390( 14 mod 256): TRUNCATE UP from 0x4cc13 to 0xe6674 2023-07-14T18:17:18.427 INFO:tasks.workunit.client.0.smithi163.stdout:5391( 15 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.428 INFO:tasks.workunit.client.0.smithi163.stdout:5392( 16 mod 256): READ 0xc5bd2 thru 0xd15b4 (0xb9e3 bytes) 2023-07-14T18:17:18.428 INFO:tasks.workunit.client.0.smithi163.stdout:5393( 17 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.428 INFO:tasks.workunit.client.0.smithi163.stdout:5394( 18 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.428 INFO:tasks.workunit.client.0.smithi163.stdout:5395( 19 mod 256): WRITE 0x61607 thru 0x66a6d (0x5467 bytes) 2023-07-14T18:17:18.428 INFO:tasks.workunit.client.0.smithi163.stdout:5396( 20 mod 256): FALLOC 0x18f58 thru 0x24240 (0xb2e8 bytes) INTERIOR 2023-07-14T18:17:18.428 INFO:tasks.workunit.client.0.smithi163.stdout:5397( 21 mod 256): MAPWRITE 0xacfb8 thru 0xbaac5 (0xdb0e bytes) 2023-07-14T18:17:18.428 INFO:tasks.workunit.client.0.smithi163.stdout:5398( 22 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.428 INFO:tasks.workunit.client.0.smithi163.stdout:5399( 23 mod 256): TRUNCATE DOWN from 0xe6674 to 0x6305c 2023-07-14T18:17:18.429 INFO:tasks.workunit.client.0.smithi163.stdout:5400( 24 mod 256): COPY 0x2ee6d thru 0x35466 (0x65fa bytes) to 0xb6a62 thru 0xbd05b 2023-07-14T18:17:18.429 INFO:tasks.workunit.client.0.smithi163.stdout:5401( 25 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.429 INFO:tasks.workunit.client.0.smithi163.stdout:5402( 26 mod 256): TRUNCATE DOWN from 0xbd05c to 0x92aa8 2023-07-14T18:17:18.429 INFO:tasks.workunit.client.0.smithi163.stdout:5403( 27 mod 256): FALLOC 0x57455 thru 0x5db7a (0x6725 bytes) INTERIOR 2023-07-14T18:17:18.429 INFO:tasks.workunit.client.0.smithi163.stdout:5404( 28 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.429 INFO:tasks.workunit.client.0.smithi163.stdout:5405( 29 mod 256): READ 0x3301e thru 0x3d4b3 (0xa496 bytes) ***RRRR*** 2023-07-14T18:17:18.429 INFO:tasks.workunit.client.0.smithi163.stdout:5406( 30 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.429 INFO:tasks.workunit.client.0.smithi163.stdout:5407( 31 mod 256): COPY 0x6a205 thru 0x788c2 (0xe6be bytes) to 0xcdc0b thru 0xdc2c8 2023-07-14T18:17:18.430 INFO:tasks.workunit.client.0.smithi163.stdout:5408( 32 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.430 INFO:tasks.workunit.client.0.smithi163.stdout:5409( 33 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.430 INFO:tasks.workunit.client.0.smithi163.stdout:5410( 34 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.430 INFO:tasks.workunit.client.0.smithi163.stdout:5411( 35 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.430 INFO:tasks.workunit.client.0.smithi163.stdout:5412( 36 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.430 INFO:tasks.workunit.client.0.smithi163.stdout:5413( 37 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.430 INFO:tasks.workunit.client.0.smithi163.stdout:5414( 38 mod 256): MAPWRITE 0xb35e5 thru 0xc2912 (0xf32e bytes) 2023-07-14T18:17:18.430 INFO:tasks.workunit.client.0.smithi163.stdout:5415( 39 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.431 INFO:tasks.workunit.client.0.smithi163.stdout:5416( 40 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.431 INFO:tasks.workunit.client.0.smithi163.stdout:5417( 41 mod 256): COPY 0x6f0a5 thru 0x78665 (0x95c1 bytes) to 0x9b51f thru 0xa4adf 2023-07-14T18:17:18.431 INFO:tasks.workunit.client.0.smithi163.stdout:5418( 42 mod 256): COPY 0x632ca thru 0x69579 (0x62b0 bytes) to 0x196d1 thru 0x1f980 2023-07-14T18:17:18.431 INFO:tasks.workunit.client.0.smithi163.stdout:5419( 43 mod 256): MAPREAD 0x607a thru 0x15520 (0xf4a7 bytes) 2023-07-14T18:17:18.431 INFO:tasks.workunit.client.0.smithi163.stdout:5420( 44 mod 256): FALLOC 0x182c9 thru 0x1f680 (0x73b7 bytes) INTERIOR 2023-07-14T18:17:18.431 INFO:tasks.workunit.client.0.smithi163.stdout:5421( 45 mod 256): PUNCH 0x7132b thru 0x7639e (0x5074 bytes) 2023-07-14T18:17:18.431 INFO:tasks.workunit.client.0.smithi163.stdout:5422( 46 mod 256): READ 0x970cf thru 0xa0842 (0x9774 bytes) 2023-07-14T18:17:18.431 INFO:tasks.workunit.client.0.smithi163.stdout:5423( 47 mod 256): PUNCH 0xb305e thru 0xc0b3f (0xdae2 bytes) 2023-07-14T18:17:18.432 INFO:tasks.workunit.client.0.smithi163.stdout:5424( 48 mod 256): WRITE 0x56ebd thru 0x650df (0xe223 bytes) 2023-07-14T18:17:18.432 INFO:tasks.workunit.client.0.smithi163.stdout:5425( 49 mod 256): READ 0x8ea76 thru 0x99566 (0xaaf1 bytes) 2023-07-14T18:17:18.432 INFO:tasks.workunit.client.0.smithi163.stdout:5426( 50 mod 256): PUNCH 0x3c1a1 thru 0x43bc6 (0x7a26 bytes) 2023-07-14T18:17:18.432 INFO:tasks.workunit.client.0.smithi163.stdout:5427( 51 mod 256): MAPREAD 0xbe39 thru 0x162ae (0xa476 bytes) 2023-07-14T18:17:18.432 INFO:tasks.workunit.client.0.smithi163.stdout:5428( 52 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.432 INFO:tasks.workunit.client.0.smithi163.stdout:5429( 53 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.432 INFO:tasks.workunit.client.0.smithi163.stdout:5430( 54 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.432 INFO:tasks.workunit.client.0.smithi163.stdout:5431( 55 mod 256): MAPWRITE 0xde34a thru 0xed320 (0xefd7 bytes) 2023-07-14T18:17:18.433 INFO:tasks.workunit.client.0.smithi163.stdout:5432( 56 mod 256): COPY 0xd7129 thru 0xe2b7b (0xba53 bytes) to 0x29a8e thru 0x354e0 2023-07-14T18:17:18.433 INFO:tasks.workunit.client.0.smithi163.stdout:5433( 57 mod 256): MAPREAD 0x234c thru 0x4aed (0x27a2 bytes) 2023-07-14T18:17:18.433 INFO:tasks.workunit.client.0.smithi163.stdout:5434( 58 mod 256): READ 0xd9d4a thru 0xdaebe (0x1175 bytes) 2023-07-14T18:17:18.433 INFO:tasks.workunit.client.0.smithi163.stdout:5435( 59 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.433 INFO:tasks.workunit.client.0.smithi163.stdout:5436( 60 mod 256): MAPWRITE 0x8628c thru 0x934fa (0xd26f bytes) 2023-07-14T18:17:18.433 INFO:tasks.workunit.client.0.smithi163.stdout:5437( 61 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.433 INFO:tasks.workunit.client.0.smithi163.stdout:5438( 62 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.433 INFO:tasks.workunit.client.0.smithi163.stdout:5439( 63 mod 256): FALLOC 0x635d2 thru 0x676c1 (0x40ef bytes) INTERIOR 2023-07-14T18:17:18.434 INFO:tasks.workunit.client.0.smithi163.stdout:5440( 64 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.434 INFO:tasks.workunit.client.0.smithi163.stdout:5441( 65 mod 256): PUNCH 0x6298 thru 0x11e42 (0xbbab bytes) 2023-07-14T18:17:18.434 INFO:tasks.workunit.client.0.smithi163.stdout:5442( 66 mod 256): PUNCH 0xce4ad thru 0xd423a (0x5d8e bytes) 2023-07-14T18:17:18.434 INFO:tasks.workunit.client.0.smithi163.stdout:5443( 67 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.434 INFO:tasks.workunit.client.0.smithi163.stdout:5444( 68 mod 256): READ 0xe509d thru 0xed320 (0x8284 bytes) 2023-07-14T18:17:18.434 INFO:tasks.workunit.client.0.smithi163.stdout:5445( 69 mod 256): READ 0x5ec52 thru 0x635c5 (0x4974 bytes) 2023-07-14T18:17:18.434 INFO:tasks.workunit.client.0.smithi163.stdout:5446( 70 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.434 INFO:tasks.workunit.client.0.smithi163.stdout:5447( 71 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.435 INFO:tasks.workunit.client.0.smithi163.stdout:5448( 72 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.435 INFO:tasks.workunit.client.0.smithi163.stdout:5449( 73 mod 256): WRITE 0xe1c2d thru 0xe7b19 (0x5eed bytes) 2023-07-14T18:17:18.435 INFO:tasks.workunit.client.0.smithi163.stdout:5450( 74 mod 256): WRITE 0x4df45 thru 0x56d3f (0x8dfb bytes) 2023-07-14T18:17:18.435 INFO:tasks.workunit.client.0.smithi163.stdout:5451( 75 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.435 INFO:tasks.workunit.client.0.smithi163.stdout:5452( 76 mod 256): MAPREAD 0xcf54 thru 0x1ce7f (0xff2c bytes) 2023-07-14T18:17:18.435 INFO:tasks.workunit.client.0.smithi163.stdout:5453( 77 mod 256): MAPREAD 0x5c59a thru 0x673d4 (0xae3b bytes) 2023-07-14T18:17:18.435 INFO:tasks.workunit.client.0.smithi163.stdout:5454( 78 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.435 INFO:tasks.workunit.client.0.smithi163.stdout:5455( 79 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.436 INFO:tasks.workunit.client.0.smithi163.stdout:5456( 80 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.436 INFO:tasks.workunit.client.0.smithi163.stdout:5457( 81 mod 256): WRITE 0x82f9f thru 0x8d43b (0xa49d bytes) 2023-07-14T18:17:18.436 INFO:tasks.workunit.client.0.smithi163.stdout:5458( 82 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.436 INFO:tasks.workunit.client.0.smithi163.stdout:5459( 83 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.436 INFO:tasks.workunit.client.0.smithi163.stdout:5460( 84 mod 256): COPY 0xd54b7 thru 0xdb173 (0x5cbd bytes) to 0x731cc thru 0x78e88 2023-07-14T18:17:18.436 INFO:tasks.workunit.client.0.smithi163.stdout:5461( 85 mod 256): PUNCH 0x5a8bb thru 0x68ad1 (0xe217 bytes) 2023-07-14T18:17:18.436 INFO:tasks.workunit.client.0.smithi163.stdout:5462( 86 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.436 INFO:tasks.workunit.client.0.smithi163.stdout:5463( 87 mod 256): READ 0xb0b8d thru 0xb6572 (0x59e6 bytes) 2023-07-14T18:17:18.437 INFO:tasks.workunit.client.0.smithi163.stdout:5464( 88 mod 256): MAPWRITE 0xe26ad thru 0xf0083 (0xd9d7 bytes) 2023-07-14T18:17:18.437 INFO:tasks.workunit.client.0.smithi163.stdout:5465( 89 mod 256): READ 0x897ae thru 0x9055d (0x6db0 bytes) 2023-07-14T18:17:18.437 INFO:tasks.workunit.client.0.smithi163.stdout:5466( 90 mod 256): TRUNCATE DOWN from 0xf0084 to 0xbb0c7 2023-07-14T18:17:18.437 INFO:tasks.workunit.client.0.smithi163.stdout:5467( 91 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.437 INFO:tasks.workunit.client.0.smithi163.stdout:5468( 92 mod 256): WRITE 0xc6f41 thru 0xcb657 (0x4717 bytes) HOLE 2023-07-14T18:17:18.437 INFO:tasks.workunit.client.0.smithi163.stdout:5469( 93 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.437 INFO:tasks.workunit.client.0.smithi163.stdout:5470( 94 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.437 INFO:tasks.workunit.client.0.smithi163.stdout:5471( 95 mod 256): READ 0x28f21 thru 0x34085 (0xb165 bytes) 2023-07-14T18:17:18.438 INFO:tasks.workunit.client.0.smithi163.stdout:5472( 96 mod 256): COPY 0xa5020 thru 0xb1948 (0xc929 bytes) to 0x7d9b4 thru 0x8a2dc 2023-07-14T18:17:18.438 INFO:tasks.workunit.client.0.smithi163.stdout:5473( 97 mod 256): COPY 0x1f064 thru 0x23f21 (0x4ebe bytes) to 0x7115 thru 0xbfd2 2023-07-14T18:17:18.438 INFO:tasks.workunit.client.0.smithi163.stdout:5474( 98 mod 256): WRITE 0x9d623 thru 0xa3d2f (0x670d bytes) 2023-07-14T18:17:18.438 INFO:tasks.workunit.client.0.smithi163.stdout:5475( 99 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.438 INFO:tasks.workunit.client.0.smithi163.stdout:5476(100 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.438 INFO:tasks.workunit.client.0.smithi163.stdout:5477(101 mod 256): PUNCH 0xc6d36 thru 0xcb657 (0x4922 bytes) 2023-07-14T18:17:18.438 INFO:tasks.workunit.client.0.smithi163.stdout:5478(102 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.438 INFO:tasks.workunit.client.0.smithi163.stdout:5479(103 mod 256): FALLOC 0x4bca1 thru 0x4bee6 (0x245 bytes) INTERIOR 2023-07-14T18:17:18.439 INFO:tasks.workunit.client.0.smithi163.stdout:5480(104 mod 256): COPY 0x3ec78 thru 0x41787 (0x2b10 bytes) to 0xd2a06 thru 0xd5515 2023-07-14T18:17:18.439 INFO:tasks.workunit.client.0.smithi163.stdout:5481(105 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.439 INFO:tasks.workunit.client.0.smithi163.stdout:5482(106 mod 256): PUNCH 0x69c3e thru 0x6e5ea (0x49ad bytes) 2023-07-14T18:17:18.439 INFO:tasks.workunit.client.0.smithi163.stdout:5483(107 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.439 INFO:tasks.workunit.client.0.smithi163.stdout:5484(108 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.439 INFO:tasks.workunit.client.0.smithi163.stdout:5485(109 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.439 INFO:tasks.workunit.client.0.smithi163.stdout:5486(110 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.439 INFO:tasks.workunit.client.0.smithi163.stdout:5487(111 mod 256): READ 0x16cfd thru 0x22925 (0xbc29 bytes) 2023-07-14T18:17:18.440 INFO:tasks.workunit.client.0.smithi163.stdout:5488(112 mod 256): TRUNCATE DOWN from 0xd5516 to 0xa3b36 2023-07-14T18:17:18.440 INFO:tasks.workunit.client.0.smithi163.stdout:5489(113 mod 256): READ 0x4a6d0 thru 0x5675f (0xc090 bytes) 2023-07-14T18:17:18.440 INFO:tasks.workunit.client.0.smithi163.stdout:5490(114 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.440 INFO:tasks.workunit.client.0.smithi163.stdout:5491(115 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.440 INFO:tasks.workunit.client.0.smithi163.stdout:5492(116 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.440 INFO:tasks.workunit.client.0.smithi163.stdout:5493(117 mod 256): COPY 0x594c4 thru 0x5f537 (0x6074 bytes) to 0x3df3a thru 0x43fad 2023-07-14T18:17:18.440 INFO:tasks.workunit.client.0.smithi163.stdout:5494(118 mod 256): MAPWRITE 0x2dd8 thru 0x9733 (0x695c bytes) 2023-07-14T18:17:18.440 INFO:tasks.workunit.client.0.smithi163.stdout:5495(119 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.441 INFO:tasks.workunit.client.0.smithi163.stdout:5496(120 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.441 INFO:tasks.workunit.client.0.smithi163.stdout:5497(121 mod 256): PUNCH 0x8fdd4 thru 0x993fb (0x9628 bytes) 2023-07-14T18:17:18.441 INFO:tasks.workunit.client.0.smithi163.stdout:5498(122 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.441 INFO:tasks.workunit.client.0.smithi163.stdout:5499(123 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.441 INFO:tasks.workunit.client.0.smithi163.stdout:5500(124 mod 256): TRUNCATE DOWN from 0xa3b36 to 0x296c0 ******WWWW 2023-07-14T18:17:18.441 INFO:tasks.workunit.client.0.smithi163.stdout:5501(125 mod 256): READ 0x137ee thru 0x18b09 (0x531c bytes) 2023-07-14T18:17:18.441 INFO:tasks.workunit.client.0.smithi163.stdout:5502(126 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.441 INFO:tasks.workunit.client.0.smithi163.stdout:5503(127 mod 256): FALLOC 0x5090e thru 0x55918 (0x500a bytes) PAST_EOF 2023-07-14T18:17:18.442 INFO:tasks.workunit.client.0.smithi163.stdout:5504(128 mod 256): PUNCH 0x9b00 thru 0x1109e (0x759f bytes) 2023-07-14T18:17:18.442 INFO:tasks.workunit.client.0.smithi163.stdout:5505(129 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.442 INFO:tasks.workunit.client.0.smithi163.stdout:5506(130 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.442 INFO:tasks.workunit.client.0.smithi163.stdout:5507(131 mod 256): FALLOC 0x6f5d5 thru 0x7674a (0x7175 bytes) EXTENDING 2023-07-14T18:17:18.442 INFO:tasks.workunit.client.0.smithi163.stdout:5508(132 mod 256): PUNCH 0x4c6a3 thru 0x559f9 (0x9357 bytes) 2023-07-14T18:17:18.442 INFO:tasks.workunit.client.0.smithi163.stdout:5509(133 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.442 INFO:tasks.workunit.client.0.smithi163.stdout:5510(134 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.443 INFO:tasks.workunit.client.0.smithi163.stdout:5511(135 mod 256): COPY 0x1efc0 thru 0x2c3ea (0xd42b bytes) to 0x5b2c3 thru 0x686ed 2023-07-14T18:17:18.443 INFO:tasks.workunit.client.0.smithi163.stdout:5512(136 mod 256): WRITE 0xdc840 thru 0xdd6dd (0xe9e bytes) HOLE 2023-07-14T18:17:18.443 INFO:tasks.workunit.client.0.smithi163.stdout:5513(137 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.443 INFO:tasks.workunit.client.0.smithi163.stdout:5514(138 mod 256): MAPREAD 0x1627a thru 0x16510 (0x297 bytes) 2023-07-14T18:17:18.443 INFO:tasks.workunit.client.0.smithi163.stdout:5515(139 mod 256): TRUNCATE DOWN from 0xdd6de to 0xa7a51 2023-07-14T18:17:18.443 INFO:tasks.workunit.client.0.smithi163.stdout:5516(140 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.443 INFO:tasks.workunit.client.0.smithi163.stdout:5517(141 mod 256): FALLOC 0x6f912 thru 0x77470 (0x7b5e bytes) INTERIOR 2023-07-14T18:17:18.443 INFO:tasks.workunit.client.0.smithi163.stdout:5518(142 mod 256): READ 0x33f15 thru 0x3dc31 (0x9d1d bytes) ***RRRR*** 2023-07-14T18:17:18.444 INFO:tasks.workunit.client.0.smithi163.stdout:5519(143 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.444 INFO:tasks.workunit.client.0.smithi163.stdout:5520(144 mod 256): WRITE 0x2fca6 thru 0x3c225 (0xc580 bytes) ***WWWW 2023-07-14T18:17:18.444 INFO:tasks.workunit.client.0.smithi163.stdout:5521(145 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.444 INFO:tasks.workunit.client.0.smithi163.stdout:5522(146 mod 256): MAPREAD 0x533b8 thru 0x60b00 (0xd749 bytes) 2023-07-14T18:17:18.444 INFO:tasks.workunit.client.0.smithi163.stdout:5523(147 mod 256): FALLOC 0x299e8 thru 0x33920 (0x9f38 bytes) INTERIOR 2023-07-14T18:17:18.444 INFO:tasks.workunit.client.0.smithi163.stdout:5524(148 mod 256): MAPWRITE 0xe13b6 thru 0xedd38 (0xc983 bytes) 2023-07-14T18:17:18.444 INFO:tasks.workunit.client.0.smithi163.stdout:5525(149 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.445 INFO:tasks.workunit.client.0.smithi163.stdout:5526(150 mod 256): COPY 0xd85df thru 0xdedf6 (0x6818 bytes) to 0x1be3 thru 0x83fa 2023-07-14T18:17:18.445 INFO:tasks.workunit.client.0.smithi163.stdout:5527(151 mod 256): READ 0xc21ae thru 0xc3868 (0x16bb bytes) 2023-07-14T18:17:18.445 INFO:tasks.workunit.client.0.smithi163.stdout:5528(152 mod 256): WRITE 0x58a51 thru 0x5f70c (0x6cbc bytes) 2023-07-14T18:17:18.445 INFO:tasks.workunit.client.0.smithi163.stdout:5529(153 mod 256): READ 0x8bbe9 thru 0x94013 (0x842b bytes) 2023-07-14T18:17:18.445 INFO:tasks.workunit.client.0.smithi163.stdout:5530(154 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.445 INFO:tasks.workunit.client.0.smithi163.stdout:5531(155 mod 256): COPY 0xce32d thru 0xd354b (0x521f bytes) to 0xda71f thru 0xdf93d 2023-07-14T18:17:18.445 INFO:tasks.workunit.client.0.smithi163.stdout:5532(156 mod 256): PUNCH 0x80ec6 thru 0x8594d (0x4a88 bytes) 2023-07-14T18:17:18.445 INFO:tasks.workunit.client.0.smithi163.stdout:5533(157 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.446 INFO:tasks.workunit.client.0.smithi163.stdout:5534(158 mod 256): MAPREAD 0x53cac thru 0x58a87 (0x4ddc bytes) 2023-07-14T18:17:18.446 INFO:tasks.workunit.client.0.smithi163.stdout:5535(159 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.446 INFO:tasks.workunit.client.0.smithi163.stdout:5536(160 mod 256): MAPREAD 0xb0100 thru 0xbc036 (0xbf37 bytes) 2023-07-14T18:17:18.446 INFO:tasks.workunit.client.0.smithi163.stdout:5537(161 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.446 INFO:tasks.workunit.client.0.smithi163.stdout:5538(162 mod 256): MAPREAD 0xd43d5 thru 0xdbf66 (0x7b92 bytes) 2023-07-14T18:17:18.446 INFO:tasks.workunit.client.0.smithi163.stdout:5539(163 mod 256): COPY 0x687d7 thru 0x6f723 (0x6f4d bytes) to 0xb9c00 thru 0xc0b4c 2023-07-14T18:17:18.446 INFO:tasks.workunit.client.0.smithi163.stdout:5540(164 mod 256): WRITE 0xfbee0 thru 0xfffff (0x4120 bytes) HOLE 2023-07-14T18:17:18.446 INFO:tasks.workunit.client.0.smithi163.stdout:5541(165 mod 256): PUNCH 0xabfa8 thru 0xb3343 (0x739c bytes) 2023-07-14T18:17:18.447 INFO:tasks.workunit.client.0.smithi163.stdout:5542(166 mod 256): COPY 0x73920 thru 0x75163 (0x1844 bytes) to 0x15d68 thru 0x175ab 2023-07-14T18:17:18.447 INFO:tasks.workunit.client.0.smithi163.stdout:5543(167 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.447 INFO:tasks.workunit.client.0.smithi163.stdout:5544(168 mod 256): COPY 0xc5977 thru 0xd41d6 (0xe860 bytes) to 0xaebd7 thru 0xbd436 2023-07-14T18:17:18.447 INFO:tasks.workunit.client.0.smithi163.stdout:5545(169 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.447 INFO:tasks.workunit.client.0.smithi163.stdout:5546(170 mod 256): MAPWRITE 0xafab2 thru 0xbe600 (0xeb4f bytes) 2023-07-14T18:17:18.447 INFO:tasks.workunit.client.0.smithi163.stdout:5547(171 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.447 INFO:tasks.workunit.client.0.smithi163.stdout:5548(172 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.447 INFO:tasks.workunit.client.0.smithi163.stdout:5549(173 mod 256): FALLOC 0x9b92e thru 0xa35bd (0x7c8f bytes) INTERIOR 2023-07-14T18:17:18.448 INFO:tasks.workunit.client.0.smithi163.stdout:5550(174 mod 256): READ 0xb14fa thru 0xb3c30 (0x2737 bytes) 2023-07-14T18:17:18.448 INFO:tasks.workunit.client.0.smithi163.stdout:5551(175 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.448 INFO:tasks.workunit.client.0.smithi163.stdout:5552(176 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.448 INFO:tasks.workunit.client.0.smithi163.stdout:5553(177 mod 256): WRITE 0xbdf34 thru 0xc828c (0xa359 bytes) 2023-07-14T18:17:18.448 INFO:tasks.workunit.client.0.smithi163.stdout:5554(178 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.448 INFO:tasks.workunit.client.0.smithi163.stdout:5555(179 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.448 INFO:tasks.workunit.client.0.smithi163.stdout:5556(180 mod 256): FALLOC 0x3830d thru 0x46606 (0xe2f9 bytes) INTERIOR 2023-07-14T18:17:18.448 INFO:tasks.workunit.client.0.smithi163.stdout:5557(181 mod 256): MAPREAD 0x856b9 thru 0x8c0f6 (0x6a3e bytes) 2023-07-14T18:17:18.449 INFO:tasks.workunit.client.0.smithi163.stdout:5558(182 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.449 INFO:tasks.workunit.client.0.smithi163.stdout:5559(183 mod 256): WRITE 0xf4eab thru 0xfffff (0xb155 bytes) 2023-07-14T18:17:18.449 INFO:tasks.workunit.client.0.smithi163.stdout:5560(184 mod 256): COPY 0x930ec thru 0x9819c (0x50b1 bytes) to 0xe53cb thru 0xea47b 2023-07-14T18:17:18.449 INFO:tasks.workunit.client.0.smithi163.stdout:5561(185 mod 256): PUNCH 0x54947 thru 0x621af (0xd869 bytes) 2023-07-14T18:17:18.449 INFO:tasks.workunit.client.0.smithi163.stdout:5562(186 mod 256): FALLOC 0xe8186 thru 0xf2733 (0xa5ad bytes) INTERIOR 2023-07-14T18:17:18.449 INFO:tasks.workunit.client.0.smithi163.stdout:5563(187 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.449 INFO:tasks.workunit.client.0.smithi163.stdout:5564(188 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.449 INFO:tasks.workunit.client.0.smithi163.stdout:5565(189 mod 256): READ 0x552a5 thru 0x57f75 (0x2cd1 bytes) 2023-07-14T18:17:18.450 INFO:tasks.workunit.client.0.smithi163.stdout:5566(190 mod 256): MAPWRITE 0xe3454 thru 0xf06ef (0xd29c bytes) 2023-07-14T18:17:18.450 INFO:tasks.workunit.client.0.smithi163.stdout:5567(191 mod 256): MAPWRITE 0x4d7f1 thru 0x5491f (0x712f bytes) 2023-07-14T18:17:18.450 INFO:tasks.workunit.client.0.smithi163.stdout:5568(192 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.450 INFO:tasks.workunit.client.0.smithi163.stdout:5569(193 mod 256): MAPWRITE 0xa43e8 thru 0xa46da (0x2f3 bytes) 2023-07-14T18:17:18.450 INFO:tasks.workunit.client.0.smithi163.stdout:5570(194 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.450 INFO:tasks.workunit.client.0.smithi163.stdout:5571(195 mod 256): MAPWRITE 0x94583 thru 0x9d8ff (0x937d bytes) 2023-07-14T18:17:18.450 INFO:tasks.workunit.client.0.smithi163.stdout:5572(196 mod 256): COPY 0x11a1c thru 0x11c30 (0x215 bytes) to 0x68d80 thru 0x68f94 2023-07-14T18:17:18.450 INFO:tasks.workunit.client.0.smithi163.stdout:5573(197 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.451 INFO:tasks.workunit.client.0.smithi163.stdout:5574(198 mod 256): COPY 0xe63b1 thru 0xeea72 (0x86c2 bytes) to 0x10e8e thru 0x1954f 2023-07-14T18:17:18.451 INFO:tasks.workunit.client.0.smithi163.stdout:5575(199 mod 256): TRUNCATE DOWN from 0x100000 to 0x801b4 2023-07-14T18:17:18.451 INFO:tasks.workunit.client.0.smithi163.stdout:5576(200 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.451 INFO:tasks.workunit.client.0.smithi163.stdout:5577(201 mod 256): MAPREAD 0xabdc thru 0xbb0e (0xf33 bytes) 2023-07-14T18:17:18.451 INFO:tasks.workunit.client.0.smithi163.stdout:5578(202 mod 256): MAPWRITE 0x43c49 thru 0x46015 (0x23cd bytes) 2023-07-14T18:17:18.451 INFO:tasks.workunit.client.0.smithi163.stdout:5579(203 mod 256): READ 0x79516 thru 0x801b3 (0x6c9e bytes) 2023-07-14T18:17:18.451 INFO:tasks.workunit.client.0.smithi163.stdout:5580(204 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.451 INFO:tasks.workunit.client.0.smithi163.stdout:5581(205 mod 256): TRUNCATE DOWN from 0x801b4 to 0x61b6b 2023-07-14T18:17:18.452 INFO:tasks.workunit.client.0.smithi163.stdout:5582(206 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.452 INFO:tasks.workunit.client.0.smithi163.stdout:5583(207 mod 256): READ 0x4b549 thru 0x58648 (0xd100 bytes) 2023-07-14T18:17:18.452 INFO:tasks.workunit.client.0.smithi163.stdout:5584(208 mod 256): READ 0x159f7 thru 0x17759 (0x1d63 bytes) 2023-07-14T18:17:18.452 INFO:tasks.workunit.client.0.smithi163.stdout:5585(209 mod 256): MAPREAD 0x5b02e thru 0x61b6a (0x6b3d bytes) 2023-07-14T18:17:18.452 INFO:tasks.workunit.client.0.smithi163.stdout:5586(210 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.452 INFO:tasks.workunit.client.0.smithi163.stdout:5587(211 mod 256): FALLOC 0x965e5 thru 0x9f65a (0x9075 bytes) PAST_EOF 2023-07-14T18:17:18.452 INFO:tasks.workunit.client.0.smithi163.stdout:5588(212 mod 256): READ 0x389bd thru 0x44282 (0xb8c6 bytes) 2023-07-14T18:17:18.453 INFO:tasks.workunit.client.0.smithi163.stdout:5589(213 mod 256): PUNCH 0x56ead thru 0x58047 (0x119b bytes) 2023-07-14T18:17:18.453 INFO:tasks.workunit.client.0.smithi163.stdout:5590(214 mod 256): FALLOC 0x99ab thru 0x126d5 (0x8d2a bytes) INTERIOR 2023-07-14T18:17:18.453 INFO:tasks.workunit.client.0.smithi163.stdout:5591(215 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.453 INFO:tasks.workunit.client.0.smithi163.stdout:5592(216 mod 256): FALLOC 0xd6391 thru 0xdb926 (0x5595 bytes) EXTENDING 2023-07-14T18:17:18.453 INFO:tasks.workunit.client.0.smithi163.stdout:5593(217 mod 256): WRITE 0x3f24e thru 0x4613b (0x6eee bytes) 2023-07-14T18:17:18.453 INFO:tasks.workunit.client.0.smithi163.stdout:5594(218 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.453 INFO:tasks.workunit.client.0.smithi163.stdout:5595(219 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.453 INFO:tasks.workunit.client.0.smithi163.stdout:5596(220 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.454 INFO:tasks.workunit.client.0.smithi163.stdout:5597(221 mod 256): PUNCH 0x235a4 thru 0x27ee2 (0x493f bytes) 2023-07-14T18:17:18.454 INFO:tasks.workunit.client.0.smithi163.stdout:5598(222 mod 256): WRITE 0x4b43b thru 0x58ae7 (0xd6ad bytes) 2023-07-14T18:17:18.454 INFO:tasks.workunit.client.0.smithi163.stdout:5599(223 mod 256): READ 0x266e6 thru 0x2eab0 (0x83cb bytes) 2023-07-14T18:17:18.454 INFO:tasks.workunit.client.0.smithi163.stdout:5600(224 mod 256): MAPREAD 0x4122a thru 0x41312 (0xe9 bytes) 2023-07-14T18:17:18.454 INFO:tasks.workunit.client.0.smithi163.stdout:5601(225 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.454 INFO:tasks.workunit.client.0.smithi163.stdout:5602(226 mod 256): MAPWRITE 0x614a4 thru 0x71388 (0xfee5 bytes) 2023-07-14T18:17:18.454 INFO:tasks.workunit.client.0.smithi163.stdout:5603(227 mod 256): READ 0xbeda5 thru 0xc6b7e (0x7dda bytes) 2023-07-14T18:17:18.454 INFO:tasks.workunit.client.0.smithi163.stdout:5604(228 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.455 INFO:tasks.workunit.client.0.smithi163.stdout:5605(229 mod 256): READ 0x20bb thru 0xaae9 (0x8a2f bytes) 2023-07-14T18:17:18.455 INFO:tasks.workunit.client.0.smithi163.stdout:5606(230 mod 256): FALLOC 0x315e7 thru 0x354c1 (0x3eda bytes) INTERIOR 2023-07-14T18:17:18.455 INFO:tasks.workunit.client.0.smithi163.stdout:5607(231 mod 256): COPY 0xb31fa thru 0xb8a2b (0x5832 bytes) to 0xa494 thru 0xfcc5 2023-07-14T18:17:18.455 INFO:tasks.workunit.client.0.smithi163.stdout:5608(232 mod 256): MAPWRITE 0x83648 thru 0x8f059 (0xba12 bytes) 2023-07-14T18:17:18.455 INFO:tasks.workunit.client.0.smithi163.stdout:5609(233 mod 256): MAPREAD 0xaaa32 thru 0xb3b5e (0x912d bytes) 2023-07-14T18:17:18.455 INFO:tasks.workunit.client.0.smithi163.stdout:5610(234 mod 256): WRITE 0xc207b thru 0xc7126 (0x50ac bytes) 2023-07-14T18:17:18.455 INFO:tasks.workunit.client.0.smithi163.stdout:5611(235 mod 256): FALLOC 0x3972b thru 0x466fe (0xcfd3 bytes) INTERIOR 2023-07-14T18:17:18.455 INFO:tasks.workunit.client.0.smithi163.stdout:5612(236 mod 256): PUNCH 0xa0a85 thru 0xacbac (0xc128 bytes) 2023-07-14T18:17:18.456 INFO:tasks.workunit.client.0.smithi163.stdout:5613(237 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.456 INFO:tasks.workunit.client.0.smithi163.stdout:5614(238 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.456 INFO:tasks.workunit.client.0.smithi163.stdout:5615(239 mod 256): PUNCH 0x4a390 thru 0x5494b (0xa5bc bytes) 2023-07-14T18:17:18.456 INFO:tasks.workunit.client.0.smithi163.stdout:5616(240 mod 256): TRUNCATE DOWN from 0xdb926 to 0x34fc7 ******WWWW 2023-07-14T18:17:18.456 INFO:tasks.workunit.client.0.smithi163.stdout:5617(241 mod 256): TRUNCATE UP from 0x34fc7 to 0xa96cd ******WWWW 2023-07-14T18:17:18.456 INFO:tasks.workunit.client.0.smithi163.stdout:5618(242 mod 256): PUNCH 0x8beb6 thru 0x92c8a (0x6dd5 bytes) 2023-07-14T18:17:18.456 INFO:tasks.workunit.client.0.smithi163.stdout:5619(243 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.456 INFO:tasks.workunit.client.0.smithi163.stdout:5620(244 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.457 INFO:tasks.workunit.client.0.smithi163.stdout:5621(245 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.457 INFO:tasks.workunit.client.0.smithi163.stdout:5622(246 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.457 INFO:tasks.workunit.client.0.smithi163.stdout:5623(247 mod 256): PUNCH 0x60347 thru 0x6ece1 (0xe99b bytes) 2023-07-14T18:17:18.457 INFO:tasks.workunit.client.0.smithi163.stdout:5624(248 mod 256): PUNCH 0x8da8b thru 0x960fd (0x8673 bytes) 2023-07-14T18:17:18.457 INFO:tasks.workunit.client.0.smithi163.stdout:5625(249 mod 256): PUNCH 0x3569c thru 0x3aaa5 (0x540a bytes) ******PPPP 2023-07-14T18:17:18.457 INFO:tasks.workunit.client.0.smithi163.stdout:5626(250 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.457 INFO:tasks.workunit.client.0.smithi163.stdout:5627(251 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.457 INFO:tasks.workunit.client.0.smithi163.stdout:5628(252 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.458 INFO:tasks.workunit.client.0.smithi163.stdout:5629(253 mod 256): TRUNCATE DOWN from 0xa96cd to 0x96c8e 2023-07-14T18:17:18.458 INFO:tasks.workunit.client.0.smithi163.stdout:5630(254 mod 256): TRUNCATE DOWN from 0x96c8e to 0x194be ******WWWW 2023-07-14T18:17:18.458 INFO:tasks.workunit.client.0.smithi163.stdout:5631(255 mod 256): FALLOC 0x5b887 thru 0x625c6 (0x6d3f bytes) PAST_EOF 2023-07-14T18:17:18.458 INFO:tasks.workunit.client.0.smithi163.stdout:5632( 0 mod 256): MAPREAD 0xa374 thru 0x10637 (0x62c4 bytes) 2023-07-14T18:17:18.458 INFO:tasks.workunit.client.0.smithi163.stdout:5633( 1 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.458 INFO:tasks.workunit.client.0.smithi163.stdout:5634( 2 mod 256): FALLOC 0x2284c thru 0x32685 (0xfe39 bytes) EXTENDING 2023-07-14T18:17:18.458 INFO:tasks.workunit.client.0.smithi163.stdout:5635( 3 mod 256): PUNCH 0x8fca thru 0x13efc (0xaf33 bytes) 2023-07-14T18:17:18.458 INFO:tasks.workunit.client.0.smithi163.stdout:5636( 4 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.459 INFO:tasks.workunit.client.0.smithi163.stdout:5637( 5 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.459 INFO:tasks.workunit.client.0.smithi163.stdout:5638( 6 mod 256): READ 0x13ac8 thru 0x1bef4 (0x842d bytes) 2023-07-14T18:17:18.459 INFO:tasks.workunit.client.0.smithi163.stdout:5639( 7 mod 256): PUNCH 0x26f63 thru 0x32684 (0xb722 bytes) 2023-07-14T18:17:18.459 INFO:tasks.workunit.client.0.smithi163.stdout:5640( 8 mod 256): TRUNCATE UP from 0x32685 to 0xf76f8 ******WWWW 2023-07-14T18:17:18.459 INFO:tasks.workunit.client.0.smithi163.stdout:5641( 9 mod 256): TRUNCATE DOWN from 0xf76f8 to 0x2b37 ******WWWW 2023-07-14T18:17:18.459 INFO:tasks.workunit.client.0.smithi163.stdout:5642( 10 mod 256): FALLOC 0xa9b14 thru 0xaf2f1 (0x57dd bytes) EXTENDING 2023-07-14T18:17:18.459 INFO:tasks.workunit.client.0.smithi163.stdout:5643( 11 mod 256): MAPWRITE 0xb253b thru 0xb2601 (0xc7 bytes) 2023-07-14T18:17:18.459 INFO:tasks.workunit.client.0.smithi163.stdout:5644( 12 mod 256): COPY 0x8431f thru 0x8c843 (0x8525 bytes) to 0x92a79 thru 0x9af9d 2023-07-14T18:17:18.460 INFO:tasks.workunit.client.0.smithi163.stdout:5645( 13 mod 256): PUNCH 0x67f14 thru 0x727b2 (0xa89f bytes) 2023-07-14T18:17:18.460 INFO:tasks.workunit.client.0.smithi163.stdout:5646( 14 mod 256): PUNCH 0xa1995 thru 0xa40c7 (0x2733 bytes) 2023-07-14T18:17:18.460 INFO:tasks.workunit.client.0.smithi163.stdout:5647( 15 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.460 INFO:tasks.workunit.client.0.smithi163.stdout:5648( 16 mod 256): MAPREAD 0x1bf5f thru 0x1c581 (0x623 bytes) 2023-07-14T18:17:18.460 INFO:tasks.workunit.client.0.smithi163.stdout:5649( 17 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.460 INFO:tasks.workunit.client.0.smithi163.stdout:5650( 18 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.460 INFO:tasks.workunit.client.0.smithi163.stdout:5651( 19 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.460 INFO:tasks.workunit.client.0.smithi163.stdout:5652( 20 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.461 INFO:tasks.workunit.client.0.smithi163.stdout:5653( 21 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.461 INFO:tasks.workunit.client.0.smithi163.stdout:5654( 22 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.461 INFO:tasks.workunit.client.0.smithi163.stdout:5655( 23 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.461 INFO:tasks.workunit.client.0.smithi163.stdout:5656( 24 mod 256): MAPREAD 0x918db thru 0x9eb44 (0xd26a bytes) 2023-07-14T18:17:18.461 INFO:tasks.workunit.client.0.smithi163.stdout:5657( 25 mod 256): FALLOC 0x71b3c thru 0x747af (0x2c73 bytes) INTERIOR 2023-07-14T18:17:18.461 INFO:tasks.workunit.client.0.smithi163.stdout:5658( 26 mod 256): WRITE 0x7e6af thru 0x80306 (0x1c58 bytes) 2023-07-14T18:17:18.461 INFO:tasks.workunit.client.0.smithi163.stdout:5659( 27 mod 256): READ 0x30f60 thru 0x3d3ed (0xc48e bytes) ***RRRR*** 2023-07-14T18:17:18.461 INFO:tasks.workunit.client.0.smithi163.stdout:5660( 28 mod 256): PUNCH 0x36254 thru 0x42fa6 (0xcd53 bytes) ******PPPP 2023-07-14T18:17:18.462 INFO:tasks.workunit.client.0.smithi163.stdout:5661( 29 mod 256): PUNCH 0x8da19 thru 0x9d4ef (0xfad7 bytes) 2023-07-14T18:17:18.462 INFO:tasks.workunit.client.0.smithi163.stdout:5662( 30 mod 256): TRUNCATE DOWN from 0xb2602 to 0x5979e 2023-07-14T18:17:18.462 INFO:tasks.workunit.client.0.smithi163.stdout:5663( 31 mod 256): PUNCH 0x1f7ea thru 0x26d2e (0x7545 bytes) 2023-07-14T18:17:18.462 INFO:tasks.workunit.client.0.smithi163.stdout:5664( 32 mod 256): FALLOC 0x45ccb thru 0x4ecc1 (0x8ff6 bytes) INTERIOR 2023-07-14T18:17:18.462 INFO:tasks.workunit.client.0.smithi163.stdout:5665( 33 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.462 INFO:tasks.workunit.client.0.smithi163.stdout:5666( 34 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.462 INFO:tasks.workunit.client.0.smithi163.stdout:5667( 35 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.462 INFO:tasks.workunit.client.0.smithi163.stdout:5668( 36 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.463 INFO:tasks.workunit.client.0.smithi163.stdout:5669( 37 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.463 INFO:tasks.workunit.client.0.smithi163.stdout:5670( 38 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.463 INFO:tasks.workunit.client.0.smithi163.stdout:5671( 39 mod 256): READ 0x1829e thru 0x2533b (0xd09e bytes) 2023-07-14T18:17:18.463 INFO:tasks.workunit.client.0.smithi163.stdout:5672( 40 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.463 INFO:tasks.workunit.client.0.smithi163.stdout:5673( 41 mod 256): READ 0x4a99f thru 0x51f2a (0x758c bytes) 2023-07-14T18:17:18.463 INFO:tasks.workunit.client.0.smithi163.stdout:5674( 42 mod 256): MAPREAD 0x29218 thru 0x33078 (0x9e61 bytes) 2023-07-14T18:17:18.463 INFO:tasks.workunit.client.0.smithi163.stdout:5675( 43 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.463 INFO:tasks.workunit.client.0.smithi163.stdout:5676( 44 mod 256): WRITE 0x22ab3 thru 0x2b860 (0x8dae bytes) 2023-07-14T18:17:18.464 INFO:tasks.workunit.client.0.smithi163.stdout:5677( 45 mod 256): FALLOC 0x2eb3b thru 0x34d7b (0x6240 bytes) INTERIOR 2023-07-14T18:17:18.464 INFO:tasks.workunit.client.0.smithi163.stdout:5678( 46 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.464 INFO:tasks.workunit.client.0.smithi163.stdout:5679( 47 mod 256): READ 0xd1a0 thru 0x1a7d8 (0xd639 bytes) 2023-07-14T18:17:18.464 INFO:tasks.workunit.client.0.smithi163.stdout:5680( 48 mod 256): COPY 0x1e910 thru 0x23b14 (0x5205 bytes) to 0x825d5 thru 0x877d9 2023-07-14T18:17:18.464 INFO:tasks.workunit.client.0.smithi163.stdout:5681( 49 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.464 INFO:tasks.workunit.client.0.smithi163.stdout:5682( 50 mod 256): PUNCH 0x6b9c3 thru 0x792db (0xd919 bytes) 2023-07-14T18:17:18.464 INFO:tasks.workunit.client.0.smithi163.stdout:5683( 51 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.464 INFO:tasks.workunit.client.0.smithi163.stdout:5684( 52 mod 256): TRUNCATE DOWN from 0x877da to 0x37f54 ******WWWW 2023-07-14T18:17:18.465 INFO:tasks.workunit.client.0.smithi163.stdout:5685( 53 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.465 INFO:tasks.workunit.client.0.smithi163.stdout:5686( 54 mod 256): PUNCH 0x22ea5 thru 0x2a621 (0x777d bytes) 2023-07-14T18:17:18.465 INFO:tasks.workunit.client.0.smithi163.stdout:5687( 55 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.465 INFO:tasks.workunit.client.0.smithi163.stdout:5688( 56 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.465 INFO:tasks.workunit.client.0.smithi163.stdout:5689( 57 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.465 INFO:tasks.workunit.client.0.smithi163.stdout:5690( 58 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.465 INFO:tasks.workunit.client.0.smithi163.stdout:5691( 59 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.466 INFO:tasks.workunit.client.0.smithi163.stdout:5692( 60 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.466 INFO:tasks.workunit.client.0.smithi163.stdout:5693( 61 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.466 INFO:tasks.workunit.client.0.smithi163.stdout:5694( 62 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.466 INFO:tasks.workunit.client.0.smithi163.stdout:5695( 63 mod 256): TRUNCATE UP from 0x37f54 to 0x95514 ******WWWW 2023-07-14T18:17:18.466 INFO:tasks.workunit.client.0.smithi163.stdout:5696( 64 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.466 INFO:tasks.workunit.client.0.smithi163.stdout:5697( 65 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.466 INFO:tasks.workunit.client.0.smithi163.stdout:5698( 66 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.466 INFO:tasks.workunit.client.0.smithi163.stdout:5699( 67 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.467 INFO:tasks.workunit.client.0.smithi163.stdout:5700( 68 mod 256): MAPREAD 0x4792e thru 0x54a26 (0xd0f9 bytes) 2023-07-14T18:17:18.467 INFO:tasks.workunit.client.0.smithi163.stdout:5701( 69 mod 256): COPY 0x41fce thru 0x46f3e (0x4f71 bytes) to 0x92fb8 thru 0x97f28 2023-07-14T18:17:18.467 INFO:tasks.workunit.client.0.smithi163.stdout:5702( 70 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.467 INFO:tasks.workunit.client.0.smithi163.stdout:5703( 71 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.467 INFO:tasks.workunit.client.0.smithi163.stdout:5704( 72 mod 256): MAPWRITE 0xb3473 thru 0xc019e (0xcd2c bytes) 2023-07-14T18:17:18.467 INFO:tasks.workunit.client.0.smithi163.stdout:5705( 73 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.467 INFO:tasks.workunit.client.0.smithi163.stdout:5706( 74 mod 256): MAPWRITE 0xf8eba thru 0xfffff (0x7146 bytes) 2023-07-14T18:17:18.467 INFO:tasks.workunit.client.0.smithi163.stdout:5707( 75 mod 256): WRITE 0x9067b thru 0x9f8e1 (0xf267 bytes) 2023-07-14T18:17:18.468 INFO:tasks.workunit.client.0.smithi163.stdout:5708( 76 mod 256): COPY 0xf85e5 thru 0xfffff (0x7a1b bytes) to 0xd9f70 thru 0xe198a 2023-07-14T18:17:18.468 INFO:tasks.workunit.client.0.smithi163.stdout:5709( 77 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.468 INFO:tasks.workunit.client.0.smithi163.stdout:5710( 78 mod 256): PUNCH 0xbd58f thru 0xc4788 (0x71fa bytes) 2023-07-14T18:17:18.468 INFO:tasks.workunit.client.0.smithi163.stdout:5711( 79 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.468 INFO:tasks.workunit.client.0.smithi163.stdout:5712( 80 mod 256): TRUNCATE DOWN from 0x100000 to 0x14b29 ******WWWW 2023-07-14T18:17:18.468 INFO:tasks.workunit.client.0.smithi163.stdout:5713( 81 mod 256): MAPWRITE 0x5f470 thru 0x69dd3 (0xa964 bytes) 2023-07-14T18:17:18.468 INFO:tasks.workunit.client.0.smithi163.stdout:5714( 82 mod 256): PUNCH 0xeef3 thru 0x13211 (0x431f bytes) 2023-07-14T18:17:18.468 INFO:tasks.workunit.client.0.smithi163.stdout:5715( 83 mod 256): PUNCH 0x4c2af thru 0x586d6 (0xc428 bytes) 2023-07-14T18:17:18.469 INFO:tasks.workunit.client.0.smithi163.stdout:5716( 84 mod 256): PUNCH 0x3f0b3 thru 0x4a0ec (0xb03a bytes) 2023-07-14T18:17:18.469 INFO:tasks.workunit.client.0.smithi163.stdout:5717( 85 mod 256): FALLOC 0x6ad83 thru 0x73568 (0x87e5 bytes) EXTENDING 2023-07-14T18:17:18.469 INFO:tasks.workunit.client.0.smithi163.stdout:5718( 86 mod 256): WRITE 0xd0594 thru 0xdf7dc (0xf249 bytes) HOLE 2023-07-14T18:17:18.469 INFO:tasks.workunit.client.0.smithi163.stdout:5719( 87 mod 256): TRUNCATE UP from 0xdf7dd to 0xedf43 2023-07-14T18:17:18.469 INFO:tasks.workunit.client.0.smithi163.stdout:5720( 88 mod 256): TRUNCATE DOWN from 0xedf43 to 0xc7dbe 2023-07-14T18:17:18.469 INFO:tasks.workunit.client.0.smithi163.stdout:5721( 89 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.469 INFO:tasks.workunit.client.0.smithi163.stdout:5722( 90 mod 256): MAPWRITE 0xa949a thru 0xb7d51 (0xe8b8 bytes) 2023-07-14T18:17:18.469 INFO:tasks.workunit.client.0.smithi163.stdout:5723( 91 mod 256): MAPWRITE 0x16396 thru 0x222d9 (0xbf44 bytes) 2023-07-14T18:17:18.470 INFO:tasks.workunit.client.0.smithi163.stdout:5724( 92 mod 256): READ 0xb764e thru 0xb77c5 (0x178 bytes) 2023-07-14T18:17:18.470 INFO:tasks.workunit.client.0.smithi163.stdout:5725( 93 mod 256): MAPREAD 0x3d651 thru 0x49953 (0xc303 bytes) 2023-07-14T18:17:18.470 INFO:tasks.workunit.client.0.smithi163.stdout:5726( 94 mod 256): MAPREAD 0x66350 thru 0x709df (0xa690 bytes) 2023-07-14T18:17:18.470 INFO:tasks.workunit.client.0.smithi163.stdout:5727( 95 mod 256): MAPREAD 0x94a86 thru 0x992e1 (0x485c bytes) 2023-07-14T18:17:18.470 INFO:tasks.workunit.client.0.smithi163.stdout:5728( 96 mod 256): PUNCH 0x63a23 thru 0x67e94 (0x4472 bytes) 2023-07-14T18:17:18.470 INFO:tasks.workunit.client.0.smithi163.stdout:5729( 97 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.470 INFO:tasks.workunit.client.0.smithi163.stdout:5730( 98 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.470 INFO:tasks.workunit.client.0.smithi163.stdout:5731( 99 mod 256): TRUNCATE DOWN from 0xc7dbe to 0x57235 2023-07-14T18:17:18.471 INFO:tasks.workunit.client.0.smithi163.stdout:5732(100 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.471 INFO:tasks.workunit.client.0.smithi163.stdout:5733(101 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.471 INFO:tasks.workunit.client.0.smithi163.stdout:5734(102 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.471 INFO:tasks.workunit.client.0.smithi163.stdout:5735(103 mod 256): MAPWRITE 0xa1306 thru 0xa966c (0x8367 bytes) 2023-07-14T18:17:18.471 INFO:tasks.workunit.client.0.smithi163.stdout:5736(104 mod 256): TRUNCATE UP from 0xa966d to 0xb5916 2023-07-14T18:17:18.471 INFO:tasks.workunit.client.0.smithi163.stdout:5737(105 mod 256): READ 0x1bee thru 0xdfad (0xc3c0 bytes) 2023-07-14T18:17:18.471 INFO:tasks.workunit.client.0.smithi163.stdout:5738(106 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.471 INFO:tasks.workunit.client.0.smithi163.stdout:5739(107 mod 256): FALLOC 0x43a48 thru 0x530af (0xf667 bytes) INTERIOR 2023-07-14T18:17:18.472 INFO:tasks.workunit.client.0.smithi163.stdout:5740(108 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.472 INFO:tasks.workunit.client.0.smithi163.stdout:5741(109 mod 256): TRUNCATE UP from 0xb5916 to 0xdb44f 2023-07-14T18:17:18.472 INFO:tasks.workunit.client.0.smithi163.stdout:5742(110 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.472 INFO:tasks.workunit.client.0.smithi163.stdout:5743(111 mod 256): FALLOC 0x4b47 thru 0x1258e (0xda47 bytes) INTERIOR 2023-07-14T18:17:18.472 INFO:tasks.workunit.client.0.smithi163.stdout:5744(112 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.472 INFO:tasks.workunit.client.0.smithi163.stdout:5745(113 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.472 INFO:tasks.workunit.client.0.smithi163.stdout:5746(114 mod 256): MAPWRITE 0xd343f thru 0xdbcca (0x888c bytes) 2023-07-14T18:17:18.472 INFO:tasks.workunit.client.0.smithi163.stdout:5747(115 mod 256): READ 0xbcefc thru 0xc1b56 (0x4c5b bytes) 2023-07-14T18:17:18.473 INFO:tasks.workunit.client.0.smithi163.stdout:5748(116 mod 256): FALLOC 0xa9a9f thru 0xb74b5 (0xda16 bytes) INTERIOR 2023-07-14T18:17:18.473 INFO:tasks.workunit.client.0.smithi163.stdout:5749(117 mod 256): MAPWRITE 0x99589 thru 0x9fafd (0x6575 bytes) 2023-07-14T18:17:18.473 INFO:tasks.workunit.client.0.smithi163.stdout:5750(118 mod 256): MAPWRITE 0x1839b thru 0x1d750 (0x53b6 bytes) 2023-07-14T18:17:18.473 INFO:tasks.workunit.client.0.smithi163.stdout:5751(119 mod 256): TRUNCATE DOWN from 0xdbccb to 0x89282 2023-07-14T18:17:18.473 INFO:tasks.workunit.client.0.smithi163.stdout:5752(120 mod 256): PUNCH 0x24d03 thru 0x25047 (0x345 bytes) 2023-07-14T18:17:18.473 INFO:tasks.workunit.client.0.smithi163.stdout:5753(121 mod 256): FALLOC 0x6635b thru 0x6a5e0 (0x4285 bytes) INTERIOR 2023-07-14T18:17:18.473 INFO:tasks.workunit.client.0.smithi163.stdout:5754(122 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.473 INFO:tasks.workunit.client.0.smithi163.stdout:5755(123 mod 256): MAPREAD 0x18880 thru 0x22229 (0x99aa bytes) 2023-07-14T18:17:18.474 INFO:tasks.workunit.client.0.smithi163.stdout:5756(124 mod 256): PUNCH 0x5095c thru 0x58a32 (0x80d7 bytes) 2023-07-14T18:17:18.474 INFO:tasks.workunit.client.0.smithi163.stdout:5757(125 mod 256): COPY 0x324a2 thru 0x38845 (0x63a4 bytes) to 0x7bee7 thru 0x8228a EEEE****** 2023-07-14T18:17:18.474 INFO:tasks.workunit.client.0.smithi163.stdout:5758(126 mod 256): WRITE 0x2ca45 thru 0x347db (0x7d97 bytes) 2023-07-14T18:17:18.474 INFO:tasks.workunit.client.0.smithi163.stdout:5759(127 mod 256): TRUNCATE UP from 0x89282 to 0xb3d57 2023-07-14T18:17:18.474 INFO:tasks.workunit.client.0.smithi163.stdout:5760(128 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.474 INFO:tasks.workunit.client.0.smithi163.stdout:5761(129 mod 256): READ 0x22 thru 0xb33d (0xb31c bytes) 2023-07-14T18:17:18.474 INFO:tasks.workunit.client.0.smithi163.stdout:5762(130 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.474 INFO:tasks.workunit.client.0.smithi163.stdout:5763(131 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.475 INFO:tasks.workunit.client.0.smithi163.stdout:5764(132 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.475 INFO:tasks.workunit.client.0.smithi163.stdout:5765(133 mod 256): TRUNCATE UP from 0xb3d57 to 0xb835c 2023-07-14T18:17:18.475 INFO:tasks.workunit.client.0.smithi163.stdout:5766(134 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.475 INFO:tasks.workunit.client.0.smithi163.stdout:5767(135 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.475 INFO:tasks.workunit.client.0.smithi163.stdout:5768(136 mod 256): MAPWRITE 0x8bcc8 thru 0x8fda9 (0x40e2 bytes) 2023-07-14T18:17:18.475 INFO:tasks.workunit.client.0.smithi163.stdout:5769(137 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.475 INFO:tasks.workunit.client.0.smithi163.stdout:5770(138 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.475 INFO:tasks.workunit.client.0.smithi163.stdout:5771(139 mod 256): COPY 0x3792e thru 0x42d1a (0xb3ed bytes) to 0xe657a thru 0xf1966 EEEE****** 2023-07-14T18:17:18.476 INFO:tasks.workunit.client.0.smithi163.stdout:5772(140 mod 256): READ 0xc8acd thru 0xcd787 (0x4cbb bytes) 2023-07-14T18:17:18.476 INFO:tasks.workunit.client.0.smithi163.stdout:5773(141 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.476 INFO:tasks.workunit.client.0.smithi163.stdout:5774(142 mod 256): WRITE 0x70332 thru 0x78c14 (0x88e3 bytes) 2023-07-14T18:17:18.476 INFO:tasks.workunit.client.0.smithi163.stdout:5775(143 mod 256): PUNCH 0x599bd thru 0x689fc (0xf040 bytes) 2023-07-14T18:17:18.476 INFO:tasks.workunit.client.0.smithi163.stdout:5776(144 mod 256): COPY 0xb8c9a thru 0xbd255 (0x45bc bytes) to 0x76258 thru 0x7a813 2023-07-14T18:17:18.476 INFO:tasks.workunit.client.0.smithi163.stdout:5777(145 mod 256): READ 0xbbb44 thru 0xc48dc (0x8d99 bytes) 2023-07-14T18:17:18.476 INFO:tasks.workunit.client.0.smithi163.stdout:5778(146 mod 256): MAPWRITE 0xae5e7 thru 0xb834e (0x9d68 bytes) 2023-07-14T18:17:18.477 INFO:tasks.workunit.client.0.smithi163.stdout:5779(147 mod 256): WRITE 0xe771 thru 0x1d450 (0xece0 bytes) 2023-07-14T18:17:18.477 INFO:tasks.workunit.client.0.smithi163.stdout:5780(148 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.477 INFO:tasks.workunit.client.0.smithi163.stdout:5781(149 mod 256): WRITE 0x9ec82 thru 0xabf60 (0xd2df bytes) 2023-07-14T18:17:18.477 INFO:tasks.workunit.client.0.smithi163.stdout:5782(150 mod 256): PUNCH 0x1b558 thru 0x2a5dc (0xf085 bytes) 2023-07-14T18:17:18.477 INFO:tasks.workunit.client.0.smithi163.stdout:5783(151 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.477 INFO:tasks.workunit.client.0.smithi163.stdout:5784(152 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.477 INFO:tasks.workunit.client.0.smithi163.stdout:5785(153 mod 256): MAPWRITE 0x11c00 thru 0x19339 (0x773a bytes) 2023-07-14T18:17:18.477 INFO:tasks.workunit.client.0.smithi163.stdout:5786(154 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.478 INFO:tasks.workunit.client.0.smithi163.stdout:5787(155 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.478 INFO:tasks.workunit.client.0.smithi163.stdout:5788(156 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.478 INFO:tasks.workunit.client.0.smithi163.stdout:5789(157 mod 256): READ 0xa10bb thru 0xa10f5 (0x3b bytes) 2023-07-14T18:17:18.478 INFO:tasks.workunit.client.0.smithi163.stdout:5790(158 mod 256): COPY 0x401ff thru 0x4db48 (0xd94a bytes) to 0x9ee01 thru 0xac74a 2023-07-14T18:17:18.478 INFO:tasks.workunit.client.0.smithi163.stdout:5791(159 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.478 INFO:tasks.workunit.client.0.smithi163.stdout:5792(160 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.478 INFO:tasks.workunit.client.0.smithi163.stdout:5793(161 mod 256): PUNCH 0xceeae thru 0xd4b89 (0x5cdc bytes) 2023-07-14T18:17:18.478 INFO:tasks.workunit.client.0.smithi163.stdout:5794(162 mod 256): WRITE 0x141d7 thru 0x16e6b (0x2c95 bytes) 2023-07-14T18:17:18.479 INFO:tasks.workunit.client.0.smithi163.stdout:5795(163 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.479 INFO:tasks.workunit.client.0.smithi163.stdout:5796(164 mod 256): MAPREAD 0x86e39 thru 0x8a29c (0x3464 bytes) 2023-07-14T18:17:18.479 INFO:tasks.workunit.client.0.smithi163.stdout:5797(165 mod 256): WRITE 0x78081 thru 0x7a7e1 (0x2761 bytes) 2023-07-14T18:17:18.479 INFO:tasks.workunit.client.0.smithi163.stdout:5798(166 mod 256): PUNCH 0x83ab0 thru 0x92aff (0xf050 bytes) 2023-07-14T18:17:18.479 INFO:tasks.workunit.client.0.smithi163.stdout:5799(167 mod 256): READ 0x28a5a thru 0x37874 (0xee1b bytes) 2023-07-14T18:17:18.479 INFO:tasks.workunit.client.0.smithi163.stdout:5800(168 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.479 INFO:tasks.workunit.client.0.smithi163.stdout:5801(169 mod 256): TRUNCATE DOWN from 0xf1967 to 0xda689 2023-07-14T18:17:18.479 INFO:tasks.workunit.client.0.smithi163.stdout:5802(170 mod 256): READ 0xf848 thru 0x185da (0x8d93 bytes) 2023-07-14T18:17:18.479 INFO:tasks.workunit.client.0.smithi163.stdout:5803(171 mod 256): READ 0x5f638 thru 0x60d39 (0x1702 bytes) 2023-07-14T18:17:18.480 INFO:tasks.workunit.client.0.smithi163.stdout:5804(172 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.480 INFO:tasks.workunit.client.0.smithi163.stdout:5805(173 mod 256): COPY 0x73941 thru 0x765e6 (0x2ca6 bytes) to 0xeb1b4 thru 0xede59 2023-07-14T18:17:18.480 INFO:tasks.workunit.client.0.smithi163.stdout:5806(174 mod 256): READ 0x9b0f6 thru 0xa1a14 (0x691f bytes) 2023-07-14T18:17:18.480 INFO:tasks.workunit.client.0.smithi163.stdout:5807(175 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.480 INFO:tasks.workunit.client.0.smithi163.stdout:5808(176 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.480 INFO:tasks.workunit.client.0.smithi163.stdout:5809(177 mod 256): FALLOC 0x42ff4 thru 0x4bf4a (0x8f56 bytes) INTERIOR 2023-07-14T18:17:18.480 INFO:tasks.workunit.client.0.smithi163.stdout:5810(178 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.481 INFO:tasks.workunit.client.0.smithi163.stdout:5811(179 mod 256): PUNCH 0xbe5d0 thru 0xc86c2 (0xa0f3 bytes) 2023-07-14T18:17:18.481 INFO:tasks.workunit.client.0.smithi163.stdout:5812(180 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.481 INFO:tasks.workunit.client.0.smithi163.stdout:5813(181 mod 256): MAPREAD 0x2c923 thru 0x383e6 (0xbac4 bytes) ***RRRR*** 2023-07-14T18:17:18.481 INFO:tasks.workunit.client.0.smithi163.stdout:5814(182 mod 256): MAPWRITE 0x218a9 thru 0x284e4 (0x6c3c bytes) 2023-07-14T18:17:18.481 INFO:tasks.workunit.client.0.smithi163.stdout:5815(183 mod 256): MAPREAD 0x2e1c0 thru 0x34fb1 (0x6df2 bytes) 2023-07-14T18:17:18.481 INFO:tasks.workunit.client.0.smithi163.stdout:5816(184 mod 256): FALLOC 0x925c4 thru 0x9bcdd (0x9719 bytes) INTERIOR 2023-07-14T18:17:18.481 INFO:tasks.workunit.client.0.smithi163.stdout:5817(185 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.481 INFO:tasks.workunit.client.0.smithi163.stdout:5818(186 mod 256): FALLOC 0x2c8d7 thru 0x34c3e (0x8367 bytes) INTERIOR 2023-07-14T18:17:18.482 INFO:tasks.workunit.client.0.smithi163.stdout:5819(187 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.482 INFO:tasks.workunit.client.0.smithi163.stdout:5820(188 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.482 INFO:tasks.workunit.client.0.smithi163.stdout:5821(189 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.482 INFO:tasks.workunit.client.0.smithi163.stdout:5822(190 mod 256): PUNCH 0xd2874 thru 0xdaf48 (0x86d5 bytes) 2023-07-14T18:17:18.482 INFO:tasks.workunit.client.0.smithi163.stdout:5823(191 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.482 INFO:tasks.workunit.client.0.smithi163.stdout:5824(192 mod 256): MAPREAD 0xebe3a thru 0xede59 (0x2020 bytes) 2023-07-14T18:17:18.482 INFO:tasks.workunit.client.0.smithi163.stdout:5825(193 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.482 INFO:tasks.workunit.client.0.smithi163.stdout:5826(194 mod 256): FALLOC 0xf26cd thru 0xfe1c9 (0xbafc bytes) PAST_EOF 2023-07-14T18:17:18.483 INFO:tasks.workunit.client.0.smithi163.stdout:5827(195 mod 256): TRUNCATE DOWN from 0xede5a to 0xcccf0 2023-07-14T18:17:18.483 INFO:tasks.workunit.client.0.smithi163.stdout:5828(196 mod 256): PUNCH 0x6cbef thru 0x6e71f (0x1b31 bytes) 2023-07-14T18:17:18.483 INFO:tasks.workunit.client.0.smithi163.stdout:5829(197 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.483 INFO:tasks.workunit.client.0.smithi163.stdout:5830(198 mod 256): FALLOC 0xa07c5 thru 0xab95f (0xb19a bytes) INTERIOR 2023-07-14T18:17:18.483 INFO:tasks.workunit.client.0.smithi163.stdout:5831(199 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.483 INFO:tasks.workunit.client.0.smithi163.stdout:5832(200 mod 256): WRITE 0x54f43 thru 0x59e95 (0x4f53 bytes) 2023-07-14T18:17:18.483 INFO:tasks.workunit.client.0.smithi163.stdout:5833(201 mod 256): COPY 0x35a28 thru 0x37faa (0x2583 bytes) to 0x9e8f1 thru 0xa0e73 2023-07-14T18:17:18.483 INFO:tasks.workunit.client.0.smithi163.stdout:5834(202 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.483 INFO:tasks.workunit.client.0.smithi163.stdout:5835(203 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.484 INFO:tasks.workunit.client.0.smithi163.stdout:5836(204 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.484 INFO:tasks.workunit.client.0.smithi163.stdout:5837(205 mod 256): MAPWRITE 0x82528 thru 0x8be1f (0x98f8 bytes) 2023-07-14T18:17:18.484 INFO:tasks.workunit.client.0.smithi163.stdout:5838(206 mod 256): READ 0xb4f47 thru 0xc1fba (0xd074 bytes) 2023-07-14T18:17:18.484 INFO:tasks.workunit.client.0.smithi163.stdout:5839(207 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.484 INFO:tasks.workunit.client.0.smithi163.stdout:5840(208 mod 256): MAPREAD 0xade7d thru 0xb1133 (0x32b7 bytes) 2023-07-14T18:17:18.484 INFO:tasks.workunit.client.0.smithi163.stdout:5841(209 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.484 INFO:tasks.workunit.client.0.smithi163.stdout:5842(210 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.485 INFO:tasks.workunit.client.0.smithi163.stdout:5843(211 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.485 INFO:tasks.workunit.client.0.smithi163.stdout:5844(212 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.485 INFO:tasks.workunit.client.0.smithi163.stdout:5845(213 mod 256): TRUNCATE DOWN from 0xcccf0 to 0x1926 ******WWWW 2023-07-14T18:17:18.485 INFO:tasks.workunit.client.0.smithi163.stdout:5846(214 mod 256): WRITE 0xd425a thru 0xd8984 (0x472b bytes) HOLE ***WWWW 2023-07-14T18:17:18.485 INFO:tasks.workunit.client.0.smithi163.stdout:5847(215 mod 256): PUNCH 0x1e0cf thru 0x21cb0 (0x3be2 bytes) 2023-07-14T18:17:18.485 INFO:tasks.workunit.client.0.smithi163.stdout:5848(216 mod 256): WRITE 0x77d1d thru 0x7e89b (0x6b7f bytes) 2023-07-14T18:17:18.485 INFO:tasks.workunit.client.0.smithi163.stdout:5849(217 mod 256): PUNCH 0x45242 thru 0x4cb9a (0x7959 bytes) 2023-07-14T18:17:18.485 INFO:tasks.workunit.client.0.smithi163.stdout:5850(218 mod 256): PUNCH 0x5edbe thru 0x5f1e4 (0x427 bytes) 2023-07-14T18:17:18.486 INFO:tasks.workunit.client.0.smithi163.stdout:5851(219 mod 256): TRUNCATE DOWN from 0xd8985 to 0x28baf ******WWWW 2023-07-14T18:17:18.486 INFO:tasks.workunit.client.0.smithi163.stdout:5852(220 mod 256): MAPREAD 0x6239 thru 0x659c (0x364 bytes) 2023-07-14T18:17:18.486 INFO:tasks.workunit.client.0.smithi163.stdout:5853(221 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.486 INFO:tasks.workunit.client.0.smithi163.stdout:5854(222 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.486 INFO:tasks.workunit.client.0.smithi163.stdout:5855(223 mod 256): MAPREAD 0x6698 thru 0x8079 (0x19e2 bytes) 2023-07-14T18:17:18.486 INFO:tasks.workunit.client.0.smithi163.stdout:5856(224 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.486 INFO:tasks.workunit.client.0.smithi163.stdout:5857(225 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.486 INFO:tasks.workunit.client.0.smithi163.stdout:5858(226 mod 256): TRUNCATE UP from 0x28baf to 0x5824b ******WWWW 2023-07-14T18:17:18.487 INFO:tasks.workunit.client.0.smithi163.stdout:5859(227 mod 256): READ 0x25072 thru 0x26f69 (0x1ef8 bytes) 2023-07-14T18:17:18.487 INFO:tasks.workunit.client.0.smithi163.stdout:5860(228 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.487 INFO:tasks.workunit.client.0.smithi163.stdout:5861(229 mod 256): FALLOC 0x2879a thru 0x311fa (0x8a60 bytes) INTERIOR 2023-07-14T18:17:18.487 INFO:tasks.workunit.client.0.smithi163.stdout:5862(230 mod 256): TRUNCATE UP from 0x5824b to 0xc4264 2023-07-14T18:17:18.487 INFO:tasks.workunit.client.0.smithi163.stdout:5863(231 mod 256): PUNCH 0x9c2e7 thru 0x9f194 (0x2eae bytes) 2023-07-14T18:17:18.487 INFO:tasks.workunit.client.0.smithi163.stdout:5864(232 mod 256): READ 0x497b2 thru 0x4e506 (0x4d55 bytes) 2023-07-14T18:17:18.487 INFO:tasks.workunit.client.0.smithi163.stdout:5865(233 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.487 INFO:tasks.workunit.client.0.smithi163.stdout:5866(234 mod 256): MAPREAD 0x6b126 thru 0x75323 (0xa1fe bytes) 2023-07-14T18:17:18.488 INFO:tasks.workunit.client.0.smithi163.stdout:5867(235 mod 256): WRITE 0xd2c3f thru 0xd8d5e (0x6120 bytes) HOLE 2023-07-14T18:17:18.488 INFO:tasks.workunit.client.0.smithi163.stdout:5868(236 mod 256): COPY 0xb39f1 thru 0xbeb04 (0xb114 bytes) to 0xf4061 thru 0xff174 2023-07-14T18:17:18.488 INFO:tasks.workunit.client.0.smithi163.stdout:5869(237 mod 256): TRUNCATE DOWN from 0xff175 to 0x5dca4 2023-07-14T18:17:18.488 INFO:tasks.workunit.client.0.smithi163.stdout:5870(238 mod 256): FALLOC 0x3163d thru 0x31a03 (0x3c6 bytes) INTERIOR 2023-07-14T18:17:18.488 INFO:tasks.workunit.client.0.smithi163.stdout:5871(239 mod 256): FALLOC 0x9daa9 thru 0xa2fb5 (0x550c bytes) PAST_EOF 2023-07-14T18:17:18.488 INFO:tasks.workunit.client.0.smithi163.stdout:5872(240 mod 256): COPY 0x56025 thru 0x5622f (0x20b bytes) to 0x62f26 thru 0x63130 2023-07-14T18:17:18.488 INFO:tasks.workunit.client.0.smithi163.stdout:5873(241 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.488 INFO:tasks.workunit.client.0.smithi163.stdout:5874(242 mod 256): TRUNCATE UP from 0x63131 to 0x9ac38 2023-07-14T18:17:18.489 INFO:tasks.workunit.client.0.smithi163.stdout:5875(243 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.489 INFO:tasks.workunit.client.0.smithi163.stdout:5876(244 mod 256): MAPWRITE 0x775d6 thru 0x7ec90 (0x76bb bytes) 2023-07-14T18:17:18.489 INFO:tasks.workunit.client.0.smithi163.stdout:5877(245 mod 256): WRITE 0x3d2c7 thru 0x4cbb1 (0xf8eb bytes) 2023-07-14T18:17:18.489 INFO:tasks.workunit.client.0.smithi163.stdout:5878(246 mod 256): MAPWRITE 0xfbe7e thru 0xfffff (0x4182 bytes) 2023-07-14T18:17:18.489 INFO:tasks.workunit.client.0.smithi163.stdout:5879(247 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.489 INFO:tasks.workunit.client.0.smithi163.stdout:5880(248 mod 256): FALLOC 0xae1d0 thru 0xb80f0 (0x9f20 bytes) INTERIOR 2023-07-14T18:17:18.489 INFO:tasks.workunit.client.0.smithi163.stdout:5881(249 mod 256): COPY 0xbeaf1 thru 0xc7921 (0x8e31 bytes) to 0x9e17a thru 0xa6faa 2023-07-14T18:17:18.489 INFO:tasks.workunit.client.0.smithi163.stdout:5882(250 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.490 INFO:tasks.workunit.client.0.smithi163.stdout:5883(251 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.490 INFO:tasks.workunit.client.0.smithi163.stdout:5884(252 mod 256): MAPREAD 0x5cd98 thru 0x64f92 (0x81fb bytes) 2023-07-14T18:17:18.490 INFO:tasks.workunit.client.0.smithi163.stdout:5885(253 mod 256): COPY 0xf4986 thru 0xfe4cc (0x9b47 bytes) to 0xbeff5 thru 0xc8b3b 2023-07-14T18:17:18.490 INFO:tasks.workunit.client.0.smithi163.stdout:5886(254 mod 256): FALLOC 0xc7404 thru 0xcd0f8 (0x5cf4 bytes) INTERIOR 2023-07-14T18:17:18.490 INFO:tasks.workunit.client.0.smithi163.stdout:5887(255 mod 256): PUNCH 0x26ed1 thru 0x2afcd (0x40fd bytes) 2023-07-14T18:17:18.490 INFO:tasks.workunit.client.0.smithi163.stdout:5888( 0 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.490 INFO:tasks.workunit.client.0.smithi163.stdout:5889( 1 mod 256): COPY 0xcd843 thru 0xcfc3b (0x23f9 bytes) to 0xfceff thru 0xff2f7 2023-07-14T18:17:18.490 INFO:tasks.workunit.client.0.smithi163.stdout:5890( 2 mod 256): WRITE 0xe1da8 thru 0xe7a83 (0x5cdc bytes) 2023-07-14T18:17:18.491 INFO:tasks.workunit.client.0.smithi163.stdout:5891( 3 mod 256): PUNCH 0x89459 thru 0x8cf8c (0x3b34 bytes) 2023-07-14T18:17:18.491 INFO:tasks.workunit.client.0.smithi163.stdout:5892( 4 mod 256): FALLOC 0x60e4d thru 0x70180 (0xf333 bytes) INTERIOR 2023-07-14T18:17:18.491 INFO:tasks.workunit.client.0.smithi163.stdout:5893( 5 mod 256): MAPREAD 0x1fd53 thru 0x221c7 (0x2475 bytes) 2023-07-14T18:17:18.491 INFO:tasks.workunit.client.0.smithi163.stdout:5894( 6 mod 256): PUNCH 0x16c57 thru 0x230d3 (0xc47d bytes) 2023-07-14T18:17:18.491 INFO:tasks.workunit.client.0.smithi163.stdout:5895( 7 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.491 INFO:tasks.workunit.client.0.smithi163.stdout:5896( 8 mod 256): MAPREAD 0xf951a thru 0xfe16d (0x4c54 bytes) 2023-07-14T18:17:18.491 INFO:tasks.workunit.client.0.smithi163.stdout:5897( 9 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.491 INFO:tasks.workunit.client.0.smithi163.stdout:5898( 10 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.492 INFO:tasks.workunit.client.0.smithi163.stdout:5899( 11 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.492 INFO:tasks.workunit.client.0.smithi163.stdout:5900( 12 mod 256): FALLOC 0x5e959 thru 0x6c9fd (0xe0a4 bytes) INTERIOR 2023-07-14T18:17:18.492 INFO:tasks.workunit.client.0.smithi163.stdout:5901( 13 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.492 INFO:tasks.workunit.client.0.smithi163.stdout:5902( 14 mod 256): MAPREAD 0xb5b12 thru 0xbd7cd (0x7cbc bytes) 2023-07-14T18:17:18.492 INFO:tasks.workunit.client.0.smithi163.stdout:5903( 15 mod 256): TRUNCATE DOWN from 0x100000 to 0xf47b3 2023-07-14T18:17:18.492 INFO:tasks.workunit.client.0.smithi163.stdout:5904( 16 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.492 INFO:tasks.workunit.client.0.smithi163.stdout:5905( 17 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.492 INFO:tasks.workunit.client.0.smithi163.stdout:5906( 18 mod 256): MAPREAD 0x3d7d5 thru 0x3fe42 (0x266e bytes) 2023-07-14T18:17:18.493 INFO:tasks.workunit.client.0.smithi163.stdout:5907( 19 mod 256): MAPWRITE 0x8dd5e thru 0x91be8 (0x3e8b bytes) 2023-07-14T18:17:18.493 INFO:tasks.workunit.client.0.smithi163.stdout:5908( 20 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.493 INFO:tasks.workunit.client.0.smithi163.stdout:5909( 21 mod 256): READ 0xd1dd6 thru 0xe15df (0xf80a bytes) 2023-07-14T18:17:18.493 INFO:tasks.workunit.client.0.smithi163.stdout:5910( 22 mod 256): READ 0xa52d4 thru 0xab8f0 (0x661d bytes) 2023-07-14T18:17:18.493 INFO:tasks.workunit.client.0.smithi163.stdout:5911( 23 mod 256): READ 0x4e77f thru 0x5531e (0x6ba0 bytes) 2023-07-14T18:17:18.493 INFO:tasks.workunit.client.0.smithi163.stdout:5912( 24 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.493 INFO:tasks.workunit.client.0.smithi163.stdout:5913( 25 mod 256): FALLOC 0x1b326 thru 0x1e31c (0x2ff6 bytes) INTERIOR 2023-07-14T18:17:18.493 INFO:tasks.workunit.client.0.smithi163.stdout:5914( 26 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.494 INFO:tasks.workunit.client.0.smithi163.stdout:5915( 27 mod 256): MAPREAD 0xd503c thru 0xd633f (0x1304 bytes) 2023-07-14T18:17:18.494 INFO:tasks.workunit.client.0.smithi163.stdout:5916( 28 mod 256): MAPWRITE 0xc4234 thru 0xcc057 (0x7e24 bytes) 2023-07-14T18:17:18.494 INFO:tasks.workunit.client.0.smithi163.stdout:5917( 29 mod 256): PUNCH 0x74808 thru 0x75c7c (0x1475 bytes) 2023-07-14T18:17:18.494 INFO:tasks.workunit.client.0.smithi163.stdout:5918( 30 mod 256): WRITE 0x2a14e thru 0x312e8 (0x719b bytes) 2023-07-14T18:17:18.494 INFO:tasks.workunit.client.0.smithi163.stdout:5919( 31 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.494 INFO:tasks.workunit.client.0.smithi163.stdout:5920( 32 mod 256): FALLOC 0x75dac thru 0x8327e (0xd4d2 bytes) INTERIOR 2023-07-14T18:17:18.494 INFO:tasks.workunit.client.0.smithi163.stdout:5921( 33 mod 256): TRUNCATE DOWN from 0xf47b3 to 0x95cb5 2023-07-14T18:17:18.494 INFO:tasks.workunit.client.0.smithi163.stdout:5922( 34 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.495 INFO:tasks.workunit.client.0.smithi163.stdout:5923( 35 mod 256): WRITE 0x94b7c thru 0x959d7 (0xe5c bytes) 2023-07-14T18:17:18.495 INFO:tasks.workunit.client.0.smithi163.stdout:5924( 36 mod 256): COPY 0x71038 thru 0x71722 (0x6eb bytes) to 0x6207 thru 0x68f1 2023-07-14T18:17:18.495 INFO:tasks.workunit.client.0.smithi163.stdout:5925( 37 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.495 INFO:tasks.workunit.client.0.smithi163.stdout:5926( 38 mod 256): MAPWRITE 0xea902 thru 0xf9e1a (0xf519 bytes) 2023-07-14T18:17:18.495 INFO:tasks.workunit.client.0.smithi163.stdout:5927( 39 mod 256): COPY 0xf3c5e thru 0xf98b9 (0x5c5c bytes) to 0xcbfa4 thru 0xd1bff 2023-07-14T18:17:18.495 INFO:tasks.workunit.client.0.smithi163.stdout:5928( 40 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.495 INFO:tasks.workunit.client.0.smithi163.stdout:5929( 41 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.495 INFO:tasks.workunit.client.0.smithi163.stdout:5930( 42 mod 256): MAPWRITE 0x1d74b thru 0x28a2f (0xb2e5 bytes) 2023-07-14T18:17:18.496 INFO:tasks.workunit.client.0.smithi163.stdout:5931( 43 mod 256): READ 0x6d65f thru 0x752d8 (0x7c7a bytes) 2023-07-14T18:17:18.496 INFO:tasks.workunit.client.0.smithi163.stdout:5932( 44 mod 256): COPY 0x557e4 thru 0x5e82c (0x9049 bytes) to 0x51fb thru 0xe243 2023-07-14T18:17:18.496 INFO:tasks.workunit.client.0.smithi163.stdout:5933( 45 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.496 INFO:tasks.workunit.client.0.smithi163.stdout:5934( 46 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.496 INFO:tasks.workunit.client.0.smithi163.stdout:5935( 47 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.496 INFO:tasks.workunit.client.0.smithi163.stdout:5936( 48 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.496 INFO:tasks.workunit.client.0.smithi163.stdout:5937( 49 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.496 INFO:tasks.workunit.client.0.smithi163.stdout:5938( 50 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.497 INFO:tasks.workunit.client.0.smithi163.stdout:5939( 51 mod 256): PUNCH 0xcd7e0 thru 0xd9b95 (0xc3b6 bytes) 2023-07-14T18:17:18.497 INFO:tasks.workunit.client.0.smithi163.stdout:5940( 52 mod 256): TRUNCATE DOWN from 0xf9e1b to 0x7b3bb 2023-07-14T18:17:18.497 INFO:tasks.workunit.client.0.smithi163.stdout:5941( 53 mod 256): MAPWRITE 0xbc297 thru 0xbf6dd (0x3447 bytes) 2023-07-14T18:17:18.497 INFO:tasks.workunit.client.0.smithi163.stdout:5942( 54 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.497 INFO:tasks.workunit.client.0.smithi163.stdout:5943( 55 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.497 INFO:tasks.workunit.client.0.smithi163.stdout:5944( 56 mod 256): COPY 0x4c9fb thru 0x530bc (0x66c2 bytes) to 0xf3328 thru 0xf99e9 2023-07-14T18:17:18.497 INFO:tasks.workunit.client.0.smithi163.stdout:5945( 57 mod 256): MAPWRITE 0x11375 thru 0x113c3 (0x4f bytes) 2023-07-14T18:17:18.497 INFO:tasks.workunit.client.0.smithi163.stdout:5946( 58 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.498 INFO:tasks.workunit.client.0.smithi163.stdout:5947( 59 mod 256): PUNCH 0x99a0f thru 0xa83c0 (0xe9b2 bytes) 2023-07-14T18:17:18.498 INFO:tasks.workunit.client.0.smithi163.stdout:5948( 60 mod 256): READ 0x3661f thru 0x3dd6b (0x774d bytes) ***RRRR*** 2023-07-14T18:17:18.498 INFO:tasks.workunit.client.0.smithi163.stdout:5949( 61 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.498 INFO:tasks.workunit.client.0.smithi163.stdout:5950( 62 mod 256): COPY 0x55004 thru 0x64e2f (0xfe2c bytes) to 0x26727 thru 0x36552 2023-07-14T18:17:18.498 INFO:tasks.workunit.client.0.smithi163.stdout:5951( 63 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.498 INFO:tasks.workunit.client.0.smithi163.stdout:5952( 64 mod 256): TRUNCATE DOWN from 0xf99ea to 0xa429e 2023-07-14T18:17:18.498 INFO:tasks.workunit.client.0.smithi163.stdout:5953( 65 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.498 INFO:tasks.workunit.client.0.smithi163.stdout:5954( 66 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.499 INFO:tasks.workunit.client.0.smithi163.stdout:5955( 67 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.499 INFO:tasks.workunit.client.0.smithi163.stdout:5956( 68 mod 256): MAPREAD 0x14411 thru 0x23c5b (0xf84b bytes) 2023-07-14T18:17:18.499 INFO:tasks.workunit.client.0.smithi163.stdout:5957( 69 mod 256): TRUNCATE DOWN from 0xa429e to 0x69405 2023-07-14T18:17:18.499 INFO:tasks.workunit.client.0.smithi163.stdout:5958( 70 mod 256): WRITE 0x82dfc thru 0x83d73 (0xf78 bytes) HOLE 2023-07-14T18:17:18.499 INFO:tasks.workunit.client.0.smithi163.stdout:5959( 71 mod 256): MAPREAD 0x52850 thru 0x5ef3d (0xc6ee bytes) 2023-07-14T18:17:18.499 INFO:tasks.workunit.client.0.smithi163.stdout:5960( 72 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.499 INFO:tasks.workunit.client.0.smithi163.stdout:5961( 73 mod 256): READ 0x3deb4 thru 0x420eb (0x4238 bytes) 2023-07-14T18:17:18.499 INFO:tasks.workunit.client.0.smithi163.stdout:5962( 74 mod 256): MAPWRITE 0x87d2e thru 0x8c259 (0x452c bytes) 2023-07-14T18:17:18.500 INFO:tasks.workunit.client.0.smithi163.stdout:5963( 75 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.500 INFO:tasks.workunit.client.0.smithi163.stdout:5964( 76 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.500 INFO:tasks.workunit.client.0.smithi163.stdout:5965( 77 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.500 INFO:tasks.workunit.client.0.smithi163.stdout:5966( 78 mod 256): WRITE 0x113 thru 0xbec7 (0xbdb5 bytes) 2023-07-14T18:17:18.500 INFO:tasks.workunit.client.0.smithi163.stdout:5967( 79 mod 256): PUNCH 0x5325b thru 0x58072 (0x4e18 bytes) 2023-07-14T18:17:18.500 INFO:tasks.workunit.client.0.smithi163.stdout:5968( 80 mod 256): MAPWRITE 0x287c2 thru 0x368a6 (0xe0e5 bytes) 2023-07-14T18:17:18.500 INFO:tasks.workunit.client.0.smithi163.stdout:5969( 81 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.501 INFO:tasks.workunit.client.0.smithi163.stdout:5970( 82 mod 256): TRUNCATE DOWN from 0x8c25a to 0x2020e ******WWWW 2023-07-14T18:17:18.501 INFO:tasks.workunit.client.0.smithi163.stdout:5971( 83 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.501 INFO:tasks.workunit.client.0.smithi163.stdout:5972( 84 mod 256): PUNCH 0xb425 thru 0xbeac (0xa88 bytes) 2023-07-14T18:17:18.501 INFO:tasks.workunit.client.0.smithi163.stdout:5973( 85 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.501 INFO:tasks.workunit.client.0.smithi163.stdout:5974( 86 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.501 INFO:tasks.workunit.client.0.smithi163.stdout:5975( 87 mod 256): FALLOC 0xe7da5 thru 0xf0847 (0x8aa2 bytes) PAST_EOF 2023-07-14T18:17:18.501 INFO:tasks.workunit.client.0.smithi163.stdout:5976( 88 mod 256): READ 0xe52e thru 0x109e7 (0x24ba bytes) 2023-07-14T18:17:18.501 INFO:tasks.workunit.client.0.smithi163.stdout:5977( 89 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.502 INFO:tasks.workunit.client.0.smithi163.stdout:5978( 90 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.502 INFO:tasks.workunit.client.0.smithi163.stdout:5979( 91 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.502 INFO:tasks.workunit.client.0.smithi163.stdout:5980( 92 mod 256): COPY 0x3199 thru 0xff99 (0xce01 bytes) to 0x7b019 thru 0x87e19 2023-07-14T18:17:18.502 INFO:tasks.workunit.client.0.smithi163.stdout:5981( 93 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.502 INFO:tasks.workunit.client.0.smithi163.stdout:5982( 94 mod 256): COPY 0x3d54f thru 0x455ed (0x809f bytes) to 0xd916c thru 0xe120a 2023-07-14T18:17:18.502 INFO:tasks.workunit.client.0.smithi163.stdout:5983( 95 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.502 INFO:tasks.workunit.client.0.smithi163.stdout:5984( 96 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.502 INFO:tasks.workunit.client.0.smithi163.stdout:5985( 97 mod 256): READ 0x11914 thru 0x1e70a (0xcdf7 bytes) 2023-07-14T18:17:18.503 INFO:tasks.workunit.client.0.smithi163.stdout:5986( 98 mod 256): TRUNCATE DOWN from 0xe120b to 0xe0e91 2023-07-14T18:17:18.503 INFO:tasks.workunit.client.0.smithi163.stdout:5987( 99 mod 256): TRUNCATE DOWN from 0xe0e91 to 0x6e954 2023-07-14T18:17:18.503 INFO:tasks.workunit.client.0.smithi163.stdout:5988(100 mod 256): COPY 0x4a68 thru 0x61b9 (0x1752 bytes) to 0x1779 thru 0x2eca 2023-07-14T18:17:18.503 INFO:tasks.workunit.client.0.smithi163.stdout:5989(101 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.503 INFO:tasks.workunit.client.0.smithi163.stdout:5990(102 mod 256): PUNCH 0x266f7 thru 0x3309a (0xc9a4 bytes) 2023-07-14T18:17:18.503 INFO:tasks.workunit.client.0.smithi163.stdout:5991(103 mod 256): MAPREAD 0x6e670 thru 0x6e953 (0x2e4 bytes) 2023-07-14T18:17:18.503 INFO:tasks.workunit.client.0.smithi163.stdout:5992(104 mod 256): FALLOC 0xa1d00 thru 0xa64ed (0x47ed bytes) EXTENDING 2023-07-14T18:17:18.503 INFO:tasks.workunit.client.0.smithi163.stdout:5993(105 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.504 INFO:tasks.workunit.client.0.smithi163.stdout:5994(106 mod 256): MAPWRITE 0x7672 thru 0x12090 (0xaa1f bytes) 2023-07-14T18:17:18.504 INFO:tasks.workunit.client.0.smithi163.stdout:5995(107 mod 256): WRITE 0xa58f4 thru 0xaa66a (0x4d77 bytes) EXTEND 2023-07-14T18:17:18.504 INFO:tasks.workunit.client.0.smithi163.stdout:5996(108 mod 256): TRUNCATE UP from 0xaa66b to 0xcf90b 2023-07-14T18:17:18.504 INFO:tasks.workunit.client.0.smithi163.stdout:5997(109 mod 256): MAPREAD 0x6bbf3 thru 0x6cd27 (0x1135 bytes) 2023-07-14T18:17:18.504 INFO:tasks.workunit.client.0.smithi163.stdout:5998(110 mod 256): READ 0x6e68 thru 0xb51f (0x46b8 bytes) 2023-07-14T18:17:18.504 INFO:tasks.workunit.client.0.smithi163.stdout:5999(111 mod 256): FALLOC 0x7ffa4 thru 0x89955 (0x99b1 bytes) INTERIOR 2023-07-14T18:17:18.504 INFO:tasks.workunit.client.0.smithi163.stdout:6000(112 mod 256): TRUNCATE DOWN from 0xcf90b to 0x5414c 2023-07-14T18:17:18.504 INFO:tasks.workunit.client.0.smithi163.stdout:6001(113 mod 256): COPY 0x4fe7e thru 0x5414b (0x42ce bytes) to 0x4845b thru 0x4c728 2023-07-14T18:17:18.505 INFO:tasks.workunit.client.0.smithi163.stdout:6002(114 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.505 INFO:tasks.workunit.client.0.smithi163.stdout:6003(115 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.505 INFO:tasks.workunit.client.0.smithi163.stdout:6004(116 mod 256): MAPREAD 0xc548 thru 0x1797f (0xb438 bytes) 2023-07-14T18:17:18.505 INFO:tasks.workunit.client.0.smithi163.stdout:6005(117 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.505 INFO:tasks.workunit.client.0.smithi163.stdout:6006(118 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.505 INFO:tasks.workunit.client.0.smithi163.stdout:6007(119 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.505 INFO:tasks.workunit.client.0.smithi163.stdout:6008(120 mod 256): WRITE 0x6b804 thru 0x79ba6 (0xe3a3 bytes) HOLE 2023-07-14T18:17:18.505 INFO:tasks.workunit.client.0.smithi163.stdout:6009(121 mod 256): COPY 0x31a2c thru 0x3b6a9 (0x9c7e bytes) to 0x22637 thru 0x2c2b4 EEEE****** 2023-07-14T18:17:18.506 INFO:tasks.workunit.client.0.smithi163.stdout:6010(122 mod 256): COPY 0x34a9e thru 0x42420 (0xd983 bytes) to 0x9db5f thru 0xab4e1 EEEE****** 2023-07-14T18:17:18.506 INFO:tasks.workunit.client.0.smithi163.stdout:6011(123 mod 256): MAPWRITE 0x11ff0 thru 0x1dae9 (0xbafa bytes) 2023-07-14T18:17:18.506 INFO:tasks.workunit.client.0.smithi163.stdout:6012(124 mod 256): MAPREAD 0x15cd6 thru 0x16be6 (0xf11 bytes) 2023-07-14T18:17:18.506 INFO:tasks.workunit.client.0.smithi163.stdout:6013(125 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.506 INFO:tasks.workunit.client.0.smithi163.stdout:6014(126 mod 256): READ 0x8569c thru 0x8bc7a (0x65df bytes) 2023-07-14T18:17:18.506 INFO:tasks.workunit.client.0.smithi163.stdout:6015(127 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.506 INFO:tasks.workunit.client.0.smithi163.stdout:6016(128 mod 256): WRITE 0x4f96 thru 0x6fa8 (0x2013 bytes) 2023-07-14T18:17:18.506 INFO:tasks.workunit.client.0.smithi163.stdout:6017(129 mod 256): MAPWRITE 0xc48cd thru 0xd2908 (0xe03c bytes) 2023-07-14T18:17:18.507 INFO:tasks.workunit.client.0.smithi163.stdout:6018(130 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.507 INFO:tasks.workunit.client.0.smithi163.stdout:6019(131 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.507 INFO:tasks.workunit.client.0.smithi163.stdout:6020(132 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.507 INFO:tasks.workunit.client.0.smithi163.stdout:6021(133 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.507 INFO:tasks.workunit.client.0.smithi163.stdout:6022(134 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.507 INFO:tasks.workunit.client.0.smithi163.stdout:6023(135 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.507 INFO:tasks.workunit.client.0.smithi163.stdout:6024(136 mod 256): COPY 0x9c0c2 thru 0xa293a (0x6879 bytes) to 0x462a3 thru 0x4cb1b 2023-07-14T18:17:18.507 INFO:tasks.workunit.client.0.smithi163.stdout:6025(137 mod 256): MAPWRITE 0x609ae thru 0x61322 (0x975 bytes) 2023-07-14T18:17:18.508 INFO:tasks.workunit.client.0.smithi163.stdout:6026(138 mod 256): COPY 0x320b6 thru 0x3fd87 (0xdcd2 bytes) to 0xe6c5f thru 0xf4930 EEEE****** 2023-07-14T18:17:18.508 INFO:tasks.workunit.client.0.smithi163.stdout:6027(139 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.508 INFO:tasks.workunit.client.0.smithi163.stdout:6028(140 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.508 INFO:tasks.workunit.client.0.smithi163.stdout:6029(141 mod 256): MAPREAD 0x94cf2 thru 0x9aa72 (0x5d81 bytes) 2023-07-14T18:17:18.508 INFO:tasks.workunit.client.0.smithi163.stdout:6030(142 mod 256): MAPWRITE 0x13369 thru 0x14885 (0x151d bytes) 2023-07-14T18:17:18.508 INFO:tasks.workunit.client.0.smithi163.stdout:6031(143 mod 256): PUNCH 0x9d51b thru 0xa312b (0x5c11 bytes) 2023-07-14T18:17:18.508 INFO:tasks.workunit.client.0.smithi163.stdout:6032(144 mod 256): PUNCH 0xed0bb thru 0xf2838 (0x577e bytes) 2023-07-14T18:17:18.508 INFO:tasks.workunit.client.0.smithi163.stdout:6033(145 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.509 INFO:tasks.workunit.client.0.smithi163.stdout:6034(146 mod 256): PUNCH 0x83487 thru 0x8eb0f (0xb689 bytes) 2023-07-14T18:17:18.509 INFO:tasks.workunit.client.0.smithi163.stdout:6035(147 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.509 INFO:tasks.workunit.client.0.smithi163.stdout:6036(148 mod 256): WRITE 0x49feb thru 0x4b727 (0x173d bytes) 2023-07-14T18:17:18.509 INFO:tasks.workunit.client.0.smithi163.stdout:6037(149 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.509 INFO:tasks.workunit.client.0.smithi163.stdout:6038(150 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.509 INFO:tasks.workunit.client.0.smithi163.stdout:6039(151 mod 256): WRITE 0xa3939 thru 0xb0038 (0xc700 bytes) 2023-07-14T18:17:18.509 INFO:tasks.workunit.client.0.smithi163.stdout:6040(152 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.509 INFO:tasks.workunit.client.0.smithi163.stdout:6041(153 mod 256): WRITE 0x7a974 thru 0x7ac01 (0x28e bytes) 2023-07-14T18:17:18.510 INFO:tasks.workunit.client.0.smithi163.stdout:6042(154 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.510 INFO:tasks.workunit.client.0.smithi163.stdout:6043(155 mod 256): WRITE 0x4f28 thru 0x728e (0x2367 bytes) 2023-07-14T18:17:18.510 INFO:tasks.workunit.client.0.smithi163.stdout:6044(156 mod 256): TRUNCATE DOWN from 0xf4931 to 0x6a7eb 2023-07-14T18:17:18.510 INFO:tasks.workunit.client.0.smithi163.stdout:6045(157 mod 256): PUNCH 0x66f82 thru 0x68308 (0x1387 bytes) 2023-07-14T18:17:18.510 INFO:tasks.workunit.client.0.smithi163.stdout:6046(158 mod 256): TRUNCATE DOWN from 0x6a7eb to 0x4eb90 2023-07-14T18:17:18.510 INFO:tasks.workunit.client.0.smithi163.stdout:6047(159 mod 256): PUNCH 0x100c5 thru 0x17daa (0x7ce6 bytes) 2023-07-14T18:17:18.510 INFO:tasks.workunit.client.0.smithi163.stdout:6048(160 mod 256): TRUNCATE UP from 0x4eb90 to 0xbf7c7 2023-07-14T18:17:18.510 INFO:tasks.workunit.client.0.smithi163.stdout:6049(161 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.511 INFO:tasks.workunit.client.0.smithi163.stdout:6050(162 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.511 INFO:tasks.workunit.client.0.smithi163.stdout:6051(163 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.511 INFO:tasks.workunit.client.0.smithi163.stdout:6052(164 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.511 INFO:tasks.workunit.client.0.smithi163.stdout:6053(165 mod 256): COPY 0xdcbe thru 0x1cd74 (0xf0b7 bytes) to 0x6567b thru 0x74731 2023-07-14T18:17:18.511 INFO:tasks.workunit.client.0.smithi163.stdout:6054(166 mod 256): MAPREAD 0x8e1b6 thru 0x9c62d (0xe478 bytes) 2023-07-14T18:17:18.511 INFO:tasks.workunit.client.0.smithi163.stdout:6055(167 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.511 INFO:tasks.workunit.client.0.smithi163.stdout:6056(168 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.511 INFO:tasks.workunit.client.0.smithi163.stdout:6057(169 mod 256): MAPREAD 0x97805 thru 0x98807 (0x1003 bytes) 2023-07-14T18:17:18.512 INFO:tasks.workunit.client.0.smithi163.stdout:6058(170 mod 256): TRUNCATE DOWN from 0xbf7c7 to 0xb7894 2023-07-14T18:17:18.512 INFO:tasks.workunit.client.0.smithi163.stdout:6059(171 mod 256): WRITE 0x89d6 thru 0xe028 (0x5653 bytes) 2023-07-14T18:17:18.512 INFO:tasks.workunit.client.0.smithi163.stdout:6060(172 mod 256): PUNCH 0x2197c thru 0x292e8 (0x796d bytes) 2023-07-14T18:17:18.512 INFO:tasks.workunit.client.0.smithi163.stdout:6061(173 mod 256): FALLOC 0x98a3c thru 0x9ae37 (0x23fb bytes) INTERIOR 2023-07-14T18:17:18.512 INFO:tasks.workunit.client.0.smithi163.stdout:6062(174 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.512 INFO:tasks.workunit.client.0.smithi163.stdout:6063(175 mod 256): MAPREAD 0x365c8 thru 0x3f2ba (0x8cf3 bytes) ***RRRR*** 2023-07-14T18:17:18.512 INFO:tasks.workunit.client.0.smithi163.stdout:6064(176 mod 256): MAPWRITE 0x8de3d thru 0x9cfb8 (0xf17c bytes) 2023-07-14T18:17:18.512 INFO:tasks.workunit.client.0.smithi163.stdout:6065(177 mod 256): MAPREAD 0xc3d6 thru 0xc430 (0x5b bytes) 2023-07-14T18:17:18.513 INFO:tasks.workunit.client.0.smithi163.stdout:6066(178 mod 256): FALLOC 0x1dc72 thru 0x2b700 (0xda8e bytes) INTERIOR 2023-07-14T18:17:18.513 INFO:tasks.workunit.client.0.smithi163.stdout:6067(179 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.513 INFO:tasks.workunit.client.0.smithi163.stdout:6068(180 mod 256): FALLOC 0x397df thru 0x44724 (0xaf45 bytes) INTERIOR 2023-07-14T18:17:18.513 INFO:tasks.workunit.client.0.smithi163.stdout:6069(181 mod 256): MAPWRITE 0x87226 thru 0x8adbb (0x3b96 bytes) 2023-07-14T18:17:18.513 INFO:tasks.workunit.client.0.smithi163.stdout:6070(182 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.513 INFO:tasks.workunit.client.0.smithi163.stdout:6071(183 mod 256): PUNCH 0xaf436 thru 0xb7893 (0x845e bytes) 2023-07-14T18:17:18.513 INFO:tasks.workunit.client.0.smithi163.stdout:6072(184 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.513 INFO:tasks.workunit.client.0.smithi163.stdout:6073(185 mod 256): MAPWRITE 0x7ce00 thru 0x8c508 (0xf709 bytes) 2023-07-14T18:17:18.514 INFO:tasks.workunit.client.0.smithi163.stdout:6074(186 mod 256): TRUNCATE DOWN from 0xb7894 to 0x82a55 2023-07-14T18:17:18.514 INFO:tasks.workunit.client.0.smithi163.stdout:6075(187 mod 256): COPY 0x13576 thru 0x1e600 (0xb08b bytes) to 0xa055a thru 0xab5e4 2023-07-14T18:17:18.514 INFO:tasks.workunit.client.0.smithi163.stdout:6076(188 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.514 INFO:tasks.workunit.client.0.smithi163.stdout:6077(189 mod 256): READ 0x2e05c thru 0x3ad60 (0xcd05 bytes) ***RRRR*** 2023-07-14T18:17:18.514 INFO:tasks.workunit.client.0.smithi163.stdout:6078(190 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.514 INFO:tasks.workunit.client.0.smithi163.stdout:6079(191 mod 256): TRUNCATE DOWN from 0xab5e5 to 0x36878 ******WWWW 2023-07-14T18:17:18.514 INFO:tasks.workunit.client.0.smithi163.stdout:6080(192 mod 256): MAPWRITE 0xd4849 thru 0xd4bf3 (0x3ab bytes) 2023-07-14T18:17:18.514 INFO:tasks.workunit.client.0.smithi163.stdout:6081(193 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.515 INFO:tasks.workunit.client.0.smithi163.stdout:6082(194 mod 256): MAPREAD 0xbb0d2 thru 0xc4b24 (0x9a53 bytes) 2023-07-14T18:17:18.515 INFO:tasks.workunit.client.0.smithi163.stdout:6083(195 mod 256): PUNCH 0x7ed01 thru 0x82a55 (0x3d55 bytes) 2023-07-14T18:17:18.515 INFO:tasks.workunit.client.0.smithi163.stdout:6084(196 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.515 INFO:tasks.workunit.client.0.smithi163.stdout:6085(197 mod 256): FALLOC 0x1f1b2 thru 0x288f5 (0x9743 bytes) INTERIOR 2023-07-14T18:17:18.515 INFO:tasks.workunit.client.0.smithi163.stdout:6086(198 mod 256): READ 0xbb4bd thru 0xc18bb (0x63ff bytes) 2023-07-14T18:17:18.515 INFO:tasks.workunit.client.0.smithi163.stdout:6087(199 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.515 INFO:tasks.workunit.client.0.smithi163.stdout:6088(200 mod 256): PUNCH 0x6b305 thru 0x7568f (0xa38b bytes) 2023-07-14T18:17:18.515 INFO:tasks.workunit.client.0.smithi163.stdout:6089(201 mod 256): COPY 0x54fef thru 0x5f27e (0xa290 bytes) to 0xcb44e thru 0xd56dd 2023-07-14T18:17:18.516 INFO:tasks.workunit.client.0.smithi163.stdout:6090(202 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.516 INFO:tasks.workunit.client.0.smithi163.stdout:6091(203 mod 256): FALLOC 0xeabf4 thru 0xf81fe (0xd60a bytes) EXTENDING 2023-07-14T18:17:18.516 INFO:tasks.workunit.client.0.smithi163.stdout:6092(204 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.516 INFO:tasks.workunit.client.0.smithi163.stdout:6093(205 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.516 INFO:tasks.workunit.client.0.smithi163.stdout:6094(206 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.516 INFO:tasks.workunit.client.0.smithi163.stdout:6095(207 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.516 INFO:tasks.workunit.client.0.smithi163.stdout:6096(208 mod 256): COPY 0x6cbc4 thru 0x7c289 (0xf6c6 bytes) to 0x5a552 thru 0x69c17 2023-07-14T18:17:18.517 INFO:tasks.workunit.client.0.smithi163.stdout:6097(209 mod 256): READ 0x8c4a1 thru 0x90a0d (0x456d bytes) 2023-07-14T18:17:18.517 INFO:tasks.workunit.client.0.smithi163.stdout:6098(210 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.517 INFO:tasks.workunit.client.0.smithi163.stdout:6099(211 mod 256): READ 0x206c3 thru 0x2583a (0x5178 bytes) 2023-07-14T18:17:18.517 INFO:tasks.workunit.client.0.smithi163.stdout:6100(212 mod 256): READ 0x39194 thru 0x43414 (0xa281 bytes) 2023-07-14T18:17:18.517 INFO:tasks.workunit.client.0.smithi163.stdout:6101(213 mod 256): WRITE 0x79c3c thru 0x7a69f (0xa64 bytes) 2023-07-14T18:17:18.517 INFO:tasks.workunit.client.0.smithi163.stdout:6102(214 mod 256): MAPWRITE 0x1e027 thru 0x25e0d (0x7de7 bytes) 2023-07-14T18:17:18.517 INFO:tasks.workunit.client.0.smithi163.stdout:6103(215 mod 256): MAPWRITE 0xb6d6d thru 0xb837d (0x1611 bytes) 2023-07-14T18:17:18.517 INFO:tasks.workunit.client.0.smithi163.stdout:6104(216 mod 256): TRUNCATE DOWN from 0xf81fe to 0xbe10d 2023-07-14T18:17:18.518 INFO:tasks.workunit.client.0.smithi163.stdout:6105(217 mod 256): COPY 0xb0ebc thru 0xb2de7 (0x1f2c bytes) to 0x1ca0b thru 0x1e936 2023-07-14T18:17:18.518 INFO:tasks.workunit.client.0.smithi163.stdout:6106(218 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.518 INFO:tasks.workunit.client.0.smithi163.stdout:6107(219 mod 256): PUNCH 0x503c2 thru 0x52b4e (0x278d bytes) 2023-07-14T18:17:18.518 INFO:tasks.workunit.client.0.smithi163.stdout:6108(220 mod 256): FALLOC 0x50008 thru 0x5f26c (0xf264 bytes) INTERIOR 2023-07-14T18:17:18.518 INFO:tasks.workunit.client.0.smithi163.stdout:6109(221 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.518 INFO:tasks.workunit.client.0.smithi163.stdout:6110(222 mod 256): MAPWRITE 0x5626f thru 0x5a2b4 (0x4046 bytes) 2023-07-14T18:17:18.518 INFO:tasks.workunit.client.0.smithi163.stdout:6111(223 mod 256): MAPREAD 0x61754 thru 0x65c55 (0x4502 bytes) 2023-07-14T18:17:18.518 INFO:tasks.workunit.client.0.smithi163.stdout:6112(224 mod 256): MAPWRITE 0x22abd thru 0x2a896 (0x7dda bytes) 2023-07-14T18:17:18.518 INFO:tasks.workunit.client.0.smithi163.stdout:6113(225 mod 256): WRITE 0x8a8a5 thru 0x94149 (0x98a5 bytes) 2023-07-14T18:17:18.519 INFO:tasks.workunit.client.0.smithi163.stdout:6114(226 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.519 INFO:tasks.workunit.client.0.smithi163.stdout:6115(227 mod 256): FALLOC 0x999db thru 0xa42b0 (0xa8d5 bytes) INTERIOR 2023-07-14T18:17:18.519 INFO:tasks.workunit.client.0.smithi163.stdout:6116(228 mod 256): MAPWRITE 0x4c605 thru 0x5583b (0x9237 bytes) 2023-07-14T18:17:18.519 INFO:tasks.workunit.client.0.smithi163.stdout:6117(229 mod 256): COPY 0x6c36e thru 0x720bc (0x5d4f bytes) to 0x3ab47 thru 0x40895 2023-07-14T18:17:18.519 INFO:tasks.workunit.client.0.smithi163.stdout:6118(230 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.519 INFO:tasks.workunit.client.0.smithi163.stdout:6119(231 mod 256): MAPREAD 0x620b0 thru 0x697ff (0x7750 bytes) 2023-07-14T18:17:18.519 INFO:tasks.workunit.client.0.smithi163.stdout:6120(232 mod 256): MAPWRITE 0xda217 thru 0xdf23e (0x5028 bytes) 2023-07-14T18:17:18.519 INFO:tasks.workunit.client.0.smithi163.stdout:6121(233 mod 256): TRUNCATE UP from 0xdf23f to 0xfe668 2023-07-14T18:17:18.520 INFO:tasks.workunit.client.0.smithi163.stdout:6122(234 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.520 INFO:tasks.workunit.client.0.smithi163.stdout:6123(235 mod 256): TRUNCATE DOWN from 0xfe668 to 0x7e9d4 2023-07-14T18:17:18.520 INFO:tasks.workunit.client.0.smithi163.stdout:6124(236 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.520 INFO:tasks.workunit.client.0.smithi163.stdout:6125(237 mod 256): PUNCH 0x6844e thru 0x77f1c (0xfacf bytes) 2023-07-14T18:17:18.520 INFO:tasks.workunit.client.0.smithi163.stdout:6126(238 mod 256): READ 0x2fb64 thru 0x304ef (0x98c bytes) 2023-07-14T18:17:18.520 INFO:tasks.workunit.client.0.smithi163.stdout:6127(239 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.520 INFO:tasks.workunit.client.0.smithi163.stdout:6128(240 mod 256): COPY 0xde8b thru 0x15a51 (0x7bc7 bytes) to 0x2ad59 thru 0x3291f 2023-07-14T18:17:18.521 INFO:tasks.workunit.client.0.smithi163.stdout:6129(241 mod 256): MAPREAD 0x3f706 thru 0x45730 (0x602b bytes) 2023-07-14T18:17:18.521 INFO:tasks.workunit.client.0.smithi163.stdout:6130(242 mod 256): READ 0x4b35a thru 0x5ad50 (0xf9f7 bytes) 2023-07-14T18:17:18.521 INFO:tasks.workunit.client.0.smithi163.stdout:6131(243 mod 256): FALLOC 0xd8c40 thru 0xdef24 (0x62e4 bytes) PAST_EOF 2023-07-14T18:17:18.521 INFO:tasks.workunit.client.0.smithi163.stdout:6132(244 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.521 INFO:tasks.workunit.client.0.smithi163.stdout:6133(245 mod 256): MAPWRITE 0x6936b thru 0x772c8 (0xdf5e bytes) 2023-07-14T18:17:18.521 INFO:tasks.workunit.client.0.smithi163.stdout:6134(246 mod 256): COPY 0x2dfb8 thru 0x2ec46 (0xc8f bytes) to 0x3ccb thru 0x4959 2023-07-14T18:17:18.521 INFO:tasks.workunit.client.0.smithi163.stdout:6135(247 mod 256): WRITE 0x41e52 thru 0x44780 (0x292f bytes) 2023-07-14T18:17:18.521 INFO:tasks.workunit.client.0.smithi163.stdout:6136(248 mod 256): WRITE 0xaad6c thru 0xac1f5 (0x148a bytes) HOLE 2023-07-14T18:17:18.522 INFO:tasks.workunit.client.0.smithi163.stdout:6137(249 mod 256): MAPWRITE 0x7335e thru 0x7b042 (0x7ce5 bytes) 2023-07-14T18:17:18.522 INFO:tasks.workunit.client.0.smithi163.stdout:6138(250 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.522 INFO:tasks.workunit.client.0.smithi163.stdout:6139(251 mod 256): TRUNCATE DOWN from 0xac1f6 to 0x5ebf9 2023-07-14T18:17:18.522 INFO:tasks.workunit.client.0.smithi163.stdout:6140(252 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.522 INFO:tasks.workunit.client.0.smithi163.stdout:6141(253 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.522 INFO:tasks.workunit.client.0.smithi163.stdout:6142(254 mod 256): PUNCH 0x3876e thru 0x44a51 (0xc2e4 bytes) 2023-07-14T18:17:18.522 INFO:tasks.workunit.client.0.smithi163.stdout:6143(255 mod 256): FALLOC 0x26753 thru 0x2cb58 (0x6405 bytes) INTERIOR 2023-07-14T18:17:18.522 INFO:tasks.workunit.client.0.smithi163.stdout:6144( 0 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.523 INFO:tasks.workunit.client.0.smithi163.stdout:6145( 1 mod 256): READ 0x2509 thru 0x11442 (0xef3a bytes) 2023-07-14T18:17:18.523 INFO:tasks.workunit.client.0.smithi163.stdout:6146( 2 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.523 INFO:tasks.workunit.client.0.smithi163.stdout:6147( 3 mod 256): WRITE 0xf44a2 thru 0xfffff (0xbb5e bytes) HOLE 2023-07-14T18:17:18.523 INFO:tasks.workunit.client.0.smithi163.stdout:6148( 4 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.523 INFO:tasks.workunit.client.0.smithi163.stdout:6149( 5 mod 256): COPY 0x11915 thru 0x218d2 (0xffbe bytes) to 0x3823f thru 0x481fc 2023-07-14T18:17:18.523 INFO:tasks.workunit.client.0.smithi163.stdout:6150( 6 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.523 INFO:tasks.workunit.client.0.smithi163.stdout:6151( 7 mod 256): COPY 0xa6632 thru 0xa8580 (0x1f4f bytes) to 0x3b0f0 thru 0x3d03e 2023-07-14T18:17:18.523 INFO:tasks.workunit.client.0.smithi163.stdout:6152( 8 mod 256): PUNCH 0xeeed2 thru 0xf53d6 (0x6505 bytes) 2023-07-14T18:17:18.524 INFO:tasks.workunit.client.0.smithi163.stdout:6153( 9 mod 256): COPY 0xe6489 thru 0xf5b5a (0xf6d2 bytes) to 0x3f487 thru 0x4eb58 2023-07-14T18:17:18.524 INFO:tasks.workunit.client.0.smithi163.stdout:6154( 10 mod 256): COPY 0x34b2c thru 0x41bf9 (0xd0ce bytes) to 0x86f1e thru 0x93feb EEEE****** 2023-07-14T18:17:18.524 INFO:tasks.workunit.client.0.smithi163.stdout:6155( 11 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.524 INFO:tasks.workunit.client.0.smithi163.stdout:6156( 12 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.524 INFO:tasks.workunit.client.0.smithi163.stdout:6157( 13 mod 256): PUNCH 0xf5898 thru 0xfffff (0xa768 bytes) 2023-07-14T18:17:18.524 INFO:tasks.workunit.client.0.smithi163.stdout:6158( 14 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.524 INFO:tasks.workunit.client.0.smithi163.stdout:6159( 15 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.524 INFO:tasks.workunit.client.0.smithi163.stdout:6160( 16 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.525 INFO:tasks.workunit.client.0.smithi163.stdout:6161( 17 mod 256): PUNCH 0x88e78 thru 0x97260 (0xe3e9 bytes) 2023-07-14T18:17:18.525 INFO:tasks.workunit.client.0.smithi163.stdout:6162( 18 mod 256): TRUNCATE DOWN from 0x100000 to 0x310be ******WWWW 2023-07-14T18:17:18.525 INFO:tasks.workunit.client.0.smithi163.stdout:6163( 19 mod 256): TRUNCATE DOWN from 0x310be to 0x1f104 2023-07-14T18:17:18.525 INFO:tasks.workunit.client.0.smithi163.stdout:6164( 20 mod 256): MAPREAD 0xac71 thru 0x146dd (0x9a6d bytes) 2023-07-14T18:17:18.525 INFO:tasks.workunit.client.0.smithi163.stdout:6165( 21 mod 256): PUNCH 0xc48d thru 0x15da7 (0x991b bytes) 2023-07-14T18:17:18.525 INFO:tasks.workunit.client.0.smithi163.stdout:6166( 22 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.525 INFO:tasks.workunit.client.0.smithi163.stdout:6167( 23 mod 256): FALLOC 0xffa6a thru 0x100000 (0x596 bytes) PAST_EOF 2023-07-14T18:17:18.525 INFO:tasks.workunit.client.0.smithi163.stdout:6168( 24 mod 256): READ 0x144c0 thru 0x1581b (0x135c bytes) 2023-07-14T18:17:18.526 INFO:tasks.workunit.client.0.smithi163.stdout:6169( 25 mod 256): READ 0x47a6 thru 0x1391d (0xf178 bytes) 2023-07-14T18:17:18.526 INFO:tasks.workunit.client.0.smithi163.stdout:6170( 26 mod 256): WRITE 0x3594a thru 0x45759 (0xfe10 bytes) HOLE ***WWWW 2023-07-14T18:17:18.526 INFO:tasks.workunit.client.0.smithi163.stdout:6171( 27 mod 256): READ 0xc0c7 thru 0x117ae (0x56e8 bytes) 2023-07-14T18:17:18.526 INFO:tasks.workunit.client.0.smithi163.stdout:6172( 28 mod 256): COPY 0x20df5 thru 0x309df (0xfbeb bytes) to 0xac00a thru 0xbbbf4 2023-07-14T18:17:18.526 INFO:tasks.workunit.client.0.smithi163.stdout:6173( 29 mod 256): PUNCH 0x9fbe7 thru 0xad031 (0xd44b bytes) 2023-07-14T18:17:18.526 INFO:tasks.workunit.client.0.smithi163.stdout:6174( 30 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.526 INFO:tasks.workunit.client.0.smithi163.stdout:6175( 31 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.526 INFO:tasks.workunit.client.0.smithi163.stdout:6176( 32 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.527 INFO:tasks.workunit.client.0.smithi163.stdout:6177( 33 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.527 INFO:tasks.workunit.client.0.smithi163.stdout:6178( 34 mod 256): MAPWRITE 0x840cb thru 0x9248a (0xe3c0 bytes) 2023-07-14T18:17:18.527 INFO:tasks.workunit.client.0.smithi163.stdout:6179( 35 mod 256): MAPREAD 0x88bc thru 0xeff1 (0x6736 bytes) 2023-07-14T18:17:18.527 INFO:tasks.workunit.client.0.smithi163.stdout:6180( 36 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.527 INFO:tasks.workunit.client.0.smithi163.stdout:6181( 37 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.527 INFO:tasks.workunit.client.0.smithi163.stdout:6182( 38 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.527 INFO:tasks.workunit.client.0.smithi163.stdout:6183( 39 mod 256): MAPREAD 0x32083 thru 0x399fb (0x7979 bytes) ***RRRR*** 2023-07-14T18:17:18.527 INFO:tasks.workunit.client.0.smithi163.stdout:6184( 40 mod 256): FALLOC 0x67bf thru 0x10816 (0xa057 bytes) INTERIOR 2023-07-14T18:17:18.528 INFO:tasks.workunit.client.0.smithi163.stdout:6185( 41 mod 256): COPY 0x6a79b thru 0x6cdb4 (0x261a bytes) to 0xb1abb thru 0xb40d4 2023-07-14T18:17:18.528 INFO:tasks.workunit.client.0.smithi163.stdout:6186( 42 mod 256): MAPREAD 0x591d0 thru 0x66c03 (0xda34 bytes) 2023-07-14T18:17:18.528 INFO:tasks.workunit.client.0.smithi163.stdout:6187( 43 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.528 INFO:tasks.workunit.client.0.smithi163.stdout:6188( 44 mod 256): MAPWRITE 0xb46e8 thru 0xbceea (0x8803 bytes) 2023-07-14T18:17:18.528 INFO:tasks.workunit.client.0.smithi163.stdout:6189( 45 mod 256): TRUNCATE DOWN from 0xbceeb to 0x2715f ******WWWW 2023-07-14T18:17:18.528 INFO:tasks.workunit.client.0.smithi163.stdout:6190( 46 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.528 INFO:tasks.workunit.client.0.smithi163.stdout:6191( 47 mod 256): TRUNCATE UP from 0x2715f to 0xfe5f0 ******WWWW 2023-07-14T18:17:18.528 INFO:tasks.workunit.client.0.smithi163.stdout:6192( 48 mod 256): PUNCH 0xe4a7b thru 0xf2c8f (0xe215 bytes) 2023-07-14T18:17:18.529 INFO:tasks.workunit.client.0.smithi163.stdout:6193( 49 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.529 INFO:tasks.workunit.client.0.smithi163.stdout:6194( 50 mod 256): READ 0x244cb thru 0x2f55f (0xb095 bytes) 2023-07-14T18:17:18.529 INFO:tasks.workunit.client.0.smithi163.stdout:6195( 51 mod 256): PUNCH 0xfc15f thru 0xfd2a3 (0x1145 bytes) 2023-07-14T18:17:18.529 INFO:tasks.workunit.client.0.smithi163.stdout:6196( 52 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.529 INFO:tasks.workunit.client.0.smithi163.stdout:6197( 53 mod 256): MAPREAD 0x84f4e thru 0x90090 (0xb143 bytes) 2023-07-14T18:17:18.529 INFO:tasks.workunit.client.0.smithi163.stdout:6198( 54 mod 256): COPY 0x44ff6 thru 0x4fb0c (0xab17 bytes) to 0x96fa9 thru 0xa1abf 2023-07-14T18:17:18.529 INFO:tasks.workunit.client.0.smithi163.stdout:6199( 55 mod 256): MAPREAD 0x3d3c7 thru 0x478d9 (0xa513 bytes) 2023-07-14T18:17:18.529 INFO:tasks.workunit.client.0.smithi163.stdout:6200( 56 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.530 INFO:tasks.workunit.client.0.smithi163.stdout:6201( 57 mod 256): TRUNCATE DOWN from 0xfe5f0 to 0x241d5 ******WWWW 2023-07-14T18:17:18.530 INFO:tasks.workunit.client.0.smithi163.stdout:6202( 58 mod 256): FALLOC 0x8cf7a thru 0x90a47 (0x3acd bytes) EXTENDING 2023-07-14T18:17:18.530 INFO:tasks.workunit.client.0.smithi163.stdout:6203( 59 mod 256): COPY 0x251d2 thru 0x2d2e2 (0x8111 bytes) to 0xebe93 thru 0xf3fa3 2023-07-14T18:17:18.530 INFO:tasks.workunit.client.0.smithi163.stdout:6204( 60 mod 256): TRUNCATE DOWN from 0xf3fa4 to 0x122e8 ******WWWW 2023-07-14T18:17:18.530 INFO:tasks.workunit.client.0.smithi163.stdout:6205( 61 mod 256): FALLOC 0x512db thru 0x56bc9 (0x58ee bytes) EXTENDING 2023-07-14T18:17:18.530 INFO:tasks.workunit.client.0.smithi163.stdout:6206( 62 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.530 INFO:tasks.workunit.client.0.smithi163.stdout:6207( 63 mod 256): MAPREAD 0x124bd thru 0x1cd44 (0xa888 bytes) 2023-07-14T18:17:18.530 INFO:tasks.workunit.client.0.smithi163.stdout:6208( 64 mod 256): COPY 0x406b8 thru 0x4f9bb (0xf304 bytes) to 0xf0608 thru 0xff90b 2023-07-14T18:17:18.531 INFO:tasks.workunit.client.0.smithi163.stdout:6209( 65 mod 256): PUNCH 0x1e445 thru 0x2d7df (0xf39b bytes) 2023-07-14T18:17:18.531 INFO:tasks.workunit.client.0.smithi163.stdout:6210( 66 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.531 INFO:tasks.workunit.client.0.smithi163.stdout:6211( 67 mod 256): FALLOC 0x6baef thru 0x7749f (0xb9b0 bytes) INTERIOR 2023-07-14T18:17:18.531 INFO:tasks.workunit.client.0.smithi163.stdout:6212( 68 mod 256): COPY 0x2b4c2 thru 0x2e51f (0x305e bytes) to 0x5a0b3 thru 0x5d110 2023-07-14T18:17:18.531 INFO:tasks.workunit.client.0.smithi163.stdout:6213( 69 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.531 INFO:tasks.workunit.client.0.smithi163.stdout:6214( 70 mod 256): READ 0xe426 thru 0x19a20 (0xb5fb bytes) 2023-07-14T18:17:18.531 INFO:tasks.workunit.client.0.smithi163.stdout:6215( 71 mod 256): COPY 0xcd0e4 thru 0xd1f87 (0x4ea4 bytes) to 0xe19d5 thru 0xe6878 2023-07-14T18:17:18.531 INFO:tasks.workunit.client.0.smithi163.stdout:6216( 72 mod 256): MAPREAD 0xf6db1 thru 0xff78a (0x89da bytes) 2023-07-14T18:17:18.532 INFO:tasks.workunit.client.0.smithi163.stdout:6217( 73 mod 256): PUNCH 0xe06fc thru 0xe80aa (0x79af bytes) 2023-07-14T18:17:18.532 INFO:tasks.workunit.client.0.smithi163.stdout:6218( 74 mod 256): FALLOC 0xa6d3a thru 0xb385f (0xcb25 bytes) INTERIOR 2023-07-14T18:17:18.532 INFO:tasks.workunit.client.0.smithi163.stdout:6219( 75 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.532 INFO:tasks.workunit.client.0.smithi163.stdout:6220( 76 mod 256): PUNCH 0xc555a thru 0xce962 (0x9409 bytes) 2023-07-14T18:17:18.532 INFO:tasks.workunit.client.0.smithi163.stdout:6221( 77 mod 256): PUNCH 0x12366 thru 0x156f7 (0x3392 bytes) 2023-07-14T18:17:18.532 INFO:tasks.workunit.client.0.smithi163.stdout:6222( 78 mod 256): WRITE 0x4642e thru 0x53389 (0xcf5c bytes) 2023-07-14T18:17:18.532 INFO:tasks.workunit.client.0.smithi163.stdout:6223( 79 mod 256): PUNCH 0xa48ee thru 0xb00e5 (0xb7f8 bytes) 2023-07-14T18:17:18.532 INFO:tasks.workunit.client.0.smithi163.stdout:6224( 80 mod 256): TRUNCATE DOWN from 0xff90c to 0x52b74 2023-07-14T18:17:18.533 INFO:tasks.workunit.client.0.smithi163.stdout:6225( 81 mod 256): PUNCH 0x5782 thru 0xff97 (0xa816 bytes) 2023-07-14T18:17:18.533 INFO:tasks.workunit.client.0.smithi163.stdout:6226( 82 mod 256): WRITE 0xa09d2 thru 0xaa6b3 (0x9ce2 bytes) HOLE 2023-07-14T18:17:18.533 INFO:tasks.workunit.client.0.smithi163.stdout:6227( 83 mod 256): PUNCH 0x4cc97 thru 0x4e0bb (0x1425 bytes) 2023-07-14T18:17:18.533 INFO:tasks.workunit.client.0.smithi163.stdout:6228( 84 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.533 INFO:tasks.workunit.client.0.smithi163.stdout:6229( 85 mod 256): READ 0x7e8cc thru 0x86d38 (0x846d bytes) 2023-07-14T18:17:18.533 INFO:tasks.workunit.client.0.smithi163.stdout:6230( 86 mod 256): FALLOC 0x577ba thru 0x5cc51 (0x5497 bytes) INTERIOR 2023-07-14T18:17:18.533 INFO:tasks.workunit.client.0.smithi163.stdout:6231( 87 mod 256): PUNCH 0x3959c thru 0x4814a (0xebaf bytes) 2023-07-14T18:17:18.533 INFO:tasks.workunit.client.0.smithi163.stdout:6232( 88 mod 256): PUNCH 0x7ab8f thru 0x7ce5c (0x22ce bytes) 2023-07-14T18:17:18.534 INFO:tasks.workunit.client.0.smithi163.stdout:6233( 89 mod 256): TRUNCATE DOWN from 0xaa6b4 to 0x8b9cb 2023-07-14T18:17:18.534 INFO:tasks.workunit.client.0.smithi163.stdout:6234( 90 mod 256): MAPREAD 0x78717 thru 0x8609b (0xd985 bytes) 2023-07-14T18:17:18.534 INFO:tasks.workunit.client.0.smithi163.stdout:6235( 91 mod 256): COPY 0x70d06 thru 0x70d34 (0x2f bytes) to 0x7f15c thru 0x7f18a 2023-07-14T18:17:18.534 INFO:tasks.workunit.client.0.smithi163.stdout:6236( 92 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.534 INFO:tasks.workunit.client.0.smithi163.stdout:6237( 93 mod 256): PUNCH 0x1cb64 thru 0x2b126 (0xe5c3 bytes) 2023-07-14T18:17:18.534 INFO:tasks.workunit.client.0.smithi163.stdout:6238( 94 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.534 INFO:tasks.workunit.client.0.smithi163.stdout:6239( 95 mod 256): FALLOC 0xd2973 thru 0xd6081 (0x370e bytes) PAST_EOF 2023-07-14T18:17:18.534 INFO:tasks.workunit.client.0.smithi163.stdout:6240( 96 mod 256): READ 0x21222 thru 0x2e7c4 (0xd5a3 bytes) 2023-07-14T18:17:18.535 INFO:tasks.workunit.client.0.smithi163.stdout:6241( 97 mod 256): PUNCH 0x4b25f thru 0x4f742 (0x44e4 bytes) 2023-07-14T18:17:18.535 INFO:tasks.workunit.client.0.smithi163.stdout:6242( 98 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.535 INFO:tasks.workunit.client.0.smithi163.stdout:6243( 99 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.535 INFO:tasks.workunit.client.0.smithi163.stdout:6244(100 mod 256): MAPWRITE 0xdd4fa thru 0xdf4fc (0x2003 bytes) 2023-07-14T18:17:18.535 INFO:tasks.workunit.client.0.smithi163.stdout:6245(101 mod 256): WRITE 0xc5b63 thru 0xc667e (0xb1c bytes) 2023-07-14T18:17:18.535 INFO:tasks.workunit.client.0.smithi163.stdout:6246(102 mod 256): COPY 0xc26da thru 0xc8eda (0x6801 bytes) to 0xdff42 thru 0xe6742 2023-07-14T18:17:18.535 INFO:tasks.workunit.client.0.smithi163.stdout:6247(103 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.535 INFO:tasks.workunit.client.0.smithi163.stdout:6248(104 mod 256): WRITE 0xc65e1 thru 0xd15ab (0xafcb bytes) 2023-07-14T18:17:18.536 INFO:tasks.workunit.client.0.smithi163.stdout:6249(105 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.536 INFO:tasks.workunit.client.0.smithi163.stdout:6250(106 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.536 INFO:tasks.workunit.client.0.smithi163.stdout:6251(107 mod 256): MAPWRITE 0x2e9dd thru 0x38a65 (0xa089 bytes) ******WWWW 2023-07-14T18:17:18.536 INFO:tasks.workunit.client.0.smithi163.stdout:6252(108 mod 256): MAPREAD 0x6fd21 thru 0x780a0 (0x8380 bytes) 2023-07-14T18:17:18.536 INFO:tasks.workunit.client.0.smithi163.stdout:6253(109 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.536 INFO:tasks.workunit.client.0.smithi163.stdout:6254(110 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.536 INFO:tasks.workunit.client.0.smithi163.stdout:6255(111 mod 256): TRUNCATE UP from 0xe6743 to 0xf6f88 2023-07-14T18:17:18.536 INFO:tasks.workunit.client.0.smithi163.stdout:6256(112 mod 256): FALLOC 0x284f thru 0x6227 (0x39d8 bytes) INTERIOR 2023-07-14T18:17:18.537 INFO:tasks.workunit.client.0.smithi163.stdout:6257(113 mod 256): MAPWRITE 0x1e689 thru 0x202a2 (0x1c1a bytes) 2023-07-14T18:17:18.537 INFO:tasks.workunit.client.0.smithi163.stdout:6258(114 mod 256): TRUNCATE DOWN from 0xf6f88 to 0xc9064 2023-07-14T18:17:18.537 INFO:tasks.workunit.client.0.smithi163.stdout:6259(115 mod 256): FALLOC 0x802fe thru 0x8144f (0x1151 bytes) INTERIOR 2023-07-14T18:17:18.537 INFO:tasks.workunit.client.0.smithi163.stdout:6260(116 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.537 INFO:tasks.workunit.client.0.smithi163.stdout:6261(117 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.537 INFO:tasks.workunit.client.0.smithi163.stdout:6262(118 mod 256): MAPWRITE 0x6b9e5 thru 0x6cc2b (0x1247 bytes) 2023-07-14T18:17:18.537 INFO:tasks.workunit.client.0.smithi163.stdout:6263(119 mod 256): MAPREAD 0x9a645 thru 0xa2cb6 (0x8672 bytes) 2023-07-14T18:17:18.537 INFO:tasks.workunit.client.0.smithi163.stdout:6264(120 mod 256): WRITE 0x914e1 thru 0x96a2f (0x554f bytes) 2023-07-14T18:17:18.538 INFO:tasks.workunit.client.0.smithi163.stdout:6265(121 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.538 INFO:tasks.workunit.client.0.smithi163.stdout:6266(122 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.538 INFO:tasks.workunit.client.0.smithi163.stdout:6267(123 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.538 INFO:tasks.workunit.client.0.smithi163.stdout:6268(124 mod 256): TRUNCATE DOWN from 0xc9064 to 0xab3ef 2023-07-14T18:17:18.538 INFO:tasks.workunit.client.0.smithi163.stdout:6269(125 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.538 INFO:tasks.workunit.client.0.smithi163.stdout:6270(126 mod 256): WRITE 0xad100 thru 0xae7d6 (0x16d7 bytes) HOLE 2023-07-14T18:17:18.538 INFO:tasks.workunit.client.0.smithi163.stdout:6271(127 mod 256): FALLOC 0x784f thru 0x137d1 (0xbf82 bytes) INTERIOR 2023-07-14T18:17:18.538 INFO:tasks.workunit.client.0.smithi163.stdout:6272(128 mod 256): FALLOC 0xb64ab thru 0xbb97a (0x54cf bytes) EXTENDING 2023-07-14T18:17:18.539 INFO:tasks.workunit.client.0.smithi163.stdout:6273(129 mod 256): MAPREAD 0x5c0f8 thru 0x60906 (0x480f bytes) 2023-07-14T18:17:18.539 INFO:tasks.workunit.client.0.smithi163.stdout:6274(130 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.539 INFO:tasks.workunit.client.0.smithi163.stdout:6275(131 mod 256): READ 0x35641 thru 0x40f14 (0xb8d4 bytes) ***RRRR*** 2023-07-14T18:17:18.539 INFO:tasks.workunit.client.0.smithi163.stdout:6276(132 mod 256): PUNCH 0x731aa thru 0x81f00 (0xed57 bytes) 2023-07-14T18:17:18.539 INFO:tasks.workunit.client.0.smithi163.stdout:6277(133 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.539 INFO:tasks.workunit.client.0.smithi163.stdout:6278(134 mod 256): PUNCH 0x2eac0 thru 0x3259b (0x3adc bytes) 2023-07-14T18:17:18.539 INFO:tasks.workunit.client.0.smithi163.stdout:6279(135 mod 256): COPY 0xfbd2 thru 0x1ef3d (0xf36c bytes) to 0x3953f thru 0x488aa 2023-07-14T18:17:18.539 INFO:tasks.workunit.client.0.smithi163.stdout:6280(136 mod 256): READ 0x5480b thru 0x54a3c (0x232 bytes) 2023-07-14T18:17:18.540 INFO:tasks.workunit.client.0.smithi163.stdout:6281(137 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.540 INFO:tasks.workunit.client.0.smithi163.stdout:6282(138 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.540 INFO:tasks.workunit.client.0.smithi163.stdout:6283(139 mod 256): TRUNCATE UP from 0xbb97a to 0xf6394 2023-07-14T18:17:18.540 INFO:tasks.workunit.client.0.smithi163.stdout:6284(140 mod 256): MAPREAD 0x8d973 thru 0x93e3b (0x64c9 bytes) 2023-07-14T18:17:18.540 INFO:tasks.workunit.client.0.smithi163.stdout:6285(141 mod 256): MAPREAD 0x720e4 thru 0x73d48 (0x1c65 bytes) 2023-07-14T18:17:18.540 INFO:tasks.workunit.client.0.smithi163.stdout:6286(142 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.540 INFO:tasks.workunit.client.0.smithi163.stdout:6287(143 mod 256): COPY 0xc6f47 thru 0xcd0d7 (0x6191 bytes) to 0x63983 thru 0x69b13 2023-07-14T18:17:18.541 INFO:tasks.workunit.client.0.smithi163.stdout:6288(144 mod 256): FALLOC 0x7e6da thru 0x899c2 (0xb2e8 bytes) INTERIOR 2023-07-14T18:17:18.541 INFO:tasks.workunit.client.0.smithi163.stdout:6289(145 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.541 INFO:tasks.workunit.client.0.smithi163.stdout:6290(146 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.541 INFO:tasks.workunit.client.0.smithi163.stdout:6291(147 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.541 INFO:tasks.workunit.client.0.smithi163.stdout:6292(148 mod 256): MAPWRITE 0x1ac39 thru 0x1b724 (0xaec bytes) 2023-07-14T18:17:18.541 INFO:tasks.workunit.client.0.smithi163.stdout:6293(149 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.541 INFO:tasks.workunit.client.0.smithi163.stdout:6294(150 mod 256): TRUNCATE DOWN from 0xf6394 to 0x83a5f 2023-07-14T18:17:18.541 INFO:tasks.workunit.client.0.smithi163.stdout:6295(151 mod 256): TRUNCATE DOWN from 0x83a5f to 0xdb1a ******WWWW 2023-07-14T18:17:18.542 INFO:tasks.workunit.client.0.smithi163.stdout:6296(152 mod 256): READ 0x24f0 thru 0x6230 (0x3d41 bytes) 2023-07-14T18:17:18.542 INFO:tasks.workunit.client.0.smithi163.stdout:6297(153 mod 256): PUNCH 0x262c thru 0xdb19 (0xb4ee bytes) 2023-07-14T18:17:18.542 INFO:tasks.workunit.client.0.smithi163.stdout:6298(154 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.542 INFO:tasks.workunit.client.0.smithi163.stdout:6299(155 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.542 INFO:tasks.workunit.client.0.smithi163.stdout:6300(156 mod 256): COPY 0x3134 thru 0x6146 (0x3013 bytes) to 0xf73c0 thru 0xfa3d2 2023-07-14T18:17:18.542 INFO:tasks.workunit.client.0.smithi163.stdout:6301(157 mod 256): TRUNCATE DOWN from 0xfa3d3 to 0xe9a8f 2023-07-14T18:17:18.542 INFO:tasks.workunit.client.0.smithi163.stdout:6302(158 mod 256): MAPREAD 0x747b5 thru 0x7fbd0 (0xb41c bytes) 2023-07-14T18:17:18.542 INFO:tasks.workunit.client.0.smithi163.stdout:6303(159 mod 256): MAPWRITE 0xf561f thru 0xfe7ea (0x91cc bytes) 2023-07-14T18:17:18.543 INFO:tasks.workunit.client.0.smithi163.stdout:6304(160 mod 256): MAPWRITE 0x3be4c thru 0x404a1 (0x4656 bytes) 2023-07-14T18:17:18.543 INFO:tasks.workunit.client.0.smithi163.stdout:6305(161 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.543 INFO:tasks.workunit.client.0.smithi163.stdout:6306(162 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.543 INFO:tasks.workunit.client.0.smithi163.stdout:6307(163 mod 256): WRITE 0x1dcc8 thru 0x27b42 (0x9e7b bytes) 2023-07-14T18:17:18.543 INFO:tasks.workunit.client.0.smithi163.stdout:6308(164 mod 256): READ 0xd9a9d thru 0xdd7df (0x3d43 bytes) 2023-07-14T18:17:18.543 INFO:tasks.workunit.client.0.smithi163.stdout:6309(165 mod 256): PUNCH 0x986cc thru 0xa5afb (0xd430 bytes) 2023-07-14T18:17:18.543 INFO:tasks.workunit.client.0.smithi163.stdout:6310(166 mod 256): MAPWRITE 0xb829 thru 0x1853e (0xcd16 bytes) 2023-07-14T18:17:18.543 INFO:tasks.workunit.client.0.smithi163.stdout:6311(167 mod 256): MAPWRITE 0xc70e2 thru 0xcd99f (0x68be bytes) 2023-07-14T18:17:18.544 INFO:tasks.workunit.client.0.smithi163.stdout:6312(168 mod 256): COPY 0xdf591 thru 0xe6ccf (0x773f bytes) to 0x95240 thru 0x9c97e 2023-07-14T18:17:18.544 INFO:tasks.workunit.client.0.smithi163.stdout:6313(169 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.544 INFO:tasks.workunit.client.0.smithi163.stdout:6314(170 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.544 INFO:tasks.workunit.client.0.smithi163.stdout:6315(171 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.544 INFO:tasks.workunit.client.0.smithi163.stdout:6316(172 mod 256): WRITE 0x5023b thru 0x5425d (0x4023 bytes) 2023-07-14T18:17:18.544 INFO:tasks.workunit.client.0.smithi163.stdout:6317(173 mod 256): MAPWRITE 0x8de94 thru 0x8eeec (0x1059 bytes) 2023-07-14T18:17:18.544 INFO:tasks.workunit.client.0.smithi163.stdout:6318(174 mod 256): WRITE 0xf4668 thru 0xfaf8e (0x6927 bytes) 2023-07-14T18:17:18.544 INFO:tasks.workunit.client.0.smithi163.stdout:6319(175 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.545 INFO:tasks.workunit.client.0.smithi163.stdout:6320(176 mod 256): READ 0x8cacb thru 0x8d6c3 (0xbf9 bytes) 2023-07-14T18:17:18.545 INFO:tasks.workunit.client.0.smithi163.stdout:6321(177 mod 256): MAPREAD 0x46ee0 thru 0x47fc1 (0x10e2 bytes) 2023-07-14T18:17:18.545 INFO:tasks.workunit.client.0.smithi163.stdout:6322(178 mod 256): WRITE 0x9120e thru 0x9bd60 (0xab53 bytes) 2023-07-14T18:17:18.545 INFO:tasks.workunit.client.0.smithi163.stdout:6323(179 mod 256): COPY 0xb72f6 thru 0xc3572 (0xc27d bytes) to 0x2ed28 thru 0x3afa4 ******EEEE 2023-07-14T18:17:18.545 INFO:tasks.workunit.client.0.smithi163.stdout:6324(180 mod 256): MAPWRITE 0xc4877 thru 0xc4d04 (0x48e bytes) 2023-07-14T18:17:18.545 INFO:tasks.workunit.client.0.smithi163.stdout:6325(181 mod 256): MAPREAD 0xcce69 thru 0xd0872 (0x3a0a bytes) 2023-07-14T18:17:18.545 INFO:tasks.workunit.client.0.smithi163.stdout:6326(182 mod 256): TRUNCATE DOWN from 0xfe7eb to 0x9aecf 2023-07-14T18:17:18.545 INFO:tasks.workunit.client.0.smithi163.stdout:6327(183 mod 256): PUNCH 0x60b98 thru 0x6713e (0x65a7 bytes) 2023-07-14T18:17:18.546 INFO:tasks.workunit.client.0.smithi163.stdout:6328(184 mod 256): PUNCH 0x6488e thru 0x6656b (0x1cde bytes) 2023-07-14T18:17:18.546 INFO:tasks.workunit.client.0.smithi163.stdout:6329(185 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.546 INFO:tasks.workunit.client.0.smithi163.stdout:6330(186 mod 256): FALLOC 0x19660 thru 0x2266d (0x900d bytes) INTERIOR 2023-07-14T18:17:18.546 INFO:tasks.workunit.client.0.smithi163.stdout:6331(187 mod 256): MAPREAD 0x658eb thru 0x6e971 (0x9087 bytes) 2023-07-14T18:17:18.546 INFO:tasks.workunit.client.0.smithi163.stdout:6332(188 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.546 INFO:tasks.workunit.client.0.smithi163.stdout:6333(189 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.546 INFO:tasks.workunit.client.0.smithi163.stdout:6334(190 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.546 INFO:tasks.workunit.client.0.smithi163.stdout:6335(191 mod 256): READ 0x3b9d1 thru 0x40c30 (0x5260 bytes) 2023-07-14T18:17:18.547 INFO:tasks.workunit.client.0.smithi163.stdout:6336(192 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.547 INFO:tasks.workunit.client.0.smithi163.stdout:6337(193 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.547 INFO:tasks.workunit.client.0.smithi163.stdout:6338(194 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.547 INFO:tasks.workunit.client.0.smithi163.stdout:6339(195 mod 256): READ 0x72192 thru 0x7342b (0x129a bytes) 2023-07-14T18:17:18.547 INFO:tasks.workunit.client.0.smithi163.stdout:6340(196 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.547 INFO:tasks.workunit.client.0.smithi163.stdout:6341(197 mod 256): PUNCH 0x40ac2 thru 0x4fab1 (0xeff0 bytes) 2023-07-14T18:17:18.547 INFO:tasks.workunit.client.0.smithi163.stdout:6342(198 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.547 INFO:tasks.workunit.client.0.smithi163.stdout:6343(199 mod 256): WRITE 0x9b82d thru 0xa9a89 (0xe25d bytes) HOLE 2023-07-14T18:17:18.548 INFO:tasks.workunit.client.0.smithi163.stdout:6344(200 mod 256): READ 0x3a5c2 thru 0x3b11a (0xb59 bytes) 2023-07-14T18:17:18.548 INFO:tasks.workunit.client.0.smithi163.stdout:6345(201 mod 256): READ 0x8a0e2 thru 0x8f1b1 (0x50d0 bytes) 2023-07-14T18:17:18.548 INFO:tasks.workunit.client.0.smithi163.stdout:6346(202 mod 256): FALLOC 0xfb59e thru 0x100000 (0x4a62 bytes) EXTENDING 2023-07-14T18:17:18.548 INFO:tasks.workunit.client.0.smithi163.stdout:6347(203 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.548 INFO:tasks.workunit.client.0.smithi163.stdout:6348(204 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.548 INFO:tasks.workunit.client.0.smithi163.stdout:6349(205 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.548 INFO:tasks.workunit.client.0.smithi163.stdout:6350(206 mod 256): FALLOC 0x1e81b thru 0x26a0f (0x81f4 bytes) INTERIOR 2023-07-14T18:17:18.548 INFO:tasks.workunit.client.0.smithi163.stdout:6351(207 mod 256): MAPWRITE 0x87dd9 thru 0x943c4 (0xc5ec bytes) 2023-07-14T18:17:18.549 INFO:tasks.workunit.client.0.smithi163.stdout:6352(208 mod 256): COPY 0x59d4b thru 0x6828d (0xe543 bytes) to 0x3eaa5 thru 0x4cfe7 2023-07-14T18:17:18.549 INFO:tasks.workunit.client.0.smithi163.stdout:6353(209 mod 256): PUNCH 0x9a29 thru 0xa3b8 (0x990 bytes) 2023-07-14T18:17:18.549 INFO:tasks.workunit.client.0.smithi163.stdout:6354(210 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.549 INFO:tasks.workunit.client.0.smithi163.stdout:6355(211 mod 256): TRUNCATE DOWN from 0x100000 to 0xfaad6 2023-07-14T18:17:18.549 INFO:tasks.workunit.client.0.smithi163.stdout:6356(212 mod 256): COPY 0xf03d6 thru 0xfaad5 (0xa700 bytes) to 0x22c14 thru 0x2d313 2023-07-14T18:17:18.549 INFO:tasks.workunit.client.0.smithi163.stdout:6357(213 mod 256): FALLOC 0x5200f thru 0x60d94 (0xed85 bytes) INTERIOR 2023-07-14T18:17:18.549 INFO:tasks.workunit.client.0.smithi163.stdout:6358(214 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.549 INFO:tasks.workunit.client.0.smithi163.stdout:6359(215 mod 256): READ 0xe51fd thru 0xe6b6b (0x196f bytes) 2023-07-14T18:17:18.550 INFO:tasks.workunit.client.0.smithi163.stdout:6360(216 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.550 INFO:tasks.workunit.client.0.smithi163.stdout:6361(217 mod 256): PUNCH 0x4afa9 thru 0x5a62b (0xf683 bytes) 2023-07-14T18:17:18.550 INFO:tasks.workunit.client.0.smithi163.stdout:6362(218 mod 256): TRUNCATE DOWN from 0xfaad6 to 0xa845d 2023-07-14T18:17:18.550 INFO:tasks.workunit.client.0.smithi163.stdout:6363(219 mod 256): WRITE 0x3bc7c thru 0x3cd7a (0x10ff bytes) 2023-07-14T18:17:18.550 INFO:tasks.workunit.client.0.smithi163.stdout:6364(220 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.550 INFO:tasks.workunit.client.0.smithi163.stdout:6365(221 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.550 INFO:tasks.workunit.client.0.smithi163.stdout:6366(222 mod 256): MAPREAD 0x40756 thru 0x4e79a (0xe045 bytes) 2023-07-14T18:17:18.550 INFO:tasks.workunit.client.0.smithi163.stdout:6367(223 mod 256): READ 0x703fd thru 0x763de (0x5fe2 bytes) 2023-07-14T18:17:18.551 INFO:tasks.workunit.client.0.smithi163.stdout:6368(224 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.551 INFO:tasks.workunit.client.0.smithi163.stdout:6369(225 mod 256): FALLOC 0x30578 thru 0x3326b (0x2cf3 bytes) INTERIOR 2023-07-14T18:17:18.551 INFO:tasks.workunit.client.0.smithi163.stdout:6370(226 mod 256): PUNCH 0x44761 thru 0x469aa (0x224a bytes) 2023-07-14T18:17:18.551 INFO:tasks.workunit.client.0.smithi163.stdout:6371(227 mod 256): TRUNCATE DOWN from 0xa845d to 0x434d2 2023-07-14T18:17:18.551 INFO:tasks.workunit.client.0.smithi163.stdout:6372(228 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.551 INFO:tasks.workunit.client.0.smithi163.stdout:6373(229 mod 256): COPY 0x2723b thru 0x2a466 (0x322c bytes) to 0xf1a27 thru 0xf4c52 2023-07-14T18:17:18.551 INFO:tasks.workunit.client.0.smithi163.stdout:6374(230 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.551 INFO:tasks.workunit.client.0.smithi163.stdout:6375(231 mod 256): MAPWRITE 0xbb18a thru 0xc3c32 (0x8aa9 bytes) 2023-07-14T18:17:18.552 INFO:tasks.workunit.client.0.smithi163.stdout:6376(232 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.552 INFO:tasks.workunit.client.0.smithi163.stdout:6377(233 mod 256): COPY 0x37022 thru 0x3b941 (0x4920 bytes) to 0xd8e4f thru 0xdd76e EEEE****** 2023-07-14T18:17:18.552 INFO:tasks.workunit.client.0.smithi163.stdout:6378(234 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.552 INFO:tasks.workunit.client.0.smithi163.stdout:6379(235 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.552 INFO:tasks.workunit.client.0.smithi163.stdout:6380(236 mod 256): MAPREAD 0x43514 thru 0x4ae59 (0x7946 bytes) 2023-07-14T18:17:18.552 INFO:tasks.workunit.client.0.smithi163.stdout:6381(237 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.552 INFO:tasks.workunit.client.0.smithi163.stdout:6382(238 mod 256): MAPWRITE 0x13cc5 thru 0x209b8 (0xccf4 bytes) 2023-07-14T18:17:18.552 INFO:tasks.workunit.client.0.smithi163.stdout:6383(239 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.553 INFO:tasks.workunit.client.0.smithi163.stdout:6384(240 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.553 INFO:tasks.workunit.client.0.smithi163.stdout:6385(241 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.553 INFO:tasks.workunit.client.0.smithi163.stdout:6386(242 mod 256): MAPWRITE 0x10f73 thru 0x135fd (0x268b bytes) 2023-07-14T18:17:18.553 INFO:tasks.workunit.client.0.smithi163.stdout:6387(243 mod 256): MAPWRITE 0x4c8b thru 0x125e7 (0xd95d bytes) 2023-07-14T18:17:18.553 INFO:tasks.workunit.client.0.smithi163.stdout:6388(244 mod 256): WRITE 0x9e216 thru 0xab0cf (0xceba bytes) 2023-07-14T18:17:18.553 INFO:tasks.workunit.client.0.smithi163.stdout:6389(245 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.553 INFO:tasks.workunit.client.0.smithi163.stdout:6390(246 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.553 INFO:tasks.workunit.client.0.smithi163.stdout:6391(247 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.554 INFO:tasks.workunit.client.0.smithi163.stdout:6392(248 mod 256): COPY 0x94cc8 thru 0x9a04c (0x5385 bytes) to 0x3f158 thru 0x444dc 2023-07-14T18:17:18.554 INFO:tasks.workunit.client.0.smithi163.stdout:6393(249 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.554 INFO:tasks.workunit.client.0.smithi163.stdout:6394(250 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.554 INFO:tasks.workunit.client.0.smithi163.stdout:6395(251 mod 256): WRITE 0xf5f83 thru 0xfce12 (0x6e90 bytes) HOLE 2023-07-14T18:17:18.554 INFO:tasks.workunit.client.0.smithi163.stdout:6396(252 mod 256): TRUNCATE DOWN from 0xfce13 to 0x91eb0 2023-07-14T18:17:18.554 INFO:tasks.workunit.client.0.smithi163.stdout:6397(253 mod 256): COPY 0x888c1 thru 0x8aa64 (0x21a4 bytes) to 0xc048c thru 0xc262f 2023-07-14T18:17:18.554 INFO:tasks.workunit.client.0.smithi163.stdout:6398(254 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.554 INFO:tasks.workunit.client.0.smithi163.stdout:6399(255 mod 256): PUNCH 0x79c78 thru 0x8434e (0xa6d7 bytes) 2023-07-14T18:17:18.555 INFO:tasks.workunit.client.0.smithi163.stdout:6400( 0 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.555 INFO:tasks.workunit.client.0.smithi163.stdout:6401( 1 mod 256): WRITE 0x2218f thru 0x31ee2 (0xfd54 bytes) 2023-07-14T18:17:18.555 INFO:tasks.workunit.client.0.smithi163.stdout:6402( 2 mod 256): WRITE 0x1c72d thru 0x21b99 (0x546d bytes) 2023-07-14T18:17:18.555 INFO:tasks.workunit.client.0.smithi163.stdout:6403( 3 mod 256): COPY 0x372d4 thru 0x45714 (0xe441 bytes) to 0x74300 thru 0x82740 EEEE****** 2023-07-14T18:17:18.555 INFO:tasks.workunit.client.0.smithi163.stdout:6404( 4 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.555 INFO:tasks.workunit.client.0.smithi163.stdout:6405( 5 mod 256): MAPREAD 0x9a741 thru 0xa38a2 (0x9162 bytes) 2023-07-14T18:17:18.555 INFO:tasks.workunit.client.0.smithi163.stdout:6406( 6 mod 256): TRUNCATE UP from 0xc2630 to 0xd835b 2023-07-14T18:17:18.555 INFO:tasks.workunit.client.0.smithi163.stdout:6407( 7 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.556 INFO:tasks.workunit.client.0.smithi163.stdout:6408( 8 mod 256): READ 0xd793e thru 0xd835a (0xa1d bytes) 2023-07-14T18:17:18.556 INFO:tasks.workunit.client.0.smithi163.stdout:6409( 9 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.556 INFO:tasks.workunit.client.0.smithi163.stdout:6410( 10 mod 256): COPY 0x5bbb0 thru 0x698de (0xdd2f bytes) to 0xcbd82 thru 0xd9ab0 2023-07-14T18:17:18.556 INFO:tasks.workunit.client.0.smithi163.stdout:6411( 11 mod 256): FALLOC 0x1d147 thru 0x29667 (0xc520 bytes) INTERIOR 2023-07-14T18:17:18.556 INFO:tasks.workunit.client.0.smithi163.stdout:6412( 12 mod 256): READ 0xc9144 thru 0xd26bb (0x9578 bytes) 2023-07-14T18:17:18.556 INFO:tasks.workunit.client.0.smithi163.stdout:6413( 13 mod 256): PUNCH 0x739c5 thru 0x7d16e (0x97aa bytes) 2023-07-14T18:17:18.556 INFO:tasks.workunit.client.0.smithi163.stdout:6414( 14 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.556 INFO:tasks.workunit.client.0.smithi163.stdout:6415( 15 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.557 INFO:tasks.workunit.client.0.smithi163.stdout:6416( 16 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.557 INFO:tasks.workunit.client.0.smithi163.stdout:6417( 17 mod 256): COPY 0xc0546 thru 0xc1f57 (0x1a12 bytes) to 0xd58aa thru 0xd72bb 2023-07-14T18:17:18.557 INFO:tasks.workunit.client.0.smithi163.stdout:6418( 18 mod 256): MAPREAD 0x59d6b thru 0x63d13 (0x9fa9 bytes) 2023-07-14T18:17:18.557 INFO:tasks.workunit.client.0.smithi163.stdout:6419( 19 mod 256): MAPREAD 0xb3f5e thru 0xb9f0f (0x5fb2 bytes) 2023-07-14T18:17:18.557 INFO:tasks.workunit.client.0.smithi163.stdout:6420( 20 mod 256): FALLOC 0xde5fc thru 0xee307 (0xfd0b bytes) EXTENDING 2023-07-14T18:17:18.557 INFO:tasks.workunit.client.0.smithi163.stdout:6421( 21 mod 256): COPY 0xbce4e thru 0xbe75f (0x1912 bytes) to 0xf03d3 thru 0xf1ce4 2023-07-14T18:17:18.557 INFO:tasks.workunit.client.0.smithi163.stdout:6422( 22 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.557 INFO:tasks.workunit.client.0.smithi163.stdout:6423( 23 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.558 INFO:tasks.workunit.client.0.smithi163.stdout:6424( 24 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.558 INFO:tasks.workunit.client.0.smithi163.stdout:6425( 25 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.558 INFO:tasks.workunit.client.0.smithi163.stdout:6426( 26 mod 256): PUNCH 0x68e77 thru 0x730bf (0xa249 bytes) 2023-07-14T18:17:18.558 INFO:tasks.workunit.client.0.smithi163.stdout:6427( 27 mod 256): FALLOC 0xe2787 thru 0xea20b (0x7a84 bytes) INTERIOR 2023-07-14T18:17:18.558 INFO:tasks.workunit.client.0.smithi163.stdout:6428( 28 mod 256): MAPWRITE 0xc72c4 thru 0xca887 (0x35c4 bytes) 2023-07-14T18:17:18.558 INFO:tasks.workunit.client.0.smithi163.stdout:6429( 29 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.558 INFO:tasks.workunit.client.0.smithi163.stdout:6430( 30 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.559 INFO:tasks.workunit.client.0.smithi163.stdout:6431( 31 mod 256): MAPWRITE 0x31175 thru 0x3a0c7 (0x8f53 bytes) ******WWWW 2023-07-14T18:17:18.559 INFO:tasks.workunit.client.0.smithi163.stdout:6432( 32 mod 256): MAPREAD 0x1e46e thru 0x29ffd (0xbb90 bytes) 2023-07-14T18:17:18.559 INFO:tasks.workunit.client.0.smithi163.stdout:6433( 33 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.559 INFO:tasks.workunit.client.0.smithi163.stdout:6434( 34 mod 256): COPY 0x73c94 thru 0x833bd (0xf72a bytes) to 0x23ed7 thru 0x33600 2023-07-14T18:17:18.559 INFO:tasks.workunit.client.0.smithi163.stdout:6435( 35 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.559 INFO:tasks.workunit.client.0.smithi163.stdout:6436( 36 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.559 INFO:tasks.workunit.client.0.smithi163.stdout:6437( 37 mod 256): FALLOC 0xb17e thru 0x137d8 (0x865a bytes) INTERIOR 2023-07-14T18:17:18.559 INFO:tasks.workunit.client.0.smithi163.stdout:6438( 38 mod 256): COPY 0x2c006 thru 0x34f74 (0x8f6f bytes) to 0x9fa38 thru 0xa89a6 2023-07-14T18:17:18.560 INFO:tasks.workunit.client.0.smithi163.stdout:6439( 39 mod 256): MAPWRITE 0xaa1ef thru 0xb8a13 (0xe825 bytes) 2023-07-14T18:17:18.560 INFO:tasks.workunit.client.0.smithi163.stdout:6440( 40 mod 256): MAPREAD 0x8a2d6 thru 0x91fbb (0x7ce6 bytes) 2023-07-14T18:17:18.560 INFO:tasks.workunit.client.0.smithi163.stdout:6441( 41 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.560 INFO:tasks.workunit.client.0.smithi163.stdout:6442( 42 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.560 INFO:tasks.workunit.client.0.smithi163.stdout:6443( 43 mod 256): WRITE 0x8c811 thru 0x93d5c (0x754c bytes) 2023-07-14T18:17:18.560 INFO:tasks.workunit.client.0.smithi163.stdout:6444( 44 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.560 INFO:tasks.workunit.client.0.smithi163.stdout:6445( 45 mod 256): COPY 0x3009e thru 0x3a303 (0xa266 bytes) to 0xccd1 thru 0x16f36 EEEE****** 2023-07-14T18:17:18.560 INFO:tasks.workunit.client.0.smithi163.stdout:6446( 46 mod 256): READ 0x10b67 thru 0x170f2 (0x658c bytes) 2023-07-14T18:17:18.561 INFO:tasks.workunit.client.0.smithi163.stdout:6447( 47 mod 256): MAPREAD 0x5b225 thru 0x68c48 (0xda24 bytes) 2023-07-14T18:17:18.561 INFO:tasks.workunit.client.0.smithi163.stdout:6448( 48 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.561 INFO:tasks.workunit.client.0.smithi163.stdout:6449( 49 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.561 INFO:tasks.workunit.client.0.smithi163.stdout:6450( 50 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.561 INFO:tasks.workunit.client.0.smithi163.stdout:6451( 51 mod 256): MAPREAD 0x2cf83 thru 0x31517 (0x4595 bytes) 2023-07-14T18:17:18.561 INFO:tasks.workunit.client.0.smithi163.stdout:6452( 52 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.561 INFO:tasks.workunit.client.0.smithi163.stdout:6453( 53 mod 256): TRUNCATE DOWN from 0xf1ce5 to 0xf37a ******WWWW 2023-07-14T18:17:18.561 INFO:tasks.workunit.client.0.smithi163.stdout:6454( 54 mod 256): READ 0x2d81 thru 0x7e9d (0x511d bytes) 2023-07-14T18:17:18.562 INFO:tasks.workunit.client.0.smithi163.stdout:6455( 55 mod 256): MAPWRITE 0x8fb25 thru 0x90014 (0x4f0 bytes) 2023-07-14T18:17:18.562 INFO:tasks.workunit.client.0.smithi163.stdout:6456( 56 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.562 INFO:tasks.workunit.client.0.smithi163.stdout:6457( 57 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.562 INFO:tasks.workunit.client.0.smithi163.stdout:6458( 58 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.562 INFO:tasks.workunit.client.0.smithi163.stdout:6459( 59 mod 256): READ 0x4b6ec thru 0x547e2 (0x90f7 bytes) 2023-07-14T18:17:18.562 INFO:tasks.workunit.client.0.smithi163.stdout:6460( 60 mod 256): MAPREAD 0x31e10 thru 0x39b53 (0x7d44 bytes) ***RRRR*** 2023-07-14T18:17:18.562 INFO:tasks.workunit.client.0.smithi163.stdout:6461( 61 mod 256): MAPWRITE 0xa9695 thru 0xb397c (0xa2e8 bytes) 2023-07-14T18:17:18.562 INFO:tasks.workunit.client.0.smithi163.stdout:6462( 62 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.563 INFO:tasks.workunit.client.0.smithi163.stdout:6463( 63 mod 256): READ 0x3beb1 thru 0x47eff (0xc04f bytes) 2023-07-14T18:17:18.563 INFO:tasks.workunit.client.0.smithi163.stdout:6464( 64 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.563 INFO:tasks.workunit.client.0.smithi163.stdout:6465( 65 mod 256): READ 0x2da98 thru 0x3cfdb (0xf544 bytes) ***RRRR*** 2023-07-14T18:17:18.563 INFO:tasks.workunit.client.0.smithi163.stdout:6466( 66 mod 256): READ 0x2d246 thru 0x333b3 (0x616e bytes) 2023-07-14T18:17:18.563 INFO:tasks.workunit.client.0.smithi163.stdout:6467( 67 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.563 INFO:tasks.workunit.client.0.smithi163.stdout:6468( 68 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.563 INFO:tasks.workunit.client.0.smithi163.stdout:6469( 69 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.563 INFO:tasks.workunit.client.0.smithi163.stdout:6470( 70 mod 256): PUNCH 0x5f985 thru 0x64138 (0x47b4 bytes) 2023-07-14T18:17:18.564 INFO:tasks.workunit.client.0.smithi163.stdout:6471( 71 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.564 INFO:tasks.workunit.client.0.smithi163.stdout:6472( 72 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.564 INFO:tasks.workunit.client.0.smithi163.stdout:6473( 73 mod 256): TRUNCATE UP from 0xb397d to 0xee23e 2023-07-14T18:17:18.564 INFO:tasks.workunit.client.0.smithi163.stdout:6474( 74 mod 256): WRITE 0x7ec23 thru 0x7ffcc (0x13aa bytes) 2023-07-14T18:17:18.564 INFO:tasks.workunit.client.0.smithi163.stdout:6475( 75 mod 256): WRITE 0xe1503 thru 0xeab56 (0x9654 bytes) 2023-07-14T18:17:18.564 INFO:tasks.workunit.client.0.smithi163.stdout:6476( 76 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.564 INFO:tasks.workunit.client.0.smithi163.stdout:6477( 77 mod 256): TRUNCATE UP from 0xee23e to 0xffbe3 2023-07-14T18:17:18.564 INFO:tasks.workunit.client.0.smithi163.stdout:6478( 78 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.565 INFO:tasks.workunit.client.0.smithi163.stdout:6479( 79 mod 256): COPY 0xc3434 thru 0xcb0e3 (0x7cb0 bytes) to 0xc7fd thru 0x144ac 2023-07-14T18:17:18.565 INFO:tasks.workunit.client.0.smithi163.stdout:6480( 80 mod 256): MAPWRITE 0x8441b thru 0x92afe (0xe6e4 bytes) 2023-07-14T18:17:18.565 INFO:tasks.workunit.client.0.smithi163.stdout:6481( 81 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.565 INFO:tasks.workunit.client.0.smithi163.stdout:6482( 82 mod 256): READ 0xd7223 thru 0xe1681 (0xa45f bytes) 2023-07-14T18:17:18.565 INFO:tasks.workunit.client.0.smithi163.stdout:6483( 83 mod 256): MAPREAD 0xc9c34 thru 0xca298 (0x665 bytes) 2023-07-14T18:17:18.565 INFO:tasks.workunit.client.0.smithi163.stdout:6484( 84 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.565 INFO:tasks.workunit.client.0.smithi163.stdout:6485( 85 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.565 INFO:tasks.workunit.client.0.smithi163.stdout:6486( 86 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.566 INFO:tasks.workunit.client.0.smithi163.stdout:6487( 87 mod 256): COPY 0x5974c thru 0x652d5 (0xbb8a bytes) to 0x26512 thru 0x3209b 2023-07-14T18:17:18.566 INFO:tasks.workunit.client.0.smithi163.stdout:6488( 88 mod 256): TRUNCATE DOWN from 0xffbe3 to 0x950a0 2023-07-14T18:17:18.566 INFO:tasks.workunit.client.0.smithi163.stdout:6489( 89 mod 256): COPY 0x90249 thru 0x9509f (0x4e57 bytes) to 0x6d2e6 thru 0x7213c 2023-07-14T18:17:18.566 INFO:tasks.workunit.client.0.smithi163.stdout:6490( 90 mod 256): MAPREAD 0x6f091 thru 0x74cc7 (0x5c37 bytes) 2023-07-14T18:17:18.566 INFO:tasks.workunit.client.0.smithi163.stdout:6491( 91 mod 256): READ 0x7e40 thru 0x17641 (0xf802 bytes) 2023-07-14T18:17:18.566 INFO:tasks.workunit.client.0.smithi163.stdout:6492( 92 mod 256): MAPREAD 0x1710a thru 0x18692 (0x1589 bytes) 2023-07-14T18:17:18.566 INFO:tasks.workunit.client.0.smithi163.stdout:6493( 93 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.566 INFO:tasks.workunit.client.0.smithi163.stdout:6494( 94 mod 256): FALLOC 0x331e0 thru 0x4280c (0xf62c bytes) INTERIOR ******FFFF 2023-07-14T18:17:18.567 INFO:tasks.workunit.client.0.smithi163.stdout:6495( 95 mod 256): MAPREAD 0x66f0b thru 0x72af0 (0xbbe6 bytes) 2023-07-14T18:17:18.567 INFO:tasks.workunit.client.0.smithi163.stdout:6496( 96 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.567 INFO:tasks.workunit.client.0.smithi163.stdout:6497( 97 mod 256): TRUNCATE DOWN from 0x950a0 to 0xdde6 ******WWWW 2023-07-14T18:17:18.567 INFO:tasks.workunit.client.0.smithi163.stdout:6498( 98 mod 256): READ 0xb2f4 thru 0xdde5 (0x2af2 bytes) 2023-07-14T18:17:18.567 INFO:tasks.workunit.client.0.smithi163.stdout:6499( 99 mod 256): TRUNCATE UP from 0xdde6 to 0xda8b5 ******WWWW 2023-07-14T18:17:18.567 INFO:tasks.workunit.client.0.smithi163.stdout:6500(100 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.567 INFO:tasks.workunit.client.0.smithi163.stdout:6501(101 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.567 INFO:tasks.workunit.client.0.smithi163.stdout:6502(102 mod 256): TRUNCATE DOWN from 0xda8b5 to 0x93c5b 2023-07-14T18:17:18.568 INFO:tasks.workunit.client.0.smithi163.stdout:6503(103 mod 256): PUNCH 0x7f2a4 thru 0x82ab8 (0x3815 bytes) 2023-07-14T18:17:18.568 INFO:tasks.workunit.client.0.smithi163.stdout:6504(104 mod 256): MAPWRITE 0x63813 thru 0x6c5e0 (0x8dce bytes) 2023-07-14T18:17:18.568 INFO:tasks.workunit.client.0.smithi163.stdout:6505(105 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.568 INFO:tasks.workunit.client.0.smithi163.stdout:6506(106 mod 256): MAPREAD 0x8719b thru 0x89c1a (0x2a80 bytes) 2023-07-14T18:17:18.568 INFO:tasks.workunit.client.0.smithi163.stdout:6507(107 mod 256): COPY 0x7803f thru 0x79459 (0x141b bytes) to 0xef9a9 thru 0xf0dc3 2023-07-14T18:17:18.568 INFO:tasks.workunit.client.0.smithi163.stdout:6508(108 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.568 INFO:tasks.workunit.client.0.smithi163.stdout:6509(109 mod 256): TRUNCATE DOWN from 0xf0dc4 to 0x2b6f9 ******WWWW 2023-07-14T18:17:18.568 INFO:tasks.workunit.client.0.smithi163.stdout:6510(110 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.569 INFO:tasks.workunit.client.0.smithi163.stdout:6511(111 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.569 INFO:tasks.workunit.client.0.smithi163.stdout:6512(112 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.569 INFO:tasks.workunit.client.0.smithi163.stdout:6513(113 mod 256): READ 0x224c6 thru 0x2b6f8 (0x9233 bytes) 2023-07-14T18:17:18.569 INFO:tasks.workunit.client.0.smithi163.stdout:6514(114 mod 256): FALLOC 0xefb9d thru 0xfa6b7 (0xab1a bytes) PAST_EOF 2023-07-14T18:17:18.569 INFO:tasks.workunit.client.0.smithi163.stdout:6515(115 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.569 INFO:tasks.workunit.client.0.smithi163.stdout:6516(116 mod 256): WRITE 0x5463d thru 0x5cf86 (0x894a bytes) HOLE ***WWWW 2023-07-14T18:17:18.569 INFO:tasks.workunit.client.0.smithi163.stdout:6517(117 mod 256): MAPREAD 0x6986 thru 0x13d9e (0xd419 bytes) 2023-07-14T18:17:18.569 INFO:tasks.workunit.client.0.smithi163.stdout:6518(118 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.570 INFO:tasks.workunit.client.0.smithi163.stdout:6519(119 mod 256): MAPWRITE 0xee460 thru 0xf2f5d (0x4afe bytes) 2023-07-14T18:17:18.570 INFO:tasks.workunit.client.0.smithi163.stdout:6520(120 mod 256): COPY 0x8194f thru 0x8b2f1 (0x99a3 bytes) to 0x15089 thru 0x1ea2b 2023-07-14T18:17:18.570 INFO:tasks.workunit.client.0.smithi163.stdout:6521(121 mod 256): READ 0x83fd2 thru 0x88afe (0x4b2d bytes) 2023-07-14T18:17:18.570 INFO:tasks.workunit.client.0.smithi163.stdout:6522(122 mod 256): WRITE 0xc15fd thru 0xc3f72 (0x2976 bytes) 2023-07-14T18:17:18.570 INFO:tasks.workunit.client.0.smithi163.stdout:6523(123 mod 256): WRITE 0xcd65 thru 0xcdc2 (0x5e bytes) 2023-07-14T18:17:18.570 INFO:tasks.workunit.client.0.smithi163.stdout:6524(124 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.570 INFO:tasks.workunit.client.0.smithi163.stdout:6525(125 mod 256): COPY 0x78d70 thru 0x7bd6e (0x2fff bytes) to 0xd2888 thru 0xd5886 2023-07-14T18:17:18.571 INFO:tasks.workunit.client.0.smithi163.stdout:6526(126 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.571 INFO:tasks.workunit.client.0.smithi163.stdout:6527(127 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.571 INFO:tasks.workunit.client.0.smithi163.stdout:6528(128 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.571 INFO:tasks.workunit.client.0.smithi163.stdout:6529(129 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.571 INFO:tasks.workunit.client.0.smithi163.stdout:6530(130 mod 256): MAPREAD 0x90f3d thru 0x941b0 (0x3274 bytes) 2023-07-14T18:17:18.571 INFO:tasks.workunit.client.0.smithi163.stdout:6531(131 mod 256): FALLOC 0x80a5e thru 0x82fcd (0x256f bytes) INTERIOR 2023-07-14T18:17:18.571 INFO:tasks.workunit.client.0.smithi163.stdout:6532(132 mod 256): COPY 0x33ceb thru 0x42928 (0xec3e bytes) to 0xcf53d thru 0xde17a EEEE****** 2023-07-14T18:17:18.571 INFO:tasks.workunit.client.0.smithi163.stdout:6533(133 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.572 INFO:tasks.workunit.client.0.smithi163.stdout:6534(134 mod 256): MAPREAD 0xb46f9 thru 0xbcc6f (0x8577 bytes) 2023-07-14T18:17:18.572 INFO:tasks.workunit.client.0.smithi163.stdout:6535(135 mod 256): PUNCH 0x70ec4 thru 0x76403 (0x5540 bytes) 2023-07-14T18:17:18.572 INFO:tasks.workunit.client.0.smithi163.stdout:6536(136 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.572 INFO:tasks.workunit.client.0.smithi163.stdout:6537(137 mod 256): FALLOC 0x8b788 thru 0x93467 (0x7cdf bytes) INTERIOR 2023-07-14T18:17:18.572 INFO:tasks.workunit.client.0.smithi163.stdout:6538(138 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.572 INFO:tasks.workunit.client.0.smithi163.stdout:6539(139 mod 256): TRUNCATE DOWN from 0xf2f5e to 0x7dc99 2023-07-14T18:17:18.572 INFO:tasks.workunit.client.0.smithi163.stdout:6540(140 mod 256): READ 0x3b485 thru 0x48359 (0xced5 bytes) 2023-07-14T18:17:18.572 INFO:tasks.workunit.client.0.smithi163.stdout:6541(141 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.573 INFO:tasks.workunit.client.0.smithi163.stdout:6542(142 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.573 INFO:tasks.workunit.client.0.smithi163.stdout:6543(143 mod 256): WRITE 0x97175 thru 0xa66a7 (0xf533 bytes) HOLE 2023-07-14T18:17:18.573 INFO:tasks.workunit.client.0.smithi163.stdout:6544(144 mod 256): WRITE 0x7f403 thru 0x8844c (0x904a bytes) 2023-07-14T18:17:18.573 INFO:tasks.workunit.client.0.smithi163.stdout:6545(145 mod 256): FALLOC 0xbb2cd thru 0xc7a01 (0xc734 bytes) PAST_EOF 2023-07-14T18:17:18.573 INFO:tasks.workunit.client.0.smithi163.stdout:6546(146 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.573 INFO:tasks.workunit.client.0.smithi163.stdout:6547(147 mod 256): FALLOC 0x5bbfe thru 0x5d0c2 (0x14c4 bytes) INTERIOR 2023-07-14T18:17:18.573 INFO:tasks.workunit.client.0.smithi163.stdout:6548(148 mod 256): WRITE 0xde33c thru 0xedfea (0xfcaf bytes) HOLE 2023-07-14T18:17:18.573 INFO:tasks.workunit.client.0.smithi163.stdout:6549(149 mod 256): PUNCH 0xb78bb thru 0xbece5 (0x742b bytes) 2023-07-14T18:17:18.574 INFO:tasks.workunit.client.0.smithi163.stdout:6550(150 mod 256): WRITE 0xef2d4 thru 0xf4cab (0x59d8 bytes) HOLE 2023-07-14T18:17:18.574 INFO:tasks.workunit.client.0.smithi163.stdout:6551(151 mod 256): MAPWRITE 0xe84df thru 0xf39e9 (0xb50b bytes) 2023-07-14T18:17:18.574 INFO:tasks.workunit.client.0.smithi163.stdout:6552(152 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.574 INFO:tasks.workunit.client.0.smithi163.stdout:6553(153 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.574 INFO:tasks.workunit.client.0.smithi163.stdout:6554(154 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.574 INFO:tasks.workunit.client.0.smithi163.stdout:6555(155 mod 256): MAPWRITE 0xf9ed3 thru 0xfc685 (0x27b3 bytes) 2023-07-14T18:17:18.574 INFO:tasks.workunit.client.0.smithi163.stdout:6556(156 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.574 INFO:tasks.workunit.client.0.smithi163.stdout:6557(157 mod 256): READ 0x51dfc thru 0x53f89 (0x218e bytes) 2023-07-14T18:17:18.575 INFO:tasks.workunit.client.0.smithi163.stdout:6558(158 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.575 INFO:tasks.workunit.client.0.smithi163.stdout:6559(159 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.575 INFO:tasks.workunit.client.0.smithi163.stdout:6560(160 mod 256): MAPREAD 0x2e459 thru 0x33388 (0x4f30 bytes) 2023-07-14T18:17:18.575 INFO:tasks.workunit.client.0.smithi163.stdout:6561(161 mod 256): PUNCH 0x8511f thru 0x8ebcc (0x9aae bytes) 2023-07-14T18:17:18.575 INFO:tasks.workunit.client.0.smithi163.stdout:6562(162 mod 256): WRITE 0x2b213 thru 0x2e249 (0x3037 bytes) 2023-07-14T18:17:18.575 INFO:tasks.workunit.client.0.smithi163.stdout:6563(163 mod 256): PUNCH 0xfaa72 thru 0xfc685 (0x1c14 bytes) 2023-07-14T18:17:18.575 INFO:tasks.workunit.client.0.smithi163.stdout:6564(164 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.575 INFO:tasks.workunit.client.0.smithi163.stdout:6565(165 mod 256): FALLOC 0xe53ed thru 0xef966 (0xa579 bytes) INTERIOR 2023-07-14T18:17:18.576 INFO:tasks.workunit.client.0.smithi163.stdout:6566(166 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.576 INFO:tasks.workunit.client.0.smithi163.stdout:6567(167 mod 256): PUNCH 0xdea6e thru 0xdf053 (0x5e6 bytes) 2023-07-14T18:17:18.576 INFO:tasks.workunit.client.0.smithi163.stdout:6568(168 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.576 INFO:tasks.workunit.client.0.smithi163.stdout:6569(169 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.576 INFO:tasks.workunit.client.0.smithi163.stdout:6570(170 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.576 INFO:tasks.workunit.client.0.smithi163.stdout:6571(171 mod 256): COPY 0x5a03a thru 0x60fdd (0x6fa4 bytes) to 0x8a1ed thru 0x91190 2023-07-14T18:17:18.576 INFO:tasks.workunit.client.0.smithi163.stdout:6572(172 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.577 INFO:tasks.workunit.client.0.smithi163.stdout:6573(173 mod 256): COPY 0xb845d thru 0xc6569 (0xe10d bytes) to 0x77588 thru 0x85694 2023-07-14T18:17:18.577 INFO:tasks.workunit.client.0.smithi163.stdout:6574(174 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.577 INFO:tasks.workunit.client.0.smithi163.stdout:6575(175 mod 256): MAPREAD 0x443b thru 0x74b7 (0x307d bytes) 2023-07-14T18:17:18.577 INFO:tasks.workunit.client.0.smithi163.stdout:6576(176 mod 256): TRUNCATE DOWN from 0xfc686 to 0x2b2d2 ******WWWW 2023-07-14T18:17:18.577 INFO:tasks.workunit.client.0.smithi163.stdout:6577(177 mod 256): COPY 0x4ad6 thru 0xd350 (0x887b bytes) to 0x2bca8 thru 0x34522 2023-07-14T18:17:18.577 INFO:tasks.workunit.client.0.smithi163.stdout:6578(178 mod 256): WRITE 0xdf801 thru 0xe2a38 (0x3238 bytes) HOLE ***WWWW 2023-07-14T18:17:18.577 INFO:tasks.workunit.client.0.smithi163.stdout:6579(179 mod 256): MAPWRITE 0xeb106 thru 0xf2ef5 (0x7df0 bytes) 2023-07-14T18:17:18.577 INFO:tasks.workunit.client.0.smithi163.stdout:6580(180 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.578 INFO:tasks.workunit.client.0.smithi163.stdout:6581(181 mod 256): PUNCH 0x8021d thru 0x89f73 (0x9d57 bytes) 2023-07-14T18:17:18.578 INFO:tasks.workunit.client.0.smithi163.stdout:6582(182 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.578 INFO:tasks.workunit.client.0.smithi163.stdout:6583(183 mod 256): PUNCH 0x3728c thru 0x43a1c (0xc791 bytes) ******PPPP 2023-07-14T18:17:18.578 INFO:tasks.workunit.client.0.smithi163.stdout:6584(184 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.578 INFO:tasks.workunit.client.0.smithi163.stdout:6585(185 mod 256): TRUNCATE DOWN from 0xf2ef6 to 0x9b057 2023-07-14T18:17:18.578 INFO:tasks.workunit.client.0.smithi163.stdout:6586(186 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.578 INFO:tasks.workunit.client.0.smithi163.stdout:6587(187 mod 256): READ 0x8a7ad thru 0x95683 (0xaed7 bytes) 2023-07-14T18:17:18.578 INFO:tasks.workunit.client.0.smithi163.stdout:6588(188 mod 256): READ 0x7b262 thru 0x88b20 (0xd8bf bytes) 2023-07-14T18:17:18.579 INFO:tasks.workunit.client.0.smithi163.stdout:6589(189 mod 256): TRUNCATE DOWN from 0x9b057 to 0x74991 2023-07-14T18:17:18.579 INFO:tasks.workunit.client.0.smithi163.stdout:6590(190 mod 256): MAPWRITE 0x91ae thru 0x111de (0x8031 bytes) 2023-07-14T18:17:18.579 INFO:tasks.workunit.client.0.smithi163.stdout:6591(191 mod 256): TRUNCATE UP from 0x74991 to 0xd130b 2023-07-14T18:17:18.579 INFO:tasks.workunit.client.0.smithi163.stdout:6592(192 mod 256): MAPWRITE 0x5f7c6 thru 0x60d92 (0x15cd bytes) 2023-07-14T18:17:18.579 INFO:tasks.workunit.client.0.smithi163.stdout:6593(193 mod 256): FALLOC 0xcef33 thru 0xcf0c2 (0x18f bytes) INTERIOR 2023-07-14T18:17:18.579 INFO:tasks.workunit.client.0.smithi163.stdout:6594(194 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.579 INFO:tasks.workunit.client.0.smithi163.stdout:6595(195 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.579 INFO:tasks.workunit.client.0.smithi163.stdout:6596(196 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.580 INFO:tasks.workunit.client.0.smithi163.stdout:6597(197 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.580 INFO:tasks.workunit.client.0.smithi163.stdout:6598(198 mod 256): FALLOC 0xdbf8f thru 0xe3d74 (0x7de5 bytes) PAST_EOF 2023-07-14T18:17:18.580 INFO:tasks.workunit.client.0.smithi163.stdout:6599(199 mod 256): MAPREAD 0x3d21e thru 0x4289c (0x567f bytes) 2023-07-14T18:17:18.580 INFO:tasks.workunit.client.0.smithi163.stdout:6600(200 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.580 INFO:tasks.workunit.client.0.smithi163.stdout:6601(201 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.580 INFO:tasks.workunit.client.0.smithi163.stdout:6602(202 mod 256): PUNCH 0x5e5be thru 0x652ed (0x6d30 bytes) 2023-07-14T18:17:18.580 INFO:tasks.workunit.client.0.smithi163.stdout:6603(203 mod 256): FALLOC 0x38d4d thru 0x458d6 (0xcb89 bytes) INTERIOR 2023-07-14T18:17:18.580 INFO:tasks.workunit.client.0.smithi163.stdout:6604(204 mod 256): COPY 0xba6a7 thru 0xc971f (0xf079 bytes) to 0x8cf04 thru 0x9bf7c 2023-07-14T18:17:18.581 INFO:tasks.workunit.client.0.smithi163.stdout:6605(205 mod 256): COPY 0xa61c6 thru 0xa7ec6 (0x1d01 bytes) to 0x82b6c thru 0x8486c 2023-07-14T18:17:18.581 INFO:tasks.workunit.client.0.smithi163.stdout:6606(206 mod 256): WRITE 0xb3d73 thru 0xc3c23 (0xfeb1 bytes) 2023-07-14T18:17:18.581 INFO:tasks.workunit.client.0.smithi163.stdout:6607(207 mod 256): COPY 0x6c7e5 thru 0x7ad98 (0xe5b4 bytes) to 0xcb84f thru 0xd9e02 2023-07-14T18:17:18.581 INFO:tasks.workunit.client.0.smithi163.stdout:6608(208 mod 256): WRITE 0xd531b thru 0xe4fd9 (0xfcbf bytes) EXTEND 2023-07-14T18:17:18.581 INFO:tasks.workunit.client.0.smithi163.stdout:6609(209 mod 256): READ 0xd68cd thru 0xd7bf4 (0x1328 bytes) 2023-07-14T18:17:18.581 INFO:tasks.workunit.client.0.smithi163.stdout:6610(210 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.581 INFO:tasks.workunit.client.0.smithi163.stdout:6611(211 mod 256): READ 0x425cd thru 0x4c622 (0xa056 bytes) 2023-07-14T18:17:18.581 INFO:tasks.workunit.client.0.smithi163.stdout:6612(212 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.582 INFO:tasks.workunit.client.0.smithi163.stdout:6613(213 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.582 INFO:tasks.workunit.client.0.smithi163.stdout:6614(214 mod 256): MAPREAD 0xd5182 thru 0xdd6fc (0x857b bytes) 2023-07-14T18:17:18.582 INFO:tasks.workunit.client.0.smithi163.stdout:6615(215 mod 256): READ 0xb0be4 thru 0xb4d19 (0x4136 bytes) 2023-07-14T18:17:18.582 INFO:tasks.workunit.client.0.smithi163.stdout:6616(216 mod 256): PUNCH 0x9c05 thru 0xd2bb (0x36b7 bytes) 2023-07-14T18:17:18.582 INFO:tasks.workunit.client.0.smithi163.stdout:6617(217 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.582 INFO:tasks.workunit.client.0.smithi163.stdout:6618(218 mod 256): PUNCH 0x9a715 thru 0x9afc3 (0x8af bytes) 2023-07-14T18:17:18.582 INFO:tasks.workunit.client.0.smithi163.stdout:6619(219 mod 256): WRITE 0x5af81 thru 0x67106 (0xc186 bytes) 2023-07-14T18:17:18.582 INFO:tasks.workunit.client.0.smithi163.stdout:6620(220 mod 256): TRUNCATE UP from 0xe4fda to 0xf446f 2023-07-14T18:17:18.583 INFO:tasks.workunit.client.0.smithi163.stdout:6621(221 mod 256): TRUNCATE DOWN from 0xf446f to 0xe6489 2023-07-14T18:17:18.583 INFO:tasks.workunit.client.0.smithi163.stdout:6622(222 mod 256): MAPREAD 0x5bf0e thru 0x639ae (0x7aa1 bytes) 2023-07-14T18:17:18.583 INFO:tasks.workunit.client.0.smithi163.stdout:6623(223 mod 256): WRITE 0x68fd6 thru 0x71d62 (0x8d8d bytes) 2023-07-14T18:17:18.583 INFO:tasks.workunit.client.0.smithi163.stdout:6624(224 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.583 INFO:tasks.workunit.client.0.smithi163.stdout:6625(225 mod 256): TRUNCATE DOWN from 0xe6489 to 0x26261 ******WWWW 2023-07-14T18:17:18.583 INFO:tasks.workunit.client.0.smithi163.stdout:6626(226 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.583 INFO:tasks.workunit.client.0.smithi163.stdout:6627(227 mod 256): MAPWRITE 0x6822f thru 0x6aab8 (0x288a bytes) 2023-07-14T18:17:18.583 INFO:tasks.workunit.client.0.smithi163.stdout:6628(228 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.584 INFO:tasks.workunit.client.0.smithi163.stdout:6629(229 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.584 INFO:tasks.workunit.client.0.smithi163.stdout:6630(230 mod 256): READ 0x5a590 thru 0x5bed9 (0x194a bytes) 2023-07-14T18:17:18.584 INFO:tasks.workunit.client.0.smithi163.stdout:6631(231 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.584 INFO:tasks.workunit.client.0.smithi163.stdout:6632(232 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.584 INFO:tasks.workunit.client.0.smithi163.stdout:6633(233 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.584 INFO:tasks.workunit.client.0.smithi163.stdout:6634(234 mod 256): FALLOC 0x45508 thru 0x4f12f (0x9c27 bytes) INTERIOR 2023-07-14T18:17:18.584 INFO:tasks.workunit.client.0.smithi163.stdout:6635(235 mod 256): FALLOC 0x818c2 thru 0x8c35f (0xaa9d bytes) PAST_EOF 2023-07-14T18:17:18.585 INFO:tasks.workunit.client.0.smithi163.stdout:6636(236 mod 256): COPY 0x11332 thru 0x16a9f (0x576e bytes) to 0x2b85d thru 0x30fca 2023-07-14T18:17:18.585 INFO:tasks.workunit.client.0.smithi163.stdout:6637(237 mod 256): TRUNCATE UP from 0x6aab9 to 0x7e627 2023-07-14T18:17:18.585 INFO:tasks.workunit.client.0.smithi163.stdout:6638(238 mod 256): FALLOC 0x32fc8 thru 0x35bcb (0x2c03 bytes) INTERIOR 2023-07-14T18:17:18.585 INFO:tasks.workunit.client.0.smithi163.stdout:6639(239 mod 256): READ 0x4d2d thru 0x12668 (0xd93c bytes) 2023-07-14T18:17:18.585 INFO:tasks.workunit.client.0.smithi163.stdout:6640(240 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.585 INFO:tasks.workunit.client.0.smithi163.stdout:6641(241 mod 256): FALLOC 0xadab9 thru 0xb9fa6 (0xc4ed bytes) EXTENDING 2023-07-14T18:17:18.585 INFO:tasks.workunit.client.0.smithi163.stdout:6642(242 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.585 INFO:tasks.workunit.client.0.smithi163.stdout:6643(243 mod 256): FALLOC 0x82a2f thru 0x8f1cb (0xc79c bytes) INTERIOR 2023-07-14T18:17:18.586 INFO:tasks.workunit.client.0.smithi163.stdout:6644(244 mod 256): WRITE 0x9c27b thru 0xa2183 (0x5f09 bytes) 2023-07-14T18:17:18.586 INFO:tasks.workunit.client.0.smithi163.stdout:6645(245 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.586 INFO:tasks.workunit.client.0.smithi163.stdout:6646(246 mod 256): PUNCH 0x7add7 thru 0x867b9 (0xb9e3 bytes) 2023-07-14T18:17:18.586 INFO:tasks.workunit.client.0.smithi163.stdout:6647(247 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.586 INFO:tasks.workunit.client.0.smithi163.stdout:6648(248 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.586 INFO:tasks.workunit.client.0.smithi163.stdout:6649(249 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.586 INFO:tasks.workunit.client.0.smithi163.stdout:6650(250 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.586 INFO:tasks.workunit.client.0.smithi163.stdout:6651(251 mod 256): COPY 0x5365a thru 0x59415 (0x5dbc bytes) to 0x73c2b thru 0x799e6 2023-07-14T18:17:18.587 INFO:tasks.workunit.client.0.smithi163.stdout:6652(252 mod 256): PUNCH 0x8d28c thru 0x98318 (0xb08d bytes) 2023-07-14T18:17:18.587 INFO:tasks.workunit.client.0.smithi163.stdout:6653(253 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.587 INFO:tasks.workunit.client.0.smithi163.stdout:6654(254 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.587 INFO:tasks.workunit.client.0.smithi163.stdout:6655(255 mod 256): PUNCH 0x572ac thru 0x66077 (0xedcc bytes) 2023-07-14T18:17:18.587 INFO:tasks.workunit.client.0.smithi163.stdout:6656( 0 mod 256): COPY 0x55fa3 thru 0x6447c (0xe4da bytes) to 0x35f8d thru 0x44466 ******EEEE 2023-07-14T18:17:18.587 INFO:tasks.workunit.client.0.smithi163.stdout:6657( 1 mod 256): WRITE 0x493bf thru 0x51181 (0x7dc3 bytes) 2023-07-14T18:17:18.587 INFO:tasks.workunit.client.0.smithi163.stdout:6658( 2 mod 256): READ 0xb7d07 thru 0xb9fa5 (0x229f bytes) 2023-07-14T18:17:18.587 INFO:tasks.workunit.client.0.smithi163.stdout:6659( 3 mod 256): READ 0xab54f thru 0xae416 (0x2ec8 bytes) 2023-07-14T18:17:18.588 INFO:tasks.workunit.client.0.smithi163.stdout:6660( 4 mod 256): FALLOC 0x7a709 thru 0x7ab30 (0x427 bytes) INTERIOR 2023-07-14T18:17:18.588 INFO:tasks.workunit.client.0.smithi163.stdout:6661( 5 mod 256): TRUNCATE DOWN from 0xb9fa6 to 0x91de1 2023-07-14T18:17:18.588 INFO:tasks.workunit.client.0.smithi163.stdout:6662( 6 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.588 INFO:tasks.workunit.client.0.smithi163.stdout:6663( 7 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.588 INFO:tasks.workunit.client.0.smithi163.stdout:6664( 8 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.588 INFO:tasks.workunit.client.0.smithi163.stdout:6665( 9 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.588 INFO:tasks.workunit.client.0.smithi163.stdout:6666( 10 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.588 INFO:tasks.workunit.client.0.smithi163.stdout:6667( 11 mod 256): MAPREAD 0x8cafb thru 0x8eb94 (0x209a bytes) 2023-07-14T18:17:18.589 INFO:tasks.workunit.client.0.smithi163.stdout:6668( 12 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.589 INFO:tasks.workunit.client.0.smithi163.stdout:6669( 13 mod 256): COPY 0x6c302 thru 0x6e69b (0x239a bytes) to 0x5f79e thru 0x61b37 2023-07-14T18:17:18.589 INFO:tasks.workunit.client.0.smithi163.stdout:6670( 14 mod 256): FALLOC 0x8f888 thru 0x962d2 (0x6a4a bytes) EXTENDING 2023-07-14T18:17:18.589 INFO:tasks.workunit.client.0.smithi163.stdout:6671( 15 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.589 INFO:tasks.workunit.client.0.smithi163.stdout:6672( 16 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.589 INFO:tasks.workunit.client.0.smithi163.stdout:6673( 17 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.589 INFO:tasks.workunit.client.0.smithi163.stdout:6674( 18 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.589 INFO:tasks.workunit.client.0.smithi163.stdout:6675( 19 mod 256): MAPWRITE 0xfeec2 thru 0xfffff (0x113e bytes) 2023-07-14T18:17:18.590 INFO:tasks.workunit.client.0.smithi163.stdout:6676( 20 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.590 INFO:tasks.workunit.client.0.smithi163.stdout:6677( 21 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.590 INFO:tasks.workunit.client.0.smithi163.stdout:6678( 22 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.590 INFO:tasks.workunit.client.0.smithi163.stdout:6679( 23 mod 256): READ 0xb2d93 thru 0xb71bf (0x442d bytes) 2023-07-14T18:17:18.590 INFO:tasks.workunit.client.0.smithi163.stdout:6680( 24 mod 256): TRUNCATE DOWN from 0x100000 to 0x55c72 2023-07-14T18:17:18.590 INFO:tasks.workunit.client.0.smithi163.stdout:6681( 25 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.590 INFO:tasks.workunit.client.0.smithi163.stdout:6682( 26 mod 256): MAPWRITE 0xca570 thru 0xcefde (0x4a6f bytes) 2023-07-14T18:17:18.590 INFO:tasks.workunit.client.0.smithi163.stdout:6683( 27 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.591 INFO:tasks.workunit.client.0.smithi163.stdout:6684( 28 mod 256): COPY 0x97c21 thru 0xa125f (0x963f bytes) to 0xb1a60 thru 0xbb09e 2023-07-14T18:17:18.591 INFO:tasks.workunit.client.0.smithi163.stdout:6685( 29 mod 256): READ 0x86637 thru 0x93434 (0xcdfe bytes) 2023-07-14T18:17:18.591 INFO:tasks.workunit.client.0.smithi163.stdout:6686( 30 mod 256): PUNCH 0x55942 thru 0x59d86 (0x4445 bytes) 2023-07-14T18:17:18.591 INFO:tasks.workunit.client.0.smithi163.stdout:6687( 31 mod 256): MAPREAD 0x7ca4c thru 0x8c55f (0xfb14 bytes) 2023-07-14T18:17:18.591 INFO:tasks.workunit.client.0.smithi163.stdout:6688( 32 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.591 INFO:tasks.workunit.client.0.smithi163.stdout:6689( 33 mod 256): FALLOC 0x598ad thru 0x619af (0x8102 bytes) INTERIOR 2023-07-14T18:17:18.591 INFO:tasks.workunit.client.0.smithi163.stdout:6690( 34 mod 256): PUNCH 0x87213 thru 0x8b2f8 (0x40e6 bytes) 2023-07-14T18:17:18.591 INFO:tasks.workunit.client.0.smithi163.stdout:6691( 35 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.592 INFO:tasks.workunit.client.0.smithi163.stdout:6692( 36 mod 256): FALLOC 0xec3c2 thru 0xfa5d2 (0xe210 bytes) EXTENDING 2023-07-14T18:17:18.592 INFO:tasks.workunit.client.0.smithi163.stdout:6693( 37 mod 256): WRITE 0x8fd54 thru 0x97b85 (0x7e32 bytes) 2023-07-14T18:17:18.592 INFO:tasks.workunit.client.0.smithi163.stdout:6694( 38 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.592 INFO:tasks.workunit.client.0.smithi163.stdout:6695( 39 mod 256): COPY 0x1e2c7 thru 0x219cb (0x3705 bytes) to 0x4497f thru 0x48083 2023-07-14T18:17:18.592 INFO:tasks.workunit.client.0.smithi163.stdout:6696( 40 mod 256): MAPWRITE 0x98538 thru 0xa6aaa (0xe573 bytes) 2023-07-14T18:17:18.592 INFO:tasks.workunit.client.0.smithi163.stdout:6697( 41 mod 256): READ 0x81978 thru 0x88971 (0x6ffa bytes) 2023-07-14T18:17:18.592 INFO:tasks.workunit.client.0.smithi163.stdout:6698( 42 mod 256): PUNCH 0xcdbc7 thru 0xd0144 (0x257e bytes) 2023-07-14T18:17:18.592 INFO:tasks.workunit.client.0.smithi163.stdout:6699( 43 mod 256): TRUNCATE UP from 0xfa5d2 to 0xfa9b4 2023-07-14T18:17:18.593 INFO:tasks.workunit.client.0.smithi163.stdout:6700( 44 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.593 INFO:tasks.workunit.client.0.smithi163.stdout:6701( 45 mod 256): TRUNCATE DOWN from 0xfa9b4 to 0x108fc ******WWWW 2023-07-14T18:17:18.593 INFO:tasks.workunit.client.0.smithi163.stdout:6702( 46 mod 256): PUNCH 0x31ef thru 0x108fb (0xd70d bytes) 2023-07-14T18:17:18.593 INFO:tasks.workunit.client.0.smithi163.stdout:6703( 47 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.593 INFO:tasks.workunit.client.0.smithi163.stdout:6704( 48 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.593 INFO:tasks.workunit.client.0.smithi163.stdout:6705( 49 mod 256): COPY 0x56fc thru 0xacdf (0x55e4 bytes) to 0xabe3c thru 0xb141f 2023-07-14T18:17:18.593 INFO:tasks.workunit.client.0.smithi163.stdout:6706( 50 mod 256): READ 0x70e14 thru 0x74da3 (0x3f90 bytes) 2023-07-14T18:17:18.593 INFO:tasks.workunit.client.0.smithi163.stdout:6707( 51 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.594 INFO:tasks.workunit.client.0.smithi163.stdout:6708( 52 mod 256): WRITE 0x7cd78 thru 0x7dc8f (0xf18 bytes) 2023-07-14T18:17:18.594 INFO:tasks.workunit.client.0.smithi163.stdout:6709( 53 mod 256): PUNCH 0x5e1f thru 0x122f4 (0xc4d6 bytes) 2023-07-14T18:17:18.594 INFO:tasks.workunit.client.0.smithi163.stdout:6710( 54 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.594 INFO:tasks.workunit.client.0.smithi163.stdout:6711( 55 mod 256): MAPREAD 0x8f4c6 thru 0x94f06 (0x5a41 bytes) 2023-07-14T18:17:18.594 INFO:tasks.workunit.client.0.smithi163.stdout:6712( 56 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.594 INFO:tasks.workunit.client.0.smithi163.stdout:6713( 57 mod 256): COPY 0x9606a thru 0x9e89d (0x8834 bytes) to 0x74659 thru 0x7ce8c 2023-07-14T18:17:18.594 INFO:tasks.workunit.client.0.smithi163.stdout:6714( 58 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.594 INFO:tasks.workunit.client.0.smithi163.stdout:6715( 59 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.595 INFO:tasks.workunit.client.0.smithi163.stdout:6716( 60 mod 256): TRUNCATE UP from 0xb1420 to 0xbfe68 2023-07-14T18:17:18.595 INFO:tasks.workunit.client.0.smithi163.stdout:6717( 61 mod 256): FALLOC 0x39b33 thru 0x3ea5f (0x4f2c bytes) INTERIOR 2023-07-14T18:17:18.595 INFO:tasks.workunit.client.0.smithi163.stdout:6718( 62 mod 256): PUNCH 0x68279 thru 0x754d2 (0xd25a bytes) 2023-07-14T18:17:18.595 INFO:tasks.workunit.client.0.smithi163.stdout:6719( 63 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.595 INFO:tasks.workunit.client.0.smithi163.stdout:6720( 64 mod 256): COPY 0xa6af5 thru 0xb0604 (0x9b10 bytes) to 0x2a957 thru 0x34466 2023-07-14T18:17:18.595 INFO:tasks.workunit.client.0.smithi163.stdout:6721( 65 mod 256): WRITE 0x4ddce thru 0x5d218 (0xf44b bytes) 2023-07-14T18:17:18.595 INFO:tasks.workunit.client.0.smithi163.stdout:6722( 66 mod 256): WRITE 0xc84e0 thru 0xd66c5 (0xe1e6 bytes) HOLE 2023-07-14T18:17:18.595 INFO:tasks.workunit.client.0.smithi163.stdout:6723( 67 mod 256): PUNCH 0x4193 thru 0x118e8 (0xd756 bytes) 2023-07-14T18:17:18.596 INFO:tasks.workunit.client.0.smithi163.stdout:6724( 68 mod 256): READ 0x7e969 thru 0x88242 (0x98da bytes) 2023-07-14T18:17:18.596 INFO:tasks.workunit.client.0.smithi163.stdout:6725( 69 mod 256): PUNCH 0xaf5e6 thru 0xb75b1 (0x7fcc bytes) 2023-07-14T18:17:18.596 INFO:tasks.workunit.client.0.smithi163.stdout:6726( 70 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.596 INFO:tasks.workunit.client.0.smithi163.stdout:6727( 71 mod 256): MAPWRITE 0x69602 thru 0x71c89 (0x8688 bytes) 2023-07-14T18:17:18.596 INFO:tasks.workunit.client.0.smithi163.stdout:6728( 72 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.596 INFO:tasks.workunit.client.0.smithi163.stdout:6729( 73 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.596 INFO:tasks.workunit.client.0.smithi163.stdout:6730( 74 mod 256): MAPREAD 0x71b82 thru 0x7702f (0x54ae bytes) 2023-07-14T18:17:18.597 INFO:tasks.workunit.client.0.smithi163.stdout:6731( 75 mod 256): WRITE 0xada73 thru 0xb065d (0x2beb bytes) 2023-07-14T18:17:18.597 INFO:tasks.workunit.client.0.smithi163.stdout:6732( 76 mod 256): FALLOC 0xad25 thru 0xd6b9 (0x2994 bytes) INTERIOR 2023-07-14T18:17:18.597 INFO:tasks.workunit.client.0.smithi163.stdout:6733( 77 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.597 INFO:tasks.workunit.client.0.smithi163.stdout:6734( 78 mod 256): COPY 0x79b85 thru 0x811b6 (0x7632 bytes) to 0x2546b thru 0x2ca9c 2023-07-14T18:17:18.597 INFO:tasks.workunit.client.0.smithi163.stdout:6735( 79 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.597 INFO:tasks.workunit.client.0.smithi163.stdout:6736( 80 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.597 INFO:tasks.workunit.client.0.smithi163.stdout:6737( 81 mod 256): COPY 0x17fb thru 0x8aef (0x72f5 bytes) to 0x743e3 thru 0x7b6d7 2023-07-14T18:17:18.597 INFO:tasks.workunit.client.0.smithi163.stdout:6738( 82 mod 256): READ 0x10478 thru 0x14a9a (0x4623 bytes) 2023-07-14T18:17:18.597 INFO:tasks.workunit.client.0.smithi163.stdout:6739( 83 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.598 INFO:tasks.workunit.client.0.smithi163.stdout:6740( 84 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.598 INFO:tasks.workunit.client.0.smithi163.stdout:6741( 85 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.598 INFO:tasks.workunit.client.0.smithi163.stdout:6742( 86 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.598 INFO:tasks.workunit.client.0.smithi163.stdout:6743( 87 mod 256): READ 0x7ab95 thru 0x7e69b (0x3b07 bytes) 2023-07-14T18:17:18.598 INFO:tasks.workunit.client.0.smithi163.stdout:6744( 88 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.598 INFO:tasks.workunit.client.0.smithi163.stdout:6745( 89 mod 256): WRITE 0x2cc6e thru 0x37176 (0xa509 bytes) 2023-07-14T18:17:18.598 INFO:tasks.workunit.client.0.smithi163.stdout:6746( 90 mod 256): FALLOC 0x12c0 thru 0x38b2 (0x25f2 bytes) INTERIOR 2023-07-14T18:17:18.599 INFO:tasks.workunit.client.0.smithi163.stdout:6747( 91 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.599 INFO:tasks.workunit.client.0.smithi163.stdout:6748( 92 mod 256): WRITE 0x6eef7 thru 0x7ed40 (0xfe4a bytes) 2023-07-14T18:17:18.599 INFO:tasks.workunit.client.0.smithi163.stdout:6749( 93 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.599 INFO:tasks.workunit.client.0.smithi163.stdout:6750( 94 mod 256): COPY 0xa2e50 thru 0xab80f (0x89c0 bytes) to 0x504fc thru 0x58ebb 2023-07-14T18:17:18.599 INFO:tasks.workunit.client.0.smithi163.stdout:6751( 95 mod 256): COPY 0x582c6 thru 0x62c8f (0xa9ca bytes) to 0xb47e6 thru 0xbf1af 2023-07-14T18:17:18.599 INFO:tasks.workunit.client.0.smithi163.stdout:6752( 96 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.599 INFO:tasks.workunit.client.0.smithi163.stdout:6753( 97 mod 256): FALLOC 0x8e960 thru 0x9e13b (0xf7db bytes) INTERIOR 2023-07-14T18:17:18.599 INFO:tasks.workunit.client.0.smithi163.stdout:6754( 98 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.600 INFO:tasks.workunit.client.0.smithi163.stdout:6755( 99 mod 256): MAPWRITE 0x3099a thru 0x38f33 (0x859a bytes) ******WWWW 2023-07-14T18:17:18.600 INFO:tasks.workunit.client.0.smithi163.stdout:6756(100 mod 256): PUNCH 0x3ae97 thru 0x43059 (0x81c3 bytes) 2023-07-14T18:17:18.600 INFO:tasks.workunit.client.0.smithi163.stdout:6757(101 mod 256): MAPREAD 0x5134e thru 0x57d4a (0x69fd bytes) 2023-07-14T18:17:18.600 INFO:tasks.workunit.client.0.smithi163.stdout:6758(102 mod 256): PUNCH 0x3017e thru 0x3c228 (0xc0ab bytes) ******PPPP 2023-07-14T18:17:18.600 INFO:tasks.workunit.client.0.smithi163.stdout:6759(103 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.600 INFO:tasks.workunit.client.0.smithi163.stdout:6760(104 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.600 INFO:tasks.workunit.client.0.smithi163.stdout:6761(105 mod 256): COPY 0xc4fe0 thru 0xd27ef (0xd810 bytes) to 0x15d70 thru 0x2357f 2023-07-14T18:17:18.600 INFO:tasks.workunit.client.0.smithi163.stdout:6762(106 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.601 INFO:tasks.workunit.client.0.smithi163.stdout:6763(107 mod 256): MAPREAD 0xb47f9 thru 0xb6334 (0x1b3c bytes) 2023-07-14T18:17:18.601 INFO:tasks.workunit.client.0.smithi163.stdout:6764(108 mod 256): FALLOC 0xc8f92 thru 0xc9b58 (0xbc6 bytes) INTERIOR 2023-07-14T18:17:18.601 INFO:tasks.workunit.client.0.smithi163.stdout:6765(109 mod 256): PUNCH 0xd0456 thru 0xd66c5 (0x6270 bytes) 2023-07-14T18:17:18.601 INFO:tasks.workunit.client.0.smithi163.stdout:6766(110 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.601 INFO:tasks.workunit.client.0.smithi163.stdout:6767(111 mod 256): PUNCH 0x5e9e1 thru 0x6e1f1 (0xf811 bytes) 2023-07-14T18:17:18.601 INFO:tasks.workunit.client.0.smithi163.stdout:6768(112 mod 256): MAPWRITE 0x7106 thru 0x117ec (0xa6e7 bytes) 2023-07-14T18:17:18.601 INFO:tasks.workunit.client.0.smithi163.stdout:6769(113 mod 256): TRUNCATE UP from 0xd66c6 to 0xfb2af 2023-07-14T18:17:18.601 INFO:tasks.workunit.client.0.smithi163.stdout:6770(114 mod 256): COPY 0x140bf thru 0x1660a (0x254c bytes) to 0x3a867 thru 0x3cdb2 2023-07-14T18:17:18.602 INFO:tasks.workunit.client.0.smithi163.stdout:6771(115 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.602 INFO:tasks.workunit.client.0.smithi163.stdout:6772(116 mod 256): PUNCH 0x89cfc thru 0x96516 (0xc81b bytes) 2023-07-14T18:17:18.602 INFO:tasks.workunit.client.0.smithi163.stdout:6773(117 mod 256): READ 0x84251 thru 0x88697 (0x4447 bytes) 2023-07-14T18:17:18.602 INFO:tasks.workunit.client.0.smithi163.stdout:6774(118 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.602 INFO:tasks.workunit.client.0.smithi163.stdout:6775(119 mod 256): TRUNCATE DOWN from 0xfb2af to 0x48ebd 2023-07-14T18:17:18.602 INFO:tasks.workunit.client.0.smithi163.stdout:6776(120 mod 256): PUNCH 0x1989d thru 0x28e61 (0xf5c5 bytes) 2023-07-14T18:17:18.602 INFO:tasks.workunit.client.0.smithi163.stdout:6777(121 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.602 INFO:tasks.workunit.client.0.smithi163.stdout:6778(122 mod 256): READ 0x206a9 thru 0x2ea1d (0xe375 bytes) 2023-07-14T18:17:18.603 INFO:tasks.workunit.client.0.smithi163.stdout:6779(123 mod 256): READ 0x495e thru 0x1001d (0xb6c0 bytes) 2023-07-14T18:17:18.603 INFO:tasks.workunit.client.0.smithi163.stdout:6780(124 mod 256): TRUNCATE UP from 0x48ebd to 0x80ce9 2023-07-14T18:17:18.603 INFO:tasks.workunit.client.0.smithi163.stdout:6781(125 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.603 INFO:tasks.workunit.client.0.smithi163.stdout:6782(126 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.603 INFO:tasks.workunit.client.0.smithi163.stdout:6783(127 mod 256): WRITE 0xf8fe thru 0x18b1b (0x921e bytes) 2023-07-14T18:17:18.603 INFO:tasks.workunit.client.0.smithi163.stdout:6784(128 mod 256): READ 0x32319 thru 0x40739 (0xe421 bytes) ***RRRR*** 2023-07-14T18:17:18.603 INFO:tasks.workunit.client.0.smithi163.stdout:6785(129 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.603 INFO:tasks.workunit.client.0.smithi163.stdout:6786(130 mod 256): PUNCH 0x188c5 thru 0x1fb15 (0x7251 bytes) 2023-07-14T18:17:18.604 INFO:tasks.workunit.client.0.smithi163.stdout:6787(131 mod 256): FALLOC 0x7b0ca thru 0x807f1 (0x5727 bytes) INTERIOR 2023-07-14T18:17:18.604 INFO:tasks.workunit.client.0.smithi163.stdout:6788(132 mod 256): MAPWRITE 0xc3ba6 thru 0xcbeff (0x835a bytes) 2023-07-14T18:17:18.604 INFO:tasks.workunit.client.0.smithi163.stdout:6789(133 mod 256): FALLOC 0x77267 thru 0x7885f (0x15f8 bytes) INTERIOR 2023-07-14T18:17:18.604 INFO:tasks.workunit.client.0.smithi163.stdout:6790(134 mod 256): WRITE 0xc3aa3 thru 0xcf1ba (0xb718 bytes) EXTEND 2023-07-14T18:17:18.604 INFO:tasks.workunit.client.0.smithi163.stdout:6791(135 mod 256): COPY 0x9ccfc thru 0x9eb14 (0x1e19 bytes) to 0x23cf9 thru 0x25b11 2023-07-14T18:17:18.604 INFO:tasks.workunit.client.0.smithi163.stdout:6792(136 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.604 INFO:tasks.workunit.client.0.smithi163.stdout:6793(137 mod 256): FALLOC 0x95f2b thru 0xa30b9 (0xd18e bytes) INTERIOR 2023-07-14T18:17:18.604 INFO:tasks.workunit.client.0.smithi163.stdout:6794(138 mod 256): TRUNCATE DOWN from 0xcf1bb to 0x38694 2023-07-14T18:17:18.605 INFO:tasks.workunit.client.0.smithi163.stdout:6795(139 mod 256): MAPREAD 0x323c3 thru 0x37aab (0x56e9 bytes) 2023-07-14T18:17:18.605 INFO:tasks.workunit.client.0.smithi163.stdout:6796(140 mod 256): MAPWRITE 0xe393b thru 0xefb8b (0xc251 bytes) 2023-07-14T18:17:18.605 INFO:tasks.workunit.client.0.smithi163.stdout:6797(141 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.605 INFO:tasks.workunit.client.0.smithi163.stdout:6798(142 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.605 INFO:tasks.workunit.client.0.smithi163.stdout:6799(143 mod 256): TRUNCATE DOWN from 0xefb8c to 0x74a5d 2023-07-14T18:17:18.605 INFO:tasks.workunit.client.0.smithi163.stdout:6800(144 mod 256): MAPREAD 0x4139f thru 0x4a233 (0x8e95 bytes) 2023-07-14T18:17:18.605 INFO:tasks.workunit.client.0.smithi163.stdout:6801(145 mod 256): FALLOC 0xc8d3c thru 0xd5f4d (0xd211 bytes) PAST_EOF 2023-07-14T18:17:18.605 INFO:tasks.workunit.client.0.smithi163.stdout:6802(146 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.606 INFO:tasks.workunit.client.0.smithi163.stdout:6803(147 mod 256): WRITE 0x2cd99 thru 0x31554 (0x47bc bytes) 2023-07-14T18:17:18.606 INFO:tasks.workunit.client.0.smithi163.stdout:6804(148 mod 256): COPY 0x4a1b3 thru 0x56d60 (0xcbae bytes) to 0x3a841 thru 0x473ee 2023-07-14T18:17:18.606 INFO:tasks.workunit.client.0.smithi163.stdout:6805(149 mod 256): MAPREAD 0x50cb thru 0xcb7c (0x7ab2 bytes) 2023-07-14T18:17:18.606 INFO:tasks.workunit.client.0.smithi163.stdout:6806(150 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.606 INFO:tasks.workunit.client.0.smithi163.stdout:6807(151 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.606 INFO:tasks.workunit.client.0.smithi163.stdout:6808(152 mod 256): PUNCH 0x13589 thru 0x16ccb (0x3743 bytes) 2023-07-14T18:17:18.606 INFO:tasks.workunit.client.0.smithi163.stdout:6809(153 mod 256): TRUNCATE UP from 0x74a5d to 0x89d8a 2023-07-14T18:17:18.606 INFO:tasks.workunit.client.0.smithi163.stdout:6810(154 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.607 INFO:tasks.workunit.client.0.smithi163.stdout:6811(155 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.607 INFO:tasks.workunit.client.0.smithi163.stdout:6812(156 mod 256): PUNCH 0x5647a thru 0x6326f (0xcdf6 bytes) 2023-07-14T18:17:18.607 INFO:tasks.workunit.client.0.smithi163.stdout:6813(157 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.607 INFO:tasks.workunit.client.0.smithi163.stdout:6814(158 mod 256): MAPWRITE 0xa1a0d thru 0xa6876 (0x4e6a bytes) 2023-07-14T18:17:18.607 INFO:tasks.workunit.client.0.smithi163.stdout:6815(159 mod 256): WRITE 0xd86b0 thru 0xdbeba (0x380b bytes) HOLE 2023-07-14T18:17:18.607 INFO:tasks.workunit.client.0.smithi163.stdout:6816(160 mod 256): TRUNCATE UP from 0xdbebb to 0xe9944 2023-07-14T18:17:18.607 INFO:tasks.workunit.client.0.smithi163.stdout:6817(161 mod 256): TRUNCATE UP from 0xe9944 to 0xf9099 2023-07-14T18:17:18.607 INFO:tasks.workunit.client.0.smithi163.stdout:6818(162 mod 256): TRUNCATE DOWN from 0xf9099 to 0x2f66a ******WWWW 2023-07-14T18:17:18.608 INFO:tasks.workunit.client.0.smithi163.stdout:6819(163 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.608 INFO:tasks.workunit.client.0.smithi163.stdout:6820(164 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.608 INFO:tasks.workunit.client.0.smithi163.stdout:6821(165 mod 256): MAPWRITE 0xd8068 thru 0xe24b9 (0xa452 bytes) 2023-07-14T18:17:18.608 INFO:tasks.workunit.client.0.smithi163.stdout:6822(166 mod 256): MAPWRITE 0x404ca thru 0x454da (0x5011 bytes) 2023-07-14T18:17:18.608 INFO:tasks.workunit.client.0.smithi163.stdout:6823(167 mod 256): MAPWRITE 0xeb0aa thru 0xf6e72 (0xbdc9 bytes) 2023-07-14T18:17:18.608 INFO:tasks.workunit.client.0.smithi163.stdout:6824(168 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.608 INFO:tasks.workunit.client.0.smithi163.stdout:6825(169 mod 256): READ 0x67f65 thru 0x73989 (0xba25 bytes) 2023-07-14T18:17:18.608 INFO:tasks.workunit.client.0.smithi163.stdout:6826(170 mod 256): READ 0x1175e thru 0x20391 (0xec34 bytes) 2023-07-14T18:17:18.609 INFO:tasks.workunit.client.0.smithi163.stdout:6827(171 mod 256): WRITE 0xf25bf thru 0xfcfa1 (0xa9e3 bytes) EXTEND 2023-07-14T18:17:18.609 INFO:tasks.workunit.client.0.smithi163.stdout:6828(172 mod 256): WRITE 0x45995 thru 0x52f68 (0xd5d4 bytes) 2023-07-14T18:17:18.609 INFO:tasks.workunit.client.0.smithi163.stdout:6829(173 mod 256): MAPWRITE 0xa4b93 thru 0xaabae (0x601c bytes) 2023-07-14T18:17:18.609 INFO:tasks.workunit.client.0.smithi163.stdout:6830(174 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.609 INFO:tasks.workunit.client.0.smithi163.stdout:6831(175 mod 256): MAPREAD 0xd2ba5 thru 0xd35cd (0xa29 bytes) 2023-07-14T18:17:18.609 INFO:tasks.workunit.client.0.smithi163.stdout:6832(176 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.609 INFO:tasks.workunit.client.0.smithi163.stdout:6833(177 mod 256): MAPREAD 0x652a4 thru 0x68502 (0x325f bytes) 2023-07-14T18:17:18.609 INFO:tasks.workunit.client.0.smithi163.stdout:6834(178 mod 256): TRUNCATE DOWN from 0xfcfa2 to 0xf0d80 2023-07-14T18:17:18.610 INFO:tasks.workunit.client.0.smithi163.stdout:6835(179 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.610 INFO:tasks.workunit.client.0.smithi163.stdout:6836(180 mod 256): MAPREAD 0xc0894 thru 0xcb0f4 (0xa861 bytes) 2023-07-14T18:17:18.610 INFO:tasks.workunit.client.0.smithi163.stdout:6837(181 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.610 INFO:tasks.workunit.client.0.smithi163.stdout:6838(182 mod 256): READ 0x83277 thru 0x891d1 (0x5f5b bytes) 2023-07-14T18:17:18.610 INFO:tasks.workunit.client.0.smithi163.stdout:6839(183 mod 256): READ 0x6cd94 thru 0x6fbf9 (0x2e66 bytes) 2023-07-14T18:17:18.610 INFO:tasks.workunit.client.0.smithi163.stdout:6840(184 mod 256): TRUNCATE DOWN from 0xf0d80 to 0xe95e7 2023-07-14T18:17:18.610 INFO:tasks.workunit.client.0.smithi163.stdout:6841(185 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.610 INFO:tasks.workunit.client.0.smithi163.stdout:6842(186 mod 256): TRUNCATE DOWN from 0xe95e7 to 0xbf167 2023-07-14T18:17:18.611 INFO:tasks.workunit.client.0.smithi163.stdout:6843(187 mod 256): TRUNCATE UP from 0xbf167 to 0xd82c4 2023-07-14T18:17:18.611 INFO:tasks.workunit.client.0.smithi163.stdout:6844(188 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.611 INFO:tasks.workunit.client.0.smithi163.stdout:6845(189 mod 256): COPY 0x67f86 thru 0x6f678 (0x76f3 bytes) to 0xdc364 thru 0xe3a56 2023-07-14T18:17:18.611 INFO:tasks.workunit.client.0.smithi163.stdout:6846(190 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.611 INFO:tasks.workunit.client.0.smithi163.stdout:6847(191 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.611 INFO:tasks.workunit.client.0.smithi163.stdout:6848(192 mod 256): COPY 0x5f6da thru 0x61992 (0x22b9 bytes) to 0xecbd8 thru 0xeee90 2023-07-14T18:17:18.611 INFO:tasks.workunit.client.0.smithi163.stdout:6849(193 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.611 INFO:tasks.workunit.client.0.smithi163.stdout:6850(194 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.612 INFO:tasks.workunit.client.0.smithi163.stdout:6851(195 mod 256): WRITE 0xa3ab thru 0x1412b (0x9d81 bytes) 2023-07-14T18:17:18.612 INFO:tasks.workunit.client.0.smithi163.stdout:6852(196 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.612 INFO:tasks.workunit.client.0.smithi163.stdout:6853(197 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.612 INFO:tasks.workunit.client.0.smithi163.stdout:6854(198 mod 256): COPY 0x74b35 thru 0x76f90 (0x245c bytes) to 0x1b15a thru 0x1d5b5 2023-07-14T18:17:18.612 INFO:tasks.workunit.client.0.smithi163.stdout:6855(199 mod 256): COPY 0xb28e4 thru 0xb6f2e (0x464b bytes) to 0x119bc thru 0x16006 2023-07-14T18:17:18.612 INFO:tasks.workunit.client.0.smithi163.stdout:6856(200 mod 256): FALLOC 0x7aac thru 0x1111c (0x9670 bytes) INTERIOR 2023-07-14T18:17:18.612 INFO:tasks.workunit.client.0.smithi163.stdout:6857(201 mod 256): MAPWRITE 0xcd2 thru 0x41ed (0x351c bytes) 2023-07-14T18:17:18.612 INFO:tasks.workunit.client.0.smithi163.stdout:6858(202 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.613 INFO:tasks.workunit.client.0.smithi163.stdout:6859(203 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.613 INFO:tasks.workunit.client.0.smithi163.stdout:6860(204 mod 256): FALLOC 0xec789 thru 0xf99a4 (0xd21b bytes) PAST_EOF 2023-07-14T18:17:18.613 INFO:tasks.workunit.client.0.smithi163.stdout:6861(205 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.613 INFO:tasks.workunit.client.0.smithi163.stdout:6862(206 mod 256): MAPREAD 0x6d11 thru 0x8230 (0x1520 bytes) 2023-07-14T18:17:18.613 INFO:tasks.workunit.client.0.smithi163.stdout:6863(207 mod 256): TRUNCATE DOWN from 0xeee91 to 0x2951b ******WWWW 2023-07-14T18:17:18.613 INFO:tasks.workunit.client.0.smithi163.stdout:6864(208 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.613 INFO:tasks.workunit.client.0.smithi163.stdout:6865(209 mod 256): PUNCH 0x7598 thru 0x90a9 (0x1b12 bytes) 2023-07-14T18:17:18.613 INFO:tasks.workunit.client.0.smithi163.stdout:6866(210 mod 256): PUNCH 0x770f thru 0xa896 (0x3188 bytes) 2023-07-14T18:17:18.614 INFO:tasks.workunit.client.0.smithi163.stdout:6867(211 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.614 INFO:tasks.workunit.client.0.smithi163.stdout:6868(212 mod 256): PUNCH 0x1ee19 thru 0x26471 (0x7659 bytes) 2023-07-14T18:17:18.614 INFO:tasks.workunit.client.0.smithi163.stdout:6869(213 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.614 INFO:tasks.workunit.client.0.smithi163.stdout:6870(214 mod 256): FALLOC 0xc5747 thru 0xc70fb (0x19b4 bytes) EXTENDING 2023-07-14T18:17:18.614 INFO:tasks.workunit.client.0.smithi163.stdout:6871(215 mod 256): READ 0x34c4b thru 0x41a8c (0xce42 bytes) ***RRRR*** 2023-07-14T18:17:18.614 INFO:tasks.workunit.client.0.smithi163.stdout:6872(216 mod 256): READ 0x58cf3 thru 0x6289c (0x9baa bytes) 2023-07-14T18:17:18.614 INFO:tasks.workunit.client.0.smithi163.stdout:6873(217 mod 256): READ 0x8604e thru 0x92285 (0xc238 bytes) 2023-07-14T18:17:18.615 INFO:tasks.workunit.client.0.smithi163.stdout:6874(218 mod 256): COPY 0xab30c thru 0xb078a (0x547f bytes) to 0xc46c6 thru 0xc9b44 2023-07-14T18:17:18.615 INFO:tasks.workunit.client.0.smithi163.stdout:6875(219 mod 256): PUNCH 0xb230 thru 0x14d61 (0x9b32 bytes) 2023-07-14T18:17:18.615 INFO:tasks.workunit.client.0.smithi163.stdout:6876(220 mod 256): PUNCH 0xb5b6e thru 0xb5b9a (0x2d bytes) 2023-07-14T18:17:18.615 INFO:tasks.workunit.client.0.smithi163.stdout:6877(221 mod 256): COPY 0x58f57 thru 0x5b223 (0x22cd bytes) to 0x76cd9 thru 0x78fa5 2023-07-14T18:17:18.615 INFO:tasks.workunit.client.0.smithi163.stdout:6878(222 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.615 INFO:tasks.workunit.client.0.smithi163.stdout:6879(223 mod 256): MAPWRITE 0x58249 thru 0x65c85 (0xda3d bytes) 2023-07-14T18:17:18.615 INFO:tasks.workunit.client.0.smithi163.stdout:6880(224 mod 256): FALLOC 0x3712f thru 0x46135 (0xf006 bytes) INTERIOR ******FFFF 2023-07-14T18:17:18.615 INFO:tasks.workunit.client.0.smithi163.stdout:6881(225 mod 256): MAPREAD 0xb1b6b thru 0xbceb7 (0xb34d bytes) 2023-07-14T18:17:18.616 INFO:tasks.workunit.client.0.smithi163.stdout:6882(226 mod 256): READ 0x32827 thru 0x4069b (0xde75 bytes) ***RRRR*** 2023-07-14T18:17:18.616 INFO:tasks.workunit.client.0.smithi163.stdout:6883(227 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.616 INFO:tasks.workunit.client.0.smithi163.stdout:6884(228 mod 256): COPY 0x317db thru 0x404c1 (0xece7 bytes) to 0x44f3d thru 0x53c23 EEEE****** 2023-07-14T18:17:18.616 INFO:tasks.workunit.client.0.smithi163.stdout:6885(229 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.616 INFO:tasks.workunit.client.0.smithi163.stdout:6886(230 mod 256): MAPWRITE 0x78684 thru 0x83464 (0xade1 bytes) 2023-07-14T18:17:18.616 INFO:tasks.workunit.client.0.smithi163.stdout:6887(231 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.616 INFO:tasks.workunit.client.0.smithi163.stdout:6888(232 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.616 INFO:tasks.workunit.client.0.smithi163.stdout:6889(233 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.617 INFO:tasks.workunit.client.0.smithi163.stdout:6890(234 mod 256): MAPWRITE 0xf7d5a thru 0xfc93a (0x4be1 bytes) 2023-07-14T18:17:18.617 INFO:tasks.workunit.client.0.smithi163.stdout:6891(235 mod 256): WRITE 0x719f thru 0xaf13 (0x3d75 bytes) 2023-07-14T18:17:18.617 INFO:tasks.workunit.client.0.smithi163.stdout:6892(236 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.617 INFO:tasks.workunit.client.0.smithi163.stdout:6893(237 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.617 INFO:tasks.workunit.client.0.smithi163.stdout:6894(238 mod 256): MAPREAD 0x4b93e thru 0x4f11b (0x37de bytes) 2023-07-14T18:17:18.617 INFO:tasks.workunit.client.0.smithi163.stdout:6895(239 mod 256): READ 0x2dd00 thru 0x38769 (0xaa6a bytes) ***RRRR*** 2023-07-14T18:17:18.617 INFO:tasks.workunit.client.0.smithi163.stdout:6896(240 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.617 INFO:tasks.workunit.client.0.smithi163.stdout:6897(241 mod 256): WRITE 0xd6733 thru 0xd824c (0x1b1a bytes) 2023-07-14T18:17:18.618 INFO:tasks.workunit.client.0.smithi163.stdout:6898(242 mod 256): WRITE 0x61de thru 0xae6d (0x4c90 bytes) 2023-07-14T18:17:18.618 INFO:tasks.workunit.client.0.smithi163.stdout:6899(243 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.618 INFO:tasks.workunit.client.0.smithi163.stdout:6900(244 mod 256): MAPWRITE 0x6cb68 thru 0x7528c (0x8725 bytes) 2023-07-14T18:17:18.618 INFO:tasks.workunit.client.0.smithi163.stdout:6901(245 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.618 INFO:tasks.workunit.client.0.smithi163.stdout:6902(246 mod 256): PUNCH 0x36c01 thru 0x43c79 (0xd079 bytes) ******PPPP 2023-07-14T18:17:18.618 INFO:tasks.workunit.client.0.smithi163.stdout:6903(247 mod 256): MAPREAD 0x917cb thru 0x9bebb (0xa6f1 bytes) 2023-07-14T18:17:18.618 INFO:tasks.workunit.client.0.smithi163.stdout:6904(248 mod 256): PUNCH 0x47157 thru 0x5174f (0xa5f9 bytes) 2023-07-14T18:17:18.618 INFO:tasks.workunit.client.0.smithi163.stdout:6905(249 mod 256): COPY 0x3ffa9 thru 0x4c8e6 (0xc93e bytes) to 0x4b2e thru 0x1146b 2023-07-14T18:17:18.619 INFO:tasks.workunit.client.0.smithi163.stdout:6906(250 mod 256): PUNCH 0x272b6 thru 0x30f1f (0x9c6a bytes) 2023-07-14T18:17:18.619 INFO:tasks.workunit.client.0.smithi163.stdout:6907(251 mod 256): READ 0x4ff8f thru 0x56e0c (0x6e7e bytes) 2023-07-14T18:17:18.619 INFO:tasks.workunit.client.0.smithi163.stdout:6908(252 mod 256): WRITE 0xfde2b thru 0xfffff (0x21d5 bytes) HOLE 2023-07-14T18:17:18.619 INFO:tasks.workunit.client.0.smithi163.stdout:6909(253 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.619 INFO:tasks.workunit.client.0.smithi163.stdout:6910(254 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.619 INFO:tasks.workunit.client.0.smithi163.stdout:6911(255 mod 256): READ 0xb36af thru 0xb4544 (0xe96 bytes) 2023-07-14T18:17:18.619 INFO:tasks.workunit.client.0.smithi163.stdout:6912( 0 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.619 INFO:tasks.workunit.client.0.smithi163.stdout:6913( 1 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.620 INFO:tasks.workunit.client.0.smithi163.stdout:6914( 2 mod 256): MAPREAD 0x2ae56 thru 0x356f3 (0xa89e bytes) 2023-07-14T18:17:18.620 INFO:tasks.workunit.client.0.smithi163.stdout:6915( 3 mod 256): COPY 0xcc21a thru 0xd0297 (0x407e bytes) to 0xa433a thru 0xa83b7 2023-07-14T18:17:18.620 INFO:tasks.workunit.client.0.smithi163.stdout:6916( 4 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.620 INFO:tasks.workunit.client.0.smithi163.stdout:6917( 5 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.620 INFO:tasks.workunit.client.0.smithi163.stdout:6918( 6 mod 256): TRUNCATE DOWN from 0x100000 to 0x410cb 2023-07-14T18:17:18.620 INFO:tasks.workunit.client.0.smithi163.stdout:6919( 7 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.620 INFO:tasks.workunit.client.0.smithi163.stdout:6920( 8 mod 256): MAPREAD 0x3367a thru 0x37465 (0x3dec bytes) 2023-07-14T18:17:18.620 INFO:tasks.workunit.client.0.smithi163.stdout:6921( 9 mod 256): COPY 0x10d42 thru 0x192f7 (0x85b6 bytes) to 0x43af2 thru 0x4c0a7 2023-07-14T18:17:18.621 INFO:tasks.workunit.client.0.smithi163.stdout:6922( 10 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.621 INFO:tasks.workunit.client.0.smithi163.stdout:6923( 11 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.621 INFO:tasks.workunit.client.0.smithi163.stdout:6924( 12 mod 256): WRITE 0x151b3 thru 0x20c7b (0xbac9 bytes) 2023-07-14T18:17:18.621 INFO:tasks.workunit.client.0.smithi163.stdout:6925( 13 mod 256): PUNCH 0x8828 thru 0xd9cd (0x51a6 bytes) 2023-07-14T18:17:18.621 INFO:tasks.workunit.client.0.smithi163.stdout:6926( 14 mod 256): MAPWRITE 0xfee44 thru 0xfffff (0x11bc bytes) 2023-07-14T18:17:18.621 INFO:tasks.workunit.client.0.smithi163.stdout:6927( 15 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.621 INFO:tasks.workunit.client.0.smithi163.stdout:6928( 16 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.621 INFO:tasks.workunit.client.0.smithi163.stdout:6929( 17 mod 256): MAPREAD 0xb4721 thru 0xb6b85 (0x2465 bytes) 2023-07-14T18:17:18.622 INFO:tasks.workunit.client.0.smithi163.stdout:6930( 18 mod 256): PUNCH 0x5d5a3 thru 0x642c4 (0x6d22 bytes) 2023-07-14T18:17:18.622 INFO:tasks.workunit.client.0.smithi163.stdout:6931( 19 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.622 INFO:tasks.workunit.client.0.smithi163.stdout:6932( 20 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.622 INFO:tasks.workunit.client.0.smithi163.stdout:6933( 21 mod 256): PUNCH 0x43b66 thru 0x4c94c (0x8de7 bytes) 2023-07-14T18:17:18.622 INFO:tasks.workunit.client.0.smithi163.stdout:6934( 22 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.622 INFO:tasks.workunit.client.0.smithi163.stdout:6935( 23 mod 256): WRITE 0x26f2 thru 0x87a2 (0x60b1 bytes) 2023-07-14T18:17:18.622 INFO:tasks.workunit.client.0.smithi163.stdout:6936( 24 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.622 INFO:tasks.workunit.client.0.smithi163.stdout:6937( 25 mod 256): TRUNCATE DOWN from 0x100000 to 0x2f195 ******WWWW 2023-07-14T18:17:18.623 INFO:tasks.workunit.client.0.smithi163.stdout:6938( 26 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.623 INFO:tasks.workunit.client.0.smithi163.stdout:6939( 27 mod 256): MAPWRITE 0x23c48 thru 0x30d8a (0xd143 bytes) 2023-07-14T18:17:18.623 INFO:tasks.workunit.client.0.smithi163.stdout:6940( 28 mod 256): WRITE 0xb8405 thru 0xc7b25 (0xf721 bytes) HOLE ***WWWW 2023-07-14T18:17:18.623 INFO:tasks.workunit.client.0.smithi163.stdout:6941( 29 mod 256): COPY 0x14d1 thru 0x484f (0x337f bytes) to 0xe8aea thru 0xebe68 2023-07-14T18:17:18.623 INFO:tasks.workunit.client.0.smithi163.stdout:6942( 30 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.623 INFO:tasks.workunit.client.0.smithi163.stdout:6943( 31 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.623 INFO:tasks.workunit.client.0.smithi163.stdout:6944( 32 mod 256): TRUNCATE DOWN from 0xebe69 to 0xb7d8a 2023-07-14T18:17:18.623 INFO:tasks.workunit.client.0.smithi163.stdout:6945( 33 mod 256): PUNCH 0x6140 thru 0xbc43 (0x5b04 bytes) 2023-07-14T18:17:18.624 INFO:tasks.workunit.client.0.smithi163.stdout:6946( 34 mod 256): READ 0xa6b7 thru 0x12c2d (0x8577 bytes) 2023-07-14T18:17:18.624 INFO:tasks.workunit.client.0.smithi163.stdout:6947( 35 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.624 INFO:tasks.workunit.client.0.smithi163.stdout:6948( 36 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.624 INFO:tasks.workunit.client.0.smithi163.stdout:6949( 37 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.624 INFO:tasks.workunit.client.0.smithi163.stdout:6950( 38 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.624 INFO:tasks.workunit.client.0.smithi163.stdout:6951( 39 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.624 INFO:tasks.workunit.client.0.smithi163.stdout:6952( 40 mod 256): READ 0x93fcb thru 0x9c154 (0x818a bytes) 2023-07-14T18:17:18.624 INFO:tasks.workunit.client.0.smithi163.stdout:6953( 41 mod 256): MAPREAD 0x8b21e thru 0x9156b (0x634e bytes) 2023-07-14T18:17:18.625 INFO:tasks.workunit.client.0.smithi163.stdout:6954( 42 mod 256): COPY 0x2d506 thru 0x30c02 (0x36fd bytes) to 0xb97ac thru 0xbcea8 2023-07-14T18:17:18.625 INFO:tasks.workunit.client.0.smithi163.stdout:6955( 43 mod 256): PUNCH 0x83c6e thru 0x88015 (0x43a8 bytes) 2023-07-14T18:17:18.625 INFO:tasks.workunit.client.0.smithi163.stdout:6956( 44 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.625 INFO:tasks.workunit.client.0.smithi163.stdout:6957( 45 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.625 INFO:tasks.workunit.client.0.smithi163.stdout:6958( 46 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.625 INFO:tasks.workunit.client.0.smithi163.stdout:6959( 47 mod 256): COPY 0x57e27 thru 0x5ceb2 (0x508c bytes) to 0x9b3f8 thru 0xa0483 2023-07-14T18:17:18.625 INFO:tasks.workunit.client.0.smithi163.stdout:6960( 48 mod 256): WRITE 0xbaa11 thru 0xc2d79 (0x8369 bytes) EXTEND 2023-07-14T18:17:18.625 INFO:tasks.workunit.client.0.smithi163.stdout:6961( 49 mod 256): MAPWRITE 0x17fc8 thru 0x20b79 (0x8bb2 bytes) 2023-07-14T18:17:18.626 INFO:tasks.workunit.client.0.smithi163.stdout:6962( 50 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.626 INFO:tasks.workunit.client.0.smithi163.stdout:6963( 51 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.626 INFO:tasks.workunit.client.0.smithi163.stdout:6964( 52 mod 256): FALLOC 0x8601f thru 0x92022 (0xc003 bytes) INTERIOR 2023-07-14T18:17:18.626 INFO:tasks.workunit.client.0.smithi163.stdout:6965( 53 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.626 INFO:tasks.workunit.client.0.smithi163.stdout:6966( 54 mod 256): WRITE 0xa33ff thru 0xb29e6 (0xf5e8 bytes) 2023-07-14T18:17:18.626 INFO:tasks.workunit.client.0.smithi163.stdout:6967( 55 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.626 INFO:tasks.workunit.client.0.smithi163.stdout:6968( 56 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.626 INFO:tasks.workunit.client.0.smithi163.stdout:6969( 57 mod 256): PUNCH 0x1285 thru 0x5a68 (0x47e4 bytes) 2023-07-14T18:17:18.627 INFO:tasks.workunit.client.0.smithi163.stdout:6970( 58 mod 256): FALLOC 0x51c32 thru 0x5662c (0x49fa bytes) INTERIOR 2023-07-14T18:17:18.627 INFO:tasks.workunit.client.0.smithi163.stdout:6971( 59 mod 256): TRUNCATE DOWN from 0xc2d7a to 0x5c9f7 2023-07-14T18:17:18.627 INFO:tasks.workunit.client.0.smithi163.stdout:6972( 60 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.627 INFO:tasks.workunit.client.0.smithi163.stdout:6973( 61 mod 256): FALLOC 0xc36ad thru 0xc4747 (0x109a bytes) PAST_EOF 2023-07-14T18:17:18.627 INFO:tasks.workunit.client.0.smithi163.stdout:6974( 62 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.627 INFO:tasks.workunit.client.0.smithi163.stdout:6975( 63 mod 256): READ 0x1e638 thru 0x1f8a5 (0x126e bytes) 2023-07-14T18:17:18.627 INFO:tasks.workunit.client.0.smithi163.stdout:6976( 64 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.627 INFO:tasks.workunit.client.0.smithi163.stdout:6977( 65 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.628 INFO:tasks.workunit.client.0.smithi163.stdout:6978( 66 mod 256): MAPREAD 0x2c6c0 thru 0x37752 (0xb093 bytes) 2023-07-14T18:17:18.628 INFO:tasks.workunit.client.0.smithi163.stdout:6979( 67 mod 256): MAPWRITE 0xa787d thru 0xb1db7 (0xa53b bytes) 2023-07-14T18:17:18.628 INFO:tasks.workunit.client.0.smithi163.stdout:6980( 68 mod 256): TRUNCATE DOWN from 0xb1db8 to 0x69b00 2023-07-14T18:17:18.628 INFO:tasks.workunit.client.0.smithi163.stdout:6981( 69 mod 256): PUNCH 0x635b thru 0xb022 (0x4cc8 bytes) 2023-07-14T18:17:18.628 INFO:tasks.workunit.client.0.smithi163.stdout:6982( 70 mod 256): TRUNCATE DOWN from 0x69b00 to 0x4602d 2023-07-14T18:17:18.628 INFO:tasks.workunit.client.0.smithi163.stdout:6983( 71 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.628 INFO:tasks.workunit.client.0.smithi163.stdout:6984( 72 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.628 INFO:tasks.workunit.client.0.smithi163.stdout:6985( 73 mod 256): COPY 0x422b2 thru 0x4367c (0x13cb bytes) to 0xe9927 thru 0xeacf1 2023-07-14T18:17:18.629 INFO:tasks.workunit.client.0.smithi163.stdout:6986( 74 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.629 INFO:tasks.workunit.client.0.smithi163.stdout:6987( 75 mod 256): COPY 0x264a0 thru 0x291bd (0x2d1e bytes) to 0xf516d thru 0xf7e8a 2023-07-14T18:17:18.629 INFO:tasks.workunit.client.0.smithi163.stdout:6988( 76 mod 256): READ 0x254dc thru 0x2e34b (0x8e70 bytes) 2023-07-14T18:17:18.629 INFO:tasks.workunit.client.0.smithi163.stdout:6989( 77 mod 256): READ 0xb2369 thru 0xbbc71 (0x9909 bytes) 2023-07-14T18:17:18.629 INFO:tasks.workunit.client.0.smithi163.stdout:6990( 78 mod 256): FALLOC 0x938d1 thru 0x9d7f2 (0x9f21 bytes) INTERIOR 2023-07-14T18:17:18.629 INFO:tasks.workunit.client.0.smithi163.stdout:6991( 79 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.629 INFO:tasks.workunit.client.0.smithi163.stdout:6992( 80 mod 256): PUNCH 0x959ac thru 0x9a765 (0x4dba bytes) 2023-07-14T18:17:18.629 INFO:tasks.workunit.client.0.smithi163.stdout:6993( 81 mod 256): MAPREAD 0xc6c0b thru 0xd4300 (0xd6f6 bytes) 2023-07-14T18:17:18.630 INFO:tasks.workunit.client.0.smithi163.stdout:6994( 82 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.630 INFO:tasks.workunit.client.0.smithi163.stdout:6995( 83 mod 256): READ 0x6971 thru 0xb6eb (0x4d7b bytes) 2023-07-14T18:17:18.630 INFO:tasks.workunit.client.0.smithi163.stdout:6996( 84 mod 256): MAPREAD 0x4b463 thru 0x55968 (0xa506 bytes) 2023-07-14T18:17:18.630 INFO:tasks.workunit.client.0.smithi163.stdout:6997( 85 mod 256): PUNCH 0xe2812 thru 0xec72a (0x9f19 bytes) 2023-07-14T18:17:18.630 INFO:tasks.workunit.client.0.smithi163.stdout:6998( 86 mod 256): MAPWRITE 0x7bbe thru 0x14cfe (0xd141 bytes) 2023-07-14T18:17:18.630 INFO:tasks.workunit.client.0.smithi163.stdout:6999( 87 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.630 INFO:tasks.workunit.client.0.smithi163.stdout:7000( 88 mod 256): READ 0x32869 thru 0x40ba2 (0xe33a bytes) ***RRRR*** 2023-07-14T18:17:18.630 INFO:tasks.workunit.client.0.smithi163.stdout:7001( 89 mod 256): PUNCH 0xcf3eb thru 0xda745 (0xb35b bytes) 2023-07-14T18:17:18.631 INFO:tasks.workunit.client.0.smithi163.stdout:7002( 90 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.631 INFO:tasks.workunit.client.0.smithi163.stdout:7003( 91 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.631 INFO:tasks.workunit.client.0.smithi163.stdout:7004( 92 mod 256): MAPREAD 0xcb376 thru 0xdac62 (0xf8ed bytes) 2023-07-14T18:17:18.631 INFO:tasks.workunit.client.0.smithi163.stdout:7005( 93 mod 256): COPY 0x55616 thru 0x56b52 (0x153d bytes) to 0x850f9 thru 0x86635 2023-07-14T18:17:18.631 INFO:tasks.workunit.client.0.smithi163.stdout:7006( 94 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.631 INFO:tasks.workunit.client.0.smithi163.stdout:7007( 95 mod 256): MAPWRITE 0xf638c thru 0xfffff (0x9c74 bytes) 2023-07-14T18:17:18.631 INFO:tasks.workunit.client.0.smithi163.stdout:7008( 96 mod 256): FALLOC 0x12ce2 thru 0x17569 (0x4887 bytes) INTERIOR 2023-07-14T18:17:18.631 INFO:tasks.workunit.client.0.smithi163.stdout:7009( 97 mod 256): READ 0xc5c55 thru 0xcd513 (0x78bf bytes) 2023-07-14T18:17:18.632 INFO:tasks.workunit.client.0.smithi163.stdout:7010( 98 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.632 INFO:tasks.workunit.client.0.smithi163.stdout:7011( 99 mod 256): MAPREAD 0xb16e9 thru 0xb486e (0x3186 bytes) 2023-07-14T18:17:18.632 INFO:tasks.workunit.client.0.smithi163.stdout:7012(100 mod 256): TRUNCATE DOWN from 0x100000 to 0xb7461 2023-07-14T18:17:18.632 INFO:tasks.workunit.client.0.smithi163.stdout:7013(101 mod 256): MAPWRITE 0xeb8c9 thru 0xf4902 (0x903a bytes) 2023-07-14T18:17:18.632 INFO:tasks.workunit.client.0.smithi163.stdout:7014(102 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.632 INFO:tasks.workunit.client.0.smithi163.stdout:7015(103 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.632 INFO:tasks.workunit.client.0.smithi163.stdout:7016(104 mod 256): READ 0xa2b6d thru 0xb06f9 (0xdb8d bytes) 2023-07-14T18:17:18.632 INFO:tasks.workunit.client.0.smithi163.stdout:7017(105 mod 256): MAPWRITE 0x6c311 thru 0x6f475 (0x3165 bytes) 2023-07-14T18:17:18.633 INFO:tasks.workunit.client.0.smithi163.stdout:7018(106 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.633 INFO:tasks.workunit.client.0.smithi163.stdout:7019(107 mod 256): READ 0x1a70e thru 0x2a616 (0xff09 bytes) 2023-07-14T18:17:18.633 INFO:tasks.workunit.client.0.smithi163.stdout:7020(108 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.633 INFO:tasks.workunit.client.0.smithi163.stdout:7021(109 mod 256): MAPWRITE 0x635df thru 0x6dde3 (0xa805 bytes) 2023-07-14T18:17:18.633 INFO:tasks.workunit.client.0.smithi163.stdout:7022(110 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.633 INFO:tasks.workunit.client.0.smithi163.stdout:7023(111 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.633 INFO:tasks.workunit.client.0.smithi163.stdout:7024(112 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.633 INFO:tasks.workunit.client.0.smithi163.stdout:7025(113 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.634 INFO:tasks.workunit.client.0.smithi163.stdout:7026(114 mod 256): WRITE 0xe2889 thru 0xe6c60 (0x43d8 bytes) 2023-07-14T18:17:18.634 INFO:tasks.workunit.client.0.smithi163.stdout:7027(115 mod 256): MAPREAD 0x9c9c8 thru 0xa03c0 (0x39f9 bytes) 2023-07-14T18:17:18.634 INFO:tasks.workunit.client.0.smithi163.stdout:7028(116 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.634 INFO:tasks.workunit.client.0.smithi163.stdout:7029(117 mod 256): WRITE 0xd30fc thru 0xe1460 (0xe365 bytes) 2023-07-14T18:17:18.634 INFO:tasks.workunit.client.0.smithi163.stdout:7030(118 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.634 INFO:tasks.workunit.client.0.smithi163.stdout:7031(119 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.634 INFO:tasks.workunit.client.0.smithi163.stdout:7032(120 mod 256): FALLOC 0xc5be9 thru 0xc7a10 (0x1e27 bytes) INTERIOR 2023-07-14T18:17:18.634 INFO:tasks.workunit.client.0.smithi163.stdout:7033(121 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.635 INFO:tasks.workunit.client.0.smithi163.stdout:7034(122 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.635 INFO:tasks.workunit.client.0.smithi163.stdout:7035(123 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.635 INFO:tasks.workunit.client.0.smithi163.stdout:7036(124 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.635 INFO:tasks.workunit.client.0.smithi163.stdout:7037(125 mod 256): PUNCH 0x24cb5 thru 0x27933 (0x2c7f bytes) 2023-07-14T18:17:18.635 INFO:tasks.workunit.client.0.smithi163.stdout:7038(126 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.635 INFO:tasks.workunit.client.0.smithi163.stdout:7039(127 mod 256): MAPWRITE 0x2e0d7 thru 0x3aafd (0xca27 bytes) ******WWWW 2023-07-14T18:17:18.635 INFO:tasks.workunit.client.0.smithi163.stdout:7040(128 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.635 INFO:tasks.workunit.client.0.smithi163.stdout:7041(129 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.636 INFO:tasks.workunit.client.0.smithi163.stdout:7042(130 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.636 INFO:tasks.workunit.client.0.smithi163.stdout:7043(131 mod 256): COPY 0x2cd74 thru 0x38693 (0xb920 bytes) to 0x74ce5 thru 0x80604 EEEE****** 2023-07-14T18:17:18.636 INFO:tasks.workunit.client.0.smithi163.stdout:7044(132 mod 256): PUNCH 0xcff74 thru 0xd934a (0x93d7 bytes) 2023-07-14T18:17:18.636 INFO:tasks.workunit.client.0.smithi163.stdout:7045(133 mod 256): TRUNCATE DOWN from 0xf4903 to 0x3ba5f 2023-07-14T18:17:18.636 INFO:tasks.workunit.client.0.smithi163.stdout:7046(134 mod 256): MAPWRITE 0xa155e thru 0xaac77 (0x971a bytes) 2023-07-14T18:17:18.636 INFO:tasks.workunit.client.0.smithi163.stdout:7047(135 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.636 INFO:tasks.workunit.client.0.smithi163.stdout:7048(136 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.636 INFO:tasks.workunit.client.0.smithi163.stdout:7049(137 mod 256): TRUNCATE DOWN from 0xaac78 to 0x5298e 2023-07-14T18:17:18.637 INFO:tasks.workunit.client.0.smithi163.stdout:7050(138 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.637 INFO:tasks.workunit.client.0.smithi163.stdout:7051(139 mod 256): PUNCH 0xdace thru 0xe078 (0x5ab bytes) 2023-07-14T18:17:18.637 INFO:tasks.workunit.client.0.smithi163.stdout:7052(140 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.637 INFO:tasks.workunit.client.0.smithi163.stdout:7053(141 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.637 INFO:tasks.workunit.client.0.smithi163.stdout:7054(142 mod 256): WRITE 0x3a26c thru 0x48f88 (0xed1d bytes) 2023-07-14T18:17:18.637 INFO:tasks.workunit.client.0.smithi163.stdout:7055(143 mod 256): TRUNCATE UP from 0x5298e to 0xd40bf 2023-07-14T18:17:18.637 INFO:tasks.workunit.client.0.smithi163.stdout:7056(144 mod 256): FALLOC 0xb59e2 thru 0xbee34 (0x9452 bytes) INTERIOR 2023-07-14T18:17:18.637 INFO:tasks.workunit.client.0.smithi163.stdout:7057(145 mod 256): TRUNCATE DOWN from 0xd40bf to 0x54be ******WWWW 2023-07-14T18:17:18.638 INFO:tasks.workunit.client.0.smithi163.stdout:7058(146 mod 256): READ 0x11ad thru 0x54bd (0x4311 bytes) 2023-07-14T18:17:18.638 INFO:tasks.workunit.client.0.smithi163.stdout:7059(147 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.638 INFO:tasks.workunit.client.0.smithi163.stdout:7060(148 mod 256): MAPREAD 0xf54 thru 0x54bd (0x456a bytes) 2023-07-14T18:17:18.638 INFO:tasks.workunit.client.0.smithi163.stdout:7061(149 mod 256): MAPREAD 0x22e6 thru 0x54bd (0x31d8 bytes) 2023-07-14T18:17:18.638 INFO:tasks.workunit.client.0.smithi163.stdout:7062(150 mod 256): COPY 0x3ad5 thru 0x54bd (0x19e9 bytes) to 0x2de2a thru 0x2f812 2023-07-14T18:17:18.638 INFO:tasks.workunit.client.0.smithi163.stdout:7063(151 mod 256): COPY 0x586d thru 0xa647 (0x4ddb bytes) to 0xbea24 thru 0xc37fe 2023-07-14T18:17:18.638 INFO:tasks.workunit.client.0.smithi163.stdout:7064(152 mod 256): MAPREAD 0x65659 thru 0x6e8b2 (0x925a bytes) 2023-07-14T18:17:18.638 INFO:tasks.workunit.client.0.smithi163.stdout:7065(153 mod 256): PUNCH 0x88afa thru 0x8c16f (0x3676 bytes) 2023-07-14T18:17:18.639 INFO:tasks.workunit.client.0.smithi163.stdout:7066(154 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.639 INFO:tasks.workunit.client.0.smithi163.stdout:7067(155 mod 256): FALLOC 0xff2f0 thru 0x100000 (0xd10 bytes) EXTENDING 2023-07-14T18:17:18.639 INFO:tasks.workunit.client.0.smithi163.stdout:7068(156 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.639 INFO:tasks.workunit.client.0.smithi163.stdout:7069(157 mod 256): FALLOC 0x76693 thru 0x77d35 (0x16a2 bytes) INTERIOR 2023-07-14T18:17:18.639 INFO:tasks.workunit.client.0.smithi163.stdout:7070(158 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.639 INFO:tasks.workunit.client.0.smithi163.stdout:7071(159 mod 256): TRUNCATE DOWN from 0x100000 to 0x4082 ******WWWW 2023-07-14T18:17:18.639 INFO:tasks.workunit.client.0.smithi163.stdout:7072(160 mod 256): WRITE 0x7ae23 thru 0x89764 (0xe942 bytes) HOLE ***WWWW 2023-07-14T18:17:18.639 INFO:tasks.workunit.client.0.smithi163.stdout:7073(161 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.640 INFO:tasks.workunit.client.0.smithi163.stdout:7074(162 mod 256): READ 0x2d90d thru 0x3c110 (0xe804 bytes) ***RRRR*** 2023-07-14T18:17:18.640 INFO:tasks.workunit.client.0.smithi163.stdout:7075(163 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.640 INFO:tasks.workunit.client.0.smithi163.stdout:7076(164 mod 256): READ 0x22bc2 thru 0x32b32 (0xff71 bytes) 2023-07-14T18:17:18.640 INFO:tasks.workunit.client.0.smithi163.stdout:7077(165 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.640 INFO:tasks.workunit.client.0.smithi163.stdout:7078(166 mod 256): READ 0x7aa66 thru 0x888d1 (0xde6c bytes) 2023-07-14T18:17:18.640 INFO:tasks.workunit.client.0.smithi163.stdout:7079(167 mod 256): TRUNCATE DOWN from 0x89765 to 0x15ebd ******WWWW 2023-07-14T18:17:18.640 INFO:tasks.workunit.client.0.smithi163.stdout:7080(168 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.641 INFO:tasks.workunit.client.0.smithi163.stdout:7081(169 mod 256): TRUNCATE UP from 0x15ebd to 0x9bc3a ******WWWW 2023-07-14T18:17:18.641 INFO:tasks.workunit.client.0.smithi163.stdout:7082(170 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.641 INFO:tasks.workunit.client.0.smithi163.stdout:7083(171 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.641 INFO:tasks.workunit.client.0.smithi163.stdout:7084(172 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.641 INFO:tasks.workunit.client.0.smithi163.stdout:7085(173 mod 256): TRUNCATE DOWN from 0x9bc3a to 0x642f8 2023-07-14T18:17:18.641 INFO:tasks.workunit.client.0.smithi163.stdout:7086(174 mod 256): FALLOC 0x3532f thru 0x3feb3 (0xab84 bytes) INTERIOR ******FFFF 2023-07-14T18:17:18.641 INFO:tasks.workunit.client.0.smithi163.stdout:7087(175 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.641 INFO:tasks.workunit.client.0.smithi163.stdout:7088(176 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.641 INFO:tasks.workunit.client.0.smithi163.stdout:7089(177 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.642 INFO:tasks.workunit.client.0.smithi163.stdout:7090(178 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.642 INFO:tasks.workunit.client.0.smithi163.stdout:7091(179 mod 256): MAPREAD 0x4ff1e thru 0x5d13b (0xd21e bytes) 2023-07-14T18:17:18.642 INFO:tasks.workunit.client.0.smithi163.stdout:7092(180 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.642 INFO:tasks.workunit.client.0.smithi163.stdout:7093(181 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.642 INFO:tasks.workunit.client.0.smithi163.stdout:7094(182 mod 256): MAPREAD 0x2efa2 thru 0x36e67 (0x7ec6 bytes) 2023-07-14T18:17:18.642 INFO:tasks.workunit.client.0.smithi163.stdout:7095(183 mod 256): COPY 0x573fa thru 0x63f8c (0xcb93 bytes) to 0xc95c5 thru 0xd6157 2023-07-14T18:17:18.642 INFO:tasks.workunit.client.0.smithi163.stdout:7096(184 mod 256): MAPREAD 0x275df thru 0x2ecf6 (0x7718 bytes) 2023-07-14T18:17:18.642 INFO:tasks.workunit.client.0.smithi163.stdout:7097(185 mod 256): READ 0xb762b thru 0xba268 (0x2c3e bytes) 2023-07-14T18:17:18.643 INFO:tasks.workunit.client.0.smithi163.stdout:7098(186 mod 256): TRUNCATE DOWN from 0xd6158 to 0x14034 ******WWWW 2023-07-14T18:17:18.643 INFO:tasks.workunit.client.0.smithi163.stdout:7099(187 mod 256): FALLOC 0x18dae thru 0x1a9e2 (0x1c34 bytes) PAST_EOF 2023-07-14T18:17:18.643 INFO:tasks.workunit.client.0.smithi163.stdout:7100(188 mod 256): TRUNCATE UP from 0x14034 to 0xd586b ******WWWW 2023-07-14T18:17:18.643 INFO:tasks.workunit.client.0.smithi163.stdout:7101(189 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.643 INFO:tasks.workunit.client.0.smithi163.stdout:7102(190 mod 256): TRUNCATE DOWN from 0xd586b to 0x85dd4 2023-07-14T18:17:18.643 INFO:tasks.workunit.client.0.smithi163.stdout:7103(191 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.643 INFO:tasks.workunit.client.0.smithi163.stdout:7104(192 mod 256): TRUNCATE DOWN from 0x85dd4 to 0xbc65 ******WWWW 2023-07-14T18:17:18.643 INFO:tasks.workunit.client.0.smithi163.stdout:7105(193 mod 256): MAPWRITE 0xec0e1 thru 0xeeddc (0x2cfc bytes) 2023-07-14T18:17:18.644 INFO:tasks.workunit.client.0.smithi163.stdout:7106(194 mod 256): MAPREAD 0x9c822 thru 0xaaba9 (0xe388 bytes) 2023-07-14T18:17:18.644 INFO:tasks.workunit.client.0.smithi163.stdout:7107(195 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.644 INFO:tasks.workunit.client.0.smithi163.stdout:7108(196 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.644 INFO:tasks.workunit.client.0.smithi163.stdout:7109(197 mod 256): MAPWRITE 0xde62d thru 0xe8a15 (0xa3e9 bytes) 2023-07-14T18:17:18.644 INFO:tasks.workunit.client.0.smithi163.stdout:7110(198 mod 256): FALLOC 0x46a10 thru 0x4e082 (0x7672 bytes) INTERIOR 2023-07-14T18:17:18.644 INFO:tasks.workunit.client.0.smithi163.stdout:7111(199 mod 256): PUNCH 0xa29c7 thru 0xa651c (0x3b56 bytes) 2023-07-14T18:17:18.644 INFO:tasks.workunit.client.0.smithi163.stdout:7112(200 mod 256): WRITE 0x79aec thru 0x831dd (0x96f2 bytes) 2023-07-14T18:17:18.645 INFO:tasks.workunit.client.0.smithi163.stdout:7113(201 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.645 INFO:tasks.workunit.client.0.smithi163.stdout:7114(202 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.645 INFO:tasks.workunit.client.0.smithi163.stdout:7115(203 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.645 INFO:tasks.workunit.client.0.smithi163.stdout:7116(204 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.645 INFO:tasks.workunit.client.0.smithi163.stdout:7117(205 mod 256): FALLOC 0xd387c thru 0xe1970 (0xe0f4 bytes) INTERIOR 2023-07-14T18:17:18.645 INFO:tasks.workunit.client.0.smithi163.stdout:7118(206 mod 256): TRUNCATE DOWN from 0xeeddd to 0x63e8 ******WWWW 2023-07-14T18:17:18.645 INFO:tasks.workunit.client.0.smithi163.stdout:7119(207 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.645 INFO:tasks.workunit.client.0.smithi163.stdout:7120(208 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.646 INFO:tasks.workunit.client.0.smithi163.stdout:7121(209 mod 256): PUNCH 0x61cb thru 0x63e7 (0x21d bytes) 2023-07-14T18:17:18.646 INFO:tasks.workunit.client.0.smithi163.stdout:7122(210 mod 256): COPY 0x4294 thru 0x63e7 (0x2154 bytes) to 0x3a13a thru 0x3c28d 2023-07-14T18:17:18.646 INFO:tasks.workunit.client.0.smithi163.stdout:7123(211 mod 256): COPY 0x10239 thru 0x13bc0 (0x3988 bytes) to 0xd9a58 thru 0xdd3df 2023-07-14T18:17:18.646 INFO:tasks.workunit.client.0.smithi163.stdout:7124(212 mod 256): TRUNCATE DOWN from 0xdd3e0 to 0x1431b ******WWWW 2023-07-14T18:17:18.646 INFO:tasks.workunit.client.0.smithi163.stdout:7125(213 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.646 INFO:tasks.workunit.client.0.smithi163.stdout:7126(214 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.646 INFO:tasks.workunit.client.0.smithi163.stdout:7127(215 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.646 INFO:tasks.workunit.client.0.smithi163.stdout:7128(216 mod 256): MAPWRITE 0xbb0fe thru 0xc2a12 (0x7915 bytes) 2023-07-14T18:17:18.646 INFO:tasks.workunit.client.0.smithi163.stdout:7129(217 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.647 INFO:tasks.workunit.client.0.smithi163.stdout:7130(218 mod 256): PUNCH 0x420c3 thru 0x44366 (0x22a4 bytes) 2023-07-14T18:17:18.647 INFO:tasks.workunit.client.0.smithi163.stdout:7131(219 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.647 INFO:tasks.workunit.client.0.smithi163.stdout:7132(220 mod 256): WRITE 0xe6102 thru 0xea373 (0x4272 bytes) HOLE 2023-07-14T18:17:18.647 INFO:tasks.workunit.client.0.smithi163.stdout:7133(221 mod 256): TRUNCATE DOWN from 0xea374 to 0x669a5 2023-07-14T18:17:18.647 INFO:tasks.workunit.client.0.smithi163.stdout:7134(222 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.647 INFO:tasks.workunit.client.0.smithi163.stdout:7135(223 mod 256): MAPREAD 0x653c7 thru 0x669a4 (0x15de bytes) 2023-07-14T18:17:18.647 INFO:tasks.workunit.client.0.smithi163.stdout:7136(224 mod 256): WRITE 0xd8709 thru 0xe1a90 (0x9388 bytes) HOLE 2023-07-14T18:17:18.647 INFO:tasks.workunit.client.0.smithi163.stdout:7137(225 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.648 INFO:tasks.workunit.client.0.smithi163.stdout:7138(226 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.648 INFO:tasks.workunit.client.0.smithi163.stdout:7139(227 mod 256): MAPREAD 0xc37b7 thru 0xd3152 (0xf99c bytes) 2023-07-14T18:17:18.648 INFO:tasks.workunit.client.0.smithi163.stdout:7140(228 mod 256): FALLOC 0xebb63 thru 0xf089b (0x4d38 bytes) PAST_EOF 2023-07-14T18:17:18.648 INFO:tasks.workunit.client.0.smithi163.stdout:7141(229 mod 256): FALLOC 0x1e880 thru 0x20468 (0x1be8 bytes) INTERIOR 2023-07-14T18:17:18.648 INFO:tasks.workunit.client.0.smithi163.stdout:7142(230 mod 256): READ 0xd770 thru 0x17b3e (0xa3cf bytes) 2023-07-14T18:17:18.648 INFO:tasks.workunit.client.0.smithi163.stdout:7143(231 mod 256): MAPREAD 0x36e6e thru 0x38254 (0x13e7 bytes) ***RRRR*** 2023-07-14T18:17:18.648 INFO:tasks.workunit.client.0.smithi163.stdout:7144(232 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.649 INFO:tasks.workunit.client.0.smithi163.stdout:7145(233 mod 256): PUNCH 0x79d2f thru 0x7eab2 (0x4d84 bytes) 2023-07-14T18:17:18.649 INFO:tasks.workunit.client.0.smithi163.stdout:7146(234 mod 256): READ 0xaabcb thru 0xb9aa9 (0xeedf bytes) 2023-07-14T18:17:18.649 INFO:tasks.workunit.client.0.smithi163.stdout:7147(235 mod 256): PUNCH 0x42c15 thru 0x49f7e (0x736a bytes) 2023-07-14T18:17:18.649 INFO:tasks.workunit.client.0.smithi163.stdout:7148(236 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.649 INFO:tasks.workunit.client.0.smithi163.stdout:7149(237 mod 256): MAPWRITE 0xe4f18 thru 0xe5bb6 (0xc9f bytes) 2023-07-14T18:17:18.649 INFO:tasks.workunit.client.0.smithi163.stdout:7150(238 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.649 INFO:tasks.workunit.client.0.smithi163.stdout:7151(239 mod 256): MAPWRITE 0xbf06 thru 0x16acf (0xabca bytes) 2023-07-14T18:17:18.649 INFO:tasks.workunit.client.0.smithi163.stdout:7152(240 mod 256): READ 0xe5236 thru 0xe5bb6 (0x981 bytes) 2023-07-14T18:17:18.650 INFO:tasks.workunit.client.0.smithi163.stdout:7153(241 mod 256): READ 0xce906 thru 0xd1a09 (0x3104 bytes) 2023-07-14T18:17:18.650 INFO:tasks.workunit.client.0.smithi163.stdout:7154(242 mod 256): MAPREAD 0xd6c5b thru 0xdadc7 (0x416d bytes) 2023-07-14T18:17:18.650 INFO:tasks.workunit.client.0.smithi163.stdout:7155(243 mod 256): MAPREAD 0x9760 thru 0xfe2a (0x66cb bytes) 2023-07-14T18:17:18.650 INFO:tasks.workunit.client.0.smithi163.stdout:7156(244 mod 256): FALLOC 0xcaabf thru 0xd57a6 (0xace7 bytes) INTERIOR 2023-07-14T18:17:18.650 INFO:tasks.workunit.client.0.smithi163.stdout:7157(245 mod 256): READ 0xd3ef6 thru 0xe1bf5 (0xdd00 bytes) 2023-07-14T18:17:18.650 INFO:tasks.workunit.client.0.smithi163.stdout:7158(246 mod 256): FALLOC 0x5f828 thru 0x63aae (0x4286 bytes) INTERIOR 2023-07-14T18:17:18.650 INFO:tasks.workunit.client.0.smithi163.stdout:7159(247 mod 256): COPY 0xcd2fb thru 0xd58fe (0x8604 bytes) to 0x6f3ec thru 0x779ef 2023-07-14T18:17:18.650 INFO:tasks.workunit.client.0.smithi163.stdout:7160(248 mod 256): READ 0x7fdae thru 0x80fa3 (0x11f6 bytes) 2023-07-14T18:17:18.651 INFO:tasks.workunit.client.0.smithi163.stdout:7161(249 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.651 INFO:tasks.workunit.client.0.smithi163.stdout:7162(250 mod 256): COPY 0xa218f thru 0xa4ab0 (0x2922 bytes) to 0x7628d thru 0x78bae 2023-07-14T18:17:18.651 INFO:tasks.workunit.client.0.smithi163.stdout:7163(251 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.651 INFO:tasks.workunit.client.0.smithi163.stdout:7164(252 mod 256): COPY 0xacae4 thru 0xb27ac (0x5cc9 bytes) to 0x6543b thru 0x6b103 2023-07-14T18:17:18.651 INFO:tasks.workunit.client.0.smithi163.stdout:7165(253 mod 256): TRUNCATE DOWN from 0xe5bb7 to 0x70c4b 2023-07-14T18:17:18.651 INFO:tasks.workunit.client.0.smithi163.stdout:7166(254 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.651 INFO:tasks.workunit.client.0.smithi163.stdout:7167(255 mod 256): READ 0x6294f thru 0x700c3 (0xd775 bytes) 2023-07-14T18:17:18.651 INFO:tasks.workunit.client.0.smithi163.stdout:7168( 0 mod 256): MAPREAD 0x15f70 thru 0x1aef0 (0x4f81 bytes) 2023-07-14T18:17:18.652 INFO:tasks.workunit.client.0.smithi163.stdout:7169( 1 mod 256): MAPREAD 0x630fb thru 0x70c4a (0xdb50 bytes) 2023-07-14T18:17:18.652 INFO:tasks.workunit.client.0.smithi163.stdout:7170( 2 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.652 INFO:tasks.workunit.client.0.smithi163.stdout:7171( 3 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.652 INFO:tasks.workunit.client.0.smithi163.stdout:7172( 4 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.652 INFO:tasks.workunit.client.0.smithi163.stdout:7173( 5 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.652 INFO:tasks.workunit.client.0.smithi163.stdout:7174( 6 mod 256): PUNCH 0x2e019 thru 0x36298 (0x8280 bytes) 2023-07-14T18:17:18.652 INFO:tasks.workunit.client.0.smithi163.stdout:7175( 7 mod 256): COPY 0x59302 thru 0x5c25d (0x2f5c bytes) to 0xe7d30 thru 0xeac8b 2023-07-14T18:17:18.652 INFO:tasks.workunit.client.0.smithi163.stdout:7176( 8 mod 256): PUNCH 0x6d06 thru 0xd3e0 (0x66db bytes) 2023-07-14T18:17:18.653 INFO:tasks.workunit.client.0.smithi163.stdout:7177( 9 mod 256): COPY 0x8ccf6 thru 0x94a26 (0x7d31 bytes) to 0xace38 thru 0xb4b68 2023-07-14T18:17:18.653 INFO:tasks.workunit.client.0.smithi163.stdout:7178( 10 mod 256): PUNCH 0x4b00 thru 0x68be (0x1dbf bytes) 2023-07-14T18:17:18.653 INFO:tasks.workunit.client.0.smithi163.stdout:7179( 11 mod 256): FALLOC 0xd5e41 thru 0xd818d (0x234c bytes) INTERIOR 2023-07-14T18:17:18.653 INFO:tasks.workunit.client.0.smithi163.stdout:7180( 12 mod 256): MAPWRITE 0x1c3c6 thru 0x20b95 (0x47d0 bytes) 2023-07-14T18:17:18.653 INFO:tasks.workunit.client.0.smithi163.stdout:7181( 13 mod 256): MAPREAD 0x8b74a thru 0x93256 (0x7b0d bytes) 2023-07-14T18:17:18.653 INFO:tasks.workunit.client.0.smithi163.stdout:7182( 14 mod 256): MAPWRITE 0x82c34 thru 0x86b4f (0x3f1c bytes) 2023-07-14T18:17:18.653 INFO:tasks.workunit.client.0.smithi163.stdout:7183( 15 mod 256): TRUNCATE DOWN from 0xeac8c to 0x987fb 2023-07-14T18:17:18.653 INFO:tasks.workunit.client.0.smithi163.stdout:7184( 16 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.654 INFO:tasks.workunit.client.0.smithi163.stdout:7185( 17 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.654 INFO:tasks.workunit.client.0.smithi163.stdout:7186( 18 mod 256): COPY 0x8302d thru 0x8e197 (0xb16b bytes) to 0x6e4ba thru 0x79624 2023-07-14T18:17:18.654 INFO:tasks.workunit.client.0.smithi163.stdout:7187( 19 mod 256): MAPWRITE 0x3533c thru 0x40430 (0xb0f5 bytes) ******WWWW 2023-07-14T18:17:18.654 INFO:tasks.workunit.client.0.smithi163.stdout:7188( 20 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.654 INFO:tasks.workunit.client.0.smithi163.stdout:7189( 21 mod 256): WRITE 0xb8310 thru 0xc77da (0xf4cb bytes) HOLE 2023-07-14T18:17:18.654 INFO:tasks.workunit.client.0.smithi163.stdout:7190( 22 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.654 INFO:tasks.workunit.client.0.smithi163.stdout:7191( 23 mod 256): PUNCH 0x9e89d thru 0xa5256 (0x69ba bytes) 2023-07-14T18:17:18.654 INFO:tasks.workunit.client.0.smithi163.stdout:7192( 24 mod 256): PUNCH 0xc1b3a thru 0xc77da (0x5ca1 bytes) 2023-07-14T18:17:18.655 INFO:tasks.workunit.client.0.smithi163.stdout:7193( 25 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.655 INFO:tasks.workunit.client.0.smithi163.stdout:7194( 26 mod 256): TRUNCATE UP from 0xc77db to 0xf756c 2023-07-14T18:17:18.655 INFO:tasks.workunit.client.0.smithi163.stdout:7195( 27 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.655 INFO:tasks.workunit.client.0.smithi163.stdout:7196( 28 mod 256): WRITE 0x8884c thru 0x96f0a (0xe6bf bytes) 2023-07-14T18:17:18.655 INFO:tasks.workunit.client.0.smithi163.stdout:7197( 29 mod 256): WRITE 0x48e4f thru 0x4aa13 (0x1bc5 bytes) 2023-07-14T18:17:18.655 INFO:tasks.workunit.client.0.smithi163.stdout:7198( 30 mod 256): TRUNCATE DOWN from 0xf756c to 0xb9949 2023-07-14T18:17:18.655 INFO:tasks.workunit.client.0.smithi163.stdout:7199( 31 mod 256): FALLOC 0x75b4f thru 0x7ba02 (0x5eb3 bytes) INTERIOR 2023-07-14T18:17:18.655 INFO:tasks.workunit.client.0.smithi163.stdout:7200( 32 mod 256): MAPREAD 0x1d8f9 thru 0x26ae6 (0x91ee bytes) 2023-07-14T18:17:18.656 INFO:tasks.workunit.client.0.smithi163.stdout:7201( 33 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.656 INFO:tasks.workunit.client.0.smithi163.stdout:7202( 34 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.656 INFO:tasks.workunit.client.0.smithi163.stdout:7203( 35 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.656 INFO:tasks.workunit.client.0.smithi163.stdout:7204( 36 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.656 INFO:tasks.workunit.client.0.smithi163.stdout:7205( 37 mod 256): TRUNCATE DOWN from 0xb9949 to 0x729cd 2023-07-14T18:17:18.656 INFO:tasks.workunit.client.0.smithi163.stdout:7206( 38 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.656 INFO:tasks.workunit.client.0.smithi163.stdout:7207( 39 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.656 INFO:tasks.workunit.client.0.smithi163.stdout:7208( 40 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.657 INFO:tasks.workunit.client.0.smithi163.stdout:7209( 41 mod 256): WRITE 0x7dbf4 thru 0x83587 (0x5994 bytes) HOLE 2023-07-14T18:17:18.657 INFO:tasks.workunit.client.0.smithi163.stdout:7210( 42 mod 256): MAPREAD 0x5818a thru 0x5ec77 (0x6aee bytes) 2023-07-14T18:17:18.657 INFO:tasks.workunit.client.0.smithi163.stdout:7211( 43 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.657 INFO:tasks.workunit.client.0.smithi163.stdout:7212( 44 mod 256): READ 0x66b3 thru 0x10fae (0xa8fc bytes) 2023-07-14T18:17:18.657 INFO:tasks.workunit.client.0.smithi163.stdout:7213( 45 mod 256): MAPWRITE 0xd2ce1 thru 0xd57f1 (0x2b11 bytes) 2023-07-14T18:17:18.657 INFO:tasks.workunit.client.0.smithi163.stdout:7214( 46 mod 256): MAPREAD 0x4b1ac thru 0x52369 (0x71be bytes) 2023-07-14T18:17:18.657 INFO:tasks.workunit.client.0.smithi163.stdout:7215( 47 mod 256): MAPWRITE 0xd3081 thru 0xda8af (0x782f bytes) 2023-07-14T18:17:18.657 INFO:tasks.workunit.client.0.smithi163.stdout:7216( 48 mod 256): READ 0xd03c1 thru 0xd8b44 (0x8784 bytes) 2023-07-14T18:17:18.658 INFO:tasks.workunit.client.0.smithi163.stdout:7217( 49 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.658 INFO:tasks.workunit.client.0.smithi163.stdout:7218( 50 mod 256): MAPWRITE 0xe5f72 thru 0xf1abe (0xbb4d bytes) 2023-07-14T18:17:18.658 INFO:tasks.workunit.client.0.smithi163.stdout:7219( 51 mod 256): MAPREAD 0xdd1a0 thru 0xea32f (0xd190 bytes) 2023-07-14T18:17:18.658 INFO:tasks.workunit.client.0.smithi163.stdout:7220( 52 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.658 INFO:tasks.workunit.client.0.smithi163.stdout:7221( 53 mod 256): MAPWRITE 0xaa69f thru 0xaeb1e (0x4480 bytes) 2023-07-14T18:17:18.658 INFO:tasks.workunit.client.0.smithi163.stdout:7222( 54 mod 256): COPY 0x9f26 thru 0x14b3b (0xac16 bytes) to 0x25d34 thru 0x30949 2023-07-14T18:17:18.658 INFO:tasks.workunit.client.0.smithi163.stdout:7223( 55 mod 256): READ 0xa9bb6 thru 0xb84cc (0xe917 bytes) 2023-07-14T18:17:18.658 INFO:tasks.workunit.client.0.smithi163.stdout:7224( 56 mod 256): MAPWRITE 0x5b09a thru 0x5d4e2 (0x2449 bytes) 2023-07-14T18:17:18.659 INFO:tasks.workunit.client.0.smithi163.stdout:7225( 57 mod 256): READ 0xc25a0 thru 0xca7c3 (0x8224 bytes) 2023-07-14T18:17:18.659 INFO:tasks.workunit.client.0.smithi163.stdout:7226( 58 mod 256): MAPREAD 0x98f96 thru 0xa86ec (0xf757 bytes) 2023-07-14T18:17:18.659 INFO:tasks.workunit.client.0.smithi163.stdout:7227( 59 mod 256): WRITE 0xf01ee thru 0xf5152 (0x4f65 bytes) EXTEND 2023-07-14T18:17:18.659 INFO:tasks.workunit.client.0.smithi163.stdout:7228( 60 mod 256): MAPREAD 0xb5470 thru 0xc29c5 (0xd556 bytes) 2023-07-14T18:17:18.659 INFO:tasks.workunit.client.0.smithi163.stdout:7229( 61 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.659 INFO:tasks.workunit.client.0.smithi163.stdout:7230( 62 mod 256): WRITE 0xa2532 thru 0xa9773 (0x7242 bytes) 2023-07-14T18:17:18.659 INFO:tasks.workunit.client.0.smithi163.stdout:7231( 63 mod 256): WRITE 0x1f7fc thru 0x2ed55 (0xf55a bytes) 2023-07-14T18:17:18.659 INFO:tasks.workunit.client.0.smithi163.stdout:7232( 64 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.660 INFO:tasks.workunit.client.0.smithi163.stdout:7233( 65 mod 256): MAPWRITE 0x37382 thru 0x3f260 (0x7edf bytes) ******WWWW 2023-07-14T18:17:18.660 INFO:tasks.workunit.client.0.smithi163.stdout:7234( 66 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.660 INFO:tasks.workunit.client.0.smithi163.stdout:7235( 67 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.660 INFO:tasks.workunit.client.0.smithi163.stdout:7236( 68 mod 256): READ 0x77c3 thru 0x12d04 (0xb542 bytes) 2023-07-14T18:17:18.660 INFO:tasks.workunit.client.0.smithi163.stdout:7237( 69 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.660 INFO:tasks.workunit.client.0.smithi163.stdout:7238( 70 mod 256): TRUNCATE DOWN from 0xf5153 to 0x7b87c 2023-07-14T18:17:18.660 INFO:tasks.workunit.client.0.smithi163.stdout:7239( 71 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.660 INFO:tasks.workunit.client.0.smithi163.stdout:7240( 72 mod 256): MAPWRITE 0xc39e4 thru 0xc8472 (0x4a8f bytes) 2023-07-14T18:17:18.661 INFO:tasks.workunit.client.0.smithi163.stdout:7241( 73 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.661 INFO:tasks.workunit.client.0.smithi163.stdout:7242( 74 mod 256): COPY 0x3c4f thru 0x62b9 (0x266b bytes) to 0x1c735 thru 0x1ed9f 2023-07-14T18:17:18.661 INFO:tasks.workunit.client.0.smithi163.stdout:7243( 75 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.661 INFO:tasks.workunit.client.0.smithi163.stdout:7244( 76 mod 256): PUNCH 0x8fee9 thru 0x91fa2 (0x20ba bytes) 2023-07-14T18:17:18.661 INFO:tasks.workunit.client.0.smithi163.stdout:7245( 77 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.661 INFO:tasks.workunit.client.0.smithi163.stdout:7246( 78 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.661 INFO:tasks.workunit.client.0.smithi163.stdout:7247( 79 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.661 INFO:tasks.workunit.client.0.smithi163.stdout:7248( 80 mod 256): COPY 0x393d6 thru 0x3ac61 (0x188c bytes) to 0x947f thru 0xad0a 2023-07-14T18:17:18.662 INFO:tasks.workunit.client.0.smithi163.stdout:7249( 81 mod 256): COPY 0xed33 thru 0x165f3 (0x78c1 bytes) to 0x93972 thru 0x9b232 2023-07-14T18:17:18.662 INFO:tasks.workunit.client.0.smithi163.stdout:7250( 82 mod 256): READ 0xc64c2 thru 0xc8472 (0x1fb1 bytes) 2023-07-14T18:17:18.662 INFO:tasks.workunit.client.0.smithi163.stdout:7251( 83 mod 256): WRITE 0xa7e17 thru 0xaa8ef (0x2ad9 bytes) 2023-07-14T18:17:18.662 INFO:tasks.workunit.client.0.smithi163.stdout:7252( 84 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.662 INFO:tasks.workunit.client.0.smithi163.stdout:7253( 85 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.662 INFO:tasks.workunit.client.0.smithi163.stdout:7254( 86 mod 256): FALLOC 0xb2e2e thru 0xc020d (0xd3df bytes) INTERIOR 2023-07-14T18:17:18.662 INFO:tasks.workunit.client.0.smithi163.stdout:7255( 87 mod 256): WRITE 0xa8b5a thru 0xb3719 (0xabc0 bytes) 2023-07-14T18:17:18.662 INFO:tasks.workunit.client.0.smithi163.stdout:7256( 88 mod 256): COPY 0x34fa4 thru 0x409b0 (0xba0d bytes) to 0x765ea thru 0x81ff6 EEEE****** 2023-07-14T18:17:18.663 INFO:tasks.workunit.client.0.smithi163.stdout:7257( 89 mod 256): COPY 0x17a55 thru 0x23b67 (0xc113 bytes) to 0x2caba thru 0x38bcc ******EEEE 2023-07-14T18:17:18.663 INFO:tasks.workunit.client.0.smithi163.stdout:7258( 90 mod 256): PUNCH 0x5ba49 thru 0x5c20b (0x7c3 bytes) 2023-07-14T18:17:18.663 INFO:tasks.workunit.client.0.smithi163.stdout:7259( 91 mod 256): READ 0x329e5 thru 0x406d7 (0xdcf3 bytes) ***RRRR*** 2023-07-14T18:17:18.663 INFO:tasks.workunit.client.0.smithi163.stdout:7260( 92 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.663 INFO:tasks.workunit.client.0.smithi163.stdout:7261( 93 mod 256): WRITE 0xc1c33 thru 0xd12f5 (0xf6c3 bytes) EXTEND 2023-07-14T18:17:18.663 INFO:tasks.workunit.client.0.smithi163.stdout:7262( 94 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.663 INFO:tasks.workunit.client.0.smithi163.stdout:7263( 95 mod 256): READ 0x85219 thru 0x92769 (0xd551 bytes) 2023-07-14T18:17:18.663 INFO:tasks.workunit.client.0.smithi163.stdout:7264( 96 mod 256): MAPREAD 0x5c5e4 thru 0x69f51 (0xd96e bytes) 2023-07-14T18:17:18.664 INFO:tasks.workunit.client.0.smithi163.stdout:7265( 97 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.664 INFO:tasks.workunit.client.0.smithi163.stdout:7266( 98 mod 256): FALLOC 0x31732 thru 0x32d63 (0x1631 bytes) INTERIOR 2023-07-14T18:17:18.664 INFO:tasks.workunit.client.0.smithi163.stdout:7267( 99 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.664 INFO:tasks.workunit.client.0.smithi163.stdout:7268(100 mod 256): WRITE 0x15bb1 thru 0x24a01 (0xee51 bytes) 2023-07-14T18:17:18.664 INFO:tasks.workunit.client.0.smithi163.stdout:7269(101 mod 256): PUNCH 0xbf730 thru 0xc0ea9 (0x177a bytes) 2023-07-14T18:17:18.664 INFO:tasks.workunit.client.0.smithi163.stdout:7270(102 mod 256): MAPWRITE 0xccc1 thru 0x10518 (0x3858 bytes) 2023-07-14T18:17:18.664 INFO:tasks.workunit.client.0.smithi163.stdout:7271(103 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.664 INFO:tasks.workunit.client.0.smithi163.stdout:7272(104 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.665 INFO:tasks.workunit.client.0.smithi163.stdout:7273(105 mod 256): TRUNCATE UP from 0xd12f6 to 0xd1a16 2023-07-14T18:17:18.665 INFO:tasks.workunit.client.0.smithi163.stdout:7274(106 mod 256): FALLOC 0x49cf9 thru 0x54a71 (0xad78 bytes) INTERIOR 2023-07-14T18:17:18.665 INFO:tasks.workunit.client.0.smithi163.stdout:7275(107 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.665 INFO:tasks.workunit.client.0.smithi163.stdout:7276(108 mod 256): WRITE 0xb5668 thru 0xba932 (0x52cb bytes) 2023-07-14T18:17:18.665 INFO:tasks.workunit.client.0.smithi163.stdout:7277(109 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.665 INFO:tasks.workunit.client.0.smithi163.stdout:7278(110 mod 256): WRITE 0x9d181 thru 0x9e186 (0x1006 bytes) 2023-07-14T18:17:18.665 INFO:tasks.workunit.client.0.smithi163.stdout:7279(111 mod 256): MAPREAD 0x5c503 thru 0x67bce (0xb6cc bytes) 2023-07-14T18:17:18.665 INFO:tasks.workunit.client.0.smithi163.stdout:7280(112 mod 256): TRUNCATE UP from 0xd1a16 to 0xfb58e 2023-07-14T18:17:18.666 INFO:tasks.workunit.client.0.smithi163.stdout:7281(113 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.666 INFO:tasks.workunit.client.0.smithi163.stdout:7282(114 mod 256): TRUNCATE DOWN from 0xfb58e to 0x197c4 ******WWWW 2023-07-14T18:17:18.666 INFO:tasks.workunit.client.0.smithi163.stdout:7283(115 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.666 INFO:tasks.workunit.client.0.smithi163.stdout:7284(116 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.666 INFO:tasks.workunit.client.0.smithi163.stdout:7285(117 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.666 INFO:tasks.workunit.client.0.smithi163.stdout:7286(118 mod 256): COPY 0x16570 thru 0x197c3 (0x3254 bytes) to 0x56ea8 thru 0x5a0fb 2023-07-14T18:17:18.666 INFO:tasks.workunit.client.0.smithi163.stdout:7287(119 mod 256): COPY 0x146ad thru 0x216c4 (0xd018 bytes) to 0x7ddd2 thru 0x8ade9 2023-07-14T18:17:18.667 INFO:tasks.workunit.client.0.smithi163.stdout:7288(120 mod 256): PUNCH 0x4edb4 thru 0x55e5f (0x70ac bytes) 2023-07-14T18:17:18.667 INFO:tasks.workunit.client.0.smithi163.stdout:7289(121 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.667 INFO:tasks.workunit.client.0.smithi163.stdout:7290(122 mod 256): TRUNCATE DOWN from 0x8adea to 0x5aae4 2023-07-14T18:17:18.667 INFO:tasks.workunit.client.0.smithi163.stdout:7291(123 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.667 INFO:tasks.workunit.client.0.smithi163.stdout:7292(124 mod 256): TRUNCATE DOWN from 0x5aae4 to 0x31645 ******WWWW 2023-07-14T18:17:18.667 INFO:tasks.workunit.client.0.smithi163.stdout:7293(125 mod 256): WRITE 0xfe5ee thru 0xfffff (0x1a12 bytes) HOLE ***WWWW 2023-07-14T18:17:18.667 INFO:tasks.workunit.client.0.smithi163.stdout:7294(126 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.667 INFO:tasks.workunit.client.0.smithi163.stdout:7295(127 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.668 INFO:tasks.workunit.client.0.smithi163.stdout:7296(128 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.668 INFO:tasks.workunit.client.0.smithi163.stdout:7297(129 mod 256): TRUNCATE DOWN from 0x100000 to 0x365f9 ******WWWW 2023-07-14T18:17:18.668 INFO:tasks.workunit.client.0.smithi163.stdout:7298(130 mod 256): TRUNCATE UP from 0x365f9 to 0x5e503 ******WWWW 2023-07-14T18:17:18.668 INFO:tasks.workunit.client.0.smithi163.stdout:7299(131 mod 256): TRUNCATE UP from 0x5e503 to 0xb19d5 2023-07-14T18:17:18.668 INFO:tasks.workunit.client.0.smithi163.stdout:7300(132 mod 256): PUNCH 0x1bb61 thru 0x1f860 (0x3d00 bytes) 2023-07-14T18:17:18.668 INFO:tasks.workunit.client.0.smithi163.stdout:7301(133 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.668 INFO:tasks.workunit.client.0.smithi163.stdout:7302(134 mod 256): PUNCH 0xcc9f thru 0xec2b (0x1f8d bytes) 2023-07-14T18:17:18.668 INFO:tasks.workunit.client.0.smithi163.stdout:7303(135 mod 256): MAPREAD 0x13e01 thru 0x1fc41 (0xbe41 bytes) 2023-07-14T18:17:18.669 INFO:tasks.workunit.client.0.smithi163.stdout:7304(136 mod 256): PUNCH 0x46eed thru 0x552e7 (0xe3fb bytes) 2023-07-14T18:17:18.669 INFO:tasks.workunit.client.0.smithi163.stdout:7305(137 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.669 INFO:tasks.workunit.client.0.smithi163.stdout:7306(138 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.669 INFO:tasks.workunit.client.0.smithi163.stdout:7307(139 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.669 INFO:tasks.workunit.client.0.smithi163.stdout:7308(140 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.669 INFO:tasks.workunit.client.0.smithi163.stdout:7309(141 mod 256): MAPWRITE 0x3c507 thru 0x41a67 (0x5561 bytes) 2023-07-14T18:17:18.669 INFO:tasks.workunit.client.0.smithi163.stdout:7310(142 mod 256): MAPREAD 0x1aab2 thru 0x277d7 (0xcd26 bytes) 2023-07-14T18:17:18.669 INFO:tasks.workunit.client.0.smithi163.stdout:7311(143 mod 256): PUNCH 0x9fe2 thru 0xa732 (0x751 bytes) 2023-07-14T18:17:18.670 INFO:tasks.workunit.client.0.smithi163.stdout:7312(144 mod 256): READ 0xa0b11 thru 0xa11de (0x6ce bytes) 2023-07-14T18:17:18.670 INFO:tasks.workunit.client.0.smithi163.stdout:7313(145 mod 256): MAPWRITE 0x6ad21 thru 0x70f51 (0x6231 bytes) 2023-07-14T18:17:18.670 INFO:tasks.workunit.client.0.smithi163.stdout:7314(146 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.670 INFO:tasks.workunit.client.0.smithi163.stdout:7315(147 mod 256): READ 0x27fef thru 0x2aaa4 (0x2ab6 bytes) 2023-07-14T18:17:18.670 INFO:tasks.workunit.client.0.smithi163.stdout:7316(148 mod 256): PUNCH 0x6ff5a thru 0x75ad0 (0x5b77 bytes) 2023-07-14T18:17:18.670 INFO:tasks.workunit.client.0.smithi163.stdout:7317(149 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.670 INFO:tasks.workunit.client.0.smithi163.stdout:7318(150 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.670 INFO:tasks.workunit.client.0.smithi163.stdout:7319(151 mod 256): MAPWRITE 0x49f93 thru 0x55f2e (0xbf9c bytes) 2023-07-14T18:17:18.671 INFO:tasks.workunit.client.0.smithi163.stdout:7320(152 mod 256): FALLOC 0x44f2e thru 0x46b38 (0x1c0a bytes) INTERIOR 2023-07-14T18:17:18.671 INFO:tasks.workunit.client.0.smithi163.stdout:7321(153 mod 256): READ 0x7bd01 thru 0x87358 (0xb658 bytes) 2023-07-14T18:17:18.671 INFO:tasks.workunit.client.0.smithi163.stdout:7322(154 mod 256): WRITE 0xf9e09 thru 0xfffff (0x61f7 bytes) HOLE 2023-07-14T18:17:18.671 INFO:tasks.workunit.client.0.smithi163.stdout:7323(155 mod 256): COPY 0xb3369 thru 0xb43fb (0x1093 bytes) to 0x463a6 thru 0x47438 2023-07-14T18:17:18.671 INFO:tasks.workunit.client.0.smithi163.stdout:7324(156 mod 256): WRITE 0x45a88 thru 0x48524 (0x2a9d bytes) 2023-07-14T18:17:18.671 INFO:tasks.workunit.client.0.smithi163.stdout:7325(157 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.671 INFO:tasks.workunit.client.0.smithi163.stdout:7326(158 mod 256): MAPREAD 0xe4fe7 thru 0xe658d (0x15a7 bytes) 2023-07-14T18:17:18.671 INFO:tasks.workunit.client.0.smithi163.stdout:7327(159 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.672 INFO:tasks.workunit.client.0.smithi163.stdout:7328(160 mod 256): WRITE 0x4ea67 thru 0x5532f (0x68c9 bytes) 2023-07-14T18:17:18.672 INFO:tasks.workunit.client.0.smithi163.stdout:7329(161 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.672 INFO:tasks.workunit.client.0.smithi163.stdout:7330(162 mod 256): COPY 0x27225 thru 0x33cb1 (0xca8d bytes) to 0x52206 thru 0x5ec92 2023-07-14T18:17:18.672 INFO:tasks.workunit.client.0.smithi163.stdout:7331(163 mod 256): PUNCH 0xf2cf3 thru 0xf6aec (0x3dfa bytes) 2023-07-14T18:17:18.672 INFO:tasks.workunit.client.0.smithi163.stdout:7332(164 mod 256): PUNCH 0xa544b thru 0xa74a5 (0x205b bytes) 2023-07-14T18:17:18.672 INFO:tasks.workunit.client.0.smithi163.stdout:7333(165 mod 256): PUNCH 0x2583b thru 0x2cb59 (0x731f bytes) 2023-07-14T18:17:18.672 INFO:tasks.workunit.client.0.smithi163.stdout:7334(166 mod 256): READ 0x89e5f thru 0x8b03e (0x11e0 bytes) 2023-07-14T18:17:18.672 INFO:tasks.workunit.client.0.smithi163.stdout:7335(167 mod 256): TRUNCATE DOWN from 0x100000 to 0x5261d 2023-07-14T18:17:18.673 INFO:tasks.workunit.client.0.smithi163.stdout:7336(168 mod 256): TRUNCATE UP from 0x5261d to 0xe831b 2023-07-14T18:17:18.673 INFO:tasks.workunit.client.0.smithi163.stdout:7337(169 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.673 INFO:tasks.workunit.client.0.smithi163.stdout:7338(170 mod 256): TRUNCATE DOWN from 0xe831b to 0xe96e ******WWWW 2023-07-14T18:17:18.673 INFO:tasks.workunit.client.0.smithi163.stdout:7339(171 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.673 INFO:tasks.workunit.client.0.smithi163.stdout:7340(172 mod 256): PUNCH 0xdadf thru 0xe96d (0xe8f bytes) 2023-07-14T18:17:18.673 INFO:tasks.workunit.client.0.smithi163.stdout:7341(173 mod 256): MAPWRITE 0x3253e thru 0x3c1cd (0x9c90 bytes) ******WWWW 2023-07-14T18:17:18.673 INFO:tasks.workunit.client.0.smithi163.stdout:7342(174 mod 256): READ 0x3adf8 thru 0x3c1cd (0x13d6 bytes) 2023-07-14T18:17:18.673 INFO:tasks.workunit.client.0.smithi163.stdout:7343(175 mod 256): MAPWRITE 0x490c4 thru 0x54b1b (0xba58 bytes) 2023-07-14T18:17:18.674 INFO:tasks.workunit.client.0.smithi163.stdout:7344(176 mod 256): PUNCH 0x3f4e thru 0x11260 (0xd313 bytes) 2023-07-14T18:17:18.674 INFO:tasks.workunit.client.0.smithi163.stdout:7345(177 mod 256): READ 0xad5c thru 0x14a0a (0x9caf bytes) 2023-07-14T18:17:18.674 INFO:tasks.workunit.client.0.smithi163.stdout:7346(178 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.674 INFO:tasks.workunit.client.0.smithi163.stdout:7347(179 mod 256): READ 0x1f0ff thru 0x23826 (0x4728 bytes) 2023-07-14T18:17:18.674 INFO:tasks.workunit.client.0.smithi163.stdout:7348(180 mod 256): WRITE 0x7cb13 thru 0x8910b (0xc5f9 bytes) HOLE 2023-07-14T18:17:18.674 INFO:tasks.workunit.client.0.smithi163.stdout:7349(181 mod 256): COPY 0x5be54 thru 0x6aca8 (0xee55 bytes) to 0x2e166 thru 0x3cfba ******EEEE 2023-07-14T18:17:18.674 INFO:tasks.workunit.client.0.smithi163.stdout:7350(182 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.674 INFO:tasks.workunit.client.0.smithi163.stdout:7351(183 mod 256): TRUNCATE DOWN from 0x8910c to 0x765fd 2023-07-14T18:17:18.675 INFO:tasks.workunit.client.0.smithi163.stdout:7352(184 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.675 INFO:tasks.workunit.client.0.smithi163.stdout:7353(185 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.675 INFO:tasks.workunit.client.0.smithi163.stdout:7354(186 mod 256): MAPREAD 0x1dbfa thru 0x25c76 (0x807d bytes) 2023-07-14T18:17:18.675 INFO:tasks.workunit.client.0.smithi163.stdout:7355(187 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.675 INFO:tasks.workunit.client.0.smithi163.stdout:7356(188 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.675 INFO:tasks.workunit.client.0.smithi163.stdout:7357(189 mod 256): READ 0x60f47 thru 0x630f4 (0x21ae bytes) 2023-07-14T18:17:18.675 INFO:tasks.workunit.client.0.smithi163.stdout:7358(190 mod 256): WRITE 0x49bb8 thru 0x584e6 (0xe92f bytes) 2023-07-14T18:17:18.675 INFO:tasks.workunit.client.0.smithi163.stdout:7359(191 mod 256): PUNCH 0x63d31 thru 0x6f8fb (0xbbcb bytes) 2023-07-14T18:17:18.676 INFO:tasks.workunit.client.0.smithi163.stdout:7360(192 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.676 INFO:tasks.workunit.client.0.smithi163.stdout:7361(193 mod 256): FALLOC 0x192d9 thru 0x2170e (0x8435 bytes) INTERIOR 2023-07-14T18:17:18.676 INFO:tasks.workunit.client.0.smithi163.stdout:7362(194 mod 256): MAPREAD 0x74044 thru 0x765fc (0x25b9 bytes) 2023-07-14T18:17:18.676 INFO:tasks.workunit.client.0.smithi163.stdout:7363(195 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.676 INFO:tasks.workunit.client.0.smithi163.stdout:7364(196 mod 256): MAPREAD 0x680ae thru 0x72a11 (0xa964 bytes) 2023-07-14T18:17:18.676 INFO:tasks.workunit.client.0.smithi163.stdout:7365(197 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.676 INFO:tasks.workunit.client.0.smithi163.stdout:7366(198 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.676 INFO:tasks.workunit.client.0.smithi163.stdout:7367(199 mod 256): MAPWRITE 0x64e93 thru 0x728a4 (0xda12 bytes) 2023-07-14T18:17:18.677 INFO:tasks.workunit.client.0.smithi163.stdout:7368(200 mod 256): COPY 0x5b3c4 thru 0x65784 (0xa3c1 bytes) to 0x24fd5 thru 0x2f395 2023-07-14T18:17:18.677 INFO:tasks.workunit.client.0.smithi163.stdout:7369(201 mod 256): READ 0x6aec7 thru 0x6f68a (0x47c4 bytes) 2023-07-14T18:17:18.677 INFO:tasks.workunit.client.0.smithi163.stdout:7370(202 mod 256): WRITE 0x42a30 thru 0x4d69c (0xac6d bytes) 2023-07-14T18:17:18.677 INFO:tasks.workunit.client.0.smithi163.stdout:7371(203 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.677 INFO:tasks.workunit.client.0.smithi163.stdout:7372(204 mod 256): WRITE 0xe2df0 thru 0xf1acc (0xecdd bytes) HOLE 2023-07-14T18:17:18.677 INFO:tasks.workunit.client.0.smithi163.stdout:7373(205 mod 256): WRITE 0xcfc17 thru 0xd2fc4 (0x33ae bytes) 2023-07-14T18:17:18.677 INFO:tasks.workunit.client.0.smithi163.stdout:7374(206 mod 256): FALLOC 0x612f0 thru 0x64d78 (0x3a88 bytes) INTERIOR 2023-07-14T18:17:18.677 INFO:tasks.workunit.client.0.smithi163.stdout:7375(207 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.678 INFO:tasks.workunit.client.0.smithi163.stdout:7376(208 mod 256): WRITE 0xfe793 thru 0xfffff (0x186d bytes) HOLE 2023-07-14T18:17:18.678 INFO:tasks.workunit.client.0.smithi163.stdout:7377(209 mod 256): MAPREAD 0x68c62 thru 0x69860 (0xbff bytes) 2023-07-14T18:17:18.678 INFO:tasks.workunit.client.0.smithi163.stdout:7378(210 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.678 INFO:tasks.workunit.client.0.smithi163.stdout:7379(211 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.678 INFO:tasks.workunit.client.0.smithi163.stdout:7380(212 mod 256): FALLOC 0x26f27 thru 0x29712 (0x27eb bytes) INTERIOR 2023-07-14T18:17:18.678 INFO:tasks.workunit.client.0.smithi163.stdout:7381(213 mod 256): MAPWRITE 0xe72cc thru 0xef87c (0x85b1 bytes) 2023-07-14T18:17:18.678 INFO:tasks.workunit.client.0.smithi163.stdout:7382(214 mod 256): PUNCH 0x42a5e thru 0x4ac1e (0x81c1 bytes) 2023-07-14T18:17:18.678 INFO:tasks.workunit.client.0.smithi163.stdout:7383(215 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.679 INFO:tasks.workunit.client.0.smithi163.stdout:7384(216 mod 256): MAPWRITE 0x12faf thru 0x1c67e (0x96d0 bytes) 2023-07-14T18:17:18.679 INFO:tasks.workunit.client.0.smithi163.stdout:7385(217 mod 256): FALLOC 0x19d4b thru 0x1f4b9 (0x576e bytes) INTERIOR 2023-07-14T18:17:18.679 INFO:tasks.workunit.client.0.smithi163.stdout:7386(218 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.679 INFO:tasks.workunit.client.0.smithi163.stdout:7387(219 mod 256): PUNCH 0xb1f54 thru 0xbb6a3 (0x9750 bytes) 2023-07-14T18:17:18.679 INFO:tasks.workunit.client.0.smithi163.stdout:7388(220 mod 256): TRUNCATE DOWN from 0x100000 to 0xca6d9 2023-07-14T18:17:18.679 INFO:tasks.workunit.client.0.smithi163.stdout:7389(221 mod 256): TRUNCATE DOWN from 0xca6d9 to 0x56ff6 2023-07-14T18:17:18.679 INFO:tasks.workunit.client.0.smithi163.stdout:7390(222 mod 256): MAPWRITE 0x56c79 thru 0x6377c (0xcb04 bytes) 2023-07-14T18:17:18.679 INFO:tasks.workunit.client.0.smithi163.stdout:7391(223 mod 256): FALLOC 0x70b06 thru 0x760a9 (0x55a3 bytes) EXTENDING 2023-07-14T18:17:18.680 INFO:tasks.workunit.client.0.smithi163.stdout:7392(224 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.680 INFO:tasks.workunit.client.0.smithi163.stdout:7393(225 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.680 INFO:tasks.workunit.client.0.smithi163.stdout:7394(226 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.680 INFO:tasks.workunit.client.0.smithi163.stdout:7395(227 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.680 INFO:tasks.workunit.client.0.smithi163.stdout:7396(228 mod 256): FALLOC 0x282f4 thru 0x2ee54 (0x6b60 bytes) INTERIOR 2023-07-14T18:17:18.680 INFO:tasks.workunit.client.0.smithi163.stdout:7397(229 mod 256): READ 0x267b3 thru 0x3107e (0xa8cc bytes) 2023-07-14T18:17:18.680 INFO:tasks.workunit.client.0.smithi163.stdout:7398(230 mod 256): READ 0x18d14 thru 0x2303d (0xa32a bytes) 2023-07-14T18:17:18.680 INFO:tasks.workunit.client.0.smithi163.stdout:7399(231 mod 256): FALLOC 0xa4830 thru 0xb0914 (0xc0e4 bytes) PAST_EOF 2023-07-14T18:17:18.681 INFO:tasks.workunit.client.0.smithi163.stdout:7400(232 mod 256): MAPREAD 0x46c54 thru 0x552a4 (0xe651 bytes) 2023-07-14T18:17:18.681 INFO:tasks.workunit.client.0.smithi163.stdout:7401(233 mod 256): PUNCH 0x4a8a3 thru 0x56908 (0xc066 bytes) 2023-07-14T18:17:18.681 INFO:tasks.workunit.client.0.smithi163.stdout:7402(234 mod 256): WRITE 0x6bb8b thru 0x7b57d (0xf9f3 bytes) EXTEND 2023-07-14T18:17:18.681 INFO:tasks.workunit.client.0.smithi163.stdout:7403(235 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.681 INFO:tasks.workunit.client.0.smithi163.stdout:7404(236 mod 256): MAPWRITE 0x6948a thru 0x731d4 (0x9d4b bytes) 2023-07-14T18:17:18.681 INFO:tasks.workunit.client.0.smithi163.stdout:7405(237 mod 256): MAPREAD 0x115bc thru 0x1b224 (0x9c69 bytes) 2023-07-14T18:17:18.681 INFO:tasks.workunit.client.0.smithi163.stdout:7406(238 mod 256): PUNCH 0xbde3 thru 0xc096 (0x2b4 bytes) 2023-07-14T18:17:18.681 INFO:tasks.workunit.client.0.smithi163.stdout:7407(239 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.682 INFO:tasks.workunit.client.0.smithi163.stdout:7408(240 mod 256): MAPWRITE 0x87e69 thru 0x893bc (0x1554 bytes) 2023-07-14T18:17:18.682 INFO:tasks.workunit.client.0.smithi163.stdout:7409(241 mod 256): COPY 0x3bdc6 thru 0x429d9 (0x6c14 bytes) to 0x268e1 thru 0x2d4f4 2023-07-14T18:17:18.682 INFO:tasks.workunit.client.0.smithi163.stdout:7410(242 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.682 INFO:tasks.workunit.client.0.smithi163.stdout:7411(243 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.682 INFO:tasks.workunit.client.0.smithi163.stdout:7412(244 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.682 INFO:tasks.workunit.client.0.smithi163.stdout:7413(245 mod 256): MAPWRITE 0x84dcb thru 0x8dfec (0x9222 bytes) 2023-07-14T18:17:18.682 INFO:tasks.workunit.client.0.smithi163.stdout:7414(246 mod 256): READ 0x4642d thru 0x47be0 (0x17b4 bytes) 2023-07-14T18:17:18.682 INFO:tasks.workunit.client.0.smithi163.stdout:7415(247 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.683 INFO:tasks.workunit.client.0.smithi163.stdout:7416(248 mod 256): COPY 0x30820 thru 0x38393 (0x7b74 bytes) to 0x2640a thru 0x2df7d EEEE****** 2023-07-14T18:17:18.683 INFO:tasks.workunit.client.0.smithi163.stdout:7417(249 mod 256): PUNCH 0x4566d thru 0x4e92f (0x92c3 bytes) 2023-07-14T18:17:18.683 INFO:tasks.workunit.client.0.smithi163.stdout:7418(250 mod 256): READ 0x67ce4 thru 0x6a12b (0x2448 bytes) 2023-07-14T18:17:18.683 INFO:tasks.workunit.client.0.smithi163.stdout:7419(251 mod 256): MAPWRITE 0x4a1e1 thru 0x57ba6 (0xd9c6 bytes) 2023-07-14T18:17:18.683 INFO:tasks.workunit.client.0.smithi163.stdout:7420(252 mod 256): TRUNCATE DOWN from 0x8dfed to 0x625d3 2023-07-14T18:17:18.683 INFO:tasks.workunit.client.0.smithi163.stdout:7421(253 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.683 INFO:tasks.workunit.client.0.smithi163.stdout:7422(254 mod 256): MAPWRITE 0xe0207 thru 0xec439 (0xc233 bytes) 2023-07-14T18:17:18.683 INFO:tasks.workunit.client.0.smithi163.stdout:7423(255 mod 256): READ 0x7d902 thru 0x8080b (0x2f0a bytes) 2023-07-14T18:17:18.684 INFO:tasks.workunit.client.0.smithi163.stdout:7424( 0 mod 256): TRUNCATE UP from 0xec43a to 0xf8865 2023-07-14T18:17:18.684 INFO:tasks.workunit.client.0.smithi163.stdout:7425( 1 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.684 INFO:tasks.workunit.client.0.smithi163.stdout:7426( 2 mod 256): COPY 0x2618c thru 0x2e539 (0x83ae bytes) to 0xdfd69 thru 0xe8116 2023-07-14T18:17:18.684 INFO:tasks.workunit.client.0.smithi163.stdout:7427( 3 mod 256): PUNCH 0x44c53 thru 0x50d59 (0xc107 bytes) 2023-07-14T18:17:18.684 INFO:tasks.workunit.client.0.smithi163.stdout:7428( 4 mod 256): READ 0x27362 thru 0x35267 (0xdf06 bytes) 2023-07-14T18:17:18.684 INFO:tasks.workunit.client.0.smithi163.stdout:7429( 5 mod 256): WRITE 0xb5950 thru 0xbc81e (0x6ecf bytes) 2023-07-14T18:17:18.684 INFO:tasks.workunit.client.0.smithi163.stdout:7430( 6 mod 256): TRUNCATE DOWN from 0xf8865 to 0x7df86 2023-07-14T18:17:18.685 INFO:tasks.workunit.client.0.smithi163.stdout:7431( 7 mod 256): READ 0x6e90d thru 0x7c9d1 (0xe0c5 bytes) 2023-07-14T18:17:18.685 INFO:tasks.workunit.client.0.smithi163.stdout:7432( 8 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.685 INFO:tasks.workunit.client.0.smithi163.stdout:7433( 9 mod 256): MAPREAD 0x482a4 thru 0x57201 (0xef5e bytes) 2023-07-14T18:17:18.685 INFO:tasks.workunit.client.0.smithi163.stdout:7434( 10 mod 256): FALLOC 0xfa2d4 thru 0xfdb75 (0x38a1 bytes) PAST_EOF 2023-07-14T18:17:18.685 INFO:tasks.workunit.client.0.smithi163.stdout:7435( 11 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.685 INFO:tasks.workunit.client.0.smithi163.stdout:7436( 12 mod 256): READ 0x11ec1 thru 0x1304c (0x118c bytes) 2023-07-14T18:17:18.685 INFO:tasks.workunit.client.0.smithi163.stdout:7437( 13 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.685 INFO:tasks.workunit.client.0.smithi163.stdout:7438( 14 mod 256): PUNCH 0x5da68 thru 0x6a588 (0xcb21 bytes) 2023-07-14T18:17:18.686 INFO:tasks.workunit.client.0.smithi163.stdout:7439( 15 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.686 INFO:tasks.workunit.client.0.smithi163.stdout:7440( 16 mod 256): FALLOC 0x17fc4 thru 0x1fc2c (0x7c68 bytes) INTERIOR 2023-07-14T18:17:18.686 INFO:tasks.workunit.client.0.smithi163.stdout:7441( 17 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.686 INFO:tasks.workunit.client.0.smithi163.stdout:7442( 18 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.686 INFO:tasks.workunit.client.0.smithi163.stdout:7443( 19 mod 256): TRUNCATE UP from 0x7df86 to 0x95571 2023-07-14T18:17:18.686 INFO:tasks.workunit.client.0.smithi163.stdout:7444( 20 mod 256): PUNCH 0x2b3f4 thru 0x2f113 (0x3d20 bytes) 2023-07-14T18:17:18.686 INFO:tasks.workunit.client.0.smithi163.stdout:7445( 21 mod 256): WRITE 0x56868 thru 0x60448 (0x9be1 bytes) 2023-07-14T18:17:18.686 INFO:tasks.workunit.client.0.smithi163.stdout:7446( 22 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.687 INFO:tasks.workunit.client.0.smithi163.stdout:7447( 23 mod 256): FALLOC 0x2a1b3 thru 0x3654a (0xc397 bytes) INTERIOR 2023-07-14T18:17:18.687 INFO:tasks.workunit.client.0.smithi163.stdout:7448( 24 mod 256): TRUNCATE DOWN from 0x95571 to 0x84f0 ******WWWW 2023-07-14T18:17:18.687 INFO:tasks.workunit.client.0.smithi163.stdout:7449( 25 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.687 INFO:tasks.workunit.client.0.smithi163.stdout:7450( 26 mod 256): PUNCH 0x168b thru 0x1c61 (0x5d7 bytes) 2023-07-14T18:17:18.687 INFO:tasks.workunit.client.0.smithi163.stdout:7451( 27 mod 256): READ 0x7a88 thru 0x84ef (0xa68 bytes) 2023-07-14T18:17:18.687 INFO:tasks.workunit.client.0.smithi163.stdout:7452( 28 mod 256): MAPWRITE 0xff3c9 thru 0xfffff (0xc37 bytes) 2023-07-14T18:17:18.687 INFO:tasks.workunit.client.0.smithi163.stdout:7453( 29 mod 256): WRITE 0x1e3c2 thru 0x27c48 (0x9887 bytes) 2023-07-14T18:17:18.687 INFO:tasks.workunit.client.0.smithi163.stdout:7454( 30 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.688 INFO:tasks.workunit.client.0.smithi163.stdout:7455( 31 mod 256): READ 0x8c045 thru 0x8f613 (0x35cf bytes) 2023-07-14T18:17:18.688 INFO:tasks.workunit.client.0.smithi163.stdout:7456( 32 mod 256): WRITE 0xd442f thru 0xd8b3c (0x470e bytes) 2023-07-14T18:17:18.688 INFO:tasks.workunit.client.0.smithi163.stdout:7457( 33 mod 256): PUNCH 0x686b3 thru 0x6c7e0 (0x412e bytes) 2023-07-14T18:17:18.688 INFO:tasks.workunit.client.0.smithi163.stdout:7458( 34 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.688 INFO:tasks.workunit.client.0.smithi163.stdout:7459( 35 mod 256): WRITE 0x9ec40 thru 0xa4c54 (0x6015 bytes) 2023-07-14T18:17:18.688 INFO:tasks.workunit.client.0.smithi163.stdout:7460( 36 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.688 INFO:tasks.workunit.client.0.smithi163.stdout:7461( 37 mod 256): TRUNCATE DOWN from 0x100000 to 0xcf9a3 2023-07-14T18:17:18.688 INFO:tasks.workunit.client.0.smithi163.stdout:7462( 38 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.689 INFO:tasks.workunit.client.0.smithi163.stdout:7463( 39 mod 256): FALLOC 0xe64b0 thru 0xec4e5 (0x6035 bytes) EXTENDING 2023-07-14T18:17:18.689 INFO:tasks.workunit.client.0.smithi163.stdout:7464( 40 mod 256): COPY 0x29462 thru 0x33b83 (0xa722 bytes) to 0xa7ce9 thru 0xb240a 2023-07-14T18:17:18.689 INFO:tasks.workunit.client.0.smithi163.stdout:7465( 41 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.689 INFO:tasks.workunit.client.0.smithi163.stdout:7466( 42 mod 256): PUNCH 0xad800 thru 0xb8be4 (0xb3e5 bytes) 2023-07-14T18:17:18.689 INFO:tasks.workunit.client.0.smithi163.stdout:7467( 43 mod 256): MAPWRITE 0xb25db thru 0xbe584 (0xbfaa bytes) 2023-07-14T18:17:18.689 INFO:tasks.workunit.client.0.smithi163.stdout:7468( 44 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.689 INFO:tasks.workunit.client.0.smithi163.stdout:7469( 45 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.689 INFO:tasks.workunit.client.0.smithi163.stdout:7470( 46 mod 256): COPY 0x552e thru 0x124d6 (0xcfa9 bytes) to 0x4be4f thru 0x58df7 2023-07-14T18:17:18.690 INFO:tasks.workunit.client.0.smithi163.stdout:7471( 47 mod 256): MAPREAD 0xdea72 thru 0xe8019 (0x95a8 bytes) 2023-07-14T18:17:18.690 INFO:tasks.workunit.client.0.smithi163.stdout:7472( 48 mod 256): READ 0xc0eef thru 0xc37cf (0x28e1 bytes) 2023-07-14T18:17:18.690 INFO:tasks.workunit.client.0.smithi163.stdout:7473( 49 mod 256): MAPWRITE 0x7360f thru 0x7750c (0x3efe bytes) 2023-07-14T18:17:18.690 INFO:tasks.workunit.client.0.smithi163.stdout:7474( 50 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.690 INFO:tasks.workunit.client.0.smithi163.stdout:7475( 51 mod 256): FALLOC 0xea6e7 thru 0xeb3ee (0xd07 bytes) INTERIOR 2023-07-14T18:17:18.690 INFO:tasks.workunit.client.0.smithi163.stdout:7476( 52 mod 256): FALLOC 0x6e486 thru 0x6ebd3 (0x74d bytes) INTERIOR 2023-07-14T18:17:18.690 INFO:tasks.workunit.client.0.smithi163.stdout:7477( 53 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.690 INFO:tasks.workunit.client.0.smithi163.stdout:7478( 54 mod 256): MAPWRITE 0x820fd thru 0x90d55 (0xec59 bytes) 2023-07-14T18:17:18.691 INFO:tasks.workunit.client.0.smithi163.stdout:7479( 55 mod 256): PUNCH 0x3d9a8 thru 0x4715b (0x97b4 bytes) 2023-07-14T18:17:18.691 INFO:tasks.workunit.client.0.smithi163.stdout:7480( 56 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.691 INFO:tasks.workunit.client.0.smithi163.stdout:7481( 57 mod 256): READ 0xc4cdd thru 0xd4c7a (0xff9e bytes) 2023-07-14T18:17:18.691 INFO:tasks.workunit.client.0.smithi163.stdout:7482( 58 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.691 INFO:tasks.workunit.client.0.smithi163.stdout:7483( 59 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.691 INFO:tasks.workunit.client.0.smithi163.stdout:7484( 60 mod 256): MAPREAD 0x1cedc thru 0x2b12c (0xe251 bytes) 2023-07-14T18:17:18.691 INFO:tasks.workunit.client.0.smithi163.stdout:7485( 61 mod 256): READ 0x84632 thru 0x89974 (0x5343 bytes) 2023-07-14T18:17:18.691 INFO:tasks.workunit.client.0.smithi163.stdout:7486( 62 mod 256): PUNCH 0xc30a2 thru 0xc9fae (0x6f0d bytes) 2023-07-14T18:17:18.692 INFO:tasks.workunit.client.0.smithi163.stdout:7487( 63 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.692 INFO:tasks.workunit.client.0.smithi163.stdout:7488( 64 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.692 INFO:tasks.workunit.client.0.smithi163.stdout:7489( 65 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.692 INFO:tasks.workunit.client.0.smithi163.stdout:7490( 66 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.692 INFO:tasks.workunit.client.0.smithi163.stdout:7491( 67 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.692 INFO:tasks.workunit.client.0.smithi163.stdout:7492( 68 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.692 INFO:tasks.workunit.client.0.smithi163.stdout:7493( 69 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.692 INFO:tasks.workunit.client.0.smithi163.stdout:7494( 70 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.693 INFO:tasks.workunit.client.0.smithi163.stdout:7495( 71 mod 256): FALLOC 0x91e92 thru 0x9c222 (0xa390 bytes) INTERIOR 2023-07-14T18:17:18.693 INFO:tasks.workunit.client.0.smithi163.stdout:7496( 72 mod 256): COPY 0x65b22 thru 0x65b56 (0x35 bytes) to 0x8a36a thru 0x8a39e 2023-07-14T18:17:18.693 INFO:tasks.workunit.client.0.smithi163.stdout:7497( 73 mod 256): WRITE 0xd4f60 thru 0xde570 (0x9611 bytes) 2023-07-14T18:17:18.693 INFO:tasks.workunit.client.0.smithi163.stdout:7498( 74 mod 256): COPY 0x32a85 thru 0x356ec (0x2c68 bytes) to 0xefdb5 thru 0xf2a1c 2023-07-14T18:17:18.693 INFO:tasks.workunit.client.0.smithi163.stdout:7499( 75 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.693 INFO:tasks.workunit.client.0.smithi163.stdout:7500( 76 mod 256): MAPREAD 0x6ddb6 thru 0x7103e (0x3289 bytes) 2023-07-14T18:17:18.693 INFO:tasks.workunit.client.0.smithi163.stdout:7501( 77 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.693 INFO:tasks.workunit.client.0.smithi163.stdout:7502( 78 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.694 INFO:tasks.workunit.client.0.smithi163.stdout:7503( 79 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.694 INFO:tasks.workunit.client.0.smithi163.stdout:7504( 80 mod 256): FALLOC 0x11d2 thru 0x9eac (0x8cda bytes) INTERIOR 2023-07-14T18:17:18.694 INFO:tasks.workunit.client.0.smithi163.stdout:7505( 81 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.694 INFO:tasks.workunit.client.0.smithi163.stdout:7506( 82 mod 256): MAPWRITE 0x41b7d thru 0x4ea4f (0xced3 bytes) 2023-07-14T18:17:18.694 INFO:tasks.workunit.client.0.smithi163.stdout:7507( 83 mod 256): MAPWRITE 0x65504 thru 0x67c3a (0x2737 bytes) 2023-07-14T18:17:18.694 INFO:tasks.workunit.client.0.smithi163.stdout:7508( 84 mod 256): WRITE 0xc4328 thru 0xcc559 (0x8232 bytes) 2023-07-14T18:17:18.694 INFO:tasks.workunit.client.0.smithi163.stdout:7509( 85 mod 256): READ 0x4385d thru 0x5123a (0xd9de bytes) 2023-07-14T18:17:18.694 INFO:tasks.workunit.client.0.smithi163.stdout:7510( 86 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.695 INFO:tasks.workunit.client.0.smithi163.stdout:7511( 87 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.695 INFO:tasks.workunit.client.0.smithi163.stdout:7512( 88 mod 256): COPY 0xd979e thru 0xdebac (0x540f bytes) to 0xad5e8 thru 0xb29f6 2023-07-14T18:17:18.695 INFO:tasks.workunit.client.0.smithi163.stdout:7513( 89 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.695 INFO:tasks.workunit.client.0.smithi163.stdout:7514( 90 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.695 INFO:tasks.workunit.client.0.smithi163.stdout:7515( 91 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.695 INFO:tasks.workunit.client.0.smithi163.stdout:7516( 92 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.695 INFO:tasks.workunit.client.0.smithi163.stdout:7517( 93 mod 256): TRUNCATE DOWN from 0xf2a1d to 0xbaae0 2023-07-14T18:17:18.695 INFO:tasks.workunit.client.0.smithi163.stdout:7518( 94 mod 256): MAPWRITE 0x10cf5 thru 0x14441 (0x374d bytes) 2023-07-14T18:17:18.696 INFO:tasks.workunit.client.0.smithi163.stdout:7519( 95 mod 256): MAPREAD 0xadbc8 thru 0xb8e72 (0xb2ab bytes) 2023-07-14T18:17:18.696 INFO:tasks.workunit.client.0.smithi163.stdout:7520( 96 mod 256): COPY 0x636d2 thru 0x6a764 (0x7093 bytes) to 0xa7061 thru 0xae0f3 2023-07-14T18:17:18.696 INFO:tasks.workunit.client.0.smithi163.stdout:7521( 97 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.696 INFO:tasks.workunit.client.0.smithi163.stdout:7522( 98 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.696 INFO:tasks.workunit.client.0.smithi163.stdout:7523( 99 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.696 INFO:tasks.workunit.client.0.smithi163.stdout:7524(100 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.696 INFO:tasks.workunit.client.0.smithi163.stdout:7525(101 mod 256): FALLOC 0xf0cef thru 0xf70c5 (0x63d6 bytes) EXTENDING 2023-07-14T18:17:18.696 INFO:tasks.workunit.client.0.smithi163.stdout:7526(102 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.697 INFO:tasks.workunit.client.0.smithi163.stdout:7527(103 mod 256): WRITE 0xdf85c thru 0xe93a0 (0x9b45 bytes) 2023-07-14T18:17:18.697 INFO:tasks.workunit.client.0.smithi163.stdout:7528(104 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.697 INFO:tasks.workunit.client.0.smithi163.stdout:7529(105 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.697 INFO:tasks.workunit.client.0.smithi163.stdout:7530(106 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.697 INFO:tasks.workunit.client.0.smithi163.stdout:7531(107 mod 256): COPY 0xea665 thru 0xee03c (0x39d8 bytes) to 0xf761c thru 0xfaff3 2023-07-14T18:17:18.697 INFO:tasks.workunit.client.0.smithi163.stdout:7532(108 mod 256): COPY 0xedde thru 0x18217 (0x943a bytes) to 0xa63b5 thru 0xaf7ee 2023-07-14T18:17:18.697 INFO:tasks.workunit.client.0.smithi163.stdout:7533(109 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.697 INFO:tasks.workunit.client.0.smithi163.stdout:7534(110 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.698 INFO:tasks.workunit.client.0.smithi163.stdout:7535(111 mod 256): READ 0xe7284 thru 0xed316 (0x6093 bytes) 2023-07-14T18:17:18.698 INFO:tasks.workunit.client.0.smithi163.stdout:7536(112 mod 256): WRITE 0xe4d43 thru 0xec220 (0x74de bytes) 2023-07-14T18:17:18.698 INFO:tasks.workunit.client.0.smithi163.stdout:7537(113 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.698 INFO:tasks.workunit.client.0.smithi163.stdout:7538(114 mod 256): PUNCH 0xeaa25 thru 0xef0be (0x469a bytes) 2023-07-14T18:17:18.698 INFO:tasks.workunit.client.0.smithi163.stdout:7539(115 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.698 INFO:tasks.workunit.client.0.smithi163.stdout:7540(116 mod 256): FALLOC 0x8d6e9 thru 0x9d62f (0xff46 bytes) INTERIOR 2023-07-14T18:17:18.698 INFO:tasks.workunit.client.0.smithi163.stdout:7541(117 mod 256): WRITE 0x98921 thru 0x99527 (0xc07 bytes) 2023-07-14T18:17:18.698 INFO:tasks.workunit.client.0.smithi163.stdout:7542(118 mod 256): MAPREAD 0x2e22a thru 0x39ab6 (0xb88d bytes) ***RRRR*** 2023-07-14T18:17:18.699 INFO:tasks.workunit.client.0.smithi163.stdout:7543(119 mod 256): READ 0x84761 thru 0x9193c (0xd1dc bytes) 2023-07-14T18:17:18.699 INFO:tasks.workunit.client.0.smithi163.stdout:7544(120 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.699 INFO:tasks.workunit.client.0.smithi163.stdout:7545(121 mod 256): READ 0x968c4 thru 0x99620 (0x2d5d bytes) 2023-07-14T18:17:18.699 INFO:tasks.workunit.client.0.smithi163.stdout:7546(122 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.699 INFO:tasks.workunit.client.0.smithi163.stdout:7547(123 mod 256): TRUNCATE DOWN from 0xfaff4 to 0xbee4c 2023-07-14T18:17:18.699 INFO:tasks.workunit.client.0.smithi163.stdout:7548(124 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.699 INFO:tasks.workunit.client.0.smithi163.stdout:7549(125 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.699 INFO:tasks.workunit.client.0.smithi163.stdout:7550(126 mod 256): READ 0xa032a thru 0xac5aa (0xc281 bytes) 2023-07-14T18:17:18.700 INFO:tasks.workunit.client.0.smithi163.stdout:7551(127 mod 256): MAPREAD 0x53be9 thru 0x55fa3 (0x23bb bytes) 2023-07-14T18:17:18.700 INFO:tasks.workunit.client.0.smithi163.stdout:7552(128 mod 256): PUNCH 0x455ec thru 0x4f255 (0x9c6a bytes) 2023-07-14T18:17:18.700 INFO:tasks.workunit.client.0.smithi163.stdout:7553(129 mod 256): WRITE 0x71398 thru 0x7280e (0x1477 bytes) 2023-07-14T18:17:18.700 INFO:tasks.workunit.client.0.smithi163.stdout:7554(130 mod 256): MAPWRITE 0x868a9 thru 0x93b31 (0xd289 bytes) 2023-07-14T18:17:18.700 INFO:tasks.workunit.client.0.smithi163.stdout:7555(131 mod 256): READ 0xa8348 thru 0xb52c3 (0xcf7c bytes) 2023-07-14T18:17:18.700 INFO:tasks.workunit.client.0.smithi163.stdout:7556(132 mod 256): MAPREAD 0x8ce89 thru 0x9746c (0xa5e4 bytes) 2023-07-14T18:17:18.700 INFO:tasks.workunit.client.0.smithi163.stdout:7557(133 mod 256): TRUNCATE DOWN from 0xbee4c to 0x4f0e2 2023-07-14T18:17:18.700 INFO:tasks.workunit.client.0.smithi163.stdout:7558(134 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.701 INFO:tasks.workunit.client.0.smithi163.stdout:7559(135 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.701 INFO:tasks.workunit.client.0.smithi163.stdout:7560(136 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.701 INFO:tasks.workunit.client.0.smithi163.stdout:7561(137 mod 256): READ 0x2e384 thru 0x36323 (0x7fa0 bytes) 2023-07-14T18:17:18.701 INFO:tasks.workunit.client.0.smithi163.stdout:7562(138 mod 256): WRITE 0xb9813 thru 0xbc7d2 (0x2fc0 bytes) HOLE 2023-07-14T18:17:18.701 INFO:tasks.workunit.client.0.smithi163.stdout:7563(139 mod 256): MAPREAD 0x5f8ba thru 0x6d76f (0xdeb6 bytes) 2023-07-14T18:17:18.701 INFO:tasks.workunit.client.0.smithi163.stdout:7564(140 mod 256): TRUNCATE UP from 0xbc7d3 to 0xc86cd 2023-07-14T18:17:18.701 INFO:tasks.workunit.client.0.smithi163.stdout:7565(141 mod 256): FALLOC 0xf8dfe thru 0x100000 (0x7202 bytes) EXTENDING 2023-07-14T18:17:18.701 INFO:tasks.workunit.client.0.smithi163.stdout:7566(142 mod 256): TRUNCATE DOWN from 0x100000 to 0xac8b8 2023-07-14T18:17:18.702 INFO:tasks.workunit.client.0.smithi163.stdout:7567(143 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.702 INFO:tasks.workunit.client.0.smithi163.stdout:7568(144 mod 256): FALLOC 0x248be thru 0x2787d (0x2fbf bytes) INTERIOR 2023-07-14T18:17:18.702 INFO:tasks.workunit.client.0.smithi163.stdout:7569(145 mod 256): MAPWRITE 0x26fec thru 0x30f37 (0x9f4c bytes) 2023-07-14T18:17:18.702 INFO:tasks.workunit.client.0.smithi163.stdout:7570(146 mod 256): TRUNCATE DOWN from 0xac8b8 to 0x19ff6 ******WWWW 2023-07-14T18:17:18.702 INFO:tasks.workunit.client.0.smithi163.stdout:7571(147 mod 256): READ 0x37f9 thru 0x10b4e (0xd356 bytes) 2023-07-14T18:17:18.702 INFO:tasks.workunit.client.0.smithi163.stdout:7572(148 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.702 INFO:tasks.workunit.client.0.smithi163.stdout:7573(149 mod 256): COPY 0xed09 thru 0x19ff5 (0xb2ed bytes) to 0xda70d thru 0xe59f9 2023-07-14T18:17:18.703 INFO:tasks.workunit.client.0.smithi163.stdout:7574(150 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.703 INFO:tasks.workunit.client.0.smithi163.stdout:7575(151 mod 256): READ 0xda542 thru 0xdc5cd (0x208c bytes) 2023-07-14T18:17:18.703 INFO:tasks.workunit.client.0.smithi163.stdout:7576(152 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.703 INFO:tasks.workunit.client.0.smithi163.stdout:7577(153 mod 256): WRITE 0x4cc23 thru 0x5c6df (0xfabd bytes) 2023-07-14T18:17:18.703 INFO:tasks.workunit.client.0.smithi163.stdout:7578(154 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.703 INFO:tasks.workunit.client.0.smithi163.stdout:7579(155 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.703 INFO:tasks.workunit.client.0.smithi163.stdout:7580(156 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.703 INFO:tasks.workunit.client.0.smithi163.stdout:7581(157 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.704 INFO:tasks.workunit.client.0.smithi163.stdout:7582(158 mod 256): WRITE 0xe57ef thru 0xe7f63 (0x2775 bytes) EXTEND 2023-07-14T18:17:18.704 INFO:tasks.workunit.client.0.smithi163.stdout:7583(159 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.704 INFO:tasks.workunit.client.0.smithi163.stdout:7584(160 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.704 INFO:tasks.workunit.client.0.smithi163.stdout:7585(161 mod 256): PUNCH 0x69326 thru 0x7229b (0x8f76 bytes) 2023-07-14T18:17:18.704 INFO:tasks.workunit.client.0.smithi163.stdout:7586(162 mod 256): FALLOC 0xc31f4 thru 0xce7ce (0xb5da bytes) INTERIOR 2023-07-14T18:17:18.704 INFO:tasks.workunit.client.0.smithi163.stdout:7587(163 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.704 INFO:tasks.workunit.client.0.smithi163.stdout:7588(164 mod 256): MAPWRITE 0x2bfe4 thru 0x3bfc3 (0xffe0 bytes) ******WWWW 2023-07-14T18:17:18.704 INFO:tasks.workunit.client.0.smithi163.stdout:7589(165 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.705 INFO:tasks.workunit.client.0.smithi163.stdout:7590(166 mod 256): COPY 0x9f665 thru 0xade9a (0xe836 bytes) to 0x3eedb thru 0x4d710 2023-07-14T18:17:18.705 INFO:tasks.workunit.client.0.smithi163.stdout:7591(167 mod 256): MAPREAD 0x235d thru 0xad91 (0x8a35 bytes) 2023-07-14T18:17:18.705 INFO:tasks.workunit.client.0.smithi163.stdout:7592(168 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.705 INFO:tasks.workunit.client.0.smithi163.stdout:7593(169 mod 256): TRUNCATE DOWN from 0xe7f64 to 0x41f43 2023-07-14T18:17:18.705 INFO:tasks.workunit.client.0.smithi163.stdout:7594(170 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.705 INFO:tasks.workunit.client.0.smithi163.stdout:7595(171 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.705 INFO:tasks.workunit.client.0.smithi163.stdout:7596(172 mod 256): COPY 0x3ea8d thru 0x41f42 (0x34b6 bytes) to 0x9dc14 thru 0xa10c9 2023-07-14T18:17:18.705 INFO:tasks.workunit.client.0.smithi163.stdout:7597(173 mod 256): PUNCH 0x5e1bf thru 0x692f3 (0xb135 bytes) 2023-07-14T18:17:18.706 INFO:tasks.workunit.client.0.smithi163.stdout:7598(174 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.706 INFO:tasks.workunit.client.0.smithi163.stdout:7599(175 mod 256): TRUNCATE DOWN from 0xa10ca to 0x26c56 ******WWWW 2023-07-14T18:17:18.706 INFO:tasks.workunit.client.0.smithi163.stdout:7600(176 mod 256): FALLOC 0x11510 thru 0x132ad (0x1d9d bytes) INTERIOR 2023-07-14T18:17:18.706 INFO:tasks.workunit.client.0.smithi163.stdout:7601(177 mod 256): COPY 0x48ab thru 0x11bf4 (0xd34a bytes) to 0xe8016 thru 0xf535f 2023-07-14T18:17:18.706 INFO:tasks.workunit.client.0.smithi163.stdout:7602(178 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.706 INFO:tasks.workunit.client.0.smithi163.stdout:7603(179 mod 256): COPY 0x9d9ca thru 0xa478b (0x6dc2 bytes) to 0x46ca5 thru 0x4da66 2023-07-14T18:17:18.706 INFO:tasks.workunit.client.0.smithi163.stdout:7604(180 mod 256): WRITE 0x21342 thru 0x26e30 (0x5aef bytes) 2023-07-14T18:17:18.706 INFO:tasks.workunit.client.0.smithi163.stdout:7605(181 mod 256): MAPWRITE 0x60578 thru 0x6d41e (0xcea7 bytes) 2023-07-14T18:17:18.707 INFO:tasks.workunit.client.0.smithi163.stdout:7606(182 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.707 INFO:tasks.workunit.client.0.smithi163.stdout:7607(183 mod 256): TRUNCATE DOWN from 0xf5360 to 0x111da ******WWWW 2023-07-14T18:17:18.707 INFO:tasks.workunit.client.0.smithi163.stdout:7608(184 mod 256): READ 0xd88 thru 0x4968 (0x3be1 bytes) 2023-07-14T18:17:18.707 INFO:tasks.workunit.client.0.smithi163.stdout:7609(185 mod 256): MAPREAD 0x776c thru 0x11108 (0x999d bytes) 2023-07-14T18:17:18.707 INFO:tasks.workunit.client.0.smithi163.stdout:7610(186 mod 256): MAPWRITE 0xf5aa2 thru 0xf9a9a (0x3ff9 bytes) 2023-07-14T18:17:18.707 INFO:tasks.workunit.client.0.smithi163.stdout:7611(187 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.707 INFO:tasks.workunit.client.0.smithi163.stdout:7612(188 mod 256): MAPWRITE 0x7dbd0 thru 0x81e9a (0x42cb bytes) 2023-07-14T18:17:18.707 INFO:tasks.workunit.client.0.smithi163.stdout:7613(189 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.708 INFO:tasks.workunit.client.0.smithi163.stdout:7614(190 mod 256): TRUNCATE DOWN from 0xf9a9b to 0x576a ******WWWW 2023-07-14T18:17:18.708 INFO:tasks.workunit.client.0.smithi163.stdout:7615(191 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.708 INFO:tasks.workunit.client.0.smithi163.stdout:7616(192 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.708 INFO:tasks.workunit.client.0.smithi163.stdout:7617(193 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.708 INFO:tasks.workunit.client.0.smithi163.stdout:7618(194 mod 256): READ 0x22c0 thru 0x5769 (0x34aa bytes) 2023-07-14T18:17:18.708 INFO:tasks.workunit.client.0.smithi163.stdout:7619(195 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.708 INFO:tasks.workunit.client.0.smithi163.stdout:7620(196 mod 256): READ 0x373 thru 0x1b96 (0x1824 bytes) 2023-07-14T18:17:18.708 INFO:tasks.workunit.client.0.smithi163.stdout:7621(197 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.709 INFO:tasks.workunit.client.0.smithi163.stdout:7622(198 mod 256): COPY 0xe99 thru 0x5769 (0x48d1 bytes) to 0xa89d9 thru 0xad2a9 2023-07-14T18:17:18.709 INFO:tasks.workunit.client.0.smithi163.stdout:7623(199 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.709 INFO:tasks.workunit.client.0.smithi163.stdout:7624(200 mod 256): PUNCH 0x81864 thru 0x87ac5 (0x6262 bytes) 2023-07-14T18:17:18.709 INFO:tasks.workunit.client.0.smithi163.stdout:7625(201 mod 256): WRITE 0x313db thru 0x3d0db (0xbd01 bytes) ***WWWW 2023-07-14T18:17:18.709 INFO:tasks.workunit.client.0.smithi163.stdout:7626(202 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.709 INFO:tasks.workunit.client.0.smithi163.stdout:7627(203 mod 256): COPY 0x249df thru 0x2617b (0x179d bytes) to 0x3bf44 thru 0x3d6e0 2023-07-14T18:17:18.709 INFO:tasks.workunit.client.0.smithi163.stdout:7628(204 mod 256): WRITE 0x153bf thru 0x246c7 (0xf309 bytes) 2023-07-14T18:17:18.709 INFO:tasks.workunit.client.0.smithi163.stdout:7629(205 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.710 INFO:tasks.workunit.client.0.smithi163.stdout:7630(206 mod 256): READ 0x3e7f5 thru 0x48bb4 (0xa3c0 bytes) 2023-07-14T18:17:18.710 INFO:tasks.workunit.client.0.smithi163.stdout:7631(207 mod 256): MAPWRITE 0xb389 thru 0x1ac17 (0xf88f bytes) 2023-07-14T18:17:18.710 INFO:tasks.workunit.client.0.smithi163.stdout:7632(208 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.710 INFO:tasks.workunit.client.0.smithi163.stdout:7633(209 mod 256): MAPREAD 0xa99fa thru 0xad2a9 (0x38b0 bytes) 2023-07-14T18:17:18.710 INFO:tasks.workunit.client.0.smithi163.stdout:7634(210 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.710 INFO:tasks.workunit.client.0.smithi163.stdout:7635(211 mod 256): MAPWRITE 0x901c6 thru 0x9226b (0x20a6 bytes) 2023-07-14T18:17:18.710 INFO:tasks.workunit.client.0.smithi163.stdout:7636(212 mod 256): WRITE 0x5926a thru 0x6876c (0xf503 bytes) 2023-07-14T18:17:18.710 INFO:tasks.workunit.client.0.smithi163.stdout:7637(213 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.711 INFO:tasks.workunit.client.0.smithi163.stdout:7638(214 mod 256): MAPWRITE 0x90bde thru 0x9bcd9 (0xb0fc bytes) 2023-07-14T18:17:18.711 INFO:tasks.workunit.client.0.smithi163.stdout:7639(215 mod 256): FALLOC 0xd1fe thru 0x18529 (0xb32b bytes) INTERIOR 2023-07-14T18:17:18.711 INFO:tasks.workunit.client.0.smithi163.stdout:7640(216 mod 256): MAPWRITE 0x50b79 thru 0x5d3ad (0xc835 bytes) 2023-07-14T18:17:18.711 INFO:tasks.workunit.client.0.smithi163.stdout:7641(217 mod 256): MAPREAD 0x985f7 thru 0x9ddc9 (0x57d3 bytes) 2023-07-14T18:17:18.711 INFO:tasks.workunit.client.0.smithi163.stdout:7642(218 mod 256): PUNCH 0x6430f thru 0x713ec (0xd0de bytes) 2023-07-14T18:17:18.711 INFO:tasks.workunit.client.0.smithi163.stdout:7643(219 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.711 INFO:tasks.workunit.client.0.smithi163.stdout:7644(220 mod 256): MAPWRITE 0xc20fd thru 0xce2fd (0xc201 bytes) 2023-07-14T18:17:18.711 INFO:tasks.workunit.client.0.smithi163.stdout:7645(221 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.712 INFO:tasks.workunit.client.0.smithi163.stdout:7646(222 mod 256): TRUNCATE DOWN from 0xce2fe to 0x93a2c 2023-07-14T18:17:18.712 INFO:tasks.workunit.client.0.smithi163.stdout:7647(223 mod 256): TRUNCATE DOWN from 0x93a2c to 0x9311f 2023-07-14T18:17:18.712 INFO:tasks.workunit.client.0.smithi163.stdout:7648(224 mod 256): WRITE 0xdd3c9 thru 0xe9c7b (0xc8b3 bytes) HOLE 2023-07-14T18:17:18.712 INFO:tasks.workunit.client.0.smithi163.stdout:7649(225 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.712 INFO:tasks.workunit.client.0.smithi163.stdout:7650(226 mod 256): WRITE 0x79b71 thru 0x8702a (0xd4ba bytes) 2023-07-14T18:17:18.712 INFO:tasks.workunit.client.0.smithi163.stdout:7651(227 mod 256): READ 0x4fd1c thru 0x5c96e (0xcc53 bytes) 2023-07-14T18:17:18.712 INFO:tasks.workunit.client.0.smithi163.stdout:7652(228 mod 256): MAPREAD 0xc7f5d thru 0xd0b46 (0x8bea bytes) 2023-07-14T18:17:18.712 INFO:tasks.workunit.client.0.smithi163.stdout:7653(229 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.713 INFO:tasks.workunit.client.0.smithi163.stdout:7654(230 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.713 INFO:tasks.workunit.client.0.smithi163.stdout:7655(231 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.713 INFO:tasks.workunit.client.0.smithi163.stdout:7656(232 mod 256): MAPWRITE 0xbe9b thru 0x158a6 (0x9a0c bytes) 2023-07-14T18:17:18.713 INFO:tasks.workunit.client.0.smithi163.stdout:7657(233 mod 256): MAPWRITE 0x19b3d thru 0x1f25c (0x5720 bytes) 2023-07-14T18:17:18.713 INFO:tasks.workunit.client.0.smithi163.stdout:7658(234 mod 256): TRUNCATE DOWN from 0xe9c7c to 0x62dd2 2023-07-14T18:17:18.713 INFO:tasks.workunit.client.0.smithi163.stdout:7659(235 mod 256): MAPWRITE 0xf53c4 thru 0xf8e3d (0x3a7a bytes) 2023-07-14T18:17:18.713 INFO:tasks.workunit.client.0.smithi163.stdout:7660(236 mod 256): READ 0x5d983 thru 0x65a4a (0x80c8 bytes) 2023-07-14T18:17:18.713 INFO:tasks.workunit.client.0.smithi163.stdout:7661(237 mod 256): PUNCH 0xda535 thru 0xe842c (0xdef8 bytes) 2023-07-14T18:17:18.714 INFO:tasks.workunit.client.0.smithi163.stdout:7662(238 mod 256): MAPREAD 0xc441c thru 0xd13db (0xcfc0 bytes) 2023-07-14T18:17:18.714 INFO:tasks.workunit.client.0.smithi163.stdout:7663(239 mod 256): MAPREAD 0xf3eeb thru 0xf8e3d (0x4f53 bytes) 2023-07-14T18:17:18.714 INFO:tasks.workunit.client.0.smithi163.stdout:7664(240 mod 256): READ 0x46cbf thru 0x4ff0c (0x924e bytes) 2023-07-14T18:17:18.714 INFO:tasks.workunit.client.0.smithi163.stdout:7665(241 mod 256): WRITE 0xb0e0c thru 0xb2c87 (0x1e7c bytes) 2023-07-14T18:17:18.714 INFO:tasks.workunit.client.0.smithi163.stdout:7666(242 mod 256): READ 0xc2bd4 thru 0xc694b (0x3d78 bytes) 2023-07-14T18:17:18.714 INFO:tasks.workunit.client.0.smithi163.stdout:7667(243 mod 256): MAPREAD 0x4c638 thru 0x5c2a5 (0xfc6e bytes) 2023-07-14T18:17:18.714 INFO:tasks.workunit.client.0.smithi163.stdout:7668(244 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.714 INFO:tasks.workunit.client.0.smithi163.stdout:7669(245 mod 256): FALLOC 0xd6bba thru 0xd793b (0xd81 bytes) INTERIOR 2023-07-14T18:17:18.715 INFO:tasks.workunit.client.0.smithi163.stdout:7670(246 mod 256): FALLOC 0xf5d19 thru 0xffdd0 (0xa0b7 bytes) EXTENDING 2023-07-14T18:17:18.715 INFO:tasks.workunit.client.0.smithi163.stdout:7671(247 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.715 INFO:tasks.workunit.client.0.smithi163.stdout:7672(248 mod 256): READ 0x30ce0 thru 0x3f2b4 (0xe5d5 bytes) ***RRRR*** 2023-07-14T18:17:18.715 INFO:tasks.workunit.client.0.smithi163.stdout:7673(249 mod 256): PUNCH 0x843b9 thru 0x92fc6 (0xec0e bytes) 2023-07-14T18:17:18.715 INFO:tasks.workunit.client.0.smithi163.stdout:7674(250 mod 256): WRITE 0xac247 thru 0xb494e (0x8708 bytes) 2023-07-14T18:17:18.715 INFO:tasks.workunit.client.0.smithi163.stdout:7675(251 mod 256): MAPWRITE 0xd788f thru 0xe0c22 (0x9394 bytes) 2023-07-14T18:17:18.715 INFO:tasks.workunit.client.0.smithi163.stdout:7676(252 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.715 INFO:tasks.workunit.client.0.smithi163.stdout:7677(253 mod 256): FALLOC 0x8e68b thru 0x918b6 (0x322b bytes) INTERIOR 2023-07-14T18:17:18.716 INFO:tasks.workunit.client.0.smithi163.stdout:7678(254 mod 256): MAPREAD 0x7b971 thru 0x7c544 (0xbd4 bytes) 2023-07-14T18:17:18.716 INFO:tasks.workunit.client.0.smithi163.stdout:7679(255 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.716 INFO:tasks.workunit.client.0.smithi163.stdout:7680( 0 mod 256): PUNCH 0x71e2c thru 0x7be9f (0xa074 bytes) 2023-07-14T18:17:18.716 INFO:tasks.workunit.client.0.smithi163.stdout:7681( 1 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.716 INFO:tasks.workunit.client.0.smithi163.stdout:7682( 2 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.716 INFO:tasks.workunit.client.0.smithi163.stdout:7683( 3 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.716 INFO:tasks.workunit.client.0.smithi163.stdout:7684( 4 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.716 INFO:tasks.workunit.client.0.smithi163.stdout:7685( 5 mod 256): MAPREAD 0xa6b5a thru 0xb4d98 (0xe23f bytes) 2023-07-14T18:17:18.717 INFO:tasks.workunit.client.0.smithi163.stdout:7686( 6 mod 256): READ 0x9f00b thru 0xa0d18 (0x1d0e bytes) 2023-07-14T18:17:18.717 INFO:tasks.workunit.client.0.smithi163.stdout:7687( 7 mod 256): WRITE 0x8f039 thru 0x904a8 (0x1470 bytes) 2023-07-14T18:17:18.717 INFO:tasks.workunit.client.0.smithi163.stdout:7688( 8 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.717 INFO:tasks.workunit.client.0.smithi163.stdout:7689( 9 mod 256): WRITE 0xea652 thru 0xf43fe (0x9dad bytes) 2023-07-14T18:17:18.717 INFO:tasks.workunit.client.0.smithi163.stdout:7690( 10 mod 256): FALLOC 0xe1698 thru 0xee8a5 (0xd20d bytes) INTERIOR 2023-07-14T18:17:18.717 INFO:tasks.workunit.client.0.smithi163.stdout:7691( 11 mod 256): READ 0x60778 thru 0x60dec (0x675 bytes) 2023-07-14T18:17:18.717 INFO:tasks.workunit.client.0.smithi163.stdout:7692( 12 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.717 INFO:tasks.workunit.client.0.smithi163.stdout:7693( 13 mod 256): WRITE 0xda0be thru 0xe9e9c (0xfddf bytes) 2023-07-14T18:17:18.718 INFO:tasks.workunit.client.0.smithi163.stdout:7694( 14 mod 256): PUNCH 0x8a6ab thru 0x9529c (0xabf2 bytes) 2023-07-14T18:17:18.718 INFO:tasks.workunit.client.0.smithi163.stdout:7695( 15 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.718 INFO:tasks.workunit.client.0.smithi163.stdout:7696( 16 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.718 INFO:tasks.workunit.client.0.smithi163.stdout:7697( 17 mod 256): MAPWRITE 0x9ce8e thru 0x9eb8b (0x1cfe bytes) 2023-07-14T18:17:18.718 INFO:tasks.workunit.client.0.smithi163.stdout:7698( 18 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.718 INFO:tasks.workunit.client.0.smithi163.stdout:7699( 19 mod 256): TRUNCATE DOWN from 0xffdd0 to 0xcd828 2023-07-14T18:17:18.718 INFO:tasks.workunit.client.0.smithi163.stdout:7700( 20 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.718 INFO:tasks.workunit.client.0.smithi163.stdout:7701( 21 mod 256): COPY 0x4a352 thru 0x4d0e0 (0x2d8f bytes) to 0x171c8 thru 0x19f56 2023-07-14T18:17:18.719 INFO:tasks.workunit.client.0.smithi163.stdout:7702( 22 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.719 INFO:tasks.workunit.client.0.smithi163.stdout:7703( 23 mod 256): FALLOC 0xc59a7 thru 0xcf914 (0x9f6d bytes) EXTENDING 2023-07-14T18:17:18.719 INFO:tasks.workunit.client.0.smithi163.stdout:7704( 24 mod 256): TRUNCATE UP from 0xcf914 to 0xd3c0b 2023-07-14T18:17:18.719 INFO:tasks.workunit.client.0.smithi163.stdout:7705( 25 mod 256): MAPWRITE 0xfe201 thru 0xfffff (0x1dff bytes) 2023-07-14T18:17:18.719 INFO:tasks.workunit.client.0.smithi163.stdout:7706( 26 mod 256): FALLOC 0x39729 thru 0x3d931 (0x4208 bytes) INTERIOR 2023-07-14T18:17:18.719 INFO:tasks.workunit.client.0.smithi163.stdout:7707( 27 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.719 INFO:tasks.workunit.client.0.smithi163.stdout:7708( 28 mod 256): WRITE 0x9eb7d thru 0x9fe0d (0x1291 bytes) 2023-07-14T18:17:18.719 INFO:tasks.workunit.client.0.smithi163.stdout:7709( 29 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.720 INFO:tasks.workunit.client.0.smithi163.stdout:7710( 30 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.720 INFO:tasks.workunit.client.0.smithi163.stdout:7711( 31 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.720 INFO:tasks.workunit.client.0.smithi163.stdout:7712( 32 mod 256): TRUNCATE DOWN from 0x100000 to 0x2549c ******WWWW 2023-07-14T18:17:18.720 INFO:tasks.workunit.client.0.smithi163.stdout:7713( 33 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.720 INFO:tasks.workunit.client.0.smithi163.stdout:7714( 34 mod 256): WRITE 0xad632 thru 0xb6301 (0x8cd0 bytes) HOLE ***WWWW 2023-07-14T18:17:18.720 INFO:tasks.workunit.client.0.smithi163.stdout:7715( 35 mod 256): PUNCH 0x3da4f thru 0x459de (0x7f90 bytes) 2023-07-14T18:17:18.720 INFO:tasks.workunit.client.0.smithi163.stdout:7716( 36 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.720 INFO:tasks.workunit.client.0.smithi163.stdout:7717( 37 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.721 INFO:tasks.workunit.client.0.smithi163.stdout:7718( 38 mod 256): WRITE 0xe6850 thru 0xf1de2 (0xb593 bytes) HOLE 2023-07-14T18:17:18.721 INFO:tasks.workunit.client.0.smithi163.stdout:7719( 39 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.721 INFO:tasks.workunit.client.0.smithi163.stdout:7720( 40 mod 256): READ 0xc0689 thru 0xc2cb7 (0x262f bytes) 2023-07-14T18:17:18.721 INFO:tasks.workunit.client.0.smithi163.stdout:7721( 41 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.721 INFO:tasks.workunit.client.0.smithi163.stdout:7722( 42 mod 256): PUNCH 0xc8639 thru 0xd2aef (0xa4b7 bytes) 2023-07-14T18:17:18.721 INFO:tasks.workunit.client.0.smithi163.stdout:7723( 43 mod 256): FALLOC 0x6c20c thru 0x754cd (0x92c1 bytes) INTERIOR 2023-07-14T18:17:18.721 INFO:tasks.workunit.client.0.smithi163.stdout:7724( 44 mod 256): FALLOC 0x77a13 thru 0x838bb (0xbea8 bytes) INTERIOR 2023-07-14T18:17:18.721 INFO:tasks.workunit.client.0.smithi163.stdout:7725( 45 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.722 INFO:tasks.workunit.client.0.smithi163.stdout:7726( 46 mod 256): COPY 0xef6cf thru 0xf1de2 (0x2714 bytes) to 0x2cc1e thru 0x2f331 2023-07-14T18:17:18.722 INFO:tasks.workunit.client.0.smithi163.stdout:7727( 47 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.722 INFO:tasks.workunit.client.0.smithi163.stdout:7728( 48 mod 256): COPY 0x235fc thru 0x2fd85 (0xc78a bytes) to 0x50052 thru 0x5c7db 2023-07-14T18:17:18.722 INFO:tasks.workunit.client.0.smithi163.stdout:7729( 49 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.722 INFO:tasks.workunit.client.0.smithi163.stdout:7730( 50 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.722 INFO:tasks.workunit.client.0.smithi163.stdout:7731( 51 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.722 INFO:tasks.workunit.client.0.smithi163.stdout:7732( 52 mod 256): TRUNCATE DOWN from 0xf1de3 to 0x1d3c6 ******WWWW 2023-07-14T18:17:18.722 INFO:tasks.workunit.client.0.smithi163.stdout:7733( 53 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.723 INFO:tasks.workunit.client.0.smithi163.stdout:7734( 54 mod 256): COPY 0xd529 thru 0x15235 (0x7d0d bytes) to 0x8b236 thru 0x92f42 2023-07-14T18:17:18.723 INFO:tasks.workunit.client.0.smithi163.stdout:7735( 55 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.723 INFO:tasks.workunit.client.0.smithi163.stdout:7736( 56 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.723 INFO:tasks.workunit.client.0.smithi163.stdout:7737( 57 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.723 INFO:tasks.workunit.client.0.smithi163.stdout:7738( 58 mod 256): COPY 0x6fc47 thru 0x7f571 (0xf92b bytes) to 0xb201f thru 0xc1949 2023-07-14T18:17:18.723 INFO:tasks.workunit.client.0.smithi163.stdout:7739( 59 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.723 INFO:tasks.workunit.client.0.smithi163.stdout:7740( 60 mod 256): COPY 0x984e thru 0x14558 (0xad0b bytes) to 0x3e496 thru 0x491a0 2023-07-14T18:17:18.723 INFO:tasks.workunit.client.0.smithi163.stdout:7741( 61 mod 256): TRUNCATE DOWN from 0xc194a to 0x682bb 2023-07-14T18:17:18.724 INFO:tasks.workunit.client.0.smithi163.stdout:7742( 62 mod 256): TRUNCATE UP from 0x682bb to 0xe5e7b 2023-07-14T18:17:18.724 INFO:tasks.workunit.client.0.smithi163.stdout:7743( 63 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.724 INFO:tasks.workunit.client.0.smithi163.stdout:7744( 64 mod 256): TRUNCATE DOWN from 0xe5e7b to 0x411e1 2023-07-14T18:17:18.724 INFO:tasks.workunit.client.0.smithi163.stdout:7745( 65 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.724 INFO:tasks.workunit.client.0.smithi163.stdout:7746( 66 mod 256): READ 0xb7c6 thru 0x18a17 (0xd252 bytes) 2023-07-14T18:17:18.724 INFO:tasks.workunit.client.0.smithi163.stdout:7747( 67 mod 256): READ 0x20652 thru 0x2d546 (0xcef5 bytes) 2023-07-14T18:17:18.724 INFO:tasks.workunit.client.0.smithi163.stdout:7748( 68 mod 256): WRITE 0x909c8 thru 0x9f553 (0xeb8c bytes) HOLE 2023-07-14T18:17:18.724 INFO:tasks.workunit.client.0.smithi163.stdout:7749( 69 mod 256): FALLOC 0xa6683 thru 0xb11c4 (0xab41 bytes) EXTENDING 2023-07-14T18:17:18.725 INFO:tasks.workunit.client.0.smithi163.stdout:7750( 70 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.725 INFO:tasks.workunit.client.0.smithi163.stdout:7751( 71 mod 256): PUNCH 0x2be7b thru 0x38675 (0xc7fb bytes) ******PPPP 2023-07-14T18:17:18.725 INFO:tasks.workunit.client.0.smithi163.stdout:7752( 72 mod 256): READ 0x6a5c4 thru 0x6b0e3 (0xb20 bytes) 2023-07-14T18:17:18.725 INFO:tasks.workunit.client.0.smithi163.stdout:7753( 73 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.725 INFO:tasks.workunit.client.0.smithi163.stdout:7754( 74 mod 256): FALLOC 0x4e62d thru 0x55b69 (0x753c bytes) INTERIOR 2023-07-14T18:17:18.725 INFO:tasks.workunit.client.0.smithi163.stdout:7755( 75 mod 256): WRITE 0xc0c2c thru 0xc8e99 (0x826e bytes) HOLE 2023-07-14T18:17:18.725 INFO:tasks.workunit.client.0.smithi163.stdout:7756( 76 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.725 INFO:tasks.workunit.client.0.smithi163.stdout:7757( 77 mod 256): MAPWRITE 0x4825a thru 0x4aeba (0x2c61 bytes) 2023-07-14T18:17:18.726 INFO:tasks.workunit.client.0.smithi163.stdout:7758( 78 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.726 INFO:tasks.workunit.client.0.smithi163.stdout:7759( 79 mod 256): TRUNCATE DOWN from 0xc8e9a to 0x3490e ******WWWW 2023-07-14T18:17:18.726 INFO:tasks.workunit.client.0.smithi163.stdout:7760( 80 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.726 INFO:tasks.workunit.client.0.smithi163.stdout:7761( 81 mod 256): PUNCH 0x2ccef thru 0x3490d (0x7c1f bytes) 2023-07-14T18:17:18.726 INFO:tasks.workunit.client.0.smithi163.stdout:7762( 82 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.726 INFO:tasks.workunit.client.0.smithi163.stdout:7763( 83 mod 256): WRITE 0xf963c thru 0xfffff (0x69c4 bytes) HOLE ***WWWW 2023-07-14T18:17:18.726 INFO:tasks.workunit.client.0.smithi163.stdout:7764( 84 mod 256): PUNCH 0x4252a thru 0x459fd (0x34d4 bytes) 2023-07-14T18:17:18.726 INFO:tasks.workunit.client.0.smithi163.stdout:7765( 85 mod 256): TRUNCATE DOWN from 0x100000 to 0x8f30 ******WWWW 2023-07-14T18:17:18.727 INFO:tasks.workunit.client.0.smithi163.stdout:7766( 86 mod 256): PUNCH 0x4a93 thru 0x8f2f (0x449d bytes) 2023-07-14T18:17:18.727 INFO:tasks.workunit.client.0.smithi163.stdout:7767( 87 mod 256): TRUNCATE UP from 0x8f30 to 0x40241 ******WWWW 2023-07-14T18:17:18.727 INFO:tasks.workunit.client.0.smithi163.stdout:7768( 88 mod 256): COPY 0x28cf0 thru 0x319bc (0x8ccd bytes) to 0xee4da thru 0xf71a6 2023-07-14T18:17:18.727 INFO:tasks.workunit.client.0.smithi163.stdout:7769( 89 mod 256): WRITE 0x4e557 thru 0x57b1b (0x95c5 bytes) 2023-07-14T18:17:18.727 INFO:tasks.workunit.client.0.smithi163.stdout:7770( 90 mod 256): WRITE 0xb19bd thru 0xb8e3b (0x747f bytes) 2023-07-14T18:17:18.727 INFO:tasks.workunit.client.0.smithi163.stdout:7771( 91 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.727 INFO:tasks.workunit.client.0.smithi163.stdout:7772( 92 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.727 INFO:tasks.workunit.client.0.smithi163.stdout:7773( 93 mod 256): COPY 0x1e20c thru 0x1f72c (0x1521 bytes) to 0xef745 thru 0xf0c65 2023-07-14T18:17:18.728 INFO:tasks.workunit.client.0.smithi163.stdout:7774( 94 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.728 INFO:tasks.workunit.client.0.smithi163.stdout:7775( 95 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.728 INFO:tasks.workunit.client.0.smithi163.stdout:7776( 96 mod 256): MAPWRITE 0x5c989 thru 0x62d6f (0x63e7 bytes) 2023-07-14T18:17:18.728 INFO:tasks.workunit.client.0.smithi163.stdout:7777( 97 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.728 INFO:tasks.workunit.client.0.smithi163.stdout:7778( 98 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.728 INFO:tasks.workunit.client.0.smithi163.stdout:7779( 99 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.728 INFO:tasks.workunit.client.0.smithi163.stdout:7780(100 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.728 INFO:tasks.workunit.client.0.smithi163.stdout:7781(101 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.729 INFO:tasks.workunit.client.0.smithi163.stdout:7782(102 mod 256): PUNCH 0xb5cdb thru 0xc5a80 (0xfda6 bytes) 2023-07-14T18:17:18.729 INFO:tasks.workunit.client.0.smithi163.stdout:7783(103 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.729 INFO:tasks.workunit.client.0.smithi163.stdout:7784(104 mod 256): TRUNCATE DOWN from 0xf71a7 to 0xf2147 2023-07-14T18:17:18.729 INFO:tasks.workunit.client.0.smithi163.stdout:7785(105 mod 256): READ 0x9b858 thru 0xa5b05 (0xa2ae bytes) 2023-07-14T18:17:18.729 INFO:tasks.workunit.client.0.smithi163.stdout:7786(106 mod 256): READ 0x4b482 thru 0x57405 (0xbf84 bytes) 2023-07-14T18:17:18.729 INFO:tasks.workunit.client.0.smithi163.stdout:7787(107 mod 256): COPY 0x4387f thru 0x4dea4 (0xa626 bytes) to 0xaa36f thru 0xb4994 2023-07-14T18:17:18.729 INFO:tasks.workunit.client.0.smithi163.stdout:7788(108 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.729 INFO:tasks.workunit.client.0.smithi163.stdout:7789(109 mod 256): WRITE 0x3c023 thru 0x45e2d (0x9e0b bytes) 2023-07-14T18:17:18.730 INFO:tasks.workunit.client.0.smithi163.stdout:7790(110 mod 256): FALLOC 0xc6c5a thru 0xcb10a (0x44b0 bytes) INTERIOR 2023-07-14T18:17:18.730 INFO:tasks.workunit.client.0.smithi163.stdout:7791(111 mod 256): MAPWRITE 0xc6cde thru 0xd2988 (0xbcab bytes) 2023-07-14T18:17:18.730 INFO:tasks.workunit.client.0.smithi163.stdout:7792(112 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.730 INFO:tasks.workunit.client.0.smithi163.stdout:7793(113 mod 256): MAPREAD 0x52aaf thru 0x56eb3 (0x4405 bytes) 2023-07-14T18:17:18.730 INFO:tasks.workunit.client.0.smithi163.stdout:7794(114 mod 256): COPY 0x2e916 thru 0x36923 (0x800e bytes) to 0xb9ded thru 0xc1dfa 2023-07-14T18:17:18.730 INFO:tasks.workunit.client.0.smithi163.stdout:7795(115 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.730 INFO:tasks.workunit.client.0.smithi163.stdout:7796(116 mod 256): COPY 0xeaa70 thru 0xf2146 (0x76d7 bytes) to 0xab4a7 thru 0xb2b7d 2023-07-14T18:17:18.730 INFO:tasks.workunit.client.0.smithi163.stdout:7797(117 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.731 INFO:tasks.workunit.client.0.smithi163.stdout:7798(118 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.731 INFO:tasks.workunit.client.0.smithi163.stdout:7799(119 mod 256): FALLOC 0x57489 thru 0x593ea (0x1f61 bytes) INTERIOR 2023-07-14T18:17:18.731 INFO:tasks.workunit.client.0.smithi163.stdout:7800(120 mod 256): WRITE 0xe5049 thru 0xf20ac (0xd064 bytes) 2023-07-14T18:17:18.731 INFO:tasks.workunit.client.0.smithi163.stdout:7801(121 mod 256): WRITE 0x749b thru 0x132cb (0xbe31 bytes) 2023-07-14T18:17:18.731 INFO:tasks.workunit.client.0.smithi163.stdout:7802(122 mod 256): WRITE 0x36cec thru 0x413e7 (0xa6fc bytes) ***WWWW 2023-07-14T18:17:18.731 INFO:tasks.workunit.client.0.smithi163.stdout:7803(123 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.731 INFO:tasks.workunit.client.0.smithi163.stdout:7804(124 mod 256): MAPWRITE 0x1cfb5 thru 0x1efd8 (0x2024 bytes) 2023-07-14T18:17:18.731 INFO:tasks.workunit.client.0.smithi163.stdout:7805(125 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.732 INFO:tasks.workunit.client.0.smithi163.stdout:7806(126 mod 256): MAPWRITE 0x8706f thru 0x8a0ad (0x303f bytes) 2023-07-14T18:17:18.732 INFO:tasks.workunit.client.0.smithi163.stdout:7807(127 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.732 INFO:tasks.workunit.client.0.smithi163.stdout:7808(128 mod 256): MAPREAD 0xcbd9c thru 0xd771b (0xb980 bytes) 2023-07-14T18:17:18.732 INFO:tasks.workunit.client.0.smithi163.stdout:7809(129 mod 256): TRUNCATE DOWN from 0xf2147 to 0xdb7c6 2023-07-14T18:17:18.732 INFO:tasks.workunit.client.0.smithi163.stdout:7810(130 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.732 INFO:tasks.workunit.client.0.smithi163.stdout:7811(131 mod 256): COPY 0x8fd5b thru 0x9bf07 (0xc1ad bytes) to 0x7d0f8 thru 0x892a4 2023-07-14T18:17:18.732 INFO:tasks.workunit.client.0.smithi163.stdout:7812(132 mod 256): FALLOC 0xb9302 thru 0xc21c4 (0x8ec2 bytes) INTERIOR 2023-07-14T18:17:18.732 INFO:tasks.workunit.client.0.smithi163.stdout:7813(133 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.733 INFO:tasks.workunit.client.0.smithi163.stdout:7814(134 mod 256): FALLOC 0xf4ece thru 0x100000 (0xb132 bytes) EXTENDING 2023-07-14T18:17:18.733 INFO:tasks.workunit.client.0.smithi163.stdout:7815(135 mod 256): COPY 0x5a321 thru 0x6890e (0xe5ee bytes) to 0x89128 thru 0x97715 2023-07-14T18:17:18.733 INFO:tasks.workunit.client.0.smithi163.stdout:7816(136 mod 256): MAPREAD 0x5caf3 thru 0x69739 (0xcc47 bytes) 2023-07-14T18:17:18.733 INFO:tasks.workunit.client.0.smithi163.stdout:7817(137 mod 256): FALLOC 0x3a58c thru 0x3dd55 (0x37c9 bytes) INTERIOR 2023-07-14T18:17:18.733 INFO:tasks.workunit.client.0.smithi163.stdout:7818(138 mod 256): WRITE 0xfcefe thru 0xfffff (0x3102 bytes) 2023-07-14T18:17:18.733 INFO:tasks.workunit.client.0.smithi163.stdout:7819(139 mod 256): PUNCH 0x8a0f0 thru 0x99996 (0xf8a7 bytes) 2023-07-14T18:17:18.733 INFO:tasks.workunit.client.0.smithi163.stdout:7820(140 mod 256): PUNCH 0x6c48f thru 0x6ed3d (0x28af bytes) 2023-07-14T18:17:18.733 INFO:tasks.workunit.client.0.smithi163.stdout:7821(141 mod 256): TRUNCATE DOWN from 0x100000 to 0xb555c 2023-07-14T18:17:18.734 INFO:tasks.workunit.client.0.smithi163.stdout:7822(142 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.734 INFO:tasks.workunit.client.0.smithi163.stdout:7823(143 mod 256): MAPWRITE 0x83f22 thru 0x8f93d (0xba1c bytes) 2023-07-14T18:17:18.734 INFO:tasks.workunit.client.0.smithi163.stdout:7824(144 mod 256): TRUNCATE DOWN from 0xb555c to 0x3da90 2023-07-14T18:17:18.734 INFO:tasks.workunit.client.0.smithi163.stdout:7825(145 mod 256): READ 0x25162 thru 0x31fb3 (0xce52 bytes) 2023-07-14T18:17:18.734 INFO:tasks.workunit.client.0.smithi163.stdout:7826(146 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.734 INFO:tasks.workunit.client.0.smithi163.stdout:7827(147 mod 256): FALLOC 0x96ef1 thru 0x9fe52 (0x8f61 bytes) PAST_EOF 2023-07-14T18:17:18.734 INFO:tasks.workunit.client.0.smithi163.stdout:7828(148 mod 256): MAPWRITE 0x768a5 thru 0x77393 (0xaef bytes) 2023-07-14T18:17:18.734 INFO:tasks.workunit.client.0.smithi163.stdout:7829(149 mod 256): PUNCH 0x552a8 thru 0x5df85 (0x8cde bytes) 2023-07-14T18:17:18.735 INFO:tasks.workunit.client.0.smithi163.stdout:7830(150 mod 256): MAPREAD 0x3115e thru 0x3a5a7 (0x944a bytes) ***RRRR*** 2023-07-14T18:17:18.735 INFO:tasks.workunit.client.0.smithi163.stdout:7831(151 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.735 INFO:tasks.workunit.client.0.smithi163.stdout:7832(152 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.735 INFO:tasks.workunit.client.0.smithi163.stdout:7833(153 mod 256): PUNCH 0x2fdc3 thru 0x3b1c4 (0xb402 bytes) ******PPPP 2023-07-14T18:17:18.735 INFO:tasks.workunit.client.0.smithi163.stdout:7834(154 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.735 INFO:tasks.workunit.client.0.smithi163.stdout:7835(155 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.735 INFO:tasks.workunit.client.0.smithi163.stdout:7836(156 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.735 INFO:tasks.workunit.client.0.smithi163.stdout:7837(157 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.736 INFO:tasks.workunit.client.0.smithi163.stdout:7838(158 mod 256): MAPWRITE 0xba74d thru 0xca1b4 (0xfa68 bytes) 2023-07-14T18:17:18.736 INFO:tasks.workunit.client.0.smithi163.stdout:7839(159 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.736 INFO:tasks.workunit.client.0.smithi163.stdout:7840(160 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.736 INFO:tasks.workunit.client.0.smithi163.stdout:7841(161 mod 256): FALLOC 0xf4620 thru 0xfd07e (0x8a5e bytes) EXTENDING 2023-07-14T18:17:18.736 INFO:tasks.workunit.client.0.smithi163.stdout:7842(162 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.736 INFO:tasks.workunit.client.0.smithi163.stdout:7843(163 mod 256): WRITE 0x163ea thru 0x1961c (0x3233 bytes) 2023-07-14T18:17:18.736 INFO:tasks.workunit.client.0.smithi163.stdout:7844(164 mod 256): COPY 0xfad43 thru 0xfd07d (0x233b bytes) to 0x96a1a thru 0x98d54 2023-07-14T18:17:18.737 INFO:tasks.workunit.client.0.smithi163.stdout:7845(165 mod 256): READ 0x12c91 thru 0x150db (0x244b bytes) 2023-07-14T18:17:18.737 INFO:tasks.workunit.client.0.smithi163.stdout:7846(166 mod 256): COPY 0xb4545 thru 0xb99f2 (0x54ae bytes) to 0xd5f44 thru 0xdb3f1 2023-07-14T18:17:18.737 INFO:tasks.workunit.client.0.smithi163.stdout:7847(167 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.737 INFO:tasks.workunit.client.0.smithi163.stdout:7848(168 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.737 INFO:tasks.workunit.client.0.smithi163.stdout:7849(169 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.737 INFO:tasks.workunit.client.0.smithi163.stdout:7850(170 mod 256): FALLOC 0xe7fc6 thru 0xf711e (0xf158 bytes) INTERIOR 2023-07-14T18:17:18.737 INFO:tasks.workunit.client.0.smithi163.stdout:7851(171 mod 256): WRITE 0x7b9a5 thru 0x8b07b (0xf6d7 bytes) 2023-07-14T18:17:18.737 INFO:tasks.workunit.client.0.smithi163.stdout:7852(172 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.738 INFO:tasks.workunit.client.0.smithi163.stdout:7853(173 mod 256): PUNCH 0xed56 thru 0x16421 (0x76cc bytes) 2023-07-14T18:17:18.738 INFO:tasks.workunit.client.0.smithi163.stdout:7854(174 mod 256): FALLOC 0x9a06 thru 0xba76 (0x2070 bytes) INTERIOR 2023-07-14T18:17:18.738 INFO:tasks.workunit.client.0.smithi163.stdout:7855(175 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.738 INFO:tasks.workunit.client.0.smithi163.stdout:7856(176 mod 256): READ 0x867da thru 0x95841 (0xf068 bytes) 2023-07-14T18:17:18.738 INFO:tasks.workunit.client.0.smithi163.stdout:7857(177 mod 256): MAPREAD 0xa8cf1 thru 0xb19cf (0x8cdf bytes) 2023-07-14T18:17:18.738 INFO:tasks.workunit.client.0.smithi163.stdout:7858(178 mod 256): MAPWRITE 0x2c448 thru 0x2c819 (0x3d2 bytes) 2023-07-14T18:17:18.738 INFO:tasks.workunit.client.0.smithi163.stdout:7859(179 mod 256): COPY 0xb0728 thru 0xb1356 (0xc2f bytes) to 0x729c8 thru 0x735f6 2023-07-14T18:17:18.738 INFO:tasks.workunit.client.0.smithi163.stdout:7860(180 mod 256): PUNCH 0x1edb9 thru 0x2e22c (0xf474 bytes) 2023-07-14T18:17:18.739 INFO:tasks.workunit.client.0.smithi163.stdout:7861(181 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.739 INFO:tasks.workunit.client.0.smithi163.stdout:7862(182 mod 256): MAPWRITE 0xbb840 thru 0xbed8e (0x354f bytes) 2023-07-14T18:17:18.739 INFO:tasks.workunit.client.0.smithi163.stdout:7863(183 mod 256): MAPREAD 0x1e26 thru 0xdc1d (0xbdf8 bytes) 2023-07-14T18:17:18.739 INFO:tasks.workunit.client.0.smithi163.stdout:7864(184 mod 256): READ 0xc609d thru 0xce628 (0x858c bytes) 2023-07-14T18:17:18.739 INFO:tasks.workunit.client.0.smithi163.stdout:7865(185 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.739 INFO:tasks.workunit.client.0.smithi163.stdout:7866(186 mod 256): READ 0x64d63 thru 0x6ec8a (0x9f28 bytes) 2023-07-14T18:17:18.739 INFO:tasks.workunit.client.0.smithi163.stdout:7867(187 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.739 INFO:tasks.workunit.client.0.smithi163.stdout:7868(188 mod 256): WRITE 0xa4e10 thru 0xa53b9 (0x5aa bytes) 2023-07-14T18:17:18.740 INFO:tasks.workunit.client.0.smithi163.stdout:7869(189 mod 256): FALLOC 0x5a3eb thru 0x6250f (0x8124 bytes) INTERIOR 2023-07-14T18:17:18.740 INFO:tasks.workunit.client.0.smithi163.stdout:7870(190 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.740 INFO:tasks.workunit.client.0.smithi163.stdout:7871(191 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.740 INFO:tasks.workunit.client.0.smithi163.stdout:7872(192 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.740 INFO:tasks.workunit.client.0.smithi163.stdout:7873(193 mod 256): WRITE 0xbedae thru 0xce790 (0xf9e3 bytes) 2023-07-14T18:17:18.740 INFO:tasks.workunit.client.0.smithi163.stdout:7874(194 mod 256): MAPWRITE 0xd8327 thru 0xe4a80 (0xc75a bytes) 2023-07-14T18:17:18.740 INFO:tasks.workunit.client.0.smithi163.stdout:7875(195 mod 256): COPY 0x61701 thru 0x6944b (0x7d4b bytes) to 0xc48ca thru 0xcc614 2023-07-14T18:17:18.740 INFO:tasks.workunit.client.0.smithi163.stdout:7876(196 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.741 INFO:tasks.workunit.client.0.smithi163.stdout:7877(197 mod 256): MAPREAD 0x594a0 thru 0x5de5e (0x49bf bytes) 2023-07-14T18:17:18.741 INFO:tasks.workunit.client.0.smithi163.stdout:7878(198 mod 256): WRITE 0x76b13 thru 0x78de6 (0x22d4 bytes) 2023-07-14T18:17:18.741 INFO:tasks.workunit.client.0.smithi163.stdout:7879(199 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.741 INFO:tasks.workunit.client.0.smithi163.stdout:7880(200 mod 256): MAPWRITE 0xc1f1f thru 0xcc0ab (0xa18d bytes) 2023-07-14T18:17:18.741 INFO:tasks.workunit.client.0.smithi163.stdout:7881(201 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.741 INFO:tasks.workunit.client.0.smithi163.stdout:7882(202 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.741 INFO:tasks.workunit.client.0.smithi163.stdout:7883(203 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.741 INFO:tasks.workunit.client.0.smithi163.stdout:7884(204 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.742 INFO:tasks.workunit.client.0.smithi163.stdout:7885(205 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.742 INFO:tasks.workunit.client.0.smithi163.stdout:7886(206 mod 256): COPY 0x2733f thru 0x2e548 (0x720a bytes) to 0xaa9b3 thru 0xb1bbc 2023-07-14T18:17:18.742 INFO:tasks.workunit.client.0.smithi163.stdout:7887(207 mod 256): MAPREAD 0x2e893 thru 0x2f179 (0x8e7 bytes) 2023-07-14T18:17:18.742 INFO:tasks.workunit.client.0.smithi163.stdout:7888(208 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.742 INFO:tasks.workunit.client.0.smithi163.stdout:7889(209 mod 256): MAPWRITE 0x7e4c1 thru 0x802d3 (0x1e13 bytes) 2023-07-14T18:17:18.742 INFO:tasks.workunit.client.0.smithi163.stdout:7890(210 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.742 INFO:tasks.workunit.client.0.smithi163.stdout:7891(211 mod 256): TRUNCATE DOWN from 0xfd07e to 0x44037 2023-07-14T18:17:18.742 INFO:tasks.workunit.client.0.smithi163.stdout:7892(212 mod 256): COPY 0x59f7 thru 0xdd41 (0x834b bytes) to 0xe79ac thru 0xefcf6 2023-07-14T18:17:18.743 INFO:tasks.workunit.client.0.smithi163.stdout:7893(213 mod 256): MAPWRITE 0x9bbf0 thru 0xaad34 (0xf145 bytes) 2023-07-14T18:17:18.743 INFO:tasks.workunit.client.0.smithi163.stdout:7894(214 mod 256): PUNCH 0x979df thru 0xa2533 (0xab55 bytes) 2023-07-14T18:17:18.743 INFO:tasks.workunit.client.0.smithi163.stdout:7895(215 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.743 INFO:tasks.workunit.client.0.smithi163.stdout:7896(216 mod 256): MAPWRITE 0x3012e thru 0x3901e (0x8ef1 bytes) ******WWWW 2023-07-14T18:17:18.743 INFO:tasks.workunit.client.0.smithi163.stdout:7897(217 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.743 INFO:tasks.workunit.client.0.smithi163.stdout:7898(218 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.743 INFO:tasks.workunit.client.0.smithi163.stdout:7899(219 mod 256): COPY 0x1ef3c thru 0x23c68 (0x4d2d bytes) to 0x45cec thru 0x4aa18 2023-07-14T18:17:18.743 INFO:tasks.workunit.client.0.smithi163.stdout:7900(220 mod 256): MAPREAD 0xa0b04 thru 0xa6d7e (0x627b bytes) 2023-07-14T18:17:18.744 INFO:tasks.workunit.client.0.smithi163.stdout:7901(221 mod 256): MAPREAD 0x50635 thru 0x555c7 (0x4f93 bytes) 2023-07-14T18:17:18.744 INFO:tasks.workunit.client.0.smithi163.stdout:7902(222 mod 256): PUNCH 0xaf78f thru 0xb5dff (0x6671 bytes) 2023-07-14T18:17:18.744 INFO:tasks.workunit.client.0.smithi163.stdout:7903(223 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.744 INFO:tasks.workunit.client.0.smithi163.stdout:7904(224 mod 256): COPY 0x30adc thru 0x37124 (0x6649 bytes) to 0xab0f3 thru 0xb173b 2023-07-14T18:17:18.744 INFO:tasks.workunit.client.0.smithi163.stdout:7905(225 mod 256): READ 0x6d7db thru 0x6d8fc (0x122 bytes) 2023-07-14T18:17:18.744 INFO:tasks.workunit.client.0.smithi163.stdout:7906(226 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.744 INFO:tasks.workunit.client.0.smithi163.stdout:7907(227 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.744 INFO:tasks.workunit.client.0.smithi163.stdout:7908(228 mod 256): MAPWRITE 0xc060b thru 0xcebdf (0xe5d5 bytes) 2023-07-14T18:17:18.745 INFO:tasks.workunit.client.0.smithi163.stdout:7909(229 mod 256): PUNCH 0x5536d thru 0x5f5b8 (0xa24c bytes) 2023-07-14T18:17:18.745 INFO:tasks.workunit.client.0.smithi163.stdout:7910(230 mod 256): PUNCH 0x97315 thru 0xa5efa (0xebe6 bytes) 2023-07-14T18:17:18.745 INFO:tasks.workunit.client.0.smithi163.stdout:7911(231 mod 256): WRITE 0xf7869 thru 0xfffff (0x8797 bytes) HOLE 2023-07-14T18:17:18.745 INFO:tasks.workunit.client.0.smithi163.stdout:7912(232 mod 256): READ 0x771cc thru 0x81833 (0xa668 bytes) 2023-07-14T18:17:18.745 INFO:tasks.workunit.client.0.smithi163.stdout:7913(233 mod 256): FALLOC 0xbfc06 thru 0xc4fdc (0x53d6 bytes) INTERIOR 2023-07-14T18:17:18.745 INFO:tasks.workunit.client.0.smithi163.stdout:7914(234 mod 256): MAPREAD 0xd8fc0 thru 0xdc52b (0x356c bytes) 2023-07-14T18:17:18.745 INFO:tasks.workunit.client.0.smithi163.stdout:7915(235 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.745 INFO:tasks.workunit.client.0.smithi163.stdout:7916(236 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.746 INFO:tasks.workunit.client.0.smithi163.stdout:7917(237 mod 256): TRUNCATE DOWN from 0x100000 to 0x42113 2023-07-14T18:17:18.746 INFO:tasks.workunit.client.0.smithi163.stdout:7918(238 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.746 INFO:tasks.workunit.client.0.smithi163.stdout:7919(239 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.746 INFO:tasks.workunit.client.0.smithi163.stdout:7920(240 mod 256): READ 0x3c2e2 thru 0x42112 (0x5e31 bytes) 2023-07-14T18:17:18.746 INFO:tasks.workunit.client.0.smithi163.stdout:7921(241 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.746 INFO:tasks.workunit.client.0.smithi163.stdout:7922(242 mod 256): TRUNCATE UP from 0x42113 to 0xfd607 2023-07-14T18:17:18.746 INFO:tasks.workunit.client.0.smithi163.stdout:7923(243 mod 256): COPY 0x56100 thru 0x61ad0 (0xb9d1 bytes) to 0x24fdd thru 0x309ad 2023-07-14T18:17:18.746 INFO:tasks.workunit.client.0.smithi163.stdout:7924(244 mod 256): MAPWRITE 0x7cab1 thru 0x7cd13 (0x263 bytes) 2023-07-14T18:17:18.747 INFO:tasks.workunit.client.0.smithi163.stdout:7925(245 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.747 INFO:tasks.workunit.client.0.smithi163.stdout:7926(246 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.747 INFO:tasks.workunit.client.0.smithi163.stdout:7927(247 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.747 INFO:tasks.workunit.client.0.smithi163.stdout:7928(248 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.747 INFO:tasks.workunit.client.0.smithi163.stdout:7929(249 mod 256): TRUNCATE DOWN from 0xfd607 to 0x32aba ******WWWW 2023-07-14T18:17:18.747 INFO:tasks.workunit.client.0.smithi163.stdout:7930(250 mod 256): COPY 0x2c041 thru 0x32ab9 (0x6a79 bytes) to 0xd8995 thru 0xdf40d 2023-07-14T18:17:18.747 INFO:tasks.workunit.client.0.smithi163.stdout:7931(251 mod 256): WRITE 0x21abc thru 0x30129 (0xe66e bytes) 2023-07-14T18:17:18.747 INFO:tasks.workunit.client.0.smithi163.stdout:7932(252 mod 256): WRITE 0xb0ad5 thru 0xb4fdc (0x4508 bytes) 2023-07-14T18:17:18.748 INFO:tasks.workunit.client.0.smithi163.stdout:7933(253 mod 256): TRUNCATE DOWN from 0xdf40e to 0x9b98c 2023-07-14T18:17:18.748 INFO:tasks.workunit.client.0.smithi163.stdout:7934(254 mod 256): MAPWRITE 0x19ea thru 0x5a43 (0x405a bytes) 2023-07-14T18:17:18.748 INFO:tasks.workunit.client.0.smithi163.stdout:7935(255 mod 256): MAPREAD 0x6dcbc thru 0x72c6f (0x4fb4 bytes) 2023-07-14T18:17:18.748 INFO:tasks.workunit.client.0.smithi163.stdout:7936( 0 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.748 INFO:tasks.workunit.client.0.smithi163.stdout:7937( 1 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.748 INFO:tasks.workunit.client.0.smithi163.stdout:7938( 2 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.748 INFO:tasks.workunit.client.0.smithi163.stdout:7939( 3 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.748 INFO:tasks.workunit.client.0.smithi163.stdout:7940( 4 mod 256): COPY 0x7554 thru 0x8954 (0x1401 bytes) to 0xead3d thru 0xec13d 2023-07-14T18:17:18.749 INFO:tasks.workunit.client.0.smithi163.stdout:7941( 5 mod 256): READ 0x9330b thru 0x95487 (0x217d bytes) 2023-07-14T18:17:18.749 INFO:tasks.workunit.client.0.smithi163.stdout:7942( 6 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.749 INFO:tasks.workunit.client.0.smithi163.stdout:7943( 7 mod 256): READ 0x7c3d7 thru 0x88eac (0xcad6 bytes) 2023-07-14T18:17:18.749 INFO:tasks.workunit.client.0.smithi163.stdout:7944( 8 mod 256): READ 0x4abb6 thru 0x55b33 (0xaf7e bytes) 2023-07-14T18:17:18.749 INFO:tasks.workunit.client.0.smithi163.stdout:7945( 9 mod 256): READ 0x45f0d thru 0x48e52 (0x2f46 bytes) 2023-07-14T18:17:18.749 INFO:tasks.workunit.client.0.smithi163.stdout:7946( 10 mod 256): COPY 0x978a6 thru 0xa5924 (0xe07f bytes) to 0xc8a49 thru 0xd6ac7 2023-07-14T18:17:18.749 INFO:tasks.workunit.client.0.smithi163.stdout:7947( 11 mod 256): WRITE 0x35d09 thru 0x3b687 (0x597f bytes) ***WWWW 2023-07-14T18:17:18.749 INFO:tasks.workunit.client.0.smithi163.stdout:7948( 12 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.750 INFO:tasks.workunit.client.0.smithi163.stdout:7949( 13 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.750 INFO:tasks.workunit.client.0.smithi163.stdout:7950( 14 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.750 INFO:tasks.workunit.client.0.smithi163.stdout:7951( 15 mod 256): FALLOC 0x763b3 thru 0x83372 (0xcfbf bytes) INTERIOR 2023-07-14T18:17:18.750 INFO:tasks.workunit.client.0.smithi163.stdout:7952( 16 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.750 INFO:tasks.workunit.client.0.smithi163.stdout:7953( 17 mod 256): WRITE 0x420ed thru 0x4f2b6 (0xd1ca bytes) 2023-07-14T18:17:18.750 INFO:tasks.workunit.client.0.smithi163.stdout:7954( 18 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.750 INFO:tasks.workunit.client.0.smithi163.stdout:7955( 19 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.750 INFO:tasks.workunit.client.0.smithi163.stdout:7956( 20 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.751 INFO:tasks.workunit.client.0.smithi163.stdout:7957( 21 mod 256): PUNCH 0xb9b4 thru 0x12363 (0x69b0 bytes) 2023-07-14T18:17:18.751 INFO:tasks.workunit.client.0.smithi163.stdout:7958( 22 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.751 INFO:tasks.workunit.client.0.smithi163.stdout:7959( 23 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.751 INFO:tasks.workunit.client.0.smithi163.stdout:7960( 24 mod 256): WRITE 0x82455 thru 0x84cd6 (0x2882 bytes) 2023-07-14T18:17:18.751 INFO:tasks.workunit.client.0.smithi163.stdout:7961( 25 mod 256): PUNCH 0x26bef thru 0x2eac1 (0x7ed3 bytes) 2023-07-14T18:17:18.751 INFO:tasks.workunit.client.0.smithi163.stdout:7962( 26 mod 256): WRITE 0x4f395 thru 0x5d7d1 (0xe43d bytes) 2023-07-14T18:17:18.751 INFO:tasks.workunit.client.0.smithi163.stdout:7963( 27 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.751 INFO:tasks.workunit.client.0.smithi163.stdout:7964( 28 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.752 INFO:tasks.workunit.client.0.smithi163.stdout:7965( 29 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.752 INFO:tasks.workunit.client.0.smithi163.stdout:7966( 30 mod 256): PUNCH 0x9c8ce thru 0xa8ad0 (0xc203 bytes) 2023-07-14T18:17:18.752 INFO:tasks.workunit.client.0.smithi163.stdout:7967( 31 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.752 INFO:tasks.workunit.client.0.smithi163.stdout:7968( 32 mod 256): TRUNCATE DOWN from 0xec13e to 0xd606c 2023-07-14T18:17:18.752 INFO:tasks.workunit.client.0.smithi163.stdout:7969( 33 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.752 INFO:tasks.workunit.client.0.smithi163.stdout:7970( 34 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.752 INFO:tasks.workunit.client.0.smithi163.stdout:7971( 35 mod 256): COPY 0xc5e5f thru 0xc77e0 (0x1982 bytes) to 0xa318 thru 0xbc99 2023-07-14T18:17:18.752 INFO:tasks.workunit.client.0.smithi163.stdout:7972( 36 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.753 INFO:tasks.workunit.client.0.smithi163.stdout:7973( 37 mod 256): MAPREAD 0x796d3 thru 0x7f408 (0x5d36 bytes) 2023-07-14T18:17:18.753 INFO:tasks.workunit.client.0.smithi163.stdout:7974( 38 mod 256): MAPREAD 0x19e25 thru 0x28c85 (0xee61 bytes) 2023-07-14T18:17:18.753 INFO:tasks.workunit.client.0.smithi163.stdout:7975( 39 mod 256): COPY 0x1be00 thru 0x1f4d7 (0x36d8 bytes) to 0x8a7e7 thru 0x8debe 2023-07-14T18:17:18.753 INFO:tasks.workunit.client.0.smithi163.stdout:7976( 40 mod 256): PUNCH 0x317c8 thru 0x3fb30 (0xe369 bytes) ******PPPP 2023-07-14T18:17:18.753 INFO:tasks.workunit.client.0.smithi163.stdout:7977( 41 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.753 INFO:tasks.workunit.client.0.smithi163.stdout:7978( 42 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.753 INFO:tasks.workunit.client.0.smithi163.stdout:7979( 43 mod 256): WRITE 0x33cd6 thru 0x3d0e0 (0x940b bytes) ***WWWW 2023-07-14T18:17:18.753 INFO:tasks.workunit.client.0.smithi163.stdout:7980( 44 mod 256): READ 0x309ff thru 0x3fc9d (0xf29f bytes) ***RRRR*** 2023-07-14T18:17:18.754 INFO:tasks.workunit.client.0.smithi163.stdout:7981( 45 mod 256): TRUNCATE DOWN from 0xd606c to 0x591aa 2023-07-14T18:17:18.754 INFO:tasks.workunit.client.0.smithi163.stdout:7982( 46 mod 256): MAPREAD 0x2d5af thru 0x339ef (0x6441 bytes) 2023-07-14T18:17:18.754 INFO:tasks.workunit.client.0.smithi163.stdout:7983( 47 mod 256): TRUNCATE UP from 0x591aa to 0x6fc43 2023-07-14T18:17:18.754 INFO:tasks.workunit.client.0.smithi163.stdout:7984( 48 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.754 INFO:tasks.workunit.client.0.smithi163.stdout:7985( 49 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.754 INFO:tasks.workunit.client.0.smithi163.stdout:7986( 50 mod 256): COPY 0x45821 thru 0x51cdd (0xc4bd bytes) to 0xd5f43 thru 0xe23ff 2023-07-14T18:17:18.754 INFO:tasks.workunit.client.0.smithi163.stdout:7987( 51 mod 256): MAPREAD 0x6d286 thru 0x6fd99 (0x2b14 bytes) 2023-07-14T18:17:18.754 INFO:tasks.workunit.client.0.smithi163.stdout:7988( 52 mod 256): PUNCH 0x41335 thru 0x4e981 (0xd64d bytes) 2023-07-14T18:17:18.755 INFO:tasks.workunit.client.0.smithi163.stdout:7989( 53 mod 256): MAPREAD 0x6bdad thru 0x740e9 (0x833d bytes) 2023-07-14T18:17:18.755 INFO:tasks.workunit.client.0.smithi163.stdout:7990( 54 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.755 INFO:tasks.workunit.client.0.smithi163.stdout:7991( 55 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.755 INFO:tasks.workunit.client.0.smithi163.stdout:7992( 56 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.755 INFO:tasks.workunit.client.0.smithi163.stdout:7993( 57 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.755 INFO:tasks.workunit.client.0.smithi163.stdout:7994( 58 mod 256): COPY 0x4d845 thru 0x52707 (0x4ec3 bytes) to 0x7b34f thru 0x80211 2023-07-14T18:17:18.755 INFO:tasks.workunit.client.0.smithi163.stdout:7995( 59 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.755 INFO:tasks.workunit.client.0.smithi163.stdout:7996( 60 mod 256): TRUNCATE DOWN from 0xe2400 to 0x7b1be 2023-07-14T18:17:18.756 INFO:tasks.workunit.client.0.smithi163.stdout:7997( 61 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.756 INFO:tasks.workunit.client.0.smithi163.stdout:7998( 62 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.756 INFO:tasks.workunit.client.0.smithi163.stdout:7999( 63 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.756 INFO:tasks.workunit.client.0.smithi163.stdout:8000( 64 mod 256): MAPWRITE 0xb25a7 thru 0xb8dde (0x6838 bytes) 2023-07-14T18:17:18.756 INFO:tasks.workunit.client.0.smithi163.stdout:8001( 65 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.756 INFO:tasks.workunit.client.0.smithi163.stdout:8002( 66 mod 256): FALLOC 0xf2f37 thru 0xf8dee (0x5eb7 bytes) EXTENDING 2023-07-14T18:17:18.756 INFO:tasks.workunit.client.0.smithi163.stdout:8003( 67 mod 256): FALLOC 0x5159f thru 0x5b126 (0x9b87 bytes) INTERIOR 2023-07-14T18:17:18.756 INFO:tasks.workunit.client.0.smithi163.stdout:8004( 68 mod 256): MAPWRITE 0x67250 thru 0x71592 (0xa343 bytes) 2023-07-14T18:17:18.757 INFO:tasks.workunit.client.0.smithi163.stdout:8005( 69 mod 256): FALLOC 0x1201a thru 0x218d8 (0xf8be bytes) INTERIOR 2023-07-14T18:17:18.757 INFO:tasks.workunit.client.0.smithi163.stdout:8006( 70 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.757 INFO:tasks.workunit.client.0.smithi163.stdout:8007( 71 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.757 INFO:tasks.workunit.client.0.smithi163.stdout:8008( 72 mod 256): COPY 0x81a1f thru 0x8794b (0x5f2d bytes) to 0x4553e thru 0x4b46a 2023-07-14T18:17:18.757 INFO:tasks.workunit.client.0.smithi163.stdout:8009( 73 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.757 INFO:tasks.workunit.client.0.smithi163.stdout:8010( 74 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.757 INFO:tasks.workunit.client.0.smithi163.stdout:8011( 75 mod 256): MAPWRITE 0x402bb thru 0x4fa1f (0xf765 bytes) 2023-07-14T18:17:18.757 INFO:tasks.workunit.client.0.smithi163.stdout:8012( 76 mod 256): FALLOC 0x2db13 thru 0x2e7c0 (0xcad bytes) INTERIOR 2023-07-14T18:17:18.758 INFO:tasks.workunit.client.0.smithi163.stdout:8013( 77 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.758 INFO:tasks.workunit.client.0.smithi163.stdout:8014( 78 mod 256): COPY 0x21044 thru 0x2b3cf (0xa38c bytes) to 0xe7fa thru 0x18b85 2023-07-14T18:17:18.758 INFO:tasks.workunit.client.0.smithi163.stdout:8015( 79 mod 256): TRUNCATE DOWN from 0xf8dee to 0x6cf33 2023-07-14T18:17:18.758 INFO:tasks.workunit.client.0.smithi163.stdout:8016( 80 mod 256): COPY 0x68c8f thru 0x6cf32 (0x42a4 bytes) to 0x157d9 thru 0x19a7c 2023-07-14T18:17:18.758 INFO:tasks.workunit.client.0.smithi163.stdout:8017( 81 mod 256): PUNCH 0x12b1d thru 0x14c1d (0x2101 bytes) 2023-07-14T18:17:18.758 INFO:tasks.workunit.client.0.smithi163.stdout:8018( 82 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.758 INFO:tasks.workunit.client.0.smithi163.stdout:8019( 83 mod 256): PUNCH 0x26d58 thru 0x2c931 (0x5bda bytes) 2023-07-14T18:17:18.758 INFO:tasks.workunit.client.0.smithi163.stdout:8020( 84 mod 256): PUNCH 0x67124 thru 0x6c216 (0x50f3 bytes) 2023-07-14T18:17:18.759 INFO:tasks.workunit.client.0.smithi163.stdout:8021( 85 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.759 INFO:tasks.workunit.client.0.smithi163.stdout:8022( 86 mod 256): PUNCH 0x661d8 thru 0x6cf32 (0x6d5b bytes) 2023-07-14T18:17:18.759 INFO:tasks.workunit.client.0.smithi163.stdout:8023( 87 mod 256): PUNCH 0x68083 thru 0x6cf32 (0x4eb0 bytes) 2023-07-14T18:17:18.759 INFO:tasks.workunit.client.0.smithi163.stdout:8024( 88 mod 256): TRUNCATE DOWN from 0x6cf33 to 0x2987e ******WWWW 2023-07-14T18:17:18.759 INFO:tasks.workunit.client.0.smithi163.stdout:8025( 89 mod 256): WRITE 0x590f7 thru 0x62767 (0x9671 bytes) HOLE ***WWWW 2023-07-14T18:17:18.759 INFO:tasks.workunit.client.0.smithi163.stdout:8026( 90 mod 256): FALLOC 0x9770f thru 0x984b4 (0xda5 bytes) PAST_EOF 2023-07-14T18:17:18.759 INFO:tasks.workunit.client.0.smithi163.stdout:8027( 91 mod 256): READ 0x252ae thru 0x2f37d (0xa0d0 bytes) 2023-07-14T18:17:18.759 INFO:tasks.workunit.client.0.smithi163.stdout:8028( 92 mod 256): PUNCH 0x3d734 thru 0x402ec (0x2bb9 bytes) 2023-07-14T18:17:18.760 INFO:tasks.workunit.client.0.smithi163.stdout:8029( 93 mod 256): FALLOC 0x9461b thru 0xa28ab (0xe290 bytes) EXTENDING 2023-07-14T18:17:18.760 INFO:tasks.workunit.client.0.smithi163.stdout:8030( 94 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.760 INFO:tasks.workunit.client.0.smithi163.stdout:8031( 95 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.760 INFO:tasks.workunit.client.0.smithi163.stdout:8032( 96 mod 256): READ 0x45a2e thru 0x48bf6 (0x31c9 bytes) 2023-07-14T18:17:18.760 INFO:tasks.workunit.client.0.smithi163.stdout:8033( 97 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.760 INFO:tasks.workunit.client.0.smithi163.stdout:8034( 98 mod 256): FALLOC 0x3a07 thru 0x9f0a (0x6503 bytes) INTERIOR 2023-07-14T18:17:18.760 INFO:tasks.workunit.client.0.smithi163.stdout:8035( 99 mod 256): MAPREAD 0x5ebb8 thru 0x6aafa (0xbf43 bytes) 2023-07-14T18:17:18.761 INFO:tasks.workunit.client.0.smithi163.stdout:8036(100 mod 256): PUNCH 0xa083c thru 0xa28aa (0x206f bytes) 2023-07-14T18:17:18.761 INFO:tasks.workunit.client.0.smithi163.stdout:8037(101 mod 256): READ 0x97185 thru 0xa28aa (0xb726 bytes) 2023-07-14T18:17:18.761 INFO:tasks.workunit.client.0.smithi163.stdout:8038(102 mod 256): TRUNCATE DOWN from 0xa28ab to 0x18b3e ******WWWW 2023-07-14T18:17:18.761 INFO:tasks.workunit.client.0.smithi163.stdout:8039(103 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.761 INFO:tasks.workunit.client.0.smithi163.stdout:8040(104 mod 256): FALLOC 0x568d9 thru 0x5fa25 (0x914c bytes) PAST_EOF 2023-07-14T18:17:18.761 INFO:tasks.workunit.client.0.smithi163.stdout:8041(105 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.761 INFO:tasks.workunit.client.0.smithi163.stdout:8042(106 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.761 INFO:tasks.workunit.client.0.smithi163.stdout:8043(107 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.761 INFO:tasks.workunit.client.0.smithi163.stdout:8044(108 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.762 INFO:tasks.workunit.client.0.smithi163.stdout:8045(109 mod 256): COPY 0x184a1 thru 0x18b3d (0x69d bytes) to 0x68389 thru 0x68a25 2023-07-14T18:17:18.762 INFO:tasks.workunit.client.0.smithi163.stdout:8046(110 mod 256): FALLOC 0x4ce63 thru 0x53e94 (0x7031 bytes) INTERIOR 2023-07-14T18:17:18.762 INFO:tasks.workunit.client.0.smithi163.stdout:8047(111 mod 256): FALLOC 0x8ed8c thru 0x90a9d (0x1d11 bytes) PAST_EOF 2023-07-14T18:17:18.762 INFO:tasks.workunit.client.0.smithi163.stdout:8048(112 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.762 INFO:tasks.workunit.client.0.smithi163.stdout:8049(113 mod 256): TRUNCATE DOWN from 0x68a26 to 0x20da ******WWWW 2023-07-14T18:17:18.762 INFO:tasks.workunit.client.0.smithi163.stdout:8050(114 mod 256): COPY 0x13bd thru 0x20d9 (0xd1d bytes) to 0x6d40 thru 0x7a5c 2023-07-14T18:17:18.762 INFO:tasks.workunit.client.0.smithi163.stdout:8051(115 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.762 INFO:tasks.workunit.client.0.smithi163.stdout:8052(116 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.763 INFO:tasks.workunit.client.0.smithi163.stdout:8053(117 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.763 INFO:tasks.workunit.client.0.smithi163.stdout:8054(118 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.763 INFO:tasks.workunit.client.0.smithi163.stdout:8055(119 mod 256): MAPWRITE 0x4bdcd thru 0x5add5 (0xf009 bytes) 2023-07-14T18:17:18.763 INFO:tasks.workunit.client.0.smithi163.stdout:8056(120 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.763 INFO:tasks.workunit.client.0.smithi163.stdout:8057(121 mod 256): FALLOC 0x676d0 thru 0x6a6d7 (0x3007 bytes) PAST_EOF 2023-07-14T18:17:18.763 INFO:tasks.workunit.client.0.smithi163.stdout:8058(122 mod 256): WRITE 0x95c91 thru 0x9fc6a (0x9fda bytes) HOLE 2023-07-14T18:17:18.763 INFO:tasks.workunit.client.0.smithi163.stdout:8059(123 mod 256): COPY 0x89bff thru 0x9819c (0xe59e bytes) to 0x53bef thru 0x6218c 2023-07-14T18:17:18.763 INFO:tasks.workunit.client.0.smithi163.stdout:8060(124 mod 256): COPY 0x2ebb6 thru 0x3c7e5 (0xdc30 bytes) to 0x20552 thru 0x2e181 EEEE****** 2023-07-14T18:17:18.764 INFO:tasks.workunit.client.0.smithi163.stdout:8061(125 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.764 INFO:tasks.workunit.client.0.smithi163.stdout:8062(126 mod 256): COPY 0x9e106 thru 0x9fc6a (0x1b65 bytes) to 0x2ab0a thru 0x2c66e 2023-07-14T18:17:18.764 INFO:tasks.workunit.client.0.smithi163.stdout:8063(127 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.764 INFO:tasks.workunit.client.0.smithi163.stdout:8064(128 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.764 INFO:tasks.workunit.client.0.smithi163.stdout:8065(129 mod 256): TRUNCATE DOWN from 0x9fc6b to 0x186b8 ******WWWW 2023-07-14T18:17:18.764 INFO:tasks.workunit.client.0.smithi163.stdout:8066(130 mod 256): TRUNCATE UP from 0x186b8 to 0xa4c76 ******WWWW 2023-07-14T18:17:18.764 INFO:tasks.workunit.client.0.smithi163.stdout:8067(131 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.764 INFO:tasks.workunit.client.0.smithi163.stdout:8068(132 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.765 INFO:tasks.workunit.client.0.smithi163.stdout:8069(133 mod 256): WRITE 0xa3864 thru 0xac54e (0x8ceb bytes) EXTEND 2023-07-14T18:17:18.765 INFO:tasks.workunit.client.0.smithi163.stdout:8070(134 mod 256): READ 0x32f40 thru 0x3b602 (0x86c3 bytes) ***RRRR*** 2023-07-14T18:17:18.765 INFO:tasks.workunit.client.0.smithi163.stdout:8071(135 mod 256): WRITE 0x22d39 thru 0x275d3 (0x489b bytes) 2023-07-14T18:17:18.765 INFO:tasks.workunit.client.0.smithi163.stdout:8072(136 mod 256): MAPWRITE 0x1849f thru 0x22ea9 (0xaa0b bytes) 2023-07-14T18:17:18.765 INFO:tasks.workunit.client.0.smithi163.stdout:8073(137 mod 256): COPY 0x9b0d7 thru 0xa8af6 (0xda20 bytes) to 0x5452a thru 0x61f49 2023-07-14T18:17:18.765 INFO:tasks.workunit.client.0.smithi163.stdout:8074(138 mod 256): MAPWRITE 0xe6d25 thru 0xee867 (0x7b43 bytes) 2023-07-14T18:17:18.765 INFO:tasks.workunit.client.0.smithi163.stdout:8075(139 mod 256): WRITE 0x6c115 thru 0x71002 (0x4eee bytes) 2023-07-14T18:17:18.765 INFO:tasks.workunit.client.0.smithi163.stdout:8076(140 mod 256): READ 0x52eaf thru 0x595c3 (0x6715 bytes) 2023-07-14T18:17:18.766 INFO:tasks.workunit.client.0.smithi163.stdout:8077(141 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.766 INFO:tasks.workunit.client.0.smithi163.stdout:8078(142 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.766 INFO:tasks.workunit.client.0.smithi163.stdout:8079(143 mod 256): TRUNCATE DOWN from 0xee868 to 0x27ad8 ******WWWW 2023-07-14T18:17:18.766 INFO:tasks.workunit.client.0.smithi163.stdout:8080(144 mod 256): MAPREAD 0xdb94 thru 0x1365a (0x5ac7 bytes) 2023-07-14T18:17:18.766 INFO:tasks.workunit.client.0.smithi163.stdout:8081(145 mod 256): TRUNCATE UP from 0x27ad8 to 0xbead5 ******WWWW 2023-07-14T18:17:18.766 INFO:tasks.workunit.client.0.smithi163.stdout:8082(146 mod 256): WRITE 0xed100 thru 0xedccd (0xbce bytes) HOLE 2023-07-14T18:17:18.766 INFO:tasks.workunit.client.0.smithi163.stdout:8083(147 mod 256): COPY 0xe2e92 thru 0xeac9a (0x7e09 bytes) to 0xc68eb thru 0xce6f3 2023-07-14T18:17:18.766 INFO:tasks.workunit.client.0.smithi163.stdout:8084(148 mod 256): MAPREAD 0xb7ed0 thru 0xbd194 (0x52c5 bytes) 2023-07-14T18:17:18.767 INFO:tasks.workunit.client.0.smithi163.stdout:8085(149 mod 256): MAPREAD 0x9a3ca thru 0xa1619 (0x7250 bytes) 2023-07-14T18:17:18.767 INFO:tasks.workunit.client.0.smithi163.stdout:8086(150 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.767 INFO:tasks.workunit.client.0.smithi163.stdout:8087(151 mod 256): MAPREAD 0x91789 thru 0x968d9 (0x5151 bytes) 2023-07-14T18:17:18.767 INFO:tasks.workunit.client.0.smithi163.stdout:8088(152 mod 256): COPY 0xd8a6b thru 0xdfab6 (0x704c bytes) to 0xc46bc thru 0xcb707 2023-07-14T18:17:18.767 INFO:tasks.workunit.client.0.smithi163.stdout:8089(153 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.767 INFO:tasks.workunit.client.0.smithi163.stdout:8090(154 mod 256): WRITE 0x4f35 thru 0x7a7c (0x2b48 bytes) 2023-07-14T18:17:18.767 INFO:tasks.workunit.client.0.smithi163.stdout:8091(155 mod 256): TRUNCATE DOWN from 0xedcce to 0xe4a74 2023-07-14T18:17:18.767 INFO:tasks.workunit.client.0.smithi163.stdout:8092(156 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.768 INFO:tasks.workunit.client.0.smithi163.stdout:8093(157 mod 256): MAPREAD 0x48eb5 thru 0x4fc39 (0x6d85 bytes) 2023-07-14T18:17:18.768 INFO:tasks.workunit.client.0.smithi163.stdout:8094(158 mod 256): TRUNCATE DOWN from 0xe4a74 to 0x8068 ******WWWW 2023-07-14T18:17:18.768 INFO:tasks.workunit.client.0.smithi163.stdout:8095(159 mod 256): PUNCH 0xe23 thru 0x14d7 (0x6b5 bytes) 2023-07-14T18:17:18.768 INFO:tasks.workunit.client.0.smithi163.stdout:8096(160 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.768 INFO:tasks.workunit.client.0.smithi163.stdout:8097(161 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.768 INFO:tasks.workunit.client.0.smithi163.stdout:8098(162 mod 256): MAPWRITE 0x93705 thru 0xa17b4 (0xe0b0 bytes) 2023-07-14T18:17:18.768 INFO:tasks.workunit.client.0.smithi163.stdout:8099(163 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.768 INFO:tasks.workunit.client.0.smithi163.stdout:8100(164 mod 256): COPY 0x5243d thru 0x5ee88 (0xca4c bytes) to 0x694db thru 0x75f26 2023-07-14T18:17:18.769 INFO:tasks.workunit.client.0.smithi163.stdout:8101(165 mod 256): MAPREAD 0x13894 thru 0x178f8 (0x4065 bytes) 2023-07-14T18:17:18.769 INFO:tasks.workunit.client.0.smithi163.stdout:8102(166 mod 256): PUNCH 0x99eef thru 0xa17b4 (0x78c6 bytes) 2023-07-14T18:17:18.769 INFO:tasks.workunit.client.0.smithi163.stdout:8103(167 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.769 INFO:tasks.workunit.client.0.smithi163.stdout:8104(168 mod 256): READ 0x20d5d thru 0x29ae2 (0x8d86 bytes) 2023-07-14T18:17:18.769 INFO:tasks.workunit.client.0.smithi163.stdout:8105(169 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.769 INFO:tasks.workunit.client.0.smithi163.stdout:8106(170 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.769 INFO:tasks.workunit.client.0.smithi163.stdout:8107(171 mod 256): TRUNCATE DOWN from 0xa17b5 to 0x6148d 2023-07-14T18:17:18.769 INFO:tasks.workunit.client.0.smithi163.stdout:8108(172 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.770 INFO:tasks.workunit.client.0.smithi163.stdout:8109(173 mod 256): PUNCH 0x2207c thru 0x2c6e6 (0xa66b bytes) 2023-07-14T18:17:18.770 INFO:tasks.workunit.client.0.smithi163.stdout:8110(174 mod 256): PUNCH 0xcf8c thru 0xeba8 (0x1c1d bytes) 2023-07-14T18:17:18.770 INFO:tasks.workunit.client.0.smithi163.stdout:8111(175 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.770 INFO:tasks.workunit.client.0.smithi163.stdout:8112(176 mod 256): PUNCH 0x5537 thru 0x10981 (0xb44b bytes) 2023-07-14T18:17:18.770 INFO:tasks.workunit.client.0.smithi163.stdout:8113(177 mod 256): COPY 0x4c9ce thru 0x55558 (0x8b8b bytes) to 0x221a1 thru 0x2ad2b 2023-07-14T18:17:18.770 INFO:tasks.workunit.client.0.smithi163.stdout:8114(178 mod 256): READ 0x12cbe thru 0x15b54 (0x2e97 bytes) 2023-07-14T18:17:18.770 INFO:tasks.workunit.client.0.smithi163.stdout:8115(179 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.770 INFO:tasks.workunit.client.0.smithi163.stdout:8116(180 mod 256): COPY 0x348c7 thru 0x38e3d (0x4577 bytes) to 0x5540a thru 0x59980 EEEE****** 2023-07-14T18:17:18.771 INFO:tasks.workunit.client.0.smithi163.stdout:8117(181 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.771 INFO:tasks.workunit.client.0.smithi163.stdout:8118(182 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.771 INFO:tasks.workunit.client.0.smithi163.stdout:8119(183 mod 256): MAPREAD 0x10a58 thru 0x10fcf (0x578 bytes) 2023-07-14T18:17:18.771 INFO:tasks.workunit.client.0.smithi163.stdout:8120(184 mod 256): PUNCH 0x34979 thru 0x40518 (0xbba0 bytes) ******PPPP 2023-07-14T18:17:18.771 INFO:tasks.workunit.client.0.smithi163.stdout:8121(185 mod 256): TRUNCATE DOWN from 0x6148d to 0x4f437 2023-07-14T18:17:18.771 INFO:tasks.workunit.client.0.smithi163.stdout:8122(186 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.771 INFO:tasks.workunit.client.0.smithi163.stdout:8123(187 mod 256): MAPREAD 0x43054 thru 0x4bc10 (0x8bbd bytes) 2023-07-14T18:17:18.771 INFO:tasks.workunit.client.0.smithi163.stdout:8124(188 mod 256): MAPREAD 0x4322d thru 0x4e221 (0xaff5 bytes) 2023-07-14T18:17:18.772 INFO:tasks.workunit.client.0.smithi163.stdout:8125(189 mod 256): COPY 0x16bf6 thru 0x22b6c (0xbf77 bytes) to 0xbd13b thru 0xc90b1 2023-07-14T18:17:18.772 INFO:tasks.workunit.client.0.smithi163.stdout:8126(190 mod 256): PUNCH 0x54c8e thru 0x59120 (0x4493 bytes) 2023-07-14T18:17:18.772 INFO:tasks.workunit.client.0.smithi163.stdout:8127(191 mod 256): READ 0x6376e thru 0x7298c (0xf21f bytes) 2023-07-14T18:17:18.772 INFO:tasks.workunit.client.0.smithi163.stdout:8128(192 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.772 INFO:tasks.workunit.client.0.smithi163.stdout:8129(193 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.772 INFO:tasks.workunit.client.0.smithi163.stdout:8130(194 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.772 INFO:tasks.workunit.client.0.smithi163.stdout:8131(195 mod 256): TRUNCATE DOWN from 0xc90b2 to 0xaa984 2023-07-14T18:17:18.772 INFO:tasks.workunit.client.0.smithi163.stdout:8132(196 mod 256): READ 0x9d6cd thru 0xa9cfd (0xc631 bytes) 2023-07-14T18:17:18.773 INFO:tasks.workunit.client.0.smithi163.stdout:8133(197 mod 256): READ 0x8bcd2 thru 0x97f15 (0xc244 bytes) 2023-07-14T18:17:18.773 INFO:tasks.workunit.client.0.smithi163.stdout:8134(198 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.773 INFO:tasks.workunit.client.0.smithi163.stdout:8135(199 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.773 INFO:tasks.workunit.client.0.smithi163.stdout:8136(200 mod 256): FALLOC 0xe52be thru 0xe5acd (0x80f bytes) PAST_EOF 2023-07-14T18:17:18.773 INFO:tasks.workunit.client.0.smithi163.stdout:8137(201 mod 256): TRUNCATE DOWN from 0xaa984 to 0x7dc7 ******WWWW 2023-07-14T18:17:18.773 INFO:tasks.workunit.client.0.smithi163.stdout:8138(202 mod 256): FALLOC 0xfc2a5 thru 0xffaa6 (0x3801 bytes) EXTENDING 2023-07-14T18:17:18.773 INFO:tasks.workunit.client.0.smithi163.stdout:8139(203 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.774 INFO:tasks.workunit.client.0.smithi163.stdout:8140(204 mod 256): TRUNCATE DOWN from 0xffaa6 to 0xf4cad 2023-07-14T18:17:18.774 INFO:tasks.workunit.client.0.smithi163.stdout:8141(205 mod 256): WRITE 0x53693 thru 0x55a01 (0x236f bytes) 2023-07-14T18:17:18.774 INFO:tasks.workunit.client.0.smithi163.stdout:8142(206 mod 256): WRITE 0x63c13 thru 0x6aa91 (0x6e7f bytes) 2023-07-14T18:17:18.774 INFO:tasks.workunit.client.0.smithi163.stdout:8143(207 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.774 INFO:tasks.workunit.client.0.smithi163.stdout:8144(208 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.774 INFO:tasks.workunit.client.0.smithi163.stdout:8145(209 mod 256): WRITE 0xe98e2 thru 0xf8752 (0xee71 bytes) EXTEND 2023-07-14T18:17:18.774 INFO:tasks.workunit.client.0.smithi163.stdout:8146(210 mod 256): COPY 0xf090 thru 0x11175 (0x20e6 bytes) to 0x94343 thru 0x96428 2023-07-14T18:17:18.774 INFO:tasks.workunit.client.0.smithi163.stdout:8147(211 mod 256): MAPREAD 0x20c0b thru 0x21002 (0x3f8 bytes) 2023-07-14T18:17:18.775 INFO:tasks.workunit.client.0.smithi163.stdout:8148(212 mod 256): COPY 0x831d8 thru 0x8d89d (0xa6c6 bytes) to 0x5c303 thru 0x669c8 2023-07-14T18:17:18.775 INFO:tasks.workunit.client.0.smithi163.stdout:8149(213 mod 256): MAPWRITE 0xe9cd9 thru 0xeabfd (0xf25 bytes) 2023-07-14T18:17:18.775 INFO:tasks.workunit.client.0.smithi163.stdout:8150(214 mod 256): READ 0x37c98 thru 0x3ba0c (0x3d75 bytes) ***RRRR*** 2023-07-14T18:17:18.775 INFO:tasks.workunit.client.0.smithi163.stdout:8151(215 mod 256): READ 0x5a6b6 thru 0x648fe (0xa249 bytes) 2023-07-14T18:17:18.775 INFO:tasks.workunit.client.0.smithi163.stdout:8152(216 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.775 INFO:tasks.workunit.client.0.smithi163.stdout:8153(217 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.775 INFO:tasks.workunit.client.0.smithi163.stdout:8154(218 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.775 INFO:tasks.workunit.client.0.smithi163.stdout:8155(219 mod 256): READ 0x5a74d thru 0x65b8d (0xb441 bytes) 2023-07-14T18:17:18.776 INFO:tasks.workunit.client.0.smithi163.stdout:8156(220 mod 256): READ 0xdcc05 thru 0xeac9d (0xe099 bytes) 2023-07-14T18:17:18.776 INFO:tasks.workunit.client.0.smithi163.stdout:8157(221 mod 256): PUNCH 0x3410b thru 0x432ef (0xf1e5 bytes) ******PPPP 2023-07-14T18:17:18.776 INFO:tasks.workunit.client.0.smithi163.stdout:8158(222 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.776 INFO:tasks.workunit.client.0.smithi163.stdout:8159(223 mod 256): TRUNCATE DOWN from 0xf8753 to 0x72e33 2023-07-14T18:17:18.776 INFO:tasks.workunit.client.0.smithi163.stdout:8160(224 mod 256): TRUNCATE UP from 0x72e33 to 0xcca1a 2023-07-14T18:17:18.776 INFO:tasks.workunit.client.0.smithi163.stdout:8161(225 mod 256): COPY 0x682f7 thru 0x6911d (0xe27 bytes) to 0x4c08d thru 0x4ceb3 2023-07-14T18:17:18.776 INFO:tasks.workunit.client.0.smithi163.stdout:8162(226 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.776 INFO:tasks.workunit.client.0.smithi163.stdout:8163(227 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.777 INFO:tasks.workunit.client.0.smithi163.stdout:8164(228 mod 256): FALLOC 0xfca5f thru 0x100000 (0x35a1 bytes) PAST_EOF 2023-07-14T18:17:18.777 INFO:tasks.workunit.client.0.smithi163.stdout:8165(229 mod 256): TRUNCATE DOWN from 0xcca1a to 0xc515f 2023-07-14T18:17:18.777 INFO:tasks.workunit.client.0.smithi163.stdout:8166(230 mod 256): READ 0x4855b thru 0x54788 (0xc22e bytes) 2023-07-14T18:17:18.777 INFO:tasks.workunit.client.0.smithi163.stdout:8167(231 mod 256): PUNCH 0x65832 thru 0x74438 (0xec07 bytes) 2023-07-14T18:17:18.777 INFO:tasks.workunit.client.0.smithi163.stdout:8168(232 mod 256): MAPREAD 0xbb832 thru 0xc04a3 (0x4c72 bytes) 2023-07-14T18:17:18.777 INFO:tasks.workunit.client.0.smithi163.stdout:8169(233 mod 256): TRUNCATE DOWN from 0xc515f to 0xbe76e 2023-07-14T18:17:18.777 INFO:tasks.workunit.client.0.smithi163.stdout:8170(234 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.777 INFO:tasks.workunit.client.0.smithi163.stdout:8171(235 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.778 INFO:tasks.workunit.client.0.smithi163.stdout:8172(236 mod 256): PUNCH 0x8621c thru 0x86f11 (0xcf6 bytes) 2023-07-14T18:17:18.778 INFO:tasks.workunit.client.0.smithi163.stdout:8173(237 mod 256): TRUNCATE UP from 0xbe76e to 0xc5f15 2023-07-14T18:17:18.778 INFO:tasks.workunit.client.0.smithi163.stdout:8174(238 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.778 INFO:tasks.workunit.client.0.smithi163.stdout:8175(239 mod 256): MAPREAD 0x4c501 thru 0x56146 (0x9c46 bytes) 2023-07-14T18:17:18.778 INFO:tasks.workunit.client.0.smithi163.stdout:8176(240 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.778 INFO:tasks.workunit.client.0.smithi163.stdout:8177(241 mod 256): MAPWRITE 0x744a8 thru 0x82bd0 (0xe729 bytes) 2023-07-14T18:17:18.778 INFO:tasks.workunit.client.0.smithi163.stdout:8178(242 mod 256): PUNCH 0x518c4 thru 0x600fd (0xe83a bytes) 2023-07-14T18:17:18.778 INFO:tasks.workunit.client.0.smithi163.stdout:8179(243 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.779 INFO:tasks.workunit.client.0.smithi163.stdout:8180(244 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.779 INFO:tasks.workunit.client.0.smithi163.stdout:8181(245 mod 256): PUNCH 0x11bab thru 0x1b725 (0x9b7b bytes) 2023-07-14T18:17:18.779 INFO:tasks.workunit.client.0.smithi163.stdout:8182(246 mod 256): WRITE 0xb8b06 thru 0xc8419 (0xf914 bytes) EXTEND 2023-07-14T18:17:18.779 INFO:tasks.workunit.client.0.smithi163.stdout:8183(247 mod 256): FALLOC 0xc018 thru 0x1982f (0xd817 bytes) INTERIOR 2023-07-14T18:17:18.779 INFO:tasks.workunit.client.0.smithi163.stdout:8184(248 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.779 INFO:tasks.workunit.client.0.smithi163.stdout:8185(249 mod 256): COPY 0x95249 thru 0xa0479 (0xb231 bytes) to 0x7cb2e thru 0x87d5e 2023-07-14T18:17:18.779 INFO:tasks.workunit.client.0.smithi163.stdout:8186(250 mod 256): MAPREAD 0xc328e thru 0xc50ba (0x1e2d bytes) 2023-07-14T18:17:18.779 INFO:tasks.workunit.client.0.smithi163.stdout:8187(251 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.780 INFO:tasks.workunit.client.0.smithi163.stdout:8188(252 mod 256): MAPREAD 0x40e79 thru 0x45e05 (0x4f8d bytes) 2023-07-14T18:17:18.780 INFO:tasks.workunit.client.0.smithi163.stdout:8189(253 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.780 INFO:tasks.workunit.client.0.smithi163.stdout:8190(254 mod 256): WRITE 0x27f55 thru 0x2fc29 (0x7cd5 bytes) 2023-07-14T18:17:18.780 INFO:tasks.workunit.client.0.smithi163.stdout:8191(255 mod 256): PUNCH 0x7421f thru 0x837c4 (0xf5a6 bytes) 2023-07-14T18:17:18.780 INFO:tasks.workunit.client.0.smithi163.stdout:8192( 0 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.780 INFO:tasks.workunit.client.0.smithi163.stdout:8193( 1 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.780 INFO:tasks.workunit.client.0.smithi163.stdout:8194( 2 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.780 INFO:tasks.workunit.client.0.smithi163.stdout:8195( 3 mod 256): MAPWRITE 0x6c1ba thru 0x79bef (0xda36 bytes) 2023-07-14T18:17:18.781 INFO:tasks.workunit.client.0.smithi163.stdout:8196( 4 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.781 INFO:tasks.workunit.client.0.smithi163.stdout:8197( 5 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.781 INFO:tasks.workunit.client.0.smithi163.stdout:8198( 6 mod 256): MAPREAD 0x7310d thru 0x7315d (0x51 bytes) 2023-07-14T18:17:18.781 INFO:tasks.workunit.client.0.smithi163.stdout:8199( 7 mod 256): MAPWRITE 0xed786 thru 0xf99ed (0xc268 bytes) 2023-07-14T18:17:18.781 INFO:tasks.workunit.client.0.smithi163.stdout:8200( 8 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.781 INFO:tasks.workunit.client.0.smithi163.stdout:8201( 9 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.781 INFO:tasks.workunit.client.0.smithi163.stdout:8202( 10 mod 256): MAPREAD 0x9a840 thru 0xa297d (0x813e bytes) 2023-07-14T18:17:18.781 INFO:tasks.workunit.client.0.smithi163.stdout:8203( 11 mod 256): MAPREAD 0x8ae8 thru 0xf8fe (0x6e17 bytes) 2023-07-14T18:17:18.782 INFO:tasks.workunit.client.0.smithi163.stdout:8204( 12 mod 256): MAPREAD 0x7a93e thru 0x7e2ba (0x397d bytes) 2023-07-14T18:17:18.782 INFO:tasks.workunit.client.0.smithi163.stdout:8205( 13 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.782 INFO:tasks.workunit.client.0.smithi163.stdout:8206( 14 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.782 INFO:tasks.workunit.client.0.smithi163.stdout:8207( 15 mod 256): WRITE 0xff0e7 thru 0xfffff (0xf19 bytes) HOLE 2023-07-14T18:17:18.782 INFO:tasks.workunit.client.0.smithi163.stdout:8208( 16 mod 256): MAPWRITE 0xb0297 thru 0xb6bc0 (0x692a bytes) 2023-07-14T18:17:18.782 INFO:tasks.workunit.client.0.smithi163.stdout:8209( 17 mod 256): FALLOC 0x3e587 thru 0x4ccb1 (0xe72a bytes) INTERIOR 2023-07-14T18:17:18.782 INFO:tasks.workunit.client.0.smithi163.stdout:8210( 18 mod 256): MAPWRITE 0x290fd thru 0x29ac1 (0x9c5 bytes) 2023-07-14T18:17:18.782 INFO:tasks.workunit.client.0.smithi163.stdout:8211( 19 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.783 INFO:tasks.workunit.client.0.smithi163.stdout:8212( 20 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.783 INFO:tasks.workunit.client.0.smithi163.stdout:8213( 21 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.783 INFO:tasks.workunit.client.0.smithi163.stdout:8214( 22 mod 256): WRITE 0x6a113 thru 0x6a19e (0x8c bytes) 2023-07-14T18:17:18.783 INFO:tasks.workunit.client.0.smithi163.stdout:8215( 23 mod 256): FALLOC 0x5621b thru 0x5d3be (0x71a3 bytes) INTERIOR 2023-07-14T18:17:18.783 INFO:tasks.workunit.client.0.smithi163.stdout:8216( 24 mod 256): TRUNCATE DOWN from 0x100000 to 0x4c58a 2023-07-14T18:17:18.783 INFO:tasks.workunit.client.0.smithi163.stdout:8217( 25 mod 256): PUNCH 0x4b0f3 thru 0x4c589 (0x1497 bytes) 2023-07-14T18:17:18.783 INFO:tasks.workunit.client.0.smithi163.stdout:8218( 26 mod 256): COPY 0x31ec1 thru 0x3555e (0x369e bytes) to 0xce5f9 thru 0xd1c96 2023-07-14T18:17:18.783 INFO:tasks.workunit.client.0.smithi163.stdout:8219( 27 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.784 INFO:tasks.workunit.client.0.smithi163.stdout:8220( 28 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.784 INFO:tasks.workunit.client.0.smithi163.stdout:8221( 29 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.784 INFO:tasks.workunit.client.0.smithi163.stdout:8222( 30 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.784 INFO:tasks.workunit.client.0.smithi163.stdout:8223( 31 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.784 INFO:tasks.workunit.client.0.smithi163.stdout:8224( 32 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.784 INFO:tasks.workunit.client.0.smithi163.stdout:8225( 33 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.784 INFO:tasks.workunit.client.0.smithi163.stdout:8226( 34 mod 256): PUNCH 0x4ac15 thru 0x58dd4 (0xe1c0 bytes) 2023-07-14T18:17:18.784 INFO:tasks.workunit.client.0.smithi163.stdout:8227( 35 mod 256): PUNCH 0x6aab7 thru 0x75706 (0xac50 bytes) 2023-07-14T18:17:18.785 INFO:tasks.workunit.client.0.smithi163.stdout:8228( 36 mod 256): PUNCH 0x910ae thru 0x9ffb1 (0xef04 bytes) 2023-07-14T18:17:18.785 INFO:tasks.workunit.client.0.smithi163.stdout:8229( 37 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.785 INFO:tasks.workunit.client.0.smithi163.stdout:8230( 38 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.785 INFO:tasks.workunit.client.0.smithi163.stdout:8231( 39 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.785 INFO:tasks.workunit.client.0.smithi163.stdout:8232( 40 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.785 INFO:tasks.workunit.client.0.smithi163.stdout:8233( 41 mod 256): COPY 0x8b854 thru 0x8c7ab (0xf58 bytes) to 0xade80 thru 0xaedd7 2023-07-14T18:17:18.785 INFO:tasks.workunit.client.0.smithi163.stdout:8234( 42 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.785 INFO:tasks.workunit.client.0.smithi163.stdout:8235( 43 mod 256): MAPREAD 0x18b79 thru 0x21174 (0x85fc bytes) 2023-07-14T18:17:18.786 INFO:tasks.workunit.client.0.smithi163.stdout:8236( 44 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.786 INFO:tasks.workunit.client.0.smithi163.stdout:8237( 45 mod 256): FALLOC 0xc9ab1 thru 0xd2a13 (0x8f62 bytes) PAST_EOF 2023-07-14T18:17:18.786 INFO:tasks.workunit.client.0.smithi163.stdout:8238( 46 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.786 INFO:tasks.workunit.client.0.smithi163.stdout:8239( 47 mod 256): PUNCH 0xaccf9 thru 0xbc492 (0xf79a bytes) 2023-07-14T18:17:18.786 INFO:tasks.workunit.client.0.smithi163.stdout:8240( 48 mod 256): PUNCH 0x6e393 thru 0x75a40 (0x76ae bytes) 2023-07-14T18:17:18.786 INFO:tasks.workunit.client.0.smithi163.stdout:8241( 49 mod 256): FALLOC 0xa56b6 thru 0xaf988 (0xa2d2 bytes) INTERIOR 2023-07-14T18:17:18.786 INFO:tasks.workunit.client.0.smithi163.stdout:8242( 50 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.786 INFO:tasks.workunit.client.0.smithi163.stdout:8243( 51 mod 256): FALLOC 0xdb1b5 thru 0xe7ae7 (0xc932 bytes) EXTENDING 2023-07-14T18:17:18.787 INFO:tasks.workunit.client.0.smithi163.stdout:8244( 52 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.787 INFO:tasks.workunit.client.0.smithi163.stdout:8245( 53 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.787 INFO:tasks.workunit.client.0.smithi163.stdout:8246( 54 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.787 INFO:tasks.workunit.client.0.smithi163.stdout:8247( 55 mod 256): WRITE 0x876b3 thru 0x95b70 (0xe4be bytes) 2023-07-14T18:17:18.787 INFO:tasks.workunit.client.0.smithi163.stdout:8248( 56 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.787 INFO:tasks.workunit.client.0.smithi163.stdout:8249( 57 mod 256): WRITE 0x82c91 thru 0x8c444 (0x97b4 bytes) 2023-07-14T18:17:18.787 INFO:tasks.workunit.client.0.smithi163.stdout:8250( 58 mod 256): PUNCH 0x5837a thru 0x5d485 (0x510c bytes) 2023-07-14T18:17:18.787 INFO:tasks.workunit.client.0.smithi163.stdout:8251( 59 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.788 INFO:tasks.workunit.client.0.smithi163.stdout:8252( 60 mod 256): COPY 0x1e252 thru 0x265a2 (0x8351 bytes) to 0x42949 thru 0x4ac99 2023-07-14T18:17:18.788 INFO:tasks.workunit.client.0.smithi163.stdout:8253( 61 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.788 INFO:tasks.workunit.client.0.smithi163.stdout:8254( 62 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.788 INFO:tasks.workunit.client.0.smithi163.stdout:8255( 63 mod 256): FALLOC 0x71f19 thru 0x7495f (0x2a46 bytes) INTERIOR 2023-07-14T18:17:18.788 INFO:tasks.workunit.client.0.smithi163.stdout:8256( 64 mod 256): WRITE 0x574a1 thru 0x65352 (0xdeb2 bytes) 2023-07-14T18:17:18.788 INFO:tasks.workunit.client.0.smithi163.stdout:8257( 65 mod 256): MAPREAD 0xe6712 thru 0xe7ae6 (0x13d5 bytes) 2023-07-14T18:17:18.788 INFO:tasks.workunit.client.0.smithi163.stdout:8258( 66 mod 256): PUNCH 0x697ce thru 0x786a3 (0xeed6 bytes) 2023-07-14T18:17:18.788 INFO:tasks.workunit.client.0.smithi163.stdout:8259( 67 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.789 INFO:tasks.workunit.client.0.smithi163.stdout:8260( 68 mod 256): READ 0x7fbc9 thru 0x85cd5 (0x610d bytes) 2023-07-14T18:17:18.789 INFO:tasks.workunit.client.0.smithi163.stdout:8261( 69 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.789 INFO:tasks.workunit.client.0.smithi163.stdout:8262( 70 mod 256): PUNCH 0x741f0 thru 0x78863 (0x4674 bytes) 2023-07-14T18:17:18.789 INFO:tasks.workunit.client.0.smithi163.stdout:8263( 71 mod 256): FALLOC 0xbb78f thru 0xc5cbc (0xa52d bytes) INTERIOR 2023-07-14T18:17:18.789 INFO:tasks.workunit.client.0.smithi163.stdout:8264( 72 mod 256): TRUNCATE DOWN from 0xe7ae7 to 0x3768e ******WWWW 2023-07-14T18:17:18.789 INFO:tasks.workunit.client.0.smithi163.stdout:8265( 73 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.789 INFO:tasks.workunit.client.0.smithi163.stdout:8266( 74 mod 256): TRUNCATE UP from 0x3768e to 0x98ecd ******WWWW 2023-07-14T18:17:18.789 INFO:tasks.workunit.client.0.smithi163.stdout:8267( 75 mod 256): COPY 0x1a107 thru 0x225f2 (0x84ec bytes) to 0x5ac9c thru 0x63187 2023-07-14T18:17:18.790 INFO:tasks.workunit.client.0.smithi163.stdout:8268( 76 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.790 INFO:tasks.workunit.client.0.smithi163.stdout:8269( 77 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.790 INFO:tasks.workunit.client.0.smithi163.stdout:8270( 78 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.790 INFO:tasks.workunit.client.0.smithi163.stdout:8271( 79 mod 256): READ 0x2a7d0 thru 0x32b33 (0x8364 bytes) 2023-07-14T18:17:18.790 INFO:tasks.workunit.client.0.smithi163.stdout:8272( 80 mod 256): WRITE 0x6816 thru 0x6a30 (0x21b bytes) 2023-07-14T18:17:18.790 INFO:tasks.workunit.client.0.smithi163.stdout:8273( 81 mod 256): READ 0x501fa thru 0x5f2e2 (0xf0e9 bytes) 2023-07-14T18:17:18.790 INFO:tasks.workunit.client.0.smithi163.stdout:8274( 82 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.790 INFO:tasks.workunit.client.0.smithi163.stdout:8275( 83 mod 256): READ 0x39baa thru 0x48cc6 (0xf11d bytes) 2023-07-14T18:17:18.791 INFO:tasks.workunit.client.0.smithi163.stdout:8276( 84 mod 256): MAPREAD 0xe5d3 thru 0x1bfff (0xda2d bytes) 2023-07-14T18:17:18.791 INFO:tasks.workunit.client.0.smithi163.stdout:8277( 85 mod 256): MAPREAD 0x256c2 thru 0x28b75 (0x34b4 bytes) 2023-07-14T18:17:18.791 INFO:tasks.workunit.client.0.smithi163.stdout:8278( 86 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.791 INFO:tasks.workunit.client.0.smithi163.stdout:8279( 87 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.791 INFO:tasks.workunit.client.0.smithi163.stdout:8280( 88 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.791 INFO:tasks.workunit.client.0.smithi163.stdout:8281( 89 mod 256): PUNCH 0x11a9c thru 0x141c0 (0x2725 bytes) 2023-07-14T18:17:18.791 INFO:tasks.workunit.client.0.smithi163.stdout:8282( 90 mod 256): FALLOC 0xe73c2 thru 0xf0df5 (0x9a33 bytes) PAST_EOF 2023-07-14T18:17:18.791 INFO:tasks.workunit.client.0.smithi163.stdout:8283( 91 mod 256): MAPREAD 0x336e0 thru 0x3cbf8 (0x9519 bytes) ***RRRR*** 2023-07-14T18:17:18.792 INFO:tasks.workunit.client.0.smithi163.stdout:8284( 92 mod 256): FALLOC 0x4df4a thru 0x57247 (0x92fd bytes) INTERIOR 2023-07-14T18:17:18.792 INFO:tasks.workunit.client.0.smithi163.stdout:8285( 93 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.792 INFO:tasks.workunit.client.0.smithi163.stdout:8286( 94 mod 256): TRUNCATE DOWN from 0x98ecd to 0x909d0 2023-07-14T18:17:18.792 INFO:tasks.workunit.client.0.smithi163.stdout:8287( 95 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.792 INFO:tasks.workunit.client.0.smithi163.stdout:8288( 96 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.792 INFO:tasks.workunit.client.0.smithi163.stdout:8289( 97 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.792 INFO:tasks.workunit.client.0.smithi163.stdout:8290( 98 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.792 INFO:tasks.workunit.client.0.smithi163.stdout:8291( 99 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.793 INFO:tasks.workunit.client.0.smithi163.stdout:8292(100 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.793 INFO:tasks.workunit.client.0.smithi163.stdout:8293(101 mod 256): PUNCH 0x6acf6 thru 0x6c910 (0x1c1b bytes) 2023-07-14T18:17:18.793 INFO:tasks.workunit.client.0.smithi163.stdout:8294(102 mod 256): READ 0x6850a thru 0x6ce18 (0x490f bytes) 2023-07-14T18:17:18.793 INFO:tasks.workunit.client.0.smithi163.stdout:8295(103 mod 256): TRUNCATE UP from 0x909d0 to 0xae245 2023-07-14T18:17:18.793 INFO:tasks.workunit.client.0.smithi163.stdout:8296(104 mod 256): READ 0x92085 thru 0x99cf6 (0x7c72 bytes) 2023-07-14T18:17:18.793 INFO:tasks.workunit.client.0.smithi163.stdout:8297(105 mod 256): FALLOC 0xedc32 thru 0xf7695 (0x9a63 bytes) PAST_EOF 2023-07-14T18:17:18.793 INFO:tasks.workunit.client.0.smithi163.stdout:8298(106 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.793 INFO:tasks.workunit.client.0.smithi163.stdout:8299(107 mod 256): WRITE 0x3ec6 thru 0x8ce7 (0x4e22 bytes) 2023-07-14T18:17:18.794 INFO:tasks.workunit.client.0.smithi163.stdout:8300(108 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.794 INFO:tasks.workunit.client.0.smithi163.stdout:8301(109 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.794 INFO:tasks.workunit.client.0.smithi163.stdout:8302(110 mod 256): FALLOC 0x1344 thru 0x7e6d (0x6b29 bytes) INTERIOR 2023-07-14T18:17:18.794 INFO:tasks.workunit.client.0.smithi163.stdout:8303(111 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.794 INFO:tasks.workunit.client.0.smithi163.stdout:8304(112 mod 256): MAPREAD 0x780e0 thru 0x7b59b (0x34bc bytes) 2023-07-14T18:17:18.794 INFO:tasks.workunit.client.0.smithi163.stdout:8305(113 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.794 INFO:tasks.workunit.client.0.smithi163.stdout:8306(114 mod 256): WRITE 0x7f575 thru 0x86c5b (0x76e7 bytes) 2023-07-14T18:17:18.794 INFO:tasks.workunit.client.0.smithi163.stdout:8307(115 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.795 INFO:tasks.workunit.client.0.smithi163.stdout:8308(116 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.795 INFO:tasks.workunit.client.0.smithi163.stdout:8309(117 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.795 INFO:tasks.workunit.client.0.smithi163.stdout:8310(118 mod 256): MAPREAD 0x3b4de thru 0x4814a (0xcc6d bytes) 2023-07-14T18:17:18.795 INFO:tasks.workunit.client.0.smithi163.stdout:8311(119 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.795 INFO:tasks.workunit.client.0.smithi163.stdout:8312(120 mod 256): TRUNCATE DOWN from 0xae245 to 0x406fd 2023-07-14T18:17:18.795 INFO:tasks.workunit.client.0.smithi163.stdout:8313(121 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.795 INFO:tasks.workunit.client.0.smithi163.stdout:8314(122 mod 256): PUNCH 0x127d8 thru 0x212e7 (0xeb10 bytes) 2023-07-14T18:17:18.795 INFO:tasks.workunit.client.0.smithi163.stdout:8315(123 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.796 INFO:tasks.workunit.client.0.smithi163.stdout:8316(124 mod 256): MAPWRITE 0x43fc thru 0x1256b (0xe170 bytes) 2023-07-14T18:17:18.796 INFO:tasks.workunit.client.0.smithi163.stdout:8317(125 mod 256): MAPWRITE 0x5951f thru 0x62ecc (0x99ae bytes) 2023-07-14T18:17:18.796 INFO:tasks.workunit.client.0.smithi163.stdout:8318(126 mod 256): TRUNCATE UP from 0x62ecd to 0xfc930 2023-07-14T18:17:18.796 INFO:tasks.workunit.client.0.smithi163.stdout:8319(127 mod 256): FALLOC 0xa00c3 thru 0xada03 (0xd940 bytes) INTERIOR 2023-07-14T18:17:18.796 INFO:tasks.workunit.client.0.smithi163.stdout:8320(128 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.796 INFO:tasks.workunit.client.0.smithi163.stdout:8321(129 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.796 INFO:tasks.workunit.client.0.smithi163.stdout:8322(130 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.796 INFO:tasks.workunit.client.0.smithi163.stdout:8323(131 mod 256): FALLOC 0x8a067 thru 0x8b78a (0x1723 bytes) INTERIOR 2023-07-14T18:17:18.797 INFO:tasks.workunit.client.0.smithi163.stdout:8324(132 mod 256): READ 0x26a47 thru 0x35ae8 (0xf0a2 bytes) 2023-07-14T18:17:18.797 INFO:tasks.workunit.client.0.smithi163.stdout:8325(133 mod 256): READ 0x97acf thru 0xa7529 (0xfa5b bytes) 2023-07-14T18:17:18.797 INFO:tasks.workunit.client.0.smithi163.stdout:8326(134 mod 256): MAPWRITE 0x12b9c thru 0x160ac (0x3511 bytes) 2023-07-14T18:17:18.797 INFO:tasks.workunit.client.0.smithi163.stdout:8327(135 mod 256): PUNCH 0xa6b87 thru 0xaeebc (0x8336 bytes) 2023-07-14T18:17:18.797 INFO:tasks.workunit.client.0.smithi163.stdout:8328(136 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.797 INFO:tasks.workunit.client.0.smithi163.stdout:8329(137 mod 256): MAPREAD 0x52408 thru 0x55f90 (0x3b89 bytes) 2023-07-14T18:17:18.797 INFO:tasks.workunit.client.0.smithi163.stdout:8330(138 mod 256): PUNCH 0xdd227 thru 0xebf7a (0xed54 bytes) 2023-07-14T18:17:18.797 INFO:tasks.workunit.client.0.smithi163.stdout:8331(139 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.798 INFO:tasks.workunit.client.0.smithi163.stdout:8332(140 mod 256): FALLOC 0x9c0b thru 0x9e98 (0x28d bytes) INTERIOR 2023-07-14T18:17:18.798 INFO:tasks.workunit.client.0.smithi163.stdout:8333(141 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.798 INFO:tasks.workunit.client.0.smithi163.stdout:8334(142 mod 256): COPY 0xc8382 thru 0xd746a (0xf0e9 bytes) to 0xde914 thru 0xed9fc 2023-07-14T18:17:18.798 INFO:tasks.workunit.client.0.smithi163.stdout:8335(143 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.798 INFO:tasks.workunit.client.0.smithi163.stdout:8336(144 mod 256): READ 0x1c6a5 thru 0x203cd (0x3d29 bytes) 2023-07-14T18:17:18.798 INFO:tasks.workunit.client.0.smithi163.stdout:8337(145 mod 256): WRITE 0xe0884 thru 0xe34f4 (0x2c71 bytes) 2023-07-14T18:17:18.798 INFO:tasks.workunit.client.0.smithi163.stdout:8338(146 mod 256): PUNCH 0x827a6 thru 0x852e4 (0x2b3f bytes) 2023-07-14T18:17:18.798 INFO:tasks.workunit.client.0.smithi163.stdout:8339(147 mod 256): COPY 0xc231c thru 0xca4d4 (0x81b9 bytes) to 0x97cda thru 0x9fe92 2023-07-14T18:17:18.799 INFO:tasks.workunit.client.0.smithi163.stdout:8340(148 mod 256): MAPWRITE 0x79513 thru 0x83103 (0x9bf1 bytes) 2023-07-14T18:17:18.799 INFO:tasks.workunit.client.0.smithi163.stdout:8341(149 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.799 INFO:tasks.workunit.client.0.smithi163.stdout:8342(150 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.799 INFO:tasks.workunit.client.0.smithi163.stdout:8343(151 mod 256): FALLOC 0x6c8f6 thru 0x7bee3 (0xf5ed bytes) INTERIOR 2023-07-14T18:17:18.799 INFO:tasks.workunit.client.0.smithi163.stdout:8344(152 mod 256): WRITE 0xc9cd0 thru 0xd78fb (0xdc2c bytes) 2023-07-14T18:17:18.799 INFO:tasks.workunit.client.0.smithi163.stdout:8345(153 mod 256): READ 0xab8c0 thru 0xac5df (0xd20 bytes) 2023-07-14T18:17:18.799 INFO:tasks.workunit.client.0.smithi163.stdout:8346(154 mod 256): READ 0x4054e thru 0x4fee5 (0xf998 bytes) 2023-07-14T18:17:18.799 INFO:tasks.workunit.client.0.smithi163.stdout:8347(155 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.800 INFO:tasks.workunit.client.0.smithi163.stdout:8348(156 mod 256): WRITE 0xf3096 thru 0xfffff (0xcf6a bytes) EXTEND 2023-07-14T18:17:18.800 INFO:tasks.workunit.client.0.smithi163.stdout:8349(157 mod 256): FALLOC 0xe6d5b thru 0xe972c (0x29d1 bytes) INTERIOR 2023-07-14T18:17:18.800 INFO:tasks.workunit.client.0.smithi163.stdout:8350(158 mod 256): PUNCH 0x386d3 thru 0x4140f (0x8d3d bytes) 2023-07-14T18:17:18.800 INFO:tasks.workunit.client.0.smithi163.stdout:8351(159 mod 256): MAPREAD 0x3e083 thru 0x4353e (0x54bc bytes) 2023-07-14T18:17:18.800 INFO:tasks.workunit.client.0.smithi163.stdout:8352(160 mod 256): MAPREAD 0x193ff thru 0x271f5 (0xddf7 bytes) 2023-07-14T18:17:18.800 INFO:tasks.workunit.client.0.smithi163.stdout:8353(161 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.800 INFO:tasks.workunit.client.0.smithi163.stdout:8354(162 mod 256): TRUNCATE DOWN from 0x100000 to 0x6ff3f 2023-07-14T18:17:18.800 INFO:tasks.workunit.client.0.smithi163.stdout:8355(163 mod 256): PUNCH 0x4021e thru 0x47843 (0x7626 bytes) 2023-07-14T18:17:18.801 INFO:tasks.workunit.client.0.smithi163.stdout:8356(164 mod 256): WRITE 0xc535c thru 0xd52d3 (0xff78 bytes) HOLE 2023-07-14T18:17:18.801 INFO:tasks.workunit.client.0.smithi163.stdout:8357(165 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.801 INFO:tasks.workunit.client.0.smithi163.stdout:8358(166 mod 256): READ 0x54173 thru 0x5b9fe (0x788c bytes) 2023-07-14T18:17:18.801 INFO:tasks.workunit.client.0.smithi163.stdout:8359(167 mod 256): TRUNCATE UP from 0xd52d4 to 0xf142a 2023-07-14T18:17:18.801 INFO:tasks.workunit.client.0.smithi163.stdout:8360(168 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.801 INFO:tasks.workunit.client.0.smithi163.stdout:8361(169 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.801 INFO:tasks.workunit.client.0.smithi163.stdout:8362(170 mod 256): READ 0x42a92 thru 0x450c7 (0x2636 bytes) 2023-07-14T18:17:18.801 INFO:tasks.workunit.client.0.smithi163.stdout:8363(171 mod 256): WRITE 0xb021c thru 0xb9583 (0x9368 bytes) 2023-07-14T18:17:18.802 INFO:tasks.workunit.client.0.smithi163.stdout:8364(172 mod 256): FALLOC 0x869b8 thru 0x93150 (0xc798 bytes) INTERIOR 2023-07-14T18:17:18.802 INFO:tasks.workunit.client.0.smithi163.stdout:8365(173 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.802 INFO:tasks.workunit.client.0.smithi163.stdout:8366(174 mod 256): PUNCH 0xf0984 thru 0xf1429 (0xaa6 bytes) 2023-07-14T18:17:18.802 INFO:tasks.workunit.client.0.smithi163.stdout:8367(175 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.802 INFO:tasks.workunit.client.0.smithi163.stdout:8368(176 mod 256): FALLOC 0xe041d thru 0xe3c72 (0x3855 bytes) INTERIOR 2023-07-14T18:17:18.802 INFO:tasks.workunit.client.0.smithi163.stdout:8369(177 mod 256): PUNCH 0x96de7 thru 0xa4689 (0xd8a3 bytes) 2023-07-14T18:17:18.802 INFO:tasks.workunit.client.0.smithi163.stdout:8370(178 mod 256): MAPREAD 0xbbae0 thru 0xc3625 (0x7b46 bytes) 2023-07-14T18:17:18.802 INFO:tasks.workunit.client.0.smithi163.stdout:8371(179 mod 256): TRUNCATE DOWN from 0xf142a to 0x77908 2023-07-14T18:17:18.803 INFO:tasks.workunit.client.0.smithi163.stdout:8372(180 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.803 INFO:tasks.workunit.client.0.smithi163.stdout:8373(181 mod 256): WRITE 0x381d5 thru 0x414e9 (0x9315 bytes) ***WWWW 2023-07-14T18:17:18.803 INFO:tasks.workunit.client.0.smithi163.stdout:8374(182 mod 256): FALLOC 0xe7108 thru 0xf6f6f (0xfe67 bytes) PAST_EOF 2023-07-14T18:17:18.803 INFO:tasks.workunit.client.0.smithi163.stdout:8375(183 mod 256): WRITE 0x2a3a7 thru 0x34065 (0x9cbf bytes) 2023-07-14T18:17:18.803 INFO:tasks.workunit.client.0.smithi163.stdout:8376(184 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.803 INFO:tasks.workunit.client.0.smithi163.stdout:8377(185 mod 256): MAPREAD 0x31e3d thru 0x3e86c (0xca30 bytes) ***RRRR*** 2023-07-14T18:17:18.803 INFO:tasks.workunit.client.0.smithi163.stdout:8378(186 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.803 INFO:tasks.workunit.client.0.smithi163.stdout:8379(187 mod 256): TRUNCATE DOWN from 0x77908 to 0xf36e ******WWWW 2023-07-14T18:17:18.804 INFO:tasks.workunit.client.0.smithi163.stdout:8380(188 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.804 INFO:tasks.workunit.client.0.smithi163.stdout:8381(189 mod 256): COPY 0x64c0 thru 0xf36d (0x8eae bytes) to 0x12de8 thru 0x1bc95 2023-07-14T18:17:18.804 INFO:tasks.workunit.client.0.smithi163.stdout:8382(190 mod 256): MAPREAD 0x19f1a thru 0x1bc95 (0x1d7c bytes) 2023-07-14T18:17:18.804 INFO:tasks.workunit.client.0.smithi163.stdout:8383(191 mod 256): MAPWRITE 0x5da7c thru 0x682a3 (0xa828 bytes) 2023-07-14T18:17:18.804 INFO:tasks.workunit.client.0.smithi163.stdout:8384(192 mod 256): MAPREAD 0x3da93 thru 0x3e3a9 (0x917 bytes) 2023-07-14T18:17:18.804 INFO:tasks.workunit.client.0.smithi163.stdout:8385(193 mod 256): WRITE 0x21527 thru 0x27cdb (0x67b5 bytes) 2023-07-14T18:17:18.804 INFO:tasks.workunit.client.0.smithi163.stdout:8386(194 mod 256): MAPWRITE 0x65b7d thru 0x738ba (0xdd3e bytes) 2023-07-14T18:17:18.804 INFO:tasks.workunit.client.0.smithi163.stdout:8387(195 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.805 INFO:tasks.workunit.client.0.smithi163.stdout:8388(196 mod 256): WRITE 0xd9ce0 thru 0xe25a6 (0x88c7 bytes) HOLE 2023-07-14T18:17:18.805 INFO:tasks.workunit.client.0.smithi163.stdout:8389(197 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.805 INFO:tasks.workunit.client.0.smithi163.stdout:8390(198 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.805 INFO:tasks.workunit.client.0.smithi163.stdout:8391(199 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.805 INFO:tasks.workunit.client.0.smithi163.stdout:8392(200 mod 256): PUNCH 0xa32fa thru 0xa9577 (0x627e bytes) 2023-07-14T18:17:18.805 INFO:tasks.workunit.client.0.smithi163.stdout:8393(201 mod 256): TRUNCATE DOWN from 0xe25a7 to 0x318a9 ******WWWW 2023-07-14T18:17:18.805 INFO:tasks.workunit.client.0.smithi163.stdout:8394(202 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.805 INFO:tasks.workunit.client.0.smithi163.stdout:8395(203 mod 256): MAPREAD 0xe7c2 thru 0x17ac3 (0x9302 bytes) 2023-07-14T18:17:18.806 INFO:tasks.workunit.client.0.smithi163.stdout:8396(204 mod 256): WRITE 0x7c45 thru 0xf7d0 (0x7b8c bytes) 2023-07-14T18:17:18.806 INFO:tasks.workunit.client.0.smithi163.stdout:8397(205 mod 256): WRITE 0x1d134 thru 0x20e6b (0x3d38 bytes) 2023-07-14T18:17:18.806 INFO:tasks.workunit.client.0.smithi163.stdout:8398(206 mod 256): FALLOC 0x722e5 thru 0x77c20 (0x593b bytes) EXTENDING 2023-07-14T18:17:18.806 INFO:tasks.workunit.client.0.smithi163.stdout:8399(207 mod 256): PUNCH 0x5db11 thru 0x6d76c (0xfc5c bytes) 2023-07-14T18:17:18.806 INFO:tasks.workunit.client.0.smithi163.stdout:8400(208 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.806 INFO:tasks.workunit.client.0.smithi163.stdout:8401(209 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.806 INFO:tasks.workunit.client.0.smithi163.stdout:8402(210 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.806 INFO:tasks.workunit.client.0.smithi163.stdout:8403(211 mod 256): MAPWRITE 0x87832 thru 0x87b0f (0x2de bytes) 2023-07-14T18:17:18.807 INFO:tasks.workunit.client.0.smithi163.stdout:8404(212 mod 256): TRUNCATE DOWN from 0x87b10 to 0x508c9 2023-07-14T18:17:18.807 INFO:tasks.workunit.client.0.smithi163.stdout:8405(213 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.807 INFO:tasks.workunit.client.0.smithi163.stdout:8406(214 mod 256): COPY 0x1b6a1 thru 0x29318 (0xdc78 bytes) to 0xc429e thru 0xd1f15 2023-07-14T18:17:18.807 INFO:tasks.workunit.client.0.smithi163.stdout:8407(215 mod 256): PUNCH 0x20050 thru 0x20348 (0x2f9 bytes) 2023-07-14T18:17:18.807 INFO:tasks.workunit.client.0.smithi163.stdout:8408(216 mod 256): PUNCH 0x77666 thru 0x7fcf2 (0x868d bytes) 2023-07-14T18:17:18.807 INFO:tasks.workunit.client.0.smithi163.stdout:8409(217 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.807 INFO:tasks.workunit.client.0.smithi163.stdout:8410(218 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.807 INFO:tasks.workunit.client.0.smithi163.stdout:8411(219 mod 256): READ 0xb05cc thru 0xb51e6 (0x4c1b bytes) 2023-07-14T18:17:18.808 INFO:tasks.workunit.client.0.smithi163.stdout:8412(220 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.808 INFO:tasks.workunit.client.0.smithi163.stdout:8413(221 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.808 INFO:tasks.workunit.client.0.smithi163.stdout:8414(222 mod 256): COPY 0x55a8c thru 0x5c8d1 (0x6e46 bytes) to 0xc33c6 thru 0xca20b 2023-07-14T18:17:18.808 INFO:tasks.workunit.client.0.smithi163.stdout:8415(223 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.808 INFO:tasks.workunit.client.0.smithi163.stdout:8416(224 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.808 INFO:tasks.workunit.client.0.smithi163.stdout:8417(225 mod 256): WRITE 0x942ca thru 0xa04b6 (0xc1ed bytes) 2023-07-14T18:17:18.808 INFO:tasks.workunit.client.0.smithi163.stdout:8418(226 mod 256): MAPREAD 0x352a1 thru 0x3c2a8 (0x7008 bytes) ***RRRR*** 2023-07-14T18:17:18.808 INFO:tasks.workunit.client.0.smithi163.stdout:8419(227 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.809 INFO:tasks.workunit.client.0.smithi163.stdout:8420(228 mod 256): COPY 0x95eed thru 0x9fa9d (0x9bb1 bytes) to 0xf571 thru 0x19121 2023-07-14T18:17:18.809 INFO:tasks.workunit.client.0.smithi163.stdout:8421(229 mod 256): MAPWRITE 0xe2c12 thru 0xec23a (0x9629 bytes) 2023-07-14T18:17:18.809 INFO:tasks.workunit.client.0.smithi163.stdout:8422(230 mod 256): TRUNCATE DOWN from 0xec23b to 0xa407 ******WWWW 2023-07-14T18:17:18.809 INFO:tasks.workunit.client.0.smithi163.stdout:8423(231 mod 256): FALLOC 0xd3e0f thru 0xe16a4 (0xd895 bytes) EXTENDING 2023-07-14T18:17:18.809 INFO:tasks.workunit.client.0.smithi163.stdout:8424(232 mod 256): READ 0x6a8e7 thru 0x77400 (0xcb1a bytes) 2023-07-14T18:17:18.809 INFO:tasks.workunit.client.0.smithi163.stdout:8425(233 mod 256): TRUNCATE DOWN from 0xe16a4 to 0x9a434 2023-07-14T18:17:18.809 INFO:tasks.workunit.client.0.smithi163.stdout:8426(234 mod 256): MAPREAD 0x492d3 thru 0x506ac (0x73da bytes) 2023-07-14T18:17:18.810 INFO:tasks.workunit.client.0.smithi163.stdout:8427(235 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.810 INFO:tasks.workunit.client.0.smithi163.stdout:8428(236 mod 256): WRITE 0xf11bc thru 0xf41d2 (0x3017 bytes) HOLE 2023-07-14T18:17:18.810 INFO:tasks.workunit.client.0.smithi163.stdout:8429(237 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.810 INFO:tasks.workunit.client.0.smithi163.stdout:8430(238 mod 256): MAPREAD 0xabde8 thru 0xb2c9e (0x6eb7 bytes) 2023-07-14T18:17:18.810 INFO:tasks.workunit.client.0.smithi163.stdout:8431(239 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.810 INFO:tasks.workunit.client.0.smithi163.stdout:8432(240 mod 256): COPY 0x89e42 thru 0x8e223 (0x43e2 bytes) to 0x2b599 thru 0x2f97a 2023-07-14T18:17:18.810 INFO:tasks.workunit.client.0.smithi163.stdout:8433(241 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.810 INFO:tasks.workunit.client.0.smithi163.stdout:8434(242 mod 256): WRITE 0x1e68e thru 0x2d5d5 (0xef48 bytes) 2023-07-14T18:17:18.811 INFO:tasks.workunit.client.0.smithi163.stdout:8435(243 mod 256): TRUNCATE DOWN from 0xf41d3 to 0x3b82a 2023-07-14T18:17:18.811 INFO:tasks.workunit.client.0.smithi163.stdout:8436(244 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.811 INFO:tasks.workunit.client.0.smithi163.stdout:8437(245 mod 256): MAPWRITE 0x90d44 thru 0xa0395 (0xf652 bytes) 2023-07-14T18:17:18.811 INFO:tasks.workunit.client.0.smithi163.stdout:8438(246 mod 256): PUNCH 0x4fe1f thru 0x55726 (0x5908 bytes) 2023-07-14T18:17:18.811 INFO:tasks.workunit.client.0.smithi163.stdout:8439(247 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.811 INFO:tasks.workunit.client.0.smithi163.stdout:8440(248 mod 256): MAPREAD 0x87c25 thru 0x8e164 (0x6540 bytes) 2023-07-14T18:17:18.811 INFO:tasks.workunit.client.0.smithi163.stdout:8441(249 mod 256): TRUNCATE DOWN from 0xa0396 to 0x98643 2023-07-14T18:17:18.811 INFO:tasks.workunit.client.0.smithi163.stdout:8442(250 mod 256): WRITE 0x35ed5 thru 0x459eb (0xfb17 bytes) ***WWWW 2023-07-14T18:17:18.812 INFO:tasks.workunit.client.0.smithi163.stdout:8443(251 mod 256): TRUNCATE DOWN from 0x98643 to 0x5e070 2023-07-14T18:17:18.812 INFO:tasks.workunit.client.0.smithi163.stdout:8444(252 mod 256): MAPREAD 0x10d4d thru 0x19a49 (0x8cfd bytes) 2023-07-14T18:17:18.812 INFO:tasks.workunit.client.0.smithi163.stdout:8445(253 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.812 INFO:tasks.workunit.client.0.smithi163.stdout:8446(254 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.812 INFO:tasks.workunit.client.0.smithi163.stdout:8447(255 mod 256): FALLOC 0x418ac thru 0x41999 (0xed bytes) INTERIOR 2023-07-14T18:17:18.812 INFO:tasks.workunit.client.0.smithi163.stdout:8448( 0 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.812 INFO:tasks.workunit.client.0.smithi163.stdout:8449( 1 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.812 INFO:tasks.workunit.client.0.smithi163.stdout:8450( 2 mod 256): READ 0x47e6 thru 0x8398 (0x3bb3 bytes) 2023-07-14T18:17:18.813 INFO:tasks.workunit.client.0.smithi163.stdout:8451( 3 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.813 INFO:tasks.workunit.client.0.smithi163.stdout:8452( 4 mod 256): MAPREAD 0x23668 thru 0x27a4c (0x43e5 bytes) 2023-07-14T18:17:18.813 INFO:tasks.workunit.client.0.smithi163.stdout:8453( 5 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.813 INFO:tasks.workunit.client.0.smithi163.stdout:8454( 6 mod 256): FALLOC 0xd9a63 thru 0xda56d (0xb0a bytes) PAST_EOF 2023-07-14T18:17:18.813 INFO:tasks.workunit.client.0.smithi163.stdout:8455( 7 mod 256): WRITE 0x4ab2f thru 0x4e50e (0x39e0 bytes) 2023-07-14T18:17:18.813 INFO:tasks.workunit.client.0.smithi163.stdout:8456( 8 mod 256): TRUNCATE DOWN from 0x5e070 to 0x4aa3c 2023-07-14T18:17:18.813 INFO:tasks.workunit.client.0.smithi163.stdout:8457( 9 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.813 INFO:tasks.workunit.client.0.smithi163.stdout:8458( 10 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.814 INFO:tasks.workunit.client.0.smithi163.stdout:8459( 11 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.814 INFO:tasks.workunit.client.0.smithi163.stdout:8460( 12 mod 256): PUNCH 0x31fd6 thru 0x39f20 (0x7f4b bytes) ******PPPP 2023-07-14T18:17:18.814 INFO:tasks.workunit.client.0.smithi163.stdout:8461( 13 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.814 INFO:tasks.workunit.client.0.smithi163.stdout:8462( 14 mod 256): PUNCH 0x45425 thru 0x468e9 (0x14c5 bytes) 2023-07-14T18:17:18.814 INFO:tasks.workunit.client.0.smithi163.stdout:8463( 15 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.814 INFO:tasks.workunit.client.0.smithi163.stdout:8464( 16 mod 256): MAPREAD 0x981b thru 0xc636 (0x2e1c bytes) 2023-07-14T18:17:18.814 INFO:tasks.workunit.client.0.smithi163.stdout:8465( 17 mod 256): WRITE 0x3c404 thru 0x40c45 (0x4842 bytes) 2023-07-14T18:17:18.814 INFO:tasks.workunit.client.0.smithi163.stdout:8466( 18 mod 256): COPY 0x15c6b thru 0x1ca89 (0x6e1f bytes) to 0x29bfa thru 0x30a18 2023-07-14T18:17:18.815 INFO:tasks.workunit.client.0.smithi163.stdout:8467( 19 mod 256): TRUNCATE UP from 0x4aa3c to 0xfffc5 2023-07-14T18:17:18.815 INFO:tasks.workunit.client.0.smithi163.stdout:8468( 20 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.815 INFO:tasks.workunit.client.0.smithi163.stdout:8469( 21 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.815 INFO:tasks.workunit.client.0.smithi163.stdout:8470( 22 mod 256): COPY 0x636dd thru 0x7099a (0xd2be bytes) to 0xc7e40 thru 0xd50fd 2023-07-14T18:17:18.815 INFO:tasks.workunit.client.0.smithi163.stdout:8471( 23 mod 256): MAPWRITE 0xbaf03 thru 0xc7bae (0xccac bytes) 2023-07-14T18:17:18.815 INFO:tasks.workunit.client.0.smithi163.stdout:8472( 24 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.815 INFO:tasks.workunit.client.0.smithi163.stdout:8473( 25 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.815 INFO:tasks.workunit.client.0.smithi163.stdout:8474( 26 mod 256): READ 0x95719 thru 0x9a21f (0x4b07 bytes) 2023-07-14T18:17:18.816 INFO:tasks.workunit.client.0.smithi163.stdout:8475( 27 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.816 INFO:tasks.workunit.client.0.smithi163.stdout:8476( 28 mod 256): FALLOC 0x9981a thru 0xa1faf (0x8795 bytes) INTERIOR 2023-07-14T18:17:18.816 INFO:tasks.workunit.client.0.smithi163.stdout:8477( 29 mod 256): FALLOC 0x70500 thru 0x72d30 (0x2830 bytes) INTERIOR 2023-07-14T18:17:18.816 INFO:tasks.workunit.client.0.smithi163.stdout:8478( 30 mod 256): PUNCH 0xdef thru 0xf20 (0x132 bytes) 2023-07-14T18:17:18.816 INFO:tasks.workunit.client.0.smithi163.stdout:8479( 31 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.816 INFO:tasks.workunit.client.0.smithi163.stdout:8480( 32 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.816 INFO:tasks.workunit.client.0.smithi163.stdout:8481( 33 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.816 INFO:tasks.workunit.client.0.smithi163.stdout:8482( 34 mod 256): FALLOC 0x97643 thru 0x9d490 (0x5e4d bytes) INTERIOR 2023-07-14T18:17:18.817 INFO:tasks.workunit.client.0.smithi163.stdout:8483( 35 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.817 INFO:tasks.workunit.client.0.smithi163.stdout:8484( 36 mod 256): MAPREAD 0x6f3f2 thru 0x7d4b3 (0xe0c2 bytes) 2023-07-14T18:17:18.817 INFO:tasks.workunit.client.0.smithi163.stdout:8485( 37 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.817 INFO:tasks.workunit.client.0.smithi163.stdout:8486( 38 mod 256): READ 0x77bd8 thru 0x7e9b9 (0x6de2 bytes) 2023-07-14T18:17:18.817 INFO:tasks.workunit.client.0.smithi163.stdout:8487( 39 mod 256): MAPREAD 0x3e580 thru 0x4c0c1 (0xdb42 bytes) 2023-07-14T18:17:18.817 INFO:tasks.workunit.client.0.smithi163.stdout:8488( 40 mod 256): FALLOC 0xbaa9a thru 0xbc95b (0x1ec1 bytes) INTERIOR 2023-07-14T18:17:18.817 INFO:tasks.workunit.client.0.smithi163.stdout:8489( 41 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.817 INFO:tasks.workunit.client.0.smithi163.stdout:8490( 42 mod 256): COPY 0x11997 thru 0x147ef (0x2e59 bytes) to 0x1e488 thru 0x212e0 2023-07-14T18:17:18.818 INFO:tasks.workunit.client.0.smithi163.stdout:8491( 43 mod 256): MAPWRITE 0x4a5a2 thru 0x5539a (0xadf9 bytes) 2023-07-14T18:17:18.818 INFO:tasks.workunit.client.0.smithi163.stdout:8492( 44 mod 256): COPY 0x7257a thru 0x81458 (0xeedf bytes) to 0x9085b thru 0x9f739 2023-07-14T18:17:18.818 INFO:tasks.workunit.client.0.smithi163.stdout:8493( 45 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.818 INFO:tasks.workunit.client.0.smithi163.stdout:8494( 46 mod 256): TRUNCATE DOWN from 0xfffc5 to 0xe1cda 2023-07-14T18:17:18.818 INFO:tasks.workunit.client.0.smithi163.stdout:8495( 47 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.818 INFO:tasks.workunit.client.0.smithi163.stdout:8496( 48 mod 256): FALLOC 0xf62 thru 0xb0c4 (0xa162 bytes) INTERIOR 2023-07-14T18:17:18.818 INFO:tasks.workunit.client.0.smithi163.stdout:8497( 49 mod 256): COPY 0x26a8 thru 0x45e2 (0x1f3b bytes) to 0x18d04 thru 0x1ac3e 2023-07-14T18:17:18.818 INFO:tasks.workunit.client.0.smithi163.stdout:8498( 50 mod 256): WRITE 0x37bb4 thru 0x46cb0 (0xf0fd bytes) ***WWWW 2023-07-14T18:17:18.819 INFO:tasks.workunit.client.0.smithi163.stdout:8499( 51 mod 256): TRUNCATE DOWN from 0xe1cda to 0x42800 2023-07-14T18:17:18.819 INFO:tasks.workunit.client.0.smithi163.stdout:8500( 52 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.819 INFO:tasks.workunit.client.0.smithi163.stdout:8501( 53 mod 256): FALLOC 0x516ff thru 0x5c3d7 (0xacd8 bytes) PAST_EOF 2023-07-14T18:17:18.819 INFO:tasks.workunit.client.0.smithi163.stdout:8502( 54 mod 256): PUNCH 0x1ebb1 thru 0x2081c (0x1c6c bytes) 2023-07-14T18:17:18.819 INFO:tasks.workunit.client.0.smithi163.stdout:8503( 55 mod 256): COPY 0xfd04 thru 0x1db7a (0xde77 bytes) to 0xedf61 thru 0xfbdd7 2023-07-14T18:17:18.819 INFO:tasks.workunit.client.0.smithi163.stdout:8504( 56 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.819 INFO:tasks.workunit.client.0.smithi163.stdout:8505( 57 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.819 INFO:tasks.workunit.client.0.smithi163.stdout:8506( 58 mod 256): MAPREAD 0x7d61f thru 0x7f03f (0x1a21 bytes) 2023-07-14T18:17:18.820 INFO:tasks.workunit.client.0.smithi163.stdout:8507( 59 mod 256): READ 0xd10c9 thru 0xd42e1 (0x3219 bytes) 2023-07-14T18:17:18.820 INFO:tasks.workunit.client.0.smithi163.stdout:8508( 60 mod 256): PUNCH 0x6028c thru 0x683da (0x814f bytes) 2023-07-14T18:17:18.820 INFO:tasks.workunit.client.0.smithi163.stdout:8509( 61 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.820 INFO:tasks.workunit.client.0.smithi163.stdout:8510( 62 mod 256): WRITE 0x20f98 thru 0x2c641 (0xb6aa bytes) 2023-07-14T18:17:18.820 INFO:tasks.workunit.client.0.smithi163.stdout:8511( 63 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.820 INFO:tasks.workunit.client.0.smithi163.stdout:8512( 64 mod 256): WRITE 0x52ab2 thru 0x555a7 (0x2af6 bytes) 2023-07-14T18:17:18.820 INFO:tasks.workunit.client.0.smithi163.stdout:8513( 65 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.820 INFO:tasks.workunit.client.0.smithi163.stdout:8514( 66 mod 256): TRUNCATE DOWN from 0xfbdd8 to 0x28d27 ******WWWW 2023-07-14T18:17:18.821 INFO:tasks.workunit.client.0.smithi163.stdout:8515( 67 mod 256): PUNCH 0x9154 thru 0x1169e (0x854b bytes) 2023-07-14T18:17:18.821 INFO:tasks.workunit.client.0.smithi163.stdout:8516( 68 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.821 INFO:tasks.workunit.client.0.smithi163.stdout:8517( 69 mod 256): COPY 0x1a79f thru 0x2856c (0xddce bytes) to 0xc1f3e thru 0xcfd0b 2023-07-14T18:17:18.821 INFO:tasks.workunit.client.0.smithi163.stdout:8518( 70 mod 256): PUNCH 0xa9e86 thru 0xb0be8 (0x6d63 bytes) 2023-07-14T18:17:18.821 INFO:tasks.workunit.client.0.smithi163.stdout:8519( 71 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.821 INFO:tasks.workunit.client.0.smithi163.stdout:8520( 72 mod 256): PUNCH 0x6c2cb thru 0x710ba (0x4df0 bytes) 2023-07-14T18:17:18.821 INFO:tasks.workunit.client.0.smithi163.stdout:8521( 73 mod 256): TRUNCATE UP from 0xcfd0c to 0xede05 2023-07-14T18:17:18.821 INFO:tasks.workunit.client.0.smithi163.stdout:8522( 74 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.822 INFO:tasks.workunit.client.0.smithi163.stdout:8523( 75 mod 256): MAPWRITE 0x860b1 thru 0x96026 (0xff76 bytes) 2023-07-14T18:17:18.822 INFO:tasks.workunit.client.0.smithi163.stdout:8524( 76 mod 256): TRUNCATE DOWN from 0xede05 to 0xb1498 2023-07-14T18:17:18.822 INFO:tasks.workunit.client.0.smithi163.stdout:8525( 77 mod 256): READ 0xac572 thru 0xb1497 (0x4f26 bytes) 2023-07-14T18:17:18.822 INFO:tasks.workunit.client.0.smithi163.stdout:8526( 78 mod 256): MAPREAD 0x5a3f5 thru 0x68878 (0xe484 bytes) 2023-07-14T18:17:18.822 INFO:tasks.workunit.client.0.smithi163.stdout:8527( 79 mod 256): MAPREAD 0x4ae76 thru 0x4ea21 (0x3bac bytes) 2023-07-14T18:17:18.822 INFO:tasks.workunit.client.0.smithi163.stdout:8528( 80 mod 256): FALLOC 0x99177 thru 0xa12b4 (0x813d bytes) INTERIOR 2023-07-14T18:17:18.822 INFO:tasks.workunit.client.0.smithi163.stdout:8529( 81 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.822 INFO:tasks.workunit.client.0.smithi163.stdout:8530( 82 mod 256): READ 0x6a051 thru 0x7185d (0x780d bytes) 2023-07-14T18:17:18.823 INFO:tasks.workunit.client.0.smithi163.stdout:8531( 83 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.823 INFO:tasks.workunit.client.0.smithi163.stdout:8532( 84 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.823 INFO:tasks.workunit.client.0.smithi163.stdout:8533( 85 mod 256): MAPWRITE 0xb8187 thru 0xc5222 (0xd09c bytes) 2023-07-14T18:17:18.823 INFO:tasks.workunit.client.0.smithi163.stdout:8534( 86 mod 256): FALLOC 0xf29ab thru 0xf9d7d (0x73d2 bytes) PAST_EOF 2023-07-14T18:17:18.823 INFO:tasks.workunit.client.0.smithi163.stdout:8535( 87 mod 256): MAPREAD 0x8f6ae thru 0x9724e (0x7ba1 bytes) 2023-07-14T18:17:18.823 INFO:tasks.workunit.client.0.smithi163.stdout:8536( 88 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.823 INFO:tasks.workunit.client.0.smithi163.stdout:8537( 89 mod 256): READ 0xaebca thru 0xb2162 (0x3599 bytes) 2023-07-14T18:17:18.823 INFO:tasks.workunit.client.0.smithi163.stdout:8538( 90 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.824 INFO:tasks.workunit.client.0.smithi163.stdout:8539( 91 mod 256): COPY 0xa99f9 thru 0xaf4bc (0x5ac4 bytes) to 0xb8dc thru 0x1139f 2023-07-14T18:17:18.824 INFO:tasks.workunit.client.0.smithi163.stdout:8540( 92 mod 256): MAPWRITE 0x83db thru 0x17f4b (0xfb71 bytes) 2023-07-14T18:17:18.824 INFO:tasks.workunit.client.0.smithi163.stdout:8541( 93 mod 256): MAPWRITE 0xbed0c thru 0xcebdd (0xfed2 bytes) 2023-07-14T18:17:18.824 INFO:tasks.workunit.client.0.smithi163.stdout:8542( 94 mod 256): WRITE 0xef48a thru 0xf30a8 (0x3c1f bytes) HOLE 2023-07-14T18:17:18.824 INFO:tasks.workunit.client.0.smithi163.stdout:8543( 95 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.824 INFO:tasks.workunit.client.0.smithi163.stdout:8544( 96 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.824 INFO:tasks.workunit.client.0.smithi163.stdout:8545( 97 mod 256): WRITE 0xa2201 thru 0xa8b62 (0x6962 bytes) 2023-07-14T18:17:18.824 INFO:tasks.workunit.client.0.smithi163.stdout:8546( 98 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.825 INFO:tasks.workunit.client.0.smithi163.stdout:8547( 99 mod 256): MAPWRITE 0x58a4e thru 0x644ae (0xba61 bytes) 2023-07-14T18:17:18.825 INFO:tasks.workunit.client.0.smithi163.stdout:8548(100 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.825 INFO:tasks.workunit.client.0.smithi163.stdout:8549(101 mod 256): MAPWRITE 0xf6176 thru 0xfffff (0x9e8a bytes) 2023-07-14T18:17:18.825 INFO:tasks.workunit.client.0.smithi163.stdout:8550(102 mod 256): FALLOC 0x39022 thru 0x41216 (0x81f4 bytes) INTERIOR 2023-07-14T18:17:18.825 INFO:tasks.workunit.client.0.smithi163.stdout:8551(103 mod 256): PUNCH 0x88c1e thru 0x986f8 (0xfadb bytes) 2023-07-14T18:17:18.825 INFO:tasks.workunit.client.0.smithi163.stdout:8552(104 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.825 INFO:tasks.workunit.client.0.smithi163.stdout:8553(105 mod 256): MAPREAD 0x6671f thru 0x73d29 (0xd60b bytes) 2023-07-14T18:17:18.825 INFO:tasks.workunit.client.0.smithi163.stdout:8554(106 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.826 INFO:tasks.workunit.client.0.smithi163.stdout:8555(107 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.826 INFO:tasks.workunit.client.0.smithi163.stdout:8556(108 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.826 INFO:tasks.workunit.client.0.smithi163.stdout:8557(109 mod 256): PUNCH 0xad574 thru 0xb9c74 (0xc701 bytes) 2023-07-14T18:17:18.826 INFO:tasks.workunit.client.0.smithi163.stdout:8558(110 mod 256): COPY 0x90381 thru 0x99bc9 (0x9849 bytes) to 0xb07c7 thru 0xba00f 2023-07-14T18:17:18.826 INFO:tasks.workunit.client.0.smithi163.stdout:8559(111 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.826 INFO:tasks.workunit.client.0.smithi163.stdout:8560(112 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.826 INFO:tasks.workunit.client.0.smithi163.stdout:8561(113 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.826 INFO:tasks.workunit.client.0.smithi163.stdout:8562(114 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.827 INFO:tasks.workunit.client.0.smithi163.stdout:8563(115 mod 256): TRUNCATE DOWN from 0x100000 to 0x3a110 2023-07-14T18:17:18.827 INFO:tasks.workunit.client.0.smithi163.stdout:8564(116 mod 256): WRITE 0xf313c thru 0xfffff (0xcec4 bytes) HOLE 2023-07-14T18:17:18.827 INFO:tasks.workunit.client.0.smithi163.stdout:8565(117 mod 256): TRUNCATE DOWN from 0x100000 to 0x92935 2023-07-14T18:17:18.827 INFO:tasks.workunit.client.0.smithi163.stdout:8566(118 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.827 INFO:tasks.workunit.client.0.smithi163.stdout:8567(119 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.827 INFO:tasks.workunit.client.0.smithi163.stdout:8568(120 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.827 INFO:tasks.workunit.client.0.smithi163.stdout:8569(121 mod 256): READ 0x7010e thru 0x7525d (0x5150 bytes) 2023-07-14T18:17:18.827 INFO:tasks.workunit.client.0.smithi163.stdout:8570(122 mod 256): PUNCH 0x4f678 thru 0x549c2 (0x534b bytes) 2023-07-14T18:17:18.828 INFO:tasks.workunit.client.0.smithi163.stdout:8571(123 mod 256): MAPREAD 0x44f56 thru 0x49003 (0x40ae bytes) 2023-07-14T18:17:18.828 INFO:tasks.workunit.client.0.smithi163.stdout:8572(124 mod 256): FALLOC 0x3d18b thru 0x407c7 (0x363c bytes) INTERIOR 2023-07-14T18:17:18.828 INFO:tasks.workunit.client.0.smithi163.stdout:8573(125 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.828 INFO:tasks.workunit.client.0.smithi163.stdout:8574(126 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.828 INFO:tasks.workunit.client.0.smithi163.stdout:8575(127 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.828 INFO:tasks.workunit.client.0.smithi163.stdout:8576(128 mod 256): COPY 0x4c530 thru 0x52a90 (0x6561 bytes) to 0xb818c thru 0xbe6ec 2023-07-14T18:17:18.828 INFO:tasks.workunit.client.0.smithi163.stdout:8577(129 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.829 INFO:tasks.workunit.client.0.smithi163.stdout:8578(130 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.829 INFO:tasks.workunit.client.0.smithi163.stdout:8579(131 mod 256): MAPWRITE 0x533f5 thru 0x5a83d (0x7449 bytes) 2023-07-14T18:17:18.829 INFO:tasks.workunit.client.0.smithi163.stdout:8580(132 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.829 INFO:tasks.workunit.client.0.smithi163.stdout:8581(133 mod 256): FALLOC 0x3bd2 thru 0xad68 (0x7196 bytes) INTERIOR 2023-07-14T18:17:18.829 INFO:tasks.workunit.client.0.smithi163.stdout:8582(134 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.829 INFO:tasks.workunit.client.0.smithi163.stdout:8583(135 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.829 INFO:tasks.workunit.client.0.smithi163.stdout:8584(136 mod 256): PUNCH 0x93448 thru 0x9b6be (0x8277 bytes) 2023-07-14T18:17:18.829 INFO:tasks.workunit.client.0.smithi163.stdout:8585(137 mod 256): WRITE 0x5c44a thru 0x6616d (0x9d24 bytes) 2023-07-14T18:17:18.830 INFO:tasks.workunit.client.0.smithi163.stdout:8586(138 mod 256): READ 0x97d06 thru 0xa54a1 (0xd79c bytes) 2023-07-14T18:17:18.830 INFO:tasks.workunit.client.0.smithi163.stdout:8587(139 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.830 INFO:tasks.workunit.client.0.smithi163.stdout:8588(140 mod 256): MAPWRITE 0x76ba thru 0x10270 (0x8bb7 bytes) 2023-07-14T18:17:18.830 INFO:tasks.workunit.client.0.smithi163.stdout:8589(141 mod 256): MAPREAD 0x28e5c thru 0x2df56 (0x50fb bytes) 2023-07-14T18:17:18.830 INFO:tasks.workunit.client.0.smithi163.stdout:8590(142 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.830 INFO:tasks.workunit.client.0.smithi163.stdout:8591(143 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.830 INFO:tasks.workunit.client.0.smithi163.stdout:8592(144 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.830 INFO:tasks.workunit.client.0.smithi163.stdout:8593(145 mod 256): FALLOC 0xb805e thru 0xbbd59 (0x3cfb bytes) INTERIOR 2023-07-14T18:17:18.831 INFO:tasks.workunit.client.0.smithi163.stdout:8594(146 mod 256): READ 0xac751 thru 0xb7e2d (0xb6dd bytes) 2023-07-14T18:17:18.831 INFO:tasks.workunit.client.0.smithi163.stdout:8595(147 mod 256): TRUNCATE DOWN from 0xbe6ed to 0x2f5c9 ******WWWW 2023-07-14T18:17:18.831 INFO:tasks.workunit.client.0.smithi163.stdout:8596(148 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.831 INFO:tasks.workunit.client.0.smithi163.stdout:8597(149 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.831 INFO:tasks.workunit.client.0.smithi163.stdout:8598(150 mod 256): MAPWRITE 0x4bb02 thru 0x57beb (0xc0ea bytes) 2023-07-14T18:17:18.831 INFO:tasks.workunit.client.0.smithi163.stdout:8599(151 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.831 INFO:tasks.workunit.client.0.smithi163.stdout:8600(152 mod 256): FALLOC 0xd8646 thru 0xda8ae (0x2268 bytes) PAST_EOF 2023-07-14T18:17:18.831 INFO:tasks.workunit.client.0.smithi163.stdout:8601(153 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.832 INFO:tasks.workunit.client.0.smithi163.stdout:8602(154 mod 256): WRITE 0x684f1 thru 0x71ac6 (0x95d6 bytes) HOLE 2023-07-14T18:17:18.832 INFO:tasks.workunit.client.0.smithi163.stdout:8603(155 mod 256): TRUNCATE UP from 0x71ac7 to 0x89b6e 2023-07-14T18:17:18.832 INFO:tasks.workunit.client.0.smithi163.stdout:8604(156 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.832 INFO:tasks.workunit.client.0.smithi163.stdout:8605(157 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.832 INFO:tasks.workunit.client.0.smithi163.stdout:8606(158 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.832 INFO:tasks.workunit.client.0.smithi163.stdout:8607(159 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.832 INFO:tasks.workunit.client.0.smithi163.stdout:8608(160 mod 256): MAPWRITE 0x177fb thru 0x21017 (0x981d bytes) 2023-07-14T18:17:18.832 INFO:tasks.workunit.client.0.smithi163.stdout:8609(161 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.833 INFO:tasks.workunit.client.0.smithi163.stdout:8610(162 mod 256): TRUNCATE DOWN from 0x89b6e to 0x738eb 2023-07-14T18:17:18.833 INFO:tasks.workunit.client.0.smithi163.stdout:8611(163 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.833 INFO:tasks.workunit.client.0.smithi163.stdout:8612(164 mod 256): MAPREAD 0x359a8 thru 0x3b5b6 (0x5c0f bytes) ***RRRR*** 2023-07-14T18:17:18.833 INFO:tasks.workunit.client.0.smithi163.stdout:8613(165 mod 256): MAPREAD 0x15c14 thru 0x1d439 (0x7826 bytes) 2023-07-14T18:17:18.833 INFO:tasks.workunit.client.0.smithi163.stdout:8614(166 mod 256): MAPREAD 0x6afdd thru 0x738ea (0x890e bytes) 2023-07-14T18:17:18.833 INFO:tasks.workunit.client.0.smithi163.stdout:8615(167 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.833 INFO:tasks.workunit.client.0.smithi163.stdout:8616(168 mod 256): WRITE 0x5f524 thru 0x6f14f (0xfc2c bytes) 2023-07-14T18:17:18.833 INFO:tasks.workunit.client.0.smithi163.stdout:8617(169 mod 256): PUNCH 0x3f404 thru 0x4e8f0 (0xf4ed bytes) 2023-07-14T18:17:18.834 INFO:tasks.workunit.client.0.smithi163.stdout:8618(170 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.834 INFO:tasks.workunit.client.0.smithi163.stdout:8619(171 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.834 INFO:tasks.workunit.client.0.smithi163.stdout:8620(172 mod 256): MAPWRITE 0xdbd27 thru 0xdccfd (0xfd7 bytes) 2023-07-14T18:17:18.834 INFO:tasks.workunit.client.0.smithi163.stdout:8621(173 mod 256): FALLOC 0x2e039 thru 0x2f537 (0x14fe bytes) INTERIOR 2023-07-14T18:17:18.834 INFO:tasks.workunit.client.0.smithi163.stdout:8622(174 mod 256): READ 0x3cf1e thru 0x484f5 (0xb5d8 bytes) 2023-07-14T18:17:18.834 INFO:tasks.workunit.client.0.smithi163.stdout:8623(175 mod 256): COPY 0x3d047 thru 0x404d1 (0x348b bytes) to 0x4f855 thru 0x52cdf 2023-07-14T18:17:18.834 INFO:tasks.workunit.client.0.smithi163.stdout:8624(176 mod 256): FALLOC 0x6c2fd thru 0x6cc11 (0x914 bytes) INTERIOR 2023-07-14T18:17:18.834 INFO:tasks.workunit.client.0.smithi163.stdout:8625(177 mod 256): MAPWRITE 0x81ac1 thru 0x86a2d (0x4f6d bytes) 2023-07-14T18:17:18.835 INFO:tasks.workunit.client.0.smithi163.stdout:8626(178 mod 256): COPY 0x3fbc7 thru 0x48c59 (0x9093 bytes) to 0x5ff56 thru 0x68fe8 2023-07-14T18:17:18.835 INFO:tasks.workunit.client.0.smithi163.stdout:8627(179 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.835 INFO:tasks.workunit.client.0.smithi163.stdout:8628(180 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.835 INFO:tasks.workunit.client.0.smithi163.stdout:8629(181 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.835 INFO:tasks.workunit.client.0.smithi163.stdout:8630(182 mod 256): COPY 0x30195 thru 0x3c4d1 (0xc33d bytes) to 0x4679d thru 0x52ad9 EEEE****** 2023-07-14T18:17:18.835 INFO:tasks.workunit.client.0.smithi163.stdout:8631(183 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.835 INFO:tasks.workunit.client.0.smithi163.stdout:8632(184 mod 256): FALLOC 0xae75f thru 0xba4f2 (0xbd93 bytes) INTERIOR 2023-07-14T18:17:18.835 INFO:tasks.workunit.client.0.smithi163.stdout:8633(185 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.836 INFO:tasks.workunit.client.0.smithi163.stdout:8634(186 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.836 INFO:tasks.workunit.client.0.smithi163.stdout:8635(187 mod 256): COPY 0xcc024 thru 0xd3e22 (0x7dff bytes) to 0x97400 thru 0x9f1fe 2023-07-14T18:17:18.836 INFO:tasks.workunit.client.0.smithi163.stdout:8636(188 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.836 INFO:tasks.workunit.client.0.smithi163.stdout:8637(189 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.836 INFO:tasks.workunit.client.0.smithi163.stdout:8638(190 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.836 INFO:tasks.workunit.client.0.smithi163.stdout:8639(191 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.836 INFO:tasks.workunit.client.0.smithi163.stdout:8640(192 mod 256): MAPREAD 0x9cc4d thru 0xa84b4 (0xb868 bytes) 2023-07-14T18:17:18.836 INFO:tasks.workunit.client.0.smithi163.stdout:8641(193 mod 256): COPY 0x51248 thru 0x52ed0 (0x1c89 bytes) to 0xc68d8 thru 0xc8560 2023-07-14T18:17:18.837 INFO:tasks.workunit.client.0.smithi163.stdout:8642(194 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.837 INFO:tasks.workunit.client.0.smithi163.stdout:8643(195 mod 256): TRUNCATE DOWN from 0xdccfe to 0x4a307 2023-07-14T18:17:18.837 INFO:tasks.workunit.client.0.smithi163.stdout:8644(196 mod 256): MAPREAD 0x472d3 thru 0x4a306 (0x3034 bytes) 2023-07-14T18:17:18.837 INFO:tasks.workunit.client.0.smithi163.stdout:8645(197 mod 256): READ 0x3769a thru 0x38eb0 (0x1817 bytes) ***RRRR*** 2023-07-14T18:17:18.837 INFO:tasks.workunit.client.0.smithi163.stdout:8646(198 mod 256): MAPWRITE 0x400b8 thru 0x48de8 (0x8d31 bytes) 2023-07-14T18:17:18.837 INFO:tasks.workunit.client.0.smithi163.stdout:8647(199 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.837 INFO:tasks.workunit.client.0.smithi163.stdout:8648(200 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.837 INFO:tasks.workunit.client.0.smithi163.stdout:8649(201 mod 256): TRUNCATE UP from 0x4a307 to 0xf972d 2023-07-14T18:17:18.838 INFO:tasks.workunit.client.0.smithi163.stdout:8650(202 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.838 INFO:tasks.workunit.client.0.smithi163.stdout:8651(203 mod 256): MAPREAD 0x97fa4 thru 0xa5e05 (0xde62 bytes) 2023-07-14T18:17:18.838 INFO:tasks.workunit.client.0.smithi163.stdout:8652(204 mod 256): WRITE 0x9f112 thru 0xae0e1 (0xefd0 bytes) 2023-07-14T18:17:18.838 INFO:tasks.workunit.client.0.smithi163.stdout:8653(205 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.838 INFO:tasks.workunit.client.0.smithi163.stdout:8654(206 mod 256): MAPWRITE 0xfb34 thru 0x1b7d3 (0xbca0 bytes) 2023-07-14T18:17:18.838 INFO:tasks.workunit.client.0.smithi163.stdout:8655(207 mod 256): MAPREAD 0xe73d5 thru 0xe9e28 (0x2a54 bytes) 2023-07-14T18:17:18.838 INFO:tasks.workunit.client.0.smithi163.stdout:8656(208 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.838 INFO:tasks.workunit.client.0.smithi163.stdout:8657(209 mod 256): COPY 0xd7626 thru 0xe59d9 (0xe3b4 bytes) to 0x21ee7 thru 0x3029a 2023-07-14T18:17:18.839 INFO:tasks.workunit.client.0.smithi163.stdout:8658(210 mod 256): MAPREAD 0x46d06 thru 0x48bbb (0x1eb6 bytes) 2023-07-14T18:17:18.839 INFO:tasks.workunit.client.0.smithi163.stdout:8659(211 mod 256): READ 0xc7b8c thru 0xcce10 (0x5285 bytes) 2023-07-14T18:17:18.839 INFO:tasks.workunit.client.0.smithi163.stdout:8660(212 mod 256): PUNCH 0x30a7d thru 0x3892b (0x7eaf bytes) ******PPPP 2023-07-14T18:17:18.839 INFO:tasks.workunit.client.0.smithi163.stdout:8661(213 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.839 INFO:tasks.workunit.client.0.smithi163.stdout:8662(214 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.839 INFO:tasks.workunit.client.0.smithi163.stdout:8663(215 mod 256): TRUNCATE DOWN from 0xf972d to 0xa2155 2023-07-14T18:17:18.839 INFO:tasks.workunit.client.0.smithi163.stdout:8664(216 mod 256): TRUNCATE UP from 0xa2155 to 0xb38fc 2023-07-14T18:17:18.839 INFO:tasks.workunit.client.0.smithi163.stdout:8665(217 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.840 INFO:tasks.workunit.client.0.smithi163.stdout:8666(218 mod 256): READ 0xa6428 thru 0xa9757 (0x3330 bytes) 2023-07-14T18:17:18.840 INFO:tasks.workunit.client.0.smithi163.stdout:8667(219 mod 256): FALLOC 0x2ffd5 thru 0x3dec2 (0xdeed bytes) INTERIOR ******FFFF 2023-07-14T18:17:18.840 INFO:tasks.workunit.client.0.smithi163.stdout:8668(220 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.840 INFO:tasks.workunit.client.0.smithi163.stdout:8669(221 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.840 INFO:tasks.workunit.client.0.smithi163.stdout:8670(222 mod 256): MAPWRITE 0xbff7b thru 0xc064d (0x6d3 bytes) 2023-07-14T18:17:18.840 INFO:tasks.workunit.client.0.smithi163.stdout:8671(223 mod 256): MAPREAD 0x33df1 thru 0x34380 (0x590 bytes) 2023-07-14T18:17:18.840 INFO:tasks.workunit.client.0.smithi163.stdout:8672(224 mod 256): WRITE 0xa6f07 thru 0xae380 (0x747a bytes) 2023-07-14T18:17:18.840 INFO:tasks.workunit.client.0.smithi163.stdout:8673(225 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.841 INFO:tasks.workunit.client.0.smithi163.stdout:8674(226 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.841 INFO:tasks.workunit.client.0.smithi163.stdout:8675(227 mod 256): PUNCH 0x5e6e1 thru 0x5f1f5 (0xb15 bytes) 2023-07-14T18:17:18.841 INFO:tasks.workunit.client.0.smithi163.stdout:8676(228 mod 256): TRUNCATE UP from 0xc064e to 0xeeffb 2023-07-14T18:17:18.841 INFO:tasks.workunit.client.0.smithi163.stdout:8677(229 mod 256): TRUNCATE DOWN from 0xeeffb to 0x4777 ******WWWW 2023-07-14T18:17:18.841 INFO:tasks.workunit.client.0.smithi163.stdout:8678(230 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.841 INFO:tasks.workunit.client.0.smithi163.stdout:8679(231 mod 256): COPY 0x32bf thru 0x4776 (0x14b8 bytes) to 0x515bb thru 0x52a72 2023-07-14T18:17:18.841 INFO:tasks.workunit.client.0.smithi163.stdout:8680(232 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.841 INFO:tasks.workunit.client.0.smithi163.stdout:8681(233 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.842 INFO:tasks.workunit.client.0.smithi163.stdout:8682(234 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.842 INFO:tasks.workunit.client.0.smithi163.stdout:8683(235 mod 256): FALLOC 0x3707b thru 0x41edf (0xae64 bytes) INTERIOR ******FFFF 2023-07-14T18:17:18.842 INFO:tasks.workunit.client.0.smithi163.stdout:8684(236 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.842 INFO:tasks.workunit.client.0.smithi163.stdout:8685(237 mod 256): TRUNCATE UP from 0x52a73 to 0x7724f 2023-07-14T18:17:18.842 INFO:tasks.workunit.client.0.smithi163.stdout:8686(238 mod 256): WRITE 0xaf997 thru 0xb18d4 (0x1f3e bytes) HOLE 2023-07-14T18:17:18.842 INFO:tasks.workunit.client.0.smithi163.stdout:8687(239 mod 256): FALLOC 0xbe3c4 thru 0xc2d23 (0x495f bytes) EXTENDING 2023-07-14T18:17:18.842 INFO:tasks.workunit.client.0.smithi163.stdout:8688(240 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.842 INFO:tasks.workunit.client.0.smithi163.stdout:8689(241 mod 256): COPY 0xbe6a9 thru 0xc2d22 (0x467a bytes) to 0x810f9 thru 0x85772 2023-07-14T18:17:18.843 INFO:tasks.workunit.client.0.smithi163.stdout:8690(242 mod 256): WRITE 0x16030 thru 0x20c6f (0xac40 bytes) 2023-07-14T18:17:18.843 INFO:tasks.workunit.client.0.smithi163.stdout:8691(243 mod 256): WRITE 0xb6181 thru 0xba6cd (0x454d bytes) 2023-07-14T18:17:18.843 INFO:tasks.workunit.client.0.smithi163.stdout:8692(244 mod 256): TRUNCATE DOWN from 0xc2d23 to 0xb90fc 2023-07-14T18:17:18.843 INFO:tasks.workunit.client.0.smithi163.stdout:8693(245 mod 256): MAPREAD 0x77b81 thru 0x7fa5c (0x7edc bytes) 2023-07-14T18:17:18.843 INFO:tasks.workunit.client.0.smithi163.stdout:8694(246 mod 256): WRITE 0x5133f thru 0x56ba4 (0x5866 bytes) 2023-07-14T18:17:18.843 INFO:tasks.workunit.client.0.smithi163.stdout:8695(247 mod 256): PUNCH 0x4fcab thru 0x55d2f (0x6085 bytes) 2023-07-14T18:17:18.843 INFO:tasks.workunit.client.0.smithi163.stdout:8696(248 mod 256): READ 0x55e30 thru 0x5f375 (0x9546 bytes) 2023-07-14T18:17:18.843 INFO:tasks.workunit.client.0.smithi163.stdout:8697(249 mod 256): MAPWRITE 0xb9913 thru 0xc2457 (0x8b45 bytes) 2023-07-14T18:17:18.844 INFO:tasks.workunit.client.0.smithi163.stdout:8698(250 mod 256): MAPWRITE 0xe4c7e thru 0xf2cae (0xe031 bytes) 2023-07-14T18:17:18.844 INFO:tasks.workunit.client.0.smithi163.stdout:8699(251 mod 256): READ 0xeb0d8 thru 0xf2cae (0x7bd7 bytes) 2023-07-14T18:17:18.844 INFO:tasks.workunit.client.0.smithi163.stdout:8700(252 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.844 INFO:tasks.workunit.client.0.smithi163.stdout:8701(253 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.844 INFO:tasks.workunit.client.0.smithi163.stdout:8702(254 mod 256): MAPREAD 0x766b thru 0x98f0 (0x2286 bytes) 2023-07-14T18:17:18.844 INFO:tasks.workunit.client.0.smithi163.stdout:8703(255 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.844 INFO:tasks.workunit.client.0.smithi163.stdout:8704( 0 mod 256): FALLOC 0x96936 thru 0xa05a6 (0x9c70 bytes) INTERIOR 2023-07-14T18:17:18.844 INFO:tasks.workunit.client.0.smithi163.stdout:8705( 1 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.845 INFO:tasks.workunit.client.0.smithi163.stdout:8706( 2 mod 256): FALLOC 0x9950 thru 0xcb85 (0x3235 bytes) INTERIOR 2023-07-14T18:17:18.845 INFO:tasks.workunit.client.0.smithi163.stdout:8707( 3 mod 256): MAPWRITE 0x74d3f thru 0x8466c (0xf92e bytes) 2023-07-14T18:17:18.845 INFO:tasks.workunit.client.0.smithi163.stdout:8708( 4 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.845 INFO:tasks.workunit.client.0.smithi163.stdout:8709( 5 mod 256): READ 0x3076c thru 0x40575 (0xfe0a bytes) ***RRRR*** 2023-07-14T18:17:18.845 INFO:tasks.workunit.client.0.smithi163.stdout:8710( 6 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.845 INFO:tasks.workunit.client.0.smithi163.stdout:8711( 7 mod 256): TRUNCATE DOWN from 0xf2caf to 0x500ad 2023-07-14T18:17:18.845 INFO:tasks.workunit.client.0.smithi163.stdout:8712( 8 mod 256): PUNCH 0xb826 thru 0xf674 (0x3e4f bytes) 2023-07-14T18:17:18.845 INFO:tasks.workunit.client.0.smithi163.stdout:8713( 9 mod 256): COPY 0x194f8 thru 0x20e08 (0x7911 bytes) to 0x5db88 thru 0x65498 2023-07-14T18:17:18.846 INFO:tasks.workunit.client.0.smithi163.stdout:8714( 10 mod 256): MAPREAD 0x48f9c thru 0x4bfc2 (0x3027 bytes) 2023-07-14T18:17:18.846 INFO:tasks.workunit.client.0.smithi163.stdout:8715( 11 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.846 INFO:tasks.workunit.client.0.smithi163.stdout:8716( 12 mod 256): TRUNCATE UP from 0x65499 to 0xb8f84 2023-07-14T18:17:18.846 INFO:tasks.workunit.client.0.smithi163.stdout:8717( 13 mod 256): PUNCH 0x7f9c8 thru 0x800ac (0x6e5 bytes) 2023-07-14T18:17:18.846 INFO:tasks.workunit.client.0.smithi163.stdout:8718( 14 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.846 INFO:tasks.workunit.client.0.smithi163.stdout:8719( 15 mod 256): COPY 0x1c11e thru 0x23591 (0x7474 bytes) to 0x44f7b thru 0x4c3ee 2023-07-14T18:17:18.846 INFO:tasks.workunit.client.0.smithi163.stdout:8720( 16 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.846 INFO:tasks.workunit.client.0.smithi163.stdout:8721( 17 mod 256): TRUNCATE UP from 0xb8f84 to 0xb93b7 2023-07-14T18:17:18.847 INFO:tasks.workunit.client.0.smithi163.stdout:8722( 18 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.847 INFO:tasks.workunit.client.0.smithi163.stdout:8723( 19 mod 256): WRITE 0x870ef thru 0x95341 (0xe253 bytes) 2023-07-14T18:17:18.847 INFO:tasks.workunit.client.0.smithi163.stdout:8724( 20 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.847 INFO:tasks.workunit.client.0.smithi163.stdout:8725( 21 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.847 INFO:tasks.workunit.client.0.smithi163.stdout:8726( 22 mod 256): MAPREAD 0x8aede thru 0x8c37d (0x14a0 bytes) 2023-07-14T18:17:18.847 INFO:tasks.workunit.client.0.smithi163.stdout:8727( 23 mod 256): READ 0x6b14 thru 0xe9e8 (0x7ed5 bytes) 2023-07-14T18:17:18.847 INFO:tasks.workunit.client.0.smithi163.stdout:8728( 24 mod 256): FALLOC 0x6643a thru 0x6f4bb (0x9081 bytes) INTERIOR 2023-07-14T18:17:18.847 INFO:tasks.workunit.client.0.smithi163.stdout:8729( 25 mod 256): MAPREAD 0xaded2 thru 0xb87de (0xa90d bytes) 2023-07-14T18:17:18.848 INFO:tasks.workunit.client.0.smithi163.stdout:8730( 26 mod 256): WRITE 0xa91c5 thru 0xb1303 (0x813f bytes) 2023-07-14T18:17:18.848 INFO:tasks.workunit.client.0.smithi163.stdout:8731( 27 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.848 INFO:tasks.workunit.client.0.smithi163.stdout:8732( 28 mod 256): WRITE 0xfaee6 thru 0xfffff (0x511a bytes) HOLE 2023-07-14T18:17:18.848 INFO:tasks.workunit.client.0.smithi163.stdout:8733( 29 mod 256): TRUNCATE DOWN from 0x100000 to 0xb2cbd 2023-07-14T18:17:18.848 INFO:tasks.workunit.client.0.smithi163.stdout:8734( 30 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.848 INFO:tasks.workunit.client.0.smithi163.stdout:8735( 31 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.848 INFO:tasks.workunit.client.0.smithi163.stdout:8736( 32 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.848 INFO:tasks.workunit.client.0.smithi163.stdout:8737( 33 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.849 INFO:tasks.workunit.client.0.smithi163.stdout:8738( 34 mod 256): MAPREAD 0x87f41 thru 0x8f80f (0x78cf bytes) 2023-07-14T18:17:18.849 INFO:tasks.workunit.client.0.smithi163.stdout:8739( 35 mod 256): TRUNCATE DOWN from 0xb2cbd to 0x1e33e ******WWWW 2023-07-14T18:17:18.849 INFO:tasks.workunit.client.0.smithi163.stdout:8740( 36 mod 256): MAPREAD 0x17035 thru 0x1e33d (0x7309 bytes) 2023-07-14T18:17:18.849 INFO:tasks.workunit.client.0.smithi163.stdout:8741( 37 mod 256): MAPREAD 0x6f87 thru 0x137bb (0xc835 bytes) 2023-07-14T18:17:18.849 INFO:tasks.workunit.client.0.smithi163.stdout:8742( 38 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.849 INFO:tasks.workunit.client.0.smithi163.stdout:8743( 39 mod 256): FALLOC 0x60af1 thru 0x69051 (0x8560 bytes) PAST_EOF 2023-07-14T18:17:18.849 INFO:tasks.workunit.client.0.smithi163.stdout:8744( 40 mod 256): READ 0x613c thru 0x10508 (0xa3cd bytes) 2023-07-14T18:17:18.849 INFO:tasks.workunit.client.0.smithi163.stdout:8745( 41 mod 256): READ 0xdf1a thru 0x1060c (0x26f3 bytes) 2023-07-14T18:17:18.850 INFO:tasks.workunit.client.0.smithi163.stdout:8746( 42 mod 256): PUNCH 0x1b8ab thru 0x1bcf3 (0x449 bytes) 2023-07-14T18:17:18.850 INFO:tasks.workunit.client.0.smithi163.stdout:8747( 43 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.850 INFO:tasks.workunit.client.0.smithi163.stdout:8748( 44 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.850 INFO:tasks.workunit.client.0.smithi163.stdout:8749( 45 mod 256): PUNCH 0x13fb thru 0x8112 (0x6d18 bytes) 2023-07-14T18:17:18.850 INFO:tasks.workunit.client.0.smithi163.stdout:8750( 46 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.850 INFO:tasks.workunit.client.0.smithi163.stdout:8751( 47 mod 256): TRUNCATE UP from 0x1e33e to 0x8cd61 ******WWWW 2023-07-14T18:17:18.850 INFO:tasks.workunit.client.0.smithi163.stdout:8752( 48 mod 256): MAPREAD 0x61f4e thru 0x6f9e0 (0xda93 bytes) 2023-07-14T18:17:18.850 INFO:tasks.workunit.client.0.smithi163.stdout:8753( 49 mod 256): TRUNCATE DOWN from 0x8cd61 to 0xac2e ******WWWW 2023-07-14T18:17:18.851 INFO:tasks.workunit.client.0.smithi163.stdout:8754( 50 mod 256): FALLOC 0x46d8e thru 0x49cb0 (0x2f22 bytes) EXTENDING 2023-07-14T18:17:18.851 INFO:tasks.workunit.client.0.smithi163.stdout:8755( 51 mod 256): COPY 0x1a19d thru 0x1f037 (0x4e9b bytes) to 0xe4a54 thru 0xe98ee 2023-07-14T18:17:18.851 INFO:tasks.workunit.client.0.smithi163.stdout:8756( 52 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.851 INFO:tasks.workunit.client.0.smithi163.stdout:8757( 53 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.851 INFO:tasks.workunit.client.0.smithi163.stdout:8758( 54 mod 256): READ 0xa6abe thru 0xb3ddc (0xd31f bytes) 2023-07-14T18:17:18.851 INFO:tasks.workunit.client.0.smithi163.stdout:8759( 55 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.851 INFO:tasks.workunit.client.0.smithi163.stdout:8760( 56 mod 256): MAPWRITE 0x8f665 thru 0x9f11f (0xfabb bytes) 2023-07-14T18:17:18.851 INFO:tasks.workunit.client.0.smithi163.stdout:8761( 57 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.852 INFO:tasks.workunit.client.0.smithi163.stdout:8762( 58 mod 256): MAPWRITE 0x82482 thru 0x831e1 (0xd60 bytes) 2023-07-14T18:17:18.852 INFO:tasks.workunit.client.0.smithi163.stdout:8763( 59 mod 256): READ 0xb93f9 thru 0xbed5a (0x5962 bytes) 2023-07-14T18:17:18.852 INFO:tasks.workunit.client.0.smithi163.stdout:8764( 60 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.852 INFO:tasks.workunit.client.0.smithi163.stdout:8765( 61 mod 256): READ 0x806f2 thru 0x8529c (0x4bab bytes) 2023-07-14T18:17:18.852 INFO:tasks.workunit.client.0.smithi163.stdout:8766( 62 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.852 INFO:tasks.workunit.client.0.smithi163.stdout:8767( 63 mod 256): MAPREAD 0x2c4c1 thru 0x2d342 (0xe82 bytes) 2023-07-14T18:17:18.852 INFO:tasks.workunit.client.0.smithi163.stdout:8768( 64 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.852 INFO:tasks.workunit.client.0.smithi163.stdout:8769( 65 mod 256): PUNCH 0xaeebe thru 0xb7453 (0x8596 bytes) 2023-07-14T18:17:18.853 INFO:tasks.workunit.client.0.smithi163.stdout:8770( 66 mod 256): TRUNCATE DOWN from 0xe98ef to 0x2a0ff ******WWWW 2023-07-14T18:17:18.853 INFO:tasks.workunit.client.0.smithi163.stdout:8771( 67 mod 256): MAPWRITE 0xe664e thru 0xe7e59 (0x180c bytes) 2023-07-14T18:17:18.853 INFO:tasks.workunit.client.0.smithi163.stdout:8772( 68 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.853 INFO:tasks.workunit.client.0.smithi163.stdout:8773( 69 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.853 INFO:tasks.workunit.client.0.smithi163.stdout:8774( 70 mod 256): FALLOC 0xab84 thru 0xe233 (0x36af bytes) INTERIOR 2023-07-14T18:17:18.853 INFO:tasks.workunit.client.0.smithi163.stdout:8775( 71 mod 256): MAPREAD 0x600e0 thru 0x673c9 (0x72ea bytes) 2023-07-14T18:17:18.853 INFO:tasks.workunit.client.0.smithi163.stdout:8776( 72 mod 256): READ 0x7f6 thru 0xd927 (0xd132 bytes) 2023-07-14T18:17:18.853 INFO:tasks.workunit.client.0.smithi163.stdout:8777( 73 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.854 INFO:tasks.workunit.client.0.smithi163.stdout:8778( 74 mod 256): WRITE 0xf6351 thru 0xf98a3 (0x3553 bytes) HOLE 2023-07-14T18:17:18.854 INFO:tasks.workunit.client.0.smithi163.stdout:8779( 75 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.854 INFO:tasks.workunit.client.0.smithi163.stdout:8780( 76 mod 256): COPY 0xcdbc6 thru 0xdbe29 (0xe264 bytes) to 0x423c7 thru 0x5062a 2023-07-14T18:17:18.854 INFO:tasks.workunit.client.0.smithi163.stdout:8781( 77 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.854 INFO:tasks.workunit.client.0.smithi163.stdout:8782( 78 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.854 INFO:tasks.workunit.client.0.smithi163.stdout:8783( 79 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.854 INFO:tasks.workunit.client.0.smithi163.stdout:8784( 80 mod 256): READ 0x8eca0 thru 0x97126 (0x8487 bytes) 2023-07-14T18:17:18.854 INFO:tasks.workunit.client.0.smithi163.stdout:8785( 81 mod 256): WRITE 0x6d536 thru 0x7b390 (0xde5b bytes) 2023-07-14T18:17:18.855 INFO:tasks.workunit.client.0.smithi163.stdout:8786( 82 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.855 INFO:tasks.workunit.client.0.smithi163.stdout:8787( 83 mod 256): PUNCH 0xed922 thru 0xf98a3 (0xbf82 bytes) 2023-07-14T18:17:18.855 INFO:tasks.workunit.client.0.smithi163.stdout:8788( 84 mod 256): COPY 0x1afd3 thru 0x2abc4 (0xfbf2 bytes) to 0x757e3 thru 0x853d4 2023-07-14T18:17:18.855 INFO:tasks.workunit.client.0.smithi163.stdout:8789( 85 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.855 INFO:tasks.workunit.client.0.smithi163.stdout:8790( 86 mod 256): MAPWRITE 0xb1253 thru 0xbc5b2 (0xb360 bytes) 2023-07-14T18:17:18.855 INFO:tasks.workunit.client.0.smithi163.stdout:8791( 87 mod 256): WRITE 0xdc987 thru 0xe3a6b (0x70e5 bytes) 2023-07-14T18:17:18.855 INFO:tasks.workunit.client.0.smithi163.stdout:8792( 88 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.855 INFO:tasks.workunit.client.0.smithi163.stdout:8793( 89 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.856 INFO:tasks.workunit.client.0.smithi163.stdout:8794( 90 mod 256): READ 0xe9f39 thru 0xf035b (0x6423 bytes) 2023-07-14T18:17:18.856 INFO:tasks.workunit.client.0.smithi163.stdout:8795( 91 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.856 INFO:tasks.workunit.client.0.smithi163.stdout:8796( 92 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.856 INFO:tasks.workunit.client.0.smithi163.stdout:8797( 93 mod 256): PUNCH 0x30c98 thru 0x3e118 (0xd481 bytes) ******PPPP 2023-07-14T18:17:18.856 INFO:tasks.workunit.client.0.smithi163.stdout:8798( 94 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.856 INFO:tasks.workunit.client.0.smithi163.stdout:8799( 95 mod 256): READ 0x282 thru 0x42c2 (0x4041 bytes) 2023-07-14T18:17:18.856 INFO:tasks.workunit.client.0.smithi163.stdout:8800( 96 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.856 INFO:tasks.workunit.client.0.smithi163.stdout:8801( 97 mod 256): READ 0x627b thru 0xedbd (0x8b43 bytes) 2023-07-14T18:17:18.857 INFO:tasks.workunit.client.0.smithi163.stdout:8802( 98 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.857 INFO:tasks.workunit.client.0.smithi163.stdout:8803( 99 mod 256): WRITE 0xa3dac thru 0xa78db (0x3b30 bytes) 2023-07-14T18:17:18.857 INFO:tasks.workunit.client.0.smithi163.stdout:8804(100 mod 256): TRUNCATE DOWN from 0xf98a4 to 0xc864a 2023-07-14T18:17:18.857 INFO:tasks.workunit.client.0.smithi163.stdout:8805(101 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.857 INFO:tasks.workunit.client.0.smithi163.stdout:8806(102 mod 256): READ 0xa069c thru 0xabc76 (0xb5db bytes) 2023-07-14T18:17:18.857 INFO:tasks.workunit.client.0.smithi163.stdout:8807(103 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.857 INFO:tasks.workunit.client.0.smithi163.stdout:8808(104 mod 256): MAPREAD 0x1a51f thru 0x2a314 (0xfdf6 bytes) 2023-07-14T18:17:18.857 INFO:tasks.workunit.client.0.smithi163.stdout:8809(105 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.858 INFO:tasks.workunit.client.0.smithi163.stdout:8810(106 mod 256): READ 0x6b382 thru 0x6f76b (0x43ea bytes) 2023-07-14T18:17:18.858 INFO:tasks.workunit.client.0.smithi163.stdout:8811(107 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.858 INFO:tasks.workunit.client.0.smithi163.stdout:8812(108 mod 256): COPY 0x1502 thru 0xf67d (0xe17c bytes) to 0xeb956 thru 0xf9ad1 2023-07-14T18:17:18.858 INFO:tasks.workunit.client.0.smithi163.stdout:8813(109 mod 256): FALLOC 0xf00b8 thru 0xfaf03 (0xae4b bytes) PAST_EOF 2023-07-14T18:17:18.858 INFO:tasks.workunit.client.0.smithi163.stdout:8814(110 mod 256): MAPWRITE 0x5db45 thru 0x6913e (0xb5fa bytes) 2023-07-14T18:17:18.858 INFO:tasks.workunit.client.0.smithi163.stdout:8815(111 mod 256): WRITE 0x99e74 thru 0xa3194 (0x9321 bytes) 2023-07-14T18:17:18.858 INFO:tasks.workunit.client.0.smithi163.stdout:8816(112 mod 256): TRUNCATE DOWN from 0xf9ad2 to 0xce818 2023-07-14T18:17:18.858 INFO:tasks.workunit.client.0.smithi163.stdout:8817(113 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.859 INFO:tasks.workunit.client.0.smithi163.stdout:8818(114 mod 256): FALLOC 0x36d4c thru 0x3bbcd (0x4e81 bytes) INTERIOR ******FFFF 2023-07-14T18:17:18.859 INFO:tasks.workunit.client.0.smithi163.stdout:8819(115 mod 256): TRUNCATE DOWN from 0xce818 to 0x96266 2023-07-14T18:17:18.859 INFO:tasks.workunit.client.0.smithi163.stdout:8820(116 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.859 INFO:tasks.workunit.client.0.smithi163.stdout:8821(117 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.859 INFO:tasks.workunit.client.0.smithi163.stdout:8822(118 mod 256): COPY 0x63ab7 thru 0x6633d (0x2887 bytes) to 0x7da34 thru 0x802ba 2023-07-14T18:17:18.859 INFO:tasks.workunit.client.0.smithi163.stdout:8823(119 mod 256): PUNCH 0x6d2ee thru 0x79d9b (0xcaae bytes) 2023-07-14T18:17:18.859 INFO:tasks.workunit.client.0.smithi163.stdout:8824(120 mod 256): READ 0x640a7 thru 0x71894 (0xd7ee bytes) 2023-07-14T18:17:18.859 INFO:tasks.workunit.client.0.smithi163.stdout:8825(121 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.860 INFO:tasks.workunit.client.0.smithi163.stdout:8826(122 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.860 INFO:tasks.workunit.client.0.smithi163.stdout:8827(123 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.860 INFO:tasks.workunit.client.0.smithi163.stdout:8828(124 mod 256): PUNCH 0x4e523 thru 0x4e816 (0x2f4 bytes) 2023-07-14T18:17:18.860 INFO:tasks.workunit.client.0.smithi163.stdout:8829(125 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.860 INFO:tasks.workunit.client.0.smithi163.stdout:8830(126 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.860 INFO:tasks.workunit.client.0.smithi163.stdout:8831(127 mod 256): TRUNCATE DOWN from 0x96266 to 0x38a7a 2023-07-14T18:17:18.860 INFO:tasks.workunit.client.0.smithi163.stdout:8832(128 mod 256): WRITE 0x6c2e thru 0xd109 (0x64dc bytes) 2023-07-14T18:17:18.860 INFO:tasks.workunit.client.0.smithi163.stdout:8833(129 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.861 INFO:tasks.workunit.client.0.smithi163.stdout:8834(130 mod 256): COPY 0x31c90 thru 0x38a79 (0x6dea bytes) to 0x80672 thru 0x8745b EEEE****** 2023-07-14T18:17:18.861 INFO:tasks.workunit.client.0.smithi163.stdout:8835(131 mod 256): COPY 0x6f066 thru 0x7b54b (0xc4e6 bytes) to 0x5d07b thru 0x69560 2023-07-14T18:17:18.861 INFO:tasks.workunit.client.0.smithi163.stdout:8836(132 mod 256): READ 0x6ec23 thru 0x73c4d (0x502b bytes) 2023-07-14T18:17:18.861 INFO:tasks.workunit.client.0.smithi163.stdout:8837(133 mod 256): WRITE 0x86afd thru 0x92bc6 (0xc0ca bytes) EXTEND 2023-07-14T18:17:18.861 INFO:tasks.workunit.client.0.smithi163.stdout:8838(134 mod 256): TRUNCATE DOWN from 0x92bc7 to 0x17e3b ******WWWW 2023-07-14T18:17:18.861 INFO:tasks.workunit.client.0.smithi163.stdout:8839(135 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.861 INFO:tasks.workunit.client.0.smithi163.stdout:8840(136 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.861 INFO:tasks.workunit.client.0.smithi163.stdout:8841(137 mod 256): TRUNCATE UP from 0x17e3b to 0x42e7f ******WWWW 2023-07-14T18:17:18.862 INFO:tasks.workunit.client.0.smithi163.stdout:8842(138 mod 256): MAPWRITE 0xb9cee thru 0xbe53b (0x484e bytes) 2023-07-14T18:17:18.862 INFO:tasks.workunit.client.0.smithi163.stdout:8843(139 mod 256): TRUNCATE DOWN from 0xbe53c to 0x27ec8 ******WWWW 2023-07-14T18:17:18.862 INFO:tasks.workunit.client.0.smithi163.stdout:8844(140 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.862 INFO:tasks.workunit.client.0.smithi163.stdout:8845(141 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.862 INFO:tasks.workunit.client.0.smithi163.stdout:8846(142 mod 256): FALLOC 0xf2f9 thru 0x1d0f6 (0xddfd bytes) INTERIOR 2023-07-14T18:17:18.862 INFO:tasks.workunit.client.0.smithi163.stdout:8847(143 mod 256): COPY 0x1c52d thru 0x27ec7 (0xb99b bytes) to 0xd7d20 thru 0xe36ba 2023-07-14T18:17:18.862 INFO:tasks.workunit.client.0.smithi163.stdout:8848(144 mod 256): MAPREAD 0xae647 thru 0xb61a1 (0x7b5b bytes) 2023-07-14T18:17:18.862 INFO:tasks.workunit.client.0.smithi163.stdout:8849(145 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.863 INFO:tasks.workunit.client.0.smithi163.stdout:8850(146 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.863 INFO:tasks.workunit.client.0.smithi163.stdout:8851(147 mod 256): FALLOC 0x9e29d thru 0xa59e1 (0x7744 bytes) INTERIOR 2023-07-14T18:17:18.863 INFO:tasks.workunit.client.0.smithi163.stdout:8852(148 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.863 INFO:tasks.workunit.client.0.smithi163.stdout:8853(149 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.863 INFO:tasks.workunit.client.0.smithi163.stdout:8854(150 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.863 INFO:tasks.workunit.client.0.smithi163.stdout:8855(151 mod 256): FALLOC 0x696a2 thru 0x6f906 (0x6264 bytes) INTERIOR 2023-07-14T18:17:18.863 INFO:tasks.workunit.client.0.smithi163.stdout:8856(152 mod 256): TRUNCATE DOWN from 0xe36bb to 0x88ae2 2023-07-14T18:17:18.863 INFO:tasks.workunit.client.0.smithi163.stdout:8857(153 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.864 INFO:tasks.workunit.client.0.smithi163.stdout:8858(154 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.864 INFO:tasks.workunit.client.0.smithi163.stdout:8859(155 mod 256): READ 0x169df thru 0x21d4b (0xb36d bytes) 2023-07-14T18:17:18.864 INFO:tasks.workunit.client.0.smithi163.stdout:8860(156 mod 256): WRITE 0xface3 thru 0xfffff (0x531d bytes) HOLE 2023-07-14T18:17:18.864 INFO:tasks.workunit.client.0.smithi163.stdout:8861(157 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.864 INFO:tasks.workunit.client.0.smithi163.stdout:8862(158 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.864 INFO:tasks.workunit.client.0.smithi163.stdout:8863(159 mod 256): MAPWRITE 0x75d89 thru 0x7806f (0x22e7 bytes) 2023-07-14T18:17:18.864 INFO:tasks.workunit.client.0.smithi163.stdout:8864(160 mod 256): TRUNCATE DOWN from 0x100000 to 0xecc64 2023-07-14T18:17:18.865 INFO:tasks.workunit.client.0.smithi163.stdout:8865(161 mod 256): READ 0xc37b3 thru 0xc5a88 (0x22d6 bytes) 2023-07-14T18:17:18.865 INFO:tasks.workunit.client.0.smithi163.stdout:8866(162 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.865 INFO:tasks.workunit.client.0.smithi163.stdout:8867(163 mod 256): PUNCH 0x5ee66 thru 0x60b06 (0x1ca1 bytes) 2023-07-14T18:17:18.865 INFO:tasks.workunit.client.0.smithi163.stdout:8868(164 mod 256): TRUNCATE DOWN from 0xecc64 to 0x12c76 ******WWWW 2023-07-14T18:17:18.865 INFO:tasks.workunit.client.0.smithi163.stdout:8869(165 mod 256): PUNCH 0x5eda thru 0xe47e (0x85a5 bytes) 2023-07-14T18:17:18.865 INFO:tasks.workunit.client.0.smithi163.stdout:8870(166 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.865 INFO:tasks.workunit.client.0.smithi163.stdout:8871(167 mod 256): FALLOC 0x2515a thru 0x28bc7 (0x3a6d bytes) PAST_EOF 2023-07-14T18:17:18.865 INFO:tasks.workunit.client.0.smithi163.stdout:8872(168 mod 256): COPY 0x7a5e thru 0xae21 (0x33c4 bytes) to 0x526fa thru 0x55abd 2023-07-14T18:17:18.866 INFO:tasks.workunit.client.0.smithi163.stdout:8873(169 mod 256): PUNCH 0x2d81c thru 0x3779b (0x9f80 bytes) 2023-07-14T18:17:18.866 INFO:tasks.workunit.client.0.smithi163.stdout:8874(170 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.866 INFO:tasks.workunit.client.0.smithi163.stdout:8875(171 mod 256): TRUNCATE UP from 0x55abe to 0x8054a 2023-07-14T18:17:18.866 INFO:tasks.workunit.client.0.smithi163.stdout:8876(172 mod 256): TRUNCATE UP from 0x8054a to 0xc08a5 2023-07-14T18:17:18.866 INFO:tasks.workunit.client.0.smithi163.stdout:8877(173 mod 256): PUNCH 0x6cdde thru 0x6e380 (0x15a3 bytes) 2023-07-14T18:17:18.866 INFO:tasks.workunit.client.0.smithi163.stdout:8878(174 mod 256): PUNCH 0x7461d thru 0x7b668 (0x704c bytes) 2023-07-14T18:17:18.866 INFO:tasks.workunit.client.0.smithi163.stdout:8879(175 mod 256): WRITE 0xcd6c3 thru 0xdc24f (0xeb8d bytes) HOLE 2023-07-14T18:17:18.866 INFO:tasks.workunit.client.0.smithi163.stdout:8880(176 mod 256): FALLOC 0xe7728 thru 0xf5034 (0xd90c bytes) EXTENDING 2023-07-14T18:17:18.867 INFO:tasks.workunit.client.0.smithi163.stdout:8881(177 mod 256): MAPWRITE 0x8bb1e thru 0x93977 (0x7e5a bytes) 2023-07-14T18:17:18.867 INFO:tasks.workunit.client.0.smithi163.stdout:8882(178 mod 256): COPY 0x14bf0 thru 0x17272 (0x2683 bytes) to 0x2fd81 thru 0x32403 2023-07-14T18:17:18.867 INFO:tasks.workunit.client.0.smithi163.stdout:8883(179 mod 256): TRUNCATE UP from 0xf5034 to 0xfdc5f 2023-07-14T18:17:18.867 INFO:tasks.workunit.client.0.smithi163.stdout:8884(180 mod 256): FALLOC 0xda746 thru 0xe160b (0x6ec5 bytes) INTERIOR 2023-07-14T18:17:18.867 INFO:tasks.workunit.client.0.smithi163.stdout:8885(181 mod 256): WRITE 0x572bc thru 0x652d8 (0xe01d bytes) 2023-07-14T18:17:18.867 INFO:tasks.workunit.client.0.smithi163.stdout:8886(182 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.867 INFO:tasks.workunit.client.0.smithi163.stdout:8887(183 mod 256): READ 0xeec00 thru 0xfcc8a (0xe08b bytes) 2023-07-14T18:17:18.867 INFO:tasks.workunit.client.0.smithi163.stdout:8888(184 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.868 INFO:tasks.workunit.client.0.smithi163.stdout:8889(185 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.868 INFO:tasks.workunit.client.0.smithi163.stdout:8890(186 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.868 INFO:tasks.workunit.client.0.smithi163.stdout:8891(187 mod 256): PUNCH 0xbdf55 thru 0xc117f (0x322b bytes) 2023-07-14T18:17:18.868 INFO:tasks.workunit.client.0.smithi163.stdout:8892(188 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.868 INFO:tasks.workunit.client.0.smithi163.stdout:8893(189 mod 256): TRUNCATE DOWN from 0xfdc5f to 0x95ffe 2023-07-14T18:17:18.868 INFO:tasks.workunit.client.0.smithi163.stdout:8894(190 mod 256): FALLOC 0xb0848 thru 0xb15f3 (0xdab bytes) PAST_EOF 2023-07-14T18:17:18.868 INFO:tasks.workunit.client.0.smithi163.stdout:8895(191 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.869 INFO:tasks.workunit.client.0.smithi163.stdout:8896(192 mod 256): TRUNCATE UP from 0x95ffe to 0xf677d 2023-07-14T18:17:18.869 INFO:tasks.workunit.client.0.smithi163.stdout:8897(193 mod 256): TRUNCATE DOWN from 0xf677d to 0x1cc73 ******WWWW 2023-07-14T18:17:18.869 INFO:tasks.workunit.client.0.smithi163.stdout:8898(194 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.869 INFO:tasks.workunit.client.0.smithi163.stdout:8899(195 mod 256): COPY 0xe093 thru 0x1a265 (0xc1d3 bytes) to 0x9bf13 thru 0xa80e5 2023-07-14T18:17:18.869 INFO:tasks.workunit.client.0.smithi163.stdout:8900(196 mod 256): READ 0x40084 thru 0x4d543 (0xd4c0 bytes) 2023-07-14T18:17:18.869 INFO:tasks.workunit.client.0.smithi163.stdout:8901(197 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.869 INFO:tasks.workunit.client.0.smithi163.stdout:8902(198 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.875 INFO:tasks.workunit.client.0.smithi163.stdout:8903(199 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.875 INFO:tasks.workunit.client.0.smithi163.stdout:8904(200 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.875 INFO:tasks.workunit.client.0.smithi163.stdout:8905(201 mod 256): MAPREAD 0x780e7 thru 0x7962a (0x1544 bytes) 2023-07-14T18:17:18.875 INFO:tasks.workunit.client.0.smithi163.stdout:8906(202 mod 256): TRUNCATE UP from 0xa80e6 to 0xce35f 2023-07-14T18:17:18.875 INFO:tasks.workunit.client.0.smithi163.stdout:8907(203 mod 256): WRITE 0xc58df thru 0xd1e93 (0xc5b5 bytes) EXTEND 2023-07-14T18:17:18.875 INFO:tasks.workunit.client.0.smithi163.stdout:8908(204 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.876 INFO:tasks.workunit.client.0.smithi163.stdout:8909(205 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.876 INFO:tasks.workunit.client.0.smithi163.stdout:8910(206 mod 256): WRITE 0x8b28e thru 0x96336 (0xb0a9 bytes) 2023-07-14T18:17:18.876 INFO:tasks.workunit.client.0.smithi163.stdout:8911(207 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.876 INFO:tasks.workunit.client.0.smithi163.stdout:8912(208 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.876 INFO:tasks.workunit.client.0.smithi163.stdout:8913(209 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.876 INFO:tasks.workunit.client.0.smithi163.stdout:8914(210 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.876 INFO:tasks.workunit.client.0.smithi163.stdout:8915(211 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.877 INFO:tasks.workunit.client.0.smithi163.stdout:8916(212 mod 256): WRITE 0x51d6a thru 0x5b2b6 (0x954d bytes) 2023-07-14T18:17:18.877 INFO:tasks.workunit.client.0.smithi163.stdout:8917(213 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.877 INFO:tasks.workunit.client.0.smithi163.stdout:8918(214 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.877 INFO:tasks.workunit.client.0.smithi163.stdout:8919(215 mod 256): MAPWRITE 0xc506a thru 0xd1e0e (0xcda5 bytes) 2023-07-14T18:17:18.877 INFO:tasks.workunit.client.0.smithi163.stdout:8920(216 mod 256): MAPREAD 0x2afed thru 0x37f2a (0xcf3e bytes) 2023-07-14T18:17:18.877 INFO:tasks.workunit.client.0.smithi163.stdout:8921(217 mod 256): MAPWRITE 0x89d6c thru 0x98f5c (0xf1f1 bytes) 2023-07-14T18:17:18.877 INFO:tasks.workunit.client.0.smithi163.stdout:8922(218 mod 256): COPY 0x8661d thru 0x8c83d (0x6221 bytes) to 0x348db thru 0x3aafb ******EEEE 2023-07-14T18:17:18.877 INFO:tasks.workunit.client.0.smithi163.stdout:8923(219 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.878 INFO:tasks.workunit.client.0.smithi163.stdout:8924(220 mod 256): PUNCH 0x6cb2f thru 0x6eccd (0x219f bytes) 2023-07-14T18:17:18.878 INFO:tasks.workunit.client.0.smithi163.stdout:8925(221 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.878 INFO:tasks.workunit.client.0.smithi163.stdout:8926(222 mod 256): READ 0x688f5 thru 0x6a0a9 (0x17b5 bytes) 2023-07-14T18:17:18.878 INFO:tasks.workunit.client.0.smithi163.stdout:8927(223 mod 256): MAPWRITE 0x646b9 thru 0x6b83d (0x7185 bytes) 2023-07-14T18:17:18.878 INFO:tasks.workunit.client.0.smithi163.stdout:8928(224 mod 256): COPY 0xc7b90 thru 0xd1e93 (0xa304 bytes) to 0x326af thru 0x3c9b2 ******EEEE 2023-07-14T18:17:18.878 INFO:tasks.workunit.client.0.smithi163.stdout:8929(225 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.878 INFO:tasks.workunit.client.0.smithi163.stdout:8930(226 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.879 INFO:tasks.workunit.client.0.smithi163.stdout:8931(227 mod 256): PUNCH 0x51ba thru 0x6be1 (0x1a28 bytes) 2023-07-14T18:17:18.879 INFO:tasks.workunit.client.0.smithi163.stdout:8932(228 mod 256): WRITE 0xbd87 thru 0x166fa (0xa974 bytes) 2023-07-14T18:17:18.879 INFO:tasks.workunit.client.0.smithi163.stdout:8933(229 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.879 INFO:tasks.workunit.client.0.smithi163.stdout:8934(230 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.879 INFO:tasks.workunit.client.0.smithi163.stdout:8935(231 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.879 INFO:tasks.workunit.client.0.smithi163.stdout:8936(232 mod 256): COPY 0x27540 thru 0x309ff (0x94c0 bytes) to 0xf6984 thru 0xffe43 2023-07-14T18:17:18.879 INFO:tasks.workunit.client.0.smithi163.stdout:8937(233 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.879 INFO:tasks.workunit.client.0.smithi163.stdout:8938(234 mod 256): TRUNCATE DOWN from 0xffe44 to 0xe5de1 2023-07-14T18:17:18.880 INFO:tasks.workunit.client.0.smithi163.stdout:8939(235 mod 256): WRITE 0x28d7d thru 0x3659f (0xd823 bytes) 2023-07-14T18:17:18.880 INFO:tasks.workunit.client.0.smithi163.stdout:8940(236 mod 256): MAPWRITE 0xa16f3 thru 0xadec6 (0xc7d4 bytes) 2023-07-14T18:17:18.880 INFO:tasks.workunit.client.0.smithi163.stdout:8941(237 mod 256): WRITE 0x9cbca thru 0xa448a (0x78c1 bytes) 2023-07-14T18:17:18.880 INFO:tasks.workunit.client.0.smithi163.stdout:8942(238 mod 256): PUNCH 0xdcca4 thru 0xe0ac8 (0x3e25 bytes) 2023-07-14T18:17:18.880 INFO:tasks.workunit.client.0.smithi163.stdout:8943(239 mod 256): PUNCH 0xab701 thru 0xb4bce (0x94ce bytes) 2023-07-14T18:17:18.880 INFO:tasks.workunit.client.0.smithi163.stdout:8944(240 mod 256): COPY 0x20b76 thru 0x24259 (0x36e4 bytes) to 0xa54e0 thru 0xa8bc3 2023-07-14T18:17:18.880 INFO:tasks.workunit.client.0.smithi163.stdout:8945(241 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.881 INFO:tasks.workunit.client.0.smithi163.stdout:8946(242 mod 256): COPY 0x6abf0 thru 0x6fd26 (0x5137 bytes) to 0x35da6 thru 0x3aedc ******EEEE 2023-07-14T18:17:18.881 INFO:tasks.workunit.client.0.smithi163.stdout:8947(243 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.881 INFO:tasks.workunit.client.0.smithi163.stdout:8948(244 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.881 INFO:tasks.workunit.client.0.smithi163.stdout:8949(245 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.881 INFO:tasks.workunit.client.0.smithi163.stdout:8950(246 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.881 INFO:tasks.workunit.client.0.smithi163.stdout:8951(247 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.881 INFO:tasks.workunit.client.0.smithi163.stdout:8952(248 mod 256): WRITE 0x9bf38 thru 0x9c736 (0x7ff bytes) 2023-07-14T18:17:18.881 INFO:tasks.workunit.client.0.smithi163.stdout:8953(249 mod 256): TRUNCATE DOWN from 0xe5de1 to 0x8e926 2023-07-14T18:17:18.882 INFO:tasks.workunit.client.0.smithi163.stdout:8954(250 mod 256): PUNCH 0x1c72d thru 0x2c355 (0xfc29 bytes) 2023-07-14T18:17:18.882 INFO:tasks.workunit.client.0.smithi163.stdout:8955(251 mod 256): MAPWRITE 0xac30a thru 0xbbb98 (0xf88f bytes) 2023-07-14T18:17:18.882 INFO:tasks.workunit.client.0.smithi163.stdout:8956(252 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.882 INFO:tasks.workunit.client.0.smithi163.stdout:8957(253 mod 256): MAPWRITE 0x64982 thru 0x6517c (0x7fb bytes) 2023-07-14T18:17:18.882 INFO:tasks.workunit.client.0.smithi163.stdout:8958(254 mod 256): TRUNCATE UP from 0xbbb99 to 0xd131c 2023-07-14T18:17:18.882 INFO:tasks.workunit.client.0.smithi163.stdout:8959(255 mod 256): COPY 0x76a92 thru 0x7b697 (0x4c06 bytes) to 0x9acea thru 0x9f8ef 2023-07-14T18:17:18.882 INFO:tasks.workunit.client.0.smithi163.stdout:8960( 0 mod 256): MAPREAD 0x140a thru 0x110aa (0xfca1 bytes) 2023-07-14T18:17:18.882 INFO:tasks.workunit.client.0.smithi163.stdout:8961( 1 mod 256): READ 0x747e7 thru 0x813d2 (0xcbec bytes) 2023-07-14T18:17:18.883 INFO:tasks.workunit.client.0.smithi163.stdout:8962( 2 mod 256): PUNCH 0x1eac4 thru 0x2c181 (0xd6be bytes) 2023-07-14T18:17:18.883 INFO:tasks.workunit.client.0.smithi163.stdout:8963( 3 mod 256): COPY 0x77a3a thru 0x835eb (0xbbb2 bytes) to 0x8956 thru 0x14507 2023-07-14T18:17:18.883 INFO:tasks.workunit.client.0.smithi163.stdout:8964( 4 mod 256): MAPWRITE 0x5c433 thru 0x6106f (0x4c3d bytes) 2023-07-14T18:17:18.883 INFO:tasks.workunit.client.0.smithi163.stdout:8965( 5 mod 256): COPY 0x50e19 thru 0x53ad7 (0x2cbf bytes) to 0x8b5c2 thru 0x8e280 2023-07-14T18:17:18.883 INFO:tasks.workunit.client.0.smithi163.stdout:8966( 6 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.883 INFO:tasks.workunit.client.0.smithi163.stdout:8967( 7 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.883 INFO:tasks.workunit.client.0.smithi163.stdout:8968( 8 mod 256): FALLOC 0x7e26a thru 0x865af (0x8345 bytes) INTERIOR 2023-07-14T18:17:18.883 INFO:tasks.workunit.client.0.smithi163.stdout:8969( 9 mod 256): MAPREAD 0xd0e54 thru 0xd131b (0x4c8 bytes) 2023-07-14T18:17:18.884 INFO:tasks.workunit.client.0.smithi163.stdout:8970( 10 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.884 INFO:tasks.workunit.client.0.smithi163.stdout:8971( 11 mod 256): WRITE 0xc7337 thru 0xd1a24 (0xa6ee bytes) EXTEND 2023-07-14T18:17:18.884 INFO:tasks.workunit.client.0.smithi163.stdout:8972( 12 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.884 INFO:tasks.workunit.client.0.smithi163.stdout:8973( 13 mod 256): COPY 0x36f37 thru 0x404db (0x95a5 bytes) to 0x587fe thru 0x61da2 EEEE****** 2023-07-14T18:17:18.884 INFO:tasks.workunit.client.0.smithi163.stdout:8974( 14 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.884 INFO:tasks.workunit.client.0.smithi163.stdout:8975( 15 mod 256): PUNCH 0xaca00 thru 0xb35e5 (0x6be6 bytes) 2023-07-14T18:17:18.884 INFO:tasks.workunit.client.0.smithi163.stdout:8976( 16 mod 256): WRITE 0x8a3f thru 0x17422 (0xe9e4 bytes) 2023-07-14T18:17:18.885 INFO:tasks.workunit.client.0.smithi163.stdout:8977( 17 mod 256): MAPWRITE 0xaa61a thru 0xb157d (0x6f64 bytes) 2023-07-14T18:17:18.885 INFO:tasks.workunit.client.0.smithi163.stdout:8978( 18 mod 256): TRUNCATE DOWN from 0xd1a25 to 0xb8c6d 2023-07-14T18:17:18.885 INFO:tasks.workunit.client.0.smithi163.stdout:8979( 19 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.885 INFO:tasks.workunit.client.0.smithi163.stdout:8980( 20 mod 256): COPY 0x60697 thru 0x67045 (0x69af bytes) to 0xb4f86 thru 0xbb934 2023-07-14T18:17:18.885 INFO:tasks.workunit.client.0.smithi163.stdout:8981( 21 mod 256): MAPWRITE 0x5dd0 thru 0x9667 (0x3898 bytes) 2023-07-14T18:17:18.885 INFO:tasks.workunit.client.0.smithi163.stdout:8982( 22 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.885 INFO:tasks.workunit.client.0.smithi163.stdout:8983( 23 mod 256): TRUNCATE DOWN from 0xbb935 to 0x98ca8 2023-07-14T18:17:18.885 INFO:tasks.workunit.client.0.smithi163.stdout:8984( 24 mod 256): READ 0x439bd thru 0x5352b (0xfb6f bytes) 2023-07-14T18:17:18.886 INFO:tasks.workunit.client.0.smithi163.stdout:8985( 25 mod 256): MAPWRITE 0xd0cf6 thru 0xdc9e4 (0xbcef bytes) 2023-07-14T18:17:18.886 INFO:tasks.workunit.client.0.smithi163.stdout:8986( 26 mod 256): COPY 0xaf13d thru 0xb6686 (0x754a bytes) to 0x4e790 thru 0x55cd9 2023-07-14T18:17:18.886 INFO:tasks.workunit.client.0.smithi163.stdout:8987( 27 mod 256): TRUNCATE DOWN from 0xdc9e5 to 0xd8143 2023-07-14T18:17:18.886 INFO:tasks.workunit.client.0.smithi163.stdout:8988( 28 mod 256): COPY 0x49903 thru 0x4cabd (0x31bb bytes) to 0x5cc27 thru 0x5fde1 2023-07-14T18:17:18.886 INFO:tasks.workunit.client.0.smithi163.stdout:8989( 29 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.886 INFO:tasks.workunit.client.0.smithi163.stdout:8990( 30 mod 256): WRITE 0x61f43 thru 0x6d46e (0xb52c bytes) 2023-07-14T18:17:18.886 INFO:tasks.workunit.client.0.smithi163.stdout:8991( 31 mod 256): FALLOC 0xbbb25 thru 0xc73ae (0xb889 bytes) INTERIOR 2023-07-14T18:17:18.886 INFO:tasks.workunit.client.0.smithi163.stdout:8992( 32 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.887 INFO:tasks.workunit.client.0.smithi163.stdout:8993( 33 mod 256): MAPWRITE 0xcaa2 thru 0xda9b (0xffa bytes) 2023-07-14T18:17:18.887 INFO:tasks.workunit.client.0.smithi163.stdout:8994( 34 mod 256): MAPREAD 0x9ad01 thru 0xa3a1b (0x8d1b bytes) 2023-07-14T18:17:18.887 INFO:tasks.workunit.client.0.smithi163.stdout:8995( 35 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.887 INFO:tasks.workunit.client.0.smithi163.stdout:8996( 36 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.887 INFO:tasks.workunit.client.0.smithi163.stdout:8997( 37 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.887 INFO:tasks.workunit.client.0.smithi163.stdout:8998( 38 mod 256): READ 0x5b27f thru 0x5dd19 (0x2a9b bytes) 2023-07-14T18:17:18.887 INFO:tasks.workunit.client.0.smithi163.stdout:8999( 39 mod 256): READ 0xcaaf3 thru 0xcc106 (0x1614 bytes) 2023-07-14T18:17:18.887 INFO:tasks.workunit.client.0.smithi163.stdout:9000( 40 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.888 INFO:tasks.workunit.client.0.smithi163.stdout:9001( 41 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.888 INFO:tasks.workunit.client.0.smithi163.stdout:9002( 42 mod 256): TRUNCATE DOWN from 0xd8143 to 0xd6f68 2023-07-14T18:17:18.888 INFO:tasks.workunit.client.0.smithi163.stdout:9003( 43 mod 256): MAPREAD 0x21892 thru 0x271a6 (0x5915 bytes) 2023-07-14T18:17:18.888 INFO:tasks.workunit.client.0.smithi163.stdout:9004( 44 mod 256): TRUNCATE DOWN from 0xd6f68 to 0xf80a ******WWWW 2023-07-14T18:17:18.888 INFO:tasks.workunit.client.0.smithi163.stdout:9005( 45 mod 256): TRUNCATE UP from 0xf80a to 0x61ee5 ******WWWW 2023-07-14T18:17:18.888 INFO:tasks.workunit.client.0.smithi163.stdout:9006( 46 mod 256): MAPREAD 0x1fe7b thru 0x2243e (0x25c4 bytes) 2023-07-14T18:17:18.888 INFO:tasks.workunit.client.0.smithi163.stdout:9007( 47 mod 256): PUNCH 0x394f1 thru 0x3af67 (0x1a77 bytes) 2023-07-14T18:17:18.888 INFO:tasks.workunit.client.0.smithi163.stdout:9008( 48 mod 256): PUNCH 0x3406e thru 0x36703 (0x2696 bytes) 2023-07-14T18:17:18.889 INFO:tasks.workunit.client.0.smithi163.stdout:9009( 49 mod 256): WRITE 0xfdb23 thru 0xfe595 (0xa73 bytes) HOLE 2023-07-14T18:17:18.889 INFO:tasks.workunit.client.0.smithi163.stdout:9010( 50 mod 256): MAPWRITE 0x4847b thru 0x4b4f4 (0x307a bytes) 2023-07-14T18:17:18.889 INFO:tasks.workunit.client.0.smithi163.stdout:9011( 51 mod 256): PUNCH 0x454a4 thru 0x543bc (0xef19 bytes) 2023-07-14T18:17:18.889 INFO:tasks.workunit.client.0.smithi163.stdout:9012( 52 mod 256): MAPWRITE 0x62cdf thru 0x6e86d (0xbb8f bytes) 2023-07-14T18:17:18.889 INFO:tasks.workunit.client.0.smithi163.stdout:9013( 53 mod 256): COPY 0xd4ec6 thru 0xd8cea (0x3e25 bytes) to 0x73075 thru 0x76e99 2023-07-14T18:17:18.889 INFO:tasks.workunit.client.0.smithi163.stdout:9014( 54 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.889 INFO:tasks.workunit.client.0.smithi163.stdout:9015( 55 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.889 INFO:tasks.workunit.client.0.smithi163.stdout:9016( 56 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.890 INFO:tasks.workunit.client.0.smithi163.stdout:9017( 57 mod 256): TRUNCATE DOWN from 0xfe596 to 0x5631f 2023-07-14T18:17:18.890 INFO:tasks.workunit.client.0.smithi163.stdout:9018( 58 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.890 INFO:tasks.workunit.client.0.smithi163.stdout:9019( 59 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.890 INFO:tasks.workunit.client.0.smithi163.stdout:9020( 60 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.890 INFO:tasks.workunit.client.0.smithi163.stdout:9021( 61 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.890 INFO:tasks.workunit.client.0.smithi163.stdout:9022( 62 mod 256): READ 0x1a12f thru 0x20eba (0x6d8c bytes) 2023-07-14T18:17:18.890 INFO:tasks.workunit.client.0.smithi163.stdout:9023( 63 mod 256): FALLOC 0x73934 thru 0x77bef (0x42bb bytes) PAST_EOF 2023-07-14T18:17:18.890 INFO:tasks.workunit.client.0.smithi163.stdout:9024( 64 mod 256): MAPWRITE 0xf827a thru 0xfffff (0x7d86 bytes) 2023-07-14T18:17:18.891 INFO:tasks.workunit.client.0.smithi163.stdout:9025( 65 mod 256): COPY 0x72f32 thru 0x7ceeb (0x9fba bytes) to 0xc65f thru 0x16618 2023-07-14T18:17:18.891 INFO:tasks.workunit.client.0.smithi163.stdout:9026( 66 mod 256): WRITE 0x6ad93 thru 0x725f9 (0x7867 bytes) 2023-07-14T18:17:18.891 INFO:tasks.workunit.client.0.smithi163.stdout:9027( 67 mod 256): MAPREAD 0xaaa1b thru 0xb29f9 (0x7fdf bytes) 2023-07-14T18:17:18.891 INFO:tasks.workunit.client.0.smithi163.stdout:9028( 68 mod 256): FALLOC 0x5eafe thru 0x63d03 (0x5205 bytes) INTERIOR 2023-07-14T18:17:18.891 INFO:tasks.workunit.client.0.smithi163.stdout:9029( 69 mod 256): MAPREAD 0xcb966 thru 0xd4ec2 (0x955d bytes) 2023-07-14T18:17:18.891 INFO:tasks.workunit.client.0.smithi163.stdout:9030( 70 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.891 INFO:tasks.workunit.client.0.smithi163.stdout:9031( 71 mod 256): FALLOC 0xec845 thru 0xf9a1d (0xd1d8 bytes) INTERIOR 2023-07-14T18:17:18.891 INFO:tasks.workunit.client.0.smithi163.stdout:9032( 72 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.892 INFO:tasks.workunit.client.0.smithi163.stdout:9033( 73 mod 256): PUNCH 0xa6f82 thru 0xaa45c (0x34db bytes) 2023-07-14T18:17:18.892 INFO:tasks.workunit.client.0.smithi163.stdout:9034( 74 mod 256): TRUNCATE DOWN from 0x100000 to 0xbfb24 2023-07-14T18:17:18.892 INFO:tasks.workunit.client.0.smithi163.stdout:9035( 75 mod 256): READ 0x89537 thru 0x99242 (0xfd0c bytes) 2023-07-14T18:17:18.892 INFO:tasks.workunit.client.0.smithi163.stdout:9036( 76 mod 256): WRITE 0xfd4c0 thru 0xffd15 (0x2856 bytes) HOLE 2023-07-14T18:17:18.892 INFO:tasks.workunit.client.0.smithi163.stdout:9037( 77 mod 256): PUNCH 0x2fce thru 0xb088 (0x80bb bytes) 2023-07-14T18:17:18.892 INFO:tasks.workunit.client.0.smithi163.stdout:9038( 78 mod 256): READ 0x82201 thru 0x8d4cb (0xb2cb bytes) 2023-07-14T18:17:18.892 INFO:tasks.workunit.client.0.smithi163.stdout:9039( 79 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.892 INFO:tasks.workunit.client.0.smithi163.stdout:9040( 80 mod 256): FALLOC 0x4d13d thru 0x586d4 (0xb597 bytes) INTERIOR 2023-07-14T18:17:18.893 INFO:tasks.workunit.client.0.smithi163.stdout:9041( 81 mod 256): COPY 0xdf1a9 thru 0xdf307 (0x15f bytes) to 0x754de thru 0x7563c 2023-07-14T18:17:18.893 INFO:tasks.workunit.client.0.smithi163.stdout:9042( 82 mod 256): COPY 0xaefef thru 0xbec20 (0xfc32 bytes) to 0x9b1e5 thru 0xaae16 2023-07-14T18:17:18.893 INFO:tasks.workunit.client.0.smithi163.stdout:9043( 83 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.893 INFO:tasks.workunit.client.0.smithi163.stdout:9044( 84 mod 256): TRUNCATE DOWN from 0xffd16 to 0xb20ef 2023-07-14T18:17:18.893 INFO:tasks.workunit.client.0.smithi163.stdout:9045( 85 mod 256): FALLOC 0x791bf thru 0x7c9fe (0x383f bytes) INTERIOR 2023-07-14T18:17:18.893 INFO:tasks.workunit.client.0.smithi163.stdout:9046( 86 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.893 INFO:tasks.workunit.client.0.smithi163.stdout:9047( 87 mod 256): WRITE 0xe64a8 thru 0xe8557 (0x20b0 bytes) HOLE 2023-07-14T18:17:18.893 INFO:tasks.workunit.client.0.smithi163.stdout:9048( 88 mod 256): MAPWRITE 0xf9fcd thru 0xfffff (0x6033 bytes) 2023-07-14T18:17:18.894 INFO:tasks.workunit.client.0.smithi163.stdout:9049( 89 mod 256): MAPREAD 0x4171c thru 0x4bdd7 (0xa6bc bytes) 2023-07-14T18:17:18.894 INFO:tasks.workunit.client.0.smithi163.stdout:9050( 90 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.894 INFO:tasks.workunit.client.0.smithi163.stdout:9051( 91 mod 256): COPY 0xc0ed thru 0xd255 (0x1169 bytes) to 0x7a42f thru 0x7b597 2023-07-14T18:17:18.894 INFO:tasks.workunit.client.0.smithi163.stdout:9052( 92 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.894 INFO:tasks.workunit.client.0.smithi163.stdout:9053( 93 mod 256): WRITE 0x925c9 thru 0x943fe (0x1e36 bytes) 2023-07-14T18:17:18.894 INFO:tasks.workunit.client.0.smithi163.stdout:9054( 94 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.894 INFO:tasks.workunit.client.0.smithi163.stdout:9055( 95 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.894 INFO:tasks.workunit.client.0.smithi163.stdout:9056( 96 mod 256): READ 0x9394a thru 0x9a147 (0x67fe bytes) 2023-07-14T18:17:18.895 INFO:tasks.workunit.client.0.smithi163.stdout:9057( 97 mod 256): READ 0x64d34 thru 0x6dd58 (0x9025 bytes) 2023-07-14T18:17:18.895 INFO:tasks.workunit.client.0.smithi163.stdout:9058( 98 mod 256): TRUNCATE DOWN from 0x100000 to 0xd4b34 2023-07-14T18:17:18.895 INFO:tasks.workunit.client.0.smithi163.stdout:9059( 99 mod 256): PUNCH 0xced2b thru 0xd4b33 (0x5e09 bytes) 2023-07-14T18:17:18.895 INFO:tasks.workunit.client.0.smithi163.stdout:9060(100 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.895 INFO:tasks.workunit.client.0.smithi163.stdout:9061(101 mod 256): WRITE 0x6cac0 thru 0x7051c (0x3a5d bytes) 2023-07-14T18:17:18.895 INFO:tasks.workunit.client.0.smithi163.stdout:9062(102 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.895 INFO:tasks.workunit.client.0.smithi163.stdout:9063(103 mod 256): FALLOC 0xdeb92 thru 0xe96cf (0xab3d bytes) PAST_EOF 2023-07-14T18:17:18.895 INFO:tasks.workunit.client.0.smithi163.stdout:9064(104 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.896 INFO:tasks.workunit.client.0.smithi163.stdout:9065(105 mod 256): COPY 0x24464 thru 0x2e8ba (0xa457 bytes) to 0x931e8 thru 0x9d63e 2023-07-14T18:17:18.896 INFO:tasks.workunit.client.0.smithi163.stdout:9066(106 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.896 INFO:tasks.workunit.client.0.smithi163.stdout:9067(107 mod 256): READ 0x2fbf3 thru 0x36114 (0x6522 bytes) 2023-07-14T18:17:18.896 INFO:tasks.workunit.client.0.smithi163.stdout:9068(108 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.896 INFO:tasks.workunit.client.0.smithi163.stdout:9069(109 mod 256): WRITE 0xfe6f6 thru 0xfffff (0x190a bytes) HOLE 2023-07-14T18:17:18.896 INFO:tasks.workunit.client.0.smithi163.stdout:9070(110 mod 256): TRUNCATE DOWN from 0x100000 to 0x55828 2023-07-14T18:17:18.896 INFO:tasks.workunit.client.0.smithi163.stdout:9071(111 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.896 INFO:tasks.workunit.client.0.smithi163.stdout:9072(112 mod 256): PUNCH 0x4c38d thru 0x4e64c (0x22c0 bytes) 2023-07-14T18:17:18.897 INFO:tasks.workunit.client.0.smithi163.stdout:9073(113 mod 256): READ 0x43986 thru 0x48695 (0x4d10 bytes) 2023-07-14T18:17:18.897 INFO:tasks.workunit.client.0.smithi163.stdout:9074(114 mod 256): COPY 0x41d4a thru 0x47c12 (0x5ec9 bytes) to 0x79a8 thru 0xd870 2023-07-14T18:17:18.897 INFO:tasks.workunit.client.0.smithi163.stdout:9075(115 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.897 INFO:tasks.workunit.client.0.smithi163.stdout:9076(116 mod 256): PUNCH 0x287a9 thru 0x375c0 (0xee18 bytes) 2023-07-14T18:17:18.897 INFO:tasks.workunit.client.0.smithi163.stdout:9077(117 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.897 INFO:tasks.workunit.client.0.smithi163.stdout:9078(118 mod 256): READ 0x282c thru 0xdc96 (0xb46b bytes) 2023-07-14T18:17:18.897 INFO:tasks.workunit.client.0.smithi163.stdout:9079(119 mod 256): READ 0xd7a1 thru 0xebb4 (0x1414 bytes) 2023-07-14T18:17:18.897 INFO:tasks.workunit.client.0.smithi163.stdout:9080(120 mod 256): MAPWRITE 0x10faf thru 0x13f96 (0x2fe8 bytes) 2023-07-14T18:17:18.898 INFO:tasks.workunit.client.0.smithi163.stdout:9081(121 mod 256): READ 0x7767 thru 0xafa2 (0x383c bytes) 2023-07-14T18:17:18.898 INFO:tasks.workunit.client.0.smithi163.stdout:9082(122 mod 256): MAPWRITE 0x7b0f8 thru 0x82bf6 (0x7aff bytes) 2023-07-14T18:17:18.898 INFO:tasks.workunit.client.0.smithi163.stdout:9083(123 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.898 INFO:tasks.workunit.client.0.smithi163.stdout:9084(124 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.898 INFO:tasks.workunit.client.0.smithi163.stdout:9085(125 mod 256): TRUNCATE UP from 0x82bf7 to 0xd5c94 2023-07-14T18:17:18.898 INFO:tasks.workunit.client.0.smithi163.stdout:9086(126 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.898 INFO:tasks.workunit.client.0.smithi163.stdout:9087(127 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.898 INFO:tasks.workunit.client.0.smithi163.stdout:9088(128 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.899 INFO:tasks.workunit.client.0.smithi163.stdout:9089(129 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.899 INFO:tasks.workunit.client.0.smithi163.stdout:9090(130 mod 256): WRITE 0xc5b05 thru 0xccc69 (0x7165 bytes) 2023-07-14T18:17:18.899 INFO:tasks.workunit.client.0.smithi163.stdout:9091(131 mod 256): MAPWRITE 0xb0cc3 thru 0xb5361 (0x469f bytes) 2023-07-14T18:17:18.899 INFO:tasks.workunit.client.0.smithi163.stdout:9092(132 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.899 INFO:tasks.workunit.client.0.smithi163.stdout:9093(133 mod 256): PUNCH 0x7b309 thru 0x891a9 (0xdea1 bytes) 2023-07-14T18:17:18.899 INFO:tasks.workunit.client.0.smithi163.stdout:9094(134 mod 256): READ 0xa9afc thru 0xaf196 (0x569b bytes) 2023-07-14T18:17:18.899 INFO:tasks.workunit.client.0.smithi163.stdout:9095(135 mod 256): WRITE 0xf4b06 thru 0xfa3b3 (0x58ae bytes) HOLE 2023-07-14T18:17:18.899 INFO:tasks.workunit.client.0.smithi163.stdout:9096(136 mod 256): MAPREAD 0xf0931 thru 0xfa3b3 (0x9a83 bytes) 2023-07-14T18:17:18.900 INFO:tasks.workunit.client.0.smithi163.stdout:9097(137 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.900 INFO:tasks.workunit.client.0.smithi163.stdout:9098(138 mod 256): TRUNCATE DOWN from 0xfa3b4 to 0xf53ee 2023-07-14T18:17:18.900 INFO:tasks.workunit.client.0.smithi163.stdout:9099(139 mod 256): WRITE 0x2779a thru 0x2d8d0 (0x6137 bytes) 2023-07-14T18:17:18.900 INFO:tasks.workunit.client.0.smithi163.stdout:9100(140 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.900 INFO:tasks.workunit.client.0.smithi163.stdout:9101(141 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.900 INFO:tasks.workunit.client.0.smithi163.stdout:9102(142 mod 256): TRUNCATE DOWN from 0xf53ee to 0x297fa ******WWWW 2023-07-14T18:17:18.900 INFO:tasks.workunit.client.0.smithi163.stdout:9103(143 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.901 INFO:tasks.workunit.client.0.smithi163.stdout:9104(144 mod 256): MAPREAD 0x1ede4 thru 0x297f9 (0xaa16 bytes) 2023-07-14T18:17:18.901 INFO:tasks.workunit.client.0.smithi163.stdout:9105(145 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.901 INFO:tasks.workunit.client.0.smithi163.stdout:9106(146 mod 256): MAPWRITE 0x62c24 thru 0x69277 (0x6654 bytes) 2023-07-14T18:17:18.901 INFO:tasks.workunit.client.0.smithi163.stdout:9107(147 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.901 INFO:tasks.workunit.client.0.smithi163.stdout:9108(148 mod 256): PUNCH 0x42435 thru 0x43c8d (0x1859 bytes) 2023-07-14T18:17:18.901 INFO:tasks.workunit.client.0.smithi163.stdout:9109(149 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.901 INFO:tasks.workunit.client.0.smithi163.stdout:9110(150 mod 256): WRITE 0x1a8ef thru 0x29d7f (0xf491 bytes) 2023-07-14T18:17:18.901 INFO:tasks.workunit.client.0.smithi163.stdout:9111(151 mod 256): MAPREAD 0x61545 thru 0x69277 (0x7d33 bytes) 2023-07-14T18:17:18.902 INFO:tasks.workunit.client.0.smithi163.stdout:9112(152 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.902 INFO:tasks.workunit.client.0.smithi163.stdout:9113(153 mod 256): WRITE 0x917d7 thru 0x96cdf (0x5509 bytes) HOLE 2023-07-14T18:17:18.902 INFO:tasks.workunit.client.0.smithi163.stdout:9114(154 mod 256): FALLOC 0x4224a thru 0x4471e (0x24d4 bytes) INTERIOR 2023-07-14T18:17:18.902 INFO:tasks.workunit.client.0.smithi163.stdout:9115(155 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.902 INFO:tasks.workunit.client.0.smithi163.stdout:9116(156 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.902 INFO:tasks.workunit.client.0.smithi163.stdout:9117(157 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.902 INFO:tasks.workunit.client.0.smithi163.stdout:9118(158 mod 256): FALLOC 0xfa999 thru 0xff88f (0x4ef6 bytes) EXTENDING 2023-07-14T18:17:18.902 INFO:tasks.workunit.client.0.smithi163.stdout:9119(159 mod 256): PUNCH 0x11b86 thru 0x2021e (0xe699 bytes) 2023-07-14T18:17:18.903 INFO:tasks.workunit.client.0.smithi163.stdout:9120(160 mod 256): FALLOC 0xca676 thru 0xcd44b (0x2dd5 bytes) INTERIOR 2023-07-14T18:17:18.903 INFO:tasks.workunit.client.0.smithi163.stdout:9121(161 mod 256): TRUNCATE DOWN from 0xff88f to 0xa5a69 2023-07-14T18:17:18.903 INFO:tasks.workunit.client.0.smithi163.stdout:9122(162 mod 256): MAPWRITE 0xfc586 thru 0xfffff (0x3a7a bytes) 2023-07-14T18:17:18.903 INFO:tasks.workunit.client.0.smithi163.stdout:9123(163 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.903 INFO:tasks.workunit.client.0.smithi163.stdout:9124(164 mod 256): COPY 0xbcc6e thru 0xc83d7 (0xb76a bytes) to 0xe7f5e thru 0xf36c7 2023-07-14T18:17:18.903 INFO:tasks.workunit.client.0.smithi163.stdout:9125(165 mod 256): COPY 0xeb8e3 thru 0xf4625 (0x8d43 bytes) to 0x5778f thru 0x604d1 2023-07-14T18:17:18.903 INFO:tasks.workunit.client.0.smithi163.stdout:9126(166 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.903 INFO:tasks.workunit.client.0.smithi163.stdout:9127(167 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.904 INFO:tasks.workunit.client.0.smithi163.stdout:9128(168 mod 256): COPY 0x8fecc thru 0x90371 (0x4a6 bytes) to 0x78ef6 thru 0x7939b 2023-07-14T18:17:18.904 INFO:tasks.workunit.client.0.smithi163.stdout:9129(169 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.904 INFO:tasks.workunit.client.0.smithi163.stdout:9130(170 mod 256): MAPWRITE 0xb2e5e thru 0xb5bb6 (0x2d59 bytes) 2023-07-14T18:17:18.904 INFO:tasks.workunit.client.0.smithi163.stdout:9131(171 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.904 INFO:tasks.workunit.client.0.smithi163.stdout:9132(172 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.904 INFO:tasks.workunit.client.0.smithi163.stdout:9133(173 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.904 INFO:tasks.workunit.client.0.smithi163.stdout:9134(174 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.904 INFO:tasks.workunit.client.0.smithi163.stdout:9135(175 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.905 INFO:tasks.workunit.client.0.smithi163.stdout:9136(176 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.905 INFO:tasks.workunit.client.0.smithi163.stdout:9137(177 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.905 INFO:tasks.workunit.client.0.smithi163.stdout:9138(178 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.905 INFO:tasks.workunit.client.0.smithi163.stdout:9139(179 mod 256): PUNCH 0x6a087 thru 0x77c42 (0xdbbc bytes) 2023-07-14T18:17:18.905 INFO:tasks.workunit.client.0.smithi163.stdout:9140(180 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.905 INFO:tasks.workunit.client.0.smithi163.stdout:9141(181 mod 256): WRITE 0xf7b84 thru 0xf8df1 (0x126e bytes) 2023-07-14T18:17:18.905 INFO:tasks.workunit.client.0.smithi163.stdout:9142(182 mod 256): READ 0xf0f10 thru 0xf6001 (0x50f2 bytes) 2023-07-14T18:17:18.905 INFO:tasks.workunit.client.0.smithi163.stdout:9143(183 mod 256): COPY 0x22bb4 thru 0x2ddbe (0xb20b bytes) to 0xdcd64 thru 0xe7f6e 2023-07-14T18:17:18.906 INFO:tasks.workunit.client.0.smithi163.stdout:9144(184 mod 256): PUNCH 0x80afd thru 0x8d968 (0xce6c bytes) 2023-07-14T18:17:18.906 INFO:tasks.workunit.client.0.smithi163.stdout:9145(185 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.906 INFO:tasks.workunit.client.0.smithi163.stdout:9146(186 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.906 INFO:tasks.workunit.client.0.smithi163.stdout:9147(187 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.906 INFO:tasks.workunit.client.0.smithi163.stdout:9148(188 mod 256): FALLOC 0x38954 thru 0x3f88f (0x6f3b bytes) INTERIOR 2023-07-14T18:17:18.906 INFO:tasks.workunit.client.0.smithi163.stdout:9149(189 mod 256): MAPREAD 0x8df70 thru 0x961d8 (0x8269 bytes) 2023-07-14T18:17:18.906 INFO:tasks.workunit.client.0.smithi163.stdout:9150(190 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.906 INFO:tasks.workunit.client.0.smithi163.stdout:9151(191 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.907 INFO:tasks.workunit.client.0.smithi163.stdout:9152(192 mod 256): FALLOC 0xe0890 thru 0xeaa9e (0xa20e bytes) INTERIOR 2023-07-14T18:17:18.907 INFO:tasks.workunit.client.0.smithi163.stdout:9153(193 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.907 INFO:tasks.workunit.client.0.smithi163.stdout:9154(194 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.907 INFO:tasks.workunit.client.0.smithi163.stdout:9155(195 mod 256): MAPWRITE 0x67280 thru 0x67f1d (0xc9e bytes) 2023-07-14T18:17:18.907 INFO:tasks.workunit.client.0.smithi163.stdout:9156(196 mod 256): MAPREAD 0x403b9 thru 0x407f4 (0x43c bytes) 2023-07-14T18:17:18.907 INFO:tasks.workunit.client.0.smithi163.stdout:9157(197 mod 256): WRITE 0x1b133 thru 0x1f447 (0x4315 bytes) 2023-07-14T18:17:18.907 INFO:tasks.workunit.client.0.smithi163.stdout:9158(198 mod 256): TRUNCATE DOWN from 0x100000 to 0xb3512 2023-07-14T18:17:18.907 INFO:tasks.workunit.client.0.smithi163.stdout:9159(199 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.908 INFO:tasks.workunit.client.0.smithi163.stdout:9160(200 mod 256): READ 0x1ff14 thru 0x2f532 (0xf61f bytes) 2023-07-14T18:17:18.908 INFO:tasks.workunit.client.0.smithi163.stdout:9161(201 mod 256): MAPREAD 0x99ac0 thru 0xa2fe1 (0x9522 bytes) 2023-07-14T18:17:18.908 INFO:tasks.workunit.client.0.smithi163.stdout:9162(202 mod 256): FALLOC 0x93c92 thru 0xa0df0 (0xd15e bytes) INTERIOR 2023-07-14T18:17:18.908 INFO:tasks.workunit.client.0.smithi163.stdout:9163(203 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.908 INFO:tasks.workunit.client.0.smithi163.stdout:9164(204 mod 256): PUNCH 0x620ff thru 0x6d2eb (0xb1ed bytes) 2023-07-14T18:17:18.908 INFO:tasks.workunit.client.0.smithi163.stdout:9165(205 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.908 INFO:tasks.workunit.client.0.smithi163.stdout:9166(206 mod 256): PUNCH 0xab6e6 thru 0xb3511 (0x7e2c bytes) 2023-07-14T18:17:18.909 INFO:tasks.workunit.client.0.smithi163.stdout:9167(207 mod 256): MAPWRITE 0xd800b thru 0xdc5d5 (0x45cb bytes) 2023-07-14T18:17:18.909 INFO:tasks.workunit.client.0.smithi163.stdout:9168(208 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.909 INFO:tasks.workunit.client.0.smithi163.stdout:9169(209 mod 256): TRUNCATE DOWN from 0xdc5d6 to 0x914db 2023-07-14T18:17:18.909 INFO:tasks.workunit.client.0.smithi163.stdout:9170(210 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.909 INFO:tasks.workunit.client.0.smithi163.stdout:9171(211 mod 256): FALLOC 0x67a6b thru 0x6c5b6 (0x4b4b bytes) INTERIOR 2023-07-14T18:17:18.909 INFO:tasks.workunit.client.0.smithi163.stdout:9172(212 mod 256): MAPREAD 0x536e2 thru 0x5fcff (0xc61e bytes) 2023-07-14T18:17:18.909 INFO:tasks.workunit.client.0.smithi163.stdout:9173(213 mod 256): COPY 0x52f5e thru 0x60dca (0xde6d bytes) to 0x11aae thru 0x1f91a 2023-07-14T18:17:18.909 INFO:tasks.workunit.client.0.smithi163.stdout:9174(214 mod 256): TRUNCATE UP from 0x914db to 0x967d6 2023-07-14T18:17:18.910 INFO:tasks.workunit.client.0.smithi163.stdout:9175(215 mod 256): FALLOC 0xb6dd7 thru 0xbd76a (0x6993 bytes) EXTENDING 2023-07-14T18:17:18.910 INFO:tasks.workunit.client.0.smithi163.stdout:9176(216 mod 256): MAPREAD 0x3bb7a thru 0x3cb0b (0xf92 bytes) 2023-07-14T18:17:18.910 INFO:tasks.workunit.client.0.smithi163.stdout:9177(217 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.910 INFO:tasks.workunit.client.0.smithi163.stdout:9178(218 mod 256): PUNCH 0xa10d7 thru 0xaf439 (0xe363 bytes) 2023-07-14T18:17:18.910 INFO:tasks.workunit.client.0.smithi163.stdout:9179(219 mod 256): FALLOC 0x35cb7 thru 0x3be7e (0x61c7 bytes) INTERIOR ******FFFF 2023-07-14T18:17:18.910 INFO:tasks.workunit.client.0.smithi163.stdout:9180(220 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.910 INFO:tasks.workunit.client.0.smithi163.stdout:9181(221 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.910 INFO:tasks.workunit.client.0.smithi163.stdout:9182(222 mod 256): COPY 0xafddd thru 0xb9e96 (0xa0ba bytes) to 0xfc76 thru 0x19d2f 2023-07-14T18:17:18.911 INFO:tasks.workunit.client.0.smithi163.stdout:9183(223 mod 256): TRUNCATE UP from 0xbd76a to 0xf5ed6 2023-07-14T18:17:18.911 INFO:tasks.workunit.client.0.smithi163.stdout:9184(224 mod 256): WRITE 0xf2aa8 thru 0xf3e6e (0x13c7 bytes) 2023-07-14T18:17:18.911 INFO:tasks.workunit.client.0.smithi163.stdout:9185(225 mod 256): MAPWRITE 0x85485 thru 0x8b933 (0x64af bytes) 2023-07-14T18:17:18.911 INFO:tasks.workunit.client.0.smithi163.stdout:9186(226 mod 256): PUNCH 0xbaa83 thru 0xc9b9e (0xf11c bytes) 2023-07-14T18:17:18.911 INFO:tasks.workunit.client.0.smithi163.stdout:9187(227 mod 256): TRUNCATE DOWN from 0xf5ed6 to 0xe4c4d 2023-07-14T18:17:18.911 INFO:tasks.workunit.client.0.smithi163.stdout:9188(228 mod 256): READ 0x1b683 thru 0x2270e (0x708c bytes) 2023-07-14T18:17:18.911 INFO:tasks.workunit.client.0.smithi163.stdout:9189(229 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.911 INFO:tasks.workunit.client.0.smithi163.stdout:9190(230 mod 256): MAPWRITE 0x6e3e7 thru 0x7d375 (0xef8f bytes) 2023-07-14T18:17:18.912 INFO:tasks.workunit.client.0.smithi163.stdout:9191(231 mod 256): FALLOC 0xbb9d3 thru 0xc7635 (0xbc62 bytes) INTERIOR 2023-07-14T18:17:18.912 INFO:tasks.workunit.client.0.smithi163.stdout:9192(232 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.912 INFO:tasks.workunit.client.0.smithi163.stdout:9193(233 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.912 INFO:tasks.workunit.client.0.smithi163.stdout:9194(234 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.912 INFO:tasks.workunit.client.0.smithi163.stdout:9195(235 mod 256): READ 0xbb48f thru 0xbbf11 (0xa83 bytes) 2023-07-14T18:17:18.912 INFO:tasks.workunit.client.0.smithi163.stdout:9196(236 mod 256): COPY 0xdd7c2 thru 0xe4c4c (0x748b bytes) to 0x2ae5d thru 0x322e7 2023-07-14T18:17:18.912 INFO:tasks.workunit.client.0.smithi163.stdout:9197(237 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.912 INFO:tasks.workunit.client.0.smithi163.stdout:9198(238 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.913 INFO:tasks.workunit.client.0.smithi163.stdout:9199(239 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.913 INFO:tasks.workunit.client.0.smithi163.stdout:9200(240 mod 256): MAPWRITE 0x73d84 thru 0x7c131 (0x83ae bytes) 2023-07-14T18:17:18.913 INFO:tasks.workunit.client.0.smithi163.stdout:9201(241 mod 256): TRUNCATE DOWN from 0xe4c4d to 0xd595f 2023-07-14T18:17:18.913 INFO:tasks.workunit.client.0.smithi163.stdout:9202(242 mod 256): MAPWRITE 0x2b1cd thru 0x36e9c (0xbcd0 bytes) 2023-07-14T18:17:18.913 INFO:tasks.workunit.client.0.smithi163.stdout:9203(243 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.913 INFO:tasks.workunit.client.0.smithi163.stdout:9204(244 mod 256): WRITE 0x1b26a thru 0x1b4ce (0x265 bytes) 2023-07-14T18:17:18.913 INFO:tasks.workunit.client.0.smithi163.stdout:9205(245 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.913 INFO:tasks.workunit.client.0.smithi163.stdout:9206(246 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.914 INFO:tasks.workunit.client.0.smithi163.stdout:9207(247 mod 256): MAPWRITE 0x1616f thru 0x17c19 (0x1aab bytes) 2023-07-14T18:17:18.914 INFO:tasks.workunit.client.0.smithi163.stdout:9208(248 mod 256): READ 0xb7d5d thru 0xbf399 (0x763d bytes) 2023-07-14T18:17:18.914 INFO:tasks.workunit.client.0.smithi163.stdout:9209(249 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.914 INFO:tasks.workunit.client.0.smithi163.stdout:9210(250 mod 256): COPY 0xa32fd thru 0xb32d5 (0xffd9 bytes) to 0xd0b92 thru 0xe0b6a 2023-07-14T18:17:18.914 INFO:tasks.workunit.client.0.smithi163.stdout:9211(251 mod 256): COPY 0xca0f thru 0x1313c (0x672e bytes) to 0x84731 thru 0x8ae5e 2023-07-14T18:17:18.914 INFO:tasks.workunit.client.0.smithi163.stdout:9212(252 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.914 INFO:tasks.workunit.client.0.smithi163.stdout:9213(253 mod 256): COPY 0x129c0 thru 0x1a9a1 (0x7fe2 bytes) to 0xd6efe thru 0xdeedf 2023-07-14T18:17:18.914 INFO:tasks.workunit.client.0.smithi163.stdout:9214(254 mod 256): TRUNCATE UP from 0xe0b6b to 0xf4f7d 2023-07-14T18:17:18.915 INFO:tasks.workunit.client.0.smithi163.stdout:9215(255 mod 256): COPY 0x97aa3 thru 0xa6365 (0xe8c3 bytes) to 0x282fa thru 0x36bbc 2023-07-14T18:17:18.915 INFO:tasks.workunit.client.0.smithi163.stdout:9216( 0 mod 256): MAPREAD 0x1b37b thru 0x2325b (0x7ee1 bytes) 2023-07-14T18:17:18.915 INFO:tasks.workunit.client.0.smithi163.stdout:9217( 1 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.915 INFO:tasks.workunit.client.0.smithi163.stdout:9218( 2 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.915 INFO:tasks.workunit.client.0.smithi163.stdout:9219( 3 mod 256): MAPREAD 0xd9a71 thru 0xe66c7 (0xcc57 bytes) 2023-07-14T18:17:18.915 INFO:tasks.workunit.client.0.smithi163.stdout:9220( 4 mod 256): COPY 0x9d189 thru 0xa46cb (0x7543 bytes) to 0x3df2b thru 0x4546d 2023-07-14T18:17:18.915 INFO:tasks.workunit.client.0.smithi163.stdout:9221( 5 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.916 INFO:tasks.workunit.client.0.smithi163.stdout:9222( 6 mod 256): MAPWRITE 0xcf7b6 thru 0xd82f3 (0x8b3e bytes) 2023-07-14T18:17:18.916 INFO:tasks.workunit.client.0.smithi163.stdout:9223( 7 mod 256): MAPWRITE 0x4b860 thru 0x58a11 (0xd1b2 bytes) 2023-07-14T18:17:18.916 INFO:tasks.workunit.client.0.smithi163.stdout:9224( 8 mod 256): TRUNCATE DOWN from 0xf4f7d to 0xa3877 2023-07-14T18:17:18.916 INFO:tasks.workunit.client.0.smithi163.stdout:9225( 9 mod 256): TRUNCATE DOWN from 0xa3877 to 0x9f563 2023-07-14T18:17:18.916 INFO:tasks.workunit.client.0.smithi163.stdout:9226( 10 mod 256): MAPREAD 0x418c0 thru 0x4511b (0x385c bytes) 2023-07-14T18:17:18.916 INFO:tasks.workunit.client.0.smithi163.stdout:9227( 11 mod 256): MAPWRITE 0xc401a thru 0xd2369 (0xe350 bytes) 2023-07-14T18:17:18.916 INFO:tasks.workunit.client.0.smithi163.stdout:9228( 12 mod 256): FALLOC 0x4517e thru 0x534f0 (0xe372 bytes) INTERIOR 2023-07-14T18:17:18.916 INFO:tasks.workunit.client.0.smithi163.stdout:9229( 13 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.917 INFO:tasks.workunit.client.0.smithi163.stdout:9230( 14 mod 256): MAPWRITE 0x83553 thru 0x83a7b (0x529 bytes) 2023-07-14T18:17:18.917 INFO:tasks.workunit.client.0.smithi163.stdout:9231( 15 mod 256): MAPWRITE 0x5598 thru 0x14fd0 (0xfa39 bytes) 2023-07-14T18:17:18.917 INFO:tasks.workunit.client.0.smithi163.stdout:9232( 16 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.917 INFO:tasks.workunit.client.0.smithi163.stdout:9233( 17 mod 256): FALLOC 0x925de thru 0xa040c (0xde2e bytes) INTERIOR 2023-07-14T18:17:18.917 INFO:tasks.workunit.client.0.smithi163.stdout:9234( 18 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.917 INFO:tasks.workunit.client.0.smithi163.stdout:9235( 19 mod 256): TRUNCATE DOWN from 0xd236a to 0x40505 2023-07-14T18:17:18.917 INFO:tasks.workunit.client.0.smithi163.stdout:9236( 20 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.917 INFO:tasks.workunit.client.0.smithi163.stdout:9237( 21 mod 256): MAPWRITE 0x480a4 thru 0x4940a (0x1367 bytes) 2023-07-14T18:17:18.918 INFO:tasks.workunit.client.0.smithi163.stdout:9238( 22 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.918 INFO:tasks.workunit.client.0.smithi163.stdout:9239( 23 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.918 INFO:tasks.workunit.client.0.smithi163.stdout:9240( 24 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.918 INFO:tasks.workunit.client.0.smithi163.stdout:9241( 25 mod 256): READ 0x117ae thru 0x1b2d4 (0x9b27 bytes) 2023-07-14T18:17:18.918 INFO:tasks.workunit.client.0.smithi163.stdout:9242( 26 mod 256): WRITE 0xe8cdc thru 0xf892f (0xfc54 bytes) HOLE 2023-07-14T18:17:18.918 INFO:tasks.workunit.client.0.smithi163.stdout:9243( 27 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.918 INFO:tasks.workunit.client.0.smithi163.stdout:9244( 28 mod 256): MAPWRITE 0x1fe50 thru 0x2ee39 (0xefea bytes) 2023-07-14T18:17:18.918 INFO:tasks.workunit.client.0.smithi163.stdout:9245( 29 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.919 INFO:tasks.workunit.client.0.smithi163.stdout:9246( 30 mod 256): PUNCH 0xd59e1 thru 0xd8c7d (0x329d bytes) 2023-07-14T18:17:18.919 INFO:tasks.workunit.client.0.smithi163.stdout:9247( 31 mod 256): TRUNCATE DOWN from 0xf8930 to 0x5a724 2023-07-14T18:17:18.919 INFO:tasks.workunit.client.0.smithi163.stdout:9248( 32 mod 256): READ 0xe084 thru 0x1b0a6 (0xd023 bytes) 2023-07-14T18:17:18.919 INFO:tasks.workunit.client.0.smithi163.stdout:9249( 33 mod 256): READ 0x9a91 thru 0xfd40 (0x62b0 bytes) 2023-07-14T18:17:18.919 INFO:tasks.workunit.client.0.smithi163.stdout:9250( 34 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.919 INFO:tasks.workunit.client.0.smithi163.stdout:9251( 35 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.919 INFO:tasks.workunit.client.0.smithi163.stdout:9252( 36 mod 256): COPY 0x1508 thru 0x90dd (0x7bd6 bytes) to 0xdd0ad thru 0xe4c82 2023-07-14T18:17:18.919 INFO:tasks.workunit.client.0.smithi163.stdout:9253( 37 mod 256): READ 0x76c6 thru 0x13253 (0xbb8e bytes) 2023-07-14T18:17:18.920 INFO:tasks.workunit.client.0.smithi163.stdout:9254( 38 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.920 INFO:tasks.workunit.client.0.smithi163.stdout:9255( 39 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.920 INFO:tasks.workunit.client.0.smithi163.stdout:9256( 40 mod 256): TRUNCATE UP from 0xe4c83 to 0xf358d 2023-07-14T18:17:18.920 INFO:tasks.workunit.client.0.smithi163.stdout:9257( 41 mod 256): TRUNCATE DOWN from 0xf358d to 0x34fec ******WWWW 2023-07-14T18:17:18.920 INFO:tasks.workunit.client.0.smithi163.stdout:9258( 42 mod 256): MAPREAD 0x234ea thru 0x331dd (0xfcf4 bytes) 2023-07-14T18:17:18.920 INFO:tasks.workunit.client.0.smithi163.stdout:9259( 43 mod 256): WRITE 0xd2585 thru 0xe0f38 (0xe9b4 bytes) HOLE ***WWWW 2023-07-14T18:17:18.920 INFO:tasks.workunit.client.0.smithi163.stdout:9260( 44 mod 256): MAPWRITE 0xc5b11 thru 0xcf84b (0x9d3b bytes) 2023-07-14T18:17:18.921 INFO:tasks.workunit.client.0.smithi163.stdout:9261( 45 mod 256): READ 0x50f07 thru 0x54019 (0x3113 bytes) 2023-07-14T18:17:18.921 INFO:tasks.workunit.client.0.smithi163.stdout:9262( 46 mod 256): FALLOC 0x3270c thru 0x39dfe (0x76f2 bytes) INTERIOR ******FFFF 2023-07-14T18:17:18.921 INFO:tasks.workunit.client.0.smithi163.stdout:9263( 47 mod 256): TRUNCATE DOWN from 0xe0f39 to 0x39eb7 2023-07-14T18:17:18.921 INFO:tasks.workunit.client.0.smithi163.stdout:9264( 48 mod 256): WRITE 0x52a1f thru 0x6009f (0xd681 bytes) HOLE 2023-07-14T18:17:18.921 INFO:tasks.workunit.client.0.smithi163.stdout:9265( 49 mod 256): PUNCH 0x5407c thru 0x5868a (0x460f bytes) 2023-07-14T18:17:18.921 INFO:tasks.workunit.client.0.smithi163.stdout:9266( 50 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.921 INFO:tasks.workunit.client.0.smithi163.stdout:9267( 51 mod 256): MAPREAD 0x3350b thru 0x3ac8c (0x7782 bytes) ***RRRR*** 2023-07-14T18:17:18.921 INFO:tasks.workunit.client.0.smithi163.stdout:9268( 52 mod 256): COPY 0x3f23d thru 0x4f1a4 (0xff68 bytes) to 0x93261 thru 0xa31c8 2023-07-14T18:17:18.921 INFO:tasks.workunit.client.0.smithi163.stdout:9269( 53 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.922 INFO:tasks.workunit.client.0.smithi163.stdout:9270( 54 mod 256): COPY 0x670f3 thru 0x67f25 (0xe33 bytes) to 0xb19e9 thru 0xb281b 2023-07-14T18:17:18.922 INFO:tasks.workunit.client.0.smithi163.stdout:9271( 55 mod 256): WRITE 0x1c7d3 thru 0x1d952 (0x1180 bytes) 2023-07-14T18:17:18.922 INFO:tasks.workunit.client.0.smithi163.stdout:9272( 56 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.922 INFO:tasks.workunit.client.0.smithi163.stdout:9273( 57 mod 256): FALLOC 0xe46a thru 0x16ec2 (0x8a58 bytes) INTERIOR 2023-07-14T18:17:18.922 INFO:tasks.workunit.client.0.smithi163.stdout:9274( 58 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.922 INFO:tasks.workunit.client.0.smithi163.stdout:9275( 59 mod 256): FALLOC 0x27d89 thru 0x2a009 (0x2280 bytes) INTERIOR 2023-07-14T18:17:18.922 INFO:tasks.workunit.client.0.smithi163.stdout:9276( 60 mod 256): READ 0x99918 thru 0xa9154 (0xf83d bytes) 2023-07-14T18:17:18.922 INFO:tasks.workunit.client.0.smithi163.stdout:9277( 61 mod 256): MAPREAD 0x10424 thru 0x1b226 (0xae03 bytes) 2023-07-14T18:17:18.923 INFO:tasks.workunit.client.0.smithi163.stdout:9278( 62 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.923 INFO:tasks.workunit.client.0.smithi163.stdout:9279( 63 mod 256): PUNCH 0x47efd thru 0x48257 (0x35b bytes) 2023-07-14T18:17:18.923 INFO:tasks.workunit.client.0.smithi163.stdout:9280( 64 mod 256): WRITE 0x1ae2e thru 0x268ce (0xbaa1 bytes) 2023-07-14T18:17:18.923 INFO:tasks.workunit.client.0.smithi163.stdout:9281( 65 mod 256): COPY 0x90609 thru 0x954f5 (0x4eed bytes) to 0xbe50d thru 0xc33f9 2023-07-14T18:17:18.923 INFO:tasks.workunit.client.0.smithi163.stdout:9282( 66 mod 256): COPY 0x33655 thru 0x3e739 (0xb0e5 bytes) to 0x633a1 thru 0x6e485 EEEE****** 2023-07-14T18:17:18.923 INFO:tasks.workunit.client.0.smithi163.stdout:9283( 67 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.923 INFO:tasks.workunit.client.0.smithi163.stdout:9284( 68 mod 256): READ 0x31f38 thru 0x3b26c (0x9335 bytes) ***RRRR*** 2023-07-14T18:17:18.924 INFO:tasks.workunit.client.0.smithi163.stdout:9285( 69 mod 256): COPY 0x9aeb7 thru 0xaa71a (0xf864 bytes) to 0x3001d thru 0x3f880 ******EEEE 2023-07-14T18:17:18.924 INFO:tasks.workunit.client.0.smithi163.stdout:9286( 70 mod 256): MAPREAD 0x1573c thru 0x213e7 (0xbcac bytes) 2023-07-14T18:17:18.924 INFO:tasks.workunit.client.0.smithi163.stdout:9287( 71 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.924 INFO:tasks.workunit.client.0.smithi163.stdout:9288( 72 mod 256): READ 0xa4b53 thru 0xb343b (0xe8e9 bytes) 2023-07-14T18:17:18.924 INFO:tasks.workunit.client.0.smithi163.stdout:9289( 73 mod 256): MAPWRITE 0xcdb2 thru 0xe66c (0x18bb bytes) 2023-07-14T18:17:18.924 INFO:tasks.workunit.client.0.smithi163.stdout:9290( 74 mod 256): COPY 0x96256 thru 0xa07cc (0xa577 bytes) to 0xe0056 thru 0xea5cc 2023-07-14T18:17:18.924 INFO:tasks.workunit.client.0.smithi163.stdout:9291( 75 mod 256): FALLOC 0x575eb thru 0x66ad4 (0xf4e9 bytes) INTERIOR 2023-07-14T18:17:18.924 INFO:tasks.workunit.client.0.smithi163.stdout:9292( 76 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.925 INFO:tasks.workunit.client.0.smithi163.stdout:9293( 77 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.925 INFO:tasks.workunit.client.0.smithi163.stdout:9294( 78 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.925 INFO:tasks.workunit.client.0.smithi163.stdout:9295( 79 mod 256): READ 0x32870 thru 0x39b85 (0x7316 bytes) ***RRRR*** 2023-07-14T18:17:18.925 INFO:tasks.workunit.client.0.smithi163.stdout:9296( 80 mod 256): MAPWRITE 0x4af9e thru 0x4ed63 (0x3dc6 bytes) 2023-07-14T18:17:18.925 INFO:tasks.workunit.client.0.smithi163.stdout:9297( 81 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.925 INFO:tasks.workunit.client.0.smithi163.stdout:9298( 82 mod 256): MAPREAD 0xd4950 thru 0xdee5a (0xa50b bytes) 2023-07-14T18:17:18.925 INFO:tasks.workunit.client.0.smithi163.stdout:9299( 83 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.925 INFO:tasks.workunit.client.0.smithi163.stdout:9300( 84 mod 256): MAPREAD 0x7434b thru 0x7f56b (0xb221 bytes) 2023-07-14T18:17:18.926 INFO:tasks.workunit.client.0.smithi163.stdout:9301( 85 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.926 INFO:tasks.workunit.client.0.smithi163.stdout:9302( 86 mod 256): READ 0xb823c thru 0xbb9b0 (0x3775 bytes) 2023-07-14T18:17:18.926 INFO:tasks.workunit.client.0.smithi163.stdout:9303( 87 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.926 INFO:tasks.workunit.client.0.smithi163.stdout:9304( 88 mod 256): PUNCH 0x40bc8 thru 0x47bf3 (0x702c bytes) 2023-07-14T18:17:18.926 INFO:tasks.workunit.client.0.smithi163.stdout:9305( 89 mod 256): MAPWRITE 0x1c971 thru 0x222da (0x596a bytes) 2023-07-14T18:17:18.926 INFO:tasks.workunit.client.0.smithi163.stdout:9306( 90 mod 256): FALLOC 0xb75fe thru 0xc23b9 (0xadbb bytes) INTERIOR 2023-07-14T18:17:18.926 INFO:tasks.workunit.client.0.smithi163.stdout:9307( 91 mod 256): COPY 0xa9aea thru 0xb0e26 (0x733d bytes) to 0x79356 thru 0x80692 2023-07-14T18:17:18.926 INFO:tasks.workunit.client.0.smithi163.stdout:9308( 92 mod 256): MAPWRITE 0x9bd11 thru 0xa5403 (0x96f3 bytes) 2023-07-14T18:17:18.927 INFO:tasks.workunit.client.0.smithi163.stdout:9309( 93 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.927 INFO:tasks.workunit.client.0.smithi163.stdout:9310( 94 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.927 INFO:tasks.workunit.client.0.smithi163.stdout:9311( 95 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.927 INFO:tasks.workunit.client.0.smithi163.stdout:9312( 96 mod 256): READ 0xc76b5 thru 0xcac8d (0x35d9 bytes) 2023-07-14T18:17:18.927 INFO:tasks.workunit.client.0.smithi163.stdout:9313( 97 mod 256): TRUNCATE DOWN from 0xea5cd to 0x1bc6d ******WWWW 2023-07-14T18:17:18.927 INFO:tasks.workunit.client.0.smithi163.stdout:9314( 98 mod 256): PUNCH 0x16e63 thru 0x18f31 (0x20cf bytes) 2023-07-14T18:17:18.927 INFO:tasks.workunit.client.0.smithi163.stdout:9315( 99 mod 256): MAPREAD 0x70a9 thru 0x12b17 (0xba6f bytes) 2023-07-14T18:17:18.927 INFO:tasks.workunit.client.0.smithi163.stdout:9316(100 mod 256): TRUNCATE UP from 0x1bc6d to 0xdc02b ******WWWW 2023-07-14T18:17:18.928 INFO:tasks.workunit.client.0.smithi163.stdout:9317(101 mod 256): PUNCH 0x5794b thru 0x5c3ec (0x4aa2 bytes) 2023-07-14T18:17:18.928 INFO:tasks.workunit.client.0.smithi163.stdout:9318(102 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.928 INFO:tasks.workunit.client.0.smithi163.stdout:9319(103 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.928 INFO:tasks.workunit.client.0.smithi163.stdout:9320(104 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.928 INFO:tasks.workunit.client.0.smithi163.stdout:9321(105 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.928 INFO:tasks.workunit.client.0.smithi163.stdout:9322(106 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.928 INFO:tasks.workunit.client.0.smithi163.stdout:9323(107 mod 256): FALLOC 0x5b3c5 thru 0x5fcdb (0x4916 bytes) INTERIOR 2023-07-14T18:17:18.928 INFO:tasks.workunit.client.0.smithi163.stdout:9324(108 mod 256): MAPREAD 0x6dd9c thru 0x6f348 (0x15ad bytes) 2023-07-14T18:17:18.929 INFO:tasks.workunit.client.0.smithi163.stdout:9325(109 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.929 INFO:tasks.workunit.client.0.smithi163.stdout:9326(110 mod 256): MAPWRITE 0xd395d thru 0xd4283 (0x927 bytes) 2023-07-14T18:17:18.929 INFO:tasks.workunit.client.0.smithi163.stdout:9327(111 mod 256): WRITE 0x39e93 thru 0x4764b (0xd7b9 bytes) 2023-07-14T18:17:18.929 INFO:tasks.workunit.client.0.smithi163.stdout:9328(112 mod 256): WRITE 0x7a7a0 thru 0x832a4 (0x8b05 bytes) 2023-07-14T18:17:18.929 INFO:tasks.workunit.client.0.smithi163.stdout:9329(113 mod 256): MAPWRITE 0x7ea09 thru 0x83d7d (0x5375 bytes) 2023-07-14T18:17:18.929 INFO:tasks.workunit.client.0.smithi163.stdout:9330(114 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.929 INFO:tasks.workunit.client.0.smithi163.stdout:9331(115 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.929 INFO:tasks.workunit.client.0.smithi163.stdout:9332(116 mod 256): COPY 0xc1b5e thru 0xced47 (0xd1ea bytes) to 0x8527f thru 0x92468 2023-07-14T18:17:18.930 INFO:tasks.workunit.client.0.smithi163.stdout:9333(117 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.930 INFO:tasks.workunit.client.0.smithi163.stdout:9334(118 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.930 INFO:tasks.workunit.client.0.smithi163.stdout:9335(119 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.930 INFO:tasks.workunit.client.0.smithi163.stdout:9336(120 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.930 INFO:tasks.workunit.client.0.smithi163.stdout:9337(121 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.930 INFO:tasks.workunit.client.0.smithi163.stdout:9338(122 mod 256): MAPREAD 0x5302e thru 0x61263 (0xe236 bytes) 2023-07-14T18:17:18.930 INFO:tasks.workunit.client.0.smithi163.stdout:9339(123 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.930 INFO:tasks.workunit.client.0.smithi163.stdout:9340(124 mod 256): FALLOC 0x58ea9 thru 0x60934 (0x7a8b bytes) INTERIOR 2023-07-14T18:17:18.931 INFO:tasks.workunit.client.0.smithi163.stdout:9341(125 mod 256): FALLOC 0x830ae thru 0x8b53e (0x8490 bytes) INTERIOR 2023-07-14T18:17:18.931 INFO:tasks.workunit.client.0.smithi163.stdout:9342(126 mod 256): WRITE 0xf5f8a thru 0xf8c50 (0x2cc7 bytes) HOLE 2023-07-14T18:17:18.931 INFO:tasks.workunit.client.0.smithi163.stdout:9343(127 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.931 INFO:tasks.workunit.client.0.smithi163.stdout:9344(128 mod 256): COPY 0xc742c thru 0xcd0b5 (0x5c8a bytes) to 0xb2f0 thru 0x10f79 2023-07-14T18:17:18.931 INFO:tasks.workunit.client.0.smithi163.stdout:9345(129 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.931 INFO:tasks.workunit.client.0.smithi163.stdout:9346(130 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.931 INFO:tasks.workunit.client.0.smithi163.stdout:9347(131 mod 256): WRITE 0x6147a thru 0x67694 (0x621b bytes) 2023-07-14T18:17:18.931 INFO:tasks.workunit.client.0.smithi163.stdout:9348(132 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.932 INFO:tasks.workunit.client.0.smithi163.stdout:9349(133 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.932 INFO:tasks.workunit.client.0.smithi163.stdout:9350(134 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.932 INFO:tasks.workunit.client.0.smithi163.stdout:9351(135 mod 256): READ 0xa81c6 thru 0xa986c (0x16a7 bytes) 2023-07-14T18:17:18.932 INFO:tasks.workunit.client.0.smithi163.stdout:9352(136 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.932 INFO:tasks.workunit.client.0.smithi163.stdout:9353(137 mod 256): COPY 0xa3f21 thru 0xb2aa0 (0xeb80 bytes) to 0xbde9d thru 0xcca1c 2023-07-14T18:17:18.932 INFO:tasks.workunit.client.0.smithi163.stdout:9354(138 mod 256): MAPREAD 0x8d0c7 thru 0x98f69 (0xbea3 bytes) 2023-07-14T18:17:18.932 INFO:tasks.workunit.client.0.smithi163.stdout:9355(139 mod 256): MAPREAD 0xd3ef8 thru 0xdb198 (0x72a1 bytes) 2023-07-14T18:17:18.932 INFO:tasks.workunit.client.0.smithi163.stdout:9356(140 mod 256): TRUNCATE DOWN from 0xf8c51 to 0xed629 2023-07-14T18:17:18.933 INFO:tasks.workunit.client.0.smithi163.stdout:9357(141 mod 256): COPY 0xcbe05 thru 0xd2f3d (0x7139 bytes) to 0x3f9fe thru 0x46b36 2023-07-14T18:17:18.933 INFO:tasks.workunit.client.0.smithi163.stdout:9358(142 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.933 INFO:tasks.workunit.client.0.smithi163.stdout:9359(143 mod 256): MAPREAD 0xdb39a thru 0xde6e0 (0x3347 bytes) 2023-07-14T18:17:18.933 INFO:tasks.workunit.client.0.smithi163.stdout:9360(144 mod 256): MAPWRITE 0x21d8f thru 0x2c0d0 (0xa342 bytes) 2023-07-14T18:17:18.933 INFO:tasks.workunit.client.0.smithi163.stdout:9361(145 mod 256): MAPREAD 0xb16e8 thru 0xbb8f8 (0xa211 bytes) 2023-07-14T18:17:18.933 INFO:tasks.workunit.client.0.smithi163.stdout:9362(146 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.933 INFO:tasks.workunit.client.0.smithi163.stdout:9363(147 mod 256): READ 0x7bbba thru 0x7cc05 (0x104c bytes) 2023-07-14T18:17:18.933 INFO:tasks.workunit.client.0.smithi163.stdout:9364(148 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.934 INFO:tasks.workunit.client.0.smithi163.stdout:9365(149 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.934 INFO:tasks.workunit.client.0.smithi163.stdout:9366(150 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.934 INFO:tasks.workunit.client.0.smithi163.stdout:9367(151 mod 256): MAPREAD 0x55fa9 thru 0x64edd (0xef35 bytes) 2023-07-14T18:17:18.934 INFO:tasks.workunit.client.0.smithi163.stdout:9368(152 mod 256): FALLOC 0x3cbb0 thru 0x3f0ee (0x253e bytes) INTERIOR 2023-07-14T18:17:18.934 INFO:tasks.workunit.client.0.smithi163.stdout:9369(153 mod 256): TRUNCATE DOWN from 0xed629 to 0x144b6 ******WWWW 2023-07-14T18:17:18.934 INFO:tasks.workunit.client.0.smithi163.stdout:9370(154 mod 256): MAPWRITE 0xa5137 thru 0xab06a (0x5f34 bytes) 2023-07-14T18:17:18.934 INFO:tasks.workunit.client.0.smithi163.stdout:9371(155 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.934 INFO:tasks.workunit.client.0.smithi163.stdout:9372(156 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.935 INFO:tasks.workunit.client.0.smithi163.stdout:9373(157 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.935 INFO:tasks.workunit.client.0.smithi163.stdout:9374(158 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.935 INFO:tasks.workunit.client.0.smithi163.stdout:9375(159 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.935 INFO:tasks.workunit.client.0.smithi163.stdout:9376(160 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.935 INFO:tasks.workunit.client.0.smithi163.stdout:9377(161 mod 256): PUNCH 0x58879 thru 0x5ef69 (0x66f1 bytes) 2023-07-14T18:17:18.935 INFO:tasks.workunit.client.0.smithi163.stdout:9378(162 mod 256): MAPREAD 0xe5fe thru 0x191e9 (0xabec bytes) 2023-07-14T18:17:18.935 INFO:tasks.workunit.client.0.smithi163.stdout:9379(163 mod 256): MAPWRITE 0x761f1 thru 0x7c157 (0x5f67 bytes) 2023-07-14T18:17:18.935 INFO:tasks.workunit.client.0.smithi163.stdout:9380(164 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.936 INFO:tasks.workunit.client.0.smithi163.stdout:9381(165 mod 256): MAPREAD 0x1c66f thru 0x25dd0 (0x9762 bytes) 2023-07-14T18:17:18.936 INFO:tasks.workunit.client.0.smithi163.stdout:9382(166 mod 256): MAPWRITE 0x2f1b6 thru 0x2f2c9 (0x114 bytes) 2023-07-14T18:17:18.936 INFO:tasks.workunit.client.0.smithi163.stdout:9383(167 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.936 INFO:tasks.workunit.client.0.smithi163.stdout:9384(168 mod 256): COPY 0x7a77a thru 0x85dbf (0xb646 bytes) to 0x1c7d2 thru 0x27e17 2023-07-14T18:17:18.936 INFO:tasks.workunit.client.0.smithi163.stdout:9385(169 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.936 INFO:tasks.workunit.client.0.smithi163.stdout:9386(170 mod 256): MAPREAD 0x89aa6 thru 0x90ee6 (0x7441 bytes) 2023-07-14T18:17:18.936 INFO:tasks.workunit.client.0.smithi163.stdout:9387(171 mod 256): PUNCH 0x3a3a8 thru 0x48cb5 (0xe90e bytes) 2023-07-14T18:17:18.937 INFO:tasks.workunit.client.0.smithi163.stdout:9388(172 mod 256): PUNCH 0x2c55c thru 0x2ea28 (0x24cd bytes) 2023-07-14T18:17:18.937 INFO:tasks.workunit.client.0.smithi163.stdout:9389(173 mod 256): FALLOC 0x197d5 thru 0x24829 (0xb054 bytes) INTERIOR 2023-07-14T18:17:18.937 INFO:tasks.workunit.client.0.smithi163.stdout:9390(174 mod 256): MAPWRITE 0x91c0d thru 0x9ac1d (0x9011 bytes) 2023-07-14T18:17:18.937 INFO:tasks.workunit.client.0.smithi163.stdout:9391(175 mod 256): WRITE 0xcfe5c thru 0xd2572 (0x2717 bytes) HOLE 2023-07-14T18:17:18.937 INFO:tasks.workunit.client.0.smithi163.stdout:9392(176 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.937 INFO:tasks.workunit.client.0.smithi163.stdout:9393(177 mod 256): READ 0xa677a thru 0xa9f6d (0x37f4 bytes) 2023-07-14T18:17:18.937 INFO:tasks.workunit.client.0.smithi163.stdout:9394(178 mod 256): PUNCH 0xa8e09 thru 0xb6081 (0xd279 bytes) 2023-07-14T18:17:18.937 INFO:tasks.workunit.client.0.smithi163.stdout:9395(179 mod 256): PUNCH 0x75eba thru 0x7817a (0x22c1 bytes) 2023-07-14T18:17:18.938 INFO:tasks.workunit.client.0.smithi163.stdout:9396(180 mod 256): PUNCH 0xccc56 thru 0xcdbd4 (0xf7f bytes) 2023-07-14T18:17:18.938 INFO:tasks.workunit.client.0.smithi163.stdout:9397(181 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.938 INFO:tasks.workunit.client.0.smithi163.stdout:9398(182 mod 256): PUNCH 0x6b4d5 thru 0x78146 (0xcc72 bytes) 2023-07-14T18:17:18.938 INFO:tasks.workunit.client.0.smithi163.stdout:9399(183 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.938 INFO:tasks.workunit.client.0.smithi163.stdout:9400(184 mod 256): COPY 0x4969b thru 0x56c79 (0xd5df bytes) to 0x66c01 thru 0x741df 2023-07-14T18:17:18.938 INFO:tasks.workunit.client.0.smithi163.stdout:9401(185 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.938 INFO:tasks.workunit.client.0.smithi163.stdout:9402(186 mod 256): MAPWRITE 0x670d4 thru 0x6e6f6 (0x7623 bytes) 2023-07-14T18:17:18.938 INFO:tasks.workunit.client.0.smithi163.stdout:9403(187 mod 256): MAPREAD 0x48d60 thru 0x48d97 (0x38 bytes) 2023-07-14T18:17:18.939 INFO:tasks.workunit.client.0.smithi163.stdout:9404(188 mod 256): MAPWRITE 0x7c5b1 thru 0x7efb9 (0x2a09 bytes) 2023-07-14T18:17:18.939 INFO:tasks.workunit.client.0.smithi163.stdout:9405(189 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.939 INFO:tasks.workunit.client.0.smithi163.stdout:9406(190 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.939 INFO:tasks.workunit.client.0.smithi163.stdout:9407(191 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.939 INFO:tasks.workunit.client.0.smithi163.stdout:9408(192 mod 256): MAPWRITE 0x2c125 thru 0x2d5c9 (0x14a5 bytes) 2023-07-14T18:17:18.939 INFO:tasks.workunit.client.0.smithi163.stdout:9409(193 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.939 INFO:tasks.workunit.client.0.smithi163.stdout:9410(194 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.939 INFO:tasks.workunit.client.0.smithi163.stdout:9411(195 mod 256): FALLOC 0xb6021 thru 0xc59d8 (0xf9b7 bytes) INTERIOR 2023-07-14T18:17:18.940 INFO:tasks.workunit.client.0.smithi163.stdout:9412(196 mod 256): TRUNCATE DOWN from 0xd2573 to 0xa7bae 2023-07-14T18:17:18.940 INFO:tasks.workunit.client.0.smithi163.stdout:9413(197 mod 256): COPY 0x180ed thru 0x27eda (0xfdee bytes) to 0x93061 thru 0xa2e4e 2023-07-14T18:17:18.940 INFO:tasks.workunit.client.0.smithi163.stdout:9414(198 mod 256): COPY 0x34578 thru 0x39850 (0x52d9 bytes) to 0x40093 thru 0x4536b EEEE****** 2023-07-14T18:17:18.940 INFO:tasks.workunit.client.0.smithi163.stdout:9415(199 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.940 INFO:tasks.workunit.client.0.smithi163.stdout:9416(200 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.940 INFO:tasks.workunit.client.0.smithi163.stdout:9417(201 mod 256): MAPREAD 0xa0c9e thru 0xa70f2 (0x6455 bytes) 2023-07-14T18:17:18.940 INFO:tasks.workunit.client.0.smithi163.stdout:9418(202 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.940 INFO:tasks.workunit.client.0.smithi163.stdout:9419(203 mod 256): MAPREAD 0x90a17 thru 0x93898 (0x2e82 bytes) 2023-07-14T18:17:18.941 INFO:tasks.workunit.client.0.smithi163.stdout:9420(204 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.941 INFO:tasks.workunit.client.0.smithi163.stdout:9421(205 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.941 INFO:tasks.workunit.client.0.smithi163.stdout:9422(206 mod 256): MAPREAD 0x1174e thru 0x1e5b2 (0xce65 bytes) 2023-07-14T18:17:18.941 INFO:tasks.workunit.client.0.smithi163.stdout:9423(207 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.941 INFO:tasks.workunit.client.0.smithi163.stdout:9424(208 mod 256): READ 0x5e57 thru 0x837d (0x2527 bytes) 2023-07-14T18:17:18.941 INFO:tasks.workunit.client.0.smithi163.stdout:9425(209 mod 256): FALLOC 0x95918 thru 0xa2f96 (0xd67e bytes) INTERIOR 2023-07-14T18:17:18.941 INFO:tasks.workunit.client.0.smithi163.stdout:9426(210 mod 256): FALLOC 0xc182d thru 0xc22ce (0xaa1 bytes) PAST_EOF 2023-07-14T18:17:18.941 INFO:tasks.workunit.client.0.smithi163.stdout:9427(211 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.942 INFO:tasks.workunit.client.0.smithi163.stdout:9428(212 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.942 INFO:tasks.workunit.client.0.smithi163.stdout:9429(213 mod 256): COPY 0x4690 thru 0x72eb (0x2c5c bytes) to 0xc7da1 thru 0xca9fc 2023-07-14T18:17:18.942 INFO:tasks.workunit.client.0.smithi163.stdout:9430(214 mod 256): MAPREAD 0x3af58 thru 0x42339 (0x73e2 bytes) 2023-07-14T18:17:18.942 INFO:tasks.workunit.client.0.smithi163.stdout:9431(215 mod 256): TRUNCATE UP from 0xca9fd to 0xdcdda 2023-07-14T18:17:18.942 INFO:tasks.workunit.client.0.smithi163.stdout:9432(216 mod 256): PUNCH 0xc3b75 thru 0xc73fb (0x3887 bytes) 2023-07-14T18:17:18.942 INFO:tasks.workunit.client.0.smithi163.stdout:9433(217 mod 256): PUNCH 0x4198e thru 0x45c57 (0x42ca bytes) 2023-07-14T18:17:18.942 INFO:tasks.workunit.client.0.smithi163.stdout:9434(218 mod 256): MAPWRITE 0x2df34 thru 0x3d7f4 (0xf8c1 bytes) ******WWWW 2023-07-14T18:17:18.942 INFO:tasks.workunit.client.0.smithi163.stdout:9435(219 mod 256): TRUNCATE UP from 0xdcdda to 0xe70dc 2023-07-14T18:17:18.943 INFO:tasks.workunit.client.0.smithi163.stdout:9436(220 mod 256): READ 0x65927 thru 0x68114 (0x27ee bytes) 2023-07-14T18:17:18.943 INFO:tasks.workunit.client.0.smithi163.stdout:9437(221 mod 256): PUNCH 0xd1e8f thru 0xd9f61 (0x80d3 bytes) 2023-07-14T18:17:18.943 INFO:tasks.workunit.client.0.smithi163.stdout:9438(222 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.943 INFO:tasks.workunit.client.0.smithi163.stdout:9439(223 mod 256): MAPWRITE 0xa7f02 thru 0xa9449 (0x1548 bytes) 2023-07-14T18:17:18.943 INFO:tasks.workunit.client.0.smithi163.stdout:9440(224 mod 256): COPY 0x1e137 thru 0x28bf0 (0xaaba bytes) to 0xb9493 thru 0xc3f4c 2023-07-14T18:17:18.943 INFO:tasks.workunit.client.0.smithi163.stdout:9441(225 mod 256): FALLOC 0x431ca thru 0x461e8 (0x301e bytes) INTERIOR 2023-07-14T18:17:18.943 INFO:tasks.workunit.client.0.smithi163.stdout:9442(226 mod 256): WRITE 0xf0cad thru 0xfba88 (0xaddc bytes) HOLE 2023-07-14T18:17:18.943 INFO:tasks.workunit.client.0.smithi163.stdout:9443(227 mod 256): FALLOC 0xed934 thru 0xfc97f (0xf04b bytes) EXTENDING 2023-07-14T18:17:18.944 INFO:tasks.workunit.client.0.smithi163.stdout:9444(228 mod 256): READ 0xa032a thru 0xa1825 (0x14fc bytes) 2023-07-14T18:17:18.944 INFO:tasks.workunit.client.0.smithi163.stdout:9445(229 mod 256): PUNCH 0x25afe thru 0x29894 (0x3d97 bytes) 2023-07-14T18:17:18.944 INFO:tasks.workunit.client.0.smithi163.stdout:9446(230 mod 256): PUNCH 0xcd39f thru 0xcdb53 (0x7b5 bytes) 2023-07-14T18:17:18.944 INFO:tasks.workunit.client.0.smithi163.stdout:9447(231 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.944 INFO:tasks.workunit.client.0.smithi163.stdout:9448(232 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.944 INFO:tasks.workunit.client.0.smithi163.stdout:9449(233 mod 256): FALLOC 0x3ab8 thru 0xa288 (0x67d0 bytes) INTERIOR 2023-07-14T18:17:18.944 INFO:tasks.workunit.client.0.smithi163.stdout:9450(234 mod 256): MAPREAD 0x17d95 thru 0x2383f (0xbaab bytes) 2023-07-14T18:17:18.944 INFO:tasks.workunit.client.0.smithi163.stdout:9451(235 mod 256): TRUNCATE DOWN from 0xfc97f to 0x66614 2023-07-14T18:17:18.945 INFO:tasks.workunit.client.0.smithi163.stdout:9452(236 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.945 INFO:tasks.workunit.client.0.smithi163.stdout:9453(237 mod 256): MAPREAD 0x12e8a thru 0x1e1a2 (0xb319 bytes) 2023-07-14T18:17:18.945 INFO:tasks.workunit.client.0.smithi163.stdout:9454(238 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.945 INFO:tasks.workunit.client.0.smithi163.stdout:9455(239 mod 256): WRITE 0x8b27 thru 0x1431e (0xb7f8 bytes) 2023-07-14T18:17:18.945 INFO:tasks.workunit.client.0.smithi163.stdout:9456(240 mod 256): TRUNCATE DOWN from 0x66614 to 0x2d971 ******WWWW 2023-07-14T18:17:18.945 INFO:tasks.workunit.client.0.smithi163.stdout:9457(241 mod 256): PUNCH 0x69c thru 0x7f66 (0x78cb bytes) 2023-07-14T18:17:18.945 INFO:tasks.workunit.client.0.smithi163.stdout:9458(242 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.945 INFO:tasks.workunit.client.0.smithi163.stdout:9459(243 mod 256): TRUNCATE UP from 0x2d971 to 0x96e7f ******WWWW 2023-07-14T18:17:18.946 INFO:tasks.workunit.client.0.smithi163.stdout:9460(244 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.946 INFO:tasks.workunit.client.0.smithi163.stdout:9461(245 mod 256): FALLOC 0xbebd0 thru 0xcb96b (0xcd9b bytes) EXTENDING 2023-07-14T18:17:18.946 INFO:tasks.workunit.client.0.smithi163.stdout:9462(246 mod 256): MAPWRITE 0xbdf6e thru 0xcb320 (0xd3b3 bytes) 2023-07-14T18:17:18.946 INFO:tasks.workunit.client.0.smithi163.stdout:9463(247 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.946 INFO:tasks.workunit.client.0.smithi163.stdout:9464(248 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.946 INFO:tasks.workunit.client.0.smithi163.stdout:9465(249 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.946 INFO:tasks.workunit.client.0.smithi163.stdout:9466(250 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.946 INFO:tasks.workunit.client.0.smithi163.stdout:9467(251 mod 256): FALLOC 0xaab35 thru 0xb2c6d (0x8138 bytes) INTERIOR 2023-07-14T18:17:18.947 INFO:tasks.workunit.client.0.smithi163.stdout:9468(252 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.947 INFO:tasks.workunit.client.0.smithi163.stdout:9469(253 mod 256): MAPWRITE 0xa188d thru 0xad105 (0xb879 bytes) 2023-07-14T18:17:18.947 INFO:tasks.workunit.client.0.smithi163.stdout:9470(254 mod 256): TRUNCATE UP from 0xcb96b to 0xd0742 2023-07-14T18:17:18.947 INFO:tasks.workunit.client.0.smithi163.stdout:9471(255 mod 256): MAPREAD 0xa7c38 thru 0xb1a43 (0x9e0c bytes) 2023-07-14T18:17:18.947 INFO:tasks.workunit.client.0.smithi163.stdout:9472( 0 mod 256): FALLOC 0x862f4 thru 0x90b30 (0xa83c bytes) INTERIOR 2023-07-14T18:17:18.947 INFO:tasks.workunit.client.0.smithi163.stdout:9473( 1 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.947 INFO:tasks.workunit.client.0.smithi163.stdout:9474( 2 mod 256): SKIPPED (no operation) 2023-07-14T18:17:18.947 INFO:tasks.workunit.client.0.smithi163.stdout:9475( 3 mod 256): MAPWRITE 0xf11b8 thru 0xfd8bd (0xc706 bytes) 2023-07-14T18:17:18.948 INFO:tasks.workunit.client.0.smithi163.stdout:9476( 4 mod 256): MAPREAD 0x30ac9 thru 0x381f4 (0x772c bytes) ***RRRR*** 2023-07-14T18:17:18.948 INFO:tasks.workunit.client.0.smithi163.stdout:Log of operations saved to "1MB.fsxops"; replay with --replay-ops 2023-07-14T18:17:18.948 INFO:tasks.workunit.client.0.smithi163.stdout:Correct content saved for comparison 2023-07-14T18:17:18.948 INFO:tasks.workunit.client.0.smithi163.stdout:(maybe hexdump "1MB" vs "1MB.fsxgood") 2023-07-14T18:17:18.948 INFO:tasks.workunit:Stopping ['suites/fsx.sh'] on client.0... 2023-07-14T18:17:18.949 DEBUG:teuthology.orchestra.run.smithi163:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2023-07-14T18:17:18.950 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:17:18 smithi184 ceph-mon[98481]: pgmap v439: 129 pgs: 129 active+clean; 125 MiB data, 969 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 MiB/s rd, 4.2 MiB/s wr, 527 op/s 2023-07-14T18:17:18.972 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:17:18 smithi163 ceph-mon[96576]: pgmap v439: 129 pgs: 129 active+clean; 125 MiB data, 969 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 MiB/s rd, 4.2 MiB/s wr, 527 op/s 2023-07-14T18:17:19.031 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:17:18 smithi172 ceph-mon[97983]: pgmap v439: 129 pgs: 129 active+clean; 125 MiB data, 969 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 MiB/s rd, 4.2 MiB/s wr, 527 op/s 2023-07-14T18:17:19.261 ERROR:teuthology.run_tasks:Saw exception from tasks. Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_aa6a80e6cc655fff48452a7eca02070e61d074fc/teuthology/run_tasks.py", line 105, in run_tasks manager = run_one_task(taskname, ctx=ctx, config=config) File "/home/teuthworker/src/git.ceph.com_teuthology_aa6a80e6cc655fff48452a7eca02070e61d074fc/teuthology/run_tasks.py", line 84, in run_one_task return task(**kwargs) File "/home/teuthworker/src/git.ceph.com_ceph-c_81c9387d2e7576da065747ec9c16d1c7d69016ec/qa/tasks/workunit.py", line 145, in task _spawn_on_all_clients(ctx, refspec, all_tasks, config.get('env'), File "/home/teuthworker/src/git.ceph.com_ceph-c_81c9387d2e7576da065747ec9c16d1c7d69016ec/qa/tasks/workunit.py", line 295, in _spawn_on_all_clients p.spawn(_run_tests, ctx, refspec, role, [unit], env, File "/home/teuthworker/src/git.ceph.com_teuthology_aa6a80e6cc655fff48452a7eca02070e61d074fc/teuthology/parallel.py", line 84, in __exit__ for result in self: File "/home/teuthworker/src/git.ceph.com_teuthology_aa6a80e6cc655fff48452a7eca02070e61d074fc/teuthology/parallel.py", line 98, in __next__ resurrect_traceback(result) File "/home/teuthworker/src/git.ceph.com_teuthology_aa6a80e6cc655fff48452a7eca02070e61d074fc/teuthology/parallel.py", line 30, in resurrect_traceback raise exc.exc_info[1] File "/home/teuthworker/src/git.ceph.com_teuthology_aa6a80e6cc655fff48452a7eca02070e61d074fc/teuthology/parallel.py", line 23, in capture_traceback return func(*args, **kwargs) File "/home/teuthworker/src/git.ceph.com_ceph-c_81c9387d2e7576da065747ec9c16d1c7d69016ec/qa/tasks/workunit.py", line 424, in _run_tests remote.run( File "/home/teuthworker/src/git.ceph.com_teuthology_aa6a80e6cc655fff48452a7eca02070e61d074fc/teuthology/orchestra/remote.py", line 522, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_aa6a80e6cc655fff48452a7eca02070e61d074fc/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_aa6a80e6cc655fff48452a7eca02070e61d074fc/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_aa6a80e6cc655fff48452a7eca02070e61d074fc/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed (workunit test suites/fsx.sh) on smithi163 with status 110: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=81c9387d2e7576da065747ec9c16d1c7d69016ec TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/fsx.sh' 2023-07-14T18:17:19.372 ERROR:teuthology.run_tasks: Sentry event: https://sentry.ceph.com/organizations/ceph/?query=00c1d331cbf04cf1b88b09b1b2e50570 Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_aa6a80e6cc655fff48452a7eca02070e61d074fc/teuthology/run_tasks.py", line 105, in run_tasks manager = run_one_task(taskname, ctx=ctx, config=config) File "/home/teuthworker/src/git.ceph.com_teuthology_aa6a80e6cc655fff48452a7eca02070e61d074fc/teuthology/run_tasks.py", line 84, in run_one_task return task(**kwargs) File "/home/teuthworker/src/git.ceph.com_ceph-c_81c9387d2e7576da065747ec9c16d1c7d69016ec/qa/tasks/workunit.py", line 145, in task _spawn_on_all_clients(ctx, refspec, all_tasks, config.get('env'), File "/home/teuthworker/src/git.ceph.com_ceph-c_81c9387d2e7576da065747ec9c16d1c7d69016ec/qa/tasks/workunit.py", line 295, in _spawn_on_all_clients p.spawn(_run_tests, ctx, refspec, role, [unit], env, File "/home/teuthworker/src/git.ceph.com_teuthology_aa6a80e6cc655fff48452a7eca02070e61d074fc/teuthology/parallel.py", line 84, in __exit__ for result in self: File "/home/teuthworker/src/git.ceph.com_teuthology_aa6a80e6cc655fff48452a7eca02070e61d074fc/teuthology/parallel.py", line 98, in __next__ resurrect_traceback(result) File "/home/teuthworker/src/git.ceph.com_teuthology_aa6a80e6cc655fff48452a7eca02070e61d074fc/teuthology/parallel.py", line 30, in resurrect_traceback raise exc.exc_info[1] File "/home/teuthworker/src/git.ceph.com_teuthology_aa6a80e6cc655fff48452a7eca02070e61d074fc/teuthology/parallel.py", line 23, in capture_traceback return func(*args, **kwargs) File "/home/teuthworker/src/git.ceph.com_ceph-c_81c9387d2e7576da065747ec9c16d1c7d69016ec/qa/tasks/workunit.py", line 424, in _run_tests remote.run( File "/home/teuthworker/src/git.ceph.com_teuthology_aa6a80e6cc655fff48452a7eca02070e61d074fc/teuthology/orchestra/remote.py", line 522, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_aa6a80e6cc655fff48452a7eca02070e61d074fc/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_aa6a80e6cc655fff48452a7eca02070e61d074fc/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_aa6a80e6cc655fff48452a7eca02070e61d074fc/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed (workunit test suites/fsx.sh) on smithi163 with status 110: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=81c9387d2e7576da065747ec9c16d1c7d69016ec TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/fsx.sh' 2023-07-14T18:17:19.375 DEBUG:teuthology.run_tasks:Unwinding manager fwd_scrub 2023-07-14T18:17:19.385 INFO:tasks.fwd_scrub:joining ForwardScrubbers 2023-07-14T18:17:19.930 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:17:19 smithi184 ceph-mon[98481]: scrub summary: active paths [/] 2023-07-14T18:17:19.972 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:17:19 smithi163 ceph-mon[96576]: scrub summary: active paths [/] 2023-07-14T18:17:20.031 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:17:19 smithi172 ceph-mon[97983]: scrub summary: active paths [/] 2023-07-14T18:17:20.930 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:17:20 smithi184 ceph-mon[98481]: scrub summary: idle+waiting paths [/] 2023-07-14T18:17:20.931 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:17:20 smithi184 ceph-mon[98481]: pgmap v440: 129 pgs: 129 active+clean; 126 MiB data, 973 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 3.3 MiB/s wr, 434 op/s 2023-07-14T18:17:20.972 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:17:20 smithi163 ceph-mon[96576]: scrub summary: idle+waiting paths [/] 2023-07-14T18:17:20.973 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:17:20 smithi163 ceph-mon[96576]: pgmap v440: 129 pgs: 129 active+clean; 126 MiB data, 973 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 3.3 MiB/s wr, 434 op/s 2023-07-14T18:17:21.031 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:17:20 smithi172 ceph-mon[97983]: scrub summary: idle+waiting paths [/] 2023-07-14T18:17:21.031 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:17:20 smithi172 ceph-mon[97983]: pgmap v440: 129 pgs: 129 active+clean; 126 MiB data, 973 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 3.3 MiB/s wr, 434 op/s 2023-07-14T18:17:22.180 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:17:21 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-14T18:17:22.180 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:17:21 smithi184 ceph-mon[98481]: pgmap v441: 129 pgs: 129 active+clean; 127 MiB data, 993 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 MiB/s rd, 3.9 MiB/s wr, 500 op/s 2023-07-14T18:17:22.222 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:17:21 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-14T18:17:22.223 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:17:21 smithi163 ceph-mon[96576]: pgmap v441: 129 pgs: 129 active+clean; 127 MiB data, 993 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 MiB/s rd, 3.9 MiB/s wr, 500 op/s 2023-07-14T18:17:22.281 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:17:21 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-14T18:17:22.281 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:17:21 smithi172 ceph-mon[97983]: pgmap v441: 129 pgs: 129 active+clean; 127 MiB data, 993 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 MiB/s rd, 3.9 MiB/s wr, 500 op/s 2023-07-14T18:17:23.180 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:17:22 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T18:17:23.181 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:17:22 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-14T18:17:23.181 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:17:22 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:17:23.222 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:17:22 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T18:17:23.223 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:17:22 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-14T18:17:23.223 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:17:22 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:17:23.281 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:17:22 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T18:17:23.281 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:17:22 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-14T18:17:23.282 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:17:22 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:17:24.180 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:17:23 smithi184 ceph-mon[98481]: pgmap v442: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 2.2 MiB/s wr, 286 op/s 2023-07-14T18:17:24.222 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:17:23 smithi163 ceph-mon[96576]: pgmap v442: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 2.2 MiB/s wr, 286 op/s 2023-07-14T18:17:24.281 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:17:23 smithi172 ceph-mon[97983]: pgmap v442: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 2.2 MiB/s wr, 286 op/s 2023-07-14T18:17:26.930 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:17:26 smithi184 ceph-mon[98481]: pgmap v443: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 2.2 MiB/s wr, 284 op/s 2023-07-14T18:17:26.973 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:17:26 smithi163 ceph-mon[96576]: pgmap v443: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 2.2 MiB/s wr, 284 op/s 2023-07-14T18:17:27.031 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:17:26 smithi172 ceph-mon[97983]: pgmap v443: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 2.2 MiB/s wr, 284 op/s 2023-07-14T18:17:28.930 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:17:28 smithi184 ceph-mon[98481]: pgmap v444: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 2.1 MiB/s wr, 233 op/s 2023-07-14T18:17:28.972 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:17:28 smithi163 ceph-mon[96576]: pgmap v444: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 2.1 MiB/s wr, 233 op/s 2023-07-14T18:17:29.031 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:17:28 smithi172 ceph-mon[97983]: pgmap v444: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 2.1 MiB/s wr, 233 op/s 2023-07-14T18:17:30.930 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:17:30 smithi184 ceph-mon[98481]: pgmap v445: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 693 KiB/s rd, 677 KiB/s wr, 83 op/s 2023-07-14T18:17:30.972 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:17:30 smithi163 ceph-mon[96576]: pgmap v445: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 693 KiB/s rd, 677 KiB/s wr, 83 op/s 2023-07-14T18:17:31.031 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:17:30 smithi172 ceph-mon[97983]: pgmap v445: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 693 KiB/s rd, 677 KiB/s wr, 83 op/s 2023-07-14T18:17:32.180 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:17:31 smithi184 ceph-mon[98481]: pgmap v446: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 689 KiB/s rd, 593 KiB/s wr, 80 op/s 2023-07-14T18:17:32.222 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:17:31 smithi163 ceph-mon[96576]: pgmap v446: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 689 KiB/s rd, 593 KiB/s wr, 80 op/s 2023-07-14T18:17:32.281 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:17:31 smithi172 ceph-mon[97983]: pgmap v446: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 689 KiB/s rd, 593 KiB/s wr, 80 op/s 2023-07-14T18:17:34.930 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:17:34 smithi184 ceph-mon[98481]: pgmap v447: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 5.9 KiB/s wr, 12 op/s 2023-07-14T18:17:34.973 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:17:34 smithi163 ceph-mon[96576]: pgmap v447: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 5.9 KiB/s wr, 12 op/s 2023-07-14T18:17:35.031 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:17:34 smithi172 ceph-mon[97983]: pgmap v447: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 5.9 KiB/s wr, 12 op/s 2023-07-14T18:17:36.930 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:17:36 smithi184 ceph-mon[98481]: pgmap v448: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 2.2 KiB/s wr, 10 op/s 2023-07-14T18:17:36.973 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:17:36 smithi163 ceph-mon[96576]: pgmap v448: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 2.2 KiB/s wr, 10 op/s 2023-07-14T18:17:37.031 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:17:36 smithi172 ceph-mon[97983]: pgmap v448: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 2.2 KiB/s wr, 10 op/s 2023-07-14T18:17:38.731 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-07-14T18:17:38.869 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:17:38.822+0000 7f3c003fc700 1 -- 172.21.15.163:0/2742455681 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f3bf80ffd00 msgr2=0x7f3bf8100150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:17:38.869 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:17:38.822+0000 7f3c003fc700 1 --2- 172.21.15.163:0/2742455681 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f3bf80ffd00 0x7f3bf8100150 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7f3be8009990 tx=0x7f3be8009ca0 comp rx=0 tx=0).stop 2023-07-14T18:17:38.869 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:17:38.822+0000 7f3c003fc700 1 -- 172.21.15.163:0/2742455681 shutdown_connections 2023-07-14T18:17:38.870 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:17:38.822+0000 7f3c003fc700 1 --2- 172.21.15.163:0/2742455681 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3bf80feb10 0x7f3bf80fef20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:17:38.870 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:17:38.822+0000 7f3c003fc700 1 --2- 172.21.15.163:0/2742455681 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3bf8100690 0x7f3bf8106f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:17:38.870 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:17:38.822+0000 7f3c003fc700 1 --2- 172.21.15.163:0/2742455681 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f3bf80ffd00 0x7f3bf8100150 unknown :-1 s=CLOSED pgs=684 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:17:38.870 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:17:38.822+0000 7f3c003fc700 1 -- 172.21.15.163:0/2742455681 >> 172.21.15.163:0/2742455681 conn(0x7f3bf80fa130 msgr2=0x7f3bf80fc560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:17:38.871 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:17:38.822+0000 7f3c003fc700 1 -- 172.21.15.163:0/2742455681 shutdown_connections 2023-07-14T18:17:38.871 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:17:38.822+0000 7f3c003fc700 1 -- 172.21.15.163:0/2742455681 wait complete. 2023-07-14T18:17:38.873 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:17:38.823+0000 7f3c003fc700 1 Processor -- start 2023-07-14T18:17:38.873 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:17:38.823+0000 7f3c003fc700 1 -- start start 2023-07-14T18:17:38.873 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:17:38.823+0000 7f3c003fc700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f3bf80feb10 0x7f3bf8195910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:17:38.874 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:17:38.823+0000 7f3c003fc700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3bf80ffd00 0x7f3bf8195e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:17:38.874 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:17:38.823+0000 7f3c003fc700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3bf8100690 0x7f3bf819cec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:17:38.875 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:17:38.823+0000 7f3c003fc700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bf819d490 con 0x7f3bf80feb10 2023-07-14T18:17:38.875 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:17:38.823+0000 7f3c003fc700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bf819d5d0 con 0x7f3bf80ffd00 2023-07-14T18:17:38.875 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:17:38.823+0000 7f3c003fc700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bf819d760 con 0x7f3bf8100690 2023-07-14T18:17:38.875 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:17:38.823+0000 7f3bfe198700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f3bf80feb10 0x7f3bf8195910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:17:38.875 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:17:38.823+0000 7f3bfe198700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f3bf80feb10 0x7f3bf8195910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:59684/0 (socket says 172.21.15.163:59684) 2023-07-14T18:17:38.876 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:17:38.823+0000 7f3bfe198700 1 -- 172.21.15.163:0/348554974 learned_addr learned my addr 172.21.15.163:0/348554974 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:17:38.876 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:17:38.823+0000 7f3bfd997700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3bf80ffd00 0x7f3bf8195e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:17:38.876 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:17:38.823+0000 7f3bfe999700 1 --2- 172.21.15.163:0/348554974 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3bf8100690 0x7f3bf819cec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:17:38.876 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:17:38.824+0000 7f3bfd997700 1 -- 172.21.15.163:0/348554974 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3bf8100690 msgr2=0x7f3bf819cec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:17:38.876 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:17:38.824+0000 7f3bfd997700 1 --2- 172.21.15.163:0/348554974 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3bf8100690 0x7f3bf819cec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:17:38.877 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:17:38.824+0000 7f3bfd997700 1 -- 172.21.15.163:0/348554974 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f3bf80feb10 msgr2=0x7f3bf8195910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:17:38.877 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:17:38.824+0000 7f3bfd997700 1 --2- 172.21.15.163:0/348554974 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f3bf80feb10 0x7f3bf8195910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:17:38.877 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:17:38.824+0000 7f3bfd997700 1 -- 172.21.15.163:0/348554974 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3be80095f0 con 0x7f3bf80ffd00 2023-07-14T18:17:38.877 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:17:38.824+0000 7f3bfe198700 1 --2- 172.21.15.163:0/348554974 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f3bf80feb10 0x7f3bf8195910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T18:17:38.877 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:17:38.824+0000 7f3bfd997700 1 --2- 172.21.15.163:0/348554974 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3bf80ffd00 0x7f3bf8195e50 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f3be8000c00 tx=0x7f3be8004730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:17:38.878 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:17:38.824+0000 7f3bef7fe700 1 -- 172.21.15.163:0/348554974 <== mon.2 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3be801d070 con 0x7f3bf80ffd00 2023-07-14T18:17:38.878 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:17:38.824+0000 7f3bef7fe700 1 -- 172.21.15.163:0/348554974 <== mon.2 v2:172.21.15.172:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f3be800bd50 con 0x7f3bf80ffd00 2023-07-14T18:17:38.878 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:17:38.824+0000 7f3c003fc700 1 -- 172.21.15.163:0/348554974 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3bf819d9e0 con 0x7f3bf80ffd00 2023-07-14T18:17:38.878 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:17:38.824+0000 7f3bef7fe700 1 -- 172.21.15.163:0/348554974 <== mon.2 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3be8022d30 con 0x7f3bf80ffd00 2023-07-14T18:17:38.878 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:17:38.824+0000 7f3c003fc700 1 -- 172.21.15.163:0/348554974 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3bf819de60 con 0x7f3bf80ffd00 2023-07-14T18:17:38.879 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:17:38.826+0000 7f3bef7fe700 1 -- 172.21.15.163:0/348554974 <== mon.2 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 18) v1 ==== 135716+0+0 (secure 0 0 0) 0x7f3be8022470 con 0x7f3bf80ffd00 2023-07-14T18:17:38.883 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:17:38.827+0000 7f3bef7fe700 1 --2- 172.21.15.163:0/348554974 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f3be40a11d0 0x7f3be40a3680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:17:38.883 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:17:38.827+0000 7f3bfe198700 1 --2- 172.21.15.163:0/348554974 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f3be40a11d0 0x7f3be40a3680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:17:38.883 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:17:38.827+0000 7f3bef7fe700 1 -- 172.21.15.163:0/348554974 <== mon.2 v2:172.21.15.172:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 9049+0+0 (secure 0 0 0) 0x7f3be80ce0f0 con 0x7f3bf80ffd00 2023-07-14T18:17:38.884 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:17:38.828+0000 7f3bfe198700 1 --2- 172.21.15.163:0/348554974 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f3be40a11d0 0x7f3be40a3680 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f3bf4005950 tx=0x7f3bf4009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:17:38.884 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:17:38.828+0000 7f3c0c594b80 1 Processor -- start 2023-07-14T18:17:38.884 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:17:38.828+0000 7f3c0c594b80 1 -- start start 2023-07-14T18:17:38.884 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:17:38.828+0000 7f3c0c594b80 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x561b55dfc320 0x561b55dfc730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:17:38.884 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:17:38.828+0000 7f3c0c594b80 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x561b55dfcc70 0x561b55dfd310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:17:38.885 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:17:38.828+0000 7f3c0c594b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561b55dfd8a0 0x561b55dfdd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:17:38.885 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:17:38.828+0000 7f3c0c594b80 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x561b55cfccb0 con 0x561b55dfc320 2023-07-14T18:17:38.885 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:17:38.828+0000 7f3c0c594b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x561b55d4fa40 con 0x561b55dfd8a0 2023-07-14T18:17:38.885 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:17:38.828+0000 7f3c0c594b80 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x561b55d48ed0 con 0x561b55dfcc70 2023-07-14T18:17:38.885 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:17:38.828+0000 7f3bfe198700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x561b55dfc320 0x561b55dfc730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:17:38.886 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:17:38.828+0000 7f3bfd997700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x561b55dfcc70 0x561b55dfd310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:17:38.886 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:17:38.828+0000 7f3bfe198700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x561b55dfc320 0x561b55dfc730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:59692/0 (socket says 172.21.15.163:59692) 2023-07-14T18:17:38.886 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:17:38.828+0000 7f3bfe198700 1 -- 172.21.15.163:0/2475579518 learned_addr learned my addr 172.21.15.163:0/2475579518 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:17:38.886 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:17:38.828+0000 7f3bfe999700 1 --2- 172.21.15.163:0/2475579518 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561b55dfd8a0 0x561b55dfdd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:17:38.886 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:17:38.829+0000 7f3bfd997700 1 -- 172.21.15.163:0/2475579518 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561b55dfd8a0 msgr2=0x561b55dfdd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:17:38.887 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:17:38.829+0000 7f3bfd997700 1 --2- 172.21.15.163:0/2475579518 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561b55dfd8a0 0x561b55dfdd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:17:38.887 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:17:38.829+0000 7f3bfd997700 1 -- 172.21.15.163:0/2475579518 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x561b55dfc320 msgr2=0x561b55dfc730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:17:38.887 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:17:38.829+0000 7f3bfd997700 1 --2- 172.21.15.163:0/2475579518 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x561b55dfc320 0x561b55dfc730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:17:38.887 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:17:38.829+0000 7f3bfd997700 1 -- 172.21.15.163:0/2475579518 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561b55b76de0 con 0x561b55dfcc70 2023-07-14T18:17:38.887 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:17:38.829+0000 7f3bfe198700 1 --2- 172.21.15.163:0/2475579518 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x561b55dfc320 0x561b55dfc730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T18:17:38.888 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:17:38.829+0000 7f3bfd997700 1 --2- 172.21.15.163:0/2475579518 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x561b55dfcc70 0x561b55dfd310 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f3be80098e0 tx=0x7f3be8009ca0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=98d23faa435d0f16 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:17:38.888 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:17:38.829+0000 7f3becdaa700 1 -- 172.21.15.163:0/2475579518 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3be809b260 con 0x561b55dfcc70 2023-07-14T18:17:38.888 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:17:38.829+0000 7f3becdaa700 1 -- 172.21.15.163:0/2475579518 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f3be8022e90 con 0x561b55dfcc70 2023-07-14T18:17:38.888 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:17:38.829+0000 7f3becdaa700 1 -- 172.21.15.163:0/2475579518 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3be809a750 con 0x561b55dfcc70 2023-07-14T18:17:38.888 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:17:38.830+0000 7f3c0c594b80 1 -- 172.21.15.163:0/2475579518 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x561b55dfcc70 msgr2=0x561b55dfd310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:17:38.889 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:17:38.830+0000 7f3c0c594b80 1 --2- 172.21.15.163:0/2475579518 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x561b55dfcc70 0x561b55dfd310 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f3be80098e0 tx=0x7f3be8009ca0 comp rx=0 tx=0).stop 2023-07-14T18:17:38.889 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:17:38.830+0000 7f3c0c594b80 1 -- 172.21.15.163:0/2475579518 shutdown_connections 2023-07-14T18:17:38.889 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:17:38.830+0000 7f3c0c594b80 1 --2- 172.21.15.163:0/2475579518 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561b55dfd8a0 0x561b55dfdd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:17:38.889 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:17:38.830+0000 7f3c0c594b80 1 --2- 172.21.15.163:0/2475579518 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x561b55dfc320 0x561b55dfc730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:17:38.889 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:17:38.830+0000 7f3c0c594b80 1 --2- 172.21.15.163:0/2475579518 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x561b55dfcc70 0x561b55dfd310 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:17:38.890 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:17:38.830+0000 7f3c0c594b80 1 -- 172.21.15.163:0/2475579518 >> 172.21.15.163:0/2475579518 conn(0x561b55ded680 msgr2=0x561b55df29d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:17:38.890 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:17:38.830+0000 7f3c0c594b80 1 -- 172.21.15.163:0/2475579518 shutdown_connections 2023-07-14T18:17:38.890 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:17:38.830+0000 7f3c0c594b80 1 -- 172.21.15.163:0/2475579518 wait complete. 2023-07-14T18:17:38.890 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:17:38.830+0000 7f3c0c594b80 1 -- start start 2023-07-14T18:17:38.890 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:17:38.830+0000 7f3c0c594b80 1 Processor -- start 2023-07-14T18:17:38.890 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:17:38.831+0000 7f3c0c594b80 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x561b55dfc320 0x561b55e059d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:17:38.891 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:17:38.831+0000 7f3c0c594b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561b55dfcc70 0x561b55e05f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:17:38.891 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:17:38.831+0000 7f3c0c594b80 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x561b55dfd8a0 0x561b55e0cf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:17:38.891 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:17:38.831+0000 7f3c0c594b80 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x561b55ce8ac0 con 0x561b55dfc320 2023-07-14T18:17:38.891 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:17:38.831+0000 7f3c0c594b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x561b55ce87c0 con 0x561b55dfcc70 2023-07-14T18:17:38.892 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:17:38.831+0000 7f3c0c594b80 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x561b55bcc920 con 0x561b55dfd8a0 2023-07-14T18:17:38.892 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:17:38.831+0000 7f3c0c594b80 10 client.0 _ll_register_callbacks cb 0x561b55ce6760 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T18:17:38.892 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:17:38.831+0000 7f3bfd997700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561b55dfcc70 0x561b55e05f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:17:38.892 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:17:38.831+0000 7f3bfe198700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x561b55dfc320 0x561b55e059d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:17:38.892 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:17:38.831+0000 7f3bfe999700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x561b55dfd8a0 0x561b55e0cf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:17:38.893 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:17:38.831+0000 7f3bfd997700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561b55dfcc70 0x561b55e05f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.163:60382/0 (socket says 172.21.15.163:60382) 2023-07-14T18:17:38.893 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:17:38.831+0000 7f3bfd997700 1 -- 172.21.15.163:0/3831504101 learned_addr learned my addr 172.21.15.163:0/3831504101 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:17:38.893 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:17:38.831+0000 7f3bfe999700 1 -- 172.21.15.163:0/3831504101 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561b55dfcc70 msgr2=0x561b55e05f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:17:38.893 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:17:38.831+0000 7f3bfe999700 1 --2- 172.21.15.163:0/3831504101 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561b55dfcc70 0x561b55e05f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:17:38.893 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:17:38.831+0000 7f3bfe999700 1 -- 172.21.15.163:0/3831504101 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x561b55dfc320 msgr2=0x561b55e059d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:17:38.894 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:17:38.831+0000 7f3bfe999700 1 --2- 172.21.15.163:0/3831504101 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x561b55dfc320 0x561b55e059d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:17:38.894 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:17:38.831+0000 7f3bfe999700 1 -- 172.21.15.163:0/3831504101 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3bf4017070 con 0x561b55dfd8a0 2023-07-14T18:17:38.894 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:17:38.831+0000 7f3bfd997700 1 --2- 172.21.15.163:0/3831504101 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561b55dfcc70 0x561b55e05f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T18:17:38.894 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:17:38.831+0000 7f3bfe999700 1 --2- 172.21.15.163:0/3831504101 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x561b55dfd8a0 0x561b55e0cf50 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f3bf0011e60 tx=0x7f3bf0014600 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d57940614101ec25 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:17:38.894 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:17:38.831+0000 7f3be1ffb700 10 client.0 ms_handle_connect on v2:172.21.15.184:3300/0 2023-07-14T18:17:38.895 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:17:38.832+0000 7f3be1ffb700 1 -- 172.21.15.163:0/3831504101 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bf000e040 con 0x561b55dfd8a0 2023-07-14T18:17:38.895 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:17:38.832+0000 7f3c0c594b80 1 -- 172.21.15.163:0/3831504101 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x561b55ca24f0 con 0x561b55dfd8a0 2023-07-14T18:17:38.895 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:17:38.832+0000 7f3be1ffb700 1 -- 172.21.15.163:0/3831504101 <== mon.1 v2:172.21.15.184:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 9049+0+0 (secure 0 0 0) 0x7f3bf00093a0 con 0x561b55dfd8a0 2023-07-14T18:17:38.895 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:17:38.832+0000 7f3be1ffb700 1 -- 172.21.15.163:0/3831504101 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3bf0004db0 con 0x561b55dfd8a0 2023-07-14T18:17:38.895 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:17:38.832+0000 7f3c0c594b80 10 client.25921 fetch_fsmap learned FSMap version 33 2023-07-14T18:17:38.896 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:17:38.832+0000 7f3c0c594b80 1 -- 172.21.15.163:0/3831504101 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) v3 -- 0x7f3be8095e70 con 0x561b55dfd8a0 2023-07-14T18:17:38.896 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:17:38.832+0000 7f3be1ffb700 1 -- 172.21.15.163:0/3831504101 <== mon.1 v2:172.21.15.184:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x561b55ca24f0 con 0x561b55dfd8a0 2023-07-14T18:17:38.896 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:17:38.832+0000 7f3be1ffb700 1 -- 172.21.15.163:0/3831504101 <== mon.1 v2:172.21.15.184:3300/0 5 ==== fsmap(e 33) v1 ==== 7502+0+0 (secure 0 0 0) 0x7f3bf001c030 con 0x561b55dfd8a0 2023-07-14T18:17:38.896 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:17:38.832+0000 7f3c0c594b80 10 client.25921 fetch_fsmap finished waiting for FSMap version 33 2023-07-14T18:17:38.896 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:17:38.832+0000 7f3c0c594b80 10 client.25921 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-07-14T18:17:38.897 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:17:38.832+0000 7f3c0c594b80 20 client.25921 populate_metadata read hostname 'smithi163' 2023-07-14T18:17:38.897 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:17:38.832+0000 7f3c0c594b80 1 --2- 172.21.15.163:0/3831504101 >> [v2:172.21.15.172:6838/3850440096,v1:172.21.15.172:6839/3850440096] conn(0x561b55e11880 0x561b55e13c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:17:38.897 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:17:38.832+0000 7f3c0c594b80 4 client.25921 mds_command: new command op to 24518 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-14T18:17:38.897 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:17:38.832+0000 7f3c0c594b80 1 -- 172.21.15.163:0/3831504101 --> [v2:172.21.15.172:6838/3850440096,v1:172.21.15.172:6839/3850440096] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x561b55dc6da0 con 0x561b55e11880 2023-07-14T18:17:38.897 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:17:38.832+0000 7f3bfe198700 1 --2- 172.21.15.163:0/3831504101 >> [v2:172.21.15.172:6838/3850440096,v1:172.21.15.172:6839/3850440096] conn(0x561b55e11880 0x561b55e13c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:17:38.898 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:17:38.833+0000 7f3be1ffb700 10 client.25921 ms_handle_connect on v2:172.21.15.172:6838/3850440096 2023-07-14T18:17:38.898 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:17:38.833+0000 7f3bfe198700 1 --2- 172.21.15.163:0/3831504101 >> [v2:172.21.15.172:6838/3850440096,v1:172.21.15.172:6839/3850440096] conn(0x561b55e11880 0x561b55e13c90 crc :-1 s=READY pgs=77 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=af6747a58d872773 server_cookie=b1d93df393824681 in_seq=0 out_seq=0 2023-07-14T18:17:38.898 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:17:38.833+0000 7f3be1ffb700 1 -- 172.21.15.163:0/3831504101 <== mds.0 v2:172.21.15.172:6838/3850440096 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18017 (crc 0 0 0) 0x561b55dc6da0 con 0x561b55e11880 2023-07-14T18:17:38.898 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:17:38.833+0000 7f3be1ffb700 10 client.25921 handle_command_reply: tid=0 2023-07-14T18:17:38.898 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:17:38.833+0000 7f3c0c594b80 1 client.25921 shutdown 2023-07-14T18:17:38.899 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:17:38.834+0000 7f3c0c594b80 1 -- 172.21.15.163:0/3831504101 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x561b55dfd8a0 msgr2=0x561b55e0cf50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:17:38.899 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:17:38.834+0000 7f3c0c594b80 1 --2- 172.21.15.163:0/3831504101 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x561b55dfd8a0 0x561b55e0cf50 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f3bf0011e60 tx=0x7f3bf0014600 comp rx=0 tx=0).stop 2023-07-14T18:17:38.899 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:17:38.834+0000 7f3c0c594b80 1 -- 172.21.15.163:0/3831504101 shutdown_connections 2023-07-14T18:17:38.899 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:17:38.834+0000 7f3c0c594b80 1 --2- 172.21.15.163:0/3831504101 >> [v2:172.21.15.172:6838/3850440096,v1:172.21.15.172:6839/3850440096] conn(0x561b55e11880 0x561b55e13c90 crc :-1 s=READY pgs=77 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:17:38.899 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:17:38.834+0000 7f3c0c594b80 1 --2- 172.21.15.163:0/3831504101 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x561b55dfd8a0 0x561b55e0cf50 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:17:38.900 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:17:38.834+0000 7f3c0c594b80 1 --2- 172.21.15.163:0/3831504101 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x561b55dfc320 0x561b55e059d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:17:38.900 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:17:38.834+0000 7f3c0c594b80 1 --2- 172.21.15.163:0/3831504101 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561b55dfcc70 0x561b55e05f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:17:38.900 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:17:38.834+0000 7f3be1ffb700 0 client.25921 ms_handle_reset on v2:172.21.15.172:6838/3850440096 2023-07-14T18:17:38.900 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:17:38.834+0000 7f3c0c594b80 1 -- 172.21.15.163:0/3831504101 >> 172.21.15.163:0/3831504101 conn(0x561b55ded680 msgr2=0x561b55df1650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:17:38.900 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:17:38.834+0000 7f3c0c594b80 1 -- 172.21.15.163:0/3831504101 shutdown_connections 2023-07-14T18:17:38.901 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:17:38.834+0000 7f3c0c594b80 1 -- 172.21.15.163:0/3831504101 wait complete. 2023-07-14T18:17:38.901 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:17:38.834+0000 7f3c0c594b80 20 client.25921 trim_cache size 0 max 16384 2023-07-14T18:17:38.904 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:17:38.854+0000 7f3c0c594b80 1 Processor -- start 2023-07-14T18:17:38.904 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:17:38.854+0000 7f3c0c594b80 1 -- start start 2023-07-14T18:17:38.905 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:17:38.854+0000 7f3c0c594b80 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x561b55dfc320 0x561b55e03bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:17:38.905 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:17:38.854+0000 7f3c0c594b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561b55dfcc70 0x561b55e04100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:17:38.905 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:17:38.854+0000 7f3c0c594b80 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x561b55dfd8a0 0x561b55e0cf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:17:38.905 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:17:38.854+0000 7f3c0c594b80 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x561b55df38d0 con 0x561b55dfc320 2023-07-14T18:17:38.905 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:17:38.854+0000 7f3c0c594b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x561b55df3710 con 0x561b55dfcc70 2023-07-14T18:17:38.906 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:17:38.854+0000 7f3c0c594b80 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x561b55e11410 con 0x561b55dfd8a0 2023-07-14T18:17:38.906 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:17:38.854+0000 7f3bfe198700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x561b55dfc320 0x561b55e03bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:17:38.906 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:17:38.854+0000 7f3bfd997700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561b55dfcc70 0x561b55e04100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:17:38.906 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:17:38.854+0000 7f3bfe198700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x561b55dfc320 0x561b55e03bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:59706/0 (socket says 172.21.15.163:59706) 2023-07-14T18:17:38.906 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:17:38.854+0000 7f3bfe198700 1 -- 172.21.15.163:0/3517601792 learned_addr learned my addr 172.21.15.163:0/3517601792 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:17:38.907 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:17:38.854+0000 7f3bfe999700 1 --2- 172.21.15.163:0/3517601792 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x561b55dfd8a0 0x561b55e0cf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:17:38.907 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:17:38.854+0000 7f3bfd997700 1 -- 172.21.15.163:0/3517601792 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x561b55dfd8a0 msgr2=0x561b55e0cf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:17:38.907 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:17:38.854+0000 7f3bfd997700 1 --2- 172.21.15.163:0/3517601792 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x561b55dfd8a0 0x561b55e0cf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:17:38.907 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:17:38.854+0000 7f3bfd997700 1 -- 172.21.15.163:0/3517601792 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x561b55dfc320 msgr2=0x561b55e03bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:17:38.907 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:17:38.854+0000 7f3bfd997700 1 --2- 172.21.15.163:0/3517601792 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x561b55dfc320 0x561b55e03bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:17:38.908 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:17:38.854+0000 7f3bfd997700 1 -- 172.21.15.163:0/3517601792 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561b55b5fc60 con 0x561b55dfcc70 2023-07-14T18:17:38.908 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:17:38.854+0000 7f3bfe198700 1 --2- 172.21.15.163:0/3517601792 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x561b55dfc320 0x561b55e03bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T18:17:38.908 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:17:38.854+0000 7f3bfd997700 1 --2- 172.21.15.163:0/3517601792 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561b55dfcc70 0x561b55e04100 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f3be8097cd0 tx=0x7f3be8005a00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=66b136e2de51768d server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:17:38.908 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:17:38.855+0000 7f3bed5ab700 1 -- 172.21.15.163:0/3517601792 <== mon.2 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3be80975a0 con 0x561b55dfcc70 2023-07-14T18:17:38.908 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:17:38.855+0000 7f3bed5ab700 1 -- 172.21.15.163:0/3517601792 <== mon.2 v2:172.21.15.172:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f3be809b260 con 0x561b55dfcc70 2023-07-14T18:17:38.909 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:17:38.855+0000 7f3bed5ab700 1 -- 172.21.15.163:0/3517601792 <== mon.2 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3be8099720 con 0x561b55dfcc70 2023-07-14T18:17:38.909 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:17:38.855+0000 7f3c0c594b80 1 -- 172.21.15.163:0/3517601792 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561b55dfcc70 msgr2=0x561b55e04100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:17:38.909 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:17:38.855+0000 7f3c0c594b80 1 --2- 172.21.15.163:0/3517601792 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561b55dfcc70 0x561b55e04100 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f3be8097cd0 tx=0x7f3be8005a00 comp rx=0 tx=0).stop 2023-07-14T18:17:38.909 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:17:38.855+0000 7f3c0c594b80 1 -- 172.21.15.163:0/3517601792 shutdown_connections 2023-07-14T18:17:38.909 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:17:38.855+0000 7f3c0c594b80 1 --2- 172.21.15.163:0/3517601792 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x561b55dfd8a0 0x561b55e0cf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:17:38.909 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:17:38.855+0000 7f3c0c594b80 1 --2- 172.21.15.163:0/3517601792 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x561b55dfc320 0x561b55e03bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:17:38.910 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:17:38.855+0000 7f3c0c594b80 1 --2- 172.21.15.163:0/3517601792 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561b55dfcc70 0x561b55e04100 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:17:38.910 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:17:38.855+0000 7f3c0c594b80 1 -- 172.21.15.163:0/3517601792 >> 172.21.15.163:0/3517601792 conn(0x561b55ded680 msgr2=0x561b55e0d840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:17:38.910 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:17:38.855+0000 7f3c0c594b80 1 -- 172.21.15.163:0/3517601792 shutdown_connections 2023-07-14T18:17:38.910 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:17:38.855+0000 7f3c0c594b80 1 -- 172.21.15.163:0/3517601792 wait complete. 2023-07-14T18:17:38.910 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:17:38.856+0000 7f3c0c594b80 1 -- start start 2023-07-14T18:17:38.911 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:17:38.856+0000 7f3c0c594b80 1 Processor -- start 2023-07-14T18:17:38.911 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:17:38.856+0000 7f3c0c594b80 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x561b55dfc320 0x561b55e09140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:17:38.911 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:17:38.856+0000 7f3c0c594b80 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x561b55dfcc70 0x561b55e09680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:17:38.911 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:17:38.856+0000 7f3c0c594b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561b55dfd8a0 0x561b55e0c500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:17:38.911 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:17:38.856+0000 7f3c0c594b80 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x561b55e0ca40 con 0x561b55dfcc70 2023-07-14T18:17:38.912 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:17:38.856+0000 7f3c0c594b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x561b55e0cbb0 con 0x561b55dfd8a0 2023-07-14T18:17:38.912 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:17:38.856+0000 7f3c0c594b80 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x561b55e0cd20 con 0x561b55dfc320 2023-07-14T18:17:38.912 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:17:38.856+0000 7f3c0c594b80 10 client.0 _ll_register_callbacks cb 0x7f3bf00117c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T18:17:38.912 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:17:38.856+0000 7f3bfe198700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x561b55dfc320 0x561b55e09140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:17:38.912 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:17:38.856+0000 7f3bfd997700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x561b55dfcc70 0x561b55e09680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:17:38.913 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:17:38.856+0000 7f3bfe198700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x561b55dfc320 0x561b55e09140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.163:41534/0 (socket says 172.21.15.163:41534) 2023-07-14T18:17:38.913 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:17:38.856+0000 7f3bfe198700 1 -- 172.21.15.163:0/1856186783 learned_addr learned my addr 172.21.15.163:0/1856186783 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:17:38.913 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:17:38.856+0000 7f3bfe999700 1 --2- 172.21.15.163:0/1856186783 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561b55dfd8a0 0x561b55e0c500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:17:38.913 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:17:38.856+0000 7f3bfd997700 1 -- 172.21.15.163:0/1856186783 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x561b55dfc320 msgr2=0x561b55e09140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:17:38.913 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:17:38.856+0000 7f3bfd997700 1 --2- 172.21.15.163:0/1856186783 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x561b55dfc320 0x561b55e09140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:17:38.914 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:17:38.857+0000 7f3bfd997700 1 -- 172.21.15.163:0/1856186783 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561b55dfd8a0 msgr2=0x561b55e0c500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:17:38.914 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:17:38.857+0000 7f3bfd997700 1 --2- 172.21.15.163:0/1856186783 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561b55dfd8a0 0x561b55e0c500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:17:38.914 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:17:38.857+0000 7f3bfd997700 1 -- 172.21.15.163:0/1856186783 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3bf400ea00 con 0x561b55dfcc70 2023-07-14T18:17:38.914 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:17:38.857+0000 7f3bfe999700 1 --2- 172.21.15.163:0/1856186783 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561b55dfd8a0 0x561b55e0c500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T18:17:38.914 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:17:38.857+0000 7f3bfd997700 1 --2- 172.21.15.163:0/1856186783 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x561b55dfcc70 0x561b55e09680 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7f3be8003f60 tx=0x7f3be800baf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f0c28ba925d93af server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:17:38.915 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:17:38.857+0000 7f3be1ffb700 10 client.0 ms_handle_connect on v2:172.21.15.163:3300/0 2023-07-14T18:17:38.915 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:17:38.857+0000 7f3be1ffb700 1 -- 172.21.15.163:0/1856186783 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3be8099700 con 0x561b55dfcc70 2023-07-14T18:17:38.915 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:17:38.857+0000 7f3be1ffb700 1 -- 172.21.15.163:0/1856186783 <== mon.0 v2:172.21.15.163:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 9049+0+0 (secure 0 0 0) 0x7f3be809f290 con 0x561b55dfcc70 2023-07-14T18:17:38.915 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:17:38.857+0000 7f3c0c594b80 1 -- 172.21.15.163:0/1856186783 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f3be8022e90 con 0x561b55dfcc70 2023-07-14T18:17:38.915 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:17:38.857+0000 7f3be1ffb700 1 -- 172.21.15.163:0/1856186783 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3be80975a0 con 0x561b55dfcc70 2023-07-14T18:17:38.916 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:17:38.857+0000 7f3c0c594b80 10 client.16362 fetch_fsmap learned FSMap version 33 2023-07-14T18:17:38.916 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:17:38.857+0000 7f3c0c594b80 1 -- 172.21.15.163:0/1856186783 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) v3 -- 0x561b55b76de0 con 0x561b55dfcc70 2023-07-14T18:17:38.916 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:17:38.857+0000 7f3be1ffb700 1 -- 172.21.15.163:0/1856186783 <== mon.0 v2:172.21.15.163:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f3be8022e90 con 0x561b55dfcc70 2023-07-14T18:17:38.916 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:17:38.857+0000 7f3be1ffb700 1 -- 172.21.15.163:0/1856186783 <== mon.0 v2:172.21.15.163:3300/0 5 ==== fsmap(e 33) v1 ==== 7502+0+0 (secure 0 0 0) 0x7f3be80971e0 con 0x561b55dfcc70 2023-07-14T18:17:38.916 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:17:38.857+0000 7f3c0c594b80 10 client.16362 fetch_fsmap finished waiting for FSMap version 33 2023-07-14T18:17:38.917 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:17:38.857+0000 7f3c0c594b80 10 client.16362 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-07-14T18:17:38.917 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:17:38.857+0000 7f3c0c594b80 20 client.16362 populate_metadata read hostname 'smithi163' 2023-07-14T18:17:38.917 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:17:38.858+0000 7f3c0c594b80 1 --2- 172.21.15.163:0/1856186783 >> [v2:172.21.15.172:6838/3850440096,v1:172.21.15.172:6839/3850440096] conn(0x561b55e66150 0x561b55e68530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:17:38.917 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:17:38.858+0000 7f3c0c594b80 4 client.16362 mds_command: new command op to 24518 tid=0[{"prefix": "scrub status"}] 2023-07-14T18:17:38.917 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:17:38.858+0000 7f3c0c594b80 1 -- 172.21.15.163:0/1856186783 --> [v2:172.21.15.172:6838/3850440096,v1:172.21.15.172:6839/3850440096] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x561b55d41eb0 con 0x561b55e66150 2023-07-14T18:17:38.918 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:17:38.858+0000 7f3bfe198700 1 --2- 172.21.15.163:0/1856186783 >> [v2:172.21.15.172:6838/3850440096,v1:172.21.15.172:6839/3850440096] conn(0x561b55e66150 0x561b55e68530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:17:38.919 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:17:38.858+0000 7f3be1ffb700 10 client.16362 ms_handle_connect on v2:172.21.15.172:6838/3850440096 2023-07-14T18:17:38.919 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:17:38.858+0000 7f3bfe198700 1 --2- 172.21.15.163:0/1856186783 >> [v2:172.21.15.172:6838/3850440096,v1:172.21.15.172:6839/3850440096] conn(0x561b55e66150 0x561b55e68530 crc :-1 s=READY pgs=78 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cc3b02d2bb83ea53 server_cookie=191674053ddcb57a in_seq=0 out_seq=0 2023-07-14T18:17:38.919 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:17:38.858+0000 7f3be1ffb700 1 -- 172.21.15.163:0/1856186783 <== mds.0 v2:172.21.15.172:6838/3850440096 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x561b55d41eb0 con 0x561b55e66150 2023-07-14T18:17:38.919 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:17:38.858+0000 7f3be1ffb700 10 client.16362 handle_command_reply: tid=0 2023-07-14T18:17:38.920 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:17:38.858+0000 7f3c0c594b80 1 client.16362 shutdown 2023-07-14T18:17:38.920 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:17:38.858+0000 7f3c0c594b80 1 -- 172.21.15.163:0/1856186783 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x561b55dfcc70 msgr2=0x561b55e09680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:17:38.920 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:17:38.858+0000 7f3c0c594b80 1 --2- 172.21.15.163:0/1856186783 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x561b55dfcc70 0x561b55e09680 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7f3be8003f60 tx=0x7f3be800baf0 comp rx=0 tx=0).stop 2023-07-14T18:17:38.920 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:17:38.858+0000 7f3c0c594b80 1 -- 172.21.15.163:0/1856186783 shutdown_connections 2023-07-14T18:17:38.920 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:17:38.858+0000 7f3c0c594b80 1 --2- 172.21.15.163:0/1856186783 >> [v2:172.21.15.172:6838/3850440096,v1:172.21.15.172:6839/3850440096] conn(0x561b55e66150 0x561b55e68530 crc :-1 s=READY pgs=78 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:17:38.921 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:17:38.858+0000 7f3c0c594b80 1 --2- 172.21.15.163:0/1856186783 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x561b55dfc320 0x561b55e09140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:17:38.921 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:17:38.858+0000 7f3be1ffb700 0 client.16362 ms_handle_reset on v2:172.21.15.172:6838/3850440096 2023-07-14T18:17:38.921 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:17:38.858+0000 7f3c0c594b80 1 --2- 172.21.15.163:0/1856186783 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561b55dfd8a0 0x561b55e0c500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:17:38.921 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:17:38.858+0000 7f3c0c594b80 1 --2- 172.21.15.163:0/1856186783 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x561b55dfcc70 0x561b55e09680 unknown :-1 s=CLOSED pgs=685 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:17:38.921 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:17:38.859+0000 7f3c0c594b80 1 -- 172.21.15.163:0/1856186783 >> 172.21.15.163:0/1856186783 conn(0x561b55ded680 msgr2=0x561b55e03bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:17:38.922 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:17:38.859+0000 7f3c0c594b80 1 -- 172.21.15.163:0/1856186783 shutdown_connections 2023-07-14T18:17:38.922 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:17:38.859+0000 7f3c0c594b80 1 -- 172.21.15.163:0/1856186783 wait complete. 2023-07-14T18:17:38.922 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:17:38.859+0000 7f3c0c594b80 20 client.16362 trim_cache size 0 max 16384 2023-07-14T18:17:38.922 INFO:teuthology.orchestra.run.smithi163.stdout:{ 2023-07-14T18:17:38.923 INFO:teuthology.orchestra.run.smithi163.stdout: "status": "IDLE (waiting for more scrubs)", 2023-07-14T18:17:38.923 INFO:teuthology.orchestra.run.smithi163.stdout: "scrubs": { 2023-07-14T18:17:38.923 INFO:teuthology.orchestra.run.smithi163.stdout: "2c53b7ef-6f30-49f0-a60d-f1f114c19d42": { 2023-07-14T18:17:38.923 INFO:teuthology.orchestra.run.smithi163.stdout: "path": "/", 2023-07-14T18:17:38.923 INFO:teuthology.orchestra.run.smithi163.stdout: "tag": "2c53b7ef-6f30-49f0-a60d-f1f114c19d42", 2023-07-14T18:17:38.924 INFO:teuthology.orchestra.run.smithi163.stdout: "options": "recursive,force" 2023-07-14T18:17:38.924 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-07-14T18:17:38.924 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-07-14T18:17:38.924 INFO:teuthology.orchestra.run.smithi163.stdout:} 2023-07-14T18:17:38.925 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:17:38.859+0000 7f3c003fc700 1 -- 172.21.15.163:0/348554974 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f3be40a11d0 msgr2=0x7f3be40a3680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:17:38.925 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:17:38.859+0000 7f3c003fc700 1 --2- 172.21.15.163:0/348554974 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f3be40a11d0 0x7f3be40a3680 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f3bf4005950 tx=0x7f3bf4009260 comp rx=0 tx=0).stop 2023-07-14T18:17:38.925 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:17:38.859+0000 7f3c003fc700 1 -- 172.21.15.163:0/348554974 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3bf80ffd00 msgr2=0x7f3bf8195e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:17:38.926 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:17:38.859+0000 7f3c003fc700 1 --2- 172.21.15.163:0/348554974 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3bf80ffd00 0x7f3bf8195e50 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f3be8000c00 tx=0x7f3be8004730 comp rx=0 tx=0).stop 2023-07-14T18:17:38.926 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:17:38.859+0000 7f3c003fc700 1 -- 172.21.15.163:0/348554974 shutdown_connections 2023-07-14T18:17:38.926 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:17:38.859+0000 7f3c003fc700 1 --2- 172.21.15.163:0/348554974 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f3be40a11d0 0x7f3be40a3680 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:17:38.926 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:17:38.859+0000 7f3c003fc700 1 --2- 172.21.15.163:0/348554974 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3bf8100690 0x7f3bf819cec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:17:38.926 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:17:38.859+0000 7f3c003fc700 1 --2- 172.21.15.163:0/348554974 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f3bf80feb10 0x7f3bf8195910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:17:38.927 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:17:38.859+0000 7f3c003fc700 1 --2- 172.21.15.163:0/348554974 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3bf80ffd00 0x7f3bf8195e50 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:17:38.927 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:17:38.859+0000 7f3c003fc700 1 -- 172.21.15.163:0/348554974 >> 172.21.15.163:0/348554974 conn(0x7f3bf80fa130 msgr2=0x7f3bf8067820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:17:38.927 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:17:38.859+0000 7f3c003fc700 1 -- 172.21.15.163:0/348554974 shutdown_connections 2023-07-14T18:17:38.928 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:17:38.859+0000 7f3c003fc700 1 -- 172.21.15.163:0/348554974 wait complete. 2023-07-14T18:17:38.928 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:17:38 smithi163 ceph-mon[96576]: pgmap v449: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 938 B/s wr, 9 op/s 2023-07-14T18:17:38.929 INFO:tasks.cephfs.filesystem:scrub status for tag:2c53b7ef-6f30-49f0-a60d-f1f114c19d42 - {'path': '/', 'tag': '2c53b7ef-6f30-49f0-a60d-f1f114c19d42', 'options': 'recursive,force'} 2023-07-14T18:17:38.930 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:17:38 smithi184 ceph-mon[98481]: pgmap v449: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 938 B/s wr, 9 op/s 2023-07-14T18:17:39.031 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:17:38 smithi172 ceph-mon[97983]: pgmap v449: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 938 B/s wr, 9 op/s 2023-07-14T18:17:40.930 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:17:40 smithi184 ceph-mon[98481]: pgmap v450: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 938 B/s wr, 12 op/s 2023-07-14T18:17:40.973 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:17:40 smithi163 ceph-mon[96576]: pgmap v450: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 938 B/s wr, 12 op/s 2023-07-14T18:17:41.031 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:17:40 smithi172 ceph-mon[97983]: pgmap v450: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 938 B/s wr, 12 op/s 2023-07-14T18:17:42.180 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:17:41 smithi184 ceph-mon[98481]: pgmap v451: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 1023 B/s wr, 9 op/s 2023-07-14T18:17:42.223 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:17:41 smithi163 ceph-mon[96576]: pgmap v451: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 1023 B/s wr, 9 op/s 2023-07-14T18:17:42.281 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:17:41 smithi172 ceph-mon[97983]: pgmap v451: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 1023 B/s wr, 9 op/s 2023-07-14T18:17:44.614 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:17:44 smithi163 ceph-mon[96576]: pgmap v452: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 255 B/s wr, 11 op/s 2023-07-14T18:17:44.930 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:17:44 smithi184 ceph-mon[98481]: pgmap v452: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 255 B/s wr, 11 op/s 2023-07-14T18:17:45.031 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:17:44 smithi172 ceph-mon[97983]: pgmap v452: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 255 B/s wr, 11 op/s 2023-07-14T18:17:46.930 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:17:46 smithi184 ceph-mon[98481]: pgmap v453: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 170 B/s wr, 9 op/s 2023-07-14T18:17:46.973 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:17:46 smithi163 ceph-mon[96576]: pgmap v453: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 170 B/s wr, 9 op/s 2023-07-14T18:17:47.031 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:17:46 smithi172 ceph-mon[97983]: pgmap v453: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 170 B/s wr, 9 op/s 2023-07-14T18:17:48.931 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:17:48 smithi184 ceph-mon[98481]: pgmap v454: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 170 B/s wr, 8 op/s 2023-07-14T18:17:48.973 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:17:48 smithi163 ceph-mon[96576]: pgmap v454: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 170 B/s wr, 8 op/s 2023-07-14T18:17:49.031 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:17:48 smithi172 ceph-mon[97983]: pgmap v454: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 170 B/s wr, 8 op/s 2023-07-14T18:17:50.930 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:17:50 smithi184 ceph-mon[98481]: pgmap v455: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 170 B/s wr, 11 op/s 2023-07-14T18:17:50.973 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:17:50 smithi163 ceph-mon[96576]: pgmap v455: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 170 B/s wr, 11 op/s 2023-07-14T18:17:51.031 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:17:50 smithi172 ceph-mon[97983]: pgmap v455: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 170 B/s wr, 11 op/s 2023-07-14T18:17:52.180 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:17:51 smithi184 ceph-mon[98481]: pgmap v456: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 170 B/s wr, 9 op/s 2023-07-14T18:17:52.223 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:17:51 smithi163 ceph-mon[96576]: pgmap v456: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 170 B/s wr, 9 op/s 2023-07-14T18:17:52.281 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:17:51 smithi172 ceph-mon[97983]: pgmap v456: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 170 B/s wr, 9 op/s 2023-07-14T18:17:54.930 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:17:54 smithi184 ceph-mon[98481]: pgmap v457: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-07-14T18:17:54.973 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:17:54 smithi163 ceph-mon[96576]: pgmap v457: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-07-14T18:17:55.031 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:17:54 smithi172 ceph-mon[97983]: pgmap v457: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-07-14T18:17:56.930 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:17:56 smithi184 ceph-mon[98481]: pgmap v458: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-07-14T18:17:56.973 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:17:56 smithi163 ceph-mon[96576]: pgmap v458: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-07-14T18:17:57.031 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:17:56 smithi172 ceph-mon[97983]: pgmap v458: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-07-14T18:17:58.931 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:17:58 smithi184 ceph-mon[98481]: pgmap v459: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-07-14T18:17:58.973 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:17:58 smithi163 ceph-mon[96576]: pgmap v459: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-07-14T18:17:59.031 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:17:58 smithi172 ceph-mon[97983]: pgmap v459: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-07-14T18:18:00.930 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:18:00 smithi184 ceph-mon[98481]: pgmap v460: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-07-14T18:18:00.973 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:18:00 smithi163 ceph-mon[96576]: pgmap v460: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-07-14T18:18:01.031 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:18:00 smithi172 ceph-mon[97983]: pgmap v460: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-07-14T18:18:02.181 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:18:01 smithi184 ceph-mon[98481]: pgmap v461: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-07-14T18:18:02.223 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:18:01 smithi163 ceph-mon[96576]: pgmap v461: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-07-14T18:18:02.281 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:18:01 smithi172 ceph-mon[97983]: pgmap v461: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-07-14T18:18:04.931 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:18:04 smithi184 ceph-mon[98481]: pgmap v462: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-07-14T18:18:04.973 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:18:04 smithi163 ceph-mon[96576]: pgmap v462: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-07-14T18:18:05.031 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:18:04 smithi172 ceph-mon[97983]: pgmap v462: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-07-14T18:18:06.931 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:18:06 smithi184 ceph-mon[98481]: pgmap v463: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-07-14T18:18:06.973 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:18:06 smithi163 ceph-mon[96576]: pgmap v463: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-07-14T18:18:07.032 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:18:06 smithi172 ceph-mon[97983]: pgmap v463: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-07-14T18:18:08.930 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-07-14T18:18:08.932 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:18:08 smithi184 ceph-mon[98481]: pgmap v464: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-07-14T18:18:08.956 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:18:08 smithi163 ceph-mon[96576]: pgmap v464: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-07-14T18:18:09.031 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:18:08 smithi172 ceph-mon[97983]: pgmap v464: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-07-14T18:18:09.075 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:18:09.028+0000 7f225069d700 1 -- 172.21.15.163:0/1283033052 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f22480feb10 msgr2=0x7f22480fef20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:18:09.076 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:18:09.028+0000 7f225069d700 1 --2- 172.21.15.163:0/1283033052 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f22480feb10 0x7f22480fef20 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7f2244009990 tx=0x7f2244009ca0 comp rx=0 tx=0).stop 2023-07-14T18:18:09.076 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:18:09.028+0000 7f225069d700 1 -- 172.21.15.163:0/1283033052 shutdown_connections 2023-07-14T18:18:09.076 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:18:09.028+0000 7f225069d700 1 --2- 172.21.15.163:0/1283033052 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2248100690 0x7f2248106f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:18:09.077 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:18:09.028+0000 7f225069d700 1 --2- 172.21.15.163:0/1283033052 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f22480feb10 0x7f22480fef20 unknown :-1 s=CLOSED pgs=686 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:18:09.077 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:18:09.028+0000 7f225069d700 1 --2- 172.21.15.163:0/1283033052 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f22480ffd00 0x7f2248100150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:18:09.077 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:18:09.028+0000 7f225069d700 1 -- 172.21.15.163:0/1283033052 >> 172.21.15.163:0/1283033052 conn(0x7f22480fa130 msgr2=0x7f22480fc560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:18:09.077 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:18:09.028+0000 7f225069d700 1 -- 172.21.15.163:0/1283033052 shutdown_connections 2023-07-14T18:18:09.077 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:18:09.029+0000 7f225069d700 1 -- 172.21.15.163:0/1283033052 wait complete. 2023-07-14T18:18:09.079 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:18:09.029+0000 7f225069d700 1 Processor -- start 2023-07-14T18:18:09.079 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:18:09.029+0000 7f225069d700 1 -- start start 2023-07-14T18:18:09.080 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:18:09.029+0000 7f225069d700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f22480feb10 0x7f2248195880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:18:09.080 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:18:09.029+0000 7f225069d700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f22480ffd00 0x7f2248195dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:18:09.080 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:18:09.029+0000 7f225069d700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2248100690 0x7f224819ce30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:18:09.080 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:18:09.029+0000 7f225069d700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f224819d400 con 0x7f22480feb10 2023-07-14T18:18:09.080 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:18:09.029+0000 7f225069d700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f224819d540 con 0x7f22480ffd00 2023-07-14T18:18:09.081 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:18:09.029+0000 7f225069d700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f224819d6d0 con 0x7f2248100690 2023-07-14T18:18:09.081 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:18:09.029+0000 7f224e439700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f22480feb10 0x7f2248195880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:18:09.081 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:18:09.029+0000 7f224e439700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f22480feb10 0x7f2248195880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:59726/0 (socket says 172.21.15.163:59726) 2023-07-14T18:18:09.081 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:18:09.029+0000 7f224e439700 1 -- 172.21.15.163:0/808572392 learned_addr learned my addr 172.21.15.163:0/808572392 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:18:09.081 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:18:09.030+0000 7f224ec3a700 1 --2- 172.21.15.163:0/808572392 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2248100690 0x7f224819ce30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:18:09.082 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:18:09.030+0000 7f224dc38700 1 --2- 172.21.15.163:0/808572392 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f22480ffd00 0x7f2248195dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:18:09.082 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:18:09.030+0000 7f224ec3a700 1 -- 172.21.15.163:0/808572392 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f22480ffd00 msgr2=0x7f2248195dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:18:09.082 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:18:09.030+0000 7f224ec3a700 1 --2- 172.21.15.163:0/808572392 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f22480ffd00 0x7f2248195dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:18:09.082 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:18:09.030+0000 7f224ec3a700 1 -- 172.21.15.163:0/808572392 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f22480feb10 msgr2=0x7f2248195880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:18:09.082 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:18:09.030+0000 7f224ec3a700 1 --2- 172.21.15.163:0/808572392 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f22480feb10 0x7f2248195880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:18:09.083 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:18:09.030+0000 7f224ec3a700 1 -- 172.21.15.163:0/808572392 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22440095f0 con 0x7f2248100690 2023-07-14T18:18:09.083 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:18:09.030+0000 7f224e439700 1 --2- 172.21.15.163:0/808572392 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f22480feb10 0x7f2248195880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T18:18:09.083 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:18:09.030+0000 7f224dc38700 1 --2- 172.21.15.163:0/808572392 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f22480ffd00 0x7f2248195dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T18:18:09.083 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:18:09.030+0000 7f224ec3a700 1 --2- 172.21.15.163:0/808572392 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2248100690 0x7f224819ce30 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f224000efc0 tx=0x7f224000c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:18:09.083 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:18:09.030+0000 7f223f7fe700 1 -- 172.21.15.163:0/808572392 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2240018070 con 0x7f2248100690 2023-07-14T18:18:09.083 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:18:09.030+0000 7f225069d700 1 -- 172.21.15.163:0/808572392 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f224819d950 con 0x7f2248100690 2023-07-14T18:18:09.084 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:18:09.030+0000 7f223f7fe700 1 -- 172.21.15.163:0/808572392 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f224000f040 con 0x7f2248100690 2023-07-14T18:18:09.084 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:18:09.030+0000 7f223f7fe700 1 -- 172.21.15.163:0/808572392 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f224000cba0 con 0x7f2248100690 2023-07-14T18:18:09.084 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:18:09.030+0000 7f225069d700 1 -- 172.21.15.163:0/808572392 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f224819deb0 con 0x7f2248100690 2023-07-14T18:18:09.088 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:18:09.033+0000 7f223f7fe700 1 -- 172.21.15.163:0/808572392 <== mon.1 v2:172.21.15.184:3300/0 4 ==== mgrmap(e 18) v1 ==== 135716+0+0 (secure 0 0 0) 0x7f2240003a00 con 0x7f2248100690 2023-07-14T18:18:09.089 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:18:09.034+0000 7f223f7fe700 1 --2- 172.21.15.163:0/808572392 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f22340a1150 0x7f22340a3600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:18:09.089 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:18:09.034+0000 7f224e439700 1 --2- 172.21.15.163:0/808572392 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f22340a1150 0x7f22340a3600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:18:09.089 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:18:09.034+0000 7f223f7fe700 1 -- 172.21.15.163:0/808572392 <== mon.1 v2:172.21.15.184:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 9049+0+0 (secure 0 0 0) 0x7f22400cc6e0 con 0x7f2248100690 2023-07-14T18:18:09.089 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:18:09.034+0000 7f224e439700 1 --2- 172.21.15.163:0/808572392 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f22340a1150 0x7f22340a3600 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f224400b2e0 tx=0x7f2244004500 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:18:09.089 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:18:09.035+0000 7f225c835b80 1 Processor -- start 2023-07-14T18:18:09.090 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:18:09.035+0000 7f225c835b80 1 -- start start 2023-07-14T18:18:09.090 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:18:09.035+0000 7f225c835b80 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55b8186f9f60 0x55b8186fa370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:18:09.090 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:18:09.035+0000 7f225c835b80 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55b8186fa8b0 0x55b8186faed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:18:09.090 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:18:09.035+0000 7f225c835b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b8186fb4b0 0x55b8186fb920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:18:09.090 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:18:09.035+0000 7f225c835b80 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b8185fecb0 con 0x55b8186fa8b0 2023-07-14T18:18:09.091 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:18:09.035+0000 7f225c835b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b818651a40 con 0x55b8186fb4b0 2023-07-14T18:18:09.091 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:18:09.035+0000 7f225c835b80 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b81864aed0 con 0x55b8186f9f60 2023-07-14T18:18:09.091 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:18:09.035+0000 7f224dc38700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55b8186fa8b0 0x55b8186faed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:18:09.091 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:18:09.035+0000 7f224e439700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55b8186f9f60 0x55b8186fa370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:18:09.091 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:18:09.035+0000 7f224dc38700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55b8186fa8b0 0x55b8186faed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:59736/0 (socket says 172.21.15.163:59736) 2023-07-14T18:18:09.092 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:18:09.035+0000 7f224dc38700 1 -- 172.21.15.163:0/3524367229 learned_addr learned my addr 172.21.15.163:0/3524367229 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:18:09.092 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:18:09.036+0000 7f224ec3a700 1 --2- 172.21.15.163:0/3524367229 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b8186fb4b0 0x55b8186fb920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:18:09.092 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:18:09.036+0000 7f224dc38700 1 -- 172.21.15.163:0/3524367229 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55b8186f9f60 msgr2=0x55b8186fa370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:18:09.092 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:18:09.036+0000 7f224dc38700 1 --2- 172.21.15.163:0/3524367229 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55b8186f9f60 0x55b8186fa370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:18:09.092 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:18:09.036+0000 7f224dc38700 1 -- 172.21.15.163:0/3524367229 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b8186fb4b0 msgr2=0x55b8186fb920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:18:09.093 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:18:09.036+0000 7f224dc38700 1 --2- 172.21.15.163:0/3524367229 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b8186fb4b0 0x55b8186fb920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:18:09.093 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:18:09.036+0000 7f224dc38700 1 -- 172.21.15.163:0/3524367229 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b818478de0 con 0x55b8186fa8b0 2023-07-14T18:18:09.093 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:18:09.036+0000 7f224e439700 1 --2- 172.21.15.163:0/3524367229 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55b8186f9f60 0x55b8186fa370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T18:18:09.093 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:18:09.036+0000 7f224dc38700 1 --2- 172.21.15.163:0/3524367229 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55b8186fa8b0 0x55b8186faed0 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7f22380115f0 tx=0x7f2238011900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7efa00f5a2c3f39a server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:18:09.093 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:18:09.036+0000 7f223cff9700 1 -- 172.21.15.163:0/3524367229 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2238019630 con 0x55b8186fa8b0 2023-07-14T18:18:09.094 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:18:09.036+0000 7f223cff9700 1 -- 172.21.15.163:0/3524367229 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f2238019c20 con 0x55b8186fa8b0 2023-07-14T18:18:09.094 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:18:09.036+0000 7f223cff9700 1 -- 172.21.15.163:0/3524367229 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f223800eae0 con 0x55b8186fa8b0 2023-07-14T18:18:09.094 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:18:09.037+0000 7f225c835b80 1 -- 172.21.15.163:0/3524367229 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55b8186fa8b0 msgr2=0x55b8186faed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:18:09.094 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:18:09.037+0000 7f225c835b80 1 --2- 172.21.15.163:0/3524367229 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55b8186fa8b0 0x55b8186faed0 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7f22380115f0 tx=0x7f2238011900 comp rx=0 tx=0).stop 2023-07-14T18:18:09.094 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:18:09.037+0000 7f225c835b80 1 -- 172.21.15.163:0/3524367229 shutdown_connections 2023-07-14T18:18:09.095 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:18:09.037+0000 7f225c835b80 1 --2- 172.21.15.163:0/3524367229 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55b8186f9f60 0x55b8186fa370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:18:09.095 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:18:09.037+0000 7f225c835b80 1 --2- 172.21.15.163:0/3524367229 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b8186fb4b0 0x55b8186fb920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:18:09.095 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:18:09.037+0000 7f225c835b80 1 --2- 172.21.15.163:0/3524367229 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55b8186fa8b0 0x55b8186faed0 unknown :-1 s=CLOSED pgs=687 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:18:09.095 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:18:09.037+0000 7f225c835b80 1 -- 172.21.15.163:0/3524367229 >> 172.21.15.163:0/3524367229 conn(0x55b8186ef680 msgr2=0x55b8186f49d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:18:09.095 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:18:09.037+0000 7f225c835b80 1 -- 172.21.15.163:0/3524367229 shutdown_connections 2023-07-14T18:18:09.096 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:18:09.037+0000 7f225c835b80 1 -- 172.21.15.163:0/3524367229 wait complete. 2023-07-14T18:18:09.096 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:18:09.037+0000 7f225c835b80 1 -- start start 2023-07-14T18:18:09.096 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:18:09.038+0000 7f225c835b80 1 Processor -- start 2023-07-14T18:18:09.096 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:18:09.038+0000 7f225c835b80 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55b8186f9f60 0x55b818703970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:18:09.096 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:18:09.038+0000 7f225c835b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b8186fa8b0 0x55b818703eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:18:09.097 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:18:09.038+0000 7f225c835b80 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55b8186fb4b0 0x55b81870aef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:18:09.097 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:18:09.038+0000 7f225c835b80 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b8185eaac0 con 0x55b8186f9f60 2023-07-14T18:18:09.097 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:18:09.038+0000 7f225c835b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b8185ea7c0 con 0x55b8186fa8b0 2023-07-14T18:18:09.097 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:18:09.038+0000 7f225c835b80 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b8184ce920 con 0x55b8186fb4b0 2023-07-14T18:18:09.097 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:18:09.038+0000 7f225c835b80 10 client.0 _ll_register_callbacks cb 0x55b8185e8760 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T18:18:09.098 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:18:09.038+0000 7f224e439700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55b8186f9f60 0x55b818703970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:18:09.098 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:18:09.038+0000 7f224e439700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55b8186f9f60 0x55b818703970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:59740/0 (socket says 172.21.15.163:59740) 2023-07-14T18:18:09.098 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:18:09.038+0000 7f224e439700 1 -- 172.21.15.163:0/491351582 learned_addr learned my addr 172.21.15.163:0/491351582 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:18:09.098 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:18:09.038+0000 7f224dc38700 1 --2- 172.21.15.163:0/491351582 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b8186fa8b0 0x55b818703eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:18:09.098 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:18:09.038+0000 7f224ec3a700 1 --2- 172.21.15.163:0/491351582 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55b8186fb4b0 0x55b81870aef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:18:09.099 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:18:09.038+0000 7f224e439700 1 -- 172.21.15.163:0/491351582 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55b8186fb4b0 msgr2=0x55b81870aef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:18:09.099 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:18:09.038+0000 7f224e439700 1 --2- 172.21.15.163:0/491351582 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55b8186fb4b0 0x55b81870aef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:18:09.099 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:18:09.038+0000 7f224e439700 1 -- 172.21.15.163:0/491351582 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b8186fa8b0 msgr2=0x55b818703eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:18:09.099 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:18:09.038+0000 7f224e439700 1 --2- 172.21.15.163:0/491351582 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b8186fa8b0 0x55b818703eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:18:09.099 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:18:09.038+0000 7f224e439700 1 -- 172.21.15.163:0/491351582 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2248107880 con 0x55b8186f9f60 2023-07-14T18:18:09.099 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:18:09.039+0000 7f224e439700 1 --2- 172.21.15.163:0/491351582 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55b8186f9f60 0x55b818703970 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7f224400baf0 tx=0x7f224401a050 comp rx=0 tx=0).ready entity=mon.0 client_cookie=498b887ea92f821a server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:18:09.100 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:18:09.039+0000 7f2231ffb700 10 client.0 ms_handle_connect on v2:172.21.15.163:3300/0 2023-07-14T18:18:09.100 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:18:09.039+0000 7f2231ffb700 1 -- 172.21.15.163:0/491351582 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f224402b050 con 0x55b8186f9f60 2023-07-14T18:18:09.100 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:18:09.039+0000 7f225c835b80 1 -- 172.21.15.163:0/491351582 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55b8185a44f0 con 0x55b8186f9f60 2023-07-14T18:18:09.100 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:18:09.039+0000 7f2231ffb700 1 -- 172.21.15.163:0/491351582 <== mon.0 v2:172.21.15.163:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 9049+0+0 (secure 0 0 0) 0x7f224400fc80 con 0x55b8186f9f60 2023-07-14T18:18:09.100 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:18:09.039+0000 7f2231ffb700 1 -- 172.21.15.163:0/491351582 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) v2 ==== 24+0+0 (secure 0 0 0) 0x7f224400fe40 con 0x55b8186f9f60 2023-07-14T18:18:09.101 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:18:09.039+0000 7f225c835b80 10 client.16374 fetch_fsmap learned FSMap version 33 2023-07-14T18:18:09.101 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:18:09.039+0000 7f225c835b80 1 -- 172.21.15.163:0/491351582 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) v3 -- 0x7f2238009dd0 con 0x55b8186f9f60 2023-07-14T18:18:09.101 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:18:09.039+0000 7f2231ffb700 1 -- 172.21.15.163:0/491351582 <== mon.0 v2:172.21.15.163:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55b8185a44f0 con 0x55b8186f9f60 2023-07-14T18:18:09.101 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:18:09.039+0000 7f2231ffb700 1 -- 172.21.15.163:0/491351582 <== mon.0 v2:172.21.15.163:3300/0 5 ==== fsmap(e 33) v1 ==== 7502+0+0 (secure 0 0 0) 0x7f2244030400 con 0x55b8186f9f60 2023-07-14T18:18:09.101 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:18:09.039+0000 7f225c835b80 10 client.16374 fetch_fsmap finished waiting for FSMap version 33 2023-07-14T18:18:09.102 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:18:09.039+0000 7f225c835b80 10 client.16374 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-07-14T18:18:09.102 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:18:09.039+0000 7f225c835b80 20 client.16374 populate_metadata read hostname 'smithi163' 2023-07-14T18:18:09.102 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:18:09.039+0000 7f225c835b80 1 --2- 172.21.15.163:0/491351582 >> [v2:172.21.15.172:6838/3850440096,v1:172.21.15.172:6839/3850440096] conn(0x55b81870f820 0x55b818711c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:18:09.102 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:18:09.039+0000 7f225c835b80 4 client.16374 mds_command: new command op to 24518 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-14T18:18:09.102 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:18:09.039+0000 7f225c835b80 1 -- 172.21.15.163:0/491351582 --> [v2:172.21.15.172:6838/3850440096,v1:172.21.15.172:6839/3850440096] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55b8186c8da0 con 0x55b81870f820 2023-07-14T18:18:09.103 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:18:09.040+0000 7f224dc38700 1 --2- 172.21.15.163:0/491351582 >> [v2:172.21.15.172:6838/3850440096,v1:172.21.15.172:6839/3850440096] conn(0x55b81870f820 0x55b818711c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:18:09.103 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:18:09.040+0000 7f224dc38700 1 --2- 172.21.15.163:0/491351582 >> [v2:172.21.15.172:6838/3850440096,v1:172.21.15.172:6839/3850440096] conn(0x55b81870f820 0x55b818711c30 crc :-1 s=READY pgs=79 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5c26fe411762688f server_cookie=5d3b381240d11314 in_seq=0 out_seq=0 2023-07-14T18:18:09.103 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:18:09.040+0000 7f2231ffb700 10 client.16374 ms_handle_connect on v2:172.21.15.172:6838/3850440096 2023-07-14T18:18:09.103 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:18:09.041+0000 7f2231ffb700 1 -- 172.21.15.163:0/491351582 <== mds.0 v2:172.21.15.172:6838/3850440096 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18017 (crc 0 0 0) 0x55b8186c8da0 con 0x55b81870f820 2023-07-14T18:18:09.104 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:18:09.041+0000 7f2231ffb700 10 client.16374 handle_command_reply: tid=0 2023-07-14T18:18:09.104 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:18:09.041+0000 7f225c835b80 1 client.16374 shutdown 2023-07-14T18:18:09.104 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:18:09.041+0000 7f225c835b80 1 -- 172.21.15.163:0/491351582 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55b8186f9f60 msgr2=0x55b818703970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:18:09.104 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:18:09.041+0000 7f225c835b80 1 --2- 172.21.15.163:0/491351582 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55b8186f9f60 0x55b818703970 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7f224400baf0 tx=0x7f224401a050 comp rx=0 tx=0).stop 2023-07-14T18:18:09.105 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:18:09.041+0000 7f225c835b80 1 -- 172.21.15.163:0/491351582 shutdown_connections 2023-07-14T18:18:09.105 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:18:09.041+0000 7f225c835b80 1 --2- 172.21.15.163:0/491351582 >> [v2:172.21.15.172:6838/3850440096,v1:172.21.15.172:6839/3850440096] conn(0x55b81870f820 0x55b818711c30 crc :-1 s=READY pgs=79 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:18:09.105 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:18:09.041+0000 7f225c835b80 1 --2- 172.21.15.163:0/491351582 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55b8186fb4b0 0x55b81870aef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:18:09.105 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:18:09.041+0000 7f2231ffb700 0 client.16374 ms_handle_reset on v2:172.21.15.172:6838/3850440096 2023-07-14T18:18:09.105 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:18:09.041+0000 7f225c835b80 1 --2- 172.21.15.163:0/491351582 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55b8186f9f60 0x55b818703970 unknown :-1 s=CLOSED pgs=688 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:18:09.106 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:18:09.041+0000 7f225c835b80 1 --2- 172.21.15.163:0/491351582 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b8186fa8b0 0x55b818703eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:18:09.106 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:18:09.041+0000 7f225c835b80 1 -- 172.21.15.163:0/491351582 >> 172.21.15.163:0/491351582 conn(0x55b8186ef680 msgr2=0x55b8186f3650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:18:09.106 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:18:09.041+0000 7f225c835b80 1 -- 172.21.15.163:0/491351582 shutdown_connections 2023-07-14T18:18:09.106 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:18:09.041+0000 7f225c835b80 1 -- 172.21.15.163:0/491351582 wait complete. 2023-07-14T18:18:09.106 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:18:09.041+0000 7f225c835b80 20 client.16374 trim_cache size 0 max 16384 2023-07-14T18:18:09.108 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:18:09.060+0000 7f225c835b80 1 Processor -- start 2023-07-14T18:18:09.109 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:18:09.060+0000 7f225c835b80 1 -- start start 2023-07-14T18:18:09.109 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:18:09.061+0000 7f225c835b80 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55b8186f9f60 0x55b818701840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:18:09.109 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:18:09.061+0000 7f225c835b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b8186fa8b0 0x55b818701d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:18:09.109 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:18:09.061+0000 7f225c835b80 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55b8186fb4b0 0x55b81870aeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:18:09.110 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:18:09.061+0000 7f225c835b80 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b8187023a0 con 0x55b8186f9f60 2023-07-14T18:18:09.110 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:18:09.061+0000 7f225c835b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b818704980 con 0x55b8186fa8b0 2023-07-14T18:18:09.110 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:18:09.061+0000 7f225c835b80 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b8186facf0 con 0x55b8186fb4b0 2023-07-14T18:18:09.110 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:18:09.061+0000 7f224e439700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55b8186f9f60 0x55b818701840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:18:09.111 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:18:09.061+0000 7f224dc38700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b8186fa8b0 0x55b818701d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:18:09.111 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:18:09.061+0000 7f224e439700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55b8186f9f60 0x55b818701840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:59748/0 (socket says 172.21.15.163:59748) 2023-07-14T18:18:09.111 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:18:09.061+0000 7f224e439700 1 -- 172.21.15.163:0/1872812052 learned_addr learned my addr 172.21.15.163:0/1872812052 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:18:09.111 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:18:09.061+0000 7f224ec3a700 1 --2- 172.21.15.163:0/1872812052 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55b8186fb4b0 0x55b81870aeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:18:09.111 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:18:09.061+0000 7f224e439700 1 -- 172.21.15.163:0/1872812052 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55b8186fb4b0 msgr2=0x55b81870aeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:18:09.112 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:18:09.061+0000 7f224e439700 1 --2- 172.21.15.163:0/1872812052 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55b8186fb4b0 0x55b81870aeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:18:09.112 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:18:09.061+0000 7f224e439700 1 -- 172.21.15.163:0/1872812052 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b8186fa8b0 msgr2=0x55b818701d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:18:09.112 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:18:09.061+0000 7f224e439700 1 --2- 172.21.15.163:0/1872812052 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b8186fa8b0 0x55b818701d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:18:09.112 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:18:09.061+0000 7f224e439700 1 -- 172.21.15.163:0/1872812052 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b818461c60 con 0x55b8186f9f60 2023-07-14T18:18:09.113 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:18:09.061+0000 7f224dc38700 1 --2- 172.21.15.163:0/1872812052 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b8186fa8b0 0x55b818701d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T18:18:09.113 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:18:09.061+0000 7f224e439700 1 --2- 172.21.15.163:0/1872812052 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55b8186f9f60 0x55b818701840 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7f2244005f50 tx=0x7f2244003ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=185d877e675f40b6 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:18:09.113 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:18:09.061+0000 7f223d7fa700 1 -- 172.21.15.163:0/1872812052 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f224402b070 con 0x55b8186f9f60 2023-07-14T18:18:09.113 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:18:09.061+0000 7f223d7fa700 1 -- 172.21.15.163:0/1872812052 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f224402c040 con 0x55b8186f9f60 2023-07-14T18:18:09.113 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:18:09.061+0000 7f223d7fa700 1 -- 172.21.15.163:0/1872812052 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f224403a660 con 0x55b8186f9f60 2023-07-14T18:18:09.116 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:18:09.062+0000 7f225c835b80 1 -- 172.21.15.163:0/1872812052 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55b8186f9f60 msgr2=0x55b818701840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:18:09.116 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:18:09.062+0000 7f225c835b80 1 --2- 172.21.15.163:0/1872812052 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55b8186f9f60 0x55b818701840 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7f2244005f50 tx=0x7f2244003ab0 comp rx=0 tx=0).stop 2023-07-14T18:18:09.117 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:18:09.062+0000 7f225c835b80 1 -- 172.21.15.163:0/1872812052 shutdown_connections 2023-07-14T18:18:09.117 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:18:09.062+0000 7f225c835b80 1 --2- 172.21.15.163:0/1872812052 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55b8186fb4b0 0x55b81870aeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:18:09.117 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:18:09.062+0000 7f225c835b80 1 --2- 172.21.15.163:0/1872812052 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55b8186f9f60 0x55b818701840 unknown :-1 s=CLOSED pgs=689 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:18:09.117 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:18:09.062+0000 7f225c835b80 1 --2- 172.21.15.163:0/1872812052 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b8186fa8b0 0x55b818701d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:18:09.118 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:18:09.062+0000 7f225c835b80 1 -- 172.21.15.163:0/1872812052 >> 172.21.15.163:0/1872812052 conn(0x55b8186ef680 msgr2=0x55b81870b7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:18:09.118 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:18:09.062+0000 7f225c835b80 1 -- 172.21.15.163:0/1872812052 shutdown_connections 2023-07-14T18:18:09.118 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:18:09.062+0000 7f225c835b80 1 -- 172.21.15.163:0/1872812052 wait complete. 2023-07-14T18:18:09.118 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:18:09.062+0000 7f225c835b80 1 -- start start 2023-07-14T18:18:09.118 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:18:09.063+0000 7f225c835b80 1 Processor -- start 2023-07-14T18:18:09.118 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:18:09.063+0000 7f225c835b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b8186f9f60 0x55b81870a8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:18:09.119 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:18:09.063+0000 7f225c835b80 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55b8186fa8b0 0x55b81870ae00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:18:09.119 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:18:09.063+0000 7f225c835b80 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55b8186fb4b0 0x55b8187073e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:18:09.119 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:18:09.063+0000 7f225c835b80 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b818707b40 con 0x55b8186fb4b0 2023-07-14T18:18:09.119 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:18:09.063+0000 7f225c835b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b818707cb0 con 0x55b8186f9f60 2023-07-14T18:18:09.119 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:18:09.063+0000 7f225c835b80 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b818707e70 con 0x55b8186fa8b0 2023-07-14T18:18:09.120 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:18:09.063+0000 7f225c835b80 10 client.0 _ll_register_callbacks cb 0x7f224400b6b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T18:18:09.120 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:18:09.063+0000 7f224ec3a700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55b8186fb4b0 0x55b8187073e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:18:09.120 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:18:09.063+0000 7f224e439700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b8186f9f60 0x55b81870a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:18:09.120 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:18:09.063+0000 7f224ec3a700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55b8186fb4b0 0x55b8187073e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:59758/0 (socket says 172.21.15.163:59758) 2023-07-14T18:18:09.120 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:18:09.063+0000 7f224ec3a700 1 -- 172.21.15.163:0/872196414 learned_addr learned my addr 172.21.15.163:0/872196414 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:18:09.121 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:18:09.063+0000 7f224e439700 1 --2- 172.21.15.163:0/872196414 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b8186f9f60 0x55b81870a8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.163:60438/0 (socket says 172.21.15.163:60438) 2023-07-14T18:18:09.121 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:18:09.063+0000 7f224dc38700 1 --2- 172.21.15.163:0/872196414 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55b8186fa8b0 0x55b81870ae00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:18:09.121 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:18:09.063+0000 7f224dc38700 1 -- 172.21.15.163:0/872196414 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b8186f9f60 msgr2=0x55b81870a8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:18:09.121 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:18:09.063+0000 7f224dc38700 1 --2- 172.21.15.163:0/872196414 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b8186f9f60 0x55b81870a8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:18:09.121 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:18:09.063+0000 7f224dc38700 1 -- 172.21.15.163:0/872196414 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55b8186fb4b0 msgr2=0x55b8187073e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:18:09.122 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:18:09.063+0000 7f224dc38700 1 --2- 172.21.15.163:0/872196414 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55b8186fb4b0 0x55b8187073e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:18:09.122 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:18:09.063+0000 7f224dc38700 1 -- 172.21.15.163:0/872196414 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55b818478de0 con 0x55b8186fa8b0 2023-07-14T18:18:09.122 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:18:09.063+0000 7f224ec3a700 1 --2- 172.21.15.163:0/872196414 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55b8186fb4b0 0x55b8187073e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T18:18:09.122 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:18:09.063+0000 7f224e439700 1 --2- 172.21.15.163:0/872196414 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b8186f9f60 0x55b81870a8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T18:18:09.122 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:18:09.063+0000 7f224dc38700 1 --2- 172.21.15.163:0/872196414 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55b8186fa8b0 0x55b81870ae00 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f223801c040 tx=0x7f2238005510 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c6c33df35d269d9c server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:18:09.123 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:18:09.063+0000 7f2231ffb700 10 client.0 ms_handle_connect on v2:172.21.15.184:3300/0 2023-07-14T18:18:09.123 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:18:09.064+0000 7f2231ffb700 1 -- 172.21.15.163:0/872196414 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2238029040 con 0x55b8186fa8b0 2023-07-14T18:18:09.123 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:18:09.064+0000 7f225c835b80 1 -- 172.21.15.163:0/872196414 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f2238019c20 con 0x55b8186fa8b0 2023-07-14T18:18:09.123 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:18:09.064+0000 7f2231ffb700 1 -- 172.21.15.163:0/872196414 <== mon.1 v2:172.21.15.184:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 9049+0+0 (secure 0 0 0) 0x7f2238009260 con 0x55b8186fa8b0 2023-07-14T18:18:09.123 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:18:09.064+0000 7f2231ffb700 1 -- 172.21.15.163:0/872196414 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2238019630 con 0x55b8186fa8b0 2023-07-14T18:18:09.123 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:18:09.064+0000 7f225c835b80 10 client.25945 fetch_fsmap learned FSMap version 33 2023-07-14T18:18:09.124 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:18:09.064+0000 7f225c835b80 1 -- 172.21.15.163:0/872196414 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) v3 -- 0x7f2238009dd0 con 0x55b8186fa8b0 2023-07-14T18:18:09.124 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:18:09.064+0000 7f2231ffb700 1 -- 172.21.15.163:0/872196414 <== mon.1 v2:172.21.15.184:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f2238019c20 con 0x55b8186fa8b0 2023-07-14T18:18:09.124 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:18:09.064+0000 7f2231ffb700 1 -- 172.21.15.163:0/872196414 <== mon.1 v2:172.21.15.184:3300/0 5 ==== fsmap(e 33) v1 ==== 7502+0+0 (secure 0 0 0) 0x7f2238003c90 con 0x55b8186fa8b0 2023-07-14T18:18:09.124 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:18:09.064+0000 7f225c835b80 10 client.25945 fetch_fsmap finished waiting for FSMap version 33 2023-07-14T18:18:09.124 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:18:09.064+0000 7f225c835b80 10 client.25945 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-07-14T18:18:09.125 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:18:09.064+0000 7f225c835b80 20 client.25945 populate_metadata read hostname 'smithi163' 2023-07-14T18:18:09.125 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:18:09.064+0000 7f225c835b80 1 --2- 172.21.15.163:0/872196414 >> [v2:172.21.15.172:6838/3850440096,v1:172.21.15.172:6839/3850440096] conn(0x55b818764be0 0x55b818766ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:18:09.125 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:18:09.064+0000 7f225c835b80 4 client.25945 mds_command: new command op to 24518 tid=0[{"prefix": "scrub status"}] 2023-07-14T18:18:09.125 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:18:09.064+0000 7f225c835b80 1 -- 172.21.15.163:0/872196414 --> [v2:172.21.15.172:6838/3850440096,v1:172.21.15.172:6839/3850440096] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55b818643eb0 con 0x55b818764be0 2023-07-14T18:18:09.125 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:18:09.064+0000 7f224e439700 1 --2- 172.21.15.163:0/872196414 >> [v2:172.21.15.172:6838/3850440096,v1:172.21.15.172:6839/3850440096] conn(0x55b818764be0 0x55b818766ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:18:09.126 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:18:09.065+0000 7f2231ffb700 10 client.25945 ms_handle_connect on v2:172.21.15.172:6838/3850440096 2023-07-14T18:18:09.126 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:18:09.065+0000 7f224e439700 1 --2- 172.21.15.163:0/872196414 >> [v2:172.21.15.172:6838/3850440096,v1:172.21.15.172:6839/3850440096] conn(0x55b818764be0 0x55b818766ff0 crc :-1 s=READY pgs=80 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=65b55743b2147495 server_cookie=9dfa01fb194ab2ca in_seq=0 out_seq=0 2023-07-14T18:18:09.126 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:18:09.065+0000 7f2231ffb700 1 -- 172.21.15.163:0/872196414 <== mds.0 v2:172.21.15.172:6838/3850440096 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x55b818643eb0 con 0x55b818764be0 2023-07-14T18:18:09.126 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:18:09.065+0000 7f2231ffb700 10 client.25945 handle_command_reply: tid=0 2023-07-14T18:18:09.126 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:18:09.065+0000 7f225c835b80 1 client.25945 shutdown 2023-07-14T18:18:09.127 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:18:09.065+0000 7f225c835b80 1 -- 172.21.15.163:0/872196414 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55b8186fa8b0 msgr2=0x55b81870ae00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:18:09.127 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:18:09.065+0000 7f225c835b80 1 --2- 172.21.15.163:0/872196414 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55b8186fa8b0 0x55b81870ae00 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f223801c040 tx=0x7f2238005510 comp rx=0 tx=0).stop 2023-07-14T18:18:09.127 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:18:09.065+0000 7f225c835b80 1 -- 172.21.15.163:0/872196414 shutdown_connections 2023-07-14T18:18:09.127 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:18:09.065+0000 7f225c835b80 1 --2- 172.21.15.163:0/872196414 >> [v2:172.21.15.172:6838/3850440096,v1:172.21.15.172:6839/3850440096] conn(0x55b818764be0 0x55b818766ff0 crc :-1 s=READY pgs=80 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:18:09.127 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:18:09.065+0000 7f225c835b80 1 --2- 172.21.15.163:0/872196414 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55b8186fb4b0 0x55b8187073e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:18:09.128 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:18:09.065+0000 7f225c835b80 1 --2- 172.21.15.163:0/872196414 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b8186f9f60 0x55b81870a8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:18:09.128 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:18:09.065+0000 7f225c835b80 1 --2- 172.21.15.163:0/872196414 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55b8186fa8b0 0x55b81870ae00 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:18:09.128 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:18:09.065+0000 7f2231ffb700 0 client.25945 ms_handle_reset on v2:172.21.15.172:6838/3850440096 2023-07-14T18:18:09.128 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:18:09.065+0000 7f225c835b80 1 -- 172.21.15.163:0/872196414 >> 172.21.15.163:0/872196414 conn(0x55b8186ef680 msgr2=0x55b818701840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:18:09.128 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:18:09.065+0000 7f225c835b80 1 -- 172.21.15.163:0/872196414 shutdown_connections 2023-07-14T18:18:09.129 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:18:09.065+0000 7f225c835b80 1 -- 172.21.15.163:0/872196414 wait complete. 2023-07-14T18:18:09.129 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:18:09.065+0000 7f225c835b80 20 client.25945 trim_cache size 0 max 16384 2023-07-14T18:18:09.129 INFO:teuthology.orchestra.run.smithi163.stdout:{ 2023-07-14T18:18:09.129 INFO:teuthology.orchestra.run.smithi163.stdout: "status": "IDLE (waiting for more scrubs)", 2023-07-14T18:18:09.130 INFO:teuthology.orchestra.run.smithi163.stdout: "scrubs": { 2023-07-14T18:18:09.130 INFO:teuthology.orchestra.run.smithi163.stdout: "2c53b7ef-6f30-49f0-a60d-f1f114c19d42": { 2023-07-14T18:18:09.130 INFO:teuthology.orchestra.run.smithi163.stdout: "path": "/", 2023-07-14T18:18:09.130 INFO:teuthology.orchestra.run.smithi163.stdout: "tag": "2c53b7ef-6f30-49f0-a60d-f1f114c19d42", 2023-07-14T18:18:09.130 INFO:teuthology.orchestra.run.smithi163.stdout: "options": "recursive,force" 2023-07-14T18:18:09.131 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-07-14T18:18:09.131 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-07-14T18:18:09.131 INFO:teuthology.orchestra.run.smithi163.stdout:} 2023-07-14T18:18:09.132 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:18:09.066+0000 7f225069d700 1 -- 172.21.15.163:0/808572392 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f22340a1150 msgr2=0x7f22340a3600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:18:09.133 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:18:09.066+0000 7f225069d700 1 --2- 172.21.15.163:0/808572392 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f22340a1150 0x7f22340a3600 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f224400b2e0 tx=0x7f2244004500 comp rx=0 tx=0).stop 2023-07-14T18:18:09.133 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:18:09.066+0000 7f225069d700 1 -- 172.21.15.163:0/808572392 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2248100690 msgr2=0x7f224819ce30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:18:09.133 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:18:09.066+0000 7f225069d700 1 --2- 172.21.15.163:0/808572392 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2248100690 0x7f224819ce30 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f224000efc0 tx=0x7f224000c3a0 comp rx=0 tx=0).stop 2023-07-14T18:18:09.133 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:18:09.066+0000 7f225069d700 1 -- 172.21.15.163:0/808572392 shutdown_connections 2023-07-14T18:18:09.134 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:18:09.066+0000 7f225069d700 1 --2- 172.21.15.163:0/808572392 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f22340a1150 0x7f22340a3600 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:18:09.134 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:18:09.066+0000 7f225069d700 1 --2- 172.21.15.163:0/808572392 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2248100690 0x7f224819ce30 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:18:09.134 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:18:09.066+0000 7f225069d700 1 --2- 172.21.15.163:0/808572392 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f22480feb10 0x7f2248195880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:18:09.134 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:18:09.066+0000 7f225069d700 1 --2- 172.21.15.163:0/808572392 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f22480ffd00 0x7f2248195dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:18:09.134 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:18:09.066+0000 7f225069d700 1 -- 172.21.15.163:0/808572392 >> 172.21.15.163:0/808572392 conn(0x7f22480fa130 msgr2=0x7f2248067820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:18:09.134 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:18:09.066+0000 7f225069d700 1 -- 172.21.15.163:0/808572392 shutdown_connections 2023-07-14T18:18:09.135 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:18:09.066+0000 7f225069d700 1 -- 172.21.15.163:0/808572392 wait complete. 2023-07-14T18:18:09.135 INFO:tasks.cephfs.filesystem:scrub status for tag:2c53b7ef-6f30-49f0-a60d-f1f114c19d42 - {'path': '/', 'tag': '2c53b7ef-6f30-49f0-a60d-f1f114c19d42', 'options': 'recursive,force'} 2023-07-14T18:18:10.931 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:18:10 smithi184 ceph-mon[98481]: pgmap v465: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-07-14T18:18:10.973 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:18:10 smithi163 ceph-mon[96576]: pgmap v465: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-07-14T18:18:11.032 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:18:10 smithi172 ceph-mon[97983]: pgmap v465: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-07-14T18:18:12.181 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:18:11 smithi184 ceph-mon[98481]: pgmap v466: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-07-14T18:18:12.223 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:18:11 smithi163 ceph-mon[96576]: pgmap v466: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-07-14T18:18:12.282 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:18:11 smithi172 ceph-mon[97983]: pgmap v466: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-07-14T18:18:14.931 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:18:14 smithi184 ceph-mon[98481]: pgmap v467: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-07-14T18:18:14.973 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:18:14 smithi163 ceph-mon[96576]: pgmap v467: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-07-14T18:18:15.031 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:18:14 smithi172 ceph-mon[97983]: pgmap v467: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-07-14T18:18:16.931 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:18:16 smithi184 ceph-mon[98481]: pgmap v468: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-07-14T18:18:16.973 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:18:16 smithi163 ceph-mon[96576]: pgmap v468: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-07-14T18:18:17.032 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:18:16 smithi172 ceph-mon[97983]: pgmap v468: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-07-14T18:18:18.931 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:18:18 smithi184 ceph-mon[98481]: pgmap v469: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-07-14T18:18:18.973 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:18:18 smithi163 ceph-mon[96576]: pgmap v469: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-07-14T18:18:19.032 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:18:18 smithi172 ceph-mon[97983]: pgmap v469: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-07-14T18:18:20.931 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:18:20 smithi184 ceph-mon[98481]: pgmap v470: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-07-14T18:18:20.973 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:18:20 smithi163 ceph-mon[96576]: pgmap v470: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-07-14T18:18:21.032 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:18:20 smithi172 ceph-mon[97983]: pgmap v470: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-07-14T18:18:22.181 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:18:21 smithi184 ceph-mon[98481]: pgmap v471: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-07-14T18:18:22.223 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:18:21 smithi163 ceph-mon[96576]: pgmap v471: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-07-14T18:18:22.282 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:18:21 smithi172 ceph-mon[97983]: pgmap v471: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-07-14T18:18:23.181 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:18:22 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-14T18:18:23.181 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:18:22 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T18:18:23.181 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:18:22 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-14T18:18:23.182 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:18:22 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:18:23.223 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:18:22 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-14T18:18:23.224 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:18:22 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T18:18:23.224 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:18:22 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-14T18:18:23.224 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:18:22 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:18:23.282 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:18:22 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-14T18:18:23.282 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:18:22 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T18:18:23.282 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:18:22 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-14T18:18:23.283 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:18:22 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:18:24.181 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:18:23 smithi184 ceph-mon[98481]: pgmap v472: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-07-14T18:18:24.223 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:18:23 smithi163 ceph-mon[96576]: pgmap v472: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-07-14T18:18:24.282 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:18:23 smithi172 ceph-mon[97983]: pgmap v472: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-07-14T18:18:26.931 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:18:26 smithi184 ceph-mon[98481]: pgmap v473: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-07-14T18:18:26.973 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:18:26 smithi163 ceph-mon[96576]: pgmap v473: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-07-14T18:18:27.032 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:18:26 smithi172 ceph-mon[97983]: pgmap v473: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-07-14T18:18:28.932 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:18:28 smithi184 ceph-mon[98481]: pgmap v474: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-07-14T18:18:28.973 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:18:28 smithi163 ceph-mon[96576]: pgmap v474: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-07-14T18:18:29.032 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:18:28 smithi172 ceph-mon[97983]: pgmap v474: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-07-14T18:18:30.931 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:18:30 smithi184 ceph-mon[98481]: pgmap v475: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-07-14T18:18:30.973 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:18:30 smithi163 ceph-mon[96576]: pgmap v475: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-07-14T18:18:31.032 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:18:30 smithi172 ceph-mon[97983]: pgmap v475: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-07-14T18:18:32.181 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:18:31 smithi184 ceph-mon[98481]: pgmap v476: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-07-14T18:18:32.223 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:18:31 smithi163 ceph-mon[96576]: pgmap v476: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-07-14T18:18:32.282 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:18:31 smithi172 ceph-mon[97983]: pgmap v476: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-07-14T18:18:34.931 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:18:34 smithi184 ceph-mon[98481]: pgmap v477: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-07-14T18:18:34.973 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:18:34 smithi163 ceph-mon[96576]: pgmap v477: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-07-14T18:18:35.032 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:18:34 smithi172 ceph-mon[97983]: pgmap v477: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-07-14T18:18:36.931 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:18:36 smithi184 ceph-mon[98481]: pgmap v478: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-07-14T18:18:36.974 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:18:36 smithi163 ceph-mon[96576]: pgmap v478: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-07-14T18:18:37.032 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:18:36 smithi172 ceph-mon[97983]: pgmap v478: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-07-14T18:18:38.931 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:18:38 smithi184 ceph-mon[98481]: pgmap v479: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-07-14T18:18:38.973 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:18:38 smithi163 ceph-mon[96576]: pgmap v479: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-07-14T18:18:39.032 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:18:38 smithi172 ceph-mon[97983]: pgmap v479: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-07-14T18:18:39.136 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-07-14T18:18:39.287 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:18:39.240+0000 7f4fdcefb700 1 -- 172.21.15.163:0/456283991 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f4fd80ffc20 msgr2=0x7f4fd8100030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:18:39.288 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:18:39.240+0000 7f4fdcefb700 1 --2- 172.21.15.163:0/456283991 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f4fd80ffc20 0x7f4fd8100030 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7f4fc8009990 tx=0x7f4fc8009ca0 comp rx=0 tx=0).stop 2023-07-14T18:18:39.288 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:18:39.241+0000 7f4fdcefb700 1 -- 172.21.15.163:0/456283991 shutdown_connections 2023-07-14T18:18:39.288 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:18:39.241+0000 7f4fdcefb700 1 --2- 172.21.15.163:0/456283991 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4fd81017a0 0x7f4fd8108060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:18:39.288 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:18:39.241+0000 7f4fdcefb700 1 --2- 172.21.15.163:0/456283991 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f4fd80ffc20 0x7f4fd8100030 unknown :-1 s=CLOSED pgs=690 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:18:39.288 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:18:39.241+0000 7f4fdcefb700 1 --2- 172.21.15.163:0/456283991 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4fd8100e10 0x7f4fd8101260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:18:39.289 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:18:39.241+0000 7f4fdcefb700 1 -- 172.21.15.163:0/456283991 >> 172.21.15.163:0/456283991 conn(0x7f4fd80fb260 msgr2=0x7f4fd80fd670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:18:39.289 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:18:39.241+0000 7f4fdcefb700 1 -- 172.21.15.163:0/456283991 shutdown_connections 2023-07-14T18:18:39.289 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:18:39.241+0000 7f4fdcefb700 1 -- 172.21.15.163:0/456283991 wait complete. 2023-07-14T18:18:39.290 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:18:39.241+0000 7f4fdcefb700 1 Processor -- start 2023-07-14T18:18:39.291 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:18:39.241+0000 7f4fdcefb700 1 -- start start 2023-07-14T18:18:39.291 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:18:39.242+0000 7f4fdcefb700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f4fd80ffc20 0x7f4fd80743f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:18:39.291 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:18:39.242+0000 7f4fdcefb700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4fd8100e10 0x7f4fd8072a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:18:39.291 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:18:39.242+0000 7f4fdcefb700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4fd81017a0 0x7f4fd8072f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:18:39.292 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:18:39.242+0000 7f4fdcefb700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fd8073710 con 0x7f4fd80ffc20 2023-07-14T18:18:39.292 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:18:39.242+0000 7f4fdcefb700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fd8073880 con 0x7f4fd8100e10 2023-07-14T18:18:39.292 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:18:39.242+0000 7f4fdcefb700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fd819f870 con 0x7f4fd81017a0 2023-07-14T18:18:39.292 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:18:39.242+0000 7f4fd659c700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f4fd80ffc20 0x7f4fd80743f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:18:39.292 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:18:39.242+0000 7f4fd659c700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f4fd80ffc20 0x7f4fd80743f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:59766/0 (socket says 172.21.15.163:59766) 2023-07-14T18:18:39.293 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:18:39.242+0000 7f4fd5d9b700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4fd8100e10 0x7f4fd8072a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:18:39.293 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:18:39.242+0000 7f4fd659c700 1 -- 172.21.15.163:0/1070217190 learned_addr learned my addr 172.21.15.163:0/1070217190 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:18:39.293 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:18:39.242+0000 7f4fd6d9d700 1 --2- 172.21.15.163:0/1070217190 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4fd81017a0 0x7f4fd8072f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:18:39.293 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:18:39.242+0000 7f4fd659c700 1 -- 172.21.15.163:0/1070217190 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4fd81017a0 msgr2=0x7f4fd8072f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:18:39.294 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:18:39.242+0000 7f4fd659c700 1 --2- 172.21.15.163:0/1070217190 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4fd81017a0 0x7f4fd8072f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:18:39.294 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:18:39.242+0000 7f4fd659c700 1 -- 172.21.15.163:0/1070217190 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4fd8100e10 msgr2=0x7f4fd8072a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:18:39.294 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:18:39.242+0000 7f4fd659c700 1 --2- 172.21.15.163:0/1070217190 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4fd8100e10 0x7f4fd8072a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:18:39.294 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:18:39.242+0000 7f4fd659c700 1 -- 172.21.15.163:0/1070217190 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4fc80095f0 con 0x7f4fd80ffc20 2023-07-14T18:18:39.294 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:18:39.242+0000 7f4fd5d9b700 1 --2- 172.21.15.163:0/1070217190 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4fd8100e10 0x7f4fd8072a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T18:18:39.295 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:18:39.242+0000 7f4fd659c700 1 --2- 172.21.15.163:0/1070217190 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f4fd80ffc20 0x7f4fd80743f0 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f4fc8000c00 tx=0x7f4fc8004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:18:39.295 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:18:39.242+0000 7f4fc77fe700 1 -- 172.21.15.163:0/1070217190 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fc801d070 con 0x7f4fd80ffc20 2023-07-14T18:18:39.295 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:18:39.242+0000 7f4fc77fe700 1 -- 172.21.15.163:0/1070217190 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f4fc800bd50 con 0x7f4fd80ffc20 2023-07-14T18:18:39.295 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:18:39.242+0000 7f4fdcefb700 1 -- 172.21.15.163:0/1070217190 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4fd819faf0 con 0x7f4fd80ffc20 2023-07-14T18:18:39.295 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:18:39.243+0000 7f4fc77fe700 1 -- 172.21.15.163:0/1070217190 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fc8022cd0 con 0x7f4fd80ffc20 2023-07-14T18:18:39.296 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:18:39.243+0000 7f4fdcefb700 1 -- 172.21.15.163:0/1070217190 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4fd819ff10 con 0x7f4fd80ffc20 2023-07-14T18:18:39.300 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:18:39.245+0000 7f4fc77fe700 1 -- 172.21.15.163:0/1070217190 <== mon.0 v2:172.21.15.163:3300/0 4 ==== mgrmap(e 18) v1 ==== 135716+0+0 (secure 0 0 0) 0x7f4fc8022470 con 0x7f4fd80ffc20 2023-07-14T18:18:39.300 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:18:39.245+0000 7f4fc77fe700 1 --2- 172.21.15.163:0/1070217190 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f4fc00a1150 0x7f4fc00a3600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:18:39.300 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:18:39.245+0000 7f4fd5d9b700 1 --2- 172.21.15.163:0/1070217190 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f4fc00a1150 0x7f4fc00a3600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:18:39.300 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:18:39.245+0000 7f4fc77fe700 1 -- 172.21.15.163:0/1070217190 <== mon.0 v2:172.21.15.163:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 9049+0+0 (secure 0 0 0) 0x7f4fc80ce0f0 con 0x7f4fd80ffc20 2023-07-14T18:18:39.301 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:18:39.246+0000 7f4fd5d9b700 1 --2- 172.21.15.163:0/1070217190 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f4fc00a1150 0x7f4fc00a3600 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f4fcc011490 tx=0x7f4fcc009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:18:39.301 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:18:39.247+0000 7f4fe9093b80 1 Processor -- start 2023-07-14T18:18:39.301 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:18:39.247+0000 7f4fe9093b80 1 -- start start 2023-07-14T18:18:39.301 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:18:39.247+0000 7f4fe9093b80 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5648b3d9cf60 0x5648b3d9d370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:18:39.301 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:18:39.247+0000 7f4fe9093b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5648b3d9d8b0 0x5648b3d9ded0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:18:39.302 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:18:39.247+0000 7f4fe9093b80 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5648b3d9e4b0 0x5648b3d9e920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:18:39.302 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:18:39.247+0000 7f4fe9093b80 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x5648b3ca1cb0 con 0x5648b3d9cf60 2023-07-14T18:18:39.302 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:18:39.247+0000 7f4fe9093b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x5648b3cf4a40 con 0x5648b3d9d8b0 2023-07-14T18:18:39.302 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:18:39.247+0000 7f4fe9093b80 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x5648b3ceded0 con 0x5648b3d9e4b0 2023-07-14T18:18:39.302 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:18:39.247+0000 7f4fd659c700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5648b3d9cf60 0x5648b3d9d370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:18:39.303 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:18:39.247+0000 7f4fd5d9b700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5648b3d9d8b0 0x5648b3d9ded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:18:39.303 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:18:39.247+0000 7f4fd659c700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5648b3d9cf60 0x5648b3d9d370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:59772/0 (socket says 172.21.15.163:59772) 2023-07-14T18:18:39.303 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:18:39.247+0000 7f4fd6d9d700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5648b3d9e4b0 0x5648b3d9e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:18:39.303 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:18:39.247+0000 7f4fd5d9b700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5648b3d9d8b0 0x5648b3d9ded0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.163:60458/0 (socket says 172.21.15.163:60458) 2023-07-14T18:18:39.303 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:18:39.247+0000 7f4fd659c700 1 -- 172.21.15.163:0/1049264055 learned_addr learned my addr 172.21.15.163:0/1049264055 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:18:39.304 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:18:39.248+0000 7f4fd5d9b700 1 -- 172.21.15.163:0/1049264055 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5648b3d9e4b0 msgr2=0x5648b3d9e920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:18:39.304 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:18:39.248+0000 7f4fd5d9b700 1 --2- 172.21.15.163:0/1049264055 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5648b3d9e4b0 0x5648b3d9e920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:18:39.304 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:18:39.248+0000 7f4fd5d9b700 1 -- 172.21.15.163:0/1049264055 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5648b3d9cf60 msgr2=0x5648b3d9d370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:18:39.304 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:18:39.248+0000 7f4fd5d9b700 1 --2- 172.21.15.163:0/1049264055 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5648b3d9cf60 0x5648b3d9d370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:18:39.304 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:18:39.248+0000 7f4fd5d9b700 1 -- 172.21.15.163:0/1049264055 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5648b3b1bde0 con 0x5648b3d9d8b0 2023-07-14T18:18:39.305 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:18:39.248+0000 7f4fd659c700 1 --2- 172.21.15.163:0/1049264055 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5648b3d9cf60 0x5648b3d9d370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T18:18:39.305 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:18:39.248+0000 7f4fd6d9d700 1 --2- 172.21.15.163:0/1049264055 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5648b3d9e4b0 0x5648b3d9e920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T18:18:39.305 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:18:39.248+0000 7f4fd5d9b700 1 --2- 172.21.15.163:0/1049264055 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5648b3d9d8b0 0x5648b3d9ded0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f4fcc0042f0 tx=0x7f4fcc014000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c470419dba09ea03 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:18:39.305 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:18:39.248+0000 7f4fc4ff9700 1 -- 172.21.15.163:0/1049264055 <== mon.2 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fcc003d10 con 0x5648b3d9d8b0 2023-07-14T18:18:39.305 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:18:39.248+0000 7f4fc4ff9700 1 -- 172.21.15.163:0/1049264055 <== mon.2 v2:172.21.15.172:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f4fcc003e70 con 0x5648b3d9d8b0 2023-07-14T18:18:39.306 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:18:39.248+0000 7f4fc4ff9700 1 -- 172.21.15.163:0/1049264055 <== mon.2 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fcc01e630 con 0x5648b3d9d8b0 2023-07-14T18:18:39.306 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:18:39.249+0000 7f4fe9093b80 1 -- 172.21.15.163:0/1049264055 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5648b3d9d8b0 msgr2=0x5648b3d9ded0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:18:39.306 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:18:39.249+0000 7f4fe9093b80 1 --2- 172.21.15.163:0/1049264055 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5648b3d9d8b0 0x5648b3d9ded0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f4fcc0042f0 tx=0x7f4fcc014000 comp rx=0 tx=0).stop 2023-07-14T18:18:39.306 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:18:39.249+0000 7f4fe9093b80 1 -- 172.21.15.163:0/1049264055 shutdown_connections 2023-07-14T18:18:39.306 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:18:39.249+0000 7f4fe9093b80 1 --2- 172.21.15.163:0/1049264055 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5648b3d9e4b0 0x5648b3d9e920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:18:39.306 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:18:39.249+0000 7f4fe9093b80 1 --2- 172.21.15.163:0/1049264055 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5648b3d9cf60 0x5648b3d9d370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:18:39.307 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:18:39.249+0000 7f4fe9093b80 1 --2- 172.21.15.163:0/1049264055 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5648b3d9d8b0 0x5648b3d9ded0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:18:39.307 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:18:39.249+0000 7f4fe9093b80 1 -- 172.21.15.163:0/1049264055 >> 172.21.15.163:0/1049264055 conn(0x5648b3d92680 msgr2=0x5648b3d979d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:18:39.307 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:18:39.249+0000 7f4fe9093b80 1 -- 172.21.15.163:0/1049264055 shutdown_connections 2023-07-14T18:18:39.307 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:18:39.249+0000 7f4fe9093b80 1 -- 172.21.15.163:0/1049264055 wait complete. 2023-07-14T18:18:39.307 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:18:39.249+0000 7f4fe9093b80 1 -- start start 2023-07-14T18:18:39.308 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:18:39.250+0000 7f4fe9093b80 1 Processor -- start 2023-07-14T18:18:39.308 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:18:39.250+0000 7f4fe9093b80 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5648b3d9cf60 0x5648b3da69d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:18:39.308 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:18:39.250+0000 7f4fe9093b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5648b3d9d8b0 0x5648b3da6f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:18:39.308 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:18:39.250+0000 7f4fe9093b80 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5648b3d9e4b0 0x5648b3dadf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:18:39.308 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:18:39.250+0000 7f4fe9093b80 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x5648b3c8dac0 con 0x5648b3d9cf60 2023-07-14T18:18:39.309 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:18:39.250+0000 7f4fe9093b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x5648b3c8d7c0 con 0x5648b3d9d8b0 2023-07-14T18:18:39.309 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:18:39.250+0000 7f4fe9093b80 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x5648b3b71920 con 0x5648b3d9e4b0 2023-07-14T18:18:39.309 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:18:39.250+0000 7f4fe9093b80 10 client.0 _ll_register_callbacks cb 0x5648b3c8b760 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T18:18:39.309 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:18:39.250+0000 7f4fd659c700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5648b3d9cf60 0x5648b3da69d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:18:39.309 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:18:39.250+0000 7f4fd659c700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5648b3d9cf60 0x5648b3da69d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:59778/0 (socket says 172.21.15.163:59778) 2023-07-14T18:18:39.310 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:18:39.250+0000 7f4fd5d9b700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5648b3d9d8b0 0x5648b3da6f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:18:39.310 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:18:39.250+0000 7f4fd659c700 1 -- 172.21.15.163:0/3654237552 learned_addr learned my addr 172.21.15.163:0/3654237552 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:18:39.310 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:18:39.250+0000 7f4fd6d9d700 1 --2- 172.21.15.163:0/3654237552 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5648b3d9e4b0 0x5648b3dadf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:18:39.310 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:18:39.250+0000 7f4fd659c700 1 -- 172.21.15.163:0/3654237552 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5648b3d9e4b0 msgr2=0x5648b3dadf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:18:39.310 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:18:39.250+0000 7f4fd659c700 1 --2- 172.21.15.163:0/3654237552 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5648b3d9e4b0 0x5648b3dadf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:18:39.311 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:18:39.250+0000 7f4fd659c700 1 -- 172.21.15.163:0/3654237552 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5648b3d9d8b0 msgr2=0x5648b3da6f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:18:39.311 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:18:39.250+0000 7f4fd659c700 1 --2- 172.21.15.163:0/3654237552 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5648b3d9d8b0 0x5648b3da6f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:18:39.311 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:18:39.250+0000 7f4fd659c700 1 -- 172.21.15.163:0/3654237552 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4fc8095e70 con 0x5648b3d9cf60 2023-07-14T18:18:39.311 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:18:39.250+0000 7f4fd6d9d700 1 --2- 172.21.15.163:0/3654237552 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5648b3d9e4b0 0x5648b3dadf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T18:18:39.311 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:18:39.250+0000 7f4fd5d9b700 1 --2- 172.21.15.163:0/3654237552 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5648b3d9d8b0 0x5648b3da6f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T18:18:39.312 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:18:39.250+0000 7f4fd659c700 1 --2- 172.21.15.163:0/3654237552 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5648b3d9cf60 0x5648b3da69d0 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7f4fc800bf90 tx=0x7f4fc8004320 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d574425eb19537e7 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:18:39.312 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:18:39.250+0000 7f4fbdffb700 10 client.0 ms_handle_connect on v2:172.21.15.163:3300/0 2023-07-14T18:18:39.312 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:18:39.251+0000 7f4fbdffb700 1 -- 172.21.15.163:0/3654237552 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fc809f290 con 0x5648b3d9cf60 2023-07-14T18:18:39.312 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:18:39.251+0000 7f4fbdffb700 1 -- 172.21.15.163:0/3654237552 <== mon.0 v2:172.21.15.163:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 9049+0+0 (secure 0 0 0) 0x7f4fc80a3620 con 0x5648b3d9cf60 2023-07-14T18:18:39.312 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:18:39.251+0000 7f4fe9093b80 1 -- 172.21.15.163:0/3654237552 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5648b3c474f0 con 0x5648b3d9cf60 2023-07-14T18:18:39.313 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:18:39.251+0000 7f4fbdffb700 1 -- 172.21.15.163:0/3654237552 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4fc80a3190 con 0x5648b3d9cf60 2023-07-14T18:18:39.313 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:18:39.251+0000 7f4fe9093b80 10 client.16392 fetch_fsmap learned FSMap version 33 2023-07-14T18:18:39.313 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:18:39.251+0000 7f4fe9093b80 1 -- 172.21.15.163:0/3654237552 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) v3 -- 0x7f4fd0011230 con 0x5648b3d9cf60 2023-07-14T18:18:39.313 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:18:39.251+0000 7f4fbdffb700 1 -- 172.21.15.163:0/3654237552 <== mon.0 v2:172.21.15.163:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x5648b3c474f0 con 0x5648b3d9cf60 2023-07-14T18:18:39.313 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:18:39.251+0000 7f4fbdffb700 1 -- 172.21.15.163:0/3654237552 <== mon.0 v2:172.21.15.163:3300/0 5 ==== fsmap(e 33) v1 ==== 7502+0+0 (secure 0 0 0) 0x7f4fc8097050 con 0x5648b3d9cf60 2023-07-14T18:18:39.314 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:18:39.251+0000 7f4fe9093b80 10 client.16392 fetch_fsmap finished waiting for FSMap version 33 2023-07-14T18:18:39.314 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:18:39.251+0000 7f4fe9093b80 10 client.16392 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-07-14T18:18:39.314 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:18:39.251+0000 7f4fe9093b80 20 client.16392 populate_metadata read hostname 'smithi163' 2023-07-14T18:18:39.314 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:18:39.251+0000 7f4fe9093b80 1 --2- 172.21.15.163:0/3654237552 >> [v2:172.21.15.172:6838/3850440096,v1:172.21.15.172:6839/3850440096] conn(0x5648b3db23a0 0x5648b3db47b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:18:39.314 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:18:39.251+0000 7f4fe9093b80 4 client.16392 mds_command: new command op to 24518 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-14T18:18:39.314 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:18:39.251+0000 7f4fe9093b80 1 -- 172.21.15.163:0/3654237552 --> [v2:172.21.15.172:6838/3850440096,v1:172.21.15.172:6839/3850440096] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5648b3d6bda0 con 0x5648b3db23a0 2023-07-14T18:18:39.315 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:18:39.252+0000 7f4fd5d9b700 1 --2- 172.21.15.163:0/3654237552 >> [v2:172.21.15.172:6838/3850440096,v1:172.21.15.172:6839/3850440096] conn(0x5648b3db23a0 0x5648b3db47b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:18:39.315 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:18:39.252+0000 7f4fbdffb700 10 client.16392 ms_handle_connect on v2:172.21.15.172:6838/3850440096 2023-07-14T18:18:39.315 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:18:39.252+0000 7f4fd5d9b700 1 --2- 172.21.15.163:0/3654237552 >> [v2:172.21.15.172:6838/3850440096,v1:172.21.15.172:6839/3850440096] conn(0x5648b3db23a0 0x5648b3db47b0 crc :-1 s=READY pgs=81 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ac6741fb2c9f4196 server_cookie=26ea37689a0f28ec in_seq=0 out_seq=0 2023-07-14T18:18:39.315 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:18:39.252+0000 7f4fbdffb700 1 -- 172.21.15.163:0/3654237552 <== mds.0 v2:172.21.15.172:6838/3850440096 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18017 (crc 0 0 0) 0x5648b3d6bda0 con 0x5648b3db23a0 2023-07-14T18:18:39.315 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:18:39.252+0000 7f4fbdffb700 10 client.16392 handle_command_reply: tid=0 2023-07-14T18:18:39.316 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:18:39.253+0000 7f4fe9093b80 1 client.16392 shutdown 2023-07-14T18:18:39.316 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:18:39.253+0000 7f4fe9093b80 1 -- 172.21.15.163:0/3654237552 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5648b3d9cf60 msgr2=0x5648b3da69d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:18:39.316 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:18:39.253+0000 7f4fe9093b80 1 --2- 172.21.15.163:0/3654237552 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5648b3d9cf60 0x5648b3da69d0 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7f4fc800bf90 tx=0x7f4fc8004320 comp rx=0 tx=0).stop 2023-07-14T18:18:39.316 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:18:39.253+0000 7f4fe9093b80 1 -- 172.21.15.163:0/3654237552 shutdown_connections 2023-07-14T18:18:39.316 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:18:39.253+0000 7f4fe9093b80 1 --2- 172.21.15.163:0/3654237552 >> [v2:172.21.15.172:6838/3850440096,v1:172.21.15.172:6839/3850440096] conn(0x5648b3db23a0 0x5648b3db47b0 crc :-1 s=READY pgs=81 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:18:39.317 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:18:39.253+0000 7f4fe9093b80 1 --2- 172.21.15.163:0/3654237552 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5648b3d9e4b0 0x5648b3dadf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:18:39.317 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:18:39.253+0000 7f4fe9093b80 1 --2- 172.21.15.163:0/3654237552 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5648b3d9cf60 0x5648b3da69d0 unknown :-1 s=CLOSED pgs=692 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:18:39.317 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:18:39.253+0000 7f4fe9093b80 1 --2- 172.21.15.163:0/3654237552 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5648b3d9d8b0 0x5648b3da6f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:18:39.317 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:18:39.253+0000 7f4fbdffb700 0 client.16392 ms_handle_reset on v2:172.21.15.172:6838/3850440096 2023-07-14T18:18:39.317 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:18:39.253+0000 7f4fe9093b80 1 -- 172.21.15.163:0/3654237552 >> 172.21.15.163:0/3654237552 conn(0x5648b3d92680 msgr2=0x5648b3d96650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:18:39.318 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:18:39.253+0000 7f4fe9093b80 1 -- 172.21.15.163:0/3654237552 shutdown_connections 2023-07-14T18:18:39.318 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:18:39.253+0000 7f4fe9093b80 1 -- 172.21.15.163:0/3654237552 wait complete. 2023-07-14T18:18:39.318 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:18:39.253+0000 7f4fe9093b80 20 client.16392 trim_cache size 0 max 16384 2023-07-14T18:18:39.319 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:18:39.273+0000 7f4fe9093b80 1 Processor -- start 2023-07-14T18:18:39.319 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:18:39.273+0000 7f4fe9093b80 1 -- start start 2023-07-14T18:18:39.321 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:18:39.273+0000 7f4fe9093b80 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5648b3d9cf60 0x5648b3da56a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:18:39.321 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:18:39.273+0000 7f4fe9093b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5648b3d9d8b0 0x5648b3dadf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:18:39.322 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:18:39.273+0000 7f4fe9093b80 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5648b3d9e4b0 0x5648b3d970f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:18:39.322 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:18:39.273+0000 7f4fe9093b80 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x5648b3d922a0 con 0x5648b3d9e4b0 2023-07-14T18:18:39.322 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:18:39.273+0000 7f4fe9093b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x5648b3da5e80 con 0x5648b3d9d8b0 2023-07-14T18:18:39.322 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:18:39.273+0000 7f4fe9093b80 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x5648b3d9dcf0 con 0x5648b3d9cf60 2023-07-14T18:18:39.322 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:18:39.273+0000 7f4fd6d9d700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5648b3d9e4b0 0x5648b3d970f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:18:39.323 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:18:39.273+0000 7f4fd6d9d700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5648b3d9e4b0 0x5648b3d970f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:59788/0 (socket says 172.21.15.163:59788) 2023-07-14T18:18:39.323 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:18:39.273+0000 7f4fd659c700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5648b3d9cf60 0x5648b3da56a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:18:39.323 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:18:39.273+0000 7f4fd5d9b700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5648b3d9d8b0 0x5648b3dadf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:18:39.323 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:18:39.273+0000 7f4fd6d9d700 1 -- 172.21.15.163:0/3316769050 learned_addr learned my addr 172.21.15.163:0/3316769050 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:18:39.323 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:18:39.274+0000 7f4fd6d9d700 1 -- 172.21.15.163:0/3316769050 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5648b3d9cf60 msgr2=0x5648b3da56a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:18:39.324 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:18:39.274+0000 7f4fd6d9d700 1 --2- 172.21.15.163:0/3316769050 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5648b3d9cf60 0x5648b3da56a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:18:39.324 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:18:39.274+0000 7f4fd6d9d700 1 -- 172.21.15.163:0/3316769050 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5648b3d9d8b0 msgr2=0x5648b3dadf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:18:39.324 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:18:39.274+0000 7f4fd6d9d700 1 --2- 172.21.15.163:0/3316769050 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5648b3d9d8b0 0x5648b3dadf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:18:39.324 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:18:39.274+0000 7f4fd6d9d700 1 -- 172.21.15.163:0/3316769050 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4fcc017070 con 0x5648b3d9e4b0 2023-07-14T18:18:39.324 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:18:39.274+0000 7f4fd5d9b700 1 --2- 172.21.15.163:0/3316769050 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5648b3d9d8b0 0x5648b3dadf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T18:18:39.325 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:18:39.274+0000 7f4fd659c700 1 --2- 172.21.15.163:0/3316769050 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5648b3d9cf60 0x5648b3da56a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T18:18:39.325 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:18:39.274+0000 7f4fd6d9d700 1 --2- 172.21.15.163:0/3316769050 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5648b3d9e4b0 0x5648b3d970f0 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7f4fd00075e0 tx=0x7f4fd000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4424d48c0b6a60f7 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:18:39.325 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:18:39.274+0000 7f4fc57fa700 1 -- 172.21.15.163:0/3316769050 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fd000e040 con 0x5648b3d9e4b0 2023-07-14T18:18:39.325 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:18:39.274+0000 7f4fc57fa700 1 -- 172.21.15.163:0/3316769050 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f4fd001b070 con 0x5648b3d9e4b0 2023-07-14T18:18:39.325 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:18:39.274+0000 7f4fc57fa700 1 -- 172.21.15.163:0/3316769050 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fd001f680 con 0x5648b3d9e4b0 2023-07-14T18:18:39.325 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:18:39.275+0000 7f4fe9093b80 1 -- 172.21.15.163:0/3316769050 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5648b3d9e4b0 msgr2=0x5648b3d970f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:18:39.326 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:18:39.275+0000 7f4fe9093b80 1 --2- 172.21.15.163:0/3316769050 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5648b3d9e4b0 0x5648b3d970f0 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7f4fd00075e0 tx=0x7f4fd000b040 comp rx=0 tx=0).stop 2023-07-14T18:18:39.326 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:18:39.275+0000 7f4fe9093b80 1 -- 172.21.15.163:0/3316769050 shutdown_connections 2023-07-14T18:18:39.326 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:18:39.275+0000 7f4fe9093b80 1 --2- 172.21.15.163:0/3316769050 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5648b3d9cf60 0x5648b3da56a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:18:39.326 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:18:39.275+0000 7f4fe9093b80 1 --2- 172.21.15.163:0/3316769050 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5648b3d9e4b0 0x5648b3d970f0 unknown :-1 s=CLOSED pgs=693 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:18:39.326 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:18:39.275+0000 7f4fe9093b80 1 --2- 172.21.15.163:0/3316769050 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5648b3d9d8b0 0x5648b3dadf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:18:39.327 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:18:39.275+0000 7f4fe9093b80 1 -- 172.21.15.163:0/3316769050 >> 172.21.15.163:0/3316769050 conn(0x5648b3d92680 msgr2=0x5648b3d93b50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:18:39.327 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:18:39.275+0000 7f4fe9093b80 1 -- 172.21.15.163:0/3316769050 shutdown_connections 2023-07-14T18:18:39.327 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:18:39.275+0000 7f4fe9093b80 1 -- 172.21.15.163:0/3316769050 wait complete. 2023-07-14T18:18:39.330 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:18:39.275+0000 7f4fe9093b80 1 -- start start 2023-07-14T18:18:39.330 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:18:39.275+0000 7f4fe9093b80 1 Processor -- start 2023-07-14T18:18:39.330 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:18:39.275+0000 7f4fe9093b80 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5648b3d9cf60 0x5648b3dadfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:18:39.330 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:18:39.275+0000 7f4fe9093b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5648b3d9d8b0 0x5648b3dac5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:18:39.331 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:18:39.275+0000 7f4fe9093b80 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5648b3d9e4b0 0x5648b3dacb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:18:39.331 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:18:39.275+0000 7f4fe9093b80 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x5648b3dad2f0 con 0x5648b3d9e4b0 2023-07-14T18:18:39.331 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:18:39.275+0000 7f4fe9093b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x5648b3dad460 con 0x5648b3d9d8b0 2023-07-14T18:18:39.331 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:18:39.275+0000 7f4fe9093b80 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x5648b3e0e8c0 con 0x5648b3d9cf60 2023-07-14T18:18:39.331 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:18:39.275+0000 7f4fe9093b80 10 client.0 _ll_register_callbacks cb 0x5648b3c8b760 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T18:18:39.332 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:18:39.276+0000 7f4fd659c700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5648b3d9cf60 0x5648b3dadfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:18:39.332 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:18:39.276+0000 7f4fd6d9d700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5648b3d9e4b0 0x5648b3dacb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:18:39.332 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:18:39.276+0000 7f4fd5d9b700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5648b3d9d8b0 0x5648b3dac5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:18:39.332 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:18:39.276+0000 7f4fd659c700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5648b3d9cf60 0x5648b3dadfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.163:41614/0 (socket says 172.21.15.163:41614) 2023-07-14T18:18:39.332 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:18:39.276+0000 7f4fd6d9d700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5648b3d9e4b0 0x5648b3dacb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:59796/0 (socket says 172.21.15.163:59796) 2023-07-14T18:18:39.333 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:18:39.276+0000 7f4fd659c700 1 -- 172.21.15.163:0/1346304089 learned_addr learned my addr 172.21.15.163:0/1346304089 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:18:39.333 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:18:39.276+0000 7f4fd659c700 1 -- 172.21.15.163:0/1346304089 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5648b3d9d8b0 msgr2=0x5648b3dac5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:18:39.333 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:18:39.276+0000 7f4fd659c700 1 --2- 172.21.15.163:0/1346304089 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5648b3d9d8b0 0x5648b3dac5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:18:39.333 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:18:39.276+0000 7f4fd659c700 1 -- 172.21.15.163:0/1346304089 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5648b3d9e4b0 msgr2=0x5648b3dacb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:18:39.333 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:18:39.276+0000 7f4fd659c700 1 --2- 172.21.15.163:0/1346304089 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5648b3d9e4b0 0x5648b3dacb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:18:39.333 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:18:39.276+0000 7f4fd659c700 1 -- 172.21.15.163:0/1346304089 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4fd0011230 con 0x5648b3d9cf60 2023-07-14T18:18:39.334 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:18:39.276+0000 7f4fd5d9b700 1 --2- 172.21.15.163:0/1346304089 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5648b3d9d8b0 0x5648b3dac5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T18:18:39.334 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:18:39.276+0000 7f4fd6d9d700 1 --2- 172.21.15.163:0/1346304089 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5648b3d9e4b0 0x5648b3dacb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T18:18:39.334 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:18:39.276+0000 7f4fd659c700 1 --2- 172.21.15.163:0/1346304089 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5648b3d9cf60 0x5648b3dadfa0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f4fc8097cd0 tx=0x7f4fc8022720 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6ee6fb3ac1554869 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:18:39.334 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:18:39.276+0000 7f4fbdffb700 10 client.0 ms_handle_connect on v2:172.21.15.184:3300/0 2023-07-14T18:18:39.334 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:18:39.276+0000 7f4fbdffb700 1 -- 172.21.15.163:0/1346304089 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fc80a3390 con 0x5648b3d9cf60 2023-07-14T18:18:39.335 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:18:39.276+0000 7f4fbdffb700 1 -- 172.21.15.163:0/1346304089 <== mon.1 v2:172.21.15.184:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 9049+0+0 (secure 0 0 0) 0x7f4fc80b95a0 con 0x5648b3d9cf60 2023-07-14T18:18:39.335 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:18:39.276+0000 7f4fe9093b80 1 -- 172.21.15.163:0/1346304089 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f4fcc003e70 con 0x5648b3d9cf60 2023-07-14T18:18:39.335 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:18:39.277+0000 7f4fbdffb700 1 -- 172.21.15.163:0/1346304089 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4fc80a3620 con 0x5648b3d9cf60 2023-07-14T18:18:39.335 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:18:39.277+0000 7f4fe9093b80 10 client.25963 fetch_fsmap learned FSMap version 33 2023-07-14T18:18:39.335 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:18:39.277+0000 7f4fe9093b80 1 -- 172.21.15.163:0/1346304089 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) v3 -- 0x5648b3b1bde0 con 0x5648b3d9cf60 2023-07-14T18:18:39.336 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:18:39.277+0000 7f4fbdffb700 1 -- 172.21.15.163:0/1346304089 <== mon.1 v2:172.21.15.184:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f4fcc003e70 con 0x5648b3d9cf60 2023-07-14T18:18:39.336 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:18:39.277+0000 7f4fbdffb700 1 -- 172.21.15.163:0/1346304089 <== mon.1 v2:172.21.15.184:3300/0 5 ==== fsmap(e 33) v1 ==== 7502+0+0 (secure 0 0 0) 0x7f4fc8084ab0 con 0x5648b3d9cf60 2023-07-14T18:18:39.336 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:18:39.277+0000 7f4fe9093b80 10 client.25963 fetch_fsmap finished waiting for FSMap version 33 2023-07-14T18:18:39.336 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:18:39.277+0000 7f4fe9093b80 10 client.25963 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-07-14T18:18:39.336 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:18:39.277+0000 7f4fe9093b80 20 client.25963 populate_metadata read hostname 'smithi163' 2023-07-14T18:18:39.337 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:18:39.277+0000 7f4fe9093b80 1 --2- 172.21.15.163:0/1346304089 >> [v2:172.21.15.172:6838/3850440096,v1:172.21.15.172:6839/3850440096] conn(0x5648b3e0fe10 0x5648b3e12220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:18:39.337 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:18:39.277+0000 7f4fe9093b80 4 client.25963 mds_command: new command op to 24518 tid=0[{"prefix": "scrub status"}] 2023-07-14T18:18:39.337 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:18:39.277+0000 7f4fe9093b80 1 -- 172.21.15.163:0/1346304089 --> [v2:172.21.15.172:6838/3850440096,v1:172.21.15.172:6839/3850440096] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x5648b3ce6eb0 con 0x5648b3e0fe10 2023-07-14T18:18:39.337 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:18:39.277+0000 7f4fd5d9b700 1 --2- 172.21.15.163:0/1346304089 >> [v2:172.21.15.172:6838/3850440096,v1:172.21.15.172:6839/3850440096] conn(0x5648b3e0fe10 0x5648b3e12220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:18:39.337 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:18:39.278+0000 7f4fbdffb700 10 client.25963 ms_handle_connect on v2:172.21.15.172:6838/3850440096 2023-07-14T18:18:39.338 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:18:39.278+0000 7f4fd5d9b700 1 --2- 172.21.15.163:0/1346304089 >> [v2:172.21.15.172:6838/3850440096,v1:172.21.15.172:6839/3850440096] conn(0x5648b3e0fe10 0x5648b3e12220 crc :-1 s=READY pgs=82 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=584e02c1f1f77341 server_cookie=a395db5f7895fd18 in_seq=0 out_seq=0 2023-07-14T18:18:39.338 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:18:39.278+0000 7f4fbdffb700 1 -- 172.21.15.163:0/1346304089 <== mds.0 v2:172.21.15.172:6838/3850440096 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x5648b3ce6eb0 con 0x5648b3e0fe10 2023-07-14T18:18:39.338 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:18:39.278+0000 7f4fbdffb700 10 client.25963 handle_command_reply: tid=0 2023-07-14T18:18:39.338 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:18:39.278+0000 7f4fe9093b80 1 client.25963 shutdown 2023-07-14T18:18:39.338 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:18:39.278+0000 7f4fe9093b80 1 -- 172.21.15.163:0/1346304089 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5648b3d9cf60 msgr2=0x5648b3dadfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:18:39.339 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:18:39.278+0000 7f4fe9093b80 1 --2- 172.21.15.163:0/1346304089 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5648b3d9cf60 0x5648b3dadfa0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f4fc8097cd0 tx=0x7f4fc8022720 comp rx=0 tx=0).stop 2023-07-14T18:18:39.339 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:18:39.278+0000 7f4fe9093b80 1 -- 172.21.15.163:0/1346304089 shutdown_connections 2023-07-14T18:18:39.339 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:18:39.278+0000 7f4fe9093b80 1 --2- 172.21.15.163:0/1346304089 >> [v2:172.21.15.172:6838/3850440096,v1:172.21.15.172:6839/3850440096] conn(0x5648b3e0fe10 0x5648b3e12220 crc :-1 s=READY pgs=82 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:18:39.339 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:18:39.278+0000 7f4fe9093b80 1 --2- 172.21.15.163:0/1346304089 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5648b3d9cf60 0x5648b3dadfa0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:18:39.339 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:18:39.278+0000 7f4fbdffb700 0 client.25963 ms_handle_reset on v2:172.21.15.172:6838/3850440096 2023-07-14T18:18:39.339 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:18:39.278+0000 7f4fe9093b80 1 --2- 172.21.15.163:0/1346304089 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5648b3d9e4b0 0x5648b3dacb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:18:39.340 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:18:39.278+0000 7f4fe9093b80 1 --2- 172.21.15.163:0/1346304089 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5648b3d9d8b0 0x5648b3dac5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:18:39.340 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:18:39.278+0000 7f4fe9093b80 1 -- 172.21.15.163:0/1346304089 >> 172.21.15.163:0/1346304089 conn(0x5648b3d92680 msgr2=0x5648b3da56a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:18:39.340 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:18:39.278+0000 7f4fe9093b80 1 -- 172.21.15.163:0/1346304089 shutdown_connections 2023-07-14T18:18:39.340 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:18:39.278+0000 7f4fe9093b80 1 -- 172.21.15.163:0/1346304089 wait complete. 2023-07-14T18:18:39.341 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:18:39.278+0000 7f4fe9093b80 20 client.25963 trim_cache size 0 max 16384 2023-07-14T18:18:39.341 INFO:teuthology.orchestra.run.smithi163.stdout:{ 2023-07-14T18:18:39.341 INFO:teuthology.orchestra.run.smithi163.stdout: "status": "IDLE (waiting for more scrubs)", 2023-07-14T18:18:39.341 INFO:teuthology.orchestra.run.smithi163.stdout: "scrubs": { 2023-07-14T18:18:39.342 INFO:teuthology.orchestra.run.smithi163.stdout: "2c53b7ef-6f30-49f0-a60d-f1f114c19d42": { 2023-07-14T18:18:39.342 INFO:teuthology.orchestra.run.smithi163.stdout: "path": "/", 2023-07-14T18:18:39.342 INFO:teuthology.orchestra.run.smithi163.stdout: "tag": "2c53b7ef-6f30-49f0-a60d-f1f114c19d42", 2023-07-14T18:18:39.342 INFO:teuthology.orchestra.run.smithi163.stdout: "options": "recursive,force" 2023-07-14T18:18:39.342 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-07-14T18:18:39.343 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-07-14T18:18:39.343 INFO:teuthology.orchestra.run.smithi163.stdout:} 2023-07-14T18:18:39.344 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:18:39.279+0000 7f4fdcefb700 1 -- 172.21.15.163:0/1070217190 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f4fc00a1150 msgr2=0x7f4fc00a3600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:18:39.344 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:18:39.279+0000 7f4fdcefb700 1 --2- 172.21.15.163:0/1070217190 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f4fc00a1150 0x7f4fc00a3600 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f4fcc011490 tx=0x7f4fcc009260 comp rx=0 tx=0).stop 2023-07-14T18:18:39.344 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:18:39.279+0000 7f4fdcefb700 1 -- 172.21.15.163:0/1070217190 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f4fd80ffc20 msgr2=0x7f4fd80743f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:18:39.345 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:18:39.279+0000 7f4fdcefb700 1 --2- 172.21.15.163:0/1070217190 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f4fd80ffc20 0x7f4fd80743f0 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f4fc8000c00 tx=0x7f4fc8004730 comp rx=0 tx=0).stop 2023-07-14T18:18:39.345 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:18:39.279+0000 7f4fdcefb700 1 -- 172.21.15.163:0/1070217190 shutdown_connections 2023-07-14T18:18:39.345 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:18:39.279+0000 7f4fdcefb700 1 --2- 172.21.15.163:0/1070217190 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f4fc00a1150 0x7f4fc00a3600 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:18:39.345 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:18:39.279+0000 7f4fdcefb700 1 --2- 172.21.15.163:0/1070217190 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4fd81017a0 0x7f4fd8072f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:18:39.345 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:18:39.279+0000 7f4fdcefb700 1 --2- 172.21.15.163:0/1070217190 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f4fd80ffc20 0x7f4fd80743f0 unknown :-1 s=CLOSED pgs=691 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:18:39.346 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:18:39.279+0000 7f4fdcefb700 1 --2- 172.21.15.163:0/1070217190 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4fd8100e10 0x7f4fd8072a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:18:39.346 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:18:39.279+0000 7f4fdcefb700 1 -- 172.21.15.163:0/1070217190 >> 172.21.15.163:0/1070217190 conn(0x7f4fd80fb260 msgr2=0x7f4fd80fd4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:18:39.346 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:18:39.279+0000 7f4fdcefb700 1 -- 172.21.15.163:0/1070217190 shutdown_connections 2023-07-14T18:18:39.346 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:18:39.279+0000 7f4fdcefb700 1 -- 172.21.15.163:0/1070217190 wait complete. 2023-07-14T18:18:39.347 INFO:tasks.cephfs.filesystem:scrub status for tag:2c53b7ef-6f30-49f0-a60d-f1f114c19d42 - {'path': '/', 'tag': '2c53b7ef-6f30-49f0-a60d-f1f114c19d42', 'options': 'recursive,force'} 2023-07-14T18:18:40.931 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:18:40 smithi184 ceph-mon[98481]: pgmap v480: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-07-14T18:18:40.974 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:18:40 smithi163 ceph-mon[96576]: pgmap v480: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-07-14T18:18:41.032 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:18:40 smithi172 ceph-mon[97983]: pgmap v480: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-07-14T18:18:42.181 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:18:41 smithi184 ceph-mon[98481]: pgmap v481: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-07-14T18:18:42.224 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:18:41 smithi163 ceph-mon[96576]: pgmap v481: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-07-14T18:18:42.282 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:18:41 smithi172 ceph-mon[97983]: pgmap v481: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-07-14T18:18:44.181 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:18:43 smithi184 ceph-mon[98481]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-07-14T18:18:44.182 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:18:43 smithi184 ceph-mon[98481]: pgmap v482: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-07-14T18:18:44.224 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:18:43 smithi163 ceph-mon[96576]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-07-14T18:18:44.224 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:18:43 smithi163 ceph-mon[96576]: pgmap v482: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-07-14T18:18:44.282 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:18:43 smithi172 ceph-mon[97983]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-07-14T18:18:44.282 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:18:43 smithi172 ceph-mon[97983]: pgmap v482: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-07-14T18:18:46.931 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:18:46 smithi184 ceph-mon[98481]: pgmap v483: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-07-14T18:18:46.974 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:18:46 smithi163 ceph-mon[96576]: pgmap v483: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-07-14T18:18:47.032 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:18:46 smithi172 ceph-mon[97983]: pgmap v483: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-07-14T18:18:48.931 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:18:48 smithi184 ceph-mon[98481]: pgmap v484: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-07-14T18:18:48.974 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:18:48 smithi163 ceph-mon[96576]: pgmap v484: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-07-14T18:18:49.032 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:18:48 smithi172 ceph-mon[97983]: pgmap v484: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-07-14T18:18:50.931 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:18:50 smithi184 ceph-mon[98481]: pgmap v485: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-07-14T18:18:50.974 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:18:50 smithi163 ceph-mon[96576]: pgmap v485: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-07-14T18:18:51.032 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:18:50 smithi172 ceph-mon[97983]: pgmap v485: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-07-14T18:18:52.181 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:18:51 smithi184 ceph-mon[98481]: pgmap v486: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-07-14T18:18:52.224 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:18:51 smithi163 ceph-mon[96576]: pgmap v486: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-07-14T18:18:52.282 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:18:51 smithi172 ceph-mon[97983]: pgmap v486: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-07-14T18:18:54.931 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:18:54 smithi184 ceph-mon[98481]: pgmap v487: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-07-14T18:18:54.974 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:18:54 smithi163 ceph-mon[96576]: pgmap v487: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-07-14T18:18:55.032 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:18:54 smithi172 ceph-mon[97983]: pgmap v487: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-07-14T18:18:56.931 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:18:56 smithi184 ceph-mon[98481]: pgmap v488: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-07-14T18:18:56.974 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:18:56 smithi163 ceph-mon[96576]: pgmap v488: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-07-14T18:18:57.032 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:18:56 smithi172 ceph-mon[97983]: pgmap v488: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-07-14T18:18:58.931 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:18:58 smithi184 ceph-mon[98481]: pgmap v489: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-07-14T18:18:58.932 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:18:58 smithi184 ceph-mon[98481]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-07-14T18:18:58.974 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:18:58 smithi163 ceph-mon[96576]: pgmap v489: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-07-14T18:18:58.974 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:18:58 smithi163 ceph-mon[96576]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-07-14T18:18:59.032 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:18:58 smithi172 ceph-mon[97983]: pgmap v489: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-07-14T18:18:59.033 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:18:58 smithi172 ceph-mon[97983]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-07-14T18:19:00.931 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:19:00 smithi184 ceph-mon[98481]: pgmap v490: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-07-14T18:19:00.974 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:19:00 smithi163 ceph-mon[96576]: pgmap v490: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-07-14T18:19:01.032 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:19:00 smithi172 ceph-mon[97983]: pgmap v490: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-07-14T18:19:02.181 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:19:01 smithi184 ceph-mon[98481]: pgmap v491: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-07-14T18:19:02.224 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:19:01 smithi163 ceph-mon[96576]: pgmap v491: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-07-14T18:19:02.282 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:19:01 smithi172 ceph-mon[97983]: pgmap v491: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-07-14T18:19:04.182 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:19:03 smithi184 ceph-mon[98481]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-07-14T18:19:04.182 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:19:03 smithi184 ceph-mon[98481]: pgmap v492: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-07-14T18:19:04.224 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:19:03 smithi163 ceph-mon[96576]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-07-14T18:19:04.224 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:19:03 smithi163 ceph-mon[96576]: pgmap v492: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-07-14T18:19:04.282 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:19:03 smithi172 ceph-mon[97983]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-07-14T18:19:04.283 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:19:03 smithi172 ceph-mon[97983]: pgmap v492: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-07-14T18:19:06.932 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:19:06 smithi184 ceph-mon[98481]: pgmap v493: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-07-14T18:19:06.974 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:19:06 smithi163 ceph-mon[96576]: pgmap v493: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-07-14T18:19:07.032 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:19:06 smithi172 ceph-mon[97983]: pgmap v493: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-07-14T18:19:08.932 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:19:08 smithi184 ceph-mon[98481]: pgmap v494: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-07-14T18:19:08.974 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:19:08 smithi163 ceph-mon[96576]: pgmap v494: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-07-14T18:19:09.033 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:19:08 smithi172 ceph-mon[97983]: pgmap v494: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-07-14T18:19:09.348 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-07-14T18:19:09.517 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:19:09.470+0000 7f0b9e83e700 1 -- 172.21.15.163:0/3096538604 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f0b98100110 msgr2=0x7f0b98100520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:19:09.518 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:19:09.470+0000 7f0b9e83e700 1 --2- 172.21.15.163:0/3096538604 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f0b98100110 0x7f0b98100520 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7f0b88009990 tx=0x7f0b88009ca0 comp rx=0 tx=0).stop 2023-07-14T18:19:09.518 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:19:09.470+0000 7f0b9e83e700 1 -- 172.21.15.163:0/3096538604 shutdown_connections 2023-07-14T18:19:09.518 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:19:09.470+0000 7f0b9e83e700 1 --2- 172.21.15.163:0/3096538604 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0b980ff710 0x7f0b98106fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:19:09.519 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:19:09.470+0000 7f0b9e83e700 1 --2- 172.21.15.163:0/3096538604 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f0b98100110 0x7f0b98100520 unknown :-1 s=CLOSED pgs=694 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:19:09.519 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:19:09.470+0000 7f0b9e83e700 1 --2- 172.21.15.163:0/3096538604 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0b980fed60 0x7f0b980ff1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:19:09.519 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:19:09.470+0000 7f0b9e83e700 1 -- 172.21.15.163:0/3096538604 >> 172.21.15.163:0/3096538604 conn(0x7f0b980f98e0 msgr2=0x7f0b980fbd10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:19:09.519 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:19:09.470+0000 7f0b9e83e700 1 -- 172.21.15.163:0/3096538604 shutdown_connections 2023-07-14T18:19:09.519 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:19:09.470+0000 7f0b9e83e700 1 -- 172.21.15.163:0/3096538604 wait complete. 2023-07-14T18:19:09.519 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:19:09.471+0000 7f0b9e83e700 1 Processor -- start 2023-07-14T18:19:09.520 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:19:09.471+0000 7f0b9e83e700 1 -- start start 2023-07-14T18:19:09.521 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:19:09.471+0000 7f0b9e83e700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0b980fed60 0x7f0b98195890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:19:09.522 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:19:09.471+0000 7f0b9e83e700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f0b980ff710 0x7f0b98195dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:19:09.522 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:19:09.471+0000 7f0b9e83e700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0b98100110 0x7f0b9819ce40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:19:09.522 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:19:09.471+0000 7f0b9e83e700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b9819d410 con 0x7f0b980ff710 2023-07-14T18:19:09.522 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:19:09.471+0000 7f0b9e83e700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b9819d550 con 0x7f0b98100110 2023-07-14T18:19:09.522 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:19:09.471+0000 7f0b9e83e700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b9819d6e0 con 0x7f0b980fed60 2023-07-14T18:19:09.523 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:19:09.471+0000 7f0b97fff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0b980fed60 0x7f0b98195890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:19:09.523 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:19:09.471+0000 7f0b977fe700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f0b980ff710 0x7f0b98195dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:19:09.524 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:19:09.471+0000 7f0b97fff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0b980fed60 0x7f0b98195890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.163:41628/0 (socket says 172.21.15.163:41628) 2023-07-14T18:19:09.524 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:19:09.471+0000 7f0b97fff700 1 -- 172.21.15.163:0/3652933807 learned_addr learned my addr 172.21.15.163:0/3652933807 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:19:09.524 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:19:09.471+0000 7f0b9cddb700 1 --2- 172.21.15.163:0/3652933807 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0b98100110 0x7f0b9819ce40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:19:09.525 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:19:09.472+0000 7f0b97fff700 1 -- 172.21.15.163:0/3652933807 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0b98100110 msgr2=0x7f0b9819ce40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:19:09.525 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:19:09.472+0000 7f0b97fff700 1 --2- 172.21.15.163:0/3652933807 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0b98100110 0x7f0b9819ce40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:19:09.526 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:19:09.472+0000 7f0b97fff700 1 -- 172.21.15.163:0/3652933807 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f0b980ff710 msgr2=0x7f0b98195dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:19:09.526 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:19:09.472+0000 7f0b97fff700 1 --2- 172.21.15.163:0/3652933807 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f0b980ff710 0x7f0b98195dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:19:09.527 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:19:09.472+0000 7f0b97fff700 1 -- 172.21.15.163:0/3652933807 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b880095f0 con 0x7f0b980fed60 2023-07-14T18:19:09.527 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:19:09.472+0000 7f0b977fe700 1 --2- 172.21.15.163:0/3652933807 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f0b980ff710 0x7f0b98195dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T18:19:09.528 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:19:09.472+0000 7f0b9cddb700 1 --2- 172.21.15.163:0/3652933807 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0b98100110 0x7f0b9819ce40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T18:19:09.528 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:19:09.472+0000 7f0b97fff700 1 --2- 172.21.15.163:0/3652933807 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0b980fed60 0x7f0b98195890 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f0b880059d0 tx=0x7f0b88004730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:19:09.529 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:19:09.472+0000 7f0b957fa700 1 -- 172.21.15.163:0/3652933807 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b8801d070 con 0x7f0b980fed60 2023-07-14T18:19:09.529 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:19:09.472+0000 7f0b9e83e700 1 -- 172.21.15.163:0/3652933807 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0b9819d960 con 0x7f0b980fed60 2023-07-14T18:19:09.529 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:19:09.472+0000 7f0b957fa700 1 -- 172.21.15.163:0/3652933807 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f0b8800bdb0 con 0x7f0b980fed60 2023-07-14T18:19:09.530 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:19:09.472+0000 7f0b957fa700 1 -- 172.21.15.163:0/3652933807 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b88022cf0 con 0x7f0b980fed60 2023-07-14T18:19:09.530 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:19:09.472+0000 7f0b9e83e700 1 -- 172.21.15.163:0/3652933807 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b9819dde0 con 0x7f0b980fed60 2023-07-14T18:19:09.537 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:19:09.475+0000 7f0b957fa700 1 -- 172.21.15.163:0/3652933807 <== mon.1 v2:172.21.15.184:3300/0 4 ==== mgrmap(e 18) v1 ==== 135716+0+0 (secure 0 0 0) 0x7f0b88022470 con 0x7f0b980fed60 2023-07-14T18:19:09.537 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:19:09.476+0000 7f0b957fa700 1 --2- 172.21.15.163:0/3652933807 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f0b800a1150 0x7f0b800a3600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:19:09.538 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:19:09.476+0000 7f0b977fe700 1 --2- 172.21.15.163:0/3652933807 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f0b800a1150 0x7f0b800a3600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:19:09.538 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:19:09.476+0000 7f0b957fa700 1 -- 172.21.15.163:0/3652933807 <== mon.1 v2:172.21.15.184:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 9049+0+0 (secure 0 0 0) 0x7f0b880ce4a0 con 0x7f0b980fed60 2023-07-14T18:19:09.538 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:19:09.476+0000 7f0baa9d6b80 1 Processor -- start 2023-07-14T18:19:09.539 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:19:09.476+0000 7f0baa9d6b80 1 -- start start 2023-07-14T18:19:09.539 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:19:09.476+0000 7f0baa9d6b80 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55af5cd1c370 0x55af5cd1c7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:19:09.539 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:19:09.476+0000 7f0baa9d6b80 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55af5cd1cce0 0x55af5cd1d2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:19:09.539 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:19:09.476+0000 7f0baa9d6b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55af5cd1d8a0 0x55af5cd1dd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:19:09.540 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:19:09.477+0000 7f0baa9d6b80 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x55af5cc1ccb0 con 0x55af5cd1cce0 2023-07-14T18:19:09.540 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:19:09.477+0000 7f0baa9d6b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x55af5cc6fa40 con 0x55af5cd1d8a0 2023-07-14T18:19:09.540 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:19:09.477+0000 7f0baa9d6b80 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x55af5cc68ed0 con 0x55af5cd1c370 2023-07-14T18:19:09.540 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:19:09.477+0000 7f0b977fe700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55af5cd1cce0 0x55af5cd1d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:19:09.540 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:19:09.477+0000 7f0b97fff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55af5cd1c370 0x55af5cd1c7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:19:09.541 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:19:09.477+0000 7f0b97fff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55af5cd1c370 0x55af5cd1c7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.163:41636/0 (socket says 172.21.15.163:41636) 2023-07-14T18:19:09.541 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:19:09.477+0000 7f0b97fff700 1 -- 172.21.15.163:0/545619406 learned_addr learned my addr 172.21.15.163:0/545619406 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:19:09.541 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:19:09.477+0000 7f0b977fe700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55af5cd1cce0 0x55af5cd1d2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:59816/0 (socket says 172.21.15.163:59816) 2023-07-14T18:19:09.541 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:19:09.477+0000 7f0b977fe700 1 --2- 172.21.15.163:0/3652933807 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f0b800a1150 0x7f0b800a3600 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f0b980ffe30 tx=0x7f0b8c009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:19:09.542 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:19:09.477+0000 7f0b9cddb700 1 --2- 172.21.15.163:0/545619406 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55af5cd1d8a0 0x55af5cd1dd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:19:09.542 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:19:09.477+0000 7f0b97fff700 1 -- 172.21.15.163:0/545619406 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55af5cd1d8a0 msgr2=0x55af5cd1dd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:19:09.542 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:19:09.477+0000 7f0b97fff700 1 --2- 172.21.15.163:0/545619406 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55af5cd1d8a0 0x55af5cd1dd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:19:09.542 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:19:09.477+0000 7f0b97fff700 1 -- 172.21.15.163:0/545619406 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55af5cd1cce0 msgr2=0x55af5cd1d2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:19:09.542 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:19:09.477+0000 7f0b97fff700 1 --2- 172.21.15.163:0/545619406 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55af5cd1cce0 0x55af5cd1d2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:19:09.543 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:19:09.477+0000 7f0b97fff700 1 -- 172.21.15.163:0/545619406 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55af5ca96de0 con 0x55af5cd1c370 2023-07-14T18:19:09.543 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:19:09.477+0000 7f0b9cddb700 1 --2- 172.21.15.163:0/545619406 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55af5cd1d8a0 0x55af5cd1dd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T18:19:09.543 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:19:09.477+0000 7f0b97fff700 1 --2- 172.21.15.163:0/545619406 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55af5cd1c370 0x55af5cd1c7a0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f0b8809b6c0 tx=0x7f0b8809b610 comp rx=0 tx=0).ready entity=mon.1 client_cookie=88d0e0116f0c1171 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:19:09.543 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:19:09.477+0000 7f0b7e7fc700 1 -- 172.21.15.163:0/545619406 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b880cd070 con 0x55af5cd1c370 2023-07-14T18:19:09.543 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:19:09.477+0000 7f0b7e7fc700 1 -- 172.21.15.163:0/545619406 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f0b8809b730 con 0x55af5cd1c370 2023-07-14T18:19:09.544 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:19:09.477+0000 7f0b7e7fc700 1 -- 172.21.15.163:0/545619406 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b8809ac20 con 0x55af5cd1c370 2023-07-14T18:19:09.544 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:19:09.478+0000 7f0baa9d6b80 1 -- 172.21.15.163:0/545619406 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55af5cd1c370 msgr2=0x55af5cd1c7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:19:09.544 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:19:09.478+0000 7f0baa9d6b80 1 --2- 172.21.15.163:0/545619406 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55af5cd1c370 0x55af5cd1c7a0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f0b8809b6c0 tx=0x7f0b8809b610 comp rx=0 tx=0).stop 2023-07-14T18:19:09.545 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:19:09.478+0000 7f0baa9d6b80 1 -- 172.21.15.163:0/545619406 shutdown_connections 2023-07-14T18:19:09.545 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:19:09.478+0000 7f0baa9d6b80 1 --2- 172.21.15.163:0/545619406 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55af5cd1c370 0x55af5cd1c7a0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:19:09.545 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:19:09.478+0000 7f0baa9d6b80 1 --2- 172.21.15.163:0/545619406 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55af5cd1d8a0 0x55af5cd1dd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:19:09.545 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:19:09.478+0000 7f0baa9d6b80 1 --2- 172.21.15.163:0/545619406 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55af5cd1cce0 0x55af5cd1d2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:19:09.546 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:19:09.478+0000 7f0baa9d6b80 1 -- 172.21.15.163:0/545619406 >> 172.21.15.163:0/545619406 conn(0x55af5cd0d680 msgr2=0x55af5cd129d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:19:09.546 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:19:09.478+0000 7f0baa9d6b80 1 -- 172.21.15.163:0/545619406 shutdown_connections 2023-07-14T18:19:09.546 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:19:09.478+0000 7f0baa9d6b80 1 -- 172.21.15.163:0/545619406 wait complete. 2023-07-14T18:19:09.546 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:19:09.479+0000 7f0baa9d6b80 1 -- start start 2023-07-14T18:19:09.547 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:19:09.479+0000 7f0baa9d6b80 1 Processor -- start 2023-07-14T18:19:09.547 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:19:09.479+0000 7f0baa9d6b80 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55af5cd1c370 0x55af5cd259b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:19:09.547 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:19:09.479+0000 7f0baa9d6b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55af5cd1cce0 0x55af5cd25ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:19:09.547 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:19:09.479+0000 7f0baa9d6b80 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55af5cd1d8a0 0x55af5cd2cf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:19:09.547 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:19:09.479+0000 7f0baa9d6b80 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x55af5cc08ac0 con 0x55af5cd1c370 2023-07-14T18:19:09.548 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:19:09.479+0000 7f0baa9d6b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x55af5cc087c0 con 0x55af5cd1cce0 2023-07-14T18:19:09.548 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:19:09.479+0000 7f0baa9d6b80 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x55af5caec920 con 0x55af5cd1d8a0 2023-07-14T18:19:09.548 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:19:09.479+0000 7f0baa9d6b80 10 client.0 _ll_register_callbacks cb 0x55af5cc06760 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T18:19:09.548 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:19:09.479+0000 7f0b97fff700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55af5cd1c370 0x55af5cd259b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:19:09.548 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:19:09.479+0000 7f0b97fff700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55af5cd1c370 0x55af5cd259b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:59820/0 (socket says 172.21.15.163:59820) 2023-07-14T18:19:09.549 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:19:09.479+0000 7f0b977fe700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55af5cd1cce0 0x55af5cd25ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:19:09.549 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:19:09.479+0000 7f0b97fff700 1 -- 172.21.15.163:0/3291793323 learned_addr learned my addr 172.21.15.163:0/3291793323 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:19:09.549 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:19:09.480+0000 7f0b9cddb700 1 --2- 172.21.15.163:0/3291793323 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55af5cd1d8a0 0x55af5cd2cf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:19:09.549 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:19:09.480+0000 7f0b97fff700 1 -- 172.21.15.163:0/3291793323 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55af5cd1d8a0 msgr2=0x55af5cd2cf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:19:09.550 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:19:09.480+0000 7f0b97fff700 1 --2- 172.21.15.163:0/3291793323 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55af5cd1d8a0 0x55af5cd2cf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:19:09.550 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:19:09.480+0000 7f0b97fff700 1 -- 172.21.15.163:0/3291793323 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55af5cd1cce0 msgr2=0x55af5cd25ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:19:09.550 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:19:09.480+0000 7f0b97fff700 1 --2- 172.21.15.163:0/3291793323 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55af5cd1cce0 0x55af5cd25ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:19:09.550 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:19:09.480+0000 7f0b97fff700 1 -- 172.21.15.163:0/3291793323 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b9819dde0 con 0x55af5cd1c370 2023-07-14T18:19:09.550 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:19:09.480+0000 7f0b977fe700 1 --2- 172.21.15.163:0/3291793323 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55af5cd1cce0 0x55af5cd25ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T18:19:09.551 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:19:09.480+0000 7f0b9cddb700 1 --2- 172.21.15.163:0/3291793323 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55af5cd1d8a0 0x55af5cd2cf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T18:19:09.551 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:19:09.480+0000 7f0b97fff700 1 --2- 172.21.15.163:0/3291793323 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55af5cd1c370 0x55af5cd259b0 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7f0b880cbcc0 tx=0x7f0b880ce430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c73f70fb0f309e0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:19:09.551 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:19:09.480+0000 7f0b777fe700 10 client.0 ms_handle_connect on v2:172.21.15.163:3300/0 2023-07-14T18:19:09.551 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:19:09.480+0000 7f0b777fe700 1 -- 172.21.15.163:0/3291793323 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b880cd030 con 0x55af5cd1c370 2023-07-14T18:19:09.551 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:19:09.480+0000 7f0b777fe700 1 -- 172.21.15.163:0/3291793323 <== mon.0 v2:172.21.15.163:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 9049+0+0 (secure 0 0 0) 0x7f0b880a3af0 con 0x55af5cd1c370 2023-07-14T18:19:09.552 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:19:09.480+0000 7f0baa9d6b80 1 -- 172.21.15.163:0/3291793323 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55af5cbc24f0 con 0x55af5cd1c370 2023-07-14T18:19:09.552 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:19:09.480+0000 7f0b777fe700 1 -- 172.21.15.163:0/3291793323 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0b880a3870 con 0x55af5cd1c370 2023-07-14T18:19:09.552 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:19:09.480+0000 7f0baa9d6b80 10 client.16410 fetch_fsmap learned FSMap version 36 2023-07-14T18:19:09.553 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:19:09.480+0000 7f0baa9d6b80 1 -- 172.21.15.163:0/3291793323 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) v3 -- 0x55af5ca7fc60 con 0x55af5cd1c370 2023-07-14T18:19:09.553 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:19:09.480+0000 7f0b777fe700 1 -- 172.21.15.163:0/3291793323 <== mon.0 v2:172.21.15.163:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55af5cbc24f0 con 0x55af5cd1c370 2023-07-14T18:19:09.553 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:19:09.480+0000 7f0b777fe700 1 -- 172.21.15.163:0/3291793323 <== mon.0 v2:172.21.15.163:3300/0 5 ==== fsmap(e 36) v1 ==== 7490+0+0 (secure 0 0 0) 0x7f0b88097720 con 0x55af5cd1c370 2023-07-14T18:19:09.554 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:19:09.481+0000 7f0baa9d6b80 10 client.16410 fetch_fsmap finished waiting for FSMap version 36 2023-07-14T18:19:09.554 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:19:09.481+0000 7f0baa9d6b80 10 client.16410 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-07-14T18:19:09.554 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:19:09.481+0000 7f0baa9d6b80 20 client.16410 populate_metadata read hostname 'smithi163' 2023-07-14T18:19:09.554 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:19:09.481+0000 7f0baa9d6b80 1 --2- 172.21.15.163:0/3291793323 >> [v2:172.21.15.172:6838/3850440096,v1:172.21.15.172:6839/3850440096] conn(0x55af5cd313d0 0x55af5cd337e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:19:09.554 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:19:09.481+0000 7f0baa9d6b80 4 client.16410 mds_command: new command op to 24518 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-14T18:19:09.555 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:19:09.481+0000 7f0baa9d6b80 1 -- 172.21.15.163:0/3291793323 --> [v2:172.21.15.172:6838/3850440096,v1:172.21.15.172:6839/3850440096] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55af5cce6da0 con 0x55af5cd313d0 2023-07-14T18:19:09.555 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:19:09.481+0000 7f0b977fe700 1 --2- 172.21.15.163:0/3291793323 >> [v2:172.21.15.172:6838/3850440096,v1:172.21.15.172:6839/3850440096] conn(0x55af5cd313d0 0x55af5cd337e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:19:09.555 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:19:09.481+0000 7f0b777fe700 10 client.16410 ms_handle_connect on v2:172.21.15.172:6838/3850440096 2023-07-14T18:19:09.555 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:19:09.481+0000 7f0b977fe700 1 --2- 172.21.15.163:0/3291793323 >> [v2:172.21.15.172:6838/3850440096,v1:172.21.15.172:6839/3850440096] conn(0x55af5cd313d0 0x55af5cd337e0 crc :-1 s=READY pgs=83 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4fa814ee894d70bf server_cookie=f9297301bbd9164b in_seq=0 out_seq=0 2023-07-14T18:19:09.556 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:19:09.482+0000 7f0b777fe700 1 -- 172.21.15.163:0/3291793323 <== mds.0 v2:172.21.15.172:6838/3850440096 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18017 (crc 0 0 0) 0x55af5cce6da0 con 0x55af5cd313d0 2023-07-14T18:19:09.556 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:19:09.482+0000 7f0b777fe700 10 client.16410 handle_command_reply: tid=0 2023-07-14T18:19:09.556 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:19:09.482+0000 7f0baa9d6b80 1 client.16410 shutdown 2023-07-14T18:19:09.556 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:19:09.482+0000 7f0baa9d6b80 1 -- 172.21.15.163:0/3291793323 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55af5cd1c370 msgr2=0x55af5cd259b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:19:09.557 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:19:09.482+0000 7f0baa9d6b80 1 --2- 172.21.15.163:0/3291793323 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55af5cd1c370 0x55af5cd259b0 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7f0b880cbcc0 tx=0x7f0b880ce430 comp rx=0 tx=0).stop 2023-07-14T18:19:09.557 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:19:09.482+0000 7f0baa9d6b80 1 -- 172.21.15.163:0/3291793323 shutdown_connections 2023-07-14T18:19:09.557 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:19:09.482+0000 7f0baa9d6b80 1 --2- 172.21.15.163:0/3291793323 >> [v2:172.21.15.172:6838/3850440096,v1:172.21.15.172:6839/3850440096] conn(0x55af5cd313d0 0x55af5cd337e0 crc :-1 s=READY pgs=83 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:19:09.557 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:19:09.482+0000 7f0baa9d6b80 1 --2- 172.21.15.163:0/3291793323 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55af5cd1d8a0 0x55af5cd2cf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:19:09.558 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:19:09.482+0000 7f0baa9d6b80 1 --2- 172.21.15.163:0/3291793323 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55af5cd1c370 0x55af5cd259b0 unknown :-1 s=CLOSED pgs=695 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:19:09.558 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:19:09.482+0000 7f0b777fe700 0 client.16410 ms_handle_reset on v2:172.21.15.172:6838/3850440096 2023-07-14T18:19:09.558 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:19:09.482+0000 7f0baa9d6b80 1 --2- 172.21.15.163:0/3291793323 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55af5cd1cce0 0x55af5cd25ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:19:09.559 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:19:09.482+0000 7f0baa9d6b80 1 -- 172.21.15.163:0/3291793323 >> 172.21.15.163:0/3291793323 conn(0x55af5cd0d680 msgr2=0x55af5cd11650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:19:09.559 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:19:09.482+0000 7f0baa9d6b80 1 -- 172.21.15.163:0/3291793323 shutdown_connections 2023-07-14T18:19:09.559 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:19:09.482+0000 7f0baa9d6b80 1 -- 172.21.15.163:0/3291793323 wait complete. 2023-07-14T18:19:09.560 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:19:09.482+0000 7f0baa9d6b80 20 client.16410 trim_cache size 0 max 16384 2023-07-14T18:19:09.563 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:19:09.508+0000 7f0baa9d6b80 1 Processor -- start 2023-07-14T18:19:09.564 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:19:09.508+0000 7f0baa9d6b80 1 -- start start 2023-07-14T18:19:09.564 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:19:09.508+0000 7f0baa9d6b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55af5cd1c370 0x55af5cd0eb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:19:09.564 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:19:09.508+0000 7f0baa9d6b80 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55af5cd1cce0 0x55af5cd2cef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:19:09.565 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:19:09.508+0000 7f0baa9d6b80 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55af5cd1d8a0 0x55af5cd120f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:19:09.565 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:19:09.508+0000 7f0baa9d6b80 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x55af5cd24e60 con 0x55af5cd1cce0 2023-07-14T18:19:09.565 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:19:09.508+0000 7f0baa9d6b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x55af5cd385f0 con 0x55af5cd1c370 2023-07-14T18:19:09.565 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:19:09.508+0000 7f0baa9d6b80 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x55af5cd13cb0 con 0x55af5cd1d8a0 2023-07-14T18:19:09.565 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:19:09.508+0000 7f0b977fe700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55af5cd1cce0 0x55af5cd2cef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:19:09.566 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:19:09.508+0000 7f0b97fff700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55af5cd1c370 0x55af5cd0eb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:19:09.566 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:19:09.508+0000 7f0b97fff700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55af5cd1c370 0x55af5cd0eb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.163:60512/0 (socket says 172.21.15.163:60512) 2023-07-14T18:19:09.566 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:19:09.508+0000 7f0b977fe700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55af5cd1cce0 0x55af5cd2cef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:59830/0 (socket says 172.21.15.163:59830) 2023-07-14T18:19:09.566 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:19:09.508+0000 7f0b9cddb700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55af5cd1d8a0 0x55af5cd120f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:19:09.566 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:19:09.508+0000 7f0b97fff700 1 -- 172.21.15.163:0/1865778592 learned_addr learned my addr 172.21.15.163:0/1865778592 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:19:09.567 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:19:09.509+0000 7f0b97fff700 1 -- 172.21.15.163:0/1865778592 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55af5cd1d8a0 msgr2=0x55af5cd120f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:19:09.567 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:19:09.509+0000 7f0b97fff700 1 --2- 172.21.15.163:0/1865778592 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55af5cd1d8a0 0x55af5cd120f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:19:09.567 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:19:09.509+0000 7f0b97fff700 1 -- 172.21.15.163:0/1865778592 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55af5cd1cce0 msgr2=0x55af5cd2cef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:19:09.567 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:19:09.509+0000 7f0b97fff700 1 --2- 172.21.15.163:0/1865778592 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55af5cd1cce0 0x55af5cd2cef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:19:09.567 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:19:09.509+0000 7f0b97fff700 1 -- 172.21.15.163:0/1865778592 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55af5cabd250 con 0x55af5cd1c370 2023-07-14T18:19:09.568 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:19:09.509+0000 7f0b977fe700 1 --2- 172.21.15.163:0/1865778592 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55af5cd1cce0 0x55af5cd2cef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T18:19:09.568 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:19:09.509+0000 7f0b97fff700 1 --2- 172.21.15.163:0/1865778592 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55af5cd1c370 0x55af5cd0eb50 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f0b880cbfe0 tx=0x7f0b88009ca0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8a5c57b6bf9617b8 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:19:09.568 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:19:09.509+0000 7f0b7effd700 1 -- 172.21.15.163:0/1865778592 <== mon.2 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b880cd070 con 0x55af5cd1c370 2023-07-14T18:19:09.568 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:19:09.509+0000 7f0b7effd700 1 -- 172.21.15.163:0/1865778592 <== mon.2 v2:172.21.15.172:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f0b880a3870 con 0x55af5cd1c370 2023-07-14T18:19:09.568 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:19:09.509+0000 7f0b7effd700 1 -- 172.21.15.163:0/1865778592 <== mon.2 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b8809a9a0 con 0x55af5cd1c370 2023-07-14T18:19:09.569 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:19:09.510+0000 7f0baa9d6b80 1 -- 172.21.15.163:0/1865778592 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55af5cd1c370 msgr2=0x55af5cd0eb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:19:09.569 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:19:09.510+0000 7f0baa9d6b80 1 --2- 172.21.15.163:0/1865778592 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55af5cd1c370 0x55af5cd0eb50 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f0b880cbfe0 tx=0x7f0b88009ca0 comp rx=0 tx=0).stop 2023-07-14T18:19:09.569 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:19:09.510+0000 7f0baa9d6b80 1 -- 172.21.15.163:0/1865778592 shutdown_connections 2023-07-14T18:19:09.569 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:19:09.510+0000 7f0baa9d6b80 1 --2- 172.21.15.163:0/1865778592 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55af5cd1d8a0 0x55af5cd120f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:19:09.569 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:19:09.510+0000 7f0baa9d6b80 1 --2- 172.21.15.163:0/1865778592 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55af5cd1c370 0x55af5cd0eb50 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:19:09.570 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:19:09.510+0000 7f0baa9d6b80 1 --2- 172.21.15.163:0/1865778592 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55af5cd1cce0 0x55af5cd2cef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:19:09.570 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:19:09.510+0000 7f0baa9d6b80 1 -- 172.21.15.163:0/1865778592 >> 172.21.15.163:0/1865778592 conn(0x55af5cd0d680 msgr2=0x55af5cd129a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:19:09.570 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:19:09.510+0000 7f0baa9d6b80 1 -- 172.21.15.163:0/1865778592 shutdown_connections 2023-07-14T18:19:09.570 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:19:09.510+0000 7f0baa9d6b80 1 -- 172.21.15.163:0/1865778592 wait complete. 2023-07-14T18:19:09.570 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:19:09.510+0000 7f0baa9d6b80 1 -- start start 2023-07-14T18:19:09.571 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:19:09.510+0000 7f0baa9d6b80 1 Processor -- start 2023-07-14T18:19:09.571 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:19:09.511+0000 7f0baa9d6b80 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55af5cd1c370 0x55af5cd2c6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:19:09.571 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:19:09.511+0000 7f0baa9d6b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55af5cd1cce0 0x55af5cd2cc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:19:09.571 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:19:09.511+0000 7f0baa9d6b80 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55af5cd1d8a0 0x55af5cd29180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:19:09.571 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:19:09.511+0000 7f0baa9d6b80 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x55af5cd29700 con 0x55af5cd1d8a0 2023-07-14T18:19:09.571 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:19:09.511+0000 7f0baa9d6b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x55af5cd29840 con 0x55af5cd1cce0 2023-07-14T18:19:09.572 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:19:09.511+0000 7f0baa9d6b80 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x55af5cd29a00 con 0x55af5cd1c370 2023-07-14T18:19:09.572 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:19:09.511+0000 7f0baa9d6b80 10 client.0 _ll_register_callbacks cb 0x55af5cc06760 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T18:19:09.572 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:19:09.511+0000 7f0b9cddb700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55af5cd1d8a0 0x55af5cd29180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:19:09.572 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:19:09.511+0000 7f0b977fe700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55af5cd1cce0 0x55af5cd2cc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:19:09.572 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:19:09.511+0000 7f0b9cddb700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55af5cd1d8a0 0x55af5cd29180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:59838/0 (socket says 172.21.15.163:59838) 2023-07-14T18:19:09.573 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:19:09.511+0000 7f0b9cddb700 1 -- 172.21.15.163:0/804724048 learned_addr learned my addr 172.21.15.163:0/804724048 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:19:09.573 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:19:09.511+0000 7f0b97fff700 1 --2- 172.21.15.163:0/804724048 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55af5cd1c370 0x55af5cd2c6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:19:09.573 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:19:09.511+0000 7f0b977fe700 1 -- 172.21.15.163:0/804724048 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55af5cd1c370 msgr2=0x55af5cd2c6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:19:09.573 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:19:09.511+0000 7f0b977fe700 1 --2- 172.21.15.163:0/804724048 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55af5cd1c370 0x55af5cd2c6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:19:09.573 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:19:09.511+0000 7f0b977fe700 1 -- 172.21.15.163:0/804724048 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55af5cd1d8a0 msgr2=0x55af5cd29180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:19:09.574 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:19:09.511+0000 7f0b977fe700 1 --2- 172.21.15.163:0/804724048 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55af5cd1d8a0 0x55af5cd29180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:19:09.574 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:19:09.511+0000 7f0b977fe700 1 -- 172.21.15.163:0/804724048 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b8c017070 con 0x55af5cd1cce0 2023-07-14T18:19:09.574 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:19:09.511+0000 7f0b977fe700 1 --2- 172.21.15.163:0/804724048 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55af5cd1cce0 0x55af5cd2cc20 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x55af5cd33dc0 tx=0x7f0b8c0047c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d63b66fdd2e32ba9 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:19:09.574 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:19:09.511+0000 7f0b777fe700 10 client.0 ms_handle_connect on v2:172.21.15.172:3300/0 2023-07-14T18:19:09.574 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:19:09.511+0000 7f0b777fe700 1 -- 172.21.15.163:0/804724048 <== mon.2 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b8c024040 con 0x55af5cd1cce0 2023-07-14T18:19:09.575 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:19:09.512+0000 7f0baa9d6b80 1 -- 172.21.15.163:0/804724048 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f0b8809b730 con 0x55af5cd1cce0 2023-07-14T18:19:09.575 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:19:09.512+0000 7f0b777fe700 1 -- 172.21.15.163:0/804724048 <== mon.2 v2:172.21.15.172:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 9049+0+0 (secure 0 0 0) 0x7f0b8c029840 con 0x55af5cd1cce0 2023-07-14T18:19:09.575 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:19:09.512+0000 7f0b777fe700 1 -- 172.21.15.163:0/804724048 <== mon.2 v2:172.21.15.172:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0b8c029a00 con 0x55af5cd1cce0 2023-07-14T18:19:09.575 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:19:09.512+0000 7f0baa9d6b80 10 client.26042 fetch_fsmap learned FSMap version 36 2023-07-14T18:19:09.575 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:19:09.512+0000 7f0baa9d6b80 1 -- 172.21.15.163:0/804724048 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) v3 -- 0x55af5ca7fc60 con 0x55af5cd1cce0 2023-07-14T18:19:09.576 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:19:09.512+0000 7f0b777fe700 1 -- 172.21.15.163:0/804724048 <== mon.2 v2:172.21.15.172:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f0b8809b730 con 0x55af5cd1cce0 2023-07-14T18:19:09.576 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:19:09.512+0000 7f0b777fe700 1 -- 172.21.15.163:0/804724048 <== mon.2 v2:172.21.15.172:3300/0 5 ==== fsmap(e 36) v1 ==== 7490+0+0 (secure 0 0 0) 0x7f0b8c005020 con 0x55af5cd1cce0 2023-07-14T18:19:09.576 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:19:09.512+0000 7f0baa9d6b80 10 client.26042 fetch_fsmap finished waiting for FSMap version 36 2023-07-14T18:19:09.576 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:19:09.512+0000 7f0baa9d6b80 10 client.26042 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-07-14T18:19:09.576 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:19:09.512+0000 7f0baa9d6b80 20 client.26042 populate_metadata read hostname 'smithi163' 2023-07-14T18:19:09.577 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:19:09.512+0000 7f0baa9d6b80 1 --2- 172.21.15.163:0/804724048 >> [v2:172.21.15.172:6838/3850440096,v1:172.21.15.172:6839/3850440096] conn(0x55af5cd86620 0x55af5cd88a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:19:09.577 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:19:09.512+0000 7f0baa9d6b80 4 client.26042 mds_command: new command op to 24518 tid=0[{"prefix": "scrub status"}] 2023-07-14T18:19:09.577 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:19:09.512+0000 7f0baa9d6b80 1 -- 172.21.15.163:0/804724048 --> [v2:172.21.15.172:6838/3850440096,v1:172.21.15.172:6839/3850440096] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55af5cc61eb0 con 0x55af5cd86620 2023-07-14T18:19:09.577 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:19:09.512+0000 7f0b97fff700 1 --2- 172.21.15.163:0/804724048 >> [v2:172.21.15.172:6838/3850440096,v1:172.21.15.172:6839/3850440096] conn(0x55af5cd86620 0x55af5cd88a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:19:09.577 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:19:09.513+0000 7f0b777fe700 10 client.26042 ms_handle_connect on v2:172.21.15.172:6838/3850440096 2023-07-14T18:19:09.578 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:19:09.513+0000 7f0b97fff700 1 --2- 172.21.15.163:0/804724048 >> [v2:172.21.15.172:6838/3850440096,v1:172.21.15.172:6839/3850440096] conn(0x55af5cd86620 0x55af5cd88a30 crc :-1 s=READY pgs=84 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5a04337cab913c11 server_cookie=2f75127f204f09b0 in_seq=0 out_seq=0 2023-07-14T18:19:09.578 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:19:09.513+0000 7f0b777fe700 1 -- 172.21.15.163:0/804724048 <== mds.0 v2:172.21.15.172:6838/3850440096 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x55af5cc61eb0 con 0x55af5cd86620 2023-07-14T18:19:09.578 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:19:09.513+0000 7f0b777fe700 10 client.26042 handle_command_reply: tid=0 2023-07-14T18:19:09.578 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:19:09.513+0000 7f0baa9d6b80 1 client.26042 shutdown 2023-07-14T18:19:09.578 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:19:09.513+0000 7f0baa9d6b80 1 -- 172.21.15.163:0/804724048 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55af5cd1cce0 msgr2=0x55af5cd2cc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:19:09.578 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:19:09.513+0000 7f0baa9d6b80 1 --2- 172.21.15.163:0/804724048 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55af5cd1cce0 0x55af5cd2cc20 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x55af5cd33dc0 tx=0x7f0b8c0047c0 comp rx=0 tx=0).stop 2023-07-14T18:19:09.579 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:19:09.513+0000 7f0baa9d6b80 1 -- 172.21.15.163:0/804724048 shutdown_connections 2023-07-14T18:19:09.579 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:19:09.513+0000 7f0baa9d6b80 1 --2- 172.21.15.163:0/804724048 >> [v2:172.21.15.172:6838/3850440096,v1:172.21.15.172:6839/3850440096] conn(0x55af5cd86620 0x55af5cd88a30 crc :-1 s=READY pgs=84 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:19:09.579 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:19:09.513+0000 7f0baa9d6b80 1 --2- 172.21.15.163:0/804724048 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55af5cd1c370 0x55af5cd2c6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:19:09.579 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:19:09.513+0000 7f0b777fe700 0 client.26042 ms_handle_reset on v2:172.21.15.172:6838/3850440096 2023-07-14T18:19:09.579 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:19:09.513+0000 7f0baa9d6b80 1 --2- 172.21.15.163:0/804724048 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55af5cd1d8a0 0x55af5cd29180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:19:09.580 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:19:09.513+0000 7f0baa9d6b80 1 --2- 172.21.15.163:0/804724048 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55af5cd1cce0 0x55af5cd2cc20 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:19:09.580 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:19:09.513+0000 7f0baa9d6b80 1 -- 172.21.15.163:0/804724048 >> 172.21.15.163:0/804724048 conn(0x55af5cd0d680 msgr2=0x55af5cd20720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:19:09.580 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:19:09.513+0000 7f0baa9d6b80 1 -- 172.21.15.163:0/804724048 shutdown_connections 2023-07-14T18:19:09.580 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:19:09.513+0000 7f0baa9d6b80 1 -- 172.21.15.163:0/804724048 wait complete. 2023-07-14T18:19:09.580 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:19:09.513+0000 7f0baa9d6b80 20 client.26042 trim_cache size 0 max 16384 2023-07-14T18:19:09.581 INFO:teuthology.orchestra.run.smithi163.stdout:{ 2023-07-14T18:19:09.581 INFO:teuthology.orchestra.run.smithi163.stdout: "status": "IDLE (waiting for more scrubs)", 2023-07-14T18:19:09.581 INFO:teuthology.orchestra.run.smithi163.stdout: "scrubs": { 2023-07-14T18:19:09.582 INFO:teuthology.orchestra.run.smithi163.stdout: "2c53b7ef-6f30-49f0-a60d-f1f114c19d42": { 2023-07-14T18:19:09.582 INFO:teuthology.orchestra.run.smithi163.stdout: "path": "/", 2023-07-14T18:19:09.582 INFO:teuthology.orchestra.run.smithi163.stdout: "tag": "2c53b7ef-6f30-49f0-a60d-f1f114c19d42", 2023-07-14T18:19:09.582 INFO:teuthology.orchestra.run.smithi163.stdout: "options": "recursive,force" 2023-07-14T18:19:09.582 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-07-14T18:19:09.583 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-07-14T18:19:09.583 INFO:teuthology.orchestra.run.smithi163.stdout:} 2023-07-14T18:19:09.584 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:19:09.514+0000 7f0b9e83e700 1 -- 172.21.15.163:0/3652933807 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f0b800a1150 msgr2=0x7f0b800a3600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:19:09.584 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:19:09.514+0000 7f0b9e83e700 1 --2- 172.21.15.163:0/3652933807 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f0b800a1150 0x7f0b800a3600 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f0b980ffe30 tx=0x7f0b8c009260 comp rx=0 tx=0).stop 2023-07-14T18:19:09.584 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:19:09.514+0000 7f0b9e83e700 1 -- 172.21.15.163:0/3652933807 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0b980fed60 msgr2=0x7f0b98195890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:19:09.585 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:19:09.514+0000 7f0b9e83e700 1 --2- 172.21.15.163:0/3652933807 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0b980fed60 0x7f0b98195890 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f0b880059d0 tx=0x7f0b88004730 comp rx=0 tx=0).stop 2023-07-14T18:19:09.585 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:19:09.514+0000 7f0b9e83e700 1 -- 172.21.15.163:0/3652933807 shutdown_connections 2023-07-14T18:19:09.585 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:19:09.514+0000 7f0b9e83e700 1 --2- 172.21.15.163:0/3652933807 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f0b800a1150 0x7f0b800a3600 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:19:09.585 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:19:09.514+0000 7f0b9e83e700 1 --2- 172.21.15.163:0/3652933807 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0b980fed60 0x7f0b98195890 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:19:09.585 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:19:09.514+0000 7f0b9e83e700 1 --2- 172.21.15.163:0/3652933807 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0b98100110 0x7f0b9819ce40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:19:09.586 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:19:09.514+0000 7f0b9e83e700 1 --2- 172.21.15.163:0/3652933807 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f0b980ff710 0x7f0b98195dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:19:09.586 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:19:09.514+0000 7f0b9e83e700 1 -- 172.21.15.163:0/3652933807 >> 172.21.15.163:0/3652933807 conn(0x7f0b980f98e0 msgr2=0x7f0b980fb6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:19:09.586 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:19:09.514+0000 7f0b9e83e700 1 -- 172.21.15.163:0/3652933807 shutdown_connections 2023-07-14T18:19:09.586 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:19:09.514+0000 7f0b9e83e700 1 -- 172.21.15.163:0/3652933807 wait complete. 2023-07-14T18:19:09.587 INFO:tasks.cephfs.filesystem:scrub status for tag:2c53b7ef-6f30-49f0-a60d-f1f114c19d42 - {'path': '/', 'tag': '2c53b7ef-6f30-49f0-a60d-f1f114c19d42', 'options': 'recursive,force'} 2023-07-14T18:19:10.932 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:19:10 smithi184 ceph-mon[98481]: pgmap v495: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-07-14T18:19:10.932 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:19:10 smithi184 ceph-mon[98481]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-07-14T18:19:10.974 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:19:10 smithi163 ceph-mon[96576]: pgmap v495: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-07-14T18:19:10.974 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:19:10 smithi163 ceph-mon[96576]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-07-14T18:19:11.032 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:19:10 smithi172 ceph-mon[97983]: pgmap v495: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-07-14T18:19:11.033 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:19:10 smithi172 ceph-mon[97983]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-07-14T18:19:12.182 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:19:11 smithi184 ceph-mon[98481]: pgmap v496: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-07-14T18:19:12.224 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:19:11 smithi163 ceph-mon[96576]: pgmap v496: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-07-14T18:19:12.282 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:19:11 smithi172 ceph-mon[97983]: pgmap v496: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-07-14T18:19:14.932 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:19:14 smithi184 ceph-mon[98481]: pgmap v497: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-07-14T18:19:14.974 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:19:14 smithi163 ceph-mon[96576]: pgmap v497: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-07-14T18:19:15.032 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:19:14 smithi172 ceph-mon[97983]: pgmap v497: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-07-14T18:19:16.932 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:19:16 smithi184 ceph-mon[98481]: pgmap v498: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-07-14T18:19:16.974 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:19:16 smithi163 ceph-mon[96576]: pgmap v498: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-07-14T18:19:17.033 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:19:16 smithi172 ceph-mon[97983]: pgmap v498: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-07-14T18:19:18.932 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:19:18 smithi184 ceph-mon[98481]: pgmap v499: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-07-14T18:19:18.974 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:19:18 smithi163 ceph-mon[96576]: pgmap v499: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-07-14T18:19:19.033 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:19:18 smithi172 ceph-mon[97983]: pgmap v499: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-07-14T18:19:20.932 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:19:20 smithi184 ceph-mon[98481]: pgmap v500: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-07-14T18:19:20.974 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:19:20 smithi163 ceph-mon[96576]: pgmap v500: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-07-14T18:19:21.033 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:19:20 smithi172 ceph-mon[97983]: pgmap v500: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-07-14T18:19:22.182 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:19:21 smithi184 ceph-mon[98481]: pgmap v501: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-07-14T18:19:22.224 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:19:21 smithi163 ceph-mon[96576]: pgmap v501: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-07-14T18:19:22.283 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:19:21 smithi172 ceph-mon[97983]: pgmap v501: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-07-14T18:19:23.432 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:19:23 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-14T18:19:23.474 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:19:23 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-14T18:19:23.533 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:19:23 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-14T18:19:24.432 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:19:24 smithi184 ceph-mon[98481]: pgmap v502: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-07-14T18:19:24.432 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:19:24 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T18:19:24.433 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:19:24 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-14T18:19:24.433 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:19:24 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:19:24.474 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:19:24 smithi163 ceph-mon[96576]: pgmap v502: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-07-14T18:19:24.475 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:19:24 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T18:19:24.475 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:19:24 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-14T18:19:24.475 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:19:24 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:19:24.533 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:19:24 smithi172 ceph-mon[97983]: pgmap v502: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-07-14T18:19:24.533 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:19:24 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T18:19:24.533 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:19:24 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-14T18:19:24.534 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:19:24 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:19:26.932 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:19:26 smithi184 ceph-mon[98481]: pgmap v503: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-07-14T18:19:26.974 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:19:26 smithi163 ceph-mon[96576]: pgmap v503: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-07-14T18:19:27.033 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:19:26 smithi172 ceph-mon[97983]: pgmap v503: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-07-14T18:19:28.932 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:19:28 smithi184 ceph-mon[98481]: pgmap v504: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-07-14T18:19:28.974 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:19:28 smithi163 ceph-mon[96576]: pgmap v504: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-07-14T18:19:29.033 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:19:28 smithi172 ceph-mon[97983]: pgmap v504: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-07-14T18:19:30.932 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:19:30 smithi184 ceph-mon[98481]: pgmap v505: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-07-14T18:19:30.974 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:19:30 smithi163 ceph-mon[96576]: pgmap v505: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-07-14T18:19:31.033 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:19:30 smithi172 ceph-mon[97983]: pgmap v505: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-07-14T18:19:32.182 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:19:31 smithi184 ceph-mon[98481]: pgmap v506: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-07-14T18:19:32.225 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:19:31 smithi163 ceph-mon[96576]: pgmap v506: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-07-14T18:19:32.283 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:19:31 smithi172 ceph-mon[97983]: pgmap v506: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-07-14T18:19:34.932 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:19:34 smithi184 ceph-mon[98481]: pgmap v507: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-07-14T18:19:34.974 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:19:34 smithi163 ceph-mon[96576]: pgmap v507: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-07-14T18:19:35.033 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:19:34 smithi172 ceph-mon[97983]: pgmap v507: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-07-14T18:19:36.932 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:19:36 smithi184 ceph-mon[98481]: pgmap v508: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-07-14T18:19:36.975 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:19:36 smithi163 ceph-mon[96576]: pgmap v508: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-07-14T18:19:37.033 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:19:36 smithi172 ceph-mon[97983]: pgmap v508: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-07-14T18:19:38.932 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:19:38 smithi184 ceph-mon[98481]: pgmap v509: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-07-14T18:19:38.933 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:19:38 smithi184 ceph-mon[98481]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-07-14T18:19:38.974 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:19:38 smithi163 ceph-mon[96576]: pgmap v509: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-07-14T18:19:38.975 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:19:38 smithi163 ceph-mon[96576]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-07-14T18:19:39.033 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:19:38 smithi172 ceph-mon[97983]: pgmap v509: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-07-14T18:19:39.033 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:19:38 smithi172 ceph-mon[97983]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-07-14T18:19:39.588 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-07-14T18:19:39.742 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:19:39.693+0000 7f13ed7dc700 1 -- 172.21.15.163:0/1370651631 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f13e80feb80 msgr2=0x7f13e80fef90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:19:39.742 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:19:39.693+0000 7f13ed7dc700 1 --2- 172.21.15.163:0/1370651631 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f13e80feb80 0x7f13e80fef90 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7f13d8009990 tx=0x7f13d8009ca0 comp rx=0 tx=0).stop 2023-07-14T18:19:39.743 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:19:39.693+0000 7f13ed7dc700 1 -- 172.21.15.163:0/1370651631 shutdown_connections 2023-07-14T18:19:39.743 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:19:39.693+0000 7f13ed7dc700 1 --2- 172.21.15.163:0/1370651631 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f13e8100700 0x7f13e8106fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:19:39.746 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:19:39.693+0000 7f13ed7dc700 1 --2- 172.21.15.163:0/1370651631 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f13e80feb80 0x7f13e80fef90 unknown :-1 s=CLOSED pgs=696 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:19:39.746 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:19:39.693+0000 7f13ed7dc700 1 --2- 172.21.15.163:0/1370651631 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f13e80ffd70 0x7f13e81001c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:19:39.746 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:19:39.693+0000 7f13ed7dc700 1 -- 172.21.15.163:0/1370651631 >> 172.21.15.163:0/1370651631 conn(0x7f13e80fa1a0 msgr2=0x7f13e80fc5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:19:39.746 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:19:39.693+0000 7f13ed7dc700 1 -- 172.21.15.163:0/1370651631 shutdown_connections 2023-07-14T18:19:39.747 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:19:39.693+0000 7f13ed7dc700 1 -- 172.21.15.163:0/1370651631 wait complete. 2023-07-14T18:19:39.747 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:19:39.694+0000 7f13ed7dc700 1 Processor -- start 2023-07-14T18:19:39.747 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:19:39.694+0000 7f13ed7dc700 1 -- start start 2023-07-14T18:19:39.747 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:19:39.694+0000 7f13ed7dc700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f13e80feb80 0x7f13e80694e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:19:39.748 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:19:39.694+0000 7f13ed7dc700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f13e80ffd70 0x7f13e819a5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:19:39.748 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:19:39.694+0000 7f13ed7dc700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f13e8100700 0x7f13e819cc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:19:39.748 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:19:39.694+0000 7f13ed7dc700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13e819d3e0 con 0x7f13e8100700 2023-07-14T18:19:39.748 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:19:39.694+0000 7f13ed7dc700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13e819d550 con 0x7f13e80ffd70 2023-07-14T18:19:39.749 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:19:39.694+0000 7f13ed7dc700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13e819d710 con 0x7f13e80feb80 2023-07-14T18:19:39.749 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:19:39.694+0000 7f13e6ffd700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f13e80feb80 0x7f13e80694e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:19:39.749 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:19:39.694+0000 7f13e77fe700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f13e8100700 0x7f13e819cc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:19:39.749 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:19:39.694+0000 7f13e67fc700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f13e80ffd70 0x7f13e819a5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:19:39.749 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:19:39.695+0000 7f13e6ffd700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f13e80feb80 0x7f13e80694e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.163:41668/0 (socket says 172.21.15.163:41668) 2023-07-14T18:19:39.750 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:19:39.695+0000 7f13e6ffd700 1 -- 172.21.15.163:0/4181675192 learned_addr learned my addr 172.21.15.163:0/4181675192 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:19:39.750 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:19:39.695+0000 7f13e67fc700 1 -- 172.21.15.163:0/4181675192 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f13e80feb80 msgr2=0x7f13e80694e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:19:39.750 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:19:39.695+0000 7f13e67fc700 1 --2- 172.21.15.163:0/4181675192 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f13e80feb80 0x7f13e80694e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:19:39.750 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:19:39.695+0000 7f13e67fc700 1 -- 172.21.15.163:0/4181675192 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f13e8100700 msgr2=0x7f13e819cc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:19:39.750 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:19:39.695+0000 7f13e67fc700 1 --2- 172.21.15.163:0/4181675192 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f13e8100700 0x7f13e819cc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:19:39.751 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:19:39.695+0000 7f13e67fc700 1 -- 172.21.15.163:0/4181675192 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13e0009c40 con 0x7f13e80ffd70 2023-07-14T18:19:39.751 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:19:39.695+0000 7f13e67fc700 1 --2- 172.21.15.163:0/4181675192 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f13e80ffd70 0x7f13e819a5c0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f13dc00e9f0 tx=0x7f13dc00ed00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:19:39.751 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:19:39.695+0000 7f13cffff700 1 -- 172.21.15.163:0/4181675192 <== mon.2 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13dc00c9c0 con 0x7f13e80ffd70 2023-07-14T18:19:39.751 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:19:39.695+0000 7f13ed7dc700 1 -- 172.21.15.163:0/4181675192 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f13d80095f0 con 0x7f13e80ffd70 2023-07-14T18:19:39.752 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:19:39.695+0000 7f13cffff700 1 -- 172.21.15.163:0/4181675192 <== mon.2 v2:172.21.15.172:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f13dc010430 con 0x7f13e80ffd70 2023-07-14T18:19:39.752 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:19:39.695+0000 7f13cffff700 1 -- 172.21.15.163:0/4181675192 <== mon.2 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13dc018680 con 0x7f13e80ffd70 2023-07-14T18:19:39.752 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:19:39.695+0000 7f13ed7dc700 1 -- 172.21.15.163:0/4181675192 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f13e819dd70 con 0x7f13e80ffd70 2023-07-14T18:19:39.752 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:19:39.697+0000 7f13cffff700 1 -- 172.21.15.163:0/4181675192 <== mon.2 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 18) v1 ==== 135716+0+0 (secure 0 0 0) 0x7f13dc0105a0 con 0x7f13e80ffd70 2023-07-14T18:19:39.757 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:19:39.698+0000 7f13cffff700 1 --2- 172.21.15.163:0/4181675192 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f13d00a1150 0x7f13d00a3600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:19:39.757 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:19:39.698+0000 7f13e6ffd700 1 --2- 172.21.15.163:0/4181675192 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f13d00a1150 0x7f13d00a3600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:19:39.757 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:19:39.698+0000 7f13cffff700 1 -- 172.21.15.163:0/4181675192 <== mon.2 v2:172.21.15.172:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 9049+0+0 (secure 0 0 0) 0x7f13dc014070 con 0x7f13e80ffd70 2023-07-14T18:19:39.757 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:19:39.698+0000 7f13e6ffd700 1 --2- 172.21.15.163:0/4181675192 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f13d00a1150 0x7f13d00a3600 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f13d800b2e0 tx=0x7f13d8004000 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:19:39.758 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:19:39.699+0000 7f13f9974b80 1 Processor -- start 2023-07-14T18:19:39.758 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:19:39.699+0000 7f13f9974b80 1 -- start start 2023-07-14T18:19:39.758 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:19:39.699+0000 7f13f9974b80 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55aacb420f60 0x55aacb421370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:19:39.758 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:19:39.699+0000 7f13f9974b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55aacb4218b0 0x55aacb421ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:19:39.759 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:19:39.699+0000 7f13f9974b80 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55aacb4224b0 0x55aacb422920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:19:39.759 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:19:39.699+0000 7f13f9974b80 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x55aacb325cb0 con 0x55aacb4224b0 2023-07-14T18:19:39.759 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:19:39.700+0000 7f13f9974b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x55aacb378a40 con 0x55aacb4218b0 2023-07-14T18:19:39.759 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:19:39.700+0000 7f13f9974b80 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x55aacb371ed0 con 0x55aacb420f60 2023-07-14T18:19:39.759 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:19:39.700+0000 7f13e6ffd700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55aacb420f60 0x55aacb421370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:19:39.760 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:19:39.700+0000 7f13e6ffd700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55aacb420f60 0x55aacb421370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.163:41676/0 (socket says 172.21.15.163:41676) 2023-07-14T18:19:39.760 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:19:39.700+0000 7f13e77fe700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55aacb4224b0 0x55aacb422920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:19:39.760 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:19:39.700+0000 7f13e6ffd700 1 -- 172.21.15.163:0/497775795 learned_addr learned my addr 172.21.15.163:0/497775795 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:19:39.760 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:19:39.700+0000 7f13e67fc700 1 --2- 172.21.15.163:0/497775795 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55aacb4218b0 0x55aacb421ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:19:39.761 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:19:39.700+0000 7f13e6ffd700 1 -- 172.21.15.163:0/497775795 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55aacb4218b0 msgr2=0x55aacb421ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:19:39.761 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:19:39.700+0000 7f13e6ffd700 1 --2- 172.21.15.163:0/497775795 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55aacb4218b0 0x55aacb421ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:19:39.761 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:19:39.700+0000 7f13e6ffd700 1 -- 172.21.15.163:0/497775795 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55aacb4224b0 msgr2=0x55aacb422920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:19:39.761 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:19:39.700+0000 7f13e6ffd700 1 --2- 172.21.15.163:0/497775795 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55aacb4224b0 0x55aacb422920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:19:39.761 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:19:39.700+0000 7f13e6ffd700 1 -- 172.21.15.163:0/497775795 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55aacb19fde0 con 0x55aacb420f60 2023-07-14T18:19:39.761 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:19:39.700+0000 7f13e77fe700 1 --2- 172.21.15.163:0/497775795 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55aacb4224b0 0x55aacb422920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T18:19:39.762 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:19:39.700+0000 7f13e6ffd700 1 --2- 172.21.15.163:0/497775795 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55aacb420f60 0x55aacb421370 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f13d8005480 tx=0x7f13d8020000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=25b5c2af692abf36 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:19:39.762 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:19:39.700+0000 7f13cd7fa700 1 -- 172.21.15.163:0/497775795 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13d8003d10 con 0x55aacb420f60 2023-07-14T18:19:39.762 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:19:39.700+0000 7f13cd7fa700 1 -- 172.21.15.163:0/497775795 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f13d801e040 con 0x55aacb420f60 2023-07-14T18:19:39.763 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:19:39.700+0000 7f13cd7fa700 1 -- 172.21.15.163:0/497775795 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13d8004920 con 0x55aacb420f60 2023-07-14T18:19:39.763 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:19:39.701+0000 7f13f9974b80 1 -- 172.21.15.163:0/497775795 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55aacb420f60 msgr2=0x55aacb421370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:19:39.763 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:19:39.701+0000 7f13f9974b80 1 --2- 172.21.15.163:0/497775795 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55aacb420f60 0x55aacb421370 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f13d8005480 tx=0x7f13d8020000 comp rx=0 tx=0).stop 2023-07-14T18:19:39.764 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:19:39.701+0000 7f13f9974b80 1 -- 172.21.15.163:0/497775795 shutdown_connections 2023-07-14T18:19:39.764 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:19:39.701+0000 7f13f9974b80 1 --2- 172.21.15.163:0/497775795 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55aacb420f60 0x55aacb421370 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:19:39.764 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:19:39.701+0000 7f13f9974b80 1 --2- 172.21.15.163:0/497775795 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55aacb4224b0 0x55aacb422920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:19:39.765 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:19:39.701+0000 7f13f9974b80 1 --2- 172.21.15.163:0/497775795 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55aacb4218b0 0x55aacb421ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:19:39.765 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:19:39.701+0000 7f13f9974b80 1 -- 172.21.15.163:0/497775795 >> 172.21.15.163:0/497775795 conn(0x55aacb416680 msgr2=0x55aacb41b9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:19:39.765 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:19:39.701+0000 7f13f9974b80 1 -- 172.21.15.163:0/497775795 shutdown_connections 2023-07-14T18:19:39.765 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:19:39.701+0000 7f13f9974b80 1 -- 172.21.15.163:0/497775795 wait complete. 2023-07-14T18:19:39.765 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:19:39.701+0000 7f13f9974b80 1 -- start start 2023-07-14T18:19:39.766 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:19:39.702+0000 7f13f9974b80 1 Processor -- start 2023-07-14T18:19:39.766 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:19:39.702+0000 7f13f9974b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55aacb420f60 0x55aacb42a910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:19:39.766 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:19:39.702+0000 7f13f9974b80 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55aacb4218b0 0x55aacb42ae50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:19:39.766 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:19:39.702+0000 7f13f9974b80 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55aacb4224b0 0x55aacb431e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:19:39.766 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:19:39.702+0000 7f13f9974b80 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x55aacb311ac0 con 0x55aacb4218b0 2023-07-14T18:19:39.767 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:19:39.702+0000 7f13f9974b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x55aacb3117c0 con 0x55aacb420f60 2023-07-14T18:19:39.767 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:19:39.702+0000 7f13f9974b80 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x55aacb1f5920 con 0x55aacb4224b0 2023-07-14T18:19:39.767 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:19:39.702+0000 7f13f9974b80 10 client.0 _ll_register_callbacks cb 0x55aacb30f760 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T18:19:39.767 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:19:39.702+0000 7f13e6ffd700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55aacb420f60 0x55aacb42a910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:19:39.767 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:19:39.702+0000 7f13e77fe700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55aacb4224b0 0x55aacb431e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:19:39.768 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:19:39.702+0000 7f13e6ffd700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55aacb420f60 0x55aacb42a910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.163:60544/0 (socket says 172.21.15.163:60544) 2023-07-14T18:19:39.768 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:19:39.702+0000 7f13e6ffd700 1 -- 172.21.15.163:0/2970805912 learned_addr learned my addr 172.21.15.163:0/2970805912 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:19:39.768 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:19:39.702+0000 7f13e67fc700 1 --2- 172.21.15.163:0/2970805912 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55aacb4218b0 0x55aacb42ae50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:19:39.768 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:19:39.702+0000 7f13e6ffd700 1 -- 172.21.15.163:0/2970805912 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55aacb4224b0 msgr2=0x55aacb431e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:19:39.769 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:19:39.702+0000 7f13e6ffd700 1 --2- 172.21.15.163:0/2970805912 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55aacb4224b0 0x55aacb431e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:19:39.769 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:19:39.702+0000 7f13e6ffd700 1 -- 172.21.15.163:0/2970805912 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55aacb4218b0 msgr2=0x55aacb42ae50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:19:39.769 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:19:39.702+0000 7f13e6ffd700 1 --2- 172.21.15.163:0/2970805912 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55aacb4218b0 0x55aacb42ae50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:19:39.769 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:19:39.702+0000 7f13e6ffd700 1 -- 172.21.15.163:0/2970805912 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f13e000e330 con 0x55aacb420f60 2023-07-14T18:19:39.770 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:19:39.702+0000 7f13e77fe700 1 --2- 172.21.15.163:0/2970805912 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55aacb4224b0 0x55aacb431e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T18:19:39.770 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:19:39.702+0000 7f13e67fc700 1 --2- 172.21.15.163:0/2970805912 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55aacb4218b0 0x55aacb42ae50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T18:19:39.770 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:19:39.703+0000 7f13e6ffd700 1 --2- 172.21.15.163:0/2970805912 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55aacb420f60 0x55aacb42a910 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f13d8009ce0 tx=0x7f13d8004e90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5aab788af4415cc8 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:19:39.770 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:19:39.703+0000 7f13caff5700 10 client.0 ms_handle_connect on v2:172.21.15.172:3300/0 2023-07-14T18:19:39.770 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:19:39.703+0000 7f13caff5700 1 -- 172.21.15.163:0/2970805912 <== mon.2 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13d800b8b0 con 0x55aacb420f60 2023-07-14T18:19:39.771 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:19:39.703+0000 7f13caff5700 1 -- 172.21.15.163:0/2970805912 <== mon.2 v2:172.21.15.172:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 9049+0+0 (secure 0 0 0) 0x7f13d8004950 con 0x55aacb420f60 2023-07-14T18:19:39.771 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:19:39.703+0000 7f13f9974b80 1 -- 172.21.15.163:0/2970805912 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55aacb2cb4f0 con 0x55aacb420f60 2023-07-14T18:19:39.771 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:19:39.703+0000 7f13caff5700 1 -- 172.21.15.163:0/2970805912 <== mon.2 v2:172.21.15.172:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) v2 ==== 24+0+0 (secure 0 0 0) 0x7f13d800ba10 con 0x55aacb420f60 2023-07-14T18:19:39.771 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:19:39.703+0000 7f13f9974b80 10 client.26054 fetch_fsmap learned FSMap version 39 2023-07-14T18:19:39.771 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:19:39.703+0000 7f13f9974b80 1 -- 172.21.15.163:0/2970805912 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) v3 -- 0x7f13e81078f0 con 0x55aacb420f60 2023-07-14T18:19:39.771 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:19:39.703+0000 7f13caff5700 1 -- 172.21.15.163:0/2970805912 <== mon.2 v2:172.21.15.172:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55aacb2cb4f0 con 0x55aacb420f60 2023-07-14T18:19:39.772 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:19:39.703+0000 7f13caff5700 1 -- 172.21.15.163:0/2970805912 <== mon.2 v2:172.21.15.172:3300/0 5 ==== fsmap(e 39) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f13d802f440 con 0x55aacb420f60 2023-07-14T18:19:39.772 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:19:39.703+0000 7f13f9974b80 10 client.26054 fetch_fsmap finished waiting for FSMap version 39 2023-07-14T18:19:39.772 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:19:39.703+0000 7f13f9974b80 10 client.26054 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-07-14T18:19:39.772 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:19:39.703+0000 7f13f9974b80 20 client.26054 populate_metadata read hostname 'smithi163' 2023-07-14T18:19:39.773 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:19:39.703+0000 7f13f9974b80 1 --2- 172.21.15.163:0/2970805912 >> [v2:172.21.15.172:6838/3850440096,v1:172.21.15.172:6839/3850440096] conn(0x55aacb4361c0 0x55aacb4385d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:19:39.773 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:19:39.703+0000 7f13f9974b80 4 client.26054 mds_command: new command op to 24518 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-14T18:19:39.773 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:19:39.703+0000 7f13f9974b80 1 -- 172.21.15.163:0/2970805912 --> [v2:172.21.15.172:6838/3850440096,v1:172.21.15.172:6839/3850440096] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55aacb3efda0 con 0x55aacb4361c0 2023-07-14T18:19:39.773 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:19:39.704+0000 7f13e67fc700 1 --2- 172.21.15.163:0/2970805912 >> [v2:172.21.15.172:6838/3850440096,v1:172.21.15.172:6839/3850440096] conn(0x55aacb4361c0 0x55aacb4385d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:19:39.773 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:19:39.704+0000 7f13caff5700 10 client.26054 ms_handle_connect on v2:172.21.15.172:6838/3850440096 2023-07-14T18:19:39.774 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:19:39.704+0000 7f13e67fc700 1 --2- 172.21.15.163:0/2970805912 >> [v2:172.21.15.172:6838/3850440096,v1:172.21.15.172:6839/3850440096] conn(0x55aacb4361c0 0x55aacb4385d0 crc :-1 s=READY pgs=85 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c8b2f3251629960d server_cookie=c00695d060941395 in_seq=0 out_seq=0 2023-07-14T18:19:39.774 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:19:39.704+0000 7f13caff5700 1 -- 172.21.15.163:0/2970805912 <== mds.0 v2:172.21.15.172:6838/3850440096 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18017 (crc 0 0 0) 0x55aacb3efda0 con 0x55aacb4361c0 2023-07-14T18:19:39.774 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:19:39.704+0000 7f13caff5700 10 client.26054 handle_command_reply: tid=0 2023-07-14T18:19:39.775 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:19:39.704+0000 7f13f9974b80 1 client.26054 shutdown 2023-07-14T18:19:39.775 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:19:39.705+0000 7f13f9974b80 1 -- 172.21.15.163:0/2970805912 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55aacb420f60 msgr2=0x55aacb42a910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:19:39.775 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:19:39.705+0000 7f13f9974b80 1 --2- 172.21.15.163:0/2970805912 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55aacb420f60 0x55aacb42a910 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f13d8009ce0 tx=0x7f13d8004e90 comp rx=0 tx=0).stop 2023-07-14T18:19:39.775 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:19:39.705+0000 7f13f9974b80 1 -- 172.21.15.163:0/2970805912 shutdown_connections 2023-07-14T18:19:39.775 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:19:39.705+0000 7f13f9974b80 1 --2- 172.21.15.163:0/2970805912 >> [v2:172.21.15.172:6838/3850440096,v1:172.21.15.172:6839/3850440096] conn(0x55aacb4361c0 0x55aacb4385d0 crc :-1 s=READY pgs=85 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:19:39.776 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:19:39.705+0000 7f13f9974b80 1 --2- 172.21.15.163:0/2970805912 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55aacb4224b0 0x55aacb431e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:19:39.776 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:19:39.705+0000 7f13f9974b80 1 --2- 172.21.15.163:0/2970805912 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55aacb420f60 0x55aacb42a910 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:19:39.776 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:19:39.705+0000 7f13caff5700 0 client.26054 ms_handle_reset on v2:172.21.15.172:6838/3850440096 2023-07-14T18:19:39.776 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:19:39.705+0000 7f13f9974b80 1 --2- 172.21.15.163:0/2970805912 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55aacb4218b0 0x55aacb42ae50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:19:39.777 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:19:39.705+0000 7f13f9974b80 1 -- 172.21.15.163:0/2970805912 >> 172.21.15.163:0/2970805912 conn(0x55aacb416680 msgr2=0x55aacb41a650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:19:39.777 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:19:39.705+0000 7f13f9974b80 1 -- 172.21.15.163:0/2970805912 shutdown_connections 2023-07-14T18:19:39.777 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:19:39.705+0000 7f13f9974b80 1 -- 172.21.15.163:0/2970805912 wait complete. 2023-07-14T18:19:39.777 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:19:39.705+0000 7f13f9974b80 20 client.26054 trim_cache size 0 max 16384 2023-07-14T18:19:39.783 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:19:39.726+0000 7f13f9974b80 1 Processor -- start 2023-07-14T18:19:39.784 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:19:39.726+0000 7f13f9974b80 1 -- start start 2023-07-14T18:19:39.784 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:19:39.726+0000 7f13f9974b80 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55aacb420f60 0x55aacb429610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:19:39.784 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:19:39.726+0000 7f13f9974b80 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55aacb4218b0 0x55aacb431e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:19:39.785 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:19:39.726+0000 7f13f9974b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55aacb4224b0 0x55aacb41b0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:19:39.785 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:19:39.726+0000 7f13f9974b80 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x55aacb42b940 con 0x55aacb4218b0 2023-07-14T18:19:39.785 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:19:39.726+0000 7f13f9974b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x55aacb41ccc0 con 0x55aacb4224b0 2023-07-14T18:19:39.785 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:19:39.726+0000 7f13f9974b80 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x55aacb43d3a0 con 0x55aacb420f60 2023-07-14T18:19:39.785 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:19:39.726+0000 7f13e67fc700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55aacb4218b0 0x55aacb431e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:19:39.786 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:19:39.726+0000 7f13e6ffd700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55aacb420f60 0x55aacb429610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:19:39.786 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:19:39.726+0000 7f13e77fe700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55aacb4224b0 0x55aacb41b0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:19:39.786 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:19:39.726+0000 7f13e67fc700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55aacb4218b0 0x55aacb431e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:59870/0 (socket says 172.21.15.163:59870) 2023-07-14T18:19:39.786 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:19:39.726+0000 7f13e6ffd700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55aacb420f60 0x55aacb429610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.163:41690/0 (socket says 172.21.15.163:41690) 2023-07-14T18:19:39.786 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:19:39.726+0000 7f13e67fc700 1 -- 172.21.15.163:0/2107947822 learned_addr learned my addr 172.21.15.163:0/2107947822 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:19:39.787 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:19:39.726+0000 7f13e67fc700 1 -- 172.21.15.163:0/2107947822 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55aacb420f60 msgr2=0x55aacb429610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:19:39.787 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:19:39.726+0000 7f13e67fc700 1 --2- 172.21.15.163:0/2107947822 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55aacb420f60 0x55aacb429610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:19:39.787 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:19:39.726+0000 7f13e67fc700 1 -- 172.21.15.163:0/2107947822 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55aacb4224b0 msgr2=0x55aacb41b0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:19:39.787 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:19:39.726+0000 7f13e67fc700 1 --2- 172.21.15.163:0/2107947822 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55aacb4224b0 0x55aacb41b0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:19:39.787 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:19:39.726+0000 7f13e67fc700 1 -- 172.21.15.163:0/2107947822 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55aacb188c60 con 0x55aacb4218b0 2023-07-14T18:19:39.788 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:19:39.726+0000 7f13e77fe700 1 --2- 172.21.15.163:0/2107947822 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55aacb4224b0 0x55aacb41b0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T18:19:39.788 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:19:39.726+0000 7f13e67fc700 1 --2- 172.21.15.163:0/2107947822 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55aacb4218b0 0x55aacb431e50 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7f13dc099d30 tx=0x7f13dc01a040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=94eb18da59af62f5 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:19:39.788 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:19:39.727+0000 7f13cdffb700 1 -- 172.21.15.163:0/2107947822 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13dc0b6070 con 0x55aacb4218b0 2023-07-14T18:19:39.788 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:19:39.727+0000 7f13cdffb700 1 -- 172.21.15.163:0/2107947822 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f13dc09a030 con 0x55aacb4218b0 2023-07-14T18:19:39.788 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:19:39.727+0000 7f13cdffb700 1 -- 172.21.15.163:0/2107947822 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13dc098240 con 0x55aacb4218b0 2023-07-14T18:19:39.789 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:19:39.727+0000 7f13f9974b80 1 -- 172.21.15.163:0/2107947822 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55aacb4218b0 msgr2=0x55aacb431e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:19:39.789 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:19:39.727+0000 7f13f9974b80 1 --2- 172.21.15.163:0/2107947822 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55aacb4218b0 0x55aacb431e50 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7f13dc099d30 tx=0x7f13dc01a040 comp rx=0 tx=0).stop 2023-07-14T18:19:39.789 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:19:39.727+0000 7f13f9974b80 1 -- 172.21.15.163:0/2107947822 shutdown_connections 2023-07-14T18:19:39.789 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:19:39.727+0000 7f13f9974b80 1 --2- 172.21.15.163:0/2107947822 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55aacb420f60 0x55aacb429610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:19:39.789 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:19:39.727+0000 7f13f9974b80 1 --2- 172.21.15.163:0/2107947822 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55aacb4224b0 0x55aacb41b0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:19:39.790 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:19:39.727+0000 7f13f9974b80 1 --2- 172.21.15.163:0/2107947822 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55aacb4218b0 0x55aacb431e50 unknown :-1 s=CLOSED pgs=697 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:19:39.790 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:19:39.727+0000 7f13f9974b80 1 -- 172.21.15.163:0/2107947822 >> 172.21.15.163:0/2107947822 conn(0x55aacb416680 msgr2=0x55aacb41b9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:19:39.790 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:19:39.727+0000 7f13f9974b80 1 -- 172.21.15.163:0/2107947822 shutdown_connections 2023-07-14T18:19:39.790 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:19:39.727+0000 7f13f9974b80 1 -- 172.21.15.163:0/2107947822 wait complete. 2023-07-14T18:19:39.791 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:19:39.728+0000 7f13f9974b80 1 -- start start 2023-07-14T18:19:39.791 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:19:39.728+0000 7f13f9974b80 1 Processor -- start 2023-07-14T18:19:39.791 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:19:39.728+0000 7f13f9974b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55aacb420f60 0x55aacb431920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:19:39.791 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:19:39.728+0000 7f13f9974b80 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55aacb4218b0 0x55aacb42ff30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:19:39.791 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:19:39.728+0000 7f13f9974b80 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55aacb4224b0 0x55aacb430470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:19:39.792 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:19:39.728+0000 7f13f9974b80 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x55aacb432140 con 0x55aacb4218b0 2023-07-14T18:19:39.792 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:19:39.728+0000 7f13f9974b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x55aacb4309b0 con 0x55aacb420f60 2023-07-14T18:19:39.792 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:19:39.728+0000 7f13f9974b80 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x55aacb430b70 con 0x55aacb4224b0 2023-07-14T18:19:39.792 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:19:39.728+0000 7f13e67fc700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55aacb4218b0 0x55aacb42ff30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:19:39.793 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:19:39.728+0000 7f13f9974b80 10 client.0 _ll_register_callbacks cb 0x7f13e000e280 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T18:19:39.793 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:19:39.728+0000 7f13e6ffd700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55aacb420f60 0x55aacb431920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:19:39.793 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:19:39.728+0000 7f13e67fc700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55aacb4218b0 0x55aacb42ff30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:59876/0 (socket says 172.21.15.163:59876) 2023-07-14T18:19:39.793 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:19:39.728+0000 7f13e67fc700 1 -- 172.21.15.163:0/295573892 learned_addr learned my addr 172.21.15.163:0/295573892 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:19:39.793 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:19:39.728+0000 7f13e6ffd700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55aacb420f60 0x55aacb431920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.163:60558/0 (socket says 172.21.15.163:60558) 2023-07-14T18:19:39.794 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:19:39.728+0000 7f13e77fe700 1 --2- 172.21.15.163:0/295573892 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55aacb4224b0 0x55aacb430470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:19:39.794 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:19:39.729+0000 7f13e67fc700 1 -- 172.21.15.163:0/295573892 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55aacb4224b0 msgr2=0x55aacb430470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:19:39.794 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:19:39.729+0000 7f13e67fc700 1 --2- 172.21.15.163:0/295573892 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55aacb4224b0 0x55aacb430470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:19:39.795 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:19:39.729+0000 7f13e67fc700 1 -- 172.21.15.163:0/295573892 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55aacb420f60 msgr2=0x55aacb431920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:19:39.795 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:19:39.729+0000 7f13e67fc700 1 --2- 172.21.15.163:0/295573892 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55aacb420f60 0x55aacb431920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:19:39.796 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:19:39.729+0000 7f13e67fc700 1 -- 172.21.15.163:0/295573892 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f13e000ea20 con 0x55aacb4218b0 2023-07-14T18:19:39.796 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:19:39.729+0000 7f13e77fe700 1 --2- 172.21.15.163:0/295573892 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55aacb4224b0 0x55aacb430470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T18:19:39.796 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:19:39.729+0000 7f13e6ffd700 1 --2- 172.21.15.163:0/295573892 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55aacb420f60 0x55aacb431920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T18:19:39.797 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:19:39.729+0000 7f13e67fc700 1 --2- 172.21.15.163:0/295573892 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55aacb4218b0 0x55aacb42ff30 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7f13dc099fc0 tx=0x7f13dc00c750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3cd0e732fab2af6c server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:19:39.797 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:19:39.729+0000 7f13caff5700 10 client.0 ms_handle_connect on v2:172.21.15.163:3300/0 2023-07-14T18:19:39.798 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:19:39.729+0000 7f13caff5700 1 -- 172.21.15.163:0/295573892 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13dc0b6070 con 0x55aacb4218b0 2023-07-14T18:19:39.798 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:19:39.729+0000 7f13caff5700 1 -- 172.21.15.163:0/295573892 <== mon.0 v2:172.21.15.163:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 9049+0+0 (secure 0 0 0) 0x7f13dc0981e0 con 0x55aacb4218b0 2023-07-14T18:19:39.798 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:19:39.729+0000 7f13f9974b80 1 -- 172.21.15.163:0/295573892 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f13d801e040 con 0x55aacb4218b0 2023-07-14T18:19:39.799 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:19:39.729+0000 7f13caff5700 1 -- 172.21.15.163:0/295573892 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) v2 ==== 24+0+0 (secure 0 0 0) 0x7f13dc09e060 con 0x55aacb4218b0 2023-07-14T18:19:39.799 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:19:39.729+0000 7f13f9974b80 10 client.16434 fetch_fsmap learned FSMap version 39 2023-07-14T18:19:39.800 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:19:39.729+0000 7f13f9974b80 1 -- 172.21.15.163:0/295573892 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) v3 -- 0x7f13e819dd70 con 0x55aacb4218b0 2023-07-14T18:19:39.800 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:19:39.729+0000 7f13caff5700 1 -- 172.21.15.163:0/295573892 <== mon.0 v2:172.21.15.163:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f13d801e040 con 0x55aacb4218b0 2023-07-14T18:19:39.800 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:19:39.730+0000 7f13caff5700 1 -- 172.21.15.163:0/295573892 <== mon.0 v2:172.21.15.163:3300/0 5 ==== fsmap(e 39) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f13dc099520 con 0x55aacb4218b0 2023-07-14T18:19:39.801 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:19:39.730+0000 7f13f9974b80 10 client.16434 fetch_fsmap finished waiting for FSMap version 39 2023-07-14T18:19:39.801 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:19:39.730+0000 7f13f9974b80 10 client.16434 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-07-14T18:19:39.801 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:19:39.730+0000 7f13f9974b80 20 client.16434 populate_metadata read hostname 'smithi163' 2023-07-14T18:19:39.802 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:19:39.730+0000 7f13f9974b80 1 --2- 172.21.15.163:0/295573892 >> [v2:172.21.15.172:6838/3850440096,v1:172.21.15.172:6839/3850440096] conn(0x55aacb48b050 0x55aacb48d460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:19:39.802 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:19:39.730+0000 7f13f9974b80 4 client.16434 mds_command: new command op to 24518 tid=0[{"prefix": "scrub status"}] 2023-07-14T18:19:39.802 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:19:39.730+0000 7f13f9974b80 1 -- 172.21.15.163:0/295573892 --> [v2:172.21.15.172:6838/3850440096,v1:172.21.15.172:6839/3850440096] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55aacb36aeb0 con 0x55aacb48b050 2023-07-14T18:19:39.803 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:19:39.730+0000 7f13e6ffd700 1 --2- 172.21.15.163:0/295573892 >> [v2:172.21.15.172:6838/3850440096,v1:172.21.15.172:6839/3850440096] conn(0x55aacb48b050 0x55aacb48d460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:19:39.803 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:19:39.730+0000 7f13caff5700 10 client.16434 ms_handle_connect on v2:172.21.15.172:6838/3850440096 2023-07-14T18:19:39.803 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:19:39.730+0000 7f13e6ffd700 1 --2- 172.21.15.163:0/295573892 >> [v2:172.21.15.172:6838/3850440096,v1:172.21.15.172:6839/3850440096] conn(0x55aacb48b050 0x55aacb48d460 crc :-1 s=READY pgs=86 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ff70e7df9d4e7ee8 server_cookie=fe9b9a9eb91de643 in_seq=0 out_seq=0 2023-07-14T18:19:39.804 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:19:39.730+0000 7f13caff5700 1 -- 172.21.15.163:0/295573892 <== mds.0 v2:172.21.15.172:6838/3850440096 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x55aacb36aeb0 con 0x55aacb48b050 2023-07-14T18:19:39.804 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:19:39.730+0000 7f13caff5700 10 client.16434 handle_command_reply: tid=0 2023-07-14T18:19:39.804 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:19:39.730+0000 7f13f9974b80 1 client.16434 shutdown 2023-07-14T18:19:39.805 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:19:39.730+0000 7f13f9974b80 1 -- 172.21.15.163:0/295573892 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55aacb4218b0 msgr2=0x55aacb42ff30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:19:39.805 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:19:39.730+0000 7f13f9974b80 1 --2- 172.21.15.163:0/295573892 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55aacb4218b0 0x55aacb42ff30 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7f13dc099fc0 tx=0x7f13dc00c750 comp rx=0 tx=0).stop 2023-07-14T18:19:39.806 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:19:39.731+0000 7f13f9974b80 1 -- 172.21.15.163:0/295573892 shutdown_connections 2023-07-14T18:19:39.806 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:19:39.731+0000 7f13f9974b80 1 --2- 172.21.15.163:0/295573892 >> [v2:172.21.15.172:6838/3850440096,v1:172.21.15.172:6839/3850440096] conn(0x55aacb48b050 0x55aacb48d460 crc :-1 s=READY pgs=86 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:19:39.806 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:19:39.731+0000 7f13f9974b80 1 --2- 172.21.15.163:0/295573892 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55aacb4224b0 0x55aacb430470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:19:39.807 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:19:39.731+0000 7f13caff5700 0 client.16434 ms_handle_reset on v2:172.21.15.172:6838/3850440096 2023-07-14T18:19:39.807 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:19:39.731+0000 7f13f9974b80 1 --2- 172.21.15.163:0/295573892 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55aacb420f60 0x55aacb431920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:19:39.807 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:19:39.731+0000 7f13f9974b80 1 --2- 172.21.15.163:0/295573892 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55aacb4218b0 0x55aacb42ff30 unknown :-1 s=CLOSED pgs=698 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:19:39.808 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:19:39.731+0000 7f13f9974b80 1 -- 172.21.15.163:0/295573892 >> 172.21.15.163:0/295573892 conn(0x55aacb416680 msgr2=0x55aacb432780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:19:39.808 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:19:39.731+0000 7f13f9974b80 1 -- 172.21.15.163:0/295573892 shutdown_connections 2023-07-14T18:19:39.808 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:19:39.731+0000 7f13f9974b80 1 -- 172.21.15.163:0/295573892 wait complete. 2023-07-14T18:19:39.808 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:19:39.731+0000 7f13f9974b80 20 client.16434 trim_cache size 0 max 16384 2023-07-14T18:19:39.809 INFO:teuthology.orchestra.run.smithi163.stdout:{ 2023-07-14T18:19:39.809 INFO:teuthology.orchestra.run.smithi163.stdout: "status": "IDLE (waiting for more scrubs)", 2023-07-14T18:19:39.809 INFO:teuthology.orchestra.run.smithi163.stdout: "scrubs": { 2023-07-14T18:19:39.810 INFO:teuthology.orchestra.run.smithi163.stdout: "2c53b7ef-6f30-49f0-a60d-f1f114c19d42": { 2023-07-14T18:19:39.810 INFO:teuthology.orchestra.run.smithi163.stdout: "path": "/", 2023-07-14T18:19:39.810 INFO:teuthology.orchestra.run.smithi163.stdout: "tag": "2c53b7ef-6f30-49f0-a60d-f1f114c19d42", 2023-07-14T18:19:39.810 INFO:teuthology.orchestra.run.smithi163.stdout: "options": "recursive,force" 2023-07-14T18:19:39.810 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-07-14T18:19:39.810 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-07-14T18:19:39.811 INFO:teuthology.orchestra.run.smithi163.stdout:} 2023-07-14T18:19:39.812 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:19:39.731+0000 7f13ed7dc700 1 -- 172.21.15.163:0/4181675192 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f13d00a1150 msgr2=0x7f13d00a3600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:19:39.812 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:19:39.731+0000 7f13ed7dc700 1 --2- 172.21.15.163:0/4181675192 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f13d00a1150 0x7f13d00a3600 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f13d800b2e0 tx=0x7f13d8004000 comp rx=0 tx=0).stop 2023-07-14T18:19:39.812 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:19:39.731+0000 7f13ed7dc700 1 -- 172.21.15.163:0/4181675192 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f13e80ffd70 msgr2=0x7f13e819a5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:19:39.813 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:19:39.731+0000 7f13ed7dc700 1 --2- 172.21.15.163:0/4181675192 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f13e80ffd70 0x7f13e819a5c0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f13dc00e9f0 tx=0x7f13dc00ed00 comp rx=0 tx=0).stop 2023-07-14T18:19:39.813 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:19:39.731+0000 7f13ed7dc700 1 -- 172.21.15.163:0/4181675192 shutdown_connections 2023-07-14T18:19:39.813 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:19:39.731+0000 7f13ed7dc700 1 --2- 172.21.15.163:0/4181675192 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f13d00a1150 0x7f13d00a3600 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:19:39.813 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:19:39.731+0000 7f13ed7dc700 1 --2- 172.21.15.163:0/4181675192 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f13e80feb80 0x7f13e80694e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:19:39.813 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:19:39.731+0000 7f13ed7dc700 1 --2- 172.21.15.163:0/4181675192 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f13e8100700 0x7f13e819cc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:19:39.814 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:19:39.731+0000 7f13ed7dc700 1 --2- 172.21.15.163:0/4181675192 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f13e80ffd70 0x7f13e819a5c0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:19:39.814 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:19:39.731+0000 7f13ed7dc700 1 -- 172.21.15.163:0/4181675192 >> 172.21.15.163:0/4181675192 conn(0x7f13e80fa1a0 msgr2=0x7f13e80fc480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:19:39.814 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:19:39.731+0000 7f13ed7dc700 1 -- 172.21.15.163:0/4181675192 shutdown_connections 2023-07-14T18:19:39.814 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:19:39.731+0000 7f13ed7dc700 1 -- 172.21.15.163:0/4181675192 wait complete. 2023-07-14T18:19:39.815 INFO:tasks.cephfs.filesystem:scrub status for tag:2c53b7ef-6f30-49f0-a60d-f1f114c19d42 - {'path': '/', 'tag': '2c53b7ef-6f30-49f0-a60d-f1f114c19d42', 'options': 'recursive,force'} 2023-07-14T18:19:40.932 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:19:40 smithi184 ceph-mon[98481]: pgmap v510: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-07-14T18:19:40.933 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:19:40 smithi184 ceph-mon[98481]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-07-14T18:19:40.975 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:19:40 smithi163 ceph-mon[96576]: pgmap v510: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-07-14T18:19:40.975 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:19:40 smithi163 ceph-mon[96576]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-07-14T18:19:41.033 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:19:40 smithi172 ceph-mon[97983]: pgmap v510: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-07-14T18:19:41.034 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:19:40 smithi172 ceph-mon[97983]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-07-14T18:19:42.182 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:19:41 smithi184 ceph-mon[98481]: pgmap v511: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-07-14T18:19:42.224 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:19:41 smithi163 ceph-mon[96576]: pgmap v511: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-07-14T18:19:42.283 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:19:41 smithi172 ceph-mon[97983]: pgmap v511: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-07-14T18:19:44.932 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:19:44 smithi184 ceph-mon[98481]: pgmap v512: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-07-14T18:19:44.975 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:19:44 smithi163 ceph-mon[96576]: pgmap v512: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-07-14T18:19:45.033 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:19:44 smithi172 ceph-mon[97983]: pgmap v512: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-07-14T18:19:46.932 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:19:46 smithi184 ceph-mon[98481]: pgmap v513: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-07-14T18:19:46.975 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:19:46 smithi163 ceph-mon[96576]: pgmap v513: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-07-14T18:19:47.033 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:19:46 smithi172 ceph-mon[97983]: pgmap v513: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-07-14T18:19:48.932 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:19:48 smithi184 ceph-mon[98481]: pgmap v514: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-07-14T18:19:48.975 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:19:48 smithi163 ceph-mon[96576]: pgmap v514: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-07-14T18:19:49.033 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:19:48 smithi172 ceph-mon[97983]: pgmap v514: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-07-14T18:19:50.932 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:19:50 smithi184 ceph-mon[98481]: pgmap v515: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-07-14T18:19:50.975 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:19:50 smithi163 ceph-mon[96576]: pgmap v515: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-07-14T18:19:51.034 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:19:50 smithi172 ceph-mon[97983]: pgmap v515: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-07-14T18:19:52.182 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:19:51 smithi184 ceph-mon[98481]: pgmap v516: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-07-14T18:19:52.225 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:19:51 smithi163 ceph-mon[96576]: pgmap v516: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-07-14T18:19:52.283 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:19:51 smithi172 ceph-mon[97983]: pgmap v516: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-07-14T18:19:54.932 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:19:54 smithi184 ceph-mon[98481]: pgmap v517: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-07-14T18:19:54.975 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:19:54 smithi163 ceph-mon[96576]: pgmap v517: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-07-14T18:19:55.033 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:19:54 smithi172 ceph-mon[97983]: pgmap v517: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-07-14T18:19:56.936 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:19:56 smithi184 ceph-mon[98481]: pgmap v518: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-07-14T18:19:56.975 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:19:56 smithi163 ceph-mon[96576]: pgmap v518: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-07-14T18:19:57.033 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:19:56 smithi172 ceph-mon[97983]: pgmap v518: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-07-14T18:19:58.933 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:19:58 smithi184 ceph-mon[98481]: pgmap v519: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-07-14T18:19:58.975 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:19:58 smithi163 ceph-mon[96576]: pgmap v519: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-07-14T18:19:59.033 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:19:58 smithi172 ceph-mon[97983]: pgmap v519: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-07-14T18:20:00.932 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:20:00 smithi184 ceph-mon[98481]: pgmap v520: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-07-14T18:20:00.933 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:20:00 smithi184 ceph-mon[98481]: overall HEALTH_OK 2023-07-14T18:20:00.975 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:20:00 smithi163 ceph-mon[96576]: pgmap v520: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-07-14T18:20:00.975 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:20:00 smithi163 ceph-mon[96576]: overall HEALTH_OK 2023-07-14T18:20:01.033 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:20:00 smithi172 ceph-mon[97983]: pgmap v520: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-07-14T18:20:01.034 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:20:00 smithi172 ceph-mon[97983]: overall HEALTH_OK 2023-07-14T18:20:02.182 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:20:01 smithi184 ceph-mon[98481]: pgmap v521: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-07-14T18:20:02.225 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:20:01 smithi163 ceph-mon[96576]: pgmap v521: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-07-14T18:20:02.283 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:20:01 smithi172 ceph-mon[97983]: pgmap v521: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-07-14T18:20:04.933 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:20:04 smithi184 ceph-mon[98481]: pgmap v522: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-07-14T18:20:04.975 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:20:04 smithi163 ceph-mon[96576]: pgmap v522: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-07-14T18:20:05.033 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:20:04 smithi172 ceph-mon[97983]: pgmap v522: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-07-14T18:20:06.933 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:20:06 smithi184 ceph-mon[98481]: pgmap v523: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-07-14T18:20:06.975 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:20:06 smithi163 ceph-mon[96576]: pgmap v523: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-07-14T18:20:07.033 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:20:06 smithi172 ceph-mon[97983]: pgmap v523: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-07-14T18:20:08.932 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:20:08 smithi184 ceph-mon[98481]: pgmap v524: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-07-14T18:20:08.975 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:20:08 smithi163 ceph-mon[96576]: pgmap v524: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-07-14T18:20:09.033 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:20:08 smithi172 ceph-mon[97983]: pgmap v524: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-07-14T18:20:09.816 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-07-14T18:20:09.973 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:20:09.922+0000 7fccf4075700 1 -- 172.21.15.163:0/2007450115 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fccec100e00 msgr2=0x7fccec101250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:20:09.973 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:20:09.922+0000 7fccf4075700 1 --2- 172.21.15.163:0/2007450115 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fccec100e00 0x7fccec101250 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fccdc0098f0 tx=0x7fccdc009c00 comp rx=0 tx=0).stop 2023-07-14T18:20:09.974 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:20:09.922+0000 7fccf4075700 1 -- 172.21.15.163:0/2007450115 shutdown_connections 2023-07-14T18:20:09.974 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:20:09.922+0000 7fccf4075700 1 --2- 172.21.15.163:0/2007450115 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fccec0ffc10 0x7fccec100020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:20:09.974 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:20:09.922+0000 7fccf4075700 1 --2- 172.21.15.163:0/2007450115 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fccec101790 0x7fccec108050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:20:09.974 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:20:09.922+0000 7fccf4075700 1 --2- 172.21.15.163:0/2007450115 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fccec100e00 0x7fccec101250 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:20:09.975 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:20:09.922+0000 7fccf4075700 1 -- 172.21.15.163:0/2007450115 >> 172.21.15.163:0/2007450115 conn(0x7fccec0fb250 msgr2=0x7fccec0fd660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:20:09.975 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:20:09.922+0000 7fccf4075700 1 -- 172.21.15.163:0/2007450115 shutdown_connections 2023-07-14T18:20:09.975 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:20:09.922+0000 7fccf4075700 1 -- 172.21.15.163:0/2007450115 wait complete. 2023-07-14T18:20:09.975 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:20:09.922+0000 7fccf4075700 1 Processor -- start 2023-07-14T18:20:09.975 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:20:09.922+0000 7fccf4075700 1 -- start start 2023-07-14T18:20:09.976 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:20:09.923+0000 7fccf4075700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fccec0ffc10 0x7fccec1958d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:20:09.976 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:20:09.923+0000 7fccf4075700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fccec100e00 0x7fccec195e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:20:09.976 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:20:09.923+0000 7fccf4075700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fccec101790 0x7fccec19ce80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:20:09.977 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:20:09.923+0000 7fccf4075700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fccec19d450 con 0x7fccec100e00 2023-07-14T18:20:09.977 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:20:09.923+0000 7fccf4075700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fccec19d590 con 0x7fccec0ffc10 2023-07-14T18:20:09.977 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:20:09.923+0000 7fccf4075700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fccec19d720 con 0x7fccec101790 2023-07-14T18:20:09.978 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:20:09.923+0000 7fccf1e11700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fccec0ffc10 0x7fccec1958d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:20:09.978 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:20:09.923+0000 7fccf1e11700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fccec0ffc10 0x7fccec1958d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.163:60572/0 (socket says 172.21.15.163:60572) 2023-07-14T18:20:09.978 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:20:09.923+0000 7fccf1e11700 1 -- 172.21.15.163:0/2913183963 learned_addr learned my addr 172.21.15.163:0/2913183963 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:20:09.979 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:20:09.923+0000 7fccf1610700 1 --2- 172.21.15.163:0/2913183963 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fccec100e00 0x7fccec195e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:20:09.979 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:20:09.923+0000 7fccf2612700 1 --2- 172.21.15.163:0/2913183963 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fccec101790 0x7fccec19ce80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:20:09.979 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:20:09.923+0000 7fccf1e11700 1 -- 172.21.15.163:0/2913183963 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fccec101790 msgr2=0x7fccec19ce80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:20:09.979 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:20:09.923+0000 7fccf1e11700 1 --2- 172.21.15.163:0/2913183963 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fccec101790 0x7fccec19ce80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:20:09.980 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:20:09.923+0000 7fccf1e11700 1 -- 172.21.15.163:0/2913183963 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fccec100e00 msgr2=0x7fccec195e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:20:09.980 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:20:09.923+0000 7fccf1e11700 1 --2- 172.21.15.163:0/2913183963 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fccec100e00 0x7fccec195e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:20:09.980 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:20:09.923+0000 7fccf1e11700 1 -- 172.21.15.163:0/2913183963 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcce80095f0 con 0x7fccec0ffc10 2023-07-14T18:20:09.980 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:20:09.923+0000 7fccf1610700 1 --2- 172.21.15.163:0/2913183963 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fccec100e00 0x7fccec195e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T18:20:09.980 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:20:09.923+0000 7fccf1e11700 1 --2- 172.21.15.163:0/2913183963 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fccec0ffc10 0x7fccec1958d0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fcce800ebf0 tx=0x7fcce800ef00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:20:09.981 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:20:09.923+0000 7fcce2ffd700 1 -- 172.21.15.163:0/2913183963 <== mon.2 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcce8009a10 con 0x7fccec0ffc10 2023-07-14T18:20:09.981 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:20:09.924+0000 7fccf4075700 1 -- 172.21.15.163:0/2913183963 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcce4009c40 con 0x7fccec0ffc10 2023-07-14T18:20:09.981 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:20:09.924+0000 7fcce2ffd700 1 -- 172.21.15.163:0/2913183963 <== mon.2 v2:172.21.15.172:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fcce800cc80 con 0x7fccec0ffc10 2023-07-14T18:20:09.981 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:20:09.924+0000 7fcce2ffd700 1 -- 172.21.15.163:0/2913183963 <== mon.2 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcce8018680 con 0x7fccec0ffc10 2023-07-14T18:20:09.982 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:20:09.924+0000 7fccf4075700 1 -- 172.21.15.163:0/2913183963 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fccdc009520 con 0x7fccec0ffc10 2023-07-14T18:20:09.987 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:20:09.926+0000 7fcce2ffd700 1 -- 172.21.15.163:0/2913183963 <== mon.2 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 18) v1 ==== 135716+0+0 (secure 0 0 0) 0x7fcce8010430 con 0x7fccec0ffc10 2023-07-14T18:20:09.987 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:20:09.927+0000 7fcce2ffd700 1 --2- 172.21.15.163:0/2913183963 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7fccd80a1150 0x7fccd80a3600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:20:09.987 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:20:09.927+0000 7fccf1610700 1 --2- 172.21.15.163:0/2913183963 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7fccd80a1150 0x7fccd80a3600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:20:09.987 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:20:09.927+0000 7fcce2ffd700 1 -- 172.21.15.163:0/2913183963 <== mon.2 v2:172.21.15.172:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 9049+0+0 (secure 0 0 0) 0x7fcce8014070 con 0x7fccec0ffc10 2023-07-14T18:20:09.988 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:20:09.927+0000 7fccf1610700 1 --2- 172.21.15.163:0/2913183963 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7fccd80a1150 0x7fccd80a3600 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fccdc00f910 tx=0x7fccdc019040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:20:09.988 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:20:09.927+0000 7fcd0020db80 1 Processor -- start 2023-07-14T18:20:09.989 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:20:09.928+0000 7fcd0020db80 1 -- start start 2023-07-14T18:20:09.989 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:20:09.928+0000 7fcd0020db80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559e2655af60 0x559e2655b370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:20:09.989 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:20:09.928+0000 7fcd0020db80 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x559e2655b8b0 0x559e2655bed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:20:09.990 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:20:09.928+0000 7fcd0020db80 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x559e2655c4b0 0x559e2655c920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:20:09.990 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:20:09.928+0000 7fcd0020db80 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x559e2645fcb0 con 0x559e2655b8b0 2023-07-14T18:20:09.991 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:20:09.928+0000 7fcd0020db80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x559e264b2a40 con 0x559e2655af60 2023-07-14T18:20:09.991 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:20:09.928+0000 7fcd0020db80 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x559e264abed0 con 0x559e2655c4b0 2023-07-14T18:20:09.992 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:20:09.928+0000 7fccf1610700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x559e2655b8b0 0x559e2655bed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:20:09.992 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:20:09.928+0000 7fccf1e11700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559e2655af60 0x559e2655b370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:20:09.992 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:20:09.928+0000 7fccf1e11700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559e2655af60 0x559e2655b370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.163:60580/0 (socket says 172.21.15.163:60580) 2023-07-14T18:20:09.993 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:20:09.928+0000 7fccf1e11700 1 -- 172.21.15.163:0/935217559 learned_addr learned my addr 172.21.15.163:0/935217559 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:20:09.993 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:20:09.928+0000 7fccf2612700 1 --2- 172.21.15.163:0/935217559 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x559e2655c4b0 0x559e2655c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:20:09.993 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:20:09.928+0000 7fccf1610700 1 -- 172.21.15.163:0/935217559 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x559e2655c4b0 msgr2=0x559e2655c920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:20:09.994 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:20:09.928+0000 7fccf1610700 1 --2- 172.21.15.163:0/935217559 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x559e2655c4b0 0x559e2655c920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:20:09.994 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:20:09.928+0000 7fccf1610700 1 -- 172.21.15.163:0/935217559 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559e2655af60 msgr2=0x559e2655b370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:20:09.995 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:20:09.928+0000 7fccf1610700 1 --2- 172.21.15.163:0/935217559 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559e2655af60 0x559e2655b370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:20:09.995 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:20:09.928+0000 7fccf1610700 1 -- 172.21.15.163:0/935217559 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559e262d9de0 con 0x559e2655b8b0 2023-07-14T18:20:09.995 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:20:09.928+0000 7fccf1e11700 1 --2- 172.21.15.163:0/935217559 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559e2655af60 0x559e2655b370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T18:20:09.995 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:20:09.929+0000 7fccf1610700 1 --2- 172.21.15.163:0/935217559 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x559e2655b8b0 0x559e2655bed0 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7fccdc009230 tx=0x7fccdc01e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b71d550270fda33e server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:20:09.996 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:20:09.929+0000 7fccd7fff700 1 -- 172.21.15.163:0/935217559 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccdc028070 con 0x559e2655b8b0 2023-07-14T18:20:09.996 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:20:09.929+0000 7fccd7fff700 1 -- 172.21.15.163:0/935217559 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fccdc01d040 con 0x559e2655b8b0 2023-07-14T18:20:09.996 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:20:09.929+0000 7fccd7fff700 1 -- 172.21.15.163:0/935217559 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccdc0055e0 con 0x559e2655b8b0 2023-07-14T18:20:09.996 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:20:09.929+0000 7fcd0020db80 1 -- 172.21.15.163:0/935217559 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x559e2655b8b0 msgr2=0x559e2655bed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:20:09.997 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:20:09.930+0000 7fcd0020db80 1 --2- 172.21.15.163:0/935217559 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x559e2655b8b0 0x559e2655bed0 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7fccdc009230 tx=0x7fccdc01e000 comp rx=0 tx=0).stop 2023-07-14T18:20:09.997 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:20:09.930+0000 7fcd0020db80 1 -- 172.21.15.163:0/935217559 shutdown_connections 2023-07-14T18:20:09.997 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:20:09.930+0000 7fcd0020db80 1 --2- 172.21.15.163:0/935217559 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x559e2655c4b0 0x559e2655c920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:20:09.997 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:20:09.930+0000 7fcd0020db80 1 --2- 172.21.15.163:0/935217559 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559e2655af60 0x559e2655b370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:20:09.997 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:20:09.930+0000 7fcd0020db80 1 --2- 172.21.15.163:0/935217559 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x559e2655b8b0 0x559e2655bed0 unknown :-1 s=CLOSED pgs=699 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:20:09.998 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:20:09.930+0000 7fcd0020db80 1 -- 172.21.15.163:0/935217559 >> 172.21.15.163:0/935217559 conn(0x559e26550680 msgr2=0x559e265559d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:20:09.998 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:20:09.930+0000 7fcd0020db80 1 -- 172.21.15.163:0/935217559 shutdown_connections 2023-07-14T18:20:09.999 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:20:09.930+0000 7fcd0020db80 1 -- 172.21.15.163:0/935217559 wait complete. 2023-07-14T18:20:09.999 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:20:09.930+0000 7fcd0020db80 1 -- start start 2023-07-14T18:20:10.000 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:20:09.930+0000 7fcd0020db80 1 Processor -- start 2023-07-14T18:20:10.000 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:20:09.931+0000 7fcd0020db80 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x559e2655af60 0x559e26564970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:20:10.000 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:20:09.931+0000 7fcd0020db80 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x559e2655b8b0 0x559e26564eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:20:10.001 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:20:09.931+0000 7fcd0020db80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559e2655c4b0 0x559e2656bef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:20:10.001 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:20:09.931+0000 7fcd0020db80 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x559e2644bac0 con 0x559e2655af60 2023-07-14T18:20:10.001 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:20:09.931+0000 7fcd0020db80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x559e2644b7c0 con 0x559e2655c4b0 2023-07-14T18:20:10.002 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:20:09.931+0000 7fcd0020db80 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x559e2632f920 con 0x559e2655b8b0 2023-07-14T18:20:10.002 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:20:09.931+0000 7fcd0020db80 10 client.0 _ll_register_callbacks cb 0x559e26449760 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T18:20:10.002 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:20:09.931+0000 7fccf1e11700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x559e2655af60 0x559e26564970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:20:10.002 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:20:09.931+0000 7fccf1610700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x559e2655b8b0 0x559e26564eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:20:10.002 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:20:09.931+0000 7fccf1e11700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x559e2655af60 0x559e26564970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:59902/0 (socket says 172.21.15.163:59902) 2023-07-14T18:20:10.003 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:20:09.931+0000 7fccf2612700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559e2655c4b0 0x559e2656bef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:20:10.003 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:20:09.931+0000 7fccf1e11700 1 -- 172.21.15.163:0/3701900025 learned_addr learned my addr 172.21.15.163:0/3701900025 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:20:10.003 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:20:09.931+0000 7fccf1e11700 1 -- 172.21.15.163:0/3701900025 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x559e2655b8b0 msgr2=0x559e26564eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:20:10.003 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:20:09.931+0000 7fccf1e11700 1 --2- 172.21.15.163:0/3701900025 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x559e2655b8b0 0x559e26564eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:20:10.003 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:20:09.931+0000 7fccf1e11700 1 -- 172.21.15.163:0/3701900025 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559e2655c4b0 msgr2=0x559e2656bef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:20:10.004 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:20:09.931+0000 7fccf1e11700 1 --2- 172.21.15.163:0/3701900025 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559e2655c4b0 0x559e2656bef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:20:10.004 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:20:09.931+0000 7fccf1e11700 1 -- 172.21.15.163:0/3701900025 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fccdc009520 con 0x559e2655af60 2023-07-14T18:20:10.004 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:20:09.931+0000 7fccf1610700 1 --2- 172.21.15.163:0/3701900025 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x559e2655b8b0 0x559e26564eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T18:20:10.004 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:20:09.931+0000 7fccf2612700 1 --2- 172.21.15.163:0/3701900025 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559e2655c4b0 0x559e2656bef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T18:20:10.005 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:20:09.931+0000 7fccf1e11700 1 --2- 172.21.15.163:0/3701900025 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x559e2655af60 0x559e26564970 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7fcce80ca930 tx=0x7fcce809a730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ebc456da1f366cfd server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:20:10.005 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:20:09.931+0000 7fccd57fa700 10 client.0 ms_handle_connect on v2:172.21.15.163:3300/0 2023-07-14T18:20:10.005 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:20:09.932+0000 7fccd57fa700 1 -- 172.21.15.163:0/3701900025 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcce80b1070 con 0x559e2655af60 2023-07-14T18:20:10.005 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:20:09.932+0000 7fccd57fa700 1 -- 172.21.15.163:0/3701900025 <== mon.0 v2:172.21.15.163:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 9049+0+0 (secure 0 0 0) 0x7fcce809e220 con 0x559e2655af60 2023-07-14T18:20:10.005 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:20:09.932+0000 7fcd0020db80 1 -- 172.21.15.163:0/3701900025 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x559e264054f0 con 0x559e2655af60 2023-07-14T18:20:10.006 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:20:09.932+0000 7fccd57fa700 1 -- 172.21.15.163:0/3701900025 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) v2 ==== 24+0+0 (secure 0 0 0) 0x7fcce80a2640 con 0x559e2655af60 2023-07-14T18:20:10.006 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:20:09.932+0000 7fcd0020db80 10 client.16446 fetch_fsmap learned FSMap version 39 2023-07-14T18:20:10.006 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:20:09.932+0000 7fcd0020db80 1 -- 172.21.15.163:0/3701900025 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) v3 -- 0x7fccec108980 con 0x559e2655af60 2023-07-14T18:20:10.006 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:20:09.932+0000 7fccd57fa700 1 -- 172.21.15.163:0/3701900025 <== mon.0 v2:172.21.15.163:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x559e264054f0 con 0x559e2655af60 2023-07-14T18:20:10.006 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:20:09.932+0000 7fccd57fa700 1 -- 172.21.15.163:0/3701900025 <== mon.0 v2:172.21.15.163:3300/0 5 ==== fsmap(e 39) v1 ==== 7470+0+0 (secure 0 0 0) 0x7fcce8099150 con 0x559e2655af60 2023-07-14T18:20:10.007 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:20:09.932+0000 7fcd0020db80 10 client.16446 fetch_fsmap finished waiting for FSMap version 39 2023-07-14T18:20:10.007 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:20:09.932+0000 7fcd0020db80 10 client.16446 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-07-14T18:20:10.007 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:20:09.932+0000 7fcd0020db80 20 client.16446 populate_metadata read hostname 'smithi163' 2023-07-14T18:20:10.007 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:20:09.932+0000 7fcd0020db80 1 --2- 172.21.15.163:0/3701900025 >> [v2:172.21.15.172:6838/3850440096,v1:172.21.15.172:6839/3850440096] conn(0x559e26570740 0x559e26572b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:20:10.007 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:20:09.932+0000 7fcd0020db80 4 client.16446 mds_command: new command op to 24518 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-14T18:20:10.008 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:20:09.932+0000 7fcd0020db80 1 -- 172.21.15.163:0/3701900025 --> [v2:172.21.15.172:6838/3850440096,v1:172.21.15.172:6839/3850440096] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x559e26529da0 con 0x559e26570740 2023-07-14T18:20:10.008 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:20:09.932+0000 7fccf1610700 1 --2- 172.21.15.163:0/3701900025 >> [v2:172.21.15.172:6838/3850440096,v1:172.21.15.172:6839/3850440096] conn(0x559e26570740 0x559e26572b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:20:10.008 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:20:09.933+0000 7fccd57fa700 10 client.16446 ms_handle_connect on v2:172.21.15.172:6838/3850440096 2023-07-14T18:20:10.008 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:20:09.933+0000 7fccf1610700 1 --2- 172.21.15.163:0/3701900025 >> [v2:172.21.15.172:6838/3850440096,v1:172.21.15.172:6839/3850440096] conn(0x559e26570740 0x559e26572b50 crc :-1 s=READY pgs=87 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=65912f06a7099bce server_cookie=99c629b05a9fc7cc in_seq=0 out_seq=0 2023-07-14T18:20:10.009 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:20:09.933+0000 7fccd57fa700 1 -- 172.21.15.163:0/3701900025 <== mds.0 v2:172.21.15.172:6838/3850440096 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18017 (crc 0 0 0) 0x559e26529da0 con 0x559e26570740 2023-07-14T18:20:10.009 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:20:09.933+0000 7fccd57fa700 10 client.16446 handle_command_reply: tid=0 2023-07-14T18:20:10.009 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:20:09.933+0000 7fcd0020db80 1 client.16446 shutdown 2023-07-14T18:20:10.009 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:20:09.934+0000 7fcd0020db80 1 -- 172.21.15.163:0/3701900025 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x559e2655af60 msgr2=0x559e26564970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:20:10.010 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:20:09.934+0000 7fcd0020db80 1 --2- 172.21.15.163:0/3701900025 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x559e2655af60 0x559e26564970 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7fcce80ca930 tx=0x7fcce809a730 comp rx=0 tx=0).stop 2023-07-14T18:20:10.010 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:20:09.934+0000 7fcd0020db80 1 -- 172.21.15.163:0/3701900025 shutdown_connections 2023-07-14T18:20:10.010 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:20:09.934+0000 7fcd0020db80 1 --2- 172.21.15.163:0/3701900025 >> [v2:172.21.15.172:6838/3850440096,v1:172.21.15.172:6839/3850440096] conn(0x559e26570740 0x559e26572b50 crc :-1 s=READY pgs=87 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:20:10.010 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:20:09.934+0000 7fccd57fa700 0 client.16446 ms_handle_reset on v2:172.21.15.172:6838/3850440096 2023-07-14T18:20:10.011 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:20:09.934+0000 7fcd0020db80 1 --2- 172.21.15.163:0/3701900025 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559e2655c4b0 0x559e2656bef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:20:10.011 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:20:09.934+0000 7fcd0020db80 1 --2- 172.21.15.163:0/3701900025 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x559e2655af60 0x559e26564970 unknown :-1 s=CLOSED pgs=700 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:20:10.011 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:20:09.934+0000 7fcd0020db80 1 --2- 172.21.15.163:0/3701900025 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x559e2655b8b0 0x559e26564eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:20:10.011 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:20:09.934+0000 7fcd0020db80 1 -- 172.21.15.163:0/3701900025 >> 172.21.15.163:0/3701900025 conn(0x559e26550680 msgr2=0x559e26554650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:20:10.011 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:20:09.934+0000 7fcd0020db80 1 -- 172.21.15.163:0/3701900025 shutdown_connections 2023-07-14T18:20:10.012 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:20:09.934+0000 7fcd0020db80 1 -- 172.21.15.163:0/3701900025 wait complete. 2023-07-14T18:20:10.012 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:20:09.934+0000 7fcd0020db80 20 client.16446 trim_cache size 0 max 16384 2023-07-14T18:20:10.017 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:20:09.954+0000 7fcd0020db80 1 Processor -- start 2023-07-14T18:20:10.017 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:20:09.954+0000 7fcd0020db80 1 -- start start 2023-07-14T18:20:10.017 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:20:09.955+0000 7fcd0020db80 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x559e2655af60 0x559e26563610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:20:10.018 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:20:09.955+0000 7fcd0020db80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559e2655b8b0 0x559e2656beb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:20:10.018 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:20:09.955+0000 7fcd0020db80 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x559e2655c4b0 0x559e265628f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:20:10.018 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:20:09.955+0000 7fcd0020db80 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x559e26563e20 con 0x559e2655af60 2023-07-14T18:20:10.018 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:20:09.955+0000 7fcd0020db80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x559e265568b0 con 0x559e2655b8b0 2023-07-14T18:20:10.019 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:20:09.955+0000 7fcd0020db80 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x559e26557500 con 0x559e2655c4b0 2023-07-14T18:20:10.019 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:20:09.955+0000 7fccf1e11700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x559e2655af60 0x559e26563610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:20:10.019 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:20:09.955+0000 7fccf1e11700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x559e2655af60 0x559e26563610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:59910/0 (socket says 172.21.15.163:59910) 2023-07-14T18:20:10.020 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:20:09.955+0000 7fccf1e11700 1 -- 172.21.15.163:0/217980920 learned_addr learned my addr 172.21.15.163:0/217980920 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:20:10.020 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:20:09.955+0000 7fccf1610700 1 --2- 172.21.15.163:0/217980920 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559e2655b8b0 0x559e2656beb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:20:10.020 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:20:09.955+0000 7fccf2612700 1 --2- 172.21.15.163:0/217980920 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x559e2655c4b0 0x559e265628f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:20:10.021 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:20:09.955+0000 7fccf1e11700 1 -- 172.21.15.163:0/217980920 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x559e2655c4b0 msgr2=0x559e265628f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:20:10.021 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:20:09.955+0000 7fccf1e11700 1 --2- 172.21.15.163:0/217980920 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x559e2655c4b0 0x559e265628f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:20:10.021 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:20:09.955+0000 7fccf1e11700 1 -- 172.21.15.163:0/217980920 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559e2655b8b0 msgr2=0x559e2656beb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:20:10.022 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:20:09.955+0000 7fccf1e11700 1 --2- 172.21.15.163:0/217980920 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559e2655b8b0 0x559e2656beb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:20:10.022 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:20:09.955+0000 7fccf1e11700 1 -- 172.21.15.163:0/217980920 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559e262c2c60 con 0x559e2655af60 2023-07-14T18:20:10.022 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:20:09.955+0000 7fccf1610700 1 --2- 172.21.15.163:0/217980920 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559e2655b8b0 0x559e2656beb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T18:20:10.023 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:20:09.955+0000 7fccf1e11700 1 --2- 172.21.15.163:0/217980920 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x559e2655af60 0x559e26563610 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7fcce8005950 tx=0x7fcce80987a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=523ac4c957b159b1 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:20:10.023 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:20:09.955+0000 7fcce0ff9700 1 -- 172.21.15.163:0/217980920 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcce809e220 con 0x559e2655af60 2023-07-14T18:20:10.024 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:20:09.956+0000 7fcce0ff9700 1 -- 172.21.15.163:0/217980920 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fcce80a2640 con 0x559e2655af60 2023-07-14T18:20:10.024 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:20:09.956+0000 7fcce0ff9700 1 -- 172.21.15.163:0/217980920 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcce80a2410 con 0x559e2655af60 2023-07-14T18:20:10.024 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:20:09.956+0000 7fcd0020db80 1 -- 172.21.15.163:0/217980920 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x559e2655af60 msgr2=0x559e26563610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:20:10.025 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:20:09.956+0000 7fcd0020db80 1 --2- 172.21.15.163:0/217980920 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x559e2655af60 0x559e26563610 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7fcce8005950 tx=0x7fcce80987a0 comp rx=0 tx=0).stop 2023-07-14T18:20:10.025 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:20:09.956+0000 7fcd0020db80 1 -- 172.21.15.163:0/217980920 shutdown_connections 2023-07-14T18:20:10.026 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:20:09.956+0000 7fcd0020db80 1 --2- 172.21.15.163:0/217980920 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x559e2655c4b0 0x559e265628f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:20:10.026 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:20:09.956+0000 7fcd0020db80 1 --2- 172.21.15.163:0/217980920 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x559e2655af60 0x559e26563610 unknown :-1 s=CLOSED pgs=701 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:20:10.026 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:20:09.956+0000 7fcd0020db80 1 --2- 172.21.15.163:0/217980920 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559e2655b8b0 0x559e2656beb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:20:10.027 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:20:09.956+0000 7fcd0020db80 1 -- 172.21.15.163:0/217980920 >> 172.21.15.163:0/217980920 conn(0x559e26550680 msgr2=0x559e265559a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:20:10.027 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:20:09.956+0000 7fcd0020db80 1 -- 172.21.15.163:0/217980920 shutdown_connections 2023-07-14T18:20:10.027 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:20:09.956+0000 7fcd0020db80 1 -- 172.21.15.163:0/217980920 wait complete. 2023-07-14T18:20:10.028 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:20:09.957+0000 7fcd0020db80 1 -- start start 2023-07-14T18:20:10.028 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:20:09.957+0000 7fcd0020db80 1 Processor -- start 2023-07-14T18:20:10.028 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:20:09.957+0000 7fcd0020db80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559e2655af60 0x559e2656bb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:20:10.028 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:20:09.957+0000 7fcd0020db80 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x559e2655b8b0 0x559e2656a190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:20:10.029 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:20:09.957+0000 7fcd0020db80 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x559e2655c4b0 0x559e2656a6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:20:10.029 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:20:09.957+0000 7fcd0020db80 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x559e2656ac10 con 0x559e2655c4b0 2023-07-14T18:20:10.029 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:20:09.957+0000 7fcd0020db80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x559e2656ad80 con 0x559e2655af60 2023-07-14T18:20:10.029 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:20:09.958+0000 7fcd0020db80 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x559e2656af40 con 0x559e2655b8b0 2023-07-14T18:20:10.030 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:20:09.958+0000 7fcd0020db80 10 client.0 _ll_register_callbacks cb 0x7fcce8099b50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T18:20:10.030 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:20:09.958+0000 7fccf1e11700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559e2655af60 0x559e2656bb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:20:10.030 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:20:09.958+0000 7fccf1610700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x559e2655b8b0 0x559e2656a190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:20:10.030 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:20:09.958+0000 7fccf1e11700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559e2655af60 0x559e2656bb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.163:60600/0 (socket says 172.21.15.163:60600) 2023-07-14T18:20:10.031 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:20:09.958+0000 7fccf1610700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x559e2655b8b0 0x559e2656a190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.163:41740/0 (socket says 172.21.15.163:41740) 2023-07-14T18:20:10.031 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:20:09.958+0000 7fccf1e11700 1 -- 172.21.15.163:0/1000943367 learned_addr learned my addr 172.21.15.163:0/1000943367 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:20:10.032 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:20:09.958+0000 7fccf2612700 1 --2- 172.21.15.163:0/1000943367 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x559e2655c4b0 0x559e2656a6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:20:10.032 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:20:09.958+0000 7fccf1e11700 1 -- 172.21.15.163:0/1000943367 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x559e2655b8b0 msgr2=0x559e2656a190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:20:10.033 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:20:09.958+0000 7fccf1e11700 1 --2- 172.21.15.163:0/1000943367 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x559e2655b8b0 0x559e2656a190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:20:10.033 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:20:09.958+0000 7fccf1e11700 1 -- 172.21.15.163:0/1000943367 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x559e2655c4b0 msgr2=0x559e2656a6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:20:10.034 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:20:09.958+0000 7fccf1e11700 1 --2- 172.21.15.163:0/1000943367 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x559e2655c4b0 0x559e2656a6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:20:10.034 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:20:09.958+0000 7fccf1e11700 1 -- 172.21.15.163:0/1000943367 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x559e262d9de0 con 0x559e2655af60 2023-07-14T18:20:10.035 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:20:09.958+0000 7fccf1610700 1 --2- 172.21.15.163:0/1000943367 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x559e2655b8b0 0x559e2656a190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T18:20:10.035 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:20:09.958+0000 7fccf1e11700 1 --2- 172.21.15.163:0/1000943367 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559e2655af60 0x559e2656bb80 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fcce809a180 tx=0x7fcce8010b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8616892d4ab80317 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:20:10.036 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:20:09.958+0000 7fccd57fa700 10 client.0 ms_handle_connect on v2:172.21.15.172:3300/0 2023-07-14T18:20:10.036 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:20:09.958+0000 7fccd57fa700 1 -- 172.21.15.163:0/1000943367 <== mon.2 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcce80993b0 con 0x559e2655af60 2023-07-14T18:20:10.036 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:20:09.958+0000 7fccd57fa700 1 -- 172.21.15.163:0/1000943367 <== mon.2 v2:172.21.15.172:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 9049+0+0 (secure 0 0 0) 0x7fcce809e220 con 0x559e2655af60 2023-07-14T18:20:10.036 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:20:09.958+0000 7fcd0020db80 1 -- 172.21.15.163:0/1000943367 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fccdc01d040 con 0x559e2655af60 2023-07-14T18:20:10.037 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:20:09.959+0000 7fccd57fa700 1 -- 172.21.15.163:0/1000943367 <== mon.2 v2:172.21.15.172:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) v2 ==== 24+0+0 (secure 0 0 0) 0x7fcce80b2de0 con 0x559e2655af60 2023-07-14T18:20:10.037 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:20:09.959+0000 7fcd0020db80 10 client.26078 fetch_fsmap learned FSMap version 39 2023-07-14T18:20:10.037 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:20:09.959+0000 7fcd0020db80 1 -- 172.21.15.163:0/1000943367 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) v3 -- 0x7fccec108980 con 0x559e2655af60 2023-07-14T18:20:10.037 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:20:09.959+0000 7fccd57fa700 1 -- 172.21.15.163:0/1000943367 <== mon.2 v2:172.21.15.172:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fccdc01d040 con 0x559e2655af60 2023-07-14T18:20:10.038 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:20:09.959+0000 7fccd57fa700 1 -- 172.21.15.163:0/1000943367 <== mon.2 v2:172.21.15.172:3300/0 5 ==== fsmap(e 39) v1 ==== 7470+0+0 (secure 0 0 0) 0x7fcce8083a40 con 0x559e2655af60 2023-07-14T18:20:10.038 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:20:09.959+0000 7fcd0020db80 10 client.26078 fetch_fsmap finished waiting for FSMap version 39 2023-07-14T18:20:10.038 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:20:09.959+0000 7fcd0020db80 10 client.26078 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-07-14T18:20:10.038 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:20:09.959+0000 7fcd0020db80 20 client.26078 populate_metadata read hostname 'smithi163' 2023-07-14T18:20:10.038 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:20:09.959+0000 7fcd0020db80 1 --2- 172.21.15.163:0/1000943367 >> [v2:172.21.15.172:6838/3850440096,v1:172.21.15.172:6839/3850440096] conn(0x559e265c5630 0x559e265c7a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:20:10.039 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:20:09.959+0000 7fcd0020db80 4 client.26078 mds_command: new command op to 24518 tid=0[{"prefix": "scrub status"}] 2023-07-14T18:20:10.039 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:20:09.959+0000 7fcd0020db80 1 -- 172.21.15.163:0/1000943367 --> [v2:172.21.15.172:6838/3850440096,v1:172.21.15.172:6839/3850440096] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x559e264a4eb0 con 0x559e265c5630 2023-07-14T18:20:10.039 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:20:09.959+0000 7fccf1610700 1 --2- 172.21.15.163:0/1000943367 >> [v2:172.21.15.172:6838/3850440096,v1:172.21.15.172:6839/3850440096] conn(0x559e265c5630 0x559e265c7a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:20:10.039 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:20:09.960+0000 7fccd57fa700 10 client.26078 ms_handle_connect on v2:172.21.15.172:6838/3850440096 2023-07-14T18:20:10.039 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:20:09.960+0000 7fccf1610700 1 --2- 172.21.15.163:0/1000943367 >> [v2:172.21.15.172:6838/3850440096,v1:172.21.15.172:6839/3850440096] conn(0x559e265c5630 0x559e265c7a40 crc :-1 s=READY pgs=88 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2cdac7616b4537fe server_cookie=80db91ce1b16df44 in_seq=0 out_seq=0 2023-07-14T18:20:10.040 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:20:09.960+0000 7fccd57fa700 1 -- 172.21.15.163:0/1000943367 <== mds.0 v2:172.21.15.172:6838/3850440096 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x559e264a4eb0 con 0x559e265c5630 2023-07-14T18:20:10.040 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:20:09.960+0000 7fccd57fa700 10 client.26078 handle_command_reply: tid=0 2023-07-14T18:20:10.040 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:20:09.960+0000 7fcd0020db80 1 client.26078 shutdown 2023-07-14T18:20:10.040 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:20:09.960+0000 7fcd0020db80 1 -- 172.21.15.163:0/1000943367 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559e2655af60 msgr2=0x559e2656bb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:20:10.040 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:20:09.960+0000 7fcd0020db80 1 --2- 172.21.15.163:0/1000943367 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559e2655af60 0x559e2656bb80 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fcce809a180 tx=0x7fcce8010b80 comp rx=0 tx=0).stop 2023-07-14T18:20:10.041 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:20:09.960+0000 7fcd0020db80 1 -- 172.21.15.163:0/1000943367 shutdown_connections 2023-07-14T18:20:10.041 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:20:09.960+0000 7fcd0020db80 1 --2- 172.21.15.163:0/1000943367 >> [v2:172.21.15.172:6838/3850440096,v1:172.21.15.172:6839/3850440096] conn(0x559e265c5630 0x559e265c7a40 crc :-1 s=READY pgs=88 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:20:10.041 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:20:09.960+0000 7fcd0020db80 1 --2- 172.21.15.163:0/1000943367 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x559e2655c4b0 0x559e2656a6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:20:10.041 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:20:09.960+0000 7fcd0020db80 1 --2- 172.21.15.163:0/1000943367 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559e2655af60 0x559e2656bb80 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:20:10.042 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:20:09.960+0000 7fcd0020db80 1 --2- 172.21.15.163:0/1000943367 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x559e2655b8b0 0x559e2656a190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:20:10.042 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:20:09.960+0000 7fccd57fa700 0 client.26078 ms_handle_reset on v2:172.21.15.172:6838/3850440096 2023-07-14T18:20:10.042 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:20:09.960+0000 7fcd0020db80 1 -- 172.21.15.163:0/1000943367 >> 172.21.15.163:0/1000943367 conn(0x559e26550680 msgr2=0x559e265628f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:20:10.042 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:20:09.960+0000 7fcd0020db80 1 -- 172.21.15.163:0/1000943367 shutdown_connections 2023-07-14T18:20:10.042 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:20:09.960+0000 7fcd0020db80 1 -- 172.21.15.163:0/1000943367 wait complete. 2023-07-14T18:20:10.043 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:20:09.960+0000 7fcd0020db80 20 client.26078 trim_cache size 0 max 16384 2023-07-14T18:20:10.043 INFO:teuthology.orchestra.run.smithi163.stdout:{ 2023-07-14T18:20:10.044 INFO:teuthology.orchestra.run.smithi163.stdout: "status": "IDLE (waiting for more scrubs)", 2023-07-14T18:20:10.044 INFO:teuthology.orchestra.run.smithi163.stdout: "scrubs": { 2023-07-14T18:20:10.044 INFO:teuthology.orchestra.run.smithi163.stdout: "2c53b7ef-6f30-49f0-a60d-f1f114c19d42": { 2023-07-14T18:20:10.045 INFO:teuthology.orchestra.run.smithi163.stdout: "path": "/", 2023-07-14T18:20:10.045 INFO:teuthology.orchestra.run.smithi163.stdout: "tag": "2c53b7ef-6f30-49f0-a60d-f1f114c19d42", 2023-07-14T18:20:10.045 INFO:teuthology.orchestra.run.smithi163.stdout: "options": "recursive,force" 2023-07-14T18:20:10.045 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-07-14T18:20:10.046 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-07-14T18:20:10.046 INFO:teuthology.orchestra.run.smithi163.stdout:} 2023-07-14T18:20:10.048 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:20:09.961+0000 7fccf4075700 1 -- 172.21.15.163:0/2913183963 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7fccd80a1150 msgr2=0x7fccd80a3600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:20:10.048 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:20:09.961+0000 7fccf4075700 1 --2- 172.21.15.163:0/2913183963 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7fccd80a1150 0x7fccd80a3600 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fccdc00f910 tx=0x7fccdc019040 comp rx=0 tx=0).stop 2023-07-14T18:20:10.048 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:20:09.961+0000 7fccf4075700 1 -- 172.21.15.163:0/2913183963 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fccec0ffc10 msgr2=0x7fccec1958d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:20:10.049 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:20:09.961+0000 7fccf4075700 1 --2- 172.21.15.163:0/2913183963 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fccec0ffc10 0x7fccec1958d0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fcce800ebf0 tx=0x7fcce800ef00 comp rx=0 tx=0).stop 2023-07-14T18:20:10.049 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:20:09.961+0000 7fccf4075700 1 -- 172.21.15.163:0/2913183963 shutdown_connections 2023-07-14T18:20:10.049 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:20:09.961+0000 7fccf4075700 1 --2- 172.21.15.163:0/2913183963 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7fccd80a1150 0x7fccd80a3600 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:20:10.050 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:20:09.961+0000 7fccf4075700 1 --2- 172.21.15.163:0/2913183963 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fccec101790 0x7fccec19ce80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:20:10.050 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:20:09.961+0000 7fccf4075700 1 --2- 172.21.15.163:0/2913183963 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fccec0ffc10 0x7fccec1958d0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:20:10.050 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:20:09.961+0000 7fccf4075700 1 --2- 172.21.15.163:0/2913183963 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fccec100e00 0x7fccec195e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:20:10.051 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:20:09.961+0000 7fccf4075700 1 -- 172.21.15.163:0/2913183963 >> 172.21.15.163:0/2913183963 conn(0x7fccec0fb250 msgr2=0x7fccec1043e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:20:10.051 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:20:09.961+0000 7fccf4075700 1 -- 172.21.15.163:0/2913183963 shutdown_connections 2023-07-14T18:20:10.052 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:20:09.961+0000 7fccf4075700 1 -- 172.21.15.163:0/2913183963 wait complete. 2023-07-14T18:20:10.052 INFO:tasks.cephfs.filesystem:scrub status for tag:2c53b7ef-6f30-49f0-a60d-f1f114c19d42 - {'path': '/', 'tag': '2c53b7ef-6f30-49f0-a60d-f1f114c19d42', 'options': 'recursive,force'} 2023-07-14T18:20:10.933 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:20:10 smithi184 ceph-mon[98481]: pgmap v525: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-07-14T18:20:10.975 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:20:10 smithi163 ceph-mon[96576]: pgmap v525: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-07-14T18:20:11.033 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:20:10 smithi172 ceph-mon[97983]: pgmap v525: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-07-14T18:20:12.183 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:20:11 smithi184 ceph-mon[98481]: pgmap v526: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-07-14T18:20:12.225 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:20:11 smithi163 ceph-mon[96576]: pgmap v526: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-07-14T18:20:12.283 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:20:11 smithi172 ceph-mon[97983]: pgmap v526: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-07-14T18:20:14.933 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:20:14 smithi184 ceph-mon[98481]: pgmap v527: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-07-14T18:20:14.975 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:20:14 smithi163 ceph-mon[96576]: pgmap v527: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-07-14T18:20:15.033 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:20:14 smithi172 ceph-mon[97983]: pgmap v527: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-07-14T18:20:16.933 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:20:16 smithi184 ceph-mon[98481]: pgmap v528: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-07-14T18:20:16.975 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:20:16 smithi163 ceph-mon[96576]: pgmap v528: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-07-14T18:20:17.034 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:20:16 smithi172 ceph-mon[97983]: pgmap v528: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-07-14T18:20:18.933 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:20:18 smithi184 ceph-mon[98481]: pgmap v529: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-07-14T18:20:18.975 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:20:18 smithi163 ceph-mon[96576]: pgmap v529: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-07-14T18:20:19.034 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:20:18 smithi172 ceph-mon[97983]: pgmap v529: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-07-14T18:20:20.933 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:20:20 smithi184 ceph-mon[98481]: pgmap v530: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-07-14T18:20:20.975 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:20:20 smithi163 ceph-mon[96576]: pgmap v530: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-07-14T18:20:21.034 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:20:20 smithi172 ceph-mon[97983]: pgmap v530: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-07-14T18:20:22.225 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:20:21 smithi163 ceph-mon[96576]: pgmap v531: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-07-14T18:20:22.284 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:20:21 smithi172 ceph-mon[97983]: pgmap v531: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-07-14T18:20:22.433 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:20:21 smithi184 ceph-mon[98481]: pgmap v531: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-07-14T18:20:24.933 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:20:24 smithi184 ceph-mon[98481]: pgmap v532: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-07-14T18:20:24.933 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:20:24 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-14T18:20:24.934 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:20:24 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-07-14T18:20:24.934 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:20:24 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-07-14T18:20:24.934 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:20:24 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-07-14T18:20:24.934 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:20:24 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-07-14T18:20:24.935 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:20:24 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-07-14T18:20:24.935 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:20:24 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-07-14T18:20:24.935 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:20:24 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-07-14T18:20:24.935 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:20:24 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-07-14T18:20:24.935 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:20:24 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T18:20:24.936 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:20:24 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-14T18:20:24.936 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:20:24 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:20:24.975 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:20:24 smithi163 ceph-mon[96576]: pgmap v532: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-07-14T18:20:24.976 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:20:24 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-14T18:20:24.976 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:20:24 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-07-14T18:20:24.976 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:20:24 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-07-14T18:20:24.977 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:20:24 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-07-14T18:20:24.977 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:20:24 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-07-14T18:20:24.977 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:20:24 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-07-14T18:20:24.977 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:20:24 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-07-14T18:20:24.977 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:20:24 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-07-14T18:20:24.978 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:20:24 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-07-14T18:20:24.978 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:20:24 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T18:20:24.979 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:20:24 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-14T18:20:24.979 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:20:24 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:20:25.034 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:20:24 smithi172 ceph-mon[97983]: pgmap v532: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-07-14T18:20:25.034 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:20:24 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-14T18:20:25.034 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:20:24 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-07-14T18:20:25.035 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:20:24 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-07-14T18:20:25.035 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:20:24 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-07-14T18:20:25.035 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:20:24 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-07-14T18:20:25.035 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:20:24 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-07-14T18:20:25.036 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:20:24 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-07-14T18:20:25.036 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:20:24 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-07-14T18:20:25.036 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:20:24 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-07-14T18:20:25.036 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:20:24 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T18:20:25.036 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:20:24 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-14T18:20:25.037 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:20:24 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:20:25.933 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:20:25 smithi184 ceph-mon[98481]: Adjusting osd_memory_target on smithi163 to 196.2M 2023-07-14T18:20:25.933 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:20:25 smithi184 ceph-mon[98481]: Adjusting osd_memory_target on smithi172 to 196.2M 2023-07-14T18:20:25.933 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:20:25 smithi184 ceph-mon[98481]: Unable to set osd_memory_target on smithi163 to 205762457: error parsing value: Value '205762457' is below minimum 939524096 2023-07-14T18:20:25.934 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:20:25 smithi184 ceph-mon[98481]: Unable to set osd_memory_target on smithi172 to 205769625: error parsing value: Value '205769625' is below minimum 939524096 2023-07-14T18:20:25.975 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:20:25 smithi163 ceph-mon[96576]: Adjusting osd_memory_target on smithi163 to 196.2M 2023-07-14T18:20:25.976 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:20:25 smithi163 ceph-mon[96576]: Adjusting osd_memory_target on smithi172 to 196.2M 2023-07-14T18:20:25.976 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:20:25 smithi163 ceph-mon[96576]: Unable to set osd_memory_target on smithi163 to 205762457: error parsing value: Value '205762457' is below minimum 939524096 2023-07-14T18:20:25.976 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:20:25 smithi163 ceph-mon[96576]: Unable to set osd_memory_target on smithi172 to 205769625: error parsing value: Value '205769625' is below minimum 939524096 2023-07-14T18:20:26.034 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:20:25 smithi172 ceph-mon[97983]: Adjusting osd_memory_target on smithi163 to 196.2M 2023-07-14T18:20:26.034 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:20:25 smithi172 ceph-mon[97983]: Adjusting osd_memory_target on smithi172 to 196.2M 2023-07-14T18:20:26.034 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:20:25 smithi172 ceph-mon[97983]: Unable to set osd_memory_target on smithi163 to 205762457: error parsing value: Value '205762457' is below minimum 939524096 2023-07-14T18:20:26.035 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:20:25 smithi172 ceph-mon[97983]: Unable to set osd_memory_target on smithi172 to 205769625: error parsing value: Value '205769625' is below minimum 939524096 2023-07-14T18:20:26.933 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:20:26 smithi184 ceph-mon[98481]: pgmap v533: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-07-14T18:20:26.975 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:20:26 smithi163 ceph-mon[96576]: pgmap v533: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-07-14T18:20:27.034 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:20:26 smithi172 ceph-mon[97983]: pgmap v533: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-07-14T18:20:28.933 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:20:28 smithi184 ceph-mon[98481]: pgmap v534: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-07-14T18:20:28.975 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:20:28 smithi163 ceph-mon[96576]: pgmap v534: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-07-14T18:20:29.034 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:20:28 smithi172 ceph-mon[97983]: pgmap v534: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-07-14T18:20:30.933 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:20:30 smithi184 ceph-mon[98481]: pgmap v535: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-07-14T18:20:30.975 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:20:30 smithi163 ceph-mon[96576]: pgmap v535: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-07-14T18:20:31.034 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:20:30 smithi172 ceph-mon[97983]: pgmap v535: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-07-14T18:20:32.226 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:20:31 smithi163 ceph-mon[96576]: pgmap v536: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 9 op/s 2023-07-14T18:20:32.284 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:20:31 smithi172 ceph-mon[97983]: pgmap v536: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 9 op/s 2023-07-14T18:20:32.433 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:20:31 smithi184 ceph-mon[98481]: pgmap v536: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 9 op/s 2023-07-14T18:20:34.933 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:20:34 smithi184 ceph-mon[98481]: pgmap v537: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2023-07-14T18:20:34.976 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:20:34 smithi163 ceph-mon[96576]: pgmap v537: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2023-07-14T18:20:35.034 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:20:34 smithi172 ceph-mon[97983]: pgmap v537: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2023-07-14T18:20:36.933 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:20:36 smithi184 ceph-mon[98481]: pgmap v538: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 9 op/s 2023-07-14T18:20:36.978 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:20:36 smithi163 ceph-mon[96576]: pgmap v538: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 9 op/s 2023-07-14T18:20:37.034 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:20:36 smithi172 ceph-mon[97983]: pgmap v538: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 9 op/s 2023-07-14T18:20:38.933 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:20:38 smithi184 ceph-mon[98481]: pgmap v539: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-07-14T18:20:38.975 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:20:38 smithi163 ceph-mon[96576]: pgmap v539: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-07-14T18:20:39.034 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:20:38 smithi172 ceph-mon[97983]: pgmap v539: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-07-14T18:20:40.053 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-07-14T18:20:40.211 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:20:40.163+0000 7f926e486700 1 -- 172.21.15.163:0/3693729907 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9268100690 msgr2=0x7f9268106f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:20:40.212 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:20:40.163+0000 7f926e486700 1 --2- 172.21.15.163:0/3693729907 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9268100690 0x7f9268106f50 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f9260009f90 tx=0x7f926000b330 comp rx=0 tx=0).stop 2023-07-14T18:20:40.212 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:20:40.163+0000 7f926e486700 1 -- 172.21.15.163:0/3693729907 shutdown_connections 2023-07-14T18:20:40.213 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:20:40.163+0000 7f926e486700 1 --2- 172.21.15.163:0/3693729907 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f92680feb10 0x7f92680fef20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:20:40.213 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:20:40.163+0000 7f926e486700 1 --2- 172.21.15.163:0/3693729907 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9268100690 0x7f9268106f50 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:20:40.213 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:20:40.163+0000 7f926e486700 1 --2- 172.21.15.163:0/3693729907 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f92680ffd00 0x7f9268100150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:20:40.213 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:20:40.163+0000 7f926e486700 1 -- 172.21.15.163:0/3693729907 >> 172.21.15.163:0/3693729907 conn(0x7f92680fa130 msgr2=0x7f92680fc560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:20:40.213 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:20:40.163+0000 7f926e486700 1 -- 172.21.15.163:0/3693729907 shutdown_connections 2023-07-14T18:20:40.214 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:20:40.163+0000 7f926e486700 1 -- 172.21.15.163:0/3693729907 wait complete. 2023-07-14T18:20:40.214 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:20:40.163+0000 7f926e486700 1 Processor -- start 2023-07-14T18:20:40.214 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:20:40.164+0000 7f926e486700 1 -- start start 2023-07-14T18:20:40.216 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:20:40.164+0000 7f926e486700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f92680feb10 0x7f9268068330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:20:40.216 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:20:40.164+0000 7f926e486700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f92680ffd00 0x7f926819a6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:20:40.216 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:20:40.164+0000 7f926e486700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f9268100690 0x7f926819cd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:20:40.217 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:20:40.164+0000 7f926e486700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f926819d4d0 con 0x7f9268100690 2023-07-14T18:20:40.217 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:20:40.164+0000 7f926e486700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f926819d640 con 0x7f92680ffd00 2023-07-14T18:20:40.217 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:20:40.164+0000 7f926e486700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f926819d800 con 0x7f92680feb10 2023-07-14T18:20:40.217 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:20:40.164+0000 7f926ca23700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f9268100690 0x7f926819cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:20:40.218 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:20:40.164+0000 7f92677fe700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f92680ffd00 0x7f926819a6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:20:40.218 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:20:40.164+0000 7f9267fff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f92680feb10 0x7f9268068330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:20:40.218 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:20:40.164+0000 7f92677fe700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f92680ffd00 0x7f926819a6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.163:60624/0 (socket says 172.21.15.163:60624) 2023-07-14T18:20:40.218 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:20:40.164+0000 7f9267fff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f92680feb10 0x7f9268068330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.163:41760/0 (socket says 172.21.15.163:41760) 2023-07-14T18:20:40.218 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:20:40.164+0000 7f926ca23700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f9268100690 0x7f926819cd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:59942/0 (socket says 172.21.15.163:59942) 2023-07-14T18:20:40.219 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:20:40.164+0000 7f92677fe700 1 -- 172.21.15.163:0/934848050 learned_addr learned my addr 172.21.15.163:0/934848050 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:20:40.219 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:20:40.164+0000 7f92677fe700 1 -- 172.21.15.163:0/934848050 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f92680feb10 msgr2=0x7f9268068330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:20:40.219 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:20:40.164+0000 7f92677fe700 1 --2- 172.21.15.163:0/934848050 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f92680feb10 0x7f9268068330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:20:40.220 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:20:40.164+0000 7f92677fe700 1 -- 172.21.15.163:0/934848050 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f9268100690 msgr2=0x7f926819cd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:20:40.220 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:20:40.164+0000 7f92677fe700 1 --2- 172.21.15.163:0/934848050 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f9268100690 0x7f926819cd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:20:40.221 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:20:40.164+0000 7f92677fe700 1 -- 172.21.15.163:0/934848050 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f925c0095f0 con 0x7f92680ffd00 2023-07-14T18:20:40.221 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:20:40.164+0000 7f926ca23700 1 --2- 172.21.15.163:0/934848050 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f9268100690 0x7f926819cd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T18:20:40.221 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:20:40.165+0000 7f92677fe700 1 --2- 172.21.15.163:0/934848050 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f92680ffd00 0x7f926819a6b0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f925c00ec10 tx=0x7f925c00ef20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:20:40.222 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:20:40.165+0000 7f92657fa700 1 -- 172.21.15.163:0/934848050 <== mon.2 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f925c00cc90 con 0x7f92680ffd00 2023-07-14T18:20:40.222 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:20:40.165+0000 7f92657fa700 1 -- 172.21.15.163:0/934848050 <== mon.2 v2:172.21.15.172:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f925c00cdf0 con 0x7f92680ffd00 2023-07-14T18:20:40.222 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:20:40.165+0000 7f92657fa700 1 -- 172.21.15.163:0/934848050 <== mon.2 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f925c003e80 con 0x7f92680ffd00 2023-07-14T18:20:40.223 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:20:40.165+0000 7f926e486700 1 -- 172.21.15.163:0/934848050 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9260009c40 con 0x7f92680ffd00 2023-07-14T18:20:40.223 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:20:40.165+0000 7f926e486700 1 -- 172.21.15.163:0/934848050 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f926819de10 con 0x7f92680ffd00 2023-07-14T18:20:40.224 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:20:40.167+0000 7f92657fa700 1 -- 172.21.15.163:0/934848050 <== mon.2 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 18) v1 ==== 135716+0+0 (secure 0 0 0) 0x7f925c004000 con 0x7f92680ffd00 2023-07-14T18:20:40.231 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:20:40.168+0000 7f92657fa700 1 --2- 172.21.15.163:0/934848050 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f92500a1150 0x7f92500a3600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:20:40.232 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:20:40.168+0000 7f9267fff700 1 --2- 172.21.15.163:0/934848050 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f92500a1150 0x7f92500a3600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:20:40.233 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:20:40.168+0000 7f92657fa700 1 -- 172.21.15.163:0/934848050 <== mon.2 v2:172.21.15.172:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 9049+0+0 (secure 0 0 0) 0x7f925c014070 con 0x7f92680ffd00 2023-07-14T18:20:40.233 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:20:40.168+0000 7f9267fff700 1 --2- 172.21.15.163:0/934848050 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f92500a1150 0x7f92500a3600 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f92680ffb60 tx=0x7f9258009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:20:40.233 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:20:40.168+0000 7f927a61eb80 1 Processor -- start 2023-07-14T18:20:40.234 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:20:40.169+0000 7f927a61eb80 1 -- start start 2023-07-14T18:20:40.234 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:20:40.169+0000 7f927a61eb80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56310c1eef60 0x56310c1ef370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:20:40.234 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:20:40.169+0000 7f927a61eb80 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56310c1ef8b0 0x56310c1efed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:20:40.235 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:20:40.169+0000 7f927a61eb80 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x56310c1f04b0 0x56310c1f0920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:20:40.235 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:20:40.169+0000 7f927a61eb80 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x56310c0f3cb0 con 0x56310c1f04b0 2023-07-14T18:20:40.236 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:20:40.169+0000 7f927a61eb80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x56310c146a40 con 0x56310c1eef60 2023-07-14T18:20:40.236 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:20:40.169+0000 7f927a61eb80 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x56310c13fed0 con 0x56310c1ef8b0 2023-07-14T18:20:40.236 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:20:40.169+0000 7f9267fff700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56310c1eef60 0x56310c1ef370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:20:40.237 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:20:40.169+0000 7f9267fff700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56310c1eef60 0x56310c1ef370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.163:60630/0 (socket says 172.21.15.163:60630) 2023-07-14T18:20:40.237 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:20:40.169+0000 7f9267fff700 1 -- 172.21.15.163:0/522578064 learned_addr learned my addr 172.21.15.163:0/522578064 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:20:40.237 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:20:40.169+0000 7f926ca23700 1 --2- 172.21.15.163:0/522578064 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x56310c1f04b0 0x56310c1f0920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:20:40.238 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:20:40.169+0000 7f92677fe700 1 --2- 172.21.15.163:0/522578064 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56310c1ef8b0 0x56310c1efed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:20:40.238 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:20:40.169+0000 7f9267fff700 1 -- 172.21.15.163:0/522578064 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56310c1ef8b0 msgr2=0x56310c1efed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:20:40.238 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:20:40.169+0000 7f9267fff700 1 --2- 172.21.15.163:0/522578064 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56310c1ef8b0 0x56310c1efed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:20:40.238 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:20:40.169+0000 7f9267fff700 1 -- 172.21.15.163:0/522578064 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x56310c1f04b0 msgr2=0x56310c1f0920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:20:40.239 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:20:40.169+0000 7f9267fff700 1 --2- 172.21.15.163:0/522578064 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x56310c1f04b0 0x56310c1f0920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:20:40.239 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:20:40.169+0000 7f9267fff700 1 -- 172.21.15.163:0/522578064 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56310bf6dde0 con 0x56310c1eef60 2023-07-14T18:20:40.239 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:20:40.169+0000 7f9267fff700 1 --2- 172.21.15.163:0/522578064 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56310c1eef60 0x56310c1ef370 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f9258011d50 tx=0x7f9258014000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1556ba180c4c6a7a server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:20:40.239 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:20:40.170+0000 7f924e7fc700 1 -- 172.21.15.163:0/522578064 <== mon.2 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f925800ed20 con 0x56310c1eef60 2023-07-14T18:20:40.239 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:20:40.170+0000 7f924e7fc700 1 -- 172.21.15.163:0/522578064 <== mon.2 v2:172.21.15.172:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f9258021070 con 0x56310c1eef60 2023-07-14T18:20:40.240 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:20:40.170+0000 7f924e7fc700 1 -- 172.21.15.163:0/522578064 <== mon.2 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f925801d410 con 0x56310c1eef60 2023-07-14T18:20:40.240 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:20:40.170+0000 7f927a61eb80 1 -- 172.21.15.163:0/522578064 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56310c1eef60 msgr2=0x56310c1ef370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:20:40.240 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:20:40.170+0000 7f927a61eb80 1 --2- 172.21.15.163:0/522578064 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56310c1eef60 0x56310c1ef370 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f9258011d50 tx=0x7f9258014000 comp rx=0 tx=0).stop 2023-07-14T18:20:40.240 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:20:40.170+0000 7f927a61eb80 1 -- 172.21.15.163:0/522578064 shutdown_connections 2023-07-14T18:20:40.241 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:20:40.170+0000 7f927a61eb80 1 --2- 172.21.15.163:0/522578064 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x56310c1f04b0 0x56310c1f0920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:20:40.241 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:20:40.170+0000 7f927a61eb80 1 --2- 172.21.15.163:0/522578064 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56310c1eef60 0x56310c1ef370 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:20:40.241 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:20:40.170+0000 7f927a61eb80 1 --2- 172.21.15.163:0/522578064 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56310c1ef8b0 0x56310c1efed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:20:40.241 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:20:40.170+0000 7f927a61eb80 1 -- 172.21.15.163:0/522578064 >> 172.21.15.163:0/522578064 conn(0x56310c1e4680 msgr2=0x56310c1e99d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:20:40.241 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:20:40.170+0000 7f927a61eb80 1 -- 172.21.15.163:0/522578064 shutdown_connections 2023-07-14T18:20:40.242 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:20:40.171+0000 7f927a61eb80 1 -- 172.21.15.163:0/522578064 wait complete. 2023-07-14T18:20:40.242 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:20:40.171+0000 7f927a61eb80 1 -- start start 2023-07-14T18:20:40.242 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:20:40.171+0000 7f927a61eb80 1 Processor -- start 2023-07-14T18:20:40.242 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:20:40.172+0000 7f927a61eb80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56310c1eef60 0x56310c1f8920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:20:40.242 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:20:40.172+0000 7f927a61eb80 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x56310c1ef8b0 0x56310c1f8e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:20:40.243 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:20:40.172+0000 7f927a61eb80 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56310c1f04b0 0x56310c1ffea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:20:40.243 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:20:40.172+0000 7f927a61eb80 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x56310c0dfac0 con 0x56310c1ef8b0 2023-07-14T18:20:40.243 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:20:40.172+0000 7f927a61eb80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x56310c0df7c0 con 0x56310c1eef60 2023-07-14T18:20:40.243 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:20:40.172+0000 7f927a61eb80 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x56310bfc3920 con 0x56310c1f04b0 2023-07-14T18:20:40.243 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:20:40.172+0000 7f927a61eb80 10 client.0 _ll_register_callbacks cb 0x56310c0dd760 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T18:20:40.244 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:20:40.172+0000 7f9267fff700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56310c1eef60 0x56310c1f8920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:20:40.244 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:20:40.172+0000 7f92677fe700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x56310c1ef8b0 0x56310c1f8e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:20:40.244 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:20:40.172+0000 7f9267fff700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56310c1eef60 0x56310c1f8920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.163:60636/0 (socket says 172.21.15.163:60636) 2023-07-14T18:20:40.244 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:20:40.172+0000 7f9267fff700 1 -- 172.21.15.163:0/2131469885 learned_addr learned my addr 172.21.15.163:0/2131469885 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:20:40.244 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:20:40.172+0000 7f926ca23700 1 --2- 172.21.15.163:0/2131469885 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56310c1f04b0 0x56310c1ffea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:20:40.245 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:20:40.172+0000 7f92677fe700 1 -- 172.21.15.163:0/2131469885 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56310c1f04b0 msgr2=0x56310c1ffea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:20:40.245 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:20:40.172+0000 7f92677fe700 1 --2- 172.21.15.163:0/2131469885 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56310c1f04b0 0x56310c1ffea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:20:40.245 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:20:40.172+0000 7f92677fe700 1 -- 172.21.15.163:0/2131469885 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56310c1eef60 msgr2=0x56310c1f8920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:20:40.246 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:20:40.172+0000 7f92677fe700 1 --2- 172.21.15.163:0/2131469885 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56310c1eef60 0x56310c1f8920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:20:40.246 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:20:40.172+0000 7f92677fe700 1 -- 172.21.15.163:0/2131469885 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9258017070 con 0x56310c1ef8b0 2023-07-14T18:20:40.246 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:20:40.172+0000 7f926ca23700 1 --2- 172.21.15.163:0/2131469885 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56310c1f04b0 0x56310c1ffea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T18:20:40.246 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:20:40.172+0000 7f9267fff700 1 --2- 172.21.15.163:0/2131469885 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56310c1eef60 0x56310c1f8920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T18:20:40.246 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:20:40.172+0000 7f92677fe700 1 --2- 172.21.15.163:0/2131469885 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x56310c1ef8b0 0x56310c1f8e60 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7f925c099e40 tx=0x7f925c09a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1af117aea8cfc2e0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:20:40.247 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:20:40.172+0000 7f92477fe700 10 client.0 ms_handle_connect on v2:172.21.15.163:3300/0 2023-07-14T18:20:40.247 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:20:40.172+0000 7f92477fe700 1 -- 172.21.15.163:0/2131469885 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f925c0a2590 con 0x56310c1ef8b0 2023-07-14T18:20:40.247 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:20:40.172+0000 7f92477fe700 1 -- 172.21.15.163:0/2131469885 <== mon.0 v2:172.21.15.163:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 9049+0+0 (secure 0 0 0) 0x7f925c0ade40 con 0x56310c1ef8b0 2023-07-14T18:20:40.247 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:20:40.173+0000 7f927a61eb80 1 -- 172.21.15.163:0/2131469885 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56310c0994f0 con 0x56310c1ef8b0 2023-07-14T18:20:40.247 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:20:40.173+0000 7f92477fe700 1 -- 172.21.15.163:0/2131469885 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) v2 ==== 24+0+0 (secure 0 0 0) 0x7f925c0042b0 con 0x56310c1ef8b0 2023-07-14T18:20:40.248 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:20:40.173+0000 7f927a61eb80 10 client.16464 fetch_fsmap learned FSMap version 39 2023-07-14T18:20:40.248 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:20:40.173+0000 7f927a61eb80 1 -- 172.21.15.163:0/2131469885 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) v3 -- 0x56310bf56c60 con 0x56310c1ef8b0 2023-07-14T18:20:40.248 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:20:40.173+0000 7f92477fe700 1 -- 172.21.15.163:0/2131469885 <== mon.0 v2:172.21.15.163:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x56310c0994f0 con 0x56310c1ef8b0 2023-07-14T18:20:40.249 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:20:40.173+0000 7f92477fe700 1 -- 172.21.15.163:0/2131469885 <== mon.0 v2:172.21.15.163:3300/0 5 ==== fsmap(e 39) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f925c0996c0 con 0x56310c1ef8b0 2023-07-14T18:20:40.249 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:20:40.173+0000 7f927a61eb80 10 client.16464 fetch_fsmap finished waiting for FSMap version 39 2023-07-14T18:20:40.249 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:20:40.173+0000 7f927a61eb80 10 client.16464 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-07-14T18:20:40.249 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:20:40.173+0000 7f927a61eb80 20 client.16464 populate_metadata read hostname 'smithi163' 2023-07-14T18:20:40.249 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:20:40.173+0000 7f927a61eb80 1 --2- 172.21.15.163:0/2131469885 >> [v2:172.21.15.172:6838/3850440096,v1:172.21.15.172:6839/3850440096] conn(0x56310c2046d0 0x56310c206ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:20:40.250 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:20:40.173+0000 7f927a61eb80 4 client.16464 mds_command: new command op to 24518 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-14T18:20:40.250 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:20:40.173+0000 7f927a61eb80 1 -- 172.21.15.163:0/2131469885 --> [v2:172.21.15.172:6838/3850440096,v1:172.21.15.172:6839/3850440096] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x56310c1bdda0 con 0x56310c2046d0 2023-07-14T18:20:40.250 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:20:40.173+0000 7f9267fff700 1 --2- 172.21.15.163:0/2131469885 >> [v2:172.21.15.172:6838/3850440096,v1:172.21.15.172:6839/3850440096] conn(0x56310c2046d0 0x56310c206ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:20:40.250 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:20:40.174+0000 7f9267fff700 1 --2- 172.21.15.163:0/2131469885 >> [v2:172.21.15.172:6838/3850440096,v1:172.21.15.172:6839/3850440096] conn(0x56310c2046d0 0x56310c206ae0 crc :-1 s=READY pgs=89 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=15795d624fdebda7 server_cookie=ae3771da3b4c36e8 in_seq=0 out_seq=0 2023-07-14T18:20:40.250 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:20:40.174+0000 7f92477fe700 10 client.16464 ms_handle_connect on v2:172.21.15.172:6838/3850440096 2023-07-14T18:20:40.251 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:20:40.174+0000 7f92477fe700 1 -- 172.21.15.163:0/2131469885 <== mds.0 v2:172.21.15.172:6838/3850440096 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18017 (crc 0 0 0) 0x56310c1bdda0 con 0x56310c2046d0 2023-07-14T18:20:40.251 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:20:40.174+0000 7f92477fe700 10 client.16464 handle_command_reply: tid=0 2023-07-14T18:20:40.251 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:20:40.174+0000 7f927a61eb80 1 client.16464 shutdown 2023-07-14T18:20:40.251 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:20:40.175+0000 7f927a61eb80 1 -- 172.21.15.163:0/2131469885 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x56310c1ef8b0 msgr2=0x56310c1f8e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:20:40.251 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:20:40.175+0000 7f927a61eb80 1 --2- 172.21.15.163:0/2131469885 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x56310c1ef8b0 0x56310c1f8e60 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7f925c099e40 tx=0x7f925c09a140 comp rx=0 tx=0).stop 2023-07-14T18:20:40.252 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:20:40.175+0000 7f927a61eb80 1 -- 172.21.15.163:0/2131469885 shutdown_connections 2023-07-14T18:20:40.252 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:20:40.175+0000 7f927a61eb80 1 --2- 172.21.15.163:0/2131469885 >> [v2:172.21.15.172:6838/3850440096,v1:172.21.15.172:6839/3850440096] conn(0x56310c2046d0 0x56310c206ae0 crc :-1 s=READY pgs=89 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:20:40.252 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:20:40.175+0000 7f927a61eb80 1 --2- 172.21.15.163:0/2131469885 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56310c1f04b0 0x56310c1ffea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:20:40.252 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:20:40.175+0000 7f927a61eb80 1 --2- 172.21.15.163:0/2131469885 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56310c1eef60 0x56310c1f8920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:20:40.253 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:20:40.175+0000 7f927a61eb80 1 --2- 172.21.15.163:0/2131469885 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x56310c1ef8b0 0x56310c1f8e60 unknown :-1 s=CLOSED pgs=702 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:20:40.253 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:20:40.175+0000 7f927a61eb80 1 -- 172.21.15.163:0/2131469885 >> 172.21.15.163:0/2131469885 conn(0x56310c1e4680 msgr2=0x56310c1e8650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:20:40.253 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:20:40.175+0000 7f92477fe700 0 client.16464 ms_handle_reset on v2:172.21.15.172:6838/3850440096 2023-07-14T18:20:40.253 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:20:40.175+0000 7f927a61eb80 1 -- 172.21.15.163:0/2131469885 shutdown_connections 2023-07-14T18:20:40.253 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:20:40.175+0000 7f927a61eb80 1 -- 172.21.15.163:0/2131469885 wait complete. 2023-07-14T18:20:40.254 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:20:40.175+0000 7f927a61eb80 20 client.16464 trim_cache size 0 max 16384 2023-07-14T18:20:40.258 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:20:40.195+0000 7f927a61eb80 1 Processor -- start 2023-07-14T18:20:40.258 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:20:40.195+0000 7f927a61eb80 1 -- start start 2023-07-14T18:20:40.259 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:20:40.195+0000 7f927a61eb80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56310c1eef60 0x56310c1f0880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:20:40.259 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:20:40.195+0000 7f927a61eb80 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x56310c1ef8b0 0x56310c1ffe60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:20:40.259 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:20:40.195+0000 7f927a61eb80 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56310c1f04b0 0x56310c1f6890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:20:40.259 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:20:40.195+0000 7f927a61eb80 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x56310c1f9850 con 0x56310c1ef8b0 2023-07-14T18:20:40.260 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:20:40.195+0000 7f927a61eb80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x56310c1f84c0 con 0x56310c1eef60 2023-07-14T18:20:40.260 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:20:40.195+0000 7f927a61eb80 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x56310c1ea660 con 0x56310c1f04b0 2023-07-14T18:20:40.260 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:20:40.195+0000 7f92677fe700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x56310c1ef8b0 0x56310c1ffe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:20:40.260 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:20:40.195+0000 7f926ca23700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56310c1f04b0 0x56310c1f6890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:20:40.261 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:20:40.195+0000 7f92677fe700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x56310c1ef8b0 0x56310c1ffe60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:59962/0 (socket says 172.21.15.163:59962) 2023-07-14T18:20:40.261 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:20:40.195+0000 7f9267fff700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56310c1eef60 0x56310c1f0880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:20:40.261 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:20:40.195+0000 7f92677fe700 1 -- 172.21.15.163:0/1392390174 learned_addr learned my addr 172.21.15.163:0/1392390174 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:20:40.261 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:20:40.196+0000 7f9267fff700 1 -- 172.21.15.163:0/1392390174 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56310c1f04b0 msgr2=0x56310c1f6890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:20:40.261 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:20:40.196+0000 7f9267fff700 1 --2- 172.21.15.163:0/1392390174 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56310c1f04b0 0x56310c1f6890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:20:40.262 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:20:40.196+0000 7f9267fff700 1 -- 172.21.15.163:0/1392390174 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x56310c1ef8b0 msgr2=0x56310c1ffe60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:20:40.262 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:20:40.196+0000 7f9267fff700 1 --2- 172.21.15.163:0/1392390174 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x56310c1ef8b0 0x56310c1ffe60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:20:40.262 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:20:40.196+0000 7f9267fff700 1 -- 172.21.15.163:0/1392390174 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56310bf94250 con 0x56310c1eef60 2023-07-14T18:20:40.262 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:20:40.196+0000 7f926ca23700 1 --2- 172.21.15.163:0/1392390174 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56310c1f04b0 0x56310c1f6890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T18:20:40.262 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:20:40.196+0000 7f9267fff700 1 --2- 172.21.15.163:0/1392390174 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56310c1eef60 0x56310c1f0880 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x56310c204aa0 tx=0x7f925801cdb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8774fbcd04ad06bf server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:20:40.262 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:20:40.196+0000 7f924effd700 1 -- 172.21.15.163:0/1392390174 <== mon.2 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f925801cbc0 con 0x56310c1eef60 2023-07-14T18:20:40.263 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:20:40.196+0000 7f924effd700 1 -- 172.21.15.163:0/1392390174 <== mon.2 v2:172.21.15.172:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f925801c8a0 con 0x56310c1eef60 2023-07-14T18:20:40.263 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:20:40.196+0000 7f924effd700 1 -- 172.21.15.163:0/1392390174 <== mon.2 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92580322b0 con 0x56310c1eef60 2023-07-14T18:20:40.263 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:20:40.197+0000 7f927a61eb80 1 -- 172.21.15.163:0/1392390174 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56310c1eef60 msgr2=0x56310c1f0880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:20:40.264 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:20:40.197+0000 7f927a61eb80 1 --2- 172.21.15.163:0/1392390174 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56310c1eef60 0x56310c1f0880 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x56310c204aa0 tx=0x7f925801cdb0 comp rx=0 tx=0).stop 2023-07-14T18:20:40.264 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:20:40.197+0000 7f927a61eb80 1 -- 172.21.15.163:0/1392390174 shutdown_connections 2023-07-14T18:20:40.264 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:20:40.197+0000 7f927a61eb80 1 --2- 172.21.15.163:0/1392390174 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56310c1f04b0 0x56310c1f6890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:20:40.264 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:20:40.197+0000 7f927a61eb80 1 --2- 172.21.15.163:0/1392390174 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56310c1eef60 0x56310c1f0880 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:20:40.264 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:20:40.197+0000 7f927a61eb80 1 --2- 172.21.15.163:0/1392390174 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x56310c1ef8b0 0x56310c1ffe60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:20:40.265 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:20:40.197+0000 7f927a61eb80 1 -- 172.21.15.163:0/1392390174 >> 172.21.15.163:0/1392390174 conn(0x56310c1e4680 msgr2=0x56310c1e5b50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:20:40.265 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:20:40.197+0000 7f927a61eb80 1 -- 172.21.15.163:0/1392390174 shutdown_connections 2023-07-14T18:20:40.265 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:20:40.197+0000 7f927a61eb80 1 -- 172.21.15.163:0/1392390174 wait complete. 2023-07-14T18:20:40.265 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:20:40.197+0000 7f927a61eb80 1 -- start start 2023-07-14T18:20:40.265 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:20:40.197+0000 7f927a61eb80 1 Processor -- start 2023-07-14T18:20:40.266 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:20:40.198+0000 7f927a61eb80 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x56310c1eef60 0x56310c1ff5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:20:40.266 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:20:40.198+0000 7f927a61eb80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56310c1ef8b0 0x56310c1ffb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:20:40.266 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:20:40.198+0000 7f927a61eb80 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56310c1f04b0 0x56310c1fc080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:20:40.266 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:20:40.198+0000 7f927a61eb80 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x56310c1fc5c0 con 0x56310c1eef60 2023-07-14T18:20:40.266 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:20:40.198+0000 7f927a61eb80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x56310c1fc730 con 0x56310c1ef8b0 2023-07-14T18:20:40.267 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:20:40.198+0000 7f927a61eb80 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x56310c1fc8f0 con 0x56310c1f04b0 2023-07-14T18:20:40.267 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:20:40.198+0000 7f927a61eb80 10 client.0 _ll_register_callbacks cb 0x7f925c099cc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T18:20:40.267 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:20:40.198+0000 7f9267fff700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x56310c1eef60 0x56310c1ff5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:20:40.267 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:20:40.198+0000 7f9267fff700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x56310c1eef60 0x56310c1ff5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:59966/0 (socket says 172.21.15.163:59966) 2023-07-14T18:20:40.267 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:20:40.198+0000 7f9267fff700 1 -- 172.21.15.163:0/2588203541 learned_addr learned my addr 172.21.15.163:0/2588203541 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:20:40.268 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:20:40.198+0000 7f92677fe700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56310c1ef8b0 0x56310c1ffb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:20:40.268 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:20:40.198+0000 7f926ca23700 1 --2- 172.21.15.163:0/2588203541 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56310c1f04b0 0x56310c1fc080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:20:40.268 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:20:40.198+0000 7f9267fff700 1 -- 172.21.15.163:0/2588203541 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56310c1f04b0 msgr2=0x56310c1fc080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:20:40.268 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:20:40.198+0000 7f9267fff700 1 --2- 172.21.15.163:0/2588203541 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56310c1f04b0 0x56310c1fc080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:20:40.269 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:20:40.198+0000 7f9267fff700 1 -- 172.21.15.163:0/2588203541 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56310c1ef8b0 msgr2=0x56310c1ffb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:20:40.269 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:20:40.198+0000 7f9267fff700 1 --2- 172.21.15.163:0/2588203541 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56310c1ef8b0 0x56310c1ffb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:20:40.269 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:20:40.198+0000 7f9267fff700 1 -- 172.21.15.163:0/2588203541 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9268107880 con 0x56310c1eef60 2023-07-14T18:20:40.269 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:20:40.198+0000 7f92677fe700 1 --2- 172.21.15.163:0/2588203541 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56310c1ef8b0 0x56310c1ffb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T18:20:40.270 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:20:40.198+0000 7f9267fff700 1 --2- 172.21.15.163:0/2588203541 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x56310c1eef60 0x56310c1ff5e0 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7f925800e970 tx=0x7f925800ef90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4601ffbf42778fc server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:20:40.270 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:20:40.198+0000 7f92477fe700 10 client.0 ms_handle_connect on v2:172.21.15.163:3300/0 2023-07-14T18:20:40.270 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:20:40.198+0000 7f92477fe700 1 -- 172.21.15.163:0/2588203541 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f925801cbc0 con 0x56310c1eef60 2023-07-14T18:20:40.270 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:20:40.199+0000 7f92477fe700 1 -- 172.21.15.163:0/2588203541 <== mon.0 v2:172.21.15.163:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 9049+0+0 (secure 0 0 0) 0x7f925801ce20 con 0x56310c1eef60 2023-07-14T18:20:40.271 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:20:40.199+0000 7f927a61eb80 1 -- 172.21.15.163:0/2588203541 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f9258021070 con 0x56310c1eef60 2023-07-14T18:20:40.271 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:20:40.199+0000 7f92477fe700 1 -- 172.21.15.163:0/2588203541 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) v2 ==== 24+0+0 (secure 0 0 0) 0x7f925801c410 con 0x56310c1eef60 2023-07-14T18:20:40.271 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:20:40.199+0000 7f927a61eb80 10 client.16470 fetch_fsmap learned FSMap version 39 2023-07-14T18:20:40.271 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:20:40.199+0000 7f927a61eb80 1 -- 172.21.15.163:0/2588203541 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) v3 -- 0x7f925802a040 con 0x56310c1eef60 2023-07-14T18:20:40.271 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:20:40.199+0000 7f92477fe700 1 -- 172.21.15.163:0/2588203541 <== mon.0 v2:172.21.15.163:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f9258021070 con 0x56310c1eef60 2023-07-14T18:20:40.272 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:20:40.199+0000 7f92477fe700 1 -- 172.21.15.163:0/2588203541 <== mon.0 v2:172.21.15.163:3300/0 5 ==== fsmap(e 39) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f9258038020 con 0x56310c1eef60 2023-07-14T18:20:40.272 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:20:40.199+0000 7f927a61eb80 10 client.16470 fetch_fsmap finished waiting for FSMap version 39 2023-07-14T18:20:40.272 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:20:40.199+0000 7f927a61eb80 10 client.16470 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-07-14T18:20:40.272 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:20:40.199+0000 7f927a61eb80 20 client.16470 populate_metadata read hostname 'smithi163' 2023-07-14T18:20:40.273 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:20:40.199+0000 7f927a61eb80 1 --2- 172.21.15.163:0/2588203541 >> [v2:172.21.15.172:6838/3850440096,v1:172.21.15.172:6839/3850440096] conn(0x56310c25d790 0x56310c25fba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:20:40.273 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:20:40.199+0000 7f927a61eb80 4 client.16470 mds_command: new command op to 24518 tid=0[{"prefix": "scrub status"}] 2023-07-14T18:20:40.273 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:20:40.199+0000 7f927a61eb80 1 -- 172.21.15.163:0/2588203541 --> [v2:172.21.15.172:6838/3850440096,v1:172.21.15.172:6839/3850440096] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x56310c138eb0 con 0x56310c25d790 2023-07-14T18:20:40.273 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:20:40.199+0000 7f92677fe700 1 --2- 172.21.15.163:0/2588203541 >> [v2:172.21.15.172:6838/3850440096,v1:172.21.15.172:6839/3850440096] conn(0x56310c25d790 0x56310c25fba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:20:40.273 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:20:40.200+0000 7f92477fe700 10 client.16470 ms_handle_connect on v2:172.21.15.172:6838/3850440096 2023-07-14T18:20:40.274 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:20:40.200+0000 7f92677fe700 1 --2- 172.21.15.163:0/2588203541 >> [v2:172.21.15.172:6838/3850440096,v1:172.21.15.172:6839/3850440096] conn(0x56310c25d790 0x56310c25fba0 crc :-1 s=READY pgs=90 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=106208d6e6dd275 server_cookie=3adca436ebd05c93 in_seq=0 out_seq=0 2023-07-14T18:20:40.274 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:20:40.200+0000 7f92477fe700 1 -- 172.21.15.163:0/2588203541 <== mds.0 v2:172.21.15.172:6838/3850440096 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x56310c138eb0 con 0x56310c25d790 2023-07-14T18:20:40.274 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:20:40.200+0000 7f92477fe700 10 client.16470 handle_command_reply: tid=0 2023-07-14T18:20:40.274 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:20:40.200+0000 7f927a61eb80 1 client.16470 shutdown 2023-07-14T18:20:40.274 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:20:40.200+0000 7f927a61eb80 1 -- 172.21.15.163:0/2588203541 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x56310c1eef60 msgr2=0x56310c1ff5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:20:40.275 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:20:40.200+0000 7f927a61eb80 1 --2- 172.21.15.163:0/2588203541 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x56310c1eef60 0x56310c1ff5e0 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7f925800e970 tx=0x7f925800ef90 comp rx=0 tx=0).stop 2023-07-14T18:20:40.275 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:20:40.200+0000 7f927a61eb80 1 -- 172.21.15.163:0/2588203541 shutdown_connections 2023-07-14T18:20:40.275 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:20:40.200+0000 7f927a61eb80 1 --2- 172.21.15.163:0/2588203541 >> [v2:172.21.15.172:6838/3850440096,v1:172.21.15.172:6839/3850440096] conn(0x56310c25d790 0x56310c25fba0 crc :-1 s=READY pgs=90 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:20:40.275 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:20:40.200+0000 7f927a61eb80 1 --2- 172.21.15.163:0/2588203541 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56310c1f04b0 0x56310c1fc080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:20:40.276 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:20:40.200+0000 7f927a61eb80 1 --2- 172.21.15.163:0/2588203541 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x56310c1eef60 0x56310c1ff5e0 unknown :-1 s=CLOSED pgs=703 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:20:40.276 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:20:40.200+0000 7f927a61eb80 1 --2- 172.21.15.163:0/2588203541 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56310c1ef8b0 0x56310c1ffb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:20:40.276 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:20:40.200+0000 7f927a61eb80 1 -- 172.21.15.163:0/2588203541 >> 172.21.15.163:0/2588203541 conn(0x56310c1e4680 msgr2=0x56310c1f6890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:20:40.276 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:20:40.200+0000 7f92477fe700 0 client.16470 ms_handle_reset on v2:172.21.15.172:6838/3850440096 2023-07-14T18:20:40.276 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:20:40.200+0000 7f927a61eb80 1 -- 172.21.15.163:0/2588203541 shutdown_connections 2023-07-14T18:20:40.277 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:20:40.200+0000 7f927a61eb80 1 -- 172.21.15.163:0/2588203541 wait complete. 2023-07-14T18:20:40.277 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:20:40.200+0000 7f927a61eb80 20 client.16470 trim_cache size 0 max 16384 2023-07-14T18:20:40.277 INFO:teuthology.orchestra.run.smithi163.stdout:{ 2023-07-14T18:20:40.278 INFO:teuthology.orchestra.run.smithi163.stdout: "status": "IDLE (waiting for more scrubs)", 2023-07-14T18:20:40.278 INFO:teuthology.orchestra.run.smithi163.stdout: "scrubs": { 2023-07-14T18:20:40.278 INFO:teuthology.orchestra.run.smithi163.stdout: "2c53b7ef-6f30-49f0-a60d-f1f114c19d42": { 2023-07-14T18:20:40.278 INFO:teuthology.orchestra.run.smithi163.stdout: "path": "/", 2023-07-14T18:20:40.279 INFO:teuthology.orchestra.run.smithi163.stdout: "tag": "2c53b7ef-6f30-49f0-a60d-f1f114c19d42", 2023-07-14T18:20:40.279 INFO:teuthology.orchestra.run.smithi163.stdout: "options": "recursive,force" 2023-07-14T18:20:40.279 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-07-14T18:20:40.279 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-07-14T18:20:40.279 INFO:teuthology.orchestra.run.smithi163.stdout:} 2023-07-14T18:20:40.281 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:20:40.201+0000 7f926e486700 1 -- 172.21.15.163:0/934848050 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f92500a1150 msgr2=0x7f92500a3600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:20:40.281 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:20:40.201+0000 7f926e486700 1 --2- 172.21.15.163:0/934848050 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f92500a1150 0x7f92500a3600 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f92680ffb60 tx=0x7f9258009260 comp rx=0 tx=0).stop 2023-07-14T18:20:40.282 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:20:40.201+0000 7f926e486700 1 -- 172.21.15.163:0/934848050 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f92680ffd00 msgr2=0x7f926819a6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:20:40.282 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:20:40.201+0000 7f926e486700 1 --2- 172.21.15.163:0/934848050 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f92680ffd00 0x7f926819a6b0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f925c00ec10 tx=0x7f925c00ef20 comp rx=0 tx=0).stop 2023-07-14T18:20:40.282 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:20:40.201+0000 7f926e486700 1 -- 172.21.15.163:0/934848050 shutdown_connections 2023-07-14T18:20:40.282 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:20:40.201+0000 7f926e486700 1 --2- 172.21.15.163:0/934848050 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f92500a1150 0x7f92500a3600 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:20:40.283 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:20:40.201+0000 7f926e486700 1 --2- 172.21.15.163:0/934848050 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f92680feb10 0x7f9268068330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:20:40.283 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:20:40.201+0000 7f926e486700 1 --2- 172.21.15.163:0/934848050 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f9268100690 0x7f926819cd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:20:40.283 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:20:40.201+0000 7f926e486700 1 --2- 172.21.15.163:0/934848050 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f92680ffd00 0x7f926819a6b0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:20:40.283 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:20:40.201+0000 7f926e486700 1 -- 172.21.15.163:0/934848050 >> 172.21.15.163:0/934848050 conn(0x7f92680fa130 msgr2=0x7f92680fc3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:20:40.284 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:20:40.201+0000 7f926e486700 1 -- 172.21.15.163:0/934848050 shutdown_connections 2023-07-14T18:20:40.284 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:20:40.201+0000 7f926e486700 1 -- 172.21.15.163:0/934848050 wait complete. 2023-07-14T18:20:40.284 INFO:tasks.cephfs.filesystem:scrub status for tag:2c53b7ef-6f30-49f0-a60d-f1f114c19d42 - {'path': '/', 'tag': '2c53b7ef-6f30-49f0-a60d-f1f114c19d42', 'options': 'recursive,force'} 2023-07-14T18:20:40.933 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:20:40 smithi184 ceph-mon[98481]: pgmap v540: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-07-14T18:20:40.976 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:20:40 smithi163 ceph-mon[96576]: pgmap v540: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-07-14T18:20:41.034 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:20:40 smithi172 ceph-mon[97983]: pgmap v540: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-07-14T18:20:42.226 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:20:41 smithi163 ceph-mon[96576]: pgmap v541: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-07-14T18:20:42.284 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:20:41 smithi172 ceph-mon[97983]: pgmap v541: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-07-14T18:20:42.433 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:20:41 smithi184 ceph-mon[98481]: pgmap v541: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-07-14T18:20:44.933 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:20:44 smithi184 ceph-mon[98481]: pgmap v542: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-07-14T18:20:44.976 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:20:44 smithi163 ceph-mon[96576]: pgmap v542: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-07-14T18:20:45.034 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:20:44 smithi172 ceph-mon[97983]: pgmap v542: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-07-14T18:20:46.933 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:20:46 smithi184 ceph-mon[98481]: pgmap v543: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-07-14T18:20:46.976 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:20:46 smithi163 ceph-mon[96576]: pgmap v543: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-07-14T18:20:47.034 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:20:46 smithi172 ceph-mon[97983]: pgmap v543: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-07-14T18:20:48.933 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:20:48 smithi184 ceph-mon[98481]: pgmap v544: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-07-14T18:20:48.975 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:20:48 smithi163 ceph-mon[96576]: pgmap v544: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-07-14T18:20:49.034 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:20:48 smithi172 ceph-mon[97983]: pgmap v544: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-07-14T18:20:50.933 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:20:50 smithi184 ceph-mon[98481]: pgmap v545: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-07-14T18:20:50.976 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:20:50 smithi163 ceph-mon[96576]: pgmap v545: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-07-14T18:20:51.034 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:20:50 smithi172 ceph-mon[97983]: pgmap v545: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-07-14T18:20:52.226 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:20:51 smithi163 ceph-mon[96576]: pgmap v546: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-07-14T18:20:52.284 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:20:51 smithi172 ceph-mon[97983]: pgmap v546: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-07-14T18:20:52.433 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:20:51 smithi184 ceph-mon[98481]: pgmap v546: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-07-14T18:20:54.933 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:20:54 smithi184 ceph-mon[98481]: pgmap v547: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-07-14T18:20:54.976 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:20:54 smithi163 ceph-mon[96576]: pgmap v547: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-07-14T18:20:55.034 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:20:54 smithi172 ceph-mon[97983]: pgmap v547: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-07-14T18:20:56.933 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:20:56 smithi184 ceph-mon[98481]: pgmap v548: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-07-14T18:20:56.976 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:20:56 smithi163 ceph-mon[96576]: pgmap v548: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-07-14T18:20:57.034 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:20:56 smithi172 ceph-mon[97983]: pgmap v548: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-07-14T18:20:58.933 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:20:58 smithi184 ceph-mon[98481]: pgmap v549: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-07-14T18:20:58.976 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:20:58 smithi163 ceph-mon[96576]: pgmap v549: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-07-14T18:20:59.034 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:20:58 smithi172 ceph-mon[97983]: pgmap v549: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-07-14T18:21:00.933 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:21:00 smithi184 ceph-mon[98481]: pgmap v550: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-07-14T18:21:00.976 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:21:00 smithi163 ceph-mon[96576]: pgmap v550: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-07-14T18:21:01.034 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:21:00 smithi172 ceph-mon[97983]: pgmap v550: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-07-14T18:21:02.226 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:21:01 smithi163 ceph-mon[96576]: pgmap v551: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-07-14T18:21:02.284 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:21:01 smithi172 ceph-mon[97983]: pgmap v551: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-07-14T18:21:02.376 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:21:01 smithi184 ceph-mon[98481]: pgmap v551: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-07-14T18:21:04.933 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:21:04 smithi184 ceph-mon[98481]: pgmap v552: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-07-14T18:21:04.976 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:21:04 smithi163 ceph-mon[96576]: pgmap v552: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-07-14T18:21:05.034 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:21:04 smithi172 ceph-mon[97983]: pgmap v552: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-07-14T18:21:06.933 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:21:06 smithi184 ceph-mon[98481]: pgmap v553: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-07-14T18:21:06.976 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:21:06 smithi163 ceph-mon[96576]: pgmap v553: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-07-14T18:21:07.034 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:21:06 smithi172 ceph-mon[97983]: pgmap v553: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-07-14T18:21:08.934 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:21:08 smithi184 ceph-mon[98481]: pgmap v554: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-07-14T18:21:08.976 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:21:08 smithi163 ceph-mon[96576]: pgmap v554: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-07-14T18:21:09.034 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:21:08 smithi172 ceph-mon[97983]: pgmap v554: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-07-14T18:21:10.285 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-07-14T18:21:10.430 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:21:10.380+0000 7f453143d700 1 -- 172.21.15.163:0/124643993 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f452c103010 msgr2=0x7f452c1053f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:21:10.431 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:21:10.380+0000 7f453143d700 1 --2- 172.21.15.163:0/124643993 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f452c103010 0x7f452c1053f0 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7f4520009990 tx=0x7f4520009ca0 comp rx=0 tx=0).stop 2023-07-14T18:21:10.431 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:21:10.380+0000 7f453143d700 1 -- 172.21.15.163:0/124643993 shutdown_connections 2023-07-14T18:21:10.431 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:21:10.380+0000 7f453143d700 1 --2- 172.21.15.163:0/124643993 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f452c1006f0 0x7f452c102ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:21:10.432 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:21:10.380+0000 7f453143d700 1 --2- 172.21.15.163:0/124643993 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f452c105930 0x7f452c107d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:21:10.432 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:21:10.380+0000 7f453143d700 1 --2- 172.21.15.163:0/124643993 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f452c103010 0x7f452c1053f0 unknown :-1 s=CLOSED pgs=704 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:21:10.432 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:21:10.380+0000 7f453143d700 1 -- 172.21.15.163:0/124643993 >> 172.21.15.163:0/124643993 conn(0x7f452c0fa130 msgr2=0x7f452c0fc560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:21:10.432 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:21:10.380+0000 7f453143d700 1 -- 172.21.15.163:0/124643993 shutdown_connections 2023-07-14T18:21:10.432 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:21:10.381+0000 7f453143d700 1 -- 172.21.15.163:0/124643993 wait complete. 2023-07-14T18:21:10.434 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:21:10.381+0000 7f453143d700 1 Processor -- start 2023-07-14T18:21:10.434 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:21:10.381+0000 7f453143d700 1 -- start start 2023-07-14T18:21:10.434 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:21:10.381+0000 7f453143d700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f452c1006f0 0x7f452c197a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:21:10.435 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:21:10.381+0000 7f453143d700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f452c103010 0x7f452c197fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:21:10.435 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:21:10.381+0000 7f453143d700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f452c105930 0x7f452c19f020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:21:10.435 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:21:10.381+0000 7f453143d700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f452c19f5f0 con 0x7f452c103010 2023-07-14T18:21:10.435 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:21:10.381+0000 7f453143d700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f452c19f730 con 0x7f452c105930 2023-07-14T18:21:10.435 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:21:10.381+0000 7f453143d700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f452c19f8c0 con 0x7f452c1006f0 2023-07-14T18:21:10.435 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:21:10.382+0000 7f452a7fc700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f452c103010 0x7f452c197fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:21:10.436 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:21:10.382+0000 7f452affd700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f452c1006f0 0x7f452c197a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:21:10.436 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:21:10.382+0000 7f452a7fc700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f452c103010 0x7f452c197fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:59982/0 (socket says 172.21.15.163:59982) 2023-07-14T18:21:10.436 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:21:10.382+0000 7f452a7fc700 1 -- 172.21.15.163:0/1433598412 learned_addr learned my addr 172.21.15.163:0/1433598412 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:21:10.436 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:21:10.382+0000 7f452a7fc700 1 -- 172.21.15.163:0/1433598412 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f452c1006f0 msgr2=0x7f452c197a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:21:10.436 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:21:10.382+0000 7f452a7fc700 1 --2- 172.21.15.163:0/1433598412 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f452c1006f0 0x7f452c197a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:21:10.437 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:21:10.382+0000 7f452a7fc700 1 -- 172.21.15.163:0/1433598412 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f452c105930 msgr2=0x7f452c19f020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:21:10.437 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:21:10.382+0000 7f452a7fc700 1 --2- 172.21.15.163:0/1433598412 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f452c105930 0x7f452c19f020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:21:10.437 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:21:10.382+0000 7f452a7fc700 1 -- 172.21.15.163:0/1433598412 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f451c009520 con 0x7f452c103010 2023-07-14T18:21:10.437 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:21:10.382+0000 7f452a7fc700 1 --2- 172.21.15.163:0/1433598412 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f452c103010 0x7f452c197fb0 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7f45200059d0 tx=0x7f45200047b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:21:10.437 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:21:10.382+0000 7f4513fff700 1 -- 172.21.15.163:0/1433598412 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f452001d070 con 0x7f452c103010 2023-07-14T18:21:10.438 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:21:10.382+0000 7f453143d700 1 -- 172.21.15.163:0/1433598412 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f45200095f0 con 0x7f452c103010 2023-07-14T18:21:10.438 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:21:10.382+0000 7f4513fff700 1 -- 172.21.15.163:0/1433598412 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f452000beb0 con 0x7f452c103010 2023-07-14T18:21:10.438 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:21:10.382+0000 7f4513fff700 1 -- 172.21.15.163:0/1433598412 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f452000fe10 con 0x7f452c103010 2023-07-14T18:21:10.438 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:21:10.383+0000 7f453143d700 1 -- 172.21.15.163:0/1433598412 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f452c19fe60 con 0x7f452c103010 2023-07-14T18:21:10.442 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:21:10.385+0000 7f4513fff700 1 -- 172.21.15.163:0/1433598412 <== mon.0 v2:172.21.15.163:3300/0 4 ==== mgrmap(e 18) v1 ==== 135716+0+0 (secure 0 0 0) 0x7f452000f5d0 con 0x7f452c103010 2023-07-14T18:21:10.443 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:21:10.385+0000 7f4513fff700 1 --2- 172.21.15.163:0/1433598412 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f45140a1150 0x7f45140a3600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:21:10.443 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:21:10.385+0000 7f452affd700 1 --2- 172.21.15.163:0/1433598412 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f45140a1150 0x7f45140a3600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:21:10.443 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:21:10.385+0000 7f4513fff700 1 -- 172.21.15.163:0/1433598412 <== mon.0 v2:172.21.15.163:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 9049+0+0 (secure 0 0 0) 0x7f45200ce100 con 0x7f452c103010 2023-07-14T18:21:10.443 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:21:10.386+0000 7f452affd700 1 --2- 172.21.15.163:0/1433598412 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f45140a1150 0x7f45140a3600 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f451c009df0 tx=0x7f451c009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:21:10.444 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:21:10.387+0000 7f453d5d5b80 1 Processor -- start 2023-07-14T18:21:10.444 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:21:10.387+0000 7f453d5d5b80 1 -- start start 2023-07-14T18:21:10.444 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:21:10.387+0000 7f453d5d5b80 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x560865b84f60 0x560865b85370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:21:10.444 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:21:10.387+0000 7f453d5d5b80 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x560865b858b0 0x560865b85ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:21:10.444 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:21:10.387+0000 7f453d5d5b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560865b864b0 0x560865b86920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:21:10.445 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:21:10.387+0000 7f453d5d5b80 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x560865a89cb0 con 0x560865b84f60 2023-07-14T18:21:10.445 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:21:10.387+0000 7f453d5d5b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x560865adca40 con 0x560865b864b0 2023-07-14T18:21:10.445 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:21:10.387+0000 7f453d5d5b80 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x560865ad5ed0 con 0x560865b858b0 2023-07-14T18:21:10.445 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:21:10.387+0000 7f452a7fc700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x560865b858b0 0x560865b85ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:21:10.445 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:21:10.387+0000 7f452affd700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x560865b84f60 0x560865b85370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:21:10.446 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:21:10.387+0000 7f452b7fe700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560865b864b0 0x560865b86920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:21:10.446 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:21:10.387+0000 7f452a7fc700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x560865b858b0 0x560865b85ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.163:41812/0 (socket says 172.21.15.163:41812) 2023-07-14T18:21:10.446 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:21:10.387+0000 7f452a7fc700 1 -- 172.21.15.163:0/2825297996 learned_addr learned my addr 172.21.15.163:0/2825297996 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:21:10.446 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:21:10.387+0000 7f452b7fe700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560865b864b0 0x560865b86920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.163:60676/0 (socket says 172.21.15.163:60676) 2023-07-14T18:21:10.446 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:21:10.387+0000 7f452a7fc700 1 -- 172.21.15.163:0/2825297996 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560865b864b0 msgr2=0x560865b86920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:21:10.447 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:21:10.388+0000 7f452a7fc700 1 --2- 172.21.15.163:0/2825297996 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560865b864b0 0x560865b86920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:21:10.447 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:21:10.388+0000 7f452a7fc700 1 -- 172.21.15.163:0/2825297996 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x560865b84f60 msgr2=0x560865b85370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:21:10.447 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:21:10.388+0000 7f452a7fc700 1 --2- 172.21.15.163:0/2825297996 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x560865b84f60 0x560865b85370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:21:10.447 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:21:10.388+0000 7f452a7fc700 1 -- 172.21.15.163:0/2825297996 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560865903de0 con 0x560865b858b0 2023-07-14T18:21:10.447 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:21:10.388+0000 7f452a7fc700 1 --2- 172.21.15.163:0/2825297996 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x560865b858b0 0x560865b85ed0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f45200a3100 tx=0x7f4520097680 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a5a980999fd06ffd server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:21:10.447 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:21:10.388+0000 7f45117fa700 1 -- 172.21.15.163:0/2825297996 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f452009abd0 con 0x560865b858b0 2023-07-14T18:21:10.448 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:21:10.388+0000 7f45117fa700 1 -- 172.21.15.163:0/2825297996 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f452009b270 con 0x560865b858b0 2023-07-14T18:21:10.448 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:21:10.388+0000 7f45117fa700 1 -- 172.21.15.163:0/2825297996 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f452009a760 con 0x560865b858b0 2023-07-14T18:21:10.448 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:21:10.389+0000 7f453d5d5b80 1 -- 172.21.15.163:0/2825297996 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x560865b858b0 msgr2=0x560865b85ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:21:10.448 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:21:10.389+0000 7f453d5d5b80 1 --2- 172.21.15.163:0/2825297996 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x560865b858b0 0x560865b85ed0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f45200a3100 tx=0x7f4520097680 comp rx=0 tx=0).stop 2023-07-14T18:21:10.448 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:21:10.389+0000 7f453d5d5b80 1 -- 172.21.15.163:0/2825297996 shutdown_connections 2023-07-14T18:21:10.449 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:21:10.389+0000 7f453d5d5b80 1 --2- 172.21.15.163:0/2825297996 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560865b864b0 0x560865b86920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:21:10.449 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:21:10.389+0000 7f453d5d5b80 1 --2- 172.21.15.163:0/2825297996 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x560865b84f60 0x560865b85370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:21:10.449 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:21:10.389+0000 7f453d5d5b80 1 --2- 172.21.15.163:0/2825297996 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x560865b858b0 0x560865b85ed0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:21:10.449 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:21:10.389+0000 7f453d5d5b80 1 -- 172.21.15.163:0/2825297996 >> 172.21.15.163:0/2825297996 conn(0x560865b7a680 msgr2=0x560865b7f9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:21:10.449 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:21:10.389+0000 7f453d5d5b80 1 -- 172.21.15.163:0/2825297996 shutdown_connections 2023-07-14T18:21:10.450 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:21:10.389+0000 7f453d5d5b80 1 -- 172.21.15.163:0/2825297996 wait complete. 2023-07-14T18:21:10.450 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:21:10.389+0000 7f453d5d5b80 1 -- start start 2023-07-14T18:21:10.450 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:21:10.389+0000 7f453d5d5b80 1 Processor -- start 2023-07-14T18:21:10.450 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:21:10.390+0000 7f453d5d5b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560865b84f60 0x560865b8e5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:21:10.450 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:21:10.390+0000 7f453d5d5b80 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x560865b858b0 0x560865b8eb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:21:10.451 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:21:10.390+0000 7f453d5d5b80 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x560865b864b0 0x560865b95b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:21:10.451 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:21:10.390+0000 7f453d5d5b80 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x560865a75ac0 con 0x560865b864b0 2023-07-14T18:21:10.451 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:21:10.390+0000 7f453d5d5b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x560865a757c0 con 0x560865b84f60 2023-07-14T18:21:10.451 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:21:10.390+0000 7f453d5d5b80 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x560865959920 con 0x560865b858b0 2023-07-14T18:21:10.451 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:21:10.390+0000 7f453d5d5b80 10 client.0 _ll_register_callbacks cb 0x560865a73760 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T18:21:10.451 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:21:10.390+0000 7f452affd700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560865b84f60 0x560865b8e5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:21:10.452 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:21:10.390+0000 7f452b7fe700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x560865b864b0 0x560865b95b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:21:10.452 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:21:10.390+0000 7f452a7fc700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x560865b858b0 0x560865b8eb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:21:10.452 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:21:10.390+0000 7f452affd700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560865b84f60 0x560865b8e5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.163:60678/0 (socket says 172.21.15.163:60678) 2023-07-14T18:21:10.452 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:21:10.390+0000 7f452affd700 1 -- 172.21.15.163:0/18271826 learned_addr learned my addr 172.21.15.163:0/18271826 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:21:10.452 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:21:10.390+0000 7f452b7fe700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x560865b864b0 0x560865b95b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:59998/0 (socket says 172.21.15.163:59998) 2023-07-14T18:21:10.453 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:21:10.390+0000 7f452b7fe700 1 -- 172.21.15.163:0/18271826 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x560865b858b0 msgr2=0x560865b8eb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:21:10.453 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:21:10.390+0000 7f452b7fe700 1 --2- 172.21.15.163:0/18271826 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x560865b858b0 0x560865b8eb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:21:10.453 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:21:10.390+0000 7f452b7fe700 1 -- 172.21.15.163:0/18271826 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560865b84f60 msgr2=0x560865b8e5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:21:10.453 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:21:10.390+0000 7f452b7fe700 1 --2- 172.21.15.163:0/18271826 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560865b84f60 0x560865b8e5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:21:10.453 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:21:10.390+0000 7f452b7fe700 1 -- 172.21.15.163:0/18271826 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f452c19fe60 con 0x560865b864b0 2023-07-14T18:21:10.454 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:21:10.390+0000 7f452b7fe700 1 --2- 172.21.15.163:0/18271826 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x560865b864b0 0x560865b95b60 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7f4524011d10 tx=0x7f452400f490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e58ef96d84fadfc2 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:21:10.454 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:21:10.390+0000 7f450eff5700 10 client.0 ms_handle_connect on v2:172.21.15.163:3300/0 2023-07-14T18:21:10.454 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:21:10.390+0000 7f450eff5700 1 -- 172.21.15.163:0/18271826 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f452400e040 con 0x560865b864b0 2023-07-14T18:21:10.454 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:21:10.390+0000 7f450eff5700 1 -- 172.21.15.163:0/18271826 <== mon.0 v2:172.21.15.163:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 9049+0+0 (secure 0 0 0) 0x7f4524004bb0 con 0x560865b864b0 2023-07-14T18:21:10.454 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:21:10.390+0000 7f453d5d5b80 1 -- 172.21.15.163:0/18271826 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x560865a2f4f0 con 0x560865b864b0 2023-07-14T18:21:10.455 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:21:10.391+0000 7f450eff5700 1 -- 172.21.15.163:0/18271826 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4524004db0 con 0x560865b864b0 2023-07-14T18:21:10.455 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:21:10.391+0000 7f453d5d5b80 10 client.16482 fetch_fsmap learned FSMap version 39 2023-07-14T18:21:10.455 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:21:10.391+0000 7f453d5d5b80 1 -- 172.21.15.163:0/18271826 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) v3 -- 0x5608658ecc60 con 0x560865b864b0 2023-07-14T18:21:10.455 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:21:10.391+0000 7f450eff5700 1 -- 172.21.15.163:0/18271826 <== mon.0 v2:172.21.15.163:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x560865a2f4f0 con 0x560865b864b0 2023-07-14T18:21:10.455 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:21:10.391+0000 7f450eff5700 1 -- 172.21.15.163:0/18271826 <== mon.0 v2:172.21.15.163:3300/0 5 ==== fsmap(e 39) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f452401b020 con 0x560865b864b0 2023-07-14T18:21:10.455 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:21:10.391+0000 7f453d5d5b80 10 client.16482 fetch_fsmap finished waiting for FSMap version 39 2023-07-14T18:21:10.456 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:21:10.391+0000 7f453d5d5b80 10 client.16482 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-07-14T18:21:10.456 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:21:10.391+0000 7f453d5d5b80 20 client.16482 populate_metadata read hostname 'smithi163' 2023-07-14T18:21:10.456 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:21:10.391+0000 7f453d5d5b80 1 --2- 172.21.15.163:0/18271826 >> [v2:172.21.15.172:6838/3850440096,v1:172.21.15.172:6839/3850440096] conn(0x560865b9a420 0x560865b9c830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:21:10.456 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:21:10.391+0000 7f453d5d5b80 4 client.16482 mds_command: new command op to 24518 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-14T18:21:10.456 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:21:10.391+0000 7f453d5d5b80 1 -- 172.21.15.163:0/18271826 --> [v2:172.21.15.172:6838/3850440096,v1:172.21.15.172:6839/3850440096] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x560865b53da0 con 0x560865b9a420 2023-07-14T18:21:10.457 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:21:10.391+0000 7f452affd700 1 --2- 172.21.15.163:0/18271826 >> [v2:172.21.15.172:6838/3850440096,v1:172.21.15.172:6839/3850440096] conn(0x560865b9a420 0x560865b9c830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:21:10.457 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:21:10.392+0000 7f452affd700 1 --2- 172.21.15.163:0/18271826 >> [v2:172.21.15.172:6838/3850440096,v1:172.21.15.172:6839/3850440096] conn(0x560865b9a420 0x560865b9c830 crc :-1 s=READY pgs=91 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c5f6214eac3427bd server_cookie=cb8380819ec8cb2d in_seq=0 out_seq=0 2023-07-14T18:21:10.457 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:21:10.392+0000 7f450eff5700 10 client.16482 ms_handle_connect on v2:172.21.15.172:6838/3850440096 2023-07-14T18:21:10.457 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:21:10.392+0000 7f450eff5700 1 -- 172.21.15.163:0/18271826 <== mds.0 v2:172.21.15.172:6838/3850440096 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18017 (crc 0 0 0) 0x560865b53da0 con 0x560865b9a420 2023-07-14T18:21:10.457 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:21:10.392+0000 7f450eff5700 10 client.16482 handle_command_reply: tid=0 2023-07-14T18:21:10.458 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:21:10.392+0000 7f453d5d5b80 1 client.16482 shutdown 2023-07-14T18:21:10.458 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:21:10.393+0000 7f453d5d5b80 1 -- 172.21.15.163:0/18271826 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x560865b864b0 msgr2=0x560865b95b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:21:10.458 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:21:10.393+0000 7f453d5d5b80 1 --2- 172.21.15.163:0/18271826 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x560865b864b0 0x560865b95b60 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7f4524011d10 tx=0x7f452400f490 comp rx=0 tx=0).stop 2023-07-14T18:21:10.458 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:21:10.393+0000 7f453d5d5b80 1 -- 172.21.15.163:0/18271826 shutdown_connections 2023-07-14T18:21:10.458 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:21:10.393+0000 7f453d5d5b80 1 --2- 172.21.15.163:0/18271826 >> [v2:172.21.15.172:6838/3850440096,v1:172.21.15.172:6839/3850440096] conn(0x560865b9a420 0x560865b9c830 crc :-1 s=READY pgs=91 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:21:10.459 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:21:10.393+0000 7f453d5d5b80 1 --2- 172.21.15.163:0/18271826 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x560865b864b0 0x560865b95b60 unknown :-1 s=CLOSED pgs=706 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:21:10.459 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:21:10.393+0000 7f450eff5700 0 client.16482 ms_handle_reset on v2:172.21.15.172:6838/3850440096 2023-07-14T18:21:10.459 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:21:10.393+0000 7f453d5d5b80 1 --2- 172.21.15.163:0/18271826 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560865b84f60 0x560865b8e5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:21:10.459 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:21:10.393+0000 7f453d5d5b80 1 --2- 172.21.15.163:0/18271826 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x560865b858b0 0x560865b8eb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:21:10.459 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:21:10.393+0000 7f453d5d5b80 1 -- 172.21.15.163:0/18271826 >> 172.21.15.163:0/18271826 conn(0x560865b7a680 msgr2=0x560865b7e650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:21:10.460 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:21:10.393+0000 7f453d5d5b80 1 -- 172.21.15.163:0/18271826 shutdown_connections 2023-07-14T18:21:10.460 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:21:10.393+0000 7f453d5d5b80 1 -- 172.21.15.163:0/18271826 wait complete. 2023-07-14T18:21:10.460 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:21:10.393+0000 7f453d5d5b80 20 client.16482 trim_cache size 0 max 16384 2023-07-14T18:21:10.467 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:21:10.416+0000 7f453d5d5b80 1 Processor -- start 2023-07-14T18:21:10.467 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:21:10.416+0000 7f453d5d5b80 1 -- start start 2023-07-14T18:21:10.468 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:21:10.417+0000 7f453d5d5b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560865b84f60 0x560865b86880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:21:10.468 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:21:10.417+0000 7f453d5d5b80 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x560865b858b0 0x560865b95a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:21:10.468 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:21:10.417+0000 7f453d5d5b80 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x560865b864b0 0x560865b8d3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:21:10.468 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:21:10.417+0000 7f453d5d5b80 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x560865b8d8e0 con 0x560865b858b0 2023-07-14T18:21:10.469 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:21:10.417+0000 7f453d5d5b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x560865b8e150 con 0x560865b84f60 2023-07-14T18:21:10.469 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:21:10.417+0000 7f453d5d5b80 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x560865b81460 con 0x560865b864b0 2023-07-14T18:21:10.469 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:21:10.417+0000 7f452a7fc700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x560865b858b0 0x560865b95a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:21:10.469 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:21:10.417+0000 7f452affd700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560865b84f60 0x560865b86880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:21:10.469 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:21:10.417+0000 7f452a7fc700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x560865b858b0 0x560865b95a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:60004/0 (socket says 172.21.15.163:60004) 2023-07-14T18:21:10.469 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:21:10.417+0000 7f452affd700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560865b84f60 0x560865b86880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.163:60686/0 (socket says 172.21.15.163:60686) 2023-07-14T18:21:10.470 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:21:10.417+0000 7f452a7fc700 1 -- 172.21.15.163:0/319872837 learned_addr learned my addr 172.21.15.163:0/319872837 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:21:10.470 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:21:10.417+0000 7f452b7fe700 1 --2- 172.21.15.163:0/319872837 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x560865b864b0 0x560865b8d3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:21:10.470 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:21:10.417+0000 7f452a7fc700 1 -- 172.21.15.163:0/319872837 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x560865b864b0 msgr2=0x560865b8d3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:21:10.470 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:21:10.417+0000 7f452a7fc700 1 --2- 172.21.15.163:0/319872837 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x560865b864b0 0x560865b8d3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:21:10.470 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:21:10.417+0000 7f452a7fc700 1 -- 172.21.15.163:0/319872837 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560865b84f60 msgr2=0x560865b86880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:21:10.471 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:21:10.417+0000 7f452a7fc700 1 --2- 172.21.15.163:0/319872837 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560865b84f60 0x560865b86880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:21:10.471 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:21:10.417+0000 7f452a7fc700 1 -- 172.21.15.163:0/319872837 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56086592a250 con 0x560865b858b0 2023-07-14T18:21:10.471 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:21:10.417+0000 7f452affd700 1 --2- 172.21.15.163:0/319872837 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560865b84f60 0x560865b86880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T18:21:10.471 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:21:10.417+0000 7f452a7fc700 1 --2- 172.21.15.163:0/319872837 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x560865b858b0 0x560865b95a80 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7f45200cbc40 tx=0x7f452000ff90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f3930359a339905a server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:21:10.471 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:21:10.417+0000 7f4511ffb700 1 -- 172.21.15.163:0/319872837 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f452009abd0 con 0x560865b858b0 2023-07-14T18:21:10.472 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:21:10.418+0000 7f4511ffb700 1 -- 172.21.15.163:0/319872837 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f452009f2a0 con 0x560865b858b0 2023-07-14T18:21:10.472 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:21:10.418+0000 7f4511ffb700 1 -- 172.21.15.163:0/319872837 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f452009a9c0 con 0x560865b858b0 2023-07-14T18:21:10.475 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:21:10.418+0000 7f453d5d5b80 1 -- 172.21.15.163:0/319872837 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x560865b858b0 msgr2=0x560865b95a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:21:10.475 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:21:10.418+0000 7f453d5d5b80 1 --2- 172.21.15.163:0/319872837 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x560865b858b0 0x560865b95a80 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7f45200cbc40 tx=0x7f452000ff90 comp rx=0 tx=0).stop 2023-07-14T18:21:10.475 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:21:10.418+0000 7f453d5d5b80 1 -- 172.21.15.163:0/319872837 shutdown_connections 2023-07-14T18:21:10.475 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:21:10.418+0000 7f453d5d5b80 1 --2- 172.21.15.163:0/319872837 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x560865b864b0 0x560865b8d3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:21:10.476 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:21:10.418+0000 7f453d5d5b80 1 --2- 172.21.15.163:0/319872837 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560865b84f60 0x560865b86880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:21:10.476 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:21:10.418+0000 7f453d5d5b80 1 --2- 172.21.15.163:0/319872837 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x560865b858b0 0x560865b95a80 unknown :-1 s=CLOSED pgs=707 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:21:10.476 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:21:10.418+0000 7f453d5d5b80 1 -- 172.21.15.163:0/319872837 >> 172.21.15.163:0/319872837 conn(0x560865b7a680 msgr2=0x560865b8c7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:21:10.476 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:21:10.418+0000 7f453d5d5b80 1 -- 172.21.15.163:0/319872837 shutdown_connections 2023-07-14T18:21:10.476 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:21:10.418+0000 7f453d5d5b80 1 -- 172.21.15.163:0/319872837 wait complete. 2023-07-14T18:21:10.477 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:21:10.419+0000 7f453d5d5b80 1 -- start start 2023-07-14T18:21:10.477 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:21:10.419+0000 7f453d5d5b80 1 Processor -- start 2023-07-14T18:21:10.477 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:21:10.419+0000 7f453d5d5b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560865b84f60 0x560865b91cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:21:10.477 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:21:10.419+0000 7f453d5d5b80 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x560865b858b0 0x560865b92270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:21:10.477 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:21:10.419+0000 7f453d5d5b80 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x560865b864b0 0x560865b94fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:21:10.477 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:21:10.419+0000 7f453d5d5b80 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x560865b95520 con 0x560865b864b0 2023-07-14T18:21:10.478 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:21:10.419+0000 7f453d5d5b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x560865b95690 con 0x560865b84f60 2023-07-14T18:21:10.478 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:21:10.419+0000 7f453d5d5b80 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x560865b95800 con 0x560865b858b0 2023-07-14T18:21:10.478 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:21:10.419+0000 7f453d5d5b80 10 client.0 _ll_register_callbacks cb 0x7f45240115d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T18:21:10.478 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:21:10.419+0000 7f452b7fe700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x560865b864b0 0x560865b94fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:21:10.478 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:21:10.419+0000 7f452a7fc700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x560865b858b0 0x560865b92270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:21:10.479 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:21:10.419+0000 7f452affd700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560865b84f60 0x560865b91cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:21:10.479 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:21:10.419+0000 7f452b7fe700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x560865b864b0 0x560865b94fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:60012/0 (socket says 172.21.15.163:60012) 2023-07-14T18:21:10.479 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:21:10.419+0000 7f452b7fe700 1 -- 172.21.15.163:0/659747839 learned_addr learned my addr 172.21.15.163:0/659747839 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:21:10.479 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:21:10.419+0000 7f452a7fc700 1 -- 172.21.15.163:0/659747839 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560865b84f60 msgr2=0x560865b91cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:21:10.479 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:21:10.419+0000 7f452a7fc700 1 --2- 172.21.15.163:0/659747839 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560865b84f60 0x560865b91cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:21:10.480 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:21:10.419+0000 7f452a7fc700 1 -- 172.21.15.163:0/659747839 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x560865b864b0 msgr2=0x560865b94fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:21:10.480 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:21:10.419+0000 7f452a7fc700 1 --2- 172.21.15.163:0/659747839 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x560865b864b0 0x560865b94fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:21:10.480 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:21:10.419+0000 7f452a7fc700 1 -- 172.21.15.163:0/659747839 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f451c017070 con 0x560865b858b0 2023-07-14T18:21:10.480 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:21:10.419+0000 7f452b7fe700 1 --2- 172.21.15.163:0/659747839 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x560865b864b0 0x560865b94fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T18:21:10.480 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:21:10.419+0000 7f452affd700 1 --2- 172.21.15.163:0/659747839 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560865b84f60 0x560865b91cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T18:21:10.481 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:21:10.420+0000 7f452a7fc700 1 --2- 172.21.15.163:0/659747839 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x560865b858b0 0x560865b92270 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x560865b8dab0 tx=0x7f4520009ca0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=aa514d89d6308223 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:21:10.481 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:21:10.420+0000 7f450eff5700 10 client.0 ms_handle_connect on v2:172.21.15.184:3300/0 2023-07-14T18:21:10.481 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:21:10.420+0000 7f450eff5700 1 -- 172.21.15.163:0/659747839 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f452009b040 con 0x560865b858b0 2023-07-14T18:21:10.481 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:21:10.420+0000 7f453d5d5b80 1 -- 172.21.15.163:0/659747839 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f452009b270 con 0x560865b858b0 2023-07-14T18:21:10.481 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:21:10.420+0000 7f450eff5700 1 -- 172.21.15.163:0/659747839 <== mon.1 v2:172.21.15.184:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 9049+0+0 (secure 0 0 0) 0x7f45200a3630 con 0x560865b858b0 2023-07-14T18:21:10.482 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:21:10.420+0000 7f450eff5700 1 -- 172.21.15.163:0/659747839 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) v2 ==== 24+0+0 (secure 0 0 0) 0x7f452009abd0 con 0x560865b858b0 2023-07-14T18:21:10.482 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:21:10.420+0000 7f453d5d5b80 10 client.26050 fetch_fsmap learned FSMap version 39 2023-07-14T18:21:10.482 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:21:10.420+0000 7f453d5d5b80 1 -- 172.21.15.163:0/659747839 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) v3 -- 0x560865903de0 con 0x560865b858b0 2023-07-14T18:21:10.482 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:21:10.420+0000 7f450eff5700 1 -- 172.21.15.163:0/659747839 <== mon.1 v2:172.21.15.184:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f452009b270 con 0x560865b858b0 2023-07-14T18:21:10.482 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:21:10.420+0000 7f450eff5700 1 -- 172.21.15.163:0/659747839 <== mon.1 v2:172.21.15.184:3300/0 5 ==== fsmap(e 39) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f4520084ac0 con 0x560865b858b0 2023-07-14T18:21:10.483 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:21:10.420+0000 7f453d5d5b80 10 client.26050 fetch_fsmap finished waiting for FSMap version 39 2023-07-14T18:21:10.483 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:21:10.420+0000 7f453d5d5b80 10 client.26050 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-07-14T18:21:10.483 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:21:10.420+0000 7f453d5d5b80 20 client.26050 populate_metadata read hostname 'smithi163' 2023-07-14T18:21:10.483 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:21:10.420+0000 7f453d5d5b80 1 --2- 172.21.15.163:0/659747839 >> [v2:172.21.15.172:6838/3850440096,v1:172.21.15.172:6839/3850440096] conn(0x560865beecf0 0x560865bf1100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:21:10.483 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:21:10.420+0000 7f453d5d5b80 4 client.26050 mds_command: new command op to 24518 tid=0[{"prefix": "scrub status"}] 2023-07-14T18:21:10.483 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:21:10.420+0000 7f453d5d5b80 1 -- 172.21.15.163:0/659747839 --> [v2:172.21.15.172:6838/3850440096,v1:172.21.15.172:6839/3850440096] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x560865aceeb0 con 0x560865beecf0 2023-07-14T18:21:10.484 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:21:10.421+0000 7f452affd700 1 --2- 172.21.15.163:0/659747839 >> [v2:172.21.15.172:6838/3850440096,v1:172.21.15.172:6839/3850440096] conn(0x560865beecf0 0x560865bf1100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:21:10.484 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:21:10.421+0000 7f452affd700 1 --2- 172.21.15.163:0/659747839 >> [v2:172.21.15.172:6838/3850440096,v1:172.21.15.172:6839/3850440096] conn(0x560865beecf0 0x560865bf1100 crc :-1 s=READY pgs=92 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=128588a32f853cc4 server_cookie=46be79396b18c649 in_seq=0 out_seq=0 2023-07-14T18:21:10.484 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:21:10.421+0000 7f450eff5700 10 client.26050 ms_handle_connect on v2:172.21.15.172:6838/3850440096 2023-07-14T18:21:10.484 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:21:10.421+0000 7f450eff5700 1 -- 172.21.15.163:0/659747839 <== mds.0 v2:172.21.15.172:6838/3850440096 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x560865aceeb0 con 0x560865beecf0 2023-07-14T18:21:10.484 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:21:10.421+0000 7f450eff5700 10 client.26050 handle_command_reply: tid=0 2023-07-14T18:21:10.485 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:21:10.421+0000 7f453d5d5b80 1 client.26050 shutdown 2023-07-14T18:21:10.485 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:21:10.421+0000 7f453d5d5b80 1 -- 172.21.15.163:0/659747839 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x560865b858b0 msgr2=0x560865b92270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:21:10.485 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:21:10.421+0000 7f453d5d5b80 1 --2- 172.21.15.163:0/659747839 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x560865b858b0 0x560865b92270 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x560865b8dab0 tx=0x7f4520009ca0 comp rx=0 tx=0).stop 2023-07-14T18:21:10.485 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:21:10.421+0000 7f453d5d5b80 1 -- 172.21.15.163:0/659747839 shutdown_connections 2023-07-14T18:21:10.485 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:21:10.421+0000 7f453d5d5b80 1 --2- 172.21.15.163:0/659747839 >> [v2:172.21.15.172:6838/3850440096,v1:172.21.15.172:6839/3850440096] conn(0x560865beecf0 0x560865bf1100 crc :-1 s=READY pgs=92 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:21:10.486 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:21:10.421+0000 7f453d5d5b80 1 --2- 172.21.15.163:0/659747839 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x560865b864b0 0x560865b94fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:21:10.486 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:21:10.421+0000 7f453d5d5b80 1 --2- 172.21.15.163:0/659747839 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560865b84f60 0x560865b91cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:21:10.486 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:21:10.421+0000 7f450eff5700 0 client.26050 ms_handle_reset on v2:172.21.15.172:6838/3850440096 2023-07-14T18:21:10.486 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:21:10.421+0000 7f453d5d5b80 1 --2- 172.21.15.163:0/659747839 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x560865b858b0 0x560865b92270 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:21:10.486 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:21:10.421+0000 7f453d5d5b80 1 -- 172.21.15.163:0/659747839 >> 172.21.15.163:0/659747839 conn(0x560865b7a680 msgr2=0x560865b89330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:21:10.487 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:21:10.422+0000 7f453d5d5b80 1 -- 172.21.15.163:0/659747839 shutdown_connections 2023-07-14T18:21:10.487 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:21:10.422+0000 7f453d5d5b80 1 -- 172.21.15.163:0/659747839 wait complete. 2023-07-14T18:21:10.487 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:21:10.422+0000 7f453d5d5b80 20 client.26050 trim_cache size 0 max 16384 2023-07-14T18:21:10.487 INFO:teuthology.orchestra.run.smithi163.stdout:{ 2023-07-14T18:21:10.488 INFO:teuthology.orchestra.run.smithi163.stdout: "status": "IDLE (waiting for more scrubs)", 2023-07-14T18:21:10.488 INFO:teuthology.orchestra.run.smithi163.stdout: "scrubs": { 2023-07-14T18:21:10.488 INFO:teuthology.orchestra.run.smithi163.stdout: "2c53b7ef-6f30-49f0-a60d-f1f114c19d42": { 2023-07-14T18:21:10.488 INFO:teuthology.orchestra.run.smithi163.stdout: "path": "/", 2023-07-14T18:21:10.488 INFO:teuthology.orchestra.run.smithi163.stdout: "tag": "2c53b7ef-6f30-49f0-a60d-f1f114c19d42", 2023-07-14T18:21:10.489 INFO:teuthology.orchestra.run.smithi163.stdout: "options": "recursive,force" 2023-07-14T18:21:10.489 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-07-14T18:21:10.489 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-07-14T18:21:10.489 INFO:teuthology.orchestra.run.smithi163.stdout:} 2023-07-14T18:21:10.490 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:21:10.422+0000 7f453143d700 1 -- 172.21.15.163:0/1433598412 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f45140a1150 msgr2=0x7f45140a3600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:21:10.491 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:21:10.422+0000 7f453143d700 1 --2- 172.21.15.163:0/1433598412 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f45140a1150 0x7f45140a3600 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f451c009df0 tx=0x7f451c009260 comp rx=0 tx=0).stop 2023-07-14T18:21:10.491 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:21:10.422+0000 7f453143d700 1 -- 172.21.15.163:0/1433598412 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f452c103010 msgr2=0x7f452c197fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:21:10.491 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:21:10.422+0000 7f453143d700 1 --2- 172.21.15.163:0/1433598412 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f452c103010 0x7f452c197fb0 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7f45200059d0 tx=0x7f45200047b0 comp rx=0 tx=0).stop 2023-07-14T18:21:10.491 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:21:10.422+0000 7f453143d700 1 -- 172.21.15.163:0/1433598412 shutdown_connections 2023-07-14T18:21:10.491 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:21:10.422+0000 7f453143d700 1 --2- 172.21.15.163:0/1433598412 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f45140a1150 0x7f45140a3600 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:21:10.492 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:21:10.422+0000 7f453143d700 1 --2- 172.21.15.163:0/1433598412 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f452c1006f0 0x7f452c197a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:21:10.492 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:21:10.422+0000 7f453143d700 1 --2- 172.21.15.163:0/1433598412 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f452c105930 0x7f452c19f020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:21:10.492 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:21:10.422+0000 7f453143d700 1 --2- 172.21.15.163:0/1433598412 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f452c103010 0x7f452c197fb0 unknown :-1 s=CLOSED pgs=705 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:21:10.492 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:21:10.422+0000 7f453143d700 1 -- 172.21.15.163:0/1433598412 >> 172.21.15.163:0/1433598412 conn(0x7f452c0fa130 msgr2=0x7f452c101350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:21:10.492 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:21:10.422+0000 7f453143d700 1 -- 172.21.15.163:0/1433598412 shutdown_connections 2023-07-14T18:21:10.493 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:21:10.422+0000 7f453143d700 1 -- 172.21.15.163:0/1433598412 wait complete. 2023-07-14T18:21:10.493 INFO:tasks.cephfs.filesystem:scrub status for tag:2c53b7ef-6f30-49f0-a60d-f1f114c19d42 - {'path': '/', 'tag': '2c53b7ef-6f30-49f0-a60d-f1f114c19d42', 'options': 'recursive,force'} 2023-07-14T18:21:10.933 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:21:10 smithi184 ceph-mon[98481]: pgmap v555: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-07-14T18:21:10.976 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:21:10 smithi163 ceph-mon[96576]: pgmap v555: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-07-14T18:21:11.034 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:21:10 smithi172 ceph-mon[97983]: pgmap v555: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-07-14T18:21:12.226 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:21:11 smithi163 ceph-mon[96576]: pgmap v556: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-07-14T18:21:12.284 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:21:11 smithi172 ceph-mon[97983]: pgmap v556: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-07-14T18:21:12.433 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:21:11 smithi184 ceph-mon[98481]: pgmap v556: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-07-14T18:21:14.934 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:21:14 smithi184 ceph-mon[98481]: pgmap v557: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-07-14T18:21:14.976 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:21:14 smithi163 ceph-mon[96576]: pgmap v557: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-07-14T18:21:15.035 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:21:14 smithi172 ceph-mon[97983]: pgmap v557: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-07-14T18:21:16.934 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:21:16 smithi184 ceph-mon[98481]: pgmap v558: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-07-14T18:21:16.976 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:21:16 smithi163 ceph-mon[96576]: pgmap v558: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-07-14T18:21:17.034 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:21:16 smithi172 ceph-mon[97983]: pgmap v558: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-07-14T18:21:18.934 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:21:18 smithi184 ceph-mon[98481]: pgmap v559: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-07-14T18:21:18.976 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:21:18 smithi163 ceph-mon[96576]: pgmap v559: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-07-14T18:21:19.034 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:21:18 smithi172 ceph-mon[97983]: pgmap v559: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-07-14T18:21:20.934 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:21:20 smithi184 ceph-mon[98481]: pgmap v560: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-07-14T18:21:20.976 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:21:20 smithi163 ceph-mon[96576]: pgmap v560: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-07-14T18:21:21.034 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:21:20 smithi172 ceph-mon[97983]: pgmap v560: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-07-14T18:21:22.226 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:21:21 smithi163 ceph-mon[96576]: pgmap v561: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-07-14T18:21:22.285 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:21:21 smithi172 ceph-mon[97983]: pgmap v561: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-07-14T18:21:22.434 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:21:21 smithi184 ceph-mon[98481]: pgmap v561: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-07-14T18:21:24.934 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:21:24 smithi184 ceph-mon[98481]: pgmap v562: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-07-14T18:21:24.976 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:21:24 smithi163 ceph-mon[96576]: pgmap v562: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-07-14T18:21:25.035 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:21:24 smithi172 ceph-mon[97983]: pgmap v562: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-07-14T18:21:25.934 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:21:25 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-14T18:21:25.934 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:21:25 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-07-14T18:21:25.934 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:21:25 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-07-14T18:21:25.935 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:21:25 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-07-14T18:21:25.935 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:21:25 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-07-14T18:21:25.935 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:21:25 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T18:21:25.935 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:21:25 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-14T18:21:25.935 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:21:25 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:21:25.976 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:21:25 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-14T18:21:25.977 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:21:25 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-07-14T18:21:25.977 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:21:25 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-07-14T18:21:25.977 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:21:25 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-07-14T18:21:25.977 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:21:25 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-07-14T18:21:25.977 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:21:25 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T18:21:25.978 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:21:25 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-14T18:21:25.978 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:21:25 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:21:26.035 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:21:25 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-14T18:21:26.035 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:21:25 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-07-14T18:21:26.036 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:21:25 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-07-14T18:21:26.036 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:21:25 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-07-14T18:21:26.036 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:21:25 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-07-14T18:21:26.036 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:21:25 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T18:21:26.037 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:21:25 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-14T18:21:26.037 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:21:25 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:21:26.934 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:21:26 smithi184 ceph-mon[98481]: Adjusting osd_memory_target on smithi184 to 196.2M 2023-07-14T18:21:26.934 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:21:26 smithi184 ceph-mon[98481]: Unable to set osd_memory_target on smithi184 to 205773209: error parsing value: Value '205773209' is below minimum 939524096 2023-07-14T18:21:26.934 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:21:26 smithi184 ceph-mon[98481]: pgmap v563: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-07-14T18:21:26.976 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:21:26 smithi163 ceph-mon[96576]: Adjusting osd_memory_target on smithi184 to 196.2M 2023-07-14T18:21:26.977 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:21:26 smithi163 ceph-mon[96576]: Unable to set osd_memory_target on smithi184 to 205773209: error parsing value: Value '205773209' is below minimum 939524096 2023-07-14T18:21:26.977 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:21:26 smithi163 ceph-mon[96576]: pgmap v563: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-07-14T18:21:27.035 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:21:26 smithi172 ceph-mon[97983]: Adjusting osd_memory_target on smithi184 to 196.2M 2023-07-14T18:21:27.035 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:21:26 smithi172 ceph-mon[97983]: Unable to set osd_memory_target on smithi184 to 205773209: error parsing value: Value '205773209' is below minimum 939524096 2023-07-14T18:21:27.035 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:21:26 smithi172 ceph-mon[97983]: pgmap v563: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-07-14T18:21:28.934 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:21:28 smithi184 ceph-mon[98481]: pgmap v564: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-07-14T18:21:28.976 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:21:28 smithi163 ceph-mon[96576]: pgmap v564: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-07-14T18:21:29.034 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:21:28 smithi172 ceph-mon[97983]: pgmap v564: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-07-14T18:21:30.934 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:21:30 smithi184 ceph-mon[98481]: pgmap v565: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-07-14T18:21:30.976 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:21:30 smithi163 ceph-mon[96576]: pgmap v565: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-07-14T18:21:31.035 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:21:30 smithi172 ceph-mon[97983]: pgmap v565: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-07-14T18:21:32.226 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:21:31 smithi163 ceph-mon[96576]: pgmap v566: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-07-14T18:21:32.285 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:21:31 smithi172 ceph-mon[97983]: pgmap v566: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-07-14T18:21:32.434 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:21:31 smithi184 ceph-mon[98481]: pgmap v566: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-07-14T18:21:34.934 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:21:34 smithi184 ceph-mon[98481]: pgmap v567: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-07-14T18:21:34.976 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:21:34 smithi163 ceph-mon[96576]: pgmap v567: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-07-14T18:21:35.035 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:21:34 smithi172 ceph-mon[97983]: pgmap v567: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-07-14T18:21:36.934 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:21:36 smithi184 ceph-mon[98481]: pgmap v568: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-07-14T18:21:36.976 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:21:36 smithi163 ceph-mon[96576]: pgmap v568: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-07-14T18:21:37.035 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:21:36 smithi172 ceph-mon[97983]: pgmap v568: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-07-14T18:21:38.935 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:21:38 smithi184 ceph-mon[98481]: pgmap v569: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-07-14T18:21:38.976 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:21:38 smithi163 ceph-mon[96576]: pgmap v569: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-07-14T18:21:39.035 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:21:38 smithi172 ceph-mon[97983]: pgmap v569: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-07-14T18:21:40.495 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-07-14T18:21:40.643 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:21:40.592+0000 7fead24dc700 1 -- 172.21.15.163:0/1603744126 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7feacc0ffd40 msgr2=0x7feacc100190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:21:40.643 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:21:40.592+0000 7fead24dc700 1 --2- 172.21.15.163:0/1603744126 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7feacc0ffd40 0x7feacc100190 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7feab4009990 tx=0x7feab4009ca0 comp rx=0 tx=0).stop 2023-07-14T18:21:40.644 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:21:40.592+0000 7fead24dc700 1 -- 172.21.15.163:0/1603744126 shutdown_connections 2023-07-14T18:21:40.644 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:21:40.592+0000 7fead24dc700 1 --2- 172.21.15.163:0/1603744126 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7feacc1006d0 0x7feacc106f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:21:40.644 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:21:40.592+0000 7fead24dc700 1 --2- 172.21.15.163:0/1603744126 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7feacc0feb50 0x7feacc0fef60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:21:40.644 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:21:40.592+0000 7fead24dc700 1 --2- 172.21.15.163:0/1603744126 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7feacc0ffd40 0x7feacc100190 unknown :-1 s=CLOSED pgs=708 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:21:40.644 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:21:40.592+0000 7fead24dc700 1 -- 172.21.15.163:0/1603744126 >> 172.21.15.163:0/1603744126 conn(0x7feacc0fa150 msgr2=0x7feacc0fc5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:21:40.645 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:21:40.592+0000 7fead24dc700 1 -- 172.21.15.163:0/1603744126 shutdown_connections 2023-07-14T18:21:40.645 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:21:40.592+0000 7fead24dc700 1 -- 172.21.15.163:0/1603744126 wait complete. 2023-07-14T18:21:40.646 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:21:40.593+0000 7fead24dc700 1 Processor -- start 2023-07-14T18:21:40.647 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:21:40.593+0000 7fead24dc700 1 -- start start 2023-07-14T18:21:40.647 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:21:40.594+0000 7fead24dc700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7feacc0feb50 0x7feacc069280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:21:40.647 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:21:40.594+0000 7fead24dc700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7feacc0ffd40 0x7feacc19a5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:21:40.647 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:21:40.594+0000 7fead24dc700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7feacc1006d0 0x7feacc19cbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:21:40.648 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:21:40.594+0000 7fead24dc700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feacc19d390 con 0x7feacc1006d0 2023-07-14T18:21:40.648 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:21:40.594+0000 7fead24dc700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feacc19d500 con 0x7feacc0ffd40 2023-07-14T18:21:40.648 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:21:40.594+0000 7fead24dc700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feacc19d6c0 con 0x7feacc0feb50 2023-07-14T18:21:40.648 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:21:40.594+0000 7feacbfff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7feacc0feb50 0x7feacc069280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:21:40.648 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:21:40.594+0000 7fead0a79700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7feacc1006d0 0x7feacc19cbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:21:40.649 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:21:40.594+0000 7feacbfff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7feacc0feb50 0x7feacc069280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.163:41846/0 (socket says 172.21.15.163:41846) 2023-07-14T18:21:40.649 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:21:40.594+0000 7feacbfff700 1 -- 172.21.15.163:0/3196677044 learned_addr learned my addr 172.21.15.163:0/3196677044 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:21:40.649 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:21:40.594+0000 7fead0a79700 1 -- 172.21.15.163:0/3196677044 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7feacc0feb50 msgr2=0x7feacc069280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:21:40.649 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:21:40.594+0000 7feac3fff700 1 --2- 172.21.15.163:0/3196677044 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7feacc0ffd40 0x7feacc19a5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:21:40.649 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:21:40.594+0000 7fead0a79700 1 --2- 172.21.15.163:0/3196677044 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7feacc0feb50 0x7feacc069280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:21:40.650 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:21:40.594+0000 7fead0a79700 1 -- 172.21.15.163:0/3196677044 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7feacc0ffd40 msgr2=0x7feacc19a5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:21:40.650 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:21:40.594+0000 7fead0a79700 1 --2- 172.21.15.163:0/3196677044 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7feacc0ffd40 0x7feacc19a5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:21:40.650 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:21:40.594+0000 7fead0a79700 1 -- 172.21.15.163:0/3196677044 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feab40095f0 con 0x7feacc1006d0 2023-07-14T18:21:40.650 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:21:40.594+0000 7feacbfff700 1 --2- 172.21.15.163:0/3196677044 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7feacc0feb50 0x7feacc069280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T18:21:40.650 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:21:40.594+0000 7feac3fff700 1 --2- 172.21.15.163:0/3196677044 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7feacc0ffd40 0x7feacc19a5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-14T18:21:40.651 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:21:40.594+0000 7fead0a79700 1 --2- 172.21.15.163:0/3196677044 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7feacc1006d0 0x7feacc19cbf0 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7feac400efc0 tx=0x7feac400c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:21:40.651 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:21:40.594+0000 7feac9ffb700 1 -- 172.21.15.163:0/3196677044 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feac4018070 con 0x7feacc1006d0 2023-07-14T18:21:40.651 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:21:40.595+0000 7feac9ffb700 1 -- 172.21.15.163:0/3196677044 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7feac400f040 con 0x7feacc1006d0 2023-07-14T18:21:40.651 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:21:40.595+0000 7fead24dc700 1 -- 172.21.15.163:0/3196677044 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feacc19d940 con 0x7feacc1006d0 2023-07-14T18:21:40.651 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:21:40.595+0000 7feac9ffb700 1 -- 172.21.15.163:0/3196677044 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feac400cc50 con 0x7feacc1006d0 2023-07-14T18:21:40.651 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:21:40.595+0000 7fead24dc700 1 -- 172.21.15.163:0/3196677044 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feacc19de00 con 0x7feacc1006d0 2023-07-14T18:21:40.658 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:21:40.597+0000 7feac9ffb700 1 -- 172.21.15.163:0/3196677044 <== mon.0 v2:172.21.15.163:3300/0 4 ==== mgrmap(e 18) v1 ==== 135716+0+0 (secure 0 0 0) 0x7feac4003a00 con 0x7feacc1006d0 2023-07-14T18:21:40.658 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:21:40.598+0000 7feac9ffb700 1 --2- 172.21.15.163:0/3196677044 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7feab80a1150 0x7feab80a3600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:21:40.659 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:21:40.598+0000 7feacbfff700 1 --2- 172.21.15.163:0/3196677044 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7feab80a1150 0x7feab80a3600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:21:40.659 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:21:40.598+0000 7feac9ffb700 1 -- 172.21.15.163:0/3196677044 <== mon.0 v2:172.21.15.163:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 9049+0+0 (secure 0 0 0) 0x7feac40cc7f0 con 0x7feacc1006d0 2023-07-14T18:21:40.660 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:21:40.598+0000 7feacbfff700 1 --2- 172.21.15.163:0/3196677044 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7feab80a1150 0x7feab80a3600 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7feabc005950 tx=0x7feabc009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:21:40.660 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:21:40.599+0000 7feade674b80 1 Processor -- start 2023-07-14T18:21:40.661 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:21:40.599+0000 7feade674b80 1 -- start start 2023-07-14T18:21:40.661 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:21:40.599+0000 7feade674b80 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55da6cd41f60 0x55da6cd42370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:21:40.662 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:21:40.599+0000 7feade674b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55da6cd428b0 0x55da6cd42ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:21:40.662 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:21:40.599+0000 7feade674b80 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55da6cd434b0 0x55da6cd43920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:21:40.662 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:21:40.599+0000 7feade674b80 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x55da6cc46cb0 con 0x55da6cd41f60 2023-07-14T18:21:40.663 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:21:40.599+0000 7feade674b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x55da6cc99a40 con 0x55da6cd428b0 2023-07-14T18:21:40.663 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:21:40.599+0000 7feade674b80 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x55da6cc92ed0 con 0x55da6cd434b0 2023-07-14T18:21:40.663 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:21:40.599+0000 7feacbfff700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55da6cd41f60 0x55da6cd42370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:21:40.663 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:21:40.599+0000 7feacbfff700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55da6cd41f60 0x55da6cd42370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:60032/0 (socket says 172.21.15.163:60032) 2023-07-14T18:21:40.664 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:21:40.599+0000 7feacbfff700 1 -- 172.21.15.163:0/4060842183 learned_addr learned my addr 172.21.15.163:0/4060842183 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:21:40.664 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:21:40.599+0000 7feac3fff700 1 --2- 172.21.15.163:0/4060842183 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55da6cd428b0 0x55da6cd42ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:21:40.665 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:21:40.599+0000 7fead0a79700 1 --2- 172.21.15.163:0/4060842183 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55da6cd434b0 0x55da6cd43920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:21:40.665 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:21:40.599+0000 7feacbfff700 1 -- 172.21.15.163:0/4060842183 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55da6cd434b0 msgr2=0x55da6cd43920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:21:40.665 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:21:40.599+0000 7feacbfff700 1 --2- 172.21.15.163:0/4060842183 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55da6cd434b0 0x55da6cd43920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:21:40.666 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:21:40.599+0000 7feacbfff700 1 -- 172.21.15.163:0/4060842183 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55da6cd428b0 msgr2=0x55da6cd42ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:21:40.666 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:21:40.599+0000 7feacbfff700 1 --2- 172.21.15.163:0/4060842183 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55da6cd428b0 0x55da6cd42ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:21:40.666 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:21:40.599+0000 7feacbfff700 1 -- 172.21.15.163:0/4060842183 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55da6cac0de0 con 0x55da6cd41f60 2023-07-14T18:21:40.666 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:21:40.599+0000 7fead0a79700 1 --2- 172.21.15.163:0/4060842183 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55da6cd434b0 0x55da6cd43920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T18:21:40.666 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:21:40.599+0000 7feac3fff700 1 --2- 172.21.15.163:0/4060842183 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55da6cd428b0 0x55da6cd42ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T18:21:40.667 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:21:40.599+0000 7feacbfff700 1 --2- 172.21.15.163:0/4060842183 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55da6cd41f60 0x55da6cd42370 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7feabc009880 tx=0x7feabc014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ec627f0cbba4d12 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:21:40.667 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:21:40.600+0000 7feac27fc700 1 -- 172.21.15.163:0/4060842183 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feabc004a30 con 0x55da6cd41f60 2023-07-14T18:21:40.667 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:21:40.600+0000 7feac27fc700 1 -- 172.21.15.163:0/4060842183 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7feabc021070 con 0x55da6cd41f60 2023-07-14T18:21:40.667 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:21:40.600+0000 7feac27fc700 1 -- 172.21.15.163:0/4060842183 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feabc004ea0 con 0x55da6cd41f60 2023-07-14T18:21:40.667 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:21:40.600+0000 7feade674b80 1 -- 172.21.15.163:0/4060842183 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55da6cd41f60 msgr2=0x55da6cd42370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:21:40.668 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:21:40.600+0000 7feade674b80 1 --2- 172.21.15.163:0/4060842183 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55da6cd41f60 0x55da6cd42370 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7feabc009880 tx=0x7feabc014000 comp rx=0 tx=0).stop 2023-07-14T18:21:40.668 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:21:40.601+0000 7feade674b80 1 -- 172.21.15.163:0/4060842183 shutdown_connections 2023-07-14T18:21:40.668 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:21:40.601+0000 7feade674b80 1 --2- 172.21.15.163:0/4060842183 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55da6cd434b0 0x55da6cd43920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:21:40.668 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:21:40.601+0000 7feade674b80 1 --2- 172.21.15.163:0/4060842183 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55da6cd41f60 0x55da6cd42370 unknown :-1 s=CLOSED pgs=710 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:21:40.668 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:21:40.601+0000 7feade674b80 1 --2- 172.21.15.163:0/4060842183 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55da6cd428b0 0x55da6cd42ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:21:40.669 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:21:40.601+0000 7feade674b80 1 -- 172.21.15.163:0/4060842183 >> 172.21.15.163:0/4060842183 conn(0x55da6cd37680 msgr2=0x55da6cd3c9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:21:40.669 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:21:40.601+0000 7feade674b80 1 -- 172.21.15.163:0/4060842183 shutdown_connections 2023-07-14T18:21:40.669 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:21:40.601+0000 7feade674b80 1 -- 172.21.15.163:0/4060842183 wait complete. 2023-07-14T18:21:40.669 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:21:40.601+0000 7feade674b80 1 -- start start 2023-07-14T18:21:40.669 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:21:40.601+0000 7feade674b80 1 Processor -- start 2023-07-14T18:21:40.670 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:21:40.602+0000 7feade674b80 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55da6cd41f60 0x55da6cd4ba00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:21:40.670 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:21:40.602+0000 7feade674b80 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55da6cd428b0 0x55da6cd4bf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:21:40.670 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:21:40.602+0000 7feade674b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55da6cd434b0 0x55da6cd52f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:21:40.670 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:21:40.602+0000 7feade674b80 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x55da6cc32ac0 con 0x55da6cd428b0 2023-07-14T18:21:40.670 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:21:40.602+0000 7feade674b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x55da6cc327c0 con 0x55da6cd434b0 2023-07-14T18:21:40.671 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:21:40.602+0000 7feade674b80 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x55da6cb16920 con 0x55da6cd41f60 2023-07-14T18:21:40.671 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:21:40.602+0000 7feade674b80 10 client.0 _ll_register_callbacks cb 0x55da6cc30760 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T18:21:40.671 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:21:40.602+0000 7feac3fff700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55da6cd428b0 0x55da6cd4bf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:21:40.671 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:21:40.602+0000 7feacbfff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55da6cd41f60 0x55da6cd4ba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:21:40.671 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:21:40.602+0000 7feac3fff700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55da6cd428b0 0x55da6cd4bf40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:60040/0 (socket says 172.21.15.163:60040) 2023-07-14T18:21:40.671 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:21:40.602+0000 7feac3fff700 1 -- 172.21.15.163:0/3773641040 learned_addr learned my addr 172.21.15.163:0/3773641040 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:21:40.672 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:21:40.602+0000 7fead0a79700 1 --2- 172.21.15.163:0/3773641040 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55da6cd434b0 0x55da6cd52f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:21:40.672 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:21:40.602+0000 7feacbfff700 1 -- 172.21.15.163:0/3773641040 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55da6cd434b0 msgr2=0x55da6cd52f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:21:40.672 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:21:40.602+0000 7feacbfff700 1 --2- 172.21.15.163:0/3773641040 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55da6cd434b0 0x55da6cd52f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:21:40.672 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:21:40.602+0000 7feacbfff700 1 -- 172.21.15.163:0/3773641040 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55da6cd428b0 msgr2=0x55da6cd4bf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:21:40.673 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:21:40.602+0000 7feacbfff700 1 --2- 172.21.15.163:0/3773641040 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55da6cd428b0 0x55da6cd4bf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:21:40.673 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:21:40.602+0000 7feacbfff700 1 -- 172.21.15.163:0/3773641040 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feacc1078c0 con 0x55da6cd41f60 2023-07-14T18:21:40.673 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:21:40.602+0000 7feac3fff700 1 --2- 172.21.15.163:0/3773641040 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55da6cd428b0 0x55da6cd4bf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T18:21:40.673 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:21:40.602+0000 7feacbfff700 1 --2- 172.21.15.163:0/3773641040 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55da6cd41f60 0x55da6cd4ba00 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7feabc011c70 tx=0x7feabc00ef50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cc82fad2243958f8 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:21:40.673 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:21:40.602+0000 7feaab7fe700 10 client.0 ms_handle_connect on v2:172.21.15.184:3300/0 2023-07-14T18:21:40.674 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:21:40.603+0000 7feaab7fe700 1 -- 172.21.15.163:0/3773641040 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feabc01c590 con 0x55da6cd41f60 2023-07-14T18:21:40.674 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:21:40.603+0000 7feade674b80 1 -- 172.21.15.163:0/3773641040 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55da6cbec4f0 con 0x55da6cd41f60 2023-07-14T18:21:40.674 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:21:40.603+0000 7feaab7fe700 1 -- 172.21.15.163:0/3773641040 <== mon.1 v2:172.21.15.184:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 9049+0+0 (secure 0 0 0) 0x7feabc004e40 con 0x55da6cd41f60 2023-07-14T18:21:40.674 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:21:40.603+0000 7feaab7fe700 1 -- 172.21.15.163:0/3773641040 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) v2 ==== 24+0+0 (secure 0 0 0) 0x7feabc005000 con 0x55da6cd41f60 2023-07-14T18:21:40.674 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:21:40.603+0000 7feade674b80 10 client.26062 fetch_fsmap learned FSMap version 39 2023-07-14T18:21:40.674 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:21:40.603+0000 7feade674b80 1 -- 172.21.15.163:0/3773641040 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) v3 -- 0x7feacc19de00 con 0x55da6cd41f60 2023-07-14T18:21:40.675 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:21:40.603+0000 7feaab7fe700 1 -- 172.21.15.163:0/3773641040 <== mon.1 v2:172.21.15.184:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7feabc039080 con 0x55da6cd41f60 2023-07-14T18:21:40.675 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:21:40.603+0000 7feaab7fe700 1 -- 172.21.15.163:0/3773641040 <== mon.1 v2:172.21.15.184:3300/0 5 ==== fsmap(e 39) v1 ==== 7470+0+0 (secure 0 0 0) 0x7feabc01c860 con 0x55da6cd41f60 2023-07-14T18:21:40.675 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:21:40.603+0000 7feade674b80 10 client.26062 fetch_fsmap finished waiting for FSMap version 39 2023-07-14T18:21:40.675 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:21:40.603+0000 7feade674b80 10 client.26062 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-07-14T18:21:40.675 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:21:40.603+0000 7feade674b80 20 client.26062 populate_metadata read hostname 'smithi163' 2023-07-14T18:21:40.676 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:21:40.603+0000 7feade674b80 1 --2- 172.21.15.163:0/3773641040 >> [v2:172.21.15.172:6838/3850440096,v1:172.21.15.172:6839/3850440096] conn(0x55da6cd57670 0x55da6cd59a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:21:40.676 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:21:40.603+0000 7feade674b80 4 client.26062 mds_command: new command op to 24518 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-14T18:21:40.676 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:21:40.603+0000 7feade674b80 1 -- 172.21.15.163:0/3773641040 --> [v2:172.21.15.172:6838/3850440096,v1:172.21.15.172:6839/3850440096] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55da6cd10da0 con 0x55da6cd57670 2023-07-14T18:21:40.676 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:21:40.603+0000 7feac3fff700 1 --2- 172.21.15.163:0/3773641040 >> [v2:172.21.15.172:6838/3850440096,v1:172.21.15.172:6839/3850440096] conn(0x55da6cd57670 0x55da6cd59a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:21:40.676 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:21:40.604+0000 7feaab7fe700 10 client.26062 ms_handle_connect on v2:172.21.15.172:6838/3850440096 2023-07-14T18:21:40.677 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:21:40.604+0000 7feac3fff700 1 --2- 172.21.15.163:0/3773641040 >> [v2:172.21.15.172:6838/3850440096,v1:172.21.15.172:6839/3850440096] conn(0x55da6cd57670 0x55da6cd59a80 crc :-1 s=READY pgs=93 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fc670527ad6eca9a server_cookie=9fe59c30b74ea8b9 in_seq=0 out_seq=0 2023-07-14T18:21:40.677 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:21:40.605+0000 7feaab7fe700 1 -- 172.21.15.163:0/3773641040 <== mds.0 v2:172.21.15.172:6838/3850440096 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18017 (crc 0 0 0) 0x55da6cd10da0 con 0x55da6cd57670 2023-07-14T18:21:40.677 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:21:40.605+0000 7feaab7fe700 10 client.26062 handle_command_reply: tid=0 2023-07-14T18:21:40.677 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:21:40.605+0000 7feade674b80 1 client.26062 shutdown 2023-07-14T18:21:40.678 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:21:40.605+0000 7feade674b80 1 -- 172.21.15.163:0/3773641040 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55da6cd41f60 msgr2=0x55da6cd4ba00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:21:40.678 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:21:40.605+0000 7feade674b80 1 --2- 172.21.15.163:0/3773641040 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55da6cd41f60 0x55da6cd4ba00 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7feabc011c70 tx=0x7feabc00ef50 comp rx=0 tx=0).stop 2023-07-14T18:21:40.678 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:21:40.605+0000 7feade674b80 1 -- 172.21.15.163:0/3773641040 shutdown_connections 2023-07-14T18:21:40.678 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:21:40.605+0000 7feade674b80 1 --2- 172.21.15.163:0/3773641040 >> [v2:172.21.15.172:6838/3850440096,v1:172.21.15.172:6839/3850440096] conn(0x55da6cd57670 0x55da6cd59a80 crc :-1 s=READY pgs=93 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:21:40.678 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:21:40.605+0000 7feade674b80 1 --2- 172.21.15.163:0/3773641040 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55da6cd41f60 0x55da6cd4ba00 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:21:40.679 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:21:40.605+0000 7feaab7fe700 0 client.26062 ms_handle_reset on v2:172.21.15.172:6838/3850440096 2023-07-14T18:21:40.679 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:21:40.605+0000 7feade674b80 1 --2- 172.21.15.163:0/3773641040 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55da6cd434b0 0x55da6cd52f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:21:40.679 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:21:40.605+0000 7feade674b80 1 --2- 172.21.15.163:0/3773641040 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55da6cd428b0 0x55da6cd4bf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:21:40.679 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:21:40.605+0000 7feade674b80 1 -- 172.21.15.163:0/3773641040 >> 172.21.15.163:0/3773641040 conn(0x55da6cd37680 msgr2=0x55da6cd3b650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:21:40.679 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:21:40.605+0000 7feade674b80 1 -- 172.21.15.163:0/3773641040 shutdown_connections 2023-07-14T18:21:40.680 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:21:40.605+0000 7feade674b80 1 -- 172.21.15.163:0/3773641040 wait complete. 2023-07-14T18:21:40.680 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:21:40.605+0000 7feade674b80 20 client.26062 trim_cache size 0 max 16384 2023-07-14T18:21:40.683 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:21:40.628+0000 7feade674b80 1 Processor -- start 2023-07-14T18:21:40.683 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:21:40.628+0000 7feade674b80 1 -- start start 2023-07-14T18:21:40.683 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:21:40.628+0000 7feade674b80 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55da6cd41f60 0x55da6cd4b0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:21:40.683 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:21:40.628+0000 7feade674b80 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55da6cd428b0 0x55da6cd52f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:21:40.684 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:21:40.628+0000 7feade674b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55da6cd434b0 0x55da6cd496a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:21:40.684 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:21:40.628+0000 7feade674b80 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x55da6cd3e500 con 0x55da6cd428b0 2023-07-14T18:21:40.684 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:21:40.628+0000 7feade674b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x55da6cd4aeb0 con 0x55da6cd434b0 2023-07-14T18:21:40.684 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:21:40.628+0000 7feade674b80 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x55da6cd57490 con 0x55da6cd41f60 2023-07-14T18:21:40.684 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:21:40.629+0000 7feac3fff700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55da6cd428b0 0x55da6cd52f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:21:40.685 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:21:40.629+0000 7feacbfff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55da6cd41f60 0x55da6cd4b0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:21:40.685 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:21:40.629+0000 7feac3fff700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55da6cd428b0 0x55da6cd52f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:60048/0 (socket says 172.21.15.163:60048) 2023-07-14T18:21:40.685 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:21:40.629+0000 7feac3fff700 1 -- 172.21.15.163:0/3839518475 learned_addr learned my addr 172.21.15.163:0/3839518475 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:21:40.685 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:21:40.629+0000 7fead0a79700 1 --2- 172.21.15.163:0/3839518475 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55da6cd434b0 0x55da6cd496a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:21:40.685 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:21:40.629+0000 7feac3fff700 1 -- 172.21.15.163:0/3839518475 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55da6cd41f60 msgr2=0x55da6cd4b0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:21:40.686 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:21:40.629+0000 7feac3fff700 1 --2- 172.21.15.163:0/3839518475 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55da6cd41f60 0x55da6cd4b0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:21:40.686 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:21:40.629+0000 7feac3fff700 1 -- 172.21.15.163:0/3839518475 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55da6cd434b0 msgr2=0x55da6cd496a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:21:40.686 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:21:40.629+0000 7feac3fff700 1 --2- 172.21.15.163:0/3839518475 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55da6cd434b0 0x55da6cd496a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:21:40.686 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:21:40.629+0000 7feac3fff700 1 -- 172.21.15.163:0/3839518475 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feabc017070 con 0x55da6cd428b0 2023-07-14T18:21:40.686 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:21:40.629+0000 7fead0a79700 1 --2- 172.21.15.163:0/3839518475 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55da6cd434b0 0x55da6cd496a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T18:21:40.687 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:21:40.629+0000 7feac3fff700 1 --2- 172.21.15.163:0/3839518475 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55da6cd428b0 0x55da6cd52f40 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7feab4000c00 tx=0x7feab4005a90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb39d7e4b8366b07 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:21:40.687 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:21:40.629+0000 7feac2ffd700 1 -- 172.21.15.163:0/3839518475 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feab401e040 con 0x55da6cd428b0 2023-07-14T18:21:40.687 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:21:40.629+0000 7feac2ffd700 1 -- 172.21.15.163:0/3839518475 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7feab401f040 con 0x55da6cd428b0 2023-07-14T18:21:40.687 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:21:40.629+0000 7feac2ffd700 1 -- 172.21.15.163:0/3839518475 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feab400b910 con 0x55da6cd428b0 2023-07-14T18:21:40.687 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:21:40.630+0000 7feade674b80 1 -- 172.21.15.163:0/3839518475 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55da6cd428b0 msgr2=0x55da6cd52f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:21:40.687 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:21:40.630+0000 7feade674b80 1 --2- 172.21.15.163:0/3839518475 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55da6cd428b0 0x55da6cd52f40 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7feab4000c00 tx=0x7feab4005a90 comp rx=0 tx=0).stop 2023-07-14T18:21:40.688 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:21:40.630+0000 7feade674b80 1 -- 172.21.15.163:0/3839518475 shutdown_connections 2023-07-14T18:21:40.688 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:21:40.630+0000 7feade674b80 1 --2- 172.21.15.163:0/3839518475 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55da6cd41f60 0x55da6cd4b0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:21:40.688 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:21:40.630+0000 7feade674b80 1 --2- 172.21.15.163:0/3839518475 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55da6cd434b0 0x55da6cd496a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:21:40.688 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:21:40.630+0000 7feade674b80 1 --2- 172.21.15.163:0/3839518475 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55da6cd428b0 0x55da6cd52f40 unknown :-1 s=CLOSED pgs=711 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:21:40.689 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:21:40.630+0000 7feade674b80 1 -- 172.21.15.163:0/3839518475 >> 172.21.15.163:0/3839518475 conn(0x55da6cd37680 msgr2=0x55da6cd4a6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:21:40.689 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:21:40.630+0000 7feade674b80 1 -- 172.21.15.163:0/3839518475 shutdown_connections 2023-07-14T18:21:40.689 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:21:40.630+0000 7feade674b80 1 -- 172.21.15.163:0/3839518475 wait complete. 2023-07-14T18:21:40.689 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:21:40.630+0000 7feade674b80 1 -- start start 2023-07-14T18:21:40.689 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:21:40.631+0000 7feade674b80 1 Processor -- start 2023-07-14T18:21:40.689 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:21:40.631+0000 7feade674b80 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55da6cd41f60 0x55da6cd52a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:21:40.690 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:21:40.631+0000 7feade674b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55da6cd428b0 0x55da6cd51060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:21:40.690 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:21:40.631+0000 7feade674b80 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55da6cd434b0 0x55da6cd515a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:21:40.690 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:21:40.631+0000 7feade674b80 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x55da6cd53270 con 0x55da6cd41f60 2023-07-14T18:21:40.690 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:21:40.631+0000 7feade674b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x55da6cd51ae0 con 0x55da6cd428b0 2023-07-14T18:21:40.690 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:21:40.631+0000 7feade674b80 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x55da6cd51ca0 con 0x55da6cd434b0 2023-07-14T18:21:40.691 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:21:40.631+0000 7feade674b80 10 client.0 _ll_register_callbacks cb 0x7feac40097c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T18:21:40.691 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:21:40.631+0000 7feac3fff700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55da6cd428b0 0x55da6cd51060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:21:40.691 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:21:40.631+0000 7feacbfff700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55da6cd41f60 0x55da6cd52a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:21:40.691 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:21:40.631+0000 7feac3fff700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55da6cd428b0 0x55da6cd51060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.163:60738/0 (socket says 172.21.15.163:60738) 2023-07-14T18:21:40.691 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:21:40.631+0000 7feac3fff700 1 -- 172.21.15.163:0/2382293086 learned_addr learned my addr 172.21.15.163:0/2382293086 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:21:40.692 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:21:40.631+0000 7fead0a79700 1 --2- 172.21.15.163:0/2382293086 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55da6cd434b0 0x55da6cd515a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:21:40.692 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:21:40.631+0000 7fead0a79700 1 -- 172.21.15.163:0/2382293086 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55da6cd428b0 msgr2=0x55da6cd51060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:21:40.692 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:21:40.631+0000 7fead0a79700 1 --2- 172.21.15.163:0/2382293086 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55da6cd428b0 0x55da6cd51060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:21:40.692 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:21:40.631+0000 7fead0a79700 1 -- 172.21.15.163:0/2382293086 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55da6cd41f60 msgr2=0x55da6cd52a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:21:40.692 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:21:40.631+0000 7fead0a79700 1 --2- 172.21.15.163:0/2382293086 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55da6cd41f60 0x55da6cd52a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:21:40.693 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:21:40.631+0000 7fead0a79700 1 -- 172.21.15.163:0/2382293086 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feacc19d940 con 0x55da6cd434b0 2023-07-14T18:21:40.693 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:21:40.632+0000 7fead0a79700 1 --2- 172.21.15.163:0/2382293086 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55da6cd434b0 0x55da6cd515a0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7feac400ef90 tx=0x7feac40993d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=303ad8ba8deaca2e server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:21:40.693 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:21:40.632+0000 7feaab7fe700 10 client.0 ms_handle_connect on v2:172.21.15.184:3300/0 2023-07-14T18:21:40.693 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:21:40.632+0000 7feaab7fe700 1 -- 172.21.15.163:0/2382293086 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feac4099050 con 0x55da6cd434b0 2023-07-14T18:21:40.693 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:21:40.632+0000 7feaab7fe700 1 -- 172.21.15.163:0/2382293086 <== mon.1 v2:172.21.15.184:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 9049+0+0 (secure 0 0 0) 0x7feac409d990 con 0x55da6cd434b0 2023-07-14T18:21:40.694 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:21:40.632+0000 7feade674b80 1 -- 172.21.15.163:0/2382293086 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7feabc021070 con 0x55da6cd434b0 2023-07-14T18:21:40.695 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:21:40.636+0000 7feaab7fe700 1 -- 172.21.15.163:0/2382293086 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) v2 ==== 24+0+0 (secure 0 0 0) 0x7feac40a1d20 con 0x55da6cd434b0 2023-07-14T18:21:40.696 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:21:40.636+0000 7feade674b80 10 client.26068 fetch_fsmap learned FSMap version 39 2023-07-14T18:21:40.696 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:21:40.636+0000 7feade674b80 1 -- 172.21.15.163:0/2382293086 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) v3 -- 0x7feab4003680 con 0x55da6cd434b0 2023-07-14T18:21:40.696 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:21:40.636+0000 7feaab7fe700 1 -- 172.21.15.163:0/2382293086 <== mon.1 v2:172.21.15.184:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7feabc021070 con 0x55da6cd434b0 2023-07-14T18:21:40.696 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:21:40.637+0000 7feaab7fe700 1 -- 172.21.15.163:0/2382293086 <== mon.1 v2:172.21.15.184:3300/0 5 ==== fsmap(e 39) v1 ==== 7470+0+0 (secure 0 0 0) 0x7feac40b3040 con 0x55da6cd434b0 2023-07-14T18:21:40.696 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:21:40.637+0000 7feade674b80 10 client.26068 fetch_fsmap finished waiting for FSMap version 39 2023-07-14T18:21:40.697 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:21:40.637+0000 7feade674b80 10 client.26068 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-07-14T18:21:40.697 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:21:40.637+0000 7feade674b80 20 client.26068 populate_metadata read hostname 'smithi163' 2023-07-14T18:21:40.697 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:21:40.637+0000 7feade674b80 1 --2- 172.21.15.163:0/2382293086 >> [v2:172.21.15.172:6838/3850440096,v1:172.21.15.172:6839/3850440096] conn(0x55da6cd57670 0x55da6cdae8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:21:40.697 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:21:40.637+0000 7feade674b80 4 client.26068 mds_command: new command op to 24518 tid=0[{"prefix": "scrub status"}] 2023-07-14T18:21:40.697 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:21:40.637+0000 7feade674b80 1 -- 172.21.15.163:0/2382293086 --> [v2:172.21.15.172:6838/3850440096,v1:172.21.15.172:6839/3850440096] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55da6cc8beb0 con 0x55da6cd57670 2023-07-14T18:21:40.698 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:21:40.637+0000 7feacbfff700 1 --2- 172.21.15.163:0/2382293086 >> [v2:172.21.15.172:6838/3850440096,v1:172.21.15.172:6839/3850440096] conn(0x55da6cd57670 0x55da6cdae8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:21:40.698 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:21:40.637+0000 7feaab7fe700 10 client.26068 ms_handle_connect on v2:172.21.15.172:6838/3850440096 2023-07-14T18:21:40.698 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:21:40.637+0000 7feacbfff700 1 --2- 172.21.15.163:0/2382293086 >> [v2:172.21.15.172:6838/3850440096,v1:172.21.15.172:6839/3850440096] conn(0x55da6cd57670 0x55da6cdae8e0 crc :-1 s=READY pgs=94 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f156abf29d0e9549 server_cookie=827f7043ef4b4f69 in_seq=0 out_seq=0 2023-07-14T18:21:40.698 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:21:40.637+0000 7feaab7fe700 1 -- 172.21.15.163:0/2382293086 <== mds.0 v2:172.21.15.172:6838/3850440096 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x55da6cc8beb0 con 0x55da6cd57670 2023-07-14T18:21:40.698 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:21:40.637+0000 7feaab7fe700 10 client.26068 handle_command_reply: tid=0 2023-07-14T18:21:40.699 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:21:40.637+0000 7feade674b80 1 client.26068 shutdown 2023-07-14T18:21:40.699 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:21:40.638+0000 7feade674b80 1 -- 172.21.15.163:0/2382293086 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55da6cd434b0 msgr2=0x55da6cd515a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:21:40.699 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:21:40.638+0000 7feade674b80 1 --2- 172.21.15.163:0/2382293086 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55da6cd434b0 0x55da6cd515a0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7feac400ef90 tx=0x7feac40993d0 comp rx=0 tx=0).stop 2023-07-14T18:21:40.699 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:21:40.638+0000 7feade674b80 1 -- 172.21.15.163:0/2382293086 shutdown_connections 2023-07-14T18:21:40.699 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:21:40.638+0000 7feade674b80 1 --2- 172.21.15.163:0/2382293086 >> [v2:172.21.15.172:6838/3850440096,v1:172.21.15.172:6839/3850440096] conn(0x55da6cd57670 0x55da6cdae8e0 crc :-1 s=READY pgs=94 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:21:40.700 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:21:40.638+0000 7feade674b80 1 --2- 172.21.15.163:0/2382293086 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55da6cd434b0 0x55da6cd515a0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:21:40.700 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:21:40.638+0000 7feade674b80 1 --2- 172.21.15.163:0/2382293086 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55da6cd41f60 0x55da6cd52a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:21:40.700 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:21:40.638+0000 7feaab7fe700 0 client.26068 ms_handle_reset on v2:172.21.15.172:6838/3850440096 2023-07-14T18:21:40.700 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:21:40.638+0000 7feade674b80 1 --2- 172.21.15.163:0/2382293086 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55da6cd428b0 0x55da6cd51060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:21:40.701 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:21:40.638+0000 7feade674b80 1 -- 172.21.15.163:0/2382293086 >> 172.21.15.163:0/2382293086 conn(0x55da6cd37680 msgr2=0x55da6cd496a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:21:40.701 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:21:40.638+0000 7feade674b80 1 -- 172.21.15.163:0/2382293086 shutdown_connections 2023-07-14T18:21:40.701 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:21:40.638+0000 7feade674b80 1 -- 172.21.15.163:0/2382293086 wait complete. 2023-07-14T18:21:40.702 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:21:40.638+0000 7feade674b80 20 client.26068 trim_cache size 0 max 16384 2023-07-14T18:21:40.702 INFO:teuthology.orchestra.run.smithi163.stdout:{ 2023-07-14T18:21:40.702 INFO:teuthology.orchestra.run.smithi163.stdout: "status": "IDLE (waiting for more scrubs)", 2023-07-14T18:21:40.703 INFO:teuthology.orchestra.run.smithi163.stdout: "scrubs": { 2023-07-14T18:21:40.703 INFO:teuthology.orchestra.run.smithi163.stdout: "2c53b7ef-6f30-49f0-a60d-f1f114c19d42": { 2023-07-14T18:21:40.703 INFO:teuthology.orchestra.run.smithi163.stdout: "path": "/", 2023-07-14T18:21:40.703 INFO:teuthology.orchestra.run.smithi163.stdout: "tag": "2c53b7ef-6f30-49f0-a60d-f1f114c19d42", 2023-07-14T18:21:40.703 INFO:teuthology.orchestra.run.smithi163.stdout: "options": "recursive,force" 2023-07-14T18:21:40.704 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-07-14T18:21:40.704 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-07-14T18:21:40.704 INFO:teuthology.orchestra.run.smithi163.stdout:} 2023-07-14T18:21:40.705 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:21:40.638+0000 7fead24dc700 1 -- 172.21.15.163:0/3196677044 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7feab80a1150 msgr2=0x7feab80a3600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:21:40.705 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:21:40.638+0000 7fead24dc700 1 --2- 172.21.15.163:0/3196677044 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7feab80a1150 0x7feab80a3600 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7feabc005950 tx=0x7feabc009260 comp rx=0 tx=0).stop 2023-07-14T18:21:40.705 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:21:40.638+0000 7fead24dc700 1 -- 172.21.15.163:0/3196677044 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7feacc1006d0 msgr2=0x7feacc19cbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:21:40.706 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:21:40.638+0000 7fead24dc700 1 --2- 172.21.15.163:0/3196677044 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7feacc1006d0 0x7feacc19cbf0 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7feac400efc0 tx=0x7feac400c3a0 comp rx=0 tx=0).stop 2023-07-14T18:21:40.706 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:21:40.639+0000 7fead24dc700 1 -- 172.21.15.163:0/3196677044 shutdown_connections 2023-07-14T18:21:40.706 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:21:40.639+0000 7fead24dc700 1 --2- 172.21.15.163:0/3196677044 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7feab80a1150 0x7feab80a3600 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:21:40.706 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:21:40.639+0000 7fead24dc700 1 --2- 172.21.15.163:0/3196677044 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7feacc0feb50 0x7feacc069280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:21:40.706 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:21:40.639+0000 7fead24dc700 1 --2- 172.21.15.163:0/3196677044 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7feacc1006d0 0x7feacc19cbf0 unknown :-1 s=CLOSED pgs=709 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:21:40.707 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:21:40.639+0000 7fead24dc700 1 --2- 172.21.15.163:0/3196677044 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7feacc0ffd40 0x7feacc19a5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:21:40.707 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:21:40.639+0000 7fead24dc700 1 -- 172.21.15.163:0/3196677044 >> 172.21.15.163:0/3196677044 conn(0x7feacc0fa150 msgr2=0x7feacc103220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:21:40.707 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:21:40.639+0000 7fead24dc700 1 -- 172.21.15.163:0/3196677044 shutdown_connections 2023-07-14T18:21:40.707 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:21:40.639+0000 7fead24dc700 1 -- 172.21.15.163:0/3196677044 wait complete. 2023-07-14T18:21:40.708 INFO:tasks.cephfs.filesystem:scrub status for tag:2c53b7ef-6f30-49f0-a60d-f1f114c19d42 - {'path': '/', 'tag': '2c53b7ef-6f30-49f0-a60d-f1f114c19d42', 'options': 'recursive,force'} 2023-07-14T18:21:40.934 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:21:40 smithi184 ceph-mon[98481]: pgmap v570: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-07-14T18:21:40.976 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:21:40 smithi163 ceph-mon[96576]: pgmap v570: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-07-14T18:21:41.035 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:21:40 smithi172 ceph-mon[97983]: pgmap v570: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-07-14T18:21:42.226 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:21:41 smithi163 ceph-mon[96576]: pgmap v571: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-07-14T18:21:42.285 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:21:41 smithi172 ceph-mon[97983]: pgmap v571: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-07-14T18:21:42.434 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:21:41 smithi184 ceph-mon[98481]: pgmap v571: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-07-14T18:21:44.934 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:21:44 smithi184 ceph-mon[98481]: pgmap v572: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-07-14T18:21:44.976 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:21:44 smithi163 ceph-mon[96576]: pgmap v572: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-07-14T18:21:45.035 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:21:44 smithi172 ceph-mon[97983]: pgmap v572: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-07-14T18:21:46.934 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:21:46 smithi184 ceph-mon[98481]: pgmap v573: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-07-14T18:21:46.976 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:21:46 smithi163 ceph-mon[96576]: pgmap v573: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-07-14T18:21:47.035 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:21:46 smithi172 ceph-mon[97983]: pgmap v573: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-07-14T18:21:48.976 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:21:48 smithi163 ceph-mon[96576]: pgmap v574: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-07-14T18:21:49.035 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:21:48 smithi172 ceph-mon[97983]: pgmap v574: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-07-14T18:21:49.184 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:21:48 smithi184 ceph-mon[98481]: pgmap v574: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-07-14T18:21:50.976 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:21:50 smithi163 ceph-mon[96576]: pgmap v575: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-07-14T18:21:51.035 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:21:50 smithi172 ceph-mon[97983]: pgmap v575: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-07-14T18:21:51.184 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:21:50 smithi184 ceph-mon[98481]: pgmap v575: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-07-14T18:21:52.226 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:21:51 smithi163 ceph-mon[96576]: pgmap v576: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-07-14T18:21:52.285 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:21:51 smithi172 ceph-mon[97983]: pgmap v576: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-07-14T18:21:52.434 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:21:51 smithi184 ceph-mon[98481]: pgmap v576: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-07-14T18:21:54.934 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:21:54 smithi184 ceph-mon[98481]: pgmap v577: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-07-14T18:21:54.976 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:21:54 smithi163 ceph-mon[96576]: pgmap v577: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-07-14T18:21:55.035 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:21:54 smithi172 ceph-mon[97983]: pgmap v577: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-07-14T18:21:56.934 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:21:56 smithi184 ceph-mon[98481]: pgmap v578: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-07-14T18:21:56.976 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:21:56 smithi163 ceph-mon[96576]: pgmap v578: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-07-14T18:21:57.035 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:21:56 smithi172 ceph-mon[97983]: pgmap v578: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-07-14T18:21:58.977 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:21:58 smithi163 ceph-mon[96576]: pgmap v579: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-07-14T18:21:59.035 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:21:58 smithi172 ceph-mon[97983]: pgmap v579: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-07-14T18:21:59.184 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:21:58 smithi184 ceph-mon[98481]: pgmap v579: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-07-14T18:22:00.977 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:22:00 smithi163 ceph-mon[96576]: pgmap v580: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-07-14T18:22:01.035 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:22:00 smithi172 ceph-mon[97983]: pgmap v580: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-07-14T18:22:01.184 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:22:00 smithi184 ceph-mon[98481]: pgmap v580: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-07-14T18:22:02.227 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:22:01 smithi163 ceph-mon[96576]: pgmap v581: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-07-14T18:22:02.285 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:22:01 smithi172 ceph-mon[97983]: pgmap v581: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-07-14T18:22:02.434 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:22:01 smithi184 ceph-mon[98481]: pgmap v581: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-07-14T18:22:04.934 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:22:04 smithi184 ceph-mon[98481]: pgmap v582: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-07-14T18:22:04.977 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:22:04 smithi163 ceph-mon[96576]: pgmap v582: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-07-14T18:22:05.035 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:22:04 smithi172 ceph-mon[97983]: pgmap v582: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-07-14T18:22:06.977 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:22:06 smithi163 ceph-mon[96576]: pgmap v583: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-07-14T18:22:07.035 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:22:06 smithi172 ceph-mon[97983]: pgmap v583: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-07-14T18:22:07.184 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:22:06 smithi184 ceph-mon[98481]: pgmap v583: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-07-14T18:22:08.977 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:22:08 smithi163 ceph-mon[96576]: pgmap v584: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-07-14T18:22:09.035 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:22:08 smithi172 ceph-mon[97983]: pgmap v584: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-07-14T18:22:09.184 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:22:08 smithi184 ceph-mon[98481]: pgmap v584: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-07-14T18:22:10.708 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-07-14T18:22:10.863 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:22:10.813+0000 7f6952d28700 1 -- 172.21.15.163:0/3732731526 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f694c0feb10 msgr2=0x7f694c0fef20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:22:10.863 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:22:10.813+0000 7f6952d28700 1 --2- 172.21.15.163:0/3732731526 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f694c0feb10 0x7f694c0fef20 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7f6940009990 tx=0x7f6940009ca0 comp rx=0 tx=0).stop 2023-07-14T18:22:10.864 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:22:10.813+0000 7f6952d28700 1 -- 172.21.15.163:0/3732731526 shutdown_connections 2023-07-14T18:22:10.864 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:22:10.813+0000 7f6952d28700 1 --2- 172.21.15.163:0/3732731526 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f694c100690 0x7f694c106f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:22:10.864 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:22:10.813+0000 7f6952d28700 1 --2- 172.21.15.163:0/3732731526 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f694c0feb10 0x7f694c0fef20 unknown :-1 s=CLOSED pgs=712 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:22:10.864 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:22:10.813+0000 7f6952d28700 1 --2- 172.21.15.163:0/3732731526 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f694c0ffd00 0x7f694c100150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:22:10.865 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:22:10.813+0000 7f6952d28700 1 -- 172.21.15.163:0/3732731526 >> 172.21.15.163:0/3732731526 conn(0x7f694c0fa130 msgr2=0x7f694c0fc560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:22:10.865 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:22:10.813+0000 7f6952d28700 1 -- 172.21.15.163:0/3732731526 shutdown_connections 2023-07-14T18:22:10.865 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:22:10.813+0000 7f6952d28700 1 -- 172.21.15.163:0/3732731526 wait complete. 2023-07-14T18:22:10.867 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:22:10.814+0000 7f6952d28700 1 Processor -- start 2023-07-14T18:22:10.867 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:22:10.814+0000 7f6952d28700 1 -- start start 2023-07-14T18:22:10.867 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:22:10.814+0000 7f6952d28700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f694c0feb10 0x7f694c102aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:22:10.868 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:22:10.814+0000 7f6952d28700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f694c0ffd00 0x7f694c1010e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:22:10.868 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:22:10.814+0000 7f6952d28700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f694c100690 0x7f694c101620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:22:10.868 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:22:10.814+0000 7f6952d28700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f694c101dc0 con 0x7f694c0feb10 2023-07-14T18:22:10.869 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:22:10.814+0000 7f6952d28700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f694c101f30 con 0x7f694c100690 2023-07-14T18:22:10.869 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:22:10.814+0000 7f6952d28700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f694c19f9a0 con 0x7f694c0ffd00 2023-07-14T18:22:10.870 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:22:10.814+0000 7f6950ac4700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f694c0feb10 0x7f694c102aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:22:10.870 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:22:10.814+0000 7f6950ac4700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f694c0feb10 0x7f694c102aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:60066/0 (socket says 172.21.15.163:60066) 2023-07-14T18:22:10.870 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:22:10.814+0000 7f6950ac4700 1 -- 172.21.15.163:0/2322612654 learned_addr learned my addr 172.21.15.163:0/2322612654 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:22:10.871 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:22:10.814+0000 7f69512c5700 1 --2- 172.21.15.163:0/2322612654 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f694c100690 0x7f694c101620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:22:10.871 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:22:10.814+0000 7f694bfff700 1 --2- 172.21.15.163:0/2322612654 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f694c0ffd00 0x7f694c1010e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:22:10.871 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:22:10.815+0000 7f6950ac4700 1 -- 172.21.15.163:0/2322612654 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f694c0ffd00 msgr2=0x7f694c1010e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:22:10.872 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:22:10.815+0000 7f6950ac4700 1 --2- 172.21.15.163:0/2322612654 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f694c0ffd00 0x7f694c1010e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:22:10.872 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:22:10.815+0000 7f6950ac4700 1 -- 172.21.15.163:0/2322612654 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f694c100690 msgr2=0x7f694c101620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:22:10.873 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:22:10.815+0000 7f6950ac4700 1 --2- 172.21.15.163:0/2322612654 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f694c100690 0x7f694c101620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:22:10.873 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:22:10.815+0000 7f6950ac4700 1 -- 172.21.15.163:0/2322612654 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69400095f0 con 0x7f694c0feb10 2023-07-14T18:22:10.873 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:22:10.815+0000 7f6950ac4700 1 --2- 172.21.15.163:0/2322612654 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f694c0feb10 0x7f694c102aa0 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7f69400098e0 tx=0x7f6940004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:22:10.874 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:22:10.815+0000 7f6949ffb700 1 -- 172.21.15.163:0/2322612654 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f694001d070 con 0x7f694c0feb10 2023-07-14T18:22:10.874 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:22:10.815+0000 7f6949ffb700 1 -- 172.21.15.163:0/2322612654 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f694000bd50 con 0x7f694c0feb10 2023-07-14T18:22:10.875 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:22:10.815+0000 7f6949ffb700 1 -- 172.21.15.163:0/2322612654 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6940022cf0 con 0x7f694c0feb10 2023-07-14T18:22:10.875 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:22:10.815+0000 7f6952d28700 1 -- 172.21.15.163:0/2322612654 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f694c19fc20 con 0x7f694c0feb10 2023-07-14T18:22:10.875 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:22:10.815+0000 7f6952d28700 1 -- 172.21.15.163:0/2322612654 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f694c1a0040 con 0x7f694c0feb10 2023-07-14T18:22:10.876 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:22:10.817+0000 7f6949ffb700 1 -- 172.21.15.163:0/2322612654 <== mon.0 v2:172.21.15.163:3300/0 4 ==== mgrmap(e 18) v1 ==== 135716+0+0 (secure 0 0 0) 0x7f6940022470 con 0x7f694c0feb10 2023-07-14T18:22:10.884 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:22:10.818+0000 7f6949ffb700 1 --2- 172.21.15.163:0/2322612654 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f693c0a11d0 0x7f693c0a3680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:22:10.884 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:22:10.818+0000 7f694bfff700 1 --2- 172.21.15.163:0/2322612654 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f693c0a11d0 0x7f693c0a3680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:22:10.884 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:22:10.818+0000 7f6949ffb700 1 -- 172.21.15.163:0/2322612654 <== mon.0 v2:172.21.15.163:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 9049+0+0 (secure 0 0 0) 0x7f69400ce200 con 0x7f694c0feb10 2023-07-14T18:22:10.885 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:22:10.819+0000 7f694bfff700 1 --2- 172.21.15.163:0/2322612654 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f693c0a11d0 0x7f693c0a3680 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f6938009c60 tx=0x7f6938009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:22:10.885 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:22:10.819+0000 7f695eec0b80 1 Processor -- start 2023-07-14T18:22:10.886 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:22:10.819+0000 7f695eec0b80 1 -- start start 2023-07-14T18:22:10.886 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:22:10.820+0000 7f695eec0b80 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5593ac63bf60 0x5593ac63c370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:22:10.887 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:22:10.820+0000 7f695eec0b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5593ac63c8b0 0x5593ac63ced0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:22:10.887 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:22:10.820+0000 7f695eec0b80 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5593ac63d4b0 0x5593ac63d920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:22:10.887 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:22:10.820+0000 7f695eec0b80 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x5593ac540cb0 con 0x5593ac63bf60 2023-07-14T18:22:10.888 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:22:10.820+0000 7f695eec0b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x5593ac593a40 con 0x5593ac63c8b0 2023-07-14T18:22:10.888 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:22:10.820+0000 7f695eec0b80 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x5593ac58ced0 con 0x5593ac63d4b0 2023-07-14T18:22:10.889 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:22:10.820+0000 7f694bfff700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5593ac63c8b0 0x5593ac63ced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:22:10.889 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:22:10.820+0000 7f6950ac4700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5593ac63bf60 0x5593ac63c370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:22:10.889 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:22:10.820+0000 7f694bfff700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5593ac63c8b0 0x5593ac63ced0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.163:60760/0 (socket says 172.21.15.163:60760) 2023-07-14T18:22:10.890 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:22:10.820+0000 7f694bfff700 1 -- 172.21.15.163:0/265979286 learned_addr learned my addr 172.21.15.163:0/265979286 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:22:10.890 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:22:10.820+0000 7f69512c5700 1 --2- 172.21.15.163:0/265979286 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5593ac63d4b0 0x5593ac63d920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:22:10.891 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:22:10.820+0000 7f6950ac4700 1 -- 172.21.15.163:0/265979286 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5593ac63d4b0 msgr2=0x5593ac63d920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:22:10.891 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:22:10.820+0000 7f6950ac4700 1 --2- 172.21.15.163:0/265979286 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5593ac63d4b0 0x5593ac63d920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:22:10.891 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:22:10.820+0000 7f6950ac4700 1 -- 172.21.15.163:0/265979286 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5593ac63c8b0 msgr2=0x5593ac63ced0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:22:10.892 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:22:10.820+0000 7f6950ac4700 1 --2- 172.21.15.163:0/265979286 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5593ac63c8b0 0x5593ac63ced0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:22:10.892 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:22:10.820+0000 7f6950ac4700 1 -- 172.21.15.163:0/265979286 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5593ac3bade0 con 0x5593ac63bf60 2023-07-14T18:22:10.893 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:22:10.820+0000 7f694bfff700 1 --2- 172.21.15.163:0/265979286 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5593ac63c8b0 0x5593ac63ced0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T18:22:10.893 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:22:10.820+0000 7f6950ac4700 1 --2- 172.21.15.163:0/265979286 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5593ac63bf60 0x5593ac63c370 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7f69400cb9d0 tx=0x7f6940004320 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c0271eb59009168e server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:22:10.894 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:22:10.820+0000 7f6936ffd700 1 -- 172.21.15.163:0/265979286 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f694009b370 con 0x5593ac63bf60 2023-07-14T18:22:10.894 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:22:10.820+0000 7f6936ffd700 1 -- 172.21.15.163:0/265979286 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f69400cbe90 con 0x5593ac63bf60 2023-07-14T18:22:10.894 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:22:10.821+0000 7f6936ffd700 1 -- 172.21.15.163:0/265979286 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6940099830 con 0x5593ac63bf60 2023-07-14T18:22:10.895 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:22:10.821+0000 7f695eec0b80 1 -- 172.21.15.163:0/265979286 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5593ac63bf60 msgr2=0x5593ac63c370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:22:10.895 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:22:10.821+0000 7f695eec0b80 1 --2- 172.21.15.163:0/265979286 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5593ac63bf60 0x5593ac63c370 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7f69400cb9d0 tx=0x7f6940004320 comp rx=0 tx=0).stop 2023-07-14T18:22:10.895 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:22:10.821+0000 7f695eec0b80 1 -- 172.21.15.163:0/265979286 shutdown_connections 2023-07-14T18:22:10.895 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:22:10.821+0000 7f695eec0b80 1 --2- 172.21.15.163:0/265979286 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5593ac63d4b0 0x5593ac63d920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:22:10.896 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:22:10.821+0000 7f695eec0b80 1 --2- 172.21.15.163:0/265979286 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5593ac63bf60 0x5593ac63c370 unknown :-1 s=CLOSED pgs=714 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:22:10.896 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:22:10.821+0000 7f695eec0b80 1 --2- 172.21.15.163:0/265979286 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5593ac63c8b0 0x5593ac63ced0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:22:10.896 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:22:10.821+0000 7f695eec0b80 1 -- 172.21.15.163:0/265979286 >> 172.21.15.163:0/265979286 conn(0x5593ac631680 msgr2=0x5593ac6369d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:22:10.896 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:22:10.821+0000 7f695eec0b80 1 -- 172.21.15.163:0/265979286 shutdown_connections 2023-07-14T18:22:10.896 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:22:10.821+0000 7f695eec0b80 1 -- 172.21.15.163:0/265979286 wait complete. 2023-07-14T18:22:10.897 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:22:10.822+0000 7f695eec0b80 1 -- start start 2023-07-14T18:22:10.897 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:22:10.822+0000 7f695eec0b80 1 Processor -- start 2023-07-14T18:22:10.897 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:22:10.822+0000 7f695eec0b80 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5593ac63bf60 0x5593ac645580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:22:10.898 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:22:10.822+0000 7f695eec0b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5593ac63c8b0 0x5593ac645ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:22:10.898 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:22:10.822+0000 7f695eec0b80 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5593ac63d4b0 0x5593ac64cb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:22:10.898 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:22:10.822+0000 7f695eec0b80 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x5593ac52cac0 con 0x5593ac63bf60 2023-07-14T18:22:10.898 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:22:10.822+0000 7f695eec0b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x5593ac52c7c0 con 0x5593ac63c8b0 2023-07-14T18:22:10.899 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:22:10.822+0000 7f695eec0b80 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x5593ac410920 con 0x5593ac63d4b0 2023-07-14T18:22:10.899 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:22:10.823+0000 7f695eec0b80 10 client.0 _ll_register_callbacks cb 0x5593ac52a760 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T18:22:10.899 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:22:10.823+0000 7f6950ac4700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5593ac63bf60 0x5593ac645580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:22:10.899 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:22:10.823+0000 7f6950ac4700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5593ac63bf60 0x5593ac645580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:60080/0 (socket says 172.21.15.163:60080) 2023-07-14T18:22:10.899 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:22:10.823+0000 7f6950ac4700 1 -- 172.21.15.163:0/742056077 learned_addr learned my addr 172.21.15.163:0/742056077 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:22:10.900 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:22:10.823+0000 7f69512c5700 1 --2- 172.21.15.163:0/742056077 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5593ac63d4b0 0x5593ac64cb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:22:10.900 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:22:10.823+0000 7f694bfff700 1 --2- 172.21.15.163:0/742056077 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5593ac63c8b0 0x5593ac645ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:22:10.900 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:22:10.823+0000 7f6950ac4700 1 -- 172.21.15.163:0/742056077 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5593ac63d4b0 msgr2=0x5593ac64cb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:22:10.900 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:22:10.823+0000 7f6950ac4700 1 --2- 172.21.15.163:0/742056077 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5593ac63d4b0 0x5593ac64cb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:22:10.900 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:22:10.823+0000 7f6950ac4700 1 -- 172.21.15.163:0/742056077 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5593ac63c8b0 msgr2=0x5593ac645ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:22:10.901 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:22:10.823+0000 7f6950ac4700 1 --2- 172.21.15.163:0/742056077 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5593ac63c8b0 0x5593ac645ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:22:10.901 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:22:10.823+0000 7f6950ac4700 1 -- 172.21.15.163:0/742056077 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6938017070 con 0x5593ac63bf60 2023-07-14T18:22:10.901 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:22:10.823+0000 7f6950ac4700 1 --2- 172.21.15.163:0/742056077 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5593ac63bf60 0x5593ac645580 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7f69400227c0 tx=0x7f69400994b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b72cababcec56ccd server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:22:10.901 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:22:10.823+0000 7f692bfff700 10 client.0 ms_handle_connect on v2:172.21.15.163:3300/0 2023-07-14T18:22:10.901 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:22:10.823+0000 7f692bfff700 1 -- 172.21.15.163:0/742056077 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f694009f3a0 con 0x5593ac63bf60 2023-07-14T18:22:10.902 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:22:10.823+0000 7f692bfff700 1 -- 172.21.15.163:0/742056077 <== mon.0 v2:172.21.15.163:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 9049+0+0 (secure 0 0 0) 0x7f694009b370 con 0x5593ac63bf60 2023-07-14T18:22:10.902 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:22:10.823+0000 7f695eec0b80 1 -- 172.21.15.163:0/742056077 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5593ac4e64f0 con 0x5593ac63bf60 2023-07-14T18:22:10.902 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:22:10.823+0000 7f692bfff700 1 -- 172.21.15.163:0/742056077 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) v2 ==== 24+0+0 (secure 0 0 0) 0x7f69400a3730 con 0x5593ac63bf60 2023-07-14T18:22:10.902 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:22:10.823+0000 7f695eec0b80 10 client.16518 fetch_fsmap learned FSMap version 39 2023-07-14T18:22:10.903 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:22:10.823+0000 7f695eec0b80 1 -- 172.21.15.163:0/742056077 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) v3 -- 0x7f694c1a0040 con 0x5593ac63bf60 2023-07-14T18:22:10.903 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:22:10.824+0000 7f692bfff700 1 -- 172.21.15.163:0/742056077 <== mon.0 v2:172.21.15.163:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x5593ac4e64f0 con 0x5593ac63bf60 2023-07-14T18:22:10.903 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:22:10.824+0000 7f692bfff700 1 -- 172.21.15.163:0/742056077 <== mon.0 v2:172.21.15.163:3300/0 5 ==== fsmap(e 39) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f694009a2d0 con 0x5593ac63bf60 2023-07-14T18:22:10.903 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:22:10.824+0000 7f695eec0b80 10 client.16518 fetch_fsmap finished waiting for FSMap version 39 2023-07-14T18:22:10.904 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:22:10.824+0000 7f695eec0b80 10 client.16518 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-07-14T18:22:10.904 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:22:10.824+0000 7f695eec0b80 20 client.16518 populate_metadata read hostname 'smithi163' 2023-07-14T18:22:10.904 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:22:10.824+0000 7f695eec0b80 1 --2- 172.21.15.163:0/742056077 >> [v2:172.21.15.172:6838/3850440096,v1:172.21.15.172:6839/3850440096] conn(0x5593ac650dc0 0x5593ac6531a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:22:10.905 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:22:10.824+0000 7f695eec0b80 4 client.16518 mds_command: new command op to 24518 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-14T18:22:10.905 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:22:10.824+0000 7f695eec0b80 1 -- 172.21.15.163:0/742056077 --> [v2:172.21.15.172:6838/3850440096,v1:172.21.15.172:6839/3850440096] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5593ac60ada0 con 0x5593ac650dc0 2023-07-14T18:22:10.905 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:22:10.824+0000 7f694bfff700 1 --2- 172.21.15.163:0/742056077 >> [v2:172.21.15.172:6838/3850440096,v1:172.21.15.172:6839/3850440096] conn(0x5593ac650dc0 0x5593ac6531a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:22:10.905 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:22:10.824+0000 7f694bfff700 1 --2- 172.21.15.163:0/742056077 >> [v2:172.21.15.172:6838/3850440096,v1:172.21.15.172:6839/3850440096] conn(0x5593ac650dc0 0x5593ac6531a0 crc :-1 s=READY pgs=95 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=232822d1b36bec6b server_cookie=42d1b6cda12b4b0a in_seq=0 out_seq=0 2023-07-14T18:22:10.906 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:22:10.824+0000 7f692bfff700 10 client.16518 ms_handle_connect on v2:172.21.15.172:6838/3850440096 2023-07-14T18:22:10.906 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:22:10.825+0000 7f692bfff700 1 -- 172.21.15.163:0/742056077 <== mds.0 v2:172.21.15.172:6838/3850440096 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18017 (crc 0 0 0) 0x5593ac60ada0 con 0x5593ac650dc0 2023-07-14T18:22:10.906 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:22:10.825+0000 7f692bfff700 10 client.16518 handle_command_reply: tid=0 2023-07-14T18:22:10.906 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:22:10.825+0000 7f695eec0b80 1 client.16518 shutdown 2023-07-14T18:22:10.906 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:22:10.825+0000 7f695eec0b80 1 -- 172.21.15.163:0/742056077 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5593ac63bf60 msgr2=0x5593ac645580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:22:10.907 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:22:10.825+0000 7f695eec0b80 1 --2- 172.21.15.163:0/742056077 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5593ac63bf60 0x5593ac645580 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7f69400227c0 tx=0x7f69400994b0 comp rx=0 tx=0).stop 2023-07-14T18:22:10.907 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:22:10.825+0000 7f695eec0b80 1 -- 172.21.15.163:0/742056077 shutdown_connections 2023-07-14T18:22:10.907 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:22:10.825+0000 7f695eec0b80 1 --2- 172.21.15.163:0/742056077 >> [v2:172.21.15.172:6838/3850440096,v1:172.21.15.172:6839/3850440096] conn(0x5593ac650dc0 0x5593ac6531a0 crc :-1 s=READY pgs=95 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:22:10.907 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:22:10.825+0000 7f695eec0b80 1 --2- 172.21.15.163:0/742056077 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5593ac63d4b0 0x5593ac64cb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:22:10.907 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:22:10.825+0000 7f695eec0b80 1 --2- 172.21.15.163:0/742056077 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5593ac63bf60 0x5593ac645580 unknown :-1 s=CLOSED pgs=715 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:22:10.908 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:22:10.825+0000 7f692bfff700 0 client.16518 ms_handle_reset on v2:172.21.15.172:6838/3850440096 2023-07-14T18:22:10.908 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:22:10.825+0000 7f695eec0b80 1 --2- 172.21.15.163:0/742056077 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5593ac63c8b0 0x5593ac645ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:22:10.908 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:22:10.826+0000 7f695eec0b80 1 -- 172.21.15.163:0/742056077 >> 172.21.15.163:0/742056077 conn(0x5593ac631680 msgr2=0x5593ac635650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:22:10.909 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:22:10.826+0000 7f695eec0b80 1 -- 172.21.15.163:0/742056077 shutdown_connections 2023-07-14T18:22:10.909 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:22:10.826+0000 7f695eec0b80 1 -- 172.21.15.163:0/742056077 wait complete. 2023-07-14T18:22:10.909 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:22:10.826+0000 7f695eec0b80 20 client.16518 trim_cache size 0 max 16384 2023-07-14T18:22:10.913 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:22:10.844+0000 7f695eec0b80 1 Processor -- start 2023-07-14T18:22:10.914 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:22:10.844+0000 7f695eec0b80 1 -- start start 2023-07-14T18:22:10.914 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:22:10.844+0000 7f695eec0b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5593ac63bf60 0x5593ac644c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:22:10.914 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:22:10.844+0000 7f695eec0b80 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5593ac63c8b0 0x5593ac64cac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:22:10.914 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:22:10.844+0000 7f695eec0b80 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5593ac63d4b0 0x5593ac6443a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:22:10.915 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:22:10.844+0000 7f695eec0b80 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x5593ac63d370 con 0x5593ac63d4b0 2023-07-14T18:22:10.915 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:22:10.844+0000 7f695eec0b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x5593ac644a30 con 0x5593ac63bf60 2023-07-14T18:22:10.915 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:22:10.844+0000 7f695eec0b80 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x5593ac638200 con 0x5593ac63c8b0 2023-07-14T18:22:10.915 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:22:10.844+0000 7f6950ac4700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5593ac63bf60 0x5593ac644c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:22:10.915 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:22:10.844+0000 7f6950ac4700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5593ac63bf60 0x5593ac644c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.163:60772/0 (socket says 172.21.15.163:60772) 2023-07-14T18:22:10.916 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:22:10.844+0000 7f694bfff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5593ac63c8b0 0x5593ac64cac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:22:10.916 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:22:10.844+0000 7f6950ac4700 1 -- 172.21.15.163:0/699002062 learned_addr learned my addr 172.21.15.163:0/699002062 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:22:10.916 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:22:10.844+0000 7f69512c5700 1 --2- 172.21.15.163:0/699002062 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5593ac63d4b0 0x5593ac6443a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:22:10.916 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:22:10.844+0000 7f6950ac4700 1 -- 172.21.15.163:0/699002062 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5593ac63c8b0 msgr2=0x5593ac64cac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:22:10.916 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:22:10.844+0000 7f6950ac4700 1 --2- 172.21.15.163:0/699002062 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5593ac63c8b0 0x5593ac64cac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:22:10.917 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:22:10.844+0000 7f6950ac4700 1 -- 172.21.15.163:0/699002062 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5593ac63d4b0 msgr2=0x5593ac6443a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:22:10.917 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:22:10.844+0000 7f6950ac4700 1 --2- 172.21.15.163:0/699002062 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5593ac63d4b0 0x5593ac6443a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:22:10.917 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:22:10.844+0000 7f6950ac4700 1 -- 172.21.15.163:0/699002062 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5593ac3a3c60 con 0x5593ac63bf60 2023-07-14T18:22:10.917 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:22:10.844+0000 7f69512c5700 1 --2- 172.21.15.163:0/699002062 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5593ac63d4b0 0x5593ac6443a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T18:22:10.917 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:22:10.845+0000 7f6950ac4700 1 --2- 172.21.15.163:0/699002062 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5593ac63bf60 0x5593ac644c30 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f6940022790 tx=0x7f6940004320 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d3559636629eb885 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:22:10.918 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:22:10.845+0000 7f69377fe700 1 -- 172.21.15.163:0/699002062 <== mon.2 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f694000bec0 con 0x5593ac63bf60 2023-07-14T18:22:10.918 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:22:10.845+0000 7f69377fe700 1 -- 172.21.15.163:0/699002062 <== mon.2 v2:172.21.15.172:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f694009b370 con 0x5593ac63bf60 2023-07-14T18:22:10.918 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:22:10.845+0000 7f69377fe700 1 -- 172.21.15.163:0/699002062 <== mon.2 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69400a34c0 con 0x5593ac63bf60 2023-07-14T18:22:10.918 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:22:10.845+0000 7f695eec0b80 1 -- 172.21.15.163:0/699002062 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5593ac63bf60 msgr2=0x5593ac644c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:22:10.918 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:22:10.845+0000 7f695eec0b80 1 --2- 172.21.15.163:0/699002062 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5593ac63bf60 0x5593ac644c30 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f6940022790 tx=0x7f6940004320 comp rx=0 tx=0).stop 2023-07-14T18:22:10.919 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:22:10.845+0000 7f695eec0b80 1 -- 172.21.15.163:0/699002062 shutdown_connections 2023-07-14T18:22:10.919 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:22:10.845+0000 7f695eec0b80 1 --2- 172.21.15.163:0/699002062 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5593ac63d4b0 0x5593ac6443a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:22:10.919 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:22:10.845+0000 7f695eec0b80 1 --2- 172.21.15.163:0/699002062 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5593ac63bf60 0x5593ac644c30 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:22:10.919 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:22:10.845+0000 7f695eec0b80 1 --2- 172.21.15.163:0/699002062 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5593ac63c8b0 0x5593ac64cac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:22:10.920 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:22:10.845+0000 7f695eec0b80 1 -- 172.21.15.163:0/699002062 >> 172.21.15.163:0/699002062 conn(0x5593ac631680 msgr2=0x5593ac6369a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:22:10.920 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:22:10.846+0000 7f695eec0b80 1 -- 172.21.15.163:0/699002062 shutdown_connections 2023-07-14T18:22:10.920 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:22:10.846+0000 7f695eec0b80 1 -- 172.21.15.163:0/699002062 wait complete. 2023-07-14T18:22:10.920 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:22:10.846+0000 7f695eec0b80 1 -- start start 2023-07-14T18:22:10.921 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:22:10.846+0000 7f695eec0b80 1 Processor -- start 2023-07-14T18:22:10.921 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:22:10.846+0000 7f695eec0b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5593ac63bf60 0x5593ac648b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:22:10.921 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:22:10.846+0000 7f695eec0b80 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5593ac63c8b0 0x5593ac6490a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:22:10.921 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:22:10.846+0000 7f695eec0b80 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5593ac63d4b0 0x5593ac64c0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:22:10.921 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:22:10.846+0000 7f695eec0b80 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x5593ac64c600 con 0x5593ac63d4b0 2023-07-14T18:22:10.922 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:22:10.846+0000 7f695eec0b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x5593ac64c770 con 0x5593ac63bf60 2023-07-14T18:22:10.922 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:22:10.846+0000 7f695eec0b80 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x5593ac64c930 con 0x5593ac63c8b0 2023-07-14T18:22:10.922 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:22:10.846+0000 7f695eec0b80 10 client.0 _ll_register_callbacks cb 0x7f6938009da0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T18:22:10.922 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:22:10.846+0000 7f69512c5700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5593ac63d4b0 0x5593ac64c0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:22:10.922 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:22:10.846+0000 7f69512c5700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5593ac63d4b0 0x5593ac64c0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:60096/0 (socket says 172.21.15.163:60096) 2023-07-14T18:22:10.923 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:22:10.846+0000 7f69512c5700 1 -- 172.21.15.163:0/4259029881 learned_addr learned my addr 172.21.15.163:0/4259029881 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:22:10.923 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:22:10.846+0000 7f6950ac4700 1 --2- 172.21.15.163:0/4259029881 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5593ac63bf60 0x5593ac648b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:22:10.923 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:22:10.847+0000 7f694bfff700 1 --2- 172.21.15.163:0/4259029881 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5593ac63c8b0 0x5593ac6490a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:22:10.923 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:22:10.847+0000 7f69512c5700 1 -- 172.21.15.163:0/4259029881 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5593ac63c8b0 msgr2=0x5593ac6490a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:22:10.923 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:22:10.847+0000 7f69512c5700 1 --2- 172.21.15.163:0/4259029881 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5593ac63c8b0 0x5593ac6490a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:22:10.924 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:22:10.847+0000 7f69512c5700 1 -- 172.21.15.163:0/4259029881 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5593ac63bf60 msgr2=0x5593ac648b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:22:10.924 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:22:10.847+0000 7f69512c5700 1 --2- 172.21.15.163:0/4259029881 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5593ac63bf60 0x5593ac648b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:22:10.924 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:22:10.847+0000 7f69512c5700 1 -- 172.21.15.163:0/4259029881 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f69440115b0 con 0x5593ac63d4b0 2023-07-14T18:22:10.924 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:22:10.847+0000 7f6950ac4700 1 --2- 172.21.15.163:0/4259029881 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5593ac63bf60 0x5593ac648b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T18:22:10.924 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:22:10.847+0000 7f69512c5700 1 --2- 172.21.15.163:0/4259029881 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5593ac63d4b0 0x5593ac64c0c0 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7f6944011e10 tx=0x7f69440077e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a562f49771c6f121 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:22:10.925 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:22:10.847+0000 7f692bfff700 10 client.0 ms_handle_connect on v2:172.21.15.163:3300/0 2023-07-14T18:22:10.925 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:22:10.847+0000 7f692bfff700 1 -- 172.21.15.163:0/4259029881 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f694401c070 con 0x5593ac63d4b0 2023-07-14T18:22:10.925 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:22:10.847+0000 7f695eec0b80 1 -- 172.21.15.163:0/4259029881 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f69400cbe90 con 0x5593ac63d4b0 2023-07-14T18:22:10.925 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:22:10.847+0000 7f692bfff700 1 -- 172.21.15.163:0/4259029881 <== mon.0 v2:172.21.15.163:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 9049+0+0 (secure 0 0 0) 0x7f6944003a00 con 0x5593ac63d4b0 2023-07-14T18:22:10.925 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:22:10.847+0000 7f692bfff700 1 -- 172.21.15.163:0/4259029881 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) v2 ==== 24+0+0 (secure 0 0 0) 0x7f694400e040 con 0x5593ac63d4b0 2023-07-14T18:22:10.926 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:22:10.847+0000 7f695eec0b80 10 client.16524 fetch_fsmap learned FSMap version 39 2023-07-14T18:22:10.926 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:22:10.847+0000 7f695eec0b80 1 -- 172.21.15.163:0/4259029881 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) v3 -- 0x7f694c1a0040 con 0x5593ac63d4b0 2023-07-14T18:22:10.926 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:22:10.848+0000 7f692bfff700 1 -- 172.21.15.163:0/4259029881 <== mon.0 v2:172.21.15.163:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f69400cbe90 con 0x5593ac63d4b0 2023-07-14T18:22:10.926 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:22:10.848+0000 7f692bfff700 1 -- 172.21.15.163:0/4259029881 <== mon.0 v2:172.21.15.163:3300/0 5 ==== fsmap(e 39) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f69440047a0 con 0x5593ac63d4b0 2023-07-14T18:22:10.926 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:22:10.848+0000 7f695eec0b80 10 client.16524 fetch_fsmap finished waiting for FSMap version 39 2023-07-14T18:22:10.926 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:22:10.848+0000 7f695eec0b80 10 client.16524 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-07-14T18:22:10.927 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:22:10.848+0000 7f695eec0b80 20 client.16524 populate_metadata read hostname 'smithi163' 2023-07-14T18:22:10.927 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:22:10.848+0000 7f695eec0b80 1 --2- 172.21.15.163:0/4259029881 >> [v2:172.21.15.172:6838/3850440096,v1:172.21.15.172:6839/3850440096] conn(0x5593ac6a5d80 0x5593ac6a8190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:22:10.927 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:22:10.848+0000 7f695eec0b80 4 client.16524 mds_command: new command op to 24518 tid=0[{"prefix": "scrub status"}] 2023-07-14T18:22:10.927 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:22:10.848+0000 7f695eec0b80 1 -- 172.21.15.163:0/4259029881 --> [v2:172.21.15.172:6838/3850440096,v1:172.21.15.172:6839/3850440096] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x5593ac585eb0 con 0x5593ac6a5d80 2023-07-14T18:22:10.928 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:22:10.849+0000 7f6950ac4700 1 --2- 172.21.15.163:0/4259029881 >> [v2:172.21.15.172:6838/3850440096,v1:172.21.15.172:6839/3850440096] conn(0x5593ac6a5d80 0x5593ac6a8190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:22:10.928 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:22:10.849+0000 7f6950ac4700 1 --2- 172.21.15.163:0/4259029881 >> [v2:172.21.15.172:6838/3850440096,v1:172.21.15.172:6839/3850440096] conn(0x5593ac6a5d80 0x5593ac6a8190 crc :-1 s=READY pgs=96 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e0e44f11567846bb server_cookie=d77e070a480bd611 in_seq=0 out_seq=0 2023-07-14T18:22:10.928 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:22:10.849+0000 7f692bfff700 10 client.16524 ms_handle_connect on v2:172.21.15.172:6838/3850440096 2023-07-14T18:22:10.928 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:22:10.849+0000 7f692bfff700 1 -- 172.21.15.163:0/4259029881 <== mds.0 v2:172.21.15.172:6838/3850440096 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x5593ac585eb0 con 0x5593ac6a5d80 2023-07-14T18:22:10.928 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:22:10.849+0000 7f692bfff700 10 client.16524 handle_command_reply: tid=0 2023-07-14T18:22:10.929 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:22:10.849+0000 7f695eec0b80 1 client.16524 shutdown 2023-07-14T18:22:10.929 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:22:10.849+0000 7f695eec0b80 1 -- 172.21.15.163:0/4259029881 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5593ac63d4b0 msgr2=0x5593ac64c0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:22:10.929 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:22:10.849+0000 7f695eec0b80 1 --2- 172.21.15.163:0/4259029881 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5593ac63d4b0 0x5593ac64c0c0 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7f6944011e10 tx=0x7f69440077e0 comp rx=0 tx=0).stop 2023-07-14T18:22:10.930 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:22:10.849+0000 7f695eec0b80 1 -- 172.21.15.163:0/4259029881 shutdown_connections 2023-07-14T18:22:10.930 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:22:10.849+0000 7f695eec0b80 1 --2- 172.21.15.163:0/4259029881 >> [v2:172.21.15.172:6838/3850440096,v1:172.21.15.172:6839/3850440096] conn(0x5593ac6a5d80 0x5593ac6a8190 crc :-1 s=READY pgs=96 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:22:10.930 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:22:10.849+0000 7f695eec0b80 1 --2- 172.21.15.163:0/4259029881 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5593ac63d4b0 0x5593ac64c0c0 unknown :-1 s=CLOSED pgs=716 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:22:10.931 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:22:10.849+0000 7f695eec0b80 1 --2- 172.21.15.163:0/4259029881 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5593ac63bf60 0x5593ac648b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:22:10.931 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:22:10.849+0000 7f695eec0b80 1 --2- 172.21.15.163:0/4259029881 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5593ac63c8b0 0x5593ac6490a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:22:10.931 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:22:10.849+0000 7f695eec0b80 1 -- 172.21.15.163:0/4259029881 >> 172.21.15.163:0/4259029881 conn(0x5593ac631680 msgr2=0x5593ac640290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:22:10.931 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:22:10.849+0000 7f692bfff700 0 client.16524 ms_handle_reset on v2:172.21.15.172:6838/3850440096 2023-07-14T18:22:10.931 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:22:10.849+0000 7f695eec0b80 1 -- 172.21.15.163:0/4259029881 shutdown_connections 2023-07-14T18:22:10.932 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:22:10.849+0000 7f695eec0b80 1 -- 172.21.15.163:0/4259029881 wait complete. 2023-07-14T18:22:10.932 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:22:10.850+0000 7f695eec0b80 20 client.16524 trim_cache size 0 max 16384 2023-07-14T18:22:10.932 INFO:teuthology.orchestra.run.smithi163.stdout:{ 2023-07-14T18:22:10.933 INFO:teuthology.orchestra.run.smithi163.stdout: "status": "IDLE (waiting for more scrubs)", 2023-07-14T18:22:10.933 INFO:teuthology.orchestra.run.smithi163.stdout: "scrubs": { 2023-07-14T18:22:10.933 INFO:teuthology.orchestra.run.smithi163.stdout: "2c53b7ef-6f30-49f0-a60d-f1f114c19d42": { 2023-07-14T18:22:10.933 INFO:teuthology.orchestra.run.smithi163.stdout: "path": "/", 2023-07-14T18:22:10.933 INFO:teuthology.orchestra.run.smithi163.stdout: "tag": "2c53b7ef-6f30-49f0-a60d-f1f114c19d42", 2023-07-14T18:22:10.933 INFO:teuthology.orchestra.run.smithi163.stdout: "options": "recursive,force" 2023-07-14T18:22:10.934 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-07-14T18:22:10.934 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-07-14T18:22:10.934 INFO:teuthology.orchestra.run.smithi163.stdout:} 2023-07-14T18:22:10.935 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:22:10.850+0000 7f6952d28700 1 -- 172.21.15.163:0/2322612654 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f693c0a11d0 msgr2=0x7f693c0a3680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:22:10.935 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:22:10.850+0000 7f6952d28700 1 --2- 172.21.15.163:0/2322612654 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f693c0a11d0 0x7f693c0a3680 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f6938009c60 tx=0x7f6938009260 comp rx=0 tx=0).stop 2023-07-14T18:22:10.936 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:22:10.850+0000 7f6952d28700 1 -- 172.21.15.163:0/2322612654 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f694c0feb10 msgr2=0x7f694c102aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:22:10.936 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:22:10.850+0000 7f6952d28700 1 --2- 172.21.15.163:0/2322612654 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f694c0feb10 0x7f694c102aa0 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7f69400098e0 tx=0x7f6940004730 comp rx=0 tx=0).stop 2023-07-14T18:22:10.936 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:22:10.850+0000 7f6952d28700 1 -- 172.21.15.163:0/2322612654 shutdown_connections 2023-07-14T18:22:10.936 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:22:10.850+0000 7f6952d28700 1 --2- 172.21.15.163:0/2322612654 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f693c0a11d0 0x7f693c0a3680 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:22:10.936 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:22:10.850+0000 7f6952d28700 1 --2- 172.21.15.163:0/2322612654 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f694c100690 0x7f694c101620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:22:10.937 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:22:10.850+0000 7f6952d28700 1 --2- 172.21.15.163:0/2322612654 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f694c0feb10 0x7f694c102aa0 unknown :-1 s=CLOSED pgs=713 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:22:10.937 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:22:10.850+0000 7f6952d28700 1 --2- 172.21.15.163:0/2322612654 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f694c0ffd00 0x7f694c1010e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:22:10.937 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:22:10.850+0000 7f6952d28700 1 -- 172.21.15.163:0/2322612654 >> 172.21.15.163:0/2322612654 conn(0x7f694c0fa130 msgr2=0x7f694c0677e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:22:10.937 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:22:10.850+0000 7f6952d28700 1 -- 172.21.15.163:0/2322612654 shutdown_connections 2023-07-14T18:22:10.937 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:22:10.850+0000 7f6952d28700 1 -- 172.21.15.163:0/2322612654 wait complete. 2023-07-14T18:22:10.938 INFO:tasks.cephfs.filesystem:scrub status for tag:2c53b7ef-6f30-49f0-a60d-f1f114c19d42 - {'path': '/', 'tag': '2c53b7ef-6f30-49f0-a60d-f1f114c19d42', 'options': 'recursive,force'} 2023-07-14T18:22:10.977 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:22:10 smithi163 ceph-mon[96576]: pgmap v585: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-07-14T18:22:11.035 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:22:10 smithi172 ceph-mon[97983]: pgmap v585: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-07-14T18:22:11.184 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:22:10 smithi184 ceph-mon[98481]: pgmap v585: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-07-14T18:22:12.227 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:22:11 smithi163 ceph-mon[96576]: pgmap v586: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-07-14T18:22:12.285 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:22:11 smithi172 ceph-mon[97983]: pgmap v586: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-07-14T18:22:12.434 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:22:11 smithi184 ceph-mon[98481]: pgmap v586: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-07-14T18:22:14.977 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:22:14 smithi163 ceph-mon[96576]: pgmap v587: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-07-14T18:22:15.035 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:22:14 smithi172 ceph-mon[97983]: pgmap v587: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-07-14T18:22:15.184 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:22:14 smithi184 ceph-mon[98481]: pgmap v587: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-07-14T18:22:16.977 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:22:16 smithi163 ceph-mon[96576]: pgmap v588: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-07-14T18:22:17.035 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:22:16 smithi172 ceph-mon[97983]: pgmap v588: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-07-14T18:22:17.184 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:22:16 smithi184 ceph-mon[98481]: pgmap v588: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-07-14T18:22:18.977 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:22:18 smithi163 ceph-mon[96576]: pgmap v589: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-07-14T18:22:19.035 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:22:18 smithi172 ceph-mon[97983]: pgmap v589: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-07-14T18:22:19.184 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:22:18 smithi184 ceph-mon[98481]: pgmap v589: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-07-14T18:22:20.977 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:22:20 smithi163 ceph-mon[96576]: pgmap v590: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-07-14T18:22:21.035 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:22:20 smithi172 ceph-mon[97983]: pgmap v590: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-07-14T18:22:21.184 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:22:20 smithi184 ceph-mon[98481]: pgmap v590: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-07-14T18:22:22.227 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:22:21 smithi163 ceph-mon[96576]: pgmap v591: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-07-14T18:22:22.285 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:22:21 smithi172 ceph-mon[97983]: pgmap v591: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-07-14T18:22:22.434 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:22:21 smithi184 ceph-mon[98481]: pgmap v591: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-07-14T18:22:24.977 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:22:24 smithi163 ceph-mon[96576]: pgmap v592: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-07-14T18:22:25.035 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:22:24 smithi172 ceph-mon[97983]: pgmap v592: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-07-14T18:22:25.184 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:22:24 smithi184 ceph-mon[98481]: pgmap v592: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-07-14T18:22:25.977 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:22:25 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-14T18:22:26.035 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:22:25 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-14T18:22:26.184 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:22:25 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-14T18:22:26.977 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:22:26 smithi163 ceph-mon[96576]: pgmap v593: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-07-14T18:22:26.977 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:22:26 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T18:22:26.978 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:22:26 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-14T18:22:26.978 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:22:26 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:22:27.035 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:22:26 smithi172 ceph-mon[97983]: pgmap v593: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-07-14T18:22:27.036 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:22:26 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T18:22:27.036 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:22:26 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-14T18:22:27.036 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:22:26 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:22:27.185 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:22:26 smithi184 ceph-mon[98481]: pgmap v593: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-07-14T18:22:27.185 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:22:26 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T18:22:27.185 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:22:26 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-14T18:22:27.185 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:22:26 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:22:28.977 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:22:28 smithi163 ceph-mon[96576]: pgmap v594: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-07-14T18:22:29.035 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:22:28 smithi172 ceph-mon[97983]: pgmap v594: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-07-14T18:22:29.184 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:22:28 smithi184 ceph-mon[98481]: pgmap v594: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-07-14T18:22:30.977 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:22:30 smithi163 ceph-mon[96576]: pgmap v595: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-07-14T18:22:31.035 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:22:30 smithi172 ceph-mon[97983]: pgmap v595: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-07-14T18:22:31.184 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:22:30 smithi184 ceph-mon[98481]: pgmap v595: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-07-14T18:22:32.227 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:22:31 smithi163 ceph-mon[96576]: pgmap v596: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-07-14T18:22:32.285 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:22:31 smithi172 ceph-mon[97983]: pgmap v596: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-07-14T18:22:32.434 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:22:31 smithi184 ceph-mon[98481]: pgmap v596: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-07-14T18:22:34.977 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:22:34 smithi163 ceph-mon[96576]: pgmap v597: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-07-14T18:22:35.036 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:22:34 smithi172 ceph-mon[97983]: pgmap v597: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-07-14T18:22:35.185 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:22:34 smithi184 ceph-mon[98481]: pgmap v597: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-07-14T18:22:36.977 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:22:36 smithi163 ceph-mon[96576]: pgmap v598: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-07-14T18:22:37.036 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:22:36 smithi172 ceph-mon[97983]: pgmap v598: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-07-14T18:22:37.185 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:22:36 smithi184 ceph-mon[98481]: pgmap v598: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-07-14T18:22:38.977 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:22:38 smithi163 ceph-mon[96576]: pgmap v599: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-07-14T18:22:39.036 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:22:38 smithi172 ceph-mon[97983]: pgmap v599: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-07-14T18:22:39.185 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:22:38 smithi184 ceph-mon[98481]: pgmap v599: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-07-14T18:22:40.938 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-07-14T18:22:40.966 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:22:40 smithi163 ceph-mon[96576]: pgmap v600: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-07-14T18:22:41.036 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:22:40 smithi172 ceph-mon[97983]: pgmap v600: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-07-14T18:22:41.087 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:22:41.036+0000 7fc96ff67700 1 -- 172.21.15.163:0/1649110598 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc9680ffd40 msgr2=0x7fc968100190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:22:41.087 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:22:41.036+0000 7fc96ff67700 1 --2- 172.21.15.163:0/1649110598 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc9680ffd40 0x7fc968100190 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7fc958009990 tx=0x7fc958009ca0 comp rx=0 tx=0).stop 2023-07-14T18:22:41.090 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:22:41.036+0000 7fc96ff67700 1 -- 172.21.15.163:0/1649110598 shutdown_connections 2023-07-14T18:22:41.090 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:22:41.036+0000 7fc96ff67700 1 --2- 172.21.15.163:0/1649110598 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc9680feb50 0x7fc9680fef60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:22:41.090 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:22:41.036+0000 7fc96ff67700 1 --2- 172.21.15.163:0/1649110598 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc9681006d0 0x7fc968106f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:22:41.090 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:22:41.036+0000 7fc96ff67700 1 --2- 172.21.15.163:0/1649110598 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc9680ffd40 0x7fc968100190 unknown :-1 s=CLOSED pgs=717 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:22:41.091 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:22:41.036+0000 7fc96ff67700 1 -- 172.21.15.163:0/1649110598 >> 172.21.15.163:0/1649110598 conn(0x7fc9680fa190 msgr2=0x7fc9680fc5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:22:41.091 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:22:41.036+0000 7fc96ff67700 1 -- 172.21.15.163:0/1649110598 shutdown_connections 2023-07-14T18:22:41.091 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:22:41.036+0000 7fc96ff67700 1 -- 172.21.15.163:0/1649110598 wait complete. 2023-07-14T18:22:41.091 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:22:41.037+0000 7fc96ff67700 1 Processor -- start 2023-07-14T18:22:41.091 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:22:41.037+0000 7fc96ff67700 1 -- start start 2023-07-14T18:22:41.092 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:22:41.037+0000 7fc96ff67700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc9680feb50 0x7fc9681947b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:22:41.092 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:22:41.037+0000 7fc96ff67700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc9680ffd40 0x7fc968194cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:22:41.092 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:22:41.037+0000 7fc96ff67700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc9681006d0 0x7fc96819bd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:22:41.093 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:22:41.037+0000 7fc96ff67700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc96819c330 con 0x7fc9680feb50 2023-07-14T18:22:41.093 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:22:41.037+0000 7fc96ff67700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc96819c470 con 0x7fc9680ffd40 2023-07-14T18:22:41.093 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:22:41.037+0000 7fc96ff67700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc96819c600 con 0x7fc9681006d0 2023-07-14T18:22:41.093 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:22:41.037+0000 7fc96dd03700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc9680feb50 0x7fc9681947b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:22:41.094 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:22:41.037+0000 7fc96dd03700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc9680feb50 0x7fc9681947b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:60120/0 (socket says 172.21.15.163:60120) 2023-07-14T18:22:41.094 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:22:41.037+0000 7fc96dd03700 1 -- 172.21.15.163:0/436802449 learned_addr learned my addr 172.21.15.163:0/436802449 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:22:41.094 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:22:41.037+0000 7fc96d502700 1 --2- 172.21.15.163:0/436802449 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc9680ffd40 0x7fc968194cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:22:41.095 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:22:41.037+0000 7fc96e504700 1 --2- 172.21.15.163:0/436802449 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc9681006d0 0x7fc96819bd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:22:41.095 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:22:41.037+0000 7fc96dd03700 1 -- 172.21.15.163:0/436802449 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc9681006d0 msgr2=0x7fc96819bd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:22:41.096 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:22:41.037+0000 7fc96dd03700 1 --2- 172.21.15.163:0/436802449 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc9681006d0 0x7fc96819bd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:22:41.096 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:22:41.037+0000 7fc96dd03700 1 -- 172.21.15.163:0/436802449 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc9680ffd40 msgr2=0x7fc968194cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:22:41.097 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:22:41.037+0000 7fc96dd03700 1 --2- 172.21.15.163:0/436802449 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc9680ffd40 0x7fc968194cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:22:41.097 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:22:41.037+0000 7fc96dd03700 1 -- 172.21.15.163:0/436802449 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9580095f0 con 0x7fc9680feb50 2023-07-14T18:22:41.097 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:22:41.038+0000 7fc96dd03700 1 --2- 172.21.15.163:0/436802449 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc9680feb50 0x7fc9681947b0 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7fc96400e970 tx=0x7fc96400ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:22:41.098 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:22:41.038+0000 7fc95effd700 1 -- 172.21.15.163:0/436802449 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc964009790 con 0x7fc9680feb50 2023-07-14T18:22:41.098 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:22:41.038+0000 7fc95effd700 1 -- 172.21.15.163:0/436802449 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fc96400c7e0 con 0x7fc9680feb50 2023-07-14T18:22:41.099 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:22:41.038+0000 7fc95effd700 1 -- 172.21.15.163:0/436802449 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc964003bd0 con 0x7fc9680feb50 2023-07-14T18:22:41.099 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:22:41.038+0000 7fc96ff67700 1 -- 172.21.15.163:0/436802449 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc96819c8e0 con 0x7fc9680feb50 2023-07-14T18:22:41.100 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:22:41.038+0000 7fc96ff67700 1 -- 172.21.15.163:0/436802449 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc96819cdf0 con 0x7fc9680feb50 2023-07-14T18:22:41.107 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:22:41.042+0000 7fc97c0ffb80 1 Processor -- start 2023-07-14T18:22:41.107 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:22:41.042+0000 7fc97c0ffb80 1 -- start start 2023-07-14T18:22:41.107 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:22:41.042+0000 7fc97c0ffb80 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5605a4d4f120 0x5605a4d4f530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:22:41.107 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:22:41.042+0000 7fc97c0ffb80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5605a4d4fa70 0x5605a4d50110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:22:41.108 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:22:41.042+0000 7fc97c0ffb80 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5605a4d506a0 0x5605a4d50b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:22:41.108 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:22:41.042+0000 7fc97c0ffb80 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x5605a4c51cb0 con 0x5605a4d4f120 2023-07-14T18:22:41.108 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:22:41.042+0000 7fc97c0ffb80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x5605a4ca4a40 con 0x5605a4d4fa70 2023-07-14T18:22:41.108 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:22:41.042+0000 7fc97c0ffb80 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x5605a4c9ded0 con 0x5605a4d506a0 2023-07-14T18:22:41.108 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:22:41.042+0000 7fc96d502700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5605a4d506a0 0x5605a4d50b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:22:41.109 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:22:41.042+0000 7fc96d502700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5605a4d506a0 0x5605a4d50b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.163:41950/0 (socket says 172.21.15.163:41950) 2023-07-14T18:22:41.109 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:22:41.042+0000 7fc96d502700 1 -- 172.21.15.163:0/1100245051 learned_addr learned my addr 172.21.15.163:0/1100245051 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:22:41.109 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:22:41.042+0000 7fc96dd03700 1 --2- 172.21.15.163:0/1100245051 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5605a4d4fa70 0x5605a4d50110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:22:41.109 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:22:41.043+0000 7fc96d502700 1 -- 172.21.15.163:0/1100245051 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5605a4d4fa70 msgr2=0x5605a4d50110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:22:41.109 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:22:41.043+0000 7fc96d502700 1 --2- 172.21.15.163:0/1100245051 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5605a4d4fa70 0x5605a4d50110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:22:41.110 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:22:41.043+0000 7fc96d502700 1 -- 172.21.15.163:0/1100245051 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5605a4d4f120 msgr2=0x5605a4d4f530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:22:41.110 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:22:41.043+0000 7fc96d502700 1 --2- 172.21.15.163:0/1100245051 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5605a4d4f120 0x5605a4d4f530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:22:41.110 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:22:41.043+0000 7fc96d502700 1 -- 172.21.15.163:0/1100245051 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5605a4acbde0 con 0x5605a4d506a0 2023-07-14T18:22:41.110 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:22:41.043+0000 7fc96d502700 1 --2- 172.21.15.163:0/1100245051 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5605a4d506a0 0x5605a4d50b10 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fc958009990 tx=0x7fc958005c90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5814b1aa0ce6ba16 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:22:41.110 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:22:41.043+0000 7fc953fff700 1 -- 172.21.15.163:0/1100245051 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc95801d070 con 0x5605a4d506a0 2023-07-14T18:22:41.111 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:22:41.043+0000 7fc953fff700 1 -- 172.21.15.163:0/1100245051 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fc95801e040 con 0x5605a4d506a0 2023-07-14T18:22:41.111 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:22:41.043+0000 7fc953fff700 1 -- 172.21.15.163:0/1100245051 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc95800b910 con 0x5605a4d506a0 2023-07-14T18:22:41.111 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:22:41.044+0000 7fc95effd700 1 -- 172.21.15.163:0/436802449 <== mon.0 v2:172.21.15.163:3300/0 4 ==== mgrmap(e 18) v1 ==== 135716+0+0 (secure 0 0 0) 0x7fc964003d70 con 0x7fc9680feb50 2023-07-14T18:22:41.111 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:22:41.044+0000 7fc97c0ffb80 1 -- 172.21.15.163:0/1100245051 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5605a4d506a0 msgr2=0x5605a4d50b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:22:41.111 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:22:41.044+0000 7fc97c0ffb80 1 --2- 172.21.15.163:0/1100245051 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5605a4d506a0 0x5605a4d50b10 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fc958009990 tx=0x7fc958005c90 comp rx=0 tx=0).stop 2023-07-14T18:22:41.112 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:22:41.044+0000 7fc97c0ffb80 1 -- 172.21.15.163:0/1100245051 shutdown_connections 2023-07-14T18:22:41.112 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:22:41.044+0000 7fc97c0ffb80 1 --2- 172.21.15.163:0/1100245051 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5605a4d506a0 0x5605a4d50b10 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:22:41.112 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:22:41.044+0000 7fc97c0ffb80 1 --2- 172.21.15.163:0/1100245051 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5605a4d4f120 0x5605a4d4f530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:22:41.112 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:22:41.044+0000 7fc97c0ffb80 1 --2- 172.21.15.163:0/1100245051 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5605a4d4fa70 0x5605a4d50110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:22:41.112 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:22:41.044+0000 7fc97c0ffb80 1 -- 172.21.15.163:0/1100245051 >> 172.21.15.163:0/1100245051 conn(0x5605a4d42680 msgr2=0x5605a4d479d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:22:41.113 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:22:41.044+0000 7fc97c0ffb80 1 -- 172.21.15.163:0/1100245051 shutdown_connections 2023-07-14T18:22:41.113 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:22:41.044+0000 7fc97c0ffb80 1 -- 172.21.15.163:0/1100245051 wait complete. 2023-07-14T18:22:41.113 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:22:41.044+0000 7fc95effd700 1 --2- 172.21.15.163:0/436802449 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7fc9540a10f0 0x7fc9540a35a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:22:41.113 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:22:41.044+0000 7fc97c0ffb80 1 -- start start 2023-07-14T18:22:41.113 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:22:41.045+0000 7fc97c0ffb80 1 Processor -- start 2023-07-14T18:22:41.114 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:22:41.045+0000 7fc96e504700 1 --2- 172.21.15.163:0/436802449 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7fc9540a10f0 0x7fc9540a35a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:22:41.114 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:22:41.045+0000 7fc95effd700 1 -- 172.21.15.163:0/436802449 <== mon.0 v2:172.21.15.163:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 9049+0+0 (secure 0 0 0) 0x7fc964014070 con 0x7fc9680feb50 2023-07-14T18:22:41.114 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:22:41.045+0000 7fc97c0ffb80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5605a4d4f120 0x5605a4d58ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:22:41.114 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:22:41.045+0000 7fc97c0ffb80 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5605a4d4fa70 0x5605a4d59000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:22:41.114 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:22:41.045+0000 7fc97c0ffb80 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5605a4d506a0 0x5605a4d60040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:22:41.115 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:22:41.045+0000 7fc97c0ffb80 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x5605a4c3dac0 con 0x5605a4d4fa70 2023-07-14T18:22:41.115 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:22:41.045+0000 7fc97c0ffb80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x5605a4c3d7c0 con 0x5605a4d4f120 2023-07-14T18:22:41.115 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:22:41.045+0000 7fc97c0ffb80 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x5605a4b21920 con 0x5605a4d506a0 2023-07-14T18:22:41.115 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:22:41.045+0000 7fc97c0ffb80 10 client.0 _ll_register_callbacks cb 0x5605a4c3b760 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T18:22:41.116 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:22:41.045+0000 7fc96e504700 1 --2- 172.21.15.163:0/436802449 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7fc9540a10f0 0x7fc9540a35a0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fc960004b10 tx=0x7fc960009920 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:22:41.116 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:22:41.045+0000 7fc96e504700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5605a4d506a0 0x5605a4d60040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:22:41.116 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:22:41.045+0000 7fc96e504700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5605a4d506a0 0x5605a4d60040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.163:41958/0 (socket says 172.21.15.163:41958) 2023-07-14T18:22:41.116 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:22:41.045+0000 7fc96d502700 1 --2- 172.21.15.163:0/2120704095 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5605a4d4fa70 0x5605a4d59000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:22:41.117 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:22:41.045+0000 7fc96e504700 1 -- 172.21.15.163:0/2120704095 learned_addr learned my addr 172.21.15.163:0/2120704095 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:22:41.117 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:22:41.045+0000 7fc96dd03700 1 --2- 172.21.15.163:0/2120704095 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5605a4d4f120 0x5605a4d58ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:22:41.117 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:22:41.046+0000 7fc96e504700 1 -- 172.21.15.163:0/2120704095 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5605a4d4f120 msgr2=0x5605a4d58ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:22:41.117 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:22:41.046+0000 7fc96e504700 1 --2- 172.21.15.163:0/2120704095 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5605a4d4f120 0x5605a4d58ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:22:41.118 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:22:41.046+0000 7fc96e504700 1 -- 172.21.15.163:0/2120704095 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5605a4d4fa70 msgr2=0x5605a4d59000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:22:41.118 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:22:41.046+0000 7fc96e504700 1 --2- 172.21.15.163:0/2120704095 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5605a4d4fa70 0x5605a4d59000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:22:41.118 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:22:41.046+0000 7fc96e504700 1 -- 172.21.15.163:0/2120704095 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9681078c0 con 0x5605a4d506a0 2023-07-14T18:22:41.118 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:22:41.046+0000 7fc96d502700 1 --2- 172.21.15.163:0/2120704095 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5605a4d4fa70 0x5605a4d59000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T18:22:41.118 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:22:41.046+0000 7fc96dd03700 1 --2- 172.21.15.163:0/2120704095 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5605a4d4f120 0x5605a4d58ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T18:22:41.118 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:22:41.046+0000 7fc96e504700 1 --2- 172.21.15.163:0/2120704095 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5605a4d506a0 0x5605a4d60040 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fc960008a90 tx=0x7fc960004b40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b256085493246a0b server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:22:41.119 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:22:41.046+0000 7fc9517fa700 10 client.0 ms_handle_connect on v2:172.21.15.184:3300/0 2023-07-14T18:22:41.119 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:22:41.046+0000 7fc9517fa700 1 -- 172.21.15.163:0/2120704095 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc960026070 con 0x5605a4d506a0 2023-07-14T18:22:41.119 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:22:41.046+0000 7fc9517fa700 1 -- 172.21.15.163:0/2120704095 <== mon.1 v2:172.21.15.184:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 9049+0+0 (secure 0 0 0) 0x7fc96000fdd0 con 0x5605a4d506a0 2023-07-14T18:22:41.119 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:22:41.046+0000 7fc97c0ffb80 1 -- 172.21.15.163:0/2120704095 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5605a4bf74f0 con 0x5605a4d506a0 2023-07-14T18:22:41.119 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:22:41.046+0000 7fc9517fa700 1 -- 172.21.15.163:0/2120704095 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc96001c040 con 0x5605a4d506a0 2023-07-14T18:22:41.120 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:22:41.046+0000 7fc97c0ffb80 10 client.26098 fetch_fsmap learned FSMap version 39 2023-07-14T18:22:41.120 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:22:41.046+0000 7fc97c0ffb80 1 -- 172.21.15.163:0/2120704095 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) v3 -- 0x5605a4ab4c60 con 0x5605a4d506a0 2023-07-14T18:22:41.120 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:22:41.047+0000 7fc9517fa700 1 -- 172.21.15.163:0/2120704095 <== mon.1 v2:172.21.15.184:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x5605a4bf74f0 con 0x5605a4d506a0 2023-07-14T18:22:41.120 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:22:41.047+0000 7fc9517fa700 1 -- 172.21.15.163:0/2120704095 <== mon.1 v2:172.21.15.184:3300/0 5 ==== fsmap(e 39) v1 ==== 7470+0+0 (secure 0 0 0) 0x7fc960029020 con 0x5605a4d506a0 2023-07-14T18:22:41.120 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:22:41.047+0000 7fc97c0ffb80 10 client.26098 fetch_fsmap finished waiting for FSMap version 39 2023-07-14T18:22:41.121 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:22:41.047+0000 7fc97c0ffb80 10 client.26098 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-07-14T18:22:41.121 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:22:41.047+0000 7fc97c0ffb80 20 client.26098 populate_metadata read hostname 'smithi163' 2023-07-14T18:22:41.121 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:22:41.047+0000 7fc97c0ffb80 1 --2- 172.21.15.163:0/2120704095 >> [v2:172.21.15.172:6838/3850440096,v1:172.21.15.172:6839/3850440096] conn(0x5605a4d628d0 0x5605a4d64cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:22:41.121 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:22:41.047+0000 7fc97c0ffb80 4 client.26098 mds_command: new command op to 24518 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-14T18:22:41.121 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:22:41.047+0000 7fc97c0ffb80 1 -- 172.21.15.163:0/2120704095 --> [v2:172.21.15.172:6838/3850440096,v1:172.21.15.172:6839/3850440096] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5605a4d1bda0 con 0x5605a4d628d0 2023-07-14T18:22:41.122 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:22:41.047+0000 7fc96dd03700 1 --2- 172.21.15.163:0/2120704095 >> [v2:172.21.15.172:6838/3850440096,v1:172.21.15.172:6839/3850440096] conn(0x5605a4d628d0 0x5605a4d64cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:22:41.122 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:22:41.047+0000 7fc9517fa700 10 client.26098 ms_handle_connect on v2:172.21.15.172:6838/3850440096 2023-07-14T18:22:41.122 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:22:41.047+0000 7fc96dd03700 1 --2- 172.21.15.163:0/2120704095 >> [v2:172.21.15.172:6838/3850440096,v1:172.21.15.172:6839/3850440096] conn(0x5605a4d628d0 0x5605a4d64cb0 crc :-1 s=READY pgs=97 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9a2676093d8764e9 server_cookie=d57aa49677b00278 in_seq=0 out_seq=0 2023-07-14T18:22:41.122 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:22:41.048+0000 7fc9517fa700 1 -- 172.21.15.163:0/2120704095 <== mds.0 v2:172.21.15.172:6838/3850440096 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18017 (crc 0 0 0) 0x5605a4d1bda0 con 0x5605a4d628d0 2023-07-14T18:22:41.122 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:22:41.048+0000 7fc9517fa700 10 client.26098 handle_command_reply: tid=0 2023-07-14T18:22:41.123 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:22:41.048+0000 7fc97c0ffb80 1 client.26098 shutdown 2023-07-14T18:22:41.123 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:22:41.048+0000 7fc97c0ffb80 1 -- 172.21.15.163:0/2120704095 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5605a4d506a0 msgr2=0x5605a4d60040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:22:41.123 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:22:41.048+0000 7fc97c0ffb80 1 --2- 172.21.15.163:0/2120704095 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5605a4d506a0 0x5605a4d60040 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fc960008a90 tx=0x7fc960004b40 comp rx=0 tx=0).stop 2023-07-14T18:22:41.124 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:22:41.048+0000 7fc97c0ffb80 1 -- 172.21.15.163:0/2120704095 shutdown_connections 2023-07-14T18:22:41.124 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:22:41.048+0000 7fc97c0ffb80 1 --2- 172.21.15.163:0/2120704095 >> [v2:172.21.15.172:6838/3850440096,v1:172.21.15.172:6839/3850440096] conn(0x5605a4d628d0 0x5605a4d64cb0 crc :-1 s=READY pgs=97 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:22:41.124 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:22:41.048+0000 7fc97c0ffb80 1 --2- 172.21.15.163:0/2120704095 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5605a4d506a0 0x5605a4d60040 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:22:41.124 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:22:41.048+0000 7fc9517fa700 0 client.26098 ms_handle_reset on v2:172.21.15.172:6838/3850440096 2023-07-14T18:22:41.125 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:22:41.048+0000 7fc97c0ffb80 1 --2- 172.21.15.163:0/2120704095 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5605a4d4f120 0x5605a4d58ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:22:41.125 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:22:41.048+0000 7fc97c0ffb80 1 --2- 172.21.15.163:0/2120704095 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5605a4d4fa70 0x5605a4d59000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:22:41.125 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:22:41.048+0000 7fc97c0ffb80 1 -- 172.21.15.163:0/2120704095 >> 172.21.15.163:0/2120704095 conn(0x5605a4d42680 msgr2=0x5605a4d46650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:22:41.125 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:22:41.048+0000 7fc97c0ffb80 1 -- 172.21.15.163:0/2120704095 shutdown_connections 2023-07-14T18:22:41.125 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:22:41.048+0000 7fc97c0ffb80 1 -- 172.21.15.163:0/2120704095 wait complete. 2023-07-14T18:22:41.126 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:22:41.049+0000 7fc97c0ffb80 20 client.26098 trim_cache size 0 max 16384 2023-07-14T18:22:41.130 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:22:41.066+0000 7fc97c0ffb80 1 Processor -- start 2023-07-14T18:22:41.130 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:22:41.066+0000 7fc97c0ffb80 1 -- start start 2023-07-14T18:22:41.130 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:22:41.066+0000 7fc97c0ffb80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5605a4d4f120 0x5605a4d57860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:22:41.131 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:22:41.066+0000 7fc97c0ffb80 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5605a4d4fa70 0x5605a4d60000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:22:41.131 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:22:41.066+0000 7fc97c0ffb80 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5605a4d506a0 0x5605a4d4cf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:22:41.131 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:22:41.066+0000 7fc97c0ffb80 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x5605a4d59c40 con 0x5605a4d4fa70 2023-07-14T18:22:41.131 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:22:41.066+0000 7fc97c0ffb80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x5605a4d59740 con 0x5605a4d4f120 2023-07-14T18:22:41.132 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:22:41.066+0000 7fc97c0ffb80 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x5605a4d48780 con 0x5605a4d506a0 2023-07-14T18:22:41.132 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:22:41.066+0000 7fc96d502700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5605a4d4fa70 0x5605a4d60000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:22:41.132 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:22:41.066+0000 7fc96dd03700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5605a4d4f120 0x5605a4d57860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:22:41.132 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:22:41.066+0000 7fc96d502700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5605a4d4fa70 0x5605a4d60000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:60144/0 (socket says 172.21.15.163:60144) 2023-07-14T18:22:41.133 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:22:41.066+0000 7fc96dd03700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5605a4d4f120 0x5605a4d57860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.163:60826/0 (socket says 172.21.15.163:60826) 2023-07-14T18:22:41.133 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:22:41.066+0000 7fc96e504700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5605a4d506a0 0x5605a4d4cf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:22:41.133 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:22:41.066+0000 7fc96d502700 1 -- 172.21.15.163:0/1012733347 learned_addr learned my addr 172.21.15.163:0/1012733347 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:22:41.133 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:22:41.067+0000 7fc96d502700 1 -- 172.21.15.163:0/1012733347 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5605a4d506a0 msgr2=0x5605a4d4cf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:22:41.133 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:22:41.067+0000 7fc96d502700 1 --2- 172.21.15.163:0/1012733347 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5605a4d506a0 0x5605a4d4cf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:22:41.134 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:22:41.067+0000 7fc96d502700 1 -- 172.21.15.163:0/1012733347 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5605a4d4f120 msgr2=0x5605a4d57860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:22:41.134 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:22:41.067+0000 7fc96d502700 1 --2- 172.21.15.163:0/1012733347 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5605a4d4f120 0x5605a4d57860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:22:41.134 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:22:41.067+0000 7fc96d502700 1 -- 172.21.15.163:0/1012733347 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5605a4af2250 con 0x5605a4d4fa70 2023-07-14T18:22:41.134 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:22:41.067+0000 7fc96dd03700 1 --2- 172.21.15.163:0/1012733347 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5605a4d4f120 0x5605a4d57860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T18:22:41.135 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:22:41.067+0000 7fc96e504700 1 --2- 172.21.15.163:0/1012733347 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5605a4d506a0 0x5605a4d4cf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T18:22:41.135 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:22:41.067+0000 7fc96d502700 1 --2- 172.21.15.163:0/1012733347 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5605a4d4fa70 0x5605a4d60000 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7fc958009990 tx=0x7fc958005a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=44225330c27f2a01 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:22:41.135 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:22:41.067+0000 7fc95cff9700 1 -- 172.21.15.163:0/1012733347 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc95801d040 con 0x5605a4d4fa70 2023-07-14T18:22:41.135 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:22:41.067+0000 7fc95cff9700 1 -- 172.21.15.163:0/1012733347 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fc958031070 con 0x5605a4d4fa70 2023-07-14T18:22:41.136 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:22:41.067+0000 7fc95cff9700 1 -- 172.21.15.163:0/1012733347 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc95800bd70 con 0x5605a4d4fa70 2023-07-14T18:22:41.136 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:22:41.068+0000 7fc97c0ffb80 1 -- 172.21.15.163:0/1012733347 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5605a4d4fa70 msgr2=0x5605a4d60000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:22:41.136 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:22:41.068+0000 7fc97c0ffb80 1 --2- 172.21.15.163:0/1012733347 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5605a4d4fa70 0x5605a4d60000 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7fc958009990 tx=0x7fc958005a00 comp rx=0 tx=0).stop 2023-07-14T18:22:41.136 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:22:41.068+0000 7fc97c0ffb80 1 -- 172.21.15.163:0/1012733347 shutdown_connections 2023-07-14T18:22:41.137 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:22:41.068+0000 7fc97c0ffb80 1 --2- 172.21.15.163:0/1012733347 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5605a4d506a0 0x5605a4d4cf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:22:41.137 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:22:41.068+0000 7fc97c0ffb80 1 --2- 172.21.15.163:0/1012733347 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5605a4d4f120 0x5605a4d57860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:22:41.137 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:22:41.068+0000 7fc97c0ffb80 1 --2- 172.21.15.163:0/1012733347 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5605a4d4fa70 0x5605a4d60000 unknown :-1 s=CLOSED pgs=719 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:22:41.138 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:22:41.068+0000 7fc97c0ffb80 1 -- 172.21.15.163:0/1012733347 >> 172.21.15.163:0/1012733347 conn(0x5605a4d42680 msgr2=0x5605a4d64cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:22:41.138 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:22:41.068+0000 7fc97c0ffb80 1 -- 172.21.15.163:0/1012733347 shutdown_connections 2023-07-14T18:22:41.139 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:22:41.068+0000 7fc97c0ffb80 1 -- 172.21.15.163:0/1012733347 wait complete. 2023-07-14T18:22:41.139 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:22:41.068+0000 7fc97c0ffb80 1 -- start start 2023-07-14T18:22:41.140 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:22:41.068+0000 7fc97c0ffb80 1 Processor -- start 2023-07-14T18:22:41.140 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:22:41.069+0000 7fc97c0ffb80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5605a4d4f120 0x5605a4d5b830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:22:41.141 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:22:41.069+0000 7fc97c0ffb80 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5605a4d4fa70 0x5605a4d5bd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:22:41.141 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:22:41.069+0000 7fc97c0ffb80 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5605a4d506a0 0x5605a4d5ed30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:22:41.141 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:22:41.069+0000 7fc97c0ffb80 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x5605a4d5f270 con 0x5605a4d4fa70 2023-07-14T18:22:41.142 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:22:41.069+0000 7fc97c0ffb80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x5605a4d5f3e0 con 0x5605a4d4f120 2023-07-14T18:22:41.142 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:22:41.069+0000 7fc97c0ffb80 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x5605a4d5f5a0 con 0x5605a4d506a0 2023-07-14T18:22:41.142 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:22:41.069+0000 7fc97c0ffb80 10 client.0 _ll_register_callbacks cb 0x7fc9600093e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T18:22:41.142 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:22:41.069+0000 7fc96d502700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5605a4d4fa70 0x5605a4d5bd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:22:41.143 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:22:41.069+0000 7fc96dd03700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5605a4d4f120 0x5605a4d5b830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:22:41.143 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:22:41.069+0000 7fc96d502700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5605a4d4fa70 0x5605a4d5bd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:60150/0 (socket says 172.21.15.163:60150) 2023-07-14T18:22:41.143 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:22:41.069+0000 7fc96dd03700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5605a4d4f120 0x5605a4d5b830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.163:60832/0 (socket says 172.21.15.163:60832) 2023-07-14T18:22:41.143 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:22:41.069+0000 7fc96e504700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5605a4d506a0 0x5605a4d5ed30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:22:41.143 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:22:41.069+0000 7fc96d502700 1 -- 172.21.15.163:0/3534609579 learned_addr learned my addr 172.21.15.163:0/3534609579 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:22:41.144 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:22:41.069+0000 7fc96d502700 1 -- 172.21.15.163:0/3534609579 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5605a4d506a0 msgr2=0x5605a4d5ed30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:22:41.144 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:22:41.069+0000 7fc96d502700 1 --2- 172.21.15.163:0/3534609579 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5605a4d506a0 0x5605a4d5ed30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:22:41.144 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:22:41.069+0000 7fc96d502700 1 -- 172.21.15.163:0/3534609579 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5605a4d4f120 msgr2=0x5605a4d5b830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:22:41.144 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:22:41.069+0000 7fc96d502700 1 --2- 172.21.15.163:0/3534609579 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5605a4d4f120 0x5605a4d5b830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:22:41.144 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:22:41.069+0000 7fc96d502700 1 -- 172.21.15.163:0/3534609579 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc96819cdf0 con 0x5605a4d4fa70 2023-07-14T18:22:41.145 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:22:41.069+0000 7fc96e504700 1 --2- 172.21.15.163:0/3534609579 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5605a4d506a0 0x5605a4d5ed30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T18:22:41.145 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:22:41.069+0000 7fc96d502700 1 --2- 172.21.15.163:0/3534609579 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5605a4d4fa70 0x5605a4d5bd70 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7fc958009ce0 tx=0x7fc95800b730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bdc428b23b89eaf1 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:22:41.145 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:22:41.069+0000 7fc9517fa700 10 client.0 ms_handle_connect on v2:172.21.15.163:3300/0 2023-07-14T18:22:41.145 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:22:41.069+0000 7fc9517fa700 1 -- 172.21.15.163:0/3534609579 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc95801d040 con 0x5605a4d4fa70 2023-07-14T18:22:41.145 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:22:41.070+0000 7fc97c0ffb80 1 -- 172.21.15.163:0/3534609579 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fc95801e040 con 0x5605a4d4fa70 2023-07-14T18:22:41.146 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:22:41.070+0000 7fc9517fa700 1 -- 172.21.15.163:0/3534609579 <== mon.0 v2:172.21.15.163:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 9049+0+0 (secure 0 0 0) 0x7fc95800baf0 con 0x5605a4d4fa70 2023-07-14T18:22:41.146 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:22:41.070+0000 7fc9517fa700 1 -- 172.21.15.163:0/3534609579 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc95800bcb0 con 0x5605a4d4fa70 2023-07-14T18:22:41.146 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:22:41.070+0000 7fc97c0ffb80 10 client.16539 fetch_fsmap learned FSMap version 39 2023-07-14T18:22:41.146 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:22:41.070+0000 7fc97c0ffb80 1 -- 172.21.15.163:0/3534609579 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) v3 -- 0x5605a4ab4c60 con 0x5605a4d4fa70 2023-07-14T18:22:41.146 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:22:41.070+0000 7fc9517fa700 1 -- 172.21.15.163:0/3534609579 <== mon.0 v2:172.21.15.163:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fc95801e040 con 0x5605a4d4fa70 2023-07-14T18:22:41.147 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:22:41.070+0000 7fc9517fa700 1 -- 172.21.15.163:0/3534609579 <== mon.0 v2:172.21.15.163:3300/0 5 ==== fsmap(e 39) v1 ==== 7470+0+0 (secure 0 0 0) 0x7fc9580048b0 con 0x5605a4d4fa70 2023-07-14T18:22:41.147 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:22:41.070+0000 7fc97c0ffb80 10 client.16539 fetch_fsmap finished waiting for FSMap version 39 2023-07-14T18:22:41.147 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:22:41.070+0000 7fc97c0ffb80 10 client.16539 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-07-14T18:22:41.147 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:22:41.070+0000 7fc97c0ffb80 20 client.16539 populate_metadata read hostname 'smithi163' 2023-07-14T18:22:41.147 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:22:41.070+0000 7fc97c0ffb80 1 --2- 172.21.15.163:0/3534609579 >> [v2:172.21.15.172:6838/3850440096,v1:172.21.15.172:6839/3850440096] conn(0x5605a4d628d0 0x5605a4db8910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:22:41.148 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:22:41.070+0000 7fc97c0ffb80 4 client.16539 mds_command: new command op to 24518 tid=0[{"prefix": "scrub status"}] 2023-07-14T18:22:41.148 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:22:41.070+0000 7fc97c0ffb80 1 -- 172.21.15.163:0/3534609579 --> [v2:172.21.15.172:6838/3850440096,v1:172.21.15.172:6839/3850440096] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x5605a4c96eb0 con 0x5605a4d628d0 2023-07-14T18:22:41.148 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:22:41.070+0000 7fc96dd03700 1 --2- 172.21.15.163:0/3534609579 >> [v2:172.21.15.172:6838/3850440096,v1:172.21.15.172:6839/3850440096] conn(0x5605a4d628d0 0x5605a4db8910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:22:41.148 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:22:41.071+0000 7fc9517fa700 10 client.16539 ms_handle_connect on v2:172.21.15.172:6838/3850440096 2023-07-14T18:22:41.148 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:22:41.071+0000 7fc96dd03700 1 --2- 172.21.15.163:0/3534609579 >> [v2:172.21.15.172:6838/3850440096,v1:172.21.15.172:6839/3850440096] conn(0x5605a4d628d0 0x5605a4db8910 crc :-1 s=READY pgs=98 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fccafd9ff27a05b0 server_cookie=f804d2dba94f5823 in_seq=0 out_seq=0 2023-07-14T18:22:41.149 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:22:41.071+0000 7fc9517fa700 1 -- 172.21.15.163:0/3534609579 <== mds.0 v2:172.21.15.172:6838/3850440096 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x5605a4c96eb0 con 0x5605a4d628d0 2023-07-14T18:22:41.149 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:22:41.071+0000 7fc9517fa700 10 client.16539 handle_command_reply: tid=0 2023-07-14T18:22:41.149 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:22:41.071+0000 7fc97c0ffb80 1 client.16539 shutdown 2023-07-14T18:22:41.149 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:22:41.071+0000 7fc97c0ffb80 1 -- 172.21.15.163:0/3534609579 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5605a4d4fa70 msgr2=0x5605a4d5bd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:22:41.149 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:22:41.071+0000 7fc97c0ffb80 1 --2- 172.21.15.163:0/3534609579 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5605a4d4fa70 0x5605a4d5bd70 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7fc958009ce0 tx=0x7fc95800b730 comp rx=0 tx=0).stop 2023-07-14T18:22:41.150 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:22:41.071+0000 7fc97c0ffb80 1 -- 172.21.15.163:0/3534609579 shutdown_connections 2023-07-14T18:22:41.150 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:22:41.071+0000 7fc97c0ffb80 1 --2- 172.21.15.163:0/3534609579 >> [v2:172.21.15.172:6838/3850440096,v1:172.21.15.172:6839/3850440096] conn(0x5605a4d628d0 0x5605a4db8910 crc :-1 s=READY pgs=98 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:22:41.150 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:22:41.071+0000 7fc97c0ffb80 1 --2- 172.21.15.163:0/3534609579 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5605a4d506a0 0x5605a4d5ed30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:22:41.150 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:22:41.071+0000 7fc97c0ffb80 1 --2- 172.21.15.163:0/3534609579 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5605a4d4f120 0x5605a4d5b830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:22:41.150 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:22:41.071+0000 7fc9517fa700 0 client.16539 ms_handle_reset on v2:172.21.15.172:6838/3850440096 2023-07-14T18:22:41.151 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:22:41.071+0000 7fc97c0ffb80 1 --2- 172.21.15.163:0/3534609579 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5605a4d4fa70 0x5605a4d5bd70 unknown :-1 s=CLOSED pgs=720 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:22:41.151 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:22:41.071+0000 7fc97c0ffb80 1 -- 172.21.15.163:0/3534609579 >> 172.21.15.163:0/3534609579 conn(0x5605a4d42680 msgr2=0x5605a4d4cf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:22:41.151 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:22:41.071+0000 7fc97c0ffb80 1 -- 172.21.15.163:0/3534609579 shutdown_connections 2023-07-14T18:22:41.151 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:22:41.071+0000 7fc97c0ffb80 1 -- 172.21.15.163:0/3534609579 wait complete. 2023-07-14T18:22:41.151 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:22:41.071+0000 7fc97c0ffb80 20 client.16539 trim_cache size 0 max 16384 2023-07-14T18:22:41.152 INFO:teuthology.orchestra.run.smithi163.stdout:{ 2023-07-14T18:22:41.152 INFO:teuthology.orchestra.run.smithi163.stdout: "status": "IDLE (waiting for more scrubs)", 2023-07-14T18:22:41.152 INFO:teuthology.orchestra.run.smithi163.stdout: "scrubs": { 2023-07-14T18:22:41.153 INFO:teuthology.orchestra.run.smithi163.stdout: "2c53b7ef-6f30-49f0-a60d-f1f114c19d42": { 2023-07-14T18:22:41.153 INFO:teuthology.orchestra.run.smithi163.stdout: "path": "/", 2023-07-14T18:22:41.153 INFO:teuthology.orchestra.run.smithi163.stdout: "tag": "2c53b7ef-6f30-49f0-a60d-f1f114c19d42", 2023-07-14T18:22:41.153 INFO:teuthology.orchestra.run.smithi163.stdout: "options": "recursive,force" 2023-07-14T18:22:41.153 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-07-14T18:22:41.154 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-07-14T18:22:41.154 INFO:teuthology.orchestra.run.smithi163.stdout:} 2023-07-14T18:22:41.155 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:22:41.072+0000 7fc96ff67700 1 -- 172.21.15.163:0/436802449 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7fc9540a10f0 msgr2=0x7fc9540a35a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:22:41.155 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:22:41.072+0000 7fc96ff67700 1 --2- 172.21.15.163:0/436802449 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7fc9540a10f0 0x7fc9540a35a0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fc960004b10 tx=0x7fc960009920 comp rx=0 tx=0).stop 2023-07-14T18:22:41.155 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:22:41.072+0000 7fc96ff67700 1 -- 172.21.15.163:0/436802449 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc9680feb50 msgr2=0x7fc9681947b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:22:41.156 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:22:41.072+0000 7fc96ff67700 1 --2- 172.21.15.163:0/436802449 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc9680feb50 0x7fc9681947b0 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7fc96400e970 tx=0x7fc96400ec80 comp rx=0 tx=0).stop 2023-07-14T18:22:41.156 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:22:41.072+0000 7fc96ff67700 1 -- 172.21.15.163:0/436802449 shutdown_connections 2023-07-14T18:22:41.156 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:22:41.072+0000 7fc96ff67700 1 --2- 172.21.15.163:0/436802449 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7fc9540a10f0 0x7fc9540a35a0 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:22:41.156 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:22:41.072+0000 7fc96ff67700 1 --2- 172.21.15.163:0/436802449 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc9681006d0 0x7fc96819bd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:22:41.156 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:22:41.072+0000 7fc96ff67700 1 --2- 172.21.15.163:0/436802449 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fc9680feb50 0x7fc9681947b0 unknown :-1 s=CLOSED pgs=718 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:22:41.157 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:22:41.072+0000 7fc96ff67700 1 --2- 172.21.15.163:0/436802449 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc9680ffd40 0x7fc968194cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:22:41.157 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:22:41.072+0000 7fc96ff67700 1 -- 172.21.15.163:0/436802449 >> 172.21.15.163:0/436802449 conn(0x7fc9680fa190 msgr2=0x7fc9680fc410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:22:41.157 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:22:41.072+0000 7fc96ff67700 1 -- 172.21.15.163:0/436802449 shutdown_connections 2023-07-14T18:22:41.157 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:22:41.072+0000 7fc96ff67700 1 -- 172.21.15.163:0/436802449 wait complete. 2023-07-14T18:22:41.158 INFO:tasks.cephfs.filesystem:scrub status for tag:2c53b7ef-6f30-49f0-a60d-f1f114c19d42 - {'path': '/', 'tag': '2c53b7ef-6f30-49f0-a60d-f1f114c19d42', 'options': 'recursive,force'} 2023-07-14T18:22:41.185 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:22:40 smithi184 ceph-mon[98481]: pgmap v600: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-07-14T18:22:42.227 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:22:41 smithi163 ceph-mon[96576]: pgmap v601: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-07-14T18:22:42.286 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:22:41 smithi172 ceph-mon[97983]: pgmap v601: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-07-14T18:22:42.435 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:22:41 smithi184 ceph-mon[98481]: pgmap v601: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-07-14T18:22:44.977 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:22:44 smithi163 ceph-mon[96576]: pgmap v602: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-07-14T18:22:45.036 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:22:44 smithi172 ceph-mon[97983]: pgmap v602: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-07-14T18:22:45.185 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:22:44 smithi184 ceph-mon[98481]: pgmap v602: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-07-14T18:22:46.977 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:22:46 smithi163 ceph-mon[96576]: pgmap v603: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-07-14T18:22:47.036 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:22:46 smithi172 ceph-mon[97983]: pgmap v603: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-07-14T18:22:47.185 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:22:46 smithi184 ceph-mon[98481]: pgmap v603: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-07-14T18:22:48.977 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:22:48 smithi163 ceph-mon[96576]: pgmap v604: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-07-14T18:22:49.036 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:22:48 smithi172 ceph-mon[97983]: pgmap v604: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-07-14T18:22:49.185 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:22:48 smithi184 ceph-mon[98481]: pgmap v604: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-07-14T18:22:50.977 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:22:50 smithi163 ceph-mon[96576]: pgmap v605: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-07-14T18:22:51.036 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:22:50 smithi172 ceph-mon[97983]: pgmap v605: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-07-14T18:22:51.185 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:22:50 smithi184 ceph-mon[98481]: pgmap v605: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-07-14T18:22:52.228 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:22:51 smithi163 ceph-mon[96576]: pgmap v606: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-07-14T18:22:52.286 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:22:51 smithi172 ceph-mon[97983]: pgmap v606: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-07-14T18:22:52.435 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:22:51 smithi184 ceph-mon[98481]: pgmap v606: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-07-14T18:22:54.977 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:22:54 smithi163 ceph-mon[96576]: pgmap v607: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-07-14T18:22:55.036 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:22:54 smithi172 ceph-mon[97983]: pgmap v607: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-07-14T18:22:55.185 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:22:54 smithi184 ceph-mon[98481]: pgmap v607: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-07-14T18:22:56.977 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:22:56 smithi163 ceph-mon[96576]: pgmap v608: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-07-14T18:22:57.036 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:22:56 smithi172 ceph-mon[97983]: pgmap v608: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-07-14T18:22:57.185 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:22:56 smithi184 ceph-mon[98481]: pgmap v608: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-07-14T18:22:58.977 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:22:58 smithi163 ceph-mon[96576]: pgmap v609: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-07-14T18:22:59.036 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:22:58 smithi172 ceph-mon[97983]: pgmap v609: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-07-14T18:22:59.185 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:22:58 smithi184 ceph-mon[98481]: pgmap v609: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-07-14T18:23:00.977 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:23:00 smithi163 ceph-mon[96576]: pgmap v610: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-07-14T18:23:01.036 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:23:00 smithi172 ceph-mon[97983]: pgmap v610: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-07-14T18:23:01.185 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:23:00 smithi184 ceph-mon[98481]: pgmap v610: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-07-14T18:23:02.228 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:23:01 smithi163 ceph-mon[96576]: pgmap v611: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-07-14T18:23:02.286 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:23:01 smithi172 ceph-mon[97983]: pgmap v611: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-07-14T18:23:02.435 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:23:01 smithi184 ceph-mon[98481]: pgmap v611: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-07-14T18:23:04.977 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:23:04 smithi163 ceph-mon[96576]: pgmap v612: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-07-14T18:23:05.036 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:23:04 smithi172 ceph-mon[97983]: pgmap v612: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-07-14T18:23:05.185 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:23:04 smithi184 ceph-mon[98481]: pgmap v612: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-07-14T18:23:06.977 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:23:06 smithi163 ceph-mon[96576]: pgmap v613: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-07-14T18:23:07.036 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:23:06 smithi172 ceph-mon[97983]: pgmap v613: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-07-14T18:23:07.185 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:23:06 smithi184 ceph-mon[98481]: pgmap v613: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-07-14T18:23:08.978 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:23:08 smithi163 ceph-mon[96576]: pgmap v614: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-07-14T18:23:09.036 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:23:08 smithi172 ceph-mon[97983]: pgmap v614: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-07-14T18:23:09.185 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:23:08 smithi184 ceph-mon[98481]: pgmap v614: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-07-14T18:23:10.978 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:23:10 smithi163 ceph-mon[96576]: pgmap v615: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-07-14T18:23:11.036 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:23:10 smithi172 ceph-mon[97983]: pgmap v615: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-07-14T18:23:11.159 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-07-14T18:23:11.185 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:23:10 smithi184 ceph-mon[98481]: pgmap v615: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-07-14T18:23:11.315 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:23:11.263+0000 7f9830924700 1 -- 172.21.15.163:0/2547071422 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f982c105990 msgr2=0x7f982c107d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:23:11.316 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:23:11.263+0000 7f9830924700 1 --2- 172.21.15.163:0/2547071422 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f982c105990 0x7f982c107d70 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7f982400b0a0 tx=0x7f982400b3b0 comp rx=0 tx=0).stop 2023-07-14T18:23:11.316 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:23:11.263+0000 7f9830924700 1 -- 172.21.15.163:0/2547071422 shutdown_connections 2023-07-14T18:23:11.316 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:23:11.263+0000 7f9830924700 1 --2- 172.21.15.163:0/2547071422 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f982c100750 0x7f982c102b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:23:11.317 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:23:11.263+0000 7f9830924700 1 --2- 172.21.15.163:0/2547071422 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f982c105990 0x7f982c107d70 unknown :-1 s=CLOSED pgs=721 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:23:11.318 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:23:11.263+0000 7f9830924700 1 --2- 172.21.15.163:0/2547071422 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f982c103070 0x7f982c105450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:23:11.320 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:23:11.263+0000 7f9830924700 1 -- 172.21.15.163:0/2547071422 >> 172.21.15.163:0/2547071422 conn(0x7f982c0fa130 msgr2=0x7f982c0fc560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:23:11.320 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:23:11.263+0000 7f9830924700 1 -- 172.21.15.163:0/2547071422 shutdown_connections 2023-07-14T18:23:11.321 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:23:11.263+0000 7f9830924700 1 -- 172.21.15.163:0/2547071422 wait complete. 2023-07-14T18:23:11.329 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:23:11.264+0000 7f9830924700 1 Processor -- start 2023-07-14T18:23:11.330 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:23:11.264+0000 7f9830924700 1 -- start start 2023-07-14T18:23:11.330 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:23:11.264+0000 7f9830924700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f982c100750 0x7f982c1000c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:23:11.330 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:23:11.264+0000 7f9830924700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f982c103070 0x7f982c0fe700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:23:11.330 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:23:11.264+0000 7f9830924700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f982c105990 0x7f982c0fec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:23:11.330 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:23:11.264+0000 7f9830924700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f982c0ff3e0 con 0x7f982c100750 2023-07-14T18:23:11.331 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:23:11.264+0000 7f9830924700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f982c0ff550 con 0x7f982c103070 2023-07-14T18:23:11.331 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:23:11.264+0000 7f9830924700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f982c19f9a0 con 0x7f982c105990 2023-07-14T18:23:11.331 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:23:11.264+0000 7f982a59c700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f982c100750 0x7f982c1000c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:23:11.331 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:23:11.264+0000 7f982a59c700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f982c100750 0x7f982c1000c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:60162/0 (socket says 172.21.15.163:60162) 2023-07-14T18:23:11.331 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:23:11.264+0000 7f982a59c700 1 -- 172.21.15.163:0/3289266644 learned_addr learned my addr 172.21.15.163:0/3289266644 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:23:11.332 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:23:11.264+0000 7f9829d9b700 1 --2- 172.21.15.163:0/3289266644 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f982c103070 0x7f982c0fe700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:23:11.332 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:23:11.264+0000 7f982ad9d700 1 --2- 172.21.15.163:0/3289266644 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f982c105990 0x7f982c0fec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:23:11.332 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:23:11.265+0000 7f982a59c700 1 -- 172.21.15.163:0/3289266644 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f982c105990 msgr2=0x7f982c0fec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:23:11.332 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:23:11.265+0000 7f982a59c700 1 --2- 172.21.15.163:0/3289266644 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f982c105990 0x7f982c0fec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:23:11.332 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:23:11.265+0000 7f982a59c700 1 -- 172.21.15.163:0/3289266644 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f982c103070 msgr2=0x7f982c0fe700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:23:11.333 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:23:11.265+0000 7f982a59c700 1 --2- 172.21.15.163:0/3289266644 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f982c103070 0x7f982c0fe700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:23:11.333 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:23:11.265+0000 7f982a59c700 1 -- 172.21.15.163:0/3289266644 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9820009520 con 0x7f982c100750 2023-07-14T18:23:11.333 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:23:11.265+0000 7f9829d9b700 1 --2- 172.21.15.163:0/3289266644 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f982c103070 0x7f982c0fe700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T18:23:11.333 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:23:11.265+0000 7f982a59c700 1 --2- 172.21.15.163:0/3289266644 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f982c100750 0x7f982c1000c0 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7f981c00e9a0 tx=0x7f981c00ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:23:11.333 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:23:11.265+0000 7f981b7fe700 1 -- 172.21.15.163:0/3289266644 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f981c009790 con 0x7f982c100750 2023-07-14T18:23:11.334 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:23:11.265+0000 7f981b7fe700 1 -- 172.21.15.163:0/3289266644 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f981c010430 con 0x7f982c100750 2023-07-14T18:23:11.334 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:23:11.265+0000 7f981b7fe700 1 -- 172.21.15.163:0/3289266644 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f981c00cea0 con 0x7f982c100750 2023-07-14T18:23:11.334 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:23:11.265+0000 7f9830924700 1 -- 172.21.15.163:0/3289266644 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9824009d00 con 0x7f982c100750 2023-07-14T18:23:11.334 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:23:11.265+0000 7f9830924700 1 -- 172.21.15.163:0/3289266644 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f982c19ffb0 con 0x7f982c100750 2023-07-14T18:23:11.334 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:23:11.267+0000 7f981b7fe700 1 -- 172.21.15.163:0/3289266644 <== mon.0 v2:172.21.15.163:3300/0 4 ==== mgrmap(e 18) v1 ==== 135716+0+0 (secure 0 0 0) 0x7f981c0105a0 con 0x7f982c100750 2023-07-14T18:23:11.335 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:23:11.268+0000 7f981b7fe700 1 --2- 172.21.15.163:0/3289266644 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f98140a1150 0x7f98140a3600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:23:11.335 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:23:11.268+0000 7f9829d9b700 1 --2- 172.21.15.163:0/3289266644 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f98140a1150 0x7f98140a3600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:23:11.335 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:23:11.268+0000 7f981b7fe700 1 -- 172.21.15.163:0/3289266644 <== mon.0 v2:172.21.15.163:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 9049+0+0 (secure 0 0 0) 0x7f981c014070 con 0x7f982c100750 2023-07-14T18:23:11.335 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:23:11.269+0000 7f9829d9b700 1 --2- 172.21.15.163:0/3289266644 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f98140a1150 0x7f98140a3600 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f9820009fd0 tx=0x7f9820009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:23:11.335 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:23:11.269+0000 7f983cabcb80 1 Processor -- start 2023-07-14T18:23:11.336 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:23:11.269+0000 7f983cabcb80 1 -- start start 2023-07-14T18:23:11.336 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:23:11.270+0000 7f983cabcb80 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x56173a416f60 0x56173a417370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:23:11.336 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:23:11.270+0000 7f983cabcb80 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56173a4178b0 0x56173a417ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:23:11.336 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:23:11.270+0000 7f983cabcb80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56173a4184b0 0x56173a418920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:23:11.336 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:23:11.270+0000 7f983cabcb80 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x56173a31bcb0 con 0x56173a416f60 2023-07-14T18:23:11.337 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:23:11.270+0000 7f983cabcb80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x56173a36ea40 con 0x56173a4184b0 2023-07-14T18:23:11.337 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:23:11.270+0000 7f983cabcb80 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x56173a367ed0 con 0x56173a4178b0 2023-07-14T18:23:11.337 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:23:11.270+0000 7f982a59c700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x56173a416f60 0x56173a417370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:23:11.337 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:23:11.270+0000 7f982a59c700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x56173a416f60 0x56173a417370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:60170/0 (socket says 172.21.15.163:60170) 2023-07-14T18:23:11.337 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:23:11.270+0000 7f9829d9b700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56173a4178b0 0x56173a417ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:23:11.338 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:23:11.270+0000 7f982a59c700 1 -- 172.21.15.163:0/2107083329 learned_addr learned my addr 172.21.15.163:0/2107083329 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:23:11.338 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:23:11.270+0000 7f982ad9d700 1 --2- 172.21.15.163:0/2107083329 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56173a4184b0 0x56173a418920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:23:11.338 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:23:11.270+0000 7f9829d9b700 1 -- 172.21.15.163:0/2107083329 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56173a4184b0 msgr2=0x56173a418920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:23:11.338 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:23:11.270+0000 7f9829d9b700 1 --2- 172.21.15.163:0/2107083329 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56173a4184b0 0x56173a418920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:23:11.338 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:23:11.270+0000 7f9829d9b700 1 -- 172.21.15.163:0/2107083329 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x56173a416f60 msgr2=0x56173a417370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:23:11.339 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:23:11.270+0000 7f9829d9b700 1 --2- 172.21.15.163:0/2107083329 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x56173a416f60 0x56173a417370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:23:11.339 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:23:11.270+0000 7f9829d9b700 1 -- 172.21.15.163:0/2107083329 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56173a195de0 con 0x56173a4178b0 2023-07-14T18:23:11.339 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:23:11.270+0000 7f982a59c700 1 --2- 172.21.15.163:0/2107083329 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x56173a416f60 0x56173a417370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T18:23:11.339 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:23:11.270+0000 7f982ad9d700 1 --2- 172.21.15.163:0/2107083329 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56173a4184b0 0x56173a418920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T18:23:11.339 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:23:11.270+0000 7f9829d9b700 1 --2- 172.21.15.163:0/2107083329 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56173a4178b0 0x56173a417ed0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f9820011d50 tx=0x7f9820014000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=853bd816a2e24e36 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:23:11.340 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:23:11.270+0000 7f9818ff9700 1 -- 172.21.15.163:0/2107083329 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f982001b600 con 0x56173a4178b0 2023-07-14T18:23:11.340 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:23:11.270+0000 7f9818ff9700 1 -- 172.21.15.163:0/2107083329 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f982000ee40 con 0x56173a4178b0 2023-07-14T18:23:11.340 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:23:11.270+0000 7f9818ff9700 1 -- 172.21.15.163:0/2107083329 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9820026990 con 0x56173a4178b0 2023-07-14T18:23:11.340 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:23:11.271+0000 7f983cabcb80 1 -- 172.21.15.163:0/2107083329 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56173a4178b0 msgr2=0x56173a417ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:23:11.340 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:23:11.271+0000 7f983cabcb80 1 --2- 172.21.15.163:0/2107083329 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56173a4178b0 0x56173a417ed0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f9820011d50 tx=0x7f9820014000 comp rx=0 tx=0).stop 2023-07-14T18:23:11.340 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:23:11.271+0000 7f983cabcb80 1 -- 172.21.15.163:0/2107083329 shutdown_connections 2023-07-14T18:23:11.341 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:23:11.271+0000 7f983cabcb80 1 --2- 172.21.15.163:0/2107083329 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56173a4184b0 0x56173a418920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:23:11.341 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:23:11.271+0000 7f983cabcb80 1 --2- 172.21.15.163:0/2107083329 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x56173a416f60 0x56173a417370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:23:11.341 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:23:11.271+0000 7f983cabcb80 1 --2- 172.21.15.163:0/2107083329 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56173a4178b0 0x56173a417ed0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:23:11.341 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:23:11.271+0000 7f983cabcb80 1 -- 172.21.15.163:0/2107083329 >> 172.21.15.163:0/2107083329 conn(0x56173a40c680 msgr2=0x56173a4119d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:23:11.341 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:23:11.271+0000 7f983cabcb80 1 -- 172.21.15.163:0/2107083329 shutdown_connections 2023-07-14T18:23:11.342 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:23:11.271+0000 7f983cabcb80 1 -- 172.21.15.163:0/2107083329 wait complete. 2023-07-14T18:23:11.342 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:23:11.272+0000 7f983cabcb80 1 -- start start 2023-07-14T18:23:11.342 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:23:11.272+0000 7f983cabcb80 1 Processor -- start 2023-07-14T18:23:11.342 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:23:11.272+0000 7f983cabcb80 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56173a416f60 0x56173a420c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:23:11.342 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:23:11.272+0000 7f983cabcb80 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x56173a4184b0 0x56173a421170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:23:11.343 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:23:11.272+0000 7f983cabcb80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56173a4261a0 0x56173a428580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:23:11.343 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:23:11.272+0000 7f983cabcb80 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x56173a307ac0 con 0x56173a4184b0 2023-07-14T18:23:11.343 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:23:11.272+0000 7f983cabcb80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x56173a3077c0 con 0x56173a4261a0 2023-07-14T18:23:11.343 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:23:11.272+0000 7f983cabcb80 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x56173a1eb920 con 0x56173a416f60 2023-07-14T18:23:11.343 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:23:11.272+0000 7f983cabcb80 10 client.0 _ll_register_callbacks cb 0x56173a305760 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T18:23:11.344 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:23:11.272+0000 7f982a59c700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56173a416f60 0x56173a420c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:23:11.344 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:23:11.272+0000 7f9829d9b700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x56173a4184b0 0x56173a421170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:23:11.344 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:23:11.272+0000 7f982a59c700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56173a416f60 0x56173a420c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.163:41998/0 (socket says 172.21.15.163:41998) 2023-07-14T18:23:11.344 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:23:11.272+0000 7f982ad9d700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56173a4261a0 0x56173a428580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:23:11.344 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:23:11.272+0000 7f982a59c700 1 -- 172.21.15.163:0/310901906 learned_addr learned my addr 172.21.15.163:0/310901906 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:23:11.345 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:23:11.272+0000 7f982a59c700 1 -- 172.21.15.163:0/310901906 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56173a4261a0 msgr2=0x56173a428580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:23:11.345 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:23:11.272+0000 7f982a59c700 1 --2- 172.21.15.163:0/310901906 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56173a4261a0 0x56173a428580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:23:11.345 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:23:11.272+0000 7f982a59c700 1 -- 172.21.15.163:0/310901906 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x56173a4184b0 msgr2=0x56173a421170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:23:11.345 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:23:11.272+0000 7f982a59c700 1 --2- 172.21.15.163:0/310901906 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x56173a4184b0 0x56173a421170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:23:11.345 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:23:11.273+0000 7f982a59c700 1 -- 172.21.15.163:0/310901906 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f982c19ffb0 con 0x56173a416f60 2023-07-14T18:23:11.346 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:23:11.273+0000 7f9829d9b700 1 --2- 172.21.15.163:0/310901906 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x56173a4184b0 0x56173a421170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T18:23:11.346 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:23:11.273+0000 7f982a59c700 1 --2- 172.21.15.163:0/310901906 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56173a416f60 0x56173a420c30 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f981c0ca9d0 tx=0x7f981c09a4b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=986d8f9720287031 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:23:11.346 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:23:11.273+0000 7f9811ffb700 10 client.0 ms_handle_connect on v2:172.21.15.184:3300/0 2023-07-14T18:23:11.346 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:23:11.273+0000 7f9811ffb700 1 -- 172.21.15.163:0/310901906 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f981c0a2130 con 0x56173a416f60 2023-07-14T18:23:11.346 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:23:11.273+0000 7f983cabcb80 1 -- 172.21.15.163:0/310901906 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56173a2c14f0 con 0x56173a416f60 2023-07-14T18:23:11.347 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:23:11.273+0000 7f9811ffb700 1 -- 172.21.15.163:0/310901906 <== mon.1 v2:172.21.15.184:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 9049+0+0 (secure 0 0 0) 0x7f981c09dfa0 con 0x56173a416f60 2023-07-14T18:23:11.347 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:23:11.273+0000 7f9811ffb700 1 -- 172.21.15.163:0/310901906 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) v2 ==== 24+0+0 (secure 0 0 0) 0x7f981c0a23c0 con 0x56173a416f60 2023-07-14T18:23:11.347 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:23:11.273+0000 7f983cabcb80 10 client.26116 fetch_fsmap learned FSMap version 39 2023-07-14T18:23:11.347 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:23:11.273+0000 7f983cabcb80 1 -- 172.21.15.163:0/310901906 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) v3 -- 0x7f982c108940 con 0x56173a416f60 2023-07-14T18:23:11.347 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:23:11.273+0000 7f9811ffb700 1 -- 172.21.15.163:0/310901906 <== mon.1 v2:172.21.15.184:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x56173a2c14f0 con 0x56173a416f60 2023-07-14T18:23:11.347 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:23:11.273+0000 7f9811ffb700 1 -- 172.21.15.163:0/310901906 <== mon.1 v2:172.21.15.184:3300/0 5 ==== fsmap(e 39) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f981c0cab20 con 0x56173a416f60 2023-07-14T18:23:11.348 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:23:11.273+0000 7f983cabcb80 10 client.26116 fetch_fsmap finished waiting for FSMap version 39 2023-07-14T18:23:11.348 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:23:11.273+0000 7f983cabcb80 10 client.26116 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-07-14T18:23:11.348 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:23:11.273+0000 7f983cabcb80 20 client.26116 populate_metadata read hostname 'smithi163' 2023-07-14T18:23:11.348 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:23:11.273+0000 7f983cabcb80 1 --2- 172.21.15.163:0/310901906 >> [v2:172.21.15.172:6838/3850440096,v1:172.21.15.172:6839/3850440096] conn(0x56173a42cd30 0x56173a42f140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:23:11.348 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:23:11.274+0000 7f983cabcb80 4 client.26116 mds_command: new command op to 24518 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-14T18:23:11.349 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:23:11.274+0000 7f983cabcb80 1 -- 172.21.15.163:0/310901906 --> [v2:172.21.15.172:6838/3850440096,v1:172.21.15.172:6839/3850440096] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x56173a3e5da0 con 0x56173a42cd30 2023-07-14T18:23:11.349 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:23:11.274+0000 7f9829d9b700 1 --2- 172.21.15.163:0/310901906 >> [v2:172.21.15.172:6838/3850440096,v1:172.21.15.172:6839/3850440096] conn(0x56173a42cd30 0x56173a42f140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:23:11.349 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:23:11.274+0000 7f9829d9b700 1 --2- 172.21.15.163:0/310901906 >> [v2:172.21.15.172:6838/3850440096,v1:172.21.15.172:6839/3850440096] conn(0x56173a42cd30 0x56173a42f140 crc :-1 s=READY pgs=99 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4590c3dfb0154b0f server_cookie=4460471e083a3568 in_seq=0 out_seq=0 2023-07-14T18:23:11.349 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:23:11.274+0000 7f9811ffb700 10 client.26116 ms_handle_connect on v2:172.21.15.172:6838/3850440096 2023-07-14T18:23:11.349 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:23:11.275+0000 7f9811ffb700 1 -- 172.21.15.163:0/310901906 <== mds.0 v2:172.21.15.172:6838/3850440096 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18017 (crc 0 0 0) 0x56173a3e5da0 con 0x56173a42cd30 2023-07-14T18:23:11.350 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:23:11.275+0000 7f9811ffb700 10 client.26116 handle_command_reply: tid=0 2023-07-14T18:23:11.350 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:23:11.275+0000 7f983cabcb80 1 client.26116 shutdown 2023-07-14T18:23:11.350 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:23:11.275+0000 7f983cabcb80 1 -- 172.21.15.163:0/310901906 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56173a416f60 msgr2=0x56173a420c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:23:11.350 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:23:11.275+0000 7f983cabcb80 1 --2- 172.21.15.163:0/310901906 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56173a416f60 0x56173a420c30 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f981c0ca9d0 tx=0x7f981c09a4b0 comp rx=0 tx=0).stop 2023-07-14T18:23:11.350 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:23:11.275+0000 7f983cabcb80 1 -- 172.21.15.163:0/310901906 shutdown_connections 2023-07-14T18:23:11.351 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:23:11.275+0000 7f983cabcb80 1 --2- 172.21.15.163:0/310901906 >> [v2:172.21.15.172:6838/3850440096,v1:172.21.15.172:6839/3850440096] conn(0x56173a42cd30 0x56173a42f140 crc :-1 s=READY pgs=99 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:23:11.351 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:23:11.275+0000 7f983cabcb80 1 --2- 172.21.15.163:0/310901906 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56173a416f60 0x56173a420c30 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:23:11.351 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:23:11.275+0000 7f983cabcb80 1 --2- 172.21.15.163:0/310901906 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56173a4261a0 0x56173a428580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:23:11.351 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:23:11.275+0000 7f983cabcb80 1 --2- 172.21.15.163:0/310901906 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x56173a4184b0 0x56173a421170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:23:11.351 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:23:11.275+0000 7f9811ffb700 0 client.26116 ms_handle_reset on v2:172.21.15.172:6838/3850440096 2023-07-14T18:23:11.352 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:23:11.275+0000 7f983cabcb80 1 -- 172.21.15.163:0/310901906 >> 172.21.15.163:0/310901906 conn(0x56173a40c680 msgr2=0x56173a410650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:23:11.352 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:23:11.275+0000 7f983cabcb80 1 -- 172.21.15.163:0/310901906 shutdown_connections 2023-07-14T18:23:11.352 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:23:11.275+0000 7f983cabcb80 1 -- 172.21.15.163:0/310901906 wait complete. 2023-07-14T18:23:11.352 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:23:11.275+0000 7f983cabcb80 20 client.26116 trim_cache size 0 max 16384 2023-07-14T18:23:11.356 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:23:11.296+0000 7f983cabcb80 1 Processor -- start 2023-07-14T18:23:11.357 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:23:11.296+0000 7f983cabcb80 1 -- start start 2023-07-14T18:23:11.357 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:23:11.296+0000 7f983cabcb80 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x56173a416f60 0x56173a43c7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:23:11.357 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:23:11.296+0000 7f983cabcb80 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56173a4184b0 0x56173a417d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:23:11.357 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:23:11.296+0000 7f983cabcb80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56173a4261a0 0x56173a41eab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:23:11.358 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:23:11.296+0000 7f983cabcb80 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x56173a40c2a0 con 0x56173a416f60 2023-07-14T18:23:11.358 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:23:11.296+0000 7f983cabcb80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x56173a42a280 con 0x56173a4261a0 2023-07-14T18:23:11.358 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:23:11.296+0000 7f983cabcb80 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x56173a4124c0 con 0x56173a4184b0 2023-07-14T18:23:11.358 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:23:11.296+0000 7f982a59c700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x56173a416f60 0x56173a43c7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:23:11.358 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:23:11.296+0000 7f982ad9d700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56173a4261a0 0x56173a41eab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:23:11.359 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:23:11.296+0000 7f9829d9b700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56173a4184b0 0x56173a417d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:23:11.359 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:23:11.296+0000 7f982a59c700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x56173a416f60 0x56173a43c7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:60184/0 (socket says 172.21.15.163:60184) 2023-07-14T18:23:11.359 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:23:11.296+0000 7f9829d9b700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56173a4184b0 0x56173a417d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.163:42006/0 (socket says 172.21.15.163:42006) 2023-07-14T18:23:11.359 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:23:11.296+0000 7f982ad9d700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56173a4261a0 0x56173a41eab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.163:60872/0 (socket says 172.21.15.163:60872) 2023-07-14T18:23:11.359 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:23:11.296+0000 7f982a59c700 1 -- 172.21.15.163:0/115388667 learned_addr learned my addr 172.21.15.163:0/115388667 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:23:11.360 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:23:11.297+0000 7f9829d9b700 1 -- 172.21.15.163:0/115388667 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56173a4261a0 msgr2=0x56173a41eab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:23:11.360 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:23:11.297+0000 7f9829d9b700 1 --2- 172.21.15.163:0/115388667 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56173a4261a0 0x56173a41eab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:23:11.360 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:23:11.297+0000 7f9829d9b700 1 -- 172.21.15.163:0/115388667 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x56173a416f60 msgr2=0x56173a43c7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:23:11.360 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:23:11.297+0000 7f9829d9b700 1 --2- 172.21.15.163:0/115388667 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x56173a416f60 0x56173a43c7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:23:11.360 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:23:11.297+0000 7f9829d9b700 1 -- 172.21.15.163:0/115388667 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9820017050 con 0x56173a4184b0 2023-07-14T18:23:11.361 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:23:11.297+0000 7f9829d9b700 1 --2- 172.21.15.163:0/115388667 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56173a4184b0 0x56173a417d90 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x56173a412770 tx=0x7f9820009400 comp rx=0 tx=0).ready entity=mon.1 client_cookie=706b73b27b4584a8 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:23:11.361 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:23:11.297+0000 7f98197fa700 1 -- 172.21.15.163:0/115388667 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9820026680 con 0x56173a4184b0 2023-07-14T18:23:11.361 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:23:11.297+0000 7f98197fa700 1 -- 172.21.15.163:0/115388667 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f9820026a10 con 0x56173a4184b0 2023-07-14T18:23:11.361 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:23:11.297+0000 7f98197fa700 1 -- 172.21.15.163:0/115388667 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9820004a50 con 0x56173a4184b0 2023-07-14T18:23:11.361 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:23:11.298+0000 7f983cabcb80 1 -- 172.21.15.163:0/115388667 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56173a4184b0 msgr2=0x56173a417d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:23:11.362 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:23:11.298+0000 7f983cabcb80 1 --2- 172.21.15.163:0/115388667 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56173a4184b0 0x56173a417d90 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x56173a412770 tx=0x7f9820009400 comp rx=0 tx=0).stop 2023-07-14T18:23:11.362 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:23:11.298+0000 7f983cabcb80 1 -- 172.21.15.163:0/115388667 shutdown_connections 2023-07-14T18:23:11.362 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:23:11.298+0000 7f983cabcb80 1 --2- 172.21.15.163:0/115388667 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56173a4261a0 0x56173a41eab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:23:11.362 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:23:11.298+0000 7f983cabcb80 1 --2- 172.21.15.163:0/115388667 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x56173a416f60 0x56173a43c7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:23:11.362 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:23:11.298+0000 7f983cabcb80 1 --2- 172.21.15.163:0/115388667 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56173a4184b0 0x56173a417d90 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:23:11.362 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:23:11.298+0000 7f983cabcb80 1 -- 172.21.15.163:0/115388667 >> 172.21.15.163:0/115388667 conn(0x56173a40c680 msgr2=0x56173a410650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:23:11.363 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:23:11.298+0000 7f983cabcb80 1 -- 172.21.15.163:0/115388667 shutdown_connections 2023-07-14T18:23:11.363 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:23:11.298+0000 7f983cabcb80 1 -- 172.21.15.163:0/115388667 wait complete. 2023-07-14T18:23:11.363 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:23:11.298+0000 7f983cabcb80 1 -- start start 2023-07-14T18:23:11.363 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:23:11.298+0000 7f983cabcb80 1 Processor -- start 2023-07-14T18:23:11.363 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:23:11.298+0000 7f983cabcb80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56173a416f60 0x56173a43a9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:23:11.364 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:23:11.298+0000 7f983cabcb80 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x56173a4184b0 0x56173a43af20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:23:11.364 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:23:11.298+0000 7f983cabcb80 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56173a4261a0 0x56173a43bc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:23:11.364 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:23:11.298+0000 7f983cabcb80 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x56173a43c160 con 0x56173a4184b0 2023-07-14T18:23:11.364 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:23:11.299+0000 7f983cabcb80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x56173a43c2d0 con 0x56173a416f60 2023-07-14T18:23:11.365 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:23:11.299+0000 7f983cabcb80 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x56173a43c490 con 0x56173a4261a0 2023-07-14T18:23:11.365 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:23:11.299+0000 7f983cabcb80 10 client.0 _ll_register_callbacks cb 0x56173a305760 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T18:23:11.365 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:23:11.299+0000 7f9829d9b700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x56173a4184b0 0x56173a43af20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:23:11.365 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:23:11.299+0000 7f982a59c700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56173a416f60 0x56173a43a9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:23:11.366 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:23:11.299+0000 7f982a59c700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56173a416f60 0x56173a43a9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.163:60874/0 (socket says 172.21.15.163:60874) 2023-07-14T18:23:11.366 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:23:11.299+0000 7f982a59c700 1 -- 172.21.15.163:0/2750343012 learned_addr learned my addr 172.21.15.163:0/2750343012 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:23:11.366 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:23:11.299+0000 7f9829d9b700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x56173a4184b0 0x56173a43af20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:60192/0 (socket says 172.21.15.163:60192) 2023-07-14T18:23:11.366 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:23:11.299+0000 7f982ad9d700 1 --2- 172.21.15.163:0/2750343012 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56173a4261a0 0x56173a43bc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:23:11.366 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:23:11.299+0000 7f982a59c700 1 -- 172.21.15.163:0/2750343012 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56173a4261a0 msgr2=0x56173a43bc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:23:11.367 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:23:11.299+0000 7f982a59c700 1 --2- 172.21.15.163:0/2750343012 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56173a4261a0 0x56173a43bc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:23:11.367 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:23:11.299+0000 7f982a59c700 1 -- 172.21.15.163:0/2750343012 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x56173a4184b0 msgr2=0x56173a43af20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:23:11.367 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:23:11.299+0000 7f982a59c700 1 --2- 172.21.15.163:0/2750343012 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x56173a4184b0 0x56173a43af20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:23:11.367 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:23:11.299+0000 7f982a59c700 1 -- 172.21.15.163:0/2750343012 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56173a195de0 con 0x56173a416f60 2023-07-14T18:23:11.367 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:23:11.299+0000 7f982a59c700 1 --2- 172.21.15.163:0/2750343012 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56173a416f60 0x56173a43a9e0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f981c0ca6b0 tx=0x7f981c010940 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bb63f54251697f2 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:23:11.368 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:23:11.299+0000 7f9811ffb700 10 client.0 ms_handle_connect on v2:172.21.15.172:3300/0 2023-07-14T18:23:11.368 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:23:11.299+0000 7f9811ffb700 1 -- 172.21.15.163:0/2750343012 <== mon.2 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f981c09dfa0 con 0x56173a416f60 2023-07-14T18:23:11.368 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:23:11.299+0000 7f9811ffb700 1 -- 172.21.15.163:0/2750343012 <== mon.2 v2:172.21.15.172:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 9049+0+0 (secure 0 0 0) 0x7f981c0a23c0 con 0x56173a416f60 2023-07-14T18:23:11.368 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:23:11.299+0000 7f983cabcb80 1 -- 172.21.15.163:0/2750343012 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f982000ee40 con 0x56173a416f60 2023-07-14T18:23:11.368 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:23:11.299+0000 7f9811ffb700 1 -- 172.21.15.163:0/2750343012 <== mon.2 v2:172.21.15.172:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) v2 ==== 24+0+0 (secure 0 0 0) 0x7f981c0b80d0 con 0x56173a416f60 2023-07-14T18:23:11.369 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:23:11.300+0000 7f983cabcb80 10 client.26180 fetch_fsmap learned FSMap version 39 2023-07-14T18:23:11.369 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:23:11.300+0000 7f983cabcb80 1 -- 172.21.15.163:0/2750343012 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) v3 -- 0x56173a17ec60 con 0x56173a416f60 2023-07-14T18:23:11.369 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:23:11.300+0000 7f9811ffb700 1 -- 172.21.15.163:0/2750343012 <== mon.2 v2:172.21.15.172:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f982000ee40 con 0x56173a416f60 2023-07-14T18:23:11.369 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:23:11.300+0000 7f9811ffb700 1 -- 172.21.15.163:0/2750343012 <== mon.2 v2:172.21.15.172:3300/0 5 ==== fsmap(e 39) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f981c095ef0 con 0x56173a416f60 2023-07-14T18:23:11.369 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:23:11.300+0000 7f983cabcb80 10 client.26180 fetch_fsmap finished waiting for FSMap version 39 2023-07-14T18:23:11.369 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:23:11.300+0000 7f983cabcb80 10 client.26180 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-07-14T18:23:11.370 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:23:11.300+0000 7f983cabcb80 20 client.26180 populate_metadata read hostname 'smithi163' 2023-07-14T18:23:11.370 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:23:11.300+0000 7f983cabcb80 1 --2- 172.21.15.163:0/2750343012 >> [v2:172.21.15.172:6838/3850440096,v1:172.21.15.172:6839/3850440096] conn(0x56173a481d00 0x56173a484110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:23:11.370 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:23:11.300+0000 7f983cabcb80 4 client.26180 mds_command: new command op to 24518 tid=0[{"prefix": "scrub status"}] 2023-07-14T18:23:11.370 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:23:11.300+0000 7f983cabcb80 1 -- 172.21.15.163:0/2750343012 --> [v2:172.21.15.172:6838/3850440096,v1:172.21.15.172:6839/3850440096] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x56173a360eb0 con 0x56173a481d00 2023-07-14T18:23:11.370 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:23:11.300+0000 7f9829d9b700 1 --2- 172.21.15.163:0/2750343012 >> [v2:172.21.15.172:6838/3850440096,v1:172.21.15.172:6839/3850440096] conn(0x56173a481d00 0x56173a484110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:23:11.371 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:23:11.300+0000 7f9811ffb700 10 client.26180 ms_handle_connect on v2:172.21.15.172:6838/3850440096 2023-07-14T18:23:11.371 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:23:11.300+0000 7f9829d9b700 1 --2- 172.21.15.163:0/2750343012 >> [v2:172.21.15.172:6838/3850440096,v1:172.21.15.172:6839/3850440096] conn(0x56173a481d00 0x56173a484110 crc :-1 s=READY pgs=100 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=af560de2b7fdac03 server_cookie=f0f01d6c047a8e7f in_seq=0 out_seq=0 2023-07-14T18:23:11.371 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:23:11.301+0000 7f9811ffb700 1 -- 172.21.15.163:0/2750343012 <== mds.0 v2:172.21.15.172:6838/3850440096 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x56173a360eb0 con 0x56173a481d00 2023-07-14T18:23:11.371 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:23:11.301+0000 7f9811ffb700 10 client.26180 handle_command_reply: tid=0 2023-07-14T18:23:11.371 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:23:11.301+0000 7f983cabcb80 1 client.26180 shutdown 2023-07-14T18:23:11.372 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:23:11.301+0000 7f983cabcb80 1 -- 172.21.15.163:0/2750343012 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56173a416f60 msgr2=0x56173a43a9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:23:11.372 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:23:11.301+0000 7f983cabcb80 1 --2- 172.21.15.163:0/2750343012 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56173a416f60 0x56173a43a9e0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f981c0ca6b0 tx=0x7f981c010940 comp rx=0 tx=0).stop 2023-07-14T18:23:11.372 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:23:11.301+0000 7f983cabcb80 1 -- 172.21.15.163:0/2750343012 shutdown_connections 2023-07-14T18:23:11.372 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:23:11.301+0000 7f983cabcb80 1 --2- 172.21.15.163:0/2750343012 >> [v2:172.21.15.172:6838/3850440096,v1:172.21.15.172:6839/3850440096] conn(0x56173a481d00 0x56173a484110 crc :-1 s=READY pgs=100 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:23:11.372 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:23:11.301+0000 7f983cabcb80 1 --2- 172.21.15.163:0/2750343012 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56173a4261a0 0x56173a43bc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:23:11.373 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:23:11.301+0000 7f983cabcb80 1 --2- 172.21.15.163:0/2750343012 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56173a416f60 0x56173a43a9e0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:23:11.373 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:23:11.301+0000 7f983cabcb80 1 --2- 172.21.15.163:0/2750343012 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x56173a4184b0 0x56173a43af20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:23:11.373 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:23:11.301+0000 7f9811ffb700 0 client.26180 ms_handle_reset on v2:172.21.15.172:6838/3850440096 2023-07-14T18:23:11.373 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:23:11.301+0000 7f983cabcb80 1 -- 172.21.15.163:0/2750343012 >> 172.21.15.163:0/2750343012 conn(0x56173a40c680 msgr2=0x56173a41eab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:23:11.373 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:23:11.301+0000 7f983cabcb80 1 -- 172.21.15.163:0/2750343012 shutdown_connections 2023-07-14T18:23:11.374 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:23:11.301+0000 7f983cabcb80 1 -- 172.21.15.163:0/2750343012 wait complete. 2023-07-14T18:23:11.374 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:23:11.301+0000 7f983cabcb80 20 client.26180 trim_cache size 0 max 16384 2023-07-14T18:23:11.374 INFO:teuthology.orchestra.run.smithi163.stdout:{ 2023-07-14T18:23:11.375 INFO:teuthology.orchestra.run.smithi163.stdout: "status": "IDLE (waiting for more scrubs)", 2023-07-14T18:23:11.375 INFO:teuthology.orchestra.run.smithi163.stdout: "scrubs": { 2023-07-14T18:23:11.375 INFO:teuthology.orchestra.run.smithi163.stdout: "2c53b7ef-6f30-49f0-a60d-f1f114c19d42": { 2023-07-14T18:23:11.375 INFO:teuthology.orchestra.run.smithi163.stdout: "path": "/", 2023-07-14T18:23:11.375 INFO:teuthology.orchestra.run.smithi163.stdout: "tag": "2c53b7ef-6f30-49f0-a60d-f1f114c19d42", 2023-07-14T18:23:11.376 INFO:teuthology.orchestra.run.smithi163.stdout: "options": "recursive,force" 2023-07-14T18:23:11.376 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-07-14T18:23:11.376 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-07-14T18:23:11.376 INFO:teuthology.orchestra.run.smithi163.stdout:} 2023-07-14T18:23:11.377 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:23:11.301+0000 7f9830924700 1 -- 172.21.15.163:0/3289266644 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f98140a1150 msgr2=0x7f98140a3600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:23:11.378 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:23:11.302+0000 7f9830924700 1 --2- 172.21.15.163:0/3289266644 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f98140a1150 0x7f98140a3600 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f9820009fd0 tx=0x7f9820009260 comp rx=0 tx=0).stop 2023-07-14T18:23:11.378 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:23:11.302+0000 7f9830924700 1 -- 172.21.15.163:0/3289266644 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f982c100750 msgr2=0x7f982c1000c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:23:11.378 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:23:11.302+0000 7f9830924700 1 --2- 172.21.15.163:0/3289266644 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f982c100750 0x7f982c1000c0 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7f981c00e9a0 tx=0x7f981c00ecb0 comp rx=0 tx=0).stop 2023-07-14T18:23:11.378 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:23:11.302+0000 7f9830924700 1 -- 172.21.15.163:0/3289266644 shutdown_connections 2023-07-14T18:23:11.378 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:23:11.302+0000 7f9830924700 1 --2- 172.21.15.163:0/3289266644 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f98140a1150 0x7f98140a3600 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:23:11.379 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:23:11.302+0000 7f9830924700 1 --2- 172.21.15.163:0/3289266644 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f982c105990 0x7f982c0fec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:23:11.379 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:23:11.302+0000 7f9830924700 1 --2- 172.21.15.163:0/3289266644 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f982c100750 0x7f982c1000c0 unknown :-1 s=CLOSED pgs=722 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:23:11.379 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:23:11.302+0000 7f9830924700 1 --2- 172.21.15.163:0/3289266644 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f982c103070 0x7f982c0fe700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:23:11.379 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:23:11.302+0000 7f9830924700 1 -- 172.21.15.163:0/3289266644 >> 172.21.15.163:0/3289266644 conn(0x7f982c0fa130 msgr2=0x7f982c101c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:23:11.379 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:23:11.302+0000 7f9830924700 1 -- 172.21.15.163:0/3289266644 shutdown_connections 2023-07-14T18:23:11.380 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:23:11.302+0000 7f9830924700 1 -- 172.21.15.163:0/3289266644 wait complete. 2023-07-14T18:23:11.380 INFO:tasks.cephfs.filesystem:scrub status for tag:2c53b7ef-6f30-49f0-a60d-f1f114c19d42 - {'path': '/', 'tag': '2c53b7ef-6f30-49f0-a60d-f1f114c19d42', 'options': 'recursive,force'} 2023-07-14T18:23:12.228 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:23:11 smithi163 ceph-mon[96576]: pgmap v616: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-07-14T18:23:12.286 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:23:11 smithi172 ceph-mon[97983]: pgmap v616: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-07-14T18:23:12.435 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:23:11 smithi184 ceph-mon[98481]: pgmap v616: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-07-14T18:23:14.978 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:23:14 smithi163 ceph-mon[96576]: pgmap v617: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2023-07-14T18:23:15.036 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:23:14 smithi172 ceph-mon[97983]: pgmap v617: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2023-07-14T18:23:15.185 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:23:14 smithi184 ceph-mon[98481]: pgmap v617: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2023-07-14T18:23:16.978 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:23:16 smithi163 ceph-mon[96576]: pgmap v618: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 9 op/s 2023-07-14T18:23:17.036 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:23:16 smithi172 ceph-mon[97983]: pgmap v618: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 9 op/s 2023-07-14T18:23:17.185 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:23:16 smithi184 ceph-mon[98481]: pgmap v618: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 9 op/s 2023-07-14T18:23:18.978 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:23:18 smithi163 ceph-mon[96576]: pgmap v619: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-07-14T18:23:19.036 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:23:18 smithi172 ceph-mon[97983]: pgmap v619: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-07-14T18:23:19.185 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:23:18 smithi184 ceph-mon[98481]: pgmap v619: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-07-14T18:23:20.978 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:23:20 smithi163 ceph-mon[96576]: pgmap v620: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-07-14T18:23:21.036 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:23:20 smithi172 ceph-mon[97983]: pgmap v620: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-07-14T18:23:21.185 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:23:20 smithi184 ceph-mon[98481]: pgmap v620: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-07-14T18:23:22.228 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:23:21 smithi163 ceph-mon[96576]: pgmap v621: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 9 op/s 2023-07-14T18:23:22.286 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:23:21 smithi172 ceph-mon[97983]: pgmap v621: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 9 op/s 2023-07-14T18:23:22.436 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:23:21 smithi184 ceph-mon[98481]: pgmap v621: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 9 op/s 2023-07-14T18:23:24.978 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:23:24 smithi163 ceph-mon[96576]: pgmap v622: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2023-07-14T18:23:25.036 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:23:24 smithi172 ceph-mon[97983]: pgmap v622: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2023-07-14T18:23:25.185 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:23:24 smithi184 ceph-mon[98481]: pgmap v622: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2023-07-14T18:23:26.978 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:23:26 smithi163 ceph-mon[96576]: pgmap v623: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-07-14T18:23:26.978 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:23:26 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-14T18:23:27.036 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:23:26 smithi172 ceph-mon[97983]: pgmap v623: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-07-14T18:23:27.037 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:23:26 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-14T18:23:27.202 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:23:26 smithi184 ceph-mon[98481]: pgmap v623: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-07-14T18:23:27.202 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:23:26 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-14T18:23:28.978 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:23:28 smithi163 ceph-mon[96576]: pgmap v624: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-07-14T18:23:29.036 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:23:28 smithi172 ceph-mon[97983]: pgmap v624: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-07-14T18:23:29.185 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:23:28 smithi184 ceph-mon[98481]: pgmap v624: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-07-14T18:23:30.537 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:23:30 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:23:30.537 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:23:30 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:23:30.538 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:23:30 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:23:30.538 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:23:30 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:23:30.538 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:23:30 smithi172 ceph-mon[97983]: pgmap v625: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-07-14T18:23:30.686 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:23:30 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:23:30.687 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:23:30 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:23:30.687 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:23:30 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:23:30.687 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:23:30 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:23:30.687 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:23:30 smithi184 ceph-mon[98481]: pgmap v625: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-07-14T18:23:30.728 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:23:30 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:23:30.728 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:23:30 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:23:30.729 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:23:30 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:23:30.729 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:23:30 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:23:30.729 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:23:30 smithi163 ceph-mon[96576]: pgmap v625: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-07-14T18:23:32.786 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:23:32 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:23:32.787 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:23:32 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:23:32.787 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:23:32 smithi172 ceph-mon[97983]: pgmap v626: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-07-14T18:23:32.787 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:23:32 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T18:23:32.787 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:23:32 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-14T18:23:32.788 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:23:32 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:23:32.936 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:23:32 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:23:32.936 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:23:32 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:23:32.936 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:23:32 smithi184 ceph-mon[98481]: pgmap v626: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-07-14T18:23:32.936 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:23:32 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T18:23:32.937 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:23:32 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-14T18:23:32.937 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:23:32 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:23:32.978 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:23:32 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:23:32.978 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:23:32 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:23:32.978 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:23:32 smithi163 ceph-mon[96576]: pgmap v626: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-07-14T18:23:32.979 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:23:32 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T18:23:32.979 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:23:32 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-14T18:23:32.979 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:23:32 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:23:34.978 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:23:34 smithi163 ceph-mon[96576]: pgmap v627: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-07-14T18:23:35.036 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:23:34 smithi172 ceph-mon[97983]: pgmap v627: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-07-14T18:23:35.185 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:23:34 smithi184 ceph-mon[98481]: pgmap v627: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-07-14T18:23:36.978 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:23:36 smithi163 ceph-mon[96576]: pgmap v628: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-07-14T18:23:37.036 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:23:36 smithi172 ceph-mon[97983]: pgmap v628: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-07-14T18:23:37.185 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:23:36 smithi184 ceph-mon[98481]: pgmap v628: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-07-14T18:23:38.978 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:23:38 smithi163 ceph-mon[96576]: pgmap v629: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-07-14T18:23:39.037 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:23:38 smithi172 ceph-mon[97983]: pgmap v629: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-07-14T18:23:39.186 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:23:38 smithi184 ceph-mon[98481]: pgmap v629: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-07-14T18:23:40.978 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:23:40 smithi163 ceph-mon[96576]: pgmap v630: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-07-14T18:23:41.036 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:23:40 smithi172 ceph-mon[97983]: pgmap v630: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-07-14T18:23:41.186 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:23:40 smithi184 ceph-mon[98481]: pgmap v630: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-07-14T18:23:41.381 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-07-14T18:23:41.529 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:23:41.478+0000 7f9448927700 1 -- 172.21.15.163:0/3100048102 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f9444100690 msgr2=0x7f9444106f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:23:41.529 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:23:41.478+0000 7f9448927700 1 --2- 172.21.15.163:0/3100048102 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f9444100690 0x7f9444106f50 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7f943c00b0a0 tx=0x7f943c00b3b0 comp rx=0 tx=0).stop 2023-07-14T18:23:41.530 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:23:41.478+0000 7f9448927700 1 -- 172.21.15.163:0/3100048102 shutdown_connections 2023-07-14T18:23:41.530 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:23:41.478+0000 7f9448927700 1 --2- 172.21.15.163:0/3100048102 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f9444100690 0x7f9444106f50 unknown :-1 s=CLOSED pgs=723 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:23:41.530 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:23:41.478+0000 7f9448927700 1 --2- 172.21.15.163:0/3100048102 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f94440feb10 0x7f94440fef20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:23:41.530 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:23:41.478+0000 7f9448927700 1 --2- 172.21.15.163:0/3100048102 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f94440ffd00 0x7f9444100150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:23:41.530 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:23:41.478+0000 7f9448927700 1 -- 172.21.15.163:0/3100048102 >> 172.21.15.163:0/3100048102 conn(0x7f94440fa130 msgr2=0x7f94440fc560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:23:41.531 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:23:41.478+0000 7f9448927700 1 -- 172.21.15.163:0/3100048102 shutdown_connections 2023-07-14T18:23:41.531 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:23:41.478+0000 7f9448927700 1 -- 172.21.15.163:0/3100048102 wait complete. 2023-07-14T18:23:41.538 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:23:41.479+0000 7f9448927700 1 Processor -- start 2023-07-14T18:23:41.538 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:23:41.479+0000 7f9448927700 1 -- start start 2023-07-14T18:23:41.538 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:23:41.479+0000 7f9448927700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f94440feb10 0x7f9444194910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:23:41.538 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:23:41.479+0000 7f9448927700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f94440ffd00 0x7f9444194e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:23:41.539 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:23:41.479+0000 7f9448927700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f9444100690 0x7f944419bec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:23:41.539 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:23:41.479+0000 7f9448927700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f944419c490 con 0x7f9444100690 2023-07-14T18:23:41.539 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:23:41.479+0000 7f9448927700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f944419c5d0 con 0x7f94440feb10 2023-07-14T18:23:41.539 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:23:41.479+0000 7f9448927700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f944419c760 con 0x7f94440ffd00 2023-07-14T18:23:41.539 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:23:41.479+0000 7f9442d9d700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f9444100690 0x7f944419bec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:23:41.540 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:23:41.479+0000 7f944259c700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f94440feb10 0x7f9444194910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:23:41.540 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:23:41.479+0000 7f9442d9d700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f9444100690 0x7f944419bec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:60208/0 (socket says 172.21.15.163:60208) 2023-07-14T18:23:41.540 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:23:41.479+0000 7f944259c700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f94440feb10 0x7f9444194910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.163:60888/0 (socket says 172.21.15.163:60888) 2023-07-14T18:23:41.540 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:23:41.479+0000 7f9441d9b700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f94440ffd00 0x7f9444194e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:23:41.541 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:23:41.479+0000 7f9442d9d700 1 -- 172.21.15.163:0/1331767760 learned_addr learned my addr 172.21.15.163:0/1331767760 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:23:41.541 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:23:41.480+0000 7f944259c700 1 -- 172.21.15.163:0/1331767760 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f94440ffd00 msgr2=0x7f9444194e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:23:41.541 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:23:41.480+0000 7f944259c700 1 --2- 172.21.15.163:0/1331767760 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f94440ffd00 0x7f9444194e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:23:41.541 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:23:41.480+0000 7f944259c700 1 -- 172.21.15.163:0/1331767760 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f9444100690 msgr2=0x7f944419bec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:23:41.541 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:23:41.480+0000 7f944259c700 1 --2- 172.21.15.163:0/1331767760 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f9444100690 0x7f944419bec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:23:41.542 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:23:41.480+0000 7f944259c700 1 -- 172.21.15.163:0/1331767760 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f943c009d00 con 0x7f94440feb10 2023-07-14T18:23:41.542 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:23:41.480+0000 7f9442d9d700 1 --2- 172.21.15.163:0/1331767760 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f9444100690 0x7f944419bec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T18:23:41.542 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:23:41.480+0000 7f944259c700 1 --2- 172.21.15.163:0/1331767760 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f94440feb10 0x7f9444194910 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f943400e9c0 tx=0x7f943400ecd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:23:41.542 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:23:41.480+0000 7f94337fe700 1 -- 172.21.15.163:0/1331767760 <== mon.2 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9434004220 con 0x7f94440feb10 2023-07-14T18:23:41.543 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:23:41.480+0000 7f94337fe700 1 -- 172.21.15.163:0/1331767760 <== mon.2 v2:172.21.15.172:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f9434004380 con 0x7f94440feb10 2023-07-14T18:23:41.543 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:23:41.480+0000 7f9448927700 1 -- 172.21.15.163:0/1331767760 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f944419ca40 con 0x7f94440feb10 2023-07-14T18:23:41.543 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:23:41.480+0000 7f9448927700 1 -- 172.21.15.163:0/1331767760 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f944419cf50 con 0x7f94440feb10 2023-07-14T18:23:41.543 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:23:41.480+0000 7f94337fe700 1 -- 172.21.15.163:0/1331767760 <== mon.2 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9434003b40 con 0x7f94440feb10 2023-07-14T18:23:41.543 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:23:41.482+0000 7f94337fe700 1 -- 172.21.15.163:0/1331767760 <== mon.2 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 18) v1 ==== 135716+0+0 (secure 0 0 0) 0x7f9434003d20 con 0x7f94440feb10 2023-07-14T18:23:41.544 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:23:41.483+0000 7f94337fe700 1 --2- 172.21.15.163:0/1331767760 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f942c0a1150 0x7f942c0a3600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:23:41.544 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:23:41.483+0000 7f9441d9b700 1 --2- 172.21.15.163:0/1331767760 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f942c0a1150 0x7f942c0a3600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:23:41.544 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:23:41.483+0000 7f94337fe700 1 -- 172.21.15.163:0/1331767760 <== mon.2 v2:172.21.15.172:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 9049+0+0 (secure 0 0 0) 0x7f9434014070 con 0x7f94440feb10 2023-07-14T18:23:41.544 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:23:41.484+0000 7f9441d9b700 1 --2- 172.21.15.163:0/1331767760 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f942c0a1150 0x7f942c0a3600 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f9438009be0 tx=0x7f9438009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:23:41.544 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:23:41.484+0000 7f9454abfb80 1 Processor -- start 2023-07-14T18:23:41.545 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:23:41.484+0000 7f9454abfb80 1 -- start start 2023-07-14T18:23:41.545 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:23:41.484+0000 7f9454abfb80 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55694aef6f60 0x55694aef7370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:23:41.545 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:23:41.484+0000 7f9454abfb80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55694aef78b0 0x55694aef7ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:23:41.545 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:23:41.484+0000 7f9454abfb80 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55694aef84b0 0x55694aef8920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:23:41.546 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:23:41.484+0000 7f9454abfb80 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x55694adfbcb0 con 0x55694aef84b0 2023-07-14T18:23:41.546 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:23:41.484+0000 7f9454abfb80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x55694ae4ea40 con 0x55694aef78b0 2023-07-14T18:23:41.546 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:23:41.484+0000 7f9454abfb80 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x55694ae47ed0 con 0x55694aef6f60 2023-07-14T18:23:41.546 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:23:41.485+0000 7f944259c700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55694aef6f60 0x55694aef7370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:23:41.546 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:23:41.485+0000 7f944259c700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55694aef6f60 0x55694aef7370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.163:42034/0 (socket says 172.21.15.163:42034) 2023-07-14T18:23:41.547 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:23:41.485+0000 7f944259c700 1 -- 172.21.15.163:0/1535270537 learned_addr learned my addr 172.21.15.163:0/1535270537 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:23:41.547 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:23:41.485+0000 7f9441d9b700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55694aef78b0 0x55694aef7ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:23:41.547 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:23:41.485+0000 7f9442d9d700 1 --2- 172.21.15.163:0/1535270537 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55694aef84b0 0x55694aef8920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:23:41.547 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:23:41.485+0000 7f944259c700 1 -- 172.21.15.163:0/1535270537 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55694aef78b0 msgr2=0x55694aef7ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:23:41.548 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:23:41.485+0000 7f944259c700 1 --2- 172.21.15.163:0/1535270537 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55694aef78b0 0x55694aef7ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:23:41.548 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:23:41.485+0000 7f944259c700 1 -- 172.21.15.163:0/1535270537 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55694aef84b0 msgr2=0x55694aef8920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:23:41.548 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:23:41.485+0000 7f944259c700 1 --2- 172.21.15.163:0/1535270537 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55694aef84b0 0x55694aef8920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:23:41.548 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:23:41.485+0000 7f944259c700 1 -- 172.21.15.163:0/1535270537 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55694ac75de0 con 0x55694aef6f60 2023-07-14T18:23:41.548 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:23:41.485+0000 7f9441d9b700 1 --2- 172.21.15.163:0/1535270537 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55694aef78b0 0x55694aef7ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T18:23:41.549 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:23:41.485+0000 7f944259c700 1 --2- 172.21.15.163:0/1535270537 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55694aef6f60 0x55694aef7370 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f9434099eb0 tx=0x7f9434099e20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d76ff69811907d69 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:23:41.549 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:23:41.485+0000 7f9430ff9700 1 -- 172.21.15.163:0/1535270537 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94340044f0 con 0x55694aef6f60 2023-07-14T18:23:41.549 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:23:41.485+0000 7f9430ff9700 1 -- 172.21.15.163:0/1535270537 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f9434099f20 con 0x55694aef6f60 2023-07-14T18:23:41.549 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:23:41.485+0000 7f9430ff9700 1 -- 172.21.15.163:0/1535270537 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f943409a3e0 con 0x55694aef6f60 2023-07-14T18:23:41.549 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:23:41.486+0000 7f9454abfb80 1 -- 172.21.15.163:0/1535270537 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55694aef6f60 msgr2=0x55694aef7370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:23:41.550 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:23:41.486+0000 7f9454abfb80 1 --2- 172.21.15.163:0/1535270537 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55694aef6f60 0x55694aef7370 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f9434099eb0 tx=0x7f9434099e20 comp rx=0 tx=0).stop 2023-07-14T18:23:41.550 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:23:41.486+0000 7f9454abfb80 1 -- 172.21.15.163:0/1535270537 shutdown_connections 2023-07-14T18:23:41.550 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:23:41.486+0000 7f9454abfb80 1 --2- 172.21.15.163:0/1535270537 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55694aef6f60 0x55694aef7370 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:23:41.550 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:23:41.486+0000 7f9454abfb80 1 --2- 172.21.15.163:0/1535270537 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55694aef84b0 0x55694aef8920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:23:41.551 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:23:41.486+0000 7f9454abfb80 1 --2- 172.21.15.163:0/1535270537 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55694aef78b0 0x55694aef7ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:23:41.551 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:23:41.486+0000 7f9454abfb80 1 -- 172.21.15.163:0/1535270537 >> 172.21.15.163:0/1535270537 conn(0x55694aeec680 msgr2=0x55694aef19d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:23:41.551 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:23:41.486+0000 7f9454abfb80 1 -- 172.21.15.163:0/1535270537 shutdown_connections 2023-07-14T18:23:41.551 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:23:41.486+0000 7f9454abfb80 1 -- 172.21.15.163:0/1535270537 wait complete. 2023-07-14T18:23:41.552 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:23:41.487+0000 7f9454abfb80 1 -- start start 2023-07-14T18:23:41.552 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:23:41.487+0000 7f9454abfb80 1 Processor -- start 2023-07-14T18:23:41.555 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:23:41.487+0000 7f9454abfb80 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55694aef6f60 0x55694af009e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:23:41.555 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:23:41.487+0000 7f9454abfb80 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55694aef78b0 0x55694af00f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:23:41.555 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:23:41.487+0000 7f9454abfb80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55694aef84b0 0x55694af07f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:23:41.556 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:23:41.487+0000 7f9454abfb80 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x55694ade7ac0 con 0x55694aef78b0 2023-07-14T18:23:41.556 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:23:41.487+0000 7f9454abfb80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x55694ade77c0 con 0x55694aef84b0 2023-07-14T18:23:41.556 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:23:41.487+0000 7f9454abfb80 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x55694accb920 con 0x55694aef6f60 2023-07-14T18:23:41.556 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:23:41.487+0000 7f9454abfb80 10 client.0 _ll_register_callbacks cb 0x55694ade5760 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T18:23:41.557 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:23:41.487+0000 7f944259c700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55694aef6f60 0x55694af009e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:23:41.557 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:23:41.487+0000 7f944259c700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55694aef6f60 0x55694af009e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.163:42040/0 (socket says 172.21.15.163:42040) 2023-07-14T18:23:41.557 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:23:41.487+0000 7f944259c700 1 -- 172.21.15.163:0/2647406569 learned_addr learned my addr 172.21.15.163:0/2647406569 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:23:41.557 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:23:41.487+0000 7f9442d9d700 1 --2- 172.21.15.163:0/2647406569 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55694aef84b0 0x55694af07f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:23:41.557 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:23:41.487+0000 7f9441d9b700 1 --2- 172.21.15.163:0/2647406569 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55694aef78b0 0x55694af00f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:23:41.557 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:23:41.488+0000 7f944259c700 1 -- 172.21.15.163:0/2647406569 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55694aef84b0 msgr2=0x55694af07f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:23:41.558 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:23:41.488+0000 7f944259c700 1 --2- 172.21.15.163:0/2647406569 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55694aef84b0 0x55694af07f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:23:41.558 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:23:41.488+0000 7f944259c700 1 -- 172.21.15.163:0/2647406569 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55694aef78b0 msgr2=0x55694af00f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:23:41.558 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:23:41.488+0000 7f944259c700 1 --2- 172.21.15.163:0/2647406569 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55694aef78b0 0x55694af00f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:23:41.558 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:23:41.488+0000 7f944259c700 1 -- 172.21.15.163:0/2647406569 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9438017070 con 0x55694aef6f60 2023-07-14T18:23:41.558 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:23:41.488+0000 7f944259c700 1 --2- 172.21.15.163:0/2647406569 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55694aef6f60 0x55694af009e0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f9434096990 tx=0x7f94340044f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a5464152b9bf951 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:23:41.559 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:23:41.488+0000 7f9429ffb700 10 client.0 ms_handle_connect on v2:172.21.15.184:3300/0 2023-07-14T18:23:41.559 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:23:41.488+0000 7f9429ffb700 1 -- 172.21.15.163:0/2647406569 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94340a2370 con 0x55694aef6f60 2023-07-14T18:23:41.559 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:23:41.488+0000 7f9454abfb80 1 -- 172.21.15.163:0/2647406569 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55694ada14f0 con 0x55694aef6f60 2023-07-14T18:23:41.559 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:23:41.488+0000 7f9429ffb700 1 -- 172.21.15.163:0/2647406569 <== mon.1 v2:172.21.15.184:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 9049+0+0 (secure 0 0 0) 0x7f94340ca2c0 con 0x55694aef6f60 2023-07-14T18:23:41.560 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:23:41.488+0000 7f9429ffb700 1 -- 172.21.15.163:0/2647406569 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) v2 ==== 24+0+0 (secure 0 0 0) 0x7f943409a180 con 0x55694aef6f60 2023-07-14T18:23:41.560 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:23:41.488+0000 7f9454abfb80 10 client.26134 fetch_fsmap learned FSMap version 39 2023-07-14T18:23:41.560 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:23:41.488+0000 7f9454abfb80 1 -- 172.21.15.163:0/2647406569 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) v3 -- 0x7f944419cf50 con 0x55694aef6f60 2023-07-14T18:23:41.560 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:23:41.488+0000 7f9429ffb700 1 -- 172.21.15.163:0/2647406569 <== mon.1 v2:172.21.15.184:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55694ada14f0 con 0x55694aef6f60 2023-07-14T18:23:41.560 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:23:41.489+0000 7f9429ffb700 1 -- 172.21.15.163:0/2647406569 <== mon.1 v2:172.21.15.184:3300/0 5 ==== fsmap(e 39) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f9434098e80 con 0x55694aef6f60 2023-07-14T18:23:41.561 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:23:41.489+0000 7f9454abfb80 10 client.26134 fetch_fsmap finished waiting for FSMap version 39 2023-07-14T18:23:41.561 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:23:41.489+0000 7f9454abfb80 10 client.26134 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-07-14T18:23:41.561 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:23:41.489+0000 7f9454abfb80 20 client.26134 populate_metadata read hostname 'smithi163' 2023-07-14T18:23:41.561 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:23:41.489+0000 7f9454abfb80 1 --2- 172.21.15.163:0/2647406569 >> [v2:172.21.15.172:6838/3850440096,v1:172.21.15.172:6839/3850440096] conn(0x55694af0c390 0x55694af0e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:23:41.561 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:23:41.489+0000 7f9454abfb80 4 client.26134 mds_command: new command op to 24518 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-14T18:23:41.562 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:23:41.489+0000 7f9454abfb80 1 -- 172.21.15.163:0/2647406569 --> [v2:172.21.15.172:6838/3850440096,v1:172.21.15.172:6839/3850440096] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55694aec5da0 con 0x55694af0c390 2023-07-14T18:23:41.562 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:23:41.489+0000 7f9441d9b700 1 --2- 172.21.15.163:0/2647406569 >> [v2:172.21.15.172:6838/3850440096,v1:172.21.15.172:6839/3850440096] conn(0x55694af0c390 0x55694af0e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:23:41.562 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:23:41.489+0000 7f9429ffb700 10 client.26134 ms_handle_connect on v2:172.21.15.172:6838/3850440096 2023-07-14T18:23:41.562 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:23:41.489+0000 7f9441d9b700 1 --2- 172.21.15.163:0/2647406569 >> [v2:172.21.15.172:6838/3850440096,v1:172.21.15.172:6839/3850440096] conn(0x55694af0c390 0x55694af0e7a0 crc :-1 s=READY pgs=101 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=10232b0e2932ee40 server_cookie=618189ee7908550e in_seq=0 out_seq=0 2023-07-14T18:23:41.562 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:23:41.490+0000 7f9429ffb700 1 -- 172.21.15.163:0/2647406569 <== mds.0 v2:172.21.15.172:6838/3850440096 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18017 (crc 0 0 0) 0x55694aec5da0 con 0x55694af0c390 2023-07-14T18:23:41.563 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:23:41.490+0000 7f9429ffb700 10 client.26134 handle_command_reply: tid=0 2023-07-14T18:23:41.563 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:23:41.490+0000 7f9454abfb80 1 client.26134 shutdown 2023-07-14T18:23:41.563 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:23:41.490+0000 7f9454abfb80 1 -- 172.21.15.163:0/2647406569 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55694aef6f60 msgr2=0x55694af009e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:23:41.563 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:23:41.490+0000 7f9454abfb80 1 --2- 172.21.15.163:0/2647406569 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55694aef6f60 0x55694af009e0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f9434096990 tx=0x7f94340044f0 comp rx=0 tx=0).stop 2023-07-14T18:23:41.563 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:23:41.490+0000 7f9454abfb80 1 -- 172.21.15.163:0/2647406569 shutdown_connections 2023-07-14T18:23:41.564 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:23:41.490+0000 7f9454abfb80 1 --2- 172.21.15.163:0/2647406569 >> [v2:172.21.15.172:6838/3850440096,v1:172.21.15.172:6839/3850440096] conn(0x55694af0c390 0x55694af0e7a0 crc :-1 s=READY pgs=101 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:23:41.564 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:23:41.491+0000 7f9454abfb80 1 --2- 172.21.15.163:0/2647406569 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55694aef6f60 0x55694af009e0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:23:41.564 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:23:41.491+0000 7f9454abfb80 1 --2- 172.21.15.163:0/2647406569 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55694aef84b0 0x55694af07f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:23:41.564 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:23:41.491+0000 7f9429ffb700 0 client.26134 ms_handle_reset on v2:172.21.15.172:6838/3850440096 2023-07-14T18:23:41.565 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:23:41.491+0000 7f9454abfb80 1 --2- 172.21.15.163:0/2647406569 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55694aef78b0 0x55694af00f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:23:41.565 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:23:41.491+0000 7f9454abfb80 1 -- 172.21.15.163:0/2647406569 >> 172.21.15.163:0/2647406569 conn(0x55694aeec680 msgr2=0x55694aef0650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:23:41.565 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:23:41.491+0000 7f9454abfb80 1 -- 172.21.15.163:0/2647406569 shutdown_connections 2023-07-14T18:23:41.565 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:23:41.491+0000 7f9454abfb80 1 -- 172.21.15.163:0/2647406569 wait complete. 2023-07-14T18:23:41.566 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:23:41.491+0000 7f9454abfb80 20 client.26134 trim_cache size 0 max 16384 2023-07-14T18:23:41.571 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:23:41.513+0000 7f9454abfb80 1 Processor -- start 2023-07-14T18:23:41.572 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:23:41.513+0000 7f9454abfb80 1 -- start start 2023-07-14T18:23:41.572 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:23:41.513+0000 7f9454abfb80 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55694aef6f60 0x55694aeff6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:23:41.573 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:23:41.513+0000 7f9454abfb80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55694aef78b0 0x55694aef10f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:23:41.573 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:23:41.513+0000 7f9454abfb80 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55694aef84b0 0x55694aefe890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:23:41.573 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:23:41.513+0000 7f9454abfb80 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x55694af01bd0 con 0x55694aef6f60 2023-07-14T18:23:41.574 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:23:41.513+0000 7f9454abfb80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x55694aeffe90 con 0x55694aef78b0 2023-07-14T18:23:41.574 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:23:41.513+0000 7f9454abfb80 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x55694aef28b0 con 0x55694aef84b0 2023-07-14T18:23:41.575 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:23:41.513+0000 7f944259c700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55694aef6f60 0x55694aeff6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:23:41.575 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:23:41.513+0000 7f944259c700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55694aef6f60 0x55694aeff6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:60226/0 (socket says 172.21.15.163:60226) 2023-07-14T18:23:41.575 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:23:41.513+0000 7f944259c700 1 -- 172.21.15.163:0/2708524940 learned_addr learned my addr 172.21.15.163:0/2708524940 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:23:41.576 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:23:41.513+0000 7f9441d9b700 1 --2- 172.21.15.163:0/2708524940 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55694aef78b0 0x55694aef10f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:23:41.576 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:23:41.513+0000 7f9442d9d700 1 --2- 172.21.15.163:0/2708524940 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55694aef84b0 0x55694aefe890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:23:41.576 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:23:41.513+0000 7f944259c700 1 -- 172.21.15.163:0/2708524940 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55694aef84b0 msgr2=0x55694aefe890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:23:41.577 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:23:41.513+0000 7f944259c700 1 --2- 172.21.15.163:0/2708524940 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55694aef84b0 0x55694aefe890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:23:41.577 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:23:41.513+0000 7f944259c700 1 -- 172.21.15.163:0/2708524940 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55694aef78b0 msgr2=0x55694aef10f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:23:41.577 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:23:41.513+0000 7f944259c700 1 --2- 172.21.15.163:0/2708524940 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55694aef78b0 0x55694aef10f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:23:41.578 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:23:41.513+0000 7f944259c700 1 -- 172.21.15.163:0/2708524940 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55694ac5ec60 con 0x55694aef6f60 2023-07-14T18:23:41.578 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:23:41.513+0000 7f9441d9b700 1 --2- 172.21.15.163:0/2708524940 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55694aef78b0 0x55694aef10f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T18:23:41.578 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:23:41.513+0000 7f944259c700 1 --2- 172.21.15.163:0/2708524940 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55694aef6f60 0x55694aeff6a0 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7f9434095ca0 tx=0x7f9434099e20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d2e021f6262e1be7 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:23:41.579 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:23:41.514+0000 7f94317fa700 1 -- 172.21.15.163:0/2708524940 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94340a2370 con 0x55694aef6f60 2023-07-14T18:23:41.579 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:23:41.514+0000 7f94317fa700 1 -- 172.21.15.163:0/2708524940 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f9434098e80 con 0x55694aef6f60 2023-07-14T18:23:41.579 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:23:41.514+0000 7f94317fa700 1 -- 172.21.15.163:0/2708524940 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94340a1ee0 con 0x55694aef6f60 2023-07-14T18:23:41.580 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:23:41.514+0000 7f9454abfb80 1 -- 172.21.15.163:0/2708524940 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55694aef6f60 msgr2=0x55694aeff6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:23:41.580 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:23:41.514+0000 7f9454abfb80 1 --2- 172.21.15.163:0/2708524940 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55694aef6f60 0x55694aeff6a0 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7f9434095ca0 tx=0x7f9434099e20 comp rx=0 tx=0).stop 2023-07-14T18:23:41.580 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:23:41.514+0000 7f9454abfb80 1 -- 172.21.15.163:0/2708524940 shutdown_connections 2023-07-14T18:23:41.581 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:23:41.514+0000 7f9454abfb80 1 --2- 172.21.15.163:0/2708524940 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55694aef84b0 0x55694aefe890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:23:41.581 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:23:41.514+0000 7f9454abfb80 1 --2- 172.21.15.163:0/2708524940 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55694aef6f60 0x55694aeff6a0 unknown :-1 s=CLOSED pgs=724 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:23:41.582 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:23:41.514+0000 7f9454abfb80 1 --2- 172.21.15.163:0/2708524940 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55694aef78b0 0x55694aef10f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:23:41.582 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:23:41.514+0000 7f9454abfb80 1 -- 172.21.15.163:0/2708524940 >> 172.21.15.163:0/2708524940 conn(0x55694aeec680 msgr2=0x55694aef19a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:23:41.582 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:23:41.514+0000 7f9454abfb80 1 -- 172.21.15.163:0/2708524940 shutdown_connections 2023-07-14T18:23:41.583 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:23:41.514+0000 7f9454abfb80 1 -- 172.21.15.163:0/2708524940 wait complete. 2023-07-14T18:23:41.583 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:23:41.515+0000 7f9454abfb80 1 -- start start 2023-07-14T18:23:41.583 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:23:41.515+0000 7f9454abfb80 1 Processor -- start 2023-07-14T18:23:41.583 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:23:41.515+0000 7f9454abfb80 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55694aef6f60 0x55694af5c470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:23:41.584 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:23:41.515+0000 7f9454abfb80 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55694aef78b0 0x55694af5c9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:23:41.584 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:23:41.515+0000 7f9454abfb80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55694aef84b0 0x55694af639f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:23:41.584 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:23:41.515+0000 7f9454abfb80 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x55694af63f30 con 0x55694aef6f60 2023-07-14T18:23:41.584 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:23:41.515+0000 7f9454abfb80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x55694af64070 con 0x55694aef84b0 2023-07-14T18:23:41.584 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:23:41.515+0000 7f9454abfb80 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x55694af64200 con 0x55694aef78b0 2023-07-14T18:23:41.585 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:23:41.515+0000 7f9454abfb80 10 client.0 _ll_register_callbacks cb 0x7f9434005ec0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T18:23:41.585 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:23:41.516+0000 7f9441d9b700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55694aef78b0 0x55694af5c9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:23:41.585 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:23:41.516+0000 7f9442d9d700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55694aef84b0 0x55694af639f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:23:41.585 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:23:41.516+0000 7f9441d9b700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55694aef78b0 0x55694af5c9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.163:42056/0 (socket says 172.21.15.163:42056) 2023-07-14T18:23:41.585 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:23:41.516+0000 7f9441d9b700 1 -- 172.21.15.163:0/3640343580 learned_addr learned my addr 172.21.15.163:0/3640343580 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:23:41.586 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:23:41.516+0000 7f9441d9b700 1 -- 172.21.15.163:0/3640343580 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55694aef84b0 msgr2=0x55694af639f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:23:41.586 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:23:41.516+0000 7f9441d9b700 1 --2- 172.21.15.163:0/3640343580 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55694aef84b0 0x55694af639f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:23:41.586 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:23:41.516+0000 7f9441d9b700 1 -- 172.21.15.163:0/3640343580 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55694aef6f60 msgr2=0x55694af5c470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:23:41.586 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:23:41.516+0000 7f9441d9b700 1 --2- 172.21.15.163:0/3640343580 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55694aef6f60 0x55694af5c470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:23:41.586 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:23:41.516+0000 7f9441d9b700 1 -- 172.21.15.163:0/3640343580 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9438011b10 con 0x55694aef78b0 2023-07-14T18:23:41.587 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:23:41.516+0000 7f9441d9b700 1 --2- 172.21.15.163:0/3640343580 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55694aef78b0 0x55694af5c9b0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f9438005bf0 tx=0x7f94380047c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=36617c5e9ad309e5 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:23:41.587 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:23:41.516+0000 7f9429ffb700 10 client.0 ms_handle_connect on v2:172.21.15.184:3300/0 2023-07-14T18:23:41.587 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:23:41.516+0000 7f9429ffb700 1 -- 172.21.15.163:0/3640343580 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9438024040 con 0x55694aef78b0 2023-07-14T18:23:41.587 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:23:41.516+0000 7f9429ffb700 1 -- 172.21.15.163:0/3640343580 <== mon.1 v2:172.21.15.184:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 9049+0+0 (secure 0 0 0) 0x7f943802b850 con 0x55694aef78b0 2023-07-14T18:23:41.587 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:23:41.516+0000 7f9454abfb80 1 -- 172.21.15.163:0/3640343580 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f9434099f20 con 0x55694aef78b0 2023-07-14T18:23:41.588 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:23:41.517+0000 7f9429ffb700 1 -- 172.21.15.163:0/3640343580 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) v2 ==== 24+0+0 (secure 0 0 0) 0x7f943802ba50 con 0x55694aef78b0 2023-07-14T18:23:41.588 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:23:41.517+0000 7f9454abfb80 10 client.26140 fetch_fsmap learned FSMap version 39 2023-07-14T18:23:41.588 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:23:41.517+0000 7f9454abfb80 1 -- 172.21.15.163:0/3640343580 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) v3 -- 0x7f944419cf50 con 0x55694aef78b0 2023-07-14T18:23:41.588 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:23:41.517+0000 7f9429ffb700 1 -- 172.21.15.163:0/3640343580 <== mon.1 v2:172.21.15.184:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f9434099f20 con 0x55694aef78b0 2023-07-14T18:23:41.588 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:23:41.517+0000 7f9429ffb700 1 -- 172.21.15.163:0/3640343580 <== mon.1 v2:172.21.15.184:3300/0 5 ==== fsmap(e 39) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f943801f4b0 con 0x55694aef78b0 2023-07-14T18:23:41.589 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:23:41.517+0000 7f9454abfb80 10 client.26140 fetch_fsmap finished waiting for FSMap version 39 2023-07-14T18:23:41.589 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:23:41.517+0000 7f9454abfb80 10 client.26140 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-07-14T18:23:41.589 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:23:41.517+0000 7f9454abfb80 20 client.26140 populate_metadata read hostname 'smithi163' 2023-07-14T18:23:41.589 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:23:41.517+0000 7f9454abfb80 1 --2- 172.21.15.163:0/3640343580 >> [v2:172.21.15.172:6838/3850440096,v1:172.21.15.172:6839/3850440096] conn(0x55694af65c70 0x55694af68080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:23:41.589 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:23:41.517+0000 7f9454abfb80 4 client.26140 mds_command: new command op to 24518 tid=0[{"prefix": "scrub status"}] 2023-07-14T18:23:41.590 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:23:41.517+0000 7f9454abfb80 1 -- 172.21.15.163:0/3640343580 --> [v2:172.21.15.172:6838/3850440096,v1:172.21.15.172:6839/3850440096] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55694ae40eb0 con 0x55694af65c70 2023-07-14T18:23:41.590 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:23:41.517+0000 7f944259c700 1 --2- 172.21.15.163:0/3640343580 >> [v2:172.21.15.172:6838/3850440096,v1:172.21.15.172:6839/3850440096] conn(0x55694af65c70 0x55694af68080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:23:41.590 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:23:41.518+0000 7f9429ffb700 10 client.26140 ms_handle_connect on v2:172.21.15.172:6838/3850440096 2023-07-14T18:23:41.590 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:23:41.518+0000 7f944259c700 1 --2- 172.21.15.163:0/3640343580 >> [v2:172.21.15.172:6838/3850440096,v1:172.21.15.172:6839/3850440096] conn(0x55694af65c70 0x55694af68080 crc :-1 s=READY pgs=102 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=20952472bcc3c551 server_cookie=414152f74a5b411 in_seq=0 out_seq=0 2023-07-14T18:23:41.591 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:23:41.518+0000 7f9429ffb700 1 -- 172.21.15.163:0/3640343580 <== mds.0 v2:172.21.15.172:6838/3850440096 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x55694ae40eb0 con 0x55694af65c70 2023-07-14T18:23:41.591 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:23:41.518+0000 7f9429ffb700 10 client.26140 handle_command_reply: tid=0 2023-07-14T18:23:41.591 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:23:41.518+0000 7f9454abfb80 1 client.26140 shutdown 2023-07-14T18:23:41.591 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:23:41.518+0000 7f9454abfb80 1 -- 172.21.15.163:0/3640343580 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55694aef78b0 msgr2=0x55694af5c9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:23:41.591 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:23:41.518+0000 7f9454abfb80 1 --2- 172.21.15.163:0/3640343580 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55694aef78b0 0x55694af5c9b0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f9438005bf0 tx=0x7f94380047c0 comp rx=0 tx=0).stop 2023-07-14T18:23:41.592 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:23:41.518+0000 7f9454abfb80 1 -- 172.21.15.163:0/3640343580 shutdown_connections 2023-07-14T18:23:41.592 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:23:41.518+0000 7f9454abfb80 1 --2- 172.21.15.163:0/3640343580 >> [v2:172.21.15.172:6838/3850440096,v1:172.21.15.172:6839/3850440096] conn(0x55694af65c70 0x55694af68080 crc :-1 s=READY pgs=102 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:23:41.592 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:23:41.518+0000 7f9454abfb80 1 --2- 172.21.15.163:0/3640343580 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55694aef84b0 0x55694af639f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:23:41.592 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:23:41.518+0000 7f9429ffb700 0 client.26140 ms_handle_reset on v2:172.21.15.172:6838/3850440096 2023-07-14T18:23:41.592 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:23:41.518+0000 7f9454abfb80 1 --2- 172.21.15.163:0/3640343580 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55694aef6f60 0x55694af5c470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:23:41.593 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:23:41.518+0000 7f9454abfb80 1 --2- 172.21.15.163:0/3640343580 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55694aef78b0 0x55694af5c9b0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:23:41.593 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:23:41.518+0000 7f9454abfb80 1 -- 172.21.15.163:0/3640343580 >> 172.21.15.163:0/3640343580 conn(0x55694aeec680 msgr2=0x55694aefe890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:23:41.593 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:23:41.518+0000 7f9454abfb80 1 -- 172.21.15.163:0/3640343580 shutdown_connections 2023-07-14T18:23:41.593 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:23:41.518+0000 7f9454abfb80 1 -- 172.21.15.163:0/3640343580 wait complete. 2023-07-14T18:23:41.593 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:23:41.518+0000 7f9454abfb80 20 client.26140 trim_cache size 0 max 16384 2023-07-14T18:23:41.594 INFO:teuthology.orchestra.run.smithi163.stdout:{ 2023-07-14T18:23:41.594 INFO:teuthology.orchestra.run.smithi163.stdout: "status": "IDLE (waiting for more scrubs)", 2023-07-14T18:23:41.594 INFO:teuthology.orchestra.run.smithi163.stdout: "scrubs": { 2023-07-14T18:23:41.595 INFO:teuthology.orchestra.run.smithi163.stdout: "2c53b7ef-6f30-49f0-a60d-f1f114c19d42": { 2023-07-14T18:23:41.595 INFO:teuthology.orchestra.run.smithi163.stdout: "path": "/", 2023-07-14T18:23:41.595 INFO:teuthology.orchestra.run.smithi163.stdout: "tag": "2c53b7ef-6f30-49f0-a60d-f1f114c19d42", 2023-07-14T18:23:41.595 INFO:teuthology.orchestra.run.smithi163.stdout: "options": "recursive,force" 2023-07-14T18:23:41.595 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-07-14T18:23:41.596 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-07-14T18:23:41.596 INFO:teuthology.orchestra.run.smithi163.stdout:} 2023-07-14T18:23:41.597 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:23:41.519+0000 7f9448927700 1 -- 172.21.15.163:0/1331767760 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f942c0a1150 msgr2=0x7f942c0a3600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:23:41.597 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:23:41.519+0000 7f9448927700 1 --2- 172.21.15.163:0/1331767760 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f942c0a1150 0x7f942c0a3600 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f9438009be0 tx=0x7f9438009260 comp rx=0 tx=0).stop 2023-07-14T18:23:41.598 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:23:41.519+0000 7f9448927700 1 -- 172.21.15.163:0/1331767760 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f94440feb10 msgr2=0x7f9444194910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:23:41.598 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:23:41.519+0000 7f9448927700 1 --2- 172.21.15.163:0/1331767760 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f94440feb10 0x7f9444194910 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f943400e9c0 tx=0x7f943400ecd0 comp rx=0 tx=0).stop 2023-07-14T18:23:41.599 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:23:41.519+0000 7f9448927700 1 -- 172.21.15.163:0/1331767760 shutdown_connections 2023-07-14T18:23:41.599 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:23:41.519+0000 7f9448927700 1 --2- 172.21.15.163:0/1331767760 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f942c0a1150 0x7f942c0a3600 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:23:41.599 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:23:41.519+0000 7f9448927700 1 --2- 172.21.15.163:0/1331767760 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f9444100690 0x7f944419bec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:23:41.600 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:23:41.519+0000 7f9448927700 1 --2- 172.21.15.163:0/1331767760 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f94440feb10 0x7f9444194910 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:23:41.600 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:23:41.519+0000 7f9448927700 1 --2- 172.21.15.163:0/1331767760 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f94440ffd00 0x7f9444194e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:23:41.601 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:23:41.519+0000 7f9448927700 1 -- 172.21.15.163:0/1331767760 >> 172.21.15.163:0/1331767760 conn(0x7f94440fa130 msgr2=0x7f94441031e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:23:41.601 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:23:41.519+0000 7f9448927700 1 -- 172.21.15.163:0/1331767760 shutdown_connections 2023-07-14T18:23:41.601 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:23:41.519+0000 7f9448927700 1 -- 172.21.15.163:0/1331767760 wait complete. 2023-07-14T18:23:41.602 INFO:tasks.cephfs.filesystem:scrub status for tag:2c53b7ef-6f30-49f0-a60d-f1f114c19d42 - {'path': '/', 'tag': '2c53b7ef-6f30-49f0-a60d-f1f114c19d42', 'options': 'recursive,force'} 2023-07-14T18:23:42.286 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:23:41 smithi172 ceph-mon[97983]: pgmap v631: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-07-14T18:23:42.436 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:23:41 smithi184 ceph-mon[98481]: pgmap v631: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-07-14T18:23:42.478 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:23:41 smithi163 ceph-mon[96576]: pgmap v631: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-07-14T18:23:44.978 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:23:44 smithi163 ceph-mon[96576]: pgmap v632: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-07-14T18:23:45.037 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:23:44 smithi172 ceph-mon[97983]: pgmap v632: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-07-14T18:23:45.186 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:23:44 smithi184 ceph-mon[98481]: pgmap v632: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-07-14T18:23:46.978 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:23:46 smithi163 ceph-mon[96576]: pgmap v633: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-07-14T18:23:47.036 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:23:46 smithi172 ceph-mon[97983]: pgmap v633: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-07-14T18:23:47.186 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:23:46 smithi184 ceph-mon[98481]: pgmap v633: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-07-14T18:23:48.978 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:23:48 smithi163 ceph-mon[96576]: pgmap v634: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-07-14T18:23:49.037 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:23:48 smithi172 ceph-mon[97983]: pgmap v634: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-07-14T18:23:49.186 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:23:48 smithi184 ceph-mon[98481]: pgmap v634: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-07-14T18:23:50.978 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:23:50 smithi163 ceph-mon[96576]: pgmap v635: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-07-14T18:23:51.037 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:23:50 smithi172 ceph-mon[97983]: pgmap v635: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-07-14T18:23:51.186 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:23:50 smithi184 ceph-mon[98481]: pgmap v635: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-07-14T18:23:52.287 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:23:51 smithi172 ceph-mon[97983]: pgmap v636: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-07-14T18:23:52.436 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:23:51 smithi184 ceph-mon[98481]: pgmap v636: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-07-14T18:23:52.478 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:23:51 smithi163 ceph-mon[96576]: pgmap v636: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-07-14T18:23:54.978 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:23:54 smithi163 ceph-mon[96576]: pgmap v637: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-07-14T18:23:55.037 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:23:54 smithi172 ceph-mon[97983]: pgmap v637: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-07-14T18:23:55.186 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:23:54 smithi184 ceph-mon[98481]: pgmap v637: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-07-14T18:23:56.978 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:23:56 smithi163 ceph-mon[96576]: pgmap v638: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-07-14T18:23:57.037 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:23:56 smithi172 ceph-mon[97983]: pgmap v638: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-07-14T18:23:57.186 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:23:56 smithi184 ceph-mon[98481]: pgmap v638: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-07-14T18:23:58.978 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:23:58 smithi163 ceph-mon[96576]: pgmap v639: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-07-14T18:23:59.037 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:23:58 smithi172 ceph-mon[97983]: pgmap v639: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-07-14T18:23:59.186 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:23:58 smithi184 ceph-mon[98481]: pgmap v639: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-07-14T18:24:00.978 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:24:00 smithi163 ceph-mon[96576]: pgmap v640: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-07-14T18:24:01.037 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:24:00 smithi172 ceph-mon[97983]: pgmap v640: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-07-14T18:24:01.186 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:24:00 smithi184 ceph-mon[98481]: pgmap v640: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-07-14T18:24:02.287 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:24:01 smithi172 ceph-mon[97983]: pgmap v641: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-07-14T18:24:02.436 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:24:01 smithi184 ceph-mon[98481]: pgmap v641: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-07-14T18:24:02.478 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:24:01 smithi163 ceph-mon[96576]: pgmap v641: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-07-14T18:24:04.978 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:24:04 smithi163 ceph-mon[96576]: pgmap v642: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-07-14T18:24:05.037 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:24:04 smithi172 ceph-mon[97983]: pgmap v642: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-07-14T18:24:05.186 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:24:04 smithi184 ceph-mon[98481]: pgmap v642: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-07-14T18:24:06.978 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:24:06 smithi163 ceph-mon[96576]: pgmap v643: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-07-14T18:24:07.037 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:24:06 smithi172 ceph-mon[97983]: pgmap v643: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-07-14T18:24:07.186 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:24:06 smithi184 ceph-mon[98481]: pgmap v643: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-07-14T18:24:08.978 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:24:08 smithi163 ceph-mon[96576]: pgmap v644: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-07-14T18:24:09.037 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:24:08 smithi172 ceph-mon[97983]: pgmap v644: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-07-14T18:24:09.186 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:24:08 smithi184 ceph-mon[98481]: pgmap v644: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-07-14T18:24:10.978 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:24:10 smithi163 ceph-mon[96576]: pgmap v645: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-07-14T18:24:11.037 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:24:10 smithi172 ceph-mon[97983]: pgmap v645: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-07-14T18:24:11.186 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:24:10 smithi184 ceph-mon[98481]: pgmap v645: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-07-14T18:24:11.603 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-07-14T18:24:11.772 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:24:11.719+0000 7f6d5f752700 1 -- 172.21.15.163:0/1867376726 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f6d580fe280 msgr2=0x7f6d580fe690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:24:11.772 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:24:11.719+0000 7f6d5f752700 1 --2- 172.21.15.163:0/1867376726 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f6d580fe280 0x7f6d580fe690 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7f6d54009990 tx=0x7f6d54009ca0 comp rx=0 tx=0).stop 2023-07-14T18:24:11.773 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:24:11.719+0000 7f6d5f752700 1 -- 172.21.15.163:0/1867376726 shutdown_connections 2023-07-14T18:24:11.773 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:24:11.719+0000 7f6d5f752700 1 --2- 172.21.15.163:0/1867376726 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6d580ffe00 0x7f6d581066c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:24:11.773 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:24:11.719+0000 7f6d5f752700 1 --2- 172.21.15.163:0/1867376726 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f6d580fe280 0x7f6d580fe690 unknown :-1 s=CLOSED pgs=725 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:24:11.773 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:24:11.719+0000 7f6d5f752700 1 --2- 172.21.15.163:0/1867376726 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6d580ff470 0x7f6d580ff8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:24:11.773 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:24:11.719+0000 7f6d5f752700 1 -- 172.21.15.163:0/1867376726 >> 172.21.15.163:0/1867376726 conn(0x7f6d580f98a0 msgr2=0x7f6d580fbcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:24:11.774 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:24:11.720+0000 7f6d5f752700 1 -- 172.21.15.163:0/1867376726 shutdown_connections 2023-07-14T18:24:11.774 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:24:11.720+0000 7f6d5f752700 1 -- 172.21.15.163:0/1867376726 wait complete. 2023-07-14T18:24:11.775 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:24:11.720+0000 7f6d5f752700 1 Processor -- start 2023-07-14T18:24:11.776 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:24:11.720+0000 7f6d5f752700 1 -- start start 2023-07-14T18:24:11.776 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:24:11.720+0000 7f6d5f752700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f6d580fe280 0x7f6d581936f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:24:11.776 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:24:11.720+0000 7f6d5f752700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6d580ff470 0x7f6d58193c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:24:11.776 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:24:11.720+0000 7f6d5f752700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6d580ffe00 0x7f6d5819aca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:24:11.777 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:24:11.720+0000 7f6d5f752700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d5819b270 con 0x7f6d580fe280 2023-07-14T18:24:11.777 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:24:11.720+0000 7f6d5f752700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d5819b3b0 con 0x7f6d580ff470 2023-07-14T18:24:11.777 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:24:11.720+0000 7f6d5f752700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d5819b540 con 0x7f6d580ffe00 2023-07-14T18:24:11.777 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:24:11.721+0000 7f6d5d4ee700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f6d580fe280 0x7f6d581936f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:24:11.777 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:24:11.721+0000 7f6d5cced700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6d580ff470 0x7f6d58193c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:24:11.778 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:24:11.721+0000 7f6d5d4ee700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f6d580fe280 0x7f6d581936f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:60244/0 (socket says 172.21.15.163:60244) 2023-07-14T18:24:11.778 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:24:11.721+0000 7f6d5d4ee700 1 -- 172.21.15.163:0/424183078 learned_addr learned my addr 172.21.15.163:0/424183078 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:24:11.778 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:24:11.721+0000 7f6d5dcef700 1 --2- 172.21.15.163:0/424183078 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6d580ffe00 0x7f6d5819aca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:24:11.778 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:24:11.721+0000 7f6d5d4ee700 1 -- 172.21.15.163:0/424183078 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6d580ffe00 msgr2=0x7f6d5819aca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:24:11.778 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:24:11.721+0000 7f6d5d4ee700 1 --2- 172.21.15.163:0/424183078 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6d580ffe00 0x7f6d5819aca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:24:11.779 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:24:11.721+0000 7f6d5d4ee700 1 -- 172.21.15.163:0/424183078 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6d580ff470 msgr2=0x7f6d58193c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:24:11.779 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:24:11.721+0000 7f6d5d4ee700 1 --2- 172.21.15.163:0/424183078 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6d580ff470 0x7f6d58193c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:24:11.779 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:24:11.721+0000 7f6d5d4ee700 1 -- 172.21.15.163:0/424183078 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d540095f0 con 0x7f6d580fe280 2023-07-14T18:24:11.779 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:24:11.721+0000 7f6d5cced700 1 --2- 172.21.15.163:0/424183078 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6d580ff470 0x7f6d58193c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T18:24:11.779 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:24:11.721+0000 7f6d5d4ee700 1 --2- 172.21.15.163:0/424183078 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f6d580fe280 0x7f6d581936f0 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7f6d54003ec0 tx=0x7f6d54005740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:24:11.780 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:24:11.721+0000 7f6d4e7fc700 1 -- 172.21.15.163:0/424183078 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d5401d070 con 0x7f6d580fe280 2023-07-14T18:24:11.780 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:24:11.721+0000 7f6d4e7fc700 1 -- 172.21.15.163:0/424183078 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f6d5400bd50 con 0x7f6d580fe280 2023-07-14T18:24:11.780 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:24:11.721+0000 7f6d5f752700 1 -- 172.21.15.163:0/424183078 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6d5819b7c0 con 0x7f6d580fe280 2023-07-14T18:24:11.780 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:24:11.721+0000 7f6d4e7fc700 1 -- 172.21.15.163:0/424183078 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d54022d00 con 0x7f6d580fe280 2023-07-14T18:24:11.780 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:24:11.721+0000 7f6d5f752700 1 -- 172.21.15.163:0/424183078 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d5819bc40 con 0x7f6d580fe280 2023-07-14T18:24:11.784 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:24:11.724+0000 7f6d4e7fc700 1 -- 172.21.15.163:0/424183078 <== mon.0 v2:172.21.15.163:3300/0 4 ==== mgrmap(e 18) v1 ==== 135716+0+0 (secure 0 0 0) 0x7f6d54022500 con 0x7f6d580fe280 2023-07-14T18:24:11.785 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:24:11.725+0000 7f6d4e7fc700 1 --2- 172.21.15.163:0/424183078 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f6d440a11d0 0x7f6d440a3680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:24:11.785 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:24:11.725+0000 7f6d5cced700 1 --2- 172.21.15.163:0/424183078 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f6d440a11d0 0x7f6d440a3680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:24:11.785 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:24:11.725+0000 7f6d4e7fc700 1 -- 172.21.15.163:0/424183078 <== mon.0 v2:172.21.15.163:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 9049+0+0 (secure 0 0 0) 0x7f6d540ce040 con 0x7f6d580fe280 2023-07-14T18:24:11.785 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:24:11.725+0000 7f6d5cced700 1 --2- 172.21.15.163:0/424183078 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f6d440a11d0 0x7f6d440a3680 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f6d4800e510 tx=0x7f6d48010040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:24:11.786 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:24:11.725+0000 7f6d6b8eab80 1 Processor -- start 2023-07-14T18:24:11.786 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:24:11.726+0000 7f6d6b8eab80 1 -- start start 2023-07-14T18:24:11.786 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:24:11.726+0000 7f6d6b8eab80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5591eab71f60 0x5591eab72370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:24:11.786 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:24:11.726+0000 7f6d6b8eab80 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5591eab728b0 0x5591eab72ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:24:11.786 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:24:11.726+0000 7f6d6b8eab80 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5591eab734b0 0x5591eab73920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:24:11.787 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:24:11.726+0000 7f6d6b8eab80 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x5591eaa76cb0 con 0x5591eab734b0 2023-07-14T18:24:11.787 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:24:11.726+0000 7f6d6b8eab80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x5591eaac9a40 con 0x5591eab71f60 2023-07-14T18:24:11.787 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:24:11.726+0000 7f6d6b8eab80 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x5591eaac2ed0 con 0x5591eab728b0 2023-07-14T18:24:11.787 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:24:11.726+0000 7f6d5d4ee700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5591eab71f60 0x5591eab72370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:24:11.787 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:24:11.726+0000 7f6d5dcef700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5591eab734b0 0x5591eab73920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:24:11.787 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:24:11.726+0000 7f6d5d4ee700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5591eab71f60 0x5591eab72370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.163:60936/0 (socket says 172.21.15.163:60936) 2023-07-14T18:24:11.788 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:24:11.726+0000 7f6d5d4ee700 1 -- 172.21.15.163:0/4059845599 learned_addr learned my addr 172.21.15.163:0/4059845599 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:24:11.788 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:24:11.726+0000 7f6d5cced700 1 --2- 172.21.15.163:0/4059845599 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5591eab728b0 0x5591eab72ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:24:11.788 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:24:11.726+0000 7f6d5d4ee700 1 -- 172.21.15.163:0/4059845599 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5591eab728b0 msgr2=0x5591eab72ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:24:11.788 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:24:11.726+0000 7f6d5d4ee700 1 --2- 172.21.15.163:0/4059845599 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5591eab728b0 0x5591eab72ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:24:11.788 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:24:11.726+0000 7f6d5d4ee700 1 -- 172.21.15.163:0/4059845599 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5591eab734b0 msgr2=0x5591eab73920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:24:11.789 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:24:11.726+0000 7f6d5d4ee700 1 --2- 172.21.15.163:0/4059845599 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5591eab734b0 0x5591eab73920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:24:11.789 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:24:11.726+0000 7f6d5d4ee700 1 -- 172.21.15.163:0/4059845599 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5591ea8f0de0 con 0x5591eab71f60 2023-07-14T18:24:11.789 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:24:11.726+0000 7f6d5cced700 1 --2- 172.21.15.163:0/4059845599 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5591eab728b0 0x5591eab72ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T18:24:11.789 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:24:11.726+0000 7f6d5dcef700 1 --2- 172.21.15.163:0/4059845599 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5591eab734b0 0x5591eab73920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T18:24:11.789 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:24:11.726+0000 7f6d5d4ee700 1 --2- 172.21.15.163:0/4059845599 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5591eab71f60 0x5591eab72370 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f6d54097c20 tx=0x7f6d54009ca0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b054a4dbc8d6fda8 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:24:11.790 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:24:11.727+0000 7f6d437fe700 1 -- 172.21.15.163:0/4059845599 <== mon.2 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d5409b1b0 con 0x5591eab71f60 2023-07-14T18:24:11.790 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:24:11.727+0000 7f6d437fe700 1 -- 172.21.15.163:0/4059845599 <== mon.2 v2:172.21.15.172:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f6d5409f1e0 con 0x5591eab71f60 2023-07-14T18:24:11.790 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:24:11.727+0000 7f6d437fe700 1 -- 172.21.15.163:0/4059845599 <== mon.2 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d540a30e0 con 0x5591eab71f60 2023-07-14T18:24:11.790 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:24:11.727+0000 7f6d6b8eab80 1 -- 172.21.15.163:0/4059845599 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5591eab71f60 msgr2=0x5591eab72370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:24:11.790 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:24:11.727+0000 7f6d6b8eab80 1 --2- 172.21.15.163:0/4059845599 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5591eab71f60 0x5591eab72370 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f6d54097c20 tx=0x7f6d54009ca0 comp rx=0 tx=0).stop 2023-07-14T18:24:11.791 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:24:11.728+0000 7f6d6b8eab80 1 -- 172.21.15.163:0/4059845599 shutdown_connections 2023-07-14T18:24:11.791 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:24:11.728+0000 7f6d6b8eab80 1 --2- 172.21.15.163:0/4059845599 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5591eab734b0 0x5591eab73920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:24:11.791 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:24:11.728+0000 7f6d6b8eab80 1 --2- 172.21.15.163:0/4059845599 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5591eab71f60 0x5591eab72370 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:24:11.791 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:24:11.728+0000 7f6d6b8eab80 1 --2- 172.21.15.163:0/4059845599 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5591eab728b0 0x5591eab72ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:24:11.791 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:24:11.728+0000 7f6d6b8eab80 1 -- 172.21.15.163:0/4059845599 >> 172.21.15.163:0/4059845599 conn(0x5591eab67680 msgr2=0x5591eab6c9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:24:11.792 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:24:11.728+0000 7f6d6b8eab80 1 -- 172.21.15.163:0/4059845599 shutdown_connections 2023-07-14T18:24:11.792 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:24:11.728+0000 7f6d6b8eab80 1 -- 172.21.15.163:0/4059845599 wait complete. 2023-07-14T18:24:11.792 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:24:11.728+0000 7f6d6b8eab80 1 -- start start 2023-07-14T18:24:11.792 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:24:11.728+0000 7f6d6b8eab80 1 Processor -- start 2023-07-14T18:24:11.792 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:24:11.728+0000 7f6d6b8eab80 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5591eab71f60 0x5591eab7b5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:24:11.792 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:24:11.728+0000 7f6d6b8eab80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5591eab728b0 0x5591eab7bb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:24:11.793 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:24:11.728+0000 7f6d6b8eab80 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5591eab734b0 0x5591eab82b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:24:11.793 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:24:11.728+0000 7f6d6b8eab80 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x5591eaa62ac0 con 0x5591eab734b0 2023-07-14T18:24:11.793 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:24:11.728+0000 7f6d6b8eab80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x5591eaa627c0 con 0x5591eab728b0 2023-07-14T18:24:11.794 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:24:11.728+0000 7f6d6b8eab80 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x5591ea946920 con 0x5591eab71f60 2023-07-14T18:24:11.794 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:24:11.729+0000 7f6d6b8eab80 10 client.0 _ll_register_callbacks cb 0x5591eaa60760 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T18:24:11.794 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:24:11.729+0000 7f6d5dcef700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5591eab734b0 0x5591eab82b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:24:11.794 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:24:11.729+0000 7f6d5cced700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5591eab728b0 0x5591eab7bb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:24:11.794 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:24:11.729+0000 7f6d5dcef700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5591eab734b0 0x5591eab82b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:60262/0 (socket says 172.21.15.163:60262) 2023-07-14T18:24:11.795 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:24:11.729+0000 7f6d5dcef700 1 -- 172.21.15.163:0/3875773159 learned_addr learned my addr 172.21.15.163:0/3875773159 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:24:11.795 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:24:11.729+0000 7f6d5d4ee700 1 --2- 172.21.15.163:0/3875773159 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5591eab71f60 0x5591eab7b5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:24:11.795 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:24:11.729+0000 7f6d5dcef700 1 -- 172.21.15.163:0/3875773159 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5591eab71f60 msgr2=0x5591eab7b5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:24:11.795 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:24:11.729+0000 7f6d5dcef700 1 --2- 172.21.15.163:0/3875773159 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5591eab71f60 0x5591eab7b5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:24:11.795 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:24:11.729+0000 7f6d5dcef700 1 -- 172.21.15.163:0/3875773159 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5591eab728b0 msgr2=0x5591eab7bb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:24:11.796 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:24:11.729+0000 7f6d5dcef700 1 --2- 172.21.15.163:0/3875773159 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5591eab728b0 0x5591eab7bb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:24:11.796 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:24:11.729+0000 7f6d5dcef700 1 -- 172.21.15.163:0/3875773159 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d48004050 con 0x5591eab734b0 2023-07-14T18:24:11.796 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:24:11.729+0000 7f6d5d4ee700 1 --2- 172.21.15.163:0/3875773159 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5591eab71f60 0x5591eab7b5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T18:24:11.796 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:24:11.729+0000 7f6d5dcef700 1 --2- 172.21.15.163:0/3875773159 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5591eab734b0 0x5591eab82b50 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7f6d50007d80 tx=0x7f6d500138b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=15652277efdfb649 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:24:11.796 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:24:11.729+0000 7f6d40ff9700 10 client.0 ms_handle_connect on v2:172.21.15.163:3300/0 2023-07-14T18:24:11.797 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:24:11.729+0000 7f6d40ff9700 1 -- 172.21.15.163:0/3875773159 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d50018070 con 0x5591eab734b0 2023-07-14T18:24:11.797 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:24:11.729+0000 7f6d40ff9700 1 -- 172.21.15.163:0/3875773159 <== mon.0 v2:172.21.15.163:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 9049+0+0 (secure 0 0 0) 0x7f6d500115d0 con 0x5591eab734b0 2023-07-14T18:24:11.797 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:24:11.729+0000 7f6d6b8eab80 1 -- 172.21.15.163:0/3875773159 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5591eaa1c4f0 con 0x5591eab734b0 2023-07-14T18:24:11.797 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:24:11.730+0000 7f6d40ff9700 1 -- 172.21.15.163:0/3875773159 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6d50011790 con 0x5591eab734b0 2023-07-14T18:24:11.797 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:24:11.730+0000 7f6d6b8eab80 10 client.16584 fetch_fsmap learned FSMap version 39 2023-07-14T18:24:11.798 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:24:11.730+0000 7f6d6b8eab80 1 -- 172.21.15.163:0/3875773159 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) v3 -- 0x7f6d50013440 con 0x5591eab734b0 2023-07-14T18:24:11.798 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:24:11.730+0000 7f6d40ff9700 1 -- 172.21.15.163:0/3875773159 <== mon.0 v2:172.21.15.163:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x5591eaa1c4f0 con 0x5591eab734b0 2023-07-14T18:24:11.798 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:24:11.730+0000 7f6d40ff9700 1 -- 172.21.15.163:0/3875773159 <== mon.0 v2:172.21.15.163:3300/0 5 ==== fsmap(e 39) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f6d5001b9b0 con 0x5591eab734b0 2023-07-14T18:24:11.798 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:24:11.730+0000 7f6d6b8eab80 10 client.16584 fetch_fsmap finished waiting for FSMap version 39 2023-07-14T18:24:11.798 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:24:11.730+0000 7f6d6b8eab80 10 client.16584 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-07-14T18:24:11.799 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:24:11.730+0000 7f6d6b8eab80 20 client.16584 populate_metadata read hostname 'smithi163' 2023-07-14T18:24:11.799 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:24:11.730+0000 7f6d6b8eab80 1 --2- 172.21.15.163:0/3875773159 >> [v2:172.21.15.172:6838/3850440096,v1:172.21.15.172:6839/3850440096] conn(0x5591eab873c0 0x5591eab897d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:24:11.799 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:24:11.730+0000 7f6d6b8eab80 4 client.16584 mds_command: new command op to 24518 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-14T18:24:11.799 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:24:11.730+0000 7f6d6b8eab80 1 -- 172.21.15.163:0/3875773159 --> [v2:172.21.15.172:6838/3850440096,v1:172.21.15.172:6839/3850440096] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5591eab40da0 con 0x5591eab873c0 2023-07-14T18:24:11.799 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:24:11.730+0000 7f6d5d4ee700 1 --2- 172.21.15.163:0/3875773159 >> [v2:172.21.15.172:6838/3850440096,v1:172.21.15.172:6839/3850440096] conn(0x5591eab873c0 0x5591eab897d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:24:11.799 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:24:11.731+0000 7f6d40ff9700 10 client.16584 ms_handle_connect on v2:172.21.15.172:6838/3850440096 2023-07-14T18:24:11.800 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:24:11.731+0000 7f6d5d4ee700 1 --2- 172.21.15.163:0/3875773159 >> [v2:172.21.15.172:6838/3850440096,v1:172.21.15.172:6839/3850440096] conn(0x5591eab873c0 0x5591eab897d0 crc :-1 s=READY pgs=103 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c059bb0304a5eda9 server_cookie=9ba71fc78394b15f in_seq=0 out_seq=0 2023-07-14T18:24:11.800 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:24:11.731+0000 7f6d40ff9700 1 -- 172.21.15.163:0/3875773159 <== mds.0 v2:172.21.15.172:6838/3850440096 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18017 (crc 0 0 0) 0x5591eab40da0 con 0x5591eab873c0 2023-07-14T18:24:11.800 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:24:11.731+0000 7f6d40ff9700 10 client.16584 handle_command_reply: tid=0 2023-07-14T18:24:11.800 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:24:11.731+0000 7f6d6b8eab80 1 client.16584 shutdown 2023-07-14T18:24:11.800 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:24:11.732+0000 7f6d6b8eab80 1 -- 172.21.15.163:0/3875773159 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5591eab734b0 msgr2=0x5591eab82b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:24:11.801 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:24:11.732+0000 7f6d6b8eab80 1 --2- 172.21.15.163:0/3875773159 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5591eab734b0 0x5591eab82b50 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7f6d50007d80 tx=0x7f6d500138b0 comp rx=0 tx=0).stop 2023-07-14T18:24:11.801 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:24:11.732+0000 7f6d6b8eab80 1 -- 172.21.15.163:0/3875773159 shutdown_connections 2023-07-14T18:24:11.801 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:24:11.732+0000 7f6d6b8eab80 1 --2- 172.21.15.163:0/3875773159 >> [v2:172.21.15.172:6838/3850440096,v1:172.21.15.172:6839/3850440096] conn(0x5591eab873c0 0x5591eab897d0 crc :-1 s=READY pgs=103 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:24:11.801 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:24:11.732+0000 7f6d6b8eab80 1 --2- 172.21.15.163:0/3875773159 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5591eab71f60 0x5591eab7b5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:24:11.801 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:24:11.732+0000 7f6d6b8eab80 1 --2- 172.21.15.163:0/3875773159 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5591eab734b0 0x5591eab82b50 unknown :-1 s=CLOSED pgs=727 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:24:11.802 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:24:11.732+0000 7f6d40ff9700 0 client.16584 ms_handle_reset on v2:172.21.15.172:6838/3850440096 2023-07-14T18:24:11.802 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:24:11.732+0000 7f6d6b8eab80 1 --2- 172.21.15.163:0/3875773159 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5591eab728b0 0x5591eab7bb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:24:11.802 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:24:11.732+0000 7f6d6b8eab80 1 -- 172.21.15.163:0/3875773159 >> 172.21.15.163:0/3875773159 conn(0x5591eab67680 msgr2=0x5591eab6b650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:24:11.802 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:24:11.732+0000 7f6d6b8eab80 1 -- 172.21.15.163:0/3875773159 shutdown_connections 2023-07-14T18:24:11.802 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:24:11.732+0000 7f6d6b8eab80 1 -- 172.21.15.163:0/3875773159 wait complete. 2023-07-14T18:24:11.803 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:24:11.732+0000 7f6d6b8eab80 20 client.16584 trim_cache size 0 max 16384 2023-07-14T18:24:11.805 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:24:11.752+0000 7f6d6b8eab80 1 Processor -- start 2023-07-14T18:24:11.806 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:24:11.752+0000 7f6d6b8eab80 1 -- start start 2023-07-14T18:24:11.806 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:24:11.752+0000 7f6d6b8eab80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5591eab71f60 0x5591eab80a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:24:11.806 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:24:11.752+0000 7f6d6b8eab80 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5591eab728b0 0x5591eab76370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:24:11.806 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:24:11.752+0000 7f6d6b8eab80 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5591eab734b0 0x5591eab768b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:24:11.806 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:24:11.752+0000 7f6d6b8eab80 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x5591eab6d4f0 con 0x5591eab728b0 2023-07-14T18:24:11.807 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:24:11.752+0000 7f6d6b8eab80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x5591eab84870 con 0x5591eab71f60 2023-07-14T18:24:11.807 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:24:11.752+0000 7f6d6b8eab80 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x5591eab7b140 con 0x5591eab734b0 2023-07-14T18:24:11.807 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:24:11.753+0000 7f6d5cced700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5591eab728b0 0x5591eab76370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:24:11.807 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:24:11.753+0000 7f6d5d4ee700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5591eab71f60 0x5591eab80a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:24:11.807 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:24:11.753+0000 7f6d5d4ee700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5591eab71f60 0x5591eab80a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.163:60950/0 (socket says 172.21.15.163:60950) 2023-07-14T18:24:11.808 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:24:11.753+0000 7f6d5cced700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5591eab728b0 0x5591eab76370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:60268/0 (socket says 172.21.15.163:60268) 2023-07-14T18:24:11.808 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:24:11.753+0000 7f6d5d4ee700 1 -- 172.21.15.163:0/2646537997 learned_addr learned my addr 172.21.15.163:0/2646537997 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:24:11.808 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:24:11.753+0000 7f6d5dcef700 1 --2- 172.21.15.163:0/2646537997 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5591eab734b0 0x5591eab768b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:24:11.808 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:24:11.753+0000 7f6d5d4ee700 1 -- 172.21.15.163:0/2646537997 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5591eab734b0 msgr2=0x5591eab768b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:24:11.808 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:24:11.753+0000 7f6d5d4ee700 1 --2- 172.21.15.163:0/2646537997 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5591eab734b0 0x5591eab768b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:24:11.809 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:24:11.753+0000 7f6d5d4ee700 1 -- 172.21.15.163:0/2646537997 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5591eab728b0 msgr2=0x5591eab76370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:24:11.809 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:24:11.753+0000 7f6d5d4ee700 1 --2- 172.21.15.163:0/2646537997 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5591eab728b0 0x5591eab76370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:24:11.809 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:24:11.753+0000 7f6d5d4ee700 1 -- 172.21.15.163:0/2646537997 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d5819bc40 con 0x5591eab71f60 2023-07-14T18:24:11.809 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:24:11.753+0000 7f6d5d4ee700 1 --2- 172.21.15.163:0/2646537997 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5591eab71f60 0x5591eab80a60 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f6d54005cb0 tx=0x7f6d540a1040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9bacdc1f749e2ad5 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:24:11.809 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:24:11.753+0000 7f6d43fff700 1 -- 172.21.15.163:0/2646537997 <== mon.2 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d54099550 con 0x5591eab71f60 2023-07-14T18:24:11.809 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:24:11.753+0000 7f6d43fff700 1 -- 172.21.15.163:0/2646537997 <== mon.2 v2:172.21.15.172:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f6d5409a780 con 0x5591eab71f60 2023-07-14T18:24:11.810 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:24:11.753+0000 7f6d43fff700 1 -- 172.21.15.163:0/2646537997 <== mon.2 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d540b94d0 con 0x5591eab71f60 2023-07-14T18:24:11.813 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:24:11.754+0000 7f6d6b8eab80 1 -- 172.21.15.163:0/2646537997 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5591eab71f60 msgr2=0x5591eab80a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:24:11.813 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:24:11.754+0000 7f6d6b8eab80 1 --2- 172.21.15.163:0/2646537997 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5591eab71f60 0x5591eab80a60 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f6d54005cb0 tx=0x7f6d540a1040 comp rx=0 tx=0).stop 2023-07-14T18:24:11.813 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:24:11.754+0000 7f6d6b8eab80 1 -- 172.21.15.163:0/2646537997 shutdown_connections 2023-07-14T18:24:11.814 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:24:11.754+0000 7f6d6b8eab80 1 --2- 172.21.15.163:0/2646537997 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5591eab734b0 0x5591eab768b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:24:11.814 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:24:11.754+0000 7f6d6b8eab80 1 --2- 172.21.15.163:0/2646537997 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5591eab71f60 0x5591eab80a60 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:24:11.814 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:24:11.754+0000 7f6d6b8eab80 1 --2- 172.21.15.163:0/2646537997 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5591eab728b0 0x5591eab76370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:24:11.814 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:24:11.754+0000 7f6d6b8eab80 1 -- 172.21.15.163:0/2646537997 >> 172.21.15.163:0/2646537997 conn(0x5591eab67680 msgr2=0x5591eab79820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:24:11.814 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:24:11.754+0000 7f6d6b8eab80 1 -- 172.21.15.163:0/2646537997 shutdown_connections 2023-07-14T18:24:11.815 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:24:11.754+0000 7f6d6b8eab80 1 -- 172.21.15.163:0/2646537997 wait complete. 2023-07-14T18:24:11.815 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:24:11.754+0000 7f6d6b8eab80 1 -- start start 2023-07-14T18:24:11.815 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:24:11.754+0000 7f6d6b8eab80 1 Processor -- start 2023-07-14T18:24:11.815 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:24:11.755+0000 7f6d6b8eab80 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5591eab71f60 0x5591eab809b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:24:11.815 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:24:11.755+0000 7f6d6b8eab80 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5591eab728b0 0x5591eab7f070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:24:11.816 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:24:11.755+0000 7f6d6b8eab80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5591eab734b0 0x5591eab7f5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:24:11.816 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:24:11.755+0000 7f6d6b8eab80 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x5591eab7fcf0 con 0x5591eab728b0 2023-07-14T18:24:11.816 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:24:11.755+0000 7f6d6b8eab80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x5591eab7fe60 con 0x5591eab734b0 2023-07-14T18:24:11.816 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:24:11.755+0000 7f6d6b8eab80 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x5591eabdf420 con 0x5591eab71f60 2023-07-14T18:24:11.816 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:24:11.755+0000 7f6d6b8eab80 10 client.0 _ll_register_callbacks cb 0x7f6d50007670 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T18:24:11.817 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:24:11.755+0000 7f6d5d4ee700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5591eab71f60 0x5591eab809b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:24:11.817 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:24:11.755+0000 7f6d5cced700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5591eab728b0 0x5591eab7f070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:24:11.817 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:24:11.755+0000 7f6d5d4ee700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5591eab71f60 0x5591eab809b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.163:42094/0 (socket says 172.21.15.163:42094) 2023-07-14T18:24:11.817 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:24:11.755+0000 7f6d5dcef700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5591eab734b0 0x5591eab7f5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:24:11.817 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:24:11.755+0000 7f6d5d4ee700 1 -- 172.21.15.163:0/2938895064 learned_addr learned my addr 172.21.15.163:0/2938895064 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:24:11.818 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:24:11.755+0000 7f6d5d4ee700 1 -- 172.21.15.163:0/2938895064 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5591eab734b0 msgr2=0x5591eab7f5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:24:11.818 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:24:11.755+0000 7f6d5d4ee700 1 --2- 172.21.15.163:0/2938895064 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5591eab734b0 0x5591eab7f5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:24:11.818 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:24:11.755+0000 7f6d5d4ee700 1 -- 172.21.15.163:0/2938895064 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5591eab728b0 msgr2=0x5591eab7f070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:24:11.818 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:24:11.755+0000 7f6d5d4ee700 1 --2- 172.21.15.163:0/2938895064 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5591eab728b0 0x5591eab7f070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:24:11.818 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:24:11.755+0000 7f6d5d4ee700 1 -- 172.21.15.163:0/2938895064 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5591ea8f0de0 con 0x5591eab71f60 2023-07-14T18:24:11.819 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:24:11.755+0000 7f6d5dcef700 1 --2- 172.21.15.163:0/2938895064 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5591eab734b0 0x5591eab7f5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T18:24:11.819 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:24:11.756+0000 7f6d5d4ee700 1 --2- 172.21.15.163:0/2938895064 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5591eab71f60 0x5591eab809b0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f6d540a3730 tx=0x7f6d54009310 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b169efaa7e4649f5 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:24:11.819 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:24:11.756+0000 7f6d40ff9700 10 client.0 ms_handle_connect on v2:172.21.15.184:3300/0 2023-07-14T18:24:11.819 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:24:11.756+0000 7f6d40ff9700 1 -- 172.21.15.163:0/2938895064 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d54099550 con 0x5591eab71f60 2023-07-14T18:24:11.819 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:24:11.756+0000 7f6d40ff9700 1 -- 172.21.15.163:0/2938895064 <== mon.1 v2:172.21.15.184:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 9049+0+0 (secure 0 0 0) 0x7f6d540b9470 con 0x5591eab71f60 2023-07-14T18:24:11.819 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:24:11.756+0000 7f6d6b8eab80 1 -- 172.21.15.163:0/2938895064 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f6d5409f1e0 con 0x5591eab71f60 2023-07-14T18:24:11.820 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:24:11.756+0000 7f6d40ff9700 1 -- 172.21.15.163:0/2938895064 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6d5409a8f0 con 0x5591eab71f60 2023-07-14T18:24:11.820 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:24:11.756+0000 7f6d6b8eab80 10 client.26158 fetch_fsmap learned FSMap version 39 2023-07-14T18:24:11.820 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:24:11.756+0000 7f6d6b8eab80 1 -- 172.21.15.163:0/2938895064 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) v3 -- 0x5591ea8d9c60 con 0x5591eab71f60 2023-07-14T18:24:11.820 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:24:11.756+0000 7f6d40ff9700 1 -- 172.21.15.163:0/2938895064 <== mon.1 v2:172.21.15.184:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f6d5409f1e0 con 0x5591eab71f60 2023-07-14T18:24:11.820 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:24:11.756+0000 7f6d40ff9700 1 -- 172.21.15.163:0/2938895064 <== mon.1 v2:172.21.15.184:3300/0 5 ==== fsmap(e 39) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f6d54097030 con 0x5591eab71f60 2023-07-14T18:24:11.821 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:24:11.756+0000 7f6d6b8eab80 10 client.26158 fetch_fsmap finished waiting for FSMap version 39 2023-07-14T18:24:11.821 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:24:11.756+0000 7f6d6b8eab80 10 client.26158 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-07-14T18:24:11.821 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:24:11.756+0000 7f6d6b8eab80 20 client.26158 populate_metadata read hostname 'smithi163' 2023-07-14T18:24:11.821 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:24:11.756+0000 7f6d6b8eab80 1 --2- 172.21.15.163:0/2938895064 >> [v2:172.21.15.172:6838/3850440096,v1:172.21.15.172:6839/3850440096] conn(0x5591eabe0890 0x5591eabe2ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:24:11.821 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:24:11.756+0000 7f6d6b8eab80 4 client.26158 mds_command: new command op to 24518 tid=0[{"prefix": "scrub status"}] 2023-07-14T18:24:11.822 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:24:11.756+0000 7f6d6b8eab80 1 -- 172.21.15.163:0/2938895064 --> [v2:172.21.15.172:6838/3850440096,v1:172.21.15.172:6839/3850440096] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x5591eaabbeb0 con 0x5591eabe0890 2023-07-14T18:24:11.822 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:24:11.757+0000 7f6d5cced700 1 --2- 172.21.15.163:0/2938895064 >> [v2:172.21.15.172:6838/3850440096,v1:172.21.15.172:6839/3850440096] conn(0x5591eabe0890 0x5591eabe2ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:24:11.822 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:24:11.757+0000 7f6d40ff9700 10 client.26158 ms_handle_connect on v2:172.21.15.172:6838/3850440096 2023-07-14T18:24:11.822 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:24:11.757+0000 7f6d5cced700 1 --2- 172.21.15.163:0/2938895064 >> [v2:172.21.15.172:6838/3850440096,v1:172.21.15.172:6839/3850440096] conn(0x5591eabe0890 0x5591eabe2ca0 crc :-1 s=READY pgs=104 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5310bd1e139e6079 server_cookie=97608016a3733278 in_seq=0 out_seq=0 2023-07-14T18:24:11.822 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:24:11.757+0000 7f6d40ff9700 1 -- 172.21.15.163:0/2938895064 <== mds.0 v2:172.21.15.172:6838/3850440096 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x5591eaabbeb0 con 0x5591eabe0890 2023-07-14T18:24:11.823 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:24:11.757+0000 7f6d40ff9700 10 client.26158 handle_command_reply: tid=0 2023-07-14T18:24:11.823 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:24:11.757+0000 7f6d6b8eab80 1 client.26158 shutdown 2023-07-14T18:24:11.823 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:24:11.757+0000 7f6d6b8eab80 1 -- 172.21.15.163:0/2938895064 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5591eab71f60 msgr2=0x5591eab809b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:24:11.823 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:24:11.757+0000 7f6d6b8eab80 1 --2- 172.21.15.163:0/2938895064 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5591eab71f60 0x5591eab809b0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f6d540a3730 tx=0x7f6d54009310 comp rx=0 tx=0).stop 2023-07-14T18:24:11.823 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:24:11.757+0000 7f6d6b8eab80 1 -- 172.21.15.163:0/2938895064 shutdown_connections 2023-07-14T18:24:11.824 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:24:11.757+0000 7f6d6b8eab80 1 --2- 172.21.15.163:0/2938895064 >> [v2:172.21.15.172:6838/3850440096,v1:172.21.15.172:6839/3850440096] conn(0x5591eabe0890 0x5591eabe2ca0 crc :-1 s=READY pgs=104 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:24:11.824 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:24:11.757+0000 7f6d6b8eab80 1 --2- 172.21.15.163:0/2938895064 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5591eab71f60 0x5591eab809b0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:24:11.824 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:24:11.757+0000 7f6d40ff9700 0 client.26158 ms_handle_reset on v2:172.21.15.172:6838/3850440096 2023-07-14T18:24:11.824 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:24:11.757+0000 7f6d6b8eab80 1 --2- 172.21.15.163:0/2938895064 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5591eab734b0 0x5591eab7f5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:24:11.824 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:24:11.757+0000 7f6d6b8eab80 1 --2- 172.21.15.163:0/2938895064 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5591eab728b0 0x5591eab7f070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:24:11.825 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:24:11.757+0000 7f6d6b8eab80 1 -- 172.21.15.163:0/2938895064 >> 172.21.15.163:0/2938895064 conn(0x5591eab67680 msgr2=0x5591eab76370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:24:11.825 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:24:11.758+0000 7f6d6b8eab80 1 -- 172.21.15.163:0/2938895064 shutdown_connections 2023-07-14T18:24:11.825 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:24:11.758+0000 7f6d6b8eab80 1 -- 172.21.15.163:0/2938895064 wait complete. 2023-07-14T18:24:11.825 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:24:11.758+0000 7f6d6b8eab80 20 client.26158 trim_cache size 0 max 16384 2023-07-14T18:24:11.826 INFO:teuthology.orchestra.run.smithi163.stdout:{ 2023-07-14T18:24:11.826 INFO:teuthology.orchestra.run.smithi163.stdout: "status": "IDLE (waiting for more scrubs)", 2023-07-14T18:24:11.826 INFO:teuthology.orchestra.run.smithi163.stdout: "scrubs": { 2023-07-14T18:24:11.826 INFO:teuthology.orchestra.run.smithi163.stdout: "2c53b7ef-6f30-49f0-a60d-f1f114c19d42": { 2023-07-14T18:24:11.826 INFO:teuthology.orchestra.run.smithi163.stdout: "path": "/", 2023-07-14T18:24:11.827 INFO:teuthology.orchestra.run.smithi163.stdout: "tag": "2c53b7ef-6f30-49f0-a60d-f1f114c19d42", 2023-07-14T18:24:11.827 INFO:teuthology.orchestra.run.smithi163.stdout: "options": "recursive,force" 2023-07-14T18:24:11.827 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-07-14T18:24:11.827 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-07-14T18:24:11.827 INFO:teuthology.orchestra.run.smithi163.stdout:} 2023-07-14T18:24:11.828 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:24:11.758+0000 7f6d5f752700 1 -- 172.21.15.163:0/424183078 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f6d440a11d0 msgr2=0x7f6d440a3680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:24:11.829 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:24:11.758+0000 7f6d5f752700 1 --2- 172.21.15.163:0/424183078 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f6d440a11d0 0x7f6d440a3680 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f6d4800e510 tx=0x7f6d48010040 comp rx=0 tx=0).stop 2023-07-14T18:24:11.829 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:24:11.758+0000 7f6d5f752700 1 -- 172.21.15.163:0/424183078 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f6d580fe280 msgr2=0x7f6d581936f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:24:11.829 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:24:11.758+0000 7f6d5f752700 1 --2- 172.21.15.163:0/424183078 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f6d580fe280 0x7f6d581936f0 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7f6d54003ec0 tx=0x7f6d54005740 comp rx=0 tx=0).stop 2023-07-14T18:24:11.829 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:24:11.758+0000 7f6d5f752700 1 -- 172.21.15.163:0/424183078 shutdown_connections 2023-07-14T18:24:11.830 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:24:11.758+0000 7f6d5f752700 1 --2- 172.21.15.163:0/424183078 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f6d440a11d0 0x7f6d440a3680 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:24:11.830 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:24:11.758+0000 7f6d5f752700 1 --2- 172.21.15.163:0/424183078 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6d580ffe00 0x7f6d5819aca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:24:11.830 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:24:11.758+0000 7f6d5f752700 1 --2- 172.21.15.163:0/424183078 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f6d580fe280 0x7f6d581936f0 unknown :-1 s=CLOSED pgs=726 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:24:11.830 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:24:11.758+0000 7f6d5f752700 1 --2- 172.21.15.163:0/424183078 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6d580ff470 0x7f6d58193c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:24:11.830 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:24:11.758+0000 7f6d5f752700 1 -- 172.21.15.163:0/424183078 >> 172.21.15.163:0/424183078 conn(0x7f6d580f98a0 msgr2=0x7f6d580fbc10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:24:11.831 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:24:11.758+0000 7f6d5f752700 1 -- 172.21.15.163:0/424183078 shutdown_connections 2023-07-14T18:24:11.831 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:24:11.758+0000 7f6d5f752700 1 -- 172.21.15.163:0/424183078 wait complete. 2023-07-14T18:24:11.831 INFO:tasks.cephfs.filesystem:scrub status for tag:2c53b7ef-6f30-49f0-a60d-f1f114c19d42 - {'path': '/', 'tag': '2c53b7ef-6f30-49f0-a60d-f1f114c19d42', 'options': 'recursive,force'} 2023-07-14T18:24:12.287 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:24:11 smithi172 ceph-mon[97983]: pgmap v646: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-07-14T18:24:12.436 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:24:11 smithi184 ceph-mon[98481]: pgmap v646: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-07-14T18:24:12.478 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:24:11 smithi163 ceph-mon[96576]: pgmap v646: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-07-14T18:24:14.978 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:24:14 smithi163 ceph-mon[96576]: pgmap v647: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-07-14T18:24:15.037 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:24:14 smithi172 ceph-mon[97983]: pgmap v647: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-07-14T18:24:15.186 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:24:14 smithi184 ceph-mon[98481]: pgmap v647: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-07-14T18:24:16.978 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:24:16 smithi163 ceph-mon[96576]: pgmap v648: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-07-14T18:24:17.037 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:24:16 smithi172 ceph-mon[97983]: pgmap v648: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-07-14T18:24:17.186 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:24:16 smithi184 ceph-mon[98481]: pgmap v648: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-07-14T18:24:18.978 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:24:18 smithi163 ceph-mon[96576]: pgmap v649: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-07-14T18:24:19.037 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:24:18 smithi172 ceph-mon[97983]: pgmap v649: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-07-14T18:24:19.186 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:24:18 smithi184 ceph-mon[98481]: pgmap v649: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-07-14T18:24:20.978 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:24:20 smithi163 ceph-mon[96576]: pgmap v650: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-07-14T18:24:21.037 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:24:20 smithi172 ceph-mon[97983]: pgmap v650: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-07-14T18:24:21.186 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:24:20 smithi184 ceph-mon[98481]: pgmap v650: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-07-14T18:24:22.287 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:24:21 smithi172 ceph-mon[97983]: pgmap v651: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-07-14T18:24:22.436 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:24:21 smithi184 ceph-mon[98481]: pgmap v651: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-07-14T18:24:22.478 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:24:21 smithi163 ceph-mon[96576]: pgmap v651: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-07-14T18:24:24.979 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:24:24 smithi163 ceph-mon[96576]: pgmap v652: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-07-14T18:24:25.037 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:24:24 smithi172 ceph-mon[97983]: pgmap v652: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-07-14T18:24:25.186 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:24:24 smithi184 ceph-mon[98481]: pgmap v652: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-07-14T18:24:26.979 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:24:26 smithi163 ceph-mon[96576]: pgmap v653: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-07-14T18:24:27.037 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:24:26 smithi172 ceph-mon[97983]: pgmap v653: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-07-14T18:24:27.186 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:24:26 smithi184 ceph-mon[98481]: pgmap v653: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-07-14T18:24:28.979 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:24:28 smithi163 ceph-mon[96576]: pgmap v654: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-07-14T18:24:29.037 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:24:28 smithi172 ceph-mon[97983]: pgmap v654: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-07-14T18:24:29.186 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:24:28 smithi184 ceph-mon[98481]: pgmap v654: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-07-14T18:24:30.979 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:24:30 smithi163 ceph-mon[96576]: pgmap v655: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-07-14T18:24:31.037 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:24:30 smithi172 ceph-mon[97983]: pgmap v655: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-07-14T18:24:31.186 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:24:30 smithi184 ceph-mon[98481]: pgmap v655: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-07-14T18:24:32.288 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:24:31 smithi172 ceph-mon[97983]: pgmap v656: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-07-14T18:24:32.436 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:24:31 smithi184 ceph-mon[98481]: pgmap v656: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-07-14T18:24:32.479 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:24:31 smithi163 ceph-mon[96576]: pgmap v656: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-07-14T18:24:33.287 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:24:32 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-14T18:24:33.436 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:24:32 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-14T18:24:33.479 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:24:32 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-14T18:24:34.287 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:24:33 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T18:24:34.288 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:24:33 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-14T18:24:34.288 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:24:33 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:24:34.288 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:24:33 smithi172 ceph-mon[97983]: pgmap v657: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-07-14T18:24:34.436 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:24:33 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T18:24:34.437 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:24:33 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-14T18:24:34.437 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:24:33 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:24:34.437 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:24:33 smithi184 ceph-mon[98481]: pgmap v657: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-07-14T18:24:34.479 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:24:33 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T18:24:34.479 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:24:33 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-14T18:24:34.479 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:24:33 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:24:34.480 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:24:33 smithi163 ceph-mon[96576]: pgmap v657: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-07-14T18:24:36.979 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:24:36 smithi163 ceph-mon[96576]: pgmap v658: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-07-14T18:24:37.037 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:24:36 smithi172 ceph-mon[97983]: pgmap v658: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-07-14T18:24:37.186 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:24:36 smithi184 ceph-mon[98481]: pgmap v658: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-07-14T18:24:38.979 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:24:38 smithi163 ceph-mon[96576]: pgmap v659: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-07-14T18:24:39.037 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:24:38 smithi172 ceph-mon[97983]: pgmap v659: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-07-14T18:24:39.187 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:24:38 smithi184 ceph-mon[98481]: pgmap v659: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-07-14T18:24:41.037 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:24:40 smithi172 ceph-mon[97983]: pgmap v660: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-07-14T18:24:41.186 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:24:40 smithi184 ceph-mon[98481]: pgmap v660: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-07-14T18:24:41.229 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:24:40 smithi163 ceph-mon[96576]: pgmap v660: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-07-14T18:24:41.832 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-07-14T18:24:41.989 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:24:41.936+0000 7f9aec033700 1 -- 172.21.15.163:0/2870833546 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f9ae40feb80 msgr2=0x7f9ae40fef90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:24:41.989 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:24:41.936+0000 7f9aec033700 1 --2- 172.21.15.163:0/2870833546 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f9ae40feb80 0x7f9ae40fef90 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7f9ae0009990 tx=0x7f9ae0009ca0 comp rx=0 tx=0).stop 2023-07-14T18:24:41.990 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:24:41.936+0000 7f9aec033700 1 -- 172.21.15.163:0/2870833546 shutdown_connections 2023-07-14T18:24:41.990 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:24:41.936+0000 7f9aec033700 1 --2- 172.21.15.163:0/2870833546 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9ae4100700 0x7f9ae4106fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:24:41.990 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:24:41.936+0000 7f9aec033700 1 --2- 172.21.15.163:0/2870833546 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f9ae40feb80 0x7f9ae40fef90 unknown :-1 s=CLOSED pgs=728 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:24:41.990 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:24:41.936+0000 7f9aec033700 1 --2- 172.21.15.163:0/2870833546 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9ae40ffd70 0x7f9ae41001c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:24:41.990 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:24:41.936+0000 7f9aec033700 1 -- 172.21.15.163:0/2870833546 >> 172.21.15.163:0/2870833546 conn(0x7f9ae40fa1a0 msgr2=0x7f9ae40fc5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:24:41.991 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:24:41.936+0000 7f9aec033700 1 -- 172.21.15.163:0/2870833546 shutdown_connections 2023-07-14T18:24:41.991 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:24:41.936+0000 7f9aec033700 1 -- 172.21.15.163:0/2870833546 wait complete. 2023-07-14T18:24:41.992 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:24:41.937+0000 7f9aec033700 1 Processor -- start 2023-07-14T18:24:41.992 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:24:41.937+0000 7f9aec033700 1 -- start start 2023-07-14T18:24:41.992 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:24:41.937+0000 7f9aec033700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9ae40feb80 0x7f9ae41947a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:24:41.993 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:24:41.937+0000 7f9aec033700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9ae40ffd70 0x7f9ae4194ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:24:41.993 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:24:41.937+0000 7f9aec033700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f9ae4100700 0x7f9ae419bd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:24:41.993 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:24:41.937+0000 7f9aec033700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ae419c320 con 0x7f9ae4100700 2023-07-14T18:24:41.993 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:24:41.937+0000 7f9aec033700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ae419c460 con 0x7f9ae40feb80 2023-07-14T18:24:41.993 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:24:41.937+0000 7f9aec033700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ae419c5f0 con 0x7f9ae40ffd70 2023-07-14T18:24:41.994 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:24:41.937+0000 7f9ae9dcf700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9ae40feb80 0x7f9ae41947a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:24:41.994 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:24:41.937+0000 7f9ae95ce700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9ae40ffd70 0x7f9ae4194ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:24:41.994 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:24:41.937+0000 7f9aea5d0700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f9ae4100700 0x7f9ae419bd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:24:41.994 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:24:41.937+0000 7f9ae9dcf700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9ae40feb80 0x7f9ae41947a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.163:60970/0 (socket says 172.21.15.163:60970) 2023-07-14T18:24:41.994 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:24:41.937+0000 7f9ae9dcf700 1 -- 172.21.15.163:0/96484849 learned_addr learned my addr 172.21.15.163:0/96484849 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:24:41.995 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:24:41.937+0000 7f9aea5d0700 1 -- 172.21.15.163:0/96484849 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9ae40ffd70 msgr2=0x7f9ae4194ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:24:41.995 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:24:41.937+0000 7f9aea5d0700 1 --2- 172.21.15.163:0/96484849 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9ae40ffd70 0x7f9ae4194ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:24:41.995 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:24:41.937+0000 7f9aea5d0700 1 -- 172.21.15.163:0/96484849 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9ae40feb80 msgr2=0x7f9ae41947a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:24:41.995 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:24:41.937+0000 7f9aea5d0700 1 --2- 172.21.15.163:0/96484849 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9ae40feb80 0x7f9ae41947a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:24:41.995 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:24:41.937+0000 7f9aea5d0700 1 -- 172.21.15.163:0/96484849 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ae00095f0 con 0x7f9ae4100700 2023-07-14T18:24:41.996 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:24:41.938+0000 7f9aea5d0700 1 --2- 172.21.15.163:0/96484849 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f9ae4100700 0x7f9ae419bd50 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7f9adc00efc0 tx=0x7f9adc00c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:24:41.997 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:24:41.941+0000 7f9adaffd700 1 -- 172.21.15.163:0/96484849 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9adc018070 con 0x7f9ae4100700 2023-07-14T18:24:41.997 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:24:41.941+0000 7f9adaffd700 1 -- 172.21.15.163:0/96484849 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f9adc00f040 con 0x7f9ae4100700 2023-07-14T18:24:41.997 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:24:41.941+0000 7f9aec033700 1 -- 172.21.15.163:0/96484849 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ae419c870 con 0x7f9ae4100700 2023-07-14T18:24:41.997 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:24:41.941+0000 7f9adaffd700 1 -- 172.21.15.163:0/96484849 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9adc00cba0 con 0x7f9ae4100700 2023-07-14T18:24:41.998 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:24:41.941+0000 7f9aec033700 1 -- 172.21.15.163:0/96484849 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ae419cd80 con 0x7f9ae4100700 2023-07-14T18:24:41.998 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:24:41.943+0000 7f9adaffd700 1 -- 172.21.15.163:0/96484849 <== mon.0 v2:172.21.15.163:3300/0 4 ==== mgrmap(e 18) v1 ==== 135716+0+0 (secure 0 0 0) 0x7f9adc003a00 con 0x7f9ae4100700 2023-07-14T18:24:41.999 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:24:41.944+0000 7f9adaffd700 1 --2- 172.21.15.163:0/96484849 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f9ad00a11d0 0x7f9ad00a3680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:24:41.999 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:24:41.944+0000 7f9ae9dcf700 1 --2- 172.21.15.163:0/96484849 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f9ad00a11d0 0x7f9ad00a3680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:24:41.999 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:24:41.944+0000 7f9adaffd700 1 -- 172.21.15.163:0/96484849 <== mon.0 v2:172.21.15.163:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 9049+0+0 (secure 0 0 0) 0x7f9adc0cc680 con 0x7f9ae4100700 2023-07-14T18:24:42.000 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:24:41.944+0000 7f9ae9dcf700 1 --2- 172.21.15.163:0/96484849 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f9ad00a11d0 0x7f9ad00a3680 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f9ae000b2e0 tx=0x7f9ae0004000 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:24:42.005 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:24:41.946+0000 7f9af81cbb80 1 Processor -- start 2023-07-14T18:24:42.006 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:24:41.946+0000 7f9af81cbb80 1 -- start start 2023-07-14T18:24:42.006 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:24:41.946+0000 7f9af81cbb80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e68527d120 0x55e68527d530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:24:42.006 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:24:41.946+0000 7f9af81cbb80 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e68527da70 0x55e68527e110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:24:42.006 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:24:41.946+0000 7f9af81cbb80 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55e68527e6a0 0x55e68527eb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:24:42.007 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:24:41.946+0000 7f9af81cbb80 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e68517fcb0 con 0x55e68527e6a0 2023-07-14T18:24:42.007 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:24:41.946+0000 7f9af81cbb80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e6851d2a40 con 0x55e68527d120 2023-07-14T18:24:42.007 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:24:41.946+0000 7f9af81cbb80 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e6851cbed0 con 0x55e68527da70 2023-07-14T18:24:42.007 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:24:41.946+0000 7f9aea5d0700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55e68527e6a0 0x55e68527eb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:24:42.008 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:24:41.946+0000 7f9aea5d0700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55e68527e6a0 0x55e68527eb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:60298/0 (socket says 172.21.15.163:60298) 2023-07-14T18:24:42.008 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:24:41.946+0000 7f9ae9dcf700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e68527d120 0x55e68527d530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:24:42.008 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:24:41.946+0000 7f9ae95ce700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e68527da70 0x55e68527e110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:24:42.008 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:24:41.946+0000 7f9aea5d0700 1 -- 172.21.15.163:0/1823735356 learned_addr learned my addr 172.21.15.163:0/1823735356 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:24:42.008 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:24:41.947+0000 7f9aea5d0700 1 -- 172.21.15.163:0/1823735356 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e68527da70 msgr2=0x55e68527e110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:24:42.009 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:24:41.947+0000 7f9aea5d0700 1 --2- 172.21.15.163:0/1823735356 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e68527da70 0x55e68527e110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:24:42.009 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:24:41.947+0000 7f9aea5d0700 1 -- 172.21.15.163:0/1823735356 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e68527d120 msgr2=0x55e68527d530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:24:42.009 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:24:41.947+0000 7f9aea5d0700 1 --2- 172.21.15.163:0/1823735356 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e68527d120 0x55e68527d530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:24:42.009 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:24:41.947+0000 7f9aea5d0700 1 -- 172.21.15.163:0/1823735356 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e684ff9de0 con 0x55e68527e6a0 2023-07-14T18:24:42.009 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:24:41.947+0000 7f9ae9dcf700 1 --2- 172.21.15.163:0/1823735356 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e68527d120 0x55e68527d530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T18:24:42.010 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:24:41.947+0000 7f9aea5d0700 1 --2- 172.21.15.163:0/1823735356 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55e68527e6a0 0x55e68527eb10 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7f9adc0090a0 tx=0x7f9adc099330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=462c188cd95111b server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:24:42.010 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:24:41.947+0000 7f9acffff700 1 -- 172.21.15.163:0/1823735356 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9adc0997f0 con 0x55e68527e6a0 2023-07-14T18:24:42.010 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:24:41.947+0000 7f9acffff700 1 -- 172.21.15.163:0/1823735356 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f9adc09d820 con 0x55e68527e6a0 2023-07-14T18:24:42.010 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:24:41.947+0000 7f9acffff700 1 -- 172.21.15.163:0/1823735356 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9adc0b90d0 con 0x55e68527e6a0 2023-07-14T18:24:42.010 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:24:41.948+0000 7f9af81cbb80 1 -- 172.21.15.163:0/1823735356 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55e68527e6a0 msgr2=0x55e68527eb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:24:42.011 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:24:41.948+0000 7f9af81cbb80 1 --2- 172.21.15.163:0/1823735356 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55e68527e6a0 0x55e68527eb10 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7f9adc0090a0 tx=0x7f9adc099330 comp rx=0 tx=0).stop 2023-07-14T18:24:42.011 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:24:41.948+0000 7f9af81cbb80 1 -- 172.21.15.163:0/1823735356 shutdown_connections 2023-07-14T18:24:42.011 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:24:41.948+0000 7f9af81cbb80 1 --2- 172.21.15.163:0/1823735356 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55e68527e6a0 0x55e68527eb10 unknown :-1 s=CLOSED pgs=730 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:24:42.011 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:24:41.948+0000 7f9af81cbb80 1 --2- 172.21.15.163:0/1823735356 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e68527d120 0x55e68527d530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:24:42.011 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:24:41.948+0000 7f9af81cbb80 1 --2- 172.21.15.163:0/1823735356 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e68527da70 0x55e68527e110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:24:42.012 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:24:41.948+0000 7f9af81cbb80 1 -- 172.21.15.163:0/1823735356 >> 172.21.15.163:0/1823735356 conn(0x55e685270680 msgr2=0x55e6852759d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:24:42.012 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:24:41.948+0000 7f9af81cbb80 1 -- 172.21.15.163:0/1823735356 shutdown_connections 2023-07-14T18:24:42.012 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:24:41.948+0000 7f9af81cbb80 1 -- 172.21.15.163:0/1823735356 wait complete. 2023-07-14T18:24:42.012 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:24:41.948+0000 7f9af81cbb80 1 -- start start 2023-07-14T18:24:42.013 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:24:41.948+0000 7f9af81cbb80 1 Processor -- start 2023-07-14T18:24:42.013 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:24:41.949+0000 7f9af81cbb80 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55e68527d120 0x55e685286c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:24:42.013 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:24:41.949+0000 7f9af81cbb80 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e68527da70 0x55e685287190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:24:42.013 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:24:41.949+0000 7f9af81cbb80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e68527e6a0 0x55e68528e1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:24:42.014 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:24:41.949+0000 7f9af81cbb80 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e68516bac0 con 0x55e68527d120 2023-07-14T18:24:42.014 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:24:41.949+0000 7f9af81cbb80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e68516b7c0 con 0x55e68527e6a0 2023-07-14T18:24:42.014 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:24:41.949+0000 7f9af81cbb80 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e68504f920 con 0x55e68527da70 2023-07-14T18:24:42.014 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:24:41.949+0000 7f9af81cbb80 10 client.0 _ll_register_callbacks cb 0x55e685169760 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T18:24:42.014 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:24:41.949+0000 7f9ae9dcf700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55e68527d120 0x55e685286c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:24:42.015 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:24:41.949+0000 7f9aea5d0700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e68527e6a0 0x55e68528e1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:24:42.015 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:24:41.949+0000 7f9ae9dcf700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55e68527d120 0x55e685286c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:60300/0 (socket says 172.21.15.163:60300) 2023-07-14T18:24:42.015 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:24:41.949+0000 7f9ae9dcf700 1 -- 172.21.15.163:0/1005893635 learned_addr learned my addr 172.21.15.163:0/1005893635 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:24:42.015 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:24:41.949+0000 7f9ae95ce700 1 --2- 172.21.15.163:0/1005893635 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e68527da70 0x55e685287190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:24:42.016 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:24:41.949+0000 7f9aea5d0700 1 -- 172.21.15.163:0/1005893635 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e68527da70 msgr2=0x55e685287190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:24:42.016 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:24:41.949+0000 7f9aea5d0700 1 --2- 172.21.15.163:0/1005893635 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e68527da70 0x55e685287190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:24:42.016 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:24:41.949+0000 7f9aea5d0700 1 -- 172.21.15.163:0/1005893635 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55e68527d120 msgr2=0x55e685286c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:24:42.016 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:24:41.949+0000 7f9aea5d0700 1 --2- 172.21.15.163:0/1005893635 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55e68527d120 0x55e685286c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:24:42.017 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:24:41.949+0000 7f9aea5d0700 1 -- 172.21.15.163:0/1005893635 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ae41078f0 con 0x55e68527e6a0 2023-07-14T18:24:42.017 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:24:41.949+0000 7f9ae9dcf700 1 --2- 172.21.15.163:0/1005893635 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55e68527d120 0x55e685286c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T18:24:42.017 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:24:41.949+0000 7f9aea5d0700 1 --2- 172.21.15.163:0/1005893635 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e68527e6a0 0x55e68528e1d0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x55e685276990 tx=0x7f9adc00c810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c21b37dc09768df server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:24:42.017 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:24:41.949+0000 7f9acd7fa700 10 client.0 ms_handle_connect on v2:172.21.15.172:3300/0 2023-07-14T18:24:42.018 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:24:41.950+0000 7f9acd7fa700 1 -- 172.21.15.163:0/1005893635 <== mon.2 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9adc099c50 con 0x55e68527e6a0 2023-07-14T18:24:42.018 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:24:41.950+0000 7f9acd7fa700 1 -- 172.21.15.163:0/1005893635 <== mon.2 v2:172.21.15.172:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 9049+0+0 (secure 0 0 0) 0x7f9adc00cdc0 con 0x55e68527e6a0 2023-07-14T18:24:42.018 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:24:41.950+0000 7f9af81cbb80 1 -- 172.21.15.163:0/1005893635 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55e6851254f0 con 0x55e68527e6a0 2023-07-14T18:24:42.019 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:24:41.950+0000 7f9acd7fa700 1 -- 172.21.15.163:0/1005893635 <== mon.2 v2:172.21.15.172:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9adc0997f0 con 0x55e68527e6a0 2023-07-14T18:24:42.019 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:24:41.950+0000 7f9af81cbb80 10 client.26228 fetch_fsmap learned FSMap version 39 2023-07-14T18:24:42.019 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:24:41.950+0000 7f9af81cbb80 1 -- 172.21.15.163:0/1005893635 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) v3 -- 0x7f9ae419cd80 con 0x55e68527e6a0 2023-07-14T18:24:42.019 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:24:41.950+0000 7f9acd7fa700 1 -- 172.21.15.163:0/1005893635 <== mon.2 v2:172.21.15.172:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55e6851254f0 con 0x55e68527e6a0 2023-07-14T18:24:42.019 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:24:41.950+0000 7f9acd7fa700 1 -- 172.21.15.163:0/1005893635 <== mon.2 v2:172.21.15.172:3300/0 5 ==== fsmap(e 39) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f9adc098750 con 0x55e68527e6a0 2023-07-14T18:24:42.020 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:24:41.950+0000 7f9af81cbb80 10 client.26228 fetch_fsmap finished waiting for FSMap version 39 2023-07-14T18:24:42.020 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:24:41.950+0000 7f9af81cbb80 10 client.26228 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-07-14T18:24:42.020 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:24:41.950+0000 7f9af81cbb80 20 client.26228 populate_metadata read hostname 'smithi163' 2023-07-14T18:24:42.020 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:24:41.950+0000 7f9af81cbb80 1 --2- 172.21.15.163:0/1005893635 >> [v2:172.21.15.172:6838/3850440096,v1:172.21.15.172:6839/3850440096] conn(0x55e685292490 0x55e685294870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:24:42.020 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:24:41.950+0000 7f9af81cbb80 4 client.26228 mds_command: new command op to 24518 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-14T18:24:42.021 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:24:41.950+0000 7f9af81cbb80 1 -- 172.21.15.163:0/1005893635 --> [v2:172.21.15.172:6838/3850440096,v1:172.21.15.172:6839/3850440096] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55e685249da0 con 0x55e685292490 2023-07-14T18:24:42.021 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:24:41.951+0000 7f9ae9dcf700 1 --2- 172.21.15.163:0/1005893635 >> [v2:172.21.15.172:6838/3850440096,v1:172.21.15.172:6839/3850440096] conn(0x55e685292490 0x55e685294870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:24:42.021 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:24:41.951+0000 7f9acd7fa700 10 client.26228 ms_handle_connect on v2:172.21.15.172:6838/3850440096 2023-07-14T18:24:42.021 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:24:41.951+0000 7f9ae9dcf700 1 --2- 172.21.15.163:0/1005893635 >> [v2:172.21.15.172:6838/3850440096,v1:172.21.15.172:6839/3850440096] conn(0x55e685292490 0x55e685294870 crc :-1 s=READY pgs=105 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c962123165abf5de server_cookie=dc317ce5f93b3ed6 in_seq=0 out_seq=0 2023-07-14T18:24:42.021 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:24:41.951+0000 7f9acd7fa700 1 -- 172.21.15.163:0/1005893635 <== mds.0 v2:172.21.15.172:6838/3850440096 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18017 (crc 0 0 0) 0x55e685249da0 con 0x55e685292490 2023-07-14T18:24:42.022 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:24:41.951+0000 7f9acd7fa700 10 client.26228 handle_command_reply: tid=0 2023-07-14T18:24:42.022 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:24:41.951+0000 7f9af81cbb80 1 client.26228 shutdown 2023-07-14T18:24:42.022 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:24:41.952+0000 7f9af81cbb80 1 -- 172.21.15.163:0/1005893635 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e68527e6a0 msgr2=0x55e68528e1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:24:42.022 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:24:41.952+0000 7f9af81cbb80 1 --2- 172.21.15.163:0/1005893635 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e68527e6a0 0x55e68528e1d0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x55e685276990 tx=0x7f9adc00c810 comp rx=0 tx=0).stop 2023-07-14T18:24:42.023 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:24:41.952+0000 7f9af81cbb80 1 -- 172.21.15.163:0/1005893635 shutdown_connections 2023-07-14T18:24:42.023 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:24:41.952+0000 7f9af81cbb80 1 --2- 172.21.15.163:0/1005893635 >> [v2:172.21.15.172:6838/3850440096,v1:172.21.15.172:6839/3850440096] conn(0x55e685292490 0x55e685294870 crc :-1 s=READY pgs=105 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:24:42.023 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:24:41.952+0000 7f9af81cbb80 1 --2- 172.21.15.163:0/1005893635 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e68527e6a0 0x55e68528e1d0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:24:42.023 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:24:41.952+0000 7f9acd7fa700 0 client.26228 ms_handle_reset on v2:172.21.15.172:6838/3850440096 2023-07-14T18:24:42.024 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:24:41.952+0000 7f9af81cbb80 1 --2- 172.21.15.163:0/1005893635 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55e68527d120 0x55e685286c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:24:42.024 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:24:41.952+0000 7f9af81cbb80 1 --2- 172.21.15.163:0/1005893635 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e68527da70 0x55e685287190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:24:42.024 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:24:41.952+0000 7f9af81cbb80 1 -- 172.21.15.163:0/1005893635 >> 172.21.15.163:0/1005893635 conn(0x55e685270680 msgr2=0x55e685274650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:24:42.025 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:24:41.952+0000 7f9af81cbb80 1 -- 172.21.15.163:0/1005893635 shutdown_connections 2023-07-14T18:24:42.025 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:24:41.952+0000 7f9af81cbb80 1 -- 172.21.15.163:0/1005893635 wait complete. 2023-07-14T18:24:42.025 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:24:41.952+0000 7f9af81cbb80 20 client.26228 trim_cache size 0 max 16384 2023-07-14T18:24:42.029 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:24:41.975+0000 7f9af81cbb80 1 Processor -- start 2023-07-14T18:24:42.029 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:24:41.975+0000 7f9af81cbb80 1 -- start start 2023-07-14T18:24:42.030 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:24:41.975+0000 7f9af81cbb80 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e68527d120 0x55e685281610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:24:42.030 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:24:41.975+0000 7f9af81cbb80 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55e68527da70 0x55e68528e190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:24:42.030 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:24:41.975+0000 7f9af81cbb80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e68527e6a0 0x55e685281b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:24:42.031 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:24:41.975+0000 7f9af81cbb80 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e6852922f0 con 0x55e68527da70 2023-07-14T18:24:42.031 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:24:41.975+0000 7f9af81cbb80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e685285f40 con 0x55e68527e6a0 2023-07-14T18:24:42.031 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:24:41.975+0000 7f9af81cbb80 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e6852774f0 con 0x55e68527d120 2023-07-14T18:24:42.032 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:24:41.975+0000 7f9ae95ce700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55e68527da70 0x55e68528e190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:24:42.032 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:24:41.975+0000 7f9ae9dcf700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e68527d120 0x55e685281610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:24:42.032 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:24:41.975+0000 7f9aea5d0700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e68527e6a0 0x55e685281b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:24:42.032 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:24:41.976+0000 7f9ae9dcf700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e68527d120 0x55e685281610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.163:42130/0 (socket says 172.21.15.163:42130) 2023-07-14T18:24:42.033 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:24:41.976+0000 7f9aea5d0700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e68527e6a0 0x55e685281b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.163:60996/0 (socket says 172.21.15.163:60996) 2023-07-14T18:24:42.033 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:24:41.976+0000 7f9ae9dcf700 1 -- 172.21.15.163:0/3558160313 learned_addr learned my addr 172.21.15.163:0/3558160313 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:24:42.033 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:24:41.976+0000 7f9ae95ce700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55e68527da70 0x55e68528e190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:60310/0 (socket says 172.21.15.163:60310) 2023-07-14T18:24:42.033 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:24:41.976+0000 7f9ae9dcf700 1 -- 172.21.15.163:0/3558160313 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e68527e6a0 msgr2=0x55e685281b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:24:42.033 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:24:41.976+0000 7f9ae9dcf700 1 --2- 172.21.15.163:0/3558160313 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e68527e6a0 0x55e685281b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:24:42.034 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:24:41.976+0000 7f9ae9dcf700 1 -- 172.21.15.163:0/3558160313 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55e68527da70 msgr2=0x55e68528e190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:24:42.034 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:24:41.976+0000 7f9ae9dcf700 1 --2- 172.21.15.163:0/3558160313 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55e68527da70 0x55e68528e190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:24:42.034 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:24:41.976+0000 7f9ae9dcf700 1 -- 172.21.15.163:0/3558160313 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e684fe2c60 con 0x55e68527d120 2023-07-14T18:24:42.035 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:24:41.976+0000 7f9ae95ce700 1 --2- 172.21.15.163:0/3558160313 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55e68527da70 0x55e68528e190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T18:24:42.035 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:24:41.976+0000 7f9ae9dcf700 1 --2- 172.21.15.163:0/3558160313 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e68527d120 0x55e685281610 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f9ae0004360 tx=0x7f9ae0020000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=277fe05ddac75f57 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:24:42.035 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:24:41.976+0000 7f9ad8ff9700 1 -- 172.21.15.163:0/3558160313 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ae003a070 con 0x55e68527d120 2023-07-14T18:24:42.035 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:24:41.976+0000 7f9ad8ff9700 1 -- 172.21.15.163:0/3558160313 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f9ae001e040 con 0x55e68527d120 2023-07-14T18:24:42.036 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:24:41.976+0000 7f9ad8ff9700 1 -- 172.21.15.163:0/3558160313 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ae000b820 con 0x55e68527d120 2023-07-14T18:24:42.041 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:24:41.977+0000 7f9af81cbb80 1 -- 172.21.15.163:0/3558160313 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e68527d120 msgr2=0x55e685281610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:24:42.041 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:24:41.977+0000 7f9af81cbb80 1 --2- 172.21.15.163:0/3558160313 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e68527d120 0x55e685281610 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f9ae0004360 tx=0x7f9ae0020000 comp rx=0 tx=0).stop 2023-07-14T18:24:42.041 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:24:41.977+0000 7f9af81cbb80 1 -- 172.21.15.163:0/3558160313 shutdown_connections 2023-07-14T18:24:42.042 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:24:41.977+0000 7f9af81cbb80 1 --2- 172.21.15.163:0/3558160313 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e68527d120 0x55e685281610 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:24:42.042 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:24:41.977+0000 7f9af81cbb80 1 --2- 172.21.15.163:0/3558160313 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e68527e6a0 0x55e685281b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:24:42.042 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:24:41.977+0000 7f9af81cbb80 1 --2- 172.21.15.163:0/3558160313 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55e68527da70 0x55e68528e190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:24:42.043 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:24:41.977+0000 7f9af81cbb80 1 -- 172.21.15.163:0/3558160313 >> 172.21.15.163:0/3558160313 conn(0x55e685270680 msgr2=0x55e685284ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:24:42.043 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:24:41.977+0000 7f9af81cbb80 1 -- 172.21.15.163:0/3558160313 shutdown_connections 2023-07-14T18:24:42.043 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:24:41.977+0000 7f9af81cbb80 1 -- 172.21.15.163:0/3558160313 wait complete. 2023-07-14T18:24:42.044 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:24:41.977+0000 7f9af81cbb80 1 -- start start 2023-07-14T18:24:42.044 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:24:41.977+0000 7f9af81cbb80 1 Processor -- start 2023-07-14T18:24:42.044 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:24:41.978+0000 7f9af81cbb80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e68527d120 0x55e68528dc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:24:42.045 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:24:41.978+0000 7f9af81cbb80 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e68527da70 0x55e68528a710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:24:42.045 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:24:41.978+0000 7f9af81cbb80 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55e68527e6a0 0x55e68528ac50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:24:42.045 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:24:41.978+0000 7f9af81cbb80 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e68528b330 con 0x55e68527e6a0 2023-07-14T18:24:42.046 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:24:41.978+0000 7f9af81cbb80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e68528e2f0 con 0x55e68527d120 2023-07-14T18:24:42.046 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:24:41.978+0000 7f9af81cbb80 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e68528e480 con 0x55e68527da70 2023-07-14T18:24:42.046 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:24:41.978+0000 7f9af81cbb80 10 client.0 _ll_register_callbacks cb 0x7f9ae0004190 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T18:24:42.047 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:24:41.978+0000 7f9aea5d0700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55e68527e6a0 0x55e68528ac50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:24:42.047 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:24:41.978+0000 7f9ae9dcf700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e68527d120 0x55e68528dc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:24:42.047 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:24:41.978+0000 7f9ae9dcf700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e68527d120 0x55e68528dc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.163:60998/0 (socket says 172.21.15.163:60998) 2023-07-14T18:24:42.048 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:24:41.978+0000 7f9ae95ce700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e68527da70 0x55e68528a710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:24:42.048 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:24:41.978+0000 7f9aea5d0700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55e68527e6a0 0x55e68528ac50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:60318/0 (socket says 172.21.15.163:60318) 2023-07-14T18:24:42.048 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:24:41.978+0000 7f9ae9dcf700 1 -- 172.21.15.163:0/3037157638 learned_addr learned my addr 172.21.15.163:0/3037157638 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:24:42.049 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:24:41.978+0000 7f9ae9dcf700 1 -- 172.21.15.163:0/3037157638 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e68527da70 msgr2=0x55e68528a710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:24:42.049 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:24:41.978+0000 7f9ae9dcf700 1 --2- 172.21.15.163:0/3037157638 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e68527da70 0x55e68528a710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:24:42.049 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:24:41.978+0000 7f9ae9dcf700 1 -- 172.21.15.163:0/3037157638 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55e68527e6a0 msgr2=0x55e68528ac50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:24:42.050 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:24:41.978+0000 7f9ae9dcf700 1 --2- 172.21.15.163:0/3037157638 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55e68527e6a0 0x55e68528ac50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:24:42.050 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:24:41.978+0000 7f9ae9dcf700 1 -- 172.21.15.163:0/3037157638 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ad4009b20 con 0x55e68527d120 2023-07-14T18:24:42.050 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:24:41.978+0000 7f9aea5d0700 1 --2- 172.21.15.163:0/3037157638 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55e68527e6a0 0x55e68528ac50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T18:24:42.050 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:24:41.978+0000 7f9ae95ce700 1 --2- 172.21.15.163:0/3037157638 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e68527da70 0x55e68528a710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T18:24:42.050 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:24:41.979+0000 7f9ae9dcf700 1 --2- 172.21.15.163:0/3037157638 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e68527d120 0x55e68528dc70 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f9ae0005910 tx=0x7f9ae0036150 comp rx=0 tx=0).ready entity=mon.2 client_cookie=61d4d967b2c87b03 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:24:42.051 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:24:41.979+0000 7f9acd7fa700 10 client.0 ms_handle_connect on v2:172.21.15.172:3300/0 2023-07-14T18:24:42.051 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:24:41.979+0000 7f9acd7fa700 1 -- 172.21.15.163:0/3037157638 <== mon.2 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ae003a070 con 0x55e68527d120 2023-07-14T18:24:42.052 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:24:41.979+0000 7f9af81cbb80 1 -- 172.21.15.163:0/3037157638 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f9adc09d820 con 0x55e68527d120 2023-07-14T18:24:42.052 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:24:41.979+0000 7f9acd7fa700 1 -- 172.21.15.163:0/3037157638 <== mon.2 v2:172.21.15.172:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 9049+0+0 (secure 0 0 0) 0x7f9ae000b930 con 0x55e68527d120 2023-07-14T18:24:42.052 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:24:41.979+0000 7f9acd7fa700 1 -- 172.21.15.163:0/3037157638 <== mon.2 v2:172.21.15.172:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9ae000baf0 con 0x55e68527d120 2023-07-14T18:24:42.053 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:24:41.979+0000 7f9af81cbb80 10 client.26234 fetch_fsmap learned FSMap version 39 2023-07-14T18:24:42.053 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:24:41.979+0000 7f9af81cbb80 1 -- 172.21.15.163:0/3037157638 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) v3 -- 0x7f9ae00056b0 con 0x55e68527d120 2023-07-14T18:24:42.053 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:24:41.979+0000 7f9acd7fa700 1 -- 172.21.15.163:0/3037157638 <== mon.2 v2:172.21.15.172:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f9ae0047020 con 0x55e68527d120 2023-07-14T18:24:42.053 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:24:41.979+0000 7f9acd7fa700 1 -- 172.21.15.163:0/3037157638 <== mon.2 v2:172.21.15.172:3300/0 5 ==== fsmap(e 39) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f9ae000f460 con 0x55e68527d120 2023-07-14T18:24:42.053 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:24:41.979+0000 7f9af81cbb80 10 client.26234 fetch_fsmap finished waiting for FSMap version 39 2023-07-14T18:24:42.054 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:24:41.979+0000 7f9af81cbb80 10 client.26234 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-07-14T18:24:42.054 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:24:41.979+0000 7f9af81cbb80 20 client.26234 populate_metadata read hostname 'smithi163' 2023-07-14T18:24:42.054 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:24:41.979+0000 7f9af81cbb80 1 --2- 172.21.15.163:0/3037157638 >> [v2:172.21.15.172:6838/3850440096,v1:172.21.15.172:6839/3850440096] conn(0x55e6852e7560 0x55e6852e9970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:24:42.054 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:24:41.979+0000 7f9af81cbb80 4 client.26234 mds_command: new command op to 24518 tid=0[{"prefix": "scrub status"}] 2023-07-14T18:24:42.054 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:24:41.979+0000 7f9af81cbb80 1 -- 172.21.15.163:0/3037157638 --> [v2:172.21.15.172:6838/3850440096,v1:172.21.15.172:6839/3850440096] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55e6851c4eb0 con 0x55e6852e7560 2023-07-14T18:24:42.055 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:24:41.979+0000 7f9ae95ce700 1 --2- 172.21.15.163:0/3037157638 >> [v2:172.21.15.172:6838/3850440096,v1:172.21.15.172:6839/3850440096] conn(0x55e6852e7560 0x55e6852e9970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:24:42.055 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:24:41.980+0000 7f9ae95ce700 1 --2- 172.21.15.163:0/3037157638 >> [v2:172.21.15.172:6838/3850440096,v1:172.21.15.172:6839/3850440096] conn(0x55e6852e7560 0x55e6852e9970 crc :-1 s=READY pgs=106 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=df612ee8cd1c3ff9 server_cookie=fbb83d4c8aa3b1f3 in_seq=0 out_seq=0 2023-07-14T18:24:42.055 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:24:41.980+0000 7f9acd7fa700 10 client.26234 ms_handle_connect on v2:172.21.15.172:6838/3850440096 2023-07-14T18:24:42.055 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:24:41.980+0000 7f9acd7fa700 1 -- 172.21.15.163:0/3037157638 <== mds.0 v2:172.21.15.172:6838/3850440096 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x55e6851c4eb0 con 0x55e6852e7560 2023-07-14T18:24:42.056 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:24:41.980+0000 7f9acd7fa700 10 client.26234 handle_command_reply: tid=0 2023-07-14T18:24:42.056 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:24:41.980+0000 7f9af81cbb80 1 client.26234 shutdown 2023-07-14T18:24:42.056 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:24:41.980+0000 7f9af81cbb80 1 -- 172.21.15.163:0/3037157638 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e68527d120 msgr2=0x55e68528dc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:24:42.056 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:24:41.980+0000 7f9af81cbb80 1 --2- 172.21.15.163:0/3037157638 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e68527d120 0x55e68528dc70 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f9ae0005910 tx=0x7f9ae0036150 comp rx=0 tx=0).stop 2023-07-14T18:24:42.057 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:24:41.980+0000 7f9af81cbb80 1 -- 172.21.15.163:0/3037157638 shutdown_connections 2023-07-14T18:24:42.057 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:24:41.980+0000 7f9af81cbb80 1 --2- 172.21.15.163:0/3037157638 >> [v2:172.21.15.172:6838/3850440096,v1:172.21.15.172:6839/3850440096] conn(0x55e6852e7560 0x55e6852e9970 crc :-1 s=READY pgs=106 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:24:42.057 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:24:41.980+0000 7f9af81cbb80 1 --2- 172.21.15.163:0/3037157638 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55e68527e6a0 0x55e68528ac50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:24:42.057 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:24:41.980+0000 7f9af81cbb80 1 --2- 172.21.15.163:0/3037157638 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e68527d120 0x55e68528dc70 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:24:42.057 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:24:41.980+0000 7f9acd7fa700 0 client.26234 ms_handle_reset on v2:172.21.15.172:6838/3850440096 2023-07-14T18:24:42.058 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:24:41.980+0000 7f9af81cbb80 1 --2- 172.21.15.163:0/3037157638 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e68527da70 0x55e68528a710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:24:42.058 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:24:41.980+0000 7f9af81cbb80 1 -- 172.21.15.163:0/3037157638 >> 172.21.15.163:0/3037157638 conn(0x55e685270680 msgr2=0x55e685281610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:24:42.058 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:24:41.980+0000 7f9af81cbb80 1 -- 172.21.15.163:0/3037157638 shutdown_connections 2023-07-14T18:24:42.058 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:24:41.980+0000 7f9af81cbb80 1 -- 172.21.15.163:0/3037157638 wait complete. 2023-07-14T18:24:42.058 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:24:41.980+0000 7f9af81cbb80 20 client.26234 trim_cache size 0 max 16384 2023-07-14T18:24:42.059 INFO:teuthology.orchestra.run.smithi163.stdout:{ 2023-07-14T18:24:42.059 INFO:teuthology.orchestra.run.smithi163.stdout: "status": "IDLE (waiting for more scrubs)", 2023-07-14T18:24:42.059 INFO:teuthology.orchestra.run.smithi163.stdout: "scrubs": { 2023-07-14T18:24:42.060 INFO:teuthology.orchestra.run.smithi163.stdout: "2c53b7ef-6f30-49f0-a60d-f1f114c19d42": { 2023-07-14T18:24:42.060 INFO:teuthology.orchestra.run.smithi163.stdout: "path": "/", 2023-07-14T18:24:42.060 INFO:teuthology.orchestra.run.smithi163.stdout: "tag": "2c53b7ef-6f30-49f0-a60d-f1f114c19d42", 2023-07-14T18:24:42.060 INFO:teuthology.orchestra.run.smithi163.stdout: "options": "recursive,force" 2023-07-14T18:24:42.060 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-07-14T18:24:42.061 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-07-14T18:24:42.061 INFO:teuthology.orchestra.run.smithi163.stdout:} 2023-07-14T18:24:42.062 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:24:41.981+0000 7f9aec033700 1 -- 172.21.15.163:0/96484849 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f9ad00a11d0 msgr2=0x7f9ad00a3680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:24:42.062 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:24:41.981+0000 7f9aec033700 1 --2- 172.21.15.163:0/96484849 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f9ad00a11d0 0x7f9ad00a3680 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f9ae000b2e0 tx=0x7f9ae0004000 comp rx=0 tx=0).stop 2023-07-14T18:24:42.062 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:24:41.981+0000 7f9aec033700 1 -- 172.21.15.163:0/96484849 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f9ae4100700 msgr2=0x7f9ae419bd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:24:42.063 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:24:41.981+0000 7f9aec033700 1 --2- 172.21.15.163:0/96484849 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f9ae4100700 0x7f9ae419bd50 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7f9adc00efc0 tx=0x7f9adc00c3a0 comp rx=0 tx=0).stop 2023-07-14T18:24:42.063 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:24:41.981+0000 7f9aec033700 1 -- 172.21.15.163:0/96484849 shutdown_connections 2023-07-14T18:24:42.063 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:24:41.981+0000 7f9aec033700 1 --2- 172.21.15.163:0/96484849 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f9ad00a11d0 0x7f9ad00a3680 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:24:42.063 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:24:41.981+0000 7f9aec033700 1 --2- 172.21.15.163:0/96484849 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f9ae4100700 0x7f9ae419bd50 unknown :-1 s=CLOSED pgs=729 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:24:42.064 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:24:41.981+0000 7f9aec033700 1 --2- 172.21.15.163:0/96484849 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9ae40feb80 0x7f9ae41947a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:24:42.064 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:24:41.981+0000 7f9aec033700 1 --2- 172.21.15.163:0/96484849 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9ae40ffd70 0x7f9ae4194ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:24:42.064 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:24:41.981+0000 7f9aec033700 1 -- 172.21.15.163:0/96484849 >> 172.21.15.163:0/96484849 conn(0x7f9ae40fa1a0 msgr2=0x7f9ae40fc460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:24:42.065 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:24:41.981+0000 7f9aec033700 1 -- 172.21.15.163:0/96484849 shutdown_connections 2023-07-14T18:24:42.065 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:24:41.981+0000 7f9aec033700 1 -- 172.21.15.163:0/96484849 wait complete. 2023-07-14T18:24:42.065 INFO:tasks.cephfs.filesystem:scrub status for tag:2c53b7ef-6f30-49f0-a60d-f1f114c19d42 - {'path': '/', 'tag': '2c53b7ef-6f30-49f0-a60d-f1f114c19d42', 'options': 'recursive,force'} 2023-07-14T18:24:42.229 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:24:41 smithi163 ceph-mon[96576]: pgmap v661: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-07-14T18:24:42.287 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:24:41 smithi172 ceph-mon[97983]: pgmap v661: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-07-14T18:24:42.436 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:24:41 smithi184 ceph-mon[98481]: pgmap v661: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-07-14T18:24:44.979 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:24:44 smithi163 ceph-mon[96576]: pgmap v662: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-07-14T18:24:45.037 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:24:44 smithi172 ceph-mon[97983]: pgmap v662: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-07-14T18:24:45.186 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:24:44 smithi184 ceph-mon[98481]: pgmap v662: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-07-14T18:24:47.037 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:24:46 smithi172 ceph-mon[97983]: pgmap v663: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-07-14T18:24:47.186 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:24:46 smithi184 ceph-mon[98481]: pgmap v663: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-07-14T18:24:47.229 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:24:46 smithi163 ceph-mon[96576]: pgmap v663: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-07-14T18:24:49.037 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:24:48 smithi172 ceph-mon[97983]: pgmap v664: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-07-14T18:24:49.186 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:24:48 smithi184 ceph-mon[98481]: pgmap v664: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-07-14T18:24:49.229 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:24:48 smithi163 ceph-mon[96576]: pgmap v664: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-07-14T18:24:51.037 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:24:50 smithi172 ceph-mon[97983]: pgmap v665: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-07-14T18:24:51.187 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:24:50 smithi184 ceph-mon[98481]: pgmap v665: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-07-14T18:24:51.229 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:24:50 smithi163 ceph-mon[96576]: pgmap v665: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-07-14T18:24:52.288 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:24:51 smithi172 ceph-mon[97983]: pgmap v666: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-07-14T18:24:52.437 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:24:51 smithi184 ceph-mon[98481]: pgmap v666: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-07-14T18:24:52.479 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:24:51 smithi163 ceph-mon[96576]: pgmap v666: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-07-14T18:24:55.037 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:24:54 smithi172 ceph-mon[97983]: pgmap v667: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-07-14T18:24:55.187 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:24:54 smithi184 ceph-mon[98481]: pgmap v667: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-07-14T18:24:55.229 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:24:54 smithi163 ceph-mon[96576]: pgmap v667: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-07-14T18:24:57.038 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:24:56 smithi172 ceph-mon[97983]: pgmap v668: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-07-14T18:24:57.187 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:24:56 smithi184 ceph-mon[98481]: pgmap v668: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-07-14T18:24:57.229 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:24:56 smithi163 ceph-mon[96576]: pgmap v668: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-07-14T18:24:59.037 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:24:58 smithi172 ceph-mon[97983]: pgmap v669: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-07-14T18:24:59.187 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:24:58 smithi184 ceph-mon[98481]: pgmap v669: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-07-14T18:24:59.229 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:24:58 smithi163 ceph-mon[96576]: pgmap v669: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-07-14T18:25:01.038 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:25:00 smithi172 ceph-mon[97983]: pgmap v670: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-07-14T18:25:01.187 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:25:00 smithi184 ceph-mon[98481]: pgmap v670: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-07-14T18:25:01.229 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:25:00 smithi163 ceph-mon[96576]: pgmap v670: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-07-14T18:25:02.287 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:25:01 smithi172 ceph-mon[97983]: pgmap v671: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-07-14T18:25:02.436 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:25:01 smithi184 ceph-mon[98481]: pgmap v671: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-07-14T18:25:02.479 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:25:01 smithi163 ceph-mon[96576]: pgmap v671: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-07-14T18:25:05.037 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:25:04 smithi172 ceph-mon[97983]: pgmap v672: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-07-14T18:25:05.186 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:25:04 smithi184 ceph-mon[98481]: pgmap v672: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-07-14T18:25:05.229 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:25:04 smithi163 ceph-mon[96576]: pgmap v672: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-07-14T18:25:07.037 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:25:06 smithi172 ceph-mon[97983]: pgmap v673: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-07-14T18:25:07.186 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:25:06 smithi184 ceph-mon[98481]: pgmap v673: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-07-14T18:25:07.229 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:25:06 smithi163 ceph-mon[96576]: pgmap v673: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-07-14T18:25:09.037 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:25:08 smithi172 ceph-mon[97983]: pgmap v674: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-07-14T18:25:09.186 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:25:08 smithi184 ceph-mon[98481]: pgmap v674: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-07-14T18:25:09.228 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:25:08 smithi163 ceph-mon[96576]: pgmap v674: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-07-14T18:25:11.037 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:25:10 smithi172 ceph-mon[97983]: pgmap v675: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-07-14T18:25:11.186 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:25:10 smithi184 ceph-mon[98481]: pgmap v675: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-07-14T18:25:11.228 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:25:10 smithi163 ceph-mon[96576]: pgmap v675: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-07-14T18:25:12.066 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-07-14T18:25:12.218 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:25:12.167+0000 7f4951ff0700 1 -- 172.21.15.163:0/526604775 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f494c0ffe00 msgr2=0x7f494c1066c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:25:12.219 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:25:12.167+0000 7f4951ff0700 1 --2- 172.21.15.163:0/526604775 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f494c0ffe00 0x7f494c1066c0 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7f494400b0a0 tx=0x7f494400b3b0 comp rx=0 tx=0).stop 2023-07-14T18:25:12.219 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:25:12.167+0000 7f4951ff0700 1 -- 172.21.15.163:0/526604775 shutdown_connections 2023-07-14T18:25:12.219 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:25:12.167+0000 7f4951ff0700 1 --2- 172.21.15.163:0/526604775 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f494c0ffe00 0x7f494c1066c0 unknown :-1 s=CLOSED pgs=731 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:25:12.220 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:25:12.167+0000 7f4951ff0700 1 --2- 172.21.15.163:0/526604775 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f494c0fe280 0x7f494c0fe690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:25:12.220 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:25:12.167+0000 7f4951ff0700 1 --2- 172.21.15.163:0/526604775 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f494c0ff470 0x7f494c0ff8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:25:12.220 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:25:12.167+0000 7f4951ff0700 1 -- 172.21.15.163:0/526604775 >> 172.21.15.163:0/526604775 conn(0x7f494c0f98a0 msgr2=0x7f494c0fbcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:25:12.220 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:25:12.167+0000 7f4951ff0700 1 -- 172.21.15.163:0/526604775 shutdown_connections 2023-07-14T18:25:12.220 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:25:12.167+0000 7f4951ff0700 1 -- 172.21.15.163:0/526604775 wait complete. 2023-07-14T18:25:12.222 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:25:12.168+0000 7f4951ff0700 1 Processor -- start 2023-07-14T18:25:12.222 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:25:12.168+0000 7f4951ff0700 1 -- start start 2023-07-14T18:25:12.223 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:25:12.168+0000 7f4951ff0700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f494c0fe280 0x7f494c1948f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:25:12.223 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:25:12.168+0000 7f4951ff0700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f494c0ff470 0x7f494c194e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:25:12.223 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:25:12.168+0000 7f4951ff0700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f494c0ffe00 0x7f494c19bea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:25:12.223 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:25:12.168+0000 7f4951ff0700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f494c19c470 con 0x7f494c0ff470 2023-07-14T18:25:12.223 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:25:12.169+0000 7f4951ff0700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f494c19c5b0 con 0x7f494c0ffe00 2023-07-14T18:25:12.224 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:25:12.169+0000 7f4951ff0700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f494c19c740 con 0x7f494c0fe280 2023-07-14T18:25:12.224 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:25:12.169+0000 7f494affd700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f494c0ff470 0x7f494c194e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:25:12.224 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:25:12.169+0000 7f494b7fe700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f494c0fe280 0x7f494c1948f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:25:12.224 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:25:12.169+0000 7f494bfff700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f494c0ffe00 0x7f494c19bea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:25:12.224 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:25:12.169+0000 7f494affd700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f494c0ff470 0x7f494c194e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:60328/0 (socket says 172.21.15.163:60328) 2023-07-14T18:25:12.225 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:25:12.169+0000 7f494affd700 1 -- 172.21.15.163:0/2897466870 learned_addr learned my addr 172.21.15.163:0/2897466870 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:25:12.225 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:25:12.169+0000 7f494bfff700 1 -- 172.21.15.163:0/2897466870 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f494c0fe280 msgr2=0x7f494c1948f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:25:12.225 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:25:12.169+0000 7f494bfff700 1 --2- 172.21.15.163:0/2897466870 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f494c0fe280 0x7f494c1948f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:25:12.225 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:25:12.169+0000 7f494bfff700 1 -- 172.21.15.163:0/2897466870 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f494c0ff470 msgr2=0x7f494c194e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:25:12.225 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:25:12.169+0000 7f494bfff700 1 --2- 172.21.15.163:0/2897466870 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f494c0ff470 0x7f494c194e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:25:12.226 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:25:12.169+0000 7f494bfff700 1 -- 172.21.15.163:0/2897466870 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4944009d00 con 0x7f494c0ffe00 2023-07-14T18:25:12.226 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:25:12.169+0000 7f494affd700 1 --2- 172.21.15.163:0/2897466870 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f494c0ff470 0x7f494c194e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T18:25:12.226 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:25:12.169+0000 7f494bfff700 1 --2- 172.21.15.163:0/2897466870 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f494c0ffe00 0x7f494c19bea0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f4944009fd0 tx=0x7f4944007870 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:25:12.226 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:25:12.169+0000 7f4948ff9700 1 -- 172.21.15.163:0/2897466870 <== mon.2 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f494400e040 con 0x7f494c0ffe00 2023-07-14T18:25:12.226 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:25:12.169+0000 7f4948ff9700 1 -- 172.21.15.163:0/2897466870 <== mon.2 v2:172.21.15.172:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f4944004c50 con 0x7f494c0ffe00 2023-07-14T18:25:12.226 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:25:12.169+0000 7f4951ff0700 1 -- 172.21.15.163:0/2897466870 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f494c19c9c0 con 0x7f494c0ffe00 2023-07-14T18:25:12.227 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:25:12.169+0000 7f4948ff9700 1 -- 172.21.15.163:0/2897466870 <== mon.2 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4944005040 con 0x7f494c0ffe00 2023-07-14T18:25:12.227 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:25:12.170+0000 7f4951ff0700 1 -- 172.21.15.163:0/2897466870 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f494c19ce40 con 0x7f494c0ffe00 2023-07-14T18:25:12.231 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:25:12.172+0000 7f4948ff9700 1 -- 172.21.15.163:0/2897466870 <== mon.2 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 18) v1 ==== 135716+0+0 (secure 0 0 0) 0x7f494401d470 con 0x7f494c0ffe00 2023-07-14T18:25:12.232 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:25:12.172+0000 7f4948ff9700 1 --2- 172.21.15.163:0/2897466870 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f49340a1150 0x7f49340a3600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:25:12.232 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:25:12.173+0000 7f494b7fe700 1 --2- 172.21.15.163:0/2897466870 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f49340a1150 0x7f49340a3600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:25:12.232 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:25:12.173+0000 7f4948ff9700 1 -- 172.21.15.163:0/2897466870 <== mon.2 v2:172.21.15.172:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 9049+0+0 (secure 0 0 0) 0x7f49440ce0b0 con 0x7f494c0ffe00 2023-07-14T18:25:12.232 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:25:12.173+0000 7f494b7fe700 1 --2- 172.21.15.163:0/2897466870 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f49340a1150 0x7f49340a3600 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f494c0ff2d0 tx=0x7f493c009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:25:12.233 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:25:12.173+0000 7f495e188b80 1 Processor -- start 2023-07-14T18:25:12.233 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:25:12.173+0000 7f495e188b80 1 -- start start 2023-07-14T18:25:12.233 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:25:12.173+0000 7f495e188b80 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5641eaad83b0 0x5641eaad87c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:25:12.233 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:25:12.173+0000 7f495e188b80 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5641eaad6c90 0x5641eaad7100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:25:12.233 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:25:12.173+0000 7f495e188b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5641eaad7640 0x5641eaae32e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:25:12.234 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:25:12.173+0000 7f495e188b80 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x5641ea9dbcb0 con 0x5641eaad6c90 2023-07-14T18:25:12.234 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:25:12.173+0000 7f495e188b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x5641eaa2ea40 con 0x5641eaad7640 2023-07-14T18:25:12.234 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:25:12.173+0000 7f495e188b80 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x5641eaa27ed0 con 0x5641eaad83b0 2023-07-14T18:25:12.234 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:25:12.174+0000 7f494b7fe700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5641eaad83b0 0x5641eaad87c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:25:12.234 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:25:12.174+0000 7f494affd700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5641eaad6c90 0x5641eaad7100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:25:12.235 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:25:12.174+0000 7f494b7fe700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5641eaad83b0 0x5641eaad87c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.163:42156/0 (socket says 172.21.15.163:42156) 2023-07-14T18:25:12.235 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:25:12.174+0000 7f494b7fe700 1 -- 172.21.15.163:0/281660731 learned_addr learned my addr 172.21.15.163:0/281660731 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:25:12.235 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:25:12.174+0000 7f494bfff700 1 --2- 172.21.15.163:0/281660731 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5641eaad7640 0x5641eaae32e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:25:12.235 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:25:12.174+0000 7f494b7fe700 1 -- 172.21.15.163:0/281660731 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5641eaad7640 msgr2=0x5641eaae32e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:25:12.235 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:25:12.174+0000 7f494b7fe700 1 --2- 172.21.15.163:0/281660731 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5641eaad7640 0x5641eaae32e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:25:12.236 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:25:12.174+0000 7f494b7fe700 1 -- 172.21.15.163:0/281660731 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5641eaad6c90 msgr2=0x5641eaad7100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:25:12.236 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:25:12.174+0000 7f494b7fe700 1 --2- 172.21.15.163:0/281660731 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5641eaad6c90 0x5641eaad7100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:25:12.236 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:25:12.174+0000 7f494b7fe700 1 -- 172.21.15.163:0/281660731 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5641ea855de0 con 0x5641eaad83b0 2023-07-14T18:25:12.236 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:25:12.174+0000 7f494b7fe700 1 --2- 172.21.15.163:0/281660731 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5641eaad83b0 0x5641eaad87c0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f493c011d80 tx=0x7f493c014000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4ebe798b3b429a8c server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:25:12.236 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:25:12.174+0000 7f4931ffb700 1 -- 172.21.15.163:0/281660731 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f493c00ed20 con 0x5641eaad83b0 2023-07-14T18:25:12.237 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:25:12.174+0000 7f4931ffb700 1 -- 172.21.15.163:0/281660731 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f493c021070 con 0x5641eaad83b0 2023-07-14T18:25:12.237 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:25:12.174+0000 7f4931ffb700 1 -- 172.21.15.163:0/281660731 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f493c025630 con 0x5641eaad83b0 2023-07-14T18:25:12.237 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:25:12.175+0000 7f495e188b80 1 -- 172.21.15.163:0/281660731 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5641eaad83b0 msgr2=0x5641eaad87c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:25:12.237 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:25:12.175+0000 7f495e188b80 1 --2- 172.21.15.163:0/281660731 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5641eaad83b0 0x5641eaad87c0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f493c011d80 tx=0x7f493c014000 comp rx=0 tx=0).stop 2023-07-14T18:25:12.237 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:25:12.175+0000 7f495e188b80 1 -- 172.21.15.163:0/281660731 shutdown_connections 2023-07-14T18:25:12.238 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:25:12.175+0000 7f495e188b80 1 --2- 172.21.15.163:0/281660731 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5641eaad83b0 0x5641eaad87c0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:25:12.238 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:25:12.175+0000 7f495e188b80 1 --2- 172.21.15.163:0/281660731 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5641eaad7640 0x5641eaae32e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:25:12.238 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:25:12.175+0000 7f495e188b80 1 --2- 172.21.15.163:0/281660731 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5641eaad6c90 0x5641eaad7100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:25:12.238 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:25:12.175+0000 7f495e188b80 1 -- 172.21.15.163:0/281660731 >> 172.21.15.163:0/281660731 conn(0x5641eaacc680 msgr2=0x5641eaad19d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:25:12.238 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:25:12.175+0000 7f495e188b80 1 -- 172.21.15.163:0/281660731 shutdown_connections 2023-07-14T18:25:12.238 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:25:12.175+0000 7f495e188b80 1 -- 172.21.15.163:0/281660731 wait complete. 2023-07-14T18:25:12.239 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:25:12.175+0000 7f495e188b80 1 -- start start 2023-07-14T18:25:12.239 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:25:12.176+0000 7f495e188b80 1 Processor -- start 2023-07-14T18:25:12.239 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:25:12.176+0000 7f495e188b80 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5641eaad6c90 0x5641eaae4d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:25:12.239 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:25:12.176+0000 7f495e188b80 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5641eaad7640 0x5641eaae52c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:25:12.239 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:25:12.176+0000 7f495e188b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5641eaad83b0 0x5641eaaec300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:25:12.240 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:25:12.176+0000 7f495e188b80 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x5641ea9c7ac0 con 0x5641eaad6c90 2023-07-14T18:25:12.240 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:25:12.176+0000 7f495e188b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x5641ea9c77c0 con 0x5641eaad83b0 2023-07-14T18:25:12.240 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:25:12.176+0000 7f495e188b80 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x5641ea8ab920 con 0x5641eaad7640 2023-07-14T18:25:12.240 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:25:12.176+0000 7f495e188b80 10 client.0 _ll_register_callbacks cb 0x5641ea9c5760 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T18:25:12.240 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:25:12.176+0000 7f494b7fe700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5641eaad6c90 0x5641eaae4d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:25:12.241 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:25:12.176+0000 7f494affd700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5641eaad7640 0x5641eaae52c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:25:12.241 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:25:12.176+0000 7f494b7fe700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5641eaad6c90 0x5641eaae4d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:60340/0 (socket says 172.21.15.163:60340) 2023-07-14T18:25:12.241 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:25:12.176+0000 7f494bfff700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5641eaad83b0 0x5641eaaec300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:25:12.241 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:25:12.176+0000 7f494b7fe700 1 -- 172.21.15.163:0/1902097004 learned_addr learned my addr 172.21.15.163:0/1902097004 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:25:12.241 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:25:12.176+0000 7f494affd700 1 --2- 172.21.15.163:0/1902097004 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5641eaad7640 0x5641eaae52c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.163:42164/0 (socket says 172.21.15.163:42164) 2023-07-14T18:25:12.242 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:25:12.176+0000 7f494b7fe700 1 -- 172.21.15.163:0/1902097004 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5641eaad7640 msgr2=0x5641eaae52c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:25:12.242 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:25:12.176+0000 7f494b7fe700 1 --2- 172.21.15.163:0/1902097004 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5641eaad7640 0x5641eaae52c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:25:12.242 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:25:12.176+0000 7f494b7fe700 1 -- 172.21.15.163:0/1902097004 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5641eaad83b0 msgr2=0x5641eaaec300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:25:12.242 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:25:12.176+0000 7f494b7fe700 1 --2- 172.21.15.163:0/1902097004 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5641eaad83b0 0x5641eaaec300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:25:12.242 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:25:12.176+0000 7f494b7fe700 1 -- 172.21.15.163:0/1902097004 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f493c017070 con 0x5641eaad6c90 2023-07-14T18:25:12.243 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:25:12.176+0000 7f494affd700 1 --2- 172.21.15.163:0/1902097004 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5641eaad7640 0x5641eaae52c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T18:25:12.243 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:25:12.177+0000 7f494b7fe700 1 --2- 172.21.15.163:0/1902097004 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5641eaad6c90 0x5641eaae4d80 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7f493c00eb90 tx=0x7f493c00ebc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=21d86f7b099cd092 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:25:12.243 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:25:12.177+0000 7f492affd700 10 client.0 ms_handle_connect on v2:172.21.15.163:3300/0 2023-07-14T18:25:12.243 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:25:12.177+0000 7f492affd700 1 -- 172.21.15.163:0/1902097004 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f493c00ede0 con 0x5641eaad6c90 2023-07-14T18:25:12.243 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:25:12.177+0000 7f495e188b80 1 -- 172.21.15.163:0/1902097004 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5641ea9814f0 con 0x5641eaad6c90 2023-07-14T18:25:12.243 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:25:12.177+0000 7f492affd700 1 -- 172.21.15.163:0/1902097004 <== mon.0 v2:172.21.15.163:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 9049+0+0 (secure 0 0 0) 0x7f493c01d620 con 0x5641eaad6c90 2023-07-14T18:25:12.244 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:25:12.177+0000 7f492affd700 1 -- 172.21.15.163:0/1902097004 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) v2 ==== 24+0+0 (secure 0 0 0) 0x7f493c01d7e0 con 0x5641eaad6c90 2023-07-14T18:25:12.244 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:25:12.177+0000 7f495e188b80 10 client.16620 fetch_fsmap learned FSMap version 39 2023-07-14T18:25:12.244 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:25:12.177+0000 7f495e188b80 1 -- 172.21.15.163:0/1902097004 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) v3 -- 0x5641ea83ec60 con 0x5641eaad6c90 2023-07-14T18:25:12.244 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:25:12.177+0000 7f492affd700 1 -- 172.21.15.163:0/1902097004 <== mon.0 v2:172.21.15.163:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x5641ea9814f0 con 0x5641eaad6c90 2023-07-14T18:25:12.244 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:25:12.177+0000 7f492affd700 1 -- 172.21.15.163:0/1902097004 <== mon.0 v2:172.21.15.163:3300/0 5 ==== fsmap(e 39) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f493c004a20 con 0x5641eaad6c90 2023-07-14T18:25:12.245 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:25:12.177+0000 7f495e188b80 10 client.16620 fetch_fsmap finished waiting for FSMap version 39 2023-07-14T18:25:12.245 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:25:12.177+0000 7f495e188b80 10 client.16620 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-07-14T18:25:12.245 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:25:12.177+0000 7f495e188b80 20 client.16620 populate_metadata read hostname 'smithi163' 2023-07-14T18:25:12.245 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:25:12.178+0000 7f495e188b80 1 --2- 172.21.15.163:0/1902097004 >> [v2:172.21.15.172:6838/3850440096,v1:172.21.15.172:6839/3850440096] conn(0x5641eaaf0a50 0x5641eaaf2e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:25:12.245 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:25:12.178+0000 7f495e188b80 4 client.16620 mds_command: new command op to 24518 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-14T18:25:12.246 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:25:12.178+0000 7f495e188b80 1 -- 172.21.15.163:0/1902097004 --> [v2:172.21.15.172:6838/3850440096,v1:172.21.15.172:6839/3850440096] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5641eaaa5da0 con 0x5641eaaf0a50 2023-07-14T18:25:12.246 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:25:12.178+0000 7f494affd700 1 --2- 172.21.15.163:0/1902097004 >> [v2:172.21.15.172:6838/3850440096,v1:172.21.15.172:6839/3850440096] conn(0x5641eaaf0a50 0x5641eaaf2e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:25:12.246 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:25:12.178+0000 7f492affd700 10 client.16620 ms_handle_connect on v2:172.21.15.172:6838/3850440096 2023-07-14T18:25:12.246 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:25:12.178+0000 7f494affd700 1 --2- 172.21.15.163:0/1902097004 >> [v2:172.21.15.172:6838/3850440096,v1:172.21.15.172:6839/3850440096] conn(0x5641eaaf0a50 0x5641eaaf2e60 crc :-1 s=READY pgs=107 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=30f73fedad2fb8ad server_cookie=5232679e8d996a3a in_seq=0 out_seq=0 2023-07-14T18:25:12.246 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:25:12.179+0000 7f492affd700 1 -- 172.21.15.163:0/1902097004 <== mds.0 v2:172.21.15.172:6838/3850440096 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18017 (crc 0 0 0) 0x5641eaaa5da0 con 0x5641eaaf0a50 2023-07-14T18:25:12.247 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:25:12.179+0000 7f492affd700 10 client.16620 handle_command_reply: tid=0 2023-07-14T18:25:12.247 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:25:12.179+0000 7f495e188b80 1 client.16620 shutdown 2023-07-14T18:25:12.247 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:25:12.179+0000 7f495e188b80 1 -- 172.21.15.163:0/1902097004 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5641eaad6c90 msgr2=0x5641eaae4d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:25:12.247 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:25:12.179+0000 7f495e188b80 1 --2- 172.21.15.163:0/1902097004 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5641eaad6c90 0x5641eaae4d80 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7f493c00eb90 tx=0x7f493c00ebc0 comp rx=0 tx=0).stop 2023-07-14T18:25:12.247 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:25:12.179+0000 7f495e188b80 1 -- 172.21.15.163:0/1902097004 shutdown_connections 2023-07-14T18:25:12.248 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:25:12.179+0000 7f495e188b80 1 --2- 172.21.15.163:0/1902097004 >> [v2:172.21.15.172:6838/3850440096,v1:172.21.15.172:6839/3850440096] conn(0x5641eaaf0a50 0x5641eaaf2e60 crc :-1 s=READY pgs=107 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:25:12.248 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:25:12.179+0000 7f495e188b80 1 --2- 172.21.15.163:0/1902097004 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5641eaad83b0 0x5641eaaec300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:25:12.248 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:25:12.179+0000 7f495e188b80 1 --2- 172.21.15.163:0/1902097004 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5641eaad6c90 0x5641eaae4d80 unknown :-1 s=CLOSED pgs=732 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:25:12.248 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:25:12.179+0000 7f492affd700 0 client.16620 ms_handle_reset on v2:172.21.15.172:6838/3850440096 2023-07-14T18:25:12.248 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:25:12.179+0000 7f495e188b80 1 --2- 172.21.15.163:0/1902097004 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5641eaad7640 0x5641eaae52c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:25:12.249 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:25:12.179+0000 7f495e188b80 1 -- 172.21.15.163:0/1902097004 >> 172.21.15.163:0/1902097004 conn(0x5641eaacc680 msgr2=0x5641eaad0650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:25:12.249 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:25:12.179+0000 7f495e188b80 1 -- 172.21.15.163:0/1902097004 shutdown_connections 2023-07-14T18:25:12.249 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:25:12.179+0000 7f495e188b80 1 -- 172.21.15.163:0/1902097004 wait complete. 2023-07-14T18:25:12.249 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:25:12.179+0000 7f495e188b80 20 client.16620 trim_cache size 0 max 16384 2023-07-14T18:25:12.253 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:25:12.196+0000 7f495e188b80 1 Processor -- start 2023-07-14T18:25:12.254 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:25:12.196+0000 7f495e188b80 1 -- start start 2023-07-14T18:25:12.254 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:25:12.196+0000 7f495e188b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5641eaad6c90 0x5641eaae3b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:25:12.254 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:25:12.196+0000 7f495e188b80 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5641eaad7640 0x5641eaaec2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:25:12.254 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:25:12.196+0000 7f495e188b80 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5641eaad83b0 0x5641eaae2e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:25:12.254 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:25:12.196+0000 7f495e188b80 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x5641eaae4230 con 0x5641eaad7640 2023-07-14T18:25:12.255 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:25:12.196+0000 7f495e188b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x5641eaae4060 con 0x5641eaad6c90 2023-07-14T18:25:12.255 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:25:12.196+0000 7f495e188b80 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x5641eaaf34f0 con 0x5641eaad83b0 2023-07-14T18:25:12.255 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:25:12.196+0000 7f494affd700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5641eaad7640 0x5641eaaec2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:25:12.256 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:25:12.196+0000 7f494affd700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5641eaad7640 0x5641eaaec2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:60350/0 (socket says 172.21.15.163:60350) 2023-07-14T18:25:12.256 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:25:12.196+0000 7f494b7fe700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5641eaad6c90 0x5641eaae3b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:25:12.256 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:25:12.196+0000 7f494affd700 1 -- 172.21.15.163:0/2238572962 learned_addr learned my addr 172.21.15.163:0/2238572962 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:25:12.256 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:25:12.196+0000 7f494bfff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5641eaad83b0 0x5641eaae2e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:25:12.256 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:25:12.196+0000 7f494affd700 1 -- 172.21.15.163:0/2238572962 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5641eaad83b0 msgr2=0x5641eaae2e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:25:12.257 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:25:12.197+0000 7f494affd700 1 --2- 172.21.15.163:0/2238572962 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5641eaad83b0 0x5641eaae2e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:25:12.257 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:25:12.197+0000 7f494affd700 1 -- 172.21.15.163:0/2238572962 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5641eaad6c90 msgr2=0x5641eaae3b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:25:12.257 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:25:12.197+0000 7f494affd700 1 --2- 172.21.15.163:0/2238572962 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5641eaad6c90 0x5641eaae3b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:25:12.257 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:25:12.197+0000 7f494affd700 1 -- 172.21.15.163:0/2238572962 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5641ea87c250 con 0x5641eaad7640 2023-07-14T18:25:12.257 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:25:12.197+0000 7f494affd700 1 --2- 172.21.15.163:0/2238572962 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5641eaad7640 0x5641eaaec2c0 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7f4940005d90 tx=0x7f4940009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=77270e3eed961dad server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:25:12.258 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:25:12.197+0000 7f49327fc700 1 -- 172.21.15.163:0/2238572962 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4940017040 con 0x5641eaad7640 2023-07-14T18:25:12.258 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:25:12.197+0000 7f49327fc700 1 -- 172.21.15.163:0/2238572962 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f4940025070 con 0x5641eaad7640 2023-07-14T18:25:12.258 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:25:12.197+0000 7f49327fc700 1 -- 172.21.15.163:0/2238572962 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49400045b0 con 0x5641eaad7640 2023-07-14T18:25:12.258 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:25:12.198+0000 7f495e188b80 1 -- 172.21.15.163:0/2238572962 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5641eaad7640 msgr2=0x5641eaaec2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:25:12.258 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:25:12.198+0000 7f495e188b80 1 --2- 172.21.15.163:0/2238572962 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5641eaad7640 0x5641eaaec2c0 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7f4940005d90 tx=0x7f4940009260 comp rx=0 tx=0).stop 2023-07-14T18:25:12.259 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:25:12.198+0000 7f495e188b80 1 -- 172.21.15.163:0/2238572962 shutdown_connections 2023-07-14T18:25:12.259 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:25:12.198+0000 7f495e188b80 1 --2- 172.21.15.163:0/2238572962 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5641eaad83b0 0x5641eaae2e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:25:12.259 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:25:12.198+0000 7f495e188b80 1 --2- 172.21.15.163:0/2238572962 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5641eaad6c90 0x5641eaae3b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:25:12.259 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:25:12.198+0000 7f495e188b80 1 --2- 172.21.15.163:0/2238572962 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5641eaad7640 0x5641eaaec2c0 unknown :-1 s=CLOSED pgs=733 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:25:12.259 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:25:12.198+0000 7f495e188b80 1 -- 172.21.15.163:0/2238572962 >> 172.21.15.163:0/2238572962 conn(0x5641eaacc680 msgr2=0x5641eaaecbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:25:12.259 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:25:12.198+0000 7f495e188b80 1 -- 172.21.15.163:0/2238572962 shutdown_connections 2023-07-14T18:25:12.260 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:25:12.198+0000 7f495e188b80 1 -- 172.21.15.163:0/2238572962 wait complete. 2023-07-14T18:25:12.260 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:25:12.198+0000 7f495e188b80 1 -- start start 2023-07-14T18:25:12.260 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:25:12.198+0000 7f495e188b80 1 Processor -- start 2023-07-14T18:25:12.260 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:25:12.198+0000 7f495e188b80 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5641eaad6c90 0x5641eaaec0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:25:12.260 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:25:12.198+0000 7f495e188b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5641eaad7640 0x5641eaaea6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:25:12.261 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:25:12.198+0000 7f495e188b80 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5641eaad83b0 0x5641eaaeac20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:25:12.261 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:25:12.198+0000 7f495e188b80 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x5641eaaeb270 con 0x5641eaad83b0 2023-07-14T18:25:12.261 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:25:12.199+0000 7f495e188b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x5641eaaeb3e0 con 0x5641eaad7640 2023-07-14T18:25:12.261 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:25:12.199+0000 7f495e188b80 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x5641eaaeb5a0 con 0x5641eaad6c90 2023-07-14T18:25:12.261 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:25:12.199+0000 7f495e188b80 10 client.0 _ll_register_callbacks cb 0x7f49400095c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T18:25:12.262 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:25:12.199+0000 7f494b7fe700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5641eaad6c90 0x5641eaaec0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:25:12.262 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:25:12.199+0000 7f494affd700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5641eaad7640 0x5641eaaea6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:25:12.262 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:25:12.199+0000 7f494b7fe700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5641eaad6c90 0x5641eaaec0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.163:42176/0 (socket says 172.21.15.163:42176) 2023-07-14T18:25:12.262 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:25:12.199+0000 7f494b7fe700 1 -- 172.21.15.163:0/1543629092 learned_addr learned my addr 172.21.15.163:0/1543629092 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:25:12.262 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:25:12.199+0000 7f494bfff700 1 --2- 172.21.15.163:0/1543629092 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5641eaad83b0 0x5641eaaeac20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:25:12.263 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:25:12.199+0000 7f494b7fe700 1 -- 172.21.15.163:0/1543629092 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5641eaad7640 msgr2=0x5641eaaea6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:25:12.263 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:25:12.199+0000 7f494b7fe700 1 --2- 172.21.15.163:0/1543629092 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5641eaad7640 0x5641eaaea6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:25:12.263 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:25:12.199+0000 7f494b7fe700 1 -- 172.21.15.163:0/1543629092 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5641eaad83b0 msgr2=0x5641eaaeac20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:25:12.263 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:25:12.199+0000 7f494b7fe700 1 --2- 172.21.15.163:0/1543629092 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5641eaad83b0 0x5641eaaeac20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:25:12.263 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:25:12.199+0000 7f494b7fe700 1 -- 172.21.15.163:0/1543629092 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f49400128a0 con 0x5641eaad6c90 2023-07-14T18:25:12.264 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:25:12.199+0000 7f494b7fe700 1 --2- 172.21.15.163:0/1543629092 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5641eaad6c90 0x5641eaaec0d0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f493c0117d0 tx=0x7f493c011800 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e9cea9b7569975dc server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:25:12.264 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:25:12.199+0000 7f492affd700 10 client.0 ms_handle_connect on v2:172.21.15.184:3300/0 2023-07-14T18:25:12.264 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:25:12.199+0000 7f492affd700 1 -- 172.21.15.163:0/1543629092 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f493c01d620 con 0x5641eaad6c90 2023-07-14T18:25:12.264 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:25:12.199+0000 7f492affd700 1 -- 172.21.15.163:0/1543629092 <== mon.1 v2:172.21.15.184:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 9049+0+0 (secure 0 0 0) 0x7f493c01d780 con 0x5641eaad6c90 2023-07-14T18:25:12.264 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:25:12.199+0000 7f495e188b80 1 -- 172.21.15.163:0/1543629092 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f493c021070 con 0x5641eaad6c90 2023-07-14T18:25:12.265 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:25:12.200+0000 7f492affd700 1 -- 172.21.15.163:0/1543629092 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) v2 ==== 24+0+0 (secure 0 0 0) 0x7f493c01d940 con 0x5641eaad6c90 2023-07-14T18:25:12.265 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:25:12.200+0000 7f495e188b80 10 client.26194 fetch_fsmap learned FSMap version 39 2023-07-14T18:25:12.265 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:25:12.200+0000 7f495e188b80 1 -- 172.21.15.163:0/1543629092 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) v3 -- 0x5641ea8542b0 con 0x5641eaad6c90 2023-07-14T18:25:12.265 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:25:12.200+0000 7f492affd700 1 -- 172.21.15.163:0/1543629092 <== mon.1 v2:172.21.15.184:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f493c021070 con 0x5641eaad6c90 2023-07-14T18:25:12.265 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:25:12.200+0000 7f492affd700 1 -- 172.21.15.163:0/1543629092 <== mon.1 v2:172.21.15.184:3300/0 5 ==== fsmap(e 39) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f493c0053a0 con 0x5641eaad6c90 2023-07-14T18:25:12.266 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:25:12.200+0000 7f495e188b80 10 client.26194 fetch_fsmap finished waiting for FSMap version 39 2023-07-14T18:25:12.266 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:25:12.200+0000 7f495e188b80 10 client.26194 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-07-14T18:25:12.266 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:25:12.200+0000 7f495e188b80 20 client.26194 populate_metadata read hostname 'smithi163' 2023-07-14T18:25:12.266 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:25:12.200+0000 7f495e188b80 1 --2- 172.21.15.163:0/1543629092 >> [v2:172.21.15.172:6838/3850440096,v1:172.21.15.172:6839/3850440096] conn(0x5641eab45c20 0x5641eab48030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:25:12.266 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:25:12.200+0000 7f495e188b80 4 client.26194 mds_command: new command op to 24518 tid=0[{"prefix": "scrub status"}] 2023-07-14T18:25:12.267 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:25:12.200+0000 7f495e188b80 1 -- 172.21.15.163:0/1543629092 --> [v2:172.21.15.172:6838/3850440096,v1:172.21.15.172:6839/3850440096] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x5641eaa20eb0 con 0x5641eab45c20 2023-07-14T18:25:12.267 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:25:12.200+0000 7f494affd700 1 --2- 172.21.15.163:0/1543629092 >> [v2:172.21.15.172:6838/3850440096,v1:172.21.15.172:6839/3850440096] conn(0x5641eab45c20 0x5641eab48030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:25:12.267 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:25:12.201+0000 7f492affd700 10 client.26194 ms_handle_connect on v2:172.21.15.172:6838/3850440096 2023-07-14T18:25:12.267 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:25:12.201+0000 7f494affd700 1 --2- 172.21.15.163:0/1543629092 >> [v2:172.21.15.172:6838/3850440096,v1:172.21.15.172:6839/3850440096] conn(0x5641eab45c20 0x5641eab48030 crc :-1 s=READY pgs=108 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7246d6c448625fc4 server_cookie=a92f8f2cbe05e318 in_seq=0 out_seq=0 2023-07-14T18:25:12.267 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:25:12.201+0000 7f492affd700 1 -- 172.21.15.163:0/1543629092 <== mds.0 v2:172.21.15.172:6838/3850440096 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x5641eaa20eb0 con 0x5641eab45c20 2023-07-14T18:25:12.267 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:25:12.201+0000 7f492affd700 10 client.26194 handle_command_reply: tid=0 2023-07-14T18:25:12.268 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:25:12.201+0000 7f495e188b80 1 client.26194 shutdown 2023-07-14T18:25:12.268 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:25:12.201+0000 7f495e188b80 1 -- 172.21.15.163:0/1543629092 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5641eaad6c90 msgr2=0x5641eaaec0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:25:12.268 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:25:12.201+0000 7f495e188b80 1 --2- 172.21.15.163:0/1543629092 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5641eaad6c90 0x5641eaaec0d0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f493c0117d0 tx=0x7f493c011800 comp rx=0 tx=0).stop 2023-07-14T18:25:12.268 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:25:12.201+0000 7f495e188b80 1 -- 172.21.15.163:0/1543629092 shutdown_connections 2023-07-14T18:25:12.268 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:25:12.201+0000 7f495e188b80 1 --2- 172.21.15.163:0/1543629092 >> [v2:172.21.15.172:6838/3850440096,v1:172.21.15.172:6839/3850440096] conn(0x5641eab45c20 0x5641eab48030 crc :-1 s=READY pgs=108 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:25:12.269 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:25:12.201+0000 7f495e188b80 1 --2- 172.21.15.163:0/1543629092 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5641eaad6c90 0x5641eaaec0d0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:25:12.269 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:25:12.201+0000 7f495e188b80 1 --2- 172.21.15.163:0/1543629092 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5641eaad83b0 0x5641eaaeac20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:25:12.269 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:25:12.201+0000 7f492affd700 0 client.26194 ms_handle_reset on v2:172.21.15.172:6838/3850440096 2023-07-14T18:25:12.269 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:25:12.201+0000 7f495e188b80 1 --2- 172.21.15.163:0/1543629092 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5641eaad7640 0x5641eaaea6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:25:12.269 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:25:12.201+0000 7f495e188b80 1 -- 172.21.15.163:0/1543629092 >> 172.21.15.163:0/1543629092 conn(0x5641eaacc680 msgr2=0x5641eaae2e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:25:12.270 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:25:12.201+0000 7f495e188b80 1 -- 172.21.15.163:0/1543629092 shutdown_connections 2023-07-14T18:25:12.270 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:25:12.201+0000 7f495e188b80 1 -- 172.21.15.163:0/1543629092 wait complete. 2023-07-14T18:25:12.270 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:25:12.201+0000 7f495e188b80 20 client.26194 trim_cache size 0 max 16384 2023-07-14T18:25:12.270 INFO:teuthology.orchestra.run.smithi163.stdout:{ 2023-07-14T18:25:12.271 INFO:teuthology.orchestra.run.smithi163.stdout: "status": "IDLE (waiting for more scrubs)", 2023-07-14T18:25:12.271 INFO:teuthology.orchestra.run.smithi163.stdout: "scrubs": { 2023-07-14T18:25:12.271 INFO:teuthology.orchestra.run.smithi163.stdout: "2c53b7ef-6f30-49f0-a60d-f1f114c19d42": { 2023-07-14T18:25:12.271 INFO:teuthology.orchestra.run.smithi163.stdout: "path": "/", 2023-07-14T18:25:12.272 INFO:teuthology.orchestra.run.smithi163.stdout: "tag": "2c53b7ef-6f30-49f0-a60d-f1f114c19d42", 2023-07-14T18:25:12.272 INFO:teuthology.orchestra.run.smithi163.stdout: "options": "recursive,force" 2023-07-14T18:25:12.272 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-07-14T18:25:12.272 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-07-14T18:25:12.272 INFO:teuthology.orchestra.run.smithi163.stdout:} 2023-07-14T18:25:12.273 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:25:12.202+0000 7f4951ff0700 1 -- 172.21.15.163:0/2897466870 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f49340a1150 msgr2=0x7f49340a3600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:25:12.273 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:25:12.202+0000 7f4951ff0700 1 --2- 172.21.15.163:0/2897466870 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f49340a1150 0x7f49340a3600 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f494c0ff2d0 tx=0x7f493c009260 comp rx=0 tx=0).stop 2023-07-14T18:25:12.273 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:25:12.202+0000 7f4951ff0700 1 -- 172.21.15.163:0/2897466870 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f494c0ffe00 msgr2=0x7f494c19bea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:25:12.274 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:25:12.202+0000 7f4951ff0700 1 --2- 172.21.15.163:0/2897466870 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f494c0ffe00 0x7f494c19bea0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f4944009fd0 tx=0x7f4944007870 comp rx=0 tx=0).stop 2023-07-14T18:25:12.274 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:25:12.202+0000 7f4951ff0700 1 -- 172.21.15.163:0/2897466870 shutdown_connections 2023-07-14T18:25:12.274 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:25:12.202+0000 7f4951ff0700 1 --2- 172.21.15.163:0/2897466870 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f49340a1150 0x7f49340a3600 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:25:12.274 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:25:12.202+0000 7f4951ff0700 1 --2- 172.21.15.163:0/2897466870 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f494c0fe280 0x7f494c1948f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:25:12.274 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:25:12.202+0000 7f4951ff0700 1 --2- 172.21.15.163:0/2897466870 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f494c0ffe00 0x7f494c19bea0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:25:12.275 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:25:12.202+0000 7f4951ff0700 1 --2- 172.21.15.163:0/2897466870 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f494c0ff470 0x7f494c194e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:25:12.275 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:25:12.202+0000 7f4951ff0700 1 -- 172.21.15.163:0/2897466870 >> 172.21.15.163:0/2897466870 conn(0x7f494c0f98a0 msgr2=0x7f494c0fbaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:25:12.275 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:25:12.202+0000 7f4951ff0700 1 -- 172.21.15.163:0/2897466870 shutdown_connections 2023-07-14T18:25:12.275 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:25:12.202+0000 7f4951ff0700 1 -- 172.21.15.163:0/2897466870 wait complete. 2023-07-14T18:25:12.276 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:25:11 smithi163 ceph-mon[96576]: pgmap v676: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-07-14T18:25:12.276 INFO:tasks.cephfs.filesystem:scrub status for tag:2c53b7ef-6f30-49f0-a60d-f1f114c19d42 - {'path': '/', 'tag': '2c53b7ef-6f30-49f0-a60d-f1f114c19d42', 'options': 'recursive,force'} 2023-07-14T18:25:12.286 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:25:11 smithi172 ceph-mon[97983]: pgmap v676: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-07-14T18:25:12.436 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:25:11 smithi184 ceph-mon[98481]: pgmap v676: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-07-14T18:25:15.036 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:25:14 smithi172 ceph-mon[97983]: pgmap v677: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-07-14T18:25:15.186 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:25:14 smithi184 ceph-mon[98481]: pgmap v677: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-07-14T18:25:15.228 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:25:14 smithi163 ceph-mon[96576]: pgmap v677: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-07-14T18:25:17.036 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:25:16 smithi172 ceph-mon[97983]: pgmap v678: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-07-14T18:25:17.185 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:25:16 smithi184 ceph-mon[98481]: pgmap v678: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-07-14T18:25:17.228 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:25:16 smithi163 ceph-mon[96576]: pgmap v678: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-07-14T18:25:19.036 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:25:18 smithi172 ceph-mon[97983]: pgmap v679: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-07-14T18:25:19.185 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:25:18 smithi184 ceph-mon[98481]: pgmap v679: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-07-14T18:25:19.227 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:25:18 smithi163 ceph-mon[96576]: pgmap v679: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-07-14T18:25:21.036 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:25:20 smithi172 ceph-mon[97983]: pgmap v680: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-07-14T18:25:21.185 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:25:20 smithi184 ceph-mon[98481]: pgmap v680: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-07-14T18:25:21.227 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:25:20 smithi163 ceph-mon[96576]: pgmap v680: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-07-14T18:25:22.286 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:25:21 smithi172 ceph-mon[97983]: pgmap v681: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-07-14T18:25:22.435 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:25:21 smithi184 ceph-mon[98481]: pgmap v681: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-07-14T18:25:22.477 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:25:21 smithi163 ceph-mon[96576]: pgmap v681: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-07-14T18:25:25.035 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:25:24 smithi172 ceph-mon[97983]: pgmap v682: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-07-14T18:25:25.184 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:25:24 smithi184 ceph-mon[98481]: pgmap v682: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-07-14T18:25:25.227 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:25:24 smithi163 ceph-mon[96576]: pgmap v682: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-07-14T18:25:27.035 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:25:26 smithi172 ceph-mon[97983]: pgmap v683: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-07-14T18:25:27.184 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:25:26 smithi184 ceph-mon[98481]: pgmap v683: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-07-14T18:25:27.227 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:25:26 smithi163 ceph-mon[96576]: pgmap v683: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-07-14T18:25:29.035 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:25:28 smithi172 ceph-mon[97983]: pgmap v684: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-07-14T18:25:29.184 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:25:28 smithi184 ceph-mon[98481]: pgmap v684: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-07-14T18:25:29.227 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:25:28 smithi163 ceph-mon[96576]: pgmap v684: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-07-14T18:25:31.035 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:25:30 smithi172 ceph-mon[97983]: pgmap v685: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-07-14T18:25:31.184 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:25:30 smithi184 ceph-mon[98481]: pgmap v685: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-07-14T18:25:31.226 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:25:30 smithi163 ceph-mon[96576]: pgmap v685: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-07-14T18:25:32.285 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:25:31 smithi172 ceph-mon[97983]: pgmap v686: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-07-14T18:25:32.434 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:25:31 smithi184 ceph-mon[98481]: pgmap v686: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-07-14T18:25:32.476 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:25:31 smithi163 ceph-mon[96576]: pgmap v686: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-07-14T18:25:33.726 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:25:33 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-14T18:25:33.784 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:25:33 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-14T18:25:33.934 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:25:33 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-14T18:25:35.184 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:25:34 smithi184 ceph-mon[98481]: pgmap v687: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-07-14T18:25:35.184 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:25:34 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:25:35.184 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:25:34 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:25:35.185 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:25:34 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T18:25:35.185 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:25:34 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-14T18:25:35.185 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:25:34 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:25:35.226 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:25:34 smithi163 ceph-mon[96576]: pgmap v687: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-07-14T18:25:35.226 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:25:34 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:25:35.227 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:25:34 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:25:35.227 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:25:34 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T18:25:35.227 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:25:34 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-14T18:25:35.227 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:25:34 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:25:35.284 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:25:34 smithi172 ceph-mon[97983]: pgmap v687: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-07-14T18:25:35.285 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:25:34 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:25:35.285 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:25:34 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:25:35.285 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:25:34 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T18:25:35.285 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:25:34 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-14T18:25:35.286 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:25:34 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:25:37.183 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:25:36 smithi184 ceph-mon[98481]: pgmap v688: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-07-14T18:25:37.226 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:25:36 smithi163 ceph-mon[96576]: pgmap v688: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-07-14T18:25:37.284 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:25:36 smithi172 ceph-mon[97983]: pgmap v688: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-07-14T18:25:39.183 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:25:38 smithi184 ceph-mon[98481]: pgmap v689: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-07-14T18:25:39.225 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:25:38 smithi163 ceph-mon[96576]: pgmap v689: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-07-14T18:25:39.284 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:25:38 smithi172 ceph-mon[97983]: pgmap v689: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-07-14T18:25:41.183 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:25:40 smithi184 ceph-mon[98481]: pgmap v690: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-07-14T18:25:41.225 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:25:40 smithi163 ceph-mon[96576]: pgmap v690: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-07-14T18:25:41.284 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:25:40 smithi172 ceph-mon[97983]: pgmap v690: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-07-14T18:25:42.277 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-07-14T18:25:42.283 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:25:41 smithi172 ceph-mon[97983]: pgmap v691: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-07-14T18:25:42.303 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:25:41 smithi163 ceph-mon[96576]: pgmap v691: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-07-14T18:25:42.433 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:25:41 smithi184 ceph-mon[98481]: pgmap v691: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-07-14T18:25:42.436 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:25:42.386+0000 7f1b0d6d4700 1 -- 172.21.15.163:0/3926177341 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f1b08100690 msgr2=0x7f1b08106f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:25:42.436 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:25:42.386+0000 7f1b0d6d4700 1 --2- 172.21.15.163:0/3926177341 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f1b08100690 0x7f1b08106f50 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7f1b0000b0a0 tx=0x7f1b0000b3b0 comp rx=0 tx=0).stop 2023-07-14T18:25:42.436 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:25:42.386+0000 7f1b0d6d4700 1 -- 172.21.15.163:0/3926177341 shutdown_connections 2023-07-14T18:25:42.437 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:25:42.386+0000 7f1b0d6d4700 1 --2- 172.21.15.163:0/3926177341 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f1b08100690 0x7f1b08106f50 unknown :-1 s=CLOSED pgs=734 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:25:42.437 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:25:42.386+0000 7f1b0d6d4700 1 --2- 172.21.15.163:0/3926177341 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1b080feb10 0x7f1b080fef20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:25:42.437 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:25:42.386+0000 7f1b0d6d4700 1 --2- 172.21.15.163:0/3926177341 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1b080ffd00 0x7f1b08100150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:25:42.437 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:25:42.386+0000 7f1b0d6d4700 1 -- 172.21.15.163:0/3926177341 >> 172.21.15.163:0/3926177341 conn(0x7f1b080fa130 msgr2=0x7f1b080fc560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:25:42.437 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:25:42.386+0000 7f1b0d6d4700 1 -- 172.21.15.163:0/3926177341 shutdown_connections 2023-07-14T18:25:42.438 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:25:42.387+0000 7f1b0d6d4700 1 -- 172.21.15.163:0/3926177341 wait complete. 2023-07-14T18:25:42.439 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:25:42.387+0000 7f1b0d6d4700 1 Processor -- start 2023-07-14T18:25:42.439 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:25:42.387+0000 7f1b0d6d4700 1 -- start start 2023-07-14T18:25:42.439 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:25:42.388+0000 7f1b0d6d4700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1b080feb10 0x7f1b08197b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:25:42.440 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:25:42.388+0000 7f1b0d6d4700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1b080ffd00 0x7f1b081980d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:25:42.440 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:25:42.388+0000 7f1b0d6d4700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f1b08100690 0x7f1b0819f140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:25:42.440 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:25:42.388+0000 7f1b0d6d4700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b0819f710 con 0x7f1b08100690 2023-07-14T18:25:42.440 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:25:42.388+0000 7f1b0d6d4700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b0819f850 con 0x7f1b080ffd00 2023-07-14T18:25:42.441 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:25:42.388+0000 7f1b0d6d4700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b0819f9e0 con 0x7f1b080feb10 2023-07-14T18:25:42.441 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:25:42.388+0000 7f1b077fe700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f1b08100690 0x7f1b0819f140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:25:42.441 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:25:42.388+0000 7f1b06ffd700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1b080feb10 0x7f1b08197b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:25:42.441 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:25:42.388+0000 7f1b067fc700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1b080ffd00 0x7f1b081980d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:25:42.441 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:25:42.388+0000 7f1b077fe700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f1b08100690 0x7f1b0819f140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:60372/0 (socket says 172.21.15.163:60372) 2023-07-14T18:25:42.442 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:25:42.388+0000 7f1b077fe700 1 -- 172.21.15.163:0/3117945661 learned_addr learned my addr 172.21.15.163:0/3117945661 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:25:42.442 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:25:42.388+0000 7f1b077fe700 1 -- 172.21.15.163:0/3117945661 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1b080feb10 msgr2=0x7f1b08197b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:25:42.442 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:25:42.388+0000 7f1b077fe700 1 --2- 172.21.15.163:0/3117945661 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1b080feb10 0x7f1b08197b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:25:42.442 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:25:42.388+0000 7f1b077fe700 1 -- 172.21.15.163:0/3117945661 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1b080ffd00 msgr2=0x7f1b081980d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:25:42.442 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:25:42.388+0000 7f1b077fe700 1 --2- 172.21.15.163:0/3117945661 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1b080ffd00 0x7f1b081980d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:25:42.443 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:25:42.388+0000 7f1b077fe700 1 -- 172.21.15.163:0/3117945661 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b00009d00 con 0x7f1b08100690 2023-07-14T18:25:42.443 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:25:42.388+0000 7f1b077fe700 1 --2- 172.21.15.163:0/3117945661 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f1b08100690 0x7f1b0819f140 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7f1b000095e0 tx=0x7f1b0000ba50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:25:42.443 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:25:42.388+0000 7f1aeffff700 1 -- 172.21.15.163:0/3117945661 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b0000e040 con 0x7f1b08100690 2023-07-14T18:25:42.443 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:25:42.389+0000 7f1b0d6d4700 1 -- 172.21.15.163:0/3117945661 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1b0819fc60 con 0x7f1b08100690 2023-07-14T18:25:42.443 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:25:42.389+0000 7f1aeffff700 1 -- 172.21.15.163:0/3117945661 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f1b0000be90 con 0x7f1b08100690 2023-07-14T18:25:42.443 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:25:42.389+0000 7f1aeffff700 1 -- 172.21.15.163:0/3117945661 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b00005040 con 0x7f1b08100690 2023-07-14T18:25:42.444 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:25:42.389+0000 7f1b0d6d4700 1 -- 172.21.15.163:0/3117945661 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b081a00e0 con 0x7f1b08100690 2023-07-14T18:25:42.448 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:25:42.391+0000 7f1aeffff700 1 -- 172.21.15.163:0/3117945661 <== mon.0 v2:172.21.15.163:3300/0 4 ==== mgrmap(e 18) v1 ==== 135716+0+0 (secure 0 0 0) 0x7f1b00003c00 con 0x7f1b08100690 2023-07-14T18:25:42.448 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:25:42.391+0000 7f1aeffff700 1 --2- 172.21.15.163:0/3117945661 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f1af00a1150 0x7f1af00a3600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:25:42.449 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:25:42.392+0000 7f1b06ffd700 1 --2- 172.21.15.163:0/3117945661 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f1af00a1150 0x7f1af00a3600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:25:42.449 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:25:42.392+0000 7f1aeffff700 1 -- 172.21.15.163:0/3117945661 <== mon.0 v2:172.21.15.163:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 9049+0+0 (secure 0 0 0) 0x7f1b000cdef0 con 0x7f1b08100690 2023-07-14T18:25:42.449 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:25:42.392+0000 7f1b06ffd700 1 --2- 172.21.15.163:0/3117945661 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f1af00a1150 0x7f1af00a3600 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f1b080ffb60 tx=0x7f1af800f040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:25:42.449 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:25:42.393+0000 7f1b1986cb80 1 Processor -- start 2023-07-14T18:25:42.450 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:25:42.393+0000 7f1b1986cb80 1 -- start start 2023-07-14T18:25:42.450 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:25:42.393+0000 7f1b1986cb80 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5633beaebf60 0x5633beaec370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:25:42.450 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:25:42.393+0000 7f1b1986cb80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5633beaec8b0 0x5633beaeced0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:25:42.450 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:25:42.393+0000 7f1b1986cb80 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5633beaed4b0 0x5633beaed920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:25:42.450 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:25:42.393+0000 7f1b1986cb80 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x5633be9f0cb0 con 0x5633beaed4b0 2023-07-14T18:25:42.450 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:25:42.393+0000 7f1b1986cb80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x5633bea43a40 con 0x5633beaec8b0 2023-07-14T18:25:42.451 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:25:42.393+0000 7f1b1986cb80 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x5633bea3ced0 con 0x5633beaebf60 2023-07-14T18:25:42.451 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:25:42.393+0000 7f1b077fe700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5633beaed4b0 0x5633beaed920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:25:42.451 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:25:42.393+0000 7f1b067fc700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5633beaec8b0 0x5633beaeced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:25:42.451 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:25:42.393+0000 7f1b077fe700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5633beaed4b0 0x5633beaed920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:60378/0 (socket says 172.21.15.163:60378) 2023-07-14T18:25:42.451 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:25:42.393+0000 7f1b067fc700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5633beaec8b0 0x5633beaeced0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.163:32832/0 (socket says 172.21.15.163:32832) 2023-07-14T18:25:42.452 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:25:42.393+0000 7f1b06ffd700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5633beaebf60 0x5633beaec370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:25:42.452 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:25:42.393+0000 7f1b077fe700 1 -- 172.21.15.163:0/238496093 learned_addr learned my addr 172.21.15.163:0/238496093 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:25:42.452 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:25:42.393+0000 7f1b077fe700 1 -- 172.21.15.163:0/238496093 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5633beaebf60 msgr2=0x5633beaec370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:25:42.452 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:25:42.393+0000 7f1b077fe700 1 --2- 172.21.15.163:0/238496093 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5633beaebf60 0x5633beaec370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:25:42.453 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:25:42.393+0000 7f1b077fe700 1 -- 172.21.15.163:0/238496093 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5633beaec8b0 msgr2=0x5633beaeced0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:25:42.453 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:25:42.393+0000 7f1b077fe700 1 --2- 172.21.15.163:0/238496093 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5633beaec8b0 0x5633beaeced0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:25:42.453 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:25:42.393+0000 7f1b077fe700 1 -- 172.21.15.163:0/238496093 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5633be86ade0 con 0x5633beaed4b0 2023-07-14T18:25:42.453 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:25:42.393+0000 7f1b067fc700 1 --2- 172.21.15.163:0/238496093 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5633beaec8b0 0x5633beaeced0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T18:25:42.453 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:25:42.394+0000 7f1b077fe700 1 --2- 172.21.15.163:0/238496093 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5633beaed4b0 0x5633beaed920 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7f1b0009ad60 tx=0x7f1b00026000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af91c059559227a7 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:25:42.454 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:25:42.394+0000 7f1aed7fa700 1 -- 172.21.15.163:0/238496093 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b0009f090 con 0x5633beaed4b0 2023-07-14T18:25:42.454 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:25:42.394+0000 7f1aed7fa700 1 -- 172.21.15.163:0/238496093 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f1b000a3420 con 0x5633beaed4b0 2023-07-14T18:25:42.454 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:25:42.394+0000 7f1aed7fa700 1 -- 172.21.15.163:0/238496093 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b0009b530 con 0x5633beaed4b0 2023-07-14T18:25:42.454 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:25:42.394+0000 7f1b1986cb80 1 -- 172.21.15.163:0/238496093 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5633beaed4b0 msgr2=0x5633beaed920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:25:42.454 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:25:42.394+0000 7f1b1986cb80 1 --2- 172.21.15.163:0/238496093 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5633beaed4b0 0x5633beaed920 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7f1b0009ad60 tx=0x7f1b00026000 comp rx=0 tx=0).stop 2023-07-14T18:25:42.454 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:25:42.394+0000 7f1b1986cb80 1 -- 172.21.15.163:0/238496093 shutdown_connections 2023-07-14T18:25:42.455 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:25:42.395+0000 7f1b1986cb80 1 --2- 172.21.15.163:0/238496093 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5633beaebf60 0x5633beaec370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:25:42.455 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:25:42.395+0000 7f1b1986cb80 1 --2- 172.21.15.163:0/238496093 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5633beaed4b0 0x5633beaed920 unknown :-1 s=CLOSED pgs=736 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:25:42.455 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:25:42.395+0000 7f1b1986cb80 1 --2- 172.21.15.163:0/238496093 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5633beaec8b0 0x5633beaeced0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:25:42.455 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:25:42.395+0000 7f1b1986cb80 1 -- 172.21.15.163:0/238496093 >> 172.21.15.163:0/238496093 conn(0x5633beae1680 msgr2=0x5633beae69d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:25:42.455 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:25:42.395+0000 7f1b1986cb80 1 -- 172.21.15.163:0/238496093 shutdown_connections 2023-07-14T18:25:42.456 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:25:42.395+0000 7f1b1986cb80 1 -- 172.21.15.163:0/238496093 wait complete. 2023-07-14T18:25:42.456 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:25:42.395+0000 7f1b1986cb80 1 -- start start 2023-07-14T18:25:42.456 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:25:42.395+0000 7f1b1986cb80 1 Processor -- start 2023-07-14T18:25:42.456 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:25:42.395+0000 7f1b1986cb80 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5633beaebf60 0x5633beaf56a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:25:42.456 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:25:42.395+0000 7f1b1986cb80 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5633beaec8b0 0x5633beaf5be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:25:42.457 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:25:42.395+0000 7f1b1986cb80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5633beaed4b0 0x5633beafcc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:25:42.457 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:25:42.395+0000 7f1b1986cb80 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x5633be9dcac0 con 0x5633beaebf60 2023-07-14T18:25:42.457 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:25:42.395+0000 7f1b1986cb80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x5633be9dc7c0 con 0x5633beaed4b0 2023-07-14T18:25:42.457 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:25:42.395+0000 7f1b1986cb80 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x5633be8c0920 con 0x5633beaec8b0 2023-07-14T18:25:42.457 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:25:42.395+0000 7f1b1986cb80 10 client.0 _ll_register_callbacks cb 0x5633be9da760 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T18:25:42.458 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:25:42.395+0000 7f1b06ffd700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5633beaebf60 0x5633beaf56a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:25:42.458 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:25:42.396+0000 7f1b06ffd700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5633beaebf60 0x5633beaf56a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:60382/0 (socket says 172.21.15.163:60382) 2023-07-14T18:25:42.458 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:25:42.396+0000 7f1b067fc700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5633beaec8b0 0x5633beaf5be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:25:42.458 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:25:42.396+0000 7f1b077fe700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5633beaed4b0 0x5633beafcc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:25:42.459 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:25:42.396+0000 7f1b06ffd700 1 -- 172.21.15.163:0/3612735295 learned_addr learned my addr 172.21.15.163:0/3612735295 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:25:42.459 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:25:42.396+0000 7f1b067fc700 1 -- 172.21.15.163:0/3612735295 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5633beaed4b0 msgr2=0x5633beafcc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:25:42.459 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:25:42.396+0000 7f1b067fc700 1 --2- 172.21.15.163:0/3612735295 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5633beaed4b0 0x5633beafcc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:25:42.459 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:25:42.396+0000 7f1b067fc700 1 -- 172.21.15.163:0/3612735295 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5633beaebf60 msgr2=0x5633beaf56a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:25:42.459 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:25:42.396+0000 7f1b067fc700 1 --2- 172.21.15.163:0/3612735295 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5633beaebf60 0x5633beaf56a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:25:42.460 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:25:42.396+0000 7f1b067fc700 1 -- 172.21.15.163:0/3612735295 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1afc009920 con 0x5633beaec8b0 2023-07-14T18:25:42.460 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:25:42.396+0000 7f1b077fe700 1 --2- 172.21.15.163:0/3612735295 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5633beaed4b0 0x5633beafcc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T18:25:42.460 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:25:42.396+0000 7f1b067fc700 1 --2- 172.21.15.163:0/3612735295 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5633beaec8b0 0x5633beaf5be0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f1afc012880 tx=0x7f1afc012b90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fec531e48d8c72aa server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:25:42.460 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:25:42.396+0000 7f1aeaff5700 10 client.0 ms_handle_connect on v2:172.21.15.184:3300/0 2023-07-14T18:25:42.461 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:25:42.396+0000 7f1aeaff5700 1 -- 172.21.15.163:0/3612735295 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1afc017070 con 0x5633beaec8b0 2023-07-14T18:25:42.461 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:25:42.396+0000 7f1b1986cb80 1 -- 172.21.15.163:0/3612735295 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5633be9964f0 con 0x5633beaec8b0 2023-07-14T18:25:42.461 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:25:42.396+0000 7f1aeaff5700 1 -- 172.21.15.163:0/3612735295 <== mon.1 v2:172.21.15.184:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 9049+0+0 (secure 0 0 0) 0x7f1afc004830 con 0x5633beaec8b0 2023-07-14T18:25:42.461 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:25:42.396+0000 7f1aeaff5700 1 -- 172.21.15.163:0/3612735295 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1afc0049f0 con 0x5633beaec8b0 2023-07-14T18:25:42.461 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:25:42.397+0000 7f1b1986cb80 10 client.26206 fetch_fsmap learned FSMap version 39 2023-07-14T18:25:42.462 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:25:42.397+0000 7f1b1986cb80 1 -- 172.21.15.163:0/3612735295 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) v3 -- 0x7f1b081a00e0 con 0x5633beaec8b0 2023-07-14T18:25:42.462 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:25:42.397+0000 7f1aeaff5700 1 -- 172.21.15.163:0/3612735295 <== mon.1 v2:172.21.15.184:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x5633be9964f0 con 0x5633beaec8b0 2023-07-14T18:25:42.462 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:25:42.397+0000 7f1aeaff5700 1 -- 172.21.15.163:0/3612735295 <== mon.1 v2:172.21.15.184:3300/0 5 ==== fsmap(e 39) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f1afc01c630 con 0x5633beaec8b0 2023-07-14T18:25:42.462 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:25:42.397+0000 7f1b1986cb80 10 client.26206 fetch_fsmap finished waiting for FSMap version 39 2023-07-14T18:25:42.462 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:25:42.397+0000 7f1b1986cb80 10 client.26206 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-07-14T18:25:42.462 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:25:42.397+0000 7f1b1986cb80 20 client.26206 populate_metadata read hostname 'smithi163' 2023-07-14T18:25:42.463 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:25:42.397+0000 7f1b1986cb80 1 --2- 172.21.15.163:0/3612735295 >> [v2:172.21.15.172:6838/3850440096,v1:172.21.15.172:6839/3850440096] conn(0x5633beb014e0 0x5633beb038f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:25:42.463 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:25:42.397+0000 7f1b1986cb80 4 client.26206 mds_command: new command op to 24518 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-14T18:25:42.463 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:25:42.397+0000 7f1b1986cb80 1 -- 172.21.15.163:0/3612735295 --> [v2:172.21.15.172:6838/3850440096,v1:172.21.15.172:6839/3850440096] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5633beabada0 con 0x5633beb014e0 2023-07-14T18:25:42.464 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:25:42.397+0000 7f1b06ffd700 1 --2- 172.21.15.163:0/3612735295 >> [v2:172.21.15.172:6838/3850440096,v1:172.21.15.172:6839/3850440096] conn(0x5633beb014e0 0x5633beb038f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:25:42.464 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:25:42.397+0000 7f1aeaff5700 10 client.26206 ms_handle_connect on v2:172.21.15.172:6838/3850440096 2023-07-14T18:25:42.464 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:25:42.397+0000 7f1b06ffd700 1 --2- 172.21.15.163:0/3612735295 >> [v2:172.21.15.172:6838/3850440096,v1:172.21.15.172:6839/3850440096] conn(0x5633beb014e0 0x5633beb038f0 crc :-1 s=READY pgs=109 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e784707ab1daf286 server_cookie=a906e7f1e4b29c86 in_seq=0 out_seq=0 2023-07-14T18:25:42.464 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:25:42.398+0000 7f1aeaff5700 1 -- 172.21.15.163:0/3612735295 <== mds.0 v2:172.21.15.172:6838/3850440096 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18017 (crc 0 0 0) 0x5633beabada0 con 0x5633beb014e0 2023-07-14T18:25:42.465 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:25:42.398+0000 7f1aeaff5700 10 client.26206 handle_command_reply: tid=0 2023-07-14T18:25:42.465 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:25:42.398+0000 7f1b1986cb80 1 client.26206 shutdown 2023-07-14T18:25:42.465 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:25:42.398+0000 7f1b1986cb80 1 -- 172.21.15.163:0/3612735295 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5633beaec8b0 msgr2=0x5633beaf5be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:25:42.465 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:25:42.398+0000 7f1b1986cb80 1 --2- 172.21.15.163:0/3612735295 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5633beaec8b0 0x5633beaf5be0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f1afc012880 tx=0x7f1afc012b90 comp rx=0 tx=0).stop 2023-07-14T18:25:42.465 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:25:42.398+0000 7f1b1986cb80 1 -- 172.21.15.163:0/3612735295 shutdown_connections 2023-07-14T18:25:42.465 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:25:42.398+0000 7f1b1986cb80 1 --2- 172.21.15.163:0/3612735295 >> [v2:172.21.15.172:6838/3850440096,v1:172.21.15.172:6839/3850440096] conn(0x5633beb014e0 0x5633beb038f0 crc :-1 s=READY pgs=109 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:25:42.466 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:25:42.398+0000 7f1b1986cb80 1 --2- 172.21.15.163:0/3612735295 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5633beaed4b0 0x5633beafcc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:25:42.466 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:25:42.398+0000 7f1aeaff5700 0 client.26206 ms_handle_reset on v2:172.21.15.172:6838/3850440096 2023-07-14T18:25:42.466 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:25:42.398+0000 7f1b1986cb80 1 --2- 172.21.15.163:0/3612735295 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5633beaebf60 0x5633beaf56a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:25:42.466 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:25:42.398+0000 7f1b1986cb80 1 --2- 172.21.15.163:0/3612735295 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5633beaec8b0 0x5633beaf5be0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:25:42.466 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:25:42.398+0000 7f1b1986cb80 1 -- 172.21.15.163:0/3612735295 >> 172.21.15.163:0/3612735295 conn(0x5633beae1680 msgr2=0x5633beae5650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:25:42.467 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:25:42.398+0000 7f1b1986cb80 1 -- 172.21.15.163:0/3612735295 shutdown_connections 2023-07-14T18:25:42.467 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:25:42.398+0000 7f1b1986cb80 1 -- 172.21.15.163:0/3612735295 wait complete. 2023-07-14T18:25:42.467 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:25:42.399+0000 7f1b1986cb80 20 client.26206 trim_cache size 0 max 16384 2023-07-14T18:25:42.470 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:25:42.421+0000 7f1b1986cb80 1 Processor -- start 2023-07-14T18:25:42.471 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:25:42.421+0000 7f1b1986cb80 1 -- start start 2023-07-14T18:25:42.471 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:25:42.421+0000 7f1b1986cb80 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5633beaebf60 0x5633beaf03d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:25:42.471 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:25:42.421+0000 7f1b1986cb80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5633beaec8b0 0x5633beafcbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:25:42.471 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:25:42.421+0000 7f1b1986cb80 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5633beaed4b0 0x5633beaf0910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:25:42.472 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:25:42.421+0000 7f1b1986cb80 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x5633beaedd90 con 0x5633beaebf60 2023-07-14T18:25:42.472 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:25:42.421+0000 7f1b1986cb80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x5633beabadd0 con 0x5633beaec8b0 2023-07-14T18:25:42.472 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:25:42.421+0000 7f1b1986cb80 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x5633beae3700 con 0x5633beaed4b0 2023-07-14T18:25:42.472 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:25:42.421+0000 7f1b06ffd700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5633beaebf60 0x5633beaf03d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:25:42.472 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:25:42.421+0000 7f1b067fc700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5633beaec8b0 0x5633beafcbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:25:42.473 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:25:42.421+0000 7f1b06ffd700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5633beaebf60 0x5633beaf03d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:60390/0 (socket says 172.21.15.163:60390) 2023-07-14T18:25:42.473 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:25:42.421+0000 7f1b067fc700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5633beaec8b0 0x5633beafcbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.163:32844/0 (socket says 172.21.15.163:32844) 2023-07-14T18:25:42.473 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:25:42.421+0000 7f1b06ffd700 1 -- 172.21.15.163:0/2207162639 learned_addr learned my addr 172.21.15.163:0/2207162639 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:25:42.473 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:25:42.421+0000 7f1b077fe700 1 --2- 172.21.15.163:0/2207162639 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5633beaed4b0 0x5633beaf0910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:25:42.473 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:25:42.421+0000 7f1b06ffd700 1 -- 172.21.15.163:0/2207162639 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5633beaed4b0 msgr2=0x5633beaf0910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:25:42.474 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:25:42.421+0000 7f1b06ffd700 1 --2- 172.21.15.163:0/2207162639 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5633beaed4b0 0x5633beaf0910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:25:42.474 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:25:42.421+0000 7f1b06ffd700 1 -- 172.21.15.163:0/2207162639 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5633beaec8b0 msgr2=0x5633beafcbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:25:42.474 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:25:42.421+0000 7f1b06ffd700 1 --2- 172.21.15.163:0/2207162639 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5633beaec8b0 0x5633beafcbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:25:42.474 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:25:42.421+0000 7f1b06ffd700 1 -- 172.21.15.163:0/2207162639 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5633be853c60 con 0x5633beaebf60 2023-07-14T18:25:42.474 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:25:42.421+0000 7f1b067fc700 1 --2- 172.21.15.163:0/2207162639 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5633beaec8b0 0x5633beafcbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T18:25:42.475 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:25:42.421+0000 7f1b077fe700 1 --2- 172.21.15.163:0/2207162639 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5633beaed4b0 0x5633beaf0910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T18:25:42.475 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:25:42.422+0000 7f1b06ffd700 1 --2- 172.21.15.163:0/2207162639 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5633beaebf60 0x5633beaf03d0 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x5633beb041c0 tx=0x7f1af8015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3cf64287233b5380 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:25:42.478 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:25:42.422+0000 7f1aedffb700 1 -- 172.21.15.163:0/2207162639 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1af802d1b0 con 0x5633beaebf60 2023-07-14T18:25:42.479 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:25:42.422+0000 7f1aedffb700 1 -- 172.21.15.163:0/2207162639 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f1af802d040 con 0x5633beaebf60 2023-07-14T18:25:42.479 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:25:42.422+0000 7f1aedffb700 1 -- 172.21.15.163:0/2207162639 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1af802db00 con 0x5633beaebf60 2023-07-14T18:25:42.479 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:25:42.422+0000 7f1b1986cb80 1 -- 172.21.15.163:0/2207162639 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5633beaebf60 msgr2=0x5633beaf03d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:25:42.480 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:25:42.422+0000 7f1b1986cb80 1 --2- 172.21.15.163:0/2207162639 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5633beaebf60 0x5633beaf03d0 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x5633beb041c0 tx=0x7f1af8015000 comp rx=0 tx=0).stop 2023-07-14T18:25:42.480 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:25:42.422+0000 7f1b1986cb80 1 -- 172.21.15.163:0/2207162639 shutdown_connections 2023-07-14T18:25:42.480 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:25:42.423+0000 7f1b1986cb80 1 --2- 172.21.15.163:0/2207162639 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5633beaed4b0 0x5633beaf0910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:25:42.480 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:25:42.423+0000 7f1b1986cb80 1 --2- 172.21.15.163:0/2207162639 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5633beaebf60 0x5633beaf03d0 unknown :-1 s=CLOSED pgs=737 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:25:42.480 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:25:42.423+0000 7f1b1986cb80 1 --2- 172.21.15.163:0/2207162639 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5633beaec8b0 0x5633beafcbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:25:42.481 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:25:42.423+0000 7f1b1986cb80 1 -- 172.21.15.163:0/2207162639 >> 172.21.15.163:0/2207162639 conn(0x5633beae1680 msgr2=0x5633beaf3870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:25:42.481 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:25:42.423+0000 7f1b1986cb80 1 -- 172.21.15.163:0/2207162639 shutdown_connections 2023-07-14T18:25:42.481 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:25:42.423+0000 7f1b1986cb80 1 -- 172.21.15.163:0/2207162639 wait complete. 2023-07-14T18:25:42.482 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:25:42.423+0000 7f1b1986cb80 1 -- start start 2023-07-14T18:25:42.482 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:25:42.423+0000 7f1b1986cb80 1 Processor -- start 2023-07-14T18:25:42.482 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:25:42.423+0000 7f1b1986cb80 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5633beaebf60 0x5633beafc410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:25:42.483 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:25:42.423+0000 7f1b1986cb80 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5633beaec8b0 0x5633beafc950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:25:42.483 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:25:42.423+0000 7f1b1986cb80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5633beaed4b0 0x5633beaf8eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:25:42.484 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:25:42.423+0000 7f1b1986cb80 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x5633beaf9440 con 0x5633beaebf60 2023-07-14T18:25:42.484 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:25:42.423+0000 7f1b1986cb80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x5633beaf95b0 con 0x5633beaed4b0 2023-07-14T18:25:42.484 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:25:42.423+0000 7f1b1986cb80 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x5633beaf9770 con 0x5633beaec8b0 2023-07-14T18:25:42.485 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:25:42.423+0000 7f1b1986cb80 10 client.0 _ll_register_callbacks cb 0x7f1afc009f50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T18:25:42.485 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:25:42.423+0000 7f1b06ffd700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5633beaebf60 0x5633beafc410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:25:42.486 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:25:42.423+0000 7f1b077fe700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5633beaed4b0 0x5633beaf8eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:25:42.486 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:25:42.423+0000 7f1b06ffd700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5633beaebf60 0x5633beafc410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:60396/0 (socket says 172.21.15.163:60396) 2023-07-14T18:25:42.486 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:25:42.423+0000 7f1b06ffd700 1 -- 172.21.15.163:0/907057568 learned_addr learned my addr 172.21.15.163:0/907057568 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:25:42.487 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:25:42.423+0000 7f1b067fc700 1 --2- 172.21.15.163:0/907057568 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5633beaec8b0 0x5633beafc950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:25:42.487 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:25:42.424+0000 7f1b06ffd700 1 -- 172.21.15.163:0/907057568 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5633beaec8b0 msgr2=0x5633beafc950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:25:42.488 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:25:42.424+0000 7f1b06ffd700 1 --2- 172.21.15.163:0/907057568 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5633beaec8b0 0x5633beafc950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:25:42.488 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:25:42.424+0000 7f1b06ffd700 1 -- 172.21.15.163:0/907057568 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5633beaed4b0 msgr2=0x5633beaf8eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:25:42.488 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:25:42.424+0000 7f1b06ffd700 1 --2- 172.21.15.163:0/907057568 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5633beaed4b0 0x5633beaf8eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:25:42.489 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:25:42.424+0000 7f1b06ffd700 1 -- 172.21.15.163:0/907057568 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b081a00e0 con 0x5633beaebf60 2023-07-14T18:25:42.489 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:25:42.424+0000 7f1b077fe700 1 --2- 172.21.15.163:0/907057568 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5633beaed4b0 0x5633beaf8eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T18:25:42.489 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:25:42.424+0000 7f1b067fc700 1 --2- 172.21.15.163:0/907057568 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5633beaec8b0 0x5633beafc950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T18:25:42.490 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:25:42.424+0000 7f1b06ffd700 1 --2- 172.21.15.163:0/907057568 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5633beaebf60 0x5633beafc410 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7f1af8009f10 tx=0x7f1af8009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f9859ea980fae2e server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:25:42.490 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:25:42.424+0000 7f1aeaff5700 10 client.0 ms_handle_connect on v2:172.21.15.163:3300/0 2023-07-14T18:25:42.491 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:25:42.424+0000 7f1aeaff5700 1 -- 172.21.15.163:0/907057568 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1af802d3e0 con 0x5633beaebf60 2023-07-14T18:25:42.491 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:25:42.424+0000 7f1aeaff5700 1 -- 172.21.15.163:0/907057568 <== mon.0 v2:172.21.15.163:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 9049+0+0 (secure 0 0 0) 0x7f1af8027b70 con 0x5633beaebf60 2023-07-14T18:25:42.491 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:25:42.424+0000 7f1b1986cb80 1 -- 172.21.15.163:0/907057568 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f1b000a3420 con 0x5633beaebf60 2023-07-14T18:25:42.492 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:25:42.424+0000 7f1aeaff5700 1 -- 172.21.15.163:0/907057568 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1af8027d30 con 0x5633beaebf60 2023-07-14T18:25:42.492 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:25:42.424+0000 7f1b1986cb80 10 client.16644 fetch_fsmap learned FSMap version 39 2023-07-14T18:25:42.492 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:25:42.424+0000 7f1b1986cb80 1 -- 172.21.15.163:0/907057568 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) v3 -- 0x5633be86ade0 con 0x5633beaebf60 2023-07-14T18:25:42.493 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:25:42.425+0000 7f1aeaff5700 1 -- 172.21.15.163:0/907057568 <== mon.0 v2:172.21.15.163:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f1b000a3420 con 0x5633beaebf60 2023-07-14T18:25:42.493 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:25:42.425+0000 7f1aeaff5700 1 -- 172.21.15.163:0/907057568 <== mon.0 v2:172.21.15.163:3300/0 5 ==== fsmap(e 39) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f1af8033020 con 0x5633beaebf60 2023-07-14T18:25:42.494 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:25:42.425+0000 7f1b1986cb80 10 client.16644 fetch_fsmap finished waiting for FSMap version 39 2023-07-14T18:25:42.494 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:25:42.425+0000 7f1b1986cb80 10 client.16644 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-07-14T18:25:42.494 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:25:42.425+0000 7f1b1986cb80 20 client.16644 populate_metadata read hostname 'smithi163' 2023-07-14T18:25:42.495 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:25:42.425+0000 7f1b1986cb80 1 --2- 172.21.15.163:0/907057568 >> [v2:172.21.15.172:6838/3850440096,v1:172.21.15.172:6839/3850440096] conn(0x5633beb565a0 0x5633beb589b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:25:42.495 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:25:42.425+0000 7f1b1986cb80 4 client.16644 mds_command: new command op to 24518 tid=0[{"prefix": "scrub status"}] 2023-07-14T18:25:42.496 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:25:42.425+0000 7f1b1986cb80 1 -- 172.21.15.163:0/907057568 --> [v2:172.21.15.172:6838/3850440096,v1:172.21.15.172:6839/3850440096] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x5633bea35eb0 con 0x5633beb565a0 2023-07-14T18:25:42.496 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:25:42.425+0000 7f1b067fc700 1 --2- 172.21.15.163:0/907057568 >> [v2:172.21.15.172:6838/3850440096,v1:172.21.15.172:6839/3850440096] conn(0x5633beb565a0 0x5633beb589b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:25:42.496 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:25:42.425+0000 7f1b067fc700 1 --2- 172.21.15.163:0/907057568 >> [v2:172.21.15.172:6838/3850440096,v1:172.21.15.172:6839/3850440096] conn(0x5633beb565a0 0x5633beb589b0 crc :-1 s=READY pgs=110 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a91455f0c7dda3a4 server_cookie=7b45a19b43d51024 in_seq=0 out_seq=0 2023-07-14T18:25:42.497 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:25:42.425+0000 7f1aeaff5700 10 client.16644 ms_handle_connect on v2:172.21.15.172:6838/3850440096 2023-07-14T18:25:42.497 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:25:42.425+0000 7f1aeaff5700 1 -- 172.21.15.163:0/907057568 <== mds.0 v2:172.21.15.172:6838/3850440096 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x5633bea35eb0 con 0x5633beb565a0 2023-07-14T18:25:42.497 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:25:42.425+0000 7f1aeaff5700 10 client.16644 handle_command_reply: tid=0 2023-07-14T18:25:42.498 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:25:42.425+0000 7f1b1986cb80 1 client.16644 shutdown 2023-07-14T18:25:42.498 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:25:42.426+0000 7f1b1986cb80 1 -- 172.21.15.163:0/907057568 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5633beaebf60 msgr2=0x5633beafc410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:25:42.499 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:25:42.426+0000 7f1b1986cb80 1 --2- 172.21.15.163:0/907057568 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5633beaebf60 0x5633beafc410 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7f1af8009f10 tx=0x7f1af8009da0 comp rx=0 tx=0).stop 2023-07-14T18:25:42.499 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:25:42.426+0000 7f1b1986cb80 1 -- 172.21.15.163:0/907057568 shutdown_connections 2023-07-14T18:25:42.499 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:25:42.426+0000 7f1b1986cb80 1 --2- 172.21.15.163:0/907057568 >> [v2:172.21.15.172:6838/3850440096,v1:172.21.15.172:6839/3850440096] conn(0x5633beb565a0 0x5633beb589b0 crc :-1 s=READY pgs=110 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:25:42.500 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:25:42.426+0000 7f1b1986cb80 1 --2- 172.21.15.163:0/907057568 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5633beaed4b0 0x5633beaf8eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:25:42.500 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:25:42.426+0000 7f1aeaff5700 0 client.16644 ms_handle_reset on v2:172.21.15.172:6838/3850440096 2023-07-14T18:25:42.501 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:25:42.426+0000 7f1b1986cb80 1 --2- 172.21.15.163:0/907057568 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5633beaebf60 0x5633beafc410 unknown :-1 s=CLOSED pgs=738 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:25:42.501 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:25:42.426+0000 7f1b1986cb80 1 --2- 172.21.15.163:0/907057568 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5633beaec8b0 0x5633beafc950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:25:42.501 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:25:42.426+0000 7f1b1986cb80 1 -- 172.21.15.163:0/907057568 >> 172.21.15.163:0/907057568 conn(0x5633beae1680 msgr2=0x5633beaf03d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:25:42.502 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:25:42.426+0000 7f1b1986cb80 1 -- 172.21.15.163:0/907057568 shutdown_connections 2023-07-14T18:25:42.502 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:25:42.426+0000 7f1b1986cb80 1 -- 172.21.15.163:0/907057568 wait complete. 2023-07-14T18:25:42.502 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:25:42.426+0000 7f1b1986cb80 20 client.16644 trim_cache size 0 max 16384 2023-07-14T18:25:42.503 INFO:teuthology.orchestra.run.smithi163.stdout:{ 2023-07-14T18:25:42.504 INFO:teuthology.orchestra.run.smithi163.stdout: "status": "IDLE (waiting for more scrubs)", 2023-07-14T18:25:42.504 INFO:teuthology.orchestra.run.smithi163.stdout: "scrubs": { 2023-07-14T18:25:42.504 INFO:teuthology.orchestra.run.smithi163.stdout: "2c53b7ef-6f30-49f0-a60d-f1f114c19d42": { 2023-07-14T18:25:42.505 INFO:teuthology.orchestra.run.smithi163.stdout: "path": "/", 2023-07-14T18:25:42.505 INFO:teuthology.orchestra.run.smithi163.stdout: "tag": "2c53b7ef-6f30-49f0-a60d-f1f114c19d42", 2023-07-14T18:25:42.505 INFO:teuthology.orchestra.run.smithi163.stdout: "options": "recursive,force" 2023-07-14T18:25:42.506 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-07-14T18:25:42.506 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-07-14T18:25:42.507 INFO:teuthology.orchestra.run.smithi163.stdout:} 2023-07-14T18:25:42.509 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:25:42.426+0000 7f1b0d6d4700 1 -- 172.21.15.163:0/3117945661 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f1af00a1150 msgr2=0x7f1af00a3600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:25:42.509 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:25:42.426+0000 7f1b0d6d4700 1 --2- 172.21.15.163:0/3117945661 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f1af00a1150 0x7f1af00a3600 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f1b080ffb60 tx=0x7f1af800f040 comp rx=0 tx=0).stop 2023-07-14T18:25:42.510 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:25:42.426+0000 7f1b0d6d4700 1 -- 172.21.15.163:0/3117945661 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f1b08100690 msgr2=0x7f1b0819f140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:25:42.510 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:25:42.426+0000 7f1b0d6d4700 1 --2- 172.21.15.163:0/3117945661 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f1b08100690 0x7f1b0819f140 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7f1b000095e0 tx=0x7f1b0000ba50 comp rx=0 tx=0).stop 2023-07-14T18:25:42.511 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:25:42.426+0000 7f1b0d6d4700 1 -- 172.21.15.163:0/3117945661 shutdown_connections 2023-07-14T18:25:42.511 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:25:42.426+0000 7f1b0d6d4700 1 --2- 172.21.15.163:0/3117945661 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f1af00a1150 0x7f1af00a3600 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:25:42.511 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:25:42.426+0000 7f1b0d6d4700 1 --2- 172.21.15.163:0/3117945661 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1b080feb10 0x7f1b08197b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:25:42.512 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:25:42.426+0000 7f1b0d6d4700 1 --2- 172.21.15.163:0/3117945661 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f1b08100690 0x7f1b0819f140 unknown :-1 s=CLOSED pgs=735 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:25:42.512 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:25:42.426+0000 7f1b0d6d4700 1 --2- 172.21.15.163:0/3117945661 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1b080ffd00 0x7f1b081980d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:25:42.512 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:25:42.427+0000 7f1b0d6d4700 1 -- 172.21.15.163:0/3117945661 >> 172.21.15.163:0/3117945661 conn(0x7f1b080fa130 msgr2=0x7f1b08103190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:25:42.513 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:25:42.427+0000 7f1b0d6d4700 1 -- 172.21.15.163:0/3117945661 shutdown_connections 2023-07-14T18:25:42.513 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:25:42.427+0000 7f1b0d6d4700 1 -- 172.21.15.163:0/3117945661 wait complete. 2023-07-14T18:25:42.513 INFO:tasks.cephfs.filesystem:scrub status for tag:2c53b7ef-6f30-49f0-a60d-f1f114c19d42 - {'path': '/', 'tag': '2c53b7ef-6f30-49f0-a60d-f1f114c19d42', 'options': 'recursive,force'} 2023-07-14T18:25:45.034 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:25:44 smithi172 ceph-mon[97983]: pgmap v692: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-07-14T18:25:45.183 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:25:44 smithi184 ceph-mon[98481]: pgmap v692: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-07-14T18:25:45.225 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:25:44 smithi163 ceph-mon[96576]: pgmap v692: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-07-14T18:25:47.033 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:25:46 smithi172 ceph-mon[97983]: pgmap v693: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-07-14T18:25:47.182 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:25:46 smithi184 ceph-mon[98481]: pgmap v693: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-07-14T18:25:47.225 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:25:46 smithi163 ceph-mon[96576]: pgmap v693: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-07-14T18:25:49.033 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:25:48 smithi172 ceph-mon[97983]: pgmap v694: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-07-14T18:25:49.182 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:25:48 smithi184 ceph-mon[98481]: pgmap v694: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-07-14T18:25:49.225 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:25:48 smithi163 ceph-mon[96576]: pgmap v694: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-07-14T18:25:51.033 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:25:50 smithi172 ceph-mon[97983]: pgmap v695: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-07-14T18:25:51.182 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:25:50 smithi184 ceph-mon[98481]: pgmap v695: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-07-14T18:25:51.224 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:25:50 smithi163 ceph-mon[96576]: pgmap v695: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-07-14T18:25:52.283 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:25:51 smithi172 ceph-mon[97983]: pgmap v696: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-07-14T18:25:52.432 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:25:51 smithi184 ceph-mon[98481]: pgmap v696: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-07-14T18:25:52.474 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:25:51 smithi163 ceph-mon[96576]: pgmap v696: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-07-14T18:25:55.033 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:25:54 smithi172 ceph-mon[97983]: pgmap v697: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-07-14T18:25:55.182 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:25:54 smithi184 ceph-mon[98481]: pgmap v697: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-07-14T18:25:55.224 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:25:54 smithi163 ceph-mon[96576]: pgmap v697: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-07-14T18:25:57.032 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:25:56 smithi172 ceph-mon[97983]: pgmap v698: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-07-14T18:25:57.182 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:25:56 smithi184 ceph-mon[98481]: pgmap v698: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-07-14T18:25:57.224 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:25:56 smithi163 ceph-mon[96576]: pgmap v698: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-07-14T18:25:59.032 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:25:58 smithi172 ceph-mon[97983]: pgmap v699: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-07-14T18:25:59.181 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:25:58 smithi184 ceph-mon[98481]: pgmap v699: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-07-14T18:25:59.224 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:25:58 smithi163 ceph-mon[96576]: pgmap v699: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-07-14T18:26:01.032 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:26:00 smithi172 ceph-mon[97983]: pgmap v700: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-07-14T18:26:01.181 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:26:00 smithi184 ceph-mon[98481]: pgmap v700: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-07-14T18:26:01.224 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:26:00 smithi163 ceph-mon[96576]: pgmap v700: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-07-14T18:26:02.282 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:26:01 smithi172 ceph-mon[97983]: pgmap v701: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-07-14T18:26:02.431 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:26:01 smithi184 ceph-mon[98481]: pgmap v701: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-07-14T18:26:02.473 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:26:01 smithi163 ceph-mon[96576]: pgmap v701: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-07-14T18:26:05.032 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:26:04 smithi172 ceph-mon[97983]: pgmap v702: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-07-14T18:26:05.181 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:26:04 smithi184 ceph-mon[98481]: pgmap v702: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-07-14T18:26:05.223 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:26:04 smithi163 ceph-mon[96576]: pgmap v702: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-07-14T18:26:07.032 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:26:06 smithi172 ceph-mon[97983]: pgmap v703: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-07-14T18:26:07.181 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:26:06 smithi184 ceph-mon[98481]: pgmap v703: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-07-14T18:26:07.223 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:26:06 smithi163 ceph-mon[96576]: pgmap v703: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-07-14T18:26:09.031 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:26:08 smithi172 ceph-mon[97983]: pgmap v704: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-07-14T18:26:09.180 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:26:08 smithi184 ceph-mon[98481]: pgmap v704: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-07-14T18:26:09.223 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:26:08 smithi163 ceph-mon[96576]: pgmap v704: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-07-14T18:26:11.031 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:26:10 smithi172 ceph-mon[97983]: pgmap v705: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-07-14T18:26:11.180 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:26:10 smithi184 ceph-mon[98481]: pgmap v705: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-07-14T18:26:11.223 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:26:10 smithi163 ceph-mon[96576]: pgmap v705: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-07-14T18:26:12.281 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:26:11 smithi172 ceph-mon[97983]: pgmap v706: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-07-14T18:26:12.430 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:26:11 smithi184 ceph-mon[98481]: pgmap v706: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-07-14T18:26:12.473 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:26:11 smithi163 ceph-mon[96576]: pgmap v706: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-07-14T18:26:12.515 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-07-14T18:26:12.660 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:26:12.613+0000 7f2ad8298700 1 -- 172.21.15.163:0/3339364000 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2ad00feb10 msgr2=0x7f2ad00fef20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:26:12.661 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:26:12.613+0000 7f2ad8298700 1 --2- 172.21.15.163:0/3339364000 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2ad00feb10 0x7f2ad00fef20 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f2acc009990 tx=0x7f2acc009ca0 comp rx=0 tx=0).stop 2023-07-14T18:26:12.661 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:26:12.614+0000 7f2ad8298700 1 -- 172.21.15.163:0/3339364000 shutdown_connections 2023-07-14T18:26:12.661 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:26:12.614+0000 7f2ad8298700 1 --2- 172.21.15.163:0/3339364000 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2ad00feb10 0x7f2ad00fef20 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:26:12.661 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:26:12.614+0000 7f2ad8298700 1 --2- 172.21.15.163:0/3339364000 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f2ad0100690 0x7f2ad0106f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:26:12.662 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:26:12.614+0000 7f2ad8298700 1 --2- 172.21.15.163:0/3339364000 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2ad00ffd00 0x7f2ad0100150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:26:12.662 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:26:12.614+0000 7f2ad8298700 1 -- 172.21.15.163:0/3339364000 >> 172.21.15.163:0/3339364000 conn(0x7f2ad00fa130 msgr2=0x7f2ad00fc560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:26:12.662 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:26:12.614+0000 7f2ad8298700 1 -- 172.21.15.163:0/3339364000 shutdown_connections 2023-07-14T18:26:12.662 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:26:12.614+0000 7f2ad8298700 1 -- 172.21.15.163:0/3339364000 wait complete. 2023-07-14T18:26:12.664 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:26:12.614+0000 7f2ad8298700 1 Processor -- start 2023-07-14T18:26:12.664 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:26:12.614+0000 7f2ad8298700 1 -- start start 2023-07-14T18:26:12.665 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:26:12.615+0000 7f2ad8298700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f2ad00feb10 0x7f2ad0069360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:26:12.665 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:26:12.615+0000 7f2ad8298700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2ad00ffd00 0x7f2ad019a5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:26:12.665 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:26:12.615+0000 7f2ad8298700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2ad0100690 0x7f2ad019cbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:26:12.665 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:26:12.615+0000 7f2ad8298700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ad019d3c0 con 0x7f2ad00feb10 2023-07-14T18:26:12.665 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:26:12.615+0000 7f2ad8298700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ad019d530 con 0x7f2ad00ffd00 2023-07-14T18:26:12.666 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:26:12.615+0000 7f2ad8298700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ad019d6f0 con 0x7f2ad0100690 2023-07-14T18:26:12.666 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:26:12.615+0000 7f2ad6034700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f2ad00feb10 0x7f2ad0069360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:26:12.666 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:26:12.615+0000 7f2ad6034700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f2ad00feb10 0x7f2ad0069360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:60412/0 (socket says 172.21.15.163:60412) 2023-07-14T18:26:12.666 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:26:12.615+0000 7f2ad6835700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2ad0100690 0x7f2ad019cbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:26:12.666 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:26:12.615+0000 7f2ad6034700 1 -- 172.21.15.163:0/4036579855 learned_addr learned my addr 172.21.15.163:0/4036579855 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:26:12.667 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:26:12.615+0000 7f2ad5833700 1 --2- 172.21.15.163:0/4036579855 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2ad00ffd00 0x7f2ad019a5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:26:12.667 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:26:12.615+0000 7f2ad6034700 1 -- 172.21.15.163:0/4036579855 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2ad0100690 msgr2=0x7f2ad019cbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:26:12.667 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:26:12.615+0000 7f2ad6034700 1 --2- 172.21.15.163:0/4036579855 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2ad0100690 0x7f2ad019cbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:26:12.667 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:26:12.615+0000 7f2ad6034700 1 -- 172.21.15.163:0/4036579855 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2ad00ffd00 msgr2=0x7f2ad019a5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:26:12.667 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:26:12.615+0000 7f2ad6034700 1 --2- 172.21.15.163:0/4036579855 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2ad00ffd00 0x7f2ad019a5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:26:12.668 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:26:12.615+0000 7f2ad6034700 1 -- 172.21.15.163:0/4036579855 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ac0009520 con 0x7f2ad00feb10 2023-07-14T18:26:12.668 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:26:12.615+0000 7f2ad6835700 1 --2- 172.21.15.163:0/4036579855 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2ad0100690 0x7f2ad019cbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T18:26:12.668 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:26:12.615+0000 7f2ad5833700 1 --2- 172.21.15.163:0/4036579855 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2ad00ffd00 0x7f2ad019a5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T18:26:12.668 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:26:12.615+0000 7f2ad6034700 1 --2- 172.21.15.163:0/4036579855 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f2ad00feb10 0x7f2ad0069360 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7f2acc003ec0 tx=0x7f2acc005740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:26:12.669 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:26:12.616+0000 7f2ac77fe700 1 -- 172.21.15.163:0/4036579855 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2acc01d070 con 0x7f2ad00feb10 2023-07-14T18:26:12.669 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:26:12.616+0000 7f2ad8298700 1 -- 172.21.15.163:0/4036579855 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ac8009c40 con 0x7f2ad00feb10 2023-07-14T18:26:12.669 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:26:12.616+0000 7f2ac77fe700 1 -- 172.21.15.163:0/4036579855 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f2acc00bdb0 con 0x7f2ad00feb10 2023-07-14T18:26:12.670 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:26:12.616+0000 7f2ac77fe700 1 -- 172.21.15.163:0/4036579855 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2acc022dd0 con 0x7f2ad00feb10 2023-07-14T18:26:12.670 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:26:12.616+0000 7f2ad8298700 1 -- 172.21.15.163:0/4036579855 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2acc0095f0 con 0x7f2ad00feb10 2023-07-14T18:26:12.677 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:26:12.618+0000 7f2ac77fe700 1 -- 172.21.15.163:0/4036579855 <== mon.0 v2:172.21.15.163:3300/0 4 ==== mgrmap(e 18) v1 ==== 135716+0+0 (secure 0 0 0) 0x7f2acc022570 con 0x7f2ad00feb10 2023-07-14T18:26:12.677 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:26:12.619+0000 7f2ac77fe700 1 --2- 172.21.15.163:0/4036579855 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f2abc0a1150 0x7f2abc0a3600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:26:12.677 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:26:12.619+0000 7f2ad5833700 1 --2- 172.21.15.163:0/4036579855 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f2abc0a1150 0x7f2abc0a3600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:26:12.677 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:26:12.619+0000 7f2ac77fe700 1 -- 172.21.15.163:0/4036579855 <== mon.0 v2:172.21.15.163:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 9049+0+0 (secure 0 0 0) 0x7f2acc0ce0a0 con 0x7f2ad00feb10 2023-07-14T18:26:12.678 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:26:12.619+0000 7f2ae4430b80 1 Processor -- start 2023-07-14T18:26:12.678 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:26:12.619+0000 7f2ad5833700 1 --2- 172.21.15.163:0/4036579855 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f2abc0a1150 0x7f2abc0a3600 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f2ac0009fd0 tx=0x7f2ac0009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:26:12.678 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:26:12.620+0000 7f2ae4430b80 1 -- start start 2023-07-14T18:26:12.679 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:26:12.620+0000 7f2ae4430b80 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55dc4b75bf60 0x55dc4b75c370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:26:12.679 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:26:12.620+0000 7f2ae4430b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55dc4b75c8b0 0x55dc4b75ced0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:26:12.679 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:26:12.620+0000 7f2ae4430b80 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55dc4b75d4b0 0x55dc4b75d920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:26:12.679 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:26:12.620+0000 7f2ae4430b80 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dc4b660cb0 con 0x55dc4b75d4b0 2023-07-14T18:26:12.679 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:26:12.620+0000 7f2ae4430b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dc4b6b3a40 con 0x55dc4b75c8b0 2023-07-14T18:26:12.680 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:26:12.620+0000 7f2ae4430b80 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dc4b6aced0 con 0x55dc4b75bf60 2023-07-14T18:26:12.680 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:26:12.620+0000 7f2ad6835700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55dc4b75d4b0 0x55dc4b75d920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:26:12.680 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:26:12.620+0000 7f2ad6034700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55dc4b75bf60 0x55dc4b75c370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:26:12.680 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:26:12.620+0000 7f2ad5833700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55dc4b75c8b0 0x55dc4b75ced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:26:12.680 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:26:12.620+0000 7f2ad6835700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55dc4b75d4b0 0x55dc4b75d920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:60424/0 (socket says 172.21.15.163:60424) 2023-07-14T18:26:12.681 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:26:12.620+0000 7f2ad5833700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55dc4b75c8b0 0x55dc4b75ced0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.163:32874/0 (socket says 172.21.15.163:32874) 2023-07-14T18:26:12.681 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:26:12.620+0000 7f2ad6835700 1 -- 172.21.15.163:0/2150066326 learned_addr learned my addr 172.21.15.163:0/2150066326 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:26:12.681 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:26:12.620+0000 7f2ad6034700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55dc4b75bf60 0x55dc4b75c370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.163:42242/0 (socket says 172.21.15.163:42242) 2023-07-14T18:26:12.681 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:26:12.620+0000 7f2ad5833700 1 -- 172.21.15.163:0/2150066326 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55dc4b75bf60 msgr2=0x55dc4b75c370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:26:12.681 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:26:12.620+0000 7f2ad5833700 1 --2- 172.21.15.163:0/2150066326 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55dc4b75bf60 0x55dc4b75c370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:26:12.682 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:26:12.620+0000 7f2ad5833700 1 -- 172.21.15.163:0/2150066326 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55dc4b75d4b0 msgr2=0x55dc4b75d920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:26:12.682 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:26:12.620+0000 7f2ad5833700 1 --2- 172.21.15.163:0/2150066326 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55dc4b75d4b0 0x55dc4b75d920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:26:12.682 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:26:12.620+0000 7f2ad5833700 1 -- 172.21.15.163:0/2150066326 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55dc4b4dade0 con 0x55dc4b75c8b0 2023-07-14T18:26:12.682 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:26:12.620+0000 7f2ad6835700 1 --2- 172.21.15.163:0/2150066326 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55dc4b75d4b0 0x55dc4b75d920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T18:26:12.682 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:26:12.620+0000 7f2ad5833700 1 --2- 172.21.15.163:0/2150066326 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55dc4b75c8b0 0x55dc4b75ced0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f2ac000e610 tx=0x7f2ac0014000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=173d65f9a2ee801c server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:26:12.683 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:26:12.621+0000 7f2ac4daa700 1 -- 172.21.15.163:0/2150066326 <== mon.2 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ac0026630 con 0x55dc4b75c8b0 2023-07-14T18:26:12.683 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:26:12.621+0000 7f2ac4daa700 1 -- 172.21.15.163:0/2150066326 <== mon.2 v2:172.21.15.172:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f2ac0021070 con 0x55dc4b75c8b0 2023-07-14T18:26:12.683 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:26:12.621+0000 7f2ac4daa700 1 -- 172.21.15.163:0/2150066326 <== mon.2 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ac001d5f0 con 0x55dc4b75c8b0 2023-07-14T18:26:12.683 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:26:12.622+0000 7f2ae4430b80 1 -- 172.21.15.163:0/2150066326 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55dc4b75c8b0 msgr2=0x55dc4b75ced0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:26:12.683 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:26:12.622+0000 7f2ae4430b80 1 --2- 172.21.15.163:0/2150066326 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55dc4b75c8b0 0x55dc4b75ced0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f2ac000e610 tx=0x7f2ac0014000 comp rx=0 tx=0).stop 2023-07-14T18:26:12.684 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:26:12.622+0000 7f2ae4430b80 1 -- 172.21.15.163:0/2150066326 shutdown_connections 2023-07-14T18:26:12.684 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:26:12.622+0000 7f2ae4430b80 1 --2- 172.21.15.163:0/2150066326 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55dc4b75bf60 0x55dc4b75c370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:26:12.684 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:26:12.622+0000 7f2ae4430b80 1 --2- 172.21.15.163:0/2150066326 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55dc4b75d4b0 0x55dc4b75d920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:26:12.684 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:26:12.622+0000 7f2ae4430b80 1 --2- 172.21.15.163:0/2150066326 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55dc4b75c8b0 0x55dc4b75ced0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:26:12.685 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:26:12.622+0000 7f2ae4430b80 1 -- 172.21.15.163:0/2150066326 >> 172.21.15.163:0/2150066326 conn(0x55dc4b751680 msgr2=0x55dc4b7569d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:26:12.685 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:26:12.622+0000 7f2ae4430b80 1 -- 172.21.15.163:0/2150066326 shutdown_connections 2023-07-14T18:26:12.685 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:26:12.622+0000 7f2ae4430b80 1 -- 172.21.15.163:0/2150066326 wait complete. 2023-07-14T18:26:12.685 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:26:12.622+0000 7f2ae4430b80 1 -- start start 2023-07-14T18:26:12.685 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:26:12.622+0000 7f2ae4430b80 1 Processor -- start 2023-07-14T18:26:12.685 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:26:12.622+0000 7f2ae4430b80 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55dc4b75bf60 0x55dc4b765960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:26:12.686 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:26:12.622+0000 7f2ae4430b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55dc4b75c8b0 0x55dc4b765ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:26:12.686 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:26:12.622+0000 7f2ae4430b80 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55dc4b75d4b0 0x55dc4b76cee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:26:12.686 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:26:12.622+0000 7f2ae4430b80 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dc4b64cac0 con 0x55dc4b75bf60 2023-07-14T18:26:12.686 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:26:12.622+0000 7f2ae4430b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dc4b64c7c0 con 0x55dc4b75c8b0 2023-07-14T18:26:12.686 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:26:12.622+0000 7f2ae4430b80 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dc4b530920 con 0x55dc4b75d4b0 2023-07-14T18:26:12.687 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:26:12.622+0000 7f2ae4430b80 10 client.0 _ll_register_callbacks cb 0x55dc4b64a760 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T18:26:12.687 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:26:12.623+0000 7f2ad6034700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55dc4b75bf60 0x55dc4b765960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:26:12.687 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:26:12.623+0000 7f2ad5833700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55dc4b75c8b0 0x55dc4b765ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:26:12.687 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:26:12.623+0000 7f2ad6835700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55dc4b75d4b0 0x55dc4b76cee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:26:12.687 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:26:12.623+0000 7f2ad6034700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55dc4b75bf60 0x55dc4b765960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:60426/0 (socket says 172.21.15.163:60426) 2023-07-14T18:26:12.688 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:26:12.623+0000 7f2ad6034700 1 -- 172.21.15.163:0/948904581 learned_addr learned my addr 172.21.15.163:0/948904581 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:26:12.688 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:26:12.623+0000 7f2ad5833700 1 -- 172.21.15.163:0/948904581 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55dc4b75d4b0 msgr2=0x55dc4b76cee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:26:12.688 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:26:12.623+0000 7f2ad5833700 1 --2- 172.21.15.163:0/948904581 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55dc4b75d4b0 0x55dc4b76cee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:26:12.688 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:26:12.623+0000 7f2ad5833700 1 -- 172.21.15.163:0/948904581 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55dc4b75bf60 msgr2=0x55dc4b765960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:26:12.688 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:26:12.623+0000 7f2ad5833700 1 --2- 172.21.15.163:0/948904581 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55dc4b75bf60 0x55dc4b765960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:26:12.689 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:26:12.623+0000 7f2ad5833700 1 -- 172.21.15.163:0/948904581 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ac8009260 con 0x55dc4b75c8b0 2023-07-14T18:26:12.689 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:26:12.623+0000 7f2ad6034700 1 --2- 172.21.15.163:0/948904581 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55dc4b75bf60 0x55dc4b765960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T18:26:12.689 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:26:12.623+0000 7f2ad6835700 1 --2- 172.21.15.163:0/948904581 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55dc4b75d4b0 0x55dc4b76cee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T18:26:12.689 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:26:12.623+0000 7f2ad5833700 1 --2- 172.21.15.163:0/948904581 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55dc4b75c8b0 0x55dc4b765ea0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f2ac001cc90 tx=0x7f2ac001cfa0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f1c13c30c3ac4348 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:26:12.689 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:26:12.623+0000 7f2ab9ffb700 10 client.0 ms_handle_connect on v2:172.21.15.172:3300/0 2023-07-14T18:26:12.690 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:26:12.623+0000 7f2ab9ffb700 1 -- 172.21.15.163:0/948904581 <== mon.2 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ac00051c0 con 0x55dc4b75c8b0 2023-07-14T18:26:12.690 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:26:12.623+0000 7f2ab9ffb700 1 -- 172.21.15.163:0/948904581 <== mon.2 v2:172.21.15.172:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 9049+0+0 (secure 0 0 0) 0x7f2ac0005320 con 0x55dc4b75c8b0 2023-07-14T18:26:12.690 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:26:12.623+0000 7f2ae4430b80 1 -- 172.21.15.163:0/948904581 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55dc4b6064f0 con 0x55dc4b75c8b0 2023-07-14T18:26:12.690 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:26:12.623+0000 7f2ab9ffb700 1 -- 172.21.15.163:0/948904581 <== mon.2 v2:172.21.15.172:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2ac00054e0 con 0x55dc4b75c8b0 2023-07-14T18:26:12.690 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:26:12.623+0000 7f2ae4430b80 10 client.26282 fetch_fsmap learned FSMap version 39 2023-07-14T18:26:12.691 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:26:12.623+0000 7f2ae4430b80 1 -- 172.21.15.163:0/948904581 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) v3 -- 0x7f2ac0017050 con 0x55dc4b75c8b0 2023-07-14T18:26:12.691 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:26:12.624+0000 7f2ab9ffb700 1 -- 172.21.15.163:0/948904581 <== mon.2 v2:172.21.15.172:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55dc4b6064f0 con 0x55dc4b75c8b0 2023-07-14T18:26:12.691 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:26:12.624+0000 7f2ab9ffb700 1 -- 172.21.15.163:0/948904581 <== mon.2 v2:172.21.15.172:3300/0 5 ==== fsmap(e 39) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f2ac0004960 con 0x55dc4b75c8b0 2023-07-14T18:26:12.691 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:26:12.624+0000 7f2ae4430b80 10 client.26282 fetch_fsmap finished waiting for FSMap version 39 2023-07-14T18:26:12.691 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:26:12.624+0000 7f2ae4430b80 10 client.26282 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-07-14T18:26:12.691 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:26:12.624+0000 7f2ae4430b80 20 client.26282 populate_metadata read hostname 'smithi163' 2023-07-14T18:26:12.692 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:26:12.624+0000 7f2ae4430b80 1 --2- 172.21.15.163:0/948904581 >> [v2:172.21.15.172:6838/3850440096,v1:172.21.15.172:6839/3850440096] conn(0x55dc4b7715c0 0x55dc4b7739d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:26:12.692 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:26:12.624+0000 7f2ae4430b80 4 client.26282 mds_command: new command op to 24518 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-14T18:26:12.692 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:26:12.624+0000 7f2ae4430b80 1 -- 172.21.15.163:0/948904581 --> [v2:172.21.15.172:6838/3850440096,v1:172.21.15.172:6839/3850440096] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55dc4b72ada0 con 0x55dc4b7715c0 2023-07-14T18:26:12.692 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:26:12.624+0000 7f2ad6034700 1 --2- 172.21.15.163:0/948904581 >> [v2:172.21.15.172:6838/3850440096,v1:172.21.15.172:6839/3850440096] conn(0x55dc4b7715c0 0x55dc4b7739d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:26:12.693 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:26:12.624+0000 7f2ab9ffb700 10 client.26282 ms_handle_connect on v2:172.21.15.172:6838/3850440096 2023-07-14T18:26:12.693 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:26:12.624+0000 7f2ad6034700 1 --2- 172.21.15.163:0/948904581 >> [v2:172.21.15.172:6838/3850440096,v1:172.21.15.172:6839/3850440096] conn(0x55dc4b7715c0 0x55dc4b7739d0 crc :-1 s=READY pgs=111 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=94936f0ce47424b4 server_cookie=abb344235db29a13 in_seq=0 out_seq=0 2023-07-14T18:26:12.693 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:26:12.625+0000 7f2ab9ffb700 1 -- 172.21.15.163:0/948904581 <== mds.0 v2:172.21.15.172:6838/3850440096 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18017 (crc 0 0 0) 0x55dc4b72ada0 con 0x55dc4b7715c0 2023-07-14T18:26:12.693 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:26:12.625+0000 7f2ab9ffb700 10 client.26282 handle_command_reply: tid=0 2023-07-14T18:26:12.693 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:26:12.625+0000 7f2ae4430b80 1 client.26282 shutdown 2023-07-14T18:26:12.694 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:26:12.625+0000 7f2ae4430b80 1 -- 172.21.15.163:0/948904581 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55dc4b75c8b0 msgr2=0x55dc4b765ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:26:12.694 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:26:12.625+0000 7f2ae4430b80 1 --2- 172.21.15.163:0/948904581 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55dc4b75c8b0 0x55dc4b765ea0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f2ac001cc90 tx=0x7f2ac001cfa0 comp rx=0 tx=0).stop 2023-07-14T18:26:12.694 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:26:12.625+0000 7f2ae4430b80 1 -- 172.21.15.163:0/948904581 shutdown_connections 2023-07-14T18:26:12.694 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:26:12.625+0000 7f2ae4430b80 1 --2- 172.21.15.163:0/948904581 >> [v2:172.21.15.172:6838/3850440096,v1:172.21.15.172:6839/3850440096] conn(0x55dc4b7715c0 0x55dc4b7739d0 crc :-1 s=READY pgs=111 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:26:12.694 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:26:12.625+0000 7f2ae4430b80 1 --2- 172.21.15.163:0/948904581 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55dc4b75d4b0 0x55dc4b76cee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:26:12.695 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:26:12.625+0000 7f2ae4430b80 1 --2- 172.21.15.163:0/948904581 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55dc4b75bf60 0x55dc4b765960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:26:12.695 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:26:12.625+0000 7f2ab9ffb700 0 client.26282 ms_handle_reset on v2:172.21.15.172:6838/3850440096 2023-07-14T18:26:12.695 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:26:12.625+0000 7f2ae4430b80 1 --2- 172.21.15.163:0/948904581 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55dc4b75c8b0 0x55dc4b765ea0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:26:12.695 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:26:12.625+0000 7f2ae4430b80 1 -- 172.21.15.163:0/948904581 >> 172.21.15.163:0/948904581 conn(0x55dc4b751680 msgr2=0x55dc4b755650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:26:12.695 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:26:12.625+0000 7f2ae4430b80 1 -- 172.21.15.163:0/948904581 shutdown_connections 2023-07-14T18:26:12.695 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:26:12.625+0000 7f2ae4430b80 1 -- 172.21.15.163:0/948904581 wait complete. 2023-07-14T18:26:12.696 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:26:12.625+0000 7f2ae4430b80 20 client.26282 trim_cache size 0 max 16384 2023-07-14T18:26:12.700 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:26:12.646+0000 7f2ae4430b80 1 Processor -- start 2023-07-14T18:26:12.700 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:26:12.646+0000 7f2ae4430b80 1 -- start start 2023-07-14T18:26:12.701 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:26:12.646+0000 7f2ae4430b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55dc4b75bf60 0x55dc4b7638d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:26:12.701 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:26:12.646+0000 7f2ae4430b80 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55dc4b75c8b0 0x55dc4b76cea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:26:12.701 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:26:12.646+0000 7f2ae4430b80 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55dc4b75d4b0 0x55dc4b760400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:26:12.701 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:26:12.646+0000 7f2ae4430b80 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dc4b757cc0 con 0x55dc4b75d4b0 2023-07-14T18:26:12.702 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:26:12.646+0000 7f2ae4430b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dc4b771390 con 0x55dc4b75bf60 2023-07-14T18:26:12.702 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:26:12.646+0000 7f2ae4430b80 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dc4b74e9f0 con 0x55dc4b75c8b0 2023-07-14T18:26:12.702 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:26:12.646+0000 7f2ad6835700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55dc4b75d4b0 0x55dc4b760400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:26:12.702 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:26:12.646+0000 7f2ad5833700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55dc4b75c8b0 0x55dc4b76cea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:26:12.702 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:26:12.646+0000 7f2ad6034700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55dc4b75bf60 0x55dc4b7638d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:26:12.703 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:26:12.646+0000 7f2ad6835700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55dc4b75d4b0 0x55dc4b760400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:60438/0 (socket says 172.21.15.163:60438) 2023-07-14T18:26:12.703 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:26:12.646+0000 7f2ad6835700 1 -- 172.21.15.163:0/1845653939 learned_addr learned my addr 172.21.15.163:0/1845653939 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:26:12.703 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:26:12.647+0000 7f2ad6034700 1 -- 172.21.15.163:0/1845653939 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55dc4b75c8b0 msgr2=0x55dc4b76cea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:26:12.703 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:26:12.647+0000 7f2ad6034700 1 --2- 172.21.15.163:0/1845653939 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55dc4b75c8b0 0x55dc4b76cea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:26:12.703 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:26:12.647+0000 7f2ad6034700 1 -- 172.21.15.163:0/1845653939 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55dc4b75d4b0 msgr2=0x55dc4b760400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:26:12.704 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:26:12.647+0000 7f2ad6034700 1 --2- 172.21.15.163:0/1845653939 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55dc4b75d4b0 0x55dc4b760400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:26:12.704 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:26:12.647+0000 7f2ad6034700 1 -- 172.21.15.163:0/1845653939 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55dc4b4c3c60 con 0x55dc4b75bf60 2023-07-14T18:26:12.704 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:26:12.647+0000 7f2ad6034700 1 --2- 172.21.15.163:0/1845653939 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55dc4b75bf60 0x55dc4b7638d0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f2acc003f60 tx=0x7f2acc0a1040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5b061d1a70aa5d20 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:26:12.704 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:26:12.647+0000 7f2ac55ab700 1 -- 172.21.15.163:0/1845653939 <== mon.2 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2acc0a1130 con 0x55dc4b75bf60 2023-07-14T18:26:12.705 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:26:12.647+0000 7f2ac55ab700 1 -- 172.21.15.163:0/1845653939 <== mon.2 v2:172.21.15.172:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f2acc09b210 con 0x55dc4b75bf60 2023-07-14T18:26:12.705 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:26:12.647+0000 7f2ac55ab700 1 -- 172.21.15.163:0/1845653939 <== mon.2 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2acc0a33a0 con 0x55dc4b75bf60 2023-07-14T18:26:12.705 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:26:12.648+0000 7f2ae4430b80 1 -- 172.21.15.163:0/1845653939 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55dc4b75bf60 msgr2=0x55dc4b7638d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:26:12.705 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:26:12.648+0000 7f2ae4430b80 1 --2- 172.21.15.163:0/1845653939 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55dc4b75bf60 0x55dc4b7638d0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f2acc003f60 tx=0x7f2acc0a1040 comp rx=0 tx=0).stop 2023-07-14T18:26:12.705 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:26:12.648+0000 7f2ae4430b80 1 -- 172.21.15.163:0/1845653939 shutdown_connections 2023-07-14T18:26:12.706 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:26:12.648+0000 7f2ae4430b80 1 --2- 172.21.15.163:0/1845653939 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55dc4b75d4b0 0x55dc4b760400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:26:12.706 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:26:12.648+0000 7f2ae4430b80 1 --2- 172.21.15.163:0/1845653939 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55dc4b75bf60 0x55dc4b7638d0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:26:12.706 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:26:12.648+0000 7f2ae4430b80 1 --2- 172.21.15.163:0/1845653939 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55dc4b75c8b0 0x55dc4b76cea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:26:12.706 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:26:12.648+0000 7f2ae4430b80 1 -- 172.21.15.163:0/1845653939 >> 172.21.15.163:0/1845653939 conn(0x55dc4b751680 msgr2=0x55dc4b764670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:26:12.706 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:26:12.648+0000 7f2ae4430b80 1 -- 172.21.15.163:0/1845653939 shutdown_connections 2023-07-14T18:26:12.707 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:26:12.648+0000 7f2ae4430b80 1 -- 172.21.15.163:0/1845653939 wait complete. 2023-07-14T18:26:12.707 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:26:12.648+0000 7f2ae4430b80 1 -- start start 2023-07-14T18:26:12.707 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:26:12.648+0000 7f2ae4430b80 1 Processor -- start 2023-07-14T18:26:12.707 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:26:12.649+0000 7f2ae4430b80 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55dc4b75bf60 0x55dc4b76c980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:26:12.707 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:26:12.649+0000 7f2ae4430b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55dc4b75c8b0 0x55dc4b76cec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:26:12.708 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:26:12.649+0000 7f2ae4430b80 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55dc4b75d4b0 0x55dc4b76b080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:26:12.708 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:26:12.649+0000 7f2ae4430b80 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dc4b76b790 con 0x55dc4b75d4b0 2023-07-14T18:26:12.708 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:26:12.649+0000 7f2ae4430b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dc4b76b900 con 0x55dc4b75c8b0 2023-07-14T18:26:12.708 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:26:12.649+0000 7f2ae4430b80 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dc4b76bac0 con 0x55dc4b75bf60 2023-07-14T18:26:12.709 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:26:12.649+0000 7f2ae4430b80 10 client.0 _ll_register_callbacks cb 0x7f2ac8009050 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T18:26:12.709 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:26:12.649+0000 7f2ad6034700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55dc4b75bf60 0x55dc4b76c980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:26:12.709 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:26:12.649+0000 7f2ad5833700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55dc4b75c8b0 0x55dc4b76cec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:26:12.709 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:26:12.649+0000 7f2ad6034700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55dc4b75bf60 0x55dc4b76c980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.163:42262/0 (socket says 172.21.15.163:42262) 2023-07-14T18:26:12.709 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:26:12.649+0000 7f2ad6034700 1 -- 172.21.15.163:0/943773282 learned_addr learned my addr 172.21.15.163:0/943773282 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:26:12.710 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:26:12.649+0000 7f2ad6835700 1 --2- 172.21.15.163:0/943773282 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55dc4b75d4b0 0x55dc4b76b080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:26:12.710 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:26:12.649+0000 7f2ad6034700 1 -- 172.21.15.163:0/943773282 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55dc4b75c8b0 msgr2=0x55dc4b76cec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:26:12.710 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:26:12.649+0000 7f2ad6034700 1 --2- 172.21.15.163:0/943773282 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55dc4b75c8b0 0x55dc4b76cec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:26:12.710 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:26:12.649+0000 7f2ad6034700 1 -- 172.21.15.163:0/943773282 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55dc4b75d4b0 msgr2=0x55dc4b76b080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:26:12.710 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:26:12.649+0000 7f2ad6034700 1 --2- 172.21.15.163:0/943773282 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55dc4b75d4b0 0x55dc4b76b080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:26:12.711 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:26:12.649+0000 7f2ad6034700 1 -- 172.21.15.163:0/943773282 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2acc0095f0 con 0x55dc4b75bf60 2023-07-14T18:26:12.711 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:26:12.649+0000 7f2ad6034700 1 --2- 172.21.15.163:0/943773282 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55dc4b75bf60 0x55dc4b76c980 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f2acc09b150 tx=0x7f2acc009310 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e2605e5ac0275000 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:26:12.711 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:26:12.649+0000 7f2ab9ffb700 10 client.0 ms_handle_connect on v2:172.21.15.184:3300/0 2023-07-14T18:26:12.711 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:26:12.649+0000 7f2ab9ffb700 1 -- 172.21.15.163:0/943773282 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2acc0a1130 con 0x55dc4b75bf60 2023-07-14T18:26:12.711 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:26:12.649+0000 7f2ae4430b80 1 -- 172.21.15.163:0/943773282 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f2ac0021070 con 0x55dc4b75bf60 2023-07-14T18:26:12.711 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:26:12.649+0000 7f2ab9ffb700 1 -- 172.21.15.163:0/943773282 <== mon.1 v2:172.21.15.184:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 9049+0+0 (secure 0 0 0) 0x7f2acc09f240 con 0x55dc4b75bf60 2023-07-14T18:26:12.712 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:26:12.650+0000 7f2ab9ffb700 1 -- 172.21.15.163:0/943773282 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2acc0a35d0 con 0x55dc4b75bf60 2023-07-14T18:26:12.712 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:26:12.650+0000 7f2ae4430b80 10 client.26230 fetch_fsmap learned FSMap version 39 2023-07-14T18:26:12.712 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:26:12.650+0000 7f2ae4430b80 1 -- 172.21.15.163:0/943773282 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) v3 -- 0x55dc4b501250 con 0x55dc4b75bf60 2023-07-14T18:26:12.712 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:26:12.650+0000 7f2ab9ffb700 1 -- 172.21.15.163:0/943773282 <== mon.1 v2:172.21.15.184:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f2acc062080 con 0x55dc4b75bf60 2023-07-14T18:26:12.712 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:26:12.650+0000 7f2ab9ffb700 1 -- 172.21.15.163:0/943773282 <== mon.1 v2:172.21.15.184:3300/0 5 ==== fsmap(e 39) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f2acc0c7d20 con 0x55dc4b75bf60 2023-07-14T18:26:12.713 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:26:12.650+0000 7f2ae4430b80 10 client.26230 fetch_fsmap finished waiting for FSMap version 39 2023-07-14T18:26:12.713 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:26:12.650+0000 7f2ae4430b80 10 client.26230 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-07-14T18:26:12.713 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:26:12.650+0000 7f2ae4430b80 20 client.26230 populate_metadata read hostname 'smithi163' 2023-07-14T18:26:12.713 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:26:12.650+0000 7f2ae4430b80 1 --2- 172.21.15.163:0/943773282 >> [v2:172.21.15.172:6838/3850440096,v1:172.21.15.172:6839/3850440096] conn(0x55dc4b7715c0 0x55dc4b7c83a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:26:12.714 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:26:12.650+0000 7f2ae4430b80 4 client.26230 mds_command: new command op to 24518 tid=0[{"prefix": "scrub status"}] 2023-07-14T18:26:12.714 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:26:12.650+0000 7f2ae4430b80 1 -- 172.21.15.163:0/943773282 --> [v2:172.21.15.172:6838/3850440096,v1:172.21.15.172:6839/3850440096] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55dc4b6a5eb0 con 0x55dc4b7715c0 2023-07-14T18:26:12.715 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:26:12.650+0000 7f2ad5833700 1 --2- 172.21.15.163:0/943773282 >> [v2:172.21.15.172:6838/3850440096,v1:172.21.15.172:6839/3850440096] conn(0x55dc4b7715c0 0x55dc4b7c83a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:26:12.715 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:26:12.651+0000 7f2ab9ffb700 10 client.26230 ms_handle_connect on v2:172.21.15.172:6838/3850440096 2023-07-14T18:26:12.715 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:26:12.651+0000 7f2ad5833700 1 --2- 172.21.15.163:0/943773282 >> [v2:172.21.15.172:6838/3850440096,v1:172.21.15.172:6839/3850440096] conn(0x55dc4b7715c0 0x55dc4b7c83a0 crc :-1 s=READY pgs=112 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3e61c2d28ef50d48 server_cookie=6b8a4c0edaeab56 in_seq=0 out_seq=0 2023-07-14T18:26:12.716 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:26:12.651+0000 7f2ab9ffb700 1 -- 172.21.15.163:0/943773282 <== mds.0 v2:172.21.15.172:6838/3850440096 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x55dc4b6a5eb0 con 0x55dc4b7715c0 2023-07-14T18:26:12.716 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:26:12.651+0000 7f2ab9ffb700 10 client.26230 handle_command_reply: tid=0 2023-07-14T18:26:12.716 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:26:12.651+0000 7f2ae4430b80 1 client.26230 shutdown 2023-07-14T18:26:12.716 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:26:12.651+0000 7f2ae4430b80 1 -- 172.21.15.163:0/943773282 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55dc4b75bf60 msgr2=0x55dc4b76c980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:26:12.717 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:26:12.651+0000 7f2ae4430b80 1 --2- 172.21.15.163:0/943773282 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55dc4b75bf60 0x55dc4b76c980 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f2acc09b150 tx=0x7f2acc009310 comp rx=0 tx=0).stop 2023-07-14T18:26:12.717 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:26:12.651+0000 7f2ae4430b80 1 -- 172.21.15.163:0/943773282 shutdown_connections 2023-07-14T18:26:12.717 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:26:12.651+0000 7f2ae4430b80 1 --2- 172.21.15.163:0/943773282 >> [v2:172.21.15.172:6838/3850440096,v1:172.21.15.172:6839/3850440096] conn(0x55dc4b7715c0 0x55dc4b7c83a0 crc :-1 s=READY pgs=112 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:26:12.717 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:26:12.651+0000 7f2ae4430b80 1 --2- 172.21.15.163:0/943773282 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55dc4b75bf60 0x55dc4b76c980 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:26:12.718 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:26:12.651+0000 7f2ae4430b80 1 --2- 172.21.15.163:0/943773282 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55dc4b75d4b0 0x55dc4b76b080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:26:12.718 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:26:12.651+0000 7f2ab9ffb700 0 client.26230 ms_handle_reset on v2:172.21.15.172:6838/3850440096 2023-07-14T18:26:12.718 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:26:12.651+0000 7f2ae4430b80 1 --2- 172.21.15.163:0/943773282 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55dc4b75c8b0 0x55dc4b76cec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:26:12.718 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:26:12.651+0000 7f2ae4430b80 1 -- 172.21.15.163:0/943773282 >> 172.21.15.163:0/943773282 conn(0x55dc4b751680 msgr2=0x55dc4b7638d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:26:12.718 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:26:12.651+0000 7f2ae4430b80 1 -- 172.21.15.163:0/943773282 shutdown_connections 2023-07-14T18:26:12.719 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:26:12.651+0000 7f2ae4430b80 1 -- 172.21.15.163:0/943773282 wait complete. 2023-07-14T18:26:12.719 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:26:12.651+0000 7f2ae4430b80 20 client.26230 trim_cache size 0 max 16384 2023-07-14T18:26:12.719 INFO:teuthology.orchestra.run.smithi163.stdout:{ 2023-07-14T18:26:12.720 INFO:teuthology.orchestra.run.smithi163.stdout: "status": "IDLE (waiting for more scrubs)", 2023-07-14T18:26:12.720 INFO:teuthology.orchestra.run.smithi163.stdout: "scrubs": { 2023-07-14T18:26:12.720 INFO:teuthology.orchestra.run.smithi163.stdout: "2c53b7ef-6f30-49f0-a60d-f1f114c19d42": { 2023-07-14T18:26:12.721 INFO:teuthology.orchestra.run.smithi163.stdout: "path": "/", 2023-07-14T18:26:12.721 INFO:teuthology.orchestra.run.smithi163.stdout: "tag": "2c53b7ef-6f30-49f0-a60d-f1f114c19d42", 2023-07-14T18:26:12.721 INFO:teuthology.orchestra.run.smithi163.stdout: "options": "recursive,force" 2023-07-14T18:26:12.721 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-07-14T18:26:12.721 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-07-14T18:26:12.722 INFO:teuthology.orchestra.run.smithi163.stdout:} 2023-07-14T18:26:12.724 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:26:12.652+0000 7f2ad8298700 1 -- 172.21.15.163:0/4036579855 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f2abc0a1150 msgr2=0x7f2abc0a3600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:26:12.725 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:26:12.652+0000 7f2ad8298700 1 --2- 172.21.15.163:0/4036579855 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f2abc0a1150 0x7f2abc0a3600 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f2ac0009fd0 tx=0x7f2ac0009260 comp rx=0 tx=0).stop 2023-07-14T18:26:12.725 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:26:12.652+0000 7f2ad8298700 1 -- 172.21.15.163:0/4036579855 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f2ad00feb10 msgr2=0x7f2ad0069360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:26:12.726 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:26:12.652+0000 7f2ad8298700 1 --2- 172.21.15.163:0/4036579855 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f2ad00feb10 0x7f2ad0069360 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7f2acc003ec0 tx=0x7f2acc005740 comp rx=0 tx=0).stop 2023-07-14T18:26:12.726 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:26:12.652+0000 7f2ad8298700 1 -- 172.21.15.163:0/4036579855 shutdown_connections 2023-07-14T18:26:12.726 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:26:12.652+0000 7f2ad8298700 1 --2- 172.21.15.163:0/4036579855 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f2abc0a1150 0x7f2abc0a3600 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:26:12.726 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:26:12.652+0000 7f2ad8298700 1 --2- 172.21.15.163:0/4036579855 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2ad0100690 0x7f2ad019cbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:26:12.727 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:26:12.652+0000 7f2ad8298700 1 --2- 172.21.15.163:0/4036579855 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f2ad00feb10 0x7f2ad0069360 unknown :-1 s=CLOSED pgs=739 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:26:12.727 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:26:12.652+0000 7f2ad8298700 1 --2- 172.21.15.163:0/4036579855 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2ad00ffd00 0x7f2ad019a5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:26:12.727 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:26:12.652+0000 7f2ad8298700 1 -- 172.21.15.163:0/4036579855 >> 172.21.15.163:0/4036579855 conn(0x7f2ad00fa130 msgr2=0x7f2ad00fc450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:26:12.727 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:26:12.652+0000 7f2ad8298700 1 -- 172.21.15.163:0/4036579855 shutdown_connections 2023-07-14T18:26:12.727 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:26:12.652+0000 7f2ad8298700 1 -- 172.21.15.163:0/4036579855 wait complete. 2023-07-14T18:26:12.728 INFO:tasks.cephfs.filesystem:scrub status for tag:2c53b7ef-6f30-49f0-a60d-f1f114c19d42 - {'path': '/', 'tag': '2c53b7ef-6f30-49f0-a60d-f1f114c19d42', 'options': 'recursive,force'} 2023-07-14T18:26:15.031 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:26:14 smithi172 ceph-mon[97983]: pgmap v707: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-07-14T18:26:15.180 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:26:14 smithi184 ceph-mon[98481]: pgmap v707: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-07-14T18:26:15.222 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:26:14 smithi163 ceph-mon[96576]: pgmap v707: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-07-14T18:26:17.031 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:26:16 smithi172 ceph-mon[97983]: pgmap v708: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-07-14T18:26:17.180 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:26:16 smithi184 ceph-mon[98481]: pgmap v708: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-07-14T18:26:17.222 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:26:16 smithi163 ceph-mon[96576]: pgmap v708: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-07-14T18:26:19.031 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:26:18 smithi172 ceph-mon[97983]: pgmap v709: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-07-14T18:26:19.180 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:26:18 smithi184 ceph-mon[98481]: pgmap v709: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-07-14T18:26:19.222 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:26:18 smithi163 ceph-mon[96576]: pgmap v709: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-07-14T18:26:21.030 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:26:20 smithi172 ceph-mon[97983]: pgmap v710: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-07-14T18:26:21.180 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:26:20 smithi184 ceph-mon[98481]: pgmap v710: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-07-14T18:26:21.222 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:26:20 smithi163 ceph-mon[96576]: pgmap v710: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-07-14T18:26:22.280 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:26:21 smithi172 ceph-mon[97983]: pgmap v711: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-07-14T18:26:22.429 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:26:21 smithi184 ceph-mon[98481]: pgmap v711: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-07-14T18:26:22.472 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:26:21 smithi163 ceph-mon[96576]: pgmap v711: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-07-14T18:26:25.030 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:26:24 smithi172 ceph-mon[97983]: pgmap v712: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-07-14T18:26:25.179 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:26:24 smithi184 ceph-mon[98481]: pgmap v712: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-07-14T18:26:25.222 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:26:24 smithi163 ceph-mon[96576]: pgmap v712: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-07-14T18:26:27.030 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:26:26 smithi172 ceph-mon[97983]: pgmap v713: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-07-14T18:26:27.179 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:26:26 smithi184 ceph-mon[98481]: pgmap v713: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-07-14T18:26:27.221 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:26:26 smithi163 ceph-mon[96576]: pgmap v713: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-07-14T18:26:29.030 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:26:28 smithi172 ceph-mon[97983]: pgmap v714: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-07-14T18:26:29.179 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:26:28 smithi184 ceph-mon[98481]: pgmap v714: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-07-14T18:26:29.221 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:26:28 smithi163 ceph-mon[96576]: pgmap v714: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-07-14T18:26:31.030 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:26:30 smithi172 ceph-mon[97983]: pgmap v715: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-07-14T18:26:31.179 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:26:30 smithi184 ceph-mon[98481]: pgmap v715: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-07-14T18:26:31.221 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:26:30 smithi163 ceph-mon[96576]: pgmap v715: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-07-14T18:26:32.279 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:26:31 smithi172 ceph-mon[97983]: pgmap v716: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-07-14T18:26:32.429 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:26:31 smithi184 ceph-mon[98481]: pgmap v716: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-07-14T18:26:32.471 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:26:31 smithi163 ceph-mon[96576]: pgmap v716: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-07-14T18:26:35.030 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:26:34 smithi172 ceph-mon[97983]: pgmap v717: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-07-14T18:26:35.178 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:26:34 smithi184 ceph-mon[98481]: pgmap v717: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-07-14T18:26:35.221 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:26:34 smithi163 ceph-mon[96576]: pgmap v717: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-07-14T18:26:36.029 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:26:35 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-14T18:26:36.030 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:26:35 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:26:36.030 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:26:35 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:26:36.030 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:26:35 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:26:36.030 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:26:35 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:26:36.178 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:26:35 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-14T18:26:36.179 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:26:35 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:26:36.179 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:26:35 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:26:36.179 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:26:35 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:26:36.180 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:26:35 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:26:36.221 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:26:35 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-14T18:26:36.221 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:26:35 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:26:36.221 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:26:35 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:26:36.222 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:26:35 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:26:36.222 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:26:35 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:26:37.029 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:26:36 smithi172 ceph-mon[97983]: pgmap v718: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-07-14T18:26:37.029 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:26:36 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T18:26:37.030 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:26:36 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-14T18:26:37.030 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:26:36 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:26:37.178 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:26:36 smithi184 ceph-mon[98481]: pgmap v718: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-07-14T18:26:37.179 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:26:36 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T18:26:37.179 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:26:36 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-14T18:26:37.179 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:26:36 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:26:37.221 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:26:36 smithi163 ceph-mon[96576]: pgmap v718: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-07-14T18:26:37.221 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:26:36 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T18:26:37.221 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:26:36 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-14T18:26:37.222 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:26:36 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:26:39.029 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:26:38 smithi172 ceph-mon[97983]: pgmap v719: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-07-14T18:26:39.178 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:26:38 smithi184 ceph-mon[98481]: pgmap v719: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-07-14T18:26:39.221 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:26:38 smithi163 ceph-mon[96576]: pgmap v719: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-07-14T18:26:41.029 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:26:40 smithi172 ceph-mon[97983]: pgmap v720: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-07-14T18:26:41.178 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:26:40 smithi184 ceph-mon[98481]: pgmap v720: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-07-14T18:26:41.220 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:26:40 smithi163 ceph-mon[96576]: pgmap v720: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-07-14T18:26:42.279 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:26:41 smithi172 ceph-mon[97983]: pgmap v721: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-07-14T18:26:42.428 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:26:41 smithi184 ceph-mon[98481]: pgmap v721: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-07-14T18:26:42.470 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:26:41 smithi163 ceph-mon[96576]: pgmap v721: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-07-14T18:26:42.729 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-07-14T18:26:42.874 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:26:42.831+0000 7f053079d700 1 -- 172.21.15.163:0/3554910568 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f0528100e70 msgr2=0x7f05281012c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:26:42.874 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:26:42.831+0000 7f053079d700 1 --2- 172.21.15.163:0/3554910568 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f0528100e70 0x7f05281012c0 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7f0518009990 tx=0x7f0518009ca0 comp rx=0 tx=0).stop 2023-07-14T18:26:42.875 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:26:42.831+0000 7f053079d700 1 -- 172.21.15.163:0/3554910568 shutdown_connections 2023-07-14T18:26:42.875 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:26:42.831+0000 7f053079d700 1 --2- 172.21.15.163:0/3554910568 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0528101800 0x7f05281080c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:26:42.875 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:26:42.831+0000 7f053079d700 1 --2- 172.21.15.163:0/3554910568 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f05280ffc80 0x7f0528100090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:26:42.875 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:26:42.831+0000 7f053079d700 1 --2- 172.21.15.163:0/3554910568 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f0528100e70 0x7f05281012c0 unknown :-1 s=CLOSED pgs=740 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:26:42.875 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:26:42.831+0000 7f053079d700 1 -- 172.21.15.163:0/3554910568 >> 172.21.15.163:0/3554910568 conn(0x7f05280fb2a0 msgr2=0x7f05280fd6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:26:42.876 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:26:42.831+0000 7f053079d700 1 -- 172.21.15.163:0/3554910568 shutdown_connections 2023-07-14T18:26:42.876 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:26:42.831+0000 7f053079d700 1 -- 172.21.15.163:0/3554910568 wait complete. 2023-07-14T18:26:42.877 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:26:42.831+0000 7f053079d700 1 Processor -- start 2023-07-14T18:26:42.878 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:26:42.831+0000 7f053079d700 1 -- start start 2023-07-14T18:26:42.878 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:26:42.832+0000 7f053079d700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f05280ffc80 0x7f052819be70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:26:42.878 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:26:42.832+0000 7f053079d700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0528100e70 0x7f052819c3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:26:42.878 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:26:42.832+0000 7f053079d700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f0528101800 0x7f05281a3420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:26:42.879 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:26:42.832+0000 7f053079d700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05281a39f0 con 0x7f0528101800 2023-07-14T18:26:42.879 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:26:42.832+0000 7f053079d700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05281a3b30 con 0x7f0528100e70 2023-07-14T18:26:42.879 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:26:42.832+0000 7f053079d700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05281a3cc0 con 0x7f05280ffc80 2023-07-14T18:26:42.879 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:26:42.832+0000 7f052dd38700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0528100e70 0x7f052819c3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:26:42.879 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:26:42.832+0000 7f052e539700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f05280ffc80 0x7f052819be70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:26:42.880 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:26:42.832+0000 7f052ed3a700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f0528101800 0x7f05281a3420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:26:42.880 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:26:42.832+0000 7f052e539700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f05280ffc80 0x7f052819be70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.163:42280/0 (socket says 172.21.15.163:42280) 2023-07-14T18:26:42.880 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:26:42.832+0000 7f052dd38700 1 --2- 172.21.15.163:0/3333142354 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0528100e70 0x7f052819c3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.163:32912/0 (socket says 172.21.15.163:32912) 2023-07-14T18:26:42.880 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:26:42.832+0000 7f052e539700 1 -- 172.21.15.163:0/3333142354 learned_addr learned my addr 172.21.15.163:0/3333142354 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:26:42.880 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:26:42.832+0000 7f052e539700 1 -- 172.21.15.163:0/3333142354 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0528100e70 msgr2=0x7f052819c3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:26:42.881 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:26:42.832+0000 7f052e539700 1 --2- 172.21.15.163:0/3333142354 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0528100e70 0x7f052819c3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:26:42.881 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:26:42.832+0000 7f052e539700 1 -- 172.21.15.163:0/3333142354 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f0528101800 msgr2=0x7f05281a3420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:26:42.881 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:26:42.832+0000 7f052e539700 1 --2- 172.21.15.163:0/3333142354 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f0528101800 0x7f05281a3420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:26:42.881 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:26:42.832+0000 7f052e539700 1 -- 172.21.15.163:0/3333142354 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05180095f0 con 0x7f05280ffc80 2023-07-14T18:26:42.881 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:26:42.832+0000 7f052dd38700 1 --2- 172.21.15.163:0/3333142354 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0528100e70 0x7f052819c3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T18:26:42.882 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:26:42.832+0000 7f052e539700 1 --2- 172.21.15.163:0/3333142354 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f05280ffc80 0x7f052819be70 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f052400e970 tx=0x7f052400ec80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:26:42.882 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:26:42.833+0000 7f051f7fe700 1 -- 172.21.15.163:0/3333142354 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0524009790 con 0x7f05280ffc80 2023-07-14T18:26:42.882 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:26:42.833+0000 7f053079d700 1 -- 172.21.15.163:0/3333142354 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f05281a3fa0 con 0x7f05280ffc80 2023-07-14T18:26:42.882 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:26:42.833+0000 7f051f7fe700 1 -- 172.21.15.163:0/3333142354 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f052400c7e0 con 0x7f05280ffc80 2023-07-14T18:26:42.882 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:26:42.833+0000 7f051f7fe700 1 -- 172.21.15.163:0/3333142354 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0524003bd0 con 0x7f05280ffc80 2023-07-14T18:26:42.882 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:26:42.833+0000 7f053079d700 1 -- 172.21.15.163:0/3333142354 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05281a43c0 con 0x7f05280ffc80 2023-07-14T18:26:42.887 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:26:42.835+0000 7f051f7fe700 1 -- 172.21.15.163:0/3333142354 <== mon.1 v2:172.21.15.184:3300/0 4 ==== mgrmap(e 18) v1 ==== 135716+0+0 (secure 0 0 0) 0x7f052400c950 con 0x7f05280ffc80 2023-07-14T18:26:42.887 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:26:42.836+0000 7f051f7fe700 1 --2- 172.21.15.163:0/3333142354 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f05140a1150 0x7f05140a3600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:26:42.887 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:26:42.836+0000 7f052dd38700 1 --2- 172.21.15.163:0/3333142354 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f05140a1150 0x7f05140a3600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:26:42.888 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:26:42.836+0000 7f051f7fe700 1 -- 172.21.15.163:0/3333142354 <== mon.1 v2:172.21.15.184:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 9049+0+0 (secure 0 0 0) 0x7f0524014070 con 0x7f05280ffc80 2023-07-14T18:26:42.888 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:26:42.836+0000 7f052dd38700 1 --2- 172.21.15.163:0/3333142354 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f05140a1150 0x7f05140a3600 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f051800b2e0 tx=0x7f0518004500 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:26:42.888 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:26:42.837+0000 7f053c935b80 1 Processor -- start 2023-07-14T18:26:42.888 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:26:42.837+0000 7f053c935b80 1 -- start start 2023-07-14T18:26:42.889 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:26:42.837+0000 7f053c935b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5591905e6f60 0x5591905e7370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:26:42.889 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:26:42.837+0000 7f053c935b80 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5591905e78b0 0x5591905e7ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:26:42.889 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:26:42.837+0000 7f053c935b80 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5591905e84b0 0x5591905e8920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:26:42.889 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:26:42.837+0000 7f053c935b80 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x5591904ebcb0 con 0x5591905e84b0 2023-07-14T18:26:42.889 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:26:42.837+0000 7f053c935b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x55919053ea40 con 0x5591905e6f60 2023-07-14T18:26:42.889 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:26:42.837+0000 7f053c935b80 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x559190537ed0 con 0x5591905e78b0 2023-07-14T18:26:42.890 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:26:42.837+0000 7f052e539700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5591905e6f60 0x5591905e7370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:26:42.890 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:26:42.837+0000 7f052e539700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5591905e6f60 0x5591905e7370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.163:32918/0 (socket says 172.21.15.163:32918) 2023-07-14T18:26:42.890 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:26:42.837+0000 7f052e539700 1 -- 172.21.15.163:0/3528688279 learned_addr learned my addr 172.21.15.163:0/3528688279 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:26:42.890 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:26:42.837+0000 7f052ed3a700 1 --2- 172.21.15.163:0/3528688279 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5591905e84b0 0x5591905e8920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:26:42.890 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:26:42.837+0000 7f052dd38700 1 --2- 172.21.15.163:0/3528688279 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5591905e78b0 0x5591905e7ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:26:42.891 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:26:42.838+0000 7f052e539700 1 -- 172.21.15.163:0/3528688279 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5591905e78b0 msgr2=0x5591905e7ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:26:42.891 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:26:42.838+0000 7f052e539700 1 --2- 172.21.15.163:0/3528688279 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5591905e78b0 0x5591905e7ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:26:42.891 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:26:42.838+0000 7f052e539700 1 -- 172.21.15.163:0/3528688279 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5591905e84b0 msgr2=0x5591905e8920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:26:42.891 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:26:42.838+0000 7f052e539700 1 --2- 172.21.15.163:0/3528688279 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5591905e84b0 0x5591905e8920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:26:42.891 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:26:42.838+0000 7f052e539700 1 -- 172.21.15.163:0/3528688279 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559190365de0 con 0x5591905e6f60 2023-07-14T18:26:42.892 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:26:42.838+0000 7f052e539700 1 --2- 172.21.15.163:0/3528688279 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5591905e6f60 0x5591905e7370 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f05240a1db0 tx=0x7f0524099ac0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1679ee746444e3e2 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:26:42.892 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:26:42.838+0000 7f051cff9700 1 -- 172.21.15.163:0/3528688279 <== mon.2 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0524099e90 con 0x5591905e6f60 2023-07-14T18:26:42.892 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:26:42.838+0000 7f051cff9700 1 -- 172.21.15.163:0/3528688279 <== mon.2 v2:172.21.15.172:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f052409dec0 con 0x5591905e6f60 2023-07-14T18:26:42.892 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:26:42.838+0000 7f051cff9700 1 -- 172.21.15.163:0/3528688279 <== mon.2 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f052409a350 con 0x5591905e6f60 2023-07-14T18:26:42.892 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:26:42.839+0000 7f053c935b80 1 -- 172.21.15.163:0/3528688279 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5591905e6f60 msgr2=0x5591905e7370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:26:42.893 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:26:42.839+0000 7f053c935b80 1 --2- 172.21.15.163:0/3528688279 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5591905e6f60 0x5591905e7370 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f05240a1db0 tx=0x7f0524099ac0 comp rx=0 tx=0).stop 2023-07-14T18:26:42.893 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:26:42.839+0000 7f053c935b80 1 -- 172.21.15.163:0/3528688279 shutdown_connections 2023-07-14T18:26:42.893 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:26:42.839+0000 7f053c935b80 1 --2- 172.21.15.163:0/3528688279 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5591905e84b0 0x5591905e8920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:26:42.893 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:26:42.839+0000 7f053c935b80 1 --2- 172.21.15.163:0/3528688279 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5591905e6f60 0x5591905e7370 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:26:42.893 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:26:42.839+0000 7f053c935b80 1 --2- 172.21.15.163:0/3528688279 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5591905e78b0 0x5591905e7ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:26:42.894 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:26:42.839+0000 7f053c935b80 1 -- 172.21.15.163:0/3528688279 >> 172.21.15.163:0/3528688279 conn(0x5591905dc680 msgr2=0x5591905e19d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:26:42.894 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:26:42.839+0000 7f053c935b80 1 -- 172.21.15.163:0/3528688279 shutdown_connections 2023-07-14T18:26:42.894 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:26:42.839+0000 7f053c935b80 1 -- 172.21.15.163:0/3528688279 wait complete. 2023-07-14T18:26:42.894 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:26:42.839+0000 7f053c935b80 1 -- start start 2023-07-14T18:26:42.894 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:26:42.840+0000 7f053c935b80 1 Processor -- start 2023-07-14T18:26:42.894 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:26:42.840+0000 7f053c935b80 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5591905e6f60 0x5591905f09c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:26:42.895 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:26:42.840+0000 7f053c935b80 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5591905e78b0 0x5591905f0f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:26:42.895 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:26:42.840+0000 7f053c935b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5591905e84b0 0x5591905f7f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:26:42.895 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:26:42.840+0000 7f053c935b80 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x5591904d7ac0 con 0x5591905e78b0 2023-07-14T18:26:42.895 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:26:42.840+0000 7f053c935b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x5591904d77c0 con 0x5591905e84b0 2023-07-14T18:26:42.895 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:26:42.840+0000 7f053c935b80 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x5591903bb920 con 0x5591905e6f60 2023-07-14T18:26:42.896 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:26:42.840+0000 7f053c935b80 10 client.0 _ll_register_callbacks cb 0x5591904d5760 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T18:26:42.896 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:26:42.840+0000 7f052ed3a700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5591905e84b0 0x5591905f7f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:26:42.896 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:26:42.840+0000 7f052ed3a700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5591905e84b0 0x5591905f7f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.163:32928/0 (socket says 172.21.15.163:32928) 2023-07-14T18:26:42.896 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:26:42.840+0000 7f052ed3a700 1 -- 172.21.15.163:0/4069327758 learned_addr learned my addr 172.21.15.163:0/4069327758 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:26:42.896 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:26:42.840+0000 7f052dd38700 1 --2- 172.21.15.163:0/4069327758 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5591905e78b0 0x5591905f0f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:26:42.897 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:26:42.840+0000 7f052e539700 1 --2- 172.21.15.163:0/4069327758 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5591905e6f60 0x5591905f09c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:26:42.897 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:26:42.840+0000 7f052ed3a700 1 -- 172.21.15.163:0/4069327758 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5591905e6f60 msgr2=0x5591905f09c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:26:42.897 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:26:42.840+0000 7f052ed3a700 1 --2- 172.21.15.163:0/4069327758 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5591905e6f60 0x5591905f09c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:26:42.897 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:26:42.840+0000 7f052ed3a700 1 -- 172.21.15.163:0/4069327758 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5591905e78b0 msgr2=0x5591905f0f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:26:42.897 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:26:42.840+0000 7f052ed3a700 1 --2- 172.21.15.163:0/4069327758 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5591905e78b0 0x5591905f0f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:26:42.898 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:26:42.840+0000 7f052ed3a700 1 -- 172.21.15.163:0/4069327758 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05281a43c0 con 0x5591905e84b0 2023-07-14T18:26:42.898 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:26:42.840+0000 7f052e539700 1 --2- 172.21.15.163:0/4069327758 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5591905e6f60 0x5591905f09c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-14T18:26:42.898 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:26:42.841+0000 7f052ed3a700 1 --2- 172.21.15.163:0/4069327758 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5591905e84b0 0x5591905f7f40 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f0520011f60 tx=0x7f0520014600 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9f5059fb2b482429 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:26:42.898 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:26:42.841+0000 7f0511ffb700 10 client.0 ms_handle_connect on v2:172.21.15.172:3300/0 2023-07-14T18:26:42.898 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:26:42.841+0000 7f0511ffb700 1 -- 172.21.15.163:0/4069327758 <== mon.2 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f052000e040 con 0x5591905e84b0 2023-07-14T18:26:42.899 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:26:42.841+0000 7f053c935b80 1 -- 172.21.15.163:0/4069327758 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5591904914f0 con 0x5591905e84b0 2023-07-14T18:26:42.899 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:26:42.841+0000 7f0511ffb700 1 -- 172.21.15.163:0/4069327758 <== mon.2 v2:172.21.15.172:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 9049+0+0 (secure 0 0 0) 0x7f0520014bf0 con 0x5591905e84b0 2023-07-14T18:26:42.899 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:26:42.841+0000 7f0511ffb700 1 -- 172.21.15.163:0/4069327758 <== mon.2 v2:172.21.15.172:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0520014db0 con 0x5591905e84b0 2023-07-14T18:26:42.899 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:26:42.841+0000 7f053c935b80 10 client.26300 fetch_fsmap learned FSMap version 39 2023-07-14T18:26:42.899 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:26:42.841+0000 7f053c935b80 1 -- 172.21.15.163:0/4069327758 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) v3 -- 0x55919034ec60 con 0x5591905e84b0 2023-07-14T18:26:42.899 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:26:42.841+0000 7f0511ffb700 1 -- 172.21.15.163:0/4069327758 <== mon.2 v2:172.21.15.172:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x5591904914f0 con 0x5591905e84b0 2023-07-14T18:26:42.900 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:26:42.841+0000 7f0511ffb700 1 -- 172.21.15.163:0/4069327758 <== mon.2 v2:172.21.15.172:3300/0 5 ==== fsmap(e 39) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f052001c020 con 0x5591905e84b0 2023-07-14T18:26:42.900 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:26:42.841+0000 7f053c935b80 10 client.26300 fetch_fsmap finished waiting for FSMap version 39 2023-07-14T18:26:42.900 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:26:42.841+0000 7f053c935b80 10 client.26300 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-07-14T18:26:42.900 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:26:42.841+0000 7f053c935b80 20 client.26300 populate_metadata read hostname 'smithi163' 2023-07-14T18:26:42.900 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:26:42.841+0000 7f053c935b80 1 --2- 172.21.15.163:0/4069327758 >> [v2:172.21.15.172:6838/3850440096,v1:172.21.15.172:6839/3850440096] conn(0x5591905fc7d0 0x5591905febe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:26:42.901 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:26:42.841+0000 7f053c935b80 4 client.26300 mds_command: new command op to 24518 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-14T18:26:42.901 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:26:42.841+0000 7f053c935b80 1 -- 172.21.15.163:0/4069327758 --> [v2:172.21.15.172:6838/3850440096,v1:172.21.15.172:6839/3850440096] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5591905b5da0 con 0x5591905fc7d0 2023-07-14T18:26:42.901 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:26:42.842+0000 7f052e539700 1 --2- 172.21.15.163:0/4069327758 >> [v2:172.21.15.172:6838/3850440096,v1:172.21.15.172:6839/3850440096] conn(0x5591905fc7d0 0x5591905febe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:26:42.901 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:26:42.842+0000 7f0511ffb700 10 client.26300 ms_handle_connect on v2:172.21.15.172:6838/3850440096 2023-07-14T18:26:42.901 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:26:42.842+0000 7f052e539700 1 --2- 172.21.15.163:0/4069327758 >> [v2:172.21.15.172:6838/3850440096,v1:172.21.15.172:6839/3850440096] conn(0x5591905fc7d0 0x5591905febe0 crc :-1 s=READY pgs=113 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e03070aa97ab88e2 server_cookie=5a283098a07dba4e in_seq=0 out_seq=0 2023-07-14T18:26:42.902 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:26:42.842+0000 7f0511ffb700 1 -- 172.21.15.163:0/4069327758 <== mds.0 v2:172.21.15.172:6838/3850440096 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18017 (crc 0 0 0) 0x5591905b5da0 con 0x5591905fc7d0 2023-07-14T18:26:42.902 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:26:42.842+0000 7f0511ffb700 10 client.26300 handle_command_reply: tid=0 2023-07-14T18:26:42.902 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:26:42.843+0000 7f053c935b80 1 client.26300 shutdown 2023-07-14T18:26:42.902 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:26:42.843+0000 7f053c935b80 1 -- 172.21.15.163:0/4069327758 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5591905e84b0 msgr2=0x5591905f7f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:26:42.902 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:26:42.843+0000 7f053c935b80 1 --2- 172.21.15.163:0/4069327758 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5591905e84b0 0x5591905f7f40 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f0520011f60 tx=0x7f0520014600 comp rx=0 tx=0).stop 2023-07-14T18:26:42.903 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:26:42.843+0000 7f053c935b80 1 -- 172.21.15.163:0/4069327758 shutdown_connections 2023-07-14T18:26:42.903 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:26:42.843+0000 7f053c935b80 1 --2- 172.21.15.163:0/4069327758 >> [v2:172.21.15.172:6838/3850440096,v1:172.21.15.172:6839/3850440096] conn(0x5591905fc7d0 0x5591905febe0 crc :-1 s=READY pgs=113 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:26:42.903 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:26:42.843+0000 7f053c935b80 1 --2- 172.21.15.163:0/4069327758 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5591905e6f60 0x5591905f09c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:26:42.903 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:26:42.843+0000 7f0511ffb700 0 client.26300 ms_handle_reset on v2:172.21.15.172:6838/3850440096 2023-07-14T18:26:42.903 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:26:42.843+0000 7f053c935b80 1 --2- 172.21.15.163:0/4069327758 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5591905e84b0 0x5591905f7f40 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:26:42.904 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:26:42.843+0000 7f053c935b80 1 --2- 172.21.15.163:0/4069327758 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5591905e78b0 0x5591905f0f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:26:42.904 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:26:42.843+0000 7f053c935b80 1 -- 172.21.15.163:0/4069327758 >> 172.21.15.163:0/4069327758 conn(0x5591905dc680 msgr2=0x5591905e0650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:26:42.904 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:26:42.843+0000 7f053c935b80 1 -- 172.21.15.163:0/4069327758 shutdown_connections 2023-07-14T18:26:42.904 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:26:42.843+0000 7f053c935b80 1 -- 172.21.15.163:0/4069327758 wait complete. 2023-07-14T18:26:42.904 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:26:42.843+0000 7f053c935b80 20 client.26300 trim_cache size 0 max 16384 2023-07-14T18:26:42.909 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:26:42.865+0000 7f053c935b80 1 Processor -- start 2023-07-14T18:26:42.909 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:26:42.865+0000 7f053c935b80 1 -- start start 2023-07-14T18:26:42.910 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:26:42.866+0000 7f053c935b80 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5591905e6f60 0x5591905f8830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:26:42.910 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:26:42.866+0000 7f053c935b80 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5591905e78b0 0x5591905f7f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:26:42.910 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:26:42.866+0000 7f053c935b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5591905e84b0 0x5591905ee8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:26:42.910 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:26:42.866+0000 7f053c935b80 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x5591904914f0 con 0x5591905e78b0 2023-07-14T18:26:42.910 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:26:42.866+0000 7f053c935b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x5591905e8330 con 0x5591905e84b0 2023-07-14T18:26:42.911 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:26:42.866+0000 7f053c935b80 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x5591905f9c30 con 0x5591905e6f60 2023-07-14T18:26:42.911 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:26:42.866+0000 7f052dd38700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5591905e78b0 0x5591905f7f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:26:42.911 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:26:42.866+0000 7f052e539700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5591905e6f60 0x5591905f8830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:26:42.911 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:26:42.866+0000 7f052dd38700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5591905e78b0 0x5591905f7f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:60482/0 (socket says 172.21.15.163:60482) 2023-07-14T18:26:42.911 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:26:42.866+0000 7f052dd38700 1 -- 172.21.15.163:0/787487349 learned_addr learned my addr 172.21.15.163:0/787487349 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:26:42.912 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:26:42.866+0000 7f052ed3a700 1 --2- 172.21.15.163:0/787487349 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5591905e84b0 0x5591905ee8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:26:42.912 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:26:42.866+0000 7f052e539700 1 -- 172.21.15.163:0/787487349 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5591905e84b0 msgr2=0x5591905ee8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:26:42.912 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:26:42.866+0000 7f052e539700 1 --2- 172.21.15.163:0/787487349 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5591905e84b0 0x5591905ee8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:26:42.912 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:26:42.866+0000 7f052e539700 1 -- 172.21.15.163:0/787487349 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5591905e78b0 msgr2=0x5591905f7f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:26:42.912 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:26:42.866+0000 7f052e539700 1 --2- 172.21.15.163:0/787487349 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5591905e78b0 0x5591905f7f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:26:42.913 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:26:42.866+0000 7f052e539700 1 -- 172.21.15.163:0/787487349 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55919038c250 con 0x5591905e6f60 2023-07-14T18:26:42.913 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:26:42.866+0000 7f052dd38700 1 --2- 172.21.15.163:0/787487349 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5591905e78b0 0x5591905f7f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T18:26:42.913 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:26:42.866+0000 7f052e539700 1 --2- 172.21.15.163:0/787487349 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5591905e6f60 0x5591905f8830 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f05240ca5d0 tx=0x7f0524005910 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3b04839b5ea75d49 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:26:42.916 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:26:42.867+0000 7f051d7fa700 1 -- 172.21.15.163:0/787487349 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05240999d0 con 0x5591905e6f60 2023-07-14T18:26:42.916 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:26:42.867+0000 7f051d7fa700 1 -- 172.21.15.163:0/787487349 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f0524003d30 con 0x5591905e6f60 2023-07-14T18:26:42.917 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:26:42.867+0000 7f051d7fa700 1 -- 172.21.15.163:0/787487349 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05240995e0 con 0x5591905e6f60 2023-07-14T18:26:42.917 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:26:42.867+0000 7f053c935b80 1 -- 172.21.15.163:0/787487349 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5591905e6f60 msgr2=0x5591905f8830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:26:42.917 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:26:42.867+0000 7f053c935b80 1 --2- 172.21.15.163:0/787487349 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5591905e6f60 0x5591905f8830 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f05240ca5d0 tx=0x7f0524005910 comp rx=0 tx=0).stop 2023-07-14T18:26:42.917 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:26:42.867+0000 7f053c935b80 1 -- 172.21.15.163:0/787487349 shutdown_connections 2023-07-14T18:26:42.917 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:26:42.867+0000 7f053c935b80 1 --2- 172.21.15.163:0/787487349 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5591905e6f60 0x5591905f8830 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:26:42.918 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:26:42.867+0000 7f053c935b80 1 --2- 172.21.15.163:0/787487349 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5591905e84b0 0x5591905ee8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:26:42.918 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:26:42.867+0000 7f053c935b80 1 --2- 172.21.15.163:0/787487349 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5591905e78b0 0x5591905f7f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:26:42.918 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:26:42.867+0000 7f053c935b80 1 -- 172.21.15.163:0/787487349 >> 172.21.15.163:0/787487349 conn(0x5591905dc680 msgr2=0x5591905ef670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:26:42.919 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:26:42.867+0000 7f053c935b80 1 -- 172.21.15.163:0/787487349 shutdown_connections 2023-07-14T18:26:42.919 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:26:42.867+0000 7f053c935b80 1 -- 172.21.15.163:0/787487349 wait complete. 2023-07-14T18:26:42.919 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:26:42.868+0000 7f053c935b80 1 -- start start 2023-07-14T18:26:42.919 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:26:42.868+0000 7f053c935b80 1 Processor -- start 2023-07-14T18:26:42.919 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:26:42.868+0000 7f053c935b80 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5591905e6f60 0x5591905f7d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:26:42.920 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:26:42.868+0000 7f053c935b80 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5591905e78b0 0x5591905f6310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:26:42.920 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:26:42.868+0000 7f053c935b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5591905e84b0 0x5591905f6850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:26:42.920 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:26:42.868+0000 7f053c935b80 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x5591905f6e70 con 0x5591905e6f60 2023-07-14T18:26:42.920 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:26:42.868+0000 7f053c935b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x5591905f6fe0 con 0x5591905e84b0 2023-07-14T18:26:42.920 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:26:42.868+0000 7f053c935b80 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x5591905f71a0 con 0x5591905e78b0 2023-07-14T18:26:42.921 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:26:42.868+0000 7f053c935b80 10 client.0 _ll_register_callbacks cb 0x7f05200118c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T18:26:42.921 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:26:42.868+0000 7f052e539700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5591905e6f60 0x5591905f7d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:26:42.921 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:26:42.868+0000 7f052e539700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5591905e6f60 0x5591905f7d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:60486/0 (socket says 172.21.15.163:60486) 2023-07-14T18:26:42.921 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:26:42.868+0000 7f052e539700 1 -- 172.21.15.163:0/1094367032 learned_addr learned my addr 172.21.15.163:0/1094367032 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:26:42.921 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:26:42.868+0000 7f052ed3a700 1 --2- 172.21.15.163:0/1094367032 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5591905e84b0 0x5591905f6850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:26:42.922 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:26:42.868+0000 7f052dd38700 1 --2- 172.21.15.163:0/1094367032 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5591905e78b0 0x5591905f6310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:26:42.922 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:26:42.868+0000 7f052e539700 1 -- 172.21.15.163:0/1094367032 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5591905e78b0 msgr2=0x5591905f6310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:26:42.922 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:26:42.868+0000 7f052e539700 1 --2- 172.21.15.163:0/1094367032 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5591905e78b0 0x5591905f6310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:26:42.922 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:26:42.868+0000 7f052e539700 1 -- 172.21.15.163:0/1094367032 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5591905e84b0 msgr2=0x5591905f6850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:26:42.922 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:26:42.868+0000 7f052e539700 1 --2- 172.21.15.163:0/1094367032 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5591905e84b0 0x5591905f6850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:26:42.923 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:26:42.868+0000 7f052e539700 1 -- 172.21.15.163:0/1094367032 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05281089f0 con 0x5591905e6f60 2023-07-14T18:26:42.923 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:26:42.868+0000 7f052ed3a700 1 --2- 172.21.15.163:0/1094367032 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5591905e84b0 0x5591905f6850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T18:26:42.923 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:26:42.868+0000 7f052e539700 1 --2- 172.21.15.163:0/1094367032 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5591905e6f60 0x5591905f7d00 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7f0524099e20 tx=0x7f05240163f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=74313d20c8854df8 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:26:42.923 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:26:42.868+0000 7f0511ffb700 10 client.0 ms_handle_connect on v2:172.21.15.163:3300/0 2023-07-14T18:26:42.923 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:26:42.869+0000 7f0511ffb700 1 -- 172.21.15.163:0/1094367032 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05240999d0 con 0x5591905e6f60 2023-07-14T18:26:42.923 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:26:42.869+0000 7f053c935b80 1 -- 172.21.15.163:0/1094367032 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f052409dec0 con 0x5591905e6f60 2023-07-14T18:26:42.924 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:26:42.869+0000 7f0511ffb700 1 -- 172.21.15.163:0/1094367032 <== mon.0 v2:172.21.15.163:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 9049+0+0 (secure 0 0 0) 0x7f05240ca280 con 0x5591905e6f60 2023-07-14T18:26:42.924 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:26:42.869+0000 7f0511ffb700 1 -- 172.21.15.163:0/1094367032 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) v2 ==== 24+0+0 (secure 0 0 0) 0x7f052409a0f0 con 0x5591905e6f60 2023-07-14T18:26:42.924 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:26:42.869+0000 7f053c935b80 10 client.16680 fetch_fsmap learned FSMap version 39 2023-07-14T18:26:42.924 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:26:42.869+0000 7f053c935b80 1 -- 172.21.15.163:0/1094367032 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) v3 -- 0x559190365de0 con 0x5591905e6f60 2023-07-14T18:26:42.924 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:26:42.869+0000 7f0511ffb700 1 -- 172.21.15.163:0/1094367032 <== mon.0 v2:172.21.15.163:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f052409dec0 con 0x5591905e6f60 2023-07-14T18:26:42.925 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:26:42.869+0000 7f0511ffb700 1 -- 172.21.15.163:0/1094367032 <== mon.0 v2:172.21.15.163:3300/0 5 ==== fsmap(e 39) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f05240a1e50 con 0x5591905e6f60 2023-07-14T18:26:42.925 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:26:42.869+0000 7f053c935b80 10 client.16680 fetch_fsmap finished waiting for FSMap version 39 2023-07-14T18:26:42.925 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:26:42.869+0000 7f053c935b80 10 client.16680 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-07-14T18:26:42.925 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:26:42.869+0000 7f053c935b80 20 client.16680 populate_metadata read hostname 'smithi163' 2023-07-14T18:26:42.925 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:26:42.869+0000 7f053c935b80 1 --2- 172.21.15.163:0/1094367032 >> [v2:172.21.15.172:6838/3850440096,v1:172.21.15.172:6839/3850440096] conn(0x559190651890 0x559190653ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:26:42.926 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:26:42.869+0000 7f053c935b80 4 client.16680 mds_command: new command op to 24518 tid=0[{"prefix": "scrub status"}] 2023-07-14T18:26:42.926 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:26:42.869+0000 7f053c935b80 1 -- 172.21.15.163:0/1094367032 --> [v2:172.21.15.172:6838/3850440096,v1:172.21.15.172:6839/3850440096] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x559190530eb0 con 0x559190651890 2023-07-14T18:26:42.926 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:26:42.869+0000 7f052dd38700 1 --2- 172.21.15.163:0/1094367032 >> [v2:172.21.15.172:6838/3850440096,v1:172.21.15.172:6839/3850440096] conn(0x559190651890 0x559190653ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:26:42.926 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:26:42.870+0000 7f0511ffb700 10 client.16680 ms_handle_connect on v2:172.21.15.172:6838/3850440096 2023-07-14T18:26:42.926 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:26:42.870+0000 7f052dd38700 1 --2- 172.21.15.163:0/1094367032 >> [v2:172.21.15.172:6838/3850440096,v1:172.21.15.172:6839/3850440096] conn(0x559190651890 0x559190653ca0 crc :-1 s=READY pgs=114 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e02fd578c814166d server_cookie=4fa5db096508858b in_seq=0 out_seq=0 2023-07-14T18:26:42.927 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:26:42.870+0000 7f0511ffb700 1 -- 172.21.15.163:0/1094367032 <== mds.0 v2:172.21.15.172:6838/3850440096 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x559190530eb0 con 0x559190651890 2023-07-14T18:26:42.927 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:26:42.870+0000 7f0511ffb700 10 client.16680 handle_command_reply: tid=0 2023-07-14T18:26:42.927 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:26:42.870+0000 7f053c935b80 1 client.16680 shutdown 2023-07-14T18:26:42.927 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:26:42.870+0000 7f053c935b80 1 -- 172.21.15.163:0/1094367032 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5591905e6f60 msgr2=0x5591905f7d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:26:42.927 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:26:42.870+0000 7f053c935b80 1 --2- 172.21.15.163:0/1094367032 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5591905e6f60 0x5591905f7d00 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7f0524099e20 tx=0x7f05240163f0 comp rx=0 tx=0).stop 2023-07-14T18:26:42.928 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:26:42.870+0000 7f053c935b80 1 -- 172.21.15.163:0/1094367032 shutdown_connections 2023-07-14T18:26:42.928 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:26:42.870+0000 7f053c935b80 1 --2- 172.21.15.163:0/1094367032 >> [v2:172.21.15.172:6838/3850440096,v1:172.21.15.172:6839/3850440096] conn(0x559190651890 0x559190653ca0 crc :-1 s=READY pgs=114 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:26:42.928 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:26:42.870+0000 7f053c935b80 1 --2- 172.21.15.163:0/1094367032 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5591905e84b0 0x5591905f6850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:26:42.928 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:26:42.870+0000 7f0511ffb700 0 client.16680 ms_handle_reset on v2:172.21.15.172:6838/3850440096 2023-07-14T18:26:42.928 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:26:42.870+0000 7f053c935b80 1 --2- 172.21.15.163:0/1094367032 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5591905e6f60 0x5591905f7d00 unknown :-1 s=CLOSED pgs=741 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:26:42.929 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:26:42.870+0000 7f053c935b80 1 --2- 172.21.15.163:0/1094367032 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5591905e78b0 0x5591905f6310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:26:42.929 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:26:42.870+0000 7f053c935b80 1 -- 172.21.15.163:0/1094367032 >> 172.21.15.163:0/1094367032 conn(0x5591905dc680 msgr2=0x5591905f8830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:26:42.929 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:26:42.870+0000 7f053c935b80 1 -- 172.21.15.163:0/1094367032 shutdown_connections 2023-07-14T18:26:42.929 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:26:42.870+0000 7f053c935b80 1 -- 172.21.15.163:0/1094367032 wait complete. 2023-07-14T18:26:42.929 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:26:42.871+0000 7f053c935b80 20 client.16680 trim_cache size 0 max 16384 2023-07-14T18:26:42.930 INFO:teuthology.orchestra.run.smithi163.stdout:{ 2023-07-14T18:26:42.930 INFO:teuthology.orchestra.run.smithi163.stdout: "status": "IDLE (waiting for more scrubs)", 2023-07-14T18:26:42.930 INFO:teuthology.orchestra.run.smithi163.stdout: "scrubs": { 2023-07-14T18:26:42.930 INFO:teuthology.orchestra.run.smithi163.stdout: "2c53b7ef-6f30-49f0-a60d-f1f114c19d42": { 2023-07-14T18:26:42.931 INFO:teuthology.orchestra.run.smithi163.stdout: "path": "/", 2023-07-14T18:26:42.931 INFO:teuthology.orchestra.run.smithi163.stdout: "tag": "2c53b7ef-6f30-49f0-a60d-f1f114c19d42", 2023-07-14T18:26:42.931 INFO:teuthology.orchestra.run.smithi163.stdout: "options": "recursive,force" 2023-07-14T18:26:42.931 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-07-14T18:26:42.931 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-07-14T18:26:42.932 INFO:teuthology.orchestra.run.smithi163.stdout:} 2023-07-14T18:26:42.933 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:26:42.871+0000 7f053079d700 1 -- 172.21.15.163:0/3333142354 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f05140a1150 msgr2=0x7f05140a3600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:26:42.933 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:26:42.871+0000 7f053079d700 1 --2- 172.21.15.163:0/3333142354 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f05140a1150 0x7f05140a3600 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f051800b2e0 tx=0x7f0518004500 comp rx=0 tx=0).stop 2023-07-14T18:26:42.933 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:26:42.871+0000 7f053079d700 1 -- 172.21.15.163:0/3333142354 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f05280ffc80 msgr2=0x7f052819be70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:26:42.934 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:26:42.871+0000 7f053079d700 1 --2- 172.21.15.163:0/3333142354 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f05280ffc80 0x7f052819be70 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f052400e970 tx=0x7f052400ec80 comp rx=0 tx=0).stop 2023-07-14T18:26:42.934 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:26:42.871+0000 7f053079d700 1 -- 172.21.15.163:0/3333142354 shutdown_connections 2023-07-14T18:26:42.934 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:26:42.871+0000 7f053079d700 1 --2- 172.21.15.163:0/3333142354 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f05140a1150 0x7f05140a3600 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:26:42.934 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:26:42.871+0000 7f053079d700 1 --2- 172.21.15.163:0/3333142354 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f05280ffc80 0x7f052819be70 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:26:42.934 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:26:42.871+0000 7f053079d700 1 --2- 172.21.15.163:0/3333142354 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f0528101800 0x7f05281a3420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:26:42.935 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:26:42.871+0000 7f053079d700 1 --2- 172.21.15.163:0/3333142354 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0528100e70 0x7f052819c3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:26:42.935 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:26:42.871+0000 7f053079d700 1 -- 172.21.15.163:0/3333142354 >> 172.21.15.163:0/3333142354 conn(0x7f05280fb2a0 msgr2=0x7f05280fd2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:26:42.935 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:26:42.871+0000 7f053079d700 1 -- 172.21.15.163:0/3333142354 shutdown_connections 2023-07-14T18:26:42.935 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:26:42.871+0000 7f053079d700 1 -- 172.21.15.163:0/3333142354 wait complete. 2023-07-14T18:26:42.935 INFO:tasks.cephfs.filesystem:scrub status for tag:2c53b7ef-6f30-49f0-a60d-f1f114c19d42 - {'path': '/', 'tag': '2c53b7ef-6f30-49f0-a60d-f1f114c19d42', 'options': 'recursive,force'} 2023-07-14T18:26:45.029 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:26:44 smithi172 ceph-mon[97983]: pgmap v722: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-07-14T18:26:45.178 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:26:44 smithi184 ceph-mon[98481]: pgmap v722: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-07-14T18:26:45.220 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:26:44 smithi163 ceph-mon[96576]: pgmap v722: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-07-14T18:26:47.029 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:26:46 smithi172 ceph-mon[97983]: pgmap v723: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-07-14T18:26:47.177 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:26:46 smithi184 ceph-mon[98481]: pgmap v723: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-07-14T18:26:47.220 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:26:46 smithi163 ceph-mon[96576]: pgmap v723: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-07-14T18:26:49.028 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:26:48 smithi172 ceph-mon[97983]: pgmap v724: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-07-14T18:26:49.177 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:26:48 smithi184 ceph-mon[98481]: pgmap v724: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-07-14T18:26:49.220 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:26:48 smithi163 ceph-mon[96576]: pgmap v724: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-07-14T18:26:51.028 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:26:50 smithi172 ceph-mon[97983]: pgmap v725: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-07-14T18:26:51.177 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:26:50 smithi184 ceph-mon[98481]: pgmap v725: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-07-14T18:26:51.220 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:26:50 smithi163 ceph-mon[96576]: pgmap v725: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-07-14T18:26:52.278 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:26:51 smithi172 ceph-mon[97983]: pgmap v726: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-07-14T18:26:52.427 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:26:51 smithi184 ceph-mon[98481]: pgmap v726: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-07-14T18:26:52.469 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:26:51 smithi163 ceph-mon[96576]: pgmap v726: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-07-14T18:26:55.028 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:26:54 smithi172 ceph-mon[97983]: pgmap v727: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-07-14T18:26:55.177 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:26:54 smithi184 ceph-mon[98481]: pgmap v727: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-07-14T18:26:55.219 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:26:54 smithi163 ceph-mon[96576]: pgmap v727: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-07-14T18:26:57.028 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:26:56 smithi172 ceph-mon[97983]: pgmap v728: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-07-14T18:26:57.177 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:26:56 smithi184 ceph-mon[98481]: pgmap v728: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-07-14T18:26:57.219 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:26:56 smithi163 ceph-mon[96576]: pgmap v728: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-07-14T18:26:59.027 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:26:58 smithi172 ceph-mon[97983]: pgmap v729: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-07-14T18:26:59.177 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:26:58 smithi184 ceph-mon[98481]: pgmap v729: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-07-14T18:26:59.219 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:26:58 smithi163 ceph-mon[96576]: pgmap v729: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-07-14T18:27:01.027 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:27:00 smithi172 ceph-mon[97983]: pgmap v730: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-07-14T18:27:01.176 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:27:00 smithi184 ceph-mon[98481]: pgmap v730: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-07-14T18:27:01.219 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:27:00 smithi163 ceph-mon[96576]: pgmap v730: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-07-14T18:27:02.277 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:27:01 smithi172 ceph-mon[97983]: pgmap v731: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-07-14T18:27:02.426 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:27:01 smithi184 ceph-mon[98481]: pgmap v731: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-07-14T18:27:02.469 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:27:01 smithi163 ceph-mon[96576]: pgmap v731: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-07-14T18:27:05.027 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:27:04 smithi172 ceph-mon[97983]: pgmap v732: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-07-14T18:27:05.177 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:27:04 smithi184 ceph-mon[98481]: pgmap v732: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-07-14T18:27:05.219 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:27:04 smithi163 ceph-mon[96576]: pgmap v732: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-07-14T18:27:07.027 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:27:06 smithi172 ceph-mon[97983]: pgmap v733: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-07-14T18:27:07.176 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:27:06 smithi184 ceph-mon[98481]: pgmap v733: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-07-14T18:27:07.218 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:27:06 smithi163 ceph-mon[96576]: pgmap v733: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-07-14T18:27:09.027 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:27:08 smithi172 ceph-mon[97983]: pgmap v734: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-07-14T18:27:09.176 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:27:08 smithi184 ceph-mon[98481]: pgmap v734: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-07-14T18:27:09.218 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:27:08 smithi163 ceph-mon[96576]: pgmap v734: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-07-14T18:27:11.027 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:27:10 smithi172 ceph-mon[97983]: pgmap v735: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-07-14T18:27:11.176 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:27:10 smithi184 ceph-mon[98481]: pgmap v735: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-07-14T18:27:11.218 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:27:10 smithi163 ceph-mon[96576]: pgmap v735: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-07-14T18:27:12.276 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:27:11 smithi172 ceph-mon[97983]: pgmap v736: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-07-14T18:27:12.425 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:27:11 smithi184 ceph-mon[98481]: pgmap v736: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-07-14T18:27:12.468 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:27:11 smithi163 ceph-mon[96576]: pgmap v736: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-07-14T18:27:12.937 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-07-14T18:27:13.096 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:27:13.055+0000 7f821dca5700 1 -- 172.21.15.163:0/4279103740 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f82181017c0 msgr2=0x7f8218108080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:27:13.097 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:27:13.055+0000 7f821dca5700 1 --2- 172.21.15.163:0/4279103740 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f82181017c0 0x7f8218108080 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7f821000b0a0 tx=0x7f821000b3b0 comp rx=0 tx=0).stop 2023-07-14T18:27:13.097 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:27:13.055+0000 7f821dca5700 1 -- 172.21.15.163:0/4279103740 shutdown_connections 2023-07-14T18:27:13.097 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:27:13.055+0000 7f821dca5700 1 --2- 172.21.15.163:0/4279103740 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f82181017c0 0x7f8218108080 unknown :-1 s=CLOSED pgs=742 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:27:13.098 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:27:13.055+0000 7f821dca5700 1 --2- 172.21.15.163:0/4279103740 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f82180ffc40 0x7f8218100050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:27:13.098 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:27:13.055+0000 7f821dca5700 1 --2- 172.21.15.163:0/4279103740 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8218100e30 0x7f8218101280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:27:13.098 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:27:13.055+0000 7f821dca5700 1 -- 172.21.15.163:0/4279103740 >> 172.21.15.163:0/4279103740 conn(0x7f82180fb260 msgr2=0x7f82180fd690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:27:13.098 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:27:13.055+0000 7f821dca5700 1 -- 172.21.15.163:0/4279103740 shutdown_connections 2023-07-14T18:27:13.098 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:27:13.055+0000 7f821dca5700 1 -- 172.21.15.163:0/4279103740 wait complete. 2023-07-14T18:27:13.099 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:27:13.056+0000 7f821dca5700 1 Processor -- start 2023-07-14T18:27:13.104 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:27:13.056+0000 7f821dca5700 1 -- start start 2023-07-14T18:27:13.105 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:27:13.056+0000 7f821dca5700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f82180ffc40 0x7f8218195940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:27:13.105 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:27:13.056+0000 7f821dca5700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8218100e30 0x7f8218195e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:27:13.105 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:27:13.056+0000 7f821dca5700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f82181017c0 0x7f821819cef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:27:13.105 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:27:13.056+0000 7f821dca5700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f821819d4c0 con 0x7f82180ffc40 2023-07-14T18:27:13.106 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:27:13.056+0000 7f821dca5700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f821819d600 con 0x7f82181017c0 2023-07-14T18:27:13.106 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:27:13.056+0000 7f821dca5700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f821819d790 con 0x7f8218100e30 2023-07-14T18:27:13.106 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:27:13.056+0000 7f82177fe700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f82180ffc40 0x7f8218195940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:27:13.106 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:27:13.056+0000 7f82177fe700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f82180ffc40 0x7f8218195940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:60500/0 (socket says 172.21.15.163:60500) 2023-07-14T18:27:13.106 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:27:13.056+0000 7f8217fff700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f82181017c0 0x7f821819cef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:27:13.107 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:27:13.056+0000 7f82177fe700 1 -- 172.21.15.163:0/2365255297 learned_addr learned my addr 172.21.15.163:0/2365255297 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:27:13.107 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:27:13.056+0000 7f8216ffd700 1 --2- 172.21.15.163:0/2365255297 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8218100e30 0x7f8218195e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:27:13.107 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:27:13.057+0000 7f8217fff700 1 -- 172.21.15.163:0/2365255297 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8218100e30 msgr2=0x7f8218195e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:27:13.107 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:27:13.057+0000 7f8217fff700 1 --2- 172.21.15.163:0/2365255297 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8218100e30 0x7f8218195e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:27:13.107 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:27:13.057+0000 7f8217fff700 1 -- 172.21.15.163:0/2365255297 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f82180ffc40 msgr2=0x7f8218195940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:27:13.108 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:27:13.057+0000 7f8217fff700 1 --2- 172.21.15.163:0/2365255297 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f82180ffc40 0x7f8218195940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:27:13.108 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:27:13.057+0000 7f8217fff700 1 -- 172.21.15.163:0/2365255297 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8210009d00 con 0x7f82181017c0 2023-07-14T18:27:13.108 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:27:13.057+0000 7f8216ffd700 1 --2- 172.21.15.163:0/2365255297 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8218100e30 0x7f8218195e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T18:27:13.109 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:27:13.057+0000 7f82177fe700 1 --2- 172.21.15.163:0/2365255297 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f82180ffc40 0x7f8218195940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T18:27:13.109 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:27:13.057+0000 7f8217fff700 1 --2- 172.21.15.163:0/2365255297 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f82181017c0 0x7f821819cef0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f8210015000 tx=0x7f8210009570 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:27:13.110 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:27:13.057+0000 7f8214ff9700 1 -- 172.21.15.163:0/2365255297 <== mon.2 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f821000e040 con 0x7f82181017c0 2023-07-14T18:27:13.110 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:27:13.057+0000 7f821dca5700 1 -- 172.21.15.163:0/2365255297 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f821819da10 con 0x7f82181017c0 2023-07-14T18:27:13.111 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:27:13.057+0000 7f8214ff9700 1 -- 172.21.15.163:0/2365255297 <== mon.2 v2:172.21.15.172:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f8210003e90 con 0x7f82181017c0 2023-07-14T18:27:13.111 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:27:13.057+0000 7f8214ff9700 1 -- 172.21.15.163:0/2365255297 <== mon.2 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8210005040 con 0x7f82181017c0 2023-07-14T18:27:13.111 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:27:13.057+0000 7f821dca5700 1 -- 172.21.15.163:0/2365255297 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f821819dee0 con 0x7f82181017c0 2023-07-14T18:27:13.112 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:27:13.060+0000 7f8214ff9700 1 -- 172.21.15.163:0/2365255297 <== mon.2 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 18) v1 ==== 135716+0+0 (secure 0 0 0) 0x7f821001d670 con 0x7f82181017c0 2023-07-14T18:27:13.112 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:27:13.060+0000 7f8214ff9700 1 --2- 172.21.15.163:0/2365255297 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f82000a1150 0x7f82000a3600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:27:13.113 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:27:13.060+0000 7f82177fe700 1 --2- 172.21.15.163:0/2365255297 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f82000a1150 0x7f82000a3600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:27:13.113 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:27:13.061+0000 7f8214ff9700 1 -- 172.21.15.163:0/2365255297 <== mon.2 v2:172.21.15.172:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 9049+0+0 (secure 0 0 0) 0x7f82100cdd40 con 0x7f82181017c0 2023-07-14T18:27:13.114 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:27:13.061+0000 7f82177fe700 1 --2- 172.21.15.163:0/2365255297 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f82000a1150 0x7f82000a3600 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f8208005950 tx=0x7f8208009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:27:13.114 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:27:13.061+0000 7f8229e3db80 1 Processor -- start 2023-07-14T18:27:13.115 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:27:13.061+0000 7f8229e3db80 1 -- start start 2023-07-14T18:27:13.115 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:27:13.062+0000 7f8229e3db80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55cfcebb7f60 0x55cfcebb8370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:27:13.116 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:27:13.062+0000 7f8229e3db80 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55cfcebb88b0 0x55cfcebb8ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:27:13.116 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:27:13.062+0000 7f8229e3db80 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55cfcebb94b0 0x55cfcebb9920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:27:13.117 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:27:13.062+0000 7f8229e3db80 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cfceabccb0 con 0x55cfcebb94b0 2023-07-14T18:27:13.117 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:27:13.062+0000 7f8229e3db80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cfceb0fa40 con 0x55cfcebb7f60 2023-07-14T18:27:13.117 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:27:13.062+0000 7f8229e3db80 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cfceb08ed0 con 0x55cfcebb88b0 2023-07-14T18:27:13.118 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:27:13.062+0000 7f82177fe700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55cfcebb7f60 0x55cfcebb8370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:27:13.118 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:27:13.062+0000 7f8217fff700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55cfcebb94b0 0x55cfcebb9920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:27:13.118 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:27:13.062+0000 7f8217fff700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55cfcebb94b0 0x55cfcebb9920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:60510/0 (socket says 172.21.15.163:60510) 2023-07-14T18:27:13.119 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:27:13.062+0000 7f8217fff700 1 -- 172.21.15.163:0/312986920 learned_addr learned my addr 172.21.15.163:0/312986920 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:27:13.119 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:27:13.062+0000 7f82177fe700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55cfcebb7f60 0x55cfcebb8370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.163:32960/0 (socket says 172.21.15.163:32960) 2023-07-14T18:27:13.120 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:27:13.062+0000 7f8216ffd700 1 --2- 172.21.15.163:0/312986920 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55cfcebb88b0 0x55cfcebb8ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:27:13.120 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:27:13.062+0000 7f8217fff700 1 -- 172.21.15.163:0/312986920 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55cfcebb88b0 msgr2=0x55cfcebb8ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:27:13.121 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:27:13.062+0000 7f8217fff700 1 --2- 172.21.15.163:0/312986920 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55cfcebb88b0 0x55cfcebb8ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:27:13.121 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:27:13.062+0000 7f8217fff700 1 -- 172.21.15.163:0/312986920 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55cfcebb7f60 msgr2=0x55cfcebb8370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:27:13.121 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:27:13.062+0000 7f8217fff700 1 --2- 172.21.15.163:0/312986920 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55cfcebb7f60 0x55cfcebb8370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:27:13.121 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:27:13.062+0000 7f8217fff700 1 -- 172.21.15.163:0/312986920 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55cfce936de0 con 0x55cfcebb94b0 2023-07-14T18:27:13.122 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:27:13.062+0000 7f82177fe700 1 --2- 172.21.15.163:0/312986920 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55cfcebb7f60 0x55cfcebb8370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T18:27:13.122 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:27:13.062+0000 7f8216ffd700 1 --2- 172.21.15.163:0/312986920 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55cfcebb88b0 0x55cfcebb8ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T18:27:13.122 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:27:13.062+0000 7f8217fff700 1 --2- 172.21.15.163:0/312986920 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55cfcebb94b0 0x55cfcebb9920 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7f8210097920 tx=0x7f821000b3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5bacd66c71b0e57f server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:27:13.122 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:27:13.062+0000 7f81fdffb700 1 -- 172.21.15.163:0/312986920 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f821009eee0 con 0x55cfcebb94b0 2023-07-14T18:27:13.123 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:27:13.063+0000 7f81fdffb700 1 -- 172.21.15.163:0/312986920 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f82100a0070 con 0x55cfcebb94b0 2023-07-14T18:27:13.123 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:27:13.063+0000 7f81fdffb700 1 -- 172.21.15.163:0/312986920 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f821009b350 con 0x55cfcebb94b0 2023-07-14T18:27:13.123 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:27:13.063+0000 7f8229e3db80 1 -- 172.21.15.163:0/312986920 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55cfcebb94b0 msgr2=0x55cfcebb9920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:27:13.123 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:27:13.063+0000 7f8229e3db80 1 --2- 172.21.15.163:0/312986920 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55cfcebb94b0 0x55cfcebb9920 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7f8210097920 tx=0x7f821000b3b0 comp rx=0 tx=0).stop 2023-07-14T18:27:13.124 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:27:13.063+0000 7f8229e3db80 1 -- 172.21.15.163:0/312986920 shutdown_connections 2023-07-14T18:27:13.124 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:27:13.063+0000 7f8229e3db80 1 --2- 172.21.15.163:0/312986920 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55cfcebb94b0 0x55cfcebb9920 unknown :-1 s=CLOSED pgs=743 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:27:13.124 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:27:13.063+0000 7f8229e3db80 1 --2- 172.21.15.163:0/312986920 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55cfcebb7f60 0x55cfcebb8370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:27:13.124 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:27:13.063+0000 7f8229e3db80 1 --2- 172.21.15.163:0/312986920 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55cfcebb88b0 0x55cfcebb8ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:27:13.125 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:27:13.063+0000 7f8229e3db80 1 -- 172.21.15.163:0/312986920 >> 172.21.15.163:0/312986920 conn(0x55cfcebad680 msgr2=0x55cfcebb29d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:27:13.125 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:27:13.063+0000 7f8229e3db80 1 -- 172.21.15.163:0/312986920 shutdown_connections 2023-07-14T18:27:13.125 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:27:13.063+0000 7f8229e3db80 1 -- 172.21.15.163:0/312986920 wait complete. 2023-07-14T18:27:13.128 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:27:13.064+0000 7f8229e3db80 1 -- start start 2023-07-14T18:27:13.129 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:27:13.064+0000 7f8229e3db80 1 Processor -- start 2023-07-14T18:27:13.129 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:27:13.064+0000 7f8229e3db80 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55cfcebb7f60 0x55cfcebc15f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:27:13.130 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:27:13.064+0000 7f8229e3db80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55cfcebb88b0 0x55cfcebc1b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:27:13.130 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:27:13.064+0000 7f8229e3db80 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55cfcebb94b0 0x55cfcebc8b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:27:13.130 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:27:13.065+0000 7f8229e3db80 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cfceaa8ac0 con 0x55cfcebb94b0 2023-07-14T18:27:13.131 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:27:13.065+0000 7f8229e3db80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cfceaa87c0 con 0x55cfcebb88b0 2023-07-14T18:27:13.131 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:27:13.065+0000 7f8229e3db80 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cfce98c920 con 0x55cfcebb7f60 2023-07-14T18:27:13.131 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:27:13.065+0000 7f8229e3db80 10 client.0 _ll_register_callbacks cb 0x55cfceaa6760 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T18:27:13.131 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:27:13.065+0000 7f8217fff700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55cfcebb94b0 0x55cfcebc8b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:27:13.132 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:27:13.065+0000 7f82177fe700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55cfcebb7f60 0x55cfcebc15f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:27:13.132 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:27:13.065+0000 7f82177fe700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55cfcebb7f60 0x55cfcebc15f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.163:42336/0 (socket says 172.21.15.163:42336) 2023-07-14T18:27:13.132 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:27:13.065+0000 7f8217fff700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55cfcebb94b0 0x55cfcebc8b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:60518/0 (socket says 172.21.15.163:60518) 2023-07-14T18:27:13.132 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:27:13.065+0000 7f82177fe700 1 -- 172.21.15.163:0/1613628839 learned_addr learned my addr 172.21.15.163:0/1613628839 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:27:13.133 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:27:13.065+0000 7f8216ffd700 1 --2- 172.21.15.163:0/1613628839 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55cfcebb88b0 0x55cfcebc1b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:27:13.133 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:27:13.065+0000 7f8217fff700 1 -- 172.21.15.163:0/1613628839 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55cfcebb7f60 msgr2=0x55cfcebc15f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:27:13.133 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:27:13.065+0000 7f8217fff700 1 --2- 172.21.15.163:0/1613628839 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55cfcebb7f60 0x55cfcebc15f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:27:13.134 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:27:13.065+0000 7f8217fff700 1 -- 172.21.15.163:0/1613628839 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55cfcebb88b0 msgr2=0x55cfcebc1b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:27:13.134 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:27:13.065+0000 7f8217fff700 1 --2- 172.21.15.163:0/1613628839 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55cfcebb88b0 0x55cfcebc1b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:27:13.134 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:27:13.065+0000 7f8217fff700 1 -- 172.21.15.163:0/1613628839 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8208017070 con 0x55cfcebb94b0 2023-07-14T18:27:13.134 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:27:13.065+0000 7f82177fe700 1 --2- 172.21.15.163:0/1613628839 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55cfcebb7f60 0x55cfcebc15f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T18:27:13.135 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:27:13.065+0000 7f8217fff700 1 --2- 172.21.15.163:0/1613628839 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55cfcebb94b0 0x55cfcebc8b70 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7f8210097920 tx=0x7f82100971f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe4b57000f503ea0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:27:13.135 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:27:13.065+0000 7f81f6ffd700 10 client.0 ms_handle_connect on v2:172.21.15.163:3300/0 2023-07-14T18:27:13.135 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:27:13.065+0000 7f81f6ffd700 1 -- 172.21.15.163:0/1613628839 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f821009b310 con 0x55cfcebb94b0 2023-07-14T18:27:13.135 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:27:13.065+0000 7f81f6ffd700 1 -- 172.21.15.163:0/1613628839 <== mon.0 v2:172.21.15.163:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 9049+0+0 (secure 0 0 0) 0x7f821009eee0 con 0x55cfcebb94b0 2023-07-14T18:27:13.135 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:27:13.065+0000 7f8229e3db80 1 -- 172.21.15.163:0/1613628839 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55cfcea624f0 con 0x55cfcebb94b0 2023-07-14T18:27:13.136 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:27:13.065+0000 7f81f6ffd700 1 -- 172.21.15.163:0/1613628839 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) v2 ==== 24+0+0 (secure 0 0 0) 0x7f82100a2de0 con 0x55cfcebb94b0 2023-07-14T18:27:13.136 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:27:13.065+0000 7f8229e3db80 10 client.16692 fetch_fsmap learned FSMap version 39 2023-07-14T18:27:13.136 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:27:13.065+0000 7f8229e3db80 1 -- 172.21.15.163:0/1613628839 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) v3 -- 0x7f820c009c90 con 0x55cfcebb94b0 2023-07-14T18:27:13.136 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:27:13.066+0000 7f81f6ffd700 1 -- 172.21.15.163:0/1613628839 <== mon.0 v2:172.21.15.163:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55cfcea624f0 con 0x55cfcebb94b0 2023-07-14T18:27:13.137 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:27:13.066+0000 7f81f6ffd700 1 -- 172.21.15.163:0/1613628839 <== mon.0 v2:172.21.15.163:3300/0 5 ==== fsmap(e 39) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f82100aeb20 con 0x55cfcebb94b0 2023-07-14T18:27:13.137 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:27:13.066+0000 7f8229e3db80 10 client.16692 fetch_fsmap finished waiting for FSMap version 39 2023-07-14T18:27:13.137 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:27:13.066+0000 7f8229e3db80 10 client.16692 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-07-14T18:27:13.137 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:27:13.066+0000 7f8229e3db80 20 client.16692 populate_metadata read hostname 'smithi163' 2023-07-14T18:27:13.137 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:27:13.066+0000 7f8229e3db80 1 --2- 172.21.15.163:0/1613628839 >> [v2:172.21.15.172:6838/3850440096,v1:172.21.15.172:6839/3850440096] conn(0x55cfcebcce80 0x55cfcebcf260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:27:13.138 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:27:13.066+0000 7f8229e3db80 4 client.16692 mds_command: new command op to 24518 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-14T18:27:13.138 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:27:13.066+0000 7f8229e3db80 1 -- 172.21.15.163:0/1613628839 --> [v2:172.21.15.172:6838/3850440096,v1:172.21.15.172:6839/3850440096] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55cfceb86da0 con 0x55cfcebcce80 2023-07-14T18:27:13.138 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:27:13.066+0000 7f82177fe700 1 --2- 172.21.15.163:0/1613628839 >> [v2:172.21.15.172:6838/3850440096,v1:172.21.15.172:6839/3850440096] conn(0x55cfcebcce80 0x55cfcebcf260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:27:13.138 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:27:13.067+0000 7f81f6ffd700 10 client.16692 ms_handle_connect on v2:172.21.15.172:6838/3850440096 2023-07-14T18:27:13.139 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:27:13.067+0000 7f82177fe700 1 --2- 172.21.15.163:0/1613628839 >> [v2:172.21.15.172:6838/3850440096,v1:172.21.15.172:6839/3850440096] conn(0x55cfcebcce80 0x55cfcebcf260 crc :-1 s=READY pgs=115 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b997fe2e6d041081 server_cookie=d42995af1ba13bb3 in_seq=0 out_seq=0 2023-07-14T18:27:13.139 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:27:13.067+0000 7f81f6ffd700 1 -- 172.21.15.163:0/1613628839 <== mds.0 v2:172.21.15.172:6838/3850440096 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18017 (crc 0 0 0) 0x55cfceb86da0 con 0x55cfcebcce80 2023-07-14T18:27:13.139 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:27:13.067+0000 7f81f6ffd700 10 client.16692 handle_command_reply: tid=0 2023-07-14T18:27:13.140 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:27:13.067+0000 7f8229e3db80 1 client.16692 shutdown 2023-07-14T18:27:13.140 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:27:13.067+0000 7f8229e3db80 1 -- 172.21.15.163:0/1613628839 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55cfcebb94b0 msgr2=0x55cfcebc8b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:27:13.141 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:27:13.067+0000 7f8229e3db80 1 --2- 172.21.15.163:0/1613628839 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55cfcebb94b0 0x55cfcebc8b70 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7f8210097920 tx=0x7f82100971f0 comp rx=0 tx=0).stop 2023-07-14T18:27:13.141 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:27:13.067+0000 7f8229e3db80 1 -- 172.21.15.163:0/1613628839 shutdown_connections 2023-07-14T18:27:13.141 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:27:13.067+0000 7f8229e3db80 1 --2- 172.21.15.163:0/1613628839 >> [v2:172.21.15.172:6838/3850440096,v1:172.21.15.172:6839/3850440096] conn(0x55cfcebcce80 0x55cfcebcf260 crc :-1 s=READY pgs=115 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:27:13.142 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:27:13.067+0000 7f8229e3db80 1 --2- 172.21.15.163:0/1613628839 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55cfcebb7f60 0x55cfcebc15f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:27:13.142 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:27:13.067+0000 7f8229e3db80 1 --2- 172.21.15.163:0/1613628839 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55cfcebb94b0 0x55cfcebc8b70 unknown :-1 s=CLOSED pgs=744 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:27:13.143 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:27:13.067+0000 7f8229e3db80 1 --2- 172.21.15.163:0/1613628839 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55cfcebb88b0 0x55cfcebc1b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:27:13.143 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:27:13.067+0000 7f8229e3db80 1 -- 172.21.15.163:0/1613628839 >> 172.21.15.163:0/1613628839 conn(0x55cfcebad680 msgr2=0x55cfcebb1650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:27:13.144 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:27:13.067+0000 7f81f6ffd700 0 client.16692 ms_handle_reset on v2:172.21.15.172:6838/3850440096 2023-07-14T18:27:13.144 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:27:13.067+0000 7f8229e3db80 1 -- 172.21.15.163:0/1613628839 shutdown_connections 2023-07-14T18:27:13.144 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:27:13.067+0000 7f8229e3db80 1 -- 172.21.15.163:0/1613628839 wait complete. 2023-07-14T18:27:13.145 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:27:13.068+0000 7f8229e3db80 20 client.16692 trim_cache size 0 max 16384 2023-07-14T18:27:13.150 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:27:13.090+0000 7f8229e3db80 1 Processor -- start 2023-07-14T18:27:13.150 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:27:13.090+0000 7f8229e3db80 1 -- start start 2023-07-14T18:27:13.150 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:27:13.090+0000 7f8229e3db80 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55cfcebb7f60 0x55cfcebbf7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:27:13.150 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:27:13.090+0000 7f8229e3db80 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55cfcebb88b0 0x55cfcebbfd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:27:13.151 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:27:13.090+0000 7f8229e3db80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55cfcebb94b0 0x55cfcebc15b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:27:13.151 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:27:13.090+0000 7f8229e3db80 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cfcebb9330 con 0x55cfcebb88b0 2023-07-14T18:27:13.151 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:27:13.090+0000 7f8229e3db80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cfcebc0aa0 con 0x55cfcebb94b0 2023-07-14T18:27:13.151 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:27:13.090+0000 7f8229e3db80 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cfcebc1160 con 0x55cfcebb7f60 2023-07-14T18:27:13.152 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:27:13.090+0000 7f8216ffd700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55cfcebb88b0 0x55cfcebbfd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:27:13.152 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:27:13.090+0000 7f82177fe700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55cfcebb7f60 0x55cfcebbf7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:27:13.152 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:27:13.090+0000 7f8216ffd700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55cfcebb88b0 0x55cfcebbfd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:60524/0 (socket says 172.21.15.163:60524) 2023-07-14T18:27:13.152 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:27:13.091+0000 7f8216ffd700 1 -- 172.21.15.163:0/514835970 learned_addr learned my addr 172.21.15.163:0/514835970 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:27:13.153 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:27:13.091+0000 7f8217fff700 1 --2- 172.21.15.163:0/514835970 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55cfcebb94b0 0x55cfcebc15b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:27:13.153 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:27:13.091+0000 7f8216ffd700 1 -- 172.21.15.163:0/514835970 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55cfcebb7f60 msgr2=0x55cfcebbf7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:27:13.153 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:27:13.091+0000 7f8216ffd700 1 --2- 172.21.15.163:0/514835970 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55cfcebb7f60 0x55cfcebbf7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:27:13.153 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:27:13.091+0000 7f8216ffd700 1 -- 172.21.15.163:0/514835970 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55cfcebb94b0 msgr2=0x55cfcebc15b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:27:13.154 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:27:13.091+0000 7f8216ffd700 1 --2- 172.21.15.163:0/514835970 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55cfcebb94b0 0x55cfcebc15b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:27:13.154 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:27:13.091+0000 7f8216ffd700 1 -- 172.21.15.163:0/514835970 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f821819dee0 con 0x55cfcebb88b0 2023-07-14T18:27:13.154 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:27:13.091+0000 7f8216ffd700 1 --2- 172.21.15.163:0/514835970 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55cfcebb88b0 0x55cfcebbfd00 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7f820c0127a0 tx=0x7f820c009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba1b164da84128a3 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:27:13.154 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:27:13.091+0000 7f81fe7fc700 1 -- 172.21.15.163:0/514835970 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f820c017070 con 0x55cfcebb88b0 2023-07-14T18:27:13.154 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:27:13.091+0000 7f81fe7fc700 1 -- 172.21.15.163:0/514835970 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f820c018040 con 0x55cfcebb88b0 2023-07-14T18:27:13.155 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:27:13.091+0000 7f81fe7fc700 1 -- 172.21.15.163:0/514835970 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f820c003e90 con 0x55cfcebb88b0 2023-07-14T18:27:13.155 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:27:13.092+0000 7f8229e3db80 1 -- 172.21.15.163:0/514835970 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55cfcebb88b0 msgr2=0x55cfcebbfd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:27:13.155 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:27:13.092+0000 7f8229e3db80 1 --2- 172.21.15.163:0/514835970 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55cfcebb88b0 0x55cfcebbfd00 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7f820c0127a0 tx=0x7f820c009260 comp rx=0 tx=0).stop 2023-07-14T18:27:13.155 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:27:13.092+0000 7f8229e3db80 1 -- 172.21.15.163:0/514835970 shutdown_connections 2023-07-14T18:27:13.156 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:27:13.092+0000 7f8229e3db80 1 --2- 172.21.15.163:0/514835970 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55cfcebb7f60 0x55cfcebbf7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:27:13.156 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:27:13.092+0000 7f8229e3db80 1 --2- 172.21.15.163:0/514835970 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55cfcebb94b0 0x55cfcebc15b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:27:13.156 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:27:13.092+0000 7f8229e3db80 1 --2- 172.21.15.163:0/514835970 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55cfcebb88b0 0x55cfcebbfd00 unknown :-1 s=CLOSED pgs=745 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:27:13.156 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:27:13.092+0000 7f8229e3db80 1 -- 172.21.15.163:0/514835970 >> 172.21.15.163:0/514835970 conn(0x55cfcebad680 msgr2=0x55cfcebbc2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:27:13.157 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:27:13.092+0000 7f8229e3db80 1 -- 172.21.15.163:0/514835970 shutdown_connections 2023-07-14T18:27:13.157 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:27:13.092+0000 7f8229e3db80 1 -- 172.21.15.163:0/514835970 wait complete. 2023-07-14T18:27:13.157 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:27:13.092+0000 7f8229e3db80 1 -- start start 2023-07-14T18:27:13.157 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:27:13.093+0000 7f8229e3db80 1 Processor -- start 2023-07-14T18:27:13.158 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:27:13.093+0000 7f8229e3db80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55cfcebb7f60 0x55cfcec1cd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:27:13.158 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:27:13.093+0000 7f8229e3db80 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55cfcebb88b0 0x55cfcec1d250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:27:13.158 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:27:13.093+0000 7f8229e3db80 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55cfcebb94b0 0x55cfcec241d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:27:13.158 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:27:13.093+0000 7f8229e3db80 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cfcec24710 con 0x55cfcebb88b0 2023-07-14T18:27:13.159 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:27:13.093+0000 7f8229e3db80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cfcec24850 con 0x55cfcebb7f60 2023-07-14T18:27:13.159 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:27:13.093+0000 7f8229e3db80 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cfcec24a10 con 0x55cfcebb94b0 2023-07-14T18:27:13.159 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:27:13.093+0000 7f8229e3db80 10 client.0 _ll_register_callbacks cb 0x55cfceaa6760 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T18:27:13.159 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:27:13.093+0000 7f82177fe700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55cfcebb7f60 0x55cfcec1cd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:27:13.159 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:27:13.093+0000 7f82177fe700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55cfcebb7f60 0x55cfcec1cd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.163:32980/0 (socket says 172.21.15.163:32980) 2023-07-14T18:27:13.160 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:27:13.093+0000 7f8217fff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55cfcebb94b0 0x55cfcec241d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:27:13.160 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:27:13.093+0000 7f82177fe700 1 -- 172.21.15.163:0/930696306 learned_addr learned my addr 172.21.15.163:0/930696306 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:27:13.160 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:27:13.093+0000 7f8216ffd700 1 --2- 172.21.15.163:0/930696306 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55cfcebb88b0 0x55cfcec1d250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:27:13.160 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:27:13.093+0000 7f8217fff700 1 -- 172.21.15.163:0/930696306 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55cfcebb7f60 msgr2=0x55cfcec1cd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:27:13.161 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:27:13.093+0000 7f8217fff700 1 --2- 172.21.15.163:0/930696306 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55cfcebb7f60 0x55cfcec1cd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:27:13.161 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:27:13.093+0000 7f8217fff700 1 -- 172.21.15.163:0/930696306 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55cfcebb88b0 msgr2=0x55cfcec1d250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:27:13.161 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:27:13.093+0000 7f8217fff700 1 --2- 172.21.15.163:0/930696306 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55cfcebb88b0 0x55cfcec1d250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:27:13.161 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:27:13.094+0000 7f8217fff700 1 -- 172.21.15.163:0/930696306 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f820c012450 con 0x55cfcebb94b0 2023-07-14T18:27:13.162 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:27:13.094+0000 7f82177fe700 1 --2- 172.21.15.163:0/930696306 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55cfcebb7f60 0x55cfcec1cd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T18:27:13.162 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:27:13.094+0000 7f8217fff700 1 --2- 172.21.15.163:0/930696306 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55cfcebb94b0 0x55cfcec241d0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f82100973b0 tx=0x7f821000b3b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=49cf4eedeb51ed1b server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:27:13.163 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:27:13.094+0000 7f81f6ffd700 10 client.0 ms_handle_connect on v2:172.21.15.184:3300/0 2023-07-14T18:27:13.163 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:27:13.094+0000 7f81f6ffd700 1 -- 172.21.15.163:0/930696306 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8210097780 con 0x55cfcebb94b0 2023-07-14T18:27:13.163 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:27:13.094+0000 7f8229e3db80 1 -- 172.21.15.163:0/930696306 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f82100a0070 con 0x55cfcebb94b0 2023-07-14T18:27:13.164 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:27:13.094+0000 7f81f6ffd700 1 -- 172.21.15.163:0/930696306 <== mon.1 v2:172.21.15.184:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 9049+0+0 (secure 0 0 0) 0x7f821009eee0 con 0x55cfcebb94b0 2023-07-14T18:27:13.164 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:27:13.094+0000 7f81f6ffd700 1 -- 172.21.15.163:0/930696306 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) v2 ==== 24+0+0 (secure 0 0 0) 0x7f82100cb0c0 con 0x55cfcebb94b0 2023-07-14T18:27:13.165 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:27:13.094+0000 7f8229e3db80 10 client.26266 fetch_fsmap learned FSMap version 39 2023-07-14T18:27:13.165 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:27:13.094+0000 7f8229e3db80 1 -- 172.21.15.163:0/930696306 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) v3 -- 0x55cfce91fc60 con 0x55cfcebb94b0 2023-07-14T18:27:13.166 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:27:13.094+0000 7f81f6ffd700 1 -- 172.21.15.163:0/930696306 <== mon.1 v2:172.21.15.184:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f82100a0070 con 0x55cfcebb94b0 2023-07-14T18:27:13.166 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:27:13.094+0000 7f81f6ffd700 1 -- 172.21.15.163:0/930696306 <== mon.1 v2:172.21.15.184:3300/0 5 ==== fsmap(e 39) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f8210096ca0 con 0x55cfcebb94b0 2023-07-14T18:27:13.167 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:27:13.094+0000 7f8229e3db80 10 client.26266 fetch_fsmap finished waiting for FSMap version 39 2023-07-14T18:27:13.167 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:27:13.095+0000 7f8229e3db80 10 client.26266 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-07-14T18:27:13.168 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:27:13.095+0000 7f8229e3db80 20 client.26266 populate_metadata read hostname 'smithi163' 2023-07-14T18:27:13.168 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:27:13.095+0000 7f8229e3db80 1 --2- 172.21.15.163:0/930696306 >> [v2:172.21.15.172:6838/3850440096,v1:172.21.15.172:6839/3850440096] conn(0x55cfcec25d20 0x55cfcec28100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:27:13.169 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:27:13.095+0000 7f8229e3db80 4 client.26266 mds_command: new command op to 24518 tid=0[{"prefix": "scrub status"}] 2023-07-14T18:27:13.169 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:27:13.095+0000 7f8229e3db80 1 -- 172.21.15.163:0/930696306 --> [v2:172.21.15.172:6838/3850440096,v1:172.21.15.172:6839/3850440096] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55cfceb01eb0 con 0x55cfcec25d20 2023-07-14T18:27:13.169 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:27:13.095+0000 7f82177fe700 1 --2- 172.21.15.163:0/930696306 >> [v2:172.21.15.172:6838/3850440096,v1:172.21.15.172:6839/3850440096] conn(0x55cfcec25d20 0x55cfcec28100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:27:13.170 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:27:13.095+0000 7f81f6ffd700 10 client.26266 ms_handle_connect on v2:172.21.15.172:6838/3850440096 2023-07-14T18:27:13.170 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:27:13.095+0000 7f82177fe700 1 --2- 172.21.15.163:0/930696306 >> [v2:172.21.15.172:6838/3850440096,v1:172.21.15.172:6839/3850440096] conn(0x55cfcec25d20 0x55cfcec28100 crc :-1 s=READY pgs=116 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=797506927e32a2ad server_cookie=ebd077c85791fd7b in_seq=0 out_seq=0 2023-07-14T18:27:13.170 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:27:13.095+0000 7f81f6ffd700 1 -- 172.21.15.163:0/930696306 <== mds.0 v2:172.21.15.172:6838/3850440096 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x55cfceb01eb0 con 0x55cfcec25d20 2023-07-14T18:27:13.171 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:27:13.095+0000 7f81f6ffd700 10 client.26266 handle_command_reply: tid=0 2023-07-14T18:27:13.171 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:27:13.095+0000 7f8229e3db80 1 client.26266 shutdown 2023-07-14T18:27:13.172 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:27:13.095+0000 7f8229e3db80 1 -- 172.21.15.163:0/930696306 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55cfcebb94b0 msgr2=0x55cfcec241d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:27:13.172 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:27:13.095+0000 7f8229e3db80 1 --2- 172.21.15.163:0/930696306 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55cfcebb94b0 0x55cfcec241d0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f82100973b0 tx=0x7f821000b3b0 comp rx=0 tx=0).stop 2023-07-14T18:27:13.173 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:27:13.096+0000 7f8229e3db80 1 -- 172.21.15.163:0/930696306 shutdown_connections 2023-07-14T18:27:13.173 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:27:13.096+0000 7f8229e3db80 1 --2- 172.21.15.163:0/930696306 >> [v2:172.21.15.172:6838/3850440096,v1:172.21.15.172:6839/3850440096] conn(0x55cfcec25d20 0x55cfcec28100 crc :-1 s=READY pgs=116 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:27:13.173 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:27:13.096+0000 7f8229e3db80 1 --2- 172.21.15.163:0/930696306 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55cfcebb94b0 0x55cfcec241d0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:27:13.173 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:27:13.096+0000 7f8229e3db80 1 --2- 172.21.15.163:0/930696306 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55cfcebb7f60 0x55cfcec1cd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:27:13.174 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:27:13.096+0000 7f8229e3db80 1 --2- 172.21.15.163:0/930696306 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55cfcebb88b0 0x55cfcec1d250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:27:13.174 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:27:13.096+0000 7f81f6ffd700 0 client.26266 ms_handle_reset on v2:172.21.15.172:6838/3850440096 2023-07-14T18:27:13.174 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:27:13.096+0000 7f8229e3db80 1 -- 172.21.15.163:0/930696306 >> 172.21.15.163:0/930696306 conn(0x55cfcebad680 msgr2=0x55cfcebbf7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:27:13.174 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:27:13.096+0000 7f8229e3db80 1 -- 172.21.15.163:0/930696306 shutdown_connections 2023-07-14T18:27:13.174 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:27:13.096+0000 7f8229e3db80 1 -- 172.21.15.163:0/930696306 wait complete. 2023-07-14T18:27:13.175 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:27:13.096+0000 7f8229e3db80 20 client.26266 trim_cache size 0 max 16384 2023-07-14T18:27:13.175 INFO:teuthology.orchestra.run.smithi163.stdout:{ 2023-07-14T18:27:13.176 INFO:teuthology.orchestra.run.smithi163.stdout: "status": "IDLE (waiting for more scrubs)", 2023-07-14T18:27:13.176 INFO:teuthology.orchestra.run.smithi163.stdout: "scrubs": { 2023-07-14T18:27:13.176 INFO:teuthology.orchestra.run.smithi163.stdout: "2c53b7ef-6f30-49f0-a60d-f1f114c19d42": { 2023-07-14T18:27:13.176 INFO:teuthology.orchestra.run.smithi163.stdout: "path": "/", 2023-07-14T18:27:13.177 INFO:teuthology.orchestra.run.smithi163.stdout: "tag": "2c53b7ef-6f30-49f0-a60d-f1f114c19d42", 2023-07-14T18:27:13.177 INFO:teuthology.orchestra.run.smithi163.stdout: "options": "recursive,force" 2023-07-14T18:27:13.177 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-07-14T18:27:13.177 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-07-14T18:27:13.177 INFO:teuthology.orchestra.run.smithi163.stdout:} 2023-07-14T18:27:13.179 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:27:13.096+0000 7f821dca5700 1 -- 172.21.15.163:0/2365255297 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f82000a1150 msgr2=0x7f82000a3600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:27:13.179 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:27:13.096+0000 7f821dca5700 1 --2- 172.21.15.163:0/2365255297 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f82000a1150 0x7f82000a3600 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f8208005950 tx=0x7f8208009260 comp rx=0 tx=0).stop 2023-07-14T18:27:13.179 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:27:13.096+0000 7f821dca5700 1 -- 172.21.15.163:0/2365255297 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f82181017c0 msgr2=0x7f821819cef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:27:13.179 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:27:13.096+0000 7f821dca5700 1 --2- 172.21.15.163:0/2365255297 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f82181017c0 0x7f821819cef0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f8210015000 tx=0x7f8210009570 comp rx=0 tx=0).stop 2023-07-14T18:27:13.180 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:27:13.096+0000 7f821dca5700 1 -- 172.21.15.163:0/2365255297 shutdown_connections 2023-07-14T18:27:13.180 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:27:13.096+0000 7f821dca5700 1 --2- 172.21.15.163:0/2365255297 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f82000a1150 0x7f82000a3600 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:27:13.180 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:27:13.096+0000 7f821dca5700 1 --2- 172.21.15.163:0/2365255297 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f82181017c0 0x7f821819cef0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:27:13.180 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:27:13.096+0000 7f821dca5700 1 --2- 172.21.15.163:0/2365255297 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f82180ffc40 0x7f8218195940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:27:13.180 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:27:13.096+0000 7f821dca5700 1 --2- 172.21.15.163:0/2365255297 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8218100e30 0x7f8218195e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:27:13.181 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:27:13.096+0000 7f821dca5700 1 -- 172.21.15.163:0/2365255297 >> 172.21.15.163:0/2365255297 conn(0x7f82180fb260 msgr2=0x7f82181042d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:27:13.181 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:27:13.096+0000 7f821dca5700 1 -- 172.21.15.163:0/2365255297 shutdown_connections 2023-07-14T18:27:13.181 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:27:13.097+0000 7f821dca5700 1 -- 172.21.15.163:0/2365255297 wait complete. 2023-07-14T18:27:13.181 INFO:tasks.cephfs.filesystem:scrub status for tag:2c53b7ef-6f30-49f0-a60d-f1f114c19d42 - {'path': '/', 'tag': '2c53b7ef-6f30-49f0-a60d-f1f114c19d42', 'options': 'recursive,force'} 2023-07-14T18:27:15.026 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:27:14 smithi172 ceph-mon[97983]: pgmap v737: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-07-14T18:27:15.175 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:27:14 smithi184 ceph-mon[98481]: pgmap v737: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-07-14T18:27:15.218 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:27:14 smithi163 ceph-mon[96576]: pgmap v737: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-07-14T18:27:17.026 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:27:16 smithi172 ceph-mon[97983]: pgmap v738: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-07-14T18:27:17.175 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:27:16 smithi184 ceph-mon[98481]: pgmap v738: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-07-14T18:27:17.219 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:27:16 smithi163 ceph-mon[96576]: pgmap v738: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-07-14T18:27:19.026 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:27:18 smithi172 ceph-mon[97983]: pgmap v739: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-07-14T18:27:19.175 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:27:18 smithi184 ceph-mon[98481]: pgmap v739: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-07-14T18:27:19.217 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:27:18 smithi163 ceph-mon[96576]: pgmap v739: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-07-14T18:27:21.026 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:27:20 smithi172 ceph-mon[97983]: pgmap v740: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-07-14T18:27:21.175 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:27:20 smithi184 ceph-mon[98481]: pgmap v740: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-07-14T18:27:21.217 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:27:20 smithi163 ceph-mon[96576]: pgmap v740: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-07-14T18:27:22.276 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:27:21 smithi172 ceph-mon[97983]: pgmap v741: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-07-14T18:27:22.425 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:27:21 smithi184 ceph-mon[98481]: pgmap v741: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-07-14T18:27:22.467 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:27:21 smithi163 ceph-mon[96576]: pgmap v741: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-07-14T18:27:25.026 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:27:24 smithi172 ceph-mon[97983]: pgmap v742: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-07-14T18:27:25.175 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:27:24 smithi184 ceph-mon[98481]: pgmap v742: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-07-14T18:27:25.217 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:27:24 smithi163 ceph-mon[96576]: pgmap v742: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-07-14T18:27:27.025 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:27:26 smithi172 ceph-mon[97983]: pgmap v743: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-07-14T18:27:27.175 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:27:26 smithi184 ceph-mon[98481]: pgmap v743: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-07-14T18:27:27.217 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:27:26 smithi163 ceph-mon[96576]: pgmap v743: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-07-14T18:27:29.025 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:27:28 smithi172 ceph-mon[97983]: pgmap v744: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-07-14T18:27:29.174 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:27:28 smithi184 ceph-mon[98481]: pgmap v744: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-07-14T18:27:29.217 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:27:28 smithi163 ceph-mon[96576]: pgmap v744: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-07-14T18:27:31.025 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:27:30 smithi172 ceph-mon[97983]: pgmap v745: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-07-14T18:27:31.174 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:27:30 smithi184 ceph-mon[98481]: pgmap v745: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-07-14T18:27:31.217 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:27:30 smithi163 ceph-mon[96576]: pgmap v745: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-07-14T18:27:32.275 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:27:31 smithi172 ceph-mon[97983]: pgmap v746: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-07-14T18:27:32.424 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:27:31 smithi184 ceph-mon[98481]: pgmap v746: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-07-14T18:27:32.466 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:27:31 smithi163 ceph-mon[96576]: pgmap v746: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-07-14T18:27:35.025 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:27:34 smithi172 ceph-mon[97983]: pgmap v747: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-07-14T18:27:35.174 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:27:34 smithi184 ceph-mon[98481]: pgmap v747: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-07-14T18:27:35.216 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:27:34 smithi163 ceph-mon[96576]: pgmap v747: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-07-14T18:27:37.025 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:27:36 smithi172 ceph-mon[97983]: pgmap v748: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-07-14T18:27:37.025 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:27:36 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-14T18:27:37.174 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:27:36 smithi184 ceph-mon[98481]: pgmap v748: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-07-14T18:27:37.174 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:27:36 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-14T18:27:37.216 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:27:36 smithi163 ceph-mon[96576]: pgmap v748: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-07-14T18:27:37.251 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:27:36 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-14T18:27:38.025 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:27:37 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T18:27:38.025 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:27:37 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-14T18:27:38.025 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:27:37 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:27:38.174 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:27:37 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T18:27:38.175 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:27:37 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-14T18:27:38.175 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:27:37 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:27:38.216 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:27:37 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T18:27:38.217 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:27:37 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-14T18:27:38.217 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:27:37 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:27:39.174 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:27:38 smithi184 ceph-mon[98481]: pgmap v749: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-07-14T18:27:39.216 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:27:38 smithi163 ceph-mon[96576]: pgmap v749: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-07-14T18:27:39.274 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:27:38 smithi172 ceph-mon[97983]: pgmap v749: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-07-14T18:27:41.173 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:27:40 smithi184 ceph-mon[98481]: pgmap v750: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-07-14T18:27:41.216 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:27:40 smithi163 ceph-mon[96576]: pgmap v750: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-07-14T18:27:41.274 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:27:40 smithi172 ceph-mon[97983]: pgmap v750: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-07-14T18:27:42.274 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:27:41 smithi172 ceph-mon[97983]: pgmap v751: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-07-14T18:27:42.423 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:27:41 smithi184 ceph-mon[98481]: pgmap v751: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-07-14T18:27:42.466 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:27:41 smithi163 ceph-mon[96576]: pgmap v751: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-07-14T18:27:43.183 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-07-14T18:27:43.331 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:27:43.291+0000 7f95ea39e700 1 -- 172.21.15.163:0/2382698220 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f95e40fea00 msgr2=0x7f95e40fee10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:27:43.331 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:27:43.291+0000 7f95ea39e700 1 --2- 172.21.15.163:0/2382698220 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f95e40fea00 0x7f95e40fee10 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f95e0009990 tx=0x7f95e0009ca0 comp rx=0 tx=0).stop 2023-07-14T18:27:43.332 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:27:43.291+0000 7f95ea39e700 1 -- 172.21.15.163:0/2382698220 shutdown_connections 2023-07-14T18:27:43.332 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:27:43.291+0000 7f95ea39e700 1 --2- 172.21.15.163:0/2382698220 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f95e4100580 0x7f95e4106e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:27:43.332 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:27:43.291+0000 7f95ea39e700 1 --2- 172.21.15.163:0/2382698220 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f95e40fea00 0x7f95e40fee10 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:27:43.332 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:27:43.291+0000 7f95ea39e700 1 --2- 172.21.15.163:0/2382698220 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f95e40ffbf0 0x7f95e4100040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:27:43.333 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:27:43.291+0000 7f95ea39e700 1 -- 172.21.15.163:0/2382698220 >> 172.21.15.163:0/2382698220 conn(0x7f95e40fa000 msgr2=0x7f95e40fc450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:27:43.333 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:27:43.291+0000 7f95ea39e700 1 -- 172.21.15.163:0/2382698220 shutdown_connections 2023-07-14T18:27:43.333 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:27:43.291+0000 7f95ea39e700 1 -- 172.21.15.163:0/2382698220 wait complete. 2023-07-14T18:27:43.335 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:27:43.292+0000 7f95ea39e700 1 Processor -- start 2023-07-14T18:27:43.335 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:27:43.292+0000 7f95ea39e700 1 -- start start 2023-07-14T18:27:43.335 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:27:43.292+0000 7f95ea39e700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f95e40fea00 0x7f95e4068310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:27:43.335 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:27:43.292+0000 7f95ea39e700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f95e40ffbf0 0x7f95e419a3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:27:43.336 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:27:43.292+0000 7f95ea39e700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f95e4100580 0x7f95e419c9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:27:43.336 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:27:43.292+0000 7f95ea39e700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95e419d190 con 0x7f95e4100580 2023-07-14T18:27:43.336 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:27:43.292+0000 7f95ea39e700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95e419d300 con 0x7f95e40ffbf0 2023-07-14T18:27:43.336 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:27:43.292+0000 7f95ea39e700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95e419d4c0 con 0x7f95e40fea00 2023-07-14T18:27:43.336 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:27:43.292+0000 7f95e939c700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f95e40fea00 0x7f95e4068310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:27:43.337 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:27:43.292+0000 7f95e939c700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f95e40fea00 0x7f95e4068310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.163:42362/0 (socket says 172.21.15.163:42362) 2023-07-14T18:27:43.337 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:27:43.292+0000 7f95e8b9b700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f95e40ffbf0 0x7f95e419a3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:27:43.337 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:27:43.292+0000 7f95e939c700 1 -- 172.21.15.163:0/4187198401 learned_addr learned my addr 172.21.15.163:0/4187198401 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:27:43.337 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:27:43.292+0000 7f95e9b9d700 1 --2- 172.21.15.163:0/4187198401 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f95e4100580 0x7f95e419c9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:27:43.337 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:27:43.293+0000 7f95e939c700 1 -- 172.21.15.163:0/4187198401 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f95e40ffbf0 msgr2=0x7f95e419a3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:27:43.338 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:27:43.293+0000 7f95e939c700 1 --2- 172.21.15.163:0/4187198401 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f95e40ffbf0 0x7f95e419a3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:27:43.338 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:27:43.293+0000 7f95e939c700 1 -- 172.21.15.163:0/4187198401 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f95e4100580 msgr2=0x7f95e419c9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:27:43.338 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:27:43.293+0000 7f95e939c700 1 --2- 172.21.15.163:0/4187198401 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f95e4100580 0x7f95e419c9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:27:43.338 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:27:43.293+0000 7f95e939c700 1 -- 172.21.15.163:0/4187198401 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95e00095f0 con 0x7f95e40fea00 2023-07-14T18:27:43.339 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:27:43.293+0000 7f95e8b9b700 1 --2- 172.21.15.163:0/4187198401 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f95e40ffbf0 0x7f95e419a3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T18:27:43.339 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:27:43.293+0000 7f95e9b9d700 1 --2- 172.21.15.163:0/4187198401 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f95e4100580 0x7f95e419c9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T18:27:43.339 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:27:43.293+0000 7f95e939c700 1 --2- 172.21.15.163:0/4187198401 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f95e40fea00 0x7f95e4068310 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f95e00098e0 tx=0x7f95e0004730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:27:43.340 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:27:43.293+0000 7f95da7fc700 1 -- 172.21.15.163:0/4187198401 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95e001d070 con 0x7f95e40fea00 2023-07-14T18:27:43.340 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:27:43.293+0000 7f95ea39e700 1 -- 172.21.15.163:0/4187198401 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f95e419d740 con 0x7f95e40fea00 2023-07-14T18:27:43.340 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:27:43.293+0000 7f95ea39e700 1 -- 172.21.15.163:0/4187198401 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f95e419dbc0 con 0x7f95e40fea00 2023-07-14T18:27:43.341 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:27:43.293+0000 7f95da7fc700 1 -- 172.21.15.163:0/4187198401 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f95e000bd50 con 0x7f95e40fea00 2023-07-14T18:27:43.341 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:27:43.293+0000 7f95da7fc700 1 -- 172.21.15.163:0/4187198401 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95e0022c40 con 0x7f95e40fea00 2023-07-14T18:27:43.347 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:27:43.295+0000 7f95da7fc700 1 -- 172.21.15.163:0/4187198401 <== mon.1 v2:172.21.15.184:3300/0 4 ==== mgrmap(e 18) v1 ==== 135716+0+0 (secure 0 0 0) 0x7f95e0022470 con 0x7f95e40fea00 2023-07-14T18:27:43.348 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:27:43.296+0000 7f95da7fc700 1 --2- 172.21.15.163:0/4187198401 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f95d00a1270 0x7f95d00a3720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:27:43.348 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:27:43.296+0000 7f95e8b9b700 1 --2- 172.21.15.163:0/4187198401 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f95d00a1270 0x7f95d00a3720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:27:43.348 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:27:43.296+0000 7f95da7fc700 1 -- 172.21.15.163:0/4187198401 <== mon.1 v2:172.21.15.184:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 9049+0+0 (secure 0 0 0) 0x7f95e00cded0 con 0x7f95e40fea00 2023-07-14T18:27:43.349 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:27:43.297+0000 7f95e8b9b700 1 --2- 172.21.15.163:0/4187198401 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f95d00a1270 0x7f95d00a3720 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f95d4011490 tx=0x7f95d4009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:27:43.349 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:27:43.297+0000 7f95f7798b80 1 Processor -- start 2023-07-14T18:27:43.349 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:27:43.297+0000 7f95f7798b80 1 -- start start 2023-07-14T18:27:43.350 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:27:43.297+0000 7f95f7798b80 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a805d98110 0x55a805d98520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:27:43.350 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:27:43.297+0000 7f95f7798b80 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55a805d98a60 0x55a805d99050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:27:43.351 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:27:43.298+0000 7f95f7798b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a805d99650 0x55a805d99ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:27:43.351 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:27:43.298+0000 7f95f7798b80 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a805c9ccb0 con 0x55a805d98a60 2023-07-14T18:27:43.351 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:27:43.298+0000 7f95f7798b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a805cefa40 con 0x55a805d99650 2023-07-14T18:27:43.352 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:27:43.298+0000 7f95f7798b80 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a805ce8ed0 con 0x55a805d98110 2023-07-14T18:27:43.352 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:27:43.298+0000 7f95e939c700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a805d98110 0x55a805d98520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:27:43.352 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:27:43.298+0000 7f95e8b9b700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55a805d98a60 0x55a805d99050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:27:43.353 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:27:43.298+0000 7f95e939c700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a805d98110 0x55a805d98520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.163:42370/0 (socket says 172.21.15.163:42370) 2023-07-14T18:27:43.353 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:27:43.298+0000 7f95e939c700 1 -- 172.21.15.163:0/1936970216 learned_addr learned my addr 172.21.15.163:0/1936970216 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:27:43.354 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:27:43.298+0000 7f95e9b9d700 1 --2- 172.21.15.163:0/1936970216 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a805d99650 0x55a805d99ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:27:43.354 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:27:43.298+0000 7f95e939c700 1 -- 172.21.15.163:0/1936970216 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a805d99650 msgr2=0x55a805d99ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:27:43.355 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:27:43.298+0000 7f95e939c700 1 --2- 172.21.15.163:0/1936970216 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a805d99650 0x55a805d99ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:27:43.355 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:27:43.298+0000 7f95e939c700 1 -- 172.21.15.163:0/1936970216 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55a805d98a60 msgr2=0x55a805d99050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:27:43.355 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:27:43.298+0000 7f95e939c700 1 --2- 172.21.15.163:0/1936970216 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55a805d98a60 0x55a805d99050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:27:43.356 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:27:43.298+0000 7f95e939c700 1 -- 172.21.15.163:0/1936970216 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a805b16de0 con 0x55a805d98110 2023-07-14T18:27:43.356 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:27:43.298+0000 7f95e939c700 1 --2- 172.21.15.163:0/1936970216 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a805d98110 0x55a805d98520 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f95e009afd0 tx=0x7f95e0004320 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c40d7a3c9175a494 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:27:43.356 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:27:43.298+0000 7f95cf7fe700 1 -- 172.21.15.163:0/1936970216 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95e009b040 con 0x55a805d98110 2023-07-14T18:27:43.357 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:27:43.298+0000 7f95cf7fe700 1 -- 172.21.15.163:0/1936970216 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f95e009f070 con 0x55a805d98110 2023-07-14T18:27:43.357 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:27:43.298+0000 7f95cf7fe700 1 -- 172.21.15.163:0/1936970216 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95e00a2f70 con 0x55a805d98110 2023-07-14T18:27:43.357 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:27:43.299+0000 7f95f7798b80 1 -- 172.21.15.163:0/1936970216 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a805d98110 msgr2=0x55a805d98520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:27:43.358 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:27:43.299+0000 7f95f7798b80 1 --2- 172.21.15.163:0/1936970216 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a805d98110 0x55a805d98520 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f95e009afd0 tx=0x7f95e0004320 comp rx=0 tx=0).stop 2023-07-14T18:27:43.358 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:27:43.299+0000 7f95f7798b80 1 -- 172.21.15.163:0/1936970216 shutdown_connections 2023-07-14T18:27:43.359 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:27:43.299+0000 7f95f7798b80 1 --2- 172.21.15.163:0/1936970216 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a805d98110 0x55a805d98520 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:27:43.359 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:27:43.299+0000 7f95f7798b80 1 --2- 172.21.15.163:0/1936970216 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a805d99650 0x55a805d99ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:27:43.359 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:27:43.299+0000 7f95f7798b80 1 --2- 172.21.15.163:0/1936970216 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55a805d98a60 0x55a805d99050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:27:43.360 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:27:43.299+0000 7f95f7798b80 1 -- 172.21.15.163:0/1936970216 >> 172.21.15.163:0/1936970216 conn(0x55a805d8d7e0 msgr2=0x55a805d92ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:27:43.360 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:27:43.299+0000 7f95f7798b80 1 -- 172.21.15.163:0/1936970216 shutdown_connections 2023-07-14T18:27:43.360 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:27:43.299+0000 7f95f7798b80 1 -- 172.21.15.163:0/1936970216 wait complete. 2023-07-14T18:27:43.360 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:27:43.300+0000 7f95f7798b80 1 -- start start 2023-07-14T18:27:43.360 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:27:43.300+0000 7f95f7798b80 1 Processor -- start 2023-07-14T18:27:43.361 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:27:43.300+0000 7f95f7798b80 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55a805d98110 0x55a805da17c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:27:43.361 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:27:43.300+0000 7f95f7798b80 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a805d98a60 0x55a805da1d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:27:43.361 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:27:43.300+0000 7f95f7798b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a805d99650 0x55a805da8d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:27:43.361 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:27:43.300+0000 7f95f7798b80 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a805c88ac0 con 0x55a805d98110 2023-07-14T18:27:43.361 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:27:43.300+0000 7f95f7798b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a805c887c0 con 0x55a805d99650 2023-07-14T18:27:43.362 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:27:43.300+0000 7f95f7798b80 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a805b6c920 con 0x55a805d98a60 2023-07-14T18:27:43.362 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:27:43.300+0000 7f95f7798b80 10 client.0 _ll_register_callbacks cb 0x55a805c86760 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T18:27:43.362 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:27:43.300+0000 7f95e939c700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55a805d98110 0x55a805da17c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:27:43.362 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:27:43.300+0000 7f95e939c700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55a805d98110 0x55a805da17c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:60554/0 (socket says 172.21.15.163:60554) 2023-07-14T18:27:43.362 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:27:43.300+0000 7f95e939c700 1 -- 172.21.15.163:0/3359498937 learned_addr learned my addr 172.21.15.163:0/3359498937 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:27:43.363 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:27:43.300+0000 7f95e8b9b700 1 --2- 172.21.15.163:0/3359498937 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a805d98a60 0x55a805da1d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:27:43.363 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:27:43.300+0000 7f95e9b9d700 1 --2- 172.21.15.163:0/3359498937 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a805d99650 0x55a805da8d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:27:43.363 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:27:43.301+0000 7f95e8b9b700 1 -- 172.21.15.163:0/3359498937 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a805d99650 msgr2=0x55a805da8d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:27:43.363 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:27:43.301+0000 7f95e8b9b700 1 --2- 172.21.15.163:0/3359498937 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a805d99650 0x55a805da8d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:27:43.363 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:27:43.301+0000 7f95e8b9b700 1 -- 172.21.15.163:0/3359498937 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55a805d98110 msgr2=0x55a805da17c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:27:43.364 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:27:43.301+0000 7f95e8b9b700 1 --2- 172.21.15.163:0/3359498937 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55a805d98110 0x55a805da17c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:27:43.364 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:27:43.301+0000 7f95e8b9b700 1 -- 172.21.15.163:0/3359498937 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f95e419dbc0 con 0x55a805d98a60 2023-07-14T18:27:43.364 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:27:43.301+0000 7f95e9b9d700 1 --2- 172.21.15.163:0/3359498937 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a805d99650 0x55a805da8d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T18:27:43.364 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:27:43.301+0000 7f95e939c700 1 --2- 172.21.15.163:0/3359498937 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55a805d98110 0x55a805da17c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T18:27:43.365 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:27:43.301+0000 7f95e8b9b700 1 --2- 172.21.15.163:0/3359498937 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a805d98a60 0x55a805da1d00 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x55a805d98e70 tx=0x7f95d40047c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=27f706dff5ed490b server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:27:43.365 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:27:43.301+0000 7f95ccff9700 10 client.0 ms_handle_connect on v2:172.21.15.184:3300/0 2023-07-14T18:27:43.365 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:27:43.301+0000 7f95ccff9700 1 -- 172.21.15.163:0/3359498937 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95d401fa60 con 0x55a805d98a60 2023-07-14T18:27:43.365 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:27:43.301+0000 7f95f7798b80 1 -- 172.21.15.163:0/3359498937 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55a805c424f0 con 0x55a805d98a60 2023-07-14T18:27:43.366 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:27:43.301+0000 7f95ccff9700 1 -- 172.21.15.163:0/3359498937 <== mon.1 v2:172.21.15.184:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 9049+0+0 (secure 0 0 0) 0x7f95d401fbc0 con 0x55a805d98a60 2023-07-14T18:27:43.366 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:27:43.301+0000 7f95ccff9700 1 -- 172.21.15.163:0/3359498937 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) v2 ==== 24+0+0 (secure 0 0 0) 0x7f95d401fdc0 con 0x55a805d98a60 2023-07-14T18:27:43.366 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:27:43.301+0000 7f95f7798b80 10 client.26278 fetch_fsmap learned FSMap version 39 2023-07-14T18:27:43.366 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:27:43.301+0000 7f95f7798b80 1 -- 172.21.15.163:0/3359498937 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) v3 -- 0x55a805affc60 con 0x55a805d98a60 2023-07-14T18:27:43.366 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:27:43.302+0000 7f95ccff9700 1 -- 172.21.15.163:0/3359498937 <== mon.1 v2:172.21.15.184:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55a805c424f0 con 0x55a805d98a60 2023-07-14T18:27:43.367 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:27:43.302+0000 7f95ccff9700 1 -- 172.21.15.163:0/3359498937 <== mon.1 v2:172.21.15.184:3300/0 5 ==== fsmap(e 39) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f95d40273e0 con 0x55a805d98a60 2023-07-14T18:27:43.367 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:27:43.302+0000 7f95f7798b80 10 client.26278 fetch_fsmap finished waiting for FSMap version 39 2023-07-14T18:27:43.367 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:27:43.302+0000 7f95f7798b80 10 client.26278 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-07-14T18:27:43.367 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:27:43.302+0000 7f95f7798b80 20 client.26278 populate_metadata read hostname 'smithi163' 2023-07-14T18:27:43.367 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:27:43.302+0000 7f95f7798b80 1 --2- 172.21.15.163:0/3359498937 >> [v2:172.21.15.172:6838/3850440096,v1:172.21.15.172:6839/3850440096] conn(0x55a805dad650 0x55a805dafa60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:27:43.368 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:27:43.302+0000 7f95f7798b80 4 client.26278 mds_command: new command op to 24518 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-14T18:27:43.368 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:27:43.302+0000 7f95f7798b80 1 -- 172.21.15.163:0/3359498937 --> [v2:172.21.15.172:6838/3850440096,v1:172.21.15.172:6839/3850440096] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55a805d66da0 con 0x55a805dad650 2023-07-14T18:27:43.368 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:27:43.302+0000 7f95e939c700 1 --2- 172.21.15.163:0/3359498937 >> [v2:172.21.15.172:6838/3850440096,v1:172.21.15.172:6839/3850440096] conn(0x55a805dad650 0x55a805dafa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:27:43.368 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:27:43.302+0000 7f95e939c700 1 --2- 172.21.15.163:0/3359498937 >> [v2:172.21.15.172:6838/3850440096,v1:172.21.15.172:6839/3850440096] conn(0x55a805dad650 0x55a805dafa60 crc :-1 s=READY pgs=117 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9719bca0d8f95013 server_cookie=8aa4b1f05aabdac7 in_seq=0 out_seq=0 2023-07-14T18:27:43.369 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:27:43.302+0000 7f95ccff9700 10 client.26278 ms_handle_connect on v2:172.21.15.172:6838/3850440096 2023-07-14T18:27:43.369 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:27:43.303+0000 7f95ccff9700 1 -- 172.21.15.163:0/3359498937 <== mds.0 v2:172.21.15.172:6838/3850440096 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18017 (crc 0 0 0) 0x55a805d66da0 con 0x55a805dad650 2023-07-14T18:27:43.369 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:27:43.303+0000 7f95ccff9700 10 client.26278 handle_command_reply: tid=0 2023-07-14T18:27:43.369 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:27:43.303+0000 7f95f7798b80 1 client.26278 shutdown 2023-07-14T18:27:43.369 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:27:43.303+0000 7f95f7798b80 1 -- 172.21.15.163:0/3359498937 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a805d98a60 msgr2=0x55a805da1d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:27:43.370 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:27:43.303+0000 7f95f7798b80 1 --2- 172.21.15.163:0/3359498937 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a805d98a60 0x55a805da1d00 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x55a805d98e70 tx=0x7f95d40047c0 comp rx=0 tx=0).stop 2023-07-14T18:27:43.370 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:27:43.303+0000 7f95f7798b80 1 -- 172.21.15.163:0/3359498937 shutdown_connections 2023-07-14T18:27:43.370 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:27:43.303+0000 7f95f7798b80 1 --2- 172.21.15.163:0/3359498937 >> [v2:172.21.15.172:6838/3850440096,v1:172.21.15.172:6839/3850440096] conn(0x55a805dad650 0x55a805dafa60 crc :-1 s=READY pgs=117 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:27:43.370 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:27:43.303+0000 7f95f7798b80 1 --2- 172.21.15.163:0/3359498937 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a805d99650 0x55a805da8d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:27:43.370 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:27:43.303+0000 7f95f7798b80 1 --2- 172.21.15.163:0/3359498937 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55a805d98110 0x55a805da17c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:27:43.371 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:27:43.303+0000 7f95f7798b80 1 --2- 172.21.15.163:0/3359498937 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a805d98a60 0x55a805da1d00 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:27:43.371 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:27:43.303+0000 7f95ccff9700 0 client.26278 ms_handle_reset on v2:172.21.15.172:6838/3850440096 2023-07-14T18:27:43.371 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:27:43.303+0000 7f95f7798b80 1 -- 172.21.15.163:0/3359498937 >> 172.21.15.163:0/3359498937 conn(0x55a805d8d7e0 msgr2=0x55a805d92280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:27:43.371 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:27:43.303+0000 7f95f7798b80 1 -- 172.21.15.163:0/3359498937 shutdown_connections 2023-07-14T18:27:43.371 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:27:43.303+0000 7f95f7798b80 1 -- 172.21.15.163:0/3359498937 wait complete. 2023-07-14T18:27:43.372 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:27:43.304+0000 7f95f7798b80 20 client.26278 trim_cache size 0 max 16384 2023-07-14T18:27:43.375 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:27:43.322+0000 7f95f7798b80 1 Processor -- start 2023-07-14T18:27:43.375 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:27:43.323+0000 7f95f7798b80 1 -- start start 2023-07-14T18:27:43.376 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:27:43.323+0000 7f95f7798b80 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a805d98110 0x55a805db43c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:27:43.376 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:27:43.323+0000 7f95f7798b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a805d98a60 0x55a805da8d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:27:43.376 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:27:43.323+0000 7f95f7798b80 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55a805d99650 0x55a805da0510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:27:43.376 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:27:43.323+0000 7f95f7798b80 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a805da1330 con 0x55a805d99650 2023-07-14T18:27:43.376 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:27:43.323+0000 7f95f7798b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a805d946d0 con 0x55a805d98a60 2023-07-14T18:27:43.377 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:27:43.323+0000 7f95f7798b80 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a805d8d400 con 0x55a805d98110 2023-07-14T18:27:43.377 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:27:43.323+0000 7f95e939c700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a805d98110 0x55a805db43c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:27:43.377 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:27:43.323+0000 7f95e9b9d700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55a805d99650 0x55a805da0510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:27:43.377 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:27:43.323+0000 7f95e939c700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a805d98110 0x55a805db43c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.163:42384/0 (socket says 172.21.15.163:42384) 2023-07-14T18:27:43.377 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:27:43.323+0000 7f95e939c700 1 -- 172.21.15.163:0/1638745990 learned_addr learned my addr 172.21.15.163:0/1638745990 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:27:43.378 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:27:43.323+0000 7f95e8b9b700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a805d98a60 0x55a805da8d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:27:43.378 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:27:43.323+0000 7f95e939c700 1 -- 172.21.15.163:0/1638745990 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a805d98a60 msgr2=0x55a805da8d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:27:43.378 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:27:43.323+0000 7f95e939c700 1 --2- 172.21.15.163:0/1638745990 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a805d98a60 0x55a805da8d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:27:43.378 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:27:43.323+0000 7f95e939c700 1 -- 172.21.15.163:0/1638745990 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55a805d99650 msgr2=0x55a805da0510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:27:43.378 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:27:43.323+0000 7f95e939c700 1 --2- 172.21.15.163:0/1638745990 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55a805d99650 0x55a805da0510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:27:43.379 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:27:43.323+0000 7f95e939c700 1 -- 172.21.15.163:0/1638745990 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a805b3d250 con 0x55a805d98110 2023-07-14T18:27:43.379 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:27:43.323+0000 7f95e939c700 1 --2- 172.21.15.163:0/1638745990 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a805d98110 0x55a805db43c0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f95e0097540 tx=0x7f95e0024040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7be51e4a0ebc66b8 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:27:43.379 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:27:43.323+0000 7f95cffff700 1 -- 172.21.15.163:0/1638745990 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95e00993e0 con 0x55a805d98110 2023-07-14T18:27:43.379 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:27:43.324+0000 7f95cffff700 1 -- 172.21.15.163:0/1638745990 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f95e00b2070 con 0x55a805d98110 2023-07-14T18:27:43.379 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:27:43.324+0000 7f95cffff700 1 -- 172.21.15.163:0/1638745990 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95e00cbdc0 con 0x55a805d98110 2023-07-14T18:27:43.380 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:27:43.324+0000 7f95f7798b80 1 -- 172.21.15.163:0/1638745990 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a805d98110 msgr2=0x55a805db43c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:27:43.380 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:27:43.324+0000 7f95f7798b80 1 --2- 172.21.15.163:0/1638745990 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a805d98110 0x55a805db43c0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f95e0097540 tx=0x7f95e0024040 comp rx=0 tx=0).stop 2023-07-14T18:27:43.380 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:27:43.324+0000 7f95f7798b80 1 -- 172.21.15.163:0/1638745990 shutdown_connections 2023-07-14T18:27:43.381 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:27:43.324+0000 7f95f7798b80 1 --2- 172.21.15.163:0/1638745990 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a805d98110 0x55a805db43c0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:27:43.381 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:27:43.324+0000 7f95f7798b80 1 --2- 172.21.15.163:0/1638745990 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55a805d99650 0x55a805da0510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:27:43.381 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:27:43.324+0000 7f95f7798b80 1 --2- 172.21.15.163:0/1638745990 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a805d98a60 0x55a805da8d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:27:43.382 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:27:43.324+0000 7f95f7798b80 1 -- 172.21.15.163:0/1638745990 >> 172.21.15.163:0/1638745990 conn(0x55a805d8d7e0 msgr2=0x55a805d92b70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:27:43.382 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:27:43.324+0000 7f95f7798b80 1 -- 172.21.15.163:0/1638745990 shutdown_connections 2023-07-14T18:27:43.382 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:27:43.324+0000 7f95f7798b80 1 -- 172.21.15.163:0/1638745990 wait complete. 2023-07-14T18:27:43.383 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:27:43.324+0000 7f95f7798b80 1 -- start start 2023-07-14T18:27:43.383 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:27:43.325+0000 7f95f7798b80 1 Processor -- start 2023-07-14T18:27:43.383 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:27:43.325+0000 7f95f7798b80 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55a805d98110 0x55a805da4f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:27:43.383 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:27:43.325+0000 7f95f7798b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a805d98a60 0x55a805da5470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:27:43.384 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:27:43.325+0000 7f95f7798b80 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a805d99650 0x55a805da7f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:27:43.384 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:27:43.325+0000 7f95f7798b80 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a805da8440 con 0x55a805d98110 2023-07-14T18:27:43.384 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:27:43.325+0000 7f95f7798b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a805da85b0 con 0x55a805d98a60 2023-07-14T18:27:43.384 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:27:43.325+0000 7f95f7798b80 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a805da8770 con 0x55a805d99650 2023-07-14T18:27:43.384 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:27:43.325+0000 7f95f7798b80 10 client.0 _ll_register_callbacks cb 0x7f95d4003680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T18:27:43.385 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:27:43.325+0000 7f95e939c700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55a805d98110 0x55a805da4f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:27:43.385 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:27:43.325+0000 7f95e939c700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55a805d98110 0x55a805da4f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:60568/0 (socket says 172.21.15.163:60568) 2023-07-14T18:27:43.385 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:27:43.325+0000 7f95e8b9b700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a805d98a60 0x55a805da5470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:27:43.385 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:27:43.325+0000 7f95e939c700 1 -- 172.21.15.163:0/1080082778 learned_addr learned my addr 172.21.15.163:0/1080082778 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:27:43.385 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:27:43.325+0000 7f95e9b9d700 1 --2- 172.21.15.163:0/1080082778 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a805d99650 0x55a805da7f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:27:43.386 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:27:43.325+0000 7f95e939c700 1 -- 172.21.15.163:0/1080082778 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a805d99650 msgr2=0x55a805da7f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:27:43.386 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:27:43.325+0000 7f95e939c700 1 --2- 172.21.15.163:0/1080082778 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a805d99650 0x55a805da7f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:27:43.386 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:27:43.325+0000 7f95e939c700 1 -- 172.21.15.163:0/1080082778 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a805d98a60 msgr2=0x55a805da5470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:27:43.386 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:27:43.325+0000 7f95e939c700 1 --2- 172.21.15.163:0/1080082778 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a805d98a60 0x55a805da5470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:27:43.387 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:27:43.325+0000 7f95e939c700 1 -- 172.21.15.163:0/1080082778 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55a805b16de0 con 0x55a805d98110 2023-07-14T18:27:43.387 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:27:43.325+0000 7f95e8b9b700 1 --2- 172.21.15.163:0/1080082778 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a805d98a60 0x55a805da5470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T18:27:43.387 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:27:43.326+0000 7f95e939c700 1 --2- 172.21.15.163:0/1080082778 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55a805d98110 0x55a805da4f30 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7f95e00a35c0 tx=0x7f95e0009310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ceee2561ae00fd6 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:27:43.387 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:27:43.326+0000 7f95ccff9700 10 client.0 ms_handle_connect on v2:172.21.15.163:3300/0 2023-07-14T18:27:43.387 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:27:43.326+0000 7f95ccff9700 1 -- 172.21.15.163:0/1080082778 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95e009a780 con 0x55a805d98110 2023-07-14T18:27:43.388 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:27:43.326+0000 7f95ccff9700 1 -- 172.21.15.163:0/1080082778 <== mon.0 v2:172.21.15.163:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 9049+0+0 (secure 0 0 0) 0x7f95e00b9280 con 0x55a805d98110 2023-07-14T18:27:43.388 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:27:43.326+0000 7f95f7798b80 1 -- 172.21.15.163:0/1080082778 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f95e009f070 con 0x55a805d98110 2023-07-14T18:27:43.388 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:27:43.326+0000 7f95ccff9700 1 -- 172.21.15.163:0/1080082778 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) v2 ==== 24+0+0 (secure 0 0 0) 0x7f95e000b8c0 con 0x55a805d98110 2023-07-14T18:27:43.388 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:27:43.326+0000 7f95f7798b80 10 client.16716 fetch_fsmap learned FSMap version 39 2023-07-14T18:27:43.389 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:27:43.326+0000 7f95f7798b80 1 -- 172.21.15.163:0/1080082778 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) v3 -- 0x55a805b152b0 con 0x55a805d98110 2023-07-14T18:27:43.389 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:27:43.326+0000 7f95ccff9700 1 -- 172.21.15.163:0/1080082778 <== mon.0 v2:172.21.15.163:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f95e007d020 con 0x55a805d98110 2023-07-14T18:27:43.389 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:27:43.326+0000 7f95ccff9700 1 -- 172.21.15.163:0/1080082778 <== mon.0 v2:172.21.15.163:3300/0 5 ==== fsmap(e 39) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f95e0096ec0 con 0x55a805d98110 2023-07-14T18:27:43.389 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:27:43.326+0000 7f95f7798b80 10 client.16716 fetch_fsmap finished waiting for FSMap version 39 2023-07-14T18:27:43.389 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:27:43.326+0000 7f95f7798b80 10 client.16716 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-07-14T18:27:43.390 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:27:43.326+0000 7f95f7798b80 20 client.16716 populate_metadata read hostname 'smithi163' 2023-07-14T18:27:43.390 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:27:43.326+0000 7f95f7798b80 1 --2- 172.21.15.163:0/1080082778 >> [v2:172.21.15.172:6838/3850440096,v1:172.21.15.172:6839/3850440096] conn(0x55a805e01d50 0x55a805e04160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:27:43.390 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:27:43.326+0000 7f95f7798b80 4 client.16716 mds_command: new command op to 24518 tid=0[{"prefix": "scrub status"}] 2023-07-14T18:27:43.390 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:27:43.326+0000 7f95f7798b80 1 -- 172.21.15.163:0/1080082778 --> [v2:172.21.15.172:6838/3850440096,v1:172.21.15.172:6839/3850440096] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55a805ce1eb0 con 0x55a805e01d50 2023-07-14T18:27:43.390 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:27:43.327+0000 7f95e8b9b700 1 --2- 172.21.15.163:0/1080082778 >> [v2:172.21.15.172:6838/3850440096,v1:172.21.15.172:6839/3850440096] conn(0x55a805e01d50 0x55a805e04160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:27:43.391 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:27:43.327+0000 7f95e8b9b700 1 --2- 172.21.15.163:0/1080082778 >> [v2:172.21.15.172:6838/3850440096,v1:172.21.15.172:6839/3850440096] conn(0x55a805e01d50 0x55a805e04160 crc :-1 s=READY pgs=118 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c8a302346942def8 server_cookie=cb593ff3f389b99b in_seq=0 out_seq=0 2023-07-14T18:27:43.391 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:27:43.327+0000 7f95ccff9700 10 client.16716 ms_handle_connect on v2:172.21.15.172:6838/3850440096 2023-07-14T18:27:43.391 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:27:43.327+0000 7f95ccff9700 1 -- 172.21.15.163:0/1080082778 <== mds.0 v2:172.21.15.172:6838/3850440096 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x55a805ce1eb0 con 0x55a805e01d50 2023-07-14T18:27:43.392 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:27:43.327+0000 7f95ccff9700 10 client.16716 handle_command_reply: tid=0 2023-07-14T18:27:43.392 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:27:43.327+0000 7f95f7798b80 1 client.16716 shutdown 2023-07-14T18:27:43.392 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:27:43.327+0000 7f95f7798b80 1 -- 172.21.15.163:0/1080082778 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55a805d98110 msgr2=0x55a805da4f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:27:43.392 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:27:43.327+0000 7f95f7798b80 1 --2- 172.21.15.163:0/1080082778 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55a805d98110 0x55a805da4f30 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7f95e00a35c0 tx=0x7f95e0009310 comp rx=0 tx=0).stop 2023-07-14T18:27:43.393 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:27:43.327+0000 7f95f7798b80 1 -- 172.21.15.163:0/1080082778 shutdown_connections 2023-07-14T18:27:43.393 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:27:43.327+0000 7f95f7798b80 1 --2- 172.21.15.163:0/1080082778 >> [v2:172.21.15.172:6838/3850440096,v1:172.21.15.172:6839/3850440096] conn(0x55a805e01d50 0x55a805e04160 crc :-1 s=READY pgs=118 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:27:43.393 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:27:43.327+0000 7f95f7798b80 1 --2- 172.21.15.163:0/1080082778 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a805d99650 0x55a805da7f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:27:43.393 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:27:43.327+0000 7f95f7798b80 1 --2- 172.21.15.163:0/1080082778 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55a805d98110 0x55a805da4f30 unknown :-1 s=CLOSED pgs=746 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:27:43.393 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:27:43.327+0000 7f95f7798b80 1 --2- 172.21.15.163:0/1080082778 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a805d98a60 0x55a805da5470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:27:43.394 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:27:43.327+0000 7f95f7798b80 1 -- 172.21.15.163:0/1080082778 >> 172.21.15.163:0/1080082778 conn(0x55a805d8d7e0 msgr2=0x55a805da9510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:27:43.394 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:27:43.327+0000 7f95ccff9700 0 client.16716 ms_handle_reset on v2:172.21.15.172:6838/3850440096 2023-07-14T18:27:43.394 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:27:43.327+0000 7f95f7798b80 1 -- 172.21.15.163:0/1080082778 shutdown_connections 2023-07-14T18:27:43.394 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:27:43.327+0000 7f95f7798b80 1 -- 172.21.15.163:0/1080082778 wait complete. 2023-07-14T18:27:43.395 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:27:43.328+0000 7f95f7798b80 20 client.16716 trim_cache size 0 max 16384 2023-07-14T18:27:43.395 INFO:teuthology.orchestra.run.smithi163.stdout:{ 2023-07-14T18:27:43.395 INFO:teuthology.orchestra.run.smithi163.stdout: "status": "IDLE (waiting for more scrubs)", 2023-07-14T18:27:43.396 INFO:teuthology.orchestra.run.smithi163.stdout: "scrubs": { 2023-07-14T18:27:43.396 INFO:teuthology.orchestra.run.smithi163.stdout: "2c53b7ef-6f30-49f0-a60d-f1f114c19d42": { 2023-07-14T18:27:43.396 INFO:teuthology.orchestra.run.smithi163.stdout: "path": "/", 2023-07-14T18:27:43.396 INFO:teuthology.orchestra.run.smithi163.stdout: "tag": "2c53b7ef-6f30-49f0-a60d-f1f114c19d42", 2023-07-14T18:27:43.396 INFO:teuthology.orchestra.run.smithi163.stdout: "options": "recursive,force" 2023-07-14T18:27:43.397 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-07-14T18:27:43.397 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-07-14T18:27:43.397 INFO:teuthology.orchestra.run.smithi163.stdout:} 2023-07-14T18:27:43.399 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:27:43.328+0000 7f95ea39e700 1 -- 172.21.15.163:0/4187198401 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f95d00a1270 msgr2=0x7f95d00a3720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:27:43.399 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:27:43.328+0000 7f95ea39e700 1 --2- 172.21.15.163:0/4187198401 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f95d00a1270 0x7f95d00a3720 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f95d4011490 tx=0x7f95d4009260 comp rx=0 tx=0).stop 2023-07-14T18:27:43.399 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:27:43.328+0000 7f95ea39e700 1 -- 172.21.15.163:0/4187198401 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f95e40fea00 msgr2=0x7f95e4068310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:27:43.399 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:27:43.328+0000 7f95ea39e700 1 --2- 172.21.15.163:0/4187198401 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f95e40fea00 0x7f95e4068310 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f95e00098e0 tx=0x7f95e0004730 comp rx=0 tx=0).stop 2023-07-14T18:27:43.400 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:27:43.328+0000 7f95ea39e700 1 -- 172.21.15.163:0/4187198401 shutdown_connections 2023-07-14T18:27:43.400 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:27:43.328+0000 7f95ea39e700 1 --2- 172.21.15.163:0/4187198401 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f95d00a1270 0x7f95d00a3720 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:27:43.400 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:27:43.328+0000 7f95ea39e700 1 --2- 172.21.15.163:0/4187198401 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f95e40fea00 0x7f95e4068310 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:27:43.400 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:27:43.328+0000 7f95ea39e700 1 --2- 172.21.15.163:0/4187198401 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f95e4100580 0x7f95e419c9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:27:43.401 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:27:43.328+0000 7f95ea39e700 1 --2- 172.21.15.163:0/4187198401 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f95e40ffbf0 0x7f95e419a3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:27:43.401 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:27:43.328+0000 7f95ea39e700 1 -- 172.21.15.163:0/4187198401 >> 172.21.15.163:0/4187198401 conn(0x7f95e40fa000 msgr2=0x7f95e41030e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:27:43.401 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:27:43.328+0000 7f95ea39e700 1 -- 172.21.15.163:0/4187198401 shutdown_connections 2023-07-14T18:27:43.401 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:27:43.328+0000 7f95ea39e700 1 -- 172.21.15.163:0/4187198401 wait complete. 2023-07-14T18:27:43.402 INFO:tasks.cephfs.filesystem:scrub status for tag:2c53b7ef-6f30-49f0-a60d-f1f114c19d42 - {'path': '/', 'tag': '2c53b7ef-6f30-49f0-a60d-f1f114c19d42', 'options': 'recursive,force'} 2023-07-14T18:27:45.024 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:27:44 smithi172 ceph-mon[97983]: pgmap v752: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2023-07-14T18:27:45.173 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:27:44 smithi184 ceph-mon[98481]: pgmap v752: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2023-07-14T18:27:45.216 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:27:44 smithi163 ceph-mon[96576]: pgmap v752: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2023-07-14T18:27:47.024 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:27:46 smithi172 ceph-mon[97983]: pgmap v753: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 8 op/s 2023-07-14T18:27:47.173 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:27:46 smithi184 ceph-mon[98481]: pgmap v753: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 8 op/s 2023-07-14T18:27:47.215 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:27:46 smithi163 ceph-mon[96576]: pgmap v753: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 8 op/s 2023-07-14T18:27:49.024 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:27:48 smithi172 ceph-mon[97983]: pgmap v754: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-07-14T18:27:49.173 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:27:48 smithi184 ceph-mon[98481]: pgmap v754: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-07-14T18:27:49.215 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:27:48 smithi163 ceph-mon[96576]: pgmap v754: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-07-14T18:27:51.024 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:27:50 smithi172 ceph-mon[97983]: pgmap v755: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-07-14T18:27:51.173 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:27:50 smithi184 ceph-mon[98481]: pgmap v755: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-07-14T18:27:51.215 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:27:50 smithi163 ceph-mon[96576]: pgmap v755: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-07-14T18:27:52.274 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:27:51 smithi172 ceph-mon[97983]: pgmap v756: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-07-14T18:27:52.423 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:27:51 smithi184 ceph-mon[98481]: pgmap v756: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-07-14T18:27:52.465 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:27:51 smithi163 ceph-mon[96576]: pgmap v756: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-07-14T18:27:55.023 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:27:54 smithi172 ceph-mon[97983]: pgmap v757: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-07-14T18:27:55.172 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:27:54 smithi184 ceph-mon[98481]: pgmap v757: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-07-14T18:27:55.215 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:27:54 smithi163 ceph-mon[96576]: pgmap v757: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-07-14T18:27:57.023 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:27:56 smithi172 ceph-mon[97983]: pgmap v758: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-07-14T18:27:57.172 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:27:56 smithi184 ceph-mon[98481]: pgmap v758: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-07-14T18:27:57.215 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:27:56 smithi163 ceph-mon[96576]: pgmap v758: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-07-14T18:27:59.023 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:27:58 smithi172 ceph-mon[97983]: pgmap v759: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-07-14T18:27:59.172 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:27:58 smithi184 ceph-mon[98481]: pgmap v759: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-07-14T18:27:59.215 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:27:58 smithi163 ceph-mon[96576]: pgmap v759: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-07-14T18:28:01.023 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:28:00 smithi172 ceph-mon[97983]: pgmap v760: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-07-14T18:28:01.172 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:28:00 smithi184 ceph-mon[98481]: pgmap v760: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-07-14T18:28:01.214 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:28:00 smithi163 ceph-mon[96576]: pgmap v760: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-07-14T18:28:02.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:28:01 smithi184 ceph-mon[98481]: pgmap v761: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-07-14T18:28:02.465 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:28:01 smithi163 ceph-mon[96576]: pgmap v761: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-07-14T18:28:02.523 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:28:01 smithi172 ceph-mon[97983]: pgmap v761: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-07-14T18:28:05.023 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:28:04 smithi172 ceph-mon[97983]: pgmap v762: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-07-14T18:28:05.172 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:28:04 smithi184 ceph-mon[98481]: pgmap v762: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-07-14T18:28:05.214 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:28:04 smithi163 ceph-mon[96576]: pgmap v762: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-07-14T18:28:07.023 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:28:06 smithi172 ceph-mon[97983]: pgmap v763: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-07-14T18:28:07.172 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:28:06 smithi184 ceph-mon[98481]: pgmap v763: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-07-14T18:28:07.214 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:28:06 smithi163 ceph-mon[96576]: pgmap v763: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-07-14T18:28:09.172 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:28:08 smithi184 ceph-mon[98481]: pgmap v764: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-07-14T18:28:09.214 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:28:08 smithi163 ceph-mon[96576]: pgmap v764: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-07-14T18:28:09.272 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:28:08 smithi172 ceph-mon[97983]: pgmap v764: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-07-14T18:28:11.171 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:28:10 smithi184 ceph-mon[98481]: pgmap v765: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-07-14T18:28:11.214 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:28:10 smithi163 ceph-mon[96576]: pgmap v765: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-07-14T18:28:11.272 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:28:10 smithi172 ceph-mon[97983]: pgmap v765: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-07-14T18:28:12.421 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:28:11 smithi184 ceph-mon[98481]: pgmap v766: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-07-14T18:28:12.464 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:28:11 smithi163 ceph-mon[96576]: pgmap v766: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-07-14T18:28:12.522 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:28:11 smithi172 ceph-mon[97983]: pgmap v766: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-07-14T18:28:13.403 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-07-14T18:28:13.562 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:28:13.525+0000 7f4a548d0700 1 -- 172.21.15.163:0/860363017 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f4a500ffe00 msgr2=0x7f4a501066c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:28:13.563 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:28:13.525+0000 7f4a548d0700 1 --2- 172.21.15.163:0/860363017 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f4a500ffe00 0x7f4a501066c0 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7f4a4800c210 tx=0x7f4a4800c520 comp rx=0 tx=0).stop 2023-07-14T18:28:13.563 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:28:13.526+0000 7f4a548d0700 1 -- 172.21.15.163:0/860363017 shutdown_connections 2023-07-14T18:28:13.563 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:28:13.526+0000 7f4a548d0700 1 --2- 172.21.15.163:0/860363017 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4a500fe280 0x7f4a500fe690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:28:13.564 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:28:13.526+0000 7f4a548d0700 1 --2- 172.21.15.163:0/860363017 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f4a500ffe00 0x7f4a501066c0 unknown :-1 s=CLOSED pgs=747 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:28:13.564 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:28:13.526+0000 7f4a548d0700 1 --2- 172.21.15.163:0/860363017 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4a500ff470 0x7f4a500ff8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:28:13.564 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:28:13.526+0000 7f4a548d0700 1 -- 172.21.15.163:0/860363017 >> 172.21.15.163:0/860363017 conn(0x7f4a500f98a0 msgr2=0x7f4a500fbcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:28:13.564 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:28:13.526+0000 7f4a548d0700 1 -- 172.21.15.163:0/860363017 shutdown_connections 2023-07-14T18:28:13.565 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:28:13.526+0000 7f4a548d0700 1 -- 172.21.15.163:0/860363017 wait complete. 2023-07-14T18:28:13.567 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:28:13.527+0000 7f4a548d0700 1 Processor -- start 2023-07-14T18:28:13.567 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:28:13.527+0000 7f4a548d0700 1 -- start start 2023-07-14T18:28:13.567 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:28:13.527+0000 7f4a548d0700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4a500fe280 0x7f4a501959e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:28:13.568 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:28:13.527+0000 7f4a548d0700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4a500ff470 0x7f4a50195f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:28:13.568 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:28:13.527+0000 7f4a548d0700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f4a500ffe00 0x7f4a5019cf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:28:13.568 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:28:13.527+0000 7f4a548d0700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a5019d560 con 0x7f4a500ffe00 2023-07-14T18:28:13.568 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:28:13.527+0000 7f4a548d0700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a5019d6a0 con 0x7f4a500ff470 2023-07-14T18:28:13.569 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:28:13.527+0000 7f4a548d0700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a5019d830 con 0x7f4a500fe280 2023-07-14T18:28:13.569 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:28:13.527+0000 7f4a4ed9d700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f4a500ffe00 0x7f4a5019cf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:28:13.570 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:28:13.527+0000 7f4a4e59c700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4a500fe280 0x7f4a501959e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:28:13.570 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:28:13.527+0000 7f4a4e59c700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4a500fe280 0x7f4a501959e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.163:42402/0 (socket says 172.21.15.163:42402) 2023-07-14T18:28:13.570 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:28:13.527+0000 7f4a4ed9d700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f4a500ffe00 0x7f4a5019cf90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:60584/0 (socket says 172.21.15.163:60584) 2023-07-14T18:28:13.571 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:28:13.527+0000 7f4a47fff700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4a500ff470 0x7f4a50195f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:28:13.571 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:28:13.527+0000 7f4a4e59c700 1 -- 172.21.15.163:0/1745292394 learned_addr learned my addr 172.21.15.163:0/1745292394 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:28:13.571 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:28:13.528+0000 7f4a4e59c700 1 -- 172.21.15.163:0/1745292394 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4a500ff470 msgr2=0x7f4a50195f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:28:13.571 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:28:13.528+0000 7f4a4e59c700 1 --2- 172.21.15.163:0/1745292394 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4a500ff470 0x7f4a50195f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:28:13.571 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:28:13.528+0000 7f4a4e59c700 1 -- 172.21.15.163:0/1745292394 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f4a500ffe00 msgr2=0x7f4a5019cf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:28:13.572 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:28:13.528+0000 7f4a4e59c700 1 --2- 172.21.15.163:0/1745292394 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f4a500ffe00 0x7f4a5019cf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:28:13.572 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:28:13.528+0000 7f4a4e59c700 1 -- 172.21.15.163:0/1745292394 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a4800ae10 con 0x7f4a500fe280 2023-07-14T18:28:13.572 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:28:13.528+0000 7f4a47fff700 1 --2- 172.21.15.163:0/1745292394 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4a500ff470 0x7f4a50195f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T18:28:13.572 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:28:13.528+0000 7f4a4e59c700 1 --2- 172.21.15.163:0/1745292394 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4a500fe280 0x7f4a501959e0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f4a4000e970 tx=0x7f4a4000ec80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:28:13.572 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:28:13.528+0000 7f4a477fe700 1 -- 172.21.15.163:0/1745292394 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a40009790 con 0x7f4a500fe280 2023-07-14T18:28:13.573 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:28:13.528+0000 7f4a548d0700 1 -- 172.21.15.163:0/1745292394 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4a5019db10 con 0x7f4a500fe280 2023-07-14T18:28:13.573 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:28:13.528+0000 7f4a548d0700 1 -- 172.21.15.163:0/1745292394 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4a5019e070 con 0x7f4a500fe280 2023-07-14T18:28:13.573 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:28:13.528+0000 7f4a477fe700 1 -- 172.21.15.163:0/1745292394 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f4a4000c7e0 con 0x7f4a500fe280 2023-07-14T18:28:13.573 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:28:13.528+0000 7f4a477fe700 1 -- 172.21.15.163:0/1745292394 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a40003a80 con 0x7f4a500fe280 2023-07-14T18:28:13.573 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:28:13.530+0000 7f4a477fe700 1 -- 172.21.15.163:0/1745292394 <== mon.1 v2:172.21.15.184:3300/0 4 ==== mgrmap(e 18) v1 ==== 135716+0+0 (secure 0 0 0) 0x7f4a40003d20 con 0x7f4a500fe280 2023-07-14T18:28:13.578 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:28:13.531+0000 7f4a477fe700 1 --2- 172.21.15.163:0/1745292394 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f4a3c0a1150 0x7f4a3c0a3600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:28:13.578 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:28:13.531+0000 7f4a47fff700 1 --2- 172.21.15.163:0/1745292394 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f4a3c0a1150 0x7f4a3c0a3600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:28:13.578 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:28:13.531+0000 7f4a477fe700 1 -- 172.21.15.163:0/1745292394 <== mon.1 v2:172.21.15.184:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 9049+0+0 (secure 0 0 0) 0x7f4a40014070 con 0x7f4a500fe280 2023-07-14T18:28:13.579 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:28:13.531+0000 7f4a60a68b80 1 Processor -- start 2023-07-14T18:28:13.579 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:28:13.532+0000 7f4a47fff700 1 --2- 172.21.15.163:0/1745292394 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f4a3c0a1150 0x7f4a3c0a3600 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f4a38011490 tx=0x7f4a38009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:28:13.579 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:28:13.532+0000 7f4a60a68b80 1 -- start start 2023-07-14T18:28:13.580 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:28:13.532+0000 7f4a60a68b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55707175ef60 0x55707175f370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:28:13.581 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:28:13.532+0000 7f4a60a68b80 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55707175f8b0 0x55707175fed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:28:13.581 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:28:13.532+0000 7f4a60a68b80 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5570717604b0 0x557071760920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:28:13.581 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:28:13.532+0000 7f4a60a68b80 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x557071663cb0 con 0x55707175f8b0 2023-07-14T18:28:13.581 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:28:13.532+0000 7f4a60a68b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x5570716b6a40 con 0x55707175ef60 2023-07-14T18:28:13.582 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:28:13.532+0000 7f4a60a68b80 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x5570716afed0 con 0x5570717604b0 2023-07-14T18:28:13.582 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:28:13.532+0000 7f4a47fff700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55707175f8b0 0x55707175fed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:28:13.582 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:28:13.532+0000 7f4a47fff700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55707175f8b0 0x55707175fed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:60590/0 (socket says 172.21.15.163:60590) 2023-07-14T18:28:13.583 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:28:13.532+0000 7f4a4e59c700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55707175ef60 0x55707175f370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:28:13.583 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:28:13.532+0000 7f4a47fff700 1 -- 172.21.15.163:0/4026528052 learned_addr learned my addr 172.21.15.163:0/4026528052 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:28:13.584 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:28:13.532+0000 7f4a4ed9d700 1 --2- 172.21.15.163:0/4026528052 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5570717604b0 0x557071760920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:28:13.584 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:28:13.532+0000 7f4a47fff700 1 -- 172.21.15.163:0/4026528052 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5570717604b0 msgr2=0x557071760920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:28:13.584 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:28:13.532+0000 7f4a47fff700 1 --2- 172.21.15.163:0/4026528052 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5570717604b0 0x557071760920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:28:13.585 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:28:13.532+0000 7f4a47fff700 1 -- 172.21.15.163:0/4026528052 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55707175ef60 msgr2=0x55707175f370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:28:13.585 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:28:13.532+0000 7f4a47fff700 1 --2- 172.21.15.163:0/4026528052 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55707175ef60 0x55707175f370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:28:13.585 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:28:13.532+0000 7f4a47fff700 1 -- 172.21.15.163:0/4026528052 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5570714ddde0 con 0x55707175f8b0 2023-07-14T18:28:13.585 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:28:13.532+0000 7f4a4e59c700 1 --2- 172.21.15.163:0/4026528052 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55707175ef60 0x55707175f370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T18:28:13.585 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:28:13.533+0000 7f4a47fff700 1 --2- 172.21.15.163:0/4026528052 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55707175f8b0 0x55707175fed0 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7f4a380043c0 tx=0x7f4a38014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c0318ec9ea67b860 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:28:13.586 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:28:13.533+0000 7f4a44ff9700 1 -- 172.21.15.163:0/4026528052 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a38003d10 con 0x55707175f8b0 2023-07-14T18:28:13.586 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:28:13.533+0000 7f4a44ff9700 1 -- 172.21.15.163:0/4026528052 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f4a38003e70 con 0x55707175f8b0 2023-07-14T18:28:13.586 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:28:13.533+0000 7f4a44ff9700 1 -- 172.21.15.163:0/4026528052 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a3801e770 con 0x55707175f8b0 2023-07-14T18:28:13.586 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:28:13.534+0000 7f4a60a68b80 1 -- 172.21.15.163:0/4026528052 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55707175f8b0 msgr2=0x55707175fed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:28:13.587 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:28:13.534+0000 7f4a60a68b80 1 --2- 172.21.15.163:0/4026528052 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55707175f8b0 0x55707175fed0 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7f4a380043c0 tx=0x7f4a38014000 comp rx=0 tx=0).stop 2023-07-14T18:28:13.587 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:28:13.534+0000 7f4a60a68b80 1 -- 172.21.15.163:0/4026528052 shutdown_connections 2023-07-14T18:28:13.587 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:28:13.534+0000 7f4a60a68b80 1 --2- 172.21.15.163:0/4026528052 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5570717604b0 0x557071760920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:28:13.588 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:28:13.534+0000 7f4a60a68b80 1 --2- 172.21.15.163:0/4026528052 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55707175ef60 0x55707175f370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:28:13.588 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:28:13.534+0000 7f4a60a68b80 1 --2- 172.21.15.163:0/4026528052 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55707175f8b0 0x55707175fed0 unknown :-1 s=CLOSED pgs=748 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:28:13.588 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:28:13.534+0000 7f4a60a68b80 1 -- 172.21.15.163:0/4026528052 >> 172.21.15.163:0/4026528052 conn(0x557071754680 msgr2=0x5570717599d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:28:13.588 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:28:13.534+0000 7f4a60a68b80 1 -- 172.21.15.163:0/4026528052 shutdown_connections 2023-07-14T18:28:13.589 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:28:13.534+0000 7f4a60a68b80 1 -- 172.21.15.163:0/4026528052 wait complete. 2023-07-14T18:28:13.589 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:28:13.534+0000 7f4a60a68b80 1 -- start start 2023-07-14T18:28:13.589 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:28:13.534+0000 7f4a60a68b80 1 Processor -- start 2023-07-14T18:28:13.589 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:28:13.534+0000 7f4a60a68b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55707175ef60 0x557071768a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:28:13.589 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:28:13.535+0000 7f4a60a68b80 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55707175f8b0 0x557071768f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:28:13.590 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:28:13.535+0000 7f4a60a68b80 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5570717604b0 0x55707176ff80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:28:13.590 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:28:13.535+0000 7f4a60a68b80 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x55707164fac0 con 0x55707175f8b0 2023-07-14T18:28:13.591 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:28:13.535+0000 7f4a60a68b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x55707164f7c0 con 0x55707175ef60 2023-07-14T18:28:13.591 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:28:13.535+0000 7f4a60a68b80 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x557071533920 con 0x5570717604b0 2023-07-14T18:28:13.591 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:28:13.535+0000 7f4a60a68b80 10 client.0 _ll_register_callbacks cb 0x55707164d760 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T18:28:13.592 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:28:13.535+0000 7f4a47fff700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55707175f8b0 0x557071768f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:28:13.592 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:28:13.535+0000 7f4a4e59c700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55707175ef60 0x557071768a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:28:13.592 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:28:13.535+0000 7f4a47fff700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55707175f8b0 0x557071768f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:60596/0 (socket says 172.21.15.163:60596) 2023-07-14T18:28:13.592 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:28:13.535+0000 7f4a4e59c700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55707175ef60 0x557071768a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.163:33046/0 (socket says 172.21.15.163:33046) 2023-07-14T18:28:13.592 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:28:13.535+0000 7f4a47fff700 1 -- 172.21.15.163:0/3070987149 learned_addr learned my addr 172.21.15.163:0/3070987149 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:28:13.593 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:28:13.535+0000 7f4a4ed9d700 1 --2- 172.21.15.163:0/3070987149 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5570717604b0 0x55707176ff80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:28:13.593 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:28:13.535+0000 7f4a47fff700 1 -- 172.21.15.163:0/3070987149 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5570717604b0 msgr2=0x55707176ff80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:28:13.593 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:28:13.535+0000 7f4a47fff700 1 --2- 172.21.15.163:0/3070987149 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5570717604b0 0x55707176ff80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:28:13.593 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:28:13.535+0000 7f4a47fff700 1 -- 172.21.15.163:0/3070987149 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55707175ef60 msgr2=0x557071768a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:28:13.594 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:28:13.535+0000 7f4a47fff700 1 --2- 172.21.15.163:0/3070987149 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55707175ef60 0x557071768a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:28:13.594 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:28:13.535+0000 7f4a47fff700 1 -- 172.21.15.163:0/3070987149 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4a5019e070 con 0x55707175f8b0 2023-07-14T18:28:13.594 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:28:13.535+0000 7f4a4e59c700 1 --2- 172.21.15.163:0/3070987149 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55707175ef60 0x557071768a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T18:28:13.595 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:28:13.535+0000 7f4a47fff700 1 --2- 172.21.15.163:0/3070987149 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55707175f8b0 0x557071768f40 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7f4a38011be0 tx=0x7f4a38026630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b33f8c5f55363729 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:28:13.595 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:28:13.535+0000 7f4a35ffb700 10 client.0 ms_handle_connect on v2:172.21.15.163:3300/0 2023-07-14T18:28:13.595 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:28:13.535+0000 7f4a35ffb700 1 -- 172.21.15.163:0/3070987149 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a3802b070 con 0x55707175f8b0 2023-07-14T18:28:13.596 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:28:13.535+0000 7f4a35ffb700 1 -- 172.21.15.163:0/3070987149 <== mon.0 v2:172.21.15.163:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 9049+0+0 (secure 0 0 0) 0x7f4a38026b10 con 0x55707175f8b0 2023-07-14T18:28:13.596 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:28:13.535+0000 7f4a60a68b80 1 -- 172.21.15.163:0/3070987149 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5570716094f0 con 0x55707175f8b0 2023-07-14T18:28:13.597 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:28:13.536+0000 7f4a35ffb700 1 -- 172.21.15.163:0/3070987149 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4a3801e4f0 con 0x55707175f8b0 2023-07-14T18:28:13.597 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:28:13.536+0000 7f4a60a68b80 10 client.16728 fetch_fsmap learned FSMap version 39 2023-07-14T18:28:13.597 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:28:13.536+0000 7f4a60a68b80 1 -- 172.21.15.163:0/3070987149 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) v3 -- 0x7f4a38017070 con 0x55707175f8b0 2023-07-14T18:28:13.598 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:28:13.536+0000 7f4a35ffb700 1 -- 172.21.15.163:0/3070987149 <== mon.0 v2:172.21.15.163:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x5570716094f0 con 0x55707175f8b0 2023-07-14T18:28:13.598 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:28:13.536+0000 7f4a35ffb700 1 -- 172.21.15.163:0/3070987149 <== mon.0 v2:172.21.15.163:3300/0 5 ==== fsmap(e 39) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f4a38024020 con 0x55707175f8b0 2023-07-14T18:28:13.598 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:28:13.536+0000 7f4a60a68b80 10 client.16728 fetch_fsmap finished waiting for FSMap version 39 2023-07-14T18:28:13.598 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:28:13.536+0000 7f4a60a68b80 10 client.16728 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-07-14T18:28:13.599 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:28:13.536+0000 7f4a60a68b80 20 client.16728 populate_metadata read hostname 'smithi163' 2023-07-14T18:28:13.599 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:28:13.536+0000 7f4a60a68b80 1 --2- 172.21.15.163:0/3070987149 >> [v2:172.21.15.172:6838/3850440096,v1:172.21.15.172:6839/3850440096] conn(0x557071774720 0x557071776b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:28:13.599 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:28:13.536+0000 7f4a60a68b80 4 client.16728 mds_command: new command op to 24518 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-14T18:28:13.599 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:28:13.536+0000 7f4a60a68b80 1 -- 172.21.15.163:0/3070987149 --> [v2:172.21.15.172:6838/3850440096,v1:172.21.15.172:6839/3850440096] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55707172dda0 con 0x557071774720 2023-07-14T18:28:13.599 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:28:13.536+0000 7f4a4e59c700 1 --2- 172.21.15.163:0/3070987149 >> [v2:172.21.15.172:6838/3850440096,v1:172.21.15.172:6839/3850440096] conn(0x557071774720 0x557071776b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:28:13.600 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:28:13.537+0000 7f4a35ffb700 10 client.16728 ms_handle_connect on v2:172.21.15.172:6838/3850440096 2023-07-14T18:28:13.600 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:28:13.537+0000 7f4a4e59c700 1 --2- 172.21.15.163:0/3070987149 >> [v2:172.21.15.172:6838/3850440096,v1:172.21.15.172:6839/3850440096] conn(0x557071774720 0x557071776b30 crc :-1 s=READY pgs=119 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=619a8d92cd209035 server_cookie=a48423e72c96dc4 in_seq=0 out_seq=0 2023-07-14T18:28:13.600 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:28:13.537+0000 7f4a35ffb700 1 -- 172.21.15.163:0/3070987149 <== mds.0 v2:172.21.15.172:6838/3850440096 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18017 (crc 0 0 0) 0x55707172dda0 con 0x557071774720 2023-07-14T18:28:13.600 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:28:13.537+0000 7f4a35ffb700 10 client.16728 handle_command_reply: tid=0 2023-07-14T18:28:13.600 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:28:13.537+0000 7f4a60a68b80 1 client.16728 shutdown 2023-07-14T18:28:13.601 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:28:13.537+0000 7f4a60a68b80 1 -- 172.21.15.163:0/3070987149 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55707175f8b0 msgr2=0x557071768f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:28:13.601 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:28:13.537+0000 7f4a60a68b80 1 --2- 172.21.15.163:0/3070987149 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55707175f8b0 0x557071768f40 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7f4a38011be0 tx=0x7f4a38026630 comp rx=0 tx=0).stop 2023-07-14T18:28:13.601 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:28:13.537+0000 7f4a60a68b80 1 -- 172.21.15.163:0/3070987149 shutdown_connections 2023-07-14T18:28:13.601 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:28:13.537+0000 7f4a60a68b80 1 --2- 172.21.15.163:0/3070987149 >> [v2:172.21.15.172:6838/3850440096,v1:172.21.15.172:6839/3850440096] conn(0x557071774720 0x557071776b30 crc :-1 s=READY pgs=119 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:28:13.601 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:28:13.537+0000 7f4a60a68b80 1 --2- 172.21.15.163:0/3070987149 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5570717604b0 0x55707176ff80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:28:13.602 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:28:13.537+0000 7f4a60a68b80 1 --2- 172.21.15.163:0/3070987149 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55707175ef60 0x557071768a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:28:13.602 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:28:13.537+0000 7f4a35ffb700 0 client.16728 ms_handle_reset on v2:172.21.15.172:6838/3850440096 2023-07-14T18:28:13.602 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:28:13.537+0000 7f4a60a68b80 1 --2- 172.21.15.163:0/3070987149 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55707175f8b0 0x557071768f40 unknown :-1 s=CLOSED pgs=749 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:28:13.602 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:28:13.537+0000 7f4a60a68b80 1 -- 172.21.15.163:0/3070987149 >> 172.21.15.163:0/3070987149 conn(0x557071754680 msgr2=0x557071758650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:28:13.602 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:28:13.538+0000 7f4a60a68b80 1 -- 172.21.15.163:0/3070987149 shutdown_connections 2023-07-14T18:28:13.603 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:28:13.538+0000 7f4a60a68b80 1 -- 172.21.15.163:0/3070987149 wait complete. 2023-07-14T18:28:13.603 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:28:13.538+0000 7f4a60a68b80 20 client.16728 trim_cache size 0 max 16384 2023-07-14T18:28:13.607 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:28:13.555+0000 7f4a60a68b80 1 Processor -- start 2023-07-14T18:28:13.607 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:28:13.555+0000 7f4a60a68b80 1 -- start start 2023-07-14T18:28:13.607 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:28:13.555+0000 7f4a60a68b80 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55707175ef60 0x557071766860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:28:13.608 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:28:13.555+0000 7f4a60a68b80 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55707175f8b0 0x55707176fea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:28:13.608 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:28:13.555+0000 7f4a60a68b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5570717604b0 0x557071763370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:28:13.608 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:28:13.555+0000 7f4a60a68b80 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x557071760330 con 0x55707175ef60 2023-07-14T18:28:13.608 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:28:13.555+0000 7f4a60a68b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x557071769900 con 0x5570717604b0 2023-07-14T18:28:13.608 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:28:13.555+0000 7f4a60a68b80 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x5570717685a0 con 0x55707175f8b0 2023-07-14T18:28:13.609 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:28:13.555+0000 7f4a4e59c700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55707175ef60 0x557071766860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:28:13.609 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:28:13.555+0000 7f4a47fff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55707175f8b0 0x55707176fea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:28:13.609 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:28:13.555+0000 7f4a4e59c700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55707175ef60 0x557071766860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:60602/0 (socket says 172.21.15.163:60602) 2023-07-14T18:28:13.609 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:28:13.555+0000 7f4a4e59c700 1 -- 172.21.15.163:0/4101984855 learned_addr learned my addr 172.21.15.163:0/4101984855 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:28:13.609 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:28:13.555+0000 7f4a4ed9d700 1 --2- 172.21.15.163:0/4101984855 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5570717604b0 0x557071763370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:28:13.610 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:28:13.555+0000 7f4a4e59c700 1 -- 172.21.15.163:0/4101984855 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55707175f8b0 msgr2=0x55707176fea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:28:13.610 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:28:13.555+0000 7f4a4e59c700 1 --2- 172.21.15.163:0/4101984855 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55707175f8b0 0x55707176fea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:28:13.610 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:28:13.555+0000 7f4a4e59c700 1 -- 172.21.15.163:0/4101984855 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5570717604b0 msgr2=0x557071763370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:28:13.610 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:28:13.555+0000 7f4a4e59c700 1 --2- 172.21.15.163:0/4101984855 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5570717604b0 0x557071763370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:28:13.610 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:28:13.555+0000 7f4a4e59c700 1 -- 172.21.15.163:0/4101984855 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5570714c6c60 con 0x55707175ef60 2023-07-14T18:28:13.611 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:28:13.555+0000 7f4a47fff700 1 --2- 172.21.15.163:0/4101984855 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55707175f8b0 0x55707176fea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T18:28:13.611 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:28:13.555+0000 7f4a4ed9d700 1 --2- 172.21.15.163:0/4101984855 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5570717604b0 0x557071763370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T18:28:13.611 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:28:13.556+0000 7f4a4e59c700 1 --2- 172.21.15.163:0/4101984855 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55707175ef60 0x557071766860 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7f4a40005950 tx=0x7f4a400cc040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d02c876c762f10e3 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:28:13.611 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:28:13.556+0000 7f4a457fa700 1 -- 172.21.15.163:0/4101984855 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a4009dec0 con 0x55707175ef60 2023-07-14T18:28:13.611 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:28:13.556+0000 7f4a457fa700 1 -- 172.21.15.163:0/4101984855 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f4a400a22e0 con 0x55707175ef60 2023-07-14T18:28:13.612 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:28:13.556+0000 7f4a457fa700 1 -- 172.21.15.163:0/4101984855 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a40099380 con 0x55707175ef60 2023-07-14T18:28:13.612 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:28:13.557+0000 7f4a60a68b80 1 -- 172.21.15.163:0/4101984855 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55707175ef60 msgr2=0x557071766860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:28:13.612 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:28:13.557+0000 7f4a60a68b80 1 --2- 172.21.15.163:0/4101984855 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55707175ef60 0x557071766860 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7f4a40005950 tx=0x7f4a400cc040 comp rx=0 tx=0).stop 2023-07-14T18:28:13.612 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:28:13.557+0000 7f4a60a68b80 1 -- 172.21.15.163:0/4101984855 shutdown_connections 2023-07-14T18:28:13.613 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:28:13.557+0000 7f4a60a68b80 1 --2- 172.21.15.163:0/4101984855 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5570717604b0 0x557071763370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:28:13.613 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:28:13.557+0000 7f4a60a68b80 1 --2- 172.21.15.163:0/4101984855 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55707175ef60 0x557071766860 unknown :-1 s=CLOSED pgs=750 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:28:13.613 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:28:13.557+0000 7f4a60a68b80 1 --2- 172.21.15.163:0/4101984855 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55707175f8b0 0x55707176fea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:28:13.613 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:28:13.557+0000 7f4a60a68b80 1 -- 172.21.15.163:0/4101984855 >> 172.21.15.163:0/4101984855 conn(0x557071754680 msgr2=0x557071767700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:28:13.613 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:28:13.557+0000 7f4a60a68b80 1 -- 172.21.15.163:0/4101984855 shutdown_connections 2023-07-14T18:28:13.614 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:28:13.557+0000 7f4a60a68b80 1 -- 172.21.15.163:0/4101984855 wait complete. 2023-07-14T18:28:13.614 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:28:13.557+0000 7f4a60a68b80 1 -- start start 2023-07-14T18:28:13.614 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:28:13.557+0000 7f4a60a68b80 1 Processor -- start 2023-07-14T18:28:13.614 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:28:13.557+0000 7f4a60a68b80 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55707175ef60 0x55707176fa00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:28:13.614 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:28:13.557+0000 7f4a60a68b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55707175f8b0 0x55707176c4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:28:13.615 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:28:13.557+0000 7f4a60a68b80 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5570717604b0 0x55707176c9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:28:13.615 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:28:13.557+0000 7f4a60a68b80 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x55707176d0c0 con 0x5570717604b0 2023-07-14T18:28:13.615 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:28:13.557+0000 7f4a60a68b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x557071770080 con 0x55707175f8b0 2023-07-14T18:28:13.615 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:28:13.557+0000 7f4a60a68b80 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x557071770210 con 0x55707175ef60 2023-07-14T18:28:13.615 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:28:13.557+0000 7f4a60a68b80 10 client.0 _ll_register_callbacks cb 0x7f4a40095ab0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T18:28:13.616 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:28:13.557+0000 7f4a47fff700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55707175f8b0 0x55707176c4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:28:13.616 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:28:13.557+0000 7f4a4ed9d700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5570717604b0 0x55707176c9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:28:13.616 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:28:13.557+0000 7f4a47fff700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55707175f8b0 0x55707176c4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.163:33062/0 (socket says 172.21.15.163:33062) 2023-07-14T18:28:13.616 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:28:13.558+0000 7f4a4e59c700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55707175ef60 0x55707176fa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:28:13.616 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:28:13.558+0000 7f4a47fff700 1 -- 172.21.15.163:0/1529404353 learned_addr learned my addr 172.21.15.163:0/1529404353 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:28:13.617 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:28:13.558+0000 7f4a4ed9d700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5570717604b0 0x55707176c9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:60612/0 (socket says 172.21.15.163:60612) 2023-07-14T18:28:13.617 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:28:13.558+0000 7f4a4ed9d700 1 -- 172.21.15.163:0/1529404353 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55707175ef60 msgr2=0x55707176fa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:28:13.617 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:28:13.558+0000 7f4a4ed9d700 1 --2- 172.21.15.163:0/1529404353 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55707175ef60 0x55707176fa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:28:13.617 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:28:13.558+0000 7f4a4ed9d700 1 -- 172.21.15.163:0/1529404353 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55707175f8b0 msgr2=0x55707176c4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:28:13.617 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:28:13.558+0000 7f4a4ed9d700 1 --2- 172.21.15.163:0/1529404353 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55707175f8b0 0x55707176c4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:28:13.618 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:28:13.558+0000 7f4a4ed9d700 1 -- 172.21.15.163:0/1529404353 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4a38017070 con 0x5570717604b0 2023-07-14T18:28:13.618 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:28:13.558+0000 7f4a47fff700 1 --2- 172.21.15.163:0/1529404353 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55707175f8b0 0x55707176c4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T18:28:13.618 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:28:13.558+0000 7f4a4e59c700 1 --2- 172.21.15.163:0/1529404353 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55707175ef60 0x55707176fa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T18:28:13.618 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:28:13.558+0000 7f4a4ed9d700 1 --2- 172.21.15.163:0/1529404353 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5570717604b0 0x55707176c9e0 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7f4a48008a40 tx=0x7f4a4800a460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e86195511bb8b2f server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:28:13.618 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:28:13.558+0000 7f4a35ffb700 10 client.0 ms_handle_connect on v2:172.21.15.163:3300/0 2023-07-14T18:28:13.619 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:28:13.558+0000 7f4a35ffb700 1 -- 172.21.15.163:0/1529404353 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a4800f040 con 0x5570717604b0 2023-07-14T18:28:13.619 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:28:13.558+0000 7f4a35ffb700 1 -- 172.21.15.163:0/1529404353 <== mon.0 v2:172.21.15.163:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 9049+0+0 (secure 0 0 0) 0x7f4a48008450 con 0x5570717604b0 2023-07-14T18:28:13.619 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:28:13.558+0000 7f4a60a68b80 1 -- 172.21.15.163:0/1529404353 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f4a38003e70 con 0x5570717604b0 2023-07-14T18:28:13.619 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:28:13.558+0000 7f4a35ffb700 1 -- 172.21.15.163:0/1529404353 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4a48008650 con 0x5570717604b0 2023-07-14T18:28:13.619 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:28:13.558+0000 7f4a60a68b80 10 client.16734 fetch_fsmap learned FSMap version 39 2023-07-14T18:28:13.620 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:28:13.558+0000 7f4a60a68b80 1 -- 172.21.15.163:0/1529404353 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) v3 -- 0x7f4a50106ff0 con 0x5570717604b0 2023-07-14T18:28:13.620 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:28:13.559+0000 7f4a35ffb700 1 -- 172.21.15.163:0/1529404353 <== mon.0 v2:172.21.15.163:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f4a38003e70 con 0x5570717604b0 2023-07-14T18:28:13.620 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:28:13.559+0000 7f4a35ffb700 1 -- 172.21.15.163:0/1529404353 <== mon.0 v2:172.21.15.163:3300/0 5 ==== fsmap(e 39) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f4a4800c240 con 0x5570717604b0 2023-07-14T18:28:13.620 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:28:13.559+0000 7f4a60a68b80 10 client.16734 fetch_fsmap finished waiting for FSMap version 39 2023-07-14T18:28:13.620 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:28:13.559+0000 7f4a60a68b80 10 client.16734 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-07-14T18:28:13.621 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:28:13.559+0000 7f4a60a68b80 20 client.16734 populate_metadata read hostname 'smithi163' 2023-07-14T18:28:13.621 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:28:13.559+0000 7f4a60a68b80 1 --2- 172.21.15.163:0/1529404353 >> [v2:172.21.15.172:6838/3850440096,v1:172.21.15.172:6839/3850440096] conn(0x5570717c9be0 0x5570717cbff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:28:13.621 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:28:13.559+0000 7f4a60a68b80 4 client.16734 mds_command: new command op to 24518 tid=0[{"prefix": "scrub status"}] 2023-07-14T18:28:13.621 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:28:13.559+0000 7f4a60a68b80 1 -- 172.21.15.163:0/1529404353 --> [v2:172.21.15.172:6838/3850440096,v1:172.21.15.172:6839/3850440096] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x5570716a8eb0 con 0x5570717c9be0 2023-07-14T18:28:13.621 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:28:13.559+0000 7f4a4e59c700 1 --2- 172.21.15.163:0/1529404353 >> [v2:172.21.15.172:6838/3850440096,v1:172.21.15.172:6839/3850440096] conn(0x5570717c9be0 0x5570717cbff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:28:13.622 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:28:13.559+0000 7f4a4e59c700 1 --2- 172.21.15.163:0/1529404353 >> [v2:172.21.15.172:6838/3850440096,v1:172.21.15.172:6839/3850440096] conn(0x5570717c9be0 0x5570717cbff0 crc :-1 s=READY pgs=120 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f3cb4b0180293f24 server_cookie=86906e434e2e7df0 in_seq=0 out_seq=0 2023-07-14T18:28:13.622 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:28:13.559+0000 7f4a35ffb700 10 client.16734 ms_handle_connect on v2:172.21.15.172:6838/3850440096 2023-07-14T18:28:13.622 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:28:13.560+0000 7f4a35ffb700 1 -- 172.21.15.163:0/1529404353 <== mds.0 v2:172.21.15.172:6838/3850440096 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x5570716a8eb0 con 0x5570717c9be0 2023-07-14T18:28:13.622 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:28:13.560+0000 7f4a35ffb700 10 client.16734 handle_command_reply: tid=0 2023-07-14T18:28:13.622 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:28:13.560+0000 7f4a60a68b80 1 client.16734 shutdown 2023-07-14T18:28:13.622 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:28:13.560+0000 7f4a60a68b80 1 -- 172.21.15.163:0/1529404353 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5570717604b0 msgr2=0x55707176c9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:28:13.623 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:28:13.560+0000 7f4a60a68b80 1 --2- 172.21.15.163:0/1529404353 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5570717604b0 0x55707176c9e0 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7f4a48008a40 tx=0x7f4a4800a460 comp rx=0 tx=0).stop 2023-07-14T18:28:13.623 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:28:13.560+0000 7f4a60a68b80 1 -- 172.21.15.163:0/1529404353 shutdown_connections 2023-07-14T18:28:13.623 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:28:13.560+0000 7f4a60a68b80 1 --2- 172.21.15.163:0/1529404353 >> [v2:172.21.15.172:6838/3850440096,v1:172.21.15.172:6839/3850440096] conn(0x5570717c9be0 0x5570717cbff0 crc :-1 s=READY pgs=120 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:28:13.623 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:28:13.560+0000 7f4a60a68b80 1 --2- 172.21.15.163:0/1529404353 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55707175ef60 0x55707176fa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:28:13.624 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:28:13.560+0000 7f4a60a68b80 1 --2- 172.21.15.163:0/1529404353 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5570717604b0 0x55707176c9e0 unknown :-1 s=CLOSED pgs=751 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:28:13.624 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:28:13.560+0000 7f4a35ffb700 0 client.16734 ms_handle_reset on v2:172.21.15.172:6838/3850440096 2023-07-14T18:28:13.624 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:28:13.560+0000 7f4a60a68b80 1 --2- 172.21.15.163:0/1529404353 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55707175f8b0 0x55707176c4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:28:13.624 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:28:13.560+0000 7f4a60a68b80 1 -- 172.21.15.163:0/1529404353 >> 172.21.15.163:0/1529404353 conn(0x557071754680 msgr2=0x557071766860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:28:13.624 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:28:13.560+0000 7f4a60a68b80 1 -- 172.21.15.163:0/1529404353 shutdown_connections 2023-07-14T18:28:13.625 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:28:13.560+0000 7f4a60a68b80 1 -- 172.21.15.163:0/1529404353 wait complete. 2023-07-14T18:28:13.625 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:28:13.560+0000 7f4a60a68b80 20 client.16734 trim_cache size 0 max 16384 2023-07-14T18:28:13.625 INFO:teuthology.orchestra.run.smithi163.stdout:{ 2023-07-14T18:28:13.625 INFO:teuthology.orchestra.run.smithi163.stdout: "status": "IDLE (waiting for more scrubs)", 2023-07-14T18:28:13.626 INFO:teuthology.orchestra.run.smithi163.stdout: "scrubs": { 2023-07-14T18:28:13.626 INFO:teuthology.orchestra.run.smithi163.stdout: "2c53b7ef-6f30-49f0-a60d-f1f114c19d42": { 2023-07-14T18:28:13.626 INFO:teuthology.orchestra.run.smithi163.stdout: "path": "/", 2023-07-14T18:28:13.626 INFO:teuthology.orchestra.run.smithi163.stdout: "tag": "2c53b7ef-6f30-49f0-a60d-f1f114c19d42", 2023-07-14T18:28:13.626 INFO:teuthology.orchestra.run.smithi163.stdout: "options": "recursive,force" 2023-07-14T18:28:13.627 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-07-14T18:28:13.627 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-07-14T18:28:13.627 INFO:teuthology.orchestra.run.smithi163.stdout:} 2023-07-14T18:28:13.628 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:28:13.560+0000 7f4a548d0700 1 -- 172.21.15.163:0/1745292394 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f4a3c0a1150 msgr2=0x7f4a3c0a3600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:28:13.628 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:28:13.560+0000 7f4a548d0700 1 --2- 172.21.15.163:0/1745292394 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f4a3c0a1150 0x7f4a3c0a3600 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f4a38011490 tx=0x7f4a38009260 comp rx=0 tx=0).stop 2023-07-14T18:28:13.629 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:28:13.560+0000 7f4a548d0700 1 -- 172.21.15.163:0/1745292394 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4a500fe280 msgr2=0x7f4a501959e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:28:13.629 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:28:13.560+0000 7f4a548d0700 1 --2- 172.21.15.163:0/1745292394 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4a500fe280 0x7f4a501959e0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f4a4000e970 tx=0x7f4a4000ec80 comp rx=0 tx=0).stop 2023-07-14T18:28:13.629 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:28:13.561+0000 7f4a548d0700 1 -- 172.21.15.163:0/1745292394 shutdown_connections 2023-07-14T18:28:13.629 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:28:13.561+0000 7f4a548d0700 1 --2- 172.21.15.163:0/1745292394 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f4a3c0a1150 0x7f4a3c0a3600 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:28:13.630 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:28:13.561+0000 7f4a548d0700 1 --2- 172.21.15.163:0/1745292394 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4a500fe280 0x7f4a501959e0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:28:13.630 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:28:13.561+0000 7f4a548d0700 1 --2- 172.21.15.163:0/1745292394 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f4a500ffe00 0x7f4a5019cf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:28:13.630 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:28:13.561+0000 7f4a548d0700 1 --2- 172.21.15.163:0/1745292394 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4a500ff470 0x7f4a50195f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:28:13.630 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:28:13.561+0000 7f4a548d0700 1 -- 172.21.15.163:0/1745292394 >> 172.21.15.163:0/1745292394 conn(0x7f4a500f98a0 msgr2=0x7f4a500fbb20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:28:13.630 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:28:13.561+0000 7f4a548d0700 1 -- 172.21.15.163:0/1745292394 shutdown_connections 2023-07-14T18:28:13.631 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:28:13.561+0000 7f4a548d0700 1 -- 172.21.15.163:0/1745292394 wait complete. 2023-07-14T18:28:13.631 INFO:tasks.cephfs.filesystem:scrub status for tag:2c53b7ef-6f30-49f0-a60d-f1f114c19d42 - {'path': '/', 'tag': '2c53b7ef-6f30-49f0-a60d-f1f114c19d42', 'options': 'recursive,force'} 2023-07-14T18:28:15.022 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:28:14 smithi172 ceph-mon[97983]: pgmap v767: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-07-14T18:28:15.171 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:28:14 smithi184 ceph-mon[98481]: pgmap v767: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-07-14T18:28:15.214 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:28:14 smithi163 ceph-mon[96576]: pgmap v767: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-07-14T18:28:17.022 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:28:16 smithi172 ceph-mon[97983]: pgmap v768: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-07-14T18:28:17.171 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:28:16 smithi184 ceph-mon[98481]: pgmap v768: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-07-14T18:28:17.214 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:28:16 smithi163 ceph-mon[96576]: pgmap v768: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-07-14T18:28:19.171 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:28:18 smithi184 ceph-mon[98481]: pgmap v769: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-07-14T18:28:19.213 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:28:18 smithi163 ceph-mon[96576]: pgmap v769: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-07-14T18:28:19.272 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:28:18 smithi172 ceph-mon[97983]: pgmap v769: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-07-14T18:28:21.171 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:28:20 smithi184 ceph-mon[98481]: pgmap v770: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-07-14T18:28:21.213 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:28:20 smithi163 ceph-mon[96576]: pgmap v770: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-07-14T18:28:21.272 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:28:20 smithi172 ceph-mon[97983]: pgmap v770: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-07-14T18:28:22.421 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:28:21 smithi184 ceph-mon[98481]: pgmap v771: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-07-14T18:28:22.463 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:28:21 smithi163 ceph-mon[96576]: pgmap v771: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-07-14T18:28:22.522 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:28:21 smithi172 ceph-mon[97983]: pgmap v771: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-07-14T18:28:25.021 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:28:24 smithi172 ceph-mon[97983]: pgmap v772: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-07-14T18:28:25.171 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:28:24 smithi184 ceph-mon[98481]: pgmap v772: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-07-14T18:28:25.213 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:28:24 smithi163 ceph-mon[96576]: pgmap v772: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-07-14T18:28:27.170 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:28:26 smithi184 ceph-mon[98481]: pgmap v773: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-07-14T18:28:27.213 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:28:26 smithi163 ceph-mon[96576]: pgmap v773: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-07-14T18:28:27.271 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:28:26 smithi172 ceph-mon[97983]: pgmap v773: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-07-14T18:28:29.170 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:28:28 smithi184 ceph-mon[98481]: pgmap v774: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-07-14T18:28:29.213 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:28:28 smithi163 ceph-mon[96576]: pgmap v774: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-07-14T18:28:29.271 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:28:28 smithi172 ceph-mon[97983]: pgmap v774: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-07-14T18:28:31.170 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:28:30 smithi184 ceph-mon[98481]: pgmap v775: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-07-14T18:28:31.212 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:28:30 smithi163 ceph-mon[96576]: pgmap v775: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-07-14T18:28:31.271 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:28:30 smithi172 ceph-mon[97983]: pgmap v775: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-07-14T18:28:32.420 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:28:32 smithi184 ceph-mon[98481]: pgmap v776: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-07-14T18:28:32.462 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:28:32 smithi163 ceph-mon[96576]: pgmap v776: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-07-14T18:28:32.521 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:28:32 smithi172 ceph-mon[97983]: pgmap v776: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-07-14T18:28:35.170 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:28:34 smithi184 ceph-mon[98481]: pgmap v777: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-07-14T18:28:35.212 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:28:34 smithi163 ceph-mon[96576]: pgmap v777: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-07-14T18:28:35.271 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:28:34 smithi172 ceph-mon[97983]: pgmap v777: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-07-14T18:28:37.170 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:28:36 smithi184 ceph-mon[98481]: pgmap v778: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-07-14T18:28:37.212 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:28:36 smithi163 ceph-mon[96576]: pgmap v778: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-07-14T18:28:37.270 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:28:36 smithi172 ceph-mon[97983]: pgmap v778: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-07-14T18:28:38.170 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:28:37 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-14T18:28:38.170 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:28:37 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T18:28:38.170 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:28:37 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-14T18:28:38.171 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:28:37 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:28:38.212 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:28:37 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-14T18:28:38.213 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:28:37 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T18:28:38.213 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:28:37 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-14T18:28:38.213 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:28:37 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:28:38.271 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:28:37 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-14T18:28:38.271 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:28:37 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T18:28:38.271 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:28:37 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-14T18:28:38.272 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:28:37 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:28:39.170 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:28:38 smithi184 ceph-mon[98481]: pgmap v779: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-07-14T18:28:39.212 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:28:38 smithi163 ceph-mon[96576]: pgmap v779: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-07-14T18:28:39.270 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:28:38 smithi172 ceph-mon[97983]: pgmap v779: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-07-14T18:28:41.169 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:28:40 smithi184 ceph-mon[98481]: pgmap v780: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-07-14T18:28:41.212 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:28:40 smithi163 ceph-mon[96576]: pgmap v780: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-07-14T18:28:41.270 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:28:40 smithi172 ceph-mon[97983]: pgmap v780: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-07-14T18:28:42.421 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:28:41 smithi184 ceph-mon[98481]: pgmap v781: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-07-14T18:28:42.462 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:28:41 smithi163 ceph-mon[96576]: pgmap v781: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-07-14T18:28:42.520 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:28:41 smithi172 ceph-mon[97983]: pgmap v781: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-07-14T18:28:43.632 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-07-14T18:28:43.772 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:28:43.737+0000 7fe73c765700 1 -- 172.21.15.163:0/872122242 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fe734103010 msgr2=0x7fe7341053f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:28:43.773 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:28:43.737+0000 7fe73c765700 1 --2- 172.21.15.163:0/872122242 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fe734103010 0x7fe7341053f0 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7fe724009990 tx=0x7fe724009ca0 comp rx=0 tx=0).stop 2023-07-14T18:28:43.773 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:28:43.738+0000 7fe73c765700 1 -- 172.21.15.163:0/872122242 shutdown_connections 2023-07-14T18:28:43.773 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:28:43.738+0000 7fe73c765700 1 --2- 172.21.15.163:0/872122242 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe7341006f0 0x7fe734102ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:28:43.774 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:28:43.738+0000 7fe73c765700 1 --2- 172.21.15.163:0/872122242 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe734105930 0x7fe734107d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:28:43.774 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:28:43.738+0000 7fe73c765700 1 --2- 172.21.15.163:0/872122242 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fe734103010 0x7fe7341053f0 unknown :-1 s=CLOSED pgs=752 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:28:43.774 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:28:43.738+0000 7fe73c765700 1 -- 172.21.15.163:0/872122242 >> 172.21.15.163:0/872122242 conn(0x7fe7340fa130 msgr2=0x7fe7340fc560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:28:43.774 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:28:43.738+0000 7fe73c765700 1 -- 172.21.15.163:0/872122242 shutdown_connections 2023-07-14T18:28:43.774 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:28:43.738+0000 7fe73c765700 1 -- 172.21.15.163:0/872122242 wait complete. 2023-07-14T18:28:43.776 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:28:43.738+0000 7fe73c765700 1 Processor -- start 2023-07-14T18:28:43.776 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:28:43.738+0000 7fe73c765700 1 -- start start 2023-07-14T18:28:43.776 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:28:43.739+0000 7fe73c765700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe7341006f0 0x7fe734195870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:28:43.776 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:28:43.739+0000 7fe73c765700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe734103010 0x7fe734195db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:28:43.777 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:28:43.739+0000 7fe73c765700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fe734105930 0x7fe73419ce20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:28:43.777 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:28:43.739+0000 7fe73c765700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe73419d3f0 con 0x7fe734105930 2023-07-14T18:28:43.777 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:28:43.739+0000 7fe73c765700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe73419d530 con 0x7fe734103010 2023-07-14T18:28:43.777 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:28:43.739+0000 7fe73c765700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe73419d6c0 con 0x7fe7341006f0 2023-07-14T18:28:43.777 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:28:43.739+0000 7fe73a501700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe7341006f0 0x7fe734195870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:28:43.778 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:28:43.739+0000 7fe73a501700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe7341006f0 0x7fe734195870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.163:42444/0 (socket says 172.21.15.163:42444) 2023-07-14T18:28:43.778 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:28:43.739+0000 7fe73a501700 1 -- 172.21.15.163:0/3993067267 learned_addr learned my addr 172.21.15.163:0/3993067267 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:28:43.778 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:28:43.739+0000 7fe73ad02700 1 --2- 172.21.15.163:0/3993067267 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fe734105930 0x7fe73419ce20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:28:43.778 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:28:43.739+0000 7fe739d00700 1 --2- 172.21.15.163:0/3993067267 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe734103010 0x7fe734195db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:28:43.778 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:28:43.739+0000 7fe73ad02700 1 -- 172.21.15.163:0/3993067267 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe7341006f0 msgr2=0x7fe734195870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:28:43.779 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:28:43.739+0000 7fe73ad02700 1 --2- 172.21.15.163:0/3993067267 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe7341006f0 0x7fe734195870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:28:43.779 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:28:43.739+0000 7fe73ad02700 1 -- 172.21.15.163:0/3993067267 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe734103010 msgr2=0x7fe734195db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:28:43.779 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:28:43.739+0000 7fe73ad02700 1 --2- 172.21.15.163:0/3993067267 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe734103010 0x7fe734195db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:28:43.779 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:28:43.739+0000 7fe73ad02700 1 -- 172.21.15.163:0/3993067267 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7240095f0 con 0x7fe734105930 2023-07-14T18:28:43.779 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:28:43.739+0000 7fe73ad02700 1 --2- 172.21.15.163:0/3993067267 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fe734105930 0x7fe73419ce20 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7fe72c00efc0 tx=0x7fe72c00c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:28:43.779 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:28:43.740+0000 7fe72b7fe700 1 -- 172.21.15.163:0/3993067267 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe72c018070 con 0x7fe734105930 2023-07-14T18:28:43.780 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:28:43.740+0000 7fe72b7fe700 1 -- 172.21.15.163:0/3993067267 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fe72c00f040 con 0x7fe734105930 2023-07-14T18:28:43.780 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:28:43.740+0000 7fe73c765700 1 -- 172.21.15.163:0/3993067267 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe73419d940 con 0x7fe734105930 2023-07-14T18:28:43.780 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:28:43.740+0000 7fe72b7fe700 1 -- 172.21.15.163:0/3993067267 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe72c00cba0 con 0x7fe734105930 2023-07-14T18:28:43.780 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:28:43.740+0000 7fe73c765700 1 -- 172.21.15.163:0/3993067267 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe73419de00 con 0x7fe734105930 2023-07-14T18:28:43.784 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:28:43.742+0000 7fe72b7fe700 1 -- 172.21.15.163:0/3993067267 <== mon.0 v2:172.21.15.163:3300/0 4 ==== mgrmap(e 18) v1 ==== 135716+0+0 (secure 0 0 0) 0x7fe72c003a00 con 0x7fe734105930 2023-07-14T18:28:43.785 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:28:43.743+0000 7fe72b7fe700 1 --2- 172.21.15.163:0/3993067267 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7fe7200a1150 0x7fe7200a3600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:28:43.785 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:28:43.743+0000 7fe73a501700 1 --2- 172.21.15.163:0/3993067267 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7fe7200a1150 0x7fe7200a3600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:28:43.785 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:28:43.743+0000 7fe72b7fe700 1 -- 172.21.15.163:0/3993067267 <== mon.0 v2:172.21.15.163:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 9049+0+0 (secure 0 0 0) 0x7fe72c0cc720 con 0x7fe734105930 2023-07-14T18:28:43.785 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:28:43.744+0000 7fe73a501700 1 --2- 172.21.15.163:0/3993067267 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7fe7200a1150 0x7fe7200a3600 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7fe730009d20 tx=0x7fe730009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:28:43.786 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:28:43.745+0000 7fe7488fdb80 1 Processor -- start 2023-07-14T18:28:43.786 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:28:43.745+0000 7fe7488fdb80 1 -- start start 2023-07-14T18:28:43.786 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:28:43.745+0000 7fe7488fdb80 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55cd8949df60 0x55cd8949e370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:28:43.786 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:28:43.745+0000 7fe7488fdb80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55cd8949e8b0 0x55cd8949eed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:28:43.786 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:28:43.745+0000 7fe7488fdb80 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55cd8949f4b0 0x55cd8949f920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:28:43.787 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:28:43.745+0000 7fe7488fdb80 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cd893a2cb0 con 0x55cd8949f4b0 2023-07-14T18:28:43.787 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:28:43.745+0000 7fe7488fdb80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cd893f5a40 con 0x55cd8949e8b0 2023-07-14T18:28:43.787 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:28:43.745+0000 7fe7488fdb80 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cd893eeed0 con 0x55cd8949df60 2023-07-14T18:28:43.787 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:28:43.745+0000 7fe73a501700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55cd8949df60 0x55cd8949e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:28:43.787 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:28:43.745+0000 7fe739d00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55cd8949e8b0 0x55cd8949eed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:28:43.788 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:28:43.745+0000 7fe73a501700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55cd8949df60 0x55cd8949e370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.163:42452/0 (socket says 172.21.15.163:42452) 2023-07-14T18:28:43.788 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:28:43.745+0000 7fe73a501700 1 -- 172.21.15.163:0/2907880351 learned_addr learned my addr 172.21.15.163:0/2907880351 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:28:43.788 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:28:43.745+0000 7fe73ad02700 1 --2- 172.21.15.163:0/2907880351 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55cd8949f4b0 0x55cd8949f920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:28:43.788 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:28:43.746+0000 7fe739d00700 1 -- 172.21.15.163:0/2907880351 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55cd8949df60 msgr2=0x55cd8949e370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:28:43.788 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:28:43.746+0000 7fe739d00700 1 --2- 172.21.15.163:0/2907880351 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55cd8949df60 0x55cd8949e370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:28:43.788 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:28:43.746+0000 7fe739d00700 1 -- 172.21.15.163:0/2907880351 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55cd8949f4b0 msgr2=0x55cd8949f920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:28:43.789 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:28:43.746+0000 7fe739d00700 1 --2- 172.21.15.163:0/2907880351 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55cd8949f4b0 0x55cd8949f920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:28:43.789 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:28:43.746+0000 7fe739d00700 1 -- 172.21.15.163:0/2907880351 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55cd8921cde0 con 0x55cd8949e8b0 2023-07-14T18:28:43.789 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:28:43.746+0000 7fe739d00700 1 --2- 172.21.15.163:0/2907880351 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55cd8949e8b0 0x55cd8949eed0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fe7240098e0 tx=0x7fe724005bc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ab40ea43b8a7409 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:28:43.789 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:28:43.746+0000 7fe728ff9700 1 -- 172.21.15.163:0/2907880351 <== mon.2 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe72401d070 con 0x55cd8949e8b0 2023-07-14T18:28:43.789 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:28:43.746+0000 7fe728ff9700 1 -- 172.21.15.163:0/2907880351 <== mon.2 v2:172.21.15.172:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fe72401e040 con 0x55cd8949e8b0 2023-07-14T18:28:43.790 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:28:43.746+0000 7fe728ff9700 1 -- 172.21.15.163:0/2907880351 <== mon.2 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe72400b710 con 0x55cd8949e8b0 2023-07-14T18:28:43.790 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:28:43.747+0000 7fe7488fdb80 1 -- 172.21.15.163:0/2907880351 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55cd8949e8b0 msgr2=0x55cd8949eed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:28:43.790 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:28:43.747+0000 7fe7488fdb80 1 --2- 172.21.15.163:0/2907880351 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55cd8949e8b0 0x55cd8949eed0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fe7240098e0 tx=0x7fe724005bc0 comp rx=0 tx=0).stop 2023-07-14T18:28:43.790 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:28:43.747+0000 7fe7488fdb80 1 -- 172.21.15.163:0/2907880351 shutdown_connections 2023-07-14T18:28:43.790 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:28:43.747+0000 7fe7488fdb80 1 --2- 172.21.15.163:0/2907880351 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55cd8949df60 0x55cd8949e370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:28:43.791 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:28:43.747+0000 7fe7488fdb80 1 --2- 172.21.15.163:0/2907880351 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55cd8949f4b0 0x55cd8949f920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:28:43.791 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:28:43.747+0000 7fe7488fdb80 1 --2- 172.21.15.163:0/2907880351 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55cd8949e8b0 0x55cd8949eed0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:28:43.791 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:28:43.747+0000 7fe7488fdb80 1 -- 172.21.15.163:0/2907880351 >> 172.21.15.163:0/2907880351 conn(0x55cd89493680 msgr2=0x55cd894989d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:28:43.791 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:28:43.747+0000 7fe7488fdb80 1 -- 172.21.15.163:0/2907880351 shutdown_connections 2023-07-14T18:28:43.791 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:28:43.747+0000 7fe7488fdb80 1 -- 172.21.15.163:0/2907880351 wait complete. 2023-07-14T18:28:43.792 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:28:43.747+0000 7fe7488fdb80 1 -- start start 2023-07-14T18:28:43.792 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:28:43.747+0000 7fe7488fdb80 1 Processor -- start 2023-07-14T18:28:43.792 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:28:43.748+0000 7fe7488fdb80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55cd8949df60 0x55cd894a7910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:28:43.792 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:28:43.748+0000 7fe7488fdb80 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55cd8949e8b0 0x55cd894a7e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:28:43.792 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:28:43.748+0000 7fe7488fdb80 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55cd8949f4b0 0x55cd894aee90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:28:43.793 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:28:43.748+0000 7fe7488fdb80 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cd8938eac0 con 0x55cd8949f4b0 2023-07-14T18:28:43.793 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:28:43.748+0000 7fe7488fdb80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cd8938e7c0 con 0x55cd8949df60 2023-07-14T18:28:43.793 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:28:43.748+0000 7fe7488fdb80 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cd89272920 con 0x55cd8949e8b0 2023-07-14T18:28:43.793 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:28:43.748+0000 7fe7488fdb80 10 client.0 _ll_register_callbacks cb 0x55cd8938c760 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T18:28:43.793 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:28:43.748+0000 7fe73a501700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55cd8949df60 0x55cd894a7910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:28:43.793 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:28:43.748+0000 7fe73a501700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55cd8949df60 0x55cd894a7910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.163:33088/0 (socket says 172.21.15.163:33088) 2023-07-14T18:28:43.794 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:28:43.748+0000 7fe73a501700 1 -- 172.21.15.163:0/451621759 learned_addr learned my addr 172.21.15.163:0/451621759 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:28:43.794 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:28:43.748+0000 7fe739d00700 1 --2- 172.21.15.163:0/451621759 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55cd8949e8b0 0x55cd894a7e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:28:43.794 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:28:43.748+0000 7fe73ad02700 1 --2- 172.21.15.163:0/451621759 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55cd8949f4b0 0x55cd894aee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:28:43.794 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:28:43.748+0000 7fe73a501700 1 -- 172.21.15.163:0/451621759 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55cd8949e8b0 msgr2=0x55cd894a7e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:28:43.794 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:28:43.748+0000 7fe73a501700 1 --2- 172.21.15.163:0/451621759 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55cd8949e8b0 0x55cd894a7e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:28:43.795 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:28:43.748+0000 7fe73a501700 1 -- 172.21.15.163:0/451621759 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55cd8949f4b0 msgr2=0x55cd894aee90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:28:43.795 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:28:43.748+0000 7fe73a501700 1 --2- 172.21.15.163:0/451621759 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55cd8949f4b0 0x55cd894aee90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:28:43.795 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:28:43.748+0000 7fe73a501700 1 -- 172.21.15.163:0/451621759 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe734108920 con 0x55cd8949df60 2023-07-14T18:28:43.795 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:28:43.748+0000 7fe739d00700 1 --2- 172.21.15.163:0/451621759 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55cd8949e8b0 0x55cd894a7e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T18:28:43.795 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:28:43.748+0000 7fe73a501700 1 --2- 172.21.15.163:0/451621759 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55cd8949df60 0x55cd894a7910 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fe730011ab0 tx=0x7fe7300047c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f3f1b20031f78202 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:28:43.796 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:28:43.748+0000 7fe71dffb700 10 client.0 ms_handle_connect on v2:172.21.15.172:3300/0 2023-07-14T18:28:43.796 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:28:43.748+0000 7fe71dffb700 1 -- 172.21.15.163:0/451621759 <== mon.2 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe730022070 con 0x55cd8949df60 2023-07-14T18:28:43.796 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:28:43.749+0000 7fe71dffb700 1 -- 172.21.15.163:0/451621759 <== mon.2 v2:172.21.15.172:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 9049+0+0 (secure 0 0 0) 0x7fe73001db00 con 0x55cd8949df60 2023-07-14T18:28:43.796 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:28:43.749+0000 7fe7488fdb80 1 -- 172.21.15.163:0/451621759 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55cd893484f0 con 0x55cd8949df60 2023-07-14T18:28:43.796 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:28:43.749+0000 7fe71dffb700 1 -- 172.21.15.163:0/451621759 <== mon.2 v2:172.21.15.172:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe73001dcc0 con 0x55cd8949df60 2023-07-14T18:28:43.797 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:28:43.749+0000 7fe7488fdb80 10 client.26372 fetch_fsmap learned FSMap version 39 2023-07-14T18:28:43.797 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:28:43.749+0000 7fe7488fdb80 1 -- 172.21.15.163:0/451621759 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) v3 -- 0x55cd89205c60 con 0x55cd8949df60 2023-07-14T18:28:43.797 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:28:43.749+0000 7fe71dffb700 1 -- 172.21.15.163:0/451621759 <== mon.2 v2:172.21.15.172:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55cd893484f0 con 0x55cd8949df60 2023-07-14T18:28:43.797 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:28:43.749+0000 7fe71dffb700 1 -- 172.21.15.163:0/451621759 <== mon.2 v2:172.21.15.172:3300/0 5 ==== fsmap(e 39) v1 ==== 7470+0+0 (secure 0 0 0) 0x7fe73001c400 con 0x55cd8949df60 2023-07-14T18:28:43.797 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:28:43.749+0000 7fe7488fdb80 10 client.26372 fetch_fsmap finished waiting for FSMap version 39 2023-07-14T18:28:43.798 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:28:43.749+0000 7fe7488fdb80 10 client.26372 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-07-14T18:28:43.798 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:28:43.749+0000 7fe7488fdb80 20 client.26372 populate_metadata read hostname 'smithi163' 2023-07-14T18:28:43.798 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:28:43.749+0000 7fe7488fdb80 1 --2- 172.21.15.163:0/451621759 >> [v2:172.21.15.172:6838/3850440096,v1:172.21.15.172:6839/3850440096] conn(0x55cd894b36e0 0x55cd894b5af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:28:43.798 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:28:43.749+0000 7fe7488fdb80 4 client.26372 mds_command: new command op to 24518 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-14T18:28:43.798 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:28:43.749+0000 7fe7488fdb80 1 -- 172.21.15.163:0/451621759 --> [v2:172.21.15.172:6838/3850440096,v1:172.21.15.172:6839/3850440096] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55cd8946cda0 con 0x55cd894b36e0 2023-07-14T18:28:43.799 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:28:43.749+0000 7fe739d00700 1 --2- 172.21.15.163:0/451621759 >> [v2:172.21.15.172:6838/3850440096,v1:172.21.15.172:6839/3850440096] conn(0x55cd894b36e0 0x55cd894b5af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:28:43.799 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:28:43.750+0000 7fe71dffb700 10 client.26372 ms_handle_connect on v2:172.21.15.172:6838/3850440096 2023-07-14T18:28:43.799 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:28:43.750+0000 7fe739d00700 1 --2- 172.21.15.163:0/451621759 >> [v2:172.21.15.172:6838/3850440096,v1:172.21.15.172:6839/3850440096] conn(0x55cd894b36e0 0x55cd894b5af0 crc :-1 s=READY pgs=121 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c9567b6d742c152a server_cookie=4497c2a97c7c4e74 in_seq=0 out_seq=0 2023-07-14T18:28:43.800 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:28:43.750+0000 7fe71dffb700 1 -- 172.21.15.163:0/451621759 <== mds.0 v2:172.21.15.172:6838/3850440096 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18017 (crc 0 0 0) 0x55cd8946cda0 con 0x55cd894b36e0 2023-07-14T18:28:43.800 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:28:43.750+0000 7fe71dffb700 10 client.26372 handle_command_reply: tid=0 2023-07-14T18:28:43.801 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:28:43.750+0000 7fe7488fdb80 1 client.26372 shutdown 2023-07-14T18:28:43.801 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:28:43.751+0000 7fe7488fdb80 1 -- 172.21.15.163:0/451621759 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55cd8949df60 msgr2=0x55cd894a7910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:28:43.801 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:28:43.751+0000 7fe7488fdb80 1 --2- 172.21.15.163:0/451621759 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55cd8949df60 0x55cd894a7910 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fe730011ab0 tx=0x7fe7300047c0 comp rx=0 tx=0).stop 2023-07-14T18:28:43.801 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:28:43.751+0000 7fe7488fdb80 1 -- 172.21.15.163:0/451621759 shutdown_connections 2023-07-14T18:28:43.801 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:28:43.751+0000 7fe7488fdb80 1 --2- 172.21.15.163:0/451621759 >> [v2:172.21.15.172:6838/3850440096,v1:172.21.15.172:6839/3850440096] conn(0x55cd894b36e0 0x55cd894b5af0 crc :-1 s=READY pgs=121 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:28:43.802 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:28:43.751+0000 7fe7488fdb80 1 --2- 172.21.15.163:0/451621759 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55cd8949f4b0 0x55cd894aee90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:28:43.802 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:28:43.751+0000 7fe7488fdb80 1 --2- 172.21.15.163:0/451621759 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55cd8949df60 0x55cd894a7910 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:28:43.802 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:28:43.751+0000 7fe71dffb700 0 client.26372 ms_handle_reset on v2:172.21.15.172:6838/3850440096 2023-07-14T18:28:43.802 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:28:43.751+0000 7fe7488fdb80 1 --2- 172.21.15.163:0/451621759 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55cd8949e8b0 0x55cd894a7e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:28:43.802 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:28:43.751+0000 7fe7488fdb80 1 -- 172.21.15.163:0/451621759 >> 172.21.15.163:0/451621759 conn(0x55cd89493680 msgr2=0x55cd89497650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:28:43.803 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:28:43.751+0000 7fe7488fdb80 1 -- 172.21.15.163:0/451621759 shutdown_connections 2023-07-14T18:28:43.803 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:28:43.751+0000 7fe7488fdb80 1 -- 172.21.15.163:0/451621759 wait complete. 2023-07-14T18:28:43.803 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:28:43.751+0000 7fe7488fdb80 20 client.26372 trim_cache size 0 max 16384 2023-07-14T18:28:43.805 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:28:43.770+0000 7fe7488fdb80 1 Processor -- start 2023-07-14T18:28:43.805 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:28:43.770+0000 7fe7488fdb80 1 -- start start 2023-07-14T18:28:43.806 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:28:43.770+0000 7fe7488fdb80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55cd8949df60 0x55cd8949ec80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:28:43.806 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:28:43.770+0000 7fe7488fdb80 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55cd8949e8b0 0x55cd894aee50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:28:43.806 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:28:43.770+0000 7fe7488fdb80 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55cd8949f4b0 0x55cd894a6610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:28:43.806 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:28:43.770+0000 7fe7488fdb80 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cd894a7320 con 0x55cd8949f4b0 2023-07-14T18:28:43.806 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:28:43.770+0000 7fe7488fdb80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cd8949f1c0 con 0x55cd8949df60 2023-07-14T18:28:43.807 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:28:43.770+0000 7fe7488fdb80 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cd89499510 con 0x55cd8949e8b0 2023-07-14T18:28:43.807 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:28:43.770+0000 7fe73a501700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55cd8949df60 0x55cd8949ec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:28:43.807 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:28:43.770+0000 7fe73ad02700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55cd8949f4b0 0x55cd894a6610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:28:43.807 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:28:43.770+0000 7fe73a501700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55cd8949df60 0x55cd8949ec80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.163:33096/0 (socket says 172.21.15.163:33096) 2023-07-14T18:28:43.807 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:28:43.770+0000 7fe739d00700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55cd8949e8b0 0x55cd894aee50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:28:43.808 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:28:43.770+0000 7fe73ad02700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55cd8949f4b0 0x55cd894a6610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:60648/0 (socket says 172.21.15.163:60648) 2023-07-14T18:28:43.808 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:28:43.770+0000 7fe73a501700 1 -- 172.21.15.163:0/2546595019 learned_addr learned my addr 172.21.15.163:0/2546595019 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:28:43.808 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:28:43.770+0000 7fe73a501700 1 -- 172.21.15.163:0/2546595019 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55cd8949e8b0 msgr2=0x55cd894aee50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:28:43.808 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:28:43.770+0000 7fe73a501700 1 --2- 172.21.15.163:0/2546595019 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55cd8949e8b0 0x55cd894aee50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:28:43.808 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:28:43.770+0000 7fe73a501700 1 -- 172.21.15.163:0/2546595019 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55cd8949f4b0 msgr2=0x55cd894a6610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:28:43.809 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:28:43.770+0000 7fe73a501700 1 --2- 172.21.15.163:0/2546595019 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55cd8949f4b0 0x55cd894a6610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:28:43.809 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:28:43.770+0000 7fe73a501700 1 -- 172.21.15.163:0/2546595019 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55cd89243250 con 0x55cd8949df60 2023-07-14T18:28:43.809 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:28:43.770+0000 7fe739d00700 1 --2- 172.21.15.163:0/2546595019 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55cd8949e8b0 0x55cd894aee50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T18:28:43.809 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:28:43.770+0000 7fe73a501700 1 --2- 172.21.15.163:0/2546595019 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55cd8949df60 0x55cd8949ec80 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fe730013010 tx=0x7fe73000e3b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7209bd01728a2427 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:28:43.809 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:28:43.771+0000 7fe7297fa700 1 -- 172.21.15.163:0/2546595019 <== mon.2 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe730022050 con 0x55cd8949df60 2023-07-14T18:28:43.809 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:28:43.771+0000 7fe7297fa700 1 -- 172.21.15.163:0/2546595019 <== mon.2 v2:172.21.15.172:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fe73001cec0 con 0x55cd8949df60 2023-07-14T18:28:43.810 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:28:43.771+0000 7fe7297fa700 1 -- 172.21.15.163:0/2546595019 <== mon.2 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe730036950 con 0x55cd8949df60 2023-07-14T18:28:43.813 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:28:43.771+0000 7fe7488fdb80 1 -- 172.21.15.163:0/2546595019 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55cd8949df60 msgr2=0x55cd8949ec80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:28:43.813 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:28:43.771+0000 7fe7488fdb80 1 --2- 172.21.15.163:0/2546595019 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55cd8949df60 0x55cd8949ec80 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fe730013010 tx=0x7fe73000e3b0 comp rx=0 tx=0).stop 2023-07-14T18:28:43.813 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:28:43.771+0000 7fe7488fdb80 1 -- 172.21.15.163:0/2546595019 shutdown_connections 2023-07-14T18:28:43.813 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:28:43.771+0000 7fe7488fdb80 1 --2- 172.21.15.163:0/2546595019 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55cd8949f4b0 0x55cd894a6610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:28:43.814 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:28:43.771+0000 7fe7488fdb80 1 --2- 172.21.15.163:0/2546595019 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55cd8949df60 0x55cd8949ec80 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:28:43.814 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:28:43.771+0000 7fe7488fdb80 1 --2- 172.21.15.163:0/2546595019 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55cd8949e8b0 0x55cd894aee50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:28:43.814 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:28:43.771+0000 7fe7488fdb80 1 -- 172.21.15.163:0/2546595019 >> 172.21.15.163:0/2546595019 conn(0x55cd89493680 msgr2=0x55cd894989a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:28:43.814 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:28:43.771+0000 7fe7488fdb80 1 -- 172.21.15.163:0/2546595019 shutdown_connections 2023-07-14T18:28:43.814 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:28:43.771+0000 7fe7488fdb80 1 -- 172.21.15.163:0/2546595019 wait complete. 2023-07-14T18:28:43.815 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:28:43.772+0000 7fe7488fdb80 1 -- start start 2023-07-14T18:28:43.815 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:28:43.772+0000 7fe7488fdb80 1 Processor -- start 2023-07-14T18:28:43.815 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:28:43.772+0000 7fe7488fdb80 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55cd8949df60 0x55cd894aafe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:28:43.815 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:28:43.772+0000 7fe7488fdb80 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55cd8949e8b0 0x55cd894ab5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:28:43.815 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:28:43.772+0000 7fe7488fdb80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55cd8949f4b0 0x55cd894ae2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:28:43.816 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:28:43.772+0000 7fe7488fdb80 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cd894ae820 con 0x55cd8949e8b0 2023-07-14T18:28:43.816 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:28:43.772+0000 7fe7488fdb80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cd894ae990 con 0x55cd8949f4b0 2023-07-14T18:28:43.816 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:28:43.772+0000 7fe7488fdb80 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cd894aeb50 con 0x55cd8949df60 2023-07-14T18:28:43.816 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:28:43.772+0000 7fe7488fdb80 10 client.0 _ll_register_callbacks cb 0x7fe73000e980 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T18:28:43.816 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:28:43.772+0000 7fe73a501700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55cd8949df60 0x55cd894aafe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:28:43.817 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:28:43.772+0000 7fe73a501700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55cd8949df60 0x55cd894aafe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.163:42472/0 (socket says 172.21.15.163:42472) 2023-07-14T18:28:43.817 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:28:43.772+0000 7fe73a501700 1 -- 172.21.15.163:0/1213211862 learned_addr learned my addr 172.21.15.163:0/1213211862 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:28:43.817 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:28:43.772+0000 7fe73ad02700 1 --2- 172.21.15.163:0/1213211862 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55cd8949f4b0 0x55cd894ae2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:28:43.817 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:28:43.772+0000 7fe739d00700 1 --2- 172.21.15.163:0/1213211862 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55cd8949e8b0 0x55cd894ab5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:28:43.817 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:28:43.772+0000 7fe73a501700 1 -- 172.21.15.163:0/1213211862 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55cd8949f4b0 msgr2=0x55cd894ae2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:28:43.817 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:28:43.772+0000 7fe73a501700 1 --2- 172.21.15.163:0/1213211862 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55cd8949f4b0 0x55cd894ae2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:28:43.818 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:28:43.772+0000 7fe73a501700 1 -- 172.21.15.163:0/1213211862 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55cd8949e8b0 msgr2=0x55cd894ab5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:28:43.818 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:28:43.772+0000 7fe73a501700 1 --2- 172.21.15.163:0/1213211862 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55cd8949e8b0 0x55cd894ab5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:28:43.818 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:28:43.772+0000 7fe73a501700 1 -- 172.21.15.163:0/1213211862 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55cd8921cde0 con 0x55cd8949df60 2023-07-14T18:28:43.818 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:28:43.773+0000 7fe73a501700 1 --2- 172.21.15.163:0/1213211862 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55cd8949df60 0x55cd894aafe0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fe730011b20 tx=0x7fe730036430 comp rx=0 tx=0).ready entity=mon.1 client_cookie=59a14fd5f47cf865 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:28:43.818 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:28:43.773+0000 7fe71dffb700 10 client.0 ms_handle_connect on v2:172.21.15.184:3300/0 2023-07-14T18:28:43.819 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:28:43.773+0000 7fe71dffb700 1 -- 172.21.15.163:0/1213211862 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe730022040 con 0x55cd8949df60 2023-07-14T18:28:43.819 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:28:43.773+0000 7fe7488fdb80 1 -- 172.21.15.163:0/1213211862 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55cd893e7eb0 con 0x55cd8949df60 2023-07-14T18:28:43.819 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:28:43.773+0000 7fe71dffb700 1 -- 172.21.15.163:0/1213211862 <== mon.1 v2:172.21.15.184:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 9049+0+0 (secure 0 0 0) 0x7fe73001dbd0 con 0x55cd8949df60 2023-07-14T18:28:43.819 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:28:43.773+0000 7fe71dffb700 1 -- 172.21.15.163:0/1213211862 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe73001dd90 con 0x55cd8949df60 2023-07-14T18:28:43.819 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:28:43.773+0000 7fe7488fdb80 10 client.26320 fetch_fsmap learned FSMap version 39 2023-07-14T18:28:43.820 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:28:43.773+0000 7fe7488fdb80 1 -- 172.21.15.163:0/1213211862 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) v3 -- 0x55cd89205c60 con 0x55cd8949df60 2023-07-14T18:28:43.820 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:28:43.773+0000 7fe71dffb700 1 -- 172.21.15.163:0/1213211862 <== mon.1 v2:172.21.15.184:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55cd893e7eb0 con 0x55cd8949df60 2023-07-14T18:28:43.820 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:28:43.773+0000 7fe71dffb700 1 -- 172.21.15.163:0/1213211862 <== mon.1 v2:172.21.15.184:3300/0 5 ==== fsmap(e 39) v1 ==== 7470+0+0 (secure 0 0 0) 0x7fe73002e030 con 0x55cd8949df60 2023-07-14T18:28:43.820 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:28:43.773+0000 7fe7488fdb80 10 client.26320 fetch_fsmap finished waiting for FSMap version 39 2023-07-14T18:28:43.820 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:28:43.773+0000 7fe7488fdb80 10 client.26320 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-07-14T18:28:43.821 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:28:43.773+0000 7fe7488fdb80 20 client.26320 populate_metadata read hostname 'smithi163' 2023-07-14T18:28:43.821 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:28:43.774+0000 7fe7488fdb80 1 --2- 172.21.15.163:0/1213211862 >> [v2:172.21.15.172:6838/3850440096,v1:172.21.15.172:6839/3850440096] conn(0x55cd89508140 0x55cd8950a550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:28:43.821 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:28:43.774+0000 7fe7488fdb80 4 client.26320 mds_command: new command op to 24518 tid=0[{"prefix": "scrub status"}] 2023-07-14T18:28:43.821 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:28:43.774+0000 7fe7488fdb80 1 -- 172.21.15.163:0/1213211862 --> [v2:172.21.15.172:6838/3850440096,v1:172.21.15.172:6839/3850440096] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55cd893aa050 con 0x55cd89508140 2023-07-14T18:28:43.821 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:28:43.774+0000 7fe739d00700 1 --2- 172.21.15.163:0/1213211862 >> [v2:172.21.15.172:6838/3850440096,v1:172.21.15.172:6839/3850440096] conn(0x55cd89508140 0x55cd8950a550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:28:43.822 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:28:43.774+0000 7fe71dffb700 10 client.26320 ms_handle_connect on v2:172.21.15.172:6838/3850440096 2023-07-14T18:28:43.822 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:28:43.774+0000 7fe739d00700 1 --2- 172.21.15.163:0/1213211862 >> [v2:172.21.15.172:6838/3850440096,v1:172.21.15.172:6839/3850440096] conn(0x55cd89508140 0x55cd8950a550 crc :-1 s=READY pgs=122 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=58e013d95aef6b22 server_cookie=c7dbfcf2d80a9317 in_seq=0 out_seq=0 2023-07-14T18:28:43.822 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:28:43.774+0000 7fe71dffb700 1 -- 172.21.15.163:0/1213211862 <== mds.0 v2:172.21.15.172:6838/3850440096 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x55cd893aa050 con 0x55cd89508140 2023-07-14T18:28:43.822 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:28:43.774+0000 7fe71dffb700 10 client.26320 handle_command_reply: tid=0 2023-07-14T18:28:43.822 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:28:43.774+0000 7fe7488fdb80 1 client.26320 shutdown 2023-07-14T18:28:43.822 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:28:43.774+0000 7fe7488fdb80 1 -- 172.21.15.163:0/1213211862 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55cd8949df60 msgr2=0x55cd894aafe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:28:43.823 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:28:43.774+0000 7fe7488fdb80 1 --2- 172.21.15.163:0/1213211862 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55cd8949df60 0x55cd894aafe0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fe730011b20 tx=0x7fe730036430 comp rx=0 tx=0).stop 2023-07-14T18:28:43.823 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:28:43.774+0000 7fe7488fdb80 1 -- 172.21.15.163:0/1213211862 shutdown_connections 2023-07-14T18:28:43.823 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:28:43.774+0000 7fe7488fdb80 1 --2- 172.21.15.163:0/1213211862 >> [v2:172.21.15.172:6838/3850440096,v1:172.21.15.172:6839/3850440096] conn(0x55cd89508140 0x55cd8950a550 crc :-1 s=READY pgs=122 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:28:43.823 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:28:43.774+0000 7fe7488fdb80 1 --2- 172.21.15.163:0/1213211862 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55cd8949df60 0x55cd894aafe0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:28:43.823 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:28:43.774+0000 7fe7488fdb80 1 --2- 172.21.15.163:0/1213211862 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55cd8949f4b0 0x55cd894ae2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:28:43.824 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:28:43.774+0000 7fe7488fdb80 1 --2- 172.21.15.163:0/1213211862 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55cd8949e8b0 0x55cd894ab5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:28:43.824 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:28:43.774+0000 7fe71dffb700 0 client.26320 ms_handle_reset on v2:172.21.15.172:6838/3850440096 2023-07-14T18:28:43.824 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:28:43.774+0000 7fe7488fdb80 1 -- 172.21.15.163:0/1213211862 >> 172.21.15.163:0/1213211862 conn(0x55cd89493680 msgr2=0x55cd894a5840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:28:43.824 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:28:43.774+0000 7fe7488fdb80 1 -- 172.21.15.163:0/1213211862 shutdown_connections 2023-07-14T18:28:43.824 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:28:43.775+0000 7fe7488fdb80 1 -- 172.21.15.163:0/1213211862 wait complete. 2023-07-14T18:28:43.825 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:28:43.775+0000 7fe7488fdb80 20 client.26320 trim_cache size 0 max 16384 2023-07-14T18:28:43.825 INFO:teuthology.orchestra.run.smithi163.stdout:{ 2023-07-14T18:28:43.825 INFO:teuthology.orchestra.run.smithi163.stdout: "status": "IDLE (waiting for more scrubs)", 2023-07-14T18:28:43.826 INFO:teuthology.orchestra.run.smithi163.stdout: "scrubs": { 2023-07-14T18:28:43.826 INFO:teuthology.orchestra.run.smithi163.stdout: "2c53b7ef-6f30-49f0-a60d-f1f114c19d42": { 2023-07-14T18:28:43.826 INFO:teuthology.orchestra.run.smithi163.stdout: "path": "/", 2023-07-14T18:28:43.826 INFO:teuthology.orchestra.run.smithi163.stdout: "tag": "2c53b7ef-6f30-49f0-a60d-f1f114c19d42", 2023-07-14T18:28:43.826 INFO:teuthology.orchestra.run.smithi163.stdout: "options": "recursive,force" 2023-07-14T18:28:43.827 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-07-14T18:28:43.827 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-07-14T18:28:43.827 INFO:teuthology.orchestra.run.smithi163.stdout:} 2023-07-14T18:28:43.828 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:28:43.775+0000 7fe73c765700 1 -- 172.21.15.163:0/3993067267 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7fe7200a1150 msgr2=0x7fe7200a3600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:28:43.828 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:28:43.775+0000 7fe73c765700 1 --2- 172.21.15.163:0/3993067267 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7fe7200a1150 0x7fe7200a3600 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7fe730009d20 tx=0x7fe730009260 comp rx=0 tx=0).stop 2023-07-14T18:28:43.828 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:28:43.775+0000 7fe73c765700 1 -- 172.21.15.163:0/3993067267 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fe734105930 msgr2=0x7fe73419ce20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:28:43.829 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:28:43.775+0000 7fe73c765700 1 --2- 172.21.15.163:0/3993067267 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fe734105930 0x7fe73419ce20 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7fe72c00efc0 tx=0x7fe72c00c3a0 comp rx=0 tx=0).stop 2023-07-14T18:28:43.829 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:28:43.775+0000 7fe73c765700 1 -- 172.21.15.163:0/3993067267 shutdown_connections 2023-07-14T18:28:43.829 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:28:43.775+0000 7fe73c765700 1 --2- 172.21.15.163:0/3993067267 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7fe7200a1150 0x7fe7200a3600 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:28:43.829 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:28:43.775+0000 7fe73c765700 1 --2- 172.21.15.163:0/3993067267 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe7341006f0 0x7fe734195870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:28:43.829 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:28:43.775+0000 7fe73c765700 1 --2- 172.21.15.163:0/3993067267 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fe734105930 0x7fe73419ce20 unknown :-1 s=CLOSED pgs=753 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:28:43.830 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:28:43.775+0000 7fe73c765700 1 --2- 172.21.15.163:0/3993067267 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe734103010 0x7fe734195db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:28:43.830 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:28:43.775+0000 7fe73c765700 1 -- 172.21.15.163:0/3993067267 >> 172.21.15.163:0/3993067267 conn(0x7fe7340fa130 msgr2=0x7fe734101b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:28:43.830 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:28:43.775+0000 7fe73c765700 1 -- 172.21.15.163:0/3993067267 shutdown_connections 2023-07-14T18:28:43.830 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:28:43.775+0000 7fe73c765700 1 -- 172.21.15.163:0/3993067267 wait complete. 2023-07-14T18:28:43.831 INFO:tasks.cephfs.filesystem:scrub status for tag:2c53b7ef-6f30-49f0-a60d-f1f114c19d42 - {'path': '/', 'tag': '2c53b7ef-6f30-49f0-a60d-f1f114c19d42', 'options': 'recursive,force'} 2023-07-14T18:28:45.169 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:28:44 smithi184 ceph-mon[98481]: pgmap v782: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-07-14T18:28:45.212 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:28:44 smithi163 ceph-mon[96576]: pgmap v782: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-07-14T18:28:45.270 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:28:44 smithi172 ceph-mon[97983]: pgmap v782: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-07-14T18:28:47.169 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:28:46 smithi184 ceph-mon[98481]: pgmap v783: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-07-14T18:28:47.212 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:28:46 smithi163 ceph-mon[96576]: pgmap v783: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-07-14T18:28:47.270 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:28:46 smithi172 ceph-mon[97983]: pgmap v783: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-07-14T18:28:49.169 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:28:48 smithi184 ceph-mon[98481]: pgmap v784: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-07-14T18:28:49.211 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:28:48 smithi163 ceph-mon[96576]: pgmap v784: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-07-14T18:28:49.270 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:28:48 smithi172 ceph-mon[97983]: pgmap v784: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-07-14T18:28:51.169 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:28:50 smithi184 ceph-mon[98481]: pgmap v785: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-07-14T18:28:51.211 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:28:50 smithi163 ceph-mon[96576]: pgmap v785: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-07-14T18:28:51.270 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:28:50 smithi172 ceph-mon[97983]: pgmap v785: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-07-14T18:28:52.420 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:28:52 smithi184 ceph-mon[98481]: pgmap v786: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-07-14T18:28:52.461 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:28:51 smithi163 ceph-mon[96576]: pgmap v786: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-07-14T18:28:52.520 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:28:52 smithi172 ceph-mon[97983]: pgmap v786: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-07-14T18:28:55.169 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:28:54 smithi184 ceph-mon[98481]: pgmap v787: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-07-14T18:28:55.211 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:28:54 smithi163 ceph-mon[96576]: pgmap v787: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-07-14T18:28:55.269 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:28:54 smithi172 ceph-mon[97983]: pgmap v787: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-07-14T18:28:57.168 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:28:56 smithi184 ceph-mon[98481]: pgmap v788: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-07-14T18:28:57.211 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:28:56 smithi163 ceph-mon[96576]: pgmap v788: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-07-14T18:28:57.269 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:28:56 smithi172 ceph-mon[97983]: pgmap v788: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-07-14T18:28:59.168 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:28:58 smithi184 ceph-mon[98481]: pgmap v789: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-07-14T18:28:59.211 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:28:58 smithi163 ceph-mon[96576]: pgmap v789: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-07-14T18:28:59.269 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:28:58 smithi172 ceph-mon[97983]: pgmap v789: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-07-14T18:29:01.168 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:29:00 smithi184 ceph-mon[98481]: pgmap v790: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-07-14T18:29:01.211 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:29:00 smithi163 ceph-mon[96576]: pgmap v790: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-07-14T18:29:01.269 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:29:00 smithi172 ceph-mon[97983]: pgmap v790: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-07-14T18:29:02.418 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:29:02 smithi184 ceph-mon[98481]: pgmap v791: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-07-14T18:29:02.461 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:29:02 smithi163 ceph-mon[96576]: pgmap v791: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-07-14T18:29:02.519 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:29:02 smithi172 ceph-mon[97983]: pgmap v791: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-07-14T18:29:05.168 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:29:04 smithi184 ceph-mon[98481]: pgmap v792: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-07-14T18:29:05.210 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:29:04 smithi163 ceph-mon[96576]: pgmap v792: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-07-14T18:29:05.269 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:29:04 smithi172 ceph-mon[97983]: pgmap v792: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-07-14T18:29:07.168 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:29:06 smithi184 ceph-mon[98481]: pgmap v793: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-07-14T18:29:07.210 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:29:06 smithi163 ceph-mon[96576]: pgmap v793: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-07-14T18:29:07.269 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:29:06 smithi172 ceph-mon[97983]: pgmap v793: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-07-14T18:29:09.168 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:29:08 smithi184 ceph-mon[98481]: pgmap v794: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-07-14T18:29:09.210 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:29:08 smithi163 ceph-mon[96576]: pgmap v794: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-07-14T18:29:09.269 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:29:08 smithi172 ceph-mon[97983]: pgmap v794: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-07-14T18:29:11.168 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:29:10 smithi184 ceph-mon[98481]: pgmap v795: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-07-14T18:29:11.210 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:29:10 smithi163 ceph-mon[96576]: pgmap v795: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-07-14T18:29:11.269 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:29:10 smithi172 ceph-mon[97983]: pgmap v795: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-07-14T18:29:12.417 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:29:12 smithi184 ceph-mon[98481]: pgmap v796: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-07-14T18:29:12.460 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:29:12 smithi163 ceph-mon[96576]: pgmap v796: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-07-14T18:29:12.518 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:29:12 smithi172 ceph-mon[97983]: pgmap v796: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-07-14T18:29:13.831 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-07-14T18:29:13.981 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:13.947+0000 7f938dc24700 1 -- 172.21.15.163:0/4188513211 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f9388100690 msgr2=0x7f9388106f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:29:13.981 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:13.947+0000 7f938dc24700 1 --2- 172.21.15.163:0/4188513211 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f9388100690 0x7f9388106f50 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7f938000b0a0 tx=0x7f938000b3b0 comp rx=0 tx=0).stop 2023-07-14T18:29:13.981 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:13.947+0000 7f938dc24700 1 -- 172.21.15.163:0/4188513211 shutdown_connections 2023-07-14T18:29:13.982 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:13.947+0000 7f938dc24700 1 --2- 172.21.15.163:0/4188513211 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f93880feb10 0x7f93880fef20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:29:13.982 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:13.947+0000 7f938dc24700 1 --2- 172.21.15.163:0/4188513211 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f9388100690 0x7f9388106f50 unknown :-1 s=CLOSED pgs=754 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:29:13.982 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:13.947+0000 7f938dc24700 1 --2- 172.21.15.163:0/4188513211 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f93880ffd00 0x7f9388100150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:29:13.982 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:13.947+0000 7f938dc24700 1 -- 172.21.15.163:0/4188513211 >> 172.21.15.163:0/4188513211 conn(0x7f93880fa130 msgr2=0x7f93880fc560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:29:13.982 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:13.947+0000 7f938dc24700 1 -- 172.21.15.163:0/4188513211 shutdown_connections 2023-07-14T18:29:13.983 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:13.947+0000 7f938dc24700 1 -- 172.21.15.163:0/4188513211 wait complete. 2023-07-14T18:29:13.984 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:13.947+0000 7f938dc24700 1 Processor -- start 2023-07-14T18:29:13.984 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:13.947+0000 7f938dc24700 1 -- start start 2023-07-14T18:29:13.985 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:13.948+0000 7f938dc24700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f93880feb10 0x7f93881937a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:29:13.985 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:13.948+0000 7f938dc24700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f93880ffd00 0x7f9388193ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:29:13.985 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:13.948+0000 7f938dc24700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f9388100690 0x7f938819ad50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:29:13.985 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:13.948+0000 7f938dc24700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f938819b320 con 0x7f9388100690 2023-07-14T18:29:13.985 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:13.948+0000 7f938dc24700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f938819b460 con 0x7f93880feb10 2023-07-14T18:29:13.985 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:13.948+0000 7f938dc24700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f938819b5f0 con 0x7f93880ffd00 2023-07-14T18:29:13.986 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:13.948+0000 7f93877fe700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f93880feb10 0x7f93881937a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:29:13.986 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:13.948+0000 7f93877fe700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f93880feb10 0x7f93881937a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.163:33112/0 (socket says 172.21.15.163:33112) 2023-07-14T18:29:13.986 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:13.948+0000 7f9387fff700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f9388100690 0x7f938819ad50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:29:13.986 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:13.948+0000 7f93877fe700 1 -- 172.21.15.163:0/4255729257 learned_addr learned my addr 172.21.15.163:0/4255729257 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:29:13.987 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:13.948+0000 7f937effd700 1 --2- 172.21.15.163:0/4255729257 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f93880ffd00 0x7f9388193ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:29:13.987 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:13.948+0000 7f93877fe700 1 -- 172.21.15.163:0/4255729257 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f93880ffd00 msgr2=0x7f9388193ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:29:13.987 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:13.948+0000 7f93877fe700 1 --2- 172.21.15.163:0/4255729257 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f93880ffd00 0x7f9388193ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:29:13.987 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:13.948+0000 7f93877fe700 1 -- 172.21.15.163:0/4255729257 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f9388100690 msgr2=0x7f938819ad50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:29:13.987 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:13.948+0000 7f93877fe700 1 --2- 172.21.15.163:0/4255729257 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f9388100690 0x7f938819ad50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:29:13.988 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:13.948+0000 7f93877fe700 1 -- 172.21.15.163:0/4255729257 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9380009d00 con 0x7f93880feb10 2023-07-14T18:29:13.988 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:13.948+0000 7f9387fff700 1 --2- 172.21.15.163:0/4255729257 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f9388100690 0x7f938819ad50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T18:29:13.989 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:13.948+0000 7f93877fe700 1 --2- 172.21.15.163:0/4255729257 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f93880feb10 0x7f93881937a0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f937800e970 tx=0x7f937800ec80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:29:13.989 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:13.948+0000 7f93857fa700 1 -- 172.21.15.163:0/4255729257 <== mon.2 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9378009790 con 0x7f93880feb10 2023-07-14T18:29:13.989 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:13.949+0000 7f93857fa700 1 -- 172.21.15.163:0/4255729257 <== mon.2 v2:172.21.15.172:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f937800c7e0 con 0x7f93880feb10 2023-07-14T18:29:13.990 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:13.949+0000 7f938dc24700 1 -- 172.21.15.163:0/4255729257 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f938819b8d0 con 0x7f93880feb10 2023-07-14T18:29:13.990 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:13.949+0000 7f93857fa700 1 -- 172.21.15.163:0/4255729257 <== mon.2 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9378003bd0 con 0x7f93880feb10 2023-07-14T18:29:13.991 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:13.949+0000 7f938dc24700 1 -- 172.21.15.163:0/4255729257 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f938819bde0 con 0x7f93880feb10 2023-07-14T18:29:13.997 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:13.951+0000 7f93857fa700 1 -- 172.21.15.163:0/4255729257 <== mon.2 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 18) v1 ==== 135716+0+0 (secure 0 0 0) 0x7f937800c950 con 0x7f93880feb10 2023-07-14T18:29:13.997 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:13.952+0000 7f93857fa700 1 --2- 172.21.15.163:0/4255729257 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f93740a1150 0x7f93740a3600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:29:13.997 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:13.952+0000 7f93857fa700 1 -- 172.21.15.163:0/4255729257 <== mon.2 v2:172.21.15.172:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 9049+0+0 (secure 0 0 0) 0x7f9378014070 con 0x7f93880feb10 2023-07-14T18:29:13.998 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:13.952+0000 7f937effd700 1 --2- 172.21.15.163:0/4255729257 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f93740a1150 0x7f93740a3600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:29:13.998 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:13.952+0000 7f937effd700 1 --2- 172.21.15.163:0/4255729257 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f93740a1150 0x7f93740a3600 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f937000be70 tx=0x7f937000d040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:29:13.998 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:13.953+0000 7f9399dbcb80 1 Processor -- start 2023-07-14T18:29:13.998 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:13.953+0000 7f9399dbcb80 1 -- start start 2023-07-14T18:29:13.999 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:13.953+0000 7f9399dbcb80 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55636f7b0f60 0x55636f7b1370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:29:13.999 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:13.953+0000 7f9399dbcb80 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55636f7b18b0 0x55636f7b1ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:29:13.999 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:13.953+0000 7f9399dbcb80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55636f7b24b0 0x55636f7b2920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:29:14.000 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:13.953+0000 7f9399dbcb80 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x55636f6b5cb0 con 0x55636f7b18b0 2023-07-14T18:29:14.000 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:13.953+0000 7f9399dbcb80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x55636f708a40 con 0x55636f7b24b0 2023-07-14T18:29:14.000 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:13.953+0000 7f9399dbcb80 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x55636f701ed0 con 0x55636f7b0f60 2023-07-14T18:29:14.000 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:13.953+0000 7f937effd700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55636f7b18b0 0x55636f7b1ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:29:14.000 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:13.953+0000 7f937effd700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55636f7b18b0 0x55636f7b1ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:60670/0 (socket says 172.21.15.163:60670) 2023-07-14T18:29:14.001 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:13.953+0000 7f937effd700 1 -- 172.21.15.163:0/2953504099 learned_addr learned my addr 172.21.15.163:0/2953504099 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:29:14.001 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:13.953+0000 7f93877fe700 1 --2- 172.21.15.163:0/2953504099 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55636f7b0f60 0x55636f7b1370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:29:14.001 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:13.953+0000 7f9387fff700 1 --2- 172.21.15.163:0/2953504099 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55636f7b24b0 0x55636f7b2920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:29:14.002 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:13.953+0000 7f937effd700 1 -- 172.21.15.163:0/2953504099 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55636f7b0f60 msgr2=0x55636f7b1370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:29:14.002 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:13.953+0000 7f937effd700 1 --2- 172.21.15.163:0/2953504099 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55636f7b0f60 0x55636f7b1370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:29:14.002 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:13.953+0000 7f937effd700 1 -- 172.21.15.163:0/2953504099 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55636f7b24b0 msgr2=0x55636f7b2920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:29:14.002 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:13.953+0000 7f937effd700 1 --2- 172.21.15.163:0/2953504099 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55636f7b24b0 0x55636f7b2920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:29:14.002 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:13.953+0000 7f937effd700 1 -- 172.21.15.163:0/2953504099 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55636f52fde0 con 0x55636f7b18b0 2023-07-14T18:29:14.002 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:13.953+0000 7f93877fe700 1 --2- 172.21.15.163:0/2953504099 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55636f7b0f60 0x55636f7b1370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T18:29:14.003 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:13.953+0000 7f9387fff700 1 --2- 172.21.15.163:0/2953504099 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55636f7b24b0 0x55636f7b2920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T18:29:14.003 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:13.953+0000 7f937effd700 1 --2- 172.21.15.163:0/2953504099 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55636f7b18b0 0x55636f7b1ed0 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7f9370013e80 tx=0x7f9370016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b64ac18d72aa2394 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:29:14.003 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:13.954+0000 7f937dffb700 1 -- 172.21.15.163:0/2953504099 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9370010040 con 0x55636f7b18b0 2023-07-14T18:29:14.003 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:13.954+0000 7f937dffb700 1 -- 172.21.15.163:0/2953504099 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f9370011040 con 0x55636f7b18b0 2023-07-14T18:29:14.003 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:13.954+0000 7f937dffb700 1 -- 172.21.15.163:0/2953504099 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9370023650 con 0x55636f7b18b0 2023-07-14T18:29:14.004 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:13.954+0000 7f9399dbcb80 1 -- 172.21.15.163:0/2953504099 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55636f7b18b0 msgr2=0x55636f7b1ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:29:14.004 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:13.954+0000 7f9399dbcb80 1 --2- 172.21.15.163:0/2953504099 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55636f7b18b0 0x55636f7b1ed0 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7f9370013e80 tx=0x7f9370016000 comp rx=0 tx=0).stop 2023-07-14T18:29:14.004 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:13.955+0000 7f9399dbcb80 1 -- 172.21.15.163:0/2953504099 shutdown_connections 2023-07-14T18:29:14.004 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:13.955+0000 7f9399dbcb80 1 --2- 172.21.15.163:0/2953504099 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55636f7b0f60 0x55636f7b1370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:29:14.004 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:13.955+0000 7f9399dbcb80 1 --2- 172.21.15.163:0/2953504099 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55636f7b24b0 0x55636f7b2920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:29:14.005 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:13.955+0000 7f9399dbcb80 1 --2- 172.21.15.163:0/2953504099 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55636f7b18b0 0x55636f7b1ed0 unknown :-1 s=CLOSED pgs=755 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:29:14.005 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:13.955+0000 7f9399dbcb80 1 -- 172.21.15.163:0/2953504099 >> 172.21.15.163:0/2953504099 conn(0x55636f7a6680 msgr2=0x55636f7ab9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:29:14.005 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:13.955+0000 7f9399dbcb80 1 -- 172.21.15.163:0/2953504099 shutdown_connections 2023-07-14T18:29:14.005 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:13.955+0000 7f9399dbcb80 1 -- 172.21.15.163:0/2953504099 wait complete. 2023-07-14T18:29:14.005 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:13.955+0000 7f9399dbcb80 1 -- start start 2023-07-14T18:29:14.006 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:13.955+0000 7f9399dbcb80 1 Processor -- start 2023-07-14T18:29:14.006 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:13.955+0000 7f9399dbcb80 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55636f7b0f60 0x55636f7ba960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:29:14.006 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:13.955+0000 7f9399dbcb80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55636f7b18b0 0x55636f7baea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:29:14.006 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:13.955+0000 7f9399dbcb80 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55636f7b24b0 0x55636f7c1ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:29:14.006 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:13.955+0000 7f9399dbcb80 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x55636f6a1ac0 con 0x55636f7b0f60 2023-07-14T18:29:14.007 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:13.955+0000 7f9399dbcb80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x55636f6a17c0 con 0x55636f7b18b0 2023-07-14T18:29:14.007 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:13.955+0000 7f9399dbcb80 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x55636f585920 con 0x55636f7b24b0 2023-07-14T18:29:14.007 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:13.956+0000 7f9399dbcb80 10 client.0 _ll_register_callbacks cb 0x55636f69f760 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T18:29:14.007 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:13.956+0000 7f93877fe700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55636f7b0f60 0x55636f7ba960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:29:14.007 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:13.956+0000 7f937effd700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55636f7b18b0 0x55636f7baea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:29:14.008 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:13.956+0000 7f93877fe700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55636f7b0f60 0x55636f7ba960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:60674/0 (socket says 172.21.15.163:60674) 2023-07-14T18:29:14.008 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:13.956+0000 7f93877fe700 1 -- 172.21.15.163:0/1660419523 learned_addr learned my addr 172.21.15.163:0/1660419523 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:29:14.008 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:13.956+0000 7f9387fff700 1 --2- 172.21.15.163:0/1660419523 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55636f7b24b0 0x55636f7c1ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:29:14.008 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:13.956+0000 7f93877fe700 1 -- 172.21.15.163:0/1660419523 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55636f7b24b0 msgr2=0x55636f7c1ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:29:14.008 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:13.956+0000 7f93877fe700 1 --2- 172.21.15.163:0/1660419523 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55636f7b24b0 0x55636f7c1ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:29:14.009 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:13.956+0000 7f93877fe700 1 -- 172.21.15.163:0/1660419523 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55636f7b18b0 msgr2=0x55636f7baea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:29:14.009 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:13.956+0000 7f93877fe700 1 --2- 172.21.15.163:0/1660419523 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55636f7b18b0 0x55636f7baea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:29:14.009 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:13.956+0000 7f93877fe700 1 -- 172.21.15.163:0/1660419523 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f938819bde0 con 0x55636f7b0f60 2023-07-14T18:29:14.009 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:13.956+0000 7f937effd700 1 --2- 172.21.15.163:0/1660419523 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55636f7b18b0 0x55636f7baea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T18:29:14.009 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:13.956+0000 7f93877fe700 1 --2- 172.21.15.163:0/1660419523 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55636f7b0f60 0x55636f7ba960 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7f93780ca970 tx=0x7f9378003680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a4b8d23c312a238 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:29:14.010 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:13.956+0000 7f9366ffd700 10 client.0 ms_handle_connect on v2:172.21.15.163:3300/0 2023-07-14T18:29:14.010 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:13.956+0000 7f9366ffd700 1 -- 172.21.15.163:0/1660419523 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f937809a370 con 0x55636f7b0f60 2023-07-14T18:29:14.010 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:13.956+0000 7f9366ffd700 1 -- 172.21.15.163:0/1660419523 <== mon.0 v2:172.21.15.163:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 9049+0+0 (secure 0 0 0) 0x7f937809df40 con 0x55636f7b0f60 2023-07-14T18:29:14.010 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:13.956+0000 7f9399dbcb80 1 -- 172.21.15.163:0/1660419523 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55636f65b4f0 con 0x55636f7b0f60 2023-07-14T18:29:14.010 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:13.956+0000 7f9366ffd700 1 -- 172.21.15.163:0/1660419523 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) v2 ==== 24+0+0 (secure 0 0 0) 0x7f93780a2360 con 0x55636f7b0f60 2023-07-14T18:29:14.010 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:13.956+0000 7f9399dbcb80 10 client.16764 fetch_fsmap learned FSMap version 39 2023-07-14T18:29:14.011 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:13.956+0000 7f9399dbcb80 1 -- 172.21.15.163:0/1660419523 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) v3 -- 0x7f9388107880 con 0x55636f7b0f60 2023-07-14T18:29:14.011 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:13.957+0000 7f9366ffd700 1 -- 172.21.15.163:0/1660419523 <== mon.0 v2:172.21.15.163:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55636f65b4f0 con 0x55636f7b0f60 2023-07-14T18:29:14.011 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:13.957+0000 7f9366ffd700 1 -- 172.21.15.163:0/1660419523 <== mon.0 v2:172.21.15.163:3300/0 5 ==== fsmap(e 39) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f93780a1ed0 con 0x55636f7b0f60 2023-07-14T18:29:14.011 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:13.957+0000 7f9399dbcb80 10 client.16764 fetch_fsmap finished waiting for FSMap version 39 2023-07-14T18:29:14.011 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:13.957+0000 7f9399dbcb80 10 client.16764 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-07-14T18:29:14.012 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:13.957+0000 7f9399dbcb80 20 client.16764 populate_metadata read hostname 'smithi163' 2023-07-14T18:29:14.012 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:13.957+0000 7f9399dbcb80 1 --2- 172.21.15.163:0/1660419523 >> [v2:172.21.15.172:6838/3850440096,v1:172.21.15.172:6839/3850440096] conn(0x55636f7c66f0 0x55636f7c8b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:29:14.012 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:13.957+0000 7f9399dbcb80 4 client.16764 mds_command: new command op to 24518 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-14T18:29:14.012 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:13.957+0000 7f9399dbcb80 1 -- 172.21.15.163:0/1660419523 --> [v2:172.21.15.172:6838/3850440096,v1:172.21.15.172:6839/3850440096] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55636f77fda0 con 0x55636f7c66f0 2023-07-14T18:29:14.012 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:13.957+0000 7f937effd700 1 --2- 172.21.15.163:0/1660419523 >> [v2:172.21.15.172:6838/3850440096,v1:172.21.15.172:6839/3850440096] conn(0x55636f7c66f0 0x55636f7c8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:29:14.013 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:13.958+0000 7f9366ffd700 10 client.16764 ms_handle_connect on v2:172.21.15.172:6838/3850440096 2023-07-14T18:29:14.013 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:13.958+0000 7f937effd700 1 --2- 172.21.15.163:0/1660419523 >> [v2:172.21.15.172:6838/3850440096,v1:172.21.15.172:6839/3850440096] conn(0x55636f7c66f0 0x55636f7c8b00 crc :-1 s=READY pgs=123 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6e903e164578ee03 server_cookie=335fffeaf9b5f2ed in_seq=0 out_seq=0 2023-07-14T18:29:14.013 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:13.958+0000 7f9366ffd700 1 -- 172.21.15.163:0/1660419523 <== mds.0 v2:172.21.15.172:6838/3850440096 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18017 (crc 0 0 0) 0x55636f77fda0 con 0x55636f7c66f0 2023-07-14T18:29:14.013 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:13.958+0000 7f9366ffd700 10 client.16764 handle_command_reply: tid=0 2023-07-14T18:29:14.013 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:13.958+0000 7f9399dbcb80 1 client.16764 shutdown 2023-07-14T18:29:14.014 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:13.959+0000 7f9399dbcb80 1 -- 172.21.15.163:0/1660419523 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55636f7b0f60 msgr2=0x55636f7ba960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:29:14.014 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:13.959+0000 7f9399dbcb80 1 --2- 172.21.15.163:0/1660419523 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55636f7b0f60 0x55636f7ba960 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7f93780ca970 tx=0x7f9378003680 comp rx=0 tx=0).stop 2023-07-14T18:29:14.014 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:13.959+0000 7f9399dbcb80 1 -- 172.21.15.163:0/1660419523 shutdown_connections 2023-07-14T18:29:14.014 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:13.959+0000 7f9399dbcb80 1 --2- 172.21.15.163:0/1660419523 >> [v2:172.21.15.172:6838/3850440096,v1:172.21.15.172:6839/3850440096] conn(0x55636f7c66f0 0x55636f7c8b00 crc :-1 s=READY pgs=123 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:29:14.014 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:13.959+0000 7f9399dbcb80 1 --2- 172.21.15.163:0/1660419523 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55636f7b24b0 0x55636f7c1ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:29:14.015 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:13.959+0000 7f9399dbcb80 1 --2- 172.21.15.163:0/1660419523 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55636f7b0f60 0x55636f7ba960 unknown :-1 s=CLOSED pgs=756 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:29:14.015 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:13.959+0000 7f9399dbcb80 1 --2- 172.21.15.163:0/1660419523 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55636f7b18b0 0x55636f7baea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:29:14.015 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:13.959+0000 7f9366ffd700 0 client.16764 ms_handle_reset on v2:172.21.15.172:6838/3850440096 2023-07-14T18:29:14.015 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:13.959+0000 7f9399dbcb80 1 -- 172.21.15.163:0/1660419523 >> 172.21.15.163:0/1660419523 conn(0x55636f7a6680 msgr2=0x55636f7aa650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:29:14.015 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:13.959+0000 7f9399dbcb80 1 -- 172.21.15.163:0/1660419523 shutdown_connections 2023-07-14T18:29:14.015 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:13.959+0000 7f9399dbcb80 1 -- 172.21.15.163:0/1660419523 wait complete. 2023-07-14T18:29:14.016 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:13.959+0000 7f9399dbcb80 20 client.16764 trim_cache size 0 max 16384 2023-07-14T18:29:14.020 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:13.975+0000 7f9399dbcb80 1 Processor -- start 2023-07-14T18:29:14.020 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:13.975+0000 7f9399dbcb80 1 -- start start 2023-07-14T18:29:14.020 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:13.976+0000 7f9399dbcb80 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55636f7b0f60 0x55636f7b2880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:29:14.021 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:13.976+0000 7f9399dbcb80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55636f7b18b0 0x55636f7c1ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:29:14.021 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:13.976+0000 7f9399dbcb80 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55636f7b24b0 0x55636f7ab9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:29:14.021 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:13.976+0000 7f9399dbcb80 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x55636f7ad450 con 0x55636f7b0f60 2023-07-14T18:29:14.021 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:13.976+0000 7f9399dbcb80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x55636f7b20e0 con 0x55636f7b18b0 2023-07-14T18:29:14.021 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:13.976+0000 7f9399dbcb80 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x55636f7b1cf0 con 0x55636f7b24b0 2023-07-14T18:29:14.022 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:13.976+0000 7f93877fe700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55636f7b0f60 0x55636f7b2880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:29:14.022 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:13.976+0000 7f93877fe700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55636f7b0f60 0x55636f7b2880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:60682/0 (socket says 172.21.15.163:60682) 2023-07-14T18:29:14.022 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:13.976+0000 7f937effd700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55636f7b18b0 0x55636f7c1ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:29:14.022 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:13.976+0000 7f93877fe700 1 -- 172.21.15.163:0/309511973 learned_addr learned my addr 172.21.15.163:0/309511973 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:29:14.022 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:13.976+0000 7f9387fff700 1 --2- 172.21.15.163:0/309511973 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55636f7b24b0 0x55636f7ab9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:29:14.023 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:13.976+0000 7f93877fe700 1 -- 172.21.15.163:0/309511973 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55636f7b24b0 msgr2=0x55636f7ab9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:29:14.023 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:13.976+0000 7f93877fe700 1 --2- 172.21.15.163:0/309511973 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55636f7b24b0 0x55636f7ab9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:29:14.023 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:13.976+0000 7f93877fe700 1 -- 172.21.15.163:0/309511973 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55636f7b18b0 msgr2=0x55636f7c1ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:29:14.023 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:13.976+0000 7f93877fe700 1 --2- 172.21.15.163:0/309511973 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55636f7b18b0 0x55636f7c1ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:29:14.023 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:13.976+0000 7f93877fe700 1 -- 172.21.15.163:0/309511973 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9370013b30 con 0x55636f7b0f60 2023-07-14T18:29:14.024 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:13.976+0000 7f937effd700 1 --2- 172.21.15.163:0/309511973 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55636f7b18b0 0x55636f7c1ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T18:29:14.024 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:13.976+0000 7f93877fe700 1 --2- 172.21.15.163:0/309511973 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55636f7b0f60 0x55636f7b2880 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7f9378096980 tx=0x7f93780984c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e3efb3fa0c66b035 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:29:14.024 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:13.976+0000 7f937e7fc700 1 -- 172.21.15.163:0/309511973 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93780b82d0 con 0x55636f7b0f60 2023-07-14T18:29:14.025 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:13.976+0000 7f937e7fc700 1 -- 172.21.15.163:0/309511973 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f937800cc50 con 0x55636f7b0f60 2023-07-14T18:29:14.025 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:13.976+0000 7f937e7fc700 1 -- 172.21.15.163:0/309511973 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f937809a170 con 0x55636f7b0f60 2023-07-14T18:29:14.025 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:13.977+0000 7f9399dbcb80 1 -- 172.21.15.163:0/309511973 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55636f7b0f60 msgr2=0x55636f7b2880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:29:14.025 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:13.977+0000 7f9399dbcb80 1 --2- 172.21.15.163:0/309511973 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55636f7b0f60 0x55636f7b2880 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7f9378096980 tx=0x7f93780984c0 comp rx=0 tx=0).stop 2023-07-14T18:29:14.026 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:13.977+0000 7f9399dbcb80 1 -- 172.21.15.163:0/309511973 shutdown_connections 2023-07-14T18:29:14.026 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:13.977+0000 7f9399dbcb80 1 --2- 172.21.15.163:0/309511973 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55636f7b24b0 0x55636f7ab9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:29:14.026 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:13.977+0000 7f9399dbcb80 1 --2- 172.21.15.163:0/309511973 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55636f7b0f60 0x55636f7b2880 unknown :-1 s=CLOSED pgs=757 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:29:14.026 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:13.977+0000 7f9399dbcb80 1 --2- 172.21.15.163:0/309511973 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55636f7b18b0 0x55636f7c1ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:29:14.026 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:13.977+0000 7f9399dbcb80 1 -- 172.21.15.163:0/309511973 >> 172.21.15.163:0/309511973 conn(0x55636f7a6680 msgr2=0x55636f7b96a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:29:14.027 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:13.977+0000 7f9399dbcb80 1 -- 172.21.15.163:0/309511973 shutdown_connections 2023-07-14T18:29:14.027 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:13.977+0000 7f9399dbcb80 1 -- 172.21.15.163:0/309511973 wait complete. 2023-07-14T18:29:14.027 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:13.978+0000 7f9399dbcb80 1 -- start start 2023-07-14T18:29:14.027 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:13.978+0000 7f9399dbcb80 1 Processor -- start 2023-07-14T18:29:14.027 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:13.978+0000 7f9399dbcb80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55636f7b0f60 0x55636f7be0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:29:14.027 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:13.978+0000 7f9399dbcb80 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55636f7b18b0 0x55636f7be6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:29:14.028 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:13.978+0000 7f9399dbcb80 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55636f7b24b0 0x55636f7c13f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:29:14.028 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:13.978+0000 7f9399dbcb80 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x55636f7c1930 con 0x55636f7b24b0 2023-07-14T18:29:14.028 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:13.978+0000 7f9399dbcb80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x55636f7c1aa0 con 0x55636f7b0f60 2023-07-14T18:29:14.028 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:13.978+0000 7f9399dbcb80 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x55636f7c1c60 con 0x55636f7b18b0 2023-07-14T18:29:14.029 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:13.978+0000 7f9399dbcb80 10 client.0 _ll_register_callbacks cb 0x55636f69f760 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-14T18:29:14.029 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:13.978+0000 7f937effd700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55636f7b18b0 0x55636f7be6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:29:14.029 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:13.978+0000 7f93877fe700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55636f7b0f60 0x55636f7be0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:29:14.029 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:13.978+0000 7f937effd700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55636f7b18b0 0x55636f7be6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.163:42510/0 (socket says 172.21.15.163:42510) 2023-07-14T18:29:14.029 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:13.978+0000 7f937effd700 1 -- 172.21.15.163:0/604382497 learned_addr learned my addr 172.21.15.163:0/604382497 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:29:14.030 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:13.978+0000 7f9387fff700 1 --2- 172.21.15.163:0/604382497 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55636f7b24b0 0x55636f7c13f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:29:14.030 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:13.979+0000 7f937effd700 1 -- 172.21.15.163:0/604382497 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55636f7b0f60 msgr2=0x55636f7be0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:29:14.030 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:13.979+0000 7f937effd700 1 --2- 172.21.15.163:0/604382497 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55636f7b0f60 0x55636f7be0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:29:14.030 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:13.979+0000 7f937effd700 1 -- 172.21.15.163:0/604382497 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55636f7b24b0 msgr2=0x55636f7c13f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-14T18:29:14.030 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:13.979+0000 7f937effd700 1 --2- 172.21.15.163:0/604382497 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55636f7b24b0 0x55636f7c13f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:29:14.030 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:13.979+0000 7f937effd700 1 -- 172.21.15.163:0/604382497 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55636f52fde0 con 0x55636f7b18b0 2023-07-14T18:29:14.031 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:13.979+0000 7f93877fe700 1 --2- 172.21.15.163:0/604382497 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55636f7b0f60 0x55636f7be0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T18:29:14.031 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:13.979+0000 7f937effd700 1 --2- 172.21.15.163:0/604382497 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55636f7b18b0 0x55636f7be6b0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f9370013b00 tx=0x7f9370009330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=628338481fbcca1b server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:29:14.031 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:13.979+0000 7f9366ffd700 10 client.0 ms_handle_connect on v2:172.21.15.184:3300/0 2023-07-14T18:29:14.031 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:13.979+0000 7f9366ffd700 1 -- 172.21.15.163:0/604382497 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9370030040 con 0x55636f7b18b0 2023-07-14T18:29:14.031 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:13.979+0000 7f9399dbcb80 1 -- 172.21.15.163:0/604382497 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f9370011040 con 0x55636f7b18b0 2023-07-14T18:29:14.032 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:13.979+0000 7f9366ffd700 1 -- 172.21.15.163:0/604382497 <== mon.1 v2:172.21.15.184:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 9049+0+0 (secure 0 0 0) 0x7f937001e040 con 0x55636f7b18b0 2023-07-14T18:29:14.032 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:13.979+0000 7f9366ffd700 1 -- 172.21.15.163:0/604382497 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9370010040 con 0x55636f7b18b0 2023-07-14T18:29:14.032 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:13.979+0000 7f9399dbcb80 10 client.26338 fetch_fsmap learned FSMap version 39 2023-07-14T18:29:14.032 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:13.979+0000 7f9399dbcb80 1 -- 172.21.15.163:0/604382497 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) v3 -- 0x7f9388107880 con 0x55636f7b18b0 2023-07-14T18:29:14.032 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:13.980+0000 7f9366ffd700 1 -- 172.21.15.163:0/604382497 <== mon.1 v2:172.21.15.184:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f9370011040 con 0x55636f7b18b0 2023-07-14T18:29:14.033 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:13.980+0000 7f9366ffd700 1 -- 172.21.15.163:0/604382497 <== mon.1 v2:172.21.15.184:3300/0 5 ==== fsmap(e 39) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f9370017720 con 0x55636f7b18b0 2023-07-14T18:29:14.033 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:13.980+0000 7f9399dbcb80 10 client.26338 fetch_fsmap finished waiting for FSMap version 39 2023-07-14T18:29:14.033 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:13.980+0000 7f9399dbcb80 10 client.26338 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-07-14T18:29:14.033 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:13.980+0000 7f9399dbcb80 20 client.26338 populate_metadata read hostname 'smithi163' 2023-07-14T18:29:14.034 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:13.980+0000 7f9399dbcb80 1 --2- 172.21.15.163:0/604382497 >> [v2:172.21.15.172:6838/3850440096,v1:172.21.15.172:6839/3850440096] conn(0x55636f81b320 0x55636f81d700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:29:14.034 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:13.980+0000 7f9399dbcb80 4 client.26338 mds_command: new command op to 24518 tid=0[{"prefix": "scrub status"}] 2023-07-14T18:29:14.034 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:13.980+0000 7f9399dbcb80 1 -- 172.21.15.163:0/604382497 --> [v2:172.21.15.172:6838/3850440096,v1:172.21.15.172:6839/3850440096] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55636f6faeb0 con 0x55636f81b320 2023-07-14T18:29:14.034 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:13.980+0000 7f93877fe700 1 --2- 172.21.15.163:0/604382497 >> [v2:172.21.15.172:6838/3850440096,v1:172.21.15.172:6839/3850440096] conn(0x55636f81b320 0x55636f81d700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:29:14.034 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:13.980+0000 7f9366ffd700 10 client.26338 ms_handle_connect on v2:172.21.15.172:6838/3850440096 2023-07-14T18:29:14.034 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:13.980+0000 7f93877fe700 1 --2- 172.21.15.163:0/604382497 >> [v2:172.21.15.172:6838/3850440096,v1:172.21.15.172:6839/3850440096] conn(0x55636f81b320 0x55636f81d700 crc :-1 s=READY pgs=124 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8e71d6cc6dd51a45 server_cookie=64d8379a4af59033 in_seq=0 out_seq=0 2023-07-14T18:29:14.035 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:13.980+0000 7f9366ffd700 1 -- 172.21.15.163:0/604382497 <== mds.0 v2:172.21.15.172:6838/3850440096 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x55636f6faeb0 con 0x55636f81b320 2023-07-14T18:29:14.035 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:13.980+0000 7f9366ffd700 10 client.26338 handle_command_reply: tid=0 2023-07-14T18:29:14.035 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:13.980+0000 7f9399dbcb80 1 client.26338 shutdown 2023-07-14T18:29:14.035 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:13.981+0000 7f9399dbcb80 1 -- 172.21.15.163:0/604382497 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55636f7b18b0 msgr2=0x55636f7be6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:29:14.035 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:13.981+0000 7f9399dbcb80 1 --2- 172.21.15.163:0/604382497 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55636f7b18b0 0x55636f7be6b0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f9370013b00 tx=0x7f9370009330 comp rx=0 tx=0).stop 2023-07-14T18:29:14.036 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:13.981+0000 7f9399dbcb80 1 -- 172.21.15.163:0/604382497 shutdown_connections 2023-07-14T18:29:14.036 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:13.981+0000 7f9399dbcb80 1 --2- 172.21.15.163:0/604382497 >> [v2:172.21.15.172:6838/3850440096,v1:172.21.15.172:6839/3850440096] conn(0x55636f81b320 0x55636f81d700 crc :-1 s=READY pgs=124 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:29:14.036 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:13.981+0000 7f9399dbcb80 1 --2- 172.21.15.163:0/604382497 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x55636f7b24b0 0x55636f7c13f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:29:14.036 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:13.981+0000 7f9399dbcb80 1 --2- 172.21.15.163:0/604382497 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55636f7b0f60 0x55636f7be0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:29:14.036 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:13.981+0000 7f9366ffd700 0 client.26338 ms_handle_reset on v2:172.21.15.172:6838/3850440096 2023-07-14T18:29:14.037 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:13.981+0000 7f9399dbcb80 1 --2- 172.21.15.163:0/604382497 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55636f7b18b0 0x55636f7be6b0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:29:14.037 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:13.981+0000 7f9399dbcb80 1 -- 172.21.15.163:0/604382497 >> 172.21.15.163:0/604382497 conn(0x55636f7a6680 msgr2=0x55636f7b87e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:29:14.037 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:13.981+0000 7f9399dbcb80 1 -- 172.21.15.163:0/604382497 shutdown_connections 2023-07-14T18:29:14.037 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:13.981+0000 7f9399dbcb80 1 -- 172.21.15.163:0/604382497 wait complete. 2023-07-14T18:29:14.037 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:13.981+0000 7f9399dbcb80 20 client.26338 trim_cache size 0 max 16384 2023-07-14T18:29:14.038 INFO:teuthology.orchestra.run.smithi163.stdout:{ 2023-07-14T18:29:14.038 INFO:teuthology.orchestra.run.smithi163.stdout: "status": "IDLE (waiting for more scrubs)", 2023-07-14T18:29:14.038 INFO:teuthology.orchestra.run.smithi163.stdout: "scrubs": { 2023-07-14T18:29:14.039 INFO:teuthology.orchestra.run.smithi163.stdout: "2c53b7ef-6f30-49f0-a60d-f1f114c19d42": { 2023-07-14T18:29:14.039 INFO:teuthology.orchestra.run.smithi163.stdout: "path": "/", 2023-07-14T18:29:14.039 INFO:teuthology.orchestra.run.smithi163.stdout: "tag": "2c53b7ef-6f30-49f0-a60d-f1f114c19d42", 2023-07-14T18:29:14.039 INFO:teuthology.orchestra.run.smithi163.stdout: "options": "recursive,force" 2023-07-14T18:29:14.039 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-07-14T18:29:14.039 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-07-14T18:29:14.040 INFO:teuthology.orchestra.run.smithi163.stdout:} 2023-07-14T18:29:14.041 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:13.981+0000 7f938dc24700 1 -- 172.21.15.163:0/4255729257 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f93740a1150 msgr2=0x7f93740a3600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:29:14.041 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:13.981+0000 7f938dc24700 1 --2- 172.21.15.163:0/4255729257 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f93740a1150 0x7f93740a3600 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f937000be70 tx=0x7f937000d040 comp rx=0 tx=0).stop 2023-07-14T18:29:14.041 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:13.981+0000 7f938dc24700 1 -- 172.21.15.163:0/4255729257 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f93880feb10 msgr2=0x7f93881937a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:29:14.041 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:13.981+0000 7f938dc24700 1 --2- 172.21.15.163:0/4255729257 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f93880feb10 0x7f93881937a0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f937800e970 tx=0x7f937800ec80 comp rx=0 tx=0).stop 2023-07-14T18:29:14.042 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:13.981+0000 7f938dc24700 1 -- 172.21.15.163:0/4255729257 shutdown_connections 2023-07-14T18:29:14.042 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:13.981+0000 7f938dc24700 1 --2- 172.21.15.163:0/4255729257 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f93740a1150 0x7f93740a3600 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:29:14.042 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:13.981+0000 7f938dc24700 1 --2- 172.21.15.163:0/4255729257 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f9388100690 0x7f938819ad50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:29:14.042 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:13.981+0000 7f938dc24700 1 --2- 172.21.15.163:0/4255729257 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f93880feb10 0x7f93881937a0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:29:14.042 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:13.981+0000 7f938dc24700 1 --2- 172.21.15.163:0/4255729257 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f93880ffd00 0x7f9388193ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:29:14.043 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:13.981+0000 7f938dc24700 1 -- 172.21.15.163:0/4255729257 >> 172.21.15.163:0/4255729257 conn(0x7f93880fa130 msgr2=0x7f93880fc340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:29:14.043 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:13.982+0000 7f938dc24700 1 -- 172.21.15.163:0/4255729257 shutdown_connections 2023-07-14T18:29:14.043 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:13.982+0000 7f938dc24700 1 -- 172.21.15.163:0/4255729257 wait complete. 2023-07-14T18:29:14.043 INFO:tasks.cephfs.filesystem:scrub status for tag:2c53b7ef-6f30-49f0-a60d-f1f114c19d42 - {'path': '/', 'tag': '2c53b7ef-6f30-49f0-a60d-f1f114c19d42', 'options': 'recursive,force'} 2023-07-14T18:29:14.044 ERROR:tasks.fwd_scrub.fs.[cephfs]:exception: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_ceph-c_81c9387d2e7576da065747ec9c16d1c7d69016ec/qa/tasks/fwd_scrub.py", line 38, in _run self.do_scrub() File "/home/teuthworker/src/git.ceph.com_ceph-c_81c9387d2e7576da065747ec9c16d1c7d69016ec/qa/tasks/fwd_scrub.py", line 55, in do_scrub self._scrub() File "/home/teuthworker/src/git.ceph.com_ceph-c_81c9387d2e7576da065747ec9c16d1c7d69016ec/qa/tasks/fwd_scrub.py", line 76, in _scrub done = self.fs.wait_until_scrub_complete(tag=tag, sleep=30, timeout=self.scrub_timeout) File "/home/teuthworker/src/git.ceph.com_ceph-c_81c9387d2e7576da065747ec9c16d1c7d69016ec/qa/tasks/cephfs/filesystem.py", line 1683, in wait_until_scrub_complete while proceed(): File "/home/teuthworker/src/git.ceph.com_teuthology_aa6a80e6cc655fff48452a7eca02070e61d074fc/teuthology/contextutil.py", line 134, in __call__ raise MaxWhileTries(error_msg) teuthology.exceptions.MaxWhileTries: reached maximum tries (31) after waiting for 900 seconds 2023-07-14T18:29:14.052 ERROR:teuthology.run_tasks:Manager failed: fwd_scrub Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_aa6a80e6cc655fff48452a7eca02070e61d074fc/teuthology/run_tasks.py", line 192, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_81c9387d2e7576da065747ec9c16d1c7d69016ec/qa/tasks/fwd_scrub.py", line 164, in task stop_all_fwd_scrubbers(ctx.ceph[config['cluster']].thrashers) File "/home/teuthworker/src/git.ceph.com_ceph-c_81c9387d2e7576da065747ec9c16d1c7d69016ec/qa/tasks/fwd_scrub.py", line 99, in stop_all_fwd_scrubbers raise RuntimeError(f"error during scrub thrashing: {thrasher.exception}") RuntimeError: error during scrub thrashing: reached maximum tries (31) after waiting for 900 seconds 2023-07-14T18:29:14.056 DEBUG:teuthology.run_tasks:Unwinding manager check-counter 2023-07-14T18:29:14.067 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-14T18:29:14.214 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:14.180+0000 7fd04b352700 1 -- 172.21.15.163:0/4093899128 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fd0441006e0 msgr2=0x7fd044106f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:29:14.214 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:14.180+0000 7fd04b352700 1 --2- 172.21.15.163:0/4093899128 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fd0441006e0 0x7fd044106f80 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7fd03c00b0a0 tx=0x7fd03c00b3b0 comp rx=0 tx=0).stop 2023-07-14T18:29:14.215 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:14.180+0000 7fd04b352700 1 -- 172.21.15.163:0/4093899128 shutdown_connections 2023-07-14T18:29:14.215 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:14.180+0000 7fd04b352700 1 --2- 172.21.15.163:0/4093899128 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd0440ff020 0x7fd0440ff430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:29:14.215 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:14.180+0000 7fd04b352700 1 --2- 172.21.15.163:0/4093899128 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fd0441006e0 0x7fd044106f80 unknown :-1 s=CLOSED pgs=758 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:29:14.215 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:14.180+0000 7fd04b352700 1 --2- 172.21.15.163:0/4093899128 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd0440ffd30 0x7fd0441001a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:29:14.216 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:14.180+0000 7fd04b352700 1 -- 172.21.15.163:0/4093899128 >> 172.21.15.163:0/4093899128 conn(0x7fd0440f98a0 msgr2=0x7fd0440fbcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:29:14.216 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:14.180+0000 7fd04b352700 1 -- 172.21.15.163:0/4093899128 shutdown_connections 2023-07-14T18:29:14.216 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:14.180+0000 7fd04b352700 1 -- 172.21.15.163:0/4093899128 wait complete. 2023-07-14T18:29:14.216 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:14.180+0000 7fd04b352700 1 Processor -- start 2023-07-14T18:29:14.216 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:14.180+0000 7fd04b352700 1 -- start start 2023-07-14T18:29:14.221 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:14.180+0000 7fd04b352700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd0440ff020 0x7fd044102e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:29:14.221 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:14.180+0000 7fd04b352700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd0440ffd30 0x7fd044101470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:29:14.222 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:14.181+0000 7fd04b352700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fd0441006e0 0x7fd0441019b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:29:14.222 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:14.181+0000 7fd04b352700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd044102150 con 0x7fd0441006e0 2023-07-14T18:29:14.223 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:14.181+0000 7fd04b352700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0441022c0 con 0x7fd0440ffd30 2023-07-14T18:29:14.223 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:14.181+0000 7fd04b352700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd04419f930 con 0x7fd0440ff020 2023-07-14T18:29:14.224 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:14.181+0000 7fd0490ee700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd0440ff020 0x7fd044102e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:29:14.224 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:14.181+0000 7fd0498ef700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fd0441006e0 0x7fd0441019b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:29:14.225 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:14.181+0000 7fd0490ee700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd0440ff020 0x7fd044102e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.163:42522/0 (socket says 172.21.15.163:42522) 2023-07-14T18:29:14.225 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:14.181+0000 7fd0490ee700 1 -- 172.21.15.163:0/3391181006 learned_addr learned my addr 172.21.15.163:0/3391181006 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:29:14.225 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:14.181+0000 7fd0498ef700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fd0441006e0 0x7fd0441019b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:60702/0 (socket says 172.21.15.163:60702) 2023-07-14T18:29:14.226 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:14.181+0000 7fd0488ed700 1 --2- 172.21.15.163:0/3391181006 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd0440ffd30 0x7fd044101470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:29:14.226 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:14.181+0000 7fd0490ee700 1 -- 172.21.15.163:0/3391181006 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd0440ffd30 msgr2=0x7fd044101470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:29:14.226 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:14.181+0000 7fd0490ee700 1 --2- 172.21.15.163:0/3391181006 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd0440ffd30 0x7fd044101470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:29:14.227 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:14.181+0000 7fd0490ee700 1 -- 172.21.15.163:0/3391181006 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fd0441006e0 msgr2=0x7fd0441019b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:29:14.227 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:14.181+0000 7fd0490ee700 1 --2- 172.21.15.163:0/3391181006 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fd0441006e0 0x7fd0441019b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:29:14.228 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:14.181+0000 7fd0490ee700 1 -- 172.21.15.163:0/3391181006 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd034009520 con 0x7fd0440ff020 2023-07-14T18:29:14.228 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:14.181+0000 7fd0498ef700 1 --2- 172.21.15.163:0/3391181006 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fd0441006e0 0x7fd0441019b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T18:29:14.228 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:14.181+0000 7fd0488ed700 1 --2- 172.21.15.163:0/3391181006 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd0440ffd30 0x7fd044101470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T18:29:14.229 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:14.181+0000 7fd0490ee700 1 --2- 172.21.15.163:0/3391181006 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd0440ff020 0x7fd044102e30 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fd04000e950 tx=0x7fd04000ec60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:29:14.229 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:14.181+0000 7fd03a7fc700 1 -- 172.21.15.163:0/3391181006 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd040009770 con 0x7fd0440ff020 2023-07-14T18:29:14.229 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:14.181+0000 7fd04b352700 1 -- 172.21.15.163:0/3391181006 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd03c009d00 con 0x7fd0440ff020 2023-07-14T18:29:14.229 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:14.182+0000 7fd04b352700 1 -- 172.21.15.163:0/3391181006 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd04419ff90 con 0x7fd0440ff020 2023-07-14T18:29:14.230 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:14.182+0000 7fd03a7fc700 1 -- 172.21.15.163:0/3391181006 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fd04000c7e0 con 0x7fd0440ff020 2023-07-14T18:29:14.230 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:14.182+0000 7fd03a7fc700 1 -- 172.21.15.163:0/3391181006 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd040003b90 con 0x7fd0440ff020 2023-07-14T18:29:14.230 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:14.182+0000 7fd04b352700 1 -- 172.21.15.163:0/3391181006 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd028005320 con 0x7fd0440ff020 2023-07-14T18:29:14.230 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:14.184+0000 7fd03a7fc700 1 -- 172.21.15.163:0/3391181006 <== mon.1 v2:172.21.15.184:3300/0 4 ==== mgrmap(e 18) v1 ==== 135716+0+0 (secure 0 0 0) 0x7fd040003cf0 con 0x7fd0440ff020 2023-07-14T18:29:14.230 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:14.185+0000 7fd03a7fc700 1 --2- 172.21.15.163:0/3391181006 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7fd0300a11a0 0x7fd0300a3650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:29:14.231 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:14.185+0000 7fd0488ed700 1 --2- 172.21.15.163:0/3391181006 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7fd0300a11a0 0x7fd0300a3650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:29:14.231 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:14.185+0000 7fd03a7fc700 1 -- 172.21.15.163:0/3391181006 <== mon.1 v2:172.21.15.184:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 9049+0+0 (secure 0 0 0) 0x7fd040014070 con 0x7fd0440ff020 2023-07-14T18:29:14.231 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:14.185+0000 7fd0488ed700 1 --2- 172.21.15.163:0/3391181006 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7fd0300a11a0 0x7fd0300a3650 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7fd034009fd0 tx=0x7fd034009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:29:14.232 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:14.189+0000 7fd03a7fc700 1 -- 172.21.15.163:0/3391181006 <== mon.1 v2:172.21.15.184:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178025 (secure 0 0 0) 0x7fd0400962e0 con 0x7fd0440ff020 2023-07-14T18:29:14.481 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:14.448+0000 7fd04b352700 1 -- 172.21.15.163:0/3391181006 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd028005190 con 0x7fd0440ff020 2023-07-14T18:29:14.483 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:14.450+0000 7fd03a7fc700 1 -- 172.21.15.163:0/3391181006 <== mon.1 v2:172.21.15.184:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v88) v1 ==== 74+0+24603 (secure 0 0 0) 0x7fd040099900 con 0x7fd0440ff020 2023-07-14T18:29:14.484 INFO:teuthology.orchestra.run.smithi163.stdout: 2023-07-14T18:29:14.484 INFO:teuthology.orchestra.run.smithi163.stdout:{"epoch":88,"fsid":"bf7326ec-2270-11ee-9b33-001a4aab830c","created":"2023-07-14T18:04:26.263517+0000","modified":"2023-07-14T18:13:17.791075+0000","last_up_change":"2023-07-14T18:10:27.514863+0000","last_in_change":"2023-07-14T18:10:10.726443+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-14T18:07:19.653852+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-07-14T18:11:07.314989+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-07-14T18:11:08.274627+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-07-14T18:11:11.991162+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"e6490568-046d-43ef-bb07-d79fb884b276","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6802","nonce":3124653025},{"type":"v1","addr":"172.21.15.163:6803","nonce":3124653025}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6804","nonce":3124653025},{"type":"v1","addr":"172.21.15.163:6805","nonce":3124653025}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6808","nonce":3124653025},{"type":"v1","addr":"172.21.15.163:6809","nonce":3124653025}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6806","nonce":3124653025},{"type":"v1","addr":"172.21.15.163:6807","nonce":3124653025}]},"public_addr":"172.21.15.163:6803/3124653025","cluster_addr":"172.21.15.163:6805/3124653025","heartbeat_back_addr":"172.21.15.163:6809/3124653025","heartbeat_front_addr":"172.21.15.163:6807/3124653025","state":["exists","up"]},{"osd":1,"uuid":"0af39bda-f096-4603-adcc-bf1988f36603","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":3774455900},{"type":"v1","addr":"172.21.15.172:6801","nonce":3774455900}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":3774455900},{"type":"v1","addr":"172.21.15.172:6803","nonce":3774455900}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":3774455900},{"type":"v1","addr":"172.21.15.172:6807","nonce":3774455900}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":3774455900},{"type":"v1","addr":"172.21.15.172:6805","nonce":3774455900}]},"public_addr":"172.21.15.172:6801/3774455900","cluster_addr":"172.21.15.172:6803/3774455900","heartbeat_back_addr":"172.21.15.172:6807/3774455900","heartbeat_front_addr":"172.21.15.172:6805/3774455900","state":["exists","up"]},{"osd":2,"uuid":"cc732c13-af0f-4199-98e6-fe960ed4e5dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":1976927678},{"type":"v1","addr":"172.21.15.184:6801","nonce":1976927678}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":1976927678},{"type":"v1","addr":"172.21.15.184:6803","nonce":1976927678}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":1976927678},{"type":"v1","addr":"172.21.15.184:6807","nonce":1976927678}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":1976927678},{"type":"v1","addr":"172.21.15.184:6805","nonce":1976927678}]},"public_addr":"172.21.15.184:6801/1976927678","cluster_addr":"172.21.15.184:6803/1976927678","heartbeat_back_addr":"172.21.15.184:6807/1976927678","heartbeat_front_addr":"172.21.15.184:6805/1976927678","state":["exists","up"]},{"osd":3,"uuid":"dcee9576-0bc6-4ab0-8f63-79eacd0eca5f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6810","nonce":2589130694},{"type":"v1","addr":"172.21.15.163:6811","nonce":2589130694}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6812","nonce":2589130694},{"type":"v1","addr":"172.21.15.163:6813","nonce":2589130694}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6816","nonce":2589130694},{"type":"v1","addr":"172.21.15.163:6817","nonce":2589130694}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6814","nonce":2589130694},{"type":"v1","addr":"172.21.15.163:6815","nonce":2589130694}]},"public_addr":"172.21.15.163:6811/2589130694","cluster_addr":"172.21.15.163:6813/2589130694","heartbeat_back_addr":"172.21.15.163:6817/2589130694","heartbeat_front_addr":"172.21.15.163:6815/2589130694","state":["exists","up"]},{"osd":4,"uuid":"055df823-b8b0-426a-83c2-f0d727932ad8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":3319632614},{"type":"v1","addr":"172.21.15.172:6809","nonce":3319632614}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6810","nonce":3319632614},{"type":"v1","addr":"172.21.15.172:6811","nonce":3319632614}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6814","nonce":3319632614},{"type":"v1","addr":"172.21.15.172:6815","nonce":3319632614}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":3319632614},{"type":"v1","addr":"172.21.15.172:6813","nonce":3319632614}]},"public_addr":"172.21.15.172:6809/3319632614","cluster_addr":"172.21.15.172:6811/3319632614","heartbeat_back_addr":"172.21.15.172:6815/3319632614","heartbeat_front_addr":"172.21.15.172:6813/3319632614","state":["exists","up"]},{"osd":5,"uuid":"ef5ef02a-b4e2-4790-9d27-f6d2247b25c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":2662084043},{"type":"v1","addr":"172.21.15.184:6809","nonce":2662084043}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6810","nonce":2662084043},{"type":"v1","addr":"172.21.15.184:6811","nonce":2662084043}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6814","nonce":2662084043},{"type":"v1","addr":"172.21.15.184:6815","nonce":2662084043}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6812","nonce":2662084043},{"type":"v1","addr":"172.21.15.184:6813","nonce":2662084043}]},"public_addr":"172.21.15.184:6809/2662084043","cluster_addr":"172.21.15.184:6811/2662084043","heartbeat_back_addr":"172.21.15.184:6815/2662084043","heartbeat_front_addr":"172.21.15.184:6813/2662084043","state":["exists","up"]},{"osd":6,"uuid":"dba754be-0fc5-4867-a6d5-cf97eb344f81","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":44,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6818","nonce":2530874117},{"type":"v1","addr":"172.21.15.163:6819","nonce":2530874117}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6820","nonce":2530874117},{"type":"v1","addr":"172.21.15.163:6821","nonce":2530874117}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6824","nonce":2530874117},{"type":"v1","addr":"172.21.15.163:6825","nonce":2530874117}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6822","nonce":2530874117},{"type":"v1","addr":"172.21.15.163:6823","nonce":2530874117}]},"public_addr":"172.21.15.163:6819/2530874117","cluster_addr":"172.21.15.163:6821/2530874117","heartbeat_back_addr":"172.21.15.163:6825/2530874117","heartbeat_front_addr":"172.21.15.163:6823/2530874117","state":["exists","up"]},{"osd":7,"uuid":"edd76e6b-6077-4619-b00d-1e906f70ddcc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":49,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":233511803},{"type":"v1","addr":"172.21.15.172:6817","nonce":233511803}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6818","nonce":233511803},{"type":"v1","addr":"172.21.15.172:6819","nonce":233511803}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":233511803},{"type":"v1","addr":"172.21.15.172:6823","nonce":233511803}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6820","nonce":233511803},{"type":"v1","addr":"172.21.15.172:6821","nonce":233511803}]},"public_addr":"172.21.15.172:6817/233511803","cluster_addr":"172.21.15.172:6819/233511803","heartbeat_back_addr":"172.21.15.172:6823/233511803","heartbeat_front_addr":"172.21.15.172:6821/233511803","state":["exists","up"]},{"osd":8,"uuid":"36559400-f33e-44e6-868a-316d34da457d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":56,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6816","nonce":290154343},{"type":"v1","addr":"172.21.15.184:6817","nonce":290154343}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6818","nonce":290154343},{"type":"v1","addr":"172.21.15.184:6819","nonce":290154343}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6822","nonce":290154343},{"type":"v1","addr":"172.21.15.184:6823","nonce":290154343}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6820","nonce":290154343},{"type":"v1","addr":"172.21.15.184:6821","nonce":290154343}]},"public_addr":"172.21.15.184:6817/290154343","cluster_addr":"172.21.15.184:6819/290154343","heartbeat_back_addr":"172.21.15.184:6823/290154343","heartbeat_front_addr":"172.21.15.184:6821/290154343","state":["exists","up"]},{"osd":9,"uuid":"d484f111-f36c-4c67-9a8a-ae03e7e0d137","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6826","nonce":3848110906},{"type":"v1","addr":"172.21.15.163:6827","nonce":3848110906}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6828","nonce":3848110906},{"type":"v1","addr":"172.21.15.163:6829","nonce":3848110906}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6832","nonce":3848110906},{"type":"v1","addr":"172.21.15.163:6833","nonce":3848110906}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6830","nonce":3848110906},{"type":"v1","addr":"172.21.15.163:6831","nonce":3848110906}]},"public_addr":"172.21.15.163:6827/3848110906","cluster_addr":"172.21.15.163:6829/3848110906","heartbeat_back_addr":"172.21.15.163:6833/3848110906","heartbeat_front_addr":"172.21.15.163:6831/3848110906","state":["exists","up"]},{"osd":10,"uuid":"d943f7c0-da3d-4605-9e23-0231e675c6be","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6824","nonce":3281085356},{"type":"v1","addr":"172.21.15.172:6825","nonce":3281085356}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":3281085356},{"type":"v1","addr":"172.21.15.172:6827","nonce":3281085356}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":3281085356},{"type":"v1","addr":"172.21.15.172:6831","nonce":3281085356}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6828","nonce":3281085356},{"type":"v1","addr":"172.21.15.172:6829","nonce":3281085356}]},"public_addr":"172.21.15.172:6825/3281085356","cluster_addr":"172.21.15.172:6827/3281085356","heartbeat_back_addr":"172.21.15.172:6831/3281085356","heartbeat_front_addr":"172.21.15.172:6829/3281085356","state":["exists","up"]},{"osd":11,"uuid":"09e610a8-408a-4119-a21b-c4de2810a538","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":75,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6824","nonce":3614578747},{"type":"v1","addr":"172.21.15.184:6825","nonce":3614578747}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6826","nonce":3614578747},{"type":"v1","addr":"172.21.15.184:6827","nonce":3614578747}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6830","nonce":3614578747},{"type":"v1","addr":"172.21.15.184:6831","nonce":3614578747}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6828","nonce":3614578747},{"type":"v1","addr":"172.21.15.184:6829","nonce":3614578747}]},"public_addr":"172.21.15.184:6825/3614578747","cluster_addr":"172.21.15.184:6827/3614578747","heartbeat_back_addr":"172.21.15.184:6831/3614578747","heartbeat_front_addr":"172.21.15.184:6829/3614578747","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T18:06:36.067578+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T18:06:57.095120+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T18:07:17.825363+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T18:07:38.977196+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T18:08:00.108709+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T18:08:20.700646+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T18:08:41.473899+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T18:09:02.856536+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T18:09:23.832722+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T18:09:44.860884+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T18:10:05.520678+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T18:10:26.426315+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.8","mappings":[{"from":2,"to":11}]},{"pgid":"2.b","mappings":[{"from":8,"to":11}]},{"pgid":"3.1","mappings":[{"from":4,"to":9}]},{"pgid":"3.6","mappings":[{"from":4,"to":6}]},{"pgid":"3.25","mappings":[{"from":5,"to":9}]},{"pgid":"3.27","mappings":[{"from":4,"to":8}]},{"pgid":"3.2d","mappings":[{"from":3,"to":9}]},{"pgid":"4.a","mappings":[{"from":5,"to":8}]},{"pgid":"4.12","mappings":[{"from":9,"to":10}]},{"pgid":"4.14","mappings":[{"from":9,"to":8}]},{"pgid":"4.17","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.163:6801/1086512093":"2023-07-15T18:05:15.331458+0000","172.21.15.163:6800/1086512093":"2023-07-15T18:05:15.331458+0000","172.21.15.163:0/4235784810":"2023-07-15T18:05:15.331458+0000","172.21.15.163:6800/236891232":"2023-07-15T18:04:53.288443+0000","172.21.15.163:6801/236891232":"2023-07-15T18:04:53.288443+0000","172.21.15.163:0/3260193612":"2023-07-15T18:05:15.331458+0000","172.21.15.163:0/3513629472":"2023-07-15T18:04:53.288443+0000","172.21.15.163:0/1090329830":"2023-07-15T18:04:53.288443+0000","172.21.15.163:0/3868922045":"2023-07-15T18:05:15.331458+0000","172.21.15.163:0/2945662447":"2023-07-15T18:04:53.288443+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-14T18:29:14.486 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:14.452+0000 7fd04b352700 1 -- 172.21.15.163:0/3391181006 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7fd0300a11a0 msgr2=0x7fd0300a3650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:29:14.486 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:14.452+0000 7fd04b352700 1 --2- 172.21.15.163:0/3391181006 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7fd0300a11a0 0x7fd0300a3650 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7fd034009fd0 tx=0x7fd034009260 comp rx=0 tx=0).stop 2023-07-14T18:29:14.486 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:14.452+0000 7fd04b352700 1 -- 172.21.15.163:0/3391181006 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd0440ff020 msgr2=0x7fd044102e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:29:14.486 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:14.452+0000 7fd04b352700 1 --2- 172.21.15.163:0/3391181006 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd0440ff020 0x7fd044102e30 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fd04000e950 tx=0x7fd04000ec60 comp rx=0 tx=0).stop 2023-07-14T18:29:14.487 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:14.452+0000 7fd04b352700 1 -- 172.21.15.163:0/3391181006 shutdown_connections 2023-07-14T18:29:14.487 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:14.452+0000 7fd04b352700 1 --2- 172.21.15.163:0/3391181006 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7fd0300a11a0 0x7fd0300a3650 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:29:14.487 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:14.452+0000 7fd04b352700 1 --2- 172.21.15.163:0/3391181006 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd0440ff020 0x7fd044102e30 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:29:14.487 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:14.452+0000 7fd04b352700 1 --2- 172.21.15.163:0/3391181006 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fd0441006e0 0x7fd0441019b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:29:14.487 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:14.452+0000 7fd04b352700 1 --2- 172.21.15.163:0/3391181006 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd0440ffd30 0x7fd044101470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:29:14.488 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:14.452+0000 7fd04b352700 1 -- 172.21.15.163:0/3391181006 >> 172.21.15.163:0/3391181006 conn(0x7fd0440f98a0 msgr2=0x7fd0440fbb20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:29:14.488 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:14.452+0000 7fd04b352700 1 -- 172.21.15.163:0/3391181006 shutdown_connections 2023-07-14T18:29:14.488 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:14.452+0000 7fd04b352700 1 -- 172.21.15.163:0/3391181006 wait complete. 2023-07-14T18:29:14.498 INFO:tasks.check_counter.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-14T18:07:19.653852+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-14T18:11:07.314989+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '79', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-07-14T18:11:08.274627+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '80', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-07-14T18:11:11.991162+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '84', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-07-14T18:29:14.499 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-14T18:29:14.642 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:14.608+0000 7f5eb2b2e700 1 -- 172.21.15.163:0/532410966 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f5eac1017c0 msgr2=0x7f5eac108080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:29:14.643 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:14.608+0000 7f5eb2b2e700 1 --2- 172.21.15.163:0/532410966 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f5eac1017c0 0x7f5eac108080 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7f5ea400b0a0 tx=0x7f5ea400b3b0 comp rx=0 tx=0).stop 2023-07-14T18:29:14.643 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:14.608+0000 7f5eb2b2e700 1 -- 172.21.15.163:0/532410966 shutdown_connections 2023-07-14T18:29:14.643 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:14.608+0000 7f5eb2b2e700 1 --2- 172.21.15.163:0/532410966 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5eac0ffc40 0x7f5eac100050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:29:14.643 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:14.608+0000 7f5eb2b2e700 1 --2- 172.21.15.163:0/532410966 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f5eac1017c0 0x7f5eac108080 unknown :-1 s=CLOSED pgs=759 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:29:14.644 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:14.608+0000 7f5eb2b2e700 1 --2- 172.21.15.163:0/532410966 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5eac100e30 0x7f5eac101280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:29:14.644 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:14.608+0000 7f5eb2b2e700 1 -- 172.21.15.163:0/532410966 >> 172.21.15.163:0/532410966 conn(0x7f5eac0fb260 msgr2=0x7f5eac0fd690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:29:14.644 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:14.608+0000 7f5eb2b2e700 1 -- 172.21.15.163:0/532410966 shutdown_connections 2023-07-14T18:29:14.644 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:14.608+0000 7f5eb2b2e700 1 -- 172.21.15.163:0/532410966 wait complete. 2023-07-14T18:29:14.645 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:14.609+0000 7f5eb2b2e700 1 Processor -- start 2023-07-14T18:29:14.645 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:14.609+0000 7f5eb2b2e700 1 -- start start 2023-07-14T18:29:14.647 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:14.609+0000 7f5eb2b2e700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f5eac0ffc40 0x7f5eac195970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:29:14.647 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:14.609+0000 7f5eb2b2e700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5eac100e30 0x7f5eac195eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:29:14.647 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:14.609+0000 7f5eb2b2e700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5eac1017c0 0x7f5eac19cf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:29:14.648 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:14.609+0000 7f5eb2b2e700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5eac19d4f0 con 0x7f5eac0ffc40 2023-07-14T18:29:14.648 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:14.609+0000 7f5eb2b2e700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5eac19d630 con 0x7f5eac1017c0 2023-07-14T18:29:14.648 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:14.609+0000 7f5eb2b2e700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5eac19d7c0 con 0x7f5eac100e30 2023-07-14T18:29:14.648 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:14.609+0000 7f5eb08ca700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f5eac0ffc40 0x7f5eac195970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:29:14.648 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:14.609+0000 7f5eb08ca700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f5eac0ffc40 0x7f5eac195970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:60714/0 (socket says 172.21.15.163:60714) 2023-07-14T18:29:14.649 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:14.609+0000 7f5eb08ca700 1 -- 172.21.15.163:0/1464003368 learned_addr learned my addr 172.21.15.163:0/1464003368 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:29:14.649 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:14.609+0000 7f5eabfff700 1 --2- 172.21.15.163:0/1464003368 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5eac100e30 0x7f5eac195eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:29:14.649 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:14.609+0000 7f5eb10cb700 1 --2- 172.21.15.163:0/1464003368 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5eac1017c0 0x7f5eac19cf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:29:14.649 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:14.609+0000 7f5eb08ca700 1 -- 172.21.15.163:0/1464003368 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5eac100e30 msgr2=0x7f5eac195eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:29:14.650 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:14.609+0000 7f5eb08ca700 1 --2- 172.21.15.163:0/1464003368 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5eac100e30 0x7f5eac195eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:29:14.650 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:14.609+0000 7f5eb08ca700 1 -- 172.21.15.163:0/1464003368 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5eac1017c0 msgr2=0x7f5eac19cf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:29:14.650 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:14.609+0000 7f5eb08ca700 1 --2- 172.21.15.163:0/1464003368 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5eac1017c0 0x7f5eac19cf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:29:14.650 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:14.609+0000 7f5eb08ca700 1 -- 172.21.15.163:0/1464003368 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ea4009d00 con 0x7f5eac0ffc40 2023-07-14T18:29:14.650 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:14.610+0000 7f5eb08ca700 1 --2- 172.21.15.163:0/1464003368 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f5eac0ffc40 0x7f5eac195970 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7f5ea000e970 tx=0x7f5ea000ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:29:14.651 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:14.610+0000 7f5ea9ffb700 1 -- 172.21.15.163:0/1464003368 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ea0009790 con 0x7f5eac0ffc40 2023-07-14T18:29:14.651 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:14.610+0000 7f5ea9ffb700 1 -- 172.21.15.163:0/1464003368 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f5ea000c7e0 con 0x7f5eac0ffc40 2023-07-14T18:29:14.651 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:14.610+0000 7f5ea9ffb700 1 -- 172.21.15.163:0/1464003368 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ea0003bd0 con 0x7f5eac0ffc40 2023-07-14T18:29:14.651 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:14.610+0000 7f5eb2b2e700 1 -- 172.21.15.163:0/1464003368 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5eac19daa0 con 0x7f5eac0ffc40 2023-07-14T18:29:14.651 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:14.610+0000 7f5eb2b2e700 1 -- 172.21.15.163:0/1464003368 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5eac19df60 con 0x7f5eac0ffc40 2023-07-14T18:29:14.652 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:14.611+0000 7f5eb2b2e700 1 -- 172.21.15.163:0/1464003368 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5eac1071d0 con 0x7f5eac0ffc40 2023-07-14T18:29:14.652 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:14.612+0000 7f5ea9ffb700 1 -- 172.21.15.163:0/1464003368 <== mon.0 v2:172.21.15.163:3300/0 4 ==== mgrmap(e 18) v1 ==== 135716+0+0 (secure 0 0 0) 0x7f5ea000c950 con 0x7f5eac0ffc40 2023-07-14T18:29:14.652 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:14.613+0000 7f5ea9ffb700 1 --2- 172.21.15.163:0/1464003368 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f5e9c0a1150 0x7f5e9c0a3600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:29:14.652 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:14.613+0000 7f5eabfff700 1 --2- 172.21.15.163:0/1464003368 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f5e9c0a1150 0x7f5e9c0a3600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:29:14.652 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:14.613+0000 7f5ea9ffb700 1 -- 172.21.15.163:0/1464003368 <== mon.0 v2:172.21.15.163:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 9049+0+0 (secure 0 0 0) 0x7f5ea0014070 con 0x7f5eac0ffc40 2023-07-14T18:29:14.653 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:14.613+0000 7f5eabfff700 1 --2- 172.21.15.163:0/1464003368 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f5e9c0a1150 0x7f5e9c0a3600 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f5e98009c60 tx=0x7f5e98009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:29:14.653 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:14.617+0000 7f5ea9ffb700 1 -- 172.21.15.163:0/1464003368 <== mon.0 v2:172.21.15.163:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178025 (secure 0 0 0) 0x7f5ea00d3080 con 0x7f5eac0ffc40 2023-07-14T18:29:14.897 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:14.863+0000 7f5eb2b2e700 1 -- 172.21.15.163:0/1464003368 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f5eac02c8e0 con 0x7f5eac0ffc40 2023-07-14T18:29:14.898 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:14.864+0000 7f5ea9ffb700 1 -- 172.21.15.163:0/1464003368 <== mon.0 v2:172.21.15.163:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v88) v1 ==== 93+0+10 (secure 0 0 0) 0x7f5eac02c8e0 con 0x7f5eac0ffc40 2023-07-14T18:29:14.898 INFO:teuthology.orchestra.run.smithi163.stdout:pg_num: 1 2023-07-14T18:29:14.901 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:14.867+0000 7f5eb2b2e700 1 -- 172.21.15.163:0/1464003368 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f5e9c0a1150 msgr2=0x7f5e9c0a3600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:29:14.901 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:14.867+0000 7f5eb2b2e700 1 --2- 172.21.15.163:0/1464003368 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f5e9c0a1150 0x7f5e9c0a3600 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f5e98009c60 tx=0x7f5e98009260 comp rx=0 tx=0).stop 2023-07-14T18:29:14.901 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:14.867+0000 7f5eb2b2e700 1 -- 172.21.15.163:0/1464003368 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f5eac0ffc40 msgr2=0x7f5eac195970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:29:14.902 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:14.867+0000 7f5eb2b2e700 1 --2- 172.21.15.163:0/1464003368 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f5eac0ffc40 0x7f5eac195970 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7f5ea000e970 tx=0x7f5ea000ec80 comp rx=0 tx=0).stop 2023-07-14T18:29:14.902 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:14.867+0000 7f5eb2b2e700 1 -- 172.21.15.163:0/1464003368 shutdown_connections 2023-07-14T18:29:14.902 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:14.867+0000 7f5eb2b2e700 1 --2- 172.21.15.163:0/1464003368 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f5e9c0a1150 0x7f5e9c0a3600 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:29:14.902 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:14.867+0000 7f5eb2b2e700 1 --2- 172.21.15.163:0/1464003368 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5eac1017c0 0x7f5eac19cf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:29:14.902 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:14.867+0000 7f5eb2b2e700 1 --2- 172.21.15.163:0/1464003368 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f5eac0ffc40 0x7f5eac195970 unknown :-1 s=CLOSED pgs=760 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:29:14.903 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:14.867+0000 7f5eb2b2e700 1 --2- 172.21.15.163:0/1464003368 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5eac100e30 0x7f5eac195eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:29:14.903 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:14.867+0000 7f5eb2b2e700 1 -- 172.21.15.163:0/1464003368 >> 172.21.15.163:0/1464003368 conn(0x7f5eac0fb260 msgr2=0x7f5eac104310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:29:14.903 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:14.867+0000 7f5eb2b2e700 1 -- 172.21.15.163:0/1464003368 shutdown_connections 2023-07-14T18:29:14.903 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:14.867+0000 7f5eb2b2e700 1 -- 172.21.15.163:0/1464003368 wait complete. 2023-07-14T18:29:14.916 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-14T18:29:15.056 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:15.021+0000 7f34948e7700 1 -- 172.21.15.163:0/786800737 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f3490103010 msgr2=0x7f34901053f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:29:15.056 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:15.021+0000 7f34948e7700 1 --2- 172.21.15.163:0/786800737 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f3490103010 0x7f34901053f0 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7f3484009990 tx=0x7f3484009ca0 comp rx=0 tx=0).stop 2023-07-14T18:29:15.056 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:15.021+0000 7f34948e7700 1 -- 172.21.15.163:0/786800737 shutdown_connections 2023-07-14T18:29:15.057 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:15.021+0000 7f34948e7700 1 --2- 172.21.15.163:0/786800737 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3490105930 0x7f3490107d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:29:15.057 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:15.021+0000 7f34948e7700 1 --2- 172.21.15.163:0/786800737 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f34901006f0 0x7f3490102ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:29:15.057 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:15.021+0000 7f34948e7700 1 --2- 172.21.15.163:0/786800737 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f3490103010 0x7f34901053f0 unknown :-1 s=CLOSED pgs=761 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:29:15.057 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:15.021+0000 7f34948e7700 1 -- 172.21.15.163:0/786800737 >> 172.21.15.163:0/786800737 conn(0x7f34900fa130 msgr2=0x7f34900fc560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:29:15.058 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:15.022+0000 7f34948e7700 1 -- 172.21.15.163:0/786800737 shutdown_connections 2023-07-14T18:29:15.058 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:15.022+0000 7f34948e7700 1 -- 172.21.15.163:0/786800737 wait complete. 2023-07-14T18:29:15.060 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:15.022+0000 7f34948e7700 1 Processor -- start 2023-07-14T18:29:15.060 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:15.022+0000 7f34948e7700 1 -- start start 2023-07-14T18:29:15.060 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:15.023+0000 7f34948e7700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f34901006f0 0x7f3490100060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:29:15.060 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:15.023+0000 7f34948e7700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f3490103010 0x7f34900fe6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:29:15.061 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:15.023+0000 7f34948e7700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3490105930 0x7f34900febe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:29:15.061 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:15.023+0000 7f34948e7700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34900ff380 con 0x7f3490103010 2023-07-14T18:29:15.061 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:15.023+0000 7f34948e7700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34900ff4f0 con 0x7f34901006f0 2023-07-14T18:29:15.061 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:15.023+0000 7f34948e7700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f349019f8b0 con 0x7f3490105930 2023-07-14T18:29:15.061 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:15.023+0000 7f348dd9b700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f3490103010 0x7f34900fe6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:29:15.062 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:15.023+0000 7f348e59c700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f34901006f0 0x7f3490100060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:29:15.062 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:15.023+0000 7f348dd9b700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f3490103010 0x7f34900fe6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:60730/0 (socket says 172.21.15.163:60730) 2023-07-14T18:29:15.062 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:15.023+0000 7f348ed9d700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3490105930 0x7f34900febe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:29:15.062 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:15.023+0000 7f348dd9b700 1 -- 172.21.15.163:0/3064828840 learned_addr learned my addr 172.21.15.163:0/3064828840 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:29:15.062 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:15.023+0000 7f348e59c700 1 -- 172.21.15.163:0/3064828840 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3490105930 msgr2=0x7f34900febe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:29:15.063 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:15.023+0000 7f348e59c700 1 --2- 172.21.15.163:0/3064828840 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3490105930 0x7f34900febe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:29:15.063 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:15.023+0000 7f348e59c700 1 -- 172.21.15.163:0/3064828840 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f3490103010 msgr2=0x7f34900fe6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:29:15.063 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:15.023+0000 7f348e59c700 1 --2- 172.21.15.163:0/3064828840 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f3490103010 0x7f34900fe6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:29:15.063 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:15.023+0000 7f348e59c700 1 -- 172.21.15.163:0/3064828840 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34840095f0 con 0x7f34901006f0 2023-07-14T18:29:15.063 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:15.023+0000 7f348dd9b700 1 --2- 172.21.15.163:0/3064828840 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f3490103010 0x7f34900fe6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T18:29:15.064 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:15.023+0000 7f348e59c700 1 --2- 172.21.15.163:0/3064828840 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f34901006f0 0x7f3490100060 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f348000e9f0 tx=0x7f348000ed00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:29:15.064 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:15.023+0000 7f347f7fe700 1 -- 172.21.15.163:0/3064828840 <== mon.2 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f348000c9c0 con 0x7f34901006f0 2023-07-14T18:29:15.064 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:15.023+0000 7f34948e7700 1 -- 172.21.15.163:0/3064828840 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f349019fb90 con 0x7f34901006f0 2023-07-14T18:29:15.064 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:15.024+0000 7f34948e7700 1 -- 172.21.15.163:0/3064828840 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f34901a00f0 con 0x7f34901006f0 2023-07-14T18:29:15.065 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:15.024+0000 7f347f7fe700 1 -- 172.21.15.163:0/3064828840 <== mon.2 v2:172.21.15.172:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f3480010430 con 0x7f34901006f0 2023-07-14T18:29:15.065 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:15.024+0000 7f347f7fe700 1 -- 172.21.15.163:0/3064828840 <== mon.2 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3480018680 con 0x7f34901006f0 2023-07-14T18:29:15.065 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:15.025+0000 7f34948e7700 1 -- 172.21.15.163:0/3064828840 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f34900fbca0 con 0x7f34901006f0 2023-07-14T18:29:15.065 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:15.026+0000 7f347f7fe700 1 -- 172.21.15.163:0/3064828840 <== mon.2 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 18) v1 ==== 135716+0+0 (secure 0 0 0) 0x7f3480010830 con 0x7f34901006f0 2023-07-14T18:29:15.066 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:15.026+0000 7f347f7fe700 1 --2- 172.21.15.163:0/3064828840 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f34780a1150 0x7f34780a3600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:29:15.066 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:15.026+0000 7f348dd9b700 1 --2- 172.21.15.163:0/3064828840 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f34780a1150 0x7f34780a3600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:29:15.066 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:15.027+0000 7f347f7fe700 1 -- 172.21.15.163:0/3064828840 <== mon.2 v2:172.21.15.172:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 9049+0+0 (secure 0 0 0) 0x7f3480014070 con 0x7f34901006f0 2023-07-14T18:29:15.067 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:15.027+0000 7f348dd9b700 1 --2- 172.21.15.163:0/3064828840 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f34780a1150 0x7f34780a3600 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f3484006010 tx=0x7f3484005960 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:29:15.067 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:15.033+0000 7f347f7fe700 1 -- 172.21.15.163:0/3064828840 <== mon.2 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178025 (secure 0 0 0) 0x7f3480051780 con 0x7f34901006f0 2023-07-14T18:29:15.167 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:29:14 smithi184 ceph-mon[98481]: pgmap v797: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-07-14T18:29:15.168 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:29:14 smithi184 ceph-mon[98481]: from='client.? 172.21.15.163:0/3391181006' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-07-14T18:29:15.210 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:29:14 smithi163 ceph-mon[96576]: pgmap v797: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-07-14T18:29:15.210 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:29:14 smithi163 ceph-mon[96576]: from='client.? 172.21.15.163:0/3391181006' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-07-14T18:29:15.268 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:29:14 smithi172 ceph-mon[97983]: pgmap v797: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-07-14T18:29:15.269 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:29:14 smithi172 ceph-mon[97983]: from='client.? 172.21.15.163:0/3391181006' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-07-14T18:29:15.299 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:15.265+0000 7f34948e7700 1 -- 172.21.15.163:0/3064828840 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f349002c8e0 con 0x7f34901006f0 2023-07-14T18:29:15.299 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:15.265+0000 7f347f7fe700 1 -- 172.21.15.163:0/3064828840 <== mon.2 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v88) v1 ==== 104+0+11 (secure 0 0 0) 0x7f349002c8e0 con 0x7f34901006f0 2023-07-14T18:29:15.300 INFO:teuthology.orchestra.run.smithi163.stdout:pg_num: 32 2023-07-14T18:29:15.302 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:15.268+0000 7f34948e7700 1 -- 172.21.15.163:0/3064828840 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f34780a1150 msgr2=0x7f34780a3600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:29:15.302 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:15.268+0000 7f34948e7700 1 --2- 172.21.15.163:0/3064828840 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f34780a1150 0x7f34780a3600 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f3484006010 tx=0x7f3484005960 comp rx=0 tx=0).stop 2023-07-14T18:29:15.302 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:15.268+0000 7f34948e7700 1 -- 172.21.15.163:0/3064828840 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f34901006f0 msgr2=0x7f3490100060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:29:15.302 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:15.268+0000 7f34948e7700 1 --2- 172.21.15.163:0/3064828840 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f34901006f0 0x7f3490100060 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f348000e9f0 tx=0x7f348000ed00 comp rx=0 tx=0).stop 2023-07-14T18:29:15.303 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:15.268+0000 7f34948e7700 1 -- 172.21.15.163:0/3064828840 shutdown_connections 2023-07-14T18:29:15.303 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:15.268+0000 7f34948e7700 1 --2- 172.21.15.163:0/3064828840 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f34780a1150 0x7f34780a3600 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:29:15.303 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:15.268+0000 7f34948e7700 1 --2- 172.21.15.163:0/3064828840 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3490105930 0x7f34900febe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:29:15.303 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:15.268+0000 7f34948e7700 1 --2- 172.21.15.163:0/3064828840 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f34901006f0 0x7f3490100060 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:29:15.303 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:15.268+0000 7f34948e7700 1 --2- 172.21.15.163:0/3064828840 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f3490103010 0x7f34900fe6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:29:15.304 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:15.268+0000 7f34948e7700 1 -- 172.21.15.163:0/3064828840 >> 172.21.15.163:0/3064828840 conn(0x7f34900fa130 msgr2=0x7f3490101350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:29:15.304 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:15.268+0000 7f34948e7700 1 -- 172.21.15.163:0/3064828840 shutdown_connections 2023-07-14T18:29:15.304 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:15.268+0000 7f34948e7700 1 -- 172.21.15.163:0/3064828840 wait complete. 2023-07-14T18:29:15.315 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-14T18:29:15.478 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:15.444+0000 7fda9fcf3700 1 -- 172.21.15.163:0/940201673 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fda98101790 msgr2=0x7fda98108050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:29:15.479 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:15.444+0000 7fda9fcf3700 1 --2- 172.21.15.163:0/940201673 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fda98101790 0x7fda98108050 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7fda9000b0a0 tx=0x7fda9000b3b0 comp rx=0 tx=0).stop 2023-07-14T18:29:15.479 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:15.444+0000 7fda9fcf3700 1 -- 172.21.15.163:0/940201673 shutdown_connections 2023-07-14T18:29:15.479 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:15.444+0000 7fda9fcf3700 1 --2- 172.21.15.163:0/940201673 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fda98101790 0x7fda98108050 unknown :-1 s=CLOSED pgs=762 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:29:15.479 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:15.444+0000 7fda9fcf3700 1 --2- 172.21.15.163:0/940201673 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fda980ffc10 0x7fda98100020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:29:15.480 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:15.444+0000 7fda9fcf3700 1 --2- 172.21.15.163:0/940201673 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fda98100e00 0x7fda98101250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:29:15.480 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:15.444+0000 7fda9fcf3700 1 -- 172.21.15.163:0/940201673 >> 172.21.15.163:0/940201673 conn(0x7fda980fb250 msgr2=0x7fda980fd660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:29:15.480 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:15.444+0000 7fda9fcf3700 1 -- 172.21.15.163:0/940201673 shutdown_connections 2023-07-14T18:29:15.481 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:15.444+0000 7fda9fcf3700 1 -- 172.21.15.163:0/940201673 wait complete. 2023-07-14T18:29:15.484 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:15.445+0000 7fda9fcf3700 1 Processor -- start 2023-07-14T18:29:15.485 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:15.445+0000 7fda9fcf3700 1 -- start start 2023-07-14T18:29:15.485 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:15.445+0000 7fda9fcf3700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fda980ffc10 0x7fda98195950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:29:15.486 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:15.445+0000 7fda9fcf3700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fda98100e00 0x7fda98195e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:29:15.486 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:15.445+0000 7fda9fcf3700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fda98101790 0x7fda9819cf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:29:15.487 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:15.445+0000 7fda9fcf3700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda9819d4d0 con 0x7fda98100e00 2023-07-14T18:29:15.487 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:15.445+0000 7fda9fcf3700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda9819d610 con 0x7fda980ffc10 2023-07-14T18:29:15.487 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:15.445+0000 7fda9fcf3700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda9819d7a0 con 0x7fda98101790 2023-07-14T18:29:15.488 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:15.446+0000 7fda9da8f700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fda980ffc10 0x7fda98195950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:29:15.488 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:15.446+0000 7fda9d28e700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fda98100e00 0x7fda98195e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:29:15.488 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:15.446+0000 7fda9da8f700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fda980ffc10 0x7fda98195950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.163:33194/0 (socket says 172.21.15.163:33194) 2023-07-14T18:29:15.488 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:15.446+0000 7fda9da8f700 1 -- 172.21.15.163:0/1072498548 learned_addr learned my addr 172.21.15.163:0/1072498548 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:29:15.488 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:15.446+0000 7fda9e290700 1 --2- 172.21.15.163:0/1072498548 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fda98101790 0x7fda9819cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:29:15.489 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:15.446+0000 7fda9d28e700 1 -- 172.21.15.163:0/1072498548 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fda98101790 msgr2=0x7fda9819cf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:29:15.489 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:15.446+0000 7fda9d28e700 1 --2- 172.21.15.163:0/1072498548 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fda98101790 0x7fda9819cf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:29:15.489 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:15.446+0000 7fda9d28e700 1 -- 172.21.15.163:0/1072498548 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fda980ffc10 msgr2=0x7fda98195950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:29:15.489 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:15.446+0000 7fda9d28e700 1 --2- 172.21.15.163:0/1072498548 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fda980ffc10 0x7fda98195950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:29:15.489 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:15.446+0000 7fda9d28e700 1 -- 172.21.15.163:0/1072498548 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda90009d00 con 0x7fda98100e00 2023-07-14T18:29:15.490 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:15.446+0000 7fda9e290700 1 --2- 172.21.15.163:0/1072498548 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fda98101790 0x7fda9819cf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T18:29:15.490 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:15.446+0000 7fda9da8f700 1 --2- 172.21.15.163:0/1072498548 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fda980ffc10 0x7fda98195950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T18:29:15.490 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:15.446+0000 7fda9d28e700 1 --2- 172.21.15.163:0/1072498548 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fda98100e00 0x7fda98195e90 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7fda8800e9f0 tx=0x7fda8800ed00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:29:15.490 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:15.446+0000 7fda8effd700 1 -- 172.21.15.163:0/1072498548 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda8800c9c0 con 0x7fda98100e00 2023-07-14T18:29:15.490 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:15.446+0000 7fda9fcf3700 1 -- 172.21.15.163:0/1072498548 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda9819da80 con 0x7fda98100e00 2023-07-14T18:29:15.491 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:15.446+0000 7fda8effd700 1 -- 172.21.15.163:0/1072498548 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fda88010430 con 0x7fda98100e00 2023-07-14T18:29:15.491 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:15.446+0000 7fda8effd700 1 -- 172.21.15.163:0/1072498548 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda88018680 con 0x7fda98100e00 2023-07-14T18:29:15.491 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:15.446+0000 7fda9fcf3700 1 -- 172.21.15.163:0/1072498548 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda98072b10 con 0x7fda98100e00 2023-07-14T18:29:15.491 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:15.448+0000 7fda9fcf3700 1 -- 172.21.15.163:0/1072498548 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fda981071a0 con 0x7fda98100e00 2023-07-14T18:29:15.491 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:15.448+0000 7fda8effd700 1 -- 172.21.15.163:0/1072498548 <== mon.0 v2:172.21.15.163:3300/0 4 ==== mgrmap(e 18) v1 ==== 135716+0+0 (secure 0 0 0) 0x7fda880105a0 con 0x7fda98100e00 2023-07-14T18:29:15.492 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:15.449+0000 7fda8effd700 1 --2- 172.21.15.163:0/1072498548 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7fda840a11d0 0x7fda840a3680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:29:15.492 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:15.449+0000 7fda9da8f700 1 --2- 172.21.15.163:0/1072498548 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7fda840a11d0 0x7fda840a3680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:29:15.492 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:15.449+0000 7fda8effd700 1 -- 172.21.15.163:0/1072498548 <== mon.0 v2:172.21.15.163:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 9049+0+0 (secure 0 0 0) 0x7fda88014070 con 0x7fda98100e00 2023-07-14T18:29:15.492 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:15.450+0000 7fda9da8f700 1 --2- 172.21.15.163:0/1072498548 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7fda840a11d0 0x7fda840a3680 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7fda94005950 tx=0x7fda94009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:29:15.493 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:15.454+0000 7fda8effd700 1 -- 172.21.15.163:0/1072498548 <== mon.0 v2:172.21.15.163:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178025 (secure 0 0 0) 0x7fda88051780 con 0x7fda98100e00 2023-07-14T18:29:15.725 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:15.691+0000 7fda9fcf3700 1 -- 172.21.15.163:0/1072498548 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fda9802cd40 con 0x7fda98100e00 2023-07-14T18:29:15.725 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:15.691+0000 7fda8effd700 1 -- 172.21.15.163:0/1072498548 <== mon.0 v2:172.21.15.163:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v88) v1 ==== 100+0+11 (secure 0 0 0) 0x7fda88096120 con 0x7fda98100e00 2023-07-14T18:29:15.726 INFO:teuthology.orchestra.run.smithi163.stdout:pg_num: 64 2023-07-14T18:29:15.728 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:15.694+0000 7fda9fcf3700 1 -- 172.21.15.163:0/1072498548 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7fda840a11d0 msgr2=0x7fda840a3680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:29:15.729 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:15.694+0000 7fda9fcf3700 1 --2- 172.21.15.163:0/1072498548 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7fda840a11d0 0x7fda840a3680 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7fda94005950 tx=0x7fda94009260 comp rx=0 tx=0).stop 2023-07-14T18:29:15.729 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:15.694+0000 7fda9fcf3700 1 -- 172.21.15.163:0/1072498548 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fda98100e00 msgr2=0x7fda98195e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:29:15.729 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:15.694+0000 7fda9fcf3700 1 --2- 172.21.15.163:0/1072498548 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fda98100e00 0x7fda98195e90 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7fda8800e9f0 tx=0x7fda8800ed00 comp rx=0 tx=0).stop 2023-07-14T18:29:15.729 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:15.694+0000 7fda9fcf3700 1 -- 172.21.15.163:0/1072498548 shutdown_connections 2023-07-14T18:29:15.730 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:15.694+0000 7fda9fcf3700 1 --2- 172.21.15.163:0/1072498548 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7fda840a11d0 0x7fda840a3680 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:29:15.730 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:15.695+0000 7fda9fcf3700 1 --2- 172.21.15.163:0/1072498548 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fda98101790 0x7fda9819cf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:29:15.730 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:15.695+0000 7fda9fcf3700 1 --2- 172.21.15.163:0/1072498548 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fda980ffc10 0x7fda98195950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:29:15.730 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:15.695+0000 7fda9fcf3700 1 --2- 172.21.15.163:0/1072498548 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fda98100e00 0x7fda98195e90 unknown :-1 s=CLOSED pgs=763 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:29:15.730 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:15.695+0000 7fda9fcf3700 1 -- 172.21.15.163:0/1072498548 >> 172.21.15.163:0/1072498548 conn(0x7fda980fb250 msgr2=0x7fda981042e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:29:15.731 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:15.695+0000 7fda9fcf3700 1 -- 172.21.15.163:0/1072498548 shutdown_connections 2023-07-14T18:29:15.731 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:15.695+0000 7fda9fcf3700 1 -- 172.21.15.163:0/1072498548 wait complete. 2023-07-14T18:29:15.742 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-07-14T18:29:15.892 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:15.858+0000 7ff80e6af700 1 -- 172.21.15.163:0/336221562 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff8081058e0 msgr2=0x7ff808107d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:29:15.892 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:15.858+0000 7ff80e6af700 1 --2- 172.21.15.163:0/336221562 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff8081058e0 0x7ff808107d40 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7ff80000b0a0 tx=0x7ff80000b3b0 comp rx=0 tx=0).stop 2023-07-14T18:29:15.893 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:15.858+0000 7ff80e6af700 1 -- 172.21.15.163:0/336221562 shutdown_connections 2023-07-14T18:29:15.893 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:15.858+0000 7ff80e6af700 1 --2- 172.21.15.163:0/336221562 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff8081006a0 0x7ff808102a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:29:15.893 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:15.858+0000 7ff80e6af700 1 --2- 172.21.15.163:0/336221562 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff8081058e0 0x7ff808107d40 unknown :-1 s=CLOSED pgs=764 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:29:15.893 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:15.858+0000 7ff80e6af700 1 --2- 172.21.15.163:0/336221562 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff808102fc0 0x7ff8081053a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:29:15.893 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:15.858+0000 7ff80e6af700 1 -- 172.21.15.163:0/336221562 >> 172.21.15.163:0/336221562 conn(0x7ff8080fa160 msgr2=0x7ff8080fc570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:29:15.894 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:15.858+0000 7ff80e6af700 1 -- 172.21.15.163:0/336221562 shutdown_connections 2023-07-14T18:29:15.894 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:15.858+0000 7ff80e6af700 1 -- 172.21.15.163:0/336221562 wait complete. 2023-07-14T18:29:15.894 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:15.858+0000 7ff80e6af700 1 Processor -- start 2023-07-14T18:29:15.894 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:15.858+0000 7ff80e6af700 1 -- start start 2023-07-14T18:29:15.896 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:15.859+0000 7ff80e6af700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff8081006a0 0x7ff808195920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:29:15.896 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:15.859+0000 7ff80e6af700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff808102fc0 0x7ff808195e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:29:15.897 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:15.859+0000 7ff80e6af700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff8081058e0 0x7ff80819ced0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:29:15.897 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:15.859+0000 7ff80e6af700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff80819d4a0 con 0x7ff8081058e0 2023-07-14T18:29:15.897 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:15.859+0000 7ff80e6af700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff80819d5e0 con 0x7ff8081006a0 2023-07-14T18:29:15.897 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:15.859+0000 7ff80e6af700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff80819d770 con 0x7ff808102fc0 2023-07-14T18:29:15.897 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:15.859+0000 7ff807fff700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff8081006a0 0x7ff808195920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:29:15.898 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:15.859+0000 7ff80cc4c700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff8081058e0 0x7ff80819ced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:29:15.898 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:15.859+0000 7ff80cc4c700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff8081058e0 0x7ff80819ced0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:60760/0 (socket says 172.21.15.163:60760) 2023-07-14T18:29:15.898 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:15.859+0000 7ff807fff700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff8081006a0 0x7ff808195920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.163:33208/0 (socket says 172.21.15.163:33208) 2023-07-14T18:29:15.898 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:15.859+0000 7ff80cc4c700 1 -- 172.21.15.163:0/1993556356 learned_addr learned my addr 172.21.15.163:0/1993556356 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:29:15.899 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:15.859+0000 7ff7fffff700 1 --2- 172.21.15.163:0/1993556356 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff808102fc0 0x7ff808195e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:29:15.899 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:15.859+0000 7ff807fff700 1 -- 172.21.15.163:0/1993556356 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff808102fc0 msgr2=0x7ff808195e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:29:15.899 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:15.859+0000 7ff807fff700 1 --2- 172.21.15.163:0/1993556356 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff808102fc0 0x7ff808195e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:29:15.899 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:15.859+0000 7ff807fff700 1 -- 172.21.15.163:0/1993556356 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff8081058e0 msgr2=0x7ff80819ced0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:29:15.900 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:15.859+0000 7ff807fff700 1 --2- 172.21.15.163:0/1993556356 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff8081058e0 0x7ff80819ced0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:29:15.900 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:15.859+0000 7ff807fff700 1 -- 172.21.15.163:0/1993556356 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7f8009520 con 0x7ff8081006a0 2023-07-14T18:29:15.900 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:15.859+0000 7ff807fff700 1 --2- 172.21.15.163:0/1993556356 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff8081006a0 0x7ff808195920 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7ff7f800e9f0 tx=0x7ff7f800ed00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:29:15.900 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:15.859+0000 7ff805ffb700 1 -- 172.21.15.163:0/1993556356 <== mon.2 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7f800cb70 con 0x7ff8081006a0 2023-07-14T18:29:15.900 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:15.859+0000 7ff805ffb700 1 -- 172.21.15.163:0/1993556356 <== mon.2 v2:172.21.15.172:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ff7f800ee90 con 0x7ff8081006a0 2023-07-14T18:29:15.901 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:15.859+0000 7ff80e6af700 1 -- 172.21.15.163:0/1993556356 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff7f0009520 con 0x7ff8081006a0 2023-07-14T18:29:15.901 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:15.859+0000 7ff805ffb700 1 -- 172.21.15.163:0/1993556356 <== mon.2 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7f8003bc0 con 0x7ff8081006a0 2023-07-14T18:29:15.901 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:15.860+0000 7ff80e6af700 1 -- 172.21.15.163:0/1993556356 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff800009d00 con 0x7ff8081006a0 2023-07-14T18:29:15.901 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:15.860+0000 7ff80e6af700 1 -- 172.21.15.163:0/1993556356 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff8080fbcd0 con 0x7ff8081006a0 2023-07-14T18:29:15.901 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:15.862+0000 7ff805ffb700 1 -- 172.21.15.163:0/1993556356 <== mon.2 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 18) v1 ==== 135716+0+0 (secure 0 0 0) 0x7ff7f8005030 con 0x7ff8081006a0 2023-07-14T18:29:15.902 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:15.862+0000 7ff805ffb700 1 --2- 172.21.15.163:0/1993556356 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7ff7f40a1150 0x7ff7f40a3600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:29:15.902 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:15.862+0000 7ff7fffff700 1 --2- 172.21.15.163:0/1993556356 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7ff7f40a1150 0x7ff7f40a3600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:29:15.902 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:15.863+0000 7ff805ffb700 1 -- 172.21.15.163:0/1993556356 <== mon.2 v2:172.21.15.172:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 9049+0+0 (secure 0 0 0) 0x7ff7f8014070 con 0x7ff8081006a0 2023-07-14T18:29:15.902 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:15.863+0000 7ff7fffff700 1 --2- 172.21.15.163:0/1993556356 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7ff7f40a1150 0x7ff7f40a3600 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7ff7f0009df0 tx=0x7ff7f0009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:29:15.903 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:15.866+0000 7ff805ffb700 1 -- 172.21.15.163:0/1993556356 <== mon.2 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178025 (secure 0 0 0) 0x7ff7f8096910 con 0x7ff8081006a0 2023-07-14T18:29:16.158 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:16.124+0000 7ff80e6af700 1 -- 172.21.15.163:0/1993556356 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7ff80802cb70 con 0x7ff8081006a0 2023-07-14T18:29:16.159 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:16.124+0000 7ff805ffb700 1 -- 172.21.15.163:0/1993556356 <== mon.2 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v88) v1 ==== 103+0+11 (secure 0 0 0) 0x7ff7f8099f30 con 0x7ff8081006a0 2023-07-14T18:29:16.159 INFO:teuthology.orchestra.run.smithi163.stdout:pg_num: 32 2023-07-14T18:29:16.161 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:16.127+0000 7ff80e6af700 1 -- 172.21.15.163:0/1993556356 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7ff7f40a1150 msgr2=0x7ff7f40a3600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:29:16.161 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:16.127+0000 7ff80e6af700 1 --2- 172.21.15.163:0/1993556356 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7ff7f40a1150 0x7ff7f40a3600 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7ff7f0009df0 tx=0x7ff7f0009260 comp rx=0 tx=0).stop 2023-07-14T18:29:16.162 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:16.127+0000 7ff80e6af700 1 -- 172.21.15.163:0/1993556356 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff8081006a0 msgr2=0x7ff808195920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:29:16.162 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:16.127+0000 7ff80e6af700 1 --2- 172.21.15.163:0/1993556356 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff8081006a0 0x7ff808195920 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7ff7f800e9f0 tx=0x7ff7f800ed00 comp rx=0 tx=0).stop 2023-07-14T18:29:16.162 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:16.127+0000 7ff80e6af700 1 -- 172.21.15.163:0/1993556356 shutdown_connections 2023-07-14T18:29:16.163 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:16.127+0000 7ff80e6af700 1 --2- 172.21.15.163:0/1993556356 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7ff7f40a1150 0x7ff7f40a3600 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:29:16.163 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:16.127+0000 7ff80e6af700 1 --2- 172.21.15.163:0/1993556356 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff8081058e0 0x7ff80819ced0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:29:16.163 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:16.127+0000 7ff80e6af700 1 --2- 172.21.15.163:0/1993556356 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff8081006a0 0x7ff808195920 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:29:16.164 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:16.127+0000 7ff80e6af700 1 --2- 172.21.15.163:0/1993556356 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff808102fc0 0x7ff808195e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:29:16.164 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:16.127+0000 7ff80e6af700 1 -- 172.21.15.163:0/1993556356 >> 172.21.15.163:0/1993556356 conn(0x7ff8080fa160 msgr2=0x7ff808101300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:29:16.164 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:16.127+0000 7ff80e6af700 1 -- 172.21.15.163:0/1993556356 shutdown_connections 2023-07-14T18:29:16.165 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:16.127+0000 7ff80e6af700 1 -- 172.21.15.163:0/1993556356 wait complete. 2023-07-14T18:29:16.167 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:29:15 smithi184 ceph-mon[98481]: from='client.? 172.21.15.163:0/1464003368' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-07-14T18:29:16.168 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:29:15 smithi184 ceph-mon[98481]: from='client.? 172.21.15.163:0/3064828840' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-07-14T18:29:16.168 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:29:15 smithi184 ceph-mon[98481]: from='client.? 172.21.15.163:0/1072498548' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-07-14T18:29:16.173 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:29:15 smithi163 ceph-mon[96576]: from='client.? 172.21.15.163:0/1464003368' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-07-14T18:29:16.173 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:29:15 smithi163 ceph-mon[96576]: from='client.? 172.21.15.163:0/3064828840' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-07-14T18:29:16.173 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:29:15 smithi163 ceph-mon[96576]: from='client.? 172.21.15.163:0/1072498548' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-07-14T18:29:16.174 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json-pretty 2023-07-14T18:29:16.268 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:29:15 smithi172 ceph-mon[97983]: from='client.? 172.21.15.163:0/1464003368' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-07-14T18:29:16.269 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:29:15 smithi172 ceph-mon[97983]: from='client.? 172.21.15.163:0/3064828840' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-07-14T18:29:16.269 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:29:15 smithi172 ceph-mon[97983]: from='client.? 172.21.15.163:0/1072498548' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-07-14T18:29:16.319 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:16.285+0000 7f4929504700 1 -- 172.21.15.163:0/718141191 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f49240ffcf0 msgr2=0x7f4924100140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:29:16.320 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:16.285+0000 7f4929504700 1 --2- 172.21.15.163:0/718141191 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f49240ffcf0 0x7f4924100140 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f4918009990 tx=0x7f4918009ca0 comp rx=0 tx=0).stop 2023-07-14T18:29:16.320 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:16.285+0000 7f4929504700 1 -- 172.21.15.163:0/718141191 shutdown_connections 2023-07-14T18:29:16.320 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:16.285+0000 7f4929504700 1 --2- 172.21.15.163:0/718141191 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f49240feb00 0x7f49240fef10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:29:16.321 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:16.285+0000 7f4929504700 1 --2- 172.21.15.163:0/718141191 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f4924100680 0x7f4924106f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:29:16.321 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:16.285+0000 7f4929504700 1 --2- 172.21.15.163:0/718141191 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f49240ffcf0 0x7f4924100140 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:29:16.321 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:16.285+0000 7f4929504700 1 -- 172.21.15.163:0/718141191 >> 172.21.15.163:0/718141191 conn(0x7f49240fa100 msgr2=0x7f49240fc550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:29:16.321 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:16.285+0000 7f4929504700 1 -- 172.21.15.163:0/718141191 shutdown_connections 2023-07-14T18:29:16.321 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:16.285+0000 7f4929504700 1 -- 172.21.15.163:0/718141191 wait complete. 2023-07-14T18:29:16.322 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:16.286+0000 7f4929504700 1 Processor -- start 2023-07-14T18:29:16.323 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:16.286+0000 7f4929504700 1 -- start start 2023-07-14T18:29:16.323 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:16.286+0000 7f4929504700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f49240feb00 0x7f4924197a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:29:16.324 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:16.286+0000 7f4929504700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f49240ffcf0 0x7f4924197f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:29:16.324 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:16.286+0000 7f4929504700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4924100680 0x7f492419efd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:29:16.324 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:16.286+0000 7f4929504700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f492419f5a0 con 0x7f49240feb00 2023-07-14T18:29:16.324 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:16.286+0000 7f4929504700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f492419f6e0 con 0x7f49240ffcf0 2023-07-14T18:29:16.324 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:16.286+0000 7f4929504700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f492419f870 con 0x7f4924100680 2023-07-14T18:29:16.325 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:16.286+0000 7f4922ffd700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f49240feb00 0x7f4924197a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:29:16.325 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:16.286+0000 7f49227fc700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f49240ffcf0 0x7f4924197f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:29:16.325 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:16.286+0000 7f4922ffd700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f49240feb00 0x7f4924197a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:60768/0 (socket says 172.21.15.163:60768) 2023-07-14T18:29:16.325 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:16.286+0000 7f4922ffd700 1 -- 172.21.15.163:0/3067906713 learned_addr learned my addr 172.21.15.163:0/3067906713 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:29:16.325 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:16.286+0000 7f49237fe700 1 --2- 172.21.15.163:0/3067906713 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4924100680 0x7f492419efd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:29:16.326 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:16.287+0000 7f4922ffd700 1 -- 172.21.15.163:0/3067906713 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4924100680 msgr2=0x7f492419efd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:29:16.326 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:16.287+0000 7f4922ffd700 1 --2- 172.21.15.163:0/3067906713 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4924100680 0x7f492419efd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:29:16.326 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:16.287+0000 7f4922ffd700 1 -- 172.21.15.163:0/3067906713 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f49240ffcf0 msgr2=0x7f4924197f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:29:16.326 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:16.287+0000 7f4922ffd700 1 --2- 172.21.15.163:0/3067906713 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f49240ffcf0 0x7f4924197f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:29:16.326 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:16.287+0000 7f4922ffd700 1 -- 172.21.15.163:0/3067906713 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49180095f0 con 0x7f49240feb00 2023-07-14T18:29:16.327 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:16.287+0000 7f49227fc700 1 --2- 172.21.15.163:0/3067906713 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f49240ffcf0 0x7f4924197f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T18:29:16.327 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:16.287+0000 7f4922ffd700 1 --2- 172.21.15.163:0/3067906713 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f49240feb00 0x7f4924197a20 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7f49140099f0 tx=0x7f4914009d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:29:16.327 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:16.287+0000 7f490bfff700 1 -- 172.21.15.163:0/3067906713 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4914012070 con 0x7f49240feb00 2023-07-14T18:29:16.327 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:16.287+0000 7f4929504700 1 -- 172.21.15.163:0/3067906713 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f492419fb50 con 0x7f49240feb00 2023-07-14T18:29:16.327 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:16.287+0000 7f4929504700 1 -- 172.21.15.163:0/3067906713 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f49241a00b0 con 0x7f49240feb00 2023-07-14T18:29:16.327 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:16.287+0000 7f490bfff700 1 -- 172.21.15.163:0/3067906713 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f491400cbf0 con 0x7f49240feb00 2023-07-14T18:29:16.328 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:16.287+0000 7f490bfff700 1 -- 172.21.15.163:0/3067906713 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4914016b60 con 0x7f49240feb00 2023-07-14T18:29:16.328 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:16.288+0000 7f4929504700 1 -- 172.21.15.163:0/3067906713 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4910005320 con 0x7f49240feb00 2023-07-14T18:29:16.328 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:16.289+0000 7f490bfff700 1 -- 172.21.15.163:0/3067906713 <== mon.0 v2:172.21.15.163:3300/0 4 ==== mgrmap(e 18) v1 ==== 135716+0+0 (secure 0 0 0) 0x7f491400c760 con 0x7f49240feb00 2023-07-14T18:29:16.329 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:16.290+0000 7f490bfff700 1 --2- 172.21.15.163:0/3067906713 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f490c0a11a0 0x7f490c0a3650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:29:16.329 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:16.290+0000 7f49227fc700 1 --2- 172.21.15.163:0/3067906713 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f490c0a11a0 0x7f490c0a3650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:29:16.329 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:16.290+0000 7f490bfff700 1 -- 172.21.15.163:0/3067906713 <== mon.0 v2:172.21.15.163:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 9049+0+0 (secure 0 0 0) 0x7f49140cc4e0 con 0x7f49240feb00 2023-07-14T18:29:16.329 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:16.291+0000 7f49227fc700 1 --2- 172.21.15.163:0/3067906713 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f490c0a11a0 0x7f490c0a3650 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f491800b2e0 tx=0x7f4918004500 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:29:16.330 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:16.294+0000 7f490bfff700 1 -- 172.21.15.163:0/3067906713 <== mon.0 v2:172.21.15.163:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178025 (secure 0 0 0) 0x7f4914095900 con 0x7f49240feb00 2023-07-14T18:29:16.649 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:16.615+0000 7f4929504700 1 -- 172.21.15.163:0/3067906713 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json-pretty"} v 0) v1 -- 0x7f4910005cc0 con 0x7f49240feb00 2023-07-14T18:29:16.657 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:16.624+0000 7f490bfff700 1 -- 172.21.15.163:0/3067906713 <== mon.0 v2:172.21.15.163:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json-pretty"}]=0 v18) v1 ==== 81+0+733251 (secure 0 0 0) 0x7f4914098f20 con 0x7f49240feb00 2023-07-14T18:29:16.665 INFO:teuthology.orchestra.run.smithi163.stdout: 2023-07-14T18:29:16.665 INFO:teuthology.orchestra.run.smithi163.stdout:{ 2023-07-14T18:29:16.666 INFO:teuthology.orchestra.run.smithi163.stdout: "epoch": 18, 2023-07-14T18:29:16.666 INFO:teuthology.orchestra.run.smithi163.stdout: "active_gid": 14152, 2023-07-14T18:29:16.666 INFO:teuthology.orchestra.run.smithi163.stdout: "active_name": "x", 2023-07-14T18:29:16.666 INFO:teuthology.orchestra.run.smithi163.stdout: "active_addrs": { 2023-07-14T18:29:16.666 INFO:teuthology.orchestra.run.smithi163.stdout: "addrvec": [ 2023-07-14T18:29:16.667 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-07-14T18:29:16.667 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "v2", 2023-07-14T18:29:16.667 INFO:teuthology.orchestra.run.smithi163.stdout: "addr": "172.21.15.163:6800", 2023-07-14T18:29:16.667 INFO:teuthology.orchestra.run.smithi163.stdout: "nonce": 1949590926 2023-07-14T18:29:16.667 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:16.668 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-07-14T18:29:16.668 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "v1", 2023-07-14T18:29:16.668 INFO:teuthology.orchestra.run.smithi163.stdout: "addr": "172.21.15.163:6801", 2023-07-14T18:29:16.668 INFO:teuthology.orchestra.run.smithi163.stdout: "nonce": 1949590926 2023-07-14T18:29:16.669 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-07-14T18:29:16.669 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-07-14T18:29:16.669 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:16.669 INFO:teuthology.orchestra.run.smithi163.stdout: "active_addr": "172.21.15.163:6801/1949590926", 2023-07-14T18:29:16.669 INFO:teuthology.orchestra.run.smithi163.stdout: "active_change": "2023-07-14T18:05:15.331571+0000", 2023-07-14T18:29:16.669 INFO:teuthology.orchestra.run.smithi163.stdout: "active_mgr_features": 4540138322906710015, 2023-07-14T18:29:16.670 INFO:teuthology.orchestra.run.smithi163.stdout: "available": true, 2023-07-14T18:29:16.670 INFO:teuthology.orchestra.run.smithi163.stdout: "standbys": [ 2023-07-14T18:29:16.670 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-07-14T18:29:16.670 INFO:teuthology.orchestra.run.smithi163.stdout: "gid": 24109, 2023-07-14T18:29:16.670 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "z", 2023-07-14T18:29:16.671 INFO:teuthology.orchestra.run.smithi163.stdout: "mgr_features": 4540138322906710015, 2023-07-14T18:29:16.671 INFO:teuthology.orchestra.run.smithi163.stdout: "available_modules": [ 2023-07-14T18:29:16.671 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-07-14T18:29:16.671 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "alerts", 2023-07-14T18:29:16.671 INFO:teuthology.orchestra.run.smithi163.stdout: "can_run": true, 2023-07-14T18:29:16.672 INFO:teuthology.orchestra.run.smithi163.stdout: "error_string": "", 2023-07-14T18:29:16.672 INFO:teuthology.orchestra.run.smithi163.stdout: "module_options": { 2023-07-14T18:29:16.672 INFO:teuthology.orchestra.run.smithi163.stdout: "interval": { 2023-07-14T18:29:16.672 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "interval", 2023-07-14T18:29:16.672 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "secs", 2023-07-14T18:29:16.673 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:16.673 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:16.673 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "60", 2023-07-14T18:29:16.673 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:16.673 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:16.673 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:16.674 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "How frequently to reexamine health status", 2023-07-14T18:29:16.674 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:16.675 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:16.675 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:16.676 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:16.676 INFO:teuthology.orchestra.run.smithi163.stdout: "log_level": { 2023-07-14T18:29:16.676 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "log_level", 2023-07-14T18:29:16.676 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "str", 2023-07-14T18:29:16.677 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:16.677 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:16.677 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "", 2023-07-14T18:29:16.677 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:16.677 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:16.677 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [ 2023-07-14T18:29:16.678 INFO:teuthology.orchestra.run.smithi163.stdout: "", 2023-07-14T18:29:16.678 INFO:teuthology.orchestra.run.smithi163.stdout: "critical", 2023-07-14T18:29:16.678 INFO:teuthology.orchestra.run.smithi163.stdout: "debug", 2023-07-14T18:29:16.678 INFO:teuthology.orchestra.run.smithi163.stdout: "error", 2023-07-14T18:29:16.678 INFO:teuthology.orchestra.run.smithi163.stdout: "info", 2023-07-14T18:29:16.679 INFO:teuthology.orchestra.run.smithi163.stdout: "warning" 2023-07-14T18:29:16.679 INFO:teuthology.orchestra.run.smithi163.stdout: ], 2023-07-14T18:29:16.679 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:16.679 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:16.679 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:16.680 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:16.680 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:16.680 INFO:teuthology.orchestra.run.smithi163.stdout: "log_to_cluster": { 2023-07-14T18:29:16.680 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "log_to_cluster", 2023-07-14T18:29:16.680 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "bool", 2023-07-14T18:29:16.681 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:16.681 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:16.681 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "False", 2023-07-14T18:29:16.681 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:16.681 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:16.682 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:16.682 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:16.682 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:16.682 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:16.682 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:16.682 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:16.683 INFO:teuthology.orchestra.run.smithi163.stdout: "log_to_cluster_level": { 2023-07-14T18:29:16.683 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "log_to_cluster_level", 2023-07-14T18:29:16.683 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "str", 2023-07-14T18:29:16.683 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:16.683 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:16.684 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "info", 2023-07-14T18:29:16.684 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:16.684 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:16.684 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [ 2023-07-14T18:29:16.684 INFO:teuthology.orchestra.run.smithi163.stdout: "", 2023-07-14T18:29:16.685 INFO:teuthology.orchestra.run.smithi163.stdout: "critical", 2023-07-14T18:29:16.685 INFO:teuthology.orchestra.run.smithi163.stdout: "debug", 2023-07-14T18:29:16.685 INFO:teuthology.orchestra.run.smithi163.stdout: "error", 2023-07-14T18:29:16.685 INFO:teuthology.orchestra.run.smithi163.stdout: "info", 2023-07-14T18:29:16.685 INFO:teuthology.orchestra.run.smithi163.stdout: "warning" 2023-07-14T18:29:16.686 INFO:teuthology.orchestra.run.smithi163.stdout: ], 2023-07-14T18:29:16.686 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:16.686 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:16.686 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:16.686 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:16.687 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:16.687 INFO:teuthology.orchestra.run.smithi163.stdout: "log_to_file": { 2023-07-14T18:29:16.687 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "log_to_file", 2023-07-14T18:29:16.687 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "bool", 2023-07-14T18:29:16.687 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:16.687 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:16.688 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "False", 2023-07-14T18:29:16.688 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:16.688 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:16.688 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:16.688 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:16.689 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:16.689 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:16.689 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:16.689 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:16.689 INFO:teuthology.orchestra.run.smithi163.stdout: "smtp_destination": { 2023-07-14T18:29:16.690 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "smtp_destination", 2023-07-14T18:29:16.691 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "str", 2023-07-14T18:29:16.691 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:16.692 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:16.692 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "", 2023-07-14T18:29:16.692 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:16.692 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:16.693 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:16.693 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "Email address to send alerts to", 2023-07-14T18:29:16.693 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:16.693 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:16.693 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:16.693 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:16.694 INFO:teuthology.orchestra.run.smithi163.stdout: "smtp_from_name": { 2023-07-14T18:29:16.694 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "smtp_from_name", 2023-07-14T18:29:16.694 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "str", 2023-07-14T18:29:16.694 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:16.694 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:16.695 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "Ceph", 2023-07-14T18:29:16.695 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:16.695 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:16.695 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:16.695 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "Email From: name", 2023-07-14T18:29:16.696 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:16.696 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:16.696 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:16.696 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:16.696 INFO:teuthology.orchestra.run.smithi163.stdout: "smtp_host": { 2023-07-14T18:29:16.697 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "smtp_host", 2023-07-14T18:29:16.697 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "str", 2023-07-14T18:29:16.697 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:16.697 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:16.697 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "", 2023-07-14T18:29:16.698 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:16.698 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:16.698 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:16.698 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "SMTP server", 2023-07-14T18:29:16.698 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:16.698 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:16.699 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:16.699 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:16.699 INFO:teuthology.orchestra.run.smithi163.stdout: "smtp_password": { 2023-07-14T18:29:16.699 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "smtp_password", 2023-07-14T18:29:16.699 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "str", 2023-07-14T18:29:16.700 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:16.700 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:16.700 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "", 2023-07-14T18:29:16.700 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:16.700 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:16.701 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:16.701 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "Password to authenticate with", 2023-07-14T18:29:16.701 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:16.701 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:16.701 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:16.701 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:16.702 INFO:teuthology.orchestra.run.smithi163.stdout: "smtp_port": { 2023-07-14T18:29:16.702 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "smtp_port", 2023-07-14T18:29:16.702 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "int", 2023-07-14T18:29:16.702 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:16.702 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:16.703 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "465", 2023-07-14T18:29:16.703 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:16.703 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:16.703 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:16.703 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "SMTP port", 2023-07-14T18:29:16.704 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:16.704 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:16.704 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:16.704 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:16.704 INFO:teuthology.orchestra.run.smithi163.stdout: "smtp_sender": { 2023-07-14T18:29:16.705 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "smtp_sender", 2023-07-14T18:29:16.705 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "str", 2023-07-14T18:29:16.705 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:16.705 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:16.705 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "", 2023-07-14T18:29:16.706 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:16.706 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:16.706 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:16.706 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "SMTP envelope sender", 2023-07-14T18:29:16.706 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:16.706 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:16.707 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:16.707 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:16.707 INFO:teuthology.orchestra.run.smithi163.stdout: "smtp_ssl": { 2023-07-14T18:29:16.707 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "smtp_ssl", 2023-07-14T18:29:16.708 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "bool", 2023-07-14T18:29:16.708 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:16.708 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:16.708 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "True", 2023-07-14T18:29:16.708 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:16.709 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:16.709 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:16.709 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "Use SSL to connect to SMTP server", 2023-07-14T18:29:16.709 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:16.709 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:16.710 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:16.710 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:16.710 INFO:teuthology.orchestra.run.smithi163.stdout: "smtp_user": { 2023-07-14T18:29:16.710 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "smtp_user", 2023-07-14T18:29:16.710 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "str", 2023-07-14T18:29:16.711 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:16.711 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:16.711 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "", 2023-07-14T18:29:16.711 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:16.711 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:16.711 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:16.712 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "User to authenticate as", 2023-07-14T18:29:16.712 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:16.712 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:16.712 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:16.712 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-07-14T18:29:16.713 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-07-14T18:29:16.713 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:16.713 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-07-14T18:29:16.713 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "balancer", 2023-07-14T18:29:16.713 INFO:teuthology.orchestra.run.smithi163.stdout: "can_run": true, 2023-07-14T18:29:16.714 INFO:teuthology.orchestra.run.smithi163.stdout: "error_string": "", 2023-07-14T18:29:16.714 INFO:teuthology.orchestra.run.smithi163.stdout: "module_options": { 2023-07-14T18:29:16.714 INFO:teuthology.orchestra.run.smithi163.stdout: "active": { 2023-07-14T18:29:16.714 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "active", 2023-07-14T18:29:16.714 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "bool", 2023-07-14T18:29:16.715 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:16.715 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:16.715 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "True", 2023-07-14T18:29:16.715 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:16.715 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:16.715 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:16.716 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "automatically balance PGs across cluster", 2023-07-14T18:29:16.716 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:16.716 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:16.716 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:16.716 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:16.717 INFO:teuthology.orchestra.run.smithi163.stdout: "begin_time": { 2023-07-14T18:29:16.717 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "begin_time", 2023-07-14T18:29:16.717 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "str", 2023-07-14T18:29:16.717 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:16.717 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:16.718 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "0000", 2023-07-14T18:29:16.718 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:16.718 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:16.718 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:16.718 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "beginning time of day to automatically balance", 2023-07-14T18:29:16.719 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "This is a time of day in the format HHMM.", 2023-07-14T18:29:16.719 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:16.719 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:16.719 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:16.719 INFO:teuthology.orchestra.run.smithi163.stdout: "begin_weekday": { 2023-07-14T18:29:16.719 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "begin_weekday", 2023-07-14T18:29:16.720 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "uint", 2023-07-14T18:29:16.720 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:16.720 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:16.720 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "0", 2023-07-14T18:29:16.720 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "0", 2023-07-14T18:29:16.721 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "6", 2023-07-14T18:29:16.721 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:16.721 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2023-07-14T18:29:16.721 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2023-07-14T18:29:16.721 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:16.722 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:16.722 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:16.722 INFO:teuthology.orchestra.run.smithi163.stdout: "crush_compat_max_iterations": { 2023-07-14T18:29:16.722 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "crush_compat_max_iterations", 2023-07-14T18:29:16.722 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "uint", 2023-07-14T18:29:16.723 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:16.723 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:16.723 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "25", 2023-07-14T18:29:16.723 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "1", 2023-07-14T18:29:16.723 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "250", 2023-07-14T18:29:16.723 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:16.724 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "maximum number of iterations to attempt optimization", 2023-07-14T18:29:16.724 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:16.724 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:16.724 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:16.724 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:16.725 INFO:teuthology.orchestra.run.smithi163.stdout: "crush_compat_metrics": { 2023-07-14T18:29:16.725 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "crush_compat_metrics", 2023-07-14T18:29:16.725 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "str", 2023-07-14T18:29:16.725 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:16.725 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:16.726 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "pgs,objects,bytes", 2023-07-14T18:29:16.726 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:16.726 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:16.726 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:16.726 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "metrics with which to calculate OSD utilization", 2023-07-14T18:29:16.727 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2023-07-14T18:29:16.727 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:16.727 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:16.727 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:16.727 INFO:teuthology.orchestra.run.smithi163.stdout: "crush_compat_step": { 2023-07-14T18:29:16.728 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "crush_compat_step", 2023-07-14T18:29:16.728 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "float", 2023-07-14T18:29:16.728 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:16.728 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:16.728 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "0.5", 2023-07-14T18:29:16.728 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "0.001", 2023-07-14T18:29:16.729 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "0.999", 2023-07-14T18:29:16.729 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:16.729 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "aggressiveness of optimization", 2023-07-14T18:29:16.729 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2023-07-14T18:29:16.729 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:16.730 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:16.730 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:16.730 INFO:teuthology.orchestra.run.smithi163.stdout: "end_time": { 2023-07-14T18:29:16.730 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "end_time", 2023-07-14T18:29:16.730 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "str", 2023-07-14T18:29:16.731 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:16.731 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:16.731 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "2359", 2023-07-14T18:29:16.731 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:16.731 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:16.732 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:16.732 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "ending time of day to automatically balance", 2023-07-14T18:29:16.732 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "This is a time of day in the format HHMM.", 2023-07-14T18:29:16.732 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:16.732 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:16.733 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:16.733 INFO:teuthology.orchestra.run.smithi163.stdout: "end_weekday": { 2023-07-14T18:29:16.733 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "end_weekday", 2023-07-14T18:29:16.733 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "uint", 2023-07-14T18:29:16.733 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:16.733 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:16.734 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "0", 2023-07-14T18:29:16.734 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "0", 2023-07-14T18:29:16.734 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "6", 2023-07-14T18:29:16.734 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:16.734 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2023-07-14T18:29:16.735 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2023-07-14T18:29:16.735 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:16.735 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:16.735 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:16.735 INFO:teuthology.orchestra.run.smithi163.stdout: "log_level": { 2023-07-14T18:29:16.736 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "log_level", 2023-07-14T18:29:16.736 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "str", 2023-07-14T18:29:16.736 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:16.736 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:16.736 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "", 2023-07-14T18:29:16.737 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:16.737 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:16.737 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [ 2023-07-14T18:29:16.737 INFO:teuthology.orchestra.run.smithi163.stdout: "", 2023-07-14T18:29:16.737 INFO:teuthology.orchestra.run.smithi163.stdout: "critical", 2023-07-14T18:29:16.737 INFO:teuthology.orchestra.run.smithi163.stdout: "debug", 2023-07-14T18:29:16.738 INFO:teuthology.orchestra.run.smithi163.stdout: "error", 2023-07-14T18:29:16.738 INFO:teuthology.orchestra.run.smithi163.stdout: "info", 2023-07-14T18:29:16.738 INFO:teuthology.orchestra.run.smithi163.stdout: "warning" 2023-07-14T18:29:16.738 INFO:teuthology.orchestra.run.smithi163.stdout: ], 2023-07-14T18:29:16.738 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:16.739 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:16.739 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:16.739 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:16.739 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:16.739 INFO:teuthology.orchestra.run.smithi163.stdout: "log_to_cluster": { 2023-07-14T18:29:16.740 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "log_to_cluster", 2023-07-14T18:29:16.740 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "bool", 2023-07-14T18:29:16.740 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:16.740 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:16.740 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "False", 2023-07-14T18:29:16.741 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:16.741 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:16.741 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:16.741 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:16.741 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:16.742 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:16.742 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:16.742 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:16.742 INFO:teuthology.orchestra.run.smithi163.stdout: "log_to_cluster_level": { 2023-07-14T18:29:16.742 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "log_to_cluster_level", 2023-07-14T18:29:16.743 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "str", 2023-07-14T18:29:16.743 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:16.743 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:16.743 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "info", 2023-07-14T18:29:16.743 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:16.744 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:16.744 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [ 2023-07-14T18:29:16.744 INFO:teuthology.orchestra.run.smithi163.stdout: "", 2023-07-14T18:29:16.744 INFO:teuthology.orchestra.run.smithi163.stdout: "critical", 2023-07-14T18:29:16.744 INFO:teuthology.orchestra.run.smithi163.stdout: "debug", 2023-07-14T18:29:16.745 INFO:teuthology.orchestra.run.smithi163.stdout: "error", 2023-07-14T18:29:16.745 INFO:teuthology.orchestra.run.smithi163.stdout: "info", 2023-07-14T18:29:16.745 INFO:teuthology.orchestra.run.smithi163.stdout: "warning" 2023-07-14T18:29:16.745 INFO:teuthology.orchestra.run.smithi163.stdout: ], 2023-07-14T18:29:16.745 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:16.746 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:16.746 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:16.746 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:16.746 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:16.746 INFO:teuthology.orchestra.run.smithi163.stdout: "log_to_file": { 2023-07-14T18:29:16.746 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "log_to_file", 2023-07-14T18:29:16.747 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "bool", 2023-07-14T18:29:16.747 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:16.747 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:16.747 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "False", 2023-07-14T18:29:16.747 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:16.748 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:16.748 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:16.748 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:16.748 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:16.748 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:16.749 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:16.749 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:16.749 INFO:teuthology.orchestra.run.smithi163.stdout: "min_score": { 2023-07-14T18:29:16.749 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "min_score", 2023-07-14T18:29:16.749 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "float", 2023-07-14T18:29:16.750 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:16.750 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:16.750 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "0", 2023-07-14T18:29:16.750 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:16.750 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:16.750 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:16.751 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "minimum score, below which no optimization is attempted", 2023-07-14T18:29:16.751 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:16.751 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:16.751 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:16.751 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:16.752 INFO:teuthology.orchestra.run.smithi163.stdout: "mode": { 2023-07-14T18:29:16.752 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "mode", 2023-07-14T18:29:16.752 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "str", 2023-07-14T18:29:16.752 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:16.752 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:16.753 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "upmap", 2023-07-14T18:29:16.753 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:16.753 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:16.753 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [ 2023-07-14T18:29:16.753 INFO:teuthology.orchestra.run.smithi163.stdout: "crush-compat", 2023-07-14T18:29:16.754 INFO:teuthology.orchestra.run.smithi163.stdout: "none", 2023-07-14T18:29:16.754 INFO:teuthology.orchestra.run.smithi163.stdout: "upmap" 2023-07-14T18:29:16.754 INFO:teuthology.orchestra.run.smithi163.stdout: ], 2023-07-14T18:29:16.754 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "Balancer mode", 2023-07-14T18:29:16.754 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:16.755 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:16.755 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:16.755 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:16.755 INFO:teuthology.orchestra.run.smithi163.stdout: "pool_ids": { 2023-07-14T18:29:16.755 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "pool_ids", 2023-07-14T18:29:16.755 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "str", 2023-07-14T18:29:16.756 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:16.756 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:16.756 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "", 2023-07-14T18:29:16.756 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:16.756 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:16.757 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:16.757 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "pools which the automatic balancing will be limited to", 2023-07-14T18:29:16.757 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:16.757 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:16.757 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:16.758 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:16.758 INFO:teuthology.orchestra.run.smithi163.stdout: "sleep_interval": { 2023-07-14T18:29:16.758 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "sleep_interval", 2023-07-14T18:29:16.758 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "secs", 2023-07-14T18:29:16.758 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:16.758 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:16.759 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "60", 2023-07-14T18:29:16.759 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:16.759 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:16.759 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:16.759 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "how frequently to wake up and attempt optimization", 2023-07-14T18:29:16.760 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:16.760 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:16.760 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:16.760 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:16.760 INFO:teuthology.orchestra.run.smithi163.stdout: "upmap_max_deviation": { 2023-07-14T18:29:16.761 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "upmap_max_deviation", 2023-07-14T18:29:16.761 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "int", 2023-07-14T18:29:16.761 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:16.761 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:16.761 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "5", 2023-07-14T18:29:16.762 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "1", 2023-07-14T18:29:16.762 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:16.762 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:16.762 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "deviation below which no optimization is attempted", 2023-07-14T18:29:16.762 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2023-07-14T18:29:16.762 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:16.763 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:16.763 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:16.763 INFO:teuthology.orchestra.run.smithi163.stdout: "upmap_max_optimizations": { 2023-07-14T18:29:16.763 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "upmap_max_optimizations", 2023-07-14T18:29:16.763 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "uint", 2023-07-14T18:29:16.764 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:16.764 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:16.764 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "10", 2023-07-14T18:29:16.764 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:16.764 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:16.765 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:16.765 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "maximum upmap optimizations to make per attempt", 2023-07-14T18:29:16.765 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:16.765 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:16.765 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:16.765 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-07-14T18:29:16.766 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-07-14T18:29:16.766 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:16.766 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-07-14T18:29:16.766 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "cephadm", 2023-07-14T18:29:16.766 INFO:teuthology.orchestra.run.smithi163.stdout: "can_run": true, 2023-07-14T18:29:16.767 INFO:teuthology.orchestra.run.smithi163.stdout: "error_string": "", 2023-07-14T18:29:16.767 INFO:teuthology.orchestra.run.smithi163.stdout: "module_options": { 2023-07-14T18:29:16.767 INFO:teuthology.orchestra.run.smithi163.stdout: "agent_down_multiplier": { 2023-07-14T18:29:16.767 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "agent_down_multiplier", 2023-07-14T18:29:16.767 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "float", 2023-07-14T18:29:16.768 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:16.768 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:16.768 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "3.0", 2023-07-14T18:29:16.768 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:16.768 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:16.769 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:16.769 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2023-07-14T18:29:16.769 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:16.769 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:16.769 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:16.769 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:16.770 INFO:teuthology.orchestra.run.smithi163.stdout: "agent_refresh_rate": { 2023-07-14T18:29:16.770 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "agent_refresh_rate", 2023-07-14T18:29:16.770 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "secs", 2023-07-14T18:29:16.770 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:16.770 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:16.771 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "20", 2023-07-14T18:29:16.771 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:16.771 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:16.771 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:16.771 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2023-07-14T18:29:16.772 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:16.772 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:16.772 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:16.772 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:16.772 INFO:teuthology.orchestra.run.smithi163.stdout: "agent_starting_port": { 2023-07-14T18:29:16.773 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "agent_starting_port", 2023-07-14T18:29:16.773 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "int", 2023-07-14T18:29:16.773 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:16.773 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:16.773 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "4721", 2023-07-14T18:29:16.773 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:16.774 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:16.774 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:16.774 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2023-07-14T18:29:16.774 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:16.774 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:16.775 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:16.775 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:16.775 INFO:teuthology.orchestra.run.smithi163.stdout: "alertmanager_web_password": { 2023-07-14T18:29:16.775 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "alertmanager_web_password", 2023-07-14T18:29:16.776 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "str", 2023-07-14T18:29:16.776 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:16.776 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:16.776 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "admin", 2023-07-14T18:29:16.776 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:16.777 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:16.777 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:16.777 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "Alertmanager web password", 2023-07-14T18:29:16.777 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:16.777 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:16.777 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:16.778 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:16.778 INFO:teuthology.orchestra.run.smithi163.stdout: "alertmanager_web_user": { 2023-07-14T18:29:16.778 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "alertmanager_web_user", 2023-07-14T18:29:16.778 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "str", 2023-07-14T18:29:16.778 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:16.779 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:16.779 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "admin", 2023-07-14T18:29:16.779 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:16.779 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:16.779 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:16.780 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "Alertmanager web user", 2023-07-14T18:29:16.780 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:16.780 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:16.780 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:16.780 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:16.781 INFO:teuthology.orchestra.run.smithi163.stdout: "allow_ptrace": { 2023-07-14T18:29:16.781 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "allow_ptrace", 2023-07-14T18:29:16.781 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "bool", 2023-07-14T18:29:16.781 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:16.781 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:16.781 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "False", 2023-07-14T18:29:16.782 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:16.782 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:16.782 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:16.782 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2023-07-14T18:29:16.782 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2023-07-14T18:29:16.783 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:16.783 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:16.783 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:16.783 INFO:teuthology.orchestra.run.smithi163.stdout: "autotune_interval": { 2023-07-14T18:29:16.783 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "autotune_interval", 2023-07-14T18:29:16.784 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "secs", 2023-07-14T18:29:16.784 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:16.784 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:16.784 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "600", 2023-07-14T18:29:16.784 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:16.785 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:16.785 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:16.785 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "how frequently to autotune daemon memory", 2023-07-14T18:29:16.785 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:16.785 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:16.785 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:16.786 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:16.786 INFO:teuthology.orchestra.run.smithi163.stdout: "autotune_memory_target_ratio": { 2023-07-14T18:29:16.786 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "autotune_memory_target_ratio", 2023-07-14T18:29:16.786 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "float", 2023-07-14T18:29:16.786 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:16.787 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:16.787 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "0.7", 2023-07-14T18:29:16.787 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:16.787 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:16.787 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:16.788 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2023-07-14T18:29:16.788 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:16.788 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:16.788 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:16.788 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:16.789 INFO:teuthology.orchestra.run.smithi163.stdout: "cgroups_split": { 2023-07-14T18:29:16.789 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "cgroups_split", 2023-07-14T18:29:16.789 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "bool", 2023-07-14T18:29:16.789 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:16.789 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:16.789 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "True", 2023-07-14T18:29:16.790 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:16.790 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:16.790 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:16.790 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2023-07-14T18:29:16.790 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:16.791 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:16.791 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:16.791 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:16.791 INFO:teuthology.orchestra.run.smithi163.stdout: "config_checks_enabled": { 2023-07-14T18:29:16.791 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "config_checks_enabled", 2023-07-14T18:29:16.792 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "bool", 2023-07-14T18:29:16.792 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:16.792 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:16.792 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "False", 2023-07-14T18:29:16.792 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:16.793 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:16.793 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:16.793 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2023-07-14T18:29:16.793 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:16.793 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:16.794 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:16.794 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:16.794 INFO:teuthology.orchestra.run.smithi163.stdout: "config_dashboard": { 2023-07-14T18:29:16.794 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "config_dashboard", 2023-07-14T18:29:16.794 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "bool", 2023-07-14T18:29:16.794 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:16.795 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:16.795 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "True", 2023-07-14T18:29:16.795 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:16.795 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:16.795 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:16.796 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2023-07-14T18:29:16.796 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:16.796 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:16.796 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:16.796 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:16.797 INFO:teuthology.orchestra.run.smithi163.stdout: "container_image_alertmanager": { 2023-07-14T18:29:16.797 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "container_image_alertmanager", 2023-07-14T18:29:16.797 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "str", 2023-07-14T18:29:16.797 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:16.797 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:16.798 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.25.0", 2023-07-14T18:29:16.798 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:16.798 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:16.798 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:16.798 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "Prometheus container image", 2023-07-14T18:29:16.799 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:16.799 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:16.799 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:16.799 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:16.799 INFO:teuthology.orchestra.run.smithi163.stdout: "container_image_base": { 2023-07-14T18:29:16.799 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "container_image_base", 2023-07-14T18:29:16.800 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "str", 2023-07-14T18:29:16.800 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:16.800 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:16.800 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "quay.io/ceph/ceph", 2023-07-14T18:29:16.800 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:16.801 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:16.801 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:16.801 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "Container image name, without the tag", 2023-07-14T18:29:16.801 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:16.801 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:16.802 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:16.802 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:16.802 INFO:teuthology.orchestra.run.smithi163.stdout: "container_image_elasticsearch": { 2023-07-14T18:29:16.802 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "container_image_elasticsearch", 2023-07-14T18:29:16.802 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "str", 2023-07-14T18:29:16.803 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:16.803 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:16.803 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2023-07-14T18:29:16.803 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:16.803 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:16.803 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:16.804 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "elasticsearch container image", 2023-07-14T18:29:16.804 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:16.804 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:16.804 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:16.804 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:16.805 INFO:teuthology.orchestra.run.smithi163.stdout: "container_image_grafana": { 2023-07-14T18:29:16.805 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "container_image_grafana", 2023-07-14T18:29:16.805 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "str", 2023-07-14T18:29:16.805 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:16.805 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:16.806 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "quay.io/ceph/ceph-grafana:9.4.7", 2023-07-14T18:29:16.806 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:16.806 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:16.806 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:16.806 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "Prometheus container image", 2023-07-14T18:29:16.807 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:16.807 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:16.807 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:16.807 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:16.807 INFO:teuthology.orchestra.run.smithi163.stdout: "container_image_haproxy": { 2023-07-14T18:29:16.808 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "container_image_haproxy", 2023-07-14T18:29:16.808 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "str", 2023-07-14T18:29:16.808 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:16.808 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:16.808 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2023-07-14T18:29:16.809 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:16.809 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:16.809 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:16.809 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "HAproxy container image", 2023-07-14T18:29:16.809 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:16.810 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:16.810 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:16.810 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:16.810 INFO:teuthology.orchestra.run.smithi163.stdout: "container_image_jaeger_agent": { 2023-07-14T18:29:16.810 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "container_image_jaeger_agent", 2023-07-14T18:29:16.811 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "str", 2023-07-14T18:29:16.811 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:16.811 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:16.811 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2023-07-14T18:29:16.811 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:16.812 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:16.812 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:16.812 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "Jaeger agent container image", 2023-07-14T18:29:16.812 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:16.812 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:16.813 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:16.813 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:16.813 INFO:teuthology.orchestra.run.smithi163.stdout: "container_image_jaeger_collector": { 2023-07-14T18:29:16.813 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "container_image_jaeger_collector", 2023-07-14T18:29:16.813 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "str", 2023-07-14T18:29:16.813 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:16.814 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:16.814 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2023-07-14T18:29:16.814 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:16.814 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:16.814 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:16.815 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "Jaeger collector container image", 2023-07-14T18:29:16.815 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:16.815 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:16.815 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:16.815 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:16.816 INFO:teuthology.orchestra.run.smithi163.stdout: "container_image_jaeger_query": { 2023-07-14T18:29:16.816 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "container_image_jaeger_query", 2023-07-14T18:29:16.816 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "str", 2023-07-14T18:29:16.816 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:16.816 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:16.817 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2023-07-14T18:29:16.817 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:16.817 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:16.817 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:16.817 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "Jaeger query container image", 2023-07-14T18:29:16.817 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:16.818 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:16.818 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:16.818 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:16.818 INFO:teuthology.orchestra.run.smithi163.stdout: "container_image_keepalived": { 2023-07-14T18:29:16.818 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "container_image_keepalived", 2023-07-14T18:29:16.819 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "str", 2023-07-14T18:29:16.819 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:16.819 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:16.819 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2023-07-14T18:29:16.819 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:16.820 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:16.820 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:16.820 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "Keepalived container image", 2023-07-14T18:29:16.820 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:16.820 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:16.821 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:16.821 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:16.821 INFO:teuthology.orchestra.run.smithi163.stdout: "container_image_loki": { 2023-07-14T18:29:16.821 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "container_image_loki", 2023-07-14T18:29:16.821 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "str", 2023-07-14T18:29:16.821 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:16.822 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:16.822 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "docker.io/grafana/loki:2.4.0", 2023-07-14T18:29:16.822 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:16.822 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:16.822 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:16.823 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "Loki container image", 2023-07-14T18:29:16.823 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:16.823 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:16.823 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:16.823 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:16.824 INFO:teuthology.orchestra.run.smithi163.stdout: "container_image_node_exporter": { 2023-07-14T18:29:16.824 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "container_image_node_exporter", 2023-07-14T18:29:16.824 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "str", 2023-07-14T18:29:16.824 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:16.824 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:16.825 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.5.0", 2023-07-14T18:29:16.825 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:16.825 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:16.825 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:16.825 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "Prometheus container image", 2023-07-14T18:29:16.826 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:16.826 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:16.826 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:16.826 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:16.826 INFO:teuthology.orchestra.run.smithi163.stdout: "container_image_prometheus": { 2023-07-14T18:29:16.826 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "container_image_prometheus", 2023-07-14T18:29:16.827 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "str", 2023-07-14T18:29:16.827 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:16.827 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:16.827 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "quay.io/prometheus/prometheus:v2.43.0", 2023-07-14T18:29:16.827 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:16.828 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:16.828 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:16.828 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "Prometheus container image", 2023-07-14T18:29:16.828 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:16.828 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:16.829 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:16.829 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:16.829 INFO:teuthology.orchestra.run.smithi163.stdout: "container_image_promtail": { 2023-07-14T18:29:16.829 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "container_image_promtail", 2023-07-14T18:29:16.829 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "str", 2023-07-14T18:29:16.830 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:16.830 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:16.830 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "docker.io/grafana/promtail:2.4.0", 2023-07-14T18:29:16.830 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:16.830 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:16.830 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:16.831 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "Promtail container image", 2023-07-14T18:29:16.831 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:16.831 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:16.831 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:16.831 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:16.832 INFO:teuthology.orchestra.run.smithi163.stdout: "container_image_snmp_gateway": { 2023-07-14T18:29:16.832 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "container_image_snmp_gateway", 2023-07-14T18:29:16.832 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "str", 2023-07-14T18:29:16.832 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:16.832 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:16.833 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2023-07-14T18:29:16.833 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:16.833 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:16.833 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:16.833 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "SNMP Gateway container image", 2023-07-14T18:29:16.834 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:16.834 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:16.834 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:16.834 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:16.834 INFO:teuthology.orchestra.run.smithi163.stdout: "container_init": { 2023-07-14T18:29:16.835 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "container_init", 2023-07-14T18:29:16.835 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "bool", 2023-07-14T18:29:16.835 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:16.835 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:16.835 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "True", 2023-07-14T18:29:16.835 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:16.836 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:16.836 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:16.836 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "Run podman/docker with `--init`", 2023-07-14T18:29:16.836 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:16.836 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:16.837 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:16.837 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:16.837 INFO:teuthology.orchestra.run.smithi163.stdout: "daemon_cache_timeout": { 2023-07-14T18:29:16.837 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "daemon_cache_timeout", 2023-07-14T18:29:16.837 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "secs", 2023-07-14T18:29:16.838 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:16.838 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:16.838 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "600", 2023-07-14T18:29:16.838 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:16.838 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:16.839 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:16.839 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "seconds to cache service (daemon) inventory", 2023-07-14T18:29:16.839 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:16.839 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:16.839 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:16.839 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:16.840 INFO:teuthology.orchestra.run.smithi163.stdout: "default_cephadm_command_timeout": { 2023-07-14T18:29:16.840 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "default_cephadm_command_timeout", 2023-07-14T18:29:16.840 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "secs", 2023-07-14T18:29:16.840 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:16.841 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:16.841 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "900", 2023-07-14T18:29:16.841 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:16.841 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:16.841 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:16.842 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2023-07-14T18:29:16.842 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:16.842 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:16.842 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:16.842 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:16.842 INFO:teuthology.orchestra.run.smithi163.stdout: "default_registry": { 2023-07-14T18:29:16.843 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "default_registry", 2023-07-14T18:29:16.843 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "str", 2023-07-14T18:29:16.843 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:16.843 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:16.843 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "docker.io", 2023-07-14T18:29:16.844 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:16.844 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:16.844 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:16.844 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2023-07-14T18:29:16.844 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:16.845 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:16.845 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:16.845 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:16.846 INFO:teuthology.orchestra.run.smithi163.stdout: "device_cache_timeout": { 2023-07-14T18:29:16.846 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "device_cache_timeout", 2023-07-14T18:29:16.846 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "secs", 2023-07-14T18:29:16.846 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:16.847 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:16.847 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "1800", 2023-07-14T18:29:16.847 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:16.847 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:16.847 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:16.848 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "seconds to cache device inventory", 2023-07-14T18:29:16.848 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:16.848 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:16.848 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:16.848 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:16.849 INFO:teuthology.orchestra.run.smithi163.stdout: "device_enhanced_scan": { 2023-07-14T18:29:16.849 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "device_enhanced_scan", 2023-07-14T18:29:16.849 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "bool", 2023-07-14T18:29:16.849 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:16.849 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:16.850 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "False", 2023-07-14T18:29:16.850 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:16.850 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:16.850 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:16.850 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "Use libstoragemgmt during device scans", 2023-07-14T18:29:16.850 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:16.851 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:16.851 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:16.851 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:16.851 INFO:teuthology.orchestra.run.smithi163.stdout: "facts_cache_timeout": { 2023-07-14T18:29:16.851 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "facts_cache_timeout", 2023-07-14T18:29:16.852 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "secs", 2023-07-14T18:29:16.852 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:16.852 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:16.852 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "60", 2023-07-14T18:29:16.853 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:16.853 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:16.853 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:16.853 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "seconds to cache host facts data", 2023-07-14T18:29:16.853 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:16.853 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:16.854 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:16.854 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:16.854 INFO:teuthology.orchestra.run.smithi163.stdout: "host_check_interval": { 2023-07-14T18:29:16.854 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "host_check_interval", 2023-07-14T18:29:16.854 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "secs", 2023-07-14T18:29:16.855 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:16.855 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:16.855 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "600", 2023-07-14T18:29:16.855 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:16.855 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:16.856 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:16.856 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "how frequently to perform a host check", 2023-07-14T18:29:16.856 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:16.856 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:16.856 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:16.857 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:16.857 INFO:teuthology.orchestra.run.smithi163.stdout: "log_level": { 2023-07-14T18:29:16.857 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "log_level", 2023-07-14T18:29:16.857 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "str", 2023-07-14T18:29:16.857 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:16.858 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:16.858 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "", 2023-07-14T18:29:16.858 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:16.858 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:16.858 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [ 2023-07-14T18:29:16.859 INFO:teuthology.orchestra.run.smithi163.stdout: "", 2023-07-14T18:29:16.859 INFO:teuthology.orchestra.run.smithi163.stdout: "critical", 2023-07-14T18:29:16.859 INFO:teuthology.orchestra.run.smithi163.stdout: "debug", 2023-07-14T18:29:16.859 INFO:teuthology.orchestra.run.smithi163.stdout: "error", 2023-07-14T18:29:16.859 INFO:teuthology.orchestra.run.smithi163.stdout: "info", 2023-07-14T18:29:16.860 INFO:teuthology.orchestra.run.smithi163.stdout: "warning" 2023-07-14T18:29:16.860 INFO:teuthology.orchestra.run.smithi163.stdout: ], 2023-07-14T18:29:16.860 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:16.860 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:16.860 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:16.861 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:16.861 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:16.861 INFO:teuthology.orchestra.run.smithi163.stdout: "log_refresh_metadata": { 2023-07-14T18:29:16.861 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "log_refresh_metadata", 2023-07-14T18:29:16.861 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "bool", 2023-07-14T18:29:16.862 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:16.862 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:16.862 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "False", 2023-07-14T18:29:16.862 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:16.862 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:16.862 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:16.863 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2023-07-14T18:29:16.863 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:16.863 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:16.863 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:16.863 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:16.864 INFO:teuthology.orchestra.run.smithi163.stdout: "log_to_cluster": { 2023-07-14T18:29:16.864 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "log_to_cluster", 2023-07-14T18:29:16.864 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "bool", 2023-07-14T18:29:16.864 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:16.864 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:16.865 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "True", 2023-07-14T18:29:16.865 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:16.865 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:16.865 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:16.865 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2023-07-14T18:29:16.866 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:16.866 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:16.866 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:16.866 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:16.866 INFO:teuthology.orchestra.run.smithi163.stdout: "log_to_cluster_level": { 2023-07-14T18:29:16.867 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "log_to_cluster_level", 2023-07-14T18:29:16.867 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "str", 2023-07-14T18:29:16.867 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:16.867 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:16.867 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "info", 2023-07-14T18:29:16.867 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:16.868 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:16.868 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [ 2023-07-14T18:29:16.868 INFO:teuthology.orchestra.run.smithi163.stdout: "", 2023-07-14T18:29:16.868 INFO:teuthology.orchestra.run.smithi163.stdout: "critical", 2023-07-14T18:29:16.868 INFO:teuthology.orchestra.run.smithi163.stdout: "debug", 2023-07-14T18:29:16.869 INFO:teuthology.orchestra.run.smithi163.stdout: "error", 2023-07-14T18:29:16.869 INFO:teuthology.orchestra.run.smithi163.stdout: "info", 2023-07-14T18:29:16.869 INFO:teuthology.orchestra.run.smithi163.stdout: "warning" 2023-07-14T18:29:16.869 INFO:teuthology.orchestra.run.smithi163.stdout: ], 2023-07-14T18:29:16.869 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:16.870 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:16.870 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:16.870 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:16.870 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:16.870 INFO:teuthology.orchestra.run.smithi163.stdout: "log_to_file": { 2023-07-14T18:29:16.871 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "log_to_file", 2023-07-14T18:29:16.871 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "bool", 2023-07-14T18:29:16.871 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:16.871 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:16.871 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "False", 2023-07-14T18:29:16.872 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:16.872 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:16.872 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:16.872 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:16.872 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:16.873 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:16.873 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:16.873 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:16.873 INFO:teuthology.orchestra.run.smithi163.stdout: "manage_etc_ceph_ceph_conf": { 2023-07-14T18:29:16.873 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "manage_etc_ceph_ceph_conf", 2023-07-14T18:29:16.873 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "bool", 2023-07-14T18:29:16.874 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:16.874 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:16.874 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "False", 2023-07-14T18:29:16.874 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:16.874 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:16.875 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:16.875 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2023-07-14T18:29:16.875 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:16.875 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:16.876 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:16.876 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:16.876 INFO:teuthology.orchestra.run.smithi163.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2023-07-14T18:29:16.876 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2023-07-14T18:29:16.876 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "str", 2023-07-14T18:29:16.877 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:16.877 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:16.877 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "*", 2023-07-14T18:29:16.877 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:16.877 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:16.878 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:16.878 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2023-07-14T18:29:16.878 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:16.878 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:16.878 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:16.879 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:16.879 INFO:teuthology.orchestra.run.smithi163.stdout: "max_count_per_host": { 2023-07-14T18:29:16.879 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "max_count_per_host", 2023-07-14T18:29:16.879 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "int", 2023-07-14T18:29:16.879 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:16.880 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:16.880 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "10", 2023-07-14T18:29:16.880 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:16.880 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:16.880 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:16.880 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "max number of daemons per service per host", 2023-07-14T18:29:16.881 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:16.881 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:16.881 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:16.881 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:16.881 INFO:teuthology.orchestra.run.smithi163.stdout: "max_osd_draining_count": { 2023-07-14T18:29:16.882 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "max_osd_draining_count", 2023-07-14T18:29:16.882 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "int", 2023-07-14T18:29:16.882 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:16.882 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:16.882 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "10", 2023-07-14T18:29:16.883 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:16.883 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:16.883 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:16.883 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2023-07-14T18:29:16.883 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:16.884 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:16.884 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:16.884 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:16.884 INFO:teuthology.orchestra.run.smithi163.stdout: "migration_current": { 2023-07-14T18:29:16.884 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "migration_current", 2023-07-14T18:29:16.885 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "int", 2023-07-14T18:29:16.885 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:16.885 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:16.885 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "", 2023-07-14T18:29:16.885 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:16.885 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:16.886 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:16.886 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "internal - do not modify", 2023-07-14T18:29:16.886 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:16.886 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:16.886 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:16.887 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:16.887 INFO:teuthology.orchestra.run.smithi163.stdout: "mode": { 2023-07-14T18:29:16.887 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "mode", 2023-07-14T18:29:16.887 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "str", 2023-07-14T18:29:16.887 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:16.888 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:16.888 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "root", 2023-07-14T18:29:16.888 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:16.888 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:16.888 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [ 2023-07-14T18:29:16.889 INFO:teuthology.orchestra.run.smithi163.stdout: "cephadm-package", 2023-07-14T18:29:16.889 INFO:teuthology.orchestra.run.smithi163.stdout: "root" 2023-07-14T18:29:16.889 INFO:teuthology.orchestra.run.smithi163.stdout: ], 2023-07-14T18:29:16.889 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "mode for remote execution of cephadm", 2023-07-14T18:29:16.889 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:16.889 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:16.890 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:16.890 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:16.890 INFO:teuthology.orchestra.run.smithi163.stdout: "prometheus_alerts_path": { 2023-07-14T18:29:16.890 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "prometheus_alerts_path", 2023-07-14T18:29:16.890 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "str", 2023-07-14T18:29:16.891 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:16.891 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:16.891 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2023-07-14T18:29:16.891 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:16.891 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:16.892 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:16.892 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "location of alerts to include in prometheus deployments", 2023-07-14T18:29:16.892 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:16.892 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:16.892 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:16.893 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:16.893 INFO:teuthology.orchestra.run.smithi163.stdout: "prometheus_web_password": { 2023-07-14T18:29:16.893 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "prometheus_web_password", 2023-07-14T18:29:16.893 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "str", 2023-07-14T18:29:16.893 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:16.893 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:16.894 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "admin", 2023-07-14T18:29:16.894 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:16.894 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:16.894 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:16.894 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "Prometheus web password", 2023-07-14T18:29:16.895 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:16.895 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:16.895 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:16.895 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:16.895 INFO:teuthology.orchestra.run.smithi163.stdout: "prometheus_web_user": { 2023-07-14T18:29:16.896 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "prometheus_web_user", 2023-07-14T18:29:16.896 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "str", 2023-07-14T18:29:16.896 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:16.896 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:16.896 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "admin", 2023-07-14T18:29:16.897 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:16.897 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:16.897 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:16.897 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "Prometheus web user", 2023-07-14T18:29:16.897 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:16.897 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:16.898 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:16.898 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:16.898 INFO:teuthology.orchestra.run.smithi163.stdout: "registry_insecure": { 2023-07-14T18:29:16.898 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "registry_insecure", 2023-07-14T18:29:16.898 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "bool", 2023-07-14T18:29:16.899 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:16.899 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:16.899 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "False", 2023-07-14T18:29:16.899 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:16.899 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:16.900 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:16.900 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2023-07-14T18:29:16.900 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:16.900 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:16.900 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:16.901 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:16.901 INFO:teuthology.orchestra.run.smithi163.stdout: "registry_password": { 2023-07-14T18:29:16.901 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "registry_password", 2023-07-14T18:29:16.901 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "str", 2023-07-14T18:29:16.901 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:16.901 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:16.902 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "", 2023-07-14T18:29:16.902 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:16.902 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:16.902 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:16.902 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2023-07-14T18:29:16.903 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:16.903 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:16.903 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:16.903 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:16.903 INFO:teuthology.orchestra.run.smithi163.stdout: "registry_url": { 2023-07-14T18:29:16.904 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "registry_url", 2023-07-14T18:29:16.904 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "str", 2023-07-14T18:29:16.904 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:16.904 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:16.904 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "", 2023-07-14T18:29:16.905 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:16.905 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:16.905 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:16.905 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2023-07-14T18:29:16.905 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:16.906 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:16.906 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:16.906 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:16.906 INFO:teuthology.orchestra.run.smithi163.stdout: "registry_username": { 2023-07-14T18:29:16.906 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "registry_username", 2023-07-14T18:29:16.906 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "str", 2023-07-14T18:29:16.907 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:16.907 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:16.907 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "", 2023-07-14T18:29:16.907 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:16.907 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:16.908 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:16.908 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2023-07-14T18:29:16.908 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:16.908 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:16.909 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:16.909 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:16.909 INFO:teuthology.orchestra.run.smithi163.stdout: "secure_monitoring_stack": { 2023-07-14T18:29:16.909 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "secure_monitoring_stack", 2023-07-14T18:29:16.909 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "bool", 2023-07-14T18:29:16.910 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:16.910 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:16.910 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "False", 2023-07-14T18:29:16.910 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:16.910 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:16.910 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:16.911 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2023-07-14T18:29:16.911 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:16.911 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:16.911 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:16.911 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:16.912 INFO:teuthology.orchestra.run.smithi163.stdout: "service_discovery_port": { 2023-07-14T18:29:16.912 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "service_discovery_port", 2023-07-14T18:29:16.912 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "int", 2023-07-14T18:29:16.912 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:16.912 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:16.913 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "8765", 2023-07-14T18:29:16.913 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:16.913 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:16.913 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:16.913 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "cephadm service discovery port", 2023-07-14T18:29:16.914 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:16.914 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:16.914 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:16.914 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:16.914 INFO:teuthology.orchestra.run.smithi163.stdout: "ssh_config_file": { 2023-07-14T18:29:16.915 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "ssh_config_file", 2023-07-14T18:29:16.915 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "str", 2023-07-14T18:29:16.915 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:16.915 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:16.915 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "", 2023-07-14T18:29:16.916 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:16.916 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:16.916 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:16.916 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "customized SSH config file to connect to managed hosts", 2023-07-14T18:29:16.916 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:16.916 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:16.917 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:16.917 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:16.917 INFO:teuthology.orchestra.run.smithi163.stdout: "use_agent": { 2023-07-14T18:29:16.917 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "use_agent", 2023-07-14T18:29:16.917 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "bool", 2023-07-14T18:29:16.918 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:16.918 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:16.918 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "False", 2023-07-14T18:29:16.918 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:16.918 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:16.919 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:16.919 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2023-07-14T18:29:16.919 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:16.919 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:16.919 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:16.920 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:16.920 INFO:teuthology.orchestra.run.smithi163.stdout: "use_repo_digest": { 2023-07-14T18:29:16.920 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "use_repo_digest", 2023-07-14T18:29:16.920 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "bool", 2023-07-14T18:29:16.920 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:16.921 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:16.921 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "True", 2023-07-14T18:29:16.921 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:16.921 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:16.921 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:16.921 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2023-07-14T18:29:16.922 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:16.922 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:16.922 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:16.922 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:16.922 INFO:teuthology.orchestra.run.smithi163.stdout: "warn_on_failed_host_check": { 2023-07-14T18:29:16.923 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "warn_on_failed_host_check", 2023-07-14T18:29:16.923 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "bool", 2023-07-14T18:29:16.923 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:16.923 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:16.923 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "True", 2023-07-14T18:29:16.924 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:16.924 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:16.924 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:16.924 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "raise a health warning if the host check fails", 2023-07-14T18:29:16.924 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:16.925 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:16.925 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:16.925 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:16.925 INFO:teuthology.orchestra.run.smithi163.stdout: "warn_on_stray_daemons": { 2023-07-14T18:29:16.925 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "warn_on_stray_daemons", 2023-07-14T18:29:16.925 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "bool", 2023-07-14T18:29:16.926 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:16.926 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:16.926 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "True", 2023-07-14T18:29:16.926 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:16.927 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:16.927 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:16.927 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2023-07-14T18:29:16.927 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:16.927 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:16.928 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:16.928 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:16.928 INFO:teuthology.orchestra.run.smithi163.stdout: "warn_on_stray_hosts": { 2023-07-14T18:29:16.928 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "warn_on_stray_hosts", 2023-07-14T18:29:16.928 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "bool", 2023-07-14T18:29:16.929 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:16.929 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:16.929 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "True", 2023-07-14T18:29:16.929 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:16.929 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:16.930 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:16.930 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2023-07-14T18:29:16.930 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:16.930 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:16.930 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:16.931 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-07-14T18:29:16.931 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-07-14T18:29:16.931 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:16.931 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-07-14T18:29:16.931 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "crash", 2023-07-14T18:29:16.931 INFO:teuthology.orchestra.run.smithi163.stdout: "can_run": true, 2023-07-14T18:29:16.932 INFO:teuthology.orchestra.run.smithi163.stdout: "error_string": "", 2023-07-14T18:29:16.932 INFO:teuthology.orchestra.run.smithi163.stdout: "module_options": { 2023-07-14T18:29:16.932 INFO:teuthology.orchestra.run.smithi163.stdout: "log_level": { 2023-07-14T18:29:16.932 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "log_level", 2023-07-14T18:29:16.932 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "str", 2023-07-14T18:29:16.933 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:16.933 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:16.933 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "", 2023-07-14T18:29:16.933 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:16.933 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:16.934 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [ 2023-07-14T18:29:16.934 INFO:teuthology.orchestra.run.smithi163.stdout: "", 2023-07-14T18:29:16.934 INFO:teuthology.orchestra.run.smithi163.stdout: "critical", 2023-07-14T18:29:16.934 INFO:teuthology.orchestra.run.smithi163.stdout: "debug", 2023-07-14T18:29:16.934 INFO:teuthology.orchestra.run.smithi163.stdout: "error", 2023-07-14T18:29:16.935 INFO:teuthology.orchestra.run.smithi163.stdout: "info", 2023-07-14T18:29:16.935 INFO:teuthology.orchestra.run.smithi163.stdout: "warning" 2023-07-14T18:29:16.935 INFO:teuthology.orchestra.run.smithi163.stdout: ], 2023-07-14T18:29:16.935 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:16.935 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:16.935 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:16.936 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:16.936 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:16.936 INFO:teuthology.orchestra.run.smithi163.stdout: "log_to_cluster": { 2023-07-14T18:29:16.936 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "log_to_cluster", 2023-07-14T18:29:16.936 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "bool", 2023-07-14T18:29:16.937 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:16.937 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:16.937 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "False", 2023-07-14T18:29:16.937 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:16.937 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:16.938 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:16.938 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:16.938 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:16.938 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:16.938 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:16.939 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:16.939 INFO:teuthology.orchestra.run.smithi163.stdout: "log_to_cluster_level": { 2023-07-14T18:29:16.939 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "log_to_cluster_level", 2023-07-14T18:29:16.939 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "str", 2023-07-14T18:29:16.939 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:16.940 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:16.940 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "info", 2023-07-14T18:29:16.940 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:16.940 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:16.940 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [ 2023-07-14T18:29:16.940 INFO:teuthology.orchestra.run.smithi163.stdout: "", 2023-07-14T18:29:16.941 INFO:teuthology.orchestra.run.smithi163.stdout: "critical", 2023-07-14T18:29:16.941 INFO:teuthology.orchestra.run.smithi163.stdout: "debug", 2023-07-14T18:29:16.941 INFO:teuthology.orchestra.run.smithi163.stdout: "error", 2023-07-14T18:29:16.941 INFO:teuthology.orchestra.run.smithi163.stdout: "info", 2023-07-14T18:29:16.941 INFO:teuthology.orchestra.run.smithi163.stdout: "warning" 2023-07-14T18:29:16.942 INFO:teuthology.orchestra.run.smithi163.stdout: ], 2023-07-14T18:29:16.942 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:16.942 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:16.942 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:16.942 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:16.943 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:16.943 INFO:teuthology.orchestra.run.smithi163.stdout: "log_to_file": { 2023-07-14T18:29:16.943 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "log_to_file", 2023-07-14T18:29:16.943 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "bool", 2023-07-14T18:29:16.943 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:16.944 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:16.944 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "False", 2023-07-14T18:29:16.944 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:16.944 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:16.944 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:16.945 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:16.945 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:16.945 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:16.945 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:16.945 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:16.946 INFO:teuthology.orchestra.run.smithi163.stdout: "retain_interval": { 2023-07-14T18:29:16.946 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "retain_interval", 2023-07-14T18:29:16.946 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "secs", 2023-07-14T18:29:16.946 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:16.946 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:16.947 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "31536000", 2023-07-14T18:29:16.947 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:16.947 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:16.947 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:16.947 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "how long to retain crashes before pruning them", 2023-07-14T18:29:16.948 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:16.948 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:16.948 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:16.948 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:16.948 INFO:teuthology.orchestra.run.smithi163.stdout: "warn_recent_interval": { 2023-07-14T18:29:16.949 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "warn_recent_interval", 2023-07-14T18:29:16.949 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "secs", 2023-07-14T18:29:16.949 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:16.949 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:16.949 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "1209600", 2023-07-14T18:29:16.950 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:16.950 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:16.950 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:16.950 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "time interval in which to warn about recent crashes", 2023-07-14T18:29:16.950 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:16.950 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:16.951 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:16.951 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-07-14T18:29:16.951 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-07-14T18:29:16.951 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:16.951 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-07-14T18:29:16.952 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "dashboard", 2023-07-14T18:29:16.952 INFO:teuthology.orchestra.run.smithi163.stdout: "can_run": true, 2023-07-14T18:29:16.952 INFO:teuthology.orchestra.run.smithi163.stdout: "error_string": "", 2023-07-14T18:29:16.952 INFO:teuthology.orchestra.run.smithi163.stdout: "module_options": { 2023-07-14T18:29:16.952 INFO:teuthology.orchestra.run.smithi163.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2023-07-14T18:29:16.953 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2023-07-14T18:29:16.953 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "int", 2023-07-14T18:29:16.953 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:16.953 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:16.953 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "10", 2023-07-14T18:29:16.954 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:16.954 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:16.954 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:16.954 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:16.954 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:16.955 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:16.955 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:16.955 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:16.955 INFO:teuthology.orchestra.run.smithi163.stdout: "ALERTMANAGER_API_HOST": { 2023-07-14T18:29:16.955 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "ALERTMANAGER_API_HOST", 2023-07-14T18:29:16.955 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "str", 2023-07-14T18:29:16.956 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:16.956 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:16.956 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "", 2023-07-14T18:29:16.956 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:16.956 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:16.957 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:16.957 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:16.957 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:16.957 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:16.957 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:16.958 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:16.958 INFO:teuthology.orchestra.run.smithi163.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2023-07-14T18:29:16.958 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2023-07-14T18:29:16.958 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "bool", 2023-07-14T18:29:16.958 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:16.959 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:16.959 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "True", 2023-07-14T18:29:16.959 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:16.959 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:16.959 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:16.959 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:16.960 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:16.960 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:16.960 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:16.960 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:16.960 INFO:teuthology.orchestra.run.smithi163.stdout: "AUDIT_API_ENABLED": { 2023-07-14T18:29:16.961 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "AUDIT_API_ENABLED", 2023-07-14T18:29:16.961 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "bool", 2023-07-14T18:29:16.961 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:16.961 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:16.961 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "False", 2023-07-14T18:29:16.962 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:16.962 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:16.962 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:16.962 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:16.962 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:16.963 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:16.963 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:16.963 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:16.963 INFO:teuthology.orchestra.run.smithi163.stdout: "AUDIT_API_LOG_PAYLOAD": { 2023-07-14T18:29:16.963 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2023-07-14T18:29:16.963 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "bool", 2023-07-14T18:29:16.964 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:16.964 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:16.964 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "True", 2023-07-14T18:29:16.964 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:16.964 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:16.965 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:16.965 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:16.965 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:16.965 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:16.965 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:16.966 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:16.966 INFO:teuthology.orchestra.run.smithi163.stdout: "ENABLE_BROWSABLE_API": { 2023-07-14T18:29:16.966 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "ENABLE_BROWSABLE_API", 2023-07-14T18:29:16.966 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "bool", 2023-07-14T18:29:16.966 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:16.967 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:16.967 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "True", 2023-07-14T18:29:16.967 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:16.967 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:16.967 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:16.967 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:16.968 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:16.968 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:16.968 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:16.968 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:16.968 INFO:teuthology.orchestra.run.smithi163.stdout: "FEATURE_TOGGLE_CEPHFS": { 2023-07-14T18:29:16.969 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2023-07-14T18:29:16.969 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "bool", 2023-07-14T18:29:16.969 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:16.969 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:16.969 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "True", 2023-07-14T18:29:16.970 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:16.970 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:16.970 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:16.970 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:16.970 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:16.971 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:16.971 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:16.971 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:16.971 INFO:teuthology.orchestra.run.smithi163.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2023-07-14T18:29:16.971 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2023-07-14T18:29:16.971 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "bool", 2023-07-14T18:29:16.972 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:16.972 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:16.972 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "True", 2023-07-14T18:29:16.972 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:16.972 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:16.973 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:16.973 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:16.973 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:16.973 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:16.973 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:16.974 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:16.974 INFO:teuthology.orchestra.run.smithi163.stdout: "FEATURE_TOGGLE_ISCSI": { 2023-07-14T18:29:16.974 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2023-07-14T18:29:16.974 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "bool", 2023-07-14T18:29:16.974 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:16.975 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:16.975 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "True", 2023-07-14T18:29:16.975 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:16.975 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:16.975 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:16.976 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:16.976 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:16.976 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:16.976 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:16.976 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:16.977 INFO:teuthology.orchestra.run.smithi163.stdout: "FEATURE_TOGGLE_MIRRORING": { 2023-07-14T18:29:16.977 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2023-07-14T18:29:16.977 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "bool", 2023-07-14T18:29:16.977 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:16.977 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:16.977 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "True", 2023-07-14T18:29:16.978 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:16.978 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:16.978 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:16.978 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:16.978 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:16.979 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:16.979 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:16.979 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:16.979 INFO:teuthology.orchestra.run.smithi163.stdout: "FEATURE_TOGGLE_NFS": { 2023-07-14T18:29:16.979 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "FEATURE_TOGGLE_NFS", 2023-07-14T18:29:16.980 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "bool", 2023-07-14T18:29:16.980 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:16.980 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:16.980 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "True", 2023-07-14T18:29:16.980 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:16.981 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:16.981 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:16.981 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:16.981 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:16.981 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:16.982 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:16.982 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:16.982 INFO:teuthology.orchestra.run.smithi163.stdout: "FEATURE_TOGGLE_RBD": { 2023-07-14T18:29:16.982 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "FEATURE_TOGGLE_RBD", 2023-07-14T18:29:16.982 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "bool", 2023-07-14T18:29:16.983 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:16.983 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:16.983 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "True", 2023-07-14T18:29:16.983 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:16.983 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:16.984 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:16.984 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:16.984 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:16.984 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:16.984 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:16.985 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:16.985 INFO:teuthology.orchestra.run.smithi163.stdout: "FEATURE_TOGGLE_RGW": { 2023-07-14T18:29:16.985 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "FEATURE_TOGGLE_RGW", 2023-07-14T18:29:16.985 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "bool", 2023-07-14T18:29:16.985 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:16.985 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:16.986 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "True", 2023-07-14T18:29:16.986 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:16.986 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:16.986 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:16.986 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:16.987 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:16.987 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:16.987 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:16.987 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:16.987 INFO:teuthology.orchestra.run.smithi163.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2023-07-14T18:29:16.988 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2023-07-14T18:29:16.988 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "str", 2023-07-14T18:29:16.988 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:16.988 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:16.988 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "", 2023-07-14T18:29:16.989 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:16.989 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:16.989 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:16.989 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:16.989 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:16.990 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:16.990 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:16.990 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:16.990 INFO:teuthology.orchestra.run.smithi163.stdout: "GRAFANA_API_PASSWORD": { 2023-07-14T18:29:16.990 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "GRAFANA_API_PASSWORD", 2023-07-14T18:29:16.991 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "str", 2023-07-14T18:29:16.991 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:16.991 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:16.991 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "admin", 2023-07-14T18:29:16.991 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:16.992 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:16.992 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:16.992 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:16.992 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:16.992 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:16.993 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:16.993 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:16.993 INFO:teuthology.orchestra.run.smithi163.stdout: "GRAFANA_API_SSL_VERIFY": { 2023-07-14T18:29:16.993 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2023-07-14T18:29:16.993 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "bool", 2023-07-14T18:29:16.993 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:16.994 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:16.994 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "True", 2023-07-14T18:29:16.994 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:16.994 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:16.994 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:16.995 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:16.995 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:16.995 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:16.995 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:16.995 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:16.996 INFO:teuthology.orchestra.run.smithi163.stdout: "GRAFANA_API_URL": { 2023-07-14T18:29:16.996 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "GRAFANA_API_URL", 2023-07-14T18:29:16.996 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "str", 2023-07-14T18:29:16.996 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:16.996 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:16.997 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "", 2023-07-14T18:29:16.997 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:16.997 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:16.997 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:16.997 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:16.997 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:16.998 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:16.998 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:16.998 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:16.998 INFO:teuthology.orchestra.run.smithi163.stdout: "GRAFANA_API_USERNAME": { 2023-07-14T18:29:16.998 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "GRAFANA_API_USERNAME", 2023-07-14T18:29:16.999 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "str", 2023-07-14T18:29:16.999 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:16.999 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:16.999 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "admin", 2023-07-14T18:29:16.999 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:17.000 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:17.000 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:17.000 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:17.000 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:17.000 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:17.001 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:17.001 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:17.001 INFO:teuthology.orchestra.run.smithi163.stdout: "GRAFANA_FRONTEND_API_URL": { 2023-07-14T18:29:17.001 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2023-07-14T18:29:17.001 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "str", 2023-07-14T18:29:17.001 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:17.002 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:17.002 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "", 2023-07-14T18:29:17.002 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:17.002 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:17.002 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:17.003 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:17.003 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:17.003 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:17.003 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:17.003 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:17.004 INFO:teuthology.orchestra.run.smithi163.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2023-07-14T18:29:17.004 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2023-07-14T18:29:17.004 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "bool", 2023-07-14T18:29:17.004 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:17.004 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:17.005 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "False", 2023-07-14T18:29:17.005 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:17.005 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:17.005 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:17.005 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:17.006 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:17.006 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:17.006 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:17.006 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:17.006 INFO:teuthology.orchestra.run.smithi163.stdout: "ISCSI_API_SSL_VERIFICATION": { 2023-07-14T18:29:17.006 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2023-07-14T18:29:17.007 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "bool", 2023-07-14T18:29:17.007 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:17.007 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:17.007 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "True", 2023-07-14T18:29:17.007 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:17.008 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:17.008 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:17.008 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:17.008 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:17.008 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:17.009 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:17.009 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:17.009 INFO:teuthology.orchestra.run.smithi163.stdout: "ISSUE_TRACKER_API_KEY": { 2023-07-14T18:29:17.009 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "ISSUE_TRACKER_API_KEY", 2023-07-14T18:29:17.009 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "str", 2023-07-14T18:29:17.010 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:17.010 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:17.010 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "", 2023-07-14T18:29:17.010 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:17.010 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:17.011 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:17.011 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:17.011 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:17.011 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:17.011 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:17.011 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:17.012 INFO:teuthology.orchestra.run.smithi163.stdout: "PROMETHEUS_API_HOST": { 2023-07-14T18:29:17.012 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "PROMETHEUS_API_HOST", 2023-07-14T18:29:17.012 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "str", 2023-07-14T18:29:17.012 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:17.012 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:17.013 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "", 2023-07-14T18:29:17.013 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:17.013 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:17.013 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:17.013 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:17.014 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:17.014 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:17.014 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:17.014 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:17.014 INFO:teuthology.orchestra.run.smithi163.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2023-07-14T18:29:17.015 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2023-07-14T18:29:17.015 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "bool", 2023-07-14T18:29:17.015 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:17.015 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:17.015 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "True", 2023-07-14T18:29:17.016 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:17.016 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:17.016 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:17.016 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:17.016 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:17.017 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:17.017 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:17.017 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:17.017 INFO:teuthology.orchestra.run.smithi163.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2023-07-14T18:29:17.017 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2023-07-14T18:29:17.018 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "bool", 2023-07-14T18:29:17.018 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:17.018 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:17.018 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "False", 2023-07-14T18:29:17.018 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:17.019 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:17.019 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:17.019 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:17.019 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:17.019 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:17.020 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:17.020 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:17.020 INFO:teuthology.orchestra.run.smithi163.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2023-07-14T18:29:17.020 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2023-07-14T18:29:17.020 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "bool", 2023-07-14T18:29:17.021 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:17.021 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:17.021 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "False", 2023-07-14T18:29:17.021 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:17.021 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:17.022 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:17.022 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:17.022 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:17.022 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:17.022 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:17.023 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:17.023 INFO:teuthology.orchestra.run.smithi163.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2023-07-14T18:29:17.023 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2023-07-14T18:29:17.023 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "bool", 2023-07-14T18:29:17.023 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:17.023 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:17.024 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "True", 2023-07-14T18:29:17.024 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:17.024 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:17.024 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:17.024 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:17.025 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:17.025 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:17.025 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:17.025 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:17.025 INFO:teuthology.orchestra.run.smithi163.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2023-07-14T18:29:17.026 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2023-07-14T18:29:17.026 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "bool", 2023-07-14T18:29:17.026 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:17.026 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:17.026 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "True", 2023-07-14T18:29:17.027 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:17.027 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:17.027 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:17.027 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:17.027 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:17.028 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:17.028 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:17.028 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:17.028 INFO:teuthology.orchestra.run.smithi163.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2023-07-14T18:29:17.028 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2023-07-14T18:29:17.029 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "bool", 2023-07-14T18:29:17.029 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:17.029 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:17.029 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "False", 2023-07-14T18:29:17.029 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:17.029 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:17.030 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:17.030 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:17.030 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:17.030 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:17.030 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:17.031 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:17.031 INFO:teuthology.orchestra.run.smithi163.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2023-07-14T18:29:17.031 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2023-07-14T18:29:17.031 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "bool", 2023-07-14T18:29:17.031 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:17.032 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:17.032 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "False", 2023-07-14T18:29:17.032 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:17.032 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:17.032 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:17.033 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:17.033 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:17.033 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:17.033 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:17.033 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:17.034 INFO:teuthology.orchestra.run.smithi163.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2023-07-14T18:29:17.034 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2023-07-14T18:29:17.034 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "bool", 2023-07-14T18:29:17.034 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:17.034 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:17.034 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "False", 2023-07-14T18:29:17.035 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:17.035 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:17.035 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:17.035 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:17.035 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:17.036 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:17.036 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:17.036 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:17.036 INFO:teuthology.orchestra.run.smithi163.stdout: "PWD_POLICY_ENABLED": { 2023-07-14T18:29:17.036 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "PWD_POLICY_ENABLED", 2023-07-14T18:29:17.037 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "bool", 2023-07-14T18:29:17.037 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:17.037 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:17.037 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "True", 2023-07-14T18:29:17.037 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:17.038 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:17.038 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:17.038 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:17.038 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:17.038 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:17.039 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:17.039 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:17.039 INFO:teuthology.orchestra.run.smithi163.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2023-07-14T18:29:17.039 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2023-07-14T18:29:17.039 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "str", 2023-07-14T18:29:17.040 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:17.040 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:17.040 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2023-07-14T18:29:17.040 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:17.040 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:17.041 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:17.041 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:17.041 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:17.041 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:17.041 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:17.042 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:17.042 INFO:teuthology.orchestra.run.smithi163.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2023-07-14T18:29:17.042 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2023-07-14T18:29:17.042 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "int", 2023-07-14T18:29:17.042 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:17.043 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:17.043 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "10", 2023-07-14T18:29:17.043 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:17.043 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:17.043 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:17.044 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:17.044 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:17.044 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:17.044 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:17.044 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:17.045 INFO:teuthology.orchestra.run.smithi163.stdout: "PWD_POLICY_MIN_LENGTH": { 2023-07-14T18:29:17.045 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2023-07-14T18:29:17.045 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "int", 2023-07-14T18:29:17.045 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:17.045 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:17.046 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "8", 2023-07-14T18:29:17.046 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:17.046 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:17.046 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:17.046 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:17.047 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:17.047 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:17.047 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:17.047 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:17.047 INFO:teuthology.orchestra.run.smithi163.stdout: "REST_REQUESTS_TIMEOUT": { 2023-07-14T18:29:17.048 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "REST_REQUESTS_TIMEOUT", 2023-07-14T18:29:17.048 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "int", 2023-07-14T18:29:17.048 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:17.048 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:17.049 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "45", 2023-07-14T18:29:17.049 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:17.049 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:17.049 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:17.049 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:17.050 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:17.050 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:17.050 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:17.050 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:17.050 INFO:teuthology.orchestra.run.smithi163.stdout: "RGW_API_ACCESS_KEY": { 2023-07-14T18:29:17.051 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "RGW_API_ACCESS_KEY", 2023-07-14T18:29:17.051 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "str", 2023-07-14T18:29:17.051 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:17.051 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:17.051 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "", 2023-07-14T18:29:17.051 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:17.052 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:17.052 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:17.052 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:17.052 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:17.052 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:17.053 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:17.053 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:17.053 INFO:teuthology.orchestra.run.smithi163.stdout: "RGW_API_ADMIN_RESOURCE": { 2023-07-14T18:29:17.053 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2023-07-14T18:29:17.053 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "str", 2023-07-14T18:29:17.054 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:17.054 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:17.054 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "admin", 2023-07-14T18:29:17.054 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:17.054 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:17.055 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:17.055 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:17.055 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:17.055 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:17.055 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:17.056 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:17.056 INFO:teuthology.orchestra.run.smithi163.stdout: "RGW_API_SECRET_KEY": { 2023-07-14T18:29:17.056 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "RGW_API_SECRET_KEY", 2023-07-14T18:29:17.056 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "str", 2023-07-14T18:29:17.056 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:17.057 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:17.057 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "", 2023-07-14T18:29:17.057 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:17.057 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:17.057 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:17.058 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:17.058 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:17.058 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:17.058 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:17.058 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:17.058 INFO:teuthology.orchestra.run.smithi163.stdout: "RGW_API_SSL_VERIFY": { 2023-07-14T18:29:17.059 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "RGW_API_SSL_VERIFY", 2023-07-14T18:29:17.059 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "bool", 2023-07-14T18:29:17.059 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:17.059 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:17.059 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "True", 2023-07-14T18:29:17.060 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:17.060 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:17.060 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:17.060 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:17.060 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:17.061 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:17.061 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:17.061 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:17.061 INFO:teuthology.orchestra.run.smithi163.stdout: "USER_PWD_EXPIRATION_SPAN": { 2023-07-14T18:29:17.061 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2023-07-14T18:29:17.062 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "int", 2023-07-14T18:29:17.062 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:17.062 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:17.062 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "0", 2023-07-14T18:29:17.062 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:17.063 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:17.063 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:17.063 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:17.063 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:17.063 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:17.063 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:17.064 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:17.064 INFO:teuthology.orchestra.run.smithi163.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2023-07-14T18:29:17.064 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2023-07-14T18:29:17.064 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "int", 2023-07-14T18:29:17.064 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:17.065 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:17.065 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "10", 2023-07-14T18:29:17.065 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:17.065 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:17.065 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:17.066 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:17.066 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:17.066 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:17.066 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:17.066 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:17.067 INFO:teuthology.orchestra.run.smithi163.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2023-07-14T18:29:17.067 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2023-07-14T18:29:17.067 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "int", 2023-07-14T18:29:17.067 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:17.067 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:17.068 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "5", 2023-07-14T18:29:17.068 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:17.068 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:17.068 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:17.068 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:17.068 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:17.069 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:17.069 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:17.069 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:17.069 INFO:teuthology.orchestra.run.smithi163.stdout: "cross_origin_url": { 2023-07-14T18:29:17.069 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "cross_origin_url", 2023-07-14T18:29:17.070 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "str", 2023-07-14T18:29:17.070 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:17.070 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:17.070 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "", 2023-07-14T18:29:17.070 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:17.071 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:17.071 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:17.071 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:17.071 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:17.071 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:17.072 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:17.072 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:17.072 INFO:teuthology.orchestra.run.smithi163.stdout: "crt_file": { 2023-07-14T18:29:17.072 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "crt_file", 2023-07-14T18:29:17.072 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "str", 2023-07-14T18:29:17.072 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:17.073 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:17.073 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "", 2023-07-14T18:29:17.073 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:17.073 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:17.073 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:17.074 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:17.074 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:17.074 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:17.074 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:17.074 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:17.075 INFO:teuthology.orchestra.run.smithi163.stdout: "debug": { 2023-07-14T18:29:17.075 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "debug", 2023-07-14T18:29:17.075 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "bool", 2023-07-14T18:29:17.075 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:17.075 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:17.076 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "False", 2023-07-14T18:29:17.076 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:17.076 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:17.076 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:17.076 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "Enable/disable debug options", 2023-07-14T18:29:17.077 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:17.077 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:17.077 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:17.077 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:17.077 INFO:teuthology.orchestra.run.smithi163.stdout: "jwt_token_ttl": { 2023-07-14T18:29:17.078 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "jwt_token_ttl", 2023-07-14T18:29:17.078 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "int", 2023-07-14T18:29:17.078 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:17.078 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:17.078 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "28800", 2023-07-14T18:29:17.078 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:17.079 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:17.079 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:17.079 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:17.079 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:17.079 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:17.080 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:17.080 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:17.080 INFO:teuthology.orchestra.run.smithi163.stdout: "key_file": { 2023-07-14T18:29:17.080 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "key_file", 2023-07-14T18:29:17.080 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "str", 2023-07-14T18:29:17.081 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:17.081 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:17.081 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "", 2023-07-14T18:29:17.081 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:17.081 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:17.082 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:17.082 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:17.082 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:17.082 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:17.082 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:17.082 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:17.083 INFO:teuthology.orchestra.run.smithi163.stdout: "log_level": { 2023-07-14T18:29:17.083 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "log_level", 2023-07-14T18:29:17.083 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "str", 2023-07-14T18:29:17.083 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:17.083 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:17.084 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "", 2023-07-14T18:29:17.084 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:17.084 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:17.084 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [ 2023-07-14T18:29:17.084 INFO:teuthology.orchestra.run.smithi163.stdout: "", 2023-07-14T18:29:17.085 INFO:teuthology.orchestra.run.smithi163.stdout: "critical", 2023-07-14T18:29:17.085 INFO:teuthology.orchestra.run.smithi163.stdout: "debug", 2023-07-14T18:29:17.085 INFO:teuthology.orchestra.run.smithi163.stdout: "error", 2023-07-14T18:29:17.085 INFO:teuthology.orchestra.run.smithi163.stdout: "info", 2023-07-14T18:29:17.085 INFO:teuthology.orchestra.run.smithi163.stdout: "warning" 2023-07-14T18:29:17.086 INFO:teuthology.orchestra.run.smithi163.stdout: ], 2023-07-14T18:29:17.086 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:17.086 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:17.086 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:17.086 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:17.087 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:17.087 INFO:teuthology.orchestra.run.smithi163.stdout: "log_to_cluster": { 2023-07-14T18:29:17.087 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "log_to_cluster", 2023-07-14T18:29:17.087 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "bool", 2023-07-14T18:29:17.087 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:17.088 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:17.088 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "False", 2023-07-14T18:29:17.088 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:17.088 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:17.088 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:17.089 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:17.089 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:17.089 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:17.089 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:17.089 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:17.089 INFO:teuthology.orchestra.run.smithi163.stdout: "log_to_cluster_level": { 2023-07-14T18:29:17.090 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "log_to_cluster_level", 2023-07-14T18:29:17.090 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "str", 2023-07-14T18:29:17.090 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:17.090 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:17.090 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "info", 2023-07-14T18:29:17.091 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:17.091 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:17.091 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [ 2023-07-14T18:29:17.091 INFO:teuthology.orchestra.run.smithi163.stdout: "", 2023-07-14T18:29:17.091 INFO:teuthology.orchestra.run.smithi163.stdout: "critical", 2023-07-14T18:29:17.092 INFO:teuthology.orchestra.run.smithi163.stdout: "debug", 2023-07-14T18:29:17.092 INFO:teuthology.orchestra.run.smithi163.stdout: "error", 2023-07-14T18:29:17.092 INFO:teuthology.orchestra.run.smithi163.stdout: "info", 2023-07-14T18:29:17.092 INFO:teuthology.orchestra.run.smithi163.stdout: "warning" 2023-07-14T18:29:17.092 INFO:teuthology.orchestra.run.smithi163.stdout: ], 2023-07-14T18:29:17.093 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:17.093 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:17.093 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:17.093 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:17.093 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:17.094 INFO:teuthology.orchestra.run.smithi163.stdout: "log_to_file": { 2023-07-14T18:29:17.094 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "log_to_file", 2023-07-14T18:29:17.094 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "bool", 2023-07-14T18:29:17.094 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:17.094 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:17.094 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "False", 2023-07-14T18:29:17.095 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:17.095 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:17.095 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:17.095 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:17.095 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:17.096 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:17.096 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:17.096 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:17.096 INFO:teuthology.orchestra.run.smithi163.stdout: "motd": { 2023-07-14T18:29:17.096 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "motd", 2023-07-14T18:29:17.097 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "str", 2023-07-14T18:29:17.097 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:17.097 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:17.097 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "", 2023-07-14T18:29:17.097 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:17.098 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:17.098 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:17.098 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "The message of the day", 2023-07-14T18:29:17.098 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:17.098 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:17.099 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:17.099 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:17.099 INFO:teuthology.orchestra.run.smithi163.stdout: "redirect_resolve_ip_addr": { 2023-07-14T18:29:17.099 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "redirect_resolve_ip_addr", 2023-07-14T18:29:17.099 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "bool", 2023-07-14T18:29:17.099 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:17.100 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:17.100 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "False", 2023-07-14T18:29:17.100 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:17.100 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:17.100 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:17.101 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:17.101 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:17.101 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:17.101 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:17.101 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:17.102 INFO:teuthology.orchestra.run.smithi163.stdout: "server_addr": { 2023-07-14T18:29:17.102 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "server_addr", 2023-07-14T18:29:17.102 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "str", 2023-07-14T18:29:17.102 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:17.102 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:17.103 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "::", 2023-07-14T18:29:17.103 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:17.103 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:17.103 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:17.103 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:17.103 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:17.104 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:17.104 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:17.104 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:17.104 INFO:teuthology.orchestra.run.smithi163.stdout: "server_port": { 2023-07-14T18:29:17.104 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "server_port", 2023-07-14T18:29:17.105 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "int", 2023-07-14T18:29:17.105 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:17.105 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:17.105 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "8080", 2023-07-14T18:29:17.105 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:17.106 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:17.106 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:17.106 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:17.106 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:17.106 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:17.107 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:17.107 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:17.107 INFO:teuthology.orchestra.run.smithi163.stdout: "ssl": { 2023-07-14T18:29:17.107 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "ssl", 2023-07-14T18:29:17.107 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "bool", 2023-07-14T18:29:17.107 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:17.108 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:17.108 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "True", 2023-07-14T18:29:17.108 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:17.108 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:17.108 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:17.109 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:17.109 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:17.109 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:17.109 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:17.109 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:17.110 INFO:teuthology.orchestra.run.smithi163.stdout: "ssl_server_port": { 2023-07-14T18:29:17.110 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "ssl_server_port", 2023-07-14T18:29:17.110 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "int", 2023-07-14T18:29:17.110 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:17.110 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:17.111 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "8443", 2023-07-14T18:29:17.111 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:17.111 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:17.111 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:17.111 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:17.111 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:17.112 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:17.112 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:17.112 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:17.112 INFO:teuthology.orchestra.run.smithi163.stdout: "standby_behaviour": { 2023-07-14T18:29:17.112 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "standby_behaviour", 2023-07-14T18:29:17.113 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "str", 2023-07-14T18:29:17.113 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:17.113 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:17.113 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "redirect", 2023-07-14T18:29:17.113 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:17.114 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:17.114 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [ 2023-07-14T18:29:17.114 INFO:teuthology.orchestra.run.smithi163.stdout: "error", 2023-07-14T18:29:17.114 INFO:teuthology.orchestra.run.smithi163.stdout: "redirect" 2023-07-14T18:29:17.114 INFO:teuthology.orchestra.run.smithi163.stdout: ], 2023-07-14T18:29:17.115 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:17.115 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:17.115 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:17.115 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:17.115 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:17.115 INFO:teuthology.orchestra.run.smithi163.stdout: "standby_error_status_code": { 2023-07-14T18:29:17.116 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "standby_error_status_code", 2023-07-14T18:29:17.116 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "int", 2023-07-14T18:29:17.116 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:17.116 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:17.116 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "500", 2023-07-14T18:29:17.117 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "400", 2023-07-14T18:29:17.117 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "599", 2023-07-14T18:29:17.117 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:17.117 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:17.117 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:17.118 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:17.118 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:17.118 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:17.118 INFO:teuthology.orchestra.run.smithi163.stdout: "url_prefix": { 2023-07-14T18:29:17.118 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "url_prefix", 2023-07-14T18:29:17.118 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "str", 2023-07-14T18:29:17.119 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:17.119 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:17.119 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "", 2023-07-14T18:29:17.119 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:17.119 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:17.120 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:17.120 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:17.120 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:17.120 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:17.120 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:17.121 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-07-14T18:29:17.121 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-07-14T18:29:17.121 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:17.121 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-07-14T18:29:17.121 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "devicehealth", 2023-07-14T18:29:17.122 INFO:teuthology.orchestra.run.smithi163.stdout: "can_run": true, 2023-07-14T18:29:17.122 INFO:teuthology.orchestra.run.smithi163.stdout: "error_string": "", 2023-07-14T18:29:17.122 INFO:teuthology.orchestra.run.smithi163.stdout: "module_options": { 2023-07-14T18:29:17.122 INFO:teuthology.orchestra.run.smithi163.stdout: "enable_monitoring": { 2023-07-14T18:29:17.122 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "enable_monitoring", 2023-07-14T18:29:17.122 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "bool", 2023-07-14T18:29:17.123 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:17.123 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:17.123 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "True", 2023-07-14T18:29:17.123 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:17.123 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:17.124 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:17.124 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "monitor device health metrics", 2023-07-14T18:29:17.124 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:17.124 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:17.124 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:17.125 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:17.125 INFO:teuthology.orchestra.run.smithi163.stdout: "log_level": { 2023-07-14T18:29:17.125 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "log_level", 2023-07-14T18:29:17.125 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "str", 2023-07-14T18:29:17.125 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:17.126 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:17.126 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "", 2023-07-14T18:29:17.126 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:17.126 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:17.126 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [ 2023-07-14T18:29:17.127 INFO:teuthology.orchestra.run.smithi163.stdout: "", 2023-07-14T18:29:17.127 INFO:teuthology.orchestra.run.smithi163.stdout: "critical", 2023-07-14T18:29:17.127 INFO:teuthology.orchestra.run.smithi163.stdout: "debug", 2023-07-14T18:29:17.127 INFO:teuthology.orchestra.run.smithi163.stdout: "error", 2023-07-14T18:29:17.127 INFO:teuthology.orchestra.run.smithi163.stdout: "info", 2023-07-14T18:29:17.128 INFO:teuthology.orchestra.run.smithi163.stdout: "warning" 2023-07-14T18:29:17.128 INFO:teuthology.orchestra.run.smithi163.stdout: ], 2023-07-14T18:29:17.128 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:17.128 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:17.128 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:17.128 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:17.129 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:17.129 INFO:teuthology.orchestra.run.smithi163.stdout: "log_to_cluster": { 2023-07-14T18:29:17.129 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "log_to_cluster", 2023-07-14T18:29:17.129 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "bool", 2023-07-14T18:29:17.129 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:17.130 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:17.130 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "False", 2023-07-14T18:29:17.130 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:17.130 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:17.130 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:17.131 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:17.131 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:17.131 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:17.131 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:17.131 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:17.132 INFO:teuthology.orchestra.run.smithi163.stdout: "log_to_cluster_level": { 2023-07-14T18:29:17.132 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "log_to_cluster_level", 2023-07-14T18:29:17.132 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "str", 2023-07-14T18:29:17.132 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:17.132 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:17.132 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "info", 2023-07-14T18:29:17.133 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:17.133 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:17.133 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [ 2023-07-14T18:29:17.133 INFO:teuthology.orchestra.run.smithi163.stdout: "", 2023-07-14T18:29:17.133 INFO:teuthology.orchestra.run.smithi163.stdout: "critical", 2023-07-14T18:29:17.134 INFO:teuthology.orchestra.run.smithi163.stdout: "debug", 2023-07-14T18:29:17.134 INFO:teuthology.orchestra.run.smithi163.stdout: "error", 2023-07-14T18:29:17.134 INFO:teuthology.orchestra.run.smithi163.stdout: "info", 2023-07-14T18:29:17.134 INFO:teuthology.orchestra.run.smithi163.stdout: "warning" 2023-07-14T18:29:17.134 INFO:teuthology.orchestra.run.smithi163.stdout: ], 2023-07-14T18:29:17.135 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:17.135 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:17.135 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:17.135 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:17.135 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:17.135 INFO:teuthology.orchestra.run.smithi163.stdout: "log_to_file": { 2023-07-14T18:29:17.136 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "log_to_file", 2023-07-14T18:29:17.136 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "bool", 2023-07-14T18:29:17.136 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:17.136 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:17.136 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "False", 2023-07-14T18:29:17.137 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:17.137 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:17.137 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:17.137 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:17.137 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:17.138 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:17.138 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:17.138 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:17.138 INFO:teuthology.orchestra.run.smithi163.stdout: "mark_out_threshold": { 2023-07-14T18:29:17.138 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "mark_out_threshold", 2023-07-14T18:29:17.139 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "secs", 2023-07-14T18:29:17.139 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:17.139 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:17.139 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "2419200", 2023-07-14T18:29:17.139 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:17.139 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:17.140 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:17.140 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "automatically mark OSD if it may fail before this long", 2023-07-14T18:29:17.140 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:17.140 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:17.140 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:17.141 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:17.141 INFO:teuthology.orchestra.run.smithi163.stdout: "pool_name": { 2023-07-14T18:29:17.141 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "pool_name", 2023-07-14T18:29:17.141 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "str", 2023-07-14T18:29:17.141 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:17.142 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:17.142 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "device_health_metrics", 2023-07-14T18:29:17.142 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:17.142 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:17.142 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:17.143 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "name of pool in which to store device health metrics", 2023-07-14T18:29:17.143 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:17.143 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:17.143 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:17.143 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:17.143 INFO:teuthology.orchestra.run.smithi163.stdout: "retention_period": { 2023-07-14T18:29:17.144 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "retention_period", 2023-07-14T18:29:17.144 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "secs", 2023-07-14T18:29:17.144 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:17.144 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:17.144 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "15552000", 2023-07-14T18:29:17.145 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:17.145 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:17.145 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:17.145 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "how long to retain device health metrics", 2023-07-14T18:29:17.145 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:17.146 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:17.146 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:17.146 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:17.146 INFO:teuthology.orchestra.run.smithi163.stdout: "scrape_frequency": { 2023-07-14T18:29:17.146 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "scrape_frequency", 2023-07-14T18:29:17.146 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "secs", 2023-07-14T18:29:17.147 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:17.147 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:17.147 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "86400", 2023-07-14T18:29:17.147 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:17.147 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:17.148 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:17.148 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "how frequently to scrape device health metrics", 2023-07-14T18:29:17.148 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:17.148 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:17.148 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:17.149 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:17.149 INFO:teuthology.orchestra.run.smithi163.stdout: "self_heal": { 2023-07-14T18:29:17.149 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "self_heal", 2023-07-14T18:29:17.149 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "bool", 2023-07-14T18:29:17.149 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:17.150 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:17.150 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "True", 2023-07-14T18:29:17.150 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:17.150 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:17.150 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:17.151 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "preemptively heal cluster around devices that may fail", 2023-07-14T18:29:17.151 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:17.151 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:17.151 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:17.151 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:17.151 INFO:teuthology.orchestra.run.smithi163.stdout: "sleep_interval": { 2023-07-14T18:29:17.152 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "sleep_interval", 2023-07-14T18:29:17.152 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "secs", 2023-07-14T18:29:17.152 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:17.152 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:17.152 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "600", 2023-07-14T18:29:17.153 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:17.153 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:17.153 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:17.153 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "how frequently to wake up and check device health", 2023-07-14T18:29:17.153 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:17.154 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:17.154 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:17.154 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:17.154 INFO:teuthology.orchestra.run.smithi163.stdout: "warn_threshold": { 2023-07-14T18:29:17.154 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "warn_threshold", 2023-07-14T18:29:17.155 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "secs", 2023-07-14T18:29:17.155 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:17.155 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:17.155 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "7257600", 2023-07-14T18:29:17.155 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:17.155 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:17.156 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:17.156 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "raise health warning if OSD may fail before this long", 2023-07-14T18:29:17.156 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:17.156 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:17.156 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:17.157 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-07-14T18:29:17.157 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-07-14T18:29:17.157 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:17.157 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-07-14T18:29:17.157 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "diskprediction_local", 2023-07-14T18:29:17.158 INFO:teuthology.orchestra.run.smithi163.stdout: "can_run": true, 2023-07-14T18:29:17.158 INFO:teuthology.orchestra.run.smithi163.stdout: "error_string": "", 2023-07-14T18:29:17.158 INFO:teuthology.orchestra.run.smithi163.stdout: "module_options": { 2023-07-14T18:29:17.158 INFO:teuthology.orchestra.run.smithi163.stdout: "log_level": { 2023-07-14T18:29:17.158 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "log_level", 2023-07-14T18:29:17.159 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "str", 2023-07-14T18:29:17.159 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:17.159 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:17.159 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "", 2023-07-14T18:29:17.159 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:17.160 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:17.160 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [ 2023-07-14T18:29:17.160 INFO:teuthology.orchestra.run.smithi163.stdout: "", 2023-07-14T18:29:17.160 INFO:teuthology.orchestra.run.smithi163.stdout: "critical", 2023-07-14T18:29:17.160 INFO:teuthology.orchestra.run.smithi163.stdout: "debug", 2023-07-14T18:29:17.161 INFO:teuthology.orchestra.run.smithi163.stdout: "error", 2023-07-14T18:29:17.161 INFO:teuthology.orchestra.run.smithi163.stdout: "info", 2023-07-14T18:29:17.161 INFO:teuthology.orchestra.run.smithi163.stdout: "warning" 2023-07-14T18:29:17.161 INFO:teuthology.orchestra.run.smithi163.stdout: ], 2023-07-14T18:29:17.161 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:17.162 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:17.162 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:17.162 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:17.162 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:17.162 INFO:teuthology.orchestra.run.smithi163.stdout: "log_to_cluster": { 2023-07-14T18:29:17.162 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "log_to_cluster", 2023-07-14T18:29:17.163 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "bool", 2023-07-14T18:29:17.163 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:17.163 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:17.163 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "False", 2023-07-14T18:29:17.163 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:17.164 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:17.164 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:17.164 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:17.164 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:17.164 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:17.165 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:17.165 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:17.165 INFO:teuthology.orchestra.run.smithi163.stdout: "log_to_cluster_level": { 2023-07-14T18:29:17.165 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "log_to_cluster_level", 2023-07-14T18:29:17.165 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "str", 2023-07-14T18:29:17.166 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:17.166 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:17.166 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "info", 2023-07-14T18:29:17.166 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:17.166 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:17.166 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [ 2023-07-14T18:29:17.167 INFO:teuthology.orchestra.run.smithi163.stdout: "", 2023-07-14T18:29:17.167 INFO:teuthology.orchestra.run.smithi163.stdout: "critical", 2023-07-14T18:29:17.167 INFO:teuthology.orchestra.run.smithi163.stdout: "debug", 2023-07-14T18:29:17.167 INFO:teuthology.orchestra.run.smithi163.stdout: "error", 2023-07-14T18:29:17.167 INFO:teuthology.orchestra.run.smithi163.stdout: "info", 2023-07-14T18:29:17.168 INFO:teuthology.orchestra.run.smithi163.stdout: "warning" 2023-07-14T18:29:17.168 INFO:teuthology.orchestra.run.smithi163.stdout: ], 2023-07-14T18:29:17.168 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:17.168 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:17.168 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:17.169 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:17.169 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:17.169 INFO:teuthology.orchestra.run.smithi163.stdout: "log_to_file": { 2023-07-14T18:29:17.169 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "log_to_file", 2023-07-14T18:29:17.169 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "bool", 2023-07-14T18:29:17.170 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:17.170 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:17.170 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "False", 2023-07-14T18:29:17.170 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:17.170 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:17.171 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:17.171 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:17.171 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:17.171 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:17.171 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:17.171 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:17.172 INFO:teuthology.orchestra.run.smithi163.stdout: "predict_interval": { 2023-07-14T18:29:17.172 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "predict_interval", 2023-07-14T18:29:17.172 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "str", 2023-07-14T18:29:17.172 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:17.172 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:17.173 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "86400", 2023-07-14T18:29:17.173 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:17.173 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:17.173 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:17.173 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:17.174 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:17.174 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:17.174 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:17.174 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:17.174 INFO:teuthology.orchestra.run.smithi163.stdout: "predictor_model": { 2023-07-14T18:29:17.175 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "predictor_model", 2023-07-14T18:29:17.175 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "str", 2023-07-14T18:29:17.175 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:17.175 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:17.175 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "prophetstor", 2023-07-14T18:29:17.175 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:17.176 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:17.176 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:17.176 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:17.176 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:17.176 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:17.177 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:17.177 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:17.177 INFO:teuthology.orchestra.run.smithi163.stdout: "sleep_interval": { 2023-07-14T18:29:17.177 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "sleep_interval", 2023-07-14T18:29:17.177 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "str", 2023-07-14T18:29:17.178 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:17.178 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:17.178 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "600", 2023-07-14T18:29:17.178 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:17.178 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:17.179 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:17.179 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:17.179 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:17.179 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:17.179 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:17.179 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-07-14T18:29:17.180 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-07-14T18:29:17.180 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:17.180 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-07-14T18:29:17.180 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "influx", 2023-07-14T18:29:17.180 INFO:teuthology.orchestra.run.smithi163.stdout: "can_run": false, 2023-07-14T18:29:17.181 INFO:teuthology.orchestra.run.smithi163.stdout: "error_string": "influxdb python module not found", 2023-07-14T18:29:17.181 INFO:teuthology.orchestra.run.smithi163.stdout: "module_options": { 2023-07-14T18:29:17.181 INFO:teuthology.orchestra.run.smithi163.stdout: "batch_size": { 2023-07-14T18:29:17.181 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "batch_size", 2023-07-14T18:29:17.181 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "int", 2023-07-14T18:29:17.182 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:17.182 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:17.182 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "5000", 2023-07-14T18:29:17.182 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:17.182 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:17.183 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:17.183 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2023-07-14T18:29:17.183 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:17.183 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:17.183 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:17.183 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:17.184 INFO:teuthology.orchestra.run.smithi163.stdout: "database": { 2023-07-14T18:29:17.184 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "database", 2023-07-14T18:29:17.184 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "str", 2023-07-14T18:29:17.184 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:17.184 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:17.185 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "ceph", 2023-07-14T18:29:17.185 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:17.185 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:17.185 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:17.185 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2023-07-14T18:29:17.186 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:17.186 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:17.186 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:17.186 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:17.186 INFO:teuthology.orchestra.run.smithi163.stdout: "hostname": { 2023-07-14T18:29:17.187 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "hostname", 2023-07-14T18:29:17.187 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "str", 2023-07-14T18:29:17.187 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:17.187 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:17.187 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "", 2023-07-14T18:29:17.188 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:17.188 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:17.188 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:17.188 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "InfluxDB server hostname", 2023-07-14T18:29:17.188 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:17.189 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:17.189 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:17.189 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:17.189 INFO:teuthology.orchestra.run.smithi163.stdout: "interval": { 2023-07-14T18:29:17.189 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "interval", 2023-07-14T18:29:17.189 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "secs", 2023-07-14T18:29:17.190 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:17.190 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:17.190 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "30", 2023-07-14T18:29:17.190 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "5", 2023-07-14T18:29:17.190 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:17.191 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:17.191 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2023-07-14T18:29:17.191 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:17.191 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:17.191 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:17.192 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:17.192 INFO:teuthology.orchestra.run.smithi163.stdout: "log_level": { 2023-07-14T18:29:17.192 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "log_level", 2023-07-14T18:29:17.192 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "str", 2023-07-14T18:29:17.192 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:17.193 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:17.193 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "", 2023-07-14T18:29:17.193 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:17.193 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:17.193 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [ 2023-07-14T18:29:17.194 INFO:teuthology.orchestra.run.smithi163.stdout: "", 2023-07-14T18:29:17.194 INFO:teuthology.orchestra.run.smithi163.stdout: "critical", 2023-07-14T18:29:17.194 INFO:teuthology.orchestra.run.smithi163.stdout: "debug", 2023-07-14T18:29:17.194 INFO:teuthology.orchestra.run.smithi163.stdout: "error", 2023-07-14T18:29:17.194 INFO:teuthology.orchestra.run.smithi163.stdout: "info", 2023-07-14T18:29:17.195 INFO:teuthology.orchestra.run.smithi163.stdout: "warning" 2023-07-14T18:29:17.195 INFO:teuthology.orchestra.run.smithi163.stdout: ], 2023-07-14T18:29:17.195 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:17.195 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:17.195 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:17.196 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:17.196 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:17.196 INFO:teuthology.orchestra.run.smithi163.stdout: "log_to_cluster": { 2023-07-14T18:29:17.196 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "log_to_cluster", 2023-07-14T18:29:17.196 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "bool", 2023-07-14T18:29:17.197 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:17.197 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:17.197 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "False", 2023-07-14T18:29:17.197 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:17.197 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:17.198 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:17.198 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:17.198 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:17.198 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:17.198 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:17.199 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:17.199 INFO:teuthology.orchestra.run.smithi163.stdout: "log_to_cluster_level": { 2023-07-14T18:29:17.199 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "log_to_cluster_level", 2023-07-14T18:29:17.199 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "str", 2023-07-14T18:29:17.199 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:17.199 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:17.200 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "info", 2023-07-14T18:29:17.200 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:17.200 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:17.200 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [ 2023-07-14T18:29:17.200 INFO:teuthology.orchestra.run.smithi163.stdout: "", 2023-07-14T18:29:17.201 INFO:teuthology.orchestra.run.smithi163.stdout: "critical", 2023-07-14T18:29:17.201 INFO:teuthology.orchestra.run.smithi163.stdout: "debug", 2023-07-14T18:29:17.201 INFO:teuthology.orchestra.run.smithi163.stdout: "error", 2023-07-14T18:29:17.201 INFO:teuthology.orchestra.run.smithi163.stdout: "info", 2023-07-14T18:29:17.201 INFO:teuthology.orchestra.run.smithi163.stdout: "warning" 2023-07-14T18:29:17.202 INFO:teuthology.orchestra.run.smithi163.stdout: ], 2023-07-14T18:29:17.202 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:17.202 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:17.202 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:17.202 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:17.203 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:17.203 INFO:teuthology.orchestra.run.smithi163.stdout: "log_to_file": { 2023-07-14T18:29:17.203 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "log_to_file", 2023-07-14T18:29:17.203 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "bool", 2023-07-14T18:29:17.203 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:17.203 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:17.204 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "False", 2023-07-14T18:29:17.204 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:17.204 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:17.204 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:17.204 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:17.205 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:17.205 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:17.205 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:17.205 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:17.205 INFO:teuthology.orchestra.run.smithi163.stdout: "password": { 2023-07-14T18:29:17.206 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "password", 2023-07-14T18:29:17.206 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "str", 2023-07-14T18:29:17.206 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:17.206 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:17.206 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "", 2023-07-14T18:29:17.207 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:17.207 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:17.207 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:17.207 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "password of InfluxDB server user", 2023-07-14T18:29:17.207 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:17.207 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:17.208 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:17.208 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:17.208 INFO:teuthology.orchestra.run.smithi163.stdout: "port": { 2023-07-14T18:29:17.208 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "port", 2023-07-14T18:29:17.208 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "int", 2023-07-14T18:29:17.209 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:17.209 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:17.209 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "8086", 2023-07-14T18:29:17.209 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:17.209 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:17.210 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:17.210 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "InfluxDB server port", 2023-07-14T18:29:17.210 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:17.210 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:17.210 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:17.211 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:17.211 INFO:teuthology.orchestra.run.smithi163.stdout: "ssl": { 2023-07-14T18:29:17.211 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "ssl", 2023-07-14T18:29:17.211 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "str", 2023-07-14T18:29:17.211 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:17.211 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:17.212 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "false", 2023-07-14T18:29:17.212 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:17.212 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:17.212 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:17.212 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2023-07-14T18:29:17.213 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:17.213 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:17.213 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:17.213 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:17.213 INFO:teuthology.orchestra.run.smithi163.stdout: "threads": { 2023-07-14T18:29:17.214 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "threads", 2023-07-14T18:29:17.214 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "int", 2023-07-14T18:29:17.214 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:17.214 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:17.214 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "5", 2023-07-14T18:29:17.215 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "1", 2023-07-14T18:29:17.215 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "32", 2023-07-14T18:29:17.215 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:17.215 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2023-07-14T18:29:17.215 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:17.216 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:17.216 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:17.216 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:17.216 INFO:teuthology.orchestra.run.smithi163.stdout: "username": { 2023-07-14T18:29:17.216 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "username", 2023-07-14T18:29:17.216 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "str", 2023-07-14T18:29:17.217 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:17.217 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:17.217 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "", 2023-07-14T18:29:17.217 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:17.217 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:17.218 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:17.218 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "username of InfluxDB server user", 2023-07-14T18:29:17.218 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:17.218 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:17.218 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:17.219 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:17.219 INFO:teuthology.orchestra.run.smithi163.stdout: "verify_ssl": { 2023-07-14T18:29:17.219 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "verify_ssl", 2023-07-14T18:29:17.219 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "str", 2023-07-14T18:29:17.219 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:17.220 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:17.220 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "true", 2023-07-14T18:29:17.220 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:17.220 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:17.220 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:17.220 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2023-07-14T18:29:17.221 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:17.221 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:17.221 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:17.221 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-07-14T18:29:17.221 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-07-14T18:29:17.222 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:17.222 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-07-14T18:29:17.222 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "insights", 2023-07-14T18:29:17.222 INFO:teuthology.orchestra.run.smithi163.stdout: "can_run": true, 2023-07-14T18:29:17.222 INFO:teuthology.orchestra.run.smithi163.stdout: "error_string": "", 2023-07-14T18:29:17.223 INFO:teuthology.orchestra.run.smithi163.stdout: "module_options": { 2023-07-14T18:29:17.223 INFO:teuthology.orchestra.run.smithi163.stdout: "log_level": { 2023-07-14T18:29:17.223 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "log_level", 2023-07-14T18:29:17.223 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "str", 2023-07-14T18:29:17.223 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:17.223 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:17.224 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "", 2023-07-14T18:29:17.224 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:17.224 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:17.224 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [ 2023-07-14T18:29:17.224 INFO:teuthology.orchestra.run.smithi163.stdout: "", 2023-07-14T18:29:17.225 INFO:teuthology.orchestra.run.smithi163.stdout: "critical", 2023-07-14T18:29:17.225 INFO:teuthology.orchestra.run.smithi163.stdout: "debug", 2023-07-14T18:29:17.225 INFO:teuthology.orchestra.run.smithi163.stdout: "error", 2023-07-14T18:29:17.225 INFO:teuthology.orchestra.run.smithi163.stdout: "info", 2023-07-14T18:29:17.225 INFO:teuthology.orchestra.run.smithi163.stdout: "warning" 2023-07-14T18:29:17.226 INFO:teuthology.orchestra.run.smithi163.stdout: ], 2023-07-14T18:29:17.226 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:17.226 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:17.226 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:17.226 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:17.227 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:17.227 INFO:teuthology.orchestra.run.smithi163.stdout: "log_to_cluster": { 2023-07-14T18:29:17.227 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "log_to_cluster", 2023-07-14T18:29:17.227 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "bool", 2023-07-14T18:29:17.227 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:17.228 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:17.228 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "False", 2023-07-14T18:29:17.228 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:17.228 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:17.228 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:17.229 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:17.229 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:17.229 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:17.229 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:17.229 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:17.230 INFO:teuthology.orchestra.run.smithi163.stdout: "log_to_cluster_level": { 2023-07-14T18:29:17.230 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "log_to_cluster_level", 2023-07-14T18:29:17.230 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "str", 2023-07-14T18:29:17.230 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:17.230 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:17.231 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "info", 2023-07-14T18:29:17.231 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:17.231 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:17.231 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [ 2023-07-14T18:29:17.231 INFO:teuthology.orchestra.run.smithi163.stdout: "", 2023-07-14T18:29:17.232 INFO:teuthology.orchestra.run.smithi163.stdout: "critical", 2023-07-14T18:29:17.232 INFO:teuthology.orchestra.run.smithi163.stdout: "debug", 2023-07-14T18:29:17.232 INFO:teuthology.orchestra.run.smithi163.stdout: "error", 2023-07-14T18:29:17.232 INFO:teuthology.orchestra.run.smithi163.stdout: "info", 2023-07-14T18:29:17.232 INFO:teuthology.orchestra.run.smithi163.stdout: "warning" 2023-07-14T18:29:17.233 INFO:teuthology.orchestra.run.smithi163.stdout: ], 2023-07-14T18:29:17.233 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:17.233 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:17.233 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:17.233 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:17.233 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:17.234 INFO:teuthology.orchestra.run.smithi163.stdout: "log_to_file": { 2023-07-14T18:29:17.234 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "log_to_file", 2023-07-14T18:29:17.234 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "bool", 2023-07-14T18:29:17.234 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:17.234 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:17.235 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "False", 2023-07-14T18:29:17.235 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:17.235 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:17.235 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:17.235 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:17.236 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:17.236 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:17.236 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:17.236 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-07-14T18:29:17.236 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-07-14T18:29:17.237 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:17.237 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-07-14T18:29:17.237 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "iostat", 2023-07-14T18:29:17.237 INFO:teuthology.orchestra.run.smithi163.stdout: "can_run": true, 2023-07-14T18:29:17.237 INFO:teuthology.orchestra.run.smithi163.stdout: "error_string": "", 2023-07-14T18:29:17.238 INFO:teuthology.orchestra.run.smithi163.stdout: "module_options": { 2023-07-14T18:29:17.238 INFO:teuthology.orchestra.run.smithi163.stdout: "log_level": { 2023-07-14T18:29:17.238 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "log_level", 2023-07-14T18:29:17.238 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "str", 2023-07-14T18:29:17.238 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:17.238 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:17.239 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "", 2023-07-14T18:29:17.239 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:17.239 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:17.239 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [ 2023-07-14T18:29:17.239 INFO:teuthology.orchestra.run.smithi163.stdout: "", 2023-07-14T18:29:17.240 INFO:teuthology.orchestra.run.smithi163.stdout: "critical", 2023-07-14T18:29:17.240 INFO:teuthology.orchestra.run.smithi163.stdout: "debug", 2023-07-14T18:29:17.240 INFO:teuthology.orchestra.run.smithi163.stdout: "error", 2023-07-14T18:29:17.240 INFO:teuthology.orchestra.run.smithi163.stdout: "info", 2023-07-14T18:29:17.240 INFO:teuthology.orchestra.run.smithi163.stdout: "warning" 2023-07-14T18:29:17.241 INFO:teuthology.orchestra.run.smithi163.stdout: ], 2023-07-14T18:29:17.241 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:17.241 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:17.241 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:17.241 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:17.242 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:17.242 INFO:teuthology.orchestra.run.smithi163.stdout: "log_to_cluster": { 2023-07-14T18:29:17.242 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "log_to_cluster", 2023-07-14T18:29:17.242 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "bool", 2023-07-14T18:29:17.242 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:17.243 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:17.243 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "False", 2023-07-14T18:29:17.243 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:17.243 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:17.243 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:17.244 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:17.244 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:17.244 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:17.244 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:17.244 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:17.245 INFO:teuthology.orchestra.run.smithi163.stdout: "log_to_cluster_level": { 2023-07-14T18:29:17.245 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "log_to_cluster_level", 2023-07-14T18:29:17.245 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "str", 2023-07-14T18:29:17.245 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:17.245 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:17.245 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "info", 2023-07-14T18:29:17.246 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:17.246 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:17.246 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [ 2023-07-14T18:29:17.246 INFO:teuthology.orchestra.run.smithi163.stdout: "", 2023-07-14T18:29:17.246 INFO:teuthology.orchestra.run.smithi163.stdout: "critical", 2023-07-14T18:29:17.247 INFO:teuthology.orchestra.run.smithi163.stdout: "debug", 2023-07-14T18:29:17.247 INFO:teuthology.orchestra.run.smithi163.stdout: "error", 2023-07-14T18:29:17.247 INFO:teuthology.orchestra.run.smithi163.stdout: "info", 2023-07-14T18:29:17.247 INFO:teuthology.orchestra.run.smithi163.stdout: "warning" 2023-07-14T18:29:17.247 INFO:teuthology.orchestra.run.smithi163.stdout: ], 2023-07-14T18:29:17.248 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:17.248 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:17.248 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:17.248 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:17.248 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:17.249 INFO:teuthology.orchestra.run.smithi163.stdout: "log_to_file": { 2023-07-14T18:29:17.249 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "log_to_file", 2023-07-14T18:29:17.249 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "bool", 2023-07-14T18:29:17.249 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:17.249 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:17.249 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "False", 2023-07-14T18:29:17.250 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:17.250 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:17.250 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:17.250 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:17.250 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:17.251 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:17.251 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:17.251 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-07-14T18:29:17.251 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-07-14T18:29:17.251 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:17.252 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-07-14T18:29:17.252 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "k8sevents", 2023-07-14T18:29:17.252 INFO:teuthology.orchestra.run.smithi163.stdout: "can_run": true, 2023-07-14T18:29:17.252 INFO:teuthology.orchestra.run.smithi163.stdout: "error_string": "", 2023-07-14T18:29:17.252 INFO:teuthology.orchestra.run.smithi163.stdout: "module_options": { 2023-07-14T18:29:17.253 INFO:teuthology.orchestra.run.smithi163.stdout: "ceph_event_retention_days": { 2023-07-14T18:29:17.253 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "ceph_event_retention_days", 2023-07-14T18:29:17.253 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "int", 2023-07-14T18:29:17.253 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:17.253 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:17.254 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "7", 2023-07-14T18:29:17.254 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:17.254 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:17.254 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:17.254 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "Days to hold ceph event information within local cache", 2023-07-14T18:29:17.254 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:17.255 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:17.255 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:17.255 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:17.255 INFO:teuthology.orchestra.run.smithi163.stdout: "config_check_secs": { 2023-07-14T18:29:17.255 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "config_check_secs", 2023-07-14T18:29:17.256 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "int", 2023-07-14T18:29:17.256 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:17.256 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:17.256 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "10", 2023-07-14T18:29:17.256 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "10", 2023-07-14T18:29:17.257 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:17.257 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:17.257 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2023-07-14T18:29:17.257 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:17.257 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:17.258 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:17.258 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:17.258 INFO:teuthology.orchestra.run.smithi163.stdout: "log_level": { 2023-07-14T18:29:17.258 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "log_level", 2023-07-14T18:29:17.258 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "str", 2023-07-14T18:29:17.258 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:17.259 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:17.259 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "", 2023-07-14T18:29:17.259 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:17.259 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:17.259 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [ 2023-07-14T18:29:17.260 INFO:teuthology.orchestra.run.smithi163.stdout: "", 2023-07-14T18:29:17.260 INFO:teuthology.orchestra.run.smithi163.stdout: "critical", 2023-07-14T18:29:17.260 INFO:teuthology.orchestra.run.smithi163.stdout: "debug", 2023-07-14T18:29:17.260 INFO:teuthology.orchestra.run.smithi163.stdout: "error", 2023-07-14T18:29:17.260 INFO:teuthology.orchestra.run.smithi163.stdout: "info", 2023-07-14T18:29:17.261 INFO:teuthology.orchestra.run.smithi163.stdout: "warning" 2023-07-14T18:29:17.261 INFO:teuthology.orchestra.run.smithi163.stdout: ], 2023-07-14T18:29:17.261 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:17.261 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:17.261 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:17.262 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:17.262 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:17.262 INFO:teuthology.orchestra.run.smithi163.stdout: "log_to_cluster": { 2023-07-14T18:29:17.262 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "log_to_cluster", 2023-07-14T18:29:17.262 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "bool", 2023-07-14T18:29:17.262 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:17.263 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:17.263 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "False", 2023-07-14T18:29:17.263 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:17.263 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:17.263 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:17.264 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:17.264 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:17.264 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:17.264 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:17.264 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:17.265 INFO:teuthology.orchestra.run.smithi163.stdout: "log_to_cluster_level": { 2023-07-14T18:29:17.265 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "log_to_cluster_level", 2023-07-14T18:29:17.265 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "str", 2023-07-14T18:29:17.265 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:17.265 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:17.266 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "info", 2023-07-14T18:29:17.266 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:17.266 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:17.266 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [ 2023-07-14T18:29:17.266 INFO:teuthology.orchestra.run.smithi163.stdout: "", 2023-07-14T18:29:17.267 INFO:teuthology.orchestra.run.smithi163.stdout: "critical", 2023-07-14T18:29:17.267 INFO:teuthology.orchestra.run.smithi163.stdout: "debug", 2023-07-14T18:29:17.267 INFO:teuthology.orchestra.run.smithi163.stdout: "error", 2023-07-14T18:29:17.267 INFO:teuthology.orchestra.run.smithi163.stdout: "info", 2023-07-14T18:29:17.267 INFO:teuthology.orchestra.run.smithi163.stdout: "warning" 2023-07-14T18:29:17.268 INFO:teuthology.orchestra.run.smithi163.stdout: ], 2023-07-14T18:29:17.268 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:17.268 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:17.268 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:17.268 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:17.269 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:17.269 INFO:teuthology.orchestra.run.smithi163.stdout: "log_to_file": { 2023-07-14T18:29:17.269 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "log_to_file", 2023-07-14T18:29:17.269 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "bool", 2023-07-14T18:29:17.269 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:17.270 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:17.270 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "False", 2023-07-14T18:29:17.270 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:17.270 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:17.270 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:17.271 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:17.271 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:17.271 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:17.271 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:17.271 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-07-14T18:29:17.272 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-07-14T18:29:17.272 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:17.272 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-07-14T18:29:17.272 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "localpool", 2023-07-14T18:29:17.272 INFO:teuthology.orchestra.run.smithi163.stdout: "can_run": true, 2023-07-14T18:29:17.272 INFO:teuthology.orchestra.run.smithi163.stdout: "error_string": "", 2023-07-14T18:29:17.273 INFO:teuthology.orchestra.run.smithi163.stdout: "module_options": { 2023-07-14T18:29:17.273 INFO:teuthology.orchestra.run.smithi163.stdout: "failure_domain": { 2023-07-14T18:29:17.273 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "failure_domain", 2023-07-14T18:29:17.273 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "str", 2023-07-14T18:29:17.273 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:17.274 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:17.274 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "host", 2023-07-14T18:29:17.274 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:17.274 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:17.274 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:17.275 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "failure domain for any created local pool", 2023-07-14T18:29:17.275 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2023-07-14T18:29:17.275 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:17.275 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:17.275 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:17.276 INFO:teuthology.orchestra.run.smithi163.stdout: "log_level": { 2023-07-14T18:29:17.276 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "log_level", 2023-07-14T18:29:17.276 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "str", 2023-07-14T18:29:17.276 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:17.276 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:17.277 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "", 2023-07-14T18:29:17.277 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:17.277 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:17.277 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [ 2023-07-14T18:29:17.277 INFO:teuthology.orchestra.run.smithi163.stdout: "", 2023-07-14T18:29:17.278 INFO:teuthology.orchestra.run.smithi163.stdout: "critical", 2023-07-14T18:29:17.278 INFO:teuthology.orchestra.run.smithi163.stdout: "debug", 2023-07-14T18:29:17.278 INFO:teuthology.orchestra.run.smithi163.stdout: "error", 2023-07-14T18:29:17.278 INFO:teuthology.orchestra.run.smithi163.stdout: "info", 2023-07-14T18:29:17.278 INFO:teuthology.orchestra.run.smithi163.stdout: "warning" 2023-07-14T18:29:17.278 INFO:teuthology.orchestra.run.smithi163.stdout: ], 2023-07-14T18:29:17.279 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:17.279 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:17.279 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:17.279 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:17.279 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:17.280 INFO:teuthology.orchestra.run.smithi163.stdout: "log_to_cluster": { 2023-07-14T18:29:17.280 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "log_to_cluster", 2023-07-14T18:29:17.280 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "bool", 2023-07-14T18:29:17.280 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:17.280 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:17.281 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "False", 2023-07-14T18:29:17.281 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:17.281 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:17.281 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:17.281 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:17.282 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:17.282 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:17.282 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:17.282 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:17.282 INFO:teuthology.orchestra.run.smithi163.stdout: "log_to_cluster_level": { 2023-07-14T18:29:17.283 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "log_to_cluster_level", 2023-07-14T18:29:17.283 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "str", 2023-07-14T18:29:17.283 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:17.283 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:17.283 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "info", 2023-07-14T18:29:17.284 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:17.284 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:17.284 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [ 2023-07-14T18:29:17.284 INFO:teuthology.orchestra.run.smithi163.stdout: "", 2023-07-14T18:29:17.284 INFO:teuthology.orchestra.run.smithi163.stdout: "critical", 2023-07-14T18:29:17.285 INFO:teuthology.orchestra.run.smithi163.stdout: "debug", 2023-07-14T18:29:17.285 INFO:teuthology.orchestra.run.smithi163.stdout: "error", 2023-07-14T18:29:17.285 INFO:teuthology.orchestra.run.smithi163.stdout: "info", 2023-07-14T18:29:17.285 INFO:teuthology.orchestra.run.smithi163.stdout: "warning" 2023-07-14T18:29:17.285 INFO:teuthology.orchestra.run.smithi163.stdout: ], 2023-07-14T18:29:17.285 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:17.286 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:17.286 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:17.286 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:17.286 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:17.286 INFO:teuthology.orchestra.run.smithi163.stdout: "log_to_file": { 2023-07-14T18:29:17.287 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "log_to_file", 2023-07-14T18:29:17.287 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "bool", 2023-07-14T18:29:17.287 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:17.287 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:17.287 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "False", 2023-07-14T18:29:17.288 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:17.288 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:17.288 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:17.288 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:17.288 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:17.289 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:17.289 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:17.289 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:17.289 INFO:teuthology.orchestra.run.smithi163.stdout: "min_size": { 2023-07-14T18:29:17.289 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "min_size", 2023-07-14T18:29:17.289 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "int", 2023-07-14T18:29:17.290 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:17.290 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:17.290 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "", 2023-07-14T18:29:17.290 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:17.290 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:17.291 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:17.291 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "default min_size for any created local pool", 2023-07-14T18:29:17.291 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2023-07-14T18:29:17.291 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:17.291 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:17.292 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:17.292 INFO:teuthology.orchestra.run.smithi163.stdout: "num_rep": { 2023-07-14T18:29:17.292 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "num_rep", 2023-07-14T18:29:17.292 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "int", 2023-07-14T18:29:17.292 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:17.293 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:17.293 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "3", 2023-07-14T18:29:17.293 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:17.293 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:17.293 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:17.293 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "default replica count for any created local pool", 2023-07-14T18:29:17.294 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:17.294 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:17.294 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:17.294 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:17.294 INFO:teuthology.orchestra.run.smithi163.stdout: "pg_num": { 2023-07-14T18:29:17.295 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "pg_num", 2023-07-14T18:29:17.295 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "int", 2023-07-14T18:29:17.295 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:17.295 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:17.295 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "128", 2023-07-14T18:29:17.296 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:17.296 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:17.296 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:17.296 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "default pg_num for any created local pool", 2023-07-14T18:29:17.296 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:17.297 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:17.297 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:17.297 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:17.297 INFO:teuthology.orchestra.run.smithi163.stdout: "prefix": { 2023-07-14T18:29:17.297 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "prefix", 2023-07-14T18:29:17.297 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "str", 2023-07-14T18:29:17.298 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:17.298 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:17.298 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "", 2023-07-14T18:29:17.298 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:17.298 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:17.299 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:17.299 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "name prefix for any created local pool", 2023-07-14T18:29:17.299 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:17.299 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:17.299 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:17.300 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:17.300 INFO:teuthology.orchestra.run.smithi163.stdout: "subtree": { 2023-07-14T18:29:17.300 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "subtree", 2023-07-14T18:29:17.300 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "str", 2023-07-14T18:29:17.300 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:17.301 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:17.301 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "rack", 2023-07-14T18:29:17.301 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:17.301 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:17.301 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:17.302 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "CRUSH level for which to create a local pool", 2023-07-14T18:29:17.302 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2023-07-14T18:29:17.302 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:17.302 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:17.302 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-07-14T18:29:17.302 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-07-14T18:29:17.303 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:17.303 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-07-14T18:29:17.303 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "mds_autoscaler", 2023-07-14T18:29:17.303 INFO:teuthology.orchestra.run.smithi163.stdout: "can_run": true, 2023-07-14T18:29:17.303 INFO:teuthology.orchestra.run.smithi163.stdout: "error_string": "", 2023-07-14T18:29:17.304 INFO:teuthology.orchestra.run.smithi163.stdout: "module_options": { 2023-07-14T18:29:17.304 INFO:teuthology.orchestra.run.smithi163.stdout: "log_level": { 2023-07-14T18:29:17.304 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "log_level", 2023-07-14T18:29:17.304 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "str", 2023-07-14T18:29:17.304 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:17.305 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:17.305 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "", 2023-07-14T18:29:17.305 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:17.305 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:17.305 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [ 2023-07-14T18:29:17.306 INFO:teuthology.orchestra.run.smithi163.stdout: "", 2023-07-14T18:29:17.306 INFO:teuthology.orchestra.run.smithi163.stdout: "critical", 2023-07-14T18:29:17.306 INFO:teuthology.orchestra.run.smithi163.stdout: "debug", 2023-07-14T18:29:17.306 INFO:teuthology.orchestra.run.smithi163.stdout: "error", 2023-07-14T18:29:17.306 INFO:teuthology.orchestra.run.smithi163.stdout: "info", 2023-07-14T18:29:17.307 INFO:teuthology.orchestra.run.smithi163.stdout: "warning" 2023-07-14T18:29:17.307 INFO:teuthology.orchestra.run.smithi163.stdout: ], 2023-07-14T18:29:17.307 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:17.307 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:17.307 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:17.308 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:17.308 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:17.308 INFO:teuthology.orchestra.run.smithi163.stdout: "log_to_cluster": { 2023-07-14T18:29:17.308 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "log_to_cluster", 2023-07-14T18:29:17.308 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "bool", 2023-07-14T18:29:17.308 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:17.309 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:17.309 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "False", 2023-07-14T18:29:17.309 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:17.309 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:17.309 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:17.310 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:17.310 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:17.310 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:17.310 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:17.311 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:17.311 INFO:teuthology.orchestra.run.smithi163.stdout: "log_to_cluster_level": { 2023-07-14T18:29:17.311 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "log_to_cluster_level", 2023-07-14T18:29:17.311 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "str", 2023-07-14T18:29:17.311 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:17.312 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:17.312 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "info", 2023-07-14T18:29:17.312 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:17.312 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:17.312 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [ 2023-07-14T18:29:17.313 INFO:teuthology.orchestra.run.smithi163.stdout: "", 2023-07-14T18:29:17.313 INFO:teuthology.orchestra.run.smithi163.stdout: "critical", 2023-07-14T18:29:17.313 INFO:teuthology.orchestra.run.smithi163.stdout: "debug", 2023-07-14T18:29:17.313 INFO:teuthology.orchestra.run.smithi163.stdout: "error", 2023-07-14T18:29:17.313 INFO:teuthology.orchestra.run.smithi163.stdout: "info", 2023-07-14T18:29:17.314 INFO:teuthology.orchestra.run.smithi163.stdout: "warning" 2023-07-14T18:29:17.314 INFO:teuthology.orchestra.run.smithi163.stdout: ], 2023-07-14T18:29:17.314 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:17.314 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:17.314 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:17.315 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:17.315 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:17.315 INFO:teuthology.orchestra.run.smithi163.stdout: "log_to_file": { 2023-07-14T18:29:17.315 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "log_to_file", 2023-07-14T18:29:17.315 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "bool", 2023-07-14T18:29:17.316 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:17.316 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:17.316 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "False", 2023-07-14T18:29:17.316 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:17.316 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:17.317 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:17.317 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:17.317 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:17.317 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:17.317 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:17.318 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-07-14T18:29:17.318 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-07-14T18:29:17.318 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:17.318 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-07-14T18:29:17.318 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "mirroring", 2023-07-14T18:29:17.319 INFO:teuthology.orchestra.run.smithi163.stdout: "can_run": true, 2023-07-14T18:29:17.319 INFO:teuthology.orchestra.run.smithi163.stdout: "error_string": "", 2023-07-14T18:29:17.319 INFO:teuthology.orchestra.run.smithi163.stdout: "module_options": { 2023-07-14T18:29:17.319 INFO:teuthology.orchestra.run.smithi163.stdout: "log_level": { 2023-07-14T18:29:17.319 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "log_level", 2023-07-14T18:29:17.320 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "str", 2023-07-14T18:29:17.320 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:17.320 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:17.320 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "", 2023-07-14T18:29:17.320 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:17.321 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:17.321 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [ 2023-07-14T18:29:17.321 INFO:teuthology.orchestra.run.smithi163.stdout: "", 2023-07-14T18:29:17.321 INFO:teuthology.orchestra.run.smithi163.stdout: "critical", 2023-07-14T18:29:17.321 INFO:teuthology.orchestra.run.smithi163.stdout: "debug", 2023-07-14T18:29:17.322 INFO:teuthology.orchestra.run.smithi163.stdout: "error", 2023-07-14T18:29:17.322 INFO:teuthology.orchestra.run.smithi163.stdout: "info", 2023-07-14T18:29:17.322 INFO:teuthology.orchestra.run.smithi163.stdout: "warning" 2023-07-14T18:29:17.322 INFO:teuthology.orchestra.run.smithi163.stdout: ], 2023-07-14T18:29:17.322 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:17.322 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:17.323 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:17.323 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:17.323 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:17.323 INFO:teuthology.orchestra.run.smithi163.stdout: "log_to_cluster": { 2023-07-14T18:29:17.324 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "log_to_cluster", 2023-07-14T18:29:17.324 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "bool", 2023-07-14T18:29:17.324 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:17.324 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:17.324 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "False", 2023-07-14T18:29:17.324 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:17.325 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:17.325 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:17.325 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:17.325 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:17.325 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:17.326 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:17.326 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:17.326 INFO:teuthology.orchestra.run.smithi163.stdout: "log_to_cluster_level": { 2023-07-14T18:29:17.326 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "log_to_cluster_level", 2023-07-14T18:29:17.326 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "str", 2023-07-14T18:29:17.327 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:17.327 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:17.327 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "info", 2023-07-14T18:29:17.327 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:17.327 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:17.328 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [ 2023-07-14T18:29:17.328 INFO:teuthology.orchestra.run.smithi163.stdout: "", 2023-07-14T18:29:17.328 INFO:teuthology.orchestra.run.smithi163.stdout: "critical", 2023-07-14T18:29:17.328 INFO:teuthology.orchestra.run.smithi163.stdout: "debug", 2023-07-14T18:29:17.328 INFO:teuthology.orchestra.run.smithi163.stdout: "error", 2023-07-14T18:29:17.329 INFO:teuthology.orchestra.run.smithi163.stdout: "info", 2023-07-14T18:29:17.329 INFO:teuthology.orchestra.run.smithi163.stdout: "warning" 2023-07-14T18:29:17.329 INFO:teuthology.orchestra.run.smithi163.stdout: ], 2023-07-14T18:29:17.329 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:17.329 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:17.330 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:17.330 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:17.330 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:17.330 INFO:teuthology.orchestra.run.smithi163.stdout: "log_to_file": { 2023-07-14T18:29:17.330 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "log_to_file", 2023-07-14T18:29:17.330 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "bool", 2023-07-14T18:29:17.331 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:17.331 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:17.331 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "False", 2023-07-14T18:29:17.331 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:17.331 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:17.332 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:17.332 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:17.332 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:17.332 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:17.332 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:17.333 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-07-14T18:29:17.333 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-07-14T18:29:17.333 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:17.333 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-07-14T18:29:17.333 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "nfs", 2023-07-14T18:29:17.333 INFO:teuthology.orchestra.run.smithi163.stdout: "can_run": true, 2023-07-14T18:29:17.334 INFO:teuthology.orchestra.run.smithi163.stdout: "error_string": "", 2023-07-14T18:29:17.334 INFO:teuthology.orchestra.run.smithi163.stdout: "module_options": { 2023-07-14T18:29:17.334 INFO:teuthology.orchestra.run.smithi163.stdout: "log_level": { 2023-07-14T18:29:17.334 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "log_level", 2023-07-14T18:29:17.335 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "str", 2023-07-14T18:29:17.335 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:17.335 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:17.335 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "", 2023-07-14T18:29:17.335 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:17.335 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:17.336 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [ 2023-07-14T18:29:17.336 INFO:teuthology.orchestra.run.smithi163.stdout: "", 2023-07-14T18:29:17.336 INFO:teuthology.orchestra.run.smithi163.stdout: "critical", 2023-07-14T18:29:17.336 INFO:teuthology.orchestra.run.smithi163.stdout: "debug", 2023-07-14T18:29:17.336 INFO:teuthology.orchestra.run.smithi163.stdout: "error", 2023-07-14T18:29:17.337 INFO:teuthology.orchestra.run.smithi163.stdout: "info", 2023-07-14T18:29:17.337 INFO:teuthology.orchestra.run.smithi163.stdout: "warning" 2023-07-14T18:29:17.337 INFO:teuthology.orchestra.run.smithi163.stdout: ], 2023-07-14T18:29:17.337 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:17.337 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:17.338 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:17.338 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:17.338 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:17.338 INFO:teuthology.orchestra.run.smithi163.stdout: "log_to_cluster": { 2023-07-14T18:29:17.338 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "log_to_cluster", 2023-07-14T18:29:17.339 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "bool", 2023-07-14T18:29:17.339 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:17.339 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:17.339 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "False", 2023-07-14T18:29:17.339 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:17.340 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:17.340 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:17.340 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:17.340 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:17.340 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:17.341 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:17.341 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:17.341 INFO:teuthology.orchestra.run.smithi163.stdout: "log_to_cluster_level": { 2023-07-14T18:29:17.341 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "log_to_cluster_level", 2023-07-14T18:29:17.341 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "str", 2023-07-14T18:29:17.342 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:17.342 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:17.342 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "info", 2023-07-14T18:29:17.342 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:17.342 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:17.343 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [ 2023-07-14T18:29:17.343 INFO:teuthology.orchestra.run.smithi163.stdout: "", 2023-07-14T18:29:17.343 INFO:teuthology.orchestra.run.smithi163.stdout: "critical", 2023-07-14T18:29:17.343 INFO:teuthology.orchestra.run.smithi163.stdout: "debug", 2023-07-14T18:29:17.343 INFO:teuthology.orchestra.run.smithi163.stdout: "error", 2023-07-14T18:29:17.344 INFO:teuthology.orchestra.run.smithi163.stdout: "info", 2023-07-14T18:29:17.344 INFO:teuthology.orchestra.run.smithi163.stdout: "warning" 2023-07-14T18:29:17.344 INFO:teuthology.orchestra.run.smithi163.stdout: ], 2023-07-14T18:29:17.344 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:17.344 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:17.345 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:17.345 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:17.345 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:17.345 INFO:teuthology.orchestra.run.smithi163.stdout: "log_to_file": { 2023-07-14T18:29:17.345 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "log_to_file", 2023-07-14T18:29:17.346 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "bool", 2023-07-14T18:29:17.346 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:17.346 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:17.346 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "False", 2023-07-14T18:29:17.346 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:17.347 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:17.347 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:17.347 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:17.347 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:17.347 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:17.348 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:17.348 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-07-14T18:29:17.348 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-07-14T18:29:17.348 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:17.348 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-07-14T18:29:17.348 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "orchestrator", 2023-07-14T18:29:17.349 INFO:teuthology.orchestra.run.smithi163.stdout: "can_run": true, 2023-07-14T18:29:17.349 INFO:teuthology.orchestra.run.smithi163.stdout: "error_string": "", 2023-07-14T18:29:17.349 INFO:teuthology.orchestra.run.smithi163.stdout: "module_options": { 2023-07-14T18:29:17.349 INFO:teuthology.orchestra.run.smithi163.stdout: "fail_fs": { 2023-07-14T18:29:17.349 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "fail_fs", 2023-07-14T18:29:17.350 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "bool", 2023-07-14T18:29:17.350 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:17.350 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:17.350 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "False", 2023-07-14T18:29:17.350 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:17.351 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:17.351 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:17.351 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2023-07-14T18:29:17.351 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:17.351 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:17.352 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:17.352 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:17.352 INFO:teuthology.orchestra.run.smithi163.stdout: "log_level": { 2023-07-14T18:29:17.352 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "log_level", 2023-07-14T18:29:17.352 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "str", 2023-07-14T18:29:17.353 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:17.353 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:17.353 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "", 2023-07-14T18:29:17.353 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:17.353 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:17.354 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [ 2023-07-14T18:29:17.354 INFO:teuthology.orchestra.run.smithi163.stdout: "", 2023-07-14T18:29:17.354 INFO:teuthology.orchestra.run.smithi163.stdout: "critical", 2023-07-14T18:29:17.354 INFO:teuthology.orchestra.run.smithi163.stdout: "debug", 2023-07-14T18:29:17.354 INFO:teuthology.orchestra.run.smithi163.stdout: "error", 2023-07-14T18:29:17.355 INFO:teuthology.orchestra.run.smithi163.stdout: "info", 2023-07-14T18:29:17.355 INFO:teuthology.orchestra.run.smithi163.stdout: "warning" 2023-07-14T18:29:17.355 INFO:teuthology.orchestra.run.smithi163.stdout: ], 2023-07-14T18:29:17.355 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:17.355 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:17.356 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:17.356 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:17.356 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:17.356 INFO:teuthology.orchestra.run.smithi163.stdout: "log_to_cluster": { 2023-07-14T18:29:17.356 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "log_to_cluster", 2023-07-14T18:29:17.356 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "bool", 2023-07-14T18:29:17.357 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:17.357 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:17.357 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "False", 2023-07-14T18:29:17.357 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:17.357 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:17.358 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:17.358 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:17.358 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:17.358 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:17.358 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:17.359 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:17.359 INFO:teuthology.orchestra.run.smithi163.stdout: "log_to_cluster_level": { 2023-07-14T18:29:17.359 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "log_to_cluster_level", 2023-07-14T18:29:17.359 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "str", 2023-07-14T18:29:17.359 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:17.360 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:17.360 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "info", 2023-07-14T18:29:17.360 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:17.360 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:17.360 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [ 2023-07-14T18:29:17.361 INFO:teuthology.orchestra.run.smithi163.stdout: "", 2023-07-14T18:29:17.361 INFO:teuthology.orchestra.run.smithi163.stdout: "critical", 2023-07-14T18:29:17.361 INFO:teuthology.orchestra.run.smithi163.stdout: "debug", 2023-07-14T18:29:17.361 INFO:teuthology.orchestra.run.smithi163.stdout: "error", 2023-07-14T18:29:17.361 INFO:teuthology.orchestra.run.smithi163.stdout: "info", 2023-07-14T18:29:17.362 INFO:teuthology.orchestra.run.smithi163.stdout: "warning" 2023-07-14T18:29:17.362 INFO:teuthology.orchestra.run.smithi163.stdout: ], 2023-07-14T18:29:17.362 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:17.362 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:17.362 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:17.363 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:17.363 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:17.363 INFO:teuthology.orchestra.run.smithi163.stdout: "log_to_file": { 2023-07-14T18:29:17.363 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "log_to_file", 2023-07-14T18:29:17.363 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "bool", 2023-07-14T18:29:17.364 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:17.364 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:17.364 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "False", 2023-07-14T18:29:17.364 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:17.364 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:17.364 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:17.365 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:17.365 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:17.365 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:17.365 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:17.365 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:17.366 INFO:teuthology.orchestra.run.smithi163.stdout: "orchestrator": { 2023-07-14T18:29:17.366 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "orchestrator", 2023-07-14T18:29:17.366 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "str", 2023-07-14T18:29:17.366 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:17.366 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:17.367 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "", 2023-07-14T18:29:17.367 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:17.367 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:17.367 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [ 2023-07-14T18:29:17.367 INFO:teuthology.orchestra.run.smithi163.stdout: "cephadm", 2023-07-14T18:29:17.368 INFO:teuthology.orchestra.run.smithi163.stdout: "rook", 2023-07-14T18:29:17.368 INFO:teuthology.orchestra.run.smithi163.stdout: "test_orchestrator" 2023-07-14T18:29:17.368 INFO:teuthology.orchestra.run.smithi163.stdout: ], 2023-07-14T18:29:17.368 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "Orchestrator backend", 2023-07-14T18:29:17.368 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:17.369 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:17.369 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:17.369 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-07-14T18:29:17.369 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-07-14T18:29:17.369 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:17.369 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-07-14T18:29:17.370 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "osd_perf_query", 2023-07-14T18:29:17.370 INFO:teuthology.orchestra.run.smithi163.stdout: "can_run": true, 2023-07-14T18:29:17.370 INFO:teuthology.orchestra.run.smithi163.stdout: "error_string": "", 2023-07-14T18:29:17.370 INFO:teuthology.orchestra.run.smithi163.stdout: "module_options": { 2023-07-14T18:29:17.370 INFO:teuthology.orchestra.run.smithi163.stdout: "log_level": { 2023-07-14T18:29:17.371 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "log_level", 2023-07-14T18:29:17.371 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "str", 2023-07-14T18:29:17.371 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:17.371 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:17.371 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "", 2023-07-14T18:29:17.372 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:17.372 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:17.372 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [ 2023-07-14T18:29:17.372 INFO:teuthology.orchestra.run.smithi163.stdout: "", 2023-07-14T18:29:17.372 INFO:teuthology.orchestra.run.smithi163.stdout: "critical", 2023-07-14T18:29:17.373 INFO:teuthology.orchestra.run.smithi163.stdout: "debug", 2023-07-14T18:29:17.373 INFO:teuthology.orchestra.run.smithi163.stdout: "error", 2023-07-14T18:29:17.373 INFO:teuthology.orchestra.run.smithi163.stdout: "info", 2023-07-14T18:29:17.373 INFO:teuthology.orchestra.run.smithi163.stdout: "warning" 2023-07-14T18:29:17.373 INFO:teuthology.orchestra.run.smithi163.stdout: ], 2023-07-14T18:29:17.374 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:17.374 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:17.374 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:17.374 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:17.374 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:17.375 INFO:teuthology.orchestra.run.smithi163.stdout: "log_to_cluster": { 2023-07-14T18:29:17.375 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "log_to_cluster", 2023-07-14T18:29:17.375 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "bool", 2023-07-14T18:29:17.375 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:17.375 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:17.376 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "False", 2023-07-14T18:29:17.376 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:17.376 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:17.376 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:17.376 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:17.377 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:17.377 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:17.377 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:17.377 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:17.377 INFO:teuthology.orchestra.run.smithi163.stdout: "log_to_cluster_level": { 2023-07-14T18:29:17.377 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "log_to_cluster_level", 2023-07-14T18:29:17.378 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "str", 2023-07-14T18:29:17.378 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:17.378 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:17.378 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "info", 2023-07-14T18:29:17.378 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:17.379 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:17.379 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [ 2023-07-14T18:29:17.379 INFO:teuthology.orchestra.run.smithi163.stdout: "", 2023-07-14T18:29:17.379 INFO:teuthology.orchestra.run.smithi163.stdout: "critical", 2023-07-14T18:29:17.379 INFO:teuthology.orchestra.run.smithi163.stdout: "debug", 2023-07-14T18:29:17.380 INFO:teuthology.orchestra.run.smithi163.stdout: "error", 2023-07-14T18:29:17.380 INFO:teuthology.orchestra.run.smithi163.stdout: "info", 2023-07-14T18:29:17.380 INFO:teuthology.orchestra.run.smithi163.stdout: "warning" 2023-07-14T18:29:17.380 INFO:teuthology.orchestra.run.smithi163.stdout: ], 2023-07-14T18:29:17.380 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:17.381 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:17.381 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:17.381 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:17.381 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:17.382 INFO:teuthology.orchestra.run.smithi163.stdout: "log_to_file": { 2023-07-14T18:29:17.382 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "log_to_file", 2023-07-14T18:29:17.382 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "bool", 2023-07-14T18:29:17.382 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:17.382 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:17.383 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "False", 2023-07-14T18:29:17.383 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:17.383 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:17.383 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:17.383 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:17.384 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:17.384 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:17.384 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:17.384 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-07-14T18:29:17.384 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-07-14T18:29:17.384 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:17.385 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-07-14T18:29:17.385 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "osd_support", 2023-07-14T18:29:17.385 INFO:teuthology.orchestra.run.smithi163.stdout: "can_run": true, 2023-07-14T18:29:17.385 INFO:teuthology.orchestra.run.smithi163.stdout: "error_string": "", 2023-07-14T18:29:17.385 INFO:teuthology.orchestra.run.smithi163.stdout: "module_options": { 2023-07-14T18:29:17.386 INFO:teuthology.orchestra.run.smithi163.stdout: "log_level": { 2023-07-14T18:29:17.386 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "log_level", 2023-07-14T18:29:17.386 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "str", 2023-07-14T18:29:17.386 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:17.386 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:17.387 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "", 2023-07-14T18:29:17.387 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:17.387 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:17.387 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [ 2023-07-14T18:29:17.387 INFO:teuthology.orchestra.run.smithi163.stdout: "", 2023-07-14T18:29:17.388 INFO:teuthology.orchestra.run.smithi163.stdout: "critical", 2023-07-14T18:29:17.388 INFO:teuthology.orchestra.run.smithi163.stdout: "debug", 2023-07-14T18:29:17.388 INFO:teuthology.orchestra.run.smithi163.stdout: "error", 2023-07-14T18:29:17.388 INFO:teuthology.orchestra.run.smithi163.stdout: "info", 2023-07-14T18:29:17.388 INFO:teuthology.orchestra.run.smithi163.stdout: "warning" 2023-07-14T18:29:17.389 INFO:teuthology.orchestra.run.smithi163.stdout: ], 2023-07-14T18:29:17.389 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:17.389 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:17.389 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:17.389 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:17.390 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:17.390 INFO:teuthology.orchestra.run.smithi163.stdout: "log_to_cluster": { 2023-07-14T18:29:17.390 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "log_to_cluster", 2023-07-14T18:29:17.390 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "bool", 2023-07-14T18:29:17.390 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:17.391 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:17.391 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "False", 2023-07-14T18:29:17.391 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:17.391 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:17.391 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:17.392 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:17.392 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:17.392 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:17.392 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:17.392 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:17.393 INFO:teuthology.orchestra.run.smithi163.stdout: "log_to_cluster_level": { 2023-07-14T18:29:17.393 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "log_to_cluster_level", 2023-07-14T18:29:17.393 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "str", 2023-07-14T18:29:17.393 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:17.393 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:17.394 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "info", 2023-07-14T18:29:17.394 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:17.394 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:17.394 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [ 2023-07-14T18:29:17.394 INFO:teuthology.orchestra.run.smithi163.stdout: "", 2023-07-14T18:29:17.395 INFO:teuthology.orchestra.run.smithi163.stdout: "critical", 2023-07-14T18:29:17.395 INFO:teuthology.orchestra.run.smithi163.stdout: "debug", 2023-07-14T18:29:17.395 INFO:teuthology.orchestra.run.smithi163.stdout: "error", 2023-07-14T18:29:17.395 INFO:teuthology.orchestra.run.smithi163.stdout: "info", 2023-07-14T18:29:17.395 INFO:teuthology.orchestra.run.smithi163.stdout: "warning" 2023-07-14T18:29:17.396 INFO:teuthology.orchestra.run.smithi163.stdout: ], 2023-07-14T18:29:17.396 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:17.396 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:17.396 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:17.396 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:17.397 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:17.397 INFO:teuthology.orchestra.run.smithi163.stdout: "log_to_file": { 2023-07-14T18:29:17.397 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "log_to_file", 2023-07-14T18:29:17.397 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "bool", 2023-07-14T18:29:17.397 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:17.398 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:17.398 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "False", 2023-07-14T18:29:17.398 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:17.398 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:17.398 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:17.398 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:17.399 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:17.399 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:17.399 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:17.399 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-07-14T18:29:17.399 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-07-14T18:29:17.400 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:17.400 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-07-14T18:29:17.400 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "pg_autoscaler", 2023-07-14T18:29:17.400 INFO:teuthology.orchestra.run.smithi163.stdout: "can_run": true, 2023-07-14T18:29:17.400 INFO:teuthology.orchestra.run.smithi163.stdout: "error_string": "", 2023-07-14T18:29:17.401 INFO:teuthology.orchestra.run.smithi163.stdout: "module_options": { 2023-07-14T18:29:17.401 INFO:teuthology.orchestra.run.smithi163.stdout: "log_level": { 2023-07-14T18:29:17.401 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "log_level", 2023-07-14T18:29:17.401 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "str", 2023-07-14T18:29:17.401 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:17.402 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:17.402 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "", 2023-07-14T18:29:17.402 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:17.402 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:17.402 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [ 2023-07-14T18:29:17.403 INFO:teuthology.orchestra.run.smithi163.stdout: "", 2023-07-14T18:29:17.403 INFO:teuthology.orchestra.run.smithi163.stdout: "critical", 2023-07-14T18:29:17.403 INFO:teuthology.orchestra.run.smithi163.stdout: "debug", 2023-07-14T18:29:17.403 INFO:teuthology.orchestra.run.smithi163.stdout: "error", 2023-07-14T18:29:17.403 INFO:teuthology.orchestra.run.smithi163.stdout: "info", 2023-07-14T18:29:17.404 INFO:teuthology.orchestra.run.smithi163.stdout: "warning" 2023-07-14T18:29:17.404 INFO:teuthology.orchestra.run.smithi163.stdout: ], 2023-07-14T18:29:17.404 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:17.404 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:17.404 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:17.405 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:17.405 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:17.405 INFO:teuthology.orchestra.run.smithi163.stdout: "log_to_cluster": { 2023-07-14T18:29:17.405 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "log_to_cluster", 2023-07-14T18:29:17.405 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "bool", 2023-07-14T18:29:17.406 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:17.406 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:17.406 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "False", 2023-07-14T18:29:17.406 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:17.406 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:17.407 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:17.407 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:17.407 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:17.407 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:17.407 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:17.407 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:17.408 INFO:teuthology.orchestra.run.smithi163.stdout: "log_to_cluster_level": { 2023-07-14T18:29:17.408 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "log_to_cluster_level", 2023-07-14T18:29:17.408 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "str", 2023-07-14T18:29:17.408 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:17.408 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:17.409 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "info", 2023-07-14T18:29:17.409 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:17.409 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:17.409 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [ 2023-07-14T18:29:17.409 INFO:teuthology.orchestra.run.smithi163.stdout: "", 2023-07-14T18:29:17.410 INFO:teuthology.orchestra.run.smithi163.stdout: "critical", 2023-07-14T18:29:17.410 INFO:teuthology.orchestra.run.smithi163.stdout: "debug", 2023-07-14T18:29:17.410 INFO:teuthology.orchestra.run.smithi163.stdout: "error", 2023-07-14T18:29:17.410 INFO:teuthology.orchestra.run.smithi163.stdout: "info", 2023-07-14T18:29:17.410 INFO:teuthology.orchestra.run.smithi163.stdout: "warning" 2023-07-14T18:29:17.411 INFO:teuthology.orchestra.run.smithi163.stdout: ], 2023-07-14T18:29:17.411 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:17.411 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:17.411 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:17.411 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:17.412 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:17.412 INFO:teuthology.orchestra.run.smithi163.stdout: "log_to_file": { 2023-07-14T18:29:17.412 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "log_to_file", 2023-07-14T18:29:17.412 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "bool", 2023-07-14T18:29:17.412 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:17.413 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:17.413 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "False", 2023-07-14T18:29:17.413 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:17.413 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:17.413 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:17.414 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:17.414 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:17.414 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:17.414 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:17.414 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:17.415 INFO:teuthology.orchestra.run.smithi163.stdout: "noautoscale": { 2023-07-14T18:29:17.415 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "noautoscale", 2023-07-14T18:29:17.415 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "bool", 2023-07-14T18:29:17.415 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:17.415 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:17.415 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "False", 2023-07-14T18:29:17.416 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:17.416 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:17.416 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:17.416 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "global autoscale flag", 2023-07-14T18:29:17.416 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "Option to turn on/off the autoscaler for all pools", 2023-07-14T18:29:17.417 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:17.417 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:17.417 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:17.417 INFO:teuthology.orchestra.run.smithi163.stdout: "sleep_interval": { 2023-07-14T18:29:17.417 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "sleep_interval", 2023-07-14T18:29:17.418 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "secs", 2023-07-14T18:29:17.418 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:17.418 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:17.418 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "60", 2023-07-14T18:29:17.418 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:17.419 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:17.419 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:17.419 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:17.420 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:17.420 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:17.420 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:17.420 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:17.421 INFO:teuthology.orchestra.run.smithi163.stdout: "threshold": { 2023-07-14T18:29:17.421 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "threshold", 2023-07-14T18:29:17.421 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "float", 2023-07-14T18:29:17.421 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:17.422 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:17.422 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "3.0", 2023-07-14T18:29:17.422 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "1.0", 2023-07-14T18:29:17.422 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:17.422 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:17.423 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "scaling threshold", 2023-07-14T18:29:17.423 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2023-07-14T18:29:17.423 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:17.423 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:17.423 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-07-14T18:29:17.423 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-07-14T18:29:17.424 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:17.424 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-07-14T18:29:17.424 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "progress", 2023-07-14T18:29:17.424 INFO:teuthology.orchestra.run.smithi163.stdout: "can_run": true, 2023-07-14T18:29:17.424 INFO:teuthology.orchestra.run.smithi163.stdout: "error_string": "", 2023-07-14T18:29:17.425 INFO:teuthology.orchestra.run.smithi163.stdout: "module_options": { 2023-07-14T18:29:17.425 INFO:teuthology.orchestra.run.smithi163.stdout: "allow_pg_recovery_event": { 2023-07-14T18:29:17.425 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "allow_pg_recovery_event", 2023-07-14T18:29:17.425 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "bool", 2023-07-14T18:29:17.425 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:17.426 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:17.426 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "False", 2023-07-14T18:29:17.426 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:17.426 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:17.426 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:17.427 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "allow the module to show pg recovery progress", 2023-07-14T18:29:17.427 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:17.427 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:17.427 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:17.427 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:17.428 INFO:teuthology.orchestra.run.smithi163.stdout: "enabled": { 2023-07-14T18:29:17.428 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "enabled", 2023-07-14T18:29:17.428 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "bool", 2023-07-14T18:29:17.428 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:17.428 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:17.429 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "True", 2023-07-14T18:29:17.429 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:17.429 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:17.429 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:17.429 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:17.430 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:17.430 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:17.430 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:17.430 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:17.430 INFO:teuthology.orchestra.run.smithi163.stdout: "log_level": { 2023-07-14T18:29:17.431 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "log_level", 2023-07-14T18:29:17.431 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "str", 2023-07-14T18:29:17.431 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:17.431 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:17.431 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "", 2023-07-14T18:29:17.431 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:17.432 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:17.432 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [ 2023-07-14T18:29:17.432 INFO:teuthology.orchestra.run.smithi163.stdout: "", 2023-07-14T18:29:17.432 INFO:teuthology.orchestra.run.smithi163.stdout: "critical", 2023-07-14T18:29:17.432 INFO:teuthology.orchestra.run.smithi163.stdout: "debug", 2023-07-14T18:29:17.433 INFO:teuthology.orchestra.run.smithi163.stdout: "error", 2023-07-14T18:29:17.433 INFO:teuthology.orchestra.run.smithi163.stdout: "info", 2023-07-14T18:29:17.433 INFO:teuthology.orchestra.run.smithi163.stdout: "warning" 2023-07-14T18:29:17.433 INFO:teuthology.orchestra.run.smithi163.stdout: ], 2023-07-14T18:29:17.433 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:17.434 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:17.434 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:17.434 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:17.434 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:17.434 INFO:teuthology.orchestra.run.smithi163.stdout: "log_to_cluster": { 2023-07-14T18:29:17.435 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "log_to_cluster", 2023-07-14T18:29:17.435 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "bool", 2023-07-14T18:29:17.435 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:17.435 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:17.435 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "False", 2023-07-14T18:29:17.436 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:17.436 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:17.436 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:17.436 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:17.437 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:17.437 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:17.437 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:17.437 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:17.437 INFO:teuthology.orchestra.run.smithi163.stdout: "log_to_cluster_level": { 2023-07-14T18:29:17.438 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "log_to_cluster_level", 2023-07-14T18:29:17.438 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "str", 2023-07-14T18:29:17.438 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:17.438 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:17.439 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "info", 2023-07-14T18:29:17.439 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:17.439 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:17.439 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [ 2023-07-14T18:29:17.439 INFO:teuthology.orchestra.run.smithi163.stdout: "", 2023-07-14T18:29:17.440 INFO:teuthology.orchestra.run.smithi163.stdout: "critical", 2023-07-14T18:29:17.440 INFO:teuthology.orchestra.run.smithi163.stdout: "debug", 2023-07-14T18:29:17.440 INFO:teuthology.orchestra.run.smithi163.stdout: "error", 2023-07-14T18:29:17.440 INFO:teuthology.orchestra.run.smithi163.stdout: "info", 2023-07-14T18:29:17.441 INFO:teuthology.orchestra.run.smithi163.stdout: "warning" 2023-07-14T18:29:17.441 INFO:teuthology.orchestra.run.smithi163.stdout: ], 2023-07-14T18:29:17.441 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:17.441 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:17.442 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:17.442 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:17.442 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:17.442 INFO:teuthology.orchestra.run.smithi163.stdout: "log_to_file": { 2023-07-14T18:29:17.442 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "log_to_file", 2023-07-14T18:29:17.443 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "bool", 2023-07-14T18:29:17.443 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:17.443 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:17.443 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "False", 2023-07-14T18:29:17.444 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:17.444 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:17.444 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:17.444 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:17.444 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:17.445 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:17.445 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:17.445 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:17.445 INFO:teuthology.orchestra.run.smithi163.stdout: "max_completed_events": { 2023-07-14T18:29:17.446 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "max_completed_events", 2023-07-14T18:29:17.446 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "int", 2023-07-14T18:29:17.446 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:17.446 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:17.447 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "50", 2023-07-14T18:29:17.447 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:17.447 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:17.447 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:17.447 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "number of past completed events to remember", 2023-07-14T18:29:17.448 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:17.448 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:17.448 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:17.448 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:17.448 INFO:teuthology.orchestra.run.smithi163.stdout: "sleep_interval": { 2023-07-14T18:29:17.449 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "sleep_interval", 2023-07-14T18:29:17.449 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "secs", 2023-07-14T18:29:17.449 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:17.449 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:17.449 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "5", 2023-07-14T18:29:17.450 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:17.450 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:17.450 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:17.450 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "how long the module is going to sleep", 2023-07-14T18:29:17.450 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:17.450 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:17.451 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:17.451 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-07-14T18:29:17.451 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-07-14T18:29:17.451 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:17.451 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-07-14T18:29:17.452 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "prometheus", 2023-07-14T18:29:17.452 INFO:teuthology.orchestra.run.smithi163.stdout: "can_run": true, 2023-07-14T18:29:17.452 INFO:teuthology.orchestra.run.smithi163.stdout: "error_string": "", 2023-07-14T18:29:17.452 INFO:teuthology.orchestra.run.smithi163.stdout: "module_options": { 2023-07-14T18:29:17.452 INFO:teuthology.orchestra.run.smithi163.stdout: "cache": { 2023-07-14T18:29:17.453 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "cache", 2023-07-14T18:29:17.453 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "bool", 2023-07-14T18:29:17.453 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:17.453 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:17.453 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "True", 2023-07-14T18:29:17.454 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:17.454 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:17.454 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:17.454 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:17.454 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:17.455 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:17.455 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:17.455 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:17.455 INFO:teuthology.orchestra.run.smithi163.stdout: "exclude_perf_counters": { 2023-07-14T18:29:17.455 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "exclude_perf_counters", 2023-07-14T18:29:17.456 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "bool", 2023-07-14T18:29:17.456 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:17.456 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:17.456 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "True", 2023-07-14T18:29:17.456 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:17.457 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:17.457 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:17.457 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "Do not include perf-counters in the metrics output", 2023-07-14T18:29:17.457 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2023-07-14T18:29:17.457 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:17.458 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:17.458 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:17.458 INFO:teuthology.orchestra.run.smithi163.stdout: "log_level": { 2023-07-14T18:29:17.458 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "log_level", 2023-07-14T18:29:17.458 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "str", 2023-07-14T18:29:17.459 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:17.459 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:17.459 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "", 2023-07-14T18:29:17.459 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:17.459 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:17.460 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [ 2023-07-14T18:29:17.460 INFO:teuthology.orchestra.run.smithi163.stdout: "", 2023-07-14T18:29:17.460 INFO:teuthology.orchestra.run.smithi163.stdout: "critical", 2023-07-14T18:29:17.460 INFO:teuthology.orchestra.run.smithi163.stdout: "debug", 2023-07-14T18:29:17.460 INFO:teuthology.orchestra.run.smithi163.stdout: "error", 2023-07-14T18:29:17.461 INFO:teuthology.orchestra.run.smithi163.stdout: "info", 2023-07-14T18:29:17.461 INFO:teuthology.orchestra.run.smithi163.stdout: "warning" 2023-07-14T18:29:17.461 INFO:teuthology.orchestra.run.smithi163.stdout: ], 2023-07-14T18:29:17.461 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:17.461 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:17.462 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:17.462 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:17.462 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:17.462 INFO:teuthology.orchestra.run.smithi163.stdout: "log_to_cluster": { 2023-07-14T18:29:17.462 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "log_to_cluster", 2023-07-14T18:29:17.463 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "bool", 2023-07-14T18:29:17.463 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:17.463 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:17.463 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "False", 2023-07-14T18:29:17.463 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:17.464 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:17.464 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:17.464 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:17.464 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:17.464 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:17.465 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:17.465 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:17.465 INFO:teuthology.orchestra.run.smithi163.stdout: "log_to_cluster_level": { 2023-07-14T18:29:17.465 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "log_to_cluster_level", 2023-07-14T18:29:17.465 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "str", 2023-07-14T18:29:17.466 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:17.466 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:17.466 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "info", 2023-07-14T18:29:17.466 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:17.466 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:17.467 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [ 2023-07-14T18:29:17.467 INFO:teuthology.orchestra.run.smithi163.stdout: "", 2023-07-14T18:29:17.467 INFO:teuthology.orchestra.run.smithi163.stdout: "critical", 2023-07-14T18:29:17.467 INFO:teuthology.orchestra.run.smithi163.stdout: "debug", 2023-07-14T18:29:17.467 INFO:teuthology.orchestra.run.smithi163.stdout: "error", 2023-07-14T18:29:17.468 INFO:teuthology.orchestra.run.smithi163.stdout: "info", 2023-07-14T18:29:17.468 INFO:teuthology.orchestra.run.smithi163.stdout: "warning" 2023-07-14T18:29:17.468 INFO:teuthology.orchestra.run.smithi163.stdout: ], 2023-07-14T18:29:17.468 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:17.468 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:17.469 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:17.469 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:17.469 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:17.469 INFO:teuthology.orchestra.run.smithi163.stdout: "log_to_file": { 2023-07-14T18:29:17.469 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "log_to_file", 2023-07-14T18:29:17.470 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "bool", 2023-07-14T18:29:17.470 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:17.470 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:17.470 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "False", 2023-07-14T18:29:17.470 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:17.470 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:17.471 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:17.471 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:17.471 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:17.471 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:17.471 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:17.472 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:17.472 INFO:teuthology.orchestra.run.smithi163.stdout: "rbd_stats_pools": { 2023-07-14T18:29:17.472 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "rbd_stats_pools", 2023-07-14T18:29:17.472 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "str", 2023-07-14T18:29:17.472 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:17.473 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:17.473 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "", 2023-07-14T18:29:17.473 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:17.473 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:17.473 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:17.474 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:17.474 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:17.474 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:17.474 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:17.474 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:17.475 INFO:teuthology.orchestra.run.smithi163.stdout: "rbd_stats_pools_refresh_interval": { 2023-07-14T18:29:17.475 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "rbd_stats_pools_refresh_interval", 2023-07-14T18:29:17.475 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "int", 2023-07-14T18:29:17.475 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:17.475 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:17.476 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "300", 2023-07-14T18:29:17.476 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:17.476 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:17.476 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:17.476 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:17.477 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:17.477 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:17.477 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:17.477 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:17.477 INFO:teuthology.orchestra.run.smithi163.stdout: "scrape_interval": { 2023-07-14T18:29:17.478 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "scrape_interval", 2023-07-14T18:29:17.478 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "float", 2023-07-14T18:29:17.478 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:17.478 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:17.478 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "15.0", 2023-07-14T18:29:17.479 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:17.479 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:17.479 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:17.479 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:17.480 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:17.480 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:17.480 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:17.480 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:17.480 INFO:teuthology.orchestra.run.smithi163.stdout: "server_addr": { 2023-07-14T18:29:17.481 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "server_addr", 2023-07-14T18:29:17.481 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "str", 2023-07-14T18:29:17.481 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:17.481 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:17.481 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "::", 2023-07-14T18:29:17.482 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:17.482 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:17.482 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:17.482 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2023-07-14T18:29:17.482 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:17.483 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:17.483 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:17.483 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:17.483 INFO:teuthology.orchestra.run.smithi163.stdout: "server_port": { 2023-07-14T18:29:17.483 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "server_port", 2023-07-14T18:29:17.484 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "int", 2023-07-14T18:29:17.484 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:17.484 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:17.484 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "9283", 2023-07-14T18:29:17.484 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:17.485 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:17.485 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:17.485 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "the port on which the module listens for HTTP requests", 2023-07-14T18:29:17.485 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:17.485 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:17.486 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:17.486 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:17.486 INFO:teuthology.orchestra.run.smithi163.stdout: "stale_cache_strategy": { 2023-07-14T18:29:17.486 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "stale_cache_strategy", 2023-07-14T18:29:17.486 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "str", 2023-07-14T18:29:17.487 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:17.487 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:17.487 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "log", 2023-07-14T18:29:17.487 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:17.487 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:17.488 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:17.488 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:17.488 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:17.488 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:17.488 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:17.489 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:17.489 INFO:teuthology.orchestra.run.smithi163.stdout: "standby_behaviour": { 2023-07-14T18:29:17.489 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "standby_behaviour", 2023-07-14T18:29:17.489 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "str", 2023-07-14T18:29:17.489 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:17.490 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:17.490 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "default", 2023-07-14T18:29:17.490 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:17.490 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:17.490 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [ 2023-07-14T18:29:17.491 INFO:teuthology.orchestra.run.smithi163.stdout: "default", 2023-07-14T18:29:17.491 INFO:teuthology.orchestra.run.smithi163.stdout: "error" 2023-07-14T18:29:17.491 INFO:teuthology.orchestra.run.smithi163.stdout: ], 2023-07-14T18:29:17.491 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:17.491 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:17.492 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:17.492 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:17.492 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:17.492 INFO:teuthology.orchestra.run.smithi163.stdout: "standby_error_status_code": { 2023-07-14T18:29:17.492 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "standby_error_status_code", 2023-07-14T18:29:17.493 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "int", 2023-07-14T18:29:17.493 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:17.493 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:17.493 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "500", 2023-07-14T18:29:17.493 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "400", 2023-07-14T18:29:17.493 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "599", 2023-07-14T18:29:17.494 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:17.494 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:17.494 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:17.494 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:17.495 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:17.495 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-07-14T18:29:17.495 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-07-14T18:29:17.495 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:17.495 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-07-14T18:29:17.496 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "rbd_support", 2023-07-14T18:29:17.496 INFO:teuthology.orchestra.run.smithi163.stdout: "can_run": true, 2023-07-14T18:29:17.496 INFO:teuthology.orchestra.run.smithi163.stdout: "error_string": "", 2023-07-14T18:29:17.496 INFO:teuthology.orchestra.run.smithi163.stdout: "module_options": { 2023-07-14T18:29:17.496 INFO:teuthology.orchestra.run.smithi163.stdout: "log_level": { 2023-07-14T18:29:17.497 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "log_level", 2023-07-14T18:29:17.497 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "str", 2023-07-14T18:29:17.497 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:17.497 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:17.497 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "", 2023-07-14T18:29:17.498 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:17.498 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:17.498 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [ 2023-07-14T18:29:17.498 INFO:teuthology.orchestra.run.smithi163.stdout: "", 2023-07-14T18:29:17.498 INFO:teuthology.orchestra.run.smithi163.stdout: "critical", 2023-07-14T18:29:17.499 INFO:teuthology.orchestra.run.smithi163.stdout: "debug", 2023-07-14T18:29:17.499 INFO:teuthology.orchestra.run.smithi163.stdout: "error", 2023-07-14T18:29:17.499 INFO:teuthology.orchestra.run.smithi163.stdout: "info", 2023-07-14T18:29:17.499 INFO:teuthology.orchestra.run.smithi163.stdout: "warning" 2023-07-14T18:29:17.499 INFO:teuthology.orchestra.run.smithi163.stdout: ], 2023-07-14T18:29:17.500 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:17.500 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:17.500 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:17.500 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:17.500 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:17.501 INFO:teuthology.orchestra.run.smithi163.stdout: "log_to_cluster": { 2023-07-14T18:29:17.501 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "log_to_cluster", 2023-07-14T18:29:17.501 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "bool", 2023-07-14T18:29:17.501 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:17.501 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:17.502 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "False", 2023-07-14T18:29:17.502 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:17.502 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:17.502 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:17.502 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:17.503 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:17.503 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:17.503 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:17.503 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:17.503 INFO:teuthology.orchestra.run.smithi163.stdout: "log_to_cluster_level": { 2023-07-14T18:29:17.503 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "log_to_cluster_level", 2023-07-14T18:29:17.504 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "str", 2023-07-14T18:29:17.504 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:17.504 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:17.504 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "info", 2023-07-14T18:29:17.505 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:17.505 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:17.505 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [ 2023-07-14T18:29:17.505 INFO:teuthology.orchestra.run.smithi163.stdout: "", 2023-07-14T18:29:17.505 INFO:teuthology.orchestra.run.smithi163.stdout: "critical", 2023-07-14T18:29:17.506 INFO:teuthology.orchestra.run.smithi163.stdout: "debug", 2023-07-14T18:29:17.506 INFO:teuthology.orchestra.run.smithi163.stdout: "error", 2023-07-14T18:29:17.506 INFO:teuthology.orchestra.run.smithi163.stdout: "info", 2023-07-14T18:29:17.506 INFO:teuthology.orchestra.run.smithi163.stdout: "warning" 2023-07-14T18:29:17.506 INFO:teuthology.orchestra.run.smithi163.stdout: ], 2023-07-14T18:29:17.507 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:17.507 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:17.507 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:17.507 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:17.507 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:17.507 INFO:teuthology.orchestra.run.smithi163.stdout: "log_to_file": { 2023-07-14T18:29:17.508 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "log_to_file", 2023-07-14T18:29:17.508 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "bool", 2023-07-14T18:29:17.508 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:17.508 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:17.509 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "False", 2023-07-14T18:29:17.509 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:17.509 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:17.509 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:17.509 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:17.509 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:17.510 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:17.510 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:17.510 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:17.510 INFO:teuthology.orchestra.run.smithi163.stdout: "max_concurrent_snap_create": { 2023-07-14T18:29:17.510 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "max_concurrent_snap_create", 2023-07-14T18:29:17.511 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "int", 2023-07-14T18:29:17.511 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:17.511 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:17.511 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "10", 2023-07-14T18:29:17.511 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:17.512 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:17.512 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:17.512 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:17.512 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:17.512 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:17.513 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:17.513 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:17.513 INFO:teuthology.orchestra.run.smithi163.stdout: "mirror_snapshot_schedule": { 2023-07-14T18:29:17.513 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "mirror_snapshot_schedule", 2023-07-14T18:29:17.513 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "str", 2023-07-14T18:29:17.514 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:17.514 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:17.514 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "", 2023-07-14T18:29:17.514 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:17.514 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:17.515 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:17.515 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:17.515 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:17.515 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:17.515 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:17.516 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:17.516 INFO:teuthology.orchestra.run.smithi163.stdout: "trash_purge_schedule": { 2023-07-14T18:29:17.516 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "trash_purge_schedule", 2023-07-14T18:29:17.516 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "str", 2023-07-14T18:29:17.516 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:17.517 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:17.517 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "", 2023-07-14T18:29:17.517 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:17.517 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:17.517 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:17.518 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:17.518 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:17.518 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:17.518 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:17.518 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-07-14T18:29:17.519 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-07-14T18:29:17.519 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:17.519 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-07-14T18:29:17.519 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "restful", 2023-07-14T18:29:17.519 INFO:teuthology.orchestra.run.smithi163.stdout: "can_run": true, 2023-07-14T18:29:17.519 INFO:teuthology.orchestra.run.smithi163.stdout: "error_string": "", 2023-07-14T18:29:17.520 INFO:teuthology.orchestra.run.smithi163.stdout: "module_options": { 2023-07-14T18:29:17.520 INFO:teuthology.orchestra.run.smithi163.stdout: "enable_auth": { 2023-07-14T18:29:17.520 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "enable_auth", 2023-07-14T18:29:17.520 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "bool", 2023-07-14T18:29:17.520 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:17.521 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:17.521 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "True", 2023-07-14T18:29:17.521 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:17.521 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:17.521 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:17.522 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:17.522 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:17.522 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:17.522 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:17.522 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:17.523 INFO:teuthology.orchestra.run.smithi163.stdout: "key_file": { 2023-07-14T18:29:17.523 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "key_file", 2023-07-14T18:29:17.523 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "str", 2023-07-14T18:29:17.523 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:17.523 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:17.523 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "", 2023-07-14T18:29:17.524 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:17.524 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:17.524 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:17.524 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:17.524 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:17.525 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:17.525 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:17.525 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:17.525 INFO:teuthology.orchestra.run.smithi163.stdout: "log_level": { 2023-07-14T18:29:17.525 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "log_level", 2023-07-14T18:29:17.526 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "str", 2023-07-14T18:29:17.526 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:17.526 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:17.526 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "", 2023-07-14T18:29:17.526 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:17.527 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:17.527 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [ 2023-07-14T18:29:17.527 INFO:teuthology.orchestra.run.smithi163.stdout: "", 2023-07-14T18:29:17.527 INFO:teuthology.orchestra.run.smithi163.stdout: "critical", 2023-07-14T18:29:17.527 INFO:teuthology.orchestra.run.smithi163.stdout: "debug", 2023-07-14T18:29:17.527 INFO:teuthology.orchestra.run.smithi163.stdout: "error", 2023-07-14T18:29:17.528 INFO:teuthology.orchestra.run.smithi163.stdout: "info", 2023-07-14T18:29:17.528 INFO:teuthology.orchestra.run.smithi163.stdout: "warning" 2023-07-14T18:29:17.528 INFO:teuthology.orchestra.run.smithi163.stdout: ], 2023-07-14T18:29:17.528 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:17.528 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:17.529 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:17.529 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:17.529 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:17.529 INFO:teuthology.orchestra.run.smithi163.stdout: "log_to_cluster": { 2023-07-14T18:29:17.529 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "log_to_cluster", 2023-07-14T18:29:17.530 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "bool", 2023-07-14T18:29:17.530 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:17.530 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:17.530 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "False", 2023-07-14T18:29:17.530 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:17.531 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:17.531 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:17.531 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:17.531 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:17.531 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:17.531 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:17.532 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:17.532 INFO:teuthology.orchestra.run.smithi163.stdout: "log_to_cluster_level": { 2023-07-14T18:29:17.532 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "log_to_cluster_level", 2023-07-14T18:29:17.532 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "str", 2023-07-14T18:29:17.532 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:17.533 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:17.533 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "info", 2023-07-14T18:29:17.533 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:17.534 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:17.534 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [ 2023-07-14T18:29:17.534 INFO:teuthology.orchestra.run.smithi163.stdout: "", 2023-07-14T18:29:17.534 INFO:teuthology.orchestra.run.smithi163.stdout: "critical", 2023-07-14T18:29:17.534 INFO:teuthology.orchestra.run.smithi163.stdout: "debug", 2023-07-14T18:29:17.535 INFO:teuthology.orchestra.run.smithi163.stdout: "error", 2023-07-14T18:29:17.535 INFO:teuthology.orchestra.run.smithi163.stdout: "info", 2023-07-14T18:29:17.535 INFO:teuthology.orchestra.run.smithi163.stdout: "warning" 2023-07-14T18:29:17.535 INFO:teuthology.orchestra.run.smithi163.stdout: ], 2023-07-14T18:29:17.535 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:17.536 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:17.536 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:17.536 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:17.536 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:17.536 INFO:teuthology.orchestra.run.smithi163.stdout: "log_to_file": { 2023-07-14T18:29:17.537 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "log_to_file", 2023-07-14T18:29:17.537 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "bool", 2023-07-14T18:29:17.537 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:17.537 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:17.537 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "False", 2023-07-14T18:29:17.538 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:17.538 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:17.538 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:17.538 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:17.538 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:17.539 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:17.539 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:17.539 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:17.539 INFO:teuthology.orchestra.run.smithi163.stdout: "server_addr": { 2023-07-14T18:29:17.539 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "server_addr", 2023-07-14T18:29:17.540 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "str", 2023-07-14T18:29:17.540 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:17.540 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:17.540 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "", 2023-07-14T18:29:17.540 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:17.541 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:17.541 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:17.541 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:17.541 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:17.541 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:17.541 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:17.542 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:17.542 INFO:teuthology.orchestra.run.smithi163.stdout: "server_port": { 2023-07-14T18:29:17.542 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "server_port", 2023-07-14T18:29:17.542 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "str", 2023-07-14T18:29:17.542 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:17.543 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:17.543 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "", 2023-07-14T18:29:17.543 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:17.543 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:17.543 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:17.544 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:17.544 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:17.544 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:17.544 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:17.544 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-07-14T18:29:17.545 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-07-14T18:29:17.545 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:17.545 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-07-14T18:29:17.545 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "rgw", 2023-07-14T18:29:17.545 INFO:teuthology.orchestra.run.smithi163.stdout: "can_run": true, 2023-07-14T18:29:17.546 INFO:teuthology.orchestra.run.smithi163.stdout: "error_string": "", 2023-07-14T18:29:17.546 INFO:teuthology.orchestra.run.smithi163.stdout: "module_options": { 2023-07-14T18:29:17.546 INFO:teuthology.orchestra.run.smithi163.stdout: "log_level": { 2023-07-14T18:29:17.546 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "log_level", 2023-07-14T18:29:17.546 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "str", 2023-07-14T18:29:17.547 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:17.547 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:17.547 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "", 2023-07-14T18:29:17.547 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:17.547 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:17.548 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [ 2023-07-14T18:29:17.548 INFO:teuthology.orchestra.run.smithi163.stdout: "", 2023-07-14T18:29:17.548 INFO:teuthology.orchestra.run.smithi163.stdout: "critical", 2023-07-14T18:29:17.548 INFO:teuthology.orchestra.run.smithi163.stdout: "debug", 2023-07-14T18:29:17.548 INFO:teuthology.orchestra.run.smithi163.stdout: "error", 2023-07-14T18:29:17.549 INFO:teuthology.orchestra.run.smithi163.stdout: "info", 2023-07-14T18:29:17.549 INFO:teuthology.orchestra.run.smithi163.stdout: "warning" 2023-07-14T18:29:17.549 INFO:teuthology.orchestra.run.smithi163.stdout: ], 2023-07-14T18:29:17.549 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:17.549 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:17.549 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:17.550 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:17.550 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:17.550 INFO:teuthology.orchestra.run.smithi163.stdout: "log_to_cluster": { 2023-07-14T18:29:17.550 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "log_to_cluster", 2023-07-14T18:29:17.550 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "bool", 2023-07-14T18:29:17.551 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:17.551 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:17.551 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "False", 2023-07-14T18:29:17.551 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:17.551 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:17.552 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:17.552 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:17.552 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:17.552 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:17.552 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:17.553 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:17.553 INFO:teuthology.orchestra.run.smithi163.stdout: "log_to_cluster_level": { 2023-07-14T18:29:17.553 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "log_to_cluster_level", 2023-07-14T18:29:17.553 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "str", 2023-07-14T18:29:17.553 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:17.554 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:17.554 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "info", 2023-07-14T18:29:17.554 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:17.554 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:17.554 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [ 2023-07-14T18:29:17.554 INFO:teuthology.orchestra.run.smithi163.stdout: "", 2023-07-14T18:29:17.555 INFO:teuthology.orchestra.run.smithi163.stdout: "critical", 2023-07-14T18:29:17.555 INFO:teuthology.orchestra.run.smithi163.stdout: "debug", 2023-07-14T18:29:17.555 INFO:teuthology.orchestra.run.smithi163.stdout: "error", 2023-07-14T18:29:17.555 INFO:teuthology.orchestra.run.smithi163.stdout: "info", 2023-07-14T18:29:17.555 INFO:teuthology.orchestra.run.smithi163.stdout: "warning" 2023-07-14T18:29:17.556 INFO:teuthology.orchestra.run.smithi163.stdout: ], 2023-07-14T18:29:17.556 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:17.556 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:17.556 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:17.556 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:17.557 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:17.557 INFO:teuthology.orchestra.run.smithi163.stdout: "log_to_file": { 2023-07-14T18:29:17.557 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "log_to_file", 2023-07-14T18:29:17.557 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "bool", 2023-07-14T18:29:17.557 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:17.558 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:17.558 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "False", 2023-07-14T18:29:17.558 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:17.558 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:17.558 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:17.558 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:17.559 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:17.559 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:17.559 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:17.559 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-07-14T18:29:17.559 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-07-14T18:29:17.560 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:17.560 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-07-14T18:29:17.560 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "rook", 2023-07-14T18:29:17.560 INFO:teuthology.orchestra.run.smithi163.stdout: "can_run": true, 2023-07-14T18:29:17.560 INFO:teuthology.orchestra.run.smithi163.stdout: "error_string": "", 2023-07-14T18:29:17.561 INFO:teuthology.orchestra.run.smithi163.stdout: "module_options": { 2023-07-14T18:29:17.561 INFO:teuthology.orchestra.run.smithi163.stdout: "drive_group_interval": { 2023-07-14T18:29:17.561 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "drive_group_interval", 2023-07-14T18:29:17.561 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "float", 2023-07-14T18:29:17.561 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:17.562 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:17.562 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "300.0", 2023-07-14T18:29:17.562 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:17.562 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:17.562 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:17.562 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "interval in seconds between re-application of applied drive_groups", 2023-07-14T18:29:17.563 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:17.563 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:17.563 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:17.563 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:17.563 INFO:teuthology.orchestra.run.smithi163.stdout: "log_level": { 2023-07-14T18:29:17.564 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "log_level", 2023-07-14T18:29:17.564 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "str", 2023-07-14T18:29:17.564 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:17.564 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:17.564 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "", 2023-07-14T18:29:17.565 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:17.565 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:17.565 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [ 2023-07-14T18:29:17.565 INFO:teuthology.orchestra.run.smithi163.stdout: "", 2023-07-14T18:29:17.565 INFO:teuthology.orchestra.run.smithi163.stdout: "critical", 2023-07-14T18:29:17.566 INFO:teuthology.orchestra.run.smithi163.stdout: "debug", 2023-07-14T18:29:17.566 INFO:teuthology.orchestra.run.smithi163.stdout: "error", 2023-07-14T18:29:17.566 INFO:teuthology.orchestra.run.smithi163.stdout: "info", 2023-07-14T18:29:17.566 INFO:teuthology.orchestra.run.smithi163.stdout: "warning" 2023-07-14T18:29:17.566 INFO:teuthology.orchestra.run.smithi163.stdout: ], 2023-07-14T18:29:17.566 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:17.567 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:17.567 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:17.567 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:17.567 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:17.567 INFO:teuthology.orchestra.run.smithi163.stdout: "log_to_cluster": { 2023-07-14T18:29:17.568 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "log_to_cluster", 2023-07-14T18:29:17.568 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "bool", 2023-07-14T18:29:17.568 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:17.568 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:17.568 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "False", 2023-07-14T18:29:17.569 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:17.569 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:17.569 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:17.569 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:17.569 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:17.570 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:17.570 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:17.570 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:17.570 INFO:teuthology.orchestra.run.smithi163.stdout: "log_to_cluster_level": { 2023-07-14T18:29:17.570 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "log_to_cluster_level", 2023-07-14T18:29:17.571 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "str", 2023-07-14T18:29:17.571 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:17.571 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:17.571 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "info", 2023-07-14T18:29:17.571 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:17.572 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:17.572 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [ 2023-07-14T18:29:17.572 INFO:teuthology.orchestra.run.smithi163.stdout: "", 2023-07-14T18:29:17.572 INFO:teuthology.orchestra.run.smithi163.stdout: "critical", 2023-07-14T18:29:17.573 INFO:teuthology.orchestra.run.smithi163.stdout: "debug", 2023-07-14T18:29:17.573 INFO:teuthology.orchestra.run.smithi163.stdout: "error", 2023-07-14T18:29:17.573 INFO:teuthology.orchestra.run.smithi163.stdout: "info", 2023-07-14T18:29:17.573 INFO:teuthology.orchestra.run.smithi163.stdout: "warning" 2023-07-14T18:29:17.573 INFO:teuthology.orchestra.run.smithi163.stdout: ], 2023-07-14T18:29:17.574 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:17.574 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:17.574 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:17.574 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:17.574 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:17.574 INFO:teuthology.orchestra.run.smithi163.stdout: "log_to_file": { 2023-07-14T18:29:17.575 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "log_to_file", 2023-07-14T18:29:17.575 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "bool", 2023-07-14T18:29:17.575 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:17.575 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:17.575 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "False", 2023-07-14T18:29:17.576 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:17.576 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:17.576 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:17.576 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:17.576 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:17.577 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:17.577 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:17.577 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:17.577 INFO:teuthology.orchestra.run.smithi163.stdout: "storage_class": { 2023-07-14T18:29:17.577 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "storage_class", 2023-07-14T18:29:17.578 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "str", 2023-07-14T18:29:17.578 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:17.578 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:17.578 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "local", 2023-07-14T18:29:17.578 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:17.579 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:17.579 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:17.579 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "storage class name for LSO-discovered PVs", 2023-07-14T18:29:17.579 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:17.579 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:17.580 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:17.580 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-07-14T18:29:17.580 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-07-14T18:29:17.580 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:17.580 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-07-14T18:29:17.581 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "selftest", 2023-07-14T18:29:17.581 INFO:teuthology.orchestra.run.smithi163.stdout: "can_run": true, 2023-07-14T18:29:17.581 INFO:teuthology.orchestra.run.smithi163.stdout: "error_string": "", 2023-07-14T18:29:17.581 INFO:teuthology.orchestra.run.smithi163.stdout: "module_options": { 2023-07-14T18:29:17.581 INFO:teuthology.orchestra.run.smithi163.stdout: "log_level": { 2023-07-14T18:29:17.582 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "log_level", 2023-07-14T18:29:17.582 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "str", 2023-07-14T18:29:17.582 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:17.582 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:17.582 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "", 2023-07-14T18:29:17.583 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:17.583 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:17.583 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [ 2023-07-14T18:29:17.583 INFO:teuthology.orchestra.run.smithi163.stdout: "", 2023-07-14T18:29:17.583 INFO:teuthology.orchestra.run.smithi163.stdout: "critical", 2023-07-14T18:29:17.583 INFO:teuthology.orchestra.run.smithi163.stdout: "debug", 2023-07-14T18:29:17.584 INFO:teuthology.orchestra.run.smithi163.stdout: "error", 2023-07-14T18:29:17.584 INFO:teuthology.orchestra.run.smithi163.stdout: "info", 2023-07-14T18:29:17.584 INFO:teuthology.orchestra.run.smithi163.stdout: "warning" 2023-07-14T18:29:17.584 INFO:teuthology.orchestra.run.smithi163.stdout: ], 2023-07-14T18:29:17.584 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:17.585 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:17.585 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:17.585 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:17.585 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:17.585 INFO:teuthology.orchestra.run.smithi163.stdout: "log_to_cluster": { 2023-07-14T18:29:17.586 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "log_to_cluster", 2023-07-14T18:29:17.586 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "bool", 2023-07-14T18:29:17.586 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:17.586 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:17.586 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "False", 2023-07-14T18:29:17.586 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:17.587 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:17.587 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:17.587 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:17.587 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:17.587 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:17.588 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:17.588 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:17.588 INFO:teuthology.orchestra.run.smithi163.stdout: "log_to_cluster_level": { 2023-07-14T18:29:17.588 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "log_to_cluster_level", 2023-07-14T18:29:17.588 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "str", 2023-07-14T18:29:17.589 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:17.589 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:17.589 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "info", 2023-07-14T18:29:17.589 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:17.589 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:17.590 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [ 2023-07-14T18:29:17.590 INFO:teuthology.orchestra.run.smithi163.stdout: "", 2023-07-14T18:29:17.590 INFO:teuthology.orchestra.run.smithi163.stdout: "critical", 2023-07-14T18:29:17.590 INFO:teuthology.orchestra.run.smithi163.stdout: "debug", 2023-07-14T18:29:17.590 INFO:teuthology.orchestra.run.smithi163.stdout: "error", 2023-07-14T18:29:17.591 INFO:teuthology.orchestra.run.smithi163.stdout: "info", 2023-07-14T18:29:17.591 INFO:teuthology.orchestra.run.smithi163.stdout: "warning" 2023-07-14T18:29:17.591 INFO:teuthology.orchestra.run.smithi163.stdout: ], 2023-07-14T18:29:17.591 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:17.591 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:17.592 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:17.592 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:17.592 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:17.592 INFO:teuthology.orchestra.run.smithi163.stdout: "log_to_file": { 2023-07-14T18:29:17.592 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "log_to_file", 2023-07-14T18:29:17.593 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "bool", 2023-07-14T18:29:17.593 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:17.593 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:17.593 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "False", 2023-07-14T18:29:17.593 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:17.593 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:17.594 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:17.594 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:17.594 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:17.594 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:17.594 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:17.595 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:17.595 INFO:teuthology.orchestra.run.smithi163.stdout: "roption1": { 2023-07-14T18:29:17.595 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "roption1", 2023-07-14T18:29:17.595 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "str", 2023-07-14T18:29:17.595 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:17.596 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:17.596 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "", 2023-07-14T18:29:17.596 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:17.596 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:17.596 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:17.597 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:17.597 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:17.597 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:17.597 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:17.597 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:17.598 INFO:teuthology.orchestra.run.smithi163.stdout: "roption2": { 2023-07-14T18:29:17.598 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "roption2", 2023-07-14T18:29:17.598 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "str", 2023-07-14T18:29:17.598 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:17.598 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:17.598 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "xyz", 2023-07-14T18:29:17.599 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:17.599 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:17.599 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:17.599 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:17.599 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:17.600 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:17.600 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:17.600 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:17.600 INFO:teuthology.orchestra.run.smithi163.stdout: "rwoption1": { 2023-07-14T18:29:17.600 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "rwoption1", 2023-07-14T18:29:17.601 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "str", 2023-07-14T18:29:17.601 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:17.601 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:17.601 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "", 2023-07-14T18:29:17.601 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:17.602 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:17.602 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:17.602 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:17.602 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:17.602 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:17.603 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:17.603 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:17.603 INFO:teuthology.orchestra.run.smithi163.stdout: "rwoption2": { 2023-07-14T18:29:17.603 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "rwoption2", 2023-07-14T18:29:17.603 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "int", 2023-07-14T18:29:17.603 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:17.604 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:17.604 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "", 2023-07-14T18:29:17.604 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:17.604 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:17.604 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:17.605 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:17.605 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:17.605 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:17.605 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:17.605 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:17.606 INFO:teuthology.orchestra.run.smithi163.stdout: "rwoption3": { 2023-07-14T18:29:17.606 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "rwoption3", 2023-07-14T18:29:17.606 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "float", 2023-07-14T18:29:17.606 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:17.606 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:17.607 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "", 2023-07-14T18:29:17.607 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:17.607 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:17.607 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:17.607 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:17.608 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:17.608 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:17.608 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:17.608 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:17.608 INFO:teuthology.orchestra.run.smithi163.stdout: "rwoption4": { 2023-07-14T18:29:17.609 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "rwoption4", 2023-07-14T18:29:17.609 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "str", 2023-07-14T18:29:17.609 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:17.609 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:17.609 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "", 2023-07-14T18:29:17.610 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:17.610 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:17.610 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:17.610 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:17.610 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:17.611 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:17.611 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:17.611 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:17.611 INFO:teuthology.orchestra.run.smithi163.stdout: "rwoption5": { 2023-07-14T18:29:17.611 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "rwoption5", 2023-07-14T18:29:17.612 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "bool", 2023-07-14T18:29:17.612 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:17.612 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:17.612 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "", 2023-07-14T18:29:17.612 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:17.613 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:17.613 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:17.613 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:17.613 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:17.613 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:17.614 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:17.614 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:17.614 INFO:teuthology.orchestra.run.smithi163.stdout: "rwoption6": { 2023-07-14T18:29:17.614 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "rwoption6", 2023-07-14T18:29:17.614 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "bool", 2023-07-14T18:29:17.615 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:17.615 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:17.615 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "True", 2023-07-14T18:29:17.615 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:17.615 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:17.616 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:17.616 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:17.616 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:17.616 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:17.616 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:17.617 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:17.617 INFO:teuthology.orchestra.run.smithi163.stdout: "rwoption7": { 2023-07-14T18:29:17.617 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "rwoption7", 2023-07-14T18:29:17.617 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "int", 2023-07-14T18:29:17.617 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:17.618 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:17.618 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "", 2023-07-14T18:29:17.618 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "1", 2023-07-14T18:29:17.618 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "42", 2023-07-14T18:29:17.618 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:17.619 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:17.619 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:17.619 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:17.619 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:17.619 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:17.619 INFO:teuthology.orchestra.run.smithi163.stdout: "testkey": { 2023-07-14T18:29:17.620 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "testkey", 2023-07-14T18:29:17.620 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "str", 2023-07-14T18:29:17.620 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:17.620 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:17.620 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "", 2023-07-14T18:29:17.621 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:17.621 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:17.621 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:17.621 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:17.621 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:17.622 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:17.622 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:17.622 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:17.622 INFO:teuthology.orchestra.run.smithi163.stdout: "testlkey": { 2023-07-14T18:29:17.622 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "testlkey", 2023-07-14T18:29:17.623 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "str", 2023-07-14T18:29:17.623 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:17.623 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:17.623 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "", 2023-07-14T18:29:17.623 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:17.624 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:17.624 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:17.624 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:17.624 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:17.624 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:17.625 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:17.625 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:17.625 INFO:teuthology.orchestra.run.smithi163.stdout: "testnewline": { 2023-07-14T18:29:17.625 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "testnewline", 2023-07-14T18:29:17.625 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "str", 2023-07-14T18:29:17.626 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:17.626 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:17.626 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "", 2023-07-14T18:29:17.626 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:17.626 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:17.627 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:17.627 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:17.627 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:17.627 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:17.627 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:17.627 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-07-14T18:29:17.628 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-07-14T18:29:17.628 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:17.628 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-07-14T18:29:17.628 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "snap_schedule", 2023-07-14T18:29:17.628 INFO:teuthology.orchestra.run.smithi163.stdout: "can_run": true, 2023-07-14T18:29:17.629 INFO:teuthology.orchestra.run.smithi163.stdout: "error_string": "", 2023-07-14T18:29:17.629 INFO:teuthology.orchestra.run.smithi163.stdout: "module_options": { 2023-07-14T18:29:17.629 INFO:teuthology.orchestra.run.smithi163.stdout: "allow_m_granularity": { 2023-07-14T18:29:17.629 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "allow_m_granularity", 2023-07-14T18:29:17.629 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "bool", 2023-07-14T18:29:17.630 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:17.630 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:17.630 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "False", 2023-07-14T18:29:17.630 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:17.630 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:17.631 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:17.631 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "allow minute scheduled snapshots", 2023-07-14T18:29:17.631 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:17.631 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:17.631 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:17.631 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:17.632 INFO:teuthology.orchestra.run.smithi163.stdout: "dump_on_update": { 2023-07-14T18:29:17.632 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "dump_on_update", 2023-07-14T18:29:17.632 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "bool", 2023-07-14T18:29:17.632 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:17.632 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:17.633 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "False", 2023-07-14T18:29:17.633 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:17.633 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:17.633 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:17.633 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "dump database to debug log on update", 2023-07-14T18:29:17.634 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:17.634 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:17.634 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:17.634 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:17.634 INFO:teuthology.orchestra.run.smithi163.stdout: "log_level": { 2023-07-14T18:29:17.635 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "log_level", 2023-07-14T18:29:17.635 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "str", 2023-07-14T18:29:17.635 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:17.635 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:17.635 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "", 2023-07-14T18:29:17.636 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:17.636 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:17.636 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [ 2023-07-14T18:29:17.636 INFO:teuthology.orchestra.run.smithi163.stdout: "", 2023-07-14T18:29:17.636 INFO:teuthology.orchestra.run.smithi163.stdout: "critical", 2023-07-14T18:29:17.637 INFO:teuthology.orchestra.run.smithi163.stdout: "debug", 2023-07-14T18:29:17.637 INFO:teuthology.orchestra.run.smithi163.stdout: "error", 2023-07-14T18:29:17.637 INFO:teuthology.orchestra.run.smithi163.stdout: "info", 2023-07-14T18:29:17.637 INFO:teuthology.orchestra.run.smithi163.stdout: "warning" 2023-07-14T18:29:17.637 INFO:teuthology.orchestra.run.smithi163.stdout: ], 2023-07-14T18:29:17.638 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:17.638 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:17.638 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:17.638 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:17.638 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:17.638 INFO:teuthology.orchestra.run.smithi163.stdout: "log_to_cluster": { 2023-07-14T18:29:17.639 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "log_to_cluster", 2023-07-14T18:29:17.639 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "bool", 2023-07-14T18:29:17.639 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:17.639 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:17.639 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "False", 2023-07-14T18:29:17.640 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:17.640 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:17.640 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:17.640 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:17.640 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:17.641 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:17.641 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:17.641 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:17.641 INFO:teuthology.orchestra.run.smithi163.stdout: "log_to_cluster_level": { 2023-07-14T18:29:17.641 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "log_to_cluster_level", 2023-07-14T18:29:17.642 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "str", 2023-07-14T18:29:17.642 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:17.642 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:17.642 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "info", 2023-07-14T18:29:17.642 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:17.643 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:17.643 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [ 2023-07-14T18:29:17.643 INFO:teuthology.orchestra.run.smithi163.stdout: "", 2023-07-14T18:29:17.643 INFO:teuthology.orchestra.run.smithi163.stdout: "critical", 2023-07-14T18:29:17.643 INFO:teuthology.orchestra.run.smithi163.stdout: "debug", 2023-07-14T18:29:17.643 INFO:teuthology.orchestra.run.smithi163.stdout: "error", 2023-07-14T18:29:17.644 INFO:teuthology.orchestra.run.smithi163.stdout: "info", 2023-07-14T18:29:17.644 INFO:teuthology.orchestra.run.smithi163.stdout: "warning" 2023-07-14T18:29:17.644 INFO:teuthology.orchestra.run.smithi163.stdout: ], 2023-07-14T18:29:17.644 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:17.644 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:17.645 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:17.645 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:17.645 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:17.645 INFO:teuthology.orchestra.run.smithi163.stdout: "log_to_file": { 2023-07-14T18:29:17.645 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "log_to_file", 2023-07-14T18:29:17.646 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "bool", 2023-07-14T18:29:17.646 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:17.646 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:17.646 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "False", 2023-07-14T18:29:17.646 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:17.647 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:17.647 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:17.647 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:17.647 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:17.647 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:17.648 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:17.648 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-07-14T18:29:17.648 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-07-14T18:29:17.648 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:17.648 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-07-14T18:29:17.649 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "stats", 2023-07-14T18:29:17.649 INFO:teuthology.orchestra.run.smithi163.stdout: "can_run": true, 2023-07-14T18:29:17.649 INFO:teuthology.orchestra.run.smithi163.stdout: "error_string": "", 2023-07-14T18:29:17.649 INFO:teuthology.orchestra.run.smithi163.stdout: "module_options": { 2023-07-14T18:29:17.649 INFO:teuthology.orchestra.run.smithi163.stdout: "log_level": { 2023-07-14T18:29:17.650 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "log_level", 2023-07-14T18:29:17.650 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "str", 2023-07-14T18:29:17.650 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:17.650 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:17.650 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "", 2023-07-14T18:29:17.651 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:17.651 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:17.651 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [ 2023-07-14T18:29:17.651 INFO:teuthology.orchestra.run.smithi163.stdout: "", 2023-07-14T18:29:17.651 INFO:teuthology.orchestra.run.smithi163.stdout: "critical", 2023-07-14T18:29:17.651 INFO:teuthology.orchestra.run.smithi163.stdout: "debug", 2023-07-14T18:29:17.652 INFO:teuthology.orchestra.run.smithi163.stdout: "error", 2023-07-14T18:29:17.652 INFO:teuthology.orchestra.run.smithi163.stdout: "info", 2023-07-14T18:29:17.652 INFO:teuthology.orchestra.run.smithi163.stdout: "warning" 2023-07-14T18:29:17.652 INFO:teuthology.orchestra.run.smithi163.stdout: ], 2023-07-14T18:29:17.652 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:17.653 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:17.653 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:17.653 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:17.653 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:17.653 INFO:teuthology.orchestra.run.smithi163.stdout: "log_to_cluster": { 2023-07-14T18:29:17.654 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "log_to_cluster", 2023-07-14T18:29:17.654 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "bool", 2023-07-14T18:29:17.654 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:17.654 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:17.654 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "False", 2023-07-14T18:29:17.655 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:17.655 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:17.655 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:17.655 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:17.655 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:17.655 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:17.656 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:17.656 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:17.656 INFO:teuthology.orchestra.run.smithi163.stdout: "log_to_cluster_level": { 2023-07-14T18:29:17.656 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "log_to_cluster_level", 2023-07-14T18:29:17.656 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "str", 2023-07-14T18:29:17.657 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:17.657 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:17.657 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "info", 2023-07-14T18:29:17.657 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:17.657 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:17.658 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [ 2023-07-14T18:29:17.658 INFO:teuthology.orchestra.run.smithi163.stdout: "", 2023-07-14T18:29:17.658 INFO:teuthology.orchestra.run.smithi163.stdout: "critical", 2023-07-14T18:29:17.658 INFO:teuthology.orchestra.run.smithi163.stdout: "debug", 2023-07-14T18:29:17.658 INFO:teuthology.orchestra.run.smithi163.stdout: "error", 2023-07-14T18:29:17.659 INFO:teuthology.orchestra.run.smithi163.stdout: "info", 2023-07-14T18:29:17.659 INFO:teuthology.orchestra.run.smithi163.stdout: "warning" 2023-07-14T18:29:17.659 INFO:teuthology.orchestra.run.smithi163.stdout: ], 2023-07-14T18:29:17.659 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:17.659 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:17.659 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:17.660 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:17.660 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:17.660 INFO:teuthology.orchestra.run.smithi163.stdout: "log_to_file": { 2023-07-14T18:29:17.660 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "log_to_file", 2023-07-14T18:29:17.660 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "bool", 2023-07-14T18:29:17.661 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:17.661 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:17.661 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "False", 2023-07-14T18:29:17.661 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:17.661 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:17.662 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:17.662 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:17.662 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:17.662 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:17.662 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:17.663 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-07-14T18:29:17.663 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-07-14T18:29:17.663 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:17.663 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-07-14T18:29:17.663 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "status", 2023-07-14T18:29:17.664 INFO:teuthology.orchestra.run.smithi163.stdout: "can_run": true, 2023-07-14T18:29:17.664 INFO:teuthology.orchestra.run.smithi163.stdout: "error_string": "", 2023-07-14T18:29:17.664 INFO:teuthology.orchestra.run.smithi163.stdout: "module_options": { 2023-07-14T18:29:17.664 INFO:teuthology.orchestra.run.smithi163.stdout: "log_level": { 2023-07-14T18:29:17.664 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "log_level", 2023-07-14T18:29:17.665 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "str", 2023-07-14T18:29:17.665 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:17.665 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:17.665 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "", 2023-07-14T18:29:17.665 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:17.666 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:17.666 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [ 2023-07-14T18:29:17.666 INFO:teuthology.orchestra.run.smithi163.stdout: "", 2023-07-14T18:29:17.666 INFO:teuthology.orchestra.run.smithi163.stdout: "critical", 2023-07-14T18:29:17.666 INFO:teuthology.orchestra.run.smithi163.stdout: "debug", 2023-07-14T18:29:17.666 INFO:teuthology.orchestra.run.smithi163.stdout: "error", 2023-07-14T18:29:17.667 INFO:teuthology.orchestra.run.smithi163.stdout: "info", 2023-07-14T18:29:17.667 INFO:teuthology.orchestra.run.smithi163.stdout: "warning" 2023-07-14T18:29:17.667 INFO:teuthology.orchestra.run.smithi163.stdout: ], 2023-07-14T18:29:17.667 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:17.667 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:17.668 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:17.668 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:17.668 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:17.668 INFO:teuthology.orchestra.run.smithi163.stdout: "log_to_cluster": { 2023-07-14T18:29:17.668 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "log_to_cluster", 2023-07-14T18:29:17.669 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "bool", 2023-07-14T18:29:17.669 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:17.669 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:17.669 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "False", 2023-07-14T18:29:17.669 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:17.670 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:17.670 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:17.670 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:17.670 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:17.670 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:17.671 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:17.671 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:17.671 INFO:teuthology.orchestra.run.smithi163.stdout: "log_to_cluster_level": { 2023-07-14T18:29:17.671 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "log_to_cluster_level", 2023-07-14T18:29:17.671 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "str", 2023-07-14T18:29:17.671 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:17.672 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:17.672 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "info", 2023-07-14T18:29:17.672 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:17.672 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:17.672 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [ 2023-07-14T18:29:17.673 INFO:teuthology.orchestra.run.smithi163.stdout: "", 2023-07-14T18:29:17.673 INFO:teuthology.orchestra.run.smithi163.stdout: "critical", 2023-07-14T18:29:17.673 INFO:teuthology.orchestra.run.smithi163.stdout: "debug", 2023-07-14T18:29:17.673 INFO:teuthology.orchestra.run.smithi163.stdout: "error", 2023-07-14T18:29:17.673 INFO:teuthology.orchestra.run.smithi163.stdout: "info", 2023-07-14T18:29:17.674 INFO:teuthology.orchestra.run.smithi163.stdout: "warning" 2023-07-14T18:29:17.674 INFO:teuthology.orchestra.run.smithi163.stdout: ], 2023-07-14T18:29:17.674 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:17.674 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:17.674 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:17.675 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:17.675 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:17.675 INFO:teuthology.orchestra.run.smithi163.stdout: "log_to_file": { 2023-07-14T18:29:17.675 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "log_to_file", 2023-07-14T18:29:17.675 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "bool", 2023-07-14T18:29:17.676 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:17.676 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:17.676 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "False", 2023-07-14T18:29:17.676 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:17.676 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:17.677 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:17.677 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:17.677 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:17.677 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:17.677 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:17.677 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-07-14T18:29:17.678 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-07-14T18:29:17.678 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:17.678 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-07-14T18:29:17.678 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "telegraf", 2023-07-14T18:29:17.678 INFO:teuthology.orchestra.run.smithi163.stdout: "can_run": true, 2023-07-14T18:29:17.679 INFO:teuthology.orchestra.run.smithi163.stdout: "error_string": "", 2023-07-14T18:29:17.679 INFO:teuthology.orchestra.run.smithi163.stdout: "module_options": { 2023-07-14T18:29:17.679 INFO:teuthology.orchestra.run.smithi163.stdout: "address": { 2023-07-14T18:29:17.679 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "address", 2023-07-14T18:29:17.679 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "str", 2023-07-14T18:29:17.680 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:17.680 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:17.680 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2023-07-14T18:29:17.680 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:17.680 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:17.681 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:17.681 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:17.681 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:17.681 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:17.681 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:17.682 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:17.682 INFO:teuthology.orchestra.run.smithi163.stdout: "interval": { 2023-07-14T18:29:17.682 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "interval", 2023-07-14T18:29:17.682 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "secs", 2023-07-14T18:29:17.682 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:17.682 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:17.683 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "15", 2023-07-14T18:29:17.683 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:17.683 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:17.683 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:17.683 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:17.684 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:17.684 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:17.684 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:17.684 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:17.684 INFO:teuthology.orchestra.run.smithi163.stdout: "log_level": { 2023-07-14T18:29:17.685 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "log_level", 2023-07-14T18:29:17.685 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "str", 2023-07-14T18:29:17.685 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:17.685 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:17.685 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "", 2023-07-14T18:29:17.686 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:17.686 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:17.686 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [ 2023-07-14T18:29:17.686 INFO:teuthology.orchestra.run.smithi163.stdout: "", 2023-07-14T18:29:17.686 INFO:teuthology.orchestra.run.smithi163.stdout: "critical", 2023-07-14T18:29:17.687 INFO:teuthology.orchestra.run.smithi163.stdout: "debug", 2023-07-14T18:29:17.687 INFO:teuthology.orchestra.run.smithi163.stdout: "error", 2023-07-14T18:29:17.687 INFO:teuthology.orchestra.run.smithi163.stdout: "info", 2023-07-14T18:29:17.687 INFO:teuthology.orchestra.run.smithi163.stdout: "warning" 2023-07-14T18:29:17.687 INFO:teuthology.orchestra.run.smithi163.stdout: ], 2023-07-14T18:29:17.688 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:17.688 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:17.688 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:17.688 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:17.688 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:17.689 INFO:teuthology.orchestra.run.smithi163.stdout: "log_to_cluster": { 2023-07-14T18:29:17.689 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "log_to_cluster", 2023-07-14T18:29:17.689 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "bool", 2023-07-14T18:29:17.689 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:17.689 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:17.690 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "False", 2023-07-14T18:29:17.690 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:17.690 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:17.690 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:17.690 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:17.691 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:17.691 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:17.691 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:17.691 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:17.691 INFO:teuthology.orchestra.run.smithi163.stdout: "log_to_cluster_level": { 2023-07-14T18:29:17.691 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "log_to_cluster_level", 2023-07-14T18:29:17.692 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "str", 2023-07-14T18:29:17.692 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:17.692 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:17.692 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "info", 2023-07-14T18:29:17.692 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:17.693 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:17.693 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [ 2023-07-14T18:29:17.693 INFO:teuthology.orchestra.run.smithi163.stdout: "", 2023-07-14T18:29:17.693 INFO:teuthology.orchestra.run.smithi163.stdout: "critical", 2023-07-14T18:29:17.693 INFO:teuthology.orchestra.run.smithi163.stdout: "debug", 2023-07-14T18:29:17.694 INFO:teuthology.orchestra.run.smithi163.stdout: "error", 2023-07-14T18:29:17.694 INFO:teuthology.orchestra.run.smithi163.stdout: "info", 2023-07-14T18:29:17.694 INFO:teuthology.orchestra.run.smithi163.stdout: "warning" 2023-07-14T18:29:17.694 INFO:teuthology.orchestra.run.smithi163.stdout: ], 2023-07-14T18:29:17.694 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:17.695 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:17.695 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:17.695 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:17.695 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:17.695 INFO:teuthology.orchestra.run.smithi163.stdout: "log_to_file": { 2023-07-14T18:29:17.696 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "log_to_file", 2023-07-14T18:29:17.696 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "bool", 2023-07-14T18:29:17.696 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:17.696 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:17.696 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "False", 2023-07-14T18:29:17.696 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:17.697 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:17.697 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:17.697 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:17.697 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:17.697 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:17.698 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:17.698 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-07-14T18:29:17.698 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-07-14T18:29:17.698 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:17.698 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-07-14T18:29:17.699 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "telemetry", 2023-07-14T18:29:17.699 INFO:teuthology.orchestra.run.smithi163.stdout: "can_run": true, 2023-07-14T18:29:17.699 INFO:teuthology.orchestra.run.smithi163.stdout: "error_string": "", 2023-07-14T18:29:17.699 INFO:teuthology.orchestra.run.smithi163.stdout: "module_options": { 2023-07-14T18:29:17.699 INFO:teuthology.orchestra.run.smithi163.stdout: "channel_basic": { 2023-07-14T18:29:17.700 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "channel_basic", 2023-07-14T18:29:17.700 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "bool", 2023-07-14T18:29:17.700 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:17.700 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:17.700 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "True", 2023-07-14T18:29:17.701 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:17.701 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:17.701 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:17.701 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "Share basic cluster information (size, version)", 2023-07-14T18:29:17.701 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:17.701 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:17.702 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:17.702 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:17.702 INFO:teuthology.orchestra.run.smithi163.stdout: "channel_crash": { 2023-07-14T18:29:17.702 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "channel_crash", 2023-07-14T18:29:17.702 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "bool", 2023-07-14T18:29:17.703 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:17.703 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:17.703 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "True", 2023-07-14T18:29:17.703 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:17.703 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:17.704 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:17.704 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2023-07-14T18:29:17.704 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:17.704 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:17.704 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:17.705 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:17.705 INFO:teuthology.orchestra.run.smithi163.stdout: "channel_device": { 2023-07-14T18:29:17.705 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "channel_device", 2023-07-14T18:29:17.705 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "bool", 2023-07-14T18:29:17.705 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:17.706 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:17.706 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "True", 2023-07-14T18:29:17.706 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:17.706 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:17.706 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:17.707 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2023-07-14T18:29:17.707 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:17.707 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:17.707 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:17.707 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:17.708 INFO:teuthology.orchestra.run.smithi163.stdout: "channel_ident": { 2023-07-14T18:29:17.708 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "channel_ident", 2023-07-14T18:29:17.708 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "bool", 2023-07-14T18:29:17.708 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:17.708 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:17.709 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "False", 2023-07-14T18:29:17.709 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:17.709 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:17.709 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:17.709 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2023-07-14T18:29:17.710 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:17.710 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:17.710 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:17.710 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:17.710 INFO:teuthology.orchestra.run.smithi163.stdout: "channel_perf": { 2023-07-14T18:29:17.710 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "channel_perf", 2023-07-14T18:29:17.711 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "bool", 2023-07-14T18:29:17.711 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:17.711 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:17.711 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "False", 2023-07-14T18:29:17.711 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:17.712 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:17.712 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:17.712 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "Share various performance metrics of a cluster", 2023-07-14T18:29:17.712 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:17.712 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:17.713 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:17.713 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:17.713 INFO:teuthology.orchestra.run.smithi163.stdout: "contact": { 2023-07-14T18:29:17.713 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "contact", 2023-07-14T18:29:17.713 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "str", 2023-07-14T18:29:17.714 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:17.714 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:17.714 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "", 2023-07-14T18:29:17.714 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:17.714 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:17.715 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:17.715 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:17.715 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:17.715 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:17.715 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:17.716 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:17.716 INFO:teuthology.orchestra.run.smithi163.stdout: "description": { 2023-07-14T18:29:17.716 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "description", 2023-07-14T18:29:17.716 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "str", 2023-07-14T18:29:17.716 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:17.717 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:17.717 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "", 2023-07-14T18:29:17.717 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:17.717 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:17.717 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:17.718 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:17.718 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:17.718 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:17.718 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:17.718 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:17.718 INFO:teuthology.orchestra.run.smithi163.stdout: "device_url": { 2023-07-14T18:29:17.719 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "device_url", 2023-07-14T18:29:17.719 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "str", 2023-07-14T18:29:17.719 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:17.719 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:17.719 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "https://telemetry.ceph.com/device", 2023-07-14T18:29:17.720 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:17.720 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:17.720 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:17.720 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:17.720 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:17.721 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:17.721 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:17.721 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:17.721 INFO:teuthology.orchestra.run.smithi163.stdout: "enabled": { 2023-07-14T18:29:17.721 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "enabled", 2023-07-14T18:29:17.722 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "bool", 2023-07-14T18:29:17.722 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:17.722 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:17.722 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "False", 2023-07-14T18:29:17.722 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:17.723 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:17.723 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:17.723 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:17.723 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:17.723 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:17.724 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:17.724 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:17.724 INFO:teuthology.orchestra.run.smithi163.stdout: "interval": { 2023-07-14T18:29:17.724 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "interval", 2023-07-14T18:29:17.724 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "int", 2023-07-14T18:29:17.725 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:17.725 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:17.725 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "24", 2023-07-14T18:29:17.725 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "8", 2023-07-14T18:29:17.725 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:17.726 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:17.726 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:17.726 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:17.726 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:17.726 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:17.726 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:17.727 INFO:teuthology.orchestra.run.smithi163.stdout: "last_opt_revision": { 2023-07-14T18:29:17.727 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "last_opt_revision", 2023-07-14T18:29:17.727 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "int", 2023-07-14T18:29:17.727 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:17.727 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:17.728 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "1", 2023-07-14T18:29:17.728 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:17.728 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:17.728 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:17.728 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:17.729 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:17.729 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:17.729 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:17.729 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:17.729 INFO:teuthology.orchestra.run.smithi163.stdout: "leaderboard": { 2023-07-14T18:29:17.729 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "leaderboard", 2023-07-14T18:29:17.730 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "bool", 2023-07-14T18:29:17.730 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:17.730 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:17.730 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "False", 2023-07-14T18:29:17.730 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:17.731 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:17.731 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:17.731 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:17.731 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:17.731 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:17.732 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:17.732 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:17.732 INFO:teuthology.orchestra.run.smithi163.stdout: "leaderboard_description": { 2023-07-14T18:29:17.732 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "leaderboard_description", 2023-07-14T18:29:17.732 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "str", 2023-07-14T18:29:17.733 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:17.733 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:17.733 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "", 2023-07-14T18:29:17.733 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:17.733 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:17.733 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:17.734 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:17.734 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:17.734 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:17.734 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:17.734 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:17.735 INFO:teuthology.orchestra.run.smithi163.stdout: "log_level": { 2023-07-14T18:29:17.735 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "log_level", 2023-07-14T18:29:17.735 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "str", 2023-07-14T18:29:17.735 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:17.735 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:17.736 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "", 2023-07-14T18:29:17.736 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:17.736 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:17.736 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [ 2023-07-14T18:29:17.736 INFO:teuthology.orchestra.run.smithi163.stdout: "", 2023-07-14T18:29:17.737 INFO:teuthology.orchestra.run.smithi163.stdout: "critical", 2023-07-14T18:29:17.737 INFO:teuthology.orchestra.run.smithi163.stdout: "debug", 2023-07-14T18:29:17.737 INFO:teuthology.orchestra.run.smithi163.stdout: "error", 2023-07-14T18:29:17.737 INFO:teuthology.orchestra.run.smithi163.stdout: "info", 2023-07-14T18:29:17.737 INFO:teuthology.orchestra.run.smithi163.stdout: "warning" 2023-07-14T18:29:17.738 INFO:teuthology.orchestra.run.smithi163.stdout: ], 2023-07-14T18:29:17.738 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:17.738 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:17.738 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:17.738 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:17.739 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:17.739 INFO:teuthology.orchestra.run.smithi163.stdout: "log_to_cluster": { 2023-07-14T18:29:17.739 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "log_to_cluster", 2023-07-14T18:29:17.739 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "bool", 2023-07-14T18:29:17.739 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:17.740 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:17.740 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "False", 2023-07-14T18:29:17.740 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:17.740 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:17.740 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:17.741 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:17.741 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:17.741 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:17.741 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:17.741 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:17.742 INFO:teuthology.orchestra.run.smithi163.stdout: "log_to_cluster_level": { 2023-07-14T18:29:17.742 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "log_to_cluster_level", 2023-07-14T18:29:17.742 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "str", 2023-07-14T18:29:17.742 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:17.742 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:17.743 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "info", 2023-07-14T18:29:17.743 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:17.743 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:17.743 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [ 2023-07-14T18:29:17.743 INFO:teuthology.orchestra.run.smithi163.stdout: "", 2023-07-14T18:29:17.744 INFO:teuthology.orchestra.run.smithi163.stdout: "critical", 2023-07-14T18:29:17.744 INFO:teuthology.orchestra.run.smithi163.stdout: "debug", 2023-07-14T18:29:17.744 INFO:teuthology.orchestra.run.smithi163.stdout: "error", 2023-07-14T18:29:17.744 INFO:teuthology.orchestra.run.smithi163.stdout: "info", 2023-07-14T18:29:17.744 INFO:teuthology.orchestra.run.smithi163.stdout: "warning" 2023-07-14T18:29:17.745 INFO:teuthology.orchestra.run.smithi163.stdout: ], 2023-07-14T18:29:17.745 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:17.745 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:17.745 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:17.745 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:17.746 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:17.746 INFO:teuthology.orchestra.run.smithi163.stdout: "log_to_file": { 2023-07-14T18:29:17.746 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "log_to_file", 2023-07-14T18:29:17.746 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "bool", 2023-07-14T18:29:17.746 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:17.746 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:17.747 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "False", 2023-07-14T18:29:17.747 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:17.747 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:17.747 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:17.747 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:17.748 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:17.748 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:17.748 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:17.748 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:17.748 INFO:teuthology.orchestra.run.smithi163.stdout: "organization": { 2023-07-14T18:29:17.749 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "organization", 2023-07-14T18:29:17.749 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "str", 2023-07-14T18:29:17.749 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:17.749 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:17.749 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "", 2023-07-14T18:29:17.750 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:17.750 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:17.750 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:17.750 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:17.750 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:17.751 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:17.751 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:17.751 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:17.751 INFO:teuthology.orchestra.run.smithi163.stdout: "proxy": { 2023-07-14T18:29:17.751 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "proxy", 2023-07-14T18:29:17.752 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "str", 2023-07-14T18:29:17.752 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:17.752 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:17.752 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "", 2023-07-14T18:29:17.752 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:17.753 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:17.753 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:17.753 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:17.753 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:17.753 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:17.754 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:17.754 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:17.754 INFO:teuthology.orchestra.run.smithi163.stdout: "url": { 2023-07-14T18:29:17.754 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "url", 2023-07-14T18:29:17.754 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "str", 2023-07-14T18:29:17.755 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:17.755 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:17.755 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "https://telemetry.ceph.com/report", 2023-07-14T18:29:17.755 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:17.755 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:17.756 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:17.756 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:17.756 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:17.756 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:17.756 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:17.756 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-07-14T18:29:17.757 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-07-14T18:29:17.757 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:17.757 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-07-14T18:29:17.757 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "test_orchestrator", 2023-07-14T18:29:17.757 INFO:teuthology.orchestra.run.smithi163.stdout: "can_run": true, 2023-07-14T18:29:17.758 INFO:teuthology.orchestra.run.smithi163.stdout: "error_string": "", 2023-07-14T18:29:17.758 INFO:teuthology.orchestra.run.smithi163.stdout: "module_options": { 2023-07-14T18:29:17.758 INFO:teuthology.orchestra.run.smithi163.stdout: "log_level": { 2023-07-14T18:29:17.758 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "log_level", 2023-07-14T18:29:17.758 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "str", 2023-07-14T18:29:17.759 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:17.759 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:17.759 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "", 2023-07-14T18:29:17.759 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:17.759 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:17.760 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [ 2023-07-14T18:29:17.760 INFO:teuthology.orchestra.run.smithi163.stdout: "", 2023-07-14T18:29:17.760 INFO:teuthology.orchestra.run.smithi163.stdout: "critical", 2023-07-14T18:29:17.760 INFO:teuthology.orchestra.run.smithi163.stdout: "debug", 2023-07-14T18:29:17.760 INFO:teuthology.orchestra.run.smithi163.stdout: "error", 2023-07-14T18:29:17.761 INFO:teuthology.orchestra.run.smithi163.stdout: "info", 2023-07-14T18:29:17.761 INFO:teuthology.orchestra.run.smithi163.stdout: "warning" 2023-07-14T18:29:17.761 INFO:teuthology.orchestra.run.smithi163.stdout: ], 2023-07-14T18:29:17.761 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:17.761 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:17.762 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:17.762 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:17.762 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:17.762 INFO:teuthology.orchestra.run.smithi163.stdout: "log_to_cluster": { 2023-07-14T18:29:17.762 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "log_to_cluster", 2023-07-14T18:29:17.763 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "bool", 2023-07-14T18:29:17.763 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:17.763 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:17.763 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "False", 2023-07-14T18:29:17.763 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:17.764 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:17.764 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:17.764 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:17.764 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:17.764 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:17.765 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:17.765 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:17.765 INFO:teuthology.orchestra.run.smithi163.stdout: "log_to_cluster_level": { 2023-07-14T18:29:17.765 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "log_to_cluster_level", 2023-07-14T18:29:17.765 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "str", 2023-07-14T18:29:17.766 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:17.766 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:17.766 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "info", 2023-07-14T18:29:17.766 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:17.766 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:17.767 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [ 2023-07-14T18:29:17.767 INFO:teuthology.orchestra.run.smithi163.stdout: "", 2023-07-14T18:29:17.767 INFO:teuthology.orchestra.run.smithi163.stdout: "critical", 2023-07-14T18:29:17.767 INFO:teuthology.orchestra.run.smithi163.stdout: "debug", 2023-07-14T18:29:17.767 INFO:teuthology.orchestra.run.smithi163.stdout: "error", 2023-07-14T18:29:17.767 INFO:teuthology.orchestra.run.smithi163.stdout: "info", 2023-07-14T18:29:17.768 INFO:teuthology.orchestra.run.smithi163.stdout: "warning" 2023-07-14T18:29:17.768 INFO:teuthology.orchestra.run.smithi163.stdout: ], 2023-07-14T18:29:17.768 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:17.768 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:17.768 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:17.769 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:17.769 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:17.769 INFO:teuthology.orchestra.run.smithi163.stdout: "log_to_file": { 2023-07-14T18:29:17.769 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "log_to_file", 2023-07-14T18:29:17.769 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "bool", 2023-07-14T18:29:17.770 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:17.770 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:17.770 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "False", 2023-07-14T18:29:17.770 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:17.770 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:17.771 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:17.771 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:17.771 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:17.771 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:17.771 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:17.772 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-07-14T18:29:17.772 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-07-14T18:29:17.772 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:17.772 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-07-14T18:29:17.772 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "volumes", 2023-07-14T18:29:17.773 INFO:teuthology.orchestra.run.smithi163.stdout: "can_run": true, 2023-07-14T18:29:17.773 INFO:teuthology.orchestra.run.smithi163.stdout: "error_string": "", 2023-07-14T18:29:17.773 INFO:teuthology.orchestra.run.smithi163.stdout: "module_options": { 2023-07-14T18:29:17.773 INFO:teuthology.orchestra.run.smithi163.stdout: "log_level": { 2023-07-14T18:29:17.773 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "log_level", 2023-07-14T18:29:17.774 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "str", 2023-07-14T18:29:17.774 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:17.774 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:17.774 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "", 2023-07-14T18:29:17.775 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:17.775 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:17.775 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [ 2023-07-14T18:29:17.775 INFO:teuthology.orchestra.run.smithi163.stdout: "", 2023-07-14T18:29:17.775 INFO:teuthology.orchestra.run.smithi163.stdout: "critical", 2023-07-14T18:29:17.775 INFO:teuthology.orchestra.run.smithi163.stdout: "debug", 2023-07-14T18:29:17.776 INFO:teuthology.orchestra.run.smithi163.stdout: "error", 2023-07-14T18:29:17.776 INFO:teuthology.orchestra.run.smithi163.stdout: "info", 2023-07-14T18:29:17.776 INFO:teuthology.orchestra.run.smithi163.stdout: "warning" 2023-07-14T18:29:17.776 INFO:teuthology.orchestra.run.smithi163.stdout: ], 2023-07-14T18:29:17.776 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:17.777 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:17.777 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:17.777 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:17.777 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:17.777 INFO:teuthology.orchestra.run.smithi163.stdout: "log_to_cluster": { 2023-07-14T18:29:17.778 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "log_to_cluster", 2023-07-14T18:29:17.778 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "bool", 2023-07-14T18:29:17.778 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:17.778 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:17.778 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "False", 2023-07-14T18:29:17.779 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:17.779 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:17.779 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:17.779 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:17.779 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:17.780 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:17.780 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:17.780 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:17.780 INFO:teuthology.orchestra.run.smithi163.stdout: "log_to_cluster_level": { 2023-07-14T18:29:17.780 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "log_to_cluster_level", 2023-07-14T18:29:17.781 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "str", 2023-07-14T18:29:17.781 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:17.781 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:17.781 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "info", 2023-07-14T18:29:17.781 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:17.782 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:17.782 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [ 2023-07-14T18:29:17.782 INFO:teuthology.orchestra.run.smithi163.stdout: "", 2023-07-14T18:29:17.782 INFO:teuthology.orchestra.run.smithi163.stdout: "critical", 2023-07-14T18:29:17.782 INFO:teuthology.orchestra.run.smithi163.stdout: "debug", 2023-07-14T18:29:17.783 INFO:teuthology.orchestra.run.smithi163.stdout: "error", 2023-07-14T18:29:17.783 INFO:teuthology.orchestra.run.smithi163.stdout: "info", 2023-07-14T18:29:17.783 INFO:teuthology.orchestra.run.smithi163.stdout: "warning" 2023-07-14T18:29:17.783 INFO:teuthology.orchestra.run.smithi163.stdout: ], 2023-07-14T18:29:17.783 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:17.784 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:17.784 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:17.784 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:17.784 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:17.784 INFO:teuthology.orchestra.run.smithi163.stdout: "log_to_file": { 2023-07-14T18:29:17.785 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "log_to_file", 2023-07-14T18:29:17.785 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "bool", 2023-07-14T18:29:17.785 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:17.785 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:17.785 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "False", 2023-07-14T18:29:17.786 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:17.786 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:17.786 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:17.786 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:17.786 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:17.787 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:17.787 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:17.787 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:17.787 INFO:teuthology.orchestra.run.smithi163.stdout: "max_concurrent_clones": { 2023-07-14T18:29:17.787 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "max_concurrent_clones", 2023-07-14T18:29:17.788 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "int", 2023-07-14T18:29:17.788 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:17.788 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:17.788 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "4", 2023-07-14T18:29:17.788 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:17.789 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:17.789 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:17.789 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "Number of asynchronous cloner threads", 2023-07-14T18:29:17.789 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:17.789 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:17.789 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:17.790 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:17.790 INFO:teuthology.orchestra.run.smithi163.stdout: "snapshot_clone_delay": { 2023-07-14T18:29:17.790 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "snapshot_clone_delay", 2023-07-14T18:29:17.790 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "int", 2023-07-14T18:29:17.790 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:17.791 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:17.791 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "0", 2023-07-14T18:29:17.791 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:17.791 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:17.791 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:17.792 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2023-07-14T18:29:17.792 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:17.792 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:17.792 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:17.792 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-07-14T18:29:17.793 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-07-14T18:29:17.793 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:17.793 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-07-14T18:29:17.793 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "zabbix", 2023-07-14T18:29:17.793 INFO:teuthology.orchestra.run.smithi163.stdout: "can_run": true, 2023-07-14T18:29:17.794 INFO:teuthology.orchestra.run.smithi163.stdout: "error_string": "", 2023-07-14T18:29:17.794 INFO:teuthology.orchestra.run.smithi163.stdout: "module_options": { 2023-07-14T18:29:17.794 INFO:teuthology.orchestra.run.smithi163.stdout: "discovery_interval": { 2023-07-14T18:29:17.794 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "discovery_interval", 2023-07-14T18:29:17.794 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "uint", 2023-07-14T18:29:17.795 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:17.795 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:17.795 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "100", 2023-07-14T18:29:17.795 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:17.795 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:17.795 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:17.796 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:17.796 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:17.796 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:17.796 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:17.796 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:17.797 INFO:teuthology.orchestra.run.smithi163.stdout: "identifier": { 2023-07-14T18:29:17.797 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "identifier", 2023-07-14T18:29:17.797 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "str", 2023-07-14T18:29:17.797 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:17.797 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:17.798 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "", 2023-07-14T18:29:17.798 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:17.798 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:17.798 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:17.798 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:17.799 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:17.799 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:17.799 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:17.799 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:17.799 INFO:teuthology.orchestra.run.smithi163.stdout: "interval": { 2023-07-14T18:29:17.800 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "interval", 2023-07-14T18:29:17.800 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "secs", 2023-07-14T18:29:17.800 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:17.800 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:17.800 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "60", 2023-07-14T18:29:17.801 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:17.801 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:17.801 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:17.801 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:17.801 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:17.802 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:17.802 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:17.802 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:17.802 INFO:teuthology.orchestra.run.smithi163.stdout: "log_level": { 2023-07-14T18:29:17.802 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "log_level", 2023-07-14T18:29:17.803 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "str", 2023-07-14T18:29:17.803 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:17.803 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:17.803 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "", 2023-07-14T18:29:17.803 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:17.803 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:17.804 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [ 2023-07-14T18:29:17.804 INFO:teuthology.orchestra.run.smithi163.stdout: "", 2023-07-14T18:29:17.804 INFO:teuthology.orchestra.run.smithi163.stdout: "critical", 2023-07-14T18:29:17.804 INFO:teuthology.orchestra.run.smithi163.stdout: "debug", 2023-07-14T18:29:17.804 INFO:teuthology.orchestra.run.smithi163.stdout: "error", 2023-07-14T18:29:17.805 INFO:teuthology.orchestra.run.smithi163.stdout: "info", 2023-07-14T18:29:17.805 INFO:teuthology.orchestra.run.smithi163.stdout: "warning" 2023-07-14T18:29:17.805 INFO:teuthology.orchestra.run.smithi163.stdout: ], 2023-07-14T18:29:17.805 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:17.805 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:17.806 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:17.806 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:17.806 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:17.806 INFO:teuthology.orchestra.run.smithi163.stdout: "log_to_cluster": { 2023-07-14T18:29:17.806 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "log_to_cluster", 2023-07-14T18:29:17.807 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "bool", 2023-07-14T18:29:17.807 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:17.807 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:17.807 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "False", 2023-07-14T18:29:17.807 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:17.808 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:17.808 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:17.808 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:17.808 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:17.808 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:17.809 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:17.809 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:17.809 INFO:teuthology.orchestra.run.smithi163.stdout: "log_to_cluster_level": { 2023-07-14T18:29:17.809 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "log_to_cluster_level", 2023-07-14T18:29:17.809 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "str", 2023-07-14T18:29:17.810 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:17.810 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:17.810 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "info", 2023-07-14T18:29:17.810 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:17.810 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:17.811 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [ 2023-07-14T18:29:17.811 INFO:teuthology.orchestra.run.smithi163.stdout: "", 2023-07-14T18:29:17.811 INFO:teuthology.orchestra.run.smithi163.stdout: "critical", 2023-07-14T18:29:17.811 INFO:teuthology.orchestra.run.smithi163.stdout: "debug", 2023-07-14T18:29:17.811 INFO:teuthology.orchestra.run.smithi163.stdout: "error", 2023-07-14T18:29:17.812 INFO:teuthology.orchestra.run.smithi163.stdout: "info", 2023-07-14T18:29:17.812 INFO:teuthology.orchestra.run.smithi163.stdout: "warning" 2023-07-14T18:29:17.812 INFO:teuthology.orchestra.run.smithi163.stdout: ], 2023-07-14T18:29:17.812 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:17.812 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:17.813 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:17.813 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:17.813 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:17.813 INFO:teuthology.orchestra.run.smithi163.stdout: "log_to_file": { 2023-07-14T18:29:17.813 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "log_to_file", 2023-07-14T18:29:17.813 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "bool", 2023-07-14T18:29:17.814 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:17.814 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:17.814 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "False", 2023-07-14T18:29:17.814 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:17.814 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:17.815 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:17.815 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:17.815 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:17.815 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:17.815 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:17.816 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:17.816 INFO:teuthology.orchestra.run.smithi163.stdout: "zabbix_host": { 2023-07-14T18:29:17.816 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "zabbix_host", 2023-07-14T18:29:17.816 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "str", 2023-07-14T18:29:17.816 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:17.817 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:17.817 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "", 2023-07-14T18:29:17.817 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:17.817 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:17.817 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:17.818 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:17.818 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:17.818 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:17.818 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:17.818 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:17.819 INFO:teuthology.orchestra.run.smithi163.stdout: "zabbix_port": { 2023-07-14T18:29:17.819 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "zabbix_port", 2023-07-14T18:29:17.819 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "int", 2023-07-14T18:29:17.819 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:17.819 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:17.820 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "10051", 2023-07-14T18:29:17.820 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:17.820 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:17.820 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:17.820 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:17.821 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:17.821 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:17.821 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:17.821 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:17.821 INFO:teuthology.orchestra.run.smithi163.stdout: "zabbix_sender": { 2023-07-14T18:29:17.822 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "zabbix_sender", 2023-07-14T18:29:17.822 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "str", 2023-07-14T18:29:17.822 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:17.822 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:17.822 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "/usr/bin/zabbix_sender", 2023-07-14T18:29:17.823 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:17.823 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:17.823 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:17.823 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:17.823 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:17.823 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:17.824 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:17.824 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-07-14T18:29:17.824 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-07-14T18:29:17.824 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-07-14T18:29:17.824 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-07-14T18:29:17.825 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:17.825 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-07-14T18:29:17.825 INFO:teuthology.orchestra.run.smithi163.stdout: "gid": 24113, 2023-07-14T18:29:17.825 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "y", 2023-07-14T18:29:17.825 INFO:teuthology.orchestra.run.smithi163.stdout: "mgr_features": 4540138322906710015, 2023-07-14T18:29:17.826 INFO:teuthology.orchestra.run.smithi163.stdout: "available_modules": [ 2023-07-14T18:29:17.826 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-07-14T18:29:17.826 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "alerts", 2023-07-14T18:29:17.826 INFO:teuthology.orchestra.run.smithi163.stdout: "can_run": true, 2023-07-14T18:29:17.826 INFO:teuthology.orchestra.run.smithi163.stdout: "error_string": "", 2023-07-14T18:29:17.827 INFO:teuthology.orchestra.run.smithi163.stdout: "module_options": { 2023-07-14T18:29:17.827 INFO:teuthology.orchestra.run.smithi163.stdout: "interval": { 2023-07-14T18:29:17.827 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "interval", 2023-07-14T18:29:17.827 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "secs", 2023-07-14T18:29:17.827 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:17.828 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:17.828 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "60", 2023-07-14T18:29:17.828 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:17.828 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:17.828 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:17.829 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "How frequently to reexamine health status", 2023-07-14T18:29:17.829 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:17.829 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:17.829 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:17.829 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:17.829 INFO:teuthology.orchestra.run.smithi163.stdout: "log_level": { 2023-07-14T18:29:17.830 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "log_level", 2023-07-14T18:29:17.830 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "str", 2023-07-14T18:29:17.830 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:17.830 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:17.830 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "", 2023-07-14T18:29:17.831 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:17.831 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:17.831 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [ 2023-07-14T18:29:17.831 INFO:teuthology.orchestra.run.smithi163.stdout: "", 2023-07-14T18:29:17.831 INFO:teuthology.orchestra.run.smithi163.stdout: "critical", 2023-07-14T18:29:17.832 INFO:teuthology.orchestra.run.smithi163.stdout: "debug", 2023-07-14T18:29:17.832 INFO:teuthology.orchestra.run.smithi163.stdout: "error", 2023-07-14T18:29:17.832 INFO:teuthology.orchestra.run.smithi163.stdout: "info", 2023-07-14T18:29:17.832 INFO:teuthology.orchestra.run.smithi163.stdout: "warning" 2023-07-14T18:29:17.832 INFO:teuthology.orchestra.run.smithi163.stdout: ], 2023-07-14T18:29:17.833 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:17.833 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:17.833 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:17.833 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:17.833 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:17.834 INFO:teuthology.orchestra.run.smithi163.stdout: "log_to_cluster": { 2023-07-14T18:29:17.834 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "log_to_cluster", 2023-07-14T18:29:17.834 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "bool", 2023-07-14T18:29:17.834 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:17.834 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:17.835 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "False", 2023-07-14T18:29:17.835 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:17.835 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:17.835 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:17.835 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:17.835 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:17.836 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:17.836 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:17.836 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:17.836 INFO:teuthology.orchestra.run.smithi163.stdout: "log_to_cluster_level": { 2023-07-14T18:29:17.837 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "log_to_cluster_level", 2023-07-14T18:29:17.837 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "str", 2023-07-14T18:29:17.837 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:17.837 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:17.837 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "info", 2023-07-14T18:29:17.838 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:17.838 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:17.838 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [ 2023-07-14T18:29:17.838 INFO:teuthology.orchestra.run.smithi163.stdout: "", 2023-07-14T18:29:17.838 INFO:teuthology.orchestra.run.smithi163.stdout: "critical", 2023-07-14T18:29:17.838 INFO:teuthology.orchestra.run.smithi163.stdout: "debug", 2023-07-14T18:29:17.839 INFO:teuthology.orchestra.run.smithi163.stdout: "error", 2023-07-14T18:29:17.839 INFO:teuthology.orchestra.run.smithi163.stdout: "info", 2023-07-14T18:29:17.839 INFO:teuthology.orchestra.run.smithi163.stdout: "warning" 2023-07-14T18:29:17.839 INFO:teuthology.orchestra.run.smithi163.stdout: ], 2023-07-14T18:29:17.839 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:17.840 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:17.840 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:17.840 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:17.840 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:17.840 INFO:teuthology.orchestra.run.smithi163.stdout: "log_to_file": { 2023-07-14T18:29:17.841 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "log_to_file", 2023-07-14T18:29:17.841 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "bool", 2023-07-14T18:29:17.841 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:17.841 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:17.841 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "False", 2023-07-14T18:29:17.842 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:17.842 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:17.842 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:17.842 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:17.842 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:17.843 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:17.843 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:17.843 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:17.843 INFO:teuthology.orchestra.run.smithi163.stdout: "smtp_destination": { 2023-07-14T18:29:17.843 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "smtp_destination", 2023-07-14T18:29:17.843 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "str", 2023-07-14T18:29:17.844 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:17.844 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:17.844 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "", 2023-07-14T18:29:17.844 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:17.845 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:17.845 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:17.845 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "Email address to send alerts to", 2023-07-14T18:29:17.845 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:17.845 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:17.845 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:17.846 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:17.846 INFO:teuthology.orchestra.run.smithi163.stdout: "smtp_from_name": { 2023-07-14T18:29:17.846 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "smtp_from_name", 2023-07-14T18:29:17.846 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "str", 2023-07-14T18:29:17.846 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:17.847 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:17.847 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "Ceph", 2023-07-14T18:29:17.847 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:17.847 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:17.847 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:17.848 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "Email From: name", 2023-07-14T18:29:17.848 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:17.848 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:17.848 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:17.848 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:17.849 INFO:teuthology.orchestra.run.smithi163.stdout: "smtp_host": { 2023-07-14T18:29:17.849 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "smtp_host", 2023-07-14T18:29:17.849 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "str", 2023-07-14T18:29:17.849 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:17.849 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:17.850 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "", 2023-07-14T18:29:17.850 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:17.850 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:17.850 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:17.850 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "SMTP server", 2023-07-14T18:29:17.851 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:17.851 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:17.851 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:17.851 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:17.851 INFO:teuthology.orchestra.run.smithi163.stdout: "smtp_password": { 2023-07-14T18:29:17.852 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "smtp_password", 2023-07-14T18:29:17.852 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "str", 2023-07-14T18:29:17.852 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:17.852 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:17.852 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "", 2023-07-14T18:29:17.853 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:17.853 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:17.853 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:17.853 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "Password to authenticate with", 2023-07-14T18:29:17.853 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:17.854 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:17.854 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:17.854 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:17.854 INFO:teuthology.orchestra.run.smithi163.stdout: "smtp_port": { 2023-07-14T18:29:17.854 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "smtp_port", 2023-07-14T18:29:17.854 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "int", 2023-07-14T18:29:17.855 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:17.855 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:17.855 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "465", 2023-07-14T18:29:17.855 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:17.855 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:17.856 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:17.856 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "SMTP port", 2023-07-14T18:29:17.856 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:17.856 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:17.857 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:17.857 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:17.857 INFO:teuthology.orchestra.run.smithi163.stdout: "smtp_sender": { 2023-07-14T18:29:17.857 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "smtp_sender", 2023-07-14T18:29:17.857 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "str", 2023-07-14T18:29:17.857 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:17.858 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:17.858 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "", 2023-07-14T18:29:17.858 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:17.858 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:17.858 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:17.859 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "SMTP envelope sender", 2023-07-14T18:29:17.859 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:17.859 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:17.859 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:17.859 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:17.860 INFO:teuthology.orchestra.run.smithi163.stdout: "smtp_ssl": { 2023-07-14T18:29:17.860 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "smtp_ssl", 2023-07-14T18:29:17.860 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "bool", 2023-07-14T18:29:17.860 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:17.860 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:17.861 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "True", 2023-07-14T18:29:17.861 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:17.861 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:17.861 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:17.861 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "Use SSL to connect to SMTP server", 2023-07-14T18:29:17.862 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:17.862 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:17.862 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:17.862 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:17.862 INFO:teuthology.orchestra.run.smithi163.stdout: "smtp_user": { 2023-07-14T18:29:17.863 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "smtp_user", 2023-07-14T18:29:17.863 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "str", 2023-07-14T18:29:17.863 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:17.863 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:17.863 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "", 2023-07-14T18:29:17.864 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:17.864 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:17.864 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:17.864 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "User to authenticate as", 2023-07-14T18:29:17.864 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:17.865 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:17.865 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:17.865 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-07-14T18:29:17.865 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-07-14T18:29:17.865 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:17.866 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-07-14T18:29:17.866 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "balancer", 2023-07-14T18:29:17.866 INFO:teuthology.orchestra.run.smithi163.stdout: "can_run": true, 2023-07-14T18:29:17.866 INFO:teuthology.orchestra.run.smithi163.stdout: "error_string": "", 2023-07-14T18:29:17.866 INFO:teuthology.orchestra.run.smithi163.stdout: "module_options": { 2023-07-14T18:29:17.867 INFO:teuthology.orchestra.run.smithi163.stdout: "active": { 2023-07-14T18:29:17.867 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "active", 2023-07-14T18:29:17.867 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "bool", 2023-07-14T18:29:17.867 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:17.867 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:17.867 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "True", 2023-07-14T18:29:17.868 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:17.868 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:17.868 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:17.868 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "automatically balance PGs across cluster", 2023-07-14T18:29:17.868 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:17.869 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:17.869 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:17.869 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:17.869 INFO:teuthology.orchestra.run.smithi163.stdout: "begin_time": { 2023-07-14T18:29:17.869 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "begin_time", 2023-07-14T18:29:17.870 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "str", 2023-07-14T18:29:17.870 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:17.870 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:17.870 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "0000", 2023-07-14T18:29:17.870 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:17.871 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:17.871 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:17.871 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "beginning time of day to automatically balance", 2023-07-14T18:29:17.871 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "This is a time of day in the format HHMM.", 2023-07-14T18:29:17.871 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:17.872 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:17.872 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:17.872 INFO:teuthology.orchestra.run.smithi163.stdout: "begin_weekday": { 2023-07-14T18:29:17.872 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "begin_weekday", 2023-07-14T18:29:17.872 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "uint", 2023-07-14T18:29:17.873 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:17.873 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:17.873 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "0", 2023-07-14T18:29:17.873 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "0", 2023-07-14T18:29:17.873 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "6", 2023-07-14T18:29:17.874 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:17.874 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2023-07-14T18:29:17.874 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2023-07-14T18:29:17.874 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:17.874 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:17.875 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:17.875 INFO:teuthology.orchestra.run.smithi163.stdout: "crush_compat_max_iterations": { 2023-07-14T18:29:17.875 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "crush_compat_max_iterations", 2023-07-14T18:29:17.875 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "uint", 2023-07-14T18:29:17.875 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:17.876 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:17.876 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "25", 2023-07-14T18:29:17.876 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "1", 2023-07-14T18:29:17.876 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "250", 2023-07-14T18:29:17.876 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:17.876 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "maximum number of iterations to attempt optimization", 2023-07-14T18:29:17.877 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:17.877 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:17.877 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:17.877 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:17.877 INFO:teuthology.orchestra.run.smithi163.stdout: "crush_compat_metrics": { 2023-07-14T18:29:17.878 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "crush_compat_metrics", 2023-07-14T18:29:17.878 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "str", 2023-07-14T18:29:17.878 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:17.878 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:17.878 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "pgs,objects,bytes", 2023-07-14T18:29:17.879 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:17.879 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:17.879 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:17.879 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "metrics with which to calculate OSD utilization", 2023-07-14T18:29:17.879 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2023-07-14T18:29:17.880 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:17.880 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:17.880 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:17.880 INFO:teuthology.orchestra.run.smithi163.stdout: "crush_compat_step": { 2023-07-14T18:29:17.880 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "crush_compat_step", 2023-07-14T18:29:17.881 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "float", 2023-07-14T18:29:17.881 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:17.881 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:17.881 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "0.5", 2023-07-14T18:29:17.881 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "0.001", 2023-07-14T18:29:17.882 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "0.999", 2023-07-14T18:29:17.882 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:17.882 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "aggressiveness of optimization", 2023-07-14T18:29:17.882 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2023-07-14T18:29:17.882 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:17.883 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:17.883 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:17.883 INFO:teuthology.orchestra.run.smithi163.stdout: "end_time": { 2023-07-14T18:29:17.883 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "end_time", 2023-07-14T18:29:17.883 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "str", 2023-07-14T18:29:17.884 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:17.884 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:17.884 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "2359", 2023-07-14T18:29:17.884 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:17.884 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:17.885 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:17.885 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "ending time of day to automatically balance", 2023-07-14T18:29:17.885 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "This is a time of day in the format HHMM.", 2023-07-14T18:29:17.885 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:17.885 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:17.886 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:17.886 INFO:teuthology.orchestra.run.smithi163.stdout: "end_weekday": { 2023-07-14T18:29:17.886 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "end_weekday", 2023-07-14T18:29:17.886 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "uint", 2023-07-14T18:29:17.886 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:17.887 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:17.887 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "0", 2023-07-14T18:29:17.887 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "0", 2023-07-14T18:29:17.887 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "6", 2023-07-14T18:29:17.887 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:17.888 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2023-07-14T18:29:17.888 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2023-07-14T18:29:17.888 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:17.888 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:17.888 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:17.889 INFO:teuthology.orchestra.run.smithi163.stdout: "log_level": { 2023-07-14T18:29:17.889 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "log_level", 2023-07-14T18:29:17.889 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "str", 2023-07-14T18:29:17.889 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:17.889 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:17.890 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "", 2023-07-14T18:29:17.890 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:17.890 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:17.890 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [ 2023-07-14T18:29:17.890 INFO:teuthology.orchestra.run.smithi163.stdout: "", 2023-07-14T18:29:17.890 INFO:teuthology.orchestra.run.smithi163.stdout: "critical", 2023-07-14T18:29:17.891 INFO:teuthology.orchestra.run.smithi163.stdout: "debug", 2023-07-14T18:29:17.891 INFO:teuthology.orchestra.run.smithi163.stdout: "error", 2023-07-14T18:29:17.891 INFO:teuthology.orchestra.run.smithi163.stdout: "info", 2023-07-14T18:29:17.891 INFO:teuthology.orchestra.run.smithi163.stdout: "warning" 2023-07-14T18:29:17.891 INFO:teuthology.orchestra.run.smithi163.stdout: ], 2023-07-14T18:29:17.892 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:17.892 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:17.892 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:17.892 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:17.892 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:17.893 INFO:teuthology.orchestra.run.smithi163.stdout: "log_to_cluster": { 2023-07-14T18:29:17.893 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "log_to_cluster", 2023-07-14T18:29:17.893 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "bool", 2023-07-14T18:29:17.893 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:17.893 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:17.894 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "False", 2023-07-14T18:29:17.894 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:17.894 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:17.894 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:17.894 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:17.895 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:17.895 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:17.895 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:17.895 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:17.895 INFO:teuthology.orchestra.run.smithi163.stdout: "log_to_cluster_level": { 2023-07-14T18:29:17.896 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "log_to_cluster_level", 2023-07-14T18:29:17.896 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "str", 2023-07-14T18:29:17.896 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:17.896 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:17.896 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "info", 2023-07-14T18:29:17.897 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:17.897 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:17.897 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [ 2023-07-14T18:29:17.897 INFO:teuthology.orchestra.run.smithi163.stdout: "", 2023-07-14T18:29:17.897 INFO:teuthology.orchestra.run.smithi163.stdout: "critical", 2023-07-14T18:29:17.898 INFO:teuthology.orchestra.run.smithi163.stdout: "debug", 2023-07-14T18:29:17.898 INFO:teuthology.orchestra.run.smithi163.stdout: "error", 2023-07-14T18:29:17.898 INFO:teuthology.orchestra.run.smithi163.stdout: "info", 2023-07-14T18:29:17.898 INFO:teuthology.orchestra.run.smithi163.stdout: "warning" 2023-07-14T18:29:17.898 INFO:teuthology.orchestra.run.smithi163.stdout: ], 2023-07-14T18:29:17.898 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:17.899 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:17.899 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:17.899 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:17.899 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:17.899 INFO:teuthology.orchestra.run.smithi163.stdout: "log_to_file": { 2023-07-14T18:29:17.900 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "log_to_file", 2023-07-14T18:29:17.900 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "bool", 2023-07-14T18:29:17.900 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:17.900 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:17.900 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "False", 2023-07-14T18:29:17.901 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:17.901 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:17.901 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:17.901 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:17.901 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:17.902 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:17.902 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:17.902 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:17.902 INFO:teuthology.orchestra.run.smithi163.stdout: "min_score": { 2023-07-14T18:29:17.902 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "min_score", 2023-07-14T18:29:17.902 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "float", 2023-07-14T18:29:17.903 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:17.903 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:17.903 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "0", 2023-07-14T18:29:17.903 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:17.903 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:17.904 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:17.904 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "minimum score, below which no optimization is attempted", 2023-07-14T18:29:17.904 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:17.904 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:17.904 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:17.905 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:17.905 INFO:teuthology.orchestra.run.smithi163.stdout: "mode": { 2023-07-14T18:29:17.905 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "mode", 2023-07-14T18:29:17.905 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "str", 2023-07-14T18:29:17.905 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:17.906 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:17.906 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "upmap", 2023-07-14T18:29:17.906 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:17.906 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:17.906 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [ 2023-07-14T18:29:17.907 INFO:teuthology.orchestra.run.smithi163.stdout: "crush-compat", 2023-07-14T18:29:17.907 INFO:teuthology.orchestra.run.smithi163.stdout: "none", 2023-07-14T18:29:17.907 INFO:teuthology.orchestra.run.smithi163.stdout: "upmap" 2023-07-14T18:29:17.907 INFO:teuthology.orchestra.run.smithi163.stdout: ], 2023-07-14T18:29:17.907 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "Balancer mode", 2023-07-14T18:29:17.908 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:17.908 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:17.908 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:17.908 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:17.908 INFO:teuthology.orchestra.run.smithi163.stdout: "pool_ids": { 2023-07-14T18:29:17.909 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "pool_ids", 2023-07-14T18:29:17.909 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "str", 2023-07-14T18:29:17.909 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:17.909 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:17.909 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "", 2023-07-14T18:29:17.910 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:17.910 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:17.910 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:17.910 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "pools which the automatic balancing will be limited to", 2023-07-14T18:29:17.910 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:17.910 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:17.911 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:17.911 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:17.911 INFO:teuthology.orchestra.run.smithi163.stdout: "sleep_interval": { 2023-07-14T18:29:17.911 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "sleep_interval", 2023-07-14T18:29:17.911 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "secs", 2023-07-14T18:29:17.912 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:17.912 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:17.912 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "60", 2023-07-14T18:29:17.912 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:17.912 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:17.913 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:17.913 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "how frequently to wake up and attempt optimization", 2023-07-14T18:29:17.913 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:17.913 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:17.913 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:17.914 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:17.914 INFO:teuthology.orchestra.run.smithi163.stdout: "upmap_max_deviation": { 2023-07-14T18:29:17.914 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "upmap_max_deviation", 2023-07-14T18:29:17.914 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "int", 2023-07-14T18:29:17.914 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:17.914 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:17.915 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "5", 2023-07-14T18:29:17.915 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "1", 2023-07-14T18:29:17.915 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:17.915 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:17.915 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "deviation below which no optimization is attempted", 2023-07-14T18:29:17.916 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2023-07-14T18:29:17.916 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:17.916 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:17.916 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:17.916 INFO:teuthology.orchestra.run.smithi163.stdout: "upmap_max_optimizations": { 2023-07-14T18:29:17.917 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "upmap_max_optimizations", 2023-07-14T18:29:17.917 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "uint", 2023-07-14T18:29:17.917 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:17.917 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:17.917 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "10", 2023-07-14T18:29:17.918 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:17.918 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:17.918 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:17.918 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "maximum upmap optimizations to make per attempt", 2023-07-14T18:29:17.918 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:17.919 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:17.919 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:17.919 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-07-14T18:29:17.919 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-07-14T18:29:17.919 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:17.920 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-07-14T18:29:17.920 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "cephadm", 2023-07-14T18:29:17.920 INFO:teuthology.orchestra.run.smithi163.stdout: "can_run": true, 2023-07-14T18:29:17.920 INFO:teuthology.orchestra.run.smithi163.stdout: "error_string": "", 2023-07-14T18:29:17.920 INFO:teuthology.orchestra.run.smithi163.stdout: "module_options": { 2023-07-14T18:29:17.921 INFO:teuthology.orchestra.run.smithi163.stdout: "agent_down_multiplier": { 2023-07-14T18:29:17.921 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "agent_down_multiplier", 2023-07-14T18:29:17.921 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "float", 2023-07-14T18:29:17.921 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:17.921 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:17.921 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "3.0", 2023-07-14T18:29:17.922 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:17.922 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:17.922 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:17.922 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2023-07-14T18:29:17.922 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:17.923 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:17.923 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:17.923 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:17.923 INFO:teuthology.orchestra.run.smithi163.stdout: "agent_refresh_rate": { 2023-07-14T18:29:17.923 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "agent_refresh_rate", 2023-07-14T18:29:17.924 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "secs", 2023-07-14T18:29:17.924 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:17.924 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:17.924 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "20", 2023-07-14T18:29:17.924 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:17.924 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:17.925 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:17.925 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2023-07-14T18:29:17.925 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:17.925 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:17.925 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:17.926 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:17.926 INFO:teuthology.orchestra.run.smithi163.stdout: "agent_starting_port": { 2023-07-14T18:29:17.926 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "agent_starting_port", 2023-07-14T18:29:17.926 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "int", 2023-07-14T18:29:17.926 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:17.927 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:17.927 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "4721", 2023-07-14T18:29:17.927 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:17.927 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:17.927 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:17.928 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2023-07-14T18:29:17.928 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:17.928 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:17.928 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:17.928 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:17.929 INFO:teuthology.orchestra.run.smithi163.stdout: "alertmanager_web_password": { 2023-07-14T18:29:17.929 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "alertmanager_web_password", 2023-07-14T18:29:17.929 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "str", 2023-07-14T18:29:17.929 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:17.929 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:17.930 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "admin", 2023-07-14T18:29:17.930 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:17.930 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:17.930 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:17.930 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "Alertmanager web password", 2023-07-14T18:29:17.930 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:17.931 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:17.931 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:17.931 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:17.931 INFO:teuthology.orchestra.run.smithi163.stdout: "alertmanager_web_user": { 2023-07-14T18:29:17.931 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "alertmanager_web_user", 2023-07-14T18:29:17.932 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "str", 2023-07-14T18:29:17.932 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:17.932 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:17.932 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "admin", 2023-07-14T18:29:17.932 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:17.933 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:17.933 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:17.933 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "Alertmanager web user", 2023-07-14T18:29:17.933 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:17.933 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:17.934 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:17.934 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:17.934 INFO:teuthology.orchestra.run.smithi163.stdout: "allow_ptrace": { 2023-07-14T18:29:17.934 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "allow_ptrace", 2023-07-14T18:29:17.934 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "bool", 2023-07-14T18:29:17.935 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:17.935 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:17.935 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "False", 2023-07-14T18:29:17.935 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:17.935 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:17.936 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:17.936 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2023-07-14T18:29:17.936 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2023-07-14T18:29:17.936 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:17.936 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:17.937 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:17.937 INFO:teuthology.orchestra.run.smithi163.stdout: "autotune_interval": { 2023-07-14T18:29:17.937 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "autotune_interval", 2023-07-14T18:29:17.937 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "secs", 2023-07-14T18:29:17.937 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:17.937 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:17.938 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "600", 2023-07-14T18:29:17.938 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:17.938 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:17.938 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:17.938 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "how frequently to autotune daemon memory", 2023-07-14T18:29:17.939 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:17.939 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:17.939 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:17.939 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:17.939 INFO:teuthology.orchestra.run.smithi163.stdout: "autotune_memory_target_ratio": { 2023-07-14T18:29:17.940 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "autotune_memory_target_ratio", 2023-07-14T18:29:17.940 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "float", 2023-07-14T18:29:17.940 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:17.940 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:17.941 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "0.7", 2023-07-14T18:29:17.941 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:17.941 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:17.941 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:17.941 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2023-07-14T18:29:17.941 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:17.942 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:17.942 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:17.942 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:17.942 INFO:teuthology.orchestra.run.smithi163.stdout: "cgroups_split": { 2023-07-14T18:29:17.943 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "cgroups_split", 2023-07-14T18:29:17.943 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "bool", 2023-07-14T18:29:17.943 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:17.943 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:17.944 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "True", 2023-07-14T18:29:17.944 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:17.944 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:17.944 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:17.944 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2023-07-14T18:29:17.945 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:17.945 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:17.945 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:17.945 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:17.945 INFO:teuthology.orchestra.run.smithi163.stdout: "config_checks_enabled": { 2023-07-14T18:29:17.946 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "config_checks_enabled", 2023-07-14T18:29:17.946 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "bool", 2023-07-14T18:29:17.946 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:17.946 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:17.946 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "False", 2023-07-14T18:29:17.946 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:17.947 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:17.947 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:17.947 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2023-07-14T18:29:17.947 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:17.947 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:17.948 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:17.948 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:17.948 INFO:teuthology.orchestra.run.smithi163.stdout: "config_dashboard": { 2023-07-14T18:29:17.948 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "config_dashboard", 2023-07-14T18:29:17.948 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "bool", 2023-07-14T18:29:17.949 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:17.949 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:17.949 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "True", 2023-07-14T18:29:17.949 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:17.949 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:17.950 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:17.950 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2023-07-14T18:29:17.950 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:17.950 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:17.950 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:17.951 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:17.951 INFO:teuthology.orchestra.run.smithi163.stdout: "container_image_alertmanager": { 2023-07-14T18:29:17.951 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "container_image_alertmanager", 2023-07-14T18:29:17.951 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "str", 2023-07-14T18:29:17.951 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:17.951 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:17.952 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.25.0", 2023-07-14T18:29:17.952 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:17.952 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:17.952 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:17.952 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "Prometheus container image", 2023-07-14T18:29:17.953 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:17.953 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:17.953 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:17.953 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:17.953 INFO:teuthology.orchestra.run.smithi163.stdout: "container_image_base": { 2023-07-14T18:29:17.954 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "container_image_base", 2023-07-14T18:29:17.954 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "str", 2023-07-14T18:29:17.954 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:17.954 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:17.954 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "quay.io/ceph/ceph", 2023-07-14T18:29:17.955 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:17.955 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:17.955 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:17.955 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "Container image name, without the tag", 2023-07-14T18:29:17.955 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:17.956 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:17.956 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:17.956 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:17.956 INFO:teuthology.orchestra.run.smithi163.stdout: "container_image_elasticsearch": { 2023-07-14T18:29:17.956 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "container_image_elasticsearch", 2023-07-14T18:29:17.957 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "str", 2023-07-14T18:29:17.957 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:17.957 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:17.957 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2023-07-14T18:29:17.957 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:17.958 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:17.958 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:17.958 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "elasticsearch container image", 2023-07-14T18:29:17.958 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:17.958 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:17.959 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:17.959 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:17.959 INFO:teuthology.orchestra.run.smithi163.stdout: "container_image_grafana": { 2023-07-14T18:29:17.959 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "container_image_grafana", 2023-07-14T18:29:17.959 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "str", 2023-07-14T18:29:17.960 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:17.960 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:17.960 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "quay.io/ceph/ceph-grafana:9.4.7", 2023-07-14T18:29:17.960 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:17.960 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:17.961 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:17.961 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "Prometheus container image", 2023-07-14T18:29:17.961 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:17.961 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:17.961 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:17.961 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:17.962 INFO:teuthology.orchestra.run.smithi163.stdout: "container_image_haproxy": { 2023-07-14T18:29:17.962 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "container_image_haproxy", 2023-07-14T18:29:17.962 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "str", 2023-07-14T18:29:17.962 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:17.962 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:17.963 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2023-07-14T18:29:17.963 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:17.963 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:17.963 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:17.963 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "HAproxy container image", 2023-07-14T18:29:17.964 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:17.964 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:17.964 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:17.964 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:17.964 INFO:teuthology.orchestra.run.smithi163.stdout: "container_image_jaeger_agent": { 2023-07-14T18:29:17.965 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "container_image_jaeger_agent", 2023-07-14T18:29:17.965 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "str", 2023-07-14T18:29:17.965 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:17.965 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:17.965 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2023-07-14T18:29:17.966 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:17.966 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:17.966 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:17.966 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "Jaeger agent container image", 2023-07-14T18:29:17.966 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:17.967 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:17.967 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:17.967 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:17.967 INFO:teuthology.orchestra.run.smithi163.stdout: "container_image_jaeger_collector": { 2023-07-14T18:29:17.967 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "container_image_jaeger_collector", 2023-07-14T18:29:17.968 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "str", 2023-07-14T18:29:17.968 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:17.968 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:17.968 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2023-07-14T18:29:17.969 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:17.969 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:17.969 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:17.969 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "Jaeger collector container image", 2023-07-14T18:29:17.969 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:17.969 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:17.970 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:17.970 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:17.970 INFO:teuthology.orchestra.run.smithi163.stdout: "container_image_jaeger_query": { 2023-07-14T18:29:17.970 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "container_image_jaeger_query", 2023-07-14T18:29:17.970 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "str", 2023-07-14T18:29:17.971 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:17.971 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:17.971 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2023-07-14T18:29:17.971 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:17.971 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:17.972 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:17.972 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "Jaeger query container image", 2023-07-14T18:29:17.972 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:17.972 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:17.972 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:17.973 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:17.973 INFO:teuthology.orchestra.run.smithi163.stdout: "container_image_keepalived": { 2023-07-14T18:29:17.973 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "container_image_keepalived", 2023-07-14T18:29:17.973 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "str", 2023-07-14T18:29:17.973 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:17.974 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:17.974 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2023-07-14T18:29:17.974 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:17.974 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:17.974 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:17.975 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "Keepalived container image", 2023-07-14T18:29:17.975 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:17.975 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:17.975 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:17.975 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:17.976 INFO:teuthology.orchestra.run.smithi163.stdout: "container_image_loki": { 2023-07-14T18:29:17.976 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "container_image_loki", 2023-07-14T18:29:17.976 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "str", 2023-07-14T18:29:17.976 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:17.976 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:17.977 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "docker.io/grafana/loki:2.4.0", 2023-07-14T18:29:17.977 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:17.977 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:17.977 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:17.977 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "Loki container image", 2023-07-14T18:29:17.978 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:17.978 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:17.978 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:17.978 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:17.978 INFO:teuthology.orchestra.run.smithi163.stdout: "container_image_node_exporter": { 2023-07-14T18:29:17.979 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "container_image_node_exporter", 2023-07-14T18:29:17.979 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "str", 2023-07-14T18:29:17.979 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:17.979 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:17.979 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.5.0", 2023-07-14T18:29:17.980 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:17.980 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:17.980 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:17.980 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "Prometheus container image", 2023-07-14T18:29:17.980 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:17.981 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:17.981 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:17.981 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:17.981 INFO:teuthology.orchestra.run.smithi163.stdout: "container_image_prometheus": { 2023-07-14T18:29:17.981 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "container_image_prometheus", 2023-07-14T18:29:17.981 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "str", 2023-07-14T18:29:17.982 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:17.982 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:17.982 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "quay.io/prometheus/prometheus:v2.43.0", 2023-07-14T18:29:17.982 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:17.982 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:17.983 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:17.983 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "Prometheus container image", 2023-07-14T18:29:17.983 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:17.983 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:17.983 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:17.984 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:17.984 INFO:teuthology.orchestra.run.smithi163.stdout: "container_image_promtail": { 2023-07-14T18:29:17.984 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "container_image_promtail", 2023-07-14T18:29:17.984 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "str", 2023-07-14T18:29:17.984 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:17.985 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:17.985 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "docker.io/grafana/promtail:2.4.0", 2023-07-14T18:29:17.985 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:17.985 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:17.985 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:17.986 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "Promtail container image", 2023-07-14T18:29:17.986 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:17.986 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:17.986 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:17.986 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:17.987 INFO:teuthology.orchestra.run.smithi163.stdout: "container_image_snmp_gateway": { 2023-07-14T18:29:17.987 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "container_image_snmp_gateway", 2023-07-14T18:29:17.987 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "str", 2023-07-14T18:29:17.987 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:17.987 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:17.987 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2023-07-14T18:29:17.988 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:17.988 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:17.988 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:17.988 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "SNMP Gateway container image", 2023-07-14T18:29:17.988 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:17.989 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:17.989 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:17.989 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:17.989 INFO:teuthology.orchestra.run.smithi163.stdout: "container_init": { 2023-07-14T18:29:17.989 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "container_init", 2023-07-14T18:29:17.990 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "bool", 2023-07-14T18:29:17.990 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:17.990 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:17.990 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "True", 2023-07-14T18:29:17.990 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:17.991 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:17.991 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:17.991 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "Run podman/docker with `--init`", 2023-07-14T18:29:17.991 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:17.991 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:17.992 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:17.992 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:17.992 INFO:teuthology.orchestra.run.smithi163.stdout: "daemon_cache_timeout": { 2023-07-14T18:29:17.992 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "daemon_cache_timeout", 2023-07-14T18:29:17.992 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "secs", 2023-07-14T18:29:17.993 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:17.993 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:17.993 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "600", 2023-07-14T18:29:17.993 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:17.993 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:17.994 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:17.994 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "seconds to cache service (daemon) inventory", 2023-07-14T18:29:17.994 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:17.994 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:17.994 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:17.995 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:17.995 INFO:teuthology.orchestra.run.smithi163.stdout: "default_cephadm_command_timeout": { 2023-07-14T18:29:17.995 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "default_cephadm_command_timeout", 2023-07-14T18:29:17.995 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "secs", 2023-07-14T18:29:17.995 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:17.996 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:17.996 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "900", 2023-07-14T18:29:17.996 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:17.996 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:17.996 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:17.996 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2023-07-14T18:29:17.997 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:17.997 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:17.997 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:17.997 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:17.997 INFO:teuthology.orchestra.run.smithi163.stdout: "default_registry": { 2023-07-14T18:29:17.998 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "default_registry", 2023-07-14T18:29:17.998 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "str", 2023-07-14T18:29:17.998 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:17.998 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:17.998 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "docker.io", 2023-07-14T18:29:17.999 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:17.999 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:17.999 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:17.999 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2023-07-14T18:29:17.999 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:18.000 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:18.000 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:18.000 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:18.000 INFO:teuthology.orchestra.run.smithi163.stdout: "device_cache_timeout": { 2023-07-14T18:29:18.000 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "device_cache_timeout", 2023-07-14T18:29:18.001 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "secs", 2023-07-14T18:29:18.001 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:18.001 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:18.001 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "1800", 2023-07-14T18:29:18.001 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:18.002 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:18.002 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:18.002 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "seconds to cache device inventory", 2023-07-14T18:29:18.002 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:18.002 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:18.002 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:18.003 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:18.003 INFO:teuthology.orchestra.run.smithi163.stdout: "device_enhanced_scan": { 2023-07-14T18:29:18.003 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "device_enhanced_scan", 2023-07-14T18:29:18.003 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "bool", 2023-07-14T18:29:18.003 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:18.004 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:18.004 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "False", 2023-07-14T18:29:18.004 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:18.004 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:18.004 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:18.005 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "Use libstoragemgmt during device scans", 2023-07-14T18:29:18.005 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:18.005 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:18.005 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:18.005 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:18.006 INFO:teuthology.orchestra.run.smithi163.stdout: "facts_cache_timeout": { 2023-07-14T18:29:18.006 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "facts_cache_timeout", 2023-07-14T18:29:18.006 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "secs", 2023-07-14T18:29:18.006 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:18.006 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:18.007 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "60", 2023-07-14T18:29:18.007 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:18.007 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:18.007 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:18.007 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "seconds to cache host facts data", 2023-07-14T18:29:18.008 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:18.008 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:18.008 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:18.008 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:18.008 INFO:teuthology.orchestra.run.smithi163.stdout: "host_check_interval": { 2023-07-14T18:29:18.009 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "host_check_interval", 2023-07-14T18:29:18.009 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "secs", 2023-07-14T18:29:18.009 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:18.009 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:18.009 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "600", 2023-07-14T18:29:18.010 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:18.010 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:18.010 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:18.010 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "how frequently to perform a host check", 2023-07-14T18:29:18.010 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:18.011 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:18.011 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:18.011 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:18.011 INFO:teuthology.orchestra.run.smithi163.stdout: "log_level": { 2023-07-14T18:29:18.011 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "log_level", 2023-07-14T18:29:18.012 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "str", 2023-07-14T18:29:18.012 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:18.012 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:18.012 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "", 2023-07-14T18:29:18.012 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:18.013 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:18.013 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [ 2023-07-14T18:29:18.013 INFO:teuthology.orchestra.run.smithi163.stdout: "", 2023-07-14T18:29:18.013 INFO:teuthology.orchestra.run.smithi163.stdout: "critical", 2023-07-14T18:29:18.013 INFO:teuthology.orchestra.run.smithi163.stdout: "debug", 2023-07-14T18:29:18.013 INFO:teuthology.orchestra.run.smithi163.stdout: "error", 2023-07-14T18:29:18.014 INFO:teuthology.orchestra.run.smithi163.stdout: "info", 2023-07-14T18:29:18.014 INFO:teuthology.orchestra.run.smithi163.stdout: "warning" 2023-07-14T18:29:18.014 INFO:teuthology.orchestra.run.smithi163.stdout: ], 2023-07-14T18:29:18.014 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:18.014 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:18.015 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:18.015 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:18.015 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:18.015 INFO:teuthology.orchestra.run.smithi163.stdout: "log_refresh_metadata": { 2023-07-14T18:29:18.015 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "log_refresh_metadata", 2023-07-14T18:29:18.016 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "bool", 2023-07-14T18:29:18.016 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:18.016 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:18.016 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "False", 2023-07-14T18:29:18.016 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:18.017 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:18.017 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:18.017 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2023-07-14T18:29:18.017 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:18.017 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:18.018 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:18.018 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:18.018 INFO:teuthology.orchestra.run.smithi163.stdout: "log_to_cluster": { 2023-07-14T18:29:18.018 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "log_to_cluster", 2023-07-14T18:29:18.018 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "bool", 2023-07-14T18:29:18.019 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:18.019 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:18.019 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "True", 2023-07-14T18:29:18.019 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:18.019 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:18.019 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:18.020 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2023-07-14T18:29:18.020 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:18.020 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:18.020 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:18.020 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:18.021 INFO:teuthology.orchestra.run.smithi163.stdout: "log_to_cluster_level": { 2023-07-14T18:29:18.021 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "log_to_cluster_level", 2023-07-14T18:29:18.021 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "str", 2023-07-14T18:29:18.021 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:18.021 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:18.022 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "info", 2023-07-14T18:29:18.022 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:18.022 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:18.022 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [ 2023-07-14T18:29:18.022 INFO:teuthology.orchestra.run.smithi163.stdout: "", 2023-07-14T18:29:18.023 INFO:teuthology.orchestra.run.smithi163.stdout: "critical", 2023-07-14T18:29:18.023 INFO:teuthology.orchestra.run.smithi163.stdout: "debug", 2023-07-14T18:29:18.023 INFO:teuthology.orchestra.run.smithi163.stdout: "error", 2023-07-14T18:29:18.023 INFO:teuthology.orchestra.run.smithi163.stdout: "info", 2023-07-14T18:29:18.023 INFO:teuthology.orchestra.run.smithi163.stdout: "warning" 2023-07-14T18:29:18.024 INFO:teuthology.orchestra.run.smithi163.stdout: ], 2023-07-14T18:29:18.024 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:18.024 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:18.024 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:18.024 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:18.024 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:18.025 INFO:teuthology.orchestra.run.smithi163.stdout: "log_to_file": { 2023-07-14T18:29:18.025 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "log_to_file", 2023-07-14T18:29:18.025 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "bool", 2023-07-14T18:29:18.025 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:18.025 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:18.026 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "False", 2023-07-14T18:29:18.026 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:18.026 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:18.026 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:18.026 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:18.027 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:18.027 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:18.027 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:18.027 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:18.027 INFO:teuthology.orchestra.run.smithi163.stdout: "manage_etc_ceph_ceph_conf": { 2023-07-14T18:29:18.028 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "manage_etc_ceph_ceph_conf", 2023-07-14T18:29:18.028 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "bool", 2023-07-14T18:29:18.028 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:18.028 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:18.028 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "False", 2023-07-14T18:29:18.029 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:18.029 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:18.029 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:18.029 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2023-07-14T18:29:18.029 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:18.030 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:18.030 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:18.030 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:18.030 INFO:teuthology.orchestra.run.smithi163.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2023-07-14T18:29:18.030 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2023-07-14T18:29:18.030 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "str", 2023-07-14T18:29:18.031 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:18.031 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:18.031 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "*", 2023-07-14T18:29:18.031 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:18.031 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:18.032 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:18.032 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2023-07-14T18:29:18.032 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:18.032 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:18.032 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:18.033 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:18.033 INFO:teuthology.orchestra.run.smithi163.stdout: "max_count_per_host": { 2023-07-14T18:29:18.033 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "max_count_per_host", 2023-07-14T18:29:18.033 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "int", 2023-07-14T18:29:18.033 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:18.034 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:18.034 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "10", 2023-07-14T18:29:18.034 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:18.034 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:18.034 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:18.035 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "max number of daemons per service per host", 2023-07-14T18:29:18.035 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:18.035 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:18.035 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:18.035 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:18.036 INFO:teuthology.orchestra.run.smithi163.stdout: "max_osd_draining_count": { 2023-07-14T18:29:18.036 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "max_osd_draining_count", 2023-07-14T18:29:18.036 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "int", 2023-07-14T18:29:18.036 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:18.036 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:18.036 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "10", 2023-07-14T18:29:18.037 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:18.037 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:18.037 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:18.037 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2023-07-14T18:29:18.037 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:18.038 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:18.038 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:18.038 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:18.038 INFO:teuthology.orchestra.run.smithi163.stdout: "migration_current": { 2023-07-14T18:29:18.038 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "migration_current", 2023-07-14T18:29:18.039 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "int", 2023-07-14T18:29:18.039 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:18.039 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:18.039 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "", 2023-07-14T18:29:18.039 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:18.040 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:18.040 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:18.040 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "internal - do not modify", 2023-07-14T18:29:18.040 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:18.040 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:18.041 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:18.041 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:18.041 INFO:teuthology.orchestra.run.smithi163.stdout: "mode": { 2023-07-14T18:29:18.041 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "mode", 2023-07-14T18:29:18.041 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "str", 2023-07-14T18:29:18.042 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:18.042 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:18.042 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "root", 2023-07-14T18:29:18.042 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:18.042 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:18.043 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [ 2023-07-14T18:29:18.043 INFO:teuthology.orchestra.run.smithi163.stdout: "cephadm-package", 2023-07-14T18:29:18.043 INFO:teuthology.orchestra.run.smithi163.stdout: "root" 2023-07-14T18:29:18.043 INFO:teuthology.orchestra.run.smithi163.stdout: ], 2023-07-14T18:29:18.043 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "mode for remote execution of cephadm", 2023-07-14T18:29:18.044 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:18.044 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:18.044 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:18.044 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:18.044 INFO:teuthology.orchestra.run.smithi163.stdout: "prometheus_alerts_path": { 2023-07-14T18:29:18.045 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "prometheus_alerts_path", 2023-07-14T18:29:18.045 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "str", 2023-07-14T18:29:18.045 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:18.045 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:18.045 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2023-07-14T18:29:18.045 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:18.046 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:18.046 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:18.046 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "location of alerts to include in prometheus deployments", 2023-07-14T18:29:18.046 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:18.046 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:18.047 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:18.047 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:18.047 INFO:teuthology.orchestra.run.smithi163.stdout: "prometheus_web_password": { 2023-07-14T18:29:18.047 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "prometheus_web_password", 2023-07-14T18:29:18.047 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "str", 2023-07-14T18:29:18.048 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:18.048 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:18.048 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "admin", 2023-07-14T18:29:18.048 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:18.048 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:18.049 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:18.049 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "Prometheus web password", 2023-07-14T18:29:18.049 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:18.049 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:18.049 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:18.050 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:18.050 INFO:teuthology.orchestra.run.smithi163.stdout: "prometheus_web_user": { 2023-07-14T18:29:18.050 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "prometheus_web_user", 2023-07-14T18:29:18.050 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "str", 2023-07-14T18:29:18.050 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:18.051 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:18.051 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "admin", 2023-07-14T18:29:18.051 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:18.051 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:18.051 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:18.052 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "Prometheus web user", 2023-07-14T18:29:18.052 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:18.052 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:18.052 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:18.052 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:18.052 INFO:teuthology.orchestra.run.smithi163.stdout: "registry_insecure": { 2023-07-14T18:29:18.053 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "registry_insecure", 2023-07-14T18:29:18.053 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "bool", 2023-07-14T18:29:18.053 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:18.053 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:18.053 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "False", 2023-07-14T18:29:18.054 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:18.054 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:18.054 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:18.054 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2023-07-14T18:29:18.054 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:18.055 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:18.055 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:18.055 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:18.055 INFO:teuthology.orchestra.run.smithi163.stdout: "registry_password": { 2023-07-14T18:29:18.055 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "registry_password", 2023-07-14T18:29:18.056 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "str", 2023-07-14T18:29:18.056 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:18.056 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:18.056 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "", 2023-07-14T18:29:18.056 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:18.057 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:18.057 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:18.057 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2023-07-14T18:29:18.057 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:18.057 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:18.057 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:18.058 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:18.058 INFO:teuthology.orchestra.run.smithi163.stdout: "registry_url": { 2023-07-14T18:29:18.058 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "registry_url", 2023-07-14T18:29:18.058 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "str", 2023-07-14T18:29:18.058 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:18.059 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:18.059 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "", 2023-07-14T18:29:18.059 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:18.059 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:18.059 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:18.060 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2023-07-14T18:29:18.060 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:18.060 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:18.060 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:18.060 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:18.061 INFO:teuthology.orchestra.run.smithi163.stdout: "registry_username": { 2023-07-14T18:29:18.061 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "registry_username", 2023-07-14T18:29:18.061 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "str", 2023-07-14T18:29:18.061 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:18.061 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:18.062 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "", 2023-07-14T18:29:18.062 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:18.062 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:18.062 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:18.062 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2023-07-14T18:29:18.063 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:18.063 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:18.063 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:18.063 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:18.063 INFO:teuthology.orchestra.run.smithi163.stdout: "secure_monitoring_stack": { 2023-07-14T18:29:18.064 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "secure_monitoring_stack", 2023-07-14T18:29:18.064 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "bool", 2023-07-14T18:29:18.064 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:18.064 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:18.064 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "False", 2023-07-14T18:29:18.065 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:18.065 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:18.065 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:18.065 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2023-07-14T18:29:18.065 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:18.066 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:18.066 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:18.066 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:18.066 INFO:teuthology.orchestra.run.smithi163.stdout: "service_discovery_port": { 2023-07-14T18:29:18.066 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "service_discovery_port", 2023-07-14T18:29:18.066 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "int", 2023-07-14T18:29:18.067 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:18.067 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:18.067 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "8765", 2023-07-14T18:29:18.067 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:18.067 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:18.068 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:18.068 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "cephadm service discovery port", 2023-07-14T18:29:18.068 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:18.068 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:18.068 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:18.069 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:18.069 INFO:teuthology.orchestra.run.smithi163.stdout: "ssh_config_file": { 2023-07-14T18:29:18.069 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "ssh_config_file", 2023-07-14T18:29:18.069 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "str", 2023-07-14T18:29:18.069 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:18.070 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:18.070 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "", 2023-07-14T18:29:18.070 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:18.070 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:18.070 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:18.071 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "customized SSH config file to connect to managed hosts", 2023-07-14T18:29:18.071 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:18.071 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:18.071 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:18.071 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:18.072 INFO:teuthology.orchestra.run.smithi163.stdout: "use_agent": { 2023-07-14T18:29:18.072 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "use_agent", 2023-07-14T18:29:18.072 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "bool", 2023-07-14T18:29:18.072 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:18.072 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:18.072 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "False", 2023-07-14T18:29:18.073 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:18.073 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:18.073 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:18.073 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2023-07-14T18:29:18.073 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:18.074 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:18.074 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:18.074 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:18.074 INFO:teuthology.orchestra.run.smithi163.stdout: "use_repo_digest": { 2023-07-14T18:29:18.074 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "use_repo_digest", 2023-07-14T18:29:18.075 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "bool", 2023-07-14T18:29:18.075 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:18.075 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:18.075 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "True", 2023-07-14T18:29:18.075 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:18.076 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:18.076 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:18.076 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2023-07-14T18:29:18.076 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:18.077 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:18.077 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:18.077 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:18.077 INFO:teuthology.orchestra.run.smithi163.stdout: "warn_on_failed_host_check": { 2023-07-14T18:29:18.077 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "warn_on_failed_host_check", 2023-07-14T18:29:18.077 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "bool", 2023-07-14T18:29:18.078 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:18.078 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:18.078 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "True", 2023-07-14T18:29:18.078 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:18.078 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:18.079 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:18.079 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "raise a health warning if the host check fails", 2023-07-14T18:29:18.079 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:18.079 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:18.079 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:18.080 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:18.080 INFO:teuthology.orchestra.run.smithi163.stdout: "warn_on_stray_daemons": { 2023-07-14T18:29:18.080 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "warn_on_stray_daemons", 2023-07-14T18:29:18.080 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "bool", 2023-07-14T18:29:18.080 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:18.081 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:18.081 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "True", 2023-07-14T18:29:18.081 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:18.081 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:18.081 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:18.082 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2023-07-14T18:29:18.082 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:18.082 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:18.082 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:18.082 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:18.083 INFO:teuthology.orchestra.run.smithi163.stdout: "warn_on_stray_hosts": { 2023-07-14T18:29:18.083 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "warn_on_stray_hosts", 2023-07-14T18:29:18.083 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "bool", 2023-07-14T18:29:18.083 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:18.083 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:18.084 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "True", 2023-07-14T18:29:18.084 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:18.084 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:18.084 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:18.084 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2023-07-14T18:29:18.085 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:18.085 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:18.085 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:18.085 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-07-14T18:29:18.085 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-07-14T18:29:18.085 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:18.086 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-07-14T18:29:18.086 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "crash", 2023-07-14T18:29:18.086 INFO:teuthology.orchestra.run.smithi163.stdout: "can_run": true, 2023-07-14T18:29:18.086 INFO:teuthology.orchestra.run.smithi163.stdout: "error_string": "", 2023-07-14T18:29:18.086 INFO:teuthology.orchestra.run.smithi163.stdout: "module_options": { 2023-07-14T18:29:18.087 INFO:teuthology.orchestra.run.smithi163.stdout: "log_level": { 2023-07-14T18:29:18.087 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "log_level", 2023-07-14T18:29:18.087 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "str", 2023-07-14T18:29:18.087 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:18.087 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:18.088 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "", 2023-07-14T18:29:18.088 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:18.088 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:18.088 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [ 2023-07-14T18:29:18.088 INFO:teuthology.orchestra.run.smithi163.stdout: "", 2023-07-14T18:29:18.089 INFO:teuthology.orchestra.run.smithi163.stdout: "critical", 2023-07-14T18:29:18.089 INFO:teuthology.orchestra.run.smithi163.stdout: "debug", 2023-07-14T18:29:18.089 INFO:teuthology.orchestra.run.smithi163.stdout: "error", 2023-07-14T18:29:18.089 INFO:teuthology.orchestra.run.smithi163.stdout: "info", 2023-07-14T18:29:18.089 INFO:teuthology.orchestra.run.smithi163.stdout: "warning" 2023-07-14T18:29:18.090 INFO:teuthology.orchestra.run.smithi163.stdout: ], 2023-07-14T18:29:18.090 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:18.090 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:18.090 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:18.090 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:18.091 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:18.091 INFO:teuthology.orchestra.run.smithi163.stdout: "log_to_cluster": { 2023-07-14T18:29:18.091 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "log_to_cluster", 2023-07-14T18:29:18.091 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "bool", 2023-07-14T18:29:18.091 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:18.092 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:18.092 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "False", 2023-07-14T18:29:18.092 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:18.092 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:18.092 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:18.093 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:18.093 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:18.093 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:18.093 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:18.093 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:18.093 INFO:teuthology.orchestra.run.smithi163.stdout: "log_to_cluster_level": { 2023-07-14T18:29:18.094 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "log_to_cluster_level", 2023-07-14T18:29:18.094 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "str", 2023-07-14T18:29:18.094 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:18.094 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:18.094 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "info", 2023-07-14T18:29:18.095 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:18.095 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:18.095 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [ 2023-07-14T18:29:18.095 INFO:teuthology.orchestra.run.smithi163.stdout: "", 2023-07-14T18:29:18.095 INFO:teuthology.orchestra.run.smithi163.stdout: "critical", 2023-07-14T18:29:18.096 INFO:teuthology.orchestra.run.smithi163.stdout: "debug", 2023-07-14T18:29:18.096 INFO:teuthology.orchestra.run.smithi163.stdout: "error", 2023-07-14T18:29:18.096 INFO:teuthology.orchestra.run.smithi163.stdout: "info", 2023-07-14T18:29:18.096 INFO:teuthology.orchestra.run.smithi163.stdout: "warning" 2023-07-14T18:29:18.096 INFO:teuthology.orchestra.run.smithi163.stdout: ], 2023-07-14T18:29:18.097 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:18.097 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:18.097 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:18.097 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:18.097 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:18.097 INFO:teuthology.orchestra.run.smithi163.stdout: "log_to_file": { 2023-07-14T18:29:18.098 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "log_to_file", 2023-07-14T18:29:18.098 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "bool", 2023-07-14T18:29:18.098 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:18.098 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:18.098 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "False", 2023-07-14T18:29:18.099 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:18.099 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:18.099 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:18.099 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:18.099 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:18.100 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:18.100 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:18.100 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:18.100 INFO:teuthology.orchestra.run.smithi163.stdout: "retain_interval": { 2023-07-14T18:29:18.100 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "retain_interval", 2023-07-14T18:29:18.101 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "secs", 2023-07-14T18:29:18.101 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:18.101 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:18.101 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "31536000", 2023-07-14T18:29:18.101 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:18.102 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:18.102 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:18.102 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "how long to retain crashes before pruning them", 2023-07-14T18:29:18.102 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:18.102 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:18.102 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:18.103 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:18.103 INFO:teuthology.orchestra.run.smithi163.stdout: "warn_recent_interval": { 2023-07-14T18:29:18.103 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "warn_recent_interval", 2023-07-14T18:29:18.103 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "secs", 2023-07-14T18:29:18.103 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:18.104 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:18.104 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "1209600", 2023-07-14T18:29:18.104 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:18.104 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:18.104 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:18.105 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "time interval in which to warn about recent crashes", 2023-07-14T18:29:18.105 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:18.105 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:18.105 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:18.105 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-07-14T18:29:18.105 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-07-14T18:29:18.106 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:18.106 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-07-14T18:29:18.106 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "dashboard", 2023-07-14T18:29:18.106 INFO:teuthology.orchestra.run.smithi163.stdout: "can_run": true, 2023-07-14T18:29:18.106 INFO:teuthology.orchestra.run.smithi163.stdout: "error_string": "", 2023-07-14T18:29:18.107 INFO:teuthology.orchestra.run.smithi163.stdout: "module_options": { 2023-07-14T18:29:18.107 INFO:teuthology.orchestra.run.smithi163.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2023-07-14T18:29:18.107 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2023-07-14T18:29:18.107 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "int", 2023-07-14T18:29:18.107 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:18.108 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:18.108 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "10", 2023-07-14T18:29:18.108 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:18.108 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:18.108 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:18.109 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:18.109 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:18.109 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:18.109 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:18.109 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:18.110 INFO:teuthology.orchestra.run.smithi163.stdout: "ALERTMANAGER_API_HOST": { 2023-07-14T18:29:18.110 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "ALERTMANAGER_API_HOST", 2023-07-14T18:29:18.110 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "str", 2023-07-14T18:29:18.110 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:18.110 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:18.111 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "", 2023-07-14T18:29:18.111 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:18.111 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:18.111 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:18.111 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:18.112 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:18.112 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:18.112 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:18.112 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:18.112 INFO:teuthology.orchestra.run.smithi163.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2023-07-14T18:29:18.113 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2023-07-14T18:29:18.113 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "bool", 2023-07-14T18:29:18.113 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:18.113 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:18.113 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "True", 2023-07-14T18:29:18.114 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:18.114 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:18.114 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:18.114 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:18.114 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:18.115 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:18.115 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:18.115 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:18.115 INFO:teuthology.orchestra.run.smithi163.stdout: "AUDIT_API_ENABLED": { 2023-07-14T18:29:18.115 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "AUDIT_API_ENABLED", 2023-07-14T18:29:18.115 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "bool", 2023-07-14T18:29:18.116 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:18.116 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:18.116 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "False", 2023-07-14T18:29:18.116 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:18.117 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:18.117 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:18.117 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:18.117 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:18.117 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:18.117 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:18.118 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:18.118 INFO:teuthology.orchestra.run.smithi163.stdout: "AUDIT_API_LOG_PAYLOAD": { 2023-07-14T18:29:18.118 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2023-07-14T18:29:18.118 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "bool", 2023-07-14T18:29:18.118 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:18.119 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:18.119 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "True", 2023-07-14T18:29:18.119 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:18.119 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:18.119 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:18.120 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:18.120 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:18.120 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:18.120 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:18.120 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:18.121 INFO:teuthology.orchestra.run.smithi163.stdout: "ENABLE_BROWSABLE_API": { 2023-07-14T18:29:18.121 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "ENABLE_BROWSABLE_API", 2023-07-14T18:29:18.121 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "bool", 2023-07-14T18:29:18.121 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:18.121 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:18.121 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "True", 2023-07-14T18:29:18.122 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:18.122 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:18.122 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:18.122 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:18.122 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:18.123 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:18.123 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:18.123 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:18.123 INFO:teuthology.orchestra.run.smithi163.stdout: "FEATURE_TOGGLE_CEPHFS": { 2023-07-14T18:29:18.123 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2023-07-14T18:29:18.124 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "bool", 2023-07-14T18:29:18.124 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:18.124 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:18.124 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "True", 2023-07-14T18:29:18.124 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:18.125 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:18.125 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:18.125 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:18.125 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:18.125 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:18.125 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:18.126 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:18.126 INFO:teuthology.orchestra.run.smithi163.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2023-07-14T18:29:18.126 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2023-07-14T18:29:18.126 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "bool", 2023-07-14T18:29:18.126 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:18.127 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:18.127 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "True", 2023-07-14T18:29:18.127 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:18.127 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:18.127 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:18.128 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:18.128 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:18.128 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:18.128 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:18.128 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:18.129 INFO:teuthology.orchestra.run.smithi163.stdout: "FEATURE_TOGGLE_ISCSI": { 2023-07-14T18:29:18.129 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2023-07-14T18:29:18.129 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "bool", 2023-07-14T18:29:18.129 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:18.129 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:18.130 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "True", 2023-07-14T18:29:18.130 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:18.130 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:18.130 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:18.130 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:18.131 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:18.131 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:18.131 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:18.131 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:18.131 INFO:teuthology.orchestra.run.smithi163.stdout: "FEATURE_TOGGLE_MIRRORING": { 2023-07-14T18:29:18.131 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2023-07-14T18:29:18.132 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "bool", 2023-07-14T18:29:18.132 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:18.132 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:18.132 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "True", 2023-07-14T18:29:18.133 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:18.133 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:18.133 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:18.133 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:18.133 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:18.134 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:18.134 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:18.134 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:18.134 INFO:teuthology.orchestra.run.smithi163.stdout: "FEATURE_TOGGLE_NFS": { 2023-07-14T18:29:18.134 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "FEATURE_TOGGLE_NFS", 2023-07-14T18:29:18.135 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "bool", 2023-07-14T18:29:18.135 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:18.135 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:18.135 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "True", 2023-07-14T18:29:18.135 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:18.135 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:18.136 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:18.136 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:18.136 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:18.136 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:18.137 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:18.137 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:18.137 INFO:teuthology.orchestra.run.smithi163.stdout: "FEATURE_TOGGLE_RBD": { 2023-07-14T18:29:18.137 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "FEATURE_TOGGLE_RBD", 2023-07-14T18:29:18.137 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "bool", 2023-07-14T18:29:18.137 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:18.138 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:18.138 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "True", 2023-07-14T18:29:18.138 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:18.138 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:18.138 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:18.139 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:18.139 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:18.139 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:18.139 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:18.139 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:18.140 INFO:teuthology.orchestra.run.smithi163.stdout: "FEATURE_TOGGLE_RGW": { 2023-07-14T18:29:18.140 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "FEATURE_TOGGLE_RGW", 2023-07-14T18:29:18.140 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "bool", 2023-07-14T18:29:18.140 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:18.140 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:18.141 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "True", 2023-07-14T18:29:18.141 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:18.141 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:18.141 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:18.141 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:18.142 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:18.142 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:18.142 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:18.142 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:18.142 INFO:teuthology.orchestra.run.smithi163.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2023-07-14T18:29:18.142 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2023-07-14T18:29:18.143 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "str", 2023-07-14T18:29:18.143 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:18.143 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:18.143 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "", 2023-07-14T18:29:18.143 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:18.144 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:18.144 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:18.144 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:18.144 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:18.144 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:18.145 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:18.145 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:18.145 INFO:teuthology.orchestra.run.smithi163.stdout: "GRAFANA_API_PASSWORD": { 2023-07-14T18:29:18.145 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "GRAFANA_API_PASSWORD", 2023-07-14T18:29:18.145 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "str", 2023-07-14T18:29:18.146 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:18.146 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:18.146 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "admin", 2023-07-14T18:29:18.146 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:18.146 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:18.147 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:18.147 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:18.147 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:18.147 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:18.147 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:18.148 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:18.148 INFO:teuthology.orchestra.run.smithi163.stdout: "GRAFANA_API_SSL_VERIFY": { 2023-07-14T18:29:18.148 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2023-07-14T18:29:18.148 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "bool", 2023-07-14T18:29:18.148 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:18.149 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:18.149 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "True", 2023-07-14T18:29:18.149 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:18.149 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:18.149 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:18.150 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:18.150 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:18.150 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:18.150 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:18.150 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:18.151 INFO:teuthology.orchestra.run.smithi163.stdout: "GRAFANA_API_URL": { 2023-07-14T18:29:18.151 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "GRAFANA_API_URL", 2023-07-14T18:29:18.151 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "str", 2023-07-14T18:29:18.151 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:18.151 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:18.151 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "", 2023-07-14T18:29:18.152 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:18.152 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:18.152 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:18.152 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:18.152 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:18.153 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:18.153 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:18.153 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:18.153 INFO:teuthology.orchestra.run.smithi163.stdout: "GRAFANA_API_USERNAME": { 2023-07-14T18:29:18.153 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "GRAFANA_API_USERNAME", 2023-07-14T18:29:18.154 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "str", 2023-07-14T18:29:18.154 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:18.154 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:18.154 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "admin", 2023-07-14T18:29:18.154 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:18.155 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:18.155 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:18.155 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:18.155 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:18.155 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:18.156 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:18.156 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:18.156 INFO:teuthology.orchestra.run.smithi163.stdout: "GRAFANA_FRONTEND_API_URL": { 2023-07-14T18:29:18.156 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2023-07-14T18:29:18.156 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "str", 2023-07-14T18:29:18.157 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:18.157 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:18.157 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "", 2023-07-14T18:29:18.157 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:18.157 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:18.158 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:18.158 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:18.158 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:18.158 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:18.158 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:18.158 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:18.159 INFO:teuthology.orchestra.run.smithi163.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2023-07-14T18:29:18.159 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2023-07-14T18:29:18.159 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "bool", 2023-07-14T18:29:18.159 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:18.159 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:18.160 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "False", 2023-07-14T18:29:18.160 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:18.160 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:18.160 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:18.160 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:18.161 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:18.161 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:18.161 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:18.161 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:18.161 INFO:teuthology.orchestra.run.smithi163.stdout: "ISCSI_API_SSL_VERIFICATION": { 2023-07-14T18:29:18.162 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2023-07-14T18:29:18.162 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "bool", 2023-07-14T18:29:18.162 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:18.162 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:18.162 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "True", 2023-07-14T18:29:18.163 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:18.163 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:18.163 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:18.163 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:18.163 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:18.164 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:18.164 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:18.164 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:18.164 INFO:teuthology.orchestra.run.smithi163.stdout: "ISSUE_TRACKER_API_KEY": { 2023-07-14T18:29:18.164 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "ISSUE_TRACKER_API_KEY", 2023-07-14T18:29:18.165 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "str", 2023-07-14T18:29:18.165 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:18.165 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:18.165 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "", 2023-07-14T18:29:18.165 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:18.165 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:18.166 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:18.166 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:18.166 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:18.166 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:18.166 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:18.167 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:18.167 INFO:teuthology.orchestra.run.smithi163.stdout: "PROMETHEUS_API_HOST": { 2023-07-14T18:29:18.167 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "PROMETHEUS_API_HOST", 2023-07-14T18:29:18.167 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "str", 2023-07-14T18:29:18.167 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:18.168 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:18.168 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "", 2023-07-14T18:29:18.168 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:18.168 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:18.168 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:18.169 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:18.169 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:18.169 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:18.169 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:18.169 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:18.170 INFO:teuthology.orchestra.run.smithi163.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2023-07-14T18:29:18.170 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2023-07-14T18:29:18.170 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "bool", 2023-07-14T18:29:18.170 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:18.170 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:18.170 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "True", 2023-07-14T18:29:18.171 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:18.171 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:18.171 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:18.171 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:18.171 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:18.172 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:18.172 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:18.172 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:18.172 INFO:teuthology.orchestra.run.smithi163.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2023-07-14T18:29:18.172 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2023-07-14T18:29:18.173 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "bool", 2023-07-14T18:29:18.173 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:18.173 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:18.173 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "False", 2023-07-14T18:29:18.173 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:18.174 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:18.174 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:18.174 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:18.174 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:18.174 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:18.175 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:18.175 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:18.175 INFO:teuthology.orchestra.run.smithi163.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2023-07-14T18:29:18.175 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2023-07-14T18:29:18.175 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "bool", 2023-07-14T18:29:18.176 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:18.176 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:18.176 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "False", 2023-07-14T18:29:18.176 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:18.176 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:18.177 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:18.177 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:18.177 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:18.177 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:18.177 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:18.178 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:18.178 INFO:teuthology.orchestra.run.smithi163.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2023-07-14T18:29:18.178 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2023-07-14T18:29:18.178 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "bool", 2023-07-14T18:29:18.178 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:18.178 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:18.179 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "True", 2023-07-14T18:29:18.179 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:18.179 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:18.179 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:18.179 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:18.180 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:18.180 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:18.180 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:18.180 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:18.180 INFO:teuthology.orchestra.run.smithi163.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2023-07-14T18:29:18.181 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2023-07-14T18:29:18.181 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "bool", 2023-07-14T18:29:18.181 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:18.181 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:18.181 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "True", 2023-07-14T18:29:18.182 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:18.182 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:18.182 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:18.182 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:18.182 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:18.183 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:18.183 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:18.183 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:18.183 INFO:teuthology.orchestra.run.smithi163.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2023-07-14T18:29:18.183 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2023-07-14T18:29:18.184 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "bool", 2023-07-14T18:29:18.184 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:18.184 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:18.184 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "False", 2023-07-14T18:29:18.184 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:18.185 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:18.185 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:18.185 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:18.185 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:18.185 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:18.186 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:18.186 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:18.186 INFO:teuthology.orchestra.run.smithi163.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2023-07-14T18:29:18.186 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2023-07-14T18:29:18.186 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "bool", 2023-07-14T18:29:18.187 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:18.187 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:18.187 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "False", 2023-07-14T18:29:18.187 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:18.187 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:18.188 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:18.188 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:18.188 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:18.188 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:18.188 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:18.189 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:18.189 INFO:teuthology.orchestra.run.smithi163.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2023-07-14T18:29:18.189 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2023-07-14T18:29:18.189 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "bool", 2023-07-14T18:29:18.189 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:18.189 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:18.190 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "False", 2023-07-14T18:29:18.190 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:18.190 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:18.190 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:18.190 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:18.191 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:18.191 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:18.191 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:18.191 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:18.191 INFO:teuthology.orchestra.run.smithi163.stdout: "PWD_POLICY_ENABLED": { 2023-07-14T18:29:18.192 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "PWD_POLICY_ENABLED", 2023-07-14T18:29:18.192 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "bool", 2023-07-14T18:29:18.192 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:18.192 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:18.192 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "True", 2023-07-14T18:29:18.193 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:18.193 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:18.193 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:18.193 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:18.193 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:18.194 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:18.194 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:18.194 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:18.194 INFO:teuthology.orchestra.run.smithi163.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2023-07-14T18:29:18.194 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2023-07-14T18:29:18.195 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "str", 2023-07-14T18:29:18.195 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:18.195 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:18.195 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2023-07-14T18:29:18.195 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:18.195 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:18.196 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:18.196 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:18.196 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:18.196 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:18.196 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:18.197 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:18.197 INFO:teuthology.orchestra.run.smithi163.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2023-07-14T18:29:18.197 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2023-07-14T18:29:18.197 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "int", 2023-07-14T18:29:18.197 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:18.198 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:18.198 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "10", 2023-07-14T18:29:18.198 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:18.198 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:18.198 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:18.199 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:18.199 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:18.199 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:18.199 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:18.199 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:18.200 INFO:teuthology.orchestra.run.smithi163.stdout: "PWD_POLICY_MIN_LENGTH": { 2023-07-14T18:29:18.200 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2023-07-14T18:29:18.200 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "int", 2023-07-14T18:29:18.200 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:18.200 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:18.200 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "8", 2023-07-14T18:29:18.201 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:18.201 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:18.201 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:18.201 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:18.201 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:18.202 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:18.202 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:18.202 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:18.202 INFO:teuthology.orchestra.run.smithi163.stdout: "REST_REQUESTS_TIMEOUT": { 2023-07-14T18:29:18.202 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "REST_REQUESTS_TIMEOUT", 2023-07-14T18:29:18.203 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "int", 2023-07-14T18:29:18.203 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:18.203 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:18.203 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "45", 2023-07-14T18:29:18.203 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:18.204 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:18.204 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:18.204 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:18.204 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:18.204 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:18.205 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:18.205 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:18.205 INFO:teuthology.orchestra.run.smithi163.stdout: "RGW_API_ACCESS_KEY": { 2023-07-14T18:29:18.205 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "RGW_API_ACCESS_KEY", 2023-07-14T18:29:18.205 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "str", 2023-07-14T18:29:18.206 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:18.206 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:18.206 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "", 2023-07-14T18:29:18.206 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:18.206 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:18.206 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:18.207 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:18.207 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:18.207 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:18.207 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:18.207 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:18.208 INFO:teuthology.orchestra.run.smithi163.stdout: "RGW_API_ADMIN_RESOURCE": { 2023-07-14T18:29:18.208 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2023-07-14T18:29:18.208 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "str", 2023-07-14T18:29:18.208 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:18.208 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:18.209 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "admin", 2023-07-14T18:29:18.209 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:18.209 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:18.209 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:18.209 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:18.210 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:18.210 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:18.210 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:18.210 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:18.210 INFO:teuthology.orchestra.run.smithi163.stdout: "RGW_API_SECRET_KEY": { 2023-07-14T18:29:18.210 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "RGW_API_SECRET_KEY", 2023-07-14T18:29:18.211 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "str", 2023-07-14T18:29:18.211 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:18.211 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:18.211 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "", 2023-07-14T18:29:18.211 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:18.212 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:18.212 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:18.212 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:18.212 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:18.212 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:18.213 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:18.213 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:18.213 INFO:teuthology.orchestra.run.smithi163.stdout: "RGW_API_SSL_VERIFY": { 2023-07-14T18:29:18.213 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "RGW_API_SSL_VERIFY", 2023-07-14T18:29:18.213 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "bool", 2023-07-14T18:29:18.214 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:18.214 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:18.214 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "True", 2023-07-14T18:29:18.214 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:18.214 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:18.215 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:18.215 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:18.215 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:18.215 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:18.215 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:18.216 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:18.216 INFO:teuthology.orchestra.run.smithi163.stdout: "USER_PWD_EXPIRATION_SPAN": { 2023-07-14T18:29:18.216 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2023-07-14T18:29:18.216 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "int", 2023-07-14T18:29:18.216 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:18.216 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:18.217 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "0", 2023-07-14T18:29:18.217 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:18.217 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:18.217 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:18.218 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:18.218 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:18.218 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:18.218 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:18.218 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:18.219 INFO:teuthology.orchestra.run.smithi163.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2023-07-14T18:29:18.219 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2023-07-14T18:29:18.219 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "int", 2023-07-14T18:29:18.219 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:18.219 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:18.220 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "10", 2023-07-14T18:29:18.220 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:18.220 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:18.220 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:18.220 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:18.221 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:18.221 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:18.221 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:18.221 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:18.221 INFO:teuthology.orchestra.run.smithi163.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2023-07-14T18:29:18.221 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2023-07-14T18:29:18.222 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "int", 2023-07-14T18:29:18.222 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:18.222 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:18.222 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "5", 2023-07-14T18:29:18.222 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:18.223 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:18.223 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:18.223 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:18.223 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:18.223 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:18.224 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:18.224 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:18.224 INFO:teuthology.orchestra.run.smithi163.stdout: "cross_origin_url": { 2023-07-14T18:29:18.224 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "cross_origin_url", 2023-07-14T18:29:18.224 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "str", 2023-07-14T18:29:18.225 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:18.225 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:18.225 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "", 2023-07-14T18:29:18.225 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:18.225 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:18.226 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:18.226 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:18.226 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:18.226 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:18.226 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:18.227 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:18.227 INFO:teuthology.orchestra.run.smithi163.stdout: "crt_file": { 2023-07-14T18:29:18.227 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "crt_file", 2023-07-14T18:29:18.227 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "str", 2023-07-14T18:29:18.227 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:18.228 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:18.228 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "", 2023-07-14T18:29:18.228 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:18.228 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:18.228 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:18.229 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:18.229 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:18.229 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:18.229 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:18.229 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:18.230 INFO:teuthology.orchestra.run.smithi163.stdout: "debug": { 2023-07-14T18:29:18.230 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "debug", 2023-07-14T18:29:18.230 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "bool", 2023-07-14T18:29:18.230 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:18.230 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:18.230 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "False", 2023-07-14T18:29:18.231 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:18.231 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:18.231 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:18.231 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "Enable/disable debug options", 2023-07-14T18:29:18.231 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:18.232 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:18.232 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:18.232 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:18.232 INFO:teuthology.orchestra.run.smithi163.stdout: "jwt_token_ttl": { 2023-07-14T18:29:18.232 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "jwt_token_ttl", 2023-07-14T18:29:18.233 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "int", 2023-07-14T18:29:18.233 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:18.233 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:18.233 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "28800", 2023-07-14T18:29:18.233 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:18.234 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:18.234 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:18.234 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:18.234 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:18.234 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:18.235 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:18.235 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:18.235 INFO:teuthology.orchestra.run.smithi163.stdout: "key_file": { 2023-07-14T18:29:18.235 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "key_file", 2023-07-14T18:29:18.235 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "str", 2023-07-14T18:29:18.236 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:18.236 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:18.236 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "", 2023-07-14T18:29:18.236 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:18.236 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:18.236 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:18.237 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:18.237 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:18.237 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:18.237 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:18.237 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:18.238 INFO:teuthology.orchestra.run.smithi163.stdout: "log_level": { 2023-07-14T18:29:18.238 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "log_level", 2023-07-14T18:29:18.238 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "str", 2023-07-14T18:29:18.238 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:18.238 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:18.239 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "", 2023-07-14T18:29:18.239 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:18.239 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:18.239 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [ 2023-07-14T18:29:18.239 INFO:teuthology.orchestra.run.smithi163.stdout: "", 2023-07-14T18:29:18.240 INFO:teuthology.orchestra.run.smithi163.stdout: "critical", 2023-07-14T18:29:18.240 INFO:teuthology.orchestra.run.smithi163.stdout: "debug", 2023-07-14T18:29:18.240 INFO:teuthology.orchestra.run.smithi163.stdout: "error", 2023-07-14T18:29:18.240 INFO:teuthology.orchestra.run.smithi163.stdout: "info", 2023-07-14T18:29:18.240 INFO:teuthology.orchestra.run.smithi163.stdout: "warning" 2023-07-14T18:29:18.241 INFO:teuthology.orchestra.run.smithi163.stdout: ], 2023-07-14T18:29:18.241 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:18.241 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:18.241 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:18.241 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:18.241 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:18.242 INFO:teuthology.orchestra.run.smithi163.stdout: "log_to_cluster": { 2023-07-14T18:29:18.242 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "log_to_cluster", 2023-07-14T18:29:18.242 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "bool", 2023-07-14T18:29:18.242 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:18.242 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:18.243 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "False", 2023-07-14T18:29:18.243 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:18.243 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:18.243 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:18.243 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:18.244 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:18.244 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:18.244 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:18.244 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:18.244 INFO:teuthology.orchestra.run.smithi163.stdout: "log_to_cluster_level": { 2023-07-14T18:29:18.245 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "log_to_cluster_level", 2023-07-14T18:29:18.245 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "str", 2023-07-14T18:29:18.245 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:18.245 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:18.245 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "info", 2023-07-14T18:29:18.246 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:18.246 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:18.246 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [ 2023-07-14T18:29:18.246 INFO:teuthology.orchestra.run.smithi163.stdout: "", 2023-07-14T18:29:18.246 INFO:teuthology.orchestra.run.smithi163.stdout: "critical", 2023-07-14T18:29:18.247 INFO:teuthology.orchestra.run.smithi163.stdout: "debug", 2023-07-14T18:29:18.247 INFO:teuthology.orchestra.run.smithi163.stdout: "error", 2023-07-14T18:29:18.247 INFO:teuthology.orchestra.run.smithi163.stdout: "info", 2023-07-14T18:29:18.247 INFO:teuthology.orchestra.run.smithi163.stdout: "warning" 2023-07-14T18:29:18.247 INFO:teuthology.orchestra.run.smithi163.stdout: ], 2023-07-14T18:29:18.247 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:18.248 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:18.248 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:18.248 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:18.248 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:18.248 INFO:teuthology.orchestra.run.smithi163.stdout: "log_to_file": { 2023-07-14T18:29:18.249 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "log_to_file", 2023-07-14T18:29:18.249 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "bool", 2023-07-14T18:29:18.249 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:18.249 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:18.249 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "False", 2023-07-14T18:29:18.250 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:18.250 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:18.250 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:18.250 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:18.250 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:18.251 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:18.251 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:18.251 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:18.251 INFO:teuthology.orchestra.run.smithi163.stdout: "motd": { 2023-07-14T18:29:18.251 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "motd", 2023-07-14T18:29:18.252 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "str", 2023-07-14T18:29:18.252 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:18.252 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:18.252 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "", 2023-07-14T18:29:18.252 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:18.253 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:18.253 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:18.253 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "The message of the day", 2023-07-14T18:29:18.253 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:18.253 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:18.254 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:18.254 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:18.254 INFO:teuthology.orchestra.run.smithi163.stdout: "redirect_resolve_ip_addr": { 2023-07-14T18:29:18.254 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "redirect_resolve_ip_addr", 2023-07-14T18:29:18.254 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "bool", 2023-07-14T18:29:18.255 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:18.255 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:18.255 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "False", 2023-07-14T18:29:18.255 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:18.255 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:18.255 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:18.256 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:18.256 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:18.256 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:18.256 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:18.256 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:18.257 INFO:teuthology.orchestra.run.smithi163.stdout: "server_addr": { 2023-07-14T18:29:18.257 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "server_addr", 2023-07-14T18:29:18.257 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "str", 2023-07-14T18:29:18.257 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:18.257 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:18.258 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "::", 2023-07-14T18:29:18.258 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:18.258 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:18.258 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:18.258 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:18.259 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:18.259 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:18.259 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:18.259 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:18.259 INFO:teuthology.orchestra.run.smithi163.stdout: "server_port": { 2023-07-14T18:29:18.260 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "server_port", 2023-07-14T18:29:18.260 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "int", 2023-07-14T18:29:18.260 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:18.260 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:18.260 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "8080", 2023-07-14T18:29:18.261 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:18.261 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:18.261 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:18.261 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:18.261 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:18.262 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:18.262 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:18.262 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:18.262 INFO:teuthology.orchestra.run.smithi163.stdout: "ssl": { 2023-07-14T18:29:18.262 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "ssl", 2023-07-14T18:29:18.263 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "bool", 2023-07-14T18:29:18.263 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:18.263 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:18.263 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "True", 2023-07-14T18:29:18.263 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:18.263 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:18.264 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:18.264 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:18.264 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:18.264 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:18.264 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:18.265 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:18.265 INFO:teuthology.orchestra.run.smithi163.stdout: "ssl_server_port": { 2023-07-14T18:29:18.265 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "ssl_server_port", 2023-07-14T18:29:18.265 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "int", 2023-07-14T18:29:18.265 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:18.266 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:18.266 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "8443", 2023-07-14T18:29:18.266 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:18.266 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:18.266 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:18.267 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:18.267 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:18.267 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:18.267 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:18.267 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:18.268 INFO:teuthology.orchestra.run.smithi163.stdout: "standby_behaviour": { 2023-07-14T18:29:18.268 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "standby_behaviour", 2023-07-14T18:29:18.268 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "str", 2023-07-14T18:29:18.268 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:18.268 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:18.269 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "redirect", 2023-07-14T18:29:18.269 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:18.269 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:18.269 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [ 2023-07-14T18:29:18.269 INFO:teuthology.orchestra.run.smithi163.stdout: "error", 2023-07-14T18:29:18.270 INFO:teuthology.orchestra.run.smithi163.stdout: "redirect" 2023-07-14T18:29:18.270 INFO:teuthology.orchestra.run.smithi163.stdout: ], 2023-07-14T18:29:18.270 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:18.270 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:18.270 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:18.271 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:18.271 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:18.271 INFO:teuthology.orchestra.run.smithi163.stdout: "standby_error_status_code": { 2023-07-14T18:29:18.271 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "standby_error_status_code", 2023-07-14T18:29:18.271 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "int", 2023-07-14T18:29:18.271 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:18.272 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:18.272 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "500", 2023-07-14T18:29:18.272 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "400", 2023-07-14T18:29:18.272 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "599", 2023-07-14T18:29:18.272 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:18.273 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:18.273 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:18.273 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:18.273 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:18.273 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:18.274 INFO:teuthology.orchestra.run.smithi163.stdout: "url_prefix": { 2023-07-14T18:29:18.274 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "url_prefix", 2023-07-14T18:29:18.274 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "str", 2023-07-14T18:29:18.274 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:18.274 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:18.275 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "", 2023-07-14T18:29:18.275 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:18.275 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:18.275 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:18.275 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:18.276 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:18.276 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:18.276 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:18.276 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-07-14T18:29:18.276 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-07-14T18:29:18.277 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:18.277 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-07-14T18:29:18.277 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "devicehealth", 2023-07-14T18:29:18.277 INFO:teuthology.orchestra.run.smithi163.stdout: "can_run": true, 2023-07-14T18:29:18.277 INFO:teuthology.orchestra.run.smithi163.stdout: "error_string": "", 2023-07-14T18:29:18.277 INFO:teuthology.orchestra.run.smithi163.stdout: "module_options": { 2023-07-14T18:29:18.278 INFO:teuthology.orchestra.run.smithi163.stdout: "enable_monitoring": { 2023-07-14T18:29:18.278 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "enable_monitoring", 2023-07-14T18:29:18.278 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "bool", 2023-07-14T18:29:18.278 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:18.278 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:18.279 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "True", 2023-07-14T18:29:18.279 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:18.279 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:18.279 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:18.279 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "monitor device health metrics", 2023-07-14T18:29:18.280 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:18.280 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:18.280 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:18.280 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:18.280 INFO:teuthology.orchestra.run.smithi163.stdout: "log_level": { 2023-07-14T18:29:18.281 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "log_level", 2023-07-14T18:29:18.281 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "str", 2023-07-14T18:29:18.281 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:18.281 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:18.281 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "", 2023-07-14T18:29:18.281 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:18.282 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:18.282 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [ 2023-07-14T18:29:18.282 INFO:teuthology.orchestra.run.smithi163.stdout: "", 2023-07-14T18:29:18.282 INFO:teuthology.orchestra.run.smithi163.stdout: "critical", 2023-07-14T18:29:18.282 INFO:teuthology.orchestra.run.smithi163.stdout: "debug", 2023-07-14T18:29:18.283 INFO:teuthology.orchestra.run.smithi163.stdout: "error", 2023-07-14T18:29:18.283 INFO:teuthology.orchestra.run.smithi163.stdout: "info", 2023-07-14T18:29:18.283 INFO:teuthology.orchestra.run.smithi163.stdout: "warning" 2023-07-14T18:29:18.283 INFO:teuthology.orchestra.run.smithi163.stdout: ], 2023-07-14T18:29:18.283 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:18.284 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:18.284 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:18.284 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:18.284 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:18.284 INFO:teuthology.orchestra.run.smithi163.stdout: "log_to_cluster": { 2023-07-14T18:29:18.285 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "log_to_cluster", 2023-07-14T18:29:18.285 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "bool", 2023-07-14T18:29:18.285 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:18.285 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:18.285 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "False", 2023-07-14T18:29:18.286 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:18.286 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:18.286 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:18.286 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:18.286 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:18.286 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:18.287 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:18.287 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:18.287 INFO:teuthology.orchestra.run.smithi163.stdout: "log_to_cluster_level": { 2023-07-14T18:29:18.287 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "log_to_cluster_level", 2023-07-14T18:29:18.287 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "str", 2023-07-14T18:29:18.288 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:18.288 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:18.288 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "info", 2023-07-14T18:29:18.288 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:18.288 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:18.289 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [ 2023-07-14T18:29:18.289 INFO:teuthology.orchestra.run.smithi163.stdout: "", 2023-07-14T18:29:18.289 INFO:teuthology.orchestra.run.smithi163.stdout: "critical", 2023-07-14T18:29:18.289 INFO:teuthology.orchestra.run.smithi163.stdout: "debug", 2023-07-14T18:29:18.289 INFO:teuthology.orchestra.run.smithi163.stdout: "error", 2023-07-14T18:29:18.290 INFO:teuthology.orchestra.run.smithi163.stdout: "info", 2023-07-14T18:29:18.290 INFO:teuthology.orchestra.run.smithi163.stdout: "warning" 2023-07-14T18:29:18.290 INFO:teuthology.orchestra.run.smithi163.stdout: ], 2023-07-14T18:29:18.290 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:18.290 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:18.291 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:18.291 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:18.291 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:18.291 INFO:teuthology.orchestra.run.smithi163.stdout: "log_to_file": { 2023-07-14T18:29:18.291 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "log_to_file", 2023-07-14T18:29:18.292 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "bool", 2023-07-14T18:29:18.292 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:18.292 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:18.292 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "False", 2023-07-14T18:29:18.292 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:18.293 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:18.293 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:18.293 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:18.293 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:18.293 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:18.294 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:18.294 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:18.294 INFO:teuthology.orchestra.run.smithi163.stdout: "mark_out_threshold": { 2023-07-14T18:29:18.294 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "mark_out_threshold", 2023-07-14T18:29:18.294 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "secs", 2023-07-14T18:29:18.295 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:18.295 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:18.295 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "2419200", 2023-07-14T18:29:18.295 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:18.295 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:18.296 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:18.296 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "automatically mark OSD if it may fail before this long", 2023-07-14T18:29:18.296 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:18.296 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:18.296 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:18.297 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:18.297 INFO:teuthology.orchestra.run.smithi163.stdout: "pool_name": { 2023-07-14T18:29:18.297 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "pool_name", 2023-07-14T18:29:18.297 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "str", 2023-07-14T18:29:18.297 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:18.297 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:18.298 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "device_health_metrics", 2023-07-14T18:29:18.298 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:18.298 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:18.298 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:18.298 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "name of pool in which to store device health metrics", 2023-07-14T18:29:18.299 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:18.299 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:18.299 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:18.299 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:18.299 INFO:teuthology.orchestra.run.smithi163.stdout: "retention_period": { 2023-07-14T18:29:18.300 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "retention_period", 2023-07-14T18:29:18.300 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "secs", 2023-07-14T18:29:18.300 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:18.300 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:18.300 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "15552000", 2023-07-14T18:29:18.301 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:18.301 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:18.301 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:18.301 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "how long to retain device health metrics", 2023-07-14T18:29:18.301 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:18.302 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:18.302 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:18.302 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:18.302 INFO:teuthology.orchestra.run.smithi163.stdout: "scrape_frequency": { 2023-07-14T18:29:18.302 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "scrape_frequency", 2023-07-14T18:29:18.303 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "secs", 2023-07-14T18:29:18.303 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:18.303 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:18.303 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "86400", 2023-07-14T18:29:18.303 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:18.303 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:18.304 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:18.304 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "how frequently to scrape device health metrics", 2023-07-14T18:29:18.304 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:18.304 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:18.304 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:18.305 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:18.305 INFO:teuthology.orchestra.run.smithi163.stdout: "self_heal": { 2023-07-14T18:29:18.305 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "self_heal", 2023-07-14T18:29:18.305 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "bool", 2023-07-14T18:29:18.305 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:18.306 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:18.306 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "True", 2023-07-14T18:29:18.306 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:18.306 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:18.306 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:18.307 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "preemptively heal cluster around devices that may fail", 2023-07-14T18:29:18.307 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:18.307 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:18.307 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:18.307 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:18.308 INFO:teuthology.orchestra.run.smithi163.stdout: "sleep_interval": { 2023-07-14T18:29:18.308 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "sleep_interval", 2023-07-14T18:29:18.308 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "secs", 2023-07-14T18:29:18.308 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:18.308 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:18.309 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "600", 2023-07-14T18:29:18.309 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:18.309 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:18.309 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:18.309 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "how frequently to wake up and check device health", 2023-07-14T18:29:18.309 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:18.310 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:18.310 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:18.310 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:18.310 INFO:teuthology.orchestra.run.smithi163.stdout: "warn_threshold": { 2023-07-14T18:29:18.311 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "warn_threshold", 2023-07-14T18:29:18.311 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "secs", 2023-07-14T18:29:18.311 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:18.311 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:18.311 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "7257600", 2023-07-14T18:29:18.312 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:18.312 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:18.312 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:18.312 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "raise health warning if OSD may fail before this long", 2023-07-14T18:29:18.312 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:18.313 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:18.313 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:18.313 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-07-14T18:29:18.313 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-07-14T18:29:18.313 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:18.313 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-07-14T18:29:18.314 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "diskprediction_local", 2023-07-14T18:29:18.314 INFO:teuthology.orchestra.run.smithi163.stdout: "can_run": true, 2023-07-14T18:29:18.314 INFO:teuthology.orchestra.run.smithi163.stdout: "error_string": "", 2023-07-14T18:29:18.314 INFO:teuthology.orchestra.run.smithi163.stdout: "module_options": { 2023-07-14T18:29:18.314 INFO:teuthology.orchestra.run.smithi163.stdout: "log_level": { 2023-07-14T18:29:18.315 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "log_level", 2023-07-14T18:29:18.315 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "str", 2023-07-14T18:29:18.315 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:18.315 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:18.315 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "", 2023-07-14T18:29:18.316 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:18.316 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:18.316 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [ 2023-07-14T18:29:18.316 INFO:teuthology.orchestra.run.smithi163.stdout: "", 2023-07-14T18:29:18.316 INFO:teuthology.orchestra.run.smithi163.stdout: "critical", 2023-07-14T18:29:18.317 INFO:teuthology.orchestra.run.smithi163.stdout: "debug", 2023-07-14T18:29:18.317 INFO:teuthology.orchestra.run.smithi163.stdout: "error", 2023-07-14T18:29:18.317 INFO:teuthology.orchestra.run.smithi163.stdout: "info", 2023-07-14T18:29:18.317 INFO:teuthology.orchestra.run.smithi163.stdout: "warning" 2023-07-14T18:29:18.317 INFO:teuthology.orchestra.run.smithi163.stdout: ], 2023-07-14T18:29:18.318 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:18.318 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:18.318 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:18.318 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:18.318 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:18.318 INFO:teuthology.orchestra.run.smithi163.stdout: "log_to_cluster": { 2023-07-14T18:29:18.319 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "log_to_cluster", 2023-07-14T18:29:18.319 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "bool", 2023-07-14T18:29:18.319 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:18.319 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:18.319 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "False", 2023-07-14T18:29:18.320 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:18.320 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:18.320 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:18.320 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:18.320 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:18.321 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:18.321 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:18.321 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:18.321 INFO:teuthology.orchestra.run.smithi163.stdout: "log_to_cluster_level": { 2023-07-14T18:29:18.321 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "log_to_cluster_level", 2023-07-14T18:29:18.322 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "str", 2023-07-14T18:29:18.322 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:18.322 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:18.322 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "info", 2023-07-14T18:29:18.322 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:18.323 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:18.323 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [ 2023-07-14T18:29:18.323 INFO:teuthology.orchestra.run.smithi163.stdout: "", 2023-07-14T18:29:18.323 INFO:teuthology.orchestra.run.smithi163.stdout: "critical", 2023-07-14T18:29:18.323 INFO:teuthology.orchestra.run.smithi163.stdout: "debug", 2023-07-14T18:29:18.324 INFO:teuthology.orchestra.run.smithi163.stdout: "error", 2023-07-14T18:29:18.324 INFO:teuthology.orchestra.run.smithi163.stdout: "info", 2023-07-14T18:29:18.324 INFO:teuthology.orchestra.run.smithi163.stdout: "warning" 2023-07-14T18:29:18.324 INFO:teuthology.orchestra.run.smithi163.stdout: ], 2023-07-14T18:29:18.324 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:18.325 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:18.325 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:18.325 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:18.325 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:18.325 INFO:teuthology.orchestra.run.smithi163.stdout: "log_to_file": { 2023-07-14T18:29:18.326 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "log_to_file", 2023-07-14T18:29:18.326 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "bool", 2023-07-14T18:29:18.326 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:18.326 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:18.326 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "False", 2023-07-14T18:29:18.326 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:18.327 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:18.327 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:18.327 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:18.327 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:18.327 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:18.328 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:18.328 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:18.328 INFO:teuthology.orchestra.run.smithi163.stdout: "predict_interval": { 2023-07-14T18:29:18.328 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "predict_interval", 2023-07-14T18:29:18.328 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "str", 2023-07-14T18:29:18.329 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:18.329 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:18.329 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "86400", 2023-07-14T18:29:18.329 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:18.329 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:18.330 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:18.330 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:18.330 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:18.330 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:18.330 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:18.331 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:18.331 INFO:teuthology.orchestra.run.smithi163.stdout: "predictor_model": { 2023-07-14T18:29:18.331 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "predictor_model", 2023-07-14T18:29:18.331 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "str", 2023-07-14T18:29:18.331 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:18.332 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:18.332 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "prophetstor", 2023-07-14T18:29:18.332 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:18.332 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:18.332 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:18.333 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:18.333 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:18.333 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:18.333 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:18.333 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:18.334 INFO:teuthology.orchestra.run.smithi163.stdout: "sleep_interval": { 2023-07-14T18:29:18.334 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "sleep_interval", 2023-07-14T18:29:18.334 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "str", 2023-07-14T18:29:18.334 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:18.334 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:18.334 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "600", 2023-07-14T18:29:18.335 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:18.335 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:18.335 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:18.335 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:18.335 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:18.336 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:18.336 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:18.336 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-07-14T18:29:18.336 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-07-14T18:29:18.336 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:18.337 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-07-14T18:29:18.337 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "influx", 2023-07-14T18:29:18.337 INFO:teuthology.orchestra.run.smithi163.stdout: "can_run": false, 2023-07-14T18:29:18.337 INFO:teuthology.orchestra.run.smithi163.stdout: "error_string": "influxdb python module not found", 2023-07-14T18:29:18.337 INFO:teuthology.orchestra.run.smithi163.stdout: "module_options": { 2023-07-14T18:29:18.338 INFO:teuthology.orchestra.run.smithi163.stdout: "batch_size": { 2023-07-14T18:29:18.338 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "batch_size", 2023-07-14T18:29:18.338 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "int", 2023-07-14T18:29:18.338 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:18.338 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:18.339 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "5000", 2023-07-14T18:29:18.339 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:18.339 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:18.339 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:18.339 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2023-07-14T18:29:18.340 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:18.340 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:18.340 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:18.340 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:18.340 INFO:teuthology.orchestra.run.smithi163.stdout: "database": { 2023-07-14T18:29:18.341 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "database", 2023-07-14T18:29:18.341 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "str", 2023-07-14T18:29:18.341 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:18.341 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:18.341 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "ceph", 2023-07-14T18:29:18.341 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:18.342 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:18.342 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:18.342 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2023-07-14T18:29:18.342 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:18.342 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:18.343 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:18.343 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:18.343 INFO:teuthology.orchestra.run.smithi163.stdout: "hostname": { 2023-07-14T18:29:18.343 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "hostname", 2023-07-14T18:29:18.343 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "str", 2023-07-14T18:29:18.344 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:18.344 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:18.344 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "", 2023-07-14T18:29:18.344 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:18.344 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:18.345 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:18.345 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "InfluxDB server hostname", 2023-07-14T18:29:18.345 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:18.345 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:18.345 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:18.345 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:18.346 INFO:teuthology.orchestra.run.smithi163.stdout: "interval": { 2023-07-14T18:29:18.346 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "interval", 2023-07-14T18:29:18.346 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "secs", 2023-07-14T18:29:18.346 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:18.346 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:18.347 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "30", 2023-07-14T18:29:18.347 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "5", 2023-07-14T18:29:18.347 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:18.347 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:18.347 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2023-07-14T18:29:18.348 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:18.348 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:18.348 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:18.348 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:18.348 INFO:teuthology.orchestra.run.smithi163.stdout: "log_level": { 2023-07-14T18:29:18.349 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "log_level", 2023-07-14T18:29:18.349 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "str", 2023-07-14T18:29:18.349 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:18.349 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:18.349 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "", 2023-07-14T18:29:18.350 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:18.350 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:18.350 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [ 2023-07-14T18:29:18.350 INFO:teuthology.orchestra.run.smithi163.stdout: "", 2023-07-14T18:29:18.350 INFO:teuthology.orchestra.run.smithi163.stdout: "critical", 2023-07-14T18:29:18.350 INFO:teuthology.orchestra.run.smithi163.stdout: "debug", 2023-07-14T18:29:18.351 INFO:teuthology.orchestra.run.smithi163.stdout: "error", 2023-07-14T18:29:18.351 INFO:teuthology.orchestra.run.smithi163.stdout: "info", 2023-07-14T18:29:18.351 INFO:teuthology.orchestra.run.smithi163.stdout: "warning" 2023-07-14T18:29:18.351 INFO:teuthology.orchestra.run.smithi163.stdout: ], 2023-07-14T18:29:18.351 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:18.352 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:18.352 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:18.352 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:18.352 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:18.352 INFO:teuthology.orchestra.run.smithi163.stdout: "log_to_cluster": { 2023-07-14T18:29:18.353 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "log_to_cluster", 2023-07-14T18:29:18.353 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "bool", 2023-07-14T18:29:18.353 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:18.353 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:18.353 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "False", 2023-07-14T18:29:18.354 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:18.354 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:18.354 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:18.354 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:18.354 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:18.354 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:18.355 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:18.355 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:18.355 INFO:teuthology.orchestra.run.smithi163.stdout: "log_to_cluster_level": { 2023-07-14T18:29:18.355 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "log_to_cluster_level", 2023-07-14T18:29:18.355 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "str", 2023-07-14T18:29:18.356 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:18.356 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:18.356 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "info", 2023-07-14T18:29:18.356 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:18.356 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:18.357 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [ 2023-07-14T18:29:18.357 INFO:teuthology.orchestra.run.smithi163.stdout: "", 2023-07-14T18:29:18.357 INFO:teuthology.orchestra.run.smithi163.stdout: "critical", 2023-07-14T18:29:18.357 INFO:teuthology.orchestra.run.smithi163.stdout: "debug", 2023-07-14T18:29:18.357 INFO:teuthology.orchestra.run.smithi163.stdout: "error", 2023-07-14T18:29:18.358 INFO:teuthology.orchestra.run.smithi163.stdout: "info", 2023-07-14T18:29:18.358 INFO:teuthology.orchestra.run.smithi163.stdout: "warning" 2023-07-14T18:29:18.358 INFO:teuthology.orchestra.run.smithi163.stdout: ], 2023-07-14T18:29:18.358 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:18.358 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:18.359 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:18.359 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:18.359 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:18.359 INFO:teuthology.orchestra.run.smithi163.stdout: "log_to_file": { 2023-07-14T18:29:18.359 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "log_to_file", 2023-07-14T18:29:18.360 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "bool", 2023-07-14T18:29:18.360 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:18.360 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:18.360 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "False", 2023-07-14T18:29:18.360 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:18.361 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:18.361 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:18.361 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:18.361 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:18.361 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:18.362 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:18.362 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:18.362 INFO:teuthology.orchestra.run.smithi163.stdout: "password": { 2023-07-14T18:29:18.362 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "password", 2023-07-14T18:29:18.362 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "str", 2023-07-14T18:29:18.362 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:18.363 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:18.363 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "", 2023-07-14T18:29:18.363 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:18.363 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:18.363 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:18.364 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "password of InfluxDB server user", 2023-07-14T18:29:18.364 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:18.364 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:18.364 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:18.365 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:18.365 INFO:teuthology.orchestra.run.smithi163.stdout: "port": { 2023-07-14T18:29:18.365 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "port", 2023-07-14T18:29:18.365 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "int", 2023-07-14T18:29:18.365 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:18.366 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:18.366 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "8086", 2023-07-14T18:29:18.366 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:18.366 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:18.366 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:18.367 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "InfluxDB server port", 2023-07-14T18:29:18.367 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:18.367 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:18.367 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:18.367 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:18.367 INFO:teuthology.orchestra.run.smithi163.stdout: "ssl": { 2023-07-14T18:29:18.368 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "ssl", 2023-07-14T18:29:18.368 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "str", 2023-07-14T18:29:18.368 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:18.368 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:18.368 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "false", 2023-07-14T18:29:18.369 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:18.369 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:18.369 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:18.369 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2023-07-14T18:29:18.369 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:18.370 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:18.370 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:18.370 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:18.370 INFO:teuthology.orchestra.run.smithi163.stdout: "threads": { 2023-07-14T18:29:18.370 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "threads", 2023-07-14T18:29:18.371 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "int", 2023-07-14T18:29:18.371 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:18.371 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:18.371 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "5", 2023-07-14T18:29:18.371 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "1", 2023-07-14T18:29:18.372 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "32", 2023-07-14T18:29:18.372 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:18.372 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2023-07-14T18:29:18.372 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:18.372 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:18.373 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:18.373 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:18.373 INFO:teuthology.orchestra.run.smithi163.stdout: "username": { 2023-07-14T18:29:18.373 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "username", 2023-07-14T18:29:18.373 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "str", 2023-07-14T18:29:18.374 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:18.374 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:18.374 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "", 2023-07-14T18:29:18.374 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:18.374 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:18.375 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:18.375 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "username of InfluxDB server user", 2023-07-14T18:29:18.375 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:18.375 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:18.375 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:18.375 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:18.376 INFO:teuthology.orchestra.run.smithi163.stdout: "verify_ssl": { 2023-07-14T18:29:18.376 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "verify_ssl", 2023-07-14T18:29:18.376 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "str", 2023-07-14T18:29:18.376 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:18.376 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:18.377 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "true", 2023-07-14T18:29:18.377 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:18.377 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:18.377 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:18.377 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2023-07-14T18:29:18.378 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:18.378 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:18.378 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:18.378 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-07-14T18:29:18.378 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-07-14T18:29:18.379 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:18.379 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-07-14T18:29:18.379 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "insights", 2023-07-14T18:29:18.379 INFO:teuthology.orchestra.run.smithi163.stdout: "can_run": true, 2023-07-14T18:29:18.379 INFO:teuthology.orchestra.run.smithi163.stdout: "error_string": "", 2023-07-14T18:29:18.380 INFO:teuthology.orchestra.run.smithi163.stdout: "module_options": { 2023-07-14T18:29:18.380 INFO:teuthology.orchestra.run.smithi163.stdout: "log_level": { 2023-07-14T18:29:18.380 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "log_level", 2023-07-14T18:29:18.380 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "str", 2023-07-14T18:29:18.380 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:18.380 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:18.381 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "", 2023-07-14T18:29:18.381 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:18.381 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:18.381 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [ 2023-07-14T18:29:18.381 INFO:teuthology.orchestra.run.smithi163.stdout: "", 2023-07-14T18:29:18.382 INFO:teuthology.orchestra.run.smithi163.stdout: "critical", 2023-07-14T18:29:18.382 INFO:teuthology.orchestra.run.smithi163.stdout: "debug", 2023-07-14T18:29:18.382 INFO:teuthology.orchestra.run.smithi163.stdout: "error", 2023-07-14T18:29:18.382 INFO:teuthology.orchestra.run.smithi163.stdout: "info", 2023-07-14T18:29:18.382 INFO:teuthology.orchestra.run.smithi163.stdout: "warning" 2023-07-14T18:29:18.383 INFO:teuthology.orchestra.run.smithi163.stdout: ], 2023-07-14T18:29:18.383 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:18.383 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:18.383 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:18.383 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:18.384 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:18.384 INFO:teuthology.orchestra.run.smithi163.stdout: "log_to_cluster": { 2023-07-14T18:29:18.384 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "log_to_cluster", 2023-07-14T18:29:18.384 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "bool", 2023-07-14T18:29:18.384 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:18.385 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:18.385 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "False", 2023-07-14T18:29:18.385 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:18.385 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:18.385 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:18.385 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:18.386 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:18.386 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:18.386 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:18.386 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:18.386 INFO:teuthology.orchestra.run.smithi163.stdout: "log_to_cluster_level": { 2023-07-14T18:29:18.387 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "log_to_cluster_level", 2023-07-14T18:29:18.387 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "str", 2023-07-14T18:29:18.387 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:18.387 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:18.387 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "info", 2023-07-14T18:29:18.388 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:18.388 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:18.388 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [ 2023-07-14T18:29:18.388 INFO:teuthology.orchestra.run.smithi163.stdout: "", 2023-07-14T18:29:18.388 INFO:teuthology.orchestra.run.smithi163.stdout: "critical", 2023-07-14T18:29:18.389 INFO:teuthology.orchestra.run.smithi163.stdout: "debug", 2023-07-14T18:29:18.389 INFO:teuthology.orchestra.run.smithi163.stdout: "error", 2023-07-14T18:29:18.389 INFO:teuthology.orchestra.run.smithi163.stdout: "info", 2023-07-14T18:29:18.389 INFO:teuthology.orchestra.run.smithi163.stdout: "warning" 2023-07-14T18:29:18.389 INFO:teuthology.orchestra.run.smithi163.stdout: ], 2023-07-14T18:29:18.390 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:18.390 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:18.390 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:18.390 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:18.390 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:18.391 INFO:teuthology.orchestra.run.smithi163.stdout: "log_to_file": { 2023-07-14T18:29:18.391 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "log_to_file", 2023-07-14T18:29:18.391 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "bool", 2023-07-14T18:29:18.391 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:18.391 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:18.391 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "False", 2023-07-14T18:29:18.392 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:18.392 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:18.392 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:18.392 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:18.392 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:18.393 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:18.393 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:18.393 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-07-14T18:29:18.393 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-07-14T18:29:18.393 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:18.394 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-07-14T18:29:18.394 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "iostat", 2023-07-14T18:29:18.394 INFO:teuthology.orchestra.run.smithi163.stdout: "can_run": true, 2023-07-14T18:29:18.394 INFO:teuthology.orchestra.run.smithi163.stdout: "error_string": "", 2023-07-14T18:29:18.394 INFO:teuthology.orchestra.run.smithi163.stdout: "module_options": { 2023-07-14T18:29:18.395 INFO:teuthology.orchestra.run.smithi163.stdout: "log_level": { 2023-07-14T18:29:18.395 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "log_level", 2023-07-14T18:29:18.395 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "str", 2023-07-14T18:29:18.395 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:18.395 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:18.395 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "", 2023-07-14T18:29:18.396 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:18.396 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:18.396 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [ 2023-07-14T18:29:18.396 INFO:teuthology.orchestra.run.smithi163.stdout: "", 2023-07-14T18:29:18.396 INFO:teuthology.orchestra.run.smithi163.stdout: "critical", 2023-07-14T18:29:18.397 INFO:teuthology.orchestra.run.smithi163.stdout: "debug", 2023-07-14T18:29:18.397 INFO:teuthology.orchestra.run.smithi163.stdout: "error", 2023-07-14T18:29:18.397 INFO:teuthology.orchestra.run.smithi163.stdout: "info", 2023-07-14T18:29:18.397 INFO:teuthology.orchestra.run.smithi163.stdout: "warning" 2023-07-14T18:29:18.397 INFO:teuthology.orchestra.run.smithi163.stdout: ], 2023-07-14T18:29:18.398 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:18.398 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:18.398 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:18.398 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:18.398 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:18.399 INFO:teuthology.orchestra.run.smithi163.stdout: "log_to_cluster": { 2023-07-14T18:29:18.399 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "log_to_cluster", 2023-07-14T18:29:18.399 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "bool", 2023-07-14T18:29:18.399 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:18.399 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:18.400 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "False", 2023-07-14T18:29:18.400 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:18.400 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:18.400 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:18.400 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:18.401 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:18.401 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:18.401 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:18.401 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:18.401 INFO:teuthology.orchestra.run.smithi163.stdout: "log_to_cluster_level": { 2023-07-14T18:29:18.402 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "log_to_cluster_level", 2023-07-14T18:29:18.402 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "str", 2023-07-14T18:29:18.402 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:18.402 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:18.402 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "info", 2023-07-14T18:29:18.403 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:18.403 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:18.403 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [ 2023-07-14T18:29:18.403 INFO:teuthology.orchestra.run.smithi163.stdout: "", 2023-07-14T18:29:18.403 INFO:teuthology.orchestra.run.smithi163.stdout: "critical", 2023-07-14T18:29:18.404 INFO:teuthology.orchestra.run.smithi163.stdout: "debug", 2023-07-14T18:29:18.404 INFO:teuthology.orchestra.run.smithi163.stdout: "error", 2023-07-14T18:29:18.404 INFO:teuthology.orchestra.run.smithi163.stdout: "info", 2023-07-14T18:29:18.404 INFO:teuthology.orchestra.run.smithi163.stdout: "warning" 2023-07-14T18:29:18.404 INFO:teuthology.orchestra.run.smithi163.stdout: ], 2023-07-14T18:29:18.405 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:18.405 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:18.405 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:18.405 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:18.405 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:18.405 INFO:teuthology.orchestra.run.smithi163.stdout: "log_to_file": { 2023-07-14T18:29:18.406 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "log_to_file", 2023-07-14T18:29:18.406 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "bool", 2023-07-14T18:29:18.406 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:18.406 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:18.406 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "False", 2023-07-14T18:29:18.407 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:18.407 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:18.407 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:18.407 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:18.407 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:18.408 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:18.408 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:18.408 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-07-14T18:29:18.408 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-07-14T18:29:18.408 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:18.409 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-07-14T18:29:18.409 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "k8sevents", 2023-07-14T18:29:18.409 INFO:teuthology.orchestra.run.smithi163.stdout: "can_run": true, 2023-07-14T18:29:18.409 INFO:teuthology.orchestra.run.smithi163.stdout: "error_string": "", 2023-07-14T18:29:18.409 INFO:teuthology.orchestra.run.smithi163.stdout: "module_options": { 2023-07-14T18:29:18.410 INFO:teuthology.orchestra.run.smithi163.stdout: "ceph_event_retention_days": { 2023-07-14T18:29:18.410 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "ceph_event_retention_days", 2023-07-14T18:29:18.410 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "int", 2023-07-14T18:29:18.410 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:18.410 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:18.411 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "7", 2023-07-14T18:29:18.411 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:18.411 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:18.411 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:18.411 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "Days to hold ceph event information within local cache", 2023-07-14T18:29:18.412 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:18.412 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:18.412 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:18.412 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:18.412 INFO:teuthology.orchestra.run.smithi163.stdout: "config_check_secs": { 2023-07-14T18:29:18.413 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "config_check_secs", 2023-07-14T18:29:18.413 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "int", 2023-07-14T18:29:18.413 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:18.413 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:18.413 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "10", 2023-07-14T18:29:18.414 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "10", 2023-07-14T18:29:18.414 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:18.414 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:18.414 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2023-07-14T18:29:18.414 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:18.415 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:18.415 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:18.415 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:18.415 INFO:teuthology.orchestra.run.smithi163.stdout: "log_level": { 2023-07-14T18:29:18.415 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "log_level", 2023-07-14T18:29:18.416 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "str", 2023-07-14T18:29:18.416 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:18.416 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:18.416 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "", 2023-07-14T18:29:18.416 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:18.417 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:18.417 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [ 2023-07-14T18:29:18.417 INFO:teuthology.orchestra.run.smithi163.stdout: "", 2023-07-14T18:29:18.417 INFO:teuthology.orchestra.run.smithi163.stdout: "critical", 2023-07-14T18:29:18.417 INFO:teuthology.orchestra.run.smithi163.stdout: "debug", 2023-07-14T18:29:18.418 INFO:teuthology.orchestra.run.smithi163.stdout: "error", 2023-07-14T18:29:18.418 INFO:teuthology.orchestra.run.smithi163.stdout: "info", 2023-07-14T18:29:18.418 INFO:teuthology.orchestra.run.smithi163.stdout: "warning" 2023-07-14T18:29:18.418 INFO:teuthology.orchestra.run.smithi163.stdout: ], 2023-07-14T18:29:18.418 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:18.418 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:18.419 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:18.419 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:18.419 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:18.419 INFO:teuthology.orchestra.run.smithi163.stdout: "log_to_cluster": { 2023-07-14T18:29:18.420 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "log_to_cluster", 2023-07-14T18:29:18.420 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "bool", 2023-07-14T18:29:18.420 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:18.420 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:18.421 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "False", 2023-07-14T18:29:18.421 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:18.421 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:18.421 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:18.422 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:18.422 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:18.422 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:18.422 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:18.422 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:18.423 INFO:teuthology.orchestra.run.smithi163.stdout: "log_to_cluster_level": { 2023-07-14T18:29:18.423 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "log_to_cluster_level", 2023-07-14T18:29:18.423 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "str", 2023-07-14T18:29:18.423 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:18.423 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:18.424 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "info", 2023-07-14T18:29:18.424 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:18.424 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:18.424 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [ 2023-07-14T18:29:18.424 INFO:teuthology.orchestra.run.smithi163.stdout: "", 2023-07-14T18:29:18.425 INFO:teuthology.orchestra.run.smithi163.stdout: "critical", 2023-07-14T18:29:18.425 INFO:teuthology.orchestra.run.smithi163.stdout: "debug", 2023-07-14T18:29:18.425 INFO:teuthology.orchestra.run.smithi163.stdout: "error", 2023-07-14T18:29:18.425 INFO:teuthology.orchestra.run.smithi163.stdout: "info", 2023-07-14T18:29:18.425 INFO:teuthology.orchestra.run.smithi163.stdout: "warning" 2023-07-14T18:29:18.425 INFO:teuthology.orchestra.run.smithi163.stdout: ], 2023-07-14T18:29:18.426 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:18.426 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:18.426 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:18.426 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:18.427 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:18.427 INFO:teuthology.orchestra.run.smithi163.stdout: "log_to_file": { 2023-07-14T18:29:18.427 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "log_to_file", 2023-07-14T18:29:18.427 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "bool", 2023-07-14T18:29:18.427 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:18.428 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:18.428 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "False", 2023-07-14T18:29:18.428 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:18.428 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:18.428 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:18.429 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:18.429 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:18.429 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:18.429 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:18.429 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-07-14T18:29:18.429 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-07-14T18:29:18.430 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:18.430 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-07-14T18:29:18.430 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "localpool", 2023-07-14T18:29:18.430 INFO:teuthology.orchestra.run.smithi163.stdout: "can_run": true, 2023-07-14T18:29:18.430 INFO:teuthology.orchestra.run.smithi163.stdout: "error_string": "", 2023-07-14T18:29:18.431 INFO:teuthology.orchestra.run.smithi163.stdout: "module_options": { 2023-07-14T18:29:18.431 INFO:teuthology.orchestra.run.smithi163.stdout: "failure_domain": { 2023-07-14T18:29:18.431 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "failure_domain", 2023-07-14T18:29:18.431 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "str", 2023-07-14T18:29:18.431 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:18.432 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:18.432 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "host", 2023-07-14T18:29:18.432 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:18.432 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:18.432 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:18.433 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "failure domain for any created local pool", 2023-07-14T18:29:18.433 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2023-07-14T18:29:18.433 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:18.433 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:18.433 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:18.434 INFO:teuthology.orchestra.run.smithi163.stdout: "log_level": { 2023-07-14T18:29:18.434 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "log_level", 2023-07-14T18:29:18.434 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "str", 2023-07-14T18:29:18.434 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:18.434 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:18.435 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "", 2023-07-14T18:29:18.435 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:18.435 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:18.435 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [ 2023-07-14T18:29:18.435 INFO:teuthology.orchestra.run.smithi163.stdout: "", 2023-07-14T18:29:18.436 INFO:teuthology.orchestra.run.smithi163.stdout: "critical", 2023-07-14T18:29:18.436 INFO:teuthology.orchestra.run.smithi163.stdout: "debug", 2023-07-14T18:29:18.436 INFO:teuthology.orchestra.run.smithi163.stdout: "error", 2023-07-14T18:29:18.436 INFO:teuthology.orchestra.run.smithi163.stdout: "info", 2023-07-14T18:29:18.436 INFO:teuthology.orchestra.run.smithi163.stdout: "warning" 2023-07-14T18:29:18.437 INFO:teuthology.orchestra.run.smithi163.stdout: ], 2023-07-14T18:29:18.437 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:18.437 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:18.437 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:18.437 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:18.438 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:18.438 INFO:teuthology.orchestra.run.smithi163.stdout: "log_to_cluster": { 2023-07-14T18:29:18.438 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "log_to_cluster", 2023-07-14T18:29:18.438 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "bool", 2023-07-14T18:29:18.438 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:18.439 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:18.439 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "False", 2023-07-14T18:29:18.439 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:18.439 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:18.440 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:18.440 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:18.440 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:18.440 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:18.441 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:18.441 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:18.441 INFO:teuthology.orchestra.run.smithi163.stdout: "log_to_cluster_level": { 2023-07-14T18:29:18.441 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "log_to_cluster_level", 2023-07-14T18:29:18.441 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "str", 2023-07-14T18:29:18.442 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:18.442 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:18.442 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "info", 2023-07-14T18:29:18.442 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:18.443 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:18.443 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [ 2023-07-14T18:29:18.443 INFO:teuthology.orchestra.run.smithi163.stdout: "", 2023-07-14T18:29:18.443 INFO:teuthology.orchestra.run.smithi163.stdout: "critical", 2023-07-14T18:29:18.444 INFO:teuthology.orchestra.run.smithi163.stdout: "debug", 2023-07-14T18:29:18.444 INFO:teuthology.orchestra.run.smithi163.stdout: "error", 2023-07-14T18:29:18.444 INFO:teuthology.orchestra.run.smithi163.stdout: "info", 2023-07-14T18:29:18.444 INFO:teuthology.orchestra.run.smithi163.stdout: "warning" 2023-07-14T18:29:18.445 INFO:teuthology.orchestra.run.smithi163.stdout: ], 2023-07-14T18:29:18.445 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:18.445 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:18.445 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:18.445 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:18.446 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:18.446 INFO:teuthology.orchestra.run.smithi163.stdout: "log_to_file": { 2023-07-14T18:29:18.446 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "log_to_file", 2023-07-14T18:29:18.447 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "bool", 2023-07-14T18:29:18.447 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:18.447 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:18.447 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "False", 2023-07-14T18:29:18.448 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:18.448 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:18.448 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:18.448 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:18.448 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:18.449 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:18.449 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:18.449 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:18.449 INFO:teuthology.orchestra.run.smithi163.stdout: "min_size": { 2023-07-14T18:29:18.449 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "min_size", 2023-07-14T18:29:18.450 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "int", 2023-07-14T18:29:18.450 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:18.450 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:18.450 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "", 2023-07-14T18:29:18.450 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:18.451 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:18.451 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:18.451 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "default min_size for any created local pool", 2023-07-14T18:29:18.451 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2023-07-14T18:29:18.451 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:18.452 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:18.452 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:18.452 INFO:teuthology.orchestra.run.smithi163.stdout: "num_rep": { 2023-07-14T18:29:18.452 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "num_rep", 2023-07-14T18:29:18.452 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "int", 2023-07-14T18:29:18.453 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:18.453 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:18.453 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "3", 2023-07-14T18:29:18.453 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:18.453 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:18.454 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:18.454 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "default replica count for any created local pool", 2023-07-14T18:29:18.454 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:18.454 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:18.454 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:18.454 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:18.455 INFO:teuthology.orchestra.run.smithi163.stdout: "pg_num": { 2023-07-14T18:29:18.455 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "pg_num", 2023-07-14T18:29:18.455 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "int", 2023-07-14T18:29:18.455 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:18.455 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:18.456 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "128", 2023-07-14T18:29:18.456 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:18.456 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:18.456 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:18.456 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "default pg_num for any created local pool", 2023-07-14T18:29:18.457 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:18.457 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:18.457 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:18.457 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:18.457 INFO:teuthology.orchestra.run.smithi163.stdout: "prefix": { 2023-07-14T18:29:18.458 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "prefix", 2023-07-14T18:29:18.458 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "str", 2023-07-14T18:29:18.458 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:18.458 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:18.458 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "", 2023-07-14T18:29:18.459 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:18.459 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:18.459 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:18.459 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "name prefix for any created local pool", 2023-07-14T18:29:18.459 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:18.460 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:18.460 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:18.460 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:18.460 INFO:teuthology.orchestra.run.smithi163.stdout: "subtree": { 2023-07-14T18:29:18.460 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "subtree", 2023-07-14T18:29:18.461 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "str", 2023-07-14T18:29:18.461 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:18.461 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:18.461 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "rack", 2023-07-14T18:29:18.461 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:18.461 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:18.462 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:18.462 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "CRUSH level for which to create a local pool", 2023-07-14T18:29:18.462 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2023-07-14T18:29:18.462 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:18.462 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:18.463 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-07-14T18:29:18.463 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-07-14T18:29:18.463 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:18.463 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-07-14T18:29:18.463 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "mds_autoscaler", 2023-07-14T18:29:18.464 INFO:teuthology.orchestra.run.smithi163.stdout: "can_run": true, 2023-07-14T18:29:18.464 INFO:teuthology.orchestra.run.smithi163.stdout: "error_string": "", 2023-07-14T18:29:18.464 INFO:teuthology.orchestra.run.smithi163.stdout: "module_options": { 2023-07-14T18:29:18.464 INFO:teuthology.orchestra.run.smithi163.stdout: "log_level": { 2023-07-14T18:29:18.464 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "log_level", 2023-07-14T18:29:18.465 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "str", 2023-07-14T18:29:18.465 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:18.465 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:18.465 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "", 2023-07-14T18:29:18.465 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:18.466 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:18.466 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [ 2023-07-14T18:29:18.466 INFO:teuthology.orchestra.run.smithi163.stdout: "", 2023-07-14T18:29:18.466 INFO:teuthology.orchestra.run.smithi163.stdout: "critical", 2023-07-14T18:29:18.466 INFO:teuthology.orchestra.run.smithi163.stdout: "debug", 2023-07-14T18:29:18.467 INFO:teuthology.orchestra.run.smithi163.stdout: "error", 2023-07-14T18:29:18.467 INFO:teuthology.orchestra.run.smithi163.stdout: "info", 2023-07-14T18:29:18.467 INFO:teuthology.orchestra.run.smithi163.stdout: "warning" 2023-07-14T18:29:18.467 INFO:teuthology.orchestra.run.smithi163.stdout: ], 2023-07-14T18:29:18.467 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:18.468 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:18.468 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:18.468 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:18.468 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:18.468 INFO:teuthology.orchestra.run.smithi163.stdout: "log_to_cluster": { 2023-07-14T18:29:18.469 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "log_to_cluster", 2023-07-14T18:29:18.469 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "bool", 2023-07-14T18:29:18.469 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:18.469 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:18.469 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "False", 2023-07-14T18:29:18.470 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:18.470 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:18.470 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:18.470 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:18.470 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:18.470 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:18.471 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:18.471 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:18.471 INFO:teuthology.orchestra.run.smithi163.stdout: "log_to_cluster_level": { 2023-07-14T18:29:18.471 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "log_to_cluster_level", 2023-07-14T18:29:18.471 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "str", 2023-07-14T18:29:18.472 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:18.472 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:18.472 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "info", 2023-07-14T18:29:18.472 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:18.472 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:18.473 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [ 2023-07-14T18:29:18.473 INFO:teuthology.orchestra.run.smithi163.stdout: "", 2023-07-14T18:29:18.473 INFO:teuthology.orchestra.run.smithi163.stdout: "critical", 2023-07-14T18:29:18.473 INFO:teuthology.orchestra.run.smithi163.stdout: "debug", 2023-07-14T18:29:18.473 INFO:teuthology.orchestra.run.smithi163.stdout: "error", 2023-07-14T18:29:18.474 INFO:teuthology.orchestra.run.smithi163.stdout: "info", 2023-07-14T18:29:18.474 INFO:teuthology.orchestra.run.smithi163.stdout: "warning" 2023-07-14T18:29:18.474 INFO:teuthology.orchestra.run.smithi163.stdout: ], 2023-07-14T18:29:18.474 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:18.474 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:18.475 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:18.475 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:18.475 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:18.475 INFO:teuthology.orchestra.run.smithi163.stdout: "log_to_file": { 2023-07-14T18:29:18.475 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "log_to_file", 2023-07-14T18:29:18.476 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "bool", 2023-07-14T18:29:18.476 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:18.476 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:18.476 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "False", 2023-07-14T18:29:18.476 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:18.477 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:18.477 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:18.477 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:18.477 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:18.477 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:18.478 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:18.478 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-07-14T18:29:18.478 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-07-14T18:29:18.479 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:18.479 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-07-14T18:29:18.479 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "mirroring", 2023-07-14T18:29:18.479 INFO:teuthology.orchestra.run.smithi163.stdout: "can_run": true, 2023-07-14T18:29:18.479 INFO:teuthology.orchestra.run.smithi163.stdout: "error_string": "", 2023-07-14T18:29:18.480 INFO:teuthology.orchestra.run.smithi163.stdout: "module_options": { 2023-07-14T18:29:18.480 INFO:teuthology.orchestra.run.smithi163.stdout: "log_level": { 2023-07-14T18:29:18.480 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "log_level", 2023-07-14T18:29:18.480 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "str", 2023-07-14T18:29:18.480 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:18.481 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:18.481 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "", 2023-07-14T18:29:18.481 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:18.481 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:18.481 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [ 2023-07-14T18:29:18.482 INFO:teuthology.orchestra.run.smithi163.stdout: "", 2023-07-14T18:29:18.482 INFO:teuthology.orchestra.run.smithi163.stdout: "critical", 2023-07-14T18:29:18.482 INFO:teuthology.orchestra.run.smithi163.stdout: "debug", 2023-07-14T18:29:18.482 INFO:teuthology.orchestra.run.smithi163.stdout: "error", 2023-07-14T18:29:18.482 INFO:teuthology.orchestra.run.smithi163.stdout: "info", 2023-07-14T18:29:18.482 INFO:teuthology.orchestra.run.smithi163.stdout: "warning" 2023-07-14T18:29:18.483 INFO:teuthology.orchestra.run.smithi163.stdout: ], 2023-07-14T18:29:18.483 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:18.483 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:18.483 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:18.483 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:18.484 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:18.484 INFO:teuthology.orchestra.run.smithi163.stdout: "log_to_cluster": { 2023-07-14T18:29:18.484 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "log_to_cluster", 2023-07-14T18:29:18.484 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "bool", 2023-07-14T18:29:18.484 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:18.485 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:18.485 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "False", 2023-07-14T18:29:18.485 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:18.485 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:18.485 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:18.486 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:18.486 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:18.486 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:18.486 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:18.486 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:18.487 INFO:teuthology.orchestra.run.smithi163.stdout: "log_to_cluster_level": { 2023-07-14T18:29:18.487 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "log_to_cluster_level", 2023-07-14T18:29:18.487 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "str", 2023-07-14T18:29:18.487 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:18.487 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:18.488 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "info", 2023-07-14T18:29:18.488 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:18.488 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:18.488 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [ 2023-07-14T18:29:18.489 INFO:teuthology.orchestra.run.smithi163.stdout: "", 2023-07-14T18:29:18.489 INFO:teuthology.orchestra.run.smithi163.stdout: "critical", 2023-07-14T18:29:18.489 INFO:teuthology.orchestra.run.smithi163.stdout: "debug", 2023-07-14T18:29:18.490 INFO:teuthology.orchestra.run.smithi163.stdout: "error", 2023-07-14T18:29:18.490 INFO:teuthology.orchestra.run.smithi163.stdout: "info", 2023-07-14T18:29:18.490 INFO:teuthology.orchestra.run.smithi163.stdout: "warning" 2023-07-14T18:29:18.490 INFO:teuthology.orchestra.run.smithi163.stdout: ], 2023-07-14T18:29:18.490 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:18.491 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:18.491 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:18.491 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:18.491 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:18.492 INFO:teuthology.orchestra.run.smithi163.stdout: "log_to_file": { 2023-07-14T18:29:18.492 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "log_to_file", 2023-07-14T18:29:18.492 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "bool", 2023-07-14T18:29:18.493 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:18.493 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:18.493 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "False", 2023-07-14T18:29:18.493 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:18.493 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:18.494 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:18.494 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:18.494 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:18.494 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:18.494 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:18.495 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-07-14T18:29:18.495 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-07-14T18:29:18.495 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:18.495 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-07-14T18:29:18.495 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "nfs", 2023-07-14T18:29:18.496 INFO:teuthology.orchestra.run.smithi163.stdout: "can_run": true, 2023-07-14T18:29:18.496 INFO:teuthology.orchestra.run.smithi163.stdout: "error_string": "", 2023-07-14T18:29:18.496 INFO:teuthology.orchestra.run.smithi163.stdout: "module_options": { 2023-07-14T18:29:18.496 INFO:teuthology.orchestra.run.smithi163.stdout: "log_level": { 2023-07-14T18:29:18.496 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "log_level", 2023-07-14T18:29:18.497 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "str", 2023-07-14T18:29:18.497 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:18.497 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:18.497 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "", 2023-07-14T18:29:18.497 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:18.498 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:18.498 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [ 2023-07-14T18:29:18.498 INFO:teuthology.orchestra.run.smithi163.stdout: "", 2023-07-14T18:29:18.498 INFO:teuthology.orchestra.run.smithi163.stdout: "critical", 2023-07-14T18:29:18.498 INFO:teuthology.orchestra.run.smithi163.stdout: "debug", 2023-07-14T18:29:18.499 INFO:teuthology.orchestra.run.smithi163.stdout: "error", 2023-07-14T18:29:18.499 INFO:teuthology.orchestra.run.smithi163.stdout: "info", 2023-07-14T18:29:18.499 INFO:teuthology.orchestra.run.smithi163.stdout: "warning" 2023-07-14T18:29:18.499 INFO:teuthology.orchestra.run.smithi163.stdout: ], 2023-07-14T18:29:18.499 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:18.500 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:18.500 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:18.500 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:18.500 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:18.500 INFO:teuthology.orchestra.run.smithi163.stdout: "log_to_cluster": { 2023-07-14T18:29:18.501 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "log_to_cluster", 2023-07-14T18:29:18.501 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "bool", 2023-07-14T18:29:18.501 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:18.501 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:18.501 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "False", 2023-07-14T18:29:18.502 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:18.502 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:18.502 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:18.502 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:18.502 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:18.502 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:18.503 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:18.503 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:18.503 INFO:teuthology.orchestra.run.smithi163.stdout: "log_to_cluster_level": { 2023-07-14T18:29:18.503 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "log_to_cluster_level", 2023-07-14T18:29:18.503 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "str", 2023-07-14T18:29:18.504 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:18.504 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:18.504 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "info", 2023-07-14T18:29:18.504 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:18.504 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:18.505 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [ 2023-07-14T18:29:18.505 INFO:teuthology.orchestra.run.smithi163.stdout: "", 2023-07-14T18:29:18.505 INFO:teuthology.orchestra.run.smithi163.stdout: "critical", 2023-07-14T18:29:18.505 INFO:teuthology.orchestra.run.smithi163.stdout: "debug", 2023-07-14T18:29:18.505 INFO:teuthology.orchestra.run.smithi163.stdout: "error", 2023-07-14T18:29:18.506 INFO:teuthology.orchestra.run.smithi163.stdout: "info", 2023-07-14T18:29:18.506 INFO:teuthology.orchestra.run.smithi163.stdout: "warning" 2023-07-14T18:29:18.506 INFO:teuthology.orchestra.run.smithi163.stdout: ], 2023-07-14T18:29:18.506 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:18.506 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:18.507 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:18.507 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:18.507 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:18.507 INFO:teuthology.orchestra.run.smithi163.stdout: "log_to_file": { 2023-07-14T18:29:18.507 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "log_to_file", 2023-07-14T18:29:18.508 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "bool", 2023-07-14T18:29:18.508 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:18.508 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:18.508 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "False", 2023-07-14T18:29:18.509 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:18.509 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:18.509 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:18.510 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:18.510 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:18.510 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:18.511 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:18.511 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-07-14T18:29:18.512 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-07-14T18:29:18.512 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:18.513 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-07-14T18:29:18.513 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "orchestrator", 2023-07-14T18:29:18.513 INFO:teuthology.orchestra.run.smithi163.stdout: "can_run": true, 2023-07-14T18:29:18.514 INFO:teuthology.orchestra.run.smithi163.stdout: "error_string": "", 2023-07-14T18:29:18.514 INFO:teuthology.orchestra.run.smithi163.stdout: "module_options": { 2023-07-14T18:29:18.515 INFO:teuthology.orchestra.run.smithi163.stdout: "fail_fs": { 2023-07-14T18:29:18.515 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "fail_fs", 2023-07-14T18:29:18.515 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "bool", 2023-07-14T18:29:18.515 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:18.515 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:18.516 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "False", 2023-07-14T18:29:18.516 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:18.516 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:18.516 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:18.516 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2023-07-14T18:29:18.517 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:18.517 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:18.517 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:18.517 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:18.517 INFO:teuthology.orchestra.run.smithi163.stdout: "log_level": { 2023-07-14T18:29:18.518 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "log_level", 2023-07-14T18:29:18.518 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "str", 2023-07-14T18:29:18.518 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:18.518 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:18.518 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "", 2023-07-14T18:29:18.519 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:18.519 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:18.519 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [ 2023-07-14T18:29:18.519 INFO:teuthology.orchestra.run.smithi163.stdout: "", 2023-07-14T18:29:18.519 INFO:teuthology.orchestra.run.smithi163.stdout: "critical", 2023-07-14T18:29:18.519 INFO:teuthology.orchestra.run.smithi163.stdout: "debug", 2023-07-14T18:29:18.520 INFO:teuthology.orchestra.run.smithi163.stdout: "error", 2023-07-14T18:29:18.520 INFO:teuthology.orchestra.run.smithi163.stdout: "info", 2023-07-14T18:29:18.520 INFO:teuthology.orchestra.run.smithi163.stdout: "warning" 2023-07-14T18:29:18.520 INFO:teuthology.orchestra.run.smithi163.stdout: ], 2023-07-14T18:29:18.521 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:18.521 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:18.521 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:18.521 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:18.521 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:18.522 INFO:teuthology.orchestra.run.smithi163.stdout: "log_to_cluster": { 2023-07-14T18:29:18.522 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "log_to_cluster", 2023-07-14T18:29:18.522 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "bool", 2023-07-14T18:29:18.522 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:18.522 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:18.523 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "False", 2023-07-14T18:29:18.523 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:18.523 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:18.523 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:18.523 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:18.524 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:18.524 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:18.524 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:18.524 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:18.524 INFO:teuthology.orchestra.run.smithi163.stdout: "log_to_cluster_level": { 2023-07-14T18:29:18.525 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "log_to_cluster_level", 2023-07-14T18:29:18.525 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "str", 2023-07-14T18:29:18.525 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:18.525 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:18.526 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "info", 2023-07-14T18:29:18.526 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:18.526 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:18.526 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [ 2023-07-14T18:29:18.526 INFO:teuthology.orchestra.run.smithi163.stdout: "", 2023-07-14T18:29:18.527 INFO:teuthology.orchestra.run.smithi163.stdout: "critical", 2023-07-14T18:29:18.527 INFO:teuthology.orchestra.run.smithi163.stdout: "debug", 2023-07-14T18:29:18.527 INFO:teuthology.orchestra.run.smithi163.stdout: "error", 2023-07-14T18:29:18.527 INFO:teuthology.orchestra.run.smithi163.stdout: "info", 2023-07-14T18:29:18.527 INFO:teuthology.orchestra.run.smithi163.stdout: "warning" 2023-07-14T18:29:18.528 INFO:teuthology.orchestra.run.smithi163.stdout: ], 2023-07-14T18:29:18.528 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:18.528 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:18.528 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:18.528 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:18.529 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:18.529 INFO:teuthology.orchestra.run.smithi163.stdout: "log_to_file": { 2023-07-14T18:29:18.529 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "log_to_file", 2023-07-14T18:29:18.529 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "bool", 2023-07-14T18:29:18.529 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:18.530 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:18.530 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "False", 2023-07-14T18:29:18.530 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:18.530 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:18.530 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:18.531 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:18.531 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:18.531 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:18.531 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:18.531 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:18.531 INFO:teuthology.orchestra.run.smithi163.stdout: "orchestrator": { 2023-07-14T18:29:18.532 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "orchestrator", 2023-07-14T18:29:18.532 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "str", 2023-07-14T18:29:18.532 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:18.532 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:18.533 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "", 2023-07-14T18:29:18.533 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:18.533 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:18.533 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [ 2023-07-14T18:29:18.533 INFO:teuthology.orchestra.run.smithi163.stdout: "cephadm", 2023-07-14T18:29:18.534 INFO:teuthology.orchestra.run.smithi163.stdout: "rook", 2023-07-14T18:29:18.534 INFO:teuthology.orchestra.run.smithi163.stdout: "test_orchestrator" 2023-07-14T18:29:18.534 INFO:teuthology.orchestra.run.smithi163.stdout: ], 2023-07-14T18:29:18.534 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "Orchestrator backend", 2023-07-14T18:29:18.535 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:18.535 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:18.535 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:18.535 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-07-14T18:29:18.535 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-07-14T18:29:18.535 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:18.536 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-07-14T18:29:18.536 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "osd_perf_query", 2023-07-14T18:29:18.536 INFO:teuthology.orchestra.run.smithi163.stdout: "can_run": true, 2023-07-14T18:29:18.536 INFO:teuthology.orchestra.run.smithi163.stdout: "error_string": "", 2023-07-14T18:29:18.537 INFO:teuthology.orchestra.run.smithi163.stdout: "module_options": { 2023-07-14T18:29:18.537 INFO:teuthology.orchestra.run.smithi163.stdout: "log_level": { 2023-07-14T18:29:18.537 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "log_level", 2023-07-14T18:29:18.537 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "str", 2023-07-14T18:29:18.537 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:18.537 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:18.538 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "", 2023-07-14T18:29:18.538 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:18.538 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:18.538 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [ 2023-07-14T18:29:18.538 INFO:teuthology.orchestra.run.smithi163.stdout: "", 2023-07-14T18:29:18.539 INFO:teuthology.orchestra.run.smithi163.stdout: "critical", 2023-07-14T18:29:18.539 INFO:teuthology.orchestra.run.smithi163.stdout: "debug", 2023-07-14T18:29:18.539 INFO:teuthology.orchestra.run.smithi163.stdout: "error", 2023-07-14T18:29:18.539 INFO:teuthology.orchestra.run.smithi163.stdout: "info", 2023-07-14T18:29:18.540 INFO:teuthology.orchestra.run.smithi163.stdout: "warning" 2023-07-14T18:29:18.540 INFO:teuthology.orchestra.run.smithi163.stdout: ], 2023-07-14T18:29:18.540 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:18.540 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:18.541 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:18.541 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:18.541 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:18.541 INFO:teuthology.orchestra.run.smithi163.stdout: "log_to_cluster": { 2023-07-14T18:29:18.541 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "log_to_cluster", 2023-07-14T18:29:18.542 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "bool", 2023-07-14T18:29:18.542 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:18.542 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:18.542 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "False", 2023-07-14T18:29:18.542 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:18.543 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:18.543 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:18.543 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:18.543 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:18.544 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:18.544 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:18.544 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:18.544 INFO:teuthology.orchestra.run.smithi163.stdout: "log_to_cluster_level": { 2023-07-14T18:29:18.545 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "log_to_cluster_level", 2023-07-14T18:29:18.545 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "str", 2023-07-14T18:29:18.545 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:18.545 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:18.545 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "info", 2023-07-14T18:29:18.545 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:18.546 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:18.546 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [ 2023-07-14T18:29:18.546 INFO:teuthology.orchestra.run.smithi163.stdout: "", 2023-07-14T18:29:18.546 INFO:teuthology.orchestra.run.smithi163.stdout: "critical", 2023-07-14T18:29:18.546 INFO:teuthology.orchestra.run.smithi163.stdout: "debug", 2023-07-14T18:29:18.547 INFO:teuthology.orchestra.run.smithi163.stdout: "error", 2023-07-14T18:29:18.547 INFO:teuthology.orchestra.run.smithi163.stdout: "info", 2023-07-14T18:29:18.547 INFO:teuthology.orchestra.run.smithi163.stdout: "warning" 2023-07-14T18:29:18.547 INFO:teuthology.orchestra.run.smithi163.stdout: ], 2023-07-14T18:29:18.547 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:18.548 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:18.548 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:18.548 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:18.549 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:18.549 INFO:teuthology.orchestra.run.smithi163.stdout: "log_to_file": { 2023-07-14T18:29:18.549 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "log_to_file", 2023-07-14T18:29:18.549 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "bool", 2023-07-14T18:29:18.549 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:18.550 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:18.550 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "False", 2023-07-14T18:29:18.550 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:18.550 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:18.550 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:18.551 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:18.551 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:18.551 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:18.551 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:18.551 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-07-14T18:29:18.552 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-07-14T18:29:18.552 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:18.552 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-07-14T18:29:18.552 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "osd_support", 2023-07-14T18:29:18.552 INFO:teuthology.orchestra.run.smithi163.stdout: "can_run": true, 2023-07-14T18:29:18.553 INFO:teuthology.orchestra.run.smithi163.stdout: "error_string": "", 2023-07-14T18:29:18.553 INFO:teuthology.orchestra.run.smithi163.stdout: "module_options": { 2023-07-14T18:29:18.553 INFO:teuthology.orchestra.run.smithi163.stdout: "log_level": { 2023-07-14T18:29:18.554 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "log_level", 2023-07-14T18:29:18.554 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "str", 2023-07-14T18:29:18.554 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:18.555 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:18.555 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "", 2023-07-14T18:29:18.555 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:18.556 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:18.556 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [ 2023-07-14T18:29:18.556 INFO:teuthology.orchestra.run.smithi163.stdout: "", 2023-07-14T18:29:18.556 INFO:teuthology.orchestra.run.smithi163.stdout: "critical", 2023-07-14T18:29:18.557 INFO:teuthology.orchestra.run.smithi163.stdout: "debug", 2023-07-14T18:29:18.557 INFO:teuthology.orchestra.run.smithi163.stdout: "error", 2023-07-14T18:29:18.557 INFO:teuthology.orchestra.run.smithi163.stdout: "info", 2023-07-14T18:29:18.557 INFO:teuthology.orchestra.run.smithi163.stdout: "warning" 2023-07-14T18:29:18.558 INFO:teuthology.orchestra.run.smithi163.stdout: ], 2023-07-14T18:29:18.558 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:18.558 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:18.559 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:18.559 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:18.559 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:18.559 INFO:teuthology.orchestra.run.smithi163.stdout: "log_to_cluster": { 2023-07-14T18:29:18.560 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "log_to_cluster", 2023-07-14T18:29:18.560 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "bool", 2023-07-14T18:29:18.560 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:18.560 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:18.561 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "False", 2023-07-14T18:29:18.561 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:18.561 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:18.561 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:18.561 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:18.562 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:18.562 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:18.562 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:18.562 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:18.562 INFO:teuthology.orchestra.run.smithi163.stdout: "log_to_cluster_level": { 2023-07-14T18:29:18.562 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "log_to_cluster_level", 2023-07-14T18:29:18.563 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "str", 2023-07-14T18:29:18.563 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:18.563 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:18.563 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "info", 2023-07-14T18:29:18.563 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:18.564 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:18.564 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [ 2023-07-14T18:29:18.564 INFO:teuthology.orchestra.run.smithi163.stdout: "", 2023-07-14T18:29:18.564 INFO:teuthology.orchestra.run.smithi163.stdout: "critical", 2023-07-14T18:29:18.565 INFO:teuthology.orchestra.run.smithi163.stdout: "debug", 2023-07-14T18:29:18.565 INFO:teuthology.orchestra.run.smithi163.stdout: "error", 2023-07-14T18:29:18.565 INFO:teuthology.orchestra.run.smithi163.stdout: "info", 2023-07-14T18:29:18.565 INFO:teuthology.orchestra.run.smithi163.stdout: "warning" 2023-07-14T18:29:18.565 INFO:teuthology.orchestra.run.smithi163.stdout: ], 2023-07-14T18:29:18.566 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:18.566 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:18.566 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:18.566 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:18.566 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:18.566 INFO:teuthology.orchestra.run.smithi163.stdout: "log_to_file": { 2023-07-14T18:29:18.567 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "log_to_file", 2023-07-14T18:29:18.567 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "bool", 2023-07-14T18:29:18.567 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:18.567 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:18.567 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "False", 2023-07-14T18:29:18.568 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:18.568 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:18.568 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:18.568 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:18.568 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:18.569 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:18.569 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:18.569 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-07-14T18:29:18.569 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-07-14T18:29:18.569 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:18.570 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-07-14T18:29:18.570 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "pg_autoscaler", 2023-07-14T18:29:18.570 INFO:teuthology.orchestra.run.smithi163.stdout: "can_run": true, 2023-07-14T18:29:18.570 INFO:teuthology.orchestra.run.smithi163.stdout: "error_string": "", 2023-07-14T18:29:18.570 INFO:teuthology.orchestra.run.smithi163.stdout: "module_options": { 2023-07-14T18:29:18.571 INFO:teuthology.orchestra.run.smithi163.stdout: "log_level": { 2023-07-14T18:29:18.571 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "log_level", 2023-07-14T18:29:18.571 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "str", 2023-07-14T18:29:18.571 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:18.571 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:18.572 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "", 2023-07-14T18:29:18.572 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:18.572 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:18.572 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [ 2023-07-14T18:29:18.572 INFO:teuthology.orchestra.run.smithi163.stdout: "", 2023-07-14T18:29:18.573 INFO:teuthology.orchestra.run.smithi163.stdout: "critical", 2023-07-14T18:29:18.573 INFO:teuthology.orchestra.run.smithi163.stdout: "debug", 2023-07-14T18:29:18.573 INFO:teuthology.orchestra.run.smithi163.stdout: "error", 2023-07-14T18:29:18.573 INFO:teuthology.orchestra.run.smithi163.stdout: "info", 2023-07-14T18:29:18.573 INFO:teuthology.orchestra.run.smithi163.stdout: "warning" 2023-07-14T18:29:18.573 INFO:teuthology.orchestra.run.smithi163.stdout: ], 2023-07-14T18:29:18.574 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:18.574 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:18.574 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:18.574 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:18.574 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:18.575 INFO:teuthology.orchestra.run.smithi163.stdout: "log_to_cluster": { 2023-07-14T18:29:18.575 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "log_to_cluster", 2023-07-14T18:29:18.575 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "bool", 2023-07-14T18:29:18.575 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:18.575 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:18.576 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "False", 2023-07-14T18:29:18.576 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:18.576 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:18.576 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:18.576 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:18.577 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:18.577 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:18.577 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:18.577 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:18.577 INFO:teuthology.orchestra.run.smithi163.stdout: "log_to_cluster_level": { 2023-07-14T18:29:18.578 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "log_to_cluster_level", 2023-07-14T18:29:18.578 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "str", 2023-07-14T18:29:18.578 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:18.578 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:18.578 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "info", 2023-07-14T18:29:18.579 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:18.579 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:18.579 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [ 2023-07-14T18:29:18.579 INFO:teuthology.orchestra.run.smithi163.stdout: "", 2023-07-14T18:29:18.579 INFO:teuthology.orchestra.run.smithi163.stdout: "critical", 2023-07-14T18:29:18.579 INFO:teuthology.orchestra.run.smithi163.stdout: "debug", 2023-07-14T18:29:18.580 INFO:teuthology.orchestra.run.smithi163.stdout: "error", 2023-07-14T18:29:18.580 INFO:teuthology.orchestra.run.smithi163.stdout: "info", 2023-07-14T18:29:18.580 INFO:teuthology.orchestra.run.smithi163.stdout: "warning" 2023-07-14T18:29:18.580 INFO:teuthology.orchestra.run.smithi163.stdout: ], 2023-07-14T18:29:18.580 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:18.581 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:18.581 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:18.581 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:18.581 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:18.581 INFO:teuthology.orchestra.run.smithi163.stdout: "log_to_file": { 2023-07-14T18:29:18.582 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "log_to_file", 2023-07-14T18:29:18.582 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "bool", 2023-07-14T18:29:18.582 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:18.582 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:18.582 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "False", 2023-07-14T18:29:18.583 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:18.583 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:18.583 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:18.583 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:18.583 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:18.584 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:18.584 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:18.584 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:18.584 INFO:teuthology.orchestra.run.smithi163.stdout: "noautoscale": { 2023-07-14T18:29:18.584 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "noautoscale", 2023-07-14T18:29:18.585 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "bool", 2023-07-14T18:29:18.585 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:18.585 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:18.585 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "False", 2023-07-14T18:29:18.585 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:18.585 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:18.586 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:18.586 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "global autoscale flag", 2023-07-14T18:29:18.586 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "Option to turn on/off the autoscaler for all pools", 2023-07-14T18:29:18.586 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:18.586 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:18.587 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:18.587 INFO:teuthology.orchestra.run.smithi163.stdout: "sleep_interval": { 2023-07-14T18:29:18.587 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "sleep_interval", 2023-07-14T18:29:18.587 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "secs", 2023-07-14T18:29:18.587 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:18.588 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:18.588 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "60", 2023-07-14T18:29:18.588 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:18.588 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:18.588 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:18.589 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:18.589 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:18.589 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:18.589 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:18.589 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:18.590 INFO:teuthology.orchestra.run.smithi163.stdout: "threshold": { 2023-07-14T18:29:18.590 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "threshold", 2023-07-14T18:29:18.590 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "float", 2023-07-14T18:29:18.590 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:18.590 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:18.590 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "3.0", 2023-07-14T18:29:18.591 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "1.0", 2023-07-14T18:29:18.591 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:18.591 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:18.591 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "scaling threshold", 2023-07-14T18:29:18.591 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2023-07-14T18:29:18.592 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:18.592 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:18.592 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-07-14T18:29:18.592 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-07-14T18:29:18.592 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:18.593 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-07-14T18:29:18.593 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "progress", 2023-07-14T18:29:18.593 INFO:teuthology.orchestra.run.smithi163.stdout: "can_run": true, 2023-07-14T18:29:18.593 INFO:teuthology.orchestra.run.smithi163.stdout: "error_string": "", 2023-07-14T18:29:18.593 INFO:teuthology.orchestra.run.smithi163.stdout: "module_options": { 2023-07-14T18:29:18.594 INFO:teuthology.orchestra.run.smithi163.stdout: "allow_pg_recovery_event": { 2023-07-14T18:29:18.594 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "allow_pg_recovery_event", 2023-07-14T18:29:18.594 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "bool", 2023-07-14T18:29:18.594 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:18.594 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:18.594 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "False", 2023-07-14T18:29:18.595 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:18.595 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:18.595 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:18.595 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "allow the module to show pg recovery progress", 2023-07-14T18:29:18.595 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:18.596 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:18.596 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:18.596 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:18.596 INFO:teuthology.orchestra.run.smithi163.stdout: "enabled": { 2023-07-14T18:29:18.596 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "enabled", 2023-07-14T18:29:18.597 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "bool", 2023-07-14T18:29:18.597 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:18.597 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:18.597 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "True", 2023-07-14T18:29:18.597 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:18.598 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:18.598 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:18.598 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:18.598 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:18.598 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:18.599 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:18.599 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:18.599 INFO:teuthology.orchestra.run.smithi163.stdout: "log_level": { 2023-07-14T18:29:18.599 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "log_level", 2023-07-14T18:29:18.599 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "str", 2023-07-14T18:29:18.599 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:18.600 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:18.600 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "", 2023-07-14T18:29:18.600 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:18.600 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:18.600 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [ 2023-07-14T18:29:18.601 INFO:teuthology.orchestra.run.smithi163.stdout: "", 2023-07-14T18:29:18.601 INFO:teuthology.orchestra.run.smithi163.stdout: "critical", 2023-07-14T18:29:18.601 INFO:teuthology.orchestra.run.smithi163.stdout: "debug", 2023-07-14T18:29:18.601 INFO:teuthology.orchestra.run.smithi163.stdout: "error", 2023-07-14T18:29:18.601 INFO:teuthology.orchestra.run.smithi163.stdout: "info", 2023-07-14T18:29:18.602 INFO:teuthology.orchestra.run.smithi163.stdout: "warning" 2023-07-14T18:29:18.602 INFO:teuthology.orchestra.run.smithi163.stdout: ], 2023-07-14T18:29:18.602 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:18.602 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:18.602 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:18.603 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:18.603 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:18.603 INFO:teuthology.orchestra.run.smithi163.stdout: "log_to_cluster": { 2023-07-14T18:29:18.603 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "log_to_cluster", 2023-07-14T18:29:18.603 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "bool", 2023-07-14T18:29:18.604 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:18.604 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:18.604 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "False", 2023-07-14T18:29:18.604 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:18.604 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:18.605 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:18.605 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:18.605 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:18.605 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:18.605 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:18.606 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:18.606 INFO:teuthology.orchestra.run.smithi163.stdout: "log_to_cluster_level": { 2023-07-14T18:29:18.606 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "log_to_cluster_level", 2023-07-14T18:29:18.606 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "str", 2023-07-14T18:29:18.606 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:18.607 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:18.607 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "info", 2023-07-14T18:29:18.607 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:18.607 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:18.607 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [ 2023-07-14T18:29:18.607 INFO:teuthology.orchestra.run.smithi163.stdout: "", 2023-07-14T18:29:18.608 INFO:teuthology.orchestra.run.smithi163.stdout: "critical", 2023-07-14T18:29:18.608 INFO:teuthology.orchestra.run.smithi163.stdout: "debug", 2023-07-14T18:29:18.608 INFO:teuthology.orchestra.run.smithi163.stdout: "error", 2023-07-14T18:29:18.608 INFO:teuthology.orchestra.run.smithi163.stdout: "info", 2023-07-14T18:29:18.609 INFO:teuthology.orchestra.run.smithi163.stdout: "warning" 2023-07-14T18:29:18.609 INFO:teuthology.orchestra.run.smithi163.stdout: ], 2023-07-14T18:29:18.609 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:18.609 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:18.609 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:18.609 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:18.610 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:18.610 INFO:teuthology.orchestra.run.smithi163.stdout: "log_to_file": { 2023-07-14T18:29:18.610 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "log_to_file", 2023-07-14T18:29:18.610 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "bool", 2023-07-14T18:29:18.610 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:18.611 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:18.611 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "False", 2023-07-14T18:29:18.611 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:18.611 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:18.611 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:18.612 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:18.612 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:18.612 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:18.612 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:18.612 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:18.613 INFO:teuthology.orchestra.run.smithi163.stdout: "max_completed_events": { 2023-07-14T18:29:18.613 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "max_completed_events", 2023-07-14T18:29:18.613 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "int", 2023-07-14T18:29:18.613 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:18.613 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:18.613 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "50", 2023-07-14T18:29:18.614 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:18.614 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:18.614 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:18.614 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "number of past completed events to remember", 2023-07-14T18:29:18.614 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:18.615 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:18.615 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:18.615 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:18.615 INFO:teuthology.orchestra.run.smithi163.stdout: "sleep_interval": { 2023-07-14T18:29:18.615 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "sleep_interval", 2023-07-14T18:29:18.616 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "secs", 2023-07-14T18:29:18.616 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:18.616 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:18.616 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "5", 2023-07-14T18:29:18.616 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:18.617 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:18.617 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:18.617 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "how long the module is going to sleep", 2023-07-14T18:29:18.617 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:18.617 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:18.618 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:18.618 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-07-14T18:29:18.618 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-07-14T18:29:18.618 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:18.618 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-07-14T18:29:18.619 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "prometheus", 2023-07-14T18:29:18.619 INFO:teuthology.orchestra.run.smithi163.stdout: "can_run": true, 2023-07-14T18:29:18.619 INFO:teuthology.orchestra.run.smithi163.stdout: "error_string": "", 2023-07-14T18:29:18.619 INFO:teuthology.orchestra.run.smithi163.stdout: "module_options": { 2023-07-14T18:29:18.619 INFO:teuthology.orchestra.run.smithi163.stdout: "cache": { 2023-07-14T18:29:18.619 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "cache", 2023-07-14T18:29:18.620 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "bool", 2023-07-14T18:29:18.620 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:18.620 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:18.620 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "True", 2023-07-14T18:29:18.620 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:18.621 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:18.621 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:18.621 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:18.621 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:18.621 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:18.622 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:18.622 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:18.622 INFO:teuthology.orchestra.run.smithi163.stdout: "exclude_perf_counters": { 2023-07-14T18:29:18.622 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "exclude_perf_counters", 2023-07-14T18:29:18.622 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "bool", 2023-07-14T18:29:18.623 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:18.623 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:18.623 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "True", 2023-07-14T18:29:18.623 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:18.623 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:18.623 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:18.624 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "Do not include perf-counters in the metrics output", 2023-07-14T18:29:18.624 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2023-07-14T18:29:18.624 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:18.624 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:18.624 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:18.625 INFO:teuthology.orchestra.run.smithi163.stdout: "log_level": { 2023-07-14T18:29:18.625 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "log_level", 2023-07-14T18:29:18.625 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "str", 2023-07-14T18:29:18.625 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:18.625 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:18.626 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "", 2023-07-14T18:29:18.626 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:18.626 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:18.626 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [ 2023-07-14T18:29:18.626 INFO:teuthology.orchestra.run.smithi163.stdout: "", 2023-07-14T18:29:18.627 INFO:teuthology.orchestra.run.smithi163.stdout: "critical", 2023-07-14T18:29:18.627 INFO:teuthology.orchestra.run.smithi163.stdout: "debug", 2023-07-14T18:29:18.627 INFO:teuthology.orchestra.run.smithi163.stdout: "error", 2023-07-14T18:29:18.627 INFO:teuthology.orchestra.run.smithi163.stdout: "info", 2023-07-14T18:29:18.627 INFO:teuthology.orchestra.run.smithi163.stdout: "warning" 2023-07-14T18:29:18.628 INFO:teuthology.orchestra.run.smithi163.stdout: ], 2023-07-14T18:29:18.628 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:18.628 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:18.628 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:18.628 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:18.629 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:18.629 INFO:teuthology.orchestra.run.smithi163.stdout: "log_to_cluster": { 2023-07-14T18:29:18.629 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "log_to_cluster", 2023-07-14T18:29:18.629 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "bool", 2023-07-14T18:29:18.629 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:18.629 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:18.630 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "False", 2023-07-14T18:29:18.630 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:18.630 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:18.630 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:18.630 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:18.631 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:18.631 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:18.631 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:18.631 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:18.631 INFO:teuthology.orchestra.run.smithi163.stdout: "log_to_cluster_level": { 2023-07-14T18:29:18.632 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "log_to_cluster_level", 2023-07-14T18:29:18.632 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "str", 2023-07-14T18:29:18.632 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:18.632 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:18.632 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "info", 2023-07-14T18:29:18.633 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:18.633 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:18.633 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [ 2023-07-14T18:29:18.633 INFO:teuthology.orchestra.run.smithi163.stdout: "", 2023-07-14T18:29:18.633 INFO:teuthology.orchestra.run.smithi163.stdout: "critical", 2023-07-14T18:29:18.633 INFO:teuthology.orchestra.run.smithi163.stdout: "debug", 2023-07-14T18:29:18.634 INFO:teuthology.orchestra.run.smithi163.stdout: "error", 2023-07-14T18:29:18.634 INFO:teuthology.orchestra.run.smithi163.stdout: "info", 2023-07-14T18:29:18.634 INFO:teuthology.orchestra.run.smithi163.stdout: "warning" 2023-07-14T18:29:18.634 INFO:teuthology.orchestra.run.smithi163.stdout: ], 2023-07-14T18:29:18.634 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:18.635 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:18.635 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:18.635 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:18.635 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:18.635 INFO:teuthology.orchestra.run.smithi163.stdout: "log_to_file": { 2023-07-14T18:29:18.636 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "log_to_file", 2023-07-14T18:29:18.636 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "bool", 2023-07-14T18:29:18.636 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:18.636 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:18.636 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "False", 2023-07-14T18:29:18.637 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:18.637 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:18.637 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:18.637 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:18.637 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:18.638 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:18.638 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:18.638 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:18.638 INFO:teuthology.orchestra.run.smithi163.stdout: "rbd_stats_pools": { 2023-07-14T18:29:18.638 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "rbd_stats_pools", 2023-07-14T18:29:18.639 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "str", 2023-07-14T18:29:18.639 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:18.639 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:18.639 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "", 2023-07-14T18:29:18.639 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:18.640 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:18.640 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:18.640 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:18.640 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:18.640 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:18.641 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:18.641 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:18.641 INFO:teuthology.orchestra.run.smithi163.stdout: "rbd_stats_pools_refresh_interval": { 2023-07-14T18:29:18.641 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "rbd_stats_pools_refresh_interval", 2023-07-14T18:29:18.641 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "int", 2023-07-14T18:29:18.641 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:18.642 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:18.642 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "300", 2023-07-14T18:29:18.642 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:18.642 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:18.642 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:18.643 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:18.643 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:18.643 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:18.643 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:18.643 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:18.644 INFO:teuthology.orchestra.run.smithi163.stdout: "scrape_interval": { 2023-07-14T18:29:18.644 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "scrape_interval", 2023-07-14T18:29:18.644 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "float", 2023-07-14T18:29:18.644 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:18.644 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:18.645 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "15.0", 2023-07-14T18:29:18.645 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:18.645 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:18.645 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:18.645 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:18.646 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:18.646 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:18.646 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:18.646 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:18.646 INFO:teuthology.orchestra.run.smithi163.stdout: "server_addr": { 2023-07-14T18:29:18.646 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "server_addr", 2023-07-14T18:29:18.647 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "str", 2023-07-14T18:29:18.647 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:18.647 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:18.647 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "::", 2023-07-14T18:29:18.647 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:18.648 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:18.648 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:18.648 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2023-07-14T18:29:18.648 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:18.648 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:18.649 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:18.649 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:18.649 INFO:teuthology.orchestra.run.smithi163.stdout: "server_port": { 2023-07-14T18:29:18.649 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "server_port", 2023-07-14T18:29:18.649 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "int", 2023-07-14T18:29:18.650 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:18.650 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:18.650 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "9283", 2023-07-14T18:29:18.650 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:18.650 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:18.650 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:18.651 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "the port on which the module listens for HTTP requests", 2023-07-14T18:29:18.651 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:18.651 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:18.651 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:18.651 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:18.652 INFO:teuthology.orchestra.run.smithi163.stdout: "stale_cache_strategy": { 2023-07-14T18:29:18.652 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "stale_cache_strategy", 2023-07-14T18:29:18.652 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "str", 2023-07-14T18:29:18.652 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:18.652 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:18.653 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "log", 2023-07-14T18:29:18.653 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:18.653 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:18.653 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:18.653 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:18.654 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:18.654 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:18.654 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:18.654 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:18.654 INFO:teuthology.orchestra.run.smithi163.stdout: "standby_behaviour": { 2023-07-14T18:29:18.654 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "standby_behaviour", 2023-07-14T18:29:18.655 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "str", 2023-07-14T18:29:18.655 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:18.655 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:18.655 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "default", 2023-07-14T18:29:18.655 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:18.656 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:18.656 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [ 2023-07-14T18:29:18.656 INFO:teuthology.orchestra.run.smithi163.stdout: "default", 2023-07-14T18:29:18.656 INFO:teuthology.orchestra.run.smithi163.stdout: "error" 2023-07-14T18:29:18.656 INFO:teuthology.orchestra.run.smithi163.stdout: ], 2023-07-14T18:29:18.657 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:18.657 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:18.657 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:18.657 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:18.657 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:18.658 INFO:teuthology.orchestra.run.smithi163.stdout: "standby_error_status_code": { 2023-07-14T18:29:18.658 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "standby_error_status_code", 2023-07-14T18:29:18.658 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "int", 2023-07-14T18:29:18.658 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:18.658 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:18.659 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "500", 2023-07-14T18:29:18.659 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "400", 2023-07-14T18:29:18.659 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "599", 2023-07-14T18:29:18.659 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:18.659 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:18.659 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:18.660 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:18.660 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:18.660 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-07-14T18:29:18.660 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-07-14T18:29:18.660 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:18.661 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-07-14T18:29:18.661 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "rbd_support", 2023-07-14T18:29:18.661 INFO:teuthology.orchestra.run.smithi163.stdout: "can_run": true, 2023-07-14T18:29:18.661 INFO:teuthology.orchestra.run.smithi163.stdout: "error_string": "", 2023-07-14T18:29:18.661 INFO:teuthology.orchestra.run.smithi163.stdout: "module_options": { 2023-07-14T18:29:18.662 INFO:teuthology.orchestra.run.smithi163.stdout: "log_level": { 2023-07-14T18:29:18.662 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "log_level", 2023-07-14T18:29:18.662 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "str", 2023-07-14T18:29:18.662 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:18.662 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:18.663 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "", 2023-07-14T18:29:18.663 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:18.663 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:18.663 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [ 2023-07-14T18:29:18.663 INFO:teuthology.orchestra.run.smithi163.stdout: "", 2023-07-14T18:29:18.664 INFO:teuthology.orchestra.run.smithi163.stdout: "critical", 2023-07-14T18:29:18.664 INFO:teuthology.orchestra.run.smithi163.stdout: "debug", 2023-07-14T18:29:18.664 INFO:teuthology.orchestra.run.smithi163.stdout: "error", 2023-07-14T18:29:18.664 INFO:teuthology.orchestra.run.smithi163.stdout: "info", 2023-07-14T18:29:18.664 INFO:teuthology.orchestra.run.smithi163.stdout: "warning" 2023-07-14T18:29:18.664 INFO:teuthology.orchestra.run.smithi163.stdout: ], 2023-07-14T18:29:18.665 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:18.665 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:18.665 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:18.665 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:18.665 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:18.666 INFO:teuthology.orchestra.run.smithi163.stdout: "log_to_cluster": { 2023-07-14T18:29:18.666 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "log_to_cluster", 2023-07-14T18:29:18.666 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "bool", 2023-07-14T18:29:18.666 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:18.666 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:18.667 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "False", 2023-07-14T18:29:18.667 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:18.667 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:18.667 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:18.667 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:18.668 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:18.668 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:18.668 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:18.668 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:18.668 INFO:teuthology.orchestra.run.smithi163.stdout: "log_to_cluster_level": { 2023-07-14T18:29:18.668 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "log_to_cluster_level", 2023-07-14T18:29:18.669 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "str", 2023-07-14T18:29:18.669 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:18.669 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:18.669 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "info", 2023-07-14T18:29:18.669 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:18.670 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:18.670 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [ 2023-07-14T18:29:18.670 INFO:teuthology.orchestra.run.smithi163.stdout: "", 2023-07-14T18:29:18.670 INFO:teuthology.orchestra.run.smithi163.stdout: "critical", 2023-07-14T18:29:18.670 INFO:teuthology.orchestra.run.smithi163.stdout: "debug", 2023-07-14T18:29:18.671 INFO:teuthology.orchestra.run.smithi163.stdout: "error", 2023-07-14T18:29:18.671 INFO:teuthology.orchestra.run.smithi163.stdout: "info", 2023-07-14T18:29:18.671 INFO:teuthology.orchestra.run.smithi163.stdout: "warning" 2023-07-14T18:29:18.671 INFO:teuthology.orchestra.run.smithi163.stdout: ], 2023-07-14T18:29:18.671 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:18.672 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:18.672 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:18.672 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:18.672 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:18.672 INFO:teuthology.orchestra.run.smithi163.stdout: "log_to_file": { 2023-07-14T18:29:18.673 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "log_to_file", 2023-07-14T18:29:18.673 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "bool", 2023-07-14T18:29:18.673 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:18.673 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:18.673 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "False", 2023-07-14T18:29:18.674 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:18.674 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:18.674 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:18.674 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:18.674 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:18.675 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:18.675 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:18.675 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:18.675 INFO:teuthology.orchestra.run.smithi163.stdout: "max_concurrent_snap_create": { 2023-07-14T18:29:18.675 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "max_concurrent_snap_create", 2023-07-14T18:29:18.675 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "int", 2023-07-14T18:29:18.676 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:18.676 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:18.676 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "10", 2023-07-14T18:29:18.676 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:18.676 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:18.677 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:18.677 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:18.677 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:18.677 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:18.677 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:18.678 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:18.678 INFO:teuthology.orchestra.run.smithi163.stdout: "mirror_snapshot_schedule": { 2023-07-14T18:29:18.678 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "mirror_snapshot_schedule", 2023-07-14T18:29:18.678 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "str", 2023-07-14T18:29:18.678 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:18.679 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:18.679 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "", 2023-07-14T18:29:18.679 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:18.679 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:18.679 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:18.680 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:18.680 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:18.680 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:18.680 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:18.680 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:18.681 INFO:teuthology.orchestra.run.smithi163.stdout: "trash_purge_schedule": { 2023-07-14T18:29:18.681 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "trash_purge_schedule", 2023-07-14T18:29:18.681 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "str", 2023-07-14T18:29:18.681 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:18.681 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:18.681 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "", 2023-07-14T18:29:18.682 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:18.682 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:18.682 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:18.682 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:18.682 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:18.683 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:18.683 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:18.683 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-07-14T18:29:18.683 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-07-14T18:29:18.683 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:18.684 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-07-14T18:29:18.684 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "restful", 2023-07-14T18:29:18.684 INFO:teuthology.orchestra.run.smithi163.stdout: "can_run": true, 2023-07-14T18:29:18.684 INFO:teuthology.orchestra.run.smithi163.stdout: "error_string": "", 2023-07-14T18:29:18.684 INFO:teuthology.orchestra.run.smithi163.stdout: "module_options": { 2023-07-14T18:29:18.685 INFO:teuthology.orchestra.run.smithi163.stdout: "enable_auth": { 2023-07-14T18:29:18.685 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "enable_auth", 2023-07-14T18:29:18.685 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "bool", 2023-07-14T18:29:18.685 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:18.685 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:18.685 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "True", 2023-07-14T18:29:18.686 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:18.686 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:18.686 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:18.686 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:18.686 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:18.687 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:18.687 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:18.687 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:18.687 INFO:teuthology.orchestra.run.smithi163.stdout: "key_file": { 2023-07-14T18:29:18.687 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "key_file", 2023-07-14T18:29:18.688 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "str", 2023-07-14T18:29:18.688 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:18.688 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:18.688 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "", 2023-07-14T18:29:18.688 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:18.689 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:18.689 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:18.689 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:18.689 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:18.689 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:18.689 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:18.690 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:18.690 INFO:teuthology.orchestra.run.smithi163.stdout: "log_level": { 2023-07-14T18:29:18.690 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "log_level", 2023-07-14T18:29:18.690 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "str", 2023-07-14T18:29:18.690 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:18.691 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:18.691 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "", 2023-07-14T18:29:18.691 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:18.691 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:18.691 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [ 2023-07-14T18:29:18.692 INFO:teuthology.orchestra.run.smithi163.stdout: "", 2023-07-14T18:29:18.692 INFO:teuthology.orchestra.run.smithi163.stdout: "critical", 2023-07-14T18:29:18.692 INFO:teuthology.orchestra.run.smithi163.stdout: "debug", 2023-07-14T18:29:18.692 INFO:teuthology.orchestra.run.smithi163.stdout: "error", 2023-07-14T18:29:18.692 INFO:teuthology.orchestra.run.smithi163.stdout: "info", 2023-07-14T18:29:18.693 INFO:teuthology.orchestra.run.smithi163.stdout: "warning" 2023-07-14T18:29:18.693 INFO:teuthology.orchestra.run.smithi163.stdout: ], 2023-07-14T18:29:18.693 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:18.693 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:18.693 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:18.693 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:18.694 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:18.694 INFO:teuthology.orchestra.run.smithi163.stdout: "log_to_cluster": { 2023-07-14T18:29:18.694 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "log_to_cluster", 2023-07-14T18:29:18.694 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "bool", 2023-07-14T18:29:18.694 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:18.695 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:18.695 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "False", 2023-07-14T18:29:18.695 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:18.695 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:18.695 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:18.696 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:18.696 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:18.696 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:18.696 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:18.696 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:18.697 INFO:teuthology.orchestra.run.smithi163.stdout: "log_to_cluster_level": { 2023-07-14T18:29:18.697 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "log_to_cluster_level", 2023-07-14T18:29:18.697 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "str", 2023-07-14T18:29:18.697 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:18.697 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:18.697 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "info", 2023-07-14T18:29:18.698 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:18.698 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:18.698 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [ 2023-07-14T18:29:18.698 INFO:teuthology.orchestra.run.smithi163.stdout: "", 2023-07-14T18:29:18.698 INFO:teuthology.orchestra.run.smithi163.stdout: "critical", 2023-07-14T18:29:18.699 INFO:teuthology.orchestra.run.smithi163.stdout: "debug", 2023-07-14T18:29:18.699 INFO:teuthology.orchestra.run.smithi163.stdout: "error", 2023-07-14T18:29:18.699 INFO:teuthology.orchestra.run.smithi163.stdout: "info", 2023-07-14T18:29:18.699 INFO:teuthology.orchestra.run.smithi163.stdout: "warning" 2023-07-14T18:29:18.699 INFO:teuthology.orchestra.run.smithi163.stdout: ], 2023-07-14T18:29:18.700 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:18.700 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:18.700 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:18.700 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:18.700 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:18.701 INFO:teuthology.orchestra.run.smithi163.stdout: "log_to_file": { 2023-07-14T18:29:18.701 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "log_to_file", 2023-07-14T18:29:18.701 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "bool", 2023-07-14T18:29:18.701 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:18.701 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:18.702 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "False", 2023-07-14T18:29:18.702 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:18.702 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:18.702 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:18.702 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:18.702 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:18.703 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:18.703 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:18.703 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:18.703 INFO:teuthology.orchestra.run.smithi163.stdout: "server_addr": { 2023-07-14T18:29:18.703 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "server_addr", 2023-07-14T18:29:18.704 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "str", 2023-07-14T18:29:18.704 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:18.704 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:18.704 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "", 2023-07-14T18:29:18.704 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:18.705 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:18.705 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:18.705 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:18.705 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:18.705 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:18.706 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:18.706 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:18.706 INFO:teuthology.orchestra.run.smithi163.stdout: "server_port": { 2023-07-14T18:29:18.706 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "server_port", 2023-07-14T18:29:18.706 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "str", 2023-07-14T18:29:18.706 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:18.707 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:18.709 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "", 2023-07-14T18:29:18.709 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:18.709 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:18.709 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:18.709 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:18.710 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:18.710 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:18.710 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:18.710 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-07-14T18:29:18.710 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-07-14T18:29:18.711 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:18.711 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-07-14T18:29:18.711 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "rgw", 2023-07-14T18:29:18.711 INFO:teuthology.orchestra.run.smithi163.stdout: "can_run": true, 2023-07-14T18:29:18.711 INFO:teuthology.orchestra.run.smithi163.stdout: "error_string": "", 2023-07-14T18:29:18.711 INFO:teuthology.orchestra.run.smithi163.stdout: "module_options": { 2023-07-14T18:29:18.712 INFO:teuthology.orchestra.run.smithi163.stdout: "log_level": { 2023-07-14T18:29:18.712 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "log_level", 2023-07-14T18:29:18.712 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "str", 2023-07-14T18:29:18.712 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:18.712 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:18.713 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "", 2023-07-14T18:29:18.713 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:18.713 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:18.714 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [ 2023-07-14T18:29:18.714 INFO:teuthology.orchestra.run.smithi163.stdout: "", 2023-07-14T18:29:18.714 INFO:teuthology.orchestra.run.smithi163.stdout: "critical", 2023-07-14T18:29:18.715 INFO:teuthology.orchestra.run.smithi163.stdout: "debug", 2023-07-14T18:29:18.715 INFO:teuthology.orchestra.run.smithi163.stdout: "error", 2023-07-14T18:29:18.715 INFO:teuthology.orchestra.run.smithi163.stdout: "info", 2023-07-14T18:29:18.715 INFO:teuthology.orchestra.run.smithi163.stdout: "warning" 2023-07-14T18:29:18.715 INFO:teuthology.orchestra.run.smithi163.stdout: ], 2023-07-14T18:29:18.716 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:18.716 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:18.716 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:18.716 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:18.716 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:18.717 INFO:teuthology.orchestra.run.smithi163.stdout: "log_to_cluster": { 2023-07-14T18:29:18.717 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "log_to_cluster", 2023-07-14T18:29:18.717 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "bool", 2023-07-14T18:29:18.717 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:18.717 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:18.718 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "False", 2023-07-14T18:29:18.718 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:18.718 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:18.718 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:18.718 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:18.719 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:18.719 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:18.719 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:18.719 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:18.719 INFO:teuthology.orchestra.run.smithi163.stdout: "log_to_cluster_level": { 2023-07-14T18:29:18.720 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "log_to_cluster_level", 2023-07-14T18:29:18.720 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "str", 2023-07-14T18:29:18.720 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:18.720 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:18.721 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "info", 2023-07-14T18:29:18.721 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:18.721 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:18.721 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [ 2023-07-14T18:29:18.721 INFO:teuthology.orchestra.run.smithi163.stdout: "", 2023-07-14T18:29:18.722 INFO:teuthology.orchestra.run.smithi163.stdout: "critical", 2023-07-14T18:29:18.722 INFO:teuthology.orchestra.run.smithi163.stdout: "debug", 2023-07-14T18:29:18.722 INFO:teuthology.orchestra.run.smithi163.stdout: "error", 2023-07-14T18:29:18.722 INFO:teuthology.orchestra.run.smithi163.stdout: "info", 2023-07-14T18:29:18.722 INFO:teuthology.orchestra.run.smithi163.stdout: "warning" 2023-07-14T18:29:18.723 INFO:teuthology.orchestra.run.smithi163.stdout: ], 2023-07-14T18:29:18.723 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:18.723 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:18.723 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:18.723 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:18.723 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:18.724 INFO:teuthology.orchestra.run.smithi163.stdout: "log_to_file": { 2023-07-14T18:29:18.724 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "log_to_file", 2023-07-14T18:29:18.724 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "bool", 2023-07-14T18:29:18.724 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:18.725 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:18.725 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "False", 2023-07-14T18:29:18.725 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:18.725 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:18.725 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:18.725 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:18.726 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:18.726 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:18.726 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:18.726 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-07-14T18:29:18.726 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-07-14T18:29:18.727 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:18.727 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-07-14T18:29:18.727 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "rook", 2023-07-14T18:29:18.727 INFO:teuthology.orchestra.run.smithi163.stdout: "can_run": true, 2023-07-14T18:29:18.727 INFO:teuthology.orchestra.run.smithi163.stdout: "error_string": "", 2023-07-14T18:29:18.728 INFO:teuthology.orchestra.run.smithi163.stdout: "module_options": { 2023-07-14T18:29:18.728 INFO:teuthology.orchestra.run.smithi163.stdout: "drive_group_interval": { 2023-07-14T18:29:18.728 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "drive_group_interval", 2023-07-14T18:29:18.728 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "float", 2023-07-14T18:29:18.728 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:18.729 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:18.729 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "300.0", 2023-07-14T18:29:18.729 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:18.729 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:18.729 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:18.730 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "interval in seconds between re-application of applied drive_groups", 2023-07-14T18:29:18.730 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:18.730 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:18.730 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:18.730 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:18.731 INFO:teuthology.orchestra.run.smithi163.stdout: "log_level": { 2023-07-14T18:29:18.731 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "log_level", 2023-07-14T18:29:18.731 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "str", 2023-07-14T18:29:18.731 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:18.731 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:18.732 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "", 2023-07-14T18:29:18.732 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:18.732 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:18.732 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [ 2023-07-14T18:29:18.732 INFO:teuthology.orchestra.run.smithi163.stdout: "", 2023-07-14T18:29:18.733 INFO:teuthology.orchestra.run.smithi163.stdout: "critical", 2023-07-14T18:29:18.733 INFO:teuthology.orchestra.run.smithi163.stdout: "debug", 2023-07-14T18:29:18.733 INFO:teuthology.orchestra.run.smithi163.stdout: "error", 2023-07-14T18:29:18.733 INFO:teuthology.orchestra.run.smithi163.stdout: "info", 2023-07-14T18:29:18.733 INFO:teuthology.orchestra.run.smithi163.stdout: "warning" 2023-07-14T18:29:18.734 INFO:teuthology.orchestra.run.smithi163.stdout: ], 2023-07-14T18:29:18.734 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:18.734 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:18.734 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:18.734 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:18.735 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:18.735 INFO:teuthology.orchestra.run.smithi163.stdout: "log_to_cluster": { 2023-07-14T18:29:18.735 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "log_to_cluster", 2023-07-14T18:29:18.735 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "bool", 2023-07-14T18:29:18.735 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:18.736 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:18.736 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "False", 2023-07-14T18:29:18.736 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:18.736 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:18.736 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:18.737 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:18.737 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:18.737 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:18.737 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:18.737 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:18.738 INFO:teuthology.orchestra.run.smithi163.stdout: "log_to_cluster_level": { 2023-07-14T18:29:18.738 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "log_to_cluster_level", 2023-07-14T18:29:18.738 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "str", 2023-07-14T18:29:18.738 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:18.738 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:18.739 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "info", 2023-07-14T18:29:18.739 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:18.739 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:18.739 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [ 2023-07-14T18:29:18.739 INFO:teuthology.orchestra.run.smithi163.stdout: "", 2023-07-14T18:29:18.740 INFO:teuthology.orchestra.run.smithi163.stdout: "critical", 2023-07-14T18:29:18.740 INFO:teuthology.orchestra.run.smithi163.stdout: "debug", 2023-07-14T18:29:18.740 INFO:teuthology.orchestra.run.smithi163.stdout: "error", 2023-07-14T18:29:18.740 INFO:teuthology.orchestra.run.smithi163.stdout: "info", 2023-07-14T18:29:18.740 INFO:teuthology.orchestra.run.smithi163.stdout: "warning" 2023-07-14T18:29:18.741 INFO:teuthology.orchestra.run.smithi163.stdout: ], 2023-07-14T18:29:18.741 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:18.741 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:18.741 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:18.741 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:18.742 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:18.742 INFO:teuthology.orchestra.run.smithi163.stdout: "log_to_file": { 2023-07-14T18:29:18.742 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "log_to_file", 2023-07-14T18:29:18.742 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "bool", 2023-07-14T18:29:18.742 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:18.743 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:18.743 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "False", 2023-07-14T18:29:18.743 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:18.743 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:18.743 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:18.744 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:18.744 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:18.744 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:18.744 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:18.744 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:18.745 INFO:teuthology.orchestra.run.smithi163.stdout: "storage_class": { 2023-07-14T18:29:18.745 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "storage_class", 2023-07-14T18:29:18.745 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "str", 2023-07-14T18:29:18.745 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:18.745 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:18.746 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "local", 2023-07-14T18:29:18.746 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:18.746 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:18.746 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:18.746 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "storage class name for LSO-discovered PVs", 2023-07-14T18:29:18.747 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:18.747 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:18.747 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:18.747 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-07-14T18:29:18.747 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-07-14T18:29:18.748 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:18.748 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-07-14T18:29:18.748 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "selftest", 2023-07-14T18:29:18.748 INFO:teuthology.orchestra.run.smithi163.stdout: "can_run": true, 2023-07-14T18:29:18.748 INFO:teuthology.orchestra.run.smithi163.stdout: "error_string": "", 2023-07-14T18:29:18.749 INFO:teuthology.orchestra.run.smithi163.stdout: "module_options": { 2023-07-14T18:29:18.749 INFO:teuthology.orchestra.run.smithi163.stdout: "log_level": { 2023-07-14T18:29:18.749 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "log_level", 2023-07-14T18:29:18.749 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "str", 2023-07-14T18:29:18.749 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:18.750 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:18.750 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "", 2023-07-14T18:29:18.750 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:18.750 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:18.750 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [ 2023-07-14T18:29:18.751 INFO:teuthology.orchestra.run.smithi163.stdout: "", 2023-07-14T18:29:18.751 INFO:teuthology.orchestra.run.smithi163.stdout: "critical", 2023-07-14T18:29:18.751 INFO:teuthology.orchestra.run.smithi163.stdout: "debug", 2023-07-14T18:29:18.751 INFO:teuthology.orchestra.run.smithi163.stdout: "error", 2023-07-14T18:29:18.751 INFO:teuthology.orchestra.run.smithi163.stdout: "info", 2023-07-14T18:29:18.752 INFO:teuthology.orchestra.run.smithi163.stdout: "warning" 2023-07-14T18:29:18.752 INFO:teuthology.orchestra.run.smithi163.stdout: ], 2023-07-14T18:29:18.752 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:18.752 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:18.752 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:18.753 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:18.753 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:18.753 INFO:teuthology.orchestra.run.smithi163.stdout: "log_to_cluster": { 2023-07-14T18:29:18.753 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "log_to_cluster", 2023-07-14T18:29:18.753 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "bool", 2023-07-14T18:29:18.754 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:18.754 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:18.754 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "False", 2023-07-14T18:29:18.754 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:18.754 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:18.755 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:18.755 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:18.755 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:18.755 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:18.755 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:18.756 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:18.756 INFO:teuthology.orchestra.run.smithi163.stdout: "log_to_cluster_level": { 2023-07-14T18:29:18.756 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "log_to_cluster_level", 2023-07-14T18:29:18.756 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "str", 2023-07-14T18:29:18.756 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:18.757 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:18.757 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "info", 2023-07-14T18:29:18.757 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:18.757 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:18.757 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [ 2023-07-14T18:29:18.758 INFO:teuthology.orchestra.run.smithi163.stdout: "", 2023-07-14T18:29:18.758 INFO:teuthology.orchestra.run.smithi163.stdout: "critical", 2023-07-14T18:29:18.758 INFO:teuthology.orchestra.run.smithi163.stdout: "debug", 2023-07-14T18:29:18.758 INFO:teuthology.orchestra.run.smithi163.stdout: "error", 2023-07-14T18:29:18.758 INFO:teuthology.orchestra.run.smithi163.stdout: "info", 2023-07-14T18:29:18.758 INFO:teuthology.orchestra.run.smithi163.stdout: "warning" 2023-07-14T18:29:18.759 INFO:teuthology.orchestra.run.smithi163.stdout: ], 2023-07-14T18:29:18.759 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:18.759 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:18.759 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:18.759 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:18.760 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:18.760 INFO:teuthology.orchestra.run.smithi163.stdout: "log_to_file": { 2023-07-14T18:29:18.760 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "log_to_file", 2023-07-14T18:29:18.760 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "bool", 2023-07-14T18:29:18.760 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:18.761 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:18.761 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "False", 2023-07-14T18:29:18.761 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:18.761 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:18.761 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:18.762 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:18.762 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:18.762 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:18.762 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:18.762 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:18.763 INFO:teuthology.orchestra.run.smithi163.stdout: "roption1": { 2023-07-14T18:29:18.763 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "roption1", 2023-07-14T18:29:18.763 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "str", 2023-07-14T18:29:18.763 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:18.763 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:18.764 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "", 2023-07-14T18:29:18.764 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:18.764 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:18.764 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:18.764 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:18.765 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:18.765 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:18.765 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:18.765 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:18.765 INFO:teuthology.orchestra.run.smithi163.stdout: "roption2": { 2023-07-14T18:29:18.766 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "roption2", 2023-07-14T18:29:18.766 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "str", 2023-07-14T18:29:18.766 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:18.766 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:18.766 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "xyz", 2023-07-14T18:29:18.767 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:18.767 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:18.767 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:18.767 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:18.767 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:18.767 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:18.768 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:18.768 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:18.768 INFO:teuthology.orchestra.run.smithi163.stdout: "rwoption1": { 2023-07-14T18:29:18.768 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "rwoption1", 2023-07-14T18:29:18.769 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "str", 2023-07-14T18:29:18.769 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:18.769 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:18.769 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "", 2023-07-14T18:29:18.769 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:18.770 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:18.770 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:18.770 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:18.770 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:18.770 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:18.770 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:18.771 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:18.771 INFO:teuthology.orchestra.run.smithi163.stdout: "rwoption2": { 2023-07-14T18:29:18.771 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "rwoption2", 2023-07-14T18:29:18.771 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "int", 2023-07-14T18:29:18.771 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:18.772 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:18.772 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "", 2023-07-14T18:29:18.772 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:18.772 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:18.772 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:18.773 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:18.773 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:18.773 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:18.773 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:18.773 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:18.774 INFO:teuthology.orchestra.run.smithi163.stdout: "rwoption3": { 2023-07-14T18:29:18.774 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "rwoption3", 2023-07-14T18:29:18.774 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "float", 2023-07-14T18:29:18.774 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:18.774 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:18.775 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "", 2023-07-14T18:29:18.775 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:18.775 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:18.775 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:18.775 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:18.776 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:18.776 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:18.776 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:18.776 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:18.776 INFO:teuthology.orchestra.run.smithi163.stdout: "rwoption4": { 2023-07-14T18:29:18.777 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "rwoption4", 2023-07-14T18:29:18.777 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "str", 2023-07-14T18:29:18.777 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:18.777 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:18.777 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "", 2023-07-14T18:29:18.777 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:18.778 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:18.778 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:18.778 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:18.778 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:18.778 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:18.779 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:18.779 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:18.779 INFO:teuthology.orchestra.run.smithi163.stdout: "rwoption5": { 2023-07-14T18:29:18.779 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "rwoption5", 2023-07-14T18:29:18.779 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "bool", 2023-07-14T18:29:18.780 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:18.780 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:18.780 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "", 2023-07-14T18:29:18.780 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:18.780 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:18.781 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:18.781 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:18.781 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:18.781 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:18.781 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:18.782 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:18.782 INFO:teuthology.orchestra.run.smithi163.stdout: "rwoption6": { 2023-07-14T18:29:18.782 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "rwoption6", 2023-07-14T18:29:18.782 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "bool", 2023-07-14T18:29:18.782 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:18.783 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:18.783 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "True", 2023-07-14T18:29:18.783 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:18.783 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:18.783 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:18.784 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:18.784 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:18.784 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:18.784 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:18.784 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:18.785 INFO:teuthology.orchestra.run.smithi163.stdout: "rwoption7": { 2023-07-14T18:29:18.785 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "rwoption7", 2023-07-14T18:29:18.785 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "int", 2023-07-14T18:29:18.785 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:18.785 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:18.785 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "", 2023-07-14T18:29:18.786 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "1", 2023-07-14T18:29:18.786 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "42", 2023-07-14T18:29:18.786 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:18.786 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:18.786 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:18.787 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:18.787 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:18.787 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:18.787 INFO:teuthology.orchestra.run.smithi163.stdout: "testkey": { 2023-07-14T18:29:18.787 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "testkey", 2023-07-14T18:29:18.788 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "str", 2023-07-14T18:29:18.788 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:18.788 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:18.788 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "", 2023-07-14T18:29:18.788 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:18.789 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:18.789 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:18.789 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:18.789 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:18.789 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:18.790 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:18.790 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:18.790 INFO:teuthology.orchestra.run.smithi163.stdout: "testlkey": { 2023-07-14T18:29:18.790 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "testlkey", 2023-07-14T18:29:18.790 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "str", 2023-07-14T18:29:18.791 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:18.791 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:18.791 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "", 2023-07-14T18:29:18.791 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:18.791 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:18.792 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:18.792 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:18.792 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:18.792 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:18.792 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:18.793 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:18.793 INFO:teuthology.orchestra.run.smithi163.stdout: "testnewline": { 2023-07-14T18:29:18.793 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "testnewline", 2023-07-14T18:29:18.793 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "str", 2023-07-14T18:29:18.793 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:18.794 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:18.794 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "", 2023-07-14T18:29:18.794 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:18.794 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:18.794 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:18.795 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:18.795 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:18.795 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:18.795 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:18.795 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-07-14T18:29:18.796 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-07-14T18:29:18.796 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:18.796 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-07-14T18:29:18.796 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "snap_schedule", 2023-07-14T18:29:18.796 INFO:teuthology.orchestra.run.smithi163.stdout: "can_run": true, 2023-07-14T18:29:18.797 INFO:teuthology.orchestra.run.smithi163.stdout: "error_string": "", 2023-07-14T18:29:18.797 INFO:teuthology.orchestra.run.smithi163.stdout: "module_options": { 2023-07-14T18:29:18.797 INFO:teuthology.orchestra.run.smithi163.stdout: "allow_m_granularity": { 2023-07-14T18:29:18.797 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "allow_m_granularity", 2023-07-14T18:29:18.797 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "bool", 2023-07-14T18:29:18.798 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:18.798 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:18.798 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "False", 2023-07-14T18:29:18.798 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:18.798 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:18.798 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:18.799 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "allow minute scheduled snapshots", 2023-07-14T18:29:18.799 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:18.799 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:18.799 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:18.799 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:18.800 INFO:teuthology.orchestra.run.smithi163.stdout: "dump_on_update": { 2023-07-14T18:29:18.800 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "dump_on_update", 2023-07-14T18:29:18.800 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "bool", 2023-07-14T18:29:18.800 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:18.800 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:18.801 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "False", 2023-07-14T18:29:18.801 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:18.801 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:18.801 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:18.801 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "dump database to debug log on update", 2023-07-14T18:29:18.802 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:18.802 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:18.802 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:18.802 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:18.802 INFO:teuthology.orchestra.run.smithi163.stdout: "log_level": { 2023-07-14T18:29:18.803 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "log_level", 2023-07-14T18:29:18.803 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "str", 2023-07-14T18:29:18.803 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:18.803 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:18.803 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "", 2023-07-14T18:29:18.804 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:18.804 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:18.804 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [ 2023-07-14T18:29:18.804 INFO:teuthology.orchestra.run.smithi163.stdout: "", 2023-07-14T18:29:18.804 INFO:teuthology.orchestra.run.smithi163.stdout: "critical", 2023-07-14T18:29:18.805 INFO:teuthology.orchestra.run.smithi163.stdout: "debug", 2023-07-14T18:29:18.805 INFO:teuthology.orchestra.run.smithi163.stdout: "error", 2023-07-14T18:29:18.805 INFO:teuthology.orchestra.run.smithi163.stdout: "info", 2023-07-14T18:29:18.805 INFO:teuthology.orchestra.run.smithi163.stdout: "warning" 2023-07-14T18:29:18.805 INFO:teuthology.orchestra.run.smithi163.stdout: ], 2023-07-14T18:29:18.806 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:18.806 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:18.806 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:18.806 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:18.806 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:18.806 INFO:teuthology.orchestra.run.smithi163.stdout: "log_to_cluster": { 2023-07-14T18:29:18.807 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "log_to_cluster", 2023-07-14T18:29:18.807 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "bool", 2023-07-14T18:29:18.807 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:18.807 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:18.807 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "False", 2023-07-14T18:29:18.808 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:18.808 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:18.808 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:18.808 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:18.808 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:18.809 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:18.809 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:18.809 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:18.809 INFO:teuthology.orchestra.run.smithi163.stdout: "log_to_cluster_level": { 2023-07-14T18:29:18.809 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "log_to_cluster_level", 2023-07-14T18:29:18.810 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "str", 2023-07-14T18:29:18.810 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:18.810 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:18.810 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "info", 2023-07-14T18:29:18.810 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:18.811 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:18.811 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [ 2023-07-14T18:29:18.811 INFO:teuthology.orchestra.run.smithi163.stdout: "", 2023-07-14T18:29:18.811 INFO:teuthology.orchestra.run.smithi163.stdout: "critical", 2023-07-14T18:29:18.811 INFO:teuthology.orchestra.run.smithi163.stdout: "debug", 2023-07-14T18:29:18.812 INFO:teuthology.orchestra.run.smithi163.stdout: "error", 2023-07-14T18:29:18.812 INFO:teuthology.orchestra.run.smithi163.stdout: "info", 2023-07-14T18:29:18.812 INFO:teuthology.orchestra.run.smithi163.stdout: "warning" 2023-07-14T18:29:18.812 INFO:teuthology.orchestra.run.smithi163.stdout: ], 2023-07-14T18:29:18.812 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:18.813 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:18.813 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:18.813 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:18.813 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:18.813 INFO:teuthology.orchestra.run.smithi163.stdout: "log_to_file": { 2023-07-14T18:29:18.814 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "log_to_file", 2023-07-14T18:29:18.814 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "bool", 2023-07-14T18:29:18.814 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:18.814 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:18.814 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "False", 2023-07-14T18:29:18.815 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:18.815 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:18.815 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:18.815 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:18.815 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:18.816 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:18.816 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:18.816 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-07-14T18:29:18.816 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-07-14T18:29:18.816 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:18.817 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-07-14T18:29:18.817 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "stats", 2023-07-14T18:29:18.817 INFO:teuthology.orchestra.run.smithi163.stdout: "can_run": true, 2023-07-14T18:29:18.817 INFO:teuthology.orchestra.run.smithi163.stdout: "error_string": "", 2023-07-14T18:29:18.817 INFO:teuthology.orchestra.run.smithi163.stdout: "module_options": { 2023-07-14T18:29:18.818 INFO:teuthology.orchestra.run.smithi163.stdout: "log_level": { 2023-07-14T18:29:18.818 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "log_level", 2023-07-14T18:29:18.818 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "str", 2023-07-14T18:29:18.818 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:18.818 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:18.818 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "", 2023-07-14T18:29:18.819 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:18.819 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:18.819 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [ 2023-07-14T18:29:18.819 INFO:teuthology.orchestra.run.smithi163.stdout: "", 2023-07-14T18:29:18.819 INFO:teuthology.orchestra.run.smithi163.stdout: "critical", 2023-07-14T18:29:18.820 INFO:teuthology.orchestra.run.smithi163.stdout: "debug", 2023-07-14T18:29:18.820 INFO:teuthology.orchestra.run.smithi163.stdout: "error", 2023-07-14T18:29:18.820 INFO:teuthology.orchestra.run.smithi163.stdout: "info", 2023-07-14T18:29:18.820 INFO:teuthology.orchestra.run.smithi163.stdout: "warning" 2023-07-14T18:29:18.820 INFO:teuthology.orchestra.run.smithi163.stdout: ], 2023-07-14T18:29:18.821 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:18.821 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:18.821 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:18.821 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:18.821 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:18.822 INFO:teuthology.orchestra.run.smithi163.stdout: "log_to_cluster": { 2023-07-14T18:29:18.822 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "log_to_cluster", 2023-07-14T18:29:18.822 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "bool", 2023-07-14T18:29:18.822 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:18.822 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:18.823 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "False", 2023-07-14T18:29:18.823 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:18.823 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:18.823 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:18.823 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:18.824 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:18.824 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:18.824 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:18.824 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:18.824 INFO:teuthology.orchestra.run.smithi163.stdout: "log_to_cluster_level": { 2023-07-14T18:29:18.825 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "log_to_cluster_level", 2023-07-14T18:29:18.825 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "str", 2023-07-14T18:29:18.825 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:18.825 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:18.825 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "info", 2023-07-14T18:29:18.826 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:18.826 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:18.826 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [ 2023-07-14T18:29:18.826 INFO:teuthology.orchestra.run.smithi163.stdout: "", 2023-07-14T18:29:18.826 INFO:teuthology.orchestra.run.smithi163.stdout: "critical", 2023-07-14T18:29:18.826 INFO:teuthology.orchestra.run.smithi163.stdout: "debug", 2023-07-14T18:29:18.827 INFO:teuthology.orchestra.run.smithi163.stdout: "error", 2023-07-14T18:29:18.827 INFO:teuthology.orchestra.run.smithi163.stdout: "info", 2023-07-14T18:29:18.827 INFO:teuthology.orchestra.run.smithi163.stdout: "warning" 2023-07-14T18:29:18.827 INFO:teuthology.orchestra.run.smithi163.stdout: ], 2023-07-14T18:29:18.827 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:18.828 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:18.828 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:18.828 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:18.828 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:18.828 INFO:teuthology.orchestra.run.smithi163.stdout: "log_to_file": { 2023-07-14T18:29:18.829 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "log_to_file", 2023-07-14T18:29:18.829 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "bool", 2023-07-14T18:29:18.829 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:18.829 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:18.829 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "False", 2023-07-14T18:29:18.830 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:18.830 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:18.830 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:18.830 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:18.830 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:18.831 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:18.831 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:18.831 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-07-14T18:29:18.831 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-07-14T18:29:18.831 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:18.832 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-07-14T18:29:18.832 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "status", 2023-07-14T18:29:18.832 INFO:teuthology.orchestra.run.smithi163.stdout: "can_run": true, 2023-07-14T18:29:18.832 INFO:teuthology.orchestra.run.smithi163.stdout: "error_string": "", 2023-07-14T18:29:18.832 INFO:teuthology.orchestra.run.smithi163.stdout: "module_options": { 2023-07-14T18:29:18.833 INFO:teuthology.orchestra.run.smithi163.stdout: "log_level": { 2023-07-14T18:29:18.833 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "log_level", 2023-07-14T18:29:18.833 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "str", 2023-07-14T18:29:18.833 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:18.833 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:18.834 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "", 2023-07-14T18:29:18.834 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:18.834 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:18.834 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [ 2023-07-14T18:29:18.834 INFO:teuthology.orchestra.run.smithi163.stdout: "", 2023-07-14T18:29:18.835 INFO:teuthology.orchestra.run.smithi163.stdout: "critical", 2023-07-14T18:29:18.835 INFO:teuthology.orchestra.run.smithi163.stdout: "debug", 2023-07-14T18:29:18.835 INFO:teuthology.orchestra.run.smithi163.stdout: "error", 2023-07-14T18:29:18.835 INFO:teuthology.orchestra.run.smithi163.stdout: "info", 2023-07-14T18:29:18.835 INFO:teuthology.orchestra.run.smithi163.stdout: "warning" 2023-07-14T18:29:18.835 INFO:teuthology.orchestra.run.smithi163.stdout: ], 2023-07-14T18:29:18.836 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:18.836 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:18.836 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:18.836 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:18.836 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:18.837 INFO:teuthology.orchestra.run.smithi163.stdout: "log_to_cluster": { 2023-07-14T18:29:18.837 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "log_to_cluster", 2023-07-14T18:29:18.837 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "bool", 2023-07-14T18:29:18.837 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:18.837 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:18.838 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "False", 2023-07-14T18:29:18.838 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:18.838 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:18.838 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:18.838 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:18.839 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:18.839 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:18.839 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:18.839 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:18.839 INFO:teuthology.orchestra.run.smithi163.stdout: "log_to_cluster_level": { 2023-07-14T18:29:18.840 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "log_to_cluster_level", 2023-07-14T18:29:18.840 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "str", 2023-07-14T18:29:18.840 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:18.840 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:18.840 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "info", 2023-07-14T18:29:18.841 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:18.841 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:18.841 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [ 2023-07-14T18:29:18.841 INFO:teuthology.orchestra.run.smithi163.stdout: "", 2023-07-14T18:29:18.841 INFO:teuthology.orchestra.run.smithi163.stdout: "critical", 2023-07-14T18:29:18.842 INFO:teuthology.orchestra.run.smithi163.stdout: "debug", 2023-07-14T18:29:18.842 INFO:teuthology.orchestra.run.smithi163.stdout: "error", 2023-07-14T18:29:18.842 INFO:teuthology.orchestra.run.smithi163.stdout: "info", 2023-07-14T18:29:18.842 INFO:teuthology.orchestra.run.smithi163.stdout: "warning" 2023-07-14T18:29:18.842 INFO:teuthology.orchestra.run.smithi163.stdout: ], 2023-07-14T18:29:18.843 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:18.843 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:18.843 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:18.843 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:18.843 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:18.843 INFO:teuthology.orchestra.run.smithi163.stdout: "log_to_file": { 2023-07-14T18:29:18.844 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "log_to_file", 2023-07-14T18:29:18.844 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "bool", 2023-07-14T18:29:18.844 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:18.844 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:18.844 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "False", 2023-07-14T18:29:18.845 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:18.845 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:18.845 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:18.845 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:18.845 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:18.846 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:18.846 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:18.846 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-07-14T18:29:18.846 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-07-14T18:29:18.846 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:18.847 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-07-14T18:29:18.847 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "telegraf", 2023-07-14T18:29:18.847 INFO:teuthology.orchestra.run.smithi163.stdout: "can_run": true, 2023-07-14T18:29:18.847 INFO:teuthology.orchestra.run.smithi163.stdout: "error_string": "", 2023-07-14T18:29:18.847 INFO:teuthology.orchestra.run.smithi163.stdout: "module_options": { 2023-07-14T18:29:18.848 INFO:teuthology.orchestra.run.smithi163.stdout: "address": { 2023-07-14T18:29:18.848 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "address", 2023-07-14T18:29:18.848 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "str", 2023-07-14T18:29:18.848 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:18.848 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:18.849 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2023-07-14T18:29:18.849 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:18.849 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:18.849 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:18.849 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:18.850 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:18.850 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:18.850 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:18.850 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:18.850 INFO:teuthology.orchestra.run.smithi163.stdout: "interval": { 2023-07-14T18:29:18.851 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "interval", 2023-07-14T18:29:18.851 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "secs", 2023-07-14T18:29:18.851 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:18.851 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:18.851 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "15", 2023-07-14T18:29:18.851 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:18.852 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:18.852 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:18.852 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:18.852 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:18.852 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:18.853 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:18.853 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:18.853 INFO:teuthology.orchestra.run.smithi163.stdout: "log_level": { 2023-07-14T18:29:18.853 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "log_level", 2023-07-14T18:29:18.853 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "str", 2023-07-14T18:29:18.854 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:18.854 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:18.854 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "", 2023-07-14T18:29:18.854 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:18.854 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:18.855 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [ 2023-07-14T18:29:18.855 INFO:teuthology.orchestra.run.smithi163.stdout: "", 2023-07-14T18:29:18.855 INFO:teuthology.orchestra.run.smithi163.stdout: "critical", 2023-07-14T18:29:18.855 INFO:teuthology.orchestra.run.smithi163.stdout: "debug", 2023-07-14T18:29:18.855 INFO:teuthology.orchestra.run.smithi163.stdout: "error", 2023-07-14T18:29:18.856 INFO:teuthology.orchestra.run.smithi163.stdout: "info", 2023-07-14T18:29:18.856 INFO:teuthology.orchestra.run.smithi163.stdout: "warning" 2023-07-14T18:29:18.856 INFO:teuthology.orchestra.run.smithi163.stdout: ], 2023-07-14T18:29:18.856 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:18.856 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:18.857 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:18.857 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:18.857 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:18.857 INFO:teuthology.orchestra.run.smithi163.stdout: "log_to_cluster": { 2023-07-14T18:29:18.857 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "log_to_cluster", 2023-07-14T18:29:18.858 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "bool", 2023-07-14T18:29:18.858 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:18.858 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:18.858 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "False", 2023-07-14T18:29:18.858 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:18.858 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:18.859 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:18.859 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:18.859 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:18.859 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:18.859 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:18.860 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:18.860 INFO:teuthology.orchestra.run.smithi163.stdout: "log_to_cluster_level": { 2023-07-14T18:29:18.860 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "log_to_cluster_level", 2023-07-14T18:29:18.860 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "str", 2023-07-14T18:29:18.860 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:18.861 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:18.861 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "info", 2023-07-14T18:29:18.861 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:18.861 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:18.861 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [ 2023-07-14T18:29:18.862 INFO:teuthology.orchestra.run.smithi163.stdout: "", 2023-07-14T18:29:18.862 INFO:teuthology.orchestra.run.smithi163.stdout: "critical", 2023-07-14T18:29:18.862 INFO:teuthology.orchestra.run.smithi163.stdout: "debug", 2023-07-14T18:29:18.862 INFO:teuthology.orchestra.run.smithi163.stdout: "error", 2023-07-14T18:29:18.862 INFO:teuthology.orchestra.run.smithi163.stdout: "info", 2023-07-14T18:29:18.863 INFO:teuthology.orchestra.run.smithi163.stdout: "warning" 2023-07-14T18:29:18.863 INFO:teuthology.orchestra.run.smithi163.stdout: ], 2023-07-14T18:29:18.863 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:18.863 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:18.863 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:18.864 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:18.864 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:18.864 INFO:teuthology.orchestra.run.smithi163.stdout: "log_to_file": { 2023-07-14T18:29:18.864 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "log_to_file", 2023-07-14T18:29:18.864 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "bool", 2023-07-14T18:29:18.865 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:18.865 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:18.865 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "False", 2023-07-14T18:29:18.865 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:18.865 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:18.866 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:18.866 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:18.866 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:18.866 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:18.866 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:18.866 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-07-14T18:29:18.867 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-07-14T18:29:18.867 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:18.867 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-07-14T18:29:18.867 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "telemetry", 2023-07-14T18:29:18.867 INFO:teuthology.orchestra.run.smithi163.stdout: "can_run": true, 2023-07-14T18:29:18.868 INFO:teuthology.orchestra.run.smithi163.stdout: "error_string": "", 2023-07-14T18:29:18.868 INFO:teuthology.orchestra.run.smithi163.stdout: "module_options": { 2023-07-14T18:29:18.868 INFO:teuthology.orchestra.run.smithi163.stdout: "channel_basic": { 2023-07-14T18:29:18.868 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "channel_basic", 2023-07-14T18:29:18.868 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "bool", 2023-07-14T18:29:18.869 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:18.869 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:18.869 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "True", 2023-07-14T18:29:18.869 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:18.869 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:18.870 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:18.870 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "Share basic cluster information (size, version)", 2023-07-14T18:29:18.870 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:18.870 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:18.870 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:18.871 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:18.871 INFO:teuthology.orchestra.run.smithi163.stdout: "channel_crash": { 2023-07-14T18:29:18.871 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "channel_crash", 2023-07-14T18:29:18.871 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "bool", 2023-07-14T18:29:18.871 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:18.872 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:18.872 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "True", 2023-07-14T18:29:18.872 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:18.872 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:18.872 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:18.873 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2023-07-14T18:29:18.873 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:18.873 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:18.873 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:18.873 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:18.874 INFO:teuthology.orchestra.run.smithi163.stdout: "channel_device": { 2023-07-14T18:29:18.874 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "channel_device", 2023-07-14T18:29:18.874 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "bool", 2023-07-14T18:29:18.874 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:18.874 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:18.875 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "True", 2023-07-14T18:29:18.875 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:18.875 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:18.875 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:18.875 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2023-07-14T18:29:18.875 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:18.876 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:18.876 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:18.876 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:18.876 INFO:teuthology.orchestra.run.smithi163.stdout: "channel_ident": { 2023-07-14T18:29:18.876 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "channel_ident", 2023-07-14T18:29:18.877 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "bool", 2023-07-14T18:29:18.877 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:18.877 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:18.877 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "False", 2023-07-14T18:29:18.877 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:18.878 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:18.878 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:18.878 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2023-07-14T18:29:18.878 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:18.878 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:18.879 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:18.879 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:18.879 INFO:teuthology.orchestra.run.smithi163.stdout: "channel_perf": { 2023-07-14T18:29:18.879 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "channel_perf", 2023-07-14T18:29:18.879 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "bool", 2023-07-14T18:29:18.880 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:18.880 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:18.880 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "False", 2023-07-14T18:29:18.880 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:18.880 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:18.881 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:18.881 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "Share various performance metrics of a cluster", 2023-07-14T18:29:18.881 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:18.881 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:18.881 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:18.882 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:18.882 INFO:teuthology.orchestra.run.smithi163.stdout: "contact": { 2023-07-14T18:29:18.882 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "contact", 2023-07-14T18:29:18.882 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "str", 2023-07-14T18:29:18.882 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:18.883 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:18.883 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "", 2023-07-14T18:29:18.883 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:18.883 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:18.883 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:18.883 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:18.884 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:18.884 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:18.884 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:18.884 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:18.884 INFO:teuthology.orchestra.run.smithi163.stdout: "description": { 2023-07-14T18:29:18.885 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "description", 2023-07-14T18:29:18.885 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "str", 2023-07-14T18:29:18.885 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:18.885 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:18.885 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "", 2023-07-14T18:29:18.886 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:18.886 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:18.886 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:18.886 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:18.886 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:18.887 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:18.887 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:18.887 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:18.887 INFO:teuthology.orchestra.run.smithi163.stdout: "device_url": { 2023-07-14T18:29:18.887 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "device_url", 2023-07-14T18:29:18.888 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "str", 2023-07-14T18:29:18.888 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:18.888 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:18.888 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "https://telemetry.ceph.com/device", 2023-07-14T18:29:18.888 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:18.889 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:18.889 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:18.889 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:18.889 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:18.889 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:18.890 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:18.890 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:18.890 INFO:teuthology.orchestra.run.smithi163.stdout: "enabled": { 2023-07-14T18:29:18.890 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "enabled", 2023-07-14T18:29:18.890 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "bool", 2023-07-14T18:29:18.890 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:18.891 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:18.891 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "False", 2023-07-14T18:29:18.891 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:18.891 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:18.891 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:18.892 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:18.892 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:18.892 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:18.892 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:18.892 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:18.893 INFO:teuthology.orchestra.run.smithi163.stdout: "interval": { 2023-07-14T18:29:18.893 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "interval", 2023-07-14T18:29:18.893 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "int", 2023-07-14T18:29:18.893 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:18.893 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:18.894 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "24", 2023-07-14T18:29:18.894 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "8", 2023-07-14T18:29:18.894 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:18.894 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:18.894 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:18.895 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:18.895 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:18.895 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:18.895 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:18.895 INFO:teuthology.orchestra.run.smithi163.stdout: "last_opt_revision": { 2023-07-14T18:29:18.896 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "last_opt_revision", 2023-07-14T18:29:18.896 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "int", 2023-07-14T18:29:18.896 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:18.896 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:18.896 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "1", 2023-07-14T18:29:18.897 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:18.897 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:18.897 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:18.897 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:18.897 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:18.898 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:18.898 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:18.898 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:18.898 INFO:teuthology.orchestra.run.smithi163.stdout: "leaderboard": { 2023-07-14T18:29:18.898 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "leaderboard", 2023-07-14T18:29:18.898 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "bool", 2023-07-14T18:29:18.899 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:18.899 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:18.899 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "False", 2023-07-14T18:29:18.899 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:18.899 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:18.900 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:18.900 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:18.900 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:18.900 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:18.900 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:18.901 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:18.901 INFO:teuthology.orchestra.run.smithi163.stdout: "leaderboard_description": { 2023-07-14T18:29:18.901 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "leaderboard_description", 2023-07-14T18:29:18.901 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "str", 2023-07-14T18:29:18.901 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:18.902 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:18.902 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "", 2023-07-14T18:29:18.902 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:18.902 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:18.902 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:18.903 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:18.903 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:18.903 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:18.903 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:18.903 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:18.904 INFO:teuthology.orchestra.run.smithi163.stdout: "log_level": { 2023-07-14T18:29:18.904 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "log_level", 2023-07-14T18:29:18.904 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "str", 2023-07-14T18:29:18.904 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:18.904 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:18.905 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "", 2023-07-14T18:29:18.905 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:18.905 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:18.905 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [ 2023-07-14T18:29:18.905 INFO:teuthology.orchestra.run.smithi163.stdout: "", 2023-07-14T18:29:18.906 INFO:teuthology.orchestra.run.smithi163.stdout: "critical", 2023-07-14T18:29:18.906 INFO:teuthology.orchestra.run.smithi163.stdout: "debug", 2023-07-14T18:29:18.906 INFO:teuthology.orchestra.run.smithi163.stdout: "error", 2023-07-14T18:29:18.906 INFO:teuthology.orchestra.run.smithi163.stdout: "info", 2023-07-14T18:29:18.906 INFO:teuthology.orchestra.run.smithi163.stdout: "warning" 2023-07-14T18:29:18.907 INFO:teuthology.orchestra.run.smithi163.stdout: ], 2023-07-14T18:29:18.907 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:18.907 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:18.907 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:18.907 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:18.907 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:18.908 INFO:teuthology.orchestra.run.smithi163.stdout: "log_to_cluster": { 2023-07-14T18:29:18.908 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "log_to_cluster", 2023-07-14T18:29:18.908 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "bool", 2023-07-14T18:29:18.908 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:18.909 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:18.909 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "False", 2023-07-14T18:29:18.909 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:18.909 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:18.909 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:18.909 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:18.910 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:18.910 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:18.910 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:18.910 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:18.910 INFO:teuthology.orchestra.run.smithi163.stdout: "log_to_cluster_level": { 2023-07-14T18:29:18.911 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "log_to_cluster_level", 2023-07-14T18:29:18.911 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "str", 2023-07-14T18:29:18.911 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:18.911 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:18.911 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "info", 2023-07-14T18:29:18.912 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:18.912 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:18.912 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [ 2023-07-14T18:29:18.912 INFO:teuthology.orchestra.run.smithi163.stdout: "", 2023-07-14T18:29:18.912 INFO:teuthology.orchestra.run.smithi163.stdout: "critical", 2023-07-14T18:29:18.913 INFO:teuthology.orchestra.run.smithi163.stdout: "debug", 2023-07-14T18:29:18.913 INFO:teuthology.orchestra.run.smithi163.stdout: "error", 2023-07-14T18:29:18.913 INFO:teuthology.orchestra.run.smithi163.stdout: "info", 2023-07-14T18:29:18.913 INFO:teuthology.orchestra.run.smithi163.stdout: "warning" 2023-07-14T18:29:18.913 INFO:teuthology.orchestra.run.smithi163.stdout: ], 2023-07-14T18:29:18.914 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:18.914 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:18.914 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:18.914 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:18.914 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:18.914 INFO:teuthology.orchestra.run.smithi163.stdout: "log_to_file": { 2023-07-14T18:29:18.915 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "log_to_file", 2023-07-14T18:29:18.915 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "bool", 2023-07-14T18:29:18.915 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:18.915 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:18.915 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "False", 2023-07-14T18:29:18.916 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:18.916 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:18.916 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:18.916 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:18.916 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:18.917 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:18.917 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:18.917 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:18.917 INFO:teuthology.orchestra.run.smithi163.stdout: "organization": { 2023-07-14T18:29:18.917 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "organization", 2023-07-14T18:29:18.918 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "str", 2023-07-14T18:29:18.918 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:18.918 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:18.918 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "", 2023-07-14T18:29:18.918 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:18.919 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:18.919 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:18.919 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:18.919 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:18.919 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:18.920 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:18.920 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:18.920 INFO:teuthology.orchestra.run.smithi163.stdout: "proxy": { 2023-07-14T18:29:18.920 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "proxy", 2023-07-14T18:29:18.920 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "str", 2023-07-14T18:29:18.921 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:18.921 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:18.921 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "", 2023-07-14T18:29:18.921 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:18.921 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:18.922 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:18.922 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:18.922 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:18.922 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:18.922 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:18.922 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:18.923 INFO:teuthology.orchestra.run.smithi163.stdout: "url": { 2023-07-14T18:29:18.923 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "url", 2023-07-14T18:29:18.923 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "str", 2023-07-14T18:29:18.923 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:18.923 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:18.924 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "https://telemetry.ceph.com/report", 2023-07-14T18:29:18.924 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:18.924 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:18.924 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:18.924 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:18.925 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:18.925 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:18.925 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:18.925 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-07-14T18:29:18.925 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-07-14T18:29:18.926 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:18.926 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-07-14T18:29:18.926 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "test_orchestrator", 2023-07-14T18:29:18.926 INFO:teuthology.orchestra.run.smithi163.stdout: "can_run": true, 2023-07-14T18:29:18.926 INFO:teuthology.orchestra.run.smithi163.stdout: "error_string": "", 2023-07-14T18:29:18.927 INFO:teuthology.orchestra.run.smithi163.stdout: "module_options": { 2023-07-14T18:29:18.927 INFO:teuthology.orchestra.run.smithi163.stdout: "log_level": { 2023-07-14T18:29:18.927 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "log_level", 2023-07-14T18:29:18.927 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "str", 2023-07-14T18:29:18.927 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:18.928 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:18.928 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "", 2023-07-14T18:29:18.928 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:18.928 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:18.928 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [ 2023-07-14T18:29:18.929 INFO:teuthology.orchestra.run.smithi163.stdout: "", 2023-07-14T18:29:18.929 INFO:teuthology.orchestra.run.smithi163.stdout: "critical", 2023-07-14T18:29:18.929 INFO:teuthology.orchestra.run.smithi163.stdout: "debug", 2023-07-14T18:29:18.929 INFO:teuthology.orchestra.run.smithi163.stdout: "error", 2023-07-14T18:29:18.929 INFO:teuthology.orchestra.run.smithi163.stdout: "info", 2023-07-14T18:29:18.930 INFO:teuthology.orchestra.run.smithi163.stdout: "warning" 2023-07-14T18:29:18.930 INFO:teuthology.orchestra.run.smithi163.stdout: ], 2023-07-14T18:29:18.930 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:18.930 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:18.930 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:18.931 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:18.931 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:18.931 INFO:teuthology.orchestra.run.smithi163.stdout: "log_to_cluster": { 2023-07-14T18:29:18.931 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "log_to_cluster", 2023-07-14T18:29:18.931 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "bool", 2023-07-14T18:29:18.932 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:18.932 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:18.932 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "False", 2023-07-14T18:29:18.932 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:18.932 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:18.933 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:18.933 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:18.933 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:18.933 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:18.933 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:18.933 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:18.934 INFO:teuthology.orchestra.run.smithi163.stdout: "log_to_cluster_level": { 2023-07-14T18:29:18.934 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "log_to_cluster_level", 2023-07-14T18:29:18.934 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "str", 2023-07-14T18:29:18.934 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:18.934 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:18.935 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "info", 2023-07-14T18:29:18.935 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:18.935 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:18.935 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [ 2023-07-14T18:29:18.935 INFO:teuthology.orchestra.run.smithi163.stdout: "", 2023-07-14T18:29:18.936 INFO:teuthology.orchestra.run.smithi163.stdout: "critical", 2023-07-14T18:29:18.936 INFO:teuthology.orchestra.run.smithi163.stdout: "debug", 2023-07-14T18:29:18.936 INFO:teuthology.orchestra.run.smithi163.stdout: "error", 2023-07-14T18:29:18.936 INFO:teuthology.orchestra.run.smithi163.stdout: "info", 2023-07-14T18:29:18.936 INFO:teuthology.orchestra.run.smithi163.stdout: "warning" 2023-07-14T18:29:18.937 INFO:teuthology.orchestra.run.smithi163.stdout: ], 2023-07-14T18:29:18.937 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:18.937 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:18.937 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:18.937 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:18.938 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:18.938 INFO:teuthology.orchestra.run.smithi163.stdout: "log_to_file": { 2023-07-14T18:29:18.938 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "log_to_file", 2023-07-14T18:29:18.938 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "bool", 2023-07-14T18:29:18.938 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:18.939 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:18.939 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "False", 2023-07-14T18:29:18.939 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:18.939 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:18.939 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:18.940 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:18.940 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:18.940 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:18.940 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:18.940 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-07-14T18:29:18.941 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-07-14T18:29:18.941 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:18.941 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-07-14T18:29:18.941 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "volumes", 2023-07-14T18:29:18.941 INFO:teuthology.orchestra.run.smithi163.stdout: "can_run": true, 2023-07-14T18:29:18.941 INFO:teuthology.orchestra.run.smithi163.stdout: "error_string": "", 2023-07-14T18:29:18.942 INFO:teuthology.orchestra.run.smithi163.stdout: "module_options": { 2023-07-14T18:29:18.942 INFO:teuthology.orchestra.run.smithi163.stdout: "log_level": { 2023-07-14T18:29:18.942 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "log_level", 2023-07-14T18:29:18.942 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "str", 2023-07-14T18:29:18.943 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:18.943 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:18.943 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "", 2023-07-14T18:29:18.943 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:18.943 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:18.944 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [ 2023-07-14T18:29:18.944 INFO:teuthology.orchestra.run.smithi163.stdout: "", 2023-07-14T18:29:18.944 INFO:teuthology.orchestra.run.smithi163.stdout: "critical", 2023-07-14T18:29:18.944 INFO:teuthology.orchestra.run.smithi163.stdout: "debug", 2023-07-14T18:29:18.944 INFO:teuthology.orchestra.run.smithi163.stdout: "error", 2023-07-14T18:29:18.945 INFO:teuthology.orchestra.run.smithi163.stdout: "info", 2023-07-14T18:29:18.945 INFO:teuthology.orchestra.run.smithi163.stdout: "warning" 2023-07-14T18:29:18.945 INFO:teuthology.orchestra.run.smithi163.stdout: ], 2023-07-14T18:29:18.945 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:18.945 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:18.945 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:18.946 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:18.946 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:18.946 INFO:teuthology.orchestra.run.smithi163.stdout: "log_to_cluster": { 2023-07-14T18:29:18.946 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "log_to_cluster", 2023-07-14T18:29:18.946 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "bool", 2023-07-14T18:29:18.947 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:18.947 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:18.947 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "False", 2023-07-14T18:29:18.947 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:18.947 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:18.948 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:18.948 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:18.948 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:18.948 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:18.948 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:18.949 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:18.949 INFO:teuthology.orchestra.run.smithi163.stdout: "log_to_cluster_level": { 2023-07-14T18:29:18.949 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "log_to_cluster_level", 2023-07-14T18:29:18.949 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "str", 2023-07-14T18:29:18.949 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:18.950 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:18.950 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "info", 2023-07-14T18:29:18.950 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:18.950 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:18.950 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [ 2023-07-14T18:29:18.951 INFO:teuthology.orchestra.run.smithi163.stdout: "", 2023-07-14T18:29:18.951 INFO:teuthology.orchestra.run.smithi163.stdout: "critical", 2023-07-14T18:29:18.951 INFO:teuthology.orchestra.run.smithi163.stdout: "debug", 2023-07-14T18:29:18.951 INFO:teuthology.orchestra.run.smithi163.stdout: "error", 2023-07-14T18:29:18.951 INFO:teuthology.orchestra.run.smithi163.stdout: "info", 2023-07-14T18:29:18.952 INFO:teuthology.orchestra.run.smithi163.stdout: "warning" 2023-07-14T18:29:18.952 INFO:teuthology.orchestra.run.smithi163.stdout: ], 2023-07-14T18:29:18.952 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:18.952 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:18.952 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:18.953 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:18.953 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:18.953 INFO:teuthology.orchestra.run.smithi163.stdout: "log_to_file": { 2023-07-14T18:29:18.953 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "log_to_file", 2023-07-14T18:29:18.953 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "bool", 2023-07-14T18:29:18.954 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:18.954 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:18.954 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "False", 2023-07-14T18:29:18.954 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:18.954 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:18.955 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:18.955 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:18.955 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:18.955 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:18.956 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:18.956 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:18.956 INFO:teuthology.orchestra.run.smithi163.stdout: "max_concurrent_clones": { 2023-07-14T18:29:18.957 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "max_concurrent_clones", 2023-07-14T18:29:18.957 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "int", 2023-07-14T18:29:18.957 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:18.957 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:18.958 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "4", 2023-07-14T18:29:18.958 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:18.958 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:18.958 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:18.958 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "Number of asynchronous cloner threads", 2023-07-14T18:29:18.959 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:18.959 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:18.959 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:18.959 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:18.960 INFO:teuthology.orchestra.run.smithi163.stdout: "snapshot_clone_delay": { 2023-07-14T18:29:18.960 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "snapshot_clone_delay", 2023-07-14T18:29:18.960 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "int", 2023-07-14T18:29:18.960 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:18.961 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:18.961 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "0", 2023-07-14T18:29:18.961 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:18.962 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:18.962 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:18.962 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2023-07-14T18:29:18.962 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:18.962 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:18.963 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:18.963 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-07-14T18:29:18.963 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-07-14T18:29:18.963 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:18.964 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-07-14T18:29:18.964 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "zabbix", 2023-07-14T18:29:18.964 INFO:teuthology.orchestra.run.smithi163.stdout: "can_run": true, 2023-07-14T18:29:18.964 INFO:teuthology.orchestra.run.smithi163.stdout: "error_string": "", 2023-07-14T18:29:18.965 INFO:teuthology.orchestra.run.smithi163.stdout: "module_options": { 2023-07-14T18:29:18.965 INFO:teuthology.orchestra.run.smithi163.stdout: "discovery_interval": { 2023-07-14T18:29:18.965 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "discovery_interval", 2023-07-14T18:29:18.965 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "uint", 2023-07-14T18:29:18.965 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:18.965 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:18.966 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "100", 2023-07-14T18:29:18.966 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:18.966 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:18.966 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:18.966 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:18.967 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:18.967 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:18.967 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:18.967 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:18.967 INFO:teuthology.orchestra.run.smithi163.stdout: "identifier": { 2023-07-14T18:29:18.968 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "identifier", 2023-07-14T18:29:18.968 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "str", 2023-07-14T18:29:18.968 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:18.968 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:18.968 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "", 2023-07-14T18:29:18.969 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:18.969 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:18.969 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:18.969 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:18.969 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:18.970 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:18.970 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:18.970 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:18.970 INFO:teuthology.orchestra.run.smithi163.stdout: "interval": { 2023-07-14T18:29:18.970 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "interval", 2023-07-14T18:29:18.971 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "secs", 2023-07-14T18:29:18.971 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:18.971 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:18.971 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "60", 2023-07-14T18:29:18.971 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:18.972 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:18.972 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:18.972 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:18.972 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:18.972 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:18.973 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:18.973 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:18.973 INFO:teuthology.orchestra.run.smithi163.stdout: "log_level": { 2023-07-14T18:29:18.973 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "log_level", 2023-07-14T18:29:18.973 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "str", 2023-07-14T18:29:18.973 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:18.974 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:18.974 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "", 2023-07-14T18:29:18.974 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:18.974 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:18.974 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [ 2023-07-14T18:29:18.975 INFO:teuthology.orchestra.run.smithi163.stdout: "", 2023-07-14T18:29:18.975 INFO:teuthology.orchestra.run.smithi163.stdout: "critical", 2023-07-14T18:29:18.975 INFO:teuthology.orchestra.run.smithi163.stdout: "debug", 2023-07-14T18:29:18.975 INFO:teuthology.orchestra.run.smithi163.stdout: "error", 2023-07-14T18:29:18.975 INFO:teuthology.orchestra.run.smithi163.stdout: "info", 2023-07-14T18:29:18.976 INFO:teuthology.orchestra.run.smithi163.stdout: "warning" 2023-07-14T18:29:18.976 INFO:teuthology.orchestra.run.smithi163.stdout: ], 2023-07-14T18:29:18.976 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:18.976 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:18.976 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:18.977 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:18.977 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:18.977 INFO:teuthology.orchestra.run.smithi163.stdout: "log_to_cluster": { 2023-07-14T18:29:18.977 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "log_to_cluster", 2023-07-14T18:29:18.977 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "bool", 2023-07-14T18:29:18.978 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:18.978 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:18.978 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "False", 2023-07-14T18:29:18.978 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:18.978 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:18.979 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:18.979 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:18.979 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:18.979 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:18.979 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:18.980 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:18.980 INFO:teuthology.orchestra.run.smithi163.stdout: "log_to_cluster_level": { 2023-07-14T18:29:18.980 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "log_to_cluster_level", 2023-07-14T18:29:18.980 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "str", 2023-07-14T18:29:18.980 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:18.981 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:18.981 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "info", 2023-07-14T18:29:18.981 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:18.981 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:18.981 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [ 2023-07-14T18:29:18.982 INFO:teuthology.orchestra.run.smithi163.stdout: "", 2023-07-14T18:29:18.982 INFO:teuthology.orchestra.run.smithi163.stdout: "critical", 2023-07-14T18:29:18.982 INFO:teuthology.orchestra.run.smithi163.stdout: "debug", 2023-07-14T18:29:18.982 INFO:teuthology.orchestra.run.smithi163.stdout: "error", 2023-07-14T18:29:18.982 INFO:teuthology.orchestra.run.smithi163.stdout: "info", 2023-07-14T18:29:18.983 INFO:teuthology.orchestra.run.smithi163.stdout: "warning" 2023-07-14T18:29:18.983 INFO:teuthology.orchestra.run.smithi163.stdout: ], 2023-07-14T18:29:18.983 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:18.983 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:18.983 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:18.983 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:18.984 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:18.984 INFO:teuthology.orchestra.run.smithi163.stdout: "log_to_file": { 2023-07-14T18:29:18.984 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "log_to_file", 2023-07-14T18:29:18.984 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "bool", 2023-07-14T18:29:18.984 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:18.985 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:18.985 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "False", 2023-07-14T18:29:18.985 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:18.985 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:18.985 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:18.986 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:18.986 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:18.986 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:18.986 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:18.986 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:18.987 INFO:teuthology.orchestra.run.smithi163.stdout: "zabbix_host": { 2023-07-14T18:29:18.987 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "zabbix_host", 2023-07-14T18:29:18.987 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "str", 2023-07-14T18:29:18.987 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:18.987 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:18.988 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "", 2023-07-14T18:29:18.988 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:18.988 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:18.988 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:18.988 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:18.989 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:18.989 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:18.989 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:18.989 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:18.989 INFO:teuthology.orchestra.run.smithi163.stdout: "zabbix_port": { 2023-07-14T18:29:18.990 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "zabbix_port", 2023-07-14T18:29:18.990 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "int", 2023-07-14T18:29:18.990 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:18.990 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:18.990 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "10051", 2023-07-14T18:29:18.991 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:18.991 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:18.991 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:18.991 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:18.991 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:18.991 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:18.992 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:18.992 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:18.992 INFO:teuthology.orchestra.run.smithi163.stdout: "zabbix_sender": { 2023-07-14T18:29:18.992 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "zabbix_sender", 2023-07-14T18:29:18.992 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "str", 2023-07-14T18:29:18.993 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:18.993 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:18.993 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "/usr/bin/zabbix_sender", 2023-07-14T18:29:18.993 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:18.993 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:18.994 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:18.994 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:18.994 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:18.994 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:18.994 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:18.995 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-07-14T18:29:18.995 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-07-14T18:29:18.995 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-07-14T18:29:18.995 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-07-14T18:29:18.995 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-07-14T18:29:18.996 INFO:teuthology.orchestra.run.smithi163.stdout: ], 2023-07-14T18:29:18.996 INFO:teuthology.orchestra.run.smithi163.stdout: "modules": [ 2023-07-14T18:29:18.996 INFO:teuthology.orchestra.run.smithi163.stdout: "cephadm", 2023-07-14T18:29:18.996 INFO:teuthology.orchestra.run.smithi163.stdout: "dashboard", 2023-07-14T18:29:18.996 INFO:teuthology.orchestra.run.smithi163.stdout: "iostat", 2023-07-14T18:29:18.997 INFO:teuthology.orchestra.run.smithi163.stdout: "nfs", 2023-07-14T18:29:18.997 INFO:teuthology.orchestra.run.smithi163.stdout: "restful" 2023-07-14T18:29:18.997 INFO:teuthology.orchestra.run.smithi163.stdout: ], 2023-07-14T18:29:18.997 INFO:teuthology.orchestra.run.smithi163.stdout: "available_modules": [ 2023-07-14T18:29:18.997 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-07-14T18:29:18.998 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "alerts", 2023-07-14T18:29:18.998 INFO:teuthology.orchestra.run.smithi163.stdout: "can_run": true, 2023-07-14T18:29:18.998 INFO:teuthology.orchestra.run.smithi163.stdout: "error_string": "", 2023-07-14T18:29:18.998 INFO:teuthology.orchestra.run.smithi163.stdout: "module_options": { 2023-07-14T18:29:18.998 INFO:teuthology.orchestra.run.smithi163.stdout: "interval": { 2023-07-14T18:29:18.999 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "interval", 2023-07-14T18:29:18.999 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "secs", 2023-07-14T18:29:18.999 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:18.999 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:18.999 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "60", 2023-07-14T18:29:18.999 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:19.000 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:19.000 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:19.000 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "How frequently to reexamine health status", 2023-07-14T18:29:19.000 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:19.000 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:19.001 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:19.001 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:19.001 INFO:teuthology.orchestra.run.smithi163.stdout: "log_level": { 2023-07-14T18:29:19.001 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "log_level", 2023-07-14T18:29:19.001 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "str", 2023-07-14T18:29:19.002 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:19.002 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:19.002 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "", 2023-07-14T18:29:19.002 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:19.002 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:19.003 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [ 2023-07-14T18:29:19.003 INFO:teuthology.orchestra.run.smithi163.stdout: "", 2023-07-14T18:29:19.003 INFO:teuthology.orchestra.run.smithi163.stdout: "critical", 2023-07-14T18:29:19.003 INFO:teuthology.orchestra.run.smithi163.stdout: "debug", 2023-07-14T18:29:19.003 INFO:teuthology.orchestra.run.smithi163.stdout: "error", 2023-07-14T18:29:19.004 INFO:teuthology.orchestra.run.smithi163.stdout: "info", 2023-07-14T18:29:19.004 INFO:teuthology.orchestra.run.smithi163.stdout: "warning" 2023-07-14T18:29:19.004 INFO:teuthology.orchestra.run.smithi163.stdout: ], 2023-07-14T18:29:19.004 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:19.004 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:19.005 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:19.005 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:19.005 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:19.005 INFO:teuthology.orchestra.run.smithi163.stdout: "log_to_cluster": { 2023-07-14T18:29:19.005 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "log_to_cluster", 2023-07-14T18:29:19.006 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "bool", 2023-07-14T18:29:19.006 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:19.006 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:19.006 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "False", 2023-07-14T18:29:19.006 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:19.007 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:19.007 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:19.007 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:19.007 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:19.007 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:19.007 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:19.008 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:19.008 INFO:teuthology.orchestra.run.smithi163.stdout: "log_to_cluster_level": { 2023-07-14T18:29:19.008 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "log_to_cluster_level", 2023-07-14T18:29:19.008 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "str", 2023-07-14T18:29:19.008 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:19.009 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:19.009 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "info", 2023-07-14T18:29:19.009 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:19.009 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:19.009 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [ 2023-07-14T18:29:19.010 INFO:teuthology.orchestra.run.smithi163.stdout: "", 2023-07-14T18:29:19.010 INFO:teuthology.orchestra.run.smithi163.stdout: "critical", 2023-07-14T18:29:19.010 INFO:teuthology.orchestra.run.smithi163.stdout: "debug", 2023-07-14T18:29:19.010 INFO:teuthology.orchestra.run.smithi163.stdout: "error", 2023-07-14T18:29:19.010 INFO:teuthology.orchestra.run.smithi163.stdout: "info", 2023-07-14T18:29:19.011 INFO:teuthology.orchestra.run.smithi163.stdout: "warning" 2023-07-14T18:29:19.011 INFO:teuthology.orchestra.run.smithi163.stdout: ], 2023-07-14T18:29:19.011 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:19.011 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:19.011 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:19.012 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:19.012 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:19.012 INFO:teuthology.orchestra.run.smithi163.stdout: "log_to_file": { 2023-07-14T18:29:19.012 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "log_to_file", 2023-07-14T18:29:19.012 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "bool", 2023-07-14T18:29:19.013 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:19.013 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:19.013 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "False", 2023-07-14T18:29:19.013 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:19.013 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:19.014 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:19.014 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:19.014 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:19.014 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:19.014 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:19.014 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:19.015 INFO:teuthology.orchestra.run.smithi163.stdout: "smtp_destination": { 2023-07-14T18:29:19.015 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "smtp_destination", 2023-07-14T18:29:19.015 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "str", 2023-07-14T18:29:19.015 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:19.015 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:19.016 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "", 2023-07-14T18:29:19.016 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:19.016 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:19.016 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:19.016 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "Email address to send alerts to", 2023-07-14T18:29:19.017 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:19.017 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:19.017 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:19.017 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:19.017 INFO:teuthology.orchestra.run.smithi163.stdout: "smtp_from_name": { 2023-07-14T18:29:19.018 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "smtp_from_name", 2023-07-14T18:29:19.018 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "str", 2023-07-14T18:29:19.018 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:19.018 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:19.018 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "Ceph", 2023-07-14T18:29:19.019 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:19.019 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:19.019 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:19.019 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "Email From: name", 2023-07-14T18:29:19.019 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:19.020 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:19.020 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:19.020 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:19.020 INFO:teuthology.orchestra.run.smithi163.stdout: "smtp_host": { 2023-07-14T18:29:19.020 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "smtp_host", 2023-07-14T18:29:19.021 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "str", 2023-07-14T18:29:19.021 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:19.021 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:19.021 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "", 2023-07-14T18:29:19.021 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:19.022 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:19.022 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:19.022 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "SMTP server", 2023-07-14T18:29:19.022 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:19.022 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:19.022 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:19.023 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:19.023 INFO:teuthology.orchestra.run.smithi163.stdout: "smtp_password": { 2023-07-14T18:29:19.023 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "smtp_password", 2023-07-14T18:29:19.023 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "str", 2023-07-14T18:29:19.023 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:19.024 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:19.024 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "", 2023-07-14T18:29:19.024 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:19.024 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:19.024 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:19.025 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "Password to authenticate with", 2023-07-14T18:29:19.025 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:19.025 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:19.025 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:19.025 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:19.026 INFO:teuthology.orchestra.run.smithi163.stdout: "smtp_port": { 2023-07-14T18:29:19.026 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "smtp_port", 2023-07-14T18:29:19.026 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "int", 2023-07-14T18:29:19.026 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:19.026 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:19.027 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "465", 2023-07-14T18:29:19.027 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:19.027 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:19.027 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:19.027 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "SMTP port", 2023-07-14T18:29:19.028 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:19.028 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:19.028 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:19.028 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:19.028 INFO:teuthology.orchestra.run.smithi163.stdout: "smtp_sender": { 2023-07-14T18:29:19.029 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "smtp_sender", 2023-07-14T18:29:19.029 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "str", 2023-07-14T18:29:19.029 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:19.029 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:19.029 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "", 2023-07-14T18:29:19.030 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:19.030 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:19.030 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:19.030 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "SMTP envelope sender", 2023-07-14T18:29:19.030 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:19.031 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:19.031 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:19.031 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:19.031 INFO:teuthology.orchestra.run.smithi163.stdout: "smtp_ssl": { 2023-07-14T18:29:19.031 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "smtp_ssl", 2023-07-14T18:29:19.032 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "bool", 2023-07-14T18:29:19.032 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:19.032 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:19.032 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "True", 2023-07-14T18:29:19.032 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:19.033 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:19.033 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:19.033 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "Use SSL to connect to SMTP server", 2023-07-14T18:29:19.033 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:19.033 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:19.034 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:19.034 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:19.034 INFO:teuthology.orchestra.run.smithi163.stdout: "smtp_user": { 2023-07-14T18:29:19.034 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "smtp_user", 2023-07-14T18:29:19.034 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "str", 2023-07-14T18:29:19.035 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:19.035 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:19.035 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "", 2023-07-14T18:29:19.035 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:19.035 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:19.035 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:19.036 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "User to authenticate as", 2023-07-14T18:29:19.036 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:19.036 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:19.036 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:19.036 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-07-14T18:29:19.037 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-07-14T18:29:19.037 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:19.037 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-07-14T18:29:19.037 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "balancer", 2023-07-14T18:29:19.037 INFO:teuthology.orchestra.run.smithi163.stdout: "can_run": true, 2023-07-14T18:29:19.038 INFO:teuthology.orchestra.run.smithi163.stdout: "error_string": "", 2023-07-14T18:29:19.038 INFO:teuthology.orchestra.run.smithi163.stdout: "module_options": { 2023-07-14T18:29:19.038 INFO:teuthology.orchestra.run.smithi163.stdout: "active": { 2023-07-14T18:29:19.038 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "active", 2023-07-14T18:29:19.038 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "bool", 2023-07-14T18:29:19.039 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:19.039 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:19.039 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "True", 2023-07-14T18:29:19.039 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:19.039 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:19.040 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:19.040 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "automatically balance PGs across cluster", 2023-07-14T18:29:19.040 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:19.040 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:19.040 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:19.041 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:19.041 INFO:teuthology.orchestra.run.smithi163.stdout: "begin_time": { 2023-07-14T18:29:19.041 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "begin_time", 2023-07-14T18:29:19.041 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "str", 2023-07-14T18:29:19.041 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:19.042 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:19.042 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "0000", 2023-07-14T18:29:19.042 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:19.042 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:19.042 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:19.043 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "beginning time of day to automatically balance", 2023-07-14T18:29:19.043 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "This is a time of day in the format HHMM.", 2023-07-14T18:29:19.043 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:19.043 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:19.043 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:19.044 INFO:teuthology.orchestra.run.smithi163.stdout: "begin_weekday": { 2023-07-14T18:29:19.044 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "begin_weekday", 2023-07-14T18:29:19.044 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "uint", 2023-07-14T18:29:19.044 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:19.044 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:19.045 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "0", 2023-07-14T18:29:19.045 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "0", 2023-07-14T18:29:19.045 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "6", 2023-07-14T18:29:19.045 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:19.045 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2023-07-14T18:29:19.045 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2023-07-14T18:29:19.046 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:19.046 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:19.046 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:19.046 INFO:teuthology.orchestra.run.smithi163.stdout: "crush_compat_max_iterations": { 2023-07-14T18:29:19.047 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "crush_compat_max_iterations", 2023-07-14T18:29:19.047 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "uint", 2023-07-14T18:29:19.047 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:19.047 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:19.047 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "25", 2023-07-14T18:29:19.047 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "1", 2023-07-14T18:29:19.048 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "250", 2023-07-14T18:29:19.048 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:19.048 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "maximum number of iterations to attempt optimization", 2023-07-14T18:29:19.048 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:19.048 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:19.049 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:19.049 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:19.049 INFO:teuthology.orchestra.run.smithi163.stdout: "crush_compat_metrics": { 2023-07-14T18:29:19.049 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "crush_compat_metrics", 2023-07-14T18:29:19.049 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "str", 2023-07-14T18:29:19.050 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:19.050 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:19.050 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "pgs,objects,bytes", 2023-07-14T18:29:19.050 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:19.050 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:19.051 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:19.051 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "metrics with which to calculate OSD utilization", 2023-07-14T18:29:19.051 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2023-07-14T18:29:19.051 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:19.051 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:19.052 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:19.052 INFO:teuthology.orchestra.run.smithi163.stdout: "crush_compat_step": { 2023-07-14T18:29:19.052 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "crush_compat_step", 2023-07-14T18:29:19.052 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "float", 2023-07-14T18:29:19.052 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:19.053 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:19.053 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "0.5", 2023-07-14T18:29:19.053 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "0.001", 2023-07-14T18:29:19.053 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "0.999", 2023-07-14T18:29:19.053 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:19.054 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "aggressiveness of optimization", 2023-07-14T18:29:19.054 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2023-07-14T18:29:19.054 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:19.054 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:19.054 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:19.055 INFO:teuthology.orchestra.run.smithi163.stdout: "end_time": { 2023-07-14T18:29:19.055 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "end_time", 2023-07-14T18:29:19.055 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "str", 2023-07-14T18:29:19.055 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:19.055 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:19.055 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "2359", 2023-07-14T18:29:19.056 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:19.056 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:19.056 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:19.056 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "ending time of day to automatically balance", 2023-07-14T18:29:19.056 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "This is a time of day in the format HHMM.", 2023-07-14T18:29:19.057 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:19.057 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:19.057 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:19.057 INFO:teuthology.orchestra.run.smithi163.stdout: "end_weekday": { 2023-07-14T18:29:19.057 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "end_weekday", 2023-07-14T18:29:19.058 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "uint", 2023-07-14T18:29:19.058 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:19.058 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:19.058 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "0", 2023-07-14T18:29:19.058 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "0", 2023-07-14T18:29:19.059 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "6", 2023-07-14T18:29:19.059 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:19.059 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2023-07-14T18:29:19.059 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2023-07-14T18:29:19.059 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:19.059 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:19.060 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:19.060 INFO:teuthology.orchestra.run.smithi163.stdout: "log_level": { 2023-07-14T18:29:19.060 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "log_level", 2023-07-14T18:29:19.060 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "str", 2023-07-14T18:29:19.060 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:19.061 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:19.061 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "", 2023-07-14T18:29:19.061 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:19.061 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:19.061 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [ 2023-07-14T18:29:19.062 INFO:teuthology.orchestra.run.smithi163.stdout: "", 2023-07-14T18:29:19.062 INFO:teuthology.orchestra.run.smithi163.stdout: "critical", 2023-07-14T18:29:19.062 INFO:teuthology.orchestra.run.smithi163.stdout: "debug", 2023-07-14T18:29:19.062 INFO:teuthology.orchestra.run.smithi163.stdout: "error", 2023-07-14T18:29:19.062 INFO:teuthology.orchestra.run.smithi163.stdout: "info", 2023-07-14T18:29:19.063 INFO:teuthology.orchestra.run.smithi163.stdout: "warning" 2023-07-14T18:29:19.063 INFO:teuthology.orchestra.run.smithi163.stdout: ], 2023-07-14T18:29:19.063 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:19.063 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:19.063 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:19.064 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:19.064 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:19.064 INFO:teuthology.orchestra.run.smithi163.stdout: "log_to_cluster": { 2023-07-14T18:29:19.064 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "log_to_cluster", 2023-07-14T18:29:19.064 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "bool", 2023-07-14T18:29:19.064 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:19.065 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:19.065 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "False", 2023-07-14T18:29:19.065 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:19.065 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:19.065 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:19.066 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:19.066 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:19.066 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:19.066 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:19.066 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:19.067 INFO:teuthology.orchestra.run.smithi163.stdout: "log_to_cluster_level": { 2023-07-14T18:29:19.067 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "log_to_cluster_level", 2023-07-14T18:29:19.067 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "str", 2023-07-14T18:29:19.067 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:19.067 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:19.068 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "info", 2023-07-14T18:29:19.068 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:19.068 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:19.068 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [ 2023-07-14T18:29:19.068 INFO:teuthology.orchestra.run.smithi163.stdout: "", 2023-07-14T18:29:19.069 INFO:teuthology.orchestra.run.smithi163.stdout: "critical", 2023-07-14T18:29:19.069 INFO:teuthology.orchestra.run.smithi163.stdout: "debug", 2023-07-14T18:29:19.069 INFO:teuthology.orchestra.run.smithi163.stdout: "error", 2023-07-14T18:29:19.069 INFO:teuthology.orchestra.run.smithi163.stdout: "info", 2023-07-14T18:29:19.069 INFO:teuthology.orchestra.run.smithi163.stdout: "warning" 2023-07-14T18:29:19.070 INFO:teuthology.orchestra.run.smithi163.stdout: ], 2023-07-14T18:29:19.070 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:19.070 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:19.070 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:19.070 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:19.070 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:19.071 INFO:teuthology.orchestra.run.smithi163.stdout: "log_to_file": { 2023-07-14T18:29:19.071 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "log_to_file", 2023-07-14T18:29:19.071 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "bool", 2023-07-14T18:29:19.071 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:19.071 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:19.072 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "False", 2023-07-14T18:29:19.072 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:19.072 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:19.072 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:19.072 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:19.073 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:19.073 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:19.073 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:19.073 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:19.073 INFO:teuthology.orchestra.run.smithi163.stdout: "min_score": { 2023-07-14T18:29:19.074 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "min_score", 2023-07-14T18:29:19.074 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "float", 2023-07-14T18:29:19.074 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:19.074 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:19.074 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "0", 2023-07-14T18:29:19.075 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:19.075 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:19.075 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:19.075 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "minimum score, below which no optimization is attempted", 2023-07-14T18:29:19.075 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:19.076 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:19.076 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:19.076 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:19.076 INFO:teuthology.orchestra.run.smithi163.stdout: "mode": { 2023-07-14T18:29:19.076 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "mode", 2023-07-14T18:29:19.077 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "str", 2023-07-14T18:29:19.077 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:19.077 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:19.077 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "upmap", 2023-07-14T18:29:19.077 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:19.078 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:19.078 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [ 2023-07-14T18:29:19.078 INFO:teuthology.orchestra.run.smithi163.stdout: "crush-compat", 2023-07-14T18:29:19.078 INFO:teuthology.orchestra.run.smithi163.stdout: "none", 2023-07-14T18:29:19.078 INFO:teuthology.orchestra.run.smithi163.stdout: "upmap" 2023-07-14T18:29:19.079 INFO:teuthology.orchestra.run.smithi163.stdout: ], 2023-07-14T18:29:19.079 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "Balancer mode", 2023-07-14T18:29:19.079 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:19.079 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:19.079 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:19.079 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:19.080 INFO:teuthology.orchestra.run.smithi163.stdout: "pool_ids": { 2023-07-14T18:29:19.080 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "pool_ids", 2023-07-14T18:29:19.080 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "str", 2023-07-14T18:29:19.080 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:19.080 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:19.081 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "", 2023-07-14T18:29:19.081 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:19.081 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:19.081 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:19.081 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "pools which the automatic balancing will be limited to", 2023-07-14T18:29:19.082 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:19.082 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:19.082 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:19.082 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:19.082 INFO:teuthology.orchestra.run.smithi163.stdout: "sleep_interval": { 2023-07-14T18:29:19.083 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "sleep_interval", 2023-07-14T18:29:19.083 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "secs", 2023-07-14T18:29:19.083 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:19.083 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:19.083 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "60", 2023-07-14T18:29:19.084 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:19.084 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:19.084 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:19.084 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "how frequently to wake up and attempt optimization", 2023-07-14T18:29:19.084 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:19.085 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:19.085 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:19.085 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:19.085 INFO:teuthology.orchestra.run.smithi163.stdout: "upmap_max_deviation": { 2023-07-14T18:29:19.085 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "upmap_max_deviation", 2023-07-14T18:29:19.086 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "int", 2023-07-14T18:29:19.086 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:19.086 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:19.086 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "5", 2023-07-14T18:29:19.086 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "1", 2023-07-14T18:29:19.087 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:19.087 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:19.087 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "deviation below which no optimization is attempted", 2023-07-14T18:29:19.087 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2023-07-14T18:29:19.087 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:19.088 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:19.088 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:19.088 INFO:teuthology.orchestra.run.smithi163.stdout: "upmap_max_optimizations": { 2023-07-14T18:29:19.088 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "upmap_max_optimizations", 2023-07-14T18:29:19.088 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "uint", 2023-07-14T18:29:19.089 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:19.089 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:19.089 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "10", 2023-07-14T18:29:19.089 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:19.089 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:19.090 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:19.090 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "maximum upmap optimizations to make per attempt", 2023-07-14T18:29:19.090 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:19.090 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:19.090 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:19.091 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-07-14T18:29:19.091 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-07-14T18:29:19.091 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:19.091 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-07-14T18:29:19.091 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "cephadm", 2023-07-14T18:29:19.092 INFO:teuthology.orchestra.run.smithi163.stdout: "can_run": true, 2023-07-14T18:29:19.092 INFO:teuthology.orchestra.run.smithi163.stdout: "error_string": "", 2023-07-14T18:29:19.092 INFO:teuthology.orchestra.run.smithi163.stdout: "module_options": { 2023-07-14T18:29:19.092 INFO:teuthology.orchestra.run.smithi163.stdout: "agent_down_multiplier": { 2023-07-14T18:29:19.092 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "agent_down_multiplier", 2023-07-14T18:29:19.093 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "float", 2023-07-14T18:29:19.093 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:19.093 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:19.093 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "3.0", 2023-07-14T18:29:19.093 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:19.094 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:19.094 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:19.094 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2023-07-14T18:29:19.094 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:19.094 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:19.094 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:19.095 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:19.095 INFO:teuthology.orchestra.run.smithi163.stdout: "agent_refresh_rate": { 2023-07-14T18:29:19.095 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "agent_refresh_rate", 2023-07-14T18:29:19.095 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "secs", 2023-07-14T18:29:19.095 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:19.096 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:19.096 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "20", 2023-07-14T18:29:19.096 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:19.096 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:19.096 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:19.097 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2023-07-14T18:29:19.097 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:19.097 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:19.097 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:19.097 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:19.098 INFO:teuthology.orchestra.run.smithi163.stdout: "agent_starting_port": { 2023-07-14T18:29:19.098 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "agent_starting_port", 2023-07-14T18:29:19.098 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "int", 2023-07-14T18:29:19.098 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:19.098 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:19.099 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "4721", 2023-07-14T18:29:19.099 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:19.099 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:19.099 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:19.099 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2023-07-14T18:29:19.100 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:19.100 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:19.100 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:19.100 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:19.100 INFO:teuthology.orchestra.run.smithi163.stdout: "alertmanager_web_password": { 2023-07-14T18:29:19.101 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "alertmanager_web_password", 2023-07-14T18:29:19.101 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "str", 2023-07-14T18:29:19.101 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:19.101 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:19.101 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "admin", 2023-07-14T18:29:19.101 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:19.102 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:19.102 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:19.102 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "Alertmanager web password", 2023-07-14T18:29:19.102 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:19.102 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:19.103 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:19.103 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:19.103 INFO:teuthology.orchestra.run.smithi163.stdout: "alertmanager_web_user": { 2023-07-14T18:29:19.103 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "alertmanager_web_user", 2023-07-14T18:29:19.103 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "str", 2023-07-14T18:29:19.104 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:19.104 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:19.104 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "admin", 2023-07-14T18:29:19.104 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:19.104 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:19.105 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:19.105 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "Alertmanager web user", 2023-07-14T18:29:19.105 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:19.105 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:19.105 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:19.106 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:19.106 INFO:teuthology.orchestra.run.smithi163.stdout: "allow_ptrace": { 2023-07-14T18:29:19.106 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "allow_ptrace", 2023-07-14T18:29:19.106 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "bool", 2023-07-14T18:29:19.106 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:19.106 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:19.107 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "False", 2023-07-14T18:29:19.107 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:19.107 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:19.107 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:19.107 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2023-07-14T18:29:19.108 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2023-07-14T18:29:19.108 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:19.108 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:19.108 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:19.108 INFO:teuthology.orchestra.run.smithi163.stdout: "autotune_interval": { 2023-07-14T18:29:19.109 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "autotune_interval", 2023-07-14T18:29:19.109 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "secs", 2023-07-14T18:29:19.109 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:19.109 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:19.109 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "600", 2023-07-14T18:29:19.110 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:19.110 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:19.110 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:19.110 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "how frequently to autotune daemon memory", 2023-07-14T18:29:19.110 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:19.111 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:19.111 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:19.111 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:19.111 INFO:teuthology.orchestra.run.smithi163.stdout: "autotune_memory_target_ratio": { 2023-07-14T18:29:19.111 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "autotune_memory_target_ratio", 2023-07-14T18:29:19.112 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "float", 2023-07-14T18:29:19.112 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:19.112 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:19.112 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "0.7", 2023-07-14T18:29:19.112 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:19.113 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:19.113 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:19.113 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2023-07-14T18:29:19.113 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:19.113 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:19.114 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:19.114 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:19.114 INFO:teuthology.orchestra.run.smithi163.stdout: "cgroups_split": { 2023-07-14T18:29:19.114 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "cgroups_split", 2023-07-14T18:29:19.114 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "bool", 2023-07-14T18:29:19.115 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:19.115 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:19.115 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "True", 2023-07-14T18:29:19.115 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:19.115 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:19.115 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:19.116 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2023-07-14T18:29:19.116 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:19.116 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:19.116 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:19.116 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:19.117 INFO:teuthology.orchestra.run.smithi163.stdout: "config_checks_enabled": { 2023-07-14T18:29:19.117 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "config_checks_enabled", 2023-07-14T18:29:19.117 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "bool", 2023-07-14T18:29:19.117 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:19.117 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:19.118 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "False", 2023-07-14T18:29:19.118 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:19.118 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:19.118 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:19.118 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2023-07-14T18:29:19.119 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:19.119 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:19.119 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:19.119 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:19.119 INFO:teuthology.orchestra.run.smithi163.stdout: "config_dashboard": { 2023-07-14T18:29:19.120 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "config_dashboard", 2023-07-14T18:29:19.120 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "bool", 2023-07-14T18:29:19.120 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:19.120 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:19.120 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "True", 2023-07-14T18:29:19.121 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:19.121 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:19.121 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:19.121 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2023-07-14T18:29:19.121 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:19.121 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:19.122 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:19.122 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:19.122 INFO:teuthology.orchestra.run.smithi163.stdout: "container_image_alertmanager": { 2023-07-14T18:29:19.122 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "container_image_alertmanager", 2023-07-14T18:29:19.123 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "str", 2023-07-14T18:29:19.123 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:19.123 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:19.123 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.25.0", 2023-07-14T18:29:19.123 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:19.123 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:19.124 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:19.124 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "Prometheus container image", 2023-07-14T18:29:19.124 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:19.124 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:19.124 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:19.125 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:19.125 INFO:teuthology.orchestra.run.smithi163.stdout: "container_image_base": { 2023-07-14T18:29:19.125 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "container_image_base", 2023-07-14T18:29:19.125 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "str", 2023-07-14T18:29:19.125 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:19.126 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:19.126 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "quay.io/ceph/ceph", 2023-07-14T18:29:19.126 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:19.126 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:19.126 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:19.127 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "Container image name, without the tag", 2023-07-14T18:29:19.127 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:19.127 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:19.127 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:19.127 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:19.128 INFO:teuthology.orchestra.run.smithi163.stdout: "container_image_elasticsearch": { 2023-07-14T18:29:19.128 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "container_image_elasticsearch", 2023-07-14T18:29:19.128 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "str", 2023-07-14T18:29:19.128 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:19.128 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:19.129 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2023-07-14T18:29:19.129 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:19.129 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:19.129 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:19.129 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "elasticsearch container image", 2023-07-14T18:29:19.130 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:19.130 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:19.130 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:19.130 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:19.130 INFO:teuthology.orchestra.run.smithi163.stdout: "container_image_grafana": { 2023-07-14T18:29:19.131 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "container_image_grafana", 2023-07-14T18:29:19.131 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "str", 2023-07-14T18:29:19.131 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:19.131 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:19.131 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "quay.io/ceph/ceph-grafana:9.4.7", 2023-07-14T18:29:19.132 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:19.132 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:19.132 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:19.132 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "Prometheus container image", 2023-07-14T18:29:19.132 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:19.133 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:19.133 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:19.133 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:19.133 INFO:teuthology.orchestra.run.smithi163.stdout: "container_image_haproxy": { 2023-07-14T18:29:19.133 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "container_image_haproxy", 2023-07-14T18:29:19.134 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "str", 2023-07-14T18:29:19.134 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:19.134 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:19.134 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2023-07-14T18:29:19.134 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:19.135 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:19.135 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:19.135 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "HAproxy container image", 2023-07-14T18:29:19.135 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:19.135 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:19.136 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:19.136 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:19.136 INFO:teuthology.orchestra.run.smithi163.stdout: "container_image_jaeger_agent": { 2023-07-14T18:29:19.136 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "container_image_jaeger_agent", 2023-07-14T18:29:19.136 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "str", 2023-07-14T18:29:19.136 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:19.137 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:19.137 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2023-07-14T18:29:19.137 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:19.137 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:19.137 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:19.138 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "Jaeger agent container image", 2023-07-14T18:29:19.138 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:19.138 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:19.138 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:19.138 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:19.139 INFO:teuthology.orchestra.run.smithi163.stdout: "container_image_jaeger_collector": { 2023-07-14T18:29:19.139 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "container_image_jaeger_collector", 2023-07-14T18:29:19.139 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "str", 2023-07-14T18:29:19.139 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:19.139 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:19.140 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2023-07-14T18:29:19.140 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:19.140 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:19.140 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:19.140 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "Jaeger collector container image", 2023-07-14T18:29:19.141 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:19.141 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:19.141 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:19.141 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:19.141 INFO:teuthology.orchestra.run.smithi163.stdout: "container_image_jaeger_query": { 2023-07-14T18:29:19.142 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "container_image_jaeger_query", 2023-07-14T18:29:19.142 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "str", 2023-07-14T18:29:19.142 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:19.142 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:19.142 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2023-07-14T18:29:19.142 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:19.143 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:19.143 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:19.143 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "Jaeger query container image", 2023-07-14T18:29:19.143 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:19.143 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:19.144 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:19.144 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:19.144 INFO:teuthology.orchestra.run.smithi163.stdout: "container_image_keepalived": { 2023-07-14T18:29:19.144 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "container_image_keepalived", 2023-07-14T18:29:19.144 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "str", 2023-07-14T18:29:19.145 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:19.145 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:19.145 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2023-07-14T18:29:19.145 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:19.145 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:19.146 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:19.146 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "Keepalived container image", 2023-07-14T18:29:19.146 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:19.146 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:19.146 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:19.147 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:19.147 INFO:teuthology.orchestra.run.smithi163.stdout: "container_image_loki": { 2023-07-14T18:29:19.147 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "container_image_loki", 2023-07-14T18:29:19.147 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "str", 2023-07-14T18:29:19.147 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:19.148 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:19.148 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "docker.io/grafana/loki:2.4.0", 2023-07-14T18:29:19.148 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:19.148 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:19.148 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:19.149 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "Loki container image", 2023-07-14T18:29:19.149 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:19.149 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:19.149 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:19.149 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:19.150 INFO:teuthology.orchestra.run.smithi163.stdout: "container_image_node_exporter": { 2023-07-14T18:29:19.150 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "container_image_node_exporter", 2023-07-14T18:29:19.150 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "str", 2023-07-14T18:29:19.150 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:19.150 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:19.150 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.5.0", 2023-07-14T18:29:19.151 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:19.151 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:19.151 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:19.151 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "Prometheus container image", 2023-07-14T18:29:19.151 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:19.152 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:19.152 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:19.152 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:19.152 INFO:teuthology.orchestra.run.smithi163.stdout: "container_image_prometheus": { 2023-07-14T18:29:19.152 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "container_image_prometheus", 2023-07-14T18:29:19.153 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "str", 2023-07-14T18:29:19.153 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:19.153 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:19.153 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "quay.io/prometheus/prometheus:v2.43.0", 2023-07-14T18:29:19.153 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:19.154 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:19.154 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:19.154 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "Prometheus container image", 2023-07-14T18:29:19.154 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:19.154 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:19.155 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:19.155 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:19.155 INFO:teuthology.orchestra.run.smithi163.stdout: "container_image_promtail": { 2023-07-14T18:29:19.155 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "container_image_promtail", 2023-07-14T18:29:19.155 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "str", 2023-07-14T18:29:19.155 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:19.156 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:19.156 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "docker.io/grafana/promtail:2.4.0", 2023-07-14T18:29:19.156 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:19.156 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:19.156 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:19.157 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "Promtail container image", 2023-07-14T18:29:19.157 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:19.157 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:19.157 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:19.157 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:19.158 INFO:teuthology.orchestra.run.smithi163.stdout: "container_image_snmp_gateway": { 2023-07-14T18:29:19.158 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "container_image_snmp_gateway", 2023-07-14T18:29:19.158 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "str", 2023-07-14T18:29:19.158 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:19.158 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:19.159 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2023-07-14T18:29:19.159 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:19.159 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:19.159 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:19.159 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "SNMP Gateway container image", 2023-07-14T18:29:19.160 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:19.160 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:19.160 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:19.160 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:19.160 INFO:teuthology.orchestra.run.smithi163.stdout: "container_init": { 2023-07-14T18:29:19.161 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "container_init", 2023-07-14T18:29:19.161 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "bool", 2023-07-14T18:29:19.161 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:19.161 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:19.161 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "True", 2023-07-14T18:29:19.162 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:19.162 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:19.162 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:19.162 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "Run podman/docker with `--init`", 2023-07-14T18:29:19.162 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:19.163 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:19.163 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:19.163 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:19.163 INFO:teuthology.orchestra.run.smithi163.stdout: "daemon_cache_timeout": { 2023-07-14T18:29:19.163 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "daemon_cache_timeout", 2023-07-14T18:29:19.164 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "secs", 2023-07-14T18:29:19.164 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:19.164 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:19.164 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "600", 2023-07-14T18:29:19.164 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:19.165 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:19.165 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:19.165 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "seconds to cache service (daemon) inventory", 2023-07-14T18:29:19.165 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:19.165 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:19.166 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:19.166 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:19.166 INFO:teuthology.orchestra.run.smithi163.stdout: "default_cephadm_command_timeout": { 2023-07-14T18:29:19.166 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "default_cephadm_command_timeout", 2023-07-14T18:29:19.166 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "secs", 2023-07-14T18:29:19.167 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:19.167 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:19.167 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "900", 2023-07-14T18:29:19.167 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:19.167 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:19.168 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:19.168 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2023-07-14T18:29:19.168 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:19.168 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:19.168 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:19.169 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:19.169 INFO:teuthology.orchestra.run.smithi163.stdout: "default_registry": { 2023-07-14T18:29:19.169 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "default_registry", 2023-07-14T18:29:19.169 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "str", 2023-07-14T18:29:19.169 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:19.170 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:19.170 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "docker.io", 2023-07-14T18:29:19.170 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:19.170 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:19.170 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:19.170 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2023-07-14T18:29:19.171 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:19.171 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:19.171 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:19.171 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:19.171 INFO:teuthology.orchestra.run.smithi163.stdout: "device_cache_timeout": { 2023-07-14T18:29:19.172 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "device_cache_timeout", 2023-07-14T18:29:19.172 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "secs", 2023-07-14T18:29:19.172 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:19.172 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:19.172 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "1800", 2023-07-14T18:29:19.173 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:19.173 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:19.173 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:19.173 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "seconds to cache device inventory", 2023-07-14T18:29:19.173 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:19.174 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:19.174 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:19.174 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:19.174 INFO:teuthology.orchestra.run.smithi163.stdout: "device_enhanced_scan": { 2023-07-14T18:29:19.174 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "device_enhanced_scan", 2023-07-14T18:29:19.175 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "bool", 2023-07-14T18:29:19.175 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:19.175 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:19.175 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "False", 2023-07-14T18:29:19.175 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:19.176 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:19.176 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:19.176 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "Use libstoragemgmt during device scans", 2023-07-14T18:29:19.176 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:19.176 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:19.177 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:19.177 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:19.177 INFO:teuthology.orchestra.run.smithi163.stdout: "facts_cache_timeout": { 2023-07-14T18:29:19.177 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "facts_cache_timeout", 2023-07-14T18:29:19.177 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "secs", 2023-07-14T18:29:19.178 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:19.178 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:19.178 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "60", 2023-07-14T18:29:19.178 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:19.178 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:19.179 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:19.179 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "seconds to cache host facts data", 2023-07-14T18:29:19.179 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:19.179 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:19.179 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:19.179 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:19.180 INFO:teuthology.orchestra.run.smithi163.stdout: "host_check_interval": { 2023-07-14T18:29:19.180 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "host_check_interval", 2023-07-14T18:29:19.180 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "secs", 2023-07-14T18:29:19.180 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:19.180 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:19.181 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "600", 2023-07-14T18:29:19.181 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:19.181 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:19.181 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:19.181 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "how frequently to perform a host check", 2023-07-14T18:29:19.182 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:19.182 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:19.182 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:19.182 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:19.182 INFO:teuthology.orchestra.run.smithi163.stdout: "log_level": { 2023-07-14T18:29:19.183 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "log_level", 2023-07-14T18:29:19.183 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "str", 2023-07-14T18:29:19.183 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:19.183 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:19.183 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "", 2023-07-14T18:29:19.184 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:19.184 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:19.184 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [ 2023-07-14T18:29:19.184 INFO:teuthology.orchestra.run.smithi163.stdout: "", 2023-07-14T18:29:19.184 INFO:teuthology.orchestra.run.smithi163.stdout: "critical", 2023-07-14T18:29:19.185 INFO:teuthology.orchestra.run.smithi163.stdout: "debug", 2023-07-14T18:29:19.185 INFO:teuthology.orchestra.run.smithi163.stdout: "error", 2023-07-14T18:29:19.185 INFO:teuthology.orchestra.run.smithi163.stdout: "info", 2023-07-14T18:29:19.185 INFO:teuthology.orchestra.run.smithi163.stdout: "warning" 2023-07-14T18:29:19.185 INFO:teuthology.orchestra.run.smithi163.stdout: ], 2023-07-14T18:29:19.186 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:19.186 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:19.186 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:19.186 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:19.186 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:19.187 INFO:teuthology.orchestra.run.smithi163.stdout: "log_refresh_metadata": { 2023-07-14T18:29:19.187 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "log_refresh_metadata", 2023-07-14T18:29:19.187 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "bool", 2023-07-14T18:29:19.187 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:19.187 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:19.187 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "False", 2023-07-14T18:29:19.188 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:19.188 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:19.188 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:19.188 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2023-07-14T18:29:19.189 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:19.189 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:19.189 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:19.189 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:19.189 INFO:teuthology.orchestra.run.smithi163.stdout: "log_to_cluster": { 2023-07-14T18:29:19.190 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "log_to_cluster", 2023-07-14T18:29:19.190 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "bool", 2023-07-14T18:29:19.190 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:19.190 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:19.190 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "True", 2023-07-14T18:29:19.191 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:19.191 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:19.191 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:19.191 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2023-07-14T18:29:19.191 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:19.192 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:19.192 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:19.192 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:19.192 INFO:teuthology.orchestra.run.smithi163.stdout: "log_to_cluster_level": { 2023-07-14T18:29:19.192 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "log_to_cluster_level", 2023-07-14T18:29:19.193 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "str", 2023-07-14T18:29:19.193 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:19.193 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:19.193 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "info", 2023-07-14T18:29:19.193 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:19.194 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:19.194 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [ 2023-07-14T18:29:19.194 INFO:teuthology.orchestra.run.smithi163.stdout: "", 2023-07-14T18:29:19.194 INFO:teuthology.orchestra.run.smithi163.stdout: "critical", 2023-07-14T18:29:19.194 INFO:teuthology.orchestra.run.smithi163.stdout: "debug", 2023-07-14T18:29:19.195 INFO:teuthology.orchestra.run.smithi163.stdout: "error", 2023-07-14T18:29:19.195 INFO:teuthology.orchestra.run.smithi163.stdout: "info", 2023-07-14T18:29:19.195 INFO:teuthology.orchestra.run.smithi163.stdout: "warning" 2023-07-14T18:29:19.195 INFO:teuthology.orchestra.run.smithi163.stdout: ], 2023-07-14T18:29:19.195 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:19.196 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:19.196 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:19.196 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:19.196 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:19.196 INFO:teuthology.orchestra.run.smithi163.stdout: "log_to_file": { 2023-07-14T18:29:19.197 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "log_to_file", 2023-07-14T18:29:19.197 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "bool", 2023-07-14T18:29:19.197 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:19.197 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:19.197 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "False", 2023-07-14T18:29:19.198 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:19.198 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:19.198 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:19.198 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:19.198 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:19.198 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:19.199 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:19.199 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:19.199 INFO:teuthology.orchestra.run.smithi163.stdout: "manage_etc_ceph_ceph_conf": { 2023-07-14T18:29:19.199 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "manage_etc_ceph_ceph_conf", 2023-07-14T18:29:19.199 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "bool", 2023-07-14T18:29:19.200 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:19.200 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:19.200 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "False", 2023-07-14T18:29:19.200 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:19.200 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:19.201 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:19.201 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2023-07-14T18:29:19.201 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:19.201 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:19.201 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:19.202 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:19.202 INFO:teuthology.orchestra.run.smithi163.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2023-07-14T18:29:19.202 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2023-07-14T18:29:19.202 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "str", 2023-07-14T18:29:19.202 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:19.203 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:19.203 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "*", 2023-07-14T18:29:19.203 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:19.203 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:19.203 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:19.204 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2023-07-14T18:29:19.204 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:19.204 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:19.204 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:19.204 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:19.205 INFO:teuthology.orchestra.run.smithi163.stdout: "max_count_per_host": { 2023-07-14T18:29:19.205 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "max_count_per_host", 2023-07-14T18:29:19.205 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "int", 2023-07-14T18:29:19.205 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:19.205 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:19.206 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "10", 2023-07-14T18:29:19.206 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:19.206 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:19.206 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:19.206 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "max number of daemons per service per host", 2023-07-14T18:29:19.207 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:19.207 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:19.207 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:19.207 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:19.207 INFO:teuthology.orchestra.run.smithi163.stdout: "max_osd_draining_count": { 2023-07-14T18:29:19.208 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "max_osd_draining_count", 2023-07-14T18:29:19.208 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "int", 2023-07-14T18:29:19.208 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:19.208 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:19.208 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "10", 2023-07-14T18:29:19.209 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:19.209 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:19.209 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:19.209 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2023-07-14T18:29:19.209 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:19.210 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:19.210 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:19.210 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:19.210 INFO:teuthology.orchestra.run.smithi163.stdout: "migration_current": { 2023-07-14T18:29:19.210 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "migration_current", 2023-07-14T18:29:19.211 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "int", 2023-07-14T18:29:19.211 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:19.211 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:19.211 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "", 2023-07-14T18:29:19.211 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:19.211 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:19.212 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:19.212 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "internal - do not modify", 2023-07-14T18:29:19.212 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:19.212 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:19.213 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:19.213 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:19.213 INFO:teuthology.orchestra.run.smithi163.stdout: "mode": { 2023-07-14T18:29:19.213 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "mode", 2023-07-14T18:29:19.213 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "str", 2023-07-14T18:29:19.214 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:19.214 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:19.214 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "root", 2023-07-14T18:29:19.214 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:19.214 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:19.214 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [ 2023-07-14T18:29:19.215 INFO:teuthology.orchestra.run.smithi163.stdout: "cephadm-package", 2023-07-14T18:29:19.215 INFO:teuthology.orchestra.run.smithi163.stdout: "root" 2023-07-14T18:29:19.215 INFO:teuthology.orchestra.run.smithi163.stdout: ], 2023-07-14T18:29:19.215 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "mode for remote execution of cephadm", 2023-07-14T18:29:19.215 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:19.216 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:19.216 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:19.216 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:19.216 INFO:teuthology.orchestra.run.smithi163.stdout: "prometheus_alerts_path": { 2023-07-14T18:29:19.216 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "prometheus_alerts_path", 2023-07-14T18:29:19.217 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "str", 2023-07-14T18:29:19.217 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:19.217 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:19.217 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2023-07-14T18:29:19.217 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:19.218 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:19.218 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:19.218 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "location of alerts to include in prometheus deployments", 2023-07-14T18:29:19.218 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:19.218 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:19.219 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:19.219 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:19.219 INFO:teuthology.orchestra.run.smithi163.stdout: "prometheus_web_password": { 2023-07-14T18:29:19.219 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "prometheus_web_password", 2023-07-14T18:29:19.219 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "str", 2023-07-14T18:29:19.220 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:19.220 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:19.220 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "admin", 2023-07-14T18:29:19.220 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:19.220 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:19.221 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:19.221 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "Prometheus web password", 2023-07-14T18:29:19.221 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:19.221 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:19.221 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:19.221 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:19.222 INFO:teuthology.orchestra.run.smithi163.stdout: "prometheus_web_user": { 2023-07-14T18:29:19.222 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "prometheus_web_user", 2023-07-14T18:29:19.222 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "str", 2023-07-14T18:29:19.222 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:19.222 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:19.223 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "admin", 2023-07-14T18:29:19.223 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:19.223 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:19.223 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:19.223 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "Prometheus web user", 2023-07-14T18:29:19.224 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:19.224 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:19.224 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:19.224 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:19.224 INFO:teuthology.orchestra.run.smithi163.stdout: "registry_insecure": { 2023-07-14T18:29:19.225 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "registry_insecure", 2023-07-14T18:29:19.225 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "bool", 2023-07-14T18:29:19.225 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:19.225 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:19.225 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "False", 2023-07-14T18:29:19.226 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:19.226 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:19.226 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:19.226 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2023-07-14T18:29:19.226 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:19.227 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:19.227 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:19.227 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:19.227 INFO:teuthology.orchestra.run.smithi163.stdout: "registry_password": { 2023-07-14T18:29:19.227 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "registry_password", 2023-07-14T18:29:19.227 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "str", 2023-07-14T18:29:19.228 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:19.228 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:19.228 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "", 2023-07-14T18:29:19.228 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:19.228 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:19.229 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:19.229 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2023-07-14T18:29:19.229 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:19.229 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:19.229 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:19.230 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:19.230 INFO:teuthology.orchestra.run.smithi163.stdout: "registry_url": { 2023-07-14T18:29:19.230 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "registry_url", 2023-07-14T18:29:19.230 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "str", 2023-07-14T18:29:19.230 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:19.231 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:19.231 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "", 2023-07-14T18:29:19.231 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:19.231 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:19.231 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:19.232 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2023-07-14T18:29:19.232 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:19.232 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:19.232 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:19.232 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:19.233 INFO:teuthology.orchestra.run.smithi163.stdout: "registry_username": { 2023-07-14T18:29:19.233 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "registry_username", 2023-07-14T18:29:19.233 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "str", 2023-07-14T18:29:19.233 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:19.233 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:19.234 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "", 2023-07-14T18:29:19.234 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:19.234 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:19.234 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:19.234 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2023-07-14T18:29:19.235 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:19.235 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:19.235 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:19.235 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:19.235 INFO:teuthology.orchestra.run.smithi163.stdout: "secure_monitoring_stack": { 2023-07-14T18:29:19.236 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "secure_monitoring_stack", 2023-07-14T18:29:19.236 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "bool", 2023-07-14T18:29:19.236 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:19.236 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:19.236 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "False", 2023-07-14T18:29:19.237 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:19.237 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:19.237 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:19.237 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2023-07-14T18:29:19.237 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:19.237 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:19.238 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:19.238 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:19.238 INFO:teuthology.orchestra.run.smithi163.stdout: "service_discovery_port": { 2023-07-14T18:29:19.238 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "service_discovery_port", 2023-07-14T18:29:19.238 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "int", 2023-07-14T18:29:19.239 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:19.239 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:19.239 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "8765", 2023-07-14T18:29:19.239 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:19.239 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:19.240 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:19.240 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "cephadm service discovery port", 2023-07-14T18:29:19.240 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:19.240 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:19.240 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:19.241 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:19.241 INFO:teuthology.orchestra.run.smithi163.stdout: "ssh_config_file": { 2023-07-14T18:29:19.241 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "ssh_config_file", 2023-07-14T18:29:19.241 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "str", 2023-07-14T18:29:19.241 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:19.242 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:19.242 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "", 2023-07-14T18:29:19.242 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:19.242 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:19.242 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:19.243 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "customized SSH config file to connect to managed hosts", 2023-07-14T18:29:19.243 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:19.243 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:19.243 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:19.243 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:19.244 INFO:teuthology.orchestra.run.smithi163.stdout: "use_agent": { 2023-07-14T18:29:19.244 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "use_agent", 2023-07-14T18:29:19.244 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "bool", 2023-07-14T18:29:19.244 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:19.244 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:19.244 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "False", 2023-07-14T18:29:19.245 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:19.245 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:19.245 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:19.245 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2023-07-14T18:29:19.245 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:19.246 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:19.246 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:19.246 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:19.246 INFO:teuthology.orchestra.run.smithi163.stdout: "use_repo_digest": { 2023-07-14T18:29:19.246 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "use_repo_digest", 2023-07-14T18:29:19.247 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "bool", 2023-07-14T18:29:19.247 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:19.247 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:19.247 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "True", 2023-07-14T18:29:19.247 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:19.248 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:19.248 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:19.248 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2023-07-14T18:29:19.248 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:19.248 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:19.249 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:19.249 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:19.249 INFO:teuthology.orchestra.run.smithi163.stdout: "warn_on_failed_host_check": { 2023-07-14T18:29:19.249 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "warn_on_failed_host_check", 2023-07-14T18:29:19.249 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "bool", 2023-07-14T18:29:19.250 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:19.250 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:19.250 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "True", 2023-07-14T18:29:19.250 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:19.250 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:19.251 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:19.251 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "raise a health warning if the host check fails", 2023-07-14T18:29:19.251 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:19.251 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:19.251 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:19.251 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:19.252 INFO:teuthology.orchestra.run.smithi163.stdout: "warn_on_stray_daemons": { 2023-07-14T18:29:19.252 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "warn_on_stray_daemons", 2023-07-14T18:29:19.252 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "bool", 2023-07-14T18:29:19.252 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:19.253 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:19.253 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "True", 2023-07-14T18:29:19.253 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:19.253 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:19.253 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:19.253 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2023-07-14T18:29:19.254 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:19.254 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:19.254 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:19.254 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:19.254 INFO:teuthology.orchestra.run.smithi163.stdout: "warn_on_stray_hosts": { 2023-07-14T18:29:19.255 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "warn_on_stray_hosts", 2023-07-14T18:29:19.255 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "bool", 2023-07-14T18:29:19.255 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:19.255 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:19.255 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "True", 2023-07-14T18:29:19.256 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:19.256 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:19.256 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:19.256 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2023-07-14T18:29:19.256 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:19.257 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:19.257 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:19.257 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-07-14T18:29:19.257 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-07-14T18:29:19.257 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:19.258 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-07-14T18:29:19.258 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "crash", 2023-07-14T18:29:19.258 INFO:teuthology.orchestra.run.smithi163.stdout: "can_run": true, 2023-07-14T18:29:19.258 INFO:teuthology.orchestra.run.smithi163.stdout: "error_string": "", 2023-07-14T18:29:19.258 INFO:teuthology.orchestra.run.smithi163.stdout: "module_options": { 2023-07-14T18:29:19.259 INFO:teuthology.orchestra.run.smithi163.stdout: "log_level": { 2023-07-14T18:29:19.259 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "log_level", 2023-07-14T18:29:19.259 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "str", 2023-07-14T18:29:19.259 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:19.259 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:19.260 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "", 2023-07-14T18:29:19.260 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:19.260 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:19.260 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [ 2023-07-14T18:29:19.260 INFO:teuthology.orchestra.run.smithi163.stdout: "", 2023-07-14T18:29:19.261 INFO:teuthology.orchestra.run.smithi163.stdout: "critical", 2023-07-14T18:29:19.261 INFO:teuthology.orchestra.run.smithi163.stdout: "debug", 2023-07-14T18:29:19.261 INFO:teuthology.orchestra.run.smithi163.stdout: "error", 2023-07-14T18:29:19.261 INFO:teuthology.orchestra.run.smithi163.stdout: "info", 2023-07-14T18:29:19.261 INFO:teuthology.orchestra.run.smithi163.stdout: "warning" 2023-07-14T18:29:19.262 INFO:teuthology.orchestra.run.smithi163.stdout: ], 2023-07-14T18:29:19.262 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:19.262 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:19.262 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:19.262 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:19.262 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:19.263 INFO:teuthology.orchestra.run.smithi163.stdout: "log_to_cluster": { 2023-07-14T18:29:19.263 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "log_to_cluster", 2023-07-14T18:29:19.263 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "bool", 2023-07-14T18:29:19.263 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:19.263 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:19.264 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "False", 2023-07-14T18:29:19.264 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:19.264 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:19.264 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:19.264 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:19.265 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:19.265 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:19.265 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:19.265 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:19.265 INFO:teuthology.orchestra.run.smithi163.stdout: "log_to_cluster_level": { 2023-07-14T18:29:19.266 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "log_to_cluster_level", 2023-07-14T18:29:19.266 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "str", 2023-07-14T18:29:19.266 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:19.266 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:19.266 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "info", 2023-07-14T18:29:19.266 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:19.267 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:19.267 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [ 2023-07-14T18:29:19.267 INFO:teuthology.orchestra.run.smithi163.stdout: "", 2023-07-14T18:29:19.267 INFO:teuthology.orchestra.run.smithi163.stdout: "critical", 2023-07-14T18:29:19.267 INFO:teuthology.orchestra.run.smithi163.stdout: "debug", 2023-07-14T18:29:19.268 INFO:teuthology.orchestra.run.smithi163.stdout: "error", 2023-07-14T18:29:19.268 INFO:teuthology.orchestra.run.smithi163.stdout: "info", 2023-07-14T18:29:19.268 INFO:teuthology.orchestra.run.smithi163.stdout: "warning" 2023-07-14T18:29:19.268 INFO:teuthology.orchestra.run.smithi163.stdout: ], 2023-07-14T18:29:19.268 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:19.269 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:19.269 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:19.269 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:19.269 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:19.269 INFO:teuthology.orchestra.run.smithi163.stdout: "log_to_file": { 2023-07-14T18:29:19.270 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "log_to_file", 2023-07-14T18:29:19.270 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "bool", 2023-07-14T18:29:19.270 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:19.270 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:19.270 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "False", 2023-07-14T18:29:19.271 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:19.271 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:19.271 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:19.271 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:19.271 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:19.272 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:19.272 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:19.272 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:19.272 INFO:teuthology.orchestra.run.smithi163.stdout: "retain_interval": { 2023-07-14T18:29:19.272 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "retain_interval", 2023-07-14T18:29:19.272 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "secs", 2023-07-14T18:29:19.273 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:19.273 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:19.273 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "31536000", 2023-07-14T18:29:19.273 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:19.274 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:19.274 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:19.274 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "how long to retain crashes before pruning them", 2023-07-14T18:29:19.274 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:19.274 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:19.275 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:19.275 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:19.275 INFO:teuthology.orchestra.run.smithi163.stdout: "warn_recent_interval": { 2023-07-14T18:29:19.275 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "warn_recent_interval", 2023-07-14T18:29:19.275 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "secs", 2023-07-14T18:29:19.275 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:19.276 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:19.276 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "1209600", 2023-07-14T18:29:19.276 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:19.276 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:19.276 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:19.277 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "time interval in which to warn about recent crashes", 2023-07-14T18:29:19.277 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:19.277 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:19.277 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:19.277 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-07-14T18:29:19.278 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-07-14T18:29:19.278 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:19.278 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-07-14T18:29:19.278 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "dashboard", 2023-07-14T18:29:19.278 INFO:teuthology.orchestra.run.smithi163.stdout: "can_run": true, 2023-07-14T18:29:19.279 INFO:teuthology.orchestra.run.smithi163.stdout: "error_string": "", 2023-07-14T18:29:19.279 INFO:teuthology.orchestra.run.smithi163.stdout: "module_options": { 2023-07-14T18:29:19.279 INFO:teuthology.orchestra.run.smithi163.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2023-07-14T18:29:19.279 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2023-07-14T18:29:19.279 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "int", 2023-07-14T18:29:19.280 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:19.280 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:19.280 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "10", 2023-07-14T18:29:19.280 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:19.280 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:19.281 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:19.281 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:19.281 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:19.281 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:19.281 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:19.282 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:19.282 INFO:teuthology.orchestra.run.smithi163.stdout: "ALERTMANAGER_API_HOST": { 2023-07-14T18:29:19.282 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "ALERTMANAGER_API_HOST", 2023-07-14T18:29:19.282 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "str", 2023-07-14T18:29:19.282 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:19.283 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:19.283 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "", 2023-07-14T18:29:19.283 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:19.283 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:19.283 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:19.283 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:19.284 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:19.284 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:19.284 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:19.284 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:19.285 INFO:teuthology.orchestra.run.smithi163.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2023-07-14T18:29:19.285 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2023-07-14T18:29:19.285 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "bool", 2023-07-14T18:29:19.285 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:19.285 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:19.286 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "True", 2023-07-14T18:29:19.286 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:19.286 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:19.286 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:19.286 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:19.287 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:19.287 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:19.287 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:19.287 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:19.287 INFO:teuthology.orchestra.run.smithi163.stdout: "AUDIT_API_ENABLED": { 2023-07-14T18:29:19.287 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "AUDIT_API_ENABLED", 2023-07-14T18:29:19.288 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "bool", 2023-07-14T18:29:19.288 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:19.288 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:19.288 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "False", 2023-07-14T18:29:19.288 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:19.289 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:19.289 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:19.289 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:19.289 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:19.289 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:19.290 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:19.290 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:19.290 INFO:teuthology.orchestra.run.smithi163.stdout: "AUDIT_API_LOG_PAYLOAD": { 2023-07-14T18:29:19.290 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2023-07-14T18:29:19.290 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "bool", 2023-07-14T18:29:19.291 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:19.291 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:19.291 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "True", 2023-07-14T18:29:19.291 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:19.291 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:19.292 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:19.292 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:19.292 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:19.292 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:19.292 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:19.293 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:19.293 INFO:teuthology.orchestra.run.smithi163.stdout: "ENABLE_BROWSABLE_API": { 2023-07-14T18:29:19.293 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "ENABLE_BROWSABLE_API", 2023-07-14T18:29:19.293 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "bool", 2023-07-14T18:29:19.293 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:19.294 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:19.294 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "True", 2023-07-14T18:29:19.294 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:19.294 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:19.294 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:19.295 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:19.295 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:19.295 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:19.295 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:19.295 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:19.295 INFO:teuthology.orchestra.run.smithi163.stdout: "FEATURE_TOGGLE_CEPHFS": { 2023-07-14T18:29:19.296 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2023-07-14T18:29:19.296 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "bool", 2023-07-14T18:29:19.296 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:19.296 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:19.296 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "True", 2023-07-14T18:29:19.297 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:19.297 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:19.297 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:19.297 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:19.297 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:19.298 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:19.298 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:19.298 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:19.298 INFO:teuthology.orchestra.run.smithi163.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2023-07-14T18:29:19.298 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2023-07-14T18:29:19.299 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "bool", 2023-07-14T18:29:19.299 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:19.299 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:19.299 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "True", 2023-07-14T18:29:19.299 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:19.300 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:19.300 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:19.300 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:19.300 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:19.300 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:19.301 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:19.301 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:19.301 INFO:teuthology.orchestra.run.smithi163.stdout: "FEATURE_TOGGLE_ISCSI": { 2023-07-14T18:29:19.301 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2023-07-14T18:29:19.301 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "bool", 2023-07-14T18:29:19.302 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:19.302 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:19.302 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "True", 2023-07-14T18:29:19.302 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:19.302 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:19.303 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:19.303 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:19.303 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:19.303 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:19.303 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:19.303 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:19.304 INFO:teuthology.orchestra.run.smithi163.stdout: "FEATURE_TOGGLE_MIRRORING": { 2023-07-14T18:29:19.304 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2023-07-14T18:29:19.304 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "bool", 2023-07-14T18:29:19.304 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:19.304 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:19.305 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "True", 2023-07-14T18:29:19.305 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:19.305 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:19.305 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:19.305 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:19.306 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:19.306 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:19.306 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:19.306 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:19.306 INFO:teuthology.orchestra.run.smithi163.stdout: "FEATURE_TOGGLE_NFS": { 2023-07-14T18:29:19.307 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "FEATURE_TOGGLE_NFS", 2023-07-14T18:29:19.307 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "bool", 2023-07-14T18:29:19.307 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:19.307 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:19.307 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "True", 2023-07-14T18:29:19.308 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:19.308 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:19.308 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:19.308 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:19.308 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:19.309 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:19.309 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:19.309 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:19.309 INFO:teuthology.orchestra.run.smithi163.stdout: "FEATURE_TOGGLE_RBD": { 2023-07-14T18:29:19.309 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "FEATURE_TOGGLE_RBD", 2023-07-14T18:29:19.310 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "bool", 2023-07-14T18:29:19.310 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:19.310 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:19.310 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "True", 2023-07-14T18:29:19.310 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:19.311 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:19.311 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:19.311 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:19.311 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:19.311 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:19.312 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:19.312 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:19.312 INFO:teuthology.orchestra.run.smithi163.stdout: "FEATURE_TOGGLE_RGW": { 2023-07-14T18:29:19.312 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "FEATURE_TOGGLE_RGW", 2023-07-14T18:29:19.313 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "bool", 2023-07-14T18:29:19.313 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:19.313 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:19.313 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "True", 2023-07-14T18:29:19.313 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:19.314 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:19.314 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:19.314 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:19.314 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:19.314 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:19.315 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:19.315 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:19.315 INFO:teuthology.orchestra.run.smithi163.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2023-07-14T18:29:19.315 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2023-07-14T18:29:19.315 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "str", 2023-07-14T18:29:19.316 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:19.316 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:19.316 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "", 2023-07-14T18:29:19.316 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:19.316 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:19.317 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:19.317 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:19.317 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:19.317 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:19.317 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:19.318 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:19.318 INFO:teuthology.orchestra.run.smithi163.stdout: "GRAFANA_API_PASSWORD": { 2023-07-14T18:29:19.318 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "GRAFANA_API_PASSWORD", 2023-07-14T18:29:19.318 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "str", 2023-07-14T18:29:19.318 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:19.319 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:19.319 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "admin", 2023-07-14T18:29:19.319 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:19.319 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:19.319 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:19.319 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:19.320 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:19.320 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:19.320 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:19.320 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:19.320 INFO:teuthology.orchestra.run.smithi163.stdout: "GRAFANA_API_SSL_VERIFY": { 2023-07-14T18:29:19.321 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2023-07-14T18:29:19.321 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "bool", 2023-07-14T18:29:19.321 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:19.321 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:19.321 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "True", 2023-07-14T18:29:19.322 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:19.322 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:19.322 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:19.322 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:19.322 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:19.323 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:19.323 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:19.323 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:19.323 INFO:teuthology.orchestra.run.smithi163.stdout: "GRAFANA_API_URL": { 2023-07-14T18:29:19.323 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "GRAFANA_API_URL", 2023-07-14T18:29:19.324 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "str", 2023-07-14T18:29:19.324 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:19.324 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:19.324 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "", 2023-07-14T18:29:19.324 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:19.325 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:19.325 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:19.325 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:19.325 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:19.325 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:19.326 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:19.326 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:19.326 INFO:teuthology.orchestra.run.smithi163.stdout: "GRAFANA_API_USERNAME": { 2023-07-14T18:29:19.326 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "GRAFANA_API_USERNAME", 2023-07-14T18:29:19.326 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "str", 2023-07-14T18:29:19.326 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:19.327 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:19.327 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "admin", 2023-07-14T18:29:19.327 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:19.327 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:19.327 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:19.328 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:19.328 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:19.328 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:19.328 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:19.328 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:19.329 INFO:teuthology.orchestra.run.smithi163.stdout: "GRAFANA_FRONTEND_API_URL": { 2023-07-14T18:29:19.329 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2023-07-14T18:29:19.329 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "str", 2023-07-14T18:29:19.329 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:19.329 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:19.330 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "", 2023-07-14T18:29:19.330 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:19.330 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:19.330 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:19.330 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:19.331 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:19.331 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:19.331 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:19.331 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:19.331 INFO:teuthology.orchestra.run.smithi163.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2023-07-14T18:29:19.332 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2023-07-14T18:29:19.332 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "bool", 2023-07-14T18:29:19.332 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:19.332 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:19.332 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "False", 2023-07-14T18:29:19.333 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:19.333 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:19.333 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:19.333 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:19.333 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:19.333 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:19.334 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:19.334 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:19.334 INFO:teuthology.orchestra.run.smithi163.stdout: "ISCSI_API_SSL_VERIFICATION": { 2023-07-14T18:29:19.334 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2023-07-14T18:29:19.334 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "bool", 2023-07-14T18:29:19.335 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:19.335 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:19.335 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "True", 2023-07-14T18:29:19.335 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:19.335 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:19.336 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:19.336 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:19.336 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:19.336 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:19.336 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:19.337 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:19.337 INFO:teuthology.orchestra.run.smithi163.stdout: "ISSUE_TRACKER_API_KEY": { 2023-07-14T18:29:19.337 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "ISSUE_TRACKER_API_KEY", 2023-07-14T18:29:19.337 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "str", 2023-07-14T18:29:19.337 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:19.338 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:19.338 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "", 2023-07-14T18:29:19.338 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:19.338 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:19.338 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:19.339 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:19.339 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:19.339 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:19.339 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:19.339 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:19.340 INFO:teuthology.orchestra.run.smithi163.stdout: "PROMETHEUS_API_HOST": { 2023-07-14T18:29:19.340 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "PROMETHEUS_API_HOST", 2023-07-14T18:29:19.340 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "str", 2023-07-14T18:29:19.340 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:19.340 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:19.341 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "", 2023-07-14T18:29:19.341 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:19.341 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:19.341 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:19.341 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:19.342 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:19.342 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:19.342 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:19.342 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:19.342 INFO:teuthology.orchestra.run.smithi163.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2023-07-14T18:29:19.342 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2023-07-14T18:29:19.343 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "bool", 2023-07-14T18:29:19.343 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:19.343 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:19.343 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "True", 2023-07-14T18:29:19.343 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:19.344 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:19.344 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:19.344 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:19.344 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:19.344 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:19.345 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:19.345 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:19.345 INFO:teuthology.orchestra.run.smithi163.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2023-07-14T18:29:19.345 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2023-07-14T18:29:19.345 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "bool", 2023-07-14T18:29:19.346 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:19.346 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:19.346 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "False", 2023-07-14T18:29:19.346 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:19.346 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:19.347 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:19.347 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:19.347 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:19.347 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:19.347 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:19.348 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:19.348 INFO:teuthology.orchestra.run.smithi163.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2023-07-14T18:29:19.348 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2023-07-14T18:29:19.348 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "bool", 2023-07-14T18:29:19.348 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:19.349 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:19.349 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "False", 2023-07-14T18:29:19.349 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:19.349 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:19.349 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:19.349 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:19.350 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:19.350 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:19.350 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:19.350 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:19.350 INFO:teuthology.orchestra.run.smithi163.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2023-07-14T18:29:19.351 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2023-07-14T18:29:19.351 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "bool", 2023-07-14T18:29:19.351 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:19.351 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:19.351 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "True", 2023-07-14T18:29:19.352 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:19.352 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:19.352 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:19.352 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:19.352 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:19.353 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:19.353 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:19.353 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:19.353 INFO:teuthology.orchestra.run.smithi163.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2023-07-14T18:29:19.353 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2023-07-14T18:29:19.354 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "bool", 2023-07-14T18:29:19.354 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:19.354 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:19.354 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "True", 2023-07-14T18:29:19.354 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:19.355 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:19.355 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:19.355 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:19.355 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:19.355 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:19.356 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:19.356 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:19.356 INFO:teuthology.orchestra.run.smithi163.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2023-07-14T18:29:19.356 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2023-07-14T18:29:19.356 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "bool", 2023-07-14T18:29:19.357 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:19.357 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:19.357 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "False", 2023-07-14T18:29:19.357 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:19.357 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:19.357 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:19.358 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:19.358 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:19.358 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:19.358 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:19.358 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:19.359 INFO:teuthology.orchestra.run.smithi163.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2023-07-14T18:29:19.359 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2023-07-14T18:29:19.359 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "bool", 2023-07-14T18:29:19.359 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:19.359 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:19.360 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "False", 2023-07-14T18:29:19.360 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:19.360 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:19.360 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:19.360 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:19.361 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:19.361 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:19.361 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:19.361 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:19.361 INFO:teuthology.orchestra.run.smithi163.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2023-07-14T18:29:19.362 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2023-07-14T18:29:19.362 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "bool", 2023-07-14T18:29:19.362 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:19.362 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:19.362 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "False", 2023-07-14T18:29:19.363 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:19.363 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:19.363 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:19.363 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:19.363 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:19.364 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:19.364 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:19.364 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:19.364 INFO:teuthology.orchestra.run.smithi163.stdout: "PWD_POLICY_ENABLED": { 2023-07-14T18:29:19.364 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "PWD_POLICY_ENABLED", 2023-07-14T18:29:19.365 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "bool", 2023-07-14T18:29:19.365 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:19.365 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:19.365 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "True", 2023-07-14T18:29:19.365 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:19.366 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:19.366 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:19.366 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:19.366 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:19.366 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:19.366 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:19.367 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:19.367 INFO:teuthology.orchestra.run.smithi163.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2023-07-14T18:29:19.367 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2023-07-14T18:29:19.367 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "str", 2023-07-14T18:29:19.367 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:19.368 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:19.368 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2023-07-14T18:29:19.368 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:19.368 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:19.369 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:19.369 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:19.369 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:19.369 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:19.369 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:19.370 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:19.370 INFO:teuthology.orchestra.run.smithi163.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2023-07-14T18:29:19.370 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2023-07-14T18:29:19.370 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "int", 2023-07-14T18:29:19.370 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:19.371 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:19.371 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "10", 2023-07-14T18:29:19.371 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:19.371 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:19.371 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:19.371 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:19.372 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:19.372 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:19.372 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:19.372 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:19.373 INFO:teuthology.orchestra.run.smithi163.stdout: "PWD_POLICY_MIN_LENGTH": { 2023-07-14T18:29:19.373 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2023-07-14T18:29:19.373 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "int", 2023-07-14T18:29:19.373 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:19.373 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:19.373 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "8", 2023-07-14T18:29:19.374 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:19.374 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:19.374 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:19.374 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:19.374 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:19.375 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:19.375 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:19.375 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:19.375 INFO:teuthology.orchestra.run.smithi163.stdout: "REST_REQUESTS_TIMEOUT": { 2023-07-14T18:29:19.375 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "REST_REQUESTS_TIMEOUT", 2023-07-14T18:29:19.376 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "int", 2023-07-14T18:29:19.376 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:19.376 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:19.376 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "45", 2023-07-14T18:29:19.376 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:19.377 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:19.377 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:19.377 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:19.377 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:19.377 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:19.378 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:19.378 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:19.378 INFO:teuthology.orchestra.run.smithi163.stdout: "RGW_API_ACCESS_KEY": { 2023-07-14T18:29:19.378 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "RGW_API_ACCESS_KEY", 2023-07-14T18:29:19.378 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "str", 2023-07-14T18:29:19.379 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:19.379 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:19.379 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "", 2023-07-14T18:29:19.379 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:19.379 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:19.380 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:19.380 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:19.380 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:19.380 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:19.380 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:19.381 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:19.381 INFO:teuthology.orchestra.run.smithi163.stdout: "RGW_API_ADMIN_RESOURCE": { 2023-07-14T18:29:19.381 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2023-07-14T18:29:19.381 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "str", 2023-07-14T18:29:19.381 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:19.381 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:19.382 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "admin", 2023-07-14T18:29:19.382 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:19.382 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:19.382 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:19.382 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:19.383 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:19.383 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:19.383 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:19.383 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:19.383 INFO:teuthology.orchestra.run.smithi163.stdout: "RGW_API_SECRET_KEY": { 2023-07-14T18:29:19.384 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "RGW_API_SECRET_KEY", 2023-07-14T18:29:19.384 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "str", 2023-07-14T18:29:19.384 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:19.384 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:19.384 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "", 2023-07-14T18:29:19.385 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:19.385 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:19.385 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:19.385 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:19.385 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:19.386 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:19.386 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:19.386 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:19.386 INFO:teuthology.orchestra.run.smithi163.stdout: "RGW_API_SSL_VERIFY": { 2023-07-14T18:29:19.386 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "RGW_API_SSL_VERIFY", 2023-07-14T18:29:19.387 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "bool", 2023-07-14T18:29:19.387 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:19.387 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:19.387 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "True", 2023-07-14T18:29:19.387 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:19.388 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:19.388 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:19.388 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:19.388 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:19.388 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:19.389 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:19.389 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:19.389 INFO:teuthology.orchestra.run.smithi163.stdout: "USER_PWD_EXPIRATION_SPAN": { 2023-07-14T18:29:19.389 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2023-07-14T18:29:19.389 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "int", 2023-07-14T18:29:19.389 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:19.390 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:19.390 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "0", 2023-07-14T18:29:19.390 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:19.390 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:19.390 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:19.391 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:19.391 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:19.391 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:19.391 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:19.391 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:19.392 INFO:teuthology.orchestra.run.smithi163.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2023-07-14T18:29:19.392 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2023-07-14T18:29:19.392 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "int", 2023-07-14T18:29:19.392 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:19.392 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:19.393 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "10", 2023-07-14T18:29:19.393 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:19.393 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:19.393 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:19.393 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:19.394 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:19.394 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:19.394 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:19.394 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:19.394 INFO:teuthology.orchestra.run.smithi163.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2023-07-14T18:29:19.395 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2023-07-14T18:29:19.395 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "int", 2023-07-14T18:29:19.395 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:19.395 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:19.395 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "5", 2023-07-14T18:29:19.396 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:19.396 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:19.396 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:19.396 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:19.396 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:19.397 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:19.397 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:19.397 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:19.397 INFO:teuthology.orchestra.run.smithi163.stdout: "cross_origin_url": { 2023-07-14T18:29:19.397 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "cross_origin_url", 2023-07-14T18:29:19.398 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "str", 2023-07-14T18:29:19.398 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:19.398 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:19.398 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "", 2023-07-14T18:29:19.398 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:19.399 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:19.399 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:19.399 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:19.399 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:19.399 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:19.400 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:19.400 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:19.400 INFO:teuthology.orchestra.run.smithi163.stdout: "crt_file": { 2023-07-14T18:29:19.400 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "crt_file", 2023-07-14T18:29:19.400 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "str", 2023-07-14T18:29:19.401 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:19.401 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:19.401 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "", 2023-07-14T18:29:19.401 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:19.401 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:19.401 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:19.402 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:19.402 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:19.402 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:19.402 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:19.402 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:19.403 INFO:teuthology.orchestra.run.smithi163.stdout: "debug": { 2023-07-14T18:29:19.403 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "debug", 2023-07-14T18:29:19.403 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "bool", 2023-07-14T18:29:19.403 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:19.403 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:19.404 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "False", 2023-07-14T18:29:19.404 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:19.404 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:19.404 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:19.404 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "Enable/disable debug options", 2023-07-14T18:29:19.405 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:19.405 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:19.405 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:19.405 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:19.405 INFO:teuthology.orchestra.run.smithi163.stdout: "jwt_token_ttl": { 2023-07-14T18:29:19.406 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "jwt_token_ttl", 2023-07-14T18:29:19.406 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "int", 2023-07-14T18:29:19.406 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:19.406 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:19.406 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "28800", 2023-07-14T18:29:19.407 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:19.407 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:19.407 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:19.407 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:19.407 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:19.408 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:19.408 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:19.408 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:19.408 INFO:teuthology.orchestra.run.smithi163.stdout: "key_file": { 2023-07-14T18:29:19.408 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "key_file", 2023-07-14T18:29:19.409 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "str", 2023-07-14T18:29:19.409 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:19.409 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:19.409 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "", 2023-07-14T18:29:19.409 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:19.410 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:19.410 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:19.410 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:19.410 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:19.410 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:19.411 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:19.411 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:19.411 INFO:teuthology.orchestra.run.smithi163.stdout: "log_level": { 2023-07-14T18:29:19.411 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "log_level", 2023-07-14T18:29:19.411 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "str", 2023-07-14T18:29:19.412 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:19.412 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:19.412 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "", 2023-07-14T18:29:19.412 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:19.412 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:19.413 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [ 2023-07-14T18:29:19.413 INFO:teuthology.orchestra.run.smithi163.stdout: "", 2023-07-14T18:29:19.413 INFO:teuthology.orchestra.run.smithi163.stdout: "critical", 2023-07-14T18:29:19.413 INFO:teuthology.orchestra.run.smithi163.stdout: "debug", 2023-07-14T18:29:19.413 INFO:teuthology.orchestra.run.smithi163.stdout: "error", 2023-07-14T18:29:19.414 INFO:teuthology.orchestra.run.smithi163.stdout: "info", 2023-07-14T18:29:19.414 INFO:teuthology.orchestra.run.smithi163.stdout: "warning" 2023-07-14T18:29:19.414 INFO:teuthology.orchestra.run.smithi163.stdout: ], 2023-07-14T18:29:19.414 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:19.414 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:19.414 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:19.415 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:19.415 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:19.415 INFO:teuthology.orchestra.run.smithi163.stdout: "log_to_cluster": { 2023-07-14T18:29:19.415 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "log_to_cluster", 2023-07-14T18:29:19.415 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "bool", 2023-07-14T18:29:19.416 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:19.416 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:19.416 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "False", 2023-07-14T18:29:19.416 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:19.416 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:19.417 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:19.417 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:19.417 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:19.417 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:19.417 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:19.418 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:19.418 INFO:teuthology.orchestra.run.smithi163.stdout: "log_to_cluster_level": { 2023-07-14T18:29:19.418 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "log_to_cluster_level", 2023-07-14T18:29:19.418 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "str", 2023-07-14T18:29:19.418 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:19.419 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:19.419 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "info", 2023-07-14T18:29:19.419 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:19.419 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:19.419 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [ 2023-07-14T18:29:19.420 INFO:teuthology.orchestra.run.smithi163.stdout: "", 2023-07-14T18:29:19.420 INFO:teuthology.orchestra.run.smithi163.stdout: "critical", 2023-07-14T18:29:19.420 INFO:teuthology.orchestra.run.smithi163.stdout: "debug", 2023-07-14T18:29:19.420 INFO:teuthology.orchestra.run.smithi163.stdout: "error", 2023-07-14T18:29:19.421 INFO:teuthology.orchestra.run.smithi163.stdout: "info", 2023-07-14T18:29:19.421 INFO:teuthology.orchestra.run.smithi163.stdout: "warning" 2023-07-14T18:29:19.421 INFO:teuthology.orchestra.run.smithi163.stdout: ], 2023-07-14T18:29:19.421 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:19.421 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:19.422 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:19.422 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:19.422 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:19.422 INFO:teuthology.orchestra.run.smithi163.stdout: "log_to_file": { 2023-07-14T18:29:19.422 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "log_to_file", 2023-07-14T18:29:19.423 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "bool", 2023-07-14T18:29:19.423 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:19.423 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:19.423 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "False", 2023-07-14T18:29:19.423 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:19.424 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:19.424 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:19.424 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:19.424 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:19.424 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:19.425 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:19.425 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:19.425 INFO:teuthology.orchestra.run.smithi163.stdout: "motd": { 2023-07-14T18:29:19.425 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "motd", 2023-07-14T18:29:19.425 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "str", 2023-07-14T18:29:19.426 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:19.426 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:19.426 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "", 2023-07-14T18:29:19.426 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:19.426 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:19.426 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:19.427 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "The message of the day", 2023-07-14T18:29:19.427 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:19.427 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:19.427 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:19.427 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:19.428 INFO:teuthology.orchestra.run.smithi163.stdout: "redirect_resolve_ip_addr": { 2023-07-14T18:29:19.428 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "redirect_resolve_ip_addr", 2023-07-14T18:29:19.428 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "bool", 2023-07-14T18:29:19.428 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:19.428 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:19.429 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "False", 2023-07-14T18:29:19.429 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:19.429 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:19.429 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:19.429 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:19.430 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:19.430 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:19.430 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:19.430 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:19.430 INFO:teuthology.orchestra.run.smithi163.stdout: "server_addr": { 2023-07-14T18:29:19.431 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "server_addr", 2023-07-14T18:29:19.431 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "str", 2023-07-14T18:29:19.431 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:19.431 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:19.431 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "::", 2023-07-14T18:29:19.432 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:19.432 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:19.432 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:19.432 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:19.432 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:19.433 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:19.433 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:19.433 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:19.433 INFO:teuthology.orchestra.run.smithi163.stdout: "server_port": { 2023-07-14T18:29:19.433 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "server_port", 2023-07-14T18:29:19.434 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "int", 2023-07-14T18:29:19.434 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:19.434 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:19.434 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "8080", 2023-07-14T18:29:19.434 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:19.435 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:19.435 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:19.435 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:19.435 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:19.435 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:19.436 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:19.436 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:19.436 INFO:teuthology.orchestra.run.smithi163.stdout: "ssl": { 2023-07-14T18:29:19.436 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "ssl", 2023-07-14T18:29:19.436 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "bool", 2023-07-14T18:29:19.437 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:19.437 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:19.437 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "True", 2023-07-14T18:29:19.437 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:19.437 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:19.438 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:19.438 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:19.438 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:19.438 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:19.438 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:19.439 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:19.439 INFO:teuthology.orchestra.run.smithi163.stdout: "ssl_server_port": { 2023-07-14T18:29:19.439 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "ssl_server_port", 2023-07-14T18:29:19.439 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "int", 2023-07-14T18:29:19.439 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:19.439 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:19.440 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "8443", 2023-07-14T18:29:19.440 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:19.440 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:19.440 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:19.440 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:19.441 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:19.441 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:19.441 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:19.441 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:19.441 INFO:teuthology.orchestra.run.smithi163.stdout: "standby_behaviour": { 2023-07-14T18:29:19.442 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "standby_behaviour", 2023-07-14T18:29:19.442 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "str", 2023-07-14T18:29:19.442 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:19.442 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:19.442 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "redirect", 2023-07-14T18:29:19.443 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:19.443 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:19.443 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [ 2023-07-14T18:29:19.443 INFO:teuthology.orchestra.run.smithi163.stdout: "error", 2023-07-14T18:29:19.443 INFO:teuthology.orchestra.run.smithi163.stdout: "redirect" 2023-07-14T18:29:19.444 INFO:teuthology.orchestra.run.smithi163.stdout: ], 2023-07-14T18:29:19.444 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:19.444 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:19.444 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:19.444 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:19.445 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:19.445 INFO:teuthology.orchestra.run.smithi163.stdout: "standby_error_status_code": { 2023-07-14T18:29:19.445 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "standby_error_status_code", 2023-07-14T18:29:19.445 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "int", 2023-07-14T18:29:19.445 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:19.446 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:19.446 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "500", 2023-07-14T18:29:19.446 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "400", 2023-07-14T18:29:19.446 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "599", 2023-07-14T18:29:19.446 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:19.446 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:19.447 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:19.447 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:19.447 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:19.447 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:19.447 INFO:teuthology.orchestra.run.smithi163.stdout: "url_prefix": { 2023-07-14T18:29:19.448 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "url_prefix", 2023-07-14T18:29:19.448 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "str", 2023-07-14T18:29:19.448 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:19.448 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:19.448 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "", 2023-07-14T18:29:19.449 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:19.449 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:19.449 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:19.449 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:19.449 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:19.450 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:19.450 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:19.450 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-07-14T18:29:19.450 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-07-14T18:29:19.450 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:19.451 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-07-14T18:29:19.451 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "devicehealth", 2023-07-14T18:29:19.451 INFO:teuthology.orchestra.run.smithi163.stdout: "can_run": true, 2023-07-14T18:29:19.451 INFO:teuthology.orchestra.run.smithi163.stdout: "error_string": "", 2023-07-14T18:29:19.451 INFO:teuthology.orchestra.run.smithi163.stdout: "module_options": { 2023-07-14T18:29:19.452 INFO:teuthology.orchestra.run.smithi163.stdout: "enable_monitoring": { 2023-07-14T18:29:19.452 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "enable_monitoring", 2023-07-14T18:29:19.452 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "bool", 2023-07-14T18:29:19.452 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:19.452 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:19.453 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "True", 2023-07-14T18:29:19.453 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:19.453 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:19.453 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:19.453 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "monitor device health metrics", 2023-07-14T18:29:19.454 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:19.454 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:19.454 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:19.454 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:19.454 INFO:teuthology.orchestra.run.smithi163.stdout: "log_level": { 2023-07-14T18:29:19.455 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "log_level", 2023-07-14T18:29:19.455 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "str", 2023-07-14T18:29:19.455 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:19.455 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:19.455 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "", 2023-07-14T18:29:19.456 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:19.456 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:19.456 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [ 2023-07-14T18:29:19.456 INFO:teuthology.orchestra.run.smithi163.stdout: "", 2023-07-14T18:29:19.456 INFO:teuthology.orchestra.run.smithi163.stdout: "critical", 2023-07-14T18:29:19.457 INFO:teuthology.orchestra.run.smithi163.stdout: "debug", 2023-07-14T18:29:19.457 INFO:teuthology.orchestra.run.smithi163.stdout: "error", 2023-07-14T18:29:19.457 INFO:teuthology.orchestra.run.smithi163.stdout: "info", 2023-07-14T18:29:19.457 INFO:teuthology.orchestra.run.smithi163.stdout: "warning" 2023-07-14T18:29:19.457 INFO:teuthology.orchestra.run.smithi163.stdout: ], 2023-07-14T18:29:19.458 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:19.458 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:19.458 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:19.458 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:19.458 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:19.458 INFO:teuthology.orchestra.run.smithi163.stdout: "log_to_cluster": { 2023-07-14T18:29:19.459 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "log_to_cluster", 2023-07-14T18:29:19.459 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "bool", 2023-07-14T18:29:19.459 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:19.459 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:19.459 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "False", 2023-07-14T18:29:19.460 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:19.460 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:19.460 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:19.460 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:19.460 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:19.461 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:19.461 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:19.461 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:19.461 INFO:teuthology.orchestra.run.smithi163.stdout: "log_to_cluster_level": { 2023-07-14T18:29:19.461 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "log_to_cluster_level", 2023-07-14T18:29:19.462 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "str", 2023-07-14T18:29:19.462 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:19.462 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:19.462 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "info", 2023-07-14T18:29:19.462 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:19.463 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:19.463 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [ 2023-07-14T18:29:19.463 INFO:teuthology.orchestra.run.smithi163.stdout: "", 2023-07-14T18:29:19.463 INFO:teuthology.orchestra.run.smithi163.stdout: "critical", 2023-07-14T18:29:19.463 INFO:teuthology.orchestra.run.smithi163.stdout: "debug", 2023-07-14T18:29:19.464 INFO:teuthology.orchestra.run.smithi163.stdout: "error", 2023-07-14T18:29:19.464 INFO:teuthology.orchestra.run.smithi163.stdout: "info", 2023-07-14T18:29:19.464 INFO:teuthology.orchestra.run.smithi163.stdout: "warning" 2023-07-14T18:29:19.464 INFO:teuthology.orchestra.run.smithi163.stdout: ], 2023-07-14T18:29:19.464 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:19.465 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:19.465 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:19.465 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:19.465 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:19.465 INFO:teuthology.orchestra.run.smithi163.stdout: "log_to_file": { 2023-07-14T18:29:19.466 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "log_to_file", 2023-07-14T18:29:19.466 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "bool", 2023-07-14T18:29:19.466 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:19.466 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:19.466 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "False", 2023-07-14T18:29:19.467 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:19.467 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:19.467 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:19.467 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:19.467 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:19.468 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:19.468 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:19.468 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:19.468 INFO:teuthology.orchestra.run.smithi163.stdout: "mark_out_threshold": { 2023-07-14T18:29:19.468 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "mark_out_threshold", 2023-07-14T18:29:19.469 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "secs", 2023-07-14T18:29:19.469 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:19.469 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:19.469 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "2419200", 2023-07-14T18:29:19.469 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:19.470 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:19.470 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:19.470 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "automatically mark OSD if it may fail before this long", 2023-07-14T18:29:19.470 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:19.470 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:19.471 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:19.471 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:19.471 INFO:teuthology.orchestra.run.smithi163.stdout: "pool_name": { 2023-07-14T18:29:19.471 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "pool_name", 2023-07-14T18:29:19.471 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "str", 2023-07-14T18:29:19.472 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:19.472 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:19.472 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "device_health_metrics", 2023-07-14T18:29:19.472 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:19.472 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:19.473 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:19.473 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "name of pool in which to store device health metrics", 2023-07-14T18:29:19.473 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:19.473 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:19.473 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:19.473 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:19.474 INFO:teuthology.orchestra.run.smithi163.stdout: "retention_period": { 2023-07-14T18:29:19.474 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "retention_period", 2023-07-14T18:29:19.474 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "secs", 2023-07-14T18:29:19.474 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:19.474 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:19.475 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "15552000", 2023-07-14T18:29:19.475 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:19.475 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:19.475 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:19.475 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "how long to retain device health metrics", 2023-07-14T18:29:19.476 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:19.476 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:19.476 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:19.476 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:19.476 INFO:teuthology.orchestra.run.smithi163.stdout: "scrape_frequency": { 2023-07-14T18:29:19.477 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "scrape_frequency", 2023-07-14T18:29:19.477 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "secs", 2023-07-14T18:29:19.477 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:19.477 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:19.477 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "86400", 2023-07-14T18:29:19.478 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:19.478 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:19.478 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:19.478 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "how frequently to scrape device health metrics", 2023-07-14T18:29:19.478 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:19.479 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:19.479 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:19.479 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:19.479 INFO:teuthology.orchestra.run.smithi163.stdout: "self_heal": { 2023-07-14T18:29:19.479 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "self_heal", 2023-07-14T18:29:19.480 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "bool", 2023-07-14T18:29:19.480 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:19.480 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:19.480 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "True", 2023-07-14T18:29:19.480 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:19.481 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:19.481 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:19.481 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "preemptively heal cluster around devices that may fail", 2023-07-14T18:29:19.481 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:19.481 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:19.482 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:19.482 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:19.482 INFO:teuthology.orchestra.run.smithi163.stdout: "sleep_interval": { 2023-07-14T18:29:19.482 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "sleep_interval", 2023-07-14T18:29:19.482 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "secs", 2023-07-14T18:29:19.483 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:19.483 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:19.483 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "600", 2023-07-14T18:29:19.483 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:19.483 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:19.483 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:19.484 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "how frequently to wake up and check device health", 2023-07-14T18:29:19.484 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:19.484 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:19.484 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:19.484 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:19.485 INFO:teuthology.orchestra.run.smithi163.stdout: "warn_threshold": { 2023-07-14T18:29:19.485 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "warn_threshold", 2023-07-14T18:29:19.485 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "secs", 2023-07-14T18:29:19.485 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:19.485 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:19.486 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "7257600", 2023-07-14T18:29:19.486 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:19.486 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:19.486 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:19.486 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "raise health warning if OSD may fail before this long", 2023-07-14T18:29:19.487 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:19.487 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:19.487 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:19.487 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-07-14T18:29:19.487 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-07-14T18:29:19.488 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:19.488 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-07-14T18:29:19.488 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "diskprediction_local", 2023-07-14T18:29:19.488 INFO:teuthology.orchestra.run.smithi163.stdout: "can_run": true, 2023-07-14T18:29:19.488 INFO:teuthology.orchestra.run.smithi163.stdout: "error_string": "", 2023-07-14T18:29:19.489 INFO:teuthology.orchestra.run.smithi163.stdout: "module_options": { 2023-07-14T18:29:19.489 INFO:teuthology.orchestra.run.smithi163.stdout: "log_level": { 2023-07-14T18:29:19.489 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "log_level", 2023-07-14T18:29:19.489 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "str", 2023-07-14T18:29:19.489 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:19.490 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:19.490 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "", 2023-07-14T18:29:19.490 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:19.490 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:19.490 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [ 2023-07-14T18:29:19.491 INFO:teuthology.orchestra.run.smithi163.stdout: "", 2023-07-14T18:29:19.491 INFO:teuthology.orchestra.run.smithi163.stdout: "critical", 2023-07-14T18:29:19.491 INFO:teuthology.orchestra.run.smithi163.stdout: "debug", 2023-07-14T18:29:19.491 INFO:teuthology.orchestra.run.smithi163.stdout: "error", 2023-07-14T18:29:19.491 INFO:teuthology.orchestra.run.smithi163.stdout: "info", 2023-07-14T18:29:19.492 INFO:teuthology.orchestra.run.smithi163.stdout: "warning" 2023-07-14T18:29:19.492 INFO:teuthology.orchestra.run.smithi163.stdout: ], 2023-07-14T18:29:19.492 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:19.492 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:19.492 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:19.493 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:19.493 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:19.493 INFO:teuthology.orchestra.run.smithi163.stdout: "log_to_cluster": { 2023-07-14T18:29:19.493 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "log_to_cluster", 2023-07-14T18:29:19.493 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "bool", 2023-07-14T18:29:19.494 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:19.494 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:19.494 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "False", 2023-07-14T18:29:19.494 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:19.494 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:19.495 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:19.495 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:19.495 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:19.495 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:19.495 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:19.496 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:19.496 INFO:teuthology.orchestra.run.smithi163.stdout: "log_to_cluster_level": { 2023-07-14T18:29:19.496 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "log_to_cluster_level", 2023-07-14T18:29:19.496 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "str", 2023-07-14T18:29:19.496 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:19.497 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:19.497 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "info", 2023-07-14T18:29:19.497 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:19.497 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:19.497 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [ 2023-07-14T18:29:19.498 INFO:teuthology.orchestra.run.smithi163.stdout: "", 2023-07-14T18:29:19.498 INFO:teuthology.orchestra.run.smithi163.stdout: "critical", 2023-07-14T18:29:19.498 INFO:teuthology.orchestra.run.smithi163.stdout: "debug", 2023-07-14T18:29:19.498 INFO:teuthology.orchestra.run.smithi163.stdout: "error", 2023-07-14T18:29:19.498 INFO:teuthology.orchestra.run.smithi163.stdout: "info", 2023-07-14T18:29:19.499 INFO:teuthology.orchestra.run.smithi163.stdout: "warning" 2023-07-14T18:29:19.499 INFO:teuthology.orchestra.run.smithi163.stdout: ], 2023-07-14T18:29:19.499 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:19.499 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:19.499 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:19.500 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:19.500 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:19.500 INFO:teuthology.orchestra.run.smithi163.stdout: "log_to_file": { 2023-07-14T18:29:19.500 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "log_to_file", 2023-07-14T18:29:19.500 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "bool", 2023-07-14T18:29:19.501 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:19.501 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:19.501 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "False", 2023-07-14T18:29:19.501 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:19.501 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:19.502 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:19.502 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:19.502 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:19.502 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:19.502 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:19.503 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:19.503 INFO:teuthology.orchestra.run.smithi163.stdout: "predict_interval": { 2023-07-14T18:29:19.503 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "predict_interval", 2023-07-14T18:29:19.503 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "str", 2023-07-14T18:29:19.503 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:19.504 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:19.504 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "86400", 2023-07-14T18:29:19.504 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:19.504 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:19.504 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:19.505 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:19.505 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:19.505 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:19.505 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:19.505 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:19.506 INFO:teuthology.orchestra.run.smithi163.stdout: "predictor_model": { 2023-07-14T18:29:19.506 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "predictor_model", 2023-07-14T18:29:19.506 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "str", 2023-07-14T18:29:19.506 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:19.506 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:19.507 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "prophetstor", 2023-07-14T18:29:19.507 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:19.507 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:19.507 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:19.507 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:19.508 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:19.508 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:19.508 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:19.508 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:19.509 INFO:teuthology.orchestra.run.smithi163.stdout: "sleep_interval": { 2023-07-14T18:29:19.509 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "sleep_interval", 2023-07-14T18:29:19.509 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "str", 2023-07-14T18:29:19.509 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:19.509 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:19.509 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "600", 2023-07-14T18:29:19.510 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:19.510 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:19.510 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:19.510 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:19.510 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:19.511 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:19.511 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:19.511 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-07-14T18:29:19.511 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-07-14T18:29:19.511 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:19.512 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-07-14T18:29:19.512 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "influx", 2023-07-14T18:29:19.512 INFO:teuthology.orchestra.run.smithi163.stdout: "can_run": false, 2023-07-14T18:29:19.512 INFO:teuthology.orchestra.run.smithi163.stdout: "error_string": "influxdb python module not found", 2023-07-14T18:29:19.512 INFO:teuthology.orchestra.run.smithi163.stdout: "module_options": { 2023-07-14T18:29:19.513 INFO:teuthology.orchestra.run.smithi163.stdout: "batch_size": { 2023-07-14T18:29:19.513 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "batch_size", 2023-07-14T18:29:19.513 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "int", 2023-07-14T18:29:19.513 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:19.513 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:19.514 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "5000", 2023-07-14T18:29:19.514 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:19.514 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:19.514 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:19.514 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2023-07-14T18:29:19.515 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:19.515 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:19.515 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:19.515 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:19.515 INFO:teuthology.orchestra.run.smithi163.stdout: "database": { 2023-07-14T18:29:19.515 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "database", 2023-07-14T18:29:19.516 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "str", 2023-07-14T18:29:19.516 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:19.516 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:19.516 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "ceph", 2023-07-14T18:29:19.516 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:19.517 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:19.517 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:19.517 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2023-07-14T18:29:19.517 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:19.517 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:19.518 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:19.518 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:19.518 INFO:teuthology.orchestra.run.smithi163.stdout: "hostname": { 2023-07-14T18:29:19.518 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "hostname", 2023-07-14T18:29:19.518 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "str", 2023-07-14T18:29:19.519 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:19.519 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:19.519 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "", 2023-07-14T18:29:19.519 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:19.519 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:19.520 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:19.520 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "InfluxDB server hostname", 2023-07-14T18:29:19.520 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:19.520 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:19.520 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:19.521 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:19.521 INFO:teuthology.orchestra.run.smithi163.stdout: "interval": { 2023-07-14T18:29:19.521 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "interval", 2023-07-14T18:29:19.521 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "secs", 2023-07-14T18:29:19.521 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:19.521 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:19.522 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "30", 2023-07-14T18:29:19.522 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "5", 2023-07-14T18:29:19.522 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:19.522 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:19.522 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2023-07-14T18:29:19.523 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:19.523 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:19.523 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:19.523 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:19.524 INFO:teuthology.orchestra.run.smithi163.stdout: "log_level": { 2023-07-14T18:29:19.524 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "log_level", 2023-07-14T18:29:19.524 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "str", 2023-07-14T18:29:19.524 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:19.524 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:19.525 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "", 2023-07-14T18:29:19.525 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:19.525 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:19.525 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [ 2023-07-14T18:29:19.525 INFO:teuthology.orchestra.run.smithi163.stdout: "", 2023-07-14T18:29:19.526 INFO:teuthology.orchestra.run.smithi163.stdout: "critical", 2023-07-14T18:29:19.526 INFO:teuthology.orchestra.run.smithi163.stdout: "debug", 2023-07-14T18:29:19.526 INFO:teuthology.orchestra.run.smithi163.stdout: "error", 2023-07-14T18:29:19.526 INFO:teuthology.orchestra.run.smithi163.stdout: "info", 2023-07-14T18:29:19.526 INFO:teuthology.orchestra.run.smithi163.stdout: "warning" 2023-07-14T18:29:19.527 INFO:teuthology.orchestra.run.smithi163.stdout: ], 2023-07-14T18:29:19.527 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:19.527 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:19.527 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:19.527 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:19.528 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:19.528 INFO:teuthology.orchestra.run.smithi163.stdout: "log_to_cluster": { 2023-07-14T18:29:19.528 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "log_to_cluster", 2023-07-14T18:29:19.528 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "bool", 2023-07-14T18:29:19.528 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:19.529 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:19.529 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "False", 2023-07-14T18:29:19.529 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:19.529 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:19.529 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:19.530 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:19.530 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:19.530 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:19.530 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:19.530 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:19.531 INFO:teuthology.orchestra.run.smithi163.stdout: "log_to_cluster_level": { 2023-07-14T18:29:19.531 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "log_to_cluster_level", 2023-07-14T18:29:19.531 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "str", 2023-07-14T18:29:19.531 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:19.531 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:19.532 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "info", 2023-07-14T18:29:19.532 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:19.532 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:19.532 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [ 2023-07-14T18:29:19.532 INFO:teuthology.orchestra.run.smithi163.stdout: "", 2023-07-14T18:29:19.533 INFO:teuthology.orchestra.run.smithi163.stdout: "critical", 2023-07-14T18:29:19.533 INFO:teuthology.orchestra.run.smithi163.stdout: "debug", 2023-07-14T18:29:19.533 INFO:teuthology.orchestra.run.smithi163.stdout: "error", 2023-07-14T18:29:19.533 INFO:teuthology.orchestra.run.smithi163.stdout: "info", 2023-07-14T18:29:19.533 INFO:teuthology.orchestra.run.smithi163.stdout: "warning" 2023-07-14T18:29:19.534 INFO:teuthology.orchestra.run.smithi163.stdout: ], 2023-07-14T18:29:19.534 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:19.534 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:19.534 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:19.534 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:19.535 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:19.535 INFO:teuthology.orchestra.run.smithi163.stdout: "log_to_file": { 2023-07-14T18:29:19.535 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "log_to_file", 2023-07-14T18:29:19.535 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "bool", 2023-07-14T18:29:19.535 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:19.536 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:19.536 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "False", 2023-07-14T18:29:19.536 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:19.536 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:19.536 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:19.537 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:19.537 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:19.537 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:19.537 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:19.537 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:19.538 INFO:teuthology.orchestra.run.smithi163.stdout: "password": { 2023-07-14T18:29:19.538 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "password", 2023-07-14T18:29:19.538 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "str", 2023-07-14T18:29:19.538 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:19.538 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:19.539 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "", 2023-07-14T18:29:19.539 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:19.539 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:19.539 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:19.539 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "password of InfluxDB server user", 2023-07-14T18:29:19.539 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:19.540 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:19.540 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:19.540 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:19.540 INFO:teuthology.orchestra.run.smithi163.stdout: "port": { 2023-07-14T18:29:19.540 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "port", 2023-07-14T18:29:19.541 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "int", 2023-07-14T18:29:19.541 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:19.541 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:19.541 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "8086", 2023-07-14T18:29:19.541 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:19.542 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:19.542 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:19.542 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "InfluxDB server port", 2023-07-14T18:29:19.543 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:19.543 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:19.543 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:19.543 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:19.543 INFO:teuthology.orchestra.run.smithi163.stdout: "ssl": { 2023-07-14T18:29:19.544 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "ssl", 2023-07-14T18:29:19.544 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "str", 2023-07-14T18:29:19.544 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:19.544 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:19.544 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "false", 2023-07-14T18:29:19.545 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:19.545 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:19.545 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:19.545 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2023-07-14T18:29:19.545 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:19.546 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:19.546 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:19.546 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:19.546 INFO:teuthology.orchestra.run.smithi163.stdout: "threads": { 2023-07-14T18:29:19.546 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "threads", 2023-07-14T18:29:19.546 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "int", 2023-07-14T18:29:19.547 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:19.547 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:19.547 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "5", 2023-07-14T18:29:19.547 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "1", 2023-07-14T18:29:19.547 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "32", 2023-07-14T18:29:19.548 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:19.548 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2023-07-14T18:29:19.548 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:19.548 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:19.548 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:19.549 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:19.549 INFO:teuthology.orchestra.run.smithi163.stdout: "username": { 2023-07-14T18:29:19.549 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "username", 2023-07-14T18:29:19.549 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "str", 2023-07-14T18:29:19.549 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:19.550 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:19.550 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "", 2023-07-14T18:29:19.550 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:19.550 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:19.550 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:19.551 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "username of InfluxDB server user", 2023-07-14T18:29:19.551 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:19.551 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:19.551 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:19.551 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:19.551 INFO:teuthology.orchestra.run.smithi163.stdout: "verify_ssl": { 2023-07-14T18:29:19.552 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "verify_ssl", 2023-07-14T18:29:19.552 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "str", 2023-07-14T18:29:19.552 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:19.552 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:19.552 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "true", 2023-07-14T18:29:19.553 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:19.553 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:19.553 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:19.553 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2023-07-14T18:29:19.553 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:19.554 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:19.554 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:19.554 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-07-14T18:29:19.554 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-07-14T18:29:19.554 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:19.555 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-07-14T18:29:19.555 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "insights", 2023-07-14T18:29:19.555 INFO:teuthology.orchestra.run.smithi163.stdout: "can_run": true, 2023-07-14T18:29:19.555 INFO:teuthology.orchestra.run.smithi163.stdout: "error_string": "", 2023-07-14T18:29:19.555 INFO:teuthology.orchestra.run.smithi163.stdout: "module_options": { 2023-07-14T18:29:19.556 INFO:teuthology.orchestra.run.smithi163.stdout: "log_level": { 2023-07-14T18:29:19.556 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "log_level", 2023-07-14T18:29:19.556 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "str", 2023-07-14T18:29:19.556 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:19.556 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:19.557 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "", 2023-07-14T18:29:19.557 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:19.557 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:19.557 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [ 2023-07-14T18:29:19.557 INFO:teuthology.orchestra.run.smithi163.stdout: "", 2023-07-14T18:29:19.558 INFO:teuthology.orchestra.run.smithi163.stdout: "critical", 2023-07-14T18:29:19.558 INFO:teuthology.orchestra.run.smithi163.stdout: "debug", 2023-07-14T18:29:19.558 INFO:teuthology.orchestra.run.smithi163.stdout: "error", 2023-07-14T18:29:19.558 INFO:teuthology.orchestra.run.smithi163.stdout: "info", 2023-07-14T18:29:19.558 INFO:teuthology.orchestra.run.smithi163.stdout: "warning" 2023-07-14T18:29:19.559 INFO:teuthology.orchestra.run.smithi163.stdout: ], 2023-07-14T18:29:19.559 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:19.559 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:19.559 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:19.559 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:19.560 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:19.560 INFO:teuthology.orchestra.run.smithi163.stdout: "log_to_cluster": { 2023-07-14T18:29:19.560 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "log_to_cluster", 2023-07-14T18:29:19.560 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "bool", 2023-07-14T18:29:19.560 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:19.561 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:19.561 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "False", 2023-07-14T18:29:19.561 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:19.561 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:19.561 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:19.561 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:19.562 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:19.562 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:19.562 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:19.562 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:19.562 INFO:teuthology.orchestra.run.smithi163.stdout: "log_to_cluster_level": { 2023-07-14T18:29:19.563 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "log_to_cluster_level", 2023-07-14T18:29:19.563 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "str", 2023-07-14T18:29:19.563 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:19.563 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:19.563 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "info", 2023-07-14T18:29:19.564 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:19.564 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:19.564 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [ 2023-07-14T18:29:19.564 INFO:teuthology.orchestra.run.smithi163.stdout: "", 2023-07-14T18:29:19.564 INFO:teuthology.orchestra.run.smithi163.stdout: "critical", 2023-07-14T18:29:19.565 INFO:teuthology.orchestra.run.smithi163.stdout: "debug", 2023-07-14T18:29:19.565 INFO:teuthology.orchestra.run.smithi163.stdout: "error", 2023-07-14T18:29:19.565 INFO:teuthology.orchestra.run.smithi163.stdout: "info", 2023-07-14T18:29:19.565 INFO:teuthology.orchestra.run.smithi163.stdout: "warning" 2023-07-14T18:29:19.565 INFO:teuthology.orchestra.run.smithi163.stdout: ], 2023-07-14T18:29:19.566 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:19.566 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:19.566 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:19.566 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:19.566 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:19.567 INFO:teuthology.orchestra.run.smithi163.stdout: "log_to_file": { 2023-07-14T18:29:19.567 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "log_to_file", 2023-07-14T18:29:19.567 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "bool", 2023-07-14T18:29:19.567 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:19.567 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:19.568 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "False", 2023-07-14T18:29:19.568 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:19.568 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:19.568 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:19.568 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:19.569 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:19.569 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:19.569 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:19.569 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-07-14T18:29:19.569 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-07-14T18:29:19.569 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:19.570 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-07-14T18:29:19.570 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "iostat", 2023-07-14T18:29:19.570 INFO:teuthology.orchestra.run.smithi163.stdout: "can_run": true, 2023-07-14T18:29:19.570 INFO:teuthology.orchestra.run.smithi163.stdout: "error_string": "", 2023-07-14T18:29:19.570 INFO:teuthology.orchestra.run.smithi163.stdout: "module_options": { 2023-07-14T18:29:19.571 INFO:teuthology.orchestra.run.smithi163.stdout: "log_level": { 2023-07-14T18:29:19.571 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "log_level", 2023-07-14T18:29:19.571 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "str", 2023-07-14T18:29:19.571 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:19.571 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:19.572 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "", 2023-07-14T18:29:19.572 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:19.572 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:19.572 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [ 2023-07-14T18:29:19.572 INFO:teuthology.orchestra.run.smithi163.stdout: "", 2023-07-14T18:29:19.573 INFO:teuthology.orchestra.run.smithi163.stdout: "critical", 2023-07-14T18:29:19.573 INFO:teuthology.orchestra.run.smithi163.stdout: "debug", 2023-07-14T18:29:19.573 INFO:teuthology.orchestra.run.smithi163.stdout: "error", 2023-07-14T18:29:19.573 INFO:teuthology.orchestra.run.smithi163.stdout: "info", 2023-07-14T18:29:19.573 INFO:teuthology.orchestra.run.smithi163.stdout: "warning" 2023-07-14T18:29:19.574 INFO:teuthology.orchestra.run.smithi163.stdout: ], 2023-07-14T18:29:19.574 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:19.574 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:19.574 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:19.574 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:19.575 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:19.575 INFO:teuthology.orchestra.run.smithi163.stdout: "log_to_cluster": { 2023-07-14T18:29:19.575 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "log_to_cluster", 2023-07-14T18:29:19.575 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "bool", 2023-07-14T18:29:19.575 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:19.576 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:19.576 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "False", 2023-07-14T18:29:19.576 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:19.576 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:19.576 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:19.577 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:19.577 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:19.577 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:19.577 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:19.577 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:19.578 INFO:teuthology.orchestra.run.smithi163.stdout: "log_to_cluster_level": { 2023-07-14T18:29:19.578 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "log_to_cluster_level", 2023-07-14T18:29:19.578 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "str", 2023-07-14T18:29:19.578 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:19.578 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:19.579 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "info", 2023-07-14T18:29:19.579 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:19.579 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:19.579 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [ 2023-07-14T18:29:19.579 INFO:teuthology.orchestra.run.smithi163.stdout: "", 2023-07-14T18:29:19.579 INFO:teuthology.orchestra.run.smithi163.stdout: "critical", 2023-07-14T18:29:19.580 INFO:teuthology.orchestra.run.smithi163.stdout: "debug", 2023-07-14T18:29:19.580 INFO:teuthology.orchestra.run.smithi163.stdout: "error", 2023-07-14T18:29:19.580 INFO:teuthology.orchestra.run.smithi163.stdout: "info", 2023-07-14T18:29:19.580 INFO:teuthology.orchestra.run.smithi163.stdout: "warning" 2023-07-14T18:29:19.580 INFO:teuthology.orchestra.run.smithi163.stdout: ], 2023-07-14T18:29:19.581 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:19.581 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:19.581 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:19.581 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:19.581 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:19.582 INFO:teuthology.orchestra.run.smithi163.stdout: "log_to_file": { 2023-07-14T18:29:19.582 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "log_to_file", 2023-07-14T18:29:19.582 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "bool", 2023-07-14T18:29:19.582 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:19.582 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:19.583 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "False", 2023-07-14T18:29:19.583 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:19.583 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:19.583 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:19.583 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:19.584 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:19.584 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:19.584 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:19.584 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-07-14T18:29:19.584 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-07-14T18:29:19.584 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:19.585 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-07-14T18:29:19.585 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "k8sevents", 2023-07-14T18:29:19.585 INFO:teuthology.orchestra.run.smithi163.stdout: "can_run": true, 2023-07-14T18:29:19.585 INFO:teuthology.orchestra.run.smithi163.stdout: "error_string": "", 2023-07-14T18:29:19.585 INFO:teuthology.orchestra.run.smithi163.stdout: "module_options": { 2023-07-14T18:29:19.586 INFO:teuthology.orchestra.run.smithi163.stdout: "ceph_event_retention_days": { 2023-07-14T18:29:19.586 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "ceph_event_retention_days", 2023-07-14T18:29:19.586 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "int", 2023-07-14T18:29:19.586 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:19.586 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:19.587 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "7", 2023-07-14T18:29:19.587 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:19.587 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:19.587 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:19.587 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "Days to hold ceph event information within local cache", 2023-07-14T18:29:19.588 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:19.588 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:19.588 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:19.588 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:19.588 INFO:teuthology.orchestra.run.smithi163.stdout: "config_check_secs": { 2023-07-14T18:29:19.589 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "config_check_secs", 2023-07-14T18:29:19.589 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "int", 2023-07-14T18:29:19.589 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:19.589 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:19.589 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "10", 2023-07-14T18:29:19.590 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "10", 2023-07-14T18:29:19.590 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:19.590 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:19.590 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2023-07-14T18:29:19.590 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:19.590 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:19.591 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:19.591 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:19.591 INFO:teuthology.orchestra.run.smithi163.stdout: "log_level": { 2023-07-14T18:29:19.591 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "log_level", 2023-07-14T18:29:19.591 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "str", 2023-07-14T18:29:19.592 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:19.592 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:19.592 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "", 2023-07-14T18:29:19.592 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:19.592 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:19.593 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [ 2023-07-14T18:29:19.593 INFO:teuthology.orchestra.run.smithi163.stdout: "", 2023-07-14T18:29:19.593 INFO:teuthology.orchestra.run.smithi163.stdout: "critical", 2023-07-14T18:29:19.593 INFO:teuthology.orchestra.run.smithi163.stdout: "debug", 2023-07-14T18:29:19.593 INFO:teuthology.orchestra.run.smithi163.stdout: "error", 2023-07-14T18:29:19.594 INFO:teuthology.orchestra.run.smithi163.stdout: "info", 2023-07-14T18:29:19.594 INFO:teuthology.orchestra.run.smithi163.stdout: "warning" 2023-07-14T18:29:19.594 INFO:teuthology.orchestra.run.smithi163.stdout: ], 2023-07-14T18:29:19.594 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:19.594 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:19.595 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:19.595 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:19.595 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:19.595 INFO:teuthology.orchestra.run.smithi163.stdout: "log_to_cluster": { 2023-07-14T18:29:19.595 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "log_to_cluster", 2023-07-14T18:29:19.596 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "bool", 2023-07-14T18:29:19.596 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:19.596 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:19.596 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "False", 2023-07-14T18:29:19.596 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:19.597 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:19.597 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:19.597 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:19.597 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:19.597 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:19.598 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:19.598 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:19.598 INFO:teuthology.orchestra.run.smithi163.stdout: "log_to_cluster_level": { 2023-07-14T18:29:19.598 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "log_to_cluster_level", 2023-07-14T18:29:19.598 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "str", 2023-07-14T18:29:19.599 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:19.599 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:19.599 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "info", 2023-07-14T18:29:19.599 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:19.599 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:19.599 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [ 2023-07-14T18:29:19.600 INFO:teuthology.orchestra.run.smithi163.stdout: "", 2023-07-14T18:29:19.600 INFO:teuthology.orchestra.run.smithi163.stdout: "critical", 2023-07-14T18:29:19.600 INFO:teuthology.orchestra.run.smithi163.stdout: "debug", 2023-07-14T18:29:19.600 INFO:teuthology.orchestra.run.smithi163.stdout: "error", 2023-07-14T18:29:19.601 INFO:teuthology.orchestra.run.smithi163.stdout: "info", 2023-07-14T18:29:19.601 INFO:teuthology.orchestra.run.smithi163.stdout: "warning" 2023-07-14T18:29:19.601 INFO:teuthology.orchestra.run.smithi163.stdout: ], 2023-07-14T18:29:19.601 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:19.601 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:19.602 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:19.602 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:19.602 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:19.602 INFO:teuthology.orchestra.run.smithi163.stdout: "log_to_file": { 2023-07-14T18:29:19.602 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "log_to_file", 2023-07-14T18:29:19.602 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "bool", 2023-07-14T18:29:19.603 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:19.603 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:19.603 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "False", 2023-07-14T18:29:19.603 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:19.603 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:19.604 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:19.604 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:19.604 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:19.604 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:19.604 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:19.605 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-07-14T18:29:19.605 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-07-14T18:29:19.605 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:19.605 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-07-14T18:29:19.605 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "localpool", 2023-07-14T18:29:19.606 INFO:teuthology.orchestra.run.smithi163.stdout: "can_run": true, 2023-07-14T18:29:19.606 INFO:teuthology.orchestra.run.smithi163.stdout: "error_string": "", 2023-07-14T18:29:19.606 INFO:teuthology.orchestra.run.smithi163.stdout: "module_options": { 2023-07-14T18:29:19.606 INFO:teuthology.orchestra.run.smithi163.stdout: "failure_domain": { 2023-07-14T18:29:19.606 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "failure_domain", 2023-07-14T18:29:19.607 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "str", 2023-07-14T18:29:19.607 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:19.607 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:19.607 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "host", 2023-07-14T18:29:19.607 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:19.608 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:19.608 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:19.608 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "failure domain for any created local pool", 2023-07-14T18:29:19.608 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2023-07-14T18:29:19.608 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:19.609 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:19.609 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:19.609 INFO:teuthology.orchestra.run.smithi163.stdout: "log_level": { 2023-07-14T18:29:19.609 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "log_level", 2023-07-14T18:29:19.609 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "str", 2023-07-14T18:29:19.610 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:19.610 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:19.610 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "", 2023-07-14T18:29:19.610 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:19.610 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:19.611 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [ 2023-07-14T18:29:19.611 INFO:teuthology.orchestra.run.smithi163.stdout: "", 2023-07-14T18:29:19.611 INFO:teuthology.orchestra.run.smithi163.stdout: "critical", 2023-07-14T18:29:19.611 INFO:teuthology.orchestra.run.smithi163.stdout: "debug", 2023-07-14T18:29:19.611 INFO:teuthology.orchestra.run.smithi163.stdout: "error", 2023-07-14T18:29:19.612 INFO:teuthology.orchestra.run.smithi163.stdout: "info", 2023-07-14T18:29:19.612 INFO:teuthology.orchestra.run.smithi163.stdout: "warning" 2023-07-14T18:29:19.612 INFO:teuthology.orchestra.run.smithi163.stdout: ], 2023-07-14T18:29:19.612 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:19.612 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:19.613 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:19.613 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:19.613 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:19.613 INFO:teuthology.orchestra.run.smithi163.stdout: "log_to_cluster": { 2023-07-14T18:29:19.613 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "log_to_cluster", 2023-07-14T18:29:19.614 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "bool", 2023-07-14T18:29:19.614 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:19.614 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:19.614 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "False", 2023-07-14T18:29:19.614 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:19.614 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:19.615 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:19.615 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:19.615 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:19.615 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:19.615 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:19.616 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:19.616 INFO:teuthology.orchestra.run.smithi163.stdout: "log_to_cluster_level": { 2023-07-14T18:29:19.616 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "log_to_cluster_level", 2023-07-14T18:29:19.616 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "str", 2023-07-14T18:29:19.616 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:19.617 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:19.617 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "info", 2023-07-14T18:29:19.617 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:19.617 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:19.617 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [ 2023-07-14T18:29:19.618 INFO:teuthology.orchestra.run.smithi163.stdout: "", 2023-07-14T18:29:19.618 INFO:teuthology.orchestra.run.smithi163.stdout: "critical", 2023-07-14T18:29:19.618 INFO:teuthology.orchestra.run.smithi163.stdout: "debug", 2023-07-14T18:29:19.618 INFO:teuthology.orchestra.run.smithi163.stdout: "error", 2023-07-14T18:29:19.618 INFO:teuthology.orchestra.run.smithi163.stdout: "info", 2023-07-14T18:29:19.619 INFO:teuthology.orchestra.run.smithi163.stdout: "warning" 2023-07-14T18:29:19.619 INFO:teuthology.orchestra.run.smithi163.stdout: ], 2023-07-14T18:29:19.619 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:19.619 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:19.619 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:19.620 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:19.620 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:19.620 INFO:teuthology.orchestra.run.smithi163.stdout: "log_to_file": { 2023-07-14T18:29:19.620 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "log_to_file", 2023-07-14T18:29:19.620 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "bool", 2023-07-14T18:29:19.621 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:19.621 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:19.621 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "False", 2023-07-14T18:29:19.621 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:19.621 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:19.622 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:19.622 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:19.622 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:19.622 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:19.622 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:19.623 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:19.623 INFO:teuthology.orchestra.run.smithi163.stdout: "min_size": { 2023-07-14T18:29:19.623 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "min_size", 2023-07-14T18:29:19.623 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "int", 2023-07-14T18:29:19.623 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:19.623 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:19.624 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "", 2023-07-14T18:29:19.624 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:19.624 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:19.624 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:19.624 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "default min_size for any created local pool", 2023-07-14T18:29:19.625 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2023-07-14T18:29:19.625 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:19.625 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:19.625 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:19.625 INFO:teuthology.orchestra.run.smithi163.stdout: "num_rep": { 2023-07-14T18:29:19.626 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "num_rep", 2023-07-14T18:29:19.626 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "int", 2023-07-14T18:29:19.626 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:19.626 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:19.626 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "3", 2023-07-14T18:29:19.627 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:19.627 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:19.627 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:19.627 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "default replica count for any created local pool", 2023-07-14T18:29:19.627 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:19.628 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:19.628 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:19.628 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:19.628 INFO:teuthology.orchestra.run.smithi163.stdout: "pg_num": { 2023-07-14T18:29:19.628 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "pg_num", 2023-07-14T18:29:19.628 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "int", 2023-07-14T18:29:19.629 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:19.629 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:19.629 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "128", 2023-07-14T18:29:19.629 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:19.629 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:19.630 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:19.630 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "default pg_num for any created local pool", 2023-07-14T18:29:19.630 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:19.630 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:19.630 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:19.631 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:19.631 INFO:teuthology.orchestra.run.smithi163.stdout: "prefix": { 2023-07-14T18:29:19.631 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "prefix", 2023-07-14T18:29:19.631 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "str", 2023-07-14T18:29:19.631 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:19.631 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:19.632 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "", 2023-07-14T18:29:19.632 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:19.632 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:19.632 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:19.633 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "name prefix for any created local pool", 2023-07-14T18:29:19.633 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:19.633 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:19.633 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:19.633 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:19.634 INFO:teuthology.orchestra.run.smithi163.stdout: "subtree": { 2023-07-14T18:29:19.634 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "subtree", 2023-07-14T18:29:19.634 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "str", 2023-07-14T18:29:19.634 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:19.634 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:19.635 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "rack", 2023-07-14T18:29:19.635 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:19.635 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:19.635 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:19.635 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "CRUSH level for which to create a local pool", 2023-07-14T18:29:19.636 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2023-07-14T18:29:19.636 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:19.636 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:19.636 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-07-14T18:29:19.636 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-07-14T18:29:19.637 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:19.637 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-07-14T18:29:19.637 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "mds_autoscaler", 2023-07-14T18:29:19.637 INFO:teuthology.orchestra.run.smithi163.stdout: "can_run": true, 2023-07-14T18:29:19.637 INFO:teuthology.orchestra.run.smithi163.stdout: "error_string": "", 2023-07-14T18:29:19.638 INFO:teuthology.orchestra.run.smithi163.stdout: "module_options": { 2023-07-14T18:29:19.638 INFO:teuthology.orchestra.run.smithi163.stdout: "log_level": { 2023-07-14T18:29:19.638 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "log_level", 2023-07-14T18:29:19.638 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "str", 2023-07-14T18:29:19.638 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:19.638 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:19.639 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "", 2023-07-14T18:29:19.639 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:19.639 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:19.639 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [ 2023-07-14T18:29:19.640 INFO:teuthology.orchestra.run.smithi163.stdout: "", 2023-07-14T18:29:19.640 INFO:teuthology.orchestra.run.smithi163.stdout: "critical", 2023-07-14T18:29:19.640 INFO:teuthology.orchestra.run.smithi163.stdout: "debug", 2023-07-14T18:29:19.640 INFO:teuthology.orchestra.run.smithi163.stdout: "error", 2023-07-14T18:29:19.640 INFO:teuthology.orchestra.run.smithi163.stdout: "info", 2023-07-14T18:29:19.640 INFO:teuthology.orchestra.run.smithi163.stdout: "warning" 2023-07-14T18:29:19.641 INFO:teuthology.orchestra.run.smithi163.stdout: ], 2023-07-14T18:29:19.641 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:19.641 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:19.641 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:19.642 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:19.642 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:19.642 INFO:teuthology.orchestra.run.smithi163.stdout: "log_to_cluster": { 2023-07-14T18:29:19.642 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "log_to_cluster", 2023-07-14T18:29:19.642 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "bool", 2023-07-14T18:29:19.642 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:19.643 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:19.643 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "False", 2023-07-14T18:29:19.643 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:19.643 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:19.643 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:19.644 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:19.644 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:19.644 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:19.644 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:19.644 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:19.645 INFO:teuthology.orchestra.run.smithi163.stdout: "log_to_cluster_level": { 2023-07-14T18:29:19.645 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "log_to_cluster_level", 2023-07-14T18:29:19.645 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "str", 2023-07-14T18:29:19.645 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:19.645 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:19.646 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "info", 2023-07-14T18:29:19.646 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:19.646 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:19.646 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [ 2023-07-14T18:29:19.646 INFO:teuthology.orchestra.run.smithi163.stdout: "", 2023-07-14T18:29:19.647 INFO:teuthology.orchestra.run.smithi163.stdout: "critical", 2023-07-14T18:29:19.647 INFO:teuthology.orchestra.run.smithi163.stdout: "debug", 2023-07-14T18:29:19.647 INFO:teuthology.orchestra.run.smithi163.stdout: "error", 2023-07-14T18:29:19.647 INFO:teuthology.orchestra.run.smithi163.stdout: "info", 2023-07-14T18:29:19.647 INFO:teuthology.orchestra.run.smithi163.stdout: "warning" 2023-07-14T18:29:19.647 INFO:teuthology.orchestra.run.smithi163.stdout: ], 2023-07-14T18:29:19.648 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:19.648 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:19.648 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:19.648 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:19.649 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:19.649 INFO:teuthology.orchestra.run.smithi163.stdout: "log_to_file": { 2023-07-14T18:29:19.649 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "log_to_file", 2023-07-14T18:29:19.649 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "bool", 2023-07-14T18:29:19.649 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:19.649 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:19.650 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "False", 2023-07-14T18:29:19.650 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:19.650 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:19.650 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:19.650 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:19.651 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:19.651 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:19.651 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:19.651 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-07-14T18:29:19.651 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-07-14T18:29:19.652 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:19.652 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-07-14T18:29:19.652 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "mirroring", 2023-07-14T18:29:19.652 INFO:teuthology.orchestra.run.smithi163.stdout: "can_run": true, 2023-07-14T18:29:19.652 INFO:teuthology.orchestra.run.smithi163.stdout: "error_string": "", 2023-07-14T18:29:19.653 INFO:teuthology.orchestra.run.smithi163.stdout: "module_options": { 2023-07-14T18:29:19.653 INFO:teuthology.orchestra.run.smithi163.stdout: "log_level": { 2023-07-14T18:29:19.653 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "log_level", 2023-07-14T18:29:19.653 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "str", 2023-07-14T18:29:19.653 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:19.654 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:19.654 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "", 2023-07-14T18:29:19.654 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:19.654 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:19.654 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [ 2023-07-14T18:29:19.655 INFO:teuthology.orchestra.run.smithi163.stdout: "", 2023-07-14T18:29:19.655 INFO:teuthology.orchestra.run.smithi163.stdout: "critical", 2023-07-14T18:29:19.655 INFO:teuthology.orchestra.run.smithi163.stdout: "debug", 2023-07-14T18:29:19.655 INFO:teuthology.orchestra.run.smithi163.stdout: "error", 2023-07-14T18:29:19.655 INFO:teuthology.orchestra.run.smithi163.stdout: "info", 2023-07-14T18:29:19.655 INFO:teuthology.orchestra.run.smithi163.stdout: "warning" 2023-07-14T18:29:19.656 INFO:teuthology.orchestra.run.smithi163.stdout: ], 2023-07-14T18:29:19.656 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:19.656 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:19.656 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:19.656 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:19.657 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:19.657 INFO:teuthology.orchestra.run.smithi163.stdout: "log_to_cluster": { 2023-07-14T18:29:19.657 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "log_to_cluster", 2023-07-14T18:29:19.657 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "bool", 2023-07-14T18:29:19.657 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:19.658 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:19.658 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "False", 2023-07-14T18:29:19.658 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:19.658 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:19.658 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:19.659 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:19.659 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:19.659 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:19.659 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:19.659 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:19.660 INFO:teuthology.orchestra.run.smithi163.stdout: "log_to_cluster_level": { 2023-07-14T18:29:19.660 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "log_to_cluster_level", 2023-07-14T18:29:19.660 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "str", 2023-07-14T18:29:19.660 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:19.660 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:19.661 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "info", 2023-07-14T18:29:19.661 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:19.661 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:19.661 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [ 2023-07-14T18:29:19.661 INFO:teuthology.orchestra.run.smithi163.stdout: "", 2023-07-14T18:29:19.662 INFO:teuthology.orchestra.run.smithi163.stdout: "critical", 2023-07-14T18:29:19.662 INFO:teuthology.orchestra.run.smithi163.stdout: "debug", 2023-07-14T18:29:19.662 INFO:teuthology.orchestra.run.smithi163.stdout: "error", 2023-07-14T18:29:19.662 INFO:teuthology.orchestra.run.smithi163.stdout: "info", 2023-07-14T18:29:19.662 INFO:teuthology.orchestra.run.smithi163.stdout: "warning" 2023-07-14T18:29:19.663 INFO:teuthology.orchestra.run.smithi163.stdout: ], 2023-07-14T18:29:19.663 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:19.663 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:19.663 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:19.663 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:19.664 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:19.664 INFO:teuthology.orchestra.run.smithi163.stdout: "log_to_file": { 2023-07-14T18:29:19.664 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "log_to_file", 2023-07-14T18:29:19.664 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "bool", 2023-07-14T18:29:19.664 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:19.665 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:19.665 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "False", 2023-07-14T18:29:19.665 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:19.665 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:19.665 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:19.665 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:19.666 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:19.666 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:19.666 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:19.666 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-07-14T18:29:19.666 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-07-14T18:29:19.667 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:19.667 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-07-14T18:29:19.667 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "nfs", 2023-07-14T18:29:19.667 INFO:teuthology.orchestra.run.smithi163.stdout: "can_run": true, 2023-07-14T18:29:19.667 INFO:teuthology.orchestra.run.smithi163.stdout: "error_string": "", 2023-07-14T18:29:19.668 INFO:teuthology.orchestra.run.smithi163.stdout: "module_options": { 2023-07-14T18:29:19.668 INFO:teuthology.orchestra.run.smithi163.stdout: "log_level": { 2023-07-14T18:29:19.668 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "log_level", 2023-07-14T18:29:19.668 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "str", 2023-07-14T18:29:19.668 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:19.669 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:19.669 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "", 2023-07-14T18:29:19.669 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:19.669 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:19.669 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [ 2023-07-14T18:29:19.670 INFO:teuthology.orchestra.run.smithi163.stdout: "", 2023-07-14T18:29:19.670 INFO:teuthology.orchestra.run.smithi163.stdout: "critical", 2023-07-14T18:29:19.670 INFO:teuthology.orchestra.run.smithi163.stdout: "debug", 2023-07-14T18:29:19.670 INFO:teuthology.orchestra.run.smithi163.stdout: "error", 2023-07-14T18:29:19.670 INFO:teuthology.orchestra.run.smithi163.stdout: "info", 2023-07-14T18:29:19.671 INFO:teuthology.orchestra.run.smithi163.stdout: "warning" 2023-07-14T18:29:19.671 INFO:teuthology.orchestra.run.smithi163.stdout: ], 2023-07-14T18:29:19.671 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:19.671 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:19.671 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:19.672 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:19.672 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:19.672 INFO:teuthology.orchestra.run.smithi163.stdout: "log_to_cluster": { 2023-07-14T18:29:19.672 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "log_to_cluster", 2023-07-14T18:29:19.672 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "bool", 2023-07-14T18:29:19.673 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:19.673 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:19.673 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "False", 2023-07-14T18:29:19.673 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:19.673 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:19.674 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:19.674 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:19.674 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:19.674 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:19.674 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:19.675 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:19.675 INFO:teuthology.orchestra.run.smithi163.stdout: "log_to_cluster_level": { 2023-07-14T18:29:19.675 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "log_to_cluster_level", 2023-07-14T18:29:19.675 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "str", 2023-07-14T18:29:19.675 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:19.676 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:19.676 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "info", 2023-07-14T18:29:19.676 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:19.676 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:19.676 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [ 2023-07-14T18:29:19.676 INFO:teuthology.orchestra.run.smithi163.stdout: "", 2023-07-14T18:29:19.677 INFO:teuthology.orchestra.run.smithi163.stdout: "critical", 2023-07-14T18:29:19.677 INFO:teuthology.orchestra.run.smithi163.stdout: "debug", 2023-07-14T18:29:19.677 INFO:teuthology.orchestra.run.smithi163.stdout: "error", 2023-07-14T18:29:19.677 INFO:teuthology.orchestra.run.smithi163.stdout: "info", 2023-07-14T18:29:19.677 INFO:teuthology.orchestra.run.smithi163.stdout: "warning" 2023-07-14T18:29:19.678 INFO:teuthology.orchestra.run.smithi163.stdout: ], 2023-07-14T18:29:19.678 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:19.678 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:19.678 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:19.678 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:19.679 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:19.679 INFO:teuthology.orchestra.run.smithi163.stdout: "log_to_file": { 2023-07-14T18:29:19.679 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "log_to_file", 2023-07-14T18:29:19.679 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "bool", 2023-07-14T18:29:19.679 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:19.680 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:19.680 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "False", 2023-07-14T18:29:19.680 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:19.680 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:19.680 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:19.681 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:19.681 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:19.681 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:19.681 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:19.681 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-07-14T18:29:19.682 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-07-14T18:29:19.682 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:19.682 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-07-14T18:29:19.682 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "orchestrator", 2023-07-14T18:29:19.682 INFO:teuthology.orchestra.run.smithi163.stdout: "can_run": true, 2023-07-14T18:29:19.683 INFO:teuthology.orchestra.run.smithi163.stdout: "error_string": "", 2023-07-14T18:29:19.683 INFO:teuthology.orchestra.run.smithi163.stdout: "module_options": { 2023-07-14T18:29:19.683 INFO:teuthology.orchestra.run.smithi163.stdout: "fail_fs": { 2023-07-14T18:29:19.683 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "fail_fs", 2023-07-14T18:29:19.683 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "bool", 2023-07-14T18:29:19.683 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:19.684 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:19.684 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "False", 2023-07-14T18:29:19.684 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:19.684 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:19.684 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:19.685 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2023-07-14T18:29:19.685 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:19.685 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:19.685 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:19.685 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:19.686 INFO:teuthology.orchestra.run.smithi163.stdout: "log_level": { 2023-07-14T18:29:19.686 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "log_level", 2023-07-14T18:29:19.686 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "str", 2023-07-14T18:29:19.686 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:19.686 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:19.687 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "", 2023-07-14T18:29:19.687 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:19.687 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:19.687 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [ 2023-07-14T18:29:19.687 INFO:teuthology.orchestra.run.smithi163.stdout: "", 2023-07-14T18:29:19.687 INFO:teuthology.orchestra.run.smithi163.stdout: "critical", 2023-07-14T18:29:19.688 INFO:teuthology.orchestra.run.smithi163.stdout: "debug", 2023-07-14T18:29:19.688 INFO:teuthology.orchestra.run.smithi163.stdout: "error", 2023-07-14T18:29:19.688 INFO:teuthology.orchestra.run.smithi163.stdout: "info", 2023-07-14T18:29:19.688 INFO:teuthology.orchestra.run.smithi163.stdout: "warning" 2023-07-14T18:29:19.689 INFO:teuthology.orchestra.run.smithi163.stdout: ], 2023-07-14T18:29:19.689 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:19.689 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:19.689 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:19.689 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:19.689 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:19.690 INFO:teuthology.orchestra.run.smithi163.stdout: "log_to_cluster": { 2023-07-14T18:29:19.690 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "log_to_cluster", 2023-07-14T18:29:19.690 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "bool", 2023-07-14T18:29:19.690 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:19.690 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:19.691 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "False", 2023-07-14T18:29:19.691 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:19.691 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:19.691 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:19.691 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:19.692 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:19.692 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:19.692 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:19.692 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:19.692 INFO:teuthology.orchestra.run.smithi163.stdout: "log_to_cluster_level": { 2023-07-14T18:29:19.693 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "log_to_cluster_level", 2023-07-14T18:29:19.693 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "str", 2023-07-14T18:29:19.693 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:19.693 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:19.693 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "info", 2023-07-14T18:29:19.694 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:19.694 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:19.694 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [ 2023-07-14T18:29:19.694 INFO:teuthology.orchestra.run.smithi163.stdout: "", 2023-07-14T18:29:19.694 INFO:teuthology.orchestra.run.smithi163.stdout: "critical", 2023-07-14T18:29:19.695 INFO:teuthology.orchestra.run.smithi163.stdout: "debug", 2023-07-14T18:29:19.695 INFO:teuthology.orchestra.run.smithi163.stdout: "error", 2023-07-14T18:29:19.695 INFO:teuthology.orchestra.run.smithi163.stdout: "info", 2023-07-14T18:29:19.695 INFO:teuthology.orchestra.run.smithi163.stdout: "warning" 2023-07-14T18:29:19.695 INFO:teuthology.orchestra.run.smithi163.stdout: ], 2023-07-14T18:29:19.696 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:19.696 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:19.696 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:19.696 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:19.696 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:19.697 INFO:teuthology.orchestra.run.smithi163.stdout: "log_to_file": { 2023-07-14T18:29:19.697 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "log_to_file", 2023-07-14T18:29:19.697 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "bool", 2023-07-14T18:29:19.697 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:19.697 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:19.698 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "False", 2023-07-14T18:29:19.698 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:19.698 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:19.698 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:19.698 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:19.699 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:19.699 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:19.699 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:19.699 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:19.699 INFO:teuthology.orchestra.run.smithi163.stdout: "orchestrator": { 2023-07-14T18:29:19.700 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "orchestrator", 2023-07-14T18:29:19.700 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "str", 2023-07-14T18:29:19.700 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:19.700 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:19.700 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "", 2023-07-14T18:29:19.701 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:19.701 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:19.701 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [ 2023-07-14T18:29:19.701 INFO:teuthology.orchestra.run.smithi163.stdout: "cephadm", 2023-07-14T18:29:19.701 INFO:teuthology.orchestra.run.smithi163.stdout: "rook", 2023-07-14T18:29:19.702 INFO:teuthology.orchestra.run.smithi163.stdout: "test_orchestrator" 2023-07-14T18:29:19.702 INFO:teuthology.orchestra.run.smithi163.stdout: ], 2023-07-14T18:29:19.702 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "Orchestrator backend", 2023-07-14T18:29:19.702 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:19.702 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:19.703 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:19.703 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-07-14T18:29:19.703 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-07-14T18:29:19.703 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:19.703 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-07-14T18:29:19.704 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "osd_perf_query", 2023-07-14T18:29:19.704 INFO:teuthology.orchestra.run.smithi163.stdout: "can_run": true, 2023-07-14T18:29:19.704 INFO:teuthology.orchestra.run.smithi163.stdout: "error_string": "", 2023-07-14T18:29:19.704 INFO:teuthology.orchestra.run.smithi163.stdout: "module_options": { 2023-07-14T18:29:19.704 INFO:teuthology.orchestra.run.smithi163.stdout: "log_level": { 2023-07-14T18:29:19.705 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "log_level", 2023-07-14T18:29:19.705 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "str", 2023-07-14T18:29:19.705 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:19.705 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:19.705 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "", 2023-07-14T18:29:19.705 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:19.706 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:19.706 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [ 2023-07-14T18:29:19.706 INFO:teuthology.orchestra.run.smithi163.stdout: "", 2023-07-14T18:29:19.706 INFO:teuthology.orchestra.run.smithi163.stdout: "critical", 2023-07-14T18:29:19.706 INFO:teuthology.orchestra.run.smithi163.stdout: "debug", 2023-07-14T18:29:19.707 INFO:teuthology.orchestra.run.smithi163.stdout: "error", 2023-07-14T18:29:19.707 INFO:teuthology.orchestra.run.smithi163.stdout: "info", 2023-07-14T18:29:19.707 INFO:teuthology.orchestra.run.smithi163.stdout: "warning" 2023-07-14T18:29:19.707 INFO:teuthology.orchestra.run.smithi163.stdout: ], 2023-07-14T18:29:19.707 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:19.708 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:19.708 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:19.708 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:19.708 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:19.708 INFO:teuthology.orchestra.run.smithi163.stdout: "log_to_cluster": { 2023-07-14T18:29:19.708 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "log_to_cluster", 2023-07-14T18:29:19.709 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "bool", 2023-07-14T18:29:19.709 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:19.709 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:19.709 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "False", 2023-07-14T18:29:19.709 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:19.710 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:19.710 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:19.710 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:19.710 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:19.710 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:19.711 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:19.711 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:19.711 INFO:teuthology.orchestra.run.smithi163.stdout: "log_to_cluster_level": { 2023-07-14T18:29:19.711 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "log_to_cluster_level", 2023-07-14T18:29:19.711 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "str", 2023-07-14T18:29:19.712 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:19.712 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:19.712 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "info", 2023-07-14T18:29:19.712 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:19.712 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:19.713 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [ 2023-07-14T18:29:19.713 INFO:teuthology.orchestra.run.smithi163.stdout: "", 2023-07-14T18:29:19.713 INFO:teuthology.orchestra.run.smithi163.stdout: "critical", 2023-07-14T18:29:19.713 INFO:teuthology.orchestra.run.smithi163.stdout: "debug", 2023-07-14T18:29:19.713 INFO:teuthology.orchestra.run.smithi163.stdout: "error", 2023-07-14T18:29:19.714 INFO:teuthology.orchestra.run.smithi163.stdout: "info", 2023-07-14T18:29:19.714 INFO:teuthology.orchestra.run.smithi163.stdout: "warning" 2023-07-14T18:29:19.714 INFO:teuthology.orchestra.run.smithi163.stdout: ], 2023-07-14T18:29:19.714 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:19.714 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:19.715 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:19.715 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:19.715 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:19.715 INFO:teuthology.orchestra.run.smithi163.stdout: "log_to_file": { 2023-07-14T18:29:19.715 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "log_to_file", 2023-07-14T18:29:19.715 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "bool", 2023-07-14T18:29:19.716 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:19.716 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:19.716 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "False", 2023-07-14T18:29:19.716 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:19.716 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:19.717 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:19.717 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:19.717 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:19.717 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:19.717 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:19.718 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-07-14T18:29:19.718 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-07-14T18:29:19.718 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:19.718 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-07-14T18:29:19.718 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "osd_support", 2023-07-14T18:29:19.719 INFO:teuthology.orchestra.run.smithi163.stdout: "can_run": true, 2023-07-14T18:29:19.719 INFO:teuthology.orchestra.run.smithi163.stdout: "error_string": "", 2023-07-14T18:29:19.719 INFO:teuthology.orchestra.run.smithi163.stdout: "module_options": { 2023-07-14T18:29:19.719 INFO:teuthology.orchestra.run.smithi163.stdout: "log_level": { 2023-07-14T18:29:19.719 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "log_level", 2023-07-14T18:29:19.720 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "str", 2023-07-14T18:29:19.720 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:19.720 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:19.720 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "", 2023-07-14T18:29:19.720 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:19.721 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:19.721 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [ 2023-07-14T18:29:19.721 INFO:teuthology.orchestra.run.smithi163.stdout: "", 2023-07-14T18:29:19.721 INFO:teuthology.orchestra.run.smithi163.stdout: "critical", 2023-07-14T18:29:19.721 INFO:teuthology.orchestra.run.smithi163.stdout: "debug", 2023-07-14T18:29:19.722 INFO:teuthology.orchestra.run.smithi163.stdout: "error", 2023-07-14T18:29:19.722 INFO:teuthology.orchestra.run.smithi163.stdout: "info", 2023-07-14T18:29:19.722 INFO:teuthology.orchestra.run.smithi163.stdout: "warning" 2023-07-14T18:29:19.722 INFO:teuthology.orchestra.run.smithi163.stdout: ], 2023-07-14T18:29:19.722 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:19.723 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:19.723 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:19.723 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:19.723 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:19.723 INFO:teuthology.orchestra.run.smithi163.stdout: "log_to_cluster": { 2023-07-14T18:29:19.723 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "log_to_cluster", 2023-07-14T18:29:19.724 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "bool", 2023-07-14T18:29:19.724 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:19.724 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:19.724 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "False", 2023-07-14T18:29:19.724 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:19.725 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:19.725 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:19.725 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:19.725 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:19.725 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:19.726 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:19.726 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:19.726 INFO:teuthology.orchestra.run.smithi163.stdout: "log_to_cluster_level": { 2023-07-14T18:29:19.726 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "log_to_cluster_level", 2023-07-14T18:29:19.726 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "str", 2023-07-14T18:29:19.727 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:19.727 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:19.727 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "info", 2023-07-14T18:29:19.727 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:19.727 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:19.728 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [ 2023-07-14T18:29:19.728 INFO:teuthology.orchestra.run.smithi163.stdout: "", 2023-07-14T18:29:19.728 INFO:teuthology.orchestra.run.smithi163.stdout: "critical", 2023-07-14T18:29:19.728 INFO:teuthology.orchestra.run.smithi163.stdout: "debug", 2023-07-14T18:29:19.728 INFO:teuthology.orchestra.run.smithi163.stdout: "error", 2023-07-14T18:29:19.729 INFO:teuthology.orchestra.run.smithi163.stdout: "info", 2023-07-14T18:29:19.729 INFO:teuthology.orchestra.run.smithi163.stdout: "warning" 2023-07-14T18:29:19.729 INFO:teuthology.orchestra.run.smithi163.stdout: ], 2023-07-14T18:29:19.729 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:19.729 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:19.730 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:19.730 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:19.730 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:19.730 INFO:teuthology.orchestra.run.smithi163.stdout: "log_to_file": { 2023-07-14T18:29:19.730 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "log_to_file", 2023-07-14T18:29:19.731 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "bool", 2023-07-14T18:29:19.731 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:19.731 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:19.731 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "False", 2023-07-14T18:29:19.731 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:19.732 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:19.732 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:19.732 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:19.732 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:19.732 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:19.733 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:19.733 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-07-14T18:29:19.733 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-07-14T18:29:19.733 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:19.733 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-07-14T18:29:19.733 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "pg_autoscaler", 2023-07-14T18:29:19.734 INFO:teuthology.orchestra.run.smithi163.stdout: "can_run": true, 2023-07-14T18:29:19.734 INFO:teuthology.orchestra.run.smithi163.stdout: "error_string": "", 2023-07-14T18:29:19.734 INFO:teuthology.orchestra.run.smithi163.stdout: "module_options": { 2023-07-14T18:29:19.734 INFO:teuthology.orchestra.run.smithi163.stdout: "log_level": { 2023-07-14T18:29:19.734 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "log_level", 2023-07-14T18:29:19.735 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "str", 2023-07-14T18:29:19.735 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:19.735 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:19.735 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "", 2023-07-14T18:29:19.735 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:19.736 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:19.736 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [ 2023-07-14T18:29:19.736 INFO:teuthology.orchestra.run.smithi163.stdout: "", 2023-07-14T18:29:19.736 INFO:teuthology.orchestra.run.smithi163.stdout: "critical", 2023-07-14T18:29:19.736 INFO:teuthology.orchestra.run.smithi163.stdout: "debug", 2023-07-14T18:29:19.737 INFO:teuthology.orchestra.run.smithi163.stdout: "error", 2023-07-14T18:29:19.737 INFO:teuthology.orchestra.run.smithi163.stdout: "info", 2023-07-14T18:29:19.737 INFO:teuthology.orchestra.run.smithi163.stdout: "warning" 2023-07-14T18:29:19.737 INFO:teuthology.orchestra.run.smithi163.stdout: ], 2023-07-14T18:29:19.737 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:19.738 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:19.738 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:19.738 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:19.738 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:19.738 INFO:teuthology.orchestra.run.smithi163.stdout: "log_to_cluster": { 2023-07-14T18:29:19.739 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "log_to_cluster", 2023-07-14T18:29:19.739 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "bool", 2023-07-14T18:29:19.739 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:19.739 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:19.739 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "False", 2023-07-14T18:29:19.740 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:19.740 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:19.740 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:19.740 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:19.740 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:19.741 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:19.741 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:19.741 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:19.741 INFO:teuthology.orchestra.run.smithi163.stdout: "log_to_cluster_level": { 2023-07-14T18:29:19.741 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "log_to_cluster_level", 2023-07-14T18:29:19.742 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "str", 2023-07-14T18:29:19.742 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:19.742 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:19.742 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "info", 2023-07-14T18:29:19.742 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:19.743 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:19.743 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [ 2023-07-14T18:29:19.743 INFO:teuthology.orchestra.run.smithi163.stdout: "", 2023-07-14T18:29:19.743 INFO:teuthology.orchestra.run.smithi163.stdout: "critical", 2023-07-14T18:29:19.743 INFO:teuthology.orchestra.run.smithi163.stdout: "debug", 2023-07-14T18:29:19.744 INFO:teuthology.orchestra.run.smithi163.stdout: "error", 2023-07-14T18:29:19.744 INFO:teuthology.orchestra.run.smithi163.stdout: "info", 2023-07-14T18:29:19.744 INFO:teuthology.orchestra.run.smithi163.stdout: "warning" 2023-07-14T18:29:19.744 INFO:teuthology.orchestra.run.smithi163.stdout: ], 2023-07-14T18:29:19.744 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:19.745 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:19.745 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:19.745 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:19.745 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:19.745 INFO:teuthology.orchestra.run.smithi163.stdout: "log_to_file": { 2023-07-14T18:29:19.746 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "log_to_file", 2023-07-14T18:29:19.746 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "bool", 2023-07-14T18:29:19.746 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:19.746 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:19.746 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "False", 2023-07-14T18:29:19.746 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:19.747 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:19.747 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:19.747 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:19.747 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:19.747 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:19.748 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:19.748 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:19.748 INFO:teuthology.orchestra.run.smithi163.stdout: "noautoscale": { 2023-07-14T18:29:19.748 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "noautoscale", 2023-07-14T18:29:19.748 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "bool", 2023-07-14T18:29:19.749 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:19.749 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:19.749 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "False", 2023-07-14T18:29:19.749 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:19.749 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:19.750 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:19.750 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "global autoscale flag", 2023-07-14T18:29:19.750 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "Option to turn on/off the autoscaler for all pools", 2023-07-14T18:29:19.750 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:19.750 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:19.751 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:19.751 INFO:teuthology.orchestra.run.smithi163.stdout: "sleep_interval": { 2023-07-14T18:29:19.751 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "sleep_interval", 2023-07-14T18:29:19.751 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "secs", 2023-07-14T18:29:19.751 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:19.752 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:19.752 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "60", 2023-07-14T18:29:19.752 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:19.752 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:19.752 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:19.753 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:19.753 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:19.753 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:19.753 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:19.753 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:19.753 INFO:teuthology.orchestra.run.smithi163.stdout: "threshold": { 2023-07-14T18:29:19.754 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "threshold", 2023-07-14T18:29:19.754 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "float", 2023-07-14T18:29:19.754 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:19.754 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:19.754 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "3.0", 2023-07-14T18:29:19.755 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "1.0", 2023-07-14T18:29:19.755 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:19.755 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:19.755 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "scaling threshold", 2023-07-14T18:29:19.755 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2023-07-14T18:29:19.756 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:19.756 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:19.756 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-07-14T18:29:19.756 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-07-14T18:29:19.756 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:19.757 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-07-14T18:29:19.757 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "progress", 2023-07-14T18:29:19.757 INFO:teuthology.orchestra.run.smithi163.stdout: "can_run": true, 2023-07-14T18:29:19.757 INFO:teuthology.orchestra.run.smithi163.stdout: "error_string": "", 2023-07-14T18:29:19.757 INFO:teuthology.orchestra.run.smithi163.stdout: "module_options": { 2023-07-14T18:29:19.758 INFO:teuthology.orchestra.run.smithi163.stdout: "allow_pg_recovery_event": { 2023-07-14T18:29:19.758 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "allow_pg_recovery_event", 2023-07-14T18:29:19.758 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "bool", 2023-07-14T18:29:19.758 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:19.758 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:19.759 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "False", 2023-07-14T18:29:19.759 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:19.759 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:19.759 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:19.759 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "allow the module to show pg recovery progress", 2023-07-14T18:29:19.759 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:19.760 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:19.760 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:19.760 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:19.760 INFO:teuthology.orchestra.run.smithi163.stdout: "enabled": { 2023-07-14T18:29:19.760 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "enabled", 2023-07-14T18:29:19.761 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "bool", 2023-07-14T18:29:19.761 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:19.761 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:19.761 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "True", 2023-07-14T18:29:19.761 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:19.762 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:19.762 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:19.762 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:19.762 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:19.762 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:19.763 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:19.763 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:19.763 INFO:teuthology.orchestra.run.smithi163.stdout: "log_level": { 2023-07-14T18:29:19.763 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "log_level", 2023-07-14T18:29:19.763 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "str", 2023-07-14T18:29:19.764 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:19.764 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:19.764 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "", 2023-07-14T18:29:19.764 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:19.764 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:19.765 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [ 2023-07-14T18:29:19.765 INFO:teuthology.orchestra.run.smithi163.stdout: "", 2023-07-14T18:29:19.765 INFO:teuthology.orchestra.run.smithi163.stdout: "critical", 2023-07-14T18:29:19.765 INFO:teuthology.orchestra.run.smithi163.stdout: "debug", 2023-07-14T18:29:19.765 INFO:teuthology.orchestra.run.smithi163.stdout: "error", 2023-07-14T18:29:19.766 INFO:teuthology.orchestra.run.smithi163.stdout: "info", 2023-07-14T18:29:19.766 INFO:teuthology.orchestra.run.smithi163.stdout: "warning" 2023-07-14T18:29:19.766 INFO:teuthology.orchestra.run.smithi163.stdout: ], 2023-07-14T18:29:19.766 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:19.766 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:19.767 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:19.767 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:19.767 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:19.767 INFO:teuthology.orchestra.run.smithi163.stdout: "log_to_cluster": { 2023-07-14T18:29:19.767 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "log_to_cluster", 2023-07-14T18:29:19.768 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "bool", 2023-07-14T18:29:19.768 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:19.768 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:19.768 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "False", 2023-07-14T18:29:19.768 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:19.769 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:19.769 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:19.769 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:19.769 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:19.769 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:19.770 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:19.770 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:19.770 INFO:teuthology.orchestra.run.smithi163.stdout: "log_to_cluster_level": { 2023-07-14T18:29:19.770 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "log_to_cluster_level", 2023-07-14T18:29:19.770 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "str", 2023-07-14T18:29:19.771 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:19.771 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:19.771 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "info", 2023-07-14T18:29:19.771 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:19.771 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:19.771 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [ 2023-07-14T18:29:19.772 INFO:teuthology.orchestra.run.smithi163.stdout: "", 2023-07-14T18:29:19.772 INFO:teuthology.orchestra.run.smithi163.stdout: "critical", 2023-07-14T18:29:19.772 INFO:teuthology.orchestra.run.smithi163.stdout: "debug", 2023-07-14T18:29:19.772 INFO:teuthology.orchestra.run.smithi163.stdout: "error", 2023-07-14T18:29:19.772 INFO:teuthology.orchestra.run.smithi163.stdout: "info", 2023-07-14T18:29:19.773 INFO:teuthology.orchestra.run.smithi163.stdout: "warning" 2023-07-14T18:29:19.773 INFO:teuthology.orchestra.run.smithi163.stdout: ], 2023-07-14T18:29:19.773 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:19.773 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:19.773 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:19.774 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:19.774 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:19.774 INFO:teuthology.orchestra.run.smithi163.stdout: "log_to_file": { 2023-07-14T18:29:19.774 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "log_to_file", 2023-07-14T18:29:19.774 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "bool", 2023-07-14T18:29:19.775 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:19.775 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:19.775 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "False", 2023-07-14T18:29:19.775 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:19.775 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:19.776 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:19.776 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:19.776 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:19.776 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:19.776 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:19.777 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:19.777 INFO:teuthology.orchestra.run.smithi163.stdout: "max_completed_events": { 2023-07-14T18:29:19.777 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "max_completed_events", 2023-07-14T18:29:19.777 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "int", 2023-07-14T18:29:19.777 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:19.778 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:19.778 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "50", 2023-07-14T18:29:19.778 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:19.778 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:19.778 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:19.779 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "number of past completed events to remember", 2023-07-14T18:29:19.779 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:19.779 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:19.779 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:19.779 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:19.780 INFO:teuthology.orchestra.run.smithi163.stdout: "sleep_interval": { 2023-07-14T18:29:19.780 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "sleep_interval", 2023-07-14T18:29:19.780 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "secs", 2023-07-14T18:29:19.780 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:19.780 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:19.781 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "5", 2023-07-14T18:29:19.781 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:19.781 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:19.781 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:19.781 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "how long the module is going to sleep", 2023-07-14T18:29:19.782 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:19.782 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:19.782 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:19.782 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-07-14T18:29:19.782 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-07-14T18:29:19.783 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:19.783 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-07-14T18:29:19.783 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "prometheus", 2023-07-14T18:29:19.783 INFO:teuthology.orchestra.run.smithi163.stdout: "can_run": true, 2023-07-14T18:29:19.783 INFO:teuthology.orchestra.run.smithi163.stdout: "error_string": "", 2023-07-14T18:29:19.784 INFO:teuthology.orchestra.run.smithi163.stdout: "module_options": { 2023-07-14T18:29:19.784 INFO:teuthology.orchestra.run.smithi163.stdout: "cache": { 2023-07-14T18:29:19.784 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "cache", 2023-07-14T18:29:19.784 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "bool", 2023-07-14T18:29:19.784 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:19.785 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:19.785 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "True", 2023-07-14T18:29:19.785 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:19.785 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:19.785 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:19.785 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:19.786 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:19.786 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:19.786 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:19.786 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:19.786 INFO:teuthology.orchestra.run.smithi163.stdout: "exclude_perf_counters": { 2023-07-14T18:29:19.787 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "exclude_perf_counters", 2023-07-14T18:29:19.787 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "bool", 2023-07-14T18:29:19.787 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:19.787 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:19.787 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "True", 2023-07-14T18:29:19.788 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:19.788 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:19.788 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:19.788 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "Do not include perf-counters in the metrics output", 2023-07-14T18:29:19.788 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2023-07-14T18:29:19.789 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:19.789 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:19.789 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:19.789 INFO:teuthology.orchestra.run.smithi163.stdout: "log_level": { 2023-07-14T18:29:19.789 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "log_level", 2023-07-14T18:29:19.790 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "str", 2023-07-14T18:29:19.790 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:19.790 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:19.790 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "", 2023-07-14T18:29:19.790 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:19.791 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:19.791 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [ 2023-07-14T18:29:19.791 INFO:teuthology.orchestra.run.smithi163.stdout: "", 2023-07-14T18:29:19.791 INFO:teuthology.orchestra.run.smithi163.stdout: "critical", 2023-07-14T18:29:19.791 INFO:teuthology.orchestra.run.smithi163.stdout: "debug", 2023-07-14T18:29:19.792 INFO:teuthology.orchestra.run.smithi163.stdout: "error", 2023-07-14T18:29:19.792 INFO:teuthology.orchestra.run.smithi163.stdout: "info", 2023-07-14T18:29:19.792 INFO:teuthology.orchestra.run.smithi163.stdout: "warning" 2023-07-14T18:29:19.792 INFO:teuthology.orchestra.run.smithi163.stdout: ], 2023-07-14T18:29:19.792 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:19.793 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:19.793 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:19.793 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:19.793 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:19.793 INFO:teuthology.orchestra.run.smithi163.stdout: "log_to_cluster": { 2023-07-14T18:29:19.794 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "log_to_cluster", 2023-07-14T18:29:19.794 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "bool", 2023-07-14T18:29:19.794 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:19.794 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:19.794 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "False", 2023-07-14T18:29:19.795 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:19.795 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:19.795 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:19.795 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:19.795 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:19.796 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:19.796 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:19.796 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:19.796 INFO:teuthology.orchestra.run.smithi163.stdout: "log_to_cluster_level": { 2023-07-14T18:29:19.796 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "log_to_cluster_level", 2023-07-14T18:29:19.797 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "str", 2023-07-14T18:29:19.797 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:19.797 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:19.797 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "info", 2023-07-14T18:29:19.797 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:19.798 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:19.798 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [ 2023-07-14T18:29:19.798 INFO:teuthology.orchestra.run.smithi163.stdout: "", 2023-07-14T18:29:19.798 INFO:teuthology.orchestra.run.smithi163.stdout: "critical", 2023-07-14T18:29:19.798 INFO:teuthology.orchestra.run.smithi163.stdout: "debug", 2023-07-14T18:29:19.799 INFO:teuthology.orchestra.run.smithi163.stdout: "error", 2023-07-14T18:29:19.799 INFO:teuthology.orchestra.run.smithi163.stdout: "info", 2023-07-14T18:29:19.799 INFO:teuthology.orchestra.run.smithi163.stdout: "warning" 2023-07-14T18:29:19.799 INFO:teuthology.orchestra.run.smithi163.stdout: ], 2023-07-14T18:29:19.799 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:19.800 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:19.800 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:19.800 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:19.800 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:19.800 INFO:teuthology.orchestra.run.smithi163.stdout: "log_to_file": { 2023-07-14T18:29:19.801 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "log_to_file", 2023-07-14T18:29:19.801 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "bool", 2023-07-14T18:29:19.801 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:19.801 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:19.801 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "False", 2023-07-14T18:29:19.802 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:19.802 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:19.802 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:19.802 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:19.802 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:19.802 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:19.803 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:19.803 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:19.803 INFO:teuthology.orchestra.run.smithi163.stdout: "rbd_stats_pools": { 2023-07-14T18:29:19.803 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "rbd_stats_pools", 2023-07-14T18:29:19.803 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "str", 2023-07-14T18:29:19.804 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:19.804 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:19.804 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "", 2023-07-14T18:29:19.804 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:19.805 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:19.805 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:19.805 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:19.805 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:19.805 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:19.805 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:19.806 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:19.806 INFO:teuthology.orchestra.run.smithi163.stdout: "rbd_stats_pools_refresh_interval": { 2023-07-14T18:29:19.806 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "rbd_stats_pools_refresh_interval", 2023-07-14T18:29:19.806 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "int", 2023-07-14T18:29:19.806 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:19.807 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:19.807 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "300", 2023-07-14T18:29:19.807 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:19.807 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:19.807 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:19.808 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:19.808 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:19.808 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:19.808 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:19.808 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:19.809 INFO:teuthology.orchestra.run.smithi163.stdout: "scrape_interval": { 2023-07-14T18:29:19.809 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "scrape_interval", 2023-07-14T18:29:19.809 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "float", 2023-07-14T18:29:19.809 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:19.809 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:19.810 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "15.0", 2023-07-14T18:29:19.810 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:19.810 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:19.810 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:19.810 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:19.811 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:19.811 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:19.811 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:19.811 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:19.811 INFO:teuthology.orchestra.run.smithi163.stdout: "server_addr": { 2023-07-14T18:29:19.812 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "server_addr", 2023-07-14T18:29:19.812 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "str", 2023-07-14T18:29:19.812 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:19.812 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:19.812 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "::", 2023-07-14T18:29:19.813 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:19.813 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:19.813 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:19.813 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2023-07-14T18:29:19.813 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:19.814 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:19.814 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:19.814 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:19.814 INFO:teuthology.orchestra.run.smithi163.stdout: "server_port": { 2023-07-14T18:29:19.814 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "server_port", 2023-07-14T18:29:19.814 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "int", 2023-07-14T18:29:19.815 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:19.815 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:19.815 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "9283", 2023-07-14T18:29:19.815 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:19.815 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:19.816 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:19.816 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "the port on which the module listens for HTTP requests", 2023-07-14T18:29:19.816 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:19.816 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:19.816 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:19.817 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:19.817 INFO:teuthology.orchestra.run.smithi163.stdout: "stale_cache_strategy": { 2023-07-14T18:29:19.817 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "stale_cache_strategy", 2023-07-14T18:29:19.817 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "str", 2023-07-14T18:29:19.817 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:19.818 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:19.818 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "log", 2023-07-14T18:29:19.818 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:19.818 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:19.818 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:19.819 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:19.819 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:19.819 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:19.819 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:19.819 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:19.820 INFO:teuthology.orchestra.run.smithi163.stdout: "standby_behaviour": { 2023-07-14T18:29:19.820 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "standby_behaviour", 2023-07-14T18:29:19.820 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "str", 2023-07-14T18:29:19.820 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:19.820 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:19.821 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "default", 2023-07-14T18:29:19.821 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:19.821 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:19.821 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [ 2023-07-14T18:29:19.821 INFO:teuthology.orchestra.run.smithi163.stdout: "default", 2023-07-14T18:29:19.821 INFO:teuthology.orchestra.run.smithi163.stdout: "error" 2023-07-14T18:29:19.822 INFO:teuthology.orchestra.run.smithi163.stdout: ], 2023-07-14T18:29:19.822 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:19.822 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:19.822 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:19.822 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:19.823 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:19.823 INFO:teuthology.orchestra.run.smithi163.stdout: "standby_error_status_code": { 2023-07-14T18:29:19.823 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "standby_error_status_code", 2023-07-14T18:29:19.823 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "int", 2023-07-14T18:29:19.823 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:19.824 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:19.824 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "500", 2023-07-14T18:29:19.824 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "400", 2023-07-14T18:29:19.824 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "599", 2023-07-14T18:29:19.824 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:19.825 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:19.825 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:19.825 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:19.825 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:19.825 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-07-14T18:29:19.826 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-07-14T18:29:19.826 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:19.826 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-07-14T18:29:19.826 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "rbd_support", 2023-07-14T18:29:19.826 INFO:teuthology.orchestra.run.smithi163.stdout: "can_run": true, 2023-07-14T18:29:19.826 INFO:teuthology.orchestra.run.smithi163.stdout: "error_string": "", 2023-07-14T18:29:19.827 INFO:teuthology.orchestra.run.smithi163.stdout: "module_options": { 2023-07-14T18:29:19.827 INFO:teuthology.orchestra.run.smithi163.stdout: "log_level": { 2023-07-14T18:29:19.827 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "log_level", 2023-07-14T18:29:19.827 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "str", 2023-07-14T18:29:19.827 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:19.828 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:19.828 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "", 2023-07-14T18:29:19.828 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:19.828 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:19.828 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [ 2023-07-14T18:29:19.829 INFO:teuthology.orchestra.run.smithi163.stdout: "", 2023-07-14T18:29:19.829 INFO:teuthology.orchestra.run.smithi163.stdout: "critical", 2023-07-14T18:29:19.829 INFO:teuthology.orchestra.run.smithi163.stdout: "debug", 2023-07-14T18:29:19.829 INFO:teuthology.orchestra.run.smithi163.stdout: "error", 2023-07-14T18:29:19.829 INFO:teuthology.orchestra.run.smithi163.stdout: "info", 2023-07-14T18:29:19.830 INFO:teuthology.orchestra.run.smithi163.stdout: "warning" 2023-07-14T18:29:19.830 INFO:teuthology.orchestra.run.smithi163.stdout: ], 2023-07-14T18:29:19.830 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:19.830 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:19.830 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:19.831 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:19.831 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:19.831 INFO:teuthology.orchestra.run.smithi163.stdout: "log_to_cluster": { 2023-07-14T18:29:19.831 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "log_to_cluster", 2023-07-14T18:29:19.831 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "bool", 2023-07-14T18:29:19.832 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:19.832 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:19.832 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "False", 2023-07-14T18:29:19.832 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:19.832 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:19.833 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:19.833 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:19.833 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:19.833 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:19.833 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:19.834 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:19.834 INFO:teuthology.orchestra.run.smithi163.stdout: "log_to_cluster_level": { 2023-07-14T18:29:19.834 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "log_to_cluster_level", 2023-07-14T18:29:19.834 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "str", 2023-07-14T18:29:19.834 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:19.834 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:19.835 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "info", 2023-07-14T18:29:19.835 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:19.835 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:19.835 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [ 2023-07-14T18:29:19.835 INFO:teuthology.orchestra.run.smithi163.stdout: "", 2023-07-14T18:29:19.836 INFO:teuthology.orchestra.run.smithi163.stdout: "critical", 2023-07-14T18:29:19.836 INFO:teuthology.orchestra.run.smithi163.stdout: "debug", 2023-07-14T18:29:19.836 INFO:teuthology.orchestra.run.smithi163.stdout: "error", 2023-07-14T18:29:19.836 INFO:teuthology.orchestra.run.smithi163.stdout: "info", 2023-07-14T18:29:19.837 INFO:teuthology.orchestra.run.smithi163.stdout: "warning" 2023-07-14T18:29:19.837 INFO:teuthology.orchestra.run.smithi163.stdout: ], 2023-07-14T18:29:19.837 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:19.837 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:19.837 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:19.837 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:19.838 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:19.838 INFO:teuthology.orchestra.run.smithi163.stdout: "log_to_file": { 2023-07-14T18:29:19.838 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "log_to_file", 2023-07-14T18:29:19.838 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "bool", 2023-07-14T18:29:19.838 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:19.839 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:19.839 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "False", 2023-07-14T18:29:19.839 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:19.839 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:19.839 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:19.840 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:19.840 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:19.840 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:19.840 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:19.840 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:19.841 INFO:teuthology.orchestra.run.smithi163.stdout: "max_concurrent_snap_create": { 2023-07-14T18:29:19.841 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "max_concurrent_snap_create", 2023-07-14T18:29:19.841 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "int", 2023-07-14T18:29:19.841 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:19.841 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:19.842 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "10", 2023-07-14T18:29:19.842 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:19.842 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:19.842 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:19.842 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:19.843 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:19.843 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:19.843 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:19.843 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:19.843 INFO:teuthology.orchestra.run.smithi163.stdout: "mirror_snapshot_schedule": { 2023-07-14T18:29:19.844 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "mirror_snapshot_schedule", 2023-07-14T18:29:19.844 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "str", 2023-07-14T18:29:19.844 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:19.844 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:19.844 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "", 2023-07-14T18:29:19.845 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:19.845 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:19.845 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:19.845 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:19.845 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:19.846 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:19.846 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:19.846 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:19.846 INFO:teuthology.orchestra.run.smithi163.stdout: "trash_purge_schedule": { 2023-07-14T18:29:19.846 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "trash_purge_schedule", 2023-07-14T18:29:19.847 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "str", 2023-07-14T18:29:19.847 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:19.847 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:19.847 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "", 2023-07-14T18:29:19.847 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:19.848 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:19.848 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:19.848 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:19.848 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:19.848 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:19.849 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:19.849 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-07-14T18:29:19.849 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-07-14T18:29:19.849 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:19.849 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-07-14T18:29:19.850 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "restful", 2023-07-14T18:29:19.850 INFO:teuthology.orchestra.run.smithi163.stdout: "can_run": true, 2023-07-14T18:29:19.850 INFO:teuthology.orchestra.run.smithi163.stdout: "error_string": "", 2023-07-14T18:29:19.850 INFO:teuthology.orchestra.run.smithi163.stdout: "module_options": { 2023-07-14T18:29:19.850 INFO:teuthology.orchestra.run.smithi163.stdout: "enable_auth": { 2023-07-14T18:29:19.851 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "enable_auth", 2023-07-14T18:29:19.851 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "bool", 2023-07-14T18:29:19.851 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:19.851 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:19.851 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "True", 2023-07-14T18:29:19.852 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:19.852 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:19.852 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:19.852 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:19.852 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:19.852 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:19.853 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:19.853 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:19.853 INFO:teuthology.orchestra.run.smithi163.stdout: "key_file": { 2023-07-14T18:29:19.853 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "key_file", 2023-07-14T18:29:19.853 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "str", 2023-07-14T18:29:19.854 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:19.854 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:19.854 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "", 2023-07-14T18:29:19.854 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:19.854 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:19.855 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:19.855 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:19.855 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:19.855 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:19.855 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:19.856 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:19.856 INFO:teuthology.orchestra.run.smithi163.stdout: "log_level": { 2023-07-14T18:29:19.856 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "log_level", 2023-07-14T18:29:19.856 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "str", 2023-07-14T18:29:19.856 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:19.857 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:19.857 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "", 2023-07-14T18:29:19.857 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:19.857 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:19.857 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [ 2023-07-14T18:29:19.857 INFO:teuthology.orchestra.run.smithi163.stdout: "", 2023-07-14T18:29:19.858 INFO:teuthology.orchestra.run.smithi163.stdout: "critical", 2023-07-14T18:29:19.858 INFO:teuthology.orchestra.run.smithi163.stdout: "debug", 2023-07-14T18:29:19.858 INFO:teuthology.orchestra.run.smithi163.stdout: "error", 2023-07-14T18:29:19.858 INFO:teuthology.orchestra.run.smithi163.stdout: "info", 2023-07-14T18:29:19.858 INFO:teuthology.orchestra.run.smithi163.stdout: "warning" 2023-07-14T18:29:19.859 INFO:teuthology.orchestra.run.smithi163.stdout: ], 2023-07-14T18:29:19.859 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:19.859 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:19.859 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:19.859 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:19.860 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:19.860 INFO:teuthology.orchestra.run.smithi163.stdout: "log_to_cluster": { 2023-07-14T18:29:19.860 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "log_to_cluster", 2023-07-14T18:29:19.860 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "bool", 2023-07-14T18:29:19.860 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:19.861 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:19.861 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "False", 2023-07-14T18:29:19.861 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:19.861 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:19.861 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:19.862 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:19.862 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:19.862 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:19.862 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:19.862 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:19.863 INFO:teuthology.orchestra.run.smithi163.stdout: "log_to_cluster_level": { 2023-07-14T18:29:19.863 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "log_to_cluster_level", 2023-07-14T18:29:19.863 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "str", 2023-07-14T18:29:19.863 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:19.863 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:19.864 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "info", 2023-07-14T18:29:19.864 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:19.864 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:19.864 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [ 2023-07-14T18:29:19.864 INFO:teuthology.orchestra.run.smithi163.stdout: "", 2023-07-14T18:29:19.865 INFO:teuthology.orchestra.run.smithi163.stdout: "critical", 2023-07-14T18:29:19.865 INFO:teuthology.orchestra.run.smithi163.stdout: "debug", 2023-07-14T18:29:19.865 INFO:teuthology.orchestra.run.smithi163.stdout: "error", 2023-07-14T18:29:19.865 INFO:teuthology.orchestra.run.smithi163.stdout: "info", 2023-07-14T18:29:19.865 INFO:teuthology.orchestra.run.smithi163.stdout: "warning" 2023-07-14T18:29:19.866 INFO:teuthology.orchestra.run.smithi163.stdout: ], 2023-07-14T18:29:19.866 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:19.866 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:19.866 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:19.866 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:19.867 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:19.867 INFO:teuthology.orchestra.run.smithi163.stdout: "log_to_file": { 2023-07-14T18:29:19.867 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "log_to_file", 2023-07-14T18:29:19.867 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "bool", 2023-07-14T18:29:19.867 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:19.867 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:19.868 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "False", 2023-07-14T18:29:19.868 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:19.868 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:19.868 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:19.868 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:19.869 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:19.869 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:19.869 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:19.869 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:19.869 INFO:teuthology.orchestra.run.smithi163.stdout: "server_addr": { 2023-07-14T18:29:19.870 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "server_addr", 2023-07-14T18:29:19.870 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "str", 2023-07-14T18:29:19.870 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:19.870 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:19.870 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "", 2023-07-14T18:29:19.871 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:19.871 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:19.871 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:19.871 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:19.871 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:19.872 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:19.872 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:19.872 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:19.872 INFO:teuthology.orchestra.run.smithi163.stdout: "server_port": { 2023-07-14T18:29:19.872 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "server_port", 2023-07-14T18:29:19.873 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "str", 2023-07-14T18:29:19.873 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:19.873 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:19.873 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "", 2023-07-14T18:29:19.873 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:19.874 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:19.874 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:19.874 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:19.874 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:19.874 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:19.875 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:19.875 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-07-14T18:29:19.875 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-07-14T18:29:19.875 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:19.875 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-07-14T18:29:19.875 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "rgw", 2023-07-14T18:29:19.876 INFO:teuthology.orchestra.run.smithi163.stdout: "can_run": true, 2023-07-14T18:29:19.876 INFO:teuthology.orchestra.run.smithi163.stdout: "error_string": "", 2023-07-14T18:29:19.876 INFO:teuthology.orchestra.run.smithi163.stdout: "module_options": { 2023-07-14T18:29:19.876 INFO:teuthology.orchestra.run.smithi163.stdout: "log_level": { 2023-07-14T18:29:19.876 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "log_level", 2023-07-14T18:29:19.877 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "str", 2023-07-14T18:29:19.877 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:19.877 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:19.877 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "", 2023-07-14T18:29:19.877 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:19.878 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:19.878 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [ 2023-07-14T18:29:19.878 INFO:teuthology.orchestra.run.smithi163.stdout: "", 2023-07-14T18:29:19.878 INFO:teuthology.orchestra.run.smithi163.stdout: "critical", 2023-07-14T18:29:19.878 INFO:teuthology.orchestra.run.smithi163.stdout: "debug", 2023-07-14T18:29:19.879 INFO:teuthology.orchestra.run.smithi163.stdout: "error", 2023-07-14T18:29:19.879 INFO:teuthology.orchestra.run.smithi163.stdout: "info", 2023-07-14T18:29:19.879 INFO:teuthology.orchestra.run.smithi163.stdout: "warning" 2023-07-14T18:29:19.879 INFO:teuthology.orchestra.run.smithi163.stdout: ], 2023-07-14T18:29:19.879 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:19.880 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:19.880 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:19.880 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:19.880 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:19.880 INFO:teuthology.orchestra.run.smithi163.stdout: "log_to_cluster": { 2023-07-14T18:29:19.881 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "log_to_cluster", 2023-07-14T18:29:19.881 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "bool", 2023-07-14T18:29:19.881 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:19.881 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:19.881 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "False", 2023-07-14T18:29:19.882 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:19.882 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:19.882 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:19.882 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:19.882 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:19.883 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:19.883 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:19.883 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:19.883 INFO:teuthology.orchestra.run.smithi163.stdout: "log_to_cluster_level": { 2023-07-14T18:29:19.883 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "log_to_cluster_level", 2023-07-14T18:29:19.884 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "str", 2023-07-14T18:29:19.884 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:19.884 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:19.884 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "info", 2023-07-14T18:29:19.884 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:19.885 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:19.885 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [ 2023-07-14T18:29:19.885 INFO:teuthology.orchestra.run.smithi163.stdout: "", 2023-07-14T18:29:19.885 INFO:teuthology.orchestra.run.smithi163.stdout: "critical", 2023-07-14T18:29:19.885 INFO:teuthology.orchestra.run.smithi163.stdout: "debug", 2023-07-14T18:29:19.886 INFO:teuthology.orchestra.run.smithi163.stdout: "error", 2023-07-14T18:29:19.886 INFO:teuthology.orchestra.run.smithi163.stdout: "info", 2023-07-14T18:29:19.886 INFO:teuthology.orchestra.run.smithi163.stdout: "warning" 2023-07-14T18:29:19.886 INFO:teuthology.orchestra.run.smithi163.stdout: ], 2023-07-14T18:29:19.886 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:19.886 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:19.887 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:19.887 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:19.887 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:19.887 INFO:teuthology.orchestra.run.smithi163.stdout: "log_to_file": { 2023-07-14T18:29:19.887 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "log_to_file", 2023-07-14T18:29:19.888 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "bool", 2023-07-14T18:29:19.888 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:19.888 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:19.888 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "False", 2023-07-14T18:29:19.888 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:19.889 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:19.889 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:19.889 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:19.889 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:19.889 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:19.890 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:19.890 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-07-14T18:29:19.890 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-07-14T18:29:19.890 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:19.890 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-07-14T18:29:19.891 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "rook", 2023-07-14T18:29:19.891 INFO:teuthology.orchestra.run.smithi163.stdout: "can_run": true, 2023-07-14T18:29:19.891 INFO:teuthology.orchestra.run.smithi163.stdout: "error_string": "", 2023-07-14T18:29:19.891 INFO:teuthology.orchestra.run.smithi163.stdout: "module_options": { 2023-07-14T18:29:19.891 INFO:teuthology.orchestra.run.smithi163.stdout: "drive_group_interval": { 2023-07-14T18:29:19.892 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "drive_group_interval", 2023-07-14T18:29:19.892 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "float", 2023-07-14T18:29:19.892 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:19.892 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:19.892 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "300.0", 2023-07-14T18:29:19.892 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:19.893 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:19.893 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:19.893 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "interval in seconds between re-application of applied drive_groups", 2023-07-14T18:29:19.893 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:19.893 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:19.894 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:19.894 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:19.894 INFO:teuthology.orchestra.run.smithi163.stdout: "log_level": { 2023-07-14T18:29:19.894 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "log_level", 2023-07-14T18:29:19.894 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "str", 2023-07-14T18:29:19.895 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:19.895 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:19.895 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "", 2023-07-14T18:29:19.895 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:19.895 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:19.896 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [ 2023-07-14T18:29:19.896 INFO:teuthology.orchestra.run.smithi163.stdout: "", 2023-07-14T18:29:19.896 INFO:teuthology.orchestra.run.smithi163.stdout: "critical", 2023-07-14T18:29:19.896 INFO:teuthology.orchestra.run.smithi163.stdout: "debug", 2023-07-14T18:29:19.896 INFO:teuthology.orchestra.run.smithi163.stdout: "error", 2023-07-14T18:29:19.897 INFO:teuthology.orchestra.run.smithi163.stdout: "info", 2023-07-14T18:29:19.897 INFO:teuthology.orchestra.run.smithi163.stdout: "warning" 2023-07-14T18:29:19.897 INFO:teuthology.orchestra.run.smithi163.stdout: ], 2023-07-14T18:29:19.897 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:19.897 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:19.898 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:19.898 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:19.898 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:19.898 INFO:teuthology.orchestra.run.smithi163.stdout: "log_to_cluster": { 2023-07-14T18:29:19.898 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "log_to_cluster", 2023-07-14T18:29:19.898 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "bool", 2023-07-14T18:29:19.899 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:19.899 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:19.899 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "False", 2023-07-14T18:29:19.899 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:19.899 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:19.900 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:19.900 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:19.900 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:19.900 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:19.900 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:19.901 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:19.901 INFO:teuthology.orchestra.run.smithi163.stdout: "log_to_cluster_level": { 2023-07-14T18:29:19.901 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "log_to_cluster_level", 2023-07-14T18:29:19.901 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "str", 2023-07-14T18:29:19.901 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:19.902 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:19.902 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "info", 2023-07-14T18:29:19.902 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:19.902 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:19.902 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [ 2023-07-14T18:29:19.903 INFO:teuthology.orchestra.run.smithi163.stdout: "", 2023-07-14T18:29:19.903 INFO:teuthology.orchestra.run.smithi163.stdout: "critical", 2023-07-14T18:29:19.903 INFO:teuthology.orchestra.run.smithi163.stdout: "debug", 2023-07-14T18:29:19.903 INFO:teuthology.orchestra.run.smithi163.stdout: "error", 2023-07-14T18:29:19.903 INFO:teuthology.orchestra.run.smithi163.stdout: "info", 2023-07-14T18:29:19.904 INFO:teuthology.orchestra.run.smithi163.stdout: "warning" 2023-07-14T18:29:19.904 INFO:teuthology.orchestra.run.smithi163.stdout: ], 2023-07-14T18:29:19.904 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:19.904 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:19.904 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:19.904 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:19.905 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:19.905 INFO:teuthology.orchestra.run.smithi163.stdout: "log_to_file": { 2023-07-14T18:29:19.905 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "log_to_file", 2023-07-14T18:29:19.905 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "bool", 2023-07-14T18:29:19.905 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:19.906 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:19.906 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "False", 2023-07-14T18:29:19.906 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:19.906 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:19.906 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:19.907 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:19.907 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:19.907 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:19.907 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:19.907 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:19.908 INFO:teuthology.orchestra.run.smithi163.stdout: "storage_class": { 2023-07-14T18:29:19.908 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "storage_class", 2023-07-14T18:29:19.908 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "str", 2023-07-14T18:29:19.908 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:19.908 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:19.909 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "local", 2023-07-14T18:29:19.909 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:19.909 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:19.909 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:19.909 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "storage class name for LSO-discovered PVs", 2023-07-14T18:29:19.910 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:19.910 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:19.910 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:19.910 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-07-14T18:29:19.910 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-07-14T18:29:19.911 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:19.911 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-07-14T18:29:19.911 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "selftest", 2023-07-14T18:29:19.911 INFO:teuthology.orchestra.run.smithi163.stdout: "can_run": true, 2023-07-14T18:29:19.911 INFO:teuthology.orchestra.run.smithi163.stdout: "error_string": "", 2023-07-14T18:29:19.912 INFO:teuthology.orchestra.run.smithi163.stdout: "module_options": { 2023-07-14T18:29:19.912 INFO:teuthology.orchestra.run.smithi163.stdout: "log_level": { 2023-07-14T18:29:19.912 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "log_level", 2023-07-14T18:29:19.912 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "str", 2023-07-14T18:29:19.912 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:19.913 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:19.913 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "", 2023-07-14T18:29:19.913 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:19.913 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:19.913 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [ 2023-07-14T18:29:19.914 INFO:teuthology.orchestra.run.smithi163.stdout: "", 2023-07-14T18:29:19.914 INFO:teuthology.orchestra.run.smithi163.stdout: "critical", 2023-07-14T18:29:19.914 INFO:teuthology.orchestra.run.smithi163.stdout: "debug", 2023-07-14T18:29:19.914 INFO:teuthology.orchestra.run.smithi163.stdout: "error", 2023-07-14T18:29:19.914 INFO:teuthology.orchestra.run.smithi163.stdout: "info", 2023-07-14T18:29:19.915 INFO:teuthology.orchestra.run.smithi163.stdout: "warning" 2023-07-14T18:29:19.915 INFO:teuthology.orchestra.run.smithi163.stdout: ], 2023-07-14T18:29:19.915 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:19.915 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:19.915 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:19.916 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:19.916 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:19.916 INFO:teuthology.orchestra.run.smithi163.stdout: "log_to_cluster": { 2023-07-14T18:29:19.916 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "log_to_cluster", 2023-07-14T18:29:19.916 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "bool", 2023-07-14T18:29:19.916 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:19.917 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:19.917 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "False", 2023-07-14T18:29:19.917 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:19.917 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:19.917 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:19.918 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:19.918 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:19.918 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:19.918 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:19.918 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:19.919 INFO:teuthology.orchestra.run.smithi163.stdout: "log_to_cluster_level": { 2023-07-14T18:29:19.919 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "log_to_cluster_level", 2023-07-14T18:29:19.919 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "str", 2023-07-14T18:29:19.919 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:19.919 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:19.920 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "info", 2023-07-14T18:29:19.920 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:19.920 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:19.920 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [ 2023-07-14T18:29:19.920 INFO:teuthology.orchestra.run.smithi163.stdout: "", 2023-07-14T18:29:19.921 INFO:teuthology.orchestra.run.smithi163.stdout: "critical", 2023-07-14T18:29:19.921 INFO:teuthology.orchestra.run.smithi163.stdout: "debug", 2023-07-14T18:29:19.921 INFO:teuthology.orchestra.run.smithi163.stdout: "error", 2023-07-14T18:29:19.921 INFO:teuthology.orchestra.run.smithi163.stdout: "info", 2023-07-14T18:29:19.921 INFO:teuthology.orchestra.run.smithi163.stdout: "warning" 2023-07-14T18:29:19.922 INFO:teuthology.orchestra.run.smithi163.stdout: ], 2023-07-14T18:29:19.922 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:19.922 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:19.922 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:19.922 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:19.923 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:19.923 INFO:teuthology.orchestra.run.smithi163.stdout: "log_to_file": { 2023-07-14T18:29:19.923 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "log_to_file", 2023-07-14T18:29:19.923 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "bool", 2023-07-14T18:29:19.923 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:19.923 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:19.924 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "False", 2023-07-14T18:29:19.924 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:19.924 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:19.924 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:19.924 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:19.925 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:19.925 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:19.925 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:19.925 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:19.925 INFO:teuthology.orchestra.run.smithi163.stdout: "roption1": { 2023-07-14T18:29:19.926 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "roption1", 2023-07-14T18:29:19.926 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "str", 2023-07-14T18:29:19.926 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:19.926 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:19.926 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "", 2023-07-14T18:29:19.927 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:19.927 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:19.927 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:19.927 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:19.927 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:19.928 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:19.928 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:19.928 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:19.928 INFO:teuthology.orchestra.run.smithi163.stdout: "roption2": { 2023-07-14T18:29:19.928 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "roption2", 2023-07-14T18:29:19.928 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "str", 2023-07-14T18:29:19.929 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:19.929 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:19.929 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "xyz", 2023-07-14T18:29:19.929 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:19.929 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:19.930 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:19.930 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:19.930 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:19.930 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:19.930 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:19.931 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:19.931 INFO:teuthology.orchestra.run.smithi163.stdout: "rwoption1": { 2023-07-14T18:29:19.931 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "rwoption1", 2023-07-14T18:29:19.931 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "str", 2023-07-14T18:29:19.931 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:19.932 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:19.932 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "", 2023-07-14T18:29:19.932 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:19.932 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:19.932 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:19.933 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:19.933 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:19.933 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:19.933 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:19.933 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:19.934 INFO:teuthology.orchestra.run.smithi163.stdout: "rwoption2": { 2023-07-14T18:29:19.934 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "rwoption2", 2023-07-14T18:29:19.934 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "int", 2023-07-14T18:29:19.934 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:19.934 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:19.934 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "", 2023-07-14T18:29:19.935 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:19.935 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:19.935 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:19.935 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:19.935 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:19.936 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:19.936 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:19.936 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:19.936 INFO:teuthology.orchestra.run.smithi163.stdout: "rwoption3": { 2023-07-14T18:29:19.936 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "rwoption3", 2023-07-14T18:29:19.937 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "float", 2023-07-14T18:29:19.937 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:19.937 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:19.937 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "", 2023-07-14T18:29:19.937 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:19.938 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:19.938 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:19.938 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:19.938 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:19.938 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:19.938 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:19.939 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:19.939 INFO:teuthology.orchestra.run.smithi163.stdout: "rwoption4": { 2023-07-14T18:29:19.939 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "rwoption4", 2023-07-14T18:29:19.939 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "str", 2023-07-14T18:29:19.939 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:19.940 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:19.940 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "", 2023-07-14T18:29:19.940 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:19.940 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:19.940 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:19.941 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:19.941 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:19.941 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:19.941 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:19.941 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:19.942 INFO:teuthology.orchestra.run.smithi163.stdout: "rwoption5": { 2023-07-14T18:29:19.942 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "rwoption5", 2023-07-14T18:29:19.942 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "bool", 2023-07-14T18:29:19.942 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:19.942 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:19.943 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "", 2023-07-14T18:29:19.943 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:19.943 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:19.943 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:19.943 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:19.943 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:19.944 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:19.944 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:19.944 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:19.944 INFO:teuthology.orchestra.run.smithi163.stdout: "rwoption6": { 2023-07-14T18:29:19.945 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "rwoption6", 2023-07-14T18:29:19.945 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "bool", 2023-07-14T18:29:19.945 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:19.945 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:19.945 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "True", 2023-07-14T18:29:19.946 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:19.946 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:19.946 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:19.946 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:19.946 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:19.946 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:19.947 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:19.947 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:19.947 INFO:teuthology.orchestra.run.smithi163.stdout: "rwoption7": { 2023-07-14T18:29:19.947 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "rwoption7", 2023-07-14T18:29:19.947 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "int", 2023-07-14T18:29:19.948 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:19.948 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:19.948 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "", 2023-07-14T18:29:19.948 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "1", 2023-07-14T18:29:19.948 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "42", 2023-07-14T18:29:19.949 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:19.949 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:19.949 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:19.949 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:19.949 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:19.950 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:19.950 INFO:teuthology.orchestra.run.smithi163.stdout: "testkey": { 2023-07-14T18:29:19.950 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "testkey", 2023-07-14T18:29:19.950 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "str", 2023-07-14T18:29:19.950 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:19.950 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:19.951 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "", 2023-07-14T18:29:19.951 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:19.951 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:19.951 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:19.951 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:19.952 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:19.952 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:19.952 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:19.952 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:19.952 INFO:teuthology.orchestra.run.smithi163.stdout: "testlkey": { 2023-07-14T18:29:19.953 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "testlkey", 2023-07-14T18:29:19.953 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "str", 2023-07-14T18:29:19.953 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:19.953 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:19.953 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "", 2023-07-14T18:29:19.954 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:19.954 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:19.954 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:19.954 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:19.954 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:19.955 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:19.955 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:19.955 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:19.955 INFO:teuthology.orchestra.run.smithi163.stdout: "testnewline": { 2023-07-14T18:29:19.955 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "testnewline", 2023-07-14T18:29:19.955 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "str", 2023-07-14T18:29:19.956 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:19.956 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:19.956 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "", 2023-07-14T18:29:19.956 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:19.956 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:19.957 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:19.957 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:19.957 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:19.957 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:19.957 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:19.958 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-07-14T18:29:19.958 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-07-14T18:29:19.958 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:19.958 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-07-14T18:29:19.958 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "snap_schedule", 2023-07-14T18:29:19.958 INFO:teuthology.orchestra.run.smithi163.stdout: "can_run": true, 2023-07-14T18:29:19.959 INFO:teuthology.orchestra.run.smithi163.stdout: "error_string": "", 2023-07-14T18:29:19.959 INFO:teuthology.orchestra.run.smithi163.stdout: "module_options": { 2023-07-14T18:29:19.959 INFO:teuthology.orchestra.run.smithi163.stdout: "allow_m_granularity": { 2023-07-14T18:29:19.959 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "allow_m_granularity", 2023-07-14T18:29:19.959 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "bool", 2023-07-14T18:29:19.960 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:19.960 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:19.960 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "False", 2023-07-14T18:29:19.960 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:19.961 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:19.961 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:19.961 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "allow minute scheduled snapshots", 2023-07-14T18:29:19.961 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:19.961 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:19.961 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:19.962 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:19.962 INFO:teuthology.orchestra.run.smithi163.stdout: "dump_on_update": { 2023-07-14T18:29:19.962 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "dump_on_update", 2023-07-14T18:29:19.962 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "bool", 2023-07-14T18:29:19.962 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:19.963 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:19.963 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "False", 2023-07-14T18:29:19.963 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:19.963 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:19.963 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:19.964 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "dump database to debug log on update", 2023-07-14T18:29:19.964 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:19.964 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:19.964 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:19.964 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:19.965 INFO:teuthology.orchestra.run.smithi163.stdout: "log_level": { 2023-07-14T18:29:19.965 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "log_level", 2023-07-14T18:29:19.965 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "str", 2023-07-14T18:29:19.965 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:19.965 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:19.965 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "", 2023-07-14T18:29:19.966 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:19.966 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:19.966 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [ 2023-07-14T18:29:19.966 INFO:teuthology.orchestra.run.smithi163.stdout: "", 2023-07-14T18:29:19.966 INFO:teuthology.orchestra.run.smithi163.stdout: "critical", 2023-07-14T18:29:19.967 INFO:teuthology.orchestra.run.smithi163.stdout: "debug", 2023-07-14T18:29:19.967 INFO:teuthology.orchestra.run.smithi163.stdout: "error", 2023-07-14T18:29:19.967 INFO:teuthology.orchestra.run.smithi163.stdout: "info", 2023-07-14T18:29:19.967 INFO:teuthology.orchestra.run.smithi163.stdout: "warning" 2023-07-14T18:29:19.967 INFO:teuthology.orchestra.run.smithi163.stdout: ], 2023-07-14T18:29:19.968 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:19.968 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:19.968 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:19.968 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:19.968 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:19.969 INFO:teuthology.orchestra.run.smithi163.stdout: "log_to_cluster": { 2023-07-14T18:29:19.969 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "log_to_cluster", 2023-07-14T18:29:19.969 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "bool", 2023-07-14T18:29:19.969 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:19.969 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:19.970 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "False", 2023-07-14T18:29:19.970 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:19.970 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:19.970 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:19.970 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:19.971 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:19.971 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:19.971 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:19.971 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:19.971 INFO:teuthology.orchestra.run.smithi163.stdout: "log_to_cluster_level": { 2023-07-14T18:29:19.971 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "log_to_cluster_level", 2023-07-14T18:29:19.972 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "str", 2023-07-14T18:29:19.972 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:19.972 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:19.972 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "info", 2023-07-14T18:29:19.973 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:19.973 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:19.973 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [ 2023-07-14T18:29:19.973 INFO:teuthology.orchestra.run.smithi163.stdout: "", 2023-07-14T18:29:19.973 INFO:teuthology.orchestra.run.smithi163.stdout: "critical", 2023-07-14T18:29:19.973 INFO:teuthology.orchestra.run.smithi163.stdout: "debug", 2023-07-14T18:29:19.974 INFO:teuthology.orchestra.run.smithi163.stdout: "error", 2023-07-14T18:29:19.974 INFO:teuthology.orchestra.run.smithi163.stdout: "info", 2023-07-14T18:29:19.974 INFO:teuthology.orchestra.run.smithi163.stdout: "warning" 2023-07-14T18:29:19.974 INFO:teuthology.orchestra.run.smithi163.stdout: ], 2023-07-14T18:29:19.974 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:19.975 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:19.975 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:19.975 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:19.975 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:19.975 INFO:teuthology.orchestra.run.smithi163.stdout: "log_to_file": { 2023-07-14T18:29:19.976 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "log_to_file", 2023-07-14T18:29:19.976 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "bool", 2023-07-14T18:29:19.976 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:19.976 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:19.976 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "False", 2023-07-14T18:29:19.977 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:19.977 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:19.977 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:19.977 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:19.977 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:19.978 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:19.978 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:19.978 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-07-14T18:29:19.978 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-07-14T18:29:19.978 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:19.979 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-07-14T18:29:19.979 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "stats", 2023-07-14T18:29:19.979 INFO:teuthology.orchestra.run.smithi163.stdout: "can_run": true, 2023-07-14T18:29:19.979 INFO:teuthology.orchestra.run.smithi163.stdout: "error_string": "", 2023-07-14T18:29:19.979 INFO:teuthology.orchestra.run.smithi163.stdout: "module_options": { 2023-07-14T18:29:19.980 INFO:teuthology.orchestra.run.smithi163.stdout: "log_level": { 2023-07-14T18:29:19.980 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "log_level", 2023-07-14T18:29:19.980 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "str", 2023-07-14T18:29:19.980 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:19.980 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:19.981 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "", 2023-07-14T18:29:19.981 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:19.981 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:19.981 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [ 2023-07-14T18:29:19.981 INFO:teuthology.orchestra.run.smithi163.stdout: "", 2023-07-14T18:29:19.981 INFO:teuthology.orchestra.run.smithi163.stdout: "critical", 2023-07-14T18:29:19.982 INFO:teuthology.orchestra.run.smithi163.stdout: "debug", 2023-07-14T18:29:19.982 INFO:teuthology.orchestra.run.smithi163.stdout: "error", 2023-07-14T18:29:19.982 INFO:teuthology.orchestra.run.smithi163.stdout: "info", 2023-07-14T18:29:19.982 INFO:teuthology.orchestra.run.smithi163.stdout: "warning" 2023-07-14T18:29:19.982 INFO:teuthology.orchestra.run.smithi163.stdout: ], 2023-07-14T18:29:19.983 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:19.983 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:19.983 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:19.983 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:19.983 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:19.984 INFO:teuthology.orchestra.run.smithi163.stdout: "log_to_cluster": { 2023-07-14T18:29:19.984 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "log_to_cluster", 2023-07-14T18:29:19.984 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "bool", 2023-07-14T18:29:19.984 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:19.984 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:19.985 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "False", 2023-07-14T18:29:19.985 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:19.985 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:19.985 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:19.985 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:19.986 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:19.986 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:19.986 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:19.986 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:19.986 INFO:teuthology.orchestra.run.smithi163.stdout: "log_to_cluster_level": { 2023-07-14T18:29:19.987 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "log_to_cluster_level", 2023-07-14T18:29:19.987 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "str", 2023-07-14T18:29:19.987 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:19.987 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:19.987 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "info", 2023-07-14T18:29:19.987 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:19.988 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:19.988 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [ 2023-07-14T18:29:19.988 INFO:teuthology.orchestra.run.smithi163.stdout: "", 2023-07-14T18:29:19.988 INFO:teuthology.orchestra.run.smithi163.stdout: "critical", 2023-07-14T18:29:19.988 INFO:teuthology.orchestra.run.smithi163.stdout: "debug", 2023-07-14T18:29:19.989 INFO:teuthology.orchestra.run.smithi163.stdout: "error", 2023-07-14T18:29:19.989 INFO:teuthology.orchestra.run.smithi163.stdout: "info", 2023-07-14T18:29:19.989 INFO:teuthology.orchestra.run.smithi163.stdout: "warning" 2023-07-14T18:29:19.989 INFO:teuthology.orchestra.run.smithi163.stdout: ], 2023-07-14T18:29:19.989 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:19.990 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:19.990 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:19.990 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:19.990 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:19.990 INFO:teuthology.orchestra.run.smithi163.stdout: "log_to_file": { 2023-07-14T18:29:19.991 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "log_to_file", 2023-07-14T18:29:19.991 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "bool", 2023-07-14T18:29:19.991 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:19.991 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:19.991 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "False", 2023-07-14T18:29:19.992 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:19.992 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:19.992 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:19.992 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:19.992 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:19.993 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:19.993 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:19.993 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-07-14T18:29:19.993 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-07-14T18:29:19.993 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:19.993 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-07-14T18:29:19.994 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "status", 2023-07-14T18:29:19.994 INFO:teuthology.orchestra.run.smithi163.stdout: "can_run": true, 2023-07-14T18:29:19.994 INFO:teuthology.orchestra.run.smithi163.stdout: "error_string": "", 2023-07-14T18:29:19.994 INFO:teuthology.orchestra.run.smithi163.stdout: "module_options": { 2023-07-14T18:29:19.994 INFO:teuthology.orchestra.run.smithi163.stdout: "log_level": { 2023-07-14T18:29:19.995 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "log_level", 2023-07-14T18:29:19.995 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "str", 2023-07-14T18:29:19.995 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:19.995 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:19.995 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "", 2023-07-14T18:29:19.996 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:19.996 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:19.996 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [ 2023-07-14T18:29:19.996 INFO:teuthology.orchestra.run.smithi163.stdout: "", 2023-07-14T18:29:19.996 INFO:teuthology.orchestra.run.smithi163.stdout: "critical", 2023-07-14T18:29:19.997 INFO:teuthology.orchestra.run.smithi163.stdout: "debug", 2023-07-14T18:29:19.997 INFO:teuthology.orchestra.run.smithi163.stdout: "error", 2023-07-14T18:29:19.997 INFO:teuthology.orchestra.run.smithi163.stdout: "info", 2023-07-14T18:29:19.997 INFO:teuthology.orchestra.run.smithi163.stdout: "warning" 2023-07-14T18:29:19.997 INFO:teuthology.orchestra.run.smithi163.stdout: ], 2023-07-14T18:29:19.998 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:19.998 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:19.998 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:19.998 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:19.998 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:19.998 INFO:teuthology.orchestra.run.smithi163.stdout: "log_to_cluster": { 2023-07-14T18:29:19.999 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "log_to_cluster", 2023-07-14T18:29:19.999 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "bool", 2023-07-14T18:29:19.999 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:19.999 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:19.999 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "False", 2023-07-14T18:29:20.000 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:20.000 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:20.000 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:20.000 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:20.000 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:20.001 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:20.001 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:20.001 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:20.001 INFO:teuthology.orchestra.run.smithi163.stdout: "log_to_cluster_level": { 2023-07-14T18:29:20.001 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "log_to_cluster_level", 2023-07-14T18:29:20.002 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "str", 2023-07-14T18:29:20.002 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:20.002 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:20.002 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "info", 2023-07-14T18:29:20.002 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:20.003 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:20.003 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [ 2023-07-14T18:29:20.003 INFO:teuthology.orchestra.run.smithi163.stdout: "", 2023-07-14T18:29:20.003 INFO:teuthology.orchestra.run.smithi163.stdout: "critical", 2023-07-14T18:29:20.003 INFO:teuthology.orchestra.run.smithi163.stdout: "debug", 2023-07-14T18:29:20.003 INFO:teuthology.orchestra.run.smithi163.stdout: "error", 2023-07-14T18:29:20.004 INFO:teuthology.orchestra.run.smithi163.stdout: "info", 2023-07-14T18:29:20.004 INFO:teuthology.orchestra.run.smithi163.stdout: "warning" 2023-07-14T18:29:20.004 INFO:teuthology.orchestra.run.smithi163.stdout: ], 2023-07-14T18:29:20.004 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:20.004 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:20.005 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:20.005 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:20.005 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:20.005 INFO:teuthology.orchestra.run.smithi163.stdout: "log_to_file": { 2023-07-14T18:29:20.005 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "log_to_file", 2023-07-14T18:29:20.006 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "bool", 2023-07-14T18:29:20.006 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:20.006 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:20.006 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "False", 2023-07-14T18:29:20.006 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:20.007 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:20.007 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:20.007 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:20.007 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:20.007 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:20.008 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:20.008 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-07-14T18:29:20.008 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-07-14T18:29:20.008 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:20.008 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-07-14T18:29:20.009 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "telegraf", 2023-07-14T18:29:20.009 INFO:teuthology.orchestra.run.smithi163.stdout: "can_run": true, 2023-07-14T18:29:20.009 INFO:teuthology.orchestra.run.smithi163.stdout: "error_string": "", 2023-07-14T18:29:20.009 INFO:teuthology.orchestra.run.smithi163.stdout: "module_options": { 2023-07-14T18:29:20.009 INFO:teuthology.orchestra.run.smithi163.stdout: "address": { 2023-07-14T18:29:20.010 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "address", 2023-07-14T18:29:20.010 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "str", 2023-07-14T18:29:20.010 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:20.010 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:20.010 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2023-07-14T18:29:20.011 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:20.011 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:20.011 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:20.011 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:20.011 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:20.011 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:20.012 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:20.012 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:20.012 INFO:teuthology.orchestra.run.smithi163.stdout: "interval": { 2023-07-14T18:29:20.012 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "interval", 2023-07-14T18:29:20.012 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "secs", 2023-07-14T18:29:20.013 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:20.013 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:20.013 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "15", 2023-07-14T18:29:20.013 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:20.013 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:20.014 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:20.014 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:20.014 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:20.014 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:20.014 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:20.015 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:20.015 INFO:teuthology.orchestra.run.smithi163.stdout: "log_level": { 2023-07-14T18:29:20.015 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "log_level", 2023-07-14T18:29:20.015 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "str", 2023-07-14T18:29:20.015 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:20.016 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:20.016 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "", 2023-07-14T18:29:20.016 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:20.016 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:20.016 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [ 2023-07-14T18:29:20.017 INFO:teuthology.orchestra.run.smithi163.stdout: "", 2023-07-14T18:29:20.017 INFO:teuthology.orchestra.run.smithi163.stdout: "critical", 2023-07-14T18:29:20.017 INFO:teuthology.orchestra.run.smithi163.stdout: "debug", 2023-07-14T18:29:20.017 INFO:teuthology.orchestra.run.smithi163.stdout: "error", 2023-07-14T18:29:20.017 INFO:teuthology.orchestra.run.smithi163.stdout: "info", 2023-07-14T18:29:20.018 INFO:teuthology.orchestra.run.smithi163.stdout: "warning" 2023-07-14T18:29:20.018 INFO:teuthology.orchestra.run.smithi163.stdout: ], 2023-07-14T18:29:20.018 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:20.018 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:20.018 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:20.018 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:20.019 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:20.019 INFO:teuthology.orchestra.run.smithi163.stdout: "log_to_cluster": { 2023-07-14T18:29:20.019 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "log_to_cluster", 2023-07-14T18:29:20.019 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "bool", 2023-07-14T18:29:20.019 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:20.020 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:20.020 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "False", 2023-07-14T18:29:20.020 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:20.020 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:20.020 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:20.021 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:20.021 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:20.021 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:20.021 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:20.021 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:20.022 INFO:teuthology.orchestra.run.smithi163.stdout: "log_to_cluster_level": { 2023-07-14T18:29:20.022 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "log_to_cluster_level", 2023-07-14T18:29:20.022 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "str", 2023-07-14T18:29:20.022 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:20.022 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:20.023 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "info", 2023-07-14T18:29:20.023 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:20.023 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:20.023 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [ 2023-07-14T18:29:20.023 INFO:teuthology.orchestra.run.smithi163.stdout: "", 2023-07-14T18:29:20.024 INFO:teuthology.orchestra.run.smithi163.stdout: "critical", 2023-07-14T18:29:20.024 INFO:teuthology.orchestra.run.smithi163.stdout: "debug", 2023-07-14T18:29:20.024 INFO:teuthology.orchestra.run.smithi163.stdout: "error", 2023-07-14T18:29:20.024 INFO:teuthology.orchestra.run.smithi163.stdout: "info", 2023-07-14T18:29:20.024 INFO:teuthology.orchestra.run.smithi163.stdout: "warning" 2023-07-14T18:29:20.025 INFO:teuthology.orchestra.run.smithi163.stdout: ], 2023-07-14T18:29:20.025 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:20.025 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:20.025 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:20.025 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:20.026 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:20.026 INFO:teuthology.orchestra.run.smithi163.stdout: "log_to_file": { 2023-07-14T18:29:20.026 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "log_to_file", 2023-07-14T18:29:20.026 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "bool", 2023-07-14T18:29:20.026 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:20.026 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:20.027 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "False", 2023-07-14T18:29:20.027 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:20.027 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:20.027 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:20.027 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:20.028 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:20.028 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:20.028 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:20.028 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-07-14T18:29:20.028 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-07-14T18:29:20.029 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:20.029 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-07-14T18:29:20.029 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "telemetry", 2023-07-14T18:29:20.029 INFO:teuthology.orchestra.run.smithi163.stdout: "can_run": true, 2023-07-14T18:29:20.029 INFO:teuthology.orchestra.run.smithi163.stdout: "error_string": "", 2023-07-14T18:29:20.030 INFO:teuthology.orchestra.run.smithi163.stdout: "module_options": { 2023-07-14T18:29:20.030 INFO:teuthology.orchestra.run.smithi163.stdout: "channel_basic": { 2023-07-14T18:29:20.030 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "channel_basic", 2023-07-14T18:29:20.030 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "bool", 2023-07-14T18:29:20.030 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:20.031 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:20.031 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "True", 2023-07-14T18:29:20.031 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:20.031 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:20.031 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:20.031 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "Share basic cluster information (size, version)", 2023-07-14T18:29:20.032 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:20.032 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:20.032 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:20.032 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:20.032 INFO:teuthology.orchestra.run.smithi163.stdout: "channel_crash": { 2023-07-14T18:29:20.033 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "channel_crash", 2023-07-14T18:29:20.033 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "bool", 2023-07-14T18:29:20.033 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:20.033 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:20.033 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "True", 2023-07-14T18:29:20.034 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:20.034 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:20.034 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:20.034 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2023-07-14T18:29:20.034 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:20.035 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:20.035 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:20.035 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:20.035 INFO:teuthology.orchestra.run.smithi163.stdout: "channel_device": { 2023-07-14T18:29:20.035 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "channel_device", 2023-07-14T18:29:20.036 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "bool", 2023-07-14T18:29:20.036 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:20.036 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:20.036 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "True", 2023-07-14T18:29:20.036 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:20.037 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:20.037 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:20.037 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2023-07-14T18:29:20.037 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:20.037 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:20.037 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:20.038 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:20.038 INFO:teuthology.orchestra.run.smithi163.stdout: "channel_ident": { 2023-07-14T18:29:20.038 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "channel_ident", 2023-07-14T18:29:20.038 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "bool", 2023-07-14T18:29:20.038 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:20.039 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:20.039 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "False", 2023-07-14T18:29:20.039 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:20.039 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:20.039 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:20.040 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2023-07-14T18:29:20.040 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:20.040 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:20.040 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:20.040 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:20.040 INFO:teuthology.orchestra.run.smithi163.stdout: "channel_perf": { 2023-07-14T18:29:20.041 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "channel_perf", 2023-07-14T18:29:20.041 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "bool", 2023-07-14T18:29:20.041 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:20.041 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:20.041 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "False", 2023-07-14T18:29:20.042 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:20.042 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:20.042 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:20.042 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "Share various performance metrics of a cluster", 2023-07-14T18:29:20.042 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:20.043 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:20.043 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:20.043 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:20.043 INFO:teuthology.orchestra.run.smithi163.stdout: "contact": { 2023-07-14T18:29:20.043 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "contact", 2023-07-14T18:29:20.044 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "str", 2023-07-14T18:29:20.044 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:20.044 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:20.044 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "", 2023-07-14T18:29:20.044 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:20.045 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:20.045 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:20.045 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:20.045 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:20.045 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:20.045 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:20.046 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:20.046 INFO:teuthology.orchestra.run.smithi163.stdout: "description": { 2023-07-14T18:29:20.046 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "description", 2023-07-14T18:29:20.046 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "str", 2023-07-14T18:29:20.046 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:20.047 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:20.047 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "", 2023-07-14T18:29:20.047 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:20.047 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:20.047 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:20.048 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:20.048 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:20.048 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:20.048 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:20.048 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:20.049 INFO:teuthology.orchestra.run.smithi163.stdout: "device_url": { 2023-07-14T18:29:20.049 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "device_url", 2023-07-14T18:29:20.049 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "str", 2023-07-14T18:29:20.049 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:20.049 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:20.050 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "https://telemetry.ceph.com/device", 2023-07-14T18:29:20.050 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:20.050 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:20.050 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:20.050 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:20.051 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:20.051 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:20.051 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:20.051 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:20.051 INFO:teuthology.orchestra.run.smithi163.stdout: "enabled": { 2023-07-14T18:29:20.052 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "enabled", 2023-07-14T18:29:20.052 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "bool", 2023-07-14T18:29:20.052 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:20.052 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:20.052 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "False", 2023-07-14T18:29:20.053 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:20.053 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:20.053 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:20.053 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:20.053 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:20.053 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:20.054 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:20.054 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:20.054 INFO:teuthology.orchestra.run.smithi163.stdout: "interval": { 2023-07-14T18:29:20.054 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "interval", 2023-07-14T18:29:20.054 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "int", 2023-07-14T18:29:20.055 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:20.055 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:20.055 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "24", 2023-07-14T18:29:20.055 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "8", 2023-07-14T18:29:20.055 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:20.056 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:20.056 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:20.056 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:20.056 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:20.056 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:20.056 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:20.057 INFO:teuthology.orchestra.run.smithi163.stdout: "last_opt_revision": { 2023-07-14T18:29:20.057 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "last_opt_revision", 2023-07-14T18:29:20.057 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "int", 2023-07-14T18:29:20.057 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:20.057 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:20.058 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "1", 2023-07-14T18:29:20.058 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:20.058 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:20.058 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:20.058 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:20.059 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:20.059 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:20.059 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:20.059 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:20.059 INFO:teuthology.orchestra.run.smithi163.stdout: "leaderboard": { 2023-07-14T18:29:20.060 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "leaderboard", 2023-07-14T18:29:20.060 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "bool", 2023-07-14T18:29:20.060 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:20.060 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:20.060 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "False", 2023-07-14T18:29:20.061 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:20.061 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:20.061 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:20.061 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:20.061 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:20.062 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:20.062 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:20.062 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:20.062 INFO:teuthology.orchestra.run.smithi163.stdout: "leaderboard_description": { 2023-07-14T18:29:20.062 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "leaderboard_description", 2023-07-14T18:29:20.062 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "str", 2023-07-14T18:29:20.063 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:20.063 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:20.063 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "", 2023-07-14T18:29:20.063 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:20.063 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:20.064 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:20.064 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:20.064 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:20.064 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:20.064 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:20.065 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:20.065 INFO:teuthology.orchestra.run.smithi163.stdout: "log_level": { 2023-07-14T18:29:20.065 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "log_level", 2023-07-14T18:29:20.065 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "str", 2023-07-14T18:29:20.065 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:20.066 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:20.066 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "", 2023-07-14T18:29:20.066 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:20.066 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:20.067 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [ 2023-07-14T18:29:20.067 INFO:teuthology.orchestra.run.smithi163.stdout: "", 2023-07-14T18:29:20.067 INFO:teuthology.orchestra.run.smithi163.stdout: "critical", 2023-07-14T18:29:20.067 INFO:teuthology.orchestra.run.smithi163.stdout: "debug", 2023-07-14T18:29:20.067 INFO:teuthology.orchestra.run.smithi163.stdout: "error", 2023-07-14T18:29:20.068 INFO:teuthology.orchestra.run.smithi163.stdout: "info", 2023-07-14T18:29:20.068 INFO:teuthology.orchestra.run.smithi163.stdout: "warning" 2023-07-14T18:29:20.068 INFO:teuthology.orchestra.run.smithi163.stdout: ], 2023-07-14T18:29:20.068 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:20.068 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:20.069 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:20.069 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:20.069 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:20.069 INFO:teuthology.orchestra.run.smithi163.stdout: "log_to_cluster": { 2023-07-14T18:29:20.069 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "log_to_cluster", 2023-07-14T18:29:20.069 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "bool", 2023-07-14T18:29:20.070 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:20.070 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:20.070 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "False", 2023-07-14T18:29:20.070 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:20.070 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:20.071 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:20.071 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:20.071 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:20.071 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:20.071 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:20.072 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:20.072 INFO:teuthology.orchestra.run.smithi163.stdout: "log_to_cluster_level": { 2023-07-14T18:29:20.072 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "log_to_cluster_level", 2023-07-14T18:29:20.072 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "str", 2023-07-14T18:29:20.072 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:20.073 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:20.073 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "info", 2023-07-14T18:29:20.073 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:20.073 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:20.073 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [ 2023-07-14T18:29:20.074 INFO:teuthology.orchestra.run.smithi163.stdout: "", 2023-07-14T18:29:20.074 INFO:teuthology.orchestra.run.smithi163.stdout: "critical", 2023-07-14T18:29:20.074 INFO:teuthology.orchestra.run.smithi163.stdout: "debug", 2023-07-14T18:29:20.074 INFO:teuthology.orchestra.run.smithi163.stdout: "error", 2023-07-14T18:29:20.074 INFO:teuthology.orchestra.run.smithi163.stdout: "info", 2023-07-14T18:29:20.075 INFO:teuthology.orchestra.run.smithi163.stdout: "warning" 2023-07-14T18:29:20.075 INFO:teuthology.orchestra.run.smithi163.stdout: ], 2023-07-14T18:29:20.075 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:20.075 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:20.075 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:20.075 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:20.076 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:20.076 INFO:teuthology.orchestra.run.smithi163.stdout: "log_to_file": { 2023-07-14T18:29:20.076 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "log_to_file", 2023-07-14T18:29:20.076 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "bool", 2023-07-14T18:29:20.076 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:20.077 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:20.077 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "False", 2023-07-14T18:29:20.077 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:20.077 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:20.077 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:20.078 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:20.078 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:20.078 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:20.078 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:20.078 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:20.079 INFO:teuthology.orchestra.run.smithi163.stdout: "organization": { 2023-07-14T18:29:20.079 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "organization", 2023-07-14T18:29:20.079 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "str", 2023-07-14T18:29:20.079 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:20.079 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:20.079 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "", 2023-07-14T18:29:20.080 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:20.080 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:20.080 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:20.080 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:20.080 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:20.081 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:20.081 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:20.081 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:20.081 INFO:teuthology.orchestra.run.smithi163.stdout: "proxy": { 2023-07-14T18:29:20.081 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "proxy", 2023-07-14T18:29:20.082 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "str", 2023-07-14T18:29:20.082 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:20.082 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:20.082 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "", 2023-07-14T18:29:20.082 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:20.083 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:20.083 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:20.083 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:20.083 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:20.083 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:20.083 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:20.084 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:20.084 INFO:teuthology.orchestra.run.smithi163.stdout: "url": { 2023-07-14T18:29:20.084 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "url", 2023-07-14T18:29:20.084 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "str", 2023-07-14T18:29:20.084 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:20.085 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:20.085 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "https://telemetry.ceph.com/report", 2023-07-14T18:29:20.085 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:20.085 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:20.085 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:20.086 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:20.086 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:20.086 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:20.086 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:20.086 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-07-14T18:29:20.087 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-07-14T18:29:20.087 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:20.087 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-07-14T18:29:20.087 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "test_orchestrator", 2023-07-14T18:29:20.087 INFO:teuthology.orchestra.run.smithi163.stdout: "can_run": true, 2023-07-14T18:29:20.088 INFO:teuthology.orchestra.run.smithi163.stdout: "error_string": "", 2023-07-14T18:29:20.088 INFO:teuthology.orchestra.run.smithi163.stdout: "module_options": { 2023-07-14T18:29:20.088 INFO:teuthology.orchestra.run.smithi163.stdout: "log_level": { 2023-07-14T18:29:20.088 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "log_level", 2023-07-14T18:29:20.088 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "str", 2023-07-14T18:29:20.089 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:20.089 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:20.089 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "", 2023-07-14T18:29:20.089 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:20.089 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:20.090 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [ 2023-07-14T18:29:20.090 INFO:teuthology.orchestra.run.smithi163.stdout: "", 2023-07-14T18:29:20.090 INFO:teuthology.orchestra.run.smithi163.stdout: "critical", 2023-07-14T18:29:20.090 INFO:teuthology.orchestra.run.smithi163.stdout: "debug", 2023-07-14T18:29:20.090 INFO:teuthology.orchestra.run.smithi163.stdout: "error", 2023-07-14T18:29:20.090 INFO:teuthology.orchestra.run.smithi163.stdout: "info", 2023-07-14T18:29:20.091 INFO:teuthology.orchestra.run.smithi163.stdout: "warning" 2023-07-14T18:29:20.091 INFO:teuthology.orchestra.run.smithi163.stdout: ], 2023-07-14T18:29:20.091 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:20.091 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:20.091 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:20.092 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:20.092 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:20.092 INFO:teuthology.orchestra.run.smithi163.stdout: "log_to_cluster": { 2023-07-14T18:29:20.092 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "log_to_cluster", 2023-07-14T18:29:20.092 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "bool", 2023-07-14T18:29:20.093 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:20.093 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:20.093 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "False", 2023-07-14T18:29:20.093 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:20.093 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:20.094 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:20.094 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:20.094 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:20.094 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:20.094 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:20.095 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:20.095 INFO:teuthology.orchestra.run.smithi163.stdout: "log_to_cluster_level": { 2023-07-14T18:29:20.095 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "log_to_cluster_level", 2023-07-14T18:29:20.095 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "str", 2023-07-14T18:29:20.095 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:20.096 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:20.096 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "info", 2023-07-14T18:29:20.096 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:20.096 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:20.096 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [ 2023-07-14T18:29:20.097 INFO:teuthology.orchestra.run.smithi163.stdout: "", 2023-07-14T18:29:20.097 INFO:teuthology.orchestra.run.smithi163.stdout: "critical", 2023-07-14T18:29:20.097 INFO:teuthology.orchestra.run.smithi163.stdout: "debug", 2023-07-14T18:29:20.097 INFO:teuthology.orchestra.run.smithi163.stdout: "error", 2023-07-14T18:29:20.097 INFO:teuthology.orchestra.run.smithi163.stdout: "info", 2023-07-14T18:29:20.097 INFO:teuthology.orchestra.run.smithi163.stdout: "warning" 2023-07-14T18:29:20.098 INFO:teuthology.orchestra.run.smithi163.stdout: ], 2023-07-14T18:29:20.098 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:20.098 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:20.098 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:20.098 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:20.099 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:20.099 INFO:teuthology.orchestra.run.smithi163.stdout: "log_to_file": { 2023-07-14T18:29:20.099 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "log_to_file", 2023-07-14T18:29:20.099 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "bool", 2023-07-14T18:29:20.099 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:20.100 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:20.100 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "False", 2023-07-14T18:29:20.100 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:20.100 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:20.100 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:20.101 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:20.101 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:20.101 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:20.101 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:20.101 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-07-14T18:29:20.102 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-07-14T18:29:20.102 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:20.102 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-07-14T18:29:20.102 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "volumes", 2023-07-14T18:29:20.102 INFO:teuthology.orchestra.run.smithi163.stdout: "can_run": true, 2023-07-14T18:29:20.103 INFO:teuthology.orchestra.run.smithi163.stdout: "error_string": "", 2023-07-14T18:29:20.103 INFO:teuthology.orchestra.run.smithi163.stdout: "module_options": { 2023-07-14T18:29:20.103 INFO:teuthology.orchestra.run.smithi163.stdout: "log_level": { 2023-07-14T18:29:20.103 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "log_level", 2023-07-14T18:29:20.103 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "str", 2023-07-14T18:29:20.103 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:20.104 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:20.104 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "", 2023-07-14T18:29:20.104 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:20.104 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:20.104 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [ 2023-07-14T18:29:20.105 INFO:teuthology.orchestra.run.smithi163.stdout: "", 2023-07-14T18:29:20.105 INFO:teuthology.orchestra.run.smithi163.stdout: "critical", 2023-07-14T18:29:20.105 INFO:teuthology.orchestra.run.smithi163.stdout: "debug", 2023-07-14T18:29:20.105 INFO:teuthology.orchestra.run.smithi163.stdout: "error", 2023-07-14T18:29:20.105 INFO:teuthology.orchestra.run.smithi163.stdout: "info", 2023-07-14T18:29:20.106 INFO:teuthology.orchestra.run.smithi163.stdout: "warning" 2023-07-14T18:29:20.106 INFO:teuthology.orchestra.run.smithi163.stdout: ], 2023-07-14T18:29:20.106 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:20.106 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:20.106 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:20.107 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:20.107 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:20.107 INFO:teuthology.orchestra.run.smithi163.stdout: "log_to_cluster": { 2023-07-14T18:29:20.107 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "log_to_cluster", 2023-07-14T18:29:20.107 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "bool", 2023-07-14T18:29:20.108 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:20.108 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:20.108 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "False", 2023-07-14T18:29:20.108 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:20.108 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:20.109 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:20.109 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:20.109 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:20.109 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:20.109 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:20.109 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:20.110 INFO:teuthology.orchestra.run.smithi163.stdout: "log_to_cluster_level": { 2023-07-14T18:29:20.110 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "log_to_cluster_level", 2023-07-14T18:29:20.110 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "str", 2023-07-14T18:29:20.110 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:20.111 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:20.111 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "info", 2023-07-14T18:29:20.111 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:20.111 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:20.111 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [ 2023-07-14T18:29:20.111 INFO:teuthology.orchestra.run.smithi163.stdout: "", 2023-07-14T18:29:20.112 INFO:teuthology.orchestra.run.smithi163.stdout: "critical", 2023-07-14T18:29:20.112 INFO:teuthology.orchestra.run.smithi163.stdout: "debug", 2023-07-14T18:29:20.112 INFO:teuthology.orchestra.run.smithi163.stdout: "error", 2023-07-14T18:29:20.113 INFO:teuthology.orchestra.run.smithi163.stdout: "info", 2023-07-14T18:29:20.113 INFO:teuthology.orchestra.run.smithi163.stdout: "warning" 2023-07-14T18:29:20.113 INFO:teuthology.orchestra.run.smithi163.stdout: ], 2023-07-14T18:29:20.113 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:20.114 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:20.114 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:20.114 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:20.114 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:20.114 INFO:teuthology.orchestra.run.smithi163.stdout: "log_to_file": { 2023-07-14T18:29:20.115 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "log_to_file", 2023-07-14T18:29:20.115 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "bool", 2023-07-14T18:29:20.115 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:20.115 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:20.115 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "False", 2023-07-14T18:29:20.116 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:20.116 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:20.116 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:20.116 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:20.116 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:20.117 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:20.117 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:20.117 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:20.117 INFO:teuthology.orchestra.run.smithi163.stdout: "max_concurrent_clones": { 2023-07-14T18:29:20.117 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "max_concurrent_clones", 2023-07-14T18:29:20.118 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "int", 2023-07-14T18:29:20.118 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:20.118 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:20.118 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "4", 2023-07-14T18:29:20.118 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:20.119 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:20.119 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:20.119 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "Number of asynchronous cloner threads", 2023-07-14T18:29:20.119 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:20.119 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:20.120 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:20.120 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:20.120 INFO:teuthology.orchestra.run.smithi163.stdout: "snapshot_clone_delay": { 2023-07-14T18:29:20.120 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "snapshot_clone_delay", 2023-07-14T18:29:20.121 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "int", 2023-07-14T18:29:20.121 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:20.121 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:20.121 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "0", 2023-07-14T18:29:20.121 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:20.122 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:20.122 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:20.122 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2023-07-14T18:29:20.122 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:20.122 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:20.123 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:20.123 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-07-14T18:29:20.123 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-07-14T18:29:20.123 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:20.123 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-07-14T18:29:20.124 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "zabbix", 2023-07-14T18:29:20.124 INFO:teuthology.orchestra.run.smithi163.stdout: "can_run": true, 2023-07-14T18:29:20.124 INFO:teuthology.orchestra.run.smithi163.stdout: "error_string": "", 2023-07-14T18:29:20.124 INFO:teuthology.orchestra.run.smithi163.stdout: "module_options": { 2023-07-14T18:29:20.124 INFO:teuthology.orchestra.run.smithi163.stdout: "discovery_interval": { 2023-07-14T18:29:20.125 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "discovery_interval", 2023-07-14T18:29:20.125 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "uint", 2023-07-14T18:29:20.125 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:20.125 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:20.125 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "100", 2023-07-14T18:29:20.126 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:20.126 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:20.126 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:20.126 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:20.126 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:20.127 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:20.127 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:20.127 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:20.127 INFO:teuthology.orchestra.run.smithi163.stdout: "identifier": { 2023-07-14T18:29:20.127 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "identifier", 2023-07-14T18:29:20.128 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "str", 2023-07-14T18:29:20.128 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:20.128 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:20.128 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "", 2023-07-14T18:29:20.128 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:20.129 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:20.129 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:20.129 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:20.129 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:20.129 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:20.129 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:20.130 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:20.130 INFO:teuthology.orchestra.run.smithi163.stdout: "interval": { 2023-07-14T18:29:20.130 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "interval", 2023-07-14T18:29:20.130 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "secs", 2023-07-14T18:29:20.130 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:20.131 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:20.131 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "60", 2023-07-14T18:29:20.131 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:20.131 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:20.131 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:20.132 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:20.132 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:20.132 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:20.132 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:20.132 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:20.133 INFO:teuthology.orchestra.run.smithi163.stdout: "log_level": { 2023-07-14T18:29:20.133 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "log_level", 2023-07-14T18:29:20.133 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "str", 2023-07-14T18:29:20.133 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:20.133 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:20.134 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "", 2023-07-14T18:29:20.134 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:20.134 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:20.134 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [ 2023-07-14T18:29:20.134 INFO:teuthology.orchestra.run.smithi163.stdout: "", 2023-07-14T18:29:20.134 INFO:teuthology.orchestra.run.smithi163.stdout: "critical", 2023-07-14T18:29:20.135 INFO:teuthology.orchestra.run.smithi163.stdout: "debug", 2023-07-14T18:29:20.135 INFO:teuthology.orchestra.run.smithi163.stdout: "error", 2023-07-14T18:29:20.135 INFO:teuthology.orchestra.run.smithi163.stdout: "info", 2023-07-14T18:29:20.135 INFO:teuthology.orchestra.run.smithi163.stdout: "warning" 2023-07-14T18:29:20.135 INFO:teuthology.orchestra.run.smithi163.stdout: ], 2023-07-14T18:29:20.136 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:20.136 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:20.136 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:20.136 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:20.137 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:20.137 INFO:teuthology.orchestra.run.smithi163.stdout: "log_to_cluster": { 2023-07-14T18:29:20.137 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "log_to_cluster", 2023-07-14T18:29:20.137 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "bool", 2023-07-14T18:29:20.137 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:20.137 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:20.138 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "False", 2023-07-14T18:29:20.138 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:20.138 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:20.138 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:20.138 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:20.139 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:20.139 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:20.139 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:20.139 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:20.139 INFO:teuthology.orchestra.run.smithi163.stdout: "log_to_cluster_level": { 2023-07-14T18:29:20.140 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "log_to_cluster_level", 2023-07-14T18:29:20.140 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "str", 2023-07-14T18:29:20.140 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:20.140 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:20.140 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "info", 2023-07-14T18:29:20.141 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:20.141 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:20.141 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [ 2023-07-14T18:29:20.141 INFO:teuthology.orchestra.run.smithi163.stdout: "", 2023-07-14T18:29:20.141 INFO:teuthology.orchestra.run.smithi163.stdout: "critical", 2023-07-14T18:29:20.142 INFO:teuthology.orchestra.run.smithi163.stdout: "debug", 2023-07-14T18:29:20.142 INFO:teuthology.orchestra.run.smithi163.stdout: "error", 2023-07-14T18:29:20.142 INFO:teuthology.orchestra.run.smithi163.stdout: "info", 2023-07-14T18:29:20.142 INFO:teuthology.orchestra.run.smithi163.stdout: "warning" 2023-07-14T18:29:20.142 INFO:teuthology.orchestra.run.smithi163.stdout: ], 2023-07-14T18:29:20.143 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:20.143 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:20.143 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:20.143 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:20.143 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:20.143 INFO:teuthology.orchestra.run.smithi163.stdout: "log_to_file": { 2023-07-14T18:29:20.144 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "log_to_file", 2023-07-14T18:29:20.144 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "bool", 2023-07-14T18:29:20.144 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:20.144 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 1, 2023-07-14T18:29:20.145 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "False", 2023-07-14T18:29:20.145 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:20.145 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:20.145 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:20.145 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:20.145 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:20.146 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:20.146 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:20.146 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:20.146 INFO:teuthology.orchestra.run.smithi163.stdout: "zabbix_host": { 2023-07-14T18:29:20.146 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "zabbix_host", 2023-07-14T18:29:20.147 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "str", 2023-07-14T18:29:20.147 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:20.147 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:20.147 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "", 2023-07-14T18:29:20.147 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:20.148 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:20.148 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:20.148 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:20.148 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:20.148 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:20.149 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:20.149 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:20.149 INFO:teuthology.orchestra.run.smithi163.stdout: "zabbix_port": { 2023-07-14T18:29:20.149 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "zabbix_port", 2023-07-14T18:29:20.149 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "int", 2023-07-14T18:29:20.150 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:20.150 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:20.150 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "10051", 2023-07-14T18:29:20.150 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:20.150 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:20.150 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:20.151 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:20.151 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:20.151 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:20.151 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:20.151 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:20.152 INFO:teuthology.orchestra.run.smithi163.stdout: "zabbix_sender": { 2023-07-14T18:29:20.152 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "zabbix_sender", 2023-07-14T18:29:20.152 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "str", 2023-07-14T18:29:20.152 INFO:teuthology.orchestra.run.smithi163.stdout: "level": "advanced", 2023-07-14T18:29:20.152 INFO:teuthology.orchestra.run.smithi163.stdout: "flags": 0, 2023-07-14T18:29:20.153 INFO:teuthology.orchestra.run.smithi163.stdout: "default_value": "/usr/bin/zabbix_sender", 2023-07-14T18:29:20.153 INFO:teuthology.orchestra.run.smithi163.stdout: "min": "", 2023-07-14T18:29:20.153 INFO:teuthology.orchestra.run.smithi163.stdout: "max": "", 2023-07-14T18:29:20.153 INFO:teuthology.orchestra.run.smithi163.stdout: "enum_allowed": [], 2023-07-14T18:29:20.153 INFO:teuthology.orchestra.run.smithi163.stdout: "desc": "", 2023-07-14T18:29:20.154 INFO:teuthology.orchestra.run.smithi163.stdout: "long_desc": "", 2023-07-14T18:29:20.154 INFO:teuthology.orchestra.run.smithi163.stdout: "tags": [], 2023-07-14T18:29:20.154 INFO:teuthology.orchestra.run.smithi163.stdout: "see_also": [] 2023-07-14T18:29:20.154 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-07-14T18:29:20.154 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-07-14T18:29:20.154 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-07-14T18:29:20.155 INFO:teuthology.orchestra.run.smithi163.stdout: ], 2023-07-14T18:29:20.155 INFO:teuthology.orchestra.run.smithi163.stdout: "services": { 2023-07-14T18:29:20.155 INFO:teuthology.orchestra.run.smithi163.stdout: "dashboard": "https://172.21.15.163:8443/" 2023-07-14T18:29:20.155 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:20.155 INFO:teuthology.orchestra.run.smithi163.stdout: "always_on_modules": { 2023-07-14T18:29:20.156 INFO:teuthology.orchestra.run.smithi163.stdout: "octopus": [ 2023-07-14T18:29:20.156 INFO:teuthology.orchestra.run.smithi163.stdout: "balancer", 2023-07-14T18:29:20.156 INFO:teuthology.orchestra.run.smithi163.stdout: "crash", 2023-07-14T18:29:20.156 INFO:teuthology.orchestra.run.smithi163.stdout: "devicehealth", 2023-07-14T18:29:20.156 INFO:teuthology.orchestra.run.smithi163.stdout: "orchestrator", 2023-07-14T18:29:20.157 INFO:teuthology.orchestra.run.smithi163.stdout: "pg_autoscaler", 2023-07-14T18:29:20.157 INFO:teuthology.orchestra.run.smithi163.stdout: "progress", 2023-07-14T18:29:20.157 INFO:teuthology.orchestra.run.smithi163.stdout: "rbd_support", 2023-07-14T18:29:20.157 INFO:teuthology.orchestra.run.smithi163.stdout: "status", 2023-07-14T18:29:20.157 INFO:teuthology.orchestra.run.smithi163.stdout: "telemetry", 2023-07-14T18:29:20.158 INFO:teuthology.orchestra.run.smithi163.stdout: "volumes" 2023-07-14T18:29:20.158 INFO:teuthology.orchestra.run.smithi163.stdout: ], 2023-07-14T18:29:20.158 INFO:teuthology.orchestra.run.smithi163.stdout: "pacific": [ 2023-07-14T18:29:20.158 INFO:teuthology.orchestra.run.smithi163.stdout: "balancer", 2023-07-14T18:29:20.158 INFO:teuthology.orchestra.run.smithi163.stdout: "crash", 2023-07-14T18:29:20.158 INFO:teuthology.orchestra.run.smithi163.stdout: "devicehealth", 2023-07-14T18:29:20.159 INFO:teuthology.orchestra.run.smithi163.stdout: "orchestrator", 2023-07-14T18:29:20.159 INFO:teuthology.orchestra.run.smithi163.stdout: "pg_autoscaler", 2023-07-14T18:29:20.159 INFO:teuthology.orchestra.run.smithi163.stdout: "progress", 2023-07-14T18:29:20.159 INFO:teuthology.orchestra.run.smithi163.stdout: "rbd_support", 2023-07-14T18:29:20.159 INFO:teuthology.orchestra.run.smithi163.stdout: "status", 2023-07-14T18:29:20.160 INFO:teuthology.orchestra.run.smithi163.stdout: "telemetry", 2023-07-14T18:29:20.160 INFO:teuthology.orchestra.run.smithi163.stdout: "volumes" 2023-07-14T18:29:20.160 INFO:teuthology.orchestra.run.smithi163.stdout: ], 2023-07-14T18:29:20.160 INFO:teuthology.orchestra.run.smithi163.stdout: "quincy": [ 2023-07-14T18:29:20.160 INFO:teuthology.orchestra.run.smithi163.stdout: "balancer", 2023-07-14T18:29:20.161 INFO:teuthology.orchestra.run.smithi163.stdout: "crash", 2023-07-14T18:29:20.161 INFO:teuthology.orchestra.run.smithi163.stdout: "devicehealth", 2023-07-14T18:29:20.161 INFO:teuthology.orchestra.run.smithi163.stdout: "orchestrator", 2023-07-14T18:29:20.161 INFO:teuthology.orchestra.run.smithi163.stdout: "pg_autoscaler", 2023-07-14T18:29:20.161 INFO:teuthology.orchestra.run.smithi163.stdout: "progress", 2023-07-14T18:29:20.162 INFO:teuthology.orchestra.run.smithi163.stdout: "rbd_support", 2023-07-14T18:29:20.162 INFO:teuthology.orchestra.run.smithi163.stdout: "status", 2023-07-14T18:29:20.162 INFO:teuthology.orchestra.run.smithi163.stdout: "telemetry", 2023-07-14T18:29:20.162 INFO:teuthology.orchestra.run.smithi163.stdout: "volumes" 2023-07-14T18:29:20.162 INFO:teuthology.orchestra.run.smithi163.stdout: ], 2023-07-14T18:29:20.162 INFO:teuthology.orchestra.run.smithi163.stdout: "reef": [ 2023-07-14T18:29:20.163 INFO:teuthology.orchestra.run.smithi163.stdout: "balancer", 2023-07-14T18:29:20.163 INFO:teuthology.orchestra.run.smithi163.stdout: "crash", 2023-07-14T18:29:20.163 INFO:teuthology.orchestra.run.smithi163.stdout: "devicehealth", 2023-07-14T18:29:20.163 INFO:teuthology.orchestra.run.smithi163.stdout: "orchestrator", 2023-07-14T18:29:20.163 INFO:teuthology.orchestra.run.smithi163.stdout: "pg_autoscaler", 2023-07-14T18:29:20.164 INFO:teuthology.orchestra.run.smithi163.stdout: "progress", 2023-07-14T18:29:20.164 INFO:teuthology.orchestra.run.smithi163.stdout: "rbd_support", 2023-07-14T18:29:20.164 INFO:teuthology.orchestra.run.smithi163.stdout: "status", 2023-07-14T18:29:20.164 INFO:teuthology.orchestra.run.smithi163.stdout: "telemetry", 2023-07-14T18:29:20.164 INFO:teuthology.orchestra.run.smithi163.stdout: "volumes" 2023-07-14T18:29:20.165 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-07-14T18:29:20.165 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:20.165 INFO:teuthology.orchestra.run.smithi163.stdout: "last_failure_osd_epoch": 3, 2023-07-14T18:29:20.165 INFO:teuthology.orchestra.run.smithi163.stdout: "active_clients": [ 2023-07-14T18:29:20.165 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-07-14T18:29:20.166 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "devicehealth", 2023-07-14T18:29:20.166 INFO:teuthology.orchestra.run.smithi163.stdout: "addrvec": [ 2023-07-14T18:29:20.166 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-07-14T18:29:20.166 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "v2", 2023-07-14T18:29:20.166 INFO:teuthology.orchestra.run.smithi163.stdout: "addr": "172.21.15.163:0", 2023-07-14T18:29:20.166 INFO:teuthology.orchestra.run.smithi163.stdout: "nonce": 606557271 2023-07-14T18:29:20.167 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-07-14T18:29:20.167 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-07-14T18:29:20.167 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:20.167 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-07-14T18:29:20.167 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "libcephsqlite", 2023-07-14T18:29:20.168 INFO:teuthology.orchestra.run.smithi163.stdout: "addrvec": [ 2023-07-14T18:29:20.168 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-07-14T18:29:20.168 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "v2", 2023-07-14T18:29:20.168 INFO:teuthology.orchestra.run.smithi163.stdout: "addr": "172.21.15.163:0", 2023-07-14T18:29:20.168 INFO:teuthology.orchestra.run.smithi163.stdout: "nonce": 1374381674 2023-07-14T18:29:20.169 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-07-14T18:29:20.169 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-07-14T18:29:20.169 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:20.169 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-07-14T18:29:20.169 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "rbd_support", 2023-07-14T18:29:20.170 INFO:teuthology.orchestra.run.smithi163.stdout: "addrvec": [ 2023-07-14T18:29:20.170 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-07-14T18:29:20.170 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "v2", 2023-07-14T18:29:20.170 INFO:teuthology.orchestra.run.smithi163.stdout: "addr": "172.21.15.163:0", 2023-07-14T18:29:20.170 INFO:teuthology.orchestra.run.smithi163.stdout: "nonce": 3447485118 2023-07-14T18:29:20.170 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-07-14T18:29:20.171 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-07-14T18:29:20.171 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:20.171 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-07-14T18:29:20.171 INFO:teuthology.orchestra.run.smithi163.stdout: "name": "volumes", 2023-07-14T18:29:20.171 INFO:teuthology.orchestra.run.smithi163.stdout: "addrvec": [ 2023-07-14T18:29:20.172 INFO:teuthology.orchestra.run.smithi163.stdout: { 2023-07-14T18:29:20.172 INFO:teuthology.orchestra.run.smithi163.stdout: "type": "v2", 2023-07-14T18:29:20.172 INFO:teuthology.orchestra.run.smithi163.stdout: "addr": "172.21.15.163:0", 2023-07-14T18:29:20.172 INFO:teuthology.orchestra.run.smithi163.stdout: "nonce": 4095099911 2023-07-14T18:29:20.172 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-07-14T18:29:20.173 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-07-14T18:29:20.173 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-07-14T18:29:20.173 INFO:teuthology.orchestra.run.smithi163.stdout: ] 2023-07-14T18:29:20.173 INFO:teuthology.orchestra.run.smithi163.stdout:} 2023-07-14T18:29:20.175 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:29:16 smithi172 ceph-mon[97983]: pgmap v798: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-07-14T18:29:20.175 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:29:16 smithi172 ceph-mon[97983]: from='client.? 172.21.15.163:0/1993556356' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2023-07-14T18:29:20.175 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:29:16 smithi172 ceph-mon[97983]: from='client.? 172.21.15.163:0/3067906713' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json-pretty"}]: dispatch 2023-07-14T18:29:20.175 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:29:18 smithi172 ceph-mon[97983]: pgmap v799: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-07-14T18:29:20.176 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:29:16 smithi184 ceph-mon[98481]: pgmap v798: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-07-14T18:29:20.176 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:29:16 smithi184 ceph-mon[98481]: from='client.? 172.21.15.163:0/1993556356' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2023-07-14T18:29:20.176 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:29:16 smithi184 ceph-mon[98481]: from='client.? 172.21.15.163:0/3067906713' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json-pretty"}]: dispatch 2023-07-14T18:29:20.176 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:29:18 smithi184 ceph-mon[98481]: pgmap v799: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-07-14T18:29:20.177 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:16.630+0000 7f4929504700 1 -- 172.21.15.163:0/3067906713 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f490c0a11a0 msgr2=0x7f490c0a3650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:29:20.177 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:16.630+0000 7f4929504700 1 --2- 172.21.15.163:0/3067906713 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f490c0a11a0 0x7f490c0a3650 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f491800b2e0 tx=0x7f4918004500 comp rx=0 tx=0).stop 2023-07-14T18:29:20.177 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:16.630+0000 7f4929504700 1 -- 172.21.15.163:0/3067906713 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f49240feb00 msgr2=0x7f4924197a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:29:20.177 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:16.630+0000 7f4929504700 1 --2- 172.21.15.163:0/3067906713 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f49240feb00 0x7f4924197a20 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7f49140099f0 tx=0x7f4914009d00 comp rx=0 tx=0).stop 2023-07-14T18:29:20.178 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:16.630+0000 7f4929504700 1 -- 172.21.15.163:0/3067906713 shutdown_connections 2023-07-14T18:29:20.178 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:16.630+0000 7f4929504700 1 --2- 172.21.15.163:0/3067906713 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f490c0a11a0 0x7f490c0a3650 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:29:20.178 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:16.630+0000 7f4929504700 1 --2- 172.21.15.163:0/3067906713 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4924100680 0x7f492419efd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:29:20.178 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:16.630+0000 7f4929504700 1 --2- 172.21.15.163:0/3067906713 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f49240feb00 0x7f4924197a20 unknown :-1 s=CLOSED pgs=765 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:29:20.178 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:16.630+0000 7f4929504700 1 --2- 172.21.15.163:0/3067906713 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f49240ffcf0 0x7f4924197f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:29:20.179 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:16.630+0000 7f4929504700 1 -- 172.21.15.163:0/3067906713 >> 172.21.15.163:0/3067906713 conn(0x7f49240fa100 msgr2=0x7f49240fc360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:29:20.179 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:16.630+0000 7f4929504700 1 -- 172.21.15.163:0/3067906713 shutdown_connections 2023-07-14T18:29:20.179 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:29:16.630+0000 7f4929504700 1 -- 172.21.15.163:0/3067906713 wait complete. 2023-07-14T18:29:20.186 DEBUG:tasks.check_counter:Getting stats from a 2023-07-14T18:29:20.186 DEBUG:teuthology.orchestra.run.smithi163:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81c9387d2e7576da065747ec9c16d1c7d69016ec shell --fsid bf7326ec-2270-11ee-9b33-001a4aab830c -- ceph daemon mds.a perf dump 2023-07-14T18:29:20.187 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:29:16 smithi163 ceph-mon[96576]: pgmap v798: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-07-14T18:29:20.187 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:29:16 smithi163 ceph-mon[96576]: from='client.? 172.21.15.163:0/1993556356' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2023-07-14T18:29:20.188 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:29:16 smithi163 ceph-mon[96576]: from='client.? 172.21.15.163:0/3067906713' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json-pretty"}]: dispatch 2023-07-14T18:29:20.188 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:29:18 smithi163 ceph-mon[96576]: pgmap v799: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-07-14T18:29:20.769 INFO:teuthology.orchestra.run.smithi163.stderr:Inferring config /var/lib/ceph/bf7326ec-2270-11ee-9b33-001a4aab830c/mon.a/config 2023-07-14T18:29:21.045 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:29:20 smithi163 ceph-mon[96576]: pgmap v800: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-07-14T18:29:21.167 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:29:20 smithi184 ceph-mon[98481]: pgmap v800: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-07-14T18:29:21.268 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:29:20 smithi172 ceph-mon[97983]: pgmap v800: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-07-14T18:29:22.029 INFO:teuthology.orchestra.run.smithi163.stdout:{ 2023-07-14T18:29:22.030 INFO:teuthology.orchestra.run.smithi163.stdout: "AsyncMessenger::Worker-0": { 2023-07-14T18:29:22.030 INFO:teuthology.orchestra.run.smithi163.stdout: "msgr_recv_messages": 4948437, 2023-07-14T18:29:22.030 INFO:teuthology.orchestra.run.smithi163.stdout: "msgr_send_messages": 4950034, 2023-07-14T18:29:22.031 INFO:teuthology.orchestra.run.smithi163.stdout: "msgr_recv_bytes": 824928930, 2023-07-14T18:29:22.031 INFO:teuthology.orchestra.run.smithi163.stdout: "msgr_send_bytes": 787628692, 2023-07-14T18:29:22.031 INFO:teuthology.orchestra.run.smithi163.stdout: "msgr_created_connections": 15, 2023-07-14T18:29:22.031 INFO:teuthology.orchestra.run.smithi163.stdout: "msgr_active_connections": 6, 2023-07-14T18:29:22.031 INFO:teuthology.orchestra.run.smithi163.stdout: "msgr_running_total_time": 141.778434962, 2023-07-14T18:29:22.032 INFO:teuthology.orchestra.run.smithi163.stdout: "msgr_running_send_time": 56.504823532, 2023-07-14T18:29:22.032 INFO:teuthology.orchestra.run.smithi163.stdout: "msgr_running_recv_time": 100.213754536, 2023-07-14T18:29:22.032 INFO:teuthology.orchestra.run.smithi163.stdout: "msgr_running_fast_dispatch_time": 0.022651274, 2023-07-14T18:29:22.032 INFO:teuthology.orchestra.run.smithi163.stdout: "msgr_send_messages_queue_lat": { 2023-07-14T18:29:22.032 INFO:teuthology.orchestra.run.smithi163.stdout: "avgcount": 4950032, 2023-07-14T18:29:22.033 INFO:teuthology.orchestra.run.smithi163.stdout: "sum": 39.558473970, 2023-07-14T18:29:22.033 INFO:teuthology.orchestra.run.smithi163.stdout: "avgtime": 0.000007991 2023-07-14T18:29:22.033 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:22.033 INFO:teuthology.orchestra.run.smithi163.stdout: "msgr_handle_ack_lat": { 2023-07-14T18:29:22.033 INFO:teuthology.orchestra.run.smithi163.stdout: "avgcount": 9895871, 2023-07-14T18:29:22.034 INFO:teuthology.orchestra.run.smithi163.stdout: "sum": 0.772355558, 2023-07-14T18:29:22.034 INFO:teuthology.orchestra.run.smithi163.stdout: "avgtime": 0.000000078 2023-07-14T18:29:22.034 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:22.034 INFO:teuthology.orchestra.run.smithi163.stdout: "msgr_recv_encrypted_bytes": 598464, 2023-07-14T18:29:22.034 INFO:teuthology.orchestra.run.smithi163.stdout: "msgr_send_encrypted_bytes": 176016 2023-07-14T18:29:22.035 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:22.035 INFO:teuthology.orchestra.run.smithi163.stdout: "AsyncMessenger::Worker-1": { 2023-07-14T18:29:22.035 INFO:teuthology.orchestra.run.smithi163.stdout: "msgr_recv_messages": 842624, 2023-07-14T18:29:22.035 INFO:teuthology.orchestra.run.smithi163.stdout: "msgr_send_messages": 837942, 2023-07-14T18:29:22.035 INFO:teuthology.orchestra.run.smithi163.stdout: "msgr_recv_bytes": 175275385, 2023-07-14T18:29:22.035 INFO:teuthology.orchestra.run.smithi163.stdout: "msgr_send_bytes": 136733303, 2023-07-14T18:29:22.036 INFO:teuthology.orchestra.run.smithi163.stdout: "msgr_created_connections": 10, 2023-07-14T18:29:22.036 INFO:teuthology.orchestra.run.smithi163.stdout: "msgr_active_connections": 5, 2023-07-14T18:29:22.036 INFO:teuthology.orchestra.run.smithi163.stdout: "msgr_running_total_time": 26.974429365, 2023-07-14T18:29:22.036 INFO:teuthology.orchestra.run.smithi163.stdout: "msgr_running_send_time": 10.751436149, 2023-07-14T18:29:22.036 INFO:teuthology.orchestra.run.smithi163.stdout: "msgr_running_recv_time": 19.293747907, 2023-07-14T18:29:22.037 INFO:teuthology.orchestra.run.smithi163.stdout: "msgr_running_fast_dispatch_time": 0.041390806, 2023-07-14T18:29:22.037 INFO:teuthology.orchestra.run.smithi163.stdout: "msgr_send_messages_queue_lat": { 2023-07-14T18:29:22.037 INFO:teuthology.orchestra.run.smithi163.stdout: "avgcount": 837942, 2023-07-14T18:29:22.037 INFO:teuthology.orchestra.run.smithi163.stdout: "sum": 7.925136013, 2023-07-14T18:29:22.037 INFO:teuthology.orchestra.run.smithi163.stdout: "avgtime": 0.000009457 2023-07-14T18:29:22.038 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:22.038 INFO:teuthology.orchestra.run.smithi163.stdout: "msgr_handle_ack_lat": { 2023-07-14T18:29:22.038 INFO:teuthology.orchestra.run.smithi163.stdout: "avgcount": 1663371, 2023-07-14T18:29:22.038 INFO:teuthology.orchestra.run.smithi163.stdout: "sum": 0.147824145, 2023-07-14T18:29:22.038 INFO:teuthology.orchestra.run.smithi163.stdout: "avgtime": 0.000000088 2023-07-14T18:29:22.038 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:22.039 INFO:teuthology.orchestra.run.smithi163.stdout: "msgr_recv_encrypted_bytes": 160, 2023-07-14T18:29:22.039 INFO:teuthology.orchestra.run.smithi163.stdout: "msgr_send_encrypted_bytes": 466048 2023-07-14T18:29:22.039 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:22.039 INFO:teuthology.orchestra.run.smithi163.stdout: "AsyncMessenger::Worker-2": { 2023-07-14T18:29:22.039 INFO:teuthology.orchestra.run.smithi163.stdout: "msgr_recv_messages": 4407689, 2023-07-14T18:29:22.040 INFO:teuthology.orchestra.run.smithi163.stdout: "msgr_send_messages": 4407703, 2023-07-14T18:29:22.040 INFO:teuthology.orchestra.run.smithi163.stdout: "msgr_recv_bytes": 749446851, 2023-07-14T18:29:22.040 INFO:teuthology.orchestra.run.smithi163.stdout: "msgr_send_bytes": 707713322, 2023-07-14T18:29:22.040 INFO:teuthology.orchestra.run.smithi163.stdout: "msgr_created_connections": 17, 2023-07-14T18:29:22.040 INFO:teuthology.orchestra.run.smithi163.stdout: "msgr_active_connections": 9, 2023-07-14T18:29:22.041 INFO:teuthology.orchestra.run.smithi163.stdout: "msgr_running_total_time": 126.672762274, 2023-07-14T18:29:22.041 INFO:teuthology.orchestra.run.smithi163.stdout: "msgr_running_send_time": 50.066979633, 2023-07-14T18:29:22.041 INFO:teuthology.orchestra.run.smithi163.stdout: "msgr_running_recv_time": 90.579599410, 2023-07-14T18:29:22.041 INFO:teuthology.orchestra.run.smithi163.stdout: "msgr_running_fast_dispatch_time": 0.025664774, 2023-07-14T18:29:22.041 INFO:teuthology.orchestra.run.smithi163.stdout: "msgr_send_messages_queue_lat": { 2023-07-14T18:29:22.042 INFO:teuthology.orchestra.run.smithi163.stdout: "avgcount": 4407701, 2023-07-14T18:29:22.042 INFO:teuthology.orchestra.run.smithi163.stdout: "sum": 35.248237561, 2023-07-14T18:29:22.042 INFO:teuthology.orchestra.run.smithi163.stdout: "avgtime": 0.000007996 2023-07-14T18:29:22.042 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:22.042 INFO:teuthology.orchestra.run.smithi163.stdout: "msgr_handle_ack_lat": { 2023-07-14T18:29:22.042 INFO:teuthology.orchestra.run.smithi163.stdout: "avgcount": 8813685, 2023-07-14T18:29:22.043 INFO:teuthology.orchestra.run.smithi163.stdout: "sum": 0.699372002, 2023-07-14T18:29:22.043 INFO:teuthology.orchestra.run.smithi163.stdout: "avgtime": 0.000000079 2023-07-14T18:29:22.043 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:22.043 INFO:teuthology.orchestra.run.smithi163.stdout: "msgr_recv_encrypted_bytes": 0, 2023-07-14T18:29:22.043 INFO:teuthology.orchestra.run.smithi163.stdout: "msgr_send_encrypted_bytes": 0 2023-07-14T18:29:22.044 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:22.044 INFO:teuthology.orchestra.run.smithi163.stdout: "cct": { 2023-07-14T18:29:22.044 INFO:teuthology.orchestra.run.smithi163.stdout: "total_workers": 1, 2023-07-14T18:29:22.044 INFO:teuthology.orchestra.run.smithi163.stdout: "unhealthy_workers": 0 2023-07-14T18:29:22.044 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:22.045 INFO:teuthology.orchestra.run.smithi163.stdout: "finisher-MDSRank": { 2023-07-14T18:29:22.045 INFO:teuthology.orchestra.run.smithi163.stdout: "queue_len": 0, 2023-07-14T18:29:22.045 INFO:teuthology.orchestra.run.smithi163.stdout: "complete_latency": { 2023-07-14T18:29:22.045 INFO:teuthology.orchestra.run.smithi163.stdout: "avgcount": 1660, 2023-07-14T18:29:22.045 INFO:teuthology.orchestra.run.smithi163.stdout: "sum": 1.606469101, 2023-07-14T18:29:22.046 INFO:teuthology.orchestra.run.smithi163.stdout: "avgtime": 0.000967752 2023-07-14T18:29:22.046 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-07-14T18:29:22.046 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:22.046 INFO:teuthology.orchestra.run.smithi163.stdout: "finisher-PurgeQueue": { 2023-07-14T18:29:22.046 INFO:teuthology.orchestra.run.smithi163.stdout: "queue_len": 0, 2023-07-14T18:29:22.047 INFO:teuthology.orchestra.run.smithi163.stdout: "complete_latency": { 2023-07-14T18:29:22.047 INFO:teuthology.orchestra.run.smithi163.stdout: "avgcount": 718, 2023-07-14T18:29:22.047 INFO:teuthology.orchestra.run.smithi163.stdout: "sum": 0.039207087, 2023-07-14T18:29:22.047 INFO:teuthology.orchestra.run.smithi163.stdout: "avgtime": 0.000054605 2023-07-14T18:29:22.047 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-07-14T18:29:22.047 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:22.048 INFO:teuthology.orchestra.run.smithi163.stdout: "mds": { 2023-07-14T18:29:22.048 INFO:teuthology.orchestra.run.smithi163.stdout: "request": 7927, 2023-07-14T18:29:22.048 INFO:teuthology.orchestra.run.smithi163.stdout: "reply": 5175, 2023-07-14T18:29:22.048 INFO:teuthology.orchestra.run.smithi163.stdout: "reply_latency": { 2023-07-14T18:29:22.048 INFO:teuthology.orchestra.run.smithi163.stdout: "avgcount": 5175, 2023-07-14T18:29:22.049 INFO:teuthology.orchestra.run.smithi163.stdout: "sum": 3.501051120, 2023-07-14T18:29:22.049 INFO:teuthology.orchestra.run.smithi163.stdout: "avgtime": 0.000676531 2023-07-14T18:29:22.049 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:22.049 INFO:teuthology.orchestra.run.smithi163.stdout: "slow_reply": 0, 2023-07-14T18:29:22.049 INFO:teuthology.orchestra.run.smithi163.stdout: "forward": 2752, 2023-07-14T18:29:22.050 INFO:teuthology.orchestra.run.smithi163.stdout: "dir_fetch_complete": 0, 2023-07-14T18:29:22.050 INFO:teuthology.orchestra.run.smithi163.stdout: "dir_fetch_keys": 0, 2023-07-14T18:29:22.050 INFO:teuthology.orchestra.run.smithi163.stdout: "dir_commit": 11, 2023-07-14T18:29:22.050 INFO:teuthology.orchestra.run.smithi163.stdout: "dir_split": 0, 2023-07-14T18:29:22.050 INFO:teuthology.orchestra.run.smithi163.stdout: "dir_merge": 0, 2023-07-14T18:29:22.051 INFO:teuthology.orchestra.run.smithi163.stdout: "inodes": 1161, 2023-07-14T18:29:22.051 INFO:teuthology.orchestra.run.smithi163.stdout: "inodes_top": 55, 2023-07-14T18:29:22.051 INFO:teuthology.orchestra.run.smithi163.stdout: "inodes_bottom": 1106, 2023-07-14T18:29:22.051 INFO:teuthology.orchestra.run.smithi163.stdout: "inodes_pin_tail": 0, 2023-07-14T18:29:22.051 INFO:teuthology.orchestra.run.smithi163.stdout: "inodes_pinned": 1082, 2023-07-14T18:29:22.051 INFO:teuthology.orchestra.run.smithi163.stdout: "inodes_expired": 8, 2023-07-14T18:29:22.052 INFO:teuthology.orchestra.run.smithi163.stdout: "inodes_with_caps": 839, 2023-07-14T18:29:22.052 INFO:teuthology.orchestra.run.smithi163.stdout: "caps": 839, 2023-07-14T18:29:22.052 INFO:teuthology.orchestra.run.smithi163.stdout: "subtrees": 96, 2023-07-14T18:29:22.052 INFO:teuthology.orchestra.run.smithi163.stdout: "traverse": 14510, 2023-07-14T18:29:22.052 INFO:teuthology.orchestra.run.smithi163.stdout: "traverse_hit": 1666, 2023-07-14T18:29:22.053 INFO:teuthology.orchestra.run.smithi163.stdout: "traverse_forward": 2752, 2023-07-14T18:29:22.053 INFO:teuthology.orchestra.run.smithi163.stdout: "traverse_discover": 60, 2023-07-14T18:29:22.053 INFO:teuthology.orchestra.run.smithi163.stdout: "traverse_dir_fetch": 0, 2023-07-14T18:29:22.053 INFO:teuthology.orchestra.run.smithi163.stdout: "traverse_remote_ino": 0, 2023-07-14T18:29:22.053 INFO:teuthology.orchestra.run.smithi163.stdout: "traverse_lock": 0, 2023-07-14T18:29:22.054 INFO:teuthology.orchestra.run.smithi163.stdout: "load_cent": 0, 2023-07-14T18:29:22.054 INFO:teuthology.orchestra.run.smithi163.stdout: "q": 0, 2023-07-14T18:29:22.054 INFO:teuthology.orchestra.run.smithi163.stdout: "exported": 0, 2023-07-14T18:29:22.054 INFO:teuthology.orchestra.run.smithi163.stdout: "exported_inodes": 0, 2023-07-14T18:29:22.054 INFO:teuthology.orchestra.run.smithi163.stdout: "imported": 46, 2023-07-14T18:29:22.055 INFO:teuthology.orchestra.run.smithi163.stdout: "imported_inodes": 987, 2023-07-14T18:29:22.055 INFO:teuthology.orchestra.run.smithi163.stdout: "openino_dir_fetch": 0, 2023-07-14T18:29:22.055 INFO:teuthology.orchestra.run.smithi163.stdout: "openino_backtrace_fetch": 334, 2023-07-14T18:29:22.055 INFO:teuthology.orchestra.run.smithi163.stdout: "openino_peer_discover": 0, 2023-07-14T18:29:22.055 INFO:teuthology.orchestra.run.smithi163.stdout: "root_rfiles": 3563, 2023-07-14T18:29:22.056 INFO:teuthology.orchestra.run.smithi163.stdout: "root_rbytes": 33808819, 2023-07-14T18:29:22.056 INFO:teuthology.orchestra.run.smithi163.stdout: "root_rsnaps": 0, 2023-07-14T18:29:22.056 INFO:teuthology.orchestra.run.smithi163.stdout: "scrub_backtrace_fetch": 334, 2023-07-14T18:29:22.056 INFO:teuthology.orchestra.run.smithi163.stdout: "scrub_set_tag": 0, 2023-07-14T18:29:22.056 INFO:teuthology.orchestra.run.smithi163.stdout: "scrub_backtrace_repaired": 0, 2023-07-14T18:29:22.057 INFO:teuthology.orchestra.run.smithi163.stdout: "scrub_inotable_repaired": 0, 2023-07-14T18:29:22.057 INFO:teuthology.orchestra.run.smithi163.stdout: "scrub_dir_inodes": 0, 2023-07-14T18:29:22.057 INFO:teuthology.orchestra.run.smithi163.stdout: "scrub_dir_base_inodes": 0, 2023-07-14T18:29:22.057 INFO:teuthology.orchestra.run.smithi163.stdout: "scrub_dirfrag_rstats": 0, 2023-07-14T18:29:22.057 INFO:teuthology.orchestra.run.smithi163.stdout: "scrub_file_inodes": 334, 2023-07-14T18:29:22.057 INFO:teuthology.orchestra.run.smithi163.stdout: "handle_inode_file_caps": 0, 2023-07-14T18:29:22.058 INFO:teuthology.orchestra.run.smithi163.stdout: "ceph_cap_op_revoke": 35, 2023-07-14T18:29:22.058 INFO:teuthology.orchestra.run.smithi163.stdout: "ceph_cap_op_grant": 614, 2023-07-14T18:29:22.058 INFO:teuthology.orchestra.run.smithi163.stdout: "ceph_cap_op_trunc": 0, 2023-07-14T18:29:22.058 INFO:teuthology.orchestra.run.smithi163.stdout: "ceph_cap_op_flushsnap_ack": 0, 2023-07-14T18:29:22.058 INFO:teuthology.orchestra.run.smithi163.stdout: "ceph_cap_op_flush_ack": 0, 2023-07-14T18:29:22.059 INFO:teuthology.orchestra.run.smithi163.stdout: "handle_client_caps": 777, 2023-07-14T18:29:22.059 INFO:teuthology.orchestra.run.smithi163.stdout: "handle_client_caps_dirty": 384, 2023-07-14T18:29:22.059 INFO:teuthology.orchestra.run.smithi163.stdout: "handle_client_cap_release": 40, 2023-07-14T18:29:22.059 INFO:teuthology.orchestra.run.smithi163.stdout: "process_request_cap_release": 889 2023-07-14T18:29:22.059 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:22.060 INFO:teuthology.orchestra.run.smithi163.stdout: "mds_cache": { 2023-07-14T18:29:22.060 INFO:teuthology.orchestra.run.smithi163.stdout: "dir_update": 127, 2023-07-14T18:29:22.060 INFO:teuthology.orchestra.run.smithi163.stdout: "dir_update_receipt": 341, 2023-07-14T18:29:22.060 INFO:teuthology.orchestra.run.smithi163.stdout: "dir_try_discover": 181, 2023-07-14T18:29:22.060 INFO:teuthology.orchestra.run.smithi163.stdout: "dir_send_discover": 304, 2023-07-14T18:29:22.061 INFO:teuthology.orchestra.run.smithi163.stdout: "dir_handle_discover": 199, 2023-07-14T18:29:22.061 INFO:teuthology.orchestra.run.smithi163.stdout: "num_strays": 0, 2023-07-14T18:29:22.061 INFO:teuthology.orchestra.run.smithi163.stdout: "num_strays_delayed": 0, 2023-07-14T18:29:22.061 INFO:teuthology.orchestra.run.smithi163.stdout: "num_strays_enqueuing": 0, 2023-07-14T18:29:22.061 INFO:teuthology.orchestra.run.smithi163.stdout: "strays_created": 275, 2023-07-14T18:29:22.062 INFO:teuthology.orchestra.run.smithi163.stdout: "strays_enqueued": 275, 2023-07-14T18:29:22.062 INFO:teuthology.orchestra.run.smithi163.stdout: "strays_reintegrated": 0, 2023-07-14T18:29:22.062 INFO:teuthology.orchestra.run.smithi163.stdout: "strays_migrated": 0, 2023-07-14T18:29:22.062 INFO:teuthology.orchestra.run.smithi163.stdout: "num_recovering_processing": 0, 2023-07-14T18:29:22.062 INFO:teuthology.orchestra.run.smithi163.stdout: "num_recovering_enqueued": 0, 2023-07-14T18:29:22.063 INFO:teuthology.orchestra.run.smithi163.stdout: "num_recovering_prioritized": 0, 2023-07-14T18:29:22.063 INFO:teuthology.orchestra.run.smithi163.stdout: "recovery_started": 0, 2023-07-14T18:29:22.063 INFO:teuthology.orchestra.run.smithi163.stdout: "recovery_completed": 0, 2023-07-14T18:29:22.063 INFO:teuthology.orchestra.run.smithi163.stdout: "ireq_enqueue_scrub": 0, 2023-07-14T18:29:22.063 INFO:teuthology.orchestra.run.smithi163.stdout: "ireq_exportdir": 0, 2023-07-14T18:29:22.063 INFO:teuthology.orchestra.run.smithi163.stdout: "ireq_flush": 0, 2023-07-14T18:29:22.064 INFO:teuthology.orchestra.run.smithi163.stdout: "ireq_fragmentdir": 0, 2023-07-14T18:29:22.064 INFO:teuthology.orchestra.run.smithi163.stdout: "ireq_fragstats": 0, 2023-07-14T18:29:22.064 INFO:teuthology.orchestra.run.smithi163.stdout: "ireq_inodestats": 0 2023-07-14T18:29:22.064 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:22.064 INFO:teuthology.orchestra.run.smithi163.stdout: "mds_log": { 2023-07-14T18:29:22.065 INFO:teuthology.orchestra.run.smithi163.stdout: "evadd": 21869, 2023-07-14T18:29:22.065 INFO:teuthology.orchestra.run.smithi163.stdout: "evex": 0, 2023-07-14T18:29:22.065 INFO:teuthology.orchestra.run.smithi163.stdout: "evtrm": 0, 2023-07-14T18:29:22.065 INFO:teuthology.orchestra.run.smithi163.stdout: "ev": 21869, 2023-07-14T18:29:22.065 INFO:teuthology.orchestra.run.smithi163.stdout: "evexg": 0, 2023-07-14T18:29:22.066 INFO:teuthology.orchestra.run.smithi163.stdout: "evexd": 0, 2023-07-14T18:29:22.066 INFO:teuthology.orchestra.run.smithi163.stdout: "segadd": 24, 2023-07-14T18:29:22.066 INFO:teuthology.orchestra.run.smithi163.stdout: "segex": 0, 2023-07-14T18:29:22.066 INFO:teuthology.orchestra.run.smithi163.stdout: "segtrm": 0, 2023-07-14T18:29:22.066 INFO:teuthology.orchestra.run.smithi163.stdout: "seg": 24, 2023-07-14T18:29:22.067 INFO:teuthology.orchestra.run.smithi163.stdout: "segexg": 0, 2023-07-14T18:29:22.067 INFO:teuthology.orchestra.run.smithi163.stdout: "segexd": 0, 2023-07-14T18:29:22.067 INFO:teuthology.orchestra.run.smithi163.stdout: "expos": 4194304, 2023-07-14T18:29:22.067 INFO:teuthology.orchestra.run.smithi163.stdout: "wrpos": 19515794, 2023-07-14T18:29:22.067 INFO:teuthology.orchestra.run.smithi163.stdout: "rdpos": 0, 2023-07-14T18:29:22.067 INFO:teuthology.orchestra.run.smithi163.stdout: "jlat": { 2023-07-14T18:29:22.068 INFO:teuthology.orchestra.run.smithi163.stdout: "avgcount": 692, 2023-07-14T18:29:22.068 INFO:teuthology.orchestra.run.smithi163.stdout: "sum": 1.380765888, 2023-07-14T18:29:22.068 INFO:teuthology.orchestra.run.smithi163.stdout: "avgtime": 0.001995326 2023-07-14T18:29:22.068 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:22.068 INFO:teuthology.orchestra.run.smithi163.stdout: "replayed": 0 2023-07-14T18:29:22.069 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:22.069 INFO:teuthology.orchestra.run.smithi163.stdout: "mds_mem": { 2023-07-14T18:29:22.069 INFO:teuthology.orchestra.run.smithi163.stdout: "ino": 878, 2023-07-14T18:29:22.069 INFO:teuthology.orchestra.run.smithi163.stdout: "ino+": 1158, 2023-07-14T18:29:22.069 INFO:teuthology.orchestra.run.smithi163.stdout: "ino-": 280, 2023-07-14T18:29:22.070 INFO:teuthology.orchestra.run.smithi163.stdout: "dir": 191, 2023-07-14T18:29:22.070 INFO:teuthology.orchestra.run.smithi163.stdout: "dir+": 232, 2023-07-14T18:29:22.070 INFO:teuthology.orchestra.run.smithi163.stdout: "dir-": 41, 2023-07-14T18:29:22.070 INFO:teuthology.orchestra.run.smithi163.stdout: "dn": 1161, 2023-07-14T18:29:22.070 INFO:teuthology.orchestra.run.smithi163.stdout: "dn+": 1469, 2023-07-14T18:29:22.070 INFO:teuthology.orchestra.run.smithi163.stdout: "dn-": 308, 2023-07-14T18:29:22.071 INFO:teuthology.orchestra.run.smithi163.stdout: "cap": 839, 2023-07-14T18:29:22.071 INFO:teuthology.orchestra.run.smithi163.stdout: "cap+": 1114, 2023-07-14T18:29:22.071 INFO:teuthology.orchestra.run.smithi163.stdout: "cap-": 275, 2023-07-14T18:29:22.071 INFO:teuthology.orchestra.run.smithi163.stdout: "rss": 60744, 2023-07-14T18:29:22.071 INFO:teuthology.orchestra.run.smithi163.stdout: "heap": 198960 2023-07-14T18:29:22.072 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:22.072 INFO:teuthology.orchestra.run.smithi163.stdout: "mds_server": { 2023-07-14T18:29:22.072 INFO:teuthology.orchestra.run.smithi163.stdout: "dispatch_client_request": 9764, 2023-07-14T18:29:22.072 INFO:teuthology.orchestra.run.smithi163.stdout: "dispatch_server_request": 3, 2023-07-14T18:29:22.072 INFO:teuthology.orchestra.run.smithi163.stdout: "handle_client_request": 7927, 2023-07-14T18:29:22.073 INFO:teuthology.orchestra.run.smithi163.stdout: "handle_client_session": 12, 2023-07-14T18:29:22.073 INFO:teuthology.orchestra.run.smithi163.stdout: "handle_peer_request": 612, 2023-07-14T18:29:22.073 INFO:teuthology.orchestra.run.smithi163.stdout: "req_create_latency": { 2023-07-14T18:29:22.073 INFO:teuthology.orchestra.run.smithi163.stdout: "avgcount": 337, 2023-07-14T18:29:22.073 INFO:teuthology.orchestra.run.smithi163.stdout: "sum": 1.183989561, 2023-07-14T18:29:22.074 INFO:teuthology.orchestra.run.smithi163.stdout: "avgtime": 0.003513322 2023-07-14T18:29:22.074 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:22.074 INFO:teuthology.orchestra.run.smithi163.stdout: "req_getattr_latency": { 2023-07-14T18:29:22.074 INFO:teuthology.orchestra.run.smithi163.stdout: "avgcount": 8, 2023-07-14T18:29:22.074 INFO:teuthology.orchestra.run.smithi163.stdout: "sum": 0.002943701, 2023-07-14T18:29:22.074 INFO:teuthology.orchestra.run.smithi163.stdout: "avgtime": 0.000367962 2023-07-14T18:29:22.075 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:22.075 INFO:teuthology.orchestra.run.smithi163.stdout: "req_getfilelock_latency": { 2023-07-14T18:29:22.075 INFO:teuthology.orchestra.run.smithi163.stdout: "avgcount": 0, 2023-07-14T18:29:22.075 INFO:teuthology.orchestra.run.smithi163.stdout: "sum": 0.000000000, 2023-07-14T18:29:22.075 INFO:teuthology.orchestra.run.smithi163.stdout: "avgtime": 0.000000000 2023-07-14T18:29:22.076 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:22.076 INFO:teuthology.orchestra.run.smithi163.stdout: "req_link_latency": { 2023-07-14T18:29:22.076 INFO:teuthology.orchestra.run.smithi163.stdout: "avgcount": 0, 2023-07-14T18:29:22.076 INFO:teuthology.orchestra.run.smithi163.stdout: "sum": 0.000000000, 2023-07-14T18:29:22.076 INFO:teuthology.orchestra.run.smithi163.stdout: "avgtime": 0.000000000 2023-07-14T18:29:22.077 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:22.077 INFO:teuthology.orchestra.run.smithi163.stdout: "req_lookup_latency": { 2023-07-14T18:29:22.077 INFO:teuthology.orchestra.run.smithi163.stdout: "avgcount": 4541, 2023-07-14T18:29:22.077 INFO:teuthology.orchestra.run.smithi163.stdout: "sum": 1.215119006, 2023-07-14T18:29:22.077 INFO:teuthology.orchestra.run.smithi163.stdout: "avgtime": 0.000267588 2023-07-14T18:29:22.077 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:22.078 INFO:teuthology.orchestra.run.smithi163.stdout: "req_lookuphash_latency": { 2023-07-14T18:29:22.078 INFO:teuthology.orchestra.run.smithi163.stdout: "avgcount": 0, 2023-07-14T18:29:22.078 INFO:teuthology.orchestra.run.smithi163.stdout: "sum": 0.000000000, 2023-07-14T18:29:22.078 INFO:teuthology.orchestra.run.smithi163.stdout: "avgtime": 0.000000000 2023-07-14T18:29:22.078 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:22.079 INFO:teuthology.orchestra.run.smithi163.stdout: "req_lookupino_latency": { 2023-07-14T18:29:22.079 INFO:teuthology.orchestra.run.smithi163.stdout: "avgcount": 0, 2023-07-14T18:29:22.079 INFO:teuthology.orchestra.run.smithi163.stdout: "sum": 0.000000000, 2023-07-14T18:29:22.079 INFO:teuthology.orchestra.run.smithi163.stdout: "avgtime": 0.000000000 2023-07-14T18:29:22.079 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:22.080 INFO:teuthology.orchestra.run.smithi163.stdout: "req_lookupname_latency": { 2023-07-14T18:29:22.080 INFO:teuthology.orchestra.run.smithi163.stdout: "avgcount": 0, 2023-07-14T18:29:22.080 INFO:teuthology.orchestra.run.smithi163.stdout: "sum": 0.000000000, 2023-07-14T18:29:22.080 INFO:teuthology.orchestra.run.smithi163.stdout: "avgtime": 0.000000000 2023-07-14T18:29:22.080 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:22.081 INFO:teuthology.orchestra.run.smithi163.stdout: "req_lookupparent_latency": { 2023-07-14T18:29:22.081 INFO:teuthology.orchestra.run.smithi163.stdout: "avgcount": 0, 2023-07-14T18:29:22.081 INFO:teuthology.orchestra.run.smithi163.stdout: "sum": 0.000000000, 2023-07-14T18:29:22.081 INFO:teuthology.orchestra.run.smithi163.stdout: "avgtime": 0.000000000 2023-07-14T18:29:22.081 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:22.081 INFO:teuthology.orchestra.run.smithi163.stdout: "req_lookupsnap_latency": { 2023-07-14T18:29:22.082 INFO:teuthology.orchestra.run.smithi163.stdout: "avgcount": 0, 2023-07-14T18:29:22.082 INFO:teuthology.orchestra.run.smithi163.stdout: "sum": 0.000000000, 2023-07-14T18:29:22.082 INFO:teuthology.orchestra.run.smithi163.stdout: "avgtime": 0.000000000 2023-07-14T18:29:22.082 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:22.082 INFO:teuthology.orchestra.run.smithi163.stdout: "req_lssnap_latency": { 2023-07-14T18:29:22.083 INFO:teuthology.orchestra.run.smithi163.stdout: "avgcount": 0, 2023-07-14T18:29:22.083 INFO:teuthology.orchestra.run.smithi163.stdout: "sum": 0.000000000, 2023-07-14T18:29:22.083 INFO:teuthology.orchestra.run.smithi163.stdout: "avgtime": 0.000000000 2023-07-14T18:29:22.083 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:22.083 INFO:teuthology.orchestra.run.smithi163.stdout: "req_mkdir_latency": { 2023-07-14T18:29:22.084 INFO:teuthology.orchestra.run.smithi163.stdout: "avgcount": 2, 2023-07-14T18:29:22.084 INFO:teuthology.orchestra.run.smithi163.stdout: "sum": 0.004667604, 2023-07-14T18:29:22.084 INFO:teuthology.orchestra.run.smithi163.stdout: "avgtime": 0.002333802 2023-07-14T18:29:22.084 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:22.084 INFO:teuthology.orchestra.run.smithi163.stdout: "req_mknod_latency": { 2023-07-14T18:29:22.085 INFO:teuthology.orchestra.run.smithi163.stdout: "avgcount": 0, 2023-07-14T18:29:22.085 INFO:teuthology.orchestra.run.smithi163.stdout: "sum": 0.000000000, 2023-07-14T18:29:22.085 INFO:teuthology.orchestra.run.smithi163.stdout: "avgtime": 0.000000000 2023-07-14T18:29:22.085 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:22.085 INFO:teuthology.orchestra.run.smithi163.stdout: "req_mksnap_latency": { 2023-07-14T18:29:22.086 INFO:teuthology.orchestra.run.smithi163.stdout: "avgcount": 0, 2023-07-14T18:29:22.086 INFO:teuthology.orchestra.run.smithi163.stdout: "sum": 0.000000000, 2023-07-14T18:29:22.086 INFO:teuthology.orchestra.run.smithi163.stdout: "avgtime": 0.000000000 2023-07-14T18:29:22.086 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:22.086 INFO:teuthology.orchestra.run.smithi163.stdout: "req_open_latency": { 2023-07-14T18:29:22.086 INFO:teuthology.orchestra.run.smithi163.stdout: "avgcount": 1, 2023-07-14T18:29:22.087 INFO:teuthology.orchestra.run.smithi163.stdout: "sum": 0.000316402, 2023-07-14T18:29:22.087 INFO:teuthology.orchestra.run.smithi163.stdout: "avgtime": 0.000316402 2023-07-14T18:29:22.087 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:22.087 INFO:teuthology.orchestra.run.smithi163.stdout: "req_readdir_latency": { 2023-07-14T18:29:22.087 INFO:teuthology.orchestra.run.smithi163.stdout: "avgcount": 11, 2023-07-14T18:29:22.088 INFO:teuthology.orchestra.run.smithi163.stdout: "sum": 0.012410831, 2023-07-14T18:29:22.088 INFO:teuthology.orchestra.run.smithi163.stdout: "avgtime": 0.001128257 2023-07-14T18:29:22.088 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:22.088 INFO:teuthology.orchestra.run.smithi163.stdout: "req_rename_latency": { 2023-07-14T18:29:22.088 INFO:teuthology.orchestra.run.smithi163.stdout: "avgcount": 0, 2023-07-14T18:29:22.089 INFO:teuthology.orchestra.run.smithi163.stdout: "sum": 0.000000000, 2023-07-14T18:29:22.089 INFO:teuthology.orchestra.run.smithi163.stdout: "avgtime": 0.000000000 2023-07-14T18:29:22.089 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:22.089 INFO:teuthology.orchestra.run.smithi163.stdout: "req_renamesnap_latency": { 2023-07-14T18:29:22.089 INFO:teuthology.orchestra.run.smithi163.stdout: "avgcount": 0, 2023-07-14T18:29:22.089 INFO:teuthology.orchestra.run.smithi163.stdout: "sum": 0.000000000, 2023-07-14T18:29:22.090 INFO:teuthology.orchestra.run.smithi163.stdout: "avgtime": 0.000000000 2023-07-14T18:29:22.090 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:22.090 INFO:teuthology.orchestra.run.smithi163.stdout: "req_snapdiff_latency": { 2023-07-14T18:29:22.090 INFO:teuthology.orchestra.run.smithi163.stdout: "avgcount": 0, 2023-07-14T18:29:22.090 INFO:teuthology.orchestra.run.smithi163.stdout: "sum": 0.000000000, 2023-07-14T18:29:22.091 INFO:teuthology.orchestra.run.smithi163.stdout: "avgtime": 0.000000000 2023-07-14T18:29:22.091 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:22.091 INFO:teuthology.orchestra.run.smithi163.stdout: "req_rmdir_latency": { 2023-07-14T18:29:22.091 INFO:teuthology.orchestra.run.smithi163.stdout: "avgcount": 0, 2023-07-14T18:29:22.091 INFO:teuthology.orchestra.run.smithi163.stdout: "sum": 0.000000000, 2023-07-14T18:29:22.092 INFO:teuthology.orchestra.run.smithi163.stdout: "avgtime": 0.000000000 2023-07-14T18:29:22.092 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:22.092 INFO:teuthology.orchestra.run.smithi163.stdout: "req_rmsnap_latency": { 2023-07-14T18:29:22.092 INFO:teuthology.orchestra.run.smithi163.stdout: "avgcount": 0, 2023-07-14T18:29:22.092 INFO:teuthology.orchestra.run.smithi163.stdout: "sum": 0.000000000, 2023-07-14T18:29:22.093 INFO:teuthology.orchestra.run.smithi163.stdout: "avgtime": 0.000000000 2023-07-14T18:29:22.093 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:22.093 INFO:teuthology.orchestra.run.smithi163.stdout: "req_rmxattr_latency": { 2023-07-14T18:29:22.093 INFO:teuthology.orchestra.run.smithi163.stdout: "avgcount": 0, 2023-07-14T18:29:22.093 INFO:teuthology.orchestra.run.smithi163.stdout: "sum": 0.000000000, 2023-07-14T18:29:22.093 INFO:teuthology.orchestra.run.smithi163.stdout: "avgtime": 0.000000000 2023-07-14T18:29:22.094 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:22.094 INFO:teuthology.orchestra.run.smithi163.stdout: "req_setattr_latency": { 2023-07-14T18:29:22.094 INFO:teuthology.orchestra.run.smithi163.stdout: "avgcount": 0, 2023-07-14T18:29:22.094 INFO:teuthology.orchestra.run.smithi163.stdout: "sum": 0.000000000, 2023-07-14T18:29:22.094 INFO:teuthology.orchestra.run.smithi163.stdout: "avgtime": 0.000000000 2023-07-14T18:29:22.095 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:22.095 INFO:teuthology.orchestra.run.smithi163.stdout: "req_setdirlayout_latency": { 2023-07-14T18:29:22.095 INFO:teuthology.orchestra.run.smithi163.stdout: "avgcount": 0, 2023-07-14T18:29:22.095 INFO:teuthology.orchestra.run.smithi163.stdout: "sum": 0.000000000, 2023-07-14T18:29:22.095 INFO:teuthology.orchestra.run.smithi163.stdout: "avgtime": 0.000000000 2023-07-14T18:29:22.096 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:22.096 INFO:teuthology.orchestra.run.smithi163.stdout: "req_setfilelock_latency": { 2023-07-14T18:29:22.096 INFO:teuthology.orchestra.run.smithi163.stdout: "avgcount": 0, 2023-07-14T18:29:22.096 INFO:teuthology.orchestra.run.smithi163.stdout: "sum": 0.000000000, 2023-07-14T18:29:22.096 INFO:teuthology.orchestra.run.smithi163.stdout: "avgtime": 0.000000000 2023-07-14T18:29:22.097 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:22.097 INFO:teuthology.orchestra.run.smithi163.stdout: "req_setlayout_latency": { 2023-07-14T18:29:22.097 INFO:teuthology.orchestra.run.smithi163.stdout: "avgcount": 0, 2023-07-14T18:29:22.097 INFO:teuthology.orchestra.run.smithi163.stdout: "sum": 0.000000000, 2023-07-14T18:29:22.097 INFO:teuthology.orchestra.run.smithi163.stdout: "avgtime": 0.000000000 2023-07-14T18:29:22.097 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:22.098 INFO:teuthology.orchestra.run.smithi163.stdout: "req_setxattr_latency": { 2023-07-14T18:29:22.098 INFO:teuthology.orchestra.run.smithi163.stdout: "avgcount": 0, 2023-07-14T18:29:22.098 INFO:teuthology.orchestra.run.smithi163.stdout: "sum": 0.000000000, 2023-07-14T18:29:22.098 INFO:teuthology.orchestra.run.smithi163.stdout: "avgtime": 0.000000000 2023-07-14T18:29:22.098 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:22.099 INFO:teuthology.orchestra.run.smithi163.stdout: "req_symlink_latency": { 2023-07-14T18:29:22.099 INFO:teuthology.orchestra.run.smithi163.stdout: "avgcount": 0, 2023-07-14T18:29:22.099 INFO:teuthology.orchestra.run.smithi163.stdout: "sum": 0.000000000, 2023-07-14T18:29:22.099 INFO:teuthology.orchestra.run.smithi163.stdout: "avgtime": 0.000000000 2023-07-14T18:29:22.099 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:22.100 INFO:teuthology.orchestra.run.smithi163.stdout: "req_unlink_latency": { 2023-07-14T18:29:22.100 INFO:teuthology.orchestra.run.smithi163.stdout: "avgcount": 275, 2023-07-14T18:29:22.100 INFO:teuthology.orchestra.run.smithi163.stdout: "sum": 1.081604015, 2023-07-14T18:29:22.100 INFO:teuthology.orchestra.run.smithi163.stdout: "avgtime": 0.003933105 2023-07-14T18:29:22.100 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:22.101 INFO:teuthology.orchestra.run.smithi163.stdout: "cap_revoke_eviction": 0, 2023-07-14T18:29:22.101 INFO:teuthology.orchestra.run.smithi163.stdout: "cap_acquisition_throttle": 0, 2023-07-14T18:29:22.101 INFO:teuthology.orchestra.run.smithi163.stdout: "req_getvxattr_latency": { 2023-07-14T18:29:22.101 INFO:teuthology.orchestra.run.smithi163.stdout: "avgcount": 0, 2023-07-14T18:29:22.101 INFO:teuthology.orchestra.run.smithi163.stdout: "sum": 0.000000000, 2023-07-14T18:29:22.102 INFO:teuthology.orchestra.run.smithi163.stdout: "avgtime": 0.000000000 2023-07-14T18:29:22.102 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-07-14T18:29:22.102 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:22.102 INFO:teuthology.orchestra.run.smithi163.stdout: "mds_sessions": { 2023-07-14T18:29:22.102 INFO:teuthology.orchestra.run.smithi163.stdout: "session_count": 1, 2023-07-14T18:29:22.102 INFO:teuthology.orchestra.run.smithi163.stdout: "session_add": 1, 2023-07-14T18:29:22.103 INFO:teuthology.orchestra.run.smithi163.stdout: "session_remove": 0, 2023-07-14T18:29:22.103 INFO:teuthology.orchestra.run.smithi163.stdout: "sessions_open": 1, 2023-07-14T18:29:22.103 INFO:teuthology.orchestra.run.smithi163.stdout: "sessions_stale": 0, 2023-07-14T18:29:22.103 INFO:teuthology.orchestra.run.smithi163.stdout: "total_load": 3970, 2023-07-14T18:29:22.103 INFO:teuthology.orchestra.run.smithi163.stdout: "average_load": 3970, 2023-07-14T18:29:22.104 INFO:teuthology.orchestra.run.smithi163.stdout: "avg_session_uptime": 994 2023-07-14T18:29:22.104 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:22.104 INFO:teuthology.orchestra.run.smithi163.stdout: "mempool": { 2023-07-14T18:29:22.104 INFO:teuthology.orchestra.run.smithi163.stdout: "bloom_filter_bytes": 0, 2023-07-14T18:29:22.104 INFO:teuthology.orchestra.run.smithi163.stdout: "bloom_filter_items": 0, 2023-07-14T18:29:22.105 INFO:teuthology.orchestra.run.smithi163.stdout: "bluestore_alloc_bytes": 0, 2023-07-14T18:29:22.105 INFO:teuthology.orchestra.run.smithi163.stdout: "bluestore_alloc_items": 0, 2023-07-14T18:29:22.105 INFO:teuthology.orchestra.run.smithi163.stdout: "bluestore_cache_data_bytes": 0, 2023-07-14T18:29:22.105 INFO:teuthology.orchestra.run.smithi163.stdout: "bluestore_cache_data_items": 0, 2023-07-14T18:29:22.105 INFO:teuthology.orchestra.run.smithi163.stdout: "bluestore_cache_onode_bytes": 0, 2023-07-14T18:29:22.106 INFO:teuthology.orchestra.run.smithi163.stdout: "bluestore_cache_onode_items": 0, 2023-07-14T18:29:22.106 INFO:teuthology.orchestra.run.smithi163.stdout: "bluestore_cache_meta_bytes": 0, 2023-07-14T18:29:22.106 INFO:teuthology.orchestra.run.smithi163.stdout: "bluestore_cache_meta_items": 0, 2023-07-14T18:29:22.106 INFO:teuthology.orchestra.run.smithi163.stdout: "bluestore_cache_other_bytes": 0, 2023-07-14T18:29:22.106 INFO:teuthology.orchestra.run.smithi163.stdout: "bluestore_cache_other_items": 0, 2023-07-14T18:29:22.107 INFO:teuthology.orchestra.run.smithi163.stdout: "bluestore_cache_buffer_bytes": 0, 2023-07-14T18:29:22.107 INFO:teuthology.orchestra.run.smithi163.stdout: "bluestore_cache_buffer_items": 0, 2023-07-14T18:29:22.107 INFO:teuthology.orchestra.run.smithi163.stdout: "bluestore_extent_bytes": 0, 2023-07-14T18:29:22.107 INFO:teuthology.orchestra.run.smithi163.stdout: "bluestore_extent_items": 0, 2023-07-14T18:29:22.107 INFO:teuthology.orchestra.run.smithi163.stdout: "bluestore_blob_bytes": 0, 2023-07-14T18:29:22.107 INFO:teuthology.orchestra.run.smithi163.stdout: "bluestore_blob_items": 0, 2023-07-14T18:29:22.108 INFO:teuthology.orchestra.run.smithi163.stdout: "bluestore_shared_blob_bytes": 0, 2023-07-14T18:29:22.108 INFO:teuthology.orchestra.run.smithi163.stdout: "bluestore_shared_blob_items": 0, 2023-07-14T18:29:22.108 INFO:teuthology.orchestra.run.smithi163.stdout: "bluestore_inline_bl_bytes": 0, 2023-07-14T18:29:22.108 INFO:teuthology.orchestra.run.smithi163.stdout: "bluestore_inline_bl_items": 0, 2023-07-14T18:29:22.108 INFO:teuthology.orchestra.run.smithi163.stdout: "bluestore_fsck_bytes": 0, 2023-07-14T18:29:22.109 INFO:teuthology.orchestra.run.smithi163.stdout: "bluestore_fsck_items": 0, 2023-07-14T18:29:22.109 INFO:teuthology.orchestra.run.smithi163.stdout: "bluestore_txc_bytes": 0, 2023-07-14T18:29:22.109 INFO:teuthology.orchestra.run.smithi163.stdout: "bluestore_txc_items": 0, 2023-07-14T18:29:22.109 INFO:teuthology.orchestra.run.smithi163.stdout: "bluestore_writing_deferred_bytes": 0, 2023-07-14T18:29:22.109 INFO:teuthology.orchestra.run.smithi163.stdout: "bluestore_writing_deferred_items": 0, 2023-07-14T18:29:22.110 INFO:teuthology.orchestra.run.smithi163.stdout: "bluestore_writing_bytes": 0, 2023-07-14T18:29:22.110 INFO:teuthology.orchestra.run.smithi163.stdout: "bluestore_writing_items": 0, 2023-07-14T18:29:22.110 INFO:teuthology.orchestra.run.smithi163.stdout: "bluefs_bytes": 0, 2023-07-14T18:29:22.110 INFO:teuthology.orchestra.run.smithi163.stdout: "bluefs_items": 0, 2023-07-14T18:29:22.110 INFO:teuthology.orchestra.run.smithi163.stdout: "bluefs_file_reader_bytes": 0, 2023-07-14T18:29:22.111 INFO:teuthology.orchestra.run.smithi163.stdout: "bluefs_file_reader_items": 0, 2023-07-14T18:29:22.111 INFO:teuthology.orchestra.run.smithi163.stdout: "bluefs_file_writer_bytes": 0, 2023-07-14T18:29:22.111 INFO:teuthology.orchestra.run.smithi163.stdout: "bluefs_file_writer_items": 0, 2023-07-14T18:29:22.111 INFO:teuthology.orchestra.run.smithi163.stdout: "buffer_anon_bytes": 300642, 2023-07-14T18:29:22.111 INFO:teuthology.orchestra.run.smithi163.stdout: "buffer_anon_items": 126, 2023-07-14T18:29:22.111 INFO:teuthology.orchestra.run.smithi163.stdout: "buffer_meta_bytes": 88, 2023-07-14T18:29:22.112 INFO:teuthology.orchestra.run.smithi163.stdout: "buffer_meta_items": 1, 2023-07-14T18:29:22.112 INFO:teuthology.orchestra.run.smithi163.stdout: "osd_bytes": 0, 2023-07-14T18:29:22.112 INFO:teuthology.orchestra.run.smithi163.stdout: "osd_items": 0, 2023-07-14T18:29:22.112 INFO:teuthology.orchestra.run.smithi163.stdout: "osd_mapbl_bytes": 0, 2023-07-14T18:29:22.112 INFO:teuthology.orchestra.run.smithi163.stdout: "osd_mapbl_items": 0, 2023-07-14T18:29:22.113 INFO:teuthology.orchestra.run.smithi163.stdout: "osd_pglog_bytes": 0, 2023-07-14T18:29:22.113 INFO:teuthology.orchestra.run.smithi163.stdout: "osd_pglog_items": 0, 2023-07-14T18:29:22.113 INFO:teuthology.orchestra.run.smithi163.stdout: "osdmap_bytes": 8792, 2023-07-14T18:29:22.113 INFO:teuthology.orchestra.run.smithi163.stdout: "osdmap_items": 168, 2023-07-14T18:29:22.113 INFO:teuthology.orchestra.run.smithi163.stdout: "osdmap_mapping_bytes": 0, 2023-07-14T18:29:22.114 INFO:teuthology.orchestra.run.smithi163.stdout: "osdmap_mapping_items": 0, 2023-07-14T18:29:22.114 INFO:teuthology.orchestra.run.smithi163.stdout: "pgmap_bytes": 0, 2023-07-14T18:29:22.114 INFO:teuthology.orchestra.run.smithi163.stdout: "pgmap_items": 0, 2023-07-14T18:29:22.114 INFO:teuthology.orchestra.run.smithi163.stdout: "mds_co_bytes": 3267537, 2023-07-14T18:29:22.114 INFO:teuthology.orchestra.run.smithi163.stdout: "mds_co_items": 20847, 2023-07-14T18:29:22.114 INFO:teuthology.orchestra.run.smithi163.stdout: "unittest_1_bytes": 0, 2023-07-14T18:29:22.115 INFO:teuthology.orchestra.run.smithi163.stdout: "unittest_1_items": 0, 2023-07-14T18:29:22.115 INFO:teuthology.orchestra.run.smithi163.stdout: "unittest_2_bytes": 0, 2023-07-14T18:29:22.115 INFO:teuthology.orchestra.run.smithi163.stdout: "unittest_2_items": 0 2023-07-14T18:29:22.115 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:22.115 INFO:teuthology.orchestra.run.smithi163.stdout: "objecter": { 2023-07-14T18:29:22.116 INFO:teuthology.orchestra.run.smithi163.stdout: "op_active": 0, 2023-07-14T18:29:22.116 INFO:teuthology.orchestra.run.smithi163.stdout: "op_laggy": 0, 2023-07-14T18:29:22.116 INFO:teuthology.orchestra.run.smithi163.stdout: "op_send": 1842, 2023-07-14T18:29:22.116 INFO:teuthology.orchestra.run.smithi163.stdout: "op_send_bytes": 15398036, 2023-07-14T18:29:22.116 INFO:teuthology.orchestra.run.smithi163.stdout: "op_resend": 33, 2023-07-14T18:29:22.117 INFO:teuthology.orchestra.run.smithi163.stdout: "op_reply": 1842, 2023-07-14T18:29:22.117 INFO:teuthology.orchestra.run.smithi163.stdout: "op_latency": { 2023-07-14T18:29:22.117 INFO:teuthology.orchestra.run.smithi163.stdout: "avgcount": 1842, 2023-07-14T18:29:22.117 INFO:teuthology.orchestra.run.smithi163.stdout: "sum": 4.056904587, 2023-07-14T18:29:22.117 INFO:teuthology.orchestra.run.smithi163.stdout: "avgtime": 0.002202445 2023-07-14T18:29:22.118 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:22.118 INFO:teuthology.orchestra.run.smithi163.stdout: "op_inflight": 0, 2023-07-14T18:29:22.118 INFO:teuthology.orchestra.run.smithi163.stdout: "oplen_avg": { 2023-07-14T18:29:22.118 INFO:teuthology.orchestra.run.smithi163.stdout: "avgcount": 1842, 2023-07-14T18:29:22.118 INFO:teuthology.orchestra.run.smithi163.stdout: "sum": 1894 2023-07-14T18:29:22.118 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:22.119 INFO:teuthology.orchestra.run.smithi163.stdout: "op": 1842, 2023-07-14T18:29:22.119 INFO:teuthology.orchestra.run.smithi163.stdout: "op_r": 412, 2023-07-14T18:29:22.119 INFO:teuthology.orchestra.run.smithi163.stdout: "op_w": 1430, 2023-07-14T18:29:22.119 INFO:teuthology.orchestra.run.smithi163.stdout: "op_rmw": 0, 2023-07-14T18:29:22.119 INFO:teuthology.orchestra.run.smithi163.stdout: "op_pg": 0, 2023-07-14T18:29:22.120 INFO:teuthology.orchestra.run.smithi163.stdout: "osdop_stat": 0, 2023-07-14T18:29:22.120 INFO:teuthology.orchestra.run.smithi163.stdout: "osdop_create": 10, 2023-07-14T18:29:22.120 INFO:teuthology.orchestra.run.smithi163.stdout: "osdop_read": 78, 2023-07-14T18:29:22.120 INFO:teuthology.orchestra.run.smithi163.stdout: "osdop_write": 770, 2023-07-14T18:29:22.120 INFO:teuthology.orchestra.run.smithi163.stdout: "osdop_writefull": 54, 2023-07-14T18:29:22.121 INFO:teuthology.orchestra.run.smithi163.stdout: "osdop_writesame": 0, 2023-07-14T18:29:22.121 INFO:teuthology.orchestra.run.smithi163.stdout: "osdop_append": 0, 2023-07-14T18:29:22.121 INFO:teuthology.orchestra.run.smithi163.stdout: "osdop_zero": 0, 2023-07-14T18:29:22.121 INFO:teuthology.orchestra.run.smithi163.stdout: "osdop_truncate": 0, 2023-07-14T18:29:22.121 INFO:teuthology.orchestra.run.smithi163.stdout: "osdop_delete": 565, 2023-07-14T18:29:22.121 INFO:teuthology.orchestra.run.smithi163.stdout: "osdop_mapext": 0, 2023-07-14T18:29:22.122 INFO:teuthology.orchestra.run.smithi163.stdout: "osdop_sparse_read": 0, 2023-07-14T18:29:22.122 INFO:teuthology.orchestra.run.smithi163.stdout: "osdop_clonerange": 0, 2023-07-14T18:29:22.122 INFO:teuthology.orchestra.run.smithi163.stdout: "osdop_getxattr": 334, 2023-07-14T18:29:22.122 INFO:teuthology.orchestra.run.smithi163.stdout: "osdop_setxattr": 20, 2023-07-14T18:29:22.122 INFO:teuthology.orchestra.run.smithi163.stdout: "osdop_cmpxattr": 0, 2023-07-14T18:29:22.123 INFO:teuthology.orchestra.run.smithi163.stdout: "osdop_rmxattr": 0, 2023-07-14T18:29:22.123 INFO:teuthology.orchestra.run.smithi163.stdout: "osdop_resetxattrs": 0, 2023-07-14T18:29:22.123 INFO:teuthology.orchestra.run.smithi163.stdout: "osdop_call": 0, 2023-07-14T18:29:22.123 INFO:teuthology.orchestra.run.smithi163.stdout: "osdop_watch": 0, 2023-07-14T18:29:22.123 INFO:teuthology.orchestra.run.smithi163.stdout: "osdop_notify": 0, 2023-07-14T18:29:22.124 INFO:teuthology.orchestra.run.smithi163.stdout: "osdop_src_cmpxattr": 0, 2023-07-14T18:29:22.124 INFO:teuthology.orchestra.run.smithi163.stdout: "osdop_pgls": 0, 2023-07-14T18:29:22.124 INFO:teuthology.orchestra.run.smithi163.stdout: "osdop_pgls_filter": 0, 2023-07-14T18:29:22.124 INFO:teuthology.orchestra.run.smithi163.stdout: "osdop_other": 0, 2023-07-14T18:29:22.124 INFO:teuthology.orchestra.run.smithi163.stdout: "linger_active": 0, 2023-07-14T18:29:22.125 INFO:teuthology.orchestra.run.smithi163.stdout: "linger_send": 0, 2023-07-14T18:29:22.125 INFO:teuthology.orchestra.run.smithi163.stdout: "linger_resend": 0, 2023-07-14T18:29:22.125 INFO:teuthology.orchestra.run.smithi163.stdout: "linger_ping": 0, 2023-07-14T18:29:22.125 INFO:teuthology.orchestra.run.smithi163.stdout: "poolop_active": 0, 2023-07-14T18:29:22.125 INFO:teuthology.orchestra.run.smithi163.stdout: "poolop_send": 0, 2023-07-14T18:29:22.125 INFO:teuthology.orchestra.run.smithi163.stdout: "poolop_resend": 0, 2023-07-14T18:29:22.126 INFO:teuthology.orchestra.run.smithi163.stdout: "poolstat_active": 0, 2023-07-14T18:29:22.126 INFO:teuthology.orchestra.run.smithi163.stdout: "poolstat_send": 0, 2023-07-14T18:29:22.126 INFO:teuthology.orchestra.run.smithi163.stdout: "poolstat_resend": 0, 2023-07-14T18:29:22.126 INFO:teuthology.orchestra.run.smithi163.stdout: "statfs_active": 0, 2023-07-14T18:29:22.126 INFO:teuthology.orchestra.run.smithi163.stdout: "statfs_send": 0, 2023-07-14T18:29:22.127 INFO:teuthology.orchestra.run.smithi163.stdout: "statfs_resend": 0, 2023-07-14T18:29:22.127 INFO:teuthology.orchestra.run.smithi163.stdout: "command_active": 0, 2023-07-14T18:29:22.127 INFO:teuthology.orchestra.run.smithi163.stdout: "command_send": 0, 2023-07-14T18:29:22.127 INFO:teuthology.orchestra.run.smithi163.stdout: "command_resend": 0, 2023-07-14T18:29:22.127 INFO:teuthology.orchestra.run.smithi163.stdout: "map_epoch": 88, 2023-07-14T18:29:22.128 INFO:teuthology.orchestra.run.smithi163.stdout: "map_full": 0, 2023-07-14T18:29:22.128 INFO:teuthology.orchestra.run.smithi163.stdout: "map_inc": 4, 2023-07-14T18:29:22.128 INFO:teuthology.orchestra.run.smithi163.stdout: "osd_sessions": 12, 2023-07-14T18:29:22.128 INFO:teuthology.orchestra.run.smithi163.stdout: "osd_session_open": 12, 2023-07-14T18:29:22.128 INFO:teuthology.orchestra.run.smithi163.stdout: "osd_session_close": 0, 2023-07-14T18:29:22.128 INFO:teuthology.orchestra.run.smithi163.stdout: "osd_laggy": 0, 2023-07-14T18:29:22.129 INFO:teuthology.orchestra.run.smithi163.stdout: "omap_wr": 48, 2023-07-14T18:29:22.129 INFO:teuthology.orchestra.run.smithi163.stdout: "omap_rd": 0, 2023-07-14T18:29:22.129 INFO:teuthology.orchestra.run.smithi163.stdout: "omap_del": 15 2023-07-14T18:29:22.129 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:22.129 INFO:teuthology.orchestra.run.smithi163.stdout: "oft": { 2023-07-14T18:29:22.130 INFO:teuthology.orchestra.run.smithi163.stdout: "omap_total_objs": 1, 2023-07-14T18:29:22.130 INFO:teuthology.orchestra.run.smithi163.stdout: "omap_total_kv_pairs": 0, 2023-07-14T18:29:22.130 INFO:teuthology.orchestra.run.smithi163.stdout: "omap_total_updates": 0, 2023-07-14T18:29:22.130 INFO:teuthology.orchestra.run.smithi163.stdout: "omap_total_removes": 0 2023-07-14T18:29:22.130 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:22.131 INFO:teuthology.orchestra.run.smithi163.stdout: "osd-slow-ops": { 2023-07-14T18:29:22.131 INFO:teuthology.orchestra.run.smithi163.stdout: "slow_ops_count": 0 2023-07-14T18:29:22.131 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:22.131 INFO:teuthology.orchestra.run.smithi163.stdout: "purge_queue": { 2023-07-14T18:29:22.131 INFO:teuthology.orchestra.run.smithi163.stdout: "pq_executing_ops": 0, 2023-07-14T18:29:22.132 INFO:teuthology.orchestra.run.smithi163.stdout: "pq_executing_ops_high_water": 10, 2023-07-14T18:29:22.132 INFO:teuthology.orchestra.run.smithi163.stdout: "pq_executing": 0, 2023-07-14T18:29:22.132 INFO:teuthology.orchestra.run.smithi163.stdout: "pq_executing_high_water": 5, 2023-07-14T18:29:22.132 INFO:teuthology.orchestra.run.smithi163.stdout: "pq_executed": 275, 2023-07-14T18:29:22.132 INFO:teuthology.orchestra.run.smithi163.stdout: "pq_item_in_journal": 0 2023-07-14T18:29:22.132 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:22.133 INFO:teuthology.orchestra.run.smithi163.stdout: "throttle-msgr_dispatch_throttler-mds": { 2023-07-14T18:29:22.133 INFO:teuthology.orchestra.run.smithi163.stdout: "val": 0, 2023-07-14T18:29:22.133 INFO:teuthology.orchestra.run.smithi163.stdout: "max": 104857600, 2023-07-14T18:29:22.133 INFO:teuthology.orchestra.run.smithi163.stdout: "get_started": 0, 2023-07-14T18:29:22.133 INFO:teuthology.orchestra.run.smithi163.stdout: "get": 10198750, 2023-07-14T18:29:22.134 INFO:teuthology.orchestra.run.smithi163.stdout: "get_sum": 831743540, 2023-07-14T18:29:22.134 INFO:teuthology.orchestra.run.smithi163.stdout: "get_or_fail_fail": 0, 2023-07-14T18:29:22.134 INFO:teuthology.orchestra.run.smithi163.stdout: "get_or_fail_success": 10198750, 2023-07-14T18:29:22.134 INFO:teuthology.orchestra.run.smithi163.stdout: "take": 0, 2023-07-14T18:29:22.134 INFO:teuthology.orchestra.run.smithi163.stdout: "take_sum": 0, 2023-07-14T18:29:22.135 INFO:teuthology.orchestra.run.smithi163.stdout: "put": 10198750, 2023-07-14T18:29:22.135 INFO:teuthology.orchestra.run.smithi163.stdout: "put_sum": 831743540, 2023-07-14T18:29:22.135 INFO:teuthology.orchestra.run.smithi163.stdout: "wait": { 2023-07-14T18:29:22.135 INFO:teuthology.orchestra.run.smithi163.stdout: "avgcount": 0, 2023-07-14T18:29:22.135 INFO:teuthology.orchestra.run.smithi163.stdout: "sum": 0.000000000, 2023-07-14T18:29:22.135 INFO:teuthology.orchestra.run.smithi163.stdout: "avgtime": 0.000000000 2023-07-14T18:29:22.136 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-07-14T18:29:22.136 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:22.136 INFO:teuthology.orchestra.run.smithi163.stdout: "throttle-objecter_bytes": { 2023-07-14T18:29:22.136 INFO:teuthology.orchestra.run.smithi163.stdout: "val": 0, 2023-07-14T18:29:22.136 INFO:teuthology.orchestra.run.smithi163.stdout: "max": 104857600, 2023-07-14T18:29:22.137 INFO:teuthology.orchestra.run.smithi163.stdout: "get_started": 0, 2023-07-14T18:29:22.137 INFO:teuthology.orchestra.run.smithi163.stdout: "get": 0, 2023-07-14T18:29:22.137 INFO:teuthology.orchestra.run.smithi163.stdout: "get_sum": 0, 2023-07-14T18:29:22.137 INFO:teuthology.orchestra.run.smithi163.stdout: "get_or_fail_fail": 0, 2023-07-14T18:29:22.137 INFO:teuthology.orchestra.run.smithi163.stdout: "get_or_fail_success": 0, 2023-07-14T18:29:22.138 INFO:teuthology.orchestra.run.smithi163.stdout: "take": 1842, 2023-07-14T18:29:22.138 INFO:teuthology.orchestra.run.smithi163.stdout: "take_sum": 15428011, 2023-07-14T18:29:22.138 INFO:teuthology.orchestra.run.smithi163.stdout: "put": 1842, 2023-07-14T18:29:22.138 INFO:teuthology.orchestra.run.smithi163.stdout: "put_sum": 15428011, 2023-07-14T18:29:22.138 INFO:teuthology.orchestra.run.smithi163.stdout: "wait": { 2023-07-14T18:29:22.139 INFO:teuthology.orchestra.run.smithi163.stdout: "avgcount": 0, 2023-07-14T18:29:22.139 INFO:teuthology.orchestra.run.smithi163.stdout: "sum": 0.000000000, 2023-07-14T18:29:22.139 INFO:teuthology.orchestra.run.smithi163.stdout: "avgtime": 0.000000000 2023-07-14T18:29:22.139 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-07-14T18:29:22.139 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:22.139 INFO:teuthology.orchestra.run.smithi163.stdout: "throttle-objecter_ops": { 2023-07-14T18:29:22.140 INFO:teuthology.orchestra.run.smithi163.stdout: "val": 0, 2023-07-14T18:29:22.140 INFO:teuthology.orchestra.run.smithi163.stdout: "max": 1024, 2023-07-14T18:29:22.140 INFO:teuthology.orchestra.run.smithi163.stdout: "get_started": 0, 2023-07-14T18:29:22.140 INFO:teuthology.orchestra.run.smithi163.stdout: "get": 0, 2023-07-14T18:29:22.140 INFO:teuthology.orchestra.run.smithi163.stdout: "get_sum": 0, 2023-07-14T18:29:22.141 INFO:teuthology.orchestra.run.smithi163.stdout: "get_or_fail_fail": 0, 2023-07-14T18:29:22.141 INFO:teuthology.orchestra.run.smithi163.stdout: "get_or_fail_success": 0, 2023-07-14T18:29:22.141 INFO:teuthology.orchestra.run.smithi163.stdout: "take": 1842, 2023-07-14T18:29:22.141 INFO:teuthology.orchestra.run.smithi163.stdout: "take_sum": 1842, 2023-07-14T18:29:22.141 INFO:teuthology.orchestra.run.smithi163.stdout: "put": 1842, 2023-07-14T18:29:22.142 INFO:teuthology.orchestra.run.smithi163.stdout: "put_sum": 1842, 2023-07-14T18:29:22.142 INFO:teuthology.orchestra.run.smithi163.stdout: "wait": { 2023-07-14T18:29:22.142 INFO:teuthology.orchestra.run.smithi163.stdout: "avgcount": 0, 2023-07-14T18:29:22.142 INFO:teuthology.orchestra.run.smithi163.stdout: "sum": 0.000000000, 2023-07-14T18:29:22.142 INFO:teuthology.orchestra.run.smithi163.stdout: "avgtime": 0.000000000 2023-07-14T18:29:22.143 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-07-14T18:29:22.143 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:22.143 INFO:teuthology.orchestra.run.smithi163.stdout: "throttle-write_buf_throttle": { 2023-07-14T18:29:22.143 INFO:teuthology.orchestra.run.smithi163.stdout: "val": 0, 2023-07-14T18:29:22.143 INFO:teuthology.orchestra.run.smithi163.stdout: "max": 3758096384, 2023-07-14T18:29:22.143 INFO:teuthology.orchestra.run.smithi163.stdout: "get_started": 0, 2023-07-14T18:29:22.144 INFO:teuthology.orchestra.run.smithi163.stdout: "get": 275, 2023-07-14T18:29:22.144 INFO:teuthology.orchestra.run.smithi163.stdout: "get_sum": 29975, 2023-07-14T18:29:22.144 INFO:teuthology.orchestra.run.smithi163.stdout: "get_or_fail_fail": 0, 2023-07-14T18:29:22.144 INFO:teuthology.orchestra.run.smithi163.stdout: "get_or_fail_success": 275, 2023-07-14T18:29:22.144 INFO:teuthology.orchestra.run.smithi163.stdout: "take": 0, 2023-07-14T18:29:22.145 INFO:teuthology.orchestra.run.smithi163.stdout: "take_sum": 0, 2023-07-14T18:29:22.145 INFO:teuthology.orchestra.run.smithi163.stdout: "put": 78, 2023-07-14T18:29:22.145 INFO:teuthology.orchestra.run.smithi163.stdout: "put_sum": 29975, 2023-07-14T18:29:22.145 INFO:teuthology.orchestra.run.smithi163.stdout: "wait": { 2023-07-14T18:29:22.145 INFO:teuthology.orchestra.run.smithi163.stdout: "avgcount": 0, 2023-07-14T18:29:22.146 INFO:teuthology.orchestra.run.smithi163.stdout: "sum": 0.000000000, 2023-07-14T18:29:22.146 INFO:teuthology.orchestra.run.smithi163.stdout: "avgtime": 0.000000000 2023-07-14T18:29:22.146 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-07-14T18:29:22.146 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:22.146 INFO:teuthology.orchestra.run.smithi163.stdout: "throttle-write_buf_throttle-0x56111840a0a0": { 2023-07-14T18:29:22.147 INFO:teuthology.orchestra.run.smithi163.stdout: "val": 0, 2023-07-14T18:29:22.147 INFO:teuthology.orchestra.run.smithi163.stdout: "max": 3758096384, 2023-07-14T18:29:22.147 INFO:teuthology.orchestra.run.smithi163.stdout: "get_started": 0, 2023-07-14T18:29:22.147 INFO:teuthology.orchestra.run.smithi163.stdout: "get": 21869, 2023-07-14T18:29:22.147 INFO:teuthology.orchestra.run.smithi163.stdout: "get_sum": 15321490, 2023-07-14T18:29:22.147 INFO:teuthology.orchestra.run.smithi163.stdout: "get_or_fail_fail": 0, 2023-07-14T18:29:22.148 INFO:teuthology.orchestra.run.smithi163.stdout: "get_or_fail_success": 21869, 2023-07-14T18:29:22.148 INFO:teuthology.orchestra.run.smithi163.stdout: "take": 0, 2023-07-14T18:29:22.148 INFO:teuthology.orchestra.run.smithi163.stdout: "take_sum": 0, 2023-07-14T18:29:22.148 INFO:teuthology.orchestra.run.smithi163.stdout: "put": 692, 2023-07-14T18:29:22.148 INFO:teuthology.orchestra.run.smithi163.stdout: "put_sum": 15321490, 2023-07-14T18:29:22.149 INFO:teuthology.orchestra.run.smithi163.stdout: "wait": { 2023-07-14T18:29:22.149 INFO:teuthology.orchestra.run.smithi163.stdout: "avgcount": 0, 2023-07-14T18:29:22.149 INFO:teuthology.orchestra.run.smithi163.stdout: "sum": 0.000000000, 2023-07-14T18:29:22.149 INFO:teuthology.orchestra.run.smithi163.stdout: "avgtime": 0.000000000 2023-07-14T18:29:22.149 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-07-14T18:29:22.150 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-07-14T18:29:22.150 INFO:teuthology.orchestra.run.smithi163.stdout:} 2023-07-14T18:29:22.417 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:29:22 smithi184 ceph-mon[98481]: pgmap v801: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-07-14T18:29:22.460 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:29:22 smithi163 ceph-mon[96576]: pgmap v801: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-07-14T18:29:22.518 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:29:22 smithi172 ceph-mon[97983]: pgmap v801: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-07-14T18:29:22.536 INFO:tasks.check_counter:Daemon mds.a mds.exported=0 2023-07-14T18:29:22.537 INFO:tasks.check_counter:Daemon mds.a mds.imported=46 2023-07-14T18:29:22.537 INFO:tasks.check_counter:Daemon mds.a mds_cache.dir_update=127 2023-07-14T18:29:22.537 INFO:tasks.check_counter:Daemon mds.a mds_cache.dir_update_receipt=341 2023-07-14T18:29:22.538 INFO:tasks.check_counter:Daemon mds.a mds.dir_split=0 2023-07-14T18:29:22.538 DEBUG:tasks.check_counter:Getting stats from d 2023-07-14T18:29:22.538 DEBUG:teuthology.orchestra.run.smithi163:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81c9387d2e7576da065747ec9c16d1c7d69016ec shell --fsid bf7326ec-2270-11ee-9b33-001a4aab830c -- ceph daemon mds.d perf dump 2023-07-14T18:29:23.135 INFO:teuthology.orchestra.run.smithi163.stderr:Inferring config /var/lib/ceph/bf7326ec-2270-11ee-9b33-001a4aab830c/mon.a/config 2023-07-14T18:29:24.471 INFO:teuthology.orchestra.run.smithi163.stdout:{ 2023-07-14T18:29:24.471 INFO:teuthology.orchestra.run.smithi163.stdout: "AsyncMessenger::Worker-0": { 2023-07-14T18:29:24.471 INFO:teuthology.orchestra.run.smithi163.stdout: "msgr_recv_messages": 0, 2023-07-14T18:29:24.472 INFO:teuthology.orchestra.run.smithi163.stdout: "msgr_send_messages": 2, 2023-07-14T18:29:24.472 INFO:teuthology.orchestra.run.smithi163.stdout: "msgr_recv_bytes": 0, 2023-07-14T18:29:24.472 INFO:teuthology.orchestra.run.smithi163.stdout: "msgr_send_bytes": 0, 2023-07-14T18:29:24.472 INFO:teuthology.orchestra.run.smithi163.stdout: "msgr_created_connections": 4, 2023-07-14T18:29:24.472 INFO:teuthology.orchestra.run.smithi163.stdout: "msgr_active_connections": 0, 2023-07-14T18:29:24.473 INFO:teuthology.orchestra.run.smithi163.stdout: "msgr_running_total_time": 0.001542279, 2023-07-14T18:29:24.473 INFO:teuthology.orchestra.run.smithi163.stdout: "msgr_running_send_time": 0.000000000, 2023-07-14T18:29:24.473 INFO:teuthology.orchestra.run.smithi163.stdout: "msgr_running_recv_time": 0.000431949, 2023-07-14T18:29:24.473 INFO:teuthology.orchestra.run.smithi163.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2023-07-14T18:29:24.473 INFO:teuthology.orchestra.run.smithi163.stdout: "msgr_send_messages_queue_lat": { 2023-07-14T18:29:24.474 INFO:teuthology.orchestra.run.smithi163.stdout: "avgcount": 0, 2023-07-14T18:29:24.474 INFO:teuthology.orchestra.run.smithi163.stdout: "sum": 0.000000000, 2023-07-14T18:29:24.474 INFO:teuthology.orchestra.run.smithi163.stdout: "avgtime": 0.000000000 2023-07-14T18:29:24.474 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:24.474 INFO:teuthology.orchestra.run.smithi163.stdout: "msgr_handle_ack_lat": { 2023-07-14T18:29:24.474 INFO:teuthology.orchestra.run.smithi163.stdout: "avgcount": 0, 2023-07-14T18:29:24.475 INFO:teuthology.orchestra.run.smithi163.stdout: "sum": 0.000000000, 2023-07-14T18:29:24.475 INFO:teuthology.orchestra.run.smithi163.stdout: "avgtime": 0.000000000 2023-07-14T18:29:24.475 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:24.475 INFO:teuthology.orchestra.run.smithi163.stdout: "msgr_recv_encrypted_bytes": 0, 2023-07-14T18:29:24.475 INFO:teuthology.orchestra.run.smithi163.stdout: "msgr_send_encrypted_bytes": 0 2023-07-14T18:29:24.476 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:24.476 INFO:teuthology.orchestra.run.smithi163.stdout: "AsyncMessenger::Worker-1": { 2023-07-14T18:29:24.476 INFO:teuthology.orchestra.run.smithi163.stdout: "msgr_recv_messages": 2, 2023-07-14T18:29:24.476 INFO:teuthology.orchestra.run.smithi163.stdout: "msgr_send_messages": 228, 2023-07-14T18:29:24.476 INFO:teuthology.orchestra.run.smithi163.stdout: "msgr_recv_bytes": 320, 2023-07-14T18:29:24.477 INFO:teuthology.orchestra.run.smithi163.stdout: "msgr_send_bytes": 191776, 2023-07-14T18:29:24.477 INFO:teuthology.orchestra.run.smithi163.stdout: "msgr_created_connections": 4, 2023-07-14T18:29:24.477 INFO:teuthology.orchestra.run.smithi163.stdout: "msgr_active_connections": 2, 2023-07-14T18:29:24.477 INFO:teuthology.orchestra.run.smithi163.stdout: "msgr_running_total_time": 0.012138992, 2023-07-14T18:29:24.477 INFO:teuthology.orchestra.run.smithi163.stdout: "msgr_running_send_time": 0.008919502, 2023-07-14T18:29:24.477 INFO:teuthology.orchestra.run.smithi163.stdout: "msgr_running_recv_time": 0.001589237, 2023-07-14T18:29:24.478 INFO:teuthology.orchestra.run.smithi163.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2023-07-14T18:29:24.478 INFO:teuthology.orchestra.run.smithi163.stdout: "msgr_send_messages_queue_lat": { 2023-07-14T18:29:24.478 INFO:teuthology.orchestra.run.smithi163.stdout: "avgcount": 226, 2023-07-14T18:29:24.478 INFO:teuthology.orchestra.run.smithi163.stdout: "sum": 0.007587039, 2023-07-14T18:29:24.478 INFO:teuthology.orchestra.run.smithi163.stdout: "avgtime": 0.000033570 2023-07-14T18:29:24.479 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:24.479 INFO:teuthology.orchestra.run.smithi163.stdout: "msgr_handle_ack_lat": { 2023-07-14T18:29:24.479 INFO:teuthology.orchestra.run.smithi163.stdout: "avgcount": 0, 2023-07-14T18:29:24.479 INFO:teuthology.orchestra.run.smithi163.stdout: "sum": 0.000000000, 2023-07-14T18:29:24.479 INFO:teuthology.orchestra.run.smithi163.stdout: "avgtime": 0.000000000 2023-07-14T18:29:24.480 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:24.480 INFO:teuthology.orchestra.run.smithi163.stdout: "msgr_recv_encrypted_bytes": 320, 2023-07-14T18:29:24.480 INFO:teuthology.orchestra.run.smithi163.stdout: "msgr_send_encrypted_bytes": 191776 2023-07-14T18:29:24.480 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:24.480 INFO:teuthology.orchestra.run.smithi163.stdout: "AsyncMessenger::Worker-2": { 2023-07-14T18:29:24.481 INFO:teuthology.orchestra.run.smithi163.stdout: "msgr_recv_messages": 306, 2023-07-14T18:29:24.481 INFO:teuthology.orchestra.run.smithi163.stdout: "msgr_send_messages": 301, 2023-07-14T18:29:24.481 INFO:teuthology.orchestra.run.smithi163.stdout: "msgr_recv_bytes": 498736, 2023-07-14T18:29:24.481 INFO:teuthology.orchestra.run.smithi163.stdout: "msgr_send_bytes": 171216, 2023-07-14T18:29:24.481 INFO:teuthology.orchestra.run.smithi163.stdout: "msgr_created_connections": 2, 2023-07-14T18:29:24.481 INFO:teuthology.orchestra.run.smithi163.stdout: "msgr_active_connections": 1, 2023-07-14T18:29:24.482 INFO:teuthology.orchestra.run.smithi163.stdout: "msgr_running_total_time": 0.034880195, 2023-07-14T18:29:24.482 INFO:teuthology.orchestra.run.smithi163.stdout: "msgr_running_send_time": 0.013892309, 2023-07-14T18:29:24.482 INFO:teuthology.orchestra.run.smithi163.stdout: "msgr_running_recv_time": 0.014756758, 2023-07-14T18:29:24.482 INFO:teuthology.orchestra.run.smithi163.stdout: "msgr_running_fast_dispatch_time": 0.005931739, 2023-07-14T18:29:24.482 INFO:teuthology.orchestra.run.smithi163.stdout: "msgr_send_messages_queue_lat": { 2023-07-14T18:29:24.483 INFO:teuthology.orchestra.run.smithi163.stdout: "avgcount": 301, 2023-07-14T18:29:24.483 INFO:teuthology.orchestra.run.smithi163.stdout: "sum": 0.008455784, 2023-07-14T18:29:24.483 INFO:teuthology.orchestra.run.smithi163.stdout: "avgtime": 0.000028092 2023-07-14T18:29:24.483 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:24.483 INFO:teuthology.orchestra.run.smithi163.stdout: "msgr_handle_ack_lat": { 2023-07-14T18:29:24.483 INFO:teuthology.orchestra.run.smithi163.stdout: "avgcount": 0, 2023-07-14T18:29:24.484 INFO:teuthology.orchestra.run.smithi163.stdout: "sum": 0.000000000, 2023-07-14T18:29:24.484 INFO:teuthology.orchestra.run.smithi163.stdout: "avgtime": 0.000000000 2023-07-14T18:29:24.484 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:24.484 INFO:teuthology.orchestra.run.smithi163.stdout: "msgr_recv_encrypted_bytes": 498736, 2023-07-14T18:29:24.484 INFO:teuthology.orchestra.run.smithi163.stdout: "msgr_send_encrypted_bytes": 171216 2023-07-14T18:29:24.485 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:24.485 INFO:teuthology.orchestra.run.smithi163.stdout: "cct": { 2023-07-14T18:29:24.485 INFO:teuthology.orchestra.run.smithi163.stdout: "total_workers": 0, 2023-07-14T18:29:24.485 INFO:teuthology.orchestra.run.smithi163.stdout: "unhealthy_workers": 0 2023-07-14T18:29:24.485 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:24.486 INFO:teuthology.orchestra.run.smithi163.stdout: "mempool": { 2023-07-14T18:29:24.486 INFO:teuthology.orchestra.run.smithi163.stdout: "bloom_filter_bytes": 0, 2023-07-14T18:29:24.486 INFO:teuthology.orchestra.run.smithi163.stdout: "bloom_filter_items": 0, 2023-07-14T18:29:24.486 INFO:teuthology.orchestra.run.smithi163.stdout: "bluestore_alloc_bytes": 0, 2023-07-14T18:29:24.486 INFO:teuthology.orchestra.run.smithi163.stdout: "bluestore_alloc_items": 0, 2023-07-14T18:29:24.487 INFO:teuthology.orchestra.run.smithi163.stdout: "bluestore_cache_data_bytes": 0, 2023-07-14T18:29:24.487 INFO:teuthology.orchestra.run.smithi163.stdout: "bluestore_cache_data_items": 0, 2023-07-14T18:29:24.487 INFO:teuthology.orchestra.run.smithi163.stdout: "bluestore_cache_onode_bytes": 0, 2023-07-14T18:29:24.487 INFO:teuthology.orchestra.run.smithi163.stdout: "bluestore_cache_onode_items": 0, 2023-07-14T18:29:24.487 INFO:teuthology.orchestra.run.smithi163.stdout: "bluestore_cache_meta_bytes": 0, 2023-07-14T18:29:24.487 INFO:teuthology.orchestra.run.smithi163.stdout: "bluestore_cache_meta_items": 0, 2023-07-14T18:29:24.488 INFO:teuthology.orchestra.run.smithi163.stdout: "bluestore_cache_other_bytes": 0, 2023-07-14T18:29:24.488 INFO:teuthology.orchestra.run.smithi163.stdout: "bluestore_cache_other_items": 0, 2023-07-14T18:29:24.488 INFO:teuthology.orchestra.run.smithi163.stdout: "bluestore_cache_buffer_bytes": 0, 2023-07-14T18:29:24.488 INFO:teuthology.orchestra.run.smithi163.stdout: "bluestore_cache_buffer_items": 0, 2023-07-14T18:29:24.488 INFO:teuthology.orchestra.run.smithi163.stdout: "bluestore_extent_bytes": 0, 2023-07-14T18:29:24.489 INFO:teuthology.orchestra.run.smithi163.stdout: "bluestore_extent_items": 0, 2023-07-14T18:29:24.489 INFO:teuthology.orchestra.run.smithi163.stdout: "bluestore_blob_bytes": 0, 2023-07-14T18:29:24.489 INFO:teuthology.orchestra.run.smithi163.stdout: "bluestore_blob_items": 0, 2023-07-14T18:29:24.489 INFO:teuthology.orchestra.run.smithi163.stdout: "bluestore_shared_blob_bytes": 0, 2023-07-14T18:29:24.489 INFO:teuthology.orchestra.run.smithi163.stdout: "bluestore_shared_blob_items": 0, 2023-07-14T18:29:24.490 INFO:teuthology.orchestra.run.smithi163.stdout: "bluestore_inline_bl_bytes": 0, 2023-07-14T18:29:24.490 INFO:teuthology.orchestra.run.smithi163.stdout: "bluestore_inline_bl_items": 0, 2023-07-14T18:29:24.490 INFO:teuthology.orchestra.run.smithi163.stdout: "bluestore_fsck_bytes": 0, 2023-07-14T18:29:24.490 INFO:teuthology.orchestra.run.smithi163.stdout: "bluestore_fsck_items": 0, 2023-07-14T18:29:24.490 INFO:teuthology.orchestra.run.smithi163.stdout: "bluestore_txc_bytes": 0, 2023-07-14T18:29:24.490 INFO:teuthology.orchestra.run.smithi163.stdout: "bluestore_txc_items": 0, 2023-07-14T18:29:24.491 INFO:teuthology.orchestra.run.smithi163.stdout: "bluestore_writing_deferred_bytes": 0, 2023-07-14T18:29:24.491 INFO:teuthology.orchestra.run.smithi163.stdout: "bluestore_writing_deferred_items": 0, 2023-07-14T18:29:24.491 INFO:teuthology.orchestra.run.smithi163.stdout: "bluestore_writing_bytes": 0, 2023-07-14T18:29:24.491 INFO:teuthology.orchestra.run.smithi163.stdout: "bluestore_writing_items": 0, 2023-07-14T18:29:24.491 INFO:teuthology.orchestra.run.smithi163.stdout: "bluefs_bytes": 0, 2023-07-14T18:29:24.492 INFO:teuthology.orchestra.run.smithi163.stdout: "bluefs_items": 0, 2023-07-14T18:29:24.492 INFO:teuthology.orchestra.run.smithi163.stdout: "bluefs_file_reader_bytes": 0, 2023-07-14T18:29:24.492 INFO:teuthology.orchestra.run.smithi163.stdout: "bluefs_file_reader_items": 0, 2023-07-14T18:29:24.492 INFO:teuthology.orchestra.run.smithi163.stdout: "bluefs_file_writer_bytes": 0, 2023-07-14T18:29:24.492 INFO:teuthology.orchestra.run.smithi163.stdout: "bluefs_file_writer_items": 0, 2023-07-14T18:29:24.493 INFO:teuthology.orchestra.run.smithi163.stdout: "buffer_anon_bytes": 148744, 2023-07-14T18:29:24.493 INFO:teuthology.orchestra.run.smithi163.stdout: "buffer_anon_items": 30, 2023-07-14T18:29:24.493 INFO:teuthology.orchestra.run.smithi163.stdout: "buffer_meta_bytes": 0, 2023-07-14T18:29:24.493 INFO:teuthology.orchestra.run.smithi163.stdout: "buffer_meta_items": 0, 2023-07-14T18:29:24.493 INFO:teuthology.orchestra.run.smithi163.stdout: "osd_bytes": 0, 2023-07-14T18:29:24.494 INFO:teuthology.orchestra.run.smithi163.stdout: "osd_items": 0, 2023-07-14T18:29:24.494 INFO:teuthology.orchestra.run.smithi163.stdout: "osd_mapbl_bytes": 0, 2023-07-14T18:29:24.494 INFO:teuthology.orchestra.run.smithi163.stdout: "osd_mapbl_items": 0, 2023-07-14T18:29:24.494 INFO:teuthology.orchestra.run.smithi163.stdout: "osd_pglog_bytes": 0, 2023-07-14T18:29:24.494 INFO:teuthology.orchestra.run.smithi163.stdout: "osd_pglog_items": 0, 2023-07-14T18:29:24.495 INFO:teuthology.orchestra.run.smithi163.stdout: "osdmap_bytes": 0, 2023-07-14T18:29:24.495 INFO:teuthology.orchestra.run.smithi163.stdout: "osdmap_items": 0, 2023-07-14T18:29:24.495 INFO:teuthology.orchestra.run.smithi163.stdout: "osdmap_mapping_bytes": 0, 2023-07-14T18:29:24.495 INFO:teuthology.orchestra.run.smithi163.stdout: "osdmap_mapping_items": 0, 2023-07-14T18:29:24.495 INFO:teuthology.orchestra.run.smithi163.stdout: "pgmap_bytes": 0, 2023-07-14T18:29:24.495 INFO:teuthology.orchestra.run.smithi163.stdout: "pgmap_items": 0, 2023-07-14T18:29:24.496 INFO:teuthology.orchestra.run.smithi163.stdout: "mds_co_bytes": 928, 2023-07-14T18:29:24.496 INFO:teuthology.orchestra.run.smithi163.stdout: "mds_co_items": 2, 2023-07-14T18:29:24.496 INFO:teuthology.orchestra.run.smithi163.stdout: "unittest_1_bytes": 0, 2023-07-14T18:29:24.496 INFO:teuthology.orchestra.run.smithi163.stdout: "unittest_1_items": 0, 2023-07-14T18:29:24.496 INFO:teuthology.orchestra.run.smithi163.stdout: "unittest_2_bytes": 0, 2023-07-14T18:29:24.497 INFO:teuthology.orchestra.run.smithi163.stdout: "unittest_2_items": 0 2023-07-14T18:29:24.497 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:24.497 INFO:teuthology.orchestra.run.smithi163.stdout: "throttle-msgr_dispatch_throttler-mds": { 2023-07-14T18:29:24.497 INFO:teuthology.orchestra.run.smithi163.stdout: "val": 0, 2023-07-14T18:29:24.497 INFO:teuthology.orchestra.run.smithi163.stdout: "max": 104857600, 2023-07-14T18:29:24.498 INFO:teuthology.orchestra.run.smithi163.stdout: "get_started": 0, 2023-07-14T18:29:24.498 INFO:teuthology.orchestra.run.smithi163.stdout: "get": 304, 2023-07-14T18:29:24.498 INFO:teuthology.orchestra.run.smithi163.stdout: "get_sum": 453081, 2023-07-14T18:29:24.498 INFO:teuthology.orchestra.run.smithi163.stdout: "get_or_fail_fail": 0, 2023-07-14T18:29:24.498 INFO:teuthology.orchestra.run.smithi163.stdout: "get_or_fail_success": 304, 2023-07-14T18:29:24.499 INFO:teuthology.orchestra.run.smithi163.stdout: "take": 0, 2023-07-14T18:29:24.499 INFO:teuthology.orchestra.run.smithi163.stdout: "take_sum": 0, 2023-07-14T18:29:24.499 INFO:teuthology.orchestra.run.smithi163.stdout: "put": 304, 2023-07-14T18:29:24.499 INFO:teuthology.orchestra.run.smithi163.stdout: "put_sum": 453081, 2023-07-14T18:29:24.499 INFO:teuthology.orchestra.run.smithi163.stdout: "wait": { 2023-07-14T18:29:24.499 INFO:teuthology.orchestra.run.smithi163.stdout: "avgcount": 0, 2023-07-14T18:29:24.500 INFO:teuthology.orchestra.run.smithi163.stdout: "sum": 0.000000000, 2023-07-14T18:29:24.500 INFO:teuthology.orchestra.run.smithi163.stdout: "avgtime": 0.000000000 2023-07-14T18:29:24.500 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-07-14T18:29:24.500 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-07-14T18:29:24.500 INFO:teuthology.orchestra.run.smithi163.stdout:} 2023-07-14T18:29:24.901 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:29:24 smithi163 ceph-mon[96576]: pgmap v802: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-07-14T18:29:24.902 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.d 2023-07-14T18:29:24.903 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.d 2023-07-14T18:29:24.903 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update' not found on daemon mds.d 2023-07-14T18:29:24.903 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update_receipt' not found on daemon mds.d 2023-07-14T18:29:24.904 WARNING:tasks.check_counter:Counter 'mds.dir_split' not found on daemon mds.d 2023-07-14T18:29:24.904 DEBUG:tasks.check_counter:Getting stats from g 2023-07-14T18:29:24.904 DEBUG:teuthology.orchestra.run.smithi163:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81c9387d2e7576da065747ec9c16d1c7d69016ec shell --fsid bf7326ec-2270-11ee-9b33-001a4aab830c -- ceph daemon mds.g perf dump 2023-07-14T18:29:25.167 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:29:24 smithi184 ceph-mon[98481]: pgmap v802: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-07-14T18:29:25.268 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:29:24 smithi172 ceph-mon[97983]: pgmap v802: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-07-14T18:29:25.515 INFO:teuthology.orchestra.run.smithi163.stderr:Inferring config /var/lib/ceph/bf7326ec-2270-11ee-9b33-001a4aab830c/mon.a/config 2023-07-14T18:29:26.773 INFO:teuthology.orchestra.run.smithi163.stdout:{ 2023-07-14T18:29:26.773 INFO:teuthology.orchestra.run.smithi163.stdout: "AsyncMessenger::Worker-0": { 2023-07-14T18:29:26.774 INFO:teuthology.orchestra.run.smithi163.stdout: "msgr_recv_messages": 2289, 2023-07-14T18:29:26.774 INFO:teuthology.orchestra.run.smithi163.stdout: "msgr_send_messages": 2275, 2023-07-14T18:29:26.774 INFO:teuthology.orchestra.run.smithi163.stdout: "msgr_recv_bytes": 3913432, 2023-07-14T18:29:26.774 INFO:teuthology.orchestra.run.smithi163.stdout: "msgr_send_bytes": 783198, 2023-07-14T18:29:26.774 INFO:teuthology.orchestra.run.smithi163.stdout: "msgr_created_connections": 5, 2023-07-14T18:29:26.775 INFO:teuthology.orchestra.run.smithi163.stdout: "msgr_active_connections": 1, 2023-07-14T18:29:26.775 INFO:teuthology.orchestra.run.smithi163.stdout: "msgr_running_total_time": 0.178893536, 2023-07-14T18:29:26.775 INFO:teuthology.orchestra.run.smithi163.stdout: "msgr_running_send_time": 0.064155699, 2023-07-14T18:29:26.775 INFO:teuthology.orchestra.run.smithi163.stdout: "msgr_running_recv_time": 0.047786720, 2023-07-14T18:29:26.775 INFO:teuthology.orchestra.run.smithi163.stdout: "msgr_running_fast_dispatch_time": 0.055142791, 2023-07-14T18:29:26.776 INFO:teuthology.orchestra.run.smithi163.stdout: "msgr_send_messages_queue_lat": { 2023-07-14T18:29:26.776 INFO:teuthology.orchestra.run.smithi163.stdout: "avgcount": 2274, 2023-07-14T18:29:26.776 INFO:teuthology.orchestra.run.smithi163.stdout: "sum": 0.048833301, 2023-07-14T18:29:26.776 INFO:teuthology.orchestra.run.smithi163.stdout: "avgtime": 0.000021474 2023-07-14T18:29:26.776 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:26.777 INFO:teuthology.orchestra.run.smithi163.stdout: "msgr_handle_ack_lat": { 2023-07-14T18:29:26.777 INFO:teuthology.orchestra.run.smithi163.stdout: "avgcount": 0, 2023-07-14T18:29:26.777 INFO:teuthology.orchestra.run.smithi163.stdout: "sum": 0.000000000, 2023-07-14T18:29:26.777 INFO:teuthology.orchestra.run.smithi163.stdout: "avgtime": 0.000000000 2023-07-14T18:29:26.777 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:26.778 INFO:teuthology.orchestra.run.smithi163.stdout: "msgr_recv_encrypted_bytes": 579808, 2023-07-14T18:29:26.778 INFO:teuthology.orchestra.run.smithi163.stdout: "msgr_send_encrypted_bytes": 170528 2023-07-14T18:29:26.778 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:26.778 INFO:teuthology.orchestra.run.smithi163.stdout: "AsyncMessenger::Worker-1": { 2023-07-14T18:29:26.778 INFO:teuthology.orchestra.run.smithi163.stdout: "msgr_recv_messages": 1256, 2023-07-14T18:29:26.779 INFO:teuthology.orchestra.run.smithi163.stdout: "msgr_send_messages": 1480, 2023-07-14T18:29:26.779 INFO:teuthology.orchestra.run.smithi163.stdout: "msgr_recv_bytes": 12895562, 2023-07-14T18:29:26.779 INFO:teuthology.orchestra.run.smithi163.stdout: "msgr_send_bytes": 848090, 2023-07-14T18:29:26.779 INFO:teuthology.orchestra.run.smithi163.stdout: "msgr_created_connections": 5, 2023-07-14T18:29:26.779 INFO:teuthology.orchestra.run.smithi163.stdout: "msgr_active_connections": 4, 2023-07-14T18:29:26.780 INFO:teuthology.orchestra.run.smithi163.stdout: "msgr_running_total_time": 0.101223177, 2023-07-14T18:29:26.780 INFO:teuthology.orchestra.run.smithi163.stdout: "msgr_running_send_time": 0.031007105, 2023-07-14T18:29:26.780 INFO:teuthology.orchestra.run.smithi163.stdout: "msgr_running_recv_time": 0.025892219, 2023-07-14T18:29:26.780 INFO:teuthology.orchestra.run.smithi163.stdout: "msgr_running_fast_dispatch_time": 0.035816928, 2023-07-14T18:29:26.780 INFO:teuthology.orchestra.run.smithi163.stdout: "msgr_send_messages_queue_lat": { 2023-07-14T18:29:26.780 INFO:teuthology.orchestra.run.smithi163.stdout: "avgcount": 1478, 2023-07-14T18:29:26.781 INFO:teuthology.orchestra.run.smithi163.stdout: "sum": 0.034954079, 2023-07-14T18:29:26.781 INFO:teuthology.orchestra.run.smithi163.stdout: "avgtime": 0.000023649 2023-07-14T18:29:26.781 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:26.781 INFO:teuthology.orchestra.run.smithi163.stdout: "msgr_handle_ack_lat": { 2023-07-14T18:29:26.781 INFO:teuthology.orchestra.run.smithi163.stdout: "avgcount": 0, 2023-07-14T18:29:26.782 INFO:teuthology.orchestra.run.smithi163.stdout: "sum": 0.000000000, 2023-07-14T18:29:26.782 INFO:teuthology.orchestra.run.smithi163.stdout: "avgtime": 0.000000000 2023-07-14T18:29:26.782 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:26.782 INFO:teuthology.orchestra.run.smithi163.stdout: "msgr_recv_encrypted_bytes": 160, 2023-07-14T18:29:26.782 INFO:teuthology.orchestra.run.smithi163.stdout: "msgr_send_encrypted_bytes": 457728 2023-07-14T18:29:26.783 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:26.783 INFO:teuthology.orchestra.run.smithi163.stdout: "AsyncMessenger::Worker-2": { 2023-07-14T18:29:26.783 INFO:teuthology.orchestra.run.smithi163.stdout: "msgr_recv_messages": 8, 2023-07-14T18:29:26.783 INFO:teuthology.orchestra.run.smithi163.stdout: "msgr_send_messages": 8, 2023-07-14T18:29:26.783 INFO:teuthology.orchestra.run.smithi163.stdout: "msgr_recv_bytes": 4589, 2023-07-14T18:29:26.783 INFO:teuthology.orchestra.run.smithi163.stdout: "msgr_send_bytes": 1704, 2023-07-14T18:29:26.784 INFO:teuthology.orchestra.run.smithi163.stdout: "msgr_created_connections": 7, 2023-07-14T18:29:26.784 INFO:teuthology.orchestra.run.smithi163.stdout: "msgr_active_connections": 4, 2023-07-14T18:29:26.784 INFO:teuthology.orchestra.run.smithi163.stdout: "msgr_running_total_time": 0.002395746, 2023-07-14T18:29:26.784 INFO:teuthology.orchestra.run.smithi163.stdout: "msgr_running_send_time": 0.000127510, 2023-07-14T18:29:26.784 INFO:teuthology.orchestra.run.smithi163.stdout: "msgr_running_recv_time": 0.002053216, 2023-07-14T18:29:26.785 INFO:teuthology.orchestra.run.smithi163.stdout: "msgr_running_fast_dispatch_time": 0.000102970, 2023-07-14T18:29:26.785 INFO:teuthology.orchestra.run.smithi163.stdout: "msgr_send_messages_queue_lat": { 2023-07-14T18:29:26.785 INFO:teuthology.orchestra.run.smithi163.stdout: "avgcount": 7, 2023-07-14T18:29:26.785 INFO:teuthology.orchestra.run.smithi163.stdout: "sum": 0.002957515, 2023-07-14T18:29:26.785 INFO:teuthology.orchestra.run.smithi163.stdout: "avgtime": 0.000422502 2023-07-14T18:29:26.786 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:26.786 INFO:teuthology.orchestra.run.smithi163.stdout: "msgr_handle_ack_lat": { 2023-07-14T18:29:26.786 INFO:teuthology.orchestra.run.smithi163.stdout: "avgcount": 0, 2023-07-14T18:29:26.786 INFO:teuthology.orchestra.run.smithi163.stdout: "sum": 0.000000000, 2023-07-14T18:29:26.786 INFO:teuthology.orchestra.run.smithi163.stdout: "avgtime": 0.000000000 2023-07-14T18:29:26.787 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:26.787 INFO:teuthology.orchestra.run.smithi163.stdout: "msgr_recv_encrypted_bytes": 2960, 2023-07-14T18:29:26.787 INFO:teuthology.orchestra.run.smithi163.stdout: "msgr_send_encrypted_bytes": 448 2023-07-14T18:29:26.787 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:26.787 INFO:teuthology.orchestra.run.smithi163.stdout: "cct": { 2023-07-14T18:29:26.788 INFO:teuthology.orchestra.run.smithi163.stdout: "total_workers": 1, 2023-07-14T18:29:26.788 INFO:teuthology.orchestra.run.smithi163.stdout: "unhealthy_workers": 0 2023-07-14T18:29:26.788 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:26.788 INFO:teuthology.orchestra.run.smithi163.stdout: "finisher-MDSRank": { 2023-07-14T18:29:26.788 INFO:teuthology.orchestra.run.smithi163.stdout: "queue_len": 0, 2023-07-14T18:29:26.789 INFO:teuthology.orchestra.run.smithi163.stdout: "complete_latency": { 2023-07-14T18:29:26.789 INFO:teuthology.orchestra.run.smithi163.stdout: "avgcount": 5432, 2023-07-14T18:29:26.789 INFO:teuthology.orchestra.run.smithi163.stdout: "sum": 0.133451997, 2023-07-14T18:29:26.789 INFO:teuthology.orchestra.run.smithi163.stdout: "avgtime": 0.000024567 2023-07-14T18:29:26.789 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-07-14T18:29:26.789 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:26.790 INFO:teuthology.orchestra.run.smithi163.stdout: "finisher-PurgeQueue": { 2023-07-14T18:29:26.790 INFO:teuthology.orchestra.run.smithi163.stdout: "queue_len": 0, 2023-07-14T18:29:26.790 INFO:teuthology.orchestra.run.smithi163.stdout: "complete_latency": { 2023-07-14T18:29:26.790 INFO:teuthology.orchestra.run.smithi163.stdout: "avgcount": 0, 2023-07-14T18:29:26.791 INFO:teuthology.orchestra.run.smithi163.stdout: "sum": 0.000000000, 2023-07-14T18:29:26.791 INFO:teuthology.orchestra.run.smithi163.stdout: "avgtime": 0.000000000 2023-07-14T18:29:26.791 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-07-14T18:29:26.791 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:26.791 INFO:teuthology.orchestra.run.smithi163.stdout: "mds": { 2023-07-14T18:29:26.792 INFO:teuthology.orchestra.run.smithi163.stdout: "request": 0, 2023-07-14T18:29:26.792 INFO:teuthology.orchestra.run.smithi163.stdout: "reply": 0, 2023-07-14T18:29:26.792 INFO:teuthology.orchestra.run.smithi163.stdout: "reply_latency": { 2023-07-14T18:29:26.792 INFO:teuthology.orchestra.run.smithi163.stdout: "avgcount": 0, 2023-07-14T18:29:26.792 INFO:teuthology.orchestra.run.smithi163.stdout: "sum": 0.000000000, 2023-07-14T18:29:26.793 INFO:teuthology.orchestra.run.smithi163.stdout: "avgtime": 0.000000000 2023-07-14T18:29:26.793 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:26.793 INFO:teuthology.orchestra.run.smithi163.stdout: "slow_reply": 0, 2023-07-14T18:29:26.793 INFO:teuthology.orchestra.run.smithi163.stdout: "forward": 0, 2023-07-14T18:29:26.793 INFO:teuthology.orchestra.run.smithi163.stdout: "dir_fetch_complete": 0, 2023-07-14T18:29:26.793 INFO:teuthology.orchestra.run.smithi163.stdout: "dir_fetch_keys": 0, 2023-07-14T18:29:26.794 INFO:teuthology.orchestra.run.smithi163.stdout: "dir_commit": 0, 2023-07-14T18:29:26.794 INFO:teuthology.orchestra.run.smithi163.stdout: "dir_split": 0, 2023-07-14T18:29:26.794 INFO:teuthology.orchestra.run.smithi163.stdout: "dir_merge": 0, 2023-07-14T18:29:26.794 INFO:teuthology.orchestra.run.smithi163.stdout: "inodes": 1352, 2023-07-14T18:29:26.794 INFO:teuthology.orchestra.run.smithi163.stdout: "inodes_top": 0, 2023-07-14T18:29:26.795 INFO:teuthology.orchestra.run.smithi163.stdout: "inodes_bottom": 0, 2023-07-14T18:29:26.795 INFO:teuthology.orchestra.run.smithi163.stdout: "inodes_pin_tail": 1352, 2023-07-14T18:29:26.795 INFO:teuthology.orchestra.run.smithi163.stdout: "inodes_pinned": 1352, 2023-07-14T18:29:26.795 INFO:teuthology.orchestra.run.smithi163.stdout: "inodes_expired": 0, 2023-07-14T18:29:26.795 INFO:teuthology.orchestra.run.smithi163.stdout: "inodes_with_caps": 0, 2023-07-14T18:29:26.795 INFO:teuthology.orchestra.run.smithi163.stdout: "caps": 0, 2023-07-14T18:29:26.796 INFO:teuthology.orchestra.run.smithi163.stdout: "subtrees": 48, 2023-07-14T18:29:26.796 INFO:teuthology.orchestra.run.smithi163.stdout: "traverse": 0, 2023-07-14T18:29:26.796 INFO:teuthology.orchestra.run.smithi163.stdout: "traverse_hit": 0, 2023-07-14T18:29:26.796 INFO:teuthology.orchestra.run.smithi163.stdout: "traverse_forward": 0, 2023-07-14T18:29:26.796 INFO:teuthology.orchestra.run.smithi163.stdout: "traverse_discover": 0, 2023-07-14T18:29:26.797 INFO:teuthology.orchestra.run.smithi163.stdout: "traverse_dir_fetch": 0, 2023-07-14T18:29:26.797 INFO:teuthology.orchestra.run.smithi163.stdout: "traverse_remote_ino": 0, 2023-07-14T18:29:26.797 INFO:teuthology.orchestra.run.smithi163.stdout: "traverse_lock": 0, 2023-07-14T18:29:26.797 INFO:teuthology.orchestra.run.smithi163.stdout: "load_cent": 0, 2023-07-14T18:29:26.797 INFO:teuthology.orchestra.run.smithi163.stdout: "q": 0, 2023-07-14T18:29:26.798 INFO:teuthology.orchestra.run.smithi163.stdout: "exported": 0, 2023-07-14T18:29:26.798 INFO:teuthology.orchestra.run.smithi163.stdout: "exported_inodes": 0, 2023-07-14T18:29:26.798 INFO:teuthology.orchestra.run.smithi163.stdout: "imported": 0, 2023-07-14T18:29:26.798 INFO:teuthology.orchestra.run.smithi163.stdout: "imported_inodes": 0, 2023-07-14T18:29:26.798 INFO:teuthology.orchestra.run.smithi163.stdout: "openino_dir_fetch": 0, 2023-07-14T18:29:26.799 INFO:teuthology.orchestra.run.smithi163.stdout: "openino_backtrace_fetch": 0, 2023-07-14T18:29:26.799 INFO:teuthology.orchestra.run.smithi163.stdout: "openino_peer_discover": 0, 2023-07-14T18:29:26.799 INFO:teuthology.orchestra.run.smithi163.stdout: "root_rfiles": 0, 2023-07-14T18:29:26.799 INFO:teuthology.orchestra.run.smithi163.stdout: "root_rbytes": 0, 2023-07-14T18:29:26.799 INFO:teuthology.orchestra.run.smithi163.stdout: "root_rsnaps": 0, 2023-07-14T18:29:26.800 INFO:teuthology.orchestra.run.smithi163.stdout: "scrub_backtrace_fetch": 0, 2023-07-14T18:29:26.800 INFO:teuthology.orchestra.run.smithi163.stdout: "scrub_set_tag": 0, 2023-07-14T18:29:26.800 INFO:teuthology.orchestra.run.smithi163.stdout: "scrub_backtrace_repaired": 0, 2023-07-14T18:29:26.800 INFO:teuthology.orchestra.run.smithi163.stdout: "scrub_inotable_repaired": 0, 2023-07-14T18:29:26.800 INFO:teuthology.orchestra.run.smithi163.stdout: "scrub_dir_inodes": 0, 2023-07-14T18:29:26.801 INFO:teuthology.orchestra.run.smithi163.stdout: "scrub_dir_base_inodes": 0, 2023-07-14T18:29:26.801 INFO:teuthology.orchestra.run.smithi163.stdout: "scrub_dirfrag_rstats": 0, 2023-07-14T18:29:26.801 INFO:teuthology.orchestra.run.smithi163.stdout: "scrub_file_inodes": 0, 2023-07-14T18:29:26.801 INFO:teuthology.orchestra.run.smithi163.stdout: "handle_inode_file_caps": 0, 2023-07-14T18:29:26.801 INFO:teuthology.orchestra.run.smithi163.stdout: "ceph_cap_op_revoke": 0, 2023-07-14T18:29:26.801 INFO:teuthology.orchestra.run.smithi163.stdout: "ceph_cap_op_grant": 0, 2023-07-14T18:29:26.802 INFO:teuthology.orchestra.run.smithi163.stdout: "ceph_cap_op_trunc": 0, 2023-07-14T18:29:26.802 INFO:teuthology.orchestra.run.smithi163.stdout: "ceph_cap_op_flushsnap_ack": 0, 2023-07-14T18:29:26.802 INFO:teuthology.orchestra.run.smithi163.stdout: "ceph_cap_op_flush_ack": 0, 2023-07-14T18:29:26.802 INFO:teuthology.orchestra.run.smithi163.stdout: "handle_client_caps": 0, 2023-07-14T18:29:26.802 INFO:teuthology.orchestra.run.smithi163.stdout: "handle_client_caps_dirty": 0, 2023-07-14T18:29:26.803 INFO:teuthology.orchestra.run.smithi163.stdout: "handle_client_cap_release": 0, 2023-07-14T18:29:26.803 INFO:teuthology.orchestra.run.smithi163.stdout: "process_request_cap_release": 0 2023-07-14T18:29:26.803 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:26.803 INFO:teuthology.orchestra.run.smithi163.stdout: "mds_cache": { 2023-07-14T18:29:26.803 INFO:teuthology.orchestra.run.smithi163.stdout: "dir_update": 0, 2023-07-14T18:29:26.804 INFO:teuthology.orchestra.run.smithi163.stdout: "dir_update_receipt": 0, 2023-07-14T18:29:26.804 INFO:teuthology.orchestra.run.smithi163.stdout: "dir_try_discover": 0, 2023-07-14T18:29:26.804 INFO:teuthology.orchestra.run.smithi163.stdout: "dir_send_discover": 0, 2023-07-14T18:29:26.804 INFO:teuthology.orchestra.run.smithi163.stdout: "dir_handle_discover": 0, 2023-07-14T18:29:26.804 INFO:teuthology.orchestra.run.smithi163.stdout: "num_strays": 0, 2023-07-14T18:29:26.805 INFO:teuthology.orchestra.run.smithi163.stdout: "num_strays_delayed": 0, 2023-07-14T18:29:26.805 INFO:teuthology.orchestra.run.smithi163.stdout: "num_strays_enqueuing": 0, 2023-07-14T18:29:26.805 INFO:teuthology.orchestra.run.smithi163.stdout: "strays_created": 0, 2023-07-14T18:29:26.805 INFO:teuthology.orchestra.run.smithi163.stdout: "strays_enqueued": 0, 2023-07-14T18:29:26.805 INFO:teuthology.orchestra.run.smithi163.stdout: "strays_reintegrated": 0, 2023-07-14T18:29:26.806 INFO:teuthology.orchestra.run.smithi163.stdout: "strays_migrated": 0, 2023-07-14T18:29:26.806 INFO:teuthology.orchestra.run.smithi163.stdout: "num_recovering_processing": 0, 2023-07-14T18:29:26.806 INFO:teuthology.orchestra.run.smithi163.stdout: "num_recovering_enqueued": 0, 2023-07-14T18:29:26.806 INFO:teuthology.orchestra.run.smithi163.stdout: "num_recovering_prioritized": 0, 2023-07-14T18:29:26.807 INFO:teuthology.orchestra.run.smithi163.stdout: "recovery_started": 0, 2023-07-14T18:29:26.807 INFO:teuthology.orchestra.run.smithi163.stdout: "recovery_completed": 0, 2023-07-14T18:29:26.807 INFO:teuthology.orchestra.run.smithi163.stdout: "ireq_enqueue_scrub": 0, 2023-07-14T18:29:26.807 INFO:teuthology.orchestra.run.smithi163.stdout: "ireq_exportdir": 0, 2023-07-14T18:29:26.807 INFO:teuthology.orchestra.run.smithi163.stdout: "ireq_flush": 0, 2023-07-14T18:29:26.807 INFO:teuthology.orchestra.run.smithi163.stdout: "ireq_fragmentdir": 0, 2023-07-14T18:29:26.808 INFO:teuthology.orchestra.run.smithi163.stdout: "ireq_fragstats": 0, 2023-07-14T18:29:26.808 INFO:teuthology.orchestra.run.smithi163.stdout: "ireq_inodestats": 0 2023-07-14T18:29:26.808 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:26.808 INFO:teuthology.orchestra.run.smithi163.stdout: "mds_log": { 2023-07-14T18:29:26.808 INFO:teuthology.orchestra.run.smithi163.stdout: "evadd": 0, 2023-07-14T18:29:26.809 INFO:teuthology.orchestra.run.smithi163.stdout: "evex": 0, 2023-07-14T18:29:26.809 INFO:teuthology.orchestra.run.smithi163.stdout: "evtrm": 0, 2023-07-14T18:29:26.809 INFO:teuthology.orchestra.run.smithi163.stdout: "ev": 0, 2023-07-14T18:29:26.809 INFO:teuthology.orchestra.run.smithi163.stdout: "evexg": 0, 2023-07-14T18:29:26.809 INFO:teuthology.orchestra.run.smithi163.stdout: "evexd": 0, 2023-07-14T18:29:26.810 INFO:teuthology.orchestra.run.smithi163.stdout: "segadd": 0, 2023-07-14T18:29:26.810 INFO:teuthology.orchestra.run.smithi163.stdout: "segex": 0, 2023-07-14T18:29:26.810 INFO:teuthology.orchestra.run.smithi163.stdout: "segtrm": 0, 2023-07-14T18:29:26.810 INFO:teuthology.orchestra.run.smithi163.stdout: "seg": 24, 2023-07-14T18:29:26.810 INFO:teuthology.orchestra.run.smithi163.stdout: "segexg": 0, 2023-07-14T18:29:26.810 INFO:teuthology.orchestra.run.smithi163.stdout: "segexd": 0, 2023-07-14T18:29:26.811 INFO:teuthology.orchestra.run.smithi163.stdout: "expos": 4194304, 2023-07-14T18:29:26.811 INFO:teuthology.orchestra.run.smithi163.stdout: "wrpos": 0, 2023-07-14T18:29:26.811 INFO:teuthology.orchestra.run.smithi163.stdout: "rdpos": 19515220, 2023-07-14T18:29:26.811 INFO:teuthology.orchestra.run.smithi163.stdout: "jlat": { 2023-07-14T18:29:26.811 INFO:teuthology.orchestra.run.smithi163.stdout: "avgcount": 0, 2023-07-14T18:29:26.812 INFO:teuthology.orchestra.run.smithi163.stdout: "sum": 0.000000000, 2023-07-14T18:29:26.812 INFO:teuthology.orchestra.run.smithi163.stdout: "avgtime": 0.000000000 2023-07-14T18:29:26.812 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:26.812 INFO:teuthology.orchestra.run.smithi163.stdout: "replayed": 21869 2023-07-14T18:29:26.812 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:26.813 INFO:teuthology.orchestra.run.smithi163.stdout: "mds_mem": { 2023-07-14T18:29:26.813 INFO:teuthology.orchestra.run.smithi163.stdout: "ino": 860, 2023-07-14T18:29:26.813 INFO:teuthology.orchestra.run.smithi163.stdout: "ino+": 1135, 2023-07-14T18:29:26.813 INFO:teuthology.orchestra.run.smithi163.stdout: "ino-": 275, 2023-07-14T18:29:26.813 INFO:teuthology.orchestra.run.smithi163.stdout: "dir": 69, 2023-07-14T18:29:26.813 INFO:teuthology.orchestra.run.smithi163.stdout: "dir+": 69, 2023-07-14T18:29:26.814 INFO:teuthology.orchestra.run.smithi163.stdout: "dir-": 0, 2023-07-14T18:29:26.814 INFO:teuthology.orchestra.run.smithi163.stdout: "dn": 1352, 2023-07-14T18:29:26.814 INFO:teuthology.orchestra.run.smithi163.stdout: "dn+": 1352, 2023-07-14T18:29:26.814 INFO:teuthology.orchestra.run.smithi163.stdout: "dn-": 0, 2023-07-14T18:29:26.814 INFO:teuthology.orchestra.run.smithi163.stdout: "cap": 0, 2023-07-14T18:29:26.815 INFO:teuthology.orchestra.run.smithi163.stdout: "cap+": 0, 2023-07-14T18:29:26.815 INFO:teuthology.orchestra.run.smithi163.stdout: "cap-": 0, 2023-07-14T18:29:26.815 INFO:teuthology.orchestra.run.smithi163.stdout: "rss": 50724, 2023-07-14T18:29:26.815 INFO:teuthology.orchestra.run.smithi163.stdout: "heap": 207152 2023-07-14T18:29:26.815 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:26.816 INFO:teuthology.orchestra.run.smithi163.stdout: "mds_server": { 2023-07-14T18:29:26.816 INFO:teuthology.orchestra.run.smithi163.stdout: "dispatch_client_request": 0, 2023-07-14T18:29:26.816 INFO:teuthology.orchestra.run.smithi163.stdout: "dispatch_server_request": 0, 2023-07-14T18:29:26.816 INFO:teuthology.orchestra.run.smithi163.stdout: "handle_client_request": 0, 2023-07-14T18:29:26.816 INFO:teuthology.orchestra.run.smithi163.stdout: "handle_client_session": 0, 2023-07-14T18:29:26.817 INFO:teuthology.orchestra.run.smithi163.stdout: "handle_peer_request": 0, 2023-07-14T18:29:26.817 INFO:teuthology.orchestra.run.smithi163.stdout: "req_create_latency": { 2023-07-14T18:29:26.817 INFO:teuthology.orchestra.run.smithi163.stdout: "avgcount": 0, 2023-07-14T18:29:26.817 INFO:teuthology.orchestra.run.smithi163.stdout: "sum": 0.000000000, 2023-07-14T18:29:26.817 INFO:teuthology.orchestra.run.smithi163.stdout: "avgtime": 0.000000000 2023-07-14T18:29:26.818 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:26.818 INFO:teuthology.orchestra.run.smithi163.stdout: "req_getattr_latency": { 2023-07-14T18:29:26.818 INFO:teuthology.orchestra.run.smithi163.stdout: "avgcount": 0, 2023-07-14T18:29:26.818 INFO:teuthology.orchestra.run.smithi163.stdout: "sum": 0.000000000, 2023-07-14T18:29:26.818 INFO:teuthology.orchestra.run.smithi163.stdout: "avgtime": 0.000000000 2023-07-14T18:29:26.818 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:26.819 INFO:teuthology.orchestra.run.smithi163.stdout: "req_getfilelock_latency": { 2023-07-14T18:29:26.819 INFO:teuthology.orchestra.run.smithi163.stdout: "avgcount": 0, 2023-07-14T18:29:26.819 INFO:teuthology.orchestra.run.smithi163.stdout: "sum": 0.000000000, 2023-07-14T18:29:26.819 INFO:teuthology.orchestra.run.smithi163.stdout: "avgtime": 0.000000000 2023-07-14T18:29:26.819 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:26.820 INFO:teuthology.orchestra.run.smithi163.stdout: "req_link_latency": { 2023-07-14T18:29:26.820 INFO:teuthology.orchestra.run.smithi163.stdout: "avgcount": 0, 2023-07-14T18:29:26.820 INFO:teuthology.orchestra.run.smithi163.stdout: "sum": 0.000000000, 2023-07-14T18:29:26.820 INFO:teuthology.orchestra.run.smithi163.stdout: "avgtime": 0.000000000 2023-07-14T18:29:26.820 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:26.821 INFO:teuthology.orchestra.run.smithi163.stdout: "req_lookup_latency": { 2023-07-14T18:29:26.821 INFO:teuthology.orchestra.run.smithi163.stdout: "avgcount": 0, 2023-07-14T18:29:26.821 INFO:teuthology.orchestra.run.smithi163.stdout: "sum": 0.000000000, 2023-07-14T18:29:26.821 INFO:teuthology.orchestra.run.smithi163.stdout: "avgtime": 0.000000000 2023-07-14T18:29:26.821 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:26.822 INFO:teuthology.orchestra.run.smithi163.stdout: "req_lookuphash_latency": { 2023-07-14T18:29:26.822 INFO:teuthology.orchestra.run.smithi163.stdout: "avgcount": 0, 2023-07-14T18:29:26.822 INFO:teuthology.orchestra.run.smithi163.stdout: "sum": 0.000000000, 2023-07-14T18:29:26.822 INFO:teuthology.orchestra.run.smithi163.stdout: "avgtime": 0.000000000 2023-07-14T18:29:26.822 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:26.823 INFO:teuthology.orchestra.run.smithi163.stdout: "req_lookupino_latency": { 2023-07-14T18:29:26.823 INFO:teuthology.orchestra.run.smithi163.stdout: "avgcount": 0, 2023-07-14T18:29:26.823 INFO:teuthology.orchestra.run.smithi163.stdout: "sum": 0.000000000, 2023-07-14T18:29:26.823 INFO:teuthology.orchestra.run.smithi163.stdout: "avgtime": 0.000000000 2023-07-14T18:29:26.823 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:26.824 INFO:teuthology.orchestra.run.smithi163.stdout: "req_lookupname_latency": { 2023-07-14T18:29:26.824 INFO:teuthology.orchestra.run.smithi163.stdout: "avgcount": 0, 2023-07-14T18:29:26.824 INFO:teuthology.orchestra.run.smithi163.stdout: "sum": 0.000000000, 2023-07-14T18:29:26.824 INFO:teuthology.orchestra.run.smithi163.stdout: "avgtime": 0.000000000 2023-07-14T18:29:26.824 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:26.825 INFO:teuthology.orchestra.run.smithi163.stdout: "req_lookupparent_latency": { 2023-07-14T18:29:26.825 INFO:teuthology.orchestra.run.smithi163.stdout: "avgcount": 0, 2023-07-14T18:29:26.825 INFO:teuthology.orchestra.run.smithi163.stdout: "sum": 0.000000000, 2023-07-14T18:29:26.825 INFO:teuthology.orchestra.run.smithi163.stdout: "avgtime": 0.000000000 2023-07-14T18:29:26.825 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:26.826 INFO:teuthology.orchestra.run.smithi163.stdout: "req_lookupsnap_latency": { 2023-07-14T18:29:26.826 INFO:teuthology.orchestra.run.smithi163.stdout: "avgcount": 0, 2023-07-14T18:29:26.826 INFO:teuthology.orchestra.run.smithi163.stdout: "sum": 0.000000000, 2023-07-14T18:29:26.826 INFO:teuthology.orchestra.run.smithi163.stdout: "avgtime": 0.000000000 2023-07-14T18:29:26.826 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:26.826 INFO:teuthology.orchestra.run.smithi163.stdout: "req_lssnap_latency": { 2023-07-14T18:29:26.827 INFO:teuthology.orchestra.run.smithi163.stdout: "avgcount": 0, 2023-07-14T18:29:26.827 INFO:teuthology.orchestra.run.smithi163.stdout: "sum": 0.000000000, 2023-07-14T18:29:26.827 INFO:teuthology.orchestra.run.smithi163.stdout: "avgtime": 0.000000000 2023-07-14T18:29:26.827 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:26.827 INFO:teuthology.orchestra.run.smithi163.stdout: "req_mkdir_latency": { 2023-07-14T18:29:26.828 INFO:teuthology.orchestra.run.smithi163.stdout: "avgcount": 0, 2023-07-14T18:29:26.828 INFO:teuthology.orchestra.run.smithi163.stdout: "sum": 0.000000000, 2023-07-14T18:29:26.828 INFO:teuthology.orchestra.run.smithi163.stdout: "avgtime": 0.000000000 2023-07-14T18:29:26.828 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:26.828 INFO:teuthology.orchestra.run.smithi163.stdout: "req_mknod_latency": { 2023-07-14T18:29:26.829 INFO:teuthology.orchestra.run.smithi163.stdout: "avgcount": 0, 2023-07-14T18:29:26.829 INFO:teuthology.orchestra.run.smithi163.stdout: "sum": 0.000000000, 2023-07-14T18:29:26.829 INFO:teuthology.orchestra.run.smithi163.stdout: "avgtime": 0.000000000 2023-07-14T18:29:26.829 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:26.829 INFO:teuthology.orchestra.run.smithi163.stdout: "req_mksnap_latency": { 2023-07-14T18:29:26.830 INFO:teuthology.orchestra.run.smithi163.stdout: "avgcount": 0, 2023-07-14T18:29:26.830 INFO:teuthology.orchestra.run.smithi163.stdout: "sum": 0.000000000, 2023-07-14T18:29:26.830 INFO:teuthology.orchestra.run.smithi163.stdout: "avgtime": 0.000000000 2023-07-14T18:29:26.830 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:26.830 INFO:teuthology.orchestra.run.smithi163.stdout: "req_open_latency": { 2023-07-14T18:29:26.831 INFO:teuthology.orchestra.run.smithi163.stdout: "avgcount": 0, 2023-07-14T18:29:26.831 INFO:teuthology.orchestra.run.smithi163.stdout: "sum": 0.000000000, 2023-07-14T18:29:26.831 INFO:teuthology.orchestra.run.smithi163.stdout: "avgtime": 0.000000000 2023-07-14T18:29:26.831 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:26.831 INFO:teuthology.orchestra.run.smithi163.stdout: "req_readdir_latency": { 2023-07-14T18:29:26.832 INFO:teuthology.orchestra.run.smithi163.stdout: "avgcount": 0, 2023-07-14T18:29:26.832 INFO:teuthology.orchestra.run.smithi163.stdout: "sum": 0.000000000, 2023-07-14T18:29:26.832 INFO:teuthology.orchestra.run.smithi163.stdout: "avgtime": 0.000000000 2023-07-14T18:29:26.832 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:26.833 INFO:teuthology.orchestra.run.smithi163.stdout: "req_rename_latency": { 2023-07-14T18:29:26.833 INFO:teuthology.orchestra.run.smithi163.stdout: "avgcount": 0, 2023-07-14T18:29:26.833 INFO:teuthology.orchestra.run.smithi163.stdout: "sum": 0.000000000, 2023-07-14T18:29:26.833 INFO:teuthology.orchestra.run.smithi163.stdout: "avgtime": 0.000000000 2023-07-14T18:29:26.833 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:26.834 INFO:teuthology.orchestra.run.smithi163.stdout: "req_renamesnap_latency": { 2023-07-14T18:29:26.834 INFO:teuthology.orchestra.run.smithi163.stdout: "avgcount": 0, 2023-07-14T18:29:26.834 INFO:teuthology.orchestra.run.smithi163.stdout: "sum": 0.000000000, 2023-07-14T18:29:26.834 INFO:teuthology.orchestra.run.smithi163.stdout: "avgtime": 0.000000000 2023-07-14T18:29:26.834 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:26.835 INFO:teuthology.orchestra.run.smithi163.stdout: "req_snapdiff_latency": { 2023-07-14T18:29:26.835 INFO:teuthology.orchestra.run.smithi163.stdout: "avgcount": 0, 2023-07-14T18:29:26.835 INFO:teuthology.orchestra.run.smithi163.stdout: "sum": 0.000000000, 2023-07-14T18:29:26.835 INFO:teuthology.orchestra.run.smithi163.stdout: "avgtime": 0.000000000 2023-07-14T18:29:26.835 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:26.836 INFO:teuthology.orchestra.run.smithi163.stdout: "req_rmdir_latency": { 2023-07-14T18:29:26.836 INFO:teuthology.orchestra.run.smithi163.stdout: "avgcount": 0, 2023-07-14T18:29:26.836 INFO:teuthology.orchestra.run.smithi163.stdout: "sum": 0.000000000, 2023-07-14T18:29:26.836 INFO:teuthology.orchestra.run.smithi163.stdout: "avgtime": 0.000000000 2023-07-14T18:29:26.836 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:26.836 INFO:teuthology.orchestra.run.smithi163.stdout: "req_rmsnap_latency": { 2023-07-14T18:29:26.837 INFO:teuthology.orchestra.run.smithi163.stdout: "avgcount": 0, 2023-07-14T18:29:26.837 INFO:teuthology.orchestra.run.smithi163.stdout: "sum": 0.000000000, 2023-07-14T18:29:26.837 INFO:teuthology.orchestra.run.smithi163.stdout: "avgtime": 0.000000000 2023-07-14T18:29:26.837 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:26.837 INFO:teuthology.orchestra.run.smithi163.stdout: "req_rmxattr_latency": { 2023-07-14T18:29:26.838 INFO:teuthology.orchestra.run.smithi163.stdout: "avgcount": 0, 2023-07-14T18:29:26.838 INFO:teuthology.orchestra.run.smithi163.stdout: "sum": 0.000000000, 2023-07-14T18:29:26.838 INFO:teuthology.orchestra.run.smithi163.stdout: "avgtime": 0.000000000 2023-07-14T18:29:26.838 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:26.838 INFO:teuthology.orchestra.run.smithi163.stdout: "req_setattr_latency": { 2023-07-14T18:29:26.839 INFO:teuthology.orchestra.run.smithi163.stdout: "avgcount": 0, 2023-07-14T18:29:26.839 INFO:teuthology.orchestra.run.smithi163.stdout: "sum": 0.000000000, 2023-07-14T18:29:26.839 INFO:teuthology.orchestra.run.smithi163.stdout: "avgtime": 0.000000000 2023-07-14T18:29:26.839 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:26.839 INFO:teuthology.orchestra.run.smithi163.stdout: "req_setdirlayout_latency": { 2023-07-14T18:29:26.840 INFO:teuthology.orchestra.run.smithi163.stdout: "avgcount": 0, 2023-07-14T18:29:26.840 INFO:teuthology.orchestra.run.smithi163.stdout: "sum": 0.000000000, 2023-07-14T18:29:26.840 INFO:teuthology.orchestra.run.smithi163.stdout: "avgtime": 0.000000000 2023-07-14T18:29:26.840 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:26.840 INFO:teuthology.orchestra.run.smithi163.stdout: "req_setfilelock_latency": { 2023-07-14T18:29:26.840 INFO:teuthology.orchestra.run.smithi163.stdout: "avgcount": 0, 2023-07-14T18:29:26.841 INFO:teuthology.orchestra.run.smithi163.stdout: "sum": 0.000000000, 2023-07-14T18:29:26.841 INFO:teuthology.orchestra.run.smithi163.stdout: "avgtime": 0.000000000 2023-07-14T18:29:26.841 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:26.841 INFO:teuthology.orchestra.run.smithi163.stdout: "req_setlayout_latency": { 2023-07-14T18:29:26.841 INFO:teuthology.orchestra.run.smithi163.stdout: "avgcount": 0, 2023-07-14T18:29:26.842 INFO:teuthology.orchestra.run.smithi163.stdout: "sum": 0.000000000, 2023-07-14T18:29:26.842 INFO:teuthology.orchestra.run.smithi163.stdout: "avgtime": 0.000000000 2023-07-14T18:29:26.842 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:26.842 INFO:teuthology.orchestra.run.smithi163.stdout: "req_setxattr_latency": { 2023-07-14T18:29:26.842 INFO:teuthology.orchestra.run.smithi163.stdout: "avgcount": 0, 2023-07-14T18:29:26.843 INFO:teuthology.orchestra.run.smithi163.stdout: "sum": 0.000000000, 2023-07-14T18:29:26.843 INFO:teuthology.orchestra.run.smithi163.stdout: "avgtime": 0.000000000 2023-07-14T18:29:26.843 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:26.843 INFO:teuthology.orchestra.run.smithi163.stdout: "req_symlink_latency": { 2023-07-14T18:29:26.843 INFO:teuthology.orchestra.run.smithi163.stdout: "avgcount": 0, 2023-07-14T18:29:26.844 INFO:teuthology.orchestra.run.smithi163.stdout: "sum": 0.000000000, 2023-07-14T18:29:26.844 INFO:teuthology.orchestra.run.smithi163.stdout: "avgtime": 0.000000000 2023-07-14T18:29:26.844 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:26.844 INFO:teuthology.orchestra.run.smithi163.stdout: "req_unlink_latency": { 2023-07-14T18:29:26.844 INFO:teuthology.orchestra.run.smithi163.stdout: "avgcount": 0, 2023-07-14T18:29:26.844 INFO:teuthology.orchestra.run.smithi163.stdout: "sum": 0.000000000, 2023-07-14T18:29:26.845 INFO:teuthology.orchestra.run.smithi163.stdout: "avgtime": 0.000000000 2023-07-14T18:29:26.845 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:26.845 INFO:teuthology.orchestra.run.smithi163.stdout: "cap_revoke_eviction": 0, 2023-07-14T18:29:26.845 INFO:teuthology.orchestra.run.smithi163.stdout: "cap_acquisition_throttle": 0, 2023-07-14T18:29:26.845 INFO:teuthology.orchestra.run.smithi163.stdout: "req_getvxattr_latency": { 2023-07-14T18:29:26.846 INFO:teuthology.orchestra.run.smithi163.stdout: "avgcount": 0, 2023-07-14T18:29:26.846 INFO:teuthology.orchestra.run.smithi163.stdout: "sum": 0.000000000, 2023-07-14T18:29:26.846 INFO:teuthology.orchestra.run.smithi163.stdout: "avgtime": 0.000000000 2023-07-14T18:29:26.846 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-07-14T18:29:26.846 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:26.847 INFO:teuthology.orchestra.run.smithi163.stdout: "mds_sessions": { 2023-07-14T18:29:26.847 INFO:teuthology.orchestra.run.smithi163.stdout: "session_count": 1, 2023-07-14T18:29:26.847 INFO:teuthology.orchestra.run.smithi163.stdout: "session_add": 1, 2023-07-14T18:29:26.847 INFO:teuthology.orchestra.run.smithi163.stdout: "session_remove": 0, 2023-07-14T18:29:26.847 INFO:teuthology.orchestra.run.smithi163.stdout: "sessions_open": 1, 2023-07-14T18:29:26.848 INFO:teuthology.orchestra.run.smithi163.stdout: "sessions_stale": 0, 2023-07-14T18:29:26.848 INFO:teuthology.orchestra.run.smithi163.stdout: "total_load": 0, 2023-07-14T18:29:26.848 INFO:teuthology.orchestra.run.smithi163.stdout: "average_load": 0, 2023-07-14T18:29:26.848 INFO:teuthology.orchestra.run.smithi163.stdout: "avg_session_uptime": 2582 2023-07-14T18:29:26.848 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:26.849 INFO:teuthology.orchestra.run.smithi163.stdout: "mempool": { 2023-07-14T18:29:26.849 INFO:teuthology.orchestra.run.smithi163.stdout: "bloom_filter_bytes": 0, 2023-07-14T18:29:26.849 INFO:teuthology.orchestra.run.smithi163.stdout: "bloom_filter_items": 0, 2023-07-14T18:29:26.849 INFO:teuthology.orchestra.run.smithi163.stdout: "bluestore_alloc_bytes": 0, 2023-07-14T18:29:26.849 INFO:teuthology.orchestra.run.smithi163.stdout: "bluestore_alloc_items": 0, 2023-07-14T18:29:26.850 INFO:teuthology.orchestra.run.smithi163.stdout: "bluestore_cache_data_bytes": 0, 2023-07-14T18:29:26.850 INFO:teuthology.orchestra.run.smithi163.stdout: "bluestore_cache_data_items": 0, 2023-07-14T18:29:26.850 INFO:teuthology.orchestra.run.smithi163.stdout: "bluestore_cache_onode_bytes": 0, 2023-07-14T18:29:26.850 INFO:teuthology.orchestra.run.smithi163.stdout: "bluestore_cache_onode_items": 0, 2023-07-14T18:29:26.850 INFO:teuthology.orchestra.run.smithi163.stdout: "bluestore_cache_meta_bytes": 0, 2023-07-14T18:29:26.850 INFO:teuthology.orchestra.run.smithi163.stdout: "bluestore_cache_meta_items": 0, 2023-07-14T18:29:26.851 INFO:teuthology.orchestra.run.smithi163.stdout: "bluestore_cache_other_bytes": 0, 2023-07-14T18:29:26.851 INFO:teuthology.orchestra.run.smithi163.stdout: "bluestore_cache_other_items": 0, 2023-07-14T18:29:26.851 INFO:teuthology.orchestra.run.smithi163.stdout: "bluestore_cache_buffer_bytes": 0, 2023-07-14T18:29:26.851 INFO:teuthology.orchestra.run.smithi163.stdout: "bluestore_cache_buffer_items": 0, 2023-07-14T18:29:26.851 INFO:teuthology.orchestra.run.smithi163.stdout: "bluestore_extent_bytes": 0, 2023-07-14T18:29:26.852 INFO:teuthology.orchestra.run.smithi163.stdout: "bluestore_extent_items": 0, 2023-07-14T18:29:26.852 INFO:teuthology.orchestra.run.smithi163.stdout: "bluestore_blob_bytes": 0, 2023-07-14T18:29:26.852 INFO:teuthology.orchestra.run.smithi163.stdout: "bluestore_blob_items": 0, 2023-07-14T18:29:26.852 INFO:teuthology.orchestra.run.smithi163.stdout: "bluestore_shared_blob_bytes": 0, 2023-07-14T18:29:26.852 INFO:teuthology.orchestra.run.smithi163.stdout: "bluestore_shared_blob_items": 0, 2023-07-14T18:29:26.853 INFO:teuthology.orchestra.run.smithi163.stdout: "bluestore_inline_bl_bytes": 0, 2023-07-14T18:29:26.853 INFO:teuthology.orchestra.run.smithi163.stdout: "bluestore_inline_bl_items": 0, 2023-07-14T18:29:26.853 INFO:teuthology.orchestra.run.smithi163.stdout: "bluestore_fsck_bytes": 0, 2023-07-14T18:29:26.853 INFO:teuthology.orchestra.run.smithi163.stdout: "bluestore_fsck_items": 0, 2023-07-14T18:29:26.853 INFO:teuthology.orchestra.run.smithi163.stdout: "bluestore_txc_bytes": 0, 2023-07-14T18:29:26.854 INFO:teuthology.orchestra.run.smithi163.stdout: "bluestore_txc_items": 0, 2023-07-14T18:29:26.854 INFO:teuthology.orchestra.run.smithi163.stdout: "bluestore_writing_deferred_bytes": 0, 2023-07-14T18:29:26.854 INFO:teuthology.orchestra.run.smithi163.stdout: "bluestore_writing_deferred_items": 0, 2023-07-14T18:29:26.854 INFO:teuthology.orchestra.run.smithi163.stdout: "bluestore_writing_bytes": 0, 2023-07-14T18:29:26.854 INFO:teuthology.orchestra.run.smithi163.stdout: "bluestore_writing_items": 0, 2023-07-14T18:29:26.854 INFO:teuthology.orchestra.run.smithi163.stdout: "bluefs_bytes": 0, 2023-07-14T18:29:26.855 INFO:teuthology.orchestra.run.smithi163.stdout: "bluefs_items": 0, 2023-07-14T18:29:26.855 INFO:teuthology.orchestra.run.smithi163.stdout: "bluefs_file_reader_bytes": 0, 2023-07-14T18:29:26.855 INFO:teuthology.orchestra.run.smithi163.stdout: "bluefs_file_reader_items": 0, 2023-07-14T18:29:26.855 INFO:teuthology.orchestra.run.smithi163.stdout: "bluefs_file_writer_bytes": 0, 2023-07-14T18:29:26.855 INFO:teuthology.orchestra.run.smithi163.stdout: "bluefs_file_writer_items": 0, 2023-07-14T18:29:26.856 INFO:teuthology.orchestra.run.smithi163.stdout: "buffer_anon_bytes": 199295, 2023-07-14T18:29:26.856 INFO:teuthology.orchestra.run.smithi163.stdout: "buffer_anon_items": 58, 2023-07-14T18:29:26.856 INFO:teuthology.orchestra.run.smithi163.stdout: "buffer_meta_bytes": 0, 2023-07-14T18:29:26.856 INFO:teuthology.orchestra.run.smithi163.stdout: "buffer_meta_items": 0, 2023-07-14T18:29:26.856 INFO:teuthology.orchestra.run.smithi163.stdout: "osd_bytes": 0, 2023-07-14T18:29:26.857 INFO:teuthology.orchestra.run.smithi163.stdout: "osd_items": 0, 2023-07-14T18:29:26.857 INFO:teuthology.orchestra.run.smithi163.stdout: "osd_mapbl_bytes": 0, 2023-07-14T18:29:26.857 INFO:teuthology.orchestra.run.smithi163.stdout: "osd_mapbl_items": 0, 2023-07-14T18:29:26.857 INFO:teuthology.orchestra.run.smithi163.stdout: "osd_pglog_bytes": 0, 2023-07-14T18:29:26.857 INFO:teuthology.orchestra.run.smithi163.stdout: "osd_pglog_items": 0, 2023-07-14T18:29:26.858 INFO:teuthology.orchestra.run.smithi163.stdout: "osdmap_bytes": 8792, 2023-07-14T18:29:26.858 INFO:teuthology.orchestra.run.smithi163.stdout: "osdmap_items": 168, 2023-07-14T18:29:26.858 INFO:teuthology.orchestra.run.smithi163.stdout: "osdmap_mapping_bytes": 0, 2023-07-14T18:29:26.858 INFO:teuthology.orchestra.run.smithi163.stdout: "osdmap_mapping_items": 0, 2023-07-14T18:29:26.858 INFO:teuthology.orchestra.run.smithi163.stdout: "pgmap_bytes": 0, 2023-07-14T18:29:26.858 INFO:teuthology.orchestra.run.smithi163.stdout: "pgmap_items": 0, 2023-07-14T18:29:26.859 INFO:teuthology.orchestra.run.smithi163.stdout: "mds_co_bytes": 2809472, 2023-07-14T18:29:26.859 INFO:teuthology.orchestra.run.smithi163.stdout: "mds_co_items": 10693, 2023-07-14T18:29:26.859 INFO:teuthology.orchestra.run.smithi163.stdout: "unittest_1_bytes": 0, 2023-07-14T18:29:26.859 INFO:teuthology.orchestra.run.smithi163.stdout: "unittest_1_items": 0, 2023-07-14T18:29:26.859 INFO:teuthology.orchestra.run.smithi163.stdout: "unittest_2_bytes": 0, 2023-07-14T18:29:26.860 INFO:teuthology.orchestra.run.smithi163.stdout: "unittest_2_items": 0 2023-07-14T18:29:26.860 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:26.860 INFO:teuthology.orchestra.run.smithi163.stdout: "objecter": { 2023-07-14T18:29:26.860 INFO:teuthology.orchestra.run.smithi163.stdout: "op_active": 0, 2023-07-14T18:29:26.860 INFO:teuthology.orchestra.run.smithi163.stdout: "op_laggy": 0, 2023-07-14T18:29:26.861 INFO:teuthology.orchestra.run.smithi163.stdout: "op_send": 3229, 2023-07-14T18:29:26.861 INFO:teuthology.orchestra.run.smithi163.stdout: "op_send_bytes": 21, 2023-07-14T18:29:26.861 INFO:teuthology.orchestra.run.smithi163.stdout: "op_resend": 3, 2023-07-14T18:29:26.861 INFO:teuthology.orchestra.run.smithi163.stdout: "op_reply": 3229, 2023-07-14T18:29:26.861 INFO:teuthology.orchestra.run.smithi163.stdout: "op_latency": { 2023-07-14T18:29:26.862 INFO:teuthology.orchestra.run.smithi163.stdout: "avgcount": 3229, 2023-07-14T18:29:26.862 INFO:teuthology.orchestra.run.smithi163.stdout: "sum": 1.358968867, 2023-07-14T18:29:26.862 INFO:teuthology.orchestra.run.smithi163.stdout: "avgtime": 0.000420863 2023-07-14T18:29:26.862 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:26.862 INFO:teuthology.orchestra.run.smithi163.stdout: "op_inflight": 0, 2023-07-14T18:29:26.863 INFO:teuthology.orchestra.run.smithi163.stdout: "oplen_avg": { 2023-07-14T18:29:26.863 INFO:teuthology.orchestra.run.smithi163.stdout: "avgcount": 3229, 2023-07-14T18:29:26.863 INFO:teuthology.orchestra.run.smithi163.stdout: "sum": 3230 2023-07-14T18:29:26.863 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:26.863 INFO:teuthology.orchestra.run.smithi163.stdout: "op": 3229, 2023-07-14T18:29:26.864 INFO:teuthology.orchestra.run.smithi163.stdout: "op_r": 3229, 2023-07-14T18:29:26.864 INFO:teuthology.orchestra.run.smithi163.stdout: "op_w": 0, 2023-07-14T18:29:26.864 INFO:teuthology.orchestra.run.smithi163.stdout: "op_rmw": 0, 2023-07-14T18:29:26.864 INFO:teuthology.orchestra.run.smithi163.stdout: "op_pg": 0, 2023-07-14T18:29:26.864 INFO:teuthology.orchestra.run.smithi163.stdout: "osdop_stat": 2078, 2023-07-14T18:29:26.865 INFO:teuthology.orchestra.run.smithi163.stdout: "osdop_create": 0, 2023-07-14T18:29:26.865 INFO:teuthology.orchestra.run.smithi163.stdout: "osdop_read": 1149, 2023-07-14T18:29:26.865 INFO:teuthology.orchestra.run.smithi163.stdout: "osdop_write": 0, 2023-07-14T18:29:26.865 INFO:teuthology.orchestra.run.smithi163.stdout: "osdop_writefull": 0, 2023-07-14T18:29:26.865 INFO:teuthology.orchestra.run.smithi163.stdout: "osdop_writesame": 0, 2023-07-14T18:29:26.865 INFO:teuthology.orchestra.run.smithi163.stdout: "osdop_append": 0, 2023-07-14T18:29:26.866 INFO:teuthology.orchestra.run.smithi163.stdout: "osdop_zero": 0, 2023-07-14T18:29:26.866 INFO:teuthology.orchestra.run.smithi163.stdout: "osdop_truncate": 0, 2023-07-14T18:29:26.866 INFO:teuthology.orchestra.run.smithi163.stdout: "osdop_delete": 0, 2023-07-14T18:29:26.866 INFO:teuthology.orchestra.run.smithi163.stdout: "osdop_mapext": 0, 2023-07-14T18:29:26.866 INFO:teuthology.orchestra.run.smithi163.stdout: "osdop_sparse_read": 0, 2023-07-14T18:29:26.867 INFO:teuthology.orchestra.run.smithi163.stdout: "osdop_clonerange": 0, 2023-07-14T18:29:26.867 INFO:teuthology.orchestra.run.smithi163.stdout: "osdop_getxattr": 1, 2023-07-14T18:29:26.867 INFO:teuthology.orchestra.run.smithi163.stdout: "osdop_setxattr": 0, 2023-07-14T18:29:26.867 INFO:teuthology.orchestra.run.smithi163.stdout: "osdop_cmpxattr": 0, 2023-07-14T18:29:26.867 INFO:teuthology.orchestra.run.smithi163.stdout: "osdop_rmxattr": 0, 2023-07-14T18:29:26.868 INFO:teuthology.orchestra.run.smithi163.stdout: "osdop_resetxattrs": 0, 2023-07-14T18:29:26.868 INFO:teuthology.orchestra.run.smithi163.stdout: "osdop_call": 0, 2023-07-14T18:29:26.868 INFO:teuthology.orchestra.run.smithi163.stdout: "osdop_watch": 0, 2023-07-14T18:29:26.868 INFO:teuthology.orchestra.run.smithi163.stdout: "osdop_notify": 0, 2023-07-14T18:29:26.868 INFO:teuthology.orchestra.run.smithi163.stdout: "osdop_src_cmpxattr": 0, 2023-07-14T18:29:26.869 INFO:teuthology.orchestra.run.smithi163.stdout: "osdop_pgls": 0, 2023-07-14T18:29:26.869 INFO:teuthology.orchestra.run.smithi163.stdout: "osdop_pgls_filter": 0, 2023-07-14T18:29:26.869 INFO:teuthology.orchestra.run.smithi163.stdout: "osdop_other": 0, 2023-07-14T18:29:26.869 INFO:teuthology.orchestra.run.smithi163.stdout: "linger_active": 0, 2023-07-14T18:29:26.869 INFO:teuthology.orchestra.run.smithi163.stdout: "linger_send": 0, 2023-07-14T18:29:26.869 INFO:teuthology.orchestra.run.smithi163.stdout: "linger_resend": 0, 2023-07-14T18:29:26.870 INFO:teuthology.orchestra.run.smithi163.stdout: "linger_ping": 0, 2023-07-14T18:29:26.870 INFO:teuthology.orchestra.run.smithi163.stdout: "poolop_active": 0, 2023-07-14T18:29:26.870 INFO:teuthology.orchestra.run.smithi163.stdout: "poolop_send": 0, 2023-07-14T18:29:26.870 INFO:teuthology.orchestra.run.smithi163.stdout: "poolop_resend": 0, 2023-07-14T18:29:26.870 INFO:teuthology.orchestra.run.smithi163.stdout: "poolstat_active": 0, 2023-07-14T18:29:26.871 INFO:teuthology.orchestra.run.smithi163.stdout: "poolstat_send": 0, 2023-07-14T18:29:26.871 INFO:teuthology.orchestra.run.smithi163.stdout: "poolstat_resend": 0, 2023-07-14T18:29:26.871 INFO:teuthology.orchestra.run.smithi163.stdout: "statfs_active": 0, 2023-07-14T18:29:26.871 INFO:teuthology.orchestra.run.smithi163.stdout: "statfs_send": 0, 2023-07-14T18:29:26.871 INFO:teuthology.orchestra.run.smithi163.stdout: "statfs_resend": 0, 2023-07-14T18:29:26.872 INFO:teuthology.orchestra.run.smithi163.stdout: "command_active": 0, 2023-07-14T18:29:26.872 INFO:teuthology.orchestra.run.smithi163.stdout: "command_send": 0, 2023-07-14T18:29:26.872 INFO:teuthology.orchestra.run.smithi163.stdout: "command_resend": 0, 2023-07-14T18:29:26.872 INFO:teuthology.orchestra.run.smithi163.stdout: "map_epoch": 88, 2023-07-14T18:29:26.872 INFO:teuthology.orchestra.run.smithi163.stdout: "map_full": 0, 2023-07-14T18:29:26.872 INFO:teuthology.orchestra.run.smithi163.stdout: "map_inc": 4, 2023-07-14T18:29:26.873 INFO:teuthology.orchestra.run.smithi163.stdout: "osd_sessions": 6, 2023-07-14T18:29:26.873 INFO:teuthology.orchestra.run.smithi163.stdout: "osd_session_open": 8, 2023-07-14T18:29:26.873 INFO:teuthology.orchestra.run.smithi163.stdout: "osd_session_close": 2, 2023-07-14T18:29:26.873 INFO:teuthology.orchestra.run.smithi163.stdout: "osd_laggy": 0, 2023-07-14T18:29:26.873 INFO:teuthology.orchestra.run.smithi163.stdout: "omap_wr": 0, 2023-07-14T18:29:26.874 INFO:teuthology.orchestra.run.smithi163.stdout: "omap_rd": 2, 2023-07-14T18:29:26.874 INFO:teuthology.orchestra.run.smithi163.stdout: "omap_del": 0 2023-07-14T18:29:26.874 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:26.874 INFO:teuthology.orchestra.run.smithi163.stdout: "oft": { 2023-07-14T18:29:26.874 INFO:teuthology.orchestra.run.smithi163.stdout: "omap_total_objs": 0, 2023-07-14T18:29:26.875 INFO:teuthology.orchestra.run.smithi163.stdout: "omap_total_kv_pairs": 0, 2023-07-14T18:29:26.875 INFO:teuthology.orchestra.run.smithi163.stdout: "omap_total_updates": 0, 2023-07-14T18:29:26.875 INFO:teuthology.orchestra.run.smithi163.stdout: "omap_total_removes": 0 2023-07-14T18:29:26.875 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:26.875 INFO:teuthology.orchestra.run.smithi163.stdout: "osd-slow-ops": { 2023-07-14T18:29:26.875 INFO:teuthology.orchestra.run.smithi163.stdout: "slow_ops_count": 0 2023-07-14T18:29:26.876 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:26.876 INFO:teuthology.orchestra.run.smithi163.stdout: "purge_queue": { 2023-07-14T18:29:26.876 INFO:teuthology.orchestra.run.smithi163.stdout: "pq_executing_ops": 0, 2023-07-14T18:29:26.876 INFO:teuthology.orchestra.run.smithi163.stdout: "pq_executing_ops_high_water": 0, 2023-07-14T18:29:26.876 INFO:teuthology.orchestra.run.smithi163.stdout: "pq_executing": 0, 2023-07-14T18:29:26.877 INFO:teuthology.orchestra.run.smithi163.stdout: "pq_executing_high_water": 0, 2023-07-14T18:29:26.877 INFO:teuthology.orchestra.run.smithi163.stdout: "pq_executed": 0, 2023-07-14T18:29:26.877 INFO:teuthology.orchestra.run.smithi163.stdout: "pq_item_in_journal": 0 2023-07-14T18:29:26.877 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:26.877 INFO:teuthology.orchestra.run.smithi163.stdout: "throttle-msgr_dispatch_throttler-mds": { 2023-07-14T18:29:26.878 INFO:teuthology.orchestra.run.smithi163.stdout: "val": 0, 2023-07-14T18:29:26.878 INFO:teuthology.orchestra.run.smithi163.stdout: "max": 104857600, 2023-07-14T18:29:26.878 INFO:teuthology.orchestra.run.smithi163.stdout: "get_started": 0, 2023-07-14T18:29:26.878 INFO:teuthology.orchestra.run.smithi163.stdout: "get": 3549, 2023-07-14T18:29:26.878 INFO:teuthology.orchestra.run.smithi163.stdout: "get_sum": 16474829, 2023-07-14T18:29:26.879 INFO:teuthology.orchestra.run.smithi163.stdout: "get_or_fail_fail": 0, 2023-07-14T18:29:26.879 INFO:teuthology.orchestra.run.smithi163.stdout: "get_or_fail_success": 3549, 2023-07-14T18:29:26.879 INFO:teuthology.orchestra.run.smithi163.stdout: "take": 0, 2023-07-14T18:29:26.879 INFO:teuthology.orchestra.run.smithi163.stdout: "take_sum": 0, 2023-07-14T18:29:26.879 INFO:teuthology.orchestra.run.smithi163.stdout: "put": 3549, 2023-07-14T18:29:26.880 INFO:teuthology.orchestra.run.smithi163.stdout: "put_sum": 16474829, 2023-07-14T18:29:26.880 INFO:teuthology.orchestra.run.smithi163.stdout: "wait": { 2023-07-14T18:29:26.880 INFO:teuthology.orchestra.run.smithi163.stdout: "avgcount": 0, 2023-07-14T18:29:26.880 INFO:teuthology.orchestra.run.smithi163.stdout: "sum": 0.000000000, 2023-07-14T18:29:26.880 INFO:teuthology.orchestra.run.smithi163.stdout: "avgtime": 0.000000000 2023-07-14T18:29:26.881 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-07-14T18:29:26.881 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:26.881 INFO:teuthology.orchestra.run.smithi163.stdout: "throttle-objecter_bytes": { 2023-07-14T18:29:26.881 INFO:teuthology.orchestra.run.smithi163.stdout: "val": 0, 2023-07-14T18:29:26.881 INFO:teuthology.orchestra.run.smithi163.stdout: "max": 104857600, 2023-07-14T18:29:26.882 INFO:teuthology.orchestra.run.smithi163.stdout: "get_started": 0, 2023-07-14T18:29:26.882 INFO:teuthology.orchestra.run.smithi163.stdout: "get": 0, 2023-07-14T18:29:26.882 INFO:teuthology.orchestra.run.smithi163.stdout: "get_sum": 0, 2023-07-14T18:29:26.882 INFO:teuthology.orchestra.run.smithi163.stdout: "get_or_fail_fail": 0, 2023-07-14T18:29:26.882 INFO:teuthology.orchestra.run.smithi163.stdout: "get_or_fail_success": 0, 2023-07-14T18:29:26.882 INFO:teuthology.orchestra.run.smithi163.stdout: "take": 3229, 2023-07-14T18:29:26.883 INFO:teuthology.orchestra.run.smithi163.stdout: "take_sum": 15321495, 2023-07-14T18:29:26.883 INFO:teuthology.orchestra.run.smithi163.stdout: "put": 3229, 2023-07-14T18:29:26.883 INFO:teuthology.orchestra.run.smithi163.stdout: "put_sum": 15321495, 2023-07-14T18:29:26.883 INFO:teuthology.orchestra.run.smithi163.stdout: "wait": { 2023-07-14T18:29:26.883 INFO:teuthology.orchestra.run.smithi163.stdout: "avgcount": 0, 2023-07-14T18:29:26.884 INFO:teuthology.orchestra.run.smithi163.stdout: "sum": 0.000000000, 2023-07-14T18:29:26.884 INFO:teuthology.orchestra.run.smithi163.stdout: "avgtime": 0.000000000 2023-07-14T18:29:26.884 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-07-14T18:29:26.884 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:26.884 INFO:teuthology.orchestra.run.smithi163.stdout: "throttle-objecter_ops": { 2023-07-14T18:29:26.885 INFO:teuthology.orchestra.run.smithi163.stdout: "val": 0, 2023-07-14T18:29:26.885 INFO:teuthology.orchestra.run.smithi163.stdout: "max": 1024, 2023-07-14T18:29:26.885 INFO:teuthology.orchestra.run.smithi163.stdout: "get_started": 0, 2023-07-14T18:29:26.885 INFO:teuthology.orchestra.run.smithi163.stdout: "get": 0, 2023-07-14T18:29:26.885 INFO:teuthology.orchestra.run.smithi163.stdout: "get_sum": 0, 2023-07-14T18:29:26.886 INFO:teuthology.orchestra.run.smithi163.stdout: "get_or_fail_fail": 0, 2023-07-14T18:29:26.886 INFO:teuthology.orchestra.run.smithi163.stdout: "get_or_fail_success": 0, 2023-07-14T18:29:26.886 INFO:teuthology.orchestra.run.smithi163.stdout: "take": 3229, 2023-07-14T18:29:26.886 INFO:teuthology.orchestra.run.smithi163.stdout: "take_sum": 3229, 2023-07-14T18:29:26.886 INFO:teuthology.orchestra.run.smithi163.stdout: "put": 3229, 2023-07-14T18:29:26.886 INFO:teuthology.orchestra.run.smithi163.stdout: "put_sum": 3229, 2023-07-14T18:29:26.887 INFO:teuthology.orchestra.run.smithi163.stdout: "wait": { 2023-07-14T18:29:26.887 INFO:teuthology.orchestra.run.smithi163.stdout: "avgcount": 0, 2023-07-14T18:29:26.887 INFO:teuthology.orchestra.run.smithi163.stdout: "sum": 0.000000000, 2023-07-14T18:29:26.887 INFO:teuthology.orchestra.run.smithi163.stdout: "avgtime": 0.000000000 2023-07-14T18:29:26.887 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-07-14T18:29:26.888 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:26.888 INFO:teuthology.orchestra.run.smithi163.stdout: "throttle-write_buf_throttle": { 2023-07-14T18:29:26.888 INFO:teuthology.orchestra.run.smithi163.stdout: "val": 0, 2023-07-14T18:29:26.888 INFO:teuthology.orchestra.run.smithi163.stdout: "max": 3758096384, 2023-07-14T18:29:26.888 INFO:teuthology.orchestra.run.smithi163.stdout: "get_started": 0, 2023-07-14T18:29:26.889 INFO:teuthology.orchestra.run.smithi163.stdout: "get": 0, 2023-07-14T18:29:26.889 INFO:teuthology.orchestra.run.smithi163.stdout: "get_sum": 0, 2023-07-14T18:29:26.889 INFO:teuthology.orchestra.run.smithi163.stdout: "get_or_fail_fail": 0, 2023-07-14T18:29:26.889 INFO:teuthology.orchestra.run.smithi163.stdout: "get_or_fail_success": 0, 2023-07-14T18:29:26.889 INFO:teuthology.orchestra.run.smithi163.stdout: "take": 0, 2023-07-14T18:29:26.890 INFO:teuthology.orchestra.run.smithi163.stdout: "take_sum": 0, 2023-07-14T18:29:26.890 INFO:teuthology.orchestra.run.smithi163.stdout: "put": 0, 2023-07-14T18:29:26.890 INFO:teuthology.orchestra.run.smithi163.stdout: "put_sum": 0, 2023-07-14T18:29:26.890 INFO:teuthology.orchestra.run.smithi163.stdout: "wait": { 2023-07-14T18:29:26.890 INFO:teuthology.orchestra.run.smithi163.stdout: "avgcount": 0, 2023-07-14T18:29:26.890 INFO:teuthology.orchestra.run.smithi163.stdout: "sum": 0.000000000, 2023-07-14T18:29:26.891 INFO:teuthology.orchestra.run.smithi163.stdout: "avgtime": 0.000000000 2023-07-14T18:29:26.891 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-07-14T18:29:26.891 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:26.891 INFO:teuthology.orchestra.run.smithi163.stdout: "throttle-write_buf_throttle-0x55c5b2996460": { 2023-07-14T18:29:26.891 INFO:teuthology.orchestra.run.smithi163.stdout: "val": 0, 2023-07-14T18:29:26.892 INFO:teuthology.orchestra.run.smithi163.stdout: "max": 3758096384, 2023-07-14T18:29:26.892 INFO:teuthology.orchestra.run.smithi163.stdout: "get_started": 0, 2023-07-14T18:29:26.892 INFO:teuthology.orchestra.run.smithi163.stdout: "get": 0, 2023-07-14T18:29:26.892 INFO:teuthology.orchestra.run.smithi163.stdout: "get_sum": 0, 2023-07-14T18:29:26.892 INFO:teuthology.orchestra.run.smithi163.stdout: "get_or_fail_fail": 0, 2023-07-14T18:29:26.893 INFO:teuthology.orchestra.run.smithi163.stdout: "get_or_fail_success": 0, 2023-07-14T18:29:26.893 INFO:teuthology.orchestra.run.smithi163.stdout: "take": 0, 2023-07-14T18:29:26.893 INFO:teuthology.orchestra.run.smithi163.stdout: "take_sum": 0, 2023-07-14T18:29:26.893 INFO:teuthology.orchestra.run.smithi163.stdout: "put": 0, 2023-07-14T18:29:26.893 INFO:teuthology.orchestra.run.smithi163.stdout: "put_sum": 0, 2023-07-14T18:29:26.893 INFO:teuthology.orchestra.run.smithi163.stdout: "wait": { 2023-07-14T18:29:26.894 INFO:teuthology.orchestra.run.smithi163.stdout: "avgcount": 0, 2023-07-14T18:29:26.894 INFO:teuthology.orchestra.run.smithi163.stdout: "sum": 0.000000000, 2023-07-14T18:29:26.894 INFO:teuthology.orchestra.run.smithi163.stdout: "avgtime": 0.000000000 2023-07-14T18:29:26.894 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-07-14T18:29:26.894 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-07-14T18:29:26.895 INFO:teuthology.orchestra.run.smithi163.stdout:} 2023-07-14T18:29:27.149 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:29:26 smithi163 ceph-mon[96576]: pgmap v803: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-07-14T18:29:27.167 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:29:26 smithi184 ceph-mon[98481]: pgmap v803: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-07-14T18:29:27.182 INFO:tasks.check_counter:Daemon mds.g mds.exported=0 2023-07-14T18:29:27.183 INFO:tasks.check_counter:Daemon mds.g mds.imported=0 2023-07-14T18:29:27.183 INFO:tasks.check_counter:Daemon mds.g mds_cache.dir_update=0 2023-07-14T18:29:27.183 INFO:tasks.check_counter:Daemon mds.g mds_cache.dir_update_receipt=0 2023-07-14T18:29:27.184 INFO:tasks.check_counter:Daemon mds.g mds.dir_split=0 2023-07-14T18:29:27.184 DEBUG:tasks.check_counter:Getting stats from j 2023-07-14T18:29:27.184 DEBUG:teuthology.orchestra.run.smithi163:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81c9387d2e7576da065747ec9c16d1c7d69016ec shell --fsid bf7326ec-2270-11ee-9b33-001a4aab830c -- ceph daemon mds.j perf dump 2023-07-14T18:29:27.267 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:29:26 smithi172 ceph-mon[97983]: pgmap v803: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-07-14T18:29:27.682 INFO:teuthology.orchestra.run.smithi163.stderr:Inferring config /var/lib/ceph/bf7326ec-2270-11ee-9b33-001a4aab830c/mon.a/config 2023-07-14T18:29:28.959 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:29:28 smithi163 ceph-mon[96576]: pgmap v804: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-07-14T18:29:29.012 INFO:teuthology.orchestra.run.smithi163.stdout:{ 2023-07-14T18:29:29.013 INFO:teuthology.orchestra.run.smithi163.stdout: "AsyncMessenger::Worker-0": { 2023-07-14T18:29:29.013 INFO:teuthology.orchestra.run.smithi163.stdout: "msgr_recv_messages": 0, 2023-07-14T18:29:29.013 INFO:teuthology.orchestra.run.smithi163.stdout: "msgr_send_messages": 2, 2023-07-14T18:29:29.014 INFO:teuthology.orchestra.run.smithi163.stdout: "msgr_recv_bytes": 0, 2023-07-14T18:29:29.014 INFO:teuthology.orchestra.run.smithi163.stdout: "msgr_send_bytes": 0, 2023-07-14T18:29:29.015 INFO:teuthology.orchestra.run.smithi163.stdout: "msgr_created_connections": 4, 2023-07-14T18:29:29.015 INFO:teuthology.orchestra.run.smithi163.stdout: "msgr_active_connections": 0, 2023-07-14T18:29:29.015 INFO:teuthology.orchestra.run.smithi163.stdout: "msgr_running_total_time": 0.001290382, 2023-07-14T18:29:29.016 INFO:teuthology.orchestra.run.smithi163.stdout: "msgr_running_send_time": 0.000000000, 2023-07-14T18:29:29.016 INFO:teuthology.orchestra.run.smithi163.stdout: "msgr_running_recv_time": 0.000366283, 2023-07-14T18:29:29.016 INFO:teuthology.orchestra.run.smithi163.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2023-07-14T18:29:29.017 INFO:teuthology.orchestra.run.smithi163.stdout: "msgr_send_messages_queue_lat": { 2023-07-14T18:29:29.017 INFO:teuthology.orchestra.run.smithi163.stdout: "avgcount": 0, 2023-07-14T18:29:29.017 INFO:teuthology.orchestra.run.smithi163.stdout: "sum": 0.000000000, 2023-07-14T18:29:29.018 INFO:teuthology.orchestra.run.smithi163.stdout: "avgtime": 0.000000000 2023-07-14T18:29:29.018 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:29.018 INFO:teuthology.orchestra.run.smithi163.stdout: "msgr_handle_ack_lat": { 2023-07-14T18:29:29.019 INFO:teuthology.orchestra.run.smithi163.stdout: "avgcount": 0, 2023-07-14T18:29:29.019 INFO:teuthology.orchestra.run.smithi163.stdout: "sum": 0.000000000, 2023-07-14T18:29:29.020 INFO:teuthology.orchestra.run.smithi163.stdout: "avgtime": 0.000000000 2023-07-14T18:29:29.020 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:29.020 INFO:teuthology.orchestra.run.smithi163.stdout: "msgr_recv_encrypted_bytes": 0, 2023-07-14T18:29:29.021 INFO:teuthology.orchestra.run.smithi163.stdout: "msgr_send_encrypted_bytes": 0 2023-07-14T18:29:29.021 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:29.022 INFO:teuthology.orchestra.run.smithi163.stdout: "AsyncMessenger::Worker-1": { 2023-07-14T18:29:29.022 INFO:teuthology.orchestra.run.smithi163.stdout: "msgr_recv_messages": 2, 2023-07-14T18:29:29.022 INFO:teuthology.orchestra.run.smithi163.stdout: "msgr_send_messages": 229, 2023-07-14T18:29:29.023 INFO:teuthology.orchestra.run.smithi163.stdout: "msgr_recv_bytes": 320, 2023-07-14T18:29:29.023 INFO:teuthology.orchestra.run.smithi163.stdout: "msgr_send_bytes": 191952, 2023-07-14T18:29:29.023 INFO:teuthology.orchestra.run.smithi163.stdout: "msgr_created_connections": 4, 2023-07-14T18:29:29.024 INFO:teuthology.orchestra.run.smithi163.stdout: "msgr_active_connections": 2, 2023-07-14T18:29:29.024 INFO:teuthology.orchestra.run.smithi163.stdout: "msgr_running_total_time": 0.012579916, 2023-07-14T18:29:29.025 INFO:teuthology.orchestra.run.smithi163.stdout: "msgr_running_send_time": 0.009371470, 2023-07-14T18:29:29.025 INFO:teuthology.orchestra.run.smithi163.stdout: "msgr_running_recv_time": 0.001533067, 2023-07-14T18:29:29.025 INFO:teuthology.orchestra.run.smithi163.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2023-07-14T18:29:29.026 INFO:teuthology.orchestra.run.smithi163.stdout: "msgr_send_messages_queue_lat": { 2023-07-14T18:29:29.026 INFO:teuthology.orchestra.run.smithi163.stdout: "avgcount": 227, 2023-07-14T18:29:29.026 INFO:teuthology.orchestra.run.smithi163.stdout: "sum": 0.007590194, 2023-07-14T18:29:29.027 INFO:teuthology.orchestra.run.smithi163.stdout: "avgtime": 0.000033436 2023-07-14T18:29:29.027 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:29.027 INFO:teuthology.orchestra.run.smithi163.stdout: "msgr_handle_ack_lat": { 2023-07-14T18:29:29.028 INFO:teuthology.orchestra.run.smithi163.stdout: "avgcount": 0, 2023-07-14T18:29:29.028 INFO:teuthology.orchestra.run.smithi163.stdout: "sum": 0.000000000, 2023-07-14T18:29:29.029 INFO:teuthology.orchestra.run.smithi163.stdout: "avgtime": 0.000000000 2023-07-14T18:29:29.029 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:29.029 INFO:teuthology.orchestra.run.smithi163.stdout: "msgr_recv_encrypted_bytes": 320, 2023-07-14T18:29:29.030 INFO:teuthology.orchestra.run.smithi163.stdout: "msgr_send_encrypted_bytes": 191952 2023-07-14T18:29:29.030 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:29.031 INFO:teuthology.orchestra.run.smithi163.stdout: "AsyncMessenger::Worker-2": { 2023-07-14T18:29:29.031 INFO:teuthology.orchestra.run.smithi163.stdout: "msgr_recv_messages": 308, 2023-07-14T18:29:29.031 INFO:teuthology.orchestra.run.smithi163.stdout: "msgr_send_messages": 303, 2023-07-14T18:29:29.032 INFO:teuthology.orchestra.run.smithi163.stdout: "msgr_recv_bytes": 499280, 2023-07-14T18:29:29.032 INFO:teuthology.orchestra.run.smithi163.stdout: "msgr_send_bytes": 172400, 2023-07-14T18:29:29.032 INFO:teuthology.orchestra.run.smithi163.stdout: "msgr_created_connections": 2, 2023-07-14T18:29:29.033 INFO:teuthology.orchestra.run.smithi163.stdout: "msgr_active_connections": 1, 2023-07-14T18:29:29.033 INFO:teuthology.orchestra.run.smithi163.stdout: "msgr_running_total_time": 0.034686371, 2023-07-14T18:29:29.034 INFO:teuthology.orchestra.run.smithi163.stdout: "msgr_running_send_time": 0.013240110, 2023-07-14T18:29:29.034 INFO:teuthology.orchestra.run.smithi163.stdout: "msgr_running_recv_time": 0.014794956, 2023-07-14T18:29:29.034 INFO:teuthology.orchestra.run.smithi163.stdout: "msgr_running_fast_dispatch_time": 0.006244545, 2023-07-14T18:29:29.035 INFO:teuthology.orchestra.run.smithi163.stdout: "msgr_send_messages_queue_lat": { 2023-07-14T18:29:29.035 INFO:teuthology.orchestra.run.smithi163.stdout: "avgcount": 303, 2023-07-14T18:29:29.036 INFO:teuthology.orchestra.run.smithi163.stdout: "sum": 0.009036802, 2023-07-14T18:29:29.036 INFO:teuthology.orchestra.run.smithi163.stdout: "avgtime": 0.000029824 2023-07-14T18:29:29.036 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:29.037 INFO:teuthology.orchestra.run.smithi163.stdout: "msgr_handle_ack_lat": { 2023-07-14T18:29:29.037 INFO:teuthology.orchestra.run.smithi163.stdout: "avgcount": 0, 2023-07-14T18:29:29.038 INFO:teuthology.orchestra.run.smithi163.stdout: "sum": 0.000000000, 2023-07-14T18:29:29.038 INFO:teuthology.orchestra.run.smithi163.stdout: "avgtime": 0.000000000 2023-07-14T18:29:29.038 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:29.039 INFO:teuthology.orchestra.run.smithi163.stdout: "msgr_recv_encrypted_bytes": 499280, 2023-07-14T18:29:29.039 INFO:teuthology.orchestra.run.smithi163.stdout: "msgr_send_encrypted_bytes": 172400 2023-07-14T18:29:29.039 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:29.039 INFO:teuthology.orchestra.run.smithi163.stdout: "cct": { 2023-07-14T18:29:29.039 INFO:teuthology.orchestra.run.smithi163.stdout: "total_workers": 0, 2023-07-14T18:29:29.039 INFO:teuthology.orchestra.run.smithi163.stdout: "unhealthy_workers": 0 2023-07-14T18:29:29.040 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:29.040 INFO:teuthology.orchestra.run.smithi163.stdout: "mempool": { 2023-07-14T18:29:29.040 INFO:teuthology.orchestra.run.smithi163.stdout: "bloom_filter_bytes": 0, 2023-07-14T18:29:29.040 INFO:teuthology.orchestra.run.smithi163.stdout: "bloom_filter_items": 0, 2023-07-14T18:29:29.041 INFO:teuthology.orchestra.run.smithi163.stdout: "bluestore_alloc_bytes": 0, 2023-07-14T18:29:29.041 INFO:teuthology.orchestra.run.smithi163.stdout: "bluestore_alloc_items": 0, 2023-07-14T18:29:29.041 INFO:teuthology.orchestra.run.smithi163.stdout: "bluestore_cache_data_bytes": 0, 2023-07-14T18:29:29.041 INFO:teuthology.orchestra.run.smithi163.stdout: "bluestore_cache_data_items": 0, 2023-07-14T18:29:29.041 INFO:teuthology.orchestra.run.smithi163.stdout: "bluestore_cache_onode_bytes": 0, 2023-07-14T18:29:29.041 INFO:teuthology.orchestra.run.smithi163.stdout: "bluestore_cache_onode_items": 0, 2023-07-14T18:29:29.042 INFO:teuthology.orchestra.run.smithi163.stdout: "bluestore_cache_meta_bytes": 0, 2023-07-14T18:29:29.042 INFO:teuthology.orchestra.run.smithi163.stdout: "bluestore_cache_meta_items": 0, 2023-07-14T18:29:29.042 INFO:teuthology.orchestra.run.smithi163.stdout: "bluestore_cache_other_bytes": 0, 2023-07-14T18:29:29.042 INFO:teuthology.orchestra.run.smithi163.stdout: "bluestore_cache_other_items": 0, 2023-07-14T18:29:29.042 INFO:teuthology.orchestra.run.smithi163.stdout: "bluestore_cache_buffer_bytes": 0, 2023-07-14T18:29:29.043 INFO:teuthology.orchestra.run.smithi163.stdout: "bluestore_cache_buffer_items": 0, 2023-07-14T18:29:29.043 INFO:teuthology.orchestra.run.smithi163.stdout: "bluestore_extent_bytes": 0, 2023-07-14T18:29:29.043 INFO:teuthology.orchestra.run.smithi163.stdout: "bluestore_extent_items": 0, 2023-07-14T18:29:29.043 INFO:teuthology.orchestra.run.smithi163.stdout: "bluestore_blob_bytes": 0, 2023-07-14T18:29:29.043 INFO:teuthology.orchestra.run.smithi163.stdout: "bluestore_blob_items": 0, 2023-07-14T18:29:29.044 INFO:teuthology.orchestra.run.smithi163.stdout: "bluestore_shared_blob_bytes": 0, 2023-07-14T18:29:29.044 INFO:teuthology.orchestra.run.smithi163.stdout: "bluestore_shared_blob_items": 0, 2023-07-14T18:29:29.044 INFO:teuthology.orchestra.run.smithi163.stdout: "bluestore_inline_bl_bytes": 0, 2023-07-14T18:29:29.044 INFO:teuthology.orchestra.run.smithi163.stdout: "bluestore_inline_bl_items": 0, 2023-07-14T18:29:29.044 INFO:teuthology.orchestra.run.smithi163.stdout: "bluestore_fsck_bytes": 0, 2023-07-14T18:29:29.045 INFO:teuthology.orchestra.run.smithi163.stdout: "bluestore_fsck_items": 0, 2023-07-14T18:29:29.045 INFO:teuthology.orchestra.run.smithi163.stdout: "bluestore_txc_bytes": 0, 2023-07-14T18:29:29.045 INFO:teuthology.orchestra.run.smithi163.stdout: "bluestore_txc_items": 0, 2023-07-14T18:29:29.045 INFO:teuthology.orchestra.run.smithi163.stdout: "bluestore_writing_deferred_bytes": 0, 2023-07-14T18:29:29.045 INFO:teuthology.orchestra.run.smithi163.stdout: "bluestore_writing_deferred_items": 0, 2023-07-14T18:29:29.046 INFO:teuthology.orchestra.run.smithi163.stdout: "bluestore_writing_bytes": 0, 2023-07-14T18:29:29.046 INFO:teuthology.orchestra.run.smithi163.stdout: "bluestore_writing_items": 0, 2023-07-14T18:29:29.046 INFO:teuthology.orchestra.run.smithi163.stdout: "bluefs_bytes": 0, 2023-07-14T18:29:29.046 INFO:teuthology.orchestra.run.smithi163.stdout: "bluefs_items": 0, 2023-07-14T18:29:29.046 INFO:teuthology.orchestra.run.smithi163.stdout: "bluefs_file_reader_bytes": 0, 2023-07-14T18:29:29.046 INFO:teuthology.orchestra.run.smithi163.stdout: "bluefs_file_reader_items": 0, 2023-07-14T18:29:29.047 INFO:teuthology.orchestra.run.smithi163.stdout: "bluefs_file_writer_bytes": 0, 2023-07-14T18:29:29.047 INFO:teuthology.orchestra.run.smithi163.stdout: "bluefs_file_writer_items": 0, 2023-07-14T18:29:29.047 INFO:teuthology.orchestra.run.smithi163.stdout: "buffer_anon_bytes": 148704, 2023-07-14T18:29:29.047 INFO:teuthology.orchestra.run.smithi163.stdout: "buffer_anon_items": 29, 2023-07-14T18:29:29.047 INFO:teuthology.orchestra.run.smithi163.stdout: "buffer_meta_bytes": 0, 2023-07-14T18:29:29.048 INFO:teuthology.orchestra.run.smithi163.stdout: "buffer_meta_items": 0, 2023-07-14T18:29:29.048 INFO:teuthology.orchestra.run.smithi163.stdout: "osd_bytes": 0, 2023-07-14T18:29:29.048 INFO:teuthology.orchestra.run.smithi163.stdout: "osd_items": 0, 2023-07-14T18:29:29.048 INFO:teuthology.orchestra.run.smithi163.stdout: "osd_mapbl_bytes": 0, 2023-07-14T18:29:29.049 INFO:teuthology.orchestra.run.smithi163.stdout: "osd_mapbl_items": 0, 2023-07-14T18:29:29.049 INFO:teuthology.orchestra.run.smithi163.stdout: "osd_pglog_bytes": 0, 2023-07-14T18:29:29.049 INFO:teuthology.orchestra.run.smithi163.stdout: "osd_pglog_items": 0, 2023-07-14T18:29:29.049 INFO:teuthology.orchestra.run.smithi163.stdout: "osdmap_bytes": 0, 2023-07-14T18:29:29.049 INFO:teuthology.orchestra.run.smithi163.stdout: "osdmap_items": 0, 2023-07-14T18:29:29.049 INFO:teuthology.orchestra.run.smithi163.stdout: "osdmap_mapping_bytes": 0, 2023-07-14T18:29:29.050 INFO:teuthology.orchestra.run.smithi163.stdout: "osdmap_mapping_items": 0, 2023-07-14T18:29:29.050 INFO:teuthology.orchestra.run.smithi163.stdout: "pgmap_bytes": 0, 2023-07-14T18:29:29.050 INFO:teuthology.orchestra.run.smithi163.stdout: "pgmap_items": 0, 2023-07-14T18:29:29.050 INFO:teuthology.orchestra.run.smithi163.stdout: "mds_co_bytes": 928, 2023-07-14T18:29:29.051 INFO:teuthology.orchestra.run.smithi163.stdout: "mds_co_items": 2, 2023-07-14T18:29:29.051 INFO:teuthology.orchestra.run.smithi163.stdout: "unittest_1_bytes": 0, 2023-07-14T18:29:29.051 INFO:teuthology.orchestra.run.smithi163.stdout: "unittest_1_items": 0, 2023-07-14T18:29:29.051 INFO:teuthology.orchestra.run.smithi163.stdout: "unittest_2_bytes": 0, 2023-07-14T18:29:29.051 INFO:teuthology.orchestra.run.smithi163.stdout: "unittest_2_items": 0 2023-07-14T18:29:29.052 INFO:teuthology.orchestra.run.smithi163.stdout: }, 2023-07-14T18:29:29.052 INFO:teuthology.orchestra.run.smithi163.stdout: "throttle-msgr_dispatch_throttler-mds": { 2023-07-14T18:29:29.052 INFO:teuthology.orchestra.run.smithi163.stdout: "val": 0, 2023-07-14T18:29:29.052 INFO:teuthology.orchestra.run.smithi163.stdout: "max": 104857600, 2023-07-14T18:29:29.053 INFO:teuthology.orchestra.run.smithi163.stdout: "get_started": 0, 2023-07-14T18:29:29.053 INFO:teuthology.orchestra.run.smithi163.stdout: "get": 306, 2023-07-14T18:29:29.053 INFO:teuthology.orchestra.run.smithi163.stdout: "get_sum": 453341, 2023-07-14T18:29:29.053 INFO:teuthology.orchestra.run.smithi163.stdout: "get_or_fail_fail": 0, 2023-07-14T18:29:29.053 INFO:teuthology.orchestra.run.smithi163.stdout: "get_or_fail_success": 306, 2023-07-14T18:29:29.053 INFO:teuthology.orchestra.run.smithi163.stdout: "take": 0, 2023-07-14T18:29:29.054 INFO:teuthology.orchestra.run.smithi163.stdout: "take_sum": 0, 2023-07-14T18:29:29.054 INFO:teuthology.orchestra.run.smithi163.stdout: "put": 306, 2023-07-14T18:29:29.054 INFO:teuthology.orchestra.run.smithi163.stdout: "put_sum": 453341, 2023-07-14T18:29:29.055 INFO:teuthology.orchestra.run.smithi163.stdout: "wait": { 2023-07-14T18:29:29.055 INFO:teuthology.orchestra.run.smithi163.stdout: "avgcount": 0, 2023-07-14T18:29:29.055 INFO:teuthology.orchestra.run.smithi163.stdout: "sum": 0.000000000, 2023-07-14T18:29:29.055 INFO:teuthology.orchestra.run.smithi163.stdout: "avgtime": 0.000000000 2023-07-14T18:29:29.055 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-07-14T18:29:29.056 INFO:teuthology.orchestra.run.smithi163.stdout: } 2023-07-14T18:29:29.056 INFO:teuthology.orchestra.run.smithi163.stdout:} 2023-07-14T18:29:29.167 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:29:28 smithi184 ceph-mon[98481]: pgmap v804: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-07-14T18:29:29.267 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:29:28 smithi172 ceph-mon[97983]: pgmap v804: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-07-14T18:29:29.449 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.j 2023-07-14T18:29:29.450 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.j 2023-07-14T18:29:29.450 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update' not found on daemon mds.j 2023-07-14T18:29:29.450 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update_receipt' not found on daemon mds.j 2023-07-14T18:29:29.451 WARNING:tasks.check_counter:Counter 'mds.dir_split' not found on daemon mds.j 2023-07-14T18:29:29.451 DEBUG:tasks.check_counter:Getting stats from b 2023-07-14T18:29:29.451 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81c9387d2e7576da065747ec9c16d1c7d69016ec shell --fsid bf7326ec-2270-11ee-9b33-001a4aab830c -- ceph daemon mds.b perf dump 2023-07-14T18:29:30.090 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/bf7326ec-2270-11ee-9b33-001a4aab830c/mon.b/config 2023-07-14T18:29:30.978 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:29:30 smithi172 ceph-mon[97983]: pgmap v805: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-07-14T18:29:31.166 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:29:30 smithi184 ceph-mon[98481]: pgmap v805: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-07-14T18:29:31.209 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:29:30 smithi163 ceph-mon[96576]: pgmap v805: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-07-14T18:29:31.535 INFO:teuthology.orchestra.run.smithi172.stdout:{ 2023-07-14T18:29:31.535 INFO:teuthology.orchestra.run.smithi172.stdout: "AsyncMessenger::Worker-0": { 2023-07-14T18:29:31.535 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_recv_messages": 119835, 2023-07-14T18:29:31.536 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_messages": 125071, 2023-07-14T18:29:31.536 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_recv_bytes": 20949401, 2023-07-14T18:29:31.536 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_bytes": 75561935, 2023-07-14T18:29:31.536 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_created_connections": 16, 2023-07-14T18:29:31.536 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_active_connections": 2, 2023-07-14T18:29:31.537 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_total_time": 4.335973516, 2023-07-14T18:29:31.537 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_send_time": 1.726203247, 2023-07-14T18:29:31.537 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_recv_time": 2.756096071, 2023-07-14T18:29:31.537 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_fast_dispatch_time": 0.181252155, 2023-07-14T18:29:31.537 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_messages_queue_lat": { 2023-07-14T18:29:31.538 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 125071, 2023-07-14T18:29:31.538 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 3.069302291, 2023-07-14T18:29:31.538 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000024540 2023-07-14T18:29:31.538 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-07-14T18:29:31.538 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_handle_ack_lat": { 2023-07-14T18:29:31.539 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 236999, 2023-07-14T18:29:31.539 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.025542772, 2023-07-14T18:29:31.539 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000107 2023-07-14T18:29:31.539 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-07-14T18:29:31.539 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_recv_encrypted_bytes": 0, 2023-07-14T18:29:31.540 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_encrypted_bytes": 0 2023-07-14T18:29:31.540 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-07-14T18:29:31.540 INFO:teuthology.orchestra.run.smithi172.stdout: "AsyncMessenger::Worker-1": { 2023-07-14T18:29:31.540 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_recv_messages": 917199, 2023-07-14T18:29:31.540 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_messages": 927127, 2023-07-14T18:29:31.541 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_recv_bytes": 152688438, 2023-07-14T18:29:31.541 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_bytes": 238338824, 2023-07-14T18:29:31.541 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_created_connections": 8, 2023-07-14T18:29:31.541 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_active_connections": 6, 2023-07-14T18:29:31.541 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_total_time": 28.247185318, 2023-07-14T18:29:31.542 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_send_time": 11.283166926, 2023-07-14T18:29:31.542 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_recv_time": 19.314222779, 2023-07-14T18:29:31.542 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_fast_dispatch_time": 0.202033068, 2023-07-14T18:29:31.542 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_messages_queue_lat": { 2023-07-14T18:29:31.543 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 927129, 2023-07-14T18:29:31.543 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 10.738293906, 2023-07-14T18:29:31.543 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000011582 2023-07-14T18:29:31.543 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-07-14T18:29:31.544 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_handle_ack_lat": { 2023-07-14T18:29:31.544 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 1830438, 2023-07-14T18:29:31.544 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.169809472, 2023-07-14T18:29:31.544 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000092 2023-07-14T18:29:31.544 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-07-14T18:29:31.545 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_recv_encrypted_bytes": 627760, 2023-07-14T18:29:31.545 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_encrypted_bytes": 184000 2023-07-14T18:29:31.545 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-07-14T18:29:31.545 INFO:teuthology.orchestra.run.smithi172.stdout: "AsyncMessenger::Worker-2": { 2023-07-14T18:29:31.545 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_recv_messages": 944998, 2023-07-14T18:29:31.546 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_messages": 970628, 2023-07-14T18:29:31.546 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_recv_bytes": 157969285, 2023-07-14T18:29:31.546 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_bytes": 223816774, 2023-07-14T18:29:31.546 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_created_connections": 106, 2023-07-14T18:29:31.546 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_active_connections": 9, 2023-07-14T18:29:31.547 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_total_time": 29.283688085, 2023-07-14T18:29:31.547 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_send_time": 11.584911222, 2023-07-14T18:29:31.547 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_recv_time": 19.886938656, 2023-07-14T18:29:31.547 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_fast_dispatch_time": 0.220448310, 2023-07-14T18:29:31.548 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_messages_queue_lat": { 2023-07-14T18:29:31.548 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 970622, 2023-07-14T18:29:31.548 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 10.487035540, 2023-07-14T18:29:31.548 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000010804 2023-07-14T18:29:31.548 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-07-14T18:29:31.549 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_handle_ack_lat": { 2023-07-14T18:29:31.549 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 1894416, 2023-07-14T18:29:31.549 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.208261936, 2023-07-14T18:29:31.549 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000109 2023-07-14T18:29:31.549 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-07-14T18:29:31.550 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_recv_encrypted_bytes": 51232, 2023-07-14T18:29:31.550 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_encrypted_bytes": 508320 2023-07-14T18:29:31.550 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-07-14T18:29:31.550 INFO:teuthology.orchestra.run.smithi172.stdout: "cct": { 2023-07-14T18:29:31.550 INFO:teuthology.orchestra.run.smithi172.stdout: "total_workers": 1, 2023-07-14T18:29:31.551 INFO:teuthology.orchestra.run.smithi172.stdout: "unhealthy_workers": 0 2023-07-14T18:29:31.551 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-07-14T18:29:31.551 INFO:teuthology.orchestra.run.smithi172.stdout: "finisher-MDSRank": { 2023-07-14T18:29:31.551 INFO:teuthology.orchestra.run.smithi172.stdout: "queue_len": 0, 2023-07-14T18:29:31.551 INFO:teuthology.orchestra.run.smithi172.stdout: "complete_latency": { 2023-07-14T18:29:31.552 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 13691, 2023-07-14T18:29:31.552 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 13.029589745, 2023-07-14T18:29:31.552 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000951690 2023-07-14T18:29:31.552 INFO:teuthology.orchestra.run.smithi172.stdout: } 2023-07-14T18:29:31.553 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-07-14T18:29:31.553 INFO:teuthology.orchestra.run.smithi172.stdout: "finisher-PurgeQueue": { 2023-07-14T18:29:31.553 INFO:teuthology.orchestra.run.smithi172.stdout: "queue_len": 0, 2023-07-14T18:29:31.553 INFO:teuthology.orchestra.run.smithi172.stdout: "complete_latency": { 2023-07-14T18:29:31.553 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 4121, 2023-07-14T18:29:31.554 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.510218942, 2023-07-14T18:29:31.554 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000123809 2023-07-14T18:29:31.554 INFO:teuthology.orchestra.run.smithi172.stdout: } 2023-07-14T18:29:31.554 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-07-14T18:29:31.555 INFO:teuthology.orchestra.run.smithi172.stdout: "mds": { 2023-07-14T18:29:31.555 INFO:teuthology.orchestra.run.smithi172.stdout: "request": 19510, 2023-07-14T18:29:31.555 INFO:teuthology.orchestra.run.smithi172.stdout: "reply": 15002, 2023-07-14T18:29:31.555 INFO:teuthology.orchestra.run.smithi172.stdout: "reply_latency": { 2023-07-14T18:29:31.556 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 15002, 2023-07-14T18:29:31.556 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 123.337943514, 2023-07-14T18:29:31.556 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.008221433 2023-07-14T18:29:31.556 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-07-14T18:29:31.556 INFO:teuthology.orchestra.run.smithi172.stdout: "slow_reply": 0, 2023-07-14T18:29:31.557 INFO:teuthology.orchestra.run.smithi172.stdout: "forward": 4508, 2023-07-14T18:29:31.557 INFO:teuthology.orchestra.run.smithi172.stdout: "dir_fetch_complete": 0, 2023-07-14T18:29:31.557 INFO:teuthology.orchestra.run.smithi172.stdout: "dir_fetch_keys": 0, 2023-07-14T18:29:31.558 INFO:teuthology.orchestra.run.smithi172.stdout: "dir_commit": 194, 2023-07-14T18:29:31.558 INFO:teuthology.orchestra.run.smithi172.stdout: "dir_split": 22, 2023-07-14T18:29:31.558 INFO:teuthology.orchestra.run.smithi172.stdout: "dir_merge": 0, 2023-07-14T18:29:31.558 INFO:teuthology.orchestra.run.smithi172.stdout: "inodes": 582, 2023-07-14T18:29:31.558 INFO:teuthology.orchestra.run.smithi172.stdout: "inodes_top": 373, 2023-07-14T18:29:31.559 INFO:teuthology.orchestra.run.smithi172.stdout: "inodes_bottom": 182, 2023-07-14T18:29:31.559 INFO:teuthology.orchestra.run.smithi172.stdout: "inodes_pin_tail": 27, 2023-07-14T18:29:31.559 INFO:teuthology.orchestra.run.smithi172.stdout: "inodes_pinned": 49, 2023-07-14T18:29:31.559 INFO:teuthology.orchestra.run.smithi172.stdout: "inodes_expired": 3896, 2023-07-14T18:29:31.559 INFO:teuthology.orchestra.run.smithi172.stdout: "inodes_with_caps": 20, 2023-07-14T18:29:31.560 INFO:teuthology.orchestra.run.smithi172.stdout: "caps": 20, 2023-07-14T18:29:31.560 INFO:teuthology.orchestra.run.smithi172.stdout: "subtrees": 86, 2023-07-14T18:29:31.560 INFO:teuthology.orchestra.run.smithi172.stdout: "traverse": 27574, 2023-07-14T18:29:31.560 INFO:teuthology.orchestra.run.smithi172.stdout: "traverse_hit": 19429, 2023-07-14T18:29:31.561 INFO:teuthology.orchestra.run.smithi172.stdout: "traverse_forward": 4482, 2023-07-14T18:29:31.561 INFO:teuthology.orchestra.run.smithi172.stdout: "traverse_discover": 6, 2023-07-14T18:29:31.561 INFO:teuthology.orchestra.run.smithi172.stdout: "traverse_dir_fetch": 0, 2023-07-14T18:29:31.561 INFO:teuthology.orchestra.run.smithi172.stdout: "traverse_remote_ino": 0, 2023-07-14T18:29:31.561 INFO:teuthology.orchestra.run.smithi172.stdout: "traverse_lock": 11, 2023-07-14T18:29:31.561 INFO:teuthology.orchestra.run.smithi172.stdout: "load_cent": 0, 2023-07-14T18:29:31.562 INFO:teuthology.orchestra.run.smithi172.stdout: "q": 0, 2023-07-14T18:29:31.562 INFO:teuthology.orchestra.run.smithi172.stdout: "exported": 176, 2023-07-14T18:29:31.562 INFO:teuthology.orchestra.run.smithi172.stdout: "exported_inodes": 4421, 2023-07-14T18:29:31.562 INFO:teuthology.orchestra.run.smithi172.stdout: "imported": 0, 2023-07-14T18:29:31.563 INFO:teuthology.orchestra.run.smithi172.stdout: "imported_inodes": 0, 2023-07-14T18:29:31.563 INFO:teuthology.orchestra.run.smithi172.stdout: "openino_dir_fetch": 0, 2023-07-14T18:29:31.563 INFO:teuthology.orchestra.run.smithi172.stdout: "openino_backtrace_fetch": 2085, 2023-07-14T18:29:31.564 INFO:teuthology.orchestra.run.smithi172.stdout: "openino_peer_discover": 0, 2023-07-14T18:29:31.564 INFO:teuthology.orchestra.run.smithi172.stdout: "root_rfiles": 3563, 2023-07-14T18:29:31.564 INFO:teuthology.orchestra.run.smithi172.stdout: "root_rbytes": 33808819, 2023-07-14T18:29:31.564 INFO:teuthology.orchestra.run.smithi172.stdout: "root_rsnaps": 0, 2023-07-14T18:29:31.565 INFO:teuthology.orchestra.run.smithi172.stdout: "scrub_backtrace_fetch": 2085, 2023-07-14T18:29:31.565 INFO:teuthology.orchestra.run.smithi172.stdout: "scrub_set_tag": 0, 2023-07-14T18:29:31.565 INFO:teuthology.orchestra.run.smithi172.stdout: "scrub_backtrace_repaired": 0, 2023-07-14T18:29:31.565 INFO:teuthology.orchestra.run.smithi172.stdout: "scrub_inotable_repaired": 0, 2023-07-14T18:29:31.566 INFO:teuthology.orchestra.run.smithi172.stdout: "scrub_dir_inodes": 103, 2023-07-14T18:29:31.566 INFO:teuthology.orchestra.run.smithi172.stdout: "scrub_dir_base_inodes": 5, 2023-07-14T18:29:31.566 INFO:teuthology.orchestra.run.smithi172.stdout: "scrub_dirfrag_rstats": 98, 2023-07-14T18:29:31.566 INFO:teuthology.orchestra.run.smithi172.stdout: "scrub_file_inodes": 1982, 2023-07-14T18:29:31.566 INFO:teuthology.orchestra.run.smithi172.stdout: "handle_inode_file_caps": 0, 2023-07-14T18:29:31.567 INFO:teuthology.orchestra.run.smithi172.stdout: "ceph_cap_op_revoke": 3720, 2023-07-14T18:29:31.567 INFO:teuthology.orchestra.run.smithi172.stdout: "ceph_cap_op_grant": 8406, 2023-07-14T18:29:31.567 INFO:teuthology.orchestra.run.smithi172.stdout: "ceph_cap_op_trunc": 551, 2023-07-14T18:29:31.568 INFO:teuthology.orchestra.run.smithi172.stdout: "ceph_cap_op_flushsnap_ack": 0, 2023-07-14T18:29:31.568 INFO:teuthology.orchestra.run.smithi172.stdout: "ceph_cap_op_flush_ack": 0, 2023-07-14T18:29:31.569 INFO:teuthology.orchestra.run.smithi172.stdout: "handle_client_caps": 8890, 2023-07-14T18:29:31.569 INFO:teuthology.orchestra.run.smithi172.stdout: "handle_client_caps_dirty": 5770, 2023-07-14T18:29:31.570 INFO:teuthology.orchestra.run.smithi172.stdout: "handle_client_cap_release": 74, 2023-07-14T18:29:31.570 INFO:teuthology.orchestra.run.smithi172.stdout: "process_request_cap_release": 10775 2023-07-14T18:29:31.570 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-07-14T18:29:31.571 INFO:teuthology.orchestra.run.smithi172.stdout: "mds_cache": { 2023-07-14T18:29:31.571 INFO:teuthology.orchestra.run.smithi172.stdout: "dir_update": 366, 2023-07-14T18:29:31.572 INFO:teuthology.orchestra.run.smithi172.stdout: "dir_update_receipt": 12, 2023-07-14T18:29:31.572 INFO:teuthology.orchestra.run.smithi172.stdout: "dir_try_discover": 8, 2023-07-14T18:29:31.573 INFO:teuthology.orchestra.run.smithi172.stdout: "dir_send_discover": 10, 2023-07-14T18:29:31.573 INFO:teuthology.orchestra.run.smithi172.stdout: "dir_handle_discover": 987, 2023-07-14T18:29:31.573 INFO:teuthology.orchestra.run.smithi172.stdout: "num_strays": 2, 2023-07-14T18:29:31.574 INFO:teuthology.orchestra.run.smithi172.stdout: "num_strays_delayed": 0, 2023-07-14T18:29:31.574 INFO:teuthology.orchestra.run.smithi172.stdout: "num_strays_enqueuing": 0, 2023-07-14T18:29:31.575 INFO:teuthology.orchestra.run.smithi172.stdout: "strays_created": 2177, 2023-07-14T18:29:31.575 INFO:teuthology.orchestra.run.smithi172.stdout: "strays_enqueued": 2173, 2023-07-14T18:29:31.576 INFO:teuthology.orchestra.run.smithi172.stdout: "strays_reintegrated": 8, 2023-07-14T18:29:31.576 INFO:teuthology.orchestra.run.smithi172.stdout: "strays_migrated": 0, 2023-07-14T18:29:31.576 INFO:teuthology.orchestra.run.smithi172.stdout: "num_recovering_processing": 0, 2023-07-14T18:29:31.577 INFO:teuthology.orchestra.run.smithi172.stdout: "num_recovering_enqueued": 0, 2023-07-14T18:29:31.577 INFO:teuthology.orchestra.run.smithi172.stdout: "num_recovering_prioritized": 0, 2023-07-14T18:29:31.577 INFO:teuthology.orchestra.run.smithi172.stdout: "recovery_started": 0, 2023-07-14T18:29:31.578 INFO:teuthology.orchestra.run.smithi172.stdout: "recovery_completed": 0, 2023-07-14T18:29:31.578 INFO:teuthology.orchestra.run.smithi172.stdout: "ireq_enqueue_scrub": 5, 2023-07-14T18:29:31.579 INFO:teuthology.orchestra.run.smithi172.stdout: "ireq_exportdir": 200, 2023-07-14T18:29:31.579 INFO:teuthology.orchestra.run.smithi172.stdout: "ireq_flush": 0, 2023-07-14T18:29:31.579 INFO:teuthology.orchestra.run.smithi172.stdout: "ireq_fragmentdir": 22, 2023-07-14T18:29:31.579 INFO:teuthology.orchestra.run.smithi172.stdout: "ireq_fragstats": 0, 2023-07-14T18:29:31.580 INFO:teuthology.orchestra.run.smithi172.stdout: "ireq_inodestats": 0 2023-07-14T18:29:31.580 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-07-14T18:29:31.580 INFO:teuthology.orchestra.run.smithi172.stdout: "mds_log": { 2023-07-14T18:29:31.580 INFO:teuthology.orchestra.run.smithi172.stdout: "evadd": 20043, 2023-07-14T18:29:31.580 INFO:teuthology.orchestra.run.smithi172.stdout: "evex": 0, 2023-07-14T18:29:31.581 INFO:teuthology.orchestra.run.smithi172.stdout: "evtrm": 0, 2023-07-14T18:29:31.581 INFO:teuthology.orchestra.run.smithi172.stdout: "ev": 20043, 2023-07-14T18:29:31.581 INFO:teuthology.orchestra.run.smithi172.stdout: "evexg": 0, 2023-07-14T18:29:31.581 INFO:teuthology.orchestra.run.smithi172.stdout: "evexd": 0, 2023-07-14T18:29:31.581 INFO:teuthology.orchestra.run.smithi172.stdout: "segadd": 26, 2023-07-14T18:29:31.582 INFO:teuthology.orchestra.run.smithi172.stdout: "segex": 0, 2023-07-14T18:29:31.582 INFO:teuthology.orchestra.run.smithi172.stdout: "segtrm": 0, 2023-07-14T18:29:31.582 INFO:teuthology.orchestra.run.smithi172.stdout: "seg": 26, 2023-07-14T18:29:31.583 INFO:teuthology.orchestra.run.smithi172.stdout: "segexg": 0, 2023-07-14T18:29:31.583 INFO:teuthology.orchestra.run.smithi172.stdout: "segexd": 0, 2023-07-14T18:29:31.583 INFO:teuthology.orchestra.run.smithi172.stdout: "expos": 4194304, 2023-07-14T18:29:31.583 INFO:teuthology.orchestra.run.smithi172.stdout: "wrpos": 52422653, 2023-07-14T18:29:31.583 INFO:teuthology.orchestra.run.smithi172.stdout: "rdpos": 0, 2023-07-14T18:29:31.584 INFO:teuthology.orchestra.run.smithi172.stdout: "jlat": { 2023-07-14T18:29:31.584 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 5622, 2023-07-14T18:29:31.584 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 14.055715717, 2023-07-14T18:29:31.584 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.002500127 2023-07-14T18:29:31.585 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-07-14T18:29:31.585 INFO:teuthology.orchestra.run.smithi172.stdout: "replayed": 0 2023-07-14T18:29:31.585 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-07-14T18:29:31.585 INFO:teuthology.orchestra.run.smithi172.stdout: "mds_mem": { 2023-07-14T18:29:31.585 INFO:teuthology.orchestra.run.smithi172.stdout: "ino": 579, 2023-07-14T18:29:31.586 INFO:teuthology.orchestra.run.smithi172.stdout: "ino+": 5640, 2023-07-14T18:29:31.586 INFO:teuthology.orchestra.run.smithi172.stdout: "ino-": 5061, 2023-07-14T18:29:31.586 INFO:teuthology.orchestra.run.smithi172.stdout: "dir": 186, 2023-07-14T18:29:31.586 INFO:teuthology.orchestra.run.smithi172.stdout: "dir+": 274, 2023-07-14T18:29:31.586 INFO:teuthology.orchestra.run.smithi172.stdout: "dir-": 88, 2023-07-14T18:29:31.587 INFO:teuthology.orchestra.run.smithi172.stdout: "dn": 582, 2023-07-14T18:29:31.587 INFO:teuthology.orchestra.run.smithi172.stdout: "dn+": 6841, 2023-07-14T18:29:31.587 INFO:teuthology.orchestra.run.smithi172.stdout: "dn-": 6259, 2023-07-14T18:29:31.587 INFO:teuthology.orchestra.run.smithi172.stdout: "cap": 20, 2023-07-14T18:29:31.587 INFO:teuthology.orchestra.run.smithi172.stdout: "cap+": 5632, 2023-07-14T18:29:31.588 INFO:teuthology.orchestra.run.smithi172.stdout: "cap-": 5612, 2023-07-14T18:29:31.588 INFO:teuthology.orchestra.run.smithi172.stdout: "rss": 84592, 2023-07-14T18:29:31.588 INFO:teuthology.orchestra.run.smithi172.stdout: "heap": 207152 2023-07-14T18:29:31.588 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-07-14T18:29:31.588 INFO:teuthology.orchestra.run.smithi172.stdout: "mds_server": { 2023-07-14T18:29:31.589 INFO:teuthology.orchestra.run.smithi172.stdout: "dispatch_client_request": 25811, 2023-07-14T18:29:31.589 INFO:teuthology.orchestra.run.smithi172.stdout: "dispatch_server_request": 2042, 2023-07-14T18:29:31.589 INFO:teuthology.orchestra.run.smithi172.stdout: "handle_client_request": 19510, 2023-07-14T18:29:31.590 INFO:teuthology.orchestra.run.smithi172.stdout: "handle_client_session": 202, 2023-07-14T18:29:31.590 INFO:teuthology.orchestra.run.smithi172.stdout: "handle_peer_request": 4056, 2023-07-14T18:29:31.590 INFO:teuthology.orchestra.run.smithi172.stdout: "req_create_latency": { 2023-07-14T18:29:31.590 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 5531, 2023-07-14T18:29:31.590 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 17.597112363, 2023-07-14T18:29:31.591 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.003181542 2023-07-14T18:29:31.591 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-07-14T18:29:31.591 INFO:teuthology.orchestra.run.smithi172.stdout: "req_getattr_latency": { 2023-07-14T18:29:31.591 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 1138, 2023-07-14T18:29:31.591 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.708985467, 2023-07-14T18:29:31.591 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000623010 2023-07-14T18:29:31.592 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-07-14T18:29:31.592 INFO:teuthology.orchestra.run.smithi172.stdout: "req_getfilelock_latency": { 2023-07-14T18:29:31.592 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2023-07-14T18:29:31.592 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2023-07-14T18:29:31.593 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2023-07-14T18:29:31.593 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-07-14T18:29:31.593 INFO:teuthology.orchestra.run.smithi172.stdout: "req_link_latency": { 2023-07-14T18:29:31.593 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 2, 2023-07-14T18:29:31.593 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.004078458, 2023-07-14T18:29:31.593 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.002039229 2023-07-14T18:29:31.594 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-07-14T18:29:31.594 INFO:teuthology.orchestra.run.smithi172.stdout: "req_lookup_latency": { 2023-07-14T18:29:31.594 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 5194, 2023-07-14T18:29:31.594 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 23.837290449, 2023-07-14T18:29:31.594 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.004589389 2023-07-14T18:29:31.595 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-07-14T18:29:31.595 INFO:teuthology.orchestra.run.smithi172.stdout: "req_lookuphash_latency": { 2023-07-14T18:29:31.595 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2023-07-14T18:29:31.595 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2023-07-14T18:29:31.596 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2023-07-14T18:29:31.596 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-07-14T18:29:31.597 INFO:teuthology.orchestra.run.smithi172.stdout: "req_lookupino_latency": { 2023-07-14T18:29:31.597 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2023-07-14T18:29:31.597 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2023-07-14T18:29:31.598 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2023-07-14T18:29:31.598 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-07-14T18:29:31.599 INFO:teuthology.orchestra.run.smithi172.stdout: "req_lookupname_latency": { 2023-07-14T18:29:31.599 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2023-07-14T18:29:31.599 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2023-07-14T18:29:31.600 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2023-07-14T18:29:31.600 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-07-14T18:29:31.601 INFO:teuthology.orchestra.run.smithi172.stdout: "req_lookupparent_latency": { 2023-07-14T18:29:31.601 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2023-07-14T18:29:31.602 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2023-07-14T18:29:31.602 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2023-07-14T18:29:31.602 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-07-14T18:29:31.602 INFO:teuthology.orchestra.run.smithi172.stdout: "req_lookupsnap_latency": { 2023-07-14T18:29:31.602 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2023-07-14T18:29:31.603 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2023-07-14T18:29:31.603 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2023-07-14T18:29:31.603 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-07-14T18:29:31.603 INFO:teuthology.orchestra.run.smithi172.stdout: "req_lssnap_latency": { 2023-07-14T18:29:31.603 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2023-07-14T18:29:31.604 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2023-07-14T18:29:31.604 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2023-07-14T18:29:31.604 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-07-14T18:29:31.604 INFO:teuthology.orchestra.run.smithi172.stdout: "req_mkdir_latency": { 2023-07-14T18:29:31.605 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 82, 2023-07-14T18:29:31.605 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.084857246, 2023-07-14T18:29:31.605 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.001034844 2023-07-14T18:29:31.605 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-07-14T18:29:31.605 INFO:teuthology.orchestra.run.smithi172.stdout: "req_mknod_latency": { 2023-07-14T18:29:31.606 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2023-07-14T18:29:31.606 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2023-07-14T18:29:31.606 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2023-07-14T18:29:31.606 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-07-14T18:29:31.607 INFO:teuthology.orchestra.run.smithi172.stdout: "req_mksnap_latency": { 2023-07-14T18:29:31.607 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2023-07-14T18:29:31.607 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2023-07-14T18:29:31.607 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2023-07-14T18:29:31.607 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-07-14T18:29:31.608 INFO:teuthology.orchestra.run.smithi172.stdout: "req_open_latency": { 2023-07-14T18:29:31.608 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 112, 2023-07-14T18:29:31.608 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.073583485, 2023-07-14T18:29:31.608 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000656995 2023-07-14T18:29:31.608 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-07-14T18:29:31.609 INFO:teuthology.orchestra.run.smithi172.stdout: "req_readdir_latency": { 2023-07-14T18:29:31.609 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 73, 2023-07-14T18:29:31.609 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.479551423, 2023-07-14T18:29:31.609 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.006569197 2023-07-14T18:29:31.610 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-07-14T18:29:31.610 INFO:teuthology.orchestra.run.smithi172.stdout: "req_rename_latency": { 2023-07-14T18:29:31.611 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 69, 2023-07-14T18:29:31.611 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 72.462222194, 2023-07-14T18:29:31.612 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 1.050177133 2023-07-14T18:29:31.612 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-07-14T18:29:31.613 INFO:teuthology.orchestra.run.smithi172.stdout: "req_renamesnap_latency": { 2023-07-14T18:29:31.613 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2023-07-14T18:29:31.613 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2023-07-14T18:29:31.614 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2023-07-14T18:29:31.614 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-07-14T18:29:31.614 INFO:teuthology.orchestra.run.smithi172.stdout: "req_snapdiff_latency": { 2023-07-14T18:29:31.615 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2023-07-14T18:29:31.615 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2023-07-14T18:29:31.616 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2023-07-14T18:29:31.616 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-07-14T18:29:31.616 INFO:teuthology.orchestra.run.smithi172.stdout: "req_rmdir_latency": { 2023-07-14T18:29:31.617 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 22, 2023-07-14T18:29:31.617 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.740936070, 2023-07-14T18:29:31.617 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.033678912 2023-07-14T18:29:31.618 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-07-14T18:29:31.618 INFO:teuthology.orchestra.run.smithi172.stdout: "req_rmsnap_latency": { 2023-07-14T18:29:31.618 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2023-07-14T18:29:31.618 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2023-07-14T18:29:31.618 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2023-07-14T18:29:31.619 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-07-14T18:29:31.619 INFO:teuthology.orchestra.run.smithi172.stdout: "req_rmxattr_latency": { 2023-07-14T18:29:31.619 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2023-07-14T18:29:31.619 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2023-07-14T18:29:31.620 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2023-07-14T18:29:31.620 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-07-14T18:29:31.620 INFO:teuthology.orchestra.run.smithi172.stdout: "req_setattr_latency": { 2023-07-14T18:29:31.620 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 639, 2023-07-14T18:29:31.620 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 2.675970611, 2023-07-14T18:29:31.621 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.004187747 2023-07-14T18:29:31.621 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-07-14T18:29:31.621 INFO:teuthology.orchestra.run.smithi172.stdout: "req_setdirlayout_latency": { 2023-07-14T18:29:31.621 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2023-07-14T18:29:31.621 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2023-07-14T18:29:31.622 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2023-07-14T18:29:31.622 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-07-14T18:29:31.622 INFO:teuthology.orchestra.run.smithi172.stdout: "req_setfilelock_latency": { 2023-07-14T18:29:31.622 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 8, 2023-07-14T18:29:31.622 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.004548054, 2023-07-14T18:29:31.623 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000568506 2023-07-14T18:29:31.623 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-07-14T18:29:31.623 INFO:teuthology.orchestra.run.smithi172.stdout: "req_setlayout_latency": { 2023-07-14T18:29:31.623 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2023-07-14T18:29:31.624 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2023-07-14T18:29:31.624 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2023-07-14T18:29:31.624 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-07-14T18:29:31.624 INFO:teuthology.orchestra.run.smithi172.stdout: "req_setxattr_latency": { 2023-07-14T18:29:31.624 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 7, 2023-07-14T18:29:31.625 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.022029339, 2023-07-14T18:29:31.625 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.003147048 2023-07-14T18:29:31.625 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-07-14T18:29:31.625 INFO:teuthology.orchestra.run.smithi172.stdout: "req_symlink_latency": { 2023-07-14T18:29:31.625 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 5, 2023-07-14T18:29:31.626 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.003914120, 2023-07-14T18:29:31.626 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000782824 2023-07-14T18:29:31.626 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-07-14T18:29:31.626 INFO:teuthology.orchestra.run.smithi172.stdout: "req_unlink_latency": { 2023-07-14T18:29:31.626 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 2120, 2023-07-14T18:29:31.627 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 4.642864235, 2023-07-14T18:29:31.627 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.002190030 2023-07-14T18:29:31.627 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-07-14T18:29:31.627 INFO:teuthology.orchestra.run.smithi172.stdout: "cap_revoke_eviction": 0, 2023-07-14T18:29:31.627 INFO:teuthology.orchestra.run.smithi172.stdout: "cap_acquisition_throttle": 0, 2023-07-14T18:29:31.628 INFO:teuthology.orchestra.run.smithi172.stdout: "req_getvxattr_latency": { 2023-07-14T18:29:31.628 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2023-07-14T18:29:31.628 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2023-07-14T18:29:31.628 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2023-07-14T18:29:31.628 INFO:teuthology.orchestra.run.smithi172.stdout: } 2023-07-14T18:29:31.629 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-07-14T18:29:31.629 INFO:teuthology.orchestra.run.smithi172.stdout: "mds_sessions": { 2023-07-14T18:29:31.629 INFO:teuthology.orchestra.run.smithi172.stdout: "session_count": 1, 2023-07-14T18:29:31.629 INFO:teuthology.orchestra.run.smithi172.stdout: "session_add": 3, 2023-07-14T18:29:31.629 INFO:teuthology.orchestra.run.smithi172.stdout: "session_remove": 2, 2023-07-14T18:29:31.629 INFO:teuthology.orchestra.run.smithi172.stdout: "sessions_open": 1, 2023-07-14T18:29:31.630 INFO:teuthology.orchestra.run.smithi172.stdout: "sessions_stale": 0, 2023-07-14T18:29:31.630 INFO:teuthology.orchestra.run.smithi172.stdout: "total_load": 3258, 2023-07-14T18:29:31.630 INFO:teuthology.orchestra.run.smithi172.stdout: "average_load": 3258, 2023-07-14T18:29:31.630 INFO:teuthology.orchestra.run.smithi172.stdout: "avg_session_uptime": 1001 2023-07-14T18:29:31.630 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-07-14T18:29:31.631 INFO:teuthology.orchestra.run.smithi172.stdout: "mempool": { 2023-07-14T18:29:31.631 INFO:teuthology.orchestra.run.smithi172.stdout: "bloom_filter_bytes": 0, 2023-07-14T18:29:31.631 INFO:teuthology.orchestra.run.smithi172.stdout: "bloom_filter_items": 0, 2023-07-14T18:29:31.631 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_alloc_bytes": 0, 2023-07-14T18:29:31.631 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_alloc_items": 0, 2023-07-14T18:29:31.632 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_cache_data_bytes": 0, 2023-07-14T18:29:31.632 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_cache_data_items": 0, 2023-07-14T18:29:31.632 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_cache_onode_bytes": 0, 2023-07-14T18:29:31.632 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_cache_onode_items": 0, 2023-07-14T18:29:31.632 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_cache_meta_bytes": 0, 2023-07-14T18:29:31.633 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_cache_meta_items": 0, 2023-07-14T18:29:31.633 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_cache_other_bytes": 0, 2023-07-14T18:29:31.633 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_cache_other_items": 0, 2023-07-14T18:29:31.633 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_cache_buffer_bytes": 0, 2023-07-14T18:29:31.634 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_cache_buffer_items": 0, 2023-07-14T18:29:31.634 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_extent_bytes": 0, 2023-07-14T18:29:31.634 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_extent_items": 0, 2023-07-14T18:29:31.635 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_blob_bytes": 0, 2023-07-14T18:29:31.635 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_blob_items": 0, 2023-07-14T18:29:31.635 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_shared_blob_bytes": 0, 2023-07-14T18:29:31.636 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_shared_blob_items": 0, 2023-07-14T18:29:31.636 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_inline_bl_bytes": 0, 2023-07-14T18:29:31.636 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_inline_bl_items": 0, 2023-07-14T18:29:31.637 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_fsck_bytes": 0, 2023-07-14T18:29:31.637 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_fsck_items": 0, 2023-07-14T18:29:31.637 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_txc_bytes": 0, 2023-07-14T18:29:31.638 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_txc_items": 0, 2023-07-14T18:29:31.638 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_writing_deferred_bytes": 0, 2023-07-14T18:29:31.638 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_writing_deferred_items": 0, 2023-07-14T18:29:31.638 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_writing_bytes": 0, 2023-07-14T18:29:31.639 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_writing_items": 0, 2023-07-14T18:29:31.639 INFO:teuthology.orchestra.run.smithi172.stdout: "bluefs_bytes": 0, 2023-07-14T18:29:31.639 INFO:teuthology.orchestra.run.smithi172.stdout: "bluefs_items": 0, 2023-07-14T18:29:31.640 INFO:teuthology.orchestra.run.smithi172.stdout: "bluefs_file_reader_bytes": 0, 2023-07-14T18:29:31.640 INFO:teuthology.orchestra.run.smithi172.stdout: "bluefs_file_reader_items": 0, 2023-07-14T18:29:31.640 INFO:teuthology.orchestra.run.smithi172.stdout: "bluefs_file_writer_bytes": 0, 2023-07-14T18:29:31.640 INFO:teuthology.orchestra.run.smithi172.stdout: "bluefs_file_writer_items": 0, 2023-07-14T18:29:31.640 INFO:teuthology.orchestra.run.smithi172.stdout: "buffer_anon_bytes": 306819, 2023-07-14T18:29:31.641 INFO:teuthology.orchestra.run.smithi172.stdout: "buffer_anon_items": 118, 2023-07-14T18:29:31.641 INFO:teuthology.orchestra.run.smithi172.stdout: "buffer_meta_bytes": 0, 2023-07-14T18:29:31.641 INFO:teuthology.orchestra.run.smithi172.stdout: "buffer_meta_items": 0, 2023-07-14T18:29:31.641 INFO:teuthology.orchestra.run.smithi172.stdout: "osd_bytes": 0, 2023-07-14T18:29:31.641 INFO:teuthology.orchestra.run.smithi172.stdout: "osd_items": 0, 2023-07-14T18:29:31.642 INFO:teuthology.orchestra.run.smithi172.stdout: "osd_mapbl_bytes": 0, 2023-07-14T18:29:31.642 INFO:teuthology.orchestra.run.smithi172.stdout: "osd_mapbl_items": 0, 2023-07-14T18:29:31.642 INFO:teuthology.orchestra.run.smithi172.stdout: "osd_pglog_bytes": 0, 2023-07-14T18:29:31.642 INFO:teuthology.orchestra.run.smithi172.stdout: "osd_pglog_items": 0, 2023-07-14T18:29:31.642 INFO:teuthology.orchestra.run.smithi172.stdout: "osdmap_bytes": 8792, 2023-07-14T18:29:31.643 INFO:teuthology.orchestra.run.smithi172.stdout: "osdmap_items": 168, 2023-07-14T18:29:31.643 INFO:teuthology.orchestra.run.smithi172.stdout: "osdmap_mapping_bytes": 0, 2023-07-14T18:29:31.643 INFO:teuthology.orchestra.run.smithi172.stdout: "osdmap_mapping_items": 0, 2023-07-14T18:29:31.643 INFO:teuthology.orchestra.run.smithi172.stdout: "pgmap_bytes": 0, 2023-07-14T18:29:31.643 INFO:teuthology.orchestra.run.smithi172.stdout: "pgmap_items": 0, 2023-07-14T18:29:31.644 INFO:teuthology.orchestra.run.smithi172.stdout: "mds_co_bytes": 1964298, 2023-07-14T18:29:31.644 INFO:teuthology.orchestra.run.smithi172.stdout: "mds_co_items": 18273, 2023-07-14T18:29:31.644 INFO:teuthology.orchestra.run.smithi172.stdout: "unittest_1_bytes": 0, 2023-07-14T18:29:31.644 INFO:teuthology.orchestra.run.smithi172.stdout: "unittest_1_items": 0, 2023-07-14T18:29:31.644 INFO:teuthology.orchestra.run.smithi172.stdout: "unittest_2_bytes": 0, 2023-07-14T18:29:31.645 INFO:teuthology.orchestra.run.smithi172.stdout: "unittest_2_items": 0 2023-07-14T18:29:31.645 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-07-14T18:29:31.645 INFO:teuthology.orchestra.run.smithi172.stdout: "objecter": { 2023-07-14T18:29:31.645 INFO:teuthology.orchestra.run.smithi172.stdout: "op_active": 0, 2023-07-14T18:29:31.645 INFO:teuthology.orchestra.run.smithi172.stdout: "op_laggy": 0, 2023-07-14T18:29:31.646 INFO:teuthology.orchestra.run.smithi172.stdout: "op_send": 13784, 2023-07-14T18:29:31.646 INFO:teuthology.orchestra.run.smithi172.stdout: "op_send_bytes": 50937100, 2023-07-14T18:29:31.646 INFO:teuthology.orchestra.run.smithi172.stdout: "op_resend": 37, 2023-07-14T18:29:31.646 INFO:teuthology.orchestra.run.smithi172.stdout: "op_reply": 13784, 2023-07-14T18:29:31.646 INFO:teuthology.orchestra.run.smithi172.stdout: "op_latency": { 2023-07-14T18:29:31.646 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 13784, 2023-07-14T18:29:31.647 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 45.964945927, 2023-07-14T18:29:31.647 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.003334659 2023-07-14T18:29:31.647 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-07-14T18:29:31.647 INFO:teuthology.orchestra.run.smithi172.stdout: "op_inflight": 0, 2023-07-14T18:29:31.647 INFO:teuthology.orchestra.run.smithi172.stdout: "oplen_avg": { 2023-07-14T18:29:31.648 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 13784, 2023-07-14T18:29:31.648 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 14071 2023-07-14T18:29:31.648 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-07-14T18:29:31.648 INFO:teuthology.orchestra.run.smithi172.stdout: "op": 13784, 2023-07-14T18:29:31.648 INFO:teuthology.orchestra.run.smithi172.stdout: "op_r": 2239, 2023-07-14T18:29:31.649 INFO:teuthology.orchestra.run.smithi172.stdout: "op_w": 11545, 2023-07-14T18:29:31.649 INFO:teuthology.orchestra.run.smithi172.stdout: "op_rmw": 0, 2023-07-14T18:29:31.649 INFO:teuthology.orchestra.run.smithi172.stdout: "op_pg": 0, 2023-07-14T18:29:31.649 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_stat": 0, 2023-07-14T18:29:31.649 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_create": 11, 2023-07-14T18:29:31.650 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_read": 149, 2023-07-14T18:29:31.650 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_write": 5766, 2023-07-14T18:29:31.650 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_writefull": 98, 2023-07-14T18:29:31.650 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_writesame": 0, 2023-07-14T18:29:31.650 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_append": 0, 2023-07-14T18:29:31.650 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_zero": 0, 2023-07-14T18:29:31.651 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_truncate": 6, 2023-07-14T18:29:31.651 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_delete": 4872, 2023-07-14T18:29:31.651 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_mapext": 0, 2023-07-14T18:29:31.651 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_sparse_read": 0, 2023-07-14T18:29:31.651 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_clonerange": 0, 2023-07-14T18:29:31.652 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_getxattr": 2090, 2023-07-14T18:29:31.652 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_setxattr": 22, 2023-07-14T18:29:31.652 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_cmpxattr": 0, 2023-07-14T18:29:31.652 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_rmxattr": 0, 2023-07-14T18:29:31.652 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_resetxattrs": 0, 2023-07-14T18:29:31.653 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_call": 0, 2023-07-14T18:29:31.653 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_watch": 0, 2023-07-14T18:29:31.653 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_notify": 0, 2023-07-14T18:29:31.653 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_src_cmpxattr": 0, 2023-07-14T18:29:31.653 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_pgls": 0, 2023-07-14T18:29:31.654 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_pgls_filter": 0, 2023-07-14T18:29:31.654 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_other": 552, 2023-07-14T18:29:31.654 INFO:teuthology.orchestra.run.smithi172.stdout: "linger_active": 0, 2023-07-14T18:29:31.654 INFO:teuthology.orchestra.run.smithi172.stdout: "linger_send": 0, 2023-07-14T18:29:31.654 INFO:teuthology.orchestra.run.smithi172.stdout: "linger_resend": 0, 2023-07-14T18:29:31.654 INFO:teuthology.orchestra.run.smithi172.stdout: "linger_ping": 0, 2023-07-14T18:29:31.655 INFO:teuthology.orchestra.run.smithi172.stdout: "poolop_active": 0, 2023-07-14T18:29:31.655 INFO:teuthology.orchestra.run.smithi172.stdout: "poolop_send": 0, 2023-07-14T18:29:31.655 INFO:teuthology.orchestra.run.smithi172.stdout: "poolop_resend": 0, 2023-07-14T18:29:31.655 INFO:teuthology.orchestra.run.smithi172.stdout: "poolstat_active": 0, 2023-07-14T18:29:31.655 INFO:teuthology.orchestra.run.smithi172.stdout: "poolstat_send": 0, 2023-07-14T18:29:31.656 INFO:teuthology.orchestra.run.smithi172.stdout: "poolstat_resend": 0, 2023-07-14T18:29:31.656 INFO:teuthology.orchestra.run.smithi172.stdout: "statfs_active": 0, 2023-07-14T18:29:31.656 INFO:teuthology.orchestra.run.smithi172.stdout: "statfs_send": 0, 2023-07-14T18:29:31.656 INFO:teuthology.orchestra.run.smithi172.stdout: "statfs_resend": 0, 2023-07-14T18:29:31.656 INFO:teuthology.orchestra.run.smithi172.stdout: "command_active": 0, 2023-07-14T18:29:31.657 INFO:teuthology.orchestra.run.smithi172.stdout: "command_send": 0, 2023-07-14T18:29:31.657 INFO:teuthology.orchestra.run.smithi172.stdout: "command_resend": 0, 2023-07-14T18:29:31.657 INFO:teuthology.orchestra.run.smithi172.stdout: "map_epoch": 88, 2023-07-14T18:29:31.657 INFO:teuthology.orchestra.run.smithi172.stdout: "map_full": 0, 2023-07-14T18:29:31.657 INFO:teuthology.orchestra.run.smithi172.stdout: "map_inc": 9, 2023-07-14T18:29:31.657 INFO:teuthology.orchestra.run.smithi172.stdout: "osd_sessions": 12, 2023-07-14T18:29:31.658 INFO:teuthology.orchestra.run.smithi172.stdout: "osd_session_open": 12, 2023-07-14T18:29:31.658 INFO:teuthology.orchestra.run.smithi172.stdout: "osd_session_close": 0, 2023-07-14T18:29:31.658 INFO:teuthology.orchestra.run.smithi172.stdout: "osd_laggy": 0, 2023-07-14T18:29:31.658 INFO:teuthology.orchestra.run.smithi172.stdout: "omap_wr": 460, 2023-07-14T18:29:31.658 INFO:teuthology.orchestra.run.smithi172.stdout: "omap_rd": 0, 2023-07-14T18:29:31.659 INFO:teuthology.orchestra.run.smithi172.stdout: "omap_del": 45 2023-07-14T18:29:31.659 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-07-14T18:29:31.659 INFO:teuthology.orchestra.run.smithi172.stdout: "oft": { 2023-07-14T18:29:31.659 INFO:teuthology.orchestra.run.smithi172.stdout: "omap_total_objs": 1, 2023-07-14T18:29:31.659 INFO:teuthology.orchestra.run.smithi172.stdout: "omap_total_kv_pairs": 0, 2023-07-14T18:29:31.660 INFO:teuthology.orchestra.run.smithi172.stdout: "omap_total_updates": 0, 2023-07-14T18:29:31.660 INFO:teuthology.orchestra.run.smithi172.stdout: "omap_total_removes": 0 2023-07-14T18:29:31.660 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-07-14T18:29:31.660 INFO:teuthology.orchestra.run.smithi172.stdout: "osd-slow-ops": { 2023-07-14T18:29:31.660 INFO:teuthology.orchestra.run.smithi172.stdout: "slow_ops_count": 0 2023-07-14T18:29:31.660 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-07-14T18:29:31.661 INFO:teuthology.orchestra.run.smithi172.stdout: "purge_queue": { 2023-07-14T18:29:31.661 INFO:teuthology.orchestra.run.smithi172.stdout: "pq_executing_ops": 0, 2023-07-14T18:29:31.661 INFO:teuthology.orchestra.run.smithi172.stdout: "pq_executing_ops_high_water": 10, 2023-07-14T18:29:31.661 INFO:teuthology.orchestra.run.smithi172.stdout: "pq_executing": 0, 2023-07-14T18:29:31.661 INFO:teuthology.orchestra.run.smithi172.stdout: "pq_executing_high_water": 6, 2023-07-14T18:29:31.662 INFO:teuthology.orchestra.run.smithi172.stdout: "pq_executed": 2173, 2023-07-14T18:29:31.662 INFO:teuthology.orchestra.run.smithi172.stdout: "pq_item_in_journal": 0 2023-07-14T18:29:31.662 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-07-14T18:29:31.662 INFO:teuthology.orchestra.run.smithi172.stdout: "throttle-msgr_dispatch_throttler-mds": { 2023-07-14T18:29:31.662 INFO:teuthology.orchestra.run.smithi172.stdout: "val": 0, 2023-07-14T18:29:31.663 INFO:teuthology.orchestra.run.smithi172.stdout: "max": 104857600, 2023-07-14T18:29:31.663 INFO:teuthology.orchestra.run.smithi172.stdout: "get_started": 0, 2023-07-14T18:29:31.663 INFO:teuthology.orchestra.run.smithi172.stdout: "get": 1982028, 2023-07-14T18:29:31.663 INFO:teuthology.orchestra.run.smithi172.stdout: "get_sum": 153196751, 2023-07-14T18:29:31.663 INFO:teuthology.orchestra.run.smithi172.stdout: "get_or_fail_fail": 0, 2023-07-14T18:29:31.664 INFO:teuthology.orchestra.run.smithi172.stdout: "get_or_fail_success": 1982028, 2023-07-14T18:29:31.664 INFO:teuthology.orchestra.run.smithi172.stdout: "take": 0, 2023-07-14T18:29:31.664 INFO:teuthology.orchestra.run.smithi172.stdout: "take_sum": 0, 2023-07-14T18:29:31.664 INFO:teuthology.orchestra.run.smithi172.stdout: "put": 1982028, 2023-07-14T18:29:31.664 INFO:teuthology.orchestra.run.smithi172.stdout: "put_sum": 153196751, 2023-07-14T18:29:31.665 INFO:teuthology.orchestra.run.smithi172.stdout: "wait": { 2023-07-14T18:29:31.665 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2023-07-14T18:29:31.665 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2023-07-14T18:29:31.665 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2023-07-14T18:29:31.665 INFO:teuthology.orchestra.run.smithi172.stdout: } 2023-07-14T18:29:31.665 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-07-14T18:29:31.666 INFO:teuthology.orchestra.run.smithi172.stdout: "throttle-objecter_bytes": { 2023-07-14T18:29:31.666 INFO:teuthology.orchestra.run.smithi172.stdout: "val": 0, 2023-07-14T18:29:31.666 INFO:teuthology.orchestra.run.smithi172.stdout: "max": 104857600, 2023-07-14T18:29:31.666 INFO:teuthology.orchestra.run.smithi172.stdout: "get_started": 0, 2023-07-14T18:29:31.666 INFO:teuthology.orchestra.run.smithi172.stdout: "get": 0, 2023-07-14T18:29:31.667 INFO:teuthology.orchestra.run.smithi172.stdout: "get_sum": 0, 2023-07-14T18:29:31.667 INFO:teuthology.orchestra.run.smithi172.stdout: "get_or_fail_fail": 0, 2023-07-14T18:29:31.667 INFO:teuthology.orchestra.run.smithi172.stdout: "get_or_fail_success": 0, 2023-07-14T18:29:31.667 INFO:teuthology.orchestra.run.smithi172.stdout: "take": 13784, 2023-07-14T18:29:31.667 INFO:teuthology.orchestra.run.smithi172.stdout: "take_sum": 51173853, 2023-07-14T18:29:31.668 INFO:teuthology.orchestra.run.smithi172.stdout: "put": 13784, 2023-07-14T18:29:31.668 INFO:teuthology.orchestra.run.smithi172.stdout: "put_sum": 51173853, 2023-07-14T18:29:31.668 INFO:teuthology.orchestra.run.smithi172.stdout: "wait": { 2023-07-14T18:29:31.668 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2023-07-14T18:29:31.668 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2023-07-14T18:29:31.669 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2023-07-14T18:29:31.669 INFO:teuthology.orchestra.run.smithi172.stdout: } 2023-07-14T18:29:31.669 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-07-14T18:29:31.669 INFO:teuthology.orchestra.run.smithi172.stdout: "throttle-objecter_ops": { 2023-07-14T18:29:31.669 INFO:teuthology.orchestra.run.smithi172.stdout: "val": 0, 2023-07-14T18:29:31.669 INFO:teuthology.orchestra.run.smithi172.stdout: "max": 1024, 2023-07-14T18:29:31.670 INFO:teuthology.orchestra.run.smithi172.stdout: "get_started": 0, 2023-07-14T18:29:31.670 INFO:teuthology.orchestra.run.smithi172.stdout: "get": 0, 2023-07-14T18:29:31.670 INFO:teuthology.orchestra.run.smithi172.stdout: "get_sum": 0, 2023-07-14T18:29:31.670 INFO:teuthology.orchestra.run.smithi172.stdout: "get_or_fail_fail": 0, 2023-07-14T18:29:31.670 INFO:teuthology.orchestra.run.smithi172.stdout: "get_or_fail_success": 0, 2023-07-14T18:29:31.671 INFO:teuthology.orchestra.run.smithi172.stdout: "take": 13784, 2023-07-14T18:29:31.671 INFO:teuthology.orchestra.run.smithi172.stdout: "take_sum": 13784, 2023-07-14T18:29:31.671 INFO:teuthology.orchestra.run.smithi172.stdout: "put": 13784, 2023-07-14T18:29:31.671 INFO:teuthology.orchestra.run.smithi172.stdout: "put_sum": 13784, 2023-07-14T18:29:31.671 INFO:teuthology.orchestra.run.smithi172.stdout: "wait": { 2023-07-14T18:29:31.672 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2023-07-14T18:29:31.672 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2023-07-14T18:29:31.672 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2023-07-14T18:29:31.672 INFO:teuthology.orchestra.run.smithi172.stdout: } 2023-07-14T18:29:31.672 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-07-14T18:29:31.673 INFO:teuthology.orchestra.run.smithi172.stdout: "throttle-write_buf_throttle": { 2023-07-14T18:29:31.673 INFO:teuthology.orchestra.run.smithi172.stdout: "val": 0, 2023-07-14T18:29:31.673 INFO:teuthology.orchestra.run.smithi172.stdout: "max": 3758096384, 2023-07-14T18:29:31.673 INFO:teuthology.orchestra.run.smithi172.stdout: "get_started": 0, 2023-07-14T18:29:31.673 INFO:teuthology.orchestra.run.smithi172.stdout: "get": 2173, 2023-07-14T18:29:31.673 INFO:teuthology.orchestra.run.smithi172.stdout: "get_sum": 236753, 2023-07-14T18:29:31.674 INFO:teuthology.orchestra.run.smithi172.stdout: "get_or_fail_fail": 0, 2023-07-14T18:29:31.674 INFO:teuthology.orchestra.run.smithi172.stdout: "get_or_fail_success": 2173, 2023-07-14T18:29:31.674 INFO:teuthology.orchestra.run.smithi172.stdout: "take": 0, 2023-07-14T18:29:31.674 INFO:teuthology.orchestra.run.smithi172.stdout: "take_sum": 0, 2023-07-14T18:29:31.674 INFO:teuthology.orchestra.run.smithi172.stdout: "put": 144, 2023-07-14T18:29:31.675 INFO:teuthology.orchestra.run.smithi172.stdout: "put_sum": 236753, 2023-07-14T18:29:31.675 INFO:teuthology.orchestra.run.smithi172.stdout: "wait": { 2023-07-14T18:29:31.675 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2023-07-14T18:29:31.675 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2023-07-14T18:29:31.675 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2023-07-14T18:29:31.676 INFO:teuthology.orchestra.run.smithi172.stdout: } 2023-07-14T18:29:31.676 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-07-14T18:29:31.676 INFO:teuthology.orchestra.run.smithi172.stdout: "throttle-write_buf_throttle-0x55712cf700a0": { 2023-07-14T18:29:31.676 INFO:teuthology.orchestra.run.smithi172.stdout: "val": 0, 2023-07-14T18:29:31.676 INFO:teuthology.orchestra.run.smithi172.stdout: "max": 3758096384, 2023-07-14T18:29:31.677 INFO:teuthology.orchestra.run.smithi172.stdout: "get_started": 0, 2023-07-14T18:29:31.677 INFO:teuthology.orchestra.run.smithi172.stdout: "get": 20043, 2023-07-14T18:29:31.677 INFO:teuthology.orchestra.run.smithi172.stdout: "get_sum": 48228349, 2023-07-14T18:29:31.677 INFO:teuthology.orchestra.run.smithi172.stdout: "get_or_fail_fail": 0, 2023-07-14T18:29:31.677 INFO:teuthology.orchestra.run.smithi172.stdout: "get_or_fail_success": 20043, 2023-07-14T18:29:31.677 INFO:teuthology.orchestra.run.smithi172.stdout: "take": 0, 2023-07-14T18:29:31.678 INFO:teuthology.orchestra.run.smithi172.stdout: "take_sum": 0, 2023-07-14T18:29:31.678 INFO:teuthology.orchestra.run.smithi172.stdout: "put": 5622, 2023-07-14T18:29:31.678 INFO:teuthology.orchestra.run.smithi172.stdout: "put_sum": 48228349, 2023-07-14T18:29:31.678 INFO:teuthology.orchestra.run.smithi172.stdout: "wait": { 2023-07-14T18:29:31.678 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2023-07-14T18:29:31.679 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2023-07-14T18:29:31.679 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2023-07-14T18:29:31.679 INFO:teuthology.orchestra.run.smithi172.stdout: } 2023-07-14T18:29:31.679 INFO:teuthology.orchestra.run.smithi172.stdout: } 2023-07-14T18:29:31.679 INFO:teuthology.orchestra.run.smithi172.stdout:} 2023-07-14T18:29:31.865 INFO:tasks.check_counter:Daemon mds.b mds.exported=176 2023-07-14T18:29:31.866 INFO:tasks.check_counter:Daemon mds.b mds.imported=0 2023-07-14T18:29:31.866 INFO:tasks.check_counter:Daemon mds.b mds_cache.dir_update=366 2023-07-14T18:29:31.866 INFO:tasks.check_counter:Daemon mds.b mds_cache.dir_update_receipt=12 2023-07-14T18:29:31.867 INFO:tasks.check_counter:Daemon mds.b mds.dir_split=22 2023-07-14T18:29:31.867 DEBUG:tasks.check_counter:Getting stats from e 2023-07-14T18:29:31.867 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81c9387d2e7576da065747ec9c16d1c7d69016ec shell --fsid bf7326ec-2270-11ee-9b33-001a4aab830c -- ceph daemon mds.e perf dump 2023-07-14T18:29:32.268 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:29:32 smithi172 ceph-mon[97983]: pgmap v806: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-07-14T18:29:32.416 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:29:32 smithi184 ceph-mon[98481]: pgmap v806: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-07-14T18:29:32.459 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:29:32 smithi163 ceph-mon[96576]: pgmap v806: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-07-14T18:29:32.467 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/bf7326ec-2270-11ee-9b33-001a4aab830c/mon.b/config 2023-07-14T18:29:35.017 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:29:34 smithi172 ceph-mon[97983]: pgmap v807: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-07-14T18:29:35.166 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:29:34 smithi184 ceph-mon[98481]: pgmap v807: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-07-14T18:29:35.209 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:29:34 smithi163 ceph-mon[96576]: pgmap v807: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-07-14T18:29:37.166 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:29:36 smithi184 ceph-mon[98481]: pgmap v808: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-07-14T18:29:37.209 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:29:36 smithi163 ceph-mon[96576]: pgmap v808: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-07-14T18:29:37.267 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:29:36 smithi172 ceph-mon[97983]: pgmap v808: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-07-14T18:29:39.030 INFO:teuthology.orchestra.run.smithi172.stdout:{ 2023-07-14T18:29:39.030 INFO:teuthology.orchestra.run.smithi172.stdout: "AsyncMessenger::Worker-0": { 2023-07-14T18:29:39.031 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_recv_messages": 3257, 2023-07-14T18:29:39.031 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_messages": 3259, 2023-07-14T18:29:39.031 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_recv_bytes": 8252189, 2023-07-14T18:29:39.031 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_bytes": 1012934, 2023-07-14T18:29:39.031 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_created_connections": 6, 2023-07-14T18:29:39.032 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_active_connections": 2, 2023-07-14T18:29:39.032 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_total_time": 0.199470718, 2023-07-14T18:29:39.032 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_send_time": 0.055558804, 2023-07-14T18:29:39.032 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_recv_time": 0.049808866, 2023-07-14T18:29:39.032 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_fast_dispatch_time": 0.079860266, 2023-07-14T18:29:39.033 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_messages_queue_lat": { 2023-07-14T18:29:39.033 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 3257, 2023-07-14T18:29:39.033 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.060914576, 2023-07-14T18:29:39.033 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000018702 2023-07-14T18:29:39.033 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-07-14T18:29:39.034 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_handle_ack_lat": { 2023-07-14T18:29:39.034 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2023-07-14T18:29:39.034 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2023-07-14T18:29:39.034 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2023-07-14T18:29:39.034 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-07-14T18:29:39.034 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_recv_encrypted_bytes": 0, 2023-07-14T18:29:39.035 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_encrypted_bytes": 0 2023-07-14T18:29:39.035 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-07-14T18:29:39.035 INFO:teuthology.orchestra.run.smithi172.stdout: "AsyncMessenger::Worker-1": { 2023-07-14T18:29:39.035 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_recv_messages": 4, 2023-07-14T18:29:39.035 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_messages": 233, 2023-07-14T18:29:39.036 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_recv_bytes": 876, 2023-07-14T18:29:39.036 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_bytes": 548924, 2023-07-14T18:29:39.036 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_created_connections": 5, 2023-07-14T18:29:39.036 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_active_connections": 3, 2023-07-14T18:29:39.036 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_total_time": 0.010430641, 2023-07-14T18:29:39.037 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_send_time": 0.006908149, 2023-07-14T18:29:39.037 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_recv_time": 0.001753834, 2023-07-14T18:29:39.037 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_fast_dispatch_time": 0.000076818, 2023-07-14T18:29:39.037 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_messages_queue_lat": { 2023-07-14T18:29:39.037 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 231, 2023-07-14T18:29:39.038 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.008674838, 2023-07-14T18:29:39.038 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000037553 2023-07-14T18:29:39.038 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-07-14T18:29:39.038 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_handle_ack_lat": { 2023-07-14T18:29:39.038 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2023-07-14T18:29:39.038 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2023-07-14T18:29:39.039 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2023-07-14T18:29:39.039 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-07-14T18:29:39.039 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_recv_encrypted_bytes": 320, 2023-07-14T18:29:39.039 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_encrypted_bytes": 548240 2023-07-14T18:29:39.039 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-07-14T18:29:39.040 INFO:teuthology.orchestra.run.smithi172.stdout: "AsyncMessenger::Worker-2": { 2023-07-14T18:29:39.040 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_recv_messages": 333, 2023-07-14T18:29:39.040 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_messages": 314, 2023-07-14T18:29:39.040 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_recv_bytes": 600636, 2023-07-14T18:29:39.040 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_bytes": 174839, 2023-07-14T18:29:39.041 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_created_connections": 4, 2023-07-14T18:29:39.041 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_active_connections": 2, 2023-07-14T18:29:39.041 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_total_time": 0.037646969, 2023-07-14T18:29:39.041 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_send_time": 0.013322932, 2023-07-14T18:29:39.041 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_recv_time": 0.017436896, 2023-07-14T18:29:39.042 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_fast_dispatch_time": 0.006804630, 2023-07-14T18:29:39.042 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_messages_queue_lat": { 2023-07-14T18:29:39.042 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 314, 2023-07-14T18:29:39.042 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.013150369, 2023-07-14T18:29:39.043 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000041880 2023-07-14T18:29:39.043 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-07-14T18:29:39.043 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_handle_ack_lat": { 2023-07-14T18:29:39.043 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2023-07-14T18:29:39.043 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2023-07-14T18:29:39.043 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2023-07-14T18:29:39.044 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-07-14T18:29:39.044 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_recv_encrypted_bytes": 600368, 2023-07-14T18:29:39.044 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_encrypted_bytes": 174528 2023-07-14T18:29:39.044 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-07-14T18:29:39.044 INFO:teuthology.orchestra.run.smithi172.stdout: "cct": { 2023-07-14T18:29:39.045 INFO:teuthology.orchestra.run.smithi172.stdout: "total_workers": 1, 2023-07-14T18:29:39.045 INFO:teuthology.orchestra.run.smithi172.stdout: "unhealthy_workers": 0 2023-07-14T18:29:39.045 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-07-14T18:29:39.045 INFO:teuthology.orchestra.run.smithi172.stdout: "finisher-MDSRank": { 2023-07-14T18:29:39.045 INFO:teuthology.orchestra.run.smithi172.stdout: "queue_len": 0, 2023-07-14T18:29:39.046 INFO:teuthology.orchestra.run.smithi172.stdout: "complete_latency": { 2023-07-14T18:29:39.046 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 5494, 2023-07-14T18:29:39.046 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.125701969, 2023-07-14T18:29:39.046 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000022879 2023-07-14T18:29:39.046 INFO:teuthology.orchestra.run.smithi172.stdout: } 2023-07-14T18:29:39.047 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-07-14T18:29:39.047 INFO:teuthology.orchestra.run.smithi172.stdout: "finisher-PurgeQueue": { 2023-07-14T18:29:39.047 INFO:teuthology.orchestra.run.smithi172.stdout: "queue_len": 0, 2023-07-14T18:29:39.047 INFO:teuthology.orchestra.run.smithi172.stdout: "complete_latency": { 2023-07-14T18:29:39.047 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2023-07-14T18:29:39.047 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2023-07-14T18:29:39.048 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2023-07-14T18:29:39.048 INFO:teuthology.orchestra.run.smithi172.stdout: } 2023-07-14T18:29:39.048 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-07-14T18:29:39.048 INFO:teuthology.orchestra.run.smithi172.stdout: "mds": { 2023-07-14T18:29:39.049 INFO:teuthology.orchestra.run.smithi172.stdout: "request": 0, 2023-07-14T18:29:39.049 INFO:teuthology.orchestra.run.smithi172.stdout: "reply": 0, 2023-07-14T18:29:39.049 INFO:teuthology.orchestra.run.smithi172.stdout: "reply_latency": { 2023-07-14T18:29:39.049 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2023-07-14T18:29:39.049 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2023-07-14T18:29:39.049 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2023-07-14T18:29:39.050 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-07-14T18:29:39.050 INFO:teuthology.orchestra.run.smithi172.stdout: "slow_reply": 0, 2023-07-14T18:29:39.050 INFO:teuthology.orchestra.run.smithi172.stdout: "forward": 0, 2023-07-14T18:29:39.050 INFO:teuthology.orchestra.run.smithi172.stdout: "dir_fetch_complete": 0, 2023-07-14T18:29:39.050 INFO:teuthology.orchestra.run.smithi172.stdout: "dir_fetch_keys": 0, 2023-07-14T18:29:39.051 INFO:teuthology.orchestra.run.smithi172.stdout: "dir_commit": 0, 2023-07-14T18:29:39.051 INFO:teuthology.orchestra.run.smithi172.stdout: "dir_split": 0, 2023-07-14T18:29:39.051 INFO:teuthology.orchestra.run.smithi172.stdout: "dir_merge": 0, 2023-07-14T18:29:39.051 INFO:teuthology.orchestra.run.smithi172.stdout: "inodes": 584, 2023-07-14T18:29:39.051 INFO:teuthology.orchestra.run.smithi172.stdout: "inodes_top": 0, 2023-07-14T18:29:39.052 INFO:teuthology.orchestra.run.smithi172.stdout: "inodes_bottom": 0, 2023-07-14T18:29:39.052 INFO:teuthology.orchestra.run.smithi172.stdout: "inodes_pin_tail": 584, 2023-07-14T18:29:39.052 INFO:teuthology.orchestra.run.smithi172.stdout: "inodes_pinned": 584, 2023-07-14T18:29:39.052 INFO:teuthology.orchestra.run.smithi172.stdout: "inodes_expired": 0, 2023-07-14T18:29:39.052 INFO:teuthology.orchestra.run.smithi172.stdout: "inodes_with_caps": 0, 2023-07-14T18:29:39.053 INFO:teuthology.orchestra.run.smithi172.stdout: "caps": 0, 2023-07-14T18:29:39.053 INFO:teuthology.orchestra.run.smithi172.stdout: "subtrees": 15, 2023-07-14T18:29:39.053 INFO:teuthology.orchestra.run.smithi172.stdout: "traverse": 0, 2023-07-14T18:29:39.053 INFO:teuthology.orchestra.run.smithi172.stdout: "traverse_hit": 0, 2023-07-14T18:29:39.053 INFO:teuthology.orchestra.run.smithi172.stdout: "traverse_forward": 0, 2023-07-14T18:29:39.053 INFO:teuthology.orchestra.run.smithi172.stdout: "traverse_discover": 0, 2023-07-14T18:29:39.054 INFO:teuthology.orchestra.run.smithi172.stdout: "traverse_dir_fetch": 0, 2023-07-14T18:29:39.054 INFO:teuthology.orchestra.run.smithi172.stdout: "traverse_remote_ino": 0, 2023-07-14T18:29:39.054 INFO:teuthology.orchestra.run.smithi172.stdout: "traverse_lock": 0, 2023-07-14T18:29:39.054 INFO:teuthology.orchestra.run.smithi172.stdout: "load_cent": 0, 2023-07-14T18:29:39.054 INFO:teuthology.orchestra.run.smithi172.stdout: "q": 0, 2023-07-14T18:29:39.055 INFO:teuthology.orchestra.run.smithi172.stdout: "exported": 0, 2023-07-14T18:29:39.055 INFO:teuthology.orchestra.run.smithi172.stdout: "exported_inodes": 0, 2023-07-14T18:29:39.055 INFO:teuthology.orchestra.run.smithi172.stdout: "imported": 0, 2023-07-14T18:29:39.055 INFO:teuthology.orchestra.run.smithi172.stdout: "imported_inodes": 0, 2023-07-14T18:29:39.055 INFO:teuthology.orchestra.run.smithi172.stdout: "openino_dir_fetch": 0, 2023-07-14T18:29:39.056 INFO:teuthology.orchestra.run.smithi172.stdout: "openino_backtrace_fetch": 0, 2023-07-14T18:29:39.056 INFO:teuthology.orchestra.run.smithi172.stdout: "openino_peer_discover": 0, 2023-07-14T18:29:39.056 INFO:teuthology.orchestra.run.smithi172.stdout: "root_rfiles": 0, 2023-07-14T18:29:39.056 INFO:teuthology.orchestra.run.smithi172.stdout: "root_rbytes": 0, 2023-07-14T18:29:39.056 INFO:teuthology.orchestra.run.smithi172.stdout: "root_rsnaps": 0, 2023-07-14T18:29:39.056 INFO:teuthology.orchestra.run.smithi172.stdout: "scrub_backtrace_fetch": 0, 2023-07-14T18:29:39.057 INFO:teuthology.orchestra.run.smithi172.stdout: "scrub_set_tag": 0, 2023-07-14T18:29:39.057 INFO:teuthology.orchestra.run.smithi172.stdout: "scrub_backtrace_repaired": 0, 2023-07-14T18:29:39.057 INFO:teuthology.orchestra.run.smithi172.stdout: "scrub_inotable_repaired": 0, 2023-07-14T18:29:39.057 INFO:teuthology.orchestra.run.smithi172.stdout: "scrub_dir_inodes": 0, 2023-07-14T18:29:39.057 INFO:teuthology.orchestra.run.smithi172.stdout: "scrub_dir_base_inodes": 0, 2023-07-14T18:29:39.058 INFO:teuthology.orchestra.run.smithi172.stdout: "scrub_dirfrag_rstats": 0, 2023-07-14T18:29:39.058 INFO:teuthology.orchestra.run.smithi172.stdout: "scrub_file_inodes": 0, 2023-07-14T18:29:39.058 INFO:teuthology.orchestra.run.smithi172.stdout: "handle_inode_file_caps": 0, 2023-07-14T18:29:39.058 INFO:teuthology.orchestra.run.smithi172.stdout: "ceph_cap_op_revoke": 0, 2023-07-14T18:29:39.058 INFO:teuthology.orchestra.run.smithi172.stdout: "ceph_cap_op_grant": 0, 2023-07-14T18:29:39.059 INFO:teuthology.orchestra.run.smithi172.stdout: "ceph_cap_op_trunc": 0, 2023-07-14T18:29:39.059 INFO:teuthology.orchestra.run.smithi172.stdout: "ceph_cap_op_flushsnap_ack": 0, 2023-07-14T18:29:39.059 INFO:teuthology.orchestra.run.smithi172.stdout: "ceph_cap_op_flush_ack": 0, 2023-07-14T18:29:39.059 INFO:teuthology.orchestra.run.smithi172.stdout: "handle_client_caps": 0, 2023-07-14T18:29:39.059 INFO:teuthology.orchestra.run.smithi172.stdout: "handle_client_caps_dirty": 0, 2023-07-14T18:29:39.059 INFO:teuthology.orchestra.run.smithi172.stdout: "handle_client_cap_release": 0, 2023-07-14T18:29:39.060 INFO:teuthology.orchestra.run.smithi172.stdout: "process_request_cap_release": 0 2023-07-14T18:29:39.060 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-07-14T18:29:39.060 INFO:teuthology.orchestra.run.smithi172.stdout: "mds_cache": { 2023-07-14T18:29:39.060 INFO:teuthology.orchestra.run.smithi172.stdout: "dir_update": 0, 2023-07-14T18:29:39.061 INFO:teuthology.orchestra.run.smithi172.stdout: "dir_update_receipt": 0, 2023-07-14T18:29:39.061 INFO:teuthology.orchestra.run.smithi172.stdout: "dir_try_discover": 0, 2023-07-14T18:29:39.061 INFO:teuthology.orchestra.run.smithi172.stdout: "dir_send_discover": 0, 2023-07-14T18:29:39.061 INFO:teuthology.orchestra.run.smithi172.stdout: "dir_handle_discover": 0, 2023-07-14T18:29:39.061 INFO:teuthology.orchestra.run.smithi172.stdout: "num_strays": 0, 2023-07-14T18:29:39.062 INFO:teuthology.orchestra.run.smithi172.stdout: "num_strays_delayed": 0, 2023-07-14T18:29:39.062 INFO:teuthology.orchestra.run.smithi172.stdout: "num_strays_enqueuing": 0, 2023-07-14T18:29:39.062 INFO:teuthology.orchestra.run.smithi172.stdout: "strays_created": 0, 2023-07-14T18:29:39.062 INFO:teuthology.orchestra.run.smithi172.stdout: "strays_enqueued": 0, 2023-07-14T18:29:39.062 INFO:teuthology.orchestra.run.smithi172.stdout: "strays_reintegrated": 0, 2023-07-14T18:29:39.062 INFO:teuthology.orchestra.run.smithi172.stdout: "strays_migrated": 0, 2023-07-14T18:29:39.063 INFO:teuthology.orchestra.run.smithi172.stdout: "num_recovering_processing": 0, 2023-07-14T18:29:39.063 INFO:teuthology.orchestra.run.smithi172.stdout: "num_recovering_enqueued": 0, 2023-07-14T18:29:39.063 INFO:teuthology.orchestra.run.smithi172.stdout: "num_recovering_prioritized": 0, 2023-07-14T18:29:39.063 INFO:teuthology.orchestra.run.smithi172.stdout: "recovery_started": 0, 2023-07-14T18:29:39.063 INFO:teuthology.orchestra.run.smithi172.stdout: "recovery_completed": 0, 2023-07-14T18:29:39.064 INFO:teuthology.orchestra.run.smithi172.stdout: "ireq_enqueue_scrub": 0, 2023-07-14T18:29:39.064 INFO:teuthology.orchestra.run.smithi172.stdout: "ireq_exportdir": 0, 2023-07-14T18:29:39.064 INFO:teuthology.orchestra.run.smithi172.stdout: "ireq_flush": 0, 2023-07-14T18:29:39.064 INFO:teuthology.orchestra.run.smithi172.stdout: "ireq_fragmentdir": 0, 2023-07-14T18:29:39.064 INFO:teuthology.orchestra.run.smithi172.stdout: "ireq_fragstats": 0, 2023-07-14T18:29:39.065 INFO:teuthology.orchestra.run.smithi172.stdout: "ireq_inodestats": 0 2023-07-14T18:29:39.065 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-07-14T18:29:39.065 INFO:teuthology.orchestra.run.smithi172.stdout: "mds_log": { 2023-07-14T18:29:39.065 INFO:teuthology.orchestra.run.smithi172.stdout: "evadd": 0, 2023-07-14T18:29:39.065 INFO:teuthology.orchestra.run.smithi172.stdout: "evex": 0, 2023-07-14T18:29:39.066 INFO:teuthology.orchestra.run.smithi172.stdout: "evtrm": 0, 2023-07-14T18:29:39.066 INFO:teuthology.orchestra.run.smithi172.stdout: "ev": 0, 2023-07-14T18:29:39.066 INFO:teuthology.orchestra.run.smithi172.stdout: "evexg": 0, 2023-07-14T18:29:39.066 INFO:teuthology.orchestra.run.smithi172.stdout: "evexd": 0, 2023-07-14T18:29:39.066 INFO:teuthology.orchestra.run.smithi172.stdout: "segadd": 0, 2023-07-14T18:29:39.067 INFO:teuthology.orchestra.run.smithi172.stdout: "segex": 0, 2023-07-14T18:29:39.067 INFO:teuthology.orchestra.run.smithi172.stdout: "segtrm": 0, 2023-07-14T18:29:39.067 INFO:teuthology.orchestra.run.smithi172.stdout: "seg": 9, 2023-07-14T18:29:39.067 INFO:teuthology.orchestra.run.smithi172.stdout: "segexg": 0, 2023-07-14T18:29:39.067 INFO:teuthology.orchestra.run.smithi172.stdout: "segexd": 0, 2023-07-14T18:29:39.067 INFO:teuthology.orchestra.run.smithi172.stdout: "expos": 4194304, 2023-07-14T18:29:39.068 INFO:teuthology.orchestra.run.smithi172.stdout: "wrpos": 0, 2023-07-14T18:29:39.068 INFO:teuthology.orchestra.run.smithi172.stdout: "rdpos": 11529077, 2023-07-14T18:29:39.068 INFO:teuthology.orchestra.run.smithi172.stdout: "jlat": { 2023-07-14T18:29:39.068 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2023-07-14T18:29:39.068 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2023-07-14T18:29:39.069 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2023-07-14T18:29:39.069 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-07-14T18:29:39.069 INFO:teuthology.orchestra.run.smithi172.stdout: "replayed": 8957 2023-07-14T18:29:39.069 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-07-14T18:29:39.069 INFO:teuthology.orchestra.run.smithi172.stdout: "mds_mem": { 2023-07-14T18:29:39.070 INFO:teuthology.orchestra.run.smithi172.stdout: "ino": 346, 2023-07-14T18:29:39.070 INFO:teuthology.orchestra.run.smithi172.stdout: "ino+": 1287, 2023-07-14T18:29:39.070 INFO:teuthology.orchestra.run.smithi172.stdout: "ino-": 941, 2023-07-14T18:29:39.070 INFO:teuthology.orchestra.run.smithi172.stdout: "dir": 58, 2023-07-14T18:29:39.070 INFO:teuthology.orchestra.run.smithi172.stdout: "dir+": 221, 2023-07-14T18:29:39.071 INFO:teuthology.orchestra.run.smithi172.stdout: "dir-": 163, 2023-07-14T18:29:39.071 INFO:teuthology.orchestra.run.smithi172.stdout: "dn": 584, 2023-07-14T18:29:39.071 INFO:teuthology.orchestra.run.smithi172.stdout: "dn+": 1580, 2023-07-14T18:29:39.071 INFO:teuthology.orchestra.run.smithi172.stdout: "dn-": 996, 2023-07-14T18:29:39.071 INFO:teuthology.orchestra.run.smithi172.stdout: "cap": 0, 2023-07-14T18:29:39.071 INFO:teuthology.orchestra.run.smithi172.stdout: "cap+": 0, 2023-07-14T18:29:39.072 INFO:teuthology.orchestra.run.smithi172.stdout: "cap-": 0, 2023-07-14T18:29:39.072 INFO:teuthology.orchestra.run.smithi172.stdout: "rss": 51988, 2023-07-14T18:29:39.072 INFO:teuthology.orchestra.run.smithi172.stdout: "heap": 207152 2023-07-14T18:29:39.072 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-07-14T18:29:39.073 INFO:teuthology.orchestra.run.smithi172.stdout: "mds_server": { 2023-07-14T18:29:39.073 INFO:teuthology.orchestra.run.smithi172.stdout: "dispatch_client_request": 0, 2023-07-14T18:29:39.073 INFO:teuthology.orchestra.run.smithi172.stdout: "dispatch_server_request": 0, 2023-07-14T18:29:39.073 INFO:teuthology.orchestra.run.smithi172.stdout: "handle_client_request": 0, 2023-07-14T18:29:39.073 INFO:teuthology.orchestra.run.smithi172.stdout: "handle_client_session": 0, 2023-07-14T18:29:39.073 INFO:teuthology.orchestra.run.smithi172.stdout: "handle_peer_request": 0, 2023-07-14T18:29:39.074 INFO:teuthology.orchestra.run.smithi172.stdout: "req_create_latency": { 2023-07-14T18:29:39.074 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2023-07-14T18:29:39.074 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2023-07-14T18:29:39.074 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2023-07-14T18:29:39.074 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-07-14T18:29:39.075 INFO:teuthology.orchestra.run.smithi172.stdout: "req_getattr_latency": { 2023-07-14T18:29:39.075 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2023-07-14T18:29:39.075 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2023-07-14T18:29:39.075 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2023-07-14T18:29:39.075 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-07-14T18:29:39.076 INFO:teuthology.orchestra.run.smithi172.stdout: "req_getfilelock_latency": { 2023-07-14T18:29:39.076 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2023-07-14T18:29:39.076 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2023-07-14T18:29:39.076 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2023-07-14T18:29:39.076 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-07-14T18:29:39.077 INFO:teuthology.orchestra.run.smithi172.stdout: "req_link_latency": { 2023-07-14T18:29:39.077 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2023-07-14T18:29:39.077 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2023-07-14T18:29:39.077 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2023-07-14T18:29:39.077 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-07-14T18:29:39.078 INFO:teuthology.orchestra.run.smithi172.stdout: "req_lookup_latency": { 2023-07-14T18:29:39.078 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2023-07-14T18:29:39.078 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2023-07-14T18:29:39.078 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2023-07-14T18:29:39.078 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-07-14T18:29:39.079 INFO:teuthology.orchestra.run.smithi172.stdout: "req_lookuphash_latency": { 2023-07-14T18:29:39.079 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2023-07-14T18:29:39.079 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2023-07-14T18:29:39.079 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2023-07-14T18:29:39.079 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-07-14T18:29:39.079 INFO:teuthology.orchestra.run.smithi172.stdout: "req_lookupino_latency": { 2023-07-14T18:29:39.080 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2023-07-14T18:29:39.080 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2023-07-14T18:29:39.080 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2023-07-14T18:29:39.080 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-07-14T18:29:39.080 INFO:teuthology.orchestra.run.smithi172.stdout: "req_lookupname_latency": { 2023-07-14T18:29:39.081 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2023-07-14T18:29:39.081 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2023-07-14T18:29:39.081 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2023-07-14T18:29:39.081 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-07-14T18:29:39.081 INFO:teuthology.orchestra.run.smithi172.stdout: "req_lookupparent_latency": { 2023-07-14T18:29:39.082 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2023-07-14T18:29:39.082 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2023-07-14T18:29:39.082 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2023-07-14T18:29:39.082 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-07-14T18:29:39.082 INFO:teuthology.orchestra.run.smithi172.stdout: "req_lookupsnap_latency": { 2023-07-14T18:29:39.083 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2023-07-14T18:29:39.083 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2023-07-14T18:29:39.083 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2023-07-14T18:29:39.083 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-07-14T18:29:39.083 INFO:teuthology.orchestra.run.smithi172.stdout: "req_lssnap_latency": { 2023-07-14T18:29:39.084 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2023-07-14T18:29:39.084 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2023-07-14T18:29:39.084 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2023-07-14T18:29:39.084 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-07-14T18:29:39.084 INFO:teuthology.orchestra.run.smithi172.stdout: "req_mkdir_latency": { 2023-07-14T18:29:39.085 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2023-07-14T18:29:39.085 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2023-07-14T18:29:39.085 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2023-07-14T18:29:39.085 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-07-14T18:29:39.085 INFO:teuthology.orchestra.run.smithi172.stdout: "req_mknod_latency": { 2023-07-14T18:29:39.086 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2023-07-14T18:29:39.086 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2023-07-14T18:29:39.086 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2023-07-14T18:29:39.086 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-07-14T18:29:39.086 INFO:teuthology.orchestra.run.smithi172.stdout: "req_mksnap_latency": { 2023-07-14T18:29:39.086 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2023-07-14T18:29:39.087 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2023-07-14T18:29:39.087 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2023-07-14T18:29:39.087 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-07-14T18:29:39.087 INFO:teuthology.orchestra.run.smithi172.stdout: "req_open_latency": { 2023-07-14T18:29:39.087 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2023-07-14T18:29:39.088 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2023-07-14T18:29:39.088 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2023-07-14T18:29:39.088 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-07-14T18:29:39.088 INFO:teuthology.orchestra.run.smithi172.stdout: "req_readdir_latency": { 2023-07-14T18:29:39.089 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2023-07-14T18:29:39.089 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2023-07-14T18:29:39.089 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2023-07-14T18:29:39.089 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-07-14T18:29:39.089 INFO:teuthology.orchestra.run.smithi172.stdout: "req_rename_latency": { 2023-07-14T18:29:39.090 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2023-07-14T18:29:39.090 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2023-07-14T18:29:39.090 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2023-07-14T18:29:39.091 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-07-14T18:29:39.091 INFO:teuthology.orchestra.run.smithi172.stdout: "req_renamesnap_latency": { 2023-07-14T18:29:39.091 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2023-07-14T18:29:39.091 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2023-07-14T18:29:39.091 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2023-07-14T18:29:39.091 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-07-14T18:29:39.092 INFO:teuthology.orchestra.run.smithi172.stdout: "req_snapdiff_latency": { 2023-07-14T18:29:39.092 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2023-07-14T18:29:39.092 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2023-07-14T18:29:39.092 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2023-07-14T18:29:39.093 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-07-14T18:29:39.093 INFO:teuthology.orchestra.run.smithi172.stdout: "req_rmdir_latency": { 2023-07-14T18:29:39.093 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2023-07-14T18:29:39.093 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2023-07-14T18:29:39.093 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2023-07-14T18:29:39.093 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-07-14T18:29:39.094 INFO:teuthology.orchestra.run.smithi172.stdout: "req_rmsnap_latency": { 2023-07-14T18:29:39.094 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2023-07-14T18:29:39.094 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2023-07-14T18:29:39.094 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2023-07-14T18:29:39.094 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-07-14T18:29:39.095 INFO:teuthology.orchestra.run.smithi172.stdout: "req_rmxattr_latency": { 2023-07-14T18:29:39.095 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2023-07-14T18:29:39.095 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2023-07-14T18:29:39.095 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2023-07-14T18:29:39.095 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-07-14T18:29:39.096 INFO:teuthology.orchestra.run.smithi172.stdout: "req_setattr_latency": { 2023-07-14T18:29:39.096 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2023-07-14T18:29:39.096 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2023-07-14T18:29:39.096 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2023-07-14T18:29:39.096 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-07-14T18:29:39.097 INFO:teuthology.orchestra.run.smithi172.stdout: "req_setdirlayout_latency": { 2023-07-14T18:29:39.097 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2023-07-14T18:29:39.097 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2023-07-14T18:29:39.097 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2023-07-14T18:29:39.097 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-07-14T18:29:39.098 INFO:teuthology.orchestra.run.smithi172.stdout: "req_setfilelock_latency": { 2023-07-14T18:29:39.098 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2023-07-14T18:29:39.098 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2023-07-14T18:29:39.098 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2023-07-14T18:29:39.098 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-07-14T18:29:39.099 INFO:teuthology.orchestra.run.smithi172.stdout: "req_setlayout_latency": { 2023-07-14T18:29:39.099 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2023-07-14T18:29:39.099 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2023-07-14T18:29:39.099 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2023-07-14T18:29:39.099 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-07-14T18:29:39.100 INFO:teuthology.orchestra.run.smithi172.stdout: "req_setxattr_latency": { 2023-07-14T18:29:39.100 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2023-07-14T18:29:39.100 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2023-07-14T18:29:39.100 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2023-07-14T18:29:39.101 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-07-14T18:29:39.101 INFO:teuthology.orchestra.run.smithi172.stdout: "req_symlink_latency": { 2023-07-14T18:29:39.101 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2023-07-14T18:29:39.101 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2023-07-14T18:29:39.101 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2023-07-14T18:29:39.101 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-07-14T18:29:39.102 INFO:teuthology.orchestra.run.smithi172.stdout: "req_unlink_latency": { 2023-07-14T18:29:39.102 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2023-07-14T18:29:39.102 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2023-07-14T18:29:39.102 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2023-07-14T18:29:39.102 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-07-14T18:29:39.103 INFO:teuthology.orchestra.run.smithi172.stdout: "cap_revoke_eviction": 0, 2023-07-14T18:29:39.103 INFO:teuthology.orchestra.run.smithi172.stdout: "cap_acquisition_throttle": 0, 2023-07-14T18:29:39.103 INFO:teuthology.orchestra.run.smithi172.stdout: "req_getvxattr_latency": { 2023-07-14T18:29:39.103 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2023-07-14T18:29:39.103 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2023-07-14T18:29:39.104 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2023-07-14T18:29:39.104 INFO:teuthology.orchestra.run.smithi172.stdout: } 2023-07-14T18:29:39.104 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-07-14T18:29:39.104 INFO:teuthology.orchestra.run.smithi172.stdout: "mds_sessions": { 2023-07-14T18:29:39.104 INFO:teuthology.orchestra.run.smithi172.stdout: "session_count": 1, 2023-07-14T18:29:39.105 INFO:teuthology.orchestra.run.smithi172.stdout: "session_add": 1, 2023-07-14T18:29:39.105 INFO:teuthology.orchestra.run.smithi172.stdout: "session_remove": 0, 2023-07-14T18:29:39.105 INFO:teuthology.orchestra.run.smithi172.stdout: "sessions_open": 1, 2023-07-14T18:29:39.105 INFO:teuthology.orchestra.run.smithi172.stdout: "sessions_stale": 0, 2023-07-14T18:29:39.105 INFO:teuthology.orchestra.run.smithi172.stdout: "total_load": 0, 2023-07-14T18:29:39.106 INFO:teuthology.orchestra.run.smithi172.stdout: "average_load": 0, 2023-07-14T18:29:39.106 INFO:teuthology.orchestra.run.smithi172.stdout: "avg_session_uptime": 2629 2023-07-14T18:29:39.106 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-07-14T18:29:39.106 INFO:teuthology.orchestra.run.smithi172.stdout: "mempool": { 2023-07-14T18:29:39.106 INFO:teuthology.orchestra.run.smithi172.stdout: "bloom_filter_bytes": 0, 2023-07-14T18:29:39.106 INFO:teuthology.orchestra.run.smithi172.stdout: "bloom_filter_items": 0, 2023-07-14T18:29:39.107 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_alloc_bytes": 0, 2023-07-14T18:29:39.107 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_alloc_items": 0, 2023-07-14T18:29:39.107 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_cache_data_bytes": 0, 2023-07-14T18:29:39.107 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_cache_data_items": 0, 2023-07-14T18:29:39.108 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_cache_onode_bytes": 0, 2023-07-14T18:29:39.108 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_cache_onode_items": 0, 2023-07-14T18:29:39.108 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_cache_meta_bytes": 0, 2023-07-14T18:29:39.108 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_cache_meta_items": 0, 2023-07-14T18:29:39.108 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_cache_other_bytes": 0, 2023-07-14T18:29:39.109 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_cache_other_items": 0, 2023-07-14T18:29:39.109 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_cache_buffer_bytes": 0, 2023-07-14T18:29:39.109 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_cache_buffer_items": 0, 2023-07-14T18:29:39.109 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_extent_bytes": 0, 2023-07-14T18:29:39.109 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_extent_items": 0, 2023-07-14T18:29:39.109 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_blob_bytes": 0, 2023-07-14T18:29:39.110 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_blob_items": 0, 2023-07-14T18:29:39.110 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_shared_blob_bytes": 0, 2023-07-14T18:29:39.110 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_shared_blob_items": 0, 2023-07-14T18:29:39.111 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_inline_bl_bytes": 0, 2023-07-14T18:29:39.111 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_inline_bl_items": 0, 2023-07-14T18:29:39.111 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_fsck_bytes": 0, 2023-07-14T18:29:39.111 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_fsck_items": 0, 2023-07-14T18:29:39.111 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_txc_bytes": 0, 2023-07-14T18:29:39.112 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_txc_items": 0, 2023-07-14T18:29:39.112 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_writing_deferred_bytes": 0, 2023-07-14T18:29:39.112 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_writing_deferred_items": 0, 2023-07-14T18:29:39.112 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_writing_bytes": 0, 2023-07-14T18:29:39.113 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_writing_items": 0, 2023-07-14T18:29:39.113 INFO:teuthology.orchestra.run.smithi172.stdout: "bluefs_bytes": 0, 2023-07-14T18:29:39.113 INFO:teuthology.orchestra.run.smithi172.stdout: "bluefs_items": 0, 2023-07-14T18:29:39.113 INFO:teuthology.orchestra.run.smithi172.stdout: "bluefs_file_reader_bytes": 0, 2023-07-14T18:29:39.113 INFO:teuthology.orchestra.run.smithi172.stdout: "bluefs_file_reader_items": 0, 2023-07-14T18:29:39.114 INFO:teuthology.orchestra.run.smithi172.stdout: "bluefs_file_writer_bytes": 0, 2023-07-14T18:29:39.114 INFO:teuthology.orchestra.run.smithi172.stdout: "bluefs_file_writer_items": 0, 2023-07-14T18:29:39.114 INFO:teuthology.orchestra.run.smithi172.stdout: "buffer_anon_bytes": 182127, 2023-07-14T18:29:39.114 INFO:teuthology.orchestra.run.smithi172.stdout: "buffer_anon_items": 49, 2023-07-14T18:29:39.114 INFO:teuthology.orchestra.run.smithi172.stdout: "buffer_meta_bytes": 0, 2023-07-14T18:29:39.115 INFO:teuthology.orchestra.run.smithi172.stdout: "buffer_meta_items": 0, 2023-07-14T18:29:39.115 INFO:teuthology.orchestra.run.smithi172.stdout: "osd_bytes": 0, 2023-07-14T18:29:39.115 INFO:teuthology.orchestra.run.smithi172.stdout: "osd_items": 0, 2023-07-14T18:29:39.115 INFO:teuthology.orchestra.run.smithi172.stdout: "osd_mapbl_bytes": 0, 2023-07-14T18:29:39.116 INFO:teuthology.orchestra.run.smithi172.stdout: "osd_mapbl_items": 0, 2023-07-14T18:29:39.116 INFO:teuthology.orchestra.run.smithi172.stdout: "osd_pglog_bytes": 0, 2023-07-14T18:29:39.116 INFO:teuthology.orchestra.run.smithi172.stdout: "osd_pglog_items": 0, 2023-07-14T18:29:39.116 INFO:teuthology.orchestra.run.smithi172.stdout: "osdmap_bytes": 8792, 2023-07-14T18:29:39.117 INFO:teuthology.orchestra.run.smithi172.stdout: "osdmap_items": 168, 2023-07-14T18:29:39.117 INFO:teuthology.orchestra.run.smithi172.stdout: "osdmap_mapping_bytes": 0, 2023-07-14T18:29:39.117 INFO:teuthology.orchestra.run.smithi172.stdout: "osdmap_mapping_items": 0, 2023-07-14T18:29:39.117 INFO:teuthology.orchestra.run.smithi172.stdout: "pgmap_bytes": 0, 2023-07-14T18:29:39.118 INFO:teuthology.orchestra.run.smithi172.stdout: "pgmap_items": 0, 2023-07-14T18:29:39.118 INFO:teuthology.orchestra.run.smithi172.stdout: "mds_co_bytes": 1202100, 2023-07-14T18:29:39.118 INFO:teuthology.orchestra.run.smithi172.stdout: "mds_co_items": 5771, 2023-07-14T18:29:39.118 INFO:teuthology.orchestra.run.smithi172.stdout: "unittest_1_bytes": 0, 2023-07-14T18:29:39.118 INFO:teuthology.orchestra.run.smithi172.stdout: "unittest_1_items": 0, 2023-07-14T18:29:39.119 INFO:teuthology.orchestra.run.smithi172.stdout: "unittest_2_bytes": 0, 2023-07-14T18:29:39.119 INFO:teuthology.orchestra.run.smithi172.stdout: "unittest_2_items": 0 2023-07-14T18:29:39.119 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-07-14T18:29:39.119 INFO:teuthology.orchestra.run.smithi172.stdout: "objecter": { 2023-07-14T18:29:39.119 INFO:teuthology.orchestra.run.smithi172.stdout: "op_active": 0, 2023-07-14T18:29:39.120 INFO:teuthology.orchestra.run.smithi172.stdout: "op_laggy": 0, 2023-07-14T18:29:39.120 INFO:teuthology.orchestra.run.smithi172.stdout: "op_send": 3260, 2023-07-14T18:29:39.120 INFO:teuthology.orchestra.run.smithi172.stdout: "op_send_bytes": 21, 2023-07-14T18:29:39.120 INFO:teuthology.orchestra.run.smithi172.stdout: "op_resend": 3, 2023-07-14T18:29:39.120 INFO:teuthology.orchestra.run.smithi172.stdout: "op_reply": 3260, 2023-07-14T18:29:39.121 INFO:teuthology.orchestra.run.smithi172.stdout: "op_latency": { 2023-07-14T18:29:39.121 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 3260, 2023-07-14T18:29:39.121 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 1.518967085, 2023-07-14T18:29:39.121 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000465940 2023-07-14T18:29:39.121 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-07-14T18:29:39.121 INFO:teuthology.orchestra.run.smithi172.stdout: "op_inflight": 0, 2023-07-14T18:29:39.122 INFO:teuthology.orchestra.run.smithi172.stdout: "oplen_avg": { 2023-07-14T18:29:39.122 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 3260, 2023-07-14T18:29:39.122 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 3261 2023-07-14T18:29:39.122 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-07-14T18:29:39.122 INFO:teuthology.orchestra.run.smithi172.stdout: "op": 3260, 2023-07-14T18:29:39.123 INFO:teuthology.orchestra.run.smithi172.stdout: "op_r": 3260, 2023-07-14T18:29:39.123 INFO:teuthology.orchestra.run.smithi172.stdout: "op_w": 0, 2023-07-14T18:29:39.123 INFO:teuthology.orchestra.run.smithi172.stdout: "op_rmw": 0, 2023-07-14T18:29:39.123 INFO:teuthology.orchestra.run.smithi172.stdout: "op_pg": 0, 2023-07-14T18:29:39.123 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_stat": 2098, 2023-07-14T18:29:39.124 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_create": 0, 2023-07-14T18:29:39.124 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_read": 1160, 2023-07-14T18:29:39.124 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_write": 0, 2023-07-14T18:29:39.124 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_writefull": 0, 2023-07-14T18:29:39.125 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_writesame": 0, 2023-07-14T18:29:39.125 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_append": 0, 2023-07-14T18:29:39.125 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_zero": 0, 2023-07-14T18:29:39.126 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_truncate": 0, 2023-07-14T18:29:39.126 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_delete": 0, 2023-07-14T18:29:39.127 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_mapext": 0, 2023-07-14T18:29:39.127 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_sparse_read": 0, 2023-07-14T18:29:39.127 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_clonerange": 0, 2023-07-14T18:29:39.128 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_getxattr": 1, 2023-07-14T18:29:39.128 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_setxattr": 0, 2023-07-14T18:29:39.129 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_cmpxattr": 0, 2023-07-14T18:29:39.129 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_rmxattr": 0, 2023-07-14T18:29:39.129 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_resetxattrs": 0, 2023-07-14T18:29:39.130 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_call": 0, 2023-07-14T18:29:39.130 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_watch": 0, 2023-07-14T18:29:39.131 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_notify": 0, 2023-07-14T18:29:39.131 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_src_cmpxattr": 0, 2023-07-14T18:29:39.131 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_pgls": 0, 2023-07-14T18:29:39.131 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_pgls_filter": 0, 2023-07-14T18:29:39.131 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_other": 0, 2023-07-14T18:29:39.132 INFO:teuthology.orchestra.run.smithi172.stdout: "linger_active": 0, 2023-07-14T18:29:39.132 INFO:teuthology.orchestra.run.smithi172.stdout: "linger_send": 0, 2023-07-14T18:29:39.132 INFO:teuthology.orchestra.run.smithi172.stdout: "linger_resend": 0, 2023-07-14T18:29:39.132 INFO:teuthology.orchestra.run.smithi172.stdout: "linger_ping": 0, 2023-07-14T18:29:39.132 INFO:teuthology.orchestra.run.smithi172.stdout: "poolop_active": 0, 2023-07-14T18:29:39.133 INFO:teuthology.orchestra.run.smithi172.stdout: "poolop_send": 0, 2023-07-14T18:29:39.133 INFO:teuthology.orchestra.run.smithi172.stdout: "poolop_resend": 0, 2023-07-14T18:29:39.133 INFO:teuthology.orchestra.run.smithi172.stdout: "poolstat_active": 0, 2023-07-14T18:29:39.133 INFO:teuthology.orchestra.run.smithi172.stdout: "poolstat_send": 0, 2023-07-14T18:29:39.133 INFO:teuthology.orchestra.run.smithi172.stdout: "poolstat_resend": 0, 2023-07-14T18:29:39.133 INFO:teuthology.orchestra.run.smithi172.stdout: "statfs_active": 0, 2023-07-14T18:29:39.134 INFO:teuthology.orchestra.run.smithi172.stdout: "statfs_send": 0, 2023-07-14T18:29:39.134 INFO:teuthology.orchestra.run.smithi172.stdout: "statfs_resend": 0, 2023-07-14T18:29:39.134 INFO:teuthology.orchestra.run.smithi172.stdout: "command_active": 0, 2023-07-14T18:29:39.134 INFO:teuthology.orchestra.run.smithi172.stdout: "command_send": 0, 2023-07-14T18:29:39.135 INFO:teuthology.orchestra.run.smithi172.stdout: "command_resend": 0, 2023-07-14T18:29:39.135 INFO:teuthology.orchestra.run.smithi172.stdout: "map_epoch": 88, 2023-07-14T18:29:39.135 INFO:teuthology.orchestra.run.smithi172.stdout: "map_full": 0, 2023-07-14T18:29:39.135 INFO:teuthology.orchestra.run.smithi172.stdout: "map_inc": 4, 2023-07-14T18:29:39.136 INFO:teuthology.orchestra.run.smithi172.stdout: "osd_sessions": 4, 2023-07-14T18:29:39.136 INFO:teuthology.orchestra.run.smithi172.stdout: "osd_session_open": 5, 2023-07-14T18:29:39.136 INFO:teuthology.orchestra.run.smithi172.stdout: "osd_session_close": 1, 2023-07-14T18:29:39.137 INFO:teuthology.orchestra.run.smithi172.stdout: "osd_laggy": 0, 2023-07-14T18:29:39.137 INFO:teuthology.orchestra.run.smithi172.stdout: "omap_wr": 0, 2023-07-14T18:29:39.138 INFO:teuthology.orchestra.run.smithi172.stdout: "omap_rd": 2, 2023-07-14T18:29:39.138 INFO:teuthology.orchestra.run.smithi172.stdout: "omap_del": 0 2023-07-14T18:29:39.138 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-07-14T18:29:39.139 INFO:teuthology.orchestra.run.smithi172.stdout: "oft": { 2023-07-14T18:29:39.139 INFO:teuthology.orchestra.run.smithi172.stdout: "omap_total_objs": 0, 2023-07-14T18:29:39.140 INFO:teuthology.orchestra.run.smithi172.stdout: "omap_total_kv_pairs": 0, 2023-07-14T18:29:39.140 INFO:teuthology.orchestra.run.smithi172.stdout: "omap_total_updates": 0, 2023-07-14T18:29:39.141 INFO:teuthology.orchestra.run.smithi172.stdout: "omap_total_removes": 0 2023-07-14T18:29:39.141 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-07-14T18:29:39.141 INFO:teuthology.orchestra.run.smithi172.stdout: "osd-slow-ops": { 2023-07-14T18:29:39.142 INFO:teuthology.orchestra.run.smithi172.stdout: "slow_ops_count": 0 2023-07-14T18:29:39.142 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-07-14T18:29:39.143 INFO:teuthology.orchestra.run.smithi172.stdout: "purge_queue": { 2023-07-14T18:29:39.143 INFO:teuthology.orchestra.run.smithi172.stdout: "pq_executing_ops": 0, 2023-07-14T18:29:39.143 INFO:teuthology.orchestra.run.smithi172.stdout: "pq_executing_ops_high_water": 0, 2023-07-14T18:29:39.144 INFO:teuthology.orchestra.run.smithi172.stdout: "pq_executing": 0, 2023-07-14T18:29:39.144 INFO:teuthology.orchestra.run.smithi172.stdout: "pq_executing_high_water": 0, 2023-07-14T18:29:39.145 INFO:teuthology.orchestra.run.smithi172.stdout: "pq_executed": 0, 2023-07-14T18:29:39.145 INFO:teuthology.orchestra.run.smithi172.stdout: "pq_item_in_journal": 0 2023-07-14T18:29:39.145 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-07-14T18:29:39.145 INFO:teuthology.orchestra.run.smithi172.stdout: "throttle-msgr_dispatch_throttler-mds": { 2023-07-14T18:29:39.145 INFO:teuthology.orchestra.run.smithi172.stdout: "val": 0, 2023-07-14T18:29:39.146 INFO:teuthology.orchestra.run.smithi172.stdout: "max": 104857600, 2023-07-14T18:29:39.146 INFO:teuthology.orchestra.run.smithi172.stdout: "get_started": 0, 2023-07-14T18:29:39.146 INFO:teuthology.orchestra.run.smithi172.stdout: "get": 3590, 2023-07-14T18:29:39.146 INFO:teuthology.orchestra.run.smithi172.stdout: "get_sum": 8510775, 2023-07-14T18:29:39.146 INFO:teuthology.orchestra.run.smithi172.stdout: "get_or_fail_fail": 0, 2023-07-14T18:29:39.147 INFO:teuthology.orchestra.run.smithi172.stdout: "get_or_fail_success": 3590, 2023-07-14T18:29:39.147 INFO:teuthology.orchestra.run.smithi172.stdout: "take": 0, 2023-07-14T18:29:39.147 INFO:teuthology.orchestra.run.smithi172.stdout: "take_sum": 0, 2023-07-14T18:29:39.147 INFO:teuthology.orchestra.run.smithi172.stdout: "put": 3590, 2023-07-14T18:29:39.147 INFO:teuthology.orchestra.run.smithi172.stdout: "put_sum": 8510775, 2023-07-14T18:29:39.147 INFO:teuthology.orchestra.run.smithi172.stdout: "wait": { 2023-07-14T18:29:39.148 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2023-07-14T18:29:39.148 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2023-07-14T18:29:39.148 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2023-07-14T18:29:39.148 INFO:teuthology.orchestra.run.smithi172.stdout: } 2023-07-14T18:29:39.148 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-07-14T18:29:39.149 INFO:teuthology.orchestra.run.smithi172.stdout: "throttle-objecter_bytes": { 2023-07-14T18:29:39.149 INFO:teuthology.orchestra.run.smithi172.stdout: "val": 0, 2023-07-14T18:29:39.149 INFO:teuthology.orchestra.run.smithi172.stdout: "max": 104857600, 2023-07-14T18:29:39.149 INFO:teuthology.orchestra.run.smithi172.stdout: "get_started": 0, 2023-07-14T18:29:39.149 INFO:teuthology.orchestra.run.smithi172.stdout: "get": 0, 2023-07-14T18:29:39.150 INFO:teuthology.orchestra.run.smithi172.stdout: "get_sum": 0, 2023-07-14T18:29:39.150 INFO:teuthology.orchestra.run.smithi172.stdout: "get_or_fail_fail": 0, 2023-07-14T18:29:39.150 INFO:teuthology.orchestra.run.smithi172.stdout: "get_or_fail_success": 0, 2023-07-14T18:29:39.150 INFO:teuthology.orchestra.run.smithi172.stdout: "take": 3260, 2023-07-14T18:29:39.150 INFO:teuthology.orchestra.run.smithi172.stdout: "take_sum": 7334839, 2023-07-14T18:29:39.151 INFO:teuthology.orchestra.run.smithi172.stdout: "put": 3260, 2023-07-14T18:29:39.151 INFO:teuthology.orchestra.run.smithi172.stdout: "put_sum": 7334839, 2023-07-14T18:29:39.151 INFO:teuthology.orchestra.run.smithi172.stdout: "wait": { 2023-07-14T18:29:39.151 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2023-07-14T18:29:39.151 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2023-07-14T18:29:39.152 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2023-07-14T18:29:39.152 INFO:teuthology.orchestra.run.smithi172.stdout: } 2023-07-14T18:29:39.152 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-07-14T18:29:39.152 INFO:teuthology.orchestra.run.smithi172.stdout: "throttle-objecter_ops": { 2023-07-14T18:29:39.152 INFO:teuthology.orchestra.run.smithi172.stdout: "val": 0, 2023-07-14T18:29:39.153 INFO:teuthology.orchestra.run.smithi172.stdout: "max": 1024, 2023-07-14T18:29:39.153 INFO:teuthology.orchestra.run.smithi172.stdout: "get_started": 0, 2023-07-14T18:29:39.153 INFO:teuthology.orchestra.run.smithi172.stdout: "get": 0, 2023-07-14T18:29:39.153 INFO:teuthology.orchestra.run.smithi172.stdout: "get_sum": 0, 2023-07-14T18:29:39.153 INFO:teuthology.orchestra.run.smithi172.stdout: "get_or_fail_fail": 0, 2023-07-14T18:29:39.154 INFO:teuthology.orchestra.run.smithi172.stdout: "get_or_fail_success": 0, 2023-07-14T18:29:39.154 INFO:teuthology.orchestra.run.smithi172.stdout: "take": 3260, 2023-07-14T18:29:39.154 INFO:teuthology.orchestra.run.smithi172.stdout: "take_sum": 3260, 2023-07-14T18:29:39.154 INFO:teuthology.orchestra.run.smithi172.stdout: "put": 3260, 2023-07-14T18:29:39.154 INFO:teuthology.orchestra.run.smithi172.stdout: "put_sum": 3260, 2023-07-14T18:29:39.154 INFO:teuthology.orchestra.run.smithi172.stdout: "wait": { 2023-07-14T18:29:39.155 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2023-07-14T18:29:39.155 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2023-07-14T18:29:39.155 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2023-07-14T18:29:39.155 INFO:teuthology.orchestra.run.smithi172.stdout: } 2023-07-14T18:29:39.155 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-07-14T18:29:39.156 INFO:teuthology.orchestra.run.smithi172.stdout: "throttle-write_buf_throttle": { 2023-07-14T18:29:39.156 INFO:teuthology.orchestra.run.smithi172.stdout: "val": 0, 2023-07-14T18:29:39.156 INFO:teuthology.orchestra.run.smithi172.stdout: "max": 3758096384, 2023-07-14T18:29:39.156 INFO:teuthology.orchestra.run.smithi172.stdout: "get_started": 0, 2023-07-14T18:29:39.156 INFO:teuthology.orchestra.run.smithi172.stdout: "get": 0, 2023-07-14T18:29:39.157 INFO:teuthology.orchestra.run.smithi172.stdout: "get_sum": 0, 2023-07-14T18:29:39.157 INFO:teuthology.orchestra.run.smithi172.stdout: "get_or_fail_fail": 0, 2023-07-14T18:29:39.157 INFO:teuthology.orchestra.run.smithi172.stdout: "get_or_fail_success": 0, 2023-07-14T18:29:39.157 INFO:teuthology.orchestra.run.smithi172.stdout: "take": 0, 2023-07-14T18:29:39.157 INFO:teuthology.orchestra.run.smithi172.stdout: "take_sum": 0, 2023-07-14T18:29:39.158 INFO:teuthology.orchestra.run.smithi172.stdout: "put": 0, 2023-07-14T18:29:39.158 INFO:teuthology.orchestra.run.smithi172.stdout: "put_sum": 0, 2023-07-14T18:29:39.158 INFO:teuthology.orchestra.run.smithi172.stdout: "wait": { 2023-07-14T18:29:39.158 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2023-07-14T18:29:39.158 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2023-07-14T18:29:39.158 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2023-07-14T18:29:39.159 INFO:teuthology.orchestra.run.smithi172.stdout: } 2023-07-14T18:29:39.159 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-07-14T18:29:39.159 INFO:teuthology.orchestra.run.smithi172.stdout: "throttle-write_buf_throttle-0x562785b64460": { 2023-07-14T18:29:39.159 INFO:teuthology.orchestra.run.smithi172.stdout: "val": 0, 2023-07-14T18:29:39.159 INFO:teuthology.orchestra.run.smithi172.stdout: "max": 3758096384, 2023-07-14T18:29:39.160 INFO:teuthology.orchestra.run.smithi172.stdout: "get_started": 0, 2023-07-14T18:29:39.160 INFO:teuthology.orchestra.run.smithi172.stdout: "get": 0, 2023-07-14T18:29:39.160 INFO:teuthology.orchestra.run.smithi172.stdout: "get_sum": 0, 2023-07-14T18:29:39.160 INFO:teuthology.orchestra.run.smithi172.stdout: "get_or_fail_fail": 0, 2023-07-14T18:29:39.160 INFO:teuthology.orchestra.run.smithi172.stdout: "get_or_fail_success": 0, 2023-07-14T18:29:39.161 INFO:teuthology.orchestra.run.smithi172.stdout: "take": 0, 2023-07-14T18:29:39.161 INFO:teuthology.orchestra.run.smithi172.stdout: "take_sum": 0, 2023-07-14T18:29:39.161 INFO:teuthology.orchestra.run.smithi172.stdout: "put": 0, 2023-07-14T18:29:39.161 INFO:teuthology.orchestra.run.smithi172.stdout: "put_sum": 0, 2023-07-14T18:29:39.161 INFO:teuthology.orchestra.run.smithi172.stdout: "wait": { 2023-07-14T18:29:39.162 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2023-07-14T18:29:39.162 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2023-07-14T18:29:39.162 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2023-07-14T18:29:39.162 INFO:teuthology.orchestra.run.smithi172.stdout: } 2023-07-14T18:29:39.162 INFO:teuthology.orchestra.run.smithi172.stdout: } 2023-07-14T18:29:39.163 INFO:teuthology.orchestra.run.smithi172.stdout:} 2023-07-14T18:29:39.164 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:29:38 smithi172 ceph-mon[97983]: pgmap v809: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-07-14T18:29:39.164 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:29:38 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-14T18:29:39.166 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:29:38 smithi184 ceph-mon[98481]: pgmap v809: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-07-14T18:29:39.166 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:29:38 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-14T18:29:39.209 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:29:38 smithi163 ceph-mon[96576]: pgmap v809: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-07-14T18:29:39.209 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:29:38 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-14T18:29:39.859 INFO:tasks.check_counter:Daemon mds.e mds.exported=0 2023-07-14T18:29:39.860 INFO:tasks.check_counter:Daemon mds.e mds.imported=0 2023-07-14T18:29:39.860 INFO:tasks.check_counter:Daemon mds.e mds_cache.dir_update=0 2023-07-14T18:29:39.860 INFO:tasks.check_counter:Daemon mds.e mds_cache.dir_update_receipt=0 2023-07-14T18:29:39.860 INFO:tasks.check_counter:Daemon mds.e mds.dir_split=0 2023-07-14T18:29:39.861 DEBUG:tasks.check_counter:Getting stats from h 2023-07-14T18:29:39.861 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81c9387d2e7576da065747ec9c16d1c7d69016ec shell --fsid bf7326ec-2270-11ee-9b33-001a4aab830c -- ceph daemon mds.h perf dump 2023-07-14T18:29:40.515 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/bf7326ec-2270-11ee-9b33-001a4aab830c/mon.b/config 2023-07-14T18:29:41.017 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:29:40 smithi172 ceph-mon[97983]: pgmap v810: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-07-14T18:29:41.017 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:29:40 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T18:29:41.018 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:29:40 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-14T18:29:41.018 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:29:40 smithi172 ceph-mon[97983]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:29:41.166 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:29:40 smithi184 ceph-mon[98481]: pgmap v810: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-07-14T18:29:41.166 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:29:40 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T18:29:41.167 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:29:40 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-14T18:29:41.167 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:29:40 smithi184 ceph-mon[98481]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:29:41.208 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:29:40 smithi163 ceph-mon[96576]: pgmap v810: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-07-14T18:29:41.209 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:29:40 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-14T18:29:41.209 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:29:40 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-14T18:29:41.209 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:29:40 smithi163 ceph-mon[96576]: from='mgr.14152 172.21.15.163:0/1123313171' entity='mgr.x' 2023-07-14T18:29:41.777 INFO:teuthology.orchestra.run.smithi172.stdout:{ 2023-07-14T18:29:41.778 INFO:teuthology.orchestra.run.smithi172.stdout: "AsyncMessenger::Worker-0": { 2023-07-14T18:29:41.778 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_recv_messages": 4949037, 2023-07-14T18:29:41.778 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_messages": 4951689, 2023-07-14T18:29:41.778 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_recv_bytes": 786292356, 2023-07-14T18:29:41.778 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_bytes": 841975307, 2023-07-14T18:29:41.779 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_created_connections": 12, 2023-07-14T18:29:41.779 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_active_connections": 3, 2023-07-14T18:29:41.779 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_total_time": 138.988426985, 2023-07-14T18:29:41.779 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_send_time": 54.751023993, 2023-07-14T18:29:41.779 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_recv_time": 96.513206845, 2023-07-14T18:29:41.780 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_fast_dispatch_time": 0.017996255, 2023-07-14T18:29:41.780 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_messages_queue_lat": { 2023-07-14T18:29:41.780 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 4951689, 2023-07-14T18:29:41.780 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 39.372448245, 2023-07-14T18:29:41.780 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000007951 2023-07-14T18:29:41.781 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-07-14T18:29:41.781 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_handle_ack_lat": { 2023-07-14T18:29:41.781 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 9898330, 2023-07-14T18:29:41.781 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.866328660, 2023-07-14T18:29:41.782 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000087 2023-07-14T18:29:41.782 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-07-14T18:29:41.782 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_recv_encrypted_bytes": 912, 2023-07-14T18:29:41.782 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_encrypted_bytes": 688 2023-07-14T18:29:41.782 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-07-14T18:29:41.783 INFO:teuthology.orchestra.run.smithi172.stdout: "AsyncMessenger::Worker-1": { 2023-07-14T18:29:41.783 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_recv_messages": 693, 2023-07-14T18:29:41.783 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_messages": 923, 2023-07-14T18:29:41.783 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_recv_bytes": 174471, 2023-07-14T18:29:41.784 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_bytes": 5261974, 2023-07-14T18:29:41.784 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_created_connections": 22, 2023-07-14T18:29:41.784 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_active_connections": 7, 2023-07-14T18:29:41.785 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_total_time": 0.065617496, 2023-07-14T18:29:41.785 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_send_time": 0.026536469, 2023-07-14T18:29:41.785 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_recv_time": 0.015584317, 2023-07-14T18:29:41.785 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_fast_dispatch_time": 0.018809873, 2023-07-14T18:29:41.785 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_messages_queue_lat": { 2023-07-14T18:29:41.785 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 919, 2023-07-14T18:29:41.786 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.055255364, 2023-07-14T18:29:41.786 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000060125 2023-07-14T18:29:41.786 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-07-14T18:29:41.786 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_handle_ack_lat": { 2023-07-14T18:29:41.786 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 10, 2023-07-14T18:29:41.787 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000833, 2023-07-14T18:29:41.787 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000083 2023-07-14T18:29:41.787 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-07-14T18:29:41.787 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_recv_encrypted_bytes": 320, 2023-07-14T18:29:41.787 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_encrypted_bytes": 558304 2023-07-14T18:29:41.788 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-07-14T18:29:41.788 INFO:teuthology.orchestra.run.smithi172.stdout: "AsyncMessenger::Worker-2": { 2023-07-14T18:29:41.788 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_recv_messages": 9185709, 2023-07-14T18:29:41.789 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_messages": 9180615, 2023-07-14T18:29:41.789 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_recv_bytes": 1487558660, 2023-07-14T18:29:41.789 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_bytes": 1512277625, 2023-07-14T18:29:41.789 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_created_connections": 10, 2023-07-14T18:29:41.789 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_active_connections": 5, 2023-07-14T18:29:41.790 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_total_time": 227.371293718, 2023-07-14T18:29:41.790 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_send_time": 90.404937047, 2023-07-14T18:29:41.790 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_recv_time": 154.709405440, 2023-07-14T18:29:41.790 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_fast_dispatch_time": 0.057677957, 2023-07-14T18:29:41.790 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_messages_queue_lat": { 2023-07-14T18:29:41.791 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 9180615, 2023-07-14T18:29:41.791 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 80.857601010, 2023-07-14T18:29:41.791 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000008807 2023-07-14T18:29:41.791 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-07-14T18:29:41.791 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_handle_ack_lat": { 2023-07-14T18:29:41.792 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 17918490, 2023-07-14T18:29:41.792 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 2.774226348, 2023-07-14T18:29:41.792 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000154 2023-07-14T18:29:41.792 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-07-14T18:29:41.792 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_recv_encrypted_bytes": 612240, 2023-07-14T18:29:41.793 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_encrypted_bytes": 180032 2023-07-14T18:29:41.793 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-07-14T18:29:41.793 INFO:teuthology.orchestra.run.smithi172.stdout: "cct": { 2023-07-14T18:29:41.793 INFO:teuthology.orchestra.run.smithi172.stdout: "total_workers": 1, 2023-07-14T18:29:41.793 INFO:teuthology.orchestra.run.smithi172.stdout: "unhealthy_workers": 0 2023-07-14T18:29:41.794 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-07-14T18:29:41.794 INFO:teuthology.orchestra.run.smithi172.stdout: "finisher-MDSRank": { 2023-07-14T18:29:41.794 INFO:teuthology.orchestra.run.smithi172.stdout: "queue_len": 0, 2023-07-14T18:29:41.795 INFO:teuthology.orchestra.run.smithi172.stdout: "complete_latency": { 2023-07-14T18:29:41.795 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 1495, 2023-07-14T18:29:41.795 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 1.446228493, 2023-07-14T18:29:41.795 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000967376 2023-07-14T18:29:41.795 INFO:teuthology.orchestra.run.smithi172.stdout: } 2023-07-14T18:29:41.796 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-07-14T18:29:41.796 INFO:teuthology.orchestra.run.smithi172.stdout: "finisher-PurgeQueue": { 2023-07-14T18:29:41.796 INFO:teuthology.orchestra.run.smithi172.stdout: "queue_len": 0, 2023-07-14T18:29:41.796 INFO:teuthology.orchestra.run.smithi172.stdout: "complete_latency": { 2023-07-14T18:29:41.796 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 643, 2023-07-14T18:29:41.797 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.042021772, 2023-07-14T18:29:41.797 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000065352 2023-07-14T18:29:41.797 INFO:teuthology.orchestra.run.smithi172.stdout: } 2023-07-14T18:29:41.797 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-07-14T18:29:41.797 INFO:teuthology.orchestra.run.smithi172.stdout: "mds": { 2023-07-14T18:29:41.798 INFO:teuthology.orchestra.run.smithi172.stdout: "request": 12396, 2023-07-14T18:29:41.798 INFO:teuthology.orchestra.run.smithi172.stdout: "reply": 10924, 2023-07-14T18:29:41.798 INFO:teuthology.orchestra.run.smithi172.stdout: "reply_latency": { 2023-07-14T18:29:41.798 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 10924, 2023-07-14T18:29:41.798 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 4.397195056, 2023-07-14T18:29:41.798 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000402526 2023-07-14T18:29:41.799 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-07-14T18:29:41.799 INFO:teuthology.orchestra.run.smithi172.stdout: "slow_reply": 0, 2023-07-14T18:29:41.799 INFO:teuthology.orchestra.run.smithi172.stdout: "forward": 1472, 2023-07-14T18:29:41.799 INFO:teuthology.orchestra.run.smithi172.stdout: "dir_fetch_complete": 0, 2023-07-14T18:29:41.799 INFO:teuthology.orchestra.run.smithi172.stdout: "dir_fetch_keys": 0, 2023-07-14T18:29:41.800 INFO:teuthology.orchestra.run.smithi172.stdout: "dir_commit": 11, 2023-07-14T18:29:41.800 INFO:teuthology.orchestra.run.smithi172.stdout: "dir_split": 0, 2023-07-14T18:29:41.800 INFO:teuthology.orchestra.run.smithi172.stdout: "dir_merge": 0, 2023-07-14T18:29:41.800 INFO:teuthology.orchestra.run.smithi172.stdout: "inodes": 2149, 2023-07-14T18:29:41.800 INFO:teuthology.orchestra.run.smithi172.stdout: "inodes_top": 14, 2023-07-14T18:29:41.801 INFO:teuthology.orchestra.run.smithi172.stdout: "inodes_bottom": 2135, 2023-07-14T18:29:41.801 INFO:teuthology.orchestra.run.smithi172.stdout: "inodes_pin_tail": 0, 2023-07-14T18:29:41.801 INFO:teuthology.orchestra.run.smithi172.stdout: "inodes_pinned": 2129, 2023-07-14T18:29:41.801 INFO:teuthology.orchestra.run.smithi172.stdout: "inodes_expired": 8, 2023-07-14T18:29:41.801 INFO:teuthology.orchestra.run.smithi172.stdout: "inodes_with_caps": 1610, 2023-07-14T18:29:41.802 INFO:teuthology.orchestra.run.smithi172.stdout: "caps": 1610, 2023-07-14T18:29:41.802 INFO:teuthology.orchestra.run.smithi172.stdout: "subtrees": 97, 2023-07-14T18:29:41.802 INFO:teuthology.orchestra.run.smithi172.stdout: "traverse": 24614, 2023-07-14T18:29:41.802 INFO:teuthology.orchestra.run.smithi172.stdout: "traverse_hit": 1364, 2023-07-14T18:29:41.802 INFO:teuthology.orchestra.run.smithi172.stdout: "traverse_forward": 1472, 2023-07-14T18:29:41.803 INFO:teuthology.orchestra.run.smithi172.stdout: "traverse_discover": 108, 2023-07-14T18:29:41.803 INFO:teuthology.orchestra.run.smithi172.stdout: "traverse_dir_fetch": 0, 2023-07-14T18:29:41.803 INFO:teuthology.orchestra.run.smithi172.stdout: "traverse_remote_ino": 0, 2023-07-14T18:29:41.803 INFO:teuthology.orchestra.run.smithi172.stdout: "traverse_lock": 0, 2023-07-14T18:29:41.803 INFO:teuthology.orchestra.run.smithi172.stdout: "load_cent": 3000, 2023-07-14T18:29:41.804 INFO:teuthology.orchestra.run.smithi172.stdout: "q": 3, 2023-07-14T18:29:41.804 INFO:teuthology.orchestra.run.smithi172.stdout: "exported": 0, 2023-07-14T18:29:41.804 INFO:teuthology.orchestra.run.smithi172.stdout: "exported_inodes": 0, 2023-07-14T18:29:41.804 INFO:teuthology.orchestra.run.smithi172.stdout: "imported": 46, 2023-07-14T18:29:41.805 INFO:teuthology.orchestra.run.smithi172.stdout: "imported_inodes": 2099, 2023-07-14T18:29:41.805 INFO:teuthology.orchestra.run.smithi172.stdout: "openino_dir_fetch": 0, 2023-07-14T18:29:41.805 INFO:teuthology.orchestra.run.smithi172.stdout: "openino_backtrace_fetch": 446, 2023-07-14T18:29:41.805 INFO:teuthology.orchestra.run.smithi172.stdout: "openino_peer_discover": 0, 2023-07-14T18:29:41.806 INFO:teuthology.orchestra.run.smithi172.stdout: "root_rfiles": 3563, 2023-07-14T18:29:41.806 INFO:teuthology.orchestra.run.smithi172.stdout: "root_rbytes": 33808819, 2023-07-14T18:29:41.806 INFO:teuthology.orchestra.run.smithi172.stdout: "root_rsnaps": 0, 2023-07-14T18:29:41.806 INFO:teuthology.orchestra.run.smithi172.stdout: "scrub_backtrace_fetch": 446, 2023-07-14T18:29:41.807 INFO:teuthology.orchestra.run.smithi172.stdout: "scrub_set_tag": 0, 2023-07-14T18:29:41.807 INFO:teuthology.orchestra.run.smithi172.stdout: "scrub_backtrace_repaired": 0, 2023-07-14T18:29:41.807 INFO:teuthology.orchestra.run.smithi172.stdout: "scrub_inotable_repaired": 0, 2023-07-14T18:29:41.807 INFO:teuthology.orchestra.run.smithi172.stdout: "scrub_dir_inodes": 16, 2023-07-14T18:29:41.807 INFO:teuthology.orchestra.run.smithi172.stdout: "scrub_dir_base_inodes": 0, 2023-07-14T18:29:41.807 INFO:teuthology.orchestra.run.smithi172.stdout: "scrub_dirfrag_rstats": 16, 2023-07-14T18:29:41.808 INFO:teuthology.orchestra.run.smithi172.stdout: "scrub_file_inodes": 430, 2023-07-14T18:29:41.808 INFO:teuthology.orchestra.run.smithi172.stdout: "handle_inode_file_caps": 0, 2023-07-14T18:29:41.808 INFO:teuthology.orchestra.run.smithi172.stdout: "ceph_cap_op_revoke": 17, 2023-07-14T18:29:41.808 INFO:teuthology.orchestra.run.smithi172.stdout: "ceph_cap_op_grant": 502, 2023-07-14T18:29:41.808 INFO:teuthology.orchestra.run.smithi172.stdout: "ceph_cap_op_trunc": 0, 2023-07-14T18:29:41.809 INFO:teuthology.orchestra.run.smithi172.stdout: "ceph_cap_op_flushsnap_ack": 0, 2023-07-14T18:29:41.809 INFO:teuthology.orchestra.run.smithi172.stdout: "ceph_cap_op_flush_ack": 0, 2023-07-14T18:29:41.809 INFO:teuthology.orchestra.run.smithi172.stdout: "handle_client_caps": 392, 2023-07-14T18:29:41.809 INFO:teuthology.orchestra.run.smithi172.stdout: "handle_client_caps_dirty": 283, 2023-07-14T18:29:41.809 INFO:teuthology.orchestra.run.smithi172.stdout: "handle_client_cap_release": 35, 2023-07-14T18:29:41.810 INFO:teuthology.orchestra.run.smithi172.stdout: "process_request_cap_release": 754 2023-07-14T18:29:41.810 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-07-14T18:29:41.810 INFO:teuthology.orchestra.run.smithi172.stdout: "mds_cache": { 2023-07-14T18:29:41.810 INFO:teuthology.orchestra.run.smithi172.stdout: "dir_update": 81, 2023-07-14T18:29:41.810 INFO:teuthology.orchestra.run.smithi172.stdout: "dir_update_receipt": 409, 2023-07-14T18:29:41.811 INFO:teuthology.orchestra.run.smithi172.stdout: "dir_try_discover": 215, 2023-07-14T18:29:41.811 INFO:teuthology.orchestra.run.smithi172.stdout: "dir_send_discover": 481, 2023-07-14T18:29:41.811 INFO:teuthology.orchestra.run.smithi172.stdout: "dir_handle_discover": 133, 2023-07-14T18:29:41.811 INFO:teuthology.orchestra.run.smithi172.stdout: "num_strays": 0, 2023-07-14T18:29:41.811 INFO:teuthology.orchestra.run.smithi172.stdout: "num_strays_delayed": 0, 2023-07-14T18:29:41.812 INFO:teuthology.orchestra.run.smithi172.stdout: "num_strays_enqueuing": 0, 2023-07-14T18:29:41.812 INFO:teuthology.orchestra.run.smithi172.stdout: "strays_created": 250, 2023-07-14T18:29:41.812 INFO:teuthology.orchestra.run.smithi172.stdout: "strays_enqueued": 250, 2023-07-14T18:29:41.812 INFO:teuthology.orchestra.run.smithi172.stdout: "strays_reintegrated": 0, 2023-07-14T18:29:41.812 INFO:teuthology.orchestra.run.smithi172.stdout: "strays_migrated": 0, 2023-07-14T18:29:41.812 INFO:teuthology.orchestra.run.smithi172.stdout: "num_recovering_processing": 0, 2023-07-14T18:29:41.813 INFO:teuthology.orchestra.run.smithi172.stdout: "num_recovering_enqueued": 0, 2023-07-14T18:29:41.813 INFO:teuthology.orchestra.run.smithi172.stdout: "num_recovering_prioritized": 0, 2023-07-14T18:29:41.813 INFO:teuthology.orchestra.run.smithi172.stdout: "recovery_started": 0, 2023-07-14T18:29:41.813 INFO:teuthology.orchestra.run.smithi172.stdout: "recovery_completed": 0, 2023-07-14T18:29:41.813 INFO:teuthology.orchestra.run.smithi172.stdout: "ireq_enqueue_scrub": 0, 2023-07-14T18:29:41.814 INFO:teuthology.orchestra.run.smithi172.stdout: "ireq_exportdir": 0, 2023-07-14T18:29:41.814 INFO:teuthology.orchestra.run.smithi172.stdout: "ireq_flush": 0, 2023-07-14T18:29:41.814 INFO:teuthology.orchestra.run.smithi172.stdout: "ireq_fragmentdir": 0, 2023-07-14T18:29:41.814 INFO:teuthology.orchestra.run.smithi172.stdout: "ireq_fragstats": 0, 2023-07-14T18:29:41.815 INFO:teuthology.orchestra.run.smithi172.stdout: "ireq_inodestats": 0 2023-07-14T18:29:41.815 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-07-14T18:29:41.815 INFO:teuthology.orchestra.run.smithi172.stdout: "mds_log": { 2023-07-14T18:29:41.815 INFO:teuthology.orchestra.run.smithi172.stdout: "evadd": 17273, 2023-07-14T18:29:41.816 INFO:teuthology.orchestra.run.smithi172.stdout: "evex": 0, 2023-07-14T18:29:41.816 INFO:teuthology.orchestra.run.smithi172.stdout: "evtrm": 0, 2023-07-14T18:29:41.816 INFO:teuthology.orchestra.run.smithi172.stdout: "ev": 17273, 2023-07-14T18:29:41.816 INFO:teuthology.orchestra.run.smithi172.stdout: "evexg": 0, 2023-07-14T18:29:41.816 INFO:teuthology.orchestra.run.smithi172.stdout: "evexd": 0, 2023-07-14T18:29:41.817 INFO:teuthology.orchestra.run.smithi172.stdout: "segadd": 21, 2023-07-14T18:29:41.817 INFO:teuthology.orchestra.run.smithi172.stdout: "segex": 0, 2023-07-14T18:29:41.817 INFO:teuthology.orchestra.run.smithi172.stdout: "segtrm": 0, 2023-07-14T18:29:41.817 INFO:teuthology.orchestra.run.smithi172.stdout: "seg": 21, 2023-07-14T18:29:41.817 INFO:teuthology.orchestra.run.smithi172.stdout: "segexg": 0, 2023-07-14T18:29:41.818 INFO:teuthology.orchestra.run.smithi172.stdout: "segexd": 0, 2023-07-14T18:29:41.818 INFO:teuthology.orchestra.run.smithi172.stdout: "expos": 4194304, 2023-07-14T18:29:41.818 INFO:teuthology.orchestra.run.smithi172.stdout: "wrpos": 16944124, 2023-07-14T18:29:41.818 INFO:teuthology.orchestra.run.smithi172.stdout: "rdpos": 0, 2023-07-14T18:29:41.818 INFO:teuthology.orchestra.run.smithi172.stdout: "jlat": { 2023-07-14T18:29:41.819 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 581, 2023-07-14T18:29:41.819 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 1.343148239, 2023-07-14T18:29:41.819 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.002311786 2023-07-14T18:29:41.819 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-07-14T18:29:41.819 INFO:teuthology.orchestra.run.smithi172.stdout: "replayed": 0 2023-07-14T18:29:41.820 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-07-14T18:29:41.820 INFO:teuthology.orchestra.run.smithi172.stdout: "mds_mem": { 2023-07-14T18:29:41.821 INFO:teuthology.orchestra.run.smithi172.stdout: "ino": 1640, 2023-07-14T18:29:41.821 INFO:teuthology.orchestra.run.smithi172.stdout: "ino+": 1895, 2023-07-14T18:29:41.821 INFO:teuthology.orchestra.run.smithi172.stdout: "ino-": 255, 2023-07-14T18:29:41.821 INFO:teuthology.orchestra.run.smithi172.stdout: "dir": 213, 2023-07-14T18:29:41.821 INFO:teuthology.orchestra.run.smithi172.stdout: "dir+": 333, 2023-07-14T18:29:41.822 INFO:teuthology.orchestra.run.smithi172.stdout: "dir-": 120, 2023-07-14T18:29:41.822 INFO:teuthology.orchestra.run.smithi172.stdout: "dn": 2149, 2023-07-14T18:29:41.822 INFO:teuthology.orchestra.run.smithi172.stdout: "dn+": 2471, 2023-07-14T18:29:41.822 INFO:teuthology.orchestra.run.smithi172.stdout: "dn-": 322, 2023-07-14T18:29:41.822 INFO:teuthology.orchestra.run.smithi172.stdout: "cap": 1610, 2023-07-14T18:29:41.823 INFO:teuthology.orchestra.run.smithi172.stdout: "cap+": 1860, 2023-07-14T18:29:41.823 INFO:teuthology.orchestra.run.smithi172.stdout: "cap-": 250, 2023-07-14T18:29:41.823 INFO:teuthology.orchestra.run.smithi172.stdout: "rss": 65740, 2023-07-14T18:29:41.823 INFO:teuthology.orchestra.run.smithi172.stdout: "heap": 198960 2023-07-14T18:29:41.823 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-07-14T18:29:41.823 INFO:teuthology.orchestra.run.smithi172.stdout: "mds_server": { 2023-07-14T18:29:41.824 INFO:teuthology.orchestra.run.smithi172.stdout: "dispatch_client_request": 13958, 2023-07-14T18:29:41.824 INFO:teuthology.orchestra.run.smithi172.stdout: "dispatch_server_request": 2, 2023-07-14T18:29:41.824 INFO:teuthology.orchestra.run.smithi172.stdout: "handle_client_request": 12396, 2023-07-14T18:29:41.825 INFO:teuthology.orchestra.run.smithi172.stdout: "handle_client_session": 17, 2023-07-14T18:29:41.825 INFO:teuthology.orchestra.run.smithi172.stdout: "handle_peer_request": 506, 2023-07-14T18:29:41.825 INFO:teuthology.orchestra.run.smithi172.stdout: "req_create_latency": { 2023-07-14T18:29:41.825 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 247, 2023-07-14T18:29:41.826 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.882902923, 2023-07-14T18:29:41.826 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.003574505 2023-07-14T18:29:41.826 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-07-14T18:29:41.826 INFO:teuthology.orchestra.run.smithi172.stdout: "req_getattr_latency": { 2023-07-14T18:29:41.826 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 4, 2023-07-14T18:29:41.827 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000869657, 2023-07-14T18:29:41.827 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000217414 2023-07-14T18:29:41.827 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-07-14T18:29:41.827 INFO:teuthology.orchestra.run.smithi172.stdout: "req_getfilelock_latency": { 2023-07-14T18:29:41.827 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2023-07-14T18:29:41.828 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2023-07-14T18:29:41.828 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2023-07-14T18:29:41.828 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-07-14T18:29:41.828 INFO:teuthology.orchestra.run.smithi172.stdout: "req_link_latency": { 2023-07-14T18:29:41.828 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2023-07-14T18:29:41.829 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2023-07-14T18:29:41.829 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2023-07-14T18:29:41.829 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-07-14T18:29:41.829 INFO:teuthology.orchestra.run.smithi172.stdout: "req_lookup_latency": { 2023-07-14T18:29:41.829 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 10415, 2023-07-14T18:29:41.830 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 2.439183170, 2023-07-14T18:29:41.830 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000234199 2023-07-14T18:29:41.830 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-07-14T18:29:41.830 INFO:teuthology.orchestra.run.smithi172.stdout: "req_lookuphash_latency": { 2023-07-14T18:29:41.830 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2023-07-14T18:29:41.831 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2023-07-14T18:29:41.831 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2023-07-14T18:29:41.831 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-07-14T18:29:41.831 INFO:teuthology.orchestra.run.smithi172.stdout: "req_lookupino_latency": { 2023-07-14T18:29:41.831 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2023-07-14T18:29:41.831 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2023-07-14T18:29:41.832 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2023-07-14T18:29:41.832 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-07-14T18:29:41.832 INFO:teuthology.orchestra.run.smithi172.stdout: "req_lookupname_latency": { 2023-07-14T18:29:41.832 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2023-07-14T18:29:41.832 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2023-07-14T18:29:41.833 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2023-07-14T18:29:41.833 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-07-14T18:29:41.833 INFO:teuthology.orchestra.run.smithi172.stdout: "req_lookupparent_latency": { 2023-07-14T18:29:41.833 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2023-07-14T18:29:41.833 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2023-07-14T18:29:41.834 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2023-07-14T18:29:41.834 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-07-14T18:29:41.834 INFO:teuthology.orchestra.run.smithi172.stdout: "req_lookupsnap_latency": { 2023-07-14T18:29:41.834 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2023-07-14T18:29:41.834 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2023-07-14T18:29:41.834 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2023-07-14T18:29:41.835 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-07-14T18:29:41.835 INFO:teuthology.orchestra.run.smithi172.stdout: "req_lssnap_latency": { 2023-07-14T18:29:41.835 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2023-07-14T18:29:41.835 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2023-07-14T18:29:41.836 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2023-07-14T18:29:41.836 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-07-14T18:29:41.836 INFO:teuthology.orchestra.run.smithi172.stdout: "req_mkdir_latency": { 2023-07-14T18:29:41.837 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2023-07-14T18:29:41.837 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2023-07-14T18:29:41.837 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2023-07-14T18:29:41.837 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-07-14T18:29:41.837 INFO:teuthology.orchestra.run.smithi172.stdout: "req_mknod_latency": { 2023-07-14T18:29:41.838 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2023-07-14T18:29:41.838 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2023-07-14T18:29:41.838 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2023-07-14T18:29:41.838 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-07-14T18:29:41.838 INFO:teuthology.orchestra.run.smithi172.stdout: "req_mksnap_latency": { 2023-07-14T18:29:41.839 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2023-07-14T18:29:41.839 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2023-07-14T18:29:41.839 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2023-07-14T18:29:41.839 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-07-14T18:29:41.839 INFO:teuthology.orchestra.run.smithi172.stdout: "req_open_latency": { 2023-07-14T18:29:41.839 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 3, 2023-07-14T18:29:41.840 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.001820168, 2023-07-14T18:29:41.840 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000606722 2023-07-14T18:29:41.840 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-07-14T18:29:41.840 INFO:teuthology.orchestra.run.smithi172.stdout: "req_readdir_latency": { 2023-07-14T18:29:41.840 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 4, 2023-07-14T18:29:41.841 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.004662780, 2023-07-14T18:29:41.841 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.001165695 2023-07-14T18:29:41.841 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-07-14T18:29:41.841 INFO:teuthology.orchestra.run.smithi172.stdout: "req_rename_latency": { 2023-07-14T18:29:41.841 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 3, 2023-07-14T18:29:41.842 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.009821096, 2023-07-14T18:29:41.842 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.003273698 2023-07-14T18:29:41.842 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-07-14T18:29:41.842 INFO:teuthology.orchestra.run.smithi172.stdout: "req_renamesnap_latency": { 2023-07-14T18:29:41.842 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2023-07-14T18:29:41.843 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2023-07-14T18:29:41.843 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2023-07-14T18:29:41.843 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-07-14T18:29:41.843 INFO:teuthology.orchestra.run.smithi172.stdout: "req_snapdiff_latency": { 2023-07-14T18:29:41.843 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2023-07-14T18:29:41.843 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2023-07-14T18:29:41.844 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2023-07-14T18:29:41.844 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-07-14T18:29:41.844 INFO:teuthology.orchestra.run.smithi172.stdout: "req_rmdir_latency": { 2023-07-14T18:29:41.844 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2023-07-14T18:29:41.844 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2023-07-14T18:29:41.845 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2023-07-14T18:29:41.845 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-07-14T18:29:41.845 INFO:teuthology.orchestra.run.smithi172.stdout: "req_rmsnap_latency": { 2023-07-14T18:29:41.845 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2023-07-14T18:29:41.846 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2023-07-14T18:29:41.846 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2023-07-14T18:29:41.846 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-07-14T18:29:41.846 INFO:teuthology.orchestra.run.smithi172.stdout: "req_rmxattr_latency": { 2023-07-14T18:29:41.847 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2023-07-14T18:29:41.847 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2023-07-14T18:29:41.847 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2023-07-14T18:29:41.847 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-07-14T18:29:41.847 INFO:teuthology.orchestra.run.smithi172.stdout: "req_setattr_latency": { 2023-07-14T18:29:41.848 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2023-07-14T18:29:41.848 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2023-07-14T18:29:41.848 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2023-07-14T18:29:41.848 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-07-14T18:29:41.848 INFO:teuthology.orchestra.run.smithi172.stdout: "req_setdirlayout_latency": { 2023-07-14T18:29:41.849 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2023-07-14T18:29:41.849 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2023-07-14T18:29:41.849 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2023-07-14T18:29:41.849 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-07-14T18:29:41.849 INFO:teuthology.orchestra.run.smithi172.stdout: "req_setfilelock_latency": { 2023-07-14T18:29:41.850 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2023-07-14T18:29:41.850 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2023-07-14T18:29:41.850 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2023-07-14T18:29:41.850 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-07-14T18:29:41.850 INFO:teuthology.orchestra.run.smithi172.stdout: "req_setlayout_latency": { 2023-07-14T18:29:41.851 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2023-07-14T18:29:41.851 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2023-07-14T18:29:41.851 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2023-07-14T18:29:41.851 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-07-14T18:29:41.851 INFO:teuthology.orchestra.run.smithi172.stdout: "req_setxattr_latency": { 2023-07-14T18:29:41.852 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2023-07-14T18:29:41.852 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2023-07-14T18:29:41.852 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2023-07-14T18:29:41.852 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-07-14T18:29:41.852 INFO:teuthology.orchestra.run.smithi172.stdout: "req_symlink_latency": { 2023-07-14T18:29:41.852 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2023-07-14T18:29:41.853 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2023-07-14T18:29:41.853 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2023-07-14T18:29:41.853 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-07-14T18:29:41.853 INFO:teuthology.orchestra.run.smithi172.stdout: "req_unlink_latency": { 2023-07-14T18:29:41.853 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 248, 2023-07-14T18:29:41.854 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 1.057935262, 2023-07-14T18:29:41.854 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.004265867 2023-07-14T18:29:41.854 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-07-14T18:29:41.854 INFO:teuthology.orchestra.run.smithi172.stdout: "cap_revoke_eviction": 0, 2023-07-14T18:29:41.854 INFO:teuthology.orchestra.run.smithi172.stdout: "cap_acquisition_throttle": 0, 2023-07-14T18:29:41.855 INFO:teuthology.orchestra.run.smithi172.stdout: "req_getvxattr_latency": { 2023-07-14T18:29:41.855 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2023-07-14T18:29:41.855 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2023-07-14T18:29:41.855 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2023-07-14T18:29:41.855 INFO:teuthology.orchestra.run.smithi172.stdout: } 2023-07-14T18:29:41.856 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-07-14T18:29:41.856 INFO:teuthology.orchestra.run.smithi172.stdout: "mds_sessions": { 2023-07-14T18:29:41.856 INFO:teuthology.orchestra.run.smithi172.stdout: "session_count": 1, 2023-07-14T18:29:41.856 INFO:teuthology.orchestra.run.smithi172.stdout: "session_add": 2, 2023-07-14T18:29:41.857 INFO:teuthology.orchestra.run.smithi172.stdout: "session_remove": 1, 2023-07-14T18:29:41.857 INFO:teuthology.orchestra.run.smithi172.stdout: "sessions_open": 1, 2023-07-14T18:29:41.857 INFO:teuthology.orchestra.run.smithi172.stdout: "sessions_stale": 0, 2023-07-14T18:29:41.857 INFO:teuthology.orchestra.run.smithi172.stdout: "total_load": 9407, 2023-07-14T18:29:41.858 INFO:teuthology.orchestra.run.smithi172.stdout: "average_load": 9407, 2023-07-14T18:29:41.858 INFO:teuthology.orchestra.run.smithi172.stdout: "avg_session_uptime": 1013 2023-07-14T18:29:41.858 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-07-14T18:29:41.858 INFO:teuthology.orchestra.run.smithi172.stdout: "mempool": { 2023-07-14T18:29:41.858 INFO:teuthology.orchestra.run.smithi172.stdout: "bloom_filter_bytes": 0, 2023-07-14T18:29:41.859 INFO:teuthology.orchestra.run.smithi172.stdout: "bloom_filter_items": 0, 2023-07-14T18:29:41.859 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_alloc_bytes": 0, 2023-07-14T18:29:41.859 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_alloc_items": 0, 2023-07-14T18:29:41.859 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_cache_data_bytes": 0, 2023-07-14T18:29:41.859 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_cache_data_items": 0, 2023-07-14T18:29:41.859 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_cache_onode_bytes": 0, 2023-07-14T18:29:41.860 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_cache_onode_items": 0, 2023-07-14T18:29:41.860 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_cache_meta_bytes": 0, 2023-07-14T18:29:41.860 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_cache_meta_items": 0, 2023-07-14T18:29:41.860 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_cache_other_bytes": 0, 2023-07-14T18:29:41.860 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_cache_other_items": 0, 2023-07-14T18:29:41.861 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_cache_buffer_bytes": 0, 2023-07-14T18:29:41.861 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_cache_buffer_items": 0, 2023-07-14T18:29:41.861 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_extent_bytes": 0, 2023-07-14T18:29:41.861 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_extent_items": 0, 2023-07-14T18:29:41.861 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_blob_bytes": 0, 2023-07-14T18:29:41.862 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_blob_items": 0, 2023-07-14T18:29:41.862 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_shared_blob_bytes": 0, 2023-07-14T18:29:41.862 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_shared_blob_items": 0, 2023-07-14T18:29:41.862 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_inline_bl_bytes": 0, 2023-07-14T18:29:41.862 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_inline_bl_items": 0, 2023-07-14T18:29:41.863 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_fsck_bytes": 0, 2023-07-14T18:29:41.863 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_fsck_items": 0, 2023-07-14T18:29:41.863 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_txc_bytes": 0, 2023-07-14T18:29:41.863 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_txc_items": 0, 2023-07-14T18:29:41.863 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_writing_deferred_bytes": 0, 2023-07-14T18:29:41.863 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_writing_deferred_items": 0, 2023-07-14T18:29:41.864 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_writing_bytes": 0, 2023-07-14T18:29:41.864 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_writing_items": 0, 2023-07-14T18:29:41.864 INFO:teuthology.orchestra.run.smithi172.stdout: "bluefs_bytes": 0, 2023-07-14T18:29:41.864 INFO:teuthology.orchestra.run.smithi172.stdout: "bluefs_items": 0, 2023-07-14T18:29:41.864 INFO:teuthology.orchestra.run.smithi172.stdout: "bluefs_file_reader_bytes": 0, 2023-07-14T18:29:41.865 INFO:teuthology.orchestra.run.smithi172.stdout: "bluefs_file_reader_items": 0, 2023-07-14T18:29:41.865 INFO:teuthology.orchestra.run.smithi172.stdout: "bluefs_file_writer_bytes": 0, 2023-07-14T18:29:41.865 INFO:teuthology.orchestra.run.smithi172.stdout: "bluefs_file_writer_items": 0, 2023-07-14T18:29:41.865 INFO:teuthology.orchestra.run.smithi172.stdout: "buffer_anon_bytes": 313318, 2023-07-14T18:29:41.865 INFO:teuthology.orchestra.run.smithi172.stdout: "buffer_anon_items": 126, 2023-07-14T18:29:41.866 INFO:teuthology.orchestra.run.smithi172.stdout: "buffer_meta_bytes": 0, 2023-07-14T18:29:41.866 INFO:teuthology.orchestra.run.smithi172.stdout: "buffer_meta_items": 0, 2023-07-14T18:29:41.866 INFO:teuthology.orchestra.run.smithi172.stdout: "osd_bytes": 0, 2023-07-14T18:29:41.866 INFO:teuthology.orchestra.run.smithi172.stdout: "osd_items": 0, 2023-07-14T18:29:41.867 INFO:teuthology.orchestra.run.smithi172.stdout: "osd_mapbl_bytes": 0, 2023-07-14T18:29:41.867 INFO:teuthology.orchestra.run.smithi172.stdout: "osd_mapbl_items": 0, 2023-07-14T18:29:41.867 INFO:teuthology.orchestra.run.smithi172.stdout: "osd_pglog_bytes": 0, 2023-07-14T18:29:41.867 INFO:teuthology.orchestra.run.smithi172.stdout: "osd_pglog_items": 0, 2023-07-14T18:29:41.868 INFO:teuthology.orchestra.run.smithi172.stdout: "osdmap_bytes": 8792, 2023-07-14T18:29:41.868 INFO:teuthology.orchestra.run.smithi172.stdout: "osdmap_items": 168, 2023-07-14T18:29:41.868 INFO:teuthology.orchestra.run.smithi172.stdout: "osdmap_mapping_bytes": 0, 2023-07-14T18:29:41.868 INFO:teuthology.orchestra.run.smithi172.stdout: "osdmap_mapping_items": 0, 2023-07-14T18:29:41.868 INFO:teuthology.orchestra.run.smithi172.stdout: "pgmap_bytes": 0, 2023-07-14T18:29:41.869 INFO:teuthology.orchestra.run.smithi172.stdout: "pgmap_items": 0, 2023-07-14T18:29:41.869 INFO:teuthology.orchestra.run.smithi172.stdout: "mds_co_bytes": 5884141, 2023-07-14T18:29:41.869 INFO:teuthology.orchestra.run.smithi172.stdout: "mds_co_items": 33143, 2023-07-14T18:29:41.869 INFO:teuthology.orchestra.run.smithi172.stdout: "unittest_1_bytes": 0, 2023-07-14T18:29:41.869 INFO:teuthology.orchestra.run.smithi172.stdout: "unittest_1_items": 0, 2023-07-14T18:29:41.870 INFO:teuthology.orchestra.run.smithi172.stdout: "unittest_2_bytes": 0, 2023-07-14T18:29:41.870 INFO:teuthology.orchestra.run.smithi172.stdout: "unittest_2_items": 0 2023-07-14T18:29:41.870 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-07-14T18:29:41.870 INFO:teuthology.orchestra.run.smithi172.stdout: "objecter": { 2023-07-14T18:29:41.870 INFO:teuthology.orchestra.run.smithi172.stdout: "op_active": 0, 2023-07-14T18:29:41.870 INFO:teuthology.orchestra.run.smithi172.stdout: "op_laggy": 0, 2023-07-14T18:29:41.871 INFO:teuthology.orchestra.run.smithi172.stdout: "op_send": 1764, 2023-07-14T18:29:41.871 INFO:teuthology.orchestra.run.smithi172.stdout: "op_send_bytes": 12819669, 2023-07-14T18:29:41.871 INFO:teuthology.orchestra.run.smithi172.stdout: "op_resend": 28, 2023-07-14T18:29:41.871 INFO:teuthology.orchestra.run.smithi172.stdout: "op_reply": 1764, 2023-07-14T18:29:41.871 INFO:teuthology.orchestra.run.smithi172.stdout: "op_latency": { 2023-07-14T18:29:41.872 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 1764, 2023-07-14T18:29:41.872 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 3.620915870, 2023-07-14T18:29:41.872 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.002052673 2023-07-14T18:29:41.872 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-07-14T18:29:41.872 INFO:teuthology.orchestra.run.smithi172.stdout: "op_inflight": 0, 2023-07-14T18:29:41.873 INFO:teuthology.orchestra.run.smithi172.stdout: "oplen_avg": { 2023-07-14T18:29:41.873 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 1764, 2023-07-14T18:29:41.873 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 1808 2023-07-14T18:29:41.873 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-07-14T18:29:41.873 INFO:teuthology.orchestra.run.smithi172.stdout: "op": 1764, 2023-07-14T18:29:41.874 INFO:teuthology.orchestra.run.smithi172.stdout: "op_r": 513, 2023-07-14T18:29:41.874 INFO:teuthology.orchestra.run.smithi172.stdout: "op_w": 1251, 2023-07-14T18:29:41.874 INFO:teuthology.orchestra.run.smithi172.stdout: "op_rmw": 0, 2023-07-14T18:29:41.874 INFO:teuthology.orchestra.run.smithi172.stdout: "op_pg": 0, 2023-07-14T18:29:41.874 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_stat": 0, 2023-07-14T18:29:41.875 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_create": 10, 2023-07-14T18:29:41.875 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_read": 67, 2023-07-14T18:29:41.876 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_write": 648, 2023-07-14T18:29:41.876 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_writefull": 50, 2023-07-14T18:29:41.876 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_writesame": 0, 2023-07-14T18:29:41.876 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_append": 0, 2023-07-14T18:29:41.876 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_zero": 0, 2023-07-14T18:29:41.877 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_truncate": 0, 2023-07-14T18:29:41.877 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_delete": 515, 2023-07-14T18:29:41.877 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_mapext": 0, 2023-07-14T18:29:41.877 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_sparse_read": 0, 2023-07-14T18:29:41.877 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_clonerange": 0, 2023-07-14T18:29:41.878 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_getxattr": 446, 2023-07-14T18:29:41.878 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_setxattr": 20, 2023-07-14T18:29:41.878 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_cmpxattr": 0, 2023-07-14T18:29:41.878 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_rmxattr": 0, 2023-07-14T18:29:41.878 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_resetxattrs": 0, 2023-07-14T18:29:41.879 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_call": 0, 2023-07-14T18:29:41.879 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_watch": 0, 2023-07-14T18:29:41.879 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_notify": 0, 2023-07-14T18:29:41.879 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_src_cmpxattr": 0, 2023-07-14T18:29:41.879 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_pgls": 0, 2023-07-14T18:29:41.879 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_pgls_filter": 0, 2023-07-14T18:29:41.880 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_other": 0, 2023-07-14T18:29:41.880 INFO:teuthology.orchestra.run.smithi172.stdout: "linger_active": 0, 2023-07-14T18:29:41.880 INFO:teuthology.orchestra.run.smithi172.stdout: "linger_send": 0, 2023-07-14T18:29:41.880 INFO:teuthology.orchestra.run.smithi172.stdout: "linger_resend": 0, 2023-07-14T18:29:41.880 INFO:teuthology.orchestra.run.smithi172.stdout: "linger_ping": 0, 2023-07-14T18:29:41.881 INFO:teuthology.orchestra.run.smithi172.stdout: "poolop_active": 0, 2023-07-14T18:29:41.881 INFO:teuthology.orchestra.run.smithi172.stdout: "poolop_send": 0, 2023-07-14T18:29:41.881 INFO:teuthology.orchestra.run.smithi172.stdout: "poolop_resend": 0, 2023-07-14T18:29:41.881 INFO:teuthology.orchestra.run.smithi172.stdout: "poolstat_active": 0, 2023-07-14T18:29:41.881 INFO:teuthology.orchestra.run.smithi172.stdout: "poolstat_send": 0, 2023-07-14T18:29:41.882 INFO:teuthology.orchestra.run.smithi172.stdout: "poolstat_resend": 0, 2023-07-14T18:29:41.882 INFO:teuthology.orchestra.run.smithi172.stdout: "statfs_active": 0, 2023-07-14T18:29:41.882 INFO:teuthology.orchestra.run.smithi172.stdout: "statfs_send": 0, 2023-07-14T18:29:41.882 INFO:teuthology.orchestra.run.smithi172.stdout: "statfs_resend": 0, 2023-07-14T18:29:41.882 INFO:teuthology.orchestra.run.smithi172.stdout: "command_active": 0, 2023-07-14T18:29:41.883 INFO:teuthology.orchestra.run.smithi172.stdout: "command_send": 0, 2023-07-14T18:29:41.883 INFO:teuthology.orchestra.run.smithi172.stdout: "command_resend": 0, 2023-07-14T18:29:41.883 INFO:teuthology.orchestra.run.smithi172.stdout: "map_epoch": 88, 2023-07-14T18:29:41.883 INFO:teuthology.orchestra.run.smithi172.stdout: "map_full": 0, 2023-07-14T18:29:41.883 INFO:teuthology.orchestra.run.smithi172.stdout: "map_inc": 4, 2023-07-14T18:29:41.883 INFO:teuthology.orchestra.run.smithi172.stdout: "osd_sessions": 12, 2023-07-14T18:29:41.884 INFO:teuthology.orchestra.run.smithi172.stdout: "osd_session_open": 12, 2023-07-14T18:29:41.884 INFO:teuthology.orchestra.run.smithi172.stdout: "osd_session_close": 0, 2023-07-14T18:29:41.884 INFO:teuthology.orchestra.run.smithi172.stdout: "osd_laggy": 0, 2023-07-14T18:29:41.884 INFO:teuthology.orchestra.run.smithi172.stdout: "omap_wr": 42, 2023-07-14T18:29:41.884 INFO:teuthology.orchestra.run.smithi172.stdout: "omap_rd": 0, 2023-07-14T18:29:41.885 INFO:teuthology.orchestra.run.smithi172.stdout: "omap_del": 10 2023-07-14T18:29:41.885 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-07-14T18:29:41.885 INFO:teuthology.orchestra.run.smithi172.stdout: "oft": { 2023-07-14T18:29:41.885 INFO:teuthology.orchestra.run.smithi172.stdout: "omap_total_objs": 1, 2023-07-14T18:29:41.885 INFO:teuthology.orchestra.run.smithi172.stdout: "omap_total_kv_pairs": 0, 2023-07-14T18:29:41.886 INFO:teuthology.orchestra.run.smithi172.stdout: "omap_total_updates": 0, 2023-07-14T18:29:41.886 INFO:teuthology.orchestra.run.smithi172.stdout: "omap_total_removes": 0 2023-07-14T18:29:41.886 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-07-14T18:29:41.886 INFO:teuthology.orchestra.run.smithi172.stdout: "osd-slow-ops": { 2023-07-14T18:29:41.886 INFO:teuthology.orchestra.run.smithi172.stdout: "slow_ops_count": 0 2023-07-14T18:29:41.887 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-07-14T18:29:41.887 INFO:teuthology.orchestra.run.smithi172.stdout: "purge_queue": { 2023-07-14T18:29:41.887 INFO:teuthology.orchestra.run.smithi172.stdout: "pq_executing_ops": 0, 2023-07-14T18:29:41.887 INFO:teuthology.orchestra.run.smithi172.stdout: "pq_executing_ops_high_water": 10, 2023-07-14T18:29:41.887 INFO:teuthology.orchestra.run.smithi172.stdout: "pq_executing": 0, 2023-07-14T18:29:41.888 INFO:teuthology.orchestra.run.smithi172.stdout: "pq_executing_high_water": 5, 2023-07-14T18:29:41.888 INFO:teuthology.orchestra.run.smithi172.stdout: "pq_executed": 250, 2023-07-14T18:29:41.888 INFO:teuthology.orchestra.run.smithi172.stdout: "pq_item_in_journal": 0 2023-07-14T18:29:41.888 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-07-14T18:29:41.888 INFO:teuthology.orchestra.run.smithi172.stdout: "throttle-msgr_dispatch_throttler-mds": { 2023-07-14T18:29:41.889 INFO:teuthology.orchestra.run.smithi172.stdout: "val": 68, 2023-07-14T18:29:41.889 INFO:teuthology.orchestra.run.smithi172.stdout: "max": 104857600, 2023-07-14T18:29:41.889 INFO:teuthology.orchestra.run.smithi172.stdout: "get_started": 0, 2023-07-14T18:29:41.889 INFO:teuthology.orchestra.run.smithi172.stdout: "get": 14135439, 2023-07-14T18:29:41.889 INFO:teuthology.orchestra.run.smithi172.stdout: "get_sum": 1001815237, 2023-07-14T18:29:41.890 INFO:teuthology.orchestra.run.smithi172.stdout: "get_or_fail_fail": 0, 2023-07-14T18:29:41.890 INFO:teuthology.orchestra.run.smithi172.stdout: "get_or_fail_success": 14135439, 2023-07-14T18:29:41.890 INFO:teuthology.orchestra.run.smithi172.stdout: "take": 0, 2023-07-14T18:29:41.890 INFO:teuthology.orchestra.run.smithi172.stdout: "take_sum": 0, 2023-07-14T18:29:41.890 INFO:teuthology.orchestra.run.smithi172.stdout: "put": 14135438, 2023-07-14T18:29:41.890 INFO:teuthology.orchestra.run.smithi172.stdout: "put_sum": 1001815169, 2023-07-14T18:29:41.891 INFO:teuthology.orchestra.run.smithi172.stdout: "wait": { 2023-07-14T18:29:41.891 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2023-07-14T18:29:41.891 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2023-07-14T18:29:41.891 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2023-07-14T18:29:41.891 INFO:teuthology.orchestra.run.smithi172.stdout: } 2023-07-14T18:29:41.892 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-07-14T18:29:41.892 INFO:teuthology.orchestra.run.smithi172.stdout: "throttle-objecter_bytes": { 2023-07-14T18:29:41.892 INFO:teuthology.orchestra.run.smithi172.stdout: "val": 0, 2023-07-14T18:29:41.892 INFO:teuthology.orchestra.run.smithi172.stdout: "max": 104857600, 2023-07-14T18:29:41.892 INFO:teuthology.orchestra.run.smithi172.stdout: "get_started": 0, 2023-07-14T18:29:41.893 INFO:teuthology.orchestra.run.smithi172.stdout: "get": 0, 2023-07-14T18:29:41.893 INFO:teuthology.orchestra.run.smithi172.stdout: "get_sum": 0, 2023-07-14T18:29:41.893 INFO:teuthology.orchestra.run.smithi172.stdout: "get_or_fail_fail": 0, 2023-07-14T18:29:41.893 INFO:teuthology.orchestra.run.smithi172.stdout: "get_or_fail_success": 0, 2023-07-14T18:29:41.893 INFO:teuthology.orchestra.run.smithi172.stdout: "take": 1764, 2023-07-14T18:29:41.894 INFO:teuthology.orchestra.run.smithi172.stdout: "take_sum": 12846919, 2023-07-14T18:29:41.894 INFO:teuthology.orchestra.run.smithi172.stdout: "put": 1764, 2023-07-14T18:29:41.894 INFO:teuthology.orchestra.run.smithi172.stdout: "put_sum": 12846919, 2023-07-14T18:29:41.894 INFO:teuthology.orchestra.run.smithi172.stdout: "wait": { 2023-07-14T18:29:41.894 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2023-07-14T18:29:41.895 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2023-07-14T18:29:41.895 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2023-07-14T18:29:41.895 INFO:teuthology.orchestra.run.smithi172.stdout: } 2023-07-14T18:29:41.895 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-07-14T18:29:41.895 INFO:teuthology.orchestra.run.smithi172.stdout: "throttle-objecter_ops": { 2023-07-14T18:29:41.895 INFO:teuthology.orchestra.run.smithi172.stdout: "val": 0, 2023-07-14T18:29:41.896 INFO:teuthology.orchestra.run.smithi172.stdout: "max": 1024, 2023-07-14T18:29:41.896 INFO:teuthology.orchestra.run.smithi172.stdout: "get_started": 0, 2023-07-14T18:29:41.896 INFO:teuthology.orchestra.run.smithi172.stdout: "get": 0, 2023-07-14T18:29:41.896 INFO:teuthology.orchestra.run.smithi172.stdout: "get_sum": 0, 2023-07-14T18:29:41.896 INFO:teuthology.orchestra.run.smithi172.stdout: "get_or_fail_fail": 0, 2023-07-14T18:29:41.897 INFO:teuthology.orchestra.run.smithi172.stdout: "get_or_fail_success": 0, 2023-07-14T18:29:41.897 INFO:teuthology.orchestra.run.smithi172.stdout: "take": 1764, 2023-07-14T18:29:41.897 INFO:teuthology.orchestra.run.smithi172.stdout: "take_sum": 1764, 2023-07-14T18:29:41.897 INFO:teuthology.orchestra.run.smithi172.stdout: "put": 1764, 2023-07-14T18:29:41.897 INFO:teuthology.orchestra.run.smithi172.stdout: "put_sum": 1764, 2023-07-14T18:29:41.898 INFO:teuthology.orchestra.run.smithi172.stdout: "wait": { 2023-07-14T18:29:41.898 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2023-07-14T18:29:41.898 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2023-07-14T18:29:41.898 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2023-07-14T18:29:41.898 INFO:teuthology.orchestra.run.smithi172.stdout: } 2023-07-14T18:29:41.898 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-07-14T18:29:41.899 INFO:teuthology.orchestra.run.smithi172.stdout: "throttle-write_buf_throttle": { 2023-07-14T18:29:41.899 INFO:teuthology.orchestra.run.smithi172.stdout: "val": 0, 2023-07-14T18:29:41.899 INFO:teuthology.orchestra.run.smithi172.stdout: "max": 3758096384, 2023-07-14T18:29:41.899 INFO:teuthology.orchestra.run.smithi172.stdout: "get_started": 0, 2023-07-14T18:29:41.899 INFO:teuthology.orchestra.run.smithi172.stdout: "get": 250, 2023-07-14T18:29:41.900 INFO:teuthology.orchestra.run.smithi172.stdout: "get_sum": 27250, 2023-07-14T18:29:41.900 INFO:teuthology.orchestra.run.smithi172.stdout: "get_or_fail_fail": 0, 2023-07-14T18:29:41.900 INFO:teuthology.orchestra.run.smithi172.stdout: "get_or_fail_success": 250, 2023-07-14T18:29:41.900 INFO:teuthology.orchestra.run.smithi172.stdout: "take": 0, 2023-07-14T18:29:41.900 INFO:teuthology.orchestra.run.smithi172.stdout: "take_sum": 0, 2023-07-14T18:29:41.901 INFO:teuthology.orchestra.run.smithi172.stdout: "put": 67, 2023-07-14T18:29:41.901 INFO:teuthology.orchestra.run.smithi172.stdout: "put_sum": 27250, 2023-07-14T18:29:41.901 INFO:teuthology.orchestra.run.smithi172.stdout: "wait": { 2023-07-14T18:29:41.901 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2023-07-14T18:29:41.901 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2023-07-14T18:29:41.902 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2023-07-14T18:29:41.902 INFO:teuthology.orchestra.run.smithi172.stdout: } 2023-07-14T18:29:41.902 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-07-14T18:29:41.902 INFO:teuthology.orchestra.run.smithi172.stdout: "throttle-write_buf_throttle-0x564dc2bfe0a0": { 2023-07-14T18:29:41.902 INFO:teuthology.orchestra.run.smithi172.stdout: "val": 0, 2023-07-14T18:29:41.903 INFO:teuthology.orchestra.run.smithi172.stdout: "max": 3758096384, 2023-07-14T18:29:41.903 INFO:teuthology.orchestra.run.smithi172.stdout: "get_started": 0, 2023-07-14T18:29:41.903 INFO:teuthology.orchestra.run.smithi172.stdout: "get": 17273, 2023-07-14T18:29:41.903 INFO:teuthology.orchestra.run.smithi172.stdout: "get_sum": 12749820, 2023-07-14T18:29:41.903 INFO:teuthology.orchestra.run.smithi172.stdout: "get_or_fail_fail": 0, 2023-07-14T18:29:41.904 INFO:teuthology.orchestra.run.smithi172.stdout: "get_or_fail_success": 17273, 2023-07-14T18:29:41.904 INFO:teuthology.orchestra.run.smithi172.stdout: "take": 0, 2023-07-14T18:29:41.904 INFO:teuthology.orchestra.run.smithi172.stdout: "take_sum": 0, 2023-07-14T18:29:41.904 INFO:teuthology.orchestra.run.smithi172.stdout: "put": 581, 2023-07-14T18:29:41.904 INFO:teuthology.orchestra.run.smithi172.stdout: "put_sum": 12749820, 2023-07-14T18:29:41.904 INFO:teuthology.orchestra.run.smithi172.stdout: "wait": { 2023-07-14T18:29:41.905 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2023-07-14T18:29:41.905 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2023-07-14T18:29:41.905 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2023-07-14T18:29:41.905 INFO:teuthology.orchestra.run.smithi172.stdout: } 2023-07-14T18:29:41.905 INFO:teuthology.orchestra.run.smithi172.stdout: } 2023-07-14T18:29:41.906 INFO:teuthology.orchestra.run.smithi172.stdout:} 2023-07-14T18:29:42.195 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:29:42 smithi172 ceph-mon[97983]: pgmap v811: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 9 op/s 2023-07-14T18:29:42.416 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:29:42 smithi184 ceph-mon[98481]: pgmap v811: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 9 op/s 2023-07-14T18:29:42.458 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:29:42 smithi163 ceph-mon[96576]: pgmap v811: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 9 op/s 2023-07-14T18:29:43.488 INFO:tasks.check_counter:Daemon mds.h mds.exported=0 2023-07-14T18:29:43.488 INFO:tasks.check_counter:Daemon mds.h mds.imported=46 2023-07-14T18:29:43.489 INFO:tasks.check_counter:Daemon mds.h mds_cache.dir_update=81 2023-07-14T18:29:43.489 INFO:tasks.check_counter:Daemon mds.h mds_cache.dir_update_receipt=409 2023-07-14T18:29:43.489 INFO:tasks.check_counter:Daemon mds.h mds.dir_split=0 2023-07-14T18:29:43.489 DEBUG:tasks.check_counter:Getting stats from k 2023-07-14T18:29:43.490 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81c9387d2e7576da065747ec9c16d1c7d69016ec shell --fsid bf7326ec-2270-11ee-9b33-001a4aab830c -- ceph daemon mds.k perf dump 2023-07-14T18:29:44.097 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/bf7326ec-2270-11ee-9b33-001a4aab830c/mon.b/config 2023-07-14T18:29:44.861 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:29:44 smithi172 ceph-mon[97983]: pgmap v812: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2023-07-14T18:29:45.166 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:29:44 smithi184 ceph-mon[98481]: pgmap v812: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2023-07-14T18:29:45.208 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:29:44 smithi163 ceph-mon[96576]: pgmap v812: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2023-07-14T18:29:45.381 INFO:teuthology.orchestra.run.smithi172.stdout:{ 2023-07-14T18:29:45.382 INFO:teuthology.orchestra.run.smithi172.stdout: "AsyncMessenger::Worker-0": { 2023-07-14T18:29:45.382 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_recv_messages": 1008, 2023-07-14T18:29:45.382 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_messages": 1010, 2023-07-14T18:29:45.382 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_recv_bytes": 4446303, 2023-07-14T18:29:45.383 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_bytes": 313552, 2023-07-14T18:29:45.383 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_created_connections": 8, 2023-07-14T18:29:45.383 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_active_connections": 3, 2023-07-14T18:29:45.383 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_total_time": 0.073921098, 2023-07-14T18:29:45.383 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_send_time": 0.018785845, 2023-07-14T18:29:45.384 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_recv_time": 0.018340303, 2023-07-14T18:29:45.384 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_fast_dispatch_time": 0.029766220, 2023-07-14T18:29:45.384 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_messages_queue_lat": { 2023-07-14T18:29:45.384 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 1008, 2023-07-14T18:29:45.384 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.030310013, 2023-07-14T18:29:45.385 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000030069 2023-07-14T18:29:45.385 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-07-14T18:29:45.385 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_handle_ack_lat": { 2023-07-14T18:29:45.385 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2023-07-14T18:29:45.385 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2023-07-14T18:29:45.386 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2023-07-14T18:29:45.386 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-07-14T18:29:45.386 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_recv_encrypted_bytes": 0, 2023-07-14T18:29:45.386 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_encrypted_bytes": 0 2023-07-14T18:29:45.386 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-07-14T18:29:45.386 INFO:teuthology.orchestra.run.smithi172.stdout: "AsyncMessenger::Worker-1": { 2023-07-14T18:29:45.387 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_recv_messages": 1039, 2023-07-14T18:29:45.387 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_messages": 1268, 2023-07-14T18:29:45.387 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_recv_bytes": 4631256, 2023-07-14T18:29:45.387 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_bytes": 871860, 2023-07-14T18:29:45.387 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_created_connections": 6, 2023-07-14T18:29:45.388 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_active_connections": 4, 2023-07-14T18:29:45.388 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_total_time": 0.075616442, 2023-07-14T18:29:45.388 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_send_time": 0.024512434, 2023-07-14T18:29:45.388 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_recv_time": 0.019524503, 2023-07-14T18:29:45.388 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_fast_dispatch_time": 0.024007676, 2023-07-14T18:29:45.389 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_messages_queue_lat": { 2023-07-14T18:29:45.389 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 1267, 2023-07-14T18:29:45.389 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.032316448, 2023-07-14T18:29:45.389 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000025506 2023-07-14T18:29:45.389 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-07-14T18:29:45.389 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_handle_ack_lat": { 2023-07-14T18:29:45.390 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2023-07-14T18:29:45.390 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2023-07-14T18:29:45.390 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2023-07-14T18:29:45.390 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-07-14T18:29:45.390 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_recv_encrypted_bytes": 3280, 2023-07-14T18:29:45.391 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_encrypted_bytes": 550592 2023-07-14T18:29:45.391 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-07-14T18:29:45.391 INFO:teuthology.orchestra.run.smithi172.stdout: "AsyncMessenger::Worker-2": { 2023-07-14T18:29:45.391 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_recv_messages": 1558, 2023-07-14T18:29:45.391 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_messages": 1541, 2023-07-14T18:29:45.392 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_recv_bytes": 5194628, 2023-07-14T18:29:45.392 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_bytes": 557453, 2023-07-14T18:29:45.392 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_created_connections": 4, 2023-07-14T18:29:45.392 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_active_connections": 3, 2023-07-14T18:29:45.392 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_total_time": 0.135166055, 2023-07-14T18:29:45.392 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_send_time": 0.039912716, 2023-07-14T18:29:45.393 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_recv_time": 0.040935804, 2023-07-14T18:29:45.393 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_fast_dispatch_time": 0.045409971, 2023-07-14T18:29:45.393 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_messages_queue_lat": { 2023-07-14T18:29:45.393 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 1540, 2023-07-14T18:29:45.393 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.043740140, 2023-07-14T18:29:45.394 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000028402 2023-07-14T18:29:45.394 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-07-14T18:29:45.394 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_handle_ack_lat": { 2023-07-14T18:29:45.394 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2023-07-14T18:29:45.395 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2023-07-14T18:29:45.395 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2023-07-14T18:29:45.395 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-07-14T18:29:45.395 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_recv_encrypted_bytes": 598224, 2023-07-14T18:29:45.395 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_encrypted_bytes": 175856 2023-07-14T18:29:45.396 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-07-14T18:29:45.396 INFO:teuthology.orchestra.run.smithi172.stdout: "cct": { 2023-07-14T18:29:45.396 INFO:teuthology.orchestra.run.smithi172.stdout: "total_workers": 1, 2023-07-14T18:29:45.396 INFO:teuthology.orchestra.run.smithi172.stdout: "unhealthy_workers": 0 2023-07-14T18:29:45.396 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-07-14T18:29:45.396 INFO:teuthology.orchestra.run.smithi172.stdout: "finisher-MDSRank": { 2023-07-14T18:29:45.397 INFO:teuthology.orchestra.run.smithi172.stdout: "queue_len": 0, 2023-07-14T18:29:45.397 INFO:teuthology.orchestra.run.smithi172.stdout: "complete_latency": { 2023-07-14T18:29:45.397 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 5474, 2023-07-14T18:29:45.397 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.147253239, 2023-07-14T18:29:45.397 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000026900 2023-07-14T18:29:45.398 INFO:teuthology.orchestra.run.smithi172.stdout: } 2023-07-14T18:29:45.398 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-07-14T18:29:45.398 INFO:teuthology.orchestra.run.smithi172.stdout: "finisher-PurgeQueue": { 2023-07-14T18:29:45.398 INFO:teuthology.orchestra.run.smithi172.stdout: "queue_len": 0, 2023-07-14T18:29:45.398 INFO:teuthology.orchestra.run.smithi172.stdout: "complete_latency": { 2023-07-14T18:29:45.399 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2023-07-14T18:29:45.399 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2023-07-14T18:29:45.399 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2023-07-14T18:29:45.399 INFO:teuthology.orchestra.run.smithi172.stdout: } 2023-07-14T18:29:45.399 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-07-14T18:29:45.399 INFO:teuthology.orchestra.run.smithi172.stdout: "mds": { 2023-07-14T18:29:45.400 INFO:teuthology.orchestra.run.smithi172.stdout: "request": 0, 2023-07-14T18:29:45.400 INFO:teuthology.orchestra.run.smithi172.stdout: "reply": 0, 2023-07-14T18:29:45.400 INFO:teuthology.orchestra.run.smithi172.stdout: "reply_latency": { 2023-07-14T18:29:45.400 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2023-07-14T18:29:45.400 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2023-07-14T18:29:45.401 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2023-07-14T18:29:45.401 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-07-14T18:29:45.401 INFO:teuthology.orchestra.run.smithi172.stdout: "slow_reply": 0, 2023-07-14T18:29:45.401 INFO:teuthology.orchestra.run.smithi172.stdout: "forward": 0, 2023-07-14T18:29:45.401 INFO:teuthology.orchestra.run.smithi172.stdout: "dir_fetch_complete": 0, 2023-07-14T18:29:45.402 INFO:teuthology.orchestra.run.smithi172.stdout: "dir_fetch_keys": 0, 2023-07-14T18:29:45.402 INFO:teuthology.orchestra.run.smithi172.stdout: "dir_commit": 0, 2023-07-14T18:29:45.402 INFO:teuthology.orchestra.run.smithi172.stdout: "dir_split": 0, 2023-07-14T18:29:45.402 INFO:teuthology.orchestra.run.smithi172.stdout: "dir_merge": 0, 2023-07-14T18:29:45.402 INFO:teuthology.orchestra.run.smithi172.stdout: "inodes": 2375, 2023-07-14T18:29:45.403 INFO:teuthology.orchestra.run.smithi172.stdout: "inodes_top": 0, 2023-07-14T18:29:45.403 INFO:teuthology.orchestra.run.smithi172.stdout: "inodes_bottom": 0, 2023-07-14T18:29:45.403 INFO:teuthology.orchestra.run.smithi172.stdout: "inodes_pin_tail": 2375, 2023-07-14T18:29:45.403 INFO:teuthology.orchestra.run.smithi172.stdout: "inodes_pinned": 2375, 2023-07-14T18:29:45.403 INFO:teuthology.orchestra.run.smithi172.stdout: "inodes_expired": 1, 2023-07-14T18:29:45.403 INFO:teuthology.orchestra.run.smithi172.stdout: "inodes_with_caps": 0, 2023-07-14T18:29:45.404 INFO:teuthology.orchestra.run.smithi172.stdout: "caps": 0, 2023-07-14T18:29:45.404 INFO:teuthology.orchestra.run.smithi172.stdout: "subtrees": 89, 2023-07-14T18:29:45.404 INFO:teuthology.orchestra.run.smithi172.stdout: "traverse": 0, 2023-07-14T18:29:45.404 INFO:teuthology.orchestra.run.smithi172.stdout: "traverse_hit": 0, 2023-07-14T18:29:45.404 INFO:teuthology.orchestra.run.smithi172.stdout: "traverse_forward": 0, 2023-07-14T18:29:45.405 INFO:teuthology.orchestra.run.smithi172.stdout: "traverse_discover": 0, 2023-07-14T18:29:45.405 INFO:teuthology.orchestra.run.smithi172.stdout: "traverse_dir_fetch": 0, 2023-07-14T18:29:45.405 INFO:teuthology.orchestra.run.smithi172.stdout: "traverse_remote_ino": 0, 2023-07-14T18:29:45.405 INFO:teuthology.orchestra.run.smithi172.stdout: "traverse_lock": 0, 2023-07-14T18:29:45.405 INFO:teuthology.orchestra.run.smithi172.stdout: "load_cent": 0, 2023-07-14T18:29:45.406 INFO:teuthology.orchestra.run.smithi172.stdout: "q": 0, 2023-07-14T18:29:45.406 INFO:teuthology.orchestra.run.smithi172.stdout: "exported": 0, 2023-07-14T18:29:45.406 INFO:teuthology.orchestra.run.smithi172.stdout: "exported_inodes": 0, 2023-07-14T18:29:45.406 INFO:teuthology.orchestra.run.smithi172.stdout: "imported": 0, 2023-07-14T18:29:45.406 INFO:teuthology.orchestra.run.smithi172.stdout: "imported_inodes": 0, 2023-07-14T18:29:45.406 INFO:teuthology.orchestra.run.smithi172.stdout: "openino_dir_fetch": 0, 2023-07-14T18:29:45.407 INFO:teuthology.orchestra.run.smithi172.stdout: "openino_backtrace_fetch": 0, 2023-07-14T18:29:45.407 INFO:teuthology.orchestra.run.smithi172.stdout: "openino_peer_discover": 0, 2023-07-14T18:29:45.407 INFO:teuthology.orchestra.run.smithi172.stdout: "root_rfiles": 0, 2023-07-14T18:29:45.407 INFO:teuthology.orchestra.run.smithi172.stdout: "root_rbytes": 0, 2023-07-14T18:29:45.407 INFO:teuthology.orchestra.run.smithi172.stdout: "root_rsnaps": 0, 2023-07-14T18:29:45.408 INFO:teuthology.orchestra.run.smithi172.stdout: "scrub_backtrace_fetch": 0, 2023-07-14T18:29:45.408 INFO:teuthology.orchestra.run.smithi172.stdout: "scrub_set_tag": 0, 2023-07-14T18:29:45.408 INFO:teuthology.orchestra.run.smithi172.stdout: "scrub_backtrace_repaired": 0, 2023-07-14T18:29:45.408 INFO:teuthology.orchestra.run.smithi172.stdout: "scrub_inotable_repaired": 0, 2023-07-14T18:29:45.408 INFO:teuthology.orchestra.run.smithi172.stdout: "scrub_dir_inodes": 0, 2023-07-14T18:29:45.409 INFO:teuthology.orchestra.run.smithi172.stdout: "scrub_dir_base_inodes": 0, 2023-07-14T18:29:45.409 INFO:teuthology.orchestra.run.smithi172.stdout: "scrub_dirfrag_rstats": 0, 2023-07-14T18:29:45.409 INFO:teuthology.orchestra.run.smithi172.stdout: "scrub_file_inodes": 0, 2023-07-14T18:29:45.409 INFO:teuthology.orchestra.run.smithi172.stdout: "handle_inode_file_caps": 0, 2023-07-14T18:29:45.409 INFO:teuthology.orchestra.run.smithi172.stdout: "ceph_cap_op_revoke": 0, 2023-07-14T18:29:45.410 INFO:teuthology.orchestra.run.smithi172.stdout: "ceph_cap_op_grant": 0, 2023-07-14T18:29:45.410 INFO:teuthology.orchestra.run.smithi172.stdout: "ceph_cap_op_trunc": 0, 2023-07-14T18:29:45.410 INFO:teuthology.orchestra.run.smithi172.stdout: "ceph_cap_op_flushsnap_ack": 0, 2023-07-14T18:29:45.410 INFO:teuthology.orchestra.run.smithi172.stdout: "ceph_cap_op_flush_ack": 0, 2023-07-14T18:29:45.410 INFO:teuthology.orchestra.run.smithi172.stdout: "handle_client_caps": 0, 2023-07-14T18:29:45.410 INFO:teuthology.orchestra.run.smithi172.stdout: "handle_client_caps_dirty": 0, 2023-07-14T18:29:45.411 INFO:teuthology.orchestra.run.smithi172.stdout: "handle_client_cap_release": 0, 2023-07-14T18:29:45.411 INFO:teuthology.orchestra.run.smithi172.stdout: "process_request_cap_release": 0 2023-07-14T18:29:45.411 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-07-14T18:29:45.411 INFO:teuthology.orchestra.run.smithi172.stdout: "mds_cache": { 2023-07-14T18:29:45.411 INFO:teuthology.orchestra.run.smithi172.stdout: "dir_update": 0, 2023-07-14T18:29:45.412 INFO:teuthology.orchestra.run.smithi172.stdout: "dir_update_receipt": 0, 2023-07-14T18:29:45.412 INFO:teuthology.orchestra.run.smithi172.stdout: "dir_try_discover": 0, 2023-07-14T18:29:45.412 INFO:teuthology.orchestra.run.smithi172.stdout: "dir_send_discover": 0, 2023-07-14T18:29:45.412 INFO:teuthology.orchestra.run.smithi172.stdout: "dir_handle_discover": 0, 2023-07-14T18:29:45.412 INFO:teuthology.orchestra.run.smithi172.stdout: "num_strays": 0, 2023-07-14T18:29:45.413 INFO:teuthology.orchestra.run.smithi172.stdout: "num_strays_delayed": 0, 2023-07-14T18:29:45.413 INFO:teuthology.orchestra.run.smithi172.stdout: "num_strays_enqueuing": 0, 2023-07-14T18:29:45.413 INFO:teuthology.orchestra.run.smithi172.stdout: "strays_created": 0, 2023-07-14T18:29:45.413 INFO:teuthology.orchestra.run.smithi172.stdout: "strays_enqueued": 0, 2023-07-14T18:29:45.413 INFO:teuthology.orchestra.run.smithi172.stdout: "strays_reintegrated": 0, 2023-07-14T18:29:45.414 INFO:teuthology.orchestra.run.smithi172.stdout: "strays_migrated": 0, 2023-07-14T18:29:45.414 INFO:teuthology.orchestra.run.smithi172.stdout: "num_recovering_processing": 0, 2023-07-14T18:29:45.414 INFO:teuthology.orchestra.run.smithi172.stdout: "num_recovering_enqueued": 0, 2023-07-14T18:29:45.414 INFO:teuthology.orchestra.run.smithi172.stdout: "num_recovering_prioritized": 0, 2023-07-14T18:29:45.414 INFO:teuthology.orchestra.run.smithi172.stdout: "recovery_started": 0, 2023-07-14T18:29:45.414 INFO:teuthology.orchestra.run.smithi172.stdout: "recovery_completed": 0, 2023-07-14T18:29:45.415 INFO:teuthology.orchestra.run.smithi172.stdout: "ireq_enqueue_scrub": 0, 2023-07-14T18:29:45.415 INFO:teuthology.orchestra.run.smithi172.stdout: "ireq_exportdir": 0, 2023-07-14T18:29:45.415 INFO:teuthology.orchestra.run.smithi172.stdout: "ireq_flush": 0, 2023-07-14T18:29:45.415 INFO:teuthology.orchestra.run.smithi172.stdout: "ireq_fragmentdir": 0, 2023-07-14T18:29:45.415 INFO:teuthology.orchestra.run.smithi172.stdout: "ireq_fragstats": 0, 2023-07-14T18:29:45.416 INFO:teuthology.orchestra.run.smithi172.stdout: "ireq_inodestats": 0 2023-07-14T18:29:45.416 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-07-14T18:29:45.416 INFO:teuthology.orchestra.run.smithi172.stdout: "mds_log": { 2023-07-14T18:29:45.416 INFO:teuthology.orchestra.run.smithi172.stdout: "evadd": 0, 2023-07-14T18:29:45.417 INFO:teuthology.orchestra.run.smithi172.stdout: "evex": 0, 2023-07-14T18:29:45.417 INFO:teuthology.orchestra.run.smithi172.stdout: "evtrm": 0, 2023-07-14T18:29:45.417 INFO:teuthology.orchestra.run.smithi172.stdout: "ev": 0, 2023-07-14T18:29:45.417 INFO:teuthology.orchestra.run.smithi172.stdout: "evexg": 0, 2023-07-14T18:29:45.417 INFO:teuthology.orchestra.run.smithi172.stdout: "evexd": 0, 2023-07-14T18:29:45.418 INFO:teuthology.orchestra.run.smithi172.stdout: "segadd": 0, 2023-07-14T18:29:45.418 INFO:teuthology.orchestra.run.smithi172.stdout: "segex": 0, 2023-07-14T18:29:45.418 INFO:teuthology.orchestra.run.smithi172.stdout: "segtrm": 0, 2023-07-14T18:29:45.418 INFO:teuthology.orchestra.run.smithi172.stdout: "seg": 21, 2023-07-14T18:29:45.418 INFO:teuthology.orchestra.run.smithi172.stdout: "segexg": 0, 2023-07-14T18:29:45.419 INFO:teuthology.orchestra.run.smithi172.stdout: "segexd": 0, 2023-07-14T18:29:45.419 INFO:teuthology.orchestra.run.smithi172.stdout: "expos": 4194304, 2023-07-14T18:29:45.419 INFO:teuthology.orchestra.run.smithi172.stdout: "wrpos": 0, 2023-07-14T18:29:45.419 INFO:teuthology.orchestra.run.smithi172.stdout: "rdpos": 16943087, 2023-07-14T18:29:45.419 INFO:teuthology.orchestra.run.smithi172.stdout: "jlat": { 2023-07-14T18:29:45.419 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2023-07-14T18:29:45.420 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2023-07-14T18:29:45.420 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2023-07-14T18:29:45.420 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-07-14T18:29:45.420 INFO:teuthology.orchestra.run.smithi172.stdout: "replayed": 17273 2023-07-14T18:29:45.420 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-07-14T18:29:45.421 INFO:teuthology.orchestra.run.smithi172.stdout: "mds_mem": { 2023-07-14T18:29:45.421 INFO:teuthology.orchestra.run.smithi172.stdout: "ino": 1627, 2023-07-14T18:29:45.421 INFO:teuthology.orchestra.run.smithi172.stdout: "ino+": 1877, 2023-07-14T18:29:45.421 INFO:teuthology.orchestra.run.smithi172.stdout: "ino-": 250, 2023-07-14T18:29:45.421 INFO:teuthology.orchestra.run.smithi172.stdout: "dir": 198, 2023-07-14T18:29:45.422 INFO:teuthology.orchestra.run.smithi172.stdout: "dir+": 198, 2023-07-14T18:29:45.422 INFO:teuthology.orchestra.run.smithi172.stdout: "dir-": 0, 2023-07-14T18:29:45.422 INFO:teuthology.orchestra.run.smithi172.stdout: "dn": 2375, 2023-07-14T18:29:45.422 INFO:teuthology.orchestra.run.smithi172.stdout: "dn+": 2376, 2023-07-14T18:29:45.422 INFO:teuthology.orchestra.run.smithi172.stdout: "dn-": 1, 2023-07-14T18:29:45.423 INFO:teuthology.orchestra.run.smithi172.stdout: "cap": 0, 2023-07-14T18:29:45.423 INFO:teuthology.orchestra.run.smithi172.stdout: "cap+": 0, 2023-07-14T18:29:45.423 INFO:teuthology.orchestra.run.smithi172.stdout: "cap-": 0, 2023-07-14T18:29:45.423 INFO:teuthology.orchestra.run.smithi172.stdout: "rss": 54716, 2023-07-14T18:29:45.423 INFO:teuthology.orchestra.run.smithi172.stdout: "heap": 207152 2023-07-14T18:29:45.423 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-07-14T18:29:45.424 INFO:teuthology.orchestra.run.smithi172.stdout: "mds_server": { 2023-07-14T18:29:45.424 INFO:teuthology.orchestra.run.smithi172.stdout: "dispatch_client_request": 0, 2023-07-14T18:29:45.424 INFO:teuthology.orchestra.run.smithi172.stdout: "dispatch_server_request": 0, 2023-07-14T18:29:45.424 INFO:teuthology.orchestra.run.smithi172.stdout: "handle_client_request": 0, 2023-07-14T18:29:45.424 INFO:teuthology.orchestra.run.smithi172.stdout: "handle_client_session": 0, 2023-07-14T18:29:45.425 INFO:teuthology.orchestra.run.smithi172.stdout: "handle_peer_request": 0, 2023-07-14T18:29:45.425 INFO:teuthology.orchestra.run.smithi172.stdout: "req_create_latency": { 2023-07-14T18:29:45.425 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2023-07-14T18:29:45.425 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2023-07-14T18:29:45.425 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2023-07-14T18:29:45.426 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-07-14T18:29:45.426 INFO:teuthology.orchestra.run.smithi172.stdout: "req_getattr_latency": { 2023-07-14T18:29:45.426 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2023-07-14T18:29:45.426 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2023-07-14T18:29:45.426 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2023-07-14T18:29:45.427 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-07-14T18:29:45.427 INFO:teuthology.orchestra.run.smithi172.stdout: "req_getfilelock_latency": { 2023-07-14T18:29:45.427 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2023-07-14T18:29:45.427 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2023-07-14T18:29:45.427 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2023-07-14T18:29:45.428 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-07-14T18:29:45.428 INFO:teuthology.orchestra.run.smithi172.stdout: "req_link_latency": { 2023-07-14T18:29:45.428 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2023-07-14T18:29:45.428 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2023-07-14T18:29:45.428 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2023-07-14T18:29:45.428 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-07-14T18:29:45.429 INFO:teuthology.orchestra.run.smithi172.stdout: "req_lookup_latency": { 2023-07-14T18:29:45.429 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2023-07-14T18:29:45.429 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2023-07-14T18:29:45.429 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2023-07-14T18:29:45.429 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-07-14T18:29:45.430 INFO:teuthology.orchestra.run.smithi172.stdout: "req_lookuphash_latency": { 2023-07-14T18:29:45.430 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2023-07-14T18:29:45.430 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2023-07-14T18:29:45.430 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2023-07-14T18:29:45.430 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-07-14T18:29:45.431 INFO:teuthology.orchestra.run.smithi172.stdout: "req_lookupino_latency": { 2023-07-14T18:29:45.431 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2023-07-14T18:29:45.431 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2023-07-14T18:29:45.431 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2023-07-14T18:29:45.431 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-07-14T18:29:45.432 INFO:teuthology.orchestra.run.smithi172.stdout: "req_lookupname_latency": { 2023-07-14T18:29:45.432 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2023-07-14T18:29:45.432 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2023-07-14T18:29:45.432 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2023-07-14T18:29:45.432 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-07-14T18:29:45.432 INFO:teuthology.orchestra.run.smithi172.stdout: "req_lookupparent_latency": { 2023-07-14T18:29:45.433 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2023-07-14T18:29:45.433 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2023-07-14T18:29:45.433 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2023-07-14T18:29:45.433 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-07-14T18:29:45.433 INFO:teuthology.orchestra.run.smithi172.stdout: "req_lookupsnap_latency": { 2023-07-14T18:29:45.434 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2023-07-14T18:29:45.434 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2023-07-14T18:29:45.434 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2023-07-14T18:29:45.434 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-07-14T18:29:45.434 INFO:teuthology.orchestra.run.smithi172.stdout: "req_lssnap_latency": { 2023-07-14T18:29:45.435 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2023-07-14T18:29:45.435 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2023-07-14T18:29:45.435 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2023-07-14T18:29:45.435 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-07-14T18:29:45.435 INFO:teuthology.orchestra.run.smithi172.stdout: "req_mkdir_latency": { 2023-07-14T18:29:45.436 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2023-07-14T18:29:45.436 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2023-07-14T18:29:45.436 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2023-07-14T18:29:45.436 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-07-14T18:29:45.436 INFO:teuthology.orchestra.run.smithi172.stdout: "req_mknod_latency": { 2023-07-14T18:29:45.437 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2023-07-14T18:29:45.437 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2023-07-14T18:29:45.437 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2023-07-14T18:29:45.437 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-07-14T18:29:45.437 INFO:teuthology.orchestra.run.smithi172.stdout: "req_mksnap_latency": { 2023-07-14T18:29:45.437 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2023-07-14T18:29:45.438 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2023-07-14T18:29:45.438 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2023-07-14T18:29:45.438 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-07-14T18:29:45.438 INFO:teuthology.orchestra.run.smithi172.stdout: "req_open_latency": { 2023-07-14T18:29:45.438 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2023-07-14T18:29:45.439 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2023-07-14T18:29:45.439 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2023-07-14T18:29:45.439 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-07-14T18:29:45.439 INFO:teuthology.orchestra.run.smithi172.stdout: "req_readdir_latency": { 2023-07-14T18:29:45.439 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2023-07-14T18:29:45.440 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2023-07-14T18:29:45.440 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2023-07-14T18:29:45.440 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-07-14T18:29:45.440 INFO:teuthology.orchestra.run.smithi172.stdout: "req_rename_latency": { 2023-07-14T18:29:45.440 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2023-07-14T18:29:45.440 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2023-07-14T18:29:45.441 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2023-07-14T18:29:45.441 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-07-14T18:29:45.441 INFO:teuthology.orchestra.run.smithi172.stdout: "req_renamesnap_latency": { 2023-07-14T18:29:45.441 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2023-07-14T18:29:45.441 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2023-07-14T18:29:45.442 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2023-07-14T18:29:45.442 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-07-14T18:29:45.442 INFO:teuthology.orchestra.run.smithi172.stdout: "req_snapdiff_latency": { 2023-07-14T18:29:45.442 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2023-07-14T18:29:45.442 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2023-07-14T18:29:45.443 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2023-07-14T18:29:45.443 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-07-14T18:29:45.443 INFO:teuthology.orchestra.run.smithi172.stdout: "req_rmdir_latency": { 2023-07-14T18:29:45.443 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2023-07-14T18:29:45.443 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2023-07-14T18:29:45.444 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2023-07-14T18:29:45.444 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-07-14T18:29:45.444 INFO:teuthology.orchestra.run.smithi172.stdout: "req_rmsnap_latency": { 2023-07-14T18:29:45.444 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2023-07-14T18:29:45.444 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2023-07-14T18:29:45.445 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2023-07-14T18:29:45.445 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-07-14T18:29:45.445 INFO:teuthology.orchestra.run.smithi172.stdout: "req_rmxattr_latency": { 2023-07-14T18:29:45.445 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2023-07-14T18:29:45.445 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2023-07-14T18:29:45.446 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2023-07-14T18:29:45.446 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-07-14T18:29:45.446 INFO:teuthology.orchestra.run.smithi172.stdout: "req_setattr_latency": { 2023-07-14T18:29:45.446 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2023-07-14T18:29:45.446 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2023-07-14T18:29:45.446 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2023-07-14T18:29:45.447 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-07-14T18:29:45.447 INFO:teuthology.orchestra.run.smithi172.stdout: "req_setdirlayout_latency": { 2023-07-14T18:29:45.447 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2023-07-14T18:29:45.447 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2023-07-14T18:29:45.447 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2023-07-14T18:29:45.448 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-07-14T18:29:45.448 INFO:teuthology.orchestra.run.smithi172.stdout: "req_setfilelock_latency": { 2023-07-14T18:29:45.448 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2023-07-14T18:29:45.448 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2023-07-14T18:29:45.448 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2023-07-14T18:29:45.449 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-07-14T18:29:45.449 INFO:teuthology.orchestra.run.smithi172.stdout: "req_setlayout_latency": { 2023-07-14T18:29:45.449 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2023-07-14T18:29:45.449 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2023-07-14T18:29:45.449 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2023-07-14T18:29:45.450 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-07-14T18:29:45.450 INFO:teuthology.orchestra.run.smithi172.stdout: "req_setxattr_latency": { 2023-07-14T18:29:45.450 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2023-07-14T18:29:45.450 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2023-07-14T18:29:45.450 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2023-07-14T18:29:45.450 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-07-14T18:29:45.451 INFO:teuthology.orchestra.run.smithi172.stdout: "req_symlink_latency": { 2023-07-14T18:29:45.451 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2023-07-14T18:29:45.451 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2023-07-14T18:29:45.451 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2023-07-14T18:29:45.451 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-07-14T18:29:45.452 INFO:teuthology.orchestra.run.smithi172.stdout: "req_unlink_latency": { 2023-07-14T18:29:45.452 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2023-07-14T18:29:45.452 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2023-07-14T18:29:45.452 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2023-07-14T18:29:45.452 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-07-14T18:29:45.453 INFO:teuthology.orchestra.run.smithi172.stdout: "cap_revoke_eviction": 0, 2023-07-14T18:29:45.453 INFO:teuthology.orchestra.run.smithi172.stdout: "cap_acquisition_throttle": 0, 2023-07-14T18:29:45.453 INFO:teuthology.orchestra.run.smithi172.stdout: "req_getvxattr_latency": { 2023-07-14T18:29:45.453 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2023-07-14T18:29:45.453 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2023-07-14T18:29:45.454 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2023-07-14T18:29:45.454 INFO:teuthology.orchestra.run.smithi172.stdout: } 2023-07-14T18:29:45.454 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-07-14T18:29:45.454 INFO:teuthology.orchestra.run.smithi172.stdout: "mds_sessions": { 2023-07-14T18:29:45.454 INFO:teuthology.orchestra.run.smithi172.stdout: "session_count": 1, 2023-07-14T18:29:45.454 INFO:teuthology.orchestra.run.smithi172.stdout: "session_add": 2, 2023-07-14T18:29:45.455 INFO:teuthology.orchestra.run.smithi172.stdout: "session_remove": 1, 2023-07-14T18:29:45.455 INFO:teuthology.orchestra.run.smithi172.stdout: "sessions_open": 1, 2023-07-14T18:29:45.455 INFO:teuthology.orchestra.run.smithi172.stdout: "sessions_stale": 0, 2023-07-14T18:29:45.455 INFO:teuthology.orchestra.run.smithi172.stdout: "total_load": 0, 2023-07-14T18:29:45.455 INFO:teuthology.orchestra.run.smithi172.stdout: "average_load": 0, 2023-07-14T18:29:45.456 INFO:teuthology.orchestra.run.smithi172.stdout: "avg_session_uptime": 2633 2023-07-14T18:29:45.456 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-07-14T18:29:45.456 INFO:teuthology.orchestra.run.smithi172.stdout: "mempool": { 2023-07-14T18:29:45.456 INFO:teuthology.orchestra.run.smithi172.stdout: "bloom_filter_bytes": 0, 2023-07-14T18:29:45.456 INFO:teuthology.orchestra.run.smithi172.stdout: "bloom_filter_items": 0, 2023-07-14T18:29:45.457 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_alloc_bytes": 0, 2023-07-14T18:29:45.457 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_alloc_items": 0, 2023-07-14T18:29:45.457 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_cache_data_bytes": 0, 2023-07-14T18:29:45.457 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_cache_data_items": 0, 2023-07-14T18:29:45.457 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_cache_onode_bytes": 0, 2023-07-14T18:29:45.457 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_cache_onode_items": 0, 2023-07-14T18:29:45.458 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_cache_meta_bytes": 0, 2023-07-14T18:29:45.458 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_cache_meta_items": 0, 2023-07-14T18:29:45.458 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_cache_other_bytes": 0, 2023-07-14T18:29:45.458 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_cache_other_items": 0, 2023-07-14T18:29:45.458 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_cache_buffer_bytes": 0, 2023-07-14T18:29:45.459 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_cache_buffer_items": 0, 2023-07-14T18:29:45.459 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_extent_bytes": 0, 2023-07-14T18:29:45.459 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_extent_items": 0, 2023-07-14T18:29:45.459 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_blob_bytes": 0, 2023-07-14T18:29:45.459 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_blob_items": 0, 2023-07-14T18:29:45.460 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_shared_blob_bytes": 0, 2023-07-14T18:29:45.460 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_shared_blob_items": 0, 2023-07-14T18:29:45.460 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_inline_bl_bytes": 0, 2023-07-14T18:29:45.460 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_inline_bl_items": 0, 2023-07-14T18:29:45.460 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_fsck_bytes": 0, 2023-07-14T18:29:45.461 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_fsck_items": 0, 2023-07-14T18:29:45.461 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_txc_bytes": 0, 2023-07-14T18:29:45.461 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_txc_items": 0, 2023-07-14T18:29:45.461 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_writing_deferred_bytes": 0, 2023-07-14T18:29:45.461 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_writing_deferred_items": 0, 2023-07-14T18:29:45.462 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_writing_bytes": 0, 2023-07-14T18:29:45.462 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_writing_items": 0, 2023-07-14T18:29:45.462 INFO:teuthology.orchestra.run.smithi172.stdout: "bluefs_bytes": 0, 2023-07-14T18:29:45.462 INFO:teuthology.orchestra.run.smithi172.stdout: "bluefs_items": 0, 2023-07-14T18:29:45.463 INFO:teuthology.orchestra.run.smithi172.stdout: "bluefs_file_reader_bytes": 0, 2023-07-14T18:29:45.463 INFO:teuthology.orchestra.run.smithi172.stdout: "bluefs_file_reader_items": 0, 2023-07-14T18:29:45.463 INFO:teuthology.orchestra.run.smithi172.stdout: "bluefs_file_writer_bytes": 0, 2023-07-14T18:29:45.463 INFO:teuthology.orchestra.run.smithi172.stdout: "bluefs_file_writer_items": 0, 2023-07-14T18:29:45.463 INFO:teuthology.orchestra.run.smithi172.stdout: "buffer_anon_bytes": 209711, 2023-07-14T18:29:45.464 INFO:teuthology.orchestra.run.smithi172.stdout: "buffer_anon_items": 67, 2023-07-14T18:29:45.464 INFO:teuthology.orchestra.run.smithi172.stdout: "buffer_meta_bytes": 0, 2023-07-14T18:29:45.464 INFO:teuthology.orchestra.run.smithi172.stdout: "buffer_meta_items": 0, 2023-07-14T18:29:45.464 INFO:teuthology.orchestra.run.smithi172.stdout: "osd_bytes": 0, 2023-07-14T18:29:45.464 INFO:teuthology.orchestra.run.smithi172.stdout: "osd_items": 0, 2023-07-14T18:29:45.465 INFO:teuthology.orchestra.run.smithi172.stdout: "osd_mapbl_bytes": 0, 2023-07-14T18:29:45.465 INFO:teuthology.orchestra.run.smithi172.stdout: "osd_mapbl_items": 0, 2023-07-14T18:29:45.465 INFO:teuthology.orchestra.run.smithi172.stdout: "osd_pglog_bytes": 0, 2023-07-14T18:29:45.465 INFO:teuthology.orchestra.run.smithi172.stdout: "osd_pglog_items": 0, 2023-07-14T18:29:45.465 INFO:teuthology.orchestra.run.smithi172.stdout: "osdmap_bytes": 8792, 2023-07-14T18:29:45.465 INFO:teuthology.orchestra.run.smithi172.stdout: "osdmap_items": 168, 2023-07-14T18:29:45.466 INFO:teuthology.orchestra.run.smithi172.stdout: "osdmap_mapping_bytes": 0, 2023-07-14T18:29:45.466 INFO:teuthology.orchestra.run.smithi172.stdout: "osdmap_mapping_items": 0, 2023-07-14T18:29:45.466 INFO:teuthology.orchestra.run.smithi172.stdout: "pgmap_bytes": 0, 2023-07-14T18:29:45.466 INFO:teuthology.orchestra.run.smithi172.stdout: "pgmap_items": 0, 2023-07-14T18:29:45.466 INFO:teuthology.orchestra.run.smithi172.stdout: "mds_co_bytes": 5279587, 2023-07-14T18:29:45.467 INFO:teuthology.orchestra.run.smithi172.stdout: "mds_co_items": 18798, 2023-07-14T18:29:45.467 INFO:teuthology.orchestra.run.smithi172.stdout: "unittest_1_bytes": 0, 2023-07-14T18:29:45.467 INFO:teuthology.orchestra.run.smithi172.stdout: "unittest_1_items": 0, 2023-07-14T18:29:45.467 INFO:teuthology.orchestra.run.smithi172.stdout: "unittest_2_bytes": 0, 2023-07-14T18:29:45.467 INFO:teuthology.orchestra.run.smithi172.stdout: "unittest_2_items": 0 2023-07-14T18:29:45.468 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-07-14T18:29:45.468 INFO:teuthology.orchestra.run.smithi172.stdout: "objecter": { 2023-07-14T18:29:45.468 INFO:teuthology.orchestra.run.smithi172.stdout: "op_active": 0, 2023-07-14T18:29:45.468 INFO:teuthology.orchestra.run.smithi172.stdout: "op_laggy": 0, 2023-07-14T18:29:45.468 INFO:teuthology.orchestra.run.smithi172.stdout: "op_send": 3268, 2023-07-14T18:29:45.469 INFO:teuthology.orchestra.run.smithi172.stdout: "op_send_bytes": 21, 2023-07-14T18:29:45.469 INFO:teuthology.orchestra.run.smithi172.stdout: "op_resend": 3, 2023-07-14T18:29:45.469 INFO:teuthology.orchestra.run.smithi172.stdout: "op_reply": 3268, 2023-07-14T18:29:45.469 INFO:teuthology.orchestra.run.smithi172.stdout: "op_latency": { 2023-07-14T18:29:45.469 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 3268, 2023-07-14T18:29:45.470 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 1.474967817, 2023-07-14T18:29:45.470 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000451336 2023-07-14T18:29:45.470 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-07-14T18:29:45.470 INFO:teuthology.orchestra.run.smithi172.stdout: "op_inflight": 0, 2023-07-14T18:29:45.470 INFO:teuthology.orchestra.run.smithi172.stdout: "oplen_avg": { 2023-07-14T18:29:45.470 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 3268, 2023-07-14T18:29:45.471 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 3269 2023-07-14T18:29:45.471 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-07-14T18:29:45.471 INFO:teuthology.orchestra.run.smithi172.stdout: "op": 3268, 2023-07-14T18:29:45.471 INFO:teuthology.orchestra.run.smithi172.stdout: "op_r": 3268, 2023-07-14T18:29:45.471 INFO:teuthology.orchestra.run.smithi172.stdout: "op_w": 0, 2023-07-14T18:29:45.472 INFO:teuthology.orchestra.run.smithi172.stdout: "op_rmw": 0, 2023-07-14T18:29:45.472 INFO:teuthology.orchestra.run.smithi172.stdout: "op_pg": 0, 2023-07-14T18:29:45.472 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_stat": 2115, 2023-07-14T18:29:45.472 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_create": 0, 2023-07-14T18:29:45.472 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_read": 1151, 2023-07-14T18:29:45.473 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_write": 0, 2023-07-14T18:29:45.473 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_writefull": 0, 2023-07-14T18:29:45.473 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_writesame": 0, 2023-07-14T18:29:45.473 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_append": 0, 2023-07-14T18:29:45.473 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_zero": 0, 2023-07-14T18:29:45.474 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_truncate": 0, 2023-07-14T18:29:45.474 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_delete": 0, 2023-07-14T18:29:45.474 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_mapext": 0, 2023-07-14T18:29:45.474 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_sparse_read": 0, 2023-07-14T18:29:45.474 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_clonerange": 0, 2023-07-14T18:29:45.474 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_getxattr": 1, 2023-07-14T18:29:45.475 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_setxattr": 0, 2023-07-14T18:29:45.475 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_cmpxattr": 0, 2023-07-14T18:29:45.475 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_rmxattr": 0, 2023-07-14T18:29:45.475 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_resetxattrs": 0, 2023-07-14T18:29:45.475 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_call": 0, 2023-07-14T18:29:45.476 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_watch": 0, 2023-07-14T18:29:45.476 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_notify": 0, 2023-07-14T18:29:45.476 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_src_cmpxattr": 0, 2023-07-14T18:29:45.476 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_pgls": 0, 2023-07-14T18:29:45.476 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_pgls_filter": 0, 2023-07-14T18:29:45.477 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_other": 0, 2023-07-14T18:29:45.477 INFO:teuthology.orchestra.run.smithi172.stdout: "linger_active": 0, 2023-07-14T18:29:45.477 INFO:teuthology.orchestra.run.smithi172.stdout: "linger_send": 0, 2023-07-14T18:29:45.477 INFO:teuthology.orchestra.run.smithi172.stdout: "linger_resend": 0, 2023-07-14T18:29:45.477 INFO:teuthology.orchestra.run.smithi172.stdout: "linger_ping": 0, 2023-07-14T18:29:45.478 INFO:teuthology.orchestra.run.smithi172.stdout: "poolop_active": 0, 2023-07-14T18:29:45.478 INFO:teuthology.orchestra.run.smithi172.stdout: "poolop_send": 0, 2023-07-14T18:29:45.478 INFO:teuthology.orchestra.run.smithi172.stdout: "poolop_resend": 0, 2023-07-14T18:29:45.478 INFO:teuthology.orchestra.run.smithi172.stdout: "poolstat_active": 0, 2023-07-14T18:29:45.478 INFO:teuthology.orchestra.run.smithi172.stdout: "poolstat_send": 0, 2023-07-14T18:29:45.479 INFO:teuthology.orchestra.run.smithi172.stdout: "poolstat_resend": 0, 2023-07-14T18:29:45.479 INFO:teuthology.orchestra.run.smithi172.stdout: "statfs_active": 0, 2023-07-14T18:29:45.479 INFO:teuthology.orchestra.run.smithi172.stdout: "statfs_send": 0, 2023-07-14T18:29:45.479 INFO:teuthology.orchestra.run.smithi172.stdout: "statfs_resend": 0, 2023-07-14T18:29:45.479 INFO:teuthology.orchestra.run.smithi172.stdout: "command_active": 0, 2023-07-14T18:29:45.479 INFO:teuthology.orchestra.run.smithi172.stdout: "command_send": 0, 2023-07-14T18:29:45.480 INFO:teuthology.orchestra.run.smithi172.stdout: "command_resend": 0, 2023-07-14T18:29:45.480 INFO:teuthology.orchestra.run.smithi172.stdout: "map_epoch": 88, 2023-07-14T18:29:45.480 INFO:teuthology.orchestra.run.smithi172.stdout: "map_full": 0, 2023-07-14T18:29:45.480 INFO:teuthology.orchestra.run.smithi172.stdout: "map_inc": 4, 2023-07-14T18:29:45.480 INFO:teuthology.orchestra.run.smithi172.stdout: "osd_sessions": 7, 2023-07-14T18:29:45.481 INFO:teuthology.orchestra.run.smithi172.stdout: "osd_session_open": 8, 2023-07-14T18:29:45.481 INFO:teuthology.orchestra.run.smithi172.stdout: "osd_session_close": 1, 2023-07-14T18:29:45.481 INFO:teuthology.orchestra.run.smithi172.stdout: "osd_laggy": 0, 2023-07-14T18:29:45.481 INFO:teuthology.orchestra.run.smithi172.stdout: "omap_wr": 0, 2023-07-14T18:29:45.481 INFO:teuthology.orchestra.run.smithi172.stdout: "omap_rd": 2, 2023-07-14T18:29:45.482 INFO:teuthology.orchestra.run.smithi172.stdout: "omap_del": 0 2023-07-14T18:29:45.482 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-07-14T18:29:45.482 INFO:teuthology.orchestra.run.smithi172.stdout: "oft": { 2023-07-14T18:29:45.482 INFO:teuthology.orchestra.run.smithi172.stdout: "omap_total_objs": 0, 2023-07-14T18:29:45.482 INFO:teuthology.orchestra.run.smithi172.stdout: "omap_total_kv_pairs": 0, 2023-07-14T18:29:45.482 INFO:teuthology.orchestra.run.smithi172.stdout: "omap_total_updates": 0, 2023-07-14T18:29:45.483 INFO:teuthology.orchestra.run.smithi172.stdout: "omap_total_removes": 0 2023-07-14T18:29:45.483 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-07-14T18:29:45.483 INFO:teuthology.orchestra.run.smithi172.stdout: "osd-slow-ops": { 2023-07-14T18:29:45.483 INFO:teuthology.orchestra.run.smithi172.stdout: "slow_ops_count": 0 2023-07-14T18:29:45.483 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-07-14T18:29:45.484 INFO:teuthology.orchestra.run.smithi172.stdout: "purge_queue": { 2023-07-14T18:29:45.484 INFO:teuthology.orchestra.run.smithi172.stdout: "pq_executing_ops": 0, 2023-07-14T18:29:45.484 INFO:teuthology.orchestra.run.smithi172.stdout: "pq_executing_ops_high_water": 0, 2023-07-14T18:29:45.484 INFO:teuthology.orchestra.run.smithi172.stdout: "pq_executing": 0, 2023-07-14T18:29:45.484 INFO:teuthology.orchestra.run.smithi172.stdout: "pq_executing_high_water": 0, 2023-07-14T18:29:45.485 INFO:teuthology.orchestra.run.smithi172.stdout: "pq_executed": 0, 2023-07-14T18:29:45.485 INFO:teuthology.orchestra.run.smithi172.stdout: "pq_item_in_journal": 0 2023-07-14T18:29:45.485 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-07-14T18:29:45.485 INFO:teuthology.orchestra.run.smithi172.stdout: "throttle-msgr_dispatch_throttler-mds": { 2023-07-14T18:29:45.485 INFO:teuthology.orchestra.run.smithi172.stdout: "val": 0, 2023-07-14T18:29:45.486 INFO:teuthology.orchestra.run.smithi172.stdout: "max": 104857600, 2023-07-14T18:29:45.486 INFO:teuthology.orchestra.run.smithi172.stdout: "get_started": 0, 2023-07-14T18:29:45.486 INFO:teuthology.orchestra.run.smithi172.stdout: "get": 3601, 2023-07-14T18:29:45.486 INFO:teuthology.orchestra.run.smithi172.stdout: "get_sum": 13928115, 2023-07-14T18:29:45.486 INFO:teuthology.orchestra.run.smithi172.stdout: "get_or_fail_fail": 0, 2023-07-14T18:29:45.486 INFO:teuthology.orchestra.run.smithi172.stdout: "get_or_fail_success": 3601, 2023-07-14T18:29:45.487 INFO:teuthology.orchestra.run.smithi172.stdout: "take": 0, 2023-07-14T18:29:45.487 INFO:teuthology.orchestra.run.smithi172.stdout: "take_sum": 0, 2023-07-14T18:29:45.487 INFO:teuthology.orchestra.run.smithi172.stdout: "put": 3601, 2023-07-14T18:29:45.487 INFO:teuthology.orchestra.run.smithi172.stdout: "put_sum": 13928115, 2023-07-14T18:29:45.487 INFO:teuthology.orchestra.run.smithi172.stdout: "wait": { 2023-07-14T18:29:45.488 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2023-07-14T18:29:45.488 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2023-07-14T18:29:45.488 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2023-07-14T18:29:45.488 INFO:teuthology.orchestra.run.smithi172.stdout: } 2023-07-14T18:29:45.488 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-07-14T18:29:45.489 INFO:teuthology.orchestra.run.smithi172.stdout: "throttle-objecter_bytes": { 2023-07-14T18:29:45.489 INFO:teuthology.orchestra.run.smithi172.stdout: "val": 0, 2023-07-14T18:29:45.489 INFO:teuthology.orchestra.run.smithi172.stdout: "max": 104857600, 2023-07-14T18:29:45.489 INFO:teuthology.orchestra.run.smithi172.stdout: "get_started": 0, 2023-07-14T18:29:45.489 INFO:teuthology.orchestra.run.smithi172.stdout: "get": 0, 2023-07-14T18:29:45.490 INFO:teuthology.orchestra.run.smithi172.stdout: "get_sum": 0, 2023-07-14T18:29:45.490 INFO:teuthology.orchestra.run.smithi172.stdout: "get_or_fail_fail": 0, 2023-07-14T18:29:45.490 INFO:teuthology.orchestra.run.smithi172.stdout: "get_or_fail_success": 0, 2023-07-14T18:29:45.490 INFO:teuthology.orchestra.run.smithi172.stdout: "take": 3268, 2023-07-14T18:29:45.490 INFO:teuthology.orchestra.run.smithi172.stdout: "take_sum": 12749825, 2023-07-14T18:29:45.490 INFO:teuthology.orchestra.run.smithi172.stdout: "put": 3268, 2023-07-14T18:29:45.491 INFO:teuthology.orchestra.run.smithi172.stdout: "put_sum": 12749825, 2023-07-14T18:29:45.491 INFO:teuthology.orchestra.run.smithi172.stdout: "wait": { 2023-07-14T18:29:45.491 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2023-07-14T18:29:45.491 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2023-07-14T18:29:45.491 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2023-07-14T18:29:45.492 INFO:teuthology.orchestra.run.smithi172.stdout: } 2023-07-14T18:29:45.492 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-07-14T18:29:45.492 INFO:teuthology.orchestra.run.smithi172.stdout: "throttle-objecter_ops": { 2023-07-14T18:29:45.492 INFO:teuthology.orchestra.run.smithi172.stdout: "val": 0, 2023-07-14T18:29:45.492 INFO:teuthology.orchestra.run.smithi172.stdout: "max": 1024, 2023-07-14T18:29:45.493 INFO:teuthology.orchestra.run.smithi172.stdout: "get_started": 0, 2023-07-14T18:29:45.493 INFO:teuthology.orchestra.run.smithi172.stdout: "get": 0, 2023-07-14T18:29:45.493 INFO:teuthology.orchestra.run.smithi172.stdout: "get_sum": 0, 2023-07-14T18:29:45.493 INFO:teuthology.orchestra.run.smithi172.stdout: "get_or_fail_fail": 0, 2023-07-14T18:29:45.493 INFO:teuthology.orchestra.run.smithi172.stdout: "get_or_fail_success": 0, 2023-07-14T18:29:45.494 INFO:teuthology.orchestra.run.smithi172.stdout: "take": 3268, 2023-07-14T18:29:45.494 INFO:teuthology.orchestra.run.smithi172.stdout: "take_sum": 3268, 2023-07-14T18:29:45.494 INFO:teuthology.orchestra.run.smithi172.stdout: "put": 3268, 2023-07-14T18:29:45.494 INFO:teuthology.orchestra.run.smithi172.stdout: "put_sum": 3268, 2023-07-14T18:29:45.494 INFO:teuthology.orchestra.run.smithi172.stdout: "wait": { 2023-07-14T18:29:45.495 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2023-07-14T18:29:45.495 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2023-07-14T18:29:45.495 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2023-07-14T18:29:45.495 INFO:teuthology.orchestra.run.smithi172.stdout: } 2023-07-14T18:29:45.495 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-07-14T18:29:45.496 INFO:teuthology.orchestra.run.smithi172.stdout: "throttle-write_buf_throttle": { 2023-07-14T18:29:45.496 INFO:teuthology.orchestra.run.smithi172.stdout: "val": 0, 2023-07-14T18:29:45.496 INFO:teuthology.orchestra.run.smithi172.stdout: "max": 3758096384, 2023-07-14T18:29:45.496 INFO:teuthology.orchestra.run.smithi172.stdout: "get_started": 0, 2023-07-14T18:29:45.496 INFO:teuthology.orchestra.run.smithi172.stdout: "get": 0, 2023-07-14T18:29:45.497 INFO:teuthology.orchestra.run.smithi172.stdout: "get_sum": 0, 2023-07-14T18:29:45.497 INFO:teuthology.orchestra.run.smithi172.stdout: "get_or_fail_fail": 0, 2023-07-14T18:29:45.497 INFO:teuthology.orchestra.run.smithi172.stdout: "get_or_fail_success": 0, 2023-07-14T18:29:45.497 INFO:teuthology.orchestra.run.smithi172.stdout: "take": 0, 2023-07-14T18:29:45.497 INFO:teuthology.orchestra.run.smithi172.stdout: "take_sum": 0, 2023-07-14T18:29:45.498 INFO:teuthology.orchestra.run.smithi172.stdout: "put": 0, 2023-07-14T18:29:45.498 INFO:teuthology.orchestra.run.smithi172.stdout: "put_sum": 0, 2023-07-14T18:29:45.498 INFO:teuthology.orchestra.run.smithi172.stdout: "wait": { 2023-07-14T18:29:45.498 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2023-07-14T18:29:45.498 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2023-07-14T18:29:45.499 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2023-07-14T18:29:45.499 INFO:teuthology.orchestra.run.smithi172.stdout: } 2023-07-14T18:29:45.499 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2023-07-14T18:29:45.499 INFO:teuthology.orchestra.run.smithi172.stdout: "throttle-write_buf_throttle-0x564e0fde4460": { 2023-07-14T18:29:45.499 INFO:teuthology.orchestra.run.smithi172.stdout: "val": 0, 2023-07-14T18:29:45.500 INFO:teuthology.orchestra.run.smithi172.stdout: "max": 3758096384, 2023-07-14T18:29:45.500 INFO:teuthology.orchestra.run.smithi172.stdout: "get_started": 0, 2023-07-14T18:29:45.500 INFO:teuthology.orchestra.run.smithi172.stdout: "get": 0, 2023-07-14T18:29:45.500 INFO:teuthology.orchestra.run.smithi172.stdout: "get_sum": 0, 2023-07-14T18:29:45.500 INFO:teuthology.orchestra.run.smithi172.stdout: "get_or_fail_fail": 0, 2023-07-14T18:29:45.501 INFO:teuthology.orchestra.run.smithi172.stdout: "get_or_fail_success": 0, 2023-07-14T18:29:45.501 INFO:teuthology.orchestra.run.smithi172.stdout: "take": 0, 2023-07-14T18:29:45.501 INFO:teuthology.orchestra.run.smithi172.stdout: "take_sum": 0, 2023-07-14T18:29:45.501 INFO:teuthology.orchestra.run.smithi172.stdout: "put": 0, 2023-07-14T18:29:45.501 INFO:teuthology.orchestra.run.smithi172.stdout: "put_sum": 0, 2023-07-14T18:29:45.502 INFO:teuthology.orchestra.run.smithi172.stdout: "wait": { 2023-07-14T18:29:45.502 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2023-07-14T18:29:45.502 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2023-07-14T18:29:45.502 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2023-07-14T18:29:45.502 INFO:teuthology.orchestra.run.smithi172.stdout: } 2023-07-14T18:29:45.502 INFO:teuthology.orchestra.run.smithi172.stdout: } 2023-07-14T18:29:45.503 INFO:teuthology.orchestra.run.smithi172.stdout:} 2023-07-14T18:29:46.994 INFO:tasks.check_counter:Daemon mds.k mds.exported=0 2023-07-14T18:29:46.994 INFO:tasks.check_counter:Daemon mds.k mds.imported=0 2023-07-14T18:29:46.995 INFO:tasks.check_counter:Daemon mds.k mds_cache.dir_update=0 2023-07-14T18:29:46.995 INFO:tasks.check_counter:Daemon mds.k mds_cache.dir_update_receipt=0 2023-07-14T18:29:46.995 INFO:tasks.check_counter:Daemon mds.k mds.dir_split=0 2023-07-14T18:29:46.995 DEBUG:tasks.check_counter:Getting stats from c 2023-07-14T18:29:46.996 DEBUG:teuthology.orchestra.run.smithi184:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81c9387d2e7576da065747ec9c16d1c7d69016ec shell --fsid bf7326ec-2270-11ee-9b33-001a4aab830c -- ceph daemon mds.c perf dump 2023-07-14T18:29:47.115 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:29:46 smithi184 ceph-mon[98481]: pgmap v813: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 9 op/s 2023-07-14T18:29:47.208 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:29:46 smithi163 ceph-mon[96576]: pgmap v813: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 9 op/s 2023-07-14T18:29:47.266 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:29:46 smithi172 ceph-mon[97983]: pgmap v813: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 9 op/s 2023-07-14T18:29:47.728 INFO:teuthology.orchestra.run.smithi184.stderr:Inferring config /var/lib/ceph/bf7326ec-2270-11ee-9b33-001a4aab830c/mon.c/config 2023-07-14T18:29:49.069 INFO:teuthology.orchestra.run.smithi184.stdout:{ 2023-07-14T18:29:49.070 INFO:teuthology.orchestra.run.smithi184.stdout: "AsyncMessenger::Worker-0": { 2023-07-14T18:29:49.070 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_recv_messages": 916781, 2023-07-14T18:29:49.070 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_send_messages": 911644, 2023-07-14T18:29:49.070 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_recv_bytes": 184578230, 2023-07-14T18:29:49.070 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_send_bytes": 155914657, 2023-07-14T18:29:49.071 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_created_connections": 10, 2023-07-14T18:29:49.071 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_active_connections": 4, 2023-07-14T18:29:49.071 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_running_total_time": 29.819635996, 2023-07-14T18:29:49.071 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_running_send_time": 11.136460871, 2023-07-14T18:29:49.071 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_running_recv_time": 22.017070814, 2023-07-14T18:29:49.072 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_running_fast_dispatch_time": 0.030864882, 2023-07-14T18:29:49.072 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_send_messages_queue_lat": { 2023-07-14T18:29:49.072 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 911645, 2023-07-14T18:29:49.072 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 9.038272368, 2023-07-14T18:29:49.072 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000009914 2023-07-14T18:29:49.073 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2023-07-14T18:29:49.073 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_handle_ack_lat": { 2023-07-14T18:29:49.073 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 1784678, 2023-07-14T18:29:49.073 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.190665799, 2023-07-14T18:29:49.073 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000106 2023-07-14T18:29:49.074 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2023-07-14T18:29:49.074 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_recv_encrypted_bytes": 604832, 2023-07-14T18:29:49.074 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_send_encrypted_bytes": 179936 2023-07-14T18:29:49.075 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2023-07-14T18:29:49.075 INFO:teuthology.orchestra.run.smithi184.stdout: "AsyncMessenger::Worker-1": { 2023-07-14T18:29:49.076 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_recv_messages": 9189765, 2023-07-14T18:29:49.076 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_send_messages": 9190013, 2023-07-14T18:29:49.076 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_recv_bytes": 1507126127, 2023-07-14T18:29:49.076 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_send_bytes": 1456967384, 2023-07-14T18:29:49.077 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_created_connections": 17, 2023-07-14T18:29:49.077 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_active_connections": 8, 2023-07-14T18:29:49.077 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_running_total_time": 246.447513952, 2023-07-14T18:29:49.077 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_running_send_time": 99.805777749, 2023-07-14T18:29:49.077 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_running_recv_time": 164.585604716, 2023-07-14T18:29:49.077 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_running_fast_dispatch_time": 0.013929166, 2023-07-14T18:29:49.078 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_send_messages_queue_lat": { 2023-07-14T18:29:49.078 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 9190011, 2023-07-14T18:29:49.078 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 80.356622630, 2023-07-14T18:29:49.078 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000008743 2023-07-14T18:29:49.078 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2023-07-14T18:29:49.079 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_handle_ack_lat": { 2023-07-14T18:29:49.079 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 17142582, 2023-07-14T18:29:49.079 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 1.921985467, 2023-07-14T18:29:49.079 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000112 2023-07-14T18:29:49.080 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2023-07-14T18:29:49.080 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_recv_encrypted_bytes": 320, 2023-07-14T18:29:49.080 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_send_encrypted_bytes": 560256 2023-07-14T18:29:49.080 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2023-07-14T18:29:49.080 INFO:teuthology.orchestra.run.smithi184.stdout: "AsyncMessenger::Worker-2": { 2023-07-14T18:29:49.081 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_recv_messages": 5557527, 2023-07-14T18:29:49.081 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_send_messages": 5558918, 2023-07-14T18:29:49.081 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_recv_bytes": 903217052, 2023-07-14T18:29:49.082 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_send_bytes": 882136800, 2023-07-14T18:29:49.082 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_created_connections": 16, 2023-07-14T18:29:49.082 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_active_connections": 9, 2023-07-14T18:29:49.082 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_running_total_time": 206.934212121, 2023-07-14T18:29:49.082 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_running_send_time": 89.185450957, 2023-07-14T18:29:49.082 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_running_recv_time": 148.224343512, 2023-07-14T18:29:49.083 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_running_fast_dispatch_time": 0.011003126, 2023-07-14T18:29:49.083 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_send_messages_queue_lat": { 2023-07-14T18:29:49.083 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 5558915, 2023-07-14T18:29:49.083 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 47.326536915, 2023-07-14T18:29:49.083 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000008513 2023-07-14T18:29:49.084 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2023-07-14T18:29:49.084 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_handle_ack_lat": { 2023-07-14T18:29:49.084 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 10907951, 2023-07-14T18:29:49.084 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 1.010316573, 2023-07-14T18:29:49.084 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000092 2023-07-14T18:29:49.085 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2023-07-14T18:29:49.085 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_recv_encrypted_bytes": 2960, 2023-07-14T18:29:49.085 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_send_encrypted_bytes": 448 2023-07-14T18:29:49.085 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2023-07-14T18:29:49.085 INFO:teuthology.orchestra.run.smithi184.stdout: "cct": { 2023-07-14T18:29:49.086 INFO:teuthology.orchestra.run.smithi184.stdout: "total_workers": 1, 2023-07-14T18:29:49.086 INFO:teuthology.orchestra.run.smithi184.stdout: "unhealthy_workers": 0 2023-07-14T18:29:49.086 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2023-07-14T18:29:49.087 INFO:teuthology.orchestra.run.smithi184.stdout: "finisher-MDSRank": { 2023-07-14T18:29:49.087 INFO:teuthology.orchestra.run.smithi184.stdout: "queue_len": 0, 2023-07-14T18:29:49.088 INFO:teuthology.orchestra.run.smithi184.stdout: "complete_latency": { 2023-07-14T18:29:49.088 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 1380, 2023-07-14T18:29:49.088 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 1.647891964, 2023-07-14T18:29:49.089 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.001194124 2023-07-14T18:29:49.089 INFO:teuthology.orchestra.run.smithi184.stdout: } 2023-07-14T18:29:49.090 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2023-07-14T18:29:49.090 INFO:teuthology.orchestra.run.smithi184.stdout: "finisher-PurgeQueue": { 2023-07-14T18:29:49.090 INFO:teuthology.orchestra.run.smithi184.stdout: "queue_len": 0, 2023-07-14T18:29:49.091 INFO:teuthology.orchestra.run.smithi184.stdout: "complete_latency": { 2023-07-14T18:29:49.091 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 548, 2023-07-14T18:29:49.092 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.039507123, 2023-07-14T18:29:49.092 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000072093 2023-07-14T18:29:49.092 INFO:teuthology.orchestra.run.smithi184.stdout: } 2023-07-14T18:29:49.093 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2023-07-14T18:29:49.093 INFO:teuthology.orchestra.run.smithi184.stdout: "mds": { 2023-07-14T18:29:49.093 INFO:teuthology.orchestra.run.smithi184.stdout: "request": 7249, 2023-07-14T18:29:49.094 INFO:teuthology.orchestra.run.smithi184.stdout: "reply": 3942, 2023-07-14T18:29:49.094 INFO:teuthology.orchestra.run.smithi184.stdout: "reply_latency": { 2023-07-14T18:29:49.095 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 3942, 2023-07-14T18:29:49.095 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 2.759489515, 2023-07-14T18:29:49.095 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000700022 2023-07-14T18:29:49.096 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2023-07-14T18:29:49.096 INFO:teuthology.orchestra.run.smithi184.stdout: "slow_reply": 0, 2023-07-14T18:29:49.096 INFO:teuthology.orchestra.run.smithi184.stdout: "forward": 3307, 2023-07-14T18:29:49.097 INFO:teuthology.orchestra.run.smithi184.stdout: "dir_fetch_complete": 0, 2023-07-14T18:29:49.097 INFO:teuthology.orchestra.run.smithi184.stdout: "dir_fetch_keys": 0, 2023-07-14T18:29:49.097 INFO:teuthology.orchestra.run.smithi184.stdout: "dir_commit": 11, 2023-07-14T18:29:49.098 INFO:teuthology.orchestra.run.smithi184.stdout: "dir_split": 0, 2023-07-14T18:29:49.098 INFO:teuthology.orchestra.run.smithi184.stdout: "dir_merge": 0, 2023-07-14T18:29:49.098 INFO:teuthology.orchestra.run.smithi184.stdout: "inodes": 1210, 2023-07-14T18:29:49.099 INFO:teuthology.orchestra.run.smithi184.stdout: "inodes_top": 60, 2023-07-14T18:29:49.099 INFO:teuthology.orchestra.run.smithi184.stdout: "inodes_bottom": 1150, 2023-07-14T18:29:49.099 INFO:teuthology.orchestra.run.smithi184.stdout: "inodes_pin_tail": 0, 2023-07-14T18:29:49.100 INFO:teuthology.orchestra.run.smithi184.stdout: "inodes_pinned": 1126, 2023-07-14T18:29:49.100 INFO:teuthology.orchestra.run.smithi184.stdout: "inodes_expired": 8, 2023-07-14T18:29:49.101 INFO:teuthology.orchestra.run.smithi184.stdout: "inodes_with_caps": 869, 2023-07-14T18:29:49.101 INFO:teuthology.orchestra.run.smithi184.stdout: "caps": 869, 2023-07-14T18:29:49.101 INFO:teuthology.orchestra.run.smithi184.stdout: "subtrees": 90, 2023-07-14T18:29:49.102 INFO:teuthology.orchestra.run.smithi184.stdout: "traverse": 12372, 2023-07-14T18:29:49.102 INFO:teuthology.orchestra.run.smithi184.stdout: "traverse_hit": 1423, 2023-07-14T18:29:49.103 INFO:teuthology.orchestra.run.smithi184.stdout: "traverse_forward": 3307, 2023-07-14T18:29:49.103 INFO:teuthology.orchestra.run.smithi184.stdout: "traverse_discover": 68, 2023-07-14T18:29:49.104 INFO:teuthology.orchestra.run.smithi184.stdout: "traverse_dir_fetch": 0, 2023-07-14T18:29:49.104 INFO:teuthology.orchestra.run.smithi184.stdout: "traverse_remote_ino": 0, 2023-07-14T18:29:49.105 INFO:teuthology.orchestra.run.smithi184.stdout: "traverse_lock": 0, 2023-07-14T18:29:49.105 INFO:teuthology.orchestra.run.smithi184.stdout: "load_cent": 0, 2023-07-14T18:29:49.105 INFO:teuthology.orchestra.run.smithi184.stdout: "q": 0, 2023-07-14T18:29:49.106 INFO:teuthology.orchestra.run.smithi184.stdout: "exported": 0, 2023-07-14T18:29:49.106 INFO:teuthology.orchestra.run.smithi184.stdout: "exported_inodes": 0, 2023-07-14T18:29:49.107 INFO:teuthology.orchestra.run.smithi184.stdout: "imported": 45, 2023-07-14T18:29:49.107 INFO:teuthology.orchestra.run.smithi184.stdout: "imported_inodes": 1040, 2023-07-14T18:29:49.108 INFO:teuthology.orchestra.run.smithi184.stdout: "openino_dir_fetch": 0, 2023-07-14T18:29:49.108 INFO:teuthology.orchestra.run.smithi184.stdout: "openino_backtrace_fetch": 296, 2023-07-14T18:29:49.108 INFO:teuthology.orchestra.run.smithi184.stdout: "openino_peer_discover": 0, 2023-07-14T18:29:49.108 INFO:teuthology.orchestra.run.smithi184.stdout: "root_rfiles": 3563, 2023-07-14T18:29:49.109 INFO:teuthology.orchestra.run.smithi184.stdout: "root_rbytes": 33808819, 2023-07-14T18:29:49.109 INFO:teuthology.orchestra.run.smithi184.stdout: "root_rsnaps": 0, 2023-07-14T18:29:49.109 INFO:teuthology.orchestra.run.smithi184.stdout: "scrub_backtrace_fetch": 296, 2023-07-14T18:29:49.109 INFO:teuthology.orchestra.run.smithi184.stdout: "scrub_set_tag": 0, 2023-07-14T18:29:49.109 INFO:teuthology.orchestra.run.smithi184.stdout: "scrub_backtrace_repaired": 0, 2023-07-14T18:29:49.110 INFO:teuthology.orchestra.run.smithi184.stdout: "scrub_inotable_repaired": 0, 2023-07-14T18:29:49.110 INFO:teuthology.orchestra.run.smithi184.stdout: "scrub_dir_inodes": 1, 2023-07-14T18:29:49.110 INFO:teuthology.orchestra.run.smithi184.stdout: "scrub_dir_base_inodes": 0, 2023-07-14T18:29:49.110 INFO:teuthology.orchestra.run.smithi184.stdout: "scrub_dirfrag_rstats": 1, 2023-07-14T18:29:49.110 INFO:teuthology.orchestra.run.smithi184.stdout: "scrub_file_inodes": 295, 2023-07-14T18:29:49.111 INFO:teuthology.orchestra.run.smithi184.stdout: "handle_inode_file_caps": 0, 2023-07-14T18:29:49.111 INFO:teuthology.orchestra.run.smithi184.stdout: "ceph_cap_op_revoke": 45, 2023-07-14T18:29:49.111 INFO:teuthology.orchestra.run.smithi184.stdout: "ceph_cap_op_grant": 514, 2023-07-14T18:29:49.111 INFO:teuthology.orchestra.run.smithi184.stdout: "ceph_cap_op_trunc": 0, 2023-07-14T18:29:49.111 INFO:teuthology.orchestra.run.smithi184.stdout: "ceph_cap_op_flushsnap_ack": 0, 2023-07-14T18:29:49.112 INFO:teuthology.orchestra.run.smithi184.stdout: "ceph_cap_op_flush_ack": 0, 2023-07-14T18:29:49.112 INFO:teuthology.orchestra.run.smithi184.stdout: "handle_client_caps": 798, 2023-07-14T18:29:49.112 INFO:teuthology.orchestra.run.smithi184.stdout: "handle_client_caps_dirty": 320, 2023-07-14T18:29:49.112 INFO:teuthology.orchestra.run.smithi184.stdout: "handle_client_cap_release": 30, 2023-07-14T18:29:49.112 INFO:teuthology.orchestra.run.smithi184.stdout: "process_request_cap_release": 736 2023-07-14T18:29:49.113 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2023-07-14T18:29:49.113 INFO:teuthology.orchestra.run.smithi184.stdout: "mds_cache": { 2023-07-14T18:29:49.113 INFO:teuthology.orchestra.run.smithi184.stdout: "dir_update": 97, 2023-07-14T18:29:49.113 INFO:teuthology.orchestra.run.smithi184.stdout: "dir_update_receipt": 373, 2023-07-14T18:29:49.113 INFO:teuthology.orchestra.run.smithi184.stdout: "dir_try_discover": 197, 2023-07-14T18:29:49.114 INFO:teuthology.orchestra.run.smithi184.stdout: "dir_send_discover": 348, 2023-07-14T18:29:49.114 INFO:teuthology.orchestra.run.smithi184.stdout: "dir_handle_discover": 119, 2023-07-14T18:29:49.114 INFO:teuthology.orchestra.run.smithi184.stdout: "num_strays": 0, 2023-07-14T18:29:49.114 INFO:teuthology.orchestra.run.smithi184.stdout: "num_strays_delayed": 0, 2023-07-14T18:29:49.114 INFO:teuthology.orchestra.run.smithi184.stdout: "num_strays_enqueuing": 0, 2023-07-14T18:29:49.114 INFO:teuthology.orchestra.run.smithi184.stdout: "strays_created": 226, 2023-07-14T18:29:49.115 INFO:teuthology.orchestra.run.smithi184.stdout: "strays_enqueued": 226, 2023-07-14T18:29:49.115 INFO:teuthology.orchestra.run.smithi184.stdout: "strays_reintegrated": 0, 2023-07-14T18:29:49.115 INFO:teuthology.orchestra.run.smithi184.stdout: "strays_migrated": 0, 2023-07-14T18:29:49.115 INFO:teuthology.orchestra.run.smithi184.stdout: "num_recovering_processing": 0, 2023-07-14T18:29:49.115 INFO:teuthology.orchestra.run.smithi184.stdout: "num_recovering_enqueued": 0, 2023-07-14T18:29:49.116 INFO:teuthology.orchestra.run.smithi184.stdout: "num_recovering_prioritized": 0, 2023-07-14T18:29:49.116 INFO:teuthology.orchestra.run.smithi184.stdout: "recovery_started": 0, 2023-07-14T18:29:49.116 INFO:teuthology.orchestra.run.smithi184.stdout: "recovery_completed": 0, 2023-07-14T18:29:49.116 INFO:teuthology.orchestra.run.smithi184.stdout: "ireq_enqueue_scrub": 0, 2023-07-14T18:29:49.116 INFO:teuthology.orchestra.run.smithi184.stdout: "ireq_exportdir": 0, 2023-07-14T18:29:49.117 INFO:teuthology.orchestra.run.smithi184.stdout: "ireq_flush": 0, 2023-07-14T18:29:49.117 INFO:teuthology.orchestra.run.smithi184.stdout: "ireq_fragmentdir": 0, 2023-07-14T18:29:49.117 INFO:teuthology.orchestra.run.smithi184.stdout: "ireq_fragstats": 0, 2023-07-14T18:29:49.117 INFO:teuthology.orchestra.run.smithi184.stdout: "ireq_inodestats": 0 2023-07-14T18:29:49.117 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2023-07-14T18:29:49.118 INFO:teuthology.orchestra.run.smithi184.stdout: "mds_log": { 2023-07-14T18:29:49.118 INFO:teuthology.orchestra.run.smithi184.stdout: "evadd": 22223, 2023-07-14T18:29:49.118 INFO:teuthology.orchestra.run.smithi184.stdout: "evex": 0, 2023-07-14T18:29:49.119 INFO:teuthology.orchestra.run.smithi184.stdout: "evtrm": 0, 2023-07-14T18:29:49.119 INFO:teuthology.orchestra.run.smithi184.stdout: "ev": 22223, 2023-07-14T18:29:49.119 INFO:teuthology.orchestra.run.smithi184.stdout: "evexg": 0, 2023-07-14T18:29:49.119 INFO:teuthology.orchestra.run.smithi184.stdout: "evexd": 0, 2023-07-14T18:29:49.119 INFO:teuthology.orchestra.run.smithi184.stdout: "segadd": 24, 2023-07-14T18:29:49.120 INFO:teuthology.orchestra.run.smithi184.stdout: "segex": 0, 2023-07-14T18:29:49.120 INFO:teuthology.orchestra.run.smithi184.stdout: "segtrm": 0, 2023-07-14T18:29:49.120 INFO:teuthology.orchestra.run.smithi184.stdout: "seg": 24, 2023-07-14T18:29:49.120 INFO:teuthology.orchestra.run.smithi184.stdout: "segexg": 0, 2023-07-14T18:29:49.120 INFO:teuthology.orchestra.run.smithi184.stdout: "segexd": 0, 2023-07-14T18:29:49.121 INFO:teuthology.orchestra.run.smithi184.stdout: "expos": 4194304, 2023-07-14T18:29:49.121 INFO:teuthology.orchestra.run.smithi184.stdout: "wrpos": 19551767, 2023-07-14T18:29:49.121 INFO:teuthology.orchestra.run.smithi184.stdout: "rdpos": 0, 2023-07-14T18:29:49.121 INFO:teuthology.orchestra.run.smithi184.stdout: "jlat": { 2023-07-14T18:29:49.121 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 572, 2023-07-14T18:29:49.122 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 1.116730985, 2023-07-14T18:29:49.122 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.001952326 2023-07-14T18:29:49.122 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2023-07-14T18:29:49.122 INFO:teuthology.orchestra.run.smithi184.stdout: "replayed": 0 2023-07-14T18:29:49.122 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2023-07-14T18:29:49.122 INFO:teuthology.orchestra.run.smithi184.stdout: "mds_mem": { 2023-07-14T18:29:49.123 INFO:teuthology.orchestra.run.smithi184.stdout: "ino": 905, 2023-07-14T18:29:49.123 INFO:teuthology.orchestra.run.smithi184.stdout: "ino+": 1136, 2023-07-14T18:29:49.123 INFO:teuthology.orchestra.run.smithi184.stdout: "ino-": 231, 2023-07-14T18:29:49.123 INFO:teuthology.orchestra.run.smithi184.stdout: "dir": 183, 2023-07-14T18:29:49.123 INFO:teuthology.orchestra.run.smithi184.stdout: "dir+": 248, 2023-07-14T18:29:49.124 INFO:teuthology.orchestra.run.smithi184.stdout: "dir-": 65, 2023-07-14T18:29:49.124 INFO:teuthology.orchestra.run.smithi184.stdout: "dn": 1210, 2023-07-14T18:29:49.124 INFO:teuthology.orchestra.run.smithi184.stdout: "dn+": 1457, 2023-07-14T18:29:49.125 INFO:teuthology.orchestra.run.smithi184.stdout: "dn-": 247, 2023-07-14T18:29:49.125 INFO:teuthology.orchestra.run.smithi184.stdout: "cap": 869, 2023-07-14T18:29:49.125 INFO:teuthology.orchestra.run.smithi184.stdout: "cap+": 1095, 2023-07-14T18:29:49.125 INFO:teuthology.orchestra.run.smithi184.stdout: "cap-": 226, 2023-07-14T18:29:49.126 INFO:teuthology.orchestra.run.smithi184.stdout: "rss": 63544, 2023-07-14T18:29:49.126 INFO:teuthology.orchestra.run.smithi184.stdout: "heap": 198960 2023-07-14T18:29:49.126 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2023-07-14T18:29:49.126 INFO:teuthology.orchestra.run.smithi184.stdout: "mds_server": { 2023-07-14T18:29:49.127 INFO:teuthology.orchestra.run.smithi184.stdout: "dispatch_client_request": 8749, 2023-07-14T18:29:49.127 INFO:teuthology.orchestra.run.smithi184.stdout: "dispatch_server_request": 4, 2023-07-14T18:29:49.127 INFO:teuthology.orchestra.run.smithi184.stdout: "handle_client_request": 7249, 2023-07-14T18:29:49.127 INFO:teuthology.orchestra.run.smithi184.stdout: "handle_client_session": 13, 2023-07-14T18:29:49.127 INFO:teuthology.orchestra.run.smithi184.stdout: "handle_peer_request": 496, 2023-07-14T18:29:49.128 INFO:teuthology.orchestra.run.smithi184.stdout: "req_create_latency": { 2023-07-14T18:29:49.128 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 283, 2023-07-14T18:29:49.128 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.977140182, 2023-07-14T18:29:49.128 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.003452792 2023-07-14T18:29:49.128 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2023-07-14T18:29:49.129 INFO:teuthology.orchestra.run.smithi184.stdout: "req_getattr_latency": { 2023-07-14T18:29:49.129 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 15, 2023-07-14T18:29:49.129 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.004129815, 2023-07-14T18:29:49.129 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000275321 2023-07-14T18:29:49.129 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2023-07-14T18:29:49.130 INFO:teuthology.orchestra.run.smithi184.stdout: "req_getfilelock_latency": { 2023-07-14T18:29:49.130 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2023-07-14T18:29:49.130 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2023-07-14T18:29:49.130 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2023-07-14T18:29:49.130 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2023-07-14T18:29:49.131 INFO:teuthology.orchestra.run.smithi184.stdout: "req_link_latency": { 2023-07-14T18:29:49.131 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2023-07-14T18:29:49.131 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2023-07-14T18:29:49.131 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2023-07-14T18:29:49.131 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2023-07-14T18:29:49.131 INFO:teuthology.orchestra.run.smithi184.stdout: "req_lookup_latency": { 2023-07-14T18:29:49.132 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 3403, 2023-07-14T18:29:49.132 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.768160697, 2023-07-14T18:29:49.132 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000225730 2023-07-14T18:29:49.132 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2023-07-14T18:29:49.132 INFO:teuthology.orchestra.run.smithi184.stdout: "req_lookuphash_latency": { 2023-07-14T18:29:49.133 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2023-07-14T18:29:49.133 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2023-07-14T18:29:49.133 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2023-07-14T18:29:49.133 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2023-07-14T18:29:49.133 INFO:teuthology.orchestra.run.smithi184.stdout: "req_lookupino_latency": { 2023-07-14T18:29:49.134 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2023-07-14T18:29:49.134 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2023-07-14T18:29:49.134 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2023-07-14T18:29:49.134 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2023-07-14T18:29:49.134 INFO:teuthology.orchestra.run.smithi184.stdout: "req_lookupname_latency": { 2023-07-14T18:29:49.135 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2023-07-14T18:29:49.135 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2023-07-14T18:29:49.135 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2023-07-14T18:29:49.135 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2023-07-14T18:29:49.135 INFO:teuthology.orchestra.run.smithi184.stdout: "req_lookupparent_latency": { 2023-07-14T18:29:49.136 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2023-07-14T18:29:49.136 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2023-07-14T18:29:49.136 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2023-07-14T18:29:49.136 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2023-07-14T18:29:49.136 INFO:teuthology.orchestra.run.smithi184.stdout: "req_lookupsnap_latency": { 2023-07-14T18:29:49.137 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2023-07-14T18:29:49.137 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2023-07-14T18:29:49.137 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2023-07-14T18:29:49.137 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2023-07-14T18:29:49.137 INFO:teuthology.orchestra.run.smithi184.stdout: "req_lssnap_latency": { 2023-07-14T18:29:49.138 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2023-07-14T18:29:49.138 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2023-07-14T18:29:49.138 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2023-07-14T18:29:49.138 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2023-07-14T18:29:49.138 INFO:teuthology.orchestra.run.smithi184.stdout: "req_mkdir_latency": { 2023-07-14T18:29:49.139 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 1, 2023-07-14T18:29:49.139 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.001281935, 2023-07-14T18:29:49.139 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.001281935 2023-07-14T18:29:49.139 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2023-07-14T18:29:49.140 INFO:teuthology.orchestra.run.smithi184.stdout: "req_mknod_latency": { 2023-07-14T18:29:49.140 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2023-07-14T18:29:49.140 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2023-07-14T18:29:49.140 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2023-07-14T18:29:49.140 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2023-07-14T18:29:49.140 INFO:teuthology.orchestra.run.smithi184.stdout: "req_mksnap_latency": { 2023-07-14T18:29:49.141 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2023-07-14T18:29:49.141 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2023-07-14T18:29:49.141 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2023-07-14T18:29:49.141 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2023-07-14T18:29:49.141 INFO:teuthology.orchestra.run.smithi184.stdout: "req_open_latency": { 2023-07-14T18:29:49.142 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 2, 2023-07-14T18:29:49.142 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000603037, 2023-07-14T18:29:49.142 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000301518 2023-07-14T18:29:49.142 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2023-07-14T18:29:49.142 INFO:teuthology.orchestra.run.smithi184.stdout: "req_readdir_latency": { 2023-07-14T18:29:49.143 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 12, 2023-07-14T18:29:49.143 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.018133658, 2023-07-14T18:29:49.143 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.001511138 2023-07-14T18:29:49.143 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2023-07-14T18:29:49.143 INFO:teuthology.orchestra.run.smithi184.stdout: "req_rename_latency": { 2023-07-14T18:29:49.144 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2023-07-14T18:29:49.144 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2023-07-14T18:29:49.144 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2023-07-14T18:29:49.144 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2023-07-14T18:29:49.144 INFO:teuthology.orchestra.run.smithi184.stdout: "req_renamesnap_latency": { 2023-07-14T18:29:49.145 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2023-07-14T18:29:49.145 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2023-07-14T18:29:49.145 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2023-07-14T18:29:49.145 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2023-07-14T18:29:49.145 INFO:teuthology.orchestra.run.smithi184.stdout: "req_snapdiff_latency": { 2023-07-14T18:29:49.145 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2023-07-14T18:29:49.146 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2023-07-14T18:29:49.146 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2023-07-14T18:29:49.146 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2023-07-14T18:29:49.146 INFO:teuthology.orchestra.run.smithi184.stdout: "req_rmdir_latency": { 2023-07-14T18:29:49.146 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2023-07-14T18:29:49.147 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2023-07-14T18:29:49.147 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2023-07-14T18:29:49.147 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2023-07-14T18:29:49.147 INFO:teuthology.orchestra.run.smithi184.stdout: "req_rmsnap_latency": { 2023-07-14T18:29:49.147 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2023-07-14T18:29:49.148 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2023-07-14T18:29:49.148 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2023-07-14T18:29:49.148 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2023-07-14T18:29:49.148 INFO:teuthology.orchestra.run.smithi184.stdout: "req_rmxattr_latency": { 2023-07-14T18:29:49.148 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2023-07-14T18:29:49.149 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2023-07-14T18:29:49.149 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2023-07-14T18:29:49.149 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2023-07-14T18:29:49.149 INFO:teuthology.orchestra.run.smithi184.stdout: "req_setattr_latency": { 2023-07-14T18:29:49.149 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2023-07-14T18:29:49.149 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2023-07-14T18:29:49.150 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2023-07-14T18:29:49.150 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2023-07-14T18:29:49.150 INFO:teuthology.orchestra.run.smithi184.stdout: "req_setdirlayout_latency": { 2023-07-14T18:29:49.150 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2023-07-14T18:29:49.150 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2023-07-14T18:29:49.151 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2023-07-14T18:29:49.151 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2023-07-14T18:29:49.151 INFO:teuthology.orchestra.run.smithi184.stdout: "req_setfilelock_latency": { 2023-07-14T18:29:49.151 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2023-07-14T18:29:49.151 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2023-07-14T18:29:49.152 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2023-07-14T18:29:49.152 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2023-07-14T18:29:49.152 INFO:teuthology.orchestra.run.smithi184.stdout: "req_setlayout_latency": { 2023-07-14T18:29:49.152 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2023-07-14T18:29:49.152 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2023-07-14T18:29:49.153 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2023-07-14T18:29:49.153 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2023-07-14T18:29:49.153 INFO:teuthology.orchestra.run.smithi184.stdout: "req_setxattr_latency": { 2023-07-14T18:29:49.153 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2023-07-14T18:29:49.153 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2023-07-14T18:29:49.154 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2023-07-14T18:29:49.154 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2023-07-14T18:29:49.154 INFO:teuthology.orchestra.run.smithi184.stdout: "req_symlink_latency": { 2023-07-14T18:29:49.154 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2023-07-14T18:29:49.154 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2023-07-14T18:29:49.154 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2023-07-14T18:29:49.155 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2023-07-14T18:29:49.155 INFO:teuthology.orchestra.run.smithi184.stdout: "req_unlink_latency": { 2023-07-14T18:29:49.155 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 226, 2023-07-14T18:29:49.155 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.990040191, 2023-07-14T18:29:49.155 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.004380708 2023-07-14T18:29:49.156 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2023-07-14T18:29:49.156 INFO:teuthology.orchestra.run.smithi184.stdout: "cap_revoke_eviction": 0, 2023-07-14T18:29:49.156 INFO:teuthology.orchestra.run.smithi184.stdout: "cap_acquisition_throttle": 0, 2023-07-14T18:29:49.156 INFO:teuthology.orchestra.run.smithi184.stdout: "req_getvxattr_latency": { 2023-07-14T18:29:49.156 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2023-07-14T18:29:49.157 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2023-07-14T18:29:49.157 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2023-07-14T18:29:49.157 INFO:teuthology.orchestra.run.smithi184.stdout: } 2023-07-14T18:29:49.157 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2023-07-14T18:29:49.157 INFO:teuthology.orchestra.run.smithi184.stdout: "mds_sessions": { 2023-07-14T18:29:49.158 INFO:teuthology.orchestra.run.smithi184.stdout: "session_count": 1, 2023-07-14T18:29:49.158 INFO:teuthology.orchestra.run.smithi184.stdout: "session_add": 1, 2023-07-14T18:29:49.158 INFO:teuthology.orchestra.run.smithi184.stdout: "session_remove": 0, 2023-07-14T18:29:49.158 INFO:teuthology.orchestra.run.smithi184.stdout: "sessions_open": 1, 2023-07-14T18:29:49.158 INFO:teuthology.orchestra.run.smithi184.stdout: "sessions_stale": 0, 2023-07-14T18:29:49.158 INFO:teuthology.orchestra.run.smithi184.stdout: "total_load": 3057, 2023-07-14T18:29:49.159 INFO:teuthology.orchestra.run.smithi184.stdout: "average_load": 3057, 2023-07-14T18:29:49.159 INFO:teuthology.orchestra.run.smithi184.stdout: "avg_session_uptime": 1020 2023-07-14T18:29:49.159 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2023-07-14T18:29:49.159 INFO:teuthology.orchestra.run.smithi184.stdout: "mempool": { 2023-07-14T18:29:49.159 INFO:teuthology.orchestra.run.smithi184.stdout: "bloom_filter_bytes": 0, 2023-07-14T18:29:49.160 INFO:teuthology.orchestra.run.smithi184.stdout: "bloom_filter_items": 0, 2023-07-14T18:29:49.160 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_alloc_bytes": 0, 2023-07-14T18:29:49.160 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_alloc_items": 0, 2023-07-14T18:29:49.160 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_cache_data_bytes": 0, 2023-07-14T18:29:49.160 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_cache_data_items": 0, 2023-07-14T18:29:49.161 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_cache_onode_bytes": 0, 2023-07-14T18:29:49.161 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_cache_onode_items": 0, 2023-07-14T18:29:49.161 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_cache_meta_bytes": 0, 2023-07-14T18:29:49.161 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_cache_meta_items": 0, 2023-07-14T18:29:49.161 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_cache_other_bytes": 0, 2023-07-14T18:29:49.162 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_cache_other_items": 0, 2023-07-14T18:29:49.162 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_cache_buffer_bytes": 0, 2023-07-14T18:29:49.162 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_cache_buffer_items": 0, 2023-07-14T18:29:49.162 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_extent_bytes": 0, 2023-07-14T18:29:49.162 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_extent_items": 0, 2023-07-14T18:29:49.163 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_blob_bytes": 0, 2023-07-14T18:29:49.163 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_blob_items": 0, 2023-07-14T18:29:49.163 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_shared_blob_bytes": 0, 2023-07-14T18:29:49.163 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_shared_blob_items": 0, 2023-07-14T18:29:49.163 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_inline_bl_bytes": 0, 2023-07-14T18:29:49.163 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_inline_bl_items": 0, 2023-07-14T18:29:49.164 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_fsck_bytes": 0, 2023-07-14T18:29:49.164 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_fsck_items": 0, 2023-07-14T18:29:49.164 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_txc_bytes": 0, 2023-07-14T18:29:49.164 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_txc_items": 0, 2023-07-14T18:29:49.164 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_writing_deferred_bytes": 0, 2023-07-14T18:29:49.165 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_writing_deferred_items": 0, 2023-07-14T18:29:49.165 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_writing_bytes": 0, 2023-07-14T18:29:49.165 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_writing_items": 0, 2023-07-14T18:29:49.165 INFO:teuthology.orchestra.run.smithi184.stdout: "bluefs_bytes": 0, 2023-07-14T18:29:49.165 INFO:teuthology.orchestra.run.smithi184.stdout: "bluefs_items": 0, 2023-07-14T18:29:49.166 INFO:teuthology.orchestra.run.smithi184.stdout: "bluefs_file_reader_bytes": 0, 2023-07-14T18:29:49.166 INFO:teuthology.orchestra.run.smithi184.stdout: "bluefs_file_reader_items": 0, 2023-07-14T18:29:49.166 INFO:teuthology.orchestra.run.smithi184.stdout: "bluefs_file_writer_bytes": 0, 2023-07-14T18:29:49.166 INFO:teuthology.orchestra.run.smithi184.stdout: "bluefs_file_writer_items": 0, 2023-07-14T18:29:49.166 INFO:teuthology.orchestra.run.smithi184.stdout: "buffer_anon_bytes": 285552, 2023-07-14T18:29:49.167 INFO:teuthology.orchestra.run.smithi184.stdout: "buffer_anon_items": 125, 2023-07-14T18:29:49.167 INFO:teuthology.orchestra.run.smithi184.stdout: "buffer_meta_bytes": 0, 2023-07-14T18:29:49.167 INFO:teuthology.orchestra.run.smithi184.stdout: "buffer_meta_items": 0, 2023-07-14T18:29:49.167 INFO:teuthology.orchestra.run.smithi184.stdout: "osd_bytes": 0, 2023-07-14T18:29:49.167 INFO:teuthology.orchestra.run.smithi184.stdout: "osd_items": 0, 2023-07-14T18:29:49.167 INFO:teuthology.orchestra.run.smithi184.stdout: "osd_mapbl_bytes": 0, 2023-07-14T18:29:49.168 INFO:teuthology.orchestra.run.smithi184.stdout: "osd_mapbl_items": 0, 2023-07-14T18:29:49.168 INFO:teuthology.orchestra.run.smithi184.stdout: "osd_pglog_bytes": 0, 2023-07-14T18:29:49.168 INFO:teuthology.orchestra.run.smithi184.stdout: "osd_pglog_items": 0, 2023-07-14T18:29:49.168 INFO:teuthology.orchestra.run.smithi184.stdout: "osdmap_bytes": 8792, 2023-07-14T18:29:49.169 INFO:teuthology.orchestra.run.smithi184.stdout: "osdmap_items": 168, 2023-07-14T18:29:49.169 INFO:teuthology.orchestra.run.smithi184.stdout: "osdmap_mapping_bytes": 0, 2023-07-14T18:29:49.169 INFO:teuthology.orchestra.run.smithi184.stdout: "osdmap_mapping_items": 0, 2023-07-14T18:29:49.169 INFO:teuthology.orchestra.run.smithi184.stdout: "pgmap_bytes": 0, 2023-07-14T18:29:49.169 INFO:teuthology.orchestra.run.smithi184.stdout: "pgmap_items": 0, 2023-07-14T18:29:49.170 INFO:teuthology.orchestra.run.smithi184.stdout: "mds_co_bytes": 3359308, 2023-07-14T18:29:49.170 INFO:teuthology.orchestra.run.smithi184.stdout: "mds_co_items": 21945, 2023-07-14T18:29:49.170 INFO:teuthology.orchestra.run.smithi184.stdout: "unittest_1_bytes": 0, 2023-07-14T18:29:49.170 INFO:teuthology.orchestra.run.smithi184.stdout: "unittest_1_items": 0, 2023-07-14T18:29:49.170 INFO:teuthology.orchestra.run.smithi184.stdout: "unittest_2_bytes": 0, 2023-07-14T18:29:49.170 INFO:teuthology.orchestra.run.smithi184.stdout: "unittest_2_items": 0 2023-07-14T18:29:49.171 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2023-07-14T18:29:49.171 INFO:teuthology.orchestra.run.smithi184.stdout: "objecter": { 2023-07-14T18:29:49.171 INFO:teuthology.orchestra.run.smithi184.stdout: "op_active": 0, 2023-07-14T18:29:49.171 INFO:teuthology.orchestra.run.smithi184.stdout: "op_laggy": 0, 2023-07-14T18:29:49.171 INFO:teuthology.orchestra.run.smithi184.stdout: "op_send": 1535, 2023-07-14T18:29:49.172 INFO:teuthology.orchestra.run.smithi184.stdout: "op_send_bytes": 15422999, 2023-07-14T18:29:49.172 INFO:teuthology.orchestra.run.smithi184.stdout: "op_resend": 27, 2023-07-14T18:29:49.172 INFO:teuthology.orchestra.run.smithi184.stdout: "op_reply": 1535, 2023-07-14T18:29:49.172 INFO:teuthology.orchestra.run.smithi184.stdout: "op_latency": { 2023-07-14T18:29:49.172 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 1535, 2023-07-14T18:29:49.173 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 3.239932622, 2023-07-14T18:29:49.173 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.002110705 2023-07-14T18:29:49.173 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2023-07-14T18:29:49.173 INFO:teuthology.orchestra.run.smithi184.stdout: "op_inflight": 0, 2023-07-14T18:29:49.173 INFO:teuthology.orchestra.run.smithi184.stdout: "oplen_avg": { 2023-07-14T18:29:49.174 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 1535, 2023-07-14T18:29:49.174 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 1584 2023-07-14T18:29:49.174 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2023-07-14T18:29:49.174 INFO:teuthology.orchestra.run.smithi184.stdout: "op": 1535, 2023-07-14T18:29:49.174 INFO:teuthology.orchestra.run.smithi184.stdout: "op_r": 354, 2023-07-14T18:29:49.175 INFO:teuthology.orchestra.run.smithi184.stdout: "op_w": 1181, 2023-07-14T18:29:49.175 INFO:teuthology.orchestra.run.smithi184.stdout: "op_rmw": 0, 2023-07-14T18:29:49.175 INFO:teuthology.orchestra.run.smithi184.stdout: "op_pg": 0, 2023-07-14T18:29:49.175 INFO:teuthology.orchestra.run.smithi184.stdout: "osdop_stat": 0, 2023-07-14T18:29:49.175 INFO:teuthology.orchestra.run.smithi184.stdout: "osdop_create": 10, 2023-07-14T18:29:49.176 INFO:teuthology.orchestra.run.smithi184.stdout: "osdop_read": 58, 2023-07-14T18:29:49.176 INFO:teuthology.orchestra.run.smithi184.stdout: "osdop_write": 630, 2023-07-14T18:29:49.176 INFO:teuthology.orchestra.run.smithi184.stdout: "osdop_writefull": 44, 2023-07-14T18:29:49.176 INFO:teuthology.orchestra.run.smithi184.stdout: "osdop_writesame": 0, 2023-07-14T18:29:49.176 INFO:teuthology.orchestra.run.smithi184.stdout: "osdop_append": 0, 2023-07-14T18:29:49.176 INFO:teuthology.orchestra.run.smithi184.stdout: "osdop_zero": 0, 2023-07-14T18:29:49.177 INFO:teuthology.orchestra.run.smithi184.stdout: "osdop_truncate": 0, 2023-07-14T18:29:49.177 INFO:teuthology.orchestra.run.smithi184.stdout: "osdop_delete": 467, 2023-07-14T18:29:49.177 INFO:teuthology.orchestra.run.smithi184.stdout: "osdop_mapext": 0, 2023-07-14T18:29:49.177 INFO:teuthology.orchestra.run.smithi184.stdout: "osdop_sparse_read": 0, 2023-07-14T18:29:49.177 INFO:teuthology.orchestra.run.smithi184.stdout: "osdop_clonerange": 0, 2023-07-14T18:29:49.178 INFO:teuthology.orchestra.run.smithi184.stdout: "osdop_getxattr": 296, 2023-07-14T18:29:49.178 INFO:teuthology.orchestra.run.smithi184.stdout: "osdop_setxattr": 20, 2023-07-14T18:29:49.178 INFO:teuthology.orchestra.run.smithi184.stdout: "osdop_cmpxattr": 0, 2023-07-14T18:29:49.178 INFO:teuthology.orchestra.run.smithi184.stdout: "osdop_rmxattr": 0, 2023-07-14T18:29:49.178 INFO:teuthology.orchestra.run.smithi184.stdout: "osdop_resetxattrs": 0, 2023-07-14T18:29:49.179 INFO:teuthology.orchestra.run.smithi184.stdout: "osdop_call": 0, 2023-07-14T18:29:49.179 INFO:teuthology.orchestra.run.smithi184.stdout: "osdop_watch": 0, 2023-07-14T18:29:49.179 INFO:teuthology.orchestra.run.smithi184.stdout: "osdop_notify": 0, 2023-07-14T18:29:49.179 INFO:teuthology.orchestra.run.smithi184.stdout: "osdop_src_cmpxattr": 0, 2023-07-14T18:29:49.179 INFO:teuthology.orchestra.run.smithi184.stdout: "osdop_pgls": 0, 2023-07-14T18:29:49.179 INFO:teuthology.orchestra.run.smithi184.stdout: "osdop_pgls_filter": 0, 2023-07-14T18:29:49.180 INFO:teuthology.orchestra.run.smithi184.stdout: "osdop_other": 0, 2023-07-14T18:29:49.180 INFO:teuthology.orchestra.run.smithi184.stdout: "linger_active": 0, 2023-07-14T18:29:49.180 INFO:teuthology.orchestra.run.smithi184.stdout: "linger_send": 0, 2023-07-14T18:29:49.180 INFO:teuthology.orchestra.run.smithi184.stdout: "linger_resend": 0, 2023-07-14T18:29:49.180 INFO:teuthology.orchestra.run.smithi184.stdout: "linger_ping": 0, 2023-07-14T18:29:49.181 INFO:teuthology.orchestra.run.smithi184.stdout: "poolop_active": 0, 2023-07-14T18:29:49.181 INFO:teuthology.orchestra.run.smithi184.stdout: "poolop_send": 0, 2023-07-14T18:29:49.181 INFO:teuthology.orchestra.run.smithi184.stdout: "poolop_resend": 0, 2023-07-14T18:29:49.181 INFO:teuthology.orchestra.run.smithi184.stdout: "poolstat_active": 0, 2023-07-14T18:29:49.181 INFO:teuthology.orchestra.run.smithi184.stdout: "poolstat_send": 0, 2023-07-14T18:29:49.182 INFO:teuthology.orchestra.run.smithi184.stdout: "poolstat_resend": 0, 2023-07-14T18:29:49.182 INFO:teuthology.orchestra.run.smithi184.stdout: "statfs_active": 0, 2023-07-14T18:29:49.182 INFO:teuthology.orchestra.run.smithi184.stdout: "statfs_send": 0, 2023-07-14T18:29:49.182 INFO:teuthology.orchestra.run.smithi184.stdout: "statfs_resend": 0, 2023-07-14T18:29:49.182 INFO:teuthology.orchestra.run.smithi184.stdout: "command_active": 0, 2023-07-14T18:29:49.182 INFO:teuthology.orchestra.run.smithi184.stdout: "command_send": 0, 2023-07-14T18:29:49.183 INFO:teuthology.orchestra.run.smithi184.stdout: "command_resend": 0, 2023-07-14T18:29:49.183 INFO:teuthology.orchestra.run.smithi184.stdout: "map_epoch": 88, 2023-07-14T18:29:49.183 INFO:teuthology.orchestra.run.smithi184.stdout: "map_full": 0, 2023-07-14T18:29:49.183 INFO:teuthology.orchestra.run.smithi184.stdout: "map_inc": 4, 2023-07-14T18:29:49.183 INFO:teuthology.orchestra.run.smithi184.stdout: "osd_sessions": 12, 2023-07-14T18:29:49.184 INFO:teuthology.orchestra.run.smithi184.stdout: "osd_session_open": 12, 2023-07-14T18:29:49.184 INFO:teuthology.orchestra.run.smithi184.stdout: "osd_session_close": 0, 2023-07-14T18:29:49.184 INFO:teuthology.orchestra.run.smithi184.stdout: "osd_laggy": 0, 2023-07-14T18:29:49.184 INFO:teuthology.orchestra.run.smithi184.stdout: "omap_wr": 45, 2023-07-14T18:29:49.184 INFO:teuthology.orchestra.run.smithi184.stdout: "omap_rd": 0, 2023-07-14T18:29:49.185 INFO:teuthology.orchestra.run.smithi184.stdout: "omap_del": 14 2023-07-14T18:29:49.185 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2023-07-14T18:29:49.185 INFO:teuthology.orchestra.run.smithi184.stdout: "oft": { 2023-07-14T18:29:49.185 INFO:teuthology.orchestra.run.smithi184.stdout: "omap_total_objs": 1, 2023-07-14T18:29:49.185 INFO:teuthology.orchestra.run.smithi184.stdout: "omap_total_kv_pairs": 0, 2023-07-14T18:29:49.186 INFO:teuthology.orchestra.run.smithi184.stdout: "omap_total_updates": 0, 2023-07-14T18:29:49.186 INFO:teuthology.orchestra.run.smithi184.stdout: "omap_total_removes": 0 2023-07-14T18:29:49.186 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2023-07-14T18:29:49.186 INFO:teuthology.orchestra.run.smithi184.stdout: "osd-slow-ops": { 2023-07-14T18:29:49.186 INFO:teuthology.orchestra.run.smithi184.stdout: "slow_ops_count": 0 2023-07-14T18:29:49.186 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2023-07-14T18:29:49.187 INFO:teuthology.orchestra.run.smithi184.stdout: "purge_queue": { 2023-07-14T18:29:49.187 INFO:teuthology.orchestra.run.smithi184.stdout: "pq_executing_ops": 0, 2023-07-14T18:29:49.187 INFO:teuthology.orchestra.run.smithi184.stdout: "pq_executing_ops_high_water": 10, 2023-07-14T18:29:49.187 INFO:teuthology.orchestra.run.smithi184.stdout: "pq_executing": 0, 2023-07-14T18:29:49.187 INFO:teuthology.orchestra.run.smithi184.stdout: "pq_executing_high_water": 5, 2023-07-14T18:29:49.188 INFO:teuthology.orchestra.run.smithi184.stdout: "pq_executed": 226, 2023-07-14T18:29:49.188 INFO:teuthology.orchestra.run.smithi184.stdout: "pq_item_in_journal": 0 2023-07-14T18:29:49.188 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2023-07-14T18:29:49.188 INFO:teuthology.orchestra.run.smithi184.stdout: "throttle-msgr_dispatch_throttler-mds": { 2023-07-14T18:29:49.188 INFO:teuthology.orchestra.run.smithi184.stdout: "val": 76, 2023-07-14T18:29:49.189 INFO:teuthology.orchestra.run.smithi184.stdout: "max": 104857600, 2023-07-14T18:29:49.189 INFO:teuthology.orchestra.run.smithi184.stdout: "get_started": 0, 2023-07-14T18:29:49.189 INFO:teuthology.orchestra.run.smithi184.stdout: "get": 15664075, 2023-07-14T18:29:49.189 INFO:teuthology.orchestra.run.smithi184.stdout: "get_sum": 1185134516, 2023-07-14T18:29:49.189 INFO:teuthology.orchestra.run.smithi184.stdout: "get_or_fail_fail": 0, 2023-07-14T18:29:49.190 INFO:teuthology.orchestra.run.smithi184.stdout: "get_or_fail_success": 15664075, 2023-07-14T18:29:49.190 INFO:teuthology.orchestra.run.smithi184.stdout: "take": 0, 2023-07-14T18:29:49.190 INFO:teuthology.orchestra.run.smithi184.stdout: "take_sum": 0, 2023-07-14T18:29:49.190 INFO:teuthology.orchestra.run.smithi184.stdout: "put": 15664074, 2023-07-14T18:29:49.190 INFO:teuthology.orchestra.run.smithi184.stdout: "put_sum": 1185134440, 2023-07-14T18:29:49.191 INFO:teuthology.orchestra.run.smithi184.stdout: "wait": { 2023-07-14T18:29:49.191 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2023-07-14T18:29:49.191 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2023-07-14T18:29:49.191 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2023-07-14T18:29:49.191 INFO:teuthology.orchestra.run.smithi184.stdout: } 2023-07-14T18:29:49.191 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2023-07-14T18:29:49.192 INFO:teuthology.orchestra.run.smithi184.stdout: "throttle-objecter_bytes": { 2023-07-14T18:29:49.192 INFO:teuthology.orchestra.run.smithi184.stdout: "val": 0, 2023-07-14T18:29:49.192 INFO:teuthology.orchestra.run.smithi184.stdout: "max": 104857600, 2023-07-14T18:29:49.192 INFO:teuthology.orchestra.run.smithi184.stdout: "get_started": 0, 2023-07-14T18:29:49.192 INFO:teuthology.orchestra.run.smithi184.stdout: "get": 0, 2023-07-14T18:29:49.193 INFO:teuthology.orchestra.run.smithi184.stdout: "get_sum": 0, 2023-07-14T18:29:49.193 INFO:teuthology.orchestra.run.smithi184.stdout: "get_or_fail_fail": 0, 2023-07-14T18:29:49.193 INFO:teuthology.orchestra.run.smithi184.stdout: "get_or_fail_success": 0, 2023-07-14T18:29:49.193 INFO:teuthology.orchestra.run.smithi184.stdout: "take": 1535, 2023-07-14T18:29:49.193 INFO:teuthology.orchestra.run.smithi184.stdout: "take_sum": 15447633, 2023-07-14T18:29:49.194 INFO:teuthology.orchestra.run.smithi184.stdout: "put": 1535, 2023-07-14T18:29:49.194 INFO:teuthology.orchestra.run.smithi184.stdout: "put_sum": 15447633, 2023-07-14T18:29:49.194 INFO:teuthology.orchestra.run.smithi184.stdout: "wait": { 2023-07-14T18:29:49.194 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2023-07-14T18:29:49.194 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2023-07-14T18:29:49.195 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2023-07-14T18:29:49.195 INFO:teuthology.orchestra.run.smithi184.stdout: } 2023-07-14T18:29:49.195 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2023-07-14T18:29:49.195 INFO:teuthology.orchestra.run.smithi184.stdout: "throttle-objecter_ops": { 2023-07-14T18:29:49.195 INFO:teuthology.orchestra.run.smithi184.stdout: "val": 0, 2023-07-14T18:29:49.195 INFO:teuthology.orchestra.run.smithi184.stdout: "max": 1024, 2023-07-14T18:29:49.196 INFO:teuthology.orchestra.run.smithi184.stdout: "get_started": 0, 2023-07-14T18:29:49.196 INFO:teuthology.orchestra.run.smithi184.stdout: "get": 0, 2023-07-14T18:29:49.196 INFO:teuthology.orchestra.run.smithi184.stdout: "get_sum": 0, 2023-07-14T18:29:49.196 INFO:teuthology.orchestra.run.smithi184.stdout: "get_or_fail_fail": 0, 2023-07-14T18:29:49.196 INFO:teuthology.orchestra.run.smithi184.stdout: "get_or_fail_success": 0, 2023-07-14T18:29:49.197 INFO:teuthology.orchestra.run.smithi184.stdout: "take": 1535, 2023-07-14T18:29:49.197 INFO:teuthology.orchestra.run.smithi184.stdout: "take_sum": 1535, 2023-07-14T18:29:49.197 INFO:teuthology.orchestra.run.smithi184.stdout: "put": 1535, 2023-07-14T18:29:49.197 INFO:teuthology.orchestra.run.smithi184.stdout: "put_sum": 1535, 2023-07-14T18:29:49.197 INFO:teuthology.orchestra.run.smithi184.stdout: "wait": { 2023-07-14T18:29:49.198 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2023-07-14T18:29:49.198 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2023-07-14T18:29:49.198 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2023-07-14T18:29:49.198 INFO:teuthology.orchestra.run.smithi184.stdout: } 2023-07-14T18:29:49.198 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2023-07-14T18:29:49.199 INFO:teuthology.orchestra.run.smithi184.stdout: "throttle-write_buf_throttle": { 2023-07-14T18:29:49.199 INFO:teuthology.orchestra.run.smithi184.stdout: "val": 0, 2023-07-14T18:29:49.199 INFO:teuthology.orchestra.run.smithi184.stdout: "max": 3758096384, 2023-07-14T18:29:49.199 INFO:teuthology.orchestra.run.smithi184.stdout: "get_started": 0, 2023-07-14T18:29:49.199 INFO:teuthology.orchestra.run.smithi184.stdout: "get": 226, 2023-07-14T18:29:49.200 INFO:teuthology.orchestra.run.smithi184.stdout: "get_sum": 24634, 2023-07-14T18:29:49.200 INFO:teuthology.orchestra.run.smithi184.stdout: "get_or_fail_fail": 0, 2023-07-14T18:29:49.200 INFO:teuthology.orchestra.run.smithi184.stdout: "get_or_fail_success": 226, 2023-07-14T18:29:49.200 INFO:teuthology.orchestra.run.smithi184.stdout: "take": 0, 2023-07-14T18:29:49.200 INFO:teuthology.orchestra.run.smithi184.stdout: "take_sum": 0, 2023-07-14T18:29:49.201 INFO:teuthology.orchestra.run.smithi184.stdout: "put": 58, 2023-07-14T18:29:49.201 INFO:teuthology.orchestra.run.smithi184.stdout: "put_sum": 24634, 2023-07-14T18:29:49.201 INFO:teuthology.orchestra.run.smithi184.stdout: "wait": { 2023-07-14T18:29:49.201 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2023-07-14T18:29:49.201 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2023-07-14T18:29:49.202 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2023-07-14T18:29:49.202 INFO:teuthology.orchestra.run.smithi184.stdout: } 2023-07-14T18:29:49.202 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2023-07-14T18:29:49.202 INFO:teuthology.orchestra.run.smithi184.stdout: "throttle-write_buf_throttle-0x5623345660a0": { 2023-07-14T18:29:49.202 INFO:teuthology.orchestra.run.smithi184.stdout: "val": 0, 2023-07-14T18:29:49.203 INFO:teuthology.orchestra.run.smithi184.stdout: "max": 3758096384, 2023-07-14T18:29:49.203 INFO:teuthology.orchestra.run.smithi184.stdout: "get_started": 0, 2023-07-14T18:29:49.203 INFO:teuthology.orchestra.run.smithi184.stdout: "get": 22223, 2023-07-14T18:29:49.203 INFO:teuthology.orchestra.run.smithi184.stdout: "get_sum": 15357463, 2023-07-14T18:29:49.203 INFO:teuthology.orchestra.run.smithi184.stdout: "get_or_fail_fail": 0, 2023-07-14T18:29:49.203 INFO:teuthology.orchestra.run.smithi184.stdout: "get_or_fail_success": 22223, 2023-07-14T18:29:49.204 INFO:teuthology.orchestra.run.smithi184.stdout: "take": 0, 2023-07-14T18:29:49.204 INFO:teuthology.orchestra.run.smithi184.stdout: "take_sum": 0, 2023-07-14T18:29:49.204 INFO:teuthology.orchestra.run.smithi184.stdout: "put": 572, 2023-07-14T18:29:49.204 INFO:teuthology.orchestra.run.smithi184.stdout: "put_sum": 15357463, 2023-07-14T18:29:49.204 INFO:teuthology.orchestra.run.smithi184.stdout: "wait": { 2023-07-14T18:29:49.205 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2023-07-14T18:29:49.205 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2023-07-14T18:29:49.205 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2023-07-14T18:29:49.205 INFO:teuthology.orchestra.run.smithi184.stdout: } 2023-07-14T18:29:49.205 INFO:teuthology.orchestra.run.smithi184.stdout: } 2023-07-14T18:29:49.206 INFO:teuthology.orchestra.run.smithi184.stdout:} 2023-07-14T18:29:49.206 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:29:48 smithi184 ceph-mon[98481]: pgmap v814: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-07-14T18:29:49.208 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:29:48 smithi163 ceph-mon[96576]: pgmap v814: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-07-14T18:29:49.266 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:29:48 smithi172 ceph-mon[97983]: pgmap v814: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2023-07-14T18:29:49.533 INFO:tasks.check_counter:Daemon mds.c mds.exported=0 2023-07-14T18:29:49.533 INFO:tasks.check_counter:Daemon mds.c mds.imported=45 2023-07-14T18:29:49.534 INFO:tasks.check_counter:Daemon mds.c mds_cache.dir_update=97 2023-07-14T18:29:49.534 INFO:tasks.check_counter:Daemon mds.c mds_cache.dir_update_receipt=373 2023-07-14T18:29:49.534 INFO:tasks.check_counter:Daemon mds.c mds.dir_split=0 2023-07-14T18:29:49.534 DEBUG:tasks.check_counter:Getting stats from f 2023-07-14T18:29:49.535 DEBUG:teuthology.orchestra.run.smithi184:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81c9387d2e7576da065747ec9c16d1c7d69016ec shell --fsid bf7326ec-2270-11ee-9b33-001a4aab830c -- ceph daemon mds.f perf dump 2023-07-14T18:29:50.185 INFO:teuthology.orchestra.run.smithi184.stderr:Inferring config /var/lib/ceph/bf7326ec-2270-11ee-9b33-001a4aab830c/mon.c/config 2023-07-14T18:29:51.166 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:29:50 smithi184 ceph-mon[98481]: pgmap v815: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-07-14T18:29:51.208 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:29:50 smithi163 ceph-mon[96576]: pgmap v815: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-07-14T18:29:51.266 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:29:50 smithi172 ceph-mon[97983]: pgmap v815: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-07-14T18:29:52.415 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:29:52 smithi184 ceph-mon[98481]: pgmap v816: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-07-14T18:29:52.458 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:29:52 smithi163 ceph-mon[96576]: pgmap v816: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-07-14T18:29:52.516 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:29:52 smithi172 ceph-mon[97983]: pgmap v816: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-07-14T18:29:55.165 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:29:54 smithi184 ceph-mon[98481]: pgmap v817: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-07-14T18:29:55.208 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:29:54 smithi163 ceph-mon[96576]: pgmap v817: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-07-14T18:29:55.266 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:29:54 smithi172 ceph-mon[97983]: pgmap v817: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-07-14T18:29:56.957 INFO:teuthology.orchestra.run.smithi184.stdout:{ 2023-07-14T18:29:56.958 INFO:teuthology.orchestra.run.smithi184.stdout: "AsyncMessenger::Worker-0": { 2023-07-14T18:29:56.958 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_recv_messages": 1658, 2023-07-14T18:29:56.958 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_send_messages": 1641, 2023-07-14T18:29:56.959 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_recv_bytes": 13612343, 2023-07-14T18:29:56.959 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_send_bytes": 588687, 2023-07-14T18:29:56.959 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_created_connections": 6, 2023-07-14T18:29:56.959 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_active_connections": 2, 2023-07-14T18:29:56.959 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_running_total_time": 0.153006663, 2023-07-14T18:29:56.960 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_running_send_time": 0.042302040, 2023-07-14T18:29:56.960 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_running_recv_time": 0.050606713, 2023-07-14T18:29:56.960 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_running_fast_dispatch_time": 0.050045747, 2023-07-14T18:29:56.960 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_send_messages_queue_lat": { 2023-07-14T18:29:56.960 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 1640, 2023-07-14T18:29:56.961 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.047364596, 2023-07-14T18:29:56.961 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000028880 2023-07-14T18:29:56.961 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2023-07-14T18:29:56.961 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_handle_ack_lat": { 2023-07-14T18:29:56.961 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2023-07-14T18:29:56.961 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2023-07-14T18:29:56.962 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2023-07-14T18:29:56.962 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2023-07-14T18:29:56.962 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_recv_encrypted_bytes": 598656, 2023-07-14T18:29:56.962 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_send_encrypted_bytes": 176608 2023-07-14T18:29:56.962 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2023-07-14T18:29:56.963 INFO:teuthology.orchestra.run.smithi184.stdout: "AsyncMessenger::Worker-1": { 2023-07-14T18:29:56.963 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_recv_messages": 1172, 2023-07-14T18:29:56.963 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_send_messages": 1402, 2023-07-14T18:29:56.963 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_recv_bytes": 23368161, 2023-07-14T18:29:56.963 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_send_bytes": 918116, 2023-07-14T18:29:56.964 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_created_connections": 7, 2023-07-14T18:29:56.964 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_active_connections": 5, 2023-07-14T18:29:56.964 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_running_total_time": 0.094269025, 2023-07-14T18:29:56.964 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_running_send_time": 0.025400339, 2023-07-14T18:29:56.964 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_running_recv_time": 0.032234855, 2023-07-14T18:29:56.964 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_running_fast_dispatch_time": 0.028720678, 2023-07-14T18:29:56.965 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_send_messages_queue_lat": { 2023-07-14T18:29:56.965 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 1401, 2023-07-14T18:29:56.965 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.035608284, 2023-07-14T18:29:56.965 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000025416 2023-07-14T18:29:56.965 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2023-07-14T18:29:56.966 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_handle_ack_lat": { 2023-07-14T18:29:56.966 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2023-07-14T18:29:56.966 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2023-07-14T18:29:56.966 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2023-07-14T18:29:56.966 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2023-07-14T18:29:56.967 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_recv_encrypted_bytes": 3280, 2023-07-14T18:29:56.967 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_send_encrypted_bytes": 555424 2023-07-14T18:29:56.967 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2023-07-14T18:29:56.967 INFO:teuthology.orchestra.run.smithi184.stdout: "AsyncMessenger::Worker-2": { 2023-07-14T18:29:56.967 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_recv_messages": 1006, 2023-07-14T18:29:56.968 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_send_messages": 1008, 2023-07-14T18:29:56.968 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_recv_bytes": 12831278, 2023-07-14T18:29:56.968 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_send_bytes": 312873, 2023-07-14T18:29:56.968 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_created_connections": 5, 2023-07-14T18:29:56.968 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_active_connections": 4, 2023-07-14T18:29:56.968 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_running_total_time": 0.085658470, 2023-07-14T18:29:56.969 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_running_send_time": 0.024149064, 2023-07-14T18:29:56.969 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_running_recv_time": 0.022312546, 2023-07-14T18:29:56.969 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_running_fast_dispatch_time": 0.033102528, 2023-07-14T18:29:56.969 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_send_messages_queue_lat": { 2023-07-14T18:29:56.969 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 1006, 2023-07-14T18:29:56.970 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.027941701, 2023-07-14T18:29:56.970 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000027775 2023-07-14T18:29:56.970 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2023-07-14T18:29:56.970 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_handle_ack_lat": { 2023-07-14T18:29:56.970 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2023-07-14T18:29:56.971 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2023-07-14T18:29:56.971 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2023-07-14T18:29:56.971 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2023-07-14T18:29:56.971 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_recv_encrypted_bytes": 0, 2023-07-14T18:29:56.971 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_send_encrypted_bytes": 0 2023-07-14T18:29:56.972 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2023-07-14T18:29:56.972 INFO:teuthology.orchestra.run.smithi184.stdout: "cct": { 2023-07-14T18:29:56.972 INFO:teuthology.orchestra.run.smithi184.stdout: "total_workers": 1, 2023-07-14T18:29:56.972 INFO:teuthology.orchestra.run.smithi184.stdout: "unhealthy_workers": 0 2023-07-14T18:29:56.972 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2023-07-14T18:29:56.972 INFO:teuthology.orchestra.run.smithi184.stdout: "finisher-MDSRank": { 2023-07-14T18:29:56.973 INFO:teuthology.orchestra.run.smithi184.stdout: "queue_len": 0, 2023-07-14T18:29:56.973 INFO:teuthology.orchestra.run.smithi184.stdout: "complete_latency": { 2023-07-14T18:29:56.973 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 5723, 2023-07-14T18:29:56.973 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.152556055, 2023-07-14T18:29:56.973 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000026656 2023-07-14T18:29:56.974 INFO:teuthology.orchestra.run.smithi184.stdout: } 2023-07-14T18:29:56.974 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2023-07-14T18:29:56.974 INFO:teuthology.orchestra.run.smithi184.stdout: "finisher-PurgeQueue": { 2023-07-14T18:29:56.974 INFO:teuthology.orchestra.run.smithi184.stdout: "queue_len": 0, 2023-07-14T18:29:56.974 INFO:teuthology.orchestra.run.smithi184.stdout: "complete_latency": { 2023-07-14T18:29:56.975 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2023-07-14T18:29:56.975 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2023-07-14T18:29:56.975 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2023-07-14T18:29:56.975 INFO:teuthology.orchestra.run.smithi184.stdout: } 2023-07-14T18:29:56.975 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2023-07-14T18:29:56.976 INFO:teuthology.orchestra.run.smithi184.stdout: "mds": { 2023-07-14T18:29:56.976 INFO:teuthology.orchestra.run.smithi184.stdout: "request": 0, 2023-07-14T18:29:56.976 INFO:teuthology.orchestra.run.smithi184.stdout: "reply": 0, 2023-07-14T18:29:56.976 INFO:teuthology.orchestra.run.smithi184.stdout: "reply_latency": { 2023-07-14T18:29:56.976 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2023-07-14T18:29:56.977 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2023-07-14T18:29:56.977 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2023-07-14T18:29:56.977 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2023-07-14T18:29:56.977 INFO:teuthology.orchestra.run.smithi184.stdout: "slow_reply": 0, 2023-07-14T18:29:56.977 INFO:teuthology.orchestra.run.smithi184.stdout: "forward": 0, 2023-07-14T18:29:56.978 INFO:teuthology.orchestra.run.smithi184.stdout: "dir_fetch_complete": 0, 2023-07-14T18:29:56.978 INFO:teuthology.orchestra.run.smithi184.stdout: "dir_fetch_keys": 0, 2023-07-14T18:29:56.978 INFO:teuthology.orchestra.run.smithi184.stdout: "dir_commit": 0, 2023-07-14T18:29:56.978 INFO:teuthology.orchestra.run.smithi184.stdout: "dir_split": 0, 2023-07-14T18:29:56.978 INFO:teuthology.orchestra.run.smithi184.stdout: "dir_merge": 0, 2023-07-14T18:29:56.978 INFO:teuthology.orchestra.run.smithi184.stdout: "inodes": 2213, 2023-07-14T18:29:56.979 INFO:teuthology.orchestra.run.smithi184.stdout: "inodes_top": 0, 2023-07-14T18:29:56.979 INFO:teuthology.orchestra.run.smithi184.stdout: "inodes_bottom": 0, 2023-07-14T18:29:56.979 INFO:teuthology.orchestra.run.smithi184.stdout: "inodes_pin_tail": 2213, 2023-07-14T18:29:56.979 INFO:teuthology.orchestra.run.smithi184.stdout: "inodes_pinned": 2213, 2023-07-14T18:29:56.979 INFO:teuthology.orchestra.run.smithi184.stdout: "inodes_expired": 0, 2023-07-14T18:29:56.980 INFO:teuthology.orchestra.run.smithi184.stdout: "inodes_with_caps": 0, 2023-07-14T18:29:56.980 INFO:teuthology.orchestra.run.smithi184.stdout: "caps": 0, 2023-07-14T18:29:56.980 INFO:teuthology.orchestra.run.smithi184.stdout: "subtrees": 3, 2023-07-14T18:29:56.980 INFO:teuthology.orchestra.run.smithi184.stdout: "traverse": 0, 2023-07-14T18:29:56.980 INFO:teuthology.orchestra.run.smithi184.stdout: "traverse_hit": 0, 2023-07-14T18:29:56.981 INFO:teuthology.orchestra.run.smithi184.stdout: "traverse_forward": 0, 2023-07-14T18:29:56.981 INFO:teuthology.orchestra.run.smithi184.stdout: "traverse_discover": 0, 2023-07-14T18:29:56.981 INFO:teuthology.orchestra.run.smithi184.stdout: "traverse_dir_fetch": 0, 2023-07-14T18:29:56.981 INFO:teuthology.orchestra.run.smithi184.stdout: "traverse_remote_ino": 0, 2023-07-14T18:29:56.981 INFO:teuthology.orchestra.run.smithi184.stdout: "traverse_lock": 0, 2023-07-14T18:29:56.982 INFO:teuthology.orchestra.run.smithi184.stdout: "load_cent": 0, 2023-07-14T18:29:56.982 INFO:teuthology.orchestra.run.smithi184.stdout: "q": 0, 2023-07-14T18:29:56.982 INFO:teuthology.orchestra.run.smithi184.stdout: "exported": 0, 2023-07-14T18:29:56.982 INFO:teuthology.orchestra.run.smithi184.stdout: "exported_inodes": 0, 2023-07-14T18:29:56.982 INFO:teuthology.orchestra.run.smithi184.stdout: "imported": 0, 2023-07-14T18:29:56.982 INFO:teuthology.orchestra.run.smithi184.stdout: "imported_inodes": 0, 2023-07-14T18:29:56.983 INFO:teuthology.orchestra.run.smithi184.stdout: "openino_dir_fetch": 0, 2023-07-14T18:29:56.983 INFO:teuthology.orchestra.run.smithi184.stdout: "openino_backtrace_fetch": 0, 2023-07-14T18:29:56.983 INFO:teuthology.orchestra.run.smithi184.stdout: "openino_peer_discover": 0, 2023-07-14T18:29:56.983 INFO:teuthology.orchestra.run.smithi184.stdout: "root_rfiles": 3563, 2023-07-14T18:29:56.983 INFO:teuthology.orchestra.run.smithi184.stdout: "root_rbytes": 33808819, 2023-07-14T18:29:56.984 INFO:teuthology.orchestra.run.smithi184.stdout: "root_rsnaps": 0, 2023-07-14T18:29:56.984 INFO:teuthology.orchestra.run.smithi184.stdout: "scrub_backtrace_fetch": 0, 2023-07-14T18:29:56.984 INFO:teuthology.orchestra.run.smithi184.stdout: "scrub_set_tag": 0, 2023-07-14T18:29:56.984 INFO:teuthology.orchestra.run.smithi184.stdout: "scrub_backtrace_repaired": 0, 2023-07-14T18:29:56.984 INFO:teuthology.orchestra.run.smithi184.stdout: "scrub_inotable_repaired": 0, 2023-07-14T18:29:56.985 INFO:teuthology.orchestra.run.smithi184.stdout: "scrub_dir_inodes": 0, 2023-07-14T18:29:56.985 INFO:teuthology.orchestra.run.smithi184.stdout: "scrub_dir_base_inodes": 0, 2023-07-14T18:29:56.985 INFO:teuthology.orchestra.run.smithi184.stdout: "scrub_dirfrag_rstats": 0, 2023-07-14T18:29:56.985 INFO:teuthology.orchestra.run.smithi184.stdout: "scrub_file_inodes": 0, 2023-07-14T18:29:56.985 INFO:teuthology.orchestra.run.smithi184.stdout: "handle_inode_file_caps": 0, 2023-07-14T18:29:56.986 INFO:teuthology.orchestra.run.smithi184.stdout: "ceph_cap_op_revoke": 0, 2023-07-14T18:29:56.986 INFO:teuthology.orchestra.run.smithi184.stdout: "ceph_cap_op_grant": 0, 2023-07-14T18:29:56.986 INFO:teuthology.orchestra.run.smithi184.stdout: "ceph_cap_op_trunc": 0, 2023-07-14T18:29:56.986 INFO:teuthology.orchestra.run.smithi184.stdout: "ceph_cap_op_flushsnap_ack": 0, 2023-07-14T18:29:56.986 INFO:teuthology.orchestra.run.smithi184.stdout: "ceph_cap_op_flush_ack": 0, 2023-07-14T18:29:56.986 INFO:teuthology.orchestra.run.smithi184.stdout: "handle_client_caps": 0, 2023-07-14T18:29:56.987 INFO:teuthology.orchestra.run.smithi184.stdout: "handle_client_caps_dirty": 0, 2023-07-14T18:29:56.987 INFO:teuthology.orchestra.run.smithi184.stdout: "handle_client_cap_release": 0, 2023-07-14T18:29:56.987 INFO:teuthology.orchestra.run.smithi184.stdout: "process_request_cap_release": 0 2023-07-14T18:29:56.987 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2023-07-14T18:29:56.987 INFO:teuthology.orchestra.run.smithi184.stdout: "mds_cache": { 2023-07-14T18:29:56.988 INFO:teuthology.orchestra.run.smithi184.stdout: "dir_update": 0, 2023-07-14T18:29:56.988 INFO:teuthology.orchestra.run.smithi184.stdout: "dir_update_receipt": 0, 2023-07-14T18:29:56.988 INFO:teuthology.orchestra.run.smithi184.stdout: "dir_try_discover": 0, 2023-07-14T18:29:56.988 INFO:teuthology.orchestra.run.smithi184.stdout: "dir_send_discover": 0, 2023-07-14T18:29:56.988 INFO:teuthology.orchestra.run.smithi184.stdout: "dir_handle_discover": 0, 2023-07-14T18:29:56.989 INFO:teuthology.orchestra.run.smithi184.stdout: "num_strays": 0, 2023-07-14T18:29:56.989 INFO:teuthology.orchestra.run.smithi184.stdout: "num_strays_delayed": 0, 2023-07-14T18:29:56.989 INFO:teuthology.orchestra.run.smithi184.stdout: "num_strays_enqueuing": 0, 2023-07-14T18:29:56.989 INFO:teuthology.orchestra.run.smithi184.stdout: "strays_created": 0, 2023-07-14T18:29:56.989 INFO:teuthology.orchestra.run.smithi184.stdout: "strays_enqueued": 0, 2023-07-14T18:29:56.990 INFO:teuthology.orchestra.run.smithi184.stdout: "strays_reintegrated": 0, 2023-07-14T18:29:56.990 INFO:teuthology.orchestra.run.smithi184.stdout: "strays_migrated": 0, 2023-07-14T18:29:56.990 INFO:teuthology.orchestra.run.smithi184.stdout: "num_recovering_processing": 0, 2023-07-14T18:29:56.990 INFO:teuthology.orchestra.run.smithi184.stdout: "num_recovering_enqueued": 0, 2023-07-14T18:29:56.990 INFO:teuthology.orchestra.run.smithi184.stdout: "num_recovering_prioritized": 0, 2023-07-14T18:29:56.990 INFO:teuthology.orchestra.run.smithi184.stdout: "recovery_started": 0, 2023-07-14T18:29:56.991 INFO:teuthology.orchestra.run.smithi184.stdout: "recovery_completed": 0, 2023-07-14T18:29:56.991 INFO:teuthology.orchestra.run.smithi184.stdout: "ireq_enqueue_scrub": 0, 2023-07-14T18:29:56.991 INFO:teuthology.orchestra.run.smithi184.stdout: "ireq_exportdir": 0, 2023-07-14T18:29:56.991 INFO:teuthology.orchestra.run.smithi184.stdout: "ireq_flush": 0, 2023-07-14T18:29:56.991 INFO:teuthology.orchestra.run.smithi184.stdout: "ireq_fragmentdir": 0, 2023-07-14T18:29:56.992 INFO:teuthology.orchestra.run.smithi184.stdout: "ireq_fragstats": 0, 2023-07-14T18:29:56.992 INFO:teuthology.orchestra.run.smithi184.stdout: "ireq_inodestats": 0 2023-07-14T18:29:56.992 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2023-07-14T18:29:56.992 INFO:teuthology.orchestra.run.smithi184.stdout: "mds_log": { 2023-07-14T18:29:56.992 INFO:teuthology.orchestra.run.smithi184.stdout: "evadd": 0, 2023-07-14T18:29:56.993 INFO:teuthology.orchestra.run.smithi184.stdout: "evex": 0, 2023-07-14T18:29:56.993 INFO:teuthology.orchestra.run.smithi184.stdout: "evtrm": 0, 2023-07-14T18:29:56.993 INFO:teuthology.orchestra.run.smithi184.stdout: "ev": 0, 2023-07-14T18:29:56.993 INFO:teuthology.orchestra.run.smithi184.stdout: "evexg": 0, 2023-07-14T18:29:56.993 INFO:teuthology.orchestra.run.smithi184.stdout: "evexd": 0, 2023-07-14T18:29:56.994 INFO:teuthology.orchestra.run.smithi184.stdout: "segadd": 0, 2023-07-14T18:29:56.994 INFO:teuthology.orchestra.run.smithi184.stdout: "segex": 0, 2023-07-14T18:29:56.994 INFO:teuthology.orchestra.run.smithi184.stdout: "segtrm": 0, 2023-07-14T18:29:56.994 INFO:teuthology.orchestra.run.smithi184.stdout: "seg": 26, 2023-07-14T18:29:56.994 INFO:teuthology.orchestra.run.smithi184.stdout: "segexg": 0, 2023-07-14T18:29:56.995 INFO:teuthology.orchestra.run.smithi184.stdout: "segexd": 0, 2023-07-14T18:29:56.995 INFO:teuthology.orchestra.run.smithi184.stdout: "expos": 4194304, 2023-07-14T18:29:56.995 INFO:teuthology.orchestra.run.smithi184.stdout: "wrpos": 0, 2023-07-14T18:29:56.995 INFO:teuthology.orchestra.run.smithi184.stdout: "rdpos": 52421001, 2023-07-14T18:29:56.995 INFO:teuthology.orchestra.run.smithi184.stdout: "jlat": { 2023-07-14T18:29:56.995 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2023-07-14T18:29:56.996 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2023-07-14T18:29:56.996 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2023-07-14T18:29:56.996 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2023-07-14T18:29:56.996 INFO:teuthology.orchestra.run.smithi184.stdout: "replayed": 20043 2023-07-14T18:29:56.996 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2023-07-14T18:29:56.997 INFO:teuthology.orchestra.run.smithi184.stdout: "mds_mem": { 2023-07-14T18:29:56.997 INFO:teuthology.orchestra.run.smithi184.stdout: "ino": 32, 2023-07-14T18:29:56.997 INFO:teuthology.orchestra.run.smithi184.stdout: "ino+": 5630, 2023-07-14T18:29:56.997 INFO:teuthology.orchestra.run.smithi184.stdout: "ino-": 5598, 2023-07-14T18:29:56.997 INFO:teuthology.orchestra.run.smithi184.stdout: "dir": 22, 2023-07-14T18:29:56.998 INFO:teuthology.orchestra.run.smithi184.stdout: "dir+": 269, 2023-07-14T18:29:56.998 INFO:teuthology.orchestra.run.smithi184.stdout: "dir-": 247, 2023-07-14T18:29:56.998 INFO:teuthology.orchestra.run.smithi184.stdout: "dn": 2213, 2023-07-14T18:29:56.998 INFO:teuthology.orchestra.run.smithi184.stdout: "dn+": 6680, 2023-07-14T18:29:56.998 INFO:teuthology.orchestra.run.smithi184.stdout: "dn-": 4467, 2023-07-14T18:29:56.998 INFO:teuthology.orchestra.run.smithi184.stdout: "cap": 0, 2023-07-14T18:29:56.999 INFO:teuthology.orchestra.run.smithi184.stdout: "cap+": 0, 2023-07-14T18:29:56.999 INFO:teuthology.orchestra.run.smithi184.stdout: "cap-": 0, 2023-07-14T18:29:56.999 INFO:teuthology.orchestra.run.smithi184.stdout: "rss": 57736, 2023-07-14T18:29:56.999 INFO:teuthology.orchestra.run.smithi184.stdout: "heap": 207152 2023-07-14T18:29:56.999 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2023-07-14T18:29:57.000 INFO:teuthology.orchestra.run.smithi184.stdout: "mds_server": { 2023-07-14T18:29:57.000 INFO:teuthology.orchestra.run.smithi184.stdout: "dispatch_client_request": 0, 2023-07-14T18:29:57.000 INFO:teuthology.orchestra.run.smithi184.stdout: "dispatch_server_request": 0, 2023-07-14T18:29:57.000 INFO:teuthology.orchestra.run.smithi184.stdout: "handle_client_request": 0, 2023-07-14T18:29:57.000 INFO:teuthology.orchestra.run.smithi184.stdout: "handle_client_session": 0, 2023-07-14T18:29:57.001 INFO:teuthology.orchestra.run.smithi184.stdout: "handle_peer_request": 0, 2023-07-14T18:29:57.001 INFO:teuthology.orchestra.run.smithi184.stdout: "req_create_latency": { 2023-07-14T18:29:57.001 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2023-07-14T18:29:57.001 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2023-07-14T18:29:57.001 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2023-07-14T18:29:57.002 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2023-07-14T18:29:57.002 INFO:teuthology.orchestra.run.smithi184.stdout: "req_getattr_latency": { 2023-07-14T18:29:57.002 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2023-07-14T18:29:57.002 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2023-07-14T18:29:57.002 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2023-07-14T18:29:57.002 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2023-07-14T18:29:57.003 INFO:teuthology.orchestra.run.smithi184.stdout: "req_getfilelock_latency": { 2023-07-14T18:29:57.003 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2023-07-14T18:29:57.003 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2023-07-14T18:29:57.003 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2023-07-14T18:29:57.003 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2023-07-14T18:29:57.004 INFO:teuthology.orchestra.run.smithi184.stdout: "req_link_latency": { 2023-07-14T18:29:57.004 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2023-07-14T18:29:57.004 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2023-07-14T18:29:57.004 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2023-07-14T18:29:57.004 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2023-07-14T18:29:57.005 INFO:teuthology.orchestra.run.smithi184.stdout: "req_lookup_latency": { 2023-07-14T18:29:57.005 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2023-07-14T18:29:57.005 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2023-07-14T18:29:57.005 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2023-07-14T18:29:57.005 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2023-07-14T18:29:57.006 INFO:teuthology.orchestra.run.smithi184.stdout: "req_lookuphash_latency": { 2023-07-14T18:29:57.006 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2023-07-14T18:29:57.006 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2023-07-14T18:29:57.006 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2023-07-14T18:29:57.006 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2023-07-14T18:29:57.006 INFO:teuthology.orchestra.run.smithi184.stdout: "req_lookupino_latency": { 2023-07-14T18:29:57.007 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2023-07-14T18:29:57.007 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2023-07-14T18:29:57.007 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2023-07-14T18:29:57.007 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2023-07-14T18:29:57.007 INFO:teuthology.orchestra.run.smithi184.stdout: "req_lookupname_latency": { 2023-07-14T18:29:57.008 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2023-07-14T18:29:57.008 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2023-07-14T18:29:57.008 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2023-07-14T18:29:57.008 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2023-07-14T18:29:57.008 INFO:teuthology.orchestra.run.smithi184.stdout: "req_lookupparent_latency": { 2023-07-14T18:29:57.009 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2023-07-14T18:29:57.009 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2023-07-14T18:29:57.009 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2023-07-14T18:29:57.009 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2023-07-14T18:29:57.009 INFO:teuthology.orchestra.run.smithi184.stdout: "req_lookupsnap_latency": { 2023-07-14T18:29:57.009 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2023-07-14T18:29:57.011 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2023-07-14T18:29:57.011 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2023-07-14T18:29:57.012 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2023-07-14T18:29:57.012 INFO:teuthology.orchestra.run.smithi184.stdout: "req_lssnap_latency": { 2023-07-14T18:29:57.012 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2023-07-14T18:29:57.012 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2023-07-14T18:29:57.012 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2023-07-14T18:29:57.013 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2023-07-14T18:29:57.013 INFO:teuthology.orchestra.run.smithi184.stdout: "req_mkdir_latency": { 2023-07-14T18:29:57.013 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2023-07-14T18:29:57.013 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2023-07-14T18:29:57.013 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2023-07-14T18:29:57.014 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2023-07-14T18:29:57.014 INFO:teuthology.orchestra.run.smithi184.stdout: "req_mknod_latency": { 2023-07-14T18:29:57.014 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2023-07-14T18:29:57.014 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2023-07-14T18:29:57.014 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2023-07-14T18:29:57.015 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2023-07-14T18:29:57.015 INFO:teuthology.orchestra.run.smithi184.stdout: "req_mksnap_latency": { 2023-07-14T18:29:57.015 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2023-07-14T18:29:57.015 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2023-07-14T18:29:57.015 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2023-07-14T18:29:57.016 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2023-07-14T18:29:57.016 INFO:teuthology.orchestra.run.smithi184.stdout: "req_open_latency": { 2023-07-14T18:29:57.016 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2023-07-14T18:29:57.016 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2023-07-14T18:29:57.016 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2023-07-14T18:29:57.017 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2023-07-14T18:29:57.017 INFO:teuthology.orchestra.run.smithi184.stdout: "req_readdir_latency": { 2023-07-14T18:29:57.017 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2023-07-14T18:29:57.017 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2023-07-14T18:29:57.017 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2023-07-14T18:29:57.017 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2023-07-14T18:29:57.018 INFO:teuthology.orchestra.run.smithi184.stdout: "req_rename_latency": { 2023-07-14T18:29:57.018 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2023-07-14T18:29:57.018 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2023-07-14T18:29:57.018 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2023-07-14T18:29:57.018 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2023-07-14T18:29:57.019 INFO:teuthology.orchestra.run.smithi184.stdout: "req_renamesnap_latency": { 2023-07-14T18:29:57.019 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2023-07-14T18:29:57.019 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2023-07-14T18:29:57.019 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2023-07-14T18:29:57.019 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2023-07-14T18:29:57.020 INFO:teuthology.orchestra.run.smithi184.stdout: "req_snapdiff_latency": { 2023-07-14T18:29:57.020 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2023-07-14T18:29:57.020 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2023-07-14T18:29:57.020 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2023-07-14T18:29:57.020 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2023-07-14T18:29:57.020 INFO:teuthology.orchestra.run.smithi184.stdout: "req_rmdir_latency": { 2023-07-14T18:29:57.021 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2023-07-14T18:29:57.021 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2023-07-14T18:29:57.021 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2023-07-14T18:29:57.021 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2023-07-14T18:29:57.021 INFO:teuthology.orchestra.run.smithi184.stdout: "req_rmsnap_latency": { 2023-07-14T18:29:57.022 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2023-07-14T18:29:57.022 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2023-07-14T18:29:57.022 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2023-07-14T18:29:57.022 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2023-07-14T18:29:57.022 INFO:teuthology.orchestra.run.smithi184.stdout: "req_rmxattr_latency": { 2023-07-14T18:29:57.023 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2023-07-14T18:29:57.023 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2023-07-14T18:29:57.023 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2023-07-14T18:29:57.023 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2023-07-14T18:29:57.023 INFO:teuthology.orchestra.run.smithi184.stdout: "req_setattr_latency": { 2023-07-14T18:29:57.024 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2023-07-14T18:29:57.024 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2023-07-14T18:29:57.024 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2023-07-14T18:29:57.024 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2023-07-14T18:29:57.024 INFO:teuthology.orchestra.run.smithi184.stdout: "req_setdirlayout_latency": { 2023-07-14T18:29:57.025 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2023-07-14T18:29:57.025 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2023-07-14T18:29:57.025 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2023-07-14T18:29:57.025 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2023-07-14T18:29:57.025 INFO:teuthology.orchestra.run.smithi184.stdout: "req_setfilelock_latency": { 2023-07-14T18:29:57.025 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2023-07-14T18:29:57.026 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2023-07-14T18:29:57.026 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2023-07-14T18:29:57.026 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2023-07-14T18:29:57.026 INFO:teuthology.orchestra.run.smithi184.stdout: "req_setlayout_latency": { 2023-07-14T18:29:57.026 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2023-07-14T18:29:57.027 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2023-07-14T18:29:57.027 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2023-07-14T18:29:57.027 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2023-07-14T18:29:57.027 INFO:teuthology.orchestra.run.smithi184.stdout: "req_setxattr_latency": { 2023-07-14T18:29:57.027 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2023-07-14T18:29:57.028 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2023-07-14T18:29:57.028 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2023-07-14T18:29:57.028 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2023-07-14T18:29:57.028 INFO:teuthology.orchestra.run.smithi184.stdout: "req_symlink_latency": { 2023-07-14T18:29:57.028 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2023-07-14T18:29:57.029 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2023-07-14T18:29:57.029 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2023-07-14T18:29:57.029 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2023-07-14T18:29:57.029 INFO:teuthology.orchestra.run.smithi184.stdout: "req_unlink_latency": { 2023-07-14T18:29:57.029 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2023-07-14T18:29:57.029 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2023-07-14T18:29:57.030 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2023-07-14T18:29:57.030 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2023-07-14T18:29:57.030 INFO:teuthology.orchestra.run.smithi184.stdout: "cap_revoke_eviction": 0, 2023-07-14T18:29:57.030 INFO:teuthology.orchestra.run.smithi184.stdout: "cap_acquisition_throttle": 0, 2023-07-14T18:29:57.030 INFO:teuthology.orchestra.run.smithi184.stdout: "req_getvxattr_latency": { 2023-07-14T18:29:57.031 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2023-07-14T18:29:57.031 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2023-07-14T18:29:57.031 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2023-07-14T18:29:57.031 INFO:teuthology.orchestra.run.smithi184.stdout: } 2023-07-14T18:29:57.031 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2023-07-14T18:29:57.032 INFO:teuthology.orchestra.run.smithi184.stdout: "mds_sessions": { 2023-07-14T18:29:57.032 INFO:teuthology.orchestra.run.smithi184.stdout: "session_count": 1, 2023-07-14T18:29:57.032 INFO:teuthology.orchestra.run.smithi184.stdout: "session_add": 3, 2023-07-14T18:29:57.032 INFO:teuthology.orchestra.run.smithi184.stdout: "session_remove": 2, 2023-07-14T18:29:57.032 INFO:teuthology.orchestra.run.smithi184.stdout: "sessions_open": 1, 2023-07-14T18:29:57.033 INFO:teuthology.orchestra.run.smithi184.stdout: "sessions_stale": 0, 2023-07-14T18:29:57.033 INFO:teuthology.orchestra.run.smithi184.stdout: "total_load": 0, 2023-07-14T18:29:57.033 INFO:teuthology.orchestra.run.smithi184.stdout: "average_load": 0, 2023-07-14T18:29:57.033 INFO:teuthology.orchestra.run.smithi184.stdout: "avg_session_uptime": 2658 2023-07-14T18:29:57.033 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2023-07-14T18:29:57.033 INFO:teuthology.orchestra.run.smithi184.stdout: "mempool": { 2023-07-14T18:29:57.034 INFO:teuthology.orchestra.run.smithi184.stdout: "bloom_filter_bytes": 0, 2023-07-14T18:29:57.034 INFO:teuthology.orchestra.run.smithi184.stdout: "bloom_filter_items": 0, 2023-07-14T18:29:57.034 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_alloc_bytes": 0, 2023-07-14T18:29:57.034 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_alloc_items": 0, 2023-07-14T18:29:57.034 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_cache_data_bytes": 0, 2023-07-14T18:29:57.035 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_cache_data_items": 0, 2023-07-14T18:29:57.035 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_cache_onode_bytes": 0, 2023-07-14T18:29:57.035 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_cache_onode_items": 0, 2023-07-14T18:29:57.035 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_cache_meta_bytes": 0, 2023-07-14T18:29:57.035 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_cache_meta_items": 0, 2023-07-14T18:29:57.036 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_cache_other_bytes": 0, 2023-07-14T18:29:57.036 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_cache_other_items": 0, 2023-07-14T18:29:57.036 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_cache_buffer_bytes": 0, 2023-07-14T18:29:57.036 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_cache_buffer_items": 0, 2023-07-14T18:29:57.036 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_extent_bytes": 0, 2023-07-14T18:29:57.037 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_extent_items": 0, 2023-07-14T18:29:57.037 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_blob_bytes": 0, 2023-07-14T18:29:57.037 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_blob_items": 0, 2023-07-14T18:29:57.037 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_shared_blob_bytes": 0, 2023-07-14T18:29:57.037 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_shared_blob_items": 0, 2023-07-14T18:29:57.037 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_inline_bl_bytes": 0, 2023-07-14T18:29:57.038 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_inline_bl_items": 0, 2023-07-14T18:29:57.038 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_fsck_bytes": 0, 2023-07-14T18:29:57.038 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_fsck_items": 0, 2023-07-14T18:29:57.038 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_txc_bytes": 0, 2023-07-14T18:29:57.038 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_txc_items": 0, 2023-07-14T18:29:57.039 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_writing_deferred_bytes": 0, 2023-07-14T18:29:57.039 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_writing_deferred_items": 0, 2023-07-14T18:29:57.039 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_writing_bytes": 0, 2023-07-14T18:29:57.039 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_writing_items": 0, 2023-07-14T18:29:57.039 INFO:teuthology.orchestra.run.smithi184.stdout: "bluefs_bytes": 0, 2023-07-14T18:29:57.040 INFO:teuthology.orchestra.run.smithi184.stdout: "bluefs_items": 0, 2023-07-14T18:29:57.040 INFO:teuthology.orchestra.run.smithi184.stdout: "bluefs_file_reader_bytes": 0, 2023-07-14T18:29:57.040 INFO:teuthology.orchestra.run.smithi184.stdout: "bluefs_file_reader_items": 0, 2023-07-14T18:29:57.040 INFO:teuthology.orchestra.run.smithi184.stdout: "bluefs_file_writer_bytes": 0, 2023-07-14T18:29:57.040 INFO:teuthology.orchestra.run.smithi184.stdout: "bluefs_file_writer_items": 0, 2023-07-14T18:29:57.041 INFO:teuthology.orchestra.run.smithi184.stdout: "buffer_anon_bytes": 215215, 2023-07-14T18:29:57.041 INFO:teuthology.orchestra.run.smithi184.stdout: "buffer_anon_items": 66, 2023-07-14T18:29:57.041 INFO:teuthology.orchestra.run.smithi184.stdout: "buffer_meta_bytes": 0, 2023-07-14T18:29:57.041 INFO:teuthology.orchestra.run.smithi184.stdout: "buffer_meta_items": 0, 2023-07-14T18:29:57.041 INFO:teuthology.orchestra.run.smithi184.stdout: "osd_bytes": 0, 2023-07-14T18:29:57.041 INFO:teuthology.orchestra.run.smithi184.stdout: "osd_items": 0, 2023-07-14T18:29:57.042 INFO:teuthology.orchestra.run.smithi184.stdout: "osd_mapbl_bytes": 0, 2023-07-14T18:29:57.042 INFO:teuthology.orchestra.run.smithi184.stdout: "osd_mapbl_items": 0, 2023-07-14T18:29:57.042 INFO:teuthology.orchestra.run.smithi184.stdout: "osd_pglog_bytes": 0, 2023-07-14T18:29:57.042 INFO:teuthology.orchestra.run.smithi184.stdout: "osd_pglog_items": 0, 2023-07-14T18:29:57.042 INFO:teuthology.orchestra.run.smithi184.stdout: "osdmap_bytes": 8792, 2023-07-14T18:29:57.043 INFO:teuthology.orchestra.run.smithi184.stdout: "osdmap_items": 168, 2023-07-14T18:29:57.043 INFO:teuthology.orchestra.run.smithi184.stdout: "osdmap_mapping_bytes": 0, 2023-07-14T18:29:57.043 INFO:teuthology.orchestra.run.smithi184.stdout: "osdmap_mapping_items": 0, 2023-07-14T18:29:57.043 INFO:teuthology.orchestra.run.smithi184.stdout: "pgmap_bytes": 0, 2023-07-14T18:29:57.043 INFO:teuthology.orchestra.run.smithi184.stdout: "pgmap_items": 0, 2023-07-14T18:29:57.044 INFO:teuthology.orchestra.run.smithi184.stdout: "mds_co_bytes": 1655234, 2023-07-14T18:29:57.044 INFO:teuthology.orchestra.run.smithi184.stdout: "mds_co_items": 9407, 2023-07-14T18:29:57.044 INFO:teuthology.orchestra.run.smithi184.stdout: "unittest_1_bytes": 0, 2023-07-14T18:29:57.044 INFO:teuthology.orchestra.run.smithi184.stdout: "unittest_1_items": 0, 2023-07-14T18:29:57.044 INFO:teuthology.orchestra.run.smithi184.stdout: "unittest_2_bytes": 0, 2023-07-14T18:29:57.045 INFO:teuthology.orchestra.run.smithi184.stdout: "unittest_2_items": 0 2023-07-14T18:29:57.045 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2023-07-14T18:29:57.045 INFO:teuthology.orchestra.run.smithi184.stdout: "objecter": { 2023-07-14T18:29:57.045 INFO:teuthology.orchestra.run.smithi184.stdout: "op_active": 0, 2023-07-14T18:29:57.045 INFO:teuthology.orchestra.run.smithi184.stdout: "op_laggy": 0, 2023-07-14T18:29:57.045 INFO:teuthology.orchestra.run.smithi184.stdout: "op_send": 3497, 2023-07-14T18:29:57.046 INFO:teuthology.orchestra.run.smithi184.stdout: "op_send_bytes": 26, 2023-07-14T18:29:57.046 INFO:teuthology.orchestra.run.smithi184.stdout: "op_resend": 4, 2023-07-14T18:29:57.046 INFO:teuthology.orchestra.run.smithi184.stdout: "op_reply": 3497, 2023-07-14T18:29:57.046 INFO:teuthology.orchestra.run.smithi184.stdout: "op_latency": { 2023-07-14T18:29:57.046 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 3497, 2023-07-14T18:29:57.047 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 1.645966870, 2023-07-14T18:29:57.047 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000470679 2023-07-14T18:29:57.047 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2023-07-14T18:29:57.047 INFO:teuthology.orchestra.run.smithi184.stdout: "op_inflight": 0, 2023-07-14T18:29:57.047 INFO:teuthology.orchestra.run.smithi184.stdout: "oplen_avg": { 2023-07-14T18:29:57.048 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 3497, 2023-07-14T18:29:57.048 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 3498 2023-07-14T18:29:57.048 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2023-07-14T18:29:57.048 INFO:teuthology.orchestra.run.smithi184.stdout: "op": 3497, 2023-07-14T18:29:57.048 INFO:teuthology.orchestra.run.smithi184.stdout: "op_r": 3497, 2023-07-14T18:29:57.049 INFO:teuthology.orchestra.run.smithi184.stdout: "op_w": 0, 2023-07-14T18:29:57.049 INFO:teuthology.orchestra.run.smithi184.stdout: "op_rmw": 0, 2023-07-14T18:29:57.049 INFO:teuthology.orchestra.run.smithi184.stdout: "op_pg": 0, 2023-07-14T18:29:57.050 INFO:teuthology.orchestra.run.smithi184.stdout: "osdop_stat": 2227, 2023-07-14T18:29:57.050 INFO:teuthology.orchestra.run.smithi184.stdout: "osdop_create": 0, 2023-07-14T18:29:57.050 INFO:teuthology.orchestra.run.smithi184.stdout: "osdop_read": 1267, 2023-07-14T18:29:57.050 INFO:teuthology.orchestra.run.smithi184.stdout: "osdop_write": 0, 2023-07-14T18:29:57.050 INFO:teuthology.orchestra.run.smithi184.stdout: "osdop_writefull": 0, 2023-07-14T18:29:57.051 INFO:teuthology.orchestra.run.smithi184.stdout: "osdop_writesame": 0, 2023-07-14T18:29:57.051 INFO:teuthology.orchestra.run.smithi184.stdout: "osdop_append": 0, 2023-07-14T18:29:57.051 INFO:teuthology.orchestra.run.smithi184.stdout: "osdop_zero": 0, 2023-07-14T18:29:57.051 INFO:teuthology.orchestra.run.smithi184.stdout: "osdop_truncate": 0, 2023-07-14T18:29:57.051 INFO:teuthology.orchestra.run.smithi184.stdout: "osdop_delete": 0, 2023-07-14T18:29:57.052 INFO:teuthology.orchestra.run.smithi184.stdout: "osdop_mapext": 0, 2023-07-14T18:29:57.052 INFO:teuthology.orchestra.run.smithi184.stdout: "osdop_sparse_read": 0, 2023-07-14T18:29:57.052 INFO:teuthology.orchestra.run.smithi184.stdout: "osdop_clonerange": 0, 2023-07-14T18:29:57.052 INFO:teuthology.orchestra.run.smithi184.stdout: "osdop_getxattr": 2, 2023-07-14T18:29:57.053 INFO:teuthology.orchestra.run.smithi184.stdout: "osdop_setxattr": 0, 2023-07-14T18:29:57.053 INFO:teuthology.orchestra.run.smithi184.stdout: "osdop_cmpxattr": 0, 2023-07-14T18:29:57.053 INFO:teuthology.orchestra.run.smithi184.stdout: "osdop_rmxattr": 0, 2023-07-14T18:29:57.053 INFO:teuthology.orchestra.run.smithi184.stdout: "osdop_resetxattrs": 0, 2023-07-14T18:29:57.053 INFO:teuthology.orchestra.run.smithi184.stdout: "osdop_call": 0, 2023-07-14T18:29:57.054 INFO:teuthology.orchestra.run.smithi184.stdout: "osdop_watch": 0, 2023-07-14T18:29:57.054 INFO:teuthology.orchestra.run.smithi184.stdout: "osdop_notify": 0, 2023-07-14T18:29:57.054 INFO:teuthology.orchestra.run.smithi184.stdout: "osdop_src_cmpxattr": 0, 2023-07-14T18:29:57.054 INFO:teuthology.orchestra.run.smithi184.stdout: "osdop_pgls": 0, 2023-07-14T18:29:57.054 INFO:teuthology.orchestra.run.smithi184.stdout: "osdop_pgls_filter": 0, 2023-07-14T18:29:57.055 INFO:teuthology.orchestra.run.smithi184.stdout: "osdop_other": 0, 2023-07-14T18:29:57.055 INFO:teuthology.orchestra.run.smithi184.stdout: "linger_active": 0, 2023-07-14T18:29:57.055 INFO:teuthology.orchestra.run.smithi184.stdout: "linger_send": 0, 2023-07-14T18:29:57.055 INFO:teuthology.orchestra.run.smithi184.stdout: "linger_resend": 0, 2023-07-14T18:29:57.055 INFO:teuthology.orchestra.run.smithi184.stdout: "linger_ping": 0, 2023-07-14T18:29:57.056 INFO:teuthology.orchestra.run.smithi184.stdout: "poolop_active": 0, 2023-07-14T18:29:57.056 INFO:teuthology.orchestra.run.smithi184.stdout: "poolop_send": 0, 2023-07-14T18:29:57.056 INFO:teuthology.orchestra.run.smithi184.stdout: "poolop_resend": 0, 2023-07-14T18:29:57.056 INFO:teuthology.orchestra.run.smithi184.stdout: "poolstat_active": 0, 2023-07-14T18:29:57.056 INFO:teuthology.orchestra.run.smithi184.stdout: "poolstat_send": 0, 2023-07-14T18:29:57.057 INFO:teuthology.orchestra.run.smithi184.stdout: "poolstat_resend": 0, 2023-07-14T18:29:57.057 INFO:teuthology.orchestra.run.smithi184.stdout: "statfs_active": 0, 2023-07-14T18:29:57.057 INFO:teuthology.orchestra.run.smithi184.stdout: "statfs_send": 0, 2023-07-14T18:29:57.057 INFO:teuthology.orchestra.run.smithi184.stdout: "statfs_resend": 0, 2023-07-14T18:29:57.057 INFO:teuthology.orchestra.run.smithi184.stdout: "command_active": 0, 2023-07-14T18:29:57.058 INFO:teuthology.orchestra.run.smithi184.stdout: "command_send": 0, 2023-07-14T18:29:57.058 INFO:teuthology.orchestra.run.smithi184.stdout: "command_resend": 0, 2023-07-14T18:29:57.058 INFO:teuthology.orchestra.run.smithi184.stdout: "map_epoch": 88, 2023-07-14T18:29:57.058 INFO:teuthology.orchestra.run.smithi184.stdout: "map_full": 0, 2023-07-14T18:29:57.058 INFO:teuthology.orchestra.run.smithi184.stdout: "map_inc": 4, 2023-07-14T18:29:57.059 INFO:teuthology.orchestra.run.smithi184.stdout: "osd_sessions": 8, 2023-07-14T18:29:57.059 INFO:teuthology.orchestra.run.smithi184.stdout: "osd_session_open": 8, 2023-07-14T18:29:57.059 INFO:teuthology.orchestra.run.smithi184.stdout: "osd_session_close": 0, 2023-07-14T18:29:57.059 INFO:teuthology.orchestra.run.smithi184.stdout: "osd_laggy": 0, 2023-07-14T18:29:57.059 INFO:teuthology.orchestra.run.smithi184.stdout: "omap_wr": 0, 2023-07-14T18:29:57.060 INFO:teuthology.orchestra.run.smithi184.stdout: "omap_rd": 2, 2023-07-14T18:29:57.060 INFO:teuthology.orchestra.run.smithi184.stdout: "omap_del": 0 2023-07-14T18:29:57.060 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2023-07-14T18:29:57.060 INFO:teuthology.orchestra.run.smithi184.stdout: "oft": { 2023-07-14T18:29:57.060 INFO:teuthology.orchestra.run.smithi184.stdout: "omap_total_objs": 0, 2023-07-14T18:29:57.061 INFO:teuthology.orchestra.run.smithi184.stdout: "omap_total_kv_pairs": 0, 2023-07-14T18:29:57.061 INFO:teuthology.orchestra.run.smithi184.stdout: "omap_total_updates": 0, 2023-07-14T18:29:57.061 INFO:teuthology.orchestra.run.smithi184.stdout: "omap_total_removes": 0 2023-07-14T18:29:57.061 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2023-07-14T18:29:57.061 INFO:teuthology.orchestra.run.smithi184.stdout: "osd-slow-ops": { 2023-07-14T18:29:57.061 INFO:teuthology.orchestra.run.smithi184.stdout: "slow_ops_count": 0 2023-07-14T18:29:57.062 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2023-07-14T18:29:57.062 INFO:teuthology.orchestra.run.smithi184.stdout: "purge_queue": { 2023-07-14T18:29:57.062 INFO:teuthology.orchestra.run.smithi184.stdout: "pq_executing_ops": 0, 2023-07-14T18:29:57.062 INFO:teuthology.orchestra.run.smithi184.stdout: "pq_executing_ops_high_water": 0, 2023-07-14T18:29:57.062 INFO:teuthology.orchestra.run.smithi184.stdout: "pq_executing": 0, 2023-07-14T18:29:57.063 INFO:teuthology.orchestra.run.smithi184.stdout: "pq_executing_high_water": 0, 2023-07-14T18:29:57.063 INFO:teuthology.orchestra.run.smithi184.stdout: "pq_executed": 0, 2023-07-14T18:29:57.063 INFO:teuthology.orchestra.run.smithi184.stdout: "pq_item_in_journal": 0 2023-07-14T18:29:57.063 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2023-07-14T18:29:57.063 INFO:teuthology.orchestra.run.smithi184.stdout: "throttle-msgr_dispatch_throttler-mds": { 2023-07-14T18:29:57.064 INFO:teuthology.orchestra.run.smithi184.stdout: "val": 0, 2023-07-14T18:29:57.064 INFO:teuthology.orchestra.run.smithi184.stdout: "max": 104857600, 2023-07-14T18:29:57.064 INFO:teuthology.orchestra.run.smithi184.stdout: "get_started": 0, 2023-07-14T18:29:57.064 INFO:teuthology.orchestra.run.smithi184.stdout: "get": 3832, 2023-07-14T18:29:57.064 INFO:teuthology.orchestra.run.smithi184.stdout: "get_sum": 49446822, 2023-07-14T18:29:57.065 INFO:teuthology.orchestra.run.smithi184.stdout: "get_or_fail_fail": 0, 2023-07-14T18:29:57.065 INFO:teuthology.orchestra.run.smithi184.stdout: "get_or_fail_success": 3832, 2023-07-14T18:29:57.065 INFO:teuthology.orchestra.run.smithi184.stdout: "take": 0, 2023-07-14T18:29:57.065 INFO:teuthology.orchestra.run.smithi184.stdout: "take_sum": 0, 2023-07-14T18:29:57.065 INFO:teuthology.orchestra.run.smithi184.stdout: "put": 3832, 2023-07-14T18:29:57.066 INFO:teuthology.orchestra.run.smithi184.stdout: "put_sum": 49446822, 2023-07-14T18:29:57.066 INFO:teuthology.orchestra.run.smithi184.stdout: "wait": { 2023-07-14T18:29:57.066 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2023-07-14T18:29:57.066 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2023-07-14T18:29:57.066 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2023-07-14T18:29:57.066 INFO:teuthology.orchestra.run.smithi184.stdout: } 2023-07-14T18:29:57.067 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2023-07-14T18:29:57.067 INFO:teuthology.orchestra.run.smithi184.stdout: "throttle-objecter_bytes": { 2023-07-14T18:29:57.067 INFO:teuthology.orchestra.run.smithi184.stdout: "val": 0, 2023-07-14T18:29:57.067 INFO:teuthology.orchestra.run.smithi184.stdout: "max": 104857600, 2023-07-14T18:29:57.067 INFO:teuthology.orchestra.run.smithi184.stdout: "get_started": 0, 2023-07-14T18:29:57.068 INFO:teuthology.orchestra.run.smithi184.stdout: "get": 0, 2023-07-14T18:29:57.068 INFO:teuthology.orchestra.run.smithi184.stdout: "get_sum": 0, 2023-07-14T18:29:57.068 INFO:teuthology.orchestra.run.smithi184.stdout: "get_or_fail_fail": 0, 2023-07-14T18:29:57.068 INFO:teuthology.orchestra.run.smithi184.stdout: "get_or_fail_success": 0, 2023-07-14T18:29:57.068 INFO:teuthology.orchestra.run.smithi184.stdout: "take": 3497, 2023-07-14T18:29:57.069 INFO:teuthology.orchestra.run.smithi184.stdout: "take_sum": 48230272, 2023-07-14T18:29:57.069 INFO:teuthology.orchestra.run.smithi184.stdout: "put": 3497, 2023-07-14T18:29:57.069 INFO:teuthology.orchestra.run.smithi184.stdout: "put_sum": 48230272, 2023-07-14T18:29:57.069 INFO:teuthology.orchestra.run.smithi184.stdout: "wait": { 2023-07-14T18:29:57.069 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2023-07-14T18:29:57.070 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2023-07-14T18:29:57.070 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2023-07-14T18:29:57.070 INFO:teuthology.orchestra.run.smithi184.stdout: } 2023-07-14T18:29:57.070 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2023-07-14T18:29:57.070 INFO:teuthology.orchestra.run.smithi184.stdout: "throttle-objecter_ops": { 2023-07-14T18:29:57.070 INFO:teuthology.orchestra.run.smithi184.stdout: "val": 0, 2023-07-14T18:29:57.071 INFO:teuthology.orchestra.run.smithi184.stdout: "max": 1024, 2023-07-14T18:29:57.071 INFO:teuthology.orchestra.run.smithi184.stdout: "get_started": 0, 2023-07-14T18:29:57.071 INFO:teuthology.orchestra.run.smithi184.stdout: "get": 0, 2023-07-14T18:29:57.071 INFO:teuthology.orchestra.run.smithi184.stdout: "get_sum": 0, 2023-07-14T18:29:57.071 INFO:teuthology.orchestra.run.smithi184.stdout: "get_or_fail_fail": 0, 2023-07-14T18:29:57.072 INFO:teuthology.orchestra.run.smithi184.stdout: "get_or_fail_success": 0, 2023-07-14T18:29:57.072 INFO:teuthology.orchestra.run.smithi184.stdout: "take": 3497, 2023-07-14T18:29:57.072 INFO:teuthology.orchestra.run.smithi184.stdout: "take_sum": 3497, 2023-07-14T18:29:57.072 INFO:teuthology.orchestra.run.smithi184.stdout: "put": 3497, 2023-07-14T18:29:57.072 INFO:teuthology.orchestra.run.smithi184.stdout: "put_sum": 3497, 2023-07-14T18:29:57.073 INFO:teuthology.orchestra.run.smithi184.stdout: "wait": { 2023-07-14T18:29:57.073 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2023-07-14T18:29:57.073 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2023-07-14T18:29:57.073 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2023-07-14T18:29:57.073 INFO:teuthology.orchestra.run.smithi184.stdout: } 2023-07-14T18:29:57.074 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2023-07-14T18:29:57.074 INFO:teuthology.orchestra.run.smithi184.stdout: "throttle-write_buf_throttle": { 2023-07-14T18:29:57.074 INFO:teuthology.orchestra.run.smithi184.stdout: "val": 0, 2023-07-14T18:29:57.074 INFO:teuthology.orchestra.run.smithi184.stdout: "max": 3758096384, 2023-07-14T18:29:57.074 INFO:teuthology.orchestra.run.smithi184.stdout: "get_started": 0, 2023-07-14T18:29:57.075 INFO:teuthology.orchestra.run.smithi184.stdout: "get": 0, 2023-07-14T18:29:57.075 INFO:teuthology.orchestra.run.smithi184.stdout: "get_sum": 0, 2023-07-14T18:29:57.075 INFO:teuthology.orchestra.run.smithi184.stdout: "get_or_fail_fail": 0, 2023-07-14T18:29:57.075 INFO:teuthology.orchestra.run.smithi184.stdout: "get_or_fail_success": 0, 2023-07-14T18:29:57.075 INFO:teuthology.orchestra.run.smithi184.stdout: "take": 0, 2023-07-14T18:29:57.076 INFO:teuthology.orchestra.run.smithi184.stdout: "take_sum": 0, 2023-07-14T18:29:57.076 INFO:teuthology.orchestra.run.smithi184.stdout: "put": 0, 2023-07-14T18:29:57.076 INFO:teuthology.orchestra.run.smithi184.stdout: "put_sum": 0, 2023-07-14T18:29:57.076 INFO:teuthology.orchestra.run.smithi184.stdout: "wait": { 2023-07-14T18:29:57.076 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2023-07-14T18:29:57.077 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2023-07-14T18:29:57.077 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2023-07-14T18:29:57.077 INFO:teuthology.orchestra.run.smithi184.stdout: } 2023-07-14T18:29:57.077 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2023-07-14T18:29:57.077 INFO:teuthology.orchestra.run.smithi184.stdout: "throttle-write_buf_throttle-0x557a6ce08460": { 2023-07-14T18:29:57.077 INFO:teuthology.orchestra.run.smithi184.stdout: "val": 0, 2023-07-14T18:29:57.078 INFO:teuthology.orchestra.run.smithi184.stdout: "max": 3758096384, 2023-07-14T18:29:57.078 INFO:teuthology.orchestra.run.smithi184.stdout: "get_started": 0, 2023-07-14T18:29:57.078 INFO:teuthology.orchestra.run.smithi184.stdout: "get": 0, 2023-07-14T18:29:57.078 INFO:teuthology.orchestra.run.smithi184.stdout: "get_sum": 0, 2023-07-14T18:29:57.078 INFO:teuthology.orchestra.run.smithi184.stdout: "get_or_fail_fail": 0, 2023-07-14T18:29:57.079 INFO:teuthology.orchestra.run.smithi184.stdout: "get_or_fail_success": 0, 2023-07-14T18:29:57.079 INFO:teuthology.orchestra.run.smithi184.stdout: "take": 0, 2023-07-14T18:29:57.079 INFO:teuthology.orchestra.run.smithi184.stdout: "take_sum": 0, 2023-07-14T18:29:57.079 INFO:teuthology.orchestra.run.smithi184.stdout: "put": 0, 2023-07-14T18:29:57.079 INFO:teuthology.orchestra.run.smithi184.stdout: "put_sum": 0, 2023-07-14T18:29:57.080 INFO:teuthology.orchestra.run.smithi184.stdout: "wait": { 2023-07-14T18:29:57.080 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2023-07-14T18:29:57.080 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2023-07-14T18:29:57.080 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2023-07-14T18:29:57.080 INFO:teuthology.orchestra.run.smithi184.stdout: } 2023-07-14T18:29:57.081 INFO:teuthology.orchestra.run.smithi184.stdout: } 2023-07-14T18:29:57.081 INFO:teuthology.orchestra.run.smithi184.stdout:} 2023-07-14T18:29:57.165 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:29:56 smithi184 ceph-mon[98481]: pgmap v818: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-07-14T18:29:57.207 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:29:56 smithi163 ceph-mon[96576]: pgmap v818: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-07-14T18:29:57.266 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:29:56 smithi172 ceph-mon[97983]: pgmap v818: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-07-14T18:29:59.165 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:29:58 smithi184 ceph-mon[98481]: pgmap v819: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-07-14T18:29:59.207 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:29:58 smithi163 ceph-mon[96576]: pgmap v819: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-07-14T18:29:59.266 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:29:58 smithi172 ceph-mon[97983]: pgmap v819: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-07-14T18:30:00.448 INFO:tasks.check_counter:Daemon mds.f mds.exported=0 2023-07-14T18:30:00.448 INFO:tasks.check_counter:Daemon mds.f mds.imported=0 2023-07-14T18:30:00.449 INFO:tasks.check_counter:Daemon mds.f mds_cache.dir_update=0 2023-07-14T18:30:00.449 INFO:tasks.check_counter:Daemon mds.f mds_cache.dir_update_receipt=0 2023-07-14T18:30:00.449 INFO:tasks.check_counter:Daemon mds.f mds.dir_split=0 2023-07-14T18:30:00.449 DEBUG:tasks.check_counter:Getting stats from i 2023-07-14T18:30:00.450 DEBUG:teuthology.orchestra.run.smithi184:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81c9387d2e7576da065747ec9c16d1c7d69016ec shell --fsid bf7326ec-2270-11ee-9b33-001a4aab830c -- ceph daemon mds.i perf dump 2023-07-14T18:30:01.165 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:30:00 smithi184 ceph-mon[98481]: pgmap v820: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-07-14T18:30:01.165 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:30:00 smithi184 ceph-mon[98481]: overall HEALTH_OK 2023-07-14T18:30:01.207 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:30:00 smithi163 ceph-mon[96576]: pgmap v820: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-07-14T18:30:01.208 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:30:00 smithi163 ceph-mon[96576]: overall HEALTH_OK 2023-07-14T18:30:01.266 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:30:00 smithi172 ceph-mon[97983]: pgmap v820: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-07-14T18:30:01.266 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:30:00 smithi172 ceph-mon[97983]: overall HEALTH_OK 2023-07-14T18:30:02.415 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:30:02 smithi184 ceph-mon[98481]: pgmap v821: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-07-14T18:30:02.457 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:30:02 smithi163 ceph-mon[96576]: pgmap v821: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-07-14T18:30:02.516 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:30:02 smithi172 ceph-mon[97983]: pgmap v821: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-07-14T18:30:03.132 INFO:teuthology.orchestra.run.smithi184.stderr:Inferring config /var/lib/ceph/bf7326ec-2270-11ee-9b33-001a4aab830c/mon.c/config 2023-07-14T18:30:05.126 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:30:04 smithi184 ceph-mon[98481]: pgmap v822: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-07-14T18:30:05.207 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:30:04 smithi163 ceph-mon[96576]: pgmap v822: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-07-14T18:30:05.265 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:30:04 smithi172 ceph-mon[97983]: pgmap v822: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-07-14T18:30:07.164 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:30:06 smithi184 ceph-mon[98481]: pgmap v823: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-07-14T18:30:07.207 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:30:06 smithi163 ceph-mon[96576]: pgmap v823: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-07-14T18:30:07.265 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:30:06 smithi172 ceph-mon[97983]: pgmap v823: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-07-14T18:30:08.764 INFO:teuthology.orchestra.run.smithi184.stdout:{ 2023-07-14T18:30:08.764 INFO:teuthology.orchestra.run.smithi184.stdout: "AsyncMessenger::Worker-0": { 2023-07-14T18:30:08.764 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_recv_messages": 5789106, 2023-07-14T18:30:08.765 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_send_messages": 5783858, 2023-07-14T18:30:08.765 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_recv_bytes": 950712887, 2023-07-14T18:30:08.765 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_send_bytes": 947426987, 2023-07-14T18:30:08.765 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_created_connections": 11, 2023-07-14T18:30:08.765 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_active_connections": 4, 2023-07-14T18:30:08.766 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_running_total_time": 220.307304580, 2023-07-14T18:30:08.766 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_running_send_time": 98.004808191, 2023-07-14T18:30:08.766 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_running_recv_time": 151.100902960, 2023-07-14T18:30:08.766 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_running_fast_dispatch_time": 0.035045050, 2023-07-14T18:30:08.766 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_send_messages_queue_lat": { 2023-07-14T18:30:08.767 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 5783856, 2023-07-14T18:30:08.767 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 54.433572505, 2023-07-14T18:30:08.767 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000009411 2023-07-14T18:30:08.767 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2023-07-14T18:30:08.767 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_handle_ack_lat": { 2023-07-14T18:30:08.768 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 11544080, 2023-07-14T18:30:08.768 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 1.170892912, 2023-07-14T18:30:08.768 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000101 2023-07-14T18:30:08.769 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2023-07-14T18:30:08.769 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_recv_encrypted_bytes": 0, 2023-07-14T18:30:08.769 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_send_encrypted_bytes": 0 2023-07-14T18:30:08.769 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2023-07-14T18:30:08.769 INFO:teuthology.orchestra.run.smithi184.stdout: "AsyncMessenger::Worker-1": { 2023-07-14T18:30:08.770 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_recv_messages": 5232744, 2023-07-14T18:30:08.770 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_send_messages": 5233224, 2023-07-14T18:30:08.770 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_recv_bytes": 828156522, 2023-07-14T18:30:08.770 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_send_bytes": 871927860, 2023-07-14T18:30:08.770 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_created_connections": 15, 2023-07-14T18:30:08.771 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_active_connections": 5, 2023-07-14T18:30:08.771 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_running_total_time": 159.654766999, 2023-07-14T18:30:08.771 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_running_send_time": 61.391159402, 2023-07-14T18:30:08.771 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_running_recv_time": 113.007438994, 2023-07-14T18:30:08.771 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_running_fast_dispatch_time": 0.004526196, 2023-07-14T18:30:08.772 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_send_messages_queue_lat": { 2023-07-14T18:30:08.772 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 5233223, 2023-07-14T18:30:08.772 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 46.414901880, 2023-07-14T18:30:08.772 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000008869 2023-07-14T18:30:08.772 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2023-07-14T18:30:08.773 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_handle_ack_lat": { 2023-07-14T18:30:08.773 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 10464251, 2023-07-14T18:30:08.773 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.951579898, 2023-07-14T18:30:08.773 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000090 2023-07-14T18:30:08.774 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2023-07-14T18:30:08.774 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_recv_encrypted_bytes": 3120, 2023-07-14T18:30:08.774 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_send_encrypted_bytes": 482656 2023-07-14T18:30:08.774 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2023-07-14T18:30:08.774 INFO:teuthology.orchestra.run.smithi184.stdout: "AsyncMessenger::Worker-2": { 2023-07-14T18:30:08.775 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_recv_messages": 415324, 2023-07-14T18:30:08.775 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_send_messages": 415122, 2023-07-14T18:30:08.775 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_recv_bytes": 66390875, 2023-07-14T18:30:08.775 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_send_bytes": 67857817, 2023-07-14T18:30:08.775 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_created_connections": 16, 2023-07-14T18:30:08.776 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_active_connections": 8, 2023-07-14T18:30:08.776 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_running_total_time": 14.748316189, 2023-07-14T18:30:08.776 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_running_send_time": 5.662708848, 2023-07-14T18:30:08.776 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_running_recv_time": 10.828305745, 2023-07-14T18:30:08.776 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_running_fast_dispatch_time": 0.018384877, 2023-07-14T18:30:08.777 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_send_messages_queue_lat": { 2023-07-14T18:30:08.777 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 415121, 2023-07-14T18:30:08.777 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 4.246056535, 2023-07-14T18:30:08.777 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000010228 2023-07-14T18:30:08.777 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2023-07-14T18:30:08.777 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_handle_ack_lat": { 2023-07-14T18:30:08.778 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 828605, 2023-07-14T18:30:08.778 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.100056792, 2023-07-14T18:30:08.778 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000120 2023-07-14T18:30:08.778 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2023-07-14T18:30:08.779 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_recv_encrypted_bytes": 614816, 2023-07-14T18:30:08.779 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_send_encrypted_bytes": 185184 2023-07-14T18:30:08.779 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2023-07-14T18:30:08.779 INFO:teuthology.orchestra.run.smithi184.stdout: "cct": { 2023-07-14T18:30:08.779 INFO:teuthology.orchestra.run.smithi184.stdout: "total_workers": 1, 2023-07-14T18:30:08.780 INFO:teuthology.orchestra.run.smithi184.stdout: "unhealthy_workers": 0 2023-07-14T18:30:08.780 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2023-07-14T18:30:08.780 INFO:teuthology.orchestra.run.smithi184.stdout: "finisher-MDSRank": { 2023-07-14T18:30:08.780 INFO:teuthology.orchestra.run.smithi184.stdout: "queue_len": 0, 2023-07-14T18:30:08.781 INFO:teuthology.orchestra.run.smithi184.stdout: "complete_latency": { 2023-07-14T18:30:08.781 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 1455, 2023-07-14T18:30:08.781 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.921315434, 2023-07-14T18:30:08.781 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000633206 2023-07-14T18:30:08.781 INFO:teuthology.orchestra.run.smithi184.stdout: } 2023-07-14T18:30:08.782 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2023-07-14T18:30:08.782 INFO:teuthology.orchestra.run.smithi184.stdout: "finisher-PurgeQueue": { 2023-07-14T18:30:08.782 INFO:teuthology.orchestra.run.smithi184.stdout: "queue_len": 0, 2023-07-14T18:30:08.782 INFO:teuthology.orchestra.run.smithi184.stdout: "complete_latency": { 2023-07-14T18:30:08.782 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 523, 2023-07-14T18:30:08.783 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.033123572, 2023-07-14T18:30:08.783 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000063333 2023-07-14T18:30:08.783 INFO:teuthology.orchestra.run.smithi184.stdout: } 2023-07-14T18:30:08.783 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2023-07-14T18:30:08.783 INFO:teuthology.orchestra.run.smithi184.stdout: "mds": { 2023-07-14T18:30:08.783 INFO:teuthology.orchestra.run.smithi184.stdout: "request": 5330, 2023-07-14T18:30:08.784 INFO:teuthology.orchestra.run.smithi184.stdout: "reply": 1698, 2023-07-14T18:30:08.784 INFO:teuthology.orchestra.run.smithi184.stdout: "reply_latency": { 2023-07-14T18:30:08.784 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 1698, 2023-07-14T18:30:08.784 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 8.649923366, 2023-07-14T18:30:08.784 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.005094183 2023-07-14T18:30:08.785 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2023-07-14T18:30:08.785 INFO:teuthology.orchestra.run.smithi184.stdout: "slow_reply": 0, 2023-07-14T18:30:08.785 INFO:teuthology.orchestra.run.smithi184.stdout: "forward": 3632, 2023-07-14T18:30:08.786 INFO:teuthology.orchestra.run.smithi184.stdout: "dir_fetch_complete": 0, 2023-07-14T18:30:08.786 INFO:teuthology.orchestra.run.smithi184.stdout: "dir_fetch_keys": 0, 2023-07-14T18:30:08.786 INFO:teuthology.orchestra.run.smithi184.stdout: "dir_commit": 11, 2023-07-14T18:30:08.786 INFO:teuthology.orchestra.run.smithi184.stdout: "dir_split": 0, 2023-07-14T18:30:08.786 INFO:teuthology.orchestra.run.smithi184.stdout: "dir_merge": 0, 2023-07-14T18:30:08.787 INFO:teuthology.orchestra.run.smithi184.stdout: "inodes": 441, 2023-07-14T18:30:08.787 INFO:teuthology.orchestra.run.smithi184.stdout: "inodes_top": 23, 2023-07-14T18:30:08.787 INFO:teuthology.orchestra.run.smithi184.stdout: "inodes_bottom": 112, 2023-07-14T18:30:08.787 INFO:teuthology.orchestra.run.smithi184.stdout: "inodes_pin_tail": 306, 2023-07-14T18:30:08.787 INFO:teuthology.orchestra.run.smithi184.stdout: "inodes_pinned": 409, 2023-07-14T18:30:08.788 INFO:teuthology.orchestra.run.smithi184.stdout: "inodes_expired": 1040, 2023-07-14T18:30:08.788 INFO:teuthology.orchestra.run.smithi184.stdout: "inodes_with_caps": 330, 2023-07-14T18:30:08.788 INFO:teuthology.orchestra.run.smithi184.stdout: "caps": 330, 2023-07-14T18:30:08.788 INFO:teuthology.orchestra.run.smithi184.stdout: "subtrees": 15, 2023-07-14T18:30:08.788 INFO:teuthology.orchestra.run.smithi184.stdout: "traverse": 8164, 2023-07-14T18:30:08.789 INFO:teuthology.orchestra.run.smithi184.stdout: "traverse_hit": 1319, 2023-07-14T18:30:08.789 INFO:teuthology.orchestra.run.smithi184.stdout: "traverse_forward": 3632, 2023-07-14T18:30:08.789 INFO:teuthology.orchestra.run.smithi184.stdout: "traverse_discover": 46, 2023-07-14T18:30:08.789 INFO:teuthology.orchestra.run.smithi184.stdout: "traverse_dir_fetch": 0, 2023-07-14T18:30:08.789 INFO:teuthology.orchestra.run.smithi184.stdout: "traverse_remote_ino": 0, 2023-07-14T18:30:08.790 INFO:teuthology.orchestra.run.smithi184.stdout: "traverse_lock": 3, 2023-07-14T18:30:08.790 INFO:teuthology.orchestra.run.smithi184.stdout: "load_cent": 0, 2023-07-14T18:30:08.790 INFO:teuthology.orchestra.run.smithi184.stdout: "q": 0, 2023-07-14T18:30:08.790 INFO:teuthology.orchestra.run.smithi184.stdout: "exported": 3, 2023-07-14T18:30:08.790 INFO:teuthology.orchestra.run.smithi184.stdout: "exported_inodes": 994, 2023-07-14T18:30:08.791 INFO:teuthology.orchestra.run.smithi184.stdout: "imported": 42, 2023-07-14T18:30:08.791 INFO:teuthology.orchestra.run.smithi184.stdout: "imported_inodes": 1289, 2023-07-14T18:30:08.791 INFO:teuthology.orchestra.run.smithi184.stdout: "openino_dir_fetch": 0, 2023-07-14T18:30:08.791 INFO:teuthology.orchestra.run.smithi184.stdout: "openino_backtrace_fetch": 515, 2023-07-14T18:30:08.792 INFO:teuthology.orchestra.run.smithi184.stdout: "openino_peer_discover": 0, 2023-07-14T18:30:08.792 INFO:teuthology.orchestra.run.smithi184.stdout: "root_rfiles": 3563, 2023-07-14T18:30:08.792 INFO:teuthology.orchestra.run.smithi184.stdout: "root_rbytes": 33808819, 2023-07-14T18:30:08.793 INFO:teuthology.orchestra.run.smithi184.stdout: "root_rsnaps": 0, 2023-07-14T18:30:08.793 INFO:teuthology.orchestra.run.smithi184.stdout: "scrub_backtrace_fetch": 515, 2023-07-14T18:30:08.794 INFO:teuthology.orchestra.run.smithi184.stdout: "scrub_set_tag": 0, 2023-07-14T18:30:08.794 INFO:teuthology.orchestra.run.smithi184.stdout: "scrub_backtrace_repaired": 0, 2023-07-14T18:30:08.794 INFO:teuthology.orchestra.run.smithi184.stdout: "scrub_inotable_repaired": 0, 2023-07-14T18:30:08.795 INFO:teuthology.orchestra.run.smithi184.stdout: "scrub_dir_inodes": 17, 2023-07-14T18:30:08.795 INFO:teuthology.orchestra.run.smithi184.stdout: "scrub_dir_base_inodes": 0, 2023-07-14T18:30:08.796 INFO:teuthology.orchestra.run.smithi184.stdout: "scrub_dirfrag_rstats": 17, 2023-07-14T18:30:08.796 INFO:teuthology.orchestra.run.smithi184.stdout: "scrub_file_inodes": 498, 2023-07-14T18:30:08.796 INFO:teuthology.orchestra.run.smithi184.stdout: "handle_inode_file_caps": 0, 2023-07-14T18:30:08.797 INFO:teuthology.orchestra.run.smithi184.stdout: "ceph_cap_op_revoke": 67, 2023-07-14T18:30:08.797 INFO:teuthology.orchestra.run.smithi184.stdout: "ceph_cap_op_grant": 447, 2023-07-14T18:30:08.798 INFO:teuthology.orchestra.run.smithi184.stdout: "ceph_cap_op_trunc": 2, 2023-07-14T18:30:08.798 INFO:teuthology.orchestra.run.smithi184.stdout: "ceph_cap_op_flushsnap_ack": 0, 2023-07-14T18:30:08.798 INFO:teuthology.orchestra.run.smithi184.stdout: "ceph_cap_op_flush_ack": 0, 2023-07-14T18:30:08.799 INFO:teuthology.orchestra.run.smithi184.stdout: "handle_client_caps": 2883, 2023-07-14T18:30:08.799 INFO:teuthology.orchestra.run.smithi184.stdout: "handle_client_caps_dirty": 443, 2023-07-14T18:30:08.799 INFO:teuthology.orchestra.run.smithi184.stdout: "handle_client_cap_release": 28, 2023-07-14T18:30:08.799 INFO:teuthology.orchestra.run.smithi184.stdout: "process_request_cap_release": 649 2023-07-14T18:30:08.799 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2023-07-14T18:30:08.800 INFO:teuthology.orchestra.run.smithi184.stdout: "mds_cache": { 2023-07-14T18:30:08.800 INFO:teuthology.orchestra.run.smithi184.stdout: "dir_update": 57, 2023-07-14T18:30:08.800 INFO:teuthology.orchestra.run.smithi184.stdout: "dir_update_receipt": 407, 2023-07-14T18:30:08.800 INFO:teuthology.orchestra.run.smithi184.stdout: "dir_try_discover": 213, 2023-07-14T18:30:08.801 INFO:teuthology.orchestra.run.smithi184.stdout: "dir_send_discover": 390, 2023-07-14T18:30:08.801 INFO:teuthology.orchestra.run.smithi184.stdout: "dir_handle_discover": 96, 2023-07-14T18:30:08.801 INFO:teuthology.orchestra.run.smithi184.stdout: "num_strays": 0, 2023-07-14T18:30:08.801 INFO:teuthology.orchestra.run.smithi184.stdout: "num_strays_delayed": 0, 2023-07-14T18:30:08.801 INFO:teuthology.orchestra.run.smithi184.stdout: "num_strays_enqueuing": 0, 2023-07-14T18:30:08.802 INFO:teuthology.orchestra.run.smithi184.stdout: "strays_created": 177, 2023-07-14T18:30:08.802 INFO:teuthology.orchestra.run.smithi184.stdout: "strays_enqueued": 177, 2023-07-14T18:30:08.802 INFO:teuthology.orchestra.run.smithi184.stdout: "strays_reintegrated": 0, 2023-07-14T18:30:08.802 INFO:teuthology.orchestra.run.smithi184.stdout: "strays_migrated": 0, 2023-07-14T18:30:08.802 INFO:teuthology.orchestra.run.smithi184.stdout: "num_recovering_processing": 0, 2023-07-14T18:30:08.802 INFO:teuthology.orchestra.run.smithi184.stdout: "num_recovering_enqueued": 0, 2023-07-14T18:30:08.803 INFO:teuthology.orchestra.run.smithi184.stdout: "num_recovering_prioritized": 0, 2023-07-14T18:30:08.803 INFO:teuthology.orchestra.run.smithi184.stdout: "recovery_started": 0, 2023-07-14T18:30:08.803 INFO:teuthology.orchestra.run.smithi184.stdout: "recovery_completed": 0, 2023-07-14T18:30:08.803 INFO:teuthology.orchestra.run.smithi184.stdout: "ireq_enqueue_scrub": 0, 2023-07-14T18:30:08.804 INFO:teuthology.orchestra.run.smithi184.stdout: "ireq_exportdir": 4, 2023-07-14T18:30:08.804 INFO:teuthology.orchestra.run.smithi184.stdout: "ireq_flush": 0, 2023-07-14T18:30:08.804 INFO:teuthology.orchestra.run.smithi184.stdout: "ireq_fragmentdir": 0, 2023-07-14T18:30:08.804 INFO:teuthology.orchestra.run.smithi184.stdout: "ireq_fragstats": 0, 2023-07-14T18:30:08.804 INFO:teuthology.orchestra.run.smithi184.stdout: "ireq_inodestats": 0 2023-07-14T18:30:08.805 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2023-07-14T18:30:08.805 INFO:teuthology.orchestra.run.smithi184.stdout: "mds_log": { 2023-07-14T18:30:08.805 INFO:teuthology.orchestra.run.smithi184.stdout: "evadd": 8957, 2023-07-14T18:30:08.805 INFO:teuthology.orchestra.run.smithi184.stdout: "evex": 0, 2023-07-14T18:30:08.805 INFO:teuthology.orchestra.run.smithi184.stdout: "evtrm": 0, 2023-07-14T18:30:08.806 INFO:teuthology.orchestra.run.smithi184.stdout: "ev": 8957, 2023-07-14T18:30:08.806 INFO:teuthology.orchestra.run.smithi184.stdout: "evexg": 0, 2023-07-14T18:30:08.806 INFO:teuthology.orchestra.run.smithi184.stdout: "evexd": 0, 2023-07-14T18:30:08.806 INFO:teuthology.orchestra.run.smithi184.stdout: "segadd": 9, 2023-07-14T18:30:08.806 INFO:teuthology.orchestra.run.smithi184.stdout: "segex": 0, 2023-07-14T18:30:08.807 INFO:teuthology.orchestra.run.smithi184.stdout: "segtrm": 0, 2023-07-14T18:30:08.807 INFO:teuthology.orchestra.run.smithi184.stdout: "seg": 9, 2023-07-14T18:30:08.807 INFO:teuthology.orchestra.run.smithi184.stdout: "segexg": 0, 2023-07-14T18:30:08.807 INFO:teuthology.orchestra.run.smithi184.stdout: "segexd": 0, 2023-07-14T18:30:08.807 INFO:teuthology.orchestra.run.smithi184.stdout: "expos": 4194304, 2023-07-14T18:30:08.808 INFO:teuthology.orchestra.run.smithi184.stdout: "wrpos": 11529138, 2023-07-14T18:30:08.808 INFO:teuthology.orchestra.run.smithi184.stdout: "rdpos": 0, 2023-07-14T18:30:08.808 INFO:teuthology.orchestra.run.smithi184.stdout: "jlat": { 2023-07-14T18:30:08.808 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 536, 2023-07-14T18:30:08.808 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.994169780, 2023-07-14T18:30:08.809 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.001854794 2023-07-14T18:30:08.809 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2023-07-14T18:30:08.809 INFO:teuthology.orchestra.run.smithi184.stdout: "replayed": 0 2023-07-14T18:30:08.809 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2023-07-14T18:30:08.809 INFO:teuthology.orchestra.run.smithi184.stdout: "mds_mem": { 2023-07-14T18:30:08.810 INFO:teuthology.orchestra.run.smithi184.stdout: "ino": 372, 2023-07-14T18:30:08.810 INFO:teuthology.orchestra.run.smithi184.stdout: "ino+": 1306, 2023-07-14T18:30:08.810 INFO:teuthology.orchestra.run.smithi184.stdout: "ino-": 934, 2023-07-14T18:30:08.810 INFO:teuthology.orchestra.run.smithi184.stdout: "dir": 79, 2023-07-14T18:30:08.810 INFO:teuthology.orchestra.run.smithi184.stdout: "dir+": 289, 2023-07-14T18:30:08.811 INFO:teuthology.orchestra.run.smithi184.stdout: "dir-": 210, 2023-07-14T18:30:08.811 INFO:teuthology.orchestra.run.smithi184.stdout: "dn": 441, 2023-07-14T18:30:08.811 INFO:teuthology.orchestra.run.smithi184.stdout: "dn+": 1713, 2023-07-14T18:30:08.811 INFO:teuthology.orchestra.run.smithi184.stdout: "dn-": 1272, 2023-07-14T18:30:08.811 INFO:teuthology.orchestra.run.smithi184.stdout: "cap": 330, 2023-07-14T18:30:08.812 INFO:teuthology.orchestra.run.smithi184.stdout: "cap+": 1268, 2023-07-14T18:30:08.812 INFO:teuthology.orchestra.run.smithi184.stdout: "cap-": 938, 2023-07-14T18:30:08.812 INFO:teuthology.orchestra.run.smithi184.stdout: "rss": 62044, 2023-07-14T18:30:08.812 INFO:teuthology.orchestra.run.smithi184.stdout: "heap": 198960 2023-07-14T18:30:08.812 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2023-07-14T18:30:08.813 INFO:teuthology.orchestra.run.smithi184.stdout: "mds_server": { 2023-07-14T18:30:08.813 INFO:teuthology.orchestra.run.smithi184.stdout: "dispatch_client_request": 6636, 2023-07-14T18:30:08.813 INFO:teuthology.orchestra.run.smithi184.stdout: "dispatch_server_request": 8, 2023-07-14T18:30:08.813 INFO:teuthology.orchestra.run.smithi184.stdout: "handle_client_request": 5330, 2023-07-14T18:30:08.813 INFO:teuthology.orchestra.run.smithi184.stdout: "handle_client_session": 16, 2023-07-14T18:30:08.814 INFO:teuthology.orchestra.run.smithi184.stdout: "handle_peer_request": 459, 2023-07-14T18:30:08.814 INFO:teuthology.orchestra.run.smithi184.stdout: "req_create_latency": { 2023-07-14T18:30:08.814 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 251, 2023-07-14T18:30:08.814 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.794365805, 2023-07-14T18:30:08.814 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.003164804 2023-07-14T18:30:08.815 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2023-07-14T18:30:08.815 INFO:teuthology.orchestra.run.smithi184.stdout: "req_getattr_latency": { 2023-07-14T18:30:08.815 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 6, 2023-07-14T18:30:08.815 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.003252911, 2023-07-14T18:30:08.815 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000542151 2023-07-14T18:30:08.815 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2023-07-14T18:30:08.816 INFO:teuthology.orchestra.run.smithi184.stdout: "req_getfilelock_latency": { 2023-07-14T18:30:08.816 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2023-07-14T18:30:08.816 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2023-07-14T18:30:08.816 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2023-07-14T18:30:08.816 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2023-07-14T18:30:08.817 INFO:teuthology.orchestra.run.smithi184.stdout: "req_link_latency": { 2023-07-14T18:30:08.817 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2023-07-14T18:30:08.817 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2023-07-14T18:30:08.817 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2023-07-14T18:30:08.817 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2023-07-14T18:30:08.818 INFO:teuthology.orchestra.run.smithi184.stdout: "req_lookup_latency": { 2023-07-14T18:30:08.818 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 1228, 2023-07-14T18:30:08.818 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.373357767, 2023-07-14T18:30:08.818 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000304037 2023-07-14T18:30:08.818 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2023-07-14T18:30:08.819 INFO:teuthology.orchestra.run.smithi184.stdout: "req_lookuphash_latency": { 2023-07-14T18:30:08.819 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2023-07-14T18:30:08.819 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2023-07-14T18:30:08.819 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2023-07-14T18:30:08.819 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2023-07-14T18:30:08.820 INFO:teuthology.orchestra.run.smithi184.stdout: "req_lookupino_latency": { 2023-07-14T18:30:08.820 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2023-07-14T18:30:08.820 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2023-07-14T18:30:08.820 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2023-07-14T18:30:08.820 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2023-07-14T18:30:08.821 INFO:teuthology.orchestra.run.smithi184.stdout: "req_lookupname_latency": { 2023-07-14T18:30:08.821 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2023-07-14T18:30:08.821 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2023-07-14T18:30:08.821 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2023-07-14T18:30:08.821 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2023-07-14T18:30:08.822 INFO:teuthology.orchestra.run.smithi184.stdout: "req_lookupparent_latency": { 2023-07-14T18:30:08.822 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2023-07-14T18:30:08.822 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2023-07-14T18:30:08.822 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2023-07-14T18:30:08.822 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2023-07-14T18:30:08.823 INFO:teuthology.orchestra.run.smithi184.stdout: "req_lookupsnap_latency": { 2023-07-14T18:30:08.823 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2023-07-14T18:30:08.823 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2023-07-14T18:30:08.823 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2023-07-14T18:30:08.823 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2023-07-14T18:30:08.823 INFO:teuthology.orchestra.run.smithi184.stdout: "req_lssnap_latency": { 2023-07-14T18:30:08.824 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2023-07-14T18:30:08.824 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2023-07-14T18:30:08.824 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2023-07-14T18:30:08.824 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2023-07-14T18:30:08.824 INFO:teuthology.orchestra.run.smithi184.stdout: "req_mkdir_latency": { 2023-07-14T18:30:08.825 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 2, 2023-07-14T18:30:08.825 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.004108289, 2023-07-14T18:30:08.825 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.002054144 2023-07-14T18:30:08.825 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2023-07-14T18:30:08.825 INFO:teuthology.orchestra.run.smithi184.stdout: "req_mknod_latency": { 2023-07-14T18:30:08.826 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2023-07-14T18:30:08.826 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2023-07-14T18:30:08.826 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2023-07-14T18:30:08.826 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2023-07-14T18:30:08.826 INFO:teuthology.orchestra.run.smithi184.stdout: "req_mksnap_latency": { 2023-07-14T18:30:08.827 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2023-07-14T18:30:08.827 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2023-07-14T18:30:08.827 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2023-07-14T18:30:08.827 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2023-07-14T18:30:08.827 INFO:teuthology.orchestra.run.smithi184.stdout: "req_open_latency": { 2023-07-14T18:30:08.828 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 6, 2023-07-14T18:30:08.828 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.008351947, 2023-07-14T18:30:08.828 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.001391991 2023-07-14T18:30:08.828 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2023-07-14T18:30:08.828 INFO:teuthology.orchestra.run.smithi184.stdout: "req_readdir_latency": { 2023-07-14T18:30:08.828 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 11, 2023-07-14T18:30:08.829 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.009250449, 2023-07-14T18:30:08.829 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000840949 2023-07-14T18:30:08.829 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2023-07-14T18:30:08.829 INFO:teuthology.orchestra.run.smithi184.stdout: "req_rename_latency": { 2023-07-14T18:30:08.829 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 15, 2023-07-14T18:30:08.830 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 6.918078746, 2023-07-14T18:30:08.830 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.461205249 2023-07-14T18:30:08.830 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2023-07-14T18:30:08.830 INFO:teuthology.orchestra.run.smithi184.stdout: "req_renamesnap_latency": { 2023-07-14T18:30:08.830 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2023-07-14T18:30:08.831 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2023-07-14T18:30:08.831 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2023-07-14T18:30:08.831 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2023-07-14T18:30:08.831 INFO:teuthology.orchestra.run.smithi184.stdout: "req_snapdiff_latency": { 2023-07-14T18:30:08.831 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2023-07-14T18:30:08.832 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2023-07-14T18:30:08.832 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2023-07-14T18:30:08.832 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2023-07-14T18:30:08.832 INFO:teuthology.orchestra.run.smithi184.stdout: "req_rmdir_latency": { 2023-07-14T18:30:08.833 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2023-07-14T18:30:08.833 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2023-07-14T18:30:08.833 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2023-07-14T18:30:08.833 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2023-07-14T18:30:08.833 INFO:teuthology.orchestra.run.smithi184.stdout: "req_rmsnap_latency": { 2023-07-14T18:30:08.833 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2023-07-14T18:30:08.834 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2023-07-14T18:30:08.834 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2023-07-14T18:30:08.834 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2023-07-14T18:30:08.834 INFO:teuthology.orchestra.run.smithi184.stdout: "req_rmxattr_latency": { 2023-07-14T18:30:08.834 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2023-07-14T18:30:08.835 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2023-07-14T18:30:08.835 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2023-07-14T18:30:08.835 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2023-07-14T18:30:08.835 INFO:teuthology.orchestra.run.smithi184.stdout: "req_setattr_latency": { 2023-07-14T18:30:08.835 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2023-07-14T18:30:08.836 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2023-07-14T18:30:08.836 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2023-07-14T18:30:08.836 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2023-07-14T18:30:08.836 INFO:teuthology.orchestra.run.smithi184.stdout: "req_setdirlayout_latency": { 2023-07-14T18:30:08.836 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2023-07-14T18:30:08.837 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2023-07-14T18:30:08.837 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2023-07-14T18:30:08.837 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2023-07-14T18:30:08.837 INFO:teuthology.orchestra.run.smithi184.stdout: "req_setfilelock_latency": { 2023-07-14T18:30:08.837 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2023-07-14T18:30:08.837 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2023-07-14T18:30:08.838 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2023-07-14T18:30:08.838 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2023-07-14T18:30:08.838 INFO:teuthology.orchestra.run.smithi184.stdout: "req_setlayout_latency": { 2023-07-14T18:30:08.838 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2023-07-14T18:30:08.838 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2023-07-14T18:30:08.839 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2023-07-14T18:30:08.839 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2023-07-14T18:30:08.839 INFO:teuthology.orchestra.run.smithi184.stdout: "req_setxattr_latency": { 2023-07-14T18:30:08.840 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2023-07-14T18:30:08.840 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2023-07-14T18:30:08.840 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2023-07-14T18:30:08.840 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2023-07-14T18:30:08.841 INFO:teuthology.orchestra.run.smithi184.stdout: "req_symlink_latency": { 2023-07-14T18:30:08.841 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 2, 2023-07-14T18:30:08.841 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.003301629, 2023-07-14T18:30:08.841 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.001650814 2023-07-14T18:30:08.842 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2023-07-14T18:30:08.842 INFO:teuthology.orchestra.run.smithi184.stdout: "req_unlink_latency": { 2023-07-14T18:30:08.842 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 177, 2023-07-14T18:30:08.842 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.535855823, 2023-07-14T18:30:08.843 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.003027434 2023-07-14T18:30:08.843 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2023-07-14T18:30:08.844 INFO:teuthology.orchestra.run.smithi184.stdout: "cap_revoke_eviction": 0, 2023-07-14T18:30:08.844 INFO:teuthology.orchestra.run.smithi184.stdout: "cap_acquisition_throttle": 0, 2023-07-14T18:30:08.844 INFO:teuthology.orchestra.run.smithi184.stdout: "req_getvxattr_latency": { 2023-07-14T18:30:08.845 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2023-07-14T18:30:08.845 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2023-07-14T18:30:08.846 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2023-07-14T18:30:08.846 INFO:teuthology.orchestra.run.smithi184.stdout: } 2023-07-14T18:30:08.847 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2023-07-14T18:30:08.847 INFO:teuthology.orchestra.run.smithi184.stdout: "mds_sessions": { 2023-07-14T18:30:08.847 INFO:teuthology.orchestra.run.smithi184.stdout: "session_count": 1, 2023-07-14T18:30:08.848 INFO:teuthology.orchestra.run.smithi184.stdout: "session_add": 1, 2023-07-14T18:30:08.848 INFO:teuthology.orchestra.run.smithi184.stdout: "session_remove": 0, 2023-07-14T18:30:08.849 INFO:teuthology.orchestra.run.smithi184.stdout: "sessions_open": 1, 2023-07-14T18:30:08.849 INFO:teuthology.orchestra.run.smithi184.stdout: "sessions_stale": 0, 2023-07-14T18:30:08.849 INFO:teuthology.orchestra.run.smithi184.stdout: "total_load": 999, 2023-07-14T18:30:08.850 INFO:teuthology.orchestra.run.smithi184.stdout: "average_load": 999, 2023-07-14T18:30:08.850 INFO:teuthology.orchestra.run.smithi184.stdout: "avg_session_uptime": 1040 2023-07-14T18:30:08.851 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2023-07-14T18:30:08.851 INFO:teuthology.orchestra.run.smithi184.stdout: "mempool": { 2023-07-14T18:30:08.851 INFO:teuthology.orchestra.run.smithi184.stdout: "bloom_filter_bytes": 0, 2023-07-14T18:30:08.851 INFO:teuthology.orchestra.run.smithi184.stdout: "bloom_filter_items": 0, 2023-07-14T18:30:08.852 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_alloc_bytes": 0, 2023-07-14T18:30:08.852 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_alloc_items": 0, 2023-07-14T18:30:08.852 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_cache_data_bytes": 0, 2023-07-14T18:30:08.852 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_cache_data_items": 0, 2023-07-14T18:30:08.852 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_cache_onode_bytes": 0, 2023-07-14T18:30:08.853 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_cache_onode_items": 0, 2023-07-14T18:30:08.853 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_cache_meta_bytes": 0, 2023-07-14T18:30:08.853 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_cache_meta_items": 0, 2023-07-14T18:30:08.853 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_cache_other_bytes": 0, 2023-07-14T18:30:08.853 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_cache_other_items": 0, 2023-07-14T18:30:08.854 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_cache_buffer_bytes": 0, 2023-07-14T18:30:08.854 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_cache_buffer_items": 0, 2023-07-14T18:30:08.854 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_extent_bytes": 0, 2023-07-14T18:30:08.854 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_extent_items": 0, 2023-07-14T18:30:08.855 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_blob_bytes": 0, 2023-07-14T18:30:08.855 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_blob_items": 0, 2023-07-14T18:30:08.855 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_shared_blob_bytes": 0, 2023-07-14T18:30:08.855 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_shared_blob_items": 0, 2023-07-14T18:30:08.855 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_inline_bl_bytes": 0, 2023-07-14T18:30:08.856 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_inline_bl_items": 0, 2023-07-14T18:30:08.856 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_fsck_bytes": 0, 2023-07-14T18:30:08.856 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_fsck_items": 0, 2023-07-14T18:30:08.856 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_txc_bytes": 0, 2023-07-14T18:30:08.857 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_txc_items": 0, 2023-07-14T18:30:08.857 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_writing_deferred_bytes": 0, 2023-07-14T18:30:08.857 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_writing_deferred_items": 0, 2023-07-14T18:30:08.857 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_writing_bytes": 0, 2023-07-14T18:30:08.857 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_writing_items": 0, 2023-07-14T18:30:08.858 INFO:teuthology.orchestra.run.smithi184.stdout: "bluefs_bytes": 0, 2023-07-14T18:30:08.858 INFO:teuthology.orchestra.run.smithi184.stdout: "bluefs_items": 0, 2023-07-14T18:30:08.858 INFO:teuthology.orchestra.run.smithi184.stdout: "bluefs_file_reader_bytes": 0, 2023-07-14T18:30:08.858 INFO:teuthology.orchestra.run.smithi184.stdout: "bluefs_file_reader_items": 0, 2023-07-14T18:30:08.858 INFO:teuthology.orchestra.run.smithi184.stdout: "bluefs_file_writer_bytes": 0, 2023-07-14T18:30:08.858 INFO:teuthology.orchestra.run.smithi184.stdout: "bluefs_file_writer_items": 0, 2023-07-14T18:30:08.859 INFO:teuthology.orchestra.run.smithi184.stdout: "buffer_anon_bytes": 315792, 2023-07-14T18:30:08.859 INFO:teuthology.orchestra.run.smithi184.stdout: "buffer_anon_items": 130, 2023-07-14T18:30:08.859 INFO:teuthology.orchestra.run.smithi184.stdout: "buffer_meta_bytes": 0, 2023-07-14T18:30:08.859 INFO:teuthology.orchestra.run.smithi184.stdout: "buffer_meta_items": 0, 2023-07-14T18:30:08.859 INFO:teuthology.orchestra.run.smithi184.stdout: "osd_bytes": 0, 2023-07-14T18:30:08.860 INFO:teuthology.orchestra.run.smithi184.stdout: "osd_items": 0, 2023-07-14T18:30:08.860 INFO:teuthology.orchestra.run.smithi184.stdout: "osd_mapbl_bytes": 0, 2023-07-14T18:30:08.860 INFO:teuthology.orchestra.run.smithi184.stdout: "osd_mapbl_items": 0, 2023-07-14T18:30:08.860 INFO:teuthology.orchestra.run.smithi184.stdout: "osd_pglog_bytes": 0, 2023-07-14T18:30:08.860 INFO:teuthology.orchestra.run.smithi184.stdout: "osd_pglog_items": 0, 2023-07-14T18:30:08.861 INFO:teuthology.orchestra.run.smithi184.stdout: "osdmap_bytes": 8792, 2023-07-14T18:30:08.861 INFO:teuthology.orchestra.run.smithi184.stdout: "osdmap_items": 168, 2023-07-14T18:30:08.861 INFO:teuthology.orchestra.run.smithi184.stdout: "osdmap_mapping_bytes": 0, 2023-07-14T18:30:08.861 INFO:teuthology.orchestra.run.smithi184.stdout: "osdmap_mapping_items": 0, 2023-07-14T18:30:08.861 INFO:teuthology.orchestra.run.smithi184.stdout: "pgmap_bytes": 0, 2023-07-14T18:30:08.862 INFO:teuthology.orchestra.run.smithi184.stdout: "pgmap_items": 0, 2023-07-14T18:30:08.862 INFO:teuthology.orchestra.run.smithi184.stdout: "mds_co_bytes": 1339087, 2023-07-14T18:30:08.862 INFO:teuthology.orchestra.run.smithi184.stdout: "mds_co_items": 9786, 2023-07-14T18:30:08.862 INFO:teuthology.orchestra.run.smithi184.stdout: "unittest_1_bytes": 0, 2023-07-14T18:30:08.862 INFO:teuthology.orchestra.run.smithi184.stdout: "unittest_1_items": 0, 2023-07-14T18:30:08.863 INFO:teuthology.orchestra.run.smithi184.stdout: "unittest_2_bytes": 0, 2023-07-14T18:30:08.863 INFO:teuthology.orchestra.run.smithi184.stdout: "unittest_2_items": 0 2023-07-14T18:30:08.863 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2023-07-14T18:30:08.863 INFO:teuthology.orchestra.run.smithi184.stdout: "objecter": { 2023-07-14T18:30:08.863 INFO:teuthology.orchestra.run.smithi184.stdout: "op_active": 0, 2023-07-14T18:30:08.864 INFO:teuthology.orchestra.run.smithi184.stdout: "op_laggy": 0, 2023-07-14T18:30:08.864 INFO:teuthology.orchestra.run.smithi184.stdout: "op_send": 1608, 2023-07-14T18:30:08.864 INFO:teuthology.orchestra.run.smithi184.stdout: "op_send_bytes": 7406012, 2023-07-14T18:30:08.864 INFO:teuthology.orchestra.run.smithi184.stdout: "op_resend": 28, 2023-07-14T18:30:08.864 INFO:teuthology.orchestra.run.smithi184.stdout: "op_reply": 1608, 2023-07-14T18:30:08.865 INFO:teuthology.orchestra.run.smithi184.stdout: "op_latency": { 2023-07-14T18:30:08.865 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 1608, 2023-07-14T18:30:08.865 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 2.747942848, 2023-07-14T18:30:08.865 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.001708919 2023-07-14T18:30:08.865 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2023-07-14T18:30:08.866 INFO:teuthology.orchestra.run.smithi184.stdout: "op_inflight": 0, 2023-07-14T18:30:08.866 INFO:teuthology.orchestra.run.smithi184.stdout: "oplen_avg": { 2023-07-14T18:30:08.866 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 1608, 2023-07-14T18:30:08.866 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 1660 2023-07-14T18:30:08.866 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2023-07-14T18:30:08.866 INFO:teuthology.orchestra.run.smithi184.stdout: "op": 1608, 2023-07-14T18:30:08.867 INFO:teuthology.orchestra.run.smithi184.stdout: "op_r": 565, 2023-07-14T18:30:08.867 INFO:teuthology.orchestra.run.smithi184.stdout: "op_w": 1043, 2023-07-14T18:30:08.867 INFO:teuthology.orchestra.run.smithi184.stdout: "op_rmw": 0, 2023-07-14T18:30:08.868 INFO:teuthology.orchestra.run.smithi184.stdout: "op_pg": 0, 2023-07-14T18:30:08.868 INFO:teuthology.orchestra.run.smithi184.stdout: "osdop_stat": 0, 2023-07-14T18:30:08.868 INFO:teuthology.orchestra.run.smithi184.stdout: "osdop_create": 10, 2023-07-14T18:30:08.868 INFO:teuthology.orchestra.run.smithi184.stdout: "osdop_read": 50, 2023-07-14T18:30:08.869 INFO:teuthology.orchestra.run.smithi184.stdout: "osdop_write": 586, 2023-07-14T18:30:08.869 INFO:teuthology.orchestra.run.smithi184.stdout: "osdop_writefull": 45, 2023-07-14T18:30:08.869 INFO:teuthology.orchestra.run.smithi184.stdout: "osdop_writesame": 0, 2023-07-14T18:30:08.869 INFO:teuthology.orchestra.run.smithi184.stdout: "osdop_append": 0, 2023-07-14T18:30:08.870 INFO:teuthology.orchestra.run.smithi184.stdout: "osdop_zero": 0, 2023-07-14T18:30:08.870 INFO:teuthology.orchestra.run.smithi184.stdout: "osdop_truncate": 0, 2023-07-14T18:30:08.870 INFO:teuthology.orchestra.run.smithi184.stdout: "osdop_delete": 367, 2023-07-14T18:30:08.870 INFO:teuthology.orchestra.run.smithi184.stdout: "osdop_mapext": 0, 2023-07-14T18:30:08.871 INFO:teuthology.orchestra.run.smithi184.stdout: "osdop_sparse_read": 0, 2023-07-14T18:30:08.871 INFO:teuthology.orchestra.run.smithi184.stdout: "osdop_clonerange": 0, 2023-07-14T18:30:08.871 INFO:teuthology.orchestra.run.smithi184.stdout: "osdop_getxattr": 515, 2023-07-14T18:30:08.871 INFO:teuthology.orchestra.run.smithi184.stdout: "osdop_setxattr": 20, 2023-07-14T18:30:08.871 INFO:teuthology.orchestra.run.smithi184.stdout: "osdop_cmpxattr": 0, 2023-07-14T18:30:08.872 INFO:teuthology.orchestra.run.smithi184.stdout: "osdop_rmxattr": 0, 2023-07-14T18:30:08.872 INFO:teuthology.orchestra.run.smithi184.stdout: "osdop_resetxattrs": 0, 2023-07-14T18:30:08.872 INFO:teuthology.orchestra.run.smithi184.stdout: "osdop_call": 0, 2023-07-14T18:30:08.872 INFO:teuthology.orchestra.run.smithi184.stdout: "osdop_watch": 0, 2023-07-14T18:30:08.872 INFO:teuthology.orchestra.run.smithi184.stdout: "osdop_notify": 0, 2023-07-14T18:30:08.873 INFO:teuthology.orchestra.run.smithi184.stdout: "osdop_src_cmpxattr": 0, 2023-07-14T18:30:08.873 INFO:teuthology.orchestra.run.smithi184.stdout: "osdop_pgls": 0, 2023-07-14T18:30:08.873 INFO:teuthology.orchestra.run.smithi184.stdout: "osdop_pgls_filter": 0, 2023-07-14T18:30:08.873 INFO:teuthology.orchestra.run.smithi184.stdout: "osdop_other": 2, 2023-07-14T18:30:08.873 INFO:teuthology.orchestra.run.smithi184.stdout: "linger_active": 0, 2023-07-14T18:30:08.874 INFO:teuthology.orchestra.run.smithi184.stdout: "linger_send": 0, 2023-07-14T18:30:08.874 INFO:teuthology.orchestra.run.smithi184.stdout: "linger_resend": 0, 2023-07-14T18:30:08.874 INFO:teuthology.orchestra.run.smithi184.stdout: "linger_ping": 0, 2023-07-14T18:30:08.874 INFO:teuthology.orchestra.run.smithi184.stdout: "poolop_active": 0, 2023-07-14T18:30:08.874 INFO:teuthology.orchestra.run.smithi184.stdout: "poolop_send": 0, 2023-07-14T18:30:08.874 INFO:teuthology.orchestra.run.smithi184.stdout: "poolop_resend": 0, 2023-07-14T18:30:08.875 INFO:teuthology.orchestra.run.smithi184.stdout: "poolstat_active": 0, 2023-07-14T18:30:08.875 INFO:teuthology.orchestra.run.smithi184.stdout: "poolstat_send": 0, 2023-07-14T18:30:08.875 INFO:teuthology.orchestra.run.smithi184.stdout: "poolstat_resend": 0, 2023-07-14T18:30:08.875 INFO:teuthology.orchestra.run.smithi184.stdout: "statfs_active": 0, 2023-07-14T18:30:08.875 INFO:teuthology.orchestra.run.smithi184.stdout: "statfs_send": 0, 2023-07-14T18:30:08.876 INFO:teuthology.orchestra.run.smithi184.stdout: "statfs_resend": 0, 2023-07-14T18:30:08.876 INFO:teuthology.orchestra.run.smithi184.stdout: "command_active": 0, 2023-07-14T18:30:08.876 INFO:teuthology.orchestra.run.smithi184.stdout: "command_send": 0, 2023-07-14T18:30:08.876 INFO:teuthology.orchestra.run.smithi184.stdout: "command_resend": 0, 2023-07-14T18:30:08.876 INFO:teuthology.orchestra.run.smithi184.stdout: "map_epoch": 88, 2023-07-14T18:30:08.877 INFO:teuthology.orchestra.run.smithi184.stdout: "map_full": 0, 2023-07-14T18:30:08.877 INFO:teuthology.orchestra.run.smithi184.stdout: "map_inc": 4, 2023-07-14T18:30:08.877 INFO:teuthology.orchestra.run.smithi184.stdout: "osd_sessions": 12, 2023-07-14T18:30:08.877 INFO:teuthology.orchestra.run.smithi184.stdout: "osd_session_open": 12, 2023-07-14T18:30:08.877 INFO:teuthology.orchestra.run.smithi184.stdout: "osd_session_close": 0, 2023-07-14T18:30:08.878 INFO:teuthology.orchestra.run.smithi184.stdout: "osd_laggy": 0, 2023-07-14T18:30:08.878 INFO:teuthology.orchestra.run.smithi184.stdout: "omap_wr": 50, 2023-07-14T18:30:08.878 INFO:teuthology.orchestra.run.smithi184.stdout: "omap_rd": 0, 2023-07-14T18:30:08.878 INFO:teuthology.orchestra.run.smithi184.stdout: "omap_del": 15 2023-07-14T18:30:08.878 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2023-07-14T18:30:08.878 INFO:teuthology.orchestra.run.smithi184.stdout: "oft": { 2023-07-14T18:30:08.879 INFO:teuthology.orchestra.run.smithi184.stdout: "omap_total_objs": 1, 2023-07-14T18:30:08.879 INFO:teuthology.orchestra.run.smithi184.stdout: "omap_total_kv_pairs": 0, 2023-07-14T18:30:08.879 INFO:teuthology.orchestra.run.smithi184.stdout: "omap_total_updates": 0, 2023-07-14T18:30:08.879 INFO:teuthology.orchestra.run.smithi184.stdout: "omap_total_removes": 0 2023-07-14T18:30:08.880 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2023-07-14T18:30:08.880 INFO:teuthology.orchestra.run.smithi184.stdout: "osd-slow-ops": { 2023-07-14T18:30:08.880 INFO:teuthology.orchestra.run.smithi184.stdout: "slow_ops_count": 0 2023-07-14T18:30:08.880 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2023-07-14T18:30:08.880 INFO:teuthology.orchestra.run.smithi184.stdout: "purge_queue": { 2023-07-14T18:30:08.881 INFO:teuthology.orchestra.run.smithi184.stdout: "pq_executing_ops": 0, 2023-07-14T18:30:08.881 INFO:teuthology.orchestra.run.smithi184.stdout: "pq_executing_ops_high_water": 10, 2023-07-14T18:30:08.881 INFO:teuthology.orchestra.run.smithi184.stdout: "pq_executing": 0, 2023-07-14T18:30:08.881 INFO:teuthology.orchestra.run.smithi184.stdout: "pq_executing_high_water": 5, 2023-07-14T18:30:08.881 INFO:teuthology.orchestra.run.smithi184.stdout: "pq_executed": 177, 2023-07-14T18:30:08.882 INFO:teuthology.orchestra.run.smithi184.stdout: "pq_item_in_journal": 0 2023-07-14T18:30:08.882 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2023-07-14T18:30:08.882 INFO:teuthology.orchestra.run.smithi184.stdout: "throttle-msgr_dispatch_throttler-mds": { 2023-07-14T18:30:08.882 INFO:teuthology.orchestra.run.smithi184.stdout: "val": 68, 2023-07-14T18:30:08.882 INFO:teuthology.orchestra.run.smithi184.stdout: "max": 104857600, 2023-07-14T18:30:08.883 INFO:teuthology.orchestra.run.smithi184.stdout: "get_started": 0, 2023-07-14T18:30:08.883 INFO:teuthology.orchestra.run.smithi184.stdout: "get": 11437174, 2023-07-14T18:30:08.883 INFO:teuthology.orchestra.run.smithi184.stdout: "get_sum": 815893602, 2023-07-14T18:30:08.883 INFO:teuthology.orchestra.run.smithi184.stdout: "get_or_fail_fail": 0, 2023-07-14T18:30:08.883 INFO:teuthology.orchestra.run.smithi184.stdout: "get_or_fail_success": 11437174, 2023-07-14T18:30:08.883 INFO:teuthology.orchestra.run.smithi184.stdout: "take": 0, 2023-07-14T18:30:08.884 INFO:teuthology.orchestra.run.smithi184.stdout: "take_sum": 0, 2023-07-14T18:30:08.884 INFO:teuthology.orchestra.run.smithi184.stdout: "put": 11437173, 2023-07-14T18:30:08.884 INFO:teuthology.orchestra.run.smithi184.stdout: "put_sum": 815893534, 2023-07-14T18:30:08.885 INFO:teuthology.orchestra.run.smithi184.stdout: "wait": { 2023-07-14T18:30:08.885 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2023-07-14T18:30:08.885 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2023-07-14T18:30:08.885 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2023-07-14T18:30:08.886 INFO:teuthology.orchestra.run.smithi184.stdout: } 2023-07-14T18:30:08.886 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2023-07-14T18:30:08.886 INFO:teuthology.orchestra.run.smithi184.stdout: "throttle-objecter_bytes": { 2023-07-14T18:30:08.886 INFO:teuthology.orchestra.run.smithi184.stdout: "val": 0, 2023-07-14T18:30:08.886 INFO:teuthology.orchestra.run.smithi184.stdout: "max": 104857600, 2023-07-14T18:30:08.887 INFO:teuthology.orchestra.run.smithi184.stdout: "get_started": 0, 2023-07-14T18:30:08.887 INFO:teuthology.orchestra.run.smithi184.stdout: "get": 0, 2023-07-14T18:30:08.887 INFO:teuthology.orchestra.run.smithi184.stdout: "get_sum": 0, 2023-07-14T18:30:08.887 INFO:teuthology.orchestra.run.smithi184.stdout: "get_or_fail_fail": 0, 2023-07-14T18:30:08.887 INFO:teuthology.orchestra.run.smithi184.stdout: "get_or_fail_success": 0, 2023-07-14T18:30:08.887 INFO:teuthology.orchestra.run.smithi184.stdout: "take": 1608, 2023-07-14T18:30:08.888 INFO:teuthology.orchestra.run.smithi184.stdout: "take_sum": 7425305, 2023-07-14T18:30:08.888 INFO:teuthology.orchestra.run.smithi184.stdout: "put": 1608, 2023-07-14T18:30:08.888 INFO:teuthology.orchestra.run.smithi184.stdout: "put_sum": 7425305, 2023-07-14T18:30:08.888 INFO:teuthology.orchestra.run.smithi184.stdout: "wait": { 2023-07-14T18:30:08.889 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2023-07-14T18:30:08.889 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2023-07-14T18:30:08.889 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2023-07-14T18:30:08.889 INFO:teuthology.orchestra.run.smithi184.stdout: } 2023-07-14T18:30:08.889 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2023-07-14T18:30:08.890 INFO:teuthology.orchestra.run.smithi184.stdout: "throttle-objecter_ops": { 2023-07-14T18:30:08.890 INFO:teuthology.orchestra.run.smithi184.stdout: "val": 0, 2023-07-14T18:30:08.890 INFO:teuthology.orchestra.run.smithi184.stdout: "max": 1024, 2023-07-14T18:30:08.890 INFO:teuthology.orchestra.run.smithi184.stdout: "get_started": 0, 2023-07-14T18:30:08.890 INFO:teuthology.orchestra.run.smithi184.stdout: "get": 0, 2023-07-14T18:30:08.891 INFO:teuthology.orchestra.run.smithi184.stdout: "get_sum": 0, 2023-07-14T18:30:08.891 INFO:teuthology.orchestra.run.smithi184.stdout: "get_or_fail_fail": 0, 2023-07-14T18:30:08.891 INFO:teuthology.orchestra.run.smithi184.stdout: "get_or_fail_success": 0, 2023-07-14T18:30:08.891 INFO:teuthology.orchestra.run.smithi184.stdout: "take": 1608, 2023-07-14T18:30:08.891 INFO:teuthology.orchestra.run.smithi184.stdout: "take_sum": 1608, 2023-07-14T18:30:08.892 INFO:teuthology.orchestra.run.smithi184.stdout: "put": 1608, 2023-07-14T18:30:08.892 INFO:teuthology.orchestra.run.smithi184.stdout: "put_sum": 1608, 2023-07-14T18:30:08.892 INFO:teuthology.orchestra.run.smithi184.stdout: "wait": { 2023-07-14T18:30:08.892 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2023-07-14T18:30:08.892 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2023-07-14T18:30:08.893 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2023-07-14T18:30:08.893 INFO:teuthology.orchestra.run.smithi184.stdout: } 2023-07-14T18:30:08.893 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2023-07-14T18:30:08.893 INFO:teuthology.orchestra.run.smithi184.stdout: "throttle-write_buf_throttle": { 2023-07-14T18:30:08.893 INFO:teuthology.orchestra.run.smithi184.stdout: "val": 0, 2023-07-14T18:30:08.894 INFO:teuthology.orchestra.run.smithi184.stdout: "max": 3758096384, 2023-07-14T18:30:08.894 INFO:teuthology.orchestra.run.smithi184.stdout: "get_started": 0, 2023-07-14T18:30:08.894 INFO:teuthology.orchestra.run.smithi184.stdout: "get": 177, 2023-07-14T18:30:08.894 INFO:teuthology.orchestra.run.smithi184.stdout: "get_sum": 19293, 2023-07-14T18:30:08.894 INFO:teuthology.orchestra.run.smithi184.stdout: "get_or_fail_fail": 0, 2023-07-14T18:30:08.895 INFO:teuthology.orchestra.run.smithi184.stdout: "get_or_fail_success": 177, 2023-07-14T18:30:08.895 INFO:teuthology.orchestra.run.smithi184.stdout: "take": 0, 2023-07-14T18:30:08.895 INFO:teuthology.orchestra.run.smithi184.stdout: "take_sum": 0, 2023-07-14T18:30:08.895 INFO:teuthology.orchestra.run.smithi184.stdout: "put": 50, 2023-07-14T18:30:08.895 INFO:teuthology.orchestra.run.smithi184.stdout: "put_sum": 19293, 2023-07-14T18:30:08.895 INFO:teuthology.orchestra.run.smithi184.stdout: "wait": { 2023-07-14T18:30:08.896 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2023-07-14T18:30:08.896 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2023-07-14T18:30:08.896 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2023-07-14T18:30:08.896 INFO:teuthology.orchestra.run.smithi184.stdout: } 2023-07-14T18:30:08.896 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2023-07-14T18:30:08.897 INFO:teuthology.orchestra.run.smithi184.stdout: "throttle-write_buf_throttle-0x55af2e6940a0": { 2023-07-14T18:30:08.897 INFO:teuthology.orchestra.run.smithi184.stdout: "val": 0, 2023-07-14T18:30:08.897 INFO:teuthology.orchestra.run.smithi184.stdout: "max": 3758096384, 2023-07-14T18:30:08.897 INFO:teuthology.orchestra.run.smithi184.stdout: "get_started": 0, 2023-07-14T18:30:08.897 INFO:teuthology.orchestra.run.smithi184.stdout: "get": 8957, 2023-07-14T18:30:08.898 INFO:teuthology.orchestra.run.smithi184.stdout: "get_sum": 7334834, 2023-07-14T18:30:08.898 INFO:teuthology.orchestra.run.smithi184.stdout: "get_or_fail_fail": 0, 2023-07-14T18:30:08.898 INFO:teuthology.orchestra.run.smithi184.stdout: "get_or_fail_success": 8957, 2023-07-14T18:30:08.898 INFO:teuthology.orchestra.run.smithi184.stdout: "take": 0, 2023-07-14T18:30:08.898 INFO:teuthology.orchestra.run.smithi184.stdout: "take_sum": 0, 2023-07-14T18:30:08.899 INFO:teuthology.orchestra.run.smithi184.stdout: "put": 536, 2023-07-14T18:30:08.899 INFO:teuthology.orchestra.run.smithi184.stdout: "put_sum": 7334834, 2023-07-14T18:30:08.899 INFO:teuthology.orchestra.run.smithi184.stdout: "wait": { 2023-07-14T18:30:08.899 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2023-07-14T18:30:08.899 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2023-07-14T18:30:08.899 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2023-07-14T18:30:08.900 INFO:teuthology.orchestra.run.smithi184.stdout: } 2023-07-14T18:30:08.900 INFO:teuthology.orchestra.run.smithi184.stdout: } 2023-07-14T18:30:08.900 INFO:teuthology.orchestra.run.smithi184.stdout:} 2023-07-14T18:30:09.165 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:30:08 smithi184 ceph-mon[98481]: pgmap v824: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-07-14T18:30:09.207 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:30:08 smithi163 ceph-mon[96576]: pgmap v824: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-07-14T18:30:09.265 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:30:08 smithi172 ceph-mon[97983]: pgmap v824: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-07-14T18:30:10.059 INFO:tasks.check_counter:Daemon mds.i mds.exported=3 2023-07-14T18:30:10.059 INFO:tasks.check_counter:Daemon mds.i mds.imported=42 2023-07-14T18:30:10.060 INFO:tasks.check_counter:Daemon mds.i mds_cache.dir_update=57 2023-07-14T18:30:10.060 INFO:tasks.check_counter:Daemon mds.i mds_cache.dir_update_receipt=407 2023-07-14T18:30:10.061 INFO:tasks.check_counter:Daemon mds.i mds.dir_split=0 2023-07-14T18:30:10.061 DEBUG:tasks.check_counter:Getting stats from l 2023-07-14T18:30:10.062 DEBUG:teuthology.orchestra.run.smithi184:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:81c9387d2e7576da065747ec9c16d1c7d69016ec shell --fsid bf7326ec-2270-11ee-9b33-001a4aab830c -- ceph daemon mds.l perf dump 2023-07-14T18:30:10.783 INFO:teuthology.orchestra.run.smithi184.stderr:Inferring config /var/lib/ceph/bf7326ec-2270-11ee-9b33-001a4aab830c/mon.c/config 2023-07-14T18:30:11.087 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:30:10 smithi184 ceph-mon[98481]: pgmap v825: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-07-14T18:30:11.207 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:30:10 smithi163 ceph-mon[96576]: pgmap v825: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-07-14T18:30:11.265 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:30:10 smithi172 ceph-mon[97983]: pgmap v825: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-07-14T18:30:12.048 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:30:12 smithi184 ceph-mon[98481]: pgmap v826: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-07-14T18:30:12.457 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:30:12 smithi163 ceph-mon[96576]: pgmap v826: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-07-14T18:30:12.515 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:30:12 smithi172 ceph-mon[97983]: pgmap v826: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-07-14T18:30:13.608 INFO:teuthology.orchestra.run.smithi184.stdout:{ 2023-07-14T18:30:13.609 INFO:teuthology.orchestra.run.smithi184.stdout: "AsyncMessenger::Worker-0": { 2023-07-14T18:30:13.609 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_recv_messages": 2365, 2023-07-14T18:30:13.609 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_send_messages": 2348, 2023-07-14T18:30:13.609 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_recv_bytes": 1199686, 2023-07-14T18:30:13.610 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_send_bytes": 810678, 2023-07-14T18:30:13.610 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_created_connections": 6, 2023-07-14T18:30:13.610 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_active_connections": 2, 2023-07-14T18:30:13.610 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_running_total_time": 0.192542715, 2023-07-14T18:30:13.610 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_running_send_time": 0.051239846, 2023-07-14T18:30:13.611 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_running_recv_time": 0.051880130, 2023-07-14T18:30:13.611 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_running_fast_dispatch_time": 0.076666682, 2023-07-14T18:30:13.611 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_send_messages_queue_lat": { 2023-07-14T18:30:13.611 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 2347, 2023-07-14T18:30:13.611 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.058733155, 2023-07-14T18:30:13.612 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000025024 2023-07-14T18:30:13.612 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2023-07-14T18:30:13.612 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_handle_ack_lat": { 2023-07-14T18:30:13.612 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2023-07-14T18:30:13.612 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2023-07-14T18:30:13.613 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2023-07-14T18:30:13.613 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2023-07-14T18:30:13.613 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_recv_encrypted_bytes": 600400, 2023-07-14T18:30:13.613 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_send_encrypted_bytes": 180592 2023-07-14T18:30:13.613 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2023-07-14T18:30:13.614 INFO:teuthology.orchestra.run.smithi184.stdout: "AsyncMessenger::Worker-1": { 2023-07-14T18:30:13.614 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_recv_messages": 1094, 2023-07-14T18:30:13.614 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_send_messages": 1331, 2023-07-14T18:30:13.614 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_recv_bytes": 7253441, 2023-07-14T18:30:13.614 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_send_bytes": 813975, 2023-07-14T18:30:13.615 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_created_connections": 5, 2023-07-14T18:30:13.615 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_active_connections": 4, 2023-07-14T18:30:13.615 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_running_total_time": 0.089909741, 2023-07-14T18:30:13.615 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_running_send_time": 0.033403192, 2023-07-14T18:30:13.615 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_running_recv_time": 0.021027685, 2023-07-14T18:30:13.616 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_running_fast_dispatch_time": 0.027595031, 2023-07-14T18:30:13.616 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_send_messages_queue_lat": { 2023-07-14T18:30:13.616 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 1329, 2023-07-14T18:30:13.616 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.032757186, 2023-07-14T18:30:13.616 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000024647 2023-07-14T18:30:13.617 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2023-07-14T18:30:13.617 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_handle_ack_lat": { 2023-07-14T18:30:13.617 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2023-07-14T18:30:13.617 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2023-07-14T18:30:13.617 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2023-07-14T18:30:13.618 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2023-07-14T18:30:13.618 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_recv_encrypted_bytes": 160, 2023-07-14T18:30:13.618 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_send_encrypted_bytes": 473984 2023-07-14T18:30:13.618 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2023-07-14T18:30:13.618 INFO:teuthology.orchestra.run.smithi184.stdout: "AsyncMessenger::Worker-2": { 2023-07-14T18:30:13.619 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_recv_messages": 252, 2023-07-14T18:30:13.619 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_send_messages": 252, 2023-07-14T18:30:13.619 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_recv_bytes": 8456041, 2023-07-14T18:30:13.619 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_send_bytes": 77577, 2023-07-14T18:30:13.619 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_created_connections": 6, 2023-07-14T18:30:13.620 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_active_connections": 4, 2023-07-14T18:30:13.620 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_running_total_time": 0.026431225, 2023-07-14T18:30:13.620 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_running_send_time": 0.007466341, 2023-07-14T18:30:13.620 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_running_recv_time": 0.010338085, 2023-07-14T18:30:13.620 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_running_fast_dispatch_time": 0.006603783, 2023-07-14T18:30:13.621 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_send_messages_queue_lat": { 2023-07-14T18:30:13.621 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 251, 2023-07-14T18:30:13.621 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.014321161, 2023-07-14T18:30:13.621 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000057056 2023-07-14T18:30:13.621 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2023-07-14T18:30:13.622 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_handle_ack_lat": { 2023-07-14T18:30:13.622 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2023-07-14T18:30:13.622 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2023-07-14T18:30:13.622 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2023-07-14T18:30:13.622 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2023-07-14T18:30:13.623 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_recv_encrypted_bytes": 2960, 2023-07-14T18:30:13.623 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_send_encrypted_bytes": 448 2023-07-14T18:30:13.623 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2023-07-14T18:30:13.623 INFO:teuthology.orchestra.run.smithi184.stdout: "cct": { 2023-07-14T18:30:13.623 INFO:teuthology.orchestra.run.smithi184.stdout: "total_workers": 1, 2023-07-14T18:30:13.623 INFO:teuthology.orchestra.run.smithi184.stdout: "unhealthy_workers": 0 2023-07-14T18:30:13.624 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2023-07-14T18:30:13.624 INFO:teuthology.orchestra.run.smithi184.stdout: "finisher-MDSRank": { 2023-07-14T18:30:13.624 INFO:teuthology.orchestra.run.smithi184.stdout: "queue_len": 0, 2023-07-14T18:30:13.624 INFO:teuthology.orchestra.run.smithi184.stdout: "complete_latency": { 2023-07-14T18:30:13.624 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 5596, 2023-07-14T18:30:13.625 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.153405718, 2023-07-14T18:30:13.625 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000027413 2023-07-14T18:30:13.625 INFO:teuthology.orchestra.run.smithi184.stdout: } 2023-07-14T18:30:13.625 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2023-07-14T18:30:13.625 INFO:teuthology.orchestra.run.smithi184.stdout: "finisher-PurgeQueue": { 2023-07-14T18:30:13.626 INFO:teuthology.orchestra.run.smithi184.stdout: "queue_len": 0, 2023-07-14T18:30:13.626 INFO:teuthology.orchestra.run.smithi184.stdout: "complete_latency": { 2023-07-14T18:30:13.626 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2023-07-14T18:30:13.626 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2023-07-14T18:30:13.626 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2023-07-14T18:30:13.626 INFO:teuthology.orchestra.run.smithi184.stdout: } 2023-07-14T18:30:13.627 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2023-07-14T18:30:13.627 INFO:teuthology.orchestra.run.smithi184.stdout: "mds": { 2023-07-14T18:30:13.627 INFO:teuthology.orchestra.run.smithi184.stdout: "request": 0, 2023-07-14T18:30:13.627 INFO:teuthology.orchestra.run.smithi184.stdout: "reply": 0, 2023-07-14T18:30:13.627 INFO:teuthology.orchestra.run.smithi184.stdout: "reply_latency": { 2023-07-14T18:30:13.628 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2023-07-14T18:30:13.628 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2023-07-14T18:30:13.628 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2023-07-14T18:30:13.628 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2023-07-14T18:30:13.628 INFO:teuthology.orchestra.run.smithi184.stdout: "slow_reply": 0, 2023-07-14T18:30:13.629 INFO:teuthology.orchestra.run.smithi184.stdout: "forward": 0, 2023-07-14T18:30:13.629 INFO:teuthology.orchestra.run.smithi184.stdout: "dir_fetch_complete": 0, 2023-07-14T18:30:13.629 INFO:teuthology.orchestra.run.smithi184.stdout: "dir_fetch_keys": 0, 2023-07-14T18:30:13.629 INFO:teuthology.orchestra.run.smithi184.stdout: "dir_commit": 0, 2023-07-14T18:30:13.629 INFO:teuthology.orchestra.run.smithi184.stdout: "dir_split": 0, 2023-07-14T18:30:13.630 INFO:teuthology.orchestra.run.smithi184.stdout: "dir_merge": 0, 2023-07-14T18:30:13.630 INFO:teuthology.orchestra.run.smithi184.stdout: "inodes": 1348, 2023-07-14T18:30:13.630 INFO:teuthology.orchestra.run.smithi184.stdout: "inodes_top": 0, 2023-07-14T18:30:13.630 INFO:teuthology.orchestra.run.smithi184.stdout: "inodes_bottom": 0, 2023-07-14T18:30:13.630 INFO:teuthology.orchestra.run.smithi184.stdout: "inodes_pin_tail": 1348, 2023-07-14T18:30:13.630 INFO:teuthology.orchestra.run.smithi184.stdout: "inodes_pinned": 1348, 2023-07-14T18:30:13.631 INFO:teuthology.orchestra.run.smithi184.stdout: "inodes_expired": 0, 2023-07-14T18:30:13.631 INFO:teuthology.orchestra.run.smithi184.stdout: "inodes_with_caps": 0, 2023-07-14T18:30:13.631 INFO:teuthology.orchestra.run.smithi184.stdout: "caps": 0, 2023-07-14T18:30:13.631 INFO:teuthology.orchestra.run.smithi184.stdout: "subtrees": 47, 2023-07-14T18:30:13.631 INFO:teuthology.orchestra.run.smithi184.stdout: "traverse": 0, 2023-07-14T18:30:13.632 INFO:teuthology.orchestra.run.smithi184.stdout: "traverse_hit": 0, 2023-07-14T18:30:13.632 INFO:teuthology.orchestra.run.smithi184.stdout: "traverse_forward": 0, 2023-07-14T18:30:13.632 INFO:teuthology.orchestra.run.smithi184.stdout: "traverse_discover": 0, 2023-07-14T18:30:13.632 INFO:teuthology.orchestra.run.smithi184.stdout: "traverse_dir_fetch": 0, 2023-07-14T18:30:13.632 INFO:teuthology.orchestra.run.smithi184.stdout: "traverse_remote_ino": 0, 2023-07-14T18:30:13.633 INFO:teuthology.orchestra.run.smithi184.stdout: "traverse_lock": 0, 2023-07-14T18:30:13.633 INFO:teuthology.orchestra.run.smithi184.stdout: "load_cent": 0, 2023-07-14T18:30:13.633 INFO:teuthology.orchestra.run.smithi184.stdout: "q": 0, 2023-07-14T18:30:13.633 INFO:teuthology.orchestra.run.smithi184.stdout: "exported": 0, 2023-07-14T18:30:13.633 INFO:teuthology.orchestra.run.smithi184.stdout: "exported_inodes": 0, 2023-07-14T18:30:13.633 INFO:teuthology.orchestra.run.smithi184.stdout: "imported": 0, 2023-07-14T18:30:13.634 INFO:teuthology.orchestra.run.smithi184.stdout: "imported_inodes": 0, 2023-07-14T18:30:13.634 INFO:teuthology.orchestra.run.smithi184.stdout: "openino_dir_fetch": 0, 2023-07-14T18:30:13.634 INFO:teuthology.orchestra.run.smithi184.stdout: "openino_backtrace_fetch": 0, 2023-07-14T18:30:13.634 INFO:teuthology.orchestra.run.smithi184.stdout: "openino_peer_discover": 0, 2023-07-14T18:30:13.634 INFO:teuthology.orchestra.run.smithi184.stdout: "root_rfiles": 0, 2023-07-14T18:30:13.635 INFO:teuthology.orchestra.run.smithi184.stdout: "root_rbytes": 0, 2023-07-14T18:30:13.635 INFO:teuthology.orchestra.run.smithi184.stdout: "root_rsnaps": 0, 2023-07-14T18:30:13.635 INFO:teuthology.orchestra.run.smithi184.stdout: "scrub_backtrace_fetch": 0, 2023-07-14T18:30:13.635 INFO:teuthology.orchestra.run.smithi184.stdout: "scrub_set_tag": 0, 2023-07-14T18:30:13.635 INFO:teuthology.orchestra.run.smithi184.stdout: "scrub_backtrace_repaired": 0, 2023-07-14T18:30:13.636 INFO:teuthology.orchestra.run.smithi184.stdout: "scrub_inotable_repaired": 0, 2023-07-14T18:30:13.636 INFO:teuthology.orchestra.run.smithi184.stdout: "scrub_dir_inodes": 0, 2023-07-14T18:30:13.636 INFO:teuthology.orchestra.run.smithi184.stdout: "scrub_dir_base_inodes": 0, 2023-07-14T18:30:13.636 INFO:teuthology.orchestra.run.smithi184.stdout: "scrub_dirfrag_rstats": 0, 2023-07-14T18:30:13.636 INFO:teuthology.orchestra.run.smithi184.stdout: "scrub_file_inodes": 0, 2023-07-14T18:30:13.637 INFO:teuthology.orchestra.run.smithi184.stdout: "handle_inode_file_caps": 0, 2023-07-14T18:30:13.637 INFO:teuthology.orchestra.run.smithi184.stdout: "ceph_cap_op_revoke": 0, 2023-07-14T18:30:13.637 INFO:teuthology.orchestra.run.smithi184.stdout: "ceph_cap_op_grant": 0, 2023-07-14T18:30:13.637 INFO:teuthology.orchestra.run.smithi184.stdout: "ceph_cap_op_trunc": 0, 2023-07-14T18:30:13.637 INFO:teuthology.orchestra.run.smithi184.stdout: "ceph_cap_op_flushsnap_ack": 0, 2023-07-14T18:30:13.638 INFO:teuthology.orchestra.run.smithi184.stdout: "ceph_cap_op_flush_ack": 0, 2023-07-14T18:30:13.638 INFO:teuthology.orchestra.run.smithi184.stdout: "handle_client_caps": 0, 2023-07-14T18:30:13.638 INFO:teuthology.orchestra.run.smithi184.stdout: "handle_client_caps_dirty": 0, 2023-07-14T18:30:13.638 INFO:teuthology.orchestra.run.smithi184.stdout: "handle_client_cap_release": 0, 2023-07-14T18:30:13.638 INFO:teuthology.orchestra.run.smithi184.stdout: "process_request_cap_release": 0 2023-07-14T18:30:13.638 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2023-07-14T18:30:13.639 INFO:teuthology.orchestra.run.smithi184.stdout: "mds_cache": { 2023-07-14T18:30:13.639 INFO:teuthology.orchestra.run.smithi184.stdout: "dir_update": 0, 2023-07-14T18:30:13.639 INFO:teuthology.orchestra.run.smithi184.stdout: "dir_update_receipt": 0, 2023-07-14T18:30:13.639 INFO:teuthology.orchestra.run.smithi184.stdout: "dir_try_discover": 0, 2023-07-14T18:30:13.639 INFO:teuthology.orchestra.run.smithi184.stdout: "dir_send_discover": 0, 2023-07-14T18:30:13.640 INFO:teuthology.orchestra.run.smithi184.stdout: "dir_handle_discover": 0, 2023-07-14T18:30:13.640 INFO:teuthology.orchestra.run.smithi184.stdout: "num_strays": 0, 2023-07-14T18:30:13.640 INFO:teuthology.orchestra.run.smithi184.stdout: "num_strays_delayed": 0, 2023-07-14T18:30:13.640 INFO:teuthology.orchestra.run.smithi184.stdout: "num_strays_enqueuing": 0, 2023-07-14T18:30:13.640 INFO:teuthology.orchestra.run.smithi184.stdout: "strays_created": 0, 2023-07-14T18:30:13.641 INFO:teuthology.orchestra.run.smithi184.stdout: "strays_enqueued": 0, 2023-07-14T18:30:13.641 INFO:teuthology.orchestra.run.smithi184.stdout: "strays_reintegrated": 0, 2023-07-14T18:30:13.641 INFO:teuthology.orchestra.run.smithi184.stdout: "strays_migrated": 0, 2023-07-14T18:30:13.641 INFO:teuthology.orchestra.run.smithi184.stdout: "num_recovering_processing": 0, 2023-07-14T18:30:13.641 INFO:teuthology.orchestra.run.smithi184.stdout: "num_recovering_enqueued": 0, 2023-07-14T18:30:13.641 INFO:teuthology.orchestra.run.smithi184.stdout: "num_recovering_prioritized": 0, 2023-07-14T18:30:13.642 INFO:teuthology.orchestra.run.smithi184.stdout: "recovery_started": 0, 2023-07-14T18:30:13.642 INFO:teuthology.orchestra.run.smithi184.stdout: "recovery_completed": 0, 2023-07-14T18:30:13.642 INFO:teuthology.orchestra.run.smithi184.stdout: "ireq_enqueue_scrub": 0, 2023-07-14T18:30:13.642 INFO:teuthology.orchestra.run.smithi184.stdout: "ireq_exportdir": 0, 2023-07-14T18:30:13.642 INFO:teuthology.orchestra.run.smithi184.stdout: "ireq_flush": 0, 2023-07-14T18:30:13.643 INFO:teuthology.orchestra.run.smithi184.stdout: "ireq_fragmentdir": 0, 2023-07-14T18:30:13.643 INFO:teuthology.orchestra.run.smithi184.stdout: "ireq_fragstats": 0, 2023-07-14T18:30:13.643 INFO:teuthology.orchestra.run.smithi184.stdout: "ireq_inodestats": 0 2023-07-14T18:30:13.643 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2023-07-14T18:30:13.643 INFO:teuthology.orchestra.run.smithi184.stdout: "mds_log": { 2023-07-14T18:30:13.644 INFO:teuthology.orchestra.run.smithi184.stdout: "evadd": 0, 2023-07-14T18:30:13.644 INFO:teuthology.orchestra.run.smithi184.stdout: "evex": 0, 2023-07-14T18:30:13.644 INFO:teuthology.orchestra.run.smithi184.stdout: "evtrm": 0, 2023-07-14T18:30:13.644 INFO:teuthology.orchestra.run.smithi184.stdout: "ev": 0, 2023-07-14T18:30:13.644 INFO:teuthology.orchestra.run.smithi184.stdout: "evexg": 0, 2023-07-14T18:30:13.645 INFO:teuthology.orchestra.run.smithi184.stdout: "evexd": 0, 2023-07-14T18:30:13.645 INFO:teuthology.orchestra.run.smithi184.stdout: "segadd": 0, 2023-07-14T18:30:13.645 INFO:teuthology.orchestra.run.smithi184.stdout: "segex": 0, 2023-07-14T18:30:13.645 INFO:teuthology.orchestra.run.smithi184.stdout: "segtrm": 0, 2023-07-14T18:30:13.645 INFO:teuthology.orchestra.run.smithi184.stdout: "seg": 24, 2023-07-14T18:30:13.645 INFO:teuthology.orchestra.run.smithi184.stdout: "segexg": 0, 2023-07-14T18:30:13.646 INFO:teuthology.orchestra.run.smithi184.stdout: "segexd": 0, 2023-07-14T18:30:13.646 INFO:teuthology.orchestra.run.smithi184.stdout: "expos": 4194304, 2023-07-14T18:30:13.646 INFO:teuthology.orchestra.run.smithi184.stdout: "wrpos": 0, 2023-07-14T18:30:13.646 INFO:teuthology.orchestra.run.smithi184.stdout: "rdpos": 19551193, 2023-07-14T18:30:13.646 INFO:teuthology.orchestra.run.smithi184.stdout: "jlat": { 2023-07-14T18:30:13.647 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2023-07-14T18:30:13.647 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2023-07-14T18:30:13.647 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2023-07-14T18:30:13.647 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2023-07-14T18:30:13.647 INFO:teuthology.orchestra.run.smithi184.stdout: "replayed": 22223 2023-07-14T18:30:13.648 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2023-07-14T18:30:13.648 INFO:teuthology.orchestra.run.smithi184.stdout: "mds_mem": { 2023-07-14T18:30:13.648 INFO:teuthology.orchestra.run.smithi184.stdout: "ino": 888, 2023-07-14T18:30:13.648 INFO:teuthology.orchestra.run.smithi184.stdout: "ino+": 1114, 2023-07-14T18:30:13.648 INFO:teuthology.orchestra.run.smithi184.stdout: "ino-": 226, 2023-07-14T18:30:13.649 INFO:teuthology.orchestra.run.smithi184.stdout: "dir": 69, 2023-07-14T18:30:13.649 INFO:teuthology.orchestra.run.smithi184.stdout: "dir+": 69, 2023-07-14T18:30:13.649 INFO:teuthology.orchestra.run.smithi184.stdout: "dir-": 0, 2023-07-14T18:30:13.649 INFO:teuthology.orchestra.run.smithi184.stdout: "dn": 1348, 2023-07-14T18:30:13.649 INFO:teuthology.orchestra.run.smithi184.stdout: "dn+": 1348, 2023-07-14T18:30:13.650 INFO:teuthology.orchestra.run.smithi184.stdout: "dn-": 0, 2023-07-14T18:30:13.650 INFO:teuthology.orchestra.run.smithi184.stdout: "cap": 0, 2023-07-14T18:30:13.650 INFO:teuthology.orchestra.run.smithi184.stdout: "cap+": 0, 2023-07-14T18:30:13.650 INFO:teuthology.orchestra.run.smithi184.stdout: "cap-": 0, 2023-07-14T18:30:13.650 INFO:teuthology.orchestra.run.smithi184.stdout: "rss": 54616, 2023-07-14T18:30:13.651 INFO:teuthology.orchestra.run.smithi184.stdout: "heap": 207152 2023-07-14T18:30:13.651 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2023-07-14T18:30:13.651 INFO:teuthology.orchestra.run.smithi184.stdout: "mds_server": { 2023-07-14T18:30:13.651 INFO:teuthology.orchestra.run.smithi184.stdout: "dispatch_client_request": 0, 2023-07-14T18:30:13.651 INFO:teuthology.orchestra.run.smithi184.stdout: "dispatch_server_request": 0, 2023-07-14T18:30:13.651 INFO:teuthology.orchestra.run.smithi184.stdout: "handle_client_request": 0, 2023-07-14T18:30:13.652 INFO:teuthology.orchestra.run.smithi184.stdout: "handle_client_session": 0, 2023-07-14T18:30:13.652 INFO:teuthology.orchestra.run.smithi184.stdout: "handle_peer_request": 0, 2023-07-14T18:30:13.652 INFO:teuthology.orchestra.run.smithi184.stdout: "req_create_latency": { 2023-07-14T18:30:13.652 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2023-07-14T18:30:13.652 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2023-07-14T18:30:13.653 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2023-07-14T18:30:13.653 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2023-07-14T18:30:13.653 INFO:teuthology.orchestra.run.smithi184.stdout: "req_getattr_latency": { 2023-07-14T18:30:13.653 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2023-07-14T18:30:13.653 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2023-07-14T18:30:13.654 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2023-07-14T18:30:13.654 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2023-07-14T18:30:13.654 INFO:teuthology.orchestra.run.smithi184.stdout: "req_getfilelock_latency": { 2023-07-14T18:30:13.654 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2023-07-14T18:30:13.654 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2023-07-14T18:30:13.655 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2023-07-14T18:30:13.655 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2023-07-14T18:30:13.655 INFO:teuthology.orchestra.run.smithi184.stdout: "req_link_latency": { 2023-07-14T18:30:13.655 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2023-07-14T18:30:13.655 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2023-07-14T18:30:13.656 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2023-07-14T18:30:13.656 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2023-07-14T18:30:13.656 INFO:teuthology.orchestra.run.smithi184.stdout: "req_lookup_latency": { 2023-07-14T18:30:13.656 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2023-07-14T18:30:13.656 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2023-07-14T18:30:13.657 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2023-07-14T18:30:13.657 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2023-07-14T18:30:13.657 INFO:teuthology.orchestra.run.smithi184.stdout: "req_lookuphash_latency": { 2023-07-14T18:30:13.657 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2023-07-14T18:30:13.657 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2023-07-14T18:30:13.657 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2023-07-14T18:30:13.658 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2023-07-14T18:30:13.658 INFO:teuthology.orchestra.run.smithi184.stdout: "req_lookupino_latency": { 2023-07-14T18:30:13.658 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2023-07-14T18:30:13.658 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2023-07-14T18:30:13.658 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2023-07-14T18:30:13.659 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2023-07-14T18:30:13.659 INFO:teuthology.orchestra.run.smithi184.stdout: "req_lookupname_latency": { 2023-07-14T18:30:13.659 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2023-07-14T18:30:13.659 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2023-07-14T18:30:13.660 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2023-07-14T18:30:13.660 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2023-07-14T18:30:13.660 INFO:teuthology.orchestra.run.smithi184.stdout: "req_lookupparent_latency": { 2023-07-14T18:30:13.660 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2023-07-14T18:30:13.660 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2023-07-14T18:30:13.661 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2023-07-14T18:30:13.661 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2023-07-14T18:30:13.661 INFO:teuthology.orchestra.run.smithi184.stdout: "req_lookupsnap_latency": { 2023-07-14T18:30:13.661 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2023-07-14T18:30:13.661 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2023-07-14T18:30:13.661 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2023-07-14T18:30:13.662 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2023-07-14T18:30:13.662 INFO:teuthology.orchestra.run.smithi184.stdout: "req_lssnap_latency": { 2023-07-14T18:30:13.662 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2023-07-14T18:30:13.662 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2023-07-14T18:30:13.663 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2023-07-14T18:30:13.663 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2023-07-14T18:30:13.663 INFO:teuthology.orchestra.run.smithi184.stdout: "req_mkdir_latency": { 2023-07-14T18:30:13.663 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2023-07-14T18:30:13.663 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2023-07-14T18:30:13.664 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2023-07-14T18:30:13.664 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2023-07-14T18:30:13.664 INFO:teuthology.orchestra.run.smithi184.stdout: "req_mknod_latency": { 2023-07-14T18:30:13.664 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2023-07-14T18:30:13.664 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2023-07-14T18:30:13.665 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2023-07-14T18:30:13.665 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2023-07-14T18:30:13.665 INFO:teuthology.orchestra.run.smithi184.stdout: "req_mksnap_latency": { 2023-07-14T18:30:13.665 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2023-07-14T18:30:13.665 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2023-07-14T18:30:13.665 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2023-07-14T18:30:13.666 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2023-07-14T18:30:13.666 INFO:teuthology.orchestra.run.smithi184.stdout: "req_open_latency": { 2023-07-14T18:30:13.666 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2023-07-14T18:30:13.666 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2023-07-14T18:30:13.666 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2023-07-14T18:30:13.667 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2023-07-14T18:30:13.667 INFO:teuthology.orchestra.run.smithi184.stdout: "req_readdir_latency": { 2023-07-14T18:30:13.667 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2023-07-14T18:30:13.667 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2023-07-14T18:30:13.667 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2023-07-14T18:30:13.668 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2023-07-14T18:30:13.668 INFO:teuthology.orchestra.run.smithi184.stdout: "req_rename_latency": { 2023-07-14T18:30:13.668 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2023-07-14T18:30:13.668 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2023-07-14T18:30:13.668 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2023-07-14T18:30:13.669 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2023-07-14T18:30:13.669 INFO:teuthology.orchestra.run.smithi184.stdout: "req_renamesnap_latency": { 2023-07-14T18:30:13.669 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2023-07-14T18:30:13.669 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2023-07-14T18:30:13.669 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2023-07-14T18:30:13.669 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2023-07-14T18:30:13.670 INFO:teuthology.orchestra.run.smithi184.stdout: "req_snapdiff_latency": { 2023-07-14T18:30:13.670 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2023-07-14T18:30:13.670 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2023-07-14T18:30:13.670 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2023-07-14T18:30:13.670 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2023-07-14T18:30:13.671 INFO:teuthology.orchestra.run.smithi184.stdout: "req_rmdir_latency": { 2023-07-14T18:30:13.671 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2023-07-14T18:30:13.671 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2023-07-14T18:30:13.671 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2023-07-14T18:30:13.671 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2023-07-14T18:30:13.672 INFO:teuthology.orchestra.run.smithi184.stdout: "req_rmsnap_latency": { 2023-07-14T18:30:13.672 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2023-07-14T18:30:13.672 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2023-07-14T18:30:13.672 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2023-07-14T18:30:13.672 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2023-07-14T18:30:13.673 INFO:teuthology.orchestra.run.smithi184.stdout: "req_rmxattr_latency": { 2023-07-14T18:30:13.673 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2023-07-14T18:30:13.673 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2023-07-14T18:30:13.673 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2023-07-14T18:30:13.673 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2023-07-14T18:30:13.674 INFO:teuthology.orchestra.run.smithi184.stdout: "req_setattr_latency": { 2023-07-14T18:30:13.674 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2023-07-14T18:30:13.674 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2023-07-14T18:30:13.674 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2023-07-14T18:30:13.674 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2023-07-14T18:30:13.674 INFO:teuthology.orchestra.run.smithi184.stdout: "req_setdirlayout_latency": { 2023-07-14T18:30:13.675 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2023-07-14T18:30:13.675 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2023-07-14T18:30:13.675 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2023-07-14T18:30:13.675 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2023-07-14T18:30:13.675 INFO:teuthology.orchestra.run.smithi184.stdout: "req_setfilelock_latency": { 2023-07-14T18:30:13.676 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2023-07-14T18:30:13.676 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2023-07-14T18:30:13.676 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2023-07-14T18:30:13.676 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2023-07-14T18:30:13.676 INFO:teuthology.orchestra.run.smithi184.stdout: "req_setlayout_latency": { 2023-07-14T18:30:13.677 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2023-07-14T18:30:13.677 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2023-07-14T18:30:13.677 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2023-07-14T18:30:13.677 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2023-07-14T18:30:13.677 INFO:teuthology.orchestra.run.smithi184.stdout: "req_setxattr_latency": { 2023-07-14T18:30:13.678 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2023-07-14T18:30:13.678 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2023-07-14T18:30:13.678 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2023-07-14T18:30:13.678 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2023-07-14T18:30:13.678 INFO:teuthology.orchestra.run.smithi184.stdout: "req_symlink_latency": { 2023-07-14T18:30:13.678 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2023-07-14T18:30:13.679 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2023-07-14T18:30:13.679 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2023-07-14T18:30:13.679 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2023-07-14T18:30:13.679 INFO:teuthology.orchestra.run.smithi184.stdout: "req_unlink_latency": { 2023-07-14T18:30:13.679 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2023-07-14T18:30:13.680 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2023-07-14T18:30:13.680 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2023-07-14T18:30:13.680 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2023-07-14T18:30:13.680 INFO:teuthology.orchestra.run.smithi184.stdout: "cap_revoke_eviction": 0, 2023-07-14T18:30:13.680 INFO:teuthology.orchestra.run.smithi184.stdout: "cap_acquisition_throttle": 0, 2023-07-14T18:30:13.681 INFO:teuthology.orchestra.run.smithi184.stdout: "req_getvxattr_latency": { 2023-07-14T18:30:13.681 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2023-07-14T18:30:13.681 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2023-07-14T18:30:13.681 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2023-07-14T18:30:13.681 INFO:teuthology.orchestra.run.smithi184.stdout: } 2023-07-14T18:30:13.682 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2023-07-14T18:30:13.682 INFO:teuthology.orchestra.run.smithi184.stdout: "mds_sessions": { 2023-07-14T18:30:13.682 INFO:teuthology.orchestra.run.smithi184.stdout: "session_count": 1, 2023-07-14T18:30:13.682 INFO:teuthology.orchestra.run.smithi184.stdout: "session_add": 1, 2023-07-14T18:30:13.682 INFO:teuthology.orchestra.run.smithi184.stdout: "session_remove": 0, 2023-07-14T18:30:13.682 INFO:teuthology.orchestra.run.smithi184.stdout: "sessions_open": 1, 2023-07-14T18:30:13.683 INFO:teuthology.orchestra.run.smithi184.stdout: "sessions_stale": 0, 2023-07-14T18:30:13.683 INFO:teuthology.orchestra.run.smithi184.stdout: "total_load": 0, 2023-07-14T18:30:13.683 INFO:teuthology.orchestra.run.smithi184.stdout: "average_load": 0, 2023-07-14T18:30:13.683 INFO:teuthology.orchestra.run.smithi184.stdout: "avg_session_uptime": 2672 2023-07-14T18:30:13.683 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2023-07-14T18:30:13.684 INFO:teuthology.orchestra.run.smithi184.stdout: "mempool": { 2023-07-14T18:30:13.684 INFO:teuthology.orchestra.run.smithi184.stdout: "bloom_filter_bytes": 0, 2023-07-14T18:30:13.684 INFO:teuthology.orchestra.run.smithi184.stdout: "bloom_filter_items": 0, 2023-07-14T18:30:13.684 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_alloc_bytes": 0, 2023-07-14T18:30:13.684 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_alloc_items": 0, 2023-07-14T18:30:13.685 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_cache_data_bytes": 0, 2023-07-14T18:30:13.685 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_cache_data_items": 0, 2023-07-14T18:30:13.685 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_cache_onode_bytes": 0, 2023-07-14T18:30:13.685 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_cache_onode_items": 0, 2023-07-14T18:30:13.685 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_cache_meta_bytes": 0, 2023-07-14T18:30:13.686 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_cache_meta_items": 0, 2023-07-14T18:30:13.686 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_cache_other_bytes": 0, 2023-07-14T18:30:13.686 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_cache_other_items": 0, 2023-07-14T18:30:13.686 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_cache_buffer_bytes": 0, 2023-07-14T18:30:13.686 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_cache_buffer_items": 0, 2023-07-14T18:30:13.686 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_extent_bytes": 0, 2023-07-14T18:30:13.687 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_extent_items": 0, 2023-07-14T18:30:13.687 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_blob_bytes": 0, 2023-07-14T18:30:13.687 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_blob_items": 0, 2023-07-14T18:30:13.687 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_shared_blob_bytes": 0, 2023-07-14T18:30:13.687 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_shared_blob_items": 0, 2023-07-14T18:30:13.688 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_inline_bl_bytes": 0, 2023-07-14T18:30:13.688 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_inline_bl_items": 0, 2023-07-14T18:30:13.688 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_fsck_bytes": 0, 2023-07-14T18:30:13.688 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_fsck_items": 0, 2023-07-14T18:30:13.688 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_txc_bytes": 0, 2023-07-14T18:30:13.689 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_txc_items": 0, 2023-07-14T18:30:13.689 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_writing_deferred_bytes": 0, 2023-07-14T18:30:13.689 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_writing_deferred_items": 0, 2023-07-14T18:30:13.689 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_writing_bytes": 0, 2023-07-14T18:30:13.689 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_writing_items": 0, 2023-07-14T18:30:13.689 INFO:teuthology.orchestra.run.smithi184.stdout: "bluefs_bytes": 0, 2023-07-14T18:30:13.690 INFO:teuthology.orchestra.run.smithi184.stdout: "bluefs_items": 0, 2023-07-14T18:30:13.690 INFO:teuthology.orchestra.run.smithi184.stdout: "bluefs_file_reader_bytes": 0, 2023-07-14T18:30:13.690 INFO:teuthology.orchestra.run.smithi184.stdout: "bluefs_file_reader_items": 0, 2023-07-14T18:30:13.690 INFO:teuthology.orchestra.run.smithi184.stdout: "bluefs_file_writer_bytes": 0, 2023-07-14T18:30:13.690 INFO:teuthology.orchestra.run.smithi184.stdout: "bluefs_file_writer_items": 0, 2023-07-14T18:30:13.691 INFO:teuthology.orchestra.run.smithi184.stdout: "buffer_anon_bytes": 207145, 2023-07-14T18:30:13.691 INFO:teuthology.orchestra.run.smithi184.stdout: "buffer_anon_items": 64, 2023-07-14T18:30:13.691 INFO:teuthology.orchestra.run.smithi184.stdout: "buffer_meta_bytes": 0, 2023-07-14T18:30:13.691 INFO:teuthology.orchestra.run.smithi184.stdout: "buffer_meta_items": 0, 2023-07-14T18:30:13.691 INFO:teuthology.orchestra.run.smithi184.stdout: "osd_bytes": 0, 2023-07-14T18:30:13.692 INFO:teuthology.orchestra.run.smithi184.stdout: "osd_items": 0, 2023-07-14T18:30:13.692 INFO:teuthology.orchestra.run.smithi184.stdout: "osd_mapbl_bytes": 0, 2023-07-14T18:30:13.692 INFO:teuthology.orchestra.run.smithi184.stdout: "osd_mapbl_items": 0, 2023-07-14T18:30:13.692 INFO:teuthology.orchestra.run.smithi184.stdout: "osd_pglog_bytes": 0, 2023-07-14T18:30:13.692 INFO:teuthology.orchestra.run.smithi184.stdout: "osd_pglog_items": 0, 2023-07-14T18:30:13.692 INFO:teuthology.orchestra.run.smithi184.stdout: "osdmap_bytes": 8792, 2023-07-14T18:30:13.693 INFO:teuthology.orchestra.run.smithi184.stdout: "osdmap_items": 168, 2023-07-14T18:30:13.693 INFO:teuthology.orchestra.run.smithi184.stdout: "osdmap_mapping_bytes": 0, 2023-07-14T18:30:13.693 INFO:teuthology.orchestra.run.smithi184.stdout: "osdmap_mapping_items": 0, 2023-07-14T18:30:13.693 INFO:teuthology.orchestra.run.smithi184.stdout: "pgmap_bytes": 0, 2023-07-14T18:30:13.693 INFO:teuthology.orchestra.run.smithi184.stdout: "pgmap_items": 0, 2023-07-14T18:30:13.694 INFO:teuthology.orchestra.run.smithi184.stdout: "mds_co_bytes": 2864679, 2023-07-14T18:30:13.694 INFO:teuthology.orchestra.run.smithi184.stdout: "mds_co_items": 11450, 2023-07-14T18:30:13.694 INFO:teuthology.orchestra.run.smithi184.stdout: "unittest_1_bytes": 0, 2023-07-14T18:30:13.694 INFO:teuthology.orchestra.run.smithi184.stdout: "unittest_1_items": 0, 2023-07-14T18:30:13.694 INFO:teuthology.orchestra.run.smithi184.stdout: "unittest_2_bytes": 0, 2023-07-14T18:30:13.695 INFO:teuthology.orchestra.run.smithi184.stdout: "unittest_2_items": 0 2023-07-14T18:30:13.695 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2023-07-14T18:30:13.695 INFO:teuthology.orchestra.run.smithi184.stdout: "objecter": { 2023-07-14T18:30:13.695 INFO:teuthology.orchestra.run.smithi184.stdout: "op_active": 0, 2023-07-14T18:30:13.695 INFO:teuthology.orchestra.run.smithi184.stdout: "op_laggy": 0, 2023-07-14T18:30:13.696 INFO:teuthology.orchestra.run.smithi184.stdout: "op_send": 3367, 2023-07-14T18:30:13.696 INFO:teuthology.orchestra.run.smithi184.stdout: "op_send_bytes": 21, 2023-07-14T18:30:13.696 INFO:teuthology.orchestra.run.smithi184.stdout: "op_resend": 3, 2023-07-14T18:30:13.696 INFO:teuthology.orchestra.run.smithi184.stdout: "op_reply": 3367, 2023-07-14T18:30:13.696 INFO:teuthology.orchestra.run.smithi184.stdout: "op_latency": { 2023-07-14T18:30:13.696 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 3367, 2023-07-14T18:30:13.697 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 1.451970909, 2023-07-14T18:30:13.697 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000431235 2023-07-14T18:30:13.697 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2023-07-14T18:30:13.697 INFO:teuthology.orchestra.run.smithi184.stdout: "op_inflight": 0, 2023-07-14T18:30:13.697 INFO:teuthology.orchestra.run.smithi184.stdout: "oplen_avg": { 2023-07-14T18:30:13.698 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 3367, 2023-07-14T18:30:13.698 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 3368 2023-07-14T18:30:13.698 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2023-07-14T18:30:13.698 INFO:teuthology.orchestra.run.smithi184.stdout: "op": 3367, 2023-07-14T18:30:13.698 INFO:teuthology.orchestra.run.smithi184.stdout: "op_r": 3367, 2023-07-14T18:30:13.699 INFO:teuthology.orchestra.run.smithi184.stdout: "op_w": 0, 2023-07-14T18:30:13.699 INFO:teuthology.orchestra.run.smithi184.stdout: "op_rmw": 0, 2023-07-14T18:30:13.699 INFO:teuthology.orchestra.run.smithi184.stdout: "op_pg": 0, 2023-07-14T18:30:13.699 INFO:teuthology.orchestra.run.smithi184.stdout: "osdop_stat": 2173, 2023-07-14T18:30:13.699 INFO:teuthology.orchestra.run.smithi184.stdout: "osdop_create": 0, 2023-07-14T18:30:13.699 INFO:teuthology.orchestra.run.smithi184.stdout: "osdop_read": 1192, 2023-07-14T18:30:13.700 INFO:teuthology.orchestra.run.smithi184.stdout: "osdop_write": 0, 2023-07-14T18:30:13.700 INFO:teuthology.orchestra.run.smithi184.stdout: "osdop_writefull": 0, 2023-07-14T18:30:13.700 INFO:teuthology.orchestra.run.smithi184.stdout: "osdop_writesame": 0, 2023-07-14T18:30:13.700 INFO:teuthology.orchestra.run.smithi184.stdout: "osdop_append": 0, 2023-07-14T18:30:13.700 INFO:teuthology.orchestra.run.smithi184.stdout: "osdop_zero": 0, 2023-07-14T18:30:13.701 INFO:teuthology.orchestra.run.smithi184.stdout: "osdop_truncate": 0, 2023-07-14T18:30:13.701 INFO:teuthology.orchestra.run.smithi184.stdout: "osdop_delete": 0, 2023-07-14T18:30:13.701 INFO:teuthology.orchestra.run.smithi184.stdout: "osdop_mapext": 0, 2023-07-14T18:30:13.701 INFO:teuthology.orchestra.run.smithi184.stdout: "osdop_sparse_read": 0, 2023-07-14T18:30:13.701 INFO:teuthology.orchestra.run.smithi184.stdout: "osdop_clonerange": 0, 2023-07-14T18:30:13.702 INFO:teuthology.orchestra.run.smithi184.stdout: "osdop_getxattr": 1, 2023-07-14T18:30:13.702 INFO:teuthology.orchestra.run.smithi184.stdout: "osdop_setxattr": 0, 2023-07-14T18:30:13.702 INFO:teuthology.orchestra.run.smithi184.stdout: "osdop_cmpxattr": 0, 2023-07-14T18:30:13.702 INFO:teuthology.orchestra.run.smithi184.stdout: "osdop_rmxattr": 0, 2023-07-14T18:30:13.702 INFO:teuthology.orchestra.run.smithi184.stdout: "osdop_resetxattrs": 0, 2023-07-14T18:30:13.703 INFO:teuthology.orchestra.run.smithi184.stdout: "osdop_call": 0, 2023-07-14T18:30:13.703 INFO:teuthology.orchestra.run.smithi184.stdout: "osdop_watch": 0, 2023-07-14T18:30:13.703 INFO:teuthology.orchestra.run.smithi184.stdout: "osdop_notify": 0, 2023-07-14T18:30:13.703 INFO:teuthology.orchestra.run.smithi184.stdout: "osdop_src_cmpxattr": 0, 2023-07-14T18:30:13.703 INFO:teuthology.orchestra.run.smithi184.stdout: "osdop_pgls": 0, 2023-07-14T18:30:13.703 INFO:teuthology.orchestra.run.smithi184.stdout: "osdop_pgls_filter": 0, 2023-07-14T18:30:13.704 INFO:teuthology.orchestra.run.smithi184.stdout: "osdop_other": 0, 2023-07-14T18:30:13.704 INFO:teuthology.orchestra.run.smithi184.stdout: "linger_active": 0, 2023-07-14T18:30:13.704 INFO:teuthology.orchestra.run.smithi184.stdout: "linger_send": 0, 2023-07-14T18:30:13.704 INFO:teuthology.orchestra.run.smithi184.stdout: "linger_resend": 0, 2023-07-14T18:30:13.704 INFO:teuthology.orchestra.run.smithi184.stdout: "linger_ping": 0, 2023-07-14T18:30:13.705 INFO:teuthology.orchestra.run.smithi184.stdout: "poolop_active": 0, 2023-07-14T18:30:13.705 INFO:teuthology.orchestra.run.smithi184.stdout: "poolop_send": 0, 2023-07-14T18:30:13.705 INFO:teuthology.orchestra.run.smithi184.stdout: "poolop_resend": 0, 2023-07-14T18:30:13.705 INFO:teuthology.orchestra.run.smithi184.stdout: "poolstat_active": 0, 2023-07-14T18:30:13.705 INFO:teuthology.orchestra.run.smithi184.stdout: "poolstat_send": 0, 2023-07-14T18:30:13.706 INFO:teuthology.orchestra.run.smithi184.stdout: "poolstat_resend": 0, 2023-07-14T18:30:13.706 INFO:teuthology.orchestra.run.smithi184.stdout: "statfs_active": 0, 2023-07-14T18:30:13.706 INFO:teuthology.orchestra.run.smithi184.stdout: "statfs_send": 0, 2023-07-14T18:30:13.706 INFO:teuthology.orchestra.run.smithi184.stdout: "statfs_resend": 0, 2023-07-14T18:30:13.706 INFO:teuthology.orchestra.run.smithi184.stdout: "command_active": 0, 2023-07-14T18:30:13.706 INFO:teuthology.orchestra.run.smithi184.stdout: "command_send": 0, 2023-07-14T18:30:13.707 INFO:teuthology.orchestra.run.smithi184.stdout: "command_resend": 0, 2023-07-14T18:30:13.707 INFO:teuthology.orchestra.run.smithi184.stdout: "map_epoch": 88, 2023-07-14T18:30:13.707 INFO:teuthology.orchestra.run.smithi184.stdout: "map_full": 0, 2023-07-14T18:30:13.707 INFO:teuthology.orchestra.run.smithi184.stdout: "map_inc": 4, 2023-07-14T18:30:13.707 INFO:teuthology.orchestra.run.smithi184.stdout: "osd_sessions": 7, 2023-07-14T18:30:13.708 INFO:teuthology.orchestra.run.smithi184.stdout: "osd_session_open": 8, 2023-07-14T18:30:13.708 INFO:teuthology.orchestra.run.smithi184.stdout: "osd_session_close": 1, 2023-07-14T18:30:13.708 INFO:teuthology.orchestra.run.smithi184.stdout: "osd_laggy": 0, 2023-07-14T18:30:13.708 INFO:teuthology.orchestra.run.smithi184.stdout: "omap_wr": 0, 2023-07-14T18:30:13.708 INFO:teuthology.orchestra.run.smithi184.stdout: "omap_rd": 2, 2023-07-14T18:30:13.709 INFO:teuthology.orchestra.run.smithi184.stdout: "omap_del": 0 2023-07-14T18:30:13.709 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2023-07-14T18:30:13.709 INFO:teuthology.orchestra.run.smithi184.stdout: "oft": { 2023-07-14T18:30:13.709 INFO:teuthology.orchestra.run.smithi184.stdout: "omap_total_objs": 0, 2023-07-14T18:30:13.709 INFO:teuthology.orchestra.run.smithi184.stdout: "omap_total_kv_pairs": 0, 2023-07-14T18:30:13.709 INFO:teuthology.orchestra.run.smithi184.stdout: "omap_total_updates": 0, 2023-07-14T18:30:13.710 INFO:teuthology.orchestra.run.smithi184.stdout: "omap_total_removes": 0 2023-07-14T18:30:13.710 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2023-07-14T18:30:13.710 INFO:teuthology.orchestra.run.smithi184.stdout: "osd-slow-ops": { 2023-07-14T18:30:13.710 INFO:teuthology.orchestra.run.smithi184.stdout: "slow_ops_count": 0 2023-07-14T18:30:13.711 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2023-07-14T18:30:13.711 INFO:teuthology.orchestra.run.smithi184.stdout: "purge_queue": { 2023-07-14T18:30:13.711 INFO:teuthology.orchestra.run.smithi184.stdout: "pq_executing_ops": 0, 2023-07-14T18:30:13.711 INFO:teuthology.orchestra.run.smithi184.stdout: "pq_executing_ops_high_water": 0, 2023-07-14T18:30:13.711 INFO:teuthology.orchestra.run.smithi184.stdout: "pq_executing": 0, 2023-07-14T18:30:13.711 INFO:teuthology.orchestra.run.smithi184.stdout: "pq_executing_high_water": 0, 2023-07-14T18:30:13.712 INFO:teuthology.orchestra.run.smithi184.stdout: "pq_executed": 0, 2023-07-14T18:30:13.712 INFO:teuthology.orchestra.run.smithi184.stdout: "pq_item_in_journal": 0 2023-07-14T18:30:13.712 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2023-07-14T18:30:13.712 INFO:teuthology.orchestra.run.smithi184.stdout: "throttle-msgr_dispatch_throttler-mds": { 2023-07-14T18:30:13.712 INFO:teuthology.orchestra.run.smithi184.stdout: "val": 0, 2023-07-14T18:30:13.713 INFO:teuthology.orchestra.run.smithi184.stdout: "max": 104857600, 2023-07-14T18:30:13.713 INFO:teuthology.orchestra.run.smithi184.stdout: "get_started": 0, 2023-07-14T18:30:13.713 INFO:teuthology.orchestra.run.smithi184.stdout: "get": 3707, 2023-07-14T18:30:13.713 INFO:teuthology.orchestra.run.smithi184.stdout: "get_sum": 16555183, 2023-07-14T18:30:13.713 INFO:teuthology.orchestra.run.smithi184.stdout: "get_or_fail_fail": 0, 2023-07-14T18:30:13.714 INFO:teuthology.orchestra.run.smithi184.stdout: "get_or_fail_success": 3707, 2023-07-14T18:30:13.714 INFO:teuthology.orchestra.run.smithi184.stdout: "take": 0, 2023-07-14T18:30:13.714 INFO:teuthology.orchestra.run.smithi184.stdout: "take_sum": 0, 2023-07-14T18:30:13.714 INFO:teuthology.orchestra.run.smithi184.stdout: "put": 3707, 2023-07-14T18:30:13.714 INFO:teuthology.orchestra.run.smithi184.stdout: "put_sum": 16555183, 2023-07-14T18:30:13.715 INFO:teuthology.orchestra.run.smithi184.stdout: "wait": { 2023-07-14T18:30:13.715 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2023-07-14T18:30:13.715 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2023-07-14T18:30:13.715 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2023-07-14T18:30:13.715 INFO:teuthology.orchestra.run.smithi184.stdout: } 2023-07-14T18:30:13.716 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2023-07-14T18:30:13.716 INFO:teuthology.orchestra.run.smithi184.stdout: "throttle-objecter_bytes": { 2023-07-14T18:30:13.716 INFO:teuthology.orchestra.run.smithi184.stdout: "val": 0, 2023-07-14T18:30:13.716 INFO:teuthology.orchestra.run.smithi184.stdout: "max": 104857600, 2023-07-14T18:30:13.716 INFO:teuthology.orchestra.run.smithi184.stdout: "get_started": 0, 2023-07-14T18:30:13.717 INFO:teuthology.orchestra.run.smithi184.stdout: "get": 0, 2023-07-14T18:30:13.717 INFO:teuthology.orchestra.run.smithi184.stdout: "get_sum": 0, 2023-07-14T18:30:13.717 INFO:teuthology.orchestra.run.smithi184.stdout: "get_or_fail_fail": 0, 2023-07-14T18:30:13.717 INFO:teuthology.orchestra.run.smithi184.stdout: "get_or_fail_success": 0, 2023-07-14T18:30:13.717 INFO:teuthology.orchestra.run.smithi184.stdout: "take": 3367, 2023-07-14T18:30:13.718 INFO:teuthology.orchestra.run.smithi184.stdout: "take_sum": 15357468, 2023-07-14T18:30:13.718 INFO:teuthology.orchestra.run.smithi184.stdout: "put": 3367, 2023-07-14T18:30:13.718 INFO:teuthology.orchestra.run.smithi184.stdout: "put_sum": 15357468, 2023-07-14T18:30:13.718 INFO:teuthology.orchestra.run.smithi184.stdout: "wait": { 2023-07-14T18:30:13.718 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2023-07-14T18:30:13.718 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2023-07-14T18:30:13.719 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2023-07-14T18:30:13.719 INFO:teuthology.orchestra.run.smithi184.stdout: } 2023-07-14T18:30:13.719 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2023-07-14T18:30:13.719 INFO:teuthology.orchestra.run.smithi184.stdout: "throttle-objecter_ops": { 2023-07-14T18:30:13.719 INFO:teuthology.orchestra.run.smithi184.stdout: "val": 0, 2023-07-14T18:30:13.720 INFO:teuthology.orchestra.run.smithi184.stdout: "max": 1024, 2023-07-14T18:30:13.720 INFO:teuthology.orchestra.run.smithi184.stdout: "get_started": 0, 2023-07-14T18:30:13.720 INFO:teuthology.orchestra.run.smithi184.stdout: "get": 0, 2023-07-14T18:30:13.720 INFO:teuthology.orchestra.run.smithi184.stdout: "get_sum": 0, 2023-07-14T18:30:13.720 INFO:teuthology.orchestra.run.smithi184.stdout: "get_or_fail_fail": 0, 2023-07-14T18:30:13.721 INFO:teuthology.orchestra.run.smithi184.stdout: "get_or_fail_success": 0, 2023-07-14T18:30:13.721 INFO:teuthology.orchestra.run.smithi184.stdout: "take": 3367, 2023-07-14T18:30:13.721 INFO:teuthology.orchestra.run.smithi184.stdout: "take_sum": 3367, 2023-07-14T18:30:13.721 INFO:teuthology.orchestra.run.smithi184.stdout: "put": 3367, 2023-07-14T18:30:13.721 INFO:teuthology.orchestra.run.smithi184.stdout: "put_sum": 3367, 2023-07-14T18:30:13.722 INFO:teuthology.orchestra.run.smithi184.stdout: "wait": { 2023-07-14T18:30:13.722 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2023-07-14T18:30:13.722 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2023-07-14T18:30:13.722 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2023-07-14T18:30:13.722 INFO:teuthology.orchestra.run.smithi184.stdout: } 2023-07-14T18:30:13.723 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2023-07-14T18:30:13.723 INFO:teuthology.orchestra.run.smithi184.stdout: "throttle-write_buf_throttle": { 2023-07-14T18:30:13.723 INFO:teuthology.orchestra.run.smithi184.stdout: "val": 0, 2023-07-14T18:30:13.723 INFO:teuthology.orchestra.run.smithi184.stdout: "max": 3758096384, 2023-07-14T18:30:13.723 INFO:teuthology.orchestra.run.smithi184.stdout: "get_started": 0, 2023-07-14T18:30:13.724 INFO:teuthology.orchestra.run.smithi184.stdout: "get": 0, 2023-07-14T18:30:13.724 INFO:teuthology.orchestra.run.smithi184.stdout: "get_sum": 0, 2023-07-14T18:30:13.724 INFO:teuthology.orchestra.run.smithi184.stdout: "get_or_fail_fail": 0, 2023-07-14T18:30:13.724 INFO:teuthology.orchestra.run.smithi184.stdout: "get_or_fail_success": 0, 2023-07-14T18:30:13.725 INFO:teuthology.orchestra.run.smithi184.stdout: "take": 0, 2023-07-14T18:30:13.725 INFO:teuthology.orchestra.run.smithi184.stdout: "take_sum": 0, 2023-07-14T18:30:13.725 INFO:teuthology.orchestra.run.smithi184.stdout: "put": 0, 2023-07-14T18:30:13.725 INFO:teuthology.orchestra.run.smithi184.stdout: "put_sum": 0, 2023-07-14T18:30:13.725 INFO:teuthology.orchestra.run.smithi184.stdout: "wait": { 2023-07-14T18:30:13.725 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2023-07-14T18:30:13.726 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2023-07-14T18:30:13.726 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2023-07-14T18:30:13.726 INFO:teuthology.orchestra.run.smithi184.stdout: } 2023-07-14T18:30:13.726 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2023-07-14T18:30:13.726 INFO:teuthology.orchestra.run.smithi184.stdout: "throttle-write_buf_throttle-0x55acabce6460": { 2023-07-14T18:30:13.727 INFO:teuthology.orchestra.run.smithi184.stdout: "val": 0, 2023-07-14T18:30:13.727 INFO:teuthology.orchestra.run.smithi184.stdout: "max": 3758096384, 2023-07-14T18:30:13.727 INFO:teuthology.orchestra.run.smithi184.stdout: "get_started": 0, 2023-07-14T18:30:13.727 INFO:teuthology.orchestra.run.smithi184.stdout: "get": 0, 2023-07-14T18:30:13.727 INFO:teuthology.orchestra.run.smithi184.stdout: "get_sum": 0, 2023-07-14T18:30:13.728 INFO:teuthology.orchestra.run.smithi184.stdout: "get_or_fail_fail": 0, 2023-07-14T18:30:13.728 INFO:teuthology.orchestra.run.smithi184.stdout: "get_or_fail_success": 0, 2023-07-14T18:30:13.728 INFO:teuthology.orchestra.run.smithi184.stdout: "take": 0, 2023-07-14T18:30:13.728 INFO:teuthology.orchestra.run.smithi184.stdout: "take_sum": 0, 2023-07-14T18:30:13.728 INFO:teuthology.orchestra.run.smithi184.stdout: "put": 0, 2023-07-14T18:30:13.729 INFO:teuthology.orchestra.run.smithi184.stdout: "put_sum": 0, 2023-07-14T18:30:13.729 INFO:teuthology.orchestra.run.smithi184.stdout: "wait": { 2023-07-14T18:30:13.729 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2023-07-14T18:30:13.729 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2023-07-14T18:30:13.729 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2023-07-14T18:30:13.730 INFO:teuthology.orchestra.run.smithi184.stdout: } 2023-07-14T18:30:13.730 INFO:teuthology.orchestra.run.smithi184.stdout: } 2023-07-14T18:30:13.730 INFO:teuthology.orchestra.run.smithi184.stdout:} 2023-07-14T18:30:14.802 INFO:tasks.check_counter:Daemon mds.l mds.exported=0 2023-07-14T18:30:14.803 INFO:tasks.check_counter:Daemon mds.l mds.imported=0 2023-07-14T18:30:14.803 INFO:tasks.check_counter:Daemon mds.l mds_cache.dir_update=0 2023-07-14T18:30:14.803 INFO:tasks.check_counter:Daemon mds.l mds_cache.dir_update_receipt=0 2023-07-14T18:30:14.803 INFO:tasks.check_counter:Daemon mds.l mds.dir_split=0 2023-07-14T18:30:14.804 DEBUG:teuthology.run_tasks:Unwinding manager ceph-fuse 2023-07-14T18:30:14.814 INFO:tasks.ceph_fuse:Unmounting ceph-fuse clients... 2023-07-14T18:30:14.814 DEBUG:teuthology.orchestra.run.smithi163:> set -ex 2023-07-14T18:30:14.815 DEBUG:teuthology.orchestra.run.smithi163:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-14T18:30:14.837 DEBUG:teuthology.orchestra.run.smithi163:> set -ex 2023-07-14T18:30:14.838 DEBUG:teuthology.orchestra.run.smithi163:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-14T18:30:14.898 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-14T18:30:15.092 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:15.063+0000 7f8162556700 1 -- 172.21.15.163:0/2119654577 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f815c0ffcf0 msgr2=0x7f815c100140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:30:15.093 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:15.063+0000 7f8162556700 1 --2- 172.21.15.163:0/2119654577 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f815c0ffcf0 0x7f815c100140 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f8150009990 tx=0x7f8150009ca0 comp rx=0 tx=0).stop 2023-07-14T18:30:15.093 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:15.063+0000 7f8162556700 1 -- 172.21.15.163:0/2119654577 shutdown_connections 2023-07-14T18:30:15.093 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:15.063+0000 7f8162556700 1 --2- 172.21.15.163:0/2119654577 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f815c100680 0x7f815c106f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:30:15.094 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:15.063+0000 7f8162556700 1 --2- 172.21.15.163:0/2119654577 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f815c0feb00 0x7f815c0fef10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:30:15.094 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:15.063+0000 7f8162556700 1 --2- 172.21.15.163:0/2119654577 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f815c0ffcf0 0x7f815c100140 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:30:15.094 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:15.063+0000 7f8162556700 1 -- 172.21.15.163:0/2119654577 >> 172.21.15.163:0/2119654577 conn(0x7f815c0fa100 msgr2=0x7f815c0fc550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:30:15.094 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:15.063+0000 7f8162556700 1 -- 172.21.15.163:0/2119654577 shutdown_connections 2023-07-14T18:30:15.094 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:15.063+0000 7f8162556700 1 -- 172.21.15.163:0/2119654577 wait complete. 2023-07-14T18:30:15.096 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:15.064+0000 7f8162556700 1 Processor -- start 2023-07-14T18:30:15.096 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:15.064+0000 7f8162556700 1 -- start start 2023-07-14T18:30:15.097 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:15.064+0000 7f8162556700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f815c0feb00 0x7f815c193590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:30:15.097 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:15.064+0000 7f8162556700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f815c0ffcf0 0x7f815c193ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:30:15.097 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:15.064+0000 7f8162556700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f815c100680 0x7f815c19ab40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:30:15.097 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:15.064+0000 7f8162556700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f815c19b110 con 0x7f815c0feb00 2023-07-14T18:30:15.097 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:15.064+0000 7f8162556700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f815c19b250 con 0x7f815c0ffcf0 2023-07-14T18:30:15.098 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:15.064+0000 7f8162556700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f815c19b3e0 con 0x7f815c100680 2023-07-14T18:30:15.098 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:15.064+0000 7f815bfff700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f815c0feb00 0x7f815c193590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:30:15.098 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:15.064+0000 7f815b7fe700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f815c0ffcf0 0x7f815c193ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:30:15.098 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:15.064+0000 7f815bfff700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f815c0feb00 0x7f815c193590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:60780/0 (socket says 172.21.15.163:60780) 2023-07-14T18:30:15.098 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:15.064+0000 7f815b7fe700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f815c0ffcf0 0x7f815c193ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.163:33234/0 (socket says 172.21.15.163:33234) 2023-07-14T18:30:15.099 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:15.064+0000 7f815bfff700 1 -- 172.21.15.163:0/134496759 learned_addr learned my addr 172.21.15.163:0/134496759 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:30:15.099 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:15.064+0000 7f8160af3700 1 --2- 172.21.15.163:0/134496759 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f815c100680 0x7f815c19ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:30:15.099 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:15.065+0000 7f815b7fe700 1 -- 172.21.15.163:0/134496759 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f815c100680 msgr2=0x7f815c19ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:30:15.099 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:15.065+0000 7f815b7fe700 1 --2- 172.21.15.163:0/134496759 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f815c100680 0x7f815c19ab40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:30:15.099 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:15.065+0000 7f815b7fe700 1 -- 172.21.15.163:0/134496759 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f815c0feb00 msgr2=0x7f815c193590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:30:15.100 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:15.065+0000 7f815b7fe700 1 --2- 172.21.15.163:0/134496759 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f815c0feb00 0x7f815c193590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:30:15.100 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:15.065+0000 7f815b7fe700 1 -- 172.21.15.163:0/134496759 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f815400be50 con 0x7f815c0ffcf0 2023-07-14T18:30:15.100 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:15.065+0000 7f815bfff700 1 --2- 172.21.15.163:0/134496759 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f815c0feb00 0x7f815c193590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T18:30:15.100 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:15.065+0000 7f815b7fe700 1 --2- 172.21.15.163:0/134496759 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f815c0ffcf0 0x7f815c193ad0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f8150003f60 tx=0x7f81500042a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:30:15.100 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:15.065+0000 7f81597fa700 1 -- 172.21.15.163:0/134496759 <== mon.2 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f815001d070 con 0x7f815c0ffcf0 2023-07-14T18:30:15.101 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:15.065+0000 7f8162556700 1 -- 172.21.15.163:0/134496759 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f81500095f0 con 0x7f815c0ffcf0 2023-07-14T18:30:15.101 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:15.065+0000 7f81597fa700 1 -- 172.21.15.163:0/134496759 <== mon.2 v2:172.21.15.172:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f8150003d20 con 0x7f815c0ffcf0 2023-07-14T18:30:15.101 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:15.065+0000 7f81597fa700 1 -- 172.21.15.163:0/134496759 <== mon.2 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8150022d00 con 0x7f815c0ffcf0 2023-07-14T18:30:15.101 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:15.065+0000 7f8162556700 1 -- 172.21.15.163:0/134496759 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f815c19b9a0 con 0x7f815c0ffcf0 2023-07-14T18:30:15.101 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:15.066+0000 7f8162556700 1 -- 172.21.15.163:0/134496759 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f815c1090f0 con 0x7f815c0ffcf0 2023-07-14T18:30:15.102 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:15.067+0000 7f81597fa700 1 -- 172.21.15.163:0/134496759 <== mon.2 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 18) v1 ==== 135716+0+0 (secure 0 0 0) 0x7f8150022500 con 0x7f815c0ffcf0 2023-07-14T18:30:15.102 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:15.068+0000 7f81597fa700 1 --2- 172.21.15.163:0/134496759 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f81440a1220 0x7f81440a36d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:30:15.103 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:15.068+0000 7f815bfff700 1 --2- 172.21.15.163:0/134496759 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f81440a1220 0x7f81440a36d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:30:15.103 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:15.068+0000 7f81597fa700 1 -- 172.21.15.163:0/134496759 <== mon.2 v2:172.21.15.172:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 9049+0+0 (secure 0 0 0) 0x7f81500ce160 con 0x7f815c0ffcf0 2023-07-14T18:30:15.103 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:15.069+0000 7f815bfff700 1 --2- 172.21.15.163:0/134496759 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f81440a1220 0x7f81440a36d0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f814c005950 tx=0x7f814c009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:30:15.103 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:15.074+0000 7f81597fa700 1 -- 172.21.15.163:0/134496759 <== mon.2 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178025 (secure 0 0 0) 0x7f8150097610 con 0x7f815c0ffcf0 2023-07-14T18:30:15.164 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:30:14 smithi184 ceph-mon[98481]: pgmap v827: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-07-14T18:30:15.206 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:30:14 smithi163 ceph-mon[96576]: pgmap v827: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-07-14T18:30:15.265 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:30:14 smithi172 ceph-mon[97983]: pgmap v827: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-07-14T18:30:15.344 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:15.315+0000 7f8162556700 1 -- 172.21.15.163:0/134496759 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f815c1092e0 con 0x7f815c0ffcf0 2023-07-14T18:30:15.346 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:15.316+0000 7f81597fa700 1 -- 172.21.15.163:0/134496759 <== mon.2 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v88) v1 ==== 74+0+24603 (secure 0 0 0) 0x7f815009ac30 con 0x7f815c0ffcf0 2023-07-14T18:30:15.346 INFO:teuthology.orchestra.run.smithi163.stdout: 2023-07-14T18:30:15.347 INFO:teuthology.orchestra.run.smithi163.stdout:{"epoch":88,"fsid":"bf7326ec-2270-11ee-9b33-001a4aab830c","created":"2023-07-14T18:04:26.263517+0000","modified":"2023-07-14T18:13:17.791075+0000","last_up_change":"2023-07-14T18:10:27.514863+0000","last_in_change":"2023-07-14T18:10:10.726443+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-14T18:07:19.653852+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-07-14T18:11:07.314989+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-07-14T18:11:08.274627+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-07-14T18:11:11.991162+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"e6490568-046d-43ef-bb07-d79fb884b276","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6802","nonce":3124653025},{"type":"v1","addr":"172.21.15.163:6803","nonce":3124653025}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6804","nonce":3124653025},{"type":"v1","addr":"172.21.15.163:6805","nonce":3124653025}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6808","nonce":3124653025},{"type":"v1","addr":"172.21.15.163:6809","nonce":3124653025}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6806","nonce":3124653025},{"type":"v1","addr":"172.21.15.163:6807","nonce":3124653025}]},"public_addr":"172.21.15.163:6803/3124653025","cluster_addr":"172.21.15.163:6805/3124653025","heartbeat_back_addr":"172.21.15.163:6809/3124653025","heartbeat_front_addr":"172.21.15.163:6807/3124653025","state":["exists","up"]},{"osd":1,"uuid":"0af39bda-f096-4603-adcc-bf1988f36603","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":3774455900},{"type":"v1","addr":"172.21.15.172:6801","nonce":3774455900}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":3774455900},{"type":"v1","addr":"172.21.15.172:6803","nonce":3774455900}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":3774455900},{"type":"v1","addr":"172.21.15.172:6807","nonce":3774455900}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":3774455900},{"type":"v1","addr":"172.21.15.172:6805","nonce":3774455900}]},"public_addr":"172.21.15.172:6801/3774455900","cluster_addr":"172.21.15.172:6803/3774455900","heartbeat_back_addr":"172.21.15.172:6807/3774455900","heartbeat_front_addr":"172.21.15.172:6805/3774455900","state":["exists","up"]},{"osd":2,"uuid":"cc732c13-af0f-4199-98e6-fe960ed4e5dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":1976927678},{"type":"v1","addr":"172.21.15.184:6801","nonce":1976927678}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":1976927678},{"type":"v1","addr":"172.21.15.184:6803","nonce":1976927678}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":1976927678},{"type":"v1","addr":"172.21.15.184:6807","nonce":1976927678}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":1976927678},{"type":"v1","addr":"172.21.15.184:6805","nonce":1976927678}]},"public_addr":"172.21.15.184:6801/1976927678","cluster_addr":"172.21.15.184:6803/1976927678","heartbeat_back_addr":"172.21.15.184:6807/1976927678","heartbeat_front_addr":"172.21.15.184:6805/1976927678","state":["exists","up"]},{"osd":3,"uuid":"dcee9576-0bc6-4ab0-8f63-79eacd0eca5f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6810","nonce":2589130694},{"type":"v1","addr":"172.21.15.163:6811","nonce":2589130694}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6812","nonce":2589130694},{"type":"v1","addr":"172.21.15.163:6813","nonce":2589130694}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6816","nonce":2589130694},{"type":"v1","addr":"172.21.15.163:6817","nonce":2589130694}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6814","nonce":2589130694},{"type":"v1","addr":"172.21.15.163:6815","nonce":2589130694}]},"public_addr":"172.21.15.163:6811/2589130694","cluster_addr":"172.21.15.163:6813/2589130694","heartbeat_back_addr":"172.21.15.163:6817/2589130694","heartbeat_front_addr":"172.21.15.163:6815/2589130694","state":["exists","up"]},{"osd":4,"uuid":"055df823-b8b0-426a-83c2-f0d727932ad8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":3319632614},{"type":"v1","addr":"172.21.15.172:6809","nonce":3319632614}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6810","nonce":3319632614},{"type":"v1","addr":"172.21.15.172:6811","nonce":3319632614}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6814","nonce":3319632614},{"type":"v1","addr":"172.21.15.172:6815","nonce":3319632614}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":3319632614},{"type":"v1","addr":"172.21.15.172:6813","nonce":3319632614}]},"public_addr":"172.21.15.172:6809/3319632614","cluster_addr":"172.21.15.172:6811/3319632614","heartbeat_back_addr":"172.21.15.172:6815/3319632614","heartbeat_front_addr":"172.21.15.172:6813/3319632614","state":["exists","up"]},{"osd":5,"uuid":"ef5ef02a-b4e2-4790-9d27-f6d2247b25c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":2662084043},{"type":"v1","addr":"172.21.15.184:6809","nonce":2662084043}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6810","nonce":2662084043},{"type":"v1","addr":"172.21.15.184:6811","nonce":2662084043}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6814","nonce":2662084043},{"type":"v1","addr":"172.21.15.184:6815","nonce":2662084043}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6812","nonce":2662084043},{"type":"v1","addr":"172.21.15.184:6813","nonce":2662084043}]},"public_addr":"172.21.15.184:6809/2662084043","cluster_addr":"172.21.15.184:6811/2662084043","heartbeat_back_addr":"172.21.15.184:6815/2662084043","heartbeat_front_addr":"172.21.15.184:6813/2662084043","state":["exists","up"]},{"osd":6,"uuid":"dba754be-0fc5-4867-a6d5-cf97eb344f81","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":44,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6818","nonce":2530874117},{"type":"v1","addr":"172.21.15.163:6819","nonce":2530874117}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6820","nonce":2530874117},{"type":"v1","addr":"172.21.15.163:6821","nonce":2530874117}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6824","nonce":2530874117},{"type":"v1","addr":"172.21.15.163:6825","nonce":2530874117}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6822","nonce":2530874117},{"type":"v1","addr":"172.21.15.163:6823","nonce":2530874117}]},"public_addr":"172.21.15.163:6819/2530874117","cluster_addr":"172.21.15.163:6821/2530874117","heartbeat_back_addr":"172.21.15.163:6825/2530874117","heartbeat_front_addr":"172.21.15.163:6823/2530874117","state":["exists","up"]},{"osd":7,"uuid":"edd76e6b-6077-4619-b00d-1e906f70ddcc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":49,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":233511803},{"type":"v1","addr":"172.21.15.172:6817","nonce":233511803}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6818","nonce":233511803},{"type":"v1","addr":"172.21.15.172:6819","nonce":233511803}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":233511803},{"type":"v1","addr":"172.21.15.172:6823","nonce":233511803}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6820","nonce":233511803},{"type":"v1","addr":"172.21.15.172:6821","nonce":233511803}]},"public_addr":"172.21.15.172:6817/233511803","cluster_addr":"172.21.15.172:6819/233511803","heartbeat_back_addr":"172.21.15.172:6823/233511803","heartbeat_front_addr":"172.21.15.172:6821/233511803","state":["exists","up"]},{"osd":8,"uuid":"36559400-f33e-44e6-868a-316d34da457d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":56,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6816","nonce":290154343},{"type":"v1","addr":"172.21.15.184:6817","nonce":290154343}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6818","nonce":290154343},{"type":"v1","addr":"172.21.15.184:6819","nonce":290154343}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6822","nonce":290154343},{"type":"v1","addr":"172.21.15.184:6823","nonce":290154343}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6820","nonce":290154343},{"type":"v1","addr":"172.21.15.184:6821","nonce":290154343}]},"public_addr":"172.21.15.184:6817/290154343","cluster_addr":"172.21.15.184:6819/290154343","heartbeat_back_addr":"172.21.15.184:6823/290154343","heartbeat_front_addr":"172.21.15.184:6821/290154343","state":["exists","up"]},{"osd":9,"uuid":"d484f111-f36c-4c67-9a8a-ae03e7e0d137","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6826","nonce":3848110906},{"type":"v1","addr":"172.21.15.163:6827","nonce":3848110906}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6828","nonce":3848110906},{"type":"v1","addr":"172.21.15.163:6829","nonce":3848110906}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6832","nonce":3848110906},{"type":"v1","addr":"172.21.15.163:6833","nonce":3848110906}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6830","nonce":3848110906},{"type":"v1","addr":"172.21.15.163:6831","nonce":3848110906}]},"public_addr":"172.21.15.163:6827/3848110906","cluster_addr":"172.21.15.163:6829/3848110906","heartbeat_back_addr":"172.21.15.163:6833/3848110906","heartbeat_front_addr":"172.21.15.163:6831/3848110906","state":["exists","up"]},{"osd":10,"uuid":"d943f7c0-da3d-4605-9e23-0231e675c6be","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6824","nonce":3281085356},{"type":"v1","addr":"172.21.15.172:6825","nonce":3281085356}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":3281085356},{"type":"v1","addr":"172.21.15.172:6827","nonce":3281085356}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":3281085356},{"type":"v1","addr":"172.21.15.172:6831","nonce":3281085356}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6828","nonce":3281085356},{"type":"v1","addr":"172.21.15.172:6829","nonce":3281085356}]},"public_addr":"172.21.15.172:6825/3281085356","cluster_addr":"172.21.15.172:6827/3281085356","heartbeat_back_addr":"172.21.15.172:6831/3281085356","heartbeat_front_addr":"172.21.15.172:6829/3281085356","state":["exists","up"]},{"osd":11,"uuid":"09e610a8-408a-4119-a21b-c4de2810a538","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":75,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6824","nonce":3614578747},{"type":"v1","addr":"172.21.15.184:6825","nonce":3614578747}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6826","nonce":3614578747},{"type":"v1","addr":"172.21.15.184:6827","nonce":3614578747}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6830","nonce":3614578747},{"type":"v1","addr":"172.21.15.184:6831","nonce":3614578747}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6828","nonce":3614578747},{"type":"v1","addr":"172.21.15.184:6829","nonce":3614578747}]},"public_addr":"172.21.15.184:6825/3614578747","cluster_addr":"172.21.15.184:6827/3614578747","heartbeat_back_addr":"172.21.15.184:6831/3614578747","heartbeat_front_addr":"172.21.15.184:6829/3614578747","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T18:06:36.067578+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T18:06:57.095120+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T18:07:17.825363+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T18:07:38.977196+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T18:08:00.108709+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T18:08:20.700646+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T18:08:41.473899+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T18:09:02.856536+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T18:09:23.832722+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T18:09:44.860884+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T18:10:05.520678+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T18:10:26.426315+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.8","mappings":[{"from":2,"to":11}]},{"pgid":"2.b","mappings":[{"from":8,"to":11}]},{"pgid":"3.1","mappings":[{"from":4,"to":9}]},{"pgid":"3.6","mappings":[{"from":4,"to":6}]},{"pgid":"3.25","mappings":[{"from":5,"to":9}]},{"pgid":"3.27","mappings":[{"from":4,"to":8}]},{"pgid":"3.2d","mappings":[{"from":3,"to":9}]},{"pgid":"4.a","mappings":[{"from":5,"to":8}]},{"pgid":"4.12","mappings":[{"from":9,"to":10}]},{"pgid":"4.14","mappings":[{"from":9,"to":8}]},{"pgid":"4.17","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.163:6801/1086512093":"2023-07-15T18:05:15.331458+0000","172.21.15.163:6800/1086512093":"2023-07-15T18:05:15.331458+0000","172.21.15.163:0/4235784810":"2023-07-15T18:05:15.331458+0000","172.21.15.163:6800/236891232":"2023-07-15T18:04:53.288443+0000","172.21.15.163:6801/236891232":"2023-07-15T18:04:53.288443+0000","172.21.15.163:0/3260193612":"2023-07-15T18:05:15.331458+0000","172.21.15.163:0/3513629472":"2023-07-15T18:04:53.288443+0000","172.21.15.163:0/1090329830":"2023-07-15T18:04:53.288443+0000","172.21.15.163:0/3868922045":"2023-07-15T18:05:15.331458+0000","172.21.15.163:0/2945662447":"2023-07-15T18:04:53.288443+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-14T18:30:15.348 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:15.319+0000 7f8162556700 1 -- 172.21.15.163:0/134496759 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f81440a1220 msgr2=0x7f81440a36d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:30:15.349 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:15.319+0000 7f8162556700 1 --2- 172.21.15.163:0/134496759 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f81440a1220 0x7f81440a36d0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f814c005950 tx=0x7f814c009260 comp rx=0 tx=0).stop 2023-07-14T18:30:15.349 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:15.319+0000 7f8162556700 1 -- 172.21.15.163:0/134496759 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f815c0ffcf0 msgr2=0x7f815c193ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:30:15.349 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:15.319+0000 7f8162556700 1 --2- 172.21.15.163:0/134496759 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f815c0ffcf0 0x7f815c193ad0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f8150003f60 tx=0x7f81500042a0 comp rx=0 tx=0).stop 2023-07-14T18:30:15.349 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:15.319+0000 7f8162556700 1 -- 172.21.15.163:0/134496759 shutdown_connections 2023-07-14T18:30:15.349 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:15.319+0000 7f8162556700 1 --2- 172.21.15.163:0/134496759 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f81440a1220 0x7f81440a36d0 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:30:15.350 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:15.319+0000 7f8162556700 1 --2- 172.21.15.163:0/134496759 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f815c100680 0x7f815c19ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:30:15.350 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:15.319+0000 7f8162556700 1 --2- 172.21.15.163:0/134496759 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f815c0feb00 0x7f815c193590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:30:15.350 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:15.319+0000 7f8162556700 1 --2- 172.21.15.163:0/134496759 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f815c0ffcf0 0x7f815c193ad0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:30:15.350 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:15.319+0000 7f8162556700 1 -- 172.21.15.163:0/134496759 >> 172.21.15.163:0/134496759 conn(0x7f815c0fa100 msgr2=0x7f815c0fc320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:30:15.350 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:15.319+0000 7f8162556700 1 -- 172.21.15.163:0/134496759 shutdown_connections 2023-07-14T18:30:15.351 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:15.319+0000 7f8162556700 1 -- 172.21.15.163:0/134496759 wait complete. 2023-07-14T18:30:15.363 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-14T18:07:19.653852+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-14T18:11:07.314989+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '79', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-07-14T18:11:08.274627+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '80', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-07-14T18:11:11.991162+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '84', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-07-14T18:30:15.364 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-14T18:30:15.510 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:15.480+0000 7f77aa912700 1 -- 172.21.15.163:0/57205540 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f77a4100690 msgr2=0x7f77a4106f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:30:15.510 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:15.480+0000 7f77aa912700 1 --2- 172.21.15.163:0/57205540 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f77a4100690 0x7f77a4106f50 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7f779c00b0a0 tx=0x7f779c00b3b0 comp rx=0 tx=0).stop 2023-07-14T18:30:15.511 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:15.480+0000 7f77aa912700 1 -- 172.21.15.163:0/57205540 shutdown_connections 2023-07-14T18:30:15.511 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:15.480+0000 7f77aa912700 1 --2- 172.21.15.163:0/57205540 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f77a40feb10 0x7f77a40fef20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:30:15.511 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:15.480+0000 7f77aa912700 1 --2- 172.21.15.163:0/57205540 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f77a4100690 0x7f77a4106f50 unknown :-1 s=CLOSED pgs=766 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:30:15.511 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:15.480+0000 7f77aa912700 1 --2- 172.21.15.163:0/57205540 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f77a40ffd00 0x7f77a4100150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:30:15.511 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:15.480+0000 7f77aa912700 1 -- 172.21.15.163:0/57205540 >> 172.21.15.163:0/57205540 conn(0x7f77a40fa130 msgr2=0x7f77a40fc560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:30:15.512 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:15.480+0000 7f77aa912700 1 -- 172.21.15.163:0/57205540 shutdown_connections 2023-07-14T18:30:15.512 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:15.480+0000 7f77aa912700 1 -- 172.21.15.163:0/57205540 wait complete. 2023-07-14T18:30:15.514 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:15.481+0000 7f77aa912700 1 Processor -- start 2023-07-14T18:30:15.514 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:15.481+0000 7f77aa912700 1 -- start start 2023-07-14T18:30:15.514 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:15.481+0000 7f77aa912700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f77a40feb10 0x7f77a4068370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:30:15.514 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:15.481+0000 7f77aa912700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f77a40ffd00 0x7f77a419a670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:30:15.514 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:15.481+0000 7f77aa912700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f77a4100690 0x7f77a419cd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:30:15.515 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:15.481+0000 7f77aa912700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77a419d4a0 con 0x7f77a40ffd00 2023-07-14T18:30:15.515 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:15.481+0000 7f77aa912700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77a419d610 con 0x7f77a40feb10 2023-07-14T18:30:15.515 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:15.481+0000 7f77aa912700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77a419d7d0 con 0x7f77a4100690 2023-07-14T18:30:15.515 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:15.482+0000 7f77a3fff700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f77a40feb10 0x7f77a4068370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:30:15.515 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:15.482+0000 7f779bfff700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f77a40ffd00 0x7f77a419a670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:30:15.516 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:15.482+0000 7f77a3fff700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f77a40feb10 0x7f77a4068370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.163:33246/0 (socket says 172.21.15.163:33246) 2023-07-14T18:30:15.516 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:15.482+0000 7f77a3fff700 1 -- 172.21.15.163:0/4138174450 learned_addr learned my addr 172.21.15.163:0/4138174450 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:30:15.516 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:15.482+0000 7f77a8eaf700 1 --2- 172.21.15.163:0/4138174450 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f77a4100690 0x7f77a419cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:30:15.516 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:15.482+0000 7f779bfff700 1 -- 172.21.15.163:0/4138174450 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f77a4100690 msgr2=0x7f77a419cd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:30:15.516 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:15.482+0000 7f779bfff700 1 --2- 172.21.15.163:0/4138174450 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f77a4100690 0x7f77a419cd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:30:15.517 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:15.482+0000 7f779bfff700 1 -- 172.21.15.163:0/4138174450 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f77a40feb10 msgr2=0x7f77a4068370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:30:15.517 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:15.482+0000 7f779bfff700 1 --2- 172.21.15.163:0/4138174450 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f77a40feb10 0x7f77a4068370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:30:15.517 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:15.482+0000 7f779bfff700 1 -- 172.21.15.163:0/4138174450 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f779c009d00 con 0x7f77a40ffd00 2023-07-14T18:30:15.517 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:15.482+0000 7f77a3fff700 1 --2- 172.21.15.163:0/4138174450 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f77a40feb10 0x7f77a4068370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T18:30:15.517 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:15.482+0000 7f77a8eaf700 1 --2- 172.21.15.163:0/4138174450 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f77a4100690 0x7f77a419cd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T18:30:15.518 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:15.482+0000 7f779bfff700 1 --2- 172.21.15.163:0/4138174450 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f77a40ffd00 0x7f77a419a670 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7f779400e9f0 tx=0x7f779400ed00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:30:15.518 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:15.482+0000 7f77a1ffb700 1 -- 172.21.15.163:0/4138174450 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f779400c9c0 con 0x7f77a40ffd00 2023-07-14T18:30:15.518 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:15.482+0000 7f77a1ffb700 1 -- 172.21.15.163:0/4138174450 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f7794010430 con 0x7f77a40ffd00 2023-07-14T18:30:15.518 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:15.482+0000 7f77aa912700 1 -- 172.21.15.163:0/4138174450 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f77a41944a0 con 0x7f77a40ffd00 2023-07-14T18:30:15.518 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:15.482+0000 7f77a1ffb700 1 -- 172.21.15.163:0/4138174450 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7794018680 con 0x7f77a40ffd00 2023-07-14T18:30:15.518 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:15.482+0000 7f77aa912700 1 -- 172.21.15.163:0/4138174450 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f77a41949b0 con 0x7f77a40ffd00 2023-07-14T18:30:15.519 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:15.483+0000 7f77aa912700 1 -- 172.21.15.163:0/4138174450 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f77a410a1a0 con 0x7f77a40ffd00 2023-07-14T18:30:15.519 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:15.485+0000 7f77a1ffb700 1 -- 172.21.15.163:0/4138174450 <== mon.0 v2:172.21.15.163:3300/0 4 ==== mgrmap(e 18) v1 ==== 135716+0+0 (secure 0 0 0) 0x7f77940105a0 con 0x7f77a40ffd00 2023-07-14T18:30:15.520 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:15.485+0000 7f77a1ffb700 1 --2- 172.21.15.163:0/4138174450 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f77900a1150 0x7f77900a3600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:30:15.520 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:15.485+0000 7f77a1ffb700 1 -- 172.21.15.163:0/4138174450 <== mon.0 v2:172.21.15.163:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 9049+0+0 (secure 0 0 0) 0x7f7794014070 con 0x7f77a40ffd00 2023-07-14T18:30:15.520 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:15.485+0000 7f77a3fff700 1 --2- 172.21.15.163:0/4138174450 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f77900a1150 0x7f77900a3600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:30:15.520 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:15.486+0000 7f77a3fff700 1 --2- 172.21.15.163:0/4138174450 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f77900a1150 0x7f77900a3600 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f778c005950 tx=0x7f778c012040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:30:15.521 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:15.490+0000 7f77a1ffb700 1 -- 172.21.15.163:0/4138174450 <== mon.0 v2:172.21.15.163:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178025 (secure 0 0 0) 0x7f7794096470 con 0x7f77a40ffd00 2023-07-14T18:30:15.782 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:15.753+0000 7f77aa912700 1 -- 172.21.15.163:0/4138174450 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f77a4195270 con 0x7f77a40ffd00 2023-07-14T18:30:15.783 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:15.754+0000 7f77a1ffb700 1 -- 172.21.15.163:0/4138174450 <== mon.0 v2:172.21.15.163:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v88) v1 ==== 93+0+10 (secure 0 0 0) 0x7f7794026020 con 0x7f77a40ffd00 2023-07-14T18:30:15.784 INFO:teuthology.orchestra.run.smithi163.stdout:pg_num: 1 2023-07-14T18:30:15.786 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:15.756+0000 7f77aa912700 1 -- 172.21.15.163:0/4138174450 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f77900a1150 msgr2=0x7f77900a3600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:30:15.786 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:15.756+0000 7f77aa912700 1 --2- 172.21.15.163:0/4138174450 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f77900a1150 0x7f77900a3600 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f778c005950 tx=0x7f778c012040 comp rx=0 tx=0).stop 2023-07-14T18:30:15.786 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:15.756+0000 7f77aa912700 1 -- 172.21.15.163:0/4138174450 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f77a40ffd00 msgr2=0x7f77a419a670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:30:15.786 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:15.756+0000 7f77aa912700 1 --2- 172.21.15.163:0/4138174450 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f77a40ffd00 0x7f77a419a670 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7f779400e9f0 tx=0x7f779400ed00 comp rx=0 tx=0).stop 2023-07-14T18:30:15.787 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:15.756+0000 7f77aa912700 1 -- 172.21.15.163:0/4138174450 shutdown_connections 2023-07-14T18:30:15.787 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:15.756+0000 7f77aa912700 1 --2- 172.21.15.163:0/4138174450 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f77900a1150 0x7f77900a3600 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:30:15.787 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:15.756+0000 7f77aa912700 1 --2- 172.21.15.163:0/4138174450 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f77a4100690 0x7f77a419cd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:30:15.787 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:15.756+0000 7f77aa912700 1 --2- 172.21.15.163:0/4138174450 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f77a40feb10 0x7f77a4068370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:30:15.787 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:15.756+0000 7f77aa912700 1 --2- 172.21.15.163:0/4138174450 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f77a40ffd00 0x7f77a419a670 unknown :-1 s=CLOSED pgs=767 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:30:15.788 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:15.756+0000 7f77aa912700 1 -- 172.21.15.163:0/4138174450 >> 172.21.15.163:0/4138174450 conn(0x7f77a40fa130 msgr2=0x7f77a40fc380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:30:15.788 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:15.756+0000 7f77aa912700 1 -- 172.21.15.163:0/4138174450 shutdown_connections 2023-07-14T18:30:15.788 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:15.756+0000 7f77aa912700 1 -- 172.21.15.163:0/4138174450 wait complete. 2023-07-14T18:30:15.800 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-14T18:30:15.944 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:15.915+0000 7f5c0e41c700 1 -- 172.21.15.163:0/3094417480 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f5c081006f0 msgr2=0x7f5c08102ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:30:15.945 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:15.915+0000 7f5c0e41c700 1 --2- 172.21.15.163:0/3094417480 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f5c081006f0 0x7f5c08102ad0 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7f5bfc009990 tx=0x7f5bfc009ca0 comp rx=0 tx=0).stop 2023-07-14T18:30:15.945 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:15.915+0000 7f5c0e41c700 1 -- 172.21.15.163:0/3094417480 shutdown_connections 2023-07-14T18:30:15.945 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:15.915+0000 7f5c0e41c700 1 --2- 172.21.15.163:0/3094417480 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5c08105930 0x7f5c08107d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:30:15.945 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:15.915+0000 7f5c0e41c700 1 --2- 172.21.15.163:0/3094417480 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f5c081006f0 0x7f5c08102ad0 unknown :-1 s=CLOSED pgs=768 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:30:15.946 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:15.915+0000 7f5c0e41c700 1 --2- 172.21.15.163:0/3094417480 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5c08103010 0x7f5c081053f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:30:15.946 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:15.915+0000 7f5c0e41c700 1 -- 172.21.15.163:0/3094417480 >> 172.21.15.163:0/3094417480 conn(0x7f5c080fa130 msgr2=0x7f5c080fc560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:30:15.946 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:15.915+0000 7f5c0e41c700 1 -- 172.21.15.163:0/3094417480 shutdown_connections 2023-07-14T18:30:15.946 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:15.915+0000 7f5c0e41c700 1 -- 172.21.15.163:0/3094417480 wait complete. 2023-07-14T18:30:15.949 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:15.915+0000 7f5c0e41c700 1 Processor -- start 2023-07-14T18:30:15.949 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:15.916+0000 7f5c0e41c700 1 -- start start 2023-07-14T18:30:15.949 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:15.916+0000 7f5c0e41c700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5c081006f0 0x7f5c08195860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:30:15.949 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:15.916+0000 7f5c0e41c700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f5c08103010 0x7f5c08195da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:30:15.950 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:15.916+0000 7f5c0e41c700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5c08105930 0x7f5c0819ce10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:30:15.950 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:15.916+0000 7f5c0e41c700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c0819d3e0 con 0x7f5c08103010 2023-07-14T18:30:15.950 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:15.916+0000 7f5c0e41c700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c0819d520 con 0x7f5c08105930 2023-07-14T18:30:15.950 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:15.916+0000 7f5c0e41c700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c0819d6b0 con 0x7f5c081006f0 2023-07-14T18:30:15.950 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:15.916+0000 7f5c077fe700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f5c08103010 0x7f5c08195da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:30:15.951 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:15.916+0000 7f5c077fe700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f5c08103010 0x7f5c08195da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:60808/0 (socket says 172.21.15.163:60808) 2023-07-14T18:30:15.951 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:15.916+0000 7f5c077fe700 1 -- 172.21.15.163:0/3585619619 learned_addr learned my addr 172.21.15.163:0/3585619619 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:30:15.951 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:15.916+0000 7f5c07fff700 1 --2- 172.21.15.163:0/3585619619 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5c081006f0 0x7f5c08195860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:30:15.951 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:15.916+0000 7f5c0c9b9700 1 --2- 172.21.15.163:0/3585619619 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5c08105930 0x7f5c0819ce10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:30:15.951 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:15.916+0000 7f5c077fe700 1 -- 172.21.15.163:0/3585619619 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5c081006f0 msgr2=0x7f5c08195860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:30:15.952 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:15.916+0000 7f5c077fe700 1 --2- 172.21.15.163:0/3585619619 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5c081006f0 0x7f5c08195860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:30:15.952 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:15.916+0000 7f5c077fe700 1 -- 172.21.15.163:0/3585619619 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5c08105930 msgr2=0x7f5c0819ce10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:30:15.952 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:15.916+0000 7f5c077fe700 1 --2- 172.21.15.163:0/3585619619 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5c08105930 0x7f5c0819ce10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:30:15.952 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:15.916+0000 7f5c077fe700 1 -- 172.21.15.163:0/3585619619 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5bfc0095f0 con 0x7f5c08103010 2023-07-14T18:30:15.953 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:15.917+0000 7f5c077fe700 1 --2- 172.21.15.163:0/3585619619 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f5c08103010 0x7f5c08195da0 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7f5bf800e9a0 tx=0x7f5bf800ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:30:15.953 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:15.917+0000 7f5c057fa700 1 -- 172.21.15.163:0/3585619619 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bf8009790 con 0x7f5c08103010 2023-07-14T18:30:15.953 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:15.917+0000 7f5c057fa700 1 -- 172.21.15.163:0/3585619619 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f5bf8010430 con 0x7f5c08103010 2023-07-14T18:30:15.953 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:15.917+0000 7f5c057fa700 1 -- 172.21.15.163:0/3585619619 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bf800cea0 con 0x7f5c08103010 2023-07-14T18:30:15.953 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:15.917+0000 7f5c0e41c700 1 -- 172.21.15.163:0/3585619619 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5c0819d990 con 0x7f5c08103010 2023-07-14T18:30:15.953 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:15.917+0000 7f5c0e41c700 1 -- 172.21.15.163:0/3585619619 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5c0819de50 con 0x7f5c08103010 2023-07-14T18:30:15.954 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:15.918+0000 7f5c0e41c700 1 -- 172.21.15.163:0/3585619619 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5c080fbca0 con 0x7f5c08103010 2023-07-14T18:30:15.954 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:15.919+0000 7f5c057fa700 1 -- 172.21.15.163:0/3585619619 <== mon.0 v2:172.21.15.163:3300/0 4 ==== mgrmap(e 18) v1 ==== 135716+0+0 (secure 0 0 0) 0x7f5bf80105a0 con 0x7f5c08103010 2023-07-14T18:30:15.954 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:15.919+0000 7f5c057fa700 1 --2- 172.21.15.163:0/3585619619 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f5bf00a1150 0x7f5bf00a3600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:30:15.954 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:15.919+0000 7f5c07fff700 1 --2- 172.21.15.163:0/3585619619 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f5bf00a1150 0x7f5bf00a3600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:30:15.954 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:15.919+0000 7f5c057fa700 1 -- 172.21.15.163:0/3585619619 <== mon.0 v2:172.21.15.163:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 9049+0+0 (secure 0 0 0) 0x7f5bf8014070 con 0x7f5c08103010 2023-07-14T18:30:15.955 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:15.920+0000 7f5c07fff700 1 --2- 172.21.15.163:0/3585619619 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f5bf00a1150 0x7f5bf00a3600 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f5bfc006010 tx=0x7f5bfc005960 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:30:15.955 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:15.923+0000 7f5c057fa700 1 -- 172.21.15.163:0/3585619619 <== mon.0 v2:172.21.15.163:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178025 (secure 0 0 0) 0x7f5bf8051780 con 0x7f5c08103010 2023-07-14T18:30:16.164 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:30:15 smithi184 ceph-mon[98481]: from='client.? 172.21.15.163:0/134496759' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-07-14T18:30:16.165 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:30:15 smithi184 ceph-mon[98481]: from='client.? 172.21.15.163:0/4138174450' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-07-14T18:30:16.201 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:16.171+0000 7f5c0e41c700 1 -- 172.21.15.163:0/3585619619 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f5c08061250 con 0x7f5c08103010 2023-07-14T18:30:16.201 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:16.172+0000 7f5c057fa700 1 -- 172.21.15.163:0/3585619619 <== mon.0 v2:172.21.15.163:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v88) v1 ==== 104+0+11 (secure 0 0 0) 0x7f5bf8096250 con 0x7f5c08103010 2023-07-14T18:30:16.202 INFO:teuthology.orchestra.run.smithi163.stdout:pg_num: 32 2023-07-14T18:30:16.204 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:16.174+0000 7f5c0e41c700 1 -- 172.21.15.163:0/3585619619 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f5bf00a1150 msgr2=0x7f5bf00a3600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:30:16.204 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:16.175+0000 7f5c0e41c700 1 --2- 172.21.15.163:0/3585619619 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f5bf00a1150 0x7f5bf00a3600 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f5bfc006010 tx=0x7f5bfc005960 comp rx=0 tx=0).stop 2023-07-14T18:30:16.205 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:16.175+0000 7f5c0e41c700 1 -- 172.21.15.163:0/3585619619 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f5c08103010 msgr2=0x7f5c08195da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:30:16.205 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:16.175+0000 7f5c0e41c700 1 --2- 172.21.15.163:0/3585619619 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f5c08103010 0x7f5c08195da0 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7f5bf800e9a0 tx=0x7f5bf800ecb0 comp rx=0 tx=0).stop 2023-07-14T18:30:16.205 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:16.175+0000 7f5c0e41c700 1 -- 172.21.15.163:0/3585619619 shutdown_connections 2023-07-14T18:30:16.205 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:16.175+0000 7f5c0e41c700 1 --2- 172.21.15.163:0/3585619619 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f5bf00a1150 0x7f5bf00a3600 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:30:16.205 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:16.175+0000 7f5c0e41c700 1 --2- 172.21.15.163:0/3585619619 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5c081006f0 0x7f5c08195860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:30:16.206 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:16.175+0000 7f5c0e41c700 1 --2- 172.21.15.163:0/3585619619 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5c08105930 0x7f5c0819ce10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:30:16.206 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:16.175+0000 7f5c0e41c700 1 --2- 172.21.15.163:0/3585619619 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f5c08103010 0x7f5c08195da0 unknown :-1 s=CLOSED pgs=769 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:30:16.206 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:16.175+0000 7f5c0e41c700 1 -- 172.21.15.163:0/3585619619 >> 172.21.15.163:0/3585619619 conn(0x7f5c080fa130 msgr2=0x7f5c08101350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:30:16.206 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:16.175+0000 7f5c0e41c700 1 -- 172.21.15.163:0/3585619619 shutdown_connections 2023-07-14T18:30:16.206 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:16.175+0000 7f5c0e41c700 1 -- 172.21.15.163:0/3585619619 wait complete. 2023-07-14T18:30:16.207 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:30:15 smithi163 ceph-mon[96576]: from='client.? 172.21.15.163:0/134496759' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-07-14T18:30:16.207 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:30:15 smithi163 ceph-mon[96576]: from='client.? 172.21.15.163:0/4138174450' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-07-14T18:30:16.218 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-14T18:30:16.265 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:30:15 smithi172 ceph-mon[97983]: from='client.? 172.21.15.163:0/134496759' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-07-14T18:30:16.265 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:30:15 smithi172 ceph-mon[97983]: from='client.? 172.21.15.163:0/4138174450' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-07-14T18:30:16.361 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:16.331+0000 7f4df57c9700 1 -- 172.21.15.163:0/2424314211 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f4df0100690 msgr2=0x7f4df0106f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:30:16.362 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:16.331+0000 7f4df57c9700 1 --2- 172.21.15.163:0/2424314211 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f4df0100690 0x7f4df0106f50 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7f4de800b0a0 tx=0x7f4de800b3b0 comp rx=0 tx=0).stop 2023-07-14T18:30:16.362 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:16.332+0000 7f4df57c9700 1 -- 172.21.15.163:0/2424314211 shutdown_connections 2023-07-14T18:30:16.362 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:16.332+0000 7f4df57c9700 1 --2- 172.21.15.163:0/2424314211 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f4df0100690 0x7f4df0106f50 unknown :-1 s=CLOSED pgs=770 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:30:16.363 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:16.332+0000 7f4df57c9700 1 --2- 172.21.15.163:0/2424314211 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4df00feb10 0x7f4df00fef20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:30:16.363 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:16.332+0000 7f4df57c9700 1 --2- 172.21.15.163:0/2424314211 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4df00ffd00 0x7f4df0100150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:30:16.363 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:16.332+0000 7f4df57c9700 1 -- 172.21.15.163:0/2424314211 >> 172.21.15.163:0/2424314211 conn(0x7f4df00fa130 msgr2=0x7f4df00fc560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:30:16.363 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:16.332+0000 7f4df57c9700 1 -- 172.21.15.163:0/2424314211 shutdown_connections 2023-07-14T18:30:16.363 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:16.332+0000 7f4df57c9700 1 -- 172.21.15.163:0/2424314211 wait complete. 2023-07-14T18:30:16.363 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:16.332+0000 7f4df57c9700 1 Processor -- start 2023-07-14T18:30:16.365 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:16.333+0000 7f4df57c9700 1 -- start start 2023-07-14T18:30:16.365 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:16.333+0000 7f4df57c9700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4df00feb10 0x7f4df0068370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:30:16.365 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:16.333+0000 7f4df57c9700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f4df00ffd00 0x7f4df019a690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:30:16.365 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:16.333+0000 7f4df57c9700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4df0100690 0x7f4df019cd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:30:16.366 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:16.333+0000 7f4df57c9700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4df019d4c0 con 0x7f4df00ffd00 2023-07-14T18:30:16.366 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:16.333+0000 7f4df57c9700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4df019d630 con 0x7f4df0100690 2023-07-14T18:30:16.366 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:16.333+0000 7f4df57c9700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4df019d7f0 con 0x7f4df00feb10 2023-07-14T18:30:16.366 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:16.333+0000 7f4dee7fc700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f4df00ffd00 0x7f4df019a690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:30:16.366 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:16.333+0000 7f4dee7fc700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f4df00ffd00 0x7f4df019a690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:60822/0 (socket says 172.21.15.163:60822) 2023-07-14T18:30:16.367 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:16.333+0000 7f4dee7fc700 1 -- 172.21.15.163:0/1988952660 learned_addr learned my addr 172.21.15.163:0/1988952660 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:30:16.367 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:16.333+0000 7f4deeffd700 1 --2- 172.21.15.163:0/1988952660 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4df00feb10 0x7f4df0068370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:30:16.367 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:16.333+0000 7f4def7fe700 1 --2- 172.21.15.163:0/1988952660 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4df0100690 0x7f4df019cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:30:16.367 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:16.333+0000 7f4dee7fc700 1 -- 172.21.15.163:0/1988952660 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4df00feb10 msgr2=0x7f4df0068370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:30:16.367 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:16.333+0000 7f4dee7fc700 1 --2- 172.21.15.163:0/1988952660 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4df00feb10 0x7f4df0068370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:30:16.368 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:16.333+0000 7f4dee7fc700 1 -- 172.21.15.163:0/1988952660 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4df0100690 msgr2=0x7f4df019cd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:30:16.368 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:16.333+0000 7f4dee7fc700 1 --2- 172.21.15.163:0/1988952660 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4df0100690 0x7f4df019cd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:30:16.368 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:16.333+0000 7f4dee7fc700 1 -- 172.21.15.163:0/1988952660 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4de8009d00 con 0x7f4df00ffd00 2023-07-14T18:30:16.368 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:16.333+0000 7f4def7fe700 1 --2- 172.21.15.163:0/1988952660 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4df0100690 0x7f4df019cd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T18:30:16.368 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:16.333+0000 7f4dee7fc700 1 --2- 172.21.15.163:0/1988952660 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f4df00ffd00 0x7f4df019a690 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7f4de400e9a0 tx=0x7f4de400ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:30:16.369 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:16.334+0000 7f4dd7fff700 1 -- 172.21.15.163:0/1988952660 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4de4009790 con 0x7f4df00ffd00 2023-07-14T18:30:16.369 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:16.334+0000 7f4dd7fff700 1 -- 172.21.15.163:0/1988952660 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f4de4010430 con 0x7f4df00ffd00 2023-07-14T18:30:16.369 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:16.334+0000 7f4df57c9700 1 -- 172.21.15.163:0/1988952660 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4df0194600 con 0x7f4df00ffd00 2023-07-14T18:30:16.369 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:16.334+0000 7f4dd7fff700 1 -- 172.21.15.163:0/1988952660 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4de400cea0 con 0x7f4df00ffd00 2023-07-14T18:30:16.369 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:16.334+0000 7f4df57c9700 1 -- 172.21.15.163:0/1988952660 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4df0194b10 con 0x7f4df00ffd00 2023-07-14T18:30:16.370 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:16.335+0000 7f4df57c9700 1 -- 172.21.15.163:0/1988952660 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4df01964d0 con 0x7f4df00ffd00 2023-07-14T18:30:16.370 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:16.336+0000 7f4dd7fff700 1 -- 172.21.15.163:0/1988952660 <== mon.0 v2:172.21.15.163:3300/0 4 ==== mgrmap(e 18) v1 ==== 135716+0+0 (secure 0 0 0) 0x7f4de40105a0 con 0x7f4df00ffd00 2023-07-14T18:30:16.371 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:16.337+0000 7f4dd7fff700 1 --2- 172.21.15.163:0/1988952660 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f4dd80a1150 0x7f4dd80a3600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:30:16.371 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:16.337+0000 7f4deeffd700 1 --2- 172.21.15.163:0/1988952660 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f4dd80a1150 0x7f4dd80a3600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:30:16.371 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:16.337+0000 7f4dd7fff700 1 -- 172.21.15.163:0/1988952660 <== mon.0 v2:172.21.15.163:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 9049+0+0 (secure 0 0 0) 0x7f4de4014070 con 0x7f4df00ffd00 2023-07-14T18:30:16.371 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:16.338+0000 7f4deeffd700 1 --2- 172.21.15.163:0/1988952660 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f4dd80a1150 0x7f4dd80a3600 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f4df00ffb60 tx=0x7f4de0009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:30:16.371 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:16.341+0000 7f4dd7fff700 1 -- 172.21.15.163:0/1988952660 <== mon.0 v2:172.21.15.163:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178025 (secure 0 0 0) 0x7f4de40962b0 con 0x7f4df00ffd00 2023-07-14T18:30:16.602 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:16.573+0000 7f4df57c9700 1 -- 172.21.15.163:0/1988952660 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f4df002cc20 con 0x7f4df00ffd00 2023-07-14T18:30:16.603 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:16.573+0000 7f4dd7fff700 1 -- 172.21.15.163:0/1988952660 <== mon.0 v2:172.21.15.163:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v88) v1 ==== 100+0+11 (secure 0 0 0) 0x7f4de40260a0 con 0x7f4df00ffd00 2023-07-14T18:30:16.603 INFO:teuthology.orchestra.run.smithi163.stdout:pg_num: 64 2023-07-14T18:30:16.605 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:16.576+0000 7f4df57c9700 1 -- 172.21.15.163:0/1988952660 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f4dd80a1150 msgr2=0x7f4dd80a3600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:30:16.605 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:16.576+0000 7f4df57c9700 1 --2- 172.21.15.163:0/1988952660 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f4dd80a1150 0x7f4dd80a3600 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f4df00ffb60 tx=0x7f4de0009260 comp rx=0 tx=0).stop 2023-07-14T18:30:16.605 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:16.576+0000 7f4df57c9700 1 -- 172.21.15.163:0/1988952660 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f4df00ffd00 msgr2=0x7f4df019a690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:30:16.606 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:16.576+0000 7f4df57c9700 1 --2- 172.21.15.163:0/1988952660 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f4df00ffd00 0x7f4df019a690 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7f4de400e9a0 tx=0x7f4de400ecb0 comp rx=0 tx=0).stop 2023-07-14T18:30:16.606 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:16.576+0000 7f4df57c9700 1 -- 172.21.15.163:0/1988952660 shutdown_connections 2023-07-14T18:30:16.606 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:16.576+0000 7f4df57c9700 1 --2- 172.21.15.163:0/1988952660 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f4dd80a1150 0x7f4dd80a3600 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:30:16.606 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:16.576+0000 7f4df57c9700 1 --2- 172.21.15.163:0/1988952660 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4df00feb10 0x7f4df0068370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:30:16.606 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:16.576+0000 7f4df57c9700 1 --2- 172.21.15.163:0/1988952660 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4df0100690 0x7f4df019cd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:30:16.607 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:16.576+0000 7f4df57c9700 1 --2- 172.21.15.163:0/1988952660 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f4df00ffd00 0x7f4df019a690 unknown :-1 s=CLOSED pgs=771 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:30:16.607 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:16.576+0000 7f4df57c9700 1 -- 172.21.15.163:0/1988952660 >> 172.21.15.163:0/1988952660 conn(0x7f4df00fa130 msgr2=0x7f4df0103240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:30:16.607 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:16.576+0000 7f4df57c9700 1 -- 172.21.15.163:0/1988952660 shutdown_connections 2023-07-14T18:30:16.607 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:16.576+0000 7f4df57c9700 1 -- 172.21.15.163:0/1988952660 wait complete. 2023-07-14T18:30:16.619 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-07-14T18:30:16.764 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:16.734+0000 7f7defb1d700 1 -- 172.21.15.163:0/924487713 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f7de80feb80 msgr2=0x7f7de80fef90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:30:16.764 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:16.734+0000 7f7defb1d700 1 --2- 172.21.15.163:0/924487713 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f7de80feb80 0x7f7de80fef90 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7f7de4009990 tx=0x7f7de4009ca0 comp rx=0 tx=0).stop 2023-07-14T18:30:16.764 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:16.734+0000 7f7defb1d700 1 -- 172.21.15.163:0/924487713 shutdown_connections 2023-07-14T18:30:16.765 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:16.734+0000 7f7defb1d700 1 --2- 172.21.15.163:0/924487713 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7de8100700 0x7f7de8106fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:30:16.765 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:16.734+0000 7f7defb1d700 1 --2- 172.21.15.163:0/924487713 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f7de80feb80 0x7f7de80fef90 unknown :-1 s=CLOSED pgs=772 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:30:16.765 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:16.734+0000 7f7defb1d700 1 --2- 172.21.15.163:0/924487713 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7de80ffd70 0x7f7de81001c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:30:16.765 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:16.734+0000 7f7defb1d700 1 -- 172.21.15.163:0/924487713 >> 172.21.15.163:0/924487713 conn(0x7f7de80fa1a0 msgr2=0x7f7de80fc5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:30:16.765 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:16.734+0000 7f7defb1d700 1 -- 172.21.15.163:0/924487713 shutdown_connections 2023-07-14T18:30:16.766 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:16.734+0000 7f7defb1d700 1 -- 172.21.15.163:0/924487713 wait complete. 2023-07-14T18:30:16.766 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:16.735+0000 7f7defb1d700 1 Processor -- start 2023-07-14T18:30:16.766 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:16.735+0000 7f7defb1d700 1 -- start start 2023-07-14T18:30:16.768 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:16.735+0000 7f7defb1d700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f7de80feb80 0x7f7de8102b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:30:16.768 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:16.735+0000 7f7defb1d700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7de80ffd70 0x7f7de8101150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:30:16.768 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:16.735+0000 7f7defb1d700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7de8100700 0x7f7de8101690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:30:16.769 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:16.735+0000 7f7defb1d700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7de8101e30 con 0x7f7de80feb80 2023-07-14T18:30:16.769 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:16.735+0000 7f7defb1d700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7de8101fa0 con 0x7f7de8100700 2023-07-14T18:30:16.769 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:16.735+0000 7f7defb1d700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7de819f8d0 con 0x7f7de80ffd70 2023-07-14T18:30:16.769 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:16.735+0000 7f7ded8b9700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f7de80feb80 0x7f7de8102b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:30:16.769 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:16.735+0000 7f7ded8b9700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f7de80feb80 0x7f7de8102b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:60834/0 (socket says 172.21.15.163:60834) 2023-07-14T18:30:16.769 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:16.735+0000 7f7ded8b9700 1 -- 172.21.15.163:0/3630667254 learned_addr learned my addr 172.21.15.163:0/3630667254 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:30:16.770 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:16.735+0000 7f7ded0b8700 1 --2- 172.21.15.163:0/3630667254 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7de80ffd70 0x7f7de8101150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:30:16.770 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:16.735+0000 7f7dee0ba700 1 --2- 172.21.15.163:0/3630667254 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7de8100700 0x7f7de8101690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:30:16.770 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:16.735+0000 7f7ded8b9700 1 -- 172.21.15.163:0/3630667254 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7de80ffd70 msgr2=0x7f7de8101150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:30:16.770 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:16.735+0000 7f7ded8b9700 1 --2- 172.21.15.163:0/3630667254 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7de80ffd70 0x7f7de8101150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:30:16.770 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:16.735+0000 7f7ded8b9700 1 -- 172.21.15.163:0/3630667254 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7de8100700 msgr2=0x7f7de8101690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:30:16.771 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:16.735+0000 7f7ded8b9700 1 --2- 172.21.15.163:0/3630667254 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7de8100700 0x7f7de8101690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:30:16.771 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:16.735+0000 7f7ded8b9700 1 -- 172.21.15.163:0/3630667254 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7de40095f0 con 0x7f7de80feb80 2023-07-14T18:30:16.771 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:16.735+0000 7f7ded0b8700 1 --2- 172.21.15.163:0/3630667254 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7de80ffd70 0x7f7de8101150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T18:30:16.771 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:16.735+0000 7f7ded8b9700 1 --2- 172.21.15.163:0/3630667254 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f7de80feb80 0x7f7de8102b10 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7f7de4000c00 tx=0x7f7de4004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:30:16.771 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:16.736+0000 7f7ddeffd700 1 -- 172.21.15.163:0/3630667254 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7de401d070 con 0x7f7de80feb80 2023-07-14T18:30:16.772 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:16.736+0000 7f7defb1d700 1 -- 172.21.15.163:0/3630667254 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7de819fb50 con 0x7f7de80feb80 2023-07-14T18:30:16.772 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:16.736+0000 7f7ddeffd700 1 -- 172.21.15.163:0/3630667254 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f7de400bd50 con 0x7f7de80feb80 2023-07-14T18:30:16.772 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:16.736+0000 7f7ddeffd700 1 -- 172.21.15.163:0/3630667254 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7de4022cd0 con 0x7f7de80feb80 2023-07-14T18:30:16.772 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:16.736+0000 7f7defb1d700 1 -- 172.21.15.163:0/3630667254 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7de819ff70 con 0x7f7de80feb80 2023-07-14T18:30:16.772 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:16.737+0000 7f7defb1d700 1 -- 172.21.15.163:0/3630667254 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7de810a190 con 0x7f7de80feb80 2023-07-14T18:30:16.773 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:16.738+0000 7f7ddeffd700 1 -- 172.21.15.163:0/3630667254 <== mon.0 v2:172.21.15.163:3300/0 4 ==== mgrmap(e 18) v1 ==== 135716+0+0 (secure 0 0 0) 0x7f7de4022470 con 0x7f7de80feb80 2023-07-14T18:30:16.773 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:16.739+0000 7f7ddeffd700 1 --2- 172.21.15.163:0/3630667254 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f7dd40a1150 0x7f7dd40a3600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:30:16.773 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:16.739+0000 7f7ded0b8700 1 --2- 172.21.15.163:0/3630667254 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f7dd40a1150 0x7f7dd40a3600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:30:16.774 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:16.739+0000 7f7ddeffd700 1 -- 172.21.15.163:0/3630667254 <== mon.0 v2:172.21.15.163:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 9049+0+0 (secure 0 0 0) 0x7f7de40ce530 con 0x7f7de80feb80 2023-07-14T18:30:16.774 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:16.739+0000 7f7ded0b8700 1 --2- 172.21.15.163:0/3630667254 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f7dd40a1150 0x7f7dd40a3600 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f7dd8011490 tx=0x7f7dd8009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:30:16.774 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:16.742+0000 7f7ddeffd700 1 -- 172.21.15.163:0/3630667254 <== mon.0 v2:172.21.15.163:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178025 (secure 0 0 0) 0x7f7de40979e0 con 0x7f7de80feb80 2023-07-14T18:30:16.956 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:30:16 smithi163 ceph-mon[96576]: pgmap v828: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-07-14T18:30:16.957 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:30:16 smithi163 ceph-mon[96576]: from='client.? 172.21.15.163:0/3585619619' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-07-14T18:30:16.957 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:30:16 smithi163 ceph-mon[96576]: from='client.? 172.21.15.163:0/1988952660' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-07-14T18:30:17.002 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:16.973+0000 7f7defb1d700 1 -- 172.21.15.163:0/3630667254 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f7de81a0580 con 0x7f7de80feb80 2023-07-14T18:30:17.003 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:16.973+0000 7f7ddeffd700 1 -- 172.21.15.163:0/3630667254 <== mon.0 v2:172.21.15.163:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v88) v1 ==== 103+0+11 (secure 0 0 0) 0x7f7de409b000 con 0x7f7de80feb80 2023-07-14T18:30:17.003 INFO:teuthology.orchestra.run.smithi163.stdout:pg_num: 32 2023-07-14T18:30:17.006 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:16.976+0000 7f7defb1d700 1 -- 172.21.15.163:0/3630667254 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f7dd40a1150 msgr2=0x7f7dd40a3600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:30:17.006 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:16.976+0000 7f7defb1d700 1 --2- 172.21.15.163:0/3630667254 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f7dd40a1150 0x7f7dd40a3600 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f7dd8011490 tx=0x7f7dd8009260 comp rx=0 tx=0).stop 2023-07-14T18:30:17.006 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:16.976+0000 7f7defb1d700 1 -- 172.21.15.163:0/3630667254 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f7de80feb80 msgr2=0x7f7de8102b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:30:17.006 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:16.976+0000 7f7defb1d700 1 --2- 172.21.15.163:0/3630667254 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f7de80feb80 0x7f7de8102b10 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7f7de4000c00 tx=0x7f7de4004730 comp rx=0 tx=0).stop 2023-07-14T18:30:17.007 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:16.976+0000 7f7defb1d700 1 -- 172.21.15.163:0/3630667254 shutdown_connections 2023-07-14T18:30:17.007 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:16.976+0000 7f7defb1d700 1 --2- 172.21.15.163:0/3630667254 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f7dd40a1150 0x7f7dd40a3600 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:30:17.007 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:16.976+0000 7f7defb1d700 1 --2- 172.21.15.163:0/3630667254 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7de8100700 0x7f7de8101690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:30:17.007 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:16.976+0000 7f7defb1d700 1 --2- 172.21.15.163:0/3630667254 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f7de80feb80 0x7f7de8102b10 unknown :-1 s=CLOSED pgs=773 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:30:17.007 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:16.976+0000 7f7defb1d700 1 --2- 172.21.15.163:0/3630667254 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7de80ffd70 0x7f7de8101150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:30:17.008 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:16.976+0000 7f7defb1d700 1 -- 172.21.15.163:0/3630667254 >> 172.21.15.163:0/3630667254 conn(0x7f7de80fa1a0 msgr2=0x7f7de8068990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:30:17.008 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:16.976+0000 7f7defb1d700 1 -- 172.21.15.163:0/3630667254 shutdown_connections 2023-07-14T18:30:17.008 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:16.977+0000 7f7defb1d700 1 -- 172.21.15.163:0/3630667254 wait complete. 2023-07-14T18:30:17.020 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-07-14T18:30:17.164 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:30:16 smithi184 ceph-mon[98481]: pgmap v828: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-07-14T18:30:17.164 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:30:16 smithi184 ceph-mon[98481]: from='client.? 172.21.15.163:0/3585619619' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-07-14T18:30:17.165 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:30:16 smithi184 ceph-mon[98481]: from='client.? 172.21.15.163:0/1988952660' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-07-14T18:30:17.176 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:17.146+0000 7fcefa12f700 1 -- 172.21.15.163:0/4035620504 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fcef4100e30 msgr2=0x7fcef4101280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:30:17.176 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:17.146+0000 7fcefa12f700 1 --2- 172.21.15.163:0/4035620504 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fcef4100e30 0x7fcef4101280 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7fcee8009990 tx=0x7fcee8009ca0 comp rx=0 tx=0).stop 2023-07-14T18:30:17.176 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:17.146+0000 7fcefa12f700 1 -- 172.21.15.163:0/4035620504 shutdown_connections 2023-07-14T18:30:17.176 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:17.146+0000 7fcefa12f700 1 --2- 172.21.15.163:0/4035620504 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcef41017c0 0x7fcef4108080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:30:17.177 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:17.146+0000 7fcefa12f700 1 --2- 172.21.15.163:0/4035620504 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcef40ffc40 0x7fcef4100050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:30:17.177 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:17.146+0000 7fcefa12f700 1 --2- 172.21.15.163:0/4035620504 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fcef4100e30 0x7fcef4101280 unknown :-1 s=CLOSED pgs=774 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:30:17.177 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:17.146+0000 7fcefa12f700 1 -- 172.21.15.163:0/4035620504 >> 172.21.15.163:0/4035620504 conn(0x7fcef40fb260 msgr2=0x7fcef40fd690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:30:17.177 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:17.146+0000 7fcefa12f700 1 -- 172.21.15.163:0/4035620504 shutdown_connections 2023-07-14T18:30:17.177 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:17.146+0000 7fcefa12f700 1 -- 172.21.15.163:0/4035620504 wait complete. 2023-07-14T18:30:17.179 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:17.147+0000 7fcefa12f700 1 Processor -- start 2023-07-14T18:30:17.179 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:17.147+0000 7fcefa12f700 1 -- start start 2023-07-14T18:30:17.180 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:17.147+0000 7fcefa12f700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fcef40ffc40 0x7fcef41958c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:30:17.180 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:17.147+0000 7fcefa12f700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcef4100e30 0x7fcef4195e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:30:17.180 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:17.147+0000 7fcefa12f700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcef41017c0 0x7fcef419ce70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:30:17.180 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:17.147+0000 7fcefa12f700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcef419d440 con 0x7fcef40ffc40 2023-07-14T18:30:17.180 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:17.147+0000 7fcefa12f700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcef419d580 con 0x7fcef41017c0 2023-07-14T18:30:17.181 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:17.147+0000 7fcefa12f700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcef419d710 con 0x7fcef4100e30 2023-07-14T18:30:17.181 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:17.147+0000 7fcef37fe700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fcef40ffc40 0x7fcef41958c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:30:17.181 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:17.147+0000 7fcef37fe700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fcef40ffc40 0x7fcef41958c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:60848/0 (socket says 172.21.15.163:60848) 2023-07-14T18:30:17.181 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:17.147+0000 7fcef37fe700 1 -- 172.21.15.163:0/2393453239 learned_addr learned my addr 172.21.15.163:0/2393453239 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:30:17.181 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:17.147+0000 7fcef3fff700 1 --2- 172.21.15.163:0/2393453239 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcef41017c0 0x7fcef419ce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:30:17.182 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:17.147+0000 7fcef2ffd700 1 --2- 172.21.15.163:0/2393453239 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcef4100e30 0x7fcef4195e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:30:17.182 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:17.148+0000 7fcef3fff700 1 -- 172.21.15.163:0/2393453239 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcef4100e30 msgr2=0x7fcef4195e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:30:17.182 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:17.148+0000 7fcef3fff700 1 --2- 172.21.15.163:0/2393453239 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcef4100e30 0x7fcef4195e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:30:17.182 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:17.148+0000 7fcef3fff700 1 -- 172.21.15.163:0/2393453239 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fcef40ffc40 msgr2=0x7fcef41958c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:30:17.182 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:17.148+0000 7fcef3fff700 1 --2- 172.21.15.163:0/2393453239 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fcef40ffc40 0x7fcef41958c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:30:17.183 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:17.148+0000 7fcef3fff700 1 -- 172.21.15.163:0/2393453239 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcee80095f0 con 0x7fcef41017c0 2023-07-14T18:30:17.183 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:17.148+0000 7fcef37fe700 1 --2- 172.21.15.163:0/2393453239 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fcef40ffc40 0x7fcef41958c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T18:30:17.183 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:17.148+0000 7fcef3fff700 1 --2- 172.21.15.163:0/2393453239 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcef41017c0 0x7fcef419ce70 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fceec00efc0 tx=0x7fceec00c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:30:17.183 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:17.148+0000 7fcef0ff9700 1 -- 172.21.15.163:0/2393453239 <== mon.2 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fceec018070 con 0x7fcef41017c0 2023-07-14T18:30:17.183 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:17.148+0000 7fcefa12f700 1 -- 172.21.15.163:0/2393453239 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcef419d990 con 0x7fcef41017c0 2023-07-14T18:30:17.183 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:17.148+0000 7fcef0ff9700 1 -- 172.21.15.163:0/2393453239 <== mon.2 v2:172.21.15.172:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fceec00f040 con 0x7fcef41017c0 2023-07-14T18:30:17.184 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:17.148+0000 7fcefa12f700 1 -- 172.21.15.163:0/2393453239 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcef419def0 con 0x7fcef41017c0 2023-07-14T18:30:17.184 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:17.148+0000 7fcef0ff9700 1 -- 172.21.15.163:0/2393453239 <== mon.2 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fceec00cba0 con 0x7fcef41017c0 2023-07-14T18:30:17.184 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:17.149+0000 7fcefa12f700 1 -- 172.21.15.163:0/2393453239 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcee0005320 con 0x7fcef41017c0 2023-07-14T18:30:17.185 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:17.151+0000 7fcef0ff9700 1 -- 172.21.15.163:0/2393453239 <== mon.2 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 18) v1 ==== 135716+0+0 (secure 0 0 0) 0x7fceec003a00 con 0x7fcef41017c0 2023-07-14T18:30:17.185 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:17.151+0000 7fcef0ff9700 1 --2- 172.21.15.163:0/2393453239 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7fcedc0a11d0 0x7fcedc0a3680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:30:17.185 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:17.151+0000 7fcef37fe700 1 --2- 172.21.15.163:0/2393453239 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7fcedc0a11d0 0x7fcedc0a3680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:30:17.185 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:17.151+0000 7fcef0ff9700 1 -- 172.21.15.163:0/2393453239 <== mon.2 v2:172.21.15.172:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 9049+0+0 (secure 0 0 0) 0x7fceec0cc680 con 0x7fcef41017c0 2023-07-14T18:30:17.186 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:17.152+0000 7fcef37fe700 1 --2- 172.21.15.163:0/2393453239 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7fcedc0a11d0 0x7fcedc0a3680 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7fcee4005950 tx=0x7fcee4009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:30:17.186 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:17.157+0000 7fcef0ff9700 1 -- 172.21.15.163:0/2393453239 <== mon.2 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178025 (secure 0 0 0) 0x7fceec095b30 con 0x7fcef41017c0 2023-07-14T18:30:17.265 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:30:16 smithi172 ceph-mon[97983]: pgmap v828: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-07-14T18:30:17.265 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:30:16 smithi172 ceph-mon[97983]: from='client.? 172.21.15.163:0/3585619619' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-07-14T18:30:17.266 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:30:16 smithi172 ceph-mon[97983]: from='client.? 172.21.15.163:0/1988952660' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-07-14T18:30:17.445 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:17.416+0000 7fcefa12f700 1 -- 172.21.15.163:0/2393453239 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fcee0005cc0 con 0x7fcef41017c0 2023-07-14T18:30:17.446 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:17.416+0000 7fcef0ff9700 1 -- 172.21.15.163:0/2393453239 <== mon.2 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 10 entries v88) v1 ==== 81+0+600 (secure 0 0 0) 0x7fceec003cb0 con 0x7fcef41017c0 2023-07-14T18:30:17.446 INFO:teuthology.orchestra.run.smithi163.stdout:172.21.15.163:6801/1086512093 2023-07-15T18:05:15.331458+0000 2023-07-14T18:30:17.446 INFO:teuthology.orchestra.run.smithi163.stdout:172.21.15.163:6800/1086512093 2023-07-15T18:05:15.331458+0000 2023-07-14T18:30:17.447 INFO:teuthology.orchestra.run.smithi163.stdout:172.21.15.163:0/4235784810 2023-07-15T18:05:15.331458+0000 2023-07-14T18:30:17.447 INFO:teuthology.orchestra.run.smithi163.stdout:172.21.15.163:6800/236891232 2023-07-15T18:04:53.288443+0000 2023-07-14T18:30:17.447 INFO:teuthology.orchestra.run.smithi163.stdout:172.21.15.163:6801/236891232 2023-07-15T18:04:53.288443+0000 2023-07-14T18:30:17.447 INFO:teuthology.orchestra.run.smithi163.stdout:172.21.15.163:0/3260193612 2023-07-15T18:05:15.331458+0000 2023-07-14T18:30:17.447 INFO:teuthology.orchestra.run.smithi163.stdout:172.21.15.163:0/3513629472 2023-07-15T18:04:53.288443+0000 2023-07-14T18:30:17.448 INFO:teuthology.orchestra.run.smithi163.stdout:172.21.15.163:0/1090329830 2023-07-15T18:04:53.288443+0000 2023-07-14T18:30:17.448 INFO:teuthology.orchestra.run.smithi163.stdout:172.21.15.163:0/3868922045 2023-07-15T18:05:15.331458+0000 2023-07-14T18:30:17.448 INFO:teuthology.orchestra.run.smithi163.stdout:172.21.15.163:0/2945662447 2023-07-15T18:04:53.288443+0000 2023-07-14T18:30:17.449 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:17.419+0000 7fcefa12f700 1 -- 172.21.15.163:0/2393453239 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7fcedc0a11d0 msgr2=0x7fcedc0a3680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:30:17.449 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:17.419+0000 7fcefa12f700 1 --2- 172.21.15.163:0/2393453239 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7fcedc0a11d0 0x7fcedc0a3680 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7fcee4005950 tx=0x7fcee4009260 comp rx=0 tx=0).stop 2023-07-14T18:30:17.449 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:17.419+0000 7fcefa12f700 1 -- 172.21.15.163:0/2393453239 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcef41017c0 msgr2=0x7fcef419ce70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:30:17.450 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:17.419+0000 7fcefa12f700 1 --2- 172.21.15.163:0/2393453239 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcef41017c0 0x7fcef419ce70 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fceec00efc0 tx=0x7fceec00c3a0 comp rx=0 tx=0).stop 2023-07-14T18:30:17.450 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:17.419+0000 7fcefa12f700 1 -- 172.21.15.163:0/2393453239 shutdown_connections 2023-07-14T18:30:17.450 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:17.419+0000 7fcefa12f700 1 --2- 172.21.15.163:0/2393453239 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7fcedc0a11d0 0x7fcedc0a3680 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:30:17.450 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:17.419+0000 7fcefa12f700 1 --2- 172.21.15.163:0/2393453239 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcef41017c0 0x7fcef419ce70 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:30:17.450 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:17.419+0000 7fcefa12f700 1 --2- 172.21.15.163:0/2393453239 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fcef40ffc40 0x7fcef41958c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:30:17.451 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:17.419+0000 7fcefa12f700 1 --2- 172.21.15.163:0/2393453239 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcef4100e30 0x7fcef4195e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:30:17.451 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:17.419+0000 7fcefa12f700 1 -- 172.21.15.163:0/2393453239 >> 172.21.15.163:0/2393453239 conn(0x7fcef40fb260 msgr2=0x7fcef40fd4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:30:17.451 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:17.420+0000 7fcefa12f700 1 -- 172.21.15.163:0/2393453239 shutdown_connections 2023-07-14T18:30:17.451 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:17.420+0000 7fcefa12f700 1 -- 172.21.15.163:0/2393453239 wait complete. 2023-07-14T18:30:17.452 INFO:teuthology.orchestra.run.smithi163.stderr:listed 10 entries 2023-07-14T18:30:17.463 DEBUG:teuthology.orchestra.run.smithi163:> set -ex 2023-07-14T18:30:17.463 DEBUG:teuthology.orchestra.run.smithi163:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-14T18:30:17.482 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-14T18:30:17.662 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:17.633+0000 7fec6552c700 1 -- 172.21.15.163:0/3121473180 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fec600feb00 msgr2=0x7fec600fef10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:30:17.663 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:17.633+0000 7fec6552c700 1 --2- 172.21.15.163:0/3121473180 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fec600feb00 0x7fec600fef10 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fec500098f0 tx=0x7fec50009c00 comp rx=0 tx=0).stop 2023-07-14T18:30:17.663 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:17.633+0000 7fec6552c700 1 -- 172.21.15.163:0/3121473180 shutdown_connections 2023-07-14T18:30:17.663 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:17.633+0000 7fec6552c700 1 --2- 172.21.15.163:0/3121473180 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fec600feb00 0x7fec600fef10 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:30:17.664 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:17.633+0000 7fec6552c700 1 --2- 172.21.15.163:0/3121473180 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fec60100680 0x7fec60106f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:30:17.664 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:17.633+0000 7fec6552c700 1 --2- 172.21.15.163:0/3121473180 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fec600ffcf0 0x7fec60100140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:30:17.664 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:17.633+0000 7fec6552c700 1 -- 172.21.15.163:0/3121473180 >> 172.21.15.163:0/3121473180 conn(0x7fec600fa100 msgr2=0x7fec600fc550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:30:17.664 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:17.633+0000 7fec6552c700 1 -- 172.21.15.163:0/3121473180 shutdown_connections 2023-07-14T18:30:17.664 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:17.633+0000 7fec6552c700 1 -- 172.21.15.163:0/3121473180 wait complete. 2023-07-14T18:30:17.666 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:17.634+0000 7fec6552c700 1 Processor -- start 2023-07-14T18:30:17.666 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:17.634+0000 7fec6552c700 1 -- start start 2023-07-14T18:30:17.667 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:17.634+0000 7fec6552c700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fec600feb00 0x7fec60195820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:30:17.667 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:17.634+0000 7fec6552c700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fec600ffcf0 0x7fec60195d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:30:17.667 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:17.634+0000 7fec6552c700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fec60100680 0x7fec6019cdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:30:17.667 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:17.634+0000 7fec6552c700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec6019d3a0 con 0x7fec600ffcf0 2023-07-14T18:30:17.667 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:17.634+0000 7fec6552c700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec6019d4e0 con 0x7fec600feb00 2023-07-14T18:30:17.668 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:17.634+0000 7fec6552c700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec6019d670 con 0x7fec60100680 2023-07-14T18:30:17.668 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:17.634+0000 7fec5e7fc700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fec600ffcf0 0x7fec60195d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:30:17.668 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:17.634+0000 7fec5e7fc700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fec600ffcf0 0x7fec60195d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:60864/0 (socket says 172.21.15.163:60864) 2023-07-14T18:30:17.668 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:17.634+0000 7fec5effd700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fec600feb00 0x7fec60195820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:30:17.668 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:17.634+0000 7fec5e7fc700 1 -- 172.21.15.163:0/828594335 learned_addr learned my addr 172.21.15.163:0/828594335 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:30:17.669 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:17.634+0000 7fec5f7fe700 1 --2- 172.21.15.163:0/828594335 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fec60100680 0x7fec6019cdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:30:17.669 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:17.634+0000 7fec5e7fc700 1 -- 172.21.15.163:0/828594335 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fec60100680 msgr2=0x7fec6019cdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:30:17.669 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:17.634+0000 7fec5e7fc700 1 --2- 172.21.15.163:0/828594335 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fec60100680 0x7fec6019cdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:30:17.669 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:17.634+0000 7fec5e7fc700 1 -- 172.21.15.163:0/828594335 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fec600feb00 msgr2=0x7fec60195820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:30:17.669 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:17.634+0000 7fec5e7fc700 1 --2- 172.21.15.163:0/828594335 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fec600feb00 0x7fec60195820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:30:17.670 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:17.634+0000 7fec5e7fc700 1 -- 172.21.15.163:0/828594335 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec540095f0 con 0x7fec600ffcf0 2023-07-14T18:30:17.670 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:17.634+0000 7fec5effd700 1 --2- 172.21.15.163:0/828594335 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fec600feb00 0x7fec60195820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T18:30:17.670 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:17.635+0000 7fec5e7fc700 1 --2- 172.21.15.163:0/828594335 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fec600ffcf0 0x7fec60195d60 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7fec5400ec10 tx=0x7fec5400ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:30:17.670 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:17.635+0000 7fec47fff700 1 -- 172.21.15.163:0/828594335 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec5400cc90 con 0x7fec600ffcf0 2023-07-14T18:30:17.670 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:17.635+0000 7fec47fff700 1 -- 172.21.15.163:0/828594335 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fec5400cdf0 con 0x7fec600ffcf0 2023-07-14T18:30:17.671 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:17.635+0000 7fec6552c700 1 -- 172.21.15.163:0/828594335 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fec50009520 con 0x7fec600ffcf0 2023-07-14T18:30:17.671 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:17.635+0000 7fec47fff700 1 -- 172.21.15.163:0/828594335 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec54003e80 con 0x7fec600ffcf0 2023-07-14T18:30:17.671 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:17.635+0000 7fec6552c700 1 -- 172.21.15.163:0/828594335 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec6019dcd0 con 0x7fec600ffcf0 2023-07-14T18:30:17.671 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:17.636+0000 7fec6552c700 1 -- 172.21.15.163:0/828594335 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fec6010b290 con 0x7fec600ffcf0 2023-07-14T18:30:17.672 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:17.637+0000 7fec47fff700 1 -- 172.21.15.163:0/828594335 <== mon.0 v2:172.21.15.163:3300/0 4 ==== mgrmap(e 18) v1 ==== 135716+0+0 (secure 0 0 0) 0x7fec54004000 con 0x7fec600ffcf0 2023-07-14T18:30:17.672 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:17.638+0000 7fec47fff700 1 --2- 172.21.15.163:0/828594335 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7fec480a11a0 0x7fec480a3650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:30:17.672 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:17.638+0000 7fec5effd700 1 --2- 172.21.15.163:0/828594335 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7fec480a11a0 0x7fec480a3650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:30:17.673 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:17.638+0000 7fec47fff700 1 -- 172.21.15.163:0/828594335 <== mon.0 v2:172.21.15.163:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 9049+0+0 (secure 0 0 0) 0x7fec54014070 con 0x7fec600ffcf0 2023-07-14T18:30:17.673 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:17.638+0000 7fec5effd700 1 --2- 172.21.15.163:0/828594335 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7fec480a11a0 0x7fec480a3650 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7fec500098c0 tx=0x7fec50019040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:30:17.673 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:17.642+0000 7fec47fff700 1 -- 172.21.15.163:0/828594335 <== mon.0 v2:172.21.15.163:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178025 (secure 0 0 0) 0x7fec54096470 con 0x7fec600ffcf0 2023-07-14T18:30:17.938 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:17.909+0000 7fec6552c700 1 -- 172.21.15.163:0/828594335 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fec6019e370 con 0x7fec600ffcf0 2023-07-14T18:30:17.940 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:17.910+0000 7fec47fff700 1 -- 172.21.15.163:0/828594335 <== mon.0 v2:172.21.15.163:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v88) v1 ==== 74+0+24603 (secure 0 0 0) 0x7fec54099a90 con 0x7fec600ffcf0 2023-07-14T18:30:17.940 INFO:teuthology.orchestra.run.smithi163.stdout: 2023-07-14T18:30:17.941 INFO:teuthology.orchestra.run.smithi163.stdout:{"epoch":88,"fsid":"bf7326ec-2270-11ee-9b33-001a4aab830c","created":"2023-07-14T18:04:26.263517+0000","modified":"2023-07-14T18:13:17.791075+0000","last_up_change":"2023-07-14T18:10:27.514863+0000","last_in_change":"2023-07-14T18:10:10.726443+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-14T18:07:19.653852+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-07-14T18:11:07.314989+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-07-14T18:11:08.274627+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-07-14T18:11:11.991162+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"e6490568-046d-43ef-bb07-d79fb884b276","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6802","nonce":3124653025},{"type":"v1","addr":"172.21.15.163:6803","nonce":3124653025}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6804","nonce":3124653025},{"type":"v1","addr":"172.21.15.163:6805","nonce":3124653025}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6808","nonce":3124653025},{"type":"v1","addr":"172.21.15.163:6809","nonce":3124653025}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6806","nonce":3124653025},{"type":"v1","addr":"172.21.15.163:6807","nonce":3124653025}]},"public_addr":"172.21.15.163:6803/3124653025","cluster_addr":"172.21.15.163:6805/3124653025","heartbeat_back_addr":"172.21.15.163:6809/3124653025","heartbeat_front_addr":"172.21.15.163:6807/3124653025","state":["exists","up"]},{"osd":1,"uuid":"0af39bda-f096-4603-adcc-bf1988f36603","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":3774455900},{"type":"v1","addr":"172.21.15.172:6801","nonce":3774455900}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":3774455900},{"type":"v1","addr":"172.21.15.172:6803","nonce":3774455900}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":3774455900},{"type":"v1","addr":"172.21.15.172:6807","nonce":3774455900}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":3774455900},{"type":"v1","addr":"172.21.15.172:6805","nonce":3774455900}]},"public_addr":"172.21.15.172:6801/3774455900","cluster_addr":"172.21.15.172:6803/3774455900","heartbeat_back_addr":"172.21.15.172:6807/3774455900","heartbeat_front_addr":"172.21.15.172:6805/3774455900","state":["exists","up"]},{"osd":2,"uuid":"cc732c13-af0f-4199-98e6-fe960ed4e5dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":1976927678},{"type":"v1","addr":"172.21.15.184:6801","nonce":1976927678}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":1976927678},{"type":"v1","addr":"172.21.15.184:6803","nonce":1976927678}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":1976927678},{"type":"v1","addr":"172.21.15.184:6807","nonce":1976927678}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":1976927678},{"type":"v1","addr":"172.21.15.184:6805","nonce":1976927678}]},"public_addr":"172.21.15.184:6801/1976927678","cluster_addr":"172.21.15.184:6803/1976927678","heartbeat_back_addr":"172.21.15.184:6807/1976927678","heartbeat_front_addr":"172.21.15.184:6805/1976927678","state":["exists","up"]},{"osd":3,"uuid":"dcee9576-0bc6-4ab0-8f63-79eacd0eca5f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6810","nonce":2589130694},{"type":"v1","addr":"172.21.15.163:6811","nonce":2589130694}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6812","nonce":2589130694},{"type":"v1","addr":"172.21.15.163:6813","nonce":2589130694}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6816","nonce":2589130694},{"type":"v1","addr":"172.21.15.163:6817","nonce":2589130694}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6814","nonce":2589130694},{"type":"v1","addr":"172.21.15.163:6815","nonce":2589130694}]},"public_addr":"172.21.15.163:6811/2589130694","cluster_addr":"172.21.15.163:6813/2589130694","heartbeat_back_addr":"172.21.15.163:6817/2589130694","heartbeat_front_addr":"172.21.15.163:6815/2589130694","state":["exists","up"]},{"osd":4,"uuid":"055df823-b8b0-426a-83c2-f0d727932ad8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":3319632614},{"type":"v1","addr":"172.21.15.172:6809","nonce":3319632614}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6810","nonce":3319632614},{"type":"v1","addr":"172.21.15.172:6811","nonce":3319632614}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6814","nonce":3319632614},{"type":"v1","addr":"172.21.15.172:6815","nonce":3319632614}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":3319632614},{"type":"v1","addr":"172.21.15.172:6813","nonce":3319632614}]},"public_addr":"172.21.15.172:6809/3319632614","cluster_addr":"172.21.15.172:6811/3319632614","heartbeat_back_addr":"172.21.15.172:6815/3319632614","heartbeat_front_addr":"172.21.15.172:6813/3319632614","state":["exists","up"]},{"osd":5,"uuid":"ef5ef02a-b4e2-4790-9d27-f6d2247b25c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":2662084043},{"type":"v1","addr":"172.21.15.184:6809","nonce":2662084043}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6810","nonce":2662084043},{"type":"v1","addr":"172.21.15.184:6811","nonce":2662084043}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6814","nonce":2662084043},{"type":"v1","addr":"172.21.15.184:6815","nonce":2662084043}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6812","nonce":2662084043},{"type":"v1","addr":"172.21.15.184:6813","nonce":2662084043}]},"public_addr":"172.21.15.184:6809/2662084043","cluster_addr":"172.21.15.184:6811/2662084043","heartbeat_back_addr":"172.21.15.184:6815/2662084043","heartbeat_front_addr":"172.21.15.184:6813/2662084043","state":["exists","up"]},{"osd":6,"uuid":"dba754be-0fc5-4867-a6d5-cf97eb344f81","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":44,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6818","nonce":2530874117},{"type":"v1","addr":"172.21.15.163:6819","nonce":2530874117}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6820","nonce":2530874117},{"type":"v1","addr":"172.21.15.163:6821","nonce":2530874117}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6824","nonce":2530874117},{"type":"v1","addr":"172.21.15.163:6825","nonce":2530874117}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6822","nonce":2530874117},{"type":"v1","addr":"172.21.15.163:6823","nonce":2530874117}]},"public_addr":"172.21.15.163:6819/2530874117","cluster_addr":"172.21.15.163:6821/2530874117","heartbeat_back_addr":"172.21.15.163:6825/2530874117","heartbeat_front_addr":"172.21.15.163:6823/2530874117","state":["exists","up"]},{"osd":7,"uuid":"edd76e6b-6077-4619-b00d-1e906f70ddcc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":49,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":233511803},{"type":"v1","addr":"172.21.15.172:6817","nonce":233511803}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6818","nonce":233511803},{"type":"v1","addr":"172.21.15.172:6819","nonce":233511803}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":233511803},{"type":"v1","addr":"172.21.15.172:6823","nonce":233511803}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6820","nonce":233511803},{"type":"v1","addr":"172.21.15.172:6821","nonce":233511803}]},"public_addr":"172.21.15.172:6817/233511803","cluster_addr":"172.21.15.172:6819/233511803","heartbeat_back_addr":"172.21.15.172:6823/233511803","heartbeat_front_addr":"172.21.15.172:6821/233511803","state":["exists","up"]},{"osd":8,"uuid":"36559400-f33e-44e6-868a-316d34da457d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":56,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6816","nonce":290154343},{"type":"v1","addr":"172.21.15.184:6817","nonce":290154343}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6818","nonce":290154343},{"type":"v1","addr":"172.21.15.184:6819","nonce":290154343}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6822","nonce":290154343},{"type":"v1","addr":"172.21.15.184:6823","nonce":290154343}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6820","nonce":290154343},{"type":"v1","addr":"172.21.15.184:6821","nonce":290154343}]},"public_addr":"172.21.15.184:6817/290154343","cluster_addr":"172.21.15.184:6819/290154343","heartbeat_back_addr":"172.21.15.184:6823/290154343","heartbeat_front_addr":"172.21.15.184:6821/290154343","state":["exists","up"]},{"osd":9,"uuid":"d484f111-f36c-4c67-9a8a-ae03e7e0d137","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6826","nonce":3848110906},{"type":"v1","addr":"172.21.15.163:6827","nonce":3848110906}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6828","nonce":3848110906},{"type":"v1","addr":"172.21.15.163:6829","nonce":3848110906}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6832","nonce":3848110906},{"type":"v1","addr":"172.21.15.163:6833","nonce":3848110906}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6830","nonce":3848110906},{"type":"v1","addr":"172.21.15.163:6831","nonce":3848110906}]},"public_addr":"172.21.15.163:6827/3848110906","cluster_addr":"172.21.15.163:6829/3848110906","heartbeat_back_addr":"172.21.15.163:6833/3848110906","heartbeat_front_addr":"172.21.15.163:6831/3848110906","state":["exists","up"]},{"osd":10,"uuid":"d943f7c0-da3d-4605-9e23-0231e675c6be","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6824","nonce":3281085356},{"type":"v1","addr":"172.21.15.172:6825","nonce":3281085356}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":3281085356},{"type":"v1","addr":"172.21.15.172:6827","nonce":3281085356}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":3281085356},{"type":"v1","addr":"172.21.15.172:6831","nonce":3281085356}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6828","nonce":3281085356},{"type":"v1","addr":"172.21.15.172:6829","nonce":3281085356}]},"public_addr":"172.21.15.172:6825/3281085356","cluster_addr":"172.21.15.172:6827/3281085356","heartbeat_back_addr":"172.21.15.172:6831/3281085356","heartbeat_front_addr":"172.21.15.172:6829/3281085356","state":["exists","up"]},{"osd":11,"uuid":"09e610a8-408a-4119-a21b-c4de2810a538","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":75,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6824","nonce":3614578747},{"type":"v1","addr":"172.21.15.184:6825","nonce":3614578747}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6826","nonce":3614578747},{"type":"v1","addr":"172.21.15.184:6827","nonce":3614578747}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6830","nonce":3614578747},{"type":"v1","addr":"172.21.15.184:6831","nonce":3614578747}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6828","nonce":3614578747},{"type":"v1","addr":"172.21.15.184:6829","nonce":3614578747}]},"public_addr":"172.21.15.184:6825/3614578747","cluster_addr":"172.21.15.184:6827/3614578747","heartbeat_back_addr":"172.21.15.184:6831/3614578747","heartbeat_front_addr":"172.21.15.184:6829/3614578747","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T18:06:36.067578+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T18:06:57.095120+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T18:07:17.825363+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T18:07:38.977196+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T18:08:00.108709+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T18:08:20.700646+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T18:08:41.473899+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T18:09:02.856536+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T18:09:23.832722+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T18:09:44.860884+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T18:10:05.520678+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-14T18:10:26.426315+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.8","mappings":[{"from":2,"to":11}]},{"pgid":"2.b","mappings":[{"from":8,"to":11}]},{"pgid":"3.1","mappings":[{"from":4,"to":9}]},{"pgid":"3.6","mappings":[{"from":4,"to":6}]},{"pgid":"3.25","mappings":[{"from":5,"to":9}]},{"pgid":"3.27","mappings":[{"from":4,"to":8}]},{"pgid":"3.2d","mappings":[{"from":3,"to":9}]},{"pgid":"4.a","mappings":[{"from":5,"to":8}]},{"pgid":"4.12","mappings":[{"from":9,"to":10}]},{"pgid":"4.14","mappings":[{"from":9,"to":8}]},{"pgid":"4.17","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.163:6801/1086512093":"2023-07-15T18:05:15.331458+0000","172.21.15.163:6800/1086512093":"2023-07-15T18:05:15.331458+0000","172.21.15.163:0/4235784810":"2023-07-15T18:05:15.331458+0000","172.21.15.163:6800/236891232":"2023-07-15T18:04:53.288443+0000","172.21.15.163:6801/236891232":"2023-07-15T18:04:53.288443+0000","172.21.15.163:0/3260193612":"2023-07-15T18:05:15.331458+0000","172.21.15.163:0/3513629472":"2023-07-15T18:04:53.288443+0000","172.21.15.163:0/1090329830":"2023-07-15T18:04:53.288443+0000","172.21.15.163:0/3868922045":"2023-07-15T18:05:15.331458+0000","172.21.15.163:0/2945662447":"2023-07-15T18:04:53.288443+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-14T18:30:17.942 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:17.913+0000 7fec6552c700 1 -- 172.21.15.163:0/828594335 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7fec480a11a0 msgr2=0x7fec480a3650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:30:17.942 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:17.913+0000 7fec6552c700 1 --2- 172.21.15.163:0/828594335 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7fec480a11a0 0x7fec480a3650 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7fec500098c0 tx=0x7fec50019040 comp rx=0 tx=0).stop 2023-07-14T18:30:17.943 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:17.913+0000 7fec6552c700 1 -- 172.21.15.163:0/828594335 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fec600ffcf0 msgr2=0x7fec60195d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:30:17.943 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:17.913+0000 7fec6552c700 1 --2- 172.21.15.163:0/828594335 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fec600ffcf0 0x7fec60195d60 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7fec5400ec10 tx=0x7fec5400ef20 comp rx=0 tx=0).stop 2023-07-14T18:30:17.943 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:17.913+0000 7fec6552c700 1 -- 172.21.15.163:0/828594335 shutdown_connections 2023-07-14T18:30:17.943 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:17.913+0000 7fec6552c700 1 --2- 172.21.15.163:0/828594335 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7fec480a11a0 0x7fec480a3650 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:30:17.944 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:17.913+0000 7fec6552c700 1 --2- 172.21.15.163:0/828594335 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fec60100680 0x7fec6019cdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:30:17.944 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:17.913+0000 7fec6552c700 1 --2- 172.21.15.163:0/828594335 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fec600feb00 0x7fec60195820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:30:17.944 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:17.913+0000 7fec6552c700 1 --2- 172.21.15.163:0/828594335 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7fec600ffcf0 0x7fec60195d60 unknown :-1 s=CLOSED pgs=775 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:30:17.944 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:17.913+0000 7fec6552c700 1 -- 172.21.15.163:0/828594335 >> 172.21.15.163:0/828594335 conn(0x7fec600fa100 msgr2=0x7fec600fc430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:30:17.944 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:17.913+0000 7fec6552c700 1 -- 172.21.15.163:0/828594335 shutdown_connections 2023-07-14T18:30:17.945 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:17.913+0000 7fec6552c700 1 -- 172.21.15.163:0/828594335 wait complete. 2023-07-14T18:30:17.956 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-14T18:07:19.653852+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-14T18:11:07.314989+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '79', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-07-14T18:11:08.274627+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '80', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-07-14T18:11:11.991162+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '84', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-07-14T18:30:17.957 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-14T18:30:18.101 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:18.072+0000 7f8007108700 1 -- 172.21.15.163:0/922366610 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f80000fed40 msgr2=0x7f80000ff1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:30:18.102 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:18.072+0000 7f8007108700 1 --2- 172.21.15.163:0/922366610 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f80000fed40 0x7f80000ff1b0 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7f7fec009990 tx=0x7f7fec009ca0 comp rx=0 tx=0).stop 2023-07-14T18:30:18.102 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:18.072+0000 7f8007108700 1 -- 172.21.15.163:0/922366610 shutdown_connections 2023-07-14T18:30:18.102 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:18.072+0000 7f8007108700 1 --2- 172.21.15.163:0/922366610 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f80000ff6f0 0x7f8000106fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:30:18.103 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:18.072+0000 7f8007108700 1 --2- 172.21.15.163:0/922366610 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8000100180 0x7f8000100590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:30:18.103 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:18.072+0000 7f8007108700 1 --2- 172.21.15.163:0/922366610 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f80000fed40 0x7f80000ff1b0 unknown :-1 s=CLOSED pgs=776 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:30:18.103 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:18.072+0000 7f8007108700 1 -- 172.21.15.163:0/922366610 >> 172.21.15.163:0/922366610 conn(0x7f80000f98a0 msgr2=0x7f80000fbcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:30:18.103 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:18.072+0000 7f8007108700 1 -- 172.21.15.163:0/922366610 shutdown_connections 2023-07-14T18:30:18.103 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:18.072+0000 7f8007108700 1 -- 172.21.15.163:0/922366610 wait complete. 2023-07-14T18:30:18.105 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:18.073+0000 7f8007108700 1 Processor -- start 2023-07-14T18:30:18.105 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:18.073+0000 7f8007108700 1 -- start start 2023-07-14T18:30:18.106 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:18.073+0000 7f8007108700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f80000fed40 0x7f80000fe7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:30:18.106 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:18.073+0000 7f8007108700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f80000ff6f0 0x7f800019a5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:30:18.106 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:18.073+0000 7f8007108700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8000100180 0x7f800019cbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:30:18.106 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:18.073+0000 7f8007108700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f800019d3c0 con 0x7f80000fed40 2023-07-14T18:30:18.106 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:18.073+0000 7f8007108700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f800019d530 con 0x7f8000100180 2023-07-14T18:30:18.106 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:18.073+0000 7f8007108700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f800019d6f0 con 0x7f80000ff6f0 2023-07-14T18:30:18.107 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:18.073+0000 7f8004ea4700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f80000fed40 0x7f80000fe7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:30:18.107 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:18.073+0000 7f8004ea4700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f80000fed40 0x7f80000fe7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.163:3300/0 says I am v2:172.21.15.163:60876/0 (socket says 172.21.15.163:60876) 2023-07-14T18:30:18.107 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:18.073+0000 7f8004ea4700 1 -- 172.21.15.163:0/1616977762 learned_addr learned my addr 172.21.15.163:0/1616977762 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:30:18.107 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:18.073+0000 7f7ffffff700 1 --2- 172.21.15.163:0/1616977762 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f80000ff6f0 0x7f800019a5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:30:18.108 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:18.073+0000 7f80056a5700 1 --2- 172.21.15.163:0/1616977762 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8000100180 0x7f800019cbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:30:18.108 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:18.073+0000 7f8004ea4700 1 -- 172.21.15.163:0/1616977762 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f80000ff6f0 msgr2=0x7f800019a5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:30:18.108 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:18.073+0000 7f8004ea4700 1 --2- 172.21.15.163:0/1616977762 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f80000ff6f0 0x7f800019a5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:30:18.108 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:18.073+0000 7f8004ea4700 1 -- 172.21.15.163:0/1616977762 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8000100180 msgr2=0x7f800019cbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:30:18.108 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:18.073+0000 7f8004ea4700 1 --2- 172.21.15.163:0/1616977762 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8000100180 0x7f800019cbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:30:18.109 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:18.073+0000 7f8004ea4700 1 -- 172.21.15.163:0/1616977762 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ff4009520 con 0x7f80000fed40 2023-07-14T18:30:18.109 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:18.074+0000 7f8004ea4700 1 --2- 172.21.15.163:0/1616977762 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f80000fed40 0x7f80000fe7c0 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7f7ff400eb30 tx=0x7f7ff400ee40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:30:18.109 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:18.074+0000 7f7ffdffb700 1 -- 172.21.15.163:0/1616977762 <== mon.0 v2:172.21.15.163:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ff4009880 con 0x7f80000fed40 2023-07-14T18:30:18.109 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:18.074+0000 7f8007108700 1 -- 172.21.15.163:0/1616977762 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7fec0095f0 con 0x7f80000fed40 2023-07-14T18:30:18.109 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:18.074+0000 7f7ffdffb700 1 -- 172.21.15.163:0/1616977762 <== mon.0 v2:172.21.15.163:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f7ff40044b0 con 0x7f80000fed40 2023-07-14T18:30:18.110 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:18.074+0000 7f7ffdffb700 1 -- 172.21.15.163:0/1616977762 <== mon.0 v2:172.21.15.163:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ff4003ce0 con 0x7f80000fed40 2023-07-14T18:30:18.110 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:18.074+0000 7f8007108700 1 -- 172.21.15.163:0/1616977762 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f800019dd20 con 0x7f80000fed40 2023-07-14T18:30:18.110 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:18.075+0000 7f8007108700 1 -- 172.21.15.163:0/1616977762 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8000105b40 con 0x7f80000fed40 2023-07-14T18:30:18.110 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:18.076+0000 7f7ffdffb700 1 -- 172.21.15.163:0/1616977762 <== mon.0 v2:172.21.15.163:3300/0 4 ==== mgrmap(e 18) v1 ==== 135716+0+0 (secure 0 0 0) 0x7f7ff4003e40 con 0x7f80000fed40 2023-07-14T18:30:18.111 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:18.077+0000 7f7ffdffb700 1 --2- 172.21.15.163:0/1616977762 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f7ff00a1150 0x7f7ff00a3600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:30:18.111 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:18.077+0000 7f7ffffff700 1 --2- 172.21.15.163:0/1616977762 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f7ff00a1150 0x7f7ff00a3600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:30:18.111 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:18.077+0000 7f7ffdffb700 1 -- 172.21.15.163:0/1616977762 <== mon.0 v2:172.21.15.163:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 9049+0+0 (secure 0 0 0) 0x7f7ff4014070 con 0x7f80000fed40 2023-07-14T18:30:18.111 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:18.077+0000 7f7ffffff700 1 --2- 172.21.15.163:0/1616977762 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f7ff00a1150 0x7f7ff00a3600 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f7fec006010 tx=0x7f7fec005960 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:30:18.112 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:18.081+0000 7f7ffdffb700 1 -- 172.21.15.163:0/1616977762 <== mon.0 v2:172.21.15.163:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178025 (secure 0 0 0) 0x7f7ff4096520 con 0x7f80000fed40 2023-07-14T18:30:18.164 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:30:17 smithi184 ceph-mon[98481]: from='client.? 172.21.15.163:0/3630667254' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2023-07-14T18:30:18.164 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:30:17 smithi184 ceph-mon[98481]: from='client.? 172.21.15.163:0/2393453239' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2023-07-14T18:30:18.206 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:30:17 smithi163 ceph-mon[96576]: from='client.? 172.21.15.163:0/3630667254' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2023-07-14T18:30:18.207 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:30:17 smithi163 ceph-mon[96576]: from='client.? 172.21.15.163:0/2393453239' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2023-07-14T18:30:18.265 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:30:17 smithi172 ceph-mon[97983]: from='client.? 172.21.15.163:0/3630667254' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2023-07-14T18:30:18.265 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:30:17 smithi172 ceph-mon[97983]: from='client.? 172.21.15.163:0/2393453239' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2023-07-14T18:30:18.369 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:18.340+0000 7f8007108700 1 -- 172.21.15.163:0/1616977762 --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f800002c8e0 con 0x7f80000fed40 2023-07-14T18:30:18.370 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:18.341+0000 7f7ffdffb700 1 -- 172.21.15.163:0/1616977762 <== mon.0 v2:172.21.15.163:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v88) v1 ==== 93+0+10 (secure 0 0 0) 0x7f800002c8e0 con 0x7f80000fed40 2023-07-14T18:30:18.370 INFO:teuthology.orchestra.run.smithi163.stdout:pg_num: 1 2023-07-14T18:30:18.372 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:18.343+0000 7f8007108700 1 -- 172.21.15.163:0/1616977762 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f7ff00a1150 msgr2=0x7f7ff00a3600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:30:18.372 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:18.343+0000 7f8007108700 1 --2- 172.21.15.163:0/1616977762 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f7ff00a1150 0x7f7ff00a3600 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f7fec006010 tx=0x7f7fec005960 comp rx=0 tx=0).stop 2023-07-14T18:30:18.373 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:18.343+0000 7f8007108700 1 -- 172.21.15.163:0/1616977762 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f80000fed40 msgr2=0x7f80000fe7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:30:18.373 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:18.343+0000 7f8007108700 1 --2- 172.21.15.163:0/1616977762 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f80000fed40 0x7f80000fe7c0 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7f7ff400eb30 tx=0x7f7ff400ee40 comp rx=0 tx=0).stop 2023-07-14T18:30:18.373 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:18.343+0000 7f8007108700 1 -- 172.21.15.163:0/1616977762 shutdown_connections 2023-07-14T18:30:18.373 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:18.343+0000 7f8007108700 1 --2- 172.21.15.163:0/1616977762 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f7ff00a1150 0x7f7ff00a3600 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:30:18.373 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:18.343+0000 7f8007108700 1 --2- 172.21.15.163:0/1616977762 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8000100180 0x7f800019cbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:30:18.374 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:18.343+0000 7f8007108700 1 --2- 172.21.15.163:0/1616977762 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f80000fed40 0x7f80000fe7c0 unknown :-1 s=CLOSED pgs=777 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:30:18.374 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:18.343+0000 7f8007108700 1 --2- 172.21.15.163:0/1616977762 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f80000ff6f0 0x7f800019a5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:30:18.374 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:18.343+0000 7f8007108700 1 -- 172.21.15.163:0/1616977762 >> 172.21.15.163:0/1616977762 conn(0x7f80000f98a0 msgr2=0x7f80000fbbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:30:18.374 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:18.343+0000 7f8007108700 1 -- 172.21.15.163:0/1616977762 shutdown_connections 2023-07-14T18:30:18.374 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:18.343+0000 7f8007108700 1 -- 172.21.15.163:0/1616977762 wait complete. 2023-07-14T18:30:18.385 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-14T18:30:18.526 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:18.496+0000 7f8ad21f8700 1 -- 172.21.15.163:0/3080446462 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f8acc100e10 msgr2=0x7f8acc101260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:30:18.527 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:18.496+0000 7f8ad21f8700 1 --2- 172.21.15.163:0/3080446462 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f8acc100e10 0x7f8acc101260 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7f8ac0009990 tx=0x7f8ac0009ca0 comp rx=0 tx=0).stop 2023-07-14T18:30:18.527 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:18.496+0000 7f8ad21f8700 1 -- 172.21.15.163:0/3080446462 shutdown_connections 2023-07-14T18:30:18.527 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:18.496+0000 7f8ad21f8700 1 --2- 172.21.15.163:0/3080446462 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8acc1017a0 0x7f8acc108060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:30:18.527 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:18.496+0000 7f8ad21f8700 1 --2- 172.21.15.163:0/3080446462 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8acc0ffc20 0x7f8acc100030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:30:18.527 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:18.496+0000 7f8ad21f8700 1 --2- 172.21.15.163:0/3080446462 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f8acc100e10 0x7f8acc101260 unknown :-1 s=CLOSED pgs=778 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:30:18.528 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:18.496+0000 7f8ad21f8700 1 -- 172.21.15.163:0/3080446462 >> 172.21.15.163:0/3080446462 conn(0x7f8acc0fb260 msgr2=0x7f8acc0fd670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:30:18.528 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:18.497+0000 7f8ad21f8700 1 -- 172.21.15.163:0/3080446462 shutdown_connections 2023-07-14T18:30:18.528 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:18.497+0000 7f8ad21f8700 1 -- 172.21.15.163:0/3080446462 wait complete. 2023-07-14T18:30:18.528 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:18.497+0000 7f8ad21f8700 1 Processor -- start 2023-07-14T18:30:18.530 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:18.497+0000 7f8ad21f8700 1 -- start start 2023-07-14T18:30:18.530 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:18.497+0000 7f8ad21f8700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8acc0ffc20 0x7f8acc195810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:30:18.531 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:18.497+0000 7f8ad21f8700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f8acc100e10 0x7f8acc195d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:30:18.531 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:18.497+0000 7f8ad21f8700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8acc1017a0 0x7f8acc19cdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:30:18.531 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:18.497+0000 7f8ad21f8700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8acc19d390 con 0x7f8acc100e10 2023-07-14T18:30:18.531 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:18.497+0000 7f8ad21f8700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8acc19d4d0 con 0x7f8acc0ffc20 2023-07-14T18:30:18.531 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:18.497+0000 7f8ad21f8700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8acc19d660 con 0x7f8acc1017a0 2023-07-14T18:30:18.532 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:18.498+0000 7f8acb7fe700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8acc0ffc20 0x7f8acc195810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:30:18.532 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:18.498+0000 7f8acaffd700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f8acc100e10 0x7f8acc195d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:30:18.532 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:18.498+0000 7f8acb7fe700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8acc0ffc20 0x7f8acc195810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.163:33342/0 (socket says 172.21.15.163:33342) 2023-07-14T18:30:18.532 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:18.498+0000 7f8acb7fe700 1 -- 172.21.15.163:0/814363608 learned_addr learned my addr 172.21.15.163:0/814363608 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:30:18.532 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:18.498+0000 7f8acbfff700 1 --2- 172.21.15.163:0/814363608 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8acc1017a0 0x7f8acc19cdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:30:18.533 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:18.498+0000 7f8acb7fe700 1 -- 172.21.15.163:0/814363608 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8acc1017a0 msgr2=0x7f8acc19cdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:30:18.533 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:18.498+0000 7f8acb7fe700 1 --2- 172.21.15.163:0/814363608 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8acc1017a0 0x7f8acc19cdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:30:18.533 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:18.498+0000 7f8acb7fe700 1 -- 172.21.15.163:0/814363608 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f8acc100e10 msgr2=0x7f8acc195d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:30:18.533 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:18.498+0000 7f8acb7fe700 1 --2- 172.21.15.163:0/814363608 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f8acc100e10 0x7f8acc195d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:30:18.534 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:18.498+0000 7f8acb7fe700 1 -- 172.21.15.163:0/814363608 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ac00095f0 con 0x7f8acc0ffc20 2023-07-14T18:30:18.534 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:18.498+0000 7f8acaffd700 1 --2- 172.21.15.163:0/814363608 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f8acc100e10 0x7f8acc195d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T18:30:18.534 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:18.498+0000 7f8acb7fe700 1 --2- 172.21.15.163:0/814363608 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8acc0ffc20 0x7f8acc195810 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f8abc00e970 tx=0x7f8abc00ec80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:30:18.534 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:18.498+0000 7f8ac8ff9700 1 -- 172.21.15.163:0/814363608 <== mon.2 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8abc009790 con 0x7f8acc0ffc20 2023-07-14T18:30:18.534 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:18.498+0000 7f8ad21f8700 1 -- 172.21.15.163:0/814363608 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8acc19d940 con 0x7f8acc0ffc20 2023-07-14T18:30:18.535 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:18.498+0000 7f8ac8ff9700 1 -- 172.21.15.163:0/814363608 <== mon.2 v2:172.21.15.172:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f8abc00c7e0 con 0x7f8acc0ffc20 2023-07-14T18:30:18.535 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:18.498+0000 7f8ac8ff9700 1 -- 172.21.15.163:0/814363608 <== mon.2 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8abc003bd0 con 0x7f8acc0ffc20 2023-07-14T18:30:18.535 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:18.498+0000 7f8ad21f8700 1 -- 172.21.15.163:0/814363608 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8acc19dea0 con 0x7f8acc0ffc20 2023-07-14T18:30:18.535 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:18.499+0000 7f8ad21f8700 1 -- 172.21.15.163:0/814363608 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8acc106ba0 con 0x7f8acc0ffc20 2023-07-14T18:30:18.535 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:18.501+0000 7f8ac8ff9700 1 -- 172.21.15.163:0/814363608 <== mon.2 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 18) v1 ==== 135716+0+0 (secure 0 0 0) 0x7f8abc00c950 con 0x7f8acc0ffc20 2023-07-14T18:30:18.536 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:18.501+0000 7f8ac8ff9700 1 --2- 172.21.15.163:0/814363608 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f8ab40a1150 0x7f8ab40a3600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:30:18.536 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:18.501+0000 7f8acaffd700 1 --2- 172.21.15.163:0/814363608 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f8ab40a1150 0x7f8ab40a3600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:30:18.537 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:18.501+0000 7f8ac8ff9700 1 -- 172.21.15.163:0/814363608 <== mon.2 v2:172.21.15.172:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 9049+0+0 (secure 0 0 0) 0x7f8abc014070 con 0x7f8acc0ffc20 2023-07-14T18:30:18.537 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:18.502+0000 7f8acaffd700 1 --2- 172.21.15.163:0/814363608 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f8ab40a1150 0x7f8ab40a3600 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f8ac000b2e0 tx=0x7f8ac0004500 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:30:18.537 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:18.508+0000 7f8ac8ff9700 1 -- 172.21.15.163:0/814363608 <== mon.2 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178025 (secure 0 0 0) 0x7f8abc096380 con 0x7f8acc0ffc20 2023-07-14T18:30:18.803 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:18.774+0000 7f8ad21f8700 1 -- 172.21.15.163:0/814363608 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f8acc02cb90 con 0x7f8acc0ffc20 2023-07-14T18:30:18.807 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:18.778+0000 7f8ac8ff9700 1 -- 172.21.15.163:0/814363608 <== mon.2 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v88) v1 ==== 104+0+11 (secure 0 0 0) 0x7f8abc0999a0 con 0x7f8acc0ffc20 2023-07-14T18:30:18.808 INFO:teuthology.orchestra.run.smithi163.stdout:pg_num: 32 2023-07-14T18:30:18.810 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:18.780+0000 7f8ad21f8700 1 -- 172.21.15.163:0/814363608 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f8ab40a1150 msgr2=0x7f8ab40a3600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:30:18.810 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:18.780+0000 7f8ad21f8700 1 --2- 172.21.15.163:0/814363608 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f8ab40a1150 0x7f8ab40a3600 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f8ac000b2e0 tx=0x7f8ac0004500 comp rx=0 tx=0).stop 2023-07-14T18:30:18.810 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:18.780+0000 7f8ad21f8700 1 -- 172.21.15.163:0/814363608 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8acc0ffc20 msgr2=0x7f8acc195810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:30:18.810 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:18.780+0000 7f8ad21f8700 1 --2- 172.21.15.163:0/814363608 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8acc0ffc20 0x7f8acc195810 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f8abc00e970 tx=0x7f8abc00ec80 comp rx=0 tx=0).stop 2023-07-14T18:30:18.811 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:18.780+0000 7f8ad21f8700 1 -- 172.21.15.163:0/814363608 shutdown_connections 2023-07-14T18:30:18.811 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:18.780+0000 7f8ad21f8700 1 --2- 172.21.15.163:0/814363608 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f8ab40a1150 0x7f8ab40a3600 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:30:18.811 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:18.780+0000 7f8ad21f8700 1 --2- 172.21.15.163:0/814363608 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8acc1017a0 0x7f8acc19cdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:30:18.811 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:18.780+0000 7f8ad21f8700 1 --2- 172.21.15.163:0/814363608 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8acc0ffc20 0x7f8acc195810 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:30:18.811 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:18.780+0000 7f8ad21f8700 1 --2- 172.21.15.163:0/814363608 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f8acc100e10 0x7f8acc195d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:30:18.812 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:18.780+0000 7f8ad21f8700 1 -- 172.21.15.163:0/814363608 >> 172.21.15.163:0/814363608 conn(0x7f8acc0fb260 msgr2=0x7f8acc0fd520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:30:18.812 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:18.781+0000 7f8ad21f8700 1 -- 172.21.15.163:0/814363608 shutdown_connections 2023-07-14T18:30:18.812 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:18.781+0000 7f8ad21f8700 1 -- 172.21.15.163:0/814363608 wait complete. 2023-07-14T18:30:18.824 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-14T18:30:18.963 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:18.933+0000 7ff19e3d2700 1 -- 172.21.15.163:0/3453510503 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff198100690 msgr2=0x7ff198102a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:30:18.964 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:18.934+0000 7ff19e3d2700 1 --2- 172.21.15.163:0/3453510503 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff198100690 0x7ff198102a70 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7ff188009990 tx=0x7ff188009ca0 comp rx=0 tx=0).stop 2023-07-14T18:30:18.964 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:18.934+0000 7ff19e3d2700 1 -- 172.21.15.163:0/3453510503 shutdown_connections 2023-07-14T18:30:18.964 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:18.934+0000 7ff19e3d2700 1 --2- 172.21.15.163:0/3453510503 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff1981058d0 0x7ff198107d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:30:18.964 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:18.934+0000 7ff19e3d2700 1 --2- 172.21.15.163:0/3453510503 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff198100690 0x7ff198102a70 unknown :-1 s=CLOSED pgs=779 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:30:18.964 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:18.934+0000 7ff19e3d2700 1 --2- 172.21.15.163:0/3453510503 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff198102fb0 0x7ff198105390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:30:18.965 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:18.934+0000 7ff19e3d2700 1 -- 172.21.15.163:0/3453510503 >> 172.21.15.163:0/3453510503 conn(0x7ff1980fa130 msgr2=0x7ff1980fc560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:30:18.965 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:18.934+0000 7ff19e3d2700 1 -- 172.21.15.163:0/3453510503 shutdown_connections 2023-07-14T18:30:18.965 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:18.934+0000 7ff19e3d2700 1 -- 172.21.15.163:0/3453510503 wait complete. 2023-07-14T18:30:18.967 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:18.934+0000 7ff19e3d2700 1 Processor -- start 2023-07-14T18:30:18.967 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:18.934+0000 7ff19e3d2700 1 -- start start 2023-07-14T18:30:18.968 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:18.935+0000 7ff19e3d2700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff198100690 0x7ff198195900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:30:18.968 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:18.935+0000 7ff19e3d2700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff198102fb0 0x7ff198195e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:30:18.968 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:18.935+0000 7ff19e3d2700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff1981058d0 0x7ff19819ce10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:30:18.968 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:18.935+0000 7ff19e3d2700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff19819d3e0 con 0x7ff198102fb0 2023-07-14T18:30:18.968 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:18.935+0000 7ff19e3d2700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff19819d520 con 0x7ff198100690 2023-07-14T18:30:18.969 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:18.935+0000 7ff19e3d2700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff19819d6b0 con 0x7ff1981058d0 2023-07-14T18:30:18.969 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:18.935+0000 7ff197fff700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff198100690 0x7ff198195900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:30:18.969 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:18.935+0000 7ff1977fe700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff198102fb0 0x7ff198195e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:30:18.969 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:18.935+0000 7ff197fff700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff198100690 0x7ff198195900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.163:33356/0 (socket says 172.21.15.163:33356) 2023-07-14T18:30:18.969 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:18.935+0000 7ff197fff700 1 -- 172.21.15.163:0/24884454 learned_addr learned my addr 172.21.15.163:0/24884454 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:30:18.970 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:18.935+0000 7ff19c96f700 1 --2- 172.21.15.163:0/24884454 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff1981058d0 0x7ff19819ce10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:30:18.970 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:18.935+0000 7ff197fff700 1 -- 172.21.15.163:0/24884454 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff1981058d0 msgr2=0x7ff19819ce10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:30:18.970 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:18.935+0000 7ff197fff700 1 --2- 172.21.15.163:0/24884454 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff1981058d0 0x7ff19819ce10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:30:18.970 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:18.935+0000 7ff197fff700 1 -- 172.21.15.163:0/24884454 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff198102fb0 msgr2=0x7ff198195e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:30:18.971 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:18.935+0000 7ff197fff700 1 --2- 172.21.15.163:0/24884454 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff198102fb0 0x7ff198195e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:30:18.971 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:18.935+0000 7ff197fff700 1 -- 172.21.15.163:0/24884454 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1880095f0 con 0x7ff198100690 2023-07-14T18:30:18.971 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:18.935+0000 7ff197fff700 1 --2- 172.21.15.163:0/24884454 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff198100690 0x7ff198195900 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7ff1880059d0 tx=0x7ff1880047b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:30:18.971 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:18.936+0000 7ff1957fa700 1 -- 172.21.15.163:0/24884454 <== mon.2 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff18801d070 con 0x7ff198100690 2023-07-14T18:30:18.971 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:18.936+0000 7ff1957fa700 1 -- 172.21.15.163:0/24884454 <== mon.2 v2:172.21.15.172:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ff18800bdb0 con 0x7ff198100690 2023-07-14T18:30:18.972 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:18.936+0000 7ff19e3d2700 1 -- 172.21.15.163:0/24884454 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff19819d930 con 0x7ff198100690 2023-07-14T18:30:18.972 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:18.936+0000 7ff1957fa700 1 -- 172.21.15.163:0/24884454 <== mon.2 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff18800fd90 con 0x7ff198100690 2023-07-14T18:30:18.972 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:18.936+0000 7ff19e3d2700 1 -- 172.21.15.163:0/24884454 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff19819dde0 con 0x7ff198100690 2023-07-14T18:30:18.972 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:18.937+0000 7ff19e3d2700 1 -- 172.21.15.163:0/24884454 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff1980fbca0 con 0x7ff198100690 2023-07-14T18:30:18.972 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:18.938+0000 7ff1957fa700 1 -- 172.21.15.163:0/24884454 <== mon.2 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 18) v1 ==== 135716+0+0 (secure 0 0 0) 0x7ff18800f560 con 0x7ff198100690 2023-07-14T18:30:18.973 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:18.939+0000 7ff1957fa700 1 --2- 172.21.15.163:0/24884454 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7ff1800a1150 0x7ff1800a3600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:30:18.974 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:18.939+0000 7ff1977fe700 1 --2- 172.21.15.163:0/24884454 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7ff1800a1150 0x7ff1800a3600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:30:18.974 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:18.939+0000 7ff1957fa700 1 -- 172.21.15.163:0/24884454 <== mon.2 v2:172.21.15.172:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 9049+0+0 (secure 0 0 0) 0x7ff1880cdfb0 con 0x7ff198100690 2023-07-14T18:30:18.974 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:18.939+0000 7ff1977fe700 1 --2- 172.21.15.163:0/24884454 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7ff1800a1150 0x7ff1800a3600 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7ff18c009c60 tx=0x7ff18c009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:30:18.974 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:18.943+0000 7ff1957fa700 1 -- 172.21.15.163:0/24884454 <== mon.2 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178025 (secure 0 0 0) 0x7ff188097460 con 0x7ff198100690 2023-07-14T18:30:19.164 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:30:18 smithi184 ceph-mon[98481]: pgmap v829: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-07-14T18:30:19.164 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:30:18 smithi184 ceph-mon[98481]: from='client.? 172.21.15.163:0/828594335' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-07-14T18:30:19.165 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:30:18 smithi184 ceph-mon[98481]: from='client.? 172.21.15.163:0/1616977762' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-07-14T18:30:19.206 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:30:18 smithi163 ceph-mon[96576]: pgmap v829: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-07-14T18:30:19.207 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:30:18 smithi163 ceph-mon[96576]: from='client.? 172.21.15.163:0/828594335' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-07-14T18:30:19.207 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:30:18 smithi163 ceph-mon[96576]: from='client.? 172.21.15.163:0/1616977762' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-07-14T18:30:19.209 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:19.180+0000 7ff19e3d2700 1 -- 172.21.15.163:0/24884454 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7ff19802ca70 con 0x7ff198100690 2023-07-14T18:30:19.210 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:19.181+0000 7ff1957fa700 1 -- 172.21.15.163:0/24884454 <== mon.2 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v88) v1 ==== 100+0+11 (secure 0 0 0) 0x7ff18801b0c0 con 0x7ff198100690 2023-07-14T18:30:19.210 INFO:teuthology.orchestra.run.smithi163.stdout:pg_num: 64 2023-07-14T18:30:19.212 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:19.183+0000 7ff19e3d2700 1 -- 172.21.15.163:0/24884454 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7ff1800a1150 msgr2=0x7ff1800a3600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:30:19.213 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:19.183+0000 7ff19e3d2700 1 --2- 172.21.15.163:0/24884454 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7ff1800a1150 0x7ff1800a3600 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7ff18c009c60 tx=0x7ff18c009260 comp rx=0 tx=0).stop 2023-07-14T18:30:19.213 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:19.183+0000 7ff19e3d2700 1 -- 172.21.15.163:0/24884454 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff198100690 msgr2=0x7ff198195900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:30:19.213 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:19.183+0000 7ff19e3d2700 1 --2- 172.21.15.163:0/24884454 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff198100690 0x7ff198195900 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7ff1880059d0 tx=0x7ff1880047b0 comp rx=0 tx=0).stop 2023-07-14T18:30:19.213 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:19.183+0000 7ff19e3d2700 1 -- 172.21.15.163:0/24884454 shutdown_connections 2023-07-14T18:30:19.214 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:19.183+0000 7ff19e3d2700 1 --2- 172.21.15.163:0/24884454 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7ff1800a1150 0x7ff1800a3600 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:30:19.214 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:19.183+0000 7ff19e3d2700 1 --2- 172.21.15.163:0/24884454 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff1981058d0 0x7ff19819ce10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:30:19.214 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:19.183+0000 7ff19e3d2700 1 --2- 172.21.15.163:0/24884454 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff198100690 0x7ff198195900 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:30:19.214 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:19.183+0000 7ff19e3d2700 1 --2- 172.21.15.163:0/24884454 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7ff198102fb0 0x7ff198195e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:30:19.214 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:19.183+0000 7ff19e3d2700 1 -- 172.21.15.163:0/24884454 >> 172.21.15.163:0/24884454 conn(0x7ff1980fa130 msgr2=0x7ff1981012f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:30:19.215 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:19.183+0000 7ff19e3d2700 1 -- 172.21.15.163:0/24884454 shutdown_connections 2023-07-14T18:30:19.215 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:19.183+0000 7ff19e3d2700 1 -- 172.21.15.163:0/24884454 wait complete. 2023-07-14T18:30:19.227 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-07-14T18:30:19.265 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:30:18 smithi172 ceph-mon[97983]: pgmap v829: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-07-14T18:30:19.265 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:30:18 smithi172 ceph-mon[97983]: from='client.? 172.21.15.163:0/828594335' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-07-14T18:30:19.265 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:30:18 smithi172 ceph-mon[97983]: from='client.? 172.21.15.163:0/1616977762' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-07-14T18:30:19.372 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:19.342+0000 7f499540d700 1 -- 172.21.15.163:0/2907585611 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f49900ffd00 msgr2=0x7f4990100150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:30:19.372 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:19.342+0000 7f499540d700 1 --2- 172.21.15.163:0/2907585611 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f49900ffd00 0x7f4990100150 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7f4984009990 tx=0x7f4984009ca0 comp rx=0 tx=0).stop 2023-07-14T18:30:19.373 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:19.342+0000 7f499540d700 1 -- 172.21.15.163:0/2907585611 shutdown_connections 2023-07-14T18:30:19.373 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:19.342+0000 7f499540d700 1 --2- 172.21.15.163:0/2907585611 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4990100690 0x7f4990106f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:30:19.373 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:19.342+0000 7f499540d700 1 --2- 172.21.15.163:0/2907585611 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f49900feb10 0x7f49900fef20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:30:19.373 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:19.342+0000 7f499540d700 1 --2- 172.21.15.163:0/2907585611 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f49900ffd00 0x7f4990100150 unknown :-1 s=CLOSED pgs=780 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:30:19.373 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:19.342+0000 7f499540d700 1 -- 172.21.15.163:0/2907585611 >> 172.21.15.163:0/2907585611 conn(0x7f49900fa130 msgr2=0x7f49900fc560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:30:19.374 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:19.343+0000 7f499540d700 1 -- 172.21.15.163:0/2907585611 shutdown_connections 2023-07-14T18:30:19.374 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:19.343+0000 7f499540d700 1 -- 172.21.15.163:0/2907585611 wait complete. 2023-07-14T18:30:19.375 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:19.343+0000 7f499540d700 1 Processor -- start 2023-07-14T18:30:19.376 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:19.343+0000 7f499540d700 1 -- start start 2023-07-14T18:30:19.376 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:19.344+0000 7f499540d700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f49900feb10 0x7f4990195910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:30:19.376 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:19.344+0000 7f499540d700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f49900ffd00 0x7f4990195e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:30:19.376 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:19.344+0000 7f499540d700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f4990100690 0x7f499019cec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:30:19.377 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:19.344+0000 7f499540d700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f499019d490 con 0x7f4990100690 2023-07-14T18:30:19.377 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:19.344+0000 7f499540d700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f499019d5d0 con 0x7f49900feb10 2023-07-14T18:30:19.377 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:19.344+0000 7f499540d700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f499019d760 con 0x7f49900ffd00 2023-07-14T18:30:19.377 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:19.344+0000 7f498effd700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f49900feb10 0x7f4990195910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:30:19.377 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:19.344+0000 7f498effd700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f49900feb10 0x7f4990195910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.163:33370/0 (socket says 172.21.15.163:33370) 2023-07-14T18:30:19.378 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:19.344+0000 7f498effd700 1 -- 172.21.15.163:0/2978294096 learned_addr learned my addr 172.21.15.163:0/2978294096 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:30:19.378 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:19.344+0000 7f498f7fe700 1 --2- 172.21.15.163:0/2978294096 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f4990100690 0x7f499019cec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:30:19.378 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:19.344+0000 7f498e7fc700 1 --2- 172.21.15.163:0/2978294096 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f49900ffd00 0x7f4990195e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:30:19.378 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:19.344+0000 7f498effd700 1 -- 172.21.15.163:0/2978294096 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f49900ffd00 msgr2=0x7f4990195e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:30:19.378 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:19.344+0000 7f498effd700 1 --2- 172.21.15.163:0/2978294096 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f49900ffd00 0x7f4990195e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:30:19.379 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:19.344+0000 7f498effd700 1 -- 172.21.15.163:0/2978294096 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f4990100690 msgr2=0x7f499019cec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:30:19.379 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:19.344+0000 7f498effd700 1 --2- 172.21.15.163:0/2978294096 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f4990100690 0x7f499019cec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:30:19.379 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:19.344+0000 7f498effd700 1 -- 172.21.15.163:0/2978294096 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49840095f0 con 0x7f49900feb10 2023-07-14T18:30:19.379 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:19.344+0000 7f498effd700 1 --2- 172.21.15.163:0/2978294096 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f49900feb10 0x7f4990195910 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f498000e970 tx=0x7f498000ec80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:30:19.379 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:19.344+0000 7f4977fff700 1 -- 172.21.15.163:0/2978294096 <== mon.2 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4980009790 con 0x7f49900feb10 2023-07-14T18:30:19.380 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:19.345+0000 7f499540d700 1 -- 172.21.15.163:0/2978294096 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f49901078e0 con 0x7f49900feb10 2023-07-14T18:30:19.380 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:19.345+0000 7f4977fff700 1 -- 172.21.15.163:0/2978294096 <== mon.2 v2:172.21.15.172:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f498000c7e0 con 0x7f49900feb10 2023-07-14T18:30:19.380 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:19.345+0000 7f4977fff700 1 -- 172.21.15.163:0/2978294096 <== mon.2 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4980003bd0 con 0x7f49900feb10 2023-07-14T18:30:19.380 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:19.345+0000 7f499540d700 1 -- 172.21.15.163:0/2978294096 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4990107df0 con 0x7f49900feb10 2023-07-14T18:30:19.381 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:19.345+0000 7f499540d700 1 -- 172.21.15.163:0/2978294096 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f49901061a0 con 0x7f49900feb10 2023-07-14T18:30:19.382 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:19.347+0000 7f4977fff700 1 -- 172.21.15.163:0/2978294096 <== mon.2 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 18) v1 ==== 135716+0+0 (secure 0 0 0) 0x7f498000c950 con 0x7f49900feb10 2023-07-14T18:30:19.382 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:19.348+0000 7f4977fff700 1 --2- 172.21.15.163:0/2978294096 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f49780a1150 0x7f49780a3600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:30:19.382 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:19.348+0000 7f498e7fc700 1 --2- 172.21.15.163:0/2978294096 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f49780a1150 0x7f49780a3600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:30:19.383 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:19.348+0000 7f4977fff700 1 -- 172.21.15.163:0/2978294096 <== mon.2 v2:172.21.15.172:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 9049+0+0 (secure 0 0 0) 0x7f4980014070 con 0x7f49900feb10 2023-07-14T18:30:19.383 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:19.348+0000 7f498e7fc700 1 --2- 172.21.15.163:0/2978294096 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f49780a1150 0x7f49780a3600 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f498400b2e0 tx=0x7f4984004000 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:30:19.383 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:19.350+0000 7f4977fff700 1 -- 172.21.15.163:0/2978294096 <== mon.2 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178025 (secure 0 0 0) 0x7f4980096390 con 0x7f49900feb10 2023-07-14T18:30:19.659 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:19.630+0000 7f499540d700 1 -- 172.21.15.163:0/2978294096 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f499002cb70 con 0x7f49900feb10 2023-07-14T18:30:19.660 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:19.630+0000 7f4977fff700 1 -- 172.21.15.163:0/2978294096 <== mon.2 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v88) v1 ==== 103+0+11 (secure 0 0 0) 0x7f49800999b0 con 0x7f49900feb10 2023-07-14T18:30:19.660 INFO:teuthology.orchestra.run.smithi163.stdout:pg_num: 32 2023-07-14T18:30:19.662 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:19.633+0000 7f499540d700 1 -- 172.21.15.163:0/2978294096 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f49780a1150 msgr2=0x7f49780a3600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:30:19.663 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:19.633+0000 7f499540d700 1 --2- 172.21.15.163:0/2978294096 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f49780a1150 0x7f49780a3600 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f498400b2e0 tx=0x7f4984004000 comp rx=0 tx=0).stop 2023-07-14T18:30:19.663 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:19.633+0000 7f499540d700 1 -- 172.21.15.163:0/2978294096 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f49900feb10 msgr2=0x7f4990195910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:30:19.663 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:19.633+0000 7f499540d700 1 --2- 172.21.15.163:0/2978294096 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f49900feb10 0x7f4990195910 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f498000e970 tx=0x7f498000ec80 comp rx=0 tx=0).stop 2023-07-14T18:30:19.663 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:19.633+0000 7f499540d700 1 -- 172.21.15.163:0/2978294096 shutdown_connections 2023-07-14T18:30:19.663 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:19.633+0000 7f499540d700 1 --2- 172.21.15.163:0/2978294096 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f49780a1150 0x7f49780a3600 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:30:19.664 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:19.633+0000 7f499540d700 1 --2- 172.21.15.163:0/2978294096 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f4990100690 0x7f499019cec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:30:19.664 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:19.633+0000 7f499540d700 1 --2- 172.21.15.163:0/2978294096 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f49900feb10 0x7f4990195910 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:30:19.664 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:19.633+0000 7f499540d700 1 --2- 172.21.15.163:0/2978294096 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f49900ffd00 0x7f4990195e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:30:19.664 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:19.633+0000 7f499540d700 1 -- 172.21.15.163:0/2978294096 >> 172.21.15.163:0/2978294096 conn(0x7f49900fa130 msgr2=0x7f49901032e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:30:19.664 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:19.633+0000 7f499540d700 1 -- 172.21.15.163:0/2978294096 shutdown_connections 2023-07-14T18:30:19.665 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:19.633+0000 7f499540d700 1 -- 172.21.15.163:0/2978294096 wait complete. 2023-07-14T18:30:19.676 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-07-14T18:30:19.827 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:19.795+0000 7f510dd81700 1 -- 172.21.15.163:0/2008315747 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5108101790 msgr2=0x7f5108108050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:30:19.828 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:19.795+0000 7f510dd81700 1 --2- 172.21.15.163:0/2008315747 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5108101790 0x7f5108108050 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f5100009f90 tx=0x7f510000b330 comp rx=0 tx=0).stop 2023-07-14T18:30:19.829 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:19.795+0000 7f510dd81700 1 -- 172.21.15.163:0/2008315747 shutdown_connections 2023-07-14T18:30:19.829 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:19.795+0000 7f510dd81700 1 --2- 172.21.15.163:0/2008315747 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5108101790 0x7f5108108050 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:30:19.829 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:19.795+0000 7f510dd81700 1 --2- 172.21.15.163:0/2008315747 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f51080ffc10 0x7f5108100020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:30:19.830 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:19.795+0000 7f510dd81700 1 --2- 172.21.15.163:0/2008315747 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f5108100e00 0x7f5108101250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:30:19.830 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:19.795+0000 7f510dd81700 1 -- 172.21.15.163:0/2008315747 >> 172.21.15.163:0/2008315747 conn(0x7f51080fb250 msgr2=0x7f51080fd660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:30:19.831 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:19.795+0000 7f510dd81700 1 -- 172.21.15.163:0/2008315747 shutdown_connections 2023-07-14T18:30:19.831 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:19.795+0000 7f510dd81700 1 -- 172.21.15.163:0/2008315747 wait complete. 2023-07-14T18:30:19.831 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:19.796+0000 7f510dd81700 1 Processor -- start 2023-07-14T18:30:19.831 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:19.796+0000 7f510dd81700 1 -- start start 2023-07-14T18:30:19.831 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:19.796+0000 7f510dd81700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f51080ffc10 0x7f51081958c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:30:19.832 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:19.796+0000 7f510dd81700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f5108100e00 0x7f5108195e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:30:19.832 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:19.796+0000 7f510dd81700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5108101790 0x7f510819ce70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:30:19.832 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:19.796+0000 7f510dd81700 1 -- --> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f510819d440 con 0x7f5108100e00 2023-07-14T18:30:19.832 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:19.796+0000 7f510dd81700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f510819d580 con 0x7f51080ffc10 2023-07-14T18:30:19.833 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:19.796+0000 7f510dd81700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f510819d710 con 0x7f5108101790 2023-07-14T18:30:19.833 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:19.796+0000 7f51077fe700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f51080ffc10 0x7f51081958c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:30:19.833 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:19.796+0000 7f5106ffd700 1 --2- >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f5108100e00 0x7f5108195e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:30:19.833 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:19.796+0000 7f51077fe700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f51080ffc10 0x7f51081958c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.163:33384/0 (socket says 172.21.15.163:33384) 2023-07-14T18:30:19.833 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:19.796+0000 7f51077fe700 1 -- 172.21.15.163:0/3227279935 learned_addr learned my addr 172.21.15.163:0/3227279935 (peer_addr_for_me v2:172.21.15.163:0/0) 2023-07-14T18:30:19.834 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:19.796+0000 7f5107fff700 1 --2- 172.21.15.163:0/3227279935 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5108101790 0x7f510819ce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:30:19.834 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:19.797+0000 7f51077fe700 1 -- 172.21.15.163:0/3227279935 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5108101790 msgr2=0x7f510819ce70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:30:19.834 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:19.797+0000 7f51077fe700 1 --2- 172.21.15.163:0/3227279935 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5108101790 0x7f510819ce70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:30:19.834 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:19.797+0000 7f51077fe700 1 -- 172.21.15.163:0/3227279935 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f5108100e00 msgr2=0x7f5108195e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:30:19.834 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:19.797+0000 7f51077fe700 1 --2- 172.21.15.163:0/3227279935 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f5108100e00 0x7f5108195e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:30:19.835 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:19.797+0000 7f51077fe700 1 -- 172.21.15.163:0/3227279935 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50fc009520 con 0x7f51080ffc10 2023-07-14T18:30:19.835 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:19.797+0000 7f5106ffd700 1 --2- 172.21.15.163:0/3227279935 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f5108100e00 0x7f5108195e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-14T18:30:19.835 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:19.797+0000 7f51077fe700 1 --2- 172.21.15.163:0/3227279935 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f51080ffc10 0x7f51081958c0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f50f800e9f0 tx=0x7f50f800ed00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:30:19.835 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:19.797+0000 7f5104ff9700 1 -- 172.21.15.163:0/3227279935 <== mon.2 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50f8004220 con 0x7f51080ffc10 2023-07-14T18:30:19.835 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:19.797+0000 7f510dd81700 1 -- 172.21.15.163:0/3227279935 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5100009c40 con 0x7f51080ffc10 2023-07-14T18:30:19.836 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:19.797+0000 7f5104ff9700 1 -- 172.21.15.163:0/3227279935 <== mon.2 v2:172.21.15.172:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f50f8004380 con 0x7f51080ffc10 2023-07-14T18:30:19.836 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:19.797+0000 7f5104ff9700 1 -- 172.21.15.163:0/3227279935 <== mon.2 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50f8003a80 con 0x7f51080ffc10 2023-07-14T18:30:19.836 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:19.797+0000 7f510dd81700 1 -- 172.21.15.163:0/3227279935 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f510819dd70 con 0x7f51080ffc10 2023-07-14T18:30:19.836 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:19.798+0000 7f510dd81700 1 -- 172.21.15.163:0/3227279935 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5108107200 con 0x7f51080ffc10 2023-07-14T18:30:19.837 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:19.799+0000 7f5104ff9700 1 -- 172.21.15.163:0/3227279935 <== mon.2 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 18) v1 ==== 135716+0+0 (secure 0 0 0) 0x7f50f8003c20 con 0x7f51080ffc10 2023-07-14T18:30:19.837 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:19.800+0000 7f5104ff9700 1 --2- 172.21.15.163:0/3227279935 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f50f00a1150 0x7f50f00a3600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-14T18:30:19.838 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:19.800+0000 7f5106ffd700 1 --2- 172.21.15.163:0/3227279935 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f50f00a1150 0x7f50f00a3600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-14T18:30:19.838 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:19.800+0000 7f5104ff9700 1 -- 172.21.15.163:0/3227279935 <== mon.2 v2:172.21.15.172:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 9049+0+0 (secure 0 0 0) 0x7f50f8014070 con 0x7f51080ffc10 2023-07-14T18:30:19.838 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:19.800+0000 7f5106ffd700 1 --2- 172.21.15.163:0/3227279935 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f50f00a1150 0x7f50f00a3600 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f50fc009fd0 tx=0x7f50fc009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-14T18:30:19.838 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:19.805+0000 7f5104ff9700 1 -- 172.21.15.163:0/3227279935 <== mon.2 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178025 (secure 0 0 0) 0x7f50f80967c0 con 0x7f51080ffc10 2023-07-14T18:30:19.956 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:30:19 smithi163 ceph-mon[96576]: from='client.? 172.21.15.163:0/814363608' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-07-14T18:30:19.957 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:30:19 smithi163 ceph-mon[96576]: from='client.? 172.21.15.163:0/24884454' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-07-14T18:30:19.957 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:30:19 smithi163 ceph-mon[96576]: from='client.? 172.21.15.163:0/2978294096' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2023-07-14T18:30:20.109 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:20.080+0000 7f510dd81700 1 -- 172.21.15.163:0/3227279935 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f510802cb90 con 0x7f51080ffc10 2023-07-14T18:30:20.110 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:20.080+0000 7f5104ff9700 1 -- 172.21.15.163:0/3227279935 <== mon.2 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 10 entries v88) v1 ==== 81+0+600 (secure 0 0 0) 0x7f50f8099de0 con 0x7f51080ffc10 2023-07-14T18:30:20.110 INFO:teuthology.orchestra.run.smithi163.stdout:172.21.15.163:6801/1086512093 2023-07-15T18:05:15.331458+0000 2023-07-14T18:30:20.110 INFO:teuthology.orchestra.run.smithi163.stdout:172.21.15.163:6800/1086512093 2023-07-15T18:05:15.331458+0000 2023-07-14T18:30:20.111 INFO:teuthology.orchestra.run.smithi163.stdout:172.21.15.163:0/4235784810 2023-07-15T18:05:15.331458+0000 2023-07-14T18:30:20.111 INFO:teuthology.orchestra.run.smithi163.stdout:172.21.15.163:6800/236891232 2023-07-15T18:04:53.288443+0000 2023-07-14T18:30:20.111 INFO:teuthology.orchestra.run.smithi163.stdout:172.21.15.163:6801/236891232 2023-07-15T18:04:53.288443+0000 2023-07-14T18:30:20.111 INFO:teuthology.orchestra.run.smithi163.stdout:172.21.15.163:0/3260193612 2023-07-15T18:05:15.331458+0000 2023-07-14T18:30:20.111 INFO:teuthology.orchestra.run.smithi163.stdout:172.21.15.163:0/3513629472 2023-07-15T18:04:53.288443+0000 2023-07-14T18:30:20.112 INFO:teuthology.orchestra.run.smithi163.stdout:172.21.15.163:0/1090329830 2023-07-15T18:04:53.288443+0000 2023-07-14T18:30:20.112 INFO:teuthology.orchestra.run.smithi163.stdout:172.21.15.163:0/3868922045 2023-07-15T18:05:15.331458+0000 2023-07-14T18:30:20.112 INFO:teuthology.orchestra.run.smithi163.stdout:172.21.15.163:0/2945662447 2023-07-15T18:04:53.288443+0000 2023-07-14T18:30:20.113 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:20.083+0000 7f510dd81700 1 -- 172.21.15.163:0/3227279935 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f50f00a1150 msgr2=0x7f50f00a3600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:30:20.113 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:20.083+0000 7f510dd81700 1 --2- 172.21.15.163:0/3227279935 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f50f00a1150 0x7f50f00a3600 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f50fc009fd0 tx=0x7f50fc009260 comp rx=0 tx=0).stop 2023-07-14T18:30:20.113 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:20.083+0000 7f510dd81700 1 -- 172.21.15.163:0/3227279935 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f51080ffc10 msgr2=0x7f51081958c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-14T18:30:20.114 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:20.083+0000 7f510dd81700 1 --2- 172.21.15.163:0/3227279935 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f51080ffc10 0x7f51081958c0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f50f800e9f0 tx=0x7f50f800ed00 comp rx=0 tx=0).stop 2023-07-14T18:30:20.114 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:20.083+0000 7f510dd81700 1 -- 172.21.15.163:0/3227279935 shutdown_connections 2023-07-14T18:30:20.114 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:20.083+0000 7f510dd81700 1 --2- 172.21.15.163:0/3227279935 >> [v2:172.21.15.163:6800/1949590926,v1:172.21.15.163:6801/1949590926] conn(0x7f50f00a1150 0x7f50f00a3600 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:30:20.114 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:20.083+0000 7f510dd81700 1 --2- 172.21.15.163:0/3227279935 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5108101790 0x7f510819ce70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:30:20.114 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:20.083+0000 7f510dd81700 1 --2- 172.21.15.163:0/3227279935 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f51080ffc10 0x7f51081958c0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:30:20.115 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:20.083+0000 7f510dd81700 1 --2- 172.21.15.163:0/3227279935 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f5108100e00 0x7f5108195e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-14T18:30:20.115 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:20.083+0000 7f510dd81700 1 -- 172.21.15.163:0/3227279935 >> 172.21.15.163:0/3227279935 conn(0x7f51080fb250 msgr2=0x7f5108104340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-14T18:30:20.115 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:20.083+0000 7f510dd81700 1 -- 172.21.15.163:0/3227279935 shutdown_connections 2023-07-14T18:30:20.115 INFO:teuthology.orchestra.run.smithi163.stderr:2023-07-14T18:30:20.083+0000 7f510dd81700 1 -- 172.21.15.163:0/3227279935 wait complete. 2023-07-14T18:30:20.115 INFO:teuthology.orchestra.run.smithi163.stderr:listed 10 entries 2023-07-14T18:30:20.124 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi163.front.sepia.ceph.com... 2023-07-14T18:30:20.125 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T18:30:20.125 DEBUG:teuthology.orchestra.run.smithi163:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2023-07-14T18:30:20.164 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:30:19 smithi184 ceph-mon[98481]: from='client.? 172.21.15.163:0/814363608' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-07-14T18:30:20.164 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:30:19 smithi184 ceph-mon[98481]: from='client.? 172.21.15.163:0/24884454' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-07-14T18:30:20.165 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:30:19 smithi184 ceph-mon[98481]: from='client.? 172.21.15.163:0/2978294096' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2023-07-14T18:30:20.165 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi163.stderr:ceph-fuse[146701]: fuse finished with error 0 and tester_r 0 2023-07-14T18:30:20.175 INFO:teuthology.orchestra.run:waiting for 300 2023-07-14T18:30:20.265 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:30:19 smithi172 ceph-mon[97983]: from='client.? 172.21.15.163:0/814363608' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-07-14T18:30:20.265 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:30:19 smithi172 ceph-mon[97983]: from='client.? 172.21.15.163:0/24884454' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-07-14T18:30:20.266 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:30:19 smithi172 ceph-mon[97983]: from='client.? 172.21.15.163:0/2978294096' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2023-07-14T18:30:21.164 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:30:20 smithi184 ceph-mon[98481]: pgmap v830: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-07-14T18:30:21.164 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:30:20 smithi184 ceph-mon[98481]: from='client.? 172.21.15.163:0/3227279935' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2023-07-14T18:30:21.208 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:30:20 smithi163 ceph-mon[96576]: pgmap v830: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-07-14T18:30:21.208 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:30:20 smithi163 ceph-mon[96576]: from='client.? 172.21.15.163:0/3227279935' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2023-07-14T18:30:21.265 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:30:20 smithi172 ceph-mon[97983]: pgmap v830: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-07-14T18:30:21.265 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:30:20 smithi172 ceph-mon[97983]: from='client.? 172.21.15.163:0/3227279935' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2023-07-14T18:30:22.414 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:30:22 smithi184 ceph-mon[98481]: pgmap v831: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 511 B/s wr, 9 op/s 2023-07-14T18:30:22.456 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:30:22 smithi163 ceph-mon[96576]: pgmap v831: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 511 B/s wr, 9 op/s 2023-07-14T18:30:22.514 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:30:22 smithi172 ceph-mon[97983]: pgmap v831: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 511 B/s wr, 9 op/s 2023-07-14T18:30:25.164 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:30:24 smithi184 ceph-mon[98481]: pgmap v832: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 1.5 KiB/s wr, 12 op/s 2023-07-14T18:30:25.206 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:30:24 smithi163 ceph-mon[96576]: pgmap v832: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 1.5 KiB/s wr, 12 op/s 2023-07-14T18:30:25.264 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:30:24 smithi172 ceph-mon[97983]: pgmap v832: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 1.5 KiB/s wr, 12 op/s 2023-07-14T18:30:26.277 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi163.front.sepia.ceph.com 2023-07-14T18:30:26.278 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T18:30:26.278 DEBUG:teuthology.orchestra.run.smithi163:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-07-14T18:30:26.297 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T18:30:26.298 DEBUG:teuthology.orchestra.run.smithi163:> ip netns list 2023-07-14T18:30:26.356 INFO:teuthology.orchestra.run.smithi163.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-07-14T18:30:26.357 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T18:30:26.358 DEBUG:teuthology.orchestra.run.smithi163:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2023-07-14T18:30:26.435 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-14T18:30:26.436 DEBUG:teuthology.orchestra.run.smithi163:> sudo ip link delete ceph-brx 2023-07-14T18:30:26.547 DEBUG:teuthology.run_tasks:Unwinding manager cephadm 2023-07-14T18:30:26.557 INFO:tasks.cephadm:Teardown begin 2023-07-14T18:30:26.558 ERROR:teuthology.contextutil:Saw exception from nested tasks Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_aa6a80e6cc655fff48452a7eca02070e61d074fc/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/git.ceph.com_ceph-c_81c9387d2e7576da065747ec9c16d1c7d69016ec/qa/tasks/cephadm.py", line 1677, in task yield File "/home/teuthworker/src/git.ceph.com_teuthology_aa6a80e6cc655fff48452a7eca02070e61d074fc/teuthology/run_tasks.py", line 192, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_81c9387d2e7576da065747ec9c16d1c7d69016ec/qa/tasks/fwd_scrub.py", line 164, in task stop_all_fwd_scrubbers(ctx.ceph[config['cluster']].thrashers) File "/home/teuthworker/src/git.ceph.com_ceph-c_81c9387d2e7576da065747ec9c16d1c7d69016ec/qa/tasks/fwd_scrub.py", line 99, in stop_all_fwd_scrubbers raise RuntimeError(f"error during scrub thrashing: {thrasher.exception}") RuntimeError: error during scrub thrashing: reached maximum tries (31) after waiting for 900 seconds 2023-07-14T18:30:26.562 DEBUG:teuthology.orchestra.run.smithi163:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2023-07-14T18:30:26.592 DEBUG:teuthology.orchestra.run.smithi172:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2023-07-14T18:30:26.867 DEBUG:teuthology.orchestra.run.smithi184:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2023-07-14T18:30:26.920 INFO:tasks.cephadm:Cleaning up testdir ceph.* files... 2023-07-14T18:30:26.920 DEBUG:teuthology.orchestra.run.smithi163:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2023-07-14T18:30:26.938 DEBUG:teuthology.orchestra.run.smithi172:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2023-07-14T18:30:27.014 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:30:26 smithi172 ceph-mon[97983]: pgmap v833: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 1.7 KiB/s wr, 11 op/s 2023-07-14T18:30:27.073 DEBUG:teuthology.orchestra.run.smithi184:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2023-07-14T18:30:27.110 INFO:tasks.cephadm:Stopping all daemons... 2023-07-14T18:30:27.111 INFO:tasks.cephadm.mon.a:Stopping mon.a... 2023-07-14T18:30:27.111 DEBUG:teuthology.orchestra.run.smithi163:> sudo systemctl stop ceph-bf7326ec-2270-11ee-9b33-001a4aab830c@mon.a 2023-07-14T18:30:27.137 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:30:26 smithi163 ceph-mon[96576]: pgmap v833: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 1.7 KiB/s wr, 11 op/s 2023-07-14T18:30:27.163 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:30:26 smithi184 ceph-mon[98481]: pgmap v833: 129 pgs: 129 active+clean; 128 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 1.7 KiB/s wr, 11 op/s 2023-07-14T18:30:27.456 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:30:27 smithi163 systemd[1]: Stopping Ceph mon.a for bf7326ec-2270-11ee-9b33-001a4aab830c... 2023-07-14T18:30:27.815 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:30:27 smithi163 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-mon-a[96552]: 2023-07-14T18:30:27.487+0000 7f3bd78b3700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2023-07-14T18:30:27.816 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:30:27 smithi163 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-mon-a[96552]: 2023-07-14T18:30:27.487+0000 7f3bd78b3700 -1 mon.a@0(leader) e3 *** Got Signal Terminated *** 2023-07-14T18:30:28.054 DEBUG:teuthology.orchestra.run.smithi163:> sudo pkill -f 'journalctl -f -n 0 -u ceph-bf7326ec-2270-11ee-9b33-001a4aab830c@mon.a.service' 2023-07-14T18:30:28.123 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:30:27 smithi163 bash[173463]: ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-mon-a 2023-07-14T18:30:28.124 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:30:28 smithi163 systemd[1]: ceph-bf7326ec-2270-11ee-9b33-001a4aab830c@mon.a.service: Succeeded. 2023-07-14T18:30:28.124 INFO:journalctl@ceph.mon.a.smithi163.stdout:Jul 14 18:30:28 smithi163 systemd[1]: Stopped Ceph mon.a for bf7326ec-2270-11ee-9b33-001a4aab830c. 2023-07-14T18:30:28.154 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-07-14T18:30:28.154 INFO:tasks.cephadm.mon.a:Stopped mon.a 2023-07-14T18:30:28.155 INFO:tasks.cephadm.mon.c:Stopping mon.b... 2023-07-14T18:30:28.155 DEBUG:teuthology.orchestra.run.smithi172:> sudo systemctl stop ceph-bf7326ec-2270-11ee-9b33-001a4aab830c@mon.b 2023-07-14T18:30:28.515 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:30:28 smithi172 systemd[1]: Stopping Ceph mon.b for bf7326ec-2270-11ee-9b33-001a4aab830c... 2023-07-14T18:30:29.014 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:30:28 smithi172 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-mon-b[97959]: 2023-07-14T18:30:28.656+0000 7f18185af700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-mon -n mon.b -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2023-07-14T18:30:29.015 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:30:28 smithi172 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-mon-b[97959]: 2023-07-14T18:30:28.656+0000 7f18185af700 -1 mon.b@2(peon) e3 *** Got Signal Terminated *** 2023-07-14T18:30:29.412 INFO:journalctl@ceph.mon.b.smithi172.stdout:Jul 14 18:30:29 smithi172 bash[128916]: ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-mon-b 2023-07-14T18:30:29.420 DEBUG:teuthology.orchestra.run.smithi172:> sudo pkill -f 'journalctl -f -n 0 -u ceph-bf7326ec-2270-11ee-9b33-001a4aab830c@mon.b.service' 2023-07-14T18:30:29.471 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-07-14T18:30:29.472 INFO:tasks.cephadm.mon.c:Stopped mon.b 2023-07-14T18:30:29.472 INFO:tasks.cephadm.mon.c:Stopping mon.c... 2023-07-14T18:30:29.473 DEBUG:teuthology.orchestra.run.smithi184:> sudo systemctl stop ceph-bf7326ec-2270-11ee-9b33-001a4aab830c@mon.c 2023-07-14T18:30:29.913 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:30:29 smithi184 systemd[1]: Stopping Ceph mon.c for bf7326ec-2270-11ee-9b33-001a4aab830c... 2023-07-14T18:30:30.414 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:30:30 smithi184 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-mon-c[98454]: 2023-07-14T18:30:30.007+0000 7f4308757700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-mon -n mon.c -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2023-07-14T18:30:30.414 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:30:30 smithi184 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-mon-c[98454]: 2023-07-14T18:30:30.007+0000 7f4308757700 -1 mon.c@1(peon) e3 *** Got Signal Terminated *** 2023-07-14T18:30:30.913 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jul 14 18:30:30 smithi184 bash[130428]: ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-mon-c 2023-07-14T18:30:30.933 DEBUG:teuthology.orchestra.run.smithi184:> sudo pkill -f 'journalctl -f -n 0 -u ceph-bf7326ec-2270-11ee-9b33-001a4aab830c@mon.c.service' 2023-07-14T18:30:31.009 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-07-14T18:30:31.010 INFO:tasks.cephadm.mon.c:Stopped mon.c 2023-07-14T18:30:31.010 INFO:tasks.cephadm.mgr.x:Stopping mgr.x... 2023-07-14T18:30:31.011 DEBUG:teuthology.orchestra.run.smithi163:> sudo systemctl stop ceph-bf7326ec-2270-11ee-9b33-001a4aab830c@mgr.x 2023-07-14T18:30:31.384 INFO:journalctl@ceph.mgr.x.smithi163.stdout:Jul 14 18:30:31 smithi163 systemd[1]: Stopping Ceph mgr.x for bf7326ec-2270-11ee-9b33-001a4aab830c... 2023-07-14T18:30:31.385 INFO:journalctl@ceph.mgr.x.smithi163.stdout:Jul 14 18:30:31 smithi163 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-mgr-x[96818]: 2023-07-14T18:30:31.354+0000 7fdfbac10700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-mgr -n mgr.x -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-07-14T18:30:31.385 INFO:journalctl@ceph.mgr.x.smithi163.stdout:Jul 14 18:30:31 smithi163 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-mgr-x[96818]: 2023-07-14T18:30:31.354+0000 7fdfbac10700 -1 mgr handle_mgr_signal *** Got signal Terminated *** 2023-07-14T18:30:31.939 INFO:journalctl@ceph.mgr.x.smithi163.stdout:Jul 14 18:30:31 smithi163 bash[173600]: ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-mgr-x 2023-07-14T18:30:31.947 DEBUG:teuthology.orchestra.run.smithi163:> sudo pkill -f 'journalctl -f -n 0 -u ceph-bf7326ec-2270-11ee-9b33-001a4aab830c@mgr.x.service' 2023-07-14T18:30:31.989 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-07-14T18:30:31.990 INFO:tasks.cephadm.mgr.x:Stopped mgr.x 2023-07-14T18:30:31.991 INFO:tasks.cephadm.mgr.y:Stopping mgr.y... 2023-07-14T18:30:31.991 DEBUG:teuthology.orchestra.run.smithi172:> sudo systemctl stop ceph-bf7326ec-2270-11ee-9b33-001a4aab830c@mgr.y 2023-07-14T18:30:32.514 INFO:journalctl@ceph.mgr.y.smithi172.stdout:Jul 14 18:30:31 smithi172 systemd[1]: Stopping Ceph mgr.y for bf7326ec-2270-11ee-9b33-001a4aab830c... 2023-07-14T18:30:35.249 INFO:journalctl@ceph.mgr.y.smithi172.stdout:Jul 14 18:30:34 smithi172 bash[129070]: ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-mgr-y 2023-07-14T18:30:35.249 INFO:journalctl@ceph.mgr.y.smithi172.stdout:Jul 14 18:30:34 smithi172 systemd[1]: ceph-bf7326ec-2270-11ee-9b33-001a4aab830c@mgr.y.service: Main process exited, code=exited, status=143/n/a 2023-07-14T18:30:35.257 DEBUG:teuthology.orchestra.run.smithi172:> sudo pkill -f 'journalctl -f -n 0 -u ceph-bf7326ec-2270-11ee-9b33-001a4aab830c@mgr.y.service' 2023-07-14T18:30:35.308 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-07-14T18:30:35.309 INFO:tasks.cephadm.mgr.y:Stopped mgr.y 2023-07-14T18:30:35.309 INFO:tasks.cephadm.mgr.z:Stopping mgr.z... 2023-07-14T18:30:35.310 DEBUG:teuthology.orchestra.run.smithi184:> sudo systemctl stop ceph-bf7326ec-2270-11ee-9b33-001a4aab830c@mgr.z 2023-07-14T18:30:35.665 INFO:journalctl@ceph.mgr.z.smithi184.stdout:Jul 14 18:30:35 smithi184 systemd[1]: Stopping Ceph mgr.z for bf7326ec-2270-11ee-9b33-001a4aab830c... 2023-07-14T18:30:39.880 INFO:journalctl@ceph.mgr.z.smithi184.stdout:Jul 14 18:30:39 smithi184 bash[130580]: ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-mgr-z 2023-07-14T18:30:39.881 INFO:journalctl@ceph.mgr.z.smithi184.stdout:Jul 14 18:30:39 smithi184 systemd[1]: ceph-bf7326ec-2270-11ee-9b33-001a4aab830c@mgr.z.service: Main process exited, code=exited, status=143/n/a 2023-07-14T18:30:39.887 DEBUG:teuthology.orchestra.run.smithi184:> sudo pkill -f 'journalctl -f -n 0 -u ceph-bf7326ec-2270-11ee-9b33-001a4aab830c@mgr.z.service' 2023-07-14T18:30:39.924 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-07-14T18:30:39.925 INFO:tasks.cephadm.mgr.z:Stopped mgr.z 2023-07-14T18:30:39.925 INFO:tasks.cephadm.osd.0:Stopping osd.0... 2023-07-14T18:30:39.926 DEBUG:teuthology.orchestra.run.smithi163:> sudo systemctl stop ceph-bf7326ec-2270-11ee-9b33-001a4aab830c@osd.0 2023-07-14T18:30:40.206 INFO:journalctl@ceph.osd.0.smithi163.stdout:Jul 14 18:30:39 smithi163 systemd[1]: Stopping Ceph osd.0 for bf7326ec-2270-11ee-9b33-001a4aab830c... 2023-07-14T18:30:40.705 INFO:journalctl@ceph.osd.0.smithi163.stdout:Jul 14 18:30:40 smithi163 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-0[109611]: 2023-07-14T18:30:40.243+0000 7f1978d50700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-osd -n osd.0 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-07-14T18:30:40.706 INFO:journalctl@ceph.osd.0.smithi163.stdout:Jul 14 18:30:40 smithi163 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-0[109611]: 2023-07-14T18:30:40.243+0000 7f1978d50700 -1 osd.0 88 *** Got signal Terminated *** 2023-07-14T18:30:40.706 INFO:journalctl@ceph.osd.0.smithi163.stdout:Jul 14 18:30:40 smithi163 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-0[109611]: 2023-07-14T18:30:40.243+0000 7f1978d50700 -1 osd.0 88 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-07-14T18:30:46.050 INFO:journalctl@ceph.osd.0.smithi163.stdout:Jul 14 18:30:45 smithi163 bash[173751]: ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-0 2023-07-14T18:30:47.920 DEBUG:teuthology.orchestra.run.smithi163:> sudo pkill -f 'journalctl -f -n 0 -u ceph-bf7326ec-2270-11ee-9b33-001a4aab830c@osd.0.service' 2023-07-14T18:30:47.962 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-07-14T18:30:47.962 INFO:tasks.cephadm.osd.0:Stopped osd.0 2023-07-14T18:30:47.963 INFO:tasks.cephadm.osd.1:Stopping osd.1... 2023-07-14T18:30:47.963 DEBUG:teuthology.orchestra.run.smithi172:> sudo systemctl stop ceph-bf7326ec-2270-11ee-9b33-001a4aab830c@osd.1 2023-07-14T18:30:48.263 INFO:journalctl@ceph.osd.1.smithi172.stdout:Jul 14 18:30:47 smithi172 systemd[1]: Stopping Ceph osd.1 for bf7326ec-2270-11ee-9b33-001a4aab830c... 2023-07-14T18:30:48.763 INFO:journalctl@ceph.osd.1.smithi172.stdout:Jul 14 18:30:48 smithi172 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-1[102969]: 2023-07-14T18:30:48.300+0000 7f0d5ed82700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-osd -n osd.1 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-07-14T18:30:48.764 INFO:journalctl@ceph.osd.1.smithi172.stdout:Jul 14 18:30:48 smithi172 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-1[102969]: 2023-07-14T18:30:48.300+0000 7f0d5ed82700 -1 osd.1 88 *** Got signal Terminated *** 2023-07-14T18:30:48.764 INFO:journalctl@ceph.osd.1.smithi172.stdout:Jul 14 18:30:48 smithi172 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-1[102969]: 2023-07-14T18:30:48.300+0000 7f0d5ed82700 -1 osd.1 88 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-07-14T18:30:54.101 INFO:journalctl@ceph.osd.1.smithi172.stdout:Jul 14 18:30:53 smithi172 bash[129216]: ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-1 2023-07-14T18:30:55.365 DEBUG:teuthology.orchestra.run.smithi172:> sudo pkill -f 'journalctl -f -n 0 -u ceph-bf7326ec-2270-11ee-9b33-001a4aab830c@osd.1.service' 2023-07-14T18:30:55.405 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-07-14T18:30:55.406 INFO:tasks.cephadm.osd.1:Stopped osd.1 2023-07-14T18:30:55.407 INFO:tasks.cephadm.osd.2:Stopping osd.2... 2023-07-14T18:30:55.407 DEBUG:teuthology.orchestra.run.smithi184:> sudo systemctl stop ceph-bf7326ec-2270-11ee-9b33-001a4aab830c@osd.2 2023-07-14T18:30:55.777 INFO:journalctl@ceph.osd.2.smithi184.stdout:Jul 14 18:30:55 smithi184 systemd[1]: Stopping Ceph osd.2 for bf7326ec-2270-11ee-9b33-001a4aab830c... 2023-07-14T18:30:56.162 INFO:journalctl@ceph.osd.2.smithi184.stdout:Jul 14 18:30:55 smithi184 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-2[104293]: 2023-07-14T18:30:55.747+0000 7f0df1615700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-osd -n osd.2 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-07-14T18:30:56.163 INFO:journalctl@ceph.osd.2.smithi184.stdout:Jul 14 18:30:55 smithi184 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-2[104293]: 2023-07-14T18:30:55.747+0000 7f0df1615700 -1 osd.2 88 *** Got signal Terminated *** 2023-07-14T18:30:56.163 INFO:journalctl@ceph.osd.2.smithi184.stdout:Jul 14 18:30:55 smithi184 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-2[104293]: 2023-07-14T18:30:55.747+0000 7f0df1615700 -1 osd.2 88 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-07-14T18:31:01.662 INFO:journalctl@ceph.osd.2.smithi184.stdout:Jul 14 18:31:01 smithi184 bash[130734]: ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-2 2023-07-14T18:31:03.116 DEBUG:teuthology.orchestra.run.smithi184:> sudo pkill -f 'journalctl -f -n 0 -u ceph-bf7326ec-2270-11ee-9b33-001a4aab830c@osd.2.service' 2023-07-14T18:31:03.157 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-07-14T18:31:03.158 INFO:tasks.cephadm.osd.2:Stopped osd.2 2023-07-14T18:31:03.159 INFO:tasks.cephadm.osd.3:Stopping osd.3... 2023-07-14T18:31:03.160 DEBUG:teuthology.orchestra.run.smithi163:> sudo systemctl stop ceph-bf7326ec-2270-11ee-9b33-001a4aab830c@osd.3 2023-07-14T18:31:03.455 INFO:journalctl@ceph.osd.3.smithi163.stdout:Jul 14 18:31:03 smithi163 systemd[1]: Stopping Ceph osd.3 for bf7326ec-2270-11ee-9b33-001a4aab830c... 2023-07-14T18:31:03.954 INFO:journalctl@ceph.osd.3.smithi163.stdout:Jul 14 18:31:03 smithi163 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-3[114961]: 2023-07-14T18:31:03.532+0000 7f91cba35700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-osd -n osd.3 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-07-14T18:31:03.955 INFO:journalctl@ceph.osd.3.smithi163.stdout:Jul 14 18:31:03 smithi163 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-3[114961]: 2023-07-14T18:31:03.532+0000 7f91cba35700 -1 osd.3 88 *** Got signal Terminated *** 2023-07-14T18:31:03.955 INFO:journalctl@ceph.osd.3.smithi163.stdout:Jul 14 18:31:03 smithi163 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-3[114961]: 2023-07-14T18:31:03.532+0000 7f91cba35700 -1 osd.3 88 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-07-14T18:31:06.454 INFO:journalctl@ceph.osd.3.smithi163.stdout:Jul 14 18:31:06 smithi163 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-3[114961]: 2023-07-14T18:31:06.047+0000 7f91c6028700 -1 osd.3 88 heartbeat_check: no reply from 172.21.15.163:6806 osd.0 since back 2023-07-14T18:30:41.077196+0000 front 2023-07-14T18:30:41.077296+0000 (oldest deadline 2023-07-14T18:31:05.777459+0000) 2023-07-14T18:31:07.262 INFO:journalctl@ceph.osd.10.smithi172.stdout:Jul 14 18:31:06 smithi172 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-10[119489]: 2023-07-14T18:31:06.753+0000 7fe8a6017700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.163:6806 osd.0 since back 2023-07-14T18:30:44.219658+0000 front 2023-07-14T18:30:44.219740+0000 (oldest deadline 2023-07-14T18:31:05.919624+0000) 2023-07-14T18:31:07.422 INFO:journalctl@ceph.osd.3.smithi163.stdout:Jul 14 18:31:07 smithi163 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-3[114961]: 2023-07-14T18:31:07.035+0000 7f91c6028700 -1 osd.3 88 heartbeat_check: no reply from 172.21.15.163:6806 osd.0 since back 2023-07-14T18:30:41.077196+0000 front 2023-07-14T18:30:41.077296+0000 (oldest deadline 2023-07-14T18:31:05.777459+0000) 2023-07-14T18:31:08.012 INFO:journalctl@ceph.osd.10.smithi172.stdout:Jul 14 18:31:07 smithi172 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-10[119489]: 2023-07-14T18:31:07.722+0000 7fe8a6017700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.163:6806 osd.0 since back 2023-07-14T18:30:44.219658+0000 front 2023-07-14T18:30:44.219740+0000 (oldest deadline 2023-07-14T18:31:05.919624+0000) 2023-07-14T18:31:08.272 INFO:journalctl@ceph.osd.5.smithi184.stdout:Jul 14 18:31:07 smithi184 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-5[109831]: 2023-07-14T18:31:07.924+0000 7f8b50395700 -1 osd.5 88 heartbeat_check: no reply from 172.21.15.163:6806 osd.0 since back 2023-07-14T18:30:41.961731+0000 front 2023-07-14T18:30:41.961630+0000 (oldest deadline 2023-07-14T18:31:07.261616+0000) 2023-07-14T18:31:08.454 INFO:journalctl@ceph.osd.3.smithi163.stdout:Jul 14 18:31:08 smithi163 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-3[114961]: 2023-07-14T18:31:08.067+0000 7f91c6028700 -1 osd.3 88 heartbeat_check: no reply from 172.21.15.163:6806 osd.0 since back 2023-07-14T18:30:41.077196+0000 front 2023-07-14T18:30:41.077296+0000 (oldest deadline 2023-07-14T18:31:05.777459+0000) 2023-07-14T18:31:08.455 INFO:journalctl@ceph.osd.6.smithi163.stdout:Jul 14 18:31:08 smithi163 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-6[120359]: 2023-07-14T18:31:08.088+0000 7fc691297700 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.163:6806 osd.0 since back 2023-07-14T18:30:41.324204+0000 front 2023-07-14T18:30:41.324276+0000 (oldest deadline 2023-07-14T18:31:07.224382+0000) 2023-07-14T18:31:08.662 INFO:journalctl@ceph.osd.8.smithi184.stdout:Jul 14 18:31:08 smithi184 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-8[115280]: 2023-07-14T18:31:08.245+0000 7fa897e34700 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.163:6806 osd.0 since back 2023-07-14T18:30:44.909156+0000 front 2023-07-14T18:30:44.908950+0000 (oldest deadline 2023-07-14T18:31:07.809102+0000) 2023-07-14T18:31:08.954 INFO:journalctl@ceph.osd.9.smithi163.stdout:Jul 14 18:31:08 smithi163 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-9[125814]: 2023-07-14T18:31:08.593+0000 7fd0759f3700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.163:6806 osd.0 since back 2023-07-14T18:30:42.661073+0000 front 2023-07-14T18:30:42.661052+0000 (oldest deadline 2023-07-14T18:31:07.961309+0000) 2023-07-14T18:31:09.262 INFO:journalctl@ceph.osd.10.smithi172.stdout:Jul 14 18:31:08 smithi172 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-10[119489]: 2023-07-14T18:31:08.755+0000 7fe8a6017700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.163:6806 osd.0 since back 2023-07-14T18:30:44.219658+0000 front 2023-07-14T18:30:44.219740+0000 (oldest deadline 2023-07-14T18:31:05.919624+0000) 2023-07-14T18:31:09.315 INFO:journalctl@ceph.osd.5.smithi184.stdout:Jul 14 18:31:08 smithi184 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-5[109831]: 2023-07-14T18:31:08.953+0000 7f8b50395700 -1 osd.5 88 heartbeat_check: no reply from 172.21.15.163:6806 osd.0 since back 2023-07-14T18:30:41.961731+0000 front 2023-07-14T18:30:41.961630+0000 (oldest deadline 2023-07-14T18:31:07.261616+0000) 2023-07-14T18:31:09.454 INFO:journalctl@ceph.osd.3.smithi163.stdout:Jul 14 18:31:09 smithi163 bash[174040]: ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-3 2023-07-14T18:31:09.455 INFO:journalctl@ceph.osd.6.smithi163.stdout:Jul 14 18:31:09 smithi163 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-6[120359]: 2023-07-14T18:31:09.083+0000 7fc691297700 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.163:6806 osd.0 since back 2023-07-14T18:30:41.324204+0000 front 2023-07-14T18:30:41.324276+0000 (oldest deadline 2023-07-14T18:31:07.224382+0000) 2023-07-14T18:31:09.662 INFO:journalctl@ceph.osd.8.smithi184.stdout:Jul 14 18:31:09 smithi184 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-8[115280]: 2023-07-14T18:31:09.288+0000 7fa897e34700 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.163:6806 osd.0 since back 2023-07-14T18:30:44.909156+0000 front 2023-07-14T18:30:44.908950+0000 (oldest deadline 2023-07-14T18:31:07.809102+0000) 2023-07-14T18:31:09.662 INFO:journalctl@ceph.osd.11.smithi184.stdout:Jul 14 18:31:09 smithi184 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-11[120819]: 2023-07-14T18:31:09.504+0000 7f44dbfe8700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.163:6806 osd.0 since back 2023-07-14T18:30:42.566533+0000 front 2023-07-14T18:30:42.566680+0000 (oldest deadline 2023-07-14T18:31:08.967162+0000) 2023-07-14T18:31:09.863 INFO:journalctl@ceph.osd.9.smithi163.stdout:Jul 14 18:31:09 smithi163 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-9[125814]: 2023-07-14T18:31:09.571+0000 7fd0759f3700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.163:6806 osd.0 since back 2023-07-14T18:30:42.661073+0000 front 2023-07-14T18:30:42.661052+0000 (oldest deadline 2023-07-14T18:31:07.961309+0000) 2023-07-14T18:31:10.263 INFO:journalctl@ceph.osd.10.smithi172.stdout:Jul 14 18:31:09 smithi172 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-10[119489]: 2023-07-14T18:31:09.785+0000 7fe8a6017700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.163:6806 osd.0 since back 2023-07-14T18:30:44.219658+0000 front 2023-07-14T18:30:44.219740+0000 (oldest deadline 2023-07-14T18:31:05.919624+0000) 2023-07-14T18:31:10.356 INFO:journalctl@ceph.osd.5.smithi184.stdout:Jul 14 18:31:09 smithi184 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-5[109831]: 2023-07-14T18:31:09.944+0000 7f8b50395700 -1 osd.5 88 heartbeat_check: no reply from 172.21.15.163:6806 osd.0 since back 2023-07-14T18:30:41.961731+0000 front 2023-07-14T18:30:41.961630+0000 (oldest deadline 2023-07-14T18:31:07.261616+0000) 2023-07-14T18:31:10.454 INFO:journalctl@ceph.osd.6.smithi163.stdout:Jul 14 18:31:10 smithi163 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-6[120359]: 2023-07-14T18:31:10.132+0000 7fc691297700 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.163:6806 osd.0 since back 2023-07-14T18:30:41.324204+0000 front 2023-07-14T18:30:41.324276+0000 (oldest deadline 2023-07-14T18:31:07.224382+0000) 2023-07-14T18:31:10.651 DEBUG:teuthology.orchestra.run.smithi163:> sudo pkill -f 'journalctl -f -n 0 -u ceph-bf7326ec-2270-11ee-9b33-001a4aab830c@osd.3.service' 2023-07-14T18:31:10.662 INFO:journalctl@ceph.osd.8.smithi184.stdout:Jul 14 18:31:10 smithi184 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-8[115280]: 2023-07-14T18:31:10.329+0000 7fa897e34700 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.163:6806 osd.0 since back 2023-07-14T18:30:44.909156+0000 front 2023-07-14T18:30:44.908950+0000 (oldest deadline 2023-07-14T18:31:07.809102+0000) 2023-07-14T18:31:10.662 INFO:journalctl@ceph.osd.11.smithi184.stdout:Jul 14 18:31:10 smithi184 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-11[120819]: 2023-07-14T18:31:10.507+0000 7f44dbfe8700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.163:6806 osd.0 since back 2023-07-14T18:30:42.566533+0000 front 2023-07-14T18:30:42.566680+0000 (oldest deadline 2023-07-14T18:31:08.967162+0000) 2023-07-14T18:31:10.693 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-07-14T18:31:10.694 INFO:tasks.cephadm.osd.3:Stopped osd.3 2023-07-14T18:31:10.694 INFO:tasks.cephadm.osd.4:Stopping osd.4... 2023-07-14T18:31:10.695 DEBUG:teuthology.orchestra.run.smithi172:> sudo systemctl stop ceph-bf7326ec-2270-11ee-9b33-001a4aab830c@osd.4 2023-07-14T18:31:10.954 INFO:journalctl@ceph.osd.9.smithi163.stdout:Jul 14 18:31:10 smithi163 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-9[125814]: 2023-07-14T18:31:10.531+0000 7fd0759f3700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.163:6806 osd.0 since back 2023-07-14T18:30:42.661073+0000 front 2023-07-14T18:30:42.661052+0000 (oldest deadline 2023-07-14T18:31:07.961309+0000) 2023-07-14T18:31:11.012 INFO:journalctl@ceph.osd.4.smithi172.stdout:Jul 14 18:31:10 smithi172 systemd[1]: Stopping Ceph osd.4 for bf7326ec-2270-11ee-9b33-001a4aab830c... 2023-07-14T18:31:11.013 INFO:journalctl@ceph.osd.10.smithi172.stdout:Jul 14 18:31:10 smithi172 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-10[119489]: 2023-07-14T18:31:10.796+0000 7fe8a6017700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.163:6806 osd.0 since back 2023-07-14T18:30:44.219658+0000 front 2023-07-14T18:30:44.219740+0000 (oldest deadline 2023-07-14T18:31:05.919624+0000) 2023-07-14T18:31:11.370 INFO:journalctl@ceph.osd.5.smithi184.stdout:Jul 14 18:31:10 smithi184 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-5[109831]: 2023-07-14T18:31:10.962+0000 7f8b50395700 -1 osd.5 88 heartbeat_check: no reply from 172.21.15.163:6806 osd.0 since back 2023-07-14T18:30:41.961731+0000 front 2023-07-14T18:30:41.961630+0000 (oldest deadline 2023-07-14T18:31:07.261616+0000) 2023-07-14T18:31:11.454 INFO:journalctl@ceph.osd.6.smithi163.stdout:Jul 14 18:31:11 smithi163 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-6[120359]: 2023-07-14T18:31:11.151+0000 7fc691297700 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.163:6806 osd.0 since back 2023-07-14T18:30:41.324204+0000 front 2023-07-14T18:30:41.324276+0000 (oldest deadline 2023-07-14T18:31:07.224382+0000) 2023-07-14T18:31:11.512 INFO:journalctl@ceph.osd.4.smithi172.stdout:Jul 14 18:31:11 smithi172 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-4[108488]: 2023-07-14T18:31:11.055+0000 7f9f16b8e700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-osd -n osd.4 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-07-14T18:31:11.513 INFO:journalctl@ceph.osd.4.smithi172.stdout:Jul 14 18:31:11 smithi172 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-4[108488]: 2023-07-14T18:31:11.055+0000 7f9f16b8e700 -1 osd.4 88 *** Got signal Terminated *** 2023-07-14T18:31:11.513 INFO:journalctl@ceph.osd.4.smithi172.stdout:Jul 14 18:31:11 smithi172 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-4[108488]: 2023-07-14T18:31:11.055+0000 7f9f16b8e700 -1 osd.4 88 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-07-14T18:31:11.662 INFO:journalctl@ceph.osd.8.smithi184.stdout:Jul 14 18:31:11 smithi184 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-8[115280]: 2023-07-14T18:31:11.343+0000 7fa897e34700 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.163:6806 osd.0 since back 2023-07-14T18:30:44.909156+0000 front 2023-07-14T18:30:44.908950+0000 (oldest deadline 2023-07-14T18:31:07.809102+0000) 2023-07-14T18:31:11.663 INFO:journalctl@ceph.osd.11.smithi184.stdout:Jul 14 18:31:11 smithi184 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-11[120819]: 2023-07-14T18:31:11.534+0000 7f44dbfe8700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.163:6806 osd.0 since back 2023-07-14T18:30:42.566533+0000 front 2023-07-14T18:30:42.566680+0000 (oldest deadline 2023-07-14T18:31:08.967162+0000) 2023-07-14T18:31:11.954 INFO:journalctl@ceph.osd.9.smithi163.stdout:Jul 14 18:31:11 smithi163 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-9[125814]: 2023-07-14T18:31:11.521+0000 7fd0759f3700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.163:6806 osd.0 since back 2023-07-14T18:30:42.661073+0000 front 2023-07-14T18:30:42.661052+0000 (oldest deadline 2023-07-14T18:31:07.961309+0000) 2023-07-14T18:31:12.262 INFO:journalctl@ceph.osd.10.smithi172.stdout:Jul 14 18:31:11 smithi172 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-10[119489]: 2023-07-14T18:31:11.843+0000 7fe8a6017700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.163:6806 osd.0 since back 2023-07-14T18:30:44.219658+0000 front 2023-07-14T18:30:44.219740+0000 (oldest deadline 2023-07-14T18:31:05.919624+0000) 2023-07-14T18:31:12.378 INFO:journalctl@ceph.osd.5.smithi184.stdout:Jul 14 18:31:12 smithi184 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-5[109831]: 2023-07-14T18:31:12.011+0000 7f8b50395700 -1 osd.5 88 heartbeat_check: no reply from 172.21.15.163:6806 osd.0 since back 2023-07-14T18:30:41.961731+0000 front 2023-07-14T18:30:41.961630+0000 (oldest deadline 2023-07-14T18:31:07.261616+0000) 2023-07-14T18:31:12.454 INFO:journalctl@ceph.osd.6.smithi163.stdout:Jul 14 18:31:12 smithi163 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-6[120359]: 2023-07-14T18:31:12.172+0000 7fc691297700 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.163:6806 osd.0 since back 2023-07-14T18:30:41.324204+0000 front 2023-07-14T18:30:41.324276+0000 (oldest deadline 2023-07-14T18:31:07.224382+0000) 2023-07-14T18:31:12.662 INFO:journalctl@ceph.osd.8.smithi184.stdout:Jul 14 18:31:12 smithi184 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-8[115280]: 2023-07-14T18:31:12.351+0000 7fa897e34700 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.163:6806 osd.0 since back 2023-07-14T18:30:44.909156+0000 front 2023-07-14T18:30:44.908950+0000 (oldest deadline 2023-07-14T18:31:07.809102+0000) 2023-07-14T18:31:12.662 INFO:journalctl@ceph.osd.11.smithi184.stdout:Jul 14 18:31:12 smithi184 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-11[120819]: 2023-07-14T18:31:12.544+0000 7f44dbfe8700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.163:6806 osd.0 since back 2023-07-14T18:30:42.566533+0000 front 2023-07-14T18:30:42.566680+0000 (oldest deadline 2023-07-14T18:31:08.967162+0000) 2023-07-14T18:31:12.954 INFO:journalctl@ceph.osd.9.smithi163.stdout:Jul 14 18:31:12 smithi163 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-9[125814]: 2023-07-14T18:31:12.560+0000 7fd0759f3700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.163:6806 osd.0 since back 2023-07-14T18:30:42.661073+0000 front 2023-07-14T18:30:42.661052+0000 (oldest deadline 2023-07-14T18:31:07.961309+0000) 2023-07-14T18:31:13.262 INFO:journalctl@ceph.osd.10.smithi172.stdout:Jul 14 18:31:12 smithi172 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-10[119489]: 2023-07-14T18:31:12.811+0000 7fe8a6017700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.163:6806 osd.0 since back 2023-07-14T18:30:44.219658+0000 front 2023-07-14T18:30:44.219740+0000 (oldest deadline 2023-07-14T18:31:05.919624+0000) 2023-07-14T18:31:13.364 INFO:journalctl@ceph.osd.5.smithi184.stdout:Jul 14 18:31:13 smithi184 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-5[109831]: 2023-07-14T18:31:13.030+0000 7f8b50395700 -1 osd.5 88 heartbeat_check: no reply from 172.21.15.163:6806 osd.0 since back 2023-07-14T18:30:41.961731+0000 front 2023-07-14T18:30:41.961630+0000 (oldest deadline 2023-07-14T18:31:07.261616+0000) 2023-07-14T18:31:13.454 INFO:journalctl@ceph.osd.6.smithi163.stdout:Jul 14 18:31:13 smithi163 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-6[120359]: 2023-07-14T18:31:13.144+0000 7fc691297700 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.163:6806 osd.0 since back 2023-07-14T18:30:41.324204+0000 front 2023-07-14T18:30:41.324276+0000 (oldest deadline 2023-07-14T18:31:07.224382+0000) 2023-07-14T18:31:13.661 INFO:journalctl@ceph.osd.8.smithi184.stdout:Jul 14 18:31:13 smithi184 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-8[115280]: 2023-07-14T18:31:13.337+0000 7fa897e34700 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.163:6806 osd.0 since back 2023-07-14T18:30:44.909156+0000 front 2023-07-14T18:30:44.908950+0000 (oldest deadline 2023-07-14T18:31:07.809102+0000) 2023-07-14T18:31:13.662 INFO:journalctl@ceph.osd.11.smithi184.stdout:Jul 14 18:31:13 smithi184 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-11[120819]: 2023-07-14T18:31:13.585+0000 7f44dbfe8700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.163:6806 osd.0 since back 2023-07-14T18:30:42.566533+0000 front 2023-07-14T18:30:42.566680+0000 (oldest deadline 2023-07-14T18:31:08.967162+0000) 2023-07-14T18:31:13.954 INFO:journalctl@ceph.osd.9.smithi163.stdout:Jul 14 18:31:13 smithi163 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-9[125814]: 2023-07-14T18:31:13.577+0000 7fd0759f3700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.163:6806 osd.0 since back 2023-07-14T18:30:42.661073+0000 front 2023-07-14T18:30:42.661052+0000 (oldest deadline 2023-07-14T18:31:07.961309+0000) 2023-07-14T18:31:14.262 INFO:journalctl@ceph.osd.10.smithi172.stdout:Jul 14 18:31:13 smithi172 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-10[119489]: 2023-07-14T18:31:13.835+0000 7fe8a6017700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.163:6806 osd.0 since back 2023-07-14T18:30:44.219658+0000 front 2023-07-14T18:30:44.219740+0000 (oldest deadline 2023-07-14T18:31:05.919624+0000) 2023-07-14T18:31:14.345 INFO:journalctl@ceph.osd.5.smithi184.stdout:Jul 14 18:31:13 smithi184 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-5[109831]: 2023-07-14T18:31:13.981+0000 7f8b50395700 -1 osd.5 88 heartbeat_check: no reply from 172.21.15.163:6806 osd.0 since back 2023-07-14T18:30:41.961731+0000 front 2023-07-14T18:30:41.961630+0000 (oldest deadline 2023-07-14T18:31:07.261616+0000) 2023-07-14T18:31:14.560 INFO:journalctl@ceph.osd.6.smithi163.stdout:Jul 14 18:31:14 smithi163 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-6[120359]: 2023-07-14T18:31:14.187+0000 7fc691297700 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.163:6806 osd.0 since back 2023-07-14T18:30:41.324204+0000 front 2023-07-14T18:30:41.324276+0000 (oldest deadline 2023-07-14T18:31:07.224382+0000) 2023-07-14T18:31:14.561 INFO:journalctl@ceph.osd.6.smithi163.stdout:Jul 14 18:31:14 smithi163 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-6[120359]: 2023-07-14T18:31:14.187+0000 7fc691297700 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2023-07-14T18:30:52.326778+0000 front 2023-07-14T18:30:52.326716+0000 (oldest deadline 2023-07-14T18:31:14.026594+0000) 2023-07-14T18:31:14.626 INFO:journalctl@ceph.osd.8.smithi184.stdout:Jul 14 18:31:14 smithi184 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-8[115280]: 2023-07-14T18:31:14.318+0000 7fa897e34700 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.163:6806 osd.0 since back 2023-07-14T18:30:44.909156+0000 front 2023-07-14T18:30:44.908950+0000 (oldest deadline 2023-07-14T18:31:07.809102+0000) 2023-07-14T18:31:14.912 INFO:journalctl@ceph.osd.11.smithi184.stdout:Jul 14 18:31:14 smithi184 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-11[120819]: 2023-07-14T18:31:14.599+0000 7f44dbfe8700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.163:6806 osd.0 since back 2023-07-14T18:30:42.566533+0000 front 2023-07-14T18:30:42.566680+0000 (oldest deadline 2023-07-14T18:31:08.967162+0000) 2023-07-14T18:31:14.954 INFO:journalctl@ceph.osd.9.smithi163.stdout:Jul 14 18:31:14 smithi163 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-9[125814]: 2023-07-14T18:31:14.533+0000 7fd0759f3700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.163:6806 osd.0 since back 2023-07-14T18:30:42.661073+0000 front 2023-07-14T18:30:42.661052+0000 (oldest deadline 2023-07-14T18:31:07.961309+0000) 2023-07-14T18:31:14.955 INFO:journalctl@ceph.osd.9.smithi163.stdout:Jul 14 18:31:14 smithi163 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-9[125814]: 2023-07-14T18:31:14.533+0000 7fd0759f3700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2023-07-14T18:30:47.961848+0000 front 2023-07-14T18:30:47.961754+0000 (oldest deadline 2023-07-14T18:31:13.861824+0000) 2023-07-14T18:31:15.262 INFO:journalctl@ceph.osd.10.smithi172.stdout:Jul 14 18:31:14 smithi172 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-10[119489]: 2023-07-14T18:31:14.878+0000 7fe8a6017700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.163:6806 osd.0 since back 2023-07-14T18:30:44.219658+0000 front 2023-07-14T18:30:44.219740+0000 (oldest deadline 2023-07-14T18:31:05.919624+0000) 2023-07-14T18:31:15.263 INFO:journalctl@ceph.osd.10.smithi172.stdout:Jul 14 18:31:14 smithi172 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-10[119489]: 2023-07-14T18:31:14.878+0000 7fe8a6017700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2023-07-14T18:30:51.022066+0000 front 2023-07-14T18:30:51.022166+0000 (oldest deadline 2023-07-14T18:31:13.922245+0000) 2023-07-14T18:31:15.391 INFO:journalctl@ceph.osd.5.smithi184.stdout:Jul 14 18:31:14 smithi184 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-5[109831]: 2023-07-14T18:31:14.962+0000 7f8b50395700 -1 osd.5 88 heartbeat_check: no reply from 172.21.15.163:6806 osd.0 since back 2023-07-14T18:30:41.961731+0000 front 2023-07-14T18:30:41.961630+0000 (oldest deadline 2023-07-14T18:31:07.261616+0000) 2023-07-14T18:31:15.581 INFO:journalctl@ceph.osd.6.smithi163.stdout:Jul 14 18:31:15 smithi163 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-6[120359]: 2023-07-14T18:31:15.184+0000 7fc691297700 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.163:6806 osd.0 since back 2023-07-14T18:30:41.324204+0000 front 2023-07-14T18:30:41.324276+0000 (oldest deadline 2023-07-14T18:31:07.224382+0000) 2023-07-14T18:31:15.582 INFO:journalctl@ceph.osd.6.smithi163.stdout:Jul 14 18:31:15 smithi163 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-6[120359]: 2023-07-14T18:31:15.184+0000 7fc691297700 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2023-07-14T18:30:52.326778+0000 front 2023-07-14T18:30:52.326716+0000 (oldest deadline 2023-07-14T18:31:14.026594+0000) 2023-07-14T18:31:15.662 INFO:journalctl@ceph.osd.8.smithi184.stdout:Jul 14 18:31:15 smithi184 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-8[115280]: 2023-07-14T18:31:15.365+0000 7fa897e34700 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.163:6806 osd.0 since back 2023-07-14T18:30:44.909156+0000 front 2023-07-14T18:30:44.908950+0000 (oldest deadline 2023-07-14T18:31:07.809102+0000) 2023-07-14T18:31:15.663 INFO:journalctl@ceph.osd.11.smithi184.stdout:Jul 14 18:31:15 smithi184 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-11[120819]: 2023-07-14T18:31:15.565+0000 7f44dbfe8700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.163:6806 osd.0 since back 2023-07-14T18:30:42.566533+0000 front 2023-07-14T18:30:42.566680+0000 (oldest deadline 2023-07-14T18:31:08.967162+0000) 2023-07-14T18:31:15.954 INFO:journalctl@ceph.osd.9.smithi163.stdout:Jul 14 18:31:15 smithi163 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-9[125814]: 2023-07-14T18:31:15.554+0000 7fd0759f3700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.163:6806 osd.0 since back 2023-07-14T18:30:42.661073+0000 front 2023-07-14T18:30:42.661052+0000 (oldest deadline 2023-07-14T18:31:07.961309+0000) 2023-07-14T18:31:15.954 INFO:journalctl@ceph.osd.9.smithi163.stdout:Jul 14 18:31:15 smithi163 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-9[125814]: 2023-07-14T18:31:15.554+0000 7fd0759f3700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2023-07-14T18:30:47.961848+0000 front 2023-07-14T18:30:47.961754+0000 (oldest deadline 2023-07-14T18:31:13.861824+0000) 2023-07-14T18:31:16.262 INFO:journalctl@ceph.osd.10.smithi172.stdout:Jul 14 18:31:15 smithi172 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-10[119489]: 2023-07-14T18:31:15.915+0000 7fe8a6017700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.163:6806 osd.0 since back 2023-07-14T18:30:44.219658+0000 front 2023-07-14T18:30:44.219740+0000 (oldest deadline 2023-07-14T18:31:05.919624+0000) 2023-07-14T18:31:16.262 INFO:journalctl@ceph.osd.10.smithi172.stdout:Jul 14 18:31:15 smithi172 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-10[119489]: 2023-07-14T18:31:15.915+0000 7fe8a6017700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2023-07-14T18:30:51.022066+0000 front 2023-07-14T18:30:51.022166+0000 (oldest deadline 2023-07-14T18:31:13.922245+0000) 2023-07-14T18:31:16.356 INFO:journalctl@ceph.osd.5.smithi184.stdout:Jul 14 18:31:16 smithi184 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-5[109831]: 2023-07-14T18:31:16.000+0000 7f8b50395700 -1 osd.5 88 heartbeat_check: no reply from 172.21.15.163:6806 osd.0 since back 2023-07-14T18:30:41.961731+0000 front 2023-07-14T18:30:41.961630+0000 (oldest deadline 2023-07-14T18:31:07.261616+0000) 2023-07-14T18:31:16.356 INFO:journalctl@ceph.osd.5.smithi184.stdout:Jul 14 18:31:16 smithi184 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-5[109831]: 2023-07-14T18:31:16.000+0000 7f8b50395700 -1 osd.5 88 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2023-07-14T18:30:53.063578+0000 front 2023-07-14T18:30:53.063405+0000 (oldest deadline 2023-07-14T18:31:15.363340+0000) 2023-07-14T18:31:16.586 INFO:journalctl@ceph.osd.6.smithi163.stdout:Jul 14 18:31:16 smithi163 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-6[120359]: 2023-07-14T18:31:16.222+0000 7fc691297700 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.163:6806 osd.0 since back 2023-07-14T18:30:41.324204+0000 front 2023-07-14T18:30:41.324276+0000 (oldest deadline 2023-07-14T18:31:07.224382+0000) 2023-07-14T18:31:16.586 INFO:journalctl@ceph.osd.6.smithi163.stdout:Jul 14 18:31:16 smithi163 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-6[120359]: 2023-07-14T18:31:16.222+0000 7fc691297700 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2023-07-14T18:30:52.326778+0000 front 2023-07-14T18:30:52.326716+0000 (oldest deadline 2023-07-14T18:31:14.026594+0000) 2023-07-14T18:31:16.661 INFO:journalctl@ceph.osd.11.smithi184.stdout:Jul 14 18:31:16 smithi184 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-11[120819]: 2023-07-14T18:31:16.567+0000 7f44dbfe8700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.163:6806 osd.0 since back 2023-07-14T18:30:42.566533+0000 front 2023-07-14T18:30:42.566680+0000 (oldest deadline 2023-07-14T18:31:08.967162+0000) 2023-07-14T18:31:16.662 INFO:journalctl@ceph.osd.8.smithi184.stdout:Jul 14 18:31:16 smithi184 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-8[115280]: 2023-07-14T18:31:16.329+0000 7fa897e34700 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.163:6806 osd.0 since back 2023-07-14T18:30:44.909156+0000 front 2023-07-14T18:30:44.908950+0000 (oldest deadline 2023-07-14T18:31:07.809102+0000) 2023-07-14T18:31:16.840 INFO:journalctl@ceph.osd.4.smithi172.stdout:Jul 14 18:31:16 smithi172 bash[129492]: ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-4 2023-07-14T18:31:16.954 INFO:journalctl@ceph.osd.9.smithi163.stdout:Jul 14 18:31:16 smithi163 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-9[125814]: 2023-07-14T18:31:16.558+0000 7fd0759f3700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.163:6806 osd.0 since back 2023-07-14T18:30:42.661073+0000 front 2023-07-14T18:30:42.661052+0000 (oldest deadline 2023-07-14T18:31:07.961309+0000) 2023-07-14T18:31:16.954 INFO:journalctl@ceph.osd.9.smithi163.stdout:Jul 14 18:31:16 smithi163 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-9[125814]: 2023-07-14T18:31:16.558+0000 7fd0759f3700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2023-07-14T18:30:47.961848+0000 front 2023-07-14T18:30:47.961754+0000 (oldest deadline 2023-07-14T18:31:13.861824+0000) 2023-07-14T18:31:17.262 INFO:journalctl@ceph.osd.10.smithi172.stdout:Jul 14 18:31:16 smithi172 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-10[119489]: 2023-07-14T18:31:16.962+0000 7fe8a6017700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.163:6806 osd.0 since back 2023-07-14T18:30:44.219658+0000 front 2023-07-14T18:30:44.219740+0000 (oldest deadline 2023-07-14T18:31:05.919624+0000) 2023-07-14T18:31:17.262 INFO:journalctl@ceph.osd.10.smithi172.stdout:Jul 14 18:31:16 smithi172 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-10[119489]: 2023-07-14T18:31:16.962+0000 7fe8a6017700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2023-07-14T18:30:51.022066+0000 front 2023-07-14T18:30:51.022166+0000 (oldest deadline 2023-07-14T18:31:13.922245+0000) 2023-07-14T18:31:17.370 INFO:journalctl@ceph.osd.5.smithi184.stdout:Jul 14 18:31:17 smithi184 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-5[109831]: 2023-07-14T18:31:17.028+0000 7f8b50395700 -1 osd.5 88 heartbeat_check: no reply from 172.21.15.163:6806 osd.0 since back 2023-07-14T18:30:41.961731+0000 front 2023-07-14T18:30:41.961630+0000 (oldest deadline 2023-07-14T18:31:07.261616+0000) 2023-07-14T18:31:17.370 INFO:journalctl@ceph.osd.5.smithi184.stdout:Jul 14 18:31:17 smithi184 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-5[109831]: 2023-07-14T18:31:17.028+0000 7f8b50395700 -1 osd.5 88 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2023-07-14T18:30:53.063578+0000 front 2023-07-14T18:30:53.063405+0000 (oldest deadline 2023-07-14T18:31:15.363340+0000) 2023-07-14T18:31:17.576 INFO:journalctl@ceph.osd.6.smithi163.stdout:Jul 14 18:31:17 smithi163 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-6[120359]: 2023-07-14T18:31:17.188+0000 7fc691297700 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.163:6806 osd.0 since back 2023-07-14T18:30:41.324204+0000 front 2023-07-14T18:30:41.324276+0000 (oldest deadline 2023-07-14T18:31:07.224382+0000) 2023-07-14T18:31:17.577 INFO:journalctl@ceph.osd.6.smithi163.stdout:Jul 14 18:31:17 smithi163 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-6[120359]: 2023-07-14T18:31:17.188+0000 7fc691297700 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2023-07-14T18:30:52.326778+0000 front 2023-07-14T18:30:52.326716+0000 (oldest deadline 2023-07-14T18:31:14.026594+0000) 2023-07-14T18:31:17.661 INFO:journalctl@ceph.osd.8.smithi184.stdout:Jul 14 18:31:17 smithi184 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-8[115280]: 2023-07-14T18:31:17.343+0000 7fa897e34700 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.163:6806 osd.0 since back 2023-07-14T18:30:44.909156+0000 front 2023-07-14T18:30:44.908950+0000 (oldest deadline 2023-07-14T18:31:07.809102+0000) 2023-07-14T18:31:17.662 INFO:journalctl@ceph.osd.11.smithi184.stdout:Jul 14 18:31:17 smithi184 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-11[120819]: 2023-07-14T18:31:17.592+0000 7f44dbfe8700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.163:6806 osd.0 since back 2023-07-14T18:30:42.566533+0000 front 2023-07-14T18:30:42.566680+0000 (oldest deadline 2023-07-14T18:31:08.967162+0000) 2023-07-14T18:31:17.954 INFO:journalctl@ceph.osd.9.smithi163.stdout:Jul 14 18:31:17 smithi163 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-9[125814]: 2023-07-14T18:31:17.549+0000 7fd0759f3700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.163:6806 osd.0 since back 2023-07-14T18:30:42.661073+0000 front 2023-07-14T18:30:42.661052+0000 (oldest deadline 2023-07-14T18:31:07.961309+0000) 2023-07-14T18:31:17.954 INFO:journalctl@ceph.osd.9.smithi163.stdout:Jul 14 18:31:17 smithi163 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-9[125814]: 2023-07-14T18:31:17.549+0000 7fd0759f3700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2023-07-14T18:30:47.961848+0000 front 2023-07-14T18:30:47.961754+0000 (oldest deadline 2023-07-14T18:31:13.861824+0000) 2023-07-14T18:31:18.102 DEBUG:teuthology.orchestra.run.smithi172:> sudo pkill -f 'journalctl -f -n 0 -u ceph-bf7326ec-2270-11ee-9b33-001a4aab830c@osd.4.service' 2023-07-14T18:31:18.142 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-07-14T18:31:18.143 INFO:tasks.cephadm.osd.4:Stopped osd.4 2023-07-14T18:31:18.143 INFO:tasks.cephadm.osd.5:Stopping osd.5... 2023-07-14T18:31:18.144 DEBUG:teuthology.orchestra.run.smithi184:> sudo systemctl stop ceph-bf7326ec-2270-11ee-9b33-001a4aab830c@osd.5 2023-07-14T18:31:18.262 INFO:journalctl@ceph.osd.10.smithi172.stdout:Jul 14 18:31:17 smithi172 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-10[119489]: 2023-07-14T18:31:17.965+0000 7fe8a6017700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.163:6806 osd.0 since back 2023-07-14T18:30:44.219658+0000 front 2023-07-14T18:30:44.219740+0000 (oldest deadline 2023-07-14T18:31:05.919624+0000) 2023-07-14T18:31:18.262 INFO:journalctl@ceph.osd.10.smithi172.stdout:Jul 14 18:31:17 smithi172 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-10[119489]: 2023-07-14T18:31:17.965+0000 7fe8a6017700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2023-07-14T18:30:51.022066+0000 front 2023-07-14T18:30:51.022166+0000 (oldest deadline 2023-07-14T18:31:13.922245+0000) 2023-07-14T18:31:18.263 INFO:journalctl@ceph.osd.7.smithi172.stdout:Jul 14 18:31:18 smithi172 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-7[114020]: 2023-07-14T18:31:18.008+0000 7f4be707e700 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2023-07-14T18:30:51.994549+0000 front 2023-07-14T18:30:51.994596+0000 (oldest deadline 2023-07-14T18:31:17.294675+0000) 2023-07-14T18:31:18.390 INFO:journalctl@ceph.osd.5.smithi184.stdout:Jul 14 18:31:18 smithi184 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-5[109831]: 2023-07-14T18:31:18.063+0000 7f8b50395700 -1 osd.5 88 heartbeat_check: no reply from 172.21.15.163:6806 osd.0 since back 2023-07-14T18:30:41.961731+0000 front 2023-07-14T18:30:41.961630+0000 (oldest deadline 2023-07-14T18:31:07.261616+0000) 2023-07-14T18:31:18.391 INFO:journalctl@ceph.osd.5.smithi184.stdout:Jul 14 18:31:18 smithi184 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-5[109831]: 2023-07-14T18:31:18.063+0000 7f8b50395700 -1 osd.5 88 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2023-07-14T18:30:53.063578+0000 front 2023-07-14T18:30:53.063405+0000 (oldest deadline 2023-07-14T18:31:15.363340+0000) 2023-07-14T18:31:18.391 INFO:journalctl@ceph.osd.5.smithi184.stdout:Jul 14 18:31:18 smithi184 systemd[1]: Stopping Ceph osd.5 for bf7326ec-2270-11ee-9b33-001a4aab830c... 2023-07-14T18:31:18.454 INFO:journalctl@ceph.osd.6.smithi163.stdout:Jul 14 18:31:18 smithi163 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-6[120359]: 2023-07-14T18:31:18.162+0000 7fc691297700 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.163:6806 osd.0 since back 2023-07-14T18:30:41.324204+0000 front 2023-07-14T18:30:41.324276+0000 (oldest deadline 2023-07-14T18:31:07.224382+0000) 2023-07-14T18:31:18.454 INFO:journalctl@ceph.osd.6.smithi163.stdout:Jul 14 18:31:18 smithi163 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-6[120359]: 2023-07-14T18:31:18.162+0000 7fc691297700 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2023-07-14T18:30:52.326778+0000 front 2023-07-14T18:30:52.326716+0000 (oldest deadline 2023-07-14T18:31:14.026594+0000) 2023-07-14T18:31:18.661 INFO:journalctl@ceph.osd.8.smithi184.stdout:Jul 14 18:31:18 smithi184 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-8[115280]: 2023-07-14T18:31:18.363+0000 7fa897e34700 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.163:6806 osd.0 since back 2023-07-14T18:30:44.909156+0000 front 2023-07-14T18:30:44.908950+0000 (oldest deadline 2023-07-14T18:31:07.809102+0000) 2023-07-14T18:31:18.662 INFO:journalctl@ceph.osd.5.smithi184.stdout:Jul 14 18:31:18 smithi184 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-5[109831]: 2023-07-14T18:31:18.469+0000 7f8b56da4700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-osd -n osd.5 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-07-14T18:31:18.662 INFO:journalctl@ceph.osd.5.smithi184.stdout:Jul 14 18:31:18 smithi184 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-5[109831]: 2023-07-14T18:31:18.469+0000 7f8b56da4700 -1 osd.5 88 *** Got signal Terminated *** 2023-07-14T18:31:18.662 INFO:journalctl@ceph.osd.5.smithi184.stdout:Jul 14 18:31:18 smithi184 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-5[109831]: 2023-07-14T18:31:18.469+0000 7f8b56da4700 -1 osd.5 88 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-07-14T18:31:18.954 INFO:journalctl@ceph.osd.9.smithi163.stdout:Jul 14 18:31:18 smithi163 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-9[125814]: 2023-07-14T18:31:18.594+0000 7fd0759f3700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.163:6806 osd.0 since back 2023-07-14T18:30:42.661073+0000 front 2023-07-14T18:30:42.661052+0000 (oldest deadline 2023-07-14T18:31:07.961309+0000) 2023-07-14T18:31:18.954 INFO:journalctl@ceph.osd.9.smithi163.stdout:Jul 14 18:31:18 smithi163 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-9[125814]: 2023-07-14T18:31:18.594+0000 7fd0759f3700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2023-07-14T18:30:47.961848+0000 front 2023-07-14T18:30:47.961754+0000 (oldest deadline 2023-07-14T18:31:13.861824+0000) 2023-07-14T18:31:19.044 INFO:journalctl@ceph.osd.11.smithi184.stdout:Jul 14 18:31:18 smithi184 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-11[120819]: 2023-07-14T18:31:18.641+0000 7f44dbfe8700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.163:6806 osd.0 since back 2023-07-14T18:30:42.566533+0000 front 2023-07-14T18:30:42.566680+0000 (oldest deadline 2023-07-14T18:31:08.967162+0000) 2023-07-14T18:31:19.045 INFO:journalctl@ceph.osd.11.smithi184.stdout:Jul 14 18:31:18 smithi184 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-11[120819]: 2023-07-14T18:31:18.641+0000 7f44dbfe8700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2023-07-14T18:30:51.868462+0000 front 2023-07-14T18:30:51.868670+0000 (oldest deadline 2023-07-14T18:31:17.768517+0000) 2023-07-14T18:31:19.374 INFO:journalctl@ceph.osd.5.smithi184.stdout:Jul 14 18:31:19 smithi184 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-5[109831]: 2023-07-14T18:31:19.018+0000 7f8b50395700 -1 osd.5 88 heartbeat_check: no reply from 172.21.15.163:6806 osd.0 since back 2023-07-14T18:30:41.961731+0000 front 2023-07-14T18:30:41.961630+0000 (oldest deadline 2023-07-14T18:31:07.261616+0000) 2023-07-14T18:31:19.375 INFO:journalctl@ceph.osd.5.smithi184.stdout:Jul 14 18:31:19 smithi184 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-5[109831]: 2023-07-14T18:31:19.018+0000 7f8b50395700 -1 osd.5 88 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2023-07-14T18:30:53.063578+0000 front 2023-07-14T18:30:53.063405+0000 (oldest deadline 2023-07-14T18:31:15.363340+0000) 2023-07-14T18:31:19.454 INFO:journalctl@ceph.osd.6.smithi163.stdout:Jul 14 18:31:19 smithi163 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-6[120359]: 2023-07-14T18:31:19.137+0000 7fc691297700 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.163:6806 osd.0 since back 2023-07-14T18:30:41.324204+0000 front 2023-07-14T18:30:41.324276+0000 (oldest deadline 2023-07-14T18:31:07.224382+0000) 2023-07-14T18:31:19.454 INFO:journalctl@ceph.osd.6.smithi163.stdout:Jul 14 18:31:19 smithi163 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-6[120359]: 2023-07-14T18:31:19.137+0000 7fc691297700 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2023-07-14T18:30:52.326778+0000 front 2023-07-14T18:30:52.326716+0000 (oldest deadline 2023-07-14T18:31:14.026594+0000) 2023-07-14T18:31:19.512 INFO:journalctl@ceph.osd.10.smithi172.stdout:Jul 14 18:31:19 smithi172 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-10[119489]: 2023-07-14T18:31:19.003+0000 7fe8a6017700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.163:6806 osd.0 since back 2023-07-14T18:30:44.219658+0000 front 2023-07-14T18:30:44.219740+0000 (oldest deadline 2023-07-14T18:31:05.919624+0000) 2023-07-14T18:31:19.512 INFO:journalctl@ceph.osd.10.smithi172.stdout:Jul 14 18:31:19 smithi172 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-10[119489]: 2023-07-14T18:31:19.003+0000 7fe8a6017700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2023-07-14T18:30:51.022066+0000 front 2023-07-14T18:30:51.022166+0000 (oldest deadline 2023-07-14T18:31:13.922245+0000) 2023-07-14T18:31:19.513 INFO:journalctl@ceph.osd.7.smithi172.stdout:Jul 14 18:31:19 smithi172 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-7[114020]: 2023-07-14T18:31:19.029+0000 7f4be707e700 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2023-07-14T18:30:51.994549+0000 front 2023-07-14T18:30:51.994596+0000 (oldest deadline 2023-07-14T18:31:17.294675+0000) 2023-07-14T18:31:19.661 INFO:journalctl@ceph.osd.8.smithi184.stdout:Jul 14 18:31:19 smithi184 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-8[115280]: 2023-07-14T18:31:19.348+0000 7fa897e34700 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.163:6806 osd.0 since back 2023-07-14T18:30:44.909156+0000 front 2023-07-14T18:30:44.908950+0000 (oldest deadline 2023-07-14T18:31:07.809102+0000) 2023-07-14T18:31:19.662 INFO:journalctl@ceph.osd.8.smithi184.stdout:Jul 14 18:31:19 smithi184 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-8[115280]: 2023-07-14T18:31:19.348+0000 7fa897e34700 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2023-07-14T18:30:47.809828+0000 front 2023-07-14T18:30:47.809790+0000 (oldest deadline 2023-07-14T18:31:18.410275+0000) 2023-07-14T18:31:19.954 INFO:journalctl@ceph.osd.9.smithi163.stdout:Jul 14 18:31:19 smithi163 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-9[125814]: 2023-07-14T18:31:19.617+0000 7fd0759f3700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.163:6806 osd.0 since back 2023-07-14T18:30:42.661073+0000 front 2023-07-14T18:30:42.661052+0000 (oldest deadline 2023-07-14T18:31:07.961309+0000) 2023-07-14T18:31:19.954 INFO:journalctl@ceph.osd.9.smithi163.stdout:Jul 14 18:31:19 smithi163 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-9[125814]: 2023-07-14T18:31:19.617+0000 7fd0759f3700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2023-07-14T18:30:47.961848+0000 front 2023-07-14T18:30:47.961754+0000 (oldest deadline 2023-07-14T18:31:13.861824+0000) 2023-07-14T18:31:20.082 INFO:journalctl@ceph.osd.11.smithi184.stdout:Jul 14 18:31:19 smithi184 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-11[120819]: 2023-07-14T18:31:19.640+0000 7f44dbfe8700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.163:6806 osd.0 since back 2023-07-14T18:30:42.566533+0000 front 2023-07-14T18:30:42.566680+0000 (oldest deadline 2023-07-14T18:31:08.967162+0000) 2023-07-14T18:31:20.083 INFO:journalctl@ceph.osd.11.smithi184.stdout:Jul 14 18:31:19 smithi184 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-11[120819]: 2023-07-14T18:31:19.640+0000 7f44dbfe8700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2023-07-14T18:30:51.868462+0000 front 2023-07-14T18:30:51.868670+0000 (oldest deadline 2023-07-14T18:31:17.768517+0000) 2023-07-14T18:31:20.262 INFO:journalctl@ceph.osd.10.smithi172.stdout:Jul 14 18:31:19 smithi172 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-10[119489]: 2023-07-14T18:31:19.978+0000 7fe8a6017700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.163:6806 osd.0 since back 2023-07-14T18:30:44.219658+0000 front 2023-07-14T18:30:44.219740+0000 (oldest deadline 2023-07-14T18:31:05.919624+0000) 2023-07-14T18:31:20.262 INFO:journalctl@ceph.osd.10.smithi172.stdout:Jul 14 18:31:19 smithi172 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-10[119489]: 2023-07-14T18:31:19.978+0000 7fe8a6017700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2023-07-14T18:30:51.022066+0000 front 2023-07-14T18:30:51.022166+0000 (oldest deadline 2023-07-14T18:31:13.922245+0000) 2023-07-14T18:31:20.263 INFO:journalctl@ceph.osd.7.smithi172.stdout:Jul 14 18:31:19 smithi172 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-7[114020]: 2023-07-14T18:31:19.994+0000 7f4be707e700 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2023-07-14T18:30:51.994549+0000 front 2023-07-14T18:30:51.994596+0000 (oldest deadline 2023-07-14T18:31:17.294675+0000) 2023-07-14T18:31:20.408 INFO:journalctl@ceph.osd.5.smithi184.stdout:Jul 14 18:31:20 smithi184 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-5[109831]: 2023-07-14T18:31:20.056+0000 7f8b50395700 -1 osd.5 88 heartbeat_check: no reply from 172.21.15.163:6806 osd.0 since back 2023-07-14T18:30:41.961731+0000 front 2023-07-14T18:30:41.961630+0000 (oldest deadline 2023-07-14T18:31:07.261616+0000) 2023-07-14T18:31:20.408 INFO:journalctl@ceph.osd.5.smithi184.stdout:Jul 14 18:31:20 smithi184 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-5[109831]: 2023-07-14T18:31:20.056+0000 7f8b50395700 -1 osd.5 88 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2023-07-14T18:30:53.063578+0000 front 2023-07-14T18:30:53.063405+0000 (oldest deadline 2023-07-14T18:31:15.363340+0000) 2023-07-14T18:31:20.453 INFO:journalctl@ceph.osd.6.smithi163.stdout:Jul 14 18:31:20 smithi163 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-6[120359]: 2023-07-14T18:31:20.167+0000 7fc691297700 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.163:6806 osd.0 since back 2023-07-14T18:30:41.324204+0000 front 2023-07-14T18:30:41.324276+0000 (oldest deadline 2023-07-14T18:31:07.224382+0000) 2023-07-14T18:31:20.454 INFO:journalctl@ceph.osd.6.smithi163.stdout:Jul 14 18:31:20 smithi163 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-6[120359]: 2023-07-14T18:31:20.167+0000 7fc691297700 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2023-07-14T18:30:52.326778+0000 front 2023-07-14T18:30:52.326716+0000 (oldest deadline 2023-07-14T18:31:14.026594+0000) 2023-07-14T18:31:20.661 INFO:journalctl@ceph.osd.8.smithi184.stdout:Jul 14 18:31:20 smithi184 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-8[115280]: 2023-07-14T18:31:20.380+0000 7fa897e34700 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.163:6806 osd.0 since back 2023-07-14T18:30:44.909156+0000 front 2023-07-14T18:30:44.908950+0000 (oldest deadline 2023-07-14T18:31:07.809102+0000) 2023-07-14T18:31:20.662 INFO:journalctl@ceph.osd.8.smithi184.stdout:Jul 14 18:31:20 smithi184 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-8[115280]: 2023-07-14T18:31:20.380+0000 7fa897e34700 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2023-07-14T18:30:47.809828+0000 front 2023-07-14T18:30:47.809790+0000 (oldest deadline 2023-07-14T18:31:18.410275+0000) 2023-07-14T18:31:20.662 INFO:journalctl@ceph.osd.11.smithi184.stdout:Jul 14 18:31:20 smithi184 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-11[120819]: 2023-07-14T18:31:20.607+0000 7f44dbfe8700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.163:6806 osd.0 since back 2023-07-14T18:30:42.566533+0000 front 2023-07-14T18:30:42.566680+0000 (oldest deadline 2023-07-14T18:31:08.967162+0000) 2023-07-14T18:31:20.662 INFO:journalctl@ceph.osd.11.smithi184.stdout:Jul 14 18:31:20 smithi184 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-11[120819]: 2023-07-14T18:31:20.607+0000 7f44dbfe8700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2023-07-14T18:30:51.868462+0000 front 2023-07-14T18:30:51.868670+0000 (oldest deadline 2023-07-14T18:31:17.768517+0000) 2023-07-14T18:31:20.954 INFO:journalctl@ceph.osd.9.smithi163.stdout:Jul 14 18:31:20 smithi163 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-9[125814]: 2023-07-14T18:31:20.615+0000 7fd0759f3700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.163:6806 osd.0 since back 2023-07-14T18:30:42.661073+0000 front 2023-07-14T18:30:42.661052+0000 (oldest deadline 2023-07-14T18:31:07.961309+0000) 2023-07-14T18:31:20.954 INFO:journalctl@ceph.osd.9.smithi163.stdout:Jul 14 18:31:20 smithi163 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-9[125814]: 2023-07-14T18:31:20.615+0000 7fd0759f3700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2023-07-14T18:30:47.961848+0000 front 2023-07-14T18:30:47.961754+0000 (oldest deadline 2023-07-14T18:31:13.861824+0000) 2023-07-14T18:31:21.262 INFO:journalctl@ceph.osd.10.smithi172.stdout:Jul 14 18:31:20 smithi172 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-10[119489]: 2023-07-14T18:31:20.994+0000 7fe8a6017700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.163:6806 osd.0 since back 2023-07-14T18:30:44.219658+0000 front 2023-07-14T18:30:44.219740+0000 (oldest deadline 2023-07-14T18:31:05.919624+0000) 2023-07-14T18:31:21.262 INFO:journalctl@ceph.osd.10.smithi172.stdout:Jul 14 18:31:20 smithi172 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-10[119489]: 2023-07-14T18:31:20.994+0000 7fe8a6017700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2023-07-14T18:30:51.022066+0000 front 2023-07-14T18:30:51.022166+0000 (oldest deadline 2023-07-14T18:31:13.922245+0000) 2023-07-14T18:31:21.263 INFO:journalctl@ceph.osd.7.smithi172.stdout:Jul 14 18:31:20 smithi172 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-7[114020]: 2023-07-14T18:31:20.976+0000 7f4be707e700 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2023-07-14T18:30:51.994549+0000 front 2023-07-14T18:30:51.994596+0000 (oldest deadline 2023-07-14T18:31:17.294675+0000) 2023-07-14T18:31:21.411 INFO:journalctl@ceph.osd.5.smithi184.stdout:Jul 14 18:31:21 smithi184 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-5[109831]: 2023-07-14T18:31:21.016+0000 7f8b50395700 -1 osd.5 88 heartbeat_check: no reply from 172.21.15.163:6806 osd.0 since back 2023-07-14T18:30:41.961731+0000 front 2023-07-14T18:30:41.961630+0000 (oldest deadline 2023-07-14T18:31:07.261616+0000) 2023-07-14T18:31:21.411 INFO:journalctl@ceph.osd.5.smithi184.stdout:Jul 14 18:31:21 smithi184 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-5[109831]: 2023-07-14T18:31:21.016+0000 7f8b50395700 -1 osd.5 88 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2023-07-14T18:30:53.063578+0000 front 2023-07-14T18:30:53.063405+0000 (oldest deadline 2023-07-14T18:31:15.363340+0000) 2023-07-14T18:31:21.605 INFO:journalctl@ceph.osd.6.smithi163.stdout:Jul 14 18:31:21 smithi163 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-6[120359]: 2023-07-14T18:31:21.187+0000 7fc691297700 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.163:6806 osd.0 since back 2023-07-14T18:30:41.324204+0000 front 2023-07-14T18:30:41.324276+0000 (oldest deadline 2023-07-14T18:31:07.224382+0000) 2023-07-14T18:31:21.606 INFO:journalctl@ceph.osd.6.smithi163.stdout:Jul 14 18:31:21 smithi163 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-6[120359]: 2023-07-14T18:31:21.187+0000 7fc691297700 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2023-07-14T18:30:52.326778+0000 front 2023-07-14T18:30:52.326716+0000 (oldest deadline 2023-07-14T18:31:14.026594+0000) 2023-07-14T18:31:21.911 INFO:journalctl@ceph.osd.11.smithi184.stdout:Jul 14 18:31:21 smithi184 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-11[120819]: 2023-07-14T18:31:21.582+0000 7f44dbfe8700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.163:6806 osd.0 since back 2023-07-14T18:30:42.566533+0000 front 2023-07-14T18:30:42.566680+0000 (oldest deadline 2023-07-14T18:31:08.967162+0000) 2023-07-14T18:31:21.911 INFO:journalctl@ceph.osd.11.smithi184.stdout:Jul 14 18:31:21 smithi184 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-11[120819]: 2023-07-14T18:31:21.582+0000 7f44dbfe8700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2023-07-14T18:30:51.868462+0000 front 2023-07-14T18:30:51.868670+0000 (oldest deadline 2023-07-14T18:31:17.768517+0000) 2023-07-14T18:31:21.912 INFO:journalctl@ceph.osd.8.smithi184.stdout:Jul 14 18:31:21 smithi184 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-8[115280]: 2023-07-14T18:31:21.419+0000 7fa897e34700 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.163:6806 osd.0 since back 2023-07-14T18:30:44.909156+0000 front 2023-07-14T18:30:44.908950+0000 (oldest deadline 2023-07-14T18:31:07.809102+0000) 2023-07-14T18:31:21.912 INFO:journalctl@ceph.osd.8.smithi184.stdout:Jul 14 18:31:21 smithi184 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-8[115280]: 2023-07-14T18:31:21.419+0000 7fa897e34700 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2023-07-14T18:30:47.809828+0000 front 2023-07-14T18:30:47.809790+0000 (oldest deadline 2023-07-14T18:31:18.410275+0000) 2023-07-14T18:31:21.912 INFO:journalctl@ceph.osd.8.smithi184.stdout:Jul 14 18:31:21 smithi184 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-8[115280]: 2023-07-14T18:31:21.419+0000 7fa897e34700 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.184:6804 osd.2 since back 2023-07-14T18:31:00.111285+0000 front 2023-07-14T18:31:00.111392+0000 (oldest deadline 2023-07-14T18:31:21.211412+0000) 2023-07-14T18:31:21.953 INFO:journalctl@ceph.osd.9.smithi163.stdout:Jul 14 18:31:21 smithi163 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-9[125814]: 2023-07-14T18:31:21.577+0000 7fd0759f3700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.163:6806 osd.0 since back 2023-07-14T18:30:42.661073+0000 front 2023-07-14T18:30:42.661052+0000 (oldest deadline 2023-07-14T18:31:07.961309+0000) 2023-07-14T18:31:21.954 INFO:journalctl@ceph.osd.9.smithi163.stdout:Jul 14 18:31:21 smithi163 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-9[125814]: 2023-07-14T18:31:21.577+0000 7fd0759f3700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2023-07-14T18:30:47.961848+0000 front 2023-07-14T18:30:47.961754+0000 (oldest deadline 2023-07-14T18:31:13.861824+0000) 2023-07-14T18:31:22.262 INFO:journalctl@ceph.osd.7.smithi172.stdout:Jul 14 18:31:21 smithi172 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-7[114020]: 2023-07-14T18:31:21.977+0000 7f4be707e700 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2023-07-14T18:30:51.994549+0000 front 2023-07-14T18:30:51.994596+0000 (oldest deadline 2023-07-14T18:31:17.294675+0000) 2023-07-14T18:31:22.262 INFO:journalctl@ceph.osd.10.smithi172.stdout:Jul 14 18:31:22 smithi172 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-10[119489]: 2023-07-14T18:31:22.015+0000 7fe8a6017700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.163:6806 osd.0 since back 2023-07-14T18:30:44.219658+0000 front 2023-07-14T18:30:44.219740+0000 (oldest deadline 2023-07-14T18:31:05.919624+0000) 2023-07-14T18:31:22.263 INFO:journalctl@ceph.osd.10.smithi172.stdout:Jul 14 18:31:22 smithi172 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-10[119489]: 2023-07-14T18:31:22.015+0000 7fe8a6017700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2023-07-14T18:30:51.022066+0000 front 2023-07-14T18:30:51.022166+0000 (oldest deadline 2023-07-14T18:31:13.922245+0000) 2023-07-14T18:31:22.263 INFO:journalctl@ceph.osd.10.smithi172.stdout:Jul 14 18:31:22 smithi172 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-10[119489]: 2023-07-14T18:31:22.015+0000 7fe8a6017700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.184:6804 osd.2 since back 2023-07-14T18:30:59.723894+0000 front 2023-07-14T18:30:59.723980+0000 (oldest deadline 2023-07-14T18:31:21.424006+0000) 2023-07-14T18:31:22.411 INFO:journalctl@ceph.osd.5.smithi184.stdout:Jul 14 18:31:22 smithi184 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-5[109831]: 2023-07-14T18:31:22.021+0000 7f8b50395700 -1 osd.5 88 heartbeat_check: no reply from 172.21.15.163:6806 osd.0 since back 2023-07-14T18:30:41.961731+0000 front 2023-07-14T18:30:41.961630+0000 (oldest deadline 2023-07-14T18:31:07.261616+0000) 2023-07-14T18:31:22.412 INFO:journalctl@ceph.osd.5.smithi184.stdout:Jul 14 18:31:22 smithi184 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-5[109831]: 2023-07-14T18:31:22.021+0000 7f8b50395700 -1 osd.5 88 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2023-07-14T18:30:53.063578+0000 front 2023-07-14T18:30:53.063405+0000 (oldest deadline 2023-07-14T18:31:15.363340+0000) 2023-07-14T18:31:22.617 INFO:journalctl@ceph.osd.6.smithi163.stdout:Jul 14 18:31:22 smithi163 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-6[120359]: 2023-07-14T18:31:22.197+0000 7fc691297700 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.163:6806 osd.0 since back 2023-07-14T18:30:41.324204+0000 front 2023-07-14T18:30:41.324276+0000 (oldest deadline 2023-07-14T18:31:07.224382+0000) 2023-07-14T18:31:22.618 INFO:journalctl@ceph.osd.6.smithi163.stdout:Jul 14 18:31:22 smithi163 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-6[120359]: 2023-07-14T18:31:22.197+0000 7fc691297700 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2023-07-14T18:30:52.326778+0000 front 2023-07-14T18:30:52.326716+0000 (oldest deadline 2023-07-14T18:31:14.026594+0000) 2023-07-14T18:31:22.911 INFO:journalctl@ceph.osd.11.smithi184.stdout:Jul 14 18:31:22 smithi184 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-11[120819]: 2023-07-14T18:31:22.579+0000 7f44dbfe8700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.163:6806 osd.0 since back 2023-07-14T18:30:42.566533+0000 front 2023-07-14T18:30:42.566680+0000 (oldest deadline 2023-07-14T18:31:08.967162+0000) 2023-07-14T18:31:22.912 INFO:journalctl@ceph.osd.11.smithi184.stdout:Jul 14 18:31:22 smithi184 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-11[120819]: 2023-07-14T18:31:22.579+0000 7f44dbfe8700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2023-07-14T18:30:51.868462+0000 front 2023-07-14T18:30:51.868670+0000 (oldest deadline 2023-07-14T18:31:17.768517+0000) 2023-07-14T18:31:22.912 INFO:journalctl@ceph.osd.8.smithi184.stdout:Jul 14 18:31:22 smithi184 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-8[115280]: 2023-07-14T18:31:22.444+0000 7fa897e34700 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.163:6806 osd.0 since back 2023-07-14T18:30:44.909156+0000 front 2023-07-14T18:30:44.908950+0000 (oldest deadline 2023-07-14T18:31:07.809102+0000) 2023-07-14T18:31:22.913 INFO:journalctl@ceph.osd.8.smithi184.stdout:Jul 14 18:31:22 smithi184 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-8[115280]: 2023-07-14T18:31:22.444+0000 7fa897e34700 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2023-07-14T18:30:47.809828+0000 front 2023-07-14T18:30:47.809790+0000 (oldest deadline 2023-07-14T18:31:18.410275+0000) 2023-07-14T18:31:22.913 INFO:journalctl@ceph.osd.8.smithi184.stdout:Jul 14 18:31:22 smithi184 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-8[115280]: 2023-07-14T18:31:22.444+0000 7fa897e34700 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.184:6804 osd.2 since back 2023-07-14T18:31:00.111285+0000 front 2023-07-14T18:31:00.111392+0000 (oldest deadline 2023-07-14T18:31:21.211412+0000) 2023-07-14T18:31:22.953 INFO:journalctl@ceph.osd.9.smithi163.stdout:Jul 14 18:31:22 smithi163 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-9[125814]: 2023-07-14T18:31:22.590+0000 7fd0759f3700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.163:6806 osd.0 since back 2023-07-14T18:30:42.661073+0000 front 2023-07-14T18:30:42.661052+0000 (oldest deadline 2023-07-14T18:31:07.961309+0000) 2023-07-14T18:31:22.954 INFO:journalctl@ceph.osd.9.smithi163.stdout:Jul 14 18:31:22 smithi163 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-9[125814]: 2023-07-14T18:31:22.590+0000 7fd0759f3700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2023-07-14T18:30:47.961848+0000 front 2023-07-14T18:30:47.961754+0000 (oldest deadline 2023-07-14T18:31:13.861824+0000) 2023-07-14T18:31:23.411 INFO:journalctl@ceph.osd.5.smithi184.stdout:Jul 14 18:31:23 smithi184 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-5[109831]: 2023-07-14T18:31:23.013+0000 7f8b50395700 -1 osd.5 88 heartbeat_check: no reply from 172.21.15.163:6806 osd.0 since back 2023-07-14T18:30:41.961731+0000 front 2023-07-14T18:30:41.961630+0000 (oldest deadline 2023-07-14T18:31:07.261616+0000) 2023-07-14T18:31:23.411 INFO:journalctl@ceph.osd.5.smithi184.stdout:Jul 14 18:31:23 smithi184 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-5[109831]: 2023-07-14T18:31:23.013+0000 7f8b50395700 -1 osd.5 88 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2023-07-14T18:30:53.063578+0000 front 2023-07-14T18:30:53.063405+0000 (oldest deadline 2023-07-14T18:31:15.363340+0000) 2023-07-14T18:31:23.512 INFO:journalctl@ceph.osd.7.smithi172.stdout:Jul 14 18:31:23 smithi172 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-7[114020]: 2023-07-14T18:31:23.013+0000 7f4be707e700 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2023-07-14T18:30:51.994549+0000 front 2023-07-14T18:30:51.994596+0000 (oldest deadline 2023-07-14T18:31:17.294675+0000) 2023-07-14T18:31:23.512 INFO:journalctl@ceph.osd.10.smithi172.stdout:Jul 14 18:31:23 smithi172 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-10[119489]: 2023-07-14T18:31:23.042+0000 7fe8a6017700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.163:6806 osd.0 since back 2023-07-14T18:30:44.219658+0000 front 2023-07-14T18:30:44.219740+0000 (oldest deadline 2023-07-14T18:31:05.919624+0000) 2023-07-14T18:31:23.513 INFO:journalctl@ceph.osd.10.smithi172.stdout:Jul 14 18:31:23 smithi172 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-10[119489]: 2023-07-14T18:31:23.042+0000 7fe8a6017700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2023-07-14T18:30:51.022066+0000 front 2023-07-14T18:30:51.022166+0000 (oldest deadline 2023-07-14T18:31:13.922245+0000) 2023-07-14T18:31:23.513 INFO:journalctl@ceph.osd.10.smithi172.stdout:Jul 14 18:31:23 smithi172 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-10[119489]: 2023-07-14T18:31:23.042+0000 7fe8a6017700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.184:6804 osd.2 since back 2023-07-14T18:30:59.723894+0000 front 2023-07-14T18:30:59.723980+0000 (oldest deadline 2023-07-14T18:31:21.424006+0000) 2023-07-14T18:31:23.645 INFO:journalctl@ceph.osd.6.smithi163.stdout:Jul 14 18:31:23 smithi163 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-6[120359]: 2023-07-14T18:31:23.212+0000 7fc691297700 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.163:6806 osd.0 since back 2023-07-14T18:30:41.324204+0000 front 2023-07-14T18:30:41.324276+0000 (oldest deadline 2023-07-14T18:31:07.224382+0000) 2023-07-14T18:31:23.645 INFO:journalctl@ceph.osd.6.smithi163.stdout:Jul 14 18:31:23 smithi163 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-6[120359]: 2023-07-14T18:31:23.212+0000 7fc691297700 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2023-07-14T18:30:52.326778+0000 front 2023-07-14T18:30:52.326716+0000 (oldest deadline 2023-07-14T18:31:14.026594+0000) 2023-07-14T18:31:23.911 INFO:journalctl@ceph.osd.8.smithi184.stdout:Jul 14 18:31:23 smithi184 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-8[115280]: 2023-07-14T18:31:23.433+0000 7fa897e34700 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.163:6806 osd.0 since back 2023-07-14T18:30:44.909156+0000 front 2023-07-14T18:30:44.908950+0000 (oldest deadline 2023-07-14T18:31:07.809102+0000) 2023-07-14T18:31:23.912 INFO:journalctl@ceph.osd.8.smithi184.stdout:Jul 14 18:31:23 smithi184 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-8[115280]: 2023-07-14T18:31:23.433+0000 7fa897e34700 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2023-07-14T18:30:47.809828+0000 front 2023-07-14T18:30:47.809790+0000 (oldest deadline 2023-07-14T18:31:18.410275+0000) 2023-07-14T18:31:23.912 INFO:journalctl@ceph.osd.8.smithi184.stdout:Jul 14 18:31:23 smithi184 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-8[115280]: 2023-07-14T18:31:23.433+0000 7fa897e34700 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.184:6804 osd.2 since back 2023-07-14T18:31:00.111285+0000 front 2023-07-14T18:31:00.111392+0000 (oldest deadline 2023-07-14T18:31:21.211412+0000) 2023-07-14T18:31:23.912 INFO:journalctl@ceph.osd.11.smithi184.stdout:Jul 14 18:31:23 smithi184 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-11[120819]: 2023-07-14T18:31:23.573+0000 7f44dbfe8700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.163:6806 osd.0 since back 2023-07-14T18:30:42.566533+0000 front 2023-07-14T18:30:42.566680+0000 (oldest deadline 2023-07-14T18:31:08.967162+0000) 2023-07-14T18:31:23.913 INFO:journalctl@ceph.osd.11.smithi184.stdout:Jul 14 18:31:23 smithi184 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-11[120819]: 2023-07-14T18:31:23.573+0000 7f44dbfe8700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2023-07-14T18:30:51.868462+0000 front 2023-07-14T18:30:51.868670+0000 (oldest deadline 2023-07-14T18:31:17.768517+0000) 2023-07-14T18:31:23.913 INFO:journalctl@ceph.osd.11.smithi184.stdout:Jul 14 18:31:23 smithi184 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-11[120819]: 2023-07-14T18:31:23.573+0000 7f44dbfe8700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.184:6804 osd.2 since back 2023-07-14T18:30:58.269297+0000 front 2023-07-14T18:30:58.269338+0000 (oldest deadline 2023-07-14T18:31:23.569431+0000) 2023-07-14T18:31:23.953 INFO:journalctl@ceph.osd.9.smithi163.stdout:Jul 14 18:31:23 smithi163 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-9[125814]: 2023-07-14T18:31:23.618+0000 7fd0759f3700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.163:6806 osd.0 since back 2023-07-14T18:30:42.661073+0000 front 2023-07-14T18:30:42.661052+0000 (oldest deadline 2023-07-14T18:31:07.961309+0000) 2023-07-14T18:31:23.954 INFO:journalctl@ceph.osd.9.smithi163.stdout:Jul 14 18:31:23 smithi163 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-9[125814]: 2023-07-14T18:31:23.618+0000 7fd0759f3700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2023-07-14T18:30:47.961848+0000 front 2023-07-14T18:30:47.961754+0000 (oldest deadline 2023-07-14T18:31:13.861824+0000) 2023-07-14T18:31:24.262 INFO:journalctl@ceph.osd.10.smithi172.stdout:Jul 14 18:31:24 smithi172 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-10[119489]: 2023-07-14T18:31:24.081+0000 7fe8a6017700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.163:6806 osd.0 since back 2023-07-14T18:30:44.219658+0000 front 2023-07-14T18:30:44.219740+0000 (oldest deadline 2023-07-14T18:31:05.919624+0000) 2023-07-14T18:31:24.262 INFO:journalctl@ceph.osd.10.smithi172.stdout:Jul 14 18:31:24 smithi172 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-10[119489]: 2023-07-14T18:31:24.081+0000 7fe8a6017700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2023-07-14T18:30:51.022066+0000 front 2023-07-14T18:30:51.022166+0000 (oldest deadline 2023-07-14T18:31:13.922245+0000) 2023-07-14T18:31:24.263 INFO:journalctl@ceph.osd.10.smithi172.stdout:Jul 14 18:31:24 smithi172 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-10[119489]: 2023-07-14T18:31:24.081+0000 7fe8a6017700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.184:6804 osd.2 since back 2023-07-14T18:30:59.723894+0000 front 2023-07-14T18:30:59.723980+0000 (oldest deadline 2023-07-14T18:31:21.424006+0000) 2023-07-14T18:31:24.263 INFO:journalctl@ceph.osd.7.smithi172.stdout:Jul 14 18:31:23 smithi172 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-7[114020]: 2023-07-14T18:31:23.974+0000 7f4be707e700 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2023-07-14T18:30:51.994549+0000 front 2023-07-14T18:30:51.994596+0000 (oldest deadline 2023-07-14T18:31:17.294675+0000) 2023-07-14T18:31:24.264 INFO:journalctl@ceph.osd.7.smithi172.stdout:Jul 14 18:31:23 smithi172 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-7[114020]: 2023-07-14T18:31:23.974+0000 7f4be707e700 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.184:6804 osd.2 since back 2023-07-14T18:30:57.295136+0000 front 2023-07-14T18:30:57.295194+0000 (oldest deadline 2023-07-14T18:31:23.195171+0000) 2023-07-14T18:31:24.384 INFO:journalctl@ceph.osd.5.smithi184.stdout:Jul 14 18:31:24 smithi184 bash[131011]: ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-5 2023-07-14T18:31:24.679 INFO:journalctl@ceph.osd.6.smithi163.stdout:Jul 14 18:31:24 smithi163 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-6[120359]: 2023-07-14T18:31:24.177+0000 7fc691297700 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.163:6806 osd.0 since back 2023-07-14T18:30:41.324204+0000 front 2023-07-14T18:30:41.324276+0000 (oldest deadline 2023-07-14T18:31:07.224382+0000) 2023-07-14T18:31:24.679 INFO:journalctl@ceph.osd.6.smithi163.stdout:Jul 14 18:31:24 smithi163 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-6[120359]: 2023-07-14T18:31:24.177+0000 7fc691297700 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2023-07-14T18:30:52.326778+0000 front 2023-07-14T18:30:52.326716+0000 (oldest deadline 2023-07-14T18:31:14.026594+0000) 2023-07-14T18:31:24.911 INFO:journalctl@ceph.osd.11.smithi184.stdout:Jul 14 18:31:24 smithi184 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-11[120819]: 2023-07-14T18:31:24.594+0000 7f44dbfe8700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.163:6806 osd.0 since back 2023-07-14T18:30:42.566533+0000 front 2023-07-14T18:30:42.566680+0000 (oldest deadline 2023-07-14T18:31:08.967162+0000) 2023-07-14T18:31:24.912 INFO:journalctl@ceph.osd.11.smithi184.stdout:Jul 14 18:31:24 smithi184 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-11[120819]: 2023-07-14T18:31:24.594+0000 7f44dbfe8700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2023-07-14T18:30:51.868462+0000 front 2023-07-14T18:30:51.868670+0000 (oldest deadline 2023-07-14T18:31:17.768517+0000) 2023-07-14T18:31:24.912 INFO:journalctl@ceph.osd.11.smithi184.stdout:Jul 14 18:31:24 smithi184 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-11[120819]: 2023-07-14T18:31:24.594+0000 7f44dbfe8700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.184:6804 osd.2 since back 2023-07-14T18:30:58.269297+0000 front 2023-07-14T18:30:58.269338+0000 (oldest deadline 2023-07-14T18:31:23.569431+0000) 2023-07-14T18:31:24.912 INFO:journalctl@ceph.osd.8.smithi184.stdout:Jul 14 18:31:24 smithi184 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-8[115280]: 2023-07-14T18:31:24.465+0000 7fa897e34700 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.163:6806 osd.0 since back 2023-07-14T18:30:44.909156+0000 front 2023-07-14T18:30:44.908950+0000 (oldest deadline 2023-07-14T18:31:07.809102+0000) 2023-07-14T18:31:24.912 INFO:journalctl@ceph.osd.8.smithi184.stdout:Jul 14 18:31:24 smithi184 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-8[115280]: 2023-07-14T18:31:24.465+0000 7fa897e34700 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2023-07-14T18:30:47.809828+0000 front 2023-07-14T18:30:47.809790+0000 (oldest deadline 2023-07-14T18:31:18.410275+0000) 2023-07-14T18:31:24.913 INFO:journalctl@ceph.osd.8.smithi184.stdout:Jul 14 18:31:24 smithi184 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-8[115280]: 2023-07-14T18:31:24.465+0000 7fa897e34700 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.184:6804 osd.2 since back 2023-07-14T18:31:00.111285+0000 front 2023-07-14T18:31:00.111392+0000 (oldest deadline 2023-07-14T18:31:21.211412+0000) 2023-07-14T18:31:24.953 INFO:journalctl@ceph.osd.9.smithi163.stdout:Jul 14 18:31:24 smithi163 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-9[125814]: 2023-07-14T18:31:24.652+0000 7fd0759f3700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.163:6806 osd.0 since back 2023-07-14T18:30:42.661073+0000 front 2023-07-14T18:30:42.661052+0000 (oldest deadline 2023-07-14T18:31:07.961309+0000) 2023-07-14T18:31:24.954 INFO:journalctl@ceph.osd.9.smithi163.stdout:Jul 14 18:31:24 smithi163 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-9[125814]: 2023-07-14T18:31:24.652+0000 7fd0759f3700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2023-07-14T18:30:47.961848+0000 front 2023-07-14T18:30:47.961754+0000 (oldest deadline 2023-07-14T18:31:13.861824+0000) 2023-07-14T18:31:25.262 INFO:journalctl@ceph.osd.7.smithi172.stdout:Jul 14 18:31:24 smithi172 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-7[114020]: 2023-07-14T18:31:24.952+0000 7f4be707e700 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2023-07-14T18:30:51.994549+0000 front 2023-07-14T18:30:51.994596+0000 (oldest deadline 2023-07-14T18:31:17.294675+0000) 2023-07-14T18:31:25.262 INFO:journalctl@ceph.osd.7.smithi172.stdout:Jul 14 18:31:24 smithi172 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-7[114020]: 2023-07-14T18:31:24.952+0000 7f4be707e700 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.184:6804 osd.2 since back 2023-07-14T18:30:57.295136+0000 front 2023-07-14T18:30:57.295194+0000 (oldest deadline 2023-07-14T18:31:23.195171+0000) 2023-07-14T18:31:25.262 INFO:journalctl@ceph.osd.10.smithi172.stdout:Jul 14 18:31:25 smithi172 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-10[119489]: 2023-07-14T18:31:25.056+0000 7fe8a6017700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.163:6806 osd.0 since back 2023-07-14T18:30:44.219658+0000 front 2023-07-14T18:30:44.219740+0000 (oldest deadline 2023-07-14T18:31:05.919624+0000) 2023-07-14T18:31:25.263 INFO:journalctl@ceph.osd.10.smithi172.stdout:Jul 14 18:31:25 smithi172 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-10[119489]: 2023-07-14T18:31:25.056+0000 7fe8a6017700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2023-07-14T18:30:51.022066+0000 front 2023-07-14T18:30:51.022166+0000 (oldest deadline 2023-07-14T18:31:13.922245+0000) 2023-07-14T18:31:25.263 INFO:journalctl@ceph.osd.10.smithi172.stdout:Jul 14 18:31:25 smithi172 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-10[119489]: 2023-07-14T18:31:25.056+0000 7fe8a6017700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.184:6804 osd.2 since back 2023-07-14T18:30:59.723894+0000 front 2023-07-14T18:30:59.723980+0000 (oldest deadline 2023-07-14T18:31:21.424006+0000) 2023-07-14T18:31:25.453 INFO:journalctl@ceph.osd.6.smithi163.stdout:Jul 14 18:31:25 smithi163 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-6[120359]: 2023-07-14T18:31:25.130+0000 7fc691297700 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.163:6806 osd.0 since back 2023-07-14T18:30:41.324204+0000 front 2023-07-14T18:30:41.324276+0000 (oldest deadline 2023-07-14T18:31:07.224382+0000) 2023-07-14T18:31:25.454 INFO:journalctl@ceph.osd.6.smithi163.stdout:Jul 14 18:31:25 smithi163 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-6[120359]: 2023-07-14T18:31:25.130+0000 7fc691297700 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2023-07-14T18:30:52.326778+0000 front 2023-07-14T18:30:52.326716+0000 (oldest deadline 2023-07-14T18:31:14.026594+0000) 2023-07-14T18:31:25.454 INFO:journalctl@ceph.osd.6.smithi163.stdout:Jul 14 18:31:25 smithi163 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-6[120359]: 2023-07-14T18:31:25.130+0000 7fc691297700 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.184:6804 osd.2 since back 2023-07-14T18:31:00.428215+0000 front 2023-07-14T18:31:00.428236+0000 (oldest deadline 2023-07-14T18:31:25.128362+0000) 2023-07-14T18:31:25.661 INFO:journalctl@ceph.osd.8.smithi184.stdout:Jul 14 18:31:25 smithi184 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-8[115280]: 2023-07-14T18:31:25.508+0000 7fa897e34700 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.163:6806 osd.0 since back 2023-07-14T18:30:44.909156+0000 front 2023-07-14T18:30:44.908950+0000 (oldest deadline 2023-07-14T18:31:07.809102+0000) 2023-07-14T18:31:25.662 INFO:journalctl@ceph.osd.8.smithi184.stdout:Jul 14 18:31:25 smithi184 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-8[115280]: 2023-07-14T18:31:25.508+0000 7fa897e34700 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2023-07-14T18:30:47.809828+0000 front 2023-07-14T18:30:47.809790+0000 (oldest deadline 2023-07-14T18:31:18.410275+0000) 2023-07-14T18:31:25.662 INFO:journalctl@ceph.osd.8.smithi184.stdout:Jul 14 18:31:25 smithi184 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-8[115280]: 2023-07-14T18:31:25.508+0000 7fa897e34700 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.184:6804 osd.2 since back 2023-07-14T18:31:00.111285+0000 front 2023-07-14T18:31:00.111392+0000 (oldest deadline 2023-07-14T18:31:21.211412+0000) 2023-07-14T18:31:25.751 DEBUG:teuthology.orchestra.run.smithi184:> sudo pkill -f 'journalctl -f -n 0 -u ceph-bf7326ec-2270-11ee-9b33-001a4aab830c@osd.5.service' 2023-07-14T18:31:25.791 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-07-14T18:31:25.792 INFO:tasks.cephadm.osd.5:Stopped osd.5 2023-07-14T18:31:25.792 INFO:tasks.cephadm.osd.6:Stopping osd.6... 2023-07-14T18:31:25.792 DEBUG:teuthology.orchestra.run.smithi163:> sudo systemctl stop ceph-bf7326ec-2270-11ee-9b33-001a4aab830c@osd.6 2023-07-14T18:31:26.141 INFO:journalctl@ceph.osd.6.smithi163.stdout:Jul 14 18:31:25 smithi163 systemd[1]: Stopping Ceph osd.6 for bf7326ec-2270-11ee-9b33-001a4aab830c... 2023-07-14T18:31:26.141 INFO:journalctl@ceph.osd.9.smithi163.stdout:Jul 14 18:31:25 smithi163 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-9[125814]: 2023-07-14T18:31:25.688+0000 7fd0759f3700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.163:6806 osd.0 since back 2023-07-14T18:30:42.661073+0000 front 2023-07-14T18:30:42.661052+0000 (oldest deadline 2023-07-14T18:31:07.961309+0000) 2023-07-14T18:31:26.141 INFO:journalctl@ceph.osd.9.smithi163.stdout:Jul 14 18:31:25 smithi163 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-9[125814]: 2023-07-14T18:31:25.688+0000 7fd0759f3700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2023-07-14T18:30:47.961848+0000 front 2023-07-14T18:30:47.961754+0000 (oldest deadline 2023-07-14T18:31:13.861824+0000) 2023-07-14T18:31:26.142 INFO:journalctl@ceph.osd.9.smithi163.stdout:Jul 14 18:31:25 smithi163 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-9[125814]: 2023-07-14T18:31:25.688+0000 7fd0759f3700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.184:6804 osd.2 since back 2023-07-14T18:30:59.763100+0000 front 2023-07-14T18:30:59.763261+0000 (oldest deadline 2023-07-14T18:31:25.662987+0000) 2023-07-14T18:31:26.161 INFO:journalctl@ceph.osd.11.smithi184.stdout:Jul 14 18:31:25 smithi184 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-11[120819]: 2023-07-14T18:31:25.639+0000 7f44dbfe8700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.163:6806 osd.0 since back 2023-07-14T18:30:42.566533+0000 front 2023-07-14T18:30:42.566680+0000 (oldest deadline 2023-07-14T18:31:08.967162+0000) 2023-07-14T18:31:26.161 INFO:journalctl@ceph.osd.11.smithi184.stdout:Jul 14 18:31:25 smithi184 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-11[120819]: 2023-07-14T18:31:25.639+0000 7f44dbfe8700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2023-07-14T18:30:51.868462+0000 front 2023-07-14T18:30:51.868670+0000 (oldest deadline 2023-07-14T18:31:17.768517+0000) 2023-07-14T18:31:26.161 INFO:journalctl@ceph.osd.11.smithi184.stdout:Jul 14 18:31:25 smithi184 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-11[120819]: 2023-07-14T18:31:25.639+0000 7f44dbfe8700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.184:6804 osd.2 since back 2023-07-14T18:30:58.269297+0000 front 2023-07-14T18:30:58.269338+0000 (oldest deadline 2023-07-14T18:31:23.569431+0000) 2023-07-14T18:31:26.262 INFO:journalctl@ceph.osd.10.smithi172.stdout:Jul 14 18:31:26 smithi172 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-10[119489]: 2023-07-14T18:31:26.041+0000 7fe8a6017700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.163:6806 osd.0 since back 2023-07-14T18:30:44.219658+0000 front 2023-07-14T18:30:44.219740+0000 (oldest deadline 2023-07-14T18:31:05.919624+0000) 2023-07-14T18:31:26.263 INFO:journalctl@ceph.osd.10.smithi172.stdout:Jul 14 18:31:26 smithi172 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-10[119489]: 2023-07-14T18:31:26.041+0000 7fe8a6017700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2023-07-14T18:30:51.022066+0000 front 2023-07-14T18:30:51.022166+0000 (oldest deadline 2023-07-14T18:31:13.922245+0000) 2023-07-14T18:31:26.263 INFO:journalctl@ceph.osd.10.smithi172.stdout:Jul 14 18:31:26 smithi172 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-10[119489]: 2023-07-14T18:31:26.041+0000 7fe8a6017700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.184:6804 osd.2 since back 2023-07-14T18:30:59.723894+0000 front 2023-07-14T18:30:59.723980+0000 (oldest deadline 2023-07-14T18:31:21.424006+0000) 2023-07-14T18:31:26.263 INFO:journalctl@ceph.osd.7.smithi172.stdout:Jul 14 18:31:25 smithi172 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-7[114020]: 2023-07-14T18:31:25.935+0000 7f4be707e700 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2023-07-14T18:30:51.994549+0000 front 2023-07-14T18:30:51.994596+0000 (oldest deadline 2023-07-14T18:31:17.294675+0000) 2023-07-14T18:31:26.263 INFO:journalctl@ceph.osd.7.smithi172.stdout:Jul 14 18:31:25 smithi172 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-7[114020]: 2023-07-14T18:31:25.935+0000 7f4be707e700 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.184:6804 osd.2 since back 2023-07-14T18:30:57.295136+0000 front 2023-07-14T18:30:57.295194+0000 (oldest deadline 2023-07-14T18:31:23.195171+0000) 2023-07-14T18:31:26.454 INFO:journalctl@ceph.osd.6.smithi163.stdout:Jul 14 18:31:26 smithi163 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-6[120359]: 2023-07-14T18:31:26.113+0000 7fc691297700 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.163:6806 osd.0 since back 2023-07-14T18:30:41.324204+0000 front 2023-07-14T18:30:41.324276+0000 (oldest deadline 2023-07-14T18:31:07.224382+0000) 2023-07-14T18:31:26.454 INFO:journalctl@ceph.osd.6.smithi163.stdout:Jul 14 18:31:26 smithi163 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-6[120359]: 2023-07-14T18:31:26.113+0000 7fc691297700 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2023-07-14T18:30:52.326778+0000 front 2023-07-14T18:30:52.326716+0000 (oldest deadline 2023-07-14T18:31:14.026594+0000) 2023-07-14T18:31:26.454 INFO:journalctl@ceph.osd.6.smithi163.stdout:Jul 14 18:31:26 smithi163 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-6[120359]: 2023-07-14T18:31:26.113+0000 7fc691297700 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.184:6804 osd.2 since back 2023-07-14T18:31:00.428215+0000 front 2023-07-14T18:31:00.428236+0000 (oldest deadline 2023-07-14T18:31:25.128362+0000) 2023-07-14T18:31:26.455 INFO:journalctl@ceph.osd.6.smithi163.stdout:Jul 14 18:31:26 smithi163 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-6[120359]: 2023-07-14T18:31:26.136+0000 7fc697ca6700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-osd -n osd.6 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-07-14T18:31:26.455 INFO:journalctl@ceph.osd.6.smithi163.stdout:Jul 14 18:31:26 smithi163 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-6[120359]: 2023-07-14T18:31:26.136+0000 7fc697ca6700 -1 osd.6 88 *** Got signal Terminated *** 2023-07-14T18:31:26.455 INFO:journalctl@ceph.osd.6.smithi163.stdout:Jul 14 18:31:26 smithi163 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-6[120359]: 2023-07-14T18:31:26.136+0000 7fc697ca6700 -1 osd.6 88 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-07-14T18:31:26.911 INFO:journalctl@ceph.osd.8.smithi184.stdout:Jul 14 18:31:26 smithi184 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-8[115280]: 2023-07-14T18:31:26.509+0000 7fa897e34700 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.163:6806 osd.0 since back 2023-07-14T18:30:44.909156+0000 front 2023-07-14T18:30:44.908950+0000 (oldest deadline 2023-07-14T18:31:07.809102+0000) 2023-07-14T18:31:26.911 INFO:journalctl@ceph.osd.8.smithi184.stdout:Jul 14 18:31:26 smithi184 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-8[115280]: 2023-07-14T18:31:26.509+0000 7fa897e34700 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2023-07-14T18:30:47.809828+0000 front 2023-07-14T18:30:47.809790+0000 (oldest deadline 2023-07-14T18:31:18.410275+0000) 2023-07-14T18:31:26.911 INFO:journalctl@ceph.osd.8.smithi184.stdout:Jul 14 18:31:26 smithi184 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-8[115280]: 2023-07-14T18:31:26.509+0000 7fa897e34700 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.184:6804 osd.2 since back 2023-07-14T18:31:00.111285+0000 front 2023-07-14T18:31:00.111392+0000 (oldest deadline 2023-07-14T18:31:21.211412+0000) 2023-07-14T18:31:26.912 INFO:journalctl@ceph.osd.11.smithi184.stdout:Jul 14 18:31:26 smithi184 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-11[120819]: 2023-07-14T18:31:26.605+0000 7f44dbfe8700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.163:6806 osd.0 since back 2023-07-14T18:30:42.566533+0000 front 2023-07-14T18:30:42.566680+0000 (oldest deadline 2023-07-14T18:31:08.967162+0000) 2023-07-14T18:31:26.912 INFO:journalctl@ceph.osd.11.smithi184.stdout:Jul 14 18:31:26 smithi184 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-11[120819]: 2023-07-14T18:31:26.605+0000 7f44dbfe8700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2023-07-14T18:30:51.868462+0000 front 2023-07-14T18:30:51.868670+0000 (oldest deadline 2023-07-14T18:31:17.768517+0000) 2023-07-14T18:31:26.912 INFO:journalctl@ceph.osd.11.smithi184.stdout:Jul 14 18:31:26 smithi184 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-11[120819]: 2023-07-14T18:31:26.605+0000 7f44dbfe8700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.184:6804 osd.2 since back 2023-07-14T18:30:58.269297+0000 front 2023-07-14T18:30:58.269338+0000 (oldest deadline 2023-07-14T18:31:23.569431+0000) 2023-07-14T18:31:26.953 INFO:journalctl@ceph.osd.9.smithi163.stdout:Jul 14 18:31:26 smithi163 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-9[125814]: 2023-07-14T18:31:26.675+0000 7fd0759f3700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.163:6806 osd.0 since back 2023-07-14T18:30:42.661073+0000 front 2023-07-14T18:30:42.661052+0000 (oldest deadline 2023-07-14T18:31:07.961309+0000) 2023-07-14T18:31:26.954 INFO:journalctl@ceph.osd.9.smithi163.stdout:Jul 14 18:31:26 smithi163 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-9[125814]: 2023-07-14T18:31:26.675+0000 7fd0759f3700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2023-07-14T18:30:47.961848+0000 front 2023-07-14T18:30:47.961754+0000 (oldest deadline 2023-07-14T18:31:13.861824+0000) 2023-07-14T18:31:26.955 INFO:journalctl@ceph.osd.9.smithi163.stdout:Jul 14 18:31:26 smithi163 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-9[125814]: 2023-07-14T18:31:26.675+0000 7fd0759f3700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.184:6804 osd.2 since back 2023-07-14T18:30:59.763100+0000 front 2023-07-14T18:30:59.763261+0000 (oldest deadline 2023-07-14T18:31:25.662987+0000) 2023-07-14T18:31:27.262 INFO:journalctl@ceph.osd.10.smithi172.stdout:Jul 14 18:31:27 smithi172 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-10[119489]: 2023-07-14T18:31:27.027+0000 7fe8a6017700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.163:6806 osd.0 since back 2023-07-14T18:30:44.219658+0000 front 2023-07-14T18:30:44.219740+0000 (oldest deadline 2023-07-14T18:31:05.919624+0000) 2023-07-14T18:31:27.262 INFO:journalctl@ceph.osd.10.smithi172.stdout:Jul 14 18:31:27 smithi172 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-10[119489]: 2023-07-14T18:31:27.027+0000 7fe8a6017700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2023-07-14T18:30:51.022066+0000 front 2023-07-14T18:30:51.022166+0000 (oldest deadline 2023-07-14T18:31:13.922245+0000) 2023-07-14T18:31:27.262 INFO:journalctl@ceph.osd.10.smithi172.stdout:Jul 14 18:31:27 smithi172 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-10[119489]: 2023-07-14T18:31:27.027+0000 7fe8a6017700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.184:6804 osd.2 since back 2023-07-14T18:30:59.723894+0000 front 2023-07-14T18:30:59.723980+0000 (oldest deadline 2023-07-14T18:31:21.424006+0000) 2023-07-14T18:31:27.263 INFO:journalctl@ceph.osd.7.smithi172.stdout:Jul 14 18:31:26 smithi172 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-7[114020]: 2023-07-14T18:31:26.963+0000 7f4be707e700 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2023-07-14T18:30:51.994549+0000 front 2023-07-14T18:30:51.994596+0000 (oldest deadline 2023-07-14T18:31:17.294675+0000) 2023-07-14T18:31:27.263 INFO:journalctl@ceph.osd.7.smithi172.stdout:Jul 14 18:31:26 smithi172 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-7[114020]: 2023-07-14T18:31:26.964+0000 7f4be707e700 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.184:6804 osd.2 since back 2023-07-14T18:30:57.295136+0000 front 2023-07-14T18:30:57.295194+0000 (oldest deadline 2023-07-14T18:31:23.195171+0000) 2023-07-14T18:31:27.453 INFO:journalctl@ceph.osd.6.smithi163.stdout:Jul 14 18:31:27 smithi163 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-6[120359]: 2023-07-14T18:31:27.119+0000 7fc691297700 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.163:6806 osd.0 since back 2023-07-14T18:30:41.324204+0000 front 2023-07-14T18:30:41.324276+0000 (oldest deadline 2023-07-14T18:31:07.224382+0000) 2023-07-14T18:31:27.454 INFO:journalctl@ceph.osd.6.smithi163.stdout:Jul 14 18:31:27 smithi163 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-6[120359]: 2023-07-14T18:31:27.119+0000 7fc691297700 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2023-07-14T18:30:52.326778+0000 front 2023-07-14T18:30:52.326716+0000 (oldest deadline 2023-07-14T18:31:14.026594+0000) 2023-07-14T18:31:27.454 INFO:journalctl@ceph.osd.6.smithi163.stdout:Jul 14 18:31:27 smithi163 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-6[120359]: 2023-07-14T18:31:27.119+0000 7fc691297700 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.184:6804 osd.2 since back 2023-07-14T18:31:00.428215+0000 front 2023-07-14T18:31:00.428236+0000 (oldest deadline 2023-07-14T18:31:25.128362+0000) 2023-07-14T18:31:27.911 INFO:journalctl@ceph.osd.8.smithi184.stdout:Jul 14 18:31:27 smithi184 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-8[115280]: 2023-07-14T18:31:27.483+0000 7fa897e34700 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.163:6806 osd.0 since back 2023-07-14T18:30:44.909156+0000 front 2023-07-14T18:30:44.908950+0000 (oldest deadline 2023-07-14T18:31:07.809102+0000) 2023-07-14T18:31:27.911 INFO:journalctl@ceph.osd.8.smithi184.stdout:Jul 14 18:31:27 smithi184 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-8[115280]: 2023-07-14T18:31:27.483+0000 7fa897e34700 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2023-07-14T18:30:47.809828+0000 front 2023-07-14T18:30:47.809790+0000 (oldest deadline 2023-07-14T18:31:18.410275+0000) 2023-07-14T18:31:27.912 INFO:journalctl@ceph.osd.8.smithi184.stdout:Jul 14 18:31:27 smithi184 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-8[115280]: 2023-07-14T18:31:27.483+0000 7fa897e34700 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.184:6804 osd.2 since back 2023-07-14T18:31:00.111285+0000 front 2023-07-14T18:31:00.111392+0000 (oldest deadline 2023-07-14T18:31:21.211412+0000) 2023-07-14T18:31:27.912 INFO:journalctl@ceph.osd.11.smithi184.stdout:Jul 14 18:31:27 smithi184 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-11[120819]: 2023-07-14T18:31:27.567+0000 7f44dbfe8700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.163:6806 osd.0 since back 2023-07-14T18:30:42.566533+0000 front 2023-07-14T18:30:42.566680+0000 (oldest deadline 2023-07-14T18:31:08.967162+0000) 2023-07-14T18:31:27.912 INFO:journalctl@ceph.osd.11.smithi184.stdout:Jul 14 18:31:27 smithi184 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-11[120819]: 2023-07-14T18:31:27.567+0000 7f44dbfe8700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2023-07-14T18:30:51.868462+0000 front 2023-07-14T18:30:51.868670+0000 (oldest deadline 2023-07-14T18:31:17.768517+0000) 2023-07-14T18:31:27.913 INFO:journalctl@ceph.osd.11.smithi184.stdout:Jul 14 18:31:27 smithi184 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-11[120819]: 2023-07-14T18:31:27.567+0000 7f44dbfe8700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.184:6804 osd.2 since back 2023-07-14T18:30:58.269297+0000 front 2023-07-14T18:30:58.269338+0000 (oldest deadline 2023-07-14T18:31:23.569431+0000) 2023-07-14T18:31:27.953 INFO:journalctl@ceph.osd.9.smithi163.stdout:Jul 14 18:31:27 smithi163 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-9[125814]: 2023-07-14T18:31:27.663+0000 7fd0759f3700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.163:6806 osd.0 since back 2023-07-14T18:30:42.661073+0000 front 2023-07-14T18:30:42.661052+0000 (oldest deadline 2023-07-14T18:31:07.961309+0000) 2023-07-14T18:31:27.954 INFO:journalctl@ceph.osd.9.smithi163.stdout:Jul 14 18:31:27 smithi163 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-9[125814]: 2023-07-14T18:31:27.663+0000 7fd0759f3700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2023-07-14T18:30:47.961848+0000 front 2023-07-14T18:30:47.961754+0000 (oldest deadline 2023-07-14T18:31:13.861824+0000) 2023-07-14T18:31:27.954 INFO:journalctl@ceph.osd.9.smithi163.stdout:Jul 14 18:31:27 smithi163 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-9[125814]: 2023-07-14T18:31:27.663+0000 7fd0759f3700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.184:6804 osd.2 since back 2023-07-14T18:30:59.763100+0000 front 2023-07-14T18:30:59.763261+0000 (oldest deadline 2023-07-14T18:31:25.662987+0000) 2023-07-14T18:31:28.262 INFO:journalctl@ceph.osd.10.smithi172.stdout:Jul 14 18:31:28 smithi172 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-10[119489]: 2023-07-14T18:31:28.063+0000 7fe8a6017700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.163:6806 osd.0 since back 2023-07-14T18:30:44.219658+0000 front 2023-07-14T18:30:44.219740+0000 (oldest deadline 2023-07-14T18:31:05.919624+0000) 2023-07-14T18:31:28.262 INFO:journalctl@ceph.osd.10.smithi172.stdout:Jul 14 18:31:28 smithi172 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-10[119489]: 2023-07-14T18:31:28.063+0000 7fe8a6017700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2023-07-14T18:30:51.022066+0000 front 2023-07-14T18:30:51.022166+0000 (oldest deadline 2023-07-14T18:31:13.922245+0000) 2023-07-14T18:31:28.262 INFO:journalctl@ceph.osd.10.smithi172.stdout:Jul 14 18:31:28 smithi172 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-10[119489]: 2023-07-14T18:31:28.063+0000 7fe8a6017700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.184:6804 osd.2 since back 2023-07-14T18:30:59.723894+0000 front 2023-07-14T18:30:59.723980+0000 (oldest deadline 2023-07-14T18:31:21.424006+0000) 2023-07-14T18:31:28.263 INFO:journalctl@ceph.osd.7.smithi172.stdout:Jul 14 18:31:27 smithi172 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-7[114020]: 2023-07-14T18:31:27.955+0000 7f4be707e700 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2023-07-14T18:30:51.994549+0000 front 2023-07-14T18:30:51.994596+0000 (oldest deadline 2023-07-14T18:31:17.294675+0000) 2023-07-14T18:31:28.263 INFO:journalctl@ceph.osd.7.smithi172.stdout:Jul 14 18:31:27 smithi172 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-7[114020]: 2023-07-14T18:31:27.955+0000 7f4be707e700 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.184:6804 osd.2 since back 2023-07-14T18:30:57.295136+0000 front 2023-07-14T18:30:57.295194+0000 (oldest deadline 2023-07-14T18:31:23.195171+0000) 2023-07-14T18:31:28.453 INFO:journalctl@ceph.osd.6.smithi163.stdout:Jul 14 18:31:28 smithi163 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-6[120359]: 2023-07-14T18:31:28.161+0000 7fc691297700 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.163:6806 osd.0 since back 2023-07-14T18:30:41.324204+0000 front 2023-07-14T18:30:41.324276+0000 (oldest deadline 2023-07-14T18:31:07.224382+0000) 2023-07-14T18:31:28.454 INFO:journalctl@ceph.osd.6.smithi163.stdout:Jul 14 18:31:28 smithi163 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-6[120359]: 2023-07-14T18:31:28.161+0000 7fc691297700 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2023-07-14T18:30:52.326778+0000 front 2023-07-14T18:30:52.326716+0000 (oldest deadline 2023-07-14T18:31:14.026594+0000) 2023-07-14T18:31:28.454 INFO:journalctl@ceph.osd.6.smithi163.stdout:Jul 14 18:31:28 smithi163 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-6[120359]: 2023-07-14T18:31:28.161+0000 7fc691297700 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.184:6804 osd.2 since back 2023-07-14T18:31:00.428215+0000 front 2023-07-14T18:31:00.428236+0000 (oldest deadline 2023-07-14T18:31:25.128362+0000) 2023-07-14T18:31:28.911 INFO:journalctl@ceph.osd.8.smithi184.stdout:Jul 14 18:31:28 smithi184 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-8[115280]: 2023-07-14T18:31:28.510+0000 7fa897e34700 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.163:6806 osd.0 since back 2023-07-14T18:30:44.909156+0000 front 2023-07-14T18:30:44.908950+0000 (oldest deadline 2023-07-14T18:31:07.809102+0000) 2023-07-14T18:31:28.911 INFO:journalctl@ceph.osd.8.smithi184.stdout:Jul 14 18:31:28 smithi184 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-8[115280]: 2023-07-14T18:31:28.510+0000 7fa897e34700 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2023-07-14T18:30:47.809828+0000 front 2023-07-14T18:30:47.809790+0000 (oldest deadline 2023-07-14T18:31:18.410275+0000) 2023-07-14T18:31:28.912 INFO:journalctl@ceph.osd.8.smithi184.stdout:Jul 14 18:31:28 smithi184 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-8[115280]: 2023-07-14T18:31:28.510+0000 7fa897e34700 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.184:6804 osd.2 since back 2023-07-14T18:31:00.111285+0000 front 2023-07-14T18:31:00.111392+0000 (oldest deadline 2023-07-14T18:31:21.211412+0000) 2023-07-14T18:31:28.912 INFO:journalctl@ceph.osd.11.smithi184.stdout:Jul 14 18:31:28 smithi184 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-11[120819]: 2023-07-14T18:31:28.580+0000 7f44dbfe8700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.163:6806 osd.0 since back 2023-07-14T18:30:42.566533+0000 front 2023-07-14T18:30:42.566680+0000 (oldest deadline 2023-07-14T18:31:08.967162+0000) 2023-07-14T18:31:28.913 INFO:journalctl@ceph.osd.11.smithi184.stdout:Jul 14 18:31:28 smithi184 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-11[120819]: 2023-07-14T18:31:28.580+0000 7f44dbfe8700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2023-07-14T18:30:51.868462+0000 front 2023-07-14T18:30:51.868670+0000 (oldest deadline 2023-07-14T18:31:17.768517+0000) 2023-07-14T18:31:28.913 INFO:journalctl@ceph.osd.11.smithi184.stdout:Jul 14 18:31:28 smithi184 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-11[120819]: 2023-07-14T18:31:28.580+0000 7f44dbfe8700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.184:6804 osd.2 since back 2023-07-14T18:30:58.269297+0000 front 2023-07-14T18:30:58.269338+0000 (oldest deadline 2023-07-14T18:31:23.569431+0000) 2023-07-14T18:31:28.953 INFO:journalctl@ceph.osd.9.smithi163.stdout:Jul 14 18:31:28 smithi163 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-9[125814]: 2023-07-14T18:31:28.628+0000 7fd0759f3700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.163:6806 osd.0 since back 2023-07-14T18:30:42.661073+0000 front 2023-07-14T18:30:42.661052+0000 (oldest deadline 2023-07-14T18:31:07.961309+0000) 2023-07-14T18:31:28.954 INFO:journalctl@ceph.osd.9.smithi163.stdout:Jul 14 18:31:28 smithi163 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-9[125814]: 2023-07-14T18:31:28.628+0000 7fd0759f3700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2023-07-14T18:30:47.961848+0000 front 2023-07-14T18:30:47.961754+0000 (oldest deadline 2023-07-14T18:31:13.861824+0000) 2023-07-14T18:31:28.954 INFO:journalctl@ceph.osd.9.smithi163.stdout:Jul 14 18:31:28 smithi163 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-9[125814]: 2023-07-14T18:31:28.628+0000 7fd0759f3700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.184:6804 osd.2 since back 2023-07-14T18:30:59.763100+0000 front 2023-07-14T18:30:59.763261+0000 (oldest deadline 2023-07-14T18:31:25.662987+0000) 2023-07-14T18:31:29.262 INFO:journalctl@ceph.osd.10.smithi172.stdout:Jul 14 18:31:29 smithi172 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-10[119489]: 2023-07-14T18:31:29.090+0000 7fe8a6017700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.163:6806 osd.0 since back 2023-07-14T18:30:44.219658+0000 front 2023-07-14T18:30:44.219740+0000 (oldest deadline 2023-07-14T18:31:05.919624+0000) 2023-07-14T18:31:29.262 INFO:journalctl@ceph.osd.10.smithi172.stdout:Jul 14 18:31:29 smithi172 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-10[119489]: 2023-07-14T18:31:29.090+0000 7fe8a6017700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2023-07-14T18:30:51.022066+0000 front 2023-07-14T18:30:51.022166+0000 (oldest deadline 2023-07-14T18:31:13.922245+0000) 2023-07-14T18:31:29.262 INFO:journalctl@ceph.osd.10.smithi172.stdout:Jul 14 18:31:29 smithi172 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-10[119489]: 2023-07-14T18:31:29.090+0000 7fe8a6017700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.184:6804 osd.2 since back 2023-07-14T18:30:59.723894+0000 front 2023-07-14T18:30:59.723980+0000 (oldest deadline 2023-07-14T18:31:21.424006+0000) 2023-07-14T18:31:29.263 INFO:journalctl@ceph.osd.7.smithi172.stdout:Jul 14 18:31:28 smithi172 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-7[114020]: 2023-07-14T18:31:28.907+0000 7f4be707e700 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2023-07-14T18:30:51.994549+0000 front 2023-07-14T18:30:51.994596+0000 (oldest deadline 2023-07-14T18:31:17.294675+0000) 2023-07-14T18:31:29.263 INFO:journalctl@ceph.osd.7.smithi172.stdout:Jul 14 18:31:28 smithi172 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-7[114020]: 2023-07-14T18:31:28.907+0000 7f4be707e700 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.184:6804 osd.2 since back 2023-07-14T18:30:57.295136+0000 front 2023-07-14T18:30:57.295194+0000 (oldest deadline 2023-07-14T18:31:23.195171+0000) 2023-07-14T18:31:29.453 INFO:journalctl@ceph.osd.6.smithi163.stdout:Jul 14 18:31:29 smithi163 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-6[120359]: 2023-07-14T18:31:29.132+0000 7fc691297700 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.163:6806 osd.0 since back 2023-07-14T18:30:41.324204+0000 front 2023-07-14T18:30:41.324276+0000 (oldest deadline 2023-07-14T18:31:07.224382+0000) 2023-07-14T18:31:29.453 INFO:journalctl@ceph.osd.6.smithi163.stdout:Jul 14 18:31:29 smithi163 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-6[120359]: 2023-07-14T18:31:29.132+0000 7fc691297700 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2023-07-14T18:30:52.326778+0000 front 2023-07-14T18:30:52.326716+0000 (oldest deadline 2023-07-14T18:31:14.026594+0000) 2023-07-14T18:31:29.454 INFO:journalctl@ceph.osd.6.smithi163.stdout:Jul 14 18:31:29 smithi163 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-6[120359]: 2023-07-14T18:31:29.132+0000 7fc691297700 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.184:6804 osd.2 since back 2023-07-14T18:31:00.428215+0000 front 2023-07-14T18:31:00.428236+0000 (oldest deadline 2023-07-14T18:31:25.128362+0000) 2023-07-14T18:31:29.454 INFO:journalctl@ceph.osd.6.smithi163.stdout:Jul 14 18:31:29 smithi163 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-6[120359]: 2023-07-14T18:31:29.132+0000 7fc691297700 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.163:6814 osd.3 since back 2023-07-14T18:31:07.429204+0000 front 2023-07-14T18:31:07.429246+0000 (oldest deadline 2023-07-14T18:31:29.129436+0000) 2023-07-14T18:31:29.911 INFO:journalctl@ceph.osd.8.smithi184.stdout:Jul 14 18:31:29 smithi184 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-8[115280]: 2023-07-14T18:31:29.507+0000 7fa897e34700 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.163:6806 osd.0 since back 2023-07-14T18:30:44.909156+0000 front 2023-07-14T18:30:44.908950+0000 (oldest deadline 2023-07-14T18:31:07.809102+0000) 2023-07-14T18:31:29.911 INFO:journalctl@ceph.osd.8.smithi184.stdout:Jul 14 18:31:29 smithi184 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-8[115280]: 2023-07-14T18:31:29.507+0000 7fa897e34700 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2023-07-14T18:30:47.809828+0000 front 2023-07-14T18:30:47.809790+0000 (oldest deadline 2023-07-14T18:31:18.410275+0000) 2023-07-14T18:31:29.911 INFO:journalctl@ceph.osd.8.smithi184.stdout:Jul 14 18:31:29 smithi184 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-8[115280]: 2023-07-14T18:31:29.507+0000 7fa897e34700 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.184:6804 osd.2 since back 2023-07-14T18:31:00.111285+0000 front 2023-07-14T18:31:00.111392+0000 (oldest deadline 2023-07-14T18:31:21.211412+0000) 2023-07-14T18:31:29.912 INFO:journalctl@ceph.osd.11.smithi184.stdout:Jul 14 18:31:29 smithi184 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-11[120819]: 2023-07-14T18:31:29.558+0000 7f44dbfe8700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.163:6806 osd.0 since back 2023-07-14T18:30:42.566533+0000 front 2023-07-14T18:30:42.566680+0000 (oldest deadline 2023-07-14T18:31:08.967162+0000) 2023-07-14T18:31:29.912 INFO:journalctl@ceph.osd.11.smithi184.stdout:Jul 14 18:31:29 smithi184 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-11[120819]: 2023-07-14T18:31:29.558+0000 7f44dbfe8700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2023-07-14T18:30:51.868462+0000 front 2023-07-14T18:30:51.868670+0000 (oldest deadline 2023-07-14T18:31:17.768517+0000) 2023-07-14T18:31:29.912 INFO:journalctl@ceph.osd.11.smithi184.stdout:Jul 14 18:31:29 smithi184 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-11[120819]: 2023-07-14T18:31:29.558+0000 7f44dbfe8700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.184:6804 osd.2 since back 2023-07-14T18:30:58.269297+0000 front 2023-07-14T18:30:58.269338+0000 (oldest deadline 2023-07-14T18:31:23.569431+0000) 2023-07-14T18:31:29.953 INFO:journalctl@ceph.osd.9.smithi163.stdout:Jul 14 18:31:29 smithi163 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-9[125814]: 2023-07-14T18:31:29.601+0000 7fd0759f3700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.163:6806 osd.0 since back 2023-07-14T18:30:42.661073+0000 front 2023-07-14T18:30:42.661052+0000 (oldest deadline 2023-07-14T18:31:07.961309+0000) 2023-07-14T18:31:29.953 INFO:journalctl@ceph.osd.9.smithi163.stdout:Jul 14 18:31:29 smithi163 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-9[125814]: 2023-07-14T18:31:29.601+0000 7fd0759f3700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2023-07-14T18:30:47.961848+0000 front 2023-07-14T18:30:47.961754+0000 (oldest deadline 2023-07-14T18:31:13.861824+0000) 2023-07-14T18:31:29.954 INFO:journalctl@ceph.osd.9.smithi163.stdout:Jul 14 18:31:29 smithi163 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-9[125814]: 2023-07-14T18:31:29.601+0000 7fd0759f3700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.184:6804 osd.2 since back 2023-07-14T18:30:59.763100+0000 front 2023-07-14T18:30:59.763261+0000 (oldest deadline 2023-07-14T18:31:25.662987+0000) 2023-07-14T18:31:30.262 INFO:journalctl@ceph.osd.10.smithi172.stdout:Jul 14 18:31:30 smithi172 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-10[119489]: 2023-07-14T18:31:30.084+0000 7fe8a6017700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.163:6806 osd.0 since back 2023-07-14T18:30:44.219658+0000 front 2023-07-14T18:30:44.219740+0000 (oldest deadline 2023-07-14T18:31:05.919624+0000) 2023-07-14T18:31:30.262 INFO:journalctl@ceph.osd.10.smithi172.stdout:Jul 14 18:31:30 smithi172 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-10[119489]: 2023-07-14T18:31:30.084+0000 7fe8a6017700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2023-07-14T18:30:51.022066+0000 front 2023-07-14T18:30:51.022166+0000 (oldest deadline 2023-07-14T18:31:13.922245+0000) 2023-07-14T18:31:30.263 INFO:journalctl@ceph.osd.10.smithi172.stdout:Jul 14 18:31:30 smithi172 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-10[119489]: 2023-07-14T18:31:30.084+0000 7fe8a6017700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.184:6804 osd.2 since back 2023-07-14T18:30:59.723894+0000 front 2023-07-14T18:30:59.723980+0000 (oldest deadline 2023-07-14T18:31:21.424006+0000) 2023-07-14T18:31:30.263 INFO:journalctl@ceph.osd.7.smithi172.stdout:Jul 14 18:31:29 smithi172 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-7[114020]: 2023-07-14T18:31:29.955+0000 7f4be707e700 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2023-07-14T18:30:51.994549+0000 front 2023-07-14T18:30:51.994596+0000 (oldest deadline 2023-07-14T18:31:17.294675+0000) 2023-07-14T18:31:30.263 INFO:journalctl@ceph.osd.7.smithi172.stdout:Jul 14 18:31:29 smithi172 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-7[114020]: 2023-07-14T18:31:29.955+0000 7f4be707e700 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.184:6804 osd.2 since back 2023-07-14T18:30:57.295136+0000 front 2023-07-14T18:30:57.295194+0000 (oldest deadline 2023-07-14T18:31:23.195171+0000) 2023-07-14T18:31:30.263 INFO:journalctl@ceph.osd.7.smithi172.stdout:Jul 14 18:31:29 smithi172 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-7[114020]: 2023-07-14T18:31:29.955+0000 7f4be707e700 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.163:6814 osd.3 since back 2023-07-14T18:31:07.296357+0000 front 2023-07-14T18:31:07.296344+0000 (oldest deadline 2023-07-14T18:31:29.596299+0000) 2023-07-14T18:31:30.453 INFO:journalctl@ceph.osd.6.smithi163.stdout:Jul 14 18:31:30 smithi163 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-6[120359]: 2023-07-14T18:31:30.158+0000 7fc691297700 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.163:6806 osd.0 since back 2023-07-14T18:30:41.324204+0000 front 2023-07-14T18:30:41.324276+0000 (oldest deadline 2023-07-14T18:31:07.224382+0000) 2023-07-14T18:31:30.453 INFO:journalctl@ceph.osd.6.smithi163.stdout:Jul 14 18:31:30 smithi163 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-6[120359]: 2023-07-14T18:31:30.158+0000 7fc691297700 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2023-07-14T18:30:52.326778+0000 front 2023-07-14T18:30:52.326716+0000 (oldest deadline 2023-07-14T18:31:14.026594+0000) 2023-07-14T18:31:30.454 INFO:journalctl@ceph.osd.6.smithi163.stdout:Jul 14 18:31:30 smithi163 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-6[120359]: 2023-07-14T18:31:30.158+0000 7fc691297700 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.184:6804 osd.2 since back 2023-07-14T18:31:00.428215+0000 front 2023-07-14T18:31:00.428236+0000 (oldest deadline 2023-07-14T18:31:25.128362+0000) 2023-07-14T18:31:30.454 INFO:journalctl@ceph.osd.6.smithi163.stdout:Jul 14 18:31:30 smithi163 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-6[120359]: 2023-07-14T18:31:30.158+0000 7fc691297700 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.163:6814 osd.3 since back 2023-07-14T18:31:07.429204+0000 front 2023-07-14T18:31:07.429246+0000 (oldest deadline 2023-07-14T18:31:29.129436+0000) 2023-07-14T18:31:30.911 INFO:journalctl@ceph.osd.8.smithi184.stdout:Jul 14 18:31:30 smithi184 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-8[115280]: 2023-07-14T18:31:30.461+0000 7fa897e34700 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.163:6806 osd.0 since back 2023-07-14T18:30:44.909156+0000 front 2023-07-14T18:30:44.908950+0000 (oldest deadline 2023-07-14T18:31:07.809102+0000) 2023-07-14T18:31:30.911 INFO:journalctl@ceph.osd.8.smithi184.stdout:Jul 14 18:31:30 smithi184 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-8[115280]: 2023-07-14T18:31:30.461+0000 7fa897e34700 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2023-07-14T18:30:47.809828+0000 front 2023-07-14T18:30:47.809790+0000 (oldest deadline 2023-07-14T18:31:18.410275+0000) 2023-07-14T18:31:30.911 INFO:journalctl@ceph.osd.8.smithi184.stdout:Jul 14 18:31:30 smithi184 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-8[115280]: 2023-07-14T18:31:30.461+0000 7fa897e34700 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.184:6804 osd.2 since back 2023-07-14T18:31:00.111285+0000 front 2023-07-14T18:31:00.111392+0000 (oldest deadline 2023-07-14T18:31:21.211412+0000) 2023-07-14T18:31:30.912 INFO:journalctl@ceph.osd.11.smithi184.stdout:Jul 14 18:31:30 smithi184 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-11[120819]: 2023-07-14T18:31:30.567+0000 7f44dbfe8700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.163:6806 osd.0 since back 2023-07-14T18:30:42.566533+0000 front 2023-07-14T18:30:42.566680+0000 (oldest deadline 2023-07-14T18:31:08.967162+0000) 2023-07-14T18:31:30.912 INFO:journalctl@ceph.osd.11.smithi184.stdout:Jul 14 18:31:30 smithi184 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-11[120819]: 2023-07-14T18:31:30.567+0000 7f44dbfe8700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2023-07-14T18:30:51.868462+0000 front 2023-07-14T18:30:51.868670+0000 (oldest deadline 2023-07-14T18:31:17.768517+0000) 2023-07-14T18:31:30.912 INFO:journalctl@ceph.osd.11.smithi184.stdout:Jul 14 18:31:30 smithi184 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-11[120819]: 2023-07-14T18:31:30.567+0000 7f44dbfe8700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.184:6804 osd.2 since back 2023-07-14T18:30:58.269297+0000 front 2023-07-14T18:30:58.269338+0000 (oldest deadline 2023-07-14T18:31:23.569431+0000) 2023-07-14T18:31:30.953 INFO:journalctl@ceph.osd.9.smithi163.stdout:Jul 14 18:31:30 smithi163 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-9[125814]: 2023-07-14T18:31:30.630+0000 7fd0759f3700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.163:6806 osd.0 since back 2023-07-14T18:30:42.661073+0000 front 2023-07-14T18:30:42.661052+0000 (oldest deadline 2023-07-14T18:31:07.961309+0000) 2023-07-14T18:31:30.953 INFO:journalctl@ceph.osd.9.smithi163.stdout:Jul 14 18:31:30 smithi163 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-9[125814]: 2023-07-14T18:31:30.630+0000 7fd0759f3700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2023-07-14T18:30:47.961848+0000 front 2023-07-14T18:30:47.961754+0000 (oldest deadline 2023-07-14T18:31:13.861824+0000) 2023-07-14T18:31:30.954 INFO:journalctl@ceph.osd.9.smithi163.stdout:Jul 14 18:31:30 smithi163 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-9[125814]: 2023-07-14T18:31:30.630+0000 7fd0759f3700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.184:6804 osd.2 since back 2023-07-14T18:30:59.763100+0000 front 2023-07-14T18:30:59.763261+0000 (oldest deadline 2023-07-14T18:31:25.662987+0000) 2023-07-14T18:31:31.261 INFO:journalctl@ceph.osd.10.smithi172.stdout:Jul 14 18:31:31 smithi172 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-10[119489]: 2023-07-14T18:31:31.100+0000 7fe8a6017700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.163:6806 osd.0 since back 2023-07-14T18:30:44.219658+0000 front 2023-07-14T18:30:44.219740+0000 (oldest deadline 2023-07-14T18:31:05.919624+0000) 2023-07-14T18:31:31.262 INFO:journalctl@ceph.osd.10.smithi172.stdout:Jul 14 18:31:31 smithi172 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-10[119489]: 2023-07-14T18:31:31.100+0000 7fe8a6017700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2023-07-14T18:30:51.022066+0000 front 2023-07-14T18:30:51.022166+0000 (oldest deadline 2023-07-14T18:31:13.922245+0000) 2023-07-14T18:31:31.262 INFO:journalctl@ceph.osd.10.smithi172.stdout:Jul 14 18:31:31 smithi172 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-10[119489]: 2023-07-14T18:31:31.100+0000 7fe8a6017700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.184:6804 osd.2 since back 2023-07-14T18:30:59.723894+0000 front 2023-07-14T18:30:59.723980+0000 (oldest deadline 2023-07-14T18:31:21.424006+0000) 2023-07-14T18:31:31.262 INFO:journalctl@ceph.osd.7.smithi172.stdout:Jul 14 18:31:30 smithi172 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-7[114020]: 2023-07-14T18:31:30.949+0000 7f4be707e700 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2023-07-14T18:30:51.994549+0000 front 2023-07-14T18:30:51.994596+0000 (oldest deadline 2023-07-14T18:31:17.294675+0000) 2023-07-14T18:31:31.263 INFO:journalctl@ceph.osd.7.smithi172.stdout:Jul 14 18:31:30 smithi172 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-7[114020]: 2023-07-14T18:31:30.949+0000 7f4be707e700 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.184:6804 osd.2 since back 2023-07-14T18:30:57.295136+0000 front 2023-07-14T18:30:57.295194+0000 (oldest deadline 2023-07-14T18:31:23.195171+0000) 2023-07-14T18:31:31.263 INFO:journalctl@ceph.osd.7.smithi172.stdout:Jul 14 18:31:30 smithi172 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-7[114020]: 2023-07-14T18:31:30.949+0000 7f4be707e700 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.163:6814 osd.3 since back 2023-07-14T18:31:07.296357+0000 front 2023-07-14T18:31:07.296344+0000 (oldest deadline 2023-07-14T18:31:29.596299+0000) 2023-07-14T18:31:31.453 INFO:journalctl@ceph.osd.6.smithi163.stdout:Jul 14 18:31:31 smithi163 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-6[120359]: 2023-07-14T18:31:31.132+0000 7fc691297700 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.163:6806 osd.0 since back 2023-07-14T18:30:41.324204+0000 front 2023-07-14T18:30:41.324276+0000 (oldest deadline 2023-07-14T18:31:07.224382+0000) 2023-07-14T18:31:31.454 INFO:journalctl@ceph.osd.6.smithi163.stdout:Jul 14 18:31:31 smithi163 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-6[120359]: 2023-07-14T18:31:31.132+0000 7fc691297700 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2023-07-14T18:30:52.326778+0000 front 2023-07-14T18:30:52.326716+0000 (oldest deadline 2023-07-14T18:31:14.026594+0000) 2023-07-14T18:31:31.454 INFO:journalctl@ceph.osd.6.smithi163.stdout:Jul 14 18:31:31 smithi163 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-6[120359]: 2023-07-14T18:31:31.132+0000 7fc691297700 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.184:6804 osd.2 since back 2023-07-14T18:31:00.428215+0000 front 2023-07-14T18:31:00.428236+0000 (oldest deadline 2023-07-14T18:31:25.128362+0000) 2023-07-14T18:31:31.454 INFO:journalctl@ceph.osd.6.smithi163.stdout:Jul 14 18:31:31 smithi163 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-6[120359]: 2023-07-14T18:31:31.132+0000 7fc691297700 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.163:6814 osd.3 since back 2023-07-14T18:31:07.429204+0000 front 2023-07-14T18:31:07.429246+0000 (oldest deadline 2023-07-14T18:31:29.129436+0000) 2023-07-14T18:31:31.911 INFO:journalctl@ceph.osd.8.smithi184.stdout:Jul 14 18:31:31 smithi184 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-8[115280]: 2023-07-14T18:31:31.414+0000 7fa897e34700 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.163:6806 osd.0 since back 2023-07-14T18:30:44.909156+0000 front 2023-07-14T18:30:44.908950+0000 (oldest deadline 2023-07-14T18:31:07.809102+0000) 2023-07-14T18:31:31.911 INFO:journalctl@ceph.osd.8.smithi184.stdout:Jul 14 18:31:31 smithi184 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-8[115280]: 2023-07-14T18:31:31.414+0000 7fa897e34700 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2023-07-14T18:30:47.809828+0000 front 2023-07-14T18:30:47.809790+0000 (oldest deadline 2023-07-14T18:31:18.410275+0000) 2023-07-14T18:31:31.911 INFO:journalctl@ceph.osd.8.smithi184.stdout:Jul 14 18:31:31 smithi184 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-8[115280]: 2023-07-14T18:31:31.414+0000 7fa897e34700 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.184:6804 osd.2 since back 2023-07-14T18:31:00.111285+0000 front 2023-07-14T18:31:00.111392+0000 (oldest deadline 2023-07-14T18:31:21.211412+0000) 2023-07-14T18:31:31.912 INFO:journalctl@ceph.osd.11.smithi184.stdout:Jul 14 18:31:31 smithi184 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-11[120819]: 2023-07-14T18:31:31.579+0000 7f44dbfe8700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.163:6806 osd.0 since back 2023-07-14T18:30:42.566533+0000 front 2023-07-14T18:30:42.566680+0000 (oldest deadline 2023-07-14T18:31:08.967162+0000) 2023-07-14T18:31:31.912 INFO:journalctl@ceph.osd.11.smithi184.stdout:Jul 14 18:31:31 smithi184 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-11[120819]: 2023-07-14T18:31:31.579+0000 7f44dbfe8700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2023-07-14T18:30:51.868462+0000 front 2023-07-14T18:30:51.868670+0000 (oldest deadline 2023-07-14T18:31:17.768517+0000) 2023-07-14T18:31:31.912 INFO:journalctl@ceph.osd.11.smithi184.stdout:Jul 14 18:31:31 smithi184 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-11[120819]: 2023-07-14T18:31:31.579+0000 7f44dbfe8700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.184:6804 osd.2 since back 2023-07-14T18:30:58.269297+0000 front 2023-07-14T18:30:58.269338+0000 (oldest deadline 2023-07-14T18:31:23.569431+0000) 2023-07-14T18:31:31.953 INFO:journalctl@ceph.osd.6.smithi163.stdout:Jul 14 18:31:31 smithi163 bash[174324]: ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-6 2023-07-14T18:31:31.953 INFO:journalctl@ceph.osd.9.smithi163.stdout:Jul 14 18:31:31 smithi163 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-9[125814]: 2023-07-14T18:31:31.626+0000 7fd0759f3700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.163:6806 osd.0 since back 2023-07-14T18:30:42.661073+0000 front 2023-07-14T18:30:42.661052+0000 (oldest deadline 2023-07-14T18:31:07.961309+0000) 2023-07-14T18:31:31.954 INFO:journalctl@ceph.osd.9.smithi163.stdout:Jul 14 18:31:31 smithi163 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-9[125814]: 2023-07-14T18:31:31.626+0000 7fd0759f3700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2023-07-14T18:30:47.961848+0000 front 2023-07-14T18:30:47.961754+0000 (oldest deadline 2023-07-14T18:31:13.861824+0000) 2023-07-14T18:31:31.954 INFO:journalctl@ceph.osd.9.smithi163.stdout:Jul 14 18:31:31 smithi163 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-9[125814]: 2023-07-14T18:31:31.626+0000 7fd0759f3700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.184:6804 osd.2 since back 2023-07-14T18:30:59.763100+0000 front 2023-07-14T18:30:59.763261+0000 (oldest deadline 2023-07-14T18:31:25.662987+0000) 2023-07-14T18:31:31.954 INFO:journalctl@ceph.osd.9.smithi163.stdout:Jul 14 18:31:31 smithi163 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-9[125814]: 2023-07-14T18:31:31.626+0000 7fd0759f3700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.163:6814 osd.3 since back 2023-07-14T18:31:05.663336+0000 front 2023-07-14T18:31:05.663310+0000 (oldest deadline 2023-07-14T18:31:30.963470+0000) 2023-07-14T18:31:32.261 INFO:journalctl@ceph.osd.10.smithi172.stdout:Jul 14 18:31:32 smithi172 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-10[119489]: 2023-07-14T18:31:32.058+0000 7fe8a6017700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.163:6806 osd.0 since back 2023-07-14T18:30:44.219658+0000 front 2023-07-14T18:30:44.219740+0000 (oldest deadline 2023-07-14T18:31:05.919624+0000) 2023-07-14T18:31:32.262 INFO:journalctl@ceph.osd.10.smithi172.stdout:Jul 14 18:31:32 smithi172 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-10[119489]: 2023-07-14T18:31:32.058+0000 7fe8a6017700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2023-07-14T18:30:51.022066+0000 front 2023-07-14T18:30:51.022166+0000 (oldest deadline 2023-07-14T18:31:13.922245+0000) 2023-07-14T18:31:32.262 INFO:journalctl@ceph.osd.10.smithi172.stdout:Jul 14 18:31:32 smithi172 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-10[119489]: 2023-07-14T18:31:32.058+0000 7fe8a6017700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.184:6804 osd.2 since back 2023-07-14T18:30:59.723894+0000 front 2023-07-14T18:30:59.723980+0000 (oldest deadline 2023-07-14T18:31:21.424006+0000) 2023-07-14T18:31:32.262 INFO:journalctl@ceph.osd.10.smithi172.stdout:Jul 14 18:31:32 smithi172 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-10[119489]: 2023-07-14T18:31:32.058+0000 7fe8a6017700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.163:6814 osd.3 since back 2023-07-14T18:31:07.126091+0000 front 2023-07-14T18:31:07.126185+0000 (oldest deadline 2023-07-14T18:31:31.826180+0000) 2023-07-14T18:31:32.263 INFO:journalctl@ceph.osd.7.smithi172.stdout:Jul 14 18:31:31 smithi172 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-7[114020]: 2023-07-14T18:31:31.900+0000 7f4be707e700 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2023-07-14T18:30:51.994549+0000 front 2023-07-14T18:30:51.994596+0000 (oldest deadline 2023-07-14T18:31:17.294675+0000) 2023-07-14T18:31:32.263 INFO:journalctl@ceph.osd.7.smithi172.stdout:Jul 14 18:31:31 smithi172 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-7[114020]: 2023-07-14T18:31:31.900+0000 7f4be707e700 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.184:6804 osd.2 since back 2023-07-14T18:30:57.295136+0000 front 2023-07-14T18:30:57.295194+0000 (oldest deadline 2023-07-14T18:31:23.195171+0000) 2023-07-14T18:31:32.263 INFO:journalctl@ceph.osd.7.smithi172.stdout:Jul 14 18:31:31 smithi172 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-7[114020]: 2023-07-14T18:31:31.900+0000 7f4be707e700 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.163:6814 osd.3 since back 2023-07-14T18:31:07.296357+0000 front 2023-07-14T18:31:07.296344+0000 (oldest deadline 2023-07-14T18:31:29.596299+0000) 2023-07-14T18:31:32.660 INFO:journalctl@ceph.osd.11.smithi184.stdout:Jul 14 18:31:32 smithi184 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-11[120819]: 2023-07-14T18:31:32.530+0000 7f44dbfe8700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.163:6806 osd.0 since back 2023-07-14T18:30:42.566533+0000 front 2023-07-14T18:30:42.566680+0000 (oldest deadline 2023-07-14T18:31:08.967162+0000) 2023-07-14T18:31:32.661 INFO:journalctl@ceph.osd.11.smithi184.stdout:Jul 14 18:31:32 smithi184 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-11[120819]: 2023-07-14T18:31:32.530+0000 7f44dbfe8700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2023-07-14T18:30:51.868462+0000 front 2023-07-14T18:30:51.868670+0000 (oldest deadline 2023-07-14T18:31:17.768517+0000) 2023-07-14T18:31:32.661 INFO:journalctl@ceph.osd.11.smithi184.stdout:Jul 14 18:31:32 smithi184 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-11[120819]: 2023-07-14T18:31:32.530+0000 7f44dbfe8700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.184:6804 osd.2 since back 2023-07-14T18:30:58.269297+0000 front 2023-07-14T18:30:58.269338+0000 (oldest deadline 2023-07-14T18:31:23.569431+0000) 2023-07-14T18:31:32.661 INFO:journalctl@ceph.osd.8.smithi184.stdout:Jul 14 18:31:32 smithi184 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-8[115280]: 2023-07-14T18:31:32.372+0000 7fa897e34700 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.163:6806 osd.0 since back 2023-07-14T18:30:44.909156+0000 front 2023-07-14T18:30:44.908950+0000 (oldest deadline 2023-07-14T18:31:07.809102+0000) 2023-07-14T18:31:32.662 INFO:journalctl@ceph.osd.8.smithi184.stdout:Jul 14 18:31:32 smithi184 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-8[115280]: 2023-07-14T18:31:32.372+0000 7fa897e34700 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2023-07-14T18:30:47.809828+0000 front 2023-07-14T18:30:47.809790+0000 (oldest deadline 2023-07-14T18:31:18.410275+0000) 2023-07-14T18:31:32.662 INFO:journalctl@ceph.osd.8.smithi184.stdout:Jul 14 18:31:32 smithi184 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-8[115280]: 2023-07-14T18:31:32.372+0000 7fa897e34700 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.184:6804 osd.2 since back 2023-07-14T18:31:00.111285+0000 front 2023-07-14T18:31:00.111392+0000 (oldest deadline 2023-07-14T18:31:21.211412+0000) 2023-07-14T18:31:32.662 INFO:journalctl@ceph.osd.8.smithi184.stdout:Jul 14 18:31:32 smithi184 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-8[115280]: 2023-07-14T18:31:32.372+0000 7fa897e34700 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.163:6814 osd.3 since back 2023-07-14T18:31:07.112570+0000 front 2023-07-14T18:31:07.112507+0000 (oldest deadline 2023-07-14T18:31:31.812314+0000) 2023-07-14T18:31:32.703 INFO:journalctl@ceph.osd.9.smithi163.stdout:Jul 14 18:31:32 smithi163 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-9[125814]: 2023-07-14T18:31:32.596+0000 7fd0759f3700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.163:6806 osd.0 since back 2023-07-14T18:30:42.661073+0000 front 2023-07-14T18:30:42.661052+0000 (oldest deadline 2023-07-14T18:31:07.961309+0000) 2023-07-14T18:31:32.704 INFO:journalctl@ceph.osd.9.smithi163.stdout:Jul 14 18:31:32 smithi163 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-9[125814]: 2023-07-14T18:31:32.596+0000 7fd0759f3700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2023-07-14T18:30:47.961848+0000 front 2023-07-14T18:30:47.961754+0000 (oldest deadline 2023-07-14T18:31:13.861824+0000) 2023-07-14T18:31:32.704 INFO:journalctl@ceph.osd.9.smithi163.stdout:Jul 14 18:31:32 smithi163 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-9[125814]: 2023-07-14T18:31:32.596+0000 7fd0759f3700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.184:6804 osd.2 since back 2023-07-14T18:30:59.763100+0000 front 2023-07-14T18:30:59.763261+0000 (oldest deadline 2023-07-14T18:31:25.662987+0000) 2023-07-14T18:31:32.704 INFO:journalctl@ceph.osd.9.smithi163.stdout:Jul 14 18:31:32 smithi163 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-9[125814]: 2023-07-14T18:31:32.596+0000 7fd0759f3700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.163:6814 osd.3 since back 2023-07-14T18:31:05.663336+0000 front 2023-07-14T18:31:05.663310+0000 (oldest deadline 2023-07-14T18:31:30.963470+0000) 2023-07-14T18:31:33.258 DEBUG:teuthology.orchestra.run.smithi163:> sudo pkill -f 'journalctl -f -n 0 -u ceph-bf7326ec-2270-11ee-9b33-001a4aab830c@osd.6.service' 2023-07-14T18:31:33.262 INFO:journalctl@ceph.osd.7.smithi172.stdout:Jul 14 18:31:32 smithi172 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-7[114020]: 2023-07-14T18:31:32.875+0000 7f4be707e700 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2023-07-14T18:30:51.994549+0000 front 2023-07-14T18:30:51.994596+0000 (oldest deadline 2023-07-14T18:31:17.294675+0000) 2023-07-14T18:31:33.262 INFO:journalctl@ceph.osd.7.smithi172.stdout:Jul 14 18:31:32 smithi172 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-7[114020]: 2023-07-14T18:31:32.875+0000 7f4be707e700 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.184:6804 osd.2 since back 2023-07-14T18:30:57.295136+0000 front 2023-07-14T18:30:57.295194+0000 (oldest deadline 2023-07-14T18:31:23.195171+0000) 2023-07-14T18:31:33.263 INFO:journalctl@ceph.osd.7.smithi172.stdout:Jul 14 18:31:32 smithi172 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-7[114020]: 2023-07-14T18:31:32.875+0000 7f4be707e700 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.163:6814 osd.3 since back 2023-07-14T18:31:07.296357+0000 front 2023-07-14T18:31:07.296344+0000 (oldest deadline 2023-07-14T18:31:29.596299+0000) 2023-07-14T18:31:33.263 INFO:journalctl@ceph.osd.10.smithi172.stdout:Jul 14 18:31:33 smithi172 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-10[119489]: 2023-07-14T18:31:33.021+0000 7fe8a6017700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.163:6806 osd.0 since back 2023-07-14T18:30:44.219658+0000 front 2023-07-14T18:30:44.219740+0000 (oldest deadline 2023-07-14T18:31:05.919624+0000) 2023-07-14T18:31:33.264 INFO:journalctl@ceph.osd.10.smithi172.stdout:Jul 14 18:31:33 smithi172 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-10[119489]: 2023-07-14T18:31:33.021+0000 7fe8a6017700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2023-07-14T18:30:51.022066+0000 front 2023-07-14T18:30:51.022166+0000 (oldest deadline 2023-07-14T18:31:13.922245+0000) 2023-07-14T18:31:33.264 INFO:journalctl@ceph.osd.10.smithi172.stdout:Jul 14 18:31:33 smithi172 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-10[119489]: 2023-07-14T18:31:33.021+0000 7fe8a6017700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.184:6804 osd.2 since back 2023-07-14T18:30:59.723894+0000 front 2023-07-14T18:30:59.723980+0000 (oldest deadline 2023-07-14T18:31:21.424006+0000) 2023-07-14T18:31:33.265 INFO:journalctl@ceph.osd.10.smithi172.stdout:Jul 14 18:31:33 smithi172 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-10[119489]: 2023-07-14T18:31:33.021+0000 7fe8a6017700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.163:6814 osd.3 since back 2023-07-14T18:31:07.126091+0000 front 2023-07-14T18:31:07.126185+0000 (oldest deadline 2023-07-14T18:31:31.826180+0000) 2023-07-14T18:31:33.302 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-07-14T18:31:33.302 INFO:tasks.cephadm.osd.6:Stopped osd.6 2023-07-14T18:31:33.303 INFO:tasks.cephadm.osd.7:Stopping osd.7... 2023-07-14T18:31:33.303 DEBUG:teuthology.orchestra.run.smithi172:> sudo systemctl stop ceph-bf7326ec-2270-11ee-9b33-001a4aab830c@osd.7 2023-07-14T18:31:33.661 INFO:journalctl@ceph.osd.11.smithi184.stdout:Jul 14 18:31:33 smithi184 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-11[120819]: 2023-07-14T18:31:33.540+0000 7f44dbfe8700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.163:6806 osd.0 since back 2023-07-14T18:30:42.566533+0000 front 2023-07-14T18:30:42.566680+0000 (oldest deadline 2023-07-14T18:31:08.967162+0000) 2023-07-14T18:31:33.661 INFO:journalctl@ceph.osd.11.smithi184.stdout:Jul 14 18:31:33 smithi184 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-11[120819]: 2023-07-14T18:31:33.540+0000 7f44dbfe8700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2023-07-14T18:30:51.868462+0000 front 2023-07-14T18:30:51.868670+0000 (oldest deadline 2023-07-14T18:31:17.768517+0000) 2023-07-14T18:31:33.661 INFO:journalctl@ceph.osd.11.smithi184.stdout:Jul 14 18:31:33 smithi184 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-11[120819]: 2023-07-14T18:31:33.540+0000 7f44dbfe8700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.184:6804 osd.2 since back 2023-07-14T18:30:58.269297+0000 front 2023-07-14T18:30:58.269338+0000 (oldest deadline 2023-07-14T18:31:23.569431+0000) 2023-07-14T18:31:33.662 INFO:journalctl@ceph.osd.8.smithi184.stdout:Jul 14 18:31:33 smithi184 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-8[115280]: 2023-07-14T18:31:33.326+0000 7fa897e34700 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.163:6806 osd.0 since back 2023-07-14T18:30:44.909156+0000 front 2023-07-14T18:30:44.908950+0000 (oldest deadline 2023-07-14T18:31:07.809102+0000) 2023-07-14T18:31:33.662 INFO:journalctl@ceph.osd.8.smithi184.stdout:Jul 14 18:31:33 smithi184 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-8[115280]: 2023-07-14T18:31:33.326+0000 7fa897e34700 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2023-07-14T18:30:47.809828+0000 front 2023-07-14T18:30:47.809790+0000 (oldest deadline 2023-07-14T18:31:18.410275+0000) 2023-07-14T18:31:33.662 INFO:journalctl@ceph.osd.8.smithi184.stdout:Jul 14 18:31:33 smithi184 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-8[115280]: 2023-07-14T18:31:33.326+0000 7fa897e34700 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.184:6804 osd.2 since back 2023-07-14T18:31:00.111285+0000 front 2023-07-14T18:31:00.111392+0000 (oldest deadline 2023-07-14T18:31:21.211412+0000) 2023-07-14T18:31:33.662 INFO:journalctl@ceph.osd.8.smithi184.stdout:Jul 14 18:31:33 smithi184 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-8[115280]: 2023-07-14T18:31:33.326+0000 7fa897e34700 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.163:6814 osd.3 since back 2023-07-14T18:31:07.112570+0000 front 2023-07-14T18:31:07.112507+0000 (oldest deadline 2023-07-14T18:31:31.812314+0000) 2023-07-14T18:31:33.669 INFO:journalctl@ceph.osd.7.smithi172.stdout:Jul 14 18:31:33 smithi172 systemd[1]: Stopping Ceph osd.7 for bf7326ec-2270-11ee-9b33-001a4aab830c... 2023-07-14T18:31:33.953 INFO:journalctl@ceph.osd.9.smithi163.stdout:Jul 14 18:31:33 smithi163 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-9[125814]: 2023-07-14T18:31:33.635+0000 7fd0759f3700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.163:6806 osd.0 since back 2023-07-14T18:30:42.661073+0000 front 2023-07-14T18:30:42.661052+0000 (oldest deadline 2023-07-14T18:31:07.961309+0000) 2023-07-14T18:31:33.953 INFO:journalctl@ceph.osd.9.smithi163.stdout:Jul 14 18:31:33 smithi163 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-9[125814]: 2023-07-14T18:31:33.635+0000 7fd0759f3700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2023-07-14T18:30:47.961848+0000 front 2023-07-14T18:30:47.961754+0000 (oldest deadline 2023-07-14T18:31:13.861824+0000) 2023-07-14T18:31:33.954 INFO:journalctl@ceph.osd.9.smithi163.stdout:Jul 14 18:31:33 smithi163 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-9[125814]: 2023-07-14T18:31:33.635+0000 7fd0759f3700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.184:6804 osd.2 since back 2023-07-14T18:30:59.763100+0000 front 2023-07-14T18:30:59.763261+0000 (oldest deadline 2023-07-14T18:31:25.662987+0000) 2023-07-14T18:31:33.954 INFO:journalctl@ceph.osd.9.smithi163.stdout:Jul 14 18:31:33 smithi163 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-9[125814]: 2023-07-14T18:31:33.635+0000 7fd0759f3700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.163:6814 osd.3 since back 2023-07-14T18:31:05.663336+0000 front 2023-07-14T18:31:05.663310+0000 (oldest deadline 2023-07-14T18:31:30.963470+0000) 2023-07-14T18:31:34.011 INFO:journalctl@ceph.osd.7.smithi172.stdout:Jul 14 18:31:33 smithi172 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-7[114020]: 2023-07-14T18:31:33.642+0000 7f4beea8f700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-osd -n osd.7 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-07-14T18:31:34.012 INFO:journalctl@ceph.osd.7.smithi172.stdout:Jul 14 18:31:33 smithi172 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-7[114020]: 2023-07-14T18:31:33.642+0000 7f4beea8f700 -1 osd.7 88 *** Got signal Terminated *** 2023-07-14T18:31:34.012 INFO:journalctl@ceph.osd.7.smithi172.stdout:Jul 14 18:31:33 smithi172 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-7[114020]: 2023-07-14T18:31:33.642+0000 7f4beea8f700 -1 osd.7 88 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-07-14T18:31:34.012 INFO:journalctl@ceph.osd.7.smithi172.stdout:Jul 14 18:31:33 smithi172 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-7[114020]: 2023-07-14T18:31:33.885+0000 7f4be707e700 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2023-07-14T18:30:51.994549+0000 front 2023-07-14T18:30:51.994596+0000 (oldest deadline 2023-07-14T18:31:17.294675+0000) 2023-07-14T18:31:34.012 INFO:journalctl@ceph.osd.7.smithi172.stdout:Jul 14 18:31:33 smithi172 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-7[114020]: 2023-07-14T18:31:33.885+0000 7f4be707e700 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.184:6804 osd.2 since back 2023-07-14T18:30:57.295136+0000 front 2023-07-14T18:30:57.295194+0000 (oldest deadline 2023-07-14T18:31:23.195171+0000) 2023-07-14T18:31:34.013 INFO:journalctl@ceph.osd.7.smithi172.stdout:Jul 14 18:31:33 smithi172 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-7[114020]: 2023-07-14T18:31:33.885+0000 7f4be707e700 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.163:6814 osd.3 since back 2023-07-14T18:31:07.296357+0000 front 2023-07-14T18:31:07.296344+0000 (oldest deadline 2023-07-14T18:31:29.596299+0000) 2023-07-14T18:31:34.511 INFO:journalctl@ceph.osd.10.smithi172.stdout:Jul 14 18:31:34 smithi172 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-10[119489]: 2023-07-14T18:31:34.010+0000 7fe8a6017700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.163:6806 osd.0 since back 2023-07-14T18:30:44.219658+0000 front 2023-07-14T18:30:44.219740+0000 (oldest deadline 2023-07-14T18:31:05.919624+0000) 2023-07-14T18:31:34.512 INFO:journalctl@ceph.osd.10.smithi172.stdout:Jul 14 18:31:34 smithi172 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-10[119489]: 2023-07-14T18:31:34.010+0000 7fe8a6017700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2023-07-14T18:30:51.022066+0000 front 2023-07-14T18:30:51.022166+0000 (oldest deadline 2023-07-14T18:31:13.922245+0000) 2023-07-14T18:31:34.512 INFO:journalctl@ceph.osd.10.smithi172.stdout:Jul 14 18:31:34 smithi172 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-10[119489]: 2023-07-14T18:31:34.010+0000 7fe8a6017700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.184:6804 osd.2 since back 2023-07-14T18:30:59.723894+0000 front 2023-07-14T18:30:59.723980+0000 (oldest deadline 2023-07-14T18:31:21.424006+0000) 2023-07-14T18:31:34.512 INFO:journalctl@ceph.osd.10.smithi172.stdout:Jul 14 18:31:34 smithi172 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-10[119489]: 2023-07-14T18:31:34.010+0000 7fe8a6017700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.163:6814 osd.3 since back 2023-07-14T18:31:07.126091+0000 front 2023-07-14T18:31:07.126185+0000 (oldest deadline 2023-07-14T18:31:31.826180+0000) 2023-07-14T18:31:34.589 INFO:journalctl@ceph.osd.8.smithi184.stdout:Jul 14 18:31:34 smithi184 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-8[115280]: 2023-07-14T18:31:34.310+0000 7fa897e34700 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.163:6806 osd.0 since back 2023-07-14T18:30:44.909156+0000 front 2023-07-14T18:30:44.908950+0000 (oldest deadline 2023-07-14T18:31:07.809102+0000) 2023-07-14T18:31:34.589 INFO:journalctl@ceph.osd.8.smithi184.stdout:Jul 14 18:31:34 smithi184 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-8[115280]: 2023-07-14T18:31:34.310+0000 7fa897e34700 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2023-07-14T18:30:47.809828+0000 front 2023-07-14T18:30:47.809790+0000 (oldest deadline 2023-07-14T18:31:18.410275+0000) 2023-07-14T18:31:34.589 INFO:journalctl@ceph.osd.8.smithi184.stdout:Jul 14 18:31:34 smithi184 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-8[115280]: 2023-07-14T18:31:34.310+0000 7fa897e34700 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.184:6804 osd.2 since back 2023-07-14T18:31:00.111285+0000 front 2023-07-14T18:31:00.111392+0000 (oldest deadline 2023-07-14T18:31:21.211412+0000) 2023-07-14T18:31:34.589 INFO:journalctl@ceph.osd.8.smithi184.stdout:Jul 14 18:31:34 smithi184 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-8[115280]: 2023-07-14T18:31:34.310+0000 7fa897e34700 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.163:6814 osd.3 since back 2023-07-14T18:31:07.112570+0000 front 2023-07-14T18:31:07.112507+0000 (oldest deadline 2023-07-14T18:31:31.812314+0000) 2023-07-14T18:31:34.910 INFO:journalctl@ceph.osd.11.smithi184.stdout:Jul 14 18:31:34 smithi184 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-11[120819]: 2023-07-14T18:31:34.562+0000 7f44dbfe8700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.163:6806 osd.0 since back 2023-07-14T18:30:42.566533+0000 front 2023-07-14T18:30:42.566680+0000 (oldest deadline 2023-07-14T18:31:08.967162+0000) 2023-07-14T18:31:34.911 INFO:journalctl@ceph.osd.11.smithi184.stdout:Jul 14 18:31:34 smithi184 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-11[120819]: 2023-07-14T18:31:34.562+0000 7f44dbfe8700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2023-07-14T18:30:51.868462+0000 front 2023-07-14T18:30:51.868670+0000 (oldest deadline 2023-07-14T18:31:17.768517+0000) 2023-07-14T18:31:34.911 INFO:journalctl@ceph.osd.11.smithi184.stdout:Jul 14 18:31:34 smithi184 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-11[120819]: 2023-07-14T18:31:34.562+0000 7f44dbfe8700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.184:6804 osd.2 since back 2023-07-14T18:30:58.269297+0000 front 2023-07-14T18:30:58.269338+0000 (oldest deadline 2023-07-14T18:31:23.569431+0000) 2023-07-14T18:31:34.953 INFO:journalctl@ceph.osd.9.smithi163.stdout:Jul 14 18:31:34 smithi163 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-9[125814]: 2023-07-14T18:31:34.662+0000 7fd0759f3700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.163:6806 osd.0 since back 2023-07-14T18:30:42.661073+0000 front 2023-07-14T18:30:42.661052+0000 (oldest deadline 2023-07-14T18:31:07.961309+0000) 2023-07-14T18:31:34.953 INFO:journalctl@ceph.osd.9.smithi163.stdout:Jul 14 18:31:34 smithi163 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-9[125814]: 2023-07-14T18:31:34.662+0000 7fd0759f3700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2023-07-14T18:30:47.961848+0000 front 2023-07-14T18:30:47.961754+0000 (oldest deadline 2023-07-14T18:31:13.861824+0000) 2023-07-14T18:31:34.954 INFO:journalctl@ceph.osd.9.smithi163.stdout:Jul 14 18:31:34 smithi163 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-9[125814]: 2023-07-14T18:31:34.662+0000 7fd0759f3700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.184:6804 osd.2 since back 2023-07-14T18:30:59.763100+0000 front 2023-07-14T18:30:59.763261+0000 (oldest deadline 2023-07-14T18:31:25.662987+0000) 2023-07-14T18:31:34.954 INFO:journalctl@ceph.osd.9.smithi163.stdout:Jul 14 18:31:34 smithi163 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-9[125814]: 2023-07-14T18:31:34.662+0000 7fd0759f3700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.163:6814 osd.3 since back 2023-07-14T18:31:05.663336+0000 front 2023-07-14T18:31:05.663310+0000 (oldest deadline 2023-07-14T18:31:30.963470+0000) 2023-07-14T18:31:35.261 INFO:journalctl@ceph.osd.7.smithi172.stdout:Jul 14 18:31:34 smithi172 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-7[114020]: 2023-07-14T18:31:34.837+0000 7f4be707e700 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2023-07-14T18:30:51.994549+0000 front 2023-07-14T18:30:51.994596+0000 (oldest deadline 2023-07-14T18:31:17.294675+0000) 2023-07-14T18:31:35.262 INFO:journalctl@ceph.osd.7.smithi172.stdout:Jul 14 18:31:34 smithi172 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-7[114020]: 2023-07-14T18:31:34.837+0000 7f4be707e700 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.184:6804 osd.2 since back 2023-07-14T18:30:57.295136+0000 front 2023-07-14T18:30:57.295194+0000 (oldest deadline 2023-07-14T18:31:23.195171+0000) 2023-07-14T18:31:35.262 INFO:journalctl@ceph.osd.7.smithi172.stdout:Jul 14 18:31:34 smithi172 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-7[114020]: 2023-07-14T18:31:34.837+0000 7f4be707e700 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.163:6814 osd.3 since back 2023-07-14T18:31:07.296357+0000 front 2023-07-14T18:31:07.296344+0000 (oldest deadline 2023-07-14T18:31:29.596299+0000) 2023-07-14T18:31:35.263 INFO:journalctl@ceph.osd.10.smithi172.stdout:Jul 14 18:31:35 smithi172 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-10[119489]: 2023-07-14T18:31:35.060+0000 7fe8a6017700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.163:6806 osd.0 since back 2023-07-14T18:30:44.219658+0000 front 2023-07-14T18:30:44.219740+0000 (oldest deadline 2023-07-14T18:31:05.919624+0000) 2023-07-14T18:31:35.263 INFO:journalctl@ceph.osd.10.smithi172.stdout:Jul 14 18:31:35 smithi172 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-10[119489]: 2023-07-14T18:31:35.060+0000 7fe8a6017700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2023-07-14T18:30:51.022066+0000 front 2023-07-14T18:30:51.022166+0000 (oldest deadline 2023-07-14T18:31:13.922245+0000) 2023-07-14T18:31:35.263 INFO:journalctl@ceph.osd.10.smithi172.stdout:Jul 14 18:31:35 smithi172 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-10[119489]: 2023-07-14T18:31:35.060+0000 7fe8a6017700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.184:6804 osd.2 since back 2023-07-14T18:30:59.723894+0000 front 2023-07-14T18:30:59.723980+0000 (oldest deadline 2023-07-14T18:31:21.424006+0000) 2023-07-14T18:31:35.263 INFO:journalctl@ceph.osd.10.smithi172.stdout:Jul 14 18:31:35 smithi172 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-10[119489]: 2023-07-14T18:31:35.060+0000 7fe8a6017700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.163:6814 osd.3 since back 2023-07-14T18:31:07.126091+0000 front 2023-07-14T18:31:07.126185+0000 (oldest deadline 2023-07-14T18:31:31.826180+0000) 2023-07-14T18:31:35.660 INFO:journalctl@ceph.osd.8.smithi184.stdout:Jul 14 18:31:35 smithi184 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-8[115280]: 2023-07-14T18:31:35.334+0000 7fa897e34700 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.163:6806 osd.0 since back 2023-07-14T18:30:44.909156+0000 front 2023-07-14T18:30:44.908950+0000 (oldest deadline 2023-07-14T18:31:07.809102+0000) 2023-07-14T18:31:35.661 INFO:journalctl@ceph.osd.8.smithi184.stdout:Jul 14 18:31:35 smithi184 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-8[115280]: 2023-07-14T18:31:35.334+0000 7fa897e34700 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2023-07-14T18:30:47.809828+0000 front 2023-07-14T18:30:47.809790+0000 (oldest deadline 2023-07-14T18:31:18.410275+0000) 2023-07-14T18:31:35.661 INFO:journalctl@ceph.osd.8.smithi184.stdout:Jul 14 18:31:35 smithi184 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-8[115280]: 2023-07-14T18:31:35.334+0000 7fa897e34700 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.184:6804 osd.2 since back 2023-07-14T18:31:00.111285+0000 front 2023-07-14T18:31:00.111392+0000 (oldest deadline 2023-07-14T18:31:21.211412+0000) 2023-07-14T18:31:35.661 INFO:journalctl@ceph.osd.8.smithi184.stdout:Jul 14 18:31:35 smithi184 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-8[115280]: 2023-07-14T18:31:35.334+0000 7fa897e34700 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.163:6814 osd.3 since back 2023-07-14T18:31:07.112570+0000 front 2023-07-14T18:31:07.112507+0000 (oldest deadline 2023-07-14T18:31:31.812314+0000) 2023-07-14T18:31:35.662 INFO:journalctl@ceph.osd.11.smithi184.stdout:Jul 14 18:31:35 smithi184 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-11[120819]: 2023-07-14T18:31:35.582+0000 7f44dbfe8700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.163:6806 osd.0 since back 2023-07-14T18:30:42.566533+0000 front 2023-07-14T18:30:42.566680+0000 (oldest deadline 2023-07-14T18:31:08.967162+0000) 2023-07-14T18:31:35.662 INFO:journalctl@ceph.osd.11.smithi184.stdout:Jul 14 18:31:35 smithi184 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-11[120819]: 2023-07-14T18:31:35.582+0000 7f44dbfe8700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2023-07-14T18:30:51.868462+0000 front 2023-07-14T18:30:51.868670+0000 (oldest deadline 2023-07-14T18:31:17.768517+0000) 2023-07-14T18:31:35.662 INFO:journalctl@ceph.osd.11.smithi184.stdout:Jul 14 18:31:35 smithi184 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-11[120819]: 2023-07-14T18:31:35.582+0000 7f44dbfe8700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.184:6804 osd.2 since back 2023-07-14T18:30:58.269297+0000 front 2023-07-14T18:30:58.269338+0000 (oldest deadline 2023-07-14T18:31:23.569431+0000) 2023-07-14T18:31:35.953 INFO:journalctl@ceph.osd.9.smithi163.stdout:Jul 14 18:31:35 smithi163 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-9[125814]: 2023-07-14T18:31:35.646+0000 7fd0759f3700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.163:6806 osd.0 since back 2023-07-14T18:30:42.661073+0000 front 2023-07-14T18:30:42.661052+0000 (oldest deadline 2023-07-14T18:31:07.961309+0000) 2023-07-14T18:31:35.953 INFO:journalctl@ceph.osd.9.smithi163.stdout:Jul 14 18:31:35 smithi163 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-9[125814]: 2023-07-14T18:31:35.646+0000 7fd0759f3700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2023-07-14T18:30:47.961848+0000 front 2023-07-14T18:30:47.961754+0000 (oldest deadline 2023-07-14T18:31:13.861824+0000) 2023-07-14T18:31:35.953 INFO:journalctl@ceph.osd.9.smithi163.stdout:Jul 14 18:31:35 smithi163 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-9[125814]: 2023-07-14T18:31:35.646+0000 7fd0759f3700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.184:6804 osd.2 since back 2023-07-14T18:30:59.763100+0000 front 2023-07-14T18:30:59.763261+0000 (oldest deadline 2023-07-14T18:31:25.662987+0000) 2023-07-14T18:31:35.954 INFO:journalctl@ceph.osd.9.smithi163.stdout:Jul 14 18:31:35 smithi163 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-9[125814]: 2023-07-14T18:31:35.646+0000 7fd0759f3700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.163:6814 osd.3 since back 2023-07-14T18:31:05.663336+0000 front 2023-07-14T18:31:05.663310+0000 (oldest deadline 2023-07-14T18:31:30.963470+0000) 2023-07-14T18:31:36.131 INFO:journalctl@ceph.osd.7.smithi172.stdout:Jul 14 18:31:35 smithi172 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-7[114020]: 2023-07-14T18:31:35.851+0000 7f4be707e700 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2023-07-14T18:30:51.994549+0000 front 2023-07-14T18:30:51.994596+0000 (oldest deadline 2023-07-14T18:31:17.294675+0000) 2023-07-14T18:31:36.131 INFO:journalctl@ceph.osd.7.smithi172.stdout:Jul 14 18:31:35 smithi172 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-7[114020]: 2023-07-14T18:31:35.851+0000 7f4be707e700 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.184:6804 osd.2 since back 2023-07-14T18:30:57.295136+0000 front 2023-07-14T18:30:57.295194+0000 (oldest deadline 2023-07-14T18:31:23.195171+0000) 2023-07-14T18:31:36.132 INFO:journalctl@ceph.osd.7.smithi172.stdout:Jul 14 18:31:35 smithi172 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-7[114020]: 2023-07-14T18:31:35.851+0000 7f4be707e700 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.163:6814 osd.3 since back 2023-07-14T18:31:07.296357+0000 front 2023-07-14T18:31:07.296344+0000 (oldest deadline 2023-07-14T18:31:29.596299+0000) 2023-07-14T18:31:36.511 INFO:journalctl@ceph.osd.10.smithi172.stdout:Jul 14 18:31:36 smithi172 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-10[119489]: 2023-07-14T18:31:36.104+0000 7fe8a6017700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.163:6806 osd.0 since back 2023-07-14T18:30:44.219658+0000 front 2023-07-14T18:30:44.219740+0000 (oldest deadline 2023-07-14T18:31:05.919624+0000) 2023-07-14T18:31:36.512 INFO:journalctl@ceph.osd.10.smithi172.stdout:Jul 14 18:31:36 smithi172 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-10[119489]: 2023-07-14T18:31:36.104+0000 7fe8a6017700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2023-07-14T18:30:51.022066+0000 front 2023-07-14T18:30:51.022166+0000 (oldest deadline 2023-07-14T18:31:13.922245+0000) 2023-07-14T18:31:36.512 INFO:journalctl@ceph.osd.10.smithi172.stdout:Jul 14 18:31:36 smithi172 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-10[119489]: 2023-07-14T18:31:36.104+0000 7fe8a6017700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.184:6804 osd.2 since back 2023-07-14T18:30:59.723894+0000 front 2023-07-14T18:30:59.723980+0000 (oldest deadline 2023-07-14T18:31:21.424006+0000) 2023-07-14T18:31:36.512 INFO:journalctl@ceph.osd.10.smithi172.stdout:Jul 14 18:31:36 smithi172 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-10[119489]: 2023-07-14T18:31:36.104+0000 7fe8a6017700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.163:6814 osd.3 since back 2023-07-14T18:31:07.126091+0000 front 2023-07-14T18:31:07.126185+0000 (oldest deadline 2023-07-14T18:31:31.826180+0000) 2023-07-14T18:31:36.660 INFO:journalctl@ceph.osd.8.smithi184.stdout:Jul 14 18:31:36 smithi184 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-8[115280]: 2023-07-14T18:31:36.317+0000 7fa897e34700 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.163:6806 osd.0 since back 2023-07-14T18:30:44.909156+0000 front 2023-07-14T18:30:44.908950+0000 (oldest deadline 2023-07-14T18:31:07.809102+0000) 2023-07-14T18:31:36.661 INFO:journalctl@ceph.osd.8.smithi184.stdout:Jul 14 18:31:36 smithi184 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-8[115280]: 2023-07-14T18:31:36.317+0000 7fa897e34700 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2023-07-14T18:30:47.809828+0000 front 2023-07-14T18:30:47.809790+0000 (oldest deadline 2023-07-14T18:31:18.410275+0000) 2023-07-14T18:31:36.661 INFO:journalctl@ceph.osd.8.smithi184.stdout:Jul 14 18:31:36 smithi184 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-8[115280]: 2023-07-14T18:31:36.317+0000 7fa897e34700 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.184:6804 osd.2 since back 2023-07-14T18:31:00.111285+0000 front 2023-07-14T18:31:00.111392+0000 (oldest deadline 2023-07-14T18:31:21.211412+0000) 2023-07-14T18:31:36.661 INFO:journalctl@ceph.osd.8.smithi184.stdout:Jul 14 18:31:36 smithi184 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-8[115280]: 2023-07-14T18:31:36.317+0000 7fa897e34700 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.163:6814 osd.3 since back 2023-07-14T18:31:07.112570+0000 front 2023-07-14T18:31:07.112507+0000 (oldest deadline 2023-07-14T18:31:31.812314+0000) 2023-07-14T18:31:36.662 INFO:journalctl@ceph.osd.11.smithi184.stdout:Jul 14 18:31:36 smithi184 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-11[120819]: 2023-07-14T18:31:36.540+0000 7f44dbfe8700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.163:6806 osd.0 since back 2023-07-14T18:30:42.566533+0000 front 2023-07-14T18:30:42.566680+0000 (oldest deadline 2023-07-14T18:31:08.967162+0000) 2023-07-14T18:31:36.662 INFO:journalctl@ceph.osd.11.smithi184.stdout:Jul 14 18:31:36 smithi184 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-11[120819]: 2023-07-14T18:31:36.540+0000 7f44dbfe8700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2023-07-14T18:30:51.868462+0000 front 2023-07-14T18:30:51.868670+0000 (oldest deadline 2023-07-14T18:31:17.768517+0000) 2023-07-14T18:31:36.663 INFO:journalctl@ceph.osd.11.smithi184.stdout:Jul 14 18:31:36 smithi184 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-11[120819]: 2023-07-14T18:31:36.540+0000 7f44dbfe8700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.184:6804 osd.2 since back 2023-07-14T18:30:58.269297+0000 front 2023-07-14T18:30:58.269338+0000 (oldest deadline 2023-07-14T18:31:23.569431+0000) 2023-07-14T18:31:36.953 INFO:journalctl@ceph.osd.9.smithi163.stdout:Jul 14 18:31:36 smithi163 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-9[125814]: 2023-07-14T18:31:36.675+0000 7fd0759f3700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.163:6806 osd.0 since back 2023-07-14T18:30:42.661073+0000 front 2023-07-14T18:30:42.661052+0000 (oldest deadline 2023-07-14T18:31:07.961309+0000) 2023-07-14T18:31:36.953 INFO:journalctl@ceph.osd.9.smithi163.stdout:Jul 14 18:31:36 smithi163 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-9[125814]: 2023-07-14T18:31:36.675+0000 7fd0759f3700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2023-07-14T18:30:47.961848+0000 front 2023-07-14T18:30:47.961754+0000 (oldest deadline 2023-07-14T18:31:13.861824+0000) 2023-07-14T18:31:36.953 INFO:journalctl@ceph.osd.9.smithi163.stdout:Jul 14 18:31:36 smithi163 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-9[125814]: 2023-07-14T18:31:36.675+0000 7fd0759f3700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.184:6804 osd.2 since back 2023-07-14T18:30:59.763100+0000 front 2023-07-14T18:30:59.763261+0000 (oldest deadline 2023-07-14T18:31:25.662987+0000) 2023-07-14T18:31:36.954 INFO:journalctl@ceph.osd.9.smithi163.stdout:Jul 14 18:31:36 smithi163 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-9[125814]: 2023-07-14T18:31:36.675+0000 7fd0759f3700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.163:6814 osd.3 since back 2023-07-14T18:31:05.663336+0000 front 2023-07-14T18:31:05.663310+0000 (oldest deadline 2023-07-14T18:31:30.963470+0000) 2023-07-14T18:31:37.168 INFO:journalctl@ceph.osd.10.smithi172.stdout:Jul 14 18:31:37 smithi172 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-10[119489]: 2023-07-14T18:31:37.141+0000 7fe8a6017700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.163:6806 osd.0 since back 2023-07-14T18:30:44.219658+0000 front 2023-07-14T18:30:44.219740+0000 (oldest deadline 2023-07-14T18:31:05.919624+0000) 2023-07-14T18:31:37.169 INFO:journalctl@ceph.osd.7.smithi172.stdout:Jul 14 18:31:36 smithi172 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-7[114020]: 2023-07-14T18:31:36.892+0000 7f4be707e700 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2023-07-14T18:30:51.994549+0000 front 2023-07-14T18:30:51.994596+0000 (oldest deadline 2023-07-14T18:31:17.294675+0000) 2023-07-14T18:31:37.169 INFO:journalctl@ceph.osd.7.smithi172.stdout:Jul 14 18:31:36 smithi172 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-7[114020]: 2023-07-14T18:31:36.892+0000 7f4be707e700 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.184:6804 osd.2 since back 2023-07-14T18:30:57.295136+0000 front 2023-07-14T18:30:57.295194+0000 (oldest deadline 2023-07-14T18:31:23.195171+0000) 2023-07-14T18:31:37.169 INFO:journalctl@ceph.osd.7.smithi172.stdout:Jul 14 18:31:36 smithi172 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-7[114020]: 2023-07-14T18:31:36.892+0000 7f4be707e700 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.163:6814 osd.3 since back 2023-07-14T18:31:07.296357+0000 front 2023-07-14T18:31:07.296344+0000 (oldest deadline 2023-07-14T18:31:29.596299+0000) 2023-07-14T18:31:37.511 INFO:journalctl@ceph.osd.10.smithi172.stdout:Jul 14 18:31:37 smithi172 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-10[119489]: 2023-07-14T18:31:37.141+0000 7fe8a6017700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2023-07-14T18:30:51.022066+0000 front 2023-07-14T18:30:51.022166+0000 (oldest deadline 2023-07-14T18:31:13.922245+0000) 2023-07-14T18:31:37.512 INFO:journalctl@ceph.osd.10.smithi172.stdout:Jul 14 18:31:37 smithi172 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-10[119489]: 2023-07-14T18:31:37.141+0000 7fe8a6017700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.184:6804 osd.2 since back 2023-07-14T18:30:59.723894+0000 front 2023-07-14T18:30:59.723980+0000 (oldest deadline 2023-07-14T18:31:21.424006+0000) 2023-07-14T18:31:37.513 INFO:journalctl@ceph.osd.10.smithi172.stdout:Jul 14 18:31:37 smithi172 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-10[119489]: 2023-07-14T18:31:37.141+0000 7fe8a6017700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.163:6814 osd.3 since back 2023-07-14T18:31:07.126091+0000 front 2023-07-14T18:31:07.126185+0000 (oldest deadline 2023-07-14T18:31:31.826180+0000) 2023-07-14T18:31:37.660 INFO:journalctl@ceph.osd.8.smithi184.stdout:Jul 14 18:31:37 smithi184 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-8[115280]: 2023-07-14T18:31:37.344+0000 7fa897e34700 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.163:6806 osd.0 since back 2023-07-14T18:30:44.909156+0000 front 2023-07-14T18:30:44.908950+0000 (oldest deadline 2023-07-14T18:31:07.809102+0000) 2023-07-14T18:31:37.661 INFO:journalctl@ceph.osd.8.smithi184.stdout:Jul 14 18:31:37 smithi184 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-8[115280]: 2023-07-14T18:31:37.344+0000 7fa897e34700 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2023-07-14T18:30:47.809828+0000 front 2023-07-14T18:30:47.809790+0000 (oldest deadline 2023-07-14T18:31:18.410275+0000) 2023-07-14T18:31:37.661 INFO:journalctl@ceph.osd.8.smithi184.stdout:Jul 14 18:31:37 smithi184 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-8[115280]: 2023-07-14T18:31:37.344+0000 7fa897e34700 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.184:6804 osd.2 since back 2023-07-14T18:31:00.111285+0000 front 2023-07-14T18:31:00.111392+0000 (oldest deadline 2023-07-14T18:31:21.211412+0000) 2023-07-14T18:31:37.661 INFO:journalctl@ceph.osd.8.smithi184.stdout:Jul 14 18:31:37 smithi184 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-8[115280]: 2023-07-14T18:31:37.344+0000 7fa897e34700 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.163:6814 osd.3 since back 2023-07-14T18:31:07.112570+0000 front 2023-07-14T18:31:07.112507+0000 (oldest deadline 2023-07-14T18:31:31.812314+0000) 2023-07-14T18:31:37.662 INFO:journalctl@ceph.osd.11.smithi184.stdout:Jul 14 18:31:37 smithi184 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-11[120819]: 2023-07-14T18:31:37.521+0000 7f44dbfe8700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.163:6806 osd.0 since back 2023-07-14T18:30:42.566533+0000 front 2023-07-14T18:30:42.566680+0000 (oldest deadline 2023-07-14T18:31:08.967162+0000) 2023-07-14T18:31:37.662 INFO:journalctl@ceph.osd.11.smithi184.stdout:Jul 14 18:31:37 smithi184 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-11[120819]: 2023-07-14T18:31:37.521+0000 7f44dbfe8700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2023-07-14T18:30:51.868462+0000 front 2023-07-14T18:30:51.868670+0000 (oldest deadline 2023-07-14T18:31:17.768517+0000) 2023-07-14T18:31:37.662 INFO:journalctl@ceph.osd.11.smithi184.stdout:Jul 14 18:31:37 smithi184 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-11[120819]: 2023-07-14T18:31:37.521+0000 7f44dbfe8700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.184:6804 osd.2 since back 2023-07-14T18:30:58.269297+0000 front 2023-07-14T18:30:58.269338+0000 (oldest deadline 2023-07-14T18:31:23.569431+0000) 2023-07-14T18:31:37.953 INFO:journalctl@ceph.osd.9.smithi163.stdout:Jul 14 18:31:37 smithi163 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-9[125814]: 2023-07-14T18:31:37.631+0000 7fd0759f3700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.163:6806 osd.0 since back 2023-07-14T18:30:42.661073+0000 front 2023-07-14T18:30:42.661052+0000 (oldest deadline 2023-07-14T18:31:07.961309+0000) 2023-07-14T18:31:37.953 INFO:journalctl@ceph.osd.9.smithi163.stdout:Jul 14 18:31:37 smithi163 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-9[125814]: 2023-07-14T18:31:37.631+0000 7fd0759f3700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2023-07-14T18:30:47.961848+0000 front 2023-07-14T18:30:47.961754+0000 (oldest deadline 2023-07-14T18:31:13.861824+0000) 2023-07-14T18:31:37.953 INFO:journalctl@ceph.osd.9.smithi163.stdout:Jul 14 18:31:37 smithi163 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-9[125814]: 2023-07-14T18:31:37.631+0000 7fd0759f3700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.184:6804 osd.2 since back 2023-07-14T18:30:59.763100+0000 front 2023-07-14T18:30:59.763261+0000 (oldest deadline 2023-07-14T18:31:25.662987+0000) 2023-07-14T18:31:37.954 INFO:journalctl@ceph.osd.9.smithi163.stdout:Jul 14 18:31:37 smithi163 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-9[125814]: 2023-07-14T18:31:37.631+0000 7fd0759f3700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.163:6814 osd.3 since back 2023-07-14T18:31:05.663336+0000 front 2023-07-14T18:31:05.663310+0000 (oldest deadline 2023-07-14T18:31:30.963470+0000) 2023-07-14T18:31:38.162 INFO:journalctl@ceph.osd.7.smithi172.stdout:Jul 14 18:31:37 smithi172 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-7[114020]: 2023-07-14T18:31:37.876+0000 7f4be707e700 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2023-07-14T18:30:51.994549+0000 front 2023-07-14T18:30:51.994596+0000 (oldest deadline 2023-07-14T18:31:17.294675+0000) 2023-07-14T18:31:38.163 INFO:journalctl@ceph.osd.7.smithi172.stdout:Jul 14 18:31:37 smithi172 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-7[114020]: 2023-07-14T18:31:37.876+0000 7f4be707e700 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.184:6804 osd.2 since back 2023-07-14T18:30:57.295136+0000 front 2023-07-14T18:30:57.295194+0000 (oldest deadline 2023-07-14T18:31:23.195171+0000) 2023-07-14T18:31:38.164 INFO:journalctl@ceph.osd.7.smithi172.stdout:Jul 14 18:31:37 smithi172 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-7[114020]: 2023-07-14T18:31:37.876+0000 7f4be707e700 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.163:6814 osd.3 since back 2023-07-14T18:31:07.296357+0000 front 2023-07-14T18:31:07.296344+0000 (oldest deadline 2023-07-14T18:31:29.596299+0000) 2023-07-14T18:31:38.511 INFO:journalctl@ceph.osd.10.smithi172.stdout:Jul 14 18:31:38 smithi172 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-10[119489]: 2023-07-14T18:31:38.136+0000 7fe8a6017700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.163:6806 osd.0 since back 2023-07-14T18:30:44.219658+0000 front 2023-07-14T18:30:44.219740+0000 (oldest deadline 2023-07-14T18:31:05.919624+0000) 2023-07-14T18:31:38.512 INFO:journalctl@ceph.osd.10.smithi172.stdout:Jul 14 18:31:38 smithi172 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-10[119489]: 2023-07-14T18:31:38.136+0000 7fe8a6017700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2023-07-14T18:30:51.022066+0000 front 2023-07-14T18:30:51.022166+0000 (oldest deadline 2023-07-14T18:31:13.922245+0000) 2023-07-14T18:31:38.512 INFO:journalctl@ceph.osd.10.smithi172.stdout:Jul 14 18:31:38 smithi172 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-10[119489]: 2023-07-14T18:31:38.136+0000 7fe8a6017700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.184:6804 osd.2 since back 2023-07-14T18:30:59.723894+0000 front 2023-07-14T18:30:59.723980+0000 (oldest deadline 2023-07-14T18:31:21.424006+0000) 2023-07-14T18:31:38.512 INFO:journalctl@ceph.osd.10.smithi172.stdout:Jul 14 18:31:38 smithi172 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-10[119489]: 2023-07-14T18:31:38.136+0000 7fe8a6017700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.163:6814 osd.3 since back 2023-07-14T18:31:07.126091+0000 front 2023-07-14T18:31:07.126185+0000 (oldest deadline 2023-07-14T18:31:31.826180+0000) 2023-07-14T18:31:38.513 INFO:journalctl@ceph.osd.10.smithi172.stdout:Jul 14 18:31:38 smithi172 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-10[119489]: 2023-07-14T18:31:38.136+0000 7fe8a6017700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.172:6812 osd.4 since back 2023-07-14T18:31:11.826674+0000 front 2023-07-14T18:31:11.826695+0000 (oldest deadline 2023-07-14T18:31:37.726788+0000) 2023-07-14T18:31:38.660 INFO:journalctl@ceph.osd.8.smithi184.stdout:Jul 14 18:31:38 smithi184 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-8[115280]: 2023-07-14T18:31:38.330+0000 7fa897e34700 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.163:6806 osd.0 since back 2023-07-14T18:30:44.909156+0000 front 2023-07-14T18:30:44.908950+0000 (oldest deadline 2023-07-14T18:31:07.809102+0000) 2023-07-14T18:31:38.661 INFO:journalctl@ceph.osd.8.smithi184.stdout:Jul 14 18:31:38 smithi184 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-8[115280]: 2023-07-14T18:31:38.330+0000 7fa897e34700 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2023-07-14T18:30:47.809828+0000 front 2023-07-14T18:30:47.809790+0000 (oldest deadline 2023-07-14T18:31:18.410275+0000) 2023-07-14T18:31:38.661 INFO:journalctl@ceph.osd.8.smithi184.stdout:Jul 14 18:31:38 smithi184 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-8[115280]: 2023-07-14T18:31:38.330+0000 7fa897e34700 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.184:6804 osd.2 since back 2023-07-14T18:31:00.111285+0000 front 2023-07-14T18:31:00.111392+0000 (oldest deadline 2023-07-14T18:31:21.211412+0000) 2023-07-14T18:31:38.662 INFO:journalctl@ceph.osd.8.smithi184.stdout:Jul 14 18:31:38 smithi184 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-8[115280]: 2023-07-14T18:31:38.330+0000 7fa897e34700 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.163:6814 osd.3 since back 2023-07-14T18:31:07.112570+0000 front 2023-07-14T18:31:07.112507+0000 (oldest deadline 2023-07-14T18:31:31.812314+0000) 2023-07-14T18:31:38.662 INFO:journalctl@ceph.osd.11.smithi184.stdout:Jul 14 18:31:38 smithi184 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-11[120819]: 2023-07-14T18:31:38.523+0000 7f44dbfe8700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.163:6806 osd.0 since back 2023-07-14T18:30:42.566533+0000 front 2023-07-14T18:30:42.566680+0000 (oldest deadline 2023-07-14T18:31:08.967162+0000) 2023-07-14T18:31:38.662 INFO:journalctl@ceph.osd.11.smithi184.stdout:Jul 14 18:31:38 smithi184 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-11[120819]: 2023-07-14T18:31:38.523+0000 7f44dbfe8700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2023-07-14T18:30:51.868462+0000 front 2023-07-14T18:30:51.868670+0000 (oldest deadline 2023-07-14T18:31:17.768517+0000) 2023-07-14T18:31:38.663 INFO:journalctl@ceph.osd.11.smithi184.stdout:Jul 14 18:31:38 smithi184 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-11[120819]: 2023-07-14T18:31:38.523+0000 7f44dbfe8700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.184:6804 osd.2 since back 2023-07-14T18:30:58.269297+0000 front 2023-07-14T18:30:58.269338+0000 (oldest deadline 2023-07-14T18:31:23.569431+0000) 2023-07-14T18:31:38.663 INFO:journalctl@ceph.osd.11.smithi184.stdout:Jul 14 18:31:38 smithi184 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-11[120819]: 2023-07-14T18:31:38.523+0000 7f44dbfe8700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.172:6812 osd.4 since back 2023-07-14T18:31:14.770869+0000 front 2023-07-14T18:31:14.770949+0000 (oldest deadline 2023-07-14T18:31:38.270981+0000) 2023-07-14T18:31:38.953 INFO:journalctl@ceph.osd.9.smithi163.stdout:Jul 14 18:31:38 smithi163 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-9[125814]: 2023-07-14T18:31:38.590+0000 7fd0759f3700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.163:6806 osd.0 since back 2023-07-14T18:30:42.661073+0000 front 2023-07-14T18:30:42.661052+0000 (oldest deadline 2023-07-14T18:31:07.961309+0000) 2023-07-14T18:31:38.953 INFO:journalctl@ceph.osd.9.smithi163.stdout:Jul 14 18:31:38 smithi163 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-9[125814]: 2023-07-14T18:31:38.590+0000 7fd0759f3700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2023-07-14T18:30:47.961848+0000 front 2023-07-14T18:30:47.961754+0000 (oldest deadline 2023-07-14T18:31:13.861824+0000) 2023-07-14T18:31:38.953 INFO:journalctl@ceph.osd.9.smithi163.stdout:Jul 14 18:31:38 smithi163 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-9[125814]: 2023-07-14T18:31:38.590+0000 7fd0759f3700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.184:6804 osd.2 since back 2023-07-14T18:30:59.763100+0000 front 2023-07-14T18:30:59.763261+0000 (oldest deadline 2023-07-14T18:31:25.662987+0000) 2023-07-14T18:31:38.954 INFO:journalctl@ceph.osd.9.smithi163.stdout:Jul 14 18:31:38 smithi163 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-9[125814]: 2023-07-14T18:31:38.590+0000 7fd0759f3700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.163:6814 osd.3 since back 2023-07-14T18:31:05.663336+0000 front 2023-07-14T18:31:05.663310+0000 (oldest deadline 2023-07-14T18:31:30.963470+0000) 2023-07-14T18:31:38.954 INFO:journalctl@ceph.osd.9.smithi163.stdout:Jul 14 18:31:38 smithi163 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-9[125814]: 2023-07-14T18:31:38.590+0000 7fd0759f3700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.172:6812 osd.4 since back 2023-07-14T18:31:10.963937+0000 front 2023-07-14T18:31:10.964038+0000 (oldest deadline 2023-07-14T18:31:38.564432+0000) 2023-07-14T18:31:39.483 INFO:journalctl@ceph.osd.10.smithi172.stdout:Jul 14 18:31:39 smithi172 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-10[119489]: 2023-07-14T18:31:39.091+0000 7fe8a6017700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.163:6806 osd.0 since back 2023-07-14T18:30:44.219658+0000 front 2023-07-14T18:30:44.219740+0000 (oldest deadline 2023-07-14T18:31:05.919624+0000) 2023-07-14T18:31:39.483 INFO:journalctl@ceph.osd.10.smithi172.stdout:Jul 14 18:31:39 smithi172 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-10[119489]: 2023-07-14T18:31:39.091+0000 7fe8a6017700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2023-07-14T18:30:51.022066+0000 front 2023-07-14T18:30:51.022166+0000 (oldest deadline 2023-07-14T18:31:13.922245+0000) 2023-07-14T18:31:39.484 INFO:journalctl@ceph.osd.10.smithi172.stdout:Jul 14 18:31:39 smithi172 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-10[119489]: 2023-07-14T18:31:39.091+0000 7fe8a6017700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.184:6804 osd.2 since back 2023-07-14T18:30:59.723894+0000 front 2023-07-14T18:30:59.723980+0000 (oldest deadline 2023-07-14T18:31:21.424006+0000) 2023-07-14T18:31:39.484 INFO:journalctl@ceph.osd.10.smithi172.stdout:Jul 14 18:31:39 smithi172 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-10[119489]: 2023-07-14T18:31:39.091+0000 7fe8a6017700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.163:6814 osd.3 since back 2023-07-14T18:31:07.126091+0000 front 2023-07-14T18:31:07.126185+0000 (oldest deadline 2023-07-14T18:31:31.826180+0000) 2023-07-14T18:31:39.484 INFO:journalctl@ceph.osd.10.smithi172.stdout:Jul 14 18:31:39 smithi172 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-10[119489]: 2023-07-14T18:31:39.091+0000 7fe8a6017700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.172:6812 osd.4 since back 2023-07-14T18:31:11.826674+0000 front 2023-07-14T18:31:11.826695+0000 (oldest deadline 2023-07-14T18:31:37.726788+0000) 2023-07-14T18:31:39.660 INFO:journalctl@ceph.osd.8.smithi184.stdout:Jul 14 18:31:39 smithi184 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-8[115280]: 2023-07-14T18:31:39.296+0000 7fa897e34700 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.163:6806 osd.0 since back 2023-07-14T18:30:44.909156+0000 front 2023-07-14T18:30:44.908950+0000 (oldest deadline 2023-07-14T18:31:07.809102+0000) 2023-07-14T18:31:39.661 INFO:journalctl@ceph.osd.8.smithi184.stdout:Jul 14 18:31:39 smithi184 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-8[115280]: 2023-07-14T18:31:39.296+0000 7fa897e34700 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2023-07-14T18:30:47.809828+0000 front 2023-07-14T18:30:47.809790+0000 (oldest deadline 2023-07-14T18:31:18.410275+0000) 2023-07-14T18:31:39.661 INFO:journalctl@ceph.osd.8.smithi184.stdout:Jul 14 18:31:39 smithi184 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-8[115280]: 2023-07-14T18:31:39.296+0000 7fa897e34700 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.184:6804 osd.2 since back 2023-07-14T18:31:00.111285+0000 front 2023-07-14T18:31:00.111392+0000 (oldest deadline 2023-07-14T18:31:21.211412+0000) 2023-07-14T18:31:39.662 INFO:journalctl@ceph.osd.8.smithi184.stdout:Jul 14 18:31:39 smithi184 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-8[115280]: 2023-07-14T18:31:39.296+0000 7fa897e34700 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.163:6814 osd.3 since back 2023-07-14T18:31:07.112570+0000 front 2023-07-14T18:31:07.112507+0000 (oldest deadline 2023-07-14T18:31:31.812314+0000) 2023-07-14T18:31:39.662 INFO:journalctl@ceph.osd.11.smithi184.stdout:Jul 14 18:31:39 smithi184 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-11[120819]: 2023-07-14T18:31:39.544+0000 7f44dbfe8700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.163:6806 osd.0 since back 2023-07-14T18:30:42.566533+0000 front 2023-07-14T18:30:42.566680+0000 (oldest deadline 2023-07-14T18:31:08.967162+0000) 2023-07-14T18:31:39.663 INFO:journalctl@ceph.osd.11.smithi184.stdout:Jul 14 18:31:39 smithi184 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-11[120819]: 2023-07-14T18:31:39.544+0000 7f44dbfe8700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2023-07-14T18:30:51.868462+0000 front 2023-07-14T18:30:51.868670+0000 (oldest deadline 2023-07-14T18:31:17.768517+0000) 2023-07-14T18:31:39.663 INFO:journalctl@ceph.osd.11.smithi184.stdout:Jul 14 18:31:39 smithi184 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-11[120819]: 2023-07-14T18:31:39.544+0000 7f44dbfe8700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.184:6804 osd.2 since back 2023-07-14T18:30:58.269297+0000 front 2023-07-14T18:30:58.269338+0000 (oldest deadline 2023-07-14T18:31:23.569431+0000) 2023-07-14T18:31:39.664 INFO:journalctl@ceph.osd.11.smithi184.stdout:Jul 14 18:31:39 smithi184 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-11[120819]: 2023-07-14T18:31:39.544+0000 7f44dbfe8700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.172:6812 osd.4 since back 2023-07-14T18:31:14.770869+0000 front 2023-07-14T18:31:14.770949+0000 (oldest deadline 2023-07-14T18:31:38.270981+0000) 2023-07-14T18:31:39.761 INFO:journalctl@ceph.osd.7.smithi172.stdout:Jul 14 18:31:39 smithi172 bash[129753]: ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-7 2023-07-14T18:31:39.953 INFO:journalctl@ceph.osd.9.smithi163.stdout:Jul 14 18:31:39 smithi163 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-9[125814]: 2023-07-14T18:31:39.631+0000 7fd0759f3700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.163:6806 osd.0 since back 2023-07-14T18:30:42.661073+0000 front 2023-07-14T18:30:42.661052+0000 (oldest deadline 2023-07-14T18:31:07.961309+0000) 2023-07-14T18:31:39.953 INFO:journalctl@ceph.osd.9.smithi163.stdout:Jul 14 18:31:39 smithi163 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-9[125814]: 2023-07-14T18:31:39.631+0000 7fd0759f3700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2023-07-14T18:30:47.961848+0000 front 2023-07-14T18:30:47.961754+0000 (oldest deadline 2023-07-14T18:31:13.861824+0000) 2023-07-14T18:31:39.953 INFO:journalctl@ceph.osd.9.smithi163.stdout:Jul 14 18:31:39 smithi163 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-9[125814]: 2023-07-14T18:31:39.631+0000 7fd0759f3700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.184:6804 osd.2 since back 2023-07-14T18:30:59.763100+0000 front 2023-07-14T18:30:59.763261+0000 (oldest deadline 2023-07-14T18:31:25.662987+0000) 2023-07-14T18:31:39.954 INFO:journalctl@ceph.osd.9.smithi163.stdout:Jul 14 18:31:39 smithi163 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-9[125814]: 2023-07-14T18:31:39.631+0000 7fd0759f3700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.163:6814 osd.3 since back 2023-07-14T18:31:05.663336+0000 front 2023-07-14T18:31:05.663310+0000 (oldest deadline 2023-07-14T18:31:30.963470+0000) 2023-07-14T18:31:39.954 INFO:journalctl@ceph.osd.9.smithi163.stdout:Jul 14 18:31:39 smithi163 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-9[125814]: 2023-07-14T18:31:39.631+0000 7fd0759f3700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.172:6812 osd.4 since back 2023-07-14T18:31:10.963937+0000 front 2023-07-14T18:31:10.964038+0000 (oldest deadline 2023-07-14T18:31:38.564432+0000) 2023-07-14T18:31:40.474 INFO:journalctl@ceph.osd.10.smithi172.stdout:Jul 14 18:31:40 smithi172 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-10[119489]: 2023-07-14T18:31:40.100+0000 7fe8a6017700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.163:6806 osd.0 since back 2023-07-14T18:30:44.219658+0000 front 2023-07-14T18:30:44.219740+0000 (oldest deadline 2023-07-14T18:31:05.919624+0000) 2023-07-14T18:31:40.475 INFO:journalctl@ceph.osd.10.smithi172.stdout:Jul 14 18:31:40 smithi172 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-10[119489]: 2023-07-14T18:31:40.100+0000 7fe8a6017700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2023-07-14T18:30:51.022066+0000 front 2023-07-14T18:30:51.022166+0000 (oldest deadline 2023-07-14T18:31:13.922245+0000) 2023-07-14T18:31:40.475 INFO:journalctl@ceph.osd.10.smithi172.stdout:Jul 14 18:31:40 smithi172 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-10[119489]: 2023-07-14T18:31:40.100+0000 7fe8a6017700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.184:6804 osd.2 since back 2023-07-14T18:30:59.723894+0000 front 2023-07-14T18:30:59.723980+0000 (oldest deadline 2023-07-14T18:31:21.424006+0000) 2023-07-14T18:31:40.475 INFO:journalctl@ceph.osd.10.smithi172.stdout:Jul 14 18:31:40 smithi172 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-10[119489]: 2023-07-14T18:31:40.100+0000 7fe8a6017700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.163:6814 osd.3 since back 2023-07-14T18:31:07.126091+0000 front 2023-07-14T18:31:07.126185+0000 (oldest deadline 2023-07-14T18:31:31.826180+0000) 2023-07-14T18:31:40.475 INFO:journalctl@ceph.osd.10.smithi172.stdout:Jul 14 18:31:40 smithi172 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-10[119489]: 2023-07-14T18:31:40.100+0000 7fe8a6017700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.172:6812 osd.4 since back 2023-07-14T18:31:11.826674+0000 front 2023-07-14T18:31:11.826695+0000 (oldest deadline 2023-07-14T18:31:37.726788+0000) 2023-07-14T18:31:40.660 INFO:journalctl@ceph.osd.8.smithi184.stdout:Jul 14 18:31:40 smithi184 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-8[115280]: 2023-07-14T18:31:40.329+0000 7fa897e34700 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.163:6806 osd.0 since back 2023-07-14T18:30:44.909156+0000 front 2023-07-14T18:30:44.908950+0000 (oldest deadline 2023-07-14T18:31:07.809102+0000) 2023-07-14T18:31:40.661 INFO:journalctl@ceph.osd.8.smithi184.stdout:Jul 14 18:31:40 smithi184 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-8[115280]: 2023-07-14T18:31:40.329+0000 7fa897e34700 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2023-07-14T18:30:47.809828+0000 front 2023-07-14T18:30:47.809790+0000 (oldest deadline 2023-07-14T18:31:18.410275+0000) 2023-07-14T18:31:40.661 INFO:journalctl@ceph.osd.8.smithi184.stdout:Jul 14 18:31:40 smithi184 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-8[115280]: 2023-07-14T18:31:40.329+0000 7fa897e34700 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.184:6804 osd.2 since back 2023-07-14T18:31:00.111285+0000 front 2023-07-14T18:31:00.111392+0000 (oldest deadline 2023-07-14T18:31:21.211412+0000) 2023-07-14T18:31:40.661 INFO:journalctl@ceph.osd.8.smithi184.stdout:Jul 14 18:31:40 smithi184 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-8[115280]: 2023-07-14T18:31:40.329+0000 7fa897e34700 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.163:6814 osd.3 since back 2023-07-14T18:31:07.112570+0000 front 2023-07-14T18:31:07.112507+0000 (oldest deadline 2023-07-14T18:31:31.812314+0000) 2023-07-14T18:31:40.661 INFO:journalctl@ceph.osd.11.smithi184.stdout:Jul 14 18:31:40 smithi184 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-11[120819]: 2023-07-14T18:31:40.530+0000 7f44dbfe8700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.163:6806 osd.0 since back 2023-07-14T18:30:42.566533+0000 front 2023-07-14T18:30:42.566680+0000 (oldest deadline 2023-07-14T18:31:08.967162+0000) 2023-07-14T18:31:40.662 INFO:journalctl@ceph.osd.11.smithi184.stdout:Jul 14 18:31:40 smithi184 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-11[120819]: 2023-07-14T18:31:40.530+0000 7f44dbfe8700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2023-07-14T18:30:51.868462+0000 front 2023-07-14T18:30:51.868670+0000 (oldest deadline 2023-07-14T18:31:17.768517+0000) 2023-07-14T18:31:40.662 INFO:journalctl@ceph.osd.11.smithi184.stdout:Jul 14 18:31:40 smithi184 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-11[120819]: 2023-07-14T18:31:40.530+0000 7f44dbfe8700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.184:6804 osd.2 since back 2023-07-14T18:30:58.269297+0000 front 2023-07-14T18:30:58.269338+0000 (oldest deadline 2023-07-14T18:31:23.569431+0000) 2023-07-14T18:31:40.662 INFO:journalctl@ceph.osd.11.smithi184.stdout:Jul 14 18:31:40 smithi184 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-11[120819]: 2023-07-14T18:31:40.530+0000 7f44dbfe8700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.172:6812 osd.4 since back 2023-07-14T18:31:14.770869+0000 front 2023-07-14T18:31:14.770949+0000 (oldest deadline 2023-07-14T18:31:38.270981+0000) 2023-07-14T18:31:40.807 DEBUG:teuthology.orchestra.run.smithi172:> sudo pkill -f 'journalctl -f -n 0 -u ceph-bf7326ec-2270-11ee-9b33-001a4aab830c@osd.7.service' 2023-07-14T18:31:40.848 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-07-14T18:31:40.848 INFO:tasks.cephadm.osd.7:Stopped osd.7 2023-07-14T18:31:40.849 INFO:tasks.cephadm.osd.8:Stopping osd.8... 2023-07-14T18:31:40.849 DEBUG:teuthology.orchestra.run.smithi184:> sudo systemctl stop ceph-bf7326ec-2270-11ee-9b33-001a4aab830c@osd.8 2023-07-14T18:31:40.953 INFO:journalctl@ceph.osd.9.smithi163.stdout:Jul 14 18:31:40 smithi163 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-9[125814]: 2023-07-14T18:31:40.675+0000 7fd0759f3700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.163:6806 osd.0 since back 2023-07-14T18:30:42.661073+0000 front 2023-07-14T18:30:42.661052+0000 (oldest deadline 2023-07-14T18:31:07.961309+0000) 2023-07-14T18:31:40.953 INFO:journalctl@ceph.osd.9.smithi163.stdout:Jul 14 18:31:40 smithi163 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-9[125814]: 2023-07-14T18:31:40.675+0000 7fd0759f3700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2023-07-14T18:30:47.961848+0000 front 2023-07-14T18:30:47.961754+0000 (oldest deadline 2023-07-14T18:31:13.861824+0000) 2023-07-14T18:31:40.953 INFO:journalctl@ceph.osd.9.smithi163.stdout:Jul 14 18:31:40 smithi163 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-9[125814]: 2023-07-14T18:31:40.675+0000 7fd0759f3700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.184:6804 osd.2 since back 2023-07-14T18:30:59.763100+0000 front 2023-07-14T18:30:59.763261+0000 (oldest deadline 2023-07-14T18:31:25.662987+0000) 2023-07-14T18:31:40.954 INFO:journalctl@ceph.osd.9.smithi163.stdout:Jul 14 18:31:40 smithi163 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-9[125814]: 2023-07-14T18:31:40.675+0000 7fd0759f3700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.163:6814 osd.3 since back 2023-07-14T18:31:05.663336+0000 front 2023-07-14T18:31:05.663310+0000 (oldest deadline 2023-07-14T18:31:30.963470+0000) 2023-07-14T18:31:40.954 INFO:journalctl@ceph.osd.9.smithi163.stdout:Jul 14 18:31:40 smithi163 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-9[125814]: 2023-07-14T18:31:40.675+0000 7fd0759f3700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.172:6812 osd.4 since back 2023-07-14T18:31:10.963937+0000 front 2023-07-14T18:31:10.964038+0000 (oldest deadline 2023-07-14T18:31:38.564432+0000) 2023-07-14T18:31:41.160 INFO:journalctl@ceph.osd.8.smithi184.stdout:Jul 14 18:31:40 smithi184 systemd[1]: Stopping Ceph osd.8 for bf7326ec-2270-11ee-9b33-001a4aab830c... 2023-07-14T18:31:41.511 INFO:journalctl@ceph.osd.10.smithi172.stdout:Jul 14 18:31:41 smithi172 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-10[119489]: 2023-07-14T18:31:41.104+0000 7fe8a6017700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.163:6806 osd.0 since back 2023-07-14T18:30:44.219658+0000 front 2023-07-14T18:30:44.219740+0000 (oldest deadline 2023-07-14T18:31:05.919624+0000) 2023-07-14T18:31:41.511 INFO:journalctl@ceph.osd.10.smithi172.stdout:Jul 14 18:31:41 smithi172 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-10[119489]: 2023-07-14T18:31:41.104+0000 7fe8a6017700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2023-07-14T18:30:51.022066+0000 front 2023-07-14T18:30:51.022166+0000 (oldest deadline 2023-07-14T18:31:13.922245+0000) 2023-07-14T18:31:41.512 INFO:journalctl@ceph.osd.10.smithi172.stdout:Jul 14 18:31:41 smithi172 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-10[119489]: 2023-07-14T18:31:41.104+0000 7fe8a6017700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.184:6804 osd.2 since back 2023-07-14T18:30:59.723894+0000 front 2023-07-14T18:30:59.723980+0000 (oldest deadline 2023-07-14T18:31:21.424006+0000) 2023-07-14T18:31:41.512 INFO:journalctl@ceph.osd.10.smithi172.stdout:Jul 14 18:31:41 smithi172 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-10[119489]: 2023-07-14T18:31:41.104+0000 7fe8a6017700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.163:6814 osd.3 since back 2023-07-14T18:31:07.126091+0000 front 2023-07-14T18:31:07.126185+0000 (oldest deadline 2023-07-14T18:31:31.826180+0000) 2023-07-14T18:31:41.512 INFO:journalctl@ceph.osd.10.smithi172.stdout:Jul 14 18:31:41 smithi172 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-10[119489]: 2023-07-14T18:31:41.104+0000 7fe8a6017700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.172:6812 osd.4 since back 2023-07-14T18:31:11.826674+0000 front 2023-07-14T18:31:11.826695+0000 (oldest deadline 2023-07-14T18:31:37.726788+0000) 2023-07-14T18:31:41.520 INFO:journalctl@ceph.osd.8.smithi184.stdout:Jul 14 18:31:41 smithi184 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-8[115280]: 2023-07-14T18:31:41.197+0000 7fa89e042700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-osd -n osd.8 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-07-14T18:31:41.521 INFO:journalctl@ceph.osd.8.smithi184.stdout:Jul 14 18:31:41 smithi184 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-8[115280]: 2023-07-14T18:31:41.197+0000 7fa89e042700 -1 osd.8 88 *** Got signal Terminated *** 2023-07-14T18:31:41.521 INFO:journalctl@ceph.osd.8.smithi184.stdout:Jul 14 18:31:41 smithi184 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-8[115280]: 2023-07-14T18:31:41.197+0000 7fa89e042700 -1 osd.8 88 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-07-14T18:31:41.521 INFO:journalctl@ceph.osd.8.smithi184.stdout:Jul 14 18:31:41 smithi184 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-8[115280]: 2023-07-14T18:31:41.307+0000 7fa897e34700 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.163:6806 osd.0 since back 2023-07-14T18:30:44.909156+0000 front 2023-07-14T18:30:44.908950+0000 (oldest deadline 2023-07-14T18:31:07.809102+0000) 2023-07-14T18:31:41.521 INFO:journalctl@ceph.osd.8.smithi184.stdout:Jul 14 18:31:41 smithi184 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-8[115280]: 2023-07-14T18:31:41.307+0000 7fa897e34700 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2023-07-14T18:30:47.809828+0000 front 2023-07-14T18:30:47.809790+0000 (oldest deadline 2023-07-14T18:31:18.410275+0000) 2023-07-14T18:31:41.521 INFO:journalctl@ceph.osd.8.smithi184.stdout:Jul 14 18:31:41 smithi184 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-8[115280]: 2023-07-14T18:31:41.307+0000 7fa897e34700 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.184:6804 osd.2 since back 2023-07-14T18:31:00.111285+0000 front 2023-07-14T18:31:00.111392+0000 (oldest deadline 2023-07-14T18:31:21.211412+0000) 2023-07-14T18:31:41.522 INFO:journalctl@ceph.osd.8.smithi184.stdout:Jul 14 18:31:41 smithi184 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-8[115280]: 2023-07-14T18:31:41.307+0000 7fa897e34700 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.163:6814 osd.3 since back 2023-07-14T18:31:07.112570+0000 front 2023-07-14T18:31:07.112507+0000 (oldest deadline 2023-07-14T18:31:31.812314+0000) 2023-07-14T18:31:41.522 INFO:journalctl@ceph.osd.8.smithi184.stdout:Jul 14 18:31:41 smithi184 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-8[115280]: 2023-07-14T18:31:41.307+0000 7fa897e34700 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.172:6812 osd.4 since back 2023-07-14T18:31:15.213909+0000 front 2023-07-14T18:31:15.213696+0000 (oldest deadline 2023-07-14T18:31:40.513767+0000) 2023-07-14T18:31:41.910 INFO:journalctl@ceph.osd.11.smithi184.stdout:Jul 14 18:31:41 smithi184 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-11[120819]: 2023-07-14T18:31:41.494+0000 7f44dbfe8700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.163:6806 osd.0 since back 2023-07-14T18:30:42.566533+0000 front 2023-07-14T18:30:42.566680+0000 (oldest deadline 2023-07-14T18:31:08.967162+0000) 2023-07-14T18:31:41.910 INFO:journalctl@ceph.osd.11.smithi184.stdout:Jul 14 18:31:41 smithi184 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-11[120819]: 2023-07-14T18:31:41.494+0000 7f44dbfe8700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2023-07-14T18:30:51.868462+0000 front 2023-07-14T18:30:51.868670+0000 (oldest deadline 2023-07-14T18:31:17.768517+0000) 2023-07-14T18:31:41.911 INFO:journalctl@ceph.osd.11.smithi184.stdout:Jul 14 18:31:41 smithi184 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-11[120819]: 2023-07-14T18:31:41.494+0000 7f44dbfe8700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.184:6804 osd.2 since back 2023-07-14T18:30:58.269297+0000 front 2023-07-14T18:30:58.269338+0000 (oldest deadline 2023-07-14T18:31:23.569431+0000) 2023-07-14T18:31:41.911 INFO:journalctl@ceph.osd.11.smithi184.stdout:Jul 14 18:31:41 smithi184 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-11[120819]: 2023-07-14T18:31:41.494+0000 7f44dbfe8700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.172:6812 osd.4 since back 2023-07-14T18:31:14.770869+0000 front 2023-07-14T18:31:14.770949+0000 (oldest deadline 2023-07-14T18:31:38.270981+0000) 2023-07-14T18:31:42.203 INFO:journalctl@ceph.osd.9.smithi163.stdout:Jul 14 18:31:41 smithi163 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-9[125814]: 2023-07-14T18:31:41.699+0000 7fd0759f3700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.163:6806 osd.0 since back 2023-07-14T18:30:42.661073+0000 front 2023-07-14T18:30:42.661052+0000 (oldest deadline 2023-07-14T18:31:07.961309+0000) 2023-07-14T18:31:42.203 INFO:journalctl@ceph.osd.9.smithi163.stdout:Jul 14 18:31:41 smithi163 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-9[125814]: 2023-07-14T18:31:41.699+0000 7fd0759f3700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2023-07-14T18:30:47.961848+0000 front 2023-07-14T18:30:47.961754+0000 (oldest deadline 2023-07-14T18:31:13.861824+0000) 2023-07-14T18:31:42.203 INFO:journalctl@ceph.osd.9.smithi163.stdout:Jul 14 18:31:41 smithi163 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-9[125814]: 2023-07-14T18:31:41.699+0000 7fd0759f3700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.184:6804 osd.2 since back 2023-07-14T18:30:59.763100+0000 front 2023-07-14T18:30:59.763261+0000 (oldest deadline 2023-07-14T18:31:25.662987+0000) 2023-07-14T18:31:42.203 INFO:journalctl@ceph.osd.9.smithi163.stdout:Jul 14 18:31:41 smithi163 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-9[125814]: 2023-07-14T18:31:41.699+0000 7fd0759f3700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.163:6814 osd.3 since back 2023-07-14T18:31:05.663336+0000 front 2023-07-14T18:31:05.663310+0000 (oldest deadline 2023-07-14T18:31:30.963470+0000) 2023-07-14T18:31:42.204 INFO:journalctl@ceph.osd.9.smithi163.stdout:Jul 14 18:31:41 smithi163 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-9[125814]: 2023-07-14T18:31:41.699+0000 7fd0759f3700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.172:6812 osd.4 since back 2023-07-14T18:31:10.963937+0000 front 2023-07-14T18:31:10.964038+0000 (oldest deadline 2023-07-14T18:31:38.564432+0000) 2023-07-14T18:31:42.511 INFO:journalctl@ceph.osd.10.smithi172.stdout:Jul 14 18:31:42 smithi172 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-10[119489]: 2023-07-14T18:31:42.128+0000 7fe8a6017700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.163:6806 osd.0 since back 2023-07-14T18:30:44.219658+0000 front 2023-07-14T18:30:44.219740+0000 (oldest deadline 2023-07-14T18:31:05.919624+0000) 2023-07-14T18:31:42.511 INFO:journalctl@ceph.osd.10.smithi172.stdout:Jul 14 18:31:42 smithi172 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-10[119489]: 2023-07-14T18:31:42.128+0000 7fe8a6017700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2023-07-14T18:30:51.022066+0000 front 2023-07-14T18:30:51.022166+0000 (oldest deadline 2023-07-14T18:31:13.922245+0000) 2023-07-14T18:31:42.512 INFO:journalctl@ceph.osd.10.smithi172.stdout:Jul 14 18:31:42 smithi172 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-10[119489]: 2023-07-14T18:31:42.128+0000 7fe8a6017700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.184:6804 osd.2 since back 2023-07-14T18:30:59.723894+0000 front 2023-07-14T18:30:59.723980+0000 (oldest deadline 2023-07-14T18:31:21.424006+0000) 2023-07-14T18:31:42.512 INFO:journalctl@ceph.osd.10.smithi172.stdout:Jul 14 18:31:42 smithi172 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-10[119489]: 2023-07-14T18:31:42.128+0000 7fe8a6017700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.163:6814 osd.3 since back 2023-07-14T18:31:07.126091+0000 front 2023-07-14T18:31:07.126185+0000 (oldest deadline 2023-07-14T18:31:31.826180+0000) 2023-07-14T18:31:42.512 INFO:journalctl@ceph.osd.10.smithi172.stdout:Jul 14 18:31:42 smithi172 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-10[119489]: 2023-07-14T18:31:42.128+0000 7fe8a6017700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.172:6812 osd.4 since back 2023-07-14T18:31:11.826674+0000 front 2023-07-14T18:31:11.826695+0000 (oldest deadline 2023-07-14T18:31:37.726788+0000) 2023-07-14T18:31:42.660 INFO:journalctl@ceph.osd.11.smithi184.stdout:Jul 14 18:31:42 smithi184 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-11[120819]: 2023-07-14T18:31:42.511+0000 7f44dbfe8700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.163:6806 osd.0 since back 2023-07-14T18:30:42.566533+0000 front 2023-07-14T18:30:42.566680+0000 (oldest deadline 2023-07-14T18:31:08.967162+0000) 2023-07-14T18:31:42.660 INFO:journalctl@ceph.osd.11.smithi184.stdout:Jul 14 18:31:42 smithi184 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-11[120819]: 2023-07-14T18:31:42.511+0000 7f44dbfe8700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2023-07-14T18:30:51.868462+0000 front 2023-07-14T18:30:51.868670+0000 (oldest deadline 2023-07-14T18:31:17.768517+0000) 2023-07-14T18:31:42.661 INFO:journalctl@ceph.osd.11.smithi184.stdout:Jul 14 18:31:42 smithi184 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-11[120819]: 2023-07-14T18:31:42.511+0000 7f44dbfe8700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.184:6804 osd.2 since back 2023-07-14T18:30:58.269297+0000 front 2023-07-14T18:30:58.269338+0000 (oldest deadline 2023-07-14T18:31:23.569431+0000) 2023-07-14T18:31:42.661 INFO:journalctl@ceph.osd.11.smithi184.stdout:Jul 14 18:31:42 smithi184 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-11[120819]: 2023-07-14T18:31:42.511+0000 7f44dbfe8700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.172:6812 osd.4 since back 2023-07-14T18:31:14.770869+0000 front 2023-07-14T18:31:14.770949+0000 (oldest deadline 2023-07-14T18:31:38.270981+0000) 2023-07-14T18:31:42.661 INFO:journalctl@ceph.osd.8.smithi184.stdout:Jul 14 18:31:42 smithi184 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-8[115280]: 2023-07-14T18:31:42.272+0000 7fa897e34700 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.163:6806 osd.0 since back 2023-07-14T18:30:44.909156+0000 front 2023-07-14T18:30:44.908950+0000 (oldest deadline 2023-07-14T18:31:07.809102+0000) 2023-07-14T18:31:42.662 INFO:journalctl@ceph.osd.8.smithi184.stdout:Jul 14 18:31:42 smithi184 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-8[115280]: 2023-07-14T18:31:42.272+0000 7fa897e34700 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2023-07-14T18:30:47.809828+0000 front 2023-07-14T18:30:47.809790+0000 (oldest deadline 2023-07-14T18:31:18.410275+0000) 2023-07-14T18:31:42.662 INFO:journalctl@ceph.osd.8.smithi184.stdout:Jul 14 18:31:42 smithi184 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-8[115280]: 2023-07-14T18:31:42.272+0000 7fa897e34700 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.184:6804 osd.2 since back 2023-07-14T18:31:00.111285+0000 front 2023-07-14T18:31:00.111392+0000 (oldest deadline 2023-07-14T18:31:21.211412+0000) 2023-07-14T18:31:42.662 INFO:journalctl@ceph.osd.8.smithi184.stdout:Jul 14 18:31:42 smithi184 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-8[115280]: 2023-07-14T18:31:42.272+0000 7fa897e34700 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.163:6814 osd.3 since back 2023-07-14T18:31:07.112570+0000 front 2023-07-14T18:31:07.112507+0000 (oldest deadline 2023-07-14T18:31:31.812314+0000) 2023-07-14T18:31:42.662 INFO:journalctl@ceph.osd.8.smithi184.stdout:Jul 14 18:31:42 smithi184 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-8[115280]: 2023-07-14T18:31:42.272+0000 7fa897e34700 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.172:6812 osd.4 since back 2023-07-14T18:31:15.213909+0000 front 2023-07-14T18:31:15.213696+0000 (oldest deadline 2023-07-14T18:31:40.513767+0000) 2023-07-14T18:31:42.952 INFO:journalctl@ceph.osd.9.smithi163.stdout:Jul 14 18:31:42 smithi163 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-9[125814]: 2023-07-14T18:31:42.675+0000 7fd0759f3700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.163:6806 osd.0 since back 2023-07-14T18:30:42.661073+0000 front 2023-07-14T18:30:42.661052+0000 (oldest deadline 2023-07-14T18:31:07.961309+0000) 2023-07-14T18:31:42.953 INFO:journalctl@ceph.osd.9.smithi163.stdout:Jul 14 18:31:42 smithi163 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-9[125814]: 2023-07-14T18:31:42.675+0000 7fd0759f3700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2023-07-14T18:30:47.961848+0000 front 2023-07-14T18:30:47.961754+0000 (oldest deadline 2023-07-14T18:31:13.861824+0000) 2023-07-14T18:31:42.953 INFO:journalctl@ceph.osd.9.smithi163.stdout:Jul 14 18:31:42 smithi163 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-9[125814]: 2023-07-14T18:31:42.676+0000 7fd0759f3700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.184:6804 osd.2 since back 2023-07-14T18:30:59.763100+0000 front 2023-07-14T18:30:59.763261+0000 (oldest deadline 2023-07-14T18:31:25.662987+0000) 2023-07-14T18:31:42.953 INFO:journalctl@ceph.osd.9.smithi163.stdout:Jul 14 18:31:42 smithi163 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-9[125814]: 2023-07-14T18:31:42.676+0000 7fd0759f3700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.163:6814 osd.3 since back 2023-07-14T18:31:05.663336+0000 front 2023-07-14T18:31:05.663310+0000 (oldest deadline 2023-07-14T18:31:30.963470+0000) 2023-07-14T18:31:42.954 INFO:journalctl@ceph.osd.9.smithi163.stdout:Jul 14 18:31:42 smithi163 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-9[125814]: 2023-07-14T18:31:42.676+0000 7fd0759f3700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.172:6812 osd.4 since back 2023-07-14T18:31:10.963937+0000 front 2023-07-14T18:31:10.964038+0000 (oldest deadline 2023-07-14T18:31:38.564432+0000) 2023-07-14T18:31:43.511 INFO:journalctl@ceph.osd.10.smithi172.stdout:Jul 14 18:31:43 smithi172 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-10[119489]: 2023-07-14T18:31:43.126+0000 7fe8a6017700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.163:6806 osd.0 since back 2023-07-14T18:30:44.219658+0000 front 2023-07-14T18:30:44.219740+0000 (oldest deadline 2023-07-14T18:31:05.919624+0000) 2023-07-14T18:31:43.511 INFO:journalctl@ceph.osd.10.smithi172.stdout:Jul 14 18:31:43 smithi172 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-10[119489]: 2023-07-14T18:31:43.126+0000 7fe8a6017700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2023-07-14T18:30:51.022066+0000 front 2023-07-14T18:30:51.022166+0000 (oldest deadline 2023-07-14T18:31:13.922245+0000) 2023-07-14T18:31:43.512 INFO:journalctl@ceph.osd.10.smithi172.stdout:Jul 14 18:31:43 smithi172 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-10[119489]: 2023-07-14T18:31:43.126+0000 7fe8a6017700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.184:6804 osd.2 since back 2023-07-14T18:30:59.723894+0000 front 2023-07-14T18:30:59.723980+0000 (oldest deadline 2023-07-14T18:31:21.424006+0000) 2023-07-14T18:31:43.512 INFO:journalctl@ceph.osd.10.smithi172.stdout:Jul 14 18:31:43 smithi172 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-10[119489]: 2023-07-14T18:31:43.126+0000 7fe8a6017700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.163:6814 osd.3 since back 2023-07-14T18:31:07.126091+0000 front 2023-07-14T18:31:07.126185+0000 (oldest deadline 2023-07-14T18:31:31.826180+0000) 2023-07-14T18:31:43.512 INFO:journalctl@ceph.osd.10.smithi172.stdout:Jul 14 18:31:43 smithi172 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-10[119489]: 2023-07-14T18:31:43.126+0000 7fe8a6017700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.172:6812 osd.4 since back 2023-07-14T18:31:11.826674+0000 front 2023-07-14T18:31:11.826695+0000 (oldest deadline 2023-07-14T18:31:37.726788+0000) 2023-07-14T18:31:43.660 INFO:journalctl@ceph.osd.11.smithi184.stdout:Jul 14 18:31:43 smithi184 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-11[120819]: 2023-07-14T18:31:43.486+0000 7f44dbfe8700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.163:6806 osd.0 since back 2023-07-14T18:30:42.566533+0000 front 2023-07-14T18:30:42.566680+0000 (oldest deadline 2023-07-14T18:31:08.967162+0000) 2023-07-14T18:31:43.661 INFO:journalctl@ceph.osd.11.smithi184.stdout:Jul 14 18:31:43 smithi184 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-11[120819]: 2023-07-14T18:31:43.486+0000 7f44dbfe8700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2023-07-14T18:30:51.868462+0000 front 2023-07-14T18:30:51.868670+0000 (oldest deadline 2023-07-14T18:31:17.768517+0000) 2023-07-14T18:31:43.661 INFO:journalctl@ceph.osd.11.smithi184.stdout:Jul 14 18:31:43 smithi184 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-11[120819]: 2023-07-14T18:31:43.486+0000 7f44dbfe8700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.184:6804 osd.2 since back 2023-07-14T18:30:58.269297+0000 front 2023-07-14T18:30:58.269338+0000 (oldest deadline 2023-07-14T18:31:23.569431+0000) 2023-07-14T18:31:43.661 INFO:journalctl@ceph.osd.11.smithi184.stdout:Jul 14 18:31:43 smithi184 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-11[120819]: 2023-07-14T18:31:43.486+0000 7f44dbfe8700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.172:6812 osd.4 since back 2023-07-14T18:31:14.770869+0000 front 2023-07-14T18:31:14.770949+0000 (oldest deadline 2023-07-14T18:31:38.270981+0000) 2023-07-14T18:31:43.661 INFO:journalctl@ceph.osd.8.smithi184.stdout:Jul 14 18:31:43 smithi184 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-8[115280]: 2023-07-14T18:31:43.290+0000 7fa897e34700 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.163:6806 osd.0 since back 2023-07-14T18:30:44.909156+0000 front 2023-07-14T18:30:44.908950+0000 (oldest deadline 2023-07-14T18:31:07.809102+0000) 2023-07-14T18:31:43.662 INFO:journalctl@ceph.osd.8.smithi184.stdout:Jul 14 18:31:43 smithi184 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-8[115280]: 2023-07-14T18:31:43.290+0000 7fa897e34700 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2023-07-14T18:30:47.809828+0000 front 2023-07-14T18:30:47.809790+0000 (oldest deadline 2023-07-14T18:31:18.410275+0000) 2023-07-14T18:31:43.662 INFO:journalctl@ceph.osd.8.smithi184.stdout:Jul 14 18:31:43 smithi184 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-8[115280]: 2023-07-14T18:31:43.290+0000 7fa897e34700 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.184:6804 osd.2 since back 2023-07-14T18:31:00.111285+0000 front 2023-07-14T18:31:00.111392+0000 (oldest deadline 2023-07-14T18:31:21.211412+0000) 2023-07-14T18:31:43.662 INFO:journalctl@ceph.osd.8.smithi184.stdout:Jul 14 18:31:43 smithi184 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-8[115280]: 2023-07-14T18:31:43.290+0000 7fa897e34700 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.163:6814 osd.3 since back 2023-07-14T18:31:07.112570+0000 front 2023-07-14T18:31:07.112507+0000 (oldest deadline 2023-07-14T18:31:31.812314+0000) 2023-07-14T18:31:43.662 INFO:journalctl@ceph.osd.8.smithi184.stdout:Jul 14 18:31:43 smithi184 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-8[115280]: 2023-07-14T18:31:43.290+0000 7fa897e34700 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.172:6812 osd.4 since back 2023-07-14T18:31:15.213909+0000 front 2023-07-14T18:31:15.213696+0000 (oldest deadline 2023-07-14T18:31:40.513767+0000) 2023-07-14T18:31:44.203 INFO:journalctl@ceph.osd.9.smithi163.stdout:Jul 14 18:31:43 smithi163 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-9[125814]: 2023-07-14T18:31:43.693+0000 7fd0759f3700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.163:6806 osd.0 since back 2023-07-14T18:30:42.661073+0000 front 2023-07-14T18:30:42.661052+0000 (oldest deadline 2023-07-14T18:31:07.961309+0000) 2023-07-14T18:31:44.203 INFO:journalctl@ceph.osd.9.smithi163.stdout:Jul 14 18:31:43 smithi163 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-9[125814]: 2023-07-14T18:31:43.693+0000 7fd0759f3700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2023-07-14T18:30:47.961848+0000 front 2023-07-14T18:30:47.961754+0000 (oldest deadline 2023-07-14T18:31:13.861824+0000) 2023-07-14T18:31:44.203 INFO:journalctl@ceph.osd.9.smithi163.stdout:Jul 14 18:31:43 smithi163 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-9[125814]: 2023-07-14T18:31:43.693+0000 7fd0759f3700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.184:6804 osd.2 since back 2023-07-14T18:30:59.763100+0000 front 2023-07-14T18:30:59.763261+0000 (oldest deadline 2023-07-14T18:31:25.662987+0000) 2023-07-14T18:31:44.203 INFO:journalctl@ceph.osd.9.smithi163.stdout:Jul 14 18:31:43 smithi163 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-9[125814]: 2023-07-14T18:31:43.693+0000 7fd0759f3700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.163:6814 osd.3 since back 2023-07-14T18:31:05.663336+0000 front 2023-07-14T18:31:05.663310+0000 (oldest deadline 2023-07-14T18:31:30.963470+0000) 2023-07-14T18:31:44.204 INFO:journalctl@ceph.osd.9.smithi163.stdout:Jul 14 18:31:43 smithi163 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-9[125814]: 2023-07-14T18:31:43.693+0000 7fd0759f3700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.172:6812 osd.4 since back 2023-07-14T18:31:10.963937+0000 front 2023-07-14T18:31:10.964038+0000 (oldest deadline 2023-07-14T18:31:38.564432+0000) 2023-07-14T18:31:44.511 INFO:journalctl@ceph.osd.10.smithi172.stdout:Jul 14 18:31:44 smithi172 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-10[119489]: 2023-07-14T18:31:44.086+0000 7fe8a6017700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.163:6806 osd.0 since back 2023-07-14T18:30:44.219658+0000 front 2023-07-14T18:30:44.219740+0000 (oldest deadline 2023-07-14T18:31:05.919624+0000) 2023-07-14T18:31:44.511 INFO:journalctl@ceph.osd.10.smithi172.stdout:Jul 14 18:31:44 smithi172 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-10[119489]: 2023-07-14T18:31:44.086+0000 7fe8a6017700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2023-07-14T18:30:51.022066+0000 front 2023-07-14T18:30:51.022166+0000 (oldest deadline 2023-07-14T18:31:13.922245+0000) 2023-07-14T18:31:44.512 INFO:journalctl@ceph.osd.10.smithi172.stdout:Jul 14 18:31:44 smithi172 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-10[119489]: 2023-07-14T18:31:44.086+0000 7fe8a6017700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.184:6804 osd.2 since back 2023-07-14T18:30:59.723894+0000 front 2023-07-14T18:30:59.723980+0000 (oldest deadline 2023-07-14T18:31:21.424006+0000) 2023-07-14T18:31:44.512 INFO:journalctl@ceph.osd.10.smithi172.stdout:Jul 14 18:31:44 smithi172 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-10[119489]: 2023-07-14T18:31:44.086+0000 7fe8a6017700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.163:6814 osd.3 since back 2023-07-14T18:31:07.126091+0000 front 2023-07-14T18:31:07.126185+0000 (oldest deadline 2023-07-14T18:31:31.826180+0000) 2023-07-14T18:31:44.512 INFO:journalctl@ceph.osd.10.smithi172.stdout:Jul 14 18:31:44 smithi172 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-10[119489]: 2023-07-14T18:31:44.086+0000 7fe8a6017700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.172:6812 osd.4 since back 2023-07-14T18:31:11.826674+0000 front 2023-07-14T18:31:11.826695+0000 (oldest deadline 2023-07-14T18:31:37.726788+0000) 2023-07-14T18:31:44.660 INFO:journalctl@ceph.osd.8.smithi184.stdout:Jul 14 18:31:44 smithi184 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-8[115280]: 2023-07-14T18:31:44.294+0000 7fa897e34700 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.163:6806 osd.0 since back 2023-07-14T18:30:44.909156+0000 front 2023-07-14T18:30:44.908950+0000 (oldest deadline 2023-07-14T18:31:07.809102+0000) 2023-07-14T18:31:44.660 INFO:journalctl@ceph.osd.8.smithi184.stdout:Jul 14 18:31:44 smithi184 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-8[115280]: 2023-07-14T18:31:44.294+0000 7fa897e34700 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2023-07-14T18:30:47.809828+0000 front 2023-07-14T18:30:47.809790+0000 (oldest deadline 2023-07-14T18:31:18.410275+0000) 2023-07-14T18:31:44.661 INFO:journalctl@ceph.osd.8.smithi184.stdout:Jul 14 18:31:44 smithi184 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-8[115280]: 2023-07-14T18:31:44.294+0000 7fa897e34700 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.184:6804 osd.2 since back 2023-07-14T18:31:00.111285+0000 front 2023-07-14T18:31:00.111392+0000 (oldest deadline 2023-07-14T18:31:21.211412+0000) 2023-07-14T18:31:44.661 INFO:journalctl@ceph.osd.8.smithi184.stdout:Jul 14 18:31:44 smithi184 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-8[115280]: 2023-07-14T18:31:44.294+0000 7fa897e34700 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.163:6814 osd.3 since back 2023-07-14T18:31:07.112570+0000 front 2023-07-14T18:31:07.112507+0000 (oldest deadline 2023-07-14T18:31:31.812314+0000) 2023-07-14T18:31:44.661 INFO:journalctl@ceph.osd.8.smithi184.stdout:Jul 14 18:31:44 smithi184 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-8[115280]: 2023-07-14T18:31:44.294+0000 7fa897e34700 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.172:6812 osd.4 since back 2023-07-14T18:31:15.213909+0000 front 2023-07-14T18:31:15.213696+0000 (oldest deadline 2023-07-14T18:31:40.513767+0000) 2023-07-14T18:31:44.661 INFO:journalctl@ceph.osd.11.smithi184.stdout:Jul 14 18:31:44 smithi184 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-11[120819]: 2023-07-14T18:31:44.438+0000 7f44dbfe8700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.163:6806 osd.0 since back 2023-07-14T18:30:42.566533+0000 front 2023-07-14T18:30:42.566680+0000 (oldest deadline 2023-07-14T18:31:08.967162+0000) 2023-07-14T18:31:44.662 INFO:journalctl@ceph.osd.11.smithi184.stdout:Jul 14 18:31:44 smithi184 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-11[120819]: 2023-07-14T18:31:44.438+0000 7f44dbfe8700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2023-07-14T18:30:51.868462+0000 front 2023-07-14T18:30:51.868670+0000 (oldest deadline 2023-07-14T18:31:17.768517+0000) 2023-07-14T18:31:44.662 INFO:journalctl@ceph.osd.11.smithi184.stdout:Jul 14 18:31:44 smithi184 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-11[120819]: 2023-07-14T18:31:44.438+0000 7f44dbfe8700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.184:6804 osd.2 since back 2023-07-14T18:30:58.269297+0000 front 2023-07-14T18:30:58.269338+0000 (oldest deadline 2023-07-14T18:31:23.569431+0000) 2023-07-14T18:31:44.662 INFO:journalctl@ceph.osd.11.smithi184.stdout:Jul 14 18:31:44 smithi184 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-11[120819]: 2023-07-14T18:31:44.438+0000 7f44dbfe8700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.172:6812 osd.4 since back 2023-07-14T18:31:14.770869+0000 front 2023-07-14T18:31:14.770949+0000 (oldest deadline 2023-07-14T18:31:38.270981+0000) 2023-07-14T18:31:44.953 INFO:journalctl@ceph.osd.9.smithi163.stdout:Jul 14 18:31:44 smithi163 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-9[125814]: 2023-07-14T18:31:44.649+0000 7fd0759f3700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.163:6806 osd.0 since back 2023-07-14T18:30:42.661073+0000 front 2023-07-14T18:30:42.661052+0000 (oldest deadline 2023-07-14T18:31:07.961309+0000) 2023-07-14T18:31:44.953 INFO:journalctl@ceph.osd.9.smithi163.stdout:Jul 14 18:31:44 smithi163 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-9[125814]: 2023-07-14T18:31:44.649+0000 7fd0759f3700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2023-07-14T18:30:47.961848+0000 front 2023-07-14T18:30:47.961754+0000 (oldest deadline 2023-07-14T18:31:13.861824+0000) 2023-07-14T18:31:44.953 INFO:journalctl@ceph.osd.9.smithi163.stdout:Jul 14 18:31:44 smithi163 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-9[125814]: 2023-07-14T18:31:44.649+0000 7fd0759f3700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.184:6804 osd.2 since back 2023-07-14T18:30:59.763100+0000 front 2023-07-14T18:30:59.763261+0000 (oldest deadline 2023-07-14T18:31:25.662987+0000) 2023-07-14T18:31:44.954 INFO:journalctl@ceph.osd.9.smithi163.stdout:Jul 14 18:31:44 smithi163 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-9[125814]: 2023-07-14T18:31:44.649+0000 7fd0759f3700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.163:6814 osd.3 since back 2023-07-14T18:31:05.663336+0000 front 2023-07-14T18:31:05.663310+0000 (oldest deadline 2023-07-14T18:31:30.963470+0000) 2023-07-14T18:31:44.954 INFO:journalctl@ceph.osd.9.smithi163.stdout:Jul 14 18:31:44 smithi163 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-9[125814]: 2023-07-14T18:31:44.649+0000 7fd0759f3700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.172:6812 osd.4 since back 2023-07-14T18:31:10.963937+0000 front 2023-07-14T18:31:10.964038+0000 (oldest deadline 2023-07-14T18:31:38.564432+0000) 2023-07-14T18:31:45.511 INFO:journalctl@ceph.osd.10.smithi172.stdout:Jul 14 18:31:45 smithi172 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-10[119489]: 2023-07-14T18:31:45.067+0000 7fe8a6017700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.163:6806 osd.0 since back 2023-07-14T18:30:44.219658+0000 front 2023-07-14T18:30:44.219740+0000 (oldest deadline 2023-07-14T18:31:05.919624+0000) 2023-07-14T18:31:45.511 INFO:journalctl@ceph.osd.10.smithi172.stdout:Jul 14 18:31:45 smithi172 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-10[119489]: 2023-07-14T18:31:45.067+0000 7fe8a6017700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2023-07-14T18:30:51.022066+0000 front 2023-07-14T18:30:51.022166+0000 (oldest deadline 2023-07-14T18:31:13.922245+0000) 2023-07-14T18:31:45.512 INFO:journalctl@ceph.osd.10.smithi172.stdout:Jul 14 18:31:45 smithi172 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-10[119489]: 2023-07-14T18:31:45.067+0000 7fe8a6017700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.184:6804 osd.2 since back 2023-07-14T18:30:59.723894+0000 front 2023-07-14T18:30:59.723980+0000 (oldest deadline 2023-07-14T18:31:21.424006+0000) 2023-07-14T18:31:45.512 INFO:journalctl@ceph.osd.10.smithi172.stdout:Jul 14 18:31:45 smithi172 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-10[119489]: 2023-07-14T18:31:45.067+0000 7fe8a6017700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.163:6814 osd.3 since back 2023-07-14T18:31:07.126091+0000 front 2023-07-14T18:31:07.126185+0000 (oldest deadline 2023-07-14T18:31:31.826180+0000) 2023-07-14T18:31:45.512 INFO:journalctl@ceph.osd.10.smithi172.stdout:Jul 14 18:31:45 smithi172 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-10[119489]: 2023-07-14T18:31:45.067+0000 7fe8a6017700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.172:6812 osd.4 since back 2023-07-14T18:31:11.826674+0000 front 2023-07-14T18:31:11.826695+0000 (oldest deadline 2023-07-14T18:31:37.726788+0000) 2023-07-14T18:31:45.660 INFO:journalctl@ceph.osd.8.smithi184.stdout:Jul 14 18:31:45 smithi184 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-8[115280]: 2023-07-14T18:31:45.247+0000 7fa897e34700 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.163:6806 osd.0 since back 2023-07-14T18:30:44.909156+0000 front 2023-07-14T18:30:44.908950+0000 (oldest deadline 2023-07-14T18:31:07.809102+0000) 2023-07-14T18:31:45.660 INFO:journalctl@ceph.osd.8.smithi184.stdout:Jul 14 18:31:45 smithi184 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-8[115280]: 2023-07-14T18:31:45.247+0000 7fa897e34700 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2023-07-14T18:30:47.809828+0000 front 2023-07-14T18:30:47.809790+0000 (oldest deadline 2023-07-14T18:31:18.410275+0000) 2023-07-14T18:31:45.661 INFO:journalctl@ceph.osd.8.smithi184.stdout:Jul 14 18:31:45 smithi184 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-8[115280]: 2023-07-14T18:31:45.247+0000 7fa897e34700 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.184:6804 osd.2 since back 2023-07-14T18:31:00.111285+0000 front 2023-07-14T18:31:00.111392+0000 (oldest deadline 2023-07-14T18:31:21.211412+0000) 2023-07-14T18:31:45.661 INFO:journalctl@ceph.osd.8.smithi184.stdout:Jul 14 18:31:45 smithi184 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-8[115280]: 2023-07-14T18:31:45.247+0000 7fa897e34700 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.163:6814 osd.3 since back 2023-07-14T18:31:07.112570+0000 front 2023-07-14T18:31:07.112507+0000 (oldest deadline 2023-07-14T18:31:31.812314+0000) 2023-07-14T18:31:45.661 INFO:journalctl@ceph.osd.8.smithi184.stdout:Jul 14 18:31:45 smithi184 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-8[115280]: 2023-07-14T18:31:45.247+0000 7fa897e34700 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.172:6812 osd.4 since back 2023-07-14T18:31:15.213909+0000 front 2023-07-14T18:31:15.213696+0000 (oldest deadline 2023-07-14T18:31:40.513767+0000) 2023-07-14T18:31:45.661 INFO:journalctl@ceph.osd.8.smithi184.stdout:Jul 14 18:31:45 smithi184 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-8[115280]: 2023-07-14T18:31:45.247+0000 7fa897e34700 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.184:6812 osd.5 since back 2023-07-14T18:31:20.514090+0000 front 2023-07-14T18:31:20.514112+0000 (oldest deadline 2023-07-14T18:31:44.614277+0000) 2023-07-14T18:31:45.662 INFO:journalctl@ceph.osd.11.smithi184.stdout:Jul 14 18:31:45 smithi184 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-11[120819]: 2023-07-14T18:31:45.451+0000 7f44dbfe8700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.163:6806 osd.0 since back 2023-07-14T18:30:42.566533+0000 front 2023-07-14T18:30:42.566680+0000 (oldest deadline 2023-07-14T18:31:08.967162+0000) 2023-07-14T18:31:45.662 INFO:journalctl@ceph.osd.11.smithi184.stdout:Jul 14 18:31:45 smithi184 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-11[120819]: 2023-07-14T18:31:45.451+0000 7f44dbfe8700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2023-07-14T18:30:51.868462+0000 front 2023-07-14T18:30:51.868670+0000 (oldest deadline 2023-07-14T18:31:17.768517+0000) 2023-07-14T18:31:45.662 INFO:journalctl@ceph.osd.11.smithi184.stdout:Jul 14 18:31:45 smithi184 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-11[120819]: 2023-07-14T18:31:45.451+0000 7f44dbfe8700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.184:6804 osd.2 since back 2023-07-14T18:30:58.269297+0000 front 2023-07-14T18:30:58.269338+0000 (oldest deadline 2023-07-14T18:31:23.569431+0000) 2023-07-14T18:31:45.662 INFO:journalctl@ceph.osd.11.smithi184.stdout:Jul 14 18:31:45 smithi184 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-11[120819]: 2023-07-14T18:31:45.451+0000 7f44dbfe8700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.172:6812 osd.4 since back 2023-07-14T18:31:14.770869+0000 front 2023-07-14T18:31:14.770949+0000 (oldest deadline 2023-07-14T18:31:38.270981+0000) 2023-07-14T18:31:45.952 INFO:journalctl@ceph.osd.9.smithi163.stdout:Jul 14 18:31:45 smithi163 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-9[125814]: 2023-07-14T18:31:45.669+0000 7fd0759f3700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.163:6806 osd.0 since back 2023-07-14T18:30:42.661073+0000 front 2023-07-14T18:30:42.661052+0000 (oldest deadline 2023-07-14T18:31:07.961309+0000) 2023-07-14T18:31:45.953 INFO:journalctl@ceph.osd.9.smithi163.stdout:Jul 14 18:31:45 smithi163 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-9[125814]: 2023-07-14T18:31:45.669+0000 7fd0759f3700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2023-07-14T18:30:47.961848+0000 front 2023-07-14T18:30:47.961754+0000 (oldest deadline 2023-07-14T18:31:13.861824+0000) 2023-07-14T18:31:45.953 INFO:journalctl@ceph.osd.9.smithi163.stdout:Jul 14 18:31:45 smithi163 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-9[125814]: 2023-07-14T18:31:45.669+0000 7fd0759f3700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.184:6804 osd.2 since back 2023-07-14T18:30:59.763100+0000 front 2023-07-14T18:30:59.763261+0000 (oldest deadline 2023-07-14T18:31:25.662987+0000) 2023-07-14T18:31:45.953 INFO:journalctl@ceph.osd.9.smithi163.stdout:Jul 14 18:31:45 smithi163 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-9[125814]: 2023-07-14T18:31:45.669+0000 7fd0759f3700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.163:6814 osd.3 since back 2023-07-14T18:31:05.663336+0000 front 2023-07-14T18:31:05.663310+0000 (oldest deadline 2023-07-14T18:31:30.963470+0000) 2023-07-14T18:31:45.954 INFO:journalctl@ceph.osd.9.smithi163.stdout:Jul 14 18:31:45 smithi163 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-9[125814]: 2023-07-14T18:31:45.669+0000 7fd0759f3700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.172:6812 osd.4 since back 2023-07-14T18:31:10.963937+0000 front 2023-07-14T18:31:10.964038+0000 (oldest deadline 2023-07-14T18:31:38.564432+0000) 2023-07-14T18:31:46.511 INFO:journalctl@ceph.osd.10.smithi172.stdout:Jul 14 18:31:46 smithi172 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-10[119489]: 2023-07-14T18:31:46.109+0000 7fe8a6017700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.163:6806 osd.0 since back 2023-07-14T18:30:44.219658+0000 front 2023-07-14T18:30:44.219740+0000 (oldest deadline 2023-07-14T18:31:05.919624+0000) 2023-07-14T18:31:46.511 INFO:journalctl@ceph.osd.10.smithi172.stdout:Jul 14 18:31:46 smithi172 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-10[119489]: 2023-07-14T18:31:46.109+0000 7fe8a6017700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2023-07-14T18:30:51.022066+0000 front 2023-07-14T18:30:51.022166+0000 (oldest deadline 2023-07-14T18:31:13.922245+0000) 2023-07-14T18:31:46.511 INFO:journalctl@ceph.osd.10.smithi172.stdout:Jul 14 18:31:46 smithi172 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-10[119489]: 2023-07-14T18:31:46.109+0000 7fe8a6017700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.184:6804 osd.2 since back 2023-07-14T18:30:59.723894+0000 front 2023-07-14T18:30:59.723980+0000 (oldest deadline 2023-07-14T18:31:21.424006+0000) 2023-07-14T18:31:46.512 INFO:journalctl@ceph.osd.10.smithi172.stdout:Jul 14 18:31:46 smithi172 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-10[119489]: 2023-07-14T18:31:46.109+0000 7fe8a6017700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.163:6814 osd.3 since back 2023-07-14T18:31:07.126091+0000 front 2023-07-14T18:31:07.126185+0000 (oldest deadline 2023-07-14T18:31:31.826180+0000) 2023-07-14T18:31:46.512 INFO:journalctl@ceph.osd.10.smithi172.stdout:Jul 14 18:31:46 smithi172 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-10[119489]: 2023-07-14T18:31:46.109+0000 7fe8a6017700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.172:6812 osd.4 since back 2023-07-14T18:31:11.826674+0000 front 2023-07-14T18:31:11.826695+0000 (oldest deadline 2023-07-14T18:31:37.726788+0000) 2023-07-14T18:31:46.512 INFO:journalctl@ceph.osd.10.smithi172.stdout:Jul 14 18:31:46 smithi172 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-10[119489]: 2023-07-14T18:31:46.109+0000 7fe8a6017700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.184:6812 osd.5 since back 2023-07-14T18:31:21.128328+0000 front 2023-07-14T18:31:21.128169+0000 (oldest deadline 2023-07-14T18:31:45.827990+0000) 2023-07-14T18:31:46.813 INFO:journalctl@ceph.osd.11.smithi184.stdout:Jul 14 18:31:46 smithi184 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-11[120819]: 2023-07-14T18:31:46.406+0000 7f44dbfe8700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.163:6806 osd.0 since back 2023-07-14T18:30:42.566533+0000 front 2023-07-14T18:30:42.566680+0000 (oldest deadline 2023-07-14T18:31:08.967162+0000) 2023-07-14T18:31:46.814 INFO:journalctl@ceph.osd.11.smithi184.stdout:Jul 14 18:31:46 smithi184 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-11[120819]: 2023-07-14T18:31:46.406+0000 7f44dbfe8700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2023-07-14T18:30:51.868462+0000 front 2023-07-14T18:30:51.868670+0000 (oldest deadline 2023-07-14T18:31:17.768517+0000) 2023-07-14T18:31:46.814 INFO:journalctl@ceph.osd.11.smithi184.stdout:Jul 14 18:31:46 smithi184 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-11[120819]: 2023-07-14T18:31:46.406+0000 7f44dbfe8700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.184:6804 osd.2 since back 2023-07-14T18:30:58.269297+0000 front 2023-07-14T18:30:58.269338+0000 (oldest deadline 2023-07-14T18:31:23.569431+0000) 2023-07-14T18:31:46.814 INFO:journalctl@ceph.osd.11.smithi184.stdout:Jul 14 18:31:46 smithi184 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-11[120819]: 2023-07-14T18:31:46.406+0000 7f44dbfe8700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.172:6812 osd.4 since back 2023-07-14T18:31:14.770869+0000 front 2023-07-14T18:31:14.770949+0000 (oldest deadline 2023-07-14T18:31:38.270981+0000) 2023-07-14T18:31:46.814 INFO:journalctl@ceph.osd.11.smithi184.stdout:Jul 14 18:31:46 smithi184 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-11[120819]: 2023-07-14T18:31:46.406+0000 7f44dbfe8700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.184:6812 osd.5 since back 2023-07-14T18:31:22.272344+0000 front 2023-07-14T18:31:22.272388+0000 (oldest deadline 2023-07-14T18:31:46.372402+0000) 2023-07-14T18:31:47.160 INFO:journalctl@ceph.osd.8.smithi184.stdout:Jul 14 18:31:46 smithi184 bash[131273]: ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-8 2023-07-14T18:31:47.202 INFO:journalctl@ceph.osd.9.smithi163.stdout:Jul 14 18:31:46 smithi163 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-9[125814]: 2023-07-14T18:31:46.688+0000 7fd0759f3700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.163:6806 osd.0 since back 2023-07-14T18:30:42.661073+0000 front 2023-07-14T18:30:42.661052+0000 (oldest deadline 2023-07-14T18:31:07.961309+0000) 2023-07-14T18:31:47.203 INFO:journalctl@ceph.osd.9.smithi163.stdout:Jul 14 18:31:46 smithi163 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-9[125814]: 2023-07-14T18:31:46.688+0000 7fd0759f3700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2023-07-14T18:30:47.961848+0000 front 2023-07-14T18:30:47.961754+0000 (oldest deadline 2023-07-14T18:31:13.861824+0000) 2023-07-14T18:31:47.203 INFO:journalctl@ceph.osd.9.smithi163.stdout:Jul 14 18:31:46 smithi163 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-9[125814]: 2023-07-14T18:31:46.688+0000 7fd0759f3700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.184:6804 osd.2 since back 2023-07-14T18:30:59.763100+0000 front 2023-07-14T18:30:59.763261+0000 (oldest deadline 2023-07-14T18:31:25.662987+0000) 2023-07-14T18:31:47.203 INFO:journalctl@ceph.osd.9.smithi163.stdout:Jul 14 18:31:46 smithi163 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-9[125814]: 2023-07-14T18:31:46.688+0000 7fd0759f3700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.163:6814 osd.3 since back 2023-07-14T18:31:05.663336+0000 front 2023-07-14T18:31:05.663310+0000 (oldest deadline 2023-07-14T18:31:30.963470+0000) 2023-07-14T18:31:47.203 INFO:journalctl@ceph.osd.9.smithi163.stdout:Jul 14 18:31:46 smithi163 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-9[125814]: 2023-07-14T18:31:46.688+0000 7fd0759f3700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.172:6812 osd.4 since back 2023-07-14T18:31:10.963937+0000 front 2023-07-14T18:31:10.964038+0000 (oldest deadline 2023-07-14T18:31:38.564432+0000) 2023-07-14T18:31:47.204 INFO:journalctl@ceph.osd.9.smithi163.stdout:Jul 14 18:31:46 smithi163 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-9[125814]: 2023-07-14T18:31:46.688+0000 7fd0759f3700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.184:6812 osd.5 since back 2023-07-14T18:31:18.564935+0000 front 2023-07-14T18:31:18.565043+0000 (oldest deadline 2023-07-14T18:31:46.165387+0000) 2023-07-14T18:31:47.511 INFO:journalctl@ceph.osd.10.smithi172.stdout:Jul 14 18:31:47 smithi172 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-10[119489]: 2023-07-14T18:31:47.071+0000 7fe8a6017700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.163:6806 osd.0 since back 2023-07-14T18:30:44.219658+0000 front 2023-07-14T18:30:44.219740+0000 (oldest deadline 2023-07-14T18:31:05.919624+0000) 2023-07-14T18:31:47.511 INFO:journalctl@ceph.osd.10.smithi172.stdout:Jul 14 18:31:47 smithi172 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-10[119489]: 2023-07-14T18:31:47.071+0000 7fe8a6017700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2023-07-14T18:30:51.022066+0000 front 2023-07-14T18:30:51.022166+0000 (oldest deadline 2023-07-14T18:31:13.922245+0000) 2023-07-14T18:31:47.511 INFO:journalctl@ceph.osd.10.smithi172.stdout:Jul 14 18:31:47 smithi172 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-10[119489]: 2023-07-14T18:31:47.071+0000 7fe8a6017700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.184:6804 osd.2 since back 2023-07-14T18:30:59.723894+0000 front 2023-07-14T18:30:59.723980+0000 (oldest deadline 2023-07-14T18:31:21.424006+0000) 2023-07-14T18:31:47.512 INFO:journalctl@ceph.osd.10.smithi172.stdout:Jul 14 18:31:47 smithi172 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-10[119489]: 2023-07-14T18:31:47.071+0000 7fe8a6017700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.163:6814 osd.3 since back 2023-07-14T18:31:07.126091+0000 front 2023-07-14T18:31:07.126185+0000 (oldest deadline 2023-07-14T18:31:31.826180+0000) 2023-07-14T18:31:47.512 INFO:journalctl@ceph.osd.10.smithi172.stdout:Jul 14 18:31:47 smithi172 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-10[119489]: 2023-07-14T18:31:47.071+0000 7fe8a6017700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.172:6812 osd.4 since back 2023-07-14T18:31:11.826674+0000 front 2023-07-14T18:31:11.826695+0000 (oldest deadline 2023-07-14T18:31:37.726788+0000) 2023-07-14T18:31:47.512 INFO:journalctl@ceph.osd.10.smithi172.stdout:Jul 14 18:31:47 smithi172 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-10[119489]: 2023-07-14T18:31:47.071+0000 7fe8a6017700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.184:6812 osd.5 since back 2023-07-14T18:31:21.128328+0000 front 2023-07-14T18:31:21.128169+0000 (oldest deadline 2023-07-14T18:31:45.827990+0000) 2023-07-14T18:31:47.819 INFO:journalctl@ceph.osd.11.smithi184.stdout:Jul 14 18:31:47 smithi184 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-11[120819]: 2023-07-14T18:31:47.404+0000 7f44dbfe8700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.163:6806 osd.0 since back 2023-07-14T18:30:42.566533+0000 front 2023-07-14T18:30:42.566680+0000 (oldest deadline 2023-07-14T18:31:08.967162+0000) 2023-07-14T18:31:47.819 INFO:journalctl@ceph.osd.11.smithi184.stdout:Jul 14 18:31:47 smithi184 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-11[120819]: 2023-07-14T18:31:47.404+0000 7f44dbfe8700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2023-07-14T18:30:51.868462+0000 front 2023-07-14T18:30:51.868670+0000 (oldest deadline 2023-07-14T18:31:17.768517+0000) 2023-07-14T18:31:47.820 INFO:journalctl@ceph.osd.11.smithi184.stdout:Jul 14 18:31:47 smithi184 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-11[120819]: 2023-07-14T18:31:47.404+0000 7f44dbfe8700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.184:6804 osd.2 since back 2023-07-14T18:30:58.269297+0000 front 2023-07-14T18:30:58.269338+0000 (oldest deadline 2023-07-14T18:31:23.569431+0000) 2023-07-14T18:31:47.820 INFO:journalctl@ceph.osd.11.smithi184.stdout:Jul 14 18:31:47 smithi184 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-11[120819]: 2023-07-14T18:31:47.404+0000 7f44dbfe8700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.172:6812 osd.4 since back 2023-07-14T18:31:14.770869+0000 front 2023-07-14T18:31:14.770949+0000 (oldest deadline 2023-07-14T18:31:38.270981+0000) 2023-07-14T18:31:47.820 INFO:journalctl@ceph.osd.11.smithi184.stdout:Jul 14 18:31:47 smithi184 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-11[120819]: 2023-07-14T18:31:47.404+0000 7f44dbfe8700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.184:6812 osd.5 since back 2023-07-14T18:31:22.272344+0000 front 2023-07-14T18:31:22.272388+0000 (oldest deadline 2023-07-14T18:31:46.372402+0000) 2023-07-14T18:31:47.952 INFO:journalctl@ceph.osd.9.smithi163.stdout:Jul 14 18:31:47 smithi163 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-9[125814]: 2023-07-14T18:31:47.660+0000 7fd0759f3700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.163:6806 osd.0 since back 2023-07-14T18:30:42.661073+0000 front 2023-07-14T18:30:42.661052+0000 (oldest deadline 2023-07-14T18:31:07.961309+0000) 2023-07-14T18:31:47.953 INFO:journalctl@ceph.osd.9.smithi163.stdout:Jul 14 18:31:47 smithi163 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-9[125814]: 2023-07-14T18:31:47.660+0000 7fd0759f3700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2023-07-14T18:30:47.961848+0000 front 2023-07-14T18:30:47.961754+0000 (oldest deadline 2023-07-14T18:31:13.861824+0000) 2023-07-14T18:31:47.953 INFO:journalctl@ceph.osd.9.smithi163.stdout:Jul 14 18:31:47 smithi163 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-9[125814]: 2023-07-14T18:31:47.660+0000 7fd0759f3700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.184:6804 osd.2 since back 2023-07-14T18:30:59.763100+0000 front 2023-07-14T18:30:59.763261+0000 (oldest deadline 2023-07-14T18:31:25.662987+0000) 2023-07-14T18:31:47.953 INFO:journalctl@ceph.osd.9.smithi163.stdout:Jul 14 18:31:47 smithi163 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-9[125814]: 2023-07-14T18:31:47.660+0000 7fd0759f3700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.163:6814 osd.3 since back 2023-07-14T18:31:05.663336+0000 front 2023-07-14T18:31:05.663310+0000 (oldest deadline 2023-07-14T18:31:30.963470+0000) 2023-07-14T18:31:47.953 INFO:journalctl@ceph.osd.9.smithi163.stdout:Jul 14 18:31:47 smithi163 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-9[125814]: 2023-07-14T18:31:47.660+0000 7fd0759f3700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.172:6812 osd.4 since back 2023-07-14T18:31:10.963937+0000 front 2023-07-14T18:31:10.964038+0000 (oldest deadline 2023-07-14T18:31:38.564432+0000) 2023-07-14T18:31:47.953 INFO:journalctl@ceph.osd.9.smithi163.stdout:Jul 14 18:31:47 smithi163 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-9[125814]: 2023-07-14T18:31:47.660+0000 7fd0759f3700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.184:6812 osd.5 since back 2023-07-14T18:31:18.564935+0000 front 2023-07-14T18:31:18.565043+0000 (oldest deadline 2023-07-14T18:31:46.165387+0000) 2023-07-14T18:31:48.153 DEBUG:teuthology.orchestra.run.smithi184:> sudo pkill -f 'journalctl -f -n 0 -u ceph-bf7326ec-2270-11ee-9b33-001a4aab830c@osd.8.service' 2023-07-14T18:31:48.195 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-07-14T18:31:48.196 INFO:tasks.cephadm.osd.8:Stopped osd.8 2023-07-14T18:31:48.196 INFO:tasks.cephadm.osd.9:Stopping osd.9... 2023-07-14T18:31:48.197 DEBUG:teuthology.orchestra.run.smithi163:> sudo systemctl stop ceph-bf7326ec-2270-11ee-9b33-001a4aab830c@osd.9 2023-07-14T18:31:48.511 INFO:journalctl@ceph.osd.10.smithi172.stdout:Jul 14 18:31:48 smithi172 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-10[119489]: 2023-07-14T18:31:48.118+0000 7fe8a6017700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.163:6806 osd.0 since back 2023-07-14T18:30:44.219658+0000 front 2023-07-14T18:30:44.219740+0000 (oldest deadline 2023-07-14T18:31:05.919624+0000) 2023-07-14T18:31:48.511 INFO:journalctl@ceph.osd.10.smithi172.stdout:Jul 14 18:31:48 smithi172 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-10[119489]: 2023-07-14T18:31:48.118+0000 7fe8a6017700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2023-07-14T18:30:51.022066+0000 front 2023-07-14T18:30:51.022166+0000 (oldest deadline 2023-07-14T18:31:13.922245+0000) 2023-07-14T18:31:48.511 INFO:journalctl@ceph.osd.10.smithi172.stdout:Jul 14 18:31:48 smithi172 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-10[119489]: 2023-07-14T18:31:48.118+0000 7fe8a6017700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.184:6804 osd.2 since back 2023-07-14T18:30:59.723894+0000 front 2023-07-14T18:30:59.723980+0000 (oldest deadline 2023-07-14T18:31:21.424006+0000) 2023-07-14T18:31:48.512 INFO:journalctl@ceph.osd.10.smithi172.stdout:Jul 14 18:31:48 smithi172 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-10[119489]: 2023-07-14T18:31:48.118+0000 7fe8a6017700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.163:6814 osd.3 since back 2023-07-14T18:31:07.126091+0000 front 2023-07-14T18:31:07.126185+0000 (oldest deadline 2023-07-14T18:31:31.826180+0000) 2023-07-14T18:31:48.512 INFO:journalctl@ceph.osd.10.smithi172.stdout:Jul 14 18:31:48 smithi172 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-10[119489]: 2023-07-14T18:31:48.118+0000 7fe8a6017700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.172:6812 osd.4 since back 2023-07-14T18:31:11.826674+0000 front 2023-07-14T18:31:11.826695+0000 (oldest deadline 2023-07-14T18:31:37.726788+0000) 2023-07-14T18:31:48.512 INFO:journalctl@ceph.osd.10.smithi172.stdout:Jul 14 18:31:48 smithi172 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-10[119489]: 2023-07-14T18:31:48.118+0000 7fe8a6017700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.184:6812 osd.5 since back 2023-07-14T18:31:21.128328+0000 front 2023-07-14T18:31:21.128169+0000 (oldest deadline 2023-07-14T18:31:45.827990+0000) 2023-07-14T18:31:48.566 INFO:journalctl@ceph.osd.9.smithi163.stdout:Jul 14 18:31:48 smithi163 systemd[1]: Stopping Ceph osd.9 for bf7326ec-2270-11ee-9b33-001a4aab830c... 2023-07-14T18:31:48.910 INFO:journalctl@ceph.osd.11.smithi184.stdout:Jul 14 18:31:48 smithi184 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-11[120819]: 2023-07-14T18:31:48.399+0000 7f44dbfe8700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.163:6806 osd.0 since back 2023-07-14T18:30:42.566533+0000 front 2023-07-14T18:30:42.566680+0000 (oldest deadline 2023-07-14T18:31:08.967162+0000) 2023-07-14T18:31:48.910 INFO:journalctl@ceph.osd.11.smithi184.stdout:Jul 14 18:31:48 smithi184 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-11[120819]: 2023-07-14T18:31:48.399+0000 7f44dbfe8700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2023-07-14T18:30:51.868462+0000 front 2023-07-14T18:30:51.868670+0000 (oldest deadline 2023-07-14T18:31:17.768517+0000) 2023-07-14T18:31:48.910 INFO:journalctl@ceph.osd.11.smithi184.stdout:Jul 14 18:31:48 smithi184 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-11[120819]: 2023-07-14T18:31:48.399+0000 7f44dbfe8700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.184:6804 osd.2 since back 2023-07-14T18:30:58.269297+0000 front 2023-07-14T18:30:58.269338+0000 (oldest deadline 2023-07-14T18:31:23.569431+0000) 2023-07-14T18:31:48.911 INFO:journalctl@ceph.osd.11.smithi184.stdout:Jul 14 18:31:48 smithi184 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-11[120819]: 2023-07-14T18:31:48.399+0000 7f44dbfe8700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.172:6812 osd.4 since back 2023-07-14T18:31:14.770869+0000 front 2023-07-14T18:31:14.770949+0000 (oldest deadline 2023-07-14T18:31:38.270981+0000) 2023-07-14T18:31:48.911 INFO:journalctl@ceph.osd.11.smithi184.stdout:Jul 14 18:31:48 smithi184 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-11[120819]: 2023-07-14T18:31:48.399+0000 7f44dbfe8700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.184:6812 osd.5 since back 2023-07-14T18:31:22.272344+0000 front 2023-07-14T18:31:22.272388+0000 (oldest deadline 2023-07-14T18:31:46.372402+0000) 2023-07-14T18:31:48.952 INFO:journalctl@ceph.osd.9.smithi163.stdout:Jul 14 18:31:48 smithi163 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-9[125814]: 2023-07-14T18:31:48.541+0000 7fd07cc03700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-osd -n osd.9 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-07-14T18:31:48.953 INFO:journalctl@ceph.osd.9.smithi163.stdout:Jul 14 18:31:48 smithi163 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-9[125814]: 2023-07-14T18:31:48.541+0000 7fd07cc03700 -1 osd.9 88 *** Got signal Terminated *** 2023-07-14T18:31:48.953 INFO:journalctl@ceph.osd.9.smithi163.stdout:Jul 14 18:31:48 smithi163 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-9[125814]: 2023-07-14T18:31:48.541+0000 7fd07cc03700 -1 osd.9 88 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-07-14T18:31:48.953 INFO:journalctl@ceph.osd.9.smithi163.stdout:Jul 14 18:31:48 smithi163 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-9[125814]: 2023-07-14T18:31:48.622+0000 7fd0759f3700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.163:6806 osd.0 since back 2023-07-14T18:30:42.661073+0000 front 2023-07-14T18:30:42.661052+0000 (oldest deadline 2023-07-14T18:31:07.961309+0000) 2023-07-14T18:31:48.953 INFO:journalctl@ceph.osd.9.smithi163.stdout:Jul 14 18:31:48 smithi163 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-9[125814]: 2023-07-14T18:31:48.622+0000 7fd0759f3700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2023-07-14T18:30:47.961848+0000 front 2023-07-14T18:30:47.961754+0000 (oldest deadline 2023-07-14T18:31:13.861824+0000) 2023-07-14T18:31:48.954 INFO:journalctl@ceph.osd.9.smithi163.stdout:Jul 14 18:31:48 smithi163 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-9[125814]: 2023-07-14T18:31:48.622+0000 7fd0759f3700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.184:6804 osd.2 since back 2023-07-14T18:30:59.763100+0000 front 2023-07-14T18:30:59.763261+0000 (oldest deadline 2023-07-14T18:31:25.662987+0000) 2023-07-14T18:31:48.954 INFO:journalctl@ceph.osd.9.smithi163.stdout:Jul 14 18:31:48 smithi163 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-9[125814]: 2023-07-14T18:31:48.622+0000 7fd0759f3700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.163:6814 osd.3 since back 2023-07-14T18:31:05.663336+0000 front 2023-07-14T18:31:05.663310+0000 (oldest deadline 2023-07-14T18:31:30.963470+0000) 2023-07-14T18:31:48.954 INFO:journalctl@ceph.osd.9.smithi163.stdout:Jul 14 18:31:48 smithi163 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-9[125814]: 2023-07-14T18:31:48.622+0000 7fd0759f3700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.172:6812 osd.4 since back 2023-07-14T18:31:10.963937+0000 front 2023-07-14T18:31:10.964038+0000 (oldest deadline 2023-07-14T18:31:38.564432+0000) 2023-07-14T18:31:48.954 INFO:journalctl@ceph.osd.9.smithi163.stdout:Jul 14 18:31:48 smithi163 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-9[125814]: 2023-07-14T18:31:48.622+0000 7fd0759f3700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.184:6812 osd.5 since back 2023-07-14T18:31:18.564935+0000 front 2023-07-14T18:31:18.565043+0000 (oldest deadline 2023-07-14T18:31:46.165387+0000) 2023-07-14T18:31:49.511 INFO:journalctl@ceph.osd.10.smithi172.stdout:Jul 14 18:31:49 smithi172 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-10[119489]: 2023-07-14T18:31:49.106+0000 7fe8a6017700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.163:6806 osd.0 since back 2023-07-14T18:30:44.219658+0000 front 2023-07-14T18:30:44.219740+0000 (oldest deadline 2023-07-14T18:31:05.919624+0000) 2023-07-14T18:31:49.511 INFO:journalctl@ceph.osd.10.smithi172.stdout:Jul 14 18:31:49 smithi172 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-10[119489]: 2023-07-14T18:31:49.106+0000 7fe8a6017700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2023-07-14T18:30:51.022066+0000 front 2023-07-14T18:30:51.022166+0000 (oldest deadline 2023-07-14T18:31:13.922245+0000) 2023-07-14T18:31:49.511 INFO:journalctl@ceph.osd.10.smithi172.stdout:Jul 14 18:31:49 smithi172 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-10[119489]: 2023-07-14T18:31:49.106+0000 7fe8a6017700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.184:6804 osd.2 since back 2023-07-14T18:30:59.723894+0000 front 2023-07-14T18:30:59.723980+0000 (oldest deadline 2023-07-14T18:31:21.424006+0000) 2023-07-14T18:31:49.512 INFO:journalctl@ceph.osd.10.smithi172.stdout:Jul 14 18:31:49 smithi172 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-10[119489]: 2023-07-14T18:31:49.106+0000 7fe8a6017700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.163:6814 osd.3 since back 2023-07-14T18:31:07.126091+0000 front 2023-07-14T18:31:07.126185+0000 (oldest deadline 2023-07-14T18:31:31.826180+0000) 2023-07-14T18:31:49.512 INFO:journalctl@ceph.osd.10.smithi172.stdout:Jul 14 18:31:49 smithi172 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-10[119489]: 2023-07-14T18:31:49.106+0000 7fe8a6017700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.172:6812 osd.4 since back 2023-07-14T18:31:11.826674+0000 front 2023-07-14T18:31:11.826695+0000 (oldest deadline 2023-07-14T18:31:37.726788+0000) 2023-07-14T18:31:49.512 INFO:journalctl@ceph.osd.10.smithi172.stdout:Jul 14 18:31:49 smithi172 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-10[119489]: 2023-07-14T18:31:49.106+0000 7fe8a6017700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.184:6812 osd.5 since back 2023-07-14T18:31:21.128328+0000 front 2023-07-14T18:31:21.128169+0000 (oldest deadline 2023-07-14T18:31:45.827990+0000) 2023-07-14T18:31:49.910 INFO:journalctl@ceph.osd.11.smithi184.stdout:Jul 14 18:31:49 smithi184 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-11[120819]: 2023-07-14T18:31:49.386+0000 7f44dbfe8700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.163:6806 osd.0 since back 2023-07-14T18:30:42.566533+0000 front 2023-07-14T18:30:42.566680+0000 (oldest deadline 2023-07-14T18:31:08.967162+0000) 2023-07-14T18:31:49.910 INFO:journalctl@ceph.osd.11.smithi184.stdout:Jul 14 18:31:49 smithi184 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-11[120819]: 2023-07-14T18:31:49.386+0000 7f44dbfe8700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2023-07-14T18:30:51.868462+0000 front 2023-07-14T18:30:51.868670+0000 (oldest deadline 2023-07-14T18:31:17.768517+0000) 2023-07-14T18:31:49.910 INFO:journalctl@ceph.osd.11.smithi184.stdout:Jul 14 18:31:49 smithi184 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-11[120819]: 2023-07-14T18:31:49.386+0000 7f44dbfe8700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.184:6804 osd.2 since back 2023-07-14T18:30:58.269297+0000 front 2023-07-14T18:30:58.269338+0000 (oldest deadline 2023-07-14T18:31:23.569431+0000) 2023-07-14T18:31:49.911 INFO:journalctl@ceph.osd.11.smithi184.stdout:Jul 14 18:31:49 smithi184 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-11[120819]: 2023-07-14T18:31:49.386+0000 7f44dbfe8700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.172:6812 osd.4 since back 2023-07-14T18:31:14.770869+0000 front 2023-07-14T18:31:14.770949+0000 (oldest deadline 2023-07-14T18:31:38.270981+0000) 2023-07-14T18:31:49.911 INFO:journalctl@ceph.osd.11.smithi184.stdout:Jul 14 18:31:49 smithi184 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-11[120819]: 2023-07-14T18:31:49.386+0000 7f44dbfe8700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.184:6812 osd.5 since back 2023-07-14T18:31:22.272344+0000 front 2023-07-14T18:31:22.272388+0000 (oldest deadline 2023-07-14T18:31:46.372402+0000) 2023-07-14T18:31:49.952 INFO:journalctl@ceph.osd.9.smithi163.stdout:Jul 14 18:31:49 smithi163 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-9[125814]: 2023-07-14T18:31:49.613+0000 7fd0759f3700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.163:6806 osd.0 since back 2023-07-14T18:30:42.661073+0000 front 2023-07-14T18:30:42.661052+0000 (oldest deadline 2023-07-14T18:31:07.961309+0000) 2023-07-14T18:31:49.953 INFO:journalctl@ceph.osd.9.smithi163.stdout:Jul 14 18:31:49 smithi163 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-9[125814]: 2023-07-14T18:31:49.613+0000 7fd0759f3700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2023-07-14T18:30:47.961848+0000 front 2023-07-14T18:30:47.961754+0000 (oldest deadline 2023-07-14T18:31:13.861824+0000) 2023-07-14T18:31:49.953 INFO:journalctl@ceph.osd.9.smithi163.stdout:Jul 14 18:31:49 smithi163 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-9[125814]: 2023-07-14T18:31:49.613+0000 7fd0759f3700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.184:6804 osd.2 since back 2023-07-14T18:30:59.763100+0000 front 2023-07-14T18:30:59.763261+0000 (oldest deadline 2023-07-14T18:31:25.662987+0000) 2023-07-14T18:31:49.953 INFO:journalctl@ceph.osd.9.smithi163.stdout:Jul 14 18:31:49 smithi163 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-9[125814]: 2023-07-14T18:31:49.613+0000 7fd0759f3700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.163:6814 osd.3 since back 2023-07-14T18:31:05.663336+0000 front 2023-07-14T18:31:05.663310+0000 (oldest deadline 2023-07-14T18:31:30.963470+0000) 2023-07-14T18:31:49.953 INFO:journalctl@ceph.osd.9.smithi163.stdout:Jul 14 18:31:49 smithi163 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-9[125814]: 2023-07-14T18:31:49.613+0000 7fd0759f3700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.172:6812 osd.4 since back 2023-07-14T18:31:10.963937+0000 front 2023-07-14T18:31:10.964038+0000 (oldest deadline 2023-07-14T18:31:38.564432+0000) 2023-07-14T18:31:49.954 INFO:journalctl@ceph.osd.9.smithi163.stdout:Jul 14 18:31:49 smithi163 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-9[125814]: 2023-07-14T18:31:49.613+0000 7fd0759f3700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.184:6812 osd.5 since back 2023-07-14T18:31:18.564935+0000 front 2023-07-14T18:31:18.565043+0000 (oldest deadline 2023-07-14T18:31:46.165387+0000) 2023-07-14T18:31:50.511 INFO:journalctl@ceph.osd.10.smithi172.stdout:Jul 14 18:31:50 smithi172 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-10[119489]: 2023-07-14T18:31:50.088+0000 7fe8a6017700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.163:6806 osd.0 since back 2023-07-14T18:30:44.219658+0000 front 2023-07-14T18:30:44.219740+0000 (oldest deadline 2023-07-14T18:31:05.919624+0000) 2023-07-14T18:31:50.511 INFO:journalctl@ceph.osd.10.smithi172.stdout:Jul 14 18:31:50 smithi172 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-10[119489]: 2023-07-14T18:31:50.088+0000 7fe8a6017700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2023-07-14T18:30:51.022066+0000 front 2023-07-14T18:30:51.022166+0000 (oldest deadline 2023-07-14T18:31:13.922245+0000) 2023-07-14T18:31:50.511 INFO:journalctl@ceph.osd.10.smithi172.stdout:Jul 14 18:31:50 smithi172 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-10[119489]: 2023-07-14T18:31:50.088+0000 7fe8a6017700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.184:6804 osd.2 since back 2023-07-14T18:30:59.723894+0000 front 2023-07-14T18:30:59.723980+0000 (oldest deadline 2023-07-14T18:31:21.424006+0000) 2023-07-14T18:31:50.512 INFO:journalctl@ceph.osd.10.smithi172.stdout:Jul 14 18:31:50 smithi172 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-10[119489]: 2023-07-14T18:31:50.088+0000 7fe8a6017700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.163:6814 osd.3 since back 2023-07-14T18:31:07.126091+0000 front 2023-07-14T18:31:07.126185+0000 (oldest deadline 2023-07-14T18:31:31.826180+0000) 2023-07-14T18:31:50.512 INFO:journalctl@ceph.osd.10.smithi172.stdout:Jul 14 18:31:50 smithi172 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-10[119489]: 2023-07-14T18:31:50.088+0000 7fe8a6017700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.172:6812 osd.4 since back 2023-07-14T18:31:11.826674+0000 front 2023-07-14T18:31:11.826695+0000 (oldest deadline 2023-07-14T18:31:37.726788+0000) 2023-07-14T18:31:50.513 INFO:journalctl@ceph.osd.10.smithi172.stdout:Jul 14 18:31:50 smithi172 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-10[119489]: 2023-07-14T18:31:50.088+0000 7fe8a6017700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.184:6812 osd.5 since back 2023-07-14T18:31:21.128328+0000 front 2023-07-14T18:31:21.128169+0000 (oldest deadline 2023-07-14T18:31:45.827990+0000) 2023-07-14T18:31:50.910 INFO:journalctl@ceph.osd.11.smithi184.stdout:Jul 14 18:31:50 smithi184 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-11[120819]: 2023-07-14T18:31:50.401+0000 7f44dbfe8700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.163:6806 osd.0 since back 2023-07-14T18:30:42.566533+0000 front 2023-07-14T18:30:42.566680+0000 (oldest deadline 2023-07-14T18:31:08.967162+0000) 2023-07-14T18:31:50.910 INFO:journalctl@ceph.osd.11.smithi184.stdout:Jul 14 18:31:50 smithi184 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-11[120819]: 2023-07-14T18:31:50.401+0000 7f44dbfe8700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2023-07-14T18:30:51.868462+0000 front 2023-07-14T18:30:51.868670+0000 (oldest deadline 2023-07-14T18:31:17.768517+0000) 2023-07-14T18:31:50.910 INFO:journalctl@ceph.osd.11.smithi184.stdout:Jul 14 18:31:50 smithi184 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-11[120819]: 2023-07-14T18:31:50.401+0000 7f44dbfe8700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.184:6804 osd.2 since back 2023-07-14T18:30:58.269297+0000 front 2023-07-14T18:30:58.269338+0000 (oldest deadline 2023-07-14T18:31:23.569431+0000) 2023-07-14T18:31:50.911 INFO:journalctl@ceph.osd.11.smithi184.stdout:Jul 14 18:31:50 smithi184 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-11[120819]: 2023-07-14T18:31:50.401+0000 7f44dbfe8700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.172:6812 osd.4 since back 2023-07-14T18:31:14.770869+0000 front 2023-07-14T18:31:14.770949+0000 (oldest deadline 2023-07-14T18:31:38.270981+0000) 2023-07-14T18:31:50.911 INFO:journalctl@ceph.osd.11.smithi184.stdout:Jul 14 18:31:50 smithi184 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-11[120819]: 2023-07-14T18:31:50.401+0000 7f44dbfe8700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.184:6812 osd.5 since back 2023-07-14T18:31:22.272344+0000 front 2023-07-14T18:31:22.272388+0000 (oldest deadline 2023-07-14T18:31:46.372402+0000) 2023-07-14T18:31:50.952 INFO:journalctl@ceph.osd.9.smithi163.stdout:Jul 14 18:31:50 smithi163 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-9[125814]: 2023-07-14T18:31:50.584+0000 7fd0759f3700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.163:6806 osd.0 since back 2023-07-14T18:30:42.661073+0000 front 2023-07-14T18:30:42.661052+0000 (oldest deadline 2023-07-14T18:31:07.961309+0000) 2023-07-14T18:31:50.953 INFO:journalctl@ceph.osd.9.smithi163.stdout:Jul 14 18:31:50 smithi163 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-9[125814]: 2023-07-14T18:31:50.584+0000 7fd0759f3700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2023-07-14T18:30:47.961848+0000 front 2023-07-14T18:30:47.961754+0000 (oldest deadline 2023-07-14T18:31:13.861824+0000) 2023-07-14T18:31:50.953 INFO:journalctl@ceph.osd.9.smithi163.stdout:Jul 14 18:31:50 smithi163 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-9[125814]: 2023-07-14T18:31:50.584+0000 7fd0759f3700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.184:6804 osd.2 since back 2023-07-14T18:30:59.763100+0000 front 2023-07-14T18:30:59.763261+0000 (oldest deadline 2023-07-14T18:31:25.662987+0000) 2023-07-14T18:31:50.953 INFO:journalctl@ceph.osd.9.smithi163.stdout:Jul 14 18:31:50 smithi163 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-9[125814]: 2023-07-14T18:31:50.584+0000 7fd0759f3700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.163:6814 osd.3 since back 2023-07-14T18:31:05.663336+0000 front 2023-07-14T18:31:05.663310+0000 (oldest deadline 2023-07-14T18:31:30.963470+0000) 2023-07-14T18:31:50.953 INFO:journalctl@ceph.osd.9.smithi163.stdout:Jul 14 18:31:50 smithi163 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-9[125814]: 2023-07-14T18:31:50.584+0000 7fd0759f3700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.172:6812 osd.4 since back 2023-07-14T18:31:10.963937+0000 front 2023-07-14T18:31:10.964038+0000 (oldest deadline 2023-07-14T18:31:38.564432+0000) 2023-07-14T18:31:50.954 INFO:journalctl@ceph.osd.9.smithi163.stdout:Jul 14 18:31:50 smithi163 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-9[125814]: 2023-07-14T18:31:50.584+0000 7fd0759f3700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.184:6812 osd.5 since back 2023-07-14T18:31:18.564935+0000 front 2023-07-14T18:31:18.565043+0000 (oldest deadline 2023-07-14T18:31:46.165387+0000) 2023-07-14T18:31:51.511 INFO:journalctl@ceph.osd.10.smithi172.stdout:Jul 14 18:31:51 smithi172 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-10[119489]: 2023-07-14T18:31:51.072+0000 7fe8a6017700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.163:6806 osd.0 since back 2023-07-14T18:30:44.219658+0000 front 2023-07-14T18:30:44.219740+0000 (oldest deadline 2023-07-14T18:31:05.919624+0000) 2023-07-14T18:31:51.512 INFO:journalctl@ceph.osd.10.smithi172.stdout:Jul 14 18:31:51 smithi172 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-10[119489]: 2023-07-14T18:31:51.072+0000 7fe8a6017700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2023-07-14T18:30:51.022066+0000 front 2023-07-14T18:30:51.022166+0000 (oldest deadline 2023-07-14T18:31:13.922245+0000) 2023-07-14T18:31:51.512 INFO:journalctl@ceph.osd.10.smithi172.stdout:Jul 14 18:31:51 smithi172 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-10[119489]: 2023-07-14T18:31:51.072+0000 7fe8a6017700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.184:6804 osd.2 since back 2023-07-14T18:30:59.723894+0000 front 2023-07-14T18:30:59.723980+0000 (oldest deadline 2023-07-14T18:31:21.424006+0000) 2023-07-14T18:31:51.513 INFO:journalctl@ceph.osd.10.smithi172.stdout:Jul 14 18:31:51 smithi172 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-10[119489]: 2023-07-14T18:31:51.072+0000 7fe8a6017700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.163:6814 osd.3 since back 2023-07-14T18:31:07.126091+0000 front 2023-07-14T18:31:07.126185+0000 (oldest deadline 2023-07-14T18:31:31.826180+0000) 2023-07-14T18:31:51.513 INFO:journalctl@ceph.osd.10.smithi172.stdout:Jul 14 18:31:51 smithi172 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-10[119489]: 2023-07-14T18:31:51.072+0000 7fe8a6017700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.172:6812 osd.4 since back 2023-07-14T18:31:11.826674+0000 front 2023-07-14T18:31:11.826695+0000 (oldest deadline 2023-07-14T18:31:37.726788+0000) 2023-07-14T18:31:51.513 INFO:journalctl@ceph.osd.10.smithi172.stdout:Jul 14 18:31:51 smithi172 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-10[119489]: 2023-07-14T18:31:51.072+0000 7fe8a6017700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.184:6812 osd.5 since back 2023-07-14T18:31:21.128328+0000 front 2023-07-14T18:31:21.128169+0000 (oldest deadline 2023-07-14T18:31:45.827990+0000) 2023-07-14T18:31:51.660 INFO:journalctl@ceph.osd.11.smithi184.stdout:Jul 14 18:31:51 smithi184 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-11[120819]: 2023-07-14T18:31:51.356+0000 7f44dbfe8700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.163:6806 osd.0 since back 2023-07-14T18:30:42.566533+0000 front 2023-07-14T18:30:42.566680+0000 (oldest deadline 2023-07-14T18:31:08.967162+0000) 2023-07-14T18:31:51.660 INFO:journalctl@ceph.osd.11.smithi184.stdout:Jul 14 18:31:51 smithi184 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-11[120819]: 2023-07-14T18:31:51.356+0000 7f44dbfe8700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2023-07-14T18:30:51.868462+0000 front 2023-07-14T18:30:51.868670+0000 (oldest deadline 2023-07-14T18:31:17.768517+0000) 2023-07-14T18:31:51.661 INFO:journalctl@ceph.osd.11.smithi184.stdout:Jul 14 18:31:51 smithi184 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-11[120819]: 2023-07-14T18:31:51.356+0000 7f44dbfe8700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.184:6804 osd.2 since back 2023-07-14T18:30:58.269297+0000 front 2023-07-14T18:30:58.269338+0000 (oldest deadline 2023-07-14T18:31:23.569431+0000) 2023-07-14T18:31:51.661 INFO:journalctl@ceph.osd.11.smithi184.stdout:Jul 14 18:31:51 smithi184 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-11[120819]: 2023-07-14T18:31:51.356+0000 7f44dbfe8700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.172:6812 osd.4 since back 2023-07-14T18:31:14.770869+0000 front 2023-07-14T18:31:14.770949+0000 (oldest deadline 2023-07-14T18:31:38.270981+0000) 2023-07-14T18:31:51.661 INFO:journalctl@ceph.osd.11.smithi184.stdout:Jul 14 18:31:51 smithi184 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-11[120819]: 2023-07-14T18:31:51.356+0000 7f44dbfe8700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.184:6812 osd.5 since back 2023-07-14T18:31:22.272344+0000 front 2023-07-14T18:31:22.272388+0000 (oldest deadline 2023-07-14T18:31:46.372402+0000) 2023-07-14T18:31:51.952 INFO:journalctl@ceph.osd.9.smithi163.stdout:Jul 14 18:31:51 smithi163 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-9[125814]: 2023-07-14T18:31:51.599+0000 7fd0759f3700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.163:6806 osd.0 since back 2023-07-14T18:30:42.661073+0000 front 2023-07-14T18:30:42.661052+0000 (oldest deadline 2023-07-14T18:31:07.961309+0000) 2023-07-14T18:31:51.953 INFO:journalctl@ceph.osd.9.smithi163.stdout:Jul 14 18:31:51 smithi163 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-9[125814]: 2023-07-14T18:31:51.599+0000 7fd0759f3700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2023-07-14T18:30:47.961848+0000 front 2023-07-14T18:30:47.961754+0000 (oldest deadline 2023-07-14T18:31:13.861824+0000) 2023-07-14T18:31:51.953 INFO:journalctl@ceph.osd.9.smithi163.stdout:Jul 14 18:31:51 smithi163 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-9[125814]: 2023-07-14T18:31:51.599+0000 7fd0759f3700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.184:6804 osd.2 since back 2023-07-14T18:30:59.763100+0000 front 2023-07-14T18:30:59.763261+0000 (oldest deadline 2023-07-14T18:31:25.662987+0000) 2023-07-14T18:31:51.953 INFO:journalctl@ceph.osd.9.smithi163.stdout:Jul 14 18:31:51 smithi163 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-9[125814]: 2023-07-14T18:31:51.599+0000 7fd0759f3700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.163:6814 osd.3 since back 2023-07-14T18:31:05.663336+0000 front 2023-07-14T18:31:05.663310+0000 (oldest deadline 2023-07-14T18:31:30.963470+0000) 2023-07-14T18:31:51.953 INFO:journalctl@ceph.osd.9.smithi163.stdout:Jul 14 18:31:51 smithi163 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-9[125814]: 2023-07-14T18:31:51.599+0000 7fd0759f3700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.172:6812 osd.4 since back 2023-07-14T18:31:10.963937+0000 front 2023-07-14T18:31:10.964038+0000 (oldest deadline 2023-07-14T18:31:38.564432+0000) 2023-07-14T18:31:51.954 INFO:journalctl@ceph.osd.9.smithi163.stdout:Jul 14 18:31:51 smithi163 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-9[125814]: 2023-07-14T18:31:51.599+0000 7fd0759f3700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.184:6812 osd.5 since back 2023-07-14T18:31:18.564935+0000 front 2023-07-14T18:31:18.565043+0000 (oldest deadline 2023-07-14T18:31:46.165387+0000) 2023-07-14T18:31:52.511 INFO:journalctl@ceph.osd.10.smithi172.stdout:Jul 14 18:31:52 smithi172 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-10[119489]: 2023-07-14T18:31:52.041+0000 7fe8a6017700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.163:6806 osd.0 since back 2023-07-14T18:30:44.219658+0000 front 2023-07-14T18:30:44.219740+0000 (oldest deadline 2023-07-14T18:31:05.919624+0000) 2023-07-14T18:31:52.511 INFO:journalctl@ceph.osd.10.smithi172.stdout:Jul 14 18:31:52 smithi172 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-10[119489]: 2023-07-14T18:31:52.041+0000 7fe8a6017700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2023-07-14T18:30:51.022066+0000 front 2023-07-14T18:30:51.022166+0000 (oldest deadline 2023-07-14T18:31:13.922245+0000) 2023-07-14T18:31:52.511 INFO:journalctl@ceph.osd.10.smithi172.stdout:Jul 14 18:31:52 smithi172 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-10[119489]: 2023-07-14T18:31:52.041+0000 7fe8a6017700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.184:6804 osd.2 since back 2023-07-14T18:30:59.723894+0000 front 2023-07-14T18:30:59.723980+0000 (oldest deadline 2023-07-14T18:31:21.424006+0000) 2023-07-14T18:31:52.512 INFO:journalctl@ceph.osd.10.smithi172.stdout:Jul 14 18:31:52 smithi172 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-10[119489]: 2023-07-14T18:31:52.041+0000 7fe8a6017700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.163:6814 osd.3 since back 2023-07-14T18:31:07.126091+0000 front 2023-07-14T18:31:07.126185+0000 (oldest deadline 2023-07-14T18:31:31.826180+0000) 2023-07-14T18:31:52.512 INFO:journalctl@ceph.osd.10.smithi172.stdout:Jul 14 18:31:52 smithi172 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-10[119489]: 2023-07-14T18:31:52.041+0000 7fe8a6017700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.172:6812 osd.4 since back 2023-07-14T18:31:11.826674+0000 front 2023-07-14T18:31:11.826695+0000 (oldest deadline 2023-07-14T18:31:37.726788+0000) 2023-07-14T18:31:52.512 INFO:journalctl@ceph.osd.10.smithi172.stdout:Jul 14 18:31:52 smithi172 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-10[119489]: 2023-07-14T18:31:52.041+0000 7fe8a6017700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.184:6812 osd.5 since back 2023-07-14T18:31:21.128328+0000 front 2023-07-14T18:31:21.128169+0000 (oldest deadline 2023-07-14T18:31:45.827990+0000) 2023-07-14T18:31:52.660 INFO:journalctl@ceph.osd.11.smithi184.stdout:Jul 14 18:31:52 smithi184 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-11[120819]: 2023-07-14T18:31:52.354+0000 7f44dbfe8700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.163:6806 osd.0 since back 2023-07-14T18:30:42.566533+0000 front 2023-07-14T18:30:42.566680+0000 (oldest deadline 2023-07-14T18:31:08.967162+0000) 2023-07-14T18:31:52.660 INFO:journalctl@ceph.osd.11.smithi184.stdout:Jul 14 18:31:52 smithi184 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-11[120819]: 2023-07-14T18:31:52.354+0000 7f44dbfe8700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2023-07-14T18:30:51.868462+0000 front 2023-07-14T18:30:51.868670+0000 (oldest deadline 2023-07-14T18:31:17.768517+0000) 2023-07-14T18:31:52.660 INFO:journalctl@ceph.osd.11.smithi184.stdout:Jul 14 18:31:52 smithi184 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-11[120819]: 2023-07-14T18:31:52.354+0000 7f44dbfe8700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.184:6804 osd.2 since back 2023-07-14T18:30:58.269297+0000 front 2023-07-14T18:30:58.269338+0000 (oldest deadline 2023-07-14T18:31:23.569431+0000) 2023-07-14T18:31:52.661 INFO:journalctl@ceph.osd.11.smithi184.stdout:Jul 14 18:31:52 smithi184 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-11[120819]: 2023-07-14T18:31:52.354+0000 7f44dbfe8700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.172:6812 osd.4 since back 2023-07-14T18:31:14.770869+0000 front 2023-07-14T18:31:14.770949+0000 (oldest deadline 2023-07-14T18:31:38.270981+0000) 2023-07-14T18:31:52.661 INFO:journalctl@ceph.osd.11.smithi184.stdout:Jul 14 18:31:52 smithi184 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-11[120819]: 2023-07-14T18:31:52.354+0000 7f44dbfe8700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.184:6812 osd.5 since back 2023-07-14T18:31:22.272344+0000 front 2023-07-14T18:31:22.272388+0000 (oldest deadline 2023-07-14T18:31:46.372402+0000) 2023-07-14T18:31:52.952 INFO:journalctl@ceph.osd.9.smithi163.stdout:Jul 14 18:31:52 smithi163 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-9[125814]: 2023-07-14T18:31:52.640+0000 7fd0759f3700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.163:6806 osd.0 since back 2023-07-14T18:30:42.661073+0000 front 2023-07-14T18:30:42.661052+0000 (oldest deadline 2023-07-14T18:31:07.961309+0000) 2023-07-14T18:31:52.953 INFO:journalctl@ceph.osd.9.smithi163.stdout:Jul 14 18:31:52 smithi163 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-9[125814]: 2023-07-14T18:31:52.640+0000 7fd0759f3700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2023-07-14T18:30:47.961848+0000 front 2023-07-14T18:30:47.961754+0000 (oldest deadline 2023-07-14T18:31:13.861824+0000) 2023-07-14T18:31:52.953 INFO:journalctl@ceph.osd.9.smithi163.stdout:Jul 14 18:31:52 smithi163 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-9[125814]: 2023-07-14T18:31:52.640+0000 7fd0759f3700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.184:6804 osd.2 since back 2023-07-14T18:30:59.763100+0000 front 2023-07-14T18:30:59.763261+0000 (oldest deadline 2023-07-14T18:31:25.662987+0000) 2023-07-14T18:31:52.953 INFO:journalctl@ceph.osd.9.smithi163.stdout:Jul 14 18:31:52 smithi163 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-9[125814]: 2023-07-14T18:31:52.640+0000 7fd0759f3700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.163:6814 osd.3 since back 2023-07-14T18:31:05.663336+0000 front 2023-07-14T18:31:05.663310+0000 (oldest deadline 2023-07-14T18:31:30.963470+0000) 2023-07-14T18:31:52.953 INFO:journalctl@ceph.osd.9.smithi163.stdout:Jul 14 18:31:52 smithi163 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-9[125814]: 2023-07-14T18:31:52.640+0000 7fd0759f3700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.172:6812 osd.4 since back 2023-07-14T18:31:10.963937+0000 front 2023-07-14T18:31:10.964038+0000 (oldest deadline 2023-07-14T18:31:38.564432+0000) 2023-07-14T18:31:52.953 INFO:journalctl@ceph.osd.9.smithi163.stdout:Jul 14 18:31:52 smithi163 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-9[125814]: 2023-07-14T18:31:52.640+0000 7fd0759f3700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.184:6812 osd.5 since back 2023-07-14T18:31:18.564935+0000 front 2023-07-14T18:31:18.565043+0000 (oldest deadline 2023-07-14T18:31:46.165387+0000) 2023-07-14T18:31:53.511 INFO:journalctl@ceph.osd.10.smithi172.stdout:Jul 14 18:31:53 smithi172 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-10[119489]: 2023-07-14T18:31:53.029+0000 7fe8a6017700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.163:6806 osd.0 since back 2023-07-14T18:30:44.219658+0000 front 2023-07-14T18:30:44.219740+0000 (oldest deadline 2023-07-14T18:31:05.919624+0000) 2023-07-14T18:31:53.511 INFO:journalctl@ceph.osd.10.smithi172.stdout:Jul 14 18:31:53 smithi172 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-10[119489]: 2023-07-14T18:31:53.029+0000 7fe8a6017700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2023-07-14T18:30:51.022066+0000 front 2023-07-14T18:30:51.022166+0000 (oldest deadline 2023-07-14T18:31:13.922245+0000) 2023-07-14T18:31:53.511 INFO:journalctl@ceph.osd.10.smithi172.stdout:Jul 14 18:31:53 smithi172 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-10[119489]: 2023-07-14T18:31:53.029+0000 7fe8a6017700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.184:6804 osd.2 since back 2023-07-14T18:30:59.723894+0000 front 2023-07-14T18:30:59.723980+0000 (oldest deadline 2023-07-14T18:31:21.424006+0000) 2023-07-14T18:31:53.511 INFO:journalctl@ceph.osd.10.smithi172.stdout:Jul 14 18:31:53 smithi172 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-10[119489]: 2023-07-14T18:31:53.029+0000 7fe8a6017700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.163:6814 osd.3 since back 2023-07-14T18:31:07.126091+0000 front 2023-07-14T18:31:07.126185+0000 (oldest deadline 2023-07-14T18:31:31.826180+0000) 2023-07-14T18:31:53.512 INFO:journalctl@ceph.osd.10.smithi172.stdout:Jul 14 18:31:53 smithi172 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-10[119489]: 2023-07-14T18:31:53.029+0000 7fe8a6017700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.172:6812 osd.4 since back 2023-07-14T18:31:11.826674+0000 front 2023-07-14T18:31:11.826695+0000 (oldest deadline 2023-07-14T18:31:37.726788+0000) 2023-07-14T18:31:53.512 INFO:journalctl@ceph.osd.10.smithi172.stdout:Jul 14 18:31:53 smithi172 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-10[119489]: 2023-07-14T18:31:53.029+0000 7fe8a6017700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.184:6812 osd.5 since back 2023-07-14T18:31:21.128328+0000 front 2023-07-14T18:31:21.128169+0000 (oldest deadline 2023-07-14T18:31:45.827990+0000) 2023-07-14T18:31:53.660 INFO:journalctl@ceph.osd.11.smithi184.stdout:Jul 14 18:31:53 smithi184 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-11[120819]: 2023-07-14T18:31:53.358+0000 7f44dbfe8700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.163:6806 osd.0 since back 2023-07-14T18:30:42.566533+0000 front 2023-07-14T18:30:42.566680+0000 (oldest deadline 2023-07-14T18:31:08.967162+0000) 2023-07-14T18:31:53.660 INFO:journalctl@ceph.osd.11.smithi184.stdout:Jul 14 18:31:53 smithi184 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-11[120819]: 2023-07-14T18:31:53.358+0000 7f44dbfe8700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2023-07-14T18:30:51.868462+0000 front 2023-07-14T18:30:51.868670+0000 (oldest deadline 2023-07-14T18:31:17.768517+0000) 2023-07-14T18:31:53.660 INFO:journalctl@ceph.osd.11.smithi184.stdout:Jul 14 18:31:53 smithi184 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-11[120819]: 2023-07-14T18:31:53.358+0000 7f44dbfe8700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.184:6804 osd.2 since back 2023-07-14T18:30:58.269297+0000 front 2023-07-14T18:30:58.269338+0000 (oldest deadline 2023-07-14T18:31:23.569431+0000) 2023-07-14T18:31:53.661 INFO:journalctl@ceph.osd.11.smithi184.stdout:Jul 14 18:31:53 smithi184 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-11[120819]: 2023-07-14T18:31:53.358+0000 7f44dbfe8700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.172:6812 osd.4 since back 2023-07-14T18:31:14.770869+0000 front 2023-07-14T18:31:14.770949+0000 (oldest deadline 2023-07-14T18:31:38.270981+0000) 2023-07-14T18:31:53.661 INFO:journalctl@ceph.osd.11.smithi184.stdout:Jul 14 18:31:53 smithi184 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-11[120819]: 2023-07-14T18:31:53.358+0000 7f44dbfe8700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.184:6812 osd.5 since back 2023-07-14T18:31:22.272344+0000 front 2023-07-14T18:31:22.272388+0000 (oldest deadline 2023-07-14T18:31:46.372402+0000) 2023-07-14T18:31:53.661 INFO:journalctl@ceph.osd.11.smithi184.stdout:Jul 14 18:31:53 smithi184 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-11[120819]: 2023-07-14T18:31:53.358+0000 7f44dbfe8700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.163:6822 osd.6 since back 2023-07-14T18:31:31.073622+0000 front 2023-07-14T18:31:31.073601+0000 (oldest deadline 2023-07-14T18:31:52.773428+0000) 2023-07-14T18:31:54.452 INFO:journalctl@ceph.osd.9.smithi163.stdout:Jul 14 18:31:54 smithi163 bash[174615]: ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-9 2023-07-14T18:31:54.510 INFO:journalctl@ceph.osd.10.smithi172.stdout:Jul 14 18:31:54 smithi172 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-10[119489]: 2023-07-14T18:31:54.056+0000 7fe8a6017700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.163:6806 osd.0 since back 2023-07-14T18:30:44.219658+0000 front 2023-07-14T18:30:44.219740+0000 (oldest deadline 2023-07-14T18:31:05.919624+0000) 2023-07-14T18:31:54.511 INFO:journalctl@ceph.osd.10.smithi172.stdout:Jul 14 18:31:54 smithi172 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-10[119489]: 2023-07-14T18:31:54.056+0000 7fe8a6017700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2023-07-14T18:30:51.022066+0000 front 2023-07-14T18:30:51.022166+0000 (oldest deadline 2023-07-14T18:31:13.922245+0000) 2023-07-14T18:31:54.511 INFO:journalctl@ceph.osd.10.smithi172.stdout:Jul 14 18:31:54 smithi172 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-10[119489]: 2023-07-14T18:31:54.056+0000 7fe8a6017700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.184:6804 osd.2 since back 2023-07-14T18:30:59.723894+0000 front 2023-07-14T18:30:59.723980+0000 (oldest deadline 2023-07-14T18:31:21.424006+0000) 2023-07-14T18:31:54.511 INFO:journalctl@ceph.osd.10.smithi172.stdout:Jul 14 18:31:54 smithi172 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-10[119489]: 2023-07-14T18:31:54.056+0000 7fe8a6017700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.163:6814 osd.3 since back 2023-07-14T18:31:07.126091+0000 front 2023-07-14T18:31:07.126185+0000 (oldest deadline 2023-07-14T18:31:31.826180+0000) 2023-07-14T18:31:54.512 INFO:journalctl@ceph.osd.10.smithi172.stdout:Jul 14 18:31:54 smithi172 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-10[119489]: 2023-07-14T18:31:54.056+0000 7fe8a6017700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.172:6812 osd.4 since back 2023-07-14T18:31:11.826674+0000 front 2023-07-14T18:31:11.826695+0000 (oldest deadline 2023-07-14T18:31:37.726788+0000) 2023-07-14T18:31:54.512 INFO:journalctl@ceph.osd.10.smithi172.stdout:Jul 14 18:31:54 smithi172 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-10[119489]: 2023-07-14T18:31:54.056+0000 7fe8a6017700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.184:6812 osd.5 since back 2023-07-14T18:31:21.128328+0000 front 2023-07-14T18:31:21.128169+0000 (oldest deadline 2023-07-14T18:31:45.827990+0000) 2023-07-14T18:31:54.512 INFO:journalctl@ceph.osd.10.smithi172.stdout:Jul 14 18:31:54 smithi172 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-10[119489]: 2023-07-14T18:31:54.056+0000 7fe8a6017700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.163:6822 osd.6 since back 2023-07-14T18:31:30.429581+0000 front 2023-07-14T18:31:30.429602+0000 (oldest deadline 2023-07-14T18:31:53.929561+0000) 2023-07-14T18:31:54.659 INFO:journalctl@ceph.osd.11.smithi184.stdout:Jul 14 18:31:54 smithi184 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-11[120819]: 2023-07-14T18:31:54.335+0000 7f44dbfe8700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.163:6806 osd.0 since back 2023-07-14T18:30:42.566533+0000 front 2023-07-14T18:30:42.566680+0000 (oldest deadline 2023-07-14T18:31:08.967162+0000) 2023-07-14T18:31:54.660 INFO:journalctl@ceph.osd.11.smithi184.stdout:Jul 14 18:31:54 smithi184 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-11[120819]: 2023-07-14T18:31:54.335+0000 7f44dbfe8700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2023-07-14T18:30:51.868462+0000 front 2023-07-14T18:30:51.868670+0000 (oldest deadline 2023-07-14T18:31:17.768517+0000) 2023-07-14T18:31:54.660 INFO:journalctl@ceph.osd.11.smithi184.stdout:Jul 14 18:31:54 smithi184 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-11[120819]: 2023-07-14T18:31:54.335+0000 7f44dbfe8700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.184:6804 osd.2 since back 2023-07-14T18:30:58.269297+0000 front 2023-07-14T18:30:58.269338+0000 (oldest deadline 2023-07-14T18:31:23.569431+0000) 2023-07-14T18:31:54.660 INFO:journalctl@ceph.osd.11.smithi184.stdout:Jul 14 18:31:54 smithi184 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-11[120819]: 2023-07-14T18:31:54.335+0000 7f44dbfe8700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.172:6812 osd.4 since back 2023-07-14T18:31:14.770869+0000 front 2023-07-14T18:31:14.770949+0000 (oldest deadline 2023-07-14T18:31:38.270981+0000) 2023-07-14T18:31:54.661 INFO:journalctl@ceph.osd.11.smithi184.stdout:Jul 14 18:31:54 smithi184 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-11[120819]: 2023-07-14T18:31:54.335+0000 7f44dbfe8700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.184:6812 osd.5 since back 2023-07-14T18:31:22.272344+0000 front 2023-07-14T18:31:22.272388+0000 (oldest deadline 2023-07-14T18:31:46.372402+0000) 2023-07-14T18:31:54.661 INFO:journalctl@ceph.osd.11.smithi184.stdout:Jul 14 18:31:54 smithi184 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-11[120819]: 2023-07-14T18:31:54.335+0000 7f44dbfe8700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.163:6822 osd.6 since back 2023-07-14T18:31:31.073622+0000 front 2023-07-14T18:31:31.073601+0000 (oldest deadline 2023-07-14T18:31:52.773428+0000) 2023-07-14T18:31:55.510 INFO:journalctl@ceph.osd.10.smithi172.stdout:Jul 14 18:31:55 smithi172 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-10[119489]: 2023-07-14T18:31:55.069+0000 7fe8a6017700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.163:6806 osd.0 since back 2023-07-14T18:30:44.219658+0000 front 2023-07-14T18:30:44.219740+0000 (oldest deadline 2023-07-14T18:31:05.919624+0000) 2023-07-14T18:31:55.511 INFO:journalctl@ceph.osd.10.smithi172.stdout:Jul 14 18:31:55 smithi172 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-10[119489]: 2023-07-14T18:31:55.069+0000 7fe8a6017700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2023-07-14T18:30:51.022066+0000 front 2023-07-14T18:30:51.022166+0000 (oldest deadline 2023-07-14T18:31:13.922245+0000) 2023-07-14T18:31:55.511 INFO:journalctl@ceph.osd.10.smithi172.stdout:Jul 14 18:31:55 smithi172 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-10[119489]: 2023-07-14T18:31:55.069+0000 7fe8a6017700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.184:6804 osd.2 since back 2023-07-14T18:30:59.723894+0000 front 2023-07-14T18:30:59.723980+0000 (oldest deadline 2023-07-14T18:31:21.424006+0000) 2023-07-14T18:31:55.511 INFO:journalctl@ceph.osd.10.smithi172.stdout:Jul 14 18:31:55 smithi172 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-10[119489]: 2023-07-14T18:31:55.069+0000 7fe8a6017700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.163:6814 osd.3 since back 2023-07-14T18:31:07.126091+0000 front 2023-07-14T18:31:07.126185+0000 (oldest deadline 2023-07-14T18:31:31.826180+0000) 2023-07-14T18:31:55.511 INFO:journalctl@ceph.osd.10.smithi172.stdout:Jul 14 18:31:55 smithi172 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-10[119489]: 2023-07-14T18:31:55.069+0000 7fe8a6017700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.172:6812 osd.4 since back 2023-07-14T18:31:11.826674+0000 front 2023-07-14T18:31:11.826695+0000 (oldest deadline 2023-07-14T18:31:37.726788+0000) 2023-07-14T18:31:55.512 INFO:journalctl@ceph.osd.10.smithi172.stdout:Jul 14 18:31:55 smithi172 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-10[119489]: 2023-07-14T18:31:55.069+0000 7fe8a6017700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.184:6812 osd.5 since back 2023-07-14T18:31:21.128328+0000 front 2023-07-14T18:31:21.128169+0000 (oldest deadline 2023-07-14T18:31:45.827990+0000) 2023-07-14T18:31:55.512 INFO:journalctl@ceph.osd.10.smithi172.stdout:Jul 14 18:31:55 smithi172 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-10[119489]: 2023-07-14T18:31:55.069+0000 7fe8a6017700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.163:6822 osd.6 since back 2023-07-14T18:31:30.429581+0000 front 2023-07-14T18:31:30.429602+0000 (oldest deadline 2023-07-14T18:31:53.929561+0000) 2023-07-14T18:31:55.608 DEBUG:teuthology.orchestra.run.smithi163:> sudo pkill -f 'journalctl -f -n 0 -u ceph-bf7326ec-2270-11ee-9b33-001a4aab830c@osd.9.service' 2023-07-14T18:31:55.649 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-07-14T18:31:55.650 INFO:tasks.cephadm.osd.9:Stopped osd.9 2023-07-14T18:31:55.650 INFO:tasks.cephadm.osd.10:Stopping osd.10... 2023-07-14T18:31:55.651 DEBUG:teuthology.orchestra.run.smithi172:> sudo systemctl stop ceph-bf7326ec-2270-11ee-9b33-001a4aab830c@osd.10 2023-07-14T18:31:55.659 INFO:journalctl@ceph.osd.11.smithi184.stdout:Jul 14 18:31:55 smithi184 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-11[120819]: 2023-07-14T18:31:55.303+0000 7f44dbfe8700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.163:6806 osd.0 since back 2023-07-14T18:30:42.566533+0000 front 2023-07-14T18:30:42.566680+0000 (oldest deadline 2023-07-14T18:31:08.967162+0000) 2023-07-14T18:31:55.660 INFO:journalctl@ceph.osd.11.smithi184.stdout:Jul 14 18:31:55 smithi184 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-11[120819]: 2023-07-14T18:31:55.303+0000 7f44dbfe8700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2023-07-14T18:30:51.868462+0000 front 2023-07-14T18:30:51.868670+0000 (oldest deadline 2023-07-14T18:31:17.768517+0000) 2023-07-14T18:31:55.660 INFO:journalctl@ceph.osd.11.smithi184.stdout:Jul 14 18:31:55 smithi184 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-11[120819]: 2023-07-14T18:31:55.303+0000 7f44dbfe8700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.184:6804 osd.2 since back 2023-07-14T18:30:58.269297+0000 front 2023-07-14T18:30:58.269338+0000 (oldest deadline 2023-07-14T18:31:23.569431+0000) 2023-07-14T18:31:55.660 INFO:journalctl@ceph.osd.11.smithi184.stdout:Jul 14 18:31:55 smithi184 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-11[120819]: 2023-07-14T18:31:55.303+0000 7f44dbfe8700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.172:6812 osd.4 since back 2023-07-14T18:31:14.770869+0000 front 2023-07-14T18:31:14.770949+0000 (oldest deadline 2023-07-14T18:31:38.270981+0000) 2023-07-14T18:31:55.661 INFO:journalctl@ceph.osd.11.smithi184.stdout:Jul 14 18:31:55 smithi184 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-11[120819]: 2023-07-14T18:31:55.303+0000 7f44dbfe8700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.184:6812 osd.5 since back 2023-07-14T18:31:22.272344+0000 front 2023-07-14T18:31:22.272388+0000 (oldest deadline 2023-07-14T18:31:46.372402+0000) 2023-07-14T18:31:55.661 INFO:journalctl@ceph.osd.11.smithi184.stdout:Jul 14 18:31:55 smithi184 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-11[120819]: 2023-07-14T18:31:55.303+0000 7f44dbfe8700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.163:6822 osd.6 since back 2023-07-14T18:31:31.073622+0000 front 2023-07-14T18:31:31.073601+0000 (oldest deadline 2023-07-14T18:31:52.773428+0000) 2023-07-14T18:31:56.005 INFO:journalctl@ceph.osd.10.smithi172.stdout:Jul 14 18:31:55 smithi172 systemd[1]: Stopping Ceph osd.10 for bf7326ec-2270-11ee-9b33-001a4aab830c... 2023-07-14T18:31:56.260 INFO:journalctl@ceph.osd.10.smithi172.stdout:Jul 14 18:31:55 smithi172 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-10[119489]: 2023-07-14T18:31:55.979+0000 7fe8aaa22700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-osd -n osd.10 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-07-14T18:31:56.261 INFO:journalctl@ceph.osd.10.smithi172.stdout:Jul 14 18:31:55 smithi172 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-10[119489]: 2023-07-14T18:31:55.979+0000 7fe8aaa22700 -1 osd.10 88 *** Got signal Terminated *** 2023-07-14T18:31:56.261 INFO:journalctl@ceph.osd.10.smithi172.stdout:Jul 14 18:31:55 smithi172 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-10[119489]: 2023-07-14T18:31:55.979+0000 7fe8aaa22700 -1 osd.10 88 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-07-14T18:31:56.261 INFO:journalctl@ceph.osd.10.smithi172.stdout:Jul 14 18:31:56 smithi172 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-10[119489]: 2023-07-14T18:31:56.089+0000 7fe8a6017700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.163:6806 osd.0 since back 2023-07-14T18:30:44.219658+0000 front 2023-07-14T18:30:44.219740+0000 (oldest deadline 2023-07-14T18:31:05.919624+0000) 2023-07-14T18:31:56.261 INFO:journalctl@ceph.osd.10.smithi172.stdout:Jul 14 18:31:56 smithi172 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-10[119489]: 2023-07-14T18:31:56.089+0000 7fe8a6017700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2023-07-14T18:30:51.022066+0000 front 2023-07-14T18:30:51.022166+0000 (oldest deadline 2023-07-14T18:31:13.922245+0000) 2023-07-14T18:31:56.262 INFO:journalctl@ceph.osd.10.smithi172.stdout:Jul 14 18:31:56 smithi172 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-10[119489]: 2023-07-14T18:31:56.089+0000 7fe8a6017700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.184:6804 osd.2 since back 2023-07-14T18:30:59.723894+0000 front 2023-07-14T18:30:59.723980+0000 (oldest deadline 2023-07-14T18:31:21.424006+0000) 2023-07-14T18:31:56.262 INFO:journalctl@ceph.osd.10.smithi172.stdout:Jul 14 18:31:56 smithi172 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-10[119489]: 2023-07-14T18:31:56.089+0000 7fe8a6017700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.163:6814 osd.3 since back 2023-07-14T18:31:07.126091+0000 front 2023-07-14T18:31:07.126185+0000 (oldest deadline 2023-07-14T18:31:31.826180+0000) 2023-07-14T18:31:56.262 INFO:journalctl@ceph.osd.10.smithi172.stdout:Jul 14 18:31:56 smithi172 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-10[119489]: 2023-07-14T18:31:56.089+0000 7fe8a6017700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.172:6812 osd.4 since back 2023-07-14T18:31:11.826674+0000 front 2023-07-14T18:31:11.826695+0000 (oldest deadline 2023-07-14T18:31:37.726788+0000) 2023-07-14T18:31:56.262 INFO:journalctl@ceph.osd.10.smithi172.stdout:Jul 14 18:31:56 smithi172 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-10[119489]: 2023-07-14T18:31:56.089+0000 7fe8a6017700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.184:6812 osd.5 since back 2023-07-14T18:31:21.128328+0000 front 2023-07-14T18:31:21.128169+0000 (oldest deadline 2023-07-14T18:31:45.827990+0000) 2023-07-14T18:31:56.262 INFO:journalctl@ceph.osd.10.smithi172.stdout:Jul 14 18:31:56 smithi172 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-10[119489]: 2023-07-14T18:31:56.089+0000 7fe8a6017700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.163:6822 osd.6 since back 2023-07-14T18:31:30.429581+0000 front 2023-07-14T18:31:30.429602+0000 (oldest deadline 2023-07-14T18:31:53.929561+0000) 2023-07-14T18:31:56.659 INFO:journalctl@ceph.osd.11.smithi184.stdout:Jul 14 18:31:56 smithi184 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-11[120819]: 2023-07-14T18:31:56.317+0000 7f44dbfe8700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.163:6806 osd.0 since back 2023-07-14T18:30:42.566533+0000 front 2023-07-14T18:30:42.566680+0000 (oldest deadline 2023-07-14T18:31:08.967162+0000) 2023-07-14T18:31:56.660 INFO:journalctl@ceph.osd.11.smithi184.stdout:Jul 14 18:31:56 smithi184 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-11[120819]: 2023-07-14T18:31:56.317+0000 7f44dbfe8700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2023-07-14T18:30:51.868462+0000 front 2023-07-14T18:30:51.868670+0000 (oldest deadline 2023-07-14T18:31:17.768517+0000) 2023-07-14T18:31:56.660 INFO:journalctl@ceph.osd.11.smithi184.stdout:Jul 14 18:31:56 smithi184 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-11[120819]: 2023-07-14T18:31:56.317+0000 7f44dbfe8700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.184:6804 osd.2 since back 2023-07-14T18:30:58.269297+0000 front 2023-07-14T18:30:58.269338+0000 (oldest deadline 2023-07-14T18:31:23.569431+0000) 2023-07-14T18:31:56.660 INFO:journalctl@ceph.osd.11.smithi184.stdout:Jul 14 18:31:56 smithi184 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-11[120819]: 2023-07-14T18:31:56.317+0000 7f44dbfe8700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.172:6812 osd.4 since back 2023-07-14T18:31:14.770869+0000 front 2023-07-14T18:31:14.770949+0000 (oldest deadline 2023-07-14T18:31:38.270981+0000) 2023-07-14T18:31:56.661 INFO:journalctl@ceph.osd.11.smithi184.stdout:Jul 14 18:31:56 smithi184 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-11[120819]: 2023-07-14T18:31:56.317+0000 7f44dbfe8700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.184:6812 osd.5 since back 2023-07-14T18:31:22.272344+0000 front 2023-07-14T18:31:22.272388+0000 (oldest deadline 2023-07-14T18:31:46.372402+0000) 2023-07-14T18:31:56.661 INFO:journalctl@ceph.osd.11.smithi184.stdout:Jul 14 18:31:56 smithi184 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-11[120819]: 2023-07-14T18:31:56.317+0000 7f44dbfe8700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.163:6822 osd.6 since back 2023-07-14T18:31:31.073622+0000 front 2023-07-14T18:31:31.073601+0000 (oldest deadline 2023-07-14T18:31:52.773428+0000) 2023-07-14T18:31:57.510 INFO:journalctl@ceph.osd.10.smithi172.stdout:Jul 14 18:31:57 smithi172 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-10[119489]: 2023-07-14T18:31:57.112+0000 7fe8a6017700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.163:6806 osd.0 since back 2023-07-14T18:30:44.219658+0000 front 2023-07-14T18:30:44.219740+0000 (oldest deadline 2023-07-14T18:31:05.919624+0000) 2023-07-14T18:31:57.511 INFO:journalctl@ceph.osd.10.smithi172.stdout:Jul 14 18:31:57 smithi172 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-10[119489]: 2023-07-14T18:31:57.112+0000 7fe8a6017700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2023-07-14T18:30:51.022066+0000 front 2023-07-14T18:30:51.022166+0000 (oldest deadline 2023-07-14T18:31:13.922245+0000) 2023-07-14T18:31:57.511 INFO:journalctl@ceph.osd.10.smithi172.stdout:Jul 14 18:31:57 smithi172 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-10[119489]: 2023-07-14T18:31:57.112+0000 7fe8a6017700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.184:6804 osd.2 since back 2023-07-14T18:30:59.723894+0000 front 2023-07-14T18:30:59.723980+0000 (oldest deadline 2023-07-14T18:31:21.424006+0000) 2023-07-14T18:31:57.512 INFO:journalctl@ceph.osd.10.smithi172.stdout:Jul 14 18:31:57 smithi172 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-10[119489]: 2023-07-14T18:31:57.112+0000 7fe8a6017700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.163:6814 osd.3 since back 2023-07-14T18:31:07.126091+0000 front 2023-07-14T18:31:07.126185+0000 (oldest deadline 2023-07-14T18:31:31.826180+0000) 2023-07-14T18:31:57.512 INFO:journalctl@ceph.osd.10.smithi172.stdout:Jul 14 18:31:57 smithi172 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-10[119489]: 2023-07-14T18:31:57.112+0000 7fe8a6017700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.172:6812 osd.4 since back 2023-07-14T18:31:11.826674+0000 front 2023-07-14T18:31:11.826695+0000 (oldest deadline 2023-07-14T18:31:37.726788+0000) 2023-07-14T18:31:57.513 INFO:journalctl@ceph.osd.10.smithi172.stdout:Jul 14 18:31:57 smithi172 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-10[119489]: 2023-07-14T18:31:57.112+0000 7fe8a6017700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.184:6812 osd.5 since back 2023-07-14T18:31:21.128328+0000 front 2023-07-14T18:31:21.128169+0000 (oldest deadline 2023-07-14T18:31:45.827990+0000) 2023-07-14T18:31:57.513 INFO:journalctl@ceph.osd.10.smithi172.stdout:Jul 14 18:31:57 smithi172 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-10[119489]: 2023-07-14T18:31:57.112+0000 7fe8a6017700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.163:6822 osd.6 since back 2023-07-14T18:31:30.429581+0000 front 2023-07-14T18:31:30.429602+0000 (oldest deadline 2023-07-14T18:31:53.929561+0000) 2023-07-14T18:31:57.659 INFO:journalctl@ceph.osd.11.smithi184.stdout:Jul 14 18:31:57 smithi184 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-11[120819]: 2023-07-14T18:31:57.269+0000 7f44dbfe8700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.163:6806 osd.0 since back 2023-07-14T18:30:42.566533+0000 front 2023-07-14T18:30:42.566680+0000 (oldest deadline 2023-07-14T18:31:08.967162+0000) 2023-07-14T18:31:57.660 INFO:journalctl@ceph.osd.11.smithi184.stdout:Jul 14 18:31:57 smithi184 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-11[120819]: 2023-07-14T18:31:57.269+0000 7f44dbfe8700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2023-07-14T18:30:51.868462+0000 front 2023-07-14T18:30:51.868670+0000 (oldest deadline 2023-07-14T18:31:17.768517+0000) 2023-07-14T18:31:57.661 INFO:journalctl@ceph.osd.11.smithi184.stdout:Jul 14 18:31:57 smithi184 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-11[120819]: 2023-07-14T18:31:57.269+0000 7f44dbfe8700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.184:6804 osd.2 since back 2023-07-14T18:30:58.269297+0000 front 2023-07-14T18:30:58.269338+0000 (oldest deadline 2023-07-14T18:31:23.569431+0000) 2023-07-14T18:31:57.661 INFO:journalctl@ceph.osd.11.smithi184.stdout:Jul 14 18:31:57 smithi184 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-11[120819]: 2023-07-14T18:31:57.269+0000 7f44dbfe8700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.172:6812 osd.4 since back 2023-07-14T18:31:14.770869+0000 front 2023-07-14T18:31:14.770949+0000 (oldest deadline 2023-07-14T18:31:38.270981+0000) 2023-07-14T18:31:57.661 INFO:journalctl@ceph.osd.11.smithi184.stdout:Jul 14 18:31:57 smithi184 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-11[120819]: 2023-07-14T18:31:57.269+0000 7f44dbfe8700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.184:6812 osd.5 since back 2023-07-14T18:31:22.272344+0000 front 2023-07-14T18:31:22.272388+0000 (oldest deadline 2023-07-14T18:31:46.372402+0000) 2023-07-14T18:31:57.661 INFO:journalctl@ceph.osd.11.smithi184.stdout:Jul 14 18:31:57 smithi184 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-11[120819]: 2023-07-14T18:31:57.269+0000 7f44dbfe8700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.163:6822 osd.6 since back 2023-07-14T18:31:31.073622+0000 front 2023-07-14T18:31:31.073601+0000 (oldest deadline 2023-07-14T18:31:52.773428+0000) 2023-07-14T18:31:58.510 INFO:journalctl@ceph.osd.10.smithi172.stdout:Jul 14 18:31:58 smithi172 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-10[119489]: 2023-07-14T18:31:58.145+0000 7fe8a6017700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.163:6806 osd.0 since back 2023-07-14T18:30:44.219658+0000 front 2023-07-14T18:30:44.219740+0000 (oldest deadline 2023-07-14T18:31:05.919624+0000) 2023-07-14T18:31:58.511 INFO:journalctl@ceph.osd.10.smithi172.stdout:Jul 14 18:31:58 smithi172 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-10[119489]: 2023-07-14T18:31:58.145+0000 7fe8a6017700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2023-07-14T18:30:51.022066+0000 front 2023-07-14T18:30:51.022166+0000 (oldest deadline 2023-07-14T18:31:13.922245+0000) 2023-07-14T18:31:58.511 INFO:journalctl@ceph.osd.10.smithi172.stdout:Jul 14 18:31:58 smithi172 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-10[119489]: 2023-07-14T18:31:58.145+0000 7fe8a6017700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.184:6804 osd.2 since back 2023-07-14T18:30:59.723894+0000 front 2023-07-14T18:30:59.723980+0000 (oldest deadline 2023-07-14T18:31:21.424006+0000) 2023-07-14T18:31:58.511 INFO:journalctl@ceph.osd.10.smithi172.stdout:Jul 14 18:31:58 smithi172 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-10[119489]: 2023-07-14T18:31:58.145+0000 7fe8a6017700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.163:6814 osd.3 since back 2023-07-14T18:31:07.126091+0000 front 2023-07-14T18:31:07.126185+0000 (oldest deadline 2023-07-14T18:31:31.826180+0000) 2023-07-14T18:31:58.512 INFO:journalctl@ceph.osd.10.smithi172.stdout:Jul 14 18:31:58 smithi172 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-10[119489]: 2023-07-14T18:31:58.145+0000 7fe8a6017700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.172:6812 osd.4 since back 2023-07-14T18:31:11.826674+0000 front 2023-07-14T18:31:11.826695+0000 (oldest deadline 2023-07-14T18:31:37.726788+0000) 2023-07-14T18:31:58.512 INFO:journalctl@ceph.osd.10.smithi172.stdout:Jul 14 18:31:58 smithi172 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-10[119489]: 2023-07-14T18:31:58.145+0000 7fe8a6017700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.184:6812 osd.5 since back 2023-07-14T18:31:21.128328+0000 front 2023-07-14T18:31:21.128169+0000 (oldest deadline 2023-07-14T18:31:45.827990+0000) 2023-07-14T18:31:58.512 INFO:journalctl@ceph.osd.10.smithi172.stdout:Jul 14 18:31:58 smithi172 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-10[119489]: 2023-07-14T18:31:58.145+0000 7fe8a6017700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.163:6822 osd.6 since back 2023-07-14T18:31:30.429581+0000 front 2023-07-14T18:31:30.429602+0000 (oldest deadline 2023-07-14T18:31:53.929561+0000) 2023-07-14T18:31:58.660 INFO:journalctl@ceph.osd.11.smithi184.stdout:Jul 14 18:31:58 smithi184 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-11[120819]: 2023-07-14T18:31:58.236+0000 7f44dbfe8700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.163:6806 osd.0 since back 2023-07-14T18:30:42.566533+0000 front 2023-07-14T18:30:42.566680+0000 (oldest deadline 2023-07-14T18:31:08.967162+0000) 2023-07-14T18:31:58.660 INFO:journalctl@ceph.osd.11.smithi184.stdout:Jul 14 18:31:58 smithi184 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-11[120819]: 2023-07-14T18:31:58.236+0000 7f44dbfe8700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2023-07-14T18:30:51.868462+0000 front 2023-07-14T18:30:51.868670+0000 (oldest deadline 2023-07-14T18:31:17.768517+0000) 2023-07-14T18:31:58.660 INFO:journalctl@ceph.osd.11.smithi184.stdout:Jul 14 18:31:58 smithi184 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-11[120819]: 2023-07-14T18:31:58.236+0000 7f44dbfe8700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.184:6804 osd.2 since back 2023-07-14T18:30:58.269297+0000 front 2023-07-14T18:30:58.269338+0000 (oldest deadline 2023-07-14T18:31:23.569431+0000) 2023-07-14T18:31:58.661 INFO:journalctl@ceph.osd.11.smithi184.stdout:Jul 14 18:31:58 smithi184 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-11[120819]: 2023-07-14T18:31:58.236+0000 7f44dbfe8700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.172:6812 osd.4 since back 2023-07-14T18:31:14.770869+0000 front 2023-07-14T18:31:14.770949+0000 (oldest deadline 2023-07-14T18:31:38.270981+0000) 2023-07-14T18:31:58.661 INFO:journalctl@ceph.osd.11.smithi184.stdout:Jul 14 18:31:58 smithi184 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-11[120819]: 2023-07-14T18:31:58.236+0000 7f44dbfe8700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.184:6812 osd.5 since back 2023-07-14T18:31:22.272344+0000 front 2023-07-14T18:31:22.272388+0000 (oldest deadline 2023-07-14T18:31:46.372402+0000) 2023-07-14T18:31:58.661 INFO:journalctl@ceph.osd.11.smithi184.stdout:Jul 14 18:31:58 smithi184 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-11[120819]: 2023-07-14T18:31:58.236+0000 7f44dbfe8700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.163:6822 osd.6 since back 2023-07-14T18:31:31.073622+0000 front 2023-07-14T18:31:31.073601+0000 (oldest deadline 2023-07-14T18:31:52.773428+0000) 2023-07-14T18:31:59.510 INFO:journalctl@ceph.osd.10.smithi172.stdout:Jul 14 18:31:59 smithi172 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-10[119489]: 2023-07-14T18:31:59.125+0000 7fe8a6017700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.163:6806 osd.0 since back 2023-07-14T18:30:44.219658+0000 front 2023-07-14T18:30:44.219740+0000 (oldest deadline 2023-07-14T18:31:05.919624+0000) 2023-07-14T18:31:59.511 INFO:journalctl@ceph.osd.10.smithi172.stdout:Jul 14 18:31:59 smithi172 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-10[119489]: 2023-07-14T18:31:59.125+0000 7fe8a6017700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2023-07-14T18:30:51.022066+0000 front 2023-07-14T18:30:51.022166+0000 (oldest deadline 2023-07-14T18:31:13.922245+0000) 2023-07-14T18:31:59.511 INFO:journalctl@ceph.osd.10.smithi172.stdout:Jul 14 18:31:59 smithi172 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-10[119489]: 2023-07-14T18:31:59.125+0000 7fe8a6017700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.184:6804 osd.2 since back 2023-07-14T18:30:59.723894+0000 front 2023-07-14T18:30:59.723980+0000 (oldest deadline 2023-07-14T18:31:21.424006+0000) 2023-07-14T18:31:59.512 INFO:journalctl@ceph.osd.10.smithi172.stdout:Jul 14 18:31:59 smithi172 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-10[119489]: 2023-07-14T18:31:59.125+0000 7fe8a6017700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.163:6814 osd.3 since back 2023-07-14T18:31:07.126091+0000 front 2023-07-14T18:31:07.126185+0000 (oldest deadline 2023-07-14T18:31:31.826180+0000) 2023-07-14T18:31:59.512 INFO:journalctl@ceph.osd.10.smithi172.stdout:Jul 14 18:31:59 smithi172 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-10[119489]: 2023-07-14T18:31:59.125+0000 7fe8a6017700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.172:6812 osd.4 since back 2023-07-14T18:31:11.826674+0000 front 2023-07-14T18:31:11.826695+0000 (oldest deadline 2023-07-14T18:31:37.726788+0000) 2023-07-14T18:31:59.512 INFO:journalctl@ceph.osd.10.smithi172.stdout:Jul 14 18:31:59 smithi172 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-10[119489]: 2023-07-14T18:31:59.125+0000 7fe8a6017700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.184:6812 osd.5 since back 2023-07-14T18:31:21.128328+0000 front 2023-07-14T18:31:21.128169+0000 (oldest deadline 2023-07-14T18:31:45.827990+0000) 2023-07-14T18:31:59.512 INFO:journalctl@ceph.osd.10.smithi172.stdout:Jul 14 18:31:59 smithi172 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-10[119489]: 2023-07-14T18:31:59.125+0000 7fe8a6017700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.163:6822 osd.6 since back 2023-07-14T18:31:30.429581+0000 front 2023-07-14T18:31:30.429602+0000 (oldest deadline 2023-07-14T18:31:53.929561+0000) 2023-07-14T18:31:59.660 INFO:journalctl@ceph.osd.11.smithi184.stdout:Jul 14 18:31:59 smithi184 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-11[120819]: 2023-07-14T18:31:59.222+0000 7f44dbfe8700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.163:6806 osd.0 since back 2023-07-14T18:30:42.566533+0000 front 2023-07-14T18:30:42.566680+0000 (oldest deadline 2023-07-14T18:31:08.967162+0000) 2023-07-14T18:31:59.660 INFO:journalctl@ceph.osd.11.smithi184.stdout:Jul 14 18:31:59 smithi184 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-11[120819]: 2023-07-14T18:31:59.222+0000 7f44dbfe8700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2023-07-14T18:30:51.868462+0000 front 2023-07-14T18:30:51.868670+0000 (oldest deadline 2023-07-14T18:31:17.768517+0000) 2023-07-14T18:31:59.661 INFO:journalctl@ceph.osd.11.smithi184.stdout:Jul 14 18:31:59 smithi184 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-11[120819]: 2023-07-14T18:31:59.222+0000 7f44dbfe8700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.184:6804 osd.2 since back 2023-07-14T18:30:58.269297+0000 front 2023-07-14T18:30:58.269338+0000 (oldest deadline 2023-07-14T18:31:23.569431+0000) 2023-07-14T18:31:59.661 INFO:journalctl@ceph.osd.11.smithi184.stdout:Jul 14 18:31:59 smithi184 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-11[120819]: 2023-07-14T18:31:59.222+0000 7f44dbfe8700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.172:6812 osd.4 since back 2023-07-14T18:31:14.770869+0000 front 2023-07-14T18:31:14.770949+0000 (oldest deadline 2023-07-14T18:31:38.270981+0000) 2023-07-14T18:31:59.661 INFO:journalctl@ceph.osd.11.smithi184.stdout:Jul 14 18:31:59 smithi184 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-11[120819]: 2023-07-14T18:31:59.222+0000 7f44dbfe8700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.184:6812 osd.5 since back 2023-07-14T18:31:22.272344+0000 front 2023-07-14T18:31:22.272388+0000 (oldest deadline 2023-07-14T18:31:46.372402+0000) 2023-07-14T18:31:59.661 INFO:journalctl@ceph.osd.11.smithi184.stdout:Jul 14 18:31:59 smithi184 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-11[120819]: 2023-07-14T18:31:59.222+0000 7f44dbfe8700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.163:6822 osd.6 since back 2023-07-14T18:31:31.073622+0000 front 2023-07-14T18:31:31.073601+0000 (oldest deadline 2023-07-14T18:31:52.773428+0000) 2023-07-14T18:32:00.510 INFO:journalctl@ceph.osd.10.smithi172.stdout:Jul 14 18:32:00 smithi172 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-10[119489]: 2023-07-14T18:32:00.081+0000 7fe8a6017700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.163:6806 osd.0 since back 2023-07-14T18:30:44.219658+0000 front 2023-07-14T18:30:44.219740+0000 (oldest deadline 2023-07-14T18:31:05.919624+0000) 2023-07-14T18:32:00.511 INFO:journalctl@ceph.osd.10.smithi172.stdout:Jul 14 18:32:00 smithi172 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-10[119489]: 2023-07-14T18:32:00.081+0000 7fe8a6017700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2023-07-14T18:30:51.022066+0000 front 2023-07-14T18:30:51.022166+0000 (oldest deadline 2023-07-14T18:31:13.922245+0000) 2023-07-14T18:32:00.511 INFO:journalctl@ceph.osd.10.smithi172.stdout:Jul 14 18:32:00 smithi172 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-10[119489]: 2023-07-14T18:32:00.081+0000 7fe8a6017700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.184:6804 osd.2 since back 2023-07-14T18:30:59.723894+0000 front 2023-07-14T18:30:59.723980+0000 (oldest deadline 2023-07-14T18:31:21.424006+0000) 2023-07-14T18:32:00.511 INFO:journalctl@ceph.osd.10.smithi172.stdout:Jul 14 18:32:00 smithi172 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-10[119489]: 2023-07-14T18:32:00.081+0000 7fe8a6017700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.163:6814 osd.3 since back 2023-07-14T18:31:07.126091+0000 front 2023-07-14T18:31:07.126185+0000 (oldest deadline 2023-07-14T18:31:31.826180+0000) 2023-07-14T18:32:00.511 INFO:journalctl@ceph.osd.10.smithi172.stdout:Jul 14 18:32:00 smithi172 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-10[119489]: 2023-07-14T18:32:00.081+0000 7fe8a6017700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.172:6812 osd.4 since back 2023-07-14T18:31:11.826674+0000 front 2023-07-14T18:31:11.826695+0000 (oldest deadline 2023-07-14T18:31:37.726788+0000) 2023-07-14T18:32:00.512 INFO:journalctl@ceph.osd.10.smithi172.stdout:Jul 14 18:32:00 smithi172 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-10[119489]: 2023-07-14T18:32:00.081+0000 7fe8a6017700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.184:6812 osd.5 since back 2023-07-14T18:31:21.128328+0000 front 2023-07-14T18:31:21.128169+0000 (oldest deadline 2023-07-14T18:31:45.827990+0000) 2023-07-14T18:32:00.512 INFO:journalctl@ceph.osd.10.smithi172.stdout:Jul 14 18:32:00 smithi172 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-10[119489]: 2023-07-14T18:32:00.081+0000 7fe8a6017700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.163:6822 osd.6 since back 2023-07-14T18:31:30.429581+0000 front 2023-07-14T18:31:30.429602+0000 (oldest deadline 2023-07-14T18:31:53.929561+0000) 2023-07-14T18:32:00.659 INFO:journalctl@ceph.osd.11.smithi184.stdout:Jul 14 18:32:00 smithi184 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-11[120819]: 2023-07-14T18:32:00.180+0000 7f44dbfe8700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.163:6806 osd.0 since back 2023-07-14T18:30:42.566533+0000 front 2023-07-14T18:30:42.566680+0000 (oldest deadline 2023-07-14T18:31:08.967162+0000) 2023-07-14T18:32:00.660 INFO:journalctl@ceph.osd.11.smithi184.stdout:Jul 14 18:32:00 smithi184 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-11[120819]: 2023-07-14T18:32:00.180+0000 7f44dbfe8700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2023-07-14T18:30:51.868462+0000 front 2023-07-14T18:30:51.868670+0000 (oldest deadline 2023-07-14T18:31:17.768517+0000) 2023-07-14T18:32:00.660 INFO:journalctl@ceph.osd.11.smithi184.stdout:Jul 14 18:32:00 smithi184 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-11[120819]: 2023-07-14T18:32:00.180+0000 7f44dbfe8700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.184:6804 osd.2 since back 2023-07-14T18:30:58.269297+0000 front 2023-07-14T18:30:58.269338+0000 (oldest deadline 2023-07-14T18:31:23.569431+0000) 2023-07-14T18:32:00.660 INFO:journalctl@ceph.osd.11.smithi184.stdout:Jul 14 18:32:00 smithi184 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-11[120819]: 2023-07-14T18:32:00.180+0000 7f44dbfe8700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.172:6812 osd.4 since back 2023-07-14T18:31:14.770869+0000 front 2023-07-14T18:31:14.770949+0000 (oldest deadline 2023-07-14T18:31:38.270981+0000) 2023-07-14T18:32:00.660 INFO:journalctl@ceph.osd.11.smithi184.stdout:Jul 14 18:32:00 smithi184 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-11[120819]: 2023-07-14T18:32:00.180+0000 7f44dbfe8700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.184:6812 osd.5 since back 2023-07-14T18:31:22.272344+0000 front 2023-07-14T18:31:22.272388+0000 (oldest deadline 2023-07-14T18:31:46.372402+0000) 2023-07-14T18:32:00.661 INFO:journalctl@ceph.osd.11.smithi184.stdout:Jul 14 18:32:00 smithi184 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-11[120819]: 2023-07-14T18:32:00.180+0000 7f44dbfe8700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.163:6822 osd.6 since back 2023-07-14T18:31:31.073622+0000 front 2023-07-14T18:31:31.073601+0000 (oldest deadline 2023-07-14T18:31:52.773428+0000) 2023-07-14T18:32:01.659 INFO:journalctl@ceph.osd.11.smithi184.stdout:Jul 14 18:32:01 smithi184 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-11[120819]: 2023-07-14T18:32:01.169+0000 7f44dbfe8700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.163:6806 osd.0 since back 2023-07-14T18:30:42.566533+0000 front 2023-07-14T18:30:42.566680+0000 (oldest deadline 2023-07-14T18:31:08.967162+0000) 2023-07-14T18:32:01.660 INFO:journalctl@ceph.osd.11.smithi184.stdout:Jul 14 18:32:01 smithi184 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-11[120819]: 2023-07-14T18:32:01.169+0000 7f44dbfe8700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2023-07-14T18:30:51.868462+0000 front 2023-07-14T18:30:51.868670+0000 (oldest deadline 2023-07-14T18:31:17.768517+0000) 2023-07-14T18:32:01.660 INFO:journalctl@ceph.osd.11.smithi184.stdout:Jul 14 18:32:01 smithi184 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-11[120819]: 2023-07-14T18:32:01.169+0000 7f44dbfe8700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.184:6804 osd.2 since back 2023-07-14T18:30:58.269297+0000 front 2023-07-14T18:30:58.269338+0000 (oldest deadline 2023-07-14T18:31:23.569431+0000) 2023-07-14T18:32:01.660 INFO:journalctl@ceph.osd.11.smithi184.stdout:Jul 14 18:32:01 smithi184 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-11[120819]: 2023-07-14T18:32:01.169+0000 7f44dbfe8700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.172:6812 osd.4 since back 2023-07-14T18:31:14.770869+0000 front 2023-07-14T18:31:14.770949+0000 (oldest deadline 2023-07-14T18:31:38.270981+0000) 2023-07-14T18:32:01.661 INFO:journalctl@ceph.osd.11.smithi184.stdout:Jul 14 18:32:01 smithi184 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-11[120819]: 2023-07-14T18:32:01.169+0000 7f44dbfe8700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.184:6812 osd.5 since back 2023-07-14T18:31:22.272344+0000 front 2023-07-14T18:31:22.272388+0000 (oldest deadline 2023-07-14T18:31:46.372402+0000) 2023-07-14T18:32:01.661 INFO:journalctl@ceph.osd.11.smithi184.stdout:Jul 14 18:32:01 smithi184 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-11[120819]: 2023-07-14T18:32:01.169+0000 7f44dbfe8700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.163:6822 osd.6 since back 2023-07-14T18:31:31.073622+0000 front 2023-07-14T18:31:31.073601+0000 (oldest deadline 2023-07-14T18:31:52.773428+0000) 2023-07-14T18:32:02.011 INFO:journalctl@ceph.osd.10.smithi172.stdout:Jul 14 18:32:01 smithi172 bash[130016]: ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-10 2023-07-14T18:32:02.659 INFO:journalctl@ceph.osd.11.smithi184.stdout:Jul 14 18:32:02 smithi184 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-11[120819]: 2023-07-14T18:32:02.146+0000 7f44dbfe8700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.163:6806 osd.0 since back 2023-07-14T18:30:42.566533+0000 front 2023-07-14T18:30:42.566680+0000 (oldest deadline 2023-07-14T18:31:08.967162+0000) 2023-07-14T18:32:02.660 INFO:journalctl@ceph.osd.11.smithi184.stdout:Jul 14 18:32:02 smithi184 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-11[120819]: 2023-07-14T18:32:02.146+0000 7f44dbfe8700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2023-07-14T18:30:51.868462+0000 front 2023-07-14T18:30:51.868670+0000 (oldest deadline 2023-07-14T18:31:17.768517+0000) 2023-07-14T18:32:02.660 INFO:journalctl@ceph.osd.11.smithi184.stdout:Jul 14 18:32:02 smithi184 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-11[120819]: 2023-07-14T18:32:02.146+0000 7f44dbfe8700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.184:6804 osd.2 since back 2023-07-14T18:30:58.269297+0000 front 2023-07-14T18:30:58.269338+0000 (oldest deadline 2023-07-14T18:31:23.569431+0000) 2023-07-14T18:32:02.660 INFO:journalctl@ceph.osd.11.smithi184.stdout:Jul 14 18:32:02 smithi184 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-11[120819]: 2023-07-14T18:32:02.146+0000 7f44dbfe8700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.172:6812 osd.4 since back 2023-07-14T18:31:14.770869+0000 front 2023-07-14T18:31:14.770949+0000 (oldest deadline 2023-07-14T18:31:38.270981+0000) 2023-07-14T18:32:02.660 INFO:journalctl@ceph.osd.11.smithi184.stdout:Jul 14 18:32:02 smithi184 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-11[120819]: 2023-07-14T18:32:02.146+0000 7f44dbfe8700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.184:6812 osd.5 since back 2023-07-14T18:31:22.272344+0000 front 2023-07-14T18:31:22.272388+0000 (oldest deadline 2023-07-14T18:31:46.372402+0000) 2023-07-14T18:32:02.661 INFO:journalctl@ceph.osd.11.smithi184.stdout:Jul 14 18:32:02 smithi184 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-11[120819]: 2023-07-14T18:32:02.146+0000 7f44dbfe8700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.163:6822 osd.6 since back 2023-07-14T18:31:31.073622+0000 front 2023-07-14T18:31:31.073601+0000 (oldest deadline 2023-07-14T18:31:52.773428+0000) 2023-07-14T18:32:02.988 DEBUG:teuthology.orchestra.run.smithi172:> sudo pkill -f 'journalctl -f -n 0 -u ceph-bf7326ec-2270-11ee-9b33-001a4aab830c@osd.10.service' 2023-07-14T18:32:03.028 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-07-14T18:32:03.030 INFO:tasks.cephadm.osd.10:Stopped osd.10 2023-07-14T18:32:03.031 INFO:tasks.cephadm.osd.11:Stopping osd.11... 2023-07-14T18:32:03.032 DEBUG:teuthology.orchestra.run.smithi184:> sudo systemctl stop ceph-bf7326ec-2270-11ee-9b33-001a4aab830c@osd.11 2023-07-14T18:32:03.395 INFO:journalctl@ceph.osd.11.smithi184.stdout:Jul 14 18:32:03 smithi184 systemd[1]: Stopping Ceph osd.11 for bf7326ec-2270-11ee-9b33-001a4aab830c... 2023-07-14T18:32:03.395 INFO:journalctl@ceph.osd.11.smithi184.stdout:Jul 14 18:32:03 smithi184 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-11[120819]: 2023-07-14T18:32:03.158+0000 7f44dbfe8700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.163:6806 osd.0 since back 2023-07-14T18:30:42.566533+0000 front 2023-07-14T18:30:42.566680+0000 (oldest deadline 2023-07-14T18:31:08.967162+0000) 2023-07-14T18:32:03.396 INFO:journalctl@ceph.osd.11.smithi184.stdout:Jul 14 18:32:03 smithi184 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-11[120819]: 2023-07-14T18:32:03.158+0000 7f44dbfe8700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2023-07-14T18:30:51.868462+0000 front 2023-07-14T18:30:51.868670+0000 (oldest deadline 2023-07-14T18:31:17.768517+0000) 2023-07-14T18:32:03.396 INFO:journalctl@ceph.osd.11.smithi184.stdout:Jul 14 18:32:03 smithi184 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-11[120819]: 2023-07-14T18:32:03.158+0000 7f44dbfe8700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.184:6804 osd.2 since back 2023-07-14T18:30:58.269297+0000 front 2023-07-14T18:30:58.269338+0000 (oldest deadline 2023-07-14T18:31:23.569431+0000) 2023-07-14T18:32:03.396 INFO:journalctl@ceph.osd.11.smithi184.stdout:Jul 14 18:32:03 smithi184 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-11[120819]: 2023-07-14T18:32:03.158+0000 7f44dbfe8700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.172:6812 osd.4 since back 2023-07-14T18:31:14.770869+0000 front 2023-07-14T18:31:14.770949+0000 (oldest deadline 2023-07-14T18:31:38.270981+0000) 2023-07-14T18:32:03.396 INFO:journalctl@ceph.osd.11.smithi184.stdout:Jul 14 18:32:03 smithi184 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-11[120819]: 2023-07-14T18:32:03.158+0000 7f44dbfe8700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.184:6812 osd.5 since back 2023-07-14T18:31:22.272344+0000 front 2023-07-14T18:31:22.272388+0000 (oldest deadline 2023-07-14T18:31:46.372402+0000) 2023-07-14T18:32:03.396 INFO:journalctl@ceph.osd.11.smithi184.stdout:Jul 14 18:32:03 smithi184 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-11[120819]: 2023-07-14T18:32:03.158+0000 7f44dbfe8700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.163:6822 osd.6 since back 2023-07-14T18:31:31.073622+0000 front 2023-07-14T18:31:31.073601+0000 (oldest deadline 2023-07-14T18:31:52.773428+0000) 2023-07-14T18:32:03.397 INFO:journalctl@ceph.osd.11.smithi184.stdout:Jul 14 18:32:03 smithi184 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-11[120819]: 2023-07-14T18:32:03.370+0000 7f44e09f3700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-osd -n osd.11 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-07-14T18:32:03.397 INFO:journalctl@ceph.osd.11.smithi184.stdout:Jul 14 18:32:03 smithi184 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-11[120819]: 2023-07-14T18:32:03.370+0000 7f44e09f3700 -1 osd.11 88 *** Got signal Terminated *** 2023-07-14T18:32:04.659 INFO:journalctl@ceph.osd.11.smithi184.stdout:Jul 14 18:32:03 smithi184 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-11[120819]: 2023-07-14T18:32:03.370+0000 7f44e09f3700 -1 osd.11 88 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-07-14T18:32:04.660 INFO:journalctl@ceph.osd.11.smithi184.stdout:Jul 14 18:32:04 smithi184 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-11[120819]: 2023-07-14T18:32:04.159+0000 7f44dbfe8700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.163:6806 osd.0 since back 2023-07-14T18:30:42.566533+0000 front 2023-07-14T18:30:42.566680+0000 (oldest deadline 2023-07-14T18:31:08.967162+0000) 2023-07-14T18:32:04.660 INFO:journalctl@ceph.osd.11.smithi184.stdout:Jul 14 18:32:04 smithi184 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-11[120819]: 2023-07-14T18:32:04.159+0000 7f44dbfe8700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2023-07-14T18:30:51.868462+0000 front 2023-07-14T18:30:51.868670+0000 (oldest deadline 2023-07-14T18:31:17.768517+0000) 2023-07-14T18:32:04.660 INFO:journalctl@ceph.osd.11.smithi184.stdout:Jul 14 18:32:04 smithi184 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-11[120819]: 2023-07-14T18:32:04.159+0000 7f44dbfe8700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.184:6804 osd.2 since back 2023-07-14T18:30:58.269297+0000 front 2023-07-14T18:30:58.269338+0000 (oldest deadline 2023-07-14T18:31:23.569431+0000) 2023-07-14T18:32:04.661 INFO:journalctl@ceph.osd.11.smithi184.stdout:Jul 14 18:32:04 smithi184 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-11[120819]: 2023-07-14T18:32:04.159+0000 7f44dbfe8700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.172:6812 osd.4 since back 2023-07-14T18:31:14.770869+0000 front 2023-07-14T18:31:14.770949+0000 (oldest deadline 2023-07-14T18:31:38.270981+0000) 2023-07-14T18:32:04.661 INFO:journalctl@ceph.osd.11.smithi184.stdout:Jul 14 18:32:04 smithi184 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-11[120819]: 2023-07-14T18:32:04.159+0000 7f44dbfe8700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.184:6812 osd.5 since back 2023-07-14T18:31:22.272344+0000 front 2023-07-14T18:31:22.272388+0000 (oldest deadline 2023-07-14T18:31:46.372402+0000) 2023-07-14T18:32:04.661 INFO:journalctl@ceph.osd.11.smithi184.stdout:Jul 14 18:32:04 smithi184 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-11[120819]: 2023-07-14T18:32:04.159+0000 7f44dbfe8700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.163:6822 osd.6 since back 2023-07-14T18:31:31.073622+0000 front 2023-07-14T18:31:31.073601+0000 (oldest deadline 2023-07-14T18:31:52.773428+0000) 2023-07-14T18:32:04.661 INFO:journalctl@ceph.osd.11.smithi184.stdout:Jul 14 18:32:04 smithi184 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-11[120819]: 2023-07-14T18:32:04.159+0000 7f44dbfe8700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.172:6820 osd.7 since back 2023-07-14T18:31:38.375891+0000 front 2023-07-14T18:31:38.375877+0000 (oldest deadline 2023-07-14T18:32:03.675721+0000) 2023-07-14T18:32:05.659 INFO:journalctl@ceph.osd.11.smithi184.stdout:Jul 14 18:32:05 smithi184 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-11[120819]: 2023-07-14T18:32:05.152+0000 7f44dbfe8700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.163:6806 osd.0 since back 2023-07-14T18:30:42.566533+0000 front 2023-07-14T18:30:42.566680+0000 (oldest deadline 2023-07-14T18:31:08.967162+0000) 2023-07-14T18:32:05.660 INFO:journalctl@ceph.osd.11.smithi184.stdout:Jul 14 18:32:05 smithi184 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-11[120819]: 2023-07-14T18:32:05.152+0000 7f44dbfe8700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2023-07-14T18:30:51.868462+0000 front 2023-07-14T18:30:51.868670+0000 (oldest deadline 2023-07-14T18:31:17.768517+0000) 2023-07-14T18:32:05.660 INFO:journalctl@ceph.osd.11.smithi184.stdout:Jul 14 18:32:05 smithi184 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-11[120819]: 2023-07-14T18:32:05.152+0000 7f44dbfe8700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.184:6804 osd.2 since back 2023-07-14T18:30:58.269297+0000 front 2023-07-14T18:30:58.269338+0000 (oldest deadline 2023-07-14T18:31:23.569431+0000) 2023-07-14T18:32:05.660 INFO:journalctl@ceph.osd.11.smithi184.stdout:Jul 14 18:32:05 smithi184 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-11[120819]: 2023-07-14T18:32:05.152+0000 7f44dbfe8700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.172:6812 osd.4 since back 2023-07-14T18:31:14.770869+0000 front 2023-07-14T18:31:14.770949+0000 (oldest deadline 2023-07-14T18:31:38.270981+0000) 2023-07-14T18:32:05.660 INFO:journalctl@ceph.osd.11.smithi184.stdout:Jul 14 18:32:05 smithi184 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-11[120819]: 2023-07-14T18:32:05.152+0000 7f44dbfe8700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.184:6812 osd.5 since back 2023-07-14T18:31:22.272344+0000 front 2023-07-14T18:31:22.272388+0000 (oldest deadline 2023-07-14T18:31:46.372402+0000) 2023-07-14T18:32:05.661 INFO:journalctl@ceph.osd.11.smithi184.stdout:Jul 14 18:32:05 smithi184 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-11[120819]: 2023-07-14T18:32:05.152+0000 7f44dbfe8700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.163:6822 osd.6 since back 2023-07-14T18:31:31.073622+0000 front 2023-07-14T18:31:31.073601+0000 (oldest deadline 2023-07-14T18:31:52.773428+0000) 2023-07-14T18:32:05.661 INFO:journalctl@ceph.osd.11.smithi184.stdout:Jul 14 18:32:05 smithi184 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-11[120819]: 2023-07-14T18:32:05.152+0000 7f44dbfe8700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.172:6820 osd.7 since back 2023-07-14T18:31:38.375891+0000 front 2023-07-14T18:31:38.375877+0000 (oldest deadline 2023-07-14T18:32:03.675721+0000) 2023-07-14T18:32:06.659 INFO:journalctl@ceph.osd.11.smithi184.stdout:Jul 14 18:32:06 smithi184 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-11[120819]: 2023-07-14T18:32:06.135+0000 7f44dbfe8700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.163:6806 osd.0 since back 2023-07-14T18:30:42.566533+0000 front 2023-07-14T18:30:42.566680+0000 (oldest deadline 2023-07-14T18:31:08.967162+0000) 2023-07-14T18:32:06.660 INFO:journalctl@ceph.osd.11.smithi184.stdout:Jul 14 18:32:06 smithi184 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-11[120819]: 2023-07-14T18:32:06.135+0000 7f44dbfe8700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2023-07-14T18:30:51.868462+0000 front 2023-07-14T18:30:51.868670+0000 (oldest deadline 2023-07-14T18:31:17.768517+0000) 2023-07-14T18:32:06.660 INFO:journalctl@ceph.osd.11.smithi184.stdout:Jul 14 18:32:06 smithi184 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-11[120819]: 2023-07-14T18:32:06.135+0000 7f44dbfe8700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.184:6804 osd.2 since back 2023-07-14T18:30:58.269297+0000 front 2023-07-14T18:30:58.269338+0000 (oldest deadline 2023-07-14T18:31:23.569431+0000) 2023-07-14T18:32:06.660 INFO:journalctl@ceph.osd.11.smithi184.stdout:Jul 14 18:32:06 smithi184 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-11[120819]: 2023-07-14T18:32:06.135+0000 7f44dbfe8700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.172:6812 osd.4 since back 2023-07-14T18:31:14.770869+0000 front 2023-07-14T18:31:14.770949+0000 (oldest deadline 2023-07-14T18:31:38.270981+0000) 2023-07-14T18:32:06.661 INFO:journalctl@ceph.osd.11.smithi184.stdout:Jul 14 18:32:06 smithi184 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-11[120819]: 2023-07-14T18:32:06.135+0000 7f44dbfe8700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.184:6812 osd.5 since back 2023-07-14T18:31:22.272344+0000 front 2023-07-14T18:31:22.272388+0000 (oldest deadline 2023-07-14T18:31:46.372402+0000) 2023-07-14T18:32:06.661 INFO:journalctl@ceph.osd.11.smithi184.stdout:Jul 14 18:32:06 smithi184 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-11[120819]: 2023-07-14T18:32:06.135+0000 7f44dbfe8700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.163:6822 osd.6 since back 2023-07-14T18:31:31.073622+0000 front 2023-07-14T18:31:31.073601+0000 (oldest deadline 2023-07-14T18:31:52.773428+0000) 2023-07-14T18:32:06.661 INFO:journalctl@ceph.osd.11.smithi184.stdout:Jul 14 18:32:06 smithi184 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-11[120819]: 2023-07-14T18:32:06.135+0000 7f44dbfe8700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.172:6820 osd.7 since back 2023-07-14T18:31:38.375891+0000 front 2023-07-14T18:31:38.375877+0000 (oldest deadline 2023-07-14T18:32:03.675721+0000) 2023-07-14T18:32:07.659 INFO:journalctl@ceph.osd.11.smithi184.stdout:Jul 14 18:32:07 smithi184 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-11[120819]: 2023-07-14T18:32:07.178+0000 7f44dbfe8700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.163:6806 osd.0 since back 2023-07-14T18:30:42.566533+0000 front 2023-07-14T18:30:42.566680+0000 (oldest deadline 2023-07-14T18:31:08.967162+0000) 2023-07-14T18:32:07.659 INFO:journalctl@ceph.osd.11.smithi184.stdout:Jul 14 18:32:07 smithi184 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-11[120819]: 2023-07-14T18:32:07.178+0000 7f44dbfe8700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2023-07-14T18:30:51.868462+0000 front 2023-07-14T18:30:51.868670+0000 (oldest deadline 2023-07-14T18:31:17.768517+0000) 2023-07-14T18:32:07.660 INFO:journalctl@ceph.osd.11.smithi184.stdout:Jul 14 18:32:07 smithi184 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-11[120819]: 2023-07-14T18:32:07.178+0000 7f44dbfe8700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.184:6804 osd.2 since back 2023-07-14T18:30:58.269297+0000 front 2023-07-14T18:30:58.269338+0000 (oldest deadline 2023-07-14T18:31:23.569431+0000) 2023-07-14T18:32:07.660 INFO:journalctl@ceph.osd.11.smithi184.stdout:Jul 14 18:32:07 smithi184 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-11[120819]: 2023-07-14T18:32:07.178+0000 7f44dbfe8700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.172:6812 osd.4 since back 2023-07-14T18:31:14.770869+0000 front 2023-07-14T18:31:14.770949+0000 (oldest deadline 2023-07-14T18:31:38.270981+0000) 2023-07-14T18:32:07.660 INFO:journalctl@ceph.osd.11.smithi184.stdout:Jul 14 18:32:07 smithi184 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-11[120819]: 2023-07-14T18:32:07.178+0000 7f44dbfe8700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.184:6812 osd.5 since back 2023-07-14T18:31:22.272344+0000 front 2023-07-14T18:31:22.272388+0000 (oldest deadline 2023-07-14T18:31:46.372402+0000) 2023-07-14T18:32:07.660 INFO:journalctl@ceph.osd.11.smithi184.stdout:Jul 14 18:32:07 smithi184 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-11[120819]: 2023-07-14T18:32:07.178+0000 7f44dbfe8700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.163:6822 osd.6 since back 2023-07-14T18:31:31.073622+0000 front 2023-07-14T18:31:31.073601+0000 (oldest deadline 2023-07-14T18:31:52.773428+0000) 2023-07-14T18:32:07.660 INFO:journalctl@ceph.osd.11.smithi184.stdout:Jul 14 18:32:07 smithi184 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-11[120819]: 2023-07-14T18:32:07.178+0000 7f44dbfe8700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.172:6820 osd.7 since back 2023-07-14T18:31:38.375891+0000 front 2023-07-14T18:31:38.375877+0000 (oldest deadline 2023-07-14T18:32:03.675721+0000) 2023-07-14T18:32:08.659 INFO:journalctl@ceph.osd.11.smithi184.stdout:Jul 14 18:32:08 smithi184 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-11[120819]: 2023-07-14T18:32:08.199+0000 7f44dbfe8700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.163:6806 osd.0 since back 2023-07-14T18:30:42.566533+0000 front 2023-07-14T18:30:42.566680+0000 (oldest deadline 2023-07-14T18:31:08.967162+0000) 2023-07-14T18:32:08.660 INFO:journalctl@ceph.osd.11.smithi184.stdout:Jul 14 18:32:08 smithi184 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-11[120819]: 2023-07-14T18:32:08.199+0000 7f44dbfe8700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2023-07-14T18:30:51.868462+0000 front 2023-07-14T18:30:51.868670+0000 (oldest deadline 2023-07-14T18:31:17.768517+0000) 2023-07-14T18:32:08.660 INFO:journalctl@ceph.osd.11.smithi184.stdout:Jul 14 18:32:08 smithi184 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-11[120819]: 2023-07-14T18:32:08.199+0000 7f44dbfe8700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.184:6804 osd.2 since back 2023-07-14T18:30:58.269297+0000 front 2023-07-14T18:30:58.269338+0000 (oldest deadline 2023-07-14T18:31:23.569431+0000) 2023-07-14T18:32:08.660 INFO:journalctl@ceph.osd.11.smithi184.stdout:Jul 14 18:32:08 smithi184 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-11[120819]: 2023-07-14T18:32:08.199+0000 7f44dbfe8700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.172:6812 osd.4 since back 2023-07-14T18:31:14.770869+0000 front 2023-07-14T18:31:14.770949+0000 (oldest deadline 2023-07-14T18:31:38.270981+0000) 2023-07-14T18:32:08.661 INFO:journalctl@ceph.osd.11.smithi184.stdout:Jul 14 18:32:08 smithi184 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-11[120819]: 2023-07-14T18:32:08.199+0000 7f44dbfe8700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.184:6812 osd.5 since back 2023-07-14T18:31:22.272344+0000 front 2023-07-14T18:31:22.272388+0000 (oldest deadline 2023-07-14T18:31:46.372402+0000) 2023-07-14T18:32:08.661 INFO:journalctl@ceph.osd.11.smithi184.stdout:Jul 14 18:32:08 smithi184 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-11[120819]: 2023-07-14T18:32:08.199+0000 7f44dbfe8700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.163:6822 osd.6 since back 2023-07-14T18:31:31.073622+0000 front 2023-07-14T18:31:31.073601+0000 (oldest deadline 2023-07-14T18:31:52.773428+0000) 2023-07-14T18:32:08.661 INFO:journalctl@ceph.osd.11.smithi184.stdout:Jul 14 18:32:08 smithi184 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-11[120819]: 2023-07-14T18:32:08.199+0000 7f44dbfe8700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.172:6820 osd.7 since back 2023-07-14T18:31:38.375891+0000 front 2023-07-14T18:31:38.375877+0000 (oldest deadline 2023-07-14T18:32:03.675721+0000) 2023-07-14T18:32:09.409 INFO:journalctl@ceph.osd.11.smithi184.stdout:Jul 14 18:32:09 smithi184 bash[131541]: ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-osd-11 2023-07-14T18:32:10.823 DEBUG:teuthology.orchestra.run.smithi184:> sudo pkill -f 'journalctl -f -n 0 -u ceph-bf7326ec-2270-11ee-9b33-001a4aab830c@osd.11.service' 2023-07-14T18:32:10.862 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-07-14T18:32:10.863 INFO:tasks.cephadm.osd.11:Stopped osd.11 2023-07-14T18:32:10.864 INFO:tasks.cephadm.mds.a:Stopping mds.a... 2023-07-14T18:32:10.864 DEBUG:teuthology.orchestra.run.smithi163:> sudo systemctl stop ceph-bf7326ec-2270-11ee-9b33-001a4aab830c@mds.a 2023-07-14T18:32:11.201 INFO:journalctl@ceph.mds.a.smithi163.stdout:Jul 14 18:32:10 smithi163 systemd[1]: Stopping Ceph mds.a for bf7326ec-2270-11ee-9b33-001a4aab830c... 2023-07-14T18:32:11.701 INFO:journalctl@ceph.mds.a.smithi163.stdout:Jul 14 18:32:11 smithi163 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-mds-a[131158]: 2023-07-14T18:32:11.195+0000 7f692e5d2700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-mds -n mds.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-07-14T18:32:11.702 INFO:journalctl@ceph.mds.a.smithi163.stdout:Jul 14 18:32:11 smithi163 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-mds-a[131158]: 2023-07-14T18:32:11.195+0000 7f692e5d2700 -1 mds.a *** got signal Terminated *** 2023-07-14T18:32:16.415 INFO:journalctl@ceph.mds.a.smithi163.stdout:Jul 14 18:32:16 smithi163 bash[174880]: ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-mds-a 2023-07-14T18:32:16.421 DEBUG:teuthology.orchestra.run.smithi163:> sudo pkill -f 'journalctl -f -n 0 -u ceph-bf7326ec-2270-11ee-9b33-001a4aab830c@mds.a.service' 2023-07-14T18:32:16.458 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-07-14T18:32:16.459 INFO:tasks.cephadm.mds.a:Stopped mds.a 2023-07-14T18:32:16.460 INFO:tasks.cephadm.mds.d:Stopping mds.d... 2023-07-14T18:32:16.460 DEBUG:teuthology.orchestra.run.smithi163:> sudo systemctl stop ceph-bf7326ec-2270-11ee-9b33-001a4aab830c@mds.d 2023-07-14T18:32:16.701 INFO:journalctl@ceph.mds.d.smithi163.stdout:Jul 14 18:32:16 smithi163 systemd[1]: Stopping Ceph mds.d for bf7326ec-2270-11ee-9b33-001a4aab830c... 2023-07-14T18:32:17.201 INFO:journalctl@ceph.mds.d.smithi163.stdout:Jul 14 18:32:16 smithi163 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-mds-d[130155]: 2023-07-14T18:32:16.806+0000 7f3d0e3f6700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-mds -n mds.d -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-07-14T18:32:17.202 INFO:journalctl@ceph.mds.d.smithi163.stdout:Jul 14 18:32:16 smithi163 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-mds-d[130155]: 2023-07-14T18:32:16.806+0000 7f3d0e3f6700 -1 mds.d *** got signal Terminated *** 2023-07-14T18:32:18.451 INFO:journalctl@ceph.mds.d.smithi163.stdout:Jul 14 18:32:18 smithi163 bash[175027]: ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-mds-d 2023-07-14T18:32:18.583 DEBUG:teuthology.orchestra.run.smithi163:> sudo pkill -f 'journalctl -f -n 0 -u ceph-bf7326ec-2270-11ee-9b33-001a4aab830c@mds.d.service' 2023-07-14T18:32:18.620 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-07-14T18:32:18.621 INFO:tasks.cephadm.mds.d:Stopped mds.d 2023-07-14T18:32:18.621 INFO:tasks.cephadm.mds.g:Stopping mds.g... 2023-07-14T18:32:18.622 DEBUG:teuthology.orchestra.run.smithi163:> sudo systemctl stop ceph-bf7326ec-2270-11ee-9b33-001a4aab830c@mds.g 2023-07-14T18:32:18.951 INFO:journalctl@ceph.mds.g.smithi163.stdout:Jul 14 18:32:18 smithi163 systemd[1]: Stopping Ceph mds.g for bf7326ec-2270-11ee-9b33-001a4aab830c... 2023-07-14T18:32:19.451 INFO:journalctl@ceph.mds.g.smithi163.stdout:Jul 14 18:32:18 smithi163 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-mds-g[130766]: 2023-07-14T18:32:18.977+0000 7f40b212d700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-mds -n mds.g -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-07-14T18:32:19.451 INFO:journalctl@ceph.mds.g.smithi163.stdout:Jul 14 18:32:18 smithi163 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-mds-g[130766]: 2023-07-14T18:32:18.977+0000 7f40b212d700 -1 mds.g *** got signal Terminated *** 2023-07-14T18:32:23.376 INFO:journalctl@ceph.mds.g.smithi163.stdout:Jul 14 18:32:23 smithi163 bash[175164]: ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-mds-g 2023-07-14T18:32:23.565 DEBUG:teuthology.orchestra.run.smithi163:> sudo pkill -f 'journalctl -f -n 0 -u ceph-bf7326ec-2270-11ee-9b33-001a4aab830c@mds.g.service' 2023-07-14T18:32:23.600 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-07-14T18:32:23.600 INFO:tasks.cephadm.mds.g:Stopped mds.g 2023-07-14T18:32:23.601 INFO:tasks.cephadm.mds.j:Stopping mds.j... 2023-07-14T18:32:23.601 DEBUG:teuthology.orchestra.run.smithi163:> sudo systemctl stop ceph-bf7326ec-2270-11ee-9b33-001a4aab830c@mds.j 2023-07-14T18:32:23.951 INFO:journalctl@ceph.mds.j.smithi163.stdout:Jul 14 18:32:23 smithi163 systemd[1]: Stopping Ceph mds.j for bf7326ec-2270-11ee-9b33-001a4aab830c... 2023-07-14T18:32:24.453 INFO:journalctl@ceph.mds.j.smithi163.stdout:Jul 14 18:32:23 smithi163 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-mds-j[129790]: 2023-07-14T18:32:23.967+0000 7f47e7c7b700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-mds -n mds.j -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-07-14T18:32:24.453 INFO:journalctl@ceph.mds.j.smithi163.stdout:Jul 14 18:32:23 smithi163 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-mds-j[129790]: 2023-07-14T18:32:23.967+0000 7f47e7c7b700 -1 mds.j *** got signal Terminated *** 2023-07-14T18:32:28.450 INFO:journalctl@ceph.mds.j.smithi163.stdout:Jul 14 18:32:28 smithi163 bash[175303]: ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-mds-j 2023-07-14T18:32:28.570 DEBUG:teuthology.orchestra.run.smithi163:> sudo pkill -f 'journalctl -f -n 0 -u ceph-bf7326ec-2270-11ee-9b33-001a4aab830c@mds.j.service' 2023-07-14T18:32:28.605 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-07-14T18:32:28.606 INFO:tasks.cephadm.mds.j:Stopped mds.j 2023-07-14T18:32:28.606 INFO:tasks.cephadm.mds.b:Stopping mds.b... 2023-07-14T18:32:28.606 DEBUG:teuthology.orchestra.run.smithi172:> sudo systemctl stop ceph-bf7326ec-2270-11ee-9b33-001a4aab830c@mds.b 2023-07-14T18:32:28.948 INFO:journalctl@ceph.mds.b.smithi172.stdout:Jul 14 18:32:28 smithi172 systemd[1]: Stopping Ceph mds.b for bf7326ec-2270-11ee-9b33-001a4aab830c... 2023-07-14T18:32:29.259 INFO:journalctl@ceph.mds.b.smithi172.stdout:Jul 14 18:32:28 smithi172 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-mds-b[123259]: 2023-07-14T18:32:28.923+0000 7f9c15caa700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-mds -n mds.b -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-07-14T18:32:29.259 INFO:journalctl@ceph.mds.b.smithi172.stdout:Jul 14 18:32:28 smithi172 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-mds-b[123259]: 2023-07-14T18:32:28.923+0000 7f9c15caa700 -1 mds.b *** got signal Terminated *** 2023-07-14T18:32:36.432 INFO:journalctl@ceph.mds.b.smithi172.stdout:Jul 14 18:32:36 smithi172 bash[130293]: ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-mds-b 2023-07-14T18:32:36.437 DEBUG:teuthology.orchestra.run.smithi172:> sudo pkill -f 'journalctl -f -n 0 -u ceph-bf7326ec-2270-11ee-9b33-001a4aab830c@mds.b.service' 2023-07-14T18:32:36.473 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-07-14T18:32:36.474 INFO:tasks.cephadm.mds.b:Stopped mds.b 2023-07-14T18:32:36.475 INFO:tasks.cephadm.mds.e:Stopping mds.e... 2023-07-14T18:32:36.476 DEBUG:teuthology.orchestra.run.smithi172:> sudo systemctl stop ceph-bf7326ec-2270-11ee-9b33-001a4aab830c@mds.e 2023-07-14T18:32:36.759 INFO:journalctl@ceph.mds.e.smithi172.stdout:Jul 14 18:32:36 smithi172 systemd[1]: Stopping Ceph mds.e for bf7326ec-2270-11ee-9b33-001a4aab830c... 2023-07-14T18:32:37.259 INFO:journalctl@ceph.mds.e.smithi172.stdout:Jul 14 18:32:36 smithi172 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-mds-e[122570]: 2023-07-14T18:32:36.822+0000 7f004b62b700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-mds -n mds.e -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-07-14T18:32:37.260 INFO:journalctl@ceph.mds.e.smithi172.stdout:Jul 14 18:32:36 smithi172 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-mds-e[122570]: 2023-07-14T18:32:36.822+0000 7f004b62b700 -1 mds.e *** got signal Terminated *** 2023-07-14T18:32:40.822 INFO:journalctl@ceph.mds.e.smithi172.stdout:Jul 14 18:32:40 smithi172 bash[130438]: ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-mds-e 2023-07-14T18:32:41.013 DEBUG:teuthology.orchestra.run.smithi172:> sudo pkill -f 'journalctl -f -n 0 -u ceph-bf7326ec-2270-11ee-9b33-001a4aab830c@mds.e.service' 2023-07-14T18:32:41.048 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-07-14T18:32:41.048 INFO:tasks.cephadm.mds.e:Stopped mds.e 2023-07-14T18:32:41.049 INFO:tasks.cephadm.mds.h:Stopping mds.h... 2023-07-14T18:32:41.049 DEBUG:teuthology.orchestra.run.smithi172:> sudo systemctl stop ceph-bf7326ec-2270-11ee-9b33-001a4aab830c@mds.h 2023-07-14T18:32:41.428 INFO:journalctl@ceph.mds.h.smithi172.stdout:Jul 14 18:32:41 smithi172 systemd[1]: Stopping Ceph mds.h for bf7326ec-2270-11ee-9b33-001a4aab830c... 2023-07-14T18:32:41.758 INFO:journalctl@ceph.mds.h.smithi172.stdout:Jul 14 18:32:41 smithi172 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-mds-h[122913]: 2023-07-14T18:32:41.404+0000 7f868fac3700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-mds -n mds.h -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-07-14T18:32:41.759 INFO:journalctl@ceph.mds.h.smithi172.stdout:Jul 14 18:32:41 smithi172 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-mds-h[122913]: 2023-07-14T18:32:41.404+0000 7f868fac3700 -1 mds.h *** got signal Terminated *** 2023-07-14T18:32:46.482 INFO:journalctl@ceph.mds.h.smithi172.stdout:Jul 14 18:32:46 smithi172 bash[130579]: ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-mds-h 2023-07-14T18:32:46.489 DEBUG:teuthology.orchestra.run.smithi172:> sudo pkill -f 'journalctl -f -n 0 -u ceph-bf7326ec-2270-11ee-9b33-001a4aab830c@mds.h.service' 2023-07-14T18:32:46.524 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-07-14T18:32:46.525 INFO:tasks.cephadm.mds.h:Stopped mds.h 2023-07-14T18:32:46.525 INFO:tasks.cephadm.mds.k:Stopping mds.k... 2023-07-14T18:32:46.526 DEBUG:teuthology.orchestra.run.smithi172:> sudo systemctl stop ceph-bf7326ec-2270-11ee-9b33-001a4aab830c@mds.k 2023-07-14T18:32:46.758 INFO:journalctl@ceph.mds.k.smithi172.stdout:Jul 14 18:32:46 smithi172 systemd[1]: Stopping Ceph mds.k for bf7326ec-2270-11ee-9b33-001a4aab830c... 2023-07-14T18:32:47.258 INFO:journalctl@ceph.mds.k.smithi172.stdout:Jul 14 18:32:46 smithi172 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-mds-k[122226]: 2023-07-14T18:32:46.887+0000 7fc7d8475700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-mds -n mds.k -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-07-14T18:32:47.259 INFO:journalctl@ceph.mds.k.smithi172.stdout:Jul 14 18:32:46 smithi172 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-mds-k[122226]: 2023-07-14T18:32:46.887+0000 7fc7d8475700 -1 mds.k *** got signal Terminated *** 2023-07-14T18:32:50.279 INFO:journalctl@ceph.mds.k.smithi172.stdout:Jul 14 18:32:50 smithi172 bash[130718]: ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-mds-k 2023-07-14T18:32:50.478 DEBUG:teuthology.orchestra.run.smithi172:> sudo pkill -f 'journalctl -f -n 0 -u ceph-bf7326ec-2270-11ee-9b33-001a4aab830c@mds.k.service' 2023-07-14T18:32:50.511 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-07-14T18:32:50.512 INFO:tasks.cephadm.mds.k:Stopped mds.k 2023-07-14T18:32:50.513 INFO:tasks.cephadm.mds.c:Stopping mds.c... 2023-07-14T18:32:50.513 DEBUG:teuthology.orchestra.run.smithi184:> sudo systemctl stop ceph-bf7326ec-2270-11ee-9b33-001a4aab830c@mds.c 2023-07-14T18:32:50.876 INFO:journalctl@ceph.mds.c.smithi184.stdout:Jul 14 18:32:50 smithi184 systemd[1]: Stopping Ceph mds.c for bf7326ec-2270-11ee-9b33-001a4aab830c... 2023-07-14T18:32:51.157 INFO:journalctl@ceph.mds.c.smithi184.stdout:Jul 14 18:32:50 smithi184 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-mds-c[124334]: 2023-07-14T18:32:50.853+0000 7f1dd3e1f700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-mds -n mds.c -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-07-14T18:32:51.158 INFO:journalctl@ceph.mds.c.smithi184.stdout:Jul 14 18:32:50 smithi184 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-mds-c[124334]: 2023-07-14T18:32:50.853+0000 7f1dd3e1f700 -1 mds.c *** got signal Terminated *** 2023-07-14T18:32:55.451 INFO:journalctl@ceph.mds.c.smithi184.stdout:Jul 14 18:32:55 smithi184 bash[131829]: ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-mds-c 2023-07-14T18:32:55.643 DEBUG:teuthology.orchestra.run.smithi184:> sudo pkill -f 'journalctl -f -n 0 -u ceph-bf7326ec-2270-11ee-9b33-001a4aab830c@mds.c.service' 2023-07-14T18:32:55.684 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-07-14T18:32:55.684 INFO:tasks.cephadm.mds.c:Stopped mds.c 2023-07-14T18:32:55.685 INFO:tasks.cephadm.mds.f:Stopping mds.f... 2023-07-14T18:32:55.685 DEBUG:teuthology.orchestra.run.smithi184:> sudo systemctl stop ceph-bf7326ec-2270-11ee-9b33-001a4aab830c@mds.f 2023-07-14T18:32:55.907 INFO:journalctl@ceph.mds.f.smithi184.stdout:Jul 14 18:32:55 smithi184 systemd[1]: Stopping Ceph mds.f for bf7326ec-2270-11ee-9b33-001a4aab830c... 2023-07-14T18:32:56.407 INFO:journalctl@ceph.mds.f.smithi184.stdout:Jul 14 18:32:56 smithi184 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-mds-f[123996]: 2023-07-14T18:32:56.044+0000 7feeec502700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-mds -n mds.f -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-07-14T18:32:56.407 INFO:journalctl@ceph.mds.f.smithi184.stdout:Jul 14 18:32:56 smithi184 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-mds-f[123996]: 2023-07-14T18:32:56.044+0000 7feeec502700 -1 mds.f *** got signal Terminated *** 2023-07-14T18:32:59.157 INFO:journalctl@ceph.mds.f.smithi184.stdout:Jul 14 18:32:58 smithi184 bash[131965]: ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-mds-f 2023-07-14T18:32:59.223 DEBUG:teuthology.orchestra.run.smithi184:> sudo pkill -f 'journalctl -f -n 0 -u ceph-bf7326ec-2270-11ee-9b33-001a4aab830c@mds.f.service' 2023-07-14T18:32:59.258 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-07-14T18:32:59.259 INFO:tasks.cephadm.mds.f:Stopped mds.f 2023-07-14T18:32:59.260 INFO:tasks.cephadm.mds.i:Stopping mds.i... 2023-07-14T18:32:59.261 DEBUG:teuthology.orchestra.run.smithi184:> sudo systemctl stop ceph-bf7326ec-2270-11ee-9b33-001a4aab830c@mds.i 2023-07-14T18:32:59.632 INFO:journalctl@ceph.mds.i.smithi184.stdout:Jul 14 18:32:59 smithi184 systemd[1]: Stopping Ceph mds.i for bf7326ec-2270-11ee-9b33-001a4aab830c... 2023-07-14T18:32:59.907 INFO:journalctl@ceph.mds.i.smithi184.stdout:Jul 14 18:32:59 smithi184 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-mds-i[124675]: 2023-07-14T18:32:59.609+0000 7fabbfdbd700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-mds -n mds.i -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-07-14T18:32:59.907 INFO:journalctl@ceph.mds.i.smithi184.stdout:Jul 14 18:32:59 smithi184 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-mds-i[124675]: 2023-07-14T18:32:59.609+0000 7fabbfdbd700 -1 mds.i *** got signal Terminated *** 2023-07-14T18:33:05.407 INFO:journalctl@ceph.mds.i.smithi184.stdout:Jul 14 18:33:05 smithi184 bash[132110]: ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-mds-i 2023-07-14T18:33:05.606 DEBUG:teuthology.orchestra.run.smithi184:> sudo pkill -f 'journalctl -f -n 0 -u ceph-bf7326ec-2270-11ee-9b33-001a4aab830c@mds.i.service' 2023-07-14T18:33:05.642 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-07-14T18:33:05.642 INFO:tasks.cephadm.mds.i:Stopped mds.i 2023-07-14T18:33:05.643 INFO:tasks.cephadm.mds.l:Stopping mds.l... 2023-07-14T18:33:05.643 DEBUG:teuthology.orchestra.run.smithi184:> sudo systemctl stop ceph-bf7326ec-2270-11ee-9b33-001a4aab830c@mds.l 2023-07-14T18:33:05.907 INFO:journalctl@ceph.mds.l.smithi184.stdout:Jul 14 18:33:05 smithi184 systemd[1]: Stopping Ceph mds.l for bf7326ec-2270-11ee-9b33-001a4aab830c... 2023-07-14T18:33:06.407 INFO:journalctl@ceph.mds.l.smithi184.stdout:Jul 14 18:33:06 smithi184 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-mds-l[123647]: 2023-07-14T18:33:05.999+0000 7f853b2e1700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-mds -n mds.l -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-07-14T18:33:06.408 INFO:journalctl@ceph.mds.l.smithi184.stdout:Jul 14 18:33:06 smithi184 ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-mds-l[123647]: 2023-07-14T18:33:05.999+0000 7f853b2e1700 -1 mds.l *** got signal Terminated *** 2023-07-14T18:33:07.974 INFO:journalctl@ceph.mds.l.smithi184.stdout:Jul 14 18:33:07 smithi184 bash[132249]: ceph-bf7326ec-2270-11ee-9b33-001a4aab830c-mds-l 2023-07-14T18:33:08.181 DEBUG:teuthology.orchestra.run.smithi184:> sudo pkill -f 'journalctl -f -n 0 -u ceph-bf7326ec-2270-11ee-9b33-001a4aab830c@mds.l.service' 2023-07-14T18:33:08.214 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-07-14T18:33:08.215 INFO:tasks.cephadm.mds.l:Stopped mds.l 2023-07-14T18:33:08.215 DEBUG:teuthology.orchestra.run.smithi163:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid bf7326ec-2270-11ee-9b33-001a4aab830c --force --keep-logs 2023-07-14T18:33:08.516 INFO:teuthology.orchestra.run.smithi163.stdout:Deleting cluster with fsid: bf7326ec-2270-11ee-9b33-001a4aab830c 2023-07-14T18:33:10.061 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid bf7326ec-2270-11ee-9b33-001a4aab830c --force --keep-logs 2023-07-14T18:33:10.448 INFO:teuthology.orchestra.run.smithi172.stdout:Deleting cluster with fsid: bf7326ec-2270-11ee-9b33-001a4aab830c 2023-07-14T18:33:12.060 DEBUG:teuthology.orchestra.run.smithi184:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid bf7326ec-2270-11ee-9b33-001a4aab830c --force --keep-logs 2023-07-14T18:33:12.411 INFO:teuthology.orchestra.run.smithi184.stdout:Deleting cluster with fsid: bf7326ec-2270-11ee-9b33-001a4aab830c 2023-07-14T18:33:14.043 DEBUG:teuthology.orchestra.run.smithi163:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2023-07-14T18:33:14.080 DEBUG:teuthology.orchestra.run.smithi172:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2023-07-14T18:33:14.117 DEBUG:teuthology.orchestra.run.smithi184:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2023-07-14T18:33:14.148 INFO:tasks.cephadm:Archiving crash dumps... 2023-07-14T18:33:14.150 DEBUG:teuthology.misc:Transferring archived files from smithi163:/var/lib/ceph/bf7326ec-2270-11ee-9b33-001a4aab830c/crash to /home/teuthworker/archive/pdonnell-2023-07-14_16:44:47-fs:workload-wip-pdonnell-testing-20230714.134335-distro-default-smithi/7337998/remote/smithi163/crash 2023-07-14T18:33:14.156 DEBUG:teuthology.orchestra.run.smithi163:> sudo tar c -f - -C /var/lib/ceph/bf7326ec-2270-11ee-9b33-001a4aab830c/crash -- . 2023-07-14T18:33:14.209 INFO:teuthology.orchestra.run.smithi163.stderr:tar: /var/lib/ceph/bf7326ec-2270-11ee-9b33-001a4aab830c/crash: Cannot open: No such file or directory 2023-07-14T18:33:14.209 INFO:teuthology.orchestra.run.smithi163.stderr:tar: Error is not recoverable: exiting now 2023-07-14T18:33:14.211 DEBUG:teuthology.misc:Transferring archived files from smithi172:/var/lib/ceph/bf7326ec-2270-11ee-9b33-001a4aab830c/crash to /home/teuthworker/archive/pdonnell-2023-07-14_16:44:47-fs:workload-wip-pdonnell-testing-20230714.134335-distro-default-smithi/7337998/remote/smithi172/crash 2023-07-14T18:33:14.212 DEBUG:teuthology.orchestra.run.smithi172:> sudo tar c -f - -C /var/lib/ceph/bf7326ec-2270-11ee-9b33-001a4aab830c/crash -- . 2023-07-14T18:33:14.275 INFO:teuthology.orchestra.run.smithi172.stderr:tar: /var/lib/ceph/bf7326ec-2270-11ee-9b33-001a4aab830c/crash: Cannot open: No such file or directory 2023-07-14T18:33:14.276 INFO:teuthology.orchestra.run.smithi172.stderr:tar: Error is not recoverable: exiting now 2023-07-14T18:33:14.277 DEBUG:teuthology.misc:Transferring archived files from smithi184:/var/lib/ceph/bf7326ec-2270-11ee-9b33-001a4aab830c/crash to /home/teuthworker/archive/pdonnell-2023-07-14_16:44:47-fs:workload-wip-pdonnell-testing-20230714.134335-distro-default-smithi/7337998/remote/smithi184/crash 2023-07-14T18:33:14.279 DEBUG:teuthology.orchestra.run.smithi184:> sudo tar c -f - -C /var/lib/ceph/bf7326ec-2270-11ee-9b33-001a4aab830c/crash -- . 2023-07-14T18:33:14.351 INFO:teuthology.orchestra.run.smithi184.stderr:tar: /var/lib/ceph/bf7326ec-2270-11ee-9b33-001a4aab830c/crash: Cannot open: No such file or directory 2023-07-14T18:33:14.352 INFO:teuthology.orchestra.run.smithi184.stderr:tar: Error is not recoverable: exiting now 2023-07-14T18:33:14.353 INFO:tasks.cephadm:Checking cluster log for badness... 2023-07-14T18:33:14.354 DEBUG:teuthology.orchestra.run.smithi163:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/bf7326ec-2270-11ee-9b33-001a4aab830c/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v 'slow metadata IO' | egrep -v SLOW_OPS | egrep -v 'slow request' | head -n 1 2023-07-14T18:33:14.389 INFO:teuthology.orchestra.run.smithi163.stderr:grep: /var/log/ceph/bf7326ec-2270-11ee-9b33-001a4aab830c/ceph.log: No such file or directory 2023-07-14T18:33:14.392 INFO:tasks.cephadm:Compressing logs... 2023-07-14T18:33:14.394 DEBUG:teuthology.orchestra.run.smithi163:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-07-14T18:33:14.434 DEBUG:teuthology.orchestra.run.smithi172:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-07-14T18:33:14.438 DEBUG:teuthology.orchestra.run.smithi184:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-07-14T18:33:14.461 INFO:teuthology.orchestra.run.smithi163.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/cephadm.log 2023-07-14T18:33:14.462 INFO:teuthology.orchestra.run.smithi163.stderr:: No such file or directory 2023-07-14T18:33:14.462 INFO:teuthology.orchestra.run.smithi163.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.log 2023-07-14T18:33:14.462 INFO:teuthology.orchestra.run.smithi163.stderr:/var/log/ceph/cephadm.log: gzip -5 --verbose -- /var/log/ceph/bf7326ec-2270-11ee-9b33-001a4aab830c/ceph-osd.0.log 2023-07-14T18:33:14.463 INFO:teuthology.orchestra.run.smithi163.stderr:gzip /var/log/ceph/ceph-client.admin.log: -5 --verbose -- /var/log/ceph/bf7326ec-2270-11ee-9b33-001a4aab830c/ceph-mds.g.log 2023-07-14T18:33:14.464 INFO:teuthology.orchestra.run.smithi163.stderr:/var/log/ceph/bf7326ec-2270-11ee-9b33-001a4aab830c/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/bf7326ec-2270-11ee-9b33-001a4aab830c/ceph-mds.a.log 2023-07-14T18:33:14.464 INFO:teuthology.orchestra.run.smithi163.stderr:/var/log/ceph/bf7326ec-2270-11ee-9b33-001a4aab830c/ceph-mds.g.log: gzip -5 --verbose -- /var/log/ceph/bf7326ec-2270-11ee-9b33-001a4aab830c/ceph-osd.6.log 2023-07-14T18:33:14.464 INFO:teuthology.orchestra.run.smithi163.stderr:/var/log/ceph/bf7326ec-2270-11ee-9b33-001a4aab830c/ceph-mds.a.log: gzip -5 --verbose -- /var/log/ceph/bf7326ec-2270-11ee-9b33-001a4aab830c/ceph-osd.3.log 2023-07-14T18:33:14.465 INFO:teuthology.orchestra.run.smithi163.stderr:/var/log/ceph/bf7326ec-2270-11ee-9b33-001a4aab830c/ceph-osd.6.log: /var/log/ceph/bf7326ec-2270-11ee-9b33-001a4aab830c/ceph-osd.3.log: 94.0% -- replaced with /var/log/ceph/ceph-client.admin.log.gz 2023-07-14T18:33:14.465 INFO:teuthology.orchestra.run.smithi163.stderr:gzip -5 --verbose -- /var/log/ceph/bf7326ec-2270-11ee-9b33-001a4aab830c/ceph-mds.d.log 2023-07-14T18:33:14.468 INFO:teuthology.orchestra.run.smithi163.stderr:/var/log/ceph/bf7326ec-2270-11ee-9b33-001a4aab830c/ceph-mds.d.log: gzip -5 --verbose -- /var/log/ceph/bf7326ec-2270-11ee-9b33-001a4aab830c/ceph-mgr.x.log 2023-07-14T18:33:14.473 INFO:teuthology.orchestra.run.smithi163.stderr: 94.7% -- replaced with /var/log/ceph/bf7326ec-2270-11ee-9b33-001a4aab830c/ceph-mds.d.log.gz 2023-07-14T18:33:14.474 INFO:teuthology.orchestra.run.smithi172.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/cephadm.log 2023-07-14T18:33:14.474 INFO:teuthology.orchestra.run.smithi172.stderr:: No such file or directory 2023-07-14T18:33:14.476 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/bf7326ec-2270-11ee-9b33-001a4aab830c/ceph-osd.10.log 2023-07-14T18:33:14.478 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/cephadm.log: gzip -5 --verbose -- /var/log/ceph/bf7326ec-2270-11ee-9b33-001a4aab830c/ceph-mds.h.log 2023-07-14T18:33:14.478 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/bf7326ec-2270-11ee-9b33-001a4aab830c/ceph-osd.10.log: gzip -5 --verbose -- /var/log/ceph/bf7326ec-2270-11ee-9b33-001a4aab830c/ceph-mds.e.log 2023-07-14T18:33:14.478 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/bf7326ec-2270-11ee-9b33-001a4aab830c/ceph-mds.h.log: gzip -5 --verbose -- /var/log/ceph/bf7326ec-2270-11ee-9b33-001a4aab830c/ceph-osd.4.log 2023-07-14T18:33:14.478 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/bf7326ec-2270-11ee-9b33-001a4aab830c/ceph-mds.e.log: gzip -5 --verbose -- /var/log/ceph/bf7326ec-2270-11ee-9b33-001a4aab830c/ceph-osd.1.log 2023-07-14T18:33:14.479 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/bf7326ec-2270-11ee-9b33-001a4aab830c/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/bf7326ec-2270-11ee-9b33-001a4aab830c/ceph-mds.k.log 2023-07-14T18:33:14.479 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/bf7326ec-2270-11ee-9b33-001a4aab830c/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/bf7326ec-2270-11ee-9b33-001a4aab830c/ceph-volume.log 2023-07-14T18:33:14.479 INFO:teuthology.orchestra.run.smithi163.stderr:/var/log/ceph/bf7326ec-2270-11ee-9b33-001a4aab830c/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/bf7326ec-2270-11ee-9b33-001a4aab830c/ceph-osd.9.log 2023-07-14T18:33:14.480 INFO:teuthology.orchestra.run.smithi163.stderr: 93.4% -- replaced with /var/log/ceph/cephadm.log.gz 2023-07-14T18:33:14.480 INFO:teuthology.orchestra.run.smithi163.stderr:gzip -5 --verbose -- /var/log/ceph/bf7326ec-2270-11ee-9b33-001a4aab830c/ceph-volume.log 2023-07-14T18:33:14.480 INFO:teuthology.orchestra.run.smithi163.stderr:/var/log/ceph/bf7326ec-2270-11ee-9b33-001a4aab830c/ceph-osd.9.log: /var/log/ceph/bf7326ec-2270-11ee-9b33-001a4aab830c/ceph-volume.log: 91.6% -- replaced with /var/log/ceph/bf7326ec-2270-11ee-9b33-001a4aab830c/ceph-volume.log.gz 2023-07-14T18:33:14.480 INFO:teuthology.orchestra.run.smithi163.stderr:gzip -5 --verbose -- /var/log/ceph/bf7326ec-2270-11ee-9b33-001a4aab830c/ceph-mds.j.log 2023-07-14T18:33:14.482 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/bf7326ec-2270-11ee-9b33-001a4aab830c/ceph-mds.k.log: gzip -5 --verbose -- /var/log/ceph/bf7326ec-2270-11ee-9b33-001a4aab830c/ceph-osd.7.log 2023-07-14T18:33:14.482 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/bf7326ec-2270-11ee-9b33-001a4aab830c/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/bf7326ec-2270-11ee-9b33-001a4aab830c/ceph-mon.b.log 2023-07-14T18:33:14.482 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/bf7326ec-2270-11ee-9b33-001a4aab830c/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/bf7326ec-2270-11ee-9b33-001a4aab830c/ceph-mds.b.log 2023-07-14T18:33:14.482 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/bf7326ec-2270-11ee-9b33-001a4aab830c/ceph-mon.b.log: gzip -5 --verbose -- /var/log/ceph/bf7326ec-2270-11ee-9b33-001a4aab830c/ceph-mgr.y.log 2023-07-14T18:33:14.484 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/bf7326ec-2270-11ee-9b33-001a4aab830c/ceph-mds.b.log: /var/log/ceph/bf7326ec-2270-11ee-9b33-001a4aab830c/ceph-mgr.y.log: 93.1% -- replaced with /var/log/ceph/bf7326ec-2270-11ee-9b33-001a4aab830c/ceph-mgr.y.log.gz 2023-07-14T18:33:14.490 INFO:teuthology.orchestra.run.smithi163.stderr:/var/log/ceph/bf7326ec-2270-11ee-9b33-001a4aab830c/ceph-mds.j.log: 94.7% -- replaced with /var/log/ceph/bf7326ec-2270-11ee-9b33-001a4aab830c/ceph-mds.j.log.gz 2023-07-14T18:33:14.490 INFO:teuthology.orchestra.run.smithi163.stderr:gzip -5 --verbose -- /var/log/ceph/bf7326ec-2270-11ee-9b33-001a4aab830c/ceph-mon.a.log 2023-07-14T18:33:14.496 INFO:teuthology.orchestra.run.smithi184.stderr:find: ‘/var/log/rbd-target-api’: No such file or directory 2023-07-14T18:33:14.496 INFO:teuthology.orchestra.run.smithi163.stderr:/var/log/ceph/bf7326ec-2270-11ee-9b33-001a4aab830c/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.log 2023-07-14T18:33:14.500 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/cephadm.log 2023-07-14T18:33:14.501 INFO:teuthology.orchestra.run.smithi172.stderr: 91.9% -- replaced with /var/log/ceph/cephadm.log.gz 2023-07-14T18:33:14.513 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/bf7326ec-2270-11ee-9b33-001a4aab830c/ceph-osd.5.log 2023-07-14T18:33:14.514 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/cephadm.log: gzip -5 --verbose -- /var/log/ceph/bf7326ec-2270-11ee-9b33-001a4aab830c/ceph-osd.2.log 2023-07-14T18:33:14.515 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/bf7326ec-2270-11ee-9b33-001a4aab830c/ceph-osd.11.log 2023-07-14T18:33:14.515 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/bf7326ec-2270-11ee-9b33-001a4aab830c/ceph-osd.5.log: /var/log/ceph/bf7326ec-2270-11ee-9b33-001a4aab830c/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/bf7326ec-2270-11ee-9b33-001a4aab830c/ceph-mgr.z.log 2023-07-14T18:33:14.516 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/bf7326ec-2270-11ee-9b33-001a4aab830c/ceph-osd.11.log: gzip -5 --verbose -- /var/log/ceph/bf7326ec-2270-11ee-9b33-001a4aab830c/ceph-osd.8.log 2023-07-14T18:33:14.516 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/bf7326ec-2270-11ee-9b33-001a4aab830c/ceph-mgr.z.log: gzip -5 --verbose -- /var/log/ceph/bf7326ec-2270-11ee-9b33-001a4aab830c/ceph-mds.f.log 2023-07-14T18:33:14.516 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/bf7326ec-2270-11ee-9b33-001a4aab830c/ceph-osd.8.log: gzip -5 --verbose -- /var/log/ceph/bf7326ec-2270-11ee-9b33-001a4aab830c/ceph-mds.c.log 2023-07-14T18:33:14.517 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/bf7326ec-2270-11ee-9b33-001a4aab830c/ceph-mds.f.log: gzip -5 --verbose -- /var/log/ceph/bf7326ec-2270-11ee-9b33-001a4aab830c/ceph-mds.i.log 2023-07-14T18:33:14.520 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/bf7326ec-2270-11ee-9b33-001a4aab830c/ceph-mon.c.log 2023-07-14T18:33:14.520 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/bf7326ec-2270-11ee-9b33-001a4aab830c/ceph-mds.c.log: /var/log/ceph/bf7326ec-2270-11ee-9b33-001a4aab830c/ceph-mds.i.log: gzip -5 --verbose -- /var/log/ceph/bf7326ec-2270-11ee-9b33-001a4aab830c/ceph-volume.log 2023-07-14T18:33:14.520 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/bf7326ec-2270-11ee-9b33-001a4aab830c/ceph-mon.c.log: gzip -5 --verbose -- /var/log/ceph/bf7326ec-2270-11ee-9b33-001a4aab830c/ceph-mds.l.log 2023-07-14T18:33:14.521 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/bf7326ec-2270-11ee-9b33-001a4aab830c/ceph-volume.log: /var/log/ceph/bf7326ec-2270-11ee-9b33-001a4aab830c/ceph-mds.l.log: 93.2% -- replaced with /var/log/ceph/bf7326ec-2270-11ee-9b33-001a4aab830c/ceph-mgr.z.log.gz 2023-07-14T18:33:14.699 INFO:teuthology.orchestra.run.smithi172.stderr: 91.5% -- replaced with /var/log/ceph/bf7326ec-2270-11ee-9b33-001a4aab830c/ceph-volume.log.gz 2023-07-14T18:33:14.761 INFO:teuthology.orchestra.run.smithi163.stderr:/var/log/ceph/ceph-client.0.log: 90.1% -- replaced with /var/log/ceph/bf7326ec-2270-11ee-9b33-001a4aab830c/ceph-mgr.x.log.gz 2023-07-14T18:33:14.764 INFO:teuthology.orchestra.run.smithi184.stderr: 92.2% -- replaced with /var/log/ceph/cephadm.log.gz 2023-07-14T18:33:15.030 INFO:teuthology.orchestra.run.smithi172.stderr: 95.8% -- replaced with /var/log/ceph/bf7326ec-2270-11ee-9b33-001a4aab830c/ceph-mds.e.log.gz 2023-07-14T18:33:15.135 INFO:teuthology.orchestra.run.smithi184.stderr: 92.1% -- replaced with /var/log/ceph/bf7326ec-2270-11ee-9b33-001a4aab830c/ceph-mon.c.log.gz 2023-07-14T18:33:15.358 INFO:teuthology.orchestra.run.smithi163.stderr: 95.6% -- replaced with /var/log/ceph/bf7326ec-2270-11ee-9b33-001a4aab830c/ceph-mds.g.log.gz 2023-07-14T18:33:15.931 INFO:teuthology.orchestra.run.smithi163.stderr: 90.5% -- replaced with /var/log/ceph/bf7326ec-2270-11ee-9b33-001a4aab830c/ceph-mon.a.log.gz 2023-07-14T18:33:16.097 INFO:teuthology.orchestra.run.smithi184.stderr: 91.5% -- replaced with /var/log/ceph/bf7326ec-2270-11ee-9b33-001a4aab830c/ceph-volume.log.gz 2023-07-14T18:33:16.521 INFO:teuthology.orchestra.run.smithi172.stderr: 92.1% -- replaced with /var/log/ceph/bf7326ec-2270-11ee-9b33-001a4aab830c/ceph-mon.b.log.gz 2023-07-14T18:33:16.976 INFO:teuthology.orchestra.run.smithi172.stderr: 95.5% -- replaced with /var/log/ceph/bf7326ec-2270-11ee-9b33-001a4aab830c/ceph-mds.k.log.gz 2023-07-14T18:33:17.721 INFO:teuthology.orchestra.run.smithi184.stderr: 95.6% -- replaced with /var/log/ceph/bf7326ec-2270-11ee-9b33-001a4aab830c/ceph-mds.l.log.gz 2023-07-14T18:33:18.223 INFO:teuthology.orchestra.run.smithi163.stderr: 91.8% -- replaced with /var/log/ceph/bf7326ec-2270-11ee-9b33-001a4aab830c/ceph-osd.6.log.gz 2023-07-14T18:33:18.539 INFO:teuthology.orchestra.run.smithi163.stderr: 92.0% -- replaced with /var/log/ceph/bf7326ec-2270-11ee-9b33-001a4aab830c/ceph-osd.0.log.gz 2023-07-14T18:33:19.082 INFO:teuthology.orchestra.run.smithi163.stderr: 91.7% -- replaced with /var/log/ceph/bf7326ec-2270-11ee-9b33-001a4aab830c/ceph-osd.3.log.gz 2023-07-14T18:33:20.158 INFO:teuthology.orchestra.run.smithi163.stderr: 91.7% -- replaced with /var/log/ceph/bf7326ec-2270-11ee-9b33-001a4aab830c/ceph-osd.9.log.gz 2023-07-14T18:33:20.305 INFO:teuthology.orchestra.run.smithi184.stderr: 95.7% -- replaced with /var/log/ceph/bf7326ec-2270-11ee-9b33-001a4aab830c/ceph-mds.f.log.gz 2023-07-14T18:33:22.626 INFO:teuthology.orchestra.run.smithi172.stderr: 92.1% -- replaced with /var/log/ceph/bf7326ec-2270-11ee-9b33-001a4aab830c/ceph-osd.1.log.gz 2023-07-14T18:33:22.860 INFO:teuthology.orchestra.run.smithi184.stderr: 91.8% -- replaced with /var/log/ceph/bf7326ec-2270-11ee-9b33-001a4aab830c/ceph-osd.11.log.gz 2023-07-14T18:33:23.909 INFO:teuthology.orchestra.run.smithi172.stderr: 91.8% -- replaced with /var/log/ceph/bf7326ec-2270-11ee-9b33-001a4aab830c/ceph-osd.4.log.gz 2023-07-14T18:33:24.093 INFO:teuthology.orchestra.run.smithi172.stderr: 91.8% -- replaced with /var/log/ceph/bf7326ec-2270-11ee-9b33-001a4aab830c/ceph-osd.10.log.gz 2023-07-14T18:33:24.221 INFO:teuthology.orchestra.run.smithi163.stderr: 93.9% -- replaced with /var/log/ceph/ceph-client.0.log.gz 2023-07-14T18:33:24.633 INFO:teuthology.orchestra.run.smithi172.stderr: 91.3% -- replaced with /var/log/ceph/bf7326ec-2270-11ee-9b33-001a4aab830c/ceph-osd.7.log.gz 2023-07-14T18:33:25.580 INFO:teuthology.orchestra.run.smithi184.stderr: 91.6% -- replaced with /var/log/ceph/bf7326ec-2270-11ee-9b33-001a4aab830c/ceph-osd.2.log.gz 2023-07-14T18:33:26.428 INFO:teuthology.orchestra.run.smithi184.stderr: 91.8% -- replaced with /var/log/ceph/bf7326ec-2270-11ee-9b33-001a4aab830c/ceph-osd.5.log.gz 2023-07-14T18:33:29.599 INFO:teuthology.orchestra.run.smithi184.stderr: 91.6% -- replaced with /var/log/ceph/bf7326ec-2270-11ee-9b33-001a4aab830c/ceph-osd.8.log.gz 2023-07-14T18:34:43.954 INFO:teuthology.orchestra.run.smithi163.stderr: 97.3% -- replaced with /var/log/ceph/bf7326ec-2270-11ee-9b33-001a4aab830c/ceph-mds.a.log.gz 2023-07-14T18:34:43.957 INFO:teuthology.orchestra.run.smithi163.stderr: 2023-07-14T18:34:43.957 INFO:teuthology.orchestra.run.smithi163.stderr:real 1m29.510s 2023-07-14T18:34:43.957 INFO:teuthology.orchestra.run.smithi163.stderr:user 1m54.795s 2023-07-14T18:34:43.958 INFO:teuthology.orchestra.run.smithi163.stderr:sys 0m4.801s 2023-07-14T18:35:08.576 INFO:teuthology.orchestra.run.smithi172.stderr: 95.8% -- replaced with /var/log/ceph/bf7326ec-2270-11ee-9b33-001a4aab830c/ceph-mds.b.log.gz 2023-07-14T18:37:26.917 INFO:teuthology.orchestra.run.smithi184.stderr: 97.2% -- replaced with /var/log/ceph/bf7326ec-2270-11ee-9b33-001a4aab830c/ceph-mds.c.log.gz 2023-07-14T18:37:26.990 INFO:teuthology.orchestra.run.smithi172.stderr: 97.6% -- replaced with /var/log/ceph/bf7326ec-2270-11ee-9b33-001a4aab830c/ceph-mds.h.log.gz 2023-07-14T18:37:26.992 INFO:teuthology.orchestra.run.smithi172.stderr: 2023-07-14T18:37:26.993 INFO:teuthology.orchestra.run.smithi172.stderr:real 4m12.547s 2023-07-14T18:37:26.993 INFO:teuthology.orchestra.run.smithi172.stderr:user 4m17.357s 2023-07-14T18:37:26.993 INFO:teuthology.orchestra.run.smithi172.stderr:sys 0m12.742s 2023-07-14T18:37:34.112 INFO:teuthology.orchestra.run.smithi184.stderr: 97.9% -- replaced with /var/log/ceph/bf7326ec-2270-11ee-9b33-001a4aab830c/ceph-mds.i.log.gz 2023-07-14T18:37:34.134 INFO:teuthology.orchestra.run.smithi184.stderr: 2023-07-14T18:37:34.134 INFO:teuthology.orchestra.run.smithi184.stderr:real 4m19.687s 2023-07-14T18:37:34.135 INFO:teuthology.orchestra.run.smithi184.stderr:user 4m22.567s 2023-07-14T18:37:34.135 INFO:teuthology.orchestra.run.smithi184.stderr:sys 0m14.026s 2023-07-14T18:37:34.135 INFO:tasks.cephadm:Archiving logs... 2023-07-14T18:37:34.136 DEBUG:teuthology.misc:Transferring archived files from smithi163:/var/log/ceph to /home/teuthworker/archive/pdonnell-2023-07-14_16:44:47-fs:workload-wip-pdonnell-testing-20230714.134335-distro-default-smithi/7337998/remote/smithi163/log 2023-07-14T18:37:34.138 DEBUG:teuthology.orchestra.run.smithi163:> sudo tar c -f - -C /var/log/ceph -- . 2023-07-14T18:37:43.703 DEBUG:teuthology.misc:Transferring archived files from smithi172:/var/log/ceph to /home/teuthworker/archive/pdonnell-2023-07-14_16:44:47-fs:workload-wip-pdonnell-testing-20230714.134335-distro-default-smithi/7337998/remote/smithi172/log 2023-07-14T18:37:43.704 DEBUG:teuthology.orchestra.run.smithi172:> sudo tar c -f - -C /var/log/ceph -- . 2023-07-14T18:38:03.136 DEBUG:teuthology.misc:Transferring archived files from smithi184:/var/log/ceph to /home/teuthworker/archive/pdonnell-2023-07-14_16:44:47-fs:workload-wip-pdonnell-testing-20230714.134335-distro-default-smithi/7337998/remote/smithi184/log 2023-07-14T18:38:03.138 DEBUG:teuthology.orchestra.run.smithi184:> sudo tar c -f - -C /var/log/ceph -- . 2023-07-14T18:38:22.397 INFO:tasks.cephadm:Removing cluster... 2023-07-14T18:38:22.398 DEBUG:teuthology.orchestra.run.smithi163:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid bf7326ec-2270-11ee-9b33-001a4aab830c --force 2023-07-14T18:38:22.701 INFO:teuthology.orchestra.run.smithi163.stdout:Deleting cluster with fsid: bf7326ec-2270-11ee-9b33-001a4aab830c 2023-07-14T18:38:23.250 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid bf7326ec-2270-11ee-9b33-001a4aab830c --force 2023-07-14T18:38:23.770 INFO:teuthology.orchestra.run.smithi172.stdout:Deleting cluster with fsid: bf7326ec-2270-11ee-9b33-001a4aab830c 2023-07-14T18:38:24.380 DEBUG:teuthology.orchestra.run.smithi184:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid bf7326ec-2270-11ee-9b33-001a4aab830c --force 2023-07-14T18:38:24.853 INFO:teuthology.orchestra.run.smithi184.stdout:Deleting cluster with fsid: bf7326ec-2270-11ee-9b33-001a4aab830c 2023-07-14T18:38:25.470 INFO:tasks.cephadm:Removing cephadm ... 2023-07-14T18:38:25.471 DEBUG:teuthology.orchestra.run.smithi163:> rm -rf /home/ubuntu/cephtest/cephadm 2023-07-14T18:38:25.493 DEBUG:teuthology.orchestra.run.smithi172:> rm -rf /home/ubuntu/cephtest/cephadm 2023-07-14T18:38:25.529 DEBUG:teuthology.orchestra.run.smithi184:> rm -rf /home/ubuntu/cephtest/cephadm 2023-07-14T18:38:25.557 INFO:tasks.cephadm:Teardown complete 2023-07-14T18:38:25.558 DEBUG:teuthology.run_tasks:Unwinding manager install 2023-07-14T18:38:25.578 ERROR:teuthology.contextutil:Saw exception from nested tasks Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_aa6a80e6cc655fff48452a7eca02070e61d074fc/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/git.ceph.com_teuthology_aa6a80e6cc655fff48452a7eca02070e61d074fc/teuthology/task/install/__init__.py", line 626, in task yield File "/home/teuthworker/src/git.ceph.com_teuthology_aa6a80e6cc655fff48452a7eca02070e61d074fc/teuthology/run_tasks.py", line 192, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_81c9387d2e7576da065747ec9c16d1c7d69016ec/qa/tasks/fwd_scrub.py", line 164, in task stop_all_fwd_scrubbers(ctx.ceph[config['cluster']].thrashers) File "/home/teuthworker/src/git.ceph.com_ceph-c_81c9387d2e7576da065747ec9c16d1c7d69016ec/qa/tasks/fwd_scrub.py", line 99, in stop_all_fwd_scrubbers raise RuntimeError(f"error during scrub thrashing: {thrasher.exception}") RuntimeError: error during scrub thrashing: reached maximum tries (31) after waiting for 900 seconds 2023-07-14T18:38:25.581 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2023-07-14T18:38:25.581 DEBUG:teuthology.orchestra.run.smithi163:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-07-14T18:38:25.585 DEBUG:teuthology.orchestra.run.smithi172:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-07-14T18:38:25.588 DEBUG:teuthology.orchestra.run.smithi184:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-07-14T18:38:26.571 DEBUG:teuthology.run_tasks:Unwinding manager clock 2023-07-14T18:38:26.591 INFO:teuthology.task.clock:Checking final clock skew... 2023-07-14T18:38:26.591 DEBUG:teuthology.orchestra.run.smithi163:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-07-14T18:38:26.594 DEBUG:teuthology.orchestra.run.smithi172:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-07-14T18:38:26.597 DEBUG:teuthology.orchestra.run.smithi184:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-07-14T18:38:26.611 INFO:teuthology.orchestra.run.smithi163.stderr:bash: ntpq: command not found 2023-07-14T18:38:26.614 INFO:teuthology.orchestra.run.smithi172.stderr:bash: ntpq: command not found 2023-07-14T18:38:26.617 INFO:teuthology.orchestra.run.smithi163.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-07-14T18:38:26.618 INFO:teuthology.orchestra.run.smithi163.stdout:=============================================================================== 2023-07-14T18:38:26.618 INFO:teuthology.orchestra.run.smithi163.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 51 +762us[ +762us] +/- 88ms 2023-07-14T18:38:26.618 INFO:teuthology.orchestra.run.smithi163.stdout:^* hv02.front.sepia.ceph.com 3 6 377 52 -4351us[-4299us] +/- 72ms 2023-07-14T18:38:26.619 INFO:teuthology.orchestra.run.smithi163.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 52 +3672us[+3672us] +/- 71ms 2023-07-14T18:38:26.619 INFO:teuthology.orchestra.run.smithi163.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2023-07-14T18:38:26.620 INFO:teuthology.orchestra.run.smithi184.stderr:bash: ntpq: command not found 2023-07-14T18:38:26.640 INFO:teuthology.orchestra.run.smithi184.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-07-14T18:38:26.641 INFO:teuthology.orchestra.run.smithi184.stdout:=============================================================================== 2023-07-14T18:38:26.641 INFO:teuthology.orchestra.run.smithi184.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 52 +771us[ +771us] +/- 88ms 2023-07-14T18:38:26.642 INFO:teuthology.orchestra.run.smithi184.stdout:^* hv02.front.sepia.ceph.com 3 6 377 56 -4353us[-4311us] +/- 72ms 2023-07-14T18:38:26.642 INFO:teuthology.orchestra.run.smithi184.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 53 +3668us[+3668us] +/- 71ms 2023-07-14T18:38:26.643 INFO:teuthology.orchestra.run.smithi184.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2023-07-14T18:38:26.644 INFO:teuthology.orchestra.run.smithi172.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-07-14T18:38:26.645 INFO:teuthology.orchestra.run.smithi172.stdout:=============================================================================== 2023-07-14T18:38:26.645 INFO:teuthology.orchestra.run.smithi172.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 52 +755us[ +755us] +/- 88ms 2023-07-14T18:38:26.645 INFO:teuthology.orchestra.run.smithi172.stdout:^* hv02.front.sepia.ceph.com 3 6 377 53 -4361us[-4393us] +/- 72ms 2023-07-14T18:38:26.645 INFO:teuthology.orchestra.run.smithi172.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 55 +3671us[+3639us] +/- 71ms 2023-07-14T18:38:26.645 INFO:teuthology.orchestra.run.smithi172.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2023-07-14T18:38:26.646 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2023-07-14T18:38:26.658 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2023-07-14T18:38:26.659 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2023-07-14T18:38:26.677 DEBUG:teuthology.orchestra.run.smithi163:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2023-07-14T18:38:26.787 DEBUG:teuthology.orchestra.run.smithi172:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2023-07-14T18:38:26.949 DEBUG:teuthology.orchestra.run.smithi184:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2023-07-14T18:38:27.142 DEBUG:teuthology.orchestra.run.smithi163:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-07-14T18:38:27.178 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-07-14T18:38:27.179 DEBUG:teuthology.orchestra.run.smithi172:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-07-14T18:38:27.215 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-07-14T18:38:27.216 DEBUG:teuthology.orchestra.run.smithi184:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-07-14T18:38:27.250 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-07-14T18:38:27.251 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2023-07-14T18:38:27.264 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2023-07-14T18:38:27.276 INFO:teuthology.task.internal:Duration was 2946.538126 seconds 2023-07-14T18:38:27.276 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2023-07-14T18:38:27.287 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2023-07-14T18:38:27.287 DEBUG:teuthology.orchestra.run.smithi163:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-07-14T18:38:27.290 DEBUG:teuthology.orchestra.run.smithi172:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-07-14T18:38:27.293 DEBUG:teuthology.orchestra.run.smithi184:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-07-14T18:38:27.338 INFO:teuthology.orchestra.run.smithi163.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-07-14T18:38:27.351 INFO:teuthology.orchestra.run.smithi172.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-07-14T18:38:27.367 INFO:teuthology.orchestra.run.smithi184.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-07-14T18:38:27.675 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2023-07-14T18:38:27.676 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi163.front.sepia.ceph.com 2023-07-14T18:38:27.676 DEBUG:teuthology.orchestra.run.smithi163:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-07-14T18:38:27.699 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi172.front.sepia.ceph.com 2023-07-14T18:38:27.700 DEBUG:teuthology.orchestra.run.smithi172:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-07-14T18:38:27.739 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi184.front.sepia.ceph.com 2023-07-14T18:38:27.739 DEBUG:teuthology.orchestra.run.smithi184:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-07-14T18:38:27.768 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2023-07-14T18:38:27.768 DEBUG:teuthology.orchestra.run.smithi163:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-07-14T18:38:27.771 DEBUG:teuthology.orchestra.run.smithi172:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-07-14T18:38:27.781 DEBUG:teuthology.orchestra.run.smithi184:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-07-14T18:38:27.887 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2023-07-14T18:38:27.887 DEBUG:teuthology.orchestra.run.smithi163:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-07-14T18:38:27.890 DEBUG:teuthology.orchestra.run.smithi172:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-07-14T18:38:27.893 DEBUG:teuthology.orchestra.run.smithi184:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-07-14T18:38:28.172 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2023-07-14T18:38:28.183 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2023-07-14T18:38:28.184 DEBUG:teuthology.orchestra.run.smithi163:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-07-14T18:38:28.212 DEBUG:teuthology.orchestra.run.smithi172:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-07-14T18:38:28.246 DEBUG:teuthology.orchestra.run.smithi184:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-07-14T18:38:28.291 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2023-07-14T18:38:28.310 DEBUG:teuthology.orchestra.run.smithi163:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-07-14T18:38:28.313 DEBUG:teuthology.orchestra.run.smithi172:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-07-14T18:38:28.315 DEBUG:teuthology.orchestra.run.smithi184:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-07-14T18:38:28.337 INFO:teuthology.orchestra.run.smithi163.stdout:kernel.core_pattern = core 2023-07-14T18:38:28.353 INFO:teuthology.orchestra.run.smithi172.stdout:kernel.core_pattern = core 2023-07-14T18:38:28.369 INFO:teuthology.orchestra.run.smithi184.stdout:kernel.core_pattern = core 2023-07-14T18:38:28.390 DEBUG:teuthology.orchestra.run.smithi163:> test -e /home/ubuntu/cephtest/archive/coredump 2023-07-14T18:38:28.407 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-07-14T18:38:28.407 DEBUG:teuthology.orchestra.run.smithi172:> test -e /home/ubuntu/cephtest/archive/coredump 2023-07-14T18:38:28.424 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-07-14T18:38:28.425 DEBUG:teuthology.orchestra.run.smithi184:> test -e /home/ubuntu/cephtest/archive/coredump 2023-07-14T18:38:28.447 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-07-14T18:38:28.448 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2023-07-14T18:38:28.459 INFO:teuthology.task.internal:Transferring archived files... 2023-07-14T18:38:28.460 DEBUG:teuthology.misc:Transferring archived files from smithi163:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/pdonnell-2023-07-14_16:44:47-fs:workload-wip-pdonnell-testing-20230714.134335-distro-default-smithi/7337998/remote/smithi163 2023-07-14T18:38:28.461 DEBUG:teuthology.orchestra.run.smithi163:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-07-14T18:38:28.501 DEBUG:teuthology.misc:Transferring archived files from smithi172:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/pdonnell-2023-07-14_16:44:47-fs:workload-wip-pdonnell-testing-20230714.134335-distro-default-smithi/7337998/remote/smithi172 2023-07-14T18:38:28.501 DEBUG:teuthology.orchestra.run.smithi172:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-07-14T18:38:28.538 DEBUG:teuthology.misc:Transferring archived files from smithi184:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/pdonnell-2023-07-14_16:44:47-fs:workload-wip-pdonnell-testing-20230714.134335-distro-default-smithi/7337998/remote/smithi184 2023-07-14T18:38:28.539 DEBUG:teuthology.orchestra.run.smithi184:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-07-14T18:38:28.577 INFO:teuthology.task.internal:Removing archive directory... 2023-07-14T18:38:28.578 DEBUG:teuthology.orchestra.run.smithi163:> rm -rf -- /home/ubuntu/cephtest/archive 2023-07-14T18:38:28.582 DEBUG:teuthology.orchestra.run.smithi172:> rm -rf -- /home/ubuntu/cephtest/archive 2023-07-14T18:38:28.585 DEBUG:teuthology.orchestra.run.smithi184:> rm -rf -- /home/ubuntu/cephtest/archive 2023-07-14T18:38:28.628 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2023-07-14T18:38:28.650 INFO:teuthology.task.internal:Not uploading archives. 2023-07-14T18:38:28.650 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2023-07-14T18:38:28.701 INFO:teuthology.task.internal:Tidying up after the test... 2023-07-14T18:38:28.702 DEBUG:teuthology.orchestra.run.smithi163:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-07-14T18:38:28.705 DEBUG:teuthology.orchestra.run.smithi172:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-07-14T18:38:28.707 DEBUG:teuthology.orchestra.run.smithi184:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-07-14T18:38:28.719 INFO:teuthology.orchestra.run.smithi163.stdout: 262307 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Jul 14 18:38 /home/ubuntu/cephtest 2023-07-14T18:38:28.721 INFO:teuthology.orchestra.run.smithi172.stdout: 262307 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Jul 14 18:38 /home/ubuntu/cephtest 2023-07-14T18:38:28.723 INFO:teuthology.orchestra.run.smithi184.stdout: 262307 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Jul 14 18:38 /home/ubuntu/cephtest 2023-07-14T18:38:28.731 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2023-07-14T18:38:28.745 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2023-07-14T18:38:28.760 DEBUG:teuthology.run_tasks:Exception was not quenched, exiting: RuntimeError: error during scrub thrashing: reached maximum tries (31) after waiting for 900 seconds 2023-07-14T18:38:28.761 INFO:teuthology.nuke:Checking targets against current locks 2023-07-14T18:38:28.791 DEBUG:teuthology.nuke:shortname: smithi163 2023-07-14T18:38:28.792 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-07-14T18:38:28.816 DEBUG:teuthology.nuke:shortname: smithi172 2023-07-14T18:38:28.816 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-07-14T18:38:28.820 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi163.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2023-07-14_16:44:47-fs:workload-wip-pdonnell-testing-20230714.134335-distro-default-smithi/7337998', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-14 17:41:36.212229', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCpUxo5ay/ucdkX9rleNMm8Ofp24XRXUtJPOK3Ji3XBpTiUgmmwneaY6316+3CG+k4K0p3IebanuyTvZApjm02/dNCvu8yD3rjEpWVgIuqYH8O3lEdN9DXcCX+7xHJE0m18+ZPsJQVsNrNJxY+5zqyNnBc8jpZq2LStsWwPOKPWhauANRkOBFSGDoLppWZbLx/yJs+R0qoNLLK9LpKQTUnqsapXvbD27OpPahzj/qbNxFPPyY6XrrldZ6qEO+EjJOujFLH3gzv0kJu10DCuzxrpz6ston4RPi1O3GgcHnF4Mqr/W9VwZ94UTMh+k4dIFRVqJEKrcwRHa5kFsvH/WhVx0Ygr/MiV/Q86mmV7JT+/MpzIRTtWyei5L9IBeZIE9cwzj+mOk6SD/t1roIVEGVV/uF2AyFDVBPr6F8oZ822OGpUyyaDsWTitPNdTX4TC3zdSrLc9tyDa1P74eH/ZLeTSf+C6pM/cepOhQaa6XzpDiPSuJUm9HOQxUlEAvcqa7Ac='} 2023-07-14T18:38:28.842 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi172.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2023-07-14_16:44:47-fs:workload-wip-pdonnell-testing-20230714.134335-distro-default-smithi/7337998', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-14 17:41:36.215246', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCpUxo5ay/ucdkX9rleNMm8Ofp24XRXUtJPOK3Ji3XBpTiUgmmwneaY6316+3CG+k4K0p3IebanuyTvZApjm02/dNCvu8yD3rjEpWVgIuqYH8O3lEdN9DXcCX+7xHJE0m18+ZPsJQVsNrNJxY+5zqyNnBc8jpZq2LStsWwPOKPWhauANRkOBFSGDoLppWZbLx/yJs+R0qoNLLK9LpKQTUnqsapXvbD27OpPahzj/qbNxFPPyY6XrrldZ6qEO+EjJOujFLH3gzv0kJu10DCuzxrpz6ston4RPi1O3GgcHnF4Mqr/W9VwZ94UTMh+k4dIFRVqJEKrcwRHa5kFsvH/WhVx0Ygr/MiV/Q86mmV7JT+/MpzIRTtWyei5L9IBeZIE9cwzj+mOk6SD/t1roIVEGVV/uF2AyFDVBPr6F8oZ822OGpUyyaDsWTitPNdTX4TC3zdSrLc9tyDa1P74eH/ZLeTSf+C6pM/cepOhQaa6XzpDiPSuJUm9HOQxUlEAvcqa7Ac='} 2023-07-14T18:38:28.845 DEBUG:teuthology.nuke:shortname: smithi184 2023-07-14T18:38:28.846 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-07-14T18:38:28.866 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi184.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2023-07-14_16:44:47-fs:workload-wip-pdonnell-testing-20230714.134335-distro-default-smithi/7337998', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-14 17:41:36.213859', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCpUxo5ay/ucdkX9rleNMm8Ofp24XRXUtJPOK3Ji3XBpTiUgmmwneaY6316+3CG+k4K0p3IebanuyTvZApjm02/dNCvu8yD3rjEpWVgIuqYH8O3lEdN9DXcCX+7xHJE0m18+ZPsJQVsNrNJxY+5zqyNnBc8jpZq2LStsWwPOKPWhauANRkOBFSGDoLppWZbLx/yJs+R0qoNLLK9LpKQTUnqsapXvbD27OpPahzj/qbNxFPPyY6XrrldZ6qEO+EjJOujFLH3gzv0kJu10DCuzxrpz6ston4RPi1O3GgcHnF4Mqr/W9VwZ94UTMh+k4dIFRVqJEKrcwRHa5kFsvH/WhVx0Ygr/MiV/Q86mmV7JT+/MpzIRTtWyei5L9IBeZIE9cwzj+mOk6SD/t1roIVEGVV/uF2AyFDVBPr6F8oZ822OGpUyyaDsWTitPNdTX4TC3zdSrLc9tyDa1P74eH/ZLeTSf+C6pM/cepOhQaa6XzpDiPSuJUm9HOQxUlEAvcqa7Ac='} 2023-07-14T18:38:28.879 INFO:teuthology.orchestra.console:Power off smithi163 2023-07-14T18:38:28.880 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi163.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-14T18:38:28.902 INFO:teuthology.orchestra.console:Power off smithi172 2023-07-14T18:38:28.903 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi172.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-14T18:38:28.919 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi163.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-14T18:38:28.933 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi172.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-14T18:38:28.967 INFO:teuthology.orchestra.console:Power off smithi184 2023-07-14T18:38:28.968 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi184.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-14T18:38:28.995 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi184.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-14T18:38:32.952 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi163.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-14T18:38:32.981 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi172.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-14T18:38:33.032 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi184.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-14T18:38:38.065 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi163.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-14T18:38:38.096 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi172.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-14T18:38:38.145 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi184.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-14T18:38:38.308 INFO:teuthology.orchestra.console:Power off for smithi172 completed 2023-07-14T18:38:43.178 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi163.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-14T18:38:43.260 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi184.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-14T18:38:48.298 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi163.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-14T18:38:48.374 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi184.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-14T18:38:48.586 INFO:teuthology.orchestra.console:Power off for smithi184 completed 2023-07-14T18:38:53.412 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi163.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-14T18:38:53.624 INFO:teuthology.orchestra.console:Power off for smithi163 completed 2023-07-14T18:38:53.740 INFO:teuthology.run:Summary data: description: fs:workload/{0-rhel_8 begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/fuse objectstore-ec/bluestore-ec-root omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/multi/{balancer/automatic export-check n/5 replication/always} standby-replay tasks/{0-subvolume/{with-namespace-isolated-and-quota} 1-check-counter 2-scrub/yes 3-snaps/no 4-flush/no 5-workunit/suites/fsx}} duration: 2946.5381264686584 failure_reason: 'Command failed (workunit test suites/fsx.sh) on smithi163 with status 110: ''mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=81c9387d2e7576da065747ec9c16d1c7d69016ec TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/fsx.sh''' flavor: default owner: scheduled_pdonnell@teuthology sentry_event: https://sentry.ceph.com/organizations/ceph/?query=00c1d331cbf04cf1b88b09b1b2e50570 status: fail success: false 2023-07-14T18:38:53.741 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-14T18:38:53.846 INFO:teuthology.run:FAIL